-- Logs begin at Wed 2022-09-14 08:01:13 UTC, end at Wed 2022-09-14 10:33:27 UTC. -- Sep 14 08:37:30.117680 n-d-836830-18 systemd[1]: Starting Devstack devstack@n-api.service... Sep 14 08:37:30.127855 n-d-836830-18 devstack@n-api.service[112913]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 14 08:37:30.129874 n-d-836830-18 devstack@n-api.service[112913]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Sep 14 08:37:30 2022] *** Sep 14 08:37:30.129874 n-d-836830-18 devstack@n-api.service[112913]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 14 08:37:30.129874 n-d-836830-18 devstack@n-api.service[112913]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 14 08:37:30.129874 n-d-836830-18 devstack@n-api.service[112913]: nodename: n-d-836830-18 Sep 14 08:37:30.129874 n-d-836830-18 devstack@n-api.service[112913]: machine: x86_64 Sep 14 08:37:30.129874 n-d-836830-18 devstack@n-api.service[112913]: clock source: unix Sep 14 08:37:30.129874 n-d-836830-18 devstack@n-api.service[112913]: pcre jit disabled Sep 14 08:37:30.129874 n-d-836830-18 devstack@n-api.service[112913]: detected number of CPU cores: 4 Sep 14 08:37:30.129874 n-d-836830-18 devstack@n-api.service[112913]: current working directory: / Sep 14 08:37:30.129874 n-d-836830-18 devstack@n-api.service[112913]: detected binary path: /usr/bin/uwsgi-core Sep 14 08:37:30.129874 n-d-836830-18 devstack@n-api.service[112913]: your processes number limit is 47680 Sep 14 08:37:30.130648 n-d-836830-18 devstack@n-api.service[112913]: your memory page size is 4096 bytes Sep 14 08:37:30.130648 n-d-836830-18 devstack@n-api.service[112913]: detected max file descriptor number: 2048 Sep 14 08:37:30.130648 n-d-836830-18 devstack@n-api.service[112913]: lock engine: pthread robust mutexes Sep 14 08:37:30.130648 n-d-836830-18 devstack@n-api.service[112913]: thunder lock: enabled Sep 14 08:37:30.130648 n-d-836830-18 devstack@n-api.service[112913]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 14 08:37:30.130648 n-d-836830-18 devstack@n-api.service[112913]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 14 08:37:30.170573 n-d-836830-18 devstack@n-api.service[112913]: Python main interpreter initialized at 0x55952b2b59c0 Sep 14 08:37:30.170573 n-d-836830-18 devstack@n-api.service[112913]: python threads support enabled Sep 14 08:37:30.170573 n-d-836830-18 devstack@n-api.service[112913]: your server socket listen backlog is limited to 100 connections Sep 14 08:37:30.170573 n-d-836830-18 devstack@n-api.service[112913]: your mercy for graceful operations on workers is 90 seconds Sep 14 08:37:30.170991 n-d-836830-18 devstack@n-api.service[112913]: mapped 403077 bytes (393 KB) for 2 cores Sep 14 08:37:30.171090 n-d-836830-18 devstack@n-api.service[112913]: *** Operational MODE: preforking *** Sep 14 08:37:30.171292 n-d-836830-18 devstack@n-api.service[112913]: *** uWSGI is running in multiple interpreter mode *** Sep 14 08:37:30.171292 n-d-836830-18 devstack@n-api.service[112913]: spawned uWSGI master process (pid: 112913) Sep 14 08:37:30.171509 n-d-836830-18 systemd[1]: Started Devstack devstack@n-api.service. Sep 14 08:37:30.172223 n-d-836830-18 devstack@n-api.service[112913]: spawned uWSGI worker 1 (pid: 112914, cores: 1) Sep 14 08:37:30.172487 n-d-836830-18 devstack@n-api.service[112913]: spawned uWSGI worker 2 (pid: 112915, cores: 1) Sep 14 08:37:30.172589 n-d-836830-18 devstack@n-api.service[112913]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 14 08:37:30.835869 n-d-836830-18 devstack@n-api.service[112914]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 14 08:37:30.841190 n-d-836830-18 devstack@n-api.service[112915]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 14 08:37:31.949791 n-d-836830-18 devstack@n-api.service[112915]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 14 08:37:31.949791 n-d-836830-18 devstack@n-api.service[112915]: from cryptography.utils import int_from_bytes Sep 14 08:37:31.950537 n-d-836830-18 devstack@n-api.service[112915]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 14 08:37:31.950537 n-d-836830-18 devstack@n-api.service[112915]: from cryptography.utils import int_from_bytes Sep 14 08:37:31.958400 n-d-836830-18 devstack@n-api.service[112914]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 14 08:37:31.958400 n-d-836830-18 devstack@n-api.service[112914]: from cryptography.utils import int_from_bytes Sep 14 08:37:31.958859 n-d-836830-18 devstack@n-api.service[112914]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 14 08:37:31.958859 n-d-836830-18 devstack@n-api.service[112914]: from cryptography.utils import int_from_bytes Sep 14 08:37:34.467234 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 14 08:37:34.467834 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 14 08:37:34.467960 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 14 08:37:34.467960 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 14 08:37:34.468446 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 14 08:37:34.468539 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 14 08:37:34.468649 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 14 08:37:34.468649 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 14 08:37:34.468819 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 14 08:37:34.468931 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 14 08:37:34.469018 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.469296 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.469396 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.469623 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.469738 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.469949 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.470042 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.470281 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.470376 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.470594 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.470697 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.470918 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.471047 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.471272 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.471377 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.471598 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.471693 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.471861 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.471966 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.472185 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.472305 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.472504 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.472614 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-836830-18 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.472833 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.472949 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-836830-18 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.473150 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.473270 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.473456 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.473571 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.473780 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.473885 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.474093 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.474297 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.474397 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.474489 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.474719 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.474809 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.475061 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.475235 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.475580 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.475714 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.475899 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.476026 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.476216 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.476533 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.476668 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.476791 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.476934 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.477077 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.477224 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.477350 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.477481 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.477615 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.477783 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.477920 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.478100 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.478234 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.478431 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.478558 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.478749 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.478877 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-836830-18 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.479196 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-836830-18 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.479842 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.480048 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.480359 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.480804 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.481207 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.481598 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.481697 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.481978 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.482173 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.482328 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.482752 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.482841 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.483116 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.483325 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.483682 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.484024 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.484363 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.484703 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.485025 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.485347 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.485674 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.486008 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.486324 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.486730 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.486879 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.487223 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.487331 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.487625 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.487793 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.487971 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.488320 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.488420 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.488669 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.488757 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.489011 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.489101 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.489280 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.489370 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.489548 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.489662 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.489885 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.489996 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.490223 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.490322 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.490548 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.490636 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.490872 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.490982 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.491227 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.491344 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.491543 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.491641 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.491863 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.491951 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.492255 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.492557 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.492830 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.492918 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.493233 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.493414 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.493512 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.493753 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.494015 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.494104 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.494409 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.494601 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.494734 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.495650 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.495781 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.495984 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.496079 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.496308 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.496400 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.496629 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.496729 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.60 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.496949 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.497048 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.60 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.497270 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.497489 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.497636 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.497771 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.497943 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.498084 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.498253 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.498406 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.498620 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.498762 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.498974 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.499120 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.499294 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.499439 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.499636 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.499784 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.60 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.499959 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.500111 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.60 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.500296 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.500443 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.500616 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.500760 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.500929 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.501080 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.501215 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.501359 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.501496 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.501641 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.501776 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.501920 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.502108 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.502250 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.502426 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.502569 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.502742 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.502904 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.503077 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.503224 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.503496 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.503980 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.504212 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.504354 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.504573 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.504717 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.504864 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.505006 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.505151 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.505287 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.505434 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.505571 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.505736 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.505882 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.506032 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.506168 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.506304 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.506446 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.506582 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.506743 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.506902 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.507078 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.507222 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.507369 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.507511 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.507646 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.507887 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.508040 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.508184 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.508328 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.508471 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.508635 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.508795 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.508933 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.509068 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.509202 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.509376 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.509513 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.509684 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.509829 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.509997 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.510156 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.510293 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.510448 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.510597 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.510757 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.510905 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.511094 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.511246 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.511423 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.511600 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.511745 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.511916 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.512060 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.512195 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.512371 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.512519 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.512681 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.512819 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.512991 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.513129 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.513309 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.513448 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.513608 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.513753 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.513920 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.514062 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.514245 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.514467 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.514718 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.514983 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.515301 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.515447 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.515622 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.515959 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.516101 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.516262 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.516586 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.516744 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.516915 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.517060 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.517239 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.517386 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.517560 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.517735 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.517896 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.518048 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.518197 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.518334 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.518477 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.518651 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.518790 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.518988 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.519134 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.519295 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.519433 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.519604 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.519746 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.519930 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.520094 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.520253 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.520403 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.520570 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.520721 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.520897 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.521043 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.521217 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.521375 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.521544 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.521685 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:37:34.521872 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.522014 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.522195 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.522350 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.522524 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.522667 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.522852 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.523062 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.523212 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.523357 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.523533 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.523674 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.523860 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.524003 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.524180 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.524322 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.524496 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.524730 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.524940 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.525089 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.525226 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.525379 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.525515 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.525652 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.525787 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.525928 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.526073 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.526226 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.526402 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.526570 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.526744 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.526888 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.527082 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.527244 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.527420 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.527587 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.527731 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.527889 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.528042 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.528185 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.528361 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.528498 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.528662 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.528801 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.528977 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.529116 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.529278 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.529416 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.529582 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.529800 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.529966 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.530104 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.530276 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.530414 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.530582 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.530735 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.530874 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.531058 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.531203 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.531343 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.531478 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.531625 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.531782 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.531929 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.532095 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.532263 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.532400 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.532573 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.532832 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.533026 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.533189 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.533328 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.533494 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.533636 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.533795 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.533938 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.534084 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.534240 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.534396 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.534560 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.534717 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.535058 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.535239 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.535379 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.535551 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.535690 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.535851 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.536002 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.536163 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.536311 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.536457 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.536608 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.536759 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.536909 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.537045 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.537219 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.537365 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.537528 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.537705 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.537846 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.537981 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.538127 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.538265 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.538401 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.538554 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.538698 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.538834 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.539059 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.539222 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.539492 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.539649 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.539786 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.539921 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.540065 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.540201 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.540338 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.540473 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.540627 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.540771 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.540925 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.541061 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.541212 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.541354 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.541491 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.541635 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.541778 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.542414 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.542550 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.542685 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.542831 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.543004 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.543156 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.543291 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.543434 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.543571 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.543707 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.543850 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.543986 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.544121 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.544257 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.544393 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.544539 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.544685 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.544829 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.544981 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.545225 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.545375 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.545521 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.545658 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.545801 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.545938 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.546073 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.546247 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.546400 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.546572 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.546732 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.546877 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.547068 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.547242 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.547394 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.547555 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.547699 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.547870 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.548020 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.548166 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.548309 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.548483 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.548636 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.548794 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.548946 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.549100 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.549244 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.549387 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.549606 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.549750 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.549886 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.550035 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.550171 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.550308 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.550443 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.550588 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.550723 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.550896 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.551068 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.551235 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.551394 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.551547 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.551706 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.551880 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.552031 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.552182 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.552331 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.552531 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.552712 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.552857 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.553013 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.553156 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.553552 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.553690 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.553835 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.554003 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.554147 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.554324 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.554467 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.554672 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.554822 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.555036 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.555198 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.555406 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.555547 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.555690 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.555835 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.555972 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.556109 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.556245 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.556380 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.556552 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.556696 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.556861 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.556998 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.557192 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.557344 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.557574 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.558217 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.558389 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.558540 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.558702 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.558845 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.559054 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.559203 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.559406 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.559558 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.559791 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.559933 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.560146 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.560293 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.560437 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.560580 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.560722 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.560872 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.561022 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.561164 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.561307 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.561449 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.561602 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.561762 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.561914 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.562056 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.562220 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.562371 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.562545 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.562701 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.562843 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.563031 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.563181 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.563334 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.563477 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.563641 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.563810 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.563959 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.564127 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.564276 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.564454 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.564620 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.564763 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.564904 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.565070 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.565220 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.565413 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.565538 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.565728 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.565834 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.566055 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.566163 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.566370 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.566467 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.566692 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.566781 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.567041 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.567214 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.567371 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.567522 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.567668 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.567820 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.567971 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.568112 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.568269 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.568419 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.568568 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.568711 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.568863 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.569014 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.569156 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.569298 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.569472 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.569641 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.569804 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.570038 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.570197 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.570340 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.570481 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.570622 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.570772 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.570928 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.571105 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.571248 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.571389 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.571543 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.572273 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.572420 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.572562 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.572704 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.572858 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.573008 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.573237 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.573383 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.573524 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.573673 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.573823 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.573975 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.574135 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.574278 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.574427 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.574570 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.574711 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.574865 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.575058 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.575228 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.575375 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.575561 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.575779 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.575941 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.576085 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.576270 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.576424 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.576592 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.576739 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.576914 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.577065 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.577230 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.577380 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.577543 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.577703 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.577846 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.577987 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.578139 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.578300 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.578468 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.578621 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.578791 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.578998 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.579163 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.579307 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.579449 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.579604 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.579758 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.579901 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.580060 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.580277 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.580435 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.580587 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.580737 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.580880 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.581029 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.581170 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.581321 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.581474 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.581641 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.581784 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.581961 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.582107 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.582297 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.582442 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.582583 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.582732 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.582885 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.582885 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.583151 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.583259 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.583347 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.583431 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.583513 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.583594 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.583685 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.583767 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.583848 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.583938 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.584033 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.584116 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.584259 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.584360 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.584594 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.584693 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.584913 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.585012 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.585228 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.585320 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.585545 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.585832 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.585923 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.586153 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.586324 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.586471 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.586570 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.586785 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.586883 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.587148 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.587253 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.587466 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.587566 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.587787 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.587876 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.588099 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.588188 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.588413 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.588503 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.588747 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.588836 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.589060 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.589149 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.589372 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.589461 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.589681 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.589768 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.589998 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.590085 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.590307 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.590396 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.590619 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.590706 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.590931 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.591065 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.591266 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.591355 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.591577 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.591672 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.591889 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.591998 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.592197 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.592305 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.592507 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.592599 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.592829 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.592929 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.593142 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.593233 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.593462 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.593558 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.593776 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.593866 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.594108 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.594197 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.594427 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.594521 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.594735 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.594914 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.595100 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.595255 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.595415 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.595570 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.595735 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.595922 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.596053 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.596234 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.596364 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.596578 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.596677 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.596993 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.597093 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.597312 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.597401 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.597630 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.597719 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.597941 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.598037 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.598253 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.598348 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.598564 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.598654 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.598874 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.598982 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.599220 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.599532 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.599844 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.600239 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.600397 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.600765 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.601084 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.601444 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.601805 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.602147 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.602261 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.602510 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.602745 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.602845 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.603209 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.603358 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.603554 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.603883 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.604772 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.605008 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.605356 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.605445 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.605687 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.605930 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.606024 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.606483 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.606573 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.606824 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.607122 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.607505 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.607840 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.608106 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.608258 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.608487 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.608835 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.608924 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.609186 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.609423 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.609520 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.609789 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.609885 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.610138 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.610236 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.610479 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.610564 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.610803 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.610891 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.611165 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.611266 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.611497 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.611585 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.611825 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.611926 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.612159 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.612269 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.612491 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.612621 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.612807 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.612906 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.613124 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.613214 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.613440 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.613528 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.613758 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.613847 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.614076 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.614166 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.614397 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.614493 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.614719 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.614810 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.615062 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.615155 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.615384 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.615474 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.615702 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.615791 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.616031 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.616120 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.616351 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.616447 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.616676 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.616774 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.616995 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.617084 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.617314 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.617402 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.617631 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.617794 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.617953 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.618042 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.618268 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.618358 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.618585 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.618683 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.618897 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.619001 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.619251 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.619341 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.619574 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.619677 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.619916 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.620762 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.621079 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.621494 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.621823 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.622065 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.622346 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.622447 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.622756 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.622962 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.623122 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.623468 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.623556 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.623924 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.624397 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.624485 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.624735 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.624978 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.625120 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.625452 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.625570 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.625927 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.626128 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.626274 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.626661 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.627041 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.627389 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.627565 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.627925 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.628062 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.628276 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.628563 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.628665 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.628942 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.629031 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.629801 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.630139 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.630213 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.630294 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.630390 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.630473 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.630554 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.630554 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.630863 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.631176 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.631282 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.631508 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.631599 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.631859 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.631947 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.632190 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.632303 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.632512 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.632612 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.632837 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.632943 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.633158 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.633247 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.633482 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.633584 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.633803 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.633892 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.634122 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.634257 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.634447 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.634587 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.634774 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.634914 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.635130 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.635260 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.635455 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.635609 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.635806 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.636013 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.636111 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.636343 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.636436 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.636670 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.636758 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.636988 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.637078 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.637369 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.637456 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.637694 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.637779 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.638012 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.638102 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.638335 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.638430 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.638653 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.638742 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.638985 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.639089 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.639312 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.639399 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.639645 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.639761 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.639961 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.640087 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.640277 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.640409 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.640591 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.640725 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.640929 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.641045 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.641246 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.641367 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.641580 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.641755 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.642004 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.642093 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.642320 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.642409 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.642631 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.642749 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.643102 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.643202 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.643425 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.643514 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.643746 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.643852 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.644111 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.644209 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.644415 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.644512 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.644740 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.644830 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.645054 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.645149 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.645380 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.645469 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.645703 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.645800 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.646035 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.646370 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.646694 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.647068 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.647176 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.647431 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.647899 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.647990 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.648316 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.648497 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.648670 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.649069 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.649172 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.649547 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.649920 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.650177 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.650267 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.650688 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.650784 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.651050 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.651386 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.651546 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.651895 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.651995 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.652448 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.652782 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.653127 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.653226 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.653534 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.653729 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.653880 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.654226 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.654327 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.654567 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.654717 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.654921 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.655094 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.655296 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.655424 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.655730 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.655828 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.656077 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.656166 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.656402 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.656498 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.656722 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.656822 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.657044 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.657132 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.657385 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.657472 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.657710 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.657809 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.658047 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.658176 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.658377 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.658466 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.658712 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.658811 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.659070 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.659163 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.659392 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.659481 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.659728 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.659830 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.660051 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.660141 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.660368 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.660507 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.660687 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.660815 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.661004 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.661101 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.661337 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.661426 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.661657 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.661748 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.661987 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.662077 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.662314 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.662403 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.662638 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.662744 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.662975 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.663079 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.663301 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.663414 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.663634 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.663733 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.663951 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.664043 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.664273 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.664375 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.664602 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.664690 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.664932 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.665020 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.665248 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.665348 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.665561 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.665650 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.665879 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.665968 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.666194 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.666330 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.666509 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.666598 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.667361 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.667459 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.667690 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.667853 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.668006 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.668225 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.668316 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.668546 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.668644 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.668883 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.668974 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.669229 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.669320 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.669557 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.669654 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.669885 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.670000 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.670199 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.670298 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.670519 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.670670 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.670836 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.670958 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.671204 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.671293 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.671518 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.671619 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.671857 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.671950 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.672171 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.672259 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.672491 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.672583 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.672814 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.672902 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.673129 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.673217 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.673449 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.673550 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.673764 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.673855 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.674086 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.674176 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.674401 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.674494 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.674717 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.674816 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.675060 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.675155 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.675394 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.675486 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.675709 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.675808 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.676067 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.676165 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.676413 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.676631 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.676975 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.677303 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.677699 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.678043 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.678502 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.678768 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.678866 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.679227 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.679383 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.679611 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.679948 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.680037 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.680386 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.680795 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.681218 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.681309 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.681572 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.681873 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.681963 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.682260 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.683150 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.683315 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.683670 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.683768 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.684011 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.684267 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.684621 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.684968 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.685305 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.685571 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.685662 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.685996 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.686182 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.686340 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.686634 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.686728 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.686999 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.687109 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.687335 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.687425 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.687675 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.687914 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.688004 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.688268 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.688360 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.688601 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.688731 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.688933 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.689033 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.689265 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.689355 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.689597 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.689693 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.689923 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.690021 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.690250 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.690340 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.690576 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.690663 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.690901 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.691027 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.691257 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.691354 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.691602 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.691693 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.691937 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.692026 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.692279 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.692369 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.692631 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.692720 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.692964 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.693053 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.693292 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.693502 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.693656 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.693832 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.693932 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.694179 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.694291 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.694518 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.694608 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.694854 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.694972 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.695207 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.695297 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.695537 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.695636 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.695875 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.695966 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.696193 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.696283 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.696510 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.696600 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.696834 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.696924 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.697155 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.697252 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.697472 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.697561 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.697805 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.697903 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.698155 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.698244 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.698472 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.698570 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.698807 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.698897 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.699154 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.699702 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.700062 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.700389 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.700723 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.701060 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.701387 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.701797 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.702137 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.702456 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.702727 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.702817 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.703109 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.703201 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.703435 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.703528 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.703752 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.703841 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.704067 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.704156 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.704390 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.704664 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.704754 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.705010 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.705102 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.705326 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.705423 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.705643 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.705732 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.705982 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.706110 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.706298 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.706402 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.706613 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.706711 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.706929 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.707091 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.707271 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.707422 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.707586 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.707745 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.707907 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.708076 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.708221 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.708405 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.708534 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.708728 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.708855 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.709067 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.709169 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.709393 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.709483 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.709715 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.709804 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.710052 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.710151 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.710377 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.710467 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.710726 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.710925 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.711084 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.711310 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.711402 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.711640 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.711736 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.711980 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.712077 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.712308 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.712398 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.712629 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.712718 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.712948 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.713050 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.713264 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.713353 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.713585 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.714205 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.714430 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.714535 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.714767 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.714857 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.715118 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.715392 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.715496 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.715735 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.715826 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.716059 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.716147 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.716382 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.716481 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.716698 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.716796 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.717022 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.717113 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.717382 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.717487 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.717655 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.717755 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.717974 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.718070 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.718291 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.718394 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.718609 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.718930 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.719276 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.719599 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.719900 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.719993 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.720312 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.720776 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.720864 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.721172 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.721352 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.721520 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.721864 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.721952 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.722374 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.722713 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.723081 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.723174 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.723416 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.723506 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.723750 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.723852 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.724111 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.724201 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.724449 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.724538 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.724782 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.724949 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.725115 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.725328 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.725447 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.725666 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.725763 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.725994 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.726093 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.726340 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.726431 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.726668 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.726765 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.727107 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.727200 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.727457 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.727785 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.727966 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.728131 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.728738 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.728828 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.729129 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.729933 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.730029 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.730419 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.730563 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.730747 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.730980 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.731109 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.731446 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.731545 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.731769 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.731862 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.732104 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.732426 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.732524 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.732769 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.732889 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.733118 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.733266 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.733456 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.733657 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.733790 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.734105 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.734192 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.734419 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.734508 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.734734 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.734823 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.735080 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.735222 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.735412 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.735598 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.735731 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.736017 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.736120 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.736344 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.736439 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.736664 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.736761 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.736977 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.737089 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.737291 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.737452 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.737608 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.737810 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.737912 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.738168 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.738259 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.738521 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.738625 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.738835 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.738928 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.739185 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.739286 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.739499 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.739589 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.739812 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.739908 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.740123 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.740212 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.740441 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.740539 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.740754 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.740843 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.741069 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.741167 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.741382 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.741472 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.741695 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.741798 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.742007 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.742109 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.742338 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.742426 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.742676 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.742764 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.743023 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.743133 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.743357 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.743447 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.743677 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.743766 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.743998 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.744096 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.744335 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.744425 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.744652 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.744749 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.744962 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.745357 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.745665 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.745934 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.746031 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.746307 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.746481 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.746641 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.746847 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.746963 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.747217 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.747306 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.747554 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.747645 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.747888 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.747977 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.748220 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.748327 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.748552 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.748643 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.748881 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.748970 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.749225 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.749322 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.749563 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.749653 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.749883 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.749974 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.750191 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.750288 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.750501 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.750591 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.750809 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.750899 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.751149 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.751262 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.751470 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.751568 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.751783 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.751872 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.752091 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.752190 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.752399 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.752490 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.752711 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.752800 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.753018 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.753116 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.753325 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.753415 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.753631 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.753755 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.753917 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.754078 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.754231 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.754401 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.754635 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.754725 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.754958 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.755052 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.755271 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.755389 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.755683 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.755781 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.755990 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.756080 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.756295 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.756386 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.756664 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.756800 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.757019 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.757115 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.757348 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.757451 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.757701 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.757800 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.758037 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.758172 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.758363 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.758453 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.758684 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.758783 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.759024 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.759132 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.759278 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 14 08:37:34.759406 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.759731 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.760046 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.760370 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.760682 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.761006 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.761327 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.761646 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.761958 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.762292 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.762604 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.762917 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.763253 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.763565 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.763876 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.764188 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.764515 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.764958 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.765266 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.765593 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.765912 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.766234 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.766551 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.766864 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.767220 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.767534 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.767847 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.768158 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.768470 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.768788 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.769104 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.769416 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.769728 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.770053 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.770370 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.770778 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.771169 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.771457 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.771830 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.772178 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.772529 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.772885 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.773264 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.773628 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.773984 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.774332 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.774642 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:37:34.774894 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 14 08:37:34.927165 n-d-836830-18 devstack@n-api.service[112915]: INFO dbcounter [None req-c879a051-cc16-4067-99c2-26c206edba1c None None] Registered counter for database nova_api Sep 14 08:37:34.944051 n-d-836830-18 devstack@n-api.service[112914]: INFO dbcounter [None req-e9de7b74-465a-4fcf-bcc6-824bba95e2bc None None] Registered counter for database nova_api Sep 14 08:37:34.948622 n-d-836830-18 devstack@n-api.service[112915]: DEBUG oslo_db.sqlalchemy.engines [None req-c879a051-cc16-4067-99c2-26c206edba1c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112915) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 14 08:37:34.957381 n-d-836830-18 devstack@n-api.service[112915]: DEBUG dbcounter [-] [112915] Writer thread running {{(pid=112915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 14 08:37:34.963241 n-d-836830-18 devstack@n-api.service[112914]: DEBUG oslo_db.sqlalchemy.engines [None req-e9de7b74-465a-4fcf-bcc6-824bba95e2bc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112914) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 14 08:37:34.971037 n-d-836830-18 devstack@n-api.service[112914]: DEBUG dbcounter [-] [112914] Writer thread running {{(pid=112914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 14 08:37:35.020295 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.context [None req-c879a051-cc16-4067-99c2-26c206edba1c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0a35f87f-19b7-4b11-98e6-8bcd07b0466f(cell1) {{(pid=112915) load_cells /opt/stack/nova/nova/context.py:464}} Sep 14 08:37:35.025177 n-d-836830-18 devstack@n-api.service[112915]: DEBUG oslo_concurrency.lockutils [None req-c879a051-cc16-4067-99c2-26c206edba1c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:37:35.025661 n-d-836830-18 devstack@n-api.service[112915]: DEBUG oslo_concurrency.lockutils [None req-c879a051-cc16-4067-99c2-26c206edba1c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:37:35.029105 n-d-836830-18 devstack@n-api.service[112915]: DEBUG oslo_concurrency.lockutils [None req-c879a051-cc16-4067-99c2-26c206edba1c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=112915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:37:35.029864 n-d-836830-18 devstack@n-api.service[112915]: DEBUG oslo_concurrency.lockutils [None req-c879a051-cc16-4067-99c2-26c206edba1c None None] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:37:35.030317 n-d-836830-18 devstack@n-api.service[112915]: DEBUG oslo_concurrency.lockutils [None req-c879a051-cc16-4067-99c2-26c206edba1c None None] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:37:35.031686 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.context [None req-e9de7b74-465a-4fcf-bcc6-824bba95e2bc None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0a35f87f-19b7-4b11-98e6-8bcd07b0466f(cell1) {{(pid=112914) load_cells /opt/stack/nova/nova/context.py:464}} Sep 14 08:37:35.032361 n-d-836830-18 devstack@n-api.service[112915]: DEBUG oslo_concurrency.lockutils [None req-c879a051-cc16-4067-99c2-26c206edba1c None None] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:37:35.034383 n-d-836830-18 devstack@n-api.service[112915]: INFO dbcounter [None req-c879a051-cc16-4067-99c2-26c206edba1c None None] Registered counter for database nova_cell0 Sep 14 08:37:35.035567 n-d-836830-18 devstack@n-api.service[112914]: DEBUG oslo_concurrency.lockutils [None req-e9de7b74-465a-4fcf-bcc6-824bba95e2bc None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:37:35.036040 n-d-836830-18 devstack@n-api.service[112914]: DEBUG oslo_concurrency.lockutils [None req-e9de7b74-465a-4fcf-bcc6-824bba95e2bc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:37:35.037598 n-d-836830-18 devstack@n-api.service[112914]: DEBUG oslo_concurrency.lockutils [None req-e9de7b74-465a-4fcf-bcc6-824bba95e2bc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:37:35.038307 n-d-836830-18 devstack@n-api.service[112914]: DEBUG oslo_concurrency.lockutils [None req-e9de7b74-465a-4fcf-bcc6-824bba95e2bc None None] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:37:35.038550 n-d-836830-18 devstack@n-api.service[112915]: INFO dbcounter [None req-c879a051-cc16-4067-99c2-26c206edba1c None None] Registered counter for database nova_cell1 Sep 14 08:37:35.038750 n-d-836830-18 devstack@n-api.service[112914]: DEBUG oslo_concurrency.lockutils [None req-e9de7b74-465a-4fcf-bcc6-824bba95e2bc None None] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:37:35.040736 n-d-836830-18 devstack@n-api.service[112914]: DEBUG oslo_concurrency.lockutils [None req-e9de7b74-465a-4fcf-bcc6-824bba95e2bc None None] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:37:35.043304 n-d-836830-18 devstack@n-api.service[112914]: INFO dbcounter [None req-e9de7b74-465a-4fcf-bcc6-824bba95e2bc None None] Registered counter for database nova_cell0 Sep 14 08:37:35.047451 n-d-836830-18 devstack@n-api.service[112915]: DEBUG oslo_db.sqlalchemy.engines [None req-c879a051-cc16-4067-99c2-26c206edba1c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112915) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 14 08:37:35.047639 n-d-836830-18 devstack@n-api.service[112914]: INFO dbcounter [None req-e9de7b74-465a-4fcf-bcc6-824bba95e2bc None None] Registered counter for database nova_cell1 Sep 14 08:37:35.048897 n-d-836830-18 devstack@n-api.service[112915]: DEBUG oslo_db.sqlalchemy.engines [None req-c879a051-cc16-4067-99c2-26c206edba1c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112915) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 14 08:37:35.054665 n-d-836830-18 devstack@n-api.service[112914]: DEBUG oslo_db.sqlalchemy.engines [None req-e9de7b74-465a-4fcf-bcc6-824bba95e2bc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112914) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 14 08:37:35.056864 n-d-836830-18 devstack@n-api.service[112915]: DEBUG dbcounter [-] [112915] Writer thread running {{(pid=112915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 14 08:37:35.058080 n-d-836830-18 devstack@n-api.service[112914]: DEBUG oslo_db.sqlalchemy.engines [None req-e9de7b74-465a-4fcf-bcc6-824bba95e2bc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112914) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 14 08:37:35.059356 n-d-836830-18 devstack@n-api.service[112915]: DEBUG dbcounter [-] [112915] Writer thread running {{(pid=112915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 14 08:37:35.061390 n-d-836830-18 devstack@n-api.service[112914]: DEBUG dbcounter [-] [112914] Writer thread running {{(pid=112914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 14 08:37:35.216536 n-d-836830-18 devstack@n-api.service[112914]: DEBUG dbcounter [-] [112914] Writer thread running {{(pid=112914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 14 08:37:35.225967 n-d-836830-18 devstack@n-api.service[112914]: INFO dbcounter [None req-e9de7b74-465a-4fcf-bcc6-824bba95e2bc None None] Registered counter for database nova_cell0 Sep 14 08:37:35.232761 n-d-836830-18 devstack@n-api.service[112914]: DEBUG oslo_db.sqlalchemy.engines [None req-e9de7b74-465a-4fcf-bcc6-824bba95e2bc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112914) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 14 08:37:35.237283 n-d-836830-18 devstack@n-api.service[112914]: DEBUG dbcounter [-] [112914] Writer thread running {{(pid=112914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 14 08:37:35.243316 n-d-836830-18 devstack@n-api.service[112915]: INFO dbcounter [None req-c879a051-cc16-4067-99c2-26c206edba1c None None] Registered counter for database nova_cell0 Sep 14 08:37:35.252816 n-d-836830-18 devstack@n-api.service[112915]: DEBUG oslo_db.sqlalchemy.engines [None req-c879a051-cc16-4067-99c2-26c206edba1c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112915) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 14 08:37:35.257424 n-d-836830-18 devstack@n-api.service[112915]: DEBUG dbcounter [-] [112915] Writer thread running {{(pid=112915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 14 08:37:35.588975 n-d-836830-18 devstack@n-api.service[112914]: WARNING keystonemiddleware.auth_token [None req-e9de7b74-465a-4fcf-bcc6-824bba95e2bc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 14 08:37:35.596452 n-d-836830-18 devstack@n-api.service[112914]: WARNING keystonemiddleware.auth_token [None req-e9de7b74-465a-4fcf-bcc6-824bba95e2bc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 14 08:37:35.612387 n-d-836830-18 devstack@n-api.service[112915]: WARNING keystonemiddleware.auth_token [None req-c879a051-cc16-4067-99c2-26c206edba1c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 14 08:37:35.619710 n-d-836830-18 devstack@n-api.service[112915]: WARNING keystonemiddleware.auth_token [None req-c879a051-cc16-4067-99c2-26c206edba1c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 14 08:37:35.946611 n-d-836830-18 devstack@n-api.service[112914]: WARNING keystonemiddleware.auth_token [None req-e9de7b74-465a-4fcf-bcc6-824bba95e2bc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 14 08:37:35.952783 n-d-836830-18 devstack@n-api.service[112914]: WARNING keystonemiddleware.auth_token [None req-e9de7b74-465a-4fcf-bcc6-824bba95e2bc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 14 08:37:35.958188 n-d-836830-18 devstack@n-api.service[112914]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55952b2b59c0 pid: 112914 (default app) Sep 14 08:37:35.960494 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi [None req-e9de7b74-465a-4fcf-bcc6-824bba95e2bc None None] Calling method '>' {{(pid=112914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:37:35.961690 n-d-836830-18 devstack@n-api.service[112914]: INFO nova.api.openstack.requestlog [None req-e9de7b74-465a-4fcf-bcc6-824bba95e2bc None None] 10.222.0.60 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001810 Sep 14 08:37:35.962121 n-d-836830-18 devstack@n-api.service[112914]: [pid: 112914|app: 0|req: 1/1] 10.222.0.60 () {50 vars in 788 bytes} [Wed Sep 14 08:37:35 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:37:35.967396 n-d-836830-18 devstack@n-api.service[112915]: WARNING keystonemiddleware.auth_token [None req-c879a051-cc16-4067-99c2-26c206edba1c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 14 08:37:35.973404 n-d-836830-18 devstack@n-api.service[112915]: WARNING keystonemiddleware.auth_token [None req-c879a051-cc16-4067-99c2-26c206edba1c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 14 08:37:35.978753 n-d-836830-18 devstack@n-api.service[112915]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55952b2b59c0 pid: 112915 (default app) Sep 14 08:38:57.403400 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi [None req-e9de7b74-465a-4fcf-bcc6-824bba95e2bc None None] Calling method '>' {{(pid=112914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:38:57.404393 n-d-836830-18 devstack@n-api.service[112914]: INFO nova.api.openstack.requestlog [None req-e9de7b74-465a-4fcf-bcc6-824bba95e2bc None None] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Sep 14 08:38:57.405254 n-d-836830-18 devstack@n-api.service[112914]: [pid: 112914|app: 0|req: 2/2] 10.222.0.60 () {54 vars in 931 bytes} [Wed Sep 14 08:38:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:38:57.417535 n-d-836830-18 devstack@n-api.service[112915]: DEBUG dbcounter [-] [112915] Writing DB stats nova_api:SELECT=3 {{(pid=112915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:38:57.418447 n-d-836830-18 devstack@n-api.service[112915]: DEBUG dbcounter [-] [112915] Writing DB stats nova_cell0:SELECT=3 {{(pid=112915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:38:57.419371 n-d-836830-18 devstack@n-api.service[112915]: DEBUG dbcounter [-] [112915] Writing DB stats nova_cell1:SELECT=3 {{(pid=112915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:38:57.420091 n-d-836830-18 devstack@n-api.service[112915]: DEBUG dbcounter [-] [112915] Writing DB stats nova_cell0:SELECT=3 {{(pid=112915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:38:58.272036 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi [None req-aea0e138-9a80-4d40-bb7a-ebc372205674 admin admin] Calling method '>' {{(pid=112915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:38:58.305288 n-d-836830-18 devstack@n-api.service[112915]: INFO nova.api.openstack.requestlog [None req-aea0e138-9a80-4d40-bb7a-ebc372205674 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.893130 Sep 14 08:38:58.306228 n-d-836830-18 devstack@n-api.service[112915]: [pid: 112915|app: 0|req: 1/3] 10.222.0.60 () {60 vars in 1292 bytes} [Wed Sep 14 08:38:57 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:39:00.949237 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi [None req-e9de7b74-465a-4fcf-bcc6-824bba95e2bc None None] Calling method '>' {{(pid=112914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:39:00.950253 n-d-836830-18 devstack@n-api.service[112914]: INFO nova.api.openstack.requestlog [None req-e9de7b74-465a-4fcf-bcc6-824bba95e2bc None None] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001980 Sep 14 08:39:00.950824 n-d-836830-18 devstack@n-api.service[112914]: [pid: 112914|app: 0|req: 3/4] 10.222.0.60 () {54 vars in 931 bytes} [Wed Sep 14 08:39:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:39:01.410785 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi [None req-f98f0365-704d-4779-9b9d-fb2b01096bfe admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256", "ram": 256, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "disk": 1, "vcpus": 1, "id": "c1"}} {{(pid=112915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:39:01.460140 n-d-836830-18 devstack@n-api.service[112915]: INFO nova.api.openstack.requestlog [None req-f98f0365-704d-4779-9b9d-fb2b01096bfe admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.502849 Sep 14 08:39:01.460953 n-d-836830-18 devstack@n-api.service[112915]: [pid: 112915|app: 0|req: 2/5] 10.222.0.60 () {64 vars in 1283 bytes} [Wed Sep 14 08:39:00 2022] POST /compute/v2.1/flavors => generated 407 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 08:39:01.476523 n-d-836830-18 devstack@n-api.service[112914]: DEBUG dbcounter [-] [112914] Writing DB stats nova_api:SELECT=3 {{(pid=112914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:39:01.477342 n-d-836830-18 devstack@n-api.service[112914]: DEBUG dbcounter [-] [112914] Writing DB stats nova_cell0:SELECT=3 {{(pid=112914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:39:01.478087 n-d-836830-18 devstack@n-api.service[112914]: DEBUG dbcounter [-] [112914] Writing DB stats nova_cell1:SELECT=3 {{(pid=112914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:39:01.479738 n-d-836830-18 devstack@n-api.service[112914]: DEBUG dbcounter [-] [112914] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=112914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:39:01.684940 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi [None req-d6a9391e-9597-4e44-8fe6-2255880dd273 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:39:01.754307 n-d-836830-18 devstack@n-api.service[112914]: INFO nova.api.openstack.requestlog [None req-d6a9391e-9597-4e44-8fe6-2255880dd273 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.284217 Sep 14 08:39:01.754887 n-d-836830-18 devstack@n-api.service[112914]: [pid: 112914|app: 0|req: 4/6] 10.222.0.60 () {64 vars in 1336 bytes} [Wed Sep 14 08:39:01 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:39:04.449828 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi [None req-f98f0365-704d-4779-9b9d-fb2b01096bfe admin admin] Calling method '>' {{(pid=112915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:39:04.450855 n-d-836830-18 devstack@n-api.service[112915]: INFO nova.api.openstack.requestlog [None req-f98f0365-704d-4779-9b9d-fb2b01096bfe admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001501 Sep 14 08:39:04.451396 n-d-836830-18 devstack@n-api.service[112915]: [pid: 112915|app: 0|req: 3/7] 10.222.0.60 () {54 vars in 931 bytes} [Wed Sep 14 08:39:04 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:39:05.498368 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi [None req-faf86b76-dbf1-4e9b-b5c5-e753691c6d3e admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "d1", "name": "ds512M", "disk": 5, "os-flavor-access:is_public": true, "swap": 0, "vcpus": 1}} {{(pid=112914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:39:05.562927 n-d-836830-18 devstack@n-api.service[112914]: INFO nova.api.openstack.requestlog [None req-faf86b76-dbf1-4e9b-b5c5-e753691c6d3e admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 1.104980 Sep 14 08:39:05.571853 n-d-836830-18 devstack@n-api.service[112914]: [pid: 112914|app: 0|req: 5/8] 10.222.0.60 () {64 vars in 1283 bytes} [Wed Sep 14 08:39:04 2022] POST /compute/v2.1/flavors => generated 404 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 08:39:05.577590 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi [None req-6c1f99cc-a8da-4352-a31a-1f7a9b6e542f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:39:05.651761 n-d-836830-18 devstack@n-api.service[112915]: INFO nova.api.openstack.requestlog [None req-6c1f99cc-a8da-4352-a31a-1f7a9b6e542f admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.077357 Sep 14 08:39:05.652683 n-d-836830-18 devstack@n-api.service[112915]: [pid: 112915|app: 0|req: 4/9] 10.222.0.60 () {64 vars in 1336 bytes} [Wed Sep 14 08:39:05 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:39:08.622786 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi [None req-faf86b76-dbf1-4e9b-b5c5-e753691c6d3e admin admin] Calling method '>' {{(pid=112914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:39:08.623982 n-d-836830-18 devstack@n-api.service[112914]: INFO nova.api.openstack.requestlog [None req-faf86b76-dbf1-4e9b-b5c5-e753691c6d3e admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001642 Sep 14 08:39:08.624485 n-d-836830-18 devstack@n-api.service[112914]: [pid: 112914|app: 0|req: 6/10] 10.222.0.60 () {54 vars in 931 bytes} [Wed Sep 14 08:39:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:39:09.061909 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi [None req-1ce2ae78-2c7e-4657-9c11-4dbfc72288c8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "name": "ds1G", "swap": 0, "ram": 1024, "vcpus": 1, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "d2"}} {{(pid=112915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:39:09.085937 n-d-836830-18 devstack@n-api.service[112915]: INFO nova.api.openstack.requestlog [None req-1ce2ae78-2c7e-4657-9c11-4dbfc72288c8 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.454238 Sep 14 08:39:09.094564 n-d-836830-18 devstack@n-api.service[112915]: [pid: 112915|app: 0|req: 5/11] 10.222.0.60 () {64 vars in 1283 bytes} [Wed Sep 14 08:39:08 2022] POST /compute/v2.1/flavors => generated 404 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 08:39:09.100179 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi [None req-adb742cb-7ec2-43a3-ae0c-be2b24d2ffed admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:39:09.131797 n-d-836830-18 devstack@n-api.service[112914]: INFO nova.api.openstack.requestlog [None req-adb742cb-7ec2-43a3-ae0c-be2b24d2ffed admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035900 Sep 14 08:39:09.132994 n-d-836830-18 devstack@n-api.service[112914]: [pid: 112914|app: 0|req: 7/12] 10.222.0.60 () {64 vars in 1336 bytes} [Wed Sep 14 08:39:09 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:39:11.787591 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi [None req-1ce2ae78-2c7e-4657-9c11-4dbfc72288c8 admin admin] Calling method '>' {{(pid=112915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:39:11.788699 n-d-836830-18 devstack@n-api.service[112915]: INFO nova.api.openstack.requestlog [None req-1ce2ae78-2c7e-4657-9c11-4dbfc72288c8 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001634 Sep 14 08:39:11.789111 n-d-836830-18 devstack@n-api.service[112915]: [pid: 112915|app: 0|req: 6/13] 10.222.0.60 () {54 vars in 931 bytes} [Wed Sep 14 08:39:11 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:39:12.263223 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi [None req-e849f018-0c16-4ddb-8f81-3be20c73008c admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "os-flavor-access:is_public": true, "disk": 10, "id": "d3", "vcpus": 2, "swap": 0, "name": "ds2G", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=112914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:39:12.285942 n-d-836830-18 devstack@n-api.service[112914]: INFO nova.api.openstack.requestlog [None req-e849f018-0c16-4ddb-8f81-3be20c73008c admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.490183 Sep 14 08:39:12.287156 n-d-836830-18 devstack@n-api.service[112914]: [pid: 112914|app: 0|req: 8/14] 10.222.0.60 () {64 vars in 1283 bytes} [Wed Sep 14 08:39:11 2022] POST /compute/v2.1/flavors => generated 404 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 08:39:12.301879 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi [None req-b1460b75-2744-4a98-a499-e4aee7afe873 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:39:12.343757 n-d-836830-18 devstack@n-api.service[112915]: INFO nova.api.openstack.requestlog [None req-b1460b75-2744-4a98-a499-e4aee7afe873 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.045552 Sep 14 08:39:12.344561 n-d-836830-18 devstack@n-api.service[112915]: [pid: 112915|app: 0|req: 7/15] 10.222.0.60 () {64 vars in 1336 bytes} [Wed Sep 14 08:39:12 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:39:15.059409 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi [None req-e849f018-0c16-4ddb-8f81-3be20c73008c admin admin] Calling method '>' {{(pid=112914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:39:15.061096 n-d-836830-18 devstack@n-api.service[112914]: INFO nova.api.openstack.requestlog [None req-e849f018-0c16-4ddb-8f81-3be20c73008c admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002246 Sep 14 08:39:15.067093 n-d-836830-18 devstack@n-api.service[112914]: [pid: 112914|app: 0|req: 9/16] 10.222.0.60 () {54 vars in 931 bytes} [Wed Sep 14 08:39:15 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:39:15.531732 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi [None req-fd5cefb5-fde1-4f73-b10b-c0a63eabda0d admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "swap": 0, "rxtx_factor": 1.0, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 20, "vcpus": 4, "name": "ds4G"}} {{(pid=112915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:39:15.564644 n-d-836830-18 devstack@n-api.service[112915]: INFO nova.api.openstack.requestlog [None req-fd5cefb5-fde1-4f73-b10b-c0a63eabda0d admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.495886 Sep 14 08:39:15.565472 n-d-836830-18 devstack@n-api.service[112915]: [pid: 112915|app: 0|req: 8/17] 10.222.0.60 () {64 vars in 1283 bytes} [Wed Sep 14 08:39:15 2022] POST /compute/v2.1/flavors => generated 404 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 14 08:39:15.579384 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi [None req-dba50fce-6b0d-48f5-8586-ec84bab7eca6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:39:15.607359 n-d-836830-18 devstack@n-api.service[112914]: INFO nova.api.openstack.requestlog [None req-dba50fce-6b0d-48f5-8586-ec84bab7eca6 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031993 Sep 14 08:39:15.623700 n-d-836830-18 devstack@n-api.service[112914]: [pid: 112914|app: 0|req: 10/18] 10.222.0.60 () {64 vars in 1336 bytes} [Wed Sep 14 08:39:15 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:39:18.311253 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi [None req-fd5cefb5-fde1-4f73-b10b-c0a63eabda0d admin admin] Calling method '>' {{(pid=112915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:39:18.312544 n-d-836830-18 devstack@n-api.service[112915]: INFO nova.api.openstack.requestlog [None req-fd5cefb5-fde1-4f73-b10b-c0a63eabda0d admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001815 Sep 14 08:39:18.313020 n-d-836830-18 devstack@n-api.service[112915]: [pid: 112915|app: 0|req: 9/19] 10.222.0.60 () {54 vars in 931 bytes} [Wed Sep 14 08:39:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:39:18.739206 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi [None req-093e79bb-8348-4497-808a-0a9a94b53e13 admin admin] Calling method '>' {{(pid=112914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:39:18.764752 n-d-836830-18 devstack@n-api.service[112914]: INFO nova.api.openstack.requestlog [None req-093e79bb-8348-4497-808a-0a9a94b53e13 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.445477 Sep 14 08:39:18.765324 n-d-836830-18 devstack@n-api.service[112914]: [pid: 112914|app: 0|req: 11/20] 10.222.0.60 () {60 vars in 1292 bytes} [Wed Sep 14 08:39:18 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:39:21.695604 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi [None req-fd5cefb5-fde1-4f73-b10b-c0a63eabda0d admin admin] Calling method '>' {{(pid=112915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:39:21.696652 n-d-836830-18 devstack@n-api.service[112915]: INFO nova.api.openstack.requestlog [None req-fd5cefb5-fde1-4f73-b10b-c0a63eabda0d admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001539 Sep 14 08:39:21.697060 n-d-836830-18 devstack@n-api.service[112915]: [pid: 112915|app: 0|req: 10/21] 10.222.0.60 () {54 vars in 931 bytes} [Wed Sep 14 08:39:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:39:22.119661 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi [None req-e381c413-6d66-40c0-a301-a5476971b575 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 1, "os-flavor-access:is_public": true, "disk": 1, "name": "m1.tiny", "ram": 512, "swap": 0, "id": "1"}} {{(pid=112914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:39:22.143045 n-d-836830-18 devstack@n-api.service[112914]: INFO nova.api.openstack.requestlog [None req-e381c413-6d66-40c0-a301-a5476971b575 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.437708 Sep 14 08:39:22.143742 n-d-836830-18 devstack@n-api.service[112914]: [pid: 112914|app: 0|req: 12/22] 10.222.0.60 () {64 vars in 1283 bytes} [Wed Sep 14 08:39:21 2022] POST /compute/v2.1/flavors => generated 402 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 08:39:22.156492 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi [None req-b4ff33f2-e3a7-4b5b-8815-33db6284d8a2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:39:22.185251 n-d-836830-18 devstack@n-api.service[112915]: INFO nova.api.openstack.requestlog [None req-b4ff33f2-e3a7-4b5b-8815-33db6284d8a2 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032505 Sep 14 08:39:22.186012 n-d-836830-18 devstack@n-api.service[112915]: [pid: 112915|app: 0|req: 11/23] 10.222.0.60 () {64 vars in 1333 bytes} [Wed Sep 14 08:39:22 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:39:24.906770 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi [None req-e381c413-6d66-40c0-a301-a5476971b575 admin admin] Calling method '>' {{(pid=112914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:39:24.907820 n-d-836830-18 devstack@n-api.service[112914]: INFO nova.api.openstack.requestlog [None req-e381c413-6d66-40c0-a301-a5476971b575 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001502 Sep 14 08:39:24.908217 n-d-836830-18 devstack@n-api.service[112914]: [pid: 112914|app: 0|req: 13/24] 10.222.0.60 () {54 vars in 931 bytes} [Wed Sep 14 08:39:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:39:25.312481 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi [None req-f20b9e93-8368-4baf-a77a-9c20c3b3ef2d admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 1, "ram": 2048, "os-flavor-access:is_public": true, "name": "m1.small", "id": "2", "disk": 20, "rxtx_factor": 1.0}} {{(pid=112915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:39:25.332959 n-d-836830-18 devstack@n-api.service[112915]: INFO nova.api.openstack.requestlog [None req-f20b9e93-8368-4baf-a77a-9c20c3b3ef2d admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.418258 Sep 14 08:39:25.333627 n-d-836830-18 devstack@n-api.service[112915]: [pid: 112915|app: 0|req: 12/25] 10.222.0.60 () {64 vars in 1283 bytes} [Wed Sep 14 08:39:24 2022] POST /compute/v2.1/flavors => generated 405 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 08:39:25.346164 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi [None req-22b99b6b-1f37-4b2f-8255-c99d89c3a9fb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:39:25.368686 n-d-836830-18 devstack@n-api.service[112914]: INFO nova.api.openstack.requestlog [None req-22b99b6b-1f37-4b2f-8255-c99d89c3a9fb admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026382 Sep 14 08:39:25.369542 n-d-836830-18 devstack@n-api.service[112914]: [pid: 112914|app: 0|req: 14/26] 10.222.0.60 () {64 vars in 1333 bytes} [Wed Sep 14 08:39:25 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:39:27.930169 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi [None req-f20b9e93-8368-4baf-a77a-9c20c3b3ef2d admin admin] Calling method '>' {{(pid=112915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:39:27.931136 n-d-836830-18 devstack@n-api.service[112915]: INFO nova.api.openstack.requestlog [None req-f20b9e93-8368-4baf-a77a-9c20c3b3ef2d admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Sep 14 08:39:27.931572 n-d-836830-18 devstack@n-api.service[112915]: [pid: 112915|app: 0|req: 13/27] 10.222.0.60 () {54 vars in 931 bytes} [Wed Sep 14 08:39:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:39:28.312545 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi [None req-babca3da-5bac-445f-9825-48ffa928cc98 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "os-flavor-access:is_public": true, "ram": 4096, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "m1.medium", "id": "3", "swap": 0}} {{(pid=112914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:39:28.332314 n-d-836830-18 devstack@n-api.service[112914]: INFO nova.api.openstack.requestlog [None req-babca3da-5bac-445f-9825-48ffa928cc98 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.394511 Sep 14 08:39:28.333191 n-d-836830-18 devstack@n-api.service[112914]: [pid: 112914|app: 0|req: 15/28] 10.222.0.60 () {64 vars in 1283 bytes} [Wed Sep 14 08:39:27 2022] POST /compute/v2.1/flavors => generated 406 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 08:39:28.346156 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi [None req-24f9744d-f21c-49ed-a406-a07b88f131b9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:39:28.351694 n-d-836830-18 devstack@n-api.service[112915]: DEBUG dbcounter [-] [112915] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=112915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:39:28.376380 n-d-836830-18 devstack@n-api.service[112915]: INFO nova.api.openstack.requestlog [None req-24f9744d-f21c-49ed-a406-a07b88f131b9 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035055 Sep 14 08:39:28.376974 n-d-836830-18 devstack@n-api.service[112915]: [pid: 112915|app: 0|req: 14/29] 10.222.0.60 () {64 vars in 1333 bytes} [Wed Sep 14 08:39:28 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:39:31.030567 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi [None req-babca3da-5bac-445f-9825-48ffa928cc98 admin admin] Calling method '>' {{(pid=112914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:39:31.031659 n-d-836830-18 devstack@n-api.service[112914]: INFO nova.api.openstack.requestlog [None req-babca3da-5bac-445f-9825-48ffa928cc98 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001541 Sep 14 08:39:31.032073 n-d-836830-18 devstack@n-api.service[112914]: [pid: 112914|app: 0|req: 16/30] 10.222.0.60 () {54 vars in 931 bytes} [Wed Sep 14 08:39:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:39:31.468222 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi [None req-f1f27eab-d3a8-415f-88ad-c177d050ca15 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 80, "ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "name": "m1.large", "vcpus": 4, "id": "4"}} {{(pid=112915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:39:31.494584 n-d-836830-18 devstack@n-api.service[112915]: INFO nova.api.openstack.requestlog [None req-f1f27eab-d3a8-415f-88ad-c177d050ca15 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.455622 Sep 14 08:39:31.495521 n-d-836830-18 devstack@n-api.service[112915]: [pid: 112915|app: 0|req: 15/31] 10.222.0.60 () {64 vars in 1283 bytes} [Wed Sep 14 08:39:31 2022] POST /compute/v2.1/flavors => generated 405 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 14 08:39:31.507706 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi [None req-6fff3c1b-2bc7-4c94-a09e-b2ea3bc39988 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:39:31.532636 n-d-836830-18 devstack@n-api.service[112914]: INFO nova.api.openstack.requestlog [None req-6fff3c1b-2bc7-4c94-a09e-b2ea3bc39988 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028573 Sep 14 08:39:31.533434 n-d-836830-18 devstack@n-api.service[112914]: [pid: 112914|app: 0|req: 17/32] 10.222.0.60 () {64 vars in 1333 bytes} [Wed Sep 14 08:39:31 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:39:34.223459 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi [None req-f1f27eab-d3a8-415f-88ad-c177d050ca15 admin admin] Calling method '>' {{(pid=112915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:39:34.224486 n-d-836830-18 devstack@n-api.service[112915]: INFO nova.api.openstack.requestlog [None req-f1f27eab-d3a8-415f-88ad-c177d050ca15 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 Sep 14 08:39:34.224872 n-d-836830-18 devstack@n-api.service[112915]: [pid: 112915|app: 0|req: 16/33] 10.222.0.60 () {54 vars in 931 bytes} [Wed Sep 14 08:39:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:39:34.723488 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi [None req-ccb55bb1-d243-40f9-a084-6f8352f2cff9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 160, "rxtx_factor": 1.0, "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge", "swap": 0, "id": "5", "ram": 16384}} {{(pid=112914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:39:34.731662 n-d-836830-18 devstack@n-api.service[112914]: DEBUG dbcounter [-] [112914] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=112914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:39:34.747012 n-d-836830-18 devstack@n-api.service[112914]: INFO nova.api.openstack.requestlog [None req-ccb55bb1-d243-40f9-a084-6f8352f2cff9 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.515373 Sep 14 08:39:34.748221 n-d-836830-18 devstack@n-api.service[112914]: [pid: 112914|app: 0|req: 18/34] 10.222.0.60 () {64 vars in 1283 bytes} [Wed Sep 14 08:39:34 2022] POST /compute/v2.1/flavors => generated 408 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 14 08:39:34.759448 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi [None req-6ab2237d-6f0b-4a06-9aba-95789a36f303 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:39:34.784724 n-d-836830-18 devstack@n-api.service[112915]: INFO nova.api.openstack.requestlog [None req-6ab2237d-6f0b-4a06-9aba-95789a36f303 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028964 Sep 14 08:39:34.785484 n-d-836830-18 devstack@n-api.service[112915]: [pid: 112915|app: 0|req: 17/35] 10.222.0.60 () {64 vars in 1333 bytes} [Wed Sep 14 08:39:34 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:39:56.205463 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi [None req-ccb55bb1-d243-40f9-a084-6f8352f2cff9 admin admin] Calling method '>' {{(pid=112914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:39:56.206530 n-d-836830-18 devstack@n-api.service[112914]: INFO nova.api.openstack.requestlog [None req-ccb55bb1-d243-40f9-a084-6f8352f2cff9 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Sep 14 08:39:56.206951 n-d-836830-18 devstack@n-api.service[112914]: [pid: 112914|app: 0|req: 19/36] 10.222.0.60 () {54 vars in 931 bytes} [Wed Sep 14 08:39:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:39:56.217641 n-d-836830-18 devstack@n-api.service[112915]: DEBUG dbcounter [-] [112915] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=112915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:39:56.595373 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi [None req-fb6e3b58-8aca-4be2-8118-19a4e306dda7 admin admin] Calling method '>' {{(pid=112915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:39:56.613682 n-d-836830-18 devstack@n-api.service[112915]: INFO nova.api.openstack.requestlog [None req-fb6e3b58-8aca-4be2-8118-19a4e306dda7 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.400532 Sep 14 08:39:56.614220 n-d-836830-18 devstack@n-api.service[112915]: [pid: 112915|app: 0|req: 18/37] 10.222.0.60 () {60 vars in 1292 bytes} [Wed Sep 14 08:39:56 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 08:39:57.897159 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi [None req-ccb55bb1-d243-40f9-a084-6f8352f2cff9 admin admin] Calling method '>' {{(pid=112914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:39:57.898176 n-d-836830-18 devstack@n-api.service[112914]: INFO nova.api.openstack.requestlog [None req-ccb55bb1-d243-40f9-a084-6f8352f2cff9 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Sep 14 08:39:57.898584 n-d-836830-18 devstack@n-api.service[112914]: [pid: 112914|app: 0|req: 20/38] 10.222.0.60 () {56 vars in 1074 bytes} [Wed Sep 14 08:39:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:39:58.479215 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi [None req-2ae13a29-29df-43d8-ab04-aaec266cd1b0 admin admin] Calling method '>' {{(pid=112915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:39:58.484616 n-d-836830-18 devstack@n-api.service[112915]: INFO nova.api.openstack.wsgi [None req-2ae13a29-29df-43d8-ab04-aaec266cd1b0 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 14 08:39:58.487878 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi [None req-2ae13a29-29df-43d8-ab04-aaec266cd1b0 admin admin] Request method failure captured: Sep 14 08:39:58.487878 n-d-836830-18 devstack@n-api.service[112915]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 14 08:39:58.487878 n-d-836830-18 devstack@n-api.service[112915]: Accept: application/json Sep 14 08:39:58.487878 n-d-836830-18 devstack@n-api.service[112915]: Accept-Encoding: gzip, deflate Sep 14 08:39:58.487878 n-d-836830-18 devstack@n-api.service[112915]: Connection: keep-alive Sep 14 08:39:58.487878 n-d-836830-18 devstack@n-api.service[112915]: Content-Length: 0 Sep 14 08:39:58.487878 n-d-836830-18 devstack@n-api.service[112915]: Host: 10.222.0.60 Sep 14 08:39:58.487878 n-d-836830-18 devstack@n-api.service[112915]: Openstack-Api-Version: compute 2.92 Sep 14 08:39:58.487878 n-d-836830-18 devstack@n-api.service[112915]: Openstack-System-Scope: None Sep 14 08:39:58.487878 n-d-836830-18 devstack@n-api.service[112915]: User-Agent: python-novaclient Sep 14 08:39:58.487878 n-d-836830-18 devstack@n-api.service[112915]: X-Auth-Token: gAAAAABjIZNd1QS-g_iRhH7CefdC7w-lmP0UpDLq_j8kcEvGO5ByDjcUQZ9c3nW0czzlBZzj1QUx0UZMQNk_ZlDJ7sscZde66p0pTOZ5loOtcU_DcK0CpPKGsYfWuRM3TiQBDTKyYeKa0HPWJ9TxG9LTT5XulwtYH0TKmNTlcr7ENgEhywrnikY Sep 14 08:39:58.487878 n-d-836830-18 devstack@n-api.service[112915]: X-Domain-Id: None Sep 14 08:39:58.487878 n-d-836830-18 devstack@n-api.service[112915]: X-Domain-Name: None Sep 14 08:39:58.487878 n-d-836830-18 devstack@n-api.service[112915]: X-Identity-Status: Confirmed Sep 14 08:39:58.487878 n-d-836830-18 devstack@n-api.service[112915]: X-Is-Admin-Project: True Sep 14 08:39:58.487878 n-d-836830-18 devstack@n-api.service[112915]: X-Openstack-Nova-Api-Version: 2.92 Sep 14 08:39:58.487878 n-d-836830-18 devstack@n-api.service[112915]: X-Project-Domain-Id: default Sep 14 08:39:58.487878 n-d-836830-18 devstack@n-api.service[112915]: X-Project-Domain-Name: Default Sep 14 08:39:58.487878 n-d-836830-18 devstack@n-api.service[112915]: X-Project-Id: 9c488597177e469597e328bac29ff9f9 Sep 14 08:39:58.487878 n-d-836830-18 devstack@n-api.service[112915]: X-Project-Name: admin Sep 14 08:39:58.487878 n-d-836830-18 devstack@n-api.service[112915]: X-Role: reader,member,admin Sep 14 08:39:58.487878 n-d-836830-18 devstack@n-api.service[112915]: X-Roles: reader,member,admin Sep 14 08:39:58.489602 n-d-836830-18 devstack@n-api.service[112915]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/9c488597177e469597e328bac29ff9f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_9c488597177e469597e328bac29ff9f9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9c488597177e469597e328bac29ff9f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9c488597177e469597e328bac29ff9f9"}]}] Sep 14 08:39:58.489602 n-d-836830-18 devstack@n-api.service[112915]: X-Tenant: admin Sep 14 08:39:58.489602 n-d-836830-18 devstack@n-api.service[112915]: X-Tenant-Id: 9c488597177e469597e328bac29ff9f9 Sep 14 08:39:58.489602 n-d-836830-18 devstack@n-api.service[112915]: X-Tenant-Name: admin Sep 14 08:39:58.489602 n-d-836830-18 devstack@n-api.service[112915]: X-User: admin Sep 14 08:39:58.489602 n-d-836830-18 devstack@n-api.service[112915]: X-User-Domain-Id: default Sep 14 08:39:58.489602 n-d-836830-18 devstack@n-api.service[112915]: X-User-Domain-Name: Default Sep 14 08:39:58.489602 n-d-836830-18 devstack@n-api.service[112915]: X-User-Id: 881ac425a3324d418c9851b0a65ac4f6 Sep 14 08:39:58.489602 n-d-836830-18 devstack@n-api.service[112915]: X-User-Name: admin Sep 14 08:39:58.489602 n-d-836830-18 devstack@n-api.service[112915]: method: > Sep 14 08:39:58.489602 n-d-836830-18 devstack@n-api.service[112915]: exception: Flavor 42 could not be found. Sep 14 08:39:58.489602 n-d-836830-18 devstack@n-api.service[112915]: action_args: {'id': '42'} Sep 14 08:39:58.489602 n-d-836830-18 devstack@n-api.service[112915]: {{(pid=112915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:39:58.489602 n-d-836830-18 devstack@n-api.service[112915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:39:58.490530 n-d-836830-18 devstack@n-api.service[112915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 14 08:39:58.490530 n-d-836830-18 devstack@n-api.service[112915]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 14 08:39:58.490530 n-d-836830-18 devstack@n-api.service[112915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 14 08:39:58.490530 n-d-836830-18 devstack@n-api.service[112915]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 14 08:39:58.490530 n-d-836830-18 devstack@n-api.service[112915]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 14 08:39:58.490530 n-d-836830-18 devstack@n-api.service[112915]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 14 08:39:58.490530 n-d-836830-18 devstack@n-api.service[112915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 14 08:39:58.490530 n-d-836830-18 devstack@n-api.service[112915]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 14 08:39:58.490530 n-d-836830-18 devstack@n-api.service[112915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 14 08:39:58.490530 n-d-836830-18 devstack@n-api.service[112915]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:39:58.490530 n-d-836830-18 devstack@n-api.service[112915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 14 08:39:58.490530 n-d-836830-18 devstack@n-api.service[112915]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 14 08:39:58.490530 n-d-836830-18 devstack@n-api.service[112915]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 14 08:39:58.490530 n-d-836830-18 devstack@n-api.service[112915]: ERROR nova.api.openstack.wsgi Sep 14 08:39:58.490530 n-d-836830-18 devstack@n-api.service[112915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:39:58.490530 n-d-836830-18 devstack@n-api.service[112915]: ERROR nova.api.openstack.wsgi Sep 14 08:39:58.490530 n-d-836830-18 devstack@n-api.service[112915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:39:58.490530 n-d-836830-18 devstack@n-api.service[112915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:39:58.490530 n-d-836830-18 devstack@n-api.service[112915]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:39:58.492044 n-d-836830-18 devstack@n-api.service[112915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:39:58.492044 n-d-836830-18 devstack@n-api.service[112915]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:39:58.492044 n-d-836830-18 devstack@n-api.service[112915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:39:58.492044 n-d-836830-18 devstack@n-api.service[112915]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:39:58.492044 n-d-836830-18 devstack@n-api.service[112915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 14 08:39:58.492044 n-d-836830-18 devstack@n-api.service[112915]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 14 08:39:58.492044 n-d-836830-18 devstack@n-api.service[112915]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 14 08:39:58.492044 n-d-836830-18 devstack@n-api.service[112915]: ERROR nova.api.openstack.wsgi Sep 14 08:39:58.492044 n-d-836830-18 devstack@n-api.service[112915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:39:58.492044 n-d-836830-18 devstack@n-api.service[112915]: ERROR nova.api.openstack.wsgi Sep 14 08:39:58.492044 n-d-836830-18 devstack@n-api.service[112915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:39:58.492044 n-d-836830-18 devstack@n-api.service[112915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:39:58.492044 n-d-836830-18 devstack@n-api.service[112915]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:39:58.492044 n-d-836830-18 devstack@n-api.service[112915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:39:58.492044 n-d-836830-18 devstack@n-api.service[112915]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:39:58.492044 n-d-836830-18 devstack@n-api.service[112915]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 14 08:39:58.492044 n-d-836830-18 devstack@n-api.service[112915]: ERROR nova.api.openstack.wsgi Sep 14 08:39:58.492044 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi [None req-2ae13a29-29df-43d8-ab04-aaec266cd1b0 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=112915) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:39:58.493357 n-d-836830-18 devstack@n-api.service[112915]: INFO nova.api.openstack.requestlog [None req-2ae13a29-29df-43d8-ab04-aaec266cd1b0 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.391711 Sep 14 08:39:58.493357 n-d-836830-18 devstack@n-api.service[112915]: [pid: 112915|app: 0|req: 19/39] 10.222.0.60 () {60 vars in 1190 bytes} [Wed Sep 14 08:39:58 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 393 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 14 08:39:58.499325 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi [None req-f3673b81-2280-42ed-a898-361a41ef9369 admin admin] Calling method '>' {{(pid=112914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:39:58.523280 n-d-836830-18 devstack@n-api.service[112914]: INFO nova.api.openstack.requestlog [None req-f3673b81-2280-42ed-a898-361a41ef9369 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027529 Sep 14 08:39:58.523825 n-d-836830-18 devstack@n-api.service[112914]: [pid: 112914|app: 0|req: 21/40] 10.222.0.60 () {60 vars in 1210 bytes} [Wed Sep 14 08:39:58 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 08:39:58.540205 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi [None req-f87900f7-f7ab-4f7e-bc56-51e5dda56fb0 admin admin] Calling method '>' {{(pid=112915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:39:58.562139 n-d-836830-18 devstack@n-api.service[112915]: INFO nova.api.openstack.requestlog [None req-f87900f7-f7ab-4f7e-bc56-51e5dda56fb0 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026404 Sep 14 08:39:58.562698 n-d-836830-18 devstack@n-api.service[112915]: [pid: 112915|app: 0|req: 20/41] 10.222.0.60 () {60 vars in 1210 bytes} [Wed Sep 14 08:39:58 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:39:58.572746 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi [None req-1212a7b7-88c3-44dc-9b8c-e845f47cd205 admin admin] Calling method '>' {{(pid=112914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:39:58.578302 n-d-836830-18 devstack@n-api.service[112914]: INFO nova.api.openstack.wsgi [None req-1212a7b7-88c3-44dc-9b8c-e845f47cd205 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 14 08:39:58.581657 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi [None req-1212a7b7-88c3-44dc-9b8c-e845f47cd205 admin admin] Request method failure captured: Sep 14 08:39:58.581657 n-d-836830-18 devstack@n-api.service[112914]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 14 08:39:58.581657 n-d-836830-18 devstack@n-api.service[112914]: Accept: application/json Sep 14 08:39:58.581657 n-d-836830-18 devstack@n-api.service[112914]: Accept-Encoding: gzip, deflate Sep 14 08:39:58.581657 n-d-836830-18 devstack@n-api.service[112914]: Connection: keep-alive Sep 14 08:39:58.581657 n-d-836830-18 devstack@n-api.service[112914]: Content-Length: 0 Sep 14 08:39:58.581657 n-d-836830-18 devstack@n-api.service[112914]: Host: 10.222.0.60 Sep 14 08:39:58.581657 n-d-836830-18 devstack@n-api.service[112914]: Openstack-Api-Version: compute 2.92 Sep 14 08:39:58.581657 n-d-836830-18 devstack@n-api.service[112914]: Openstack-System-Scope: None Sep 14 08:39:58.581657 n-d-836830-18 devstack@n-api.service[112914]: User-Agent: python-novaclient Sep 14 08:39:58.581657 n-d-836830-18 devstack@n-api.service[112914]: X-Auth-Token: gAAAAABjIZNd1QS-g_iRhH7CefdC7w-lmP0UpDLq_j8kcEvGO5ByDjcUQZ9c3nW0czzlBZzj1QUx0UZMQNk_ZlDJ7sscZde66p0pTOZ5loOtcU_DcK0CpPKGsYfWuRM3TiQBDTKyYeKa0HPWJ9TxG9LTT5XulwtYH0TKmNTlcr7ENgEhywrnikY Sep 14 08:39:58.581657 n-d-836830-18 devstack@n-api.service[112914]: X-Domain-Id: None Sep 14 08:39:58.581657 n-d-836830-18 devstack@n-api.service[112914]: X-Domain-Name: None Sep 14 08:39:58.581657 n-d-836830-18 devstack@n-api.service[112914]: X-Identity-Status: Confirmed Sep 14 08:39:58.581657 n-d-836830-18 devstack@n-api.service[112914]: X-Is-Admin-Project: True Sep 14 08:39:58.581657 n-d-836830-18 devstack@n-api.service[112914]: X-Openstack-Nova-Api-Version: 2.92 Sep 14 08:39:58.581657 n-d-836830-18 devstack@n-api.service[112914]: X-Project-Domain-Id: default Sep 14 08:39:58.581657 n-d-836830-18 devstack@n-api.service[112914]: X-Project-Domain-Name: Default Sep 14 08:39:58.581657 n-d-836830-18 devstack@n-api.service[112914]: X-Project-Id: 9c488597177e469597e328bac29ff9f9 Sep 14 08:39:58.581657 n-d-836830-18 devstack@n-api.service[112914]: X-Project-Name: admin Sep 14 08:39:58.581657 n-d-836830-18 devstack@n-api.service[112914]: X-Role: reader,member,admin Sep 14 08:39:58.581657 n-d-836830-18 devstack@n-api.service[112914]: X-Roles: reader,member,admin Sep 14 08:39:58.583258 n-d-836830-18 devstack@n-api.service[112914]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/9c488597177e469597e328bac29ff9f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_9c488597177e469597e328bac29ff9f9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9c488597177e469597e328bac29ff9f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9c488597177e469597e328bac29ff9f9"}]}] Sep 14 08:39:58.583258 n-d-836830-18 devstack@n-api.service[112914]: X-Tenant: admin Sep 14 08:39:58.583258 n-d-836830-18 devstack@n-api.service[112914]: X-Tenant-Id: 9c488597177e469597e328bac29ff9f9 Sep 14 08:39:58.583258 n-d-836830-18 devstack@n-api.service[112914]: X-Tenant-Name: admin Sep 14 08:39:58.583258 n-d-836830-18 devstack@n-api.service[112914]: X-User: admin Sep 14 08:39:58.583258 n-d-836830-18 devstack@n-api.service[112914]: X-User-Domain-Id: default Sep 14 08:39:58.583258 n-d-836830-18 devstack@n-api.service[112914]: X-User-Domain-Name: Default Sep 14 08:39:58.583258 n-d-836830-18 devstack@n-api.service[112914]: X-User-Id: 881ac425a3324d418c9851b0a65ac4f6 Sep 14 08:39:58.583258 n-d-836830-18 devstack@n-api.service[112914]: X-User-Name: admin Sep 14 08:39:58.583258 n-d-836830-18 devstack@n-api.service[112914]: method: > Sep 14 08:39:58.583258 n-d-836830-18 devstack@n-api.service[112914]: exception: Flavor 42 could not be found. Sep 14 08:39:58.583258 n-d-836830-18 devstack@n-api.service[112914]: action_args: {'id': '42'} Sep 14 08:39:58.583258 n-d-836830-18 devstack@n-api.service[112914]: {{(pid=112914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:39:58.583258 n-d-836830-18 devstack@n-api.service[112914]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:39:58.585223 n-d-836830-18 devstack@n-api.service[112914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 14 08:39:58.585223 n-d-836830-18 devstack@n-api.service[112914]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 14 08:39:58.585223 n-d-836830-18 devstack@n-api.service[112914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 14 08:39:58.585223 n-d-836830-18 devstack@n-api.service[112914]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 14 08:39:58.585223 n-d-836830-18 devstack@n-api.service[112914]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 14 08:39:58.585223 n-d-836830-18 devstack@n-api.service[112914]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 14 08:39:58.585223 n-d-836830-18 devstack@n-api.service[112914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 14 08:39:58.585223 n-d-836830-18 devstack@n-api.service[112914]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 14 08:39:58.585223 n-d-836830-18 devstack@n-api.service[112914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 14 08:39:58.585223 n-d-836830-18 devstack@n-api.service[112914]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:39:58.585223 n-d-836830-18 devstack@n-api.service[112914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 14 08:39:58.585223 n-d-836830-18 devstack@n-api.service[112914]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 14 08:39:58.585223 n-d-836830-18 devstack@n-api.service[112914]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 14 08:39:58.585223 n-d-836830-18 devstack@n-api.service[112914]: ERROR nova.api.openstack.wsgi Sep 14 08:39:58.585223 n-d-836830-18 devstack@n-api.service[112914]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:39:58.585223 n-d-836830-18 devstack@n-api.service[112914]: ERROR nova.api.openstack.wsgi Sep 14 08:39:58.585223 n-d-836830-18 devstack@n-api.service[112914]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:39:58.585223 n-d-836830-18 devstack@n-api.service[112914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:39:58.585223 n-d-836830-18 devstack@n-api.service[112914]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:39:58.586559 n-d-836830-18 devstack@n-api.service[112914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:39:58.586559 n-d-836830-18 devstack@n-api.service[112914]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:39:58.586559 n-d-836830-18 devstack@n-api.service[112914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:39:58.586559 n-d-836830-18 devstack@n-api.service[112914]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:39:58.586559 n-d-836830-18 devstack@n-api.service[112914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 14 08:39:58.586559 n-d-836830-18 devstack@n-api.service[112914]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 14 08:39:58.586559 n-d-836830-18 devstack@n-api.service[112914]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 14 08:39:58.586559 n-d-836830-18 devstack@n-api.service[112914]: ERROR nova.api.openstack.wsgi Sep 14 08:39:58.586559 n-d-836830-18 devstack@n-api.service[112914]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:39:58.586559 n-d-836830-18 devstack@n-api.service[112914]: ERROR nova.api.openstack.wsgi Sep 14 08:39:58.586559 n-d-836830-18 devstack@n-api.service[112914]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:39:58.586559 n-d-836830-18 devstack@n-api.service[112914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:39:58.586559 n-d-836830-18 devstack@n-api.service[112914]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:39:58.586559 n-d-836830-18 devstack@n-api.service[112914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:39:58.586559 n-d-836830-18 devstack@n-api.service[112914]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:39:58.586559 n-d-836830-18 devstack@n-api.service[112914]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 14 08:39:58.586559 n-d-836830-18 devstack@n-api.service[112914]: ERROR nova.api.openstack.wsgi Sep 14 08:39:58.586559 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi [None req-1212a7b7-88c3-44dc-9b8c-e845f47cd205 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=112914) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:39:58.588299 n-d-836830-18 devstack@n-api.service[112914]: INFO nova.api.openstack.requestlog [None req-1212a7b7-88c3-44dc-9b8c-e845f47cd205 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014593 Sep 14 08:39:58.588299 n-d-836830-18 devstack@n-api.service[112914]: [pid: 112914|app: 0|req: 22/42] 10.222.0.60 () {60 vars in 1190 bytes} [Wed Sep 14 08:39:58 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 14 08:39:59.814101 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi [None req-f87900f7-f7ab-4f7e-bc56-51e5dda56fb0 admin admin] Calling method '>' {{(pid=112915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:39:59.815151 n-d-836830-18 devstack@n-api.service[112915]: INFO nova.api.openstack.requestlog [None req-f87900f7-f7ab-4f7e-bc56-51e5dda56fb0 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Sep 14 08:39:59.815539 n-d-836830-18 devstack@n-api.service[112915]: [pid: 112915|app: 0|req: 21/43] 10.222.0.60 () {56 vars in 1074 bytes} [Wed Sep 14 08:39:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:40:00.335100 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi [None req-2a9d5a52-19ca-4a1a-8ef4-39709c98708c admin admin] Calling method '>' {{(pid=112914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:40:00.340681 n-d-836830-18 devstack@n-api.service[112914]: INFO nova.api.openstack.wsgi [None req-2a9d5a52-19ca-4a1a-8ef4-39709c98708c admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 14 08:40:00.342155 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi [None req-2a9d5a52-19ca-4a1a-8ef4-39709c98708c admin admin] Request method failure captured: Sep 14 08:40:00.342155 n-d-836830-18 devstack@n-api.service[112914]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 14 08:40:00.342155 n-d-836830-18 devstack@n-api.service[112914]: Accept: application/json Sep 14 08:40:00.342155 n-d-836830-18 devstack@n-api.service[112914]: Accept-Encoding: gzip, deflate Sep 14 08:40:00.342155 n-d-836830-18 devstack@n-api.service[112914]: Connection: keep-alive Sep 14 08:40:00.342155 n-d-836830-18 devstack@n-api.service[112914]: Content-Length: 0 Sep 14 08:40:00.342155 n-d-836830-18 devstack@n-api.service[112914]: Host: 10.222.0.60 Sep 14 08:40:00.342155 n-d-836830-18 devstack@n-api.service[112914]: Openstack-Api-Version: compute 2.92 Sep 14 08:40:00.342155 n-d-836830-18 devstack@n-api.service[112914]: Openstack-System-Scope: None Sep 14 08:40:00.342155 n-d-836830-18 devstack@n-api.service[112914]: User-Agent: python-novaclient Sep 14 08:40:00.342155 n-d-836830-18 devstack@n-api.service[112914]: X-Auth-Token: gAAAAABjIZNfns4mkLiLr4nwgWIXIgNgHFjsUrpdz4LWouPmCJOL3jlbEJvaUMk7yoVqOSviw-C548GZXzTnGFuBB7APOP1oq0A0GSuvoiuOu6QW38-2AdiF5s9I8tXg2GQI1z1TZG4Y9xhuGRnN7S-yyIzW5p0FoBwhyhIGBFiNkHD3d97jlgM Sep 14 08:40:00.342155 n-d-836830-18 devstack@n-api.service[112914]: X-Domain-Id: None Sep 14 08:40:00.342155 n-d-836830-18 devstack@n-api.service[112914]: X-Domain-Name: None Sep 14 08:40:00.342155 n-d-836830-18 devstack@n-api.service[112914]: X-Identity-Status: Confirmed Sep 14 08:40:00.342155 n-d-836830-18 devstack@n-api.service[112914]: X-Is-Admin-Project: True Sep 14 08:40:00.342155 n-d-836830-18 devstack@n-api.service[112914]: X-Openstack-Nova-Api-Version: 2.92 Sep 14 08:40:00.342155 n-d-836830-18 devstack@n-api.service[112914]: X-Project-Domain-Id: default Sep 14 08:40:00.342155 n-d-836830-18 devstack@n-api.service[112914]: X-Project-Domain-Name: Default Sep 14 08:40:00.342155 n-d-836830-18 devstack@n-api.service[112914]: X-Project-Id: 9c488597177e469597e328bac29ff9f9 Sep 14 08:40:00.342155 n-d-836830-18 devstack@n-api.service[112914]: X-Project-Name: admin Sep 14 08:40:00.342155 n-d-836830-18 devstack@n-api.service[112914]: X-Role: reader,member,admin Sep 14 08:40:00.342155 n-d-836830-18 devstack@n-api.service[112914]: X-Roles: reader,member,admin Sep 14 08:40:00.343824 n-d-836830-18 devstack@n-api.service[112914]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/9c488597177e469597e328bac29ff9f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_9c488597177e469597e328bac29ff9f9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9c488597177e469597e328bac29ff9f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9c488597177e469597e328bac29ff9f9"}]}] Sep 14 08:40:00.343824 n-d-836830-18 devstack@n-api.service[112914]: X-Tenant: admin Sep 14 08:40:00.343824 n-d-836830-18 devstack@n-api.service[112914]: X-Tenant-Id: 9c488597177e469597e328bac29ff9f9 Sep 14 08:40:00.343824 n-d-836830-18 devstack@n-api.service[112914]: X-Tenant-Name: admin Sep 14 08:40:00.343824 n-d-836830-18 devstack@n-api.service[112914]: X-User: admin Sep 14 08:40:00.343824 n-d-836830-18 devstack@n-api.service[112914]: X-User-Domain-Id: default Sep 14 08:40:00.343824 n-d-836830-18 devstack@n-api.service[112914]: X-User-Domain-Name: Default Sep 14 08:40:00.343824 n-d-836830-18 devstack@n-api.service[112914]: X-User-Id: 881ac425a3324d418c9851b0a65ac4f6 Sep 14 08:40:00.343824 n-d-836830-18 devstack@n-api.service[112914]: X-User-Name: admin Sep 14 08:40:00.343824 n-d-836830-18 devstack@n-api.service[112914]: method: > Sep 14 08:40:00.343824 n-d-836830-18 devstack@n-api.service[112914]: exception: Flavor 84 could not be found. Sep 14 08:40:00.343824 n-d-836830-18 devstack@n-api.service[112914]: action_args: {'id': '84'} Sep 14 08:40:00.343824 n-d-836830-18 devstack@n-api.service[112914]: {{(pid=112914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:40:00.343824 n-d-836830-18 devstack@n-api.service[112914]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:40:00.344902 n-d-836830-18 devstack@n-api.service[112914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 14 08:40:00.344902 n-d-836830-18 devstack@n-api.service[112914]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 14 08:40:00.344902 n-d-836830-18 devstack@n-api.service[112914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 14 08:40:00.344902 n-d-836830-18 devstack@n-api.service[112914]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 14 08:40:00.344902 n-d-836830-18 devstack@n-api.service[112914]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 14 08:40:00.344902 n-d-836830-18 devstack@n-api.service[112914]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 14 08:40:00.344902 n-d-836830-18 devstack@n-api.service[112914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 14 08:40:00.344902 n-d-836830-18 devstack@n-api.service[112914]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 14 08:40:00.344902 n-d-836830-18 devstack@n-api.service[112914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 14 08:40:00.344902 n-d-836830-18 devstack@n-api.service[112914]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:40:00.344902 n-d-836830-18 devstack@n-api.service[112914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 14 08:40:00.344902 n-d-836830-18 devstack@n-api.service[112914]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 14 08:40:00.344902 n-d-836830-18 devstack@n-api.service[112914]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 14 08:40:00.344902 n-d-836830-18 devstack@n-api.service[112914]: ERROR nova.api.openstack.wsgi Sep 14 08:40:00.344902 n-d-836830-18 devstack@n-api.service[112914]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:40:00.344902 n-d-836830-18 devstack@n-api.service[112914]: ERROR nova.api.openstack.wsgi Sep 14 08:40:00.344902 n-d-836830-18 devstack@n-api.service[112914]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:40:00.344902 n-d-836830-18 devstack@n-api.service[112914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:40:00.344902 n-d-836830-18 devstack@n-api.service[112914]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:40:00.346303 n-d-836830-18 devstack@n-api.service[112914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:40:00.346303 n-d-836830-18 devstack@n-api.service[112914]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:40:00.346303 n-d-836830-18 devstack@n-api.service[112914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:40:00.346303 n-d-836830-18 devstack@n-api.service[112914]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:40:00.346303 n-d-836830-18 devstack@n-api.service[112914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 14 08:40:00.346303 n-d-836830-18 devstack@n-api.service[112914]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 14 08:40:00.346303 n-d-836830-18 devstack@n-api.service[112914]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 14 08:40:00.346303 n-d-836830-18 devstack@n-api.service[112914]: ERROR nova.api.openstack.wsgi Sep 14 08:40:00.346303 n-d-836830-18 devstack@n-api.service[112914]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:40:00.346303 n-d-836830-18 devstack@n-api.service[112914]: ERROR nova.api.openstack.wsgi Sep 14 08:40:00.346303 n-d-836830-18 devstack@n-api.service[112914]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:40:00.346303 n-d-836830-18 devstack@n-api.service[112914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:40:00.346303 n-d-836830-18 devstack@n-api.service[112914]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:40:00.346303 n-d-836830-18 devstack@n-api.service[112914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:40:00.346303 n-d-836830-18 devstack@n-api.service[112914]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:40:00.346303 n-d-836830-18 devstack@n-api.service[112914]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 14 08:40:00.346303 n-d-836830-18 devstack@n-api.service[112914]: ERROR nova.api.openstack.wsgi Sep 14 08:40:00.346303 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi [None req-2a9d5a52-19ca-4a1a-8ef4-39709c98708c admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=112914) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:40:00.347699 n-d-836830-18 devstack@n-api.service[112914]: INFO nova.api.openstack.requestlog [None req-2a9d5a52-19ca-4a1a-8ef4-39709c98708c admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.391911 Sep 14 08:40:00.347699 n-d-836830-18 devstack@n-api.service[112914]: [pid: 112914|app: 0|req: 23/44] 10.222.0.60 () {60 vars in 1190 bytes} [Wed Sep 14 08:39:59 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 393 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 14 08:40:00.353961 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi [None req-aa2dc32f-3460-45f8-adde-7a2a7663f973 admin admin] Calling method '>' {{(pid=112915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:40:00.368803 n-d-836830-18 devstack@n-api.service[112915]: INFO nova.api.openstack.requestlog [None req-aa2dc32f-3460-45f8-adde-7a2a7663f973 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019031 Sep 14 08:40:00.369350 n-d-836830-18 devstack@n-api.service[112915]: [pid: 112915|app: 0|req: 22/45] 10.222.0.60 () {60 vars in 1210 bytes} [Wed Sep 14 08:40:00 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 08:40:00.378784 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi [None req-927efc8f-e4b6-4ca6-99c5-18a9a37a74d8 admin admin] Calling method '>' {{(pid=112914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:40:00.393911 n-d-836830-18 devstack@n-api.service[112914]: INFO nova.api.openstack.requestlog [None req-927efc8f-e4b6-4ca6-99c5-18a9a37a74d8 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018765 Sep 14 08:40:00.394433 n-d-836830-18 devstack@n-api.service[112914]: [pid: 112914|app: 0|req: 24/46] 10.222.0.60 () {60 vars in 1210 bytes} [Wed Sep 14 08:40:00 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 08:40:00.404131 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi [None req-bf3d6757-f242-4752-a611-4d11115a1add admin admin] Calling method '>' {{(pid=112915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:40:00.409225 n-d-836830-18 devstack@n-api.service[112915]: INFO nova.api.openstack.wsgi [None req-bf3d6757-f242-4752-a611-4d11115a1add admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 14 08:40:00.410726 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi [None req-bf3d6757-f242-4752-a611-4d11115a1add admin admin] Request method failure captured: Sep 14 08:40:00.410726 n-d-836830-18 devstack@n-api.service[112915]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 14 08:40:00.410726 n-d-836830-18 devstack@n-api.service[112915]: Accept: application/json Sep 14 08:40:00.410726 n-d-836830-18 devstack@n-api.service[112915]: Accept-Encoding: gzip, deflate Sep 14 08:40:00.410726 n-d-836830-18 devstack@n-api.service[112915]: Connection: keep-alive Sep 14 08:40:00.410726 n-d-836830-18 devstack@n-api.service[112915]: Content-Length: 0 Sep 14 08:40:00.410726 n-d-836830-18 devstack@n-api.service[112915]: Host: 10.222.0.60 Sep 14 08:40:00.410726 n-d-836830-18 devstack@n-api.service[112915]: Openstack-Api-Version: compute 2.92 Sep 14 08:40:00.410726 n-d-836830-18 devstack@n-api.service[112915]: Openstack-System-Scope: None Sep 14 08:40:00.410726 n-d-836830-18 devstack@n-api.service[112915]: User-Agent: python-novaclient Sep 14 08:40:00.410726 n-d-836830-18 devstack@n-api.service[112915]: X-Auth-Token: gAAAAABjIZNfns4mkLiLr4nwgWIXIgNgHFjsUrpdz4LWouPmCJOL3jlbEJvaUMk7yoVqOSviw-C548GZXzTnGFuBB7APOP1oq0A0GSuvoiuOu6QW38-2AdiF5s9I8tXg2GQI1z1TZG4Y9xhuGRnN7S-yyIzW5p0FoBwhyhIGBFiNkHD3d97jlgM Sep 14 08:40:00.410726 n-d-836830-18 devstack@n-api.service[112915]: X-Domain-Id: None Sep 14 08:40:00.410726 n-d-836830-18 devstack@n-api.service[112915]: X-Domain-Name: None Sep 14 08:40:00.410726 n-d-836830-18 devstack@n-api.service[112915]: X-Identity-Status: Confirmed Sep 14 08:40:00.410726 n-d-836830-18 devstack@n-api.service[112915]: X-Is-Admin-Project: True Sep 14 08:40:00.410726 n-d-836830-18 devstack@n-api.service[112915]: X-Openstack-Nova-Api-Version: 2.92 Sep 14 08:40:00.410726 n-d-836830-18 devstack@n-api.service[112915]: X-Project-Domain-Id: default Sep 14 08:40:00.410726 n-d-836830-18 devstack@n-api.service[112915]: X-Project-Domain-Name: Default Sep 14 08:40:00.410726 n-d-836830-18 devstack@n-api.service[112915]: X-Project-Id: 9c488597177e469597e328bac29ff9f9 Sep 14 08:40:00.410726 n-d-836830-18 devstack@n-api.service[112915]: X-Project-Name: admin Sep 14 08:40:00.410726 n-d-836830-18 devstack@n-api.service[112915]: X-Role: reader,member,admin Sep 14 08:40:00.410726 n-d-836830-18 devstack@n-api.service[112915]: X-Roles: reader,member,admin Sep 14 08:40:00.412372 n-d-836830-18 devstack@n-api.service[112915]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/9c488597177e469597e328bac29ff9f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_9c488597177e469597e328bac29ff9f9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9c488597177e469597e328bac29ff9f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9c488597177e469597e328bac29ff9f9"}]}] Sep 14 08:40:00.412372 n-d-836830-18 devstack@n-api.service[112915]: X-Tenant: admin Sep 14 08:40:00.412372 n-d-836830-18 devstack@n-api.service[112915]: X-Tenant-Id: 9c488597177e469597e328bac29ff9f9 Sep 14 08:40:00.412372 n-d-836830-18 devstack@n-api.service[112915]: X-Tenant-Name: admin Sep 14 08:40:00.412372 n-d-836830-18 devstack@n-api.service[112915]: X-User: admin Sep 14 08:40:00.412372 n-d-836830-18 devstack@n-api.service[112915]: X-User-Domain-Id: default Sep 14 08:40:00.412372 n-d-836830-18 devstack@n-api.service[112915]: X-User-Domain-Name: Default Sep 14 08:40:00.412372 n-d-836830-18 devstack@n-api.service[112915]: X-User-Id: 881ac425a3324d418c9851b0a65ac4f6 Sep 14 08:40:00.412372 n-d-836830-18 devstack@n-api.service[112915]: X-User-Name: admin Sep 14 08:40:00.412372 n-d-836830-18 devstack@n-api.service[112915]: method: > Sep 14 08:40:00.412372 n-d-836830-18 devstack@n-api.service[112915]: exception: Flavor 84 could not be found. Sep 14 08:40:00.412372 n-d-836830-18 devstack@n-api.service[112915]: action_args: {'id': '84'} Sep 14 08:40:00.412372 n-d-836830-18 devstack@n-api.service[112915]: {{(pid=112915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:40:00.412372 n-d-836830-18 devstack@n-api.service[112915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:40:00.413207 n-d-836830-18 devstack@n-api.service[112915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 14 08:40:00.413207 n-d-836830-18 devstack@n-api.service[112915]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 14 08:40:00.413207 n-d-836830-18 devstack@n-api.service[112915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 14 08:40:00.413207 n-d-836830-18 devstack@n-api.service[112915]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 14 08:40:00.413207 n-d-836830-18 devstack@n-api.service[112915]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 14 08:40:00.413207 n-d-836830-18 devstack@n-api.service[112915]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 14 08:40:00.413207 n-d-836830-18 devstack@n-api.service[112915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 14 08:40:00.413207 n-d-836830-18 devstack@n-api.service[112915]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 14 08:40:00.413207 n-d-836830-18 devstack@n-api.service[112915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 14 08:40:00.413207 n-d-836830-18 devstack@n-api.service[112915]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:40:00.413207 n-d-836830-18 devstack@n-api.service[112915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 14 08:40:00.413207 n-d-836830-18 devstack@n-api.service[112915]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 14 08:40:00.413207 n-d-836830-18 devstack@n-api.service[112915]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 14 08:40:00.413207 n-d-836830-18 devstack@n-api.service[112915]: ERROR nova.api.openstack.wsgi Sep 14 08:40:00.413207 n-d-836830-18 devstack@n-api.service[112915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:40:00.413207 n-d-836830-18 devstack@n-api.service[112915]: ERROR nova.api.openstack.wsgi Sep 14 08:40:00.413207 n-d-836830-18 devstack@n-api.service[112915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:40:00.413207 n-d-836830-18 devstack@n-api.service[112915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:40:00.413207 n-d-836830-18 devstack@n-api.service[112915]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:40:00.414317 n-d-836830-18 devstack@n-api.service[112915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:40:00.414317 n-d-836830-18 devstack@n-api.service[112915]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:40:00.414317 n-d-836830-18 devstack@n-api.service[112915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:40:00.414317 n-d-836830-18 devstack@n-api.service[112915]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:40:00.414317 n-d-836830-18 devstack@n-api.service[112915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 14 08:40:00.414317 n-d-836830-18 devstack@n-api.service[112915]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 14 08:40:00.414317 n-d-836830-18 devstack@n-api.service[112915]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 14 08:40:00.414317 n-d-836830-18 devstack@n-api.service[112915]: ERROR nova.api.openstack.wsgi Sep 14 08:40:00.414317 n-d-836830-18 devstack@n-api.service[112915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:40:00.414317 n-d-836830-18 devstack@n-api.service[112915]: ERROR nova.api.openstack.wsgi Sep 14 08:40:00.414317 n-d-836830-18 devstack@n-api.service[112915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:40:00.414317 n-d-836830-18 devstack@n-api.service[112915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:40:00.414317 n-d-836830-18 devstack@n-api.service[112915]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:40:00.414317 n-d-836830-18 devstack@n-api.service[112915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:40:00.414317 n-d-836830-18 devstack@n-api.service[112915]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:40:00.414317 n-d-836830-18 devstack@n-api.service[112915]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 14 08:40:00.414317 n-d-836830-18 devstack@n-api.service[112915]: ERROR nova.api.openstack.wsgi Sep 14 08:40:00.414317 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi [None req-bf3d6757-f242-4752-a611-4d11115a1add admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=112915) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:40:00.415942 n-d-836830-18 devstack@n-api.service[112915]: INFO nova.api.openstack.requestlog [None req-bf3d6757-f242-4752-a611-4d11115a1add admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011584 Sep 14 08:40:00.415942 n-d-836830-18 devstack@n-api.service[112915]: [pid: 112915|app: 0|req: 23/47] 10.222.0.60 () {60 vars in 1190 bytes} [Wed Sep 14 08:40:00 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 14 08:40:01.616597 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi [None req-927efc8f-e4b6-4ca6-99c5-18a9a37a74d8 admin admin] Calling method '>' {{(pid=112914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:40:01.617590 n-d-836830-18 devstack@n-api.service[112914]: INFO nova.api.openstack.requestlog [None req-927efc8f-e4b6-4ca6-99c5-18a9a37a74d8 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001530 Sep 14 08:40:01.617996 n-d-836830-18 devstack@n-api.service[112914]: [pid: 112914|app: 0|req: 25/48] 10.222.0.60 () {56 vars in 1074 bytes} [Wed Sep 14 08:40:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:40:02.145016 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi [None req-3f9e9c9e-ba20-4e75-a1a4-e0612ff4be7b admin admin] Calling method '>' {{(pid=112915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:40:02.150789 n-d-836830-18 devstack@n-api.service[112915]: INFO nova.api.openstack.wsgi [None req-3f9e9c9e-ba20-4e75-a1a4-e0612ff4be7b admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 14 08:40:02.152344 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi [None req-3f9e9c9e-ba20-4e75-a1a4-e0612ff4be7b admin admin] Request method failure captured: Sep 14 08:40:02.152344 n-d-836830-18 devstack@n-api.service[112915]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 14 08:40:02.152344 n-d-836830-18 devstack@n-api.service[112915]: Accept: application/json Sep 14 08:40:02.152344 n-d-836830-18 devstack@n-api.service[112915]: Accept-Encoding: gzip, deflate Sep 14 08:40:02.152344 n-d-836830-18 devstack@n-api.service[112915]: Connection: keep-alive Sep 14 08:40:02.152344 n-d-836830-18 devstack@n-api.service[112915]: Content-Length: 0 Sep 14 08:40:02.152344 n-d-836830-18 devstack@n-api.service[112915]: Host: 10.222.0.60 Sep 14 08:40:02.152344 n-d-836830-18 devstack@n-api.service[112915]: Openstack-Api-Version: compute 2.92 Sep 14 08:40:02.152344 n-d-836830-18 devstack@n-api.service[112915]: Openstack-System-Scope: None Sep 14 08:40:02.152344 n-d-836830-18 devstack@n-api.service[112915]: User-Agent: python-novaclient Sep 14 08:40:02.152344 n-d-836830-18 devstack@n-api.service[112915]: X-Auth-Token: gAAAAABjIZNhscGVA9IJekMYnsJecomDpyWUtWKyKT13kgD4qwtb31MKo7M_IUgGyBC3FLyzClr6FDCe72RxQ9QsnXyUg1pWYBN_KembaNWUvvvWwrPe7BzBbjdcAysJZJmMu60ZQOWdBCN8UCXNt0UKQSxFJrOj6U1OAulnx5lDGAexxB6ubF8 Sep 14 08:40:02.152344 n-d-836830-18 devstack@n-api.service[112915]: X-Domain-Id: None Sep 14 08:40:02.152344 n-d-836830-18 devstack@n-api.service[112915]: X-Domain-Name: None Sep 14 08:40:02.152344 n-d-836830-18 devstack@n-api.service[112915]: X-Identity-Status: Confirmed Sep 14 08:40:02.152344 n-d-836830-18 devstack@n-api.service[112915]: X-Is-Admin-Project: True Sep 14 08:40:02.152344 n-d-836830-18 devstack@n-api.service[112915]: X-Openstack-Nova-Api-Version: 2.92 Sep 14 08:40:02.152344 n-d-836830-18 devstack@n-api.service[112915]: X-Project-Domain-Id: default Sep 14 08:40:02.152344 n-d-836830-18 devstack@n-api.service[112915]: X-Project-Domain-Name: Default Sep 14 08:40:02.152344 n-d-836830-18 devstack@n-api.service[112915]: X-Project-Id: 9c488597177e469597e328bac29ff9f9 Sep 14 08:40:02.152344 n-d-836830-18 devstack@n-api.service[112915]: X-Project-Name: admin Sep 14 08:40:02.152344 n-d-836830-18 devstack@n-api.service[112915]: X-Role: reader,member,admin Sep 14 08:40:02.152344 n-d-836830-18 devstack@n-api.service[112915]: X-Roles: reader,member,admin Sep 14 08:40:02.153912 n-d-836830-18 devstack@n-api.service[112915]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/9c488597177e469597e328bac29ff9f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_9c488597177e469597e328bac29ff9f9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9c488597177e469597e328bac29ff9f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9c488597177e469597e328bac29ff9f9"}]}] Sep 14 08:40:02.153912 n-d-836830-18 devstack@n-api.service[112915]: X-Tenant: admin Sep 14 08:40:02.153912 n-d-836830-18 devstack@n-api.service[112915]: X-Tenant-Id: 9c488597177e469597e328bac29ff9f9 Sep 14 08:40:02.153912 n-d-836830-18 devstack@n-api.service[112915]: X-Tenant-Name: admin Sep 14 08:40:02.153912 n-d-836830-18 devstack@n-api.service[112915]: X-User: admin Sep 14 08:40:02.153912 n-d-836830-18 devstack@n-api.service[112915]: X-User-Domain-Id: default Sep 14 08:40:02.153912 n-d-836830-18 devstack@n-api.service[112915]: X-User-Domain-Name: Default Sep 14 08:40:02.153912 n-d-836830-18 devstack@n-api.service[112915]: X-User-Id: 881ac425a3324d418c9851b0a65ac4f6 Sep 14 08:40:02.153912 n-d-836830-18 devstack@n-api.service[112915]: X-User-Name: admin Sep 14 08:40:02.153912 n-d-836830-18 devstack@n-api.service[112915]: method: > Sep 14 08:40:02.153912 n-d-836830-18 devstack@n-api.service[112915]: exception: Flavor 451 could not be found. Sep 14 08:40:02.153912 n-d-836830-18 devstack@n-api.service[112915]: action_args: {'id': '451'} Sep 14 08:40:02.153912 n-d-836830-18 devstack@n-api.service[112915]: {{(pid=112915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:40:02.153912 n-d-836830-18 devstack@n-api.service[112915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:40:02.154860 n-d-836830-18 devstack@n-api.service[112915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 14 08:40:02.154860 n-d-836830-18 devstack@n-api.service[112915]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 14 08:40:02.154860 n-d-836830-18 devstack@n-api.service[112915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 14 08:40:02.154860 n-d-836830-18 devstack@n-api.service[112915]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 14 08:40:02.154860 n-d-836830-18 devstack@n-api.service[112915]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 14 08:40:02.154860 n-d-836830-18 devstack@n-api.service[112915]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 14 08:40:02.154860 n-d-836830-18 devstack@n-api.service[112915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 14 08:40:02.154860 n-d-836830-18 devstack@n-api.service[112915]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 14 08:40:02.154860 n-d-836830-18 devstack@n-api.service[112915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 14 08:40:02.154860 n-d-836830-18 devstack@n-api.service[112915]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:40:02.154860 n-d-836830-18 devstack@n-api.service[112915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 14 08:40:02.154860 n-d-836830-18 devstack@n-api.service[112915]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 14 08:40:02.154860 n-d-836830-18 devstack@n-api.service[112915]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 14 08:40:02.154860 n-d-836830-18 devstack@n-api.service[112915]: ERROR nova.api.openstack.wsgi Sep 14 08:40:02.154860 n-d-836830-18 devstack@n-api.service[112915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:40:02.154860 n-d-836830-18 devstack@n-api.service[112915]: ERROR nova.api.openstack.wsgi Sep 14 08:40:02.154860 n-d-836830-18 devstack@n-api.service[112915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:40:02.154860 n-d-836830-18 devstack@n-api.service[112915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:40:02.154860 n-d-836830-18 devstack@n-api.service[112915]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:40:02.156035 n-d-836830-18 devstack@n-api.service[112915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:40:02.156035 n-d-836830-18 devstack@n-api.service[112915]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:40:02.156035 n-d-836830-18 devstack@n-api.service[112915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:40:02.156035 n-d-836830-18 devstack@n-api.service[112915]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:40:02.156035 n-d-836830-18 devstack@n-api.service[112915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 14 08:40:02.156035 n-d-836830-18 devstack@n-api.service[112915]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 14 08:40:02.156035 n-d-836830-18 devstack@n-api.service[112915]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 14 08:40:02.156035 n-d-836830-18 devstack@n-api.service[112915]: ERROR nova.api.openstack.wsgi Sep 14 08:40:02.156035 n-d-836830-18 devstack@n-api.service[112915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:40:02.156035 n-d-836830-18 devstack@n-api.service[112915]: ERROR nova.api.openstack.wsgi Sep 14 08:40:02.156035 n-d-836830-18 devstack@n-api.service[112915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:40:02.156035 n-d-836830-18 devstack@n-api.service[112915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:40:02.156035 n-d-836830-18 devstack@n-api.service[112915]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:40:02.156035 n-d-836830-18 devstack@n-api.service[112915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:40:02.156035 n-d-836830-18 devstack@n-api.service[112915]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:40:02.156035 n-d-836830-18 devstack@n-api.service[112915]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 14 08:40:02.156035 n-d-836830-18 devstack@n-api.service[112915]: ERROR nova.api.openstack.wsgi Sep 14 08:40:02.156035 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi [None req-3f9e9c9e-ba20-4e75-a1a4-e0612ff4be7b admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=112915) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:40:02.157066 n-d-836830-18 devstack@n-api.service[112915]: INFO nova.api.openstack.requestlog [None req-3f9e9c9e-ba20-4e75-a1a4-e0612ff4be7b admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.393543 Sep 14 08:40:02.157066 n-d-836830-18 devstack@n-api.service[112915]: [pid: 112915|app: 0|req: 24/49] 10.222.0.60 () {60 vars in 1193 bytes} [Wed Sep 14 08:40:01 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 395 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 14 08:40:02.163567 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi [None req-744ca7f1-0dab-42cf-b191-97f1a354c4f8 admin admin] Calling method '>' {{(pid=112914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:40:02.179893 n-d-836830-18 devstack@n-api.service[112914]: INFO nova.api.openstack.requestlog [None req-744ca7f1-0dab-42cf-b191-97f1a354c4f8 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019936 Sep 14 08:40:02.180445 n-d-836830-18 devstack@n-api.service[112914]: [pid: 112914|app: 0|req: 26/50] 10.222.0.60 () {60 vars in 1210 bytes} [Wed Sep 14 08:40:02 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:40:02.190741 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi [None req-f5eb3f84-9e83-457b-9db4-3eccd8cdb21b admin admin] Calling method '>' {{(pid=112915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:40:02.205810 n-d-836830-18 devstack@n-api.service[112915]: INFO nova.api.openstack.requestlog [None req-f5eb3f84-9e83-457b-9db4-3eccd8cdb21b admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018852 Sep 14 08:40:02.206329 n-d-836830-18 devstack@n-api.service[112915]: [pid: 112915|app: 0|req: 25/51] 10.222.0.60 () {60 vars in 1210 bytes} [Wed Sep 14 08:40:02 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:40:02.215621 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi [None req-714dc2ea-6b97-4858-9926-3e53780f1799 admin admin] Calling method '>' {{(pid=112914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:40:02.220558 n-d-836830-18 devstack@n-api.service[112914]: INFO nova.api.openstack.wsgi [None req-714dc2ea-6b97-4858-9926-3e53780f1799 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 14 08:40:02.222047 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi [None req-714dc2ea-6b97-4858-9926-3e53780f1799 admin admin] Request method failure captured: Sep 14 08:40:02.222047 n-d-836830-18 devstack@n-api.service[112914]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 14 08:40:02.222047 n-d-836830-18 devstack@n-api.service[112914]: Accept: application/json Sep 14 08:40:02.222047 n-d-836830-18 devstack@n-api.service[112914]: Accept-Encoding: gzip, deflate Sep 14 08:40:02.222047 n-d-836830-18 devstack@n-api.service[112914]: Connection: keep-alive Sep 14 08:40:02.222047 n-d-836830-18 devstack@n-api.service[112914]: Content-Length: 0 Sep 14 08:40:02.222047 n-d-836830-18 devstack@n-api.service[112914]: Host: 10.222.0.60 Sep 14 08:40:02.222047 n-d-836830-18 devstack@n-api.service[112914]: Openstack-Api-Version: compute 2.92 Sep 14 08:40:02.222047 n-d-836830-18 devstack@n-api.service[112914]: Openstack-System-Scope: None Sep 14 08:40:02.222047 n-d-836830-18 devstack@n-api.service[112914]: User-Agent: python-novaclient Sep 14 08:40:02.222047 n-d-836830-18 devstack@n-api.service[112914]: X-Auth-Token: gAAAAABjIZNhscGVA9IJekMYnsJecomDpyWUtWKyKT13kgD4qwtb31MKo7M_IUgGyBC3FLyzClr6FDCe72RxQ9QsnXyUg1pWYBN_KembaNWUvvvWwrPe7BzBbjdcAysJZJmMu60ZQOWdBCN8UCXNt0UKQSxFJrOj6U1OAulnx5lDGAexxB6ubF8 Sep 14 08:40:02.222047 n-d-836830-18 devstack@n-api.service[112914]: X-Domain-Id: None Sep 14 08:40:02.222047 n-d-836830-18 devstack@n-api.service[112914]: X-Domain-Name: None Sep 14 08:40:02.222047 n-d-836830-18 devstack@n-api.service[112914]: X-Identity-Status: Confirmed Sep 14 08:40:02.222047 n-d-836830-18 devstack@n-api.service[112914]: X-Is-Admin-Project: True Sep 14 08:40:02.222047 n-d-836830-18 devstack@n-api.service[112914]: X-Openstack-Nova-Api-Version: 2.92 Sep 14 08:40:02.222047 n-d-836830-18 devstack@n-api.service[112914]: X-Project-Domain-Id: default Sep 14 08:40:02.222047 n-d-836830-18 devstack@n-api.service[112914]: X-Project-Domain-Name: Default Sep 14 08:40:02.222047 n-d-836830-18 devstack@n-api.service[112914]: X-Project-Id: 9c488597177e469597e328bac29ff9f9 Sep 14 08:40:02.222047 n-d-836830-18 devstack@n-api.service[112914]: X-Project-Name: admin Sep 14 08:40:02.222047 n-d-836830-18 devstack@n-api.service[112914]: X-Role: reader,member,admin Sep 14 08:40:02.222047 n-d-836830-18 devstack@n-api.service[112914]: X-Roles: reader,member,admin Sep 14 08:40:02.223828 n-d-836830-18 devstack@n-api.service[112914]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/9c488597177e469597e328bac29ff9f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_9c488597177e469597e328bac29ff9f9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9c488597177e469597e328bac29ff9f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9c488597177e469597e328bac29ff9f9"}]}] Sep 14 08:40:02.223828 n-d-836830-18 devstack@n-api.service[112914]: X-Tenant: admin Sep 14 08:40:02.223828 n-d-836830-18 devstack@n-api.service[112914]: X-Tenant-Id: 9c488597177e469597e328bac29ff9f9 Sep 14 08:40:02.223828 n-d-836830-18 devstack@n-api.service[112914]: X-Tenant-Name: admin Sep 14 08:40:02.223828 n-d-836830-18 devstack@n-api.service[112914]: X-User: admin Sep 14 08:40:02.223828 n-d-836830-18 devstack@n-api.service[112914]: X-User-Domain-Id: default Sep 14 08:40:02.223828 n-d-836830-18 devstack@n-api.service[112914]: X-User-Domain-Name: Default Sep 14 08:40:02.223828 n-d-836830-18 devstack@n-api.service[112914]: X-User-Id: 881ac425a3324d418c9851b0a65ac4f6 Sep 14 08:40:02.223828 n-d-836830-18 devstack@n-api.service[112914]: X-User-Name: admin Sep 14 08:40:02.223828 n-d-836830-18 devstack@n-api.service[112914]: method: > Sep 14 08:40:02.223828 n-d-836830-18 devstack@n-api.service[112914]: exception: Flavor 451 could not be found. Sep 14 08:40:02.223828 n-d-836830-18 devstack@n-api.service[112914]: action_args: {'id': '451'} Sep 14 08:40:02.223828 n-d-836830-18 devstack@n-api.service[112914]: {{(pid=112914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:40:02.223828 n-d-836830-18 devstack@n-api.service[112914]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:40:02.224650 n-d-836830-18 devstack@n-api.service[112914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 14 08:40:02.224650 n-d-836830-18 devstack@n-api.service[112914]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 14 08:40:02.224650 n-d-836830-18 devstack@n-api.service[112914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 14 08:40:02.224650 n-d-836830-18 devstack@n-api.service[112914]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 14 08:40:02.224650 n-d-836830-18 devstack@n-api.service[112914]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 14 08:40:02.224650 n-d-836830-18 devstack@n-api.service[112914]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 14 08:40:02.224650 n-d-836830-18 devstack@n-api.service[112914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 14 08:40:02.224650 n-d-836830-18 devstack@n-api.service[112914]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 14 08:40:02.224650 n-d-836830-18 devstack@n-api.service[112914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 14 08:40:02.224650 n-d-836830-18 devstack@n-api.service[112914]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:40:02.224650 n-d-836830-18 devstack@n-api.service[112914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 14 08:40:02.224650 n-d-836830-18 devstack@n-api.service[112914]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 14 08:40:02.224650 n-d-836830-18 devstack@n-api.service[112914]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 14 08:40:02.224650 n-d-836830-18 devstack@n-api.service[112914]: ERROR nova.api.openstack.wsgi Sep 14 08:40:02.224650 n-d-836830-18 devstack@n-api.service[112914]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:40:02.224650 n-d-836830-18 devstack@n-api.service[112914]: ERROR nova.api.openstack.wsgi Sep 14 08:40:02.224650 n-d-836830-18 devstack@n-api.service[112914]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:40:02.224650 n-d-836830-18 devstack@n-api.service[112914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:40:02.224650 n-d-836830-18 devstack@n-api.service[112914]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:40:02.225808 n-d-836830-18 devstack@n-api.service[112914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:40:02.225808 n-d-836830-18 devstack@n-api.service[112914]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:40:02.225808 n-d-836830-18 devstack@n-api.service[112914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:40:02.225808 n-d-836830-18 devstack@n-api.service[112914]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:40:02.225808 n-d-836830-18 devstack@n-api.service[112914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 14 08:40:02.225808 n-d-836830-18 devstack@n-api.service[112914]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 14 08:40:02.225808 n-d-836830-18 devstack@n-api.service[112914]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 14 08:40:02.225808 n-d-836830-18 devstack@n-api.service[112914]: ERROR nova.api.openstack.wsgi Sep 14 08:40:02.225808 n-d-836830-18 devstack@n-api.service[112914]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:40:02.225808 n-d-836830-18 devstack@n-api.service[112914]: ERROR nova.api.openstack.wsgi Sep 14 08:40:02.225808 n-d-836830-18 devstack@n-api.service[112914]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:40:02.225808 n-d-836830-18 devstack@n-api.service[112914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:40:02.225808 n-d-836830-18 devstack@n-api.service[112914]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:40:02.225808 n-d-836830-18 devstack@n-api.service[112914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:40:02.225808 n-d-836830-18 devstack@n-api.service[112914]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:40:02.225808 n-d-836830-18 devstack@n-api.service[112914]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 14 08:40:02.225808 n-d-836830-18 devstack@n-api.service[112914]: ERROR nova.api.openstack.wsgi Sep 14 08:40:02.225808 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi [None req-714dc2ea-6b97-4858-9926-3e53780f1799 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=112914) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:40:02.226855 n-d-836830-18 devstack@n-api.service[112914]: INFO nova.api.openstack.requestlog [None req-714dc2ea-6b97-4858-9926-3e53780f1799 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011516 Sep 14 08:40:02.226855 n-d-836830-18 devstack@n-api.service[112914]: [pid: 112914|app: 0|req: 27/52] 10.222.0.60 () {60 vars in 1193 bytes} [Wed Sep 14 08:40:02 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 14 08:40:03.430317 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi [None req-f5eb3f84-9e83-457b-9db4-3eccd8cdb21b admin admin] Calling method '>' {{(pid=112915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:40:03.431544 n-d-836830-18 devstack@n-api.service[112915]: INFO nova.api.openstack.requestlog [None req-f5eb3f84-9e83-457b-9db4-3eccd8cdb21b admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001663 Sep 14 08:40:03.431936 n-d-836830-18 devstack@n-api.service[112915]: [pid: 112915|app: 0|req: 26/53] 10.222.0.60 () {56 vars in 1074 bytes} [Wed Sep 14 08:40:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:40:03.950588 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi [None req-904e374f-06e0-4e4b-8e23-c59b81a8bfe9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:40:03.970029 n-d-836830-18 devstack@n-api.service[112914]: INFO nova.api.openstack.requestlog [None req-904e374f-06e0-4e4b-8e23-c59b81a8bfe9 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.403190 Sep 14 08:40:03.970575 n-d-836830-18 devstack@n-api.service[112914]: [pid: 112914|app: 0|req: 28/54] 10.222.0.60 () {64 vars in 1235 bytes} [Wed Sep 14 08:40:03 2022] POST /compute/v2.1/flavors => generated 404 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 08:40:05.169442 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi [None req-f5eb3f84-9e83-457b-9db4-3eccd8cdb21b admin admin] Calling method '>' {{(pid=112915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:40:05.170867 n-d-836830-18 devstack@n-api.service[112915]: INFO nova.api.openstack.requestlog [None req-f5eb3f84-9e83-457b-9db4-3eccd8cdb21b admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001751 Sep 14 08:40:05.171482 n-d-836830-18 devstack@n-api.service[112915]: [pid: 112915|app: 0|req: 27/55] 10.222.0.60 () {56 vars in 1074 bytes} [Wed Sep 14 08:40:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:40:05.700008 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi [None req-a5597dcf-48b2-48ef-95a0-a6946b83597b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:40:05.718808 n-d-836830-18 devstack@n-api.service[112914]: INFO nova.api.openstack.requestlog [None req-a5597dcf-48b2-48ef-95a0-a6946b83597b admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.410075 Sep 14 08:40:05.719391 n-d-836830-18 devstack@n-api.service[112914]: [pid: 112914|app: 0|req: 29/56] 10.222.0.60 () {64 vars in 1235 bytes} [Wed Sep 14 08:40:05 2022] POST /compute/v2.1/flavors => generated 405 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 08:40:06.947262 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi [None req-f5eb3f84-9e83-457b-9db4-3eccd8cdb21b admin admin] Calling method '>' {{(pid=112915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:40:06.948268 n-d-836830-18 devstack@n-api.service[112915]: INFO nova.api.openstack.requestlog [None req-f5eb3f84-9e83-457b-9db4-3eccd8cdb21b admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Sep 14 08:40:06.948655 n-d-836830-18 devstack@n-api.service[112915]: [pid: 112915|app: 0|req: 28/57] 10.222.0.60 () {56 vars in 1074 bytes} [Wed Sep 14 08:40:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:40:07.475976 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi [None req-f94d0a9a-5bd9-485e-8427-70e1c6964965 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:40:07.495047 n-d-836830-18 devstack@n-api.service[112914]: INFO nova.api.openstack.requestlog [None req-f94d0a9a-5bd9-485e-8427-70e1c6964965 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.408804 Sep 14 08:40:07.495590 n-d-836830-18 devstack@n-api.service[112914]: [pid: 112914|app: 0|req: 30/58] 10.222.0.60 () {64 vars in 1235 bytes} [Wed Sep 14 08:40:07 2022] POST /compute/v2.1/flavors => generated 407 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 08:40:08.722032 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi [None req-f5eb3f84-9e83-457b-9db4-3eccd8cdb21b admin admin] Calling method '>' {{(pid=112915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:40:08.723124 n-d-836830-18 devstack@n-api.service[112915]: INFO nova.api.openstack.requestlog [None req-f5eb3f84-9e83-457b-9db4-3eccd8cdb21b admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001515 Sep 14 08:40:08.723518 n-d-836830-18 devstack@n-api.service[112915]: [pid: 112915|app: 0|req: 29/59] 10.222.0.60 () {56 vars in 1074 bytes} [Wed Sep 14 08:40:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:40:09.244355 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi [None req-89fb075b-1572-4a6d-bde3-05aa410e6204 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:40:09.262458 n-d-836830-18 devstack@n-api.service[112914]: INFO nova.api.openstack.requestlog [None req-89fb075b-1572-4a6d-bde3-05aa410e6204 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.400110 Sep 14 08:40:09.263125 n-d-836830-18 devstack@n-api.service[112914]: [pid: 112914|app: 0|req: 31/60] 10.222.0.60 () {64 vars in 1235 bytes} [Wed Sep 14 08:40:08 2022] POST /compute/v2.1/flavors => generated 409 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 08:40:10.469505 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi [None req-f5eb3f84-9e83-457b-9db4-3eccd8cdb21b admin admin] Calling method '>' {{(pid=112915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:40:10.470517 n-d-836830-18 devstack@n-api.service[112915]: INFO nova.api.openstack.requestlog [None req-f5eb3f84-9e83-457b-9db4-3eccd8cdb21b admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Sep 14 08:40:10.470910 n-d-836830-18 devstack@n-api.service[112915]: [pid: 112915|app: 0|req: 30/61] 10.222.0.60 () {56 vars in 1074 bytes} [Wed Sep 14 08:40:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:40:10.985664 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi [None req-33b709be-9669-4265-a6ca-05666944384d admin admin] Calling method '>' {{(pid=112914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:40:11.006401 n-d-836830-18 devstack@n-api.service[112914]: INFO nova.api.openstack.requestlog [None req-33b709be-9669-4265-a6ca-05666944384d admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.398899 Sep 14 08:40:11.006982 n-d-836830-18 devstack@n-api.service[112914]: [pid: 112914|app: 0|req: 32/62] 10.222.0.60 () {60 vars in 1202 bytes} [Wed Sep 14 08:40:10 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:41:08.057782 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi [None req-f5eb3f84-9e83-457b-9db4-3eccd8cdb21b admin admin] Calling method '>' {{(pid=112915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:41:08.058801 n-d-836830-18 devstack@n-api.service[112915]: INFO nova.api.openstack.requestlog [None req-f5eb3f84-9e83-457b-9db4-3eccd8cdb21b admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Sep 14 08:41:08.059269 n-d-836830-18 devstack@n-api.service[112915]: [pid: 112915|app: 0|req: 31/63] 10.222.0.60 () {54 vars in 931 bytes} [Wed Sep 14 08:41:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:41:08.070362 n-d-836830-18 devstack@n-api.service[112914]: DEBUG dbcounter [-] [112914] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=112914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:41:08.448748 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi [None req-87bf0e91-2964-4936-916a-79bffd03388a admin admin] Calling method '>' {{(pid=112914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:41:08.468736 n-d-836830-18 devstack@n-api.service[112914]: INFO nova.api.openstack.requestlog [None req-87bf0e91-2964-4936-916a-79bffd03388a admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.403366 Sep 14 08:41:08.469278 n-d-836830-18 devstack@n-api.service[112914]: [pid: 112914|app: 0|req: 33/64] 10.222.0.60 () {60 vars in 1292 bytes} [Wed Sep 14 08:41:08 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:41:08.489870 n-d-836830-18 devstack@n-api.service[112915]: DEBUG dbcounter [-] [112915] Writing DB stats nova_api:SELECT=14 {{(pid=112915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:41:08.494099 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi [None req-14603fb6-cc41-4201-8c8a-514ac8674b48 admin admin] Calling method '>' {{(pid=112915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:41:08.501432 n-d-836830-18 devstack@n-api.service[112915]: INFO nova.api.openstack.requestlog [None req-14603fb6-cc41-4201-8c8a-514ac8674b48 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013087 Sep 14 08:41:08.501944 n-d-836830-18 devstack@n-api.service[112915]: [pid: 112915|app: 0|req: 32/65] 10.222.0.60 () {60 vars in 1283 bytes} [Wed Sep 14 08:41:08 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:41:08.513926 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi [None req-94744c50-d6e8-40d1-b679-962825f9ec94 admin admin] Calling method '>' {{(pid=112914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:41:08.521130 n-d-836830-18 devstack@n-api.service[112914]: INFO nova.api.openstack.requestlog [None req-94744c50-d6e8-40d1-b679-962825f9ec94 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010744 Sep 14 08:41:08.521648 n-d-836830-18 devstack@n-api.service[112914]: [pid: 112914|app: 0|req: 34/66] 10.222.0.60 () {60 vars in 1286 bytes} [Wed Sep 14 08:41:08 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:41:08.533950 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi [None req-05af22cd-e4d4-4502-9802-87811fe4bbca admin admin] Calling method '>' {{(pid=112915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:41:08.541316 n-d-836830-18 devstack@n-api.service[112915]: INFO nova.api.openstack.requestlog [None req-05af22cd-e4d4-4502-9802-87811fe4bbca admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010965 Sep 14 08:41:08.541835 n-d-836830-18 devstack@n-api.service[112915]: [pid: 112915|app: 0|req: 33/67] 10.222.0.60 () {60 vars in 1286 bytes} [Wed Sep 14 08:41:08 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:41:08.553306 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi [None req-fbe16e8c-8595-46fc-9ce4-7ea1e69fae3e admin admin] Calling method '>' {{(pid=112914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:41:08.561655 n-d-836830-18 devstack@n-api.service[112914]: INFO nova.api.openstack.requestlog [None req-fbe16e8c-8595-46fc-9ce4-7ea1e69fae3e admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011983 Sep 14 08:41:08.562193 n-d-836830-18 devstack@n-api.service[112914]: [pid: 112914|app: 0|req: 35/68] 10.222.0.60 () {60 vars in 1283 bytes} [Wed Sep 14 08:41:08 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:46:35.641504 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi [None req-05af22cd-e4d4-4502-9802-87811fe4bbca admin admin] Calling method '>' {{(pid=112915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:46:35.642527 n-d-836830-18 devstack@n-api.service[112915]: INFO nova.api.openstack.requestlog [None req-05af22cd-e4d4-4502-9802-87811fe4bbca admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Sep 14 08:46:35.642930 n-d-836830-18 devstack@n-api.service[112915]: [pid: 112915|app: 0|req: 34/69] 10.222.0.60 () {56 vars in 1074 bytes} [Wed Sep 14 08:46:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:46:35.780505 n-d-836830-18 devstack@n-api.service[112914]: DEBUG dbcounter [-] [112914] Writing DB stats nova_api:SELECT=6 {{(pid=112914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:46:35.924639 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi [None req-93791954-f515-4c06-9bca-6c3f39447eb4 admin admin] Calling method '>' {{(pid=112914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:46:35.929378 n-d-836830-18 devstack@n-api.service[112914]: DEBUG oslo_concurrency.lockutils [None req-93791954-f515-4c06-9bca-6c3f39447eb4 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:46:35.929946 n-d-836830-18 devstack@n-api.service[112914]: DEBUG oslo_concurrency.lockutils [None req-93791954-f515-4c06-9bca-6c3f39447eb4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:46:35.930633 n-d-836830-18 devstack@n-api.service[112914]: DEBUG oslo_concurrency.lockutils [None req-93791954-f515-4c06-9bca-6c3f39447eb4 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:46:35.931382 n-d-836830-18 devstack@n-api.service[112914]: DEBUG oslo_concurrency.lockutils [None req-93791954-f515-4c06-9bca-6c3f39447eb4 admin admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:46:35.931832 n-d-836830-18 devstack@n-api.service[112914]: DEBUG oslo_concurrency.lockutils [None req-93791954-f515-4c06-9bca-6c3f39447eb4 admin admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:46:35.932247 n-d-836830-18 devstack@n-api.service[112914]: DEBUG oslo_concurrency.lockutils [None req-93791954-f515-4c06-9bca-6c3f39447eb4 admin admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:46:35.971258 n-d-836830-18 devstack@n-api.service[112914]: INFO nova.api.openstack.requestlog [None req-93791954-f515-4c06-9bca-6c3f39447eb4 admin admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.92 time: 0.191997 Sep 14 08:46:35.971815 n-d-836830-18 devstack@n-api.service[112914]: [pid: 112914|app: 0|req: 36/70] 10.222.0.60 () {60 vars in 1193 bytes} [Wed Sep 14 08:46:35 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:46:37.032933 n-d-836830-18 devstack@n-api.service[112915]: DEBUG nova.api.openstack.wsgi [None req-05af22cd-e4d4-4502-9802-87811fe4bbca admin admin] Calling method '>' {{(pid=112915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:46:37.033947 n-d-836830-18 devstack@n-api.service[112915]: INFO nova.api.openstack.requestlog [None req-05af22cd-e4d4-4502-9802-87811fe4bbca admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Sep 14 08:46:37.034345 n-d-836830-18 devstack@n-api.service[112915]: [pid: 112915|app: 0|req: 35/71] 10.222.0.60 () {56 vars in 1074 bytes} [Wed Sep 14 08:46:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:46:37.226631 n-d-836830-18 devstack@n-api.service[112914]: DEBUG nova.api.openstack.wsgi [None req-f999e7b0-d22e-4971-8329-4f5950074d46 admin admin] Calling method '>' {{(pid=112914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:46:37.230224 n-d-836830-18 devstack@n-api.service[112914]: DEBUG oslo_concurrency.lockutils [None req-f999e7b0-d22e-4971-8329-4f5950074d46 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:46:37.230703 n-d-836830-18 devstack@n-api.service[112914]: DEBUG oslo_concurrency.lockutils [None req-f999e7b0-d22e-4971-8329-4f5950074d46 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:46:37.231174 n-d-836830-18 devstack@n-api.service[112914]: DEBUG oslo_concurrency.lockutils [None req-f999e7b0-d22e-4971-8329-4f5950074d46 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:46:37.231893 n-d-836830-18 devstack@n-api.service[112914]: DEBUG oslo_concurrency.lockutils [None req-f999e7b0-d22e-4971-8329-4f5950074d46 admin admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:46:37.232343 n-d-836830-18 devstack@n-api.service[112914]: DEBUG oslo_concurrency.lockutils [None req-f999e7b0-d22e-4971-8329-4f5950074d46 admin admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:46:37.232764 n-d-836830-18 devstack@n-api.service[112914]: DEBUG oslo_concurrency.lockutils [None req-f999e7b0-d22e-4971-8329-4f5950074d46 admin admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:46:37.258560 n-d-836830-18 devstack@n-api.service[112914]: INFO nova.api.openstack.requestlog [None req-f999e7b0-d22e-4971-8329-4f5950074d46 admin admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.92 time: 0.085807 Sep 14 08:46:37.259354 n-d-836830-18 devstack@n-api.service[112914]: [pid: 112914|app: 0|req: 37/72] 10.222.0.60 () {60 vars in 1193 bytes} [Wed Sep 14 08:46:37 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:47:24.086403 n-d-836830-18 devstack@n-api.service[112913]: Wed Sep 14 08:47:24 2022 - graceful shutdown triggered... Sep 14 08:47:24.086185 n-d-836830-18 systemd[1]: Stopping Devstack devstack@n-api.service... Sep 14 08:47:24.087443 n-d-836830-18 devstack@n-api.service[112914]: Gracefully killing worker 1 (pid: 112914)... Sep 14 08:47:24.087808 n-d-836830-18 devstack@n-api.service[112915]: Gracefully killing worker 2 (pid: 112915)... Sep 14 08:47:24.213382 n-d-836830-18 devstack@n-api.service[112915]: DEBUG dbcounter [-] [112915] Writing DB stats nova_api:SELECT=4 {{(pid=112915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:47:25.087058 n-d-836830-18 devstack@n-api.service[112913]: worker 1 buried after 1 seconds Sep 14 08:47:25.087058 n-d-836830-18 devstack@n-api.service[112913]: worker 2 buried after 1 seconds Sep 14 08:47:25.087058 n-d-836830-18 devstack@n-api.service[112913]: goodbye to uWSGI. Sep 14 08:47:25.088649 n-d-836830-18 systemd[1]: devstack@n-api.service: Succeeded. Sep 14 08:47:25.089235 n-d-836830-18 systemd[1]: Stopped Devstack devstack@n-api.service. Sep 14 08:47:25.092098 n-d-836830-18 systemd[1]: Starting Devstack devstack@n-api.service... Sep 14 08:47:25.105329 n-d-836830-18 devstack@n-api.service[128747]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 14 08:47:25.121962 n-d-836830-18 devstack@n-api.service[128747]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Sep 14 08:47:25 2022] *** Sep 14 08:47:25.121962 n-d-836830-18 devstack@n-api.service[128747]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 14 08:47:25.121962 n-d-836830-18 devstack@n-api.service[128747]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 14 08:47:25.121962 n-d-836830-18 devstack@n-api.service[128747]: nodename: n-d-836830-18 Sep 14 08:47:25.121962 n-d-836830-18 devstack@n-api.service[128747]: machine: x86_64 Sep 14 08:47:25.121962 n-d-836830-18 devstack@n-api.service[128747]: clock source: unix Sep 14 08:47:25.121962 n-d-836830-18 devstack@n-api.service[128747]: pcre jit disabled Sep 14 08:47:25.121962 n-d-836830-18 devstack@n-api.service[128747]: detected number of CPU cores: 4 Sep 14 08:47:25.121962 n-d-836830-18 devstack@n-api.service[128747]: current working directory: / Sep 14 08:47:25.121962 n-d-836830-18 devstack@n-api.service[128747]: detected binary path: /usr/bin/uwsgi-core Sep 14 08:47:25.122766 n-d-836830-18 devstack@n-api.service[128747]: your processes number limit is 47680 Sep 14 08:47:25.122766 n-d-836830-18 devstack@n-api.service[128747]: your memory page size is 4096 bytes Sep 14 08:47:25.122766 n-d-836830-18 devstack@n-api.service[128747]: detected max file descriptor number: 2048 Sep 14 08:47:25.122766 n-d-836830-18 devstack@n-api.service[128747]: lock engine: pthread robust mutexes Sep 14 08:47:25.122766 n-d-836830-18 devstack@n-api.service[128747]: thunder lock: enabled Sep 14 08:47:25.122766 n-d-836830-18 devstack@n-api.service[128747]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 14 08:47:25.122766 n-d-836830-18 devstack@n-api.service[128747]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 14 08:47:25.162417 n-d-836830-18 devstack@n-api.service[128747]: Python main interpreter initialized at 0x55a81dc819c0 Sep 14 08:47:25.162417 n-d-836830-18 devstack@n-api.service[128747]: python threads support enabled Sep 14 08:47:25.162417 n-d-836830-18 devstack@n-api.service[128747]: your server socket listen backlog is limited to 100 connections Sep 14 08:47:25.162417 n-d-836830-18 devstack@n-api.service[128747]: your mercy for graceful operations on workers is 90 seconds Sep 14 08:47:25.162878 n-d-836830-18 devstack@n-api.service[128747]: mapped 403077 bytes (393 KB) for 2 cores Sep 14 08:47:25.162878 n-d-836830-18 devstack@n-api.service[128747]: *** Operational MODE: preforking *** Sep 14 08:47:25.163142 n-d-836830-18 devstack@n-api.service[128747]: *** uWSGI is running in multiple interpreter mode *** Sep 14 08:47:25.163142 n-d-836830-18 devstack@n-api.service[128747]: spawned uWSGI master process (pid: 128747) Sep 14 08:47:25.163354 n-d-836830-18 systemd[1]: Started Devstack devstack@n-api.service. Sep 14 08:47:25.163952 n-d-836830-18 devstack@n-api.service[128747]: spawned uWSGI worker 1 (pid: 128758, cores: 1) Sep 14 08:47:25.164486 n-d-836830-18 devstack@n-api.service[128747]: spawned uWSGI worker 2 (pid: 128759, cores: 1) Sep 14 08:47:25.164801 n-d-836830-18 devstack@n-api.service[128747]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 14 08:47:25.826230 n-d-836830-18 devstack@n-api.service[128758]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 14 08:47:25.829361 n-d-836830-18 devstack@n-api.service[128759]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 14 08:47:27.000073 n-d-836830-18 devstack@n-api.service[128759]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 14 08:47:27.000073 n-d-836830-18 devstack@n-api.service[128759]: from cryptography.utils import int_from_bytes Sep 14 08:47:27.000803 n-d-836830-18 devstack@n-api.service[128759]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 14 08:47:27.000803 n-d-836830-18 devstack@n-api.service[128759]: from cryptography.utils import int_from_bytes Sep 14 08:47:27.002094 n-d-836830-18 devstack@n-api.service[128758]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 14 08:47:27.002094 n-d-836830-18 devstack@n-api.service[128758]: from cryptography.utils import int_from_bytes Sep 14 08:47:27.002528 n-d-836830-18 devstack@n-api.service[128758]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 14 08:47:27.002528 n-d-836830-18 devstack@n-api.service[128758]: from cryptography.utils import int_from_bytes Sep 14 08:47:29.412569 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 14 08:47:29.413166 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 14 08:47:29.413375 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 14 08:47:29.413751 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 14 08:47:29.414008 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 14 08:47:29.414398 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.414727 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.415074 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.415557 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.415891 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.416209 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.416531 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.416854 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.417182 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.417445 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.417770 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.418093 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-836830-18 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.418419 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.418727 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.419062 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.419389 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.419694 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.420017 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.420324 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.420832 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.421287 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.422144 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.422508 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.422792 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.423137 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.423447 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.423773 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.424083 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.424412 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.424736 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.425137 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-836830-18 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.425449 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.425763 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.426077 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.426496 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.426809 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.427154 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.427477 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.427802 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.428114 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.428443 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.428764 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.429084 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.429404 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.429705 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.430261 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.430577 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.430898 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.431229 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.431537 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.431791 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.432102 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.432423 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.432747 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.433069 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.433321 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.433573 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.433893 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.434218 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.434528 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.434834 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.435166 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.435477 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.435785 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.436090 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.436397 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.436702 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.437020 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.437866 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.438222 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.438512 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.438833 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.439259 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.60 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.439512 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.60 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.439622 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 14 08:47:29.440038 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.440135 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 14 08:47:29.440237 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.440326 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 14 08:47:29.440458 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.440683 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 14 08:47:29.440787 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.440945 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 14 08:47:29.441075 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.441339 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.441443 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.441670 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.441782 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.441984 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.442091 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.442293 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.442435 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.442613 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.442762 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.442966 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.443111 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.443272 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.443440 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.443537 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.443768 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.443921 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.444086 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.444193 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.444358 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.444453 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.444680 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.444790 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.444991 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.445085 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-836830-18 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.445299 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.445406 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.445648 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.445765 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.445909 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.446014 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.446215 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.446311 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.446522 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.446662 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.446829 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.446932 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.447160 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.447265 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.447467 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.447674 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.447794 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.447991 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.448094 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.448305 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.448469 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.448619 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.448722 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.448953 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.449059 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.449269 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.449364 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.449576 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.449682 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.449886 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.449983 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.450196 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.450302 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.450506 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.450611 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.450819 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.450913 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.451152 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.451256 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-836830-18 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.451460 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.451565 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.451783 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.451886 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.452089 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.452185 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.452397 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.452558 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.452714 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.452901 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.453054 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.453214 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.453362 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.453540 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.453680 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.453868 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.454011 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.454180 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.454285 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.454511 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.454606 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.454835 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.454931 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.455186 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.455293 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.455490 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.455586 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.455797 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.455893 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.456101 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.456205 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.456406 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.456512 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.456708 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.456891 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.457012 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.457115 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.457311 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.457406 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.457547 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.457652 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.457863 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.457972 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.458188 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.458292 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.458513 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.458627 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.458826 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.458928 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.459111 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.459205 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.459368 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.459479 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.459694 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.459814 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.460019 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.460159 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.460335 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.460475 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.460656 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.460808 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.460959 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.461138 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.461272 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.461456 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.461584 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.461770 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.461896 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.462087 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.462192 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.462415 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.462518 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.462729 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.462835 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.463066 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.463166 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.463383 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.463525 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.463704 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.463806 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.464028 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.464131 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.464362 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.464473 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.60 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.464680 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.464789 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.60 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.464989 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.465091 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.465306 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.465408 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.465622 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.465734 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.465937 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.466039 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.466261 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.466358 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.466581 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.466690 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.466897 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.467026 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.467234 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.467336 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.467545 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.467699 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.467870 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.467974 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.468203 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.468305 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.468533 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.468687 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.468787 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.468882 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.469081 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.469176 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.469390 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.469486 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.469713 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.469816 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.470024 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.470127 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.470336 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.470432 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.470648 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.470744 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.470994 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.471094 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.471287 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.471392 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.471597 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.471692 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.471907 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.472010 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.472217 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.472311 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.472524 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.472624 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.472833 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.472945 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.473138 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.473241 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.473450 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.473556 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.473759 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.473876 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.474066 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.474206 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.474385 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.474488 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.474704 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.474821 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.475040 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.475150 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.475355 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.475449 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.475665 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.475770 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.475972 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.476078 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.476279 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.476375 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.476585 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.476694 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.476896 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.477067 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.477202 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.477308 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.477517 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.477618 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.477827 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.477930 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.478138 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.478249 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.478446 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.478548 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.478755 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.478861 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.479087 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.479202 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.479396 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.479500 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.479707 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.479803 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.480011 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.480106 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.480326 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.480430 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.480633 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.480728 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.480937 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.481040 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.481245 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.481347 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.481553 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.481649 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.481858 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.481953 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.482161 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.482262 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.482468 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.482564 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.482771 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.482874 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.483106 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.483218 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.483421 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.483531 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.483732 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.483826 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.484608 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.484747 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.484852 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.484959 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.485174 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 08:47:29.485270 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.485485 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.485580 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.485800 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.485913 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.486132 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.486227 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.486463 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.486567 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.486769 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.486875 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.487118 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.487226 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.487446 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.487542 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.487761 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.487865 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.488063 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.488161 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.488374 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.488480 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.488681 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.488790 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.488989 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.489095 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.489295 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.489390 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.489608 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.489704 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.489913 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.490008 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.490221 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.490333 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.490528 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.490624 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.490837 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.490954 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.491169 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.491278 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.491493 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.491596 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.491803 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.491908 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.492109 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.492213 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.492414 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.492510 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.492719 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.492823 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.493065 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.493176 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.493375 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.493470 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.493716 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.493817 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.494047 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.494153 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.494386 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.494498 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.494687 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.494790 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.495025 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.495124 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.495341 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.495436 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.495651 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.495752 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.495965 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.496062 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.496277 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.496374 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.496589 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.496684 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.496901 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.497003 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.497211 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.497312 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.497532 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.497628 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.497843 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.497938 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.498160 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.498298 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.498468 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.498574 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.498779 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.498880 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.499105 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.499202 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.499421 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.499532 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.500298 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.500455 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.500632 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.500738 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.500951 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.501057 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.501272 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.501377 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.501585 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.501681 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.501899 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.502003 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.502209 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.502303 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.502518 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.502611 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.502827 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.502923 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.503163 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.503267 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.503479 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.503581 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.503788 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.503885 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.506141 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.506297 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.506407 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.506498 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.506602 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.506698 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.506785 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.506879 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.507014 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.507114 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.507216 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.507367 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.507468 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.507564 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.507658 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.507745 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.507745 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.507919 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.507919 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.508076 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.508161 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.508299 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.508396 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.508491 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.508578 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.508665 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.508759 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.508859 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.508996 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.509132 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.509223 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.509322 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.509410 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.509512 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.509600 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.509696 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.509783 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.509876 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.509963 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.510059 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.510147 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.510233 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.510451 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.510554 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.510765 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.510863 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.511098 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.511197 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.511405 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.511509 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.511711 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.511808 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.512023 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.512119 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.512344 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.512448 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.512655 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.512760 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.512976 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.513079 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.513295 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.513462 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.513599 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.513696 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.513904 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.514008 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.514215 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.514323 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.514527 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.514622 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.514829 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.514923 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.515165 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.515327 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.515525 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.515629 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.515872 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.515969 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.516187 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.516292 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.516490 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.516594 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.516810 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.516920 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.517123 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.517226 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.517433 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.517525 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.517750 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.517851 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.518059 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.518162 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.518369 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.518473 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.518679 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.518773 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.519017 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.519117 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.519330 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.519441 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.519647 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.519742 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.519961 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.520056 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.520274 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.520370 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.520587 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.520681 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.520911 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.521006 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.521223 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.521326 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.521537 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.521643 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.521848 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.521950 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.522157 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.522254 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.522469 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.522574 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.522790 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.522891 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.523134 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.523459 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.523553 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.523777 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.523880 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.524095 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.524196 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.524409 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.524511 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.524734 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.524829 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.525043 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.525189 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.525363 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.525460 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.525688 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.525782 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.526004 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.526112 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.526314 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.526420 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.526625 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.526724 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.526976 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.527092 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.527261 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.527363 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.527576 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.527672 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.527883 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.527978 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.528190 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.528292 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.528498 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.528601 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.528811 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.528914 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.529116 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.529219 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.529421 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.529527 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.529725 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.529821 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.530029 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.530132 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.530344 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.530446 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.530651 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.530755 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.531003 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.531117 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.531310 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.531412 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.531635 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.531732 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.531946 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.532049 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.532253 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.532363 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.532560 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.532665 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.532868 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.532972 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.533185 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.533292 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.533501 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.533604 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.533820 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.533915 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.534130 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.534240 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.534442 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.534548 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.534759 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.534862 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.535094 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.535190 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.535409 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.535513 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.535714 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.535809 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.536020 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.536122 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.536321 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.536433 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.536631 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.536737 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.536938 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.537040 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.537238 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.537339 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.537551 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.537682 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.537861 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.537966 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.538172 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.538268 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.538483 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.538589 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.538790 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.538897 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.539124 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.539233 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.539429 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.539534 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.539744 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.539840 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.540053 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.540157 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.540360 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.540463 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.540661 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.540766 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.540967 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.541075 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.541274 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.541386 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.541578 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.541675 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.541890 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.541987 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.542196 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.542300 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.542513 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.542609 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.542817 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.542923 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.543130 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.543221 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.543437 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.543541 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.543747 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.543843 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.544061 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.544166 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.544365 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.544514 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.544688 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.544791 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.544998 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.545100 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.545304 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.545446 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.545608 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.545714 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.545919 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.546015 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.546223 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.546319 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.547043 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.547200 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.547365 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.547461 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.547690 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.547844 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.548000 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.548110 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.548304 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.548399 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.548615 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.548712 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.548921 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.549179 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.549284 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.549518 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.549625 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.549824 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.549932 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.550128 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.550232 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.550431 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.550528 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.550736 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.550846 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.551064 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.551165 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.551368 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.551472 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.551690 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.551795 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.551999 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.552103 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.552305 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.552402 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.552612 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.552708 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.552919 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.553052 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.553262 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.553395 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.553571 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.553701 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.553880 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.554010 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.554192 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.554317 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.554509 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.554642 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.554818 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.555746 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.555899 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.556025 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.556141 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.556270 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.556385 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.556508 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.556622 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.556744 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.556868 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.556990 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.557106 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.557229 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.557351 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.557472 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.557587 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.557708 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.557823 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.557946 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.558122 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.558246 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.558431 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.558563 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.558741 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.558871 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.559087 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.559212 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.559413 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.559546 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.559739 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.559863 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.560047 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.560172 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.560360 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.560464 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.560676 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.560773 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.560989 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.561131 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.561301 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.561397 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.561610 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.561705 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.561921 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.562025 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.562299 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.562887 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.563109 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.563214 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.563421 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.563555 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.563730 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.563837 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.564036 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.564129 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.564348 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.564442 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.564657 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.564759 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.564965 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.565062 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.565270 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.565372 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.565631 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.565863 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.565863 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.566035 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.566182 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.566278 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.566491 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.566597 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.566801 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.566897 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.567129 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.567216 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.567450 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.567571 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.567767 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.567888 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.568076 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.568203 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.568392 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.568513 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.568701 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.568827 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.569022 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.569148 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.569331 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.569461 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.569640 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.569779 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.569947 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.570086 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.570264 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.570507 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.570600 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.570823 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.570907 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.571162 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.571257 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.571477 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.571576 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.571785 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.571870 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.572090 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.572192 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.572824 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.572904 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.572978 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.573062 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.573149 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.573232 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.573306 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.573377 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.573594 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.573688 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.573912 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.574003 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.574220 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.574305 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.574535 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.574642 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.574846 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.574971 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.575182 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.575290 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.575491 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.575587 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.575817 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.575999 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.576098 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.576273 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.576401 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.576586 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.576749 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.576910 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.577072 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.577232 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.577374 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.577559 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.577702 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.577891 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.578041 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.578210 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.578353 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.578525 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.578662 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.578851 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.579006 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.579192 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.579333 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.579504 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.579645 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.579824 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.580008 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.580118 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.580322 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.580426 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.580647 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.580743 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.580971 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.581080 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.581291 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.581387 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.581611 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.581765 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.581930 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.582095 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.582243 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.582412 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.582563 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.582738 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.582882 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.583090 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.583227 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.583400 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.583535 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.583708 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.583845 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.584021 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.584172 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.584336 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.584489 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.584643 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.584806 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.584967 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.585132 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.585304 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.585458 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.585591 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.585786 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.585897 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.586097 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.586213 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.586409 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.586515 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.586725 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.586822 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.587063 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.587164 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.587388 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.587502 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.587703 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.587800 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.588020 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.588124 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.588339 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.588451 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.588656 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.588752 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.588962 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.589056 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.589274 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.589388 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.589584 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.589681 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.589888 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.589991 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.590195 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.590304 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.590501 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.590595 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.590831 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.590993 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.591162 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.591272 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.591471 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.591565 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.591786 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.591882 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.592097 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.592192 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.592412 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.592507 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.592720 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.592866 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.593060 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.593166 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.593383 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.593499 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.593719 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.593815 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.594041 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.594144 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.594380 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.594510 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.594688 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.594790 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.595021 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.595122 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.595338 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.595448 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.595647 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.595743 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.595951 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.596104 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.596295 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.596405 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.596555 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.596660 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.596859 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.596985 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.597162 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.597302 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.597468 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.597612 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.597791 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.597929 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.598094 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.598260 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.598414 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.598572 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.598721 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.598880 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.599040 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.599217 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.599345 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.599547 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.599642 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.599858 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.599969 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.600187 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.600283 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.600591 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.600685 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.600906 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.601082 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.601211 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.601307 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.601539 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.601641 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.601857 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.601968 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.602174 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.602278 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.602493 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.602589 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.602810 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.602983 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.603153 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.603265 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.603471 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.603567 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.603783 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.603888 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.604107 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.604214 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.604426 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.604522 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.604746 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.604850 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.605063 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.605292 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.605387 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.605624 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.605733 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.605941 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.606086 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.606331 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.606441 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.606568 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.606665 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.606884 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.607016 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.607225 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.607362 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.607540 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.607693 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.607852 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.608012 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.608165 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.608341 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.608477 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.608675 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.608808 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.608987 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.609644 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.609808 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.609973 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.610125 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.610308 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.610438 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.610627 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.610736 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.610968 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.611089 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.611282 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.611387 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.611597 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.611708 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.611956 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.612055 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.612272 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.612368 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.612581 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.612685 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.612896 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.613039 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.613211 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.613343 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.613518 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.613614 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.613828 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.613923 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.614138 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.614233 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.614454 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.614559 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.614773 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.614876 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.615104 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.615200 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.615426 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.615523 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.615737 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.615885 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.635670 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.635854 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.635854 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.636807 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.636907 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.637398 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.639089 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.639471 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.639850 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.640169 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.640537 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.641759 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.642020 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.642343 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.642788 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.642788 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.643898 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.644050 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.644188 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.644324 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.644486 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.644679 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.644958 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.645288 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.645592 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.645822 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.646224 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.646455 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.646684 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.647003 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.647179 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.647367 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.647542 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.647726 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.647896 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.648094 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.648262 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.648470 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.648648 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.648959 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.649123 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.649334 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.649500 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.649665 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.649809 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.649990 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.650143 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.650281 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.650425 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.650562 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.650698 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.650833 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.650833 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.650833 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.651532 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.651672 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.651932 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.652077 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.652214 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.652363 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.652598 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.652770 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.652908 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.653083 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.653268 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.653471 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.653725 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.654166 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.654340 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.654492 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.654664 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.654861 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.655065 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.655236 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.655377 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.655549 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.655703 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.655841 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.655976 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.656111 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.656292 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.656445 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.656584 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.656719 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.656885 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.657108 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.657252 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.657388 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.657525 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.657525 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.657782 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.657782 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.658050 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.658050 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.658304 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.658440 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.658585 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.658734 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.658896 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.659148 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.659285 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.659421 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.659421 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.659692 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.659829 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.659964 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.660100 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.660236 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.660380 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.660528 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.660666 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.660823 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.660972 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.661114 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.661259 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.661396 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.661533 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.661740 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.661885 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.662023 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.662169 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.662306 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.662455 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.662592 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.662729 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.662866 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.663054 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.663054 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.663317 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.663455 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.663606 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.663838 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.663838 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.663838 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.663838 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.664641 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.664781 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.664781 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.665070 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.665070 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.665343 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.665481 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.665618 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.665618 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.665888 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.666027 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.666176 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.666358 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.666358 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.666634 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.666773 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.666773 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.667058 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.667283 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.667441 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.667581 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.667718 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.667856 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.667994 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.668143 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.668143 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.668411 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.668548 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.668548 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.668825 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.668963 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.669202 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.669349 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.669681 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.669829 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.669916 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.669989 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.670070 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.670206 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.670335 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.670455 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.670572 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.670698 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.670833 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.670987 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.670987 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.671212 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.671329 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.671329 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.672069 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.672191 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.672308 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.672485 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.672610 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.672802 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.672923 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.672923 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.673142 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.673260 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.673260 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.673489 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.673606 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.673722 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.673853 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.673853 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.674166 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.674528 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.674651 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.674791 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.674913 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.675050 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.675184 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.675304 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.675422 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.675538 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.675654 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.675779 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.675897 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.676012 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.676128 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.676244 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.676359 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.676359 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.676638 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.676756 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.676872 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.676989 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.677106 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.677250 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.677449 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.677571 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.677696 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.677815 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.677930 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.678055 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.678172 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.678287 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.678401 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.678518 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.678633 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.678757 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.678874 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.679029 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.679150 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.679349 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.679485 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.679606 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.679722 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.679848 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.679967 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.680331 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.680449 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.680574 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.680693 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.680809 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.680925 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.681045 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.681170 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.681288 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.681404 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.681520 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.681637 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.681753 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.681877 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.681994 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.682110 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.682226 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.682341 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.682457 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.682582 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.682700 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.682816 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.682949 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.683069 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.683186 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.683186 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.683420 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.683537 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.683652 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.683769 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.683893 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.684010 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.684207 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.684327 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.684676 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.684800 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.684931 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.685050 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.685166 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.685282 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.685398 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.685514 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.685639 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.685757 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.685875 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.685992 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.686108 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.686224 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.686349 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.686553 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.686677 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.686795 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.686912 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.687084 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.687204 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.687878 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.688068 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.688068 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.688068 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.688068 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.688068 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.688604 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.688604 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.688821 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.688939 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.689067 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.689185 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.689302 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.689501 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.689623 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.689739 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.689869 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.689989 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.690107 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.690223 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.690339 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.690464 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.690583 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.690703 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.690822 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.690964 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.691085 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.691206 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.691343 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.691464 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.691464 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.691681 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.691681 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.691913 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.692032 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.692195 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.692346 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.692493 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.692640 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.692779 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.692916 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.693054 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.693192 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.693329 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.693475 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.693614 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.693751 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.693888 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.694036 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.694174 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.694541 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.695022 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.695185 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.695328 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.695477 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.695618 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.695805 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.695940 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.695940 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.696166 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.696294 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.696414 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.696653 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.696776 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.696895 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.697023 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.697023 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.697256 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.697376 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.697495 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.697613 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.697732 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.697860 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.698688 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.698811 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.698932 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.699064 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.699201 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.699324 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.699444 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.699653 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.699770 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.699889 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.700025 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.700146 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.700267 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.700386 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.700514 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.700514 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 14 08:47:29.700757 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.700757 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.700757 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.700757 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.700757 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.700757 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.700757 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.700757 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.701652 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.701652 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.701652 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.701652 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.701652 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.701652 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.701652 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.701652 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.702466 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.702466 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.702466 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.702466 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.702466 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.702466 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.702466 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.702466 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.703376 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.703376 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.703376 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.703376 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.703376 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.703376 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.703376 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.703376 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.704068 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.704068 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.704068 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.704068 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.704068 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.704068 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.704068 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.704068 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.705093 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.705093 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.705093 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.705093 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.705093 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.705093 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.705093 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.705093 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.706056 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.706056 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.706056 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.706056 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.706056 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.706056 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.706056 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.706056 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.706920 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.706920 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.706920 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.706920 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.706920 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.706920 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.706920 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.706920 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.708250 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.708250 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.708250 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.708250 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.708250 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.708250 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.708250 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.708250 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.708649 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.708710 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.709023 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.709500 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.709848 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.710105 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.710495 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.710796 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.711134 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.711476 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.711845 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.712047 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.712418 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.712611 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 08:47:29.712861 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 14 08:47:29.750685 n-d-836830-18 devstack@n-api.service[128759]: INFO dbcounter [None req-91975351-f73d-4592-839c-ac942b94f3c3 None None] Registered counter for database nova_api Sep 14 08:47:29.770875 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_db.sqlalchemy.engines [None req-91975351-f73d-4592-839c-ac942b94f3c3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128759) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 14 08:47:29.776611 n-d-836830-18 devstack@n-api.service[128758]: INFO dbcounter [None req-f24308f3-75d6-42d0-811e-2e33256e08ce None None] Registered counter for database nova_api Sep 14 08:47:29.777284 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writer thread running {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 14 08:47:29.798209 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_db.sqlalchemy.engines [None req-f24308f3-75d6-42d0-811e-2e33256e08ce None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128758) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 14 08:47:29.804734 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writer thread running {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 14 08:47:29.834124 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.context [None req-91975351-f73d-4592-839c-ac942b94f3c3 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0a35f87f-19b7-4b11-98e6-8bcd07b0466f(cell1) {{(pid=128759) load_cells /opt/stack/nova/nova/context.py:464}} Sep 14 08:47:29.838161 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-91975351-f73d-4592-839c-ac942b94f3c3 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:47:29.838636 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-91975351-f73d-4592-839c-ac942b94f3c3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:47:29.840243 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-91975351-f73d-4592-839c-ac942b94f3c3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:47:29.840978 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-91975351-f73d-4592-839c-ac942b94f3c3 None None] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:47:29.841417 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-91975351-f73d-4592-839c-ac942b94f3c3 None None] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:47:29.844051 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-91975351-f73d-4592-839c-ac942b94f3c3 None None] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:47:29.846045 n-d-836830-18 devstack@n-api.service[128759]: INFO dbcounter [None req-91975351-f73d-4592-839c-ac942b94f3c3 None None] Registered counter for database nova_cell0 Sep 14 08:47:29.850146 n-d-836830-18 devstack@n-api.service[128759]: INFO dbcounter [None req-91975351-f73d-4592-839c-ac942b94f3c3 None None] Registered counter for database nova_cell1 Sep 14 08:47:29.857633 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_db.sqlalchemy.engines [None req-91975351-f73d-4592-839c-ac942b94f3c3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128759) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 14 08:47:29.862128 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.context [None req-f24308f3-75d6-42d0-811e-2e33256e08ce None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0a35f87f-19b7-4b11-98e6-8bcd07b0466f(cell1) {{(pid=128758) load_cells /opt/stack/nova/nova/context.py:464}} Sep 14 08:47:29.863012 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writer thread running {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 14 08:47:29.863700 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_db.sqlalchemy.engines [None req-91975351-f73d-4592-839c-ac942b94f3c3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128759) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 14 08:47:29.866246 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f24308f3-75d6-42d0-811e-2e33256e08ce None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:47:29.866673 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f24308f3-75d6-42d0-811e-2e33256e08ce None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:47:29.868331 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f24308f3-75d6-42d0-811e-2e33256e08ce None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:47:29.869080 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f24308f3-75d6-42d0-811e-2e33256e08ce None None] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:47:29.869538 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f24308f3-75d6-42d0-811e-2e33256e08ce None None] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:47:29.871584 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f24308f3-75d6-42d0-811e-2e33256e08ce None None] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:47:29.873625 n-d-836830-18 devstack@n-api.service[128758]: INFO dbcounter [None req-f24308f3-75d6-42d0-811e-2e33256e08ce None None] Registered counter for database nova_cell0 Sep 14 08:47:29.877848 n-d-836830-18 devstack@n-api.service[128758]: INFO dbcounter [None req-f24308f3-75d6-42d0-811e-2e33256e08ce None None] Registered counter for database nova_cell1 Sep 14 08:47:29.885175 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_db.sqlalchemy.engines [None req-f24308f3-75d6-42d0-811e-2e33256e08ce None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128758) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 14 08:47:29.889413 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_db.sqlalchemy.engines [None req-f24308f3-75d6-42d0-811e-2e33256e08ce None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128758) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 14 08:47:29.891058 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writer thread running {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 14 08:47:30.013193 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writer thread running {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 14 08:47:30.022591 n-d-836830-18 devstack@n-api.service[128759]: INFO dbcounter [None req-91975351-f73d-4592-839c-ac942b94f3c3 None None] Registered counter for database nova_cell0 Sep 14 08:47:30.030371 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_db.sqlalchemy.engines [None req-91975351-f73d-4592-839c-ac942b94f3c3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128759) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 14 08:47:30.035344 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writer thread running {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 14 08:47:30.042590 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writer thread running {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 14 08:47:30.052669 n-d-836830-18 devstack@n-api.service[128758]: INFO dbcounter [None req-f24308f3-75d6-42d0-811e-2e33256e08ce None None] Registered counter for database nova_cell0 Sep 14 08:47:30.060812 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_db.sqlalchemy.engines [None req-f24308f3-75d6-42d0-811e-2e33256e08ce None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128758) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 14 08:47:30.065359 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writer thread running {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 14 08:47:30.361081 n-d-836830-18 devstack@n-api.service[128759]: WARNING keystonemiddleware.auth_token [None req-91975351-f73d-4592-839c-ac942b94f3c3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 14 08:47:30.369316 n-d-836830-18 devstack@n-api.service[128759]: WARNING keystonemiddleware.auth_token [None req-91975351-f73d-4592-839c-ac942b94f3c3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 14 08:47:30.392283 n-d-836830-18 devstack@n-api.service[128758]: WARNING keystonemiddleware.auth_token [None req-f24308f3-75d6-42d0-811e-2e33256e08ce None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 14 08:47:30.400645 n-d-836830-18 devstack@n-api.service[128758]: WARNING keystonemiddleware.auth_token [None req-f24308f3-75d6-42d0-811e-2e33256e08ce None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 14 08:47:30.723062 n-d-836830-18 devstack@n-api.service[128759]: WARNING keystonemiddleware.auth_token [None req-91975351-f73d-4592-839c-ac942b94f3c3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 14 08:47:30.730323 n-d-836830-18 devstack@n-api.service[128759]: WARNING keystonemiddleware.auth_token [None req-91975351-f73d-4592-839c-ac942b94f3c3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 14 08:47:30.735759 n-d-836830-18 devstack@n-api.service[128759]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55a81dc819c0 pid: 128759 (default app) Sep 14 08:47:30.763279 n-d-836830-18 devstack@n-api.service[128758]: WARNING keystonemiddleware.auth_token [None req-f24308f3-75d6-42d0-811e-2e33256e08ce None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 14 08:47:30.772030 n-d-836830-18 devstack@n-api.service[128758]: WARNING keystonemiddleware.auth_token [None req-f24308f3-75d6-42d0-811e-2e33256e08ce None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 14 08:47:30.777217 n-d-836830-18 devstack@n-api.service[128758]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55a81dc819c0 pid: 128758 (default app) Sep 14 08:48:11.684280 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=3 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:48:11.685135 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=3 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:48:11.686077 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=3 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:48:11.687548 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=3 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:48:11.735906 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=3 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:48:11.736904 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=3 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:48:11.738083 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=3 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:48:11.739025 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=3 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:48:12.770791 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-6cbfad0b-111e-4e81-9352-2638265ac217 tempest-AggregatesAdminNegativeTestJSON-1326539754 tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:12.775861 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6cbfad0b-111e-4e81-9352-2638265ac217 tempest-AggregatesAdminNegativeTestJSON-1326539754 tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:12.776337 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6cbfad0b-111e-4e81-9352-2638265ac217 tempest-AggregatesAdminNegativeTestJSON-1326539754 tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:12.776797 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6cbfad0b-111e-4e81-9352-2638265ac217 tempest-AggregatesAdminNegativeTestJSON-1326539754 tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:12.777558 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6cbfad0b-111e-4e81-9352-2638265ac217 tempest-AggregatesAdminNegativeTestJSON-1326539754 tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:12.778018 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6cbfad0b-111e-4e81-9352-2638265ac217 tempest-AggregatesAdminNegativeTestJSON-1326539754 tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:12.778451 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6cbfad0b-111e-4e81-9352-2638265ac217 tempest-AggregatesAdminNegativeTestJSON-1326539754 tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:12.822463 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-6cbfad0b-111e-4e81-9352-2638265ac217 tempest-AggregatesAdminNegativeTestJSON-1326539754 tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 1.149184 Sep 14 08:48:12.827270 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1/1] 10.222.0.60 () {58 vars in 1176 bytes} [Wed Sep 14 08:48:11 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:48:12.848582 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-90eb5dda-98b9-4158-b52a-c89887f78882 tempest-HostsAdminNegativeTestJSON-1935444004 tempest-HostsAdminNegativeTestJSON-1935444004-project-admin] Calling method '.version_select at 0x7f7d45ef6ee0>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:12.853196 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-90eb5dda-98b9-4158-b52a-c89887f78882 tempest-HostsAdminNegativeTestJSON-1935444004 tempest-HostsAdminNegativeTestJSON-1935444004-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:12.853689 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-90eb5dda-98b9-4158-b52a-c89887f78882 tempest-HostsAdminNegativeTestJSON-1935444004 tempest-HostsAdminNegativeTestJSON-1935444004-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:12.854136 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-90eb5dda-98b9-4158-b52a-c89887f78882 tempest-HostsAdminNegativeTestJSON-1935444004 tempest-HostsAdminNegativeTestJSON-1935444004-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:12.854903 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-90eb5dda-98b9-4158-b52a-c89887f78882 tempest-HostsAdminNegativeTestJSON-1935444004 tempest-HostsAdminNegativeTestJSON-1935444004-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:12.855331 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-90eb5dda-98b9-4158-b52a-c89887f78882 tempest-HostsAdminNegativeTestJSON-1935444004 tempest-HostsAdminNegativeTestJSON-1935444004-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:12.855759 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-90eb5dda-98b9-4158-b52a-c89887f78882 tempest-HostsAdminNegativeTestJSON-1935444004 tempest-HostsAdminNegativeTestJSON-1935444004-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:12.898436 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-90eb5dda-98b9-4158-b52a-c89887f78882 tempest-HostsAdminNegativeTestJSON-1935444004 tempest-HostsAdminNegativeTestJSON-1935444004-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 1.172959 Sep 14 08:48:12.899365 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1/2] 10.222.0.60 () {58 vars in 1128 bytes} [Wed Sep 14 08:48:11 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 08:48:13.072419 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ad795b4a-161d-426c-b599-d817d9002652 tempest-AZAdminNegativeTestJSON-1085555549 tempest-AZAdminNegativeTestJSON-1085555549-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:13.074252 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-ad795b4a-161d-426c-b599-d817d9002652 tempest-AZAdminNegativeTestJSON-1085555549 tempest-AZAdminNegativeTestJSON-1085555549-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': '729529d405644eb3874c20086f30359c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fb52f19d4aff93b9e9bc33d0353f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:48:13.078616 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ad795b4a-161d-426c-b599-d817d9002652 tempest-AZAdminNegativeTestJSON-1085555549 tempest-AZAdminNegativeTestJSON-1085555549-project] Request method failure captured: Sep 14 08:48:13.078616 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Sep 14 08:48:13.078616 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 08:48:13.078616 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 08:48:13.078616 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 08:48:13.078616 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 08:48:13.078616 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 08:48:13.078616 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 08:48:13.078616 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 08:48:13.078616 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 08:48:13.078616 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZVJLwomLrqG81Cf31Rz28umqhAZ7LLxRGQT--zyaOzQa-Xqxq95kNXILvvvFssL4bAxZUiNC9RY4SIqVLRYdd4kbLhbIzNvWVLbDY8l57zi2DunR3MxuNor8FHvSesJKE2WEHgD6_8mUNRMKI1O6KG0DrKB5hiLkcRN0pUBCbrMHCs Sep 14 08:48:13.078616 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 08:48:13.078616 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 08:48:13.078616 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 08:48:13.078616 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 08:48:13.078616 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 08:48:13.078616 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 08:48:13.078616 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 4168fb52f19d4aff93b9e9bc33d0353f Sep 14 08:48:13.078616 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-AZAdminNegativeTestJSON-1085555549 Sep 14 08:48:13.078616 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 08:48:13.078616 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 08:48:13.080072 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/4168fb52f19d4aff93b9e9bc33d0353f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_4168fb52f19d4aff93b9e9bc33d0353f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4168fb52f19d4aff93b9e9bc33d0353f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4168fb52f19d4aff93b9e9bc33d0353f"}]}] Sep 14 08:48:13.080072 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-AZAdminNegativeTestJSON-1085555549 Sep 14 08:48:13.080072 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 4168fb52f19d4aff93b9e9bc33d0353f Sep 14 08:48:13.080072 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-1085555549 Sep 14 08:48:13.080072 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-AZAdminNegativeTestJSON-1085555549-project Sep 14 08:48:13.080072 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 08:48:13.080072 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 08:48:13.080072 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 729529d405644eb3874c20086f30359c Sep 14 08:48:13.080072 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-AZAdminNegativeTestJSON-1085555549-project Sep 14 08:48:13.080072 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 08:48:13.080072 n-d-836830-18 devstack@n-api.service[128759]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Sep 14 08:48:13.080072 n-d-836830-18 devstack@n-api.service[128759]: action_args: {} Sep 14 08:48:13.080682 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:48:13.080682 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:13.080682 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:48:13.080682 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:48:13.080682 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:48:13.080682 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:48:13.080682 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:48:13.080682 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:48:13.080682 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Sep 14 08:48:13.080682 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Sep 14 08:48:13.080682 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 14 08:48:13.080682 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 14 08:48:13.080682 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 14 08:48:13.080682 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 14 08:48:13.080682 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 14 08:48:13.080682 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 14 08:48:13.080682 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 14 08:48:13.080682 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise self.value Sep 14 08:48:13.080682 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 14 08:48:13.081629 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 14 08:48:13.081629 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 14 08:48:13.081629 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 14 08:48:13.081629 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 14 08:48:13.081629 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 14 08:48:13.081629 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Sep 14 08:48:13.081629 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:48:13.081629 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:48:13.081629 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:48:13.081629 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:13.081629 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:48:13.081629 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:48:13.081629 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 14 08:48:13.081629 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 14 08:48:13.081629 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Sep 14 08:48:13.081629 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:48:13.081629 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ad795b4a-161d-426c-b599-d817d9002652 tempest-AZAdminNegativeTestJSON-1085555549 tempest-AZAdminNegativeTestJSON-1085555549-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:48:13.082541 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-ad795b4a-161d-426c-b599-d817d9002652 tempest-AZAdminNegativeTestJSON-1085555549 tempest-AZAdminNegativeTestJSON-1085555549-project] 10.222.0.60 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.255632 Sep 14 08:48:13.082541 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2/3] 10.222.0.60 () {58 vars in 1185 bytes} [Wed Sep 14 08:48:12 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 257 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 14 08:48:13.093190 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-840aca47-b800-4332-8672-e410b089046c tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] Calling method '.version_select at 0x7f7d45dc4ca0>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:13.105310 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-840aca47-b800-4332-8672-e410b089046c tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0a35f87f-19b7-4b11-98e6-8bcd07b0466f(cell1) {{(pid=128758) load_cells /opt/stack/nova/nova/compute/api.py:319}} Sep 14 08:48:13.107084 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-840aca47-b800-4332-8672-e410b089046c tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:13.107716 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-840aca47-b800-4332-8672-e410b089046c tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:13.108369 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-840aca47-b800-4332-8672-e410b089046c tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:13.134731 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-840aca47-b800-4332-8672-e410b089046c tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:13.135362 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-840aca47-b800-4332-8672-e410b089046c tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:13.135871 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-840aca47-b800-4332-8672-e410b089046c tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:13.148399 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-840aca47-b800-4332-8672-e410b089046c tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:13.148965 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-840aca47-b800-4332-8672-e410b089046c tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:13.149469 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-840aca47-b800-4332-8672-e410b089046c tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:13.156478 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-840aca47-b800-4332-8672-e410b089046c tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1507 microversion: 2.1 time: 0.256038 Sep 14 08:48:13.157223 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2/4] 10.222.0.60 () {58 vars in 1167 bytes} [Wed Sep 14 08:48:12 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1507 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:48:13.290589 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d009d5a1-9549-42b5-baa3-7f41b00da5cf tempest-FlavorsAdminTestJSON-1934103607 tempest-FlavorsAdminTestJSON-1934103607-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1639898853", "id": 739073415, "os-flavor-access:is_public": "True"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:48:13.343633 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d009d5a1-9549-42b5-baa3-7f41b00da5cf tempest-FlavorsAdminTestJSON-1934103607 tempest-FlavorsAdminTestJSON-1934103607-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.262027 Sep 14 08:48:13.344451 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3/5] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 08:48:13 2022] POST /compute/v2.1/flavors => generated 427 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:48:13.449630 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-5c9dd06b-7a6b-4e31-9ff9-454893e8ba3a tempest-HypervisorAdminTestJSON-885487048 tempest-HypervisorAdminTestJSON-885487048-project-admin] Calling method '.version_select at 0x7f7d45d5fa60>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:13.452214 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5c9dd06b-7a6b-4e31-9ff9-454893e8ba3a tempest-HypervisorAdminTestJSON-885487048 tempest-HypervisorAdminTestJSON-885487048-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:13.452699 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5c9dd06b-7a6b-4e31-9ff9-454893e8ba3a tempest-HypervisorAdminTestJSON-885487048 tempest-HypervisorAdminTestJSON-885487048-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:13.453287 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5c9dd06b-7a6b-4e31-9ff9-454893e8ba3a tempest-HypervisorAdminTestJSON-885487048 tempest-HypervisorAdminTestJSON-885487048-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:13.466709 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5c9dd06b-7a6b-4e31-9ff9-454893e8ba3a tempest-HypervisorAdminTestJSON-885487048 tempest-HypervisorAdminTestJSON-885487048-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:13.467261 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5c9dd06b-7a6b-4e31-9ff9-454893e8ba3a tempest-HypervisorAdminTestJSON-885487048 tempest-HypervisorAdminTestJSON-885487048-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:13.467697 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5c9dd06b-7a6b-4e31-9ff9-454893e8ba3a tempest-HypervisorAdminTestJSON-885487048 tempest-HypervisorAdminTestJSON-885487048-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:13.477677 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5c9dd06b-7a6b-4e31-9ff9-454893e8ba3a tempest-HypervisorAdminTestJSON-885487048 tempest-HypervisorAdminTestJSON-885487048-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:13.478159 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5c9dd06b-7a6b-4e31-9ff9-454893e8ba3a tempest-HypervisorAdminTestJSON-885487048 tempest-HypervisorAdminTestJSON-885487048-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:13.478802 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5c9dd06b-7a6b-4e31-9ff9-454893e8ba3a tempest-HypervisorAdminTestJSON-885487048 tempest-HypervisorAdminTestJSON-885487048-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:13.485561 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-5c9dd06b-7a6b-4e31-9ff9-454893e8ba3a tempest-HypervisorAdminTestJSON-885487048 tempest-HypervisorAdminTestJSON-885487048-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.327363 Sep 14 08:48:13.486293 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3/6] 10.222.0.60 () {58 vars in 1146 bytes} [Wed Sep 14 08:48:13 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:48:13.490769 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-2fea9123-0ef1-49d3-a42a-0b96a522f1cc tempest-AggregatesAdminNegativeTestJSON-1326539754 tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2022382003"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:48:13.511841 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.objects.aggregate [None req-2fea9123-0ef1-49d3-a42a-0b96a522f1cc tempest-AggregatesAdminNegativeTestJSON-1326539754 tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin] Generated uuid f7da6b9f-88d2-49a5-b0e7-be103b7d9db1 for aggregate {{(pid=128758) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 14 08:48:13.586140 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-2fea9123-0ef1-49d3-a42a-0b96a522f1cc tempest-AggregatesAdminNegativeTestJSON-1326539754 tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.098310 Sep 14 08:48:13.593835 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 4/7] 10.222.0.60 () {60 vars in 1164 bytes} [Wed Sep 14 08:48:13 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:48:13.658635 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-54bc42ef-47a9-4151-8b63-73431d9992ab tempest-FlavorsAccessNegativeTestJSON-1040633479 tempest-FlavorsAccessNegativeTestJSON-1040633479-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-19344168", "id": 1141095808, "os-flavor-access:is_public": "False"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:48:13.686683 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-54bc42ef-47a9-4151-8b63-73431d9992ab tempest-FlavorsAccessNegativeTestJSON-1040633479 tempest-FlavorsAccessNegativeTestJSON-1040633479-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.331991 Sep 14 08:48:13.691663 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4/8] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 08:48:13 2022] POST /compute/v2.1/flavors => generated 437 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:48:13.696371 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b7ac0a79-7b78-470a-9c67-27849078a6b1 tempest-FlavorsAdminTestJSON-1934103607 tempest-FlavorsAdminTestJSON-1934103607-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:13.724641 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b7ac0a79-7b78-470a-9c67-27849078a6b1 tempest-FlavorsAdminTestJSON-1934103607 tempest-FlavorsAdminTestJSON-1934103607-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/739073415" status: 202 len: 0 microversion: 2.1 time: 0.031577 Sep 14 08:48:13.725434 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 5/9] 10.222.0.60 () {58 vars in 1158 bytes} [Wed Sep 14 08:48:13 2022] DELETE /compute/v2.1/flavors/739073415 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 08:48:13.739341 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d88d763d-16c5-419b-8bf2-6ee1cdca2121 tempest-HypervisorAdminTestJSON-885487048 tempest-HypervisorAdminTestJSON-885487048-project-admin] Calling method '.version_select at 0x7f7d45d24a60>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:13.747318 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-d88d763d-16c5-419b-8bf2-6ee1cdca2121 tempest-HypervisorAdminTestJSON-885487048 tempest-HypervisorAdminTestJSON-885487048-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0a35f87f-19b7-4b11-98e6-8bcd07b0466f(cell1) {{(pid=128759) load_cells /opt/stack/nova/nova/compute/api.py:319}} Sep 14 08:48:13.748050 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d88d763d-16c5-419b-8bf2-6ee1cdca2121 tempest-HypervisorAdminTestJSON-885487048 tempest-HypervisorAdminTestJSON-885487048-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:13.749682 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d88d763d-16c5-419b-8bf2-6ee1cdca2121 tempest-HypervisorAdminTestJSON-885487048 tempest-HypervisorAdminTestJSON-885487048-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:13.750268 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d88d763d-16c5-419b-8bf2-6ee1cdca2121 tempest-HypervisorAdminTestJSON-885487048 tempest-HypervisorAdminTestJSON-885487048-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:13.776362 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d88d763d-16c5-419b-8bf2-6ee1cdca2121 tempest-HypervisorAdminTestJSON-885487048 tempest-HypervisorAdminTestJSON-885487048-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:13.777501 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d88d763d-16c5-419b-8bf2-6ee1cdca2121 tempest-HypervisorAdminTestJSON-885487048 tempest-HypervisorAdminTestJSON-885487048-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:13.778087 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d88d763d-16c5-419b-8bf2-6ee1cdca2121 tempest-HypervisorAdminTestJSON-885487048 tempest-HypervisorAdminTestJSON-885487048-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:13.785079 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-be226434-31eb-42b8-9f02-62c8756fabb1 tempest-HostsAdminNegativeTestJSON-584101034 tempest-HostsAdminNegativeTestJSON-584101034-project] Calling method '.version_select at 0x7f7d45d59e50>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:13.789504 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-be226434-31eb-42b8-9f02-62c8756fabb1 tempest-HostsAdminNegativeTestJSON-584101034 tempest-HostsAdminNegativeTestJSON-584101034-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': 'f4d55676982e474286eddfba7b72cdf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb1bd97167748e5a5b8ed848fd20cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:48:13.791677 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d88d763d-16c5-419b-8bf2-6ee1cdca2121 tempest-HypervisorAdminTestJSON-885487048 tempest-HypervisorAdminTestJSON-885487048-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:13.792223 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d88d763d-16c5-419b-8bf2-6ee1cdca2121 tempest-HypervisorAdminTestJSON-885487048 tempest-HypervisorAdminTestJSON-885487048-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:13.792662 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d88d763d-16c5-419b-8bf2-6ee1cdca2121 tempest-HypervisorAdminTestJSON-885487048 tempest-HypervisorAdminTestJSON-885487048-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:13.794299 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-be226434-31eb-42b8-9f02-62c8756fabb1 tempest-HostsAdminNegativeTestJSON-584101034 tempest-HostsAdminNegativeTestJSON-584101034-project] Request method failure captured: Sep 14 08:48:13.794299 n-d-836830-18 devstack@n-api.service[128758]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Sep 14 08:48:13.794299 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 08:48:13.794299 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 08:48:13.794299 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 08:48:13.794299 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 08:48:13.794299 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 08:48:13.794299 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 08:48:13.794299 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 08:48:13.794299 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 08:48:13.794299 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZVJ1LG2NDdsIMIeItseuzrfuU9SrphiW6jCv3ZArjcasIcAMEy2Wo9XKDJHyRl_1D5Waq_QCWIMElOUFegnQeH2cNZvANhthoYmO0dpeMr4zHeJP8JmipR6Xa20e3lC4NaRX_bgjReLP0z72dRLkuujBNVR7I1EpfqUmtgQEkWdKtk Sep 14 08:48:13.794299 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 08:48:13.794299 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 08:48:13.794299 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 08:48:13.794299 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 08:48:13.794299 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 08:48:13.794299 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 08:48:13.794299 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 6bb1bd97167748e5a5b8ed848fd20cc6 Sep 14 08:48:13.794299 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-584101034 Sep 14 08:48:13.794299 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 08:48:13.794299 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 08:48:13.796221 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6bb1bd97167748e5a5b8ed848fd20cc6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6bb1bd97167748e5a5b8ed848fd20cc6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6bb1bd97167748e5a5b8ed848fd20cc6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6bb1bd97167748e5a5b8ed848fd20cc6"}]}] Sep 14 08:48:13.796221 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-HostsAdminNegativeTestJSON-584101034 Sep 14 08:48:13.796221 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 6bb1bd97167748e5a5b8ed848fd20cc6 Sep 14 08:48:13.796221 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-584101034 Sep 14 08:48:13.796221 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-HostsAdminNegativeTestJSON-584101034-project Sep 14 08:48:13.796221 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 08:48:13.796221 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 08:48:13.796221 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: f4d55676982e474286eddfba7b72cdf5 Sep 14 08:48:13.796221 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-HostsAdminNegativeTestJSON-584101034-project Sep 14 08:48:13.796221 n-d-836830-18 devstack@n-api.service[128758]: method: Sep 14 08:48:13.796221 n-d-836830-18 devstack@n-api.service[128758]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Sep 14 08:48:13.796221 n-d-836830-18 devstack@n-api.service[128758]: action_args: {} Sep 14 08:48:13.796221 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:48:13.797263 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:13.797263 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:48:13.797263 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:48:13.797263 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:48:13.797263 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:48:13.797263 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 08:48:13.797263 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 08:48:13.797263 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 14 08:48:13.797263 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 08:48:13.797263 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:48:13.797263 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:48:13.797263 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Sep 14 08:48:13.797263 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Sep 14 08:48:13.797263 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 14 08:48:13.797263 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 14 08:48:13.797263 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 14 08:48:13.797263 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 14 08:48:13.797263 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 14 08:48:13.797263 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 14 08:48:13.798455 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 14 08:48:13.798455 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise self.value Sep 14 08:48:13.798455 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 14 08:48:13.798455 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 14 08:48:13.798455 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 14 08:48:13.798455 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 14 08:48:13.798455 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 14 08:48:13.798455 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 14 08:48:13.798455 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Sep 14 08:48:13.798455 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:13.798455 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:48:13.798455 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:13.798455 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:13.798455 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:48:13.798455 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:48:13.798455 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 14 08:48:13.798455 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 14 08:48:13.798455 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Sep 14 08:48:13.798455 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:13.800960 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-be226434-31eb-42b8-9f02-62c8756fabb1 tempest-HostsAdminNegativeTestJSON-584101034 tempest-HostsAdminNegativeTestJSON-584101034-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:48:13.802412 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-be226434-31eb-42b8-9f02-62c8756fabb1 tempest-HostsAdminNegativeTestJSON-584101034 tempest-HostsAdminNegativeTestJSON-584101034-project] 10.222.0.60 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.206930 Sep 14 08:48:13.803209 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 5/10] 10.222.0.60 () {58 vars in 1128 bytes} [Wed Sep 14 08:48:13 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 209 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 14 08:48:13.805320 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d88d763d-16c5-419b-8bf2-6ee1cdca2121 tempest-HypervisorAdminTestJSON-885487048 tempest-HypervisorAdminTestJSON-885487048-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1507 microversion: 2.1 time: 0.076760 Sep 14 08:48:13.808727 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-edb9f0e9-94ef-4eec-8e55-a8b272e64683 tempest-AggregatesAdminNegativeTestJSON-1326539754 tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-836830-18"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:48:13.811989 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 6/11] 10.222.0.60 () {58 vars in 1167 bytes} [Wed Sep 14 08:48:13 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1507 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:48:13.818097 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d0d51192-046d-449e-ae2e-7a0837f5ad58 tempest-FlavorsAccessNegativeTestJSON-1040633479 tempest-FlavorsAccessNegativeTestJSON-1040633479-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "31dc6190eea241a08561f32d6989370a"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:48:13.821011 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-edb9f0e9-94ef-4eec-8e55-a8b272e64683 tempest-AggregatesAdminNegativeTestJSON-1326539754 tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:13.821707 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-edb9f0e9-94ef-4eec-8e55-a8b272e64683 tempest-AggregatesAdminNegativeTestJSON-1326539754 tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:13.822155 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-edb9f0e9-94ef-4eec-8e55-a8b272e64683 tempest-AggregatesAdminNegativeTestJSON-1326539754 tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:14.149878 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d0d51192-046d-449e-ae2e-7a0837f5ad58 tempest-FlavorsAccessNegativeTestJSON-1040633479 tempest-FlavorsAccessNegativeTestJSON-1040633479-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors/1141095808/action" status: 200 len: 97 microversion: 2.1 time: 0.335461 Sep 14 08:48:14.150804 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 7/12] 10.222.0.60 () {60 vars in 1200 bytes} [Wed Sep 14 08:48:13 2022] POST /compute/v2.1/flavors/1141095808/action => generated 97 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 08:48:14.155433 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-522a8b24-7e8d-40b7-8205-146e4e17f151 tempest-FlavorsAdminTestJSON-1934103607 tempest-FlavorsAdminTestJSON-1934103607-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:14.187409 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-522a8b24-7e8d-40b7-8205-146e4e17f151 tempest-FlavorsAdminTestJSON-1934103607 tempest-FlavorsAdminTestJSON-1934103607-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.035325 Sep 14 08:48:14.188228 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 8/13] 10.222.0.60 () {58 vars in 1146 bytes} [Wed Sep 14 08:48:14 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:48:14.204773 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f88dfdde-5b3d-4790-97e7-05b94ec68319 tempest-HostsAdminNegativeTestJSON-584101034 tempest-HostsAdminNegativeTestJSON-584101034-project] Calling method '.version_select at 0x7f7d45cb2430>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:14.207582 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f88dfdde-5b3d-4790-97e7-05b94ec68319 tempest-HostsAdminNegativeTestJSON-584101034 tempest-HostsAdminNegativeTestJSON-584101034-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': 'f4d55676982e474286eddfba7b72cdf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb1bd97167748e5a5b8ed848fd20cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:48:14.210959 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f88dfdde-5b3d-4790-97e7-05b94ec68319 tempest-HostsAdminNegativeTestJSON-584101034 tempest-HostsAdminNegativeTestJSON-584101034-project] Request method failure captured: Sep 14 08:48:14.210959 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/os-hosts/n-d-836830-18/reboot HTTP/1.1 Sep 14 08:48:14.210959 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 08:48:14.210959 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 08:48:14.210959 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 08:48:14.210959 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 08:48:14.210959 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 08:48:14.210959 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 08:48:14.210959 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 08:48:14.210959 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 08:48:14.210959 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZVJ1LG2NDdsIMIeItseuzrfuU9SrphiW6jCv3ZArjcasIcAMEy2Wo9XKDJHyRl_1D5Waq_QCWIMElOUFegnQeH2cNZvANhthoYmO0dpeMr4zHeJP8JmipR6Xa20e3lC4NaRX_bgjReLP0z72dRLkuujBNVR7I1EpfqUmtgQEkWdKtk Sep 14 08:48:14.210959 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 08:48:14.210959 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 08:48:14.210959 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 08:48:14.210959 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 08:48:14.210959 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 08:48:14.210959 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 08:48:14.210959 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 6bb1bd97167748e5a5b8ed848fd20cc6 Sep 14 08:48:14.210959 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-584101034 Sep 14 08:48:14.210959 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 08:48:14.210959 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 08:48:14.212062 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6bb1bd97167748e5a5b8ed848fd20cc6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6bb1bd97167748e5a5b8ed848fd20cc6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6bb1bd97167748e5a5b8ed848fd20cc6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6bb1bd97167748e5a5b8ed848fd20cc6"}]}] Sep 14 08:48:14.212062 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-HostsAdminNegativeTestJSON-584101034 Sep 14 08:48:14.212062 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 6bb1bd97167748e5a5b8ed848fd20cc6 Sep 14 08:48:14.212062 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-584101034 Sep 14 08:48:14.212062 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-HostsAdminNegativeTestJSON-584101034-project Sep 14 08:48:14.212062 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 08:48:14.212062 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 08:48:14.212062 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: f4d55676982e474286eddfba7b72cdf5 Sep 14 08:48:14.212062 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-HostsAdminNegativeTestJSON-584101034-project Sep 14 08:48:14.212062 n-d-836830-18 devstack@n-api.service[128759]: method: Sep 14 08:48:14.212062 n-d-836830-18 devstack@n-api.service[128759]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Sep 14 08:48:14.212062 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': 'n-d-836830-18'} Sep 14 08:48:14.212062 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:48:14.212806 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:14.212806 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:48:14.212806 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:48:14.212806 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:48:14.212806 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:48:14.212806 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 08:48:14.212806 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 08:48:14.212806 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:48:14.212806 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:48:14.212806 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Sep 14 08:48:14.212806 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Sep 14 08:48:14.212806 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 14 08:48:14.212806 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 14 08:48:14.212806 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 14 08:48:14.212806 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 14 08:48:14.212806 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 14 08:48:14.212806 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 14 08:48:14.212806 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 14 08:48:14.212806 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise self.value Sep 14 08:48:14.213719 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 14 08:48:14.213719 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 14 08:48:14.213719 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 14 08:48:14.213719 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 14 08:48:14.213719 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 14 08:48:14.213719 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 14 08:48:14.213719 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Sep 14 08:48:14.213719 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:48:14.213719 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:48:14.213719 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:48:14.213719 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:14.213719 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:48:14.213719 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:48:14.213719 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 14 08:48:14.213719 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 14 08:48:14.213719 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Sep 14 08:48:14.213719 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:48:14.216361 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f88dfdde-5b3d-4790-97e7-05b94ec68319 tempest-HostsAdminNegativeTestJSON-584101034 tempest-HostsAdminNegativeTestJSON-584101034-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:48:14.217582 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f88dfdde-5b3d-4790-97e7-05b94ec68319 tempest-HostsAdminNegativeTestJSON-584101034 tempest-HostsAdminNegativeTestJSON-584101034-project] 10.222.0.60 "GET /compute/v2.1/os-hosts/n-d-836830-18/reboot" status: 403 len: 111 microversion: 2.1 time: 0.028312 Sep 14 08:48:14.218927 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 9/14] 10.222.0.60 () {58 vars in 1191 bytes} [Wed Sep 14 08:48:14 2022] GET /compute/v2.1/os-hosts/n-d-836830-18/reboot => generated 111 bytes in 30 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 14 08:48:14.223996 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-17967fae-1125-4780-8e73-cfc20c9ca9fe tempest-HypervisorAdminTestJSON-885487048 tempest-HypervisorAdminTestJSON-885487048-project-admin] Calling method '.version_select at 0x7f7d45d8da60>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:14.225954 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-17967fae-1125-4780-8e73-cfc20c9ca9fe tempest-HypervisorAdminTestJSON-885487048 tempest-HypervisorAdminTestJSON-885487048-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:14.226440 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-17967fae-1125-4780-8e73-cfc20c9ca9fe tempest-HypervisorAdminTestJSON-885487048 tempest-HypervisorAdminTestJSON-885487048-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:14.226867 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-17967fae-1125-4780-8e73-cfc20c9ca9fe tempest-HypervisorAdminTestJSON-885487048 tempest-HypervisorAdminTestJSON-885487048-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:14.241418 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-17967fae-1125-4780-8e73-cfc20c9ca9fe tempest-HypervisorAdminTestJSON-885487048 tempest-HypervisorAdminTestJSON-885487048-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:14.241899 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-17967fae-1125-4780-8e73-cfc20c9ca9fe tempest-HypervisorAdminTestJSON-885487048 tempest-HypervisorAdminTestJSON-885487048-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:14.242331 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-17967fae-1125-4780-8e73-cfc20c9ca9fe tempest-HypervisorAdminTestJSON-885487048 tempest-HypervisorAdminTestJSON-885487048-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:14.252963 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-17967fae-1125-4780-8e73-cfc20c9ca9fe tempest-HypervisorAdminTestJSON-885487048 tempest-HypervisorAdminTestJSON-885487048-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:14.253570 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-17967fae-1125-4780-8e73-cfc20c9ca9fe tempest-HypervisorAdminTestJSON-885487048 tempest-HypervisorAdminTestJSON-885487048-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:14.253883 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-17967fae-1125-4780-8e73-cfc20c9ca9fe tempest-HypervisorAdminTestJSON-885487048 tempest-HypervisorAdminTestJSON-885487048-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:14.260471 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-17967fae-1125-4780-8e73-cfc20c9ca9fe tempest-HypervisorAdminTestJSON-885487048 tempest-HypervisorAdminTestJSON-885487048-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.040199 Sep 14 08:48:14.261287 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 10/15] 10.222.0.60 () {58 vars in 1146 bytes} [Wed Sep 14 08:48:14 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:48:14.267804 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-4ae0b39c-973b-404d-b279-811213ca4988 tempest-FlavorsAccessNegativeTestJSON-1040633479 tempest-FlavorsAccessNegativeTestJSON-1040633479-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "31dc6190eea241a08561f32d6989370a"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:48:14.475576 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-edb9f0e9-94ef-4eec-8e55-a8b272e64683 tempest-AggregatesAdminNegativeTestJSON-1326539754 tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 243 microversion: 2.1 time: 0.670815 Sep 14 08:48:14.484199 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 6/16] 10.222.0.60 () {60 vars in 1191 bytes} [Wed Sep 14 08:48:13 2022] POST /compute/v2.1/os-aggregates/1/action => generated 243 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:48:14.489508 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-aa4829b7-74bd-496a-bd7b-a71fcf56266b tempest-FlavorsAdminTestJSON-1934103607 tempest-FlavorsAdminTestJSON-1934103607-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-967957857", "id": 276252808, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:48:14.526036 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-aa4829b7-74bd-496a-bd7b-a71fcf56266b tempest-FlavorsAdminTestJSON-1934103607 tempest-FlavorsAdminTestJSON-1934103607-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.040295 Sep 14 08:48:14.526644 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 7/17] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 08:48:14 2022] POST /compute/v2.1/flavors => generated 413 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:48:14.531099 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-6209d86e-a4da-4e94-b85a-420947dd73e1 tempest-HostsAdminNegativeTestJSON-1935444004 tempest-HostsAdminNegativeTestJSON-1935444004-project-admin] Calling method '.version_select at 0x7f7d45cfe160>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:14.544808 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-6209d86e-a4da-4e94-b85a-420947dd73e1 tempest-HostsAdminNegativeTestJSON-1935444004 tempest-HostsAdminNegativeTestJSON-1935444004-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Sep 14 08:48:14.550907 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-6209d86e-a4da-4e94-b85a-420947dd73e1 tempest-HostsAdminNegativeTestJSON-1935444004 tempest-HostsAdminNegativeTestJSON-1935444004-project-admin] Request method failure captured: Sep 14 08:48:14.550907 n-d-836830-18 devstack@n-api.service[128758]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Sep 14 08:48:14.550907 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 08:48:14.550907 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 08:48:14.550907 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 08:48:14.550907 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 08:48:14.550907 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 08:48:14.550907 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 08:48:14.550907 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 08:48:14.550907 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 08:48:14.550907 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZVLljBmIMa4Eww4xCZzWOvGk9e0hrPR1kvI-Lh-4gQsGto0ZQjgq1u4sIRhD__cihmqjiitES8cLTpNiyCTZ-klVMugmw0VSDR5C1fOrEntTxY7ZFOad_8MyKz5qc8uhSpX6WymDehyUATJsVMTf8DTmSfYjIZi1vZ1r30af7hwQyQ Sep 14 08:48:14.550907 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 08:48:14.550907 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 08:48:14.550907 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 08:48:14.550907 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 08:48:14.550907 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 08:48:14.550907 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 08:48:14.550907 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 1745b16e33f84d1c9e1808b0a1326d96 Sep 14 08:48:14.550907 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1935444004 Sep 14 08:48:14.550907 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member,admin Sep 14 08:48:14.550907 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member,admin Sep 14 08:48:14.552077 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/1745b16e33f84d1c9e1808b0a1326d96"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_1745b16e33f84d1c9e1808b0a1326d96"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1745b16e33f84d1c9e1808b0a1326d96"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1745b16e33f84d1c9e1808b0a1326d96"}]}] Sep 14 08:48:14.552077 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1935444004 Sep 14 08:48:14.552077 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 1745b16e33f84d1c9e1808b0a1326d96 Sep 14 08:48:14.552077 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1935444004 Sep 14 08:48:14.552077 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-HostsAdminNegativeTestJSON-1935444004-project-admin Sep 14 08:48:14.552077 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 08:48:14.552077 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 08:48:14.552077 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 82639c95eff344e5bca7b0db9d410166 Sep 14 08:48:14.552077 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1935444004-project-admin Sep 14 08:48:14.552077 n-d-836830-18 devstack@n-api.service[128758]: method: Sep 14 08:48:14.552077 n-d-836830-18 devstack@n-api.service[128758]: exception: Host 'nonexistent_hostname' is not mapped to any cell Sep 14 08:48:14.552077 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': 'nonexistent_hostname'} Sep 14 08:48:14.552077 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:48:14.552844 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:14.552844 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Sep 14 08:48:14.552844 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Sep 14 08:48:14.552844 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 14 08:48:14.552844 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 14 08:48:14.552844 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 14 08:48:14.552844 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 14 08:48:14.552844 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 14 08:48:14.552844 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise self.value Sep 14 08:48:14.552844 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 14 08:48:14.552844 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 14 08:48:14.552844 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Sep 14 08:48:14.552844 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Sep 14 08:48:14.552844 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 14 08:48:14.552844 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 14 08:48:14.552844 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 14 08:48:14.552844 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 14 08:48:14.552844 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 14 08:48:14.552844 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 14 08:48:14.553783 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 14 08:48:14.553783 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 14 08:48:14.553783 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 14 08:48:14.553783 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:14.553783 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:48:14.553783 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:14.553783 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:14.553783 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:48:14.553783 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:48:14.553783 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:48:14.553783 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:48:14.553783 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 08:48:14.553783 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 08:48:14.553783 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:48:14.553783 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:48:14.553783 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Sep 14 08:48:14.553783 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Sep 14 08:48:14.553783 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Sep 14 08:48:14.553783 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 14 08:48:14.554706 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 14 08:48:14.554706 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:14.554706 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:48:14.554706 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:14.554706 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:14.554706 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:48:14.554706 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:48:14.554706 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:48:14.554706 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:48:14.554706 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Sep 14 08:48:14.554706 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:14.554706 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-6209d86e-a4da-4e94-b85a-420947dd73e1 tempest-HostsAdminNegativeTestJSON-1935444004 tempest-HostsAdminNegativeTestJSON-1935444004-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:48:14.554706 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-6209d86e-a4da-4e94-b85a-420947dd73e1 tempest-HostsAdminNegativeTestJSON-1935444004 tempest-HostsAdminNegativeTestJSON-1935444004-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.024915 Sep 14 08:48:14.557928 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 8/18] 10.222.0.60 () {58 vars in 1212 bytes} [Wed Sep 14 08:48:14 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 14 08:48:14.565228 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-9b2d0246-ada0-42aa-bce9-e41a07b74658 tempest-HypervisorAdminTestJSON-885487048 tempest-HypervisorAdminTestJSON-885487048-project-admin] Calling method '.version_select at 0x7f7d45cf3ca0>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:14.567316 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9b2d0246-ada0-42aa-bce9-e41a07b74658 tempest-HypervisorAdminTestJSON-885487048 tempest-HypervisorAdminTestJSON-885487048-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:14.571895 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9b2d0246-ada0-42aa-bce9-e41a07b74658 tempest-HypervisorAdminTestJSON-885487048 tempest-HypervisorAdminTestJSON-885487048-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:14.572408 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9b2d0246-ada0-42aa-bce9-e41a07b74658 tempest-HypervisorAdminTestJSON-885487048 tempest-HypervisorAdminTestJSON-885487048-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:14.590271 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9b2d0246-ada0-42aa-bce9-e41a07b74658 tempest-HypervisorAdminTestJSON-885487048 tempest-HypervisorAdminTestJSON-885487048-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:14.590767 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9b2d0246-ada0-42aa-bce9-e41a07b74658 tempest-HypervisorAdminTestJSON-885487048 tempest-HypervisorAdminTestJSON-885487048-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:14.591320 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9b2d0246-ada0-42aa-bce9-e41a07b74658 tempest-HypervisorAdminTestJSON-885487048 tempest-HypervisorAdminTestJSON-885487048-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:14.598520 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-9b2d0246-ada0-42aa-bce9-e41a07b74658 tempest-HypervisorAdminTestJSON-885487048 tempest-HypervisorAdminTestJSON-885487048-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 759 microversion: 2.1 time: 0.039515 Sep 14 08:48:14.599151 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 9/19] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Sep 14 08:48:14 2022] GET /compute/v2.1/os-hypervisors/1 => generated 759 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:48:14.652206 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-4ae0b39c-973b-404d-b279-811213ca4988 tempest-FlavorsAccessNegativeTestJSON-1040633479 tempest-FlavorsAccessNegativeTestJSON-1040633479-project-admin] HTTP exception thrown: Flavor access already exists for flavor 16 and project 31dc6190eea241a08561f32d6989370a combination. Sep 14 08:48:14.665480 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-4ae0b39c-973b-404d-b279-811213ca4988 tempest-FlavorsAccessNegativeTestJSON-1040633479 tempest-FlavorsAccessNegativeTestJSON-1040633479-project-admin] Request method failure captured: Sep 14 08:48:14.665480 n-d-836830-18 devstack@n-api.service[128759]: request: POST /compute/v2.1/flavors/1141095808/action HTTP/1.1 Sep 14 08:48:14.665480 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 08:48:14.665480 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 08:48:14.665480 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 08:48:14.665480 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 67 Sep 14 08:48:14.665480 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 08:48:14.665480 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 08:48:14.665480 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 08:48:14.665480 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 08:48:14.665480 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZVKJSjyzZGCJzjQRHZ-EUrDD7WgAPnGvswjBafnVQ4h7JSbfb9grJSyQlLqMEDjsnfwCvFjAT63xncqb7xWI9hW9N24x5jvHJ7DoIbjudemZDLyrpsoYD5x87jmuEfBIUhg7wuyjt39GOBnMJHmo2entNXbBjFuc6BUyN2NhXbAVtA Sep 14 08:48:14.665480 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 08:48:14.665480 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 08:48:14.665480 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 08:48:14.665480 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 08:48:14.665480 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 08:48:14.665480 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 08:48:14.665480 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 63a0319d101b4b63bb7f2c8d33f4dcfa Sep 14 08:48:14.665480 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1040633479 Sep 14 08:48:14.665480 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member,admin Sep 14 08:48:14.665480 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member,admin Sep 14 08:48:14.666725 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/63a0319d101b4b63bb7f2c8d33f4dcfa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_63a0319d101b4b63bb7f2c8d33f4dcfa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/63a0319d101b4b63bb7f2c8d33f4dcfa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/63a0319d101b4b63bb7f2c8d33f4dcfa"}]}] Sep 14 08:48:14.666725 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1040633479 Sep 14 08:48:14.666725 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 63a0319d101b4b63bb7f2c8d33f4dcfa Sep 14 08:48:14.666725 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1040633479 Sep 14 08:48:14.666725 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-FlavorsAccessNegativeTestJSON-1040633479-project-admin Sep 14 08:48:14.666725 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 08:48:14.666725 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 08:48:14.666725 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 681b897863214207b167ab006909a66a Sep 14 08:48:14.666725 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1040633479-project-admin Sep 14 08:48:14.666725 n-d-836830-18 devstack@n-api.service[128759]: Sep 14 08:48:14.666725 n-d-836830-18 devstack@n-api.service[128759]: {"addTenantAccess": {"tenant": "31dc6190eea241a08561f32d6989370a"}} Sep 14 08:48:14.666725 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 08:48:14.667551 n-d-836830-18 devstack@n-api.service[128759]: exception: Flavor access already exists for flavor 16 and project 31dc6190eea241a08561f32d6989370a combination. Sep 14 08:48:14.667551 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '1141095808', 'body': {'addTenantAccess': {'tenant': '31dc6190eea241a08561f32d6989370a'}}} Sep 14 08:48:14.667551 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:48:14.667551 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:14.667551 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 14 08:48:14.667551 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 14 08:48:14.667551 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 14 08:48:14.667551 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 14 08:48:14.667551 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 14 08:48:14.667551 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 14 08:48:14.667551 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 14 08:48:14.667551 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 14 08:48:14.667551 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 14 08:48:14.667551 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 14 08:48:14.667551 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 14 08:48:14.667551 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi result.read() Sep 14 08:48:14.667551 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 14 08:48:14.667551 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 14 08:48:14.668660 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 14 08:48:14.668660 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 14 08:48:14.668660 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 14 08:48:14.668660 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 14 08:48:14.668660 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 14 08:48:14.668660 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 14 08:48:14.668660 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '16-31dc6190eea241a08561f32d6989370a' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Sep 14 08:48:14.668660 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:48:14.668660 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 14 08:48:14.668660 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:48:14.668660 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:14.668660 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Sep 14 08:48:14.668660 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi project.save(context.session) Sep 14 08:48:14.668660 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Sep 14 08:48:14.668660 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi session.flush() Sep 14 08:48:14.668660 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 14 08:48:14.668660 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self._flush(objects) Sep 14 08:48:14.668660 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 14 08:48:14.668660 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Sep 14 08:48:14.669631 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 14 08:48:14.669631 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi compat.raise_( Sep 14 08:48:14.669631 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 14 08:48:14.669631 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception Sep 14 08:48:14.669631 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 14 08:48:14.669631 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi flush_context.execute() Sep 14 08:48:14.669631 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 14 08:48:14.669631 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi rec.execute(self) Sep 14 08:48:14.669631 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 14 08:48:14.669631 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Sep 14 08:48:14.669631 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 14 08:48:14.669631 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Sep 14 08:48:14.669631 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 14 08:48:14.669631 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Sep 14 08:48:14.669631 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 14 08:48:14.669631 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Sep 14 08:48:14.669631 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 14 08:48:14.669631 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Sep 14 08:48:14.671194 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 14 08:48:14.671194 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Sep 14 08:48:14.671194 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 14 08:48:14.671194 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Sep 14 08:48:14.671194 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 14 08:48:14.671194 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 14 08:48:14.671194 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 14 08:48:14.671194 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception Sep 14 08:48:14.671194 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 14 08:48:14.671194 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 14 08:48:14.671194 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 14 08:48:14.671194 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 14 08:48:14.671194 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 14 08:48:14.671194 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 14 08:48:14.671194 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 14 08:48:14.671194 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 14 08:48:14.671194 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 14 08:48:14.671194 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 14 08:48:14.672101 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 14 08:48:14.672101 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi result.read() Sep 14 08:48:14.672101 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 14 08:48:14.672101 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 14 08:48:14.672101 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 14 08:48:14.672101 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 14 08:48:14.672101 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 14 08:48:14.672101 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 14 08:48:14.672101 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 14 08:48:14.672101 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 14 08:48:14.672101 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '16-31dc6190eea241a08561f32d6989370a' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Sep 14 08:48:14.672101 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Sep 14 08:48:14.672101 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 9, 14, 8, 48, 14, 645966), 'updated_at': None, 'flavor_id': 16, 'project_id': '31dc6190eea241a08561f32d6989370a'}] Sep 14 08:48:14.672101 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 14 08:48:14.672101 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:48:14.672101 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:48:14.672101 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:48:14.673248 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:14.673248 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Sep 14 08:48:14.673248 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Sep 14 08:48:14.673248 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 14 08:48:14.673248 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 14 08:48:14.673248 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Sep 14 08:48:14.673248 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Sep 14 08:48:14.673248 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Sep 14 08:48:14.673248 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Sep 14 08:48:14.673248 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Sep 14 08:48:14.673248 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Sep 14 08:48:14.673248 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 14 08:48:14.673248 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 14 08:48:14.673248 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Sep 14 08:48:14.673248 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Sep 14 08:48:14.673248 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 16 and project 31dc6190eea241a08561f32d6989370a combination. Sep 14 08:48:14.673248 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:48:14.673248 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:48:14.673248 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:48:14.683061 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:14.683061 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:48:14.683061 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:48:14.683061 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:48:14.683061 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:48:14.683061 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:48:14.683061 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:48:14.683061 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 08:48:14.683061 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 08:48:14.683061 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Sep 14 08:48:14.683061 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Sep 14 08:48:14.683061 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 16 and project 31dc6190eea241a08561f32d6989370a combination. Sep 14 08:48:14.683061 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:48:14.683061 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:48:14.683061 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:48:14.683061 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:14.683061 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:48:14.683061 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:48:14.683061 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:48:14.683061 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:48:14.685186 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 16 and project 31dc6190eea241a08561f32d6989370a combination. Sep 14 08:48:14.685186 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:48:14.685186 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-4ae0b39c-973b-404d-b279-811213ca4988 tempest-FlavorsAccessNegativeTestJSON-1040633479 tempest-FlavorsAccessNegativeTestJSON-1040633479-project-admin] Returning 409 to user: Flavor access already exists for flavor 16 and project 31dc6190eea241a08561f32d6989370a combination. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:48:14.685186 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-4ae0b39c-973b-404d-b279-811213ca4988 tempest-FlavorsAccessNegativeTestJSON-1040633479 tempest-FlavorsAccessNegativeTestJSON-1040633479-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors/1141095808/action" status: 409 len: 152 microversion: 2.1 time: 0.415100 Sep 14 08:48:14.685186 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 11/20] 10.222.0.60 () {60 vars in 1200 bytes} [Wed Sep 14 08:48:14 2022] POST /compute/v2.1/flavors/1141095808/action => generated 152 bytes in 416 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 14 08:48:14.693734 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-db22b886-f676-48bc-ac7e-3e3fa0f4000b tempest-AggregatesAdminNegativeTestJSON-1326539754 tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-836830-18"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:48:14.728705 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-db22b886-f676-48bc-ac7e-3e3fa0f4000b tempest-AggregatesAdminNegativeTestJSON-1326539754 tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:14.729202 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-db22b886-f676-48bc-ac7e-3e3fa0f4000b tempest-AggregatesAdminNegativeTestJSON-1326539754 tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:14.729637 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-db22b886-f676-48bc-ac7e-3e3fa0f4000b tempest-AggregatesAdminNegativeTestJSON-1326539754 tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:14.767329 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-db22b886-f676-48bc-ac7e-3e3fa0f4000b tempest-AggregatesAdminNegativeTestJSON-1326539754 tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin] HTTP exception thrown: Aggregate 1 already has host n-h2-836830-18. Sep 14 08:48:14.773360 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-db22b886-f676-48bc-ac7e-3e3fa0f4000b tempest-AggregatesAdminNegativeTestJSON-1326539754 tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin] Request method failure captured: Sep 14 08:48:14.773360 n-d-836830-18 devstack@n-api.service[128759]: request: POST /compute/v2.1/os-aggregates/1/action HTTP/1.1 Sep 14 08:48:14.773360 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 08:48:14.773360 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 08:48:14.773360 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 08:48:14.773360 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 40 Sep 14 08:48:14.773360 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 08:48:14.773360 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 08:48:14.773360 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 08:48:14.773360 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 08:48:14.773360 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZVLmJ15KWpFzwjBk89mbkB4PfDNCzydgt68AeYqIMFil0sHzz7mUG2-TKeV_gXm_nnH_yPYhyWGcM4Cw8PvI6ZS_hRqRPaEAvLYHlgIjjWnxMMEh7qOnYV_USVH61vMihtYmSwUuF5ovmHMApqYsssL_HzfV3qjmWGd4yKm2NPPigs Sep 14 08:48:14.773360 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 08:48:14.773360 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 08:48:14.773360 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 08:48:14.773360 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 08:48:14.773360 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 08:48:14.773360 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 08:48:14.773360 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: eb497d14a0394c9486c4682b72a08767 Sep 14 08:48:14.773360 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1326539754 Sep 14 08:48:14.773360 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member,admin Sep 14 08:48:14.773360 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member,admin Sep 14 08:48:14.774588 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/eb497d14a0394c9486c4682b72a08767"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_eb497d14a0394c9486c4682b72a08767"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/eb497d14a0394c9486c4682b72a08767"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/eb497d14a0394c9486c4682b72a08767"}]}] Sep 14 08:48:14.774588 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1326539754 Sep 14 08:48:14.774588 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: eb497d14a0394c9486c4682b72a08767 Sep 14 08:48:14.774588 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1326539754 Sep 14 08:48:14.774588 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin Sep 14 08:48:14.774588 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 08:48:14.774588 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 08:48:14.774588 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 4452ad4c9bf2454f833c2a552ab32b8c Sep 14 08:48:14.774588 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin Sep 14 08:48:14.774588 n-d-836830-18 devstack@n-api.service[128759]: Sep 14 08:48:14.774588 n-d-836830-18 devstack@n-api.service[128759]: {"add_host": {"host": "n-h2-836830-18"}} Sep 14 08:48:14.774588 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 08:48:14.774588 n-d-836830-18 devstack@n-api.service[128759]: exception: Aggregate 1 already has host n-h2-836830-18. Sep 14 08:48:14.775416 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '1', 'body': {'add_host': {'host': 'n-h2-836830-18'}}} Sep 14 08:48:14.775416 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:48:14.775416 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:14.775416 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 14 08:48:14.775416 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 14 08:48:14.775416 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 14 08:48:14.775416 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 14 08:48:14.775416 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 14 08:48:14.775416 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 14 08:48:14.775416 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 14 08:48:14.775416 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 14 08:48:14.775416 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 14 08:48:14.775416 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 14 08:48:14.775416 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 14 08:48:14.775416 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi result.read() Sep 14 08:48:14.775416 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 14 08:48:14.775416 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 14 08:48:14.775416 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 14 08:48:14.775416 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 14 08:48:14.777234 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 14 08:48:14.777234 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 14 08:48:14.777234 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 14 08:48:14.777234 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 14 08:48:14.777234 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h2-836830-18-1' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Sep 14 08:48:14.777234 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:48:14.777234 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 14 08:48:14.777234 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:48:14.777234 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:14.777234 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Sep 14 08:48:14.777234 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Sep 14 08:48:14.777234 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Sep 14 08:48:14.777234 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi session.flush() Sep 14 08:48:14.777234 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 14 08:48:14.777234 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self._flush(objects) Sep 14 08:48:14.777234 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 14 08:48:14.777234 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Sep 14 08:48:14.777234 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 14 08:48:14.777234 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi compat.raise_( Sep 14 08:48:14.778902 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 14 08:48:14.778902 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception Sep 14 08:48:14.778902 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 14 08:48:14.778902 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi flush_context.execute() Sep 14 08:48:14.778902 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 14 08:48:14.778902 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi rec.execute(self) Sep 14 08:48:14.778902 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 14 08:48:14.778902 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Sep 14 08:48:14.778902 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 14 08:48:14.778902 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Sep 14 08:48:14.778902 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 14 08:48:14.778902 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Sep 14 08:48:14.778902 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 14 08:48:14.778902 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Sep 14 08:48:14.778902 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 14 08:48:14.778902 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Sep 14 08:48:14.778902 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 14 08:48:14.778902 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Sep 14 08:48:14.782584 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 14 08:48:14.782584 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Sep 14 08:48:14.782584 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 14 08:48:14.782584 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 14 08:48:14.782584 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 14 08:48:14.782584 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception Sep 14 08:48:14.782584 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 14 08:48:14.782584 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 14 08:48:14.782584 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 14 08:48:14.782584 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 14 08:48:14.782584 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 14 08:48:14.782584 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 14 08:48:14.782584 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 14 08:48:14.782584 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 14 08:48:14.782584 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 14 08:48:14.782584 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 14 08:48:14.782584 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 14 08:48:14.782584 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi result.read() Sep 14 08:48:14.784484 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 14 08:48:14.784484 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 14 08:48:14.784484 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 14 08:48:14.784484 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 14 08:48:14.784484 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 14 08:48:14.784484 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 14 08:48:14.784484 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 14 08:48:14.784484 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 14 08:48:14.784484 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h2-836830-18-1' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Sep 14 08:48:14.784484 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Sep 14 08:48:14.784484 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 9, 14, 8, 48, 14, 758327), 'updated_at': None, 'host': 'n-h2-836830-18', 'aggregate_id': 1}] Sep 14 08:48:14.784484 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 14 08:48:14.784484 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:48:14.784484 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:48:14.784484 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:48:14.784484 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:14.784484 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Sep 14 08:48:14.787065 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Sep 14 08:48:14.787065 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 14 08:48:14.787065 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 14 08:48:14.787065 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 14 08:48:14.787065 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 14 08:48:14.787065 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 14 08:48:14.787065 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise self.value Sep 14 08:48:14.787065 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 14 08:48:14.787065 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 14 08:48:14.787065 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6641, in add_host_to_aggregate Sep 14 08:48:14.787065 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Sep 14 08:48:14.787065 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 14 08:48:14.787065 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 14 08:48:14.787065 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Sep 14 08:48:14.787065 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Sep 14 08:48:14.787065 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Sep 14 08:48:14.787065 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Sep 14 08:48:14.787065 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 1 already has host n-h2-836830-18. Sep 14 08:48:14.787065 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:48:14.787065 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:48:14.790034 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:48:14.790034 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:14.790034 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:48:14.790034 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:48:14.790034 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:48:14.790034 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:48:14.790034 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:48:14.790034 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:48:14.790034 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 08:48:14.790034 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 08:48:14.790034 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Sep 14 08:48:14.790034 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Sep 14 08:48:14.790034 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 1 already has host n-h2-836830-18. Sep 14 08:48:14.790034 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:48:14.790034 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:48:14.790034 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:48:14.790034 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:14.790034 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:48:14.790034 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:48:14.790034 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:48:14.790034 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:48:14.792559 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 1 already has host n-h2-836830-18. Sep 14 08:48:14.792559 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:48:14.792559 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-db22b886-f676-48bc-ac7e-3e3fa0f4000b tempest-AggregatesAdminNegativeTestJSON-1326539754 tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin] Returning 409 to user: Aggregate 1 already has host n-h2-836830-18. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:48:14.792559 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-db22b886-f676-48bc-ac7e-3e3fa0f4000b tempest-AggregatesAdminNegativeTestJSON-1326539754 tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates/1/action" status: 409 len: 96 microversion: 2.1 time: 0.087816 Sep 14 08:48:14.792559 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 12/21] 10.222.0.60 () {60 vars in 1191 bytes} [Wed Sep 14 08:48:14 2022] POST /compute/v2.1/os-aggregates/1/action => generated 96 bytes in 101 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Sep 14 08:48:14.792559 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9f53631f-04a6-4cf2-a153-676ace8253e2 tempest-FlavorsAdminTestJSON-1934103607 tempest-FlavorsAdminTestJSON-1934103607-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:14.811589 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-9f53631f-04a6-4cf2-a153-676ace8253e2 tempest-FlavorsAdminTestJSON-1934103607 tempest-FlavorsAdminTestJSON-1934103607-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 5394 microversion: 2.1 time: 0.030076 Sep 14 08:48:14.812172 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 13/22] 10.222.0.60 () {58 vars in 1146 bytes} [Wed Sep 14 08:48:14 2022] GET /compute/v2.1/flavors/detail => generated 5394 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:48:14.816744 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-fe92fc8f-37ef-4717-a9b5-24b90d219fee tempest-HostsAdminNegativeTestJSON-584101034 tempest-HostsAdminNegativeTestJSON-584101034-project] Calling method '.version_select at 0x7f7d4597b430>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:14.818520 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-fe92fc8f-37ef-4717-a9b5-24b90d219fee tempest-HostsAdminNegativeTestJSON-584101034 tempest-HostsAdminNegativeTestJSON-584101034-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': 'f4d55676982e474286eddfba7b72cdf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb1bd97167748e5a5b8ed848fd20cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:48:14.820056 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-fe92fc8f-37ef-4717-a9b5-24b90d219fee tempest-HostsAdminNegativeTestJSON-584101034 tempest-HostsAdminNegativeTestJSON-584101034-project] Request method failure captured: Sep 14 08:48:14.820056 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/os-hosts/n-d-836830-18 HTTP/1.1 Sep 14 08:48:14.820056 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 08:48:14.820056 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 08:48:14.820056 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 08:48:14.820056 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 08:48:14.820056 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 08:48:14.820056 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 08:48:14.820056 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 08:48:14.820056 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 08:48:14.820056 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZVJ1LG2NDdsIMIeItseuzrfuU9SrphiW6jCv3ZArjcasIcAMEy2Wo9XKDJHyRl_1D5Waq_QCWIMElOUFegnQeH2cNZvANhthoYmO0dpeMr4zHeJP8JmipR6Xa20e3lC4NaRX_bgjReLP0z72dRLkuujBNVR7I1EpfqUmtgQEkWdKtk Sep 14 08:48:14.820056 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 08:48:14.820056 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 08:48:14.820056 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 08:48:14.820056 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 08:48:14.820056 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 08:48:14.820056 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 08:48:14.820056 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 6bb1bd97167748e5a5b8ed848fd20cc6 Sep 14 08:48:14.820056 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-584101034 Sep 14 08:48:14.820056 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 08:48:14.820056 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 08:48:14.821137 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6bb1bd97167748e5a5b8ed848fd20cc6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6bb1bd97167748e5a5b8ed848fd20cc6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6bb1bd97167748e5a5b8ed848fd20cc6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6bb1bd97167748e5a5b8ed848fd20cc6"}]}] Sep 14 08:48:14.821137 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-HostsAdminNegativeTestJSON-584101034 Sep 14 08:48:14.821137 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 6bb1bd97167748e5a5b8ed848fd20cc6 Sep 14 08:48:14.821137 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-584101034 Sep 14 08:48:14.821137 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-HostsAdminNegativeTestJSON-584101034-project Sep 14 08:48:14.821137 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 08:48:14.821137 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 08:48:14.821137 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: f4d55676982e474286eddfba7b72cdf5 Sep 14 08:48:14.821137 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-HostsAdminNegativeTestJSON-584101034-project Sep 14 08:48:14.821137 n-d-836830-18 devstack@n-api.service[128759]: method: Sep 14 08:48:14.821137 n-d-836830-18 devstack@n-api.service[128759]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Sep 14 08:48:14.821137 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': 'n-d-836830-18'} Sep 14 08:48:14.821137 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:48:14.821784 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:14.821784 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:48:14.821784 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:48:14.821784 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:48:14.821784 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:48:14.821784 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 08:48:14.821784 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 08:48:14.821784 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:48:14.821784 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:48:14.821784 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Sep 14 08:48:14.821784 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Sep 14 08:48:14.821784 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 14 08:48:14.821784 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 14 08:48:14.821784 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 14 08:48:14.821784 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 14 08:48:14.821784 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 14 08:48:14.821784 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 14 08:48:14.821784 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 14 08:48:14.821784 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise self.value Sep 14 08:48:14.822723 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 14 08:48:14.822723 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 14 08:48:14.822723 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 14 08:48:14.822723 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 14 08:48:14.822723 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 14 08:48:14.822723 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 14 08:48:14.822723 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Sep 14 08:48:14.822723 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:48:14.822723 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:48:14.822723 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:48:14.822723 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:14.822723 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:48:14.822723 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:48:14.822723 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 14 08:48:14.822723 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 14 08:48:14.822723 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Sep 14 08:48:14.822723 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:48:14.823619 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-fe92fc8f-37ef-4717-a9b5-24b90d219fee tempest-HostsAdminNegativeTestJSON-584101034 tempest-HostsAdminNegativeTestJSON-584101034-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:48:14.823619 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-fe92fc8f-37ef-4717-a9b5-24b90d219fee tempest-HostsAdminNegativeTestJSON-584101034 tempest-HostsAdminNegativeTestJSON-584101034-project] 10.222.0.60 "GET /compute/v2.1/os-hosts/n-d-836830-18" status: 403 len: 109 microversion: 2.1 time: 0.008208 Sep 14 08:48:14.823740 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-f15a74f3-13c8-4d2e-8922-5dbec4b42cdd tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1170693711", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:48:14.827373 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 14/23] 10.222.0.60 () {58 vars in 1170 bytes} [Wed Sep 14 08:48:14 2022] GET /compute/v2.1/os-hosts/n-d-836830-18 => generated 109 bytes in 15 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 14 08:48:14.840107 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-74e0ff0a-eab0-4b9d-971e-f7d70f88d0db tempest-HypervisorAdminTestJSON-885487048 tempest-HypervisorAdminTestJSON-885487048-project-admin] Calling method '.version_select at 0x7f7d459d3af0>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:14.841469 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-74e0ff0a-eab0-4b9d-971e-f7d70f88d0db tempest-HypervisorAdminTestJSON-885487048 tempest-HypervisorAdminTestJSON-885487048-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:14.841957 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-74e0ff0a-eab0-4b9d-971e-f7d70f88d0db tempest-HypervisorAdminTestJSON-885487048 tempest-HypervisorAdminTestJSON-885487048-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:14.842916 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-74e0ff0a-eab0-4b9d-971e-f7d70f88d0db tempest-HypervisorAdminTestJSON-885487048 tempest-HypervisorAdminTestJSON-885487048-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:14.869197 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-74e0ff0a-eab0-4b9d-971e-f7d70f88d0db tempest-HypervisorAdminTestJSON-885487048 tempest-HypervisorAdminTestJSON-885487048-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.032909 Sep 14 08:48:14.869828 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 15/24] 10.222.0.60 () {58 vars in 1179 bytes} [Wed Sep 14 08:48:14 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:48:14.874657 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-44fa3065-c12c-441b-b681-41c75542b03d tempest-FlavorsAccessNegativeTestJSON-1040633479 tempest-FlavorsAccessNegativeTestJSON-1040633479-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "31dc6190eea241a08561f32d6989370a"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:48:14.994414 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-44fa3065-c12c-441b-b681-41c75542b03d tempest-FlavorsAccessNegativeTestJSON-1040633479 tempest-FlavorsAccessNegativeTestJSON-1040633479-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors/1141095808/action" status: 200 len: 21 microversion: 2.1 time: 0.123368 Sep 14 08:48:15.000053 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 16/25] 10.222.0.60 () {60 vars in 1200 bytes} [Wed Sep 14 08:48:14 2022] POST /compute/v2.1/flavors/1141095808/action => generated 21 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 08:48:15.000554 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-722ca9de-2ddc-48d4-96f3-a69701846e42 tempest-AggregatesAdminNegativeTestJSON-1326539754 tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-836830-18"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:48:15.011125 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-722ca9de-2ddc-48d4-96f3-a69701846e42 tempest-AggregatesAdminNegativeTestJSON-1326539754 tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:15.011614 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-722ca9de-2ddc-48d4-96f3-a69701846e42 tempest-AggregatesAdminNegativeTestJSON-1326539754 tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:15.012048 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-722ca9de-2ddc-48d4-96f3-a69701846e42 tempest-AggregatesAdminNegativeTestJSON-1326539754 tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:15.279890 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.network.neutron [None req-f15a74f3-13c8-4d2e-8922-5dbec4b42cdd tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] validate_networks() for None {{(pid=128758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 08:48:15.440233 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-722ca9de-2ddc-48d4-96f3-a69701846e42 tempest-AggregatesAdminNegativeTestJSON-1326539754 tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 227 microversion: 2.1 time: 0.442726 Sep 14 08:48:15.440931 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 17/26] 10.222.0.60 () {60 vars in 1191 bytes} [Wed Sep 14 08:48:14 2022] POST /compute/v2.1/os-aggregates/1/action => generated 227 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:48:15.447171 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8751aa30-be31-421e-bc4d-75f7bd0f1b7a tempest-FlavorsAdminTestJSON-1934103607 tempest-FlavorsAdminTestJSON-1934103607-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:15.471254 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-8751aa30-be31-421e-bc4d-75f7bd0f1b7a tempest-FlavorsAdminTestJSON-1934103607 tempest-FlavorsAdminTestJSON-1934103607-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/276252808" status: 202 len: 0 microversion: 2.1 time: 0.026658 Sep 14 08:48:15.471254 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 18/27] 10.222.0.60 () {58 vars in 1158 bytes} [Wed Sep 14 08:48:15 2022] DELETE /compute/v2.1/flavors/276252808 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 08:48:15.476790 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-213077c2-4840-4567-af09-70894f959930 tempest-HostsAdminNegativeTestJSON-1935444004 tempest-HostsAdminNegativeTestJSON-1935444004-project-admin] Calling method '.version_select at 0x7f7d458e35e0>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:15.485542 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-213077c2-4840-4567-af09-70894f959930 tempest-HostsAdminNegativeTestJSON-1935444004 tempest-HostsAdminNegativeTestJSON-1935444004-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Sep 14 08:48:15.487803 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-213077c2-4840-4567-af09-70894f959930 tempest-HostsAdminNegativeTestJSON-1935444004 tempest-HostsAdminNegativeTestJSON-1935444004-project-admin] Request method failure captured: Sep 14 08:48:15.487803 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Sep 14 08:48:15.487803 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 08:48:15.487803 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 08:48:15.487803 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 08:48:15.487803 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 08:48:15.487803 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 08:48:15.487803 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 08:48:15.487803 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 08:48:15.487803 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 08:48:15.487803 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZVLljBmIMa4Eww4xCZzWOvGk9e0hrPR1kvI-Lh-4gQsGto0ZQjgq1u4sIRhD__cihmqjiitES8cLTpNiyCTZ-klVMugmw0VSDR5C1fOrEntTxY7ZFOad_8MyKz5qc8uhSpX6WymDehyUATJsVMTf8DTmSfYjIZi1vZ1r30af7hwQyQ Sep 14 08:48:15.487803 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 08:48:15.487803 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 08:48:15.487803 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 08:48:15.487803 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 08:48:15.487803 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 08:48:15.487803 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 08:48:15.487803 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 1745b16e33f84d1c9e1808b0a1326d96 Sep 14 08:48:15.487803 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1935444004 Sep 14 08:48:15.487803 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member,admin Sep 14 08:48:15.487803 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member,admin Sep 14 08:48:15.489008 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/1745b16e33f84d1c9e1808b0a1326d96"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_1745b16e33f84d1c9e1808b0a1326d96"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1745b16e33f84d1c9e1808b0a1326d96"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1745b16e33f84d1c9e1808b0a1326d96"}]}] Sep 14 08:48:15.489008 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1935444004 Sep 14 08:48:15.489008 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 1745b16e33f84d1c9e1808b0a1326d96 Sep 14 08:48:15.489008 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1935444004 Sep 14 08:48:15.489008 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-HostsAdminNegativeTestJSON-1935444004-project-admin Sep 14 08:48:15.489008 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 08:48:15.489008 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 08:48:15.489008 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 82639c95eff344e5bca7b0db9d410166 Sep 14 08:48:15.489008 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1935444004-project-admin Sep 14 08:48:15.489008 n-d-836830-18 devstack@n-api.service[128759]: method: Sep 14 08:48:15.489008 n-d-836830-18 devstack@n-api.service[128759]: exception: Host 'nonexistent_hostname' is not mapped to any cell Sep 14 08:48:15.489008 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': 'nonexistent_hostname'} Sep 14 08:48:15.489008 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:48:15.489803 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:15.489803 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Sep 14 08:48:15.489803 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Sep 14 08:48:15.489803 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 14 08:48:15.489803 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 14 08:48:15.489803 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 14 08:48:15.489803 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 14 08:48:15.489803 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 14 08:48:15.489803 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 14 08:48:15.489803 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 14 08:48:15.489803 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 14 08:48:15.489803 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 14 08:48:15.489803 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:48:15.489803 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:48:15.489803 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:48:15.489803 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:15.489803 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:48:15.489803 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:48:15.489803 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:48:15.490745 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:48:15.490745 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 08:48:15.490745 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 08:48:15.490745 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:48:15.490745 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:48:15.490745 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Sep 14 08:48:15.490745 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 14 08:48:15.490745 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 14 08:48:15.490745 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:48:15.490745 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:48:15.490745 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:48:15.490745 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:15.490745 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:48:15.490745 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:48:15.490745 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:48:15.490745 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:48:15.490745 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Sep 14 08:48:15.490745 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:48:15.493701 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-213077c2-4840-4567-af09-70894f959930 tempest-HostsAdminNegativeTestJSON-1935444004 tempest-HostsAdminNegativeTestJSON-1935444004-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:48:15.494798 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-213077c2-4840-4567-af09-70894f959930 tempest-HostsAdminNegativeTestJSON-1935444004 tempest-HostsAdminNegativeTestJSON-1935444004-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.023957 Sep 14 08:48:15.495513 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 19/28] 10.222.0.60 () {58 vars in 1191 bytes} [Wed Sep 14 08:48:15 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 14 08:48:15.502356 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c96e98b9-3ce4-4b60-aa4d-6c5227d83ba8 tempest-HypervisorAdminTestJSON-885487048 tempest-HypervisorAdminTestJSON-885487048-project-admin] Calling method '.version_select at 0x7f7d4597b820>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:15.504504 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c96e98b9-3ce4-4b60-aa4d-6c5227d83ba8 tempest-HypervisorAdminTestJSON-885487048 tempest-HypervisorAdminTestJSON-885487048-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:15.505687 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c96e98b9-3ce4-4b60-aa4d-6c5227d83ba8 tempest-HypervisorAdminTestJSON-885487048 tempest-HypervisorAdminTestJSON-885487048-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:15.506210 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c96e98b9-3ce4-4b60-aa4d-6c5227d83ba8 tempest-HypervisorAdminTestJSON-885487048 tempest-HypervisorAdminTestJSON-885487048-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:15.521976 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c96e98b9-3ce4-4b60-aa4d-6c5227d83ba8 tempest-HypervisorAdminTestJSON-885487048 tempest-HypervisorAdminTestJSON-885487048-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:15.522653 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c96e98b9-3ce4-4b60-aa4d-6c5227d83ba8 tempest-HypervisorAdminTestJSON-885487048 tempest-HypervisorAdminTestJSON-885487048-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:15.523281 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c96e98b9-3ce4-4b60-aa4d-6c5227d83ba8 tempest-HypervisorAdminTestJSON-885487048 tempest-HypervisorAdminTestJSON-885487048-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:15.535462 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c96e98b9-3ce4-4b60-aa4d-6c5227d83ba8 tempest-HypervisorAdminTestJSON-885487048 tempest-HypervisorAdminTestJSON-885487048-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:15.536030 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c96e98b9-3ce4-4b60-aa4d-6c5227d83ba8 tempest-HypervisorAdminTestJSON-885487048 tempest-HypervisorAdminTestJSON-885487048-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:15.536643 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c96e98b9-3ce4-4b60-aa4d-6c5227d83ba8 tempest-HypervisorAdminTestJSON-885487048 tempest-HypervisorAdminTestJSON-885487048-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:15.542977 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-c96e98b9-3ce4-4b60-aa4d-6c5227d83ba8 tempest-HypervisorAdminTestJSON-885487048 tempest-HypervisorAdminTestJSON-885487048-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.046056 Sep 14 08:48:15.550094 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 20/29] 10.222.0.60 () {58 vars in 1146 bytes} [Wed Sep 14 08:48:15 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:48:15.557643 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9881a965-97bd-4c72-bb57-63d44b5e271a tempest-FlavorsAccessNegativeTestJSON-1040633479 tempest-FlavorsAccessNegativeTestJSON-1040633479-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:15.577761 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-9881a965-97bd-4c72-bb57-63d44b5e271a tempest-FlavorsAccessNegativeTestJSON-1040633479 tempest-FlavorsAccessNegativeTestJSON-1040633479-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/1141095808" status: 202 len: 0 microversion: 2.1 time: 0.032780 Sep 14 08:48:15.578472 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 21/30] 10.222.0.60 () {58 vars in 1161 bytes} [Wed Sep 14 08:48:15 2022] DELETE /compute/v2.1/flavors/1141095808 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 08:48:15.587609 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-52d364f0-90c4-4f42-8730-e835d4b4755c tempest-AggregatesAdminNegativeTestJSON-1326539754 tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:15.615750 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-52d364f0-90c4-4f42-8730-e835d4b4755c tempest-AggregatesAdminNegativeTestJSON-1326539754 tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.032337 Sep 14 08:48:15.616728 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 22/31] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Sep 14 08:48:15 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 14 08:48:15.622602 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-55885ee0-f831-44ee-a7f5-1452f30d26d6 tempest-FlavorsAdminTestJSON-1934103607 tempest-FlavorsAdminTestJSON-1934103607-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:15.643673 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-55885ee0-f831-44ee-a7f5-1452f30d26d6 tempest-FlavorsAdminTestJSON-1934103607 tempest-FlavorsAdminTestJSON-1934103607-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025582 Sep 14 08:48:15.644165 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 23/32] 10.222.0.60 () {58 vars in 1146 bytes} [Wed Sep 14 08:48:15 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:48:15.648983 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-fa147192-6e89-4bdd-b0fe-9c73133a61c6 tempest-HostsAdminNegativeTestJSON-584101034 tempest-HostsAdminNegativeTestJSON-584101034-project] Calling method '.version_select at 0x7f7d45c75e50>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:15.650897 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-fa147192-6e89-4bdd-b0fe-9c73133a61c6 tempest-HostsAdminNegativeTestJSON-584101034 tempest-HostsAdminNegativeTestJSON-584101034-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': 'f4d55676982e474286eddfba7b72cdf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb1bd97167748e5a5b8ed848fd20cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:48:15.652569 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-fa147192-6e89-4bdd-b0fe-9c73133a61c6 tempest-HostsAdminNegativeTestJSON-584101034 tempest-HostsAdminNegativeTestJSON-584101034-project] Request method failure captured: Sep 14 08:48:15.652569 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/os-hosts/n-d-836830-18/shutdown HTTP/1.1 Sep 14 08:48:15.652569 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 08:48:15.652569 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 08:48:15.652569 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 08:48:15.652569 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 08:48:15.652569 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 08:48:15.652569 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 08:48:15.652569 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 08:48:15.652569 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 08:48:15.652569 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZVJ1LG2NDdsIMIeItseuzrfuU9SrphiW6jCv3ZArjcasIcAMEy2Wo9XKDJHyRl_1D5Waq_QCWIMElOUFegnQeH2cNZvANhthoYmO0dpeMr4zHeJP8JmipR6Xa20e3lC4NaRX_bgjReLP0z72dRLkuujBNVR7I1EpfqUmtgQEkWdKtk Sep 14 08:48:15.652569 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 08:48:15.652569 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 08:48:15.652569 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 08:48:15.652569 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 08:48:15.652569 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 08:48:15.652569 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 08:48:15.652569 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 6bb1bd97167748e5a5b8ed848fd20cc6 Sep 14 08:48:15.652569 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-584101034 Sep 14 08:48:15.652569 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 08:48:15.652569 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 08:48:15.654062 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6bb1bd97167748e5a5b8ed848fd20cc6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6bb1bd97167748e5a5b8ed848fd20cc6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6bb1bd97167748e5a5b8ed848fd20cc6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6bb1bd97167748e5a5b8ed848fd20cc6"}]}] Sep 14 08:48:15.654062 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-HostsAdminNegativeTestJSON-584101034 Sep 14 08:48:15.654062 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 6bb1bd97167748e5a5b8ed848fd20cc6 Sep 14 08:48:15.654062 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-584101034 Sep 14 08:48:15.654062 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-HostsAdminNegativeTestJSON-584101034-project Sep 14 08:48:15.654062 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 08:48:15.654062 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 08:48:15.654062 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: f4d55676982e474286eddfba7b72cdf5 Sep 14 08:48:15.654062 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-HostsAdminNegativeTestJSON-584101034-project Sep 14 08:48:15.654062 n-d-836830-18 devstack@n-api.service[128759]: method: Sep 14 08:48:15.654062 n-d-836830-18 devstack@n-api.service[128759]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Sep 14 08:48:15.654062 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': 'n-d-836830-18'} Sep 14 08:48:15.654062 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:48:15.655411 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:15.655411 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:48:15.655411 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:48:15.655411 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:48:15.655411 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:48:15.655411 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 08:48:15.655411 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 08:48:15.655411 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:48:15.655411 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:48:15.655411 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Sep 14 08:48:15.655411 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Sep 14 08:48:15.655411 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 14 08:48:15.655411 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 14 08:48:15.655411 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 14 08:48:15.655411 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 14 08:48:15.655411 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 14 08:48:15.655411 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 14 08:48:15.655411 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 14 08:48:15.655411 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise self.value Sep 14 08:48:15.656372 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 14 08:48:15.656372 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 14 08:48:15.656372 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 14 08:48:15.656372 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 14 08:48:15.656372 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 14 08:48:15.656372 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 14 08:48:15.656372 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Sep 14 08:48:15.656372 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:48:15.656372 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:48:15.656372 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:48:15.656372 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:15.656372 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:48:15.656372 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:48:15.656372 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 14 08:48:15.656372 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 14 08:48:15.656372 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Sep 14 08:48:15.656372 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:48:15.658513 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-fa147192-6e89-4bdd-b0fe-9c73133a61c6 tempest-HostsAdminNegativeTestJSON-584101034 tempest-HostsAdminNegativeTestJSON-584101034-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:48:15.659494 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-fa147192-6e89-4bdd-b0fe-9c73133a61c6 tempest-HostsAdminNegativeTestJSON-584101034 tempest-HostsAdminNegativeTestJSON-584101034-project] 10.222.0.60 "GET /compute/v2.1/os-hosts/n-d-836830-18/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.014166 Sep 14 08:48:15.660215 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 24/33] 10.222.0.60 () {58 vars in 1197 bytes} [Wed Sep 14 08:48:15 2022] GET /compute/v2.1/os-hosts/n-d-836830-18/shutdown => generated 113 bytes in 15 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 14 08:48:15.670867 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-83791ef1-f063-4dd5-9e77-8d80b44f40f7 tempest-HypervisorAdminTestJSON-885487048 tempest-HypervisorAdminTestJSON-885487048-project-admin] Calling method '.version_select at 0x7f7d4597bd30>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:15.673249 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-83791ef1-f063-4dd5-9e77-8d80b44f40f7 tempest-HypervisorAdminTestJSON-885487048 tempest-HypervisorAdminTestJSON-885487048-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:15.673790 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-83791ef1-f063-4dd5-9e77-8d80b44f40f7 tempest-HypervisorAdminTestJSON-885487048 tempest-HypervisorAdminTestJSON-885487048-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:15.674239 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-83791ef1-f063-4dd5-9e77-8d80b44f40f7 tempest-HypervisorAdminTestJSON-885487048 tempest-HypervisorAdminTestJSON-885487048-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:15.690499 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-83791ef1-f063-4dd5-9e77-8d80b44f40f7 tempest-HypervisorAdminTestJSON-885487048 tempest-HypervisorAdminTestJSON-885487048-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:15.691029 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-83791ef1-f063-4dd5-9e77-8d80b44f40f7 tempest-HypervisorAdminTestJSON-885487048 tempest-HypervisorAdminTestJSON-885487048-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:15.691476 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-83791ef1-f063-4dd5-9e77-8d80b44f40f7 tempest-HypervisorAdminTestJSON-885487048 tempest-HypervisorAdminTestJSON-885487048-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:15.692763 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-f15a74f3-13c8-4d2e-8922-5dbec4b42cdd tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Flavor limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 08:48:15.693796 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-f15a74f3-13c8-4d2e-8922-5dbec4b42cdd tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Image limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 08:48:15.694537 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-f15a74f3-13c8-4d2e-8922-5dbec4b42cdd tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Flavor pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 08:48:15.695787 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-f15a74f3-13c8-4d2e-8922-5dbec4b42cdd tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Image pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 08:48:15.696338 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-f15a74f3-13c8-4d2e-8922-5dbec4b42cdd tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 08:48:15.698204 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-83791ef1-f063-4dd5-9e77-8d80b44f40f7 tempest-HypervisorAdminTestJSON-885487048 tempest-HypervisorAdminTestJSON-885487048-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 759 microversion: 2.1 time: 0.036775 Sep 14 08:48:15.699231 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 25/34] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Sep 14 08:48:15 2022] GET /compute/v2.1/os-hypervisors/1 => generated 759 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:48:15.704248 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9dc105bc-2281-482e-aad1-45b92ad97ac2 tempest-FlavorsAccessNegativeTestJSON-1040633479 tempest-FlavorsAccessNegativeTestJSON-1040633479-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:15.719574 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f15a74f3-13c8-4d2e-8922-5dbec4b42cdd tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:15.720377 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f15a74f3-13c8-4d2e-8922-5dbec4b42cdd tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:15.720998 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f15a74f3-13c8-4d2e-8922-5dbec4b42cdd tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:15.721798 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f15a74f3-13c8-4d2e-8922-5dbec4b42cdd tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:15.722477 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f15a74f3-13c8-4d2e-8922-5dbec4b42cdd tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:15.723052 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f15a74f3-13c8-4d2e-8922-5dbec4b42cdd tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:15.725602 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-9dc105bc-2281-482e-aad1-45b92ad97ac2 tempest-FlavorsAccessNegativeTestJSON-1040633479 tempest-FlavorsAccessNegativeTestJSON-1040633479-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025107 Sep 14 08:48:15.729919 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 26/35] 10.222.0.60 () {58 vars in 1146 bytes} [Wed Sep 14 08:48:15 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:48:15.736521 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-cd99f556-2a8b-4304-b3b0-3290ce152fd7 tempest-AggregatesAdminNegativeTestJSON-1326539754 tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1547959592"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:48:15.740374 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.objects.aggregate [None req-cd99f556-2a8b-4304-b3b0-3290ce152fd7 tempest-AggregatesAdminNegativeTestJSON-1326539754 tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin] Generated uuid e6ccd567-f129-4600-b626-355f119946ee for aggregate {{(pid=128759) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 14 08:48:15.757454 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-f15a74f3-13c8-4d2e-8922-5dbec4b42cdd tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Getting quotas for project eac4d0cae0bd46fda94d7bfb900a0b9a. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 08:48:15.764425 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-f15a74f3-13c8-4d2e-8922-5dbec4b42cdd tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Getting quotas for user 6e462483415e4c2b8a917b2a032e5ac9 and project eac4d0cae0bd46fda94d7bfb900a0b9a. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 08:48:15.771222 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-cd99f556-2a8b-4304-b3b0-3290ce152fd7 tempest-AggregatesAdminNegativeTestJSON-1326539754 tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.043871 Sep 14 08:48:15.772517 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 27/36] 10.222.0.60 () {60 vars in 1164 bytes} [Wed Sep 14 08:48:15 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:48:15.777190 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-f15a74f3-13c8-4d2e-8922-5dbec4b42cdd tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Going to run 1 instances... {{(pid=128758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 08:48:15.777527 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d83b2fd6-8823-452c-bd31-3def5a3e40ff tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1719479966", "name": "tempest-test_aggregate-121827457"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:48:15.781391 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-f15a74f3-13c8-4d2e-8922-5dbec4b42cdd tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] [instance: 7045fd2e-8224-46b8-b477-57a46e18e93f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 08:48:15.799182 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.objects.aggregate [None req-d83b2fd6-8823-452c-bd31-3def5a3e40ff tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] Generated uuid a18b882d-96fc-4ddd-91e6-6a98e7769e33 for aggregate {{(pid=128759) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 14 08:48:15.803459 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=6,nova_api:DELETE=13 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:48:15.831036 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d83b2fd6-8823-452c-bd31-3def5a3e40ff tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.057233 Sep 14 08:48:15.831813 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 28/37] 10.222.0.60 () {60 vars in 1165 bytes} [Wed Sep 14 08:48:15 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:48:15.840764 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-998796ba-5d00-4c61-8d6f-461938fd22d2 tempest-HostsAdminNegativeTestJSON-1935444004 tempest-HostsAdminNegativeTestJSON-1935444004-project-admin] Calling method '.version_select at 0x7f7d45c75f70>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:15.850800 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-998796ba-5d00-4c61-8d6f-461938fd22d2 tempest-HostsAdminNegativeTestJSON-1935444004 tempest-HostsAdminNegativeTestJSON-1935444004-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Sep 14 08:48:15.852845 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-998796ba-5d00-4c61-8d6f-461938fd22d2 tempest-HostsAdminNegativeTestJSON-1935444004 tempest-HostsAdminNegativeTestJSON-1935444004-project-admin] Request method failure captured: Sep 14 08:48:15.852845 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Sep 14 08:48:15.852845 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 08:48:15.852845 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 08:48:15.852845 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 08:48:15.852845 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 08:48:15.852845 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 08:48:15.852845 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 08:48:15.852845 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 08:48:15.852845 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 08:48:15.852845 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZVLljBmIMa4Eww4xCZzWOvGk9e0hrPR1kvI-Lh-4gQsGto0ZQjgq1u4sIRhD__cihmqjiitES8cLTpNiyCTZ-klVMugmw0VSDR5C1fOrEntTxY7ZFOad_8MyKz5qc8uhSpX6WymDehyUATJsVMTf8DTmSfYjIZi1vZ1r30af7hwQyQ Sep 14 08:48:15.852845 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 08:48:15.852845 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 08:48:15.852845 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 08:48:15.852845 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 08:48:15.852845 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 08:48:15.852845 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 08:48:15.852845 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 1745b16e33f84d1c9e1808b0a1326d96 Sep 14 08:48:15.852845 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1935444004 Sep 14 08:48:15.852845 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member,admin Sep 14 08:48:15.852845 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member,admin Sep 14 08:48:15.854524 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/1745b16e33f84d1c9e1808b0a1326d96"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_1745b16e33f84d1c9e1808b0a1326d96"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1745b16e33f84d1c9e1808b0a1326d96"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1745b16e33f84d1c9e1808b0a1326d96"}]}] Sep 14 08:48:15.854524 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1935444004 Sep 14 08:48:15.854524 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 1745b16e33f84d1c9e1808b0a1326d96 Sep 14 08:48:15.854524 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1935444004 Sep 14 08:48:15.854524 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-HostsAdminNegativeTestJSON-1935444004-project-admin Sep 14 08:48:15.854524 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 08:48:15.854524 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 08:48:15.854524 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 82639c95eff344e5bca7b0db9d410166 Sep 14 08:48:15.854524 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1935444004-project-admin Sep 14 08:48:15.854524 n-d-836830-18 devstack@n-api.service[128759]: method: Sep 14 08:48:15.854524 n-d-836830-18 devstack@n-api.service[128759]: exception: Host 'nonexistent_hostname' is not mapped to any cell Sep 14 08:48:15.854524 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': 'nonexistent_hostname'} Sep 14 08:48:15.854524 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:48:15.859606 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:15.859606 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Sep 14 08:48:15.859606 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Sep 14 08:48:15.859606 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 14 08:48:15.859606 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 14 08:48:15.859606 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 14 08:48:15.859606 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 14 08:48:15.859606 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 14 08:48:15.859606 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise self.value Sep 14 08:48:15.859606 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 14 08:48:15.859606 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 14 08:48:15.859606 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Sep 14 08:48:15.859606 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Sep 14 08:48:15.859606 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 14 08:48:15.859606 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 14 08:48:15.859606 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 14 08:48:15.859606 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 14 08:48:15.859606 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 14 08:48:15.859606 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 14 08:48:15.861021 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 14 08:48:15.861021 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 14 08:48:15.861021 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 14 08:48:15.861021 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:48:15.861021 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:48:15.861021 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:48:15.861021 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:15.861021 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:48:15.861021 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:48:15.861021 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:48:15.861021 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:48:15.861021 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 08:48:15.861021 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 08:48:15.861021 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:48:15.861021 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:48:15.861021 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Sep 14 08:48:15.861021 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Sep 14 08:48:15.861021 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Sep 14 08:48:15.861021 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 14 08:48:15.863266 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 14 08:48:15.863266 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:48:15.863266 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:48:15.863266 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:48:15.863266 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:15.863266 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:48:15.863266 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:48:15.863266 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:48:15.863266 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:48:15.863266 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Sep 14 08:48:15.863266 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:48:15.863266 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-998796ba-5d00-4c61-8d6f-461938fd22d2 tempest-HostsAdminNegativeTestJSON-1935444004 tempest-HostsAdminNegativeTestJSON-1935444004-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:48:15.864585 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-f15a74f3-13c8-4d2e-8922-5dbec4b42cdd tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.254287 Sep 14 08:48:15.864772 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-998796ba-5d00-4c61-8d6f-461938fd22d2 tempest-HostsAdminNegativeTestJSON-1935444004 tempest-HostsAdminNegativeTestJSON-1935444004-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.021521 Sep 14 08:48:15.864772 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 29/38] 10.222.0.60 () {58 vars in 1218 bytes} [Wed Sep 14 08:48:15 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 14 08:48:15.864772 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-167ac667-dd5c-4f49-95d1-d171d6098753 tempest-FlavorsAdminTestJSON-1934103607 tempest-FlavorsAdminTestJSON-1934103607-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1636446022", "id": 515628146, "os-flavor-access:is_public": "True"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:48:15.865286 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 10/39] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 08:48:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 1263 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 08:48:15.868299 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-e22d617a-bf2e-4492-bb9e-e5ff352d002f tempest-HypervisorAdminTestJSON-885487048 tempest-HypervisorAdminTestJSON-885487048-project-admin] Calling method '.version_select at 0x7f7d45490310>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:15.870199 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e22d617a-bf2e-4492-bb9e-e5ff352d002f tempest-HypervisorAdminTestJSON-885487048 tempest-HypervisorAdminTestJSON-885487048-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:15.870838 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e22d617a-bf2e-4492-bb9e-e5ff352d002f tempest-HypervisorAdminTestJSON-885487048 tempest-HypervisorAdminTestJSON-885487048-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:15.871363 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e22d617a-bf2e-4492-bb9e-e5ff352d002f tempest-HypervisorAdminTestJSON-885487048 tempest-HypervisorAdminTestJSON-885487048-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:15.888110 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-167ac667-dd5c-4f49-95d1-d171d6098753 tempest-FlavorsAdminTestJSON-1934103607 tempest-FlavorsAdminTestJSON-1934103607-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 426 microversion: 2.1 time: 0.031572 Sep 14 08:48:15.888339 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e22d617a-bf2e-4492-bb9e-e5ff352d002f tempest-HypervisorAdminTestJSON-885487048 tempest-HypervisorAdminTestJSON-885487048-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:15.889580 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 30/40] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 08:48:15 2022] POST /compute/v2.1/flavors => generated 426 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:48:15.889762 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e22d617a-bf2e-4492-bb9e-e5ff352d002f tempest-HypervisorAdminTestJSON-885487048 tempest-HypervisorAdminTestJSON-885487048-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:15.890629 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e22d617a-bf2e-4492-bb9e-e5ff352d002f tempest-HypervisorAdminTestJSON-885487048 tempest-HypervisorAdminTestJSON-885487048-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:15.894119 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-33a94ca8-000c-449d-ac53-3882f987f90f tempest-FlavorsAccessNegativeTestJSON-1040633479 tempest-FlavorsAccessNegativeTestJSON-1040633479-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-660587179", "id": 1393417045, "os-flavor-access:is_public": "True"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:48:15.898478 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-e22d617a-bf2e-4492-bb9e-e5ff352d002f tempest-HypervisorAdminTestJSON-885487048 tempest-HypervisorAdminTestJSON-885487048-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 759 microversion: 2.1 time: 0.034087 Sep 14 08:48:15.899357 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 11/41] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Sep 14 08:48:15 2022] GET /compute/v2.1/os-hypervisors/2 => generated 759 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:48:15.927652 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-33a94ca8-000c-449d-ac53-3882f987f90f tempest-FlavorsAccessNegativeTestJSON-1040633479 tempest-FlavorsAccessNegativeTestJSON-1040633479-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.036372 Sep 14 08:48:15.929234 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 31/42] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 08:48:15 2022] POST /compute/v2.1/flavors => generated 437 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:48:15.934460 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a2033e9a-7534-416f-9890-45d590e606e1 tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:15.948303 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a2033e9a-7534-416f-9890-45d590e606e1 tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] 10.222.0.60 "GET /compute/v2.1/os-aggregates" status: 200 len: 516 microversion: 2.1 time: 0.017372 Sep 14 08:48:15.949542 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 32/43] 10.222.0.60 () {58 vars in 1143 bytes} [Wed Sep 14 08:48:15 2022] GET /compute/v2.1/os-aggregates => generated 516 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:48:15.954991 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-de03e896-0df2-418b-8769-8832158ea9b3 tempest-HostsAdminNegativeTestJSON-584101034 tempest-HostsAdminNegativeTestJSON-584101034-project] Calling method '.version_select at 0x7f7d45a76b80>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:15.957120 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-de03e896-0df2-418b-8769-8832158ea9b3 tempest-HostsAdminNegativeTestJSON-584101034 tempest-HostsAdminNegativeTestJSON-584101034-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': 'f4d55676982e474286eddfba7b72cdf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb1bd97167748e5a5b8ed848fd20cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:48:15.958833 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-de03e896-0df2-418b-8769-8832158ea9b3 tempest-HostsAdminNegativeTestJSON-584101034 tempest-HostsAdminNegativeTestJSON-584101034-project] Request method failure captured: Sep 14 08:48:15.958833 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/os-hosts/n-d-836830-18/startup HTTP/1.1 Sep 14 08:48:15.958833 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 08:48:15.958833 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 08:48:15.958833 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 08:48:15.958833 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 08:48:15.958833 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 08:48:15.958833 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 08:48:15.958833 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 08:48:15.958833 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 08:48:15.958833 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZVJ1LG2NDdsIMIeItseuzrfuU9SrphiW6jCv3ZArjcasIcAMEy2Wo9XKDJHyRl_1D5Waq_QCWIMElOUFegnQeH2cNZvANhthoYmO0dpeMr4zHeJP8JmipR6Xa20e3lC4NaRX_bgjReLP0z72dRLkuujBNVR7I1EpfqUmtgQEkWdKtk Sep 14 08:48:15.958833 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 08:48:15.958833 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 08:48:15.958833 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 08:48:15.958833 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 08:48:15.958833 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 08:48:15.958833 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 08:48:15.958833 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 6bb1bd97167748e5a5b8ed848fd20cc6 Sep 14 08:48:15.958833 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-584101034 Sep 14 08:48:15.958833 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 08:48:15.958833 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 08:48:15.960185 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6bb1bd97167748e5a5b8ed848fd20cc6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6bb1bd97167748e5a5b8ed848fd20cc6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6bb1bd97167748e5a5b8ed848fd20cc6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6bb1bd97167748e5a5b8ed848fd20cc6"}]}] Sep 14 08:48:15.960185 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-HostsAdminNegativeTestJSON-584101034 Sep 14 08:48:15.960185 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 6bb1bd97167748e5a5b8ed848fd20cc6 Sep 14 08:48:15.960185 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-584101034 Sep 14 08:48:15.960185 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-HostsAdminNegativeTestJSON-584101034-project Sep 14 08:48:15.960185 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 08:48:15.960185 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 08:48:15.960185 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: f4d55676982e474286eddfba7b72cdf5 Sep 14 08:48:15.960185 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-HostsAdminNegativeTestJSON-584101034-project Sep 14 08:48:15.960185 n-d-836830-18 devstack@n-api.service[128759]: method: Sep 14 08:48:15.960185 n-d-836830-18 devstack@n-api.service[128759]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Sep 14 08:48:15.960185 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': 'n-d-836830-18'} Sep 14 08:48:15.960185 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:48:15.960892 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:15.960892 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:48:15.960892 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:48:15.960892 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:48:15.960892 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:48:15.960892 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 08:48:15.960892 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 08:48:15.960892 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:48:15.960892 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:48:15.960892 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Sep 14 08:48:15.960892 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Sep 14 08:48:15.960892 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 14 08:48:15.960892 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 14 08:48:15.960892 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 14 08:48:15.960892 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 14 08:48:15.960892 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 14 08:48:15.960892 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 14 08:48:15.960892 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 14 08:48:15.960892 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise self.value Sep 14 08:48:15.961949 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 14 08:48:15.961949 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 14 08:48:15.961949 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 14 08:48:15.961949 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 14 08:48:15.961949 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 14 08:48:15.961949 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 14 08:48:15.961949 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Sep 14 08:48:15.961949 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:48:15.961949 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:48:15.961949 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:48:15.961949 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:15.961949 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:48:15.961949 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:48:15.961949 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 14 08:48:15.961949 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 14 08:48:15.961949 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Sep 14 08:48:15.961949 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:48:15.963713 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-de03e896-0df2-418b-8769-8832158ea9b3 tempest-HostsAdminNegativeTestJSON-584101034 tempest-HostsAdminNegativeTestJSON-584101034-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:48:15.964693 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-de03e896-0df2-418b-8769-8832158ea9b3 tempest-HostsAdminNegativeTestJSON-584101034 tempest-HostsAdminNegativeTestJSON-584101034-project] 10.222.0.60 "GET /compute/v2.1/os-hosts/n-d-836830-18/startup" status: 403 len: 110 microversion: 2.1 time: 0.014005 Sep 14 08:48:15.965530 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 33/44] 10.222.0.60 () {58 vars in 1194 bytes} [Wed Sep 14 08:48:15 2022] GET /compute/v2.1/os-hosts/n-d-836830-18/startup => generated 110 bytes in 15 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 14 08:48:15.973321 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9cc95916-d809-48a3-93d4-71bc7ea03cbe tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:15.974370 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-9cc95916-d809-48a3-93d4-71bc7ea03cbe tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] [instance: 7045fd2e-8224-46b8-b477-57a46e18e93f] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:48:16.124986 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-707cc917-bbc3-458c-94d5-905d28a3d39b tempest-AggregatesAdminNegativeTestJSON-338931773 tempest-AggregatesAdminNegativeTestJSON-338931773-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-836830-18"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:48:16.129021 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-707cc917-bbc3-458c-94d5-905d28a3d39b tempest-AggregatesAdminNegativeTestJSON-338931773 tempest-AggregatesAdminNegativeTestJSON-338931773-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': '57bc4ee1d3ae4513a389cb933904e571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed05e2ea9b444238abc9a9be91397ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:48:16.131350 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-707cc917-bbc3-458c-94d5-905d28a3d39b tempest-AggregatesAdminNegativeTestJSON-338931773 tempest-AggregatesAdminNegativeTestJSON-338931773-project] Request method failure captured: Sep 14 08:48:16.131350 n-d-836830-18 devstack@n-api.service[128758]: request: POST /compute/v2.1/os-aggregates/2/action HTTP/1.1 Sep 14 08:48:16.131350 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 08:48:16.131350 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 08:48:16.131350 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 08:48:16.131350 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 40 Sep 14 08:48:16.131350 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 08:48:16.131350 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 08:48:16.131350 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 08:48:16.131350 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 08:48:16.131350 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZVJdW0uLhEkavM7Bp9qDO_pOqoNOa1h0Qp3wGKgWDHTczk4fefancNdrqkwxWcAIxR12spv8mhB9hpKqGel7aj9i3-5mk7YbzPqLTKlvqM81v3Bu1p54q7f8IzHym055xKb4Z4OWTK0y1quegytrHBJSe4m3PY_Y4dVuCratJjoErM Sep 14 08:48:16.131350 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 08:48:16.131350 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 08:48:16.131350 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 08:48:16.131350 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 08:48:16.131350 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 08:48:16.131350 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 08:48:16.131350 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: ed05e2ea9b444238abc9a9be91397ffb Sep 14 08:48:16.131350 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-338931773 Sep 14 08:48:16.131350 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 08:48:16.131350 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 08:48:16.132583 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/ed05e2ea9b444238abc9a9be91397ffb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_ed05e2ea9b444238abc9a9be91397ffb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ed05e2ea9b444238abc9a9be91397ffb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ed05e2ea9b444238abc9a9be91397ffb"}]}] Sep 14 08:48:16.132583 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-338931773 Sep 14 08:48:16.132583 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: ed05e2ea9b444238abc9a9be91397ffb Sep 14 08:48:16.132583 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-338931773 Sep 14 08:48:16.132583 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-AggregatesAdminNegativeTestJSON-338931773-project Sep 14 08:48:16.132583 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 08:48:16.132583 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 08:48:16.132583 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 57bc4ee1d3ae4513a389cb933904e571 Sep 14 08:48:16.132583 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-338931773-project Sep 14 08:48:16.132583 n-d-836830-18 devstack@n-api.service[128758]: Sep 14 08:48:16.132583 n-d-836830-18 devstack@n-api.service[128758]: {"add_host": {"host": "n-h2-836830-18"}} Sep 14 08:48:16.132583 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 08:48:16.132583 n-d-836830-18 devstack@n-api.service[128758]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Sep 14 08:48:16.133302 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': '2', 'body': {'add_host': {'host': 'n-h2-836830-18'}}} Sep 14 08:48:16.133302 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:48:16.133302 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:16.133302 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:48:16.133302 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:48:16.133302 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:48:16.133302 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:48:16.133302 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:48:16.133302 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:48:16.133302 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 08:48:16.133302 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 08:48:16.133302 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Sep 14 08:48:16.133302 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Sep 14 08:48:16.133302 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 14 08:48:16.133302 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 14 08:48:16.133302 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 14 08:48:16.133302 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 14 08:48:16.133302 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 14 08:48:16.133302 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 14 08:48:16.134236 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 14 08:48:16.134236 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise self.value Sep 14 08:48:16.134236 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 14 08:48:16.134236 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 14 08:48:16.134236 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 14 08:48:16.134236 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 14 08:48:16.134236 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 14 08:48:16.134236 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 14 08:48:16.134236 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Sep 14 08:48:16.134236 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:16.134236 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:48:16.134236 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:16.134236 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:16.134236 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:48:16.134236 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:48:16.134236 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 14 08:48:16.134236 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 14 08:48:16.134236 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Sep 14 08:48:16.134236 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:16.135788 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-707cc917-bbc3-458c-94d5-905d28a3d39b tempest-AggregatesAdminNegativeTestJSON-338931773 tempest-AggregatesAdminNegativeTestJSON-338931773-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:48:16.135788 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-707cc917-bbc3-458c-94d5-905d28a3d39b tempest-AggregatesAdminNegativeTestJSON-338931773 tempest-AggregatesAdminNegativeTestJSON-338931773-project] 10.222.0.60 "POST /compute/v2.1/os-aggregates/2/action" status: 403 len: 118 microversion: 2.1 time: 0.232105 Sep 14 08:48:16.136771 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 12/45] 10.222.0.60 () {60 vars in 1191 bytes} [Wed Sep 14 08:48:15 2022] POST /compute/v2.1/os-aggregates/2/action => generated 118 bytes in 237 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 14 08:48:16.145763 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-7522e171-a35f-4a4c-b088-41be3af05615 tempest-FlavorsAdminTestJSON-1934103607 tempest-FlavorsAdminTestJSON-1934103607-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:16.177769 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-7522e171-a35f-4a4c-b088-41be3af05615 tempest-FlavorsAdminTestJSON-1934103607 tempest-FlavorsAdminTestJSON-1934103607-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/515628146" status: 202 len: 0 microversion: 2.1 time: 0.038258 Sep 14 08:48:16.182420 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 13/46] 10.222.0.60 () {58 vars in 1158 bytes} [Wed Sep 14 08:48:16 2022] DELETE /compute/v2.1/flavors/515628146 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 08:48:16.187982 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-56f6a600-4c2f-475e-9e6a-62c331730bd9 tempest-HypervisorAdminTestJSON-885487048 tempest-HypervisorAdminTestJSON-885487048-project-admin] Calling method '.version_select at 0x7f7d452d4670>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:16.189979 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-56f6a600-4c2f-475e-9e6a-62c331730bd9 tempest-HypervisorAdminTestJSON-885487048 tempest-HypervisorAdminTestJSON-885487048-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:16.190837 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-56f6a600-4c2f-475e-9e6a-62c331730bd9 tempest-HypervisorAdminTestJSON-885487048 tempest-HypervisorAdminTestJSON-885487048-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:16.191618 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-56f6a600-4c2f-475e-9e6a-62c331730bd9 tempest-HypervisorAdminTestJSON-885487048 tempest-HypervisorAdminTestJSON-885487048-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:16.215409 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-56f6a600-4c2f-475e-9e6a-62c331730bd9 tempest-HypervisorAdminTestJSON-885487048 tempest-HypervisorAdminTestJSON-885487048-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:16.216493 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-56f6a600-4c2f-475e-9e6a-62c331730bd9 tempest-HypervisorAdminTestJSON-885487048 tempest-HypervisorAdminTestJSON-885487048-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:16.217891 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-56f6a600-4c2f-475e-9e6a-62c331730bd9 tempest-HypervisorAdminTestJSON-885487048 tempest-HypervisorAdminTestJSON-885487048-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:16.230658 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-56f6a600-4c2f-475e-9e6a-62c331730bd9 tempest-HypervisorAdminTestJSON-885487048 tempest-HypervisorAdminTestJSON-885487048-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:16.231511 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-56f6a600-4c2f-475e-9e6a-62c331730bd9 tempest-HypervisorAdminTestJSON-885487048 tempest-HypervisorAdminTestJSON-885487048-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:16.232024 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-56f6a600-4c2f-475e-9e6a-62c331730bd9 tempest-HypervisorAdminTestJSON-885487048 tempest-HypervisorAdminTestJSON-885487048-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:16.239412 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-56f6a600-4c2f-475e-9e6a-62c331730bd9 tempest-HypervisorAdminTestJSON-885487048 tempest-HypervisorAdminTestJSON-885487048-project-admin] Acquiring lock "compute-rpcapi-router" {{(pid=128758) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 14 08:48:16.240123 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-56f6a600-4c2f-475e-9e6a-62c331730bd9 tempest-HypervisorAdminTestJSON-885487048 tempest-HypervisorAdminTestJSON-885487048-project-admin] Acquired lock "compute-rpcapi-router" {{(pid=128758) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 14 08:48:16.241353 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5f16c2fa-e3b7-4c7a-8ff3-584a86cf9236 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:16.241820 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5f16c2fa-e3b7-4c7a-8ff3-584a86cf9236 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:16.242254 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5f16c2fa-e3b7-4c7a-8ff3-584a86cf9236 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:16.243024 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5f16c2fa-e3b7-4c7a-8ff3-584a86cf9236 None None] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:16.243446 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5f16c2fa-e3b7-4c7a-8ff3-584a86cf9236 None None] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:16.244040 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5f16c2fa-e3b7-4c7a-8ff3-584a86cf9236 None None] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:16.253788 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.compute.rpcapi [None req-5f16c2fa-e3b7-4c7a-8ff3-584a86cf9236 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 14 08:48:16.255812 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5f16c2fa-e3b7-4c7a-8ff3-584a86cf9236 None None] Releasing lock "compute-rpcapi-router" {{(pid=128758) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 14 08:48:16.315085 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-5f16c2fa-e3b7-4c7a-8ff3-584a86cf9236 None None] 10.222.0.60 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 176 microversion: 2.1 time: 0.131117 Sep 14 08:48:16.316573 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 14/47] 10.222.0.60 () {58 vars in 1173 bytes} [Wed Sep 14 08:48:16 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 176 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:48:16.322026 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-9ee274ec-4507-45ca-bf72-91c80b6a0065 tempest-FlavorsAccessNegativeTestJSON-1040633479 tempest-FlavorsAccessNegativeTestJSON-1040633479-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:16.343315 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-9ee274ec-4507-45ca-bf72-91c80b6a0065 tempest-FlavorsAccessNegativeTestJSON-1040633479 tempest-FlavorsAccessNegativeTestJSON-1040633479-project-admin] HTTP exception thrown: Access list not available for public flavors. Sep 14 08:48:16.346168 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-9ee274ec-4507-45ca-bf72-91c80b6a0065 tempest-FlavorsAccessNegativeTestJSON-1040633479 tempest-FlavorsAccessNegativeTestJSON-1040633479-project-admin] Request method failure captured: Sep 14 08:48:16.346168 n-d-836830-18 devstack@n-api.service[128758]: request: GET /compute/v2.1/flavors/1393417045/os-flavor-access HTTP/1.1 Sep 14 08:48:16.346168 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 08:48:16.346168 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 08:48:16.346168 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 08:48:16.346168 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 08:48:16.346168 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 08:48:16.346168 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 08:48:16.346168 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 08:48:16.346168 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 08:48:16.346168 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZVKJSjyzZGCJzjQRHZ-EUrDD7WgAPnGvswjBafnVQ4h7JSbfb9grJSyQlLqMEDjsnfwCvFjAT63xncqb7xWI9hW9N24x5jvHJ7DoIbjudemZDLyrpsoYD5x87jmuEfBIUhg7wuyjt39GOBnMJHmo2entNXbBjFuc6BUyN2NhXbAVtA Sep 14 08:48:16.346168 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 08:48:16.346168 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 08:48:16.346168 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 08:48:16.346168 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 08:48:16.346168 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 08:48:16.346168 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 08:48:16.346168 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 63a0319d101b4b63bb7f2c8d33f4dcfa Sep 14 08:48:16.346168 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1040633479 Sep 14 08:48:16.346168 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member,admin Sep 14 08:48:16.346168 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member,admin Sep 14 08:48:16.347501 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/63a0319d101b4b63bb7f2c8d33f4dcfa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_63a0319d101b4b63bb7f2c8d33f4dcfa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/63a0319d101b4b63bb7f2c8d33f4dcfa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/63a0319d101b4b63bb7f2c8d33f4dcfa"}]}] Sep 14 08:48:16.347501 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1040633479 Sep 14 08:48:16.347501 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 63a0319d101b4b63bb7f2c8d33f4dcfa Sep 14 08:48:16.347501 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1040633479 Sep 14 08:48:16.347501 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-FlavorsAccessNegativeTestJSON-1040633479-project-admin Sep 14 08:48:16.347501 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 08:48:16.347501 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 08:48:16.347501 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 681b897863214207b167ab006909a66a Sep 14 08:48:16.347501 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1040633479-project-admin Sep 14 08:48:16.347501 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 08:48:16.347501 n-d-836830-18 devstack@n-api.service[128758]: exception: Access list not available for public flavors. Sep 14 08:48:16.347501 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'flavor_id': '1393417045'} Sep 14 08:48:16.348114 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:48:16.348114 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:16.348114 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:48:16.348114 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:48:16.348114 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:48:16.348114 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:48:16.348114 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:48:16.348114 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:48:16.348114 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Sep 14 08:48:16.348114 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 14 08:48:16.348114 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Sep 14 08:48:16.348114 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:16.348114 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:48:16.348114 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:16.348114 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:16.348114 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:48:16.348114 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:48:16.348114 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:48:16.348114 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:48:16.348114 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Sep 14 08:48:16.348114 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:16.349165 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-9ee274ec-4507-45ca-bf72-91c80b6a0065 tempest-FlavorsAccessNegativeTestJSON-1040633479 tempest-FlavorsAccessNegativeTestJSON-1040633479-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:48:16.349165 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-9ee274ec-4507-45ca-bf72-91c80b6a0065 tempest-FlavorsAccessNegativeTestJSON-1040633479 tempest-FlavorsAccessNegativeTestJSON-1040633479-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/1393417045/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.030656 Sep 14 08:48:16.349707 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 15/48] 10.222.0.60 () {58 vars in 1209 bytes} [Wed Sep 14 08:48:16 2022] GET /compute/v2.1/flavors/1393417045/os-flavor-access => generated 91 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 14 08:48:16.356814 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-058b5cd3-0974-4b4d-b193-ed24b602ebd7 tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-836830-18"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:48:16.374396 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-058b5cd3-0974-4b4d-b193-ed24b602ebd7 tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:16.375116 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-058b5cd3-0974-4b4d-b193-ed24b602ebd7 tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:16.375826 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-058b5cd3-0974-4b4d-b193-ed24b602ebd7 tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:16.575502 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-9cc95916-d809-48a3-93d4-71bc7ea03cbe tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e462483415e4c2b8a917b2a032e5ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac4d0cae0bd46fda94d7bfb900a0b9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:48:16.595202 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-058b5cd3-0974-4b4d-b193-ed24b602ebd7 tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 315 microversion: 2.1 time: 0.243292 Sep 14 08:48:16.596374 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 16/49] 10.222.0.60 () {60 vars in 1191 bytes} [Wed Sep 14 08:48:16 2022] POST /compute/v2.1/os-aggregates/3/action => generated 315 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:48:16.601540 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-9cc95916-d809-48a3-93d4-71bc7ea03cbe tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] 10.222.0.60 "GET /compute/v2.1/servers/7045fd2e-8224-46b8-b477-57a46e18e93f" status: 200 len: 1220 microversion: 2.1 time: 0.634290 Sep 14 08:48:16.602221 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 34/50] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:48:15 2022] GET /compute/v2.1/servers/7045fd2e-8224-46b8-b477-57a46e18e93f => generated 1220 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:48:16.616288 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-66f1552e-7807-4478-afbd-d286c81791e0 tempest-AggregatesAdminNegativeTestJSON-1326539754 tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:16.621338 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b39422df-e386-499e-b635-ffa96c846d67 tempest-HostsAdminNegativeTestJSON-1935444004 tempest-HostsAdminNegativeTestJSON-1935444004-project-admin] Calling method '.version_select at 0x7f7d45294c10>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:16.633726 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-b39422df-e386-499e-b635-ffa96c846d67 tempest-HostsAdminNegativeTestJSON-1935444004 tempest-HostsAdminNegativeTestJSON-1935444004-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Sep 14 08:48:16.635475 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b39422df-e386-499e-b635-ffa96c846d67 tempest-HostsAdminNegativeTestJSON-1935444004 tempest-HostsAdminNegativeTestJSON-1935444004-project-admin] Request method failure captured: Sep 14 08:48:16.635475 n-d-836830-18 devstack@n-api.service[128758]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Sep 14 08:48:16.635475 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 08:48:16.635475 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 08:48:16.635475 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 08:48:16.635475 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 08:48:16.635475 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 08:48:16.635475 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 08:48:16.635475 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 08:48:16.635475 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 08:48:16.635475 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZVLljBmIMa4Eww4xCZzWOvGk9e0hrPR1kvI-Lh-4gQsGto0ZQjgq1u4sIRhD__cihmqjiitES8cLTpNiyCTZ-klVMugmw0VSDR5C1fOrEntTxY7ZFOad_8MyKz5qc8uhSpX6WymDehyUATJsVMTf8DTmSfYjIZi1vZ1r30af7hwQyQ Sep 14 08:48:16.635475 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 08:48:16.635475 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 08:48:16.635475 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 08:48:16.635475 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 08:48:16.635475 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 08:48:16.635475 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 08:48:16.635475 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 1745b16e33f84d1c9e1808b0a1326d96 Sep 14 08:48:16.635475 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1935444004 Sep 14 08:48:16.635475 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member,admin Sep 14 08:48:16.635475 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member,admin Sep 14 08:48:16.636631 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/1745b16e33f84d1c9e1808b0a1326d96"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_1745b16e33f84d1c9e1808b0a1326d96"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1745b16e33f84d1c9e1808b0a1326d96"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1745b16e33f84d1c9e1808b0a1326d96"}]}] Sep 14 08:48:16.636631 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1935444004 Sep 14 08:48:16.636631 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 1745b16e33f84d1c9e1808b0a1326d96 Sep 14 08:48:16.636631 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1935444004 Sep 14 08:48:16.636631 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-HostsAdminNegativeTestJSON-1935444004-project-admin Sep 14 08:48:16.636631 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 08:48:16.636631 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 08:48:16.636631 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 82639c95eff344e5bca7b0db9d410166 Sep 14 08:48:16.636631 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1935444004-project-admin Sep 14 08:48:16.636631 n-d-836830-18 devstack@n-api.service[128758]: method: Sep 14 08:48:16.636631 n-d-836830-18 devstack@n-api.service[128758]: exception: Host 'nonexistent_hostname' is not mapped to any cell Sep 14 08:48:16.636631 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': 'nonexistent_hostname'} Sep 14 08:48:16.636631 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:48:16.637295 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:16.637295 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Sep 14 08:48:16.637295 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Sep 14 08:48:16.637295 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 14 08:48:16.637295 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 14 08:48:16.637295 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 14 08:48:16.637295 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 14 08:48:16.637295 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 14 08:48:16.637295 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise self.value Sep 14 08:48:16.637295 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 14 08:48:16.637295 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 14 08:48:16.637295 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Sep 14 08:48:16.637295 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Sep 14 08:48:16.637295 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 14 08:48:16.637295 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 14 08:48:16.637295 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 14 08:48:16.637295 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 14 08:48:16.637295 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 14 08:48:16.637295 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 14 08:48:16.638209 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 14 08:48:16.638209 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 14 08:48:16.638209 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 14 08:48:16.638209 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:16.638209 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:48:16.638209 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:16.638209 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:16.638209 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:48:16.638209 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:48:16.638209 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:48:16.638209 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:48:16.638209 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 08:48:16.638209 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 08:48:16.638209 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:48:16.638209 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:48:16.638209 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Sep 14 08:48:16.638209 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Sep 14 08:48:16.638209 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Sep 14 08:48:16.638209 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 14 08:48:16.639749 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 14 08:48:16.639749 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:16.639749 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:48:16.639749 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:16.639749 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:16.639749 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:48:16.639749 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:48:16.639749 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:48:16.639749 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:48:16.639749 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Sep 14 08:48:16.639749 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:16.656183 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-66f1552e-7807-4478-afbd-d286c81791e0 tempest-AggregatesAdminNegativeTestJSON-1326539754 tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.052327 Sep 14 08:48:16.656783 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b39422df-e386-499e-b635-ffa96c846d67 tempest-HostsAdminNegativeTestJSON-1935444004 tempest-HostsAdminNegativeTestJSON-1935444004-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:48:16.657883 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-b39422df-e386-499e-b635-ffa96c846d67 tempest-HostsAdminNegativeTestJSON-1935444004 tempest-HostsAdminNegativeTestJSON-1935444004-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.058879 Sep 14 08:48:16.662470 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 35/51] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Sep 14 08:48:16 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 14 08:48:16.665405 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 17/52] 10.222.0.60 () {58 vars in 1215 bytes} [Wed Sep 14 08:48:16 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 14 08:48:16.669471 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b7324402-15d9-45c8-99ec-40fe2a95259b tempest-FlavorsAdminTestJSON-1934103607 tempest-FlavorsAdminTestJSON-1934103607-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:16.670031 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d4c5308f-ca79-4906-9380-84b14cc46d3e tempest-FlavorsAccessNegativeTestJSON-1040633479 tempest-FlavorsAccessNegativeTestJSON-1040633479-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:16.698108 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b7324402-15d9-45c8-99ec-40fe2a95259b tempest-FlavorsAdminTestJSON-1934103607 tempest-FlavorsAdminTestJSON-1934103607-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 5418 microversion: 2.1 time: 0.033801 Sep 14 08:48:16.699260 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 36/53] 10.222.0.60 () {58 vars in 1146 bytes} [Wed Sep 14 08:48:16 2022] GET /compute/v2.1/flavors/detail => generated 5418 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:48:16.718039 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-d4c5308f-ca79-4906-9380-84b14cc46d3e tempest-FlavorsAccessNegativeTestJSON-1040633479 tempest-FlavorsAccessNegativeTestJSON-1040633479-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/1393417045" status: 202 len: 0 microversion: 2.1 time: 0.050739 Sep 14 08:48:16.718607 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 18/54] 10.222.0.60 () {58 vars in 1161 bytes} [Wed Sep 14 08:48:16 2022] DELETE /compute/v2.1/flavors/1393417045 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 08:48:16.719221 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-464b359c-5ea9-47f8-9b39-68a90ea54bdc tempest-AggregatesAdminNegativeTestJSON-1326539754 tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-363152587"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:48:16.726029 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.objects.aggregate [None req-464b359c-5ea9-47f8-9b39-68a90ea54bdc tempest-AggregatesAdminNegativeTestJSON-1326539754 tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin] Generated uuid c33d8a9d-b6b2-4ebe-bc6a-aef81d8af865 for aggregate {{(pid=128759) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 14 08:48:16.731095 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-4eedb3f5-2e82-4d24-832e-8552a2a9babb tempest-HostsAdminNegativeTestJSON-1935444004 tempest-HostsAdminNegativeTestJSON-1935444004-project-admin] Action: 'update', calling method: .version_select at 0x7f7d45296ca0>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:48:16.738448 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-4eedb3f5-2e82-4d24-832e-8552a2a9babb tempest-HostsAdminNegativeTestJSON-1935444004 tempest-HostsAdminNegativeTestJSON-1935444004-project-admin] Request method failure captured: Sep 14 08:48:16.738448 n-d-836830-18 devstack@n-api.service[128758]: request: PUT /compute/v2.1/os-hosts/n-d-836830-18 HTTP/1.1 Sep 14 08:48:16.738448 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 08:48:16.738448 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 08:48:16.738448 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 08:48:16.738448 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 51 Sep 14 08:48:16.738448 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 08:48:16.738448 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 08:48:16.738448 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 08:48:16.738448 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 08:48:16.738448 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZVLljBmIMa4Eww4xCZzWOvGk9e0hrPR1kvI-Lh-4gQsGto0ZQjgq1u4sIRhD__cihmqjiitES8cLTpNiyCTZ-klVMugmw0VSDR5C1fOrEntTxY7ZFOad_8MyKz5qc8uhSpX6WymDehyUATJsVMTf8DTmSfYjIZi1vZ1r30af7hwQyQ Sep 14 08:48:16.738448 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 08:48:16.738448 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 08:48:16.738448 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 08:48:16.738448 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 08:48:16.738448 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 08:48:16.738448 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 08:48:16.738448 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 1745b16e33f84d1c9e1808b0a1326d96 Sep 14 08:48:16.738448 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1935444004 Sep 14 08:48:16.738448 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member,admin Sep 14 08:48:16.738448 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member,admin Sep 14 08:48:16.740165 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/1745b16e33f84d1c9e1808b0a1326d96"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_1745b16e33f84d1c9e1808b0a1326d96"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1745b16e33f84d1c9e1808b0a1326d96"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1745b16e33f84d1c9e1808b0a1326d96"}]}] Sep 14 08:48:16.740165 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1935444004 Sep 14 08:48:16.740165 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 1745b16e33f84d1c9e1808b0a1326d96 Sep 14 08:48:16.740165 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1935444004 Sep 14 08:48:16.740165 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-HostsAdminNegativeTestJSON-1935444004-project-admin Sep 14 08:48:16.740165 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 08:48:16.740165 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 08:48:16.740165 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 82639c95eff344e5bca7b0db9d410166 Sep 14 08:48:16.740165 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1935444004-project-admin Sep 14 08:48:16.740165 n-d-836830-18 devstack@n-api.service[128758]: Sep 14 08:48:16.740165 n-d-836830-18 devstack@n-api.service[128758]: {"status": "enable", "maintenance_mode": "invalid"} Sep 14 08:48:16.740165 n-d-836830-18 devstack@n-api.service[128758]: method: Sep 14 08:48:16.740165 n-d-836830-18 devstack@n-api.service[128758]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 14 08:48:16.740999 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': 'n-d-836830-18', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Sep 14 08:48:16.740999 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:48:16.740999 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:16.740999 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 14 08:48:16.740999 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 14 08:48:16.740999 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 14 08:48:16.740999 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise error Sep 14 08:48:16.740999 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 14 08:48:16.740999 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:16.740999 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Sep 14 08:48:16.740999 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Sep 14 08:48:16.740999 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi 'disable', Sep 14 08:48:16.740999 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi 'Enable', Sep 14 08:48:16.740999 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi 'Disable', Sep 14 08:48:16.740999 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi 'ENABLE', Sep 14 08:48:16.740999 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi 'DISABLE'], Sep 14 08:48:16.740999 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi 'type': 'string'} Sep 14 08:48:16.740999 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:16.740999 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi On instance: Sep 14 08:48:16.740999 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi 'invalid' Sep 14 08:48:16.740999 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:16.740999 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:48:16.740999 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:16.740999 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:16.740999 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:48:16.742768 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:48:16.742768 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:48:16.742768 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:48:16.742768 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 08:48:16.742768 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 08:48:16.742768 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:48:16.742768 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:48:16.742768 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 14 08:48:16.742768 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 14 08:48:16.742768 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 14 08:48:16.742768 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 14 08:48:16.742768 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 14 08:48:16.742768 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 14 08:48:16.742768 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 14 08:48:16.742768 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:16.742768 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:48:16.742768 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:16.742768 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:16.742768 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:48:16.744100 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:48:16.744100 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 14 08:48:16.744100 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 14 08:48:16.744100 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 14 08:48:16.744100 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:16.745773 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-4eedb3f5-2e82-4d24-832e-8552a2a9babb tempest-HostsAdminNegativeTestJSON-1935444004 tempest-HostsAdminNegativeTestJSON-1935444004-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:48:16.747884 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-4eedb3f5-2e82-4d24-832e-8552a2a9babb tempest-HostsAdminNegativeTestJSON-1935444004 tempest-HostsAdminNegativeTestJSON-1935444004-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-hosts/n-d-836830-18" status: 400 len: 199 microversion: 2.1 time: 0.026702 Sep 14 08:48:16.748563 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 19/55] 10.222.0.60 () {60 vars in 1190 bytes} [Wed Sep 14 08:48:16 2022] PUT /compute/v2.1/os-hosts/n-d-836830-18 => generated 199 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 14 08:48:16.759303 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-464b359c-5ea9-47f8-9b39-68a90ea54bdc tempest-AggregatesAdminNegativeTestJSON-1326539754 tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.050959 Sep 14 08:48:16.760980 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b8f9ad22-ddf7-4524-b8c6-7f0e076c9fbc tempest-FlavorsAdminTestJSON-1934103607 tempest-FlavorsAdminTestJSON-1934103607-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1219976781", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:48:16.767421 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 37/56] 10.222.0.60 () {60 vars in 1164 bytes} [Wed Sep 14 08:48:16 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:48:16.781906 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e57a8b4b-377d-427e-a5ad-5002e7447cc4 tempest-FlavorsAccessNegativeTestJSON-1040633479 tempest-FlavorsAccessNegativeTestJSON-1040633479-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:16.785277 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-b8f9ad22-ddf7-4524-b8c6-7f0e076c9fbc tempest-FlavorsAdminTestJSON-1934103607 tempest-FlavorsAdminTestJSON-1934103607-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.034552 Sep 14 08:48:16.792420 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 20/57] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 08:48:16 2022] POST /compute/v2.1/flavors => generated 507 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:48:16.800734 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b85ff467-81b6-4d29-9896-bd9aa57b6813 tempest-HostsAdminNegativeTestJSON-1935444004 tempest-HostsAdminNegativeTestJSON-1935444004-project-admin] Action: 'update', calling method: .version_select at 0x7f7d45221f70>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:48:16.811322 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b85ff467-81b6-4d29-9896-bd9aa57b6813 tempest-HostsAdminNegativeTestJSON-1935444004 tempest-HostsAdminNegativeTestJSON-1935444004-project-admin] Request method failure captured: Sep 14 08:48:16.811322 n-d-836830-18 devstack@n-api.service[128758]: request: PUT /compute/v2.1/os-hosts/n-d-836830-18 HTTP/1.1 Sep 14 08:48:16.811322 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 08:48:16.811322 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 08:48:16.811322 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 08:48:16.811322 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 51 Sep 14 08:48:16.811322 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 08:48:16.811322 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 08:48:16.811322 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 08:48:16.811322 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 08:48:16.811322 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZVLljBmIMa4Eww4xCZzWOvGk9e0hrPR1kvI-Lh-4gQsGto0ZQjgq1u4sIRhD__cihmqjiitES8cLTpNiyCTZ-klVMugmw0VSDR5C1fOrEntTxY7ZFOad_8MyKz5qc8uhSpX6WymDehyUATJsVMTf8DTmSfYjIZi1vZ1r30af7hwQyQ Sep 14 08:48:16.811322 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 08:48:16.811322 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 08:48:16.811322 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 08:48:16.811322 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 08:48:16.811322 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 08:48:16.811322 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 08:48:16.811322 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 1745b16e33f84d1c9e1808b0a1326d96 Sep 14 08:48:16.811322 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1935444004 Sep 14 08:48:16.811322 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member,admin Sep 14 08:48:16.811322 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member,admin Sep 14 08:48:16.812765 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/1745b16e33f84d1c9e1808b0a1326d96"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_1745b16e33f84d1c9e1808b0a1326d96"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1745b16e33f84d1c9e1808b0a1326d96"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1745b16e33f84d1c9e1808b0a1326d96"}]}] Sep 14 08:48:16.812765 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1935444004 Sep 14 08:48:16.812765 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 1745b16e33f84d1c9e1808b0a1326d96 Sep 14 08:48:16.812765 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1935444004 Sep 14 08:48:16.812765 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-HostsAdminNegativeTestJSON-1935444004-project-admin Sep 14 08:48:16.812765 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 08:48:16.812765 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 08:48:16.812765 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 82639c95eff344e5bca7b0db9d410166 Sep 14 08:48:16.812765 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1935444004-project-admin Sep 14 08:48:16.812765 n-d-836830-18 devstack@n-api.service[128758]: Sep 14 08:48:16.812765 n-d-836830-18 devstack@n-api.service[128758]: {"status": "invalid", "maintenance_mode": "enable"} Sep 14 08:48:16.812765 n-d-836830-18 devstack@n-api.service[128758]: method: Sep 14 08:48:16.812765 n-d-836830-18 devstack@n-api.service[128758]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 14 08:48:16.813570 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': 'n-d-836830-18', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Sep 14 08:48:16.813570 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:48:16.813570 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:16.813570 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 14 08:48:16.813570 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 14 08:48:16.813570 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 14 08:48:16.813570 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise error Sep 14 08:48:16.813570 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 14 08:48:16.813570 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:16.813570 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Sep 14 08:48:16.813570 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Sep 14 08:48:16.813570 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi 'disable', Sep 14 08:48:16.813570 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi 'Enable', Sep 14 08:48:16.813570 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi 'Disable', Sep 14 08:48:16.813570 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi 'ENABLE', Sep 14 08:48:16.813570 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi 'DISABLE'], Sep 14 08:48:16.813570 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi 'type': 'string'} Sep 14 08:48:16.813570 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:16.813570 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi On instance: Sep 14 08:48:16.813570 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi 'invalid' Sep 14 08:48:16.813570 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:16.813570 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:48:16.813570 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:16.813570 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:16.813570 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:48:16.815099 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:48:16.815099 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:48:16.815099 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:48:16.815099 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 08:48:16.815099 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 08:48:16.815099 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:48:16.815099 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:48:16.815099 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 14 08:48:16.815099 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 14 08:48:16.815099 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 14 08:48:16.815099 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 14 08:48:16.815099 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 14 08:48:16.815099 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 14 08:48:16.815099 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 14 08:48:16.815099 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:16.815099 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:48:16.815099 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:16.815099 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:16.815099 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:48:16.816272 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:48:16.816272 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 14 08:48:16.816272 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 14 08:48:16.816272 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 14 08:48:16.816272 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:16.816272 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b85ff467-81b6-4d29-9896-bd9aa57b6813 tempest-HostsAdminNegativeTestJSON-1935444004 tempest-HostsAdminNegativeTestJSON-1935444004-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:48:16.816272 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-b85ff467-81b6-4d29-9896-bd9aa57b6813 tempest-HostsAdminNegativeTestJSON-1935444004 tempest-HostsAdminNegativeTestJSON-1935444004-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-hosts/n-d-836830-18" status: 400 len: 189 microversion: 2.1 time: 0.020103 Sep 14 08:48:16.819085 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 21/58] 10.222.0.60 () {60 vars in 1190 bytes} [Wed Sep 14 08:48:16 2022] PUT /compute/v2.1/os-hosts/n-d-836830-18 => generated 189 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 14 08:48:16.819594 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e57a8b4b-377d-427e-a5ad-5002e7447cc4 tempest-FlavorsAccessNegativeTestJSON-1040633479 tempest-FlavorsAccessNegativeTestJSON-1040633479-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 5488 microversion: 2.1 time: 0.050267 Sep 14 08:48:16.821785 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 38/59] 10.222.0.60 () {58 vars in 1146 bytes} [Wed Sep 14 08:48:16 2022] GET /compute/v2.1/flavors/detail => generated 5488 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:48:16.833599 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-7d4a6d1c-b6b0-429a-96e7-c5a1b65bd6d8 tempest-AggregatesAdminNegativeTestJSON-1326539754 tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-1633306007"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:48:16.839432 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-babb4ac8-f363-4e20-972b-bb5334b1e4e8 tempest-FlavorsAdminTestJSON-1934103607 tempest-FlavorsAdminTestJSON-1934103607-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:16.861486 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-babb4ac8-f363-4e20-972b-bb5334b1e4e8 tempest-FlavorsAdminTestJSON-1934103607 tempest-FlavorsAdminTestJSON-1934103607-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/526ea97b-b6e5-4b4f-ae3b-bc7800275b0b" status: 202 len: 0 microversion: 2.1 time: 0.030733 Sep 14 08:48:16.862670 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 39/60] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 08:48:16 2022] DELETE /compute/v2.1/flavors/526ea97b-b6e5-4b4f-ae3b-bc7800275b0b => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 08:48:16.869575 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-4e63d2f1-a067-4a6d-8daa-f008ed8a75eb tempest-HostsAdminNegativeTestJSON-584101034 tempest-HostsAdminNegativeTestJSON-584101034-project] Action: 'update', calling method: .version_select at 0x7f7d4506fe50>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:48:16.869739 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7d4a6d1c-b6b0-429a-96e7-c5a1b65bd6d8 tempest-AggregatesAdminNegativeTestJSON-1326539754 tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:16.870234 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7d4a6d1c-b6b0-429a-96e7-c5a1b65bd6d8 tempest-AggregatesAdminNegativeTestJSON-1326539754 tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:16.870686 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7d4a6d1c-b6b0-429a-96e7-c5a1b65bd6d8 tempest-AggregatesAdminNegativeTestJSON-1326539754 tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:16.874657 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-4e63d2f1-a067-4a6d-8daa-f008ed8a75eb tempest-HostsAdminNegativeTestJSON-584101034 tempest-HostsAdminNegativeTestJSON-584101034-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': 'f4d55676982e474286eddfba7b72cdf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb1bd97167748e5a5b8ed848fd20cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:48:16.877037 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-4e63d2f1-a067-4a6d-8daa-f008ed8a75eb tempest-HostsAdminNegativeTestJSON-584101034 tempest-HostsAdminNegativeTestJSON-584101034-project] Request method failure captured: Sep 14 08:48:16.877037 n-d-836830-18 devstack@n-api.service[128759]: request: PUT /compute/v2.1/os-hosts/n-d-836830-18 HTTP/1.1 Sep 14 08:48:16.877037 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 08:48:16.877037 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 08:48:16.877037 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 08:48:16.877037 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 50 Sep 14 08:48:16.877037 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 08:48:16.877037 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 08:48:16.877037 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 08:48:16.877037 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 08:48:16.877037 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZVJ1LG2NDdsIMIeItseuzrfuU9SrphiW6jCv3ZArjcasIcAMEy2Wo9XKDJHyRl_1D5Waq_QCWIMElOUFegnQeH2cNZvANhthoYmO0dpeMr4zHeJP8JmipR6Xa20e3lC4NaRX_bgjReLP0z72dRLkuujBNVR7I1EpfqUmtgQEkWdKtk Sep 14 08:48:16.877037 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 08:48:16.877037 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 08:48:16.877037 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 08:48:16.877037 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 08:48:16.877037 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 08:48:16.877037 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 08:48:16.877037 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 6bb1bd97167748e5a5b8ed848fd20cc6 Sep 14 08:48:16.877037 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-584101034 Sep 14 08:48:16.877037 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 08:48:16.877037 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 08:48:16.878517 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6bb1bd97167748e5a5b8ed848fd20cc6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6bb1bd97167748e5a5b8ed848fd20cc6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6bb1bd97167748e5a5b8ed848fd20cc6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6bb1bd97167748e5a5b8ed848fd20cc6"}]}] Sep 14 08:48:16.878517 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-HostsAdminNegativeTestJSON-584101034 Sep 14 08:48:16.878517 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 6bb1bd97167748e5a5b8ed848fd20cc6 Sep 14 08:48:16.878517 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-584101034 Sep 14 08:48:16.878517 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-HostsAdminNegativeTestJSON-584101034-project Sep 14 08:48:16.878517 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 08:48:16.878517 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 08:48:16.878517 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: f4d55676982e474286eddfba7b72cdf5 Sep 14 08:48:16.878517 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-HostsAdminNegativeTestJSON-584101034-project Sep 14 08:48:16.878517 n-d-836830-18 devstack@n-api.service[128759]: Sep 14 08:48:16.878517 n-d-836830-18 devstack@n-api.service[128759]: {"status": "enable", "maintenance_mode": "enable"} Sep 14 08:48:16.878517 n-d-836830-18 devstack@n-api.service[128759]: method: Sep 14 08:48:16.878517 n-d-836830-18 devstack@n-api.service[128759]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Sep 14 08:48:16.878517 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': 'n-d-836830-18', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Sep 14 08:48:16.879447 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:48:16.879447 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:16.879447 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:48:16.879447 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:48:16.879447 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:48:16.879447 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:48:16.879447 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 08:48:16.879447 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 08:48:16.879447 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:48:16.879447 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:48:16.879447 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 08:48:16.879447 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 08:48:16.879447 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Sep 14 08:48:16.879447 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Sep 14 08:48:16.879447 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 14 08:48:16.879447 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 14 08:48:16.879447 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 14 08:48:16.879447 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 14 08:48:16.879447 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 14 08:48:16.879447 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 14 08:48:16.880709 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 14 08:48:16.880709 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise self.value Sep 14 08:48:16.880709 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 14 08:48:16.880709 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 14 08:48:16.880709 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 14 08:48:16.880709 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 14 08:48:16.880709 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 14 08:48:16.880709 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 14 08:48:16.880709 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Sep 14 08:48:16.880709 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:48:16.880709 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:48:16.880709 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:48:16.880709 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:16.880709 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:48:16.880709 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:48:16.880709 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 14 08:48:16.880709 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 14 08:48:16.880709 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Sep 14 08:48:16.880709 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:48:16.881893 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7d4a6d1c-b6b0-429a-96e7-c5a1b65bd6d8 tempest-AggregatesAdminNegativeTestJSON-1326539754 tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:16.881893 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7d4a6d1c-b6b0-429a-96e7-c5a1b65bd6d8 tempest-AggregatesAdminNegativeTestJSON-1326539754 tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:16.881893 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7d4a6d1c-b6b0-429a-96e7-c5a1b65bd6d8 tempest-AggregatesAdminNegativeTestJSON-1326539754 tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:16.883007 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-4e63d2f1-a067-4a6d-8daa-f008ed8a75eb tempest-HostsAdminNegativeTestJSON-584101034 tempest-HostsAdminNegativeTestJSON-584101034-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:48:16.884069 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-4e63d2f1-a067-4a6d-8daa-f008ed8a75eb tempest-HostsAdminNegativeTestJSON-584101034 tempest-HostsAdminNegativeTestJSON-584101034-project] 10.222.0.60 "PUT /compute/v2.1/os-hosts/n-d-836830-18" status: 403 len: 111 microversion: 2.1 time: 0.020073 Sep 14 08:48:16.884907 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 40/61] 10.222.0.60 () {60 vars in 1190 bytes} [Wed Sep 14 08:48:16 2022] PUT /compute/v2.1/os-hosts/n-d-836830-18 => generated 111 bytes in 22 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 14 08:48:16.890230 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-7d4a6d1c-b6b0-429a-96e7-c5a1b65bd6d8 tempest-AggregatesAdminNegativeTestJSON-1326539754 tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-1633306007 could not be found. Sep 14 08:48:16.892852 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-7d4a6d1c-b6b0-429a-96e7-c5a1b65bd6d8 tempest-AggregatesAdminNegativeTestJSON-1326539754 tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin] Request method failure captured: Sep 14 08:48:16.892852 n-d-836830-18 devstack@n-api.service[128758]: request: POST /compute/v2.1/os-aggregates/4/action HTTP/1.1 Sep 14 08:48:16.892852 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 08:48:16.892852 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 08:48:16.892852 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 08:48:16.892852 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 58 Sep 14 08:48:16.892852 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 08:48:16.892852 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 08:48:16.892852 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 08:48:16.892852 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 08:48:16.892852 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZVLmJ15KWpFzwjBk89mbkB4PfDNCzydgt68AeYqIMFil0sHzz7mUG2-TKeV_gXm_nnH_yPYhyWGcM4Cw8PvI6ZS_hRqRPaEAvLYHlgIjjWnxMMEh7qOnYV_USVH61vMihtYmSwUuF5ovmHMApqYsssL_HzfV3qjmWGd4yKm2NPPigs Sep 14 08:48:16.892852 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 08:48:16.892852 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 08:48:16.892852 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 08:48:16.892852 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 08:48:16.892852 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 08:48:16.892852 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 08:48:16.892852 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: eb497d14a0394c9486c4682b72a08767 Sep 14 08:48:16.892852 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1326539754 Sep 14 08:48:16.892852 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member,admin Sep 14 08:48:16.892852 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member,admin Sep 14 08:48:16.894256 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/eb497d14a0394c9486c4682b72a08767"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_eb497d14a0394c9486c4682b72a08767"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/eb497d14a0394c9486c4682b72a08767"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/eb497d14a0394c9486c4682b72a08767"}]}] Sep 14 08:48:16.894256 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1326539754 Sep 14 08:48:16.894256 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: eb497d14a0394c9486c4682b72a08767 Sep 14 08:48:16.894256 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1326539754 Sep 14 08:48:16.894256 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin Sep 14 08:48:16.894256 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 08:48:16.894256 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 08:48:16.894256 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 4452ad4c9bf2454f833c2a552ab32b8c Sep 14 08:48:16.894256 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin Sep 14 08:48:16.894256 n-d-836830-18 devstack@n-api.service[128758]: Sep 14 08:48:16.894256 n-d-836830-18 devstack@n-api.service[128758]: {"add_host": {"host": "tempest-nonexist_host-1633306007"}} Sep 14 08:48:16.894256 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 08:48:16.895203 n-d-836830-18 devstack@n-api.service[128758]: exception: Compute host tempest-nonexist_host-1633306007 could not be found. Sep 14 08:48:16.895203 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': '4', 'body': {'add_host': {'host': 'tempest-nonexist_host-1633306007'}}} Sep 14 08:48:16.895203 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:48:16.895203 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:16.895203 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Sep 14 08:48:16.895203 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Sep 14 08:48:16.895203 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 14 08:48:16.895203 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 14 08:48:16.895203 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 14 08:48:16.895203 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 14 08:48:16.895203 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 14 08:48:16.895203 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 14 08:48:16.895203 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 14 08:48:16.895203 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 14 08:48:16.895203 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-1633306007' is not mapped to any cell Sep 14 08:48:16.895203 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:16.895203 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:48:16.895203 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:16.895203 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:16.895203 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Sep 14 08:48:16.896443 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Sep 14 08:48:16.896443 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Sep 14 08:48:16.896443 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Sep 14 08:48:16.896443 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Sep 14 08:48:16.896443 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:16.896443 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:48:16.896443 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:16.896443 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:16.896443 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Sep 14 08:48:16.896443 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Sep 14 08:48:16.896443 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 14 08:48:16.896443 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 14 08:48:16.896443 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 14 08:48:16.896443 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 14 08:48:16.896443 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 14 08:48:16.896443 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise self.value Sep 14 08:48:16.896443 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 14 08:48:16.896443 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 14 08:48:16.896443 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6621, in add_host_to_aggregate Sep 14 08:48:16.896443 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Sep 14 08:48:16.897725 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Sep 14 08:48:16.897725 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Sep 14 08:48:16.897725 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-1633306007 could not be found. Sep 14 08:48:16.897725 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:16.897725 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:48:16.897725 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:16.897725 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:16.897725 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:48:16.897725 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:48:16.897725 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:48:16.897725 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:48:16.897725 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:48:16.897725 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:48:16.897725 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 08:48:16.897725 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 08:48:16.897725 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Sep 14 08:48:16.897725 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 08:48:16.897725 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-1633306007 could not be found. Sep 14 08:48:16.897725 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:16.897725 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:48:16.897725 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:16.899179 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:16.899179 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:48:16.899179 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:48:16.899179 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:48:16.899179 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:48:16.899179 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-1633306007 could not be found. Sep 14 08:48:16.899179 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:16.899179 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-7d4a6d1c-b6b0-429a-96e7-c5a1b65bd6d8 tempest-AggregatesAdminNegativeTestJSON-1326539754 tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-1633306007 could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:48:16.899179 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-7d4a6d1c-b6b0-429a-96e7-c5a1b65bd6d8 tempest-AggregatesAdminNegativeTestJSON-1326539754 tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates/4/action" status: 404 len: 111 microversion: 2.1 time: 0.070180 Sep 14 08:48:16.899179 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 22/62] 10.222.0.60 () {60 vars in 1191 bytes} [Wed Sep 14 08:48:16 2022] POST /compute/v2.1/os-aggregates/4/action => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 08:48:16.901428 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-41fffaf6-3e0d-40ef-9e3c-416bcf49aa0e tempest-FlavorsAccessNegativeTestJSON-1040633479 tempest-FlavorsAccessNegativeTestJSON-1040633479-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1805505028", "id": 909126071, "os-flavor-access:is_public": "False"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:48:16.934725 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-41fffaf6-3e0d-40ef-9e3c-416bcf49aa0e tempest-FlavorsAccessNegativeTestJSON-1040633479 tempest-FlavorsAccessNegativeTestJSON-1040633479-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.048597 Sep 14 08:48:16.935668 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 41/63] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 08:48:16 2022] POST /compute/v2.1/flavors => generated 436 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:48:16.940370 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-10ca125d-08f0-4ea4-889c-9a54e93b7700 tempest-FlavorsAdminTestJSON-1934103607 tempest-FlavorsAdminTestJSON-1934103607-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:16.963325 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-10ca125d-08f0-4ea4-889c-9a54e93b7700 tempest-FlavorsAdminTestJSON-1934103607 tempest-FlavorsAdminTestJSON-1934103607-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.026242 Sep 14 08:48:16.963924 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 42/64] 10.222.0.60 () {58 vars in 1146 bytes} [Wed Sep 14 08:48:16 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:48:17.080874 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-11b0232f-ede3-4c0b-9f02-58a162d54334 tempest-FlavorMetadataValidation-865748206 tempest-FlavorMetadataValidation-865748206-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-61841535", "id": 1445437877, "os-flavor-access:is_public": "True"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:48:17.081051 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-40856222-0384-49af-82df-c97453db4789 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-186009029", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "availability_zone": "tempest-test_az-1719479966"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:48:17.107878 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-40856222-0384-49af-82df-c97453db4789 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:17.108389 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-40856222-0384-49af-82df-c97453db4789 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:17.108897 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-40856222-0384-49af-82df-c97453db4789 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:17.109889 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-40856222-0384-49af-82df-c97453db4789 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:17.110360 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-40856222-0384-49af-82df-c97453db4789 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:17.110797 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-40856222-0384-49af-82df-c97453db4789 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:17.117356 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-11b0232f-ede3-4c0b-9f02-58a162d54334 tempest-FlavorMetadataValidation-865748206 tempest-FlavorMetadataValidation-865748206-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 469 microversion: 2.86 time: 0.212897 Sep 14 08:48:17.119619 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 23/65] 10.222.0.60 () {62 vars in 1188 bytes} [Wed Sep 14 08:48:16 2022] POST /compute/v2.1/flavors => generated 469 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 08:48:17.124960 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-995b910a-028e-4bc9-a2c1-93e07d899d91 tempest-HostsAdminNegativeTestJSON-1935444004 tempest-HostsAdminNegativeTestJSON-1935444004-project-admin] Action: 'update', calling method: .version_select at 0x7f7d45296a60>, body: {"status": null, "maintenance_mode": null} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:48:17.129931 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-995b910a-028e-4bc9-a2c1-93e07d899d91 tempest-HostsAdminNegativeTestJSON-1935444004 tempest-HostsAdminNegativeTestJSON-1935444004-project-admin] Request method failure captured: Sep 14 08:48:17.129931 n-d-836830-18 devstack@n-api.service[128758]: request: PUT /compute/v2.1/os-hosts/n-d-836830-18 HTTP/1.1 Sep 14 08:48:17.129931 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 08:48:17.129931 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 08:48:17.129931 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 08:48:17.129931 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 42 Sep 14 08:48:17.129931 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 08:48:17.129931 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 08:48:17.129931 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 08:48:17.129931 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 08:48:17.129931 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZVLljBmIMa4Eww4xCZzWOvGk9e0hrPR1kvI-Lh-4gQsGto0ZQjgq1u4sIRhD__cihmqjiitES8cLTpNiyCTZ-klVMugmw0VSDR5C1fOrEntTxY7ZFOad_8MyKz5qc8uhSpX6WymDehyUATJsVMTf8DTmSfYjIZi1vZ1r30af7hwQyQ Sep 14 08:48:17.129931 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 08:48:17.129931 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 08:48:17.129931 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 08:48:17.129931 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 08:48:17.129931 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 08:48:17.129931 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 08:48:17.129931 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 1745b16e33f84d1c9e1808b0a1326d96 Sep 14 08:48:17.129931 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1935444004 Sep 14 08:48:17.129931 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member,admin Sep 14 08:48:17.129931 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member,admin Sep 14 08:48:17.131080 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/1745b16e33f84d1c9e1808b0a1326d96"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_1745b16e33f84d1c9e1808b0a1326d96"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1745b16e33f84d1c9e1808b0a1326d96"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1745b16e33f84d1c9e1808b0a1326d96"}]}] Sep 14 08:48:17.131080 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1935444004 Sep 14 08:48:17.131080 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 1745b16e33f84d1c9e1808b0a1326d96 Sep 14 08:48:17.131080 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1935444004 Sep 14 08:48:17.131080 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-HostsAdminNegativeTestJSON-1935444004-project-admin Sep 14 08:48:17.131080 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 08:48:17.131080 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 08:48:17.131080 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 82639c95eff344e5bca7b0db9d410166 Sep 14 08:48:17.131080 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1935444004-project-admin Sep 14 08:48:17.131080 n-d-836830-18 devstack@n-api.service[128758]: Sep 14 08:48:17.131080 n-d-836830-18 devstack@n-api.service[128758]: {"status": null, "maintenance_mode": null} Sep 14 08:48:17.131080 n-d-836830-18 devstack@n-api.service[128758]: method: Sep 14 08:48:17.131080 n-d-836830-18 devstack@n-api.service[128758]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Sep 14 08:48:17.131080 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': 'n-d-836830-18', 'body': {'status': None, 'maintenance_mode': None}} Sep 14 08:48:17.131951 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:48:17.131951 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:17.131951 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 14 08:48:17.131951 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 14 08:48:17.131951 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 14 08:48:17.131951 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise error Sep 14 08:48:17.131951 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Sep 14 08:48:17.131951 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:17.131951 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Sep 14 08:48:17.131951 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Sep 14 08:48:17.131951 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi 'disable', Sep 14 08:48:17.131951 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi 'Enable', Sep 14 08:48:17.131951 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi 'Disable', Sep 14 08:48:17.131951 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi 'ENABLE', Sep 14 08:48:17.131951 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi 'DISABLE'], Sep 14 08:48:17.131951 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi 'type': 'string'} Sep 14 08:48:17.131951 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:17.131951 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi On instance: Sep 14 08:48:17.131951 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi None Sep 14 08:48:17.131951 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:17.131951 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:48:17.131951 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:17.131951 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:17.131951 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:48:17.131951 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:48:17.133490 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:48:17.133490 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:48:17.133490 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 08:48:17.133490 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 08:48:17.133490 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:48:17.133490 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:48:17.133490 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 14 08:48:17.133490 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 14 08:48:17.133490 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 14 08:48:17.133490 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 14 08:48:17.133490 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 14 08:48:17.133490 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 14 08:48:17.133490 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Sep 14 08:48:17.133490 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:17.133490 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:48:17.133490 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:17.133490 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:17.133490 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:48:17.133490 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:48:17.134638 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 14 08:48:17.134638 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 14 08:48:17.134638 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Sep 14 08:48:17.134638 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:17.134638 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-995b910a-028e-4bc9-a2c1-93e07d899d91 tempest-HostsAdminNegativeTestJSON-1935444004 tempest-HostsAdminNegativeTestJSON-1935444004-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:48:17.134638 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-995b910a-028e-4bc9-a2c1-93e07d899d91 tempest-HostsAdminNegativeTestJSON-1935444004 tempest-HostsAdminNegativeTestJSON-1935444004-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-hosts/n-d-836830-18" status: 400 len: 127 microversion: 2.1 time: 0.013614 Sep 14 08:48:17.137501 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 24/66] 10.222.0.60 () {60 vars in 1190 bytes} [Wed Sep 14 08:48:17 2022] PUT /compute/v2.1/os-hosts/n-d-836830-18 => generated 127 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 14 08:48:17.143403 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-31b356c2-819e-4fbd-a6f1-60cbfaf54e3c tempest-AggregatesAdminNegativeTestJSON-1326539754 tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:17.159146 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=9,nova_api:DELETE=8 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:48:17.182523 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-31b356c2-819e-4fbd-a6f1-60cbfaf54e3c tempest-AggregatesAdminNegativeTestJSON-1326539754 tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.045117 Sep 14 08:48:17.183658 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 25/67] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Sep 14 08:48:17 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 14 08:48:17.227162 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.network.neutron [None req-40856222-0384-49af-82df-c97453db4789 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] validate_networks() for None {{(pid=128759) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 08:48:17.355433 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-3699af8b-78d2-42c8-94b4-88fd850a7a5a tempest-FlavorsAccessNegativeTestJSON-1654170619 tempest-FlavorsAccessNegativeTestJSON-1654170619-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "31dc6190eea241a08561f32d6989370a"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:48:17.360188 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-3699af8b-78d2-42c8-94b4-88fd850a7a5a tempest-FlavorsAccessNegativeTestJSON-1654170619 tempest-FlavorsAccessNegativeTestJSON-1654170619-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': '1423b88301e24c69b6afaae4730c61ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dc6190eea241a08561f32d6989370a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:48:17.361797 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-3699af8b-78d2-42c8-94b4-88fd850a7a5a tempest-FlavorsAccessNegativeTestJSON-1654170619 tempest-FlavorsAccessNegativeTestJSON-1654170619-project] Request method failure captured: Sep 14 08:48:17.361797 n-d-836830-18 devstack@n-api.service[128758]: request: POST /compute/v2.1/flavors/909126071/action HTTP/1.1 Sep 14 08:48:17.361797 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 08:48:17.361797 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 08:48:17.361797 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 08:48:17.361797 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 67 Sep 14 08:48:17.361797 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 08:48:17.361797 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 08:48:17.361797 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 08:48:17.361797 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 08:48:17.361797 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZVIz0F7PrcAFmWT5lOLtJXDd_x9Bas6zo3BLWMzPaGq3vQW8LWaMDnYbWA4EAQZ1gPDiI0_7sof4GF1pqTcO5QHSBLHNX9WiYo_WGQkhHfhJNILaMhU2NCZj99qm5_Y9pZy-3JjgZosdoV5KhqDUD6BzlFJ2x-PQvqyeHfSSzEuUZ4 Sep 14 08:48:17.361797 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 08:48:17.361797 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 08:48:17.361797 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 08:48:17.361797 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 08:48:17.361797 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 08:48:17.361797 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 08:48:17.361797 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 31dc6190eea241a08561f32d6989370a Sep 14 08:48:17.361797 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1654170619 Sep 14 08:48:17.361797 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 08:48:17.361797 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 08:48:17.363115 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/31dc6190eea241a08561f32d6989370a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_31dc6190eea241a08561f32d6989370a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/31dc6190eea241a08561f32d6989370a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/31dc6190eea241a08561f32d6989370a"}]}] Sep 14 08:48:17.363115 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1654170619 Sep 14 08:48:17.363115 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 31dc6190eea241a08561f32d6989370a Sep 14 08:48:17.363115 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1654170619 Sep 14 08:48:17.363115 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-FlavorsAccessNegativeTestJSON-1654170619-project Sep 14 08:48:17.363115 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 08:48:17.363115 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 08:48:17.363115 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 1423b88301e24c69b6afaae4730c61ef Sep 14 08:48:17.363115 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1654170619-project Sep 14 08:48:17.363115 n-d-836830-18 devstack@n-api.service[128758]: Sep 14 08:48:17.363115 n-d-836830-18 devstack@n-api.service[128758]: {"addTenantAccess": {"tenant": "31dc6190eea241a08561f32d6989370a"}} Sep 14 08:48:17.363115 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 08:48:17.363916 n-d-836830-18 devstack@n-api.service[128758]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Sep 14 08:48:17.363916 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': '909126071', 'body': {'addTenantAccess': {'tenant': '31dc6190eea241a08561f32d6989370a'}}} Sep 14 08:48:17.363916 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:48:17.363916 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:17.363916 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:48:17.363916 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:48:17.363916 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:48:17.363916 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:48:17.363916 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:48:17.363916 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:48:17.363916 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 08:48:17.363916 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 08:48:17.363916 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Sep 14 08:48:17.363916 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Sep 14 08:48:17.363916 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 14 08:48:17.363916 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 14 08:48:17.363916 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 14 08:48:17.363916 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 14 08:48:17.363916 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 14 08:48:17.365517 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 14 08:48:17.365517 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 14 08:48:17.365517 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise self.value Sep 14 08:48:17.365517 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 14 08:48:17.365517 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 14 08:48:17.365517 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 14 08:48:17.365517 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 14 08:48:17.365517 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 14 08:48:17.365517 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 14 08:48:17.365517 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Sep 14 08:48:17.365517 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:17.365517 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:48:17.365517 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:17.365517 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:17.365517 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:48:17.365517 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:48:17.365517 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 14 08:48:17.365517 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 14 08:48:17.365517 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Sep 14 08:48:17.365517 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:17.366742 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-3699af8b-78d2-42c8-94b4-88fd850a7a5a tempest-FlavorsAccessNegativeTestJSON-1654170619 tempest-FlavorsAccessNegativeTestJSON-1654170619-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:48:17.376083 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-3699af8b-78d2-42c8-94b4-88fd850a7a5a tempest-FlavorsAccessNegativeTestJSON-1654170619 tempest-FlavorsAccessNegativeTestJSON-1654170619-project] 10.222.0.60 "POST /compute/v2.1/flavors/909126071/action" status: 403 len: 130 microversion: 2.1 time: 0.191113 Sep 14 08:48:17.377583 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 26/68] 10.222.0.60 () {60 vars in 1197 bytes} [Wed Sep 14 08:48:17 2022] POST /compute/v2.1/flavors/909126071/action => generated 130 bytes in 193 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 14 08:48:17.384400 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-6bcb3b15-7b0f-49d3-813c-e512c62fb4db tempest-FlavorsAdminTestJSON-1934103607 tempest-FlavorsAdminTestJSON-1934103607-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1649927534", "id": "550b237b-4aad-4255-8ba7-5c98bd01be74", "os-flavor-access:is_public": "True"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:48:17.408779 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-6bcb3b15-7b0f-49d3-813c-e512c62fb4db tempest-FlavorsAdminTestJSON-1934103607 tempest-FlavorsAdminTestJSON-1934103607-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.028744 Sep 14 08:48:17.409954 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 27/69] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 08:48:17 2022] POST /compute/v2.1/flavors => generated 507 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:48:17.415007 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-3f52ffa7-4042-4e38-8515-e5ccd72e73aa tempest-FlavorMetadataValidation-865748206 tempest-FlavorMetadataValidation-865748206-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:48:17.481229 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-40856222-0384-49af-82df-c97453db4789 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Flavor limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 08:48:17.482016 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-40856222-0384-49af-82df-c97453db4789 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Image limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 08:48:17.482520 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-40856222-0384-49af-82df-c97453db4789 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Flavor pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 08:48:17.484297 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-40856222-0384-49af-82df-c97453db4789 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Image pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 08:48:17.484781 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-40856222-0384-49af-82df-c97453db4789 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 08:48:17.501343 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-40856222-0384-49af-82df-c97453db4789 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:17.502169 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-40856222-0384-49af-82df-c97453db4789 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:17.502725 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-40856222-0384-49af-82df-c97453db4789 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:17.503713 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-40856222-0384-49af-82df-c97453db4789 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:17.504213 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-40856222-0384-49af-82df-c97453db4789 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:17.504735 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-40856222-0384-49af-82df-c97453db4789 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:17.548211 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-40856222-0384-49af-82df-c97453db4789 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Getting quotas for project 2d1553889c474f75bd545166eff212b1. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 08:48:17.564486 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-40856222-0384-49af-82df-c97453db4789 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Getting quotas for user 3326618ebc864ba58c6df2c471c0f978 and project 2d1553889c474f75bd545166eff212b1. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 08:48:17.595538 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-40856222-0384-49af-82df-c97453db4789 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Going to run 1 instances... {{(pid=128759) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 08:48:17.600403 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-40856222-0384-49af-82df-c97453db4789 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] [instance: ef72dfda-b1e4-49c6-8830-33d25f6a4ec0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128759) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 08:48:17.627049 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-3f52ffa7-4042-4e38-8515-e5ccd72e73aa tempest-FlavorMetadataValidation-865748206 tempest-FlavorMetadataValidation-865748206-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors/1445437877/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.215748 Sep 14 08:48:17.627975 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 28/70] 10.222.0.60 () {62 vars in 1265 bytes} [Wed Sep 14 08:48:17 2022] POST /compute/v2.1/flavors/1445437877/os-extra_specs => generated 62 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:48:17.640824 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-7a230789-f207-4c2b-8f7a-38f9239de90a tempest-HostsAdminNegativeTestJSON-1935444004 tempest-HostsAdminNegativeTestJSON-1935444004-project-admin] Action: 'update', calling method: .version_select at 0x7f7d45221ee0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:48:17.645128 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.hosts [None req-7a230789-f207-4c2b-8f7a-38f9239de90a tempest-HostsAdminNegativeTestJSON-1935444004 tempest-HostsAdminNegativeTestJSON-1935444004-project-admin] Enabling host nonexistent_hostname. Sep 14 08:48:17.655310 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-7a230789-f207-4c2b-8f7a-38f9239de90a tempest-HostsAdminNegativeTestJSON-1935444004 tempest-HostsAdminNegativeTestJSON-1935444004-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Sep 14 08:48:17.657127 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-7a230789-f207-4c2b-8f7a-38f9239de90a tempest-HostsAdminNegativeTestJSON-1935444004 tempest-HostsAdminNegativeTestJSON-1935444004-project-admin] Request method failure captured: Sep 14 08:48:17.657127 n-d-836830-18 devstack@n-api.service[128758]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Sep 14 08:48:17.657127 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 08:48:17.657127 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 08:48:17.657127 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 08:48:17.657127 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 50 Sep 14 08:48:17.657127 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 08:48:17.657127 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 08:48:17.657127 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 08:48:17.657127 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 08:48:17.657127 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZVLljBmIMa4Eww4xCZzWOvGk9e0hrPR1kvI-Lh-4gQsGto0ZQjgq1u4sIRhD__cihmqjiitES8cLTpNiyCTZ-klVMugmw0VSDR5C1fOrEntTxY7ZFOad_8MyKz5qc8uhSpX6WymDehyUATJsVMTf8DTmSfYjIZi1vZ1r30af7hwQyQ Sep 14 08:48:17.657127 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 08:48:17.657127 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 08:48:17.657127 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 08:48:17.657127 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 08:48:17.657127 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 08:48:17.657127 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 08:48:17.657127 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 1745b16e33f84d1c9e1808b0a1326d96 Sep 14 08:48:17.657127 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1935444004 Sep 14 08:48:17.657127 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member,admin Sep 14 08:48:17.657127 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member,admin Sep 14 08:48:17.659791 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/1745b16e33f84d1c9e1808b0a1326d96"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_1745b16e33f84d1c9e1808b0a1326d96"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1745b16e33f84d1c9e1808b0a1326d96"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1745b16e33f84d1c9e1808b0a1326d96"}]}] Sep 14 08:48:17.659791 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1935444004 Sep 14 08:48:17.659791 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 1745b16e33f84d1c9e1808b0a1326d96 Sep 14 08:48:17.659791 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1935444004 Sep 14 08:48:17.659791 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-HostsAdminNegativeTestJSON-1935444004-project-admin Sep 14 08:48:17.659791 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 08:48:17.659791 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 08:48:17.659791 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 82639c95eff344e5bca7b0db9d410166 Sep 14 08:48:17.659791 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1935444004-project-admin Sep 14 08:48:17.659791 n-d-836830-18 devstack@n-api.service[128758]: Sep 14 08:48:17.659791 n-d-836830-18 devstack@n-api.service[128758]: {"status": "enable", "maintenance_mode": "enable"} Sep 14 08:48:17.659791 n-d-836830-18 devstack@n-api.service[128758]: method: Sep 14 08:48:17.659791 n-d-836830-18 devstack@n-api.service[128758]: exception: Host 'nonexistent_hostname' is not mapped to any cell Sep 14 08:48:17.659791 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Sep 14 08:48:17.660968 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:48:17.660968 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:17.660968 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Sep 14 08:48:17.660968 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Sep 14 08:48:17.660968 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 14 08:48:17.660968 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 14 08:48:17.660968 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 14 08:48:17.660968 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 14 08:48:17.660968 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 14 08:48:17.660968 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise self.value Sep 14 08:48:17.660968 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 14 08:48:17.660968 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 14 08:48:17.660968 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Sep 14 08:48:17.660968 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Sep 14 08:48:17.660968 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 14 08:48:17.660968 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 14 08:48:17.660968 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 14 08:48:17.660968 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 14 08:48:17.662135 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 14 08:48:17.662135 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 14 08:48:17.662135 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 14 08:48:17.662135 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 14 08:48:17.662135 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 14 08:48:17.662135 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:17.662135 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:48:17.662135 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:17.662135 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:17.662135 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:48:17.662135 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:48:17.662135 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:48:17.662135 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:48:17.662135 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 08:48:17.662135 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 08:48:17.662135 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:48:17.662135 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:48:17.662135 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 08:48:17.662135 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 08:48:17.662135 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Sep 14 08:48:17.668508 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Sep 14 08:48:17.668508 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Sep 14 08:48:17.668508 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 14 08:48:17.668508 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 14 08:48:17.668508 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:17.668508 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:48:17.668508 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:17.668508 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:17.668508 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:48:17.668508 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:48:17.668508 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:48:17.668508 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:48:17.668508 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Sep 14 08:48:17.668508 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:17.668508 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-7a230789-f207-4c2b-8f7a-38f9239de90a tempest-HostsAdminNegativeTestJSON-1935444004 tempest-HostsAdminNegativeTestJSON-1935444004-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:48:17.669592 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-7a230789-f207-4c2b-8f7a-38f9239de90a tempest-HostsAdminNegativeTestJSON-1935444004 tempest-HostsAdminNegativeTestJSON-1935444004-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.022488 Sep 14 08:48:17.669592 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 29/71] 10.222.0.60 () {60 vars in 1211 bytes} [Wed Sep 14 08:48:17 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 14 08:48:17.669592 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-7912513e-307b-455f-9811-f1bc055d57a6 tempest-AggregatesAdminNegativeTestJSON-1326539754 tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:48:17.671781 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-7912513e-307b-455f-9811-f1bc055d57a6 tempest-AggregatesAdminNegativeTestJSON-1326539754 tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin] Request method failure captured: Sep 14 08:48:17.671781 n-d-836830-18 devstack@n-api.service[128758]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Sep 14 08:48:17.671781 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 08:48:17.671781 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 08:48:17.671781 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 08:48:17.671781 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 283 Sep 14 08:48:17.671781 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 08:48:17.671781 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 08:48:17.671781 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 08:48:17.671781 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 08:48:17.671781 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZVLmJ15KWpFzwjBk89mbkB4PfDNCzydgt68AeYqIMFil0sHzz7mUG2-TKeV_gXm_nnH_yPYhyWGcM4Cw8PvI6ZS_hRqRPaEAvLYHlgIjjWnxMMEh7qOnYV_USVH61vMihtYmSwUuF5ovmHMApqYsssL_HzfV3qjmWGd4yKm2NPPigs Sep 14 08:48:17.671781 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 08:48:17.671781 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 08:48:17.671781 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 08:48:17.671781 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 08:48:17.671781 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 08:48:17.671781 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 08:48:17.671781 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: eb497d14a0394c9486c4682b72a08767 Sep 14 08:48:17.671781 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1326539754 Sep 14 08:48:17.671781 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member,admin Sep 14 08:48:17.671781 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member,admin Sep 14 08:48:17.673877 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/eb497d14a0394c9486c4682b72a08767"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_eb497d14a0394c9486c4682b72a08767"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/eb497d14a0394c9486c4682b72a08767"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/eb497d14a0394c9486c4682b72a08767"}]}] Sep 14 08:48:17.673877 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1326539754 Sep 14 08:48:17.673877 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: eb497d14a0394c9486c4682b72a08767 Sep 14 08:48:17.673877 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1326539754 Sep 14 08:48:17.673877 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin Sep 14 08:48:17.673877 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 08:48:17.673877 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 08:48:17.673877 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 4452ad4c9bf2454f833c2a552ab32b8c Sep 14 08:48:17.673877 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin Sep 14 08:48:17.673877 n-d-836830-18 devstack@n-api.service[128758]: Sep 14 08:48:17.674611 n-d-836830-18 devstack@n-api.service[128758]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Sep 14 08:48:17.674611 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 08:48:17.674611 n-d-836830-18 devstack@n-api.service[128758]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 14 08:48:17.674611 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Sep 14 08:48:17.674611 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:48:17.674611 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:17.674611 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 14 08:48:17.674611 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 14 08:48:17.674611 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 14 08:48:17.674611 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise error Sep 14 08:48:17.675651 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 14 08:48:17.675651 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:17.675651 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Sep 14 08:48:17.675651 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 14 08:48:17.675651 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:17.675651 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Sep 14 08:48:17.675651 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Sep 14 08:48:17.675651 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:17.675651 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:48:17.675651 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:17.675651 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:17.675651 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:48:17.675651 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:48:17.675651 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:48:17.675651 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:48:17.675651 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:48:17.675651 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:48:17.677061 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 08:48:17.677061 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 08:48:17.677061 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 14 08:48:17.677061 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 14 08:48:17.677061 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 14 08:48:17.677061 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 14 08:48:17.677061 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 14 08:48:17.677061 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 14 08:48:17.677061 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 14 08:48:17.677061 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:17.677061 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:48:17.677061 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:17.677061 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:17.677061 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:48:17.677061 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:48:17.678032 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 14 08:48:17.678032 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 14 08:48:17.678032 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 14 08:48:17.678032 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:17.678032 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-7912513e-307b-455f-9811-f1bc055d57a6 tempest-AggregatesAdminNegativeTestJSON-1326539754 tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:48:17.678389 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-7912513e-307b-455f-9811-f1bc055d57a6 tempest-AggregatesAdminNegativeTestJSON-1326539754 tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.012708 Sep 14 08:48:17.684158 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-40856222-0384-49af-82df-c97453db4789 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.718847 Sep 14 08:48:17.685497 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 43/72] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 08:48:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 720 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 08:48:17.689778 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-57715baa-a00c-44b9-afea-d011736b5381 tempest-FlavorsAccessNegativeTestJSON-1040633479 tempest-FlavorsAccessNegativeTestJSON-1040633479-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:17.694271 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 30/73] 10.222.0.60 () {60 vars in 1165 bytes} [Wed Sep 14 08:48:17 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 14 08:48:17.708347 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ac222e73-74b1-4fb9-aa06-29f189f60bf7 tempest-FlavorsAdminTestJSON-1934103607 tempest-FlavorsAdminTestJSON-1934103607-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:17.727624 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-57715baa-a00c-44b9-afea-d011736b5381 tempest-FlavorsAccessNegativeTestJSON-1040633479 tempest-FlavorsAccessNegativeTestJSON-1040633479-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/909126071" status: 202 len: 0 microversion: 2.1 time: 0.041627 Sep 14 08:48:17.736326 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 44/74] 10.222.0.60 () {58 vars in 1158 bytes} [Wed Sep 14 08:48:17 2022] DELETE /compute/v2.1/flavors/909126071 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 08:48:17.741617 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-5bdb237f-bb6b-40d3-badd-63953e8f753b tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:17.742283 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-5bdb237f-bb6b-40d3-badd-63953e8f753b tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] [instance: 7045fd2e-8224-46b8-b477-57a46e18e93f] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:48:17.743098 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-ac222e73-74b1-4fb9-aa06-29f189f60bf7 tempest-FlavorsAdminTestJSON-1934103607 tempest-FlavorsAdminTestJSON-1934103607-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/550b237b-4aad-4255-8ba7-5c98bd01be74" status: 202 len: 0 microversion: 2.1 time: 0.047775 Sep 14 08:48:17.750409 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 31/75] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 08:48:17 2022] DELETE /compute/v2.1/flavors/550b237b-4aad-4255-8ba7-5c98bd01be74 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 08:48:17.752116 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5bdb237f-bb6b-40d3-badd-63953e8f753b tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:17.752743 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5bdb237f-bb6b-40d3-badd-63953e8f753b tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:17.759282 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5bdb237f-bb6b-40d3-badd-63953e8f753b tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:17.760606 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5bdb237f-bb6b-40d3-badd-63953e8f753b tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:17.763577 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5bdb237f-bb6b-40d3-badd-63953e8f753b tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:17.764791 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5bdb237f-bb6b-40d3-badd-63953e8f753b tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:17.766803 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-cce8cec9-7c1c-43c7-a872-63834d1691c1 tempest-FlavorMetadataValidation-865748206 tempest-FlavorMetadataValidation-865748206-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:17.799217 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-cce8cec9-7c1c-43c7-a872-63834d1691c1 tempest-FlavorMetadataValidation-865748206 tempest-FlavorMetadataValidation-865748206-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/1445437877" status: 202 len: 0 microversion: 2.86 time: 0.045619 Sep 14 08:48:17.800479 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 32/76] 10.222.0.60 () {60 vars in 1202 bytes} [Wed Sep 14 08:48:17 2022] DELETE /compute/v2.1/flavors/1445437877 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 14 08:48:17.805866 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-3e060e49-18cf-45d8-a6da-e2ce87f3bca9 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:17.806982 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-3e060e49-18cf-45d8-a6da-e2ce87f3bca9 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] [instance: ef72dfda-b1e4-49c6-8830-33d25f6a4ec0] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:48:17.881587 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-3e060e49-18cf-45d8-a6da-e2ce87f3bca9 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326618ebc864ba58c6df2c471c0f978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d1553889c474f75bd545166eff212b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:48:17.907823 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-3e060e49-18cf-45d8-a6da-e2ce87f3bca9 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] 10.222.0.60 "GET /compute/v2.1/servers/ef72dfda-b1e4-49c6-8830-33d25f6a4ec0" status: 200 len: 1242 microversion: 2.1 time: 0.105926 Sep 14 08:48:17.919067 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 33/77] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:48:17 2022] GET /compute/v2.1/servers/ef72dfda-b1e4-49c6-8830-33d25f6a4ec0 => generated 1242 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:48:17.926041 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-f37cf17c-8038-43ab-9f94-7c045e9653ce tempest-AggregatesAdminNegativeTestJSON-1326539754 tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:48:17.932482 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-f37cf17c-8038-43ab-9f94-7c045e9653ce tempest-AggregatesAdminNegativeTestJSON-1326539754 tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin] Request method failure captured: Sep 14 08:48:17.932482 n-d-836830-18 devstack@n-api.service[128758]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Sep 14 08:48:17.932482 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 08:48:17.932482 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 08:48:17.932482 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 08:48:17.932482 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 27 Sep 14 08:48:17.932482 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 08:48:17.932482 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 08:48:17.932482 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 08:48:17.932482 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 08:48:17.932482 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZVLmJ15KWpFzwjBk89mbkB4PfDNCzydgt68AeYqIMFil0sHzz7mUG2-TKeV_gXm_nnH_yPYhyWGcM4Cw8PvI6ZS_hRqRPaEAvLYHlgIjjWnxMMEh7qOnYV_USVH61vMihtYmSwUuF5ovmHMApqYsssL_HzfV3qjmWGd4yKm2NPPigs Sep 14 08:48:17.932482 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 08:48:17.932482 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 08:48:17.932482 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 08:48:17.932482 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 08:48:17.932482 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 08:48:17.932482 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 08:48:17.932482 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: eb497d14a0394c9486c4682b72a08767 Sep 14 08:48:17.932482 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1326539754 Sep 14 08:48:17.932482 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member,admin Sep 14 08:48:17.932482 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member,admin Sep 14 08:48:17.934064 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/eb497d14a0394c9486c4682b72a08767"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_eb497d14a0394c9486c4682b72a08767"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/eb497d14a0394c9486c4682b72a08767"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/eb497d14a0394c9486c4682b72a08767"}]}] Sep 14 08:48:17.934064 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1326539754 Sep 14 08:48:17.934064 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: eb497d14a0394c9486c4682b72a08767 Sep 14 08:48:17.934064 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1326539754 Sep 14 08:48:17.934064 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin Sep 14 08:48:17.934064 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 08:48:17.934064 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 08:48:17.934064 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 4452ad4c9bf2454f833c2a552ab32b8c Sep 14 08:48:17.934064 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin Sep 14 08:48:17.934064 n-d-836830-18 devstack@n-api.service[128758]: Sep 14 08:48:17.934064 n-d-836830-18 devstack@n-api.service[128758]: {"aggregate": {"name": ""}} Sep 14 08:48:17.934064 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 08:48:17.934064 n-d-836830-18 devstack@n-api.service[128758]: exception: Invalid input for field/attribute name. Value: . '' is too short Sep 14 08:48:17.935037 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'body': {'aggregate': {'name': ''}}} Sep 14 08:48:17.935037 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:48:17.935037 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:17.935037 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 14 08:48:17.935037 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 14 08:48:17.935037 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 14 08:48:17.935037 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise error Sep 14 08:48:17.935037 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Sep 14 08:48:17.935037 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:17.935037 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Sep 14 08:48:17.935037 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 14 08:48:17.935037 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:17.935037 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Sep 14 08:48:17.935037 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi '' Sep 14 08:48:17.935037 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:17.935037 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:48:17.935037 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:17.935037 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:17.935037 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:48:17.935037 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:48:17.935037 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:48:17.935037 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:48:17.935037 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:48:17.936519 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:48:17.936519 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 08:48:17.936519 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 08:48:17.936519 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 14 08:48:17.936519 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 14 08:48:17.936519 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 14 08:48:17.936519 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 14 08:48:17.936519 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 14 08:48:17.936519 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 14 08:48:17.936519 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Sep 14 08:48:17.936519 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:17.936519 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:48:17.936519 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:17.936519 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:17.936519 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:48:17.936519 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:48:17.936519 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 14 08:48:17.936519 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 14 08:48:17.936519 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Sep 14 08:48:17.936519 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:17.939289 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-f37cf17c-8038-43ab-9f94-7c045e9653ce tempest-AggregatesAdminNegativeTestJSON-1326539754 tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:48:17.940613 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-f37cf17c-8038-43ab-9f94-7c045e9653ce tempest-AggregatesAdminNegativeTestJSON-1326539754 tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.030264 Sep 14 08:48:17.942425 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 34/78] 10.222.0.60 () {60 vars in 1164 bytes} [Wed Sep 14 08:48:17 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 14 08:48:17.953086 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-85fef61c-fbf6-49d7-b642-4e5cd2381a4d tempest-FlavorsAccessNegativeTestJSON-1040633479 tempest-FlavorsAccessNegativeTestJSON-1040633479-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:17.990432 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-5bdb237f-bb6b-40d3-badd-63953e8f753b tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e462483415e4c2b8a917b2a032e5ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac4d0cae0bd46fda94d7bfb900a0b9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:48:18.005382 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-5bdb237f-bb6b-40d3-badd-63953e8f753b tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] 10.222.0.60 "GET /compute/v2.1/servers/7045fd2e-8224-46b8-b477-57a46e18e93f" status: 200 len: 1294 microversion: 2.1 time: 0.267937 Sep 14 08:48:18.006074 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 45/79] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:48:17 2022] GET /compute/v2.1/servers/7045fd2e-8224-46b8-b477-57a46e18e93f => generated 1294 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:48:18.014074 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-7ac2c4f4-ac6d-4bfa-8e5a-8d2b22832912 tempest-FlavorsAdminTestJSON-1934103607 tempest-FlavorsAdminTestJSON-1934103607-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:18.039984 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-7ac2c4f4-ac6d-4bfa-8e5a-8d2b22832912 tempest-FlavorsAdminTestJSON-1934103607 tempest-FlavorsAdminTestJSON-1934103607-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.032547 Sep 14 08:48:18.041038 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 46/80] 10.222.0.60 () {58 vars in 1146 bytes} [Wed Sep 14 08:48:18 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:48:18.041738 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-85fef61c-fbf6-49d7-b642-4e5cd2381a4d tempest-FlavorsAccessNegativeTestJSON-1040633479 tempest-FlavorsAccessNegativeTestJSON-1040633479-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.093064 Sep 14 08:48:18.044811 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 35/81] 10.222.0.60 () {58 vars in 1146 bytes} [Wed Sep 14 08:48:17 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:48:18.047809 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ee08972b-d4bd-4b26-8836-4e292586858f tempest-FlavorMetadataValidation-865748206 tempest-FlavorMetadataValidation-865748206-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:18.053736 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-33c48db1-8340-42a1-a647-7d59557f9bf3 tempest-AggregatesAdminNegativeTestJSON-338931773 tempest-AggregatesAdminNegativeTestJSON-338931773-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1442950089"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:48:18.077482 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-ee08972b-d4bd-4b26-8836-4e292586858f tempest-FlavorMetadataValidation-865748206 tempest-FlavorMetadataValidation-865748206-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.86 time: 0.034137 Sep 14 08:48:18.088012 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 47/82] 10.222.0.60 () {60 vars in 1187 bytes} [Wed Sep 14 08:48:18 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:48:18.100835 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-54e3d823-39ea-475f-a4f7-841ee8da0816 tempest-FlavorsAccessNegativeTestJSON-1040633479 tempest-FlavorsAccessNegativeTestJSON-1040633479-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-747316096", "id": 1300076682, "os-flavor-access:is_public": "False"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:48:18.102900 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-33c48db1-8340-42a1-a647-7d59557f9bf3 tempest-AggregatesAdminNegativeTestJSON-338931773 tempest-AggregatesAdminNegativeTestJSON-338931773-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': '57bc4ee1d3ae4513a389cb933904e571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed05e2ea9b444238abc9a9be91397ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:48:18.105700 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-33c48db1-8340-42a1-a647-7d59557f9bf3 tempest-AggregatesAdminNegativeTestJSON-338931773 tempest-AggregatesAdminNegativeTestJSON-338931773-project] Request method failure captured: Sep 14 08:48:18.105700 n-d-836830-18 devstack@n-api.service[128758]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Sep 14 08:48:18.105700 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 08:48:18.105700 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 08:48:18.105700 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 08:48:18.105700 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 60 Sep 14 08:48:18.105700 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 08:48:18.105700 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 08:48:18.105700 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 08:48:18.105700 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 08:48:18.105700 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZVJdW0uLhEkavM7Bp9qDO_pOqoNOa1h0Qp3wGKgWDHTczk4fefancNdrqkwxWcAIxR12spv8mhB9hpKqGel7aj9i3-5mk7YbzPqLTKlvqM81v3Bu1p54q7f8IzHym055xKb4Z4OWTK0y1quegytrHBJSe4m3PY_Y4dVuCratJjoErM Sep 14 08:48:18.105700 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 08:48:18.105700 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 08:48:18.105700 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 08:48:18.105700 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 08:48:18.105700 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 08:48:18.105700 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 08:48:18.105700 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: ed05e2ea9b444238abc9a9be91397ffb Sep 14 08:48:18.105700 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-338931773 Sep 14 08:48:18.105700 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 08:48:18.105700 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 08:48:18.106869 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/ed05e2ea9b444238abc9a9be91397ffb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_ed05e2ea9b444238abc9a9be91397ffb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ed05e2ea9b444238abc9a9be91397ffb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ed05e2ea9b444238abc9a9be91397ffb"}]}] Sep 14 08:48:18.106869 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-338931773 Sep 14 08:48:18.106869 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: ed05e2ea9b444238abc9a9be91397ffb Sep 14 08:48:18.106869 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-338931773 Sep 14 08:48:18.106869 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-AggregatesAdminNegativeTestJSON-338931773-project Sep 14 08:48:18.106869 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 08:48:18.106869 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 08:48:18.106869 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 57bc4ee1d3ae4513a389cb933904e571 Sep 14 08:48:18.106869 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-338931773-project Sep 14 08:48:18.106869 n-d-836830-18 devstack@n-api.service[128758]: Sep 14 08:48:18.106869 n-d-836830-18 devstack@n-api.service[128758]: {"aggregate": {"name": "tempest-test_aggregate-1442950089"}} Sep 14 08:48:18.106869 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 08:48:18.106869 n-d-836830-18 devstack@n-api.service[128758]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Sep 14 08:48:18.108057 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1442950089'}}} Sep 14 08:48:18.108057 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:48:18.108057 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:18.108057 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:48:18.108057 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:48:18.108057 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:48:18.108057 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:48:18.108057 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:48:18.108057 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:48:18.108057 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 08:48:18.108057 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 08:48:18.108057 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 08:48:18.108057 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 08:48:18.108057 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Sep 14 08:48:18.108057 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Sep 14 08:48:18.108057 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 14 08:48:18.108057 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 14 08:48:18.108057 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 14 08:48:18.108057 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 14 08:48:18.109246 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 14 08:48:18.109246 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 14 08:48:18.109246 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 14 08:48:18.109246 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise self.value Sep 14 08:48:18.109246 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 14 08:48:18.109246 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 14 08:48:18.109246 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 14 08:48:18.109246 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 14 08:48:18.109246 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 14 08:48:18.109246 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 14 08:48:18.109246 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Sep 14 08:48:18.109246 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:18.109246 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:48:18.109246 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:18.109246 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:18.109246 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:48:18.109246 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:48:18.109246 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 14 08:48:18.109246 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 14 08:48:18.109246 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Sep 14 08:48:18.110526 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:18.113164 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-33c48db1-8340-42a1-a647-7d59557f9bf3 tempest-AggregatesAdminNegativeTestJSON-338931773 tempest-AggregatesAdminNegativeTestJSON-338931773-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:48:18.115171 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-33c48db1-8340-42a1-a647-7d59557f9bf3 tempest-AggregatesAdminNegativeTestJSON-338931773 tempest-AggregatesAdminNegativeTestJSON-338931773-project] 10.222.0.60 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.068560 Sep 14 08:48:18.116121 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 36/83] 10.222.0.60 () {60 vars in 1164 bytes} [Wed Sep 14 08:48:18 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 71 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 14 08:48:18.122173 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-3fc8c2d6-ce22-4000-91de-b1d565930e56 tempest-FlavorsAdminTestJSON-1934103607 tempest-FlavorsAdminTestJSON-1934103607-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1528707608", "id": 968422187, "os-flavor-access:is_public": "True"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:48:18.151514 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-3fc8c2d6-ce22-4000-91de-b1d565930e56 tempest-FlavorsAdminTestJSON-1934103607 tempest-FlavorsAdminTestJSON-1934103607-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.033581 Sep 14 08:48:18.154104 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 37/84] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 08:48:18 2022] POST /compute/v2.1/flavors => generated 411 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:48:18.162371 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-66165afd-0797-4c4c-95d0-035a1812d0ea tempest-AggregatesAdminNegativeTestJSON-1326539754 tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1102697908"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:48:18.166673 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.objects.aggregate [None req-66165afd-0797-4c4c-95d0-035a1812d0ea tempest-AggregatesAdminNegativeTestJSON-1326539754 tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin] Generated uuid 5d77f99c-e2d8-4ec8-ad15-a9130b191bb7 for aggregate {{(pid=128758) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 14 08:48:18.173946 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-54e3d823-39ea-475f-a4f7-841ee8da0816 tempest-FlavorsAccessNegativeTestJSON-1040633479 tempest-FlavorsAccessNegativeTestJSON-1040633479-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.084599 Sep 14 08:48:18.174557 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 48/85] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 08:48:18 2022] POST /compute/v2.1/flavors => generated 438 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:48:18.187662 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-376ea146-174f-439e-9a6a-a4e0bc6e27d5 tempest-FlavorsAdminTestJSON-1934103607 tempest-FlavorsAdminTestJSON-1934103607-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:18.196160 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-376ea146-174f-439e-9a6a-a4e0bc6e27d5 tempest-FlavorsAdminTestJSON-1934103607 tempest-FlavorsAdminTestJSON-1934103607-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/968422187" status: 200 len: 411 microversion: 2.1 time: 0.015717 Sep 14 08:48:18.196725 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 49/86] 10.222.0.60 () {58 vars in 1155 bytes} [Wed Sep 14 08:48:18 2022] GET /compute/v2.1/flavors/968422187 => generated 411 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:48:18.213447 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-2f43c220-85c2-4159-abec-f24504ba7975 tempest-FlavorsAccessNegativeTestJSON-1040633479 tempest-FlavorsAccessNegativeTestJSON-1040633479-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "31dc6190eea241a08561f32d6989370a"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:48:18.230628 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-66165afd-0797-4c4c-95d0-035a1812d0ea tempest-AggregatesAdminNegativeTestJSON-1326539754 tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.071456 Sep 14 08:48:18.235182 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 38/87] 10.222.0.60 () {60 vars in 1164 bytes} [Wed Sep 14 08:48:18 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:48:18.674161 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d9e894d6-9e72-4738-b036-9cdac7f44b47 tempest-FlavorsAdminTestJSON-442745451 tempest-FlavorsAdminTestJSON-442745451-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:18.769053 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-d9e894d6-9e72-4738-b036-9cdac7f44b47 tempest-FlavorsAdminTestJSON-442745451 tempest-FlavorsAdminTestJSON-442745451-project] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 5392 microversion: 2.1 time: 0.529163 Sep 14 08:48:18.769688 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 39/88] 10.222.0.60 () {58 vars in 1146 bytes} [Wed Sep 14 08:48:18 2022] GET /compute/v2.1/flavors/detail => generated 5392 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:48:18.781529 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c6c7e786-4612-4aef-879a-d91649cfb756 tempest-AggregatesAdminNegativeTestJSON-1326539754 tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1102697908"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:48:18.806761 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.objects.aggregate [None req-c6c7e786-4612-4aef-879a-d91649cfb756 tempest-AggregatesAdminNegativeTestJSON-1326539754 tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin] Generated uuid 66b5fa6a-d202-4e97-837f-e314efdbb545 for aggregate {{(pid=128758) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 14 08:48:18.827865 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-2f43c220-85c2-4159-abec-f24504ba7975 tempest-FlavorsAccessNegativeTestJSON-1040633479 tempest-FlavorsAccessNegativeTestJSON-1040633479-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors/1300076682/action" status: 200 len: 97 microversion: 2.1 time: 0.628559 Sep 14 08:48:18.829585 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-c6c7e786-4612-4aef-879a-d91649cfb756 tempest-AggregatesAdminNegativeTestJSON-1326539754 tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-1102697908 already exists. Sep 14 08:48:18.830328 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 50/89] 10.222.0.60 () {60 vars in 1200 bytes} [Wed Sep 14 08:48:18 2022] POST /compute/v2.1/flavors/1300076682/action => generated 97 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 08:48:18.836419 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-886b9716-80af-4ef1-8c00-f5122ced4435 tempest-FlavorsAdminTestJSON-1934103607 tempest-FlavorsAdminTestJSON-1934103607-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:18.838364 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c6c7e786-4612-4aef-879a-d91649cfb756 tempest-AggregatesAdminNegativeTestJSON-1326539754 tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin] Request method failure captured: Sep 14 08:48:18.838364 n-d-836830-18 devstack@n-api.service[128758]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Sep 14 08:48:18.838364 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 08:48:18.838364 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 08:48:18.838364 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 08:48:18.838364 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 60 Sep 14 08:48:18.838364 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 08:48:18.838364 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 08:48:18.838364 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 08:48:18.838364 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 08:48:18.838364 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZVLmJ15KWpFzwjBk89mbkB4PfDNCzydgt68AeYqIMFil0sHzz7mUG2-TKeV_gXm_nnH_yPYhyWGcM4Cw8PvI6ZS_hRqRPaEAvLYHlgIjjWnxMMEh7qOnYV_USVH61vMihtYmSwUuF5ovmHMApqYsssL_HzfV3qjmWGd4yKm2NPPigs Sep 14 08:48:18.838364 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 08:48:18.838364 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 08:48:18.838364 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 08:48:18.838364 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 08:48:18.838364 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 08:48:18.838364 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 08:48:18.838364 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: eb497d14a0394c9486c4682b72a08767 Sep 14 08:48:18.838364 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1326539754 Sep 14 08:48:18.838364 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member,admin Sep 14 08:48:18.838364 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member,admin Sep 14 08:48:18.839632 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/eb497d14a0394c9486c4682b72a08767"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_eb497d14a0394c9486c4682b72a08767"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/eb497d14a0394c9486c4682b72a08767"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/eb497d14a0394c9486c4682b72a08767"}]}] Sep 14 08:48:18.839632 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1326539754 Sep 14 08:48:18.839632 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: eb497d14a0394c9486c4682b72a08767 Sep 14 08:48:18.839632 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1326539754 Sep 14 08:48:18.839632 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin Sep 14 08:48:18.839632 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 08:48:18.839632 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 08:48:18.839632 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 4452ad4c9bf2454f833c2a552ab32b8c Sep 14 08:48:18.839632 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin Sep 14 08:48:18.839632 n-d-836830-18 devstack@n-api.service[128758]: Sep 14 08:48:18.839632 n-d-836830-18 devstack@n-api.service[128758]: {"aggregate": {"name": "tempest-test_aggregate-1102697908"}} Sep 14 08:48:18.839632 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 08:48:18.839632 n-d-836830-18 devstack@n-api.service[128758]: exception: Aggregate tempest-test_aggregate-1102697908 already exists. Sep 14 08:48:18.840359 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1102697908'}}} Sep 14 08:48:18.840359 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:48:18.840359 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:18.840359 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Sep 14 08:48:18.840359 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Sep 14 08:48:18.840359 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 14 08:48:18.840359 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 14 08:48:18.840359 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 14 08:48:18.840359 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 14 08:48:18.840359 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 14 08:48:18.840359 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise self.value Sep 14 08:48:18.840359 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 14 08:48:18.840359 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 14 08:48:18.840359 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6458, in create_aggregate Sep 14 08:48:18.840359 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi aggregate.create() Sep 14 08:48:18.840359 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 14 08:48:18.840359 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 14 08:48:18.840359 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Sep 14 08:48:18.840359 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Sep 14 08:48:18.841318 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 14 08:48:18.841318 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 14 08:48:18.841318 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Sep 14 08:48:18.841318 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Sep 14 08:48:18.841318 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-1102697908 already exists. Sep 14 08:48:18.841318 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:18.841318 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:48:18.841318 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:18.841318 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:18.841318 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:48:18.841318 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:48:18.841318 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:48:18.841318 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:48:18.841318 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:48:18.841318 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:48:18.841318 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 08:48:18.841318 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 08:48:18.841318 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 08:48:18.841318 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 08:48:18.841318 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Sep 14 08:48:18.843444 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Sep 14 08:48:18.843444 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-1102697908 already exists. Sep 14 08:48:18.843444 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:18.843444 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:48:18.843444 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:18.843444 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:18.843444 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:48:18.843444 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:48:18.843444 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:48:18.843444 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:48:18.843444 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-1102697908 already exists. Sep 14 08:48:18.843444 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:18.844626 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c6c7e786-4612-4aef-879a-d91649cfb756 tempest-AggregatesAdminNegativeTestJSON-1326539754 tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-1102697908 already exists. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:48:18.845344 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-c6c7e786-4612-4aef-879a-d91649cfb756 tempest-AggregatesAdminNegativeTestJSON-1326539754 tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates" status: 409 len: 111 microversion: 2.1 time: 0.068330 Sep 14 08:48:18.850273 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 40/90] 10.222.0.60 () {60 vars in 1164 bytes} [Wed Sep 14 08:48:18 2022] POST /compute/v2.1/os-aggregates => generated 111 bytes in 76 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 14 08:48:18.854857 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-68aba4a1-ac3b-4cc1-8bb4-c02dd3f801d3 tempest-FlavorsAccessNegativeTestJSON-1654170619 tempest-FlavorsAccessNegativeTestJSON-1654170619-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "31dc6190eea241a08561f32d6989370a"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:48:18.869193 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=11,nova_api:DELETE=10 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:48:18.870485 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-68aba4a1-ac3b-4cc1-8bb4-c02dd3f801d3 tempest-FlavorsAccessNegativeTestJSON-1654170619 tempest-FlavorsAccessNegativeTestJSON-1654170619-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': '1423b88301e24c69b6afaae4730c61ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dc6190eea241a08561f32d6989370a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:48:18.877614 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-68aba4a1-ac3b-4cc1-8bb4-c02dd3f801d3 tempest-FlavorsAccessNegativeTestJSON-1654170619 tempest-FlavorsAccessNegativeTestJSON-1654170619-project] Request method failure captured: Sep 14 08:48:18.877614 n-d-836830-18 devstack@n-api.service[128758]: request: POST /compute/v2.1/flavors/1300076682/action HTTP/1.1 Sep 14 08:48:18.877614 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 08:48:18.877614 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 08:48:18.877614 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 08:48:18.877614 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 70 Sep 14 08:48:18.877614 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 08:48:18.877614 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 08:48:18.877614 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 08:48:18.877614 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 08:48:18.877614 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZVIz0F7PrcAFmWT5lOLtJXDd_x9Bas6zo3BLWMzPaGq3vQW8LWaMDnYbWA4EAQZ1gPDiI0_7sof4GF1pqTcO5QHSBLHNX9WiYo_WGQkhHfhJNILaMhU2NCZj99qm5_Y9pZy-3JjgZosdoV5KhqDUD6BzlFJ2x-PQvqyeHfSSzEuUZ4 Sep 14 08:48:18.877614 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 08:48:18.877614 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 08:48:18.877614 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 08:48:18.877614 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 08:48:18.877614 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 08:48:18.877614 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 08:48:18.877614 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 31dc6190eea241a08561f32d6989370a Sep 14 08:48:18.877614 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1654170619 Sep 14 08:48:18.877614 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 08:48:18.877614 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 08:48:18.879043 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/31dc6190eea241a08561f32d6989370a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_31dc6190eea241a08561f32d6989370a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/31dc6190eea241a08561f32d6989370a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/31dc6190eea241a08561f32d6989370a"}]}] Sep 14 08:48:18.879043 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1654170619 Sep 14 08:48:18.879043 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 31dc6190eea241a08561f32d6989370a Sep 14 08:48:18.879043 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1654170619 Sep 14 08:48:18.879043 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-FlavorsAccessNegativeTestJSON-1654170619-project Sep 14 08:48:18.879043 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 08:48:18.879043 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 08:48:18.879043 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 1423b88301e24c69b6afaae4730c61ef Sep 14 08:48:18.879043 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1654170619-project Sep 14 08:48:18.879043 n-d-836830-18 devstack@n-api.service[128758]: Sep 14 08:48:18.879043 n-d-836830-18 devstack@n-api.service[128758]: {"removeTenantAccess": {"tenant": "31dc6190eea241a08561f32d6989370a"}} Sep 14 08:48:18.879043 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 08:48:18.880583 n-d-836830-18 devstack@n-api.service[128758]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Sep 14 08:48:18.880583 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': '1300076682', 'body': {'removeTenantAccess': {'tenant': '31dc6190eea241a08561f32d6989370a'}}} Sep 14 08:48:18.880583 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:48:18.880583 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:18.880583 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:48:18.880583 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:48:18.880583 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:48:18.880583 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:48:18.880583 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:48:18.880583 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:48:18.880583 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 08:48:18.880583 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 08:48:18.880583 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Sep 14 08:48:18.880583 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi context.can( Sep 14 08:48:18.880583 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 14 08:48:18.880583 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 14 08:48:18.880583 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 14 08:48:18.880583 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 14 08:48:18.880583 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 14 08:48:18.880583 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 14 08:48:18.882423 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 14 08:48:18.882423 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise self.value Sep 14 08:48:18.882423 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 14 08:48:18.882423 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 14 08:48:18.882423 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 14 08:48:18.882423 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 14 08:48:18.882423 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 14 08:48:18.882423 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 14 08:48:18.882423 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Sep 14 08:48:18.882423 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:18.882423 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:48:18.882423 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:18.882423 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:18.882423 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:48:18.882423 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:48:18.882423 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 14 08:48:18.882423 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 14 08:48:18.882423 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Sep 14 08:48:18.882423 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:18.883737 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-68aba4a1-ac3b-4cc1-8bb4-c02dd3f801d3 tempest-FlavorsAccessNegativeTestJSON-1654170619 tempest-FlavorsAccessNegativeTestJSON-1654170619-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:48:18.883737 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-68aba4a1-ac3b-4cc1-8bb4-c02dd3f801d3 tempest-FlavorsAccessNegativeTestJSON-1654170619 tempest-FlavorsAccessNegativeTestJSON-1654170619-project] 10.222.0.60 "POST /compute/v2.1/flavors/1300076682/action" status: 403 len: 133 microversion: 2.1 time: 0.032127 Sep 14 08:48:18.885805 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-886b9716-80af-4ef1-8c00-f5122ced4435 tempest-FlavorsAdminTestJSON-1934103607 tempest-FlavorsAdminTestJSON-1934103607-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/968422187" status: 202 len: 0 microversion: 2.1 time: 0.053877 Sep 14 08:48:18.886407 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 51/91] 10.222.0.60 () {58 vars in 1158 bytes} [Wed Sep 14 08:48:18 2022] DELETE /compute/v2.1/flavors/968422187 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 08:48:18.890962 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 41/92] 10.222.0.60 () {60 vars in 1200 bytes} [Wed Sep 14 08:48:18 2022] POST /compute/v2.1/flavors/1300076682/action => generated 133 bytes in 42 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 14 08:48:18.894674 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-eaf645f7-28f4-4f81-80e6-772f157be6fe tempest-AggregatesAdminNegativeTestJSON-1326539754 tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:18.899845 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-0cec7789-93f1-427f-b322-81ab1a125e64 tempest-FlavorsAccessNegativeTestJSON-1040633479 tempest-FlavorsAccessNegativeTestJSON-1040633479-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "31dc6190eea241a08561f32d6989370a"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:48:18.944235 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-eaf645f7-28f4-4f81-80e6-772f157be6fe tempest-AggregatesAdminNegativeTestJSON-1326539754 tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.056785 Sep 14 08:48:18.952288 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 52/93] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Sep 14 08:48:18 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 14 08:48:18.962733 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-2d6bb70d-024b-41ec-910b-1d2af911f43f tempest-FlavorsAdminTestJSON-1934103607 tempest-FlavorsAdminTestJSON-1934103607-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:18.994826 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-2d6bb70d-024b-41ec-910b-1d2af911f43f tempest-FlavorsAdminTestJSON-1934103607 tempest-FlavorsAdminTestJSON-1934103607-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.041353 Sep 14 08:48:18.995792 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 53/94] 10.222.0.60 () {58 vars in 1146 bytes} [Wed Sep 14 08:48:18 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:48:19.004408 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c5c1aee2-f061-489a-936c-5584820e41fb tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:19.005237 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-c5c1aee2-f061-489a-936c-5584820e41fb tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] [instance: ef72dfda-b1e4-49c6-8830-33d25f6a4ec0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:48:19.030837 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c5c1aee2-f061-489a-936c-5584820e41fb tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:19.032488 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c5c1aee2-f061-489a-936c-5584820e41fb tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:19.032939 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c5c1aee2-f061-489a-936c-5584820e41fb tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:19.033673 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c5c1aee2-f061-489a-936c-5584820e41fb tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:19.034135 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c5c1aee2-f061-489a-936c-5584820e41fb tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:19.034567 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c5c1aee2-f061-489a-936c-5584820e41fb tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:19.128066 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-c5c1aee2-f061-489a-936c-5584820e41fb tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326618ebc864ba58c6df2c471c0f978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d1553889c474f75bd545166eff212b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:48:19.138262 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-c5c1aee2-f061-489a-936c-5584820e41fb tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] 10.222.0.60 "GET /compute/v2.1/servers/ef72dfda-b1e4-49c6-8830-33d25f6a4ec0" status: 200 len: 1242 microversion: 2.1 time: 0.140672 Sep 14 08:48:19.139423 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 54/95] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:48:18 2022] GET /compute/v2.1/servers/ef72dfda-b1e4-49c6-8830-33d25f6a4ec0 => generated 1242 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:48:19.148431 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-065e5713-0d88-4010-970d-1ec289d80964 tempest-AggregatesAdminNegativeTestJSON-1326539754 tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2123024736"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:48:19.154789 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.objects.aggregate [None req-065e5713-0d88-4010-970d-1ec289d80964 tempest-AggregatesAdminNegativeTestJSON-1326539754 tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin] Generated uuid 3f6511ea-0dd4-4ca5-89c3-410f804d1c68 for aggregate {{(pid=128759) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 14 08:48:19.186341 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-065e5713-0d88-4010-970d-1ec289d80964 tempest-AggregatesAdminNegativeTestJSON-1326539754 tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.040582 Sep 14 08:48:19.187119 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 55/96] 10.222.0.60 () {60 vars in 1164 bytes} [Wed Sep 14 08:48:19 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:48:19.195921 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-efc7c1be-98a1-4938-a22a-9a08391a78f5 tempest-FlavorsAdminTestJSON-1934103607 tempest-FlavorsAdminTestJSON-1934103607-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-706765682", "id": 1775668826, "os-flavor-access:is_public": "False"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:48:19.238117 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-efc7c1be-98a1-4938-a22a-9a08391a78f5 tempest-FlavorsAdminTestJSON-1934103607 tempest-FlavorsAdminTestJSON-1934103607-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.049289 Sep 14 08:48:19.239007 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 56/97] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 08:48:19 2022] POST /compute/v2.1/flavors => generated 429 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:48:19.245606 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-413017c4-6a74-4c5a-b5b7-45c87037fb15 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:19.246467 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-413017c4-6a74-4c5a-b5b7-45c87037fb15 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] [instance: 7045fd2e-8224-46b8-b477-57a46e18e93f] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:48:19.256679 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-413017c4-6a74-4c5a-b5b7-45c87037fb15 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:19.258565 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-413017c4-6a74-4c5a-b5b7-45c87037fb15 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:19.259247 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-413017c4-6a74-4c5a-b5b7-45c87037fb15 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:19.260427 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-413017c4-6a74-4c5a-b5b7-45c87037fb15 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:19.262133 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-413017c4-6a74-4c5a-b5b7-45c87037fb15 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:19.272942 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-413017c4-6a74-4c5a-b5b7-45c87037fb15 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:19.497314 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-413017c4-6a74-4c5a-b5b7-45c87037fb15 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e462483415e4c2b8a917b2a032e5ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac4d0cae0bd46fda94d7bfb900a0b9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:48:19.508803 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-413017c4-6a74-4c5a-b5b7-45c87037fb15 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] 10.222.0.60 "GET /compute/v2.1/servers/7045fd2e-8224-46b8-b477-57a46e18e93f" status: 200 len: 1300 microversion: 2.1 time: 0.268492 Sep 14 08:48:19.509434 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 57/98] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:48:19 2022] GET /compute/v2.1/servers/7045fd2e-8224-46b8-b477-57a46e18e93f => generated 1300 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:48:19.523094 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d6b1aca3-eca8-4f15-b73f-15da9aeba73a tempest-AggregatesAdminNegativeTestJSON-338931773 tempest-AggregatesAdminNegativeTestJSON-338931773-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:19.523094 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-d6b1aca3-eca8-4f15-b73f-15da9aeba73a tempest-AggregatesAdminNegativeTestJSON-338931773 tempest-AggregatesAdminNegativeTestJSON-338931773-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': '57bc4ee1d3ae4513a389cb933904e571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed05e2ea9b444238abc9a9be91397ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:48:19.523094 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d6b1aca3-eca8-4f15-b73f-15da9aeba73a tempest-AggregatesAdminNegativeTestJSON-338931773 tempest-AggregatesAdminNegativeTestJSON-338931773-project] Request method failure captured: Sep 14 08:48:19.523094 n-d-836830-18 devstack@n-api.service[128759]: request: DELETE /compute/v2.1/os-aggregates/6 HTTP/1.1 Sep 14 08:48:19.523094 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 08:48:19.523094 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 08:48:19.523094 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 08:48:19.523094 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 08:48:19.523094 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 08:48:19.523094 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 08:48:19.523094 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 08:48:19.523094 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 08:48:19.523094 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZVJdW0uLhEkavM7Bp9qDO_pOqoNOa1h0Qp3wGKgWDHTczk4fefancNdrqkwxWcAIxR12spv8mhB9hpKqGel7aj9i3-5mk7YbzPqLTKlvqM81v3Bu1p54q7f8IzHym055xKb4Z4OWTK0y1quegytrHBJSe4m3PY_Y4dVuCratJjoErM Sep 14 08:48:19.523094 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 08:48:19.524224 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 08:48:19.524224 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 08:48:19.524224 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 08:48:19.524224 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 08:48:19.524224 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 08:48:19.524224 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: ed05e2ea9b444238abc9a9be91397ffb Sep 14 08:48:19.524224 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-338931773 Sep 14 08:48:19.524224 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 08:48:19.524224 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 08:48:19.524224 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/ed05e2ea9b444238abc9a9be91397ffb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_ed05e2ea9b444238abc9a9be91397ffb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ed05e2ea9b444238abc9a9be91397ffb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ed05e2ea9b444238abc9a9be91397ffb"}]}] Sep 14 08:48:19.524224 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-338931773 Sep 14 08:48:19.524224 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: ed05e2ea9b444238abc9a9be91397ffb Sep 14 08:48:19.524224 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-338931773 Sep 14 08:48:19.524224 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-AggregatesAdminNegativeTestJSON-338931773-project Sep 14 08:48:19.524224 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 08:48:19.524224 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 08:48:19.524224 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 57bc4ee1d3ae4513a389cb933904e571 Sep 14 08:48:19.525098 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-338931773-project Sep 14 08:48:19.525098 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 08:48:19.525098 n-d-836830-18 devstack@n-api.service[128759]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Sep 14 08:48:19.525098 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '6'} Sep 14 08:48:19.525098 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:48:19.525098 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:19.525098 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:48:19.525098 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:48:19.525098 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:48:19.525098 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:48:19.525098 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:48:19.525098 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:48:19.525098 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Sep 14 08:48:19.525098 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Sep 14 08:48:19.525098 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 14 08:48:19.525098 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 14 08:48:19.525098 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 14 08:48:19.525098 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 14 08:48:19.525098 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 14 08:48:19.525098 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 14 08:48:19.526118 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 14 08:48:19.526118 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise self.value Sep 14 08:48:19.526118 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 14 08:48:19.526118 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 14 08:48:19.526118 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 14 08:48:19.526118 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 14 08:48:19.526118 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 14 08:48:19.526118 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 14 08:48:19.526118 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Sep 14 08:48:19.526118 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:48:19.526118 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:48:19.526118 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:48:19.526118 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:19.526118 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:48:19.526118 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:48:19.526118 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 14 08:48:19.526118 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 14 08:48:19.526118 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Sep 14 08:48:19.526118 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:48:19.532238 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d6b1aca3-eca8-4f15-b73f-15da9aeba73a tempest-AggregatesAdminNegativeTestJSON-338931773 tempest-AggregatesAdminNegativeTestJSON-338931773-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:48:19.532238 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d6b1aca3-eca8-4f15-b73f-15da9aeba73a tempest-AggregatesAdminNegativeTestJSON-338931773 tempest-AggregatesAdminNegativeTestJSON-338931773-project] 10.222.0.60 "DELETE /compute/v2.1/os-aggregates/6" status: 403 len: 116 microversion: 2.1 time: 0.010731 Sep 14 08:48:19.532238 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 58/99] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Sep 14 08:48:19 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 116 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 14 08:48:19.539290 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f1304b5f-e258-4470-8f6b-dcdee38bb50d tempest-FlavorsAdminTestJSON-442745451 tempest-FlavorsAdminTestJSON-442745451-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "1775668826"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:48:19.565678 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-f1304b5f-e258-4470-8f6b-dcdee38bb50d tempest-FlavorsAdminTestJSON-442745451 tempest-FlavorsAdminTestJSON-442745451-project] HTTP exception thrown: Flavor 1775668826 could not be found. Sep 14 08:48:19.578284 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f1304b5f-e258-4470-8f6b-dcdee38bb50d tempest-FlavorsAdminTestJSON-442745451 tempest-FlavorsAdminTestJSON-442745451-project] Request method failure captured: Sep 14 08:48:19.578284 n-d-836830-18 devstack@n-api.service[128759]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 14 08:48:19.578284 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 08:48:19.578284 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 08:48:19.578284 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 08:48:19.578284 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 107 Sep 14 08:48:19.578284 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 08:48:19.578284 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 08:48:19.578284 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 08:48:19.578284 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 08:48:19.578284 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZVJ6gENq4Ai9KmalQr6q61IJEh0uiLGXdwM3CYZn58ql1OJ2H9ES_ei3O5Z-glg0YiC27M8Bk4x7vZmKtzaCR52KmLIqjJzttYhBfZs1AmWVY9ecZxDVIua-EJ11Vo_QHDCzDewLfwTGaBAQkHk7Luuj30G-VOPuYT9xgGbuSkEWeQ Sep 14 08:48:19.578284 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 08:48:19.578284 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 08:48:19.578284 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 08:48:19.578284 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 08:48:19.578284 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 08:48:19.578284 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 08:48:19.578284 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 4c665a60fe39442182566ef8ea107b46 Sep 14 08:48:19.578284 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-FlavorsAdminTestJSON-442745451 Sep 14 08:48:19.578284 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 08:48:19.578284 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 08:48:19.579464 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/4c665a60fe39442182566ef8ea107b46"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_4c665a60fe39442182566ef8ea107b46"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4c665a60fe39442182566ef8ea107b46"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4c665a60fe39442182566ef8ea107b46"}]}] Sep 14 08:48:19.579464 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-FlavorsAdminTestJSON-442745451 Sep 14 08:48:19.579464 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 4c665a60fe39442182566ef8ea107b46 Sep 14 08:48:19.579464 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-442745451 Sep 14 08:48:19.579464 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-FlavorsAdminTestJSON-442745451-project Sep 14 08:48:19.579464 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 08:48:19.579464 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 08:48:19.579464 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 28318bd974674bd88a06b7740aae8bb2 Sep 14 08:48:19.579464 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-FlavorsAdminTestJSON-442745451-project Sep 14 08:48:19.579464 n-d-836830-18 devstack@n-api.service[128759]: Sep 14 08:48:19.579464 n-d-836830-18 devstack@n-api.service[128759]: {"server": {"name": "test", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "1775668826"}} Sep 14 08:48:19.579464 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 08:48:19.579464 n-d-836830-18 devstack@n-api.service[128759]: exception: Flavor 1775668826 could not be found. Sep 14 08:48:19.580162 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'body': {'server': {'name': 'test', 'imageRef': 'bff4ab7f-4846-441f-8940-d96fec4c28e9', 'flavorRef': '1775668826'}}} Sep 14 08:48:19.580162 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:48:19.580162 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:19.580162 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Sep 14 08:48:19.580162 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Sep 14 08:48:19.580162 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 14 08:48:19.580162 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 14 08:48:19.580162 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 14 08:48:19.580162 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 14 08:48:19.580162 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 14 08:48:19.580162 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 14 08:48:19.580162 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 14 08:48:19.580162 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:48:19.580162 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 14 08:48:19.580162 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 14 08:48:19.580162 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 1775668826 could not be found. Sep 14 08:48:19.580162 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:48:19.580162 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:48:19.580162 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:48:19.580162 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:19.581187 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:48:19.581187 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:48:19.581187 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:48:19.581187 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:48:19.581187 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:48:19.581187 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:48:19.581187 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 08:48:19.581187 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 08:48:19.581187 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 08:48:19.581187 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 08:48:19.581187 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 08:48:19.581187 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 08:48:19.581187 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 14 08:48:19.581187 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Sep 14 08:48:19.581187 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Sep 14 08:48:19.581187 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 1775668826 could not be found. Sep 14 08:48:19.581187 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:48:19.581187 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:48:19.581187 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:48:19.581187 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:19.581187 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:48:19.583072 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:48:19.583072 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:48:19.583072 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:48:19.583072 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1775668826 could not be found. Sep 14 08:48:19.583072 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:48:19.586841 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f1304b5f-e258-4470-8f6b-dcdee38bb50d tempest-FlavorsAdminTestJSON-442745451 tempest-FlavorsAdminTestJSON-442745451-project] Returning 400 to user: Flavor 1775668826 could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:48:19.589872 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f1304b5f-e258-4470-8f6b-dcdee38bb50d tempest-FlavorsAdminTestJSON-442745451 tempest-FlavorsAdminTestJSON-442745451-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 400 len: 81 microversion: 2.1 time: 0.057629 Sep 14 08:48:19.590753 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 59/100] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 08:48:19 2022] POST /compute/v2.1/servers => generated 81 bytes in 61 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 14 08:48:19.605707 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-cda75d78-30ce-431e-88c6-11645b115f98 tempest-AggregatesAdminNegativeTestJSON-1326539754 tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:19.660528 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-cda75d78-30ce-431e-88c6-11645b115f98 tempest-AggregatesAdminNegativeTestJSON-1326539754 tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.067244 Sep 14 08:48:19.661713 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 60/101] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Sep 14 08:48:19 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 14 08:48:19.672508 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a401c34b-74ce-4e5a-be4b-77ec0fdae2f3 tempest-FlavorsAdminTestJSON-1934103607 tempest-FlavorsAdminTestJSON-1934103607-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:19.705531 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a401c34b-74ce-4e5a-be4b-77ec0fdae2f3 tempest-FlavorsAdminTestJSON-1934103607 tempest-FlavorsAdminTestJSON-1934103607-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/1775668826" status: 202 len: 0 microversion: 2.1 time: 0.040544 Sep 14 08:48:19.707270 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 61/102] 10.222.0.60 () {58 vars in 1161 bytes} [Wed Sep 14 08:48:19 2022] DELETE /compute/v2.1/flavors/1775668826 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 08:48:19.722276 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-61eb2590-f9e5-42ec-8fd2-567923eb388f tempest-AggregatesAdminNegativeTestJSON-1326539754 tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:19.749705 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-61eb2590-f9e5-42ec-8fd2-567923eb388f tempest-AggregatesAdminNegativeTestJSON-1326539754 tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Sep 14 08:48:19.757904 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-61eb2590-f9e5-42ec-8fd2-567923eb388f tempest-AggregatesAdminNegativeTestJSON-1326539754 tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin] Request method failure captured: Sep 14 08:48:19.757904 n-d-836830-18 devstack@n-api.service[128759]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Sep 14 08:48:19.757904 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 08:48:19.757904 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 08:48:19.757904 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 08:48:19.757904 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 08:48:19.757904 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 08:48:19.757904 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 08:48:19.757904 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 08:48:19.757904 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 08:48:19.757904 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZVLmJ15KWpFzwjBk89mbkB4PfDNCzydgt68AeYqIMFil0sHzz7mUG2-TKeV_gXm_nnH_yPYhyWGcM4Cw8PvI6ZS_hRqRPaEAvLYHlgIjjWnxMMEh7qOnYV_USVH61vMihtYmSwUuF5ovmHMApqYsssL_HzfV3qjmWGd4yKm2NPPigs Sep 14 08:48:19.757904 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 08:48:19.757904 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 08:48:19.757904 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 08:48:19.757904 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 08:48:19.757904 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 08:48:19.757904 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 08:48:19.757904 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: eb497d14a0394c9486c4682b72a08767 Sep 14 08:48:19.757904 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1326539754 Sep 14 08:48:19.757904 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member,admin Sep 14 08:48:19.757904 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member,admin Sep 14 08:48:19.759310 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/eb497d14a0394c9486c4682b72a08767"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_eb497d14a0394c9486c4682b72a08767"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/eb497d14a0394c9486c4682b72a08767"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/eb497d14a0394c9486c4682b72a08767"}]}] Sep 14 08:48:19.759310 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1326539754 Sep 14 08:48:19.759310 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: eb497d14a0394c9486c4682b72a08767 Sep 14 08:48:19.759310 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1326539754 Sep 14 08:48:19.759310 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin Sep 14 08:48:19.759310 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 08:48:19.759310 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 08:48:19.759310 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 4452ad4c9bf2454f833c2a552ab32b8c Sep 14 08:48:19.759310 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin Sep 14 08:48:19.759310 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 08:48:19.759310 n-d-836830-18 devstack@n-api.service[128759]: exception: Aggregate -1 could not be found. Sep 14 08:48:19.759310 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '-1'} Sep 14 08:48:19.760325 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:48:19.760325 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:19.760325 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Sep 14 08:48:19.760325 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Sep 14 08:48:19.760325 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 14 08:48:19.760325 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 14 08:48:19.760325 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 14 08:48:19.760325 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 14 08:48:19.760325 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 14 08:48:19.760325 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise self.value Sep 14 08:48:19.760325 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 14 08:48:19.760325 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 14 08:48:19.760325 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Sep 14 08:48:19.760325 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Sep 14 08:48:19.760325 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 14 08:48:19.760325 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 14 08:48:19.760325 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 14 08:48:19.760325 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 14 08:48:19.760325 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 14 08:48:19.761650 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 14 08:48:19.761650 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 14 08:48:19.761650 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 14 08:48:19.761650 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Sep 14 08:48:19.761650 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:48:19.761650 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:48:19.761650 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:48:19.761650 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:19.761650 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:48:19.761650 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:48:19.761650 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:48:19.761650 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:48:19.761650 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:48:19.761650 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:48:19.761650 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Sep 14 08:48:19.761650 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 08:48:19.761650 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Sep 14 08:48:19.761650 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:48:19.761650 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:48:19.761650 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:48:19.761650 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:19.762909 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:48:19.762909 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:48:19.762909 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:48:19.762909 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:48:19.762909 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Sep 14 08:48:19.762909 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:48:19.765750 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-61eb2590-f9e5-42ec-8fd2-567923eb388f tempest-AggregatesAdminNegativeTestJSON-1326539754 tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:48:19.766496 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-0cec7789-93f1-427f-b322-81ab1a125e64 tempest-FlavorsAccessNegativeTestJSON-1040633479 tempest-FlavorsAccessNegativeTestJSON-1040633479-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors/1300076682/action" status: 200 len: 21 microversion: 2.1 time: 0.875934 Sep 14 08:48:19.767558 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-61eb2590-f9e5-42ec-8fd2-567923eb388f tempest-AggregatesAdminNegativeTestJSON-1326539754 tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.058563 Sep 14 08:48:19.768205 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 42/103] 10.222.0.60 () {60 vars in 1200 bytes} [Wed Sep 14 08:48:18 2022] POST /compute/v2.1/flavors/1300076682/action => generated 21 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 08:48:19.770020 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 62/104] 10.222.0.60 () {58 vars in 1155 bytes} [Wed Sep 14 08:48:19 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 14 08:48:19.782060 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-52fd0f6a-427d-4daf-a3f5-a985dbaf69be tempest-FlavorsAdminTestJSON-1934103607 tempest-FlavorsAdminTestJSON-1934103607-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:19.782993 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-cc0f87c4-5d84-44a4-9221-87f4bde0afed tempest-FlavorsAccessNegativeTestJSON-1040633479 tempest-FlavorsAccessNegativeTestJSON-1040633479-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:19.829697 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-cc0f87c4-5d84-44a4-9221-87f4bde0afed tempest-FlavorsAccessNegativeTestJSON-1040633479 tempest-FlavorsAccessNegativeTestJSON-1040633479-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/1300076682" status: 202 len: 0 microversion: 2.1 time: 0.055244 Sep 14 08:48:19.831957 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 63/105] 10.222.0.60 () {58 vars in 1161 bytes} [Wed Sep 14 08:48:19 2022] DELETE /compute/v2.1/flavors/1300076682 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 08:48:19.833459 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-52fd0f6a-427d-4daf-a3f5-a985dbaf69be tempest-FlavorsAdminTestJSON-1934103607 tempest-FlavorsAdminTestJSON-1934103607-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.064059 Sep 14 08:48:19.842775 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-599bfa79-307f-46fc-9e5d-8bc0c8d28f62 tempest-AggregatesAdminNegativeTestJSON-1326539754 tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1311804679"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:48:19.847146 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.objects.aggregate [None req-599bfa79-307f-46fc-9e5d-8bc0c8d28f62 tempest-AggregatesAdminNegativeTestJSON-1326539754 tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin] Generated uuid e1c5ecf6-4e06-4640-83d4-cb6fd3b64005 for aggregate {{(pid=128759) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 14 08:48:19.850557 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 43/106] 10.222.0.60 () {58 vars in 1146 bytes} [Wed Sep 14 08:48:19 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:48:19.861633 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d8b4bf32-f562-4044-b859-472e8f50bc9b tempest-FlavorsAccessNegativeTestJSON-1040633479 tempest-FlavorsAccessNegativeTestJSON-1040633479-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:19.892825 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-599bfa79-307f-46fc-9e5d-8bc0c8d28f62 tempest-AggregatesAdminNegativeTestJSON-1326539754 tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.058053 Sep 14 08:48:19.894975 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 64/107] 10.222.0.60 () {60 vars in 1164 bytes} [Wed Sep 14 08:48:19 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:48:19.906217 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-beb1be96-1f3b-44cb-9f63-a32cf7d5b4fc tempest-FlavorsAdminTestJSON-1934103607 tempest-FlavorsAdminTestJSON-1934103607-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1450557807", "id": 29245773, "os-flavor-access:is_public": "False"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:48:19.914445 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-d8b4bf32-f562-4044-b859-472e8f50bc9b tempest-FlavorsAccessNegativeTestJSON-1040633479 tempest-FlavorsAccessNegativeTestJSON-1040633479-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.062568 Sep 14 08:48:19.916013 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 44/108] 10.222.0.60 () {58 vars in 1146 bytes} [Wed Sep 14 08:48:19 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:48:19.923362 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b4fea6a0-9bd1-47da-bf5a-1eecee6a1007 tempest-AggregatesAdminNegativeTestJSON-338931773 tempest-AggregatesAdminNegativeTestJSON-338931773-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:19.925246 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-b4fea6a0-9bd1-47da-bf5a-1eecee6a1007 tempest-AggregatesAdminNegativeTestJSON-338931773 tempest-AggregatesAdminNegativeTestJSON-338931773-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': '57bc4ee1d3ae4513a389cb933904e571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed05e2ea9b444238abc9a9be91397ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:48:19.927771 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b4fea6a0-9bd1-47da-bf5a-1eecee6a1007 tempest-AggregatesAdminNegativeTestJSON-338931773 tempest-AggregatesAdminNegativeTestJSON-338931773-project] Request method failure captured: Sep 14 08:48:19.927771 n-d-836830-18 devstack@n-api.service[128758]: request: GET /compute/v2.1/os-aggregates/7 HTTP/1.1 Sep 14 08:48:19.927771 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 08:48:19.927771 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 08:48:19.927771 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 08:48:19.927771 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 08:48:19.927771 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 08:48:19.927771 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 08:48:19.927771 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 08:48:19.927771 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 08:48:19.927771 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZVJdW0uLhEkavM7Bp9qDO_pOqoNOa1h0Qp3wGKgWDHTczk4fefancNdrqkwxWcAIxR12spv8mhB9hpKqGel7aj9i3-5mk7YbzPqLTKlvqM81v3Bu1p54q7f8IzHym055xKb4Z4OWTK0y1quegytrHBJSe4m3PY_Y4dVuCratJjoErM Sep 14 08:48:19.927771 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 08:48:19.927771 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 08:48:19.927771 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 08:48:19.927771 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 08:48:19.927771 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 08:48:19.927771 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 08:48:19.927771 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: ed05e2ea9b444238abc9a9be91397ffb Sep 14 08:48:19.927771 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-338931773 Sep 14 08:48:19.927771 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 08:48:19.927771 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 08:48:19.929373 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/ed05e2ea9b444238abc9a9be91397ffb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_ed05e2ea9b444238abc9a9be91397ffb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ed05e2ea9b444238abc9a9be91397ffb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ed05e2ea9b444238abc9a9be91397ffb"}]}] Sep 14 08:48:19.929373 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-338931773 Sep 14 08:48:19.929373 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: ed05e2ea9b444238abc9a9be91397ffb Sep 14 08:48:19.929373 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-338931773 Sep 14 08:48:19.929373 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-AggregatesAdminNegativeTestJSON-338931773-project Sep 14 08:48:19.929373 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 08:48:19.929373 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 08:48:19.929373 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 57bc4ee1d3ae4513a389cb933904e571 Sep 14 08:48:19.929373 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-338931773-project Sep 14 08:48:19.929373 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 08:48:19.929373 n-d-836830-18 devstack@n-api.service[128758]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Sep 14 08:48:19.929373 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': '7'} Sep 14 08:48:19.930424 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:48:19.930424 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:19.930424 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:48:19.930424 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:48:19.930424 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:48:19.930424 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:48:19.930424 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:48:19.930424 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:48:19.930424 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Sep 14 08:48:19.930424 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Sep 14 08:48:19.930424 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 14 08:48:19.930424 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 14 08:48:19.930424 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 14 08:48:19.930424 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 14 08:48:19.930424 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 14 08:48:19.930424 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 14 08:48:19.930424 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 14 08:48:19.930424 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise self.value Sep 14 08:48:19.930424 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 14 08:48:19.931461 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 14 08:48:19.931461 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 14 08:48:19.931461 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 14 08:48:19.931461 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 14 08:48:19.931461 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 14 08:48:19.931461 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Sep 14 08:48:19.931461 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:19.931461 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:48:19.931461 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:19.931461 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:19.931461 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:48:19.931461 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:48:19.931461 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 14 08:48:19.931461 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 14 08:48:19.931461 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Sep 14 08:48:19.931461 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:19.933691 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b4fea6a0-9bd1-47da-bf5a-1eecee6a1007 tempest-AggregatesAdminNegativeTestJSON-338931773 tempest-AggregatesAdminNegativeTestJSON-338931773-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:48:19.934669 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-b4fea6a0-9bd1-47da-bf5a-1eecee6a1007 tempest-AggregatesAdminNegativeTestJSON-338931773 tempest-AggregatesAdminNegativeTestJSON-338931773-project] 10.222.0.60 "GET /compute/v2.1/os-aggregates/7" status: 403 len: 114 microversion: 2.1 time: 0.017518 Sep 14 08:48:19.939429 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 45/109] 10.222.0.60 () {58 vars in 1149 bytes} [Wed Sep 14 08:48:19 2022] GET /compute/v2.1/os-aggregates/7 => generated 114 bytes in 22 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 14 08:48:19.945223 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1b5fc2fa-19ae-4654-8132-bd64fb2af7f9 tempest-FlavorsAccessNegativeTestJSON-1040633479 tempest-FlavorsAccessNegativeTestJSON-1040633479-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1802630782", "id": 290179358, "os-flavor-access:is_public": "False"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:48:19.950546 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-beb1be96-1f3b-44cb-9f63-a32cf7d5b4fc tempest-FlavorsAdminTestJSON-1934103607 tempest-FlavorsAdminTestJSON-1934103607-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.1 time: 0.053672 Sep 14 08:48:19.955811 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 65/110] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 08:48:19 2022] POST /compute/v2.1/flavors => generated 409 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:48:19.968827 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8649f863-976a-4e95-b8c8-38952ac23212 tempest-AggregatesAdminNegativeTestJSON-1326539754 tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:19.977355 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-1b5fc2fa-19ae-4654-8132-bd64fb2af7f9 tempest-FlavorsAccessNegativeTestJSON-1040633479 tempest-FlavorsAccessNegativeTestJSON-1040633479-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.036575 Sep 14 08:48:19.978522 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 46/111] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 08:48:19 2022] POST /compute/v2.1/flavors => generated 436 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:48:19.984639 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-131102ed-9438-4fcf-ac73-249c69be687b tempest-FlavorsAdminTestJSON-1934103607 tempest-FlavorsAdminTestJSON-1934103607-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-670931120", "id": 396132956, "os-flavor-access:is_public": "True"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:48:20.016358 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-8649f863-976a-4e95-b8c8-38952ac23212 tempest-AggregatesAdminNegativeTestJSON-1326539754 tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.055657 Sep 14 08:48:20.018402 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 66/112] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Sep 14 08:48:19 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 14 08:48:20.022755 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-131102ed-9438-4fcf-ac73-249c69be687b tempest-FlavorsAdminTestJSON-1934103607 tempest-FlavorsAdminTestJSON-1934103607-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.1 time: 0.042710 Sep 14 08:48:20.036984 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 47/113] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 08:48:19 2022] POST /compute/v2.1/flavors => generated 410 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:48:20.037184 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-2354f9de-b021-4b6d-8be0-35bd5fedd7a5 tempest-FlavorsAccessNegativeTestJSON-1040633479 tempest-FlavorsAccessNegativeTestJSON-1040633479-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "48ddd7e69eaf4971bc11ae5c7b2527ea"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:48:20.051277 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d1f80d6d-6729-4cd0-8d52-70591d6b8a9c tempest-AggregatesAdminNegativeTestJSON-1326539754 tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:20.069070 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-d1f80d6d-6729-4cd0-8d52-70591d6b8a9c tempest-AggregatesAdminNegativeTestJSON-1326539754 tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Sep 14 08:48:20.070711 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d1f80d6d-6729-4cd0-8d52-70591d6b8a9c tempest-AggregatesAdminNegativeTestJSON-1326539754 tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin] Request method failure captured: Sep 14 08:48:20.070711 n-d-836830-18 devstack@n-api.service[128758]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Sep 14 08:48:20.070711 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 08:48:20.070711 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 08:48:20.070711 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 08:48:20.070711 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 08:48:20.070711 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 08:48:20.070711 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 08:48:20.070711 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 08:48:20.070711 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 08:48:20.070711 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZVLmJ15KWpFzwjBk89mbkB4PfDNCzydgt68AeYqIMFil0sHzz7mUG2-TKeV_gXm_nnH_yPYhyWGcM4Cw8PvI6ZS_hRqRPaEAvLYHlgIjjWnxMMEh7qOnYV_USVH61vMihtYmSwUuF5ovmHMApqYsssL_HzfV3qjmWGd4yKm2NPPigs Sep 14 08:48:20.070711 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 08:48:20.070711 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 08:48:20.070711 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 08:48:20.070711 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 08:48:20.070711 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 08:48:20.070711 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 08:48:20.070711 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: eb497d14a0394c9486c4682b72a08767 Sep 14 08:48:20.070711 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1326539754 Sep 14 08:48:20.070711 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member,admin Sep 14 08:48:20.070711 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member,admin Sep 14 08:48:20.072115 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/eb497d14a0394c9486c4682b72a08767"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_eb497d14a0394c9486c4682b72a08767"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/eb497d14a0394c9486c4682b72a08767"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/eb497d14a0394c9486c4682b72a08767"}]}] Sep 14 08:48:20.072115 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1326539754 Sep 14 08:48:20.072115 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: eb497d14a0394c9486c4682b72a08767 Sep 14 08:48:20.072115 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1326539754 Sep 14 08:48:20.072115 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin Sep 14 08:48:20.072115 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 08:48:20.072115 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 08:48:20.072115 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 4452ad4c9bf2454f833c2a552ab32b8c Sep 14 08:48:20.072115 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin Sep 14 08:48:20.072115 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 08:48:20.072115 n-d-836830-18 devstack@n-api.service[128758]: exception: Aggregate -1 could not be found. Sep 14 08:48:20.072115 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': '-1'} Sep 14 08:48:20.072824 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:48:20.072824 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:20.072824 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Sep 14 08:48:20.072824 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Sep 14 08:48:20.072824 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Sep 14 08:48:20.072824 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Sep 14 08:48:20.072824 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 14 08:48:20.072824 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 14 08:48:20.072824 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 14 08:48:20.072824 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 14 08:48:20.072824 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 14 08:48:20.072824 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 14 08:48:20.072824 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 14 08:48:20.072824 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 14 08:48:20.072824 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Sep 14 08:48:20.072824 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:20.072824 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:48:20.072824 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:20.072824 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:20.072824 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:48:20.074053 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:48:20.074053 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:48:20.074053 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:48:20.074053 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:48:20.074053 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:48:20.074053 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Sep 14 08:48:20.074053 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 08:48:20.074053 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Sep 14 08:48:20.074053 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:20.074053 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:48:20.074053 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:20.074053 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:20.074053 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:48:20.074053 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:48:20.074053 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:48:20.074053 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:48:20.074053 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Sep 14 08:48:20.074053 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:20.078329 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d1f80d6d-6729-4cd0-8d52-70591d6b8a9c tempest-AggregatesAdminNegativeTestJSON-1326539754 tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:48:20.081883 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-d1f80d6d-6729-4cd0-8d52-70591d6b8a9c tempest-AggregatesAdminNegativeTestJSON-1326539754 tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin] 10.222.0.60 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.036918 Sep 14 08:48:20.083573 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 48/114] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Sep 14 08:48:20 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 14 08:48:20.098604 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-3882c1b8-c3b8-4fec-8200-594334d2095a tempest-FlavorsAdminTestJSON-1934103607 tempest-FlavorsAdminTestJSON-1934103607-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:20.140941 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-3882c1b8-c3b8-4fec-8200-594334d2095a tempest-FlavorsAdminTestJSON-1934103607 tempest-FlavorsAdminTestJSON-1934103607-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 838 microversion: 2.1 time: 0.055357 Sep 14 08:48:20.153234 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 49/115] 10.222.0.60 () {58 vars in 1169 bytes} [Wed Sep 14 08:48:20 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 838 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:48:20.160392 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a7484cd0-3061-4618-b7b6-ccf06201bdfc tempest-AggregatesAdminNegativeTestJSON-338931773 tempest-AggregatesAdminNegativeTestJSON-338931773-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:20.164159 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-a7484cd0-3061-4618-b7b6-ccf06201bdfc tempest-AggregatesAdminNegativeTestJSON-338931773 tempest-AggregatesAdminNegativeTestJSON-338931773-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': '57bc4ee1d3ae4513a389cb933904e571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed05e2ea9b444238abc9a9be91397ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:48:20.166245 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a7484cd0-3061-4618-b7b6-ccf06201bdfc tempest-AggregatesAdminNegativeTestJSON-338931773 tempest-AggregatesAdminNegativeTestJSON-338931773-project] Request method failure captured: Sep 14 08:48:20.166245 n-d-836830-18 devstack@n-api.service[128758]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Sep 14 08:48:20.166245 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 08:48:20.166245 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 08:48:20.166245 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 08:48:20.166245 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 08:48:20.166245 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 08:48:20.166245 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 08:48:20.166245 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 08:48:20.166245 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 08:48:20.166245 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZVJdW0uLhEkavM7Bp9qDO_pOqoNOa1h0Qp3wGKgWDHTczk4fefancNdrqkwxWcAIxR12spv8mhB9hpKqGel7aj9i3-5mk7YbzPqLTKlvqM81v3Bu1p54q7f8IzHym055xKb4Z4OWTK0y1quegytrHBJSe4m3PY_Y4dVuCratJjoErM Sep 14 08:48:20.166245 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 08:48:20.166245 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 08:48:20.166245 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 08:48:20.166245 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 08:48:20.166245 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 08:48:20.166245 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 08:48:20.166245 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: ed05e2ea9b444238abc9a9be91397ffb Sep 14 08:48:20.166245 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-338931773 Sep 14 08:48:20.166245 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 08:48:20.166245 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 08:48:20.167497 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/ed05e2ea9b444238abc9a9be91397ffb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_ed05e2ea9b444238abc9a9be91397ffb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ed05e2ea9b444238abc9a9be91397ffb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ed05e2ea9b444238abc9a9be91397ffb"}]}] Sep 14 08:48:20.167497 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-338931773 Sep 14 08:48:20.167497 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: ed05e2ea9b444238abc9a9be91397ffb Sep 14 08:48:20.167497 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-338931773 Sep 14 08:48:20.167497 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-AggregatesAdminNegativeTestJSON-338931773-project Sep 14 08:48:20.167497 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 08:48:20.167497 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 08:48:20.167497 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 57bc4ee1d3ae4513a389cb933904e571 Sep 14 08:48:20.167497 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-338931773-project Sep 14 08:48:20.167497 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 08:48:20.167497 n-d-836830-18 devstack@n-api.service[128758]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Sep 14 08:48:20.167497 n-d-836830-18 devstack@n-api.service[128758]: action_args: {} Sep 14 08:48:20.168127 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:48:20.168127 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:20.168127 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:48:20.168127 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:48:20.168127 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:48:20.168127 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:48:20.168127 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:48:20.168127 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:48:20.168127 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Sep 14 08:48:20.168127 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Sep 14 08:48:20.168127 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 14 08:48:20.168127 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 14 08:48:20.168127 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 14 08:48:20.168127 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 14 08:48:20.168127 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 14 08:48:20.168127 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 14 08:48:20.168127 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 14 08:48:20.168127 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise self.value Sep 14 08:48:20.168127 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 14 08:48:20.169131 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 14 08:48:20.169131 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 14 08:48:20.169131 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 14 08:48:20.169131 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 14 08:48:20.169131 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 14 08:48:20.169131 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Sep 14 08:48:20.169131 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:20.169131 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:48:20.169131 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:20.169131 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:20.169131 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:48:20.169131 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:48:20.169131 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 14 08:48:20.169131 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 14 08:48:20.169131 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Sep 14 08:48:20.169131 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:20.173089 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a7484cd0-3061-4618-b7b6-ccf06201bdfc tempest-AggregatesAdminNegativeTestJSON-338931773 tempest-AggregatesAdminNegativeTestJSON-338931773-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:48:20.178620 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-a7484cd0-3061-4618-b7b6-ccf06201bdfc tempest-AggregatesAdminNegativeTestJSON-338931773 tempest-AggregatesAdminNegativeTestJSON-338931773-project] 10.222.0.60 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.024023 Sep 14 08:48:20.185421 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 50/116] 10.222.0.60 () {58 vars in 1143 bytes} [Wed Sep 14 08:48:20 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 31 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 14 08:48:20.197218 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-0d01e1da-0900-4c7d-8ee6-9f1f9594f59a tempest-FlavorsAdminTestJSON-1934103607 tempest-FlavorsAdminTestJSON-1934103607-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:20.219527 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-0d01e1da-0900-4c7d-8ee6-9f1f9594f59a tempest-FlavorsAdminTestJSON-1934103607 tempest-FlavorsAdminTestJSON-1934103607-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 838 microversion: 2.1 time: 0.029842 Sep 14 08:48:20.236478 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 51/117] 10.222.0.60 () {58 vars in 1177 bytes} [Wed Sep 14 08:48:20 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 838 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:48:20.244794 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-35f6a0da-3a99-47e6-a79c-c36bd8b04442 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:20.248481 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-35f6a0da-3a99-47e6-a79c-c36bd8b04442 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] [instance: ef72dfda-b1e4-49c6-8830-33d25f6a4ec0] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:48:20.256119 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-35f6a0da-3a99-47e6-a79c-c36bd8b04442 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:20.257360 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-35f6a0da-3a99-47e6-a79c-c36bd8b04442 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:20.260068 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-35f6a0da-3a99-47e6-a79c-c36bd8b04442 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:20.262928 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-35f6a0da-3a99-47e6-a79c-c36bd8b04442 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:20.265715 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-35f6a0da-3a99-47e6-a79c-c36bd8b04442 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:20.267522 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-35f6a0da-3a99-47e6-a79c-c36bd8b04442 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:20.730256 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-35f6a0da-3a99-47e6-a79c-c36bd8b04442 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326618ebc864ba58c6df2c471c0f978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d1553889c474f75bd545166eff212b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:48:20.761447 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-35f6a0da-3a99-47e6-a79c-c36bd8b04442 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] 10.222.0.60 "GET /compute/v2.1/servers/ef72dfda-b1e4-49c6-8830-33d25f6a4ec0" status: 200 len: 1296 microversion: 2.1 time: 0.523328 Sep 14 08:48:20.766063 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 52/118] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:48:20 2022] GET /compute/v2.1/servers/ef72dfda-b1e4-49c6-8830-33d25f6a4ec0 => generated 1296 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:48:20.775189 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-92f9d3b2-5b54-49e3-8239-46ef196e9dcd tempest-FlavorsAdminTestJSON-1934103607 tempest-FlavorsAdminTestJSON-1934103607-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:20.822345 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-92f9d3b2-5b54-49e3-8239-46ef196e9dcd tempest-FlavorsAdminTestJSON-1934103607 tempest-FlavorsAdminTestJSON-1934103607-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 838 microversion: 2.1 time: 0.052688 Sep 14 08:48:20.826115 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 53/119] 10.222.0.60 () {58 vars in 1171 bytes} [Wed Sep 14 08:48:20 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 838 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:48:20.837255 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-21980449-b78c-4ba9-947b-976f23bb6f92 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:20.846592 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-21980449-b78c-4ba9-947b-976f23bb6f92 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] [instance: 7045fd2e-8224-46b8-b477-57a46e18e93f] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:48:20.871112 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-21980449-b78c-4ba9-947b-976f23bb6f92 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:20.872818 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-21980449-b78c-4ba9-947b-976f23bb6f92 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:20.874300 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-21980449-b78c-4ba9-947b-976f23bb6f92 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:20.879270 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-21980449-b78c-4ba9-947b-976f23bb6f92 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:20.881551 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-21980449-b78c-4ba9-947b-976f23bb6f92 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:20.884200 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-21980449-b78c-4ba9-947b-976f23bb6f92 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:20.961084 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-2354f9de-b021-4b6d-8be0-35bd5fedd7a5 tempest-FlavorsAccessNegativeTestJSON-1040633479 tempest-FlavorsAccessNegativeTestJSON-1040633479-project-admin] HTTP exception thrown: Flavor access not found for 28 / 48ddd7e69eaf4971bc11ae5c7b2527ea combination. Sep 14 08:48:20.965345 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-2354f9de-b021-4b6d-8be0-35bd5fedd7a5 tempest-FlavorsAccessNegativeTestJSON-1040633479 tempest-FlavorsAccessNegativeTestJSON-1040633479-project-admin] Request method failure captured: Sep 14 08:48:20.965345 n-d-836830-18 devstack@n-api.service[128759]: request: POST /compute/v2.1/flavors/290179358/action HTTP/1.1 Sep 14 08:48:20.965345 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 08:48:20.965345 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 08:48:20.965345 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 08:48:20.965345 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 70 Sep 14 08:48:20.965345 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 08:48:20.965345 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 08:48:20.965345 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 08:48:20.965345 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 08:48:20.965345 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZVKJSjyzZGCJzjQRHZ-EUrDD7WgAPnGvswjBafnVQ4h7JSbfb9grJSyQlLqMEDjsnfwCvFjAT63xncqb7xWI9hW9N24x5jvHJ7DoIbjudemZDLyrpsoYD5x87jmuEfBIUhg7wuyjt39GOBnMJHmo2entNXbBjFuc6BUyN2NhXbAVtA Sep 14 08:48:20.965345 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 08:48:20.965345 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 08:48:20.965345 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 08:48:20.965345 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 08:48:20.965345 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 08:48:20.965345 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 08:48:20.965345 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 63a0319d101b4b63bb7f2c8d33f4dcfa Sep 14 08:48:20.965345 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1040633479 Sep 14 08:48:20.965345 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member,admin Sep 14 08:48:20.965345 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member,admin Sep 14 08:48:20.966615 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/63a0319d101b4b63bb7f2c8d33f4dcfa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_63a0319d101b4b63bb7f2c8d33f4dcfa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/63a0319d101b4b63bb7f2c8d33f4dcfa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/63a0319d101b4b63bb7f2c8d33f4dcfa"}]}] Sep 14 08:48:20.966615 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1040633479 Sep 14 08:48:20.966615 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 63a0319d101b4b63bb7f2c8d33f4dcfa Sep 14 08:48:20.966615 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1040633479 Sep 14 08:48:20.966615 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-FlavorsAccessNegativeTestJSON-1040633479-project-admin Sep 14 08:48:20.966615 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 08:48:20.966615 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 08:48:20.966615 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 681b897863214207b167ab006909a66a Sep 14 08:48:20.966615 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1040633479-project-admin Sep 14 08:48:20.966615 n-d-836830-18 devstack@n-api.service[128759]: Sep 14 08:48:20.966615 n-d-836830-18 devstack@n-api.service[128759]: {"removeTenantAccess": {"tenant": "48ddd7e69eaf4971bc11ae5c7b2527ea"}} Sep 14 08:48:20.966615 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 08:48:20.967377 n-d-836830-18 devstack@n-api.service[128759]: exception: Flavor access not found for 28 / 48ddd7e69eaf4971bc11ae5c7b2527ea combination. Sep 14 08:48:20.967377 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '290179358', 'body': {'removeTenantAccess': {'tenant': '48ddd7e69eaf4971bc11ae5c7b2527ea'}}} Sep 14 08:48:20.967377 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:48:20.967377 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:20.967377 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Sep 14 08:48:20.967377 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Sep 14 08:48:20.967377 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 14 08:48:20.967377 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 14 08:48:20.967377 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Sep 14 08:48:20.967377 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Sep 14 08:48:20.967377 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Sep 14 08:48:20.967377 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Sep 14 08:48:20.967377 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Sep 14 08:48:20.967377 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Sep 14 08:48:20.967377 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 14 08:48:20.967377 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 14 08:48:20.967377 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Sep 14 08:48:20.967377 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Sep 14 08:48:20.968462 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 28 / 48ddd7e69eaf4971bc11ae5c7b2527ea combination. Sep 14 08:48:20.968462 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:48:20.968462 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:48:20.968462 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:48:20.968462 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:20.968462 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:48:20.968462 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:48:20.968462 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:48:20.968462 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:48:20.968462 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:48:20.968462 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:48:20.968462 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 08:48:20.968462 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 08:48:20.968462 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Sep 14 08:48:20.968462 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 14 08:48:20.968462 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 28 / 48ddd7e69eaf4971bc11ae5c7b2527ea combination. Sep 14 08:48:20.968462 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:48:20.968462 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:48:20.968462 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:48:20.968462 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:20.969606 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:48:20.969606 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:48:20.969606 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:48:20.969606 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:48:20.969606 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 28 / 48ddd7e69eaf4971bc11ae5c7b2527ea combination. Sep 14 08:48:20.969606 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:48:20.969606 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-2354f9de-b021-4b6d-8be0-35bd5fedd7a5 tempest-FlavorsAccessNegativeTestJSON-1040633479 tempest-FlavorsAccessNegativeTestJSON-1040633479-project-admin] Returning 404 to user: Flavor access not found for 28 / 48ddd7e69eaf4971bc11ae5c7b2527ea combination. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:48:20.972663 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-2354f9de-b021-4b6d-8be0-35bd5fedd7a5 tempest-FlavorsAccessNegativeTestJSON-1040633479 tempest-FlavorsAccessNegativeTestJSON-1040633479-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors/290179358/action" status: 404 len: 124 microversion: 2.1 time: 0.945585 Sep 14 08:48:20.973265 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 67/120] 10.222.0.60 () {60 vars in 1197 bytes} [Wed Sep 14 08:48:20 2022] POST /compute/v2.1/flavors/290179358/action => generated 124 bytes in 954 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 08:48:20.992035 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-97401ca6-537c-4374-a033-d73e8b30077c tempest-FlavorsAdminTestJSON-1934103607 tempest-FlavorsAdminTestJSON-1934103607-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:21.075790 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-97401ca6-537c-4374-a033-d73e8b30077c tempest-FlavorsAdminTestJSON-1934103607 tempest-FlavorsAdminTestJSON-1934103607-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 838 microversion: 2.1 time: 0.095586 Sep 14 08:48:21.082278 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 68/121] 10.222.0.60 () {58 vars in 1169 bytes} [Wed Sep 14 08:48:20 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 838 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:48:21.095366 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-501896b7-957f-496a-87c3-00e522fc0709 tempest-FlavorsAccessNegativeTestJSON-1040633479 tempest-FlavorsAccessNegativeTestJSON-1040633479-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:21.163217 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-501896b7-957f-496a-87c3-00e522fc0709 tempest-FlavorsAccessNegativeTestJSON-1040633479 tempest-FlavorsAccessNegativeTestJSON-1040633479-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/290179358" status: 202 len: 0 microversion: 2.1 time: 0.079241 Sep 14 08:48:21.167097 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 69/122] 10.222.0.60 () {58 vars in 1158 bytes} [Wed Sep 14 08:48:21 2022] DELETE /compute/v2.1/flavors/290179358 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 08:48:21.176895 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9db45f3f-6e7c-4625-be4d-2c1a4bca9c4b tempest-FlavorsAdminTestJSON-1934103607 tempest-FlavorsAdminTestJSON-1934103607-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:21.230570 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-9db45f3f-6e7c-4625-be4d-2c1a4bca9c4b tempest-FlavorsAdminTestJSON-1934103607 tempest-FlavorsAdminTestJSON-1934103607-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5391 microversion: 2.1 time: 0.062276 Sep 14 08:48:21.233688 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 70/123] 10.222.0.60 () {58 vars in 1169 bytes} [Wed Sep 14 08:48:21 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5391 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:48:21.239008 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-7c97eb53-03c0-4fa4-b302-87397e321dc4 tempest-FlavorsAccessNegativeTestJSON-1040633479 tempest-FlavorsAccessNegativeTestJSON-1040633479-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:21.290517 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-7c97eb53-03c0-4fa4-b302-87397e321dc4 tempest-FlavorsAccessNegativeTestJSON-1040633479 tempest-FlavorsAccessNegativeTestJSON-1040633479-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 5391 microversion: 2.1 time: 0.049649 Sep 14 08:48:21.303746 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 71/124] 10.222.0.60 () {58 vars in 1146 bytes} [Wed Sep 14 08:48:21 2022] GET /compute/v2.1/flavors/detail => generated 5391 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:48:21.314903 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b17b82d3-e15c-45ad-a246-58a8b95bc82b tempest-FlavorsAdminTestJSON-1934103607 tempest-FlavorsAdminTestJSON-1934103607-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:21.380020 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b17b82d3-e15c-45ad-a246-58a8b95bc82b tempest-FlavorsAdminTestJSON-1934103607 tempest-FlavorsAdminTestJSON-1934103607-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5391 microversion: 2.1 time: 0.073611 Sep 14 08:48:21.380616 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 72/125] 10.222.0.60 () {58 vars in 1175 bytes} [Wed Sep 14 08:48:21 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5391 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:48:21.415010 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-6df09d4c-a787-40f2-b6b2-81b90feec480 tempest-FlavorsAdminTestJSON-1934103607 tempest-FlavorsAdminTestJSON-1934103607-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:21.472560 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-6df09d4c-a787-40f2-b6b2-81b90feec480 tempest-FlavorsAdminTestJSON-1934103607 tempest-FlavorsAdminTestJSON-1934103607-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5391 microversion: 2.1 time: 0.061958 Sep 14 08:48:21.493607 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 73/126] 10.222.0.60 () {58 vars in 1173 bytes} [Wed Sep 14 08:48:21 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5391 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:48:21.502767 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-cffc1aa3-8c8f-45da-adaf-35c76fb70e38 tempest-FlavorsAdminTestJSON-1934103607 tempest-FlavorsAdminTestJSON-1934103607-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:21.597410 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-cffc1aa3-8c8f-45da-adaf-35c76fb70e38 tempest-FlavorsAdminTestJSON-1934103607 tempest-FlavorsAdminTestJSON-1934103607-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5391 microversion: 2.1 time: 0.101791 Sep 14 08:48:21.599937 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 74/127] 10.222.0.60 () {58 vars in 1169 bytes} [Wed Sep 14 08:48:21 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5391 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:48:21.626749 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-7cf35d11-d918-4eda-a6df-1e6f260f4e6e tempest-FlavorsAdminTestJSON-1934103607 tempest-FlavorsAdminTestJSON-1934103607-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:21.669329 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-7cf35d11-d918-4eda-a6df-1e6f260f4e6e tempest-FlavorsAdminTestJSON-1934103607 tempest-FlavorsAdminTestJSON-1934103607-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/396132956" status: 202 len: 0 microversion: 2.1 time: 0.045393 Sep 14 08:48:21.674999 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 75/128] 10.222.0.60 () {58 vars in 1158 bytes} [Wed Sep 14 08:48:21 2022] DELETE /compute/v2.1/flavors/396132956 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 14 08:48:21.690414 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f41c2cef-1f65-484e-bbcd-692aece2e23f tempest-FlavorsAdminTestJSON-1934103607 tempest-FlavorsAdminTestJSON-1934103607-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:21.767613 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f41c2cef-1f65-484e-bbcd-692aece2e23f tempest-FlavorsAdminTestJSON-1934103607 tempest-FlavorsAdminTestJSON-1934103607-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.075355 Sep 14 08:48:21.773415 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 76/129] 10.222.0.60 () {58 vars in 1146 bytes} [Wed Sep 14 08:48:21 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:48:21.793538 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-665d897c-8b8c-4a12-865f-e69a45bceb9c tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:21.794465 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-665d897c-8b8c-4a12-865f-e69a45bceb9c tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] [instance: ef72dfda-b1e4-49c6-8830-33d25f6a4ec0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:48:21.809429 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-665d897c-8b8c-4a12-865f-e69a45bceb9c tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:21.809939 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-665d897c-8b8c-4a12-865f-e69a45bceb9c tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:21.810407 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-665d897c-8b8c-4a12-865f-e69a45bceb9c tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:21.811218 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-665d897c-8b8c-4a12-865f-e69a45bceb9c tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:21.815326 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-665d897c-8b8c-4a12-865f-e69a45bceb9c tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:21.822731 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-665d897c-8b8c-4a12-865f-e69a45bceb9c tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:21.968505 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-21980449-b78c-4ba9-947b-976f23bb6f92 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e462483415e4c2b8a917b2a032e5ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac4d0cae0bd46fda94d7bfb900a0b9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:48:21.977326 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-21980449-b78c-4ba9-947b-976f23bb6f92 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] 10.222.0.60 "GET /compute/v2.1/servers/7045fd2e-8224-46b8-b477-57a46e18e93f" status: 200 len: 1342 microversion: 2.1 time: 1.149251 Sep 14 08:48:21.979776 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 54/130] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:48:20 2022] GET /compute/v2.1/servers/7045fd2e-8224-46b8-b477-57a46e18e93f => generated 1342 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:48:21.990911 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-4b966809-011a-428f-9e55-7ab1cbb62be8 tempest-FlavorsAdminTestJSON-1934103607 tempest-FlavorsAdminTestJSON-1934103607-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:22.038730 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-4b966809-011a-428f-9e55-7ab1cbb62be8 tempest-FlavorsAdminTestJSON-1934103607 tempest-FlavorsAdminTestJSON-1934103607-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/29245773" status: 202 len: 0 microversion: 2.1 time: 0.057683 Sep 14 08:48:22.039811 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-665d897c-8b8c-4a12-865f-e69a45bceb9c tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326618ebc864ba58c6df2c471c0f978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d1553889c474f75bd545166eff212b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:48:22.044533 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 55/131] 10.222.0.60 () {58 vars in 1155 bytes} [Wed Sep 14 08:48:21 2022] DELETE /compute/v2.1/flavors/29245773 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 08:48:22.052637 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-da15e801-87d1-4bab-8193-65ec0d93a7ae tempest-FlavorsAdminTestJSON-1934103607 tempest-FlavorsAdminTestJSON-1934103607-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:22.057734 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-665d897c-8b8c-4a12-865f-e69a45bceb9c tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] 10.222.0.60 "GET /compute/v2.1/servers/ef72dfda-b1e4-49c6-8830-33d25f6a4ec0" status: 200 len: 1296 microversion: 2.1 time: 0.267936 Sep 14 08:48:22.064029 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 77/132] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:48:21 2022] GET /compute/v2.1/servers/ef72dfda-b1e4-49c6-8830-33d25f6a4ec0 => generated 1296 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:48:22.099497 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-da15e801-87d1-4bab-8193-65ec0d93a7ae tempest-FlavorsAdminTestJSON-1934103607 tempest-FlavorsAdminTestJSON-1934103607-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.050515 Sep 14 08:48:22.101004 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 56/133] 10.222.0.60 () {58 vars in 1146 bytes} [Wed Sep 14 08:48:22 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:48:22.124574 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-58e5608e-c43a-4e66-830e-56c98374cd60 tempest-FlavorsAdminTestJSON-1934103607 tempest-FlavorsAdminTestJSON-1934103607-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1015415982", "id": 37729189, "os-flavor-access:is_public": "False"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:48:22.191985 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-58e5608e-c43a-4e66-830e-56c98374cd60 tempest-FlavorsAdminTestJSON-1934103607 tempest-FlavorsAdminTestJSON-1934103607-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.1 time: 0.072086 Sep 14 08:48:22.194497 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 78/134] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 08:48:22 2022] POST /compute/v2.1/flavors => generated 409 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:48:22.209900 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-846dd04d-24f8-462d-9b72-d89f6b0e7e33 tempest-FlavorsAdminTestJSON-1934103607 tempest-FlavorsAdminTestJSON-1934103607-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:22.257558 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-846dd04d-24f8-462d-9b72-d89f6b0e7e33 tempest-FlavorsAdminTestJSON-1934103607 tempest-FlavorsAdminTestJSON-1934103607-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.051922 Sep 14 08:48:22.259762 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 57/135] 10.222.0.60 () {58 vars in 1146 bytes} [Wed Sep 14 08:48:22 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:48:22.282498 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-571ec1fe-6270-4732-b831-e3af5635e304 tempest-FlavorsAdminTestJSON-442745451 tempest-FlavorsAdminTestJSON-442745451-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:22.343725 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-571ec1fe-6270-4732-b831-e3af5635e304 tempest-FlavorsAdminTestJSON-442745451 tempest-FlavorsAdminTestJSON-442745451-project] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.065783 Sep 14 08:48:22.346544 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 79/136] 10.222.0.60 () {58 vars in 1146 bytes} [Wed Sep 14 08:48:22 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:48:22.369601 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-39f913b4-7eec-40e3-a1cf-db9fcd2b61e8 tempest-FlavorsAdminTestJSON-1934103607 tempest-FlavorsAdminTestJSON-1934103607-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:22.405839 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-39f913b4-7eec-40e3-a1cf-db9fcd2b61e8 tempest-FlavorsAdminTestJSON-1934103607 tempest-FlavorsAdminTestJSON-1934103607-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/37729189" status: 202 len: 0 microversion: 2.1 time: 0.039162 Sep 14 08:48:22.407011 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 58/137] 10.222.0.60 () {58 vars in 1155 bytes} [Wed Sep 14 08:48:22 2022] DELETE /compute/v2.1/flavors/37729189 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 08:48:22.417488 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-951fb73e-0c50-4bed-bb5a-c90cc6b23704 tempest-FlavorsAdminTestJSON-1934103607 tempest-FlavorsAdminTestJSON-1934103607-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:22.449708 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=75,nova_api:DELETE=20,nova_api:INSERT=5 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:48:22.509908 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-951fb73e-0c50-4bed-bb5a-c90cc6b23704 tempest-FlavorsAdminTestJSON-1934103607 tempest-FlavorsAdminTestJSON-1934103607-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.097848 Sep 14 08:48:22.510804 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 80/138] 10.222.0.60 () {58 vars in 1146 bytes} [Wed Sep 14 08:48:22 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:48:22.535444 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-2947c302-d77c-442e-a04a-0f5f38674fca tempest-FlavorsAdminTestJSON-1934103607 tempest-FlavorsAdminTestJSON-1934103607-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1205168054", "id": 1862322539, "os-flavor-access:is_public": "True"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:48:22.545862 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=7,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:DELETE=13 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:48:22.579470 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-2947c302-d77c-442e-a04a-0f5f38674fca tempest-FlavorsAdminTestJSON-1934103607 tempest-FlavorsAdminTestJSON-1934103607-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.044423 Sep 14 08:48:22.581624 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 59/139] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 08:48:22 2022] POST /compute/v2.1/flavors => generated 414 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:48:22.596992 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-6ba81dba-4482-4159-be95-f72b8b896d95 tempest-FlavorsAdminTestJSON-442745451 tempest-FlavorsAdminTestJSON-442745451-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:22.665983 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-6ba81dba-4482-4159-be95-f72b8b896d95 tempest-FlavorsAdminTestJSON-442745451 tempest-FlavorsAdminTestJSON-442745451-project] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.075494 Sep 14 08:48:22.679191 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 81/140] 10.222.0.60 () {58 vars in 1146 bytes} [Wed Sep 14 08:48:22 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:48:22.689806 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-f2691769-a737-4271-b32b-ac22a85ebe78 tempest-FlavorsAdminTestJSON-1934103607 tempest-FlavorsAdminTestJSON-1934103607-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:22.742637 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-f2691769-a737-4271-b32b-ac22a85ebe78 tempest-FlavorsAdminTestJSON-1934103607 tempest-FlavorsAdminTestJSON-1934103607-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/1862322539" status: 202 len: 0 microversion: 2.1 time: 0.056246 Sep 14 08:48:22.754272 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-afcff1a0-35fe-4d70-a279-c2056c98dd61 tempest-FlavorsAdminTestJSON-1934103607 tempest-FlavorsAdminTestJSON-1934103607-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:22.754578 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 60/141] 10.222.0.60 () {58 vars in 1161 bytes} [Wed Sep 14 08:48:22 2022] DELETE /compute/v2.1/flavors/1862322539 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 08:48:22.803677 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-afcff1a0-35fe-4d70-a279-c2056c98dd61 tempest-FlavorsAdminTestJSON-1934103607 tempest-FlavorsAdminTestJSON-1934103607-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.053978 Sep 14 08:48:22.806427 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 82/142] 10.222.0.60 () {58 vars in 1146 bytes} [Wed Sep 14 08:48:22 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:48:23.005254 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-71908aca-395f-48b0-b19c-fca588ccdaf4 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:23.006806 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-71908aca-395f-48b0-b19c-fca588ccdaf4 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] [instance: 7045fd2e-8224-46b8-b477-57a46e18e93f] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:48:23.023094 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-71908aca-395f-48b0-b19c-fca588ccdaf4 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:23.025825 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-71908aca-395f-48b0-b19c-fca588ccdaf4 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:23.026670 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-71908aca-395f-48b0-b19c-fca588ccdaf4 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:23.028366 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-71908aca-395f-48b0-b19c-fca588ccdaf4 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:23.031913 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-71908aca-395f-48b0-b19c-fca588ccdaf4 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:23.033075 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-71908aca-395f-48b0-b19c-fca588ccdaf4 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:23.093812 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-6c397aa8-87cd-4389-a609-8d94552ad1da tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:23.095273 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-6c397aa8-87cd-4389-a609-8d94552ad1da tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] [instance: ef72dfda-b1e4-49c6-8830-33d25f6a4ec0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:48:23.116024 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6c397aa8-87cd-4389-a609-8d94552ad1da tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:23.117645 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6c397aa8-87cd-4389-a609-8d94552ad1da tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:23.119950 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6c397aa8-87cd-4389-a609-8d94552ad1da tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:23.122044 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6c397aa8-87cd-4389-a609-8d94552ad1da tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:23.124663 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6c397aa8-87cd-4389-a609-8d94552ad1da tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:23.127242 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6c397aa8-87cd-4389-a609-8d94552ad1da tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:23.377021 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-6c397aa8-87cd-4389-a609-8d94552ad1da tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326618ebc864ba58c6df2c471c0f978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d1553889c474f75bd545166eff212b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:48:23.393178 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-6c397aa8-87cd-4389-a609-8d94552ad1da tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] 10.222.0.60 "GET /compute/v2.1/servers/ef72dfda-b1e4-49c6-8830-33d25f6a4ec0" status: 200 len: 1296 microversion: 2.1 time: 0.306450 Sep 14 08:48:23.431929 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 83/143] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:48:23 2022] GET /compute/v2.1/servers/ef72dfda-b1e4-49c6-8830-33d25f6a4ec0 => generated 1296 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:48:23.482336 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-71908aca-395f-48b0-b19c-fca588ccdaf4 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e462483415e4c2b8a917b2a032e5ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac4d0cae0bd46fda94d7bfb900a0b9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:48:23.493368 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-71908aca-395f-48b0-b19c-fca588ccdaf4 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] 10.222.0.60 "GET /compute/v2.1/servers/7045fd2e-8224-46b8-b477-57a46e18e93f" status: 200 len: 1342 microversion: 2.1 time: 0.493176 Sep 14 08:48:23.494521 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 61/144] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:48:22 2022] GET /compute/v2.1/servers/7045fd2e-8224-46b8-b477-57a46e18e93f => generated 1342 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:48:24.418732 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-1edf29c8-36b6-4d44-a093-77e4bdac5011 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:24.419608 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-1edf29c8-36b6-4d44-a093-77e4bdac5011 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] [instance: ef72dfda-b1e4-49c6-8830-33d25f6a4ec0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:48:24.446342 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1edf29c8-36b6-4d44-a093-77e4bdac5011 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:24.447844 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1edf29c8-36b6-4d44-a093-77e4bdac5011 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:24.450011 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1edf29c8-36b6-4d44-a093-77e4bdac5011 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:24.452647 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1edf29c8-36b6-4d44-a093-77e4bdac5011 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:24.458130 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1edf29c8-36b6-4d44-a093-77e4bdac5011 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:24.461570 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1edf29c8-36b6-4d44-a093-77e4bdac5011 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:24.521829 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-6e98b6c5-be9c-4c00-a653-1ffb0402a32f tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:24.522437 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-6e98b6c5-be9c-4c00-a653-1ffb0402a32f tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] [instance: 7045fd2e-8224-46b8-b477-57a46e18e93f] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:48:24.549860 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6e98b6c5-be9c-4c00-a653-1ffb0402a32f tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:24.579212 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6e98b6c5-be9c-4c00-a653-1ffb0402a32f tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:24.579926 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6e98b6c5-be9c-4c00-a653-1ffb0402a32f tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:24.586466 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6e98b6c5-be9c-4c00-a653-1ffb0402a32f tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:24.590033 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6e98b6c5-be9c-4c00-a653-1ffb0402a32f tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:24.590697 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6e98b6c5-be9c-4c00-a653-1ffb0402a32f tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:24.907008 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-1edf29c8-36b6-4d44-a093-77e4bdac5011 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326618ebc864ba58c6df2c471c0f978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d1553889c474f75bd545166eff212b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:48:24.921297 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-1edf29c8-36b6-4d44-a093-77e4bdac5011 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] 10.222.0.60 "GET /compute/v2.1/servers/ef72dfda-b1e4-49c6-8830-33d25f6a4ec0" status: 200 len: 1338 microversion: 2.1 time: 0.506068 Sep 14 08:48:24.923990 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 84/145] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:48:24 2022] GET /compute/v2.1/servers/ef72dfda-b1e4-49c6-8830-33d25f6a4ec0 => generated 1338 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:48:25.143178 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-6e98b6c5-be9c-4c00-a653-1ffb0402a32f tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e462483415e4c2b8a917b2a032e5ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac4d0cae0bd46fda94d7bfb900a0b9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:48:25.154650 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-6e98b6c5-be9c-4c00-a653-1ffb0402a32f tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] 10.222.0.60 "GET /compute/v2.1/servers/7045fd2e-8224-46b8-b477-57a46e18e93f" status: 200 len: 1342 microversion: 2.1 time: 0.637800 Sep 14 08:48:25.177094 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 62/146] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:48:24 2022] GET /compute/v2.1/servers/7045fd2e-8224-46b8-b477-57a46e18e93f => generated 1342 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:48:25.700341 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c9f06265-d4d4-49c9-a1a0-76dde1938972 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-82684439", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:48:25.818829 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.network.neutron [None req-c9f06265-d4d4-49c9-a1a0-76dde1938972 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] validate_networks() for None {{(pid=128759) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 08:48:25.949753 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-f0b84455-cb3b-4b31-9729-b258cf2ff0c2 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:25.951025 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-f0b84455-cb3b-4b31-9729-b258cf2ff0c2 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] [instance: ef72dfda-b1e4-49c6-8830-33d25f6a4ec0] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:48:25.989488 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f0b84455-cb3b-4b31-9729-b258cf2ff0c2 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:25.990055 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f0b84455-cb3b-4b31-9729-b258cf2ff0c2 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:25.990510 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f0b84455-cb3b-4b31-9729-b258cf2ff0c2 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:25.991340 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f0b84455-cb3b-4b31-9729-b258cf2ff0c2 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:25.991808 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f0b84455-cb3b-4b31-9729-b258cf2ff0c2 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:25.992243 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f0b84455-cb3b-4b31-9729-b258cf2ff0c2 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:26.791448 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-f0b84455-cb3b-4b31-9729-b258cf2ff0c2 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326618ebc864ba58c6df2c471c0f978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d1553889c474f75bd545166eff212b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:48:26.808161 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-f0b84455-cb3b-4b31-9729-b258cf2ff0c2 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] 10.222.0.60 "GET /compute/v2.1/servers/ef72dfda-b1e4-49c6-8830-33d25f6a4ec0" status: 200 len: 1338 microversion: 2.1 time: 0.865899 Sep 14 08:48:26.837670 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 63/147] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:48:25 2022] GET /compute/v2.1/servers/ef72dfda-b1e4-49c6-8830-33d25f6a4ec0 => generated 1338 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:48:26.847508 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-e39ef6d7-cf27-4403-a6fc-fd7ba1e80d83 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:26.848645 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-e39ef6d7-cf27-4403-a6fc-fd7ba1e80d83 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] [instance: 7045fd2e-8224-46b8-b477-57a46e18e93f] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:48:26.859999 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e39ef6d7-cf27-4403-a6fc-fd7ba1e80d83 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:26.862187 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e39ef6d7-cf27-4403-a6fc-fd7ba1e80d83 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:26.863394 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e39ef6d7-cf27-4403-a6fc-fd7ba1e80d83 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:26.865834 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e39ef6d7-cf27-4403-a6fc-fd7ba1e80d83 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:26.866554 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e39ef6d7-cf27-4403-a6fc-fd7ba1e80d83 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:26.867518 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e39ef6d7-cf27-4403-a6fc-fd7ba1e80d83 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:26.905095 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=8 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:48:27.138096 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-c9f06265-d4d4-49c9-a1a0-76dde1938972 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Flavor limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 08:48:27.140021 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-c9f06265-d4d4-49c9-a1a0-76dde1938972 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Image limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 08:48:27.140853 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-c9f06265-d4d4-49c9-a1a0-76dde1938972 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Flavor pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 08:48:27.141607 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-c9f06265-d4d4-49c9-a1a0-76dde1938972 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Image pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 08:48:27.142204 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-c9f06265-d4d4-49c9-a1a0-76dde1938972 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 08:48:27.163744 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c9f06265-d4d4-49c9-a1a0-76dde1938972 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:27.164549 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c9f06265-d4d4-49c9-a1a0-76dde1938972 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:27.165204 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c9f06265-d4d4-49c9-a1a0-76dde1938972 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:27.166466 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c9f06265-d4d4-49c9-a1a0-76dde1938972 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:27.171052 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c9f06265-d4d4-49c9-a1a0-76dde1938972 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:27.171937 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c9f06265-d4d4-49c9-a1a0-76dde1938972 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:27.228693 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-c9f06265-d4d4-49c9-a1a0-76dde1938972 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Getting quotas for project 8fd62edd611c4390be2403972b99aa15. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 08:48:27.241120 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-c9f06265-d4d4-49c9-a1a0-76dde1938972 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Getting quotas for user 264fb30236d54248ad0ecf79a177849f and project 8fd62edd611c4390be2403972b99aa15. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 08:48:27.270011 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-c9f06265-d4d4-49c9-a1a0-76dde1938972 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Going to run 1 instances... {{(pid=128759) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 08:48:27.279965 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-c9f06265-d4d4-49c9-a1a0-76dde1938972 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: 0a331816-6b06-40c9-a557-eada274501b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128759) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 08:48:27.312659 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-e39ef6d7-cf27-4403-a6fc-fd7ba1e80d83 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e462483415e4c2b8a917b2a032e5ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac4d0cae0bd46fda94d7bfb900a0b9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:48:27.332778 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-e39ef6d7-cf27-4403-a6fc-fd7ba1e80d83 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] 10.222.0.60 "GET /compute/v2.1/servers/7045fd2e-8224-46b8-b477-57a46e18e93f" status: 200 len: 1342 microversion: 2.1 time: 0.493715 Sep 14 08:48:27.355954 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 64/148] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:48:26 2022] GET /compute/v2.1/servers/7045fd2e-8224-46b8-b477-57a46e18e93f => generated 1342 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:48:27.454127 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-c9f06265-d4d4-49c9-a1a0-76dde1938972 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.528837 Sep 14 08:48:27.459499 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 85/149] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 08:48:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 2535 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 08:48:27.907191 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=8 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:48:28.042898 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-7077efeb-b441-4255-809d-e08e36de0d00 req-852889a7-1439-42f4-9044-854e6d45e42d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef72dfda-b1e4-49c6-8830-33d25f6a4ec0", "tag": "79944610-1b41-47dc-b7f4-3b8812c658aa"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:48:28.086412 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-7077efeb-b441-4255-809d-e08e36de0d00 req-852889a7-1439-42f4-9044-854e6d45e42d service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:28.088476 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-7077efeb-b441-4255-809d-e08e36de0d00 req-852889a7-1439-42f4-9044-854e6d45e42d service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:28.091612 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-7077efeb-b441-4255-809d-e08e36de0d00 req-852889a7-1439-42f4-9044-854e6d45e42d service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:28.133452 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-4a0d6049-7450-43eb-8fac-b1f780ed27f9 req-526e0726-3418-4648-bfef-576930ee0a33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7045fd2e-8224-46b8-b477-57a46e18e93f", "tag": "ac6596d6-502b-4db1-8535-84f8989dd969"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:48:28.149476 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-7077efeb-b441-4255-809d-e08e36de0d00 req-852889a7-1439-42f4-9044-854e6d45e42d service nova] Creating event network-changed:79944610-1b41-47dc-b7f4-3b8812c658aa for instance ef72dfda-b1e4-49c6-8830-33d25f6a4ec0 on n-h2-836830-18 Sep 14 08:48:28.150905 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-7077efeb-b441-4255-809d-e08e36de0d00 req-852889a7-1439-42f4-9044-854e6d45e42d service nova] Acquiring lock "compute-rpcapi-router" {{(pid=128759) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 14 08:48:28.152489 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-7077efeb-b441-4255-809d-e08e36de0d00 req-852889a7-1439-42f4-9044-854e6d45e42d service nova] Acquired lock "compute-rpcapi-router" {{(pid=128759) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 14 08:48:28.156569 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fad052b1-b37b-4163-8142-58446bdb72dc None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:28.158503 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fad052b1-b37b-4163-8142-58446bdb72dc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:28.160561 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fad052b1-b37b-4163-8142-58446bdb72dc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:28.162062 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fad052b1-b37b-4163-8142-58446bdb72dc None None] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:28.163739 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fad052b1-b37b-4163-8142-58446bdb72dc None None] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:28.165435 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fad052b1-b37b-4163-8142-58446bdb72dc None None] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:28.173692 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-4a0d6049-7450-43eb-8fac-b1f780ed27f9 req-526e0726-3418-4648-bfef-576930ee0a33 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:28.174599 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-4a0d6049-7450-43eb-8fac-b1f780ed27f9 req-526e0726-3418-4648-bfef-576930ee0a33 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:28.178554 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-4a0d6049-7450-43eb-8fac-b1f780ed27f9 req-526e0726-3418-4648-bfef-576930ee0a33 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:28.199535 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.compute.rpcapi [None req-fad052b1-b37b-4163-8142-58446bdb72dc None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 14 08:48:28.202461 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fad052b1-b37b-4163-8142-58446bdb72dc None None] Releasing lock "compute-rpcapi-router" {{(pid=128759) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 14 08:48:28.245204 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-fad052b1-b37b-4163-8142-58446bdb72dc None None] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.773779 Sep 14 08:48:28.245403 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-4a0d6049-7450-43eb-8fac-b1f780ed27f9 req-526e0726-3418-4648-bfef-576930ee0a33 service nova] Creating event network-changed:ac6596d6-502b-4db1-8535-84f8989dd969 for instance 7045fd2e-8224-46b8-b477-57a46e18e93f on n-h2-836830-18 Sep 14 08:48:28.250430 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 86/150] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:48:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:48:28.251888 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-4a0d6049-7450-43eb-8fac-b1f780ed27f9 req-526e0726-3418-4648-bfef-576930ee0a33 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.893000 Sep 14 08:48:28.258923 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 65/151] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:48:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:48:28.265644 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f2f611d9-67ed-48d1-b9a4-de9c34c9629d tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:28.271852 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f2f611d9-67ed-48d1-b9a4-de9c34c9629d tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: 0a331816-6b06-40c9-a557-eada274501b5] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:48:28.274493 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-dc0cfeda-0cc2-45ac-ac0a-56b9719aafd4 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:28.274493 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-dc0cfeda-0cc2-45ac-ac0a-56b9719aafd4 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] [instance: ef72dfda-b1e4-49c6-8830-33d25f6a4ec0] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:48:28.288660 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dc0cfeda-0cc2-45ac-ac0a-56b9719aafd4 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:28.290914 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dc0cfeda-0cc2-45ac-ac0a-56b9719aafd4 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:28.293491 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dc0cfeda-0cc2-45ac-ac0a-56b9719aafd4 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:28.294596 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dc0cfeda-0cc2-45ac-ac0a-56b9719aafd4 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:28.295978 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dc0cfeda-0cc2-45ac-ac0a-56b9719aafd4 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:28.297769 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dc0cfeda-0cc2-45ac-ac0a-56b9719aafd4 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:28.437975 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f2f611d9-67ed-48d1-b9a4-de9c34c9629d tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:48:28.448225 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f2f611d9-67ed-48d1-b9a4-de9c34c9629d tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/0a331816-6b06-40c9-a557-eada274501b5" status: 200 len: 1211 microversion: 2.1 time: 0.196125 Sep 14 08:48:28.454888 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 87/152] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:48:28 2022] GET /compute/v2.1/servers/0a331816-6b06-40c9-a557-eada274501b5 => generated 1211 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:48:28.475668 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f76a8c3a-60fe-46ff-8fd2-308cee973c30 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:28.477060 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f76a8c3a-60fe-46ff-8fd2-308cee973c30 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] [instance: 7045fd2e-8224-46b8-b477-57a46e18e93f] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:48:28.502932 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f76a8c3a-60fe-46ff-8fd2-308cee973c30 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:28.503516 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f76a8c3a-60fe-46ff-8fd2-308cee973c30 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:28.504082 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f76a8c3a-60fe-46ff-8fd2-308cee973c30 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:28.504741 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f76a8c3a-60fe-46ff-8fd2-308cee973c30 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:28.505266 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f76a8c3a-60fe-46ff-8fd2-308cee973c30 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:28.517525 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f76a8c3a-60fe-46ff-8fd2-308cee973c30 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:29.377421 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-dc0cfeda-0cc2-45ac-ac0a-56b9719aafd4 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326618ebc864ba58c6df2c471c0f978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d1553889c474f75bd545166eff212b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:48:29.393740 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-dc0cfeda-0cc2-45ac-ac0a-56b9719aafd4 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] 10.222.0.60 "GET /compute/v2.1/servers/ef72dfda-b1e4-49c6-8830-33d25f6a4ec0" status: 200 len: 1338 microversion: 2.1 time: 1.133151 Sep 14 08:48:29.394328 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 66/153] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:48:28 2022] GET /compute/v2.1/servers/ef72dfda-b1e4-49c6-8830-33d25f6a4ec0 => generated 1338 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:48:29.527737 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f76a8c3a-60fe-46ff-8fd2-308cee973c30 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e462483415e4c2b8a917b2a032e5ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac4d0cae0bd46fda94d7bfb900a0b9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:48:29.539359 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f76a8c3a-60fe-46ff-8fd2-308cee973c30 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] 10.222.0.60 "GET /compute/v2.1/servers/7045fd2e-8224-46b8-b477-57a46e18e93f" status: 200 len: 1342 microversion: 2.1 time: 1.077499 Sep 14 08:48:29.554127 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 88/154] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:48:28 2022] GET /compute/v2.1/servers/7045fd2e-8224-46b8-b477-57a46e18e93f => generated 1342 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:48:29.554127 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f76a8c3a-60fe-46ff-8fd2-308cee973c30 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:29.554127 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f76a8c3a-60fe-46ff-8fd2-308cee973c30 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] 10.222.0.60 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002743 Sep 14 08:48:29.554127 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 89/155] 10.222.0.60 () {56 vars in 886 bytes} [Wed Sep 14 08:48:29 2022] GET /compute/ => generated 377 bytes in 7 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Sep 14 08:48:29.561243 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b8fa9452-c609-4159-98ae-aaefec441ae7 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:29.562144 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b8fa9452-c609-4159-98ae-aaefec441ae7 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: 0a331816-6b06-40c9-a557-eada274501b5] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:48:29.575732 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b8fa9452-c609-4159-98ae-aaefec441ae7 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:29.577031 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b8fa9452-c609-4159-98ae-aaefec441ae7 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:29.577895 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b8fa9452-c609-4159-98ae-aaefec441ae7 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:29.580778 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b8fa9452-c609-4159-98ae-aaefec441ae7 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:29.581455 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b8fa9452-c609-4159-98ae-aaefec441ae7 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:29.582051 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b8fa9452-c609-4159-98ae-aaefec441ae7 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:29.907058 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b8fa9452-c609-4159-98ae-aaefec441ae7 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:48:29.915392 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b8fa9452-c609-4159-98ae-aaefec441ae7 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/0a331816-6b06-40c9-a557-eada274501b5" status: 200 len: 1271 microversion: 2.1 time: 0.365574 Sep 14 08:48:29.921025 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 90/156] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:48:29 2022] GET /compute/v2.1/servers/0a331816-6b06-40c9-a557-eada274501b5 => generated 1271 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:48:30.246295 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1ba1a335-3240-44c8-9b42-fb8ed09435ca tempest-InstanceUsageAuditLogTestJSON-942502963 tempest-InstanceUsageAuditLogTestJSON-942502963-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:30.292553 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-1ba1a335-3240-44c8-9b42-fb8ed09435ca tempest-InstanceUsageAuditLogTestJSON-942502963 tempest-InstanceUsageAuditLogTestJSON-942502963-project-admin] 10.222.0.60 "GET /compute/v2.1/os-instance_usage_audit_log/2022-09-14 08:48:28" status: 200 len: 318 microversion: 2.1 time: 0.884538 Sep 14 08:48:30.297674 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 67/157] 10.222.0.60 () {58 vars in 1251 bytes} [Wed Sep 14 08:48:29 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-09-14%2008%3A48%3A28 => generated 318 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:48:30.312391 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-eded029f-1f69-47b0-8d41-d1a0d6d8e5d9 tempest-InstanceUsageAuditLogTestJSON-942502963 tempest-InstanceUsageAuditLogTestJSON-942502963-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:30.360887 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-eded029f-1f69-47b0-8d41-d1a0d6d8e5d9 tempest-InstanceUsageAuditLogTestJSON-942502963 tempest-InstanceUsageAuditLogTestJSON-942502963-project-admin] 10.222.0.60 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.052132 Sep 14 08:48:30.365574 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 91/158] 10.222.0.60 () {58 vars in 1185 bytes} [Wed Sep 14 08:48:30 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:48:30.418101 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-90364529-2ee3-413b-9b50-4837f137ca16 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:30.418754 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-90364529-2ee3-413b-9b50-4837f137ca16 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] [instance: ef72dfda-b1e4-49c6-8830-33d25f6a4ec0] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:48:30.433112 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-90364529-2ee3-413b-9b50-4837f137ca16 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:30.433627 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-90364529-2ee3-413b-9b50-4837f137ca16 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:30.434077 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-90364529-2ee3-413b-9b50-4837f137ca16 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:30.439592 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-90364529-2ee3-413b-9b50-4837f137ca16 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:30.440081 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-90364529-2ee3-413b-9b50-4837f137ca16 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:30.440696 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-90364529-2ee3-413b-9b50-4837f137ca16 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:30.569078 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f398c37f-3de4-45e1-a5fa-bef182f6379f tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:30.569702 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f398c37f-3de4-45e1-a5fa-bef182f6379f tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] [instance: 7045fd2e-8224-46b8-b477-57a46e18e93f] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:48:30.581431 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f398c37f-3de4-45e1-a5fa-bef182f6379f tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:30.583238 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f398c37f-3de4-45e1-a5fa-bef182f6379f tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:30.585060 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f398c37f-3de4-45e1-a5fa-bef182f6379f tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:30.589262 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f398c37f-3de4-45e1-a5fa-bef182f6379f tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:30.590550 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f398c37f-3de4-45e1-a5fa-bef182f6379f tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:30.592957 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f398c37f-3de4-45e1-a5fa-bef182f6379f tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:31.229747 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f398c37f-3de4-45e1-a5fa-bef182f6379f tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e462483415e4c2b8a917b2a032e5ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac4d0cae0bd46fda94d7bfb900a0b9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:48:31.253550 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f398c37f-3de4-45e1-a5fa-bef182f6379f tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] 10.222.0.60 "GET /compute/v2.1/servers/7045fd2e-8224-46b8-b477-57a46e18e93f" status: 200 len: 1342 microversion: 2.1 time: 0.688044 Sep 14 08:48:31.277117 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 92/159] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:48:30 2022] GET /compute/v2.1/servers/7045fd2e-8224-46b8-b477-57a46e18e93f => generated 1342 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:48:31.296828 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-7bc9ce1e-79c1-44f5-855f-09fb370f11ee tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:31.298354 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-7bc9ce1e-79c1-44f5-855f-09fb370f11ee tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: 0a331816-6b06-40c9-a557-eada274501b5] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:48:31.321711 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7bc9ce1e-79c1-44f5-855f-09fb370f11ee tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:31.323436 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7bc9ce1e-79c1-44f5-855f-09fb370f11ee tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:31.324790 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7bc9ce1e-79c1-44f5-855f-09fb370f11ee tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:31.325743 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7bc9ce1e-79c1-44f5-855f-09fb370f11ee tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:31.327490 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7bc9ce1e-79c1-44f5-855f-09fb370f11ee tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:31.328287 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7bc9ce1e-79c1-44f5-855f-09fb370f11ee tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:31.387478 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-90364529-2ee3-413b-9b50-4837f137ca16 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326618ebc864ba58c6df2c471c0f978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d1553889c474f75bd545166eff212b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:48:31.401992 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-90364529-2ee3-413b-9b50-4837f137ca16 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] 10.222.0.60 "GET /compute/v2.1/servers/ef72dfda-b1e4-49c6-8830-33d25f6a4ec0" status: 200 len: 1338 microversion: 2.1 time: 0.988103 Sep 14 08:48:31.402597 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 68/160] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:48:30 2022] GET /compute/v2.1/servers/ef72dfda-b1e4-49c6-8830-33d25f6a4ec0 => generated 1338 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:48:31.411787 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=100 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:48:31.544022 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-7bc9ce1e-79c1-44f5-855f-09fb370f11ee tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:48:31.560072 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-7bc9ce1e-79c1-44f5-855f-09fb370f11ee tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/0a331816-6b06-40c9-a557-eada274501b5" status: 200 len: 1269 microversion: 2.1 time: 0.281672 Sep 14 08:48:31.562393 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 93/161] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:48:31 2022] GET /compute/v2.1/servers/0a331816-6b06-40c9-a557-eada274501b5 => generated 1269 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:48:32.278445 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-fea6baa3-6576-45f6-8042-9844cb32306f tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:32.279327 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-fea6baa3-6576-45f6-8042-9844cb32306f tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] [instance: 7045fd2e-8224-46b8-b477-57a46e18e93f] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:48:32.286353 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fea6baa3-6576-45f6-8042-9844cb32306f tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:32.286854 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fea6baa3-6576-45f6-8042-9844cb32306f tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:32.287323 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fea6baa3-6576-45f6-8042-9844cb32306f tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:32.295327 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fea6baa3-6576-45f6-8042-9844cb32306f tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:32.295823 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fea6baa3-6576-45f6-8042-9844cb32306f tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:32.298200 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fea6baa3-6576-45f6-8042-9844cb32306f tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:32.432589 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b705a29a-7dde-419e-829b-ffe2c4335ecd tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:32.434525 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b705a29a-7dde-419e-829b-ffe2c4335ecd tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] [instance: ef72dfda-b1e4-49c6-8830-33d25f6a4ec0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:48:32.461161 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b705a29a-7dde-419e-829b-ffe2c4335ecd tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:32.462382 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b705a29a-7dde-419e-829b-ffe2c4335ecd tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:32.463973 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b705a29a-7dde-419e-829b-ffe2c4335ecd tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:32.466504 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b705a29a-7dde-419e-829b-ffe2c4335ecd tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:32.467032 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b705a29a-7dde-419e-829b-ffe2c4335ecd tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:32.469248 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b705a29a-7dde-419e-829b-ffe2c4335ecd tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:32.733583 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-fea6baa3-6576-45f6-8042-9844cb32306f tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e462483415e4c2b8a917b2a032e5ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac4d0cae0bd46fda94d7bfb900a0b9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:48:32.745676 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-fea6baa3-6576-45f6-8042-9844cb32306f tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] 10.222.0.60 "GET /compute/v2.1/servers/7045fd2e-8224-46b8-b477-57a46e18e93f" status: 200 len: 1342 microversion: 2.1 time: 0.471660 Sep 14 08:48:32.749090 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 69/162] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:48:32 2022] GET /compute/v2.1/servers/7045fd2e-8224-46b8-b477-57a46e18e93f => generated 1342 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:48:32.760605 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-69da741e-9362-4765-8c27-5898738e66c0 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:32.761583 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-69da741e-9362-4765-8c27-5898738e66c0 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: 0a331816-6b06-40c9-a557-eada274501b5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:48:32.779672 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-69da741e-9362-4765-8c27-5898738e66c0 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:32.780574 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-69da741e-9362-4765-8c27-5898738e66c0 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:32.781276 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-69da741e-9362-4765-8c27-5898738e66c0 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:32.784088 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-69da741e-9362-4765-8c27-5898738e66c0 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:32.784795 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-69da741e-9362-4765-8c27-5898738e66c0 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:32.786539 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-69da741e-9362-4765-8c27-5898738e66c0 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:32.801708 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=100 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:48:32.979869 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b705a29a-7dde-419e-829b-ffe2c4335ecd tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326618ebc864ba58c6df2c471c0f978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d1553889c474f75bd545166eff212b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:48:32.998121 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b705a29a-7dde-419e-829b-ffe2c4335ecd tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] 10.222.0.60 "GET /compute/v2.1/servers/ef72dfda-b1e4-49c6-8830-33d25f6a4ec0" status: 200 len: 1338 microversion: 2.1 time: 0.574530 Sep 14 08:48:33.001170 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 94/163] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:48:32 2022] GET /compute/v2.1/servers/ef72dfda-b1e4-49c6-8830-33d25f6a4ec0 => generated 1338 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:48:33.202141 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-69da741e-9362-4765-8c27-5898738e66c0 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:48:33.246874 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-69da741e-9362-4765-8c27-5898738e66c0 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/0a331816-6b06-40c9-a557-eada274501b5" status: 200 len: 1311 microversion: 2.1 time: 0.495746 Sep 14 08:48:33.251080 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 70/164] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:48:32 2022] GET /compute/v2.1/servers/0a331816-6b06-40c9-a557-eada274501b5 => generated 1311 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:48:33.780797 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b23474d7-2102-471b-8146-0371d5c72f97 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:33.781424 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b23474d7-2102-471b-8146-0371d5c72f97 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] [instance: 7045fd2e-8224-46b8-b477-57a46e18e93f] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:48:33.789075 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b23474d7-2102-471b-8146-0371d5c72f97 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:33.789576 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b23474d7-2102-471b-8146-0371d5c72f97 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:33.791868 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b23474d7-2102-471b-8146-0371d5c72f97 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:33.794287 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b23474d7-2102-471b-8146-0371d5c72f97 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:33.794967 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b23474d7-2102-471b-8146-0371d5c72f97 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:33.795551 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b23474d7-2102-471b-8146-0371d5c72f97 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:34.026385 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-0c857226-e050-4518-bec6-0d64443d583b tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:34.027123 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-0c857226-e050-4518-bec6-0d64443d583b tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] [instance: ef72dfda-b1e4-49c6-8830-33d25f6a4ec0] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:48:34.043851 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0c857226-e050-4518-bec6-0d64443d583b tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:34.046727 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0c857226-e050-4518-bec6-0d64443d583b tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:34.054732 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b23474d7-2102-471b-8146-0371d5c72f97 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e462483415e4c2b8a917b2a032e5ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac4d0cae0bd46fda94d7bfb900a0b9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:48:34.069273 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0c857226-e050-4518-bec6-0d64443d583b tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:34.071796 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0c857226-e050-4518-bec6-0d64443d583b tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:34.072468 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0c857226-e050-4518-bec6-0d64443d583b tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:34.074344 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b23474d7-2102-471b-8146-0371d5c72f97 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] 10.222.0.60 "GET /compute/v2.1/servers/7045fd2e-8224-46b8-b477-57a46e18e93f" status: 200 len: 1342 microversion: 2.1 time: 0.296871 Sep 14 08:48:34.074992 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0c857226-e050-4518-bec6-0d64443d583b tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:34.076303 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 95/165] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:48:33 2022] GET /compute/v2.1/servers/7045fd2e-8224-46b8-b477-57a46e18e93f => generated 1342 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:48:34.274958 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-4c802fe7-272e-4dcf-b274-835f93f065bc tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:34.276414 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-4c802fe7-272e-4dcf-b274-835f93f065bc tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: 0a331816-6b06-40c9-a557-eada274501b5] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:48:34.289139 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4c802fe7-272e-4dcf-b274-835f93f065bc tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:34.289901 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4c802fe7-272e-4dcf-b274-835f93f065bc tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:34.290335 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4c802fe7-272e-4dcf-b274-835f93f065bc tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:34.293115 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4c802fe7-272e-4dcf-b274-835f93f065bc tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:34.293585 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4c802fe7-272e-4dcf-b274-835f93f065bc tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:34.295727 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4c802fe7-272e-4dcf-b274-835f93f065bc tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:34.432891 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-0c857226-e050-4518-bec6-0d64443d583b tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326618ebc864ba58c6df2c471c0f978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d1553889c474f75bd545166eff212b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:48:34.445650 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-0c857226-e050-4518-bec6-0d64443d583b tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] 10.222.0.60 "GET /compute/v2.1/servers/ef72dfda-b1e4-49c6-8830-33d25f6a4ec0" status: 200 len: 1338 microversion: 2.1 time: 0.425102 Sep 14 08:48:34.450356 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 71/166] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:48:34 2022] GET /compute/v2.1/servers/ef72dfda-b1e4-49c6-8830-33d25f6a4ec0 => generated 1338 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:48:34.531582 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-4c802fe7-272e-4dcf-b274-835f93f065bc tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:48:34.540714 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-4c802fe7-272e-4dcf-b274-835f93f065bc tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/0a331816-6b06-40c9-a557-eada274501b5" status: 200 len: 1311 microversion: 2.1 time: 0.270402 Sep 14 08:48:34.550053 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 96/167] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:48:34 2022] GET /compute/v2.1/servers/0a331816-6b06-40c9-a557-eada274501b5 => generated 1311 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:48:34.961263 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-7fc583c4-316d-4c87-8949-44028d4fa55b tempest-FlavorsExtraSpecsTestJSON-196457673 tempest-FlavorsExtraSpecsTestJSON-196457673-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-443972070", "ram": 512, "vcpus": 1, "disk": 10, "id": 1514934302, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:48:34.986193 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-7fc583c4-316d-4c87-8949-44028d4fa55b tempest-FlavorsExtraSpecsTestJSON-196457673 tempest-FlavorsExtraSpecsTestJSON-196457673-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.340525 Sep 14 08:48:34.987462 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 72/168] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 08:48:34 2022] POST /compute/v2.1/flavors => generated 415 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:48:35.004385 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-38b3c917-e9eb-4a62-ac18-deb9134ca82e tempest-FlavorsExtraSpecsTestJSON-196457673 tempest-FlavorsExtraSpecsTestJSON-196457673-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:48:35.044210 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-38b3c917-e9eb-4a62-ac18-deb9134ca82e tempest-FlavorsExtraSpecsTestJSON-196457673 tempest-FlavorsExtraSpecsTestJSON-196457673-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors/1514934302/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.046189 Sep 14 08:48:35.045294 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 97/169] 10.222.0.60 () {60 vars in 1224 bytes} [Wed Sep 14 08:48:34 2022] POST /compute/v2.1/flavors/1514934302/os-extra_specs => generated 66 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 08:48:35.103879 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-94f548ec-ab3c-4599-8346-f04e5d272a81 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:35.109287 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-94f548ec-ab3c-4599-8346-f04e5d272a81 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] [instance: 7045fd2e-8224-46b8-b477-57a46e18e93f] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:48:35.121927 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-94f548ec-ab3c-4599-8346-f04e5d272a81 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:35.131588 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-94f548ec-ab3c-4599-8346-f04e5d272a81 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:35.132444 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-94f548ec-ab3c-4599-8346-f04e5d272a81 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:35.133484 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-94f548ec-ab3c-4599-8346-f04e5d272a81 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:35.134232 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-94f548ec-ab3c-4599-8346-f04e5d272a81 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:35.134667 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-94f548ec-ab3c-4599-8346-f04e5d272a81 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:35.314830 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-94f548ec-ab3c-4599-8346-f04e5d272a81 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e462483415e4c2b8a917b2a032e5ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac4d0cae0bd46fda94d7bfb900a0b9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:48:35.323319 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-94f548ec-ab3c-4599-8346-f04e5d272a81 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] 10.222.0.60 "GET /compute/v2.1/servers/7045fd2e-8224-46b8-b477-57a46e18e93f" status: 200 len: 1342 microversion: 2.1 time: 0.225313 Sep 14 08:48:35.339660 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 98/170] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:48:35 2022] GET /compute/v2.1/servers/7045fd2e-8224-46b8-b477-57a46e18e93f => generated 1342 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:48:35.372029 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a19ba002-bcb1-40c1-acff-6a4d79d55038 tempest-FlavorsExtraSpecsTestJSON-112685339 tempest-FlavorsExtraSpecsTestJSON-112685339-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:35.383836 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-a19ba002-bcb1-40c1-acff-6a4d79d55038 tempest-FlavorsExtraSpecsTestJSON-112685339 tempest-FlavorsExtraSpecsTestJSON-112685339-project] 10.222.0.60 "GET /compute/v2.1/flavors/1514934302/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.332315 Sep 14 08:48:35.384342 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 73/171] 10.222.0.60 () {58 vars in 1203 bytes} [Wed Sep 14 08:48:35 2022] GET /compute/v2.1/flavors/1514934302/os-extra_specs => generated 66 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 08:48:35.395600 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-86d70246-72f2-43ff-827f-163bc0366a16 tempest-FlavorsExtraSpecsTestJSON-196457673 tempest-FlavorsExtraSpecsTestJSON-196457673-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:48:35.421480 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-86d70246-72f2-43ff-827f-163bc0366a16 tempest-FlavorsExtraSpecsTestJSON-196457673 tempest-FlavorsExtraSpecsTestJSON-196457673-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors/1514934302/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.029843 Sep 14 08:48:35.422089 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 99/172] 10.222.0.60 () {60 vars in 1224 bytes} [Wed Sep 14 08:48:35 2022] POST /compute/v2.1/flavors/1514934302/os-extra_specs => generated 66 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 08:48:35.432199 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-16f1ccb3-3c37-40e5-9597-72043b7e19f1 tempest-FlavorsExtraSpecsTestJSON-112685339 tempest-FlavorsExtraSpecsTestJSON-112685339-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:35.443929 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-16f1ccb3-3c37-40e5-9597-72043b7e19f1 tempest-FlavorsExtraSpecsTestJSON-112685339 tempest-FlavorsExtraSpecsTestJSON-112685339-project] 10.222.0.60 "GET /compute/v2.1/flavors/1514934302/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.015833 Sep 14 08:48:35.449862 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 74/173] 10.222.0.60 () {58 vars in 1245 bytes} [Wed Sep 14 08:48:35 2022] GET /compute/v2.1/flavors/1514934302/os-extra_specs/hw:numa_nodes => generated 22 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 08:48:35.454825 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d04803c6-4778-4a03-bdea-1a2961a5301b tempest-FlavorsExtraSpecsTestJSON-196457673 tempest-FlavorsExtraSpecsTestJSON-196457673-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:48:35.484802 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-0b295882-a90d-4e34-ab2a-3b13575f09a0 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:35.490855 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-0b295882-a90d-4e34-ab2a-3b13575f09a0 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] [instance: ef72dfda-b1e4-49c6-8830-33d25f6a4ec0] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:48:35.504766 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0b295882-a90d-4e34-ab2a-3b13575f09a0 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:35.505269 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0b295882-a90d-4e34-ab2a-3b13575f09a0 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:35.505723 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0b295882-a90d-4e34-ab2a-3b13575f09a0 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:35.506424 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0b295882-a90d-4e34-ab2a-3b13575f09a0 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:35.506884 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0b295882-a90d-4e34-ab2a-3b13575f09a0 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:35.507344 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0b295882-a90d-4e34-ab2a-3b13575f09a0 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:35.514698 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d04803c6-4778-4a03-bdea-1a2961a5301b tempest-FlavorsExtraSpecsTestJSON-196457673 tempest-FlavorsExtraSpecsTestJSON-196457673-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors/1514934302/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.062575 Sep 14 08:48:35.515947 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 100/174] 10.222.0.60 () {60 vars in 1224 bytes} [Wed Sep 14 08:48:35 2022] POST /compute/v2.1/flavors/1514934302/os-extra_specs => generated 66 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 08:48:35.528321 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-1b2f00da-5f95-41ba-811b-f7af4bb4c7dc tempest-FlavorsExtraSpecsTestJSON-196457673 tempest-FlavorsExtraSpecsTestJSON-196457673-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:35.538184 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-1b2f00da-5f95-41ba-811b-f7af4bb4c7dc tempest-FlavorsExtraSpecsTestJSON-196457673 tempest-FlavorsExtraSpecsTestJSON-196457673-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/1514934302/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.014469 Sep 14 08:48:35.539215 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 101/175] 10.222.0.60 () {58 vars in 1203 bytes} [Wed Sep 14 08:48:35 2022] GET /compute/v2.1/flavors/1514934302/os-extra_specs => generated 66 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 14 08:48:35.552432 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8c2740bd-e4f9-44e5-b579-310e52f30d5f tempest-FlavorsExtraSpecsTestJSON-196457673 tempest-FlavorsExtraSpecsTestJSON-196457673-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:48:35.632941 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-8c2740bd-e4f9-44e5-b579-310e52f30d5f tempest-FlavorsExtraSpecsTestJSON-196457673 tempest-FlavorsExtraSpecsTestJSON-196457673-project-admin] 10.222.0.60 "PUT /compute/v2.1/flavors/1514934302/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.087275 Sep 14 08:48:35.636292 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 102/176] 10.222.0.60 () {60 vars in 1265 bytes} [Wed Sep 14 08:48:35 2022] PUT /compute/v2.1/flavors/1514934302/os-extra_specs/hw:numa_nodes => generated 22 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 08:48:35.712122 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-0b295882-a90d-4e34-ab2a-3b13575f09a0 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326618ebc864ba58c6df2c471c0f978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d1553889c474f75bd545166eff212b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:48:35.725189 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-0b295882-a90d-4e34-ab2a-3b13575f09a0 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] 10.222.0.60 "GET /compute/v2.1/servers/ef72dfda-b1e4-49c6-8830-33d25f6a4ec0" status: 200 len: 1338 microversion: 2.1 time: 0.250775 Sep 14 08:48:35.727182 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 75/177] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:48:35 2022] GET /compute/v2.1/servers/ef72dfda-b1e4-49c6-8830-33d25f6a4ec0 => generated 1338 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:48:35.733495 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-3a8cf3c7-a20c-4bd6-bf7d-479a31ae921d tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:35.734617 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-3a8cf3c7-a20c-4bd6-bf7d-479a31ae921d tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: 0a331816-6b06-40c9-a557-eada274501b5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:48:35.741903 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3a8cf3c7-a20c-4bd6-bf7d-479a31ae921d tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:35.742721 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3a8cf3c7-a20c-4bd6-bf7d-479a31ae921d tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:35.743417 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3a8cf3c7-a20c-4bd6-bf7d-479a31ae921d tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:35.744462 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3a8cf3c7-a20c-4bd6-bf7d-479a31ae921d tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:35.745303 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3a8cf3c7-a20c-4bd6-bf7d-479a31ae921d tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:35.745948 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3a8cf3c7-a20c-4bd6-bf7d-479a31ae921d tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:35.958530 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-3a8cf3c7-a20c-4bd6-bf7d-479a31ae921d tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:48:35.968295 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-6ebec7d9-b115-4b1a-a2b1-27784dbb877c tempest-FlavorsV261TestJSON-113629371 tempest-FlavorsV261TestJSON-113629371-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-1904399490", "id": 1956872922, "os-flavor-access:is_public": "True"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:48:35.968749 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-3a8cf3c7-a20c-4bd6-bf7d-479a31ae921d tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/0a331816-6b06-40c9-a557-eada274501b5" status: 200 len: 1311 microversion: 2.1 time: 0.239889 Sep 14 08:48:35.981745 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 76/178] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:48:35 2022] GET /compute/v2.1/servers/0a331816-6b06-40c9-a557-eada274501b5 => generated 1311 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:48:35.991950 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-eb381bea-3780-40ff-bc7d-6234b339ab60 tempest-FlavorsExtraSpecsTestJSON-196457673 tempest-FlavorsExtraSpecsTestJSON-196457673-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:36.007588 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-eb381bea-3780-40ff-bc7d-6234b339ab60 tempest-FlavorsExtraSpecsTestJSON-196457673 tempest-FlavorsExtraSpecsTestJSON-196457673-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/1514934302/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.023859 Sep 14 08:48:36.010757 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 77/179] 10.222.0.60 () {58 vars in 1203 bytes} [Wed Sep 14 08:48:35 2022] GET /compute/v2.1/flavors/1514934302/os-extra_specs => generated 66 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 08:48:36.022079 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1841c494-9fb0-408e-8156-d442990e2aa5 tempest-FlavorsExtraSpecsTestJSON-196457673 tempest-FlavorsExtraSpecsTestJSON-196457673-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:36.023913 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-6ebec7d9-b115-4b1a-a2b1-27784dbb877c tempest-FlavorsV261TestJSON-113629371 tempest-FlavorsV261TestJSON-113629371-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 468 microversion: 2.61 time: 0.385215 Sep 14 08:48:36.025603 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 103/180] 10.222.0.60 () {62 vars in 1188 bytes} [Wed Sep 14 08:48:35 2022] POST /compute/v2.1/flavors => generated 468 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 08:48:36.093606 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-1841c494-9fb0-408e-8156-d442990e2aa5 tempest-FlavorsExtraSpecsTestJSON-196457673 tempest-FlavorsExtraSpecsTestJSON-196457673-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/1514934302/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.076720 Sep 14 08:48:36.094801 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 78/181] 10.222.0.60 () {58 vars in 1248 bytes} [Wed Sep 14 08:48:36 2022] DELETE /compute/v2.1/flavors/1514934302/os-extra_specs/hw:numa_nodes => generated 0 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 14 08:48:36.104175 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a2df8966-4519-46d3-8114-9f9d8d46ddc0 tempest-FlavorsExtraSpecsTestJSON-196457673 tempest-FlavorsExtraSpecsTestJSON-196457673-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:36.143911 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-a2df8966-4519-46d3-8114-9f9d8d46ddc0 tempest-FlavorsExtraSpecsTestJSON-196457673 tempest-FlavorsExtraSpecsTestJSON-196457673-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/1514934302/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.043842 Sep 14 08:48:36.144688 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 79/182] 10.222.0.60 () {58 vars in 1248 bytes} [Wed Sep 14 08:48:36 2022] DELETE /compute/v2.1/flavors/1514934302/os-extra_specs/hw:cpu_policy => generated 0 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 14 08:48:36.153147 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d4542fbe-afc1-491c-83b1-88087a339e71 tempest-FlavorsExtraSpecsTestJSON-196457673 tempest-FlavorsExtraSpecsTestJSON-196457673-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:36.165857 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-d4542fbe-afc1-491c-83b1-88087a339e71 tempest-FlavorsExtraSpecsTestJSON-196457673 tempest-FlavorsExtraSpecsTestJSON-196457673-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/1514934302/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.015788 Sep 14 08:48:36.165857 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 80/183] 10.222.0.60 () {58 vars in 1203 bytes} [Wed Sep 14 08:48:36 2022] GET /compute/v2.1/flavors/1514934302/os-extra_specs => generated 19 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 08:48:36.175949 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-5be81f22-c1dd-4827-a3b9-b661888526a5 tempest-FlavorsExtraSpecsTestJSON-196457673 tempest-FlavorsExtraSpecsTestJSON-196457673-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:36.199651 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-5be81f22-c1dd-4827-a3b9-b661888526a5 tempest-FlavorsExtraSpecsTestJSON-196457673 tempest-FlavorsExtraSpecsTestJSON-196457673-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/1514934302" status: 202 len: 0 microversion: 2.1 time: 0.027230 Sep 14 08:48:36.200487 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 81/184] 10.222.0.60 () {58 vars in 1161 bytes} [Wed Sep 14 08:48:36 2022] DELETE /compute/v2.1/flavors/1514934302 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 08:48:36.210748 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-0719a14e-e519-41ce-a6f5-14ed030e7b24 tempest-FlavorsExtraSpecsTestJSON-196457673 tempest-FlavorsExtraSpecsTestJSON-196457673-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:36.240696 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-0719a14e-e519-41ce-a6f5-14ed030e7b24 tempest-FlavorsExtraSpecsTestJSON-196457673 tempest-FlavorsExtraSpecsTestJSON-196457673-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 5409 microversion: 2.1 time: 0.035328 Sep 14 08:48:36.241936 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 82/185] 10.222.0.60 () {58 vars in 1146 bytes} [Wed Sep 14 08:48:36 2022] GET /compute/v2.1/flavors/detail => generated 5409 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:48:36.349983 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d1390755-47d4-466d-ae4a-8f2f043c92e4 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:36.351289 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-d1390755-47d4-466d-ae4a-8f2f043c92e4 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] [instance: 7045fd2e-8224-46b8-b477-57a46e18e93f] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:48:36.360274 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d1390755-47d4-466d-ae4a-8f2f043c92e4 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:36.361104 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d1390755-47d4-466d-ae4a-8f2f043c92e4 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:36.361757 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d1390755-47d4-466d-ae4a-8f2f043c92e4 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:36.362704 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d1390755-47d4-466d-ae4a-8f2f043c92e4 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:36.363425 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d1390755-47d4-466d-ae4a-8f2f043c92e4 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:36.364072 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d1390755-47d4-466d-ae4a-8f2f043c92e4 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:36.448456 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c7fe49c7-34d1-422b-81ea-b58205dae018 tempest-FlavorsV261TestJSON-1830263142 tempest-FlavorsV261TestJSON-1830263142-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:36.474510 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-c7fe49c7-34d1-422b-81ea-b58205dae018 tempest-FlavorsV261TestJSON-1830263142 tempest-FlavorsV261TestJSON-1830263142-project] 10.222.0.60 "GET /compute/v2.1/flavors/1956872922" status: 200 len: 468 microversion: 2.61 time: 0.436088 Sep 14 08:48:36.477235 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 104/186] 10.222.0.60 () {60 vars in 1199 bytes} [Wed Sep 14 08:48:36 2022] GET /compute/v2.1/flavors/1956872922 => generated 468 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 08:48:36.498899 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-1022a67e-60ff-4ae6-91bc-c00f65a81cfc tempest-FlavorsV261TestJSON-113629371 tempest-FlavorsV261TestJSON-113629371-project-admin] Action: 'update', calling method: .version_select at 0x7f7d462cb9d0>, body: {"flavor": {"description": "new"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:48:36.574220 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=6,nova_api:SAVEPOINT=8,nova_api:RELEASE=8,nova_api:UPDATE=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:48:36.630683 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-1022a67e-60ff-4ae6-91bc-c00f65a81cfc tempest-FlavorsV261TestJSON-113629371 tempest-FlavorsV261TestJSON-113629371-project-admin] 10.222.0.60 "PUT /compute/v2.1/flavors/1956872922" status: 200 len: 469 microversion: 2.61 time: 0.143650 Sep 14 08:48:36.632450 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 105/187] 10.222.0.60 () {62 vars in 1219 bytes} [Wed Sep 14 08:48:36 2022] PUT /compute/v2.1/flavors/1956872922 => generated 469 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 08:48:36.648707 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-132389e6-dee1-44e9-92a3-761e8b2238d8 tempest-FlavorsV261TestJSON-1830263142 tempest-FlavorsV261TestJSON-1830263142-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:36.671137 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-d1390755-47d4-466d-ae4a-8f2f043c92e4 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e462483415e4c2b8a917b2a032e5ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac4d0cae0bd46fda94d7bfb900a0b9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:48:36.683756 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-d1390755-47d4-466d-ae4a-8f2f043c92e4 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] 10.222.0.60 "GET /compute/v2.1/servers/7045fd2e-8224-46b8-b477-57a46e18e93f" status: 200 len: 1342 microversion: 2.1 time: 0.338776 Sep 14 08:48:36.684396 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 83/188] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:48:36 2022] GET /compute/v2.1/servers/7045fd2e-8224-46b8-b477-57a46e18e93f => generated 1342 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:48:36.702524 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-132389e6-dee1-44e9-92a3-761e8b2238d8 tempest-FlavorsV261TestJSON-1830263142 tempest-FlavorsV261TestJSON-1830263142-project] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 6250 microversion: 2.61 time: 0.059521 Sep 14 08:48:36.704350 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 106/189] 10.222.0.60 () {60 vars in 1187 bytes} [Wed Sep 14 08:48:36 2022] GET /compute/v2.1/flavors/detail => generated 6250 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 08:48:36.728141 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-aad666ab-4f82-4123-b067-261af408a658 tempest-FlavorsV261TestJSON-1830263142 tempest-FlavorsV261TestJSON-1830263142-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:36.750993 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c99b0fc2-05b8-49bc-a863-4b755c071194 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:36.751991 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-c99b0fc2-05b8-49bc-a863-4b755c071194 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] [instance: ef72dfda-b1e4-49c6-8830-33d25f6a4ec0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:48:36.764108 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-aad666ab-4f82-4123-b067-261af408a658 tempest-FlavorsV261TestJSON-1830263142 tempest-FlavorsV261TestJSON-1830263142-project] 10.222.0.60 "GET /compute/v2.1/flavors" status: 200 len: 3157 microversion: 2.61 time: 0.040016 Sep 14 08:48:36.767572 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c99b0fc2-05b8-49bc-a863-4b755c071194 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:36.768183 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c99b0fc2-05b8-49bc-a863-4b755c071194 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:36.768717 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c99b0fc2-05b8-49bc-a863-4b755c071194 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:36.769579 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c99b0fc2-05b8-49bc-a863-4b755c071194 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:36.770110 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c99b0fc2-05b8-49bc-a863-4b755c071194 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:36.770753 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c99b0fc2-05b8-49bc-a863-4b755c071194 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:36.778016 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 84/190] 10.222.0.60 () {60 vars in 1166 bytes} [Wed Sep 14 08:48:36 2022] GET /compute/v2.1/flavors => generated 3157 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:48:36.794088 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-826e6fa6-b41e-484d-8ea0-750e7a4dcdb8 tempest-FlavorsV261TestJSON-113629371 tempest-FlavorsV261TestJSON-113629371-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:36.819638 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-826e6fa6-b41e-484d-8ea0-750e7a4dcdb8 tempest-FlavorsV261TestJSON-113629371 tempest-FlavorsV261TestJSON-113629371-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/1956872922" status: 202 len: 0 microversion: 2.61 time: 0.029324 Sep 14 08:48:36.820689 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 85/191] 10.222.0.60 () {60 vars in 1202 bytes} [Wed Sep 14 08:48:36 2022] DELETE /compute/v2.1/flavors/1956872922 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 14 08:48:36.831779 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-04b64af0-275c-4ca0-ade1-6b639dae6596 tempest-FlavorsV261TestJSON-113629371 tempest-FlavorsV261TestJSON-113629371-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:36.862080 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-04b64af0-275c-4ca0-ade1-6b639dae6596 tempest-FlavorsV261TestJSON-113629371 tempest-FlavorsV261TestJSON-113629371-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 5791 microversion: 2.61 time: 0.036890 Sep 14 08:48:36.877541 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 86/192] 10.222.0.60 () {60 vars in 1187 bytes} [Wed Sep 14 08:48:36 2022] GET /compute/v2.1/flavors/detail => generated 5791 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:48:36.996382 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c0506d0c-1c29-45ff-b6f1-9046d1986bd2 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:36.997003 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-c0506d0c-1c29-45ff-b6f1-9046d1986bd2 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: 0a331816-6b06-40c9-a557-eada274501b5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:48:36.998872 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-c99b0fc2-05b8-49bc-a863-4b755c071194 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326618ebc864ba58c6df2c471c0f978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d1553889c474f75bd545166eff212b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:48:37.014427 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-c99b0fc2-05b8-49bc-a863-4b755c071194 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] 10.222.0.60 "GET /compute/v2.1/servers/ef72dfda-b1e4-49c6-8830-33d25f6a4ec0" status: 200 len: 1338 microversion: 2.1 time: 0.267419 Sep 14 08:48:37.015612 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 107/193] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:48:36 2022] GET /compute/v2.1/servers/ef72dfda-b1e4-49c6-8830-33d25f6a4ec0 => generated 1338 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:48:37.031268 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c0506d0c-1c29-45ff-b6f1-9046d1986bd2 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:37.031781 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c0506d0c-1c29-45ff-b6f1-9046d1986bd2 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:37.032223 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c0506d0c-1c29-45ff-b6f1-9046d1986bd2 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:37.035531 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c0506d0c-1c29-45ff-b6f1-9046d1986bd2 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:37.036461 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c0506d0c-1c29-45ff-b6f1-9046d1986bd2 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:37.036611 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c0506d0c-1c29-45ff-b6f1-9046d1986bd2 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:37.228474 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-c0506d0c-1c29-45ff-b6f1-9046d1986bd2 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:48:37.256252 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-c0506d0c-1c29-45ff-b6f1-9046d1986bd2 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/0a331816-6b06-40c9-a557-eada274501b5" status: 200 len: 1311 microversion: 2.1 time: 0.263717 Sep 14 08:48:37.257136 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 87/194] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:48:36 2022] GET /compute/v2.1/servers/0a331816-6b06-40c9-a557-eada274501b5 => generated 1311 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:48:37.713481 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-23c55068-c12f-45ba-847e-aec7d3abd8fa tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:37.715114 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-23c55068-c12f-45ba-847e-aec7d3abd8fa tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] [instance: 7045fd2e-8224-46b8-b477-57a46e18e93f] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:48:37.727320 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-23c55068-c12f-45ba-847e-aec7d3abd8fa tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:37.728490 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-23c55068-c12f-45ba-847e-aec7d3abd8fa tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:37.729221 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-23c55068-c12f-45ba-847e-aec7d3abd8fa tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:37.730356 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-23c55068-c12f-45ba-847e-aec7d3abd8fa tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:37.731069 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-23c55068-c12f-45ba-847e-aec7d3abd8fa tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:37.735274 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-23c55068-c12f-45ba-847e-aec7d3abd8fa tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:37.997326 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-23c55068-c12f-45ba-847e-aec7d3abd8fa tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e462483415e4c2b8a917b2a032e5ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac4d0cae0bd46fda94d7bfb900a0b9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:48:38.009195 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-23c55068-c12f-45ba-847e-aec7d3abd8fa tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] 10.222.0.60 "GET /compute/v2.1/servers/7045fd2e-8224-46b8-b477-57a46e18e93f" status: 200 len: 1342 microversion: 2.1 time: 0.300333 Sep 14 08:48:38.010591 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 108/195] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:48:37 2022] GET /compute/v2.1/servers/7045fd2e-8224-46b8-b477-57a46e18e93f => generated 1342 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:48:38.046313 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-4c1a6a2f-a4e7-4785-b46b-6b70adf74495 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:38.052747 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-4c1a6a2f-a4e7-4785-b46b-6b70adf74495 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] [instance: ef72dfda-b1e4-49c6-8830-33d25f6a4ec0] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:48:38.078784 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4c1a6a2f-a4e7-4785-b46b-6b70adf74495 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:38.079753 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4c1a6a2f-a4e7-4785-b46b-6b70adf74495 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:38.086340 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4c1a6a2f-a4e7-4785-b46b-6b70adf74495 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:38.089327 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4c1a6a2f-a4e7-4785-b46b-6b70adf74495 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:38.091168 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4c1a6a2f-a4e7-4785-b46b-6b70adf74495 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:38.092642 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4c1a6a2f-a4e7-4785-b46b-6b70adf74495 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:38.295975 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-0a4a62b0-cf80-4b28-8f92-25cdb832dffb tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:38.296741 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-0a4a62b0-cf80-4b28-8f92-25cdb832dffb tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: 0a331816-6b06-40c9-a557-eada274501b5] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:48:38.306000 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=10 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:48:38.309666 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0a4a62b0-cf80-4b28-8f92-25cdb832dffb tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:38.310235 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0a4a62b0-cf80-4b28-8f92-25cdb832dffb tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:38.310794 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0a4a62b0-cf80-4b28-8f92-25cdb832dffb tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:38.312839 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0a4a62b0-cf80-4b28-8f92-25cdb832dffb tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:38.314661 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0a4a62b0-cf80-4b28-8f92-25cdb832dffb tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:38.315828 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0a4a62b0-cf80-4b28-8f92-25cdb832dffb tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:38.402559 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-4c1a6a2f-a4e7-4785-b46b-6b70adf74495 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326618ebc864ba58c6df2c471c0f978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d1553889c474f75bd545166eff212b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:48:38.422962 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-4c1a6a2f-a4e7-4785-b46b-6b70adf74495 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] 10.222.0.60 "GET /compute/v2.1/servers/ef72dfda-b1e4-49c6-8830-33d25f6a4ec0" status: 200 len: 1338 microversion: 2.1 time: 0.379621 Sep 14 08:48:38.424301 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 88/196] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:48:38 2022] GET /compute/v2.1/servers/ef72dfda-b1e4-49c6-8830-33d25f6a4ec0 => generated 1338 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:48:38.627465 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-0a4a62b0-cf80-4b28-8f92-25cdb832dffb tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:48:38.646179 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-0a4a62b0-cf80-4b28-8f92-25cdb832dffb tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/0a331816-6b06-40c9-a557-eada274501b5" status: 200 len: 1311 microversion: 2.1 time: 0.362655 Sep 14 08:48:38.662902 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 109/197] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:48:38 2022] GET /compute/v2.1/servers/0a331816-6b06-40c9-a557-eada274501b5 => generated 1311 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:48:39.037197 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-90f7507a-0f1b-4104-902f-64f52b9fe907 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:39.040769 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-90f7507a-0f1b-4104-902f-64f52b9fe907 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] [instance: 7045fd2e-8224-46b8-b477-57a46e18e93f] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:48:39.053210 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-90f7507a-0f1b-4104-902f-64f52b9fe907 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:39.054445 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-90f7507a-0f1b-4104-902f-64f52b9fe907 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:39.055971 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-90f7507a-0f1b-4104-902f-64f52b9fe907 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:39.057303 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-90f7507a-0f1b-4104-902f-64f52b9fe907 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:39.057924 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-90f7507a-0f1b-4104-902f-64f52b9fe907 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:39.058668 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-90f7507a-0f1b-4104-902f-64f52b9fe907 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:39.304283 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-fe15c717-a422-4e14-a10b-d6f184871fcc tempest-HypervisorAdminUnderV252Test-943600425 tempest-HypervisorAdminUnderV252Test-943600425-project-admin] Calling method '.version_select at 0x7f7d4519c550>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:39.307180 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fe15c717-a422-4e14-a10b-d6f184871fcc tempest-HypervisorAdminUnderV252Test-943600425 tempest-HypervisorAdminUnderV252Test-943600425-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:39.307678 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fe15c717-a422-4e14-a10b-d6f184871fcc tempest-HypervisorAdminUnderV252Test-943600425 tempest-HypervisorAdminUnderV252Test-943600425-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:39.308140 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fe15c717-a422-4e14-a10b-d6f184871fcc tempest-HypervisorAdminUnderV252Test-943600425 tempest-HypervisorAdminUnderV252Test-943600425-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:39.339637 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fe15c717-a422-4e14-a10b-d6f184871fcc tempest-HypervisorAdminUnderV252Test-943600425 tempest-HypervisorAdminUnderV252Test-943600425-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:39.345067 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fe15c717-a422-4e14-a10b-d6f184871fcc tempest-HypervisorAdminUnderV252Test-943600425 tempest-HypervisorAdminUnderV252Test-943600425-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:39.346293 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fe15c717-a422-4e14-a10b-d6f184871fcc tempest-HypervisorAdminUnderV252Test-943600425 tempest-HypervisorAdminUnderV252Test-943600425-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:39.360736 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fe15c717-a422-4e14-a10b-d6f184871fcc tempest-HypervisorAdminUnderV252Test-943600425 tempest-HypervisorAdminUnderV252Test-943600425-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:39.363745 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fe15c717-a422-4e14-a10b-d6f184871fcc tempest-HypervisorAdminUnderV252Test-943600425 tempest-HypervisorAdminUnderV252Test-943600425-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:39.364396 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fe15c717-a422-4e14-a10b-d6f184871fcc tempest-HypervisorAdminUnderV252Test-943600425 tempest-HypervisorAdminUnderV252Test-943600425-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:39.375925 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-fe15c717-a422-4e14-a10b-d6f184871fcc tempest-HypervisorAdminUnderV252Test-943600425 tempest-HypervisorAdminUnderV252Test-943600425-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.739834 Sep 14 08:48:39.377100 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 89/198] 10.222.0.60 () {58 vars in 1146 bytes} [Wed Sep 14 08:48:38 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 08:48:39.385390 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-90f7507a-0f1b-4104-902f-64f52b9fe907 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e462483415e4c2b8a917b2a032e5ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac4d0cae0bd46fda94d7bfb900a0b9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:48:39.391316 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d1865dc1-a69e-49f3-a7dc-3ad4701c0029 tempest-HypervisorAdminUnderV252Test-943600425 tempest-HypervisorAdminUnderV252Test-943600425-project-admin] Calling method '.version_select at 0x7f7d44fc3c10>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:39.393839 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-90f7507a-0f1b-4104-902f-64f52b9fe907 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] 10.222.0.60 "GET /compute/v2.1/servers/7045fd2e-8224-46b8-b477-57a46e18e93f" status: 200 len: 1342 microversion: 2.1 time: 0.363718 Sep 14 08:48:39.394491 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d1865dc1-a69e-49f3-a7dc-3ad4701c0029 tempest-HypervisorAdminUnderV252Test-943600425 tempest-HypervisorAdminUnderV252Test-943600425-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:39.396484 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d1865dc1-a69e-49f3-a7dc-3ad4701c0029 tempest-HypervisorAdminUnderV252Test-943600425 tempest-HypervisorAdminUnderV252Test-943600425-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:39.396886 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d1865dc1-a69e-49f3-a7dc-3ad4701c0029 tempest-HypervisorAdminUnderV252Test-943600425 tempest-HypervisorAdminUnderV252Test-943600425-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:39.408300 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 110/199] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:48:39 2022] GET /compute/v2.1/servers/7045fd2e-8224-46b8-b477-57a46e18e93f => generated 1342 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:48:39.429969 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d1865dc1-a69e-49f3-a7dc-3ad4701c0029 tempest-HypervisorAdminUnderV252Test-943600425 tempest-HypervisorAdminUnderV252Test-943600425-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:39.430713 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d1865dc1-a69e-49f3-a7dc-3ad4701c0029 tempest-HypervisorAdminUnderV252Test-943600425 tempest-HypervisorAdminUnderV252Test-943600425-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:39.431208 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d1865dc1-a69e-49f3-a7dc-3ad4701c0029 tempest-HypervisorAdminUnderV252Test-943600425 tempest-HypervisorAdminUnderV252Test-943600425-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:39.447724 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-1e3f525f-003d-4cc2-8637-82aaf438cf23 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:39.448598 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-1e3f525f-003d-4cc2-8637-82aaf438cf23 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] [instance: ef72dfda-b1e4-49c6-8830-33d25f6a4ec0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:48:39.465392 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1e3f525f-003d-4cc2-8637-82aaf438cf23 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:39.466075 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1e3f525f-003d-4cc2-8637-82aaf438cf23 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:39.467249 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1e3f525f-003d-4cc2-8637-82aaf438cf23 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:39.468170 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1e3f525f-003d-4cc2-8637-82aaf438cf23 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:39.468826 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1e3f525f-003d-4cc2-8637-82aaf438cf23 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:39.469460 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1e3f525f-003d-4cc2-8637-82aaf438cf23 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:39.473487 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d1865dc1-a69e-49f3-a7dc-3ad4701c0029 tempest-HypervisorAdminUnderV252Test-943600425 tempest-HypervisorAdminUnderV252Test-943600425-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:39.474791 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d1865dc1-a69e-49f3-a7dc-3ad4701c0029 tempest-HypervisorAdminUnderV252Test-943600425 tempest-HypervisorAdminUnderV252Test-943600425-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:39.477842 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d1865dc1-a69e-49f3-a7dc-3ad4701c0029 tempest-HypervisorAdminUnderV252Test-943600425 tempest-HypervisorAdminUnderV252Test-943600425-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:39.482732 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-d1865dc1-a69e-49f3-a7dc-3ad4701c0029 tempest-HypervisorAdminUnderV252Test-943600425 tempest-HypervisorAdminUnderV252Test-943600425-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors/n-h2-836830-18/servers" status: 200 len: 276 microversion: 2.1 time: 0.098810 Sep 14 08:48:39.489997 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 90/200] 10.222.0.60 () {58 vars in 1215 bytes} [Wed Sep 14 08:48:39 2022] GET /compute/v2.1/os-hypervisors/n-h2-836830-18/servers => generated 276 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:48:39.496530 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b500af53-df78-41b6-9aa6-12e7ea7d637c tempest-HypervisorAdminUnderV252Test-943600425 tempest-HypervisorAdminUnderV252Test-943600425-project-admin] Calling method '.version_select at 0x7f7d45061790>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:39.499740 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b500af53-df78-41b6-9aa6-12e7ea7d637c tempest-HypervisorAdminUnderV252Test-943600425 tempest-HypervisorAdminUnderV252Test-943600425-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:39.500507 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b500af53-df78-41b6-9aa6-12e7ea7d637c tempest-HypervisorAdminUnderV252Test-943600425 tempest-HypervisorAdminUnderV252Test-943600425-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:39.501418 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b500af53-df78-41b6-9aa6-12e7ea7d637c tempest-HypervisorAdminUnderV252Test-943600425 tempest-HypervisorAdminUnderV252Test-943600425-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:39.517648 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b500af53-df78-41b6-9aa6-12e7ea7d637c tempest-HypervisorAdminUnderV252Test-943600425 tempest-HypervisorAdminUnderV252Test-943600425-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:39.518144 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b500af53-df78-41b6-9aa6-12e7ea7d637c tempest-HypervisorAdminUnderV252Test-943600425 tempest-HypervisorAdminUnderV252Test-943600425-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:39.518800 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b500af53-df78-41b6-9aa6-12e7ea7d637c tempest-HypervisorAdminUnderV252Test-943600425 tempest-HypervisorAdminUnderV252Test-943600425-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:39.527542 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=85,nova_api:DELETE=11,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:48:39.532076 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b500af53-df78-41b6-9aa6-12e7ea7d637c tempest-HypervisorAdminUnderV252Test-943600425 tempest-HypervisorAdminUnderV252Test-943600425-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:39.532569 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b500af53-df78-41b6-9aa6-12e7ea7d637c tempest-HypervisorAdminUnderV252Test-943600425 tempest-HypervisorAdminUnderV252Test-943600425-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:39.532999 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b500af53-df78-41b6-9aa6-12e7ea7d637c tempest-HypervisorAdminUnderV252Test-943600425 tempest-HypervisorAdminUnderV252Test-943600425-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:39.540332 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-b500af53-df78-41b6-9aa6-12e7ea7d637c tempest-HypervisorAdminUnderV252Test-943600425 tempest-HypervisorAdminUnderV252Test-943600425-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.048599 Sep 14 08:48:39.542994 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 91/201] 10.222.0.60 () {58 vars in 1146 bytes} [Wed Sep 14 08:48:39 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 08:48:39.552328 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-f1ef6983-2d84-4873-8ab1-b217a5b5617a tempest-HypervisorAdminUnderV252Test-943600425 tempest-HypervisorAdminUnderV252Test-943600425-project-admin] Calling method '.version_select at 0x7f7d4504e670>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:39.554902 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f1ef6983-2d84-4873-8ab1-b217a5b5617a tempest-HypervisorAdminUnderV252Test-943600425 tempest-HypervisorAdminUnderV252Test-943600425-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:39.555669 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f1ef6983-2d84-4873-8ab1-b217a5b5617a tempest-HypervisorAdminUnderV252Test-943600425 tempest-HypervisorAdminUnderV252Test-943600425-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:39.556101 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f1ef6983-2d84-4873-8ab1-b217a5b5617a tempest-HypervisorAdminUnderV252Test-943600425 tempest-HypervisorAdminUnderV252Test-943600425-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:39.574889 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f1ef6983-2d84-4873-8ab1-b217a5b5617a tempest-HypervisorAdminUnderV252Test-943600425 tempest-HypervisorAdminUnderV252Test-943600425-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:39.575426 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f1ef6983-2d84-4873-8ab1-b217a5b5617a tempest-HypervisorAdminUnderV252Test-943600425 tempest-HypervisorAdminUnderV252Test-943600425-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:39.576704 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f1ef6983-2d84-4873-8ab1-b217a5b5617a tempest-HypervisorAdminUnderV252Test-943600425 tempest-HypervisorAdminUnderV252Test-943600425-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:39.584820 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-f1ef6983-2d84-4873-8ab1-b217a5b5617a tempest-HypervisorAdminUnderV252Test-943600425 tempest-HypervisorAdminUnderV252Test-943600425-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors/n-h2-836830-18/search" status: 200 len: 105 microversion: 2.1 time: 0.037150 Sep 14 08:48:39.586095 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 92/202] 10.222.0.60 () {58 vars in 1212 bytes} [Wed Sep 14 08:48:39 2022] GET /compute/v2.1/os-hypervisors/n-h2-836830-18/search => generated 105 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:48:39.645671 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-1e3f525f-003d-4cc2-8637-82aaf438cf23 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326618ebc864ba58c6df2c471c0f978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d1553889c474f75bd545166eff212b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:48:39.654161 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-1e3f525f-003d-4cc2-8637-82aaf438cf23 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] 10.222.0.60 "GET /compute/v2.1/servers/ef72dfda-b1e4-49c6-8830-33d25f6a4ec0" status: 200 len: 1338 microversion: 2.1 time: 0.210461 Sep 14 08:48:39.671311 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 111/203] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:48:39 2022] GET /compute/v2.1/servers/ef72dfda-b1e4-49c6-8830-33d25f6a4ec0 => generated 1338 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:48:39.671311 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b0dc314d-58cf-429e-81dc-91b8fc3654e2 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:39.671311 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b0dc314d-58cf-429e-81dc-91b8fc3654e2 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: 0a331816-6b06-40c9-a557-eada274501b5] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:48:39.678265 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b0dc314d-58cf-429e-81dc-91b8fc3654e2 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:39.678762 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b0dc314d-58cf-429e-81dc-91b8fc3654e2 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:39.679227 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b0dc314d-58cf-429e-81dc-91b8fc3654e2 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:39.680307 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b0dc314d-58cf-429e-81dc-91b8fc3654e2 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:39.680760 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b0dc314d-58cf-429e-81dc-91b8fc3654e2 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:39.681488 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b0dc314d-58cf-429e-81dc-91b8fc3654e2 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:39.871248 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b0dc314d-58cf-429e-81dc-91b8fc3654e2 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:48:39.888609 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b0dc314d-58cf-429e-81dc-91b8fc3654e2 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/0a331816-6b06-40c9-a557-eada274501b5" status: 200 len: 1311 microversion: 2.1 time: 0.222575 Sep 14 08:48:39.889631 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 112/204] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:48:39 2022] GET /compute/v2.1/servers/0a331816-6b06-40c9-a557-eada274501b5 => generated 1311 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:48:39.895412 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-9a410d34-c1f5-4334-b491-88f1144b93fe req-bf862d1a-74df-44e3-89f2-4f9e46e201c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7045fd2e-8224-46b8-b477-57a46e18e93f", "name": "network-vif-plugged", "status": "completed", "tag": "ac6596d6-502b-4db1-8535-84f8989dd969"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:48:39.909530 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-9a410d34-c1f5-4334-b491-88f1144b93fe req-bf862d1a-74df-44e3-89f2-4f9e46e201c9 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:39.911008 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-9a410d34-c1f5-4334-b491-88f1144b93fe req-bf862d1a-74df-44e3-89f2-4f9e46e201c9 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:39.911739 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-9a410d34-c1f5-4334-b491-88f1144b93fe req-bf862d1a-74df-44e3-89f2-4f9e46e201c9 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:39.925715 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-9a410d34-c1f5-4334-b491-88f1144b93fe req-bf862d1a-74df-44e3-89f2-4f9e46e201c9 service nova] Creating event network-vif-plugged:ac6596d6-502b-4db1-8535-84f8989dd969 for instance 7045fd2e-8224-46b8-b477-57a46e18e93f on n-h2-836830-18 Sep 14 08:48:39.933495 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-9a410d34-c1f5-4334-b491-88f1144b93fe req-bf862d1a-74df-44e3-89f2-4f9e46e201c9 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.346150 Sep 14 08:48:39.939110 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 93/205] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:48:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:48:40.339257 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c40d298b-06b0-44b1-bf6a-a56c7f72f70e tempest-QuotaClassesAdmin257Test-232312482 tempest-QuotaClassesAdmin257Test-232312482-project-admin] Calling method '.version_select at 0x7f7d44f3b670>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:40.347457 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=20 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:48:40.361388 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-c40d298b-06b0-44b1-bf6a-a56c7f72f70e tempest-QuotaClassesAdmin257Test-232312482 tempest-QuotaClassesAdmin257Test-232312482-project-admin] 10.222.0.60 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.470445 Sep 14 08:48:40.361974 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 113/206] 10.222.0.60 () {60 vars in 1226 bytes} [Wed Sep 14 08:48:39 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 08:48:40.374568 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-4fef320d-2d0a-4eba-917e-4824ec480b7d tempest-QuotaClassesAdmin257Test-232312482 tempest-QuotaClassesAdmin257Test-232312482-project-admin] Action: 'update', calling method: .version_select at 0x7f7d45057e50>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:48:40.382102 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=4 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:48:40.418753 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-534685dd-d0bf-4741-9659-c188f5c992eb tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:40.419438 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-534685dd-d0bf-4741-9659-c188f5c992eb tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] [instance: 7045fd2e-8224-46b8-b477-57a46e18e93f] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:48:40.427758 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-534685dd-d0bf-4741-9659-c188f5c992eb tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:40.428418 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-534685dd-d0bf-4741-9659-c188f5c992eb tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:40.428846 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-534685dd-d0bf-4741-9659-c188f5c992eb tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:40.429860 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-534685dd-d0bf-4741-9659-c188f5c992eb tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:40.430574 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-534685dd-d0bf-4741-9659-c188f5c992eb tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:40.431176 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-534685dd-d0bf-4741-9659-c188f5c992eb tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:40.582019 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-4fef320d-2d0a-4eba-917e-4824ec480b7d tempest-QuotaClassesAdmin257Test-232312482 tempest-QuotaClassesAdmin257Test-232312482-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.212532 Sep 14 08:48:40.588414 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 94/207] 10.222.0.60 () {62 vars in 1247 bytes} [Wed Sep 14 08:48:40 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 08:48:40.593586 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-8872b8d8-d53c-4f13-95e5-d3672ccdb27d tempest-QuotaClassesAdmin257Test-232312482 tempest-QuotaClassesAdmin257Test-232312482-project-admin] Calling method '.version_select at 0x7f7d450615e0>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:40.605049 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-8872b8d8-d53c-4f13-95e5-d3672ccdb27d tempest-QuotaClassesAdmin257Test-232312482 tempest-QuotaClassesAdmin257Test-232312482-project-admin] 10.222.0.60 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.015518 Sep 14 08:48:40.611932 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 95/208] 10.222.0.60 () {60 vars in 1226 bytes} [Wed Sep 14 08:48:40 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 14 08:48:40.613123 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-534685dd-d0bf-4741-9659-c188f5c992eb tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e462483415e4c2b8a917b2a032e5ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac4d0cae0bd46fda94d7bfb900a0b9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:48:40.616804 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ec573844-9829-42ce-9cd2-85ecee4dff1d tempest-QuotaClassesAdmin257Test-232312482 tempest-QuotaClassesAdmin257Test-232312482-project-admin] Action: 'update', calling method: .version_select at 0x7f7d450cc310>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:48:40.623325 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-534685dd-d0bf-4741-9659-c188f5c992eb tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] 10.222.0.60 "GET /compute/v2.1/servers/7045fd2e-8224-46b8-b477-57a46e18e93f" status: 200 len: 1342 microversion: 2.1 time: 0.208752 Sep 14 08:48:40.639737 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 114/209] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:48:40 2022] GET /compute/v2.1/servers/7045fd2e-8224-46b8-b477-57a46e18e93f => generated 1342 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:48:40.682271 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-055ad084-c408-487f-b6cd-24470418e82a tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:40.683357 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-055ad084-c408-487f-b6cd-24470418e82a tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] [instance: ef72dfda-b1e4-49c6-8830-33d25f6a4ec0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:48:40.693178 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-055ad084-c408-487f-b6cd-24470418e82a tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:40.693837 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-055ad084-c408-487f-b6cd-24470418e82a tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:40.694636 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-ec573844-9829-42ce-9cd2-85ecee4dff1d tempest-QuotaClassesAdmin257Test-232312482 tempest-QuotaClassesAdmin257Test-232312482-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.081253 Sep 14 08:48:40.694767 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-055ad084-c408-487f-b6cd-24470418e82a tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:40.695636 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 96/210] 10.222.0.60 () {62 vars in 1247 bytes} [Wed Sep 14 08:48:40 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 14 08:48:40.695785 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-055ad084-c408-487f-b6cd-24470418e82a tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:40.696546 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-055ad084-c408-487f-b6cd-24470418e82a tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:40.697064 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-055ad084-c408-487f-b6cd-24470418e82a tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:40.885784 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-055ad084-c408-487f-b6cd-24470418e82a tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326618ebc864ba58c6df2c471c0f978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d1553889c474f75bd545166eff212b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:48:40.896746 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-055ad084-c408-487f-b6cd-24470418e82a tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] 10.222.0.60 "GET /compute/v2.1/servers/ef72dfda-b1e4-49c6-8830-33d25f6a4ec0" status: 200 len: 1338 microversion: 2.1 time: 0.222064 Sep 14 08:48:40.897486 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 115/211] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:48:40 2022] GET /compute/v2.1/servers/ef72dfda-b1e4-49c6-8830-33d25f6a4ec0 => generated 1338 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:48:40.918385 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-33bdc8ec-367f-4aaf-ad40-0918f897fc8a tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:40.919411 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-33bdc8ec-367f-4aaf-ad40-0918f897fc8a tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: 0a331816-6b06-40c9-a557-eada274501b5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:48:40.926265 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-33bdc8ec-367f-4aaf-ad40-0918f897fc8a tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:40.926899 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-33bdc8ec-367f-4aaf-ad40-0918f897fc8a tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:40.927475 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-33bdc8ec-367f-4aaf-ad40-0918f897fc8a tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:40.928343 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-33bdc8ec-367f-4aaf-ad40-0918f897fc8a tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:40.929293 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-33bdc8ec-367f-4aaf-ad40-0918f897fc8a tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:40.929849 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-33bdc8ec-367f-4aaf-ad40-0918f897fc8a tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:41.163894 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-33bdc8ec-367f-4aaf-ad40-0918f897fc8a tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:48:41.189811 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-33bdc8ec-367f-4aaf-ad40-0918f897fc8a tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/0a331816-6b06-40c9-a557-eada274501b5" status: 200 len: 1311 microversion: 2.1 time: 0.276965 Sep 14 08:48:41.191559 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 97/212] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:48:40 2022] GET /compute/v2.1/servers/0a331816-6b06-40c9-a557-eada274501b5 => generated 1311 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:48:41.653324 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-7a341f0a-e3b6-41f1-b6df-cf7465f52479 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:41.655062 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-7a341f0a-e3b6-41f1-b6df-cf7465f52479 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] [instance: 7045fd2e-8224-46b8-b477-57a46e18e93f] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:48:41.662661 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7a341f0a-e3b6-41f1-b6df-cf7465f52479 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:41.663277 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7a341f0a-e3b6-41f1-b6df-cf7465f52479 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:41.664513 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7a341f0a-e3b6-41f1-b6df-cf7465f52479 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:41.665394 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7a341f0a-e3b6-41f1-b6df-cf7465f52479 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:41.665866 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7a341f0a-e3b6-41f1-b6df-cf7465f52479 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:41.666769 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7a341f0a-e3b6-41f1-b6df-cf7465f52479 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:41.822650 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-7a341f0a-e3b6-41f1-b6df-cf7465f52479 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e462483415e4c2b8a917b2a032e5ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac4d0cae0bd46fda94d7bfb900a0b9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:48:41.831513 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-7a341f0a-e3b6-41f1-b6df-cf7465f52479 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] 10.222.0.60 "GET /compute/v2.1/servers/7045fd2e-8224-46b8-b477-57a46e18e93f" status: 200 len: 1342 microversion: 2.1 time: 0.187476 Sep 14 08:48:41.832442 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 116/213] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:48:41 2022] GET /compute/v2.1/servers/7045fd2e-8224-46b8-b477-57a46e18e93f => generated 1342 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:48:41.920935 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-40c1123e-61ae-410b-864e-61f90067b558 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:41.921683 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-40c1123e-61ae-410b-864e-61f90067b558 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] [instance: ef72dfda-b1e4-49c6-8830-33d25f6a4ec0] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:48:41.928498 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-40c1123e-61ae-410b-864e-61f90067b558 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:41.928990 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-40c1123e-61ae-410b-864e-61f90067b558 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:41.929424 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-40c1123e-61ae-410b-864e-61f90067b558 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:41.930386 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-40c1123e-61ae-410b-864e-61f90067b558 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:41.930840 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-40c1123e-61ae-410b-864e-61f90067b558 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:41.931319 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-40c1123e-61ae-410b-864e-61f90067b558 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:41.952570 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-8a54d639-224c-4fec-be52-ef314773cdca req-3540b1f0-0ad0-444c-b29b-aa949adee5da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef72dfda-b1e4-49c6-8830-33d25f6a4ec0", "name": "network-vif-plugged", "status": "completed", "tag": "79944610-1b41-47dc-b7f4-3b8812c658aa"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:48:41.970060 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-8a54d639-224c-4fec-be52-ef314773cdca req-3540b1f0-0ad0-444c-b29b-aa949adee5da service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:41.971161 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-8a54d639-224c-4fec-be52-ef314773cdca req-3540b1f0-0ad0-444c-b29b-aa949adee5da service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:41.974889 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-8a54d639-224c-4fec-be52-ef314773cdca req-3540b1f0-0ad0-444c-b29b-aa949adee5da service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:41.991326 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-8a54d639-224c-4fec-be52-ef314773cdca req-3540b1f0-0ad0-444c-b29b-aa949adee5da service nova] Creating event network-vif-plugged:79944610-1b41-47dc-b7f4-3b8812c658aa for instance ef72dfda-b1e4-49c6-8830-33d25f6a4ec0 on n-h2-836830-18 Sep 14 08:48:41.996605 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-8a54d639-224c-4fec-be52-ef314773cdca req-3540b1f0-0ad0-444c-b29b-aa949adee5da service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050314 Sep 14 08:48:41.998657 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 117/214] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:48:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 08:48:42.220074 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f06c3eb8-68f5-4384-9e36-4f06e703bf46 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:42.220936 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f06c3eb8-68f5-4384-9e36-4f06e703bf46 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: 0a331816-6b06-40c9-a557-eada274501b5] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:48:42.237186 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f06c3eb8-68f5-4384-9e36-4f06e703bf46 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:42.237948 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f06c3eb8-68f5-4384-9e36-4f06e703bf46 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:42.238560 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f06c3eb8-68f5-4384-9e36-4f06e703bf46 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:42.239441 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f06c3eb8-68f5-4384-9e36-4f06e703bf46 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:42.240036 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f06c3eb8-68f5-4384-9e36-4f06e703bf46 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:42.240602 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f06c3eb8-68f5-4384-9e36-4f06e703bf46 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:42.280146 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-40c1123e-61ae-410b-864e-61f90067b558 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326618ebc864ba58c6df2c471c0f978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d1553889c474f75bd545166eff212b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:48:42.292619 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-40c1123e-61ae-410b-864e-61f90067b558 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] 10.222.0.60 "GET /compute/v2.1/servers/ef72dfda-b1e4-49c6-8830-33d25f6a4ec0" status: 200 len: 1338 microversion: 2.1 time: 0.375541 Sep 14 08:48:42.309585 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 98/215] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:48:41 2022] GET /compute/v2.1/servers/ef72dfda-b1e4-49c6-8830-33d25f6a4ec0 => generated 1338 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:48:42.660749 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f06c3eb8-68f5-4384-9e36-4f06e703bf46 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:48:42.671101 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f06c3eb8-68f5-4384-9e36-4f06e703bf46 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/0a331816-6b06-40c9-a557-eada274501b5" status: 200 len: 1311 microversion: 2.1 time: 0.455413 Sep 14 08:48:42.687446 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 118/216] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:48:42 2022] GET /compute/v2.1/servers/0a331816-6b06-40c9-a557-eada274501b5 => generated 1311 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:48:42.857148 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-4bd42941-2d73-4f8b-b34c-38241d880100 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:42.857849 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-4bd42941-2d73-4f8b-b34c-38241d880100 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] [instance: 7045fd2e-8224-46b8-b477-57a46e18e93f] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:48:42.868184 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4bd42941-2d73-4f8b-b34c-38241d880100 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:42.868751 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4bd42941-2d73-4f8b-b34c-38241d880100 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:42.869394 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4bd42941-2d73-4f8b-b34c-38241d880100 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:42.870456 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4bd42941-2d73-4f8b-b34c-38241d880100 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:42.871420 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4bd42941-2d73-4f8b-b34c-38241d880100 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:42.872036 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4bd42941-2d73-4f8b-b34c-38241d880100 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:43.133540 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-4bd42941-2d73-4f8b-b34c-38241d880100 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e462483415e4c2b8a917b2a032e5ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac4d0cae0bd46fda94d7bfb900a0b9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:48:43.143770 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-4bd42941-2d73-4f8b-b34c-38241d880100 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] 10.222.0.60 "GET /compute/v2.1/servers/7045fd2e-8224-46b8-b477-57a46e18e93f" status: 200 len: 1491 microversion: 2.1 time: 0.291906 Sep 14 08:48:43.163214 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 99/217] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:48:42 2022] GET /compute/v2.1/servers/7045fd2e-8224-46b8-b477-57a46e18e93f => generated 1491 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:48:43.398799 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-bdda9bfb-66e8-4bb5-afcf-ae785180e899 tempest-HypervisorAdminV228Test-1937292927 tempest-HypervisorAdminV228Test-1937292927-project-admin] Calling method '.version_select at 0x7f7d44e435e0>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:43.401036 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bdda9bfb-66e8-4bb5-afcf-ae785180e899 tempest-HypervisorAdminV228Test-1937292927 tempest-HypervisorAdminV228Test-1937292927-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:43.401707 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bdda9bfb-66e8-4bb5-afcf-ae785180e899 tempest-HypervisorAdminV228Test-1937292927 tempest-HypervisorAdminV228Test-1937292927-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:43.402252 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bdda9bfb-66e8-4bb5-afcf-ae785180e899 tempest-HypervisorAdminV228Test-1937292927 tempest-HypervisorAdminV228Test-1937292927-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:43.418375 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bdda9bfb-66e8-4bb5-afcf-ae785180e899 tempest-HypervisorAdminV228Test-1937292927 tempest-HypervisorAdminV228Test-1937292927-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:43.419147 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bdda9bfb-66e8-4bb5-afcf-ae785180e899 tempest-HypervisorAdminV228Test-1937292927 tempest-HypervisorAdminV228Test-1937292927-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:43.419840 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bdda9bfb-66e8-4bb5-afcf-ae785180e899 tempest-HypervisorAdminV228Test-1937292927 tempest-HypervisorAdminV228Test-1937292927-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:43.433970 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bdda9bfb-66e8-4bb5-afcf-ae785180e899 tempest-HypervisorAdminV228Test-1937292927 tempest-HypervisorAdminV228Test-1937292927-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:43.436488 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bdda9bfb-66e8-4bb5-afcf-ae785180e899 tempest-HypervisorAdminV228Test-1937292927 tempest-HypervisorAdminV228Test-1937292927-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:43.437894 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bdda9bfb-66e8-4bb5-afcf-ae785180e899 tempest-HypervisorAdminV228Test-1937292927 tempest-HypervisorAdminV228Test-1937292927-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:43.445610 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-bdda9bfb-66e8-4bb5-afcf-ae785180e899 tempest-HypervisorAdminV228Test-1937292927 tempest-HypervisorAdminV228Test-1937292927-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.28 time: 0.428269 Sep 14 08:48:43.446700 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 119/218] 10.222.0.60 () {60 vars in 1187 bytes} [Wed Sep 14 08:48:43 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 08:48:43.453831 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-b47de89c-1b62-46fb-956a-37fb3a7e3730 req-63ccc264-34f7-4335-9dd5-afb81be70913 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a331816-6b06-40c9-a557-eada274501b5", "tag": "667429a7-9153-49c5-a750-cc44e1cd077d"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:48:43.469093 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-b47de89c-1b62-46fb-956a-37fb3a7e3730 req-63ccc264-34f7-4335-9dd5-afb81be70913 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:43.469725 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-b47de89c-1b62-46fb-956a-37fb3a7e3730 req-63ccc264-34f7-4335-9dd5-afb81be70913 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:43.470258 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-b47de89c-1b62-46fb-956a-37fb3a7e3730 req-63ccc264-34f7-4335-9dd5-afb81be70913 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:43.482293 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-b47de89c-1b62-46fb-956a-37fb3a7e3730 req-63ccc264-34f7-4335-9dd5-afb81be70913 service nova] Creating event network-changed:667429a7-9153-49c5-a750-cc44e1cd077d for instance 0a331816-6b06-40c9-a557-eada274501b5 on n-h1-836830-18 Sep 14 08:48:43.490831 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-b47de89c-1b62-46fb-956a-37fb3a7e3730 req-63ccc264-34f7-4335-9dd5-afb81be70913 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042547 Sep 14 08:48:43.492499 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 120/219] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:48:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:48:43.501636 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b8afef6a-37e1-4da3-a691-7ffb1be09661 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:43.502506 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b8afef6a-37e1-4da3-a691-7ffb1be09661 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] [instance: ef72dfda-b1e4-49c6-8830-33d25f6a4ec0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:48:43.510663 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b8afef6a-37e1-4da3-a691-7ffb1be09661 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:43.511666 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b8afef6a-37e1-4da3-a691-7ffb1be09661 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:43.512347 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b8afef6a-37e1-4da3-a691-7ffb1be09661 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:43.514053 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b8afef6a-37e1-4da3-a691-7ffb1be09661 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:43.514779 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b8afef6a-37e1-4da3-a691-7ffb1be09661 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:43.515471 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b8afef6a-37e1-4da3-a691-7ffb1be09661 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:43.536907 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=100 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:48:43.657463 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-91b13b7f-fdac-474c-8ef6-8660cb1e51d8 tempest-DeleteServersAdminTestJSON-128887994 tempest-DeleteServersAdminTestJSON-128887994-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:43.657972 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-91b13b7f-fdac-474c-8ef6-8660cb1e51d8 tempest-DeleteServersAdminTestJSON-128887994 tempest-DeleteServersAdminTestJSON-128887994-project-admin] [instance: 7045fd2e-8224-46b8-b477-57a46e18e93f] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:48:43.665553 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-91b13b7f-fdac-474c-8ef6-8660cb1e51d8 tempest-DeleteServersAdminTestJSON-128887994 tempest-DeleteServersAdminTestJSON-128887994-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:43.666052 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-91b13b7f-fdac-474c-8ef6-8660cb1e51d8 tempest-DeleteServersAdminTestJSON-128887994 tempest-DeleteServersAdminTestJSON-128887994-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:43.666487 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-91b13b7f-fdac-474c-8ef6-8660cb1e51d8 tempest-DeleteServersAdminTestJSON-128887994 tempest-DeleteServersAdminTestJSON-128887994-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:43.667326 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-91b13b7f-fdac-474c-8ef6-8660cb1e51d8 tempest-DeleteServersAdminTestJSON-128887994 tempest-DeleteServersAdminTestJSON-128887994-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:43.667783 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-91b13b7f-fdac-474c-8ef6-8660cb1e51d8 tempest-DeleteServersAdminTestJSON-128887994 tempest-DeleteServersAdminTestJSON-128887994-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:43.668208 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-91b13b7f-fdac-474c-8ef6-8660cb1e51d8 tempest-DeleteServersAdminTestJSON-128887994 tempest-DeleteServersAdminTestJSON-128887994-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:43.747330 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-91b13b7f-fdac-474c-8ef6-8660cb1e51d8 tempest-DeleteServersAdminTestJSON-128887994 tempest-DeleteServersAdminTestJSON-128887994-project-admin] [instance: 7045fd2e-8224-46b8-b477-57a46e18e93f] Going to try to terminate instance {{(pid=128758) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 08:48:43.836732 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b8afef6a-37e1-4da3-a691-7ffb1be09661 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326618ebc864ba58c6df2c471c0f978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d1553889c474f75bd545166eff212b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:48:43.847469 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b8afef6a-37e1-4da3-a691-7ffb1be09661 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] 10.222.0.60 "GET /compute/v2.1/servers/ef72dfda-b1e4-49c6-8830-33d25f6a4ec0" status: 200 len: 1338 microversion: 2.1 time: 0.353195 Sep 14 08:48:43.850589 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 121/220] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:48:43 2022] GET /compute/v2.1/servers/ef72dfda-b1e4-49c6-8830-33d25f6a4ec0 => generated 1338 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:48:43.866127 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8573804e-f5e1-43b5-96f3-b31245f6f938 tempest-HypervisorAdminV228Test-1937292927 tempest-HypervisorAdminV228Test-1937292927-project-admin] Calling method '.version_select at 0x7f7d44e43040>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:43.868505 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8573804e-f5e1-43b5-96f3-b31245f6f938 tempest-HypervisorAdminV228Test-1937292927 tempest-HypervisorAdminV228Test-1937292927-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:43.868992 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8573804e-f5e1-43b5-96f3-b31245f6f938 tempest-HypervisorAdminV228Test-1937292927 tempest-HypervisorAdminV228Test-1937292927-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:43.870171 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8573804e-f5e1-43b5-96f3-b31245f6f938 tempest-HypervisorAdminV228Test-1937292927 tempest-HypervisorAdminV228Test-1937292927-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:43.873189 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:48:43.908520 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8573804e-f5e1-43b5-96f3-b31245f6f938 tempest-HypervisorAdminV228Test-1937292927 tempest-HypervisorAdminV228Test-1937292927-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:43.910697 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8573804e-f5e1-43b5-96f3-b31245f6f938 tempest-HypervisorAdminV228Test-1937292927 tempest-HypervisorAdminV228Test-1937292927-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:43.911683 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8573804e-f5e1-43b5-96f3-b31245f6f938 tempest-HypervisorAdminV228Test-1937292927 tempest-HypervisorAdminV228Test-1937292927-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:43.913763 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-91b13b7f-fdac-474c-8ef6-8660cb1e51d8 tempest-DeleteServersAdminTestJSON-128887994 tempest-DeleteServersAdminTestJSON-128887994-project-admin] 10.222.0.60 "DELETE /compute/v2.1/servers/7045fd2e-8224-46b8-b477-57a46e18e93f" status: 204 len: 0 microversion: 2.1 time: 0.747471 Sep 14 08:48:43.914434 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 100/221] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 08:48:43 2022] DELETE /compute/v2.1/servers/7045fd2e-8224-46b8-b477-57a46e18e93f => generated 0 bytes in 750 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 14 08:48:43.922548 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-e6cff5ce-17a6-4fe9-9fab-236239648154 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:43.924694 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-e6cff5ce-17a6-4fe9-9fab-236239648154 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: 0a331816-6b06-40c9-a557-eada274501b5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:48:43.929742 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-8573804e-f5e1-43b5-96f3-b31245f6f938 tempest-HypervisorAdminV228Test-1937292927 tempest-HypervisorAdminV228Test-1937292927-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 720 microversion: 2.28 time: 0.077976 Sep 14 08:48:43.937746 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e6cff5ce-17a6-4fe9-9fab-236239648154 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:43.938322 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e6cff5ce-17a6-4fe9-9fab-236239648154 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:43.938765 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e6cff5ce-17a6-4fe9-9fab-236239648154 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:43.939500 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e6cff5ce-17a6-4fe9-9fab-236239648154 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:43.939948 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e6cff5ce-17a6-4fe9-9fab-236239648154 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:43.940543 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e6cff5ce-17a6-4fe9-9fab-236239648154 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:43.945717 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 122/222] 10.222.0.60 () {60 vars in 1193 bytes} [Wed Sep 14 08:48:43 2022] GET /compute/v2.1/os-hypervisors/1 => generated 720 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 08:48:44.209464 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e621eb64-b32d-4a40-837c-d72e385db33e tempest-HypervisorAdminV253TestBase-197860043 tempest-HypervisorAdminV253TestBase-197860043-project-admin] Calling method '.version_select at 0x7f7d44f01700>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:44.214918 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e621eb64-b32d-4a40-837c-d72e385db33e tempest-HypervisorAdminV253TestBase-197860043 tempest-HypervisorAdminV253TestBase-197860043-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:44.215442 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e621eb64-b32d-4a40-837c-d72e385db33e tempest-HypervisorAdminV253TestBase-197860043 tempest-HypervisorAdminV253TestBase-197860043-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:44.215931 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e621eb64-b32d-4a40-837c-d72e385db33e tempest-HypervisorAdminV253TestBase-197860043 tempest-HypervisorAdminV253TestBase-197860043-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:44.241884 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e621eb64-b32d-4a40-837c-d72e385db33e tempest-HypervisorAdminV253TestBase-197860043 tempest-HypervisorAdminV253TestBase-197860043-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:44.242372 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e621eb64-b32d-4a40-837c-d72e385db33e tempest-HypervisorAdminV253TestBase-197860043 tempest-HypervisorAdminV253TestBase-197860043-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:44.242816 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e621eb64-b32d-4a40-837c-d72e385db33e tempest-HypervisorAdminV253TestBase-197860043 tempest-HypervisorAdminV253TestBase-197860043-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:44.296571 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e621eb64-b32d-4a40-837c-d72e385db33e tempest-HypervisorAdminV253TestBase-197860043 tempest-HypervisorAdminV253TestBase-197860043-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:44.297087 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e621eb64-b32d-4a40-837c-d72e385db33e tempest-HypervisorAdminV253TestBase-197860043 tempest-HypervisorAdminV253TestBase-197860043-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:44.297654 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e621eb64-b32d-4a40-837c-d72e385db33e tempest-HypervisorAdminV253TestBase-197860043 tempest-HypervisorAdminV253TestBase-197860043-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:44.300022 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-e6cff5ce-17a6-4fe9-9fab-236239648154 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:48:44.310718 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-e6cff5ce-17a6-4fe9-9fab-236239648154 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/0a331816-6b06-40c9-a557-eada274501b5" status: 200 len: 1311 microversion: 2.1 time: 0.394513 Sep 14 08:48:44.311751 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 101/223] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:48:43 2022] GET /compute/v2.1/servers/0a331816-6b06-40c9-a557-eada274501b5 => generated 1311 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:48:44.313913 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e621eb64-b32d-4a40-837c-d72e385db33e tempest-HypervisorAdminV253TestBase-197860043 tempest-HypervisorAdminV253TestBase-197860043-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:44.314413 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e621eb64-b32d-4a40-837c-d72e385db33e tempest-HypervisorAdminV253TestBase-197860043 tempest-HypervisorAdminV253TestBase-197860043-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:44.314961 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e621eb64-b32d-4a40-837c-d72e385db33e tempest-HypervisorAdminV253TestBase-197860043 tempest-HypervisorAdminV253TestBase-197860043-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:44.317216 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-4e53f99b-f227-41e1-8b01-b6b4b2a62317 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:44.317825 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-4e53f99b-f227-41e1-8b01-b6b4b2a62317 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] [instance: 7045fd2e-8224-46b8-b477-57a46e18e93f] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:48:44.323767 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4e53f99b-f227-41e1-8b01-b6b4b2a62317 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:44.324400 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4e53f99b-f227-41e1-8b01-b6b4b2a62317 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:44.324978 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4e53f99b-f227-41e1-8b01-b6b4b2a62317 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:44.326377 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4e53f99b-f227-41e1-8b01-b6b4b2a62317 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:44.326993 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4e53f99b-f227-41e1-8b01-b6b4b2a62317 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:44.327555 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4e53f99b-f227-41e1-8b01-b6b4b2a62317 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:44.344279 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e621eb64-b32d-4a40-837c-d72e385db33e tempest-HypervisorAdminV253TestBase-197860043 tempest-HypervisorAdminV253TestBase-197860043-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:44.344759 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e621eb64-b32d-4a40-837c-d72e385db33e tempest-HypervisorAdminV253TestBase-197860043 tempest-HypervisorAdminV253TestBase-197860043-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:44.345192 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e621eb64-b32d-4a40-837c-d72e385db33e tempest-HypervisorAdminV253TestBase-197860043 tempest-HypervisorAdminV253TestBase-197860043-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:44.352827 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e621eb64-b32d-4a40-837c-d72e385db33e tempest-HypervisorAdminV253TestBase-197860043 tempest-HypervisorAdminV253TestBase-197860043-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1840 microversion: 2.53 time: 0.405805 Sep 14 08:48:44.353720 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 123/224] 10.222.0.60 () {60 vars in 1243 bytes} [Wed Sep 14 08:48:43 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1840 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:48:44.384384 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8c3a4551-727f-4fc6-968f-aa6596556199 tempest-HypervisorAdminV253TestBase-197860043 tempest-HypervisorAdminV253TestBase-197860043-project-admin] Calling method '.version_select at 0x7f7d44ecc040>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:44.392611 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8c3a4551-727f-4fc6-968f-aa6596556199 tempest-HypervisorAdminV253TestBase-197860043 tempest-HypervisorAdminV253TestBase-197860043-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:44.393553 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8c3a4551-727f-4fc6-968f-aa6596556199 tempest-HypervisorAdminV253TestBase-197860043 tempest-HypervisorAdminV253TestBase-197860043-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:44.394409 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8c3a4551-727f-4fc6-968f-aa6596556199 tempest-HypervisorAdminV253TestBase-197860043 tempest-HypervisorAdminV253TestBase-197860043-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:44.415290 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8c3a4551-727f-4fc6-968f-aa6596556199 tempest-HypervisorAdminV253TestBase-197860043 tempest-HypervisorAdminV253TestBase-197860043-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:44.415566 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8c3a4551-727f-4fc6-968f-aa6596556199 tempest-HypervisorAdminV253TestBase-197860043 tempest-HypervisorAdminV253TestBase-197860043-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:44.416002 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8c3a4551-727f-4fc6-968f-aa6596556199 tempest-HypervisorAdminV253TestBase-197860043 tempest-HypervisorAdminV253TestBase-197860043-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:44.453945 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8c3a4551-727f-4fc6-968f-aa6596556199 tempest-HypervisorAdminV253TestBase-197860043 tempest-HypervisorAdminV253TestBase-197860043-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:44.455912 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8c3a4551-727f-4fc6-968f-aa6596556199 tempest-HypervisorAdminV253TestBase-197860043 tempest-HypervisorAdminV253TestBase-197860043-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:44.455912 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8c3a4551-727f-4fc6-968f-aa6596556199 tempest-HypervisorAdminV253TestBase-197860043 tempest-HypervisorAdminV253TestBase-197860043-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:44.475103 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8c3a4551-727f-4fc6-968f-aa6596556199 tempest-HypervisorAdminV253TestBase-197860043 tempest-HypervisorAdminV253TestBase-197860043-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:44.476083 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8c3a4551-727f-4fc6-968f-aa6596556199 tempest-HypervisorAdminV253TestBase-197860043 tempest-HypervisorAdminV253TestBase-197860043-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:44.477320 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8c3a4551-727f-4fc6-968f-aa6596556199 tempest-HypervisorAdminV253TestBase-197860043 tempest-HypervisorAdminV253TestBase-197860043-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:44.503393 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8c3a4551-727f-4fc6-968f-aa6596556199 tempest-HypervisorAdminV253TestBase-197860043 tempest-HypervisorAdminV253TestBase-197860043-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:44.503890 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8c3a4551-727f-4fc6-968f-aa6596556199 tempest-HypervisorAdminV253TestBase-197860043 tempest-HypervisorAdminV253TestBase-197860043-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:44.504416 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8c3a4551-727f-4fc6-968f-aa6596556199 tempest-HypervisorAdminV253TestBase-197860043 tempest-HypervisorAdminV253TestBase-197860043-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:44.514288 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-8c3a4551-727f-4fc6-968f-aa6596556199 tempest-HypervisorAdminV253TestBase-197860043 tempest-HypervisorAdminV253TestBase-197860043-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 530 microversion: 2.53 time: 0.135436 Sep 14 08:48:44.523764 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 124/225] 10.222.0.60 () {60 vars in 1222 bytes} [Wed Sep 14 08:48:44 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 530 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 08:48:44.535206 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-908152bf-e03e-4c6f-9c4d-0b223963a6d1 tempest-HypervisorAdminV253TestBase-197860043 tempest-HypervisorAdminV253TestBase-197860043-project-admin] Calling method '.version_select at 0x7f7d44de2ee0>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:44.538962 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-908152bf-e03e-4c6f-9c4d-0b223963a6d1 tempest-HypervisorAdminV253TestBase-197860043 tempest-HypervisorAdminV253TestBase-197860043-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:44.544176 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-908152bf-e03e-4c6f-9c4d-0b223963a6d1 tempest-HypervisorAdminV253TestBase-197860043 tempest-HypervisorAdminV253TestBase-197860043-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:44.544176 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-908152bf-e03e-4c6f-9c4d-0b223963a6d1 tempest-HypervisorAdminV253TestBase-197860043 tempest-HypervisorAdminV253TestBase-197860043-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:44.564445 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-908152bf-e03e-4c6f-9c4d-0b223963a6d1 tempest-HypervisorAdminV253TestBase-197860043 tempest-HypervisorAdminV253TestBase-197860043-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:44.564646 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-908152bf-e03e-4c6f-9c4d-0b223963a6d1 tempest-HypervisorAdminV253TestBase-197860043 tempest-HypervisorAdminV253TestBase-197860043-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:44.564969 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-908152bf-e03e-4c6f-9c4d-0b223963a6d1 tempest-HypervisorAdminV253TestBase-197860043 tempest-HypervisorAdminV253TestBase-197860043-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:44.571374 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-908152bf-e03e-4c6f-9c4d-0b223963a6d1 tempest-HypervisorAdminV253TestBase-197860043 tempest-HypervisorAdminV253TestBase-197860043-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors/f078b78a-d99e-4d29-8c71-3ce706365303" status: 200 len: 794 microversion: 2.53 time: 0.043976 Sep 14 08:48:44.572450 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 125/226] 10.222.0.60 () {60 vars in 1298 bytes} [Wed Sep 14 08:48:44 2022] GET /compute/v2.1/os-hypervisors/f078b78a-d99e-4d29-8c71-3ce706365303 => generated 794 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 08:48:44.633202 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-4e53f99b-f227-41e1-8b01-b6b4b2a62317 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e462483415e4c2b8a917b2a032e5ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac4d0cae0bd46fda94d7bfb900a0b9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:48:44.640853 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-4e53f99b-f227-41e1-8b01-b6b4b2a62317 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] 10.222.0.60 "GET /compute/v2.1/servers/7045fd2e-8224-46b8-b477-57a46e18e93f" status: 200 len: 1497 microversion: 2.1 time: 0.327302 Sep 14 08:48:44.641441 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 102/227] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:48:44 2022] GET /compute/v2.1/servers/7045fd2e-8224-46b8-b477-57a46e18e93f => generated 1497 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:48:44.876234 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-bfad6a6c-6e77-48a0-9a1a-dc8dd977cf9d tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:44.877992 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-bfad6a6c-6e77-48a0-9a1a-dc8dd977cf9d tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] [instance: ef72dfda-b1e4-49c6-8830-33d25f6a4ec0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:48:44.887921 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bfad6a6c-6e77-48a0-9a1a-dc8dd977cf9d tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:44.888934 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bfad6a6c-6e77-48a0-9a1a-dc8dd977cf9d tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:44.890000 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bfad6a6c-6e77-48a0-9a1a-dc8dd977cf9d tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:44.890790 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bfad6a6c-6e77-48a0-9a1a-dc8dd977cf9d tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:44.891967 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bfad6a6c-6e77-48a0-9a1a-dc8dd977cf9d tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:44.892829 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bfad6a6c-6e77-48a0-9a1a-dc8dd977cf9d tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:45.049577 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-bfad6a6c-6e77-48a0-9a1a-dc8dd977cf9d tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326618ebc864ba58c6df2c471c0f978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d1553889c474f75bd545166eff212b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:48:45.061466 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-bfad6a6c-6e77-48a0-9a1a-dc8dd977cf9d tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] 10.222.0.60 "GET /compute/v2.1/servers/ef72dfda-b1e4-49c6-8830-33d25f6a4ec0" status: 200 len: 1488 microversion: 2.1 time: 0.190352 Sep 14 08:48:45.067482 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 126/228] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:48:44 2022] GET /compute/v2.1/servers/ef72dfda-b1e4-49c6-8830-33d25f6a4ec0 => generated 1488 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:48:45.090962 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-fa9ecc5e-ca6a-4133-bd28-ab116da95825 tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:45.092305 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-fa9ecc5e-ca6a-4133-bd28-ab116da95825 tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] [instance: ef72dfda-b1e4-49c6-8830-33d25f6a4ec0] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:48:45.101860 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fa9ecc5e-ca6a-4133-bd28-ab116da95825 tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:45.102413 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fa9ecc5e-ca6a-4133-bd28-ab116da95825 tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:45.103463 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fa9ecc5e-ca6a-4133-bd28-ab116da95825 tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:45.104173 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fa9ecc5e-ca6a-4133-bd28-ab116da95825 tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:45.104681 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fa9ecc5e-ca6a-4133-bd28-ab116da95825 tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:45.105108 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fa9ecc5e-ca6a-4133-bd28-ab116da95825 tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:45.337590 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b85307b7-2272-4394-a801-42adb96569dc tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:45.339684 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b85307b7-2272-4394-a801-42adb96569dc tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: 0a331816-6b06-40c9-a557-eada274501b5] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:48:45.355293 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b85307b7-2272-4394-a801-42adb96569dc tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:45.356213 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b85307b7-2272-4394-a801-42adb96569dc tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:45.359907 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b85307b7-2272-4394-a801-42adb96569dc tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:45.362274 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b85307b7-2272-4394-a801-42adb96569dc tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:45.363514 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b85307b7-2272-4394-a801-42adb96569dc tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:45.364180 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b85307b7-2272-4394-a801-42adb96569dc tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:45.523477 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-fa9ecc5e-ca6a-4133-bd28-ab116da95825 tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/ef72dfda-b1e4-49c6-8830-33d25f6a4ec0" status: 200 len: 1641 microversion: 2.1 time: 0.436232 Sep 14 08:48:45.527620 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 103/229] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:48:45 2022] GET /compute/v2.1/servers/ef72dfda-b1e4-49c6-8830-33d25f6a4ec0 => generated 1641 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:48:45.571637 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1cf8a671-a315-4402-b196-dfa2bdf26d58 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:45.574092 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-1cf8a671-a315-4402-b196-dfa2bdf26d58 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] [instance: ef72dfda-b1e4-49c6-8830-33d25f6a4ec0] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:48:45.588655 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1cf8a671-a315-4402-b196-dfa2bdf26d58 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:45.590176 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1cf8a671-a315-4402-b196-dfa2bdf26d58 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:45.592199 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1cf8a671-a315-4402-b196-dfa2bdf26d58 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:45.593120 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1cf8a671-a315-4402-b196-dfa2bdf26d58 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:45.594123 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1cf8a671-a315-4402-b196-dfa2bdf26d58 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:45.595349 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1cf8a671-a315-4402-b196-dfa2bdf26d58 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:45.652769 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-1cf8a671-a315-4402-b196-dfa2bdf26d58 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] [instance: ef72dfda-b1e4-49c6-8830-33d25f6a4ec0] Going to try to terminate instance {{(pid=128758) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 08:48:45.671767 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b85307b7-2272-4394-a801-42adb96569dc tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:48:45.679636 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b85307b7-2272-4394-a801-42adb96569dc tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/0a331816-6b06-40c9-a557-eada274501b5" status: 200 len: 1311 microversion: 2.1 time: 0.348952 Sep 14 08:48:45.684344 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 127/230] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:48:45 2022] GET /compute/v2.1/servers/0a331816-6b06-40c9-a557-eada274501b5 => generated 1311 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:48:45.693359 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e415c5e8-aded-41a7-827a-45c95a464354 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:45.699735 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e415c5e8-aded-41a7-827a-45c95a464354 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] [instance: 7045fd2e-8224-46b8-b477-57a46e18e93f] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:48:45.706830 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e415c5e8-aded-41a7-827a-45c95a464354 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:45.710248 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e415c5e8-aded-41a7-827a-45c95a464354 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:45.711213 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e415c5e8-aded-41a7-827a-45c95a464354 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:45.712247 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e415c5e8-aded-41a7-827a-45c95a464354 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:45.714162 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e415c5e8-aded-41a7-827a-45c95a464354 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:45.714767 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e415c5e8-aded-41a7-827a-45c95a464354 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:45.908067 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-1cf8a671-a315-4402-b196-dfa2bdf26d58 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] 10.222.0.60 "DELETE /compute/v2.1/servers/ef72dfda-b1e4-49c6-8830-33d25f6a4ec0" status: 204 len: 0 microversion: 2.1 time: 0.355808 Sep 14 08:48:45.908864 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 104/231] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 08:48:45 2022] DELETE /compute/v2.1/servers/ef72dfda-b1e4-49c6-8830-33d25f6a4ec0 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 08:48:45.924081 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-0e564bc4-0f0c-42ad-985f-1c7cd8be09fc tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:45.924796 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-0e564bc4-0f0c-42ad-985f-1c7cd8be09fc tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] [instance: ef72dfda-b1e4-49c6-8830-33d25f6a4ec0] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:48:45.931210 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0e564bc4-0f0c-42ad-985f-1c7cd8be09fc tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:45.931929 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0e564bc4-0f0c-42ad-985f-1c7cd8be09fc tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:45.932508 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0e564bc4-0f0c-42ad-985f-1c7cd8be09fc tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:45.933604 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0e564bc4-0f0c-42ad-985f-1c7cd8be09fc tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:45.934605 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0e564bc4-0f0c-42ad-985f-1c7cd8be09fc tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:45.935473 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0e564bc4-0f0c-42ad-985f-1c7cd8be09fc tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:46.155223 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-e415c5e8-aded-41a7-827a-45c95a464354 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e462483415e4c2b8a917b2a032e5ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac4d0cae0bd46fda94d7bfb900a0b9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:48:46.171762 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e415c5e8-aded-41a7-827a-45c95a464354 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] 10.222.0.60 "GET /compute/v2.1/servers/7045fd2e-8224-46b8-b477-57a46e18e93f" status: 200 len: 1497 microversion: 2.1 time: 0.486272 Sep 14 08:48:46.174845 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 128/232] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:48:45 2022] GET /compute/v2.1/servers/7045fd2e-8224-46b8-b477-57a46e18e93f => generated 1497 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:48:46.293268 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-0e564bc4-0f0c-42ad-985f-1c7cd8be09fc tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326618ebc864ba58c6df2c471c0f978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d1553889c474f75bd545166eff212b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:48:46.301585 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-0e564bc4-0f0c-42ad-985f-1c7cd8be09fc tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] 10.222.0.60 "GET /compute/v2.1/servers/ef72dfda-b1e4-49c6-8830-33d25f6a4ec0" status: 200 len: 1494 microversion: 2.1 time: 0.386013 Sep 14 08:48:46.305428 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 105/233] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:48:45 2022] GET /compute/v2.1/servers/ef72dfda-b1e4-49c6-8830-33d25f6a4ec0 => generated 1494 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:48:46.563812 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1fe8ace3-cdcf-4d67-84ec-3b89565a0255 tempest-QuotaClassesAdminTestJSON-457334390 tempest-QuotaClassesAdminTestJSON-457334390-project-admin] Calling method '.version_select at 0x7f7d450405e0>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:46.583533 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-1fe8ace3-cdcf-4d67-84ec-3b89565a0255 tempest-QuotaClassesAdminTestJSON-457334390 tempest-QuotaClassesAdminTestJSON-457334390-project-admin] 10.222.0.60 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.276678 Sep 14 08:48:46.584429 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 106/234] 10.222.0.60 () {58 vars in 1185 bytes} [Wed Sep 14 08:48:46 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:48:46.594114 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-62fb8d08-1179-4eda-a420-5588b3cefd7a req-38300798-2b1a-4878-b559-a3da5a9f5b8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7045fd2e-8224-46b8-b477-57a46e18e93f", "name": "network-vif-deleted", "tag": "ac6596d6-502b-4db1-8535-84f8989dd969"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:48:46.605244 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3dc52132-d4be-4916-8b37-f8f986089fc6 tempest-KeyPairsV210TestJSON-907543374 tempest-KeyPairsV210TestJSON-907543374-project-admin] Action: 'create', calling method: .version_select at 0x7f7d44ecc040>, body: {"keypair": {"name": "tempest-keypair-1603069945", "type": "ssh", "user_id": "8187ddb3fe034a6b865ca160a18dde7b", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBmmwkbsI61SBTL9G6RayXFisreJ8HI5FYV5GE6ugv/9g51TeX+qrKLp8Pe45A10ZA7lBQk8Rm5yUyucuFjV8T/AJcT5p1l/zYS+tIoTNmweRqwI0m/oKFGU1o6QpeMfDw=="}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:48:46.618699 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-62fb8d08-1179-4eda-a420-5588b3cefd7a req-38300798-2b1a-4878-b559-a3da5a9f5b8f service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:46.619219 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-62fb8d08-1179-4eda-a420-5588b3cefd7a req-38300798-2b1a-4878-b559-a3da5a9f5b8f service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:46.619649 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-62fb8d08-1179-4eda-a420-5588b3cefd7a req-38300798-2b1a-4878-b559-a3da5a9f5b8f service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:46.645725 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-62fb8d08-1179-4eda-a420-5588b3cefd7a req-38300798-2b1a-4878-b559-a3da5a9f5b8f service nova] Creating event network-vif-deleted:ac6596d6-502b-4db1-8535-84f8989dd969 for instance 7045fd2e-8224-46b8-b477-57a46e18e93f on n-h2-836830-18 Sep 14 08:48:46.652983 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-62fb8d08-1179-4eda-a420-5588b3cefd7a req-38300798-2b1a-4878-b559-a3da5a9f5b8f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067127 Sep 14 08:48:46.654244 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 107/235] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:48:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:48:46.664166 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-3c7e48fd-2d41-4cd9-acbc-6b45b48963cc tempest-QuotaClassesAdminTestJSON-457334390 tempest-QuotaClassesAdminTestJSON-457334390-project-admin] Action: 'update', calling method: .version_select at 0x7f7d44f9ad30>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:48:46.700679 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=18,nova_api:INSERT=8 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:48:46.808895 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-3dc52132-d4be-4916-8b37-f8f986089fc6 tempest-KeyPairsV210TestJSON-907543374 tempest-KeyPairsV210TestJSON-907543374-project-admin] Getting quotas for project fb8d29d545814fb98278749c6f5cbc33. Resources: {'key_pairs'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 08:48:46.815806 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-3dc52132-d4be-4916-8b37-f8f986089fc6 tempest-KeyPairsV210TestJSON-907543374 tempest-KeyPairsV210TestJSON-907543374-project-admin] Getting quotas for user 09790dcedb9c4918aa62fd34226976c3 and project fb8d29d545814fb98278749c6f5cbc33. Resources: {'key_pairs'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 08:48:46.856366 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-3dc52132-d4be-4916-8b37-f8f986089fc6 tempest-KeyPairsV210TestJSON-907543374 tempest-KeyPairsV210TestJSON-907543374-project-admin] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.679811 Sep 14 08:48:46.859108 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 129/236] 10.222.0.60 () {62 vars in 1200 bytes} [Wed Sep 14 08:48:46 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 683 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 14 08:48:46.864764 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-2688094d-94d5-47da-92c3-4201f35f21ea tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:46.865391 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-2688094d-94d5-47da-92c3-4201f35f21ea tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: 0a331816-6b06-40c9-a557-eada274501b5] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:48:46.874022 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2688094d-94d5-47da-92c3-4201f35f21ea tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:46.875206 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2688094d-94d5-47da-92c3-4201f35f21ea tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:46.875836 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2688094d-94d5-47da-92c3-4201f35f21ea tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:46.876927 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2688094d-94d5-47da-92c3-4201f35f21ea tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:46.877619 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2688094d-94d5-47da-92c3-4201f35f21ea tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:46.878056 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2688094d-94d5-47da-92c3-4201f35f21ea tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:46.971553 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-3c7e48fd-2d41-4cd9-acbc-6b45b48963cc tempest-QuotaClassesAdminTestJSON-457334390 tempest-QuotaClassesAdminTestJSON-457334390-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.314828 Sep 14 08:48:46.972550 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 108/237] 10.222.0.60 () {60 vars in 1206 bytes} [Wed Sep 14 08:48:46 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:48:46.987310 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-6b1eaa3c-b038-491f-81f2-acf7b961a721 tempest-KeyPairsV210TestJSON-907543374 tempest-KeyPairsV210TestJSON-907543374-project-admin] Action: 'create', calling method: .version_select at 0x7f7d45032a60>, body: {"keypair": {"name": "tempest-keypair-24303619", "type": "ssh", "user_id": "8187ddb3fe034a6b865ca160a18dde7b", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJXiX8UJ0O8wdFrLeHthdOD8SLEb3OflyONPl3UrYzC36AUurHqWzV2/ug9gxscqa8iXlbOXrF1tVTZNwwqJxNzBu7zCTcDwlzIINJ9hFUSOOteQIIv+/tMQ2zRwLQEgxA=="}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:48:47.011719 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-6b1eaa3c-b038-491f-81f2-acf7b961a721 tempest-KeyPairsV210TestJSON-907543374 tempest-KeyPairsV210TestJSON-907543374-project-admin] Getting quotas for project fb8d29d545814fb98278749c6f5cbc33. Resources: {'key_pairs'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 08:48:47.021519 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-6b1eaa3c-b038-491f-81f2-acf7b961a721 tempest-KeyPairsV210TestJSON-907543374 tempest-KeyPairsV210TestJSON-907543374-project-admin] Getting quotas for user 09790dcedb9c4918aa62fd34226976c3 and project fb8d29d545814fb98278749c6f5cbc33. Resources: {'key_pairs'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 08:48:47.069651 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-6b1eaa3c-b038-491f-81f2-acf7b961a721 tempest-KeyPairsV210TestJSON-907543374 tempest-KeyPairsV210TestJSON-907543374-project-admin] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.10 time: 0.086707 Sep 14 08:48:47.075096 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 109/238] 10.222.0.60 () {62 vars in 1200 bytes} [Wed Sep 14 08:48:46 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 89 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 14 08:48:47.081922 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a4a0b43d-42b3-4432-83a9-4914215f4850 tempest-QuotaClassesAdminTestJSON-457334390 tempest-QuotaClassesAdminTestJSON-457334390-project-admin] Calling method '.version_select at 0x7f7d4519cca0>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:47.105728 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-a4a0b43d-42b3-4432-83a9-4914215f4850 tempest-QuotaClassesAdminTestJSON-457334390 tempest-QuotaClassesAdminTestJSON-457334390-project-admin] 10.222.0.60 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.033864 Sep 14 08:48:47.114071 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 110/239] 10.222.0.60 () {58 vars in 1185 bytes} [Wed Sep 14 08:48:47 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:48:47.114071 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-3de148e7-8b67-4cfb-8677-7d1f7f005194 tempest-KeyPairsV210TestJSON-907543374 tempest-KeyPairsV210TestJSON-907543374-project-admin] Calling method '.version_select at 0x7f7d44ee25e0>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:47.122778 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-3de148e7-8b67-4cfb-8677-7d1f7f005194 tempest-KeyPairsV210TestJSON-907543374 tempest-KeyPairsV210TestJSON-907543374-project-admin] 10.222.0.60 "GET /compute/v2.1/os-keypairs/tempest-keypair-1603069945?user_id=8187ddb3fe034a6b865ca160a18dde7b" status: 200 len: 512 microversion: 2.10 time: 0.014398 Sep 14 08:48:47.123730 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 111/240] 10.222.0.60 () {60 vars in 1340 bytes} [Wed Sep 14 08:48:47 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1603069945?user_id=8187ddb3fe034a6b865ca160a18dde7b => generated 512 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 08:48:47.138986 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a5ed4883-df2b-4b65-9eff-d3f4314dd175 tempest-QuotaClassesAdminTestJSON-457334390 tempest-QuotaClassesAdminTestJSON-457334390-project-admin] Action: 'update', calling method: .version_select at 0x7f7d46362af0>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:48:47.226497 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-2688094d-94d5-47da-92c3-4201f35f21ea tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:48:47.238493 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-2688094d-94d5-47da-92c3-4201f35f21ea tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/0a331816-6b06-40c9-a557-eada274501b5" status: 200 len: 1311 microversion: 2.1 time: 0.377446 Sep 14 08:48:47.239490 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 130/241] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:48:46 2022] GET /compute/v2.1/servers/0a331816-6b06-40c9-a557-eada274501b5 => generated 1311 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:48:47.244244 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-4a7b85b2-3c09-4336-9b18-5b9e7c95c84e tempest-KeyPairsV210TestJSON-907543374 tempest-KeyPairsV210TestJSON-907543374-project-admin] Action: 'create', calling method: .version_select at 0x7f7d44e39dc0>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-169253464", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBK4o/MVaT/NjFsHx6m+ns6rUQRaS9akLN0p0HV1TkT1+yb6iYJFzHTTH/T1T9dKJIbLBEc96UjbFuYtnaXDLfiRAd3IGn6WYtPTWWZQ5fzUQWtGr91MONo5wsninseXmQ=="}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:48:47.261535 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-4a7b85b2-3c09-4336-9b18-5b9e7c95c84e tempest-KeyPairsV210TestJSON-907543374 tempest-KeyPairsV210TestJSON-907543374-project-admin] Getting quotas for project fb8d29d545814fb98278749c6f5cbc33. Resources: {'key_pairs'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 08:48:47.282679 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-4a7b85b2-3c09-4336-9b18-5b9e7c95c84e tempest-KeyPairsV210TestJSON-907543374 tempest-KeyPairsV210TestJSON-907543374-project-admin] Getting quotas for user 09790dcedb9c4918aa62fd34226976c3 and project fb8d29d545814fb98278749c6f5cbc33. Resources: {'key_pairs'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 08:48:47.320333 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-4a7b85b2-3c09-4336-9b18-5b9e7c95c84e tempest-KeyPairsV210TestJSON-907543374 tempest-KeyPairsV210TestJSON-907543374-project-admin] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.10 time: 0.079713 Sep 14 08:48:47.327697 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 131/242] 10.222.0.60 () {62 vars in 1200 bytes} [Wed Sep 14 08:48:47 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 87 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 14 08:48:47.332908 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-26871ab3-8fdc-4032-91a9-1f11b83e2b86 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:47.333521 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-26871ab3-8fdc-4032-91a9-1f11b83e2b86 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] [instance: 7045fd2e-8224-46b8-b477-57a46e18e93f] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:48:47.340028 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-a5ed4883-df2b-4b65-9eff-d3f4314dd175 tempest-QuotaClassesAdminTestJSON-457334390 tempest-QuotaClassesAdminTestJSON-457334390-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.215249 Sep 14 08:48:47.342070 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 112/243] 10.222.0.60 () {60 vars in 1206 bytes} [Wed Sep 14 08:48:47 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:48:47.342567 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-26871ab3-8fdc-4032-91a9-1f11b83e2b86 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:47.343491 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-26871ab3-8fdc-4032-91a9-1f11b83e2b86 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:47.344076 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-26871ab3-8fdc-4032-91a9-1f11b83e2b86 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:47.344924 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-26871ab3-8fdc-4032-91a9-1f11b83e2b86 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:47.345520 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-26871ab3-8fdc-4032-91a9-1f11b83e2b86 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:47.346081 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-26871ab3-8fdc-4032-91a9-1f11b83e2b86 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:47.372462 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ddb9bd83-9f09-4d95-a33a-4ae2af47392e tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:47.377599 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-ddb9bd83-9f09-4d95-a33a-4ae2af47392e tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] [instance: ef72dfda-b1e4-49c6-8830-33d25f6a4ec0] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:48:47.389589 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-26871ab3-8fdc-4032-91a9-1f11b83e2b86 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:47.390405 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-26871ab3-8fdc-4032-91a9-1f11b83e2b86 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:47.391009 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-26871ab3-8fdc-4032-91a9-1f11b83e2b86 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:47.391689 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.objects.instance [None req-26871ab3-8fdc-4032-91a9-1f11b83e2b86 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lazy-loading 'fault' on Instance uuid 7045fd2e-8224-46b8-b477-57a46e18e93f {{(pid=128759) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 08:48:47.394927 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ddb9bd83-9f09-4d95-a33a-4ae2af47392e tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:47.398494 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ddb9bd83-9f09-4d95-a33a-4ae2af47392e tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:47.401338 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ddb9bd83-9f09-4d95-a33a-4ae2af47392e tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:47.406780 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ddb9bd83-9f09-4d95-a33a-4ae2af47392e tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:47.408538 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ddb9bd83-9f09-4d95-a33a-4ae2af47392e tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:47.409620 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ddb9bd83-9f09-4d95-a33a-4ae2af47392e tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:47.452829 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-26871ab3-8fdc-4032-91a9-1f11b83e2b86 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e462483415e4c2b8a917b2a032e5ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac4d0cae0bd46fda94d7bfb900a0b9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:48:47.470672 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-26871ab3-8fdc-4032-91a9-1f11b83e2b86 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] 10.222.0.60 "GET /compute/v2.1/servers/7045fd2e-8224-46b8-b477-57a46e18e93f" status: 200 len: 1332 microversion: 2.1 time: 0.141585 Sep 14 08:48:47.471909 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 132/244] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:48:47 2022] GET /compute/v2.1/servers/7045fd2e-8224-46b8-b477-57a46e18e93f => generated 1332 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:48:47.488188 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-0bd1a216-cdcd-4862-a956-9ada7a6fd615 tempest-KeyPairsV210TestJSON-907543374 tempest-KeyPairsV210TestJSON-907543374-project-admin] Calling method '.version_select at 0x7f7d44f54ca0>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:47.498557 n-d-836830-18 devstack@n-api.service[128759]: WARNING oslo_db.sqlalchemy.utils [None req-0bd1a216-cdcd-4862-a956-9ada7a6fd615 tempest-KeyPairsV210TestJSON-907543374 tempest-KeyPairsV210TestJSON-907543374-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Sep 14 08:48:47.524428 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-0bd1a216-cdcd-4862-a956-9ada7a6fd615 tempest-KeyPairsV210TestJSON-907543374 tempest-KeyPairsV210TestJSON-907543374-project-admin] 10.222.0.60 "GET /compute/v2.1/os-keypairs?user_id=8187ddb3fe034a6b865ca160a18dde7b" status: 200 len: 724 microversion: 2.10 time: 0.046526 Sep 14 08:48:47.533935 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 133/245] 10.222.0.60 () {60 vars in 1259 bytes} [Wed Sep 14 08:48:47 2022] GET /compute/v2.1/os-keypairs?user_id=8187ddb3fe034a6b865ca160a18dde7b => generated 724 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 08:48:47.550623 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b2175ac7-eeaf-4eec-9411-25463bf08a06 tempest-KeyPairsV210TestJSON-907543374 tempest-KeyPairsV210TestJSON-907543374-project-admin] Calling method '.version_select at 0x7f7d44e43dc0>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:47.610962 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:INSERT=2 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:48:47.631968 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b2175ac7-eeaf-4eec-9411-25463bf08a06 tempest-KeyPairsV210TestJSON-907543374 tempest-KeyPairsV210TestJSON-907543374-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-169253464" status: 204 len: 0 microversion: 2.10 time: 0.092372 Sep 14 08:48:47.638462 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 134/246] 10.222.0.60 () {60 vars in 1322 bytes} [Wed Sep 14 08:48:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-169253464 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 14 08:48:47.643512 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-26064269-72a3-4f3f-a343-7515512a5bf9 tempest-KeyPairsV210TestJSON-907543374 tempest-KeyPairsV210TestJSON-907543374-project-admin] Calling method '.version_select at 0x7f7d44dc7670>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:47.688958 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-26064269-72a3-4f3f-a343-7515512a5bf9 tempest-KeyPairsV210TestJSON-907543374 tempest-KeyPairsV210TestJSON-907543374-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-24303619?user_id=8187ddb3fe034a6b865ca160a18dde7b" status: 204 len: 0 microversion: 2.10 time: 0.048129 Sep 14 08:48:47.690669 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 135/247] 10.222.0.60 () {60 vars in 1337 bytes} [Wed Sep 14 08:48:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-24303619?user_id=8187ddb3fe034a6b865ca160a18dde7b => generated 0 bytes in 51 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 14 08:48:47.699802 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-dd9881de-7a4f-49a6-9d9d-7a93934fb00f tempest-KeyPairsV210TestJSON-907543374 tempest-KeyPairsV210TestJSON-907543374-project-admin] Calling method '.version_select at 0x7f7d46363550>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:47.737264 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-dd9881de-7a4f-49a6-9d9d-7a93934fb00f tempest-KeyPairsV210TestJSON-907543374 tempest-KeyPairsV210TestJSON-907543374-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1603069945?user_id=8187ddb3fe034a6b865ca160a18dde7b" status: 204 len: 0 microversion: 2.10 time: 0.041142 Sep 14 08:48:47.741833 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 136/248] 10.222.0.60 () {60 vars in 1343 bytes} [Wed Sep 14 08:48:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1603069945?user_id=8187ddb3fe034a6b865ca160a18dde7b => generated 0 bytes in 43 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 14 08:48:47.975623 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-ddb9bd83-9f09-4d95-a33a-4ae2af47392e tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326618ebc864ba58c6df2c471c0f978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d1553889c474f75bd545166eff212b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:48:47.983881 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-ddb9bd83-9f09-4d95-a33a-4ae2af47392e tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] 10.222.0.60 "GET /compute/v2.1/servers/ef72dfda-b1e4-49c6-8830-33d25f6a4ec0" status: 200 len: 1494 microversion: 2.1 time: 0.640358 Sep 14 08:48:47.995366 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 113/249] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:48:47 2022] GET /compute/v2.1/servers/ef72dfda-b1e4-49c6-8830-33d25f6a4ec0 => generated 1494 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:48:48.267731 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-11de54b6-1e33-4a5a-b17b-88cc2f3f45cb tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:48.268537 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-11de54b6-1e33-4a5a-b17b-88cc2f3f45cb tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: 0a331816-6b06-40c9-a557-eada274501b5] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:48:48.274608 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-11de54b6-1e33-4a5a-b17b-88cc2f3f45cb tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:48.275383 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-11de54b6-1e33-4a5a-b17b-88cc2f3f45cb tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:48.276696 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-11de54b6-1e33-4a5a-b17b-88cc2f3f45cb tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:48.278171 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-11de54b6-1e33-4a5a-b17b-88cc2f3f45cb tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:48.279752 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-11de54b6-1e33-4a5a-b17b-88cc2f3f45cb tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:48.280376 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-11de54b6-1e33-4a5a-b17b-88cc2f3f45cb tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:48.501984 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-9c30a494-e26c-4ce2-b6e2-a52e790c6137 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:48.502678 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-11de54b6-1e33-4a5a-b17b-88cc2f3f45cb tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:48:48.502848 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-9c30a494-e26c-4ce2-b6e2-a52e790c6137 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] [instance: 7045fd2e-8224-46b8-b477-57a46e18e93f] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:48:48.515052 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-11de54b6-1e33-4a5a-b17b-88cc2f3f45cb tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/0a331816-6b06-40c9-a557-eada274501b5" status: 200 len: 1311 microversion: 2.1 time: 0.250634 Sep 14 08:48:48.519444 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9c30a494-e26c-4ce2-b6e2-a52e790c6137 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:48.523359 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9c30a494-e26c-4ce2-b6e2-a52e790c6137 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:48.523988 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9c30a494-e26c-4ce2-b6e2-a52e790c6137 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:48.524717 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9c30a494-e26c-4ce2-b6e2-a52e790c6137 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:48.525175 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9c30a494-e26c-4ce2-b6e2-a52e790c6137 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:48.525603 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9c30a494-e26c-4ce2-b6e2-a52e790c6137 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:48.536014 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 137/250] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:48:48 2022] GET /compute/v2.1/servers/0a331816-6b06-40c9-a557-eada274501b5 => generated 1311 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:48:48.540673 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-9c30a494-e26c-4ce2-b6e2-a52e790c6137 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] HTTP exception thrown: Instance 7045fd2e-8224-46b8-b477-57a46e18e93f could not be found. Sep 14 08:48:48.543391 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-9c30a494-e26c-4ce2-b6e2-a52e790c6137 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Request method failure captured: Sep 14 08:48:48.543391 n-d-836830-18 devstack@n-api.service[128758]: request: GET /compute/v2.1/servers/7045fd2e-8224-46b8-b477-57a46e18e93f HTTP/1.1 Sep 14 08:48:48.543391 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 08:48:48.543391 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 08:48:48.543391 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 08:48:48.543391 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 08:48:48.543391 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 08:48:48.543391 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 08:48:48.543391 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 08:48:48.543391 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 08:48:48.543391 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZVNIEX8iYPlKUR_ywYdOfGITcLOqV2CGwAGW2VTuabVjCVwYYuOQLO4_BFaCJ5QRm2P0mlZz36dCRgKBnA28_Q0ZDxtYrrFSbogfjTyIXTTn7T_ZIjvGW-bW59vERHOBj1lwLdINn7o1KjOS6bnOG_sYySVRgUBsKE4CswMVFSXyyc Sep 14 08:48:48.543391 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 08:48:48.543391 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 08:48:48.543391 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 08:48:48.543391 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 08:48:48.543391 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 08:48:48.543391 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 08:48:48.543391 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: eac4d0cae0bd46fda94d7bfb900a0b9a Sep 14 08:48:48.543391 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1089983197 Sep 14 08:48:48.543391 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 08:48:48.543391 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 08:48:48.545012 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/eac4d0cae0bd46fda94d7bfb900a0b9a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_eac4d0cae0bd46fda94d7bfb900a0b9a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/eac4d0cae0bd46fda94d7bfb900a0b9a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/eac4d0cae0bd46fda94d7bfb900a0b9a"}]}] Sep 14 08:48:48.545012 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-DeleteServersAdminTestJSON-1089983197 Sep 14 08:48:48.545012 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: eac4d0cae0bd46fda94d7bfb900a0b9a Sep 14 08:48:48.545012 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1089983197 Sep 14 08:48:48.545012 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-DeleteServersAdminTestJSON-1089983197-project Sep 14 08:48:48.545012 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 08:48:48.545012 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 08:48:48.545012 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 6e462483415e4c2b8a917b2a032e5ac9 Sep 14 08:48:48.545012 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-DeleteServersAdminTestJSON-1089983197-project Sep 14 08:48:48.545012 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 08:48:48.545012 n-d-836830-18 devstack@n-api.service[128758]: exception: Instance 7045fd2e-8224-46b8-b477-57a46e18e93f could not be found. Sep 14 08:48:48.545012 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': '7045fd2e-8224-46b8-b477-57a46e18e93f'} Sep 14 08:48:48.546290 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:48:48.546290 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:48.546290 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 08:48:48.546290 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 08:48:48.546290 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 08:48:48.546290 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 08:48:48.546290 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 08:48:48.546290 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 08:48:48.546290 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 08:48:48.546290 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 08:48:48.546290 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7045fd2e-8224-46b8-b477-57a46e18e93f could not be found. Sep 14 08:48:48.546290 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:48.546290 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:48:48.546290 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:48.546290 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:48.546290 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:48:48.546290 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:48:48.546290 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:48:48.546290 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:48:48.546290 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:48:48.548315 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:48:48.548315 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 08:48:48.548315 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 08:48:48.548315 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 08:48:48.548315 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 08:48:48.548315 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 08:48:48.548315 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 08:48:48.548315 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7045fd2e-8224-46b8-b477-57a46e18e93f could not be found. Sep 14 08:48:48.548315 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:48.548315 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:48:48.548315 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:48.548315 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:48.548315 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:48:48.548315 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:48:48.548315 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:48:48.548315 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:48:48.548315 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7045fd2e-8224-46b8-b477-57a46e18e93f could not be found. Sep 14 08:48:48.548315 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:48.549584 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-9c30a494-e26c-4ce2-b6e2-a52e790c6137 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Returning 404 to user: Instance 7045fd2e-8224-46b8-b477-57a46e18e93f could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:48:48.549584 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-9c30a494-e26c-4ce2-b6e2-a52e790c6137 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] 10.222.0.60 "GET /compute/v2.1/servers/7045fd2e-8224-46b8-b477-57a46e18e93f" status: 404 len: 111 microversion: 2.1 time: 0.050183 Sep 14 08:48:48.549584 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 114/251] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:48:48 2022] GET /compute/v2.1/servers/7045fd2e-8224-46b8-b477-57a46e18e93f => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 14 08:48:48.673940 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-99c6bb7d-bde2-446c-9f54-ab2b3dea2999 req-2dfe49b3-991a-46be-a5aa-b1d5f09e94f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef72dfda-b1e4-49c6-8830-33d25f6a4ec0", "name": "network-vif-deleted", "tag": "79944610-1b41-47dc-b7f4-3b8812c658aa"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:48:48.689117 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-99c6bb7d-bde2-446c-9f54-ab2b3dea2999 req-2dfe49b3-991a-46be-a5aa-b1d5f09e94f2 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:48.689688 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-99c6bb7d-bde2-446c-9f54-ab2b3dea2999 req-2dfe49b3-991a-46be-a5aa-b1d5f09e94f2 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:48.690053 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-fbd65f96-b6f2-4f20-ab98-b0568056a476 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1867837358", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:48:48.690472 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-99c6bb7d-bde2-446c-9f54-ab2b3dea2999 req-2dfe49b3-991a-46be-a5aa-b1d5f09e94f2 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:48.704019 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-99c6bb7d-bde2-446c-9f54-ab2b3dea2999 req-2dfe49b3-991a-46be-a5aa-b1d5f09e94f2 service nova] Creating event network-vif-deleted:79944610-1b41-47dc-b7f4-3b8812c658aa for instance ef72dfda-b1e4-49c6-8830-33d25f6a4ec0 on n-h2-836830-18 Sep 14 08:48:48.711612 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-99c6bb7d-bde2-446c-9f54-ab2b3dea2999 req-2dfe49b3-991a-46be-a5aa-b1d5f09e94f2 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041257 Sep 14 08:48:48.713027 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 138/252] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:48:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:48:48.802819 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.network.neutron [None req-fbd65f96-b6f2-4f20-ab98-b0568056a476 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] validate_networks() for None {{(pid=128758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 08:48:49.014879 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-05c1b73e-2c88-4d96-a459-e6ac3f5a0e18 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:49.016909 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-05c1b73e-2c88-4d96-a459-e6ac3f5a0e18 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] [instance: ef72dfda-b1e4-49c6-8830-33d25f6a4ec0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:48:49.027520 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-05c1b73e-2c88-4d96-a459-e6ac3f5a0e18 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:49.031468 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-05c1b73e-2c88-4d96-a459-e6ac3f5a0e18 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:49.033384 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-05c1b73e-2c88-4d96-a459-e6ac3f5a0e18 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:49.035490 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-05c1b73e-2c88-4d96-a459-e6ac3f5a0e18 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:49.037499 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-05c1b73e-2c88-4d96-a459-e6ac3f5a0e18 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:49.039244 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-05c1b73e-2c88-4d96-a459-e6ac3f5a0e18 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:49.160418 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-fbd65f96-b6f2-4f20-ab98-b0568056a476 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Flavor limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 08:48:49.160982 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-fbd65f96-b6f2-4f20-ab98-b0568056a476 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Image limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 08:48:49.161612 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-fbd65f96-b6f2-4f20-ab98-b0568056a476 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Flavor pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 08:48:49.162108 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-fbd65f96-b6f2-4f20-ab98-b0568056a476 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Image pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 08:48:49.163184 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-fbd65f96-b6f2-4f20-ab98-b0568056a476 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 08:48:49.166243 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-05c1b73e-2c88-4d96-a459-e6ac3f5a0e18 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:49.167278 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-05c1b73e-2c88-4d96-a459-e6ac3f5a0e18 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:49.167649 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-05c1b73e-2c88-4d96-a459-e6ac3f5a0e18 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:49.168122 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.objects.instance [None req-05c1b73e-2c88-4d96-a459-e6ac3f5a0e18 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Lazy-loading 'fault' on Instance uuid ef72dfda-b1e4-49c6-8830-33d25f6a4ec0 {{(pid=128759) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 08:48:49.186620 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fbd65f96-b6f2-4f20-ab98-b0568056a476 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:49.188114 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fbd65f96-b6f2-4f20-ab98-b0568056a476 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:49.189604 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fbd65f96-b6f2-4f20-ab98-b0568056a476 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:49.193417 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fbd65f96-b6f2-4f20-ab98-b0568056a476 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:49.194184 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fbd65f96-b6f2-4f20-ab98-b0568056a476 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:49.197482 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fbd65f96-b6f2-4f20-ab98-b0568056a476 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:49.255858 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-fbd65f96-b6f2-4f20-ab98-b0568056a476 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Getting quotas for project eac4d0cae0bd46fda94d7bfb900a0b9a. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 08:48:49.267322 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-05c1b73e-2c88-4d96-a459-e6ac3f5a0e18 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326618ebc864ba58c6df2c471c0f978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d1553889c474f75bd545166eff212b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:48:49.272789 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-fbd65f96-b6f2-4f20-ab98-b0568056a476 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Getting quotas for user 6e462483415e4c2b8a917b2a032e5ac9 and project eac4d0cae0bd46fda94d7bfb900a0b9a. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 08:48:49.283605 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-05c1b73e-2c88-4d96-a459-e6ac3f5a0e18 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] 10.222.0.60 "GET /compute/v2.1/servers/ef72dfda-b1e4-49c6-8830-33d25f6a4ec0" status: 200 len: 1328 microversion: 2.1 time: 0.280143 Sep 14 08:48:49.288225 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 139/253] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:48:49 2022] GET /compute/v2.1/servers/ef72dfda-b1e4-49c6-8830-33d25f6a4ec0 => generated 1328 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:48:49.310921 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-fbd65f96-b6f2-4f20-ab98-b0568056a476 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Going to run 1 instances... {{(pid=128758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 08:48:49.315729 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-fbd65f96-b6f2-4f20-ab98-b0568056a476 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] [instance: 17179827-7f78-4a3b-8eaa-766c5fa2b698] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 08:48:49.356799 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=22,nova_api:INSERT=8 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:48:49.409681 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-fbd65f96-b6f2-4f20-ab98-b0568056a476 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.725289 Sep 14 08:48:49.410864 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 115/254] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 08:48:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 727 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 14 08:48:49.422259 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-1589a43c-c0a4-4ed4-85b8-d98fd237bdd7 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:49.425597 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-1589a43c-c0a4-4ed4-85b8-d98fd237bdd7 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] [instance: 17179827-7f78-4a3b-8eaa-766c5fa2b698] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:48:49.539987 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-e66bfa5a-5fc2-4c98-ab4a-17c46983806b tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:49.540611 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-e66bfa5a-5fc2-4c98-ab4a-17c46983806b tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: 0a331816-6b06-40c9-a557-eada274501b5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:48:49.555852 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-1589a43c-c0a4-4ed4-85b8-d98fd237bdd7 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e462483415e4c2b8a917b2a032e5ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac4d0cae0bd46fda94d7bfb900a0b9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:48:49.570672 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-1589a43c-c0a4-4ed4-85b8-d98fd237bdd7 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] 10.222.0.60 "GET /compute/v2.1/servers/17179827-7f78-4a3b-8eaa-766c5fa2b698" status: 200 len: 1220 microversion: 2.1 time: 0.152981 Sep 14 08:48:49.571921 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 140/255] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:48:49 2022] GET /compute/v2.1/servers/17179827-7f78-4a3b-8eaa-766c5fa2b698 => generated 1220 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:48:49.578590 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e66bfa5a-5fc2-4c98-ab4a-17c46983806b tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:49.581443 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e66bfa5a-5fc2-4c98-ab4a-17c46983806b tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:49.581910 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e66bfa5a-5fc2-4c98-ab4a-17c46983806b tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:49.582669 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e66bfa5a-5fc2-4c98-ab4a-17c46983806b tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:49.583165 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e66bfa5a-5fc2-4c98-ab4a-17c46983806b tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:49.589397 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e66bfa5a-5fc2-4c98-ab4a-17c46983806b tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:49.862868 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-e66bfa5a-5fc2-4c98-ab4a-17c46983806b tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:48:49.871139 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-e66bfa5a-5fc2-4c98-ab4a-17c46983806b tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/0a331816-6b06-40c9-a557-eada274501b5" status: 200 len: 1311 microversion: 2.1 time: 0.337228 Sep 14 08:48:49.883089 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 116/256] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:48:49 2022] GET /compute/v2.1/servers/0a331816-6b06-40c9-a557-eada274501b5 => generated 1311 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:48:50.307506 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-e8ef0e86-2c41-4903-806c-b8f2aaafa700 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:50.308323 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-e8ef0e86-2c41-4903-806c-b8f2aaafa700 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] [instance: ef72dfda-b1e4-49c6-8830-33d25f6a4ec0] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:48:50.319988 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e8ef0e86-2c41-4903-806c-b8f2aaafa700 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:50.320729 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e8ef0e86-2c41-4903-806c-b8f2aaafa700 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:50.321349 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e8ef0e86-2c41-4903-806c-b8f2aaafa700 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:50.322897 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e8ef0e86-2c41-4903-806c-b8f2aaafa700 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:50.323615 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e8ef0e86-2c41-4903-806c-b8f2aaafa700 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:50.324230 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e8ef0e86-2c41-4903-806c-b8f2aaafa700 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:50.361976 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-e8ef0e86-2c41-4903-806c-b8f2aaafa700 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] HTTP exception thrown: Instance ef72dfda-b1e4-49c6-8830-33d25f6a4ec0 could not be found. Sep 14 08:48:50.367251 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-e8ef0e86-2c41-4903-806c-b8f2aaafa700 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Request method failure captured: Sep 14 08:48:50.367251 n-d-836830-18 devstack@n-api.service[128758]: request: GET /compute/v2.1/servers/ef72dfda-b1e4-49c6-8830-33d25f6a4ec0 HTTP/1.1 Sep 14 08:48:50.367251 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 08:48:50.367251 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 08:48:50.367251 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 08:48:50.367251 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 08:48:50.367251 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 08:48:50.367251 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 08:48:50.367251 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 08:48:50.367251 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 08:48:50.367251 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZVJGVVqXhhmlm6eFocXAtGwTnagCn4FWs17hHc4FkKGNSHKzdU22iNQWweZDh94H01Y2nEEk-SlyKp69X7-9KDN-cHfuYAyVn14GEXC93orxVBNFj4SHBTO6EiWo8McWhQMSnYQkzQS4B2oA2uzcqVr9ndfr0ojMs5ccGd2Qcc-pSM Sep 14 08:48:50.367251 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 08:48:50.367251 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 08:48:50.367251 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 08:48:50.367251 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 08:48:50.367251 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 08:48:50.367251 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 08:48:50.367251 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 2d1553889c474f75bd545166eff212b1 Sep 14 08:48:50.367251 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-AggregatesAdminTestJSON-279239198 Sep 14 08:48:50.367251 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 08:48:50.367251 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 08:48:50.368730 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/2d1553889c474f75bd545166eff212b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_2d1553889c474f75bd545166eff212b1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2d1553889c474f75bd545166eff212b1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2d1553889c474f75bd545166eff212b1"}]}] Sep 14 08:48:50.368730 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-AggregatesAdminTestJSON-279239198 Sep 14 08:48:50.368730 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 2d1553889c474f75bd545166eff212b1 Sep 14 08:48:50.368730 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-279239198 Sep 14 08:48:50.368730 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-AggregatesAdminTestJSON-279239198-project Sep 14 08:48:50.368730 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 08:48:50.368730 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 08:48:50.368730 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 3326618ebc864ba58c6df2c471c0f978 Sep 14 08:48:50.368730 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-AggregatesAdminTestJSON-279239198-project Sep 14 08:48:50.368730 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 08:48:50.368730 n-d-836830-18 devstack@n-api.service[128758]: exception: Instance ef72dfda-b1e4-49c6-8830-33d25f6a4ec0 could not be found. Sep 14 08:48:50.368730 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': 'ef72dfda-b1e4-49c6-8830-33d25f6a4ec0'} Sep 14 08:48:50.369539 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:48:50.369539 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:50.369539 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 08:48:50.369539 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 08:48:50.369539 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 08:48:50.369539 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 08:48:50.369539 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 08:48:50.369539 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 08:48:50.369539 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 08:48:50.369539 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 08:48:50.369539 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef72dfda-b1e4-49c6-8830-33d25f6a4ec0 could not be found. Sep 14 08:48:50.369539 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:50.369539 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:48:50.369539 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:50.369539 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:50.369539 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:48:50.369539 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:48:50.369539 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:48:50.369539 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:48:50.369539 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:48:50.370899 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:48:50.370899 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 08:48:50.370899 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 08:48:50.370899 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 08:48:50.370899 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 08:48:50.370899 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 08:48:50.370899 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 08:48:50.370899 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef72dfda-b1e4-49c6-8830-33d25f6a4ec0 could not be found. Sep 14 08:48:50.370899 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:50.370899 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:48:50.370899 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:50.370899 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:50.370899 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:48:50.370899 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:48:50.370899 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:48:50.370899 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:48:50.370899 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef72dfda-b1e4-49c6-8830-33d25f6a4ec0 could not be found. Sep 14 08:48:50.370899 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:50.372804 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-e8ef0e86-2c41-4903-806c-b8f2aaafa700 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Returning 404 to user: Instance ef72dfda-b1e4-49c6-8830-33d25f6a4ec0 could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:48:50.372804 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-e8ef0e86-2c41-4903-806c-b8f2aaafa700 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] 10.222.0.60 "GET /compute/v2.1/servers/ef72dfda-b1e4-49c6-8830-33d25f6a4ec0" status: 404 len: 111 microversion: 2.1 time: 0.067868 Sep 14 08:48:50.375216 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 117/257] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:48:50 2022] GET /compute/v2.1/servers/ef72dfda-b1e4-49c6-8830-33d25f6a4ec0 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 08:48:50.381120 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-6ed46180-3aee-49ce-bd05-b631fbeddabd tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-836830-18"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:48:50.395303 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6ed46180-3aee-49ce-bd05-b631fbeddabd tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:50.395916 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6ed46180-3aee-49ce-bd05-b631fbeddabd tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:50.396406 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6ed46180-3aee-49ce-bd05-b631fbeddabd tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:50.566425 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-6ed46180-3aee-49ce-bd05-b631fbeddabd tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 299 microversion: 2.1 time: 0.189925 Sep 14 08:48:50.567751 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 118/258] 10.222.0.60 () {60 vars in 1191 bytes} [Wed Sep 14 08:48:50 2022] POST /compute/v2.1/os-aggregates/3/action => generated 299 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:48:50.579789 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-79dab5f3-c878-4d43-9bf1-65446bce8a8e tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:50.608868 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-79dab5f3-c878-4d43-9bf1-65446bce8a8e tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.032948 Sep 14 08:48:50.610180 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 119/259] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Sep 14 08:48:50 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 14 08:48:50.615098 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-296c0296-7811-4a79-bde2-9c4acadac487 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:50.615910 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-296c0296-7811-4a79-bde2-9c4acadac487 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] [instance: 17179827-7f78-4a3b-8eaa-766c5fa2b698] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:48:50.624978 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-296c0296-7811-4a79-bde2-9c4acadac487 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:50.625801 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-296c0296-7811-4a79-bde2-9c4acadac487 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:50.626763 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-296c0296-7811-4a79-bde2-9c4acadac487 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:50.627728 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-296c0296-7811-4a79-bde2-9c4acadac487 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:50.628598 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-296c0296-7811-4a79-bde2-9c4acadac487 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:50.629314 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-296c0296-7811-4a79-bde2-9c4acadac487 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:50.643259 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-5b2ba942-2f69-405d-993e-324ac820862d tempest-HypervisorAdminNegativeTestJSON-46417775 tempest-HypervisorAdminNegativeTestJSON-46417775-project] Calling method '.version_select at 0x7f7d44ddaee0>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:50.645070 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-5b2ba942-2f69-405d-993e-324ac820862d tempest-HypervisorAdminNegativeTestJSON-46417775 tempest-HypervisorAdminNegativeTestJSON-46417775-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': '32afdaddd85c4f3b916c92ad5f264278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66c24463b7a4d4893ed888e7af5d952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:48:50.647282 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-5b2ba942-2f69-405d-993e-324ac820862d tempest-HypervisorAdminNegativeTestJSON-46417775 tempest-HypervisorAdminNegativeTestJSON-46417775-project] Request method failure captured: Sep 14 08:48:50.647282 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Sep 14 08:48:50.647282 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 08:48:50.647282 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 08:48:50.647282 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 08:48:50.647282 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 08:48:50.647282 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 08:48:50.647282 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 08:48:50.647282 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 08:48:50.647282 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 08:48:50.647282 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZVvSHtKkpQ6IZrR0fehLTdyzxoF20gX_ZAhmTip5vy_ABINZ1VVb2yu6vLviniRqxSBi73foQC-GJ3MTjt4rnkWs2S25lA1QKErQ4zyy5of9ovnVf3gazHbOAesLqeH8A0Y33bjnZV8n_eEvQzv_J4BTAZjz608-IlX-jlMXnRzA6Q Sep 14 08:48:50.647282 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 08:48:50.647282 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 08:48:50.647282 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 08:48:50.647282 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 08:48:50.647282 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 08:48:50.647282 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 08:48:50.647282 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: d66c24463b7a4d4893ed888e7af5d952 Sep 14 08:48:50.647282 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-46417775 Sep 14 08:48:50.647282 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 08:48:50.647282 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 08:48:50.648629 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/d66c24463b7a4d4893ed888e7af5d952"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_d66c24463b7a4d4893ed888e7af5d952"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d66c24463b7a4d4893ed888e7af5d952"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d66c24463b7a4d4893ed888e7af5d952"}]}] Sep 14 08:48:50.648629 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-46417775 Sep 14 08:48:50.648629 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: d66c24463b7a4d4893ed888e7af5d952 Sep 14 08:48:50.648629 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-46417775 Sep 14 08:48:50.648629 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-HypervisorAdminNegativeTestJSON-46417775-project Sep 14 08:48:50.648629 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 08:48:50.648629 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 08:48:50.648629 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 32afdaddd85c4f3b916c92ad5f264278 Sep 14 08:48:50.648629 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-46417775-project Sep 14 08:48:50.648629 n-d-836830-18 devstack@n-api.service[128759]: method: Sep 14 08:48:50.648629 n-d-836830-18 devstack@n-api.service[128759]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Sep 14 08:48:50.648629 n-d-836830-18 devstack@n-api.service[128759]: action_args: {} Sep 14 08:48:50.648629 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:48:50.649381 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:50.649381 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:48:50.649381 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:48:50.649381 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:48:50.649381 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:48:50.649381 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 08:48:50.649381 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 08:48:50.649381 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:48:50.649381 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:48:50.649381 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Sep 14 08:48:50.649381 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self._detail(req) Sep 14 08:48:50.649381 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Sep 14 08:48:50.649381 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Sep 14 08:48:50.649381 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 14 08:48:50.649381 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 14 08:48:50.649381 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 14 08:48:50.649381 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 14 08:48:50.649381 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 14 08:48:50.649381 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 14 08:48:50.650414 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 14 08:48:50.650414 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise self.value Sep 14 08:48:50.650414 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 14 08:48:50.650414 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 14 08:48:50.650414 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 14 08:48:50.650414 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 14 08:48:50.650414 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 14 08:48:50.650414 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 14 08:48:50.650414 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Sep 14 08:48:50.650414 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:48:50.650414 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:48:50.650414 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:48:50.650414 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:50.650414 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:48:50.650414 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:48:50.650414 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 14 08:48:50.650414 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 14 08:48:50.650414 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Sep 14 08:48:50.650414 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:48:50.652925 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-5b2ba942-2f69-405d-993e-324ac820862d tempest-HypervisorAdminNegativeTestJSON-46417775 tempest-HypervisorAdminNegativeTestJSON-46417775-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:48:50.654120 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-5b2ba942-2f69-405d-993e-324ac820862d tempest-HypervisorAdminNegativeTestJSON-46417775 tempest-HypervisorAdminNegativeTestJSON-46417775-project] 10.222.0.60 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.468381 Sep 14 08:48:50.660126 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 141/260] 10.222.0.60 () {58 vars in 1167 bytes} [Wed Sep 14 08:48:50 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 475 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 14 08:48:50.666359 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c73c3ea1-f65c-493f-ab67-404a06511404 tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-749873879"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:48:50.671447 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.objects.aggregate [None req-c73c3ea1-f65c-493f-ab67-404a06511404 tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] Generated uuid fbb0b8f5-7376-4958-931d-d2f434a54bc8 for aggregate {{(pid=128759) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 14 08:48:50.695067 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-c73c3ea1-f65c-493f-ab67-404a06511404 tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.033062 Sep 14 08:48:50.696323 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 142/261] 10.222.0.60 () {60 vars in 1164 bytes} [Wed Sep 14 08:48:50 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:48:50.701344 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-1e0b4bd1-1142-40af-b7e1-fa100aaccda4 tempest-HypervisorAdminNegativeTestJSON-46417775 tempest-HypervisorAdminNegativeTestJSON-46417775-project] Calling method '.version_select at 0x7f7d44d81d30>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:50.703678 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-1e0b4bd1-1142-40af-b7e1-fa100aaccda4 tempest-HypervisorAdminNegativeTestJSON-46417775 tempest-HypervisorAdminNegativeTestJSON-46417775-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': '32afdaddd85c4f3b916c92ad5f264278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66c24463b7a4d4893ed888e7af5d952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:48:50.705747 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-1e0b4bd1-1142-40af-b7e1-fa100aaccda4 tempest-HypervisorAdminNegativeTestJSON-46417775 tempest-HypervisorAdminNegativeTestJSON-46417775-project] Request method failure captured: Sep 14 08:48:50.705747 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Sep 14 08:48:50.705747 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 08:48:50.705747 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 08:48:50.705747 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 08:48:50.705747 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 08:48:50.705747 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 08:48:50.705747 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 08:48:50.705747 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 08:48:50.705747 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 08:48:50.705747 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZVvSHtKkpQ6IZrR0fehLTdyzxoF20gX_ZAhmTip5vy_ABINZ1VVb2yu6vLviniRqxSBi73foQC-GJ3MTjt4rnkWs2S25lA1QKErQ4zyy5of9ovnVf3gazHbOAesLqeH8A0Y33bjnZV8n_eEvQzv_J4BTAZjz608-IlX-jlMXnRzA6Q Sep 14 08:48:50.705747 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 08:48:50.705747 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 08:48:50.705747 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 08:48:50.705747 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 08:48:50.705747 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 08:48:50.705747 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 08:48:50.705747 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: d66c24463b7a4d4893ed888e7af5d952 Sep 14 08:48:50.705747 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-46417775 Sep 14 08:48:50.705747 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 08:48:50.705747 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 08:48:50.706963 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/d66c24463b7a4d4893ed888e7af5d952"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_d66c24463b7a4d4893ed888e7af5d952"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d66c24463b7a4d4893ed888e7af5d952"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d66c24463b7a4d4893ed888e7af5d952"}]}] Sep 14 08:48:50.706963 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-46417775 Sep 14 08:48:50.706963 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: d66c24463b7a4d4893ed888e7af5d952 Sep 14 08:48:50.706963 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-46417775 Sep 14 08:48:50.706963 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-HypervisorAdminNegativeTestJSON-46417775-project Sep 14 08:48:50.706963 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 08:48:50.706963 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 08:48:50.706963 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 32afdaddd85c4f3b916c92ad5f264278 Sep 14 08:48:50.706963 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-46417775-project Sep 14 08:48:50.706963 n-d-836830-18 devstack@n-api.service[128759]: method: Sep 14 08:48:50.706963 n-d-836830-18 devstack@n-api.service[128759]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Sep 14 08:48:50.706963 n-d-836830-18 devstack@n-api.service[128759]: action_args: {} Sep 14 08:48:50.706963 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:48:50.707682 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:50.707682 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:48:50.707682 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:48:50.707682 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:48:50.707682 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:48:50.707682 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 08:48:50.707682 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 08:48:50.707682 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:48:50.707682 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:48:50.707682 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Sep 14 08:48:50.707682 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self._index(req) Sep 14 08:48:50.707682 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Sep 14 08:48:50.707682 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Sep 14 08:48:50.707682 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 14 08:48:50.707682 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 14 08:48:50.707682 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 14 08:48:50.707682 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 14 08:48:50.707682 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 14 08:48:50.707682 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 14 08:48:50.708717 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 14 08:48:50.708717 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise self.value Sep 14 08:48:50.708717 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 14 08:48:50.708717 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 14 08:48:50.708717 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 14 08:48:50.708717 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 14 08:48:50.708717 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 14 08:48:50.708717 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 14 08:48:50.708717 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Sep 14 08:48:50.708717 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:48:50.708717 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:48:50.708717 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:48:50.708717 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:50.708717 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:48:50.708717 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:48:50.708717 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 14 08:48:50.708717 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 14 08:48:50.708717 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Sep 14 08:48:50.708717 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:48:50.711146 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-1e0b4bd1-1142-40af-b7e1-fa100aaccda4 tempest-HypervisorAdminNegativeTestJSON-46417775 tempest-HypervisorAdminNegativeTestJSON-46417775-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:48:50.712184 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-1e0b4bd1-1142-40af-b7e1-fa100aaccda4 tempest-HypervisorAdminNegativeTestJSON-46417775 tempest-HypervisorAdminNegativeTestJSON-46417775-project] 10.222.0.60 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.014708 Sep 14 08:48:50.712933 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 143/262] 10.222.0.60 () {58 vars in 1146 bytes} [Wed Sep 14 08:48:50 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 14 08:48:50.722588 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3602dd41-4892-4309-b71a-343c12d5ce38 tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-836830-18"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:48:50.738176 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3602dd41-4892-4309-b71a-343c12d5ce38 tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:50.740070 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3602dd41-4892-4309-b71a-343c12d5ce38 tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:50.740520 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3602dd41-4892-4309-b71a-343c12d5ce38 tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:50.750608 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-296c0296-7811-4a79-bde2-9c4acadac487 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e462483415e4c2b8a917b2a032e5ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac4d0cae0bd46fda94d7bfb900a0b9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:48:50.760158 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-296c0296-7811-4a79-bde2-9c4acadac487 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] 10.222.0.60 "GET /compute/v2.1/servers/17179827-7f78-4a3b-8eaa-766c5fa2b698" status: 200 len: 1272 microversion: 2.1 time: 0.148587 Sep 14 08:48:50.761871 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 120/263] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:48:50 2022] GET /compute/v2.1/servers/17179827-7f78-4a3b-8eaa-766c5fa2b698 => generated 1272 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:48:50.769545 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-0b610f58-3d65-46d5-b478-156a0bcb50ec tempest-HypervisorAdminNegativeTestJSON-46417775 tempest-HypervisorAdminNegativeTestJSON-46417775-project] Calling method '.version_select at 0x7f7d44e7b310>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:50.784303 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-0b610f58-3d65-46d5-b478-156a0bcb50ec tempest-HypervisorAdminNegativeTestJSON-46417775 tempest-HypervisorAdminNegativeTestJSON-46417775-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': '32afdaddd85c4f3b916c92ad5f264278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66c24463b7a4d4893ed888e7af5d952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:48:50.789447 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-0b610f58-3d65-46d5-b478-156a0bcb50ec tempest-HypervisorAdminNegativeTestJSON-46417775 tempest-HypervisorAdminNegativeTestJSON-46417775-project] Request method failure captured: Sep 14 08:48:50.789447 n-d-836830-18 devstack@n-api.service[128758]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Sep 14 08:48:50.789447 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 08:48:50.789447 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 08:48:50.789447 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 08:48:50.789447 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 08:48:50.789447 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 08:48:50.789447 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 08:48:50.789447 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 08:48:50.789447 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 08:48:50.789447 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZVvSHtKkpQ6IZrR0fehLTdyzxoF20gX_ZAhmTip5vy_ABINZ1VVb2yu6vLviniRqxSBi73foQC-GJ3MTjt4rnkWs2S25lA1QKErQ4zyy5of9ovnVf3gazHbOAesLqeH8A0Y33bjnZV8n_eEvQzv_J4BTAZjz608-IlX-jlMXnRzA6Q Sep 14 08:48:50.789447 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 08:48:50.789447 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 08:48:50.789447 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 08:48:50.789447 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 08:48:50.789447 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 08:48:50.789447 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 08:48:50.789447 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: d66c24463b7a4d4893ed888e7af5d952 Sep 14 08:48:50.789447 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-46417775 Sep 14 08:48:50.789447 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 08:48:50.789447 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 08:48:50.790675 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/d66c24463b7a4d4893ed888e7af5d952"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_d66c24463b7a4d4893ed888e7af5d952"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d66c24463b7a4d4893ed888e7af5d952"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d66c24463b7a4d4893ed888e7af5d952"}]}] Sep 14 08:48:50.790675 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-46417775 Sep 14 08:48:50.790675 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: d66c24463b7a4d4893ed888e7af5d952 Sep 14 08:48:50.790675 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-46417775 Sep 14 08:48:50.790675 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-HypervisorAdminNegativeTestJSON-46417775-project Sep 14 08:48:50.790675 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 08:48:50.790675 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 08:48:50.790675 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 32afdaddd85c4f3b916c92ad5f264278 Sep 14 08:48:50.790675 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-46417775-project Sep 14 08:48:50.790675 n-d-836830-18 devstack@n-api.service[128758]: method: Sep 14 08:48:50.790675 n-d-836830-18 devstack@n-api.service[128758]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Sep 14 08:48:50.790675 n-d-836830-18 devstack@n-api.service[128758]: action_args: {} Sep 14 08:48:50.790675 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:48:50.791425 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:50.791425 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:48:50.791425 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:48:50.791425 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:48:50.791425 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:48:50.791425 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 08:48:50.791425 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 08:48:50.791425 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:48:50.791425 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:48:50.791425 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Sep 14 08:48:50.791425 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Sep 14 08:48:50.791425 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 14 08:48:50.791425 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 14 08:48:50.791425 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 14 08:48:50.791425 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 14 08:48:50.791425 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 14 08:48:50.791425 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 14 08:48:50.791425 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 14 08:48:50.791425 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise self.value Sep 14 08:48:50.792436 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 14 08:48:50.792436 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 14 08:48:50.792436 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 14 08:48:50.792436 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 14 08:48:50.792436 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 14 08:48:50.792436 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 14 08:48:50.792436 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Sep 14 08:48:50.792436 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:50.792436 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:48:50.792436 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:50.792436 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:50.792436 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:48:50.792436 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:48:50.792436 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 14 08:48:50.792436 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 14 08:48:50.792436 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Sep 14 08:48:50.792436 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:50.793353 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-0b610f58-3d65-46d5-b478-156a0bcb50ec tempest-HypervisorAdminNegativeTestJSON-46417775 tempest-HypervisorAdminNegativeTestJSON-46417775-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:48:50.793353 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-0b610f58-3d65-46d5-b478-156a0bcb50ec tempest-HypervisorAdminNegativeTestJSON-46417775 tempest-HypervisorAdminNegativeTestJSON-46417775-project] 10.222.0.60 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.027374 Sep 14 08:48:50.793353 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 121/264] 10.222.0.60 () {58 vars in 1179 bytes} [Wed Sep 14 08:48:50 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 29 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 14 08:48:50.978397 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-3602dd41-4892-4309-b71a-343c12d5ce38 tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 242 microversion: 2.1 time: 0.259791 Sep 14 08:48:50.979015 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 144/265] 10.222.0.60 () {60 vars in 1191 bytes} [Wed Sep 14 08:48:50 2022] POST /compute/v2.1/os-aggregates/8/action => generated 242 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:48:50.992732 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e3bb90fb-03b4-4d33-b9a4-ebacd5a142a9 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:50.994179 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e3bb90fb-03b4-4d33-b9a4-ebacd5a142a9 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: 0a331816-6b06-40c9-a557-eada274501b5] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:48:51.006886 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e3bb90fb-03b4-4d33-b9a4-ebacd5a142a9 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:51.009115 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e3bb90fb-03b4-4d33-b9a4-ebacd5a142a9 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:51.010537 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e3bb90fb-03b4-4d33-b9a4-ebacd5a142a9 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:51.011453 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e3bb90fb-03b4-4d33-b9a4-ebacd5a142a9 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:51.015075 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e3bb90fb-03b4-4d33-b9a4-ebacd5a142a9 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:51.015670 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e3bb90fb-03b4-4d33-b9a4-ebacd5a142a9 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:51.249011 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-27093b93-2e85-4842-8155-a451f2af616e tempest-HypervisorAdminNegativeTestJSON-389998335 tempest-HypervisorAdminNegativeTestJSON-389998335-project-admin] Calling method '.version_select at 0x7f7d44de0670>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:51.250782 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-27093b93-2e85-4842-8155-a451f2af616e tempest-HypervisorAdminNegativeTestJSON-389998335 tempest-HypervisorAdminNegativeTestJSON-389998335-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:51.251278 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-27093b93-2e85-4842-8155-a451f2af616e tempest-HypervisorAdminNegativeTestJSON-389998335 tempest-HypervisorAdminNegativeTestJSON-389998335-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:51.251732 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-27093b93-2e85-4842-8155-a451f2af616e tempest-HypervisorAdminNegativeTestJSON-389998335 tempest-HypervisorAdminNegativeTestJSON-389998335-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:51.279576 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-27093b93-2e85-4842-8155-a451f2af616e tempest-HypervisorAdminNegativeTestJSON-389998335 tempest-HypervisorAdminNegativeTestJSON-389998335-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:51.285583 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-27093b93-2e85-4842-8155-a451f2af616e tempest-HypervisorAdminNegativeTestJSON-389998335 tempest-HypervisorAdminNegativeTestJSON-389998335-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:51.287041 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-27093b93-2e85-4842-8155-a451f2af616e tempest-HypervisorAdminNegativeTestJSON-389998335 tempest-HypervisorAdminNegativeTestJSON-389998335-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:51.313783 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-27093b93-2e85-4842-8155-a451f2af616e tempest-HypervisorAdminNegativeTestJSON-389998335 tempest-HypervisorAdminNegativeTestJSON-389998335-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:51.319568 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-e3bb90fb-03b4-4d33-b9a4-ebacd5a142a9 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:48:51.327571 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-27093b93-2e85-4842-8155-a451f2af616e tempest-HypervisorAdminNegativeTestJSON-389998335 tempest-HypervisorAdminNegativeTestJSON-389998335-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:51.329271 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-27093b93-2e85-4842-8155-a451f2af616e tempest-HypervisorAdminNegativeTestJSON-389998335 tempest-HypervisorAdminNegativeTestJSON-389998335-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:51.332050 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e3bb90fb-03b4-4d33-b9a4-ebacd5a142a9 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/0a331816-6b06-40c9-a557-eada274501b5" status: 200 len: 1311 microversion: 2.1 time: 0.351564 Sep 14 08:48:51.332966 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 145/266] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:48:50 2022] GET /compute/v2.1/servers/0a331816-6b06-40c9-a557-eada274501b5 => generated 1311 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:48:51.339216 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b84cc4bf-a96c-4283-9a38-95fb12fc646c tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:51.340013 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-27093b93-2e85-4842-8155-a451f2af616e tempest-HypervisorAdminNegativeTestJSON-389998335 tempest-HypervisorAdminNegativeTestJSON-389998335-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.527883 Sep 14 08:48:51.347645 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 122/267] 10.222.0.60 () {58 vars in 1146 bytes} [Wed Sep 14 08:48:50 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:48:51.352466 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-b1dff3ca-6e36-4665-8f38-792e9047f89e req-3eb6fd1b-df0b-461b-8085-6ae6e8ad2abd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a331816-6b06-40c9-a557-eada274501b5", "name": "network-vif-plugged", "status": "completed", "tag": "667429a7-9153-49c5-a750-cc44e1cd077d"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:48:51.354392 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b84cc4bf-a96c-4283-9a38-95fb12fc646c tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] 10.222.0.60 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 242 microversion: 2.1 time: 0.019072 Sep 14 08:48:51.364394 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 146/268] 10.222.0.60 () {58 vars in 1149 bytes} [Wed Sep 14 08:48:51 2022] GET /compute/v2.1/os-aggregates/8 => generated 242 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:48:51.365157 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-b1dff3ca-6e36-4665-8f38-792e9047f89e req-3eb6fd1b-df0b-461b-8085-6ae6e8ad2abd service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:51.365754 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-b1dff3ca-6e36-4665-8f38-792e9047f89e req-3eb6fd1b-df0b-461b-8085-6ae6e8ad2abd service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:51.366318 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-b1dff3ca-6e36-4665-8f38-792e9047f89e req-3eb6fd1b-df0b-461b-8085-6ae6e8ad2abd service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:51.371385 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c7210ad1-4eb3-4e66-a444-5f90acfcab2c tempest-HypervisorAdminNegativeTestJSON-46417775 tempest-HypervisorAdminNegativeTestJSON-46417775-project] Calling method '.version_select at 0x7f7d44dc75e0>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:51.373781 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-c7210ad1-4eb3-4e66-a444-5f90acfcab2c tempest-HypervisorAdminNegativeTestJSON-46417775 tempest-HypervisorAdminNegativeTestJSON-46417775-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': '32afdaddd85c4f3b916c92ad5f264278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66c24463b7a4d4893ed888e7af5d952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:48:51.376026 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c7210ad1-4eb3-4e66-a444-5f90acfcab2c tempest-HypervisorAdminNegativeTestJSON-46417775 tempest-HypervisorAdminNegativeTestJSON-46417775-project] Request method failure captured: Sep 14 08:48:51.376026 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Sep 14 08:48:51.376026 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 08:48:51.376026 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 08:48:51.376026 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 08:48:51.376026 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 08:48:51.376026 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 08:48:51.376026 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 08:48:51.376026 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 08:48:51.376026 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 08:48:51.376026 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZVvSHtKkpQ6IZrR0fehLTdyzxoF20gX_ZAhmTip5vy_ABINZ1VVb2yu6vLviniRqxSBi73foQC-GJ3MTjt4rnkWs2S25lA1QKErQ4zyy5of9ovnVf3gazHbOAesLqeH8A0Y33bjnZV8n_eEvQzv_J4BTAZjz608-IlX-jlMXnRzA6Q Sep 14 08:48:51.376026 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 08:48:51.376026 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 08:48:51.376026 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 08:48:51.376026 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 08:48:51.376026 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 08:48:51.376026 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 08:48:51.376026 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: d66c24463b7a4d4893ed888e7af5d952 Sep 14 08:48:51.376026 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-46417775 Sep 14 08:48:51.376026 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 08:48:51.376026 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 08:48:51.377256 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/d66c24463b7a4d4893ed888e7af5d952"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_d66c24463b7a4d4893ed888e7af5d952"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d66c24463b7a4d4893ed888e7af5d952"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d66c24463b7a4d4893ed888e7af5d952"}]}] Sep 14 08:48:51.377256 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-46417775 Sep 14 08:48:51.377256 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: d66c24463b7a4d4893ed888e7af5d952 Sep 14 08:48:51.377256 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-46417775 Sep 14 08:48:51.377256 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-HypervisorAdminNegativeTestJSON-46417775-project Sep 14 08:48:51.377256 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 08:48:51.377256 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 08:48:51.377256 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 32afdaddd85c4f3b916c92ad5f264278 Sep 14 08:48:51.377256 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-46417775-project Sep 14 08:48:51.377256 n-d-836830-18 devstack@n-api.service[128759]: method: Sep 14 08:48:51.377256 n-d-836830-18 devstack@n-api.service[128759]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Sep 14 08:48:51.377256 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '1'} Sep 14 08:48:51.377256 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:48:51.378248 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:51.378248 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:48:51.378248 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:48:51.378248 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:48:51.378248 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:48:51.378248 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 08:48:51.378248 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 08:48:51.378248 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:48:51.378248 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:48:51.378248 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Sep 14 08:48:51.378248 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Sep 14 08:48:51.378248 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 14 08:48:51.378248 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 14 08:48:51.378248 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 14 08:48:51.378248 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 14 08:48:51.378248 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 14 08:48:51.378248 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 14 08:48:51.378248 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 14 08:48:51.378248 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise self.value Sep 14 08:48:51.380002 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 14 08:48:51.380002 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 14 08:48:51.380002 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 14 08:48:51.380002 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 14 08:48:51.380002 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 14 08:48:51.380002 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 14 08:48:51.380002 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Sep 14 08:48:51.380002 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:48:51.380002 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:48:51.380002 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:48:51.380002 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:51.380002 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:48:51.380002 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:48:51.380002 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 14 08:48:51.380002 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 14 08:48:51.380002 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Sep 14 08:48:51.380002 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:48:51.380999 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c7210ad1-4eb3-4e66-a444-5f90acfcab2c tempest-HypervisorAdminNegativeTestJSON-46417775 tempest-HypervisorAdminNegativeTestJSON-46417775-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:48:51.380999 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-c7210ad1-4eb3-4e66-a444-5f90acfcab2c tempest-HypervisorAdminNegativeTestJSON-46417775 tempest-HypervisorAdminNegativeTestJSON-46417775-project] 10.222.0.60 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.011513 Sep 14 08:48:51.384344 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 147/269] 10.222.0.60 () {58 vars in 1173 bytes} [Wed Sep 14 08:48:51 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 14 08:48:51.388729 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-b1dff3ca-6e36-4665-8f38-792e9047f89e req-3eb6fd1b-df0b-461b-8085-6ae6e8ad2abd service nova] Creating event network-vif-plugged:667429a7-9153-49c5-a750-cc44e1cd077d for instance 0a331816-6b06-40c9-a557-eada274501b5 on n-h1-836830-18 Sep 14 08:48:51.392527 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b5c1aeda-6627-483f-ada3-a6dff6814f28 tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-836830-18"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:48:51.400604 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-b1dff3ca-6e36-4665-8f38-792e9047f89e req-3eb6fd1b-df0b-461b-8085-6ae6e8ad2abd service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051453 Sep 14 08:48:51.405649 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 123/270] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:48:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:48:51.407985 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b5c1aeda-6627-483f-ada3-a6dff6814f28 tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:51.408474 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b5c1aeda-6627-483f-ada3-a6dff6814f28 tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:51.408904 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b5c1aeda-6627-483f-ada3-a6dff6814f28 tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:51.412612 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c06ccd86-7101-428e-aa59-8e96bde94292 tempest-HypervisorAdminNegativeTestJSON-389998335 tempest-HypervisorAdminNegativeTestJSON-389998335-project-admin] Calling method '.version_select at 0x7f7d452d40d0>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:51.414359 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-c06ccd86-7101-428e-aa59-8e96bde94292 tempest-HypervisorAdminNegativeTestJSON-389998335 tempest-HypervisorAdminNegativeTestJSON-389998335-project-admin] HTTP exception thrown: Hypervisor with ID 'e271ba28-d7c7-4567-a916-f91906609e7c' could not be found. Sep 14 08:48:51.421674 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c06ccd86-7101-428e-aa59-8e96bde94292 tempest-HypervisorAdminNegativeTestJSON-389998335 tempest-HypervisorAdminNegativeTestJSON-389998335-project-admin] Request method failure captured: Sep 14 08:48:51.421674 n-d-836830-18 devstack@n-api.service[128758]: request: GET /compute/v2.1/os-hypervisors/e271ba28-d7c7-4567-a916-f91906609e7c/uptime HTTP/1.1 Sep 14 08:48:51.421674 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 08:48:51.421674 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 08:48:51.421674 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 08:48:51.421674 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 08:48:51.421674 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 08:48:51.421674 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 08:48:51.421674 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 08:48:51.421674 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 08:48:51.421674 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZVyG0KaiW5ooFc3KkViKe49v8dPuCXsexLGaePChkpYaPIhH90-2yLz-JjZLKUUaUI1uLNuBfUFCaVeZ8YHghUS0NsMTdVhAzfjrOnsUoWBY4fSizUccukPknKtbd1dlvAnYJnfhRPGaFqAYvgkpR9zQnhUU7vp0fsZyG2xNy7J2oc Sep 14 08:48:51.421674 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 08:48:51.421674 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 08:48:51.421674 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 08:48:51.421674 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 08:48:51.421674 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 08:48:51.421674 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 08:48:51.421674 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: cb663c467ff14811a06e9ab671d11b61 Sep 14 08:48:51.421674 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-389998335 Sep 14 08:48:51.421674 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member,admin Sep 14 08:48:51.421674 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member,admin Sep 14 08:48:51.423067 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/cb663c467ff14811a06e9ab671d11b61"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_cb663c467ff14811a06e9ab671d11b61"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cb663c467ff14811a06e9ab671d11b61"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cb663c467ff14811a06e9ab671d11b61"}]}] Sep 14 08:48:51.423067 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-389998335 Sep 14 08:48:51.423067 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: cb663c467ff14811a06e9ab671d11b61 Sep 14 08:48:51.423067 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-389998335 Sep 14 08:48:51.423067 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-HypervisorAdminNegativeTestJSON-389998335-project-admin Sep 14 08:48:51.423067 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 08:48:51.423067 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 08:48:51.423067 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 6c519ce02cc042f98dcfa21caffcc1b2 Sep 14 08:48:51.423067 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-389998335-project-admin Sep 14 08:48:51.423067 n-d-836830-18 devstack@n-api.service[128758]: method: Sep 14 08:48:51.423067 n-d-836830-18 devstack@n-api.service[128758]: exception: Hypervisor with ID 'e271ba28-d7c7-4567-a916-f91906609e7c' could not be found. Sep 14 08:48:51.423067 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': 'e271ba28-d7c7-4567-a916-f91906609e7c'} Sep 14 08:48:51.423761 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:48:51.423761 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:51.423761 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Sep 14 08:48:51.423761 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi value = int(str(value)) Sep 14 08:48:51.423761 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'e271ba28-d7c7-4567-a916-f91906609e7c' Sep 14 08:48:51.423761 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:51.423761 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:48:51.423761 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:51.423761 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:51.423761 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Sep 14 08:48:51.423761 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Sep 14 08:48:51.423761 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Sep 14 08:48:51.423761 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Sep 14 08:48:51.423761 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Sep 14 08:48:51.423761 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:51.423761 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:48:51.423761 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:51.423761 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:51.423761 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Sep 14 08:48:51.423761 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Sep 14 08:48:51.423761 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Sep 14 08:48:51.423761 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Sep 14 08:48:51.425719 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Sep 14 08:48:51.425719 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:51.425719 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:48:51.425719 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:51.425719 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:51.425719 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:48:51.425719 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:48:51.425719 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:48:51.425719 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:48:51.425719 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 08:48:51.425719 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 08:48:51.425719 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:48:51.425719 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:48:51.425719 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Sep 14 08:48:51.425719 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Sep 14 08:48:51.425719 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Sep 14 08:48:51.425719 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 14 08:48:51.425719 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'e271ba28-d7c7-4567-a916-f91906609e7c' could not be found. Sep 14 08:48:51.425719 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:51.425719 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:48:51.425719 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:51.427363 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:51.427363 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:48:51.427363 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:48:51.427363 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:48:51.427363 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:48:51.427363 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'e271ba28-d7c7-4567-a916-f91906609e7c' could not be found. Sep 14 08:48:51.427363 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:51.427839 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=100 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:48:51.429248 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c06ccd86-7101-428e-aa59-8e96bde94292 tempest-HypervisorAdminNegativeTestJSON-389998335 tempest-HypervisorAdminNegativeTestJSON-389998335-project-admin] Returning 404 to user: Hypervisor with ID 'e271ba28-d7c7-4567-a916-f91906609e7c' could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:48:51.434651 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-c06ccd86-7101-428e-aa59-8e96bde94292 tempest-HypervisorAdminNegativeTestJSON-389998335 tempest-HypervisorAdminNegativeTestJSON-389998335-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors/e271ba28-d7c7-4567-a916-f91906609e7c/uptime" status: 404 len: 123 microversion: 2.1 time: 0.024496 Sep 14 08:48:51.435226 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 124/271] 10.222.0.60 () {58 vars in 1278 bytes} [Wed Sep 14 08:48:51 2022] GET /compute/v2.1/os-hypervisors/e271ba28-d7c7-4567-a916-f91906609e7c/uptime => generated 123 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 08:48:51.445369 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c0c5db11-ea99-41af-871f-946051ae6aab tempest-HypervisorAdminNegativeTestJSON-389998335 tempest-HypervisorAdminNegativeTestJSON-389998335-project-admin] Calling method '.version_select at 0x7f7d44e7b310>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:51.447161 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c0c5db11-ea99-41af-871f-946051ae6aab tempest-HypervisorAdminNegativeTestJSON-389998335 tempest-HypervisorAdminNegativeTestJSON-389998335-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:51.451484 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c0c5db11-ea99-41af-871f-946051ae6aab tempest-HypervisorAdminNegativeTestJSON-389998335 tempest-HypervisorAdminNegativeTestJSON-389998335-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:51.451658 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c0c5db11-ea99-41af-871f-946051ae6aab tempest-HypervisorAdminNegativeTestJSON-389998335 tempest-HypervisorAdminNegativeTestJSON-389998335-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:51.489530 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c0c5db11-ea99-41af-871f-946051ae6aab tempest-HypervisorAdminNegativeTestJSON-389998335 tempest-HypervisorAdminNegativeTestJSON-389998335-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:51.490051 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c0c5db11-ea99-41af-871f-946051ae6aab tempest-HypervisorAdminNegativeTestJSON-389998335 tempest-HypervisorAdminNegativeTestJSON-389998335-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:51.490510 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c0c5db11-ea99-41af-871f-946051ae6aab tempest-HypervisorAdminNegativeTestJSON-389998335 tempest-HypervisorAdminNegativeTestJSON-389998335-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:51.521608 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c0c5db11-ea99-41af-871f-946051ae6aab tempest-HypervisorAdminNegativeTestJSON-389998335 tempest-HypervisorAdminNegativeTestJSON-389998335-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:51.523290 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c0c5db11-ea99-41af-871f-946051ae6aab tempest-HypervisorAdminNegativeTestJSON-389998335 tempest-HypervisorAdminNegativeTestJSON-389998335-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:51.523936 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c0c5db11-ea99-41af-871f-946051ae6aab tempest-HypervisorAdminNegativeTestJSON-389998335 tempest-HypervisorAdminNegativeTestJSON-389998335-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:51.537571 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-c0c5db11-ea99-41af-871f-946051ae6aab tempest-HypervisorAdminNegativeTestJSON-389998335 tempest-HypervisorAdminNegativeTestJSON-389998335-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.095780 Sep 14 08:48:51.541000 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 125/272] 10.222.0.60 () {58 vars in 1146 bytes} [Wed Sep 14 08:48:51 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 08:48:51.555487 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-93239856-8919-4145-8833-493dd2a96fd9 tempest-HypervisorAdminNegativeTestJSON-46417775 tempest-HypervisorAdminNegativeTestJSON-46417775-project] Calling method '.version_select at 0x7f7d44e7ba60>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:51.563449 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-93239856-8919-4145-8833-493dd2a96fd9 tempest-HypervisorAdminNegativeTestJSON-46417775 tempest-HypervisorAdminNegativeTestJSON-46417775-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': '32afdaddd85c4f3b916c92ad5f264278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66c24463b7a4d4893ed888e7af5d952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:48:51.565463 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-93239856-8919-4145-8833-493dd2a96fd9 tempest-HypervisorAdminNegativeTestJSON-46417775 tempest-HypervisorAdminNegativeTestJSON-46417775-project] Request method failure captured: Sep 14 08:48:51.565463 n-d-836830-18 devstack@n-api.service[128758]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Sep 14 08:48:51.565463 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 08:48:51.565463 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 08:48:51.565463 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 08:48:51.565463 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 08:48:51.565463 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 08:48:51.565463 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 08:48:51.565463 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 08:48:51.565463 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 08:48:51.565463 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZVvSHtKkpQ6IZrR0fehLTdyzxoF20gX_ZAhmTip5vy_ABINZ1VVb2yu6vLviniRqxSBi73foQC-GJ3MTjt4rnkWs2S25lA1QKErQ4zyy5of9ovnVf3gazHbOAesLqeH8A0Y33bjnZV8n_eEvQzv_J4BTAZjz608-IlX-jlMXnRzA6Q Sep 14 08:48:51.565463 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 08:48:51.565463 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 08:48:51.565463 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 08:48:51.565463 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 08:48:51.565463 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 08:48:51.565463 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 08:48:51.565463 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: d66c24463b7a4d4893ed888e7af5d952 Sep 14 08:48:51.565463 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-46417775 Sep 14 08:48:51.565463 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 08:48:51.565463 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 08:48:51.566760 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/d66c24463b7a4d4893ed888e7af5d952"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_d66c24463b7a4d4893ed888e7af5d952"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d66c24463b7a4d4893ed888e7af5d952"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d66c24463b7a4d4893ed888e7af5d952"}]}] Sep 14 08:48:51.566760 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-46417775 Sep 14 08:48:51.566760 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: d66c24463b7a4d4893ed888e7af5d952 Sep 14 08:48:51.566760 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-46417775 Sep 14 08:48:51.566760 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-HypervisorAdminNegativeTestJSON-46417775-project Sep 14 08:48:51.566760 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 08:48:51.566760 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 08:48:51.566760 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 32afdaddd85c4f3b916c92ad5f264278 Sep 14 08:48:51.566760 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-46417775-project Sep 14 08:48:51.566760 n-d-836830-18 devstack@n-api.service[128758]: method: Sep 14 08:48:51.566760 n-d-836830-18 devstack@n-api.service[128758]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Sep 14 08:48:51.566760 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': '1'} Sep 14 08:48:51.566760 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:48:51.567552 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:51.567552 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:48:51.567552 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:48:51.567552 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:48:51.567552 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:48:51.567552 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 08:48:51.567552 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 08:48:51.567552 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:48:51.567552 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:48:51.567552 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Sep 14 08:48:51.567552 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self._show(req, id) Sep 14 08:48:51.567552 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Sep 14 08:48:51.567552 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Sep 14 08:48:51.567552 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 14 08:48:51.567552 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 14 08:48:51.567552 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 14 08:48:51.567552 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 14 08:48:51.567552 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 14 08:48:51.567552 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 14 08:48:51.568708 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 14 08:48:51.568708 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise self.value Sep 14 08:48:51.568708 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 14 08:48:51.568708 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 14 08:48:51.568708 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 14 08:48:51.568708 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 14 08:48:51.568708 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 14 08:48:51.568708 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 14 08:48:51.568708 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Sep 14 08:48:51.568708 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:51.568708 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:48:51.568708 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:51.568708 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:51.568708 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:48:51.568708 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:48:51.568708 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 14 08:48:51.568708 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 14 08:48:51.568708 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Sep 14 08:48:51.568708 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:51.571627 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-93239856-8919-4145-8833-493dd2a96fd9 tempest-HypervisorAdminNegativeTestJSON-46417775 tempest-HypervisorAdminNegativeTestJSON-46417775-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:48:51.571627 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-93239856-8919-4145-8833-493dd2a96fd9 tempest-HypervisorAdminNegativeTestJSON-46417775 tempest-HypervisorAdminNegativeTestJSON-46417775-project] 10.222.0.60 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.022336 Sep 14 08:48:51.571627 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 126/273] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Sep 14 08:48:51 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 25 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Sep 14 08:48:51.585784 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-84e0660d-9844-404d-bedd-ef4b44d9cb1d tempest-HypervisorAdminNegativeTestJSON-389998335 tempest-HypervisorAdminNegativeTestJSON-389998335-project-admin] Calling method '.version_select at 0x7f7d44de9ee0>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:51.588654 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-84e0660d-9844-404d-bedd-ef4b44d9cb1d tempest-HypervisorAdminNegativeTestJSON-389998335 tempest-HypervisorAdminNegativeTestJSON-389998335-project-admin] HTTP exception thrown: Hypervisor with ID '9e2dca99-e1f7-4ea2-b3b2-dd096953bfcb' could not be found. Sep 14 08:48:51.597442 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-84e0660d-9844-404d-bedd-ef4b44d9cb1d tempest-HypervisorAdminNegativeTestJSON-389998335 tempest-HypervisorAdminNegativeTestJSON-389998335-project-admin] Request method failure captured: Sep 14 08:48:51.597442 n-d-836830-18 devstack@n-api.service[128758]: request: GET /compute/v2.1/os-hypervisors/9e2dca99-e1f7-4ea2-b3b2-dd096953bfcb HTTP/1.1 Sep 14 08:48:51.597442 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 08:48:51.597442 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 08:48:51.597442 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 08:48:51.597442 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 08:48:51.597442 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 08:48:51.597442 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 08:48:51.597442 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 08:48:51.597442 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 08:48:51.597442 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZVyG0KaiW5ooFc3KkViKe49v8dPuCXsexLGaePChkpYaPIhH90-2yLz-JjZLKUUaUI1uLNuBfUFCaVeZ8YHghUS0NsMTdVhAzfjrOnsUoWBY4fSizUccukPknKtbd1dlvAnYJnfhRPGaFqAYvgkpR9zQnhUU7vp0fsZyG2xNy7J2oc Sep 14 08:48:51.597442 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 08:48:51.597442 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 08:48:51.597442 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 08:48:51.597442 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 08:48:51.597442 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 08:48:51.597442 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 08:48:51.597442 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: cb663c467ff14811a06e9ab671d11b61 Sep 14 08:48:51.597442 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-389998335 Sep 14 08:48:51.597442 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member,admin Sep 14 08:48:51.597442 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member,admin Sep 14 08:48:51.599831 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/cb663c467ff14811a06e9ab671d11b61"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_cb663c467ff14811a06e9ab671d11b61"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cb663c467ff14811a06e9ab671d11b61"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cb663c467ff14811a06e9ab671d11b61"}]}] Sep 14 08:48:51.599831 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-389998335 Sep 14 08:48:51.599831 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: cb663c467ff14811a06e9ab671d11b61 Sep 14 08:48:51.599831 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-389998335 Sep 14 08:48:51.599831 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-HypervisorAdminNegativeTestJSON-389998335-project-admin Sep 14 08:48:51.599831 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 08:48:51.599831 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 08:48:51.599831 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 6c519ce02cc042f98dcfa21caffcc1b2 Sep 14 08:48:51.599831 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-389998335-project-admin Sep 14 08:48:51.599831 n-d-836830-18 devstack@n-api.service[128758]: method: Sep 14 08:48:51.599831 n-d-836830-18 devstack@n-api.service[128758]: exception: Hypervisor with ID '9e2dca99-e1f7-4ea2-b3b2-dd096953bfcb' could not be found. Sep 14 08:48:51.599831 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': '9e2dca99-e1f7-4ea2-b3b2-dd096953bfcb'} Sep 14 08:48:51.600582 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:48:51.600582 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:51.600582 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Sep 14 08:48:51.600582 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi value = int(str(value)) Sep 14 08:48:51.600582 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '9e2dca99-e1f7-4ea2-b3b2-dd096953bfcb' Sep 14 08:48:51.600582 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:51.600582 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:48:51.600582 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:51.600582 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:51.600582 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Sep 14 08:48:51.600582 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Sep 14 08:48:51.600582 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Sep 14 08:48:51.600582 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Sep 14 08:48:51.600582 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Sep 14 08:48:51.600582 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:51.600582 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:48:51.600582 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:51.600582 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:51.600582 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Sep 14 08:48:51.600582 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Sep 14 08:48:51.600582 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Sep 14 08:48:51.600582 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Sep 14 08:48:51.601780 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Sep 14 08:48:51.601780 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:51.601780 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:48:51.601780 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:51.601780 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:51.601780 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:48:51.601780 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:48:51.601780 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:48:51.601780 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:48:51.601780 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 08:48:51.601780 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 08:48:51.601780 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:48:51.601780 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:48:51.601780 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Sep 14 08:48:51.601780 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self._show(req, id) Sep 14 08:48:51.601780 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Sep 14 08:48:51.601780 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Sep 14 08:48:51.601780 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Sep 14 08:48:51.601780 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 14 08:48:51.601780 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '9e2dca99-e1f7-4ea2-b3b2-dd096953bfcb' could not be found. Sep 14 08:48:51.602837 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:51.602837 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:48:51.602837 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:51.602837 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:51.602837 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:48:51.602837 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:48:51.602837 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:48:51.602837 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:48:51.602837 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '9e2dca99-e1f7-4ea2-b3b2-dd096953bfcb' could not be found. Sep 14 08:48:51.602837 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:51.602837 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-84e0660d-9844-404d-bedd-ef4b44d9cb1d tempest-HypervisorAdminNegativeTestJSON-389998335 tempest-HypervisorAdminNegativeTestJSON-389998335-project-admin] Returning 404 to user: Hypervisor with ID '9e2dca99-e1f7-4ea2-b3b2-dd096953bfcb' could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:48:51.608602 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-84e0660d-9844-404d-bedd-ef4b44d9cb1d tempest-HypervisorAdminNegativeTestJSON-389998335 tempest-HypervisorAdminNegativeTestJSON-389998335-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors/9e2dca99-e1f7-4ea2-b3b2-dd096953bfcb" status: 404 len: 123 microversion: 2.1 time: 0.031213 Sep 14 08:48:51.610325 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 127/274] 10.222.0.60 () {58 vars in 1257 bytes} [Wed Sep 14 08:48:51 2022] GET /compute/v2.1/os-hypervisors/9e2dca99-e1f7-4ea2-b3b2-dd096953bfcb => generated 123 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 14 08:48:51.646030 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b5c1aeda-6627-483f-ada3-a6dff6814f28 tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 226 microversion: 2.1 time: 0.259464 Sep 14 08:48:51.655951 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 148/275] 10.222.0.60 () {60 vars in 1191 bytes} [Wed Sep 14 08:48:51 2022] POST /compute/v2.1/os-aggregates/8/action => generated 226 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:48:51.661696 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-32e7a7c5-51d1-422c-a989-741d56324940 tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:51.693518 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-32e7a7c5-51d1-422c-a989-741d56324940 tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.035429 Sep 14 08:48:51.698981 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 128/276] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Sep 14 08:48:51 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 14 08:48:51.709715 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-7f2d734c-7a6a-4be9-8d3b-d4884409707e tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2120815616"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:48:51.713557 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.objects.aggregate [None req-7f2d734c-7a6a-4be9-8d3b-d4884409707e tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] Generated uuid c2199619-8897-4639-bb6d-7cf61ac7c676 for aggregate {{(pid=128759) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 14 08:48:51.743555 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-7f2d734c-7a6a-4be9-8d3b-d4884409707e tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.040117 Sep 14 08:48:51.745061 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 149/277] 10.222.0.60 () {60 vars in 1164 bytes} [Wed Sep 14 08:48:51 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:48:51.757426 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-3fbd8514-6eee-42bc-8878-e1a581000b22 tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-836830-18"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:48:51.772068 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3fbd8514-6eee-42bc-8878-e1a581000b22 tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:51.773939 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3fbd8514-6eee-42bc-8878-e1a581000b22 tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:51.779630 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3fbd8514-6eee-42bc-8878-e1a581000b22 tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:51.786592 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-bb89db99-e661-4d23-a127-8005a803f9fc tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:51.790473 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-bb89db99-e661-4d23-a127-8005a803f9fc tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] [instance: 17179827-7f78-4a3b-8eaa-766c5fa2b698] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:48:51.798623 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bb89db99-e661-4d23-a127-8005a803f9fc tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:51.802799 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bb89db99-e661-4d23-a127-8005a803f9fc tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:51.805315 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bb89db99-e661-4d23-a127-8005a803f9fc tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:51.806223 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bb89db99-e661-4d23-a127-8005a803f9fc tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:51.810730 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bb89db99-e661-4d23-a127-8005a803f9fc tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:51.811227 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bb89db99-e661-4d23-a127-8005a803f9fc tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:51.927200 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-bb89db99-e661-4d23-a127-8005a803f9fc tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e462483415e4c2b8a917b2a032e5ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac4d0cae0bd46fda94d7bfb900a0b9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:48:51.937600 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-bb89db99-e661-4d23-a127-8005a803f9fc tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] 10.222.0.60 "GET /compute/v2.1/servers/17179827-7f78-4a3b-8eaa-766c5fa2b698" status: 200 len: 1278 microversion: 2.1 time: 0.155892 Sep 14 08:48:51.938517 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 150/278] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:48:51 2022] GET /compute/v2.1/servers/17179827-7f78-4a3b-8eaa-766c5fa2b698 => generated 1278 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:48:51.951977 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-3fbd8514-6eee-42bc-8878-e1a581000b22 tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 243 microversion: 2.1 time: 0.199196 Sep 14 08:48:51.952925 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 129/279] 10.222.0.60 () {60 vars in 1191 bytes} [Wed Sep 14 08:48:51 2022] POST /compute/v2.1/os-aggregates/9/action => generated 243 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:48:51.965474 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-6bfc309a-b3b5-40f7-99a4-6df7eab4f197 tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:51.974931 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-6bfc309a-b3b5-40f7-99a4-6df7eab4f197 tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] 10.222.0.60 "GET /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.1 time: 0.013137 Sep 14 08:48:51.976287 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 151/280] 10.222.0.60 () {58 vars in 1143 bytes} [Wed Sep 14 08:48:51 2022] GET /compute/v2.1/os-aggregates => generated 246 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:48:51.991950 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-2c236223-1aa8-4cd3-ba26-46159eac5128 tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-836830-18"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:48:52.005790 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2c236223-1aa8-4cd3-ba26-46159eac5128 tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:52.006290 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2c236223-1aa8-4cd3-ba26-46159eac5128 tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:52.006725 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2c236223-1aa8-4cd3-ba26-46159eac5128 tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:52.176627 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-2c236223-1aa8-4cd3-ba26-46159eac5128 tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 227 microversion: 2.1 time: 0.189065 Sep 14 08:48:52.177323 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 130/281] 10.222.0.60 () {60 vars in 1191 bytes} [Wed Sep 14 08:48:51 2022] POST /compute/v2.1/os-aggregates/9/action => generated 227 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:48:52.194562 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-8a6a8f13-36d9-499d-be53-8c1b691c30bc tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:52.233189 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-8a6a8f13-36d9-499d-be53-8c1b691c30bc tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.046113 Sep 14 08:48:52.234592 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 131/282] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Sep 14 08:48:52 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 14 08:48:52.251054 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1c7342bc-b6c5-4b96-bba6-aa13cf35bde2 tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1837952199"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:48:52.256559 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.objects.aggregate [None req-1c7342bc-b6c5-4b96-bba6-aa13cf35bde2 tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] Generated uuid d20662b5-a286-4007-a4f4-05b92944fc6e for aggregate {{(pid=128758) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 14 08:48:52.303370 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-1c7342bc-b6c5-4b96-bba6-aa13cf35bde2 tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.061947 Sep 14 08:48:52.306248 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 132/283] 10.222.0.60 () {60 vars in 1164 bytes} [Wed Sep 14 08:48:52 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:48:52.317414 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a9ef171a-e62e-4e46-a156-f004031357f5 tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-836830-18"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:48:52.331163 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a9ef171a-e62e-4e46-a156-f004031357f5 tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:52.331664 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a9ef171a-e62e-4e46-a156-f004031357f5 tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:52.332174 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a9ef171a-e62e-4e46-a156-f004031357f5 tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:52.416523 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f31b39b8-14fe-497c-8599-be829a3545b2 tempest-NetworksTest-914225123 tempest-NetworksTest-914225123-project-admin] Calling method '.version_select at 0x7f7d44e43310>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:52.493580 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-a9ef171a-e62e-4e46-a156-f004031357f5 tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 244 microversion: 2.1 time: 0.179872 Sep 14 08:48:52.494363 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 133/284] 10.222.0.60 () {60 vars in 1194 bytes} [Wed Sep 14 08:48:52 2022] POST /compute/v2.1/os-aggregates/10/action => generated 244 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 08:48:52.499366 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-0935591c-73d1-4c36-bb61-6137b5640c07 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:52.501312 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-0935591c-73d1-4c36-bb61-6137b5640c07 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: 0a331816-6b06-40c9-a557-eada274501b5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:48:52.511198 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0935591c-73d1-4c36-bb61-6137b5640c07 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:52.511762 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0935591c-73d1-4c36-bb61-6137b5640c07 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:52.512409 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0935591c-73d1-4c36-bb61-6137b5640c07 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:52.513914 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0935591c-73d1-4c36-bb61-6137b5640c07 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:52.515047 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0935591c-73d1-4c36-bb61-6137b5640c07 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:52.515637 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0935591c-73d1-4c36-bb61-6137b5640c07 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:52.546581 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:48:52.908873 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f31b39b8-14fe-497c-8599-be829a3545b2 tempest-NetworksTest-914225123 tempest-NetworksTest-914225123-project-admin] 10.222.0.60 "GET /compute/v2.1/os-networks" status: 200 len: 1938 microversion: 2.1 time: 0.856666 Sep 14 08:48:52.909549 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 152/285] 10.222.0.60 () {58 vars in 1137 bytes} [Wed Sep 14 08:48:52 2022] GET /compute/v2.1/os-networks => generated 1938 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:48:52.918305 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-7030d6a5-75c3-4e67-aebd-0bf77976844f tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-836830-18"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:48:52.940527 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7030d6a5-75c3-4e67-aebd-0bf77976844f tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:52.941024 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7030d6a5-75c3-4e67-aebd-0bf77976844f tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:52.941467 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7030d6a5-75c3-4e67-aebd-0bf77976844f tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:52.987596 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-0935591c-73d1-4c36-bb61-6137b5640c07 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:48:53.000719 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-0935591c-73d1-4c36-bb61-6137b5640c07 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/0a331816-6b06-40c9-a557-eada274501b5" status: 200 len: 1311 microversion: 2.1 time: 0.501871 Sep 14 08:48:53.001649 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 134/286] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:48:52 2022] GET /compute/v2.1/servers/0a331816-6b06-40c9-a557-eada274501b5 => generated 1311 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:48:53.007967 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-fedc3b6a-6251-44b5-8db7-4f2435d30b45 tempest-NetworksTest-914225123 tempest-NetworksTest-914225123-project-admin] Calling method '.version_select at 0x7f7d45040430>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:53.147885 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-7030d6a5-75c3-4e67-aebd-0bf77976844f tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 228 microversion: 2.1 time: 0.237070 Sep 14 08:48:53.156477 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 153/287] 10.222.0.60 () {60 vars in 1194 bytes} [Wed Sep 14 08:48:52 2022] POST /compute/v2.1/os-aggregates/10/action => generated 228 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:48:53.164857 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-dc965034-0031-4b14-b508-134ce043d5e6 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:53.166171 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-dc965034-0031-4b14-b508-134ce043d5e6 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] [instance: 17179827-7f78-4a3b-8eaa-766c5fa2b698] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:48:53.178724 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dc965034-0031-4b14-b508-134ce043d5e6 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:53.179451 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dc965034-0031-4b14-b508-134ce043d5e6 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:53.180309 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dc965034-0031-4b14-b508-134ce043d5e6 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:53.184326 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dc965034-0031-4b14-b508-134ce043d5e6 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:53.185452 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dc965034-0031-4b14-b508-134ce043d5e6 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:53.186630 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dc965034-0031-4b14-b508-134ce043d5e6 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:53.268903 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-fedc3b6a-6251-44b5-8db7-4f2435d30b45 tempest-NetworksTest-914225123 tempest-NetworksTest-914225123-project-admin] 10.222.0.60 "GET /compute/v2.1/os-networks/36f27675-c765-4db9-982e-8f515d0f3697" status: 200 len: 652 microversion: 2.1 time: 0.263268 Sep 14 08:48:53.268903 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 135/288] 10.222.0.60 () {58 vars in 1248 bytes} [Wed Sep 14 08:48:53 2022] GET /compute/v2.1/os-networks/36f27675-c765-4db9-982e-8f515d0f3697 => generated 652 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:48:53.272907 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-afc84379-60cd-432a-82b6-fac242269c57 tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:53.313859 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-afc84379-60cd-432a-82b6-fac242269c57 tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.045500 Sep 14 08:48:53.323744 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 136/289] 10.222.0.60 () {58 vars in 1155 bytes} [Wed Sep 14 08:48:53 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 14 08:48:53.332469 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-0b90f4cc-e156-4d70-9ed9-d1ca212beea0 tempest-NetworksTest-914225123 tempest-NetworksTest-914225123-project-admin] Calling method '.version_select at 0x7f7d45294940>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:53.492349 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-dc965034-0031-4b14-b508-134ce043d5e6 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e462483415e4c2b8a917b2a032e5ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac4d0cae0bd46fda94d7bfb900a0b9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:48:53.500801 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-dc965034-0031-4b14-b508-134ce043d5e6 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] 10.222.0.60 "GET /compute/v2.1/servers/17179827-7f78-4a3b-8eaa-766c5fa2b698" status: 200 len: 1320 microversion: 2.1 time: 0.343001 Sep 14 08:48:53.514394 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 154/290] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:48:53 2022] GET /compute/v2.1/servers/17179827-7f78-4a3b-8eaa-766c5fa2b698 => generated 1320 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:48:53.534994 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e5d15e15-ac4d-406d-8e9d-00084eeb3cad tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-988557199"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:48:53.538900 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.objects.aggregate [None req-e5d15e15-ac4d-406d-8e9d-00084eeb3cad tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] Generated uuid 867e42a9-910a-4902-9a1b-04ac6280dc83 for aggregate {{(pid=128759) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 14 08:48:53.562269 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-0b90f4cc-e156-4d70-9ed9-d1ca212beea0 tempest-NetworksTest-914225123 tempest-NetworksTest-914225123-project-admin] 10.222.0.60 "GET /compute/v2.1/os-networks" status: 200 len: 1938 microversion: 2.1 time: 0.236665 Sep 14 08:48:53.563370 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 137/291] 10.222.0.60 () {58 vars in 1137 bytes} [Wed Sep 14 08:48:53 2022] GET /compute/v2.1/os-networks => generated 1938 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:48:53.569758 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-4c3d6663-3f6b-47f5-b8b2-4fb328ded3d4 tempest-AggregatesAdminNegativeTestJSON-1326539754 tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1600445065"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:48:53.578224 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.objects.aggregate [None req-4c3d6663-3f6b-47f5-b8b2-4fb328ded3d4 tempest-AggregatesAdminNegativeTestJSON-1326539754 tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin] Generated uuid 4578e230-582a-4622-a112-cfe792d4d24c for aggregate {{(pid=128758) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 14 08:48:53.595228 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e5d15e15-ac4d-406d-8e9d-00084eeb3cad tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.077297 Sep 14 08:48:53.598471 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 155/292] 10.222.0.60 () {60 vars in 1164 bytes} [Wed Sep 14 08:48:53 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:48:53.611484 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-1000efeb-619d-4ef5-863e-da3c7ed7afb6 tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:53.626676 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-4c3d6663-3f6b-47f5-b8b2-4fb328ded3d4 tempest-AggregatesAdminNegativeTestJSON-1326539754 tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.062011 Sep 14 08:48:53.627495 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 138/293] 10.222.0.60 () {60 vars in 1164 bytes} [Wed Sep 14 08:48:53 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:48:53.641893 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c2d891cb-671c-4b30-ac82-0e5c28c8c085 tempest-AggregatesAdminNegativeTestJSON-1326539754 tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-836830-18"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:48:53.656593 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-1000efeb-619d-4ef5-863e-da3c7ed7afb6 tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.049807 Sep 14 08:48:53.657768 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c2d891cb-671c-4b30-ac82-0e5c28c8c085 tempest-AggregatesAdminNegativeTestJSON-1326539754 tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:53.657959 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 156/294] 10.222.0.60 () {58 vars in 1155 bytes} [Wed Sep 14 08:48:53 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 14 08:48:53.658700 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c2d891cb-671c-4b30-ac82-0e5c28c8c085 tempest-AggregatesAdminNegativeTestJSON-1326539754 tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:53.659398 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c2d891cb-671c-4b30-ac82-0e5c28c8c085 tempest-AggregatesAdminNegativeTestJSON-1326539754 tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:53.667296 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-048fb086-fced-46af-b585-30aef661e00a tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:53.683699 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-048fb086-fced-46af-b585-30aef661e00a tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] HTTP exception thrown: Aggregate 11 could not be found. Sep 14 08:48:53.687673 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-048fb086-fced-46af-b585-30aef661e00a tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] Request method failure captured: Sep 14 08:48:53.687673 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/os-aggregates/11 HTTP/1.1 Sep 14 08:48:53.687673 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 08:48:53.687673 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 08:48:53.687673 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 08:48:53.687673 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 08:48:53.687673 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 08:48:53.687673 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 08:48:53.687673 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 08:48:53.687673 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 08:48:53.687673 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZVMCsxQa0GWMFqQ9ixc5CO69vOkNefWba_gWnLdp6fPN93XkluNWaEOQNaZLxlsNI2JIyeQqbLtdMl8gr70Oc-4rsBU5UAtz3yeIGoWmong2fRjIyHyvRbzD8_dL7wdfl5_M6gEPydAS-KHLtCzKWNh0JQvakG97igNe7HdwhBllyM Sep 14 08:48:53.687673 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 08:48:53.687673 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 08:48:53.687673 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 08:48:53.687673 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 08:48:53.687673 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 08:48:53.687673 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 08:48:53.687673 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 60c8dcd631bd42899cd1934122307693 Sep 14 08:48:53.687673 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-AggregatesAdminTestJSON-983748748 Sep 14 08:48:53.687673 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member,admin Sep 14 08:48:53.687673 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member,admin Sep 14 08:48:53.689189 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/60c8dcd631bd42899cd1934122307693"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_60c8dcd631bd42899cd1934122307693"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/60c8dcd631bd42899cd1934122307693"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/60c8dcd631bd42899cd1934122307693"}]}] Sep 14 08:48:53.689189 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-AggregatesAdminTestJSON-983748748 Sep 14 08:48:53.689189 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 60c8dcd631bd42899cd1934122307693 Sep 14 08:48:53.689189 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-983748748 Sep 14 08:48:53.689189 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-AggregatesAdminTestJSON-983748748-project-admin Sep 14 08:48:53.689189 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 08:48:53.689189 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 08:48:53.689189 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 39850262cecd482b8ff825fade0f84b0 Sep 14 08:48:53.689189 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-AggregatesAdminTestJSON-983748748-project-admin Sep 14 08:48:53.689189 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 08:48:53.689189 n-d-836830-18 devstack@n-api.service[128759]: exception: Aggregate 11 could not be found. Sep 14 08:48:53.689189 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '11'} Sep 14 08:48:53.689189 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:48:53.690099 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:53.690099 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Sep 14 08:48:53.690099 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Sep 14 08:48:53.690099 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Sep 14 08:48:53.690099 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Sep 14 08:48:53.690099 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 14 08:48:53.690099 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 14 08:48:53.690099 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 14 08:48:53.690099 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 14 08:48:53.690099 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 14 08:48:53.690099 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 14 08:48:53.690099 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 14 08:48:53.690099 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 14 08:48:53.690099 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 11 could not be found. Sep 14 08:48:53.690099 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:48:53.690099 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:48:53.690099 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:48:53.690099 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:53.690099 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:48:53.691698 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:48:53.691698 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:48:53.691698 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:48:53.691698 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:48:53.691698 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:48:53.691698 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Sep 14 08:48:53.691698 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 08:48:53.691698 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 11 could not be found. Sep 14 08:48:53.691698 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:48:53.691698 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:48:53.691698 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:48:53.691698 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:53.691698 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:48:53.691698 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:48:53.691698 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:48:53.691698 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:48:53.691698 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 11 could not be found. Sep 14 08:48:53.691698 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:48:53.714277 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-048fb086-fced-46af-b585-30aef661e00a tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] Returning 404 to user: Aggregate 11 could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:48:53.715667 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-048fb086-fced-46af-b585-30aef661e00a tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] 10.222.0.60 "GET /compute/v2.1/os-aggregates/11" status: 404 len: 78 microversion: 2.1 time: 0.053762 Sep 14 08:48:53.720168 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 157/295] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Sep 14 08:48:53 2022] GET /compute/v2.1/os-aggregates/11 => generated 78 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 14 08:48:53.735806 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-66c2b6c2-5d8d-4423-bf9c-d3b6589868f0 req-a0007f2e-4dd9-4380-8bcf-8597f57d6c0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17179827-7f78-4a3b-8eaa-766c5fa2b698", "tag": "92ab0af3-d225-4396-b7f7-37a50bd5214c"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:48:53.779446 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-66c2b6c2-5d8d-4423-bf9c-d3b6589868f0 req-a0007f2e-4dd9-4380-8bcf-8597f57d6c0b service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:53.780029 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-66c2b6c2-5d8d-4423-bf9c-d3b6589868f0 req-a0007f2e-4dd9-4380-8bcf-8597f57d6c0b service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:53.780476 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-66c2b6c2-5d8d-4423-bf9c-d3b6589868f0 req-a0007f2e-4dd9-4380-8bcf-8597f57d6c0b service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:53.818885 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-66c2b6c2-5d8d-4423-bf9c-d3b6589868f0 req-a0007f2e-4dd9-4380-8bcf-8597f57d6c0b service nova] Creating event network-changed:92ab0af3-d225-4396-b7f7-37a50bd5214c for instance 17179827-7f78-4a3b-8eaa-766c5fa2b698 on n-h2-836830-18 Sep 14 08:48:53.826403 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-66c2b6c2-5d8d-4423-bf9c-d3b6589868f0 req-a0007f2e-4dd9-4380-8bcf-8597f57d6c0b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104487 Sep 14 08:48:53.830312 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 158/296] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:48:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:48:53.843275 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8093aed7-0df5-419f-b2e6-61dae4419605 tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:53.858037 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-c2d891cb-671c-4b30-ac82-0e5c28c8c085 tempest-AggregatesAdminNegativeTestJSON-1326539754 tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates/12/action" status: 200 len: 244 microversion: 2.1 time: 0.222761 Sep 14 08:48:53.858902 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 139/297] 10.222.0.60 () {60 vars in 1194 bytes} [Wed Sep 14 08:48:53 2022] POST /compute/v2.1/os-aggregates/12/action => generated 244 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:48:53.865463 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-8093aed7-0df5-419f-b2e6-61dae4419605 tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] HTTP exception thrown: Aggregate 11 could not be found. Sep 14 08:48:53.871209 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b98b8c7e-d956-4a8a-8f70-9bf5e64d2dd5 tempest-AggregatesAdminNegativeTestJSON-338931773 tempest-AggregatesAdminNegativeTestJSON-338931773-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-836830-18"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:48:53.873002 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8093aed7-0df5-419f-b2e6-61dae4419605 tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] Request method failure captured: Sep 14 08:48:53.873002 n-d-836830-18 devstack@n-api.service[128759]: request: DELETE /compute/v2.1/os-aggregates/11 HTTP/1.1 Sep 14 08:48:53.873002 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 08:48:53.873002 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 08:48:53.873002 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 08:48:53.873002 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 08:48:53.873002 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 08:48:53.873002 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 08:48:53.873002 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 08:48:53.873002 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 08:48:53.873002 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZVMCsxQa0GWMFqQ9ixc5CO69vOkNefWba_gWnLdp6fPN93XkluNWaEOQNaZLxlsNI2JIyeQqbLtdMl8gr70Oc-4rsBU5UAtz3yeIGoWmong2fRjIyHyvRbzD8_dL7wdfl5_M6gEPydAS-KHLtCzKWNh0JQvakG97igNe7HdwhBllyM Sep 14 08:48:53.873002 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 08:48:53.873002 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 08:48:53.873002 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 08:48:53.873002 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 08:48:53.873002 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 08:48:53.873002 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 08:48:53.873002 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 60c8dcd631bd42899cd1934122307693 Sep 14 08:48:53.873002 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-AggregatesAdminTestJSON-983748748 Sep 14 08:48:53.873002 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member,admin Sep 14 08:48:53.873002 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member,admin Sep 14 08:48:53.874246 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/60c8dcd631bd42899cd1934122307693"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_60c8dcd631bd42899cd1934122307693"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/60c8dcd631bd42899cd1934122307693"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/60c8dcd631bd42899cd1934122307693"}]}] Sep 14 08:48:53.874246 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-AggregatesAdminTestJSON-983748748 Sep 14 08:48:53.874246 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 60c8dcd631bd42899cd1934122307693 Sep 14 08:48:53.874246 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-983748748 Sep 14 08:48:53.874246 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-AggregatesAdminTestJSON-983748748-project-admin Sep 14 08:48:53.874246 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 08:48:53.874246 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 08:48:53.874246 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 39850262cecd482b8ff825fade0f84b0 Sep 14 08:48:53.874246 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-AggregatesAdminTestJSON-983748748-project-admin Sep 14 08:48:53.874246 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 08:48:53.874246 n-d-836830-18 devstack@n-api.service[128759]: exception: Aggregate 11 could not be found. Sep 14 08:48:53.874246 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '11'} Sep 14 08:48:53.874246 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:48:53.876976 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:53.876976 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Sep 14 08:48:53.876976 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Sep 14 08:48:53.876976 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 14 08:48:53.876976 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 14 08:48:53.876976 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 14 08:48:53.876976 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 14 08:48:53.876976 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 14 08:48:53.876976 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise self.value Sep 14 08:48:53.876976 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 14 08:48:53.876976 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 14 08:48:53.876976 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Sep 14 08:48:53.876976 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Sep 14 08:48:53.876976 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 14 08:48:53.876976 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 14 08:48:53.876976 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 14 08:48:53.876976 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 14 08:48:53.876976 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 14 08:48:53.876976 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 14 08:48:53.878100 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 14 08:48:53.878100 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 14 08:48:53.878100 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 11 could not be found. Sep 14 08:48:53.878100 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:48:53.878100 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:48:53.878100 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:48:53.878100 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:53.878100 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:48:53.878100 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:48:53.878100 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:48:53.878100 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:48:53.878100 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:48:53.878100 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:48:53.878100 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Sep 14 08:48:53.878100 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 08:48:53.878100 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 11 could not be found. Sep 14 08:48:53.878100 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:48:53.878100 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:48:53.878100 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:48:53.878100 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:53.878100 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:48:53.881732 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:48:53.881732 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:48:53.881732 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:48:53.881732 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 11 could not be found. Sep 14 08:48:53.881732 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:48:53.881732 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8093aed7-0df5-419f-b2e6-61dae4419605 tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] Returning 404 to user: Aggregate 11 could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:48:53.881732 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-8093aed7-0df5-419f-b2e6-61dae4419605 tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-aggregates/11" status: 404 len: 78 microversion: 2.1 time: 0.043267 Sep 14 08:48:53.881732 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 159/298] 10.222.0.60 () {58 vars in 1155 bytes} [Wed Sep 14 08:48:53 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 78 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 14 08:48:53.884699 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-b98b8c7e-d956-4a8a-8f70-9bf5e64d2dd5 tempest-AggregatesAdminNegativeTestJSON-338931773 tempest-AggregatesAdminNegativeTestJSON-338931773-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': '57bc4ee1d3ae4513a389cb933904e571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed05e2ea9b444238abc9a9be91397ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:48:53.887957 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b98b8c7e-d956-4a8a-8f70-9bf5e64d2dd5 tempest-AggregatesAdminNegativeTestJSON-338931773 tempest-AggregatesAdminNegativeTestJSON-338931773-project] Request method failure captured: Sep 14 08:48:53.887957 n-d-836830-18 devstack@n-api.service[128758]: request: POST /compute/v2.1/os-aggregates/12/action HTTP/1.1 Sep 14 08:48:53.887957 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 08:48:53.887957 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 08:48:53.887957 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 08:48:53.887957 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 43 Sep 14 08:48:53.887957 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 08:48:53.887957 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 08:48:53.887957 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 08:48:53.887957 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 08:48:53.887957 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZVJdW0uLhEkavM7Bp9qDO_pOqoNOa1h0Qp3wGKgWDHTczk4fefancNdrqkwxWcAIxR12spv8mhB9hpKqGel7aj9i3-5mk7YbzPqLTKlvqM81v3Bu1p54q7f8IzHym055xKb4Z4OWTK0y1quegytrHBJSe4m3PY_Y4dVuCratJjoErM Sep 14 08:48:53.887957 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 08:48:53.887957 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 08:48:53.887957 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 08:48:53.887957 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 08:48:53.887957 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 08:48:53.887957 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 08:48:53.887957 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: ed05e2ea9b444238abc9a9be91397ffb Sep 14 08:48:53.887957 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-338931773 Sep 14 08:48:53.887957 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 08:48:53.887957 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 08:48:53.889198 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/ed05e2ea9b444238abc9a9be91397ffb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_ed05e2ea9b444238abc9a9be91397ffb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ed05e2ea9b444238abc9a9be91397ffb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ed05e2ea9b444238abc9a9be91397ffb"}]}] Sep 14 08:48:53.889198 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-338931773 Sep 14 08:48:53.889198 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: ed05e2ea9b444238abc9a9be91397ffb Sep 14 08:48:53.889198 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-338931773 Sep 14 08:48:53.889198 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-AggregatesAdminNegativeTestJSON-338931773-project Sep 14 08:48:53.889198 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 08:48:53.889198 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 08:48:53.889198 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 57bc4ee1d3ae4513a389cb933904e571 Sep 14 08:48:53.889198 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-338931773-project Sep 14 08:48:53.889198 n-d-836830-18 devstack@n-api.service[128758]: Sep 14 08:48:53.889198 n-d-836830-18 devstack@n-api.service[128758]: {"remove_host": {"host": "n-h2-836830-18"}} Sep 14 08:48:53.889198 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 08:48:53.889198 n-d-836830-18 devstack@n-api.service[128758]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Sep 14 08:48:53.890033 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': '12', 'body': {'remove_host': {'host': 'n-h2-836830-18'}}} Sep 14 08:48:53.890033 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:48:53.890033 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:53.890033 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:48:53.890033 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:48:53.890033 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:48:53.890033 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:48:53.890033 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:48:53.890033 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:48:53.890033 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 08:48:53.890033 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 08:48:53.890033 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Sep 14 08:48:53.890033 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Sep 14 08:48:53.890033 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 14 08:48:53.890033 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 14 08:48:53.890033 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 14 08:48:53.890033 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 14 08:48:53.890033 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 14 08:48:53.890033 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 14 08:48:53.891103 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 14 08:48:53.891103 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise self.value Sep 14 08:48:53.891103 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 14 08:48:53.891103 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 14 08:48:53.891103 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 14 08:48:53.891103 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 14 08:48:53.891103 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 14 08:48:53.891103 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 14 08:48:53.891103 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Sep 14 08:48:53.891103 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:53.891103 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:48:53.891103 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:53.891103 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:53.891103 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:48:53.891103 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:48:53.891103 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 14 08:48:53.891103 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 14 08:48:53.891103 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Sep 14 08:48:53.891103 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:53.892118 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b98b8c7e-d956-4a8a-8f70-9bf5e64d2dd5 tempest-AggregatesAdminNegativeTestJSON-338931773 tempest-AggregatesAdminNegativeTestJSON-338931773-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:48:53.892118 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-b98b8c7e-d956-4a8a-8f70-9bf5e64d2dd5 tempest-AggregatesAdminNegativeTestJSON-338931773 tempest-AggregatesAdminNegativeTestJSON-338931773-project] 10.222.0.60 "POST /compute/v2.1/os-aggregates/12/action" status: 403 len: 121 microversion: 2.1 time: 0.022653 Sep 14 08:48:53.892118 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 140/299] 10.222.0.60 () {60 vars in 1194 bytes} [Wed Sep 14 08:48:53 2022] POST /compute/v2.1/os-aggregates/12/action => generated 121 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Sep 14 08:48:53.898447 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-187dcb88-203f-41f1-8b8b-19d517cd395e tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-67995485", "name": "tempest-test_aggregate-1455577454"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:48:53.902505 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.objects.aggregate [None req-187dcb88-203f-41f1-8b8b-19d517cd395e tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] Generated uuid 10ab4d8f-c8bf-45a5-9435-d5f4c4f205e3 for aggregate {{(pid=128759) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 14 08:48:53.905518 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1f2078d1-de5c-4aac-8bde-8650815f8d9b tempest-AggregatesAdminNegativeTestJSON-1326539754 tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-836830-18"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:48:53.939325 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1f2078d1-de5c-4aac-8bde-8650815f8d9b tempest-AggregatesAdminNegativeTestJSON-1326539754 tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:53.941335 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1f2078d1-de5c-4aac-8bde-8650815f8d9b tempest-AggregatesAdminNegativeTestJSON-1326539754 tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:53.943185 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1f2078d1-de5c-4aac-8bde-8650815f8d9b tempest-AggregatesAdminNegativeTestJSON-1326539754 tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:53.977055 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-187dcb88-203f-41f1-8b8b-19d517cd395e tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.093466 Sep 14 08:48:53.979843 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 160/300] 10.222.0.60 () {60 vars in 1165 bytes} [Wed Sep 14 08:48:53 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:48:53.988941 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-86d74cf9-ba42-4fdc-8a63-b55e6a980e8c tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:54.045298 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-86d74cf9-ba42-4fdc-8a63-b55e6a980e8c tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.055595 Sep 14 08:48:54.047267 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 161/301] 10.222.0.60 () {58 vars in 1155 bytes} [Wed Sep 14 08:48:53 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 14 08:48:54.067571 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f671d8d5-9906-4926-ba43-5ed0bddccb4b tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:54.068349 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f671d8d5-9906-4926-ba43-5ed0bddccb4b tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: 0a331816-6b06-40c9-a557-eada274501b5] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:48:54.093815 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f671d8d5-9906-4926-ba43-5ed0bddccb4b tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:54.095607 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f671d8d5-9906-4926-ba43-5ed0bddccb4b tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:54.096068 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f671d8d5-9906-4926-ba43-5ed0bddccb4b tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:54.100055 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f671d8d5-9906-4926-ba43-5ed0bddccb4b tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:54.102063 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f671d8d5-9906-4926-ba43-5ed0bddccb4b tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:54.104099 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f671d8d5-9906-4926-ba43-5ed0bddccb4b tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:54.236913 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-1f2078d1-de5c-4aac-8bde-8650815f8d9b tempest-AggregatesAdminNegativeTestJSON-1326539754 tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates/12/action" status: 200 len: 228 microversion: 2.1 time: 0.342506 Sep 14 08:48:54.238450 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 141/302] 10.222.0.60 () {60 vars in 1194 bytes} [Wed Sep 14 08:48:53 2022] POST /compute/v2.1/os-aggregates/12/action => generated 228 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 08:48:54.243576 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-493066e4-e044-40ca-8f8b-6c191e6a2606 tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:54.253522 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-493066e4-e044-40ca-8f8b-6c191e6a2606 tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] HTTP exception thrown: Aggregate 13 could not be found. Sep 14 08:48:54.255546 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-493066e4-e044-40ca-8f8b-6c191e6a2606 tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] Request method failure captured: Sep 14 08:48:54.255546 n-d-836830-18 devstack@n-api.service[128758]: request: GET /compute/v2.1/os-aggregates/13 HTTP/1.1 Sep 14 08:48:54.255546 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 08:48:54.255546 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 08:48:54.255546 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 08:48:54.255546 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 08:48:54.255546 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 08:48:54.255546 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 08:48:54.255546 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 08:48:54.255546 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 08:48:54.255546 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZVMCsxQa0GWMFqQ9ixc5CO69vOkNefWba_gWnLdp6fPN93XkluNWaEOQNaZLxlsNI2JIyeQqbLtdMl8gr70Oc-4rsBU5UAtz3yeIGoWmong2fRjIyHyvRbzD8_dL7wdfl5_M6gEPydAS-KHLtCzKWNh0JQvakG97igNe7HdwhBllyM Sep 14 08:48:54.255546 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 08:48:54.255546 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 08:48:54.255546 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 08:48:54.255546 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 08:48:54.255546 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 08:48:54.255546 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 08:48:54.255546 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 60c8dcd631bd42899cd1934122307693 Sep 14 08:48:54.255546 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-AggregatesAdminTestJSON-983748748 Sep 14 08:48:54.255546 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member,admin Sep 14 08:48:54.255546 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member,admin Sep 14 08:48:54.257179 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/60c8dcd631bd42899cd1934122307693"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_60c8dcd631bd42899cd1934122307693"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/60c8dcd631bd42899cd1934122307693"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/60c8dcd631bd42899cd1934122307693"}]}] Sep 14 08:48:54.257179 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-AggregatesAdminTestJSON-983748748 Sep 14 08:48:54.257179 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 60c8dcd631bd42899cd1934122307693 Sep 14 08:48:54.257179 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-983748748 Sep 14 08:48:54.257179 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-AggregatesAdminTestJSON-983748748-project-admin Sep 14 08:48:54.257179 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 08:48:54.257179 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 08:48:54.257179 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 39850262cecd482b8ff825fade0f84b0 Sep 14 08:48:54.257179 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-AggregatesAdminTestJSON-983748748-project-admin Sep 14 08:48:54.257179 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 08:48:54.257179 n-d-836830-18 devstack@n-api.service[128758]: exception: Aggregate 13 could not be found. Sep 14 08:48:54.257179 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': '13'} Sep 14 08:48:54.257179 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:48:54.258015 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:54.258015 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Sep 14 08:48:54.258015 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Sep 14 08:48:54.258015 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Sep 14 08:48:54.258015 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Sep 14 08:48:54.258015 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 14 08:48:54.258015 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 14 08:48:54.258015 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 14 08:48:54.258015 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 14 08:48:54.258015 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 14 08:48:54.258015 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 14 08:48:54.258015 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 14 08:48:54.258015 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 14 08:48:54.258015 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 13 could not be found. Sep 14 08:48:54.258015 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:54.258015 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:48:54.258015 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:54.258015 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:54.258015 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:48:54.259199 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:48:54.259199 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:48:54.259199 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:48:54.259199 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:48:54.259199 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:48:54.259199 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Sep 14 08:48:54.259199 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 08:48:54.259199 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 13 could not be found. Sep 14 08:48:54.259199 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:54.259199 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:48:54.259199 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:54.259199 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:54.259199 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:48:54.259199 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:48:54.259199 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:48:54.259199 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:48:54.259199 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 13 could not be found. Sep 14 08:48:54.259199 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:54.262236 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-493066e4-e044-40ca-8f8b-6c191e6a2606 tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] Returning 404 to user: Aggregate 13 could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:48:54.264009 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-493066e4-e044-40ca-8f8b-6c191e6a2606 tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] 10.222.0.60 "GET /compute/v2.1/os-aggregates/13" status: 404 len: 78 microversion: 2.1 time: 0.024345 Sep 14 08:48:54.265570 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 142/303] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Sep 14 08:48:54 2022] GET /compute/v2.1/os-aggregates/13 => generated 78 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 14 08:48:54.270177 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-962d28d6-5135-48b6-80c2-bb47a647fd32 tempest-AggregatesAdminNegativeTestJSON-1326539754 tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:54.279678 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:INSERT=7,nova_api:SELECT=82,nova_api:DELETE=11 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:48:54.308145 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-962d28d6-5135-48b6-80c2-bb47a647fd32 tempest-AggregatesAdminNegativeTestJSON-1326539754 tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.041318 Sep 14 08:48:54.308779 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 143/304] 10.222.0.60 () {58 vars in 1155 bytes} [Wed Sep 14 08:48:54 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 14 08:48:54.314633 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-5fd7755d-b4ff-4faf-a45f-7ee09f2ad9f9 tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:54.341567 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-5fd7755d-b4ff-4faf-a45f-7ee09f2ad9f9 tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] HTTP exception thrown: Aggregate 13 could not be found. Sep 14 08:48:54.345642 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-5fd7755d-b4ff-4faf-a45f-7ee09f2ad9f9 tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] Request method failure captured: Sep 14 08:48:54.345642 n-d-836830-18 devstack@n-api.service[128758]: request: DELETE /compute/v2.1/os-aggregates/13 HTTP/1.1 Sep 14 08:48:54.345642 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 08:48:54.345642 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 08:48:54.345642 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 08:48:54.345642 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 08:48:54.345642 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 08:48:54.345642 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 08:48:54.345642 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 08:48:54.345642 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 08:48:54.345642 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZVMCsxQa0GWMFqQ9ixc5CO69vOkNefWba_gWnLdp6fPN93XkluNWaEOQNaZLxlsNI2JIyeQqbLtdMl8gr70Oc-4rsBU5UAtz3yeIGoWmong2fRjIyHyvRbzD8_dL7wdfl5_M6gEPydAS-KHLtCzKWNh0JQvakG97igNe7HdwhBllyM Sep 14 08:48:54.345642 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 08:48:54.345642 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 08:48:54.345642 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 08:48:54.345642 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 08:48:54.345642 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 08:48:54.345642 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 08:48:54.345642 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 60c8dcd631bd42899cd1934122307693 Sep 14 08:48:54.345642 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-AggregatesAdminTestJSON-983748748 Sep 14 08:48:54.345642 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member,admin Sep 14 08:48:54.345642 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member,admin Sep 14 08:48:54.347099 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/60c8dcd631bd42899cd1934122307693"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_60c8dcd631bd42899cd1934122307693"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/60c8dcd631bd42899cd1934122307693"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/60c8dcd631bd42899cd1934122307693"}]}] Sep 14 08:48:54.347099 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-AggregatesAdminTestJSON-983748748 Sep 14 08:48:54.347099 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 60c8dcd631bd42899cd1934122307693 Sep 14 08:48:54.347099 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-983748748 Sep 14 08:48:54.347099 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-AggregatesAdminTestJSON-983748748-project-admin Sep 14 08:48:54.347099 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 08:48:54.347099 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 08:48:54.347099 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 39850262cecd482b8ff825fade0f84b0 Sep 14 08:48:54.347099 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-AggregatesAdminTestJSON-983748748-project-admin Sep 14 08:48:54.347099 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 08:48:54.347099 n-d-836830-18 devstack@n-api.service[128758]: exception: Aggregate 13 could not be found. Sep 14 08:48:54.347099 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': '13'} Sep 14 08:48:54.347099 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:48:54.347962 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:54.347962 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Sep 14 08:48:54.347962 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Sep 14 08:48:54.347962 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 14 08:48:54.347962 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 14 08:48:54.347962 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 14 08:48:54.347962 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 14 08:48:54.347962 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 14 08:48:54.347962 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise self.value Sep 14 08:48:54.347962 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 14 08:48:54.347962 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 14 08:48:54.347962 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Sep 14 08:48:54.347962 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Sep 14 08:48:54.347962 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 14 08:48:54.347962 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 14 08:48:54.347962 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 14 08:48:54.347962 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 14 08:48:54.347962 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 14 08:48:54.347962 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 14 08:48:54.349138 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 14 08:48:54.349138 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 14 08:48:54.349138 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 13 could not be found. Sep 14 08:48:54.349138 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:54.349138 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:48:54.349138 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:54.349138 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:54.349138 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:48:54.349138 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:48:54.349138 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:48:54.349138 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:48:54.349138 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:48:54.349138 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:48:54.349138 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Sep 14 08:48:54.349138 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 08:48:54.349138 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 13 could not be found. Sep 14 08:48:54.349138 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:54.349138 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:48:54.349138 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:54.349138 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:54.349138 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:48:54.350490 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:48:54.350490 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:48:54.350490 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:48:54.350490 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 13 could not be found. Sep 14 08:48:54.350490 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:54.351664 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-5fd7755d-b4ff-4faf-a45f-7ee09f2ad9f9 tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] Returning 404 to user: Aggregate 13 could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:48:54.352656 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-5fd7755d-b4ff-4faf-a45f-7ee09f2ad9f9 tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-aggregates/13" status: 404 len: 78 microversion: 2.1 time: 0.042307 Sep 14 08:48:54.353686 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 144/305] 10.222.0.60 () {58 vars in 1155 bytes} [Wed Sep 14 08:48:54 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 78 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 14 08:48:54.358914 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-e67c8d6b-9cbe-40cf-9f30-9f383ff7d80c tempest-AggregatesAdminNegativeTestJSON-1326539754 tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1341246880"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:48:54.362856 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.objects.aggregate [None req-e67c8d6b-9cbe-40cf-9f30-9f383ff7d80c tempest-AggregatesAdminNegativeTestJSON-1326539754 tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin] Generated uuid 9da96da8-ac09-4c02-920c-505a7adfca4a for aggregate {{(pid=128758) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 14 08:48:54.393577 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-e67c8d6b-9cbe-40cf-9f30-9f383ff7d80c tempest-AggregatesAdminNegativeTestJSON-1326539754 tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.038586 Sep 14 08:48:54.394985 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 145/306] 10.222.0.60 () {60 vars in 1164 bytes} [Wed Sep 14 08:48:54 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:48:54.400018 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a2e9d0a9-6325-4b88-b159-cf80ac585ff4 tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2002462931"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:48:54.405364 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.objects.aggregate [None req-a2e9d0a9-6325-4b88-b159-cf80ac585ff4 tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] Generated uuid b4ad0f34-0be9-4aad-a366-22d33527161a for aggregate {{(pid=128758) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 14 08:48:54.440438 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-a2e9d0a9-6325-4b88-b159-cf80ac585ff4 tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.044171 Sep 14 08:48:54.441805 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 146/307] 10.222.0.60 () {60 vars in 1164 bytes} [Wed Sep 14 08:48:54 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:48:54.446455 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-e7ee6473-be4d-4206-86f3-3428fa0a3764 tempest-AggregatesAdminNegativeTestJSON-1326539754 tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:48:54.461172 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e7ee6473-be4d-4206-86f3-3428fa0a3764 tempest-AggregatesAdminNegativeTestJSON-1326539754 tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:54.461645 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e7ee6473-be4d-4206-86f3-3428fa0a3764 tempest-AggregatesAdminNegativeTestJSON-1326539754 tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:54.463639 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e7ee6473-be4d-4206-86f3-3428fa0a3764 tempest-AggregatesAdminNegativeTestJSON-1326539754 tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:54.475828 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e7ee6473-be4d-4206-86f3-3428fa0a3764 tempest-AggregatesAdminNegativeTestJSON-1326539754 tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:54.477600 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e7ee6473-be4d-4206-86f3-3428fa0a3764 tempest-AggregatesAdminNegativeTestJSON-1326539754 tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:54.478662 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e7ee6473-be4d-4206-86f3-3428fa0a3764 tempest-AggregatesAdminNegativeTestJSON-1326539754 tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:54.479476 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f671d8d5-9906-4926-ba43-5ed0bddccb4b tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:48:54.489885 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f671d8d5-9906-4926-ba43-5ed0bddccb4b tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/0a331816-6b06-40c9-a557-eada274501b5" status: 200 len: 1460 microversion: 2.1 time: 0.441259 Sep 14 08:48:54.490430 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 162/308] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:48:54 2022] GET /compute/v2.1/servers/0a331816-6b06-40c9-a557-eada274501b5 => generated 1460 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:48:54.494748 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.compute.aggregates [None req-e7ee6473-be4d-4206-86f3-3428fa0a3764 tempest-AggregatesAdminNegativeTestJSON-1326539754 tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin] Failed to remove host nonexist_host from aggregate 14. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Sep 14 08:48:54.495275 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f1665c66-1df6-4ae6-8ccd-a214202a21c1 tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:54.495690 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-e7ee6473-be4d-4206-86f3-3428fa0a3764 tempest-AggregatesAdminNegativeTestJSON-1326539754 tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 14 Sep 14 08:48:54.498673 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-e7ee6473-be4d-4206-86f3-3428fa0a3764 tempest-AggregatesAdminNegativeTestJSON-1326539754 tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin] Request method failure captured: Sep 14 08:48:54.498673 n-d-836830-18 devstack@n-api.service[128758]: request: POST /compute/v2.1/os-aggregates/14/action HTTP/1.1 Sep 14 08:48:54.498673 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 08:48:54.498673 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 08:48:54.498673 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 08:48:54.498673 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 42 Sep 14 08:48:54.498673 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 08:48:54.498673 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 08:48:54.498673 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 08:48:54.498673 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 08:48:54.498673 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZVLmJ15KWpFzwjBk89mbkB4PfDNCzydgt68AeYqIMFil0sHzz7mUG2-TKeV_gXm_nnH_yPYhyWGcM4Cw8PvI6ZS_hRqRPaEAvLYHlgIjjWnxMMEh7qOnYV_USVH61vMihtYmSwUuF5ovmHMApqYsssL_HzfV3qjmWGd4yKm2NPPigs Sep 14 08:48:54.498673 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 08:48:54.498673 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 08:48:54.498673 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 08:48:54.498673 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 08:48:54.498673 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 08:48:54.498673 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 08:48:54.498673 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: eb497d14a0394c9486c4682b72a08767 Sep 14 08:48:54.498673 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1326539754 Sep 14 08:48:54.498673 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member,admin Sep 14 08:48:54.498673 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member,admin Sep 14 08:48:54.499951 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/eb497d14a0394c9486c4682b72a08767"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_eb497d14a0394c9486c4682b72a08767"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/eb497d14a0394c9486c4682b72a08767"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/eb497d14a0394c9486c4682b72a08767"}]}] Sep 14 08:48:54.499951 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1326539754 Sep 14 08:48:54.499951 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: eb497d14a0394c9486c4682b72a08767 Sep 14 08:48:54.499951 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1326539754 Sep 14 08:48:54.499951 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin Sep 14 08:48:54.499951 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 08:48:54.499951 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 08:48:54.499951 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 4452ad4c9bf2454f833c2a552ab32b8c Sep 14 08:48:54.499951 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin Sep 14 08:48:54.499951 n-d-836830-18 devstack@n-api.service[128758]: Sep 14 08:48:54.499951 n-d-836830-18 devstack@n-api.service[128758]: {"remove_host": {"host": "nonexist_host"}} Sep 14 08:48:54.499951 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 08:48:54.499951 n-d-836830-18 devstack@n-api.service[128758]: exception: Cannot remove host nonexist_host in aggregate 14 Sep 14 08:48:54.500946 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': '14', 'body': {'remove_host': {'host': 'nonexist_host'}}} Sep 14 08:48:54.500946 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:48:54.500946 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:54.500946 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Sep 14 08:48:54.500946 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Sep 14 08:48:54.500946 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 14 08:48:54.500946 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 14 08:48:54.500946 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 14 08:48:54.500946 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 14 08:48:54.500946 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 14 08:48:54.500946 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 14 08:48:54.500946 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 14 08:48:54.500946 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 14 08:48:54.500946 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Sep 14 08:48:54.500946 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:54.500946 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:48:54.500946 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:54.500946 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:54.500946 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Sep 14 08:48:54.500946 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Sep 14 08:48:54.502062 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Sep 14 08:48:54.502062 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Sep 14 08:48:54.502062 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Sep 14 08:48:54.502062 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:54.502062 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:48:54.502062 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:54.502062 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:54.502062 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Sep 14 08:48:54.502062 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Sep 14 08:48:54.502062 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 14 08:48:54.502062 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 14 08:48:54.502062 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 14 08:48:54.502062 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 14 08:48:54.502062 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 14 08:48:54.502062 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise self.value Sep 14 08:48:54.502062 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 14 08:48:54.502062 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 14 08:48:54.502062 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6683, in remove_host_from_aggregate Sep 14 08:48:54.502062 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Sep 14 08:48:54.502062 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Sep 14 08:48:54.503919 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Sep 14 08:48:54.503919 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Sep 14 08:48:54.503919 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:54.503919 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:48:54.503919 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:54.503919 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:54.503919 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:48:54.503919 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:48:54.503919 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:48:54.503919 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:48:54.503919 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:48:54.503919 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:48:54.503919 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 08:48:54.503919 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 08:48:54.503919 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Sep 14 08:48:54.503919 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 14 08:48:54.503919 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 14 Sep 14 08:48:54.503919 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:54.503919 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:48:54.503919 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:54.503919 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:54.505843 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:48:54.505843 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:48:54.505843 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:48:54.505843 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:48:54.505843 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 14 Sep 14 08:48:54.505843 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:48:54.508196 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-e7ee6473-be4d-4206-86f3-3428fa0a3764 tempest-AggregatesAdminNegativeTestJSON-1326539754 tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 14 {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:48:54.509304 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-e7ee6473-be4d-4206-86f3-3428fa0a3764 tempest-AggregatesAdminNegativeTestJSON-1326539754 tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates/14/action" status: 404 len: 94 microversion: 2.1 time: 0.066426 Sep 14 08:48:54.515268 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 147/309] 10.222.0.60 () {60 vars in 1194 bytes} [Wed Sep 14 08:48:54 2022] POST /compute/v2.1/os-aggregates/14/action => generated 94 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 14 08:48:54.519144 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f1665c66-1df6-4ae6-8ccd-a214202a21c1 tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] 10.222.0.60 "GET /compute/v2.1/os-aggregates/15" status: 200 len: 228 microversion: 2.1 time: 0.027329 Sep 14 08:48:54.519795 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 163/310] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Sep 14 08:48:54 2022] GET /compute/v2.1/os-aggregates/15 => generated 228 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:48:54.535370 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-2cc95ff8-2fad-45b9-9970-a3fb2e066fc8 tempest-AggregatesAdminNegativeTestJSON-1326539754 tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:54.542359 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:DELETE=9,nova_api:SELECT=85,nova_api:INSERT=6 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:48:54.578037 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-2cc95ff8-2fad-45b9-9970-a3fb2e066fc8 tempest-AggregatesAdminNegativeTestJSON-1326539754 tempest-AggregatesAdminNegativeTestJSON-1326539754-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.047379 Sep 14 08:48:54.578877 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 164/311] 10.222.0.60 () {58 vars in 1155 bytes} [Wed Sep 14 08:48:54 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 14 08:48:54.597430 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-0729dc67-90ff-4445-852d-d36a0917eaad tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:48:54.658316 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-0729dc67-90ff-4445-852d-d36a0917eaad tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates/15/action" status: 200 len: 266 microversion: 2.1 time: 0.077292 Sep 14 08:48:54.665377 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 165/312] 10.222.0.60 () {60 vars in 1194 bytes} [Wed Sep 14 08:48:54 2022] POST /compute/v2.1/os-aggregates/15/action => generated 266 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:48:54.665377 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-2ea3ac44-85ec-4688-9ca8-0ff9974c7994 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:54.666783 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-2ea3ac44-85ec-4688-9ca8-0ff9974c7994 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] [instance: 17179827-7f78-4a3b-8eaa-766c5fa2b698] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:48:54.673449 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2ea3ac44-85ec-4688-9ca8-0ff9974c7994 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:54.674054 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2ea3ac44-85ec-4688-9ca8-0ff9974c7994 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:54.674503 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2ea3ac44-85ec-4688-9ca8-0ff9974c7994 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:54.675358 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2ea3ac44-85ec-4688-9ca8-0ff9974c7994 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:54.675996 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2ea3ac44-85ec-4688-9ca8-0ff9974c7994 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:54.676963 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2ea3ac44-85ec-4688-9ca8-0ff9974c7994 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:54.853509 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-2ea3ac44-85ec-4688-9ca8-0ff9974c7994 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e462483415e4c2b8a917b2a032e5ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac4d0cae0bd46fda94d7bfb900a0b9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:48:54.866559 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-2ea3ac44-85ec-4688-9ca8-0ff9974c7994 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] 10.222.0.60 "GET /compute/v2.1/servers/17179827-7f78-4a3b-8eaa-766c5fa2b698" status: 200 len: 1320 microversion: 2.1 time: 0.206293 Sep 14 08:48:54.867570 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 166/313] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:48:54 2022] GET /compute/v2.1/servers/17179827-7f78-4a3b-8eaa-766c5fa2b698 => generated 1320 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:48:54.955160 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-be414c61-9805-42b1-b677-8d0748184dd7 tempest-MigrationsAdminTest-1443382137 tempest-MigrationsAdminTest-1443382137-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:54.956422 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-be414c61-9805-42b1-b677-8d0748184dd7 tempest-MigrationsAdminTest-1443382137 tempest-MigrationsAdminTest-1443382137-project-admin] [instance: 0a331816-6b06-40c9-a557-eada274501b5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:48:54.964824 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-be414c61-9805-42b1-b677-8d0748184dd7 tempest-MigrationsAdminTest-1443382137 tempest-MigrationsAdminTest-1443382137-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:54.965555 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-be414c61-9805-42b1-b677-8d0748184dd7 tempest-MigrationsAdminTest-1443382137 tempest-MigrationsAdminTest-1443382137-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:54.966204 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-be414c61-9805-42b1-b677-8d0748184dd7 tempest-MigrationsAdminTest-1443382137 tempest-MigrationsAdminTest-1443382137-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:54.967090 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-be414c61-9805-42b1-b677-8d0748184dd7 tempest-MigrationsAdminTest-1443382137 tempest-MigrationsAdminTest-1443382137-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:54.967706 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-be414c61-9805-42b1-b677-8d0748184dd7 tempest-MigrationsAdminTest-1443382137 tempest-MigrationsAdminTest-1443382137-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:54.968284 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-be414c61-9805-42b1-b677-8d0748184dd7 tempest-MigrationsAdminTest-1443382137 tempest-MigrationsAdminTest-1443382137-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:55.164052 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d6e14303-d12a-4bf5-b654-e09cc1c4f466 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-401627894", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:48:55.271167 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-be414c61-9805-42b1-b677-8d0748184dd7 tempest-MigrationsAdminTest-1443382137 tempest-MigrationsAdminTest-1443382137-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/0a331816-6b06-40c9-a557-eada274501b5" status: 200 len: 1613 microversion: 2.1 time: 0.754586 Sep 14 08:48:55.271750 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 148/314] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:48:54 2022] GET /compute/v2.1/servers/0a331816-6b06-40c9-a557-eada274501b5 => generated 1613 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:48:55.279755 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.network.neutron [None req-d6e14303-d12a-4bf5-b654-e09cc1c4f466 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] validate_networks() for None {{(pid=128759) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 08:48:55.281817 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-fa85dae2-3055-4863-9bbf-e674d8a44950 tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:55.292512 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-fa85dae2-3055-4863-9bbf-e674d8a44950 tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] 10.222.0.60 "GET /compute/v2.1/os-aggregates/15" status: 200 len: 242 microversion: 2.1 time: 0.014661 Sep 14 08:48:55.293145 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 149/315] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Sep 14 08:48:55 2022] GET /compute/v2.1/os-aggregates/15 => generated 242 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:48:55.516779 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-d6e14303-d12a-4bf5-b654-e09cc1c4f466 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Flavor limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 08:48:55.517342 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-d6e14303-d12a-4bf5-b654-e09cc1c4f466 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Image limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 08:48:55.517982 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-d6e14303-d12a-4bf5-b654-e09cc1c4f466 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Flavor pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 08:48:55.519219 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-d6e14303-d12a-4bf5-b654-e09cc1c4f466 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Image pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 08:48:55.519958 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-d6e14303-d12a-4bf5-b654-e09cc1c4f466 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 08:48:55.529574 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d6e14303-d12a-4bf5-b654-e09cc1c4f466 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:55.530261 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d6e14303-d12a-4bf5-b654-e09cc1c4f466 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:55.530846 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d6e14303-d12a-4bf5-b654-e09cc1c4f466 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:55.531597 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d6e14303-d12a-4bf5-b654-e09cc1c4f466 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:55.532195 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d6e14303-d12a-4bf5-b654-e09cc1c4f466 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:55.532760 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d6e14303-d12a-4bf5-b654-e09cc1c4f466 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:55.553171 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-d6e14303-d12a-4bf5-b654-e09cc1c4f466 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Getting quotas for project 4300dd934369461b9b6ef556246bfc53. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 08:48:55.560683 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-d6e14303-d12a-4bf5-b654-e09cc1c4f466 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Getting quotas for user 9e2ee35c4791437c83193357b4085128 and project 4300dd934369461b9b6ef556246bfc53. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 08:48:55.585335 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-d6e14303-d12a-4bf5-b654-e09cc1c4f466 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Going to run 1 instances... {{(pid=128759) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 08:48:55.587653 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-d6e14303-d12a-4bf5-b654-e09cc1c4f466 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] [instance: 22688a6e-8420-49de-b5b7-7368ed55d8da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128759) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 08:48:55.656112 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d6e14303-d12a-4bf5-b654-e09cc1c4f466 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.785520 Sep 14 08:48:55.657229 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 167/316] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 08:48:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 789 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 08:48:55.679074 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-028d7ca6-a446-4621-b15c-4f82a88d3d97 tempest-MigrationsAdminTest-1443382137 tempest-MigrationsAdminTest-1443382137-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:48:55.682608 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-028d7ca6-a446-4621-b15c-4f82a88d3d97 tempest-MigrationsAdminTest-1443382137 tempest-MigrationsAdminTest-1443382137-project-admin] [instance: 0a331816-6b06-40c9-a557-eada274501b5] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:48:55.696263 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-028d7ca6-a446-4621-b15c-4f82a88d3d97 tempest-MigrationsAdminTest-1443382137 tempest-MigrationsAdminTest-1443382137-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:55.696766 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-028d7ca6-a446-4621-b15c-4f82a88d3d97 tempest-MigrationsAdminTest-1443382137 tempest-MigrationsAdminTest-1443382137-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:55.697209 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-028d7ca6-a446-4621-b15c-4f82a88d3d97 tempest-MigrationsAdminTest-1443382137 tempest-MigrationsAdminTest-1443382137-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:55.697920 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-028d7ca6-a446-4621-b15c-4f82a88d3d97 tempest-MigrationsAdminTest-1443382137 tempest-MigrationsAdminTest-1443382137-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:55.698378 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-028d7ca6-a446-4621-b15c-4f82a88d3d97 tempest-MigrationsAdminTest-1443382137 tempest-MigrationsAdminTest-1443382137-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:55.698807 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-028d7ca6-a446-4621-b15c-4f82a88d3d97 tempest-MigrationsAdminTest-1443382137 tempest-MigrationsAdminTest-1443382137-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:55.768900 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-98615777-883e-4a7f-b416-2883ab299040 tempest-QuotasAdminTestV257-325339548 tempest-QuotasAdminTestV257-325339548-project-admin] Action: 'update', calling method: .version_select at 0x7f7d44d7b0d0>, body: {"quota_set": {"ram": "5120"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:48:56.129438 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-98615777-883e-4a7f-b416-2883ab299040 tempest-QuotasAdminTestV257-325339548 tempest-QuotasAdminTestV257-325339548-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:56.130119 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-98615777-883e-4a7f-b416-2883ab299040 tempest-QuotasAdminTestV257-325339548 tempest-QuotasAdminTestV257-325339548-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:56.130875 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-98615777-883e-4a7f-b416-2883ab299040 tempest-QuotasAdminTestV257-325339548 tempest-QuotasAdminTestV257-325339548-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:56.131903 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-98615777-883e-4a7f-b416-2883ab299040 tempest-QuotasAdminTestV257-325339548 tempest-QuotasAdminTestV257-325339548-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:56.132511 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-98615777-883e-4a7f-b416-2883ab299040 tempest-QuotasAdminTestV257-325339548 tempest-QuotasAdminTestV257-325339548-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:56.133110 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-98615777-883e-4a7f-b416-2883ab299040 tempest-QuotasAdminTestV257-325339548 tempest-QuotasAdminTestV257-325339548-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:56.203790 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-98615777-883e-4a7f-b416-2883ab299040 tempest-QuotasAdminTestV257-325339548 tempest-QuotasAdminTestV257-325339548-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-quota-sets/69e2141a187649e4931c079e441c1424" status: 200 len: 148 microversion: 2.57 time: 0.908997 Sep 14 08:48:56.205608 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 150/317] 10.222.0.60 () {62 vars in 1303 bytes} [Wed Sep 14 08:48:55 2022] PUT /compute/v2.1/os-quota-sets/69e2141a187649e4931c079e441c1424 => generated 148 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 08:48:56.211887 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-7874886e-a6e4-4359-90a5-7026cd1f8d8c tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:56.249665 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-7874886e-a6e4-4359-90a5-7026cd1f8d8c tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.042120 Sep 14 08:48:56.254737 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 151/318] 10.222.0.60 () {58 vars in 1155 bytes} [Wed Sep 14 08:48:56 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 14 08:48:56.259904 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-0d70b0e0-2b1c-4442-b6b1-2b29e990f963 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:56.260664 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-0d70b0e0-2b1c-4442-b6b1-2b29e990f963 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] [instance: 22688a6e-8420-49de-b5b7-7368ed55d8da] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:48:56.365464 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-0d70b0e0-2b1c-4442-b6b1-2b29e990f963 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2ee35c4791437c83193357b4085128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4300dd934369461b9b6ef556246bfc53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:48:56.373145 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-0d70b0e0-2b1c-4442-b6b1-2b29e990f963 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] 10.222.0.60 "GET /compute/v2.1/servers/22688a6e-8420-49de-b5b7-7368ed55d8da" status: 200 len: 1218 microversion: 2.1 time: 0.117219 Sep 14 08:48:56.387148 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 152/319] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:48:56 2022] GET /compute/v2.1/servers/22688a6e-8420-49de-b5b7-7368ed55d8da => generated 1218 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:48:56.392124 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-028d7ca6-a446-4621-b15c-4f82a88d3d97 tempest-MigrationsAdminTest-1443382137 tempest-MigrationsAdminTest-1443382137-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '18b58b52cd8843628ba2ba791b030943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46b97c8b36a4f30a38a14e4a5eb8f67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:48:56.392716 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-028d7ca6-a446-4621-b15c-4f82a88d3d97 tempest-MigrationsAdminTest-1443382137 tempest-MigrationsAdminTest-1443382137-project-admin] [instance: 0a331816-6b06-40c9-a557-eada274501b5] flavor_id is None. Assuming migration. {{(pid=128759) resize /opt/stack/nova/nova/compute/api.py:4196}} Sep 14 08:48:56.393344 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-028d7ca6-a446-4621-b15c-4f82a88d3d97 tempest-MigrationsAdminTest-1443382137 tempest-MigrationsAdminTest-1443382137-project-admin] [instance: 0a331816-6b06-40c9-a557-eada274501b5] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=128759) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 14 08:48:56.394053 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-9a484047-6542-4ed9-bd0b-a3d73b94a16a tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:56.394755 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-9a484047-6542-4ed9-bd0b-a3d73b94a16a tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] [instance: 17179827-7f78-4a3b-8eaa-766c5fa2b698] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:48:56.400888 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9a484047-6542-4ed9-bd0b-a3d73b94a16a tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:56.401543 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9a484047-6542-4ed9-bd0b-a3d73b94a16a tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:56.402132 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9a484047-6542-4ed9-bd0b-a3d73b94a16a tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:56.403038 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9a484047-6542-4ed9-bd0b-a3d73b94a16a tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:56.404227 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9a484047-6542-4ed9-bd0b-a3d73b94a16a tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:56.404968 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9a484047-6542-4ed9-bd0b-a3d73b94a16a tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:56.618301 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-028d7ca6-a446-4621-b15c-4f82a88d3d97 tempest-MigrationsAdminTest-1443382137 tempest-MigrationsAdminTest-1443382137-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/0a331816-6b06-40c9-a557-eada274501b5/action" status: 202 len: 0 microversion: 2.1 time: 0.952460 Sep 14 08:48:56.623579 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 168/320] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 08:48:55 2022] POST /compute/v2.1/servers/0a331816-6b06-40c9-a557-eada274501b5/action => generated 0 bytes in 966 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 08:48:56.630652 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-231b919b-4a98-40b0-88a8-3eed1c2dc6f1 tempest-QuotasAdminTestV257-325339548 tempest-QuotasAdminTestV257-325339548-project-admin] Calling method '.version_select at 0x7f7d44f01d30>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:56.775982 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-9a484047-6542-4ed9-bd0b-a3d73b94a16a tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e462483415e4c2b8a917b2a032e5ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac4d0cae0bd46fda94d7bfb900a0b9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:48:56.786193 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-9a484047-6542-4ed9-bd0b-a3d73b94a16a tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] 10.222.0.60 "GET /compute/v2.1/servers/17179827-7f78-4a3b-8eaa-766c5fa2b698" status: 200 len: 1320 microversion: 2.1 time: 0.397365 Sep 14 08:48:56.790199 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 153/321] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:48:56 2022] GET /compute/v2.1/servers/17179827-7f78-4a3b-8eaa-766c5fa2b698 => generated 1320 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:48:56.801135 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-42220645-ac2a-4d30-9093-5ca3d47fdea6 tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1319737937", "availability_zone": "tempest-test_az-855043174"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:48:56.844118 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.objects.aggregate [None req-42220645-ac2a-4d30-9093-5ca3d47fdea6 tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] Generated uuid 76a7c6b3-d98e-4766-8482-6af329fb67d1 for aggregate {{(pid=128758) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 14 08:48:56.882361 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-42220645-ac2a-4d30-9093-5ca3d47fdea6 tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.090517 Sep 14 08:48:56.883422 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 154/322] 10.222.0.60 () {60 vars in 1165 bytes} [Wed Sep 14 08:48:56 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:48:56.890439 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-39fca115-2d35-4356-aee4-b60bbdca8c66 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:56.891947 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-39fca115-2d35-4356-aee4-b60bbdca8c66 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: 0a331816-6b06-40c9-a557-eada274501b5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:48:56.901268 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-39fca115-2d35-4356-aee4-b60bbdca8c66 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:56.901850 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-39fca115-2d35-4356-aee4-b60bbdca8c66 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:56.902280 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-39fca115-2d35-4356-aee4-b60bbdca8c66 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:56.903018 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-39fca115-2d35-4356-aee4-b60bbdca8c66 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:56.904192 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-39fca115-2d35-4356-aee4-b60bbdca8c66 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:56.905008 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-39fca115-2d35-4356-aee4-b60bbdca8c66 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:56.978347 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-231b919b-4a98-40b0-88a8-3eed1c2dc6f1 tempest-QuotasAdminTestV257-325339548 tempest-QuotasAdminTestV257-325339548-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:56.979166 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-231b919b-4a98-40b0-88a8-3eed1c2dc6f1 tempest-QuotasAdminTestV257-325339548 tempest-QuotasAdminTestV257-325339548-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:56.979606 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-231b919b-4a98-40b0-88a8-3eed1c2dc6f1 tempest-QuotasAdminTestV257-325339548 tempest-QuotasAdminTestV257-325339548-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:56.980638 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-231b919b-4a98-40b0-88a8-3eed1c2dc6f1 tempest-QuotasAdminTestV257-325339548 tempest-QuotasAdminTestV257-325339548-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:56.981472 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-231b919b-4a98-40b0-88a8-3eed1c2dc6f1 tempest-QuotasAdminTestV257-325339548 tempest-QuotasAdminTestV257-325339548-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:56.982271 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-231b919b-4a98-40b0-88a8-3eed1c2dc6f1 tempest-QuotasAdminTestV257-325339548 tempest-QuotasAdminTestV257-325339548-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:57.009200 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-231b919b-4a98-40b0-88a8-3eed1c2dc6f1 tempest-QuotasAdminTestV257-325339548 tempest-QuotasAdminTestV257-325339548-project-admin] 10.222.0.60 "GET /compute/v2.1/os-quota-sets/69e2141a187649e4931c079e441c1424/detail" status: 200 len: 463 microversion: 2.57 time: 0.382572 Sep 14 08:48:57.010306 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 169/323] 10.222.0.60 () {60 vars in 1304 bytes} [Wed Sep 14 08:48:56 2022] GET /compute/v2.1/os-quota-sets/69e2141a187649e4931c079e441c1424/detail => generated 463 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 08:48:57.017182 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-0acb4e44-891c-424a-a055-0eed09d6f711 tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1319737937_new", "availability_zone": "tempest-test_az-855043174_new"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:48:57.077638 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-39fca115-2d35-4356-aee4-b60bbdca8c66 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:48:57.087081 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-39fca115-2d35-4356-aee4-b60bbdca8c66 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/0a331816-6b06-40c9-a557-eada274501b5" status: 200 len: 1469 microversion: 2.1 time: 0.202032 Sep 14 08:48:57.087852 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 155/324] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:48:56 2022] GET /compute/v2.1/servers/0a331816-6b06-40c9-a557-eada274501b5 => generated 1469 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:48:57.150727 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0acb4e44-891c-424a-a055-0eed09d6f711 tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:57.151251 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0acb4e44-891c-424a-a055-0eed09d6f711 tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:57.152453 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0acb4e44-891c-424a-a055-0eed09d6f711 tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:57.193883 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-0acb4e44-891c-424a-a055-0eed09d6f711 tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-aggregates/16" status: 200 len: 335 microversion: 2.1 time: 0.181111 Sep 14 08:48:57.195258 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 170/325] 10.222.0.60 () {60 vars in 1173 bytes} [Wed Sep 14 08:48:57 2022] PUT /compute/v2.1/os-aggregates/16 => generated 335 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:48:57.206619 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-90b7bf23-da2e-4ace-8e9d-cd3353ac4588 tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:57.220500 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-90b7bf23-da2e-4ace-8e9d-cd3353ac4588 tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] 10.222.0.60 "GET /compute/v2.1/os-aggregates" status: 200 len: 338 microversion: 2.1 time: 0.017046 Sep 14 08:48:57.221060 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 156/326] 10.222.0.60 () {58 vars in 1143 bytes} [Wed Sep 14 08:48:57 2022] GET /compute/v2.1/os-aggregates => generated 338 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:48:57.233557 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-81eeb84c-b168-4b20-a902-737d4cc93b45 tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:57.257693 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-81eeb84c-b168-4b20-a902-737d4cc93b45 tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.027668 Sep 14 08:48:57.258558 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 171/327] 10.222.0.60 () {58 vars in 1155 bytes} [Wed Sep 14 08:48:57 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 14 08:48:57.270333 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-93482b5d-8945-4bc3-993d-bf08f62a6a68 tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1240471200"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:48:57.273674 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.objects.aggregate [None req-93482b5d-8945-4bc3-993d-bf08f62a6a68 tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] Generated uuid a5bbe9a5-a01a-4736-b073-e764d84dc3bb for aggregate {{(pid=128758) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 14 08:48:57.315881 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-93482b5d-8945-4bc3-993d-bf08f62a6a68 tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.049049 Sep 14 08:48:57.316947 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 157/328] 10.222.0.60 () {60 vars in 1164 bytes} [Wed Sep 14 08:48:57 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:48:57.328523 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d1e8846e-8ade-4525-a48c-5789e30676ab tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:57.337098 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d1e8846e-8ade-4525-a48c-5789e30676ab tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] 10.222.0.60 "GET /compute/v2.1/os-aggregates" status: 200 len: 231 microversion: 2.1 time: 0.012513 Sep 14 08:48:57.337928 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 172/329] 10.222.0.60 () {58 vars in 1143 bytes} [Wed Sep 14 08:48:57 2022] GET /compute/v2.1/os-aggregates => generated 231 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:48:57.352183 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-9c6b376f-872a-47b6-a35d-7e5e8ccb510c tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:57.377510 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-9c6b376f-872a-47b6-a35d-7e5e8ccb510c tempest-AggregatesAdminTestJSON-983748748 tempest-AggregatesAdminTestJSON-983748748-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.030863 Sep 14 08:48:57.378914 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 158/330] 10.222.0.60 () {58 vars in 1155 bytes} [Wed Sep 14 08:48:57 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Sep 14 08:48:57.388398 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-6310b1e3-3adb-455c-b416-a9313621bd97 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:57.389713 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-6310b1e3-3adb-455c-b416-a9313621bd97 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] [instance: ef72dfda-b1e4-49c6-8830-33d25f6a4ec0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:48:57.407581 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6310b1e3-3adb-455c-b416-a9313621bd97 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:57.408956 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6310b1e3-3adb-455c-b416-a9313621bd97 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:57.410842 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6310b1e3-3adb-455c-b416-a9313621bd97 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:57.411994 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6310b1e3-3adb-455c-b416-a9313621bd97 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:57.412154 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-8ee8bd4e-8d6a-4152-bd36-a5bceaaf0f9f tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:57.412918 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-8ee8bd4e-8d6a-4152-bd36-a5bceaaf0f9f tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] [instance: 22688a6e-8420-49de-b5b7-7368ed55d8da] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:48:57.413527 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6310b1e3-3adb-455c-b416-a9313621bd97 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:57.416120 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6310b1e3-3adb-455c-b416-a9313621bd97 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:57.429896 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8ee8bd4e-8d6a-4152-bd36-a5bceaaf0f9f tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:57.430889 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8ee8bd4e-8d6a-4152-bd36-a5bceaaf0f9f tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:57.432300 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8ee8bd4e-8d6a-4152-bd36-a5bceaaf0f9f tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:57.434046 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8ee8bd4e-8d6a-4152-bd36-a5bceaaf0f9f tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:57.435524 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8ee8bd4e-8d6a-4152-bd36-a5bceaaf0f9f tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:57.436111 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8ee8bd4e-8d6a-4152-bd36-a5bceaaf0f9f tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:57.462468 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-6310b1e3-3adb-455c-b416-a9313621bd97 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] HTTP exception thrown: Instance ef72dfda-b1e4-49c6-8830-33d25f6a4ec0 could not be found. Sep 14 08:48:57.472500 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-6310b1e3-3adb-455c-b416-a9313621bd97 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Request method failure captured: Sep 14 08:48:57.472500 n-d-836830-18 devstack@n-api.service[128759]: request: DELETE /compute/v2.1/servers/ef72dfda-b1e4-49c6-8830-33d25f6a4ec0 HTTP/1.1 Sep 14 08:48:57.472500 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 08:48:57.472500 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 08:48:57.472500 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 08:48:57.472500 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 08:48:57.472500 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 08:48:57.472500 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 08:48:57.472500 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 08:48:57.472500 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 08:48:57.472500 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZVJGVVqXhhmlm6eFocXAtGwTnagCn4FWs17hHc4FkKGNSHKzdU22iNQWweZDh94H01Y2nEEk-SlyKp69X7-9KDN-cHfuYAyVn14GEXC93orxVBNFj4SHBTO6EiWo8McWhQMSnYQkzQS4B2oA2uzcqVr9ndfr0ojMs5ccGd2Qcc-pSM Sep 14 08:48:57.472500 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 08:48:57.472500 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 08:48:57.472500 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 08:48:57.472500 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 08:48:57.472500 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 08:48:57.472500 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 08:48:57.472500 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 2d1553889c474f75bd545166eff212b1 Sep 14 08:48:57.472500 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-AggregatesAdminTestJSON-279239198 Sep 14 08:48:57.472500 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 08:48:57.472500 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 08:48:57.474009 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/2d1553889c474f75bd545166eff212b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_2d1553889c474f75bd545166eff212b1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2d1553889c474f75bd545166eff212b1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2d1553889c474f75bd545166eff212b1"}]}] Sep 14 08:48:57.474009 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-AggregatesAdminTestJSON-279239198 Sep 14 08:48:57.474009 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 2d1553889c474f75bd545166eff212b1 Sep 14 08:48:57.474009 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-279239198 Sep 14 08:48:57.474009 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-AggregatesAdminTestJSON-279239198-project Sep 14 08:48:57.474009 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 08:48:57.474009 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 08:48:57.474009 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 3326618ebc864ba58c6df2c471c0f978 Sep 14 08:48:57.474009 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-AggregatesAdminTestJSON-279239198-project Sep 14 08:48:57.474009 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 08:48:57.474009 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance ef72dfda-b1e4-49c6-8830-33d25f6a4ec0 could not be found. Sep 14 08:48:57.474009 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': 'ef72dfda-b1e4-49c6-8830-33d25f6a4ec0'} Sep 14 08:48:57.474831 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:48:57.474831 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:57.474831 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 08:48:57.474831 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 08:48:57.474831 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 08:48:57.474831 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 08:48:57.474831 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 08:48:57.474831 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 08:48:57.474831 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 08:48:57.474831 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 08:48:57.474831 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef72dfda-b1e4-49c6-8830-33d25f6a4ec0 could not be found. Sep 14 08:48:57.474831 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:48:57.474831 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:48:57.474831 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:48:57.474831 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:57.474831 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:48:57.474831 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:48:57.474831 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:48:57.474831 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:48:57.474831 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:48:57.476204 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:48:57.476204 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 08:48:57.476204 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 08:48:57.476204 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 08:48:57.476204 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 08:48:57.476204 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 08:48:57.476204 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 08:48:57.476204 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 08:48:57.476204 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 08:48:57.476204 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef72dfda-b1e4-49c6-8830-33d25f6a4ec0 could not be found. Sep 14 08:48:57.476204 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:48:57.476204 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:48:57.476204 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:48:57.476204 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:57.476204 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:48:57.476204 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:48:57.476204 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:48:57.476204 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:48:57.476204 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef72dfda-b1e4-49c6-8830-33d25f6a4ec0 could not be found. Sep 14 08:48:57.476204 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:48:57.481179 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-6310b1e3-3adb-455c-b416-a9313621bd97 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Returning 404 to user: Instance ef72dfda-b1e4-49c6-8830-33d25f6a4ec0 could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:48:57.483983 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-6310b1e3-3adb-455c-b416-a9313621bd97 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] 10.222.0.60 "DELETE /compute/v2.1/servers/ef72dfda-b1e4-49c6-8830-33d25f6a4ec0" status: 404 len: 111 microversion: 2.1 time: 0.100287 Sep 14 08:48:57.484559 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 173/331] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 08:48:57 2022] DELETE /compute/v2.1/servers/ef72dfda-b1e4-49c6-8830-33d25f6a4ec0 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 08:48:57.498414 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-0a564ab3-062b-4ab7-a887-95d03cbfb434 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:57.499058 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-0a564ab3-062b-4ab7-a887-95d03cbfb434 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] [instance: ef72dfda-b1e4-49c6-8830-33d25f6a4ec0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:48:57.515189 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0a564ab3-062b-4ab7-a887-95d03cbfb434 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:57.516252 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0a564ab3-062b-4ab7-a887-95d03cbfb434 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:57.517212 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0a564ab3-062b-4ab7-a887-95d03cbfb434 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:57.519499 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0a564ab3-062b-4ab7-a887-95d03cbfb434 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:57.520192 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0a564ab3-062b-4ab7-a887-95d03cbfb434 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:57.520678 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0a564ab3-062b-4ab7-a887-95d03cbfb434 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:57.542583 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-0a564ab3-062b-4ab7-a887-95d03cbfb434 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] HTTP exception thrown: Instance ef72dfda-b1e4-49c6-8830-33d25f6a4ec0 could not be found. Sep 14 08:48:57.547581 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-0a564ab3-062b-4ab7-a887-95d03cbfb434 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Request method failure captured: Sep 14 08:48:57.547581 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/ef72dfda-b1e4-49c6-8830-33d25f6a4ec0 HTTP/1.1 Sep 14 08:48:57.547581 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 08:48:57.547581 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 08:48:57.547581 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 08:48:57.547581 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 08:48:57.547581 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 08:48:57.547581 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 08:48:57.547581 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 08:48:57.547581 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 08:48:57.547581 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZVJGVVqXhhmlm6eFocXAtGwTnagCn4FWs17hHc4FkKGNSHKzdU22iNQWweZDh94H01Y2nEEk-SlyKp69X7-9KDN-cHfuYAyVn14GEXC93orxVBNFj4SHBTO6EiWo8McWhQMSnYQkzQS4B2oA2uzcqVr9ndfr0ojMs5ccGd2Qcc-pSM Sep 14 08:48:57.547581 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 08:48:57.547581 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 08:48:57.547581 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 08:48:57.547581 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 08:48:57.547581 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 08:48:57.547581 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 08:48:57.547581 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 2d1553889c474f75bd545166eff212b1 Sep 14 08:48:57.547581 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-AggregatesAdminTestJSON-279239198 Sep 14 08:48:57.547581 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 08:48:57.547581 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 08:48:57.549578 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/2d1553889c474f75bd545166eff212b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_2d1553889c474f75bd545166eff212b1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2d1553889c474f75bd545166eff212b1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2d1553889c474f75bd545166eff212b1"}]}] Sep 14 08:48:57.549578 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-AggregatesAdminTestJSON-279239198 Sep 14 08:48:57.549578 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 2d1553889c474f75bd545166eff212b1 Sep 14 08:48:57.549578 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-279239198 Sep 14 08:48:57.549578 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-AggregatesAdminTestJSON-279239198-project Sep 14 08:48:57.549578 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 08:48:57.549578 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 08:48:57.549578 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 3326618ebc864ba58c6df2c471c0f978 Sep 14 08:48:57.549578 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-AggregatesAdminTestJSON-279239198-project Sep 14 08:48:57.549578 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 08:48:57.549578 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance ef72dfda-b1e4-49c6-8830-33d25f6a4ec0 could not be found. Sep 14 08:48:57.549578 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': 'ef72dfda-b1e4-49c6-8830-33d25f6a4ec0'} Sep 14 08:48:57.551517 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:48:57.551517 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:57.551517 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 08:48:57.551517 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 08:48:57.551517 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 08:48:57.551517 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 08:48:57.551517 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 08:48:57.551517 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 08:48:57.551517 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 08:48:57.551517 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 08:48:57.551517 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef72dfda-b1e4-49c6-8830-33d25f6a4ec0 could not be found. Sep 14 08:48:57.551517 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:48:57.551517 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:48:57.551517 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:48:57.551517 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:57.551517 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:48:57.551517 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:48:57.551517 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:48:57.551517 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:48:57.551517 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:48:57.552708 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:48:57.552708 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 08:48:57.552708 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 08:48:57.552708 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 08:48:57.552708 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 08:48:57.552708 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 08:48:57.552708 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 08:48:57.552708 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef72dfda-b1e4-49c6-8830-33d25f6a4ec0 could not be found. Sep 14 08:48:57.552708 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:48:57.552708 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:48:57.552708 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:48:57.552708 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:48:57.552708 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:48:57.552708 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:48:57.552708 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:48:57.552708 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:48:57.552708 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef72dfda-b1e4-49c6-8830-33d25f6a4ec0 could not be found. Sep 14 08:48:57.552708 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:48:57.557176 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-0a564ab3-062b-4ab7-a887-95d03cbfb434 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] Returning 404 to user: Instance ef72dfda-b1e4-49c6-8830-33d25f6a4ec0 could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:48:57.558818 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-0a564ab3-062b-4ab7-a887-95d03cbfb434 tempest-AggregatesAdminTestJSON-279239198 tempest-AggregatesAdminTestJSON-279239198-project] 10.222.0.60 "GET /compute/v2.1/servers/ef72dfda-b1e4-49c6-8830-33d25f6a4ec0" status: 404 len: 111 microversion: 2.1 time: 0.066096 Sep 14 08:48:57.560853 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 174/332] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:48:57 2022] GET /compute/v2.1/servers/ef72dfda-b1e4-49c6-8830-33d25f6a4ec0 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 08:48:57.574060 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-8ee8bd4e-8d6a-4152-bd36-a5bceaaf0f9f tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2ee35c4791437c83193357b4085128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4300dd934369461b9b6ef556246bfc53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:48:57.587145 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-8ee8bd4e-8d6a-4152-bd36-a5bceaaf0f9f tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] 10.222.0.60 "GET /compute/v2.1/servers/22688a6e-8420-49de-b5b7-7368ed55d8da" status: 200 len: 1278 microversion: 2.1 time: 0.186785 Sep 14 08:48:57.588841 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 159/333] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:48:57 2022] GET /compute/v2.1/servers/22688a6e-8420-49de-b5b7-7368ed55d8da => generated 1278 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:48:57.813545 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a29e30e6-ff50-4f43-8df8-30d32ab2b6fd tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:57.814319 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-a29e30e6-ff50-4f43-8df8-30d32ab2b6fd tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] [instance: 17179827-7f78-4a3b-8eaa-766c5fa2b698] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:48:57.829236 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a29e30e6-ff50-4f43-8df8-30d32ab2b6fd tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:57.831426 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a29e30e6-ff50-4f43-8df8-30d32ab2b6fd tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:57.834339 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a29e30e6-ff50-4f43-8df8-30d32ab2b6fd tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:57.834740 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a29e30e6-ff50-4f43-8df8-30d32ab2b6fd tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:57.835362 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a29e30e6-ff50-4f43-8df8-30d32ab2b6fd tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:57.836549 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a29e30e6-ff50-4f43-8df8-30d32ab2b6fd tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:57.964908 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-f6c66080-6b79-4a28-aeec-24729c3027af tempest-QuotasAdminTestV257-325339548 tempest-QuotasAdminTestV257-325339548-project-admin] Action: 'update', calling method: .version_select at 0x7f7d44d6c310>, body: {"quota_set": {"ram": "2048"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:48:58.183961 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-a29e30e6-ff50-4f43-8df8-30d32ab2b6fd tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e462483415e4c2b8a917b2a032e5ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac4d0cae0bd46fda94d7bfb900a0b9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:48:58.200930 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a29e30e6-ff50-4f43-8df8-30d32ab2b6fd tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] 10.222.0.60 "GET /compute/v2.1/servers/17179827-7f78-4a3b-8eaa-766c5fa2b698" status: 200 len: 1320 microversion: 2.1 time: 0.387736 Sep 14 08:48:58.201896 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 175/334] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:48:57 2022] GET /compute/v2.1/servers/17179827-7f78-4a3b-8eaa-766c5fa2b698 => generated 1320 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:48:58.221261 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e758b2b4-de15-41e1-9053-5444b66b44a6 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:58.223323 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e758b2b4-de15-41e1-9053-5444b66b44a6 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: 0a331816-6b06-40c9-a557-eada274501b5] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:48:58.236589 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e758b2b4-de15-41e1-9053-5444b66b44a6 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:58.237101 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e758b2b4-de15-41e1-9053-5444b66b44a6 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:58.237927 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e758b2b4-de15-41e1-9053-5444b66b44a6 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:58.238653 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e758b2b4-de15-41e1-9053-5444b66b44a6 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:58.239171 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e758b2b4-de15-41e1-9053-5444b66b44a6 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:58.239583 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e758b2b4-de15-41e1-9053-5444b66b44a6 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:58.575817 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-e758b2b4-de15-41e1-9053-5444b66b44a6 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:48:58.585306 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e758b2b4-de15-41e1-9053-5444b66b44a6 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/0a331816-6b06-40c9-a557-eada274501b5" status: 200 len: 1469 microversion: 2.1 time: 0.382230 Sep 14 08:48:58.586494 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 176/335] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:48:58 2022] GET /compute/v2.1/servers/0a331816-6b06-40c9-a557-eada274501b5 => generated 1469 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:48:58.615919 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-379a2eef-df96-4497-a0a9-92fe339a51b3 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:58.616816 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-379a2eef-df96-4497-a0a9-92fe339a51b3 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] [instance: 22688a6e-8420-49de-b5b7-7368ed55d8da] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:48:58.625348 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-379a2eef-df96-4497-a0a9-92fe339a51b3 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:58.625995 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-379a2eef-df96-4497-a0a9-92fe339a51b3 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:58.626504 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-379a2eef-df96-4497-a0a9-92fe339a51b3 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:58.627396 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-379a2eef-df96-4497-a0a9-92fe339a51b3 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:58.628013 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-379a2eef-df96-4497-a0a9-92fe339a51b3 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:58.629608 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-379a2eef-df96-4497-a0a9-92fe339a51b3 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:58.790793 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-379a2eef-df96-4497-a0a9-92fe339a51b3 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2ee35c4791437c83193357b4085128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4300dd934369461b9b6ef556246bfc53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:48:58.804743 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-379a2eef-df96-4497-a0a9-92fe339a51b3 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] 10.222.0.60 "GET /compute/v2.1/servers/22688a6e-8420-49de-b5b7-7368ed55d8da" status: 200 len: 1276 microversion: 2.1 time: 0.194654 Sep 14 08:48:58.807048 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 177/336] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:48:58 2022] GET /compute/v2.1/servers/22688a6e-8420-49de-b5b7-7368ed55d8da => generated 1276 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:48:58.807274 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f6c66080-6b79-4a28-aeec-24729c3027af tempest-QuotasAdminTestV257-325339548 tempest-QuotasAdminTestV257-325339548-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:58.807954 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f6c66080-6b79-4a28-aeec-24729c3027af tempest-QuotasAdminTestV257-325339548 tempest-QuotasAdminTestV257-325339548-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:58.808385 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f6c66080-6b79-4a28-aeec-24729c3027af tempest-QuotasAdminTestV257-325339548 tempest-QuotasAdminTestV257-325339548-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:58.809115 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f6c66080-6b79-4a28-aeec-24729c3027af tempest-QuotasAdminTestV257-325339548 tempest-QuotasAdminTestV257-325339548-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:58.810187 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f6c66080-6b79-4a28-aeec-24729c3027af tempest-QuotasAdminTestV257-325339548 tempest-QuotasAdminTestV257-325339548-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:58.810187 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f6c66080-6b79-4a28-aeec-24729c3027af tempest-QuotasAdminTestV257-325339548 tempest-QuotasAdminTestV257-325339548-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:58.895989 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f6c66080-6b79-4a28-aeec-24729c3027af tempest-QuotasAdminTestV257-325339548 tempest-QuotasAdminTestV257-325339548-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:58.896599 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f6c66080-6b79-4a28-aeec-24729c3027af tempest-QuotasAdminTestV257-325339548 tempest-QuotasAdminTestV257-325339548-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:58.897266 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f6c66080-6b79-4a28-aeec-24729c3027af tempest-QuotasAdminTestV257-325339548 tempest-QuotasAdminTestV257-325339548-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:58.898865 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f6c66080-6b79-4a28-aeec-24729c3027af tempest-QuotasAdminTestV257-325339548 tempest-QuotasAdminTestV257-325339548-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:58.899628 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f6c66080-6b79-4a28-aeec-24729c3027af tempest-QuotasAdminTestV257-325339548 tempest-QuotasAdminTestV257-325339548-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:58.900260 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f6c66080-6b79-4a28-aeec-24729c3027af tempest-QuotasAdminTestV257-325339548 tempest-QuotasAdminTestV257-325339548-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:59.014768 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=86,nova_cell0:UPDATE=14 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:48:59.041535 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-f6c66080-6b79-4a28-aeec-24729c3027af tempest-QuotasAdminTestV257-325339548 tempest-QuotasAdminTestV257-325339548-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-quota-sets/69e2141a187649e4931c079e441c1424?user_id=0cb7a92e132d436aaea934a748b11d82" status: 200 len: 148 microversion: 2.57 time: 1.080842 Sep 14 08:48:59.042199 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 160/337] 10.222.0.60 () {62 vars in 1384 bytes} [Wed Sep 14 08:48:57 2022] PUT /compute/v2.1/os-quota-sets/69e2141a187649e4931c079e441c1424?user_id=0cb7a92e132d436aaea934a748b11d82 => generated 148 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 08:48:59.053416 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-be6564fe-5475-4146-93e8-2b352807ee1d tempest-QuotasAdminTestV257-325339548 tempest-QuotasAdminTestV257-325339548-project-admin] Calling method '.version_select at 0x7f7d44cbd4c0>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:59.225474 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-46095f98-2ca1-42dd-a88b-8cb09a864313 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:59.226024 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-46095f98-2ca1-42dd-a88b-8cb09a864313 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] [instance: 17179827-7f78-4a3b-8eaa-766c5fa2b698] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:48:59.240061 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-46095f98-2ca1-42dd-a88b-8cb09a864313 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:59.240568 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-46095f98-2ca1-42dd-a88b-8cb09a864313 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:59.241009 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-46095f98-2ca1-42dd-a88b-8cb09a864313 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:59.241840 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-46095f98-2ca1-42dd-a88b-8cb09a864313 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:59.242491 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-46095f98-2ca1-42dd-a88b-8cb09a864313 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:59.242923 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-46095f98-2ca1-42dd-a88b-8cb09a864313 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:59.579869 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-be6564fe-5475-4146-93e8-2b352807ee1d tempest-QuotasAdminTestV257-325339548 tempest-QuotasAdminTestV257-325339548-project-admin] 10.222.0.60 "GET /compute/v2.1/os-quota-sets/69e2141a187649e4931c079e441c1424?user_id=0cb7a92e132d436aaea934a748b11d82" status: 200 len: 190 microversion: 2.57 time: 0.530322 Sep 14 08:48:59.580945 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 178/338] 10.222.0.60 () {60 vars in 1364 bytes} [Wed Sep 14 08:48:59 2022] GET /compute/v2.1/os-quota-sets/69e2141a187649e4931c079e441c1424?user_id=0cb7a92e132d436aaea934a748b11d82 => generated 190 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 08:48:59.665046 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-46095f98-2ca1-42dd-a88b-8cb09a864313 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e462483415e4c2b8a917b2a032e5ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac4d0cae0bd46fda94d7bfb900a0b9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:48:59.682627 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-46095f98-2ca1-42dd-a88b-8cb09a864313 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] 10.222.0.60 "GET /compute/v2.1/servers/17179827-7f78-4a3b-8eaa-766c5fa2b698" status: 200 len: 1320 microversion: 2.1 time: 0.460999 Sep 14 08:48:59.683331 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 161/339] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:48:59 2022] GET /compute/v2.1/servers/17179827-7f78-4a3b-8eaa-766c5fa2b698 => generated 1320 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:48:59.706398 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-e7d15f6c-ae38-4d8a-a804-cafb67cbd5fe tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:48:59.706907 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-e7d15f6c-ae38-4d8a-a804-cafb67cbd5fe tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: 0a331816-6b06-40c9-a557-eada274501b5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:48:59.727898 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=87,nova_api:DELETE=6,nova_api:INSERT=7 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:48:59.733701 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e7d15f6c-ae38-4d8a-a804-cafb67cbd5fe tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:59.734222 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e7d15f6c-ae38-4d8a-a804-cafb67cbd5fe tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:59.737921 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e7d15f6c-ae38-4d8a-a804-cafb67cbd5fe tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:48:59.740373 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e7d15f6c-ae38-4d8a-a804-cafb67cbd5fe tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:48:59.741137 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e7d15f6c-ae38-4d8a-a804-cafb67cbd5fe tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:48:59.744051 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e7d15f6c-ae38-4d8a-a804-cafb67cbd5fe tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:00.053348 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-e7d15f6c-ae38-4d8a-a804-cafb67cbd5fe tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:49:00.070176 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-e7d15f6c-ae38-4d8a-a804-cafb67cbd5fe tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/0a331816-6b06-40c9-a557-eada274501b5" status: 200 len: 1469 microversion: 2.1 time: 0.385086 Sep 14 08:49:00.089833 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 162/340] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:48:59 2022] GET /compute/v2.1/servers/0a331816-6b06-40c9-a557-eada274501b5 => generated 1469 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:49:00.095756 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-05740ef1-ccf5-47c4-93e2-a1ceea6245a4 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:49:00.097177 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-05740ef1-ccf5-47c4-93e2-a1ceea6245a4 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] [instance: 22688a6e-8420-49de-b5b7-7368ed55d8da] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:49:00.103857 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-05740ef1-ccf5-47c4-93e2-a1ceea6245a4 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:00.104801 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-05740ef1-ccf5-47c4-93e2-a1ceea6245a4 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:00.105431 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-05740ef1-ccf5-47c4-93e2-a1ceea6245a4 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:00.106894 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-05740ef1-ccf5-47c4-93e2-a1ceea6245a4 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:00.107622 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-05740ef1-ccf5-47c4-93e2-a1ceea6245a4 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:00.108293 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-05740ef1-ccf5-47c4-93e2-a1ceea6245a4 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:00.256721 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9ba7cf1d-4295-4020-ab39-03afe7b2de7e tempest-InstanceUsageAuditLogNegativeTestJSON-1173180955 tempest-InstanceUsageAuditLogNegativeTestJSON-1173180955-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:49:00.260325 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-9ba7cf1d-4295-4020-ab39-03afe7b2de7e tempest-InstanceUsageAuditLogNegativeTestJSON-1173180955 tempest-InstanceUsageAuditLogNegativeTestJSON-1173180955-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Sep 14 08:49:00.267185 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9ba7cf1d-4295-4020-ab39-03afe7b2de7e tempest-InstanceUsageAuditLogNegativeTestJSON-1173180955 tempest-InstanceUsageAuditLogNegativeTestJSON-1173180955-project-admin] Request method failure captured: Sep 14 08:49:00.267185 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Sep 14 08:49:00.267185 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 08:49:00.267185 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 08:49:00.267185 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 08:49:00.267185 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 08:49:00.267185 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 08:49:00.267185 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 08:49:00.267185 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 08:49:00.267185 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 08:49:00.267185 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZV7RDvtKAE1xVVRvDn6KnzZ26j1njw_xI_O7MvkCoOyu4vimmL5H54NcH_X6x48JvmVOtGWsUisD5cmMbOLcbG-O6l7my7tDs2S3CY5QL91wK_ab--V9ZwzW6JSKJSb7UHejV_R7fXu6JMDk-OU2Bqrgs1TvSh-QdZYgcd-RXdHIIo Sep 14 08:49:00.267185 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 08:49:00.267185 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 08:49:00.267185 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 08:49:00.267185 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 08:49:00.267185 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 08:49:00.267185 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 08:49:00.267185 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 2fb7d50ea8c0482b9b9737e3e01dccdd Sep 14 08:49:00.267185 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1173180955 Sep 14 08:49:00.267185 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member,admin Sep 14 08:49:00.267185 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member,admin Sep 14 08:49:00.268499 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/2fb7d50ea8c0482b9b9737e3e01dccdd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_2fb7d50ea8c0482b9b9737e3e01dccdd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2fb7d50ea8c0482b9b9737e3e01dccdd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2fb7d50ea8c0482b9b9737e3e01dccdd"}]}] Sep 14 08:49:00.268499 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1173180955 Sep 14 08:49:00.268499 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 2fb7d50ea8c0482b9b9737e3e01dccdd Sep 14 08:49:00.268499 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1173180955 Sep 14 08:49:00.268499 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1173180955-project-admin Sep 14 08:49:00.268499 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 08:49:00.268499 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 08:49:00.268499 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 9c6383b0d3e74f92b338b843a8de74cd Sep 14 08:49:00.268499 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1173180955-project-admin Sep 14 08:49:00.268499 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 08:49:00.268499 n-d-836830-18 devstack@n-api.service[128759]: exception: Invalid timestamp for date invalid_time Sep 14 08:49:00.269251 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': 'invalid_time'} Sep 14 08:49:00.269251 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:49:00.269251 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:49:00.269251 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Sep 14 08:49:00.269251 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Sep 14 08:49:00.269251 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Sep 14 08:49:00.269251 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Sep 14 08:49:00.269251 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Sep 14 08:49:00.269251 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Sep 14 08:49:00.269251 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Sep 14 08:49:00.269251 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:49:00.269251 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:49:00.269251 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:49:00.269251 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:49:00.269251 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:49:00.269251 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:49:00.269251 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:49:00.269251 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:49:00.269251 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:49:00.269251 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:49:00.270492 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Sep 14 08:49:00.270492 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Sep 14 08:49:00.270492 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Sep 14 08:49:00.270492 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:49:00.270492 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:49:00.270492 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:49:00.270492 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:49:00.270492 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:49:00.270492 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:49:00.270492 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:49:00.270492 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:49:00.270492 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Sep 14 08:49:00.270492 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:49:00.272672 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9ba7cf1d-4295-4020-ab39-03afe7b2de7e tempest-InstanceUsageAuditLogNegativeTestJSON-1173180955 tempest-InstanceUsageAuditLogNegativeTestJSON-1173180955-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:49:00.273925 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-9ba7cf1d-4295-4020-ab39-03afe7b2de7e tempest-InstanceUsageAuditLogNegativeTestJSON-1173180955 tempest-InstanceUsageAuditLogNegativeTestJSON-1173180955-project-admin] 10.222.0.60 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.691873 Sep 14 08:49:00.274660 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 179/341] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Sep 14 08:48:59 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 693 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 14 08:49:00.595584 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-05740ef1-ccf5-47c4-93e2-a1ceea6245a4 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2ee35c4791437c83193357b4085128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4300dd934369461b9b6ef556246bfc53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:49:00.607028 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-05740ef1-ccf5-47c4-93e2-a1ceea6245a4 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] 10.222.0.60 "GET /compute/v2.1/servers/22688a6e-8420-49de-b5b7-7368ed55d8da" status: 200 len: 1318 microversion: 2.1 time: 0.515537 Sep 14 08:49:00.608708 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 163/342] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:49:00 2022] GET /compute/v2.1/servers/22688a6e-8420-49de-b5b7-7368ed55d8da => generated 1318 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:49:00.615270 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-1b86bb64-d9a0-4a9a-8b6c-ef4e1302e4b9 req-3b1c1f8f-bcaf-448c-b590-8329a098ef37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22688a6e-8420-49de-b5b7-7368ed55d8da", "tag": "edf7e1c4-afe2-4693-9deb-bf04156d3edc"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:49:00.631092 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-1b86bb64-d9a0-4a9a-8b6c-ef4e1302e4b9 req-3b1c1f8f-bcaf-448c-b590-8329a098ef37 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:00.631583 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-1b86bb64-d9a0-4a9a-8b6c-ef4e1302e4b9 req-3b1c1f8f-bcaf-448c-b590-8329a098ef37 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:00.632017 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-1b86bb64-d9a0-4a9a-8b6c-ef4e1302e4b9 req-3b1c1f8f-bcaf-448c-b590-8329a098ef37 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:00.647238 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-1b86bb64-d9a0-4a9a-8b6c-ef4e1302e4b9 req-3b1c1f8f-bcaf-448c-b590-8329a098ef37 service nova] Creating event network-changed:edf7e1c4-afe2-4693-9deb-bf04156d3edc for instance 22688a6e-8420-49de-b5b7-7368ed55d8da on n-h2-836830-18 Sep 14 08:49:00.654277 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-1b86bb64-d9a0-4a9a-8b6c-ef4e1302e4b9 req-3b1c1f8f-bcaf-448c-b590-8329a098ef37 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044200 Sep 14 08:49:00.655395 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 164/343] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:49:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:49:00.661559 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-e1911c37-aa6a-4743-90d2-6b33151e176c req-f117353e-15cb-48c0-a398-8b74ded4ede6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17179827-7f78-4a3b-8eaa-766c5fa2b698", "name": "network-vif-plugged", "status": "completed", "tag": "92ab0af3-d225-4396-b7f7-37a50bd5214c"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:49:00.673044 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-e1911c37-aa6a-4743-90d2-6b33151e176c req-f117353e-15cb-48c0-a398-8b74ded4ede6 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:00.673758 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-e1911c37-aa6a-4743-90d2-6b33151e176c req-f117353e-15cb-48c0-a398-8b74ded4ede6 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:00.674190 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-e1911c37-aa6a-4743-90d2-6b33151e176c req-f117353e-15cb-48c0-a398-8b74ded4ede6 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:00.685979 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-e1911c37-aa6a-4743-90d2-6b33151e176c req-f117353e-15cb-48c0-a398-8b74ded4ede6 service nova] Creating event network-vif-plugged:92ab0af3-d225-4396-b7f7-37a50bd5214c for instance 17179827-7f78-4a3b-8eaa-766c5fa2b698 on n-h2-836830-18 Sep 14 08:49:00.691229 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-e1911c37-aa6a-4743-90d2-6b33151e176c req-f117353e-15cb-48c0-a398-8b74ded4ede6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034529 Sep 14 08:49:00.691826 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 165/344] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:49:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:49:00.705489 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-9a296460-dcc8-47af-91fa-60c91b8fc944 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:49:00.706195 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-9a296460-dcc8-47af-91fa-60c91b8fc944 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] [instance: 17179827-7f78-4a3b-8eaa-766c5fa2b698] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:49:00.712526 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9a296460-dcc8-47af-91fa-60c91b8fc944 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:00.713246 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9a296460-dcc8-47af-91fa-60c91b8fc944 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:00.713849 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9a296460-dcc8-47af-91fa-60c91b8fc944 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:00.714707 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9a296460-dcc8-47af-91fa-60c91b8fc944 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:00.715301 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9a296460-dcc8-47af-91fa-60c91b8fc944 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:00.716342 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9a296460-dcc8-47af-91fa-60c91b8fc944 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:00.992949 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-439b4326-bbd1-4b45-8097-758f4470b2e5 tempest-InstanceUsageAuditLogNegativeTestJSON-616559457 tempest-InstanceUsageAuditLogNegativeTestJSON-616559457-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:49:00.994973 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-439b4326-bbd1-4b45-8097-758f4470b2e5 tempest-InstanceUsageAuditLogNegativeTestJSON-616559457 tempest-InstanceUsageAuditLogNegativeTestJSON-616559457-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': '5764971a495e47b28c2e9b663d9f2dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640d4829e6264aa185977837cfffbbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:49:00.996364 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-439b4326-bbd1-4b45-8097-758f4470b2e5 tempest-InstanceUsageAuditLogNegativeTestJSON-616559457 tempest-InstanceUsageAuditLogNegativeTestJSON-616559457-project] Request method failure captured: Sep 14 08:49:00.996364 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Sep 14 08:49:00.996364 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 08:49:00.996364 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 08:49:00.996364 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 08:49:00.996364 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 08:49:00.996364 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 08:49:00.996364 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 08:49:00.996364 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 08:49:00.996364 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 08:49:00.996364 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZV4x75cck8e0GvoEXLEd_AERQ54hfdtQHeyTdrY-OgpWwxnNZjfy276FgCOsTFuHfgUIidPzcyVkb7PKXtQWkuY1zBnbn0qYStcvHg0ExBgmQacpNcnzxO4uyaoFEuvqDQAu_XEYbLSJ7Lcix66QSUID9AgsTZ17knaC2hVgADwn8U Sep 14 08:49:00.996364 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 08:49:00.996364 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 08:49:00.996364 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 08:49:00.996364 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 08:49:00.996364 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 08:49:00.996364 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 08:49:00.996364 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 640d4829e6264aa185977837cfffbbdf Sep 14 08:49:00.996364 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-616559457 Sep 14 08:49:00.996364 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 08:49:00.996364 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 08:49:00.997908 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/640d4829e6264aa185977837cfffbbdf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_640d4829e6264aa185977837cfffbbdf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/640d4829e6264aa185977837cfffbbdf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/640d4829e6264aa185977837cfffbbdf"}]}] Sep 14 08:49:00.997908 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-616559457 Sep 14 08:49:00.997908 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 640d4829e6264aa185977837cfffbbdf Sep 14 08:49:00.997908 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-616559457 Sep 14 08:49:00.997908 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-616559457-project Sep 14 08:49:00.997908 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 08:49:00.997908 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 08:49:00.997908 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 5764971a495e47b28c2e9b663d9f2dc3 Sep 14 08:49:00.997908 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-616559457-project Sep 14 08:49:00.997908 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 08:49:00.998629 n-d-836830-18 devstack@n-api.service[128759]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Sep 14 08:49:00.998629 n-d-836830-18 devstack@n-api.service[128759]: action_args: {} Sep 14 08:49:00.998629 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:49:00.998629 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:49:00.998629 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:49:00.998629 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:49:00.998629 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:49:00.998629 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:49:00.998629 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:49:00.998629 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:49:00.998629 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Sep 14 08:49:00.998629 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Sep 14 08:49:00.998629 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 14 08:49:00.998629 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 14 08:49:00.998629 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 14 08:49:00.998629 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 14 08:49:00.998629 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 14 08:49:00.998629 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 14 08:49:00.998629 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 14 08:49:00.998629 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise self.value Sep 14 08:49:01.000030 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 14 08:49:01.000030 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 14 08:49:01.000030 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 14 08:49:01.000030 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 14 08:49:01.000030 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 14 08:49:01.000030 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 14 08:49:01.000030 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Sep 14 08:49:01.000030 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:49:01.000030 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:49:01.000030 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:49:01.000030 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:49:01.000030 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:49:01.000030 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:49:01.000030 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 14 08:49:01.000030 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 14 08:49:01.000030 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Sep 14 08:49:01.000030 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:49:01.001065 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-439b4326-bbd1-4b45-8097-758f4470b2e5 tempest-InstanceUsageAuditLogNegativeTestJSON-616559457 tempest-InstanceUsageAuditLogNegativeTestJSON-616559457-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:49:01.001065 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-439b4326-bbd1-4b45-8097-758f4470b2e5 tempest-InstanceUsageAuditLogNegativeTestJSON-616559457 tempest-InstanceUsageAuditLogNegativeTestJSON-616559457-project] 10.222.0.60 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.714819 Sep 14 08:49:01.001770 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 180/345] 10.222.0.60 () {58 vars in 1185 bytes} [Wed Sep 14 08:49:00 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 720 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Sep 14 08:49:01.007520 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8071d8e8-ac49-4d34-9dbe-4b33257a9173 tempest-InstanceUsageAuditLogNegativeTestJSON-616559457 tempest-InstanceUsageAuditLogNegativeTestJSON-616559457-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:49:01.009697 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-8071d8e8-ac49-4d34-9dbe-4b33257a9173 tempest-InstanceUsageAuditLogNegativeTestJSON-616559457 tempest-InstanceUsageAuditLogNegativeTestJSON-616559457-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': '5764971a495e47b28c2e9b663d9f2dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640d4829e6264aa185977837cfffbbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:49:01.011494 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8071d8e8-ac49-4d34-9dbe-4b33257a9173 tempest-InstanceUsageAuditLogNegativeTestJSON-616559457 tempest-InstanceUsageAuditLogNegativeTestJSON-616559457-project] Request method failure captured: Sep 14 08:49:01.011494 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-09-14%2008:49:01 HTTP/1.1 Sep 14 08:49:01.011494 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 08:49:01.011494 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 08:49:01.011494 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 08:49:01.011494 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 08:49:01.011494 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 08:49:01.011494 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 08:49:01.011494 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 08:49:01.011494 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 08:49:01.011494 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZV4x75cck8e0GvoEXLEd_AERQ54hfdtQHeyTdrY-OgpWwxnNZjfy276FgCOsTFuHfgUIidPzcyVkb7PKXtQWkuY1zBnbn0qYStcvHg0ExBgmQacpNcnzxO4uyaoFEuvqDQAu_XEYbLSJ7Lcix66QSUID9AgsTZ17knaC2hVgADwn8U Sep 14 08:49:01.011494 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 08:49:01.011494 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 08:49:01.011494 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 08:49:01.011494 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 08:49:01.011494 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 08:49:01.011494 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 08:49:01.011494 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 640d4829e6264aa185977837cfffbbdf Sep 14 08:49:01.011494 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-616559457 Sep 14 08:49:01.011494 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 08:49:01.011494 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 08:49:01.014038 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/640d4829e6264aa185977837cfffbbdf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_640d4829e6264aa185977837cfffbbdf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/640d4829e6264aa185977837cfffbbdf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/640d4829e6264aa185977837cfffbbdf"}]}] Sep 14 08:49:01.014038 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-616559457 Sep 14 08:49:01.014038 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 640d4829e6264aa185977837cfffbbdf Sep 14 08:49:01.014038 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-616559457 Sep 14 08:49:01.014038 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-616559457-project Sep 14 08:49:01.014038 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 08:49:01.014038 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 08:49:01.014038 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 5764971a495e47b28c2e9b663d9f2dc3 Sep 14 08:49:01.014038 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-616559457-project Sep 14 08:49:01.014038 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 08:49:01.018223 n-d-836830-18 devstack@n-api.service[128759]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Sep 14 08:49:01.018223 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '2022-09-14 08:49:01'} Sep 14 08:49:01.018223 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:49:01.018223 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:49:01.018223 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:49:01.018223 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:49:01.018223 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:49:01.018223 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:49:01.018223 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:49:01.018223 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:49:01.018223 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Sep 14 08:49:01.018223 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Sep 14 08:49:01.018223 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 14 08:49:01.018223 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 14 08:49:01.018223 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 14 08:49:01.018223 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 14 08:49:01.018223 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 14 08:49:01.018223 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 14 08:49:01.018223 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 14 08:49:01.018223 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise self.value Sep 14 08:49:01.019581 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 14 08:49:01.019581 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 14 08:49:01.019581 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 14 08:49:01.019581 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 14 08:49:01.019581 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 14 08:49:01.019581 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 14 08:49:01.019581 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Sep 14 08:49:01.019581 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:49:01.019581 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:49:01.019581 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:49:01.019581 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:49:01.019581 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:49:01.019581 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:49:01.019581 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 14 08:49:01.019581 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 14 08:49:01.019581 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Sep 14 08:49:01.019581 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:49:01.021519 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8071d8e8-ac49-4d34-9dbe-4b33257a9173 tempest-InstanceUsageAuditLogNegativeTestJSON-616559457 tempest-InstanceUsageAuditLogNegativeTestJSON-616559457-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:49:01.022725 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-8071d8e8-ac49-4d34-9dbe-4b33257a9173 tempest-InstanceUsageAuditLogNegativeTestJSON-616559457 tempest-InstanceUsageAuditLogNegativeTestJSON-616559457-project] 10.222.0.60 "GET /compute/v2.1/os-instance_usage_audit_log/2022-09-14 08:49:01" status: 403 len: 128 microversion: 2.1 time: 0.019661 Sep 14 08:49:01.023470 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 181/346] 10.222.0.60 () {58 vars in 1251 bytes} [Wed Sep 14 08:49:01 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-09-14%2008%3A49%3A01 => generated 128 bytes in 21 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 14 08:49:01.045230 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-9a296460-dcc8-47af-91fa-60c91b8fc944 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e462483415e4c2b8a917b2a032e5ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac4d0cae0bd46fda94d7bfb900a0b9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:49:01.058866 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-9a296460-dcc8-47af-91fa-60c91b8fc944 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] 10.222.0.60 "GET /compute/v2.1/servers/17179827-7f78-4a3b-8eaa-766c5fa2b698" status: 200 len: 1320 microversion: 2.1 time: 0.354338 Sep 14 08:49:01.061725 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 166/347] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:49:00 2022] GET /compute/v2.1/servers/17179827-7f78-4a3b-8eaa-766c5fa2b698 => generated 1320 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:49:01.097501 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8ef16337-2fcf-465b-8e14-6981f97b8cff tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:49:01.098130 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-8ef16337-2fcf-465b-8e14-6981f97b8cff tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: 0a331816-6b06-40c9-a557-eada274501b5] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:49:01.107167 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8ef16337-2fcf-465b-8e14-6981f97b8cff tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:01.107697 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8ef16337-2fcf-465b-8e14-6981f97b8cff tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:01.108774 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8ef16337-2fcf-465b-8e14-6981f97b8cff tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:01.109527 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8ef16337-2fcf-465b-8e14-6981f97b8cff tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:01.112623 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8ef16337-2fcf-465b-8e14-6981f97b8cff tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:01.114690 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8ef16337-2fcf-465b-8e14-6981f97b8cff tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:01.478117 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-8ef16337-2fcf-465b-8e14-6981f97b8cff tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:49:01.494528 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-8ef16337-2fcf-465b-8e14-6981f97b8cff tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/0a331816-6b06-40c9-a557-eada274501b5" status: 200 len: 1469 microversion: 2.1 time: 0.401331 Sep 14 08:49:01.495695 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 182/348] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:49:01 2022] GET /compute/v2.1/servers/0a331816-6b06-40c9-a557-eada274501b5 => generated 1469 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:49:01.633924 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-3a75d2b8-fd5d-40cc-a02e-30d3266441de tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:49:01.634637 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-3a75d2b8-fd5d-40cc-a02e-30d3266441de tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] [instance: 22688a6e-8420-49de-b5b7-7368ed55d8da] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:49:01.642856 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3a75d2b8-fd5d-40cc-a02e-30d3266441de tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:01.643372 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3a75d2b8-fd5d-40cc-a02e-30d3266441de tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:01.643808 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3a75d2b8-fd5d-40cc-a02e-30d3266441de tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:01.644510 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3a75d2b8-fd5d-40cc-a02e-30d3266441de tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:01.644962 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3a75d2b8-fd5d-40cc-a02e-30d3266441de tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:01.645380 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3a75d2b8-fd5d-40cc-a02e-30d3266441de tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:01.894190 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-3a75d2b8-fd5d-40cc-a02e-30d3266441de tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2ee35c4791437c83193357b4085128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4300dd934369461b9b6ef556246bfc53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:49:01.907241 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-3a75d2b8-fd5d-40cc-a02e-30d3266441de tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] 10.222.0.60 "GET /compute/v2.1/servers/22688a6e-8420-49de-b5b7-7368ed55d8da" status: 200 len: 1318 microversion: 2.1 time: 0.277327 Sep 14 08:49:01.909384 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 167/349] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:49:01 2022] GET /compute/v2.1/servers/22688a6e-8420-49de-b5b7-7368ed55d8da => generated 1318 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:49:02.089679 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d8ec485b-06fa-462a-9996-bad7c8978fec tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:49:02.090307 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-d8ec485b-06fa-462a-9996-bad7c8978fec tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] [instance: 17179827-7f78-4a3b-8eaa-766c5fa2b698] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:49:02.096587 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d8ec485b-06fa-462a-9996-bad7c8978fec tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:02.097286 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d8ec485b-06fa-462a-9996-bad7c8978fec tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:02.097879 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d8ec485b-06fa-462a-9996-bad7c8978fec tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:02.098851 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d8ec485b-06fa-462a-9996-bad7c8978fec tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:02.099345 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d8ec485b-06fa-462a-9996-bad7c8978fec tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:02.099777 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d8ec485b-06fa-462a-9996-bad7c8978fec tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:02.325974 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-d8ec485b-06fa-462a-9996-bad7c8978fec tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e462483415e4c2b8a917b2a032e5ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac4d0cae0bd46fda94d7bfb900a0b9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:49:02.336770 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d8ec485b-06fa-462a-9996-bad7c8978fec tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] 10.222.0.60 "GET /compute/v2.1/servers/17179827-7f78-4a3b-8eaa-766c5fa2b698" status: 200 len: 1470 microversion: 2.1 time: 0.251088 Sep 14 08:49:02.347321 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 183/350] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:49:02 2022] GET /compute/v2.1/servers/17179827-7f78-4a3b-8eaa-766c5fa2b698 => generated 1470 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:49:02.366834 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-4b620151-afcb-4bbb-893b-56a963b6d463 tempest-DeleteServersAdminTestJSON-128887994 tempest-DeleteServersAdminTestJSON-128887994-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:49:02.371273 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-4b620151-afcb-4bbb-893b-56a963b6d463 tempest-DeleteServersAdminTestJSON-128887994 tempest-DeleteServersAdminTestJSON-128887994-project-admin] [instance: 17179827-7f78-4a3b-8eaa-766c5fa2b698] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:49:02.382837 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4b620151-afcb-4bbb-893b-56a963b6d463 tempest-DeleteServersAdminTestJSON-128887994 tempest-DeleteServersAdminTestJSON-128887994-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:02.385052 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4b620151-afcb-4bbb-893b-56a963b6d463 tempest-DeleteServersAdminTestJSON-128887994 tempest-DeleteServersAdminTestJSON-128887994-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:02.387020 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4b620151-afcb-4bbb-893b-56a963b6d463 tempest-DeleteServersAdminTestJSON-128887994 tempest-DeleteServersAdminTestJSON-128887994-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:02.388729 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4b620151-afcb-4bbb-893b-56a963b6d463 tempest-DeleteServersAdminTestJSON-128887994 tempest-DeleteServersAdminTestJSON-128887994-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:02.389744 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4b620151-afcb-4bbb-893b-56a963b6d463 tempest-DeleteServersAdminTestJSON-128887994 tempest-DeleteServersAdminTestJSON-128887994-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:02.390640 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4b620151-afcb-4bbb-893b-56a963b6d463 tempest-DeleteServersAdminTestJSON-128887994 tempest-DeleteServersAdminTestJSON-128887994-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:02.520552 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-cbaf4ac0-6dcd-4003-8f14-3541c9a6b363 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:49:02.521272 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-cbaf4ac0-6dcd-4003-8f14-3541c9a6b363 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: 0a331816-6b06-40c9-a557-eada274501b5] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:49:02.525131 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-4b620151-afcb-4bbb-893b-56a963b6d463 tempest-DeleteServersAdminTestJSON-128887994 tempest-DeleteServersAdminTestJSON-128887994-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/17179827-7f78-4a3b-8eaa-766c5fa2b698/action" status: 202 len: 0 microversion: 2.1 time: 0.164186 Sep 14 08:49:02.533722 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 168/351] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 08:49:02 2022] POST /compute/v2.1/servers/17179827-7f78-4a3b-8eaa-766c5fa2b698/action => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 08:49:02.538503 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cbaf4ac0-6dcd-4003-8f14-3541c9a6b363 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:02.540089 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-58283716-c18c-43cd-b09a-b12b109350c5 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:49:02.540914 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cbaf4ac0-6dcd-4003-8f14-3541c9a6b363 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:02.541766 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-58283716-c18c-43cd-b09a-b12b109350c5 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] [instance: 17179827-7f78-4a3b-8eaa-766c5fa2b698] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:49:02.542245 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cbaf4ac0-6dcd-4003-8f14-3541c9a6b363 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:02.543688 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cbaf4ac0-6dcd-4003-8f14-3541c9a6b363 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:02.547509 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cbaf4ac0-6dcd-4003-8f14-3541c9a6b363 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:02.548957 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cbaf4ac0-6dcd-4003-8f14-3541c9a6b363 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:02.551730 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-58283716-c18c-43cd-b09a-b12b109350c5 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:02.563704 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-58283716-c18c-43cd-b09a-b12b109350c5 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:02.564335 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-58283716-c18c-43cd-b09a-b12b109350c5 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:02.565352 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-58283716-c18c-43cd-b09a-b12b109350c5 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:02.566051 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-58283716-c18c-43cd-b09a-b12b109350c5 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:02.566512 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-58283716-c18c-43cd-b09a-b12b109350c5 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:02.622196 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-58283716-c18c-43cd-b09a-b12b109350c5 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:02.622974 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-58283716-c18c-43cd-b09a-b12b109350c5 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:02.624583 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-58283716-c18c-43cd-b09a-b12b109350c5 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:02.627075 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.objects.instance [None req-58283716-c18c-43cd-b09a-b12b109350c5 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lazy-loading 'fault' on Instance uuid 17179827-7f78-4a3b-8eaa-766c5fa2b698 {{(pid=128758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 08:49:02.993991 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-cbaf4ac0-6dcd-4003-8f14-3541c9a6b363 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:49:03.003459 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-cbaf4ac0-6dcd-4003-8f14-3541c9a6b363 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/0a331816-6b06-40c9-a557-eada274501b5" status: 200 len: 1474 microversion: 2.1 time: 0.487281 Sep 14 08:49:03.007854 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 184/352] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:49:02 2022] GET /compute/v2.1/servers/0a331816-6b06-40c9-a557-eada274501b5 => generated 1474 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:49:03.012737 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-0346710e-47a7-47cb-9124-9bf63fb65829 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:49:03.023087 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-0346710e-47a7-47cb-9124-9bf63fb65829 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] [instance: 22688a6e-8420-49de-b5b7-7368ed55d8da] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:49:03.034714 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0346710e-47a7-47cb-9124-9bf63fb65829 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:03.035502 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0346710e-47a7-47cb-9124-9bf63fb65829 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:03.036188 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0346710e-47a7-47cb-9124-9bf63fb65829 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:03.036947 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0346710e-47a7-47cb-9124-9bf63fb65829 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:03.037412 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0346710e-47a7-47cb-9124-9bf63fb65829 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:03.037845 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0346710e-47a7-47cb-9124-9bf63fb65829 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:03.051024 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-58283716-c18c-43cd-b09a-b12b109350c5 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e462483415e4c2b8a917b2a032e5ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac4d0cae0bd46fda94d7bfb900a0b9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:49:03.054435 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:49:03.070075 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-58283716-c18c-43cd-b09a-b12b109350c5 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] 10.222.0.60 "GET /compute/v2.1/servers/17179827-7f78-4a3b-8eaa-766c5fa2b698" status: 200 len: 1453 microversion: 2.1 time: 0.535151 Sep 14 08:49:03.079685 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 169/353] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:49:02 2022] GET /compute/v2.1/servers/17179827-7f78-4a3b-8eaa-766c5fa2b698 => generated 1453 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:49:03.094923 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-3f4b3a71-cc19-4352-843e-b7088a439d04 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:49:03.095462 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-3f4b3a71-cc19-4352-843e-b7088a439d04 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] [instance: 17179827-7f78-4a3b-8eaa-766c5fa2b698] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:49:03.117826 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3f4b3a71-cc19-4352-843e-b7088a439d04 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:03.118572 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3f4b3a71-cc19-4352-843e-b7088a439d04 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:03.119160 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3f4b3a71-cc19-4352-843e-b7088a439d04 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:03.121295 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3f4b3a71-cc19-4352-843e-b7088a439d04 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:03.121957 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3f4b3a71-cc19-4352-843e-b7088a439d04 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:03.123477 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3f4b3a71-cc19-4352-843e-b7088a439d04 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:03.180311 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-3f4b3a71-cc19-4352-843e-b7088a439d04 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] [instance: 17179827-7f78-4a3b-8eaa-766c5fa2b698] Going to try to terminate instance {{(pid=128758) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 08:49:03.365481 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-0346710e-47a7-47cb-9124-9bf63fb65829 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2ee35c4791437c83193357b4085128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4300dd934369461b9b6ef556246bfc53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:49:03.368575 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-3f4b3a71-cc19-4352-843e-b7088a439d04 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] 10.222.0.60 "DELETE /compute/v2.1/servers/17179827-7f78-4a3b-8eaa-766c5fa2b698" status: 204 len: 0 microversion: 2.1 time: 0.278521 Sep 14 08:49:03.373606 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 170/354] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 08:49:03 2022] DELETE /compute/v2.1/servers/17179827-7f78-4a3b-8eaa-766c5fa2b698 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 08:49:03.377097 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-0346710e-47a7-47cb-9124-9bf63fb65829 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] 10.222.0.60 "GET /compute/v2.1/servers/22688a6e-8420-49de-b5b7-7368ed55d8da" status: 200 len: 1318 microversion: 2.1 time: 0.368097 Sep 14 08:49:03.378202 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 185/355] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:49:03 2022] GET /compute/v2.1/servers/22688a6e-8420-49de-b5b7-7368ed55d8da => generated 1318 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:49:03.382762 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-9e2f1fe8-3af0-40ed-a4c8-ad789c677c3e tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:49:03.384073 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-9e2f1fe8-3af0-40ed-a4c8-ad789c677c3e tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] [instance: 17179827-7f78-4a3b-8eaa-766c5fa2b698] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:49:03.407449 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9e2f1fe8-3af0-40ed-a4c8-ad789c677c3e tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:03.408226 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9e2f1fe8-3af0-40ed-a4c8-ad789c677c3e tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:03.408808 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9e2f1fe8-3af0-40ed-a4c8-ad789c677c3e tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:03.410228 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9e2f1fe8-3af0-40ed-a4c8-ad789c677c3e tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:03.410845 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9e2f1fe8-3af0-40ed-a4c8-ad789c677c3e tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:03.411480 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9e2f1fe8-3af0-40ed-a4c8-ad789c677c3e tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:03.463752 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9e2f1fe8-3af0-40ed-a4c8-ad789c677c3e tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:03.465133 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9e2f1fe8-3af0-40ed-a4c8-ad789c677c3e tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:03.465916 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9e2f1fe8-3af0-40ed-a4c8-ad789c677c3e tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:03.466520 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.objects.instance [None req-9e2f1fe8-3af0-40ed-a4c8-ad789c677c3e tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lazy-loading 'fault' on Instance uuid 17179827-7f78-4a3b-8eaa-766c5fa2b698 {{(pid=128758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 08:49:03.680972 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-9e2f1fe8-3af0-40ed-a4c8-ad789c677c3e tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e462483415e4c2b8a917b2a032e5ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac4d0cae0bd46fda94d7bfb900a0b9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:49:03.691648 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-9e2f1fe8-3af0-40ed-a4c8-ad789c677c3e tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] 10.222.0.60 "GET /compute/v2.1/servers/17179827-7f78-4a3b-8eaa-766c5fa2b698" status: 200 len: 1459 microversion: 2.1 time: 0.313179 Sep 14 08:49:03.693917 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 171/356] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:49:03 2022] GET /compute/v2.1/servers/17179827-7f78-4a3b-8eaa-766c5fa2b698 => generated 1459 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:49:04.031156 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e8e99784-8b7d-41bf-bbd7-1d475a3f2eac tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:49:04.031781 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e8e99784-8b7d-41bf-bbd7-1d475a3f2eac tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: 0a331816-6b06-40c9-a557-eada274501b5] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:49:04.042803 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e8e99784-8b7d-41bf-bbd7-1d475a3f2eac tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:04.044141 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e8e99784-8b7d-41bf-bbd7-1d475a3f2eac tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:04.045037 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e8e99784-8b7d-41bf-bbd7-1d475a3f2eac tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:04.046350 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e8e99784-8b7d-41bf-bbd7-1d475a3f2eac tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:04.047230 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e8e99784-8b7d-41bf-bbd7-1d475a3f2eac tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:04.048661 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e8e99784-8b7d-41bf-bbd7-1d475a3f2eac tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:04.055765 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:49:04.310594 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-e8e99784-8b7d-41bf-bbd7-1d475a3f2eac tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:49:04.330142 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e8e99784-8b7d-41bf-bbd7-1d475a3f2eac tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/0a331816-6b06-40c9-a557-eada274501b5" status: 200 len: 1474 microversion: 2.1 time: 0.305407 Sep 14 08:49:04.339440 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 186/357] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:49:04 2022] GET /compute/v2.1/servers/0a331816-6b06-40c9-a557-eada274501b5 => generated 1474 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:49:04.411487 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-047e358f-3c3f-4aeb-98d7-bbe0c4aeff03 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:49:04.412701 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-047e358f-3c3f-4aeb-98d7-bbe0c4aeff03 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] [instance: 22688a6e-8420-49de-b5b7-7368ed55d8da] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:49:04.457979 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-047e358f-3c3f-4aeb-98d7-bbe0c4aeff03 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:04.463699 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-047e358f-3c3f-4aeb-98d7-bbe0c4aeff03 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:04.464367 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-047e358f-3c3f-4aeb-98d7-bbe0c4aeff03 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:04.465324 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-047e358f-3c3f-4aeb-98d7-bbe0c4aeff03 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:04.470406 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-047e358f-3c3f-4aeb-98d7-bbe0c4aeff03 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:04.472329 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-047e358f-3c3f-4aeb-98d7-bbe0c4aeff03 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:04.716543 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-72948c8a-813d-4fe4-843c-136b25c0f7eb tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:49:04.717163 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-72948c8a-813d-4fe4-843c-136b25c0f7eb tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] [instance: 17179827-7f78-4a3b-8eaa-766c5fa2b698] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:49:04.725734 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-72948c8a-813d-4fe4-843c-136b25c0f7eb tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:04.726231 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-72948c8a-813d-4fe4-843c-136b25c0f7eb tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:04.727526 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-72948c8a-813d-4fe4-843c-136b25c0f7eb tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:04.728650 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-72948c8a-813d-4fe4-843c-136b25c0f7eb tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:04.729116 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-72948c8a-813d-4fe4-843c-136b25c0f7eb tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:04.730579 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-72948c8a-813d-4fe4-843c-136b25c0f7eb tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:04.787106 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-72948c8a-813d-4fe4-843c-136b25c0f7eb tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:04.787914 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-72948c8a-813d-4fe4-843c-136b25c0f7eb tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:04.788537 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-72948c8a-813d-4fe4-843c-136b25c0f7eb tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:04.790780 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.objects.instance [None req-72948c8a-813d-4fe4-843c-136b25c0f7eb tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lazy-loading 'fault' on Instance uuid 17179827-7f78-4a3b-8eaa-766c5fa2b698 {{(pid=128759) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 08:49:05.067549 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-047e358f-3c3f-4aeb-98d7-bbe0c4aeff03 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2ee35c4791437c83193357b4085128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4300dd934369461b9b6ef556246bfc53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:49:05.080538 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-047e358f-3c3f-4aeb-98d7-bbe0c4aeff03 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] 10.222.0.60 "GET /compute/v2.1/servers/22688a6e-8420-49de-b5b7-7368ed55d8da" status: 200 len: 1318 microversion: 2.1 time: 0.678510 Sep 14 08:49:05.083112 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 172/358] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:49:04 2022] GET /compute/v2.1/servers/22688a6e-8420-49de-b5b7-7368ed55d8da => generated 1318 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:49:05.440966 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-72948c8a-813d-4fe4-843c-136b25c0f7eb tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e462483415e4c2b8a917b2a032e5ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac4d0cae0bd46fda94d7bfb900a0b9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:49:05.454089 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-72948c8a-813d-4fe4-843c-136b25c0f7eb tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] 10.222.0.60 "GET /compute/v2.1/servers/17179827-7f78-4a3b-8eaa-766c5fa2b698" status: 200 len: 1459 microversion: 2.1 time: 0.741547 Sep 14 08:49:05.454689 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 187/359] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:49:04 2022] GET /compute/v2.1/servers/17179827-7f78-4a3b-8eaa-766c5fa2b698 => generated 1459 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:49:05.464061 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-fa73ca80-22d8-4c49-a8f6-2d9325b95115 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:49:05.471411 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-fa73ca80-22d8-4c49-a8f6-2d9325b95115 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: 0a331816-6b06-40c9-a557-eada274501b5] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:49:05.478105 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fa73ca80-22d8-4c49-a8f6-2d9325b95115 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:05.478602 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fa73ca80-22d8-4c49-a8f6-2d9325b95115 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:05.479072 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fa73ca80-22d8-4c49-a8f6-2d9325b95115 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:05.479786 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fa73ca80-22d8-4c49-a8f6-2d9325b95115 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:05.480251 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fa73ca80-22d8-4c49-a8f6-2d9325b95115 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:05.480683 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fa73ca80-22d8-4c49-a8f6-2d9325b95115 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:05.541738 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-0f10987f-d83e-41fa-b6e4-198bc87b62c5 tempest-AggregatesAdminTestV241-2123483065 tempest-AggregatesAdminTestV241-2123483065-project-admin] Calling method '.version_select at 0x7f7d44ca7c10>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:49:05.551896 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0f10987f-d83e-41fa-b6e4-198bc87b62c5 tempest-AggregatesAdminTestV241-2123483065 tempest-AggregatesAdminTestV241-2123483065-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:05.552633 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0f10987f-d83e-41fa-b6e4-198bc87b62c5 tempest-AggregatesAdminTestV241-2123483065 tempest-AggregatesAdminTestV241-2123483065-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:05.557581 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0f10987f-d83e-41fa-b6e4-198bc87b62c5 tempest-AggregatesAdminTestV241-2123483065 tempest-AggregatesAdminTestV241-2123483065-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:05.598449 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0f10987f-d83e-41fa-b6e4-198bc87b62c5 tempest-AggregatesAdminTestV241-2123483065 tempest-AggregatesAdminTestV241-2123483065-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:05.599729 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0f10987f-d83e-41fa-b6e4-198bc87b62c5 tempest-AggregatesAdminTestV241-2123483065 tempest-AggregatesAdminTestV241-2123483065-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:05.600917 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0f10987f-d83e-41fa-b6e4-198bc87b62c5 tempest-AggregatesAdminTestV241-2123483065 tempest-AggregatesAdminTestV241-2123483065-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:05.658079 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0f10987f-d83e-41fa-b6e4-198bc87b62c5 tempest-AggregatesAdminTestV241-2123483065 tempest-AggregatesAdminTestV241-2123483065-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:05.660498 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0f10987f-d83e-41fa-b6e4-198bc87b62c5 tempest-AggregatesAdminTestV241-2123483065 tempest-AggregatesAdminTestV241-2123483065-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:05.661261 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0f10987f-d83e-41fa-b6e4-198bc87b62c5 tempest-AggregatesAdminTestV241-2123483065 tempest-AggregatesAdminTestV241-2123483065-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:05.676646 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-0f10987f-d83e-41fa-b6e4-198bc87b62c5 tempest-AggregatesAdminTestV241-2123483065 tempest-AggregatesAdminTestV241-2123483065-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1429 microversion: 2.41 time: 0.591601 Sep 14 08:49:05.685161 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 173/360] 10.222.0.60 () {60 vars in 1208 bytes} [Wed Sep 14 08:49:05 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1429 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:49:05.698796 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-9628d0d1-c0b4-4da2-8153-b4b1d5e20066 tempest-AggregatesAdminTestV241-2123483065 tempest-AggregatesAdminTestV241-2123483065-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-814268415"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:49:05.723177 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.objects.aggregate [None req-9628d0d1-c0b4-4da2-8153-b4b1d5e20066 tempest-AggregatesAdminTestV241-2123483065 tempest-AggregatesAdminTestV241-2123483065-project-admin] Generated uuid 51df495c-6e2c-485e-a6d3-b9fdca1d1127 for aggregate {{(pid=128758) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 14 08:49:05.780692 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-9628d0d1-c0b4-4da2-8153-b4b1d5e20066 tempest-AggregatesAdminTestV241-2123483065 tempest-AggregatesAdminTestV241-2123483065-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.41 time: 0.083924 Sep 14 08:49:05.787740 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 174/361] 10.222.0.60 () {62 vars in 1205 bytes} [Wed Sep 14 08:49:05 2022] POST /compute/v2.1/os-aggregates => generated 246 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 08:49:05.802368 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-885b8c6e-48e7-4753-a2e2-e6f5f4e63ca9 tempest-AggregatesAdminTestV241-2123483065 tempest-AggregatesAdminTestV241-2123483065-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-839993184"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:49:05.857019 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-fa73ca80-22d8-4c49-a8f6-2d9325b95115 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:49:05.869101 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-fa73ca80-22d8-4c49-a8f6-2d9325b95115 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/0a331816-6b06-40c9-a557-eada274501b5" status: 200 len: 1474 microversion: 2.1 time: 0.410904 Sep 14 08:49:05.869976 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 188/362] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:49:05 2022] GET /compute/v2.1/servers/0a331816-6b06-40c9-a557-eada274501b5 => generated 1474 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:49:05.976990 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-885b8c6e-48e7-4753-a2e2-e6f5f4e63ca9 tempest-AggregatesAdminTestV241-2123483065 tempest-AggregatesAdminTestV241-2123483065-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-aggregates/18" status: 200 len: 299 microversion: 2.41 time: 0.186584 Sep 14 08:49:05.984302 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 175/363] 10.222.0.60 () {62 vars in 1213 bytes} [Wed Sep 14 08:49:05 2022] PUT /compute/v2.1/os-aggregates/18 => generated 299 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 08:49:05.991766 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-98a0ad28-e289-46a0-8421-4dae636015e8 tempest-AggregatesAdminTestV241-2123483065 tempest-AggregatesAdminTestV241-2123483065-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:49:06.002004 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-98a0ad28-e289-46a0-8421-4dae636015e8 tempest-AggregatesAdminTestV241-2123483065 tempest-AggregatesAdminTestV241-2123483065-project-admin] 10.222.0.60 "GET /compute/v2.1/os-aggregates/18" status: 200 len: 299 microversion: 2.41 time: 0.016501 Sep 14 08:49:06.003925 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 189/364] 10.222.0.60 () {60 vars in 1193 bytes} [Wed Sep 14 08:49:05 2022] GET /compute/v2.1/os-aggregates/18 => generated 299 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 08:49:06.019390 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-9eb24ac1-f7e5-42d1-a79a-b2acd903a81c tempest-AggregatesAdminTestV241-2123483065 tempest-AggregatesAdminTestV241-2123483065-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-836830-18"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:49:06.061617 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9eb24ac1-f7e5-42d1-a79a-b2acd903a81c tempest-AggregatesAdminTestV241-2123483065 tempest-AggregatesAdminTestV241-2123483065-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:06.062005 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9eb24ac1-f7e5-42d1-a79a-b2acd903a81c tempest-AggregatesAdminTestV241-2123483065 tempest-AggregatesAdminTestV241-2123483065-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:06.062536 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9eb24ac1-f7e5-42d1-a79a-b2acd903a81c tempest-AggregatesAdminTestV241-2123483065 tempest-AggregatesAdminTestV241-2123483065-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:06.113302 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-0663c5af-5256-4dec-a7c0-0bb1699505cf tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:49:06.114711 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-0663c5af-5256-4dec-a7c0-0bb1699505cf tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] [instance: 22688a6e-8420-49de-b5b7-7368ed55d8da] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:49:06.141602 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0663c5af-5256-4dec-a7c0-0bb1699505cf tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:06.143419 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0663c5af-5256-4dec-a7c0-0bb1699505cf tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:06.148332 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0663c5af-5256-4dec-a7c0-0bb1699505cf tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:06.149872 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0663c5af-5256-4dec-a7c0-0bb1699505cf tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:06.157354 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0663c5af-5256-4dec-a7c0-0bb1699505cf tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:06.158184 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0663c5af-5256-4dec-a7c0-0bb1699505cf tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:06.325494 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-9eb24ac1-f7e5-42d1-a79a-b2acd903a81c tempest-AggregatesAdminTestV241-2123483065 tempest-AggregatesAdminTestV241-2123483065-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates/18/action" status: 200 len: 315 microversion: 2.41 time: 0.312890 Sep 14 08:49:06.326696 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 176/365] 10.222.0.60 () {62 vars in 1235 bytes} [Wed Sep 14 08:49:06 2022] POST /compute/v2.1/os-aggregates/18/action => generated 315 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 08:49:06.345197 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-66916352-56ea-4697-9d08-ec44ab40152a tempest-AggregatesAdminTestV241-2123483065 tempest-AggregatesAdminTestV241-2123483065-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-836830-18"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:49:06.366697 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-66916352-56ea-4697-9d08-ec44ab40152a tempest-AggregatesAdminTestV241-2123483065 tempest-AggregatesAdminTestV241-2123483065-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:06.367987 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-66916352-56ea-4697-9d08-ec44ab40152a tempest-AggregatesAdminTestV241-2123483065 tempest-AggregatesAdminTestV241-2123483065-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:06.368582 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-66916352-56ea-4697-9d08-ec44ab40152a tempest-AggregatesAdminTestV241-2123483065 tempest-AggregatesAdminTestV241-2123483065-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:06.480281 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-0663c5af-5256-4dec-a7c0-0bb1699505cf tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2ee35c4791437c83193357b4085128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4300dd934369461b9b6ef556246bfc53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:49:06.491797 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-0663c5af-5256-4dec-a7c0-0bb1699505cf tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] 10.222.0.60 "GET /compute/v2.1/servers/22688a6e-8420-49de-b5b7-7368ed55d8da" status: 200 len: 1318 microversion: 2.1 time: 0.387903 Sep 14 08:49:06.492380 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 190/366] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:49:06 2022] GET /compute/v2.1/servers/22688a6e-8420-49de-b5b7-7368ed55d8da => generated 1318 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:49:06.512935 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9f5e7df3-751a-4385-9ea3-88587f1e81b0 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:49:06.524773 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-9f5e7df3-751a-4385-9ea3-88587f1e81b0 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] [instance: 17179827-7f78-4a3b-8eaa-766c5fa2b698] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:49:06.528524 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=4,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:49:06.551081 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9f5e7df3-751a-4385-9ea3-88587f1e81b0 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:06.551770 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9f5e7df3-751a-4385-9ea3-88587f1e81b0 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:06.552211 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9f5e7df3-751a-4385-9ea3-88587f1e81b0 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:06.562916 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9f5e7df3-751a-4385-9ea3-88587f1e81b0 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:06.564072 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9f5e7df3-751a-4385-9ea3-88587f1e81b0 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:06.564676 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9f5e7df3-751a-4385-9ea3-88587f1e81b0 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:06.625756 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-66916352-56ea-4697-9d08-ec44ab40152a tempest-AggregatesAdminTestV241-2123483065 tempest-AggregatesAdminTestV241-2123483065-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates/18/action" status: 200 len: 299 microversion: 2.41 time: 0.285802 Sep 14 08:49:06.628766 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 177/367] 10.222.0.60 () {62 vars in 1235 bytes} [Wed Sep 14 08:49:06 2022] POST /compute/v2.1/os-aggregates/18/action => generated 299 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 08:49:06.640786 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-02a70cd3-cb03-4a0c-81de-94c06c10bc61 tempest-AggregatesAdminTestV241-2123483065 tempest-AggregatesAdminTestV241-2123483065-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:49:06.641205 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9f5e7df3-751a-4385-9ea3-88587f1e81b0 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:06.641871 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9f5e7df3-751a-4385-9ea3-88587f1e81b0 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:06.643567 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9f5e7df3-751a-4385-9ea3-88587f1e81b0 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:06.644248 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.objects.instance [None req-9f5e7df3-751a-4385-9ea3-88587f1e81b0 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lazy-loading 'fault' on Instance uuid 17179827-7f78-4a3b-8eaa-766c5fa2b698 {{(pid=128759) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 08:49:06.679464 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-02a70cd3-cb03-4a0c-81de-94c06c10bc61 tempest-AggregatesAdminTestV241-2123483065 tempest-AggregatesAdminTestV241-2123483065-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.41 time: 0.043951 Sep 14 08:49:06.683109 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 178/368] 10.222.0.60 () {60 vars in 1196 bytes} [Wed Sep 14 08:49:06 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 08:49:06.727200 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-9f5e7df3-751a-4385-9ea3-88587f1e81b0 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e462483415e4c2b8a917b2a032e5ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eac4d0cae0bd46fda94d7bfb900a0b9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:49:06.736924 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-9f5e7df3-751a-4385-9ea3-88587f1e81b0 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] 10.222.0.60 "GET /compute/v2.1/servers/17179827-7f78-4a3b-8eaa-766c5fa2b698" status: 200 len: 1417 microversion: 2.1 time: 0.243530 Sep 14 08:49:06.737868 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 191/369] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:49:06 2022] GET /compute/v2.1/servers/17179827-7f78-4a3b-8eaa-766c5fa2b698 => generated 1417 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:49:06.880741 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-05572716-2d33-493a-8cdb-ef328a40e841 req-d785fab0-9b6d-42c7-acfd-2ca6eb1023f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17179827-7f78-4a3b-8eaa-766c5fa2b698", "name": "network-vif-deleted", "tag": "92ab0af3-d225-4396-b7f7-37a50bd5214c"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:49:06.898815 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f2201455-83d2-4169-8673-eb5b33429e9b tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:49:06.900093 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f2201455-83d2-4169-8673-eb5b33429e9b tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: 0a331816-6b06-40c9-a557-eada274501b5] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:49:06.900593 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-05572716-2d33-493a-8cdb-ef328a40e841 req-d785fab0-9b6d-42c7-acfd-2ca6eb1023f8 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:06.901074 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-05572716-2d33-493a-8cdb-ef328a40e841 req-d785fab0-9b6d-42c7-acfd-2ca6eb1023f8 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:06.901500 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-05572716-2d33-493a-8cdb-ef328a40e841 req-d785fab0-9b6d-42c7-acfd-2ca6eb1023f8 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:06.913082 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f2201455-83d2-4169-8673-eb5b33429e9b tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:06.917311 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f2201455-83d2-4169-8673-eb5b33429e9b tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:06.917930 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f2201455-83d2-4169-8673-eb5b33429e9b tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:06.920606 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f2201455-83d2-4169-8673-eb5b33429e9b tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:06.921169 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f2201455-83d2-4169-8673-eb5b33429e9b tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:06.921867 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f2201455-83d2-4169-8673-eb5b33429e9b tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:06.934488 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-05572716-2d33-493a-8cdb-ef328a40e841 req-d785fab0-9b6d-42c7-acfd-2ca6eb1023f8 service nova] Creating event network-vif-deleted:92ab0af3-d225-4396-b7f7-37a50bd5214c for instance 17179827-7f78-4a3b-8eaa-766c5fa2b698 on n-h2-836830-18 Sep 14 08:49:06.947958 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-05572716-2d33-493a-8cdb-ef328a40e841 req-d785fab0-9b6d-42c7-acfd-2ca6eb1023f8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072374 Sep 14 08:49:06.949046 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 179/370] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:49:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:49:06.995596 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=4 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:49:07.148678 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f2201455-83d2-4169-8673-eb5b33429e9b tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:49:07.161648 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f2201455-83d2-4169-8673-eb5b33429e9b tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/0a331816-6b06-40c9-a557-eada274501b5" status: 200 len: 1474 microversion: 2.1 time: 0.269123 Sep 14 08:49:07.163630 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 192/371] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:49:06 2022] GET /compute/v2.1/servers/0a331816-6b06-40c9-a557-eada274501b5 => generated 1474 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:49:07.522202 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d1a3d4a8-6c48-4ada-b583-0270ff1f0e91 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:49:07.524035 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-d1a3d4a8-6c48-4ada-b583-0270ff1f0e91 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] [instance: 22688a6e-8420-49de-b5b7-7368ed55d8da] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:49:07.535906 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d1a3d4a8-6c48-4ada-b583-0270ff1f0e91 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:07.536609 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d1a3d4a8-6c48-4ada-b583-0270ff1f0e91 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:07.537240 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d1a3d4a8-6c48-4ada-b583-0270ff1f0e91 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:07.538057 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d1a3d4a8-6c48-4ada-b583-0270ff1f0e91 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:07.539438 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d1a3d4a8-6c48-4ada-b583-0270ff1f0e91 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:07.540137 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d1a3d4a8-6c48-4ada-b583-0270ff1f0e91 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:07.760806 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9b061141-5e94-48c3-95fa-785cdb9c30d7 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:49:07.761531 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-9b061141-5e94-48c3-95fa-785cdb9c30d7 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] [instance: 17179827-7f78-4a3b-8eaa-766c5fa2b698] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:49:07.774077 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9b061141-5e94-48c3-95fa-785cdb9c30d7 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:07.774950 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9b061141-5e94-48c3-95fa-785cdb9c30d7 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:07.775955 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9b061141-5e94-48c3-95fa-785cdb9c30d7 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:07.781087 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9b061141-5e94-48c3-95fa-785cdb9c30d7 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:07.781087 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9b061141-5e94-48c3-95fa-785cdb9c30d7 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:07.781322 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9b061141-5e94-48c3-95fa-785cdb9c30d7 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:07.813461 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-9b061141-5e94-48c3-95fa-785cdb9c30d7 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] HTTP exception thrown: Instance 17179827-7f78-4a3b-8eaa-766c5fa2b698 could not be found. Sep 14 08:49:07.816384 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9b061141-5e94-48c3-95fa-785cdb9c30d7 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Request method failure captured: Sep 14 08:49:07.816384 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/17179827-7f78-4a3b-8eaa-766c5fa2b698 HTTP/1.1 Sep 14 08:49:07.816384 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 08:49:07.816384 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 08:49:07.816384 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 08:49:07.816384 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 08:49:07.816384 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 08:49:07.816384 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 08:49:07.816384 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 08:49:07.816384 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 08:49:07.816384 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZVNIEX8iYPlKUR_ywYdOfGITcLOqV2CGwAGW2VTuabVjCVwYYuOQLO4_BFaCJ5QRm2P0mlZz36dCRgKBnA28_Q0ZDxtYrrFSbogfjTyIXTTn7T_ZIjvGW-bW59vERHOBj1lwLdINn7o1KjOS6bnOG_sYySVRgUBsKE4CswMVFSXyyc Sep 14 08:49:07.816384 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 08:49:07.816384 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 08:49:07.816384 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 08:49:07.816384 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 08:49:07.816384 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 08:49:07.816384 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 08:49:07.816384 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: eac4d0cae0bd46fda94d7bfb900a0b9a Sep 14 08:49:07.816384 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1089983197 Sep 14 08:49:07.816384 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 08:49:07.816384 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 08:49:07.817651 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/eac4d0cae0bd46fda94d7bfb900a0b9a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_eac4d0cae0bd46fda94d7bfb900a0b9a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/eac4d0cae0bd46fda94d7bfb900a0b9a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/eac4d0cae0bd46fda94d7bfb900a0b9a"}]}] Sep 14 08:49:07.817651 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-DeleteServersAdminTestJSON-1089983197 Sep 14 08:49:07.817651 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: eac4d0cae0bd46fda94d7bfb900a0b9a Sep 14 08:49:07.817651 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1089983197 Sep 14 08:49:07.817651 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-DeleteServersAdminTestJSON-1089983197-project Sep 14 08:49:07.817651 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 08:49:07.817651 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 08:49:07.817651 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 6e462483415e4c2b8a917b2a032e5ac9 Sep 14 08:49:07.817651 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-DeleteServersAdminTestJSON-1089983197-project Sep 14 08:49:07.817651 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 08:49:07.817651 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance 17179827-7f78-4a3b-8eaa-766c5fa2b698 could not be found. Sep 14 08:49:07.817651 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '17179827-7f78-4a3b-8eaa-766c5fa2b698'} Sep 14 08:49:07.818362 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:49:07.818362 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:49:07.818362 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 08:49:07.818362 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 08:49:07.818362 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 08:49:07.818362 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 08:49:07.818362 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 08:49:07.818362 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 08:49:07.818362 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 08:49:07.818362 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 08:49:07.818362 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17179827-7f78-4a3b-8eaa-766c5fa2b698 could not be found. Sep 14 08:49:07.818362 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:49:07.818362 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:49:07.818362 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:49:07.818362 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:49:07.818362 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:49:07.818362 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:49:07.818362 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:49:07.818362 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:49:07.818362 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:49:07.820303 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:49:07.820303 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 08:49:07.820303 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 08:49:07.820303 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 08:49:07.820303 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 08:49:07.820303 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 08:49:07.820303 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 08:49:07.820303 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17179827-7f78-4a3b-8eaa-766c5fa2b698 could not be found. Sep 14 08:49:07.820303 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:49:07.820303 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:49:07.820303 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:49:07.820303 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:49:07.820303 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:49:07.820303 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:49:07.820303 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:49:07.820303 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:49:07.820303 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17179827-7f78-4a3b-8eaa-766c5fa2b698 could not be found. Sep 14 08:49:07.820303 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:49:07.821333 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9b061141-5e94-48c3-95fa-785cdb9c30d7 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Returning 404 to user: Instance 17179827-7f78-4a3b-8eaa-766c5fa2b698 could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:49:07.821333 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-9b061141-5e94-48c3-95fa-785cdb9c30d7 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] 10.222.0.60 "GET /compute/v2.1/servers/17179827-7f78-4a3b-8eaa-766c5fa2b698" status: 404 len: 111 microversion: 2.1 time: 0.061638 Sep 14 08:49:07.823512 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 193/372] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:49:07 2022] GET /compute/v2.1/servers/17179827-7f78-4a3b-8eaa-766c5fa2b698 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 14 08:49:07.830767 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8ffc3892-f2d2-4a65-947e-76bd09976d3e tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:49:07.831597 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-8ffc3892-f2d2-4a65-947e-76bd09976d3e tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] [instance: 17179827-7f78-4a3b-8eaa-766c5fa2b698] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:49:07.843742 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8ffc3892-f2d2-4a65-947e-76bd09976d3e tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:07.844790 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8ffc3892-f2d2-4a65-947e-76bd09976d3e tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:07.848240 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8ffc3892-f2d2-4a65-947e-76bd09976d3e tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:07.849544 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8ffc3892-f2d2-4a65-947e-76bd09976d3e tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:07.850557 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8ffc3892-f2d2-4a65-947e-76bd09976d3e tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:07.851295 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8ffc3892-f2d2-4a65-947e-76bd09976d3e tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:07.881151 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-8ffc3892-f2d2-4a65-947e-76bd09976d3e tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] HTTP exception thrown: Instance 17179827-7f78-4a3b-8eaa-766c5fa2b698 could not be found. Sep 14 08:49:07.885209 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8ffc3892-f2d2-4a65-947e-76bd09976d3e tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Request method failure captured: Sep 14 08:49:07.885209 n-d-836830-18 devstack@n-api.service[128759]: request: DELETE /compute/v2.1/servers/17179827-7f78-4a3b-8eaa-766c5fa2b698 HTTP/1.1 Sep 14 08:49:07.885209 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 08:49:07.885209 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 08:49:07.885209 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 08:49:07.885209 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 08:49:07.885209 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 08:49:07.885209 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 08:49:07.885209 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 08:49:07.885209 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 08:49:07.885209 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZVNIEX8iYPlKUR_ywYdOfGITcLOqV2CGwAGW2VTuabVjCVwYYuOQLO4_BFaCJ5QRm2P0mlZz36dCRgKBnA28_Q0ZDxtYrrFSbogfjTyIXTTn7T_ZIjvGW-bW59vERHOBj1lwLdINn7o1KjOS6bnOG_sYySVRgUBsKE4CswMVFSXyyc Sep 14 08:49:07.885209 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 08:49:07.885209 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 08:49:07.885209 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 08:49:07.885209 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 08:49:07.885209 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 08:49:07.885209 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 08:49:07.885209 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: eac4d0cae0bd46fda94d7bfb900a0b9a Sep 14 08:49:07.885209 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1089983197 Sep 14 08:49:07.885209 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 08:49:07.885209 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 08:49:07.886715 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/eac4d0cae0bd46fda94d7bfb900a0b9a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_eac4d0cae0bd46fda94d7bfb900a0b9a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/eac4d0cae0bd46fda94d7bfb900a0b9a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/eac4d0cae0bd46fda94d7bfb900a0b9a"}]}] Sep 14 08:49:07.886715 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-DeleteServersAdminTestJSON-1089983197 Sep 14 08:49:07.886715 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: eac4d0cae0bd46fda94d7bfb900a0b9a Sep 14 08:49:07.886715 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1089983197 Sep 14 08:49:07.886715 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-DeleteServersAdminTestJSON-1089983197-project Sep 14 08:49:07.886715 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 08:49:07.886715 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 08:49:07.886715 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 6e462483415e4c2b8a917b2a032e5ac9 Sep 14 08:49:07.886715 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-DeleteServersAdminTestJSON-1089983197-project Sep 14 08:49:07.886715 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 08:49:07.886715 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance 17179827-7f78-4a3b-8eaa-766c5fa2b698 could not be found. Sep 14 08:49:07.886715 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '17179827-7f78-4a3b-8eaa-766c5fa2b698'} Sep 14 08:49:07.888130 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:49:07.888130 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:49:07.888130 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 08:49:07.888130 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 08:49:07.888130 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 08:49:07.888130 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 08:49:07.888130 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 08:49:07.888130 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 08:49:07.888130 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 08:49:07.888130 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 08:49:07.888130 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17179827-7f78-4a3b-8eaa-766c5fa2b698 could not be found. Sep 14 08:49:07.888130 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:49:07.888130 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:49:07.888130 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:49:07.888130 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:49:07.888130 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:49:07.888130 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:49:07.888130 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:49:07.888130 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:49:07.888130 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:49:07.891332 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:49:07.891332 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 08:49:07.891332 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 08:49:07.891332 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 08:49:07.891332 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 08:49:07.891332 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 08:49:07.891332 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 08:49:07.891332 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 08:49:07.891332 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 08:49:07.891332 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17179827-7f78-4a3b-8eaa-766c5fa2b698 could not be found. Sep 14 08:49:07.891332 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:49:07.891332 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:49:07.891332 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:49:07.891332 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:49:07.891332 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:49:07.891332 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:49:07.891332 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:49:07.891332 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:49:07.891332 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17179827-7f78-4a3b-8eaa-766c5fa2b698 could not be found. Sep 14 08:49:07.891332 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:49:07.896962 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8ffc3892-f2d2-4a65-947e-76bd09976d3e tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Returning 404 to user: Instance 17179827-7f78-4a3b-8eaa-766c5fa2b698 could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:49:07.898652 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-8ffc3892-f2d2-4a65-947e-76bd09976d3e tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] 10.222.0.60 "DELETE /compute/v2.1/servers/17179827-7f78-4a3b-8eaa-766c5fa2b698" status: 404 len: 111 microversion: 2.1 time: 0.073674 Sep 14 08:49:07.903782 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 194/373] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 08:49:07 2022] DELETE /compute/v2.1/servers/17179827-7f78-4a3b-8eaa-766c5fa2b698 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 08:49:07.917826 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ea102888-1872-47f0-a589-97aec153cfc2 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:49:07.919096 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-ea102888-1872-47f0-a589-97aec153cfc2 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] [instance: 17179827-7f78-4a3b-8eaa-766c5fa2b698] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:49:07.929693 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ea102888-1872-47f0-a589-97aec153cfc2 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:07.931174 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ea102888-1872-47f0-a589-97aec153cfc2 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:07.931990 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ea102888-1872-47f0-a589-97aec153cfc2 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:07.933238 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ea102888-1872-47f0-a589-97aec153cfc2 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:07.934167 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ea102888-1872-47f0-a589-97aec153cfc2 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:07.935299 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ea102888-1872-47f0-a589-97aec153cfc2 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:07.970383 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-ea102888-1872-47f0-a589-97aec153cfc2 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] HTTP exception thrown: Instance 17179827-7f78-4a3b-8eaa-766c5fa2b698 could not be found. Sep 14 08:49:07.975737 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ea102888-1872-47f0-a589-97aec153cfc2 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Request method failure captured: Sep 14 08:49:07.975737 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/17179827-7f78-4a3b-8eaa-766c5fa2b698 HTTP/1.1 Sep 14 08:49:07.975737 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 08:49:07.975737 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 08:49:07.975737 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 08:49:07.975737 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 08:49:07.975737 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 08:49:07.975737 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 08:49:07.975737 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 08:49:07.975737 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 08:49:07.975737 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZVNIEX8iYPlKUR_ywYdOfGITcLOqV2CGwAGW2VTuabVjCVwYYuOQLO4_BFaCJ5QRm2P0mlZz36dCRgKBnA28_Q0ZDxtYrrFSbogfjTyIXTTn7T_ZIjvGW-bW59vERHOBj1lwLdINn7o1KjOS6bnOG_sYySVRgUBsKE4CswMVFSXyyc Sep 14 08:49:07.975737 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 08:49:07.975737 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 08:49:07.975737 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 08:49:07.975737 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 08:49:07.975737 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 08:49:07.975737 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 08:49:07.975737 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: eac4d0cae0bd46fda94d7bfb900a0b9a Sep 14 08:49:07.975737 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1089983197 Sep 14 08:49:07.975737 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 08:49:07.975737 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 08:49:07.977002 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/eac4d0cae0bd46fda94d7bfb900a0b9a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_eac4d0cae0bd46fda94d7bfb900a0b9a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/eac4d0cae0bd46fda94d7bfb900a0b9a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/eac4d0cae0bd46fda94d7bfb900a0b9a"}]}] Sep 14 08:49:07.977002 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-DeleteServersAdminTestJSON-1089983197 Sep 14 08:49:07.977002 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: eac4d0cae0bd46fda94d7bfb900a0b9a Sep 14 08:49:07.977002 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1089983197 Sep 14 08:49:07.977002 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-DeleteServersAdminTestJSON-1089983197-project Sep 14 08:49:07.977002 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 08:49:07.977002 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 08:49:07.977002 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 6e462483415e4c2b8a917b2a032e5ac9 Sep 14 08:49:07.977002 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-DeleteServersAdminTestJSON-1089983197-project Sep 14 08:49:07.977002 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 08:49:07.977002 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance 17179827-7f78-4a3b-8eaa-766c5fa2b698 could not be found. Sep 14 08:49:07.977002 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '17179827-7f78-4a3b-8eaa-766c5fa2b698'} Sep 14 08:49:07.977759 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:49:07.977759 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:49:07.977759 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 08:49:07.977759 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 08:49:07.977759 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 08:49:07.977759 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 08:49:07.977759 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 08:49:07.977759 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 08:49:07.977759 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 08:49:07.977759 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 08:49:07.977759 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17179827-7f78-4a3b-8eaa-766c5fa2b698 could not be found. Sep 14 08:49:07.977759 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:49:07.977759 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:49:07.977759 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:49:07.977759 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:49:07.977759 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:49:07.977759 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:49:07.977759 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:49:07.977759 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:49:07.977759 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:49:07.979028 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:49:07.979028 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 08:49:07.979028 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 08:49:07.979028 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 08:49:07.979028 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 08:49:07.979028 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 08:49:07.979028 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 08:49:07.979028 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17179827-7f78-4a3b-8eaa-766c5fa2b698 could not be found. Sep 14 08:49:07.979028 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:49:07.979028 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:49:07.979028 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:49:07.979028 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:49:07.979028 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:49:07.979028 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:49:07.979028 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:49:07.979028 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:49:07.979028 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17179827-7f78-4a3b-8eaa-766c5fa2b698 could not be found. Sep 14 08:49:07.979028 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:49:07.984309 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ea102888-1872-47f0-a589-97aec153cfc2 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Returning 404 to user: Instance 17179827-7f78-4a3b-8eaa-766c5fa2b698 could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:49:07.988903 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-ea102888-1872-47f0-a589-97aec153cfc2 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] 10.222.0.60 "GET /compute/v2.1/servers/17179827-7f78-4a3b-8eaa-766c5fa2b698" status: 404 len: 111 microversion: 2.1 time: 0.077496 Sep 14 08:49:07.989908 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 195/374] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:49:07 2022] GET /compute/v2.1/servers/17179827-7f78-4a3b-8eaa-766c5fa2b698 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 08:49:08.003012 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-45a2f024-def3-4697-8118-7fe3a9ba70b3 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:49:08.006108 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-45a2f024-def3-4697-8118-7fe3a9ba70b3 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] [instance: 7045fd2e-8224-46b8-b477-57a46e18e93f] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:49:08.026513 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-45a2f024-def3-4697-8118-7fe3a9ba70b3 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:08.027344 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-45a2f024-def3-4697-8118-7fe3a9ba70b3 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:08.029167 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-45a2f024-def3-4697-8118-7fe3a9ba70b3 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:08.034177 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-45a2f024-def3-4697-8118-7fe3a9ba70b3 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:08.034702 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-45a2f024-def3-4697-8118-7fe3a9ba70b3 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:08.035579 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-45a2f024-def3-4697-8118-7fe3a9ba70b3 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:08.077236 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-45a2f024-def3-4697-8118-7fe3a9ba70b3 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] HTTP exception thrown: Instance 7045fd2e-8224-46b8-b477-57a46e18e93f could not be found. Sep 14 08:49:08.078873 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-45a2f024-def3-4697-8118-7fe3a9ba70b3 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Request method failure captured: Sep 14 08:49:08.078873 n-d-836830-18 devstack@n-api.service[128759]: request: DELETE /compute/v2.1/servers/7045fd2e-8224-46b8-b477-57a46e18e93f HTTP/1.1 Sep 14 08:49:08.078873 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 08:49:08.078873 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 08:49:08.078873 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 08:49:08.078873 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 08:49:08.078873 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 08:49:08.078873 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 08:49:08.078873 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 08:49:08.078873 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 08:49:08.078873 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZVNIEX8iYPlKUR_ywYdOfGITcLOqV2CGwAGW2VTuabVjCVwYYuOQLO4_BFaCJ5QRm2P0mlZz36dCRgKBnA28_Q0ZDxtYrrFSbogfjTyIXTTn7T_ZIjvGW-bW59vERHOBj1lwLdINn7o1KjOS6bnOG_sYySVRgUBsKE4CswMVFSXyyc Sep 14 08:49:08.078873 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 08:49:08.078873 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 08:49:08.078873 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 08:49:08.078873 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 08:49:08.078873 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 08:49:08.078873 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 08:49:08.078873 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: eac4d0cae0bd46fda94d7bfb900a0b9a Sep 14 08:49:08.078873 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1089983197 Sep 14 08:49:08.078873 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 08:49:08.078873 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 08:49:08.080334 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/eac4d0cae0bd46fda94d7bfb900a0b9a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_eac4d0cae0bd46fda94d7bfb900a0b9a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/eac4d0cae0bd46fda94d7bfb900a0b9a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/eac4d0cae0bd46fda94d7bfb900a0b9a"}]}] Sep 14 08:49:08.080334 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-DeleteServersAdminTestJSON-1089983197 Sep 14 08:49:08.080334 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: eac4d0cae0bd46fda94d7bfb900a0b9a Sep 14 08:49:08.080334 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1089983197 Sep 14 08:49:08.080334 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-DeleteServersAdminTestJSON-1089983197-project Sep 14 08:49:08.080334 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 08:49:08.080334 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 08:49:08.080334 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 6e462483415e4c2b8a917b2a032e5ac9 Sep 14 08:49:08.080334 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-DeleteServersAdminTestJSON-1089983197-project Sep 14 08:49:08.080334 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 08:49:08.080334 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance 7045fd2e-8224-46b8-b477-57a46e18e93f could not be found. Sep 14 08:49:08.080334 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '7045fd2e-8224-46b8-b477-57a46e18e93f'} Sep 14 08:49:08.081142 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:49:08.081142 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:49:08.081142 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 08:49:08.081142 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 08:49:08.081142 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 08:49:08.081142 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 08:49:08.081142 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 08:49:08.081142 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 08:49:08.081142 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 08:49:08.081142 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 08:49:08.081142 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7045fd2e-8224-46b8-b477-57a46e18e93f could not be found. Sep 14 08:49:08.081142 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:49:08.081142 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:49:08.081142 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:49:08.081142 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:49:08.081142 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:49:08.081142 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:49:08.081142 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:49:08.081142 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:49:08.081142 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:49:08.082433 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:49:08.082433 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 08:49:08.082433 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 08:49:08.082433 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 08:49:08.082433 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 08:49:08.082433 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 08:49:08.082433 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 08:49:08.082433 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 08:49:08.082433 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 08:49:08.082433 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7045fd2e-8224-46b8-b477-57a46e18e93f could not be found. Sep 14 08:49:08.082433 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:49:08.082433 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:49:08.082433 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:49:08.082433 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:49:08.082433 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:49:08.082433 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:49:08.082433 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:49:08.082433 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:49:08.082433 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7045fd2e-8224-46b8-b477-57a46e18e93f could not be found. Sep 14 08:49:08.082433 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:49:08.084454 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-45a2f024-def3-4697-8118-7fe3a9ba70b3 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Returning 404 to user: Instance 7045fd2e-8224-46b8-b477-57a46e18e93f could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:49:08.084454 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-45a2f024-def3-4697-8118-7fe3a9ba70b3 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] 10.222.0.60 "DELETE /compute/v2.1/servers/7045fd2e-8224-46b8-b477-57a46e18e93f" status: 404 len: 111 microversion: 2.1 time: 0.084255 Sep 14 08:49:08.086340 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 196/375] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 08:49:07 2022] DELETE /compute/v2.1/servers/7045fd2e-8224-46b8-b477-57a46e18e93f => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 08:49:08.097238 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a3fc8035-7f9e-499f-a016-c5609e77df54 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:49:08.097868 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-a3fc8035-7f9e-499f-a016-c5609e77df54 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] [instance: 7045fd2e-8224-46b8-b477-57a46e18e93f] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:49:08.112074 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a3fc8035-7f9e-499f-a016-c5609e77df54 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:08.112572 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a3fc8035-7f9e-499f-a016-c5609e77df54 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:08.113014 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a3fc8035-7f9e-499f-a016-c5609e77df54 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:08.113722 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a3fc8035-7f9e-499f-a016-c5609e77df54 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:08.114177 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a3fc8035-7f9e-499f-a016-c5609e77df54 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:08.114603 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a3fc8035-7f9e-499f-a016-c5609e77df54 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:08.159805 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-a3fc8035-7f9e-499f-a016-c5609e77df54 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] HTTP exception thrown: Instance 7045fd2e-8224-46b8-b477-57a46e18e93f could not be found. Sep 14 08:49:08.162163 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a3fc8035-7f9e-499f-a016-c5609e77df54 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Request method failure captured: Sep 14 08:49:08.162163 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/7045fd2e-8224-46b8-b477-57a46e18e93f HTTP/1.1 Sep 14 08:49:08.162163 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 08:49:08.162163 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 08:49:08.162163 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 08:49:08.162163 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 08:49:08.162163 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 08:49:08.162163 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 08:49:08.162163 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 08:49:08.162163 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 08:49:08.162163 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZVNIEX8iYPlKUR_ywYdOfGITcLOqV2CGwAGW2VTuabVjCVwYYuOQLO4_BFaCJ5QRm2P0mlZz36dCRgKBnA28_Q0ZDxtYrrFSbogfjTyIXTTn7T_ZIjvGW-bW59vERHOBj1lwLdINn7o1KjOS6bnOG_sYySVRgUBsKE4CswMVFSXyyc Sep 14 08:49:08.162163 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 08:49:08.162163 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 08:49:08.162163 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 08:49:08.162163 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 08:49:08.162163 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 08:49:08.162163 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 08:49:08.162163 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: eac4d0cae0bd46fda94d7bfb900a0b9a Sep 14 08:49:08.162163 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1089983197 Sep 14 08:49:08.162163 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 08:49:08.162163 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 08:49:08.165129 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/eac4d0cae0bd46fda94d7bfb900a0b9a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_eac4d0cae0bd46fda94d7bfb900a0b9a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/eac4d0cae0bd46fda94d7bfb900a0b9a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/eac4d0cae0bd46fda94d7bfb900a0b9a"}]}] Sep 14 08:49:08.165129 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-DeleteServersAdminTestJSON-1089983197 Sep 14 08:49:08.165129 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: eac4d0cae0bd46fda94d7bfb900a0b9a Sep 14 08:49:08.165129 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1089983197 Sep 14 08:49:08.165129 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-DeleteServersAdminTestJSON-1089983197-project Sep 14 08:49:08.165129 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 08:49:08.165129 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 08:49:08.165129 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 6e462483415e4c2b8a917b2a032e5ac9 Sep 14 08:49:08.165129 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-DeleteServersAdminTestJSON-1089983197-project Sep 14 08:49:08.165129 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 08:49:08.165129 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance 7045fd2e-8224-46b8-b477-57a46e18e93f could not be found. Sep 14 08:49:08.165129 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '7045fd2e-8224-46b8-b477-57a46e18e93f'} Sep 14 08:49:08.165811 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:49:08.165811 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:49:08.165811 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 08:49:08.165811 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 08:49:08.165811 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 08:49:08.165811 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 08:49:08.165811 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 08:49:08.165811 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 08:49:08.165811 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 08:49:08.165811 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 08:49:08.165811 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7045fd2e-8224-46b8-b477-57a46e18e93f could not be found. Sep 14 08:49:08.165811 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:49:08.165811 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:49:08.165811 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:49:08.165811 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:49:08.165811 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:49:08.165811 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:49:08.165811 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:49:08.165811 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:49:08.165811 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:49:08.167554 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:49:08.167554 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 08:49:08.167554 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 08:49:08.167554 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 08:49:08.167554 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 08:49:08.167554 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 08:49:08.167554 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 08:49:08.167554 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7045fd2e-8224-46b8-b477-57a46e18e93f could not be found. Sep 14 08:49:08.167554 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:49:08.167554 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:49:08.167554 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:49:08.167554 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:49:08.167554 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:49:08.167554 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:49:08.167554 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:49:08.167554 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:49:08.167554 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7045fd2e-8224-46b8-b477-57a46e18e93f could not be found. Sep 14 08:49:08.167554 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:49:08.170088 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a3fc8035-7f9e-499f-a016-c5609e77df54 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] Returning 404 to user: Instance 7045fd2e-8224-46b8-b477-57a46e18e93f could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:49:08.170088 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a3fc8035-7f9e-499f-a016-c5609e77df54 tempest-DeleteServersAdminTestJSON-1089983197 tempest-DeleteServersAdminTestJSON-1089983197-project] 10.222.0.60 "GET /compute/v2.1/servers/7045fd2e-8224-46b8-b477-57a46e18e93f" status: 404 len: 111 microversion: 2.1 time: 0.076069 Sep 14 08:49:08.170727 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 197/376] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:49:08 2022] GET /compute/v2.1/servers/7045fd2e-8224-46b8-b477-57a46e18e93f => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 08:49:08.189896 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-32997a04-168d-4ed8-8f24-ddd63dda1319 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:49:08.190443 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-32997a04-168d-4ed8-8f24-ddd63dda1319 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: 0a331816-6b06-40c9-a557-eada274501b5] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:49:08.201790 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-32997a04-168d-4ed8-8f24-ddd63dda1319 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:08.202295 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-32997a04-168d-4ed8-8f24-ddd63dda1319 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:08.202736 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-32997a04-168d-4ed8-8f24-ddd63dda1319 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:08.203475 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-32997a04-168d-4ed8-8f24-ddd63dda1319 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:08.203932 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-32997a04-168d-4ed8-8f24-ddd63dda1319 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:08.204359 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-32997a04-168d-4ed8-8f24-ddd63dda1319 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:08.390823 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-d1a3d4a8-6c48-4ada-b583-0270ff1f0e91 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2ee35c4791437c83193357b4085128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4300dd934369461b9b6ef556246bfc53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:49:08.398602 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-d1a3d4a8-6c48-4ada-b583-0270ff1f0e91 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] 10.222.0.60 "GET /compute/v2.1/servers/22688a6e-8420-49de-b5b7-7368ed55d8da" status: 200 len: 1318 microversion: 2.1 time: 0.882407 Sep 14 08:49:08.399207 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 180/377] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:49:07 2022] GET /compute/v2.1/servers/22688a6e-8420-49de-b5b7-7368ed55d8da => generated 1318 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:49:08.569749 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-91ae547b-b004-4a48-8cde-2a9f1daa975a req-71b8448d-bc62-4bb5-baf8-2eb1a399ea04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22688a6e-8420-49de-b5b7-7368ed55d8da", "name": "network-vif-plugged", "status": "completed", "tag": "edf7e1c4-afe2-4693-9deb-bf04156d3edc"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:49:08.593854 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-91ae547b-b004-4a48-8cde-2a9f1daa975a req-71b8448d-bc62-4bb5-baf8-2eb1a399ea04 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:08.596425 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-91ae547b-b004-4a48-8cde-2a9f1daa975a req-71b8448d-bc62-4bb5-baf8-2eb1a399ea04 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:08.598446 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-91ae547b-b004-4a48-8cde-2a9f1daa975a req-71b8448d-bc62-4bb5-baf8-2eb1a399ea04 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:08.643074 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-91ae547b-b004-4a48-8cde-2a9f1daa975a req-71b8448d-bc62-4bb5-baf8-2eb1a399ea04 service nova] Creating event network-vif-plugged:edf7e1c4-afe2-4693-9deb-bf04156d3edc for instance 22688a6e-8420-49de-b5b7-7368ed55d8da on n-h2-836830-18 Sep 14 08:49:08.663788 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-91ae547b-b004-4a48-8cde-2a9f1daa975a req-71b8448d-bc62-4bb5-baf8-2eb1a399ea04 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096053 Sep 14 08:49:08.667921 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 181/378] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:49:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:49:08.770194 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-32997a04-168d-4ed8-8f24-ddd63dda1319 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:49:08.780217 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-32997a04-168d-4ed8-8f24-ddd63dda1319 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/0a331816-6b06-40c9-a557-eada274501b5" status: 200 len: 1474 microversion: 2.1 time: 0.594052 Sep 14 08:49:08.783993 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 198/379] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:49:08 2022] GET /compute/v2.1/servers/0a331816-6b06-40c9-a557-eada274501b5 => generated 1474 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:49:09.057724 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=11 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:49:09.061566 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=2 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:49:09.429141 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-1964ee62-e633-493e-824e-82311d60cd5b tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:49:09.429738 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-1964ee62-e633-493e-824e-82311d60cd5b tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] [instance: 22688a6e-8420-49de-b5b7-7368ed55d8da] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:49:09.456169 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1964ee62-e633-493e-824e-82311d60cd5b tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:09.461377 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1964ee62-e633-493e-824e-82311d60cd5b tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:09.462332 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1964ee62-e633-493e-824e-82311d60cd5b tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:09.466361 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1964ee62-e633-493e-824e-82311d60cd5b tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:09.470663 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1964ee62-e633-493e-824e-82311d60cd5b tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:09.471847 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1964ee62-e633-493e-824e-82311d60cd5b tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:09.564921 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=24 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:49:09.725138 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-49cc2db3-14e4-4294-8523-20b985f10a1c tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-457960384", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:49:09.835178 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.network.neutron [None req-49cc2db3-14e4-4294-8523-20b985f10a1c tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] validate_networks() for None {{(pid=128758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 08:49:09.946628 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-1964ee62-e633-493e-824e-82311d60cd5b tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2ee35c4791437c83193357b4085128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4300dd934369461b9b6ef556246bfc53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:49:09.957892 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-1964ee62-e633-493e-824e-82311d60cd5b tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] 10.222.0.60 "GET /compute/v2.1/servers/22688a6e-8420-49de-b5b7-7368ed55d8da" status: 200 len: 1318 microversion: 2.1 time: 0.535963 Sep 14 08:49:09.960064 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 199/380] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:49:09 2022] GET /compute/v2.1/servers/22688a6e-8420-49de-b5b7-7368ed55d8da => generated 1318 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:49:09.971147 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d94e5685-e2e6-44c2-a572-5f7d962a43a6 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:49:09.972067 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-d94e5685-e2e6-44c2-a572-5f7d962a43a6 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: 0a331816-6b06-40c9-a557-eada274501b5] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:49:10.020841 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d94e5685-e2e6-44c2-a572-5f7d962a43a6 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:10.024676 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d94e5685-e2e6-44c2-a572-5f7d962a43a6 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.034s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:10.026853 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d94e5685-e2e6-44c2-a572-5f7d962a43a6 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:10.032263 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d94e5685-e2e6-44c2-a572-5f7d962a43a6 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:10.034147 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d94e5685-e2e6-44c2-a572-5f7d962a43a6 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:10.036129 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d94e5685-e2e6-44c2-a572-5f7d962a43a6 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:10.301713 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-49cc2db3-14e4-4294-8523-20b985f10a1c tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Flavor limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 08:49:10.302393 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-49cc2db3-14e4-4294-8523-20b985f10a1c tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Image limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 08:49:10.303072 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-49cc2db3-14e4-4294-8523-20b985f10a1c tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Flavor pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 08:49:10.304256 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-49cc2db3-14e4-4294-8523-20b985f10a1c tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Image pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 08:49:10.304826 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-49cc2db3-14e4-4294-8523-20b985f10a1c tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 08:49:10.322812 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-49cc2db3-14e4-4294-8523-20b985f10a1c tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:10.323692 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-49cc2db3-14e4-4294-8523-20b985f10a1c tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:10.324538 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-49cc2db3-14e4-4294-8523-20b985f10a1c tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:10.331770 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-d94e5685-e2e6-44c2-a572-5f7d962a43a6 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:49:10.335891 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-49cc2db3-14e4-4294-8523-20b985f10a1c tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:10.339902 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-49cc2db3-14e4-4294-8523-20b985f10a1c tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:10.341687 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-49cc2db3-14e4-4294-8523-20b985f10a1c tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:10.345456 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d94e5685-e2e6-44c2-a572-5f7d962a43a6 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/0a331816-6b06-40c9-a557-eada274501b5" status: 200 len: 1474 microversion: 2.1 time: 0.383259 Sep 14 08:49:10.365076 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 200/381] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:49:09 2022] GET /compute/v2.1/servers/0a331816-6b06-40c9-a557-eada274501b5 => generated 1474 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:49:10.379675 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-49cc2db3-14e4-4294-8523-20b985f10a1c tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Getting quotas for project 5e326f95a9604fdb9bd075db3837cf62. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 08:49:10.388075 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-49cc2db3-14e4-4294-8523-20b985f10a1c tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Getting quotas for user 89c7802984cf48d1852832b52abe52e9 and project 5e326f95a9604fdb9bd075db3837cf62. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 08:49:10.411918 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-49cc2db3-14e4-4294-8523-20b985f10a1c tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Going to run 1 instances... {{(pid=128758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 08:49:10.414562 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-49cc2db3-14e4-4294-8523-20b985f10a1c tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] [instance: 307b2830-67e6-44ec-845f-9894de16694a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 08:49:10.539390 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-49cc2db3-14e4-4294-8523-20b985f10a1c tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.504021 Sep 14 08:49:10.540154 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 182/382] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 08:49:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1515 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 08:49:10.552483 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-2e10153e-df2b-45ec-b6e4-75659ea01fa1 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:49:10.553114 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-2e10153e-df2b-45ec-b6e4-75659ea01fa1 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] [instance: 307b2830-67e6-44ec-845f-9894de16694a] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:49:10.696002 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-2e10153e-df2b-45ec-b6e4-75659ea01fa1 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c7802984cf48d1852832b52abe52e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e326f95a9604fdb9bd075db3837cf62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:49:10.704069 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-2e10153e-df2b-45ec-b6e4-75659ea01fa1 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] 10.222.0.60 "GET /compute/v2.1/servers/307b2830-67e6-44ec-845f-9894de16694a" status: 200 len: 1216 microversion: 2.1 time: 0.156320 Sep 14 08:49:10.704934 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 201/383] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:49:10 2022] GET /compute/v2.1/servers/307b2830-67e6-44ec-845f-9894de16694a => generated 1216 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:49:10.991137 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b45a3790-0a7b-4594-a0ee-ff287fd8c9ab tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:49:10.991771 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-b45a3790-0a7b-4594-a0ee-ff287fd8c9ab tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] [instance: 22688a6e-8420-49de-b5b7-7368ed55d8da] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:49:11.002501 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b45a3790-0a7b-4594-a0ee-ff287fd8c9ab tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:11.003716 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b45a3790-0a7b-4594-a0ee-ff287fd8c9ab tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:11.004431 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b45a3790-0a7b-4594-a0ee-ff287fd8c9ab tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:11.006371 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b45a3790-0a7b-4594-a0ee-ff287fd8c9ab tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:11.007308 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b45a3790-0a7b-4594-a0ee-ff287fd8c9ab tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:11.008203 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b45a3790-0a7b-4594-a0ee-ff287fd8c9ab tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:11.269879 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-b45a3790-0a7b-4594-a0ee-ff287fd8c9ab tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2ee35c4791437c83193357b4085128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4300dd934369461b9b6ef556246bfc53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:49:11.281691 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-b45a3790-0a7b-4594-a0ee-ff287fd8c9ab tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] 10.222.0.60 "GET /compute/v2.1/servers/22688a6e-8420-49de-b5b7-7368ed55d8da" status: 200 len: 1468 microversion: 2.1 time: 0.295833 Sep 14 08:49:11.282289 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 183/384] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:49:10 2022] GET /compute/v2.1/servers/22688a6e-8420-49de-b5b7-7368ed55d8da => generated 1468 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:49:11.373028 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ae5eff7a-b535-4fcb-a50e-c84208792e1e tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:49:11.373684 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-ae5eff7a-b535-4fcb-a50e-c84208792e1e tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: 0a331816-6b06-40c9-a557-eada274501b5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:49:11.392641 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ae5eff7a-b535-4fcb-a50e-c84208792e1e tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:11.394181 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ae5eff7a-b535-4fcb-a50e-c84208792e1e tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:11.396631 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ae5eff7a-b535-4fcb-a50e-c84208792e1e tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:11.397755 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ae5eff7a-b535-4fcb-a50e-c84208792e1e tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:11.401079 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ae5eff7a-b535-4fcb-a50e-c84208792e1e tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:11.403976 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ae5eff7a-b535-4fcb-a50e-c84208792e1e tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:11.661607 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-ae5eff7a-b535-4fcb-a50e-c84208792e1e tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:49:11.674252 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-ae5eff7a-b535-4fcb-a50e-c84208792e1e tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/0a331816-6b06-40c9-a557-eada274501b5" status: 200 len: 1474 microversion: 2.1 time: 0.307639 Sep 14 08:49:11.675539 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 184/385] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:49:11 2022] GET /compute/v2.1/servers/0a331816-6b06-40c9-a557-eada274501b5 => generated 1474 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:49:11.731832 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-3793c103-e17e-4abb-bf73-698d81c407c9 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:49:11.732737 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-3793c103-e17e-4abb-bf73-698d81c407c9 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] [instance: 307b2830-67e6-44ec-845f-9894de16694a] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:49:11.739436 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3793c103-e17e-4abb-bf73-698d81c407c9 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:11.740214 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3793c103-e17e-4abb-bf73-698d81c407c9 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:11.741039 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3793c103-e17e-4abb-bf73-698d81c407c9 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:11.742178 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3793c103-e17e-4abb-bf73-698d81c407c9 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:11.742836 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3793c103-e17e-4abb-bf73-698d81c407c9 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:11.744857 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3793c103-e17e-4abb-bf73-698d81c407c9 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:11.823795 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-3793c103-e17e-4abb-bf73-698d81c407c9 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c7802984cf48d1852832b52abe52e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e326f95a9604fdb9bd075db3837cf62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:49:11.824203 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-cb8b8fd5-a386-4e73-bcd3-cfede19b6207 tempest-LiveMigrationNegativeTest-1584437141 tempest-LiveMigrationNegativeTest-1584437141-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-1195118450", "block_migration": true, "disk_over_commit": false}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:49:11.828466 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-cb8b8fd5-a386-4e73-bcd3-cfede19b6207 tempest-LiveMigrationNegativeTest-1584437141 tempest-LiveMigrationNegativeTest-1584437141-project-admin] [instance: 22688a6e-8420-49de-b5b7-7368ed55d8da] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:49:11.835585 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-3793c103-e17e-4abb-bf73-698d81c407c9 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] 10.222.0.60 "GET /compute/v2.1/servers/307b2830-67e6-44ec-845f-9894de16694a" status: 200 len: 1268 microversion: 2.1 time: 0.110152 Sep 14 08:49:11.850856 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 185/386] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:49:11 2022] GET /compute/v2.1/servers/307b2830-67e6-44ec-845f-9894de16694a => generated 1268 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:49:11.851300 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cb8b8fd5-a386-4e73-bcd3-cfede19b6207 tempest-LiveMigrationNegativeTest-1584437141 tempest-LiveMigrationNegativeTest-1584437141-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:11.851300 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cb8b8fd5-a386-4e73-bcd3-cfede19b6207 tempest-LiveMigrationNegativeTest-1584437141 tempest-LiveMigrationNegativeTest-1584437141-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:11.851300 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cb8b8fd5-a386-4e73-bcd3-cfede19b6207 tempest-LiveMigrationNegativeTest-1584437141 tempest-LiveMigrationNegativeTest-1584437141-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:11.851300 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cb8b8fd5-a386-4e73-bcd3-cfede19b6207 tempest-LiveMigrationNegativeTest-1584437141 tempest-LiveMigrationNegativeTest-1584437141-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:11.851588 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cb8b8fd5-a386-4e73-bcd3-cfede19b6207 tempest-LiveMigrationNegativeTest-1584437141 tempest-LiveMigrationNegativeTest-1584437141-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:11.851588 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cb8b8fd5-a386-4e73-bcd3-cfede19b6207 tempest-LiveMigrationNegativeTest-1584437141 tempest-LiveMigrationNegativeTest-1584437141-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:11.935507 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.objects.instance [None req-cb8b8fd5-a386-4e73-bcd3-cfede19b6207 tempest-LiveMigrationNegativeTest-1584437141 tempest-LiveMigrationNegativeTest-1584437141-project-admin] Lazy-loading 'flavor' on Instance uuid 22688a6e-8420-49de-b5b7-7368ed55d8da {{(pid=128759) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 08:49:12.006903 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-cb8b8fd5-a386-4e73-bcd3-cfede19b6207 tempest-LiveMigrationNegativeTest-1584437141 tempest-LiveMigrationNegativeTest-1584437141-project-admin] [instance: 22688a6e-8420-49de-b5b7-7368ed55d8da] Going to try to live migrate instance to tempest-host-1195118450 {{(pid=128759) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 14 08:49:12.024979 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-cb8b8fd5-a386-4e73-bcd3-cfede19b6207 tempest-LiveMigrationNegativeTest-1584437141 tempest-LiveMigrationNegativeTest-1584437141-project-admin] HTTP exception thrown: Compute host tempest-host-1195118450 could not be found. Sep 14 08:49:12.029772 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-cb8b8fd5-a386-4e73-bcd3-cfede19b6207 tempest-LiveMigrationNegativeTest-1584437141 tempest-LiveMigrationNegativeTest-1584437141-project-admin] Request method failure captured: Sep 14 08:49:12.029772 n-d-836830-18 devstack@n-api.service[128759]: request: POST /compute/v2.1/servers/22688a6e-8420-49de-b5b7-7368ed55d8da/action HTTP/1.1 Sep 14 08:49:12.029772 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 08:49:12.029772 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 08:49:12.029772 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 08:49:12.029772 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 107 Sep 14 08:49:12.029772 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 08:49:12.029772 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 08:49:12.029772 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 08:49:12.029772 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 08:49:12.029772 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZV2rxaswoKkceZnRuYlOL7pJqM2-aQdINhwA5OUcgenrMnuj6wMfIfAsFDsqiwrg7ieCKG2Jc5VePvhcMRE3pngnQmeIoVjlswyZPiAV0Kqt0_-QZgO71gjK4uZBRtS70JE_wibpe8ud1FkLQuywH_1KCXI8OleJ9D5gt97Eyqa_aU Sep 14 08:49:12.029772 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 08:49:12.029772 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 08:49:12.029772 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 08:49:12.029772 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 08:49:12.029772 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 08:49:12.029772 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 08:49:12.029772 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: c863a1b7bd81494a96d48aed31019a60 Sep 14 08:49:12.029772 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-LiveMigrationNegativeTest-1584437141 Sep 14 08:49:12.029772 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member,admin Sep 14 08:49:12.029772 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member,admin Sep 14 08:49:12.031107 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c863a1b7bd81494a96d48aed31019a60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c863a1b7bd81494a96d48aed31019a60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c863a1b7bd81494a96d48aed31019a60"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c863a1b7bd81494a96d48aed31019a60"}]}] Sep 14 08:49:12.031107 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-LiveMigrationNegativeTest-1584437141 Sep 14 08:49:12.031107 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: c863a1b7bd81494a96d48aed31019a60 Sep 14 08:49:12.031107 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1584437141 Sep 14 08:49:12.031107 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-LiveMigrationNegativeTest-1584437141-project-admin Sep 14 08:49:12.031107 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 08:49:12.031107 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 08:49:12.031107 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: cd999666d082493fad3a75beb2e08a4d Sep 14 08:49:12.031107 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-LiveMigrationNegativeTest-1584437141-project-admin Sep 14 08:49:12.031107 n-d-836830-18 devstack@n-api.service[128759]: Sep 14 08:49:12.031107 n-d-836830-18 devstack@n-api.service[128759]: {"os-migrateLive": {"host": "tempest-host-1195118450", "block_migration": true, "disk_over_commit": false}} Sep 14 08:49:12.031107 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 08:49:12.031830 n-d-836830-18 devstack@n-api.service[128759]: exception: Compute host tempest-host-1195118450 could not be found. Sep 14 08:49:12.031830 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '22688a6e-8420-49de-b5b7-7368ed55d8da', 'body': {'os-migrateLive': {'host': 'tempest-host-1195118450', 'block_migration': True, 'disk_over_commit': False}}} Sep 14 08:49:12.031830 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:49:12.031830 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:49:12.031830 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Sep 14 08:49:12.031830 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Sep 14 08:49:12.031830 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 14 08:49:12.031830 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 14 08:49:12.031830 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 14 08:49:12.031830 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 14 08:49:12.031830 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Sep 14 08:49:12.031830 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 14 08:49:12.031830 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 14 08:49:12.031830 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 14 08:49:12.031830 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Sep 14 08:49:12.031830 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 14 08:49:12.031830 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Sep 14 08:49:12.031830 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 14 08:49:12.031830 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 14 08:49:12.032889 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 14 08:49:12.032889 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 14 08:49:12.032889 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 14 08:49:12.032889 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5488, in live_migrate Sep 14 08:49:12.032889 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Sep 14 08:49:12.032889 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 14 08:49:12.032889 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 14 08:49:12.032889 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Sep 14 08:49:12.032889 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Sep 14 08:49:12.032889 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Sep 14 08:49:12.032889 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:49:12.032889 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Sep 14 08:49:12.032889 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Sep 14 08:49:12.032889 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Sep 14 08:49:12.032889 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Sep 14 08:49:12.032889 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Sep 14 08:49:12.032889 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Sep 14 08:49:12.032889 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-1195118450 could not be found. Sep 14 08:49:12.032889 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:49:12.033999 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:49:12.033999 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:49:12.033999 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:49:12.033999 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:49:12.033999 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:49:12.033999 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:49:12.033999 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:49:12.033999 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:49:12.033999 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:49:12.033999 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 08:49:12.033999 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 08:49:12.033999 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 08:49:12.033999 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 08:49:12.033999 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 08:49:12.033999 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 08:49:12.033999 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 14 08:49:12.033999 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Sep 14 08:49:12.033999 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 14 08:49:12.033999 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-1195118450 could not be found. Sep 14 08:49:12.033999 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:49:12.035496 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:49:12.035496 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:49:12.035496 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:49:12.035496 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:49:12.035496 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:49:12.035496 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:49:12.035496 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:49:12.035496 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-1195118450 could not be found. Sep 14 08:49:12.035496 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:49:12.037774 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-cb8b8fd5-a386-4e73-bcd3-cfede19b6207 tempest-LiveMigrationNegativeTest-1584437141 tempest-LiveMigrationNegativeTest-1584437141-project-admin] Returning 400 to user: Compute host tempest-host-1195118450 could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:49:12.038864 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-cb8b8fd5-a386-4e73-bcd3-cfede19b6207 tempest-LiveMigrationNegativeTest-1584437141 tempest-LiveMigrationNegativeTest-1584437141-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/22688a6e-8420-49de-b5b7-7368ed55d8da/action" status: 400 len: 100 microversion: 2.1 time: 0.729907 Sep 14 08:49:12.040043 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 202/387] 10.222.0.60 () {60 vars in 1279 bytes} [Wed Sep 14 08:49:11 2022] POST /compute/v2.1/servers/22688a6e-8420-49de-b5b7-7368ed55d8da/action => generated 100 bytes in 732 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 14 08:49:12.049021 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1edeac89-27ea-4e24-a47d-c444ad28486c tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:49:12.049644 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-1edeac89-27ea-4e24-a47d-c444ad28486c tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] [instance: 22688a6e-8420-49de-b5b7-7368ed55d8da] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:49:12.070782 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=2,nova_api:INSERT=5,nova_api:DELETE=3 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:49:12.101115 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1edeac89-27ea-4e24-a47d-c444ad28486c tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:12.104975 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1edeac89-27ea-4e24-a47d-c444ad28486c tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:12.111153 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1edeac89-27ea-4e24-a47d-c444ad28486c tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:12.113546 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1edeac89-27ea-4e24-a47d-c444ad28486c tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:12.120736 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1edeac89-27ea-4e24-a47d-c444ad28486c tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:12.123477 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1edeac89-27ea-4e24-a47d-c444ad28486c tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:12.703588 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-4af61631-c10a-4347-b8f4-b09f9433eb63 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:49:12.704306 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-4af61631-c10a-4347-b8f4-b09f9433eb63 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: 0a331816-6b06-40c9-a557-eada274501b5] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:49:12.727709 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4af61631-c10a-4347-b8f4-b09f9433eb63 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:12.731654 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4af61631-c10a-4347-b8f4-b09f9433eb63 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:12.743640 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4af61631-c10a-4347-b8f4-b09f9433eb63 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:12.744675 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4af61631-c10a-4347-b8f4-b09f9433eb63 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:12.751378 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4af61631-c10a-4347-b8f4-b09f9433eb63 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:12.751976 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4af61631-c10a-4347-b8f4-b09f9433eb63 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:13.139759 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-1edeac89-27ea-4e24-a47d-c444ad28486c tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2ee35c4791437c83193357b4085128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4300dd934369461b9b6ef556246bfc53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:49:13.149542 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-1edeac89-27ea-4e24-a47d-c444ad28486c tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] 10.222.0.60 "GET /compute/v2.1/servers/22688a6e-8420-49de-b5b7-7368ed55d8da" status: 200 len: 1468 microversion: 2.1 time: 1.105362 Sep 14 08:49:13.154928 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 186/388] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:49:12 2022] GET /compute/v2.1/servers/22688a6e-8420-49de-b5b7-7368ed55d8da => generated 1468 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:49:13.176171 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d19bc2a6-7cfb-49ec-bbb5-c4f77d731a59 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:49:13.176845 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-d19bc2a6-7cfb-49ec-bbb5-c4f77d731a59 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] [instance: 307b2830-67e6-44ec-845f-9894de16694a] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:49:13.197452 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d19bc2a6-7cfb-49ec-bbb5-c4f77d731a59 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:13.197967 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d19bc2a6-7cfb-49ec-bbb5-c4f77d731a59 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:13.198412 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d19bc2a6-7cfb-49ec-bbb5-c4f77d731a59 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:13.199177 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d19bc2a6-7cfb-49ec-bbb5-c4f77d731a59 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:13.207214 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d19bc2a6-7cfb-49ec-bbb5-c4f77d731a59 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:13.209491 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d19bc2a6-7cfb-49ec-bbb5-c4f77d731a59 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:13.644628 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-d19bc2a6-7cfb-49ec-bbb5-c4f77d731a59 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c7802984cf48d1852832b52abe52e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e326f95a9604fdb9bd075db3837cf62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:49:13.658152 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-d19bc2a6-7cfb-49ec-bbb5-c4f77d731a59 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] 10.222.0.60 "GET /compute/v2.1/servers/307b2830-67e6-44ec-845f-9894de16694a" status: 200 len: 1274 microversion: 2.1 time: 0.500012 Sep 14 08:49:13.659024 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 187/389] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:49:13 2022] GET /compute/v2.1/servers/307b2830-67e6-44ec-845f-9894de16694a => generated 1274 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:49:13.692335 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-dd575be4-b99e-45df-a5ec-7c8dc63d0a09 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-684963965", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:49:13.806239 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-4af61631-c10a-4347-b8f4-b09f9433eb63 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:49:13.815534 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.network.neutron [None req-dd575be4-b99e-45df-a5ec-7c8dc63d0a09 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] validate_networks() for None {{(pid=128758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 08:49:13.822032 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-4af61631-c10a-4347-b8f4-b09f9433eb63 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/0a331816-6b06-40c9-a557-eada274501b5" status: 200 len: 1474 microversion: 2.1 time: 1.128190 Sep 14 08:49:13.822621 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 203/390] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:49:12 2022] GET /compute/v2.1/servers/0a331816-6b06-40c9-a557-eada274501b5 => generated 1474 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:49:14.682131 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a84bd492-be31-4029-be7b-7ff210f799a7 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:49:14.683298 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-a84bd492-be31-4029-be7b-7ff210f799a7 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] [instance: 307b2830-67e6-44ec-845f-9894de16694a] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:49:14.693657 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a84bd492-be31-4029-be7b-7ff210f799a7 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:14.695689 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a84bd492-be31-4029-be7b-7ff210f799a7 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:14.701316 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a84bd492-be31-4029-be7b-7ff210f799a7 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:14.702300 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a84bd492-be31-4029-be7b-7ff210f799a7 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:14.702977 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a84bd492-be31-4029-be7b-7ff210f799a7 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:14.704110 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a84bd492-be31-4029-be7b-7ff210f799a7 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:14.928149 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-a84bd492-be31-4029-be7b-7ff210f799a7 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c7802984cf48d1852832b52abe52e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e326f95a9604fdb9bd075db3837cf62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:49:14.946268 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a84bd492-be31-4029-be7b-7ff210f799a7 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] 10.222.0.60 "GET /compute/v2.1/servers/307b2830-67e6-44ec-845f-9894de16694a" status: 200 len: 1274 microversion: 2.1 time: 0.268110 Sep 14 08:49:14.947481 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 204/391] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:49:14 2022] GET /compute/v2.1/servers/307b2830-67e6-44ec-845f-9894de16694a => generated 1274 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:49:14.975744 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-dd575be4-b99e-45df-a5ec-7c8dc63d0a09 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Flavor limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 08:49:14.976808 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-dd575be4-b99e-45df-a5ec-7c8dc63d0a09 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Image limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 08:49:14.977466 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-dd575be4-b99e-45df-a5ec-7c8dc63d0a09 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Flavor pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 08:49:14.978055 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-dd575be4-b99e-45df-a5ec-7c8dc63d0a09 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Image pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 08:49:14.978642 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-dd575be4-b99e-45df-a5ec-7c8dc63d0a09 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 08:49:15.001829 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dd575be4-b99e-45df-a5ec-7c8dc63d0a09 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:15.002677 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dd575be4-b99e-45df-a5ec-7c8dc63d0a09 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:15.003311 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dd575be4-b99e-45df-a5ec-7c8dc63d0a09 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:15.004217 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dd575be4-b99e-45df-a5ec-7c8dc63d0a09 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:15.004878 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dd575be4-b99e-45df-a5ec-7c8dc63d0a09 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:15.005480 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dd575be4-b99e-45df-a5ec-7c8dc63d0a09 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:15.046613 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-dd575be4-b99e-45df-a5ec-7c8dc63d0a09 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Getting quotas for project 4300dd934369461b9b6ef556246bfc53. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 08:49:15.064055 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-dd575be4-b99e-45df-a5ec-7c8dc63d0a09 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Getting quotas for user 9e2ee35c4791437c83193357b4085128 and project 4300dd934369461b9b6ef556246bfc53. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 08:49:15.096335 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-dd575be4-b99e-45df-a5ec-7c8dc63d0a09 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Going to run 1 instances... {{(pid=128758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 08:49:15.098861 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-dd575be4-b99e-45df-a5ec-7c8dc63d0a09 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] [instance: b337eb96-57a1-408f-8890-3a0a84e1afa3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 08:49:15.212605 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-dd575be4-b99e-45df-a5ec-7c8dc63d0a09 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.534981 Sep 14 08:49:15.214168 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 188/392] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 08:49:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1555 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 08:49:15.244499 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-9f34a1b3-6851-475a-ad20-02f74129b3d3 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:49:15.245482 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-9f34a1b3-6851-475a-ad20-02f74129b3d3 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: 0a331816-6b06-40c9-a557-eada274501b5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:49:15.288994 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9f34a1b3-6851-475a-ad20-02f74129b3d3 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:15.289853 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9f34a1b3-6851-475a-ad20-02f74129b3d3 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:15.290556 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9f34a1b3-6851-475a-ad20-02f74129b3d3 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:15.291566 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9f34a1b3-6851-475a-ad20-02f74129b3d3 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:15.294831 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9f34a1b3-6851-475a-ad20-02f74129b3d3 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:15.295805 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9f34a1b3-6851-475a-ad20-02f74129b3d3 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:15.360659 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-0d15bc45-7ece-483d-b26e-ddf78435d8a3 tempest-FlavorsAccessTestJSON-181465799 tempest-FlavorsAccessTestJSON-181465799-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-660590538", "id": 723824467, "os-flavor-access:is_public": "False"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:49:15.437311 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-0d15bc45-7ece-483d-b26e-ddf78435d8a3 tempest-FlavorsAccessTestJSON-181465799 tempest-FlavorsAccessTestJSON-181465799-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.488389 Sep 14 08:49:15.448884 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 205/393] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 08:49:14 2022] POST /compute/v2.1/flavors => generated 427 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:49:16.029510 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-1d1de091-ab7e-4058-84ba-d1f5a8d75d61 tempest-AZAdminV2TestJSON-1663395900 tempest-AZAdminV2TestJSON-1663395900-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:49:16.037573 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1d1de091-ab7e-4058-84ba-d1f5a8d75d61 tempest-AZAdminV2TestJSON-1663395900 tempest-AZAdminV2TestJSON-1663395900-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:16.039651 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1d1de091-ab7e-4058-84ba-d1f5a8d75d61 tempest-AZAdminV2TestJSON-1663395900 tempest-AZAdminV2TestJSON-1663395900-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:16.040356 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1d1de091-ab7e-4058-84ba-d1f5a8d75d61 tempest-AZAdminV2TestJSON-1663395900 tempest-AZAdminV2TestJSON-1663395900-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:16.042298 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1d1de091-ab7e-4058-84ba-d1f5a8d75d61 tempest-AZAdminV2TestJSON-1663395900 tempest-AZAdminV2TestJSON-1663395900-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:16.043787 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1d1de091-ab7e-4058-84ba-d1f5a8d75d61 tempest-AZAdminV2TestJSON-1663395900 tempest-AZAdminV2TestJSON-1663395900-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:16.045116 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1d1de091-ab7e-4058-84ba-d1f5a8d75d61 tempest-AZAdminV2TestJSON-1663395900 tempest-AZAdminV2TestJSON-1663395900-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:16.108330 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-1d1de091-ab7e-4058-84ba-d1f5a8d75d61 tempest-AZAdminV2TestJSON-1663395900 tempest-AZAdminV2TestJSON-1663395900-project-admin] 10.222.0.60 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.653157 Sep 14 08:49:16.110230 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 206/394] 10.222.0.60 () {58 vars in 1164 bytes} [Wed Sep 14 08:49:15 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 08:49:16.133985 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d27b446c-d593-4214-a5b7-163b7de39231 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:49:16.134622 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-d27b446c-d593-4214-a5b7-163b7de39231 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] [instance: b337eb96-57a1-408f-8890-3a0a84e1afa3] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:49:16.159161 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d27b446c-d593-4214-a5b7-163b7de39231 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:16.161360 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d27b446c-d593-4214-a5b7-163b7de39231 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:16.161830 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d27b446c-d593-4214-a5b7-163b7de39231 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:16.166925 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d27b446c-d593-4214-a5b7-163b7de39231 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:16.168424 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d27b446c-d593-4214-a5b7-163b7de39231 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:16.169630 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d27b446c-d593-4214-a5b7-163b7de39231 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:16.549957 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-d27b446c-d593-4214-a5b7-163b7de39231 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2ee35c4791437c83193357b4085128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4300dd934369461b9b6ef556246bfc53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:49:16.584621 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d27b446c-d593-4214-a5b7-163b7de39231 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] 10.222.0.60 "GET /compute/v2.1/servers/b337eb96-57a1-408f-8890-3a0a84e1afa3" status: 200 len: 1222 microversion: 2.1 time: 0.467855 Sep 14 08:49:16.592560 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 207/395] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:49:16 2022] GET /compute/v2.1/servers/b337eb96-57a1-408f-8890-3a0a84e1afa3 => generated 1222 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:49:16.601790 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a7916f1f-4787-429a-97c8-b2839003aac7 tempest-FlavorsAccessTestJSON-181465799 tempest-FlavorsAccessTestJSON-181465799-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "6c65369bcbd84dd39e9376a9e314cf98"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:49:16.640740 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-9f34a1b3-6851-475a-ad20-02f74129b3d3 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:49:16.670513 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-9f34a1b3-6851-475a-ad20-02f74129b3d3 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/0a331816-6b06-40c9-a557-eada274501b5" status: 200 len: 1474 microversion: 2.1 time: 1.450918 Sep 14 08:49:16.671769 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 189/396] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:49:15 2022] GET /compute/v2.1/servers/0a331816-6b06-40c9-a557-eada274501b5 => generated 1474 bytes in 1456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:49:16.700494 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-17cc8b01-5431-43b5-a03c-08216c950a6d tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:49:16.701521 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-17cc8b01-5431-43b5-a03c-08216c950a6d tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] [instance: 307b2830-67e6-44ec-845f-9894de16694a] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:49:16.715852 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-17cc8b01-5431-43b5-a03c-08216c950a6d tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:16.716712 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-17cc8b01-5431-43b5-a03c-08216c950a6d tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:16.719128 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-17cc8b01-5431-43b5-a03c-08216c950a6d tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:16.721141 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-17cc8b01-5431-43b5-a03c-08216c950a6d tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:16.724838 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-17cc8b01-5431-43b5-a03c-08216c950a6d tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:16.725404 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-17cc8b01-5431-43b5-a03c-08216c950a6d tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:16.870981 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a7916f1f-4787-429a-97c8-b2839003aac7 tempest-FlavorsAccessTestJSON-181465799 tempest-FlavorsAccessTestJSON-181465799-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors/723824467/action" status: 200 len: 96 microversion: 2.1 time: 0.277116 Sep 14 08:49:16.872316 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 208/397] 10.222.0.60 () {60 vars in 1197 bytes} [Wed Sep 14 08:49:16 2022] POST /compute/v2.1/flavors/723824467/action => generated 96 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 08:49:16.880987 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-7e0cd538-4c85-4b01-908e-266420a1e16b tempest-AZAdminV2TestJSON-1663395900 tempest-AZAdminV2TestJSON-1663395900-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:49:16.882707 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7e0cd538-4c85-4b01-908e-266420a1e16b tempest-AZAdminV2TestJSON-1663395900 tempest-AZAdminV2TestJSON-1663395900-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:16.883280 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7e0cd538-4c85-4b01-908e-266420a1e16b tempest-AZAdminV2TestJSON-1663395900 tempest-AZAdminV2TestJSON-1663395900-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:16.883722 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7e0cd538-4c85-4b01-908e-266420a1e16b tempest-AZAdminV2TestJSON-1663395900 tempest-AZAdminV2TestJSON-1663395900-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:16.884457 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7e0cd538-4c85-4b01-908e-266420a1e16b tempest-AZAdminV2TestJSON-1663395900 tempest-AZAdminV2TestJSON-1663395900-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:16.884915 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7e0cd538-4c85-4b01-908e-266420a1e16b tempest-AZAdminV2TestJSON-1663395900 tempest-AZAdminV2TestJSON-1663395900-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:16.885372 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7e0cd538-4c85-4b01-908e-266420a1e16b tempest-AZAdminV2TestJSON-1663395900 tempest-AZAdminV2TestJSON-1663395900-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:16.952746 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-7e0cd538-4c85-4b01-908e-266420a1e16b tempest-AZAdminV2TestJSON-1663395900 tempest-AZAdminV2TestJSON-1663395900-project-admin] 10.222.0.60 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 615 microversion: 2.1 time: 0.077080 Sep 14 08:49:16.963888 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 209/398] 10.222.0.60 () {58 vars in 1185 bytes} [Wed Sep 14 08:49:16 2022] GET /compute/v2.1/os-availability-zone/detail => generated 615 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:49:16.992353 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-17cc8b01-5431-43b5-a03c-08216c950a6d tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c7802984cf48d1852832b52abe52e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e326f95a9604fdb9bd075db3837cf62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:49:17.050922 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:49:17.068261 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-17cc8b01-5431-43b5-a03c-08216c950a6d tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] 10.222.0.60 "GET /compute/v2.1/servers/307b2830-67e6-44ec-845f-9894de16694a" status: 200 len: 1274 microversion: 2.1 time: 0.392979 Sep 14 08:49:17.072598 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 190/399] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:49:16 2022] GET /compute/v2.1/servers/307b2830-67e6-44ec-845f-9894de16694a => generated 1274 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:49:17.320503 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-2d9ec061-e790-416a-98ee-5ce6f2eacebc tempest-FlavorsAccessTestJSON-376569579 tempest-FlavorsAccessTestJSON-376569579-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:49:17.375140 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-2d9ec061-e790-416a-98ee-5ce6f2eacebc tempest-FlavorsAccessTestJSON-376569579 tempest-FlavorsAccessTestJSON-376569579-project] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 5408 microversion: 2.1 time: 0.409881 Sep 14 08:49:17.375929 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 210/400] 10.222.0.60 () {58 vars in 1146 bytes} [Wed Sep 14 08:49:16 2022] GET /compute/v2.1/flavors/detail => generated 5408 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:49:17.406212 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-31d53537-203b-4969-b2ae-89c89c4f923c tempest-FlavorsAccessTestJSON-181465799 tempest-FlavorsAccessTestJSON-181465799-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "6c65369bcbd84dd39e9376a9e314cf98"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:49:17.620486 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e29bb3fd-3ec3-41d8-92fa-77345473be8a tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:49:17.621380 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e29bb3fd-3ec3-41d8-92fa-77345473be8a tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] [instance: b337eb96-57a1-408f-8890-3a0a84e1afa3] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:49:17.630919 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e29bb3fd-3ec3-41d8-92fa-77345473be8a tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:17.631451 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e29bb3fd-3ec3-41d8-92fa-77345473be8a tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:17.632826 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e29bb3fd-3ec3-41d8-92fa-77345473be8a tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:17.633576 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e29bb3fd-3ec3-41d8-92fa-77345473be8a tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:17.638452 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e29bb3fd-3ec3-41d8-92fa-77345473be8a tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:17.639173 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e29bb3fd-3ec3-41d8-92fa-77345473be8a tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:17.684682 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=100 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:49:17.864696 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-31d53537-203b-4969-b2ae-89c89c4f923c tempest-FlavorsAccessTestJSON-181465799 tempest-FlavorsAccessTestJSON-181465799-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors/723824467/action" status: 200 len: 21 microversion: 2.1 time: 0.460857 Sep 14 08:49:17.869915 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 191/401] 10.222.0.60 () {60 vars in 1197 bytes} [Wed Sep 14 08:49:17 2022] POST /compute/v2.1/flavors/723824467/action => generated 21 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 08:49:17.874272 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-e29bb3fd-3ec3-41d8-92fa-77345473be8a tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2ee35c4791437c83193357b4085128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4300dd934369461b9b6ef556246bfc53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:49:17.881696 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-42b078bc-1caa-4916-9c29-fd76dac060a6 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:49:17.882711 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-42b078bc-1caa-4916-9c29-fd76dac060a6 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: 0a331816-6b06-40c9-a557-eada274501b5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:49:17.883404 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e29bb3fd-3ec3-41d8-92fa-77345473be8a tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] 10.222.0.60 "GET /compute/v2.1/servers/b337eb96-57a1-408f-8890-3a0a84e1afa3" status: 200 len: 1276 microversion: 2.1 time: 0.267744 Sep 14 08:49:17.884002 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 211/402] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:49:17 2022] GET /compute/v2.1/servers/b337eb96-57a1-408f-8890-3a0a84e1afa3 => generated 1276 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:49:17.891229 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-42b078bc-1caa-4916-9c29-fd76dac060a6 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:17.892030 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-42b078bc-1caa-4916-9c29-fd76dac060a6 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:17.894544 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-42b078bc-1caa-4916-9c29-fd76dac060a6 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:17.895614 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-42b078bc-1caa-4916-9c29-fd76dac060a6 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:17.896552 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-42b078bc-1caa-4916-9c29-fd76dac060a6 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:17.900569 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b1750df6-aa8f-4bef-ad7b-ef283b39e331 tempest-FlavorsAccessTestJSON-376569579 tempest-FlavorsAccessTestJSON-376569579-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:49:17.906462 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-42b078bc-1caa-4916-9c29-fd76dac060a6 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:17.945206 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b1750df6-aa8f-4bef-ad7b-ef283b39e331 tempest-FlavorsAccessTestJSON-376569579 tempest-FlavorsAccessTestJSON-376569579-project] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.060113 Sep 14 08:49:17.945812 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 212/403] 10.222.0.60 () {58 vars in 1146 bytes} [Wed Sep 14 08:49:17 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:49:17.964721 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-1a2cc4d1-b740-4528-84e6-62f3af6e0bc4 tempest-FlavorsAccessTestJSON-181465799 tempest-FlavorsAccessTestJSON-181465799-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:49:18.004768 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-1a2cc4d1-b740-4528-84e6-62f3af6e0bc4 tempest-FlavorsAccessTestJSON-181465799 tempest-FlavorsAccessTestJSON-181465799-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/723824467" status: 202 len: 0 microversion: 2.1 time: 0.043507 Sep 14 08:49:18.006275 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 213/404] 10.222.0.60 () {58 vars in 1158 bytes} [Wed Sep 14 08:49:17 2022] DELETE /compute/v2.1/flavors/723824467 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 08:49:18.023889 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-99dee77a-0b53-4e05-ad35-f9a090a03fa3 tempest-FlavorsAccessTestJSON-181465799 tempest-FlavorsAccessTestJSON-181465799-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:49:18.062180 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-99dee77a-0b53-4e05-ad35-f9a090a03fa3 tempest-FlavorsAccessTestJSON-181465799 tempest-FlavorsAccessTestJSON-181465799-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.041790 Sep 14 08:49:18.072142 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 214/405] 10.222.0.60 () {58 vars in 1146 bytes} [Wed Sep 14 08:49:18 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:49:18.092019 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-caa7c9e4-86d2-4402-96cd-6f94627dcd3d tempest-FlavorsAccessTestJSON-181465799 tempest-FlavorsAccessTestJSON-181465799-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-640433224", "id": 1768073753, "os-flavor-access:is_public": "False"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:49:18.128288 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-caa7c9e4-86d2-4402-96cd-6f94627dcd3d tempest-FlavorsAccessTestJSON-181465799 tempest-FlavorsAccessTestJSON-181465799-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.040171 Sep 14 08:49:18.129917 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 215/406] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 08:49:18 2022] POST /compute/v2.1/flavors => generated 430 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 08:49:18.144267 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-75f1d7f9-a1fb-43e3-a95a-3b0851c66603 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:49:18.145383 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-75f1d7f9-a1fb-43e3-a95a-3b0851c66603 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] [instance: 307b2830-67e6-44ec-845f-9894de16694a] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:49:18.153465 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-75f1d7f9-a1fb-43e3-a95a-3b0851c66603 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:18.154129 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-75f1d7f9-a1fb-43e3-a95a-3b0851c66603 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:18.154884 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-75f1d7f9-a1fb-43e3-a95a-3b0851c66603 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:18.155933 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-75f1d7f9-a1fb-43e3-a95a-3b0851c66603 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:18.156558 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-75f1d7f9-a1fb-43e3-a95a-3b0851c66603 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:18.157134 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-75f1d7f9-a1fb-43e3-a95a-3b0851c66603 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:18.474498 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-42b078bc-1caa-4916-9c29-fd76dac060a6 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:49:18.498586 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-42b078bc-1caa-4916-9c29-fd76dac060a6 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/0a331816-6b06-40c9-a557-eada274501b5" status: 200 len: 1474 microversion: 2.1 time: 0.624434 Sep 14 08:49:18.511769 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 192/407] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:49:17 2022] GET /compute/v2.1/servers/0a331816-6b06-40c9-a557-eada274501b5 => generated 1474 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:49:18.529793 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-84ccb1f6-299a-44f2-8f9b-5c106cb9b068 tempest-FlavorsAccessTestJSON-181465799 tempest-FlavorsAccessTestJSON-181465799-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:49:18.578150 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-84ccb1f6-299a-44f2-8f9b-5c106cb9b068 tempest-FlavorsAccessTestJSON-181465799 tempest-FlavorsAccessTestJSON-181465799-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/1768073753/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.062508 Sep 14 08:49:18.580715 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 193/408] 10.222.0.60 () {58 vars in 1209 bytes} [Wed Sep 14 08:49:18 2022] GET /compute/v2.1/flavors/1768073753/os-flavor-access => generated 21 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 08:49:18.591221 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-cebd1dcd-062c-49f3-8e64-f06d3f5ec527 tempest-FlavorsAccessTestJSON-181465799 tempest-FlavorsAccessTestJSON-181465799-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:49:18.643083 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-cebd1dcd-062c-49f3-8e64-f06d3f5ec527 tempest-FlavorsAccessTestJSON-181465799 tempest-FlavorsAccessTestJSON-181465799-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/1768073753" status: 202 len: 0 microversion: 2.1 time: 0.055954 Sep 14 08:49:18.644002 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 194/409] 10.222.0.60 () {58 vars in 1161 bytes} [Wed Sep 14 08:49:18 2022] DELETE /compute/v2.1/flavors/1768073753 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 08:49:18.651491 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-374ad96b-504a-4c9d-aab2-ee07931f7bc5 tempest-FlavorsAccessTestJSON-181465799 tempest-FlavorsAccessTestJSON-181465799-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:49:18.693829 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-374ad96b-504a-4c9d-aab2-ee07931f7bc5 tempest-FlavorsAccessTestJSON-181465799 tempest-FlavorsAccessTestJSON-181465799-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.045865 Sep 14 08:49:18.696929 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 195/410] 10.222.0.60 () {58 vars in 1146 bytes} [Wed Sep 14 08:49:18 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:49:18.913754 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-10d411fc-a808-4626-9a38-39b838dc38f1 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:49:18.914612 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-10d411fc-a808-4626-9a38-39b838dc38f1 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] [instance: b337eb96-57a1-408f-8890-3a0a84e1afa3] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:49:18.931648 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-10d411fc-a808-4626-9a38-39b838dc38f1 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:18.936693 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-10d411fc-a808-4626-9a38-39b838dc38f1 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:18.937854 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-10d411fc-a808-4626-9a38-39b838dc38f1 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:18.942003 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-10d411fc-a808-4626-9a38-39b838dc38f1 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:18.943728 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-10d411fc-a808-4626-9a38-39b838dc38f1 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:18.944918 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-10d411fc-a808-4626-9a38-39b838dc38f1 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:19.080976 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-75f1d7f9-a1fb-43e3-a95a-3b0851c66603 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c7802984cf48d1852832b52abe52e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e326f95a9604fdb9bd075db3837cf62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:49:19.083973 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-75f1d7f9-a1fb-43e3-a95a-3b0851c66603 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] 10.222.0.60 "GET /compute/v2.1/servers/307b2830-67e6-44ec-845f-9894de16694a" status: 200 len: 1316 microversion: 2.1 time: 0.949852 Sep 14 08:49:19.088962 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 216/411] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:49:18 2022] GET /compute/v2.1/servers/307b2830-67e6-44ec-845f-9894de16694a => generated 1316 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:49:19.172848 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-10d411fc-a808-4626-9a38-39b838dc38f1 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2ee35c4791437c83193357b4085128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4300dd934369461b9b6ef556246bfc53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:49:19.185479 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-10d411fc-a808-4626-9a38-39b838dc38f1 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] 10.222.0.60 "GET /compute/v2.1/servers/b337eb96-57a1-408f-8890-3a0a84e1afa3" status: 200 len: 1276 microversion: 2.1 time: 0.277881 Sep 14 08:49:19.186070 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 196/412] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:49:18 2022] GET /compute/v2.1/servers/b337eb96-57a1-408f-8890-3a0a84e1afa3 => generated 1276 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:49:19.546297 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-907d21c7-d0fa-4496-99ef-c5d97edbf146 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:49:19.548649 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-907d21c7-d0fa-4496-99ef-c5d97edbf146 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: 0a331816-6b06-40c9-a557-eada274501b5] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:49:19.561275 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-907d21c7-d0fa-4496-99ef-c5d97edbf146 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:19.564793 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-907d21c7-d0fa-4496-99ef-c5d97edbf146 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:19.565495 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-907d21c7-d0fa-4496-99ef-c5d97edbf146 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:19.567381 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-907d21c7-d0fa-4496-99ef-c5d97edbf146 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:19.580731 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-907d21c7-d0fa-4496-99ef-c5d97edbf146 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:19.581520 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-907d21c7-d0fa-4496-99ef-c5d97edbf146 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:20.113693 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-8681b97e-83aa-45c2-ae09-35771a52ab9a tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:49:20.114498 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-8681b97e-83aa-45c2-ae09-35771a52ab9a tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] [instance: 307b2830-67e6-44ec-845f-9894de16694a] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:49:20.127144 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8681b97e-83aa-45c2-ae09-35771a52ab9a tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:20.128074 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8681b97e-83aa-45c2-ae09-35771a52ab9a tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:20.130083 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8681b97e-83aa-45c2-ae09-35771a52ab9a tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:20.131068 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8681b97e-83aa-45c2-ae09-35771a52ab9a tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:20.133187 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8681b97e-83aa-45c2-ae09-35771a52ab9a tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:20.134681 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8681b97e-83aa-45c2-ae09-35771a52ab9a tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:20.252901 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-907d21c7-d0fa-4496-99ef-c5d97edbf146 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:49:20.266537 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-907d21c7-d0fa-4496-99ef-c5d97edbf146 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/0a331816-6b06-40c9-a557-eada274501b5" status: 200 len: 1474 microversion: 2.1 time: 0.744639 Sep 14 08:49:20.270292 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 217/413] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:49:19 2022] GET /compute/v2.1/servers/0a331816-6b06-40c9-a557-eada274501b5 => generated 1474 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:49:20.284054 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ac5ba7f6-a858-4792-b1f0-cbe9e3e618c9 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:49:20.284997 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-ac5ba7f6-a858-4792-b1f0-cbe9e3e618c9 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] [instance: b337eb96-57a1-408f-8890-3a0a84e1afa3] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:49:20.299415 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ac5ba7f6-a858-4792-b1f0-cbe9e3e618c9 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:20.302956 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ac5ba7f6-a858-4792-b1f0-cbe9e3e618c9 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:20.306436 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ac5ba7f6-a858-4792-b1f0-cbe9e3e618c9 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:20.307961 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ac5ba7f6-a858-4792-b1f0-cbe9e3e618c9 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:20.312948 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ac5ba7f6-a858-4792-b1f0-cbe9e3e618c9 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:20.314284 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ac5ba7f6-a858-4792-b1f0-cbe9e3e618c9 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:20.505654 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-ac5ba7f6-a858-4792-b1f0-cbe9e3e618c9 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2ee35c4791437c83193357b4085128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4300dd934369461b9b6ef556246bfc53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:49:20.521565 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-ac5ba7f6-a858-4792-b1f0-cbe9e3e618c9 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] 10.222.0.60 "GET /compute/v2.1/servers/b337eb96-57a1-408f-8890-3a0a84e1afa3" status: 200 len: 1276 microversion: 2.1 time: 0.247272 Sep 14 08:49:20.522604 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 218/414] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:49:20 2022] GET /compute/v2.1/servers/b337eb96-57a1-408f-8890-3a0a84e1afa3 => generated 1276 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:49:20.765582 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-8681b97e-83aa-45c2-ae09-35771a52ab9a tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c7802984cf48d1852832b52abe52e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e326f95a9604fdb9bd075db3837cf62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:49:20.775848 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-8681b97e-83aa-45c2-ae09-35771a52ab9a tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] 10.222.0.60 "GET /compute/v2.1/servers/307b2830-67e6-44ec-845f-9894de16694a" status: 200 len: 1316 microversion: 2.1 time: 0.665967 Sep 14 08:49:20.808092 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 197/415] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:49:20 2022] GET /compute/v2.1/servers/307b2830-67e6-44ec-845f-9894de16694a => generated 1316 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:49:21.026389 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-4df9f2eb-120b-4446-8a68-61f3a03eb74d req-3d13b834-b67b-453d-8b2b-a2902c0aa9c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "307b2830-67e6-44ec-845f-9894de16694a", "tag": "bfa5166f-08ce-4ac5-b444-021ba67b84d5"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:49:21.057717 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=2 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:49:21.062845 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-4df9f2eb-120b-4446-8a68-61f3a03eb74d req-3d13b834-b67b-453d-8b2b-a2902c0aa9c2 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:21.063737 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-4df9f2eb-120b-4446-8a68-61f3a03eb74d req-3d13b834-b67b-453d-8b2b-a2902c0aa9c2 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:21.065215 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-4df9f2eb-120b-4446-8a68-61f3a03eb74d req-3d13b834-b67b-453d-8b2b-a2902c0aa9c2 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:21.097725 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-4df9f2eb-120b-4446-8a68-61f3a03eb74d req-3d13b834-b67b-453d-8b2b-a2902c0aa9c2 service nova] Creating event network-changed:bfa5166f-08ce-4ac5-b444-021ba67b84d5 for instance 307b2830-67e6-44ec-845f-9894de16694a on n-h1-836830-18 Sep 14 08:49:21.114170 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-4df9f2eb-120b-4446-8a68-61f3a03eb74d req-3d13b834-b67b-453d-8b2b-a2902c0aa9c2 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091381 Sep 14 08:49:21.115761 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 219/416] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:49:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:49:21.294056 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-635e7c01-3adb-468d-a314-0d37d65b1ec1 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:49:21.295452 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-635e7c01-3adb-468d-a314-0d37d65b1ec1 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: 0a331816-6b06-40c9-a557-eada274501b5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:49:21.310577 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-635e7c01-3adb-468d-a314-0d37d65b1ec1 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:21.315934 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-635e7c01-3adb-468d-a314-0d37d65b1ec1 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:21.316450 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-635e7c01-3adb-468d-a314-0d37d65b1ec1 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:21.317204 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-635e7c01-3adb-468d-a314-0d37d65b1ec1 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:21.317674 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-635e7c01-3adb-468d-a314-0d37d65b1ec1 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:21.318124 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-635e7c01-3adb-468d-a314-0d37d65b1ec1 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:21.559505 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-aef1b9f0-59a0-4d22-8283-db01a7a9bb6f tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:49:21.569758 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-aef1b9f0-59a0-4d22-8283-db01a7a9bb6f tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] [instance: b337eb96-57a1-408f-8890-3a0a84e1afa3] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:49:21.595455 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-aef1b9f0-59a0-4d22-8283-db01a7a9bb6f tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:21.597557 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-aef1b9f0-59a0-4d22-8283-db01a7a9bb6f tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:21.598015 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-aef1b9f0-59a0-4d22-8283-db01a7a9bb6f tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:21.598768 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-aef1b9f0-59a0-4d22-8283-db01a7a9bb6f tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:21.601837 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-aef1b9f0-59a0-4d22-8283-db01a7a9bb6f tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:21.603130 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-aef1b9f0-59a0-4d22-8283-db01a7a9bb6f tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:22.161388 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-635e7c01-3adb-468d-a314-0d37d65b1ec1 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:49:22.174685 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-635e7c01-3adb-468d-a314-0d37d65b1ec1 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/0a331816-6b06-40c9-a557-eada274501b5" status: 200 len: 1474 microversion: 2.1 time: 0.884298 Sep 14 08:49:22.187479 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 198/417] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:49:21 2022] GET /compute/v2.1/servers/0a331816-6b06-40c9-a557-eada274501b5 => generated 1474 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:49:22.199138 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-6323f681-b6b8-48a4-8af2-973c142359f7 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:49:22.200658 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-6323f681-b6b8-48a4-8af2-973c142359f7 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] [instance: 307b2830-67e6-44ec-845f-9894de16694a] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:49:22.207922 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6323f681-b6b8-48a4-8af2-973c142359f7 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:22.208838 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6323f681-b6b8-48a4-8af2-973c142359f7 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:22.210348 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6323f681-b6b8-48a4-8af2-973c142359f7 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:22.212617 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6323f681-b6b8-48a4-8af2-973c142359f7 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:22.213779 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6323f681-b6b8-48a4-8af2-973c142359f7 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:22.214748 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6323f681-b6b8-48a4-8af2-973c142359f7 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:22.480670 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-aef1b9f0-59a0-4d22-8283-db01a7a9bb6f tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2ee35c4791437c83193357b4085128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4300dd934369461b9b6ef556246bfc53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:49:22.489920 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-aef1b9f0-59a0-4d22-8283-db01a7a9bb6f tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] 10.222.0.60 "GET /compute/v2.1/servers/b337eb96-57a1-408f-8890-3a0a84e1afa3" status: 200 len: 1318 microversion: 2.1 time: 0.947247 Sep 14 08:49:22.492152 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 220/418] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:49:21 2022] GET /compute/v2.1/servers/b337eb96-57a1-408f-8890-3a0a84e1afa3 => generated 1318 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:49:22.822923 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-6323f681-b6b8-48a4-8af2-973c142359f7 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c7802984cf48d1852832b52abe52e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e326f95a9604fdb9bd075db3837cf62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:49:22.844374 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-6323f681-b6b8-48a4-8af2-973c142359f7 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] 10.222.0.60 "GET /compute/v2.1/servers/307b2830-67e6-44ec-845f-9894de16694a" status: 200 len: 1316 microversion: 2.1 time: 0.646462 Sep 14 08:49:22.859710 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 199/419] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:49:22 2022] GET /compute/v2.1/servers/307b2830-67e6-44ec-845f-9894de16694a => generated 1316 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:49:23.202240 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a12a1e6f-39fc-4b44-8b29-2687a7e41129 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:49:23.203487 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-a12a1e6f-39fc-4b44-8b29-2687a7e41129 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: 0a331816-6b06-40c9-a557-eada274501b5] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:49:23.209887 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a12a1e6f-39fc-4b44-8b29-2687a7e41129 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:23.210679 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a12a1e6f-39fc-4b44-8b29-2687a7e41129 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:23.211444 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a12a1e6f-39fc-4b44-8b29-2687a7e41129 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:23.212692 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a12a1e6f-39fc-4b44-8b29-2687a7e41129 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:23.213413 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a12a1e6f-39fc-4b44-8b29-2687a7e41129 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:23.214059 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a12a1e6f-39fc-4b44-8b29-2687a7e41129 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:23.515295 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ea24ac5b-e807-4e3b-abae-8c2698659adf tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:49:23.515922 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-ea24ac5b-e807-4e3b-abae-8c2698659adf tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] [instance: b337eb96-57a1-408f-8890-3a0a84e1afa3] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:49:23.526901 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ea24ac5b-e807-4e3b-abae-8c2698659adf tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:23.539340 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ea24ac5b-e807-4e3b-abae-8c2698659adf tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:23.539900 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ea24ac5b-e807-4e3b-abae-8c2698659adf tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:23.540667 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ea24ac5b-e807-4e3b-abae-8c2698659adf tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:23.541311 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ea24ac5b-e807-4e3b-abae-8c2698659adf tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:23.541893 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ea24ac5b-e807-4e3b-abae-8c2698659adf tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:23.922133 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-a12a1e6f-39fc-4b44-8b29-2687a7e41129 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:49:23.935652 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a12a1e6f-39fc-4b44-8b29-2687a7e41129 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/0a331816-6b06-40c9-a557-eada274501b5" status: 200 len: 1474 microversion: 2.1 time: 0.738108 Sep 14 08:49:23.940026 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 221/420] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:49:23 2022] GET /compute/v2.1/servers/0a331816-6b06-40c9-a557-eada274501b5 => generated 1474 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:49:24.539686 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-871fb453-9610-43b0-af57-002d14b7eb53 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-1098482151", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "networks": [{"uuid": "cb8bf0a7-4184-4ca4-bffa-150d2b18bef7"}]}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:49:24.611633 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-ea24ac5b-e807-4e3b-abae-8c2698659adf tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2ee35c4791437c83193357b4085128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4300dd934369461b9b6ef556246bfc53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:49:24.642673 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-ea24ac5b-e807-4e3b-abae-8c2698659adf tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] 10.222.0.60 "GET /compute/v2.1/servers/b337eb96-57a1-408f-8890-3a0a84e1afa3" status: 200 len: 1318 microversion: 2.1 time: 1.130209 Sep 14 08:49:24.644913 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 200/421] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:49:23 2022] GET /compute/v2.1/servers/b337eb96-57a1-408f-8890-3a0a84e1afa3 => generated 1318 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:49:24.683121 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-e75f5b93-fd79-46ae-aa86-a8fc84716764 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:49:24.686164 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-e75f5b93-fd79-46ae-aa86-a8fc84716764 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] [instance: 307b2830-67e6-44ec-845f-9894de16694a] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:49:24.701919 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.network.neutron [None req-871fb453-9610-43b0-af57-002d14b7eb53 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] validate_networks() for [('cb8bf0a7-4184-4ca4-bffa-150d2b18bef7', None, None, None, None, None)] {{(pid=128759) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 08:49:24.727109 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e75f5b93-fd79-46ae-aa86-a8fc84716764 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:24.731439 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e75f5b93-fd79-46ae-aa86-a8fc84716764 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:24.735815 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e75f5b93-fd79-46ae-aa86-a8fc84716764 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:24.738660 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e75f5b93-fd79-46ae-aa86-a8fc84716764 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:24.741694 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e75f5b93-fd79-46ae-aa86-a8fc84716764 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:24.753636 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e75f5b93-fd79-46ae-aa86-a8fc84716764 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:25.020789 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=4 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:49:25.080587 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=12 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:49:26.031063 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-e75f5b93-fd79-46ae-aa86-a8fc84716764 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c7802984cf48d1852832b52abe52e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e326f95a9604fdb9bd075db3837cf62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:49:26.047489 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-e75f5b93-fd79-46ae-aa86-a8fc84716764 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] 10.222.0.60 "GET /compute/v2.1/servers/307b2830-67e6-44ec-845f-9894de16694a" status: 200 len: 1316 microversion: 2.1 time: 1.397880 Sep 14 08:49:26.050994 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 201/422] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:49:24 2022] GET /compute/v2.1/servers/307b2830-67e6-44ec-845f-9894de16694a => generated 1316 bytes in 1405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:49:26.082820 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-db052cf0-f505-4e6c-99da-aa145875baf9 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:49:26.083899 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-db052cf0-f505-4e6c-99da-aa145875baf9 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: 0a331816-6b06-40c9-a557-eada274501b5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:49:26.111220 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-db052cf0-f505-4e6c-99da-aa145875baf9 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:26.111971 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-db052cf0-f505-4e6c-99da-aa145875baf9 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:26.112657 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-db052cf0-f505-4e6c-99da-aa145875baf9 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:26.132067 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-db052cf0-f505-4e6c-99da-aa145875baf9 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:26.132897 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-db052cf0-f505-4e6c-99da-aa145875baf9 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:26.134514 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-db052cf0-f505-4e6c-99da-aa145875baf9 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:26.901560 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=4 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:49:27.424609 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-db052cf0-f505-4e6c-99da-aa145875baf9 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:49:27.434123 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-db052cf0-f505-4e6c-99da-aa145875baf9 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/0a331816-6b06-40c9-a557-eada274501b5" status: 200 len: 1473 microversion: 2.1 time: 1.380071 Sep 14 08:49:27.447849 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 202/423] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:49:26 2022] GET /compute/v2.1/servers/0a331816-6b06-40c9-a557-eada274501b5 => generated 1473 bytes in 1396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:49:27.454245 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-aec1c30e-30b5-4d27-bf5b-6a80379020cb tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:49:27.462437 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-aec1c30e-30b5-4d27-bf5b-6a80379020cb tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] [instance: b337eb96-57a1-408f-8890-3a0a84e1afa3] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:49:27.477306 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-aec1c30e-30b5-4d27-bf5b-6a80379020cb tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:27.478180 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-aec1c30e-30b5-4d27-bf5b-6a80379020cb tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:27.479468 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-aec1c30e-30b5-4d27-bf5b-6a80379020cb tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:27.481128 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-aec1c30e-30b5-4d27-bf5b-6a80379020cb tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:27.488292 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-aec1c30e-30b5-4d27-bf5b-6a80379020cb tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:27.489317 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-aec1c30e-30b5-4d27-bf5b-6a80379020cb tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:27.744136 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-871fb453-9610-43b0-af57-002d14b7eb53 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Flavor limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 08:49:27.745363 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-871fb453-9610-43b0-af57-002d14b7eb53 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Image limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 08:49:27.747058 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-871fb453-9610-43b0-af57-002d14b7eb53 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Flavor pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 08:49:27.747916 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-871fb453-9610-43b0-af57-002d14b7eb53 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Image pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 08:49:27.748565 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-871fb453-9610-43b0-af57-002d14b7eb53 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 08:49:27.769369 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-871fb453-9610-43b0-af57-002d14b7eb53 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:27.775255 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-871fb453-9610-43b0-af57-002d14b7eb53 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:27.776058 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-871fb453-9610-43b0-af57-002d14b7eb53 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:27.777099 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-871fb453-9610-43b0-af57-002d14b7eb53 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:27.777807 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-871fb453-9610-43b0-af57-002d14b7eb53 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:27.778479 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-871fb453-9610-43b0-af57-002d14b7eb53 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:27.825889 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-871fb453-9610-43b0-af57-002d14b7eb53 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Getting quotas for project 919dd9619fb24ee281cf6d96cf3351df. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 08:49:27.837752 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-871fb453-9610-43b0-af57-002d14b7eb53 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Getting quotas for user 2290f39b61044661aa9bec206794a5c8 and project 919dd9619fb24ee281cf6d96cf3351df. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 08:49:27.864982 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-871fb453-9610-43b0-af57-002d14b7eb53 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Going to run 1 instances... {{(pid=128759) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 08:49:27.872152 n-d-836830-18 devstack@n-api.service[128759]: WARNING nova.utils [None req-871fb453-9610-43b0-af57-002d14b7eb53 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Hostname tempest-FloatingIPsAssociationNegativeTestJSON-server-1098482151 is longer than 63, truncate it to tempest-FloatingIPsAssociationNegativeTestJSON-server-109848215 Sep 14 08:49:27.877415 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-871fb453-9610-43b0-af57-002d14b7eb53 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] [instance: c402c828-5101-40cc-8ac8-b3d1470028ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128759) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 08:49:27.932554 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:DELETE=3 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:49:27.982668 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-871fb453-9610-43b0-af57-002d14b7eb53 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.038172 Sep 14 08:49:27.984171 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 222/424] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 08:49:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 4043 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 08:49:27.995097 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-c97ba615-9f4b-4f35-b47e-f0a45cfa86fe req-324531f2-85fd-4f7e-80ff-799d16d6197c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b337eb96-57a1-408f-8890-3a0a84e1afa3", "tag": "3a8201ea-e8bb-4c3a-9174-e0e422931f12"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:49:28.019515 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-c97ba615-9f4b-4f35-b47e-f0a45cfa86fe req-324531f2-85fd-4f7e-80ff-799d16d6197c service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:28.026508 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-c97ba615-9f4b-4f35-b47e-f0a45cfa86fe req-324531f2-85fd-4f7e-80ff-799d16d6197c service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:28.027368 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-c97ba615-9f4b-4f35-b47e-f0a45cfa86fe req-324531f2-85fd-4f7e-80ff-799d16d6197c service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:28.059526 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-c97ba615-9f4b-4f35-b47e-f0a45cfa86fe req-324531f2-85fd-4f7e-80ff-799d16d6197c service nova] Creating event network-changed:3a8201ea-e8bb-4c3a-9174-e0e422931f12 for instance b337eb96-57a1-408f-8890-3a0a84e1afa3 on n-h2-836830-18 Sep 14 08:49:28.080888 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-c97ba615-9f4b-4f35-b47e-f0a45cfa86fe req-324531f2-85fd-4f7e-80ff-799d16d6197c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093980 Sep 14 08:49:28.081927 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 223/425] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:49:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:49:28.090282 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9ff3c183-9f34-4dd5-b9ea-c53f26e0be4b tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:49:28.091475 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-9ff3c183-9f34-4dd5-b9ea-c53f26e0be4b tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] [instance: 307b2830-67e6-44ec-845f-9894de16694a] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:49:28.104859 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9ff3c183-9f34-4dd5-b9ea-c53f26e0be4b tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:28.107730 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9ff3c183-9f34-4dd5-b9ea-c53f26e0be4b tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:28.108392 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9ff3c183-9f34-4dd5-b9ea-c53f26e0be4b tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:28.109353 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9ff3c183-9f34-4dd5-b9ea-c53f26e0be4b tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:28.112004 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9ff3c183-9f34-4dd5-b9ea-c53f26e0be4b tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:28.112682 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9ff3c183-9f34-4dd5-b9ea-c53f26e0be4b tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:28.932080 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-aec1c30e-30b5-4d27-bf5b-6a80379020cb tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2ee35c4791437c83193357b4085128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4300dd934369461b9b6ef556246bfc53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:49:28.948715 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-aec1c30e-30b5-4d27-bf5b-6a80379020cb tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] 10.222.0.60 "GET /compute/v2.1/servers/b337eb96-57a1-408f-8890-3a0a84e1afa3" status: 200 len: 1318 microversion: 2.1 time: 1.497847 Sep 14 08:49:28.950984 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 203/426] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:49:27 2022] GET /compute/v2.1/servers/b337eb96-57a1-408f-8890-3a0a84e1afa3 => generated 1318 bytes in 1502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:49:29.289672 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b1f05876-138d-4383-b925-85b0f66f3c70 tempest-HypervisorAdminNegativeUnderV252Test-1964544192 tempest-HypervisorAdminNegativeUnderV252Test-1964544192-project-admin] Calling method '.version_select at 0x7f7d44cdf0d0>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:49:29.291721 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b1f05876-138d-4383-b925-85b0f66f3c70 tempest-HypervisorAdminNegativeUnderV252Test-1964544192 tempest-HypervisorAdminNegativeUnderV252Test-1964544192-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:29.292498 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b1f05876-138d-4383-b925-85b0f66f3c70 tempest-HypervisorAdminNegativeUnderV252Test-1964544192 tempest-HypervisorAdminNegativeUnderV252Test-1964544192-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:29.293993 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b1f05876-138d-4383-b925-85b0f66f3c70 tempest-HypervisorAdminNegativeUnderV252Test-1964544192 tempest-HypervisorAdminNegativeUnderV252Test-1964544192-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:29.312749 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b1f05876-138d-4383-b925-85b0f66f3c70 tempest-HypervisorAdminNegativeUnderV252Test-1964544192 tempest-HypervisorAdminNegativeUnderV252Test-1964544192-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:29.313644 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b1f05876-138d-4383-b925-85b0f66f3c70 tempest-HypervisorAdminNegativeUnderV252Test-1964544192 tempest-HypervisorAdminNegativeUnderV252Test-1964544192-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:29.314602 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b1f05876-138d-4383-b925-85b0f66f3c70 tempest-HypervisorAdminNegativeUnderV252Test-1964544192 tempest-HypervisorAdminNegativeUnderV252Test-1964544192-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:29.328734 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b1f05876-138d-4383-b925-85b0f66f3c70 tempest-HypervisorAdminNegativeUnderV252Test-1964544192 tempest-HypervisorAdminNegativeUnderV252Test-1964544192-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:29.329899 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b1f05876-138d-4383-b925-85b0f66f3c70 tempest-HypervisorAdminNegativeUnderV252Test-1964544192 tempest-HypervisorAdminNegativeUnderV252Test-1964544192-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:29.330559 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b1f05876-138d-4383-b925-85b0f66f3c70 tempest-HypervisorAdminNegativeUnderV252Test-1964544192 tempest-HypervisorAdminNegativeUnderV252Test-1964544192-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:29.338605 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-b1f05876-138d-4383-b925-85b0f66f3c70 tempest-HypervisorAdminNegativeUnderV252Test-1964544192 tempest-HypervisorAdminNegativeUnderV252Test-1964544192-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.385071 Sep 14 08:49:29.340384 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 204/427] 10.222.0.60 () {58 vars in 1146 bytes} [Wed Sep 14 08:49:28 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:49:29.346226 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-03313e63-9055-435f-85d1-b181f36bc010 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:49:29.347184 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-03313e63-9055-435f-85d1-b181f36bc010 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] [instance: c402c828-5101-40cc-8ac8-b3d1470028ed] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:49:29.356138 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-03313e63-9055-435f-85d1-b181f36bc010 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:29.357050 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-03313e63-9055-435f-85d1-b181f36bc010 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:29.357712 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-03313e63-9055-435f-85d1-b181f36bc010 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:29.358689 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-03313e63-9055-435f-85d1-b181f36bc010 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:29.359464 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-03313e63-9055-435f-85d1-b181f36bc010 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:29.360359 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-03313e63-9055-435f-85d1-b181f36bc010 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:29.627661 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-03313e63-9055-435f-85d1-b181f36bc010 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2290f39b61044661aa9bec206794a5c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '919dd9619fb24ee281cf6d96cf3351df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:49:29.643059 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-03313e63-9055-435f-85d1-b181f36bc010 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] 10.222.0.60 "GET /compute/v2.1/servers/c402c828-5101-40cc-8ac8-b3d1470028ed" status: 200 len: 1228 microversion: 2.1 time: 0.300987 Sep 14 08:49:29.651610 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 205/428] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:49:29 2022] GET /compute/v2.1/servers/c402c828-5101-40cc-8ac8-b3d1470028ed => generated 1228 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:49:29.653847 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-9ff3c183-9f34-4dd5-b9ea-c53f26e0be4b tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c7802984cf48d1852832b52abe52e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e326f95a9604fdb9bd075db3837cf62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:49:29.679633 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-9ff3c183-9f34-4dd5-b9ea-c53f26e0be4b tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] 10.222.0.60 "GET /compute/v2.1/servers/307b2830-67e6-44ec-845f-9894de16694a" status: 200 len: 1316 microversion: 2.1 time: 1.596128 Sep 14 08:49:29.681144 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 224/429] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:49:28 2022] GET /compute/v2.1/servers/307b2830-67e6-44ec-845f-9894de16694a => generated 1316 bytes in 1598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:49:29.693130 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-f311a139-7543-4f13-820a-d37483edf250 req-e693aff5-6b64-46ec-87a3-eb8e3b0323e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a331816-6b06-40c9-a557-eada274501b5", "name": "network-vif-unplugged", "status": "completed", "tag": "667429a7-9153-49c5-a750-cc44e1cd077d"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:49:29.703333 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-84905a37-b20a-4f9c-8b3f-908f978bbb57 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:49:29.703963 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-84905a37-b20a-4f9c-8b3f-908f978bbb57 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: 0a331816-6b06-40c9-a557-eada274501b5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:49:29.716587 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-f311a139-7543-4f13-820a-d37483edf250 req-e693aff5-6b64-46ec-87a3-eb8e3b0323e2 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:29.717515 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-f311a139-7543-4f13-820a-d37483edf250 req-e693aff5-6b64-46ec-87a3-eb8e3b0323e2 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:29.718054 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-f311a139-7543-4f13-820a-d37483edf250 req-e693aff5-6b64-46ec-87a3-eb8e3b0323e2 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:29.726898 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-84905a37-b20a-4f9c-8b3f-908f978bbb57 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:29.728987 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-84905a37-b20a-4f9c-8b3f-908f978bbb57 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:29.731290 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-84905a37-b20a-4f9c-8b3f-908f978bbb57 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:29.732049 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-84905a37-b20a-4f9c-8b3f-908f978bbb57 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:29.735840 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-84905a37-b20a-4f9c-8b3f-908f978bbb57 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:29.736485 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-f311a139-7543-4f13-820a-d37483edf250 req-e693aff5-6b64-46ec-87a3-eb8e3b0323e2 service nova] Creating event network-vif-unplugged:667429a7-9153-49c5-a750-cc44e1cd077d for instance 0a331816-6b06-40c9-a557-eada274501b5 on n-h2-836830-18 Sep 14 08:49:29.736669 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-84905a37-b20a-4f9c-8b3f-908f978bbb57 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:29.781550 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [req-f311a139-7543-4f13-820a-d37483edf250 req-e693aff5-6b64-46ec-87a3-eb8e3b0323e2 service nova] Instance 0a331816-6b06-40c9-a557-eada274501b5 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-836830-18', 'n-h2-836830-18'} {{(pid=128759) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 14 08:49:29.824234 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-f311a139-7543-4f13-820a-d37483edf250 req-e693aff5-6b64-46ec-87a3-eb8e3b0323e2 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.139101 Sep 14 08:49:29.827111 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 225/430] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:49:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:49:30.030830 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ae5ebc1c-b474-4445-b6ff-58c1cee3a989 tempest-HypervisorAdminNegativeUnderV252Test-223362817 tempest-HypervisorAdminNegativeUnderV252Test-223362817-project] Calling method '.version_select at 0x7f7d44c1a820>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:49:30.032688 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-ae5ebc1c-b474-4445-b6ff-58c1cee3a989 tempest-HypervisorAdminNegativeUnderV252Test-223362817 tempest-HypervisorAdminNegativeUnderV252Test-223362817-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': 'c427279a3a594b479f85d36df0cedc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a6b7d7686d4912a2258f34385dd369', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:49:30.035842 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ae5ebc1c-b474-4445-b6ff-58c1cee3a989 tempest-HypervisorAdminNegativeUnderV252Test-223362817 tempest-HypervisorAdminNegativeUnderV252Test-223362817-project] Request method failure captured: Sep 14 08:49:30.035842 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/os-hypervisors/n-h2-836830-18/search HTTP/1.1 Sep 14 08:49:30.035842 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 08:49:30.035842 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 08:49:30.035842 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 08:49:30.035842 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 08:49:30.035842 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 08:49:30.035842 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 08:49:30.035842 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 08:49:30.035842 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 08:49:30.035842 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZWWV9cXww_m0s0M8ucBslOkG9mdazW5WOWTvt4Lhlcfmb72wVYJB4u5chiBfEOkO1LKr9r0V0T2LKvCIT-aaxLoagJiR-ZhbaAi7HvxKuGs2yxD1fMTRHG_dbQCCqX2OmjCiYe0l0C1DLtIRj2mmyXjYGXKfc44xU-Go8bOPehMQQI Sep 14 08:49:30.035842 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 08:49:30.035842 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 08:49:30.035842 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 08:49:30.035842 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 08:49:30.035842 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 08:49:30.035842 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 08:49:30.035842 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 14a6b7d7686d4912a2258f34385dd369 Sep 14 08:49:30.035842 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-223362817 Sep 14 08:49:30.035842 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 08:49:30.035842 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 08:49:30.037212 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/14a6b7d7686d4912a2258f34385dd369"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_14a6b7d7686d4912a2258f34385dd369"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/14a6b7d7686d4912a2258f34385dd369"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/14a6b7d7686d4912a2258f34385dd369"}]}] Sep 14 08:49:30.037212 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-223362817 Sep 14 08:49:30.037212 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 14a6b7d7686d4912a2258f34385dd369 Sep 14 08:49:30.037212 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-223362817 Sep 14 08:49:30.037212 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-223362817-project Sep 14 08:49:30.037212 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 08:49:30.037212 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 08:49:30.037212 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: c427279a3a594b479f85d36df0cedc2a Sep 14 08:49:30.037212 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-223362817-project Sep 14 08:49:30.037212 n-d-836830-18 devstack@n-api.service[128759]: method: Sep 14 08:49:30.037212 n-d-836830-18 devstack@n-api.service[128759]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Sep 14 08:49:30.037212 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': 'n-h2-836830-18'} Sep 14 08:49:30.037952 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:49:30.037952 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:49:30.037952 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:49:30.037952 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:49:30.037952 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:49:30.037952 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:49:30.037952 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 08:49:30.037952 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 08:49:30.037952 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:49:30.037952 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:49:30.037952 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Sep 14 08:49:30.037952 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Sep 14 08:49:30.037952 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 14 08:49:30.037952 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 14 08:49:30.037952 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 14 08:49:30.037952 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 14 08:49:30.037952 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 14 08:49:30.037952 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 14 08:49:30.037952 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 14 08:49:30.040208 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise self.value Sep 14 08:49:30.040208 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 14 08:49:30.040208 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 14 08:49:30.040208 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 14 08:49:30.040208 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 14 08:49:30.040208 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 14 08:49:30.040208 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 14 08:49:30.040208 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Sep 14 08:49:30.040208 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:49:30.040208 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:49:30.040208 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:49:30.040208 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:49:30.040208 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:49:30.040208 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:49:30.040208 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 14 08:49:30.040208 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 14 08:49:30.040208 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Sep 14 08:49:30.040208 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:49:30.041234 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ae5ebc1c-b474-4445-b6ff-58c1cee3a989 tempest-HypervisorAdminNegativeUnderV252Test-223362817 tempest-HypervisorAdminNegativeUnderV252Test-223362817-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:49:30.041234 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-ae5ebc1c-b474-4445-b6ff-58c1cee3a989 tempest-HypervisorAdminNegativeUnderV252Test-223362817 tempest-HypervisorAdminNegativeUnderV252Test-223362817-project] 10.222.0.60 "GET /compute/v2.1/os-hypervisors/n-h2-836830-18/search" status: 403 len: 117 microversion: 2.1 time: 0.207440 Sep 14 08:49:30.042209 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 226/431] 10.222.0.60 () {58 vars in 1212 bytes} [Wed Sep 14 08:49:29 2022] GET /compute/v2.1/os-hypervisors/n-h2-836830-18/search => generated 117 bytes in 213 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 14 08:49:30.055739 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-35ff08ef-97fd-4782-9eb8-16c42ba461ee tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:49:30.056710 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-35ff08ef-97fd-4782-9eb8-16c42ba461ee tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] [instance: b337eb96-57a1-408f-8890-3a0a84e1afa3] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:49:30.071159 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-35ff08ef-97fd-4782-9eb8-16c42ba461ee tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:30.071934 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-35ff08ef-97fd-4782-9eb8-16c42ba461ee tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:30.072534 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-35ff08ef-97fd-4782-9eb8-16c42ba461ee tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:30.073408 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-35ff08ef-97fd-4782-9eb8-16c42ba461ee tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:30.074538 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-35ff08ef-97fd-4782-9eb8-16c42ba461ee tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:30.075150 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-35ff08ef-97fd-4782-9eb8-16c42ba461ee tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:30.776429 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-35ff08ef-97fd-4782-9eb8-16c42ba461ee tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2ee35c4791437c83193357b4085128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4300dd934369461b9b6ef556246bfc53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:49:30.788764 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-35ff08ef-97fd-4782-9eb8-16c42ba461ee tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] 10.222.0.60 "GET /compute/v2.1/servers/b337eb96-57a1-408f-8890-3a0a84e1afa3" status: 200 len: 1318 microversion: 2.1 time: 0.741830 Sep 14 08:49:30.790016 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 227/432] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:49:30 2022] GET /compute/v2.1/servers/b337eb96-57a1-408f-8890-3a0a84e1afa3 => generated 1318 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:49:30.804283 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-cfddfdbd-ea70-4c63-b2ff-fa9ddc2aa0d1 tempest-HypervisorAdminNegativeUnderV252Test-1964544192 tempest-HypervisorAdminNegativeUnderV252Test-1964544192-project-admin] Calling method '.version_select at 0x7f7d44ab88b0>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:49:30.809362 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cfddfdbd-ea70-4c63-b2ff-fa9ddc2aa0d1 tempest-HypervisorAdminNegativeUnderV252Test-1964544192 tempest-HypervisorAdminNegativeUnderV252Test-1964544192-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:30.810120 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cfddfdbd-ea70-4c63-b2ff-fa9ddc2aa0d1 tempest-HypervisorAdminNegativeUnderV252Test-1964544192 tempest-HypervisorAdminNegativeUnderV252Test-1964544192-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:30.811884 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cfddfdbd-ea70-4c63-b2ff-fa9ddc2aa0d1 tempest-HypervisorAdminNegativeUnderV252Test-1964544192 tempest-HypervisorAdminNegativeUnderV252Test-1964544192-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:30.838730 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-cfddfdbd-ea70-4c63-b2ff-fa9ddc2aa0d1 tempest-HypervisorAdminNegativeUnderV252Test-1964544192 tempest-HypervisorAdminNegativeUnderV252Test-1964544192-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Sep 14 08:49:30.842658 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-cfddfdbd-ea70-4c63-b2ff-fa9ddc2aa0d1 tempest-HypervisorAdminNegativeUnderV252Test-1964544192 tempest-HypervisorAdminNegativeUnderV252Test-1964544192-project-admin] Request method failure captured: Sep 14 08:49:30.842658 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Sep 14 08:49:30.842658 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 08:49:30.842658 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 08:49:30.842658 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 08:49:30.842658 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 08:49:30.842658 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 08:49:30.842658 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 08:49:30.842658 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 08:49:30.842658 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 08:49:30.842658 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZWX5tTf-4qp8r-pYaGlLTusu1VFVg_HxGkugP2xWw2r_PJU5n6vjsU9yCYEiYM7pR3Vl1ljE97aGpnc4BcJrwdNSHNljop9MLItU9KpE1xbNQqOQRzJbe1M9c2IKfOKXqoTGZgqqzTxKtgQ3N0fdwa6pKXl8LviCA4MuTKRosBtFEc Sep 14 08:49:30.842658 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 08:49:30.842658 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 08:49:30.842658 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 08:49:30.842658 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 08:49:30.842658 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 08:49:30.842658 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 08:49:30.842658 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 1b1aa80521fb4df5ac5c55fb06417206 Sep 14 08:49:30.842658 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1964544192 Sep 14 08:49:30.842658 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member,admin Sep 14 08:49:30.842658 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member,admin Sep 14 08:49:30.844301 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/1b1aa80521fb4df5ac5c55fb06417206"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_1b1aa80521fb4df5ac5c55fb06417206"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1b1aa80521fb4df5ac5c55fb06417206"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1b1aa80521fb4df5ac5c55fb06417206"}]}] Sep 14 08:49:30.844301 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1964544192 Sep 14 08:49:30.844301 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 1b1aa80521fb4df5ac5c55fb06417206 Sep 14 08:49:30.844301 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1964544192 Sep 14 08:49:30.844301 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1964544192-project-admin Sep 14 08:49:30.844301 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 08:49:30.844301 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 08:49:30.844301 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 914e34e6d23f43288ffa55e12283dd1a Sep 14 08:49:30.844301 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1964544192-project-admin Sep 14 08:49:30.844301 n-d-836830-18 devstack@n-api.service[128759]: method: Sep 14 08:49:30.844301 n-d-836830-18 devstack@n-api.service[128759]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Sep 14 08:49:30.844301 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': 'nonexistent_hypervisor_name'} Sep 14 08:49:30.845161 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:49:30.845161 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:49:30.845161 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:49:30.845161 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:49:30.845161 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:49:30.845161 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:49:30.845161 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 08:49:30.845161 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 08:49:30.845161 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:49:30.845161 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:49:30.845161 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Sep 14 08:49:30.845161 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Sep 14 08:49:30.845161 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Sep 14 08:49:30.845161 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 14 08:49:30.845161 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Sep 14 08:49:30.845161 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:49:30.845161 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:49:30.845161 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:49:30.845161 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:49:30.845161 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:49:30.846519 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:49:30.846519 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:49:30.846519 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:49:30.846519 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Sep 14 08:49:30.846519 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:49:30.848850 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-cfddfdbd-ea70-4c63-b2ff-fa9ddc2aa0d1 tempest-HypervisorAdminNegativeUnderV252Test-1964544192 tempest-HypervisorAdminNegativeUnderV252Test-1964544192-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:49:30.851281 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-cfddfdbd-ea70-4c63-b2ff-fa9ddc2aa0d1 tempest-HypervisorAdminNegativeUnderV252Test-1964544192 tempest-HypervisorAdminNegativeUnderV252Test-1964544192-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.058631 Sep 14 08:49:30.852096 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 228/433] 10.222.0.60 () {58 vars in 1251 bytes} [Wed Sep 14 08:49:30 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 08:49:30.876131 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-48c3f72e-2340-4147-87de-97783a652fae tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:49:30.882229 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-48c3f72e-2340-4147-87de-97783a652fae tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] [instance: c402c828-5101-40cc-8ac8-b3d1470028ed] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:49:30.901192 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-48c3f72e-2340-4147-87de-97783a652fae tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:30.901994 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-48c3f72e-2340-4147-87de-97783a652fae tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:30.902668 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-48c3f72e-2340-4147-87de-97783a652fae tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:30.903619 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-48c3f72e-2340-4147-87de-97783a652fae tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:30.904272 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-48c3f72e-2340-4147-87de-97783a652fae tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:30.905160 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-48c3f72e-2340-4147-87de-97783a652fae tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:30.949491 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-84905a37-b20a-4f9c-8b3f-908f978bbb57 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:49:30.959852 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-84905a37-b20a-4f9c-8b3f-908f978bbb57 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/0a331816-6b06-40c9-a557-eada274501b5" status: 200 len: 1473 microversion: 2.1 time: 1.271937 Sep 14 08:49:30.969529 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 206/434] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:49:29 2022] GET /compute/v2.1/servers/0a331816-6b06-40c9-a557-eada274501b5 => generated 1473 bytes in 1312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:49:30.975919 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-8ed67d5b-19a1-42cf-bd96-5fab9c634e06 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:49:30.975919 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-8ed67d5b-19a1-42cf-bd96-5fab9c634e06 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] [instance: 307b2830-67e6-44ec-845f-9894de16694a] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:49:30.990032 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8ed67d5b-19a1-42cf-bd96-5fab9c634e06 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:30.990773 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8ed67d5b-19a1-42cf-bd96-5fab9c634e06 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:30.991265 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8ed67d5b-19a1-42cf-bd96-5fab9c634e06 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:30.993227 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8ed67d5b-19a1-42cf-bd96-5fab9c634e06 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:30.993762 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8ed67d5b-19a1-42cf-bd96-5fab9c634e06 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:30.998520 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8ed67d5b-19a1-42cf-bd96-5fab9c634e06 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:31.023376 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-48c3f72e-2340-4147-87de-97783a652fae tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2290f39b61044661aa9bec206794a5c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '919dd9619fb24ee281cf6d96cf3351df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:49:31.039437 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-48c3f72e-2340-4147-87de-97783a652fae tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] 10.222.0.60 "GET /compute/v2.1/servers/c402c828-5101-40cc-8ac8-b3d1470028ed" status: 200 len: 1290 microversion: 2.1 time: 0.180721 Sep 14 08:49:31.050034 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 229/435] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:49:30 2022] GET /compute/v2.1/servers/c402c828-5101-40cc-8ac8-b3d1470028ed => generated 1290 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:49:31.050034 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-89f68e94-33e7-4ba4-a6d0-80b67f72e89c tempest-HypervisorAdminNegativeUnderV252Test-1964544192 tempest-HypervisorAdminNegativeUnderV252Test-1964544192-project-admin] Calling method '.version_select at 0x7f7d44a8e1f0>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:49:31.050034 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-89f68e94-33e7-4ba4-a6d0-80b67f72e89c tempest-HypervisorAdminNegativeUnderV252Test-1964544192 tempest-HypervisorAdminNegativeUnderV252Test-1964544192-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:31.050034 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-89f68e94-33e7-4ba4-a6d0-80b67f72e89c tempest-HypervisorAdminNegativeUnderV252Test-1964544192 tempest-HypervisorAdminNegativeUnderV252Test-1964544192-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:31.050588 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-89f68e94-33e7-4ba4-a6d0-80b67f72e89c tempest-HypervisorAdminNegativeUnderV252Test-1964544192 tempest-HypervisorAdminNegativeUnderV252Test-1964544192-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:31.095100 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-89f68e94-33e7-4ba4-a6d0-80b67f72e89c tempest-HypervisorAdminNegativeUnderV252Test-1964544192 tempest-HypervisorAdminNegativeUnderV252Test-1964544192-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:31.095607 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-89f68e94-33e7-4ba4-a6d0-80b67f72e89c tempest-HypervisorAdminNegativeUnderV252Test-1964544192 tempest-HypervisorAdminNegativeUnderV252Test-1964544192-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:31.096047 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-89f68e94-33e7-4ba4-a6d0-80b67f72e89c tempest-HypervisorAdminNegativeUnderV252Test-1964544192 tempest-HypervisorAdminNegativeUnderV252Test-1964544192-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:31.108875 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-89f68e94-33e7-4ba4-a6d0-80b67f72e89c tempest-HypervisorAdminNegativeUnderV252Test-1964544192 tempest-HypervisorAdminNegativeUnderV252Test-1964544192-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:31.109378 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-89f68e94-33e7-4ba4-a6d0-80b67f72e89c tempest-HypervisorAdminNegativeUnderV252Test-1964544192 tempest-HypervisorAdminNegativeUnderV252Test-1964544192-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:31.109821 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-89f68e94-33e7-4ba4-a6d0-80b67f72e89c tempest-HypervisorAdminNegativeUnderV252Test-1964544192 tempest-HypervisorAdminNegativeUnderV252Test-1964544192-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:31.118569 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-89f68e94-33e7-4ba4-a6d0-80b67f72e89c tempest-HypervisorAdminNegativeUnderV252Test-1964544192 tempest-HypervisorAdminNegativeUnderV252Test-1964544192-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.076790 Sep 14 08:49:31.127131 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 230/436] 10.222.0.60 () {58 vars in 1146 bytes} [Wed Sep 14 08:49:31 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:49:31.133151 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3ba8b43e-6921-44f7-9710-7693785c4f9c tempest-HypervisorAdminNegativeUnderV252Test-223362817 tempest-HypervisorAdminNegativeUnderV252Test-223362817-project] Calling method '.version_select at 0x7f7d44a8e9d0>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:49:31.135399 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-3ba8b43e-6921-44f7-9710-7693785c4f9c tempest-HypervisorAdminNegativeUnderV252Test-223362817 tempest-HypervisorAdminNegativeUnderV252Test-223362817-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': 'c427279a3a594b479f85d36df0cedc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a6b7d7686d4912a2258f34385dd369', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:49:31.137267 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3ba8b43e-6921-44f7-9710-7693785c4f9c tempest-HypervisorAdminNegativeUnderV252Test-223362817 tempest-HypervisorAdminNegativeUnderV252Test-223362817-project] Request method failure captured: Sep 14 08:49:31.137267 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Sep 14 08:49:31.137267 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 08:49:31.137267 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 08:49:31.137267 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 08:49:31.137267 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 08:49:31.137267 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 08:49:31.137267 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 08:49:31.137267 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 08:49:31.137267 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 08:49:31.137267 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZWWV9cXww_m0s0M8ucBslOkG9mdazW5WOWTvt4Lhlcfmb72wVYJB4u5chiBfEOkO1LKr9r0V0T2LKvCIT-aaxLoagJiR-ZhbaAi7HvxKuGs2yxD1fMTRHG_dbQCCqX2OmjCiYe0l0C1DLtIRj2mmyXjYGXKfc44xU-Go8bOPehMQQI Sep 14 08:49:31.137267 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 08:49:31.137267 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 08:49:31.137267 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 08:49:31.137267 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 08:49:31.137267 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 08:49:31.137267 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 08:49:31.137267 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 14a6b7d7686d4912a2258f34385dd369 Sep 14 08:49:31.137267 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-223362817 Sep 14 08:49:31.137267 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 08:49:31.137267 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 08:49:31.138897 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/14a6b7d7686d4912a2258f34385dd369"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_14a6b7d7686d4912a2258f34385dd369"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/14a6b7d7686d4912a2258f34385dd369"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/14a6b7d7686d4912a2258f34385dd369"}]}] Sep 14 08:49:31.138897 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-223362817 Sep 14 08:49:31.138897 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 14a6b7d7686d4912a2258f34385dd369 Sep 14 08:49:31.138897 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-223362817 Sep 14 08:49:31.138897 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-223362817-project Sep 14 08:49:31.138897 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 08:49:31.138897 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 08:49:31.138897 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: c427279a3a594b479f85d36df0cedc2a Sep 14 08:49:31.138897 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-223362817-project Sep 14 08:49:31.138897 n-d-836830-18 devstack@n-api.service[128759]: method: Sep 14 08:49:31.138897 n-d-836830-18 devstack@n-api.service[128759]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Sep 14 08:49:31.138897 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '1'} Sep 14 08:49:31.139808 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:49:31.139808 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:49:31.139808 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:49:31.139808 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:49:31.139808 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:49:31.139808 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:49:31.139808 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 08:49:31.139808 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 08:49:31.139808 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:49:31.139808 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:49:31.139808 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Sep 14 08:49:31.139808 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Sep 14 08:49:31.139808 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 14 08:49:31.139808 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 14 08:49:31.139808 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 14 08:49:31.139808 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 14 08:49:31.139808 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 14 08:49:31.139808 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 14 08:49:31.139808 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 14 08:49:31.141184 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise self.value Sep 14 08:49:31.141184 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 14 08:49:31.141184 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 14 08:49:31.141184 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 14 08:49:31.141184 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 14 08:49:31.141184 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 14 08:49:31.141184 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 14 08:49:31.141184 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Sep 14 08:49:31.141184 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:49:31.141184 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:49:31.141184 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:49:31.141184 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:49:31.141184 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:49:31.141184 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:49:31.141184 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 14 08:49:31.141184 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 14 08:49:31.141184 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Sep 14 08:49:31.141184 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:49:31.143530 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3ba8b43e-6921-44f7-9710-7693785c4f9c tempest-HypervisorAdminNegativeUnderV252Test-223362817 tempest-HypervisorAdminNegativeUnderV252Test-223362817-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:49:31.144565 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-3ba8b43e-6921-44f7-9710-7693785c4f9c tempest-HypervisorAdminNegativeUnderV252Test-223362817 tempest-HypervisorAdminNegativeUnderV252Test-223362817-project] 10.222.0.60 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.015282 Sep 14 08:49:31.149610 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 231/437] 10.222.0.60 () {58 vars in 1176 bytes} [Wed Sep 14 08:49:31 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 22 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 14 08:49:31.155414 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-58a040d7-b4a8-4720-982e-dbaf13f0d624 tempest-HypervisorAdminNegativeUnderV252Test-1964544192 tempest-HypervisorAdminNegativeUnderV252Test-1964544192-project-admin] Calling method '.version_select at 0x7f7d44c1ad30>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:49:31.157531 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-58a040d7-b4a8-4720-982e-dbaf13f0d624 tempest-HypervisorAdminNegativeUnderV252Test-1964544192 tempest-HypervisorAdminNegativeUnderV252Test-1964544192-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:31.158231 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-58a040d7-b4a8-4720-982e-dbaf13f0d624 tempest-HypervisorAdminNegativeUnderV252Test-1964544192 tempest-HypervisorAdminNegativeUnderV252Test-1964544192-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:31.158832 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-58a040d7-b4a8-4720-982e-dbaf13f0d624 tempest-HypervisorAdminNegativeUnderV252Test-1964544192 tempest-HypervisorAdminNegativeUnderV252Test-1964544192-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:31.167397 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-58a040d7-b4a8-4720-982e-dbaf13f0d624 tempest-HypervisorAdminNegativeUnderV252Test-1964544192 tempest-HypervisorAdminNegativeUnderV252Test-1964544192-project-admin] HTTP exception thrown: No hypervisor matching '05da227e-30c2-4601-bc94-df1d9e9be379' could be found. Sep 14 08:49:31.170435 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-58a040d7-b4a8-4720-982e-dbaf13f0d624 tempest-HypervisorAdminNegativeUnderV252Test-1964544192 tempest-HypervisorAdminNegativeUnderV252Test-1964544192-project-admin] Request method failure captured: Sep 14 08:49:31.170435 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/os-hypervisors/05da227e-30c2-4601-bc94-df1d9e9be379/servers HTTP/1.1 Sep 14 08:49:31.170435 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 08:49:31.170435 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 08:49:31.170435 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 08:49:31.170435 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 08:49:31.170435 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 08:49:31.170435 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 08:49:31.170435 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 08:49:31.170435 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 08:49:31.170435 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZWX5tTf-4qp8r-pYaGlLTusu1VFVg_HxGkugP2xWw2r_PJU5n6vjsU9yCYEiYM7pR3Vl1ljE97aGpnc4BcJrwdNSHNljop9MLItU9KpE1xbNQqOQRzJbe1M9c2IKfOKXqoTGZgqqzTxKtgQ3N0fdwa6pKXl8LviCA4MuTKRosBtFEc Sep 14 08:49:31.170435 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 08:49:31.170435 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 08:49:31.170435 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 08:49:31.170435 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 08:49:31.170435 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 08:49:31.170435 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 08:49:31.170435 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 1b1aa80521fb4df5ac5c55fb06417206 Sep 14 08:49:31.170435 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1964544192 Sep 14 08:49:31.170435 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member,admin Sep 14 08:49:31.170435 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member,admin Sep 14 08:49:31.172228 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/1b1aa80521fb4df5ac5c55fb06417206"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_1b1aa80521fb4df5ac5c55fb06417206"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1b1aa80521fb4df5ac5c55fb06417206"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1b1aa80521fb4df5ac5c55fb06417206"}]}] Sep 14 08:49:31.172228 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1964544192 Sep 14 08:49:31.172228 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 1b1aa80521fb4df5ac5c55fb06417206 Sep 14 08:49:31.172228 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1964544192 Sep 14 08:49:31.172228 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1964544192-project-admin Sep 14 08:49:31.172228 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 08:49:31.172228 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 08:49:31.172228 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 914e34e6d23f43288ffa55e12283dd1a Sep 14 08:49:31.172228 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1964544192-project-admin Sep 14 08:49:31.172228 n-d-836830-18 devstack@n-api.service[128759]: method: Sep 14 08:49:31.172228 n-d-836830-18 devstack@n-api.service[128759]: exception: No hypervisor matching '05da227e-30c2-4601-bc94-df1d9e9be379' could be found. Sep 14 08:49:31.172228 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '05da227e-30c2-4601-bc94-df1d9e9be379'} Sep 14 08:49:31.173093 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:49:31.173093 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:49:31.173093 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:49:31.173093 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:49:31.173093 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:49:31.173093 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:49:31.173093 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 08:49:31.173093 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 08:49:31.173093 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:49:31.173093 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:49:31.173093 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Sep 14 08:49:31.173093 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Sep 14 08:49:31.173093 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Sep 14 08:49:31.173093 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 14 08:49:31.173093 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching '05da227e-30c2-4601-bc94-df1d9e9be379' could be found. Sep 14 08:49:31.173093 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:49:31.173093 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:49:31.173093 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:49:31.173093 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:49:31.174589 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:49:31.174589 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:49:31.174589 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:49:31.174589 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:49:31.174589 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching '05da227e-30c2-4601-bc94-df1d9e9be379' could be found. Sep 14 08:49:31.174589 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:49:31.175817 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-58a040d7-b4a8-4720-982e-dbaf13f0d624 tempest-HypervisorAdminNegativeUnderV252Test-1964544192 tempest-HypervisorAdminNegativeUnderV252Test-1964544192-project-admin] Returning 404 to user: No hypervisor matching '05da227e-30c2-4601-bc94-df1d9e9be379' could be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:49:31.177032 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-58a040d7-b4a8-4720-982e-dbaf13f0d624 tempest-HypervisorAdminNegativeUnderV252Test-1964544192 tempest-HypervisorAdminNegativeUnderV252Test-1964544192-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors/05da227e-30c2-4601-bc94-df1d9e9be379/servers" status: 404 len: 123 microversion: 2.1 time: 0.025911 Sep 14 08:49:31.182426 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 232/438] 10.222.0.60 () {58 vars in 1281 bytes} [Wed Sep 14 08:49:31 2022] GET /compute/v2.1/os-hypervisors/05da227e-30c2-4601-bc94-df1d9e9be379/servers => generated 123 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 08:49:31.817424 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c67f490a-5714-4cac-83ad-617981e77d67 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:49:31.819129 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-c67f490a-5714-4cac-83ad-617981e77d67 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] [instance: b337eb96-57a1-408f-8890-3a0a84e1afa3] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:49:31.831532 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c67f490a-5714-4cac-83ad-617981e77d67 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:31.832246 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c67f490a-5714-4cac-83ad-617981e77d67 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:31.832838 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c67f490a-5714-4cac-83ad-617981e77d67 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:31.833807 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c67f490a-5714-4cac-83ad-617981e77d67 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:31.834389 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c67f490a-5714-4cac-83ad-617981e77d67 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:31.835049 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c67f490a-5714-4cac-83ad-617981e77d67 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:32.109276 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-8ed67d5b-19a1-42cf-bd96-5fab9c634e06 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c7802984cf48d1852832b52abe52e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e326f95a9604fdb9bd075db3837cf62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:49:32.124705 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-8ed67d5b-19a1-42cf-bd96-5fab9c634e06 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] 10.222.0.60 "GET /compute/v2.1/servers/307b2830-67e6-44ec-845f-9894de16694a" status: 200 len: 1316 microversion: 2.1 time: 1.153405 Sep 14 08:49:32.126425 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 207/439] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:49:30 2022] GET /compute/v2.1/servers/307b2830-67e6-44ec-845f-9894de16694a => generated 1316 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:49:32.155771 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-9a401049-854f-4785-b502-5d8099ac265b tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:49:32.158827 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-9a401049-854f-4785-b502-5d8099ac265b tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: 0a331816-6b06-40c9-a557-eada274501b5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:49:32.174375 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9a401049-854f-4785-b502-5d8099ac265b tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:32.175136 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9a401049-854f-4785-b502-5d8099ac265b tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:32.175808 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9a401049-854f-4785-b502-5d8099ac265b tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:32.176912 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9a401049-854f-4785-b502-5d8099ac265b tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:32.177585 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9a401049-854f-4785-b502-5d8099ac265b tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:32.178318 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9a401049-854f-4785-b502-5d8099ac265b tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:33.210148 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-c67f490a-5714-4cac-83ad-617981e77d67 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2ee35c4791437c83193357b4085128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4300dd934369461b9b6ef556246bfc53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:49:33.228210 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-c67f490a-5714-4cac-83ad-617981e77d67 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] 10.222.0.60 "GET /compute/v2.1/servers/b337eb96-57a1-408f-8890-3a0a84e1afa3" status: 200 len: 1318 microversion: 2.1 time: 1.415004 Sep 14 08:49:33.250235 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 233/440] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:49:31 2022] GET /compute/v2.1/servers/b337eb96-57a1-408f-8890-3a0a84e1afa3 => generated 1318 bytes in 1438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:49:33.261007 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-cc5d8c81-786f-4cbf-8acc-1aae7436a8b3 req-a5751664-5f1c-4898-b8fd-b25bd82e21f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a331816-6b06-40c9-a557-eada274501b5", "tag": "667429a7-9153-49c5-a750-cc44e1cd077d"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:49:33.285157 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-cc5d8c81-786f-4cbf-8acc-1aae7436a8b3 req-a5751664-5f1c-4898-b8fd-b25bd82e21f5 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:33.285969 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-cc5d8c81-786f-4cbf-8acc-1aae7436a8b3 req-a5751664-5f1c-4898-b8fd-b25bd82e21f5 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:33.289214 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-cc5d8c81-786f-4cbf-8acc-1aae7436a8b3 req-a5751664-5f1c-4898-b8fd-b25bd82e21f5 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:33.318385 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-cc5d8c81-786f-4cbf-8acc-1aae7436a8b3 req-a5751664-5f1c-4898-b8fd-b25bd82e21f5 service nova] Creating event network-changed:667429a7-9153-49c5-a750-cc44e1cd077d for instance 0a331816-6b06-40c9-a557-eada274501b5 on n-h2-836830-18 Sep 14 08:49:33.331850 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [req-cc5d8c81-786f-4cbf-8acc-1aae7436a8b3 req-a5751664-5f1c-4898-b8fd-b25bd82e21f5 service nova] Instance 0a331816-6b06-40c9-a557-eada274501b5 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-836830-18', 'n-h2-836830-18'} {{(pid=128759) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 14 08:49:33.360777 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-cc5d8c81-786f-4cbf-8acc-1aae7436a8b3 req-a5751664-5f1c-4898-b8fd-b25bd82e21f5 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107442 Sep 14 08:49:33.364871 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 234/441] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:49:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:49:33.378551 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-732b8528-725b-4118-8edf-f972ecde9c28 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:49:33.381722 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-732b8528-725b-4118-8edf-f972ecde9c28 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] [instance: c402c828-5101-40cc-8ac8-b3d1470028ed] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:49:33.396137 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-732b8528-725b-4118-8edf-f972ecde9c28 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:33.399723 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-732b8528-725b-4118-8edf-f972ecde9c28 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:33.401087 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-732b8528-725b-4118-8edf-f972ecde9c28 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:33.405601 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-732b8528-725b-4118-8edf-f972ecde9c28 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:33.407636 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-732b8528-725b-4118-8edf-f972ecde9c28 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:33.408054 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-732b8528-725b-4118-8edf-f972ecde9c28 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:34.566396 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-9a401049-854f-4785-b502-5d8099ac265b tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:49:34.599620 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-9a401049-854f-4785-b502-5d8099ac265b tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/0a331816-6b06-40c9-a557-eada274501b5" status: 200 len: 1473 microversion: 2.1 time: 2.453651 Sep 14 08:49:34.615624 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-732b8528-725b-4118-8edf-f972ecde9c28 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2290f39b61044661aa9bec206794a5c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '919dd9619fb24ee281cf6d96cf3351df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:49:34.616890 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 208/442] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:49:32 2022] GET /compute/v2.1/servers/0a331816-6b06-40c9-a557-eada274501b5 => generated 1473 bytes in 2490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:49:34.617042 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-732b8528-725b-4118-8edf-f972ecde9c28 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] 10.222.0.60 "GET /compute/v2.1/servers/c402c828-5101-40cc-8ac8-b3d1470028ed" status: 200 len: 1332 microversion: 2.1 time: 1.250652 Sep 14 08:49:34.623959 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 235/443] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:49:33 2022] GET /compute/v2.1/servers/c402c828-5101-40cc-8ac8-b3d1470028ed => generated 1332 bytes in 1258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:49:34.649780 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b0742b6e-2c7f-4baa-a4c2-df7f1aef4e56 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:49:34.660834 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b0742b6e-2c7f-4baa-a4c2-df7f1aef4e56 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] [instance: 307b2830-67e6-44ec-845f-9894de16694a] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:49:34.681760 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b0742b6e-2c7f-4baa-a4c2-df7f1aef4e56 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:34.682571 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b0742b6e-2c7f-4baa-a4c2-df7f1aef4e56 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:34.683277 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b0742b6e-2c7f-4baa-a4c2-df7f1aef4e56 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:34.686343 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b0742b6e-2c7f-4baa-a4c2-df7f1aef4e56 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:34.694527 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b0742b6e-2c7f-4baa-a4c2-df7f1aef4e56 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:34.697259 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b0742b6e-2c7f-4baa-a4c2-df7f1aef4e56 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:35.246918 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-67c03aae-a92d-4fbc-aac3-98ddd05841ea tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:49:35.308180 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-67c03aae-a92d-4fbc-aac3-98ddd05841ea tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] 10.222.0.60 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.640557 Sep 14 08:49:35.314757 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 209/444] 10.222.0.60 () {58 vars in 1137 bytes} [Wed Sep 14 08:49:34 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:49:35.322348 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-615c5cc9-aa4c-4067-aba3-33f30866e4c0 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:49:35.324680 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-615c5cc9-aa4c-4067-aba3-33f30866e4c0 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] [instance: b337eb96-57a1-408f-8890-3a0a84e1afa3] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:49:35.333960 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-615c5cc9-aa4c-4067-aba3-33f30866e4c0 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:35.334673 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-615c5cc9-aa4c-4067-aba3-33f30866e4c0 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:35.335319 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-615c5cc9-aa4c-4067-aba3-33f30866e4c0 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:35.336991 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-615c5cc9-aa4c-4067-aba3-33f30866e4c0 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:35.343646 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-615c5cc9-aa4c-4067-aba3-33f30866e4c0 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:35.344398 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-615c5cc9-aa4c-4067-aba3-33f30866e4c0 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:35.743693 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b0742b6e-2c7f-4baa-a4c2-df7f1aef4e56 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c7802984cf48d1852832b52abe52e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e326f95a9604fdb9bd075db3837cf62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:49:35.765454 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b0742b6e-2c7f-4baa-a4c2-df7f1aef4e56 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] 10.222.0.60 "GET /compute/v2.1/servers/307b2830-67e6-44ec-845f-9894de16694a" status: 200 len: 1316 microversion: 2.1 time: 1.139827 Sep 14 08:49:35.767498 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 236/445] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:49:34 2022] GET /compute/v2.1/servers/307b2830-67e6-44ec-845f-9894de16694a => generated 1316 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:49:35.855781 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-615c5cc9-aa4c-4067-aba3-33f30866e4c0 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2ee35c4791437c83193357b4085128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4300dd934369461b9b6ef556246bfc53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:49:35.867671 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-615c5cc9-aa4c-4067-aba3-33f30866e4c0 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] 10.222.0.60 "GET /compute/v2.1/servers/b337eb96-57a1-408f-8890-3a0a84e1afa3" status: 200 len: 1318 microversion: 2.1 time: 0.551251 Sep 14 08:49:35.869182 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 210/446] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:49:35 2022] GET /compute/v2.1/servers/b337eb96-57a1-408f-8890-3a0a84e1afa3 => generated 1318 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:49:35.877241 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d612deaa-e596-4519-80c5-3b7448df048f tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:49:35.878486 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-d612deaa-e596-4519-80c5-3b7448df048f tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: 0a331816-6b06-40c9-a557-eada274501b5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:49:35.905694 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d612deaa-e596-4519-80c5-3b7448df048f tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:35.906445 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d612deaa-e596-4519-80c5-3b7448df048f tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:35.907854 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d612deaa-e596-4519-80c5-3b7448df048f tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:35.910543 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d612deaa-e596-4519-80c5-3b7448df048f tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:35.912832 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d612deaa-e596-4519-80c5-3b7448df048f tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:35.913390 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d612deaa-e596-4519-80c5-3b7448df048f tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:36.189620 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8d04638a-86a2-4768-897f-d93e07470c97 tempest-ServersWithSpecificFlavorTestJSON-583330009 tempest-ServersWithSpecificFlavorTestJSON-583330009-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-559262242", "id": 120035608, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:49:36.218749 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-8d04638a-86a2-4768-897f-d93e07470c97 tempest-ServersWithSpecificFlavorTestJSON-583330009 tempest-ServersWithSpecificFlavorTestJSON-583330009-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 421 microversion: 2.1 time: 0.449258 Sep 14 08:49:36.220222 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 237/447] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 08:49:35 2022] POST /compute/v2.1/flavors => generated 421 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:49:36.225834 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-dd75209b-6fef-4b87-b5c2-32dc23244583 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:49:36.227799 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-dd75209b-6fef-4b87-b5c2-32dc23244583 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] [instance: c402c828-5101-40cc-8ac8-b3d1470028ed] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:49:36.236953 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dd75209b-6fef-4b87-b5c2-32dc23244583 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:36.238020 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dd75209b-6fef-4b87-b5c2-32dc23244583 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:36.238755 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dd75209b-6fef-4b87-b5c2-32dc23244583 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:36.240045 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dd75209b-6fef-4b87-b5c2-32dc23244583 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:36.240813 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dd75209b-6fef-4b87-b5c2-32dc23244583 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:36.241827 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dd75209b-6fef-4b87-b5c2-32dc23244583 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:36.920189 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-d612deaa-e596-4519-80c5-3b7448df048f tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:49:36.937058 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-d612deaa-e596-4519-80c5-3b7448df048f tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/0a331816-6b06-40c9-a557-eada274501b5" status: 200 len: 1471 microversion: 2.1 time: 1.066615 Sep 14 08:49:36.942329 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 211/448] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:49:35 2022] GET /compute/v2.1/servers/0a331816-6b06-40c9-a557-eada274501b5 => generated 1471 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:49:36.956225 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-dd9853ed-eeb3-4e46-b021-6826c028a8ac req-af168e28-c3b5-4999-92dd-afd2b3e5226c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "307b2830-67e6-44ec-845f-9894de16694a", "name": "network-vif-plugged", "status": "completed", "tag": "bfa5166f-08ce-4ac5-b444-021ba67b84d5"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:49:36.993009 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-dd9853ed-eeb3-4e46-b021-6826c028a8ac req-af168e28-c3b5-4999-92dd-afd2b3e5226c service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:36.993873 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-dd9853ed-eeb3-4e46-b021-6826c028a8ac req-af168e28-c3b5-4999-92dd-afd2b3e5226c service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:36.995342 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-dd9853ed-eeb3-4e46-b021-6826c028a8ac req-af168e28-c3b5-4999-92dd-afd2b3e5226c service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:37.043185 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-dd9853ed-eeb3-4e46-b021-6826c028a8ac req-af168e28-c3b5-4999-92dd-afd2b3e5226c service nova] Creating event network-vif-plugged:bfa5166f-08ce-4ac5-b444-021ba67b84d5 for instance 307b2830-67e6-44ec-845f-9894de16694a on n-h1-836830-18 Sep 14 08:49:37.059418 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-dd9853ed-eeb3-4e46-b021-6826c028a8ac req-af168e28-c3b5-4999-92dd-afd2b3e5226c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114565 Sep 14 08:49:37.062340 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 212/449] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:49:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:49:37.079798 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-3cc8db42-fbf0-43ff-b160-b84eb9aca9ad tempest-ServersWithSpecificFlavorTestJSON-583330009 tempest-ServersWithSpecificFlavorTestJSON-583330009-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:49:37.111063 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-3cc8db42-fbf0-43ff-b160-b84eb9aca9ad tempest-ServersWithSpecificFlavorTestJSON-583330009 tempest-ServersWithSpecificFlavorTestJSON-583330009-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.041960 Sep 14 08:49:37.114902 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 213/450] 10.222.0.60 () {58 vars in 1182 bytes} [Wed Sep 14 08:49:37 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 08:49:37.128996 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c2256c8a-fda5-470a-8619-54f606b8e9bc tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:49:37.130364 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-c2256c8a-fda5-470a-8619-54f606b8e9bc tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] [instance: 307b2830-67e6-44ec-845f-9894de16694a] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:49:37.149020 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c2256c8a-fda5-470a-8619-54f606b8e9bc tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:37.150006 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c2256c8a-fda5-470a-8619-54f606b8e9bc tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:37.151463 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c2256c8a-fda5-470a-8619-54f606b8e9bc tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:37.156664 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c2256c8a-fda5-470a-8619-54f606b8e9bc tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:37.159911 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c2256c8a-fda5-470a-8619-54f606b8e9bc tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:37.161880 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c2256c8a-fda5-470a-8619-54f606b8e9bc tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:37.207583 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=100 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:49:37.395515 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-dd75209b-6fef-4b87-b5c2-32dc23244583 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2290f39b61044661aa9bec206794a5c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '919dd9619fb24ee281cf6d96cf3351df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:49:37.408888 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-dd75209b-6fef-4b87-b5c2-32dc23244583 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] 10.222.0.60 "GET /compute/v2.1/servers/c402c828-5101-40cc-8ac8-b3d1470028ed" status: 200 len: 1332 microversion: 2.1 time: 1.186740 Sep 14 08:49:37.426515 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 238/451] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:49:36 2022] GET /compute/v2.1/servers/c402c828-5101-40cc-8ac8-b3d1470028ed => generated 1332 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:49:37.441267 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3bb05d9e-7c5b-432a-aa67-a213e5b7f592 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:49:37.443259 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-3bb05d9e-7c5b-432a-aa67-a213e5b7f592 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] [instance: b337eb96-57a1-408f-8890-3a0a84e1afa3] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:49:37.455331 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3bb05d9e-7c5b-432a-aa67-a213e5b7f592 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:37.456436 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3bb05d9e-7c5b-432a-aa67-a213e5b7f592 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:37.458884 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3bb05d9e-7c5b-432a-aa67-a213e5b7f592 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:37.460969 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3bb05d9e-7c5b-432a-aa67-a213e5b7f592 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:37.461685 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3bb05d9e-7c5b-432a-aa67-a213e5b7f592 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:37.462336 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3bb05d9e-7c5b-432a-aa67-a213e5b7f592 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:37.494610 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=100 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:49:37.787689 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=2 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:49:37.859091 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=6 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:49:38.123162 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-c2256c8a-fda5-470a-8619-54f606b8e9bc tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c7802984cf48d1852832b52abe52e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e326f95a9604fdb9bd075db3837cf62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:49:38.135126 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-c2256c8a-fda5-470a-8619-54f606b8e9bc tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] 10.222.0.60 "GET /compute/v2.1/servers/307b2830-67e6-44ec-845f-9894de16694a" status: 200 len: 1316 microversion: 2.1 time: 1.018654 Sep 14 08:49:38.136245 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 214/452] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:49:37 2022] GET /compute/v2.1/servers/307b2830-67e6-44ec-845f-9894de16694a => generated 1316 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:49:38.150918 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-6379c7c0-3f06-44dd-94d5-8fa3a09ede92 tempest-ServersWithSpecificFlavorTestJSON-583330009 tempest-ServersWithSpecificFlavorTestJSON-583330009-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-684977610", "id": 654124095, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:49:38.195995 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-6379c7c0-3f06-44dd-94d5-8fa3a09ede92 tempest-ServersWithSpecificFlavorTestJSON-583330009 tempest-ServersWithSpecificFlavorTestJSON-583330009-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 421 microversion: 2.1 time: 0.056249 Sep 14 08:49:38.198201 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 215/453] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 08:49:38 2022] POST /compute/v2.1/flavors => generated 421 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:49:38.211228 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-6f477eb5-5201-473a-95cf-4fabd436b60d req-eab26e02-edcf-4947-8938-1a9076196c99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c402c828-5101-40cc-8ac8-b3d1470028ed", "tag": "16038378-4ff2-47f4-881a-cf785e164719"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:49:38.241396 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-6f477eb5-5201-473a-95cf-4fabd436b60d req-eab26e02-edcf-4947-8938-1a9076196c99 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:38.241908 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-6f477eb5-5201-473a-95cf-4fabd436b60d req-eab26e02-edcf-4947-8938-1a9076196c99 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:38.242347 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-6f477eb5-5201-473a-95cf-4fabd436b60d req-eab26e02-edcf-4947-8938-1a9076196c99 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:38.249239 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-3bb05d9e-7c5b-432a-aa67-a213e5b7f592 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2ee35c4791437c83193357b4085128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4300dd934369461b9b6ef556246bfc53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:49:38.260771 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-3bb05d9e-7c5b-432a-aa67-a213e5b7f592 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] 10.222.0.60 "GET /compute/v2.1/servers/b337eb96-57a1-408f-8890-3a0a84e1afa3" status: 200 len: 1318 microversion: 2.1 time: 0.824702 Sep 14 08:49:38.262587 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 239/454] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:49:37 2022] GET /compute/v2.1/servers/b337eb96-57a1-408f-8890-3a0a84e1afa3 => generated 1318 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:49:38.275138 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-6f477eb5-5201-473a-95cf-4fabd436b60d req-eab26e02-edcf-4947-8938-1a9076196c99 service nova] Creating event network-changed:16038378-4ff2-47f4-881a-cf785e164719 for instance c402c828-5101-40cc-8ac8-b3d1470028ed on n-h1-836830-18 Sep 14 08:49:38.281766 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-2fa2651e-2378-4438-92ba-1340bd0f6b54 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:49:38.282138 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-6f477eb5-5201-473a-95cf-4fabd436b60d req-eab26e02-edcf-4947-8938-1a9076196c99 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078905 Sep 14 08:49:38.282783 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 216/455] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:49:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:49:38.283202 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-2fa2651e-2378-4438-92ba-1340bd0f6b54 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: 0a331816-6b06-40c9-a557-eada274501b5] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:49:38.294142 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1d9ad3ed-492f-4bb3-a4fd-23c5139aa4bf tempest-ServersWithSpecificFlavorTestJSON-583330009 tempest-ServersWithSpecificFlavorTestJSON-583330009-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:49:38.295108 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2fa2651e-2378-4438-92ba-1340bd0f6b54 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:38.295618 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2fa2651e-2378-4438-92ba-1340bd0f6b54 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:38.297765 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2fa2651e-2378-4438-92ba-1340bd0f6b54 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:38.298796 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2fa2651e-2378-4438-92ba-1340bd0f6b54 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:38.299448 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2fa2651e-2378-4438-92ba-1340bd0f6b54 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:38.300726 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2fa2651e-2378-4438-92ba-1340bd0f6b54 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:38.313878 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-1d9ad3ed-492f-4bb3-a4fd-23c5139aa4bf tempest-ServersWithSpecificFlavorTestJSON-583330009 tempest-ServersWithSpecificFlavorTestJSON-583330009-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.027451 Sep 14 08:49:38.316002 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 217/456] 10.222.0.60 () {58 vars in 1182 bytes} [Wed Sep 14 08:49:38 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 08:49:38.328417 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-04f9b03a-38f8-4262-a878-7080aed2950d tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Action: 'create', calling method: .version_select at 0x7f7d44ca75e0>, body: {"keypair": {"name": "tempest-keypair-1720139900", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDaS7TaCxmmAXoyvf1TJGQ6RnfQMhcSeRncL5dgexh4KTTeuHPNY4wkSWGsEqbakm6Mq1CuX7SoVhfyMDRzCT8MHPo5mbKz+ttSWqAj48gxw7HJLlSOuPGPCynMQfn9Rsw=="}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:49:38.388482 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-04f9b03a-38f8-4262-a878-7080aed2950d tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Getting quotas for project ee17e19b2f094a899dfc8966152fd642. Resources: {'key_pairs'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 08:49:38.406116 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-04f9b03a-38f8-4262-a878-7080aed2950d tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Getting quotas for user 24b938da87b14cd79c3c6dd85818cd02 and project ee17e19b2f094a899dfc8966152fd642. Resources: {'key_pairs'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 08:49:38.411506 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=4,nova_api:DELETE=4 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:49:38.458273 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-04f9b03a-38f8-4262-a878-7080aed2950d tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.133460 Sep 14 08:49:38.466141 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 218/457] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Sep 14 08:49:38 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:49:38.472150 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d27377ff-8b53-4495-bdfd-86bad75b97f6 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:49:38.475119 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-d27377ff-8b53-4495-bdfd-86bad75b97f6 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] [instance: c402c828-5101-40cc-8ac8-b3d1470028ed] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:49:38.482593 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d27377ff-8b53-4495-bdfd-86bad75b97f6 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:38.483410 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d27377ff-8b53-4495-bdfd-86bad75b97f6 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:38.484129 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d27377ff-8b53-4495-bdfd-86bad75b97f6 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:38.485117 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d27377ff-8b53-4495-bdfd-86bad75b97f6 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:38.485733 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d27377ff-8b53-4495-bdfd-86bad75b97f6 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:38.486468 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d27377ff-8b53-4495-bdfd-86bad75b97f6 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:39.446651 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-2fa2651e-2378-4438-92ba-1340bd0f6b54 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:49:39.462325 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-2fa2651e-2378-4438-92ba-1340bd0f6b54 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/0a331816-6b06-40c9-a557-eada274501b5" status: 200 len: 1468 microversion: 2.1 time: 1.195015 Sep 14 08:49:39.464378 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 240/458] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:49:38 2022] GET /compute/v2.1/servers/0a331816-6b06-40c9-a557-eada274501b5 => generated 1468 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:49:39.498652 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3b9665dc-7d9b-4b89-8083-c6c4fde4bbb3 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:49:39.508029 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-3b9665dc-7d9b-4b89-8083-c6c4fde4bbb3 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] [instance: 307b2830-67e6-44ec-845f-9894de16694a] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:49:39.509433 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-d27377ff-8b53-4495-bdfd-86bad75b97f6 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2290f39b61044661aa9bec206794a5c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '919dd9619fb24ee281cf6d96cf3351df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:49:39.518726 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3b9665dc-7d9b-4b89-8083-c6c4fde4bbb3 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:39.519249 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3b9665dc-7d9b-4b89-8083-c6c4fde4bbb3 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:39.519690 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3b9665dc-7d9b-4b89-8083-c6c4fde4bbb3 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:39.524401 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-d27377ff-8b53-4495-bdfd-86bad75b97f6 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] 10.222.0.60 "GET /compute/v2.1/servers/c402c828-5101-40cc-8ac8-b3d1470028ed" status: 200 len: 1332 microversion: 2.1 time: 1.056860 Sep 14 08:49:39.525540 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 219/459] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:49:38 2022] GET /compute/v2.1/servers/c402c828-5101-40cc-8ac8-b3d1470028ed => generated 1332 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:49:39.526285 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3b9665dc-7d9b-4b89-8083-c6c4fde4bbb3 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:39.527844 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3b9665dc-7d9b-4b89-8083-c6c4fde4bbb3 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:39.528319 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3b9665dc-7d9b-4b89-8083-c6c4fde4bbb3 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:39.536590 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-6b389b38-4dc4-48eb-8e59-41a843d20974 req-06a6c5cd-0405-4f2c-9d7b-8338ac6ad3be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b337eb96-57a1-408f-8890-3a0a84e1afa3", "name": "network-vif-plugged", "status": "completed", "tag": "3a8201ea-e8bb-4c3a-9174-e0e422931f12"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:49:39.563056 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-6b389b38-4dc4-48eb-8e59-41a843d20974 req-06a6c5cd-0405-4f2c-9d7b-8338ac6ad3be service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:39.578506 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-6b389b38-4dc4-48eb-8e59-41a843d20974 req-06a6c5cd-0405-4f2c-9d7b-8338ac6ad3be service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:39.579196 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-6b389b38-4dc4-48eb-8e59-41a843d20974 req-06a6c5cd-0405-4f2c-9d7b-8338ac6ad3be service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:39.605646 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-6b389b38-4dc4-48eb-8e59-41a843d20974 req-06a6c5cd-0405-4f2c-9d7b-8338ac6ad3be service nova] Creating event network-vif-plugged:3a8201ea-e8bb-4c3a-9174-e0e422931f12 for instance b337eb96-57a1-408f-8890-3a0a84e1afa3 on n-h2-836830-18 Sep 14 08:49:39.615027 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-6b389b38-4dc4-48eb-8e59-41a843d20974 req-06a6c5cd-0405-4f2c-9d7b-8338ac6ad3be service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083858 Sep 14 08:49:39.625911 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 220/460] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:49:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:49:39.662980 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1c91d45b-5d82-43a3-8037-f1d1b7b84384 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:49:39.664190 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-1c91d45b-5d82-43a3-8037-f1d1b7b84384 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] [instance: b337eb96-57a1-408f-8890-3a0a84e1afa3] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:49:39.677848 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1c91d45b-5d82-43a3-8037-f1d1b7b84384 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:39.679166 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1c91d45b-5d82-43a3-8037-f1d1b7b84384 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:39.679767 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1c91d45b-5d82-43a3-8037-f1d1b7b84384 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:39.680929 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1c91d45b-5d82-43a3-8037-f1d1b7b84384 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:39.684068 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1c91d45b-5d82-43a3-8037-f1d1b7b84384 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:39.685242 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1c91d45b-5d82-43a3-8037-f1d1b7b84384 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:40.072007 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-1c91d45b-5d82-43a3-8037-f1d1b7b84384 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2ee35c4791437c83193357b4085128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4300dd934369461b9b6ef556246bfc53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:49:40.094400 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-1c91d45b-5d82-43a3-8037-f1d1b7b84384 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] 10.222.0.60 "GET /compute/v2.1/servers/b337eb96-57a1-408f-8890-3a0a84e1afa3" status: 200 len: 1318 microversion: 2.1 time: 0.450809 Sep 14 08:49:40.098141 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 221/461] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:49:39 2022] GET /compute/v2.1/servers/b337eb96-57a1-408f-8890-3a0a84e1afa3 => generated 1318 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:49:40.113165 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-3b9665dc-7d9b-4b89-8083-c6c4fde4bbb3 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c7802984cf48d1852832b52abe52e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e326f95a9604fdb9bd075db3837cf62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:49:40.119541 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-8406071c-d4c3-477f-8c4e-708aa1155d12 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:49:40.120353 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-8406071c-d4c3-477f-8c4e-708aa1155d12 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: 0a331816-6b06-40c9-a557-eada274501b5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:49:40.128070 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-3b9665dc-7d9b-4b89-8083-c6c4fde4bbb3 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] 10.222.0.60 "GET /compute/v2.1/servers/307b2830-67e6-44ec-845f-9894de16694a" status: 200 len: 1466 microversion: 2.1 time: 0.636162 Sep 14 08:49:40.130067 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 241/462] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:49:39 2022] GET /compute/v2.1/servers/307b2830-67e6-44ec-845f-9894de16694a => generated 1466 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:49:40.143542 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8406071c-d4c3-477f-8c4e-708aa1155d12 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:40.144571 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8406071c-d4c3-477f-8c4e-708aa1155d12 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:40.145511 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8406071c-d4c3-477f-8c4e-708aa1155d12 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:40.147076 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8406071c-d4c3-477f-8c4e-708aa1155d12 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:40.147771 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8406071c-d4c3-477f-8c4e-708aa1155d12 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:40.148697 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8406071c-d4c3-477f-8c4e-708aa1155d12 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:40.357583 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-8406071c-d4c3-477f-8c4e-708aa1155d12 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "POST /compute/v2.1/servers/0a331816-6b06-40c9-a557-eada274501b5/action" status: 204 len: 0 microversion: 2.1 time: 0.257759 Sep 14 08:49:40.368642 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 222/463] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 08:49:40 2022] POST /compute/v2.1/servers/0a331816-6b06-40c9-a557-eada274501b5/action => generated 0 bytes in 269 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 08:49:40.379463 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-e32b109d-8297-495d-ab8d-2eb208b07e79 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:49:40.380096 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-e32b109d-8297-495d-ab8d-2eb208b07e79 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: 0a331816-6b06-40c9-a557-eada274501b5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:49:40.407709 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e32b109d-8297-495d-ab8d-2eb208b07e79 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:40.408237 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e32b109d-8297-495d-ab8d-2eb208b07e79 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:40.408711 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e32b109d-8297-495d-ab8d-2eb208b07e79 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:40.412814 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e32b109d-8297-495d-ab8d-2eb208b07e79 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:40.413302 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e32b109d-8297-495d-ab8d-2eb208b07e79 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:40.413735 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e32b109d-8297-495d-ab8d-2eb208b07e79 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:40.588694 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-eb6d62ac-df80-49f2-8675-c795a1e31b39 tempest-ServersOnMultiNodesTest-1008135845 tempest-ServersOnMultiNodesTest-1008135845-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:49:40.590781 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-eb6d62ac-df80-49f2-8675-c795a1e31b39 tempest-ServersOnMultiNodesTest-1008135845 tempest-ServersOnMultiNodesTest-1008135845-project-admin] [instance: 307b2830-67e6-44ec-845f-9894de16694a] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:49:40.602234 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-eb6d62ac-df80-49f2-8675-c795a1e31b39 tempest-ServersOnMultiNodesTest-1008135845 tempest-ServersOnMultiNodesTest-1008135845-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:40.607242 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-eb6d62ac-df80-49f2-8675-c795a1e31b39 tempest-ServersOnMultiNodesTest-1008135845 tempest-ServersOnMultiNodesTest-1008135845-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:40.607711 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-eb6d62ac-df80-49f2-8675-c795a1e31b39 tempest-ServersOnMultiNodesTest-1008135845 tempest-ServersOnMultiNodesTest-1008135845-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:40.608472 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-eb6d62ac-df80-49f2-8675-c795a1e31b39 tempest-ServersOnMultiNodesTest-1008135845 tempest-ServersOnMultiNodesTest-1008135845-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:40.608952 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-eb6d62ac-df80-49f2-8675-c795a1e31b39 tempest-ServersOnMultiNodesTest-1008135845 tempest-ServersOnMultiNodesTest-1008135845-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:40.611085 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-eb6d62ac-df80-49f2-8675-c795a1e31b39 tempest-ServersOnMultiNodesTest-1008135845 tempest-ServersOnMultiNodesTest-1008135845-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:41.182862 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-e32b109d-8297-495d-ab8d-2eb208b07e79 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:49:41.217835 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-e32b109d-8297-495d-ab8d-2eb208b07e79 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/0a331816-6b06-40c9-a557-eada274501b5" status: 200 len: 1468 microversion: 2.1 time: 0.842720 Sep 14 08:49:41.220130 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 223/464] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:49:40 2022] GET /compute/v2.1/servers/0a331816-6b06-40c9-a557-eada274501b5 => generated 1468 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:49:41.229761 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-7f59de34-9656-47d9-a81e-76801cd47ce6 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:49:41.232757 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-7f59de34-9656-47d9-a81e-76801cd47ce6 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] [instance: c402c828-5101-40cc-8ac8-b3d1470028ed] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:49:41.254672 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7f59de34-9656-47d9-a81e-76801cd47ce6 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:41.255689 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7f59de34-9656-47d9-a81e-76801cd47ce6 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:41.256601 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7f59de34-9656-47d9-a81e-76801cd47ce6 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:41.259374 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7f59de34-9656-47d9-a81e-76801cd47ce6 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:41.260196 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7f59de34-9656-47d9-a81e-76801cd47ce6 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:41.260892 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7f59de34-9656-47d9-a81e-76801cd47ce6 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:41.873936 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-eb6d62ac-df80-49f2-8675-c795a1e31b39 tempest-ServersOnMultiNodesTest-1008135845 tempest-ServersOnMultiNodesTest-1008135845-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/307b2830-67e6-44ec-845f-9894de16694a" status: 200 len: 1619 microversion: 2.1 time: 1.717946 Sep 14 08:49:41.883948 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 242/465] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:49:40 2022] GET /compute/v2.1/servers/307b2830-67e6-44ec-845f-9894de16694a => generated 1619 bytes in 1723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:49:41.894080 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-7f59de34-9656-47d9-a81e-76801cd47ce6 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2290f39b61044661aa9bec206794a5c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '919dd9619fb24ee281cf6d96cf3351df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:49:41.894233 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c7e3735a-7f80-45ac-bd38-26d2fc5da493 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:49:41.898132 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-c7e3735a-7f80-45ac-bd38-26d2fc5da493 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] [instance: b337eb96-57a1-408f-8890-3a0a84e1afa3] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:49:41.918457 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-7f59de34-9656-47d9-a81e-76801cd47ce6 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] 10.222.0.60 "GET /compute/v2.1/servers/c402c828-5101-40cc-8ac8-b3d1470028ed" status: 200 len: 1332 microversion: 2.1 time: 0.696727 Sep 14 08:49:41.919704 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 224/466] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:49:41 2022] GET /compute/v2.1/servers/c402c828-5101-40cc-8ac8-b3d1470028ed => generated 1332 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:49:41.936006 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c7e3735a-7f80-45ac-bd38-26d2fc5da493 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:41.936511 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c7e3735a-7f80-45ac-bd38-26d2fc5da493 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:41.936947 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c7e3735a-7f80-45ac-bd38-26d2fc5da493 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:41.937822 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c7e3735a-7f80-45ac-bd38-26d2fc5da493 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:41.938416 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c7e3735a-7f80-45ac-bd38-26d2fc5da493 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:41.939023 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c7e3735a-7f80-45ac-bd38-26d2fc5da493 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:41.942920 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-24a5e118-93d3-4d29-a09f-5af46cc994e3 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Action: 'create', calling method: .version_select at 0x7f7d44cdf0d0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-773873609", "policies": ["affinity"]}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:49:42.027167 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-24a5e118-93d3-4d29-a09f-5af46cc994e3 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Getting quotas for project 5e326f95a9604fdb9bd075db3837cf62. Resources: {'server_groups'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 08:49:42.038344 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-24a5e118-93d3-4d29-a09f-5af46cc994e3 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Getting quotas for user 89c7802984cf48d1852832b52abe52e9 and project 5e326f95a9604fdb9bd075db3837cf62. Resources: {'server_groups'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 08:49:42.180509 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-24a5e118-93d3-4d29-a09f-5af46cc994e3 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Getting quotas for project 5e326f95a9604fdb9bd075db3837cf62. Resources: {'server_groups'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 08:49:42.189173 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-24a5e118-93d3-4d29-a09f-5af46cc994e3 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Getting quotas for user 89c7802984cf48d1852832b52abe52e9 and project 5e326f95a9604fdb9bd075db3837cf62. Resources: {'server_groups'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 08:49:42.209505 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-24a5e118-93d3-4d29-a09f-5af46cc994e3 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] 10.222.0.60 "POST /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.286744 Sep 14 08:49:42.210505 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 225/467] 10.222.0.60 () {60 vars in 1174 bytes} [Wed Sep 14 08:49:41 2022] POST /compute/v2.1/os-server-groups => generated 187 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:49:42.245106 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-716be10d-b1c4-480c-96ca-d331a970d88d tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:49:42.247309 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-716be10d-b1c4-480c-96ca-d331a970d88d tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: 0a331816-6b06-40c9-a557-eada274501b5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:49:42.265229 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-716be10d-b1c4-480c-96ca-d331a970d88d tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:42.266002 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-716be10d-b1c4-480c-96ca-d331a970d88d tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:42.267861 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-716be10d-b1c4-480c-96ca-d331a970d88d tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:42.271197 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-716be10d-b1c4-480c-96ca-d331a970d88d tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:42.273886 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-716be10d-b1c4-480c-96ca-d331a970d88d tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:42.275014 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-716be10d-b1c4-480c-96ca-d331a970d88d tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:42.588073 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-c7e3735a-7f80-45ac-bd38-26d2fc5da493 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2ee35c4791437c83193357b4085128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4300dd934369461b9b6ef556246bfc53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:49:42.602402 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-c7e3735a-7f80-45ac-bd38-26d2fc5da493 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] 10.222.0.60 "GET /compute/v2.1/servers/b337eb96-57a1-408f-8890-3a0a84e1afa3" status: 200 len: 1467 microversion: 2.1 time: 0.722004 Sep 14 08:49:42.610658 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 243/468] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:49:41 2022] GET /compute/v2.1/servers/b337eb96-57a1-408f-8890-3a0a84e1afa3 => generated 1467 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:49:42.625167 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c4e733a9-524d-4adb-9f57-81f5fa122366 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1777980679", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "772977de-b17d-439d-af7a-58894a154ed1"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:49:42.737045 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.network.neutron [None req-c4e733a9-524d-4adb-9f57-81f5fa122366 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] validate_networks() for None {{(pid=128759) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 08:49:43.292492 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-716be10d-b1c4-480c-96ca-d331a970d88d tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:49:43.301844 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-716be10d-b1c4-480c-96ca-d331a970d88d tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/0a331816-6b06-40c9-a557-eada274501b5" status: 200 len: 1468 microversion: 2.1 time: 1.062997 Sep 14 08:49:43.314365 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 226/469] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:49:42 2022] GET /compute/v2.1/servers/0a331816-6b06-40c9-a557-eada274501b5 => generated 1468 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:49:43.319583 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-22e71f5f-2c63-40b0-bb58-57c33c20ad2e tempest-LiveMigrationNegativeTest-1584437141 tempest-LiveMigrationNegativeTest-1584437141-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:49:43.320406 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-22e71f5f-2c63-40b0-bb58-57c33c20ad2e tempest-LiveMigrationNegativeTest-1584437141 tempest-LiveMigrationNegativeTest-1584437141-project-admin] [instance: b337eb96-57a1-408f-8890-3a0a84e1afa3] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:49:43.328698 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-22e71f5f-2c63-40b0-bb58-57c33c20ad2e tempest-LiveMigrationNegativeTest-1584437141 tempest-LiveMigrationNegativeTest-1584437141-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:43.332610 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-22e71f5f-2c63-40b0-bb58-57c33c20ad2e tempest-LiveMigrationNegativeTest-1584437141 tempest-LiveMigrationNegativeTest-1584437141-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:43.333369 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-22e71f5f-2c63-40b0-bb58-57c33c20ad2e tempest-LiveMigrationNegativeTest-1584437141 tempest-LiveMigrationNegativeTest-1584437141-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:43.334325 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-22e71f5f-2c63-40b0-bb58-57c33c20ad2e tempest-LiveMigrationNegativeTest-1584437141 tempest-LiveMigrationNegativeTest-1584437141-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:43.337202 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-22e71f5f-2c63-40b0-bb58-57c33c20ad2e tempest-LiveMigrationNegativeTest-1584437141 tempest-LiveMigrationNegativeTest-1584437141-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:43.337880 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-22e71f5f-2c63-40b0-bb58-57c33c20ad2e tempest-LiveMigrationNegativeTest-1584437141 tempest-LiveMigrationNegativeTest-1584437141-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:43.395269 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.objects.instance [None req-22e71f5f-2c63-40b0-bb58-57c33c20ad2e tempest-LiveMigrationNegativeTest-1584437141 tempest-LiveMigrationNegativeTest-1584437141-project-admin] Lazy-loading 'flavor' on Instance uuid b337eb96-57a1-408f-8890-3a0a84e1afa3 {{(pid=128758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 08:49:43.509620 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-c4e733a9-524d-4adb-9f57-81f5fa122366 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Flavor limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 08:49:43.510106 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-c4e733a9-524d-4adb-9f57-81f5fa122366 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Image limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 08:49:43.510813 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-c4e733a9-524d-4adb-9f57-81f5fa122366 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Flavor pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 08:49:43.511824 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-c4e733a9-524d-4adb-9f57-81f5fa122366 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Image pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 08:49:43.512243 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-c4e733a9-524d-4adb-9f57-81f5fa122366 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 08:49:43.608994 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c4e733a9-524d-4adb-9f57-81f5fa122366 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:43.609317 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c4e733a9-524d-4adb-9f57-81f5fa122366 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:43.609950 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c4e733a9-524d-4adb-9f57-81f5fa122366 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:43.610986 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c4e733a9-524d-4adb-9f57-81f5fa122366 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:43.611678 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c4e733a9-524d-4adb-9f57-81f5fa122366 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:43.612282 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c4e733a9-524d-4adb-9f57-81f5fa122366 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:43.641363 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-c4e733a9-524d-4adb-9f57-81f5fa122366 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Getting quotas for project 5e326f95a9604fdb9bd075db3837cf62. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 08:49:43.652179 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-c4e733a9-524d-4adb-9f57-81f5fa122366 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Getting quotas for user 89c7802984cf48d1852832b52abe52e9 and project 5e326f95a9604fdb9bd075db3837cf62. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 08:49:43.664413 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-22e71f5f-2c63-40b0-bb58-57c33c20ad2e tempest-LiveMigrationNegativeTest-1584437141 tempest-LiveMigrationNegativeTest-1584437141-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/b337eb96-57a1-408f-8890-3a0a84e1afa3/action" status: 202 len: 0 microversion: 2.1 time: 0.346043 Sep 14 08:49:43.676132 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 227/470] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 08:49:43 2022] POST /compute/v2.1/servers/b337eb96-57a1-408f-8890-3a0a84e1afa3/action => generated 0 bytes in 361 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 08:49:43.679255 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-c4e733a9-524d-4adb-9f57-81f5fa122366 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Going to run 2 instances... {{(pid=128759) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 08:49:43.682341 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-c4e733a9-524d-4adb-9f57-81f5fa122366 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] [instance: 9507f778-dd44-4db1-b36e-fecd603b2487] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128759) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 08:49:43.701736 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-5e5997b9-2eb7-43b2-8624-da4dec299cad tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:49:43.704163 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-5e5997b9-2eb7-43b2-8624-da4dec299cad tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] [instance: c402c828-5101-40cc-8ac8-b3d1470028ed] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:49:43.722463 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5e5997b9-2eb7-43b2-8624-da4dec299cad tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:43.728958 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5e5997b9-2eb7-43b2-8624-da4dec299cad tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:43.732078 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5e5997b9-2eb7-43b2-8624-da4dec299cad tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:43.734832 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5e5997b9-2eb7-43b2-8624-da4dec299cad tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:43.735555 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5e5997b9-2eb7-43b2-8624-da4dec299cad tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:43.742486 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5e5997b9-2eb7-43b2-8624-da4dec299cad tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:43.749632 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-c4e733a9-524d-4adb-9f57-81f5fa122366 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=128759) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Sep 14 08:49:43.774865 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-c4e733a9-524d-4adb-9f57-81f5fa122366 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Getting quotas for project 5e326f95a9604fdb9bd075db3837cf62. Resources: {'server_group_members'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 08:49:43.782813 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-c4e733a9-524d-4adb-9f57-81f5fa122366 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Getting quotas for user 89c7802984cf48d1852832b52abe52e9 and project 5e326f95a9604fdb9bd075db3837cf62. Resources: {'server_group_members'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 08:49:43.843217 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-c4e733a9-524d-4adb-9f57-81f5fa122366 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Getting quotas for project 5e326f95a9604fdb9bd075db3837cf62. Resources: {'server_group_members'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 08:49:43.852656 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-c4e733a9-524d-4adb-9f57-81f5fa122366 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Getting quotas for user 89c7802984cf48d1852832b52abe52e9 and project 5e326f95a9604fdb9bd075db3837cf62. Resources: {'server_group_members'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 08:49:43.875476 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-c4e733a9-524d-4adb-9f57-81f5fa122366 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] [instance: 3acd19ba-a5b9-4bac-a4a3-2c274448c374] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=9507f778-dd44-4db1-b36e-fecd603b2487,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128759) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 08:49:43.958673 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-c4e733a9-524d-4adb-9f57-81f5fa122366 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Getting quotas for project 5e326f95a9604fdb9bd075db3837cf62. Resources: {'server_group_members'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 08:49:43.967524 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-c4e733a9-524d-4adb-9f57-81f5fa122366 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Getting quotas for user 89c7802984cf48d1852832b52abe52e9 and project 5e326f95a9604fdb9bd075db3837cf62. Resources: {'server_group_members'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 08:49:43.996046 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:49:44.021204 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-c4e733a9-524d-4adb-9f57-81f5fa122366 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Getting quotas for project 5e326f95a9604fdb9bd075db3837cf62. Resources: {'server_group_members'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 08:49:44.028843 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-c4e733a9-524d-4adb-9f57-81f5fa122366 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Getting quotas for user 89c7802984cf48d1852832b52abe52e9 and project 5e326f95a9604fdb9bd075db3837cf62. Resources: {'server_group_members'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 08:49:44.083319 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-c4e733a9-524d-4adb-9f57-81f5fa122366 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.470880 Sep 14 08:49:44.084166 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 244/471] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 08:49:42 2022] POST /compute/v2.1/servers => generated 32 bytes in 1473 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Sep 14 08:49:44.097382 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-16700ceb-e1b2-4322-b337-0859408ed704 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:49:44.098926 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-16700ceb-e1b2-4322-b337-0859408ed704 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] [instance: b337eb96-57a1-408f-8890-3a0a84e1afa3] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:49:44.108523 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-16700ceb-e1b2-4322-b337-0859408ed704 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:44.109015 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-16700ceb-e1b2-4322-b337-0859408ed704 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:44.109453 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-16700ceb-e1b2-4322-b337-0859408ed704 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:44.110246 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-16700ceb-e1b2-4322-b337-0859408ed704 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:44.110706 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-16700ceb-e1b2-4322-b337-0859408ed704 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:44.111161 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-16700ceb-e1b2-4322-b337-0859408ed704 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:45.860551 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-16700ceb-e1b2-4322-b337-0859408ed704 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2ee35c4791437c83193357b4085128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4300dd934369461b9b6ef556246bfc53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:49:45.871719 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-16700ceb-e1b2-4322-b337-0859408ed704 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] 10.222.0.60 "GET /compute/v2.1/servers/b337eb96-57a1-408f-8890-3a0a84e1afa3" status: 200 len: 1475 microversion: 2.1 time: 1.786154 Sep 14 08:49:45.873051 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 245/472] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:49:44 2022] GET /compute/v2.1/servers/b337eb96-57a1-408f-8890-3a0a84e1afa3 => generated 1475 bytes in 1788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:49:45.878234 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-6c2000a4-0881-47f8-9086-6449926d908e tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:49:45.883646 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-6c2000a4-0881-47f8-9086-6449926d908e tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '89c7802984cf48d1852832b52abe52e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e326f95a9604fdb9bd075db3837cf62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:49:45.884659 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-6c2000a4-0881-47f8-9086-6449926d908e tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Searching by: {'deleted': False, 'project_id': '5e326f95a9604fdb9bd075db3837cf62'} {{(pid=128759) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 14 08:49:45.893836 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6c2000a4-0881-47f8-9086-6449926d908e tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:45.894575 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6c2000a4-0881-47f8-9086-6449926d908e tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:45.895292 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6c2000a4-0881-47f8-9086-6449926d908e tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:45.898822 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6c2000a4-0881-47f8-9086-6449926d908e tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:45.899470 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6c2000a4-0881-47f8-9086-6449926d908e tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:45.900143 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6c2000a4-0881-47f8-9086-6449926d908e tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:45.912025 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-5e5997b9-2eb7-43b2-8624-da4dec299cad tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2290f39b61044661aa9bec206794a5c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '919dd9619fb24ee281cf6d96cf3351df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:49:45.929822 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-5e5997b9-2eb7-43b2-8624-da4dec299cad tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] 10.222.0.60 "GET /compute/v2.1/servers/c402c828-5101-40cc-8ac8-b3d1470028ed" status: 200 len: 1332 microversion: 2.1 time: 2.246357 Sep 14 08:49:45.934567 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 228/473] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:49:43 2022] GET /compute/v2.1/servers/c402c828-5101-40cc-8ac8-b3d1470028ed => generated 1332 bytes in 2258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:49:45.945883 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-53799065-0681-4da9-8b38-d71ceb418b03 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:49:45.946849 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-53799065-0681-4da9-8b38-d71ceb418b03 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: 0a331816-6b06-40c9-a557-eada274501b5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:49:45.961244 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-53799065-0681-4da9-8b38-d71ceb418b03 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:45.969699 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-53799065-0681-4da9-8b38-d71ceb418b03 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:45.972002 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-53799065-0681-4da9-8b38-d71ceb418b03 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:45.972995 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-53799065-0681-4da9-8b38-d71ceb418b03 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:45.976631 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-53799065-0681-4da9-8b38-d71ceb418b03 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:45.977545 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-53799065-0681-4da9-8b38-d71ceb418b03 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:46.089056 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.multi_cell_list [None req-6c2000a4-0881-47f8-9086-6449926d908e tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128759) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 14 08:49:46.287617 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-6c2000a4-0881-47f8-9086-6449926d908e tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] 10.222.0.60 "GET /compute/v2.1/servers" status: 200 len: 1003 microversion: 2.1 time: 0.413204 Sep 14 08:49:46.295264 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 246/474] 10.222.0.60 () {58 vars in 1125 bytes} [Wed Sep 14 08:49:45 2022] GET /compute/v2.1/servers => generated 1003 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:49:46.302766 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-d0373d99-dcba-4f39-b9bc-69e833cc8c70 req-1fb7c99d-6686-4874-84ce-33e3bb4f2ddb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a331816-6b06-40c9-a557-eada274501b5", "name": "network-vif-plugged", "status": "completed", "tag": "667429a7-9153-49c5-a750-cc44e1cd077d"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:49:46.314924 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-d0373d99-dcba-4f39-b9bc-69e833cc8c70 req-1fb7c99d-6686-4874-84ce-33e3bb4f2ddb service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:46.315692 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-d0373d99-dcba-4f39-b9bc-69e833cc8c70 req-1fb7c99d-6686-4874-84ce-33e3bb4f2ddb service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:46.316313 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-d0373d99-dcba-4f39-b9bc-69e833cc8c70 req-1fb7c99d-6686-4874-84ce-33e3bb4f2ddb service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:46.334145 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-d0373d99-dcba-4f39-b9bc-69e833cc8c70 req-1fb7c99d-6686-4874-84ce-33e3bb4f2ddb service nova] Creating event network-vif-plugged:667429a7-9153-49c5-a750-cc44e1cd077d for instance 0a331816-6b06-40c9-a557-eada274501b5 on n-h2-836830-18 Sep 14 08:49:46.344563 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [req-d0373d99-dcba-4f39-b9bc-69e833cc8c70 req-1fb7c99d-6686-4874-84ce-33e3bb4f2ddb service nova] Instance 0a331816-6b06-40c9-a557-eada274501b5 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-836830-18', 'n-h2-836830-18'} {{(pid=128759) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 14 08:49:46.366292 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-d0373d99-dcba-4f39-b9bc-69e833cc8c70 req-1fb7c99d-6686-4874-84ce-33e3bb4f2ddb service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068936 Sep 14 08:49:46.367838 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 247/475] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:49:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:49:46.380574 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ed982a37-c004-4b58-b8c5-4b1377c36514 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:49:46.383020 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-ed982a37-c004-4b58-b8c5-4b1377c36514 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] [instance: 3acd19ba-a5b9-4bac-a4a3-2c274448c374] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:49:46.393332 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ed982a37-c004-4b58-b8c5-4b1377c36514 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:46.394391 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ed982a37-c004-4b58-b8c5-4b1377c36514 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:46.395610 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ed982a37-c004-4b58-b8c5-4b1377c36514 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:46.396684 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ed982a37-c004-4b58-b8c5-4b1377c36514 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:46.397396 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ed982a37-c004-4b58-b8c5-4b1377c36514 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:46.398024 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ed982a37-c004-4b58-b8c5-4b1377c36514 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:46.596323 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-ed982a37-c004-4b58-b8c5-4b1377c36514 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c7802984cf48d1852832b52abe52e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e326f95a9604fdb9bd075db3837cf62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:49:46.607540 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-ed982a37-c004-4b58-b8c5-4b1377c36514 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] 10.222.0.60 "GET /compute/v2.1/servers/3acd19ba-a5b9-4bac-a4a3-2c274448c374" status: 200 len: 1215 microversion: 2.1 time: 0.237773 Sep 14 08:49:46.610466 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 248/476] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:49:46 2022] GET /compute/v2.1/servers/3acd19ba-a5b9-4bac-a4a3-2c274448c374 => generated 1215 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:49:46.804398 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-53799065-0681-4da9-8b38-d71ceb418b03 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:49:46.822238 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-53799065-0681-4da9-8b38-d71ceb418b03 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/0a331816-6b06-40c9-a557-eada274501b5" status: 200 len: 1468 microversion: 2.1 time: 0.884365 Sep 14 08:49:46.823745 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 229/477] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:49:45 2022] GET /compute/v2.1/servers/0a331816-6b06-40c9-a557-eada274501b5 => generated 1468 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:49:46.902493 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d46c3d1f-2f3a-4eda-8fb6-7be19adf905e tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:49:46.903724 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-d46c3d1f-2f3a-4eda-8fb6-7be19adf905e tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] [instance: b337eb96-57a1-408f-8890-3a0a84e1afa3] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:49:46.913872 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d46c3d1f-2f3a-4eda-8fb6-7be19adf905e tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:46.916337 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d46c3d1f-2f3a-4eda-8fb6-7be19adf905e tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:46.917015 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d46c3d1f-2f3a-4eda-8fb6-7be19adf905e tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:46.921363 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d46c3d1f-2f3a-4eda-8fb6-7be19adf905e tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:46.922057 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d46c3d1f-2f3a-4eda-8fb6-7be19adf905e tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:46.927691 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d46c3d1f-2f3a-4eda-8fb6-7be19adf905e tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:46.965065 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1b409d51-f228-4bba-b1c7-459d0109a891 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:49:46.966362 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-1b409d51-f228-4bba-b1c7-459d0109a891 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] [instance: c402c828-5101-40cc-8ac8-b3d1470028ed] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:49:46.974160 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1b409d51-f228-4bba-b1c7-459d0109a891 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:46.981684 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1b409d51-f228-4bba-b1c7-459d0109a891 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:46.982477 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1b409d51-f228-4bba-b1c7-459d0109a891 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:46.987721 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1b409d51-f228-4bba-b1c7-459d0109a891 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:46.990358 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1b409d51-f228-4bba-b1c7-459d0109a891 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:46.994395 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1b409d51-f228-4bba-b1c7-459d0109a891 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:48.016549 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-d46c3d1f-2f3a-4eda-8fb6-7be19adf905e tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2ee35c4791437c83193357b4085128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4300dd934369461b9b6ef556246bfc53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:49:48.032644 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d46c3d1f-2f3a-4eda-8fb6-7be19adf905e tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] 10.222.0.60 "GET /compute/v2.1/servers/b337eb96-57a1-408f-8890-3a0a84e1afa3" status: 200 len: 1458 microversion: 2.1 time: 1.135518 Sep 14 08:49:48.033943 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 249/478] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:49:46 2022] GET /compute/v2.1/servers/b337eb96-57a1-408f-8890-3a0a84e1afa3 => generated 1458 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:49:48.047705 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-db47a033-1e02-4f8e-b645-7429d443505e tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:49:48.048599 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-db47a033-1e02-4f8e-b645-7429d443505e tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] [instance: 3acd19ba-a5b9-4bac-a4a3-2c274448c374] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:49:48.067351 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-db47a033-1e02-4f8e-b645-7429d443505e tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:48.068181 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-db47a033-1e02-4f8e-b645-7429d443505e tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:48.068632 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-db47a033-1e02-4f8e-b645-7429d443505e tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:48.072426 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-db47a033-1e02-4f8e-b645-7429d443505e tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:48.072964 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-db47a033-1e02-4f8e-b645-7429d443505e tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:48.073402 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-db47a033-1e02-4f8e-b645-7429d443505e tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:48.169669 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-1b409d51-f228-4bba-b1c7-459d0109a891 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2290f39b61044661aa9bec206794a5c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '919dd9619fb24ee281cf6d96cf3351df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:49:48.202906 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-1b409d51-f228-4bba-b1c7-459d0109a891 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] 10.222.0.60 "GET /compute/v2.1/servers/c402c828-5101-40cc-8ac8-b3d1470028ed" status: 200 len: 1332 microversion: 2.1 time: 1.240667 Sep 14 08:49:48.221081 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 230/479] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:49:46 2022] GET /compute/v2.1/servers/c402c828-5101-40cc-8ac8-b3d1470028ed => generated 1332 bytes in 1257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:49:48.235498 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-cb460de5-fbb3-4631-bf27-c9e902e113cb tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:49:48.246122 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-cb460de5-fbb3-4631-bf27-c9e902e113cb tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: 0a331816-6b06-40c9-a557-eada274501b5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:49:48.263007 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-db47a033-1e02-4f8e-b645-7429d443505e tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c7802984cf48d1852832b52abe52e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e326f95a9604fdb9bd075db3837cf62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:49:48.267658 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cb460de5-fbb3-4631-bf27-c9e902e113cb tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:48.268660 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cb460de5-fbb3-4631-bf27-c9e902e113cb tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:48.269105 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cb460de5-fbb3-4631-bf27-c9e902e113cb tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:48.269832 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cb460de5-fbb3-4631-bf27-c9e902e113cb tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:48.270294 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cb460de5-fbb3-4631-bf27-c9e902e113cb tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:48.270718 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cb460de5-fbb3-4631-bf27-c9e902e113cb tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:48.278876 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-db47a033-1e02-4f8e-b645-7429d443505e tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] 10.222.0.60 "GET /compute/v2.1/servers/3acd19ba-a5b9-4bac-a4a3-2c274448c374" status: 200 len: 1289 microversion: 2.1 time: 0.241763 Sep 14 08:49:48.299558 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 250/480] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:49:48 2022] GET /compute/v2.1/servers/3acd19ba-a5b9-4bac-a4a3-2c274448c374 => generated 1289 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:49:48.306645 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e81245f8-370e-446f-bdfd-70b6c150857d tempest-LiveMigrationNegativeTest-1584437141 tempest-LiveMigrationNegativeTest-1584437141-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:49:48.307364 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e81245f8-370e-446f-bdfd-70b6c150857d tempest-LiveMigrationNegativeTest-1584437141 tempest-LiveMigrationNegativeTest-1584437141-project-admin] [instance: b337eb96-57a1-408f-8890-3a0a84e1afa3] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:49:48.313646 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e81245f8-370e-446f-bdfd-70b6c150857d tempest-LiveMigrationNegativeTest-1584437141 tempest-LiveMigrationNegativeTest-1584437141-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:48.314411 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e81245f8-370e-446f-bdfd-70b6c150857d tempest-LiveMigrationNegativeTest-1584437141 tempest-LiveMigrationNegativeTest-1584437141-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:48.318419 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e81245f8-370e-446f-bdfd-70b6c150857d tempest-LiveMigrationNegativeTest-1584437141 tempest-LiveMigrationNegativeTest-1584437141-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:48.319441 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e81245f8-370e-446f-bdfd-70b6c150857d tempest-LiveMigrationNegativeTest-1584437141 tempest-LiveMigrationNegativeTest-1584437141-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:48.320093 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e81245f8-370e-446f-bdfd-70b6c150857d tempest-LiveMigrationNegativeTest-1584437141 tempest-LiveMigrationNegativeTest-1584437141-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:48.320706 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e81245f8-370e-446f-bdfd-70b6c150857d tempest-LiveMigrationNegativeTest-1584437141 tempest-LiveMigrationNegativeTest-1584437141-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:49.063508 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-cb460de5-fbb3-4631-bf27-c9e902e113cb tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:49:49.082748 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-cb460de5-fbb3-4631-bf27-c9e902e113cb tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/0a331816-6b06-40c9-a557-eada274501b5" status: 200 len: 1468 microversion: 2.1 time: 0.863825 Sep 14 08:49:49.084107 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 231/481] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:49:48 2022] GET /compute/v2.1/servers/0a331816-6b06-40c9-a557-eada274501b5 => generated 1468 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:49:49.102259 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-38dae532-b860-48c0-a350-f317d0409a1a tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1006259823", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "654124095", "adminPass": "***", "networks": [{"uuid": "cbace868-f7ef-4631-aed2-33869360fdb4"}], "security_groups": [{"name": "tempest-securitygroup--458484819"}], "key_name": "tempest-keypair-1720139900", "user_data": "}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:49:49.125029 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e81245f8-370e-446f-bdfd-70b6c150857d tempest-LiveMigrationNegativeTest-1584437141 tempest-LiveMigrationNegativeTest-1584437141-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/b337eb96-57a1-408f-8890-3a0a84e1afa3" status: 200 len: 1611 microversion: 2.1 time: 0.821074 Sep 14 08:49:49.129967 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 251/482] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:49:48 2022] GET /compute/v2.1/servers/b337eb96-57a1-408f-8890-3a0a84e1afa3 => generated 1611 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:49:49.154508 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-4546dd3a-1b68-4844-b062-550a7d303526 tempest-LiveMigrationNegativeTest-1584437141 tempest-LiveMigrationNegativeTest-1584437141-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:49:49.158792 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4546dd3a-1b68-4844-b062-550a7d303526 tempest-LiveMigrationNegativeTest-1584437141 tempest-LiveMigrationNegativeTest-1584437141-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:49.159518 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4546dd3a-1b68-4844-b062-550a7d303526 tempest-LiveMigrationNegativeTest-1584437141 tempest-LiveMigrationNegativeTest-1584437141-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:49.160135 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4546dd3a-1b68-4844-b062-550a7d303526 tempest-LiveMigrationNegativeTest-1584437141 tempest-LiveMigrationNegativeTest-1584437141-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:49.161036 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4546dd3a-1b68-4844-b062-550a7d303526 tempest-LiveMigrationNegativeTest-1584437141 tempest-LiveMigrationNegativeTest-1584437141-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:49.161665 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4546dd3a-1b68-4844-b062-550a7d303526 tempest-LiveMigrationNegativeTest-1584437141 tempest-LiveMigrationNegativeTest-1584437141-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:49.162250 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4546dd3a-1b68-4844-b062-550a7d303526 tempest-LiveMigrationNegativeTest-1584437141 tempest-LiveMigrationNegativeTest-1584437141-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:49.232986 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-4546dd3a-1b68-4844-b062-550a7d303526 tempest-LiveMigrationNegativeTest-1584437141 tempest-LiveMigrationNegativeTest-1584437141-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.083065 Sep 14 08:49:49.234584 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 252/483] 10.222.0.60 () {58 vars in 1176 bytes} [Wed Sep 14 08:49:49 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 08:49:49.241308 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-2c5ecbd5-d67e-4bbf-8c68-9541c1813b2d tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:49:49.242391 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-2c5ecbd5-d67e-4bbf-8c68-9541c1813b2d tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] [instance: c402c828-5101-40cc-8ac8-b3d1470028ed] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:49:49.250660 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2c5ecbd5-d67e-4bbf-8c68-9541c1813b2d tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:49.251478 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2c5ecbd5-d67e-4bbf-8c68-9541c1813b2d tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:49.252378 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2c5ecbd5-d67e-4bbf-8c68-9541c1813b2d tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:49.253839 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2c5ecbd5-d67e-4bbf-8c68-9541c1813b2d tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:49.254456 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2c5ecbd5-d67e-4bbf-8c68-9541c1813b2d tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:49.255089 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2c5ecbd5-d67e-4bbf-8c68-9541c1813b2d tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:49.587600 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.network.neutron [None req-38dae532-b860-48c0-a350-f317d0409a1a tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] validate_networks() for [('cbace868-f7ef-4631-aed2-33869360fdb4', None, None, None, None, None)] {{(pid=128758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 08:49:49.767647 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-2c5ecbd5-d67e-4bbf-8c68-9541c1813b2d tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2290f39b61044661aa9bec206794a5c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '919dd9619fb24ee281cf6d96cf3351df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:49:49.785407 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-2c5ecbd5-d67e-4bbf-8c68-9541c1813b2d tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] 10.222.0.60 "GET /compute/v2.1/servers/c402c828-5101-40cc-8ac8-b3d1470028ed" status: 200 len: 1332 microversion: 2.1 time: 0.549056 Sep 14 08:49:49.786007 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 253/484] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:49:49 2022] GET /compute/v2.1/servers/c402c828-5101-40cc-8ac8-b3d1470028ed => generated 1332 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:49:49.810104 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-87d4a9aa-7697-485e-80de-6a3c3e290d88 tempest-LiveMigrationNegativeTest-1584437141 tempest-LiveMigrationNegativeTest-1584437141-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-836830-18", "block_migration": true, "disk_over_commit": false}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:49:49.822535 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-87d4a9aa-7697-485e-80de-6a3c3e290d88 tempest-LiveMigrationNegativeTest-1584437141 tempest-LiveMigrationNegativeTest-1584437141-project-admin] [instance: b337eb96-57a1-408f-8890-3a0a84e1afa3] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:49:49.836227 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-87d4a9aa-7697-485e-80de-6a3c3e290d88 tempest-LiveMigrationNegativeTest-1584437141 tempest-LiveMigrationNegativeTest-1584437141-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:49.836724 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-87d4a9aa-7697-485e-80de-6a3c3e290d88 tempest-LiveMigrationNegativeTest-1584437141 tempest-LiveMigrationNegativeTest-1584437141-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:49.837500 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-87d4a9aa-7697-485e-80de-6a3c3e290d88 tempest-LiveMigrationNegativeTest-1584437141 tempest-LiveMigrationNegativeTest-1584437141-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:49.838383 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-87d4a9aa-7697-485e-80de-6a3c3e290d88 tempest-LiveMigrationNegativeTest-1584437141 tempest-LiveMigrationNegativeTest-1584437141-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:49.838864 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-87d4a9aa-7697-485e-80de-6a3c3e290d88 tempest-LiveMigrationNegativeTest-1584437141 tempest-LiveMigrationNegativeTest-1584437141-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:49.843706 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-87d4a9aa-7697-485e-80de-6a3c3e290d88 tempest-LiveMigrationNegativeTest-1584437141 tempest-LiveMigrationNegativeTest-1584437141-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:49.896130 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.objects.instance [None req-87d4a9aa-7697-485e-80de-6a3c3e290d88 tempest-LiveMigrationNegativeTest-1584437141 tempest-LiveMigrationNegativeTest-1584437141-project-admin] Lazy-loading 'flavor' on Instance uuid b337eb96-57a1-408f-8890-3a0a84e1afa3 {{(pid=128759) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 08:49:49.929527 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-87d4a9aa-7697-485e-80de-6a3c3e290d88 tempest-LiveMigrationNegativeTest-1584437141 tempest-LiveMigrationNegativeTest-1584437141-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance b337eb96-57a1-408f-8890-3a0a84e1afa3 while it is in vm_state suspended Sep 14 08:49:49.932011 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-87d4a9aa-7697-485e-80de-6a3c3e290d88 tempest-LiveMigrationNegativeTest-1584437141 tempest-LiveMigrationNegativeTest-1584437141-project-admin] Request method failure captured: Sep 14 08:49:49.932011 n-d-836830-18 devstack@n-api.service[128759]: request: POST /compute/v2.1/servers/b337eb96-57a1-408f-8890-3a0a84e1afa3/action HTTP/1.1 Sep 14 08:49:49.932011 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 08:49:49.932011 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 08:49:49.932011 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 08:49:49.932011 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 98 Sep 14 08:49:49.932011 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 08:49:49.932011 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 08:49:49.932011 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 08:49:49.932011 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 08:49:49.932011 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZV2rxaswoKkceZnRuYlOL7pJqM2-aQdINhwA5OUcgenrMnuj6wMfIfAsFDsqiwrg7ieCKG2Jc5VePvhcMRE3pngnQmeIoVjlswyZPiAV0Kqt0_-QZgO71gjK4uZBRtS70JE_wibpe8ud1FkLQuywH_1KCXI8OleJ9D5gt97Eyqa_aU Sep 14 08:49:49.932011 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 08:49:49.932011 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 08:49:49.932011 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 08:49:49.932011 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 08:49:49.932011 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 08:49:49.932011 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 08:49:49.932011 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: c863a1b7bd81494a96d48aed31019a60 Sep 14 08:49:49.932011 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-LiveMigrationNegativeTest-1584437141 Sep 14 08:49:49.932011 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member,admin Sep 14 08:49:49.932011 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member,admin Sep 14 08:49:49.933631 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c863a1b7bd81494a96d48aed31019a60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c863a1b7bd81494a96d48aed31019a60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c863a1b7bd81494a96d48aed31019a60"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c863a1b7bd81494a96d48aed31019a60"}]}] Sep 14 08:49:49.933631 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-LiveMigrationNegativeTest-1584437141 Sep 14 08:49:49.933631 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: c863a1b7bd81494a96d48aed31019a60 Sep 14 08:49:49.933631 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1584437141 Sep 14 08:49:49.933631 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-LiveMigrationNegativeTest-1584437141-project-admin Sep 14 08:49:49.933631 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 08:49:49.933631 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 08:49:49.933631 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: cd999666d082493fad3a75beb2e08a4d Sep 14 08:49:49.933631 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-LiveMigrationNegativeTest-1584437141-project-admin Sep 14 08:49:49.933631 n-d-836830-18 devstack@n-api.service[128759]: Sep 14 08:49:49.933631 n-d-836830-18 devstack@n-api.service[128759]: {"os-migrateLive": {"host": "n-h1-836830-18", "block_migration": true, "disk_over_commit": false}} Sep 14 08:49:49.933631 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 08:49:49.934526 n-d-836830-18 devstack@n-api.service[128759]: exception: Cannot 'os-migrateLive' instance b337eb96-57a1-408f-8890-3a0a84e1afa3 while it is in vm_state suspended Sep 14 08:49:49.934526 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': 'b337eb96-57a1-408f-8890-3a0a84e1afa3', 'body': {'os-migrateLive': {'host': 'n-h1-836830-18', 'block_migration': True, 'disk_over_commit': False}}} Sep 14 08:49:49.934526 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:49:49.934526 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:49:49.934526 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Sep 14 08:49:49.934526 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Sep 14 08:49:49.934526 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 14 08:49:49.934526 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 14 08:49:49.934526 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 14 08:49:49.934526 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 14 08:49:49.934526 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Sep 14 08:49:49.934526 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 14 08:49:49.934526 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 14 08:49:49.934526 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 14 08:49:49.934526 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Sep 14 08:49:49.934526 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 14 08:49:49.934526 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Sep 14 08:49:49.934526 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 14 08:49:49.935649 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 14 08:49:49.935649 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 14 08:49:49.935649 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 14 08:49:49.935649 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 14 08:49:49.935649 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b337eb96-57a1-408f-8890-3a0a84e1afa3 in vm_state suspended. Cannot live_migrate while the instance is in this state. Sep 14 08:49:49.935649 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:49:49.935649 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:49:49.935649 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:49:49.935649 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:49:49.935649 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:49:49.935649 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:49:49.935649 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:49:49.935649 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:49:49.935649 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:49:49.935649 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:49:49.935649 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 08:49:49.935649 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 08:49:49.935649 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 08:49:49.935649 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 08:49:49.935649 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 08:49:49.937062 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 08:49:49.937062 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 14 08:49:49.937062 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Sep 14 08:49:49.937062 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 14 08:49:49.937062 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 14 08:49:49.937062 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 14 08:49:49.937062 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance b337eb96-57a1-408f-8890-3a0a84e1afa3 while it is in vm_state suspended Sep 14 08:49:49.937062 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:49:49.937062 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:49:49.937062 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:49:49.937062 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:49:49.937062 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:49:49.937062 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:49:49.937062 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:49:49.937062 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:49:49.937062 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance b337eb96-57a1-408f-8890-3a0a84e1afa3 while it is in vm_state suspended Sep 14 08:49:49.937062 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:49:49.939287 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-87d4a9aa-7697-485e-80de-6a3c3e290d88 tempest-LiveMigrationNegativeTest-1584437141 tempest-LiveMigrationNegativeTest-1584437141-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance b337eb96-57a1-408f-8890-3a0a84e1afa3 while it is in vm_state suspended {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:49:49.940526 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-87d4a9aa-7697-485e-80de-6a3c3e290d88 tempest-LiveMigrationNegativeTest-1584437141 tempest-LiveMigrationNegativeTest-1584437141-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/b337eb96-57a1-408f-8890-3a0a84e1afa3/action" status: 409 len: 155 microversion: 2.1 time: 0.139113 Sep 14 08:49:49.944044 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 254/485] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 08:49:49 2022] POST /compute/v2.1/servers/b337eb96-57a1-408f-8890-3a0a84e1afa3/action => generated 155 bytes in 143 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 14 08:49:49.951861 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-07729133-0c79-4ae2-b351-790a623a8b7b tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:49:49.956819 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-07729133-0c79-4ae2-b351-790a623a8b7b tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] [instance: 3acd19ba-a5b9-4bac-a4a3-2c274448c374] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:49:49.972721 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-07729133-0c79-4ae2-b351-790a623a8b7b tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:49.973796 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-07729133-0c79-4ae2-b351-790a623a8b7b tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:49.980275 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-07729133-0c79-4ae2-b351-790a623a8b7b tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:49.981078 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-07729133-0c79-4ae2-b351-790a623a8b7b tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:49.981816 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-07729133-0c79-4ae2-b351-790a623a8b7b tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:49.982280 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-07729133-0c79-4ae2-b351-790a623a8b7b tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:50.437482 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-07729133-0c79-4ae2-b351-790a623a8b7b tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c7802984cf48d1852832b52abe52e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e326f95a9604fdb9bd075db3837cf62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:49:50.448877 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-07729133-0c79-4ae2-b351-790a623a8b7b tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] 10.222.0.60 "GET /compute/v2.1/servers/3acd19ba-a5b9-4bac-a4a3-2c274448c374" status: 200 len: 1319 microversion: 2.1 time: 0.503210 Sep 14 08:49:50.450821 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 255/486] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:49:49 2022] GET /compute/v2.1/servers/3acd19ba-a5b9-4bac-a4a3-2c274448c374 => generated 1319 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:49:50.468888 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-031d7f35-0971-4257-acd2-e1073511e3dd tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:49:50.480332 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-031d7f35-0971-4257-acd2-e1073511e3dd tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] [instance: b337eb96-57a1-408f-8890-3a0a84e1afa3] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:49:50.487698 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-031d7f35-0971-4257-acd2-e1073511e3dd tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:50.488514 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-031d7f35-0971-4257-acd2-e1073511e3dd tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:50.489241 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-031d7f35-0971-4257-acd2-e1073511e3dd tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:50.490403 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-031d7f35-0971-4257-acd2-e1073511e3dd tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:50.491155 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-031d7f35-0971-4257-acd2-e1073511e3dd tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:50.491813 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-031d7f35-0971-4257-acd2-e1073511e3dd tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:50.539512 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-031d7f35-0971-4257-acd2-e1073511e3dd tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] [instance: b337eb96-57a1-408f-8890-3a0a84e1afa3] Going to try to terminate instance {{(pid=128759) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 08:49:50.607089 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=100 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:49:50.795004 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-031d7f35-0971-4257-acd2-e1073511e3dd tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] 10.222.0.60 "DELETE /compute/v2.1/servers/b337eb96-57a1-408f-8890-3a0a84e1afa3" status: 204 len: 0 microversion: 2.1 time: 0.340450 Sep 14 08:49:50.796510 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 256/487] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 08:49:50 2022] DELETE /compute/v2.1/servers/b337eb96-57a1-408f-8890-3a0a84e1afa3 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 08:49:50.814250 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-959fb6fd-b6cb-4c11-9c62-09b20766b6de tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:49:50.815185 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-959fb6fd-b6cb-4c11-9c62-09b20766b6de tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: 0a331816-6b06-40c9-a557-eada274501b5] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:49:50.826879 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-959fb6fd-b6cb-4c11-9c62-09b20766b6de tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:50.840460 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-959fb6fd-b6cb-4c11-9c62-09b20766b6de tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:50.843220 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-959fb6fd-b6cb-4c11-9c62-09b20766b6de tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:50.845346 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-959fb6fd-b6cb-4c11-9c62-09b20766b6de tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:50.847091 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-959fb6fd-b6cb-4c11-9c62-09b20766b6de tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:50.847849 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-959fb6fd-b6cb-4c11-9c62-09b20766b6de tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:51.561598 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-959fb6fd-b6cb-4c11-9c62-09b20766b6de tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:49:51.577144 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-959fb6fd-b6cb-4c11-9c62-09b20766b6de tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/0a331816-6b06-40c9-a557-eada274501b5" status: 200 len: 1460 microversion: 2.1 time: 0.775696 Sep 14 08:49:51.580488 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 257/488] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:49:50 2022] GET /compute/v2.1/servers/0a331816-6b06-40c9-a557-eada274501b5 => generated 1460 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:49:51.606223 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-767587cf-e1bc-4038-a466-621ae6c4cf27 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:49:51.608214 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-767587cf-e1bc-4038-a466-621ae6c4cf27 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] [instance: b337eb96-57a1-408f-8890-3a0a84e1afa3] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:49:51.618398 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-767587cf-e1bc-4038-a466-621ae6c4cf27 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:51.619190 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-767587cf-e1bc-4038-a466-621ae6c4cf27 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:51.619785 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-767587cf-e1bc-4038-a466-621ae6c4cf27 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:51.620738 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-767587cf-e1bc-4038-a466-621ae6c4cf27 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:51.621351 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-767587cf-e1bc-4038-a466-621ae6c4cf27 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:51.621935 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-767587cf-e1bc-4038-a466-621ae6c4cf27 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:51.692066 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-38dae532-b860-48c0-a350-f317d0409a1a tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Flavor limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 08:49:51.693292 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-38dae532-b860-48c0-a350-f317d0409a1a tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Image limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 08:49:51.693938 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-38dae532-b860-48c0-a350-f317d0409a1a tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Flavor pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 08:49:51.695405 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-38dae532-b860-48c0-a350-f317d0409a1a tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Image pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 08:49:51.696114 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-38dae532-b860-48c0-a350-f317d0409a1a tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 08:49:51.720682 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-38dae532-b860-48c0-a350-f317d0409a1a tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:51.722495 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-38dae532-b860-48c0-a350-f317d0409a1a tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:51.723416 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-38dae532-b860-48c0-a350-f317d0409a1a tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:51.725363 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-38dae532-b860-48c0-a350-f317d0409a1a tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:51.726293 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-38dae532-b860-48c0-a350-f317d0409a1a tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:51.726905 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-38dae532-b860-48c0-a350-f317d0409a1a tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:51.761049 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-38dae532-b860-48c0-a350-f317d0409a1a tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Getting quotas for project ee17e19b2f094a899dfc8966152fd642. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 08:49:51.769120 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-38dae532-b860-48c0-a350-f317d0409a1a tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Getting quotas for user 24b938da87b14cd79c3c6dd85818cd02 and project ee17e19b2f094a899dfc8966152fd642. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 08:49:51.791238 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-38dae532-b860-48c0-a350-f317d0409a1a tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Going to run 1 instances... {{(pid=128758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 08:49:51.798002 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-38dae532-b860-48c0-a350-f317d0409a1a tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] [instance: 2d2c444a-e84e-40c5-aec1-375cd14f67c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 08:49:51.897210 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-38dae532-b860-48c0-a350-f317d0409a1a tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.811610 Sep 14 08:49:51.898125 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 232/489] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 08:49:49 2022] POST /compute/v2.1/servers => generated 401 bytes in 2813 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 08:49:51.907738 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-05197dea-4a34-40b5-b40c-9e64b1813eb4 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:49:51.908602 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-05197dea-4a34-40b5-b40c-9e64b1813eb4 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] [instance: c402c828-5101-40cc-8ac8-b3d1470028ed] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:49:51.935056 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-767587cf-e1bc-4038-a466-621ae6c4cf27 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2ee35c4791437c83193357b4085128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4300dd934369461b9b6ef556246bfc53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:49:51.939582 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-05197dea-4a34-40b5-b40c-9e64b1813eb4 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:51.940190 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-05197dea-4a34-40b5-b40c-9e64b1813eb4 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:51.941320 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-05197dea-4a34-40b5-b40c-9e64b1813eb4 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:51.944564 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-767587cf-e1bc-4038-a466-621ae6c4cf27 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] 10.222.0.60 "GET /compute/v2.1/servers/b337eb96-57a1-408f-8890-3a0a84e1afa3" status: 200 len: 1464 microversion: 2.1 time: 0.362697 Sep 14 08:49:51.947352 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-05197dea-4a34-40b5-b40c-9e64b1813eb4 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:51.949265 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-05197dea-4a34-40b5-b40c-9e64b1813eb4 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:51.950606 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-05197dea-4a34-40b5-b40c-9e64b1813eb4 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:51.962964 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 258/490] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:49:51 2022] GET /compute/v2.1/servers/b337eb96-57a1-408f-8890-3a0a84e1afa3 => generated 1464 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:49:51.977605 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-03e08213-ffa6-4ae3-bf64-af537a945338 req-1552c5b9-83fb-45f9-bd51-cbcf4bd64fe6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c402c828-5101-40cc-8ac8-b3d1470028ed", "name": "network-vif-plugged", "status": "completed", "tag": "16038378-4ff2-47f4-881a-cf785e164719"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:49:52.035370 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-03e08213-ffa6-4ae3-bf64-af537a945338 req-1552c5b9-83fb-45f9-bd51-cbcf4bd64fe6 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:52.035913 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-03e08213-ffa6-4ae3-bf64-af537a945338 req-1552c5b9-83fb-45f9-bd51-cbcf4bd64fe6 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:52.036353 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-03e08213-ffa6-4ae3-bf64-af537a945338 req-1552c5b9-83fb-45f9-bd51-cbcf4bd64fe6 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:52.062173 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-03e08213-ffa6-4ae3-bf64-af537a945338 req-1552c5b9-83fb-45f9-bd51-cbcf4bd64fe6 service nova] Creating event network-vif-plugged:16038378-4ff2-47f4-881a-cf785e164719 for instance c402c828-5101-40cc-8ac8-b3d1470028ed on n-h1-836830-18 Sep 14 08:49:52.081003 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-03e08213-ffa6-4ae3-bf64-af537a945338 req-1552c5b9-83fb-45f9-bd51-cbcf4bd64fe6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127192 Sep 14 08:49:52.083721 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 259/491] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:49:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:49:52.099350 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b530dfaa-6cab-4ed5-b024-9b056dfb3aa7 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:49:52.103310 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b530dfaa-6cab-4ed5-b024-9b056dfb3aa7 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] [instance: 3acd19ba-a5b9-4bac-a4a3-2c274448c374] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:49:52.130008 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b530dfaa-6cab-4ed5-b024-9b056dfb3aa7 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:52.130755 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b530dfaa-6cab-4ed5-b024-9b056dfb3aa7 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:52.132849 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b530dfaa-6cab-4ed5-b024-9b056dfb3aa7 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:52.133757 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b530dfaa-6cab-4ed5-b024-9b056dfb3aa7 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:52.134693 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b530dfaa-6cab-4ed5-b024-9b056dfb3aa7 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:52.135413 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b530dfaa-6cab-4ed5-b024-9b056dfb3aa7 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:52.639123 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b530dfaa-6cab-4ed5-b024-9b056dfb3aa7 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c7802984cf48d1852832b52abe52e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e326f95a9604fdb9bd075db3837cf62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:49:52.675343 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b530dfaa-6cab-4ed5-b024-9b056dfb3aa7 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] 10.222.0.60 "GET /compute/v2.1/servers/3acd19ba-a5b9-4bac-a4a3-2c274448c374" status: 200 len: 1319 microversion: 2.1 time: 0.578856 Sep 14 08:49:52.679099 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 260/492] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:49:52 2022] GET /compute/v2.1/servers/3acd19ba-a5b9-4bac-a4a3-2c274448c374 => generated 1319 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:49:52.748256 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-858ca781-a5aa-4279-a309-96bff17d5182 tempest-MigrationsAdminTest-1443382137 tempest-MigrationsAdminTest-1443382137-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:49:52.748892 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-858ca781-a5aa-4279-a309-96bff17d5182 tempest-MigrationsAdminTest-1443382137 tempest-MigrationsAdminTest-1443382137-project-admin] [instance: 0a331816-6b06-40c9-a557-eada274501b5] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:49:52.781519 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-858ca781-a5aa-4279-a309-96bff17d5182 tempest-MigrationsAdminTest-1443382137 tempest-MigrationsAdminTest-1443382137-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:52.782338 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-858ca781-a5aa-4279-a309-96bff17d5182 tempest-MigrationsAdminTest-1443382137 tempest-MigrationsAdminTest-1443382137-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:52.789675 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-858ca781-a5aa-4279-a309-96bff17d5182 tempest-MigrationsAdminTest-1443382137 tempest-MigrationsAdminTest-1443382137-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:52.790924 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-858ca781-a5aa-4279-a309-96bff17d5182 tempest-MigrationsAdminTest-1443382137 tempest-MigrationsAdminTest-1443382137-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:52.791673 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-858ca781-a5aa-4279-a309-96bff17d5182 tempest-MigrationsAdminTest-1443382137 tempest-MigrationsAdminTest-1443382137-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:52.793468 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-858ca781-a5aa-4279-a309-96bff17d5182 tempest-MigrationsAdminTest-1443382137 tempest-MigrationsAdminTest-1443382137-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:53.065437 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-05197dea-4a34-40b5-b40c-9e64b1813eb4 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2290f39b61044661aa9bec206794a5c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '919dd9619fb24ee281cf6d96cf3351df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:49:53.078117 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-05197dea-4a34-40b5-b40c-9e64b1813eb4 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] 10.222.0.60 "GET /compute/v2.1/servers/c402c828-5101-40cc-8ac8-b3d1470028ed" status: 200 len: 1332 microversion: 2.1 time: 1.178204 Sep 14 08:49:53.098966 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 233/493] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:49:51 2022] GET /compute/v2.1/servers/c402c828-5101-40cc-8ac8-b3d1470028ed => generated 1332 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:49:53.104758 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-87fbb61d-5362-48d6-8307-95e5837f3e64 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:49:53.104758 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-87fbb61d-5362-48d6-8307-95e5837f3e64 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] [instance: 2d2c444a-e84e-40c5-aec1-375cd14f67c8] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:49:53.134079 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-87fbb61d-5362-48d6-8307-95e5837f3e64 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:53.134582 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-87fbb61d-5362-48d6-8307-95e5837f3e64 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:53.138723 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-87fbb61d-5362-48d6-8307-95e5837f3e64 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:53.140200 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-87fbb61d-5362-48d6-8307-95e5837f3e64 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:53.145725 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-87fbb61d-5362-48d6-8307-95e5837f3e64 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:53.148605 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-87fbb61d-5362-48d6-8307-95e5837f3e64 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:53.206955 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:49:53.388713 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-87fbb61d-5362-48d6-8307-95e5837f3e64 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b938da87b14cd79c3c6dd85818cd02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee17e19b2f094a899dfc8966152fd642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:49:53.413022 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-87fbb61d-5362-48d6-8307-95e5837f3e64 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] 10.222.0.60 "GET /compute/v2.1/servers/2d2c444a-e84e-40c5-aec1-375cd14f67c8" status: 200 len: 1259 microversion: 2.1 time: 0.320731 Sep 14 08:49:53.416022 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 234/494] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:49:53 2022] GET /compute/v2.1/servers/2d2c444a-e84e-40c5-aec1-375cd14f67c8 => generated 1259 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:49:53.422587 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-f9e0332e-63f4-4984-95a9-85af327ab3a0 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:49:53.436024 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-f9e0332e-63f4-4984-95a9-85af327ab3a0 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] [instance: b337eb96-57a1-408f-8890-3a0a84e1afa3] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:49:53.443444 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f9e0332e-63f4-4984-95a9-85af327ab3a0 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:53.444169 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f9e0332e-63f4-4984-95a9-85af327ab3a0 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:53.451276 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f9e0332e-63f4-4984-95a9-85af327ab3a0 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:53.452311 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f9e0332e-63f4-4984-95a9-85af327ab3a0 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:53.452971 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f9e0332e-63f4-4984-95a9-85af327ab3a0 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:53.453589 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f9e0332e-63f4-4984-95a9-85af327ab3a0 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:53.658390 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-858ca781-a5aa-4279-a309-96bff17d5182 tempest-MigrationsAdminTest-1443382137 tempest-MigrationsAdminTest-1443382137-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/0a331816-6b06-40c9-a557-eada274501b5" status: 200 len: 1613 microversion: 2.1 time: 0.975702 Sep 14 08:49:53.659867 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 261/495] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:49:52 2022] GET /compute/v2.1/servers/0a331816-6b06-40c9-a557-eada274501b5 => generated 1613 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:49:53.695000 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3907ea32-16c0-4f50-a272-b0ed64d0d765 tempest-MigrationsAdminTest-1443382137 tempest-MigrationsAdminTest-1443382137-project-admin] Calling method '.version_select at 0x7f7d4481d160>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:49:53.699507 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3907ea32-16c0-4f50-a272-b0ed64d0d765 tempest-MigrationsAdminTest-1443382137 tempest-MigrationsAdminTest-1443382137-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:53.699993 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3907ea32-16c0-4f50-a272-b0ed64d0d765 tempest-MigrationsAdminTest-1443382137 tempest-MigrationsAdminTest-1443382137-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:53.702923 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3907ea32-16c0-4f50-a272-b0ed64d0d765 tempest-MigrationsAdminTest-1443382137 tempest-MigrationsAdminTest-1443382137-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:53.731535 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-3907ea32-16c0-4f50-a272-b0ed64d0d765 tempest-MigrationsAdminTest-1443382137 tempest-MigrationsAdminTest-1443382137-project-admin] 10.222.0.60 "GET /compute/v2.1/os-migrations" status: 200 len: 413 microversion: 2.1 time: 0.039381 Sep 14 08:49:53.735455 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 262/496] 10.222.0.60 () {58 vars in 1143 bytes} [Wed Sep 14 08:49:53 2022] GET /compute/v2.1/os-migrations => generated 413 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 08:49:53.741240 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-85bee1ad-9605-4ab4-a83f-41157412c6d7 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:49:53.754107 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-85bee1ad-9605-4ab4-a83f-41157412c6d7 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] [instance: 3acd19ba-a5b9-4bac-a4a3-2c274448c374] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:49:53.773280 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-85bee1ad-9605-4ab4-a83f-41157412c6d7 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:53.774006 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-85bee1ad-9605-4ab4-a83f-41157412c6d7 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:53.775130 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-85bee1ad-9605-4ab4-a83f-41157412c6d7 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:53.776030 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-85bee1ad-9605-4ab4-a83f-41157412c6d7 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:53.778404 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-85bee1ad-9605-4ab4-a83f-41157412c6d7 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:53.781674 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-85bee1ad-9605-4ab4-a83f-41157412c6d7 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:54.046163 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=22 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:49:54.800172 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-f9e0332e-63f4-4984-95a9-85af327ab3a0 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2ee35c4791437c83193357b4085128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4300dd934369461b9b6ef556246bfc53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:49:54.815797 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-f9e0332e-63f4-4984-95a9-85af327ab3a0 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] 10.222.0.60 "GET /compute/v2.1/servers/b337eb96-57a1-408f-8890-3a0a84e1afa3" status: 200 len: 1464 microversion: 2.1 time: 1.396816 Sep 14 08:49:54.833747 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 235/497] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:49:53 2022] GET /compute/v2.1/servers/b337eb96-57a1-408f-8890-3a0a84e1afa3 => generated 1464 bytes in 1416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:49:54.841161 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-e4b77bb9-5067-4191-8bf8-346451c03688 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-895047200", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:49:54.962246 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.network.neutron [None req-e4b77bb9-5067-4191-8bf8-346451c03688 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] validate_networks() for None {{(pid=128758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 08:49:55.436877 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-85bee1ad-9605-4ab4-a83f-41157412c6d7 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c7802984cf48d1852832b52abe52e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e326f95a9604fdb9bd075db3837cf62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:49:55.453966 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-85bee1ad-9605-4ab4-a83f-41157412c6d7 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] 10.222.0.60 "GET /compute/v2.1/servers/3acd19ba-a5b9-4bac-a4a3-2c274448c374" status: 200 len: 1319 microversion: 2.1 time: 1.717045 Sep 14 08:49:55.454572 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 263/498] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:49:53 2022] GET /compute/v2.1/servers/3acd19ba-a5b9-4bac-a4a3-2c274448c374 => generated 1319 bytes in 1718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:49:55.466219 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-d131b352-88c0-49bd-b2f2-db92256cf04b req-bf16f8d2-a264-4abd-ab78-396195c94e9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3acd19ba-a5b9-4bac-a4a3-2c274448c374", "tag": "5370b892-fe15-4759-b6f3-2c8b78b6eb86"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:49:55.490705 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-d131b352-88c0-49bd-b2f2-db92256cf04b req-bf16f8d2-a264-4abd-ab78-396195c94e9d service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:55.491233 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-d131b352-88c0-49bd-b2f2-db92256cf04b req-bf16f8d2-a264-4abd-ab78-396195c94e9d service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:55.491844 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-d131b352-88c0-49bd-b2f2-db92256cf04b req-bf16f8d2-a264-4abd-ab78-396195c94e9d service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:55.510416 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-d131b352-88c0-49bd-b2f2-db92256cf04b req-bf16f8d2-a264-4abd-ab78-396195c94e9d service nova] Creating event network-changed:5370b892-fe15-4759-b6f3-2c8b78b6eb86 for instance 3acd19ba-a5b9-4bac-a4a3-2c274448c374 on n-h2-836830-18 Sep 14 08:49:55.520621 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-d131b352-88c0-49bd-b2f2-db92256cf04b req-bf16f8d2-a264-4abd-ab78-396195c94e9d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060831 Sep 14 08:49:55.522041 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 264/499] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:49:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:49:55.527931 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a92f3e83-b90e-4ee7-9894-84e348e376a5 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:49:55.528898 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-a92f3e83-b90e-4ee7-9894-84e348e376a5 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] [instance: c402c828-5101-40cc-8ac8-b3d1470028ed] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:49:55.541075 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a92f3e83-b90e-4ee7-9894-84e348e376a5 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:55.541918 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a92f3e83-b90e-4ee7-9894-84e348e376a5 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:55.542707 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a92f3e83-b90e-4ee7-9894-84e348e376a5 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:55.544185 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a92f3e83-b90e-4ee7-9894-84e348e376a5 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:55.545759 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a92f3e83-b90e-4ee7-9894-84e348e376a5 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:55.546369 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a92f3e83-b90e-4ee7-9894-84e348e376a5 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:56.374972 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-e4b77bb9-5067-4191-8bf8-346451c03688 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Flavor limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 08:49:56.376890 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-e4b77bb9-5067-4191-8bf8-346451c03688 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Image limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 08:49:56.377560 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-e4b77bb9-5067-4191-8bf8-346451c03688 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Flavor pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 08:49:56.378692 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-e4b77bb9-5067-4191-8bf8-346451c03688 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Image pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 08:49:56.379403 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-e4b77bb9-5067-4191-8bf8-346451c03688 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 08:49:56.405551 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e4b77bb9-5067-4191-8bf8-346451c03688 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:56.406425 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e4b77bb9-5067-4191-8bf8-346451c03688 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:56.407179 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e4b77bb9-5067-4191-8bf8-346451c03688 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:56.408182 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e4b77bb9-5067-4191-8bf8-346451c03688 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:56.408845 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e4b77bb9-5067-4191-8bf8-346451c03688 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:56.409646 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e4b77bb9-5067-4191-8bf8-346451c03688 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:56.436227 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-e4b77bb9-5067-4191-8bf8-346451c03688 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Getting quotas for project 8fd62edd611c4390be2403972b99aa15. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 08:49:56.447395 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-e4b77bb9-5067-4191-8bf8-346451c03688 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Getting quotas for user 264fb30236d54248ad0ecf79a177849f and project 8fd62edd611c4390be2403972b99aa15. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 08:49:56.484880 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-a92f3e83-b90e-4ee7-9894-84e348e376a5 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2290f39b61044661aa9bec206794a5c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '919dd9619fb24ee281cf6d96cf3351df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:49:56.487223 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-e4b77bb9-5067-4191-8bf8-346451c03688 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Going to run 1 instances... {{(pid=128758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 08:49:56.493567 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-e4b77bb9-5067-4191-8bf8-346451c03688 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: e4c51c69-8c2e-4202-9c2f-3dfae93392e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 08:49:56.494519 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a92f3e83-b90e-4ee7-9894-84e348e376a5 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] 10.222.0.60 "GET /compute/v2.1/servers/c402c828-5101-40cc-8ac8-b3d1470028ed" status: 200 len: 1536 microversion: 2.1 time: 0.970855 Sep 14 08:49:56.504656 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 265/500] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:49:55 2022] GET /compute/v2.1/servers/c402c828-5101-40cc-8ac8-b3d1470028ed => generated 1536 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:49:56.509549 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b147d507-8b95-4885-b34e-2fa85043f695 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:49:56.510176 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b147d507-8b95-4885-b34e-2fa85043f695 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] [instance: 2d2c444a-e84e-40c5-aec1-375cd14f67c8] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:49:56.527497 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b147d507-8b95-4885-b34e-2fa85043f695 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:56.528004 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b147d507-8b95-4885-b34e-2fa85043f695 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:56.528450 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b147d507-8b95-4885-b34e-2fa85043f695 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:56.529164 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b147d507-8b95-4885-b34e-2fa85043f695 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:56.529615 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b147d507-8b95-4885-b34e-2fa85043f695 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:56.530040 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b147d507-8b95-4885-b34e-2fa85043f695 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:56.590006 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-e4b77bb9-5067-4191-8bf8-346451c03688 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.753157 Sep 14 08:49:56.591321 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 236/501] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 08:49:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1757 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 08:49:56.602159 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-5d9b3813-fe6c-4f03-8af0-32e63ab524af tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:49:56.605426 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-5d9b3813-fe6c-4f03-8af0-32e63ab524af tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] [instance: b337eb96-57a1-408f-8890-3a0a84e1afa3] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:49:56.615430 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5d9b3813-fe6c-4f03-8af0-32e63ab524af tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:56.616191 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5d9b3813-fe6c-4f03-8af0-32e63ab524af tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:56.616849 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5d9b3813-fe6c-4f03-8af0-32e63ab524af tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:56.617835 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5d9b3813-fe6c-4f03-8af0-32e63ab524af tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:56.618692 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5d9b3813-fe6c-4f03-8af0-32e63ab524af tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:56.620176 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5d9b3813-fe6c-4f03-8af0-32e63ab524af tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:56.677764 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b147d507-8b95-4885-b34e-2fa85043f695 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b938da87b14cd79c3c6dd85818cd02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee17e19b2f094a899dfc8966152fd642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:49:56.693301 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b147d507-8b95-4885-b34e-2fa85043f695 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] 10.222.0.60 "GET /compute/v2.1/servers/2d2c444a-e84e-40c5-aec1-375cd14f67c8" status: 200 len: 1321 microversion: 2.1 time: 0.181552 Sep 14 08:49:56.694553 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 266/502] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:49:56 2022] GET /compute/v2.1/servers/2d2c444a-e84e-40c5-aec1-375cd14f67c8 => generated 1321 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:49:56.706871 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-7152aa21-5379-4308-9cba-78b9778749f1 req-8f1cc2f2-9570-4547-a7c0-1f333388a6db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b337eb96-57a1-408f-8890-3a0a84e1afa3", "name": "network-vif-deleted", "tag": "3a8201ea-e8bb-4c3a-9174-e0e422931f12"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:49:56.709807 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5d9b3813-fe6c-4f03-8af0-32e63ab524af tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:56.710506 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5d9b3813-fe6c-4f03-8af0-32e63ab524af tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:56.712109 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5d9b3813-fe6c-4f03-8af0-32e63ab524af tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:56.712698 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.objects.instance [None req-5d9b3813-fe6c-4f03-8af0-32e63ab524af tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lazy-loading 'fault' on Instance uuid b337eb96-57a1-408f-8890-3a0a84e1afa3 {{(pid=128758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 08:49:56.723005 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-7152aa21-5379-4308-9cba-78b9778749f1 req-8f1cc2f2-9570-4547-a7c0-1f333388a6db service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:56.727645 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-7152aa21-5379-4308-9cba-78b9778749f1 req-8f1cc2f2-9570-4547-a7c0-1f333388a6db service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:56.730445 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-7152aa21-5379-4308-9cba-78b9778749f1 req-8f1cc2f2-9570-4547-a7c0-1f333388a6db service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:56.764000 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-7152aa21-5379-4308-9cba-78b9778749f1 req-8f1cc2f2-9570-4547-a7c0-1f333388a6db service nova] Creating event network-vif-deleted:3a8201ea-e8bb-4c3a-9174-e0e422931f12 for instance b337eb96-57a1-408f-8890-3a0a84e1afa3 on n-h2-836830-18 Sep 14 08:49:56.774924 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-7152aa21-5379-4308-9cba-78b9778749f1 req-8f1cc2f2-9570-4547-a7c0-1f333388a6db service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078751 Sep 14 08:49:56.775942 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 267/503] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:49:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:49:56.781202 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-33cdde3b-7aba-4e18-a850-056a63e7c964 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:49:56.781932 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-33cdde3b-7aba-4e18-a850-056a63e7c964 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] [instance: 3acd19ba-a5b9-4bac-a4a3-2c274448c374] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:49:56.799854 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-33cdde3b-7aba-4e18-a850-056a63e7c964 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:56.800353 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-33cdde3b-7aba-4e18-a850-056a63e7c964 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:56.800797 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-33cdde3b-7aba-4e18-a850-056a63e7c964 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:56.805747 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-33cdde3b-7aba-4e18-a850-056a63e7c964 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:56.806279 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-33cdde3b-7aba-4e18-a850-056a63e7c964 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:56.806732 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-33cdde3b-7aba-4e18-a850-056a63e7c964 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:56.861328 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-5d9b3813-fe6c-4f03-8af0-32e63ab524af tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2ee35c4791437c83193357b4085128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4300dd934369461b9b6ef556246bfc53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:49:56.877619 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-5d9b3813-fe6c-4f03-8af0-32e63ab524af tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] 10.222.0.60 "GET /compute/v2.1/servers/b337eb96-57a1-408f-8890-3a0a84e1afa3" status: 200 len: 1308 microversion: 2.1 time: 0.284078 Sep 14 08:49:56.880486 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 237/504] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:49:56 2022] GET /compute/v2.1/servers/b337eb96-57a1-408f-8890-3a0a84e1afa3 => generated 1308 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:49:56.890324 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-fffd5f64-fd7e-4cff-a3ab-ddbac915afd9 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Action: 'create', calling method: .version_select at 0x7f7d44b9d9d0>, body: {"pool": "36f27675-c765-4db9-982e-8f515d0f3697"} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:49:58.219692 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-33cdde3b-7aba-4e18-a850-056a63e7c964 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c7802984cf48d1852832b52abe52e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e326f95a9604fdb9bd075db3837cf62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:49:58.239867 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-33cdde3b-7aba-4e18-a850-056a63e7c964 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] 10.222.0.60 "GET /compute/v2.1/servers/3acd19ba-a5b9-4bac-a4a3-2c274448c374" status: 200 len: 1319 microversion: 2.1 time: 1.461617 Sep 14 08:49:58.242217 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 268/505] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:49:56 2022] GET /compute/v2.1/servers/3acd19ba-a5b9-4bac-a4a3-2c274448c374 => generated 1319 bytes in 1466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:49:58.253489 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-1780e6e4-dd2c-47f5-8ac4-9877c0dde7e2 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:49:58.257999 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-1780e6e4-dd2c-47f5-8ac4-9877c0dde7e2 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: e4c51c69-8c2e-4202-9c2f-3dfae93392e9] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:49:58.273217 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1780e6e4-dd2c-47f5-8ac4-9877c0dde7e2 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:58.273743 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1780e6e4-dd2c-47f5-8ac4-9877c0dde7e2 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:58.274190 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1780e6e4-dd2c-47f5-8ac4-9877c0dde7e2 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:58.288744 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1780e6e4-dd2c-47f5-8ac4-9877c0dde7e2 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:58.289331 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1780e6e4-dd2c-47f5-8ac4-9877c0dde7e2 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:58.289786 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1780e6e4-dd2c-47f5-8ac4-9877c0dde7e2 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:58.603654 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-1780e6e4-dd2c-47f5-8ac4-9877c0dde7e2 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:49:58.622086 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-1780e6e4-dd2c-47f5-8ac4-9877c0dde7e2 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/e4c51c69-8c2e-4202-9c2f-3dfae93392e9" status: 200 len: 1264 microversion: 2.1 time: 0.374626 Sep 14 08:49:58.635125 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 269/506] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:49:58 2022] GET /compute/v2.1/servers/e4c51c69-8c2e-4202-9c2f-3dfae93392e9 => generated 1264 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:49:58.645401 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-dad9ad4e-0364-4c87-92ae-0d1824705e07 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:49:58.648063 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-dad9ad4e-0364-4c87-92ae-0d1824705e07 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] [instance: 2d2c444a-e84e-40c5-aec1-375cd14f67c8] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:49:58.664561 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dad9ad4e-0364-4c87-92ae-0d1824705e07 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:58.666684 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dad9ad4e-0364-4c87-92ae-0d1824705e07 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:58.668383 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dad9ad4e-0364-4c87-92ae-0d1824705e07 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:58.670836 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dad9ad4e-0364-4c87-92ae-0d1824705e07 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:58.673292 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dad9ad4e-0364-4c87-92ae-0d1824705e07 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:58.674402 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dad9ad4e-0364-4c87-92ae-0d1824705e07 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:59.182439 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=6 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:49:59.224930 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-dad9ad4e-0364-4c87-92ae-0d1824705e07 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b938da87b14cd79c3c6dd85818cd02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee17e19b2f094a899dfc8966152fd642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:49:59.242081 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-dad9ad4e-0364-4c87-92ae-0d1824705e07 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] 10.222.0.60 "GET /compute/v2.1/servers/2d2c444a-e84e-40c5-aec1-375cd14f67c8" status: 200 len: 1321 microversion: 2.1 time: 0.604835 Sep 14 08:49:59.242981 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 270/507] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:49:58 2022] GET /compute/v2.1/servers/2d2c444a-e84e-40c5-aec1-375cd14f67c8 => generated 1321 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:49:59.250691 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8a9848f3-b013-41c4-92b5-64bd726b8d76 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:49:59.252679 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-8a9848f3-b013-41c4-92b5-64bd726b8d76 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] [instance: b337eb96-57a1-408f-8890-3a0a84e1afa3] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:49:59.260561 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8a9848f3-b013-41c4-92b5-64bd726b8d76 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:59.262384 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8a9848f3-b013-41c4-92b5-64bd726b8d76 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:59.267595 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8a9848f3-b013-41c4-92b5-64bd726b8d76 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:59.268649 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8a9848f3-b013-41c4-92b5-64bd726b8d76 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:59.269601 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8a9848f3-b013-41c4-92b5-64bd726b8d76 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:59.270201 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8a9848f3-b013-41c4-92b5-64bd726b8d76 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:59.296751 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-8a9848f3-b013-41c4-92b5-64bd726b8d76 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] HTTP exception thrown: Instance b337eb96-57a1-408f-8890-3a0a84e1afa3 could not be found. Sep 14 08:49:59.298888 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8a9848f3-b013-41c4-92b5-64bd726b8d76 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Request method failure captured: Sep 14 08:49:59.298888 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/b337eb96-57a1-408f-8890-3a0a84e1afa3 HTTP/1.1 Sep 14 08:49:59.298888 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 08:49:59.298888 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 08:49:59.298888 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 08:49:59.298888 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 08:49:59.298888 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 08:49:59.298888 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 08:49:59.298888 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 08:49:59.298888 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 08:49:59.298888 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZV0E_iBc3ym9ZlJ6yQYf_r63ax-HUElJZnZXy4-kgyu9WgQJUqnKArYbN8omlI4JEtO-2s75N1-MgrtAbcAFumQgVINf6RUiQThuBayOcEZkrLLrz_g0Bt4ZmSXle6DP8EOD1vT0jj5kUkiKvbbRRK9Nt51vhb05NO2o_DkexsXVcw Sep 14 08:49:59.298888 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 08:49:59.298888 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 08:49:59.298888 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 08:49:59.298888 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 08:49:59.298888 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 08:49:59.298888 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 08:49:59.298888 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 4300dd934369461b9b6ef556246bfc53 Sep 14 08:49:59.298888 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-LiveMigrationNegativeTest-1982227243 Sep 14 08:49:59.298888 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 08:49:59.298888 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 08:49:59.300377 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/4300dd934369461b9b6ef556246bfc53"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_4300dd934369461b9b6ef556246bfc53"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4300dd934369461b9b6ef556246bfc53"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4300dd934369461b9b6ef556246bfc53"}]}] Sep 14 08:49:59.300377 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-LiveMigrationNegativeTest-1982227243 Sep 14 08:49:59.300377 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 4300dd934369461b9b6ef556246bfc53 Sep 14 08:49:59.300377 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1982227243 Sep 14 08:49:59.300377 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-LiveMigrationNegativeTest-1982227243-project Sep 14 08:49:59.300377 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 08:49:59.300377 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 08:49:59.300377 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 9e2ee35c4791437c83193357b4085128 Sep 14 08:49:59.300377 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-LiveMigrationNegativeTest-1982227243-project Sep 14 08:49:59.300377 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 08:49:59.300377 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance b337eb96-57a1-408f-8890-3a0a84e1afa3 could not be found. Sep 14 08:49:59.300377 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': 'b337eb96-57a1-408f-8890-3a0a84e1afa3'} Sep 14 08:49:59.301115 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:49:59.301115 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:49:59.301115 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 08:49:59.301115 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 08:49:59.301115 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 08:49:59.301115 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 08:49:59.301115 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 08:49:59.301115 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 08:49:59.301115 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 08:49:59.301115 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 08:49:59.301115 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b337eb96-57a1-408f-8890-3a0a84e1afa3 could not be found. Sep 14 08:49:59.301115 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:49:59.301115 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:49:59.301115 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:49:59.301115 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:49:59.301115 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:49:59.301115 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:49:59.301115 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:49:59.301115 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:49:59.301115 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:49:59.302267 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:49:59.302267 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 08:49:59.302267 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 08:49:59.302267 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 08:49:59.302267 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 08:49:59.302267 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 08:49:59.302267 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 08:49:59.302267 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b337eb96-57a1-408f-8890-3a0a84e1afa3 could not be found. Sep 14 08:49:59.302267 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:49:59.302267 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:49:59.302267 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:49:59.302267 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:49:59.302267 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:49:59.302267 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:49:59.302267 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:49:59.302267 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:49:59.302267 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b337eb96-57a1-408f-8890-3a0a84e1afa3 could not be found. Sep 14 08:49:59.302267 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:49:59.313642 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8a9848f3-b013-41c4-92b5-64bd726b8d76 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Returning 404 to user: Instance b337eb96-57a1-408f-8890-3a0a84e1afa3 could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:49:59.314838 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-8a9848f3-b013-41c4-92b5-64bd726b8d76 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] 10.222.0.60 "GET /compute/v2.1/servers/b337eb96-57a1-408f-8890-3a0a84e1afa3" status: 404 len: 111 microversion: 2.1 time: 0.069835 Sep 14 08:49:59.319353 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 271/508] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:49:59 2022] GET /compute/v2.1/servers/b337eb96-57a1-408f-8890-3a0a84e1afa3 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 08:49:59.326396 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-21d92aad-57f3-4f4e-9d2e-1359598c4eae tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:49:59.327381 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-21d92aad-57f3-4f4e-9d2e-1359598c4eae tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] [instance: 3acd19ba-a5b9-4bac-a4a3-2c274448c374] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:49:59.358547 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-21d92aad-57f3-4f4e-9d2e-1359598c4eae tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:59.359778 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-21d92aad-57f3-4f4e-9d2e-1359598c4eae tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:59.361072 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-21d92aad-57f3-4f4e-9d2e-1359598c4eae tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:49:59.362103 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-21d92aad-57f3-4f4e-9d2e-1359598c4eae tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:49:59.363604 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-21d92aad-57f3-4f4e-9d2e-1359598c4eae tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:49:59.364241 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-21d92aad-57f3-4f4e-9d2e-1359598c4eae tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:00.372760 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-21d92aad-57f3-4f4e-9d2e-1359598c4eae tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c7802984cf48d1852832b52abe52e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e326f95a9604fdb9bd075db3837cf62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:50:00.390199 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-21d92aad-57f3-4f4e-9d2e-1359598c4eae tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] 10.222.0.60 "GET /compute/v2.1/servers/3acd19ba-a5b9-4bac-a4a3-2c274448c374" status: 200 len: 1319 microversion: 2.1 time: 1.069291 Sep 14 08:50:00.391743 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 272/509] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:49:59 2022] GET /compute/v2.1/servers/3acd19ba-a5b9-4bac-a4a3-2c274448c374 => generated 1319 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:50:00.397786 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c99a052e-6490-405b-b489-0639fa972cc5 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:50:00.398863 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-c99a052e-6490-405b-b489-0639fa972cc5 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] [instance: 22688a6e-8420-49de-b5b7-7368ed55d8da] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:50:00.408247 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c99a052e-6490-405b-b489-0639fa972cc5 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:00.409450 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c99a052e-6490-405b-b489-0639fa972cc5 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:00.410627 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c99a052e-6490-405b-b489-0639fa972cc5 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:00.412310 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c99a052e-6490-405b-b489-0639fa972cc5 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:00.413189 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c99a052e-6490-405b-b489-0639fa972cc5 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:00.413850 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c99a052e-6490-405b-b489-0639fa972cc5 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:00.460597 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-c99a052e-6490-405b-b489-0639fa972cc5 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] [instance: 22688a6e-8420-49de-b5b7-7368ed55d8da] Going to try to terminate instance {{(pid=128759) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 08:50:00.633704 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:50:00.698896 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-c99a052e-6490-405b-b489-0639fa972cc5 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] 10.222.0.60 "DELETE /compute/v2.1/servers/22688a6e-8420-49de-b5b7-7368ed55d8da" status: 204 len: 0 microversion: 2.1 time: 0.305109 Sep 14 08:50:00.701880 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 273/510] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 08:50:00 2022] DELETE /compute/v2.1/servers/22688a6e-8420-49de-b5b7-7368ed55d8da => generated 0 bytes in 309 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 08:50:00.716065 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-339e1265-4ebc-4e41-b5f0-21dee499e5f5 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:50:00.716862 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-339e1265-4ebc-4e41-b5f0-21dee499e5f5 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: e4c51c69-8c2e-4202-9c2f-3dfae93392e9] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:50:00.744573 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-339e1265-4ebc-4e41-b5f0-21dee499e5f5 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:00.746332 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-339e1265-4ebc-4e41-b5f0-21dee499e5f5 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:00.749391 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-339e1265-4ebc-4e41-b5f0-21dee499e5f5 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:00.751588 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-339e1265-4ebc-4e41-b5f0-21dee499e5f5 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:00.752259 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-339e1265-4ebc-4e41-b5f0-21dee499e5f5 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:00.754308 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-339e1265-4ebc-4e41-b5f0-21dee499e5f5 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:01.162493 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-339e1265-4ebc-4e41-b5f0-21dee499e5f5 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:50:01.170710 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-339e1265-4ebc-4e41-b5f0-21dee499e5f5 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/e4c51c69-8c2e-4202-9c2f-3dfae93392e9" status: 200 len: 1270 microversion: 2.1 time: 0.466245 Sep 14 08:50:01.171324 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 274/511] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:50:00 2022] GET /compute/v2.1/servers/e4c51c69-8c2e-4202-9c2f-3dfae93392e9 => generated 1270 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:50:01.185601 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-f97489f2-2a9e-4a73-bc10-84e8a726ffc8 req-9d70e4ef-7319-450f-ab07-10b12bf44521 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9507f778-dd44-4db1-b36e-fecd603b2487", "tag": "7de514e0-ca4d-44bd-881b-61b7fec81020"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:50:01.207204 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-f97489f2-2a9e-4a73-bc10-84e8a726ffc8 req-9d70e4ef-7319-450f-ab07-10b12bf44521 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:01.207921 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-f97489f2-2a9e-4a73-bc10-84e8a726ffc8 req-9d70e4ef-7319-450f-ab07-10b12bf44521 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:01.208537 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-f97489f2-2a9e-4a73-bc10-84e8a726ffc8 req-9d70e4ef-7319-450f-ab07-10b12bf44521 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:01.231173 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-f97489f2-2a9e-4a73-bc10-84e8a726ffc8 req-9d70e4ef-7319-450f-ab07-10b12bf44521 service nova] Creating event network-changed:7de514e0-ca4d-44bd-881b-61b7fec81020 for instance 9507f778-dd44-4db1-b36e-fecd603b2487 on n-h2-836830-18 Sep 14 08:50:01.250078 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-f97489f2-2a9e-4a73-bc10-84e8a726ffc8 req-9d70e4ef-7319-450f-ab07-10b12bf44521 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066833 Sep 14 08:50:01.250078 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 275/512] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:50:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:50:01.255093 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-2b896ad5-920b-45e5-844e-7da4252ee5d8 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:50:01.255813 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-2b896ad5-920b-45e5-844e-7da4252ee5d8 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] [instance: 2d2c444a-e84e-40c5-aec1-375cd14f67c8] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:50:01.271031 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2b896ad5-920b-45e5-844e-7da4252ee5d8 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:01.271525 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2b896ad5-920b-45e5-844e-7da4252ee5d8 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:01.271990 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2b896ad5-920b-45e5-844e-7da4252ee5d8 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:01.285172 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2b896ad5-920b-45e5-844e-7da4252ee5d8 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:01.285954 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2b896ad5-920b-45e5-844e-7da4252ee5d8 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:01.286415 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2b896ad5-920b-45e5-844e-7da4252ee5d8 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:02.012450 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-2b896ad5-920b-45e5-844e-7da4252ee5d8 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b938da87b14cd79c3c6dd85818cd02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee17e19b2f094a899dfc8966152fd642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:50:02.021020 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-2b896ad5-920b-45e5-844e-7da4252ee5d8 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] 10.222.0.60 "GET /compute/v2.1/servers/2d2c444a-e84e-40c5-aec1-375cd14f67c8" status: 200 len: 1321 microversion: 2.1 time: 0.769954 Sep 14 08:50:02.038716 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 276/513] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:50:01 2022] GET /compute/v2.1/servers/2d2c444a-e84e-40c5-aec1-375cd14f67c8 => generated 1321 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:50:02.038716 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-123b51d7-5fad-420a-9d7e-41e605cd445b tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:50:02.038716 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-123b51d7-5fad-420a-9d7e-41e605cd445b tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] [instance: 22688a6e-8420-49de-b5b7-7368ed55d8da] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:50:02.047839 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-123b51d7-5fad-420a-9d7e-41e605cd445b tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:02.048499 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-123b51d7-5fad-420a-9d7e-41e605cd445b tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:02.049061 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-123b51d7-5fad-420a-9d7e-41e605cd445b tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:02.050361 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-123b51d7-5fad-420a-9d7e-41e605cd445b tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:02.051143 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-123b51d7-5fad-420a-9d7e-41e605cd445b tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:02.051742 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-123b51d7-5fad-420a-9d7e-41e605cd445b tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:02.848207 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-123b51d7-5fad-420a-9d7e-41e605cd445b tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2ee35c4791437c83193357b4085128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4300dd934369461b9b6ef556246bfc53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:50:02.879018 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-123b51d7-5fad-420a-9d7e-41e605cd445b tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] 10.222.0.60 "GET /compute/v2.1/servers/22688a6e-8420-49de-b5b7-7368ed55d8da" status: 200 len: 1474 microversion: 2.1 time: 0.850887 Sep 14 08:50:02.882608 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 277/514] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:50:02 2022] GET /compute/v2.1/servers/22688a6e-8420-49de-b5b7-7368ed55d8da => generated 1474 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:50:02.894039 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-adf037a2-a6cb-48e9-84f7-9d40a512fac6 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:50:02.895876 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-adf037a2-a6cb-48e9-84f7-9d40a512fac6 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] [instance: 3acd19ba-a5b9-4bac-a4a3-2c274448c374] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:50:02.904695 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-adf037a2-a6cb-48e9-84f7-9d40a512fac6 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:02.905604 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-adf037a2-a6cb-48e9-84f7-9d40a512fac6 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:02.955535 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-adf037a2-a6cb-48e9-84f7-9d40a512fac6 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:02.961073 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-adf037a2-a6cb-48e9-84f7-9d40a512fac6 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:02.967113 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-adf037a2-a6cb-48e9-84f7-9d40a512fac6 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:02.967638 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-adf037a2-a6cb-48e9-84f7-9d40a512fac6 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:03.790378 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-adf037a2-a6cb-48e9-84f7-9d40a512fac6 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c7802984cf48d1852832b52abe52e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e326f95a9604fdb9bd075db3837cf62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:50:03.802048 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-adf037a2-a6cb-48e9-84f7-9d40a512fac6 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] 10.222.0.60 "GET /compute/v2.1/servers/3acd19ba-a5b9-4bac-a4a3-2c274448c374" status: 200 len: 1319 microversion: 2.1 time: 0.917792 Sep 14 08:50:03.803710 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 278/515] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:50:02 2022] GET /compute/v2.1/servers/3acd19ba-a5b9-4bac-a4a3-2c274448c374 => generated 1319 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:50:03.813831 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-0c3de383-178a-4b56-9ded-d6d2628a95a7 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:50:03.814640 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-0c3de383-178a-4b56-9ded-d6d2628a95a7 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: e4c51c69-8c2e-4202-9c2f-3dfae93392e9] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:50:03.834816 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0c3de383-178a-4b56-9ded-d6d2628a95a7 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:03.835368 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0c3de383-178a-4b56-9ded-d6d2628a95a7 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:03.835818 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0c3de383-178a-4b56-9ded-d6d2628a95a7 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:03.836524 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0c3de383-178a-4b56-9ded-d6d2628a95a7 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:03.836980 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0c3de383-178a-4b56-9ded-d6d2628a95a7 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:03.837404 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0c3de383-178a-4b56-9ded-d6d2628a95a7 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:04.433286 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-0c3de383-178a-4b56-9ded-d6d2628a95a7 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:50:04.444903 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-0c3de383-178a-4b56-9ded-d6d2628a95a7 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/e4c51c69-8c2e-4202-9c2f-3dfae93392e9" status: 200 len: 1312 microversion: 2.1 time: 0.637911 Sep 14 08:50:04.445832 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 279/516] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:50:03 2022] GET /compute/v2.1/servers/e4c51c69-8c2e-4202-9c2f-3dfae93392e9 => generated 1312 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:50:04.716511 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9fecfe19-d7a0-4c8f-86d5-623d2a6307f2 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-875091879", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "networks": [{"uuid": "371ca8d4-dbd6-426c-b295-7fe3200f1240"}]}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:50:04.783798 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.network.neutron [None req-9fecfe19-d7a0-4c8f-86d5-623d2a6307f2 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] validate_networks() for [('371ca8d4-dbd6-426c-b295-7fe3200f1240', None, None, None, None, None)] {{(pid=128759) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 08:50:06.216186 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-fffd5f64-fd7e-4cff-a3ab-ddbac915afd9 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] 10.222.0.60 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 9.334181 Sep 14 08:50:06.217278 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 238/517] 10.222.0.60 () {60 vars in 1170 bytes} [Wed Sep 14 08:49:56 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 9336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:50:06.222331 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-2537bff9-2715-40c5-b26e-7fdc3fb7ee99 req-eab321b8-8b47-43c7-9ccb-325fdad7feab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22688a6e-8420-49de-b5b7-7368ed55d8da", "name": "network-vif-deleted", "tag": "edf7e1c4-afe2-4693-9deb-bf04156d3edc"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:50:06.234830 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:50:06.248633 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-2537bff9-2715-40c5-b26e-7fdc3fb7ee99 req-eab321b8-8b47-43c7-9ccb-325fdad7feab service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:06.249115 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-2537bff9-2715-40c5-b26e-7fdc3fb7ee99 req-eab321b8-8b47-43c7-9ccb-325fdad7feab service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:06.249540 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-2537bff9-2715-40c5-b26e-7fdc3fb7ee99 req-eab321b8-8b47-43c7-9ccb-325fdad7feab service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:06.262754 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-2537bff9-2715-40c5-b26e-7fdc3fb7ee99 req-eab321b8-8b47-43c7-9ccb-325fdad7feab service nova] Creating event network-vif-deleted:edf7e1c4-afe2-4693-9deb-bf04156d3edc for instance 22688a6e-8420-49de-b5b7-7368ed55d8da on n-h2-836830-18 Sep 14 08:50:06.273263 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-2537bff9-2715-40c5-b26e-7fdc3fb7ee99 req-eab321b8-8b47-43c7-9ccb-325fdad7feab service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054443 Sep 14 08:50:06.274931 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 239/518] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:50:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:50:06.284122 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-4457c3f7-a34d-45af-be97-a056d64ceb78 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:50:06.285073 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-4457c3f7-a34d-45af-be97-a056d64ceb78 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] [instance: 2d2c444a-e84e-40c5-aec1-375cd14f67c8] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:50:06.291894 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4457c3f7-a34d-45af-be97-a056d64ceb78 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:06.292377 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4457c3f7-a34d-45af-be97-a056d64ceb78 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:06.292866 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4457c3f7-a34d-45af-be97-a056d64ceb78 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:06.293564 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4457c3f7-a34d-45af-be97-a056d64ceb78 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:06.294175 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4457c3f7-a34d-45af-be97-a056d64ceb78 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:06.294704 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4457c3f7-a34d-45af-be97-a056d64ceb78 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:06.422445 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=4 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:50:06.468412 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=24 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:50:06.810662 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-4457c3f7-a34d-45af-be97-a056d64ceb78 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b938da87b14cd79c3c6dd85818cd02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee17e19b2f094a899dfc8966152fd642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:50:06.831792 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-9fecfe19-d7a0-4c8f-86d5-623d2a6307f2 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Flavor limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 08:50:06.832310 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-9fecfe19-d7a0-4c8f-86d5-623d2a6307f2 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Image limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 08:50:06.833197 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-9fecfe19-d7a0-4c8f-86d5-623d2a6307f2 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Flavor pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 08:50:06.833498 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-9fecfe19-d7a0-4c8f-86d5-623d2a6307f2 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Image pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 08:50:06.833913 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-9fecfe19-d7a0-4c8f-86d5-623d2a6307f2 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 08:50:06.840092 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-4457c3f7-a34d-45af-be97-a056d64ceb78 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] 10.222.0.60 "GET /compute/v2.1/servers/2d2c444a-e84e-40c5-aec1-375cd14f67c8" status: 200 len: 1388 microversion: 2.1 time: 0.559683 Sep 14 08:50:06.841823 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 240/519] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:50:06 2022] GET /compute/v2.1/servers/2d2c444a-e84e-40c5-aec1-375cd14f67c8 => generated 1388 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:50:06.862581 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-5609e309-a9d7-4909-a790-2ccf2f6a19c6 req-1cc2b2c4-73c4-445b-8220-0a62187e809d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3acd19ba-a5b9-4bac-a4a3-2c274448c374", "name": "network-vif-plugged", "status": "completed", "tag": "5370b892-fe15-4759-b6f3-2c8b78b6eb86"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:50:06.866519 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9fecfe19-d7a0-4c8f-86d5-623d2a6307f2 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:06.868748 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9fecfe19-d7a0-4c8f-86d5-623d2a6307f2 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:06.872594 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9fecfe19-d7a0-4c8f-86d5-623d2a6307f2 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:06.874317 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9fecfe19-d7a0-4c8f-86d5-623d2a6307f2 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:06.884861 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9fecfe19-d7a0-4c8f-86d5-623d2a6307f2 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:06.886667 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9fecfe19-d7a0-4c8f-86d5-623d2a6307f2 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:06.906688 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-5609e309-a9d7-4909-a790-2ccf2f6a19c6 req-1cc2b2c4-73c4-445b-8220-0a62187e809d service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:06.907485 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-5609e309-a9d7-4909-a790-2ccf2f6a19c6 req-1cc2b2c4-73c4-445b-8220-0a62187e809d service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:06.908092 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-5609e309-a9d7-4909-a790-2ccf2f6a19c6 req-1cc2b2c4-73c4-445b-8220-0a62187e809d service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:06.936230 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-9fecfe19-d7a0-4c8f-86d5-623d2a6307f2 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Getting quotas for project 3850954316f34104b2a8052dc78a50d7. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 08:50:06.938744 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:50:06.942800 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-9fecfe19-d7a0-4c8f-86d5-623d2a6307f2 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Getting quotas for user f140347422af48a4875e80337a272e29 and project 3850954316f34104b2a8052dc78a50d7. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 08:50:06.957645 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-5609e309-a9d7-4909-a790-2ccf2f6a19c6 req-1cc2b2c4-73c4-445b-8220-0a62187e809d service nova] Creating event network-vif-plugged:5370b892-fe15-4759-b6f3-2c8b78b6eb86 for instance 3acd19ba-a5b9-4bac-a4a3-2c274448c374 on n-h2-836830-18 Sep 14 08:50:06.973034 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-5609e309-a9d7-4909-a790-2ccf2f6a19c6 req-1cc2b2c4-73c4-445b-8220-0a62187e809d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128865 Sep 14 08:50:06.978422 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 241/520] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:50:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:50:06.988100 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-9fecfe19-d7a0-4c8f-86d5-623d2a6307f2 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Going to run 1 instances... {{(pid=128759) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 08:50:06.990454 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-9fecfe19-d7a0-4c8f-86d5-623d2a6307f2 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: 5059f5d9-6903-4cf4-a999-01d2d2ba0842] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128759) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 08:50:06.996859 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-55c508f0-f6f4-42a3-acb0-a0e7d6104fd9 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:50:06.998488 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-55c508f0-f6f4-42a3-acb0-a0e7d6104fd9 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] [instance: 22688a6e-8420-49de-b5b7-7368ed55d8da] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:50:07.023091 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-55c508f0-f6f4-42a3-acb0-a0e7d6104fd9 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:07.026465 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-55c508f0-f6f4-42a3-acb0-a0e7d6104fd9 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:07.027126 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-55c508f0-f6f4-42a3-acb0-a0e7d6104fd9 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:07.029879 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-55c508f0-f6f4-42a3-acb0-a0e7d6104fd9 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:07.031391 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-55c508f0-f6f4-42a3-acb0-a0e7d6104fd9 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:07.033910 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-55c508f0-f6f4-42a3-acb0-a0e7d6104fd9 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:07.064619 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-55c508f0-f6f4-42a3-acb0-a0e7d6104fd9 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] HTTP exception thrown: Instance 22688a6e-8420-49de-b5b7-7368ed55d8da could not be found. Sep 14 08:50:07.071487 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-55c508f0-f6f4-42a3-acb0-a0e7d6104fd9 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Request method failure captured: Sep 14 08:50:07.071487 n-d-836830-18 devstack@n-api.service[128758]: request: GET /compute/v2.1/servers/22688a6e-8420-49de-b5b7-7368ed55d8da HTTP/1.1 Sep 14 08:50:07.071487 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 08:50:07.071487 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 08:50:07.071487 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 08:50:07.071487 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 08:50:07.071487 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 08:50:07.071487 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 08:50:07.071487 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 08:50:07.071487 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 08:50:07.071487 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZV0E_iBc3ym9ZlJ6yQYf_r63ax-HUElJZnZXy4-kgyu9WgQJUqnKArYbN8omlI4JEtO-2s75N1-MgrtAbcAFumQgVINf6RUiQThuBayOcEZkrLLrz_g0Bt4ZmSXle6DP8EOD1vT0jj5kUkiKvbbRRK9Nt51vhb05NO2o_DkexsXVcw Sep 14 08:50:07.071487 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 08:50:07.071487 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 08:50:07.071487 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 08:50:07.071487 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 08:50:07.071487 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 08:50:07.071487 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 08:50:07.071487 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 4300dd934369461b9b6ef556246bfc53 Sep 14 08:50:07.071487 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-LiveMigrationNegativeTest-1982227243 Sep 14 08:50:07.071487 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 08:50:07.071487 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 08:50:07.072917 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/4300dd934369461b9b6ef556246bfc53"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_4300dd934369461b9b6ef556246bfc53"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4300dd934369461b9b6ef556246bfc53"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4300dd934369461b9b6ef556246bfc53"}]}] Sep 14 08:50:07.072917 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-LiveMigrationNegativeTest-1982227243 Sep 14 08:50:07.072917 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 4300dd934369461b9b6ef556246bfc53 Sep 14 08:50:07.072917 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1982227243 Sep 14 08:50:07.072917 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-LiveMigrationNegativeTest-1982227243-project Sep 14 08:50:07.072917 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 08:50:07.072917 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 08:50:07.072917 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 9e2ee35c4791437c83193357b4085128 Sep 14 08:50:07.072917 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-LiveMigrationNegativeTest-1982227243-project Sep 14 08:50:07.072917 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 08:50:07.072917 n-d-836830-18 devstack@n-api.service[128758]: exception: Instance 22688a6e-8420-49de-b5b7-7368ed55d8da could not be found. Sep 14 08:50:07.072917 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': '22688a6e-8420-49de-b5b7-7368ed55d8da'} Sep 14 08:50:07.074884 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:50:07.074884 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:50:07.074884 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 08:50:07.074884 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 08:50:07.074884 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 08:50:07.074884 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 08:50:07.074884 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 08:50:07.074884 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 08:50:07.074884 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 08:50:07.074884 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 08:50:07.074884 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22688a6e-8420-49de-b5b7-7368ed55d8da could not be found. Sep 14 08:50:07.074884 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:50:07.074884 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:50:07.074884 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:50:07.074884 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:50:07.074884 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:50:07.074884 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:50:07.074884 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:50:07.074884 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:50:07.074884 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:50:07.076279 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:50:07.076279 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 08:50:07.076279 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 08:50:07.076279 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 08:50:07.076279 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 08:50:07.076279 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 08:50:07.076279 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 08:50:07.076279 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22688a6e-8420-49de-b5b7-7368ed55d8da could not be found. Sep 14 08:50:07.076279 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:50:07.076279 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:50:07.076279 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:50:07.076279 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:50:07.076279 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:50:07.076279 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:50:07.076279 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:50:07.076279 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:50:07.076279 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22688a6e-8420-49de-b5b7-7368ed55d8da could not be found. Sep 14 08:50:07.076279 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:50:07.079283 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-55c508f0-f6f4-42a3-acb0-a0e7d6104fd9 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] Returning 404 to user: Instance 22688a6e-8420-49de-b5b7-7368ed55d8da could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:50:07.079283 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-55c508f0-f6f4-42a3-acb0-a0e7d6104fd9 tempest-LiveMigrationNegativeTest-1982227243 tempest-LiveMigrationNegativeTest-1982227243-project] 10.222.0.60 "GET /compute/v2.1/servers/22688a6e-8420-49de-b5b7-7368ed55d8da" status: 404 len: 111 microversion: 2.1 time: 0.091879 Sep 14 08:50:07.079283 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 242/521] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:50:06 2022] GET /compute/v2.1/servers/22688a6e-8420-49de-b5b7-7368ed55d8da => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 08:50:07.098082 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c630c7ff-ed7e-4297-b112-521c7a8312cb tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:50:07.098718 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-c630c7ff-ed7e-4297-b112-521c7a8312cb tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] [instance: 3acd19ba-a5b9-4bac-a4a3-2c274448c374] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:50:07.110773 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-9fecfe19-d7a0-4c8f-86d5-623d2a6307f2 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.663602 Sep 14 08:50:07.111821 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 280/522] 10.222.0.60 () {62 vars in 1188 bytes} [Wed Sep 14 08:50:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 2665 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 14 08:50:07.116672 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-6b81858e-2bc9-42e4-afb6-a92c46da81d4 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:50:07.117296 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-6b81858e-2bc9-42e4-afb6-a92c46da81d4 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: e4c51c69-8c2e-4202-9c2f-3dfae93392e9] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:50:07.132190 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6b81858e-2bc9-42e4-afb6-a92c46da81d4 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:07.132716 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6b81858e-2bc9-42e4-afb6-a92c46da81d4 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:07.135098 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6b81858e-2bc9-42e4-afb6-a92c46da81d4 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:07.136254 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6b81858e-2bc9-42e4-afb6-a92c46da81d4 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:07.136742 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6b81858e-2bc9-42e4-afb6-a92c46da81d4 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:07.137185 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6b81858e-2bc9-42e4-afb6-a92c46da81d4 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:07.144369 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c630c7ff-ed7e-4297-b112-521c7a8312cb tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:07.144878 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c630c7ff-ed7e-4297-b112-521c7a8312cb tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:07.150462 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c630c7ff-ed7e-4297-b112-521c7a8312cb tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:07.154627 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c630c7ff-ed7e-4297-b112-521c7a8312cb tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:07.156199 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c630c7ff-ed7e-4297-b112-521c7a8312cb tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:07.161553 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c630c7ff-ed7e-4297-b112-521c7a8312cb tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:07.683404 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-c630c7ff-ed7e-4297-b112-521c7a8312cb tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c7802984cf48d1852832b52abe52e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e326f95a9604fdb9bd075db3837cf62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:50:07.693629 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-c630c7ff-ed7e-4297-b112-521c7a8312cb tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] 10.222.0.60 "GET /compute/v2.1/servers/3acd19ba-a5b9-4bac-a4a3-2c274448c374" status: 200 len: 1319 microversion: 2.1 time: 0.618465 Sep 14 08:50:07.694217 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 243/523] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:50:07 2022] GET /compute/v2.1/servers/3acd19ba-a5b9-4bac-a4a3-2c274448c374 => generated 1319 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:50:07.704105 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-190576fc-8de9-44f3-8716-5d7d75281cbf tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Action: 'action', calling method: .version_select at 0x7f7d460c33a0>, body: {"addFloatingIp": {"address": "172.25.9.85"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:50:07.716407 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-190576fc-8de9-44f3-8716-5d7d75281cbf tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] [instance: c402c828-5101-40cc-8ac8-b3d1470028ed] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:50:07.734845 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-190576fc-8de9-44f3-8716-5d7d75281cbf tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:07.735637 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-190576fc-8de9-44f3-8716-5d7d75281cbf tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:07.736256 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-190576fc-8de9-44f3-8716-5d7d75281cbf tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:07.737213 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-190576fc-8de9-44f3-8716-5d7d75281cbf tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:07.737883 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-190576fc-8de9-44f3-8716-5d7d75281cbf tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:07.738277 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-190576fc-8de9-44f3-8716-5d7d75281cbf tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:07.910615 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-190576fc-8de9-44f3-8716-5d7d75281cbf tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Acquiring lock "refresh_cache-c402c828-5101-40cc-8ac8-b3d1470028ed" {{(pid=128758) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 14 08:50:07.911257 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-190576fc-8de9-44f3-8716-5d7d75281cbf tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Acquired lock "refresh_cache-c402c828-5101-40cc-8ac8-b3d1470028ed" {{(pid=128758) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 14 08:50:08.865886 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-6b81858e-2bc9-42e4-afb6-a92c46da81d4 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:50:08.895777 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-6b81858e-2bc9-42e4-afb6-a92c46da81d4 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/e4c51c69-8c2e-4202-9c2f-3dfae93392e9" status: 200 len: 1312 microversion: 2.1 time: 1.780174 Sep 14 08:50:08.896597 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 281/524] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:50:07 2022] GET /compute/v2.1/servers/e4c51c69-8c2e-4202-9c2f-3dfae93392e9 => generated 1312 bytes in 1784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:50:08.910837 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-2b036861-7274-4b65-812b-66bb5cceeb81 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:50:08.911475 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-2b036861-7274-4b65-812b-66bb5cceeb81 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: 5059f5d9-6903-4cf4-a999-01d2d2ba0842] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:50:08.954656 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2b036861-7274-4b65-812b-66bb5cceeb81 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:08.955198 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2b036861-7274-4b65-812b-66bb5cceeb81 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:08.955641 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2b036861-7274-4b65-812b-66bb5cceeb81 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:08.969703 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2b036861-7274-4b65-812b-66bb5cceeb81 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:08.970204 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2b036861-7274-4b65-812b-66bb5cceeb81 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:08.970646 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2b036861-7274-4b65-812b-66bb5cceeb81 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:09.332455 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-2b036861-7274-4b65-812b-66bb5cceeb81 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:50:09.349924 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-2b036861-7274-4b65-812b-66bb5cceeb81 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:50:09.351805 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-2b036861-7274-4b65-812b-66bb5cceeb81 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:50:09.354116 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-2b036861-7274-4b65-812b-66bb5cceeb81 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/5059f5d9-6903-4cf4-a999-01d2d2ba0842" status: 200 len: 1313 microversion: 2.25 time: 0.456664 Sep 14 08:50:09.355669 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 282/525] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:50:08 2022] GET /compute/v2.1/servers/5059f5d9-6903-4cf4-a999-01d2d2ba0842 => generated 1313 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:50:09.379764 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-465184ae-6fb7-4863-aa53-8b0aa53b71c2 req-b7cc159e-dc44-44a2-b18d-ac460fb708ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d2c444a-e84e-40c5-aec1-375cd14f67c8", "tag": "19ff01df-4500-4f30-970d-7bee0d4b0a4f"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:50:09.393006 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-465184ae-6fb7-4863-aa53-8b0aa53b71c2 req-b7cc159e-dc44-44a2-b18d-ac460fb708ce service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:09.394129 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-465184ae-6fb7-4863-aa53-8b0aa53b71c2 req-b7cc159e-dc44-44a2-b18d-ac460fb708ce service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:09.395101 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-465184ae-6fb7-4863-aa53-8b0aa53b71c2 req-b7cc159e-dc44-44a2-b18d-ac460fb708ce service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:09.412043 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-465184ae-6fb7-4863-aa53-8b0aa53b71c2 req-b7cc159e-dc44-44a2-b18d-ac460fb708ce service nova] Creating event network-changed:19ff01df-4500-4f30-970d-7bee0d4b0a4f for instance 2d2c444a-e84e-40c5-aec1-375cd14f67c8 on n-h1-836830-18 Sep 14 08:50:09.427897 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-465184ae-6fb7-4863-aa53-8b0aa53b71c2 req-b7cc159e-dc44-44a2-b18d-ac460fb708ce service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070811 Sep 14 08:50:09.429574 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 283/526] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:50:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:50:09.446824 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-1325f4fe-02e6-46bb-aec8-1008f08352b5 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:50:09.449548 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-1325f4fe-02e6-46bb-aec8-1008f08352b5 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] [instance: 2d2c444a-e84e-40c5-aec1-375cd14f67c8] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:50:09.472877 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1325f4fe-02e6-46bb-aec8-1008f08352b5 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:09.474103 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1325f4fe-02e6-46bb-aec8-1008f08352b5 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:09.475261 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1325f4fe-02e6-46bb-aec8-1008f08352b5 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:09.477306 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1325f4fe-02e6-46bb-aec8-1008f08352b5 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:09.478982 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1325f4fe-02e6-46bb-aec8-1008f08352b5 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:09.479761 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1325f4fe-02e6-46bb-aec8-1008f08352b5 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:09.983955 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-1325f4fe-02e6-46bb-aec8-1008f08352b5 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b938da87b14cd79c3c6dd85818cd02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee17e19b2f094a899dfc8966152fd642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:50:09.992847 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-1325f4fe-02e6-46bb-aec8-1008f08352b5 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] 10.222.0.60 "GET /compute/v2.1/servers/2d2c444a-e84e-40c5-aec1-375cd14f67c8" status: 200 len: 1388 microversion: 2.1 time: 0.561418 Sep 14 08:50:10.010349 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 284/527] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:50:09 2022] GET /compute/v2.1/servers/2d2c444a-e84e-40c5-aec1-375cd14f67c8 => generated 1388 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:50:10.021534 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-2585f63d-f5ce-47c1-8cf1-e57e4f7d2e30 req-4f24a77c-96da-473e-bf28-60f45e87b8eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4c51c69-8c2e-4202-9c2f-3dfae93392e9", "tag": "158744dd-786d-4346-8779-274378b61a47"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:50:10.032334 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-2585f63d-f5ce-47c1-8cf1-e57e4f7d2e30 req-4f24a77c-96da-473e-bf28-60f45e87b8eb service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:10.033014 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-2585f63d-f5ce-47c1-8cf1-e57e4f7d2e30 req-4f24a77c-96da-473e-bf28-60f45e87b8eb service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:10.033642 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-2585f63d-f5ce-47c1-8cf1-e57e4f7d2e30 req-4f24a77c-96da-473e-bf28-60f45e87b8eb service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:10.046156 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-2585f63d-f5ce-47c1-8cf1-e57e4f7d2e30 req-4f24a77c-96da-473e-bf28-60f45e87b8eb service nova] Creating event network-changed:158744dd-786d-4346-8779-274378b61a47 for instance e4c51c69-8c2e-4202-9c2f-3dfae93392e9 on n-h2-836830-18 Sep 14 08:50:10.051409 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-2585f63d-f5ce-47c1-8cf1-e57e4f7d2e30 req-4f24a77c-96da-473e-bf28-60f45e87b8eb service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039021 Sep 14 08:50:10.052504 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 285/528] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:50:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:50:10.059623 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-50281bc6-9362-4906-a7e7-4b65e2c05f41 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:50:10.060522 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-50281bc6-9362-4906-a7e7-4b65e2c05f41 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] [instance: 3acd19ba-a5b9-4bac-a4a3-2c274448c374] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:50:10.067178 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-50281bc6-9362-4906-a7e7-4b65e2c05f41 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:10.067878 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-50281bc6-9362-4906-a7e7-4b65e2c05f41 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:10.068490 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-50281bc6-9362-4906-a7e7-4b65e2c05f41 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:10.069353 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-50281bc6-9362-4906-a7e7-4b65e2c05f41 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:10.069963 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-50281bc6-9362-4906-a7e7-4b65e2c05f41 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:10.070541 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-50281bc6-9362-4906-a7e7-4b65e2c05f41 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:10.706671 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-50281bc6-9362-4906-a7e7-4b65e2c05f41 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c7802984cf48d1852832b52abe52e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e326f95a9604fdb9bd075db3837cf62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:50:10.726833 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-50281bc6-9362-4906-a7e7-4b65e2c05f41 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] 10.222.0.60 "GET /compute/v2.1/servers/3acd19ba-a5b9-4bac-a4a3-2c274448c374" status: 200 len: 1319 microversion: 2.1 time: 0.672817 Sep 14 08:50:10.728873 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 286/529] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:50:10 2022] GET /compute/v2.1/servers/3acd19ba-a5b9-4bac-a4a3-2c274448c374 => generated 1319 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:50:10.743825 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-34410e91-b6fa-4772-b30f-819073731599 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:50:10.745293 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-34410e91-b6fa-4772-b30f-819073731599 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: e4c51c69-8c2e-4202-9c2f-3dfae93392e9] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:50:10.755340 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-34410e91-b6fa-4772-b30f-819073731599 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:10.756128 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-34410e91-b6fa-4772-b30f-819073731599 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:10.756864 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-34410e91-b6fa-4772-b30f-819073731599 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:10.759164 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-34410e91-b6fa-4772-b30f-819073731599 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:10.759796 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-34410e91-b6fa-4772-b30f-819073731599 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:10.760448 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-34410e91-b6fa-4772-b30f-819073731599 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:11.973849 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-34410e91-b6fa-4772-b30f-819073731599 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:50:11.986978 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-34410e91-b6fa-4772-b30f-819073731599 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/e4c51c69-8c2e-4202-9c2f-3dfae93392e9" status: 200 len: 1312 microversion: 2.1 time: 1.255849 Sep 14 08:50:11.989829 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 287/530] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:50:10 2022] GET /compute/v2.1/servers/e4c51c69-8c2e-4202-9c2f-3dfae93392e9 => generated 1312 bytes in 1260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:50:12.004991 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-658b9e85-f47c-4425-b9b7-526552d4f113 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:50:12.008693 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-658b9e85-f47c-4425-b9b7-526552d4f113 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: 5059f5d9-6903-4cf4-a999-01d2d2ba0842] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:50:12.034507 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-658b9e85-f47c-4425-b9b7-526552d4f113 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:12.037758 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-658b9e85-f47c-4425-b9b7-526552d4f113 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:12.039968 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-658b9e85-f47c-4425-b9b7-526552d4f113 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:12.042831 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-658b9e85-f47c-4425-b9b7-526552d4f113 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:12.044747 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-658b9e85-f47c-4425-b9b7-526552d4f113 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:12.049610 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-658b9e85-f47c-4425-b9b7-526552d4f113 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:13.122545 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-658b9e85-f47c-4425-b9b7-526552d4f113 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:50:13.137927 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-658b9e85-f47c-4425-b9b7-526552d4f113 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:50:13.141300 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-658b9e85-f47c-4425-b9b7-526552d4f113 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:50:13.142878 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-658b9e85-f47c-4425-b9b7-526552d4f113 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/5059f5d9-6903-4cf4-a999-01d2d2ba0842" status: 200 len: 1361 microversion: 2.25 time: 1.151883 Sep 14 08:50:13.159762 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 288/531] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:50:11 2022] GET /compute/v2.1/servers/5059f5d9-6903-4cf4-a999-01d2d2ba0842 => generated 1361 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:50:13.173091 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f44c6a3c-6619-4663-a130-752470a00da5 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:50:13.173924 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f44c6a3c-6619-4663-a130-752470a00da5 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] [instance: 2d2c444a-e84e-40c5-aec1-375cd14f67c8] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:50:13.188231 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f44c6a3c-6619-4663-a130-752470a00da5 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:13.188737 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f44c6a3c-6619-4663-a130-752470a00da5 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:13.189189 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f44c6a3c-6619-4663-a130-752470a00da5 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:13.189902 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f44c6a3c-6619-4663-a130-752470a00da5 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:13.190365 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f44c6a3c-6619-4663-a130-752470a00da5 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:13.190791 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f44c6a3c-6619-4663-a130-752470a00da5 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:13.672464 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f44c6a3c-6619-4663-a130-752470a00da5 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b938da87b14cd79c3c6dd85818cd02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee17e19b2f094a899dfc8966152fd642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:50:13.681173 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f44c6a3c-6619-4663-a130-752470a00da5 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] 10.222.0.60 "GET /compute/v2.1/servers/2d2c444a-e84e-40c5-aec1-375cd14f67c8" status: 200 len: 1388 microversion: 2.1 time: 0.519837 Sep 14 08:50:13.681765 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 289/532] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:50:13 2022] GET /compute/v2.1/servers/2d2c444a-e84e-40c5-aec1-375cd14f67c8 => generated 1388 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:50:13.688977 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-388b7a7b-b6a8-4cd6-9e94-b4a07dbcc2e9 req-3ebcf077-8216-4dcf-8580-6181343042ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9507f778-dd44-4db1-b36e-fecd603b2487", "name": "network-vif-plugged", "status": "completed", "tag": "7de514e0-ca4d-44bd-881b-61b7fec81020"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:50:13.700368 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-388b7a7b-b6a8-4cd6-9e94-b4a07dbcc2e9 req-3ebcf077-8216-4dcf-8580-6181343042ed service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:13.700882 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-388b7a7b-b6a8-4cd6-9e94-b4a07dbcc2e9 req-3ebcf077-8216-4dcf-8580-6181343042ed service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:13.701309 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-388b7a7b-b6a8-4cd6-9e94-b4a07dbcc2e9 req-3ebcf077-8216-4dcf-8580-6181343042ed service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:13.713900 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-388b7a7b-b6a8-4cd6-9e94-b4a07dbcc2e9 req-3ebcf077-8216-4dcf-8580-6181343042ed service nova] Creating event network-vif-plugged:7de514e0-ca4d-44bd-881b-61b7fec81020 for instance 9507f778-dd44-4db1-b36e-fecd603b2487 on n-h2-836830-18 Sep 14 08:50:13.719133 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-388b7a7b-b6a8-4cd6-9e94-b4a07dbcc2e9 req-3ebcf077-8216-4dcf-8580-6181343042ed service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034874 Sep 14 08:50:13.719899 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 290/533] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:50:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:50:13.726478 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-fe2f80c5-5cbf-481b-b735-c41eaa1ae2aa tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:50:13.727219 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-fe2f80c5-5cbf-481b-b735-c41eaa1ae2aa tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] [instance: 3acd19ba-a5b9-4bac-a4a3-2c274448c374] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:50:13.735415 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fe2f80c5-5cbf-481b-b735-c41eaa1ae2aa tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:13.736209 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fe2f80c5-5cbf-481b-b735-c41eaa1ae2aa tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:13.736801 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fe2f80c5-5cbf-481b-b735-c41eaa1ae2aa tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:13.737743 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fe2f80c5-5cbf-481b-b735-c41eaa1ae2aa tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:13.738389 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fe2f80c5-5cbf-481b-b735-c41eaa1ae2aa tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:13.739173 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fe2f80c5-5cbf-481b-b735-c41eaa1ae2aa tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:14.335695 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.network.neutron [None req-190576fc-8de9-44f3-8716-5d7d75281cbf tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] [instance: c402c828-5101-40cc-8ac8-b3d1470028ed] Building network info cache for instance {{(pid=128758) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 14 08:50:14.418422 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-fe2f80c5-5cbf-481b-b735-c41eaa1ae2aa tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c7802984cf48d1852832b52abe52e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e326f95a9604fdb9bd075db3837cf62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:50:14.429234 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-fe2f80c5-5cbf-481b-b735-c41eaa1ae2aa tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] 10.222.0.60 "GET /compute/v2.1/servers/3acd19ba-a5b9-4bac-a4a3-2c274448c374" status: 200 len: 1467 microversion: 2.1 time: 0.707934 Sep 14 08:50:14.451040 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 291/534] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:50:13 2022] GET /compute/v2.1/servers/3acd19ba-a5b9-4bac-a4a3-2c274448c374 => generated 1467 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:50:14.840695 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-cef5a686-5947-4527-b0f0-69b59c8cb4ad tempest-SecurityGroupsTestAdminJSON-485934421 tempest-SecurityGroupsTestAdminJSON-485934421-project] Action: 'create', calling method: .version_select at 0x7f7d44966670>, body: {"security_group": {"name": "tempest-securitygroup-41378832", "description": "tempest-description-1907838852"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:50:15.432770 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-cef5a686-5947-4527-b0f0-69b59c8cb4ad tempest-SecurityGroupsTestAdminJSON-485934421 tempest-SecurityGroupsTestAdminJSON-485934421-project] 10.222.0.60 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 0.994264 Sep 14 08:50:15.434087 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 292/535] 10.222.0.60 () {60 vars in 1180 bytes} [Wed Sep 14 08:50:14 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:50:15.439329 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9ae64678-a824-4706-a0a3-c816127e3a19 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:50:15.440134 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-9ae64678-a824-4706-a0a3-c816127e3a19 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: e4c51c69-8c2e-4202-9c2f-3dfae93392e9] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:50:15.456918 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9ae64678-a824-4706-a0a3-c816127e3a19 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:15.458201 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9ae64678-a824-4706-a0a3-c816127e3a19 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:15.460648 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9ae64678-a824-4706-a0a3-c816127e3a19 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:15.462250 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9ae64678-a824-4706-a0a3-c816127e3a19 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:15.464248 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9ae64678-a824-4706-a0a3-c816127e3a19 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:15.465837 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9ae64678-a824-4706-a0a3-c816127e3a19 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:15.829346 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-9ae64678-a824-4706-a0a3-c816127e3a19 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:50:15.832442 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.network.neutron [None req-190576fc-8de9-44f3-8716-5d7d75281cbf tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] [instance: c402c828-5101-40cc-8ac8-b3d1470028ed] Updating instance_info_cache with network_info: [{"id": "16038378-4ff2-47f4-881a-cf785e164719", "address": "fa:16:3e:df:24:7c", "network": {"id": "cb8bf0a7-4184-4ca4-bffa-150d2b18bef7", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-2031436314-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.9.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "919dd9619fb24ee281cf6d96cf3351df", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap16038378-4f", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128758) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 14 08:50:15.837884 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-9ae64678-a824-4706-a0a3-c816127e3a19 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/e4c51c69-8c2e-4202-9c2f-3dfae93392e9" status: 200 len: 1312 microversion: 2.1 time: 0.402436 Sep 14 08:50:15.849088 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-190576fc-8de9-44f3-8716-5d7d75281cbf tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Releasing lock "refresh_cache-c402c828-5101-40cc-8ac8-b3d1470028ed" {{(pid=128758) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 14 08:50:15.851255 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-190576fc-8de9-44f3-8716-5d7d75281cbf tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] 10.222.0.60 "POST /compute/v2.1/servers/c402c828-5101-40cc-8ac8-b3d1470028ed/action" status: 202 len: 0 microversion: 2.1 time: 8.150060 Sep 14 08:50:15.866311 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 244/536] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 08:50:07 2022] POST /compute/v2.1/servers/c402c828-5101-40cc-8ac8-b3d1470028ed/action => generated 0 bytes in 8166 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 14 08:50:15.867635 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 293/537] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:50:15 2022] GET /compute/v2.1/servers/e4c51c69-8c2e-4202-9c2f-3dfae93392e9 => generated 1312 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:50:15.880086 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-a0bf453d-b9e0-473a-b1e6-47a206bd95c4 req-23c25fad-56ac-4c72-a75b-ed700094f827 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c402c828-5101-40cc-8ac8-b3d1470028ed", "tag": "16038378-4ff2-47f4-881a-cf785e164719"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:50:15.883662 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a8b73623-f14f-47b0-9b3b-5cb928683542 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:50:15.884294 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-a8b73623-f14f-47b0-9b3b-5cb928683542 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: 5059f5d9-6903-4cf4-a999-01d2d2ba0842] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:50:15.895493 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a8b73623-f14f-47b0-9b3b-5cb928683542 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:15.895988 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a8b73623-f14f-47b0-9b3b-5cb928683542 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:15.896608 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a8b73623-f14f-47b0-9b3b-5cb928683542 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:15.896876 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-a0bf453d-b9e0-473a-b1e6-47a206bd95c4 req-23c25fad-56ac-4c72-a75b-ed700094f827 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:15.897305 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a8b73623-f14f-47b0-9b3b-5cb928683542 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:15.897764 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a8b73623-f14f-47b0-9b3b-5cb928683542 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:15.898062 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-a0bf453d-b9e0-473a-b1e6-47a206bd95c4 req-23c25fad-56ac-4c72-a75b-ed700094f827 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:15.898183 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a8b73623-f14f-47b0-9b3b-5cb928683542 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:15.898876 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-a0bf453d-b9e0-473a-b1e6-47a206bd95c4 req-23c25fad-56ac-4c72-a75b-ed700094f827 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:15.915657 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-a0bf453d-b9e0-473a-b1e6-47a206bd95c4 req-23c25fad-56ac-4c72-a75b-ed700094f827 service nova] Creating event network-changed:16038378-4ff2-47f4-881a-cf785e164719 for instance c402c828-5101-40cc-8ac8-b3d1470028ed on n-h1-836830-18 Sep 14 08:50:15.933639 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-a0bf453d-b9e0-473a-b1e6-47a206bd95c4 req-23c25fad-56ac-4c72-a75b-ed700094f827 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048925 Sep 14 08:50:15.935701 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 294/538] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:50:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:50:15.948709 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3ffcf09d-8c21-469d-ac72-fa4bcf6f7952 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:50:15.949686 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-3ffcf09d-8c21-469d-ac72-fa4bcf6f7952 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] [instance: 9507f778-dd44-4db1-b36e-fecd603b2487] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:50:15.977532 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3ffcf09d-8c21-469d-ac72-fa4bcf6f7952 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:15.980169 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3ffcf09d-8c21-469d-ac72-fa4bcf6f7952 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:15.982303 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3ffcf09d-8c21-469d-ac72-fa4bcf6f7952 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:15.983469 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3ffcf09d-8c21-469d-ac72-fa4bcf6f7952 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:15.984048 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3ffcf09d-8c21-469d-ac72-fa4bcf6f7952 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:15.985180 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3ffcf09d-8c21-469d-ac72-fa4bcf6f7952 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:16.019895 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=100 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:50:16.404441 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-3ffcf09d-8c21-469d-ac72-fa4bcf6f7952 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c7802984cf48d1852832b52abe52e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e326f95a9604fdb9bd075db3837cf62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:50:16.416467 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-3ffcf09d-8c21-469d-ac72-fa4bcf6f7952 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] 10.222.0.60 "GET /compute/v2.1/servers/9507f778-dd44-4db1-b36e-fecd603b2487" status: 200 len: 1469 microversion: 2.1 time: 0.478361 Sep 14 08:50:16.416766 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 295/539] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:50:15 2022] GET /compute/v2.1/servers/9507f778-dd44-4db1-b36e-fecd603b2487 => generated 1469 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:50:16.442742 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-a8b73623-f14f-47b0-9b3b-5cb928683542 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:50:16.446763 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9abcd83b-b021-4985-a2ac-9d8f60fefe39 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:50:16.449485 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-9abcd83b-b021-4985-a2ac-9d8f60fefe39 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] [instance: 2d2c444a-e84e-40c5-aec1-375cd14f67c8] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:50:16.453105 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-a8b73623-f14f-47b0-9b3b-5cb928683542 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:50:16.455723 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-a8b73623-f14f-47b0-9b3b-5cb928683542 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:50:16.464389 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-a8b73623-f14f-47b0-9b3b-5cb928683542 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/5059f5d9-6903-4cf4-a999-01d2d2ba0842" status: 200 len: 1361 microversion: 2.25 time: 0.596715 Sep 14 08:50:16.471494 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9abcd83b-b021-4985-a2ac-9d8f60fefe39 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:16.472138 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9abcd83b-b021-4985-a2ac-9d8f60fefe39 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:16.473236 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9abcd83b-b021-4985-a2ac-9d8f60fefe39 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:16.477174 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9abcd83b-b021-4985-a2ac-9d8f60fefe39 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:16.478412 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9abcd83b-b021-4985-a2ac-9d8f60fefe39 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:16.479512 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9abcd83b-b021-4985-a2ac-9d8f60fefe39 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:16.483935 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 245/540] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:50:15 2022] GET /compute/v2.1/servers/5059f5d9-6903-4cf4-a999-01d2d2ba0842 => generated 1361 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:50:16.490587 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-f1efb9bc-3e4b-46ea-a9f0-d30ee4787e83 tempest-SecurityGroupsTestAdminJSON-485934421 tempest-SecurityGroupsTestAdminJSON-485934421-project] Action: 'create', calling method: .version_select at 0x7f7d44c3fb80>, body: {"security_group": {"name": "tempest-securitygroup-914749611", "description": "tempest-description-1181314603"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:50:16.925208 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=2 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:50:16.971207 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=6 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:50:16.999422 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-9abcd83b-b021-4985-a2ac-9d8f60fefe39 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b938da87b14cd79c3c6dd85818cd02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee17e19b2f094a899dfc8966152fd642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:50:17.014290 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-9abcd83b-b021-4985-a2ac-9d8f60fefe39 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] 10.222.0.60 "GET /compute/v2.1/servers/2d2c444a-e84e-40c5-aec1-375cd14f67c8" status: 200 len: 1388 microversion: 2.1 time: 0.594053 Sep 14 08:50:17.015233 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 296/541] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:50:16 2022] GET /compute/v2.1/servers/2d2c444a-e84e-40c5-aec1-375cd14f67c8 => generated 1388 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:50:17.036135 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-338c903d-214a-49e7-8e64-dff2a6813253 req-c2c8750f-d4da-4579-a742-8574f96dbd58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5059f5d9-6903-4cf4-a999-01d2d2ba0842", "tag": "0b18a372-58a0-4acd-a4e8-de3db7d03c42"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:50:17.066070 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-338c903d-214a-49e7-8e64-dff2a6813253 req-c2c8750f-d4da-4579-a742-8574f96dbd58 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:17.070306 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-338c903d-214a-49e7-8e64-dff2a6813253 req-c2c8750f-d4da-4579-a742-8574f96dbd58 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:17.070999 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-338c903d-214a-49e7-8e64-dff2a6813253 req-c2c8750f-d4da-4579-a742-8574f96dbd58 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:17.099319 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-338c903d-214a-49e7-8e64-dff2a6813253 req-c2c8750f-d4da-4579-a742-8574f96dbd58 service nova] Creating event network-changed:0b18a372-58a0-4acd-a4e8-de3db7d03c42 for instance 5059f5d9-6903-4cf4-a999-01d2d2ba0842 on n-h2-836830-18 Sep 14 08:50:17.109764 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-338c903d-214a-49e7-8e64-dff2a6813253 req-c2c8750f-d4da-4579-a742-8574f96dbd58 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081451 Sep 14 08:50:17.111623 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 297/542] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:50:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:50:17.123508 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-27aee3e1-c8e6-4efa-83c1-7b177ff8c32c tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Action: 'create', calling method: .version_select at 0x7f7d44868280>, body: {"pool": "36f27675-c765-4db9-982e-8f515d0f3697"} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:50:17.573529 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-f1efb9bc-3e4b-46ea-a9f0-d30ee4787e83 tempest-SecurityGroupsTestAdminJSON-485934421 tempest-SecurityGroupsTestAdminJSON-485934421-project] 10.222.0.60 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 1.087837 Sep 14 08:50:17.585111 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 246/543] 10.222.0.60 () {60 vars in 1180 bytes} [Wed Sep 14 08:50:16 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:50:17.590746 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-21897d8b-8e24-46a0-997c-dc15b74ff5b7 req-97a729d2-3fd3-4531-bd0f-f638eead3091 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4c51c69-8c2e-4202-9c2f-3dfae93392e9", "name": "network-vif-plugged", "status": "completed", "tag": "158744dd-786d-4346-8779-274378b61a47"}, {"server_uuid": "2d2c444a-e84e-40c5-aec1-375cd14f67c8", "name": "network-vif-plugged", "status": "completed", "tag": "19ff01df-4500-4f30-970d-7bee0d4b0a4f"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:50:17.608608 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-21897d8b-8e24-46a0-997c-dc15b74ff5b7 req-97a729d2-3fd3-4531-bd0f-f638eead3091 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:17.609840 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-21897d8b-8e24-46a0-997c-dc15b74ff5b7 req-97a729d2-3fd3-4531-bd0f-f638eead3091 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:17.610618 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-21897d8b-8e24-46a0-997c-dc15b74ff5b7 req-97a729d2-3fd3-4531-bd0f-f638eead3091 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:17.637572 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-21897d8b-8e24-46a0-997c-dc15b74ff5b7 req-97a729d2-3fd3-4531-bd0f-f638eead3091 service nova] Creating event network-vif-plugged:158744dd-786d-4346-8779-274378b61a47 for instance e4c51c69-8c2e-4202-9c2f-3dfae93392e9 on n-h2-836830-18 Sep 14 08:50:17.638493 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-21897d8b-8e24-46a0-997c-dc15b74ff5b7 req-97a729d2-3fd3-4531-bd0f-f638eead3091 service nova] Creating event network-vif-plugged:19ff01df-4500-4f30-970d-7bee0d4b0a4f for instance 2d2c444a-e84e-40c5-aec1-375cd14f67c8 on n-h1-836830-18 Sep 14 08:50:17.656117 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-21897d8b-8e24-46a0-997c-dc15b74ff5b7 req-97a729d2-3fd3-4531-bd0f-f638eead3091 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.069932 Sep 14 08:50:17.669852 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 247/544] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:50:17 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:50:17.687722 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-cfe7255c-f1ba-4a06-a51d-fc67395843df tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:50:17.695551 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-cfe7255c-f1ba-4a06-a51d-fc67395843df tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '89c7802984cf48d1852832b52abe52e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e326f95a9604fdb9bd075db3837cf62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:50:17.697360 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-cfe7255c-f1ba-4a06-a51d-fc67395843df tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Searching by: {'reservation_id': 'r-h4b61ulr', 'deleted': False, 'project_id': '5e326f95a9604fdb9bd075db3837cf62'} {{(pid=128758) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 14 08:50:17.705998 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cfe7255c-f1ba-4a06-a51d-fc67395843df tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:17.706581 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cfe7255c-f1ba-4a06-a51d-fc67395843df tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:17.707145 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cfe7255c-f1ba-4a06-a51d-fc67395843df tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:17.707952 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cfe7255c-f1ba-4a06-a51d-fc67395843df tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:17.708505 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cfe7255c-f1ba-4a06-a51d-fc67395843df tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:17.709151 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cfe7255c-f1ba-4a06-a51d-fc67395843df tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:17.941473 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.multi_cell_list [None req-cfe7255c-f1ba-4a06-a51d-fc67395843df tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128758) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 14 08:50:18.139877 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-cfe7255c-f1ba-4a06-a51d-fc67395843df tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c7802984cf48d1852832b52abe52e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e326f95a9604fdb9bd075db3837cf62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:50:18.152257 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cfe7255c-f1ba-4a06-a51d-fc67395843df tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:18.153108 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cfe7255c-f1ba-4a06-a51d-fc67395843df tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:18.154733 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cfe7255c-f1ba-4a06-a51d-fc67395843df tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:18.474199 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-cfe7255c-f1ba-4a06-a51d-fc67395843df tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] 10.222.0.60 "GET /compute/v2.1/servers/detail?reservation_id=r-h4b61ulr" status: 200 len: 2929 microversion: 2.1 time: 0.802022 Sep 14 08:50:18.479163 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 248/545] 10.222.0.60 () {58 vars in 1197 bytes} [Wed Sep 14 08:50:17 2022] GET /compute/v2.1/servers/detail?reservation_id=r-h4b61ulr => generated 2929 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:50:18.486102 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-e5cee895-e70e-409d-9e56-7842981d450d tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:50:18.486857 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-e5cee895-e70e-409d-9e56-7842981d450d tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: e4c51c69-8c2e-4202-9c2f-3dfae93392e9] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:50:18.503430 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e5cee895-e70e-409d-9e56-7842981d450d tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:18.503974 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e5cee895-e70e-409d-9e56-7842981d450d tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:18.504601 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e5cee895-e70e-409d-9e56-7842981d450d tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:18.505534 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e5cee895-e70e-409d-9e56-7842981d450d tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:18.506144 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e5cee895-e70e-409d-9e56-7842981d450d tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:18.506725 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e5cee895-e70e-409d-9e56-7842981d450d tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:18.741422 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-e5cee895-e70e-409d-9e56-7842981d450d tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:50:18.756269 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-e5cee895-e70e-409d-9e56-7842981d450d tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/e4c51c69-8c2e-4202-9c2f-3dfae93392e9" status: 200 len: 1312 microversion: 2.1 time: 0.280058 Sep 14 08:50:18.757064 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 249/546] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:50:18 2022] GET /compute/v2.1/servers/e4c51c69-8c2e-4202-9c2f-3dfae93392e9 => generated 1312 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:50:18.777507 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-50081ceb-1fa4-4795-b434-61487bf30c52 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:50:18.778117 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-50081ceb-1fa4-4795-b434-61487bf30c52 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: 5059f5d9-6903-4cf4-a999-01d2d2ba0842] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:50:18.784709 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-50081ceb-1fa4-4795-b434-61487bf30c52 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:18.785197 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-50081ceb-1fa4-4795-b434-61487bf30c52 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:18.785689 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-50081ceb-1fa4-4795-b434-61487bf30c52 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:18.786557 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-50081ceb-1fa4-4795-b434-61487bf30c52 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:18.787042 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-50081ceb-1fa4-4795-b434-61487bf30c52 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:18.787543 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-50081ceb-1fa4-4795-b434-61487bf30c52 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:19.264666 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-50081ceb-1fa4-4795-b434-61487bf30c52 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:50:19.273404 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-50081ceb-1fa4-4795-b434-61487bf30c52 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:50:19.274869 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-50081ceb-1fa4-4795-b434-61487bf30c52 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:50:19.276084 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-50081ceb-1fa4-4795-b434-61487bf30c52 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/5059f5d9-6903-4cf4-a999-01d2d2ba0842" status: 200 len: 1361 microversion: 2.25 time: 0.502741 Sep 14 08:50:19.277079 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 250/547] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:50:18 2022] GET /compute/v2.1/servers/5059f5d9-6903-4cf4-a999-01d2d2ba0842 => generated 1361 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:50:19.576071 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c91b99ef-c65e-40b7-bd67-5d6801eda525 tempest-SecurityGroupsTestAdminJSON-901672823 tempest-SecurityGroupsTestAdminJSON-901672823-project-admin] Action: 'create', calling method: .version_select at 0x7f7d44cdfb80>, body: {"security_group": {"name": "tempest-securitygroup-96333129", "description": "tempest-description-1622443430"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:50:19.746649 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-27aee3e1-c8e6-4efa-83c1-7b177ff8c32c tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] 10.222.0.60 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.633554 Sep 14 08:50:19.747796 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 298/548] 10.222.0.60 () {60 vars in 1170 bytes} [Wed Sep 14 08:50:17 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2635 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:50:19.761740 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-0e18da0b-b99b-4473-a4aa-8b6adefbb6fc tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:50:19.762513 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-0e18da0b-b99b-4473-a4aa-8b6adefbb6fc tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] [instance: 2d2c444a-e84e-40c5-aec1-375cd14f67c8] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:50:19.777780 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0e18da0b-b99b-4473-a4aa-8b6adefbb6fc tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:19.779447 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0e18da0b-b99b-4473-a4aa-8b6adefbb6fc tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:19.780830 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0e18da0b-b99b-4473-a4aa-8b6adefbb6fc tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:19.782246 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0e18da0b-b99b-4473-a4aa-8b6adefbb6fc tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:19.783633 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0e18da0b-b99b-4473-a4aa-8b6adefbb6fc tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:19.785244 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0e18da0b-b99b-4473-a4aa-8b6adefbb6fc tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:20.041973 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-0e18da0b-b99b-4473-a4aa-8b6adefbb6fc tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b938da87b14cd79c3c6dd85818cd02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee17e19b2f094a899dfc8966152fd642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:50:20.047089 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-c91b99ef-c65e-40b7-bd67-5d6801eda525 tempest-SecurityGroupsTestAdminJSON-901672823 tempest-SecurityGroupsTestAdminJSON-901672823-project-admin] 10.222.0.60 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 0.768761 Sep 14 08:50:20.047699 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 251/549] 10.222.0.60 () {60 vars in 1180 bytes} [Wed Sep 14 08:50:19 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:50:20.050892 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-0e18da0b-b99b-4473-a4aa-8b6adefbb6fc tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] 10.222.0.60 "GET /compute/v2.1/servers/2d2c444a-e84e-40c5-aec1-375cd14f67c8" status: 200 len: 1586 microversion: 2.1 time: 0.293708 Sep 14 08:50:20.051607 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 299/550] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:50:19 2022] GET /compute/v2.1/servers/2d2c444a-e84e-40c5-aec1-375cd14f67c8 => generated 1586 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:50:20.060945 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-079e20fd-0e41-4119-b662-87db1def60b8 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:50:20.093628 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.compute.server_groups [None req-079e20fd-0e41-4119-b662-87db1def60b8 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Querying cell 0a35f87f-19b7-4b11-98e6-8bcd07b0466f(cell1) for 2 instances {{(pid=128758) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Sep 14 08:50:20.095027 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-079e20fd-0e41-4119-b662-87db1def60b8 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:20.095663 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-079e20fd-0e41-4119-b662-87db1def60b8 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:20.096247 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-079e20fd-0e41-4119-b662-87db1def60b8 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:20.139173 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-079e20fd-0e41-4119-b662-87db1def60b8 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] 10.222.0.60 "GET /compute/v2.1/os-server-groups/772977de-b17d-439d-af7a-58894a154ed1" status: 200 len: 265 microversion: 2.1 time: 0.082305 Sep 14 08:50:20.140158 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 252/551] 10.222.0.60 () {58 vars in 1263 bytes} [Wed Sep 14 08:50:20 2022] GET /compute/v2.1/os-server-groups/772977de-b17d-439d-af7a-58894a154ed1 => generated 265 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:50:20.146455 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-29eb8746-415b-4984-930e-11b609787a98 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.9.157"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:50:20.150851 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-29eb8746-415b-4984-930e-11b609787a98 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] [instance: c402c828-5101-40cc-8ac8-b3d1470028ed] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:50:20.160050 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-29eb8746-415b-4984-930e-11b609787a98 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:20.160874 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-29eb8746-415b-4984-930e-11b609787a98 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:20.161475 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-29eb8746-415b-4984-930e-11b609787a98 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:20.163258 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-29eb8746-415b-4984-930e-11b609787a98 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:20.163891 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-29eb8746-415b-4984-930e-11b609787a98 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:20.164480 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-29eb8746-415b-4984-930e-11b609787a98 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:20.214314 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-29eb8746-415b-4984-930e-11b609787a98 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Acquiring lock "refresh_cache-c402c828-5101-40cc-8ac8-b3d1470028ed" {{(pid=128758) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 14 08:50:20.214726 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-29eb8746-415b-4984-930e-11b609787a98 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Acquired lock "refresh_cache-c402c828-5101-40cc-8ac8-b3d1470028ed" {{(pid=128758) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 14 08:50:20.346913 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-abc58ce2-d202-4395-9b07-7be6d844fb81 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1030647762", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "networks": [{"uuid": "3e96754e-5525-4c7d-b9d8-ac1d87e859d5"}]}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:50:20.422709 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.network.neutron [None req-abc58ce2-d202-4395-9b07-7be6d844fb81 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] validate_networks() for [('3e96754e-5525-4c7d-b9d8-ac1d87e859d5', None, None, None, None, None)] {{(pid=128759) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 08:50:20.884541 n-d-836830-18 devstack@n-api.service[128758]: DEBUG neutronclient.v2_0.client [None req-29eb8746-415b-4984-930e-11b609787a98 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.9.157 (5367e7a6-ddfe-4f75-84b5-2b626e4421c4) with port 16038378-4ff2-47f4-881a-cf785e164719 using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network 36f27675-c765-4db9-982e-8f515d0f3697.", "detail": ""}} {{(pid=128758) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 14 08:50:20.886735 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-29eb8746-415b-4984-930e-11b609787a98 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Releasing lock "refresh_cache-c402c828-5101-40cc-8ac8-b3d1470028ed" {{(pid=128758) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 14 08:50:20.888495 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-29eb8746-415b-4984-930e-11b609787a98 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] HTTP exception thrown: Cannot associate floating IP 172.25.9.157 (5367e7a6-ddfe-4f75-84b5-2b626e4421c4) with port 16038378-4ff2-47f4-881a-cf785e164719 using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network 36f27675-c765-4db9-982e-8f515d0f3697. Sep 14 08:50:20.888495 n-d-836830-18 devstack@n-api.service[128758]: Neutron server returns request_ids: ['req-b880678a-f42e-4739-b0d0-2e4d5ba1a5ff'] Sep 14 08:50:20.901902 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-29eb8746-415b-4984-930e-11b609787a98 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Request method failure captured: Sep 14 08:50:20.901902 n-d-836830-18 devstack@n-api.service[128758]: request: POST /compute/v2.1/servers/c402c828-5101-40cc-8ac8-b3d1470028ed/action HTTP/1.1 Sep 14 08:50:20.901902 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 08:50:20.901902 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 08:50:20.901902 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 08:50:20.901902 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 46 Sep 14 08:50:20.901902 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 08:50:20.901902 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 08:50:20.901902 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 08:50:20.901902 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 08:50:20.901902 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZWTldFMv0tHd5a7Ks8uSId48hq738jXhgisWp3KuNXYOOwtDEA93GrCvsvMh8LBKWuxryMRJNeZ_djWm5PqkEKm4zP_p_hlJivtVNyHBAXQbzCzmw4ZR0JAQEfiU2nojnC3xdqWXWwglnogL3YZGi4JL0DjC2paGgvKXnMgsbUaKug Sep 14 08:50:20.901902 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 08:50:20.901902 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 08:50:20.901902 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 08:50:20.901902 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 08:50:20.901902 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 08:50:20.901902 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 08:50:20.901902 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 919dd9619fb24ee281cf6d96cf3351df Sep 14 08:50:20.901902 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 Sep 14 08:50:20.901902 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 08:50:20.901902 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 08:50:20.903647 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/919dd9619fb24ee281cf6d96cf3351df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_919dd9619fb24ee281cf6d96cf3351df"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/919dd9619fb24ee281cf6d96cf3351df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/919dd9619fb24ee281cf6d96cf3351df"}]}] Sep 14 08:50:20.903647 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 Sep 14 08:50:20.903647 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 919dd9619fb24ee281cf6d96cf3351df Sep 14 08:50:20.903647 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 Sep 14 08:50:20.903647 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project Sep 14 08:50:20.903647 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 08:50:20.903647 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 08:50:20.903647 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 2290f39b61044661aa9bec206794a5c8 Sep 14 08:50:20.903647 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project Sep 14 08:50:20.903647 n-d-836830-18 devstack@n-api.service[128758]: Sep 14 08:50:20.903647 n-d-836830-18 devstack@n-api.service[128758]: {"addFloatingIp": {"address": "172.25.9.157"}} Sep 14 08:50:20.903647 n-d-836830-18 devstack@n-api.service[128758]: method: Sep 14 08:50:20.904539 n-d-836830-18 devstack@n-api.service[128758]: exception: Cannot associate floating IP 172.25.9.157 (5367e7a6-ddfe-4f75-84b5-2b626e4421c4) with port 16038378-4ff2-47f4-881a-cf785e164719 using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network 36f27675-c765-4db9-982e-8f515d0f3697. Sep 14 08:50:20.904539 n-d-836830-18 devstack@n-api.service[128758]: Neutron server returns request_ids: ['req-b880678a-f42e-4739-b0d0-2e4d5ba1a5ff'] Sep 14 08:50:20.904539 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': 'c402c828-5101-40cc-8ac8-b3d1470028ed', 'body': {'addFloatingIp': {'address': '172.25.9.157'}}} Sep 14 08:50:20.904539 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:50:20.904539 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:50:20.904539 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2703, in associate_floating_ip Sep 14 08:50:20.904539 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Sep 14 08:50:20.904539 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 08:50:20.904539 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 08:50:20.904539 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1016, in update_floatingip Sep 14 08:50:20.904539 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Sep 14 08:50:20.904539 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 08:50:20.904539 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 08:50:20.904539 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2548, in _update_resource Sep 14 08:50:20.904539 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Sep 14 08:50:20.904539 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 08:50:20.904539 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 08:50:20.905841 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Sep 14 08:50:20.905841 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Sep 14 08:50:20.905841 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 08:50:20.905841 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 08:50:20.905841 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 14 08:50:20.905841 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 14 08:50:20.905841 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 08:50:20.905841 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 08:50:20.905841 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 14 08:50:20.905841 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 14 08:50:20.905841 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 08:50:20.905841 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 08:50:20.905841 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 14 08:50:20.905841 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 14 08:50:20.905841 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 14 08:50:20.905841 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 14 08:50:20.907016 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.9.157 (5367e7a6-ddfe-4f75-84b5-2b626e4421c4) with port 16038378-4ff2-47f4-881a-cf785e164719 using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network 36f27675-c765-4db9-982e-8f515d0f3697. Sep 14 08:50:20.907016 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b880678a-f42e-4739-b0d0-2e4d5ba1a5ff'] Sep 14 08:50:20.907016 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:50:20.907016 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:50:20.907016 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:50:20.907016 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:50:20.907016 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Sep 14 08:50:20.907016 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Sep 14 08:50:20.907016 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Sep 14 08:50:20.907016 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Sep 14 08:50:20.907016 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2705, in associate_floating_ip Sep 14 08:50:20.907016 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Sep 14 08:50:20.907016 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.9.157 (5367e7a6-ddfe-4f75-84b5-2b626e4421c4) with port 16038378-4ff2-47f4-881a-cf785e164719 using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network 36f27675-c765-4db9-982e-8f515d0f3697. Sep 14 08:50:20.907016 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b880678a-f42e-4739-b0d0-2e4d5ba1a5ff'] Sep 14 08:50:20.907016 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:50:20.907016 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:50:20.908156 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:50:20.908156 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:50:20.908156 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:50:20.908156 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:50:20.908156 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:50:20.908156 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:50:20.908156 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 08:50:20.908156 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 08:50:20.908156 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:50:20.908156 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:50:20.908156 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 08:50:20.908156 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 08:50:20.908156 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Sep 14 08:50:20.908156 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Sep 14 08:50:20.908156 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.9.157 (5367e7a6-ddfe-4f75-84b5-2b626e4421c4) with port 16038378-4ff2-47f4-881a-cf785e164719 using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network 36f27675-c765-4db9-982e-8f515d0f3697. Sep 14 08:50:20.908156 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b880678a-f42e-4739-b0d0-2e4d5ba1a5ff'] Sep 14 08:50:20.908156 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:50:20.908156 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:50:20.909441 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:50:20.909441 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:50:20.909441 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:50:20.909441 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:50:20.909441 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:50:20.909441 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:50:20.909441 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.9.157 (5367e7a6-ddfe-4f75-84b5-2b626e4421c4) with port 16038378-4ff2-47f4-881a-cf785e164719 using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network 36f27675-c765-4db9-982e-8f515d0f3697. Sep 14 08:50:20.909441 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b880678a-f42e-4739-b0d0-2e4d5ba1a5ff'] Sep 14 08:50:20.909441 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:50:20.909441 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-29eb8746-415b-4984-930e-11b609787a98 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Returning 400 to user: Cannot associate floating IP 172.25.9.157 (5367e7a6-ddfe-4f75-84b5-2b626e4421c4) with port 16038378-4ff2-47f4-881a-cf785e164719 using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network 36f27675-c765-4db9-982e-8f515d0f3697. Sep 14 08:50:20.909441 n-d-836830-18 devstack@n-api.service[128758]: Neutron server returns request_ids: ['req-b880678a-f42e-4739-b0d0-2e4d5ba1a5ff'] {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:50:20.910285 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-29eb8746-415b-4984-930e-11b609787a98 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] 10.222.0.60 "POST /compute/v2.1/servers/c402c828-5101-40cc-8ac8-b3d1470028ed/action" status: 400 len: 381 microversion: 2.1 time: 0.764475 Sep 14 08:50:20.910610 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 253/552] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 08:50:20 2022] POST /compute/v2.1/servers/c402c828-5101-40cc-8ac8-b3d1470028ed/action => generated 381 bytes in 769 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 14 08:50:20.915796 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-4b6b7e01-3d75-4a2e-ae8b-2df896e9d2e9 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:50:20.916732 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-4b6b7e01-3d75-4a2e-ae8b-2df896e9d2e9 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: e4c51c69-8c2e-4202-9c2f-3dfae93392e9] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:50:20.931262 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4b6b7e01-3d75-4a2e-ae8b-2df896e9d2e9 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:20.931787 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4b6b7e01-3d75-4a2e-ae8b-2df896e9d2e9 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:20.932705 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4b6b7e01-3d75-4a2e-ae8b-2df896e9d2e9 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:20.933462 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4b6b7e01-3d75-4a2e-ae8b-2df896e9d2e9 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:20.933921 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4b6b7e01-3d75-4a2e-ae8b-2df896e9d2e9 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:20.934349 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4b6b7e01-3d75-4a2e-ae8b-2df896e9d2e9 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:21.263843 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-4b6b7e01-3d75-4a2e-ae8b-2df896e9d2e9 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:50:21.274625 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-4b6b7e01-3d75-4a2e-ae8b-2df896e9d2e9 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/e4c51c69-8c2e-4202-9c2f-3dfae93392e9" status: 200 len: 1462 microversion: 2.1 time: 0.362606 Sep 14 08:50:21.275464 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 254/553] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:50:20 2022] GET /compute/v2.1/servers/e4c51c69-8c2e-4202-9c2f-3dfae93392e9 => generated 1462 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:50:21.292458 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-68fb9bf7-5bdd-4212-b4ee-ca6e5350b2a9 tempest-SecurityGroupsTestAdminJSON-901672823 tempest-SecurityGroupsTestAdminJSON-901672823-project-admin] Action: 'create', calling method: .version_select at 0x7f7d449395e0>, body: {"security_group": {"name": "tempest-securitygroup-1644391946", "description": "tempest-description-2002079728"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:50:21.342393 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-abc58ce2-d202-4395-9b07-7be6d844fb81 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Flavor limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 08:50:21.343175 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-abc58ce2-d202-4395-9b07-7be6d844fb81 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Image limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 08:50:21.344563 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-abc58ce2-d202-4395-9b07-7be6d844fb81 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Flavor pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 08:50:21.345413 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-abc58ce2-d202-4395-9b07-7be6d844fb81 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Image pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 08:50:21.345975 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-abc58ce2-d202-4395-9b07-7be6d844fb81 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 08:50:21.364566 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-abc58ce2-d202-4395-9b07-7be6d844fb81 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:21.365183 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-abc58ce2-d202-4395-9b07-7be6d844fb81 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:21.366259 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-abc58ce2-d202-4395-9b07-7be6d844fb81 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:21.369153 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-abc58ce2-d202-4395-9b07-7be6d844fb81 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:21.375765 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-abc58ce2-d202-4395-9b07-7be6d844fb81 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:21.376567 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-abc58ce2-d202-4395-9b07-7be6d844fb81 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:21.413919 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-abc58ce2-d202-4395-9b07-7be6d844fb81 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Getting quotas for project a7342631eeb747ba831f1d8a20fb8bf3. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 08:50:21.421447 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-abc58ce2-d202-4395-9b07-7be6d844fb81 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Getting quotas for user cd713a1c3e7148ef8bfcbe44d1a80a18 and project a7342631eeb747ba831f1d8a20fb8bf3. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 08:50:21.442007 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-abc58ce2-d202-4395-9b07-7be6d844fb81 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Going to run 1 instances... {{(pid=128759) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 08:50:21.448062 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-abc58ce2-d202-4395-9b07-7be6d844fb81 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: 87a4e8b8-79db-43f6-be85-b738382e4699] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128759) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 08:50:21.520266 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-abc58ce2-d202-4395-9b07-7be6d844fb81 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.467370 Sep 14 08:50:21.530240 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 300/554] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 08:50:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1478 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 08:50:21.535810 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-cb4d46e5-e2f9-4836-b8bf-dfbf9375dfe7 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:50:21.536574 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-cb4d46e5-e2f9-4836-b8bf-dfbf9375dfe7 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] [instance: 2d2c444a-e84e-40c5-aec1-375cd14f67c8] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:50:21.543819 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cb4d46e5-e2f9-4836-b8bf-dfbf9375dfe7 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:21.544550 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cb4d46e5-e2f9-4836-b8bf-dfbf9375dfe7 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:21.545173 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cb4d46e5-e2f9-4836-b8bf-dfbf9375dfe7 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:21.546061 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cb4d46e5-e2f9-4836-b8bf-dfbf9375dfe7 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:21.546676 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cb4d46e5-e2f9-4836-b8bf-dfbf9375dfe7 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:21.547290 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cb4d46e5-e2f9-4836-b8bf-dfbf9375dfe7 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:21.592924 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-68fb9bf7-5bdd-4212-b4ee-ca6e5350b2a9 tempest-SecurityGroupsTestAdminJSON-901672823 tempest-SecurityGroupsTestAdminJSON-901672823-project-admin] 10.222.0.60 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.315946 Sep 14 08:50:21.595426 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 255/555] 10.222.0.60 () {60 vars in 1180 bytes} [Wed Sep 14 08:50:21 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:50:21.600595 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ea9e5c87-8f6f-4ef4-ac5f-a93730f20d5d tempest-ServersOnMultiNodesTest-1008135845 tempest-ServersOnMultiNodesTest-1008135845-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:50:21.601479 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-ea9e5c87-8f6f-4ef4-ac5f-a93730f20d5d tempest-ServersOnMultiNodesTest-1008135845 tempest-ServersOnMultiNodesTest-1008135845-project-admin] [instance: 3acd19ba-a5b9-4bac-a4a3-2c274448c374] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:50:21.614401 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ea9e5c87-8f6f-4ef4-ac5f-a93730f20d5d tempest-ServersOnMultiNodesTest-1008135845 tempest-ServersOnMultiNodesTest-1008135845-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:21.615318 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ea9e5c87-8f6f-4ef4-ac5f-a93730f20d5d tempest-ServersOnMultiNodesTest-1008135845 tempest-ServersOnMultiNodesTest-1008135845-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:21.616230 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ea9e5c87-8f6f-4ef4-ac5f-a93730f20d5d tempest-ServersOnMultiNodesTest-1008135845 tempest-ServersOnMultiNodesTest-1008135845-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:21.618253 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ea9e5c87-8f6f-4ef4-ac5f-a93730f20d5d tempest-ServersOnMultiNodesTest-1008135845 tempest-ServersOnMultiNodesTest-1008135845-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:21.619162 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ea9e5c87-8f6f-4ef4-ac5f-a93730f20d5d tempest-ServersOnMultiNodesTest-1008135845 tempest-ServersOnMultiNodesTest-1008135845-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:21.620882 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ea9e5c87-8f6f-4ef4-ac5f-a93730f20d5d tempest-ServersOnMultiNodesTest-1008135845 tempest-ServersOnMultiNodesTest-1008135845-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:21.755560 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-cb4d46e5-e2f9-4836-b8bf-dfbf9375dfe7 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] 10.222.0.60 "GET /compute/v2.1/servers/2d2c444a-e84e-40c5-aec1-375cd14f67c8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.223292 Sep 14 08:50:21.765143 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 301/556] 10.222.0.60 () {58 vars in 1275 bytes} [Wed Sep 14 08:50:21 2022] GET /compute/v2.1/servers/2d2c444a-e84e-40c5-aec1-375cd14f67c8/os-interface => generated 284 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:50:21.768441 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-60a5f320-c245-4fa2-aec6-7cebcf974a2f tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:50:21.770252 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-60a5f320-c245-4fa2-aec6-7cebcf974a2f tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: 5059f5d9-6903-4cf4-a999-01d2d2ba0842] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:50:21.786277 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-60a5f320-c245-4fa2-aec6-7cebcf974a2f tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:21.787468 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-60a5f320-c245-4fa2-aec6-7cebcf974a2f tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:21.789213 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-60a5f320-c245-4fa2-aec6-7cebcf974a2f tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:21.790602 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-60a5f320-c245-4fa2-aec6-7cebcf974a2f tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:21.791383 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-60a5f320-c245-4fa2-aec6-7cebcf974a2f tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:21.792156 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-60a5f320-c245-4fa2-aec6-7cebcf974a2f tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:22.127287 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:50:22.137847 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-ea9e5c87-8f6f-4ef4-ac5f-a93730f20d5d tempest-ServersOnMultiNodesTest-1008135845 tempest-ServersOnMultiNodesTest-1008135845-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/3acd19ba-a5b9-4bac-a4a3-2c274448c374" status: 200 len: 1620 microversion: 2.1 time: 0.540437 Sep 14 08:50:22.138706 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 256/557] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:50:21 2022] GET /compute/v2.1/servers/3acd19ba-a5b9-4bac-a4a3-2c274448c374 => generated 1620 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:50:22.152110 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-74b0f28f-da1c-4998-a1fd-09cf1517ef02 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Calling method '.version_select at 0x7f7d44982f70>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:50:22.248992 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-60a5f320-c245-4fa2-aec6-7cebcf974a2f tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:50:22.270527 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-60a5f320-c245-4fa2-aec6-7cebcf974a2f tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:50:22.275072 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-60a5f320-c245-4fa2-aec6-7cebcf974a2f tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:50:22.277241 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-60a5f320-c245-4fa2-aec6-7cebcf974a2f tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/5059f5d9-6903-4cf4-a999-01d2d2ba0842" status: 200 len: 1361 microversion: 2.25 time: 0.517108 Sep 14 08:50:22.306343 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 302/558] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:50:21 2022] GET /compute/v2.1/servers/5059f5d9-6903-4cf4-a999-01d2d2ba0842 => generated 1361 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:50:22.326927 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c764b7c5-36ba-4b33-bd8a-76e4c8e6ba54 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:50:22.336003 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-c764b7c5-36ba-4b33-bd8a-76e4c8e6ba54 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: e4c51c69-8c2e-4202-9c2f-3dfae93392e9] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:50:22.351031 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c764b7c5-36ba-4b33-bd8a-76e4c8e6ba54 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:22.353130 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c764b7c5-36ba-4b33-bd8a-76e4c8e6ba54 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:22.353585 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c764b7c5-36ba-4b33-bd8a-76e4c8e6ba54 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:22.358027 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c764b7c5-36ba-4b33-bd8a-76e4c8e6ba54 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:22.359223 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c764b7c5-36ba-4b33-bd8a-76e4c8e6ba54 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:22.359840 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c764b7c5-36ba-4b33-bd8a-76e4c8e6ba54 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:22.509131 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-c764b7c5-36ba-4b33-bd8a-76e4c8e6ba54 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:50:22.526852 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-c764b7c5-36ba-4b33-bd8a-76e4c8e6ba54 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: e4c51c69-8c2e-4202-9c2f-3dfae93392e9] Old instance type m1.heat2, new instance type m1.heat {{(pid=128759) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 14 08:50:22.548401 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-c764b7c5-36ba-4b33-bd8a-76e4c8e6ba54 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Flavor limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 08:50:22.549890 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-c764b7c5-36ba-4b33-bd8a-76e4c8e6ba54 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Image limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 08:50:22.553279 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-c764b7c5-36ba-4b33-bd8a-76e4c8e6ba54 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Flavor pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 08:50:22.553879 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-c764b7c5-36ba-4b33-bd8a-76e4c8e6ba54 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Image pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 08:50:22.555908 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-c764b7c5-36ba-4b33-bd8a-76e4c8e6ba54 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 08:50:22.750025 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-c764b7c5-36ba-4b33-bd8a-76e4c8e6ba54 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "POST /compute/v2.1/servers/e4c51c69-8c2e-4202-9c2f-3dfae93392e9/action" status: 202 len: 0 microversion: 2.1 time: 0.431714 Sep 14 08:50:22.754111 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 303/559] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 08:50:22 2022] POST /compute/v2.1/servers/e4c51c69-8c2e-4202-9c2f-3dfae93392e9/action => generated 0 bytes in 447 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 08:50:22.759196 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b04a5afc-9aa5-4826-9175-2d47f26bc44a tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:50:22.760044 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b04a5afc-9aa5-4826-9175-2d47f26bc44a tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: 87a4e8b8-79db-43f6-be85-b738382e4699] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:50:22.766699 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b04a5afc-9aa5-4826-9175-2d47f26bc44a tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:22.767452 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b04a5afc-9aa5-4826-9175-2d47f26bc44a tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:22.768067 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b04a5afc-9aa5-4826-9175-2d47f26bc44a tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:22.768957 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b04a5afc-9aa5-4826-9175-2d47f26bc44a tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:22.769733 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b04a5afc-9aa5-4826-9175-2d47f26bc44a tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:22.770320 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b04a5afc-9aa5-4826-9175-2d47f26bc44a tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:23.148772 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b04a5afc-9aa5-4826-9175-2d47f26bc44a tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:50:23.163141 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b04a5afc-9aa5-4826-9175-2d47f26bc44a tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/87a4e8b8-79db-43f6-be85-b738382e4699" status: 200 len: 1263 microversion: 2.1 time: 0.407750 Sep 14 08:50:23.163926 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 304/560] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:50:22 2022] GET /compute/v2.1/servers/87a4e8b8-79db-43f6-be85-b738382e4699 => generated 1263 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:50:23.176233 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c3151e59-d9b9-431d-aae1-cd94a774c9a6 tempest-SecurityGroupsTestAdminJSON-901672823 tempest-SecurityGroupsTestAdminJSON-901672823-project-admin] Calling method '.version_select at 0x7f7d4481da60>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:50:25.802982 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-74b0f28f-da1c-4998-a1fd-09cf1517ef02 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] 10.222.0.60 "DELETE /compute/v2.1/os-floating-ips/5367e7a6-ddfe-4f75-84b5-2b626e4421c4" status: 202 len: 0 microversion: 2.1 time: 3.662648 Sep 14 08:50:25.804182 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 257/561] 10.222.0.60 () {58 vars in 1263 bytes} [Wed Sep 14 08:50:22 2022] DELETE /compute/v2.1/os-floating-ips/5367e7a6-ddfe-4f75-84b5-2b626e4421c4 => generated 0 bytes in 3665 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 08:50:25.811442 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-62e081cf-afb2-4731-bfba-6fe922bd8b5a tempest-ServersOnMultiNodesTest-1008135845 tempest-ServersOnMultiNodesTest-1008135845-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:50:25.812319 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-62e081cf-afb2-4731-bfba-6fe922bd8b5a tempest-ServersOnMultiNodesTest-1008135845 tempest-ServersOnMultiNodesTest-1008135845-project-admin] [instance: 9507f778-dd44-4db1-b36e-fecd603b2487] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:50:25.825258 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-62e081cf-afb2-4731-bfba-6fe922bd8b5a tempest-ServersOnMultiNodesTest-1008135845 tempest-ServersOnMultiNodesTest-1008135845-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:25.825758 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-62e081cf-afb2-4731-bfba-6fe922bd8b5a tempest-ServersOnMultiNodesTest-1008135845 tempest-ServersOnMultiNodesTest-1008135845-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:25.826407 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-62e081cf-afb2-4731-bfba-6fe922bd8b5a tempest-ServersOnMultiNodesTest-1008135845 tempest-ServersOnMultiNodesTest-1008135845-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:25.827422 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-62e081cf-afb2-4731-bfba-6fe922bd8b5a tempest-ServersOnMultiNodesTest-1008135845 tempest-ServersOnMultiNodesTest-1008135845-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:25.828242 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-62e081cf-afb2-4731-bfba-6fe922bd8b5a tempest-ServersOnMultiNodesTest-1008135845 tempest-ServersOnMultiNodesTest-1008135845-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:25.828891 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-62e081cf-afb2-4731-bfba-6fe922bd8b5a tempest-ServersOnMultiNodesTest-1008135845 tempest-ServersOnMultiNodesTest-1008135845-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:26.266825 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-62e081cf-afb2-4731-bfba-6fe922bd8b5a tempest-ServersOnMultiNodesTest-1008135845 tempest-ServersOnMultiNodesTest-1008135845-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/9507f778-dd44-4db1-b36e-fecd603b2487" status: 200 len: 1622 microversion: 2.1 time: 0.460918 Sep 14 08:50:26.288106 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 258/562] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:50:25 2022] GET /compute/v2.1/servers/9507f778-dd44-4db1-b36e-fecd603b2487 => generated 1622 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:50:26.294446 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-de9681eb-6b9a-42b2-97b5-7dde52aacf76 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:50:26.295177 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-de9681eb-6b9a-42b2-97b5-7dde52aacf76 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: e4c51c69-8c2e-4202-9c2f-3dfae93392e9] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:50:26.302150 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-de9681eb-6b9a-42b2-97b5-7dde52aacf76 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:26.302651 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-de9681eb-6b9a-42b2-97b5-7dde52aacf76 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:26.303123 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-de9681eb-6b9a-42b2-97b5-7dde52aacf76 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:26.303831 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-de9681eb-6b9a-42b2-97b5-7dde52aacf76 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:26.304476 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-de9681eb-6b9a-42b2-97b5-7dde52aacf76 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:26.304903 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-de9681eb-6b9a-42b2-97b5-7dde52aacf76 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:26.740381 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-de9681eb-6b9a-42b2-97b5-7dde52aacf76 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:50:26.750267 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-de9681eb-6b9a-42b2-97b5-7dde52aacf76 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/e4c51c69-8c2e-4202-9c2f-3dfae93392e9" status: 200 len: 1476 microversion: 2.1 time: 0.460427 Sep 14 08:50:26.750833 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 259/563] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:50:26 2022] GET /compute/v2.1/servers/e4c51c69-8c2e-4202-9c2f-3dfae93392e9 => generated 1476 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:50:26.766153 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-875b30db-7669-4872-baa2-d25d08dc0762 req-a0b454a4-dc66-4ae8-85e7-8d8f26d6c9cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5059f5d9-6903-4cf4-a999-01d2d2ba0842", "name": "network-vif-plugged", "status": "completed", "tag": "0b18a372-58a0-4acd-a4e8-de3db7d03c42"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:50:26.776525 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-875b30db-7669-4872-baa2-d25d08dc0762 req-a0b454a4-dc66-4ae8-85e7-8d8f26d6c9cc service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:26.777026 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-875b30db-7669-4872-baa2-d25d08dc0762 req-a0b454a4-dc66-4ae8-85e7-8d8f26d6c9cc service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:26.777525 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-875b30db-7669-4872-baa2-d25d08dc0762 req-a0b454a4-dc66-4ae8-85e7-8d8f26d6c9cc service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:26.788721 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-875b30db-7669-4872-baa2-d25d08dc0762 req-a0b454a4-dc66-4ae8-85e7-8d8f26d6c9cc service nova] Creating event network-vif-plugged:0b18a372-58a0-4acd-a4e8-de3db7d03c42 for instance 5059f5d9-6903-4cf4-a999-01d2d2ba0842 on n-h2-836830-18 Sep 14 08:50:26.794102 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-875b30db-7669-4872-baa2-d25d08dc0762 req-a0b454a4-dc66-4ae8-85e7-8d8f26d6c9cc service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032758 Sep 14 08:50:26.795443 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 260/564] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:50:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:50:26.801903 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-18d4dbad-d473-468a-9298-f6a5a8b2d60e tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:50:26.802994 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-18d4dbad-d473-468a-9298-f6a5a8b2d60e tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: 5059f5d9-6903-4cf4-a999-01d2d2ba0842] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:50:26.810311 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-18d4dbad-d473-468a-9298-f6a5a8b2d60e tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:26.811131 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-18d4dbad-d473-468a-9298-f6a5a8b2d60e tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:26.811783 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-18d4dbad-d473-468a-9298-f6a5a8b2d60e tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:26.812903 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-18d4dbad-d473-468a-9298-f6a5a8b2d60e tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:26.813594 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-18d4dbad-d473-468a-9298-f6a5a8b2d60e tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:26.814229 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-18d4dbad-d473-468a-9298-f6a5a8b2d60e tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:27.490951 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-18d4dbad-d473-468a-9298-f6a5a8b2d60e tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:50:27.501137 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-18d4dbad-d473-468a-9298-f6a5a8b2d60e tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:50:27.503653 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-18d4dbad-d473-468a-9298-f6a5a8b2d60e tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:50:27.504796 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-18d4dbad-d473-468a-9298-f6a5a8b2d60e tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/5059f5d9-6903-4cf4-a999-01d2d2ba0842" status: 200 len: 1361 microversion: 2.25 time: 0.707954 Sep 14 08:50:27.505563 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 261/565] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:50:26 2022] GET /compute/v2.1/servers/5059f5d9-6903-4cf4-a999-01d2d2ba0842 => generated 1361 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:50:27.510706 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-49213467-f7be-45c4-a5c0-83260517944e tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:50:27.511548 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-49213467-f7be-45c4-a5c0-83260517944e tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: 87a4e8b8-79db-43f6-be85-b738382e4699] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:50:27.519873 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-49213467-f7be-45c4-a5c0-83260517944e tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:27.520526 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-49213467-f7be-45c4-a5c0-83260517944e tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:27.521633 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-49213467-f7be-45c4-a5c0-83260517944e tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:27.522657 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-49213467-f7be-45c4-a5c0-83260517944e tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:27.523301 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-49213467-f7be-45c4-a5c0-83260517944e tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:27.523883 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-49213467-f7be-45c4-a5c0-83260517944e tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:27.789335 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=2 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:50:27.843981 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-49213467-f7be-45c4-a5c0-83260517944e tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:50:27.859396 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-49213467-f7be-45c4-a5c0-83260517944e tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/87a4e8b8-79db-43f6-be85-b738382e4699" status: 200 len: 1311 microversion: 2.1 time: 0.352617 Sep 14 08:50:27.871377 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 262/566] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:50:27 2022] GET /compute/v2.1/servers/87a4e8b8-79db-43f6-be85-b738382e4699 => generated 1311 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:50:27.877556 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-352d6a3b-c995-4836-8ada-7eaa3ff9a1f2 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Action: 'action', calling method: .version_select at 0x7f7d460c34c0>, body: {"removeFloatingIp": {"address": "172.25.9.85"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:50:28.139350 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=2 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:50:28.191410 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-352d6a3b-c995-4836-8ada-7eaa3ff9a1f2 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] [instance: c402c828-5101-40cc-8ac8-b3d1470028ed] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:50:28.199035 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-352d6a3b-c995-4836-8ada-7eaa3ff9a1f2 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:28.199721 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-352d6a3b-c995-4836-8ada-7eaa3ff9a1f2 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:28.200460 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-352d6a3b-c995-4836-8ada-7eaa3ff9a1f2 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:28.204114 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-352d6a3b-c995-4836-8ada-7eaa3ff9a1f2 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:28.204803 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-352d6a3b-c995-4836-8ada-7eaa3ff9a1f2 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:28.205392 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-352d6a3b-c995-4836-8ada-7eaa3ff9a1f2 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:28.796029 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-352d6a3b-c995-4836-8ada-7eaa3ff9a1f2 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Acquiring lock "refresh_cache-c402c828-5101-40cc-8ac8-b3d1470028ed" {{(pid=128758) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 14 08:50:28.796987 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-352d6a3b-c995-4836-8ada-7eaa3ff9a1f2 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Acquired lock "refresh_cache-c402c828-5101-40cc-8ac8-b3d1470028ed" {{(pid=128758) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 14 08:50:30.070191 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.network.neutron [None req-352d6a3b-c995-4836-8ada-7eaa3ff9a1f2 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] [instance: c402c828-5101-40cc-8ac8-b3d1470028ed] Building network info cache for instance {{(pid=128758) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 14 08:50:31.143427 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.network.neutron [None req-352d6a3b-c995-4836-8ada-7eaa3ff9a1f2 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] [instance: c402c828-5101-40cc-8ac8-b3d1470028ed] Updating instance_info_cache with network_info: [{"id": "16038378-4ff2-47f4-881a-cf785e164719", "address": "fa:16:3e:df:24:7c", "network": {"id": "cb8bf0a7-4184-4ca4-bffa-150d2b18bef7", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-2031436314-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "919dd9619fb24ee281cf6d96cf3351df", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap16038378-4f", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128758) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 14 08:50:31.155576 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-352d6a3b-c995-4836-8ada-7eaa3ff9a1f2 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Releasing lock "refresh_cache-c402c828-5101-40cc-8ac8-b3d1470028ed" {{(pid=128758) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 14 08:50:31.156861 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-352d6a3b-c995-4836-8ada-7eaa3ff9a1f2 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] 10.222.0.60 "POST /compute/v2.1/servers/c402c828-5101-40cc-8ac8-b3d1470028ed/action" status: 202 len: 0 microversion: 2.1 time: 3.284213 Sep 14 08:50:31.161306 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 263/567] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 08:50:27 2022] POST /compute/v2.1/servers/c402c828-5101-40cc-8ac8-b3d1470028ed/action => generated 0 bytes in 3287 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 14 08:50:31.169332 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-f851e9b3-f965-40a6-87ed-15f9dd536f5f tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:50:31.172707 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-f851e9b3-f965-40a6-87ed-15f9dd536f5f tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] [instance: 2d2c444a-e84e-40c5-aec1-375cd14f67c8] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:50:31.187630 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f851e9b3-f965-40a6-87ed-15f9dd536f5f tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:31.188369 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f851e9b3-f965-40a6-87ed-15f9dd536f5f tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:31.188978 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f851e9b3-f965-40a6-87ed-15f9dd536f5f tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:31.192727 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f851e9b3-f965-40a6-87ed-15f9dd536f5f tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:31.193383 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f851e9b3-f965-40a6-87ed-15f9dd536f5f tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:31.193986 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f851e9b3-f965-40a6-87ed-15f9dd536f5f tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:31.207450 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-c3151e59-d9b9-431d-aae1-cd94a774c9a6 tempest-SecurityGroupsTestAdminJSON-901672823 tempest-SecurityGroupsTestAdminJSON-901672823-project-admin] 10.222.0.60 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 13111 microversion: 2.1 time: 8.041529 Sep 14 08:50:31.208045 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 305/568] 10.222.0.60 () {58 vars in 1191 bytes} [Wed Sep 14 08:50:23 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 13111 bytes in 8043 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 08:50:31.213234 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-fe67a6ad-26e1-4d55-9299-c49a84b241cb tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Action: 'create', calling method: .version_select at 0x7f7d44bd28b0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1535598474", "policies": ["anti-affinity"]}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:50:31.266222 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-fe67a6ad-26e1-4d55-9299-c49a84b241cb tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Getting quotas for project 5e326f95a9604fdb9bd075db3837cf62. Resources: {'server_groups'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 08:50:31.287014 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-fe67a6ad-26e1-4d55-9299-c49a84b241cb tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Getting quotas for user 89c7802984cf48d1852832b52abe52e9 and project 5e326f95a9604fdb9bd075db3837cf62. Resources: {'server_groups'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 08:50:31.362404 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-fe67a6ad-26e1-4d55-9299-c49a84b241cb tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Getting quotas for project 5e326f95a9604fdb9bd075db3837cf62. Resources: {'server_groups'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 08:50:31.368385 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-fe67a6ad-26e1-4d55-9299-c49a84b241cb tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Getting quotas for user 89c7802984cf48d1852832b52abe52e9 and project 5e326f95a9604fdb9bd075db3837cf62. Resources: {'server_groups'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 08:50:31.385801 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-fe67a6ad-26e1-4d55-9299-c49a84b241cb tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] 10.222.0.60 "POST /compute/v2.1/os-server-groups" status: 200 len: 193 microversion: 2.1 time: 0.176515 Sep 14 08:50:31.391454 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 306/569] 10.222.0.60 () {60 vars in 1174 bytes} [Wed Sep 14 08:50:31 2022] POST /compute/v2.1/os-server-groups => generated 193 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:50:31.397663 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-356d5d45-6186-4ed2-9bd0-eace7f4384c2 req-c3206291-c166-4c6d-ba4d-275fe3bc663b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d2c444a-e84e-40c5-aec1-375cd14f67c8", "tag": "19ff01df-4500-4f30-970d-7bee0d4b0a4f"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:50:31.433776 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=2 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:50:31.440435 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-356d5d45-6186-4ed2-9bd0-eace7f4384c2 req-c3206291-c166-4c6d-ba4d-275fe3bc663b service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:31.441758 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-356d5d45-6186-4ed2-9bd0-eace7f4384c2 req-c3206291-c166-4c6d-ba4d-275fe3bc663b service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:31.442981 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-356d5d45-6186-4ed2-9bd0-eace7f4384c2 req-c3206291-c166-4c6d-ba4d-275fe3bc663b service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:31.462627 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-f851e9b3-f965-40a6-87ed-15f9dd536f5f tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b938da87b14cd79c3c6dd85818cd02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee17e19b2f094a899dfc8966152fd642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:50:31.471811 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-f851e9b3-f965-40a6-87ed-15f9dd536f5f tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] 10.222.0.60 "GET /compute/v2.1/servers/2d2c444a-e84e-40c5-aec1-375cd14f67c8" status: 200 len: 1586 microversion: 2.1 time: 0.308905 Sep 14 08:50:31.478104 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 264/570] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:50:31 2022] GET /compute/v2.1/servers/2d2c444a-e84e-40c5-aec1-375cd14f67c8 => generated 1586 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:50:31.480501 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-356d5d45-6186-4ed2-9bd0-eace7f4384c2 req-c3206291-c166-4c6d-ba4d-275fe3bc663b service nova] Creating event network-changed:19ff01df-4500-4f30-970d-7bee0d4b0a4f for instance 2d2c444a-e84e-40c5-aec1-375cd14f67c8 on n-h1-836830-18 Sep 14 08:50:31.486344 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-356d5d45-6186-4ed2-9bd0-eace7f4384c2 req-c3206291-c166-4c6d-ba4d-275fe3bc663b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093381 Sep 14 08:50:31.488571 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-4d1d7028-67f3-4247-9873-50283f10d1eb tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:50:31.489185 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-4d1d7028-67f3-4247-9873-50283f10d1eb tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: e4c51c69-8c2e-4202-9c2f-3dfae93392e9] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:50:31.491348 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 307/571] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:50:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:50:31.497001 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b6b8f718-6880-4a86-8588-ac8d828b94f2 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:50:31.497891 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b6b8f718-6880-4a86-8588-ac8d828b94f2 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: 5059f5d9-6903-4cf4-a999-01d2d2ba0842] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:50:31.504547 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4d1d7028-67f3-4247-9873-50283f10d1eb tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:31.504986 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:50:31.506433 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4d1d7028-67f3-4247-9873-50283f10d1eb tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:31.506901 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4d1d7028-67f3-4247-9873-50283f10d1eb tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:31.507618 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4d1d7028-67f3-4247-9873-50283f10d1eb tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:31.507786 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b6b8f718-6880-4a86-8588-ac8d828b94f2 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:31.508071 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4d1d7028-67f3-4247-9873-50283f10d1eb tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:31.508494 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4d1d7028-67f3-4247-9873-50283f10d1eb tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:31.508799 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b6b8f718-6880-4a86-8588-ac8d828b94f2 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:31.509410 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b6b8f718-6880-4a86-8588-ac8d828b94f2 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:31.510448 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b6b8f718-6880-4a86-8588-ac8d828b94f2 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:31.511428 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b6b8f718-6880-4a86-8588-ac8d828b94f2 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:31.512029 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b6b8f718-6880-4a86-8588-ac8d828b94f2 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:31.764304 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b6b8f718-6880-4a86-8588-ac8d828b94f2 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:50:31.768384 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-4d1d7028-67f3-4247-9873-50283f10d1eb tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:50:31.779686 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b6b8f718-6880-4a86-8588-ac8d828b94f2 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:50:31.781149 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b6b8f718-6880-4a86-8588-ac8d828b94f2 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:50:31.785800 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-4d1d7028-67f3-4247-9873-50283f10d1eb tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/e4c51c69-8c2e-4202-9c2f-3dfae93392e9" status: 200 len: 1476 microversion: 2.1 time: 0.306067 Sep 14 08:50:31.786709 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 265/572] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:50:31 2022] GET /compute/v2.1/servers/e4c51c69-8c2e-4202-9c2f-3dfae93392e9 => generated 1476 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:50:31.791379 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-5cdfce5c-1861-4ff7-befd-e2bc35f495ba tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:50:31.792876 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b6b8f718-6880-4a86-8588-ac8d828b94f2 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/5059f5d9-6903-4cf4-a999-01d2d2ba0842" status: 200 len: 1556 microversion: 2.25 time: 0.300169 Sep 14 08:50:31.793898 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 308/573] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:50:31 2022] GET /compute/v2.1/servers/5059f5d9-6903-4cf4-a999-01d2d2ba0842 => generated 1556 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:50:31.795824 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-5cdfce5c-1861-4ff7-befd-e2bc35f495ba tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: 87a4e8b8-79db-43f6-be85-b738382e4699] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:50:31.819796 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5cdfce5c-1861-4ff7-befd-e2bc35f495ba tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:31.822834 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5cdfce5c-1861-4ff7-befd-e2bc35f495ba tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:31.823838 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5cdfce5c-1861-4ff7-befd-e2bc35f495ba tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:31.824560 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5cdfce5c-1861-4ff7-befd-e2bc35f495ba tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:31.825017 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5cdfce5c-1861-4ff7-befd-e2bc35f495ba tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:31.825441 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5cdfce5c-1861-4ff7-befd-e2bc35f495ba tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:31.895993 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-38eda901-01b6-4952-80ad-39ecc1916763 tempest-FloatingIPsTestJSON-1993878692 tempest-FloatingIPsTestJSON-1993878692-project] Action: 'create', calling method: .version_select at 0x7f7d44796670>, body: {"pool": null} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:50:32.198046 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-5cdfce5c-1861-4ff7-befd-e2bc35f495ba tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:50:32.207322 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-5cdfce5c-1861-4ff7-befd-e2bc35f495ba tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/87a4e8b8-79db-43f6-be85-b738382e4699" status: 200 len: 1311 microversion: 2.1 time: 0.419319 Sep 14 08:50:32.207992 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 266/574] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:50:31 2022] GET /compute/v2.1/servers/87a4e8b8-79db-43f6-be85-b738382e4699 => generated 1311 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:50:32.216250 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-828be015-6a5c-4251-9474-1d8a82695991 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Calling method '.version_select at 0x7f7d44cc79d0>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:50:34.071652 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-828be015-6a5c-4251-9474-1d8a82695991 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] 10.222.0.60 "DELETE /compute/v2.1/os-floating-ips/16aed796-3cf4-43d8-8d00-7fb999b1a8a8" status: 202 len: 0 microversion: 2.1 time: 1.861991 Sep 14 08:50:34.077434 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 267/575] 10.222.0.60 () {58 vars in 1263 bytes} [Wed Sep 14 08:50:32 2022] DELETE /compute/v2.1/os-floating-ips/16aed796-3cf4-43d8-8d00-7fb999b1a8a8 => generated 0 bytes in 1869 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 08:50:34.082174 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-083aef57-db4f-4ba2-8c2f-c6da76567a52 tempest-SecurityGroupsTestAdminJSON-485934421 tempest-SecurityGroupsTestAdminJSON-485934421-project] Calling method '.version_select at 0x7f7d4494c670>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:50:34.478964 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-083aef57-db4f-4ba2-8c2f-c6da76567a52 tempest-SecurityGroupsTestAdminJSON-485934421 tempest-SecurityGroupsTestAdminJSON-485934421-project] 10.222.0.60 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1110 microversion: 2.1 time: 0.400349 Sep 14 08:50:34.479676 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 268/576] 10.222.0.60 () {58 vars in 1191 bytes} [Wed Sep 14 08:50:34 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1110 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:50:34.484810 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-4a56c9f2-c2e4-41f0-98ba-4f115ebe3fa2 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-2096309247", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "8d4e2809-5c95-42e0-8d35-a7c2aa5ab958"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:50:34.543220 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.network.neutron [None req-4a56c9f2-c2e4-41f0-98ba-4f115ebe3fa2 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] validate_networks() for None {{(pid=128758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 08:50:34.546515 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-38eda901-01b6-4952-80ad-39ecc1916763 tempest-FloatingIPsTestJSON-1993878692 tempest-FloatingIPsTestJSON-1993878692-project] 10.222.0.60 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.751433 Sep 14 08:50:34.547222 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 309/577] 10.222.0.60 () {60 vars in 1170 bytes} [Wed Sep 14 08:50:31 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2753 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:50:34.684554 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-0161bb25-9e82-4b21-88af-85986cdf9bc4 tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:50:34.685418 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-0161bb25-9e82-4b21-88af-85986cdf9bc4 tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] [instance: 5059f5d9-6903-4cf4-a999-01d2d2ba0842] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:50:34.691987 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0161bb25-9e82-4b21-88af-85986cdf9bc4 tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:34.693282 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0161bb25-9e82-4b21-88af-85986cdf9bc4 tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:34.694086 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0161bb25-9e82-4b21-88af-85986cdf9bc4 tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:34.694876 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0161bb25-9e82-4b21-88af-85986cdf9bc4 tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:34.695553 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0161bb25-9e82-4b21-88af-85986cdf9bc4 tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:34.696185 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0161bb25-9e82-4b21-88af-85986cdf9bc4 tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:34.810527 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-4a56c9f2-c2e4-41f0-98ba-4f115ebe3fa2 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Flavor limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 08:50:34.812310 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-4a56c9f2-c2e4-41f0-98ba-4f115ebe3fa2 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Image limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 08:50:34.813084 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-4a56c9f2-c2e4-41f0-98ba-4f115ebe3fa2 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Flavor pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 08:50:34.813909 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-4a56c9f2-c2e4-41f0-98ba-4f115ebe3fa2 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Image pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 08:50:34.814562 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-4a56c9f2-c2e4-41f0-98ba-4f115ebe3fa2 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 08:50:34.830559 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4a56c9f2-c2e4-41f0-98ba-4f115ebe3fa2 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:34.831348 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4a56c9f2-c2e4-41f0-98ba-4f115ebe3fa2 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:34.831992 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4a56c9f2-c2e4-41f0-98ba-4f115ebe3fa2 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:34.832821 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4a56c9f2-c2e4-41f0-98ba-4f115ebe3fa2 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:34.833345 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4a56c9f2-c2e4-41f0-98ba-4f115ebe3fa2 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:34.833969 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4a56c9f2-c2e4-41f0-98ba-4f115ebe3fa2 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:34.857735 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-4a56c9f2-c2e4-41f0-98ba-4f115ebe3fa2 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Getting quotas for project 5e326f95a9604fdb9bd075db3837cf62. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 08:50:34.872245 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-4a56c9f2-c2e4-41f0-98ba-4f115ebe3fa2 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Getting quotas for user 89c7802984cf48d1852832b52abe52e9 and project 5e326f95a9604fdb9bd075db3837cf62. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 08:50:34.874147 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.objects.instance [None req-0161bb25-9e82-4b21-88af-85986cdf9bc4 tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Lazy-loading 'services' on Instance uuid 5059f5d9-6903-4cf4-a999-01d2d2ba0842 {{(pid=128759) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 08:50:34.887844 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-4a56c9f2-c2e4-41f0-98ba-4f115ebe3fa2 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Going to run 2 instances... {{(pid=128758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 08:50:34.890393 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-4a56c9f2-c2e4-41f0-98ba-4f115ebe3fa2 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] [instance: 42265ff9-9c1f-45b6-b92d-0b23de43a8d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 08:50:34.939601 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-4a56c9f2-c2e4-41f0-98ba-4f115ebe3fa2 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=128758) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Sep 14 08:50:34.966592 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-4a56c9f2-c2e4-41f0-98ba-4f115ebe3fa2 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Getting quotas for project 5e326f95a9604fdb9bd075db3837cf62. Resources: {'server_group_members'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 08:50:34.972976 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-4a56c9f2-c2e4-41f0-98ba-4f115ebe3fa2 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Getting quotas for user 89c7802984cf48d1852832b52abe52e9 and project 5e326f95a9604fdb9bd075db3837cf62. Resources: {'server_group_members'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 08:50:35.023545 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-4a56c9f2-c2e4-41f0-98ba-4f115ebe3fa2 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Getting quotas for project 5e326f95a9604fdb9bd075db3837cf62. Resources: {'server_group_members'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 08:50:35.031781 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-4a56c9f2-c2e4-41f0-98ba-4f115ebe3fa2 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Getting quotas for user 89c7802984cf48d1852832b52abe52e9 and project 5e326f95a9604fdb9bd075db3837cf62. Resources: {'server_group_members'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 08:50:35.046444 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-4a56c9f2-c2e4-41f0-98ba-4f115ebe3fa2 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] [instance: 3f9e2d1a-9899-4046-b2af-939db32442b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=42265ff9-9c1f-45b6-b92d-0b23de43a8d0,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 08:50:35.079801 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:50:35.097079 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-4a56c9f2-c2e4-41f0-98ba-4f115ebe3fa2 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Getting quotas for project 5e326f95a9604fdb9bd075db3837cf62. Resources: {'server_group_members'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 08:50:35.097648 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-0161bb25-9e82-4b21-88af-85986cdf9bc4 tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/5059f5d9-6903-4cf4-a999-01d2d2ba0842" status: 200 len: 2050 microversion: 2.25 time: 0.549390 Sep 14 08:50:35.098223 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 310/578] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:50:34 2022] GET /compute/v2.1/servers/5059f5d9-6903-4cf4-a999-01d2d2ba0842 => generated 2050 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:50:35.111106 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-4a56c9f2-c2e4-41f0-98ba-4f115ebe3fa2 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Getting quotas for user 89c7802984cf48d1852832b52abe52e9 and project 5e326f95a9604fdb9bd075db3837cf62. Resources: {'server_group_members'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 08:50:35.111252 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f1304cd8-8d1c-4124-b3a6-4cbd14bc87c4 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:50:35.111252 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f1304cd8-8d1c-4124-b3a6-4cbd14bc87c4 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: e4c51c69-8c2e-4202-9c2f-3dfae93392e9] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:50:35.111252 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f1304cd8-8d1c-4124-b3a6-4cbd14bc87c4 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:35.111252 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f1304cd8-8d1c-4124-b3a6-4cbd14bc87c4 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:35.111635 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f1304cd8-8d1c-4124-b3a6-4cbd14bc87c4 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:35.111635 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f1304cd8-8d1c-4124-b3a6-4cbd14bc87c4 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:35.111635 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f1304cd8-8d1c-4124-b3a6-4cbd14bc87c4 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:35.111635 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f1304cd8-8d1c-4124-b3a6-4cbd14bc87c4 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:35.141173 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-4a56c9f2-c2e4-41f0-98ba-4f115ebe3fa2 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Getting quotas for project 5e326f95a9604fdb9bd075db3837cf62. Resources: {'server_group_members'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 08:50:35.146098 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-4a56c9f2-c2e4-41f0-98ba-4f115ebe3fa2 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Getting quotas for user 89c7802984cf48d1852832b52abe52e9 and project 5e326f95a9604fdb9bd075db3837cf62. Resources: {'server_group_members'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 08:50:35.181309 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-4a56c9f2-c2e4-41f0-98ba-4f115ebe3fa2 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 0.700265 Sep 14 08:50:35.182444 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 269/579] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 08:50:34 2022] POST /compute/v2.1/servers => generated 32 bytes in 702 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Sep 14 08:50:35.186969 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-90f45b83-c068-4542-93e2-d8667be878a9 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:50:35.187618 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-90f45b83-c068-4542-93e2-d8667be878a9 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: 87a4e8b8-79db-43f6-be85-b738382e4699] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:50:35.194158 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-90f45b83-c068-4542-93e2-d8667be878a9 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:35.194825 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-90f45b83-c068-4542-93e2-d8667be878a9 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:35.195288 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-90f45b83-c068-4542-93e2-d8667be878a9 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:35.195991 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-90f45b83-c068-4542-93e2-d8667be878a9 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:35.196446 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-90f45b83-c068-4542-93e2-d8667be878a9 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:35.196874 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-90f45b83-c068-4542-93e2-d8667be878a9 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:35.310230 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f1304cd8-8d1c-4124-b3a6-4cbd14bc87c4 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:50:35.318791 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f1304cd8-8d1c-4124-b3a6-4cbd14bc87c4 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/e4c51c69-8c2e-4202-9c2f-3dfae93392e9" status: 200 len: 1476 microversion: 2.1 time: 0.219576 Sep 14 08:50:35.319367 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 311/580] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:50:35 2022] GET /compute/v2.1/servers/e4c51c69-8c2e-4202-9c2f-3dfae93392e9 => generated 1476 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:50:35.327512 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-4e49cd40-98f7-4119-b867-d23b1642ac69 req-e09cb286-3841-49c0-861f-ca9add4c1f3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87a4e8b8-79db-43f6-be85-b738382e4699", "tag": "94536d67-6c5b-4f6a-b61f-3534a3426e05"}, {"name": "network-changed", "server_uuid": "c402c828-5101-40cc-8ac8-b3d1470028ed", "tag": "16038378-4ff2-47f4-881a-cf785e164719"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:50:35.338450 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-4e49cd40-98f7-4119-b867-d23b1642ac69 req-e09cb286-3841-49c0-861f-ca9add4c1f3e service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:35.338925 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-4e49cd40-98f7-4119-b867-d23b1642ac69 req-e09cb286-3841-49c0-861f-ca9add4c1f3e service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:35.339394 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-4e49cd40-98f7-4119-b867-d23b1642ac69 req-e09cb286-3841-49c0-861f-ca9add4c1f3e service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:35.352903 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-4e49cd40-98f7-4119-b867-d23b1642ac69 req-e09cb286-3841-49c0-861f-ca9add4c1f3e service nova] Creating event network-changed:94536d67-6c5b-4f6a-b61f-3534a3426e05 for instance 87a4e8b8-79db-43f6-be85-b738382e4699 on n-h1-836830-18 Sep 14 08:50:35.353945 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-4e49cd40-98f7-4119-b867-d23b1642ac69 req-e09cb286-3841-49c0-861f-ca9add4c1f3e service nova] Creating event network-changed:16038378-4ff2-47f4-881a-cf785e164719 for instance c402c828-5101-40cc-8ac8-b3d1470028ed on n-h1-836830-18 Sep 14 08:50:35.360698 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-4e49cd40-98f7-4119-b867-d23b1642ac69 req-e09cb286-3841-49c0-861f-ca9add4c1f3e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.040020 Sep 14 08:50:35.361288 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 312/581] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:50:35 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:50:35.366669 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ff468ddf-a1fa-4725-be55-64d4fcdf4d31 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Action: 'action', calling method: .version_select at 0x7f7d460c3310>, body: {"addFloatingIp": {"address": ""}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:50:35.375368 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-90f45b83-c068-4542-93e2-d8667be878a9 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:50:35.383491 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-90f45b83-c068-4542-93e2-d8667be878a9 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/87a4e8b8-79db-43f6-be85-b738382e4699" status: 200 len: 1311 microversion: 2.1 time: 0.200005 Sep 14 08:50:35.384072 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 270/582] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:50:35 2022] GET /compute/v2.1/servers/87a4e8b8-79db-43f6-be85-b738382e4699 => generated 1311 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:50:35.385129 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ff468ddf-a1fa-4725-be55-64d4fcdf4d31 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Request method failure captured: Sep 14 08:50:35.385129 n-d-836830-18 devstack@n-api.service[128759]: request: POST /compute/v2.1/servers/c402c828-5101-40cc-8ac8-b3d1470028ed/action HTTP/1.1 Sep 14 08:50:35.385129 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 08:50:35.385129 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 08:50:35.385129 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 08:50:35.385129 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 34 Sep 14 08:50:35.385129 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 08:50:35.385129 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 08:50:35.385129 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 08:50:35.385129 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 08:50:35.385129 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZWTldFMv0tHd5a7Ks8uSId48hq738jXhgisWp3KuNXYOOwtDEA93GrCvsvMh8LBKWuxryMRJNeZ_djWm5PqkEKm4zP_p_hlJivtVNyHBAXQbzCzmw4ZR0JAQEfiU2nojnC3xdqWXWwglnogL3YZGi4JL0DjC2paGgvKXnMgsbUaKug Sep 14 08:50:35.385129 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 08:50:35.385129 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 08:50:35.385129 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 08:50:35.385129 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 08:50:35.385129 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 08:50:35.385129 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 08:50:35.385129 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 919dd9619fb24ee281cf6d96cf3351df Sep 14 08:50:35.385129 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 Sep 14 08:50:35.385129 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 08:50:35.385129 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 08:50:35.386535 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/919dd9619fb24ee281cf6d96cf3351df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_919dd9619fb24ee281cf6d96cf3351df"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/919dd9619fb24ee281cf6d96cf3351df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/919dd9619fb24ee281cf6d96cf3351df"}]}] Sep 14 08:50:35.386535 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 Sep 14 08:50:35.386535 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 919dd9619fb24ee281cf6d96cf3351df Sep 14 08:50:35.386535 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 Sep 14 08:50:35.386535 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project Sep 14 08:50:35.386535 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 08:50:35.386535 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 08:50:35.386535 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 2290f39b61044661aa9bec206794a5c8 Sep 14 08:50:35.386535 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project Sep 14 08:50:35.386535 n-d-836830-18 devstack@n-api.service[128759]: Sep 14 08:50:35.386535 n-d-836830-18 devstack@n-api.service[128759]: {"addFloatingIp": {"address": ""}} Sep 14 08:50:35.386535 n-d-836830-18 devstack@n-api.service[128759]: method: Sep 14 08:50:35.386535 n-d-836830-18 devstack@n-api.service[128759]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Sep 14 08:50:35.387537 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': 'c402c828-5101-40cc-8ac8-b3d1470028ed', 'body': {'addFloatingIp': {'address': ''}}} Sep 14 08:50:35.387537 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:50:35.387537 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:50:35.387537 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 14 08:50:35.387537 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 14 08:50:35.387537 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 14 08:50:35.387537 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise error Sep 14 08:50:35.387537 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Sep 14 08:50:35.387537 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:50:35.387537 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Sep 14 08:50:35.387537 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Sep 14 08:50:35.387537 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:50:35.387537 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Sep 14 08:50:35.387537 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi '' Sep 14 08:50:35.387537 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:50:35.387537 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:50:35.387537 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:50:35.387537 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:50:35.387537 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:50:35.387537 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:50:35.387537 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:50:35.387537 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:50:35.388908 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 08:50:35.388908 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 08:50:35.388908 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:50:35.388908 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:50:35.388908 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 14 08:50:35.388908 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 14 08:50:35.388908 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 14 08:50:35.388908 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 14 08:50:35.388908 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 14 08:50:35.388908 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 14 08:50:35.388908 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Sep 14 08:50:35.388908 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:50:35.388908 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:50:35.388908 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:50:35.388908 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:50:35.388908 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:50:35.388908 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:50:35.388908 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 14 08:50:35.388908 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 14 08:50:35.390053 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Sep 14 08:50:35.390053 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:50:35.390053 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ff468ddf-a1fa-4725-be55-64d4fcdf4d31 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:50:35.390053 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-ff468ddf-a1fa-4725-be55-64d4fcdf4d31 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] 10.222.0.60 "POST /compute/v2.1/servers/c402c828-5101-40cc-8ac8-b3d1470028ed/action" status: 400 len: 142 microversion: 2.1 time: 0.024107 Sep 14 08:50:35.390053 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 313/583] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 08:50:35 2022] POST /compute/v2.1/servers/c402c828-5101-40cc-8ac8-b3d1470028ed/action => generated 142 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 14 08:50:35.396477 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-953fe9a6-3ba6-4057-9bde-e81e22add9fa tempest-FloatingIPsTestJSON-1993878692 tempest-FloatingIPsTestJSON-1993878692-project] Calling method '.version_select at 0x7f7d44774550>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:50:35.398493 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-9cc0726b-43a0-4ec8-b40b-1fecebe95857 tempest-SecurityGroupsTestAdminJSON-901672823 tempest-SecurityGroupsTestAdminJSON-901672823-project-admin] Calling method '.version_select at 0x7f7d44939550>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:50:35.760510 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-953fe9a6-3ba6-4057-9bde-e81e22add9fa tempest-FloatingIPsTestJSON-1993878692 tempest-FloatingIPsTestJSON-1993878692-project] 10.222.0.60 "GET /compute/v2.1/os-floating-ips/80d4e006-7a68-429e-ad71-54fd7a42a0f7" status: 200 len: 142 microversion: 2.1 time: 0.371849 Sep 14 08:50:35.762288 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 314/584] 10.222.0.60 () {58 vars in 1260 bytes} [Wed Sep 14 08:50:35 2022] GET /compute/v2.1/os-floating-ips/80d4e006-7a68-429e-ad71-54fd7a42a0f7 => generated 142 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:50:35.775694 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-28aa4303-a712-4488-bc02-b52f6ebd85c5 req-1ef812c7-e59b-47ce-a222-2d88add62c40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87a4e8b8-79db-43f6-be85-b738382e4699", "name": "network-vif-plugged", "status": "completed", "tag": "94536d67-6c5b-4f6a-b61f-3534a3426e05"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:50:35.785809 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-28aa4303-a712-4488-bc02-b52f6ebd85c5 req-1ef812c7-e59b-47ce-a222-2d88add62c40 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:35.786294 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-28aa4303-a712-4488-bc02-b52f6ebd85c5 req-1ef812c7-e59b-47ce-a222-2d88add62c40 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:35.786899 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-28aa4303-a712-4488-bc02-b52f6ebd85c5 req-1ef812c7-e59b-47ce-a222-2d88add62c40 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:35.798713 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-28aa4303-a712-4488-bc02-b52f6ebd85c5 req-1ef812c7-e59b-47ce-a222-2d88add62c40 service nova] Creating event network-vif-plugged:94536d67-6c5b-4f6a-b61f-3534a3426e05 for instance 87a4e8b8-79db-43f6-be85-b738382e4699 on n-h1-836830-18 Sep 14 08:50:35.804089 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-28aa4303-a712-4488-bc02-b52f6ebd85c5 req-1ef812c7-e59b-47ce-a222-2d88add62c40 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032492 Sep 14 08:50:35.805319 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 315/585] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:50:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:50:35.812361 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-6784f23f-0f9b-4bc8-bf47-e987cc8908aa tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:50:35.813138 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-6784f23f-0f9b-4bc8-bf47-e987cc8908aa tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] [instance: 5059f5d9-6903-4cf4-a999-01d2d2ba0842] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:50:35.819439 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6784f23f-0f9b-4bc8-bf47-e987cc8908aa tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:35.820150 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6784f23f-0f9b-4bc8-bf47-e987cc8908aa tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:35.820594 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6784f23f-0f9b-4bc8-bf47-e987cc8908aa tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:35.821293 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6784f23f-0f9b-4bc8-bf47-e987cc8908aa tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:35.821941 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6784f23f-0f9b-4bc8-bf47-e987cc8908aa tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:35.822929 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6784f23f-0f9b-4bc8-bf47-e987cc8908aa tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:35.918207 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-9cc0726b-43a0-4ec8-b40b-1fecebe95857 tempest-SecurityGroupsTestAdminJSON-901672823 tempest-SecurityGroupsTestAdminJSON-901672823-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/3bcc6668-b653-430d-81f6-62ae4d85e966" status: 202 len: 0 microversion: 2.1 time: 0.532793 Sep 14 08:50:35.918804 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 271/586] 10.222.0.60 () {58 vars in 1272 bytes} [Wed Sep 14 08:50:35 2022] DELETE /compute/v2.1/os-security-groups/3bcc6668-b653-430d-81f6-62ae4d85e966 => generated 0 bytes in 534 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 08:50:35.924407 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-2200f9d5-03ef-4785-8854-b96b4b5f7bd3 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:50:35.929871 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-2200f9d5-03ef-4785-8854-b96b4b5f7bd3 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '89c7802984cf48d1852832b52abe52e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e326f95a9604fdb9bd075db3837cf62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:50:35.931055 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-2200f9d5-03ef-4785-8854-b96b4b5f7bd3 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Searching by: {'deleted': False, 'project_id': '5e326f95a9604fdb9bd075db3837cf62'} {{(pid=128758) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 14 08:50:35.940518 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2200f9d5-03ef-4785-8854-b96b4b5f7bd3 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:35.941228 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2200f9d5-03ef-4785-8854-b96b4b5f7bd3 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:35.941441 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2200f9d5-03ef-4785-8854-b96b4b5f7bd3 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:35.944032 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2200f9d5-03ef-4785-8854-b96b4b5f7bd3 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:35.948146 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2200f9d5-03ef-4785-8854-b96b4b5f7bd3 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:35.948805 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2200f9d5-03ef-4785-8854-b96b4b5f7bd3 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:36.091582 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.multi_cell_list [None req-2200f9d5-03ef-4785-8854-b96b4b5f7bd3 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Listed batch of 5 results from cell out of 1000 limit. Returned 5 total so far. {{(pid=128758) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 14 08:50:36.104841 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.objects.instance [None req-6784f23f-0f9b-4bc8-bf47-e987cc8908aa tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Lazy-loading 'services' on Instance uuid 5059f5d9-6903-4cf4-a999-01d2d2ba0842 {{(pid=128759) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 08:50:36.118384 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-6784f23f-0f9b-4bc8-bf47-e987cc8908aa tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/5059f5d9-6903-4cf4-a999-01d2d2ba0842" status: 200 len: 2050 microversion: 2.25 time: 0.311706 Sep 14 08:50:36.127087 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 316/587] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:50:35 2022] GET /compute/v2.1/servers/5059f5d9-6903-4cf4-a999-01d2d2ba0842 => generated 2050 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:50:36.127087 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e441202e-bda1-42dd-adb6-a71610f78235 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:50:36.127087 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e441202e-bda1-42dd-adb6-a71610f78235 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] [instance: c402c828-5101-40cc-8ac8-b3d1470028ed] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:50:36.133140 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e441202e-bda1-42dd-adb6-a71610f78235 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:36.133699 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e441202e-bda1-42dd-adb6-a71610f78235 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:36.134148 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e441202e-bda1-42dd-adb6-a71610f78235 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:36.134882 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e441202e-bda1-42dd-adb6-a71610f78235 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:36.135423 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e441202e-bda1-42dd-adb6-a71610f78235 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:36.135968 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e441202e-bda1-42dd-adb6-a71610f78235 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:36.157313 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-2200f9d5-03ef-4785-8854-b96b4b5f7bd3 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] 10.222.0.60 "GET /compute/v2.1/servers" status: 200 len: 1665 microversion: 2.1 time: 0.237144 Sep 14 08:50:36.157915 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 272/588] 10.222.0.60 () {58 vars in 1125 bytes} [Wed Sep 14 08:50:35 2022] GET /compute/v2.1/servers => generated 1665 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:50:36.162706 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d4d2ed80-0556-452d-930a-a72d19c9f217 tempest-FloatingIPsTestJSON-1993878692 tempest-FloatingIPsTestJSON-1993878692-project] Calling method '.version_select at 0x7f7d44939550>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:50:36.204680 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e441202e-bda1-42dd-adb6-a71610f78235 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Acquiring lock "refresh_cache-c402c828-5101-40cc-8ac8-b3d1470028ed" {{(pid=128759) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 14 08:50:36.205090 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e441202e-bda1-42dd-adb6-a71610f78235 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Acquired lock "refresh_cache-c402c828-5101-40cc-8ac8-b3d1470028ed" {{(pid=128759) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 14 08:50:36.390688 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e441202e-bda1-42dd-adb6-a71610f78235 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Releasing lock "refresh_cache-c402c828-5101-40cc-8ac8-b3d1470028ed" {{(pid=128759) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 14 08:50:36.391284 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-e441202e-bda1-42dd-adb6-a71610f78235 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] HTTP exception thrown: floating IP not found Sep 14 08:50:36.394543 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e441202e-bda1-42dd-adb6-a71610f78235 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Request method failure captured: Sep 14 08:50:36.394543 n-d-836830-18 devstack@n-api.service[128759]: request: POST /compute/v2.1/servers/c402c828-5101-40cc-8ac8-b3d1470028ed/action HTTP/1.1 Sep 14 08:50:36.394543 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 08:50:36.394543 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 08:50:36.394543 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 08:50:36.394543 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 41 Sep 14 08:50:36.394543 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 08:50:36.394543 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 08:50:36.394543 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 08:50:36.394543 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 08:50:36.394543 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZWTldFMv0tHd5a7Ks8uSId48hq738jXhgisWp3KuNXYOOwtDEA93GrCvsvMh8LBKWuxryMRJNeZ_djWm5PqkEKm4zP_p_hlJivtVNyHBAXQbzCzmw4ZR0JAQEfiU2nojnC3xdqWXWwglnogL3YZGi4JL0DjC2paGgvKXnMgsbUaKug Sep 14 08:50:36.394543 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 08:50:36.394543 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 08:50:36.394543 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 08:50:36.394543 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 08:50:36.394543 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 08:50:36.394543 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 08:50:36.394543 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 919dd9619fb24ee281cf6d96cf3351df Sep 14 08:50:36.394543 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 Sep 14 08:50:36.394543 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 08:50:36.394543 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 08:50:36.396135 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/919dd9619fb24ee281cf6d96cf3351df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_919dd9619fb24ee281cf6d96cf3351df"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/919dd9619fb24ee281cf6d96cf3351df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/919dd9619fb24ee281cf6d96cf3351df"}]}] Sep 14 08:50:36.396135 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 Sep 14 08:50:36.396135 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 919dd9619fb24ee281cf6d96cf3351df Sep 14 08:50:36.396135 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 Sep 14 08:50:36.396135 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project Sep 14 08:50:36.396135 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 08:50:36.396135 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 08:50:36.396135 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 2290f39b61044661aa9bec206794a5c8 Sep 14 08:50:36.396135 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project Sep 14 08:50:36.396135 n-d-836830-18 devstack@n-api.service[128759]: Sep 14 08:50:36.396135 n-d-836830-18 devstack@n-api.service[128759]: {"addFloatingIp": {"address": "0.0.0.0"}} Sep 14 08:50:36.396135 n-d-836830-18 devstack@n-api.service[128759]: method: Sep 14 08:50:36.396135 n-d-836830-18 devstack@n-api.service[128759]: exception: floating IP not found Sep 14 08:50:36.396991 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': 'c402c828-5101-40cc-8ac8-b3d1470028ed', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Sep 14 08:50:36.396991 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:50:36.396991 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:50:36.396991 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Sep 14 08:50:36.396991 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Sep 14 08:50:36.396991 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Sep 14 08:50:36.396991 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Sep 14 08:50:36.396991 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2699, in associate_floating_ip Sep 14 08:50:36.396991 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Sep 14 08:50:36.396991 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Sep 14 08:50:36.396991 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Sep 14 08:50:36.396991 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Sep 14 08:50:36.396991 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:50:36.396991 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:50:36.396991 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:50:36.396991 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:50:36.396991 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:50:36.396991 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:50:36.396991 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:50:36.398120 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:50:36.398120 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 08:50:36.398120 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 08:50:36.398120 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:50:36.398120 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:50:36.398120 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 08:50:36.398120 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 08:50:36.398120 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Sep 14 08:50:36.398120 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 14 08:50:36.398120 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Sep 14 08:50:36.398120 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:50:36.398120 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:50:36.398120 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:50:36.398120 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:50:36.398120 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:50:36.398120 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:50:36.398120 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:50:36.398120 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:50:36.398120 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Sep 14 08:50:36.398120 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:50:36.399421 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e441202e-bda1-42dd-adb6-a71610f78235 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Returning 404 to user: floating IP not found {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:50:36.399421 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e441202e-bda1-42dd-adb6-a71610f78235 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] 10.222.0.60 "POST /compute/v2.1/servers/c402c828-5101-40cc-8ac8-b3d1470028ed/action" status: 404 len: 67 microversion: 2.1 time: 0.275357 Sep 14 08:50:36.399421 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 317/589] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 08:50:36 2022] POST /compute/v2.1/servers/c402c828-5101-40cc-8ac8-b3d1470028ed/action => generated 67 bytes in 276 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 14 08:50:36.401395 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-84802033-1f48-440f-8f78-e0648a3281ea tempest-SecurityGroupsTestAdminJSON-901672823 tempest-SecurityGroupsTestAdminJSON-901672823-project-admin] Calling method '.version_select at 0x7f7d446688b0>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:50:36.469384 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-d4d2ed80-0556-452d-930a-a72d19c9f217 tempest-FloatingIPsTestJSON-1993878692 tempest-FloatingIPsTestJSON-1993878692-project] 10.222.0.60 "GET /compute/v2.1/os-floating-ips" status: 200 len: 145 microversion: 2.1 time: 0.310083 Sep 14 08:50:36.469965 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 273/590] 10.222.0.60 () {58 vars in 1149 bytes} [Wed Sep 14 08:50:36 2022] GET /compute/v2.1/os-floating-ips => generated 145 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:50:36.478017 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-fc72e449-d631-4400-b921-a0a9520bd363 tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:50:36.482517 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fc72e449-d631-4400-b921-a0a9520bd363 tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:36.483101 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fc72e449-d631-4400-b921-a0a9520bd363 tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:36.483605 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fc72e449-d631-4400-b921-a0a9520bd363 tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:36.484341 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fc72e449-d631-4400-b921-a0a9520bd363 tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:36.484791 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fc72e449-d631-4400-b921-a0a9520bd363 tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:36.485209 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fc72e449-d631-4400-b921-a0a9520bd363 tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:36.512969 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-fc72e449-d631-4400-b921-a0a9520bd363 tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.038648 Sep 14 08:50:36.513505 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 274/591] 10.222.0.60 () {60 vars in 1217 bytes} [Wed Sep 14 08:50:36 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 08:50:36.517964 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-661efa40-13e0-42d1-bc57-d5699e295d97 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:50:36.518572 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-661efa40-13e0-42d1-bc57-d5699e295d97 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] [instance: 3f9e2d1a-9899-4046-b2af-939db32442b7] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:50:36.528125 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-661efa40-13e0-42d1-bc57-d5699e295d97 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:36.528710 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-661efa40-13e0-42d1-bc57-d5699e295d97 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:36.529222 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-661efa40-13e0-42d1-bc57-d5699e295d97 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:36.529999 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-661efa40-13e0-42d1-bc57-d5699e295d97 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:36.530531 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-661efa40-13e0-42d1-bc57-d5699e295d97 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:36.531059 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-661efa40-13e0-42d1-bc57-d5699e295d97 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:36.642997 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-661efa40-13e0-42d1-bc57-d5699e295d97 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c7802984cf48d1852832b52abe52e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e326f95a9604fdb9bd075db3837cf62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:50:36.651323 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-661efa40-13e0-42d1-bc57-d5699e295d97 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] 10.222.0.60 "GET /compute/v2.1/servers/3f9e2d1a-9899-4046-b2af-939db32442b7" status: 200 len: 1271 microversion: 2.1 time: 0.136829 Sep 14 08:50:36.651986 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 275/592] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:50:36 2022] GET /compute/v2.1/servers/3f9e2d1a-9899-4046-b2af-939db32442b7 => generated 1271 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:50:36.669742 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-6fed0ad7-85fb-4860-ba9a-83b063a98b27 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:50:36.670494 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-6fed0ad7-85fb-4860-ba9a-83b063a98b27 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: e4c51c69-8c2e-4202-9c2f-3dfae93392e9] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:50:36.677591 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6fed0ad7-85fb-4860-ba9a-83b063a98b27 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:36.678089 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6fed0ad7-85fb-4860-ba9a-83b063a98b27 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:36.678525 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6fed0ad7-85fb-4860-ba9a-83b063a98b27 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:36.679299 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6fed0ad7-85fb-4860-ba9a-83b063a98b27 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:36.679755 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6fed0ad7-85fb-4860-ba9a-83b063a98b27 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:36.680450 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6fed0ad7-85fb-4860-ba9a-83b063a98b27 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:36.709326 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-84802033-1f48-440f-8f78-e0648a3281ea tempest-SecurityGroupsTestAdminJSON-901672823 tempest-SecurityGroupsTestAdminJSON-901672823-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/7e75e5c6-0b20-40a4-b5c7-9563c68b2ea7" status: 202 len: 0 microversion: 2.1 time: 0.311715 Sep 14 08:50:36.709912 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 318/593] 10.222.0.60 () {58 vars in 1272 bytes} [Wed Sep 14 08:50:36 2022] DELETE /compute/v2.1/os-security-groups/7e75e5c6-0b20-40a4-b5c7-9563c68b2ea7 => generated 0 bytes in 313 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 08:50:36.715969 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a4dcabab-f18f-483b-ba52-47e2f57df027 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Action: 'action', calling method: .version_select at 0x7f7d460c3430>, body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:50:36.773896 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-a4dcabab-f18f-483b-ba52-47e2f57df027 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Sep 14 08:50:36.776645 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a4dcabab-f18f-483b-ba52-47e2f57df027 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Request method failure captured: Sep 14 08:50:36.776645 n-d-836830-18 devstack@n-api.service[128759]: request: POST /compute/v2.1/servers/c402c828-5101-40cc-8ac8-b3d1470028ed/action HTTP/1.1 Sep 14 08:50:36.776645 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 08:50:36.776645 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 08:50:36.776645 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 08:50:36.776645 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 44 Sep 14 08:50:36.776645 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 08:50:36.776645 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 08:50:36.776645 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 08:50:36.776645 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 08:50:36.776645 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZWTldFMv0tHd5a7Ks8uSId48hq738jXhgisWp3KuNXYOOwtDEA93GrCvsvMh8LBKWuxryMRJNeZ_djWm5PqkEKm4zP_p_hlJivtVNyHBAXQbzCzmw4ZR0JAQEfiU2nojnC3xdqWXWwglnogL3YZGi4JL0DjC2paGgvKXnMgsbUaKug Sep 14 08:50:36.776645 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 08:50:36.776645 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 08:50:36.776645 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 08:50:36.776645 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 08:50:36.776645 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 08:50:36.776645 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 08:50:36.776645 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 919dd9619fb24ee281cf6d96cf3351df Sep 14 08:50:36.776645 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 Sep 14 08:50:36.776645 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 08:50:36.776645 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 08:50:36.778159 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/919dd9619fb24ee281cf6d96cf3351df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_919dd9619fb24ee281cf6d96cf3351df"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/919dd9619fb24ee281cf6d96cf3351df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/919dd9619fb24ee281cf6d96cf3351df"}]}] Sep 14 08:50:36.778159 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 Sep 14 08:50:36.778159 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 919dd9619fb24ee281cf6d96cf3351df Sep 14 08:50:36.778159 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 Sep 14 08:50:36.778159 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project Sep 14 08:50:36.778159 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 08:50:36.778159 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 08:50:36.778159 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 2290f39b61044661aa9bec206794a5c8 Sep 14 08:50:36.778159 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project Sep 14 08:50:36.778159 n-d-836830-18 devstack@n-api.service[128759]: Sep 14 08:50:36.778159 n-d-836830-18 devstack@n-api.service[128759]: {"removeFloatingIp": {"address": "0.0.0.0"}} Sep 14 08:50:36.778159 n-d-836830-18 devstack@n-api.service[128759]: method: Sep 14 08:50:36.778159 n-d-836830-18 devstack@n-api.service[128759]: exception: Floating IP not found for address 0.0.0.0. Sep 14 08:50:36.779123 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': 'c402c828-5101-40cc-8ac8-b3d1470028ed', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Sep 14 08:50:36.779123 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:50:36.779123 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:50:36.779123 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Sep 14 08:50:36.779123 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Sep 14 08:50:36.779123 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2927, in get_instance_id_by_floating_address Sep 14 08:50:36.779123 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Sep 14 08:50:36.779123 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Sep 14 08:50:36.779123 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Sep 14 08:50:36.779123 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Sep 14 08:50:36.779123 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:50:36.779123 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:50:36.779123 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:50:36.779123 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:50:36.779123 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:50:36.779123 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:50:36.779123 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:50:36.779123 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:50:36.779123 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 08:50:36.780441 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 08:50:36.780441 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:50:36.780441 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:50:36.780441 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 08:50:36.780441 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 08:50:36.780441 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Sep 14 08:50:36.780441 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Sep 14 08:50:36.780441 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Sep 14 08:50:36.780441 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Sep 14 08:50:36.780441 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Sep 14 08:50:36.780441 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:50:36.780441 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:50:36.780441 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:50:36.780441 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:50:36.780441 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:50:36.780441 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:50:36.780441 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:50:36.780441 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:50:36.780441 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Sep 14 08:50:36.780441 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:50:36.782457 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a4dcabab-f18f-483b-ba52-47e2f57df027 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:50:36.783320 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a4dcabab-f18f-483b-ba52-47e2f57df027 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] 10.222.0.60 "POST /compute/v2.1/servers/c402c828-5101-40cc-8ac8-b3d1470028ed/action" status: 404 len: 88 microversion: 2.1 time: 0.072450 Sep 14 08:50:36.783888 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 319/594] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 08:50:36 2022] POST /compute/v2.1/servers/c402c828-5101-40cc-8ac8-b3d1470028ed/action => generated 88 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 14 08:50:36.794066 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-6577db06-27ba-4e0c-b2aa-1d9cc386c0e8 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:50:36.795077 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-6577db06-27ba-4e0c-b2aa-1d9cc386c0e8 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: 87a4e8b8-79db-43f6-be85-b738382e4699] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:50:36.801782 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6577db06-27ba-4e0c-b2aa-1d9cc386c0e8 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:36.802569 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6577db06-27ba-4e0c-b2aa-1d9cc386c0e8 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:36.803287 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6577db06-27ba-4e0c-b2aa-1d9cc386c0e8 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:36.804450 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6577db06-27ba-4e0c-b2aa-1d9cc386c0e8 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:36.805515 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6577db06-27ba-4e0c-b2aa-1d9cc386c0e8 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:36.806289 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6577db06-27ba-4e0c-b2aa-1d9cc386c0e8 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:36.907511 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-6fed0ad7-85fb-4860-ba9a-83b063a98b27 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:50:36.917492 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-6fed0ad7-85fb-4860-ba9a-83b063a98b27 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/e4c51c69-8c2e-4202-9c2f-3dfae93392e9" status: 200 len: 1476 microversion: 2.1 time: 0.253098 Sep 14 08:50:36.918097 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 276/595] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:50:36 2022] GET /compute/v2.1/servers/e4c51c69-8c2e-4202-9c2f-3dfae93392e9 => generated 1476 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:50:36.923782 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-bbb1c0ca-7691-4993-87ef-448ed6962159 tempest-FloatingIPsTestJSON-1993878692 tempest-FloatingIPsTestJSON-1993878692-project] Calling method '.version_select at 0x7f7d448ee430>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:50:37.072555 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-6577db06-27ba-4e0c-b2aa-1d9cc386c0e8 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:50:37.081546 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-6577db06-27ba-4e0c-b2aa-1d9cc386c0e8 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/87a4e8b8-79db-43f6-be85-b738382e4699" status: 200 len: 1311 microversion: 2.1 time: 0.296626 Sep 14 08:50:37.082526 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 320/596] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:50:36 2022] GET /compute/v2.1/servers/87a4e8b8-79db-43f6-be85-b738382e4699 => generated 1311 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:50:37.106427 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-22d256d9-f82e-4b2f-9dcd-ce4680a45b44 tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-836830-18", "block_migration": "auto"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:50:37.109129 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-22d256d9-f82e-4b2f-9dcd-ce4680a45b44 tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] [instance: 5059f5d9-6903-4cf4-a999-01d2d2ba0842] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:50:37.118645 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-22d256d9-f82e-4b2f-9dcd-ce4680a45b44 tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:37.119170 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-22d256d9-f82e-4b2f-9dcd-ce4680a45b44 tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:37.119605 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-22d256d9-f82e-4b2f-9dcd-ce4680a45b44 tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:37.120298 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-22d256d9-f82e-4b2f-9dcd-ce4680a45b44 tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:37.120745 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-22d256d9-f82e-4b2f-9dcd-ce4680a45b44 tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:37.121163 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-22d256d9-f82e-4b2f-9dcd-ce4680a45b44 tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:37.161503 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.objects.instance [None req-22d256d9-f82e-4b2f-9dcd-ce4680a45b44 tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Lazy-loading 'flavor' on Instance uuid 5059f5d9-6903-4cf4-a999-01d2d2ba0842 {{(pid=128759) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 08:50:37.184268 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-22d256d9-f82e-4b2f-9dcd-ce4680a45b44 tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] [instance: 5059f5d9-6903-4cf4-a999-01d2d2ba0842] Going to try to live migrate instance to n-h1-836830-18 {{(pid=128759) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 14 08:50:37.193278 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:50:38.008606 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-bbb1c0ca-7691-4993-87ef-448ed6962159 tempest-FloatingIPsTestJSON-1993878692 tempest-FloatingIPsTestJSON-1993878692-project] 10.222.0.60 "DELETE /compute/v2.1/os-floating-ips/80d4e006-7a68-429e-ad71-54fd7a42a0f7" status: 202 len: 0 microversion: 2.1 time: 1.087122 Sep 14 08:50:38.009343 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 277/597] 10.222.0.60 () {58 vars in 1263 bytes} [Wed Sep 14 08:50:36 2022] DELETE /compute/v2.1/os-floating-ips/80d4e006-7a68-429e-ad71-54fd7a42a0f7 => generated 0 bytes in 1090 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 08:50:38.016195 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-9fd4846b-bfb8-4073-b188-e02cb193f508 tempest-SecurityGroupsTestAdminJSON-485934421 tempest-SecurityGroupsTestAdminJSON-485934421-project] Calling method '.version_select at 0x7f7d44a40f70>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:50:38.599094 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-9fd4846b-bfb8-4073-b188-e02cb193f508 tempest-SecurityGroupsTestAdminJSON-485934421 tempest-SecurityGroupsTestAdminJSON-485934421-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/da334904-dc28-4a0c-9367-334c878d1efc" status: 202 len: 0 microversion: 2.1 time: 0.587696 Sep 14 08:50:38.599686 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 278/598] 10.222.0.60 () {58 vars in 1272 bytes} [Wed Sep 14 08:50:38 2022] DELETE /compute/v2.1/os-security-groups/da334904-dc28-4a0c-9367-334c878d1efc => generated 0 bytes in 589 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 08:50:38.605225 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-11920f0b-9885-4b14-92e1-7cdfac6ad908 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:50:38.605942 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-11920f0b-9885-4b14-92e1-7cdfac6ad908 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] [instance: c402c828-5101-40cc-8ac8-b3d1470028ed] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:50:38.614768 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-11920f0b-9885-4b14-92e1-7cdfac6ad908 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:38.615979 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-11920f0b-9885-4b14-92e1-7cdfac6ad908 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:38.616621 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-11920f0b-9885-4b14-92e1-7cdfac6ad908 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:38.617454 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-11920f0b-9885-4b14-92e1-7cdfac6ad908 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:38.618307 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-11920f0b-9885-4b14-92e1-7cdfac6ad908 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:38.618853 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-11920f0b-9885-4b14-92e1-7cdfac6ad908 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:38.650617 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-11920f0b-9885-4b14-92e1-7cdfac6ad908 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] [instance: c402c828-5101-40cc-8ac8-b3d1470028ed] Going to try to terminate instance {{(pid=128758) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 08:50:38.704113 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=96,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:50:38.735677 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-11920f0b-9885-4b14-92e1-7cdfac6ad908 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] 10.222.0.60 "DELETE /compute/v2.1/servers/c402c828-5101-40cc-8ac8-b3d1470028ed" status: 204 len: 0 microversion: 2.1 time: 0.132906 Sep 14 08:50:38.737463 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 279/599] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 08:50:38 2022] DELETE /compute/v2.1/servers/c402c828-5101-40cc-8ac8-b3d1470028ed => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 08:50:38.747324 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-6ceaf47f-3518-4b26-9b1c-33d2bdd6bdae tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:50:38.748382 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-6ceaf47f-3518-4b26-9b1c-33d2bdd6bdae tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] [instance: 3f9e2d1a-9899-4046-b2af-939db32442b7] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:50:38.754283 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6ceaf47f-3518-4b26-9b1c-33d2bdd6bdae tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:38.754767 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6ceaf47f-3518-4b26-9b1c-33d2bdd6bdae tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:38.755235 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6ceaf47f-3518-4b26-9b1c-33d2bdd6bdae tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:38.755959 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6ceaf47f-3518-4b26-9b1c-33d2bdd6bdae tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:38.756407 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6ceaf47f-3518-4b26-9b1c-33d2bdd6bdae tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:38.756824 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6ceaf47f-3518-4b26-9b1c-33d2bdd6bdae tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:38.897115 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-6ceaf47f-3518-4b26-9b1c-33d2bdd6bdae tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c7802984cf48d1852832b52abe52e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e326f95a9604fdb9bd075db3837cf62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:50:38.905071 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-6ceaf47f-3518-4b26-9b1c-33d2bdd6bdae tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] 10.222.0.60 "GET /compute/v2.1/servers/3f9e2d1a-9899-4046-b2af-939db32442b7" status: 200 len: 1319 microversion: 2.1 time: 0.165765 Sep 14 08:50:38.905600 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 280/600] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:50:38 2022] GET /compute/v2.1/servers/3f9e2d1a-9899-4046-b2af-939db32442b7 => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:50:38.910036 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b1522064-7caa-4dc0-8255-0306df12bf37 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:50:38.910644 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-b1522064-7caa-4dc0-8255-0306df12bf37 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: e4c51c69-8c2e-4202-9c2f-3dfae93392e9] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:50:38.917246 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b1522064-7caa-4dc0-8255-0306df12bf37 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:38.918224 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b1522064-7caa-4dc0-8255-0306df12bf37 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:38.918224 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b1522064-7caa-4dc0-8255-0306df12bf37 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:38.918838 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b1522064-7caa-4dc0-8255-0306df12bf37 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:38.919312 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b1522064-7caa-4dc0-8255-0306df12bf37 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:38.919733 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b1522064-7caa-4dc0-8255-0306df12bf37 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:39.055947 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-b1522064-7caa-4dc0-8255-0306df12bf37 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:50:39.064161 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-b1522064-7caa-4dc0-8255-0306df12bf37 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/e4c51c69-8c2e-4202-9c2f-3dfae93392e9" status: 200 len: 1476 microversion: 2.1 time: 0.157560 Sep 14 08:50:39.064750 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 281/601] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:50:38 2022] GET /compute/v2.1/servers/e4c51c69-8c2e-4202-9c2f-3dfae93392e9 => generated 1476 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:50:39.069488 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-e6a47df8-f7b0-4690-bbe2-be449e9b1a2e tempest-FloatingIPsTestJSON-1993878692 tempest-FloatingIPsTestJSON-1993878692-project] Action: 'create', calling method: .version_select at 0x7f7d4490e670>, body: {"pool": null} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:50:39.873695 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-22d256d9-f82e-4b2f-9dcd-ce4680a45b44 tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/5059f5d9-6903-4cf4-a999-01d2d2ba0842/action" status: 202 len: 0 microversion: 2.25 time: 2.789807 Sep 14 08:50:39.878143 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 321/602] 10.222.0.60 () {62 vars in 1319 bytes} [Wed Sep 14 08:50:37 2022] POST /compute/v2.1/servers/5059f5d9-6903-4cf4-a999-01d2d2ba0842/action => generated 0 bytes in 2791 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 14 08:50:39.884160 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-6d7e33b4-70cc-45b3-a549-b81cd03012a6 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:50:39.885979 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-6d7e33b4-70cc-45b3-a549-b81cd03012a6 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: 87a4e8b8-79db-43f6-be85-b738382e4699] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:50:39.897705 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6d7e33b4-70cc-45b3-a549-b81cd03012a6 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:39.898205 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6d7e33b4-70cc-45b3-a549-b81cd03012a6 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:39.898777 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6d7e33b4-70cc-45b3-a549-b81cd03012a6 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:39.900948 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6d7e33b4-70cc-45b3-a549-b81cd03012a6 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:39.901632 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6d7e33b4-70cc-45b3-a549-b81cd03012a6 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:39.902209 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6d7e33b4-70cc-45b3-a549-b81cd03012a6 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:40.166381 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-6d7e33b4-70cc-45b3-a549-b81cd03012a6 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:50:40.181261 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-6d7e33b4-70cc-45b3-a549-b81cd03012a6 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/87a4e8b8-79db-43f6-be85-b738382e4699" status: 200 len: 1494 microversion: 2.1 time: 0.304911 Sep 14 08:50:40.182927 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 322/603] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:50:39 2022] GET /compute/v2.1/servers/87a4e8b8-79db-43f6-be85-b738382e4699 => generated 1494 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:50:40.205396 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-163cf90f-ba17-4b82-8e71-64b59f92f51d tempest-SecurityGroupsTestAdminJSON-485934421 tempest-SecurityGroupsTestAdminJSON-485934421-project] Calling method '.version_select at 0x7f7d44875670>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:50:40.824967 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-163cf90f-ba17-4b82-8e71-64b59f92f51d tempest-SecurityGroupsTestAdminJSON-485934421 tempest-SecurityGroupsTestAdminJSON-485934421-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/6ef07a3a-3f48-4b72-b009-9ed72f9d0966" status: 202 len: 0 microversion: 2.1 time: 0.640417 Sep 14 08:50:40.825576 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 323/604] 10.222.0.60 () {58 vars in 1272 bytes} [Wed Sep 14 08:50:40 2022] DELETE /compute/v2.1/os-security-groups/6ef07a3a-3f48-4b72-b009-9ed72f9d0966 => generated 0 bytes in 642 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 08:50:40.834504 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-4bf9fd6e-b920-4b8b-9c54-1274e9460afa tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:50:40.835462 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-4bf9fd6e-b920-4b8b-9c54-1274e9460afa tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] [instance: c402c828-5101-40cc-8ac8-b3d1470028ed] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:50:40.844309 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4bf9fd6e-b920-4b8b-9c54-1274e9460afa tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:40.845899 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4bf9fd6e-b920-4b8b-9c54-1274e9460afa tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:40.847546 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4bf9fd6e-b920-4b8b-9c54-1274e9460afa tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:40.849363 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4bf9fd6e-b920-4b8b-9c54-1274e9460afa tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:40.850426 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4bf9fd6e-b920-4b8b-9c54-1274e9460afa tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:40.851404 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4bf9fd6e-b920-4b8b-9c54-1274e9460afa tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:40.988227 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-e6a47df8-f7b0-4690-bbe2-be449e9b1a2e tempest-FloatingIPsTestJSON-1993878692 tempest-FloatingIPsTestJSON-1993878692-project] 10.222.0.60 "POST /compute/v2.1/os-floating-ips" status: 200 len: 140 microversion: 2.1 time: 1.921988 Sep 14 08:50:40.993452 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 282/605] 10.222.0.60 () {60 vars in 1170 bytes} [Wed Sep 14 08:50:39 2022] POST /compute/v2.1/os-floating-ips => generated 140 bytes in 1928 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:50:41.018641 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-0b8bbe2b-693b-4f4e-ba19-664fc5329cc0 req-9f349b1c-c4bd-4659-a90d-c7f13ff28927 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f9e2d1a-9899-4046-b2af-939db32442b7", "tag": "10461c57-a77f-4f2f-9b54-907e301e22ee"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:50:41.038982 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-0b8bbe2b-693b-4f4e-ba19-664fc5329cc0 req-9f349b1c-c4bd-4659-a90d-c7f13ff28927 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:41.039682 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-0b8bbe2b-693b-4f4e-ba19-664fc5329cc0 req-9f349b1c-c4bd-4659-a90d-c7f13ff28927 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:41.040259 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-0b8bbe2b-693b-4f4e-ba19-664fc5329cc0 req-9f349b1c-c4bd-4659-a90d-c7f13ff28927 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:41.062142 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-0b8bbe2b-693b-4f4e-ba19-664fc5329cc0 req-9f349b1c-c4bd-4659-a90d-c7f13ff28927 service nova] Creating event network-changed:10461c57-a77f-4f2f-9b54-907e301e22ee for instance 3f9e2d1a-9899-4046-b2af-939db32442b7 on n-h2-836830-18 Sep 14 08:50:41.069365 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-0b8bbe2b-693b-4f4e-ba19-664fc5329cc0 req-9f349b1c-c4bd-4659-a90d-c7f13ff28927 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071111 Sep 14 08:50:41.070333 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 283/606] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:50:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:50:41.075894 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-90f48320-73ae-4f1f-872f-d9eeffaf0e0e tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:50:41.079240 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-90f48320-73ae-4f1f-872f-d9eeffaf0e0e tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: 5059f5d9-6903-4cf4-a999-01d2d2ba0842] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:50:41.091285 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-90f48320-73ae-4f1f-872f-d9eeffaf0e0e tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:41.091781 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-90f48320-73ae-4f1f-872f-d9eeffaf0e0e tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:41.092231 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-90f48320-73ae-4f1f-872f-d9eeffaf0e0e tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:41.092925 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-90f48320-73ae-4f1f-872f-d9eeffaf0e0e tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:41.093380 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-90f48320-73ae-4f1f-872f-d9eeffaf0e0e tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:41.093805 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-90f48320-73ae-4f1f-872f-d9eeffaf0e0e tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:41.302132 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-4bf9fd6e-b920-4b8b-9c54-1274e9460afa tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2290f39b61044661aa9bec206794a5c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '919dd9619fb24ee281cf6d96cf3351df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:50:41.314404 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-4bf9fd6e-b920-4b8b-9c54-1274e9460afa tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] 10.222.0.60 "GET /compute/v2.1/servers/c402c828-5101-40cc-8ac8-b3d1470028ed" status: 200 len: 1542 microversion: 2.1 time: 0.487205 Sep 14 08:50:41.315903 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 324/607] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:50:40 2022] GET /compute/v2.1/servers/c402c828-5101-40cc-8ac8-b3d1470028ed => generated 1542 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:50:41.325029 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-707cfe31-ece5-402d-8f3f-6a8e83ff5e88 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:50:41.328981 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-707cfe31-ece5-402d-8f3f-6a8e83ff5e88 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] [instance: 3f9e2d1a-9899-4046-b2af-939db32442b7] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:50:41.337269 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-707cfe31-ece5-402d-8f3f-6a8e83ff5e88 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:41.338528 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-707cfe31-ece5-402d-8f3f-6a8e83ff5e88 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:41.339179 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-707cfe31-ece5-402d-8f3f-6a8e83ff5e88 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:41.340072 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-707cfe31-ece5-402d-8f3f-6a8e83ff5e88 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:41.341199 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-707cfe31-ece5-402d-8f3f-6a8e83ff5e88 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:41.341790 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-707cfe31-ece5-402d-8f3f-6a8e83ff5e88 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:41.378598 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=14 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:50:41.469610 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-90f48320-73ae-4f1f-872f-d9eeffaf0e0e tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:50:41.482606 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-90f48320-73ae-4f1f-872f-d9eeffaf0e0e tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:50:41.495077 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-90f48320-73ae-4f1f-872f-d9eeffaf0e0e tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:50:41.496768 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-90f48320-73ae-4f1f-872f-d9eeffaf0e0e tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/5059f5d9-6903-4cf4-a999-01d2d2ba0842" status: 200 len: 1566 microversion: 2.25 time: 0.425222 Sep 14 08:50:41.497870 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 284/608] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:50:41 2022] GET /compute/v2.1/servers/5059f5d9-6903-4cf4-a999-01d2d2ba0842 => generated 1566 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:50:41.512803 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-f147d1a9-e900-4785-9efa-96957a5c5eb3 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:50:41.514284 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-f147d1a9-e900-4785-9efa-96957a5c5eb3 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: e4c51c69-8c2e-4202-9c2f-3dfae93392e9] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:50:41.523783 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f147d1a9-e900-4785-9efa-96957a5c5eb3 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:41.524284 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f147d1a9-e900-4785-9efa-96957a5c5eb3 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:41.524900 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f147d1a9-e900-4785-9efa-96957a5c5eb3 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:41.525622 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f147d1a9-e900-4785-9efa-96957a5c5eb3 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:41.526496 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f147d1a9-e900-4785-9efa-96957a5c5eb3 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:41.526925 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f147d1a9-e900-4785-9efa-96957a5c5eb3 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:41.727609 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-707cfe31-ece5-402d-8f3f-6a8e83ff5e88 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c7802984cf48d1852832b52abe52e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e326f95a9604fdb9bd075db3837cf62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:50:41.737109 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-707cfe31-ece5-402d-8f3f-6a8e83ff5e88 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] 10.222.0.60 "GET /compute/v2.1/servers/3f9e2d1a-9899-4046-b2af-939db32442b7" status: 200 len: 1319 microversion: 2.1 time: 0.419943 Sep 14 08:50:41.752593 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 325/609] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:50:41 2022] GET /compute/v2.1/servers/3f9e2d1a-9899-4046-b2af-939db32442b7 => generated 1319 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:50:41.904099 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-f147d1a9-e900-4785-9efa-96957a5c5eb3 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:50:41.915571 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-f147d1a9-e900-4785-9efa-96957a5c5eb3 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/e4c51c69-8c2e-4202-9c2f-3dfae93392e9" status: 200 len: 1476 microversion: 2.1 time: 0.416301 Sep 14 08:50:41.916924 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 285/610] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:50:41 2022] GET /compute/v2.1/servers/e4c51c69-8c2e-4202-9c2f-3dfae93392e9 => generated 1476 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:50:41.935914 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b668f2b9-8d40-4690-9655-37b6bdd96350 tempest-FloatingIPsTestJSON-1993878692 tempest-FloatingIPsTestJSON-1993878692-project] Calling method '.version_select at 0x7f7d4490e430>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:50:42.263168 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c6165a9c-b518-41e9-8747-c31d98ec7524 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:50:42.264054 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-c6165a9c-b518-41e9-8747-c31d98ec7524 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] [instance: 87a4e8b8-79db-43f6-be85-b738382e4699] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:50:42.275688 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c6165a9c-b518-41e9-8747-c31d98ec7524 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:42.276354 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c6165a9c-b518-41e9-8747-c31d98ec7524 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:42.277105 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c6165a9c-b518-41e9-8747-c31d98ec7524 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:42.278902 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c6165a9c-b518-41e9-8747-c31d98ec7524 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:42.279535 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c6165a9c-b518-41e9-8747-c31d98ec7524 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:42.280116 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c6165a9c-b518-41e9-8747-c31d98ec7524 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:42.872237 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-c6165a9c-b518-41e9-8747-c31d98ec7524 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/87a4e8b8-79db-43f6-be85-b738382e4699" status: 200 len: 1647 microversion: 2.1 time: 1.133018 Sep 14 08:50:42.872976 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 326/611] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:50:41 2022] GET /compute/v2.1/servers/87a4e8b8-79db-43f6-be85-b738382e4699 => generated 1647 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:50:42.878024 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-17b986da-e5bd-4750-ba9a-4ac916bd581d req-8a7fe1e4-7088-40ba-b67e-f23c3374fe35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c402c828-5101-40cc-8ac8-b3d1470028ed", "name": "network-vif-deleted", "tag": "16038378-4ff2-47f4-881a-cf785e164719"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:50:42.888323 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-17b986da-e5bd-4750-ba9a-4ac916bd581d req-8a7fe1e4-7088-40ba-b67e-f23c3374fe35 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:42.889150 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-17b986da-e5bd-4750-ba9a-4ac916bd581d req-8a7fe1e4-7088-40ba-b67e-f23c3374fe35 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:42.889378 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-17b986da-e5bd-4750-ba9a-4ac916bd581d req-8a7fe1e4-7088-40ba-b67e-f23c3374fe35 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:42.902852 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-17b986da-e5bd-4750-ba9a-4ac916bd581d req-8a7fe1e4-7088-40ba-b67e-f23c3374fe35 service nova] Creating event network-vif-deleted:16038378-4ff2-47f4-881a-cf785e164719 for instance c402c828-5101-40cc-8ac8-b3d1470028ed on n-h1-836830-18 Sep 14 08:50:42.908033 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-17b986da-e5bd-4750-ba9a-4ac916bd581d req-8a7fe1e4-7088-40ba-b67e-f23c3374fe35 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033596 Sep 14 08:50:42.908661 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 327/612] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:50:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:50:42.913658 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-aa11ab5a-af50-4b0c-aad3-c5edc59b221f tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:50:42.914349 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-aa11ab5a-af50-4b0c-aad3-c5edc59b221f tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] [instance: c402c828-5101-40cc-8ac8-b3d1470028ed] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:50:42.922269 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-aa11ab5a-af50-4b0c-aad3-c5edc59b221f tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:42.922269 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-aa11ab5a-af50-4b0c-aad3-c5edc59b221f tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:42.922572 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-aa11ab5a-af50-4b0c-aad3-c5edc59b221f tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:42.923160 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-aa11ab5a-af50-4b0c-aad3-c5edc59b221f tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:42.923612 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-aa11ab5a-af50-4b0c-aad3-c5edc59b221f tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:42.924028 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-aa11ab5a-af50-4b0c-aad3-c5edc59b221f tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:42.958682 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-aa11ab5a-af50-4b0c-aad3-c5edc59b221f tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:42.959194 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-aa11ab5a-af50-4b0c-aad3-c5edc59b221f tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:42.959634 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-aa11ab5a-af50-4b0c-aad3-c5edc59b221f tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:42.960068 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.objects.instance [None req-aa11ab5a-af50-4b0c-aad3-c5edc59b221f tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Lazy-loading 'fault' on Instance uuid c402c828-5101-40cc-8ac8-b3d1470028ed {{(pid=128759) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 08:50:43.049720 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-aa11ab5a-af50-4b0c-aad3-c5edc59b221f tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2290f39b61044661aa9bec206794a5c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '919dd9619fb24ee281cf6d96cf3351df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:50:43.058809 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-aa11ab5a-af50-4b0c-aad3-c5edc59b221f tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] 10.222.0.60 "GET /compute/v2.1/servers/c402c828-5101-40cc-8ac8-b3d1470028ed" status: 200 len: 1322 microversion: 2.1 time: 0.148848 Sep 14 08:50:43.071310 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 328/613] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:50:42 2022] GET /compute/v2.1/servers/c402c828-5101-40cc-8ac8-b3d1470028ed => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:50:43.079427 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-432b03cf-31fd-4188-8a14-aaf22570c906 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:50:43.080275 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-432b03cf-31fd-4188-8a14-aaf22570c906 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: 5059f5d9-6903-4cf4-a999-01d2d2ba0842] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:50:43.086541 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-432b03cf-31fd-4188-8a14-aaf22570c906 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:43.087074 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-432b03cf-31fd-4188-8a14-aaf22570c906 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:43.087548 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-432b03cf-31fd-4188-8a14-aaf22570c906 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:43.088962 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-432b03cf-31fd-4188-8a14-aaf22570c906 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:43.089591 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-432b03cf-31fd-4188-8a14-aaf22570c906 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:43.090175 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-432b03cf-31fd-4188-8a14-aaf22570c906 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:43.301545 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-432b03cf-31fd-4188-8a14-aaf22570c906 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:50:43.311243 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-432b03cf-31fd-4188-8a14-aaf22570c906 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:50:43.313368 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-432b03cf-31fd-4188-8a14-aaf22570c906 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:50:43.314836 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-432b03cf-31fd-4188-8a14-aaf22570c906 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/5059f5d9-6903-4cf4-a999-01d2d2ba0842" status: 200 len: 1566 microversion: 2.25 time: 0.242476 Sep 14 08:50:43.315541 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 329/614] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:50:43 2022] GET /compute/v2.1/servers/5059f5d9-6903-4cf4-a999-01d2d2ba0842 => generated 1566 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:50:43.320449 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f8356723-d50b-45ff-b44b-0204bf004e58 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:50:43.321304 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f8356723-d50b-45ff-b44b-0204bf004e58 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] [instance: 3f9e2d1a-9899-4046-b2af-939db32442b7] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:50:43.328790 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f8356723-d50b-45ff-b44b-0204bf004e58 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:43.329503 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f8356723-d50b-45ff-b44b-0204bf004e58 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:43.330169 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f8356723-d50b-45ff-b44b-0204bf004e58 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:43.331125 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f8356723-d50b-45ff-b44b-0204bf004e58 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:43.331970 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f8356723-d50b-45ff-b44b-0204bf004e58 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:43.332593 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f8356723-d50b-45ff-b44b-0204bf004e58 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:43.399766 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-b668f2b9-8d40-4690-9655-37b6bdd96350 tempest-FloatingIPsTestJSON-1993878692 tempest-FloatingIPsTestJSON-1993878692-project] 10.222.0.60 "DELETE /compute/v2.1/os-floating-ips/9ddfd108-23f5-4ada-9e35-826b8886e7da" status: 202 len: 0 microversion: 2.1 time: 1.481616 Sep 14 08:50:43.403402 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 286/615] 10.222.0.60 () {58 vars in 1263 bytes} [Wed Sep 14 08:50:41 2022] DELETE /compute/v2.1/os-floating-ips/9ddfd108-23f5-4ada-9e35-826b8886e7da => generated 0 bytes in 1483 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 08:50:43.406740 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-21f0bc84-25c3-43a1-80ff-721e0f90ecf0 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:50:43.407433 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-21f0bc84-25c3-43a1-80ff-721e0f90ecf0 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] [instance: 87a4e8b8-79db-43f6-be85-b738382e4699] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:50:43.413486 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-21f0bc84-25c3-43a1-80ff-721e0f90ecf0 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:43.413969 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-21f0bc84-25c3-43a1-80ff-721e0f90ecf0 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:43.414396 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-21f0bc84-25c3-43a1-80ff-721e0f90ecf0 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:43.415114 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-21f0bc84-25c3-43a1-80ff-721e0f90ecf0 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:43.415795 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-21f0bc84-25c3-43a1-80ff-721e0f90ecf0 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:43.416214 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-21f0bc84-25c3-43a1-80ff-721e0f90ecf0 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:43.528147 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f8356723-d50b-45ff-b44b-0204bf004e58 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c7802984cf48d1852832b52abe52e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e326f95a9604fdb9bd075db3837cf62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:50:43.537134 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f8356723-d50b-45ff-b44b-0204bf004e58 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] 10.222.0.60 "GET /compute/v2.1/servers/3f9e2d1a-9899-4046-b2af-939db32442b7" status: 200 len: 1319 microversion: 2.1 time: 0.220174 Sep 14 08:50:43.542170 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 330/616] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:50:43 2022] GET /compute/v2.1/servers/3f9e2d1a-9899-4046-b2af-939db32442b7 => generated 1319 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:50:43.546223 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8b473539-f229-4a88-bc85-f2242510690a tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:50:43.547037 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-8b473539-f229-4a88-bc85-f2242510690a tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: e4c51c69-8c2e-4202-9c2f-3dfae93392e9] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:50:43.557061 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8b473539-f229-4a88-bc85-f2242510690a tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:43.557781 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8b473539-f229-4a88-bc85-f2242510690a tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:43.558410 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8b473539-f229-4a88-bc85-f2242510690a tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:43.559343 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8b473539-f229-4a88-bc85-f2242510690a tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:43.559963 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8b473539-f229-4a88-bc85-f2242510690a tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:43.560549 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8b473539-f229-4a88-bc85-f2242510690a tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:43.596242 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-21f0bc84-25c3-43a1-80ff-721e0f90ecf0 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/87a4e8b8-79db-43f6-be85-b738382e4699" status: 200 len: 1647 microversion: 2.1 time: 0.194752 Sep 14 08:50:43.611052 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 287/617] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:50:43 2022] GET /compute/v2.1/servers/87a4e8b8-79db-43f6-be85-b738382e4699 => generated 1647 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:50:43.611052 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-6eb2031a-e342-4536-aaf9-245a6714dc4d req-36b1132f-8f81-40ef-a501-aa3a1cfc697a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42265ff9-9c1f-45b6-b92d-0b23de43a8d0", "tag": "770d613b-d641-4aed-936e-2e24f2cbfc9b"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:50:43.612145 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-6eb2031a-e342-4536-aaf9-245a6714dc4d req-36b1132f-8f81-40ef-a501-aa3a1cfc697a service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:43.612827 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-6eb2031a-e342-4536-aaf9-245a6714dc4d req-36b1132f-8f81-40ef-a501-aa3a1cfc697a service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:43.613259 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-6eb2031a-e342-4536-aaf9-245a6714dc4d req-36b1132f-8f81-40ef-a501-aa3a1cfc697a service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:43.626312 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-6eb2031a-e342-4536-aaf9-245a6714dc4d req-36b1132f-8f81-40ef-a501-aa3a1cfc697a service nova] Creating event network-changed:770d613b-d641-4aed-936e-2e24f2cbfc9b for instance 42265ff9-9c1f-45b6-b92d-0b23de43a8d0 on n-h1-836830-18 Sep 14 08:50:43.631797 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-6eb2031a-e342-4536-aaf9-245a6714dc4d req-36b1132f-8f81-40ef-a501-aa3a1cfc697a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033449 Sep 14 08:50:43.632390 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 288/618] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:50:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:50:43.638828 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a407cb94-90f7-441c-91ed-5cd858a3518c tempest-FloatingIPsTestJSON-1993878692 tempest-FloatingIPsTestJSON-1993878692-project] Calling method '.version_select at 0x7f7d448181f0>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:50:43.694071 n-d-836830-18 devstack@n-api.service[128758]: DEBUG neutronclient.v2_0.client [None req-a407cb94-90f7-441c-91ed-5cd858a3518c tempest-FloatingIPsTestJSON-1993878692 tempest-FloatingIPsTestJSON-1993878692-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 9ddfd108-23f5-4ada-9e35-826b8886e7da could not be found", "detail": ""}} {{(pid=128758) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 14 08:50:43.694756 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-a407cb94-90f7-441c-91ed-5cd858a3518c tempest-FloatingIPsTestJSON-1993878692 tempest-FloatingIPsTestJSON-1993878692-project] HTTP exception thrown: Floating IP not found for ID 9ddfd108-23f5-4ada-9e35-826b8886e7da Sep 14 08:50:43.696948 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a407cb94-90f7-441c-91ed-5cd858a3518c tempest-FloatingIPsTestJSON-1993878692 tempest-FloatingIPsTestJSON-1993878692-project] Request method failure captured: Sep 14 08:50:43.696948 n-d-836830-18 devstack@n-api.service[128758]: request: GET /compute/v2.1/os-floating-ips/9ddfd108-23f5-4ada-9e35-826b8886e7da HTTP/1.1 Sep 14 08:50:43.696948 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 08:50:43.696948 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 08:50:43.696948 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 08:50:43.696948 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 08:50:43.696948 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 08:50:43.696948 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 08:50:43.696948 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 08:50:43.696948 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 08:50:43.696948 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZXVmC6lLtVxl-2LCs_WNZgt_5K5LlT923SjoQcmJPA4agkIEtdhl-xtwBf7wBqXb4RSzJOs4JI6UdiP8mzNd9-ToAD8WSPQyqkhMHysocwJYf0suPaczPpJolkkhJvGgJNk3z_xcq-V_nAzI-1X1IozRCE3-2RXdy2MW5cSZNFZGmI Sep 14 08:50:43.696948 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 08:50:43.696948 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 08:50:43.696948 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 08:50:43.696948 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 08:50:43.696948 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 08:50:43.696948 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 08:50:43.696948 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 8a93ed5e2a9f4903a3d7a63eb929bfe6 Sep 14 08:50:43.696948 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-FloatingIPsTestJSON-1993878692 Sep 14 08:50:43.696948 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 08:50:43.696948 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 08:50:43.698461 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/8a93ed5e2a9f4903a3d7a63eb929bfe6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_8a93ed5e2a9f4903a3d7a63eb929bfe6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8a93ed5e2a9f4903a3d7a63eb929bfe6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8a93ed5e2a9f4903a3d7a63eb929bfe6"}]}] Sep 14 08:50:43.698461 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-FloatingIPsTestJSON-1993878692 Sep 14 08:50:43.698461 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 8a93ed5e2a9f4903a3d7a63eb929bfe6 Sep 14 08:50:43.698461 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1993878692 Sep 14 08:50:43.698461 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-FloatingIPsTestJSON-1993878692-project Sep 14 08:50:43.698461 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 08:50:43.698461 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 08:50:43.698461 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 053032d1e74e4bc894fdd8d6f46c0d81 Sep 14 08:50:43.698461 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-FloatingIPsTestJSON-1993878692-project Sep 14 08:50:43.698461 n-d-836830-18 devstack@n-api.service[128758]: method: Sep 14 08:50:43.698461 n-d-836830-18 devstack@n-api.service[128758]: exception: Floating IP not found for ID 9ddfd108-23f5-4ada-9e35-826b8886e7da Sep 14 08:50:43.698461 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': '9ddfd108-23f5-4ada-9e35-826b8886e7da'} Sep 14 08:50:43.698461 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:50:43.699391 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:50:43.699391 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Sep 14 08:50:43.699391 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Sep 14 08:50:43.699391 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 08:50:43.699391 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 08:50:43.699391 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Sep 14 08:50:43.699391 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Sep 14 08:50:43.699391 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 08:50:43.699391 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 08:50:43.699391 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 14 08:50:43.699391 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 14 08:50:43.699391 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 08:50:43.699391 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 08:50:43.699391 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 14 08:50:43.699391 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 14 08:50:43.699391 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 08:50:43.699391 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 08:50:43.699391 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 14 08:50:43.699391 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 14 08:50:43.700539 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 08:50:43.700539 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 08:50:43.700539 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 14 08:50:43.700539 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 14 08:50:43.700539 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 14 08:50:43.700539 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 14 08:50:43.700539 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 9ddfd108-23f5-4ada-9e35-826b8886e7da could not be found Sep 14 08:50:43.700539 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fd317f16-cc54-41e9-8b5e-4bb7a32d8cd3'] Sep 14 08:50:43.700539 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:50:43.700539 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:50:43.700539 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:50:43.700539 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:50:43.700539 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Sep 14 08:50:43.700539 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Sep 14 08:50:43.700539 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Sep 14 08:50:43.700539 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Sep 14 08:50:43.700539 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 9ddfd108-23f5-4ada-9e35-826b8886e7da. Sep 14 08:50:43.700539 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:50:43.700539 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:50:43.700539 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:50:43.701788 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:50:43.701788 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:50:43.701788 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:50:43.701788 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:50:43.701788 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:50:43.701788 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 08:50:43.701788 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 08:50:43.701788 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:50:43.701788 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:50:43.701788 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Sep 14 08:50:43.701788 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 14 08:50:43.701788 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 9ddfd108-23f5-4ada-9e35-826b8886e7da Sep 14 08:50:43.701788 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:50:43.701788 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:50:43.701788 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:50:43.701788 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:50:43.701788 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:50:43.701788 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:50:43.701788 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:50:43.701788 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:50:43.703293 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 9ddfd108-23f5-4ada-9e35-826b8886e7da Sep 14 08:50:43.703293 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:50:43.703293 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a407cb94-90f7-441c-91ed-5cd858a3518c tempest-FloatingIPsTestJSON-1993878692 tempest-FloatingIPsTestJSON-1993878692-project] Returning 404 to user: Floating IP not found for ID 9ddfd108-23f5-4ada-9e35-826b8886e7da {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:50:43.703293 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-a407cb94-90f7-441c-91ed-5cd858a3518c tempest-FloatingIPsTestJSON-1993878692 tempest-FloatingIPsTestJSON-1993878692-project] 10.222.0.60 "GET /compute/v2.1/os-floating-ips/9ddfd108-23f5-4ada-9e35-826b8886e7da" status: 404 len: 111 microversion: 2.1 time: 0.064819 Sep 14 08:50:43.703293 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 289/619] 10.222.0.60 () {58 vars in 1260 bytes} [Wed Sep 14 08:50:43 2022] GET /compute/v2.1/os-floating-ips/9ddfd108-23f5-4ada-9e35-826b8886e7da => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 08:50:43.703293 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ebd1d968-7715-4528-8b1d-47a14637830d tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:50:43.711433 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ebd1d968-7715-4528-8b1d-47a14637830d tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:43.711926 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ebd1d968-7715-4528-8b1d-47a14637830d tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:43.712405 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ebd1d968-7715-4528-8b1d-47a14637830d tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:43.713149 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ebd1d968-7715-4528-8b1d-47a14637830d tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:43.713600 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ebd1d968-7715-4528-8b1d-47a14637830d tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:43.714023 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ebd1d968-7715-4528-8b1d-47a14637830d tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:43.737421 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-ebd1d968-7715-4528-8b1d-47a14637830d tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.037346 Sep 14 08:50:43.739390 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 290/620] 10.222.0.60 () {58 vars in 1176 bytes} [Wed Sep 14 08:50:43 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:50:43.743690 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-8b473539-f229-4a88-bc85-f2242510690a tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:50:43.748775 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d2fb11ef-2a96-430d-9381-4472881b7dbf tempest-FloatingIPsTestJSON-1993878692 tempest-FloatingIPsTestJSON-1993878692-project] Calling method '.version_select at 0x7f7d44818160>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:50:43.754097 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-8b473539-f229-4a88-bc85-f2242510690a tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/e4c51c69-8c2e-4202-9c2f-3dfae93392e9" status: 200 len: 1476 microversion: 2.1 time: 0.214952 Sep 14 08:50:43.755160 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 331/621] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:50:43 2022] GET /compute/v2.1/servers/e4c51c69-8c2e-4202-9c2f-3dfae93392e9 => generated 1476 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:50:43.761397 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d1aa7d6b-39f9-4017-ac5c-1e22122edf56 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-836830-18", "block_migration": true, "disk_over_commit": false}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:50:43.764161 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-d1aa7d6b-39f9-4017-ac5c-1e22122edf56 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] [instance: 87a4e8b8-79db-43f6-be85-b738382e4699] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:50:43.771344 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d1aa7d6b-39f9-4017-ac5c-1e22122edf56 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:43.771835 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d1aa7d6b-39f9-4017-ac5c-1e22122edf56 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:43.772276 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d1aa7d6b-39f9-4017-ac5c-1e22122edf56 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:43.772982 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d1aa7d6b-39f9-4017-ac5c-1e22122edf56 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:43.773531 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d1aa7d6b-39f9-4017-ac5c-1e22122edf56 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:43.773961 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d1aa7d6b-39f9-4017-ac5c-1e22122edf56 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:43.801470 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.objects.instance [None req-d1aa7d6b-39f9-4017-ac5c-1e22122edf56 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Lazy-loading 'flavor' on Instance uuid 87a4e8b8-79db-43f6-be85-b738382e4699 {{(pid=128759) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 08:50:43.804641 n-d-836830-18 devstack@n-api.service[128758]: DEBUG neutronclient.v2_0.client [None req-d2fb11ef-2a96-430d-9381-4472881b7dbf tempest-FloatingIPsTestJSON-1993878692 tempest-FloatingIPsTestJSON-1993878692-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 9ddfd108-23f5-4ada-9e35-826b8886e7da could not be found", "detail": ""}} {{(pid=128758) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 14 08:50:43.805716 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-d2fb11ef-2a96-430d-9381-4472881b7dbf tempest-FloatingIPsTestJSON-1993878692 tempest-FloatingIPsTestJSON-1993878692-project] HTTP exception thrown: Floating IP not found for ID 9ddfd108-23f5-4ada-9e35-826b8886e7da Sep 14 08:50:43.808010 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d2fb11ef-2a96-430d-9381-4472881b7dbf tempest-FloatingIPsTestJSON-1993878692 tempest-FloatingIPsTestJSON-1993878692-project] Request method failure captured: Sep 14 08:50:43.808010 n-d-836830-18 devstack@n-api.service[128758]: request: DELETE /compute/v2.1/os-floating-ips/9ddfd108-23f5-4ada-9e35-826b8886e7da HTTP/1.1 Sep 14 08:50:43.808010 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 08:50:43.808010 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 08:50:43.808010 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 08:50:43.808010 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 08:50:43.808010 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 08:50:43.808010 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 08:50:43.808010 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 08:50:43.808010 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 08:50:43.808010 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZXVmC6lLtVxl-2LCs_WNZgt_5K5LlT923SjoQcmJPA4agkIEtdhl-xtwBf7wBqXb4RSzJOs4JI6UdiP8mzNd9-ToAD8WSPQyqkhMHysocwJYf0suPaczPpJolkkhJvGgJNk3z_xcq-V_nAzI-1X1IozRCE3-2RXdy2MW5cSZNFZGmI Sep 14 08:50:43.808010 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 08:50:43.808010 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 08:50:43.808010 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 08:50:43.808010 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 08:50:43.808010 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 08:50:43.808010 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 08:50:43.808010 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 8a93ed5e2a9f4903a3d7a63eb929bfe6 Sep 14 08:50:43.808010 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-FloatingIPsTestJSON-1993878692 Sep 14 08:50:43.808010 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 08:50:43.808010 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 08:50:43.809569 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/8a93ed5e2a9f4903a3d7a63eb929bfe6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_8a93ed5e2a9f4903a3d7a63eb929bfe6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8a93ed5e2a9f4903a3d7a63eb929bfe6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8a93ed5e2a9f4903a3d7a63eb929bfe6"}]}] Sep 14 08:50:43.809569 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-FloatingIPsTestJSON-1993878692 Sep 14 08:50:43.809569 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 8a93ed5e2a9f4903a3d7a63eb929bfe6 Sep 14 08:50:43.809569 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1993878692 Sep 14 08:50:43.809569 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-FloatingIPsTestJSON-1993878692-project Sep 14 08:50:43.809569 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 08:50:43.809569 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 08:50:43.809569 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 053032d1e74e4bc894fdd8d6f46c0d81 Sep 14 08:50:43.809569 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-FloatingIPsTestJSON-1993878692-project Sep 14 08:50:43.809569 n-d-836830-18 devstack@n-api.service[128758]: method: Sep 14 08:50:43.809569 n-d-836830-18 devstack@n-api.service[128758]: exception: Floating IP not found for ID 9ddfd108-23f5-4ada-9e35-826b8886e7da Sep 14 08:50:43.809569 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': '9ddfd108-23f5-4ada-9e35-826b8886e7da'} Sep 14 08:50:43.809569 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:50:43.810518 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:50:43.810518 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Sep 14 08:50:43.810518 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Sep 14 08:50:43.810518 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 08:50:43.810518 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 08:50:43.810518 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Sep 14 08:50:43.810518 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Sep 14 08:50:43.810518 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 08:50:43.810518 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 08:50:43.810518 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 14 08:50:43.810518 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 14 08:50:43.810518 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 08:50:43.810518 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 08:50:43.810518 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 14 08:50:43.810518 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 14 08:50:43.810518 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 08:50:43.810518 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 08:50:43.810518 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 14 08:50:43.810518 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 14 08:50:43.811923 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 08:50:43.811923 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 08:50:43.811923 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 14 08:50:43.811923 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 14 08:50:43.811923 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 14 08:50:43.811923 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 14 08:50:43.811923 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 9ddfd108-23f5-4ada-9e35-826b8886e7da could not be found Sep 14 08:50:43.811923 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1fda9eb1-dbaf-4c07-931e-bb7ebb6c2e3e'] Sep 14 08:50:43.811923 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:50:43.811923 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:50:43.811923 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:50:43.811923 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:50:43.811923 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Sep 14 08:50:43.811923 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Sep 14 08:50:43.811923 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Sep 14 08:50:43.811923 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Sep 14 08:50:43.811923 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 9ddfd108-23f5-4ada-9e35-826b8886e7da. Sep 14 08:50:43.811923 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:50:43.811923 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:50:43.811923 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:50:43.813737 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:50:43.813737 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:50:43.813737 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:50:43.813737 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:50:43.813737 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:50:43.813737 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 08:50:43.813737 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 08:50:43.813737 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:50:43.813737 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:50:43.813737 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Sep 14 08:50:43.813737 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 14 08:50:43.813737 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 9ddfd108-23f5-4ada-9e35-826b8886e7da Sep 14 08:50:43.813737 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:50:43.813737 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:50:43.813737 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:50:43.813737 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:50:43.813737 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:50:43.813737 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:50:43.813737 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:50:43.813737 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:50:43.815174 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 9ddfd108-23f5-4ada-9e35-826b8886e7da Sep 14 08:50:43.815174 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:50:43.815174 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d2fb11ef-2a96-430d-9381-4472881b7dbf tempest-FloatingIPsTestJSON-1993878692 tempest-FloatingIPsTestJSON-1993878692-project] Returning 404 to user: Floating IP not found for ID 9ddfd108-23f5-4ada-9e35-826b8886e7da {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:50:43.815174 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-d2fb11ef-2a96-430d-9381-4472881b7dbf tempest-FloatingIPsTestJSON-1993878692 tempest-FloatingIPsTestJSON-1993878692-project] 10.222.0.60 "DELETE /compute/v2.1/os-floating-ips/9ddfd108-23f5-4ada-9e35-826b8886e7da" status: 404 len: 111 microversion: 2.1 time: 0.071966 Sep 14 08:50:43.815174 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 291/622] 10.222.0.60 () {58 vars in 1263 bytes} [Wed Sep 14 08:50:43 2022] DELETE /compute/v2.1/os-floating-ips/9ddfd108-23f5-4ada-9e35-826b8886e7da => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 08:50:43.824170 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-d1aa7d6b-39f9-4017-ac5c-1e22122edf56 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] [instance: 87a4e8b8-79db-43f6-be85-b738382e4699] Going to try to live migrate instance to n-h2-836830-18 {{(pid=128759) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 14 08:50:44.088602 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-12f8411f-5195-4056-8c72-34a1ce98202d tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:50:44.089859 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-12f8411f-5195-4056-8c72-34a1ce98202d tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] [instance: c402c828-5101-40cc-8ac8-b3d1470028ed] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:50:44.101558 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-12f8411f-5195-4056-8c72-34a1ce98202d tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:44.102408 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-12f8411f-5195-4056-8c72-34a1ce98202d tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:44.103127 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-12f8411f-5195-4056-8c72-34a1ce98202d tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:44.104285 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-12f8411f-5195-4056-8c72-34a1ce98202d tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:44.105548 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-12f8411f-5195-4056-8c72-34a1ce98202d tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:44.106498 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-12f8411f-5195-4056-8c72-34a1ce98202d tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:44.145163 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-12f8411f-5195-4056-8c72-34a1ce98202d tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:44.145954 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-12f8411f-5195-4056-8c72-34a1ce98202d tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:44.146398 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-12f8411f-5195-4056-8c72-34a1ce98202d tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:44.147056 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.objects.instance [None req-12f8411f-5195-4056-8c72-34a1ce98202d tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Lazy-loading 'fault' on Instance uuid c402c828-5101-40cc-8ac8-b3d1470028ed {{(pid=128758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 08:50:44.227032 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-12f8411f-5195-4056-8c72-34a1ce98202d tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2290f39b61044661aa9bec206794a5c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '919dd9619fb24ee281cf6d96cf3351df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:50:44.238768 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-12f8411f-5195-4056-8c72-34a1ce98202d tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] 10.222.0.60 "GET /compute/v2.1/servers/c402c828-5101-40cc-8ac8-b3d1470028ed" status: 200 len: 1322 microversion: 2.1 time: 0.156228 Sep 14 08:50:44.241225 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 292/623] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:50:44 2022] GET /compute/v2.1/servers/c402c828-5101-40cc-8ac8-b3d1470028ed => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:50:44.344112 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-813bd596-6c29-43cd-854b-53d31edfebe0 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:50:44.344756 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-813bd596-6c29-43cd-854b-53d31edfebe0 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: 5059f5d9-6903-4cf4-a999-01d2d2ba0842] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:50:44.351370 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-813bd596-6c29-43cd-854b-53d31edfebe0 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:44.351925 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-813bd596-6c29-43cd-854b-53d31edfebe0 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:44.352366 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-813bd596-6c29-43cd-854b-53d31edfebe0 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:44.353090 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-813bd596-6c29-43cd-854b-53d31edfebe0 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:44.353700 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-813bd596-6c29-43cd-854b-53d31edfebe0 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:44.354121 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-813bd596-6c29-43cd-854b-53d31edfebe0 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:44.589154 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-813bd596-6c29-43cd-854b-53d31edfebe0 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:50:44.600725 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-813bd596-6c29-43cd-854b-53d31edfebe0 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:50:44.602584 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-813bd596-6c29-43cd-854b-53d31edfebe0 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:50:44.604415 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-813bd596-6c29-43cd-854b-53d31edfebe0 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/5059f5d9-6903-4cf4-a999-01d2d2ba0842" status: 200 len: 1566 microversion: 2.25 time: 0.264596 Sep 14 08:50:44.605506 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 293/624] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:50:44 2022] GET /compute/v2.1/servers/5059f5d9-6903-4cf4-a999-01d2d2ba0842 => generated 1566 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 08:50:44.617441 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-8e1140e7-dabf-4b1e-bbb4-0a3ceb428e50 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:50:44.618605 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-8e1140e7-dabf-4b1e-bbb4-0a3ceb428e50 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] [instance: 3f9e2d1a-9899-4046-b2af-939db32442b7] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:50:44.626660 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8e1140e7-dabf-4b1e-bbb4-0a3ceb428e50 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:44.627241 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8e1140e7-dabf-4b1e-bbb4-0a3ceb428e50 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:44.627870 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8e1140e7-dabf-4b1e-bbb4-0a3ceb428e50 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:44.628725 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8e1140e7-dabf-4b1e-bbb4-0a3ceb428e50 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:44.629326 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8e1140e7-dabf-4b1e-bbb4-0a3ceb428e50 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:44.629899 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8e1140e7-dabf-4b1e-bbb4-0a3ceb428e50 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:44.976350 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-8e1140e7-dabf-4b1e-bbb4-0a3ceb428e50 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c7802984cf48d1852832b52abe52e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e326f95a9604fdb9bd075db3837cf62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:50:44.984552 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-8e1140e7-dabf-4b1e-bbb4-0a3ceb428e50 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] 10.222.0.60 "GET /compute/v2.1/servers/3f9e2d1a-9899-4046-b2af-939db32442b7" status: 200 len: 1319 microversion: 2.1 time: 0.377805 Sep 14 08:50:44.985856 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 294/625] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:50:44 2022] GET /compute/v2.1/servers/3f9e2d1a-9899-4046-b2af-939db32442b7 => generated 1319 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:50:45.060792 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-f76646ca-a0f9-4d9e-b023-bd493db46a79 tempest-ServicesAdminTestJSON-1692687279 tempest-ServicesAdminTestJSON-1692687279-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:50:45.065923 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f76646ca-a0f9-4d9e-b023-bd493db46a79 tempest-ServicesAdminTestJSON-1692687279 tempest-ServicesAdminTestJSON-1692687279-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:45.066603 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f76646ca-a0f9-4d9e-b023-bd493db46a79 tempest-ServicesAdminTestJSON-1692687279 tempest-ServicesAdminTestJSON-1692687279-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:45.067273 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f76646ca-a0f9-4d9e-b023-bd493db46a79 tempest-ServicesAdminTestJSON-1692687279 tempest-ServicesAdminTestJSON-1692687279-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:45.068830 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f76646ca-a0f9-4d9e-b023-bd493db46a79 tempest-ServicesAdminTestJSON-1692687279 tempest-ServicesAdminTestJSON-1692687279-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:45.069477 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f76646ca-a0f9-4d9e-b023-bd493db46a79 tempest-ServicesAdminTestJSON-1692687279 tempest-ServicesAdminTestJSON-1692687279-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:45.070089 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f76646ca-a0f9-4d9e-b023-bd493db46a79 tempest-ServicesAdminTestJSON-1692687279 tempest-ServicesAdminTestJSON-1692687279-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:45.108170 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-f76646ca-a0f9-4d9e-b023-bd493db46a79 tempest-ServicesAdminTestJSON-1692687279 tempest-ServicesAdminTestJSON-1692687279-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.121005 Sep 14 08:50:45.119346 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 295/626] 10.222.0.60 () {58 vars in 1137 bytes} [Wed Sep 14 08:50:44 2022] GET /compute/v2.1/os-services => generated 949 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:50:45.125508 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-15143811-10da-41aa-bcd5-1bf042cb3576 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:50:45.126135 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-15143811-10da-41aa-bcd5-1bf042cb3576 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: e4c51c69-8c2e-4202-9c2f-3dfae93392e9] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:50:45.133711 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-15143811-10da-41aa-bcd5-1bf042cb3576 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:45.134752 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-15143811-10da-41aa-bcd5-1bf042cb3576 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:45.135219 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-15143811-10da-41aa-bcd5-1bf042cb3576 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:45.135992 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-15143811-10da-41aa-bcd5-1bf042cb3576 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:45.136877 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-15143811-10da-41aa-bcd5-1bf042cb3576 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:45.136877 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-15143811-10da-41aa-bcd5-1bf042cb3576 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:45.167782 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=22 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:50:45.525948 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-15143811-10da-41aa-bcd5-1bf042cb3576 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:50:45.538252 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-15143811-10da-41aa-bcd5-1bf042cb3576 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/e4c51c69-8c2e-4202-9c2f-3dfae93392e9" status: 200 len: 1476 microversion: 2.1 time: 0.428015 Sep 14 08:50:45.538955 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 296/627] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:50:45 2022] GET /compute/v2.1/servers/e4c51c69-8c2e-4202-9c2f-3dfae93392e9 => generated 1476 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:50:45.543677 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a05ace89-6c65-40d7-9020-9fb11da6b280 tempest-ServicesAdminTestJSON-1692687279 tempest-ServicesAdminTestJSON-1692687279-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:50:45.556934 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a05ace89-6c65-40d7-9020-9fb11da6b280 tempest-ServicesAdminTestJSON-1692687279 tempest-ServicesAdminTestJSON-1692687279-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:45.558464 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a05ace89-6c65-40d7-9020-9fb11da6b280 tempest-ServicesAdminTestJSON-1692687279 tempest-ServicesAdminTestJSON-1692687279-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:45.563391 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a05ace89-6c65-40d7-9020-9fb11da6b280 tempest-ServicesAdminTestJSON-1692687279 tempest-ServicesAdminTestJSON-1692687279-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:45.565042 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a05ace89-6c65-40d7-9020-9fb11da6b280 tempest-ServicesAdminTestJSON-1692687279 tempest-ServicesAdminTestJSON-1692687279-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:45.565949 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a05ace89-6c65-40d7-9020-9fb11da6b280 tempest-ServicesAdminTestJSON-1692687279 tempest-ServicesAdminTestJSON-1692687279-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:45.566814 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a05ace89-6c65-40d7-9020-9fb11da6b280 tempest-ServicesAdminTestJSON-1692687279 tempest-ServicesAdminTestJSON-1692687279-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:45.602522 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-a05ace89-6c65-40d7-9020-9fb11da6b280 tempest-ServicesAdminTestJSON-1692687279 tempest-ServicesAdminTestJSON-1692687279-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services?host=n-d-836830-18" status: 200 len: 581 microversion: 2.1 time: 0.062062 Sep 14 08:50:45.604139 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 297/628] 10.222.0.60 () {58 vars in 1174 bytes} [Wed Sep 14 08:50:45 2022] GET /compute/v2.1/os-services?host=n-d-836830-18 => generated 581 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:50:45.617799 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-0efe7dd2-7372-4f3b-91c3-8ce208f7bf01 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:50:45.619110 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-0efe7dd2-7372-4f3b-91c3-8ce208f7bf01 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] [instance: c402c828-5101-40cc-8ac8-b3d1470028ed] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:50:45.643413 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0efe7dd2-7372-4f3b-91c3-8ce208f7bf01 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:45.643737 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0efe7dd2-7372-4f3b-91c3-8ce208f7bf01 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:45.644792 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0efe7dd2-7372-4f3b-91c3-8ce208f7bf01 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:45.646387 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0efe7dd2-7372-4f3b-91c3-8ce208f7bf01 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:45.654761 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0efe7dd2-7372-4f3b-91c3-8ce208f7bf01 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:45.655714 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0efe7dd2-7372-4f3b-91c3-8ce208f7bf01 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:45.682004 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-0efe7dd2-7372-4f3b-91c3-8ce208f7bf01 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] HTTP exception thrown: Instance c402c828-5101-40cc-8ac8-b3d1470028ed could not be found. Sep 14 08:50:45.685047 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-0efe7dd2-7372-4f3b-91c3-8ce208f7bf01 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Request method failure captured: Sep 14 08:50:45.685047 n-d-836830-18 devstack@n-api.service[128758]: request: GET /compute/v2.1/servers/c402c828-5101-40cc-8ac8-b3d1470028ed HTTP/1.1 Sep 14 08:50:45.685047 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 08:50:45.685047 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 08:50:45.685047 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 08:50:45.685047 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 08:50:45.685047 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 08:50:45.685047 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 08:50:45.685047 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 08:50:45.685047 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 08:50:45.685047 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZWTldFMv0tHd5a7Ks8uSId48hq738jXhgisWp3KuNXYOOwtDEA93GrCvsvMh8LBKWuxryMRJNeZ_djWm5PqkEKm4zP_p_hlJivtVNyHBAXQbzCzmw4ZR0JAQEfiU2nojnC3xdqWXWwglnogL3YZGi4JL0DjC2paGgvKXnMgsbUaKug Sep 14 08:50:45.685047 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 08:50:45.685047 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 08:50:45.685047 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 08:50:45.685047 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 08:50:45.685047 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 08:50:45.685047 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 08:50:45.685047 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 919dd9619fb24ee281cf6d96cf3351df Sep 14 08:50:45.685047 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 Sep 14 08:50:45.685047 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 08:50:45.685047 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 08:50:45.686707 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/919dd9619fb24ee281cf6d96cf3351df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_919dd9619fb24ee281cf6d96cf3351df"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/919dd9619fb24ee281cf6d96cf3351df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/919dd9619fb24ee281cf6d96cf3351df"}]}] Sep 14 08:50:45.686707 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 Sep 14 08:50:45.686707 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 919dd9619fb24ee281cf6d96cf3351df Sep 14 08:50:45.686707 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 Sep 14 08:50:45.686707 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project Sep 14 08:50:45.686707 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 08:50:45.686707 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 08:50:45.686707 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 2290f39b61044661aa9bec206794a5c8 Sep 14 08:50:45.686707 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project Sep 14 08:50:45.686707 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 08:50:45.686707 n-d-836830-18 devstack@n-api.service[128758]: exception: Instance c402c828-5101-40cc-8ac8-b3d1470028ed could not be found. Sep 14 08:50:45.687703 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': 'c402c828-5101-40cc-8ac8-b3d1470028ed'} Sep 14 08:50:45.687703 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:50:45.687703 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:50:45.687703 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 08:50:45.687703 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 08:50:45.687703 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 08:50:45.687703 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 08:50:45.687703 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 08:50:45.687703 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 08:50:45.687703 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 08:50:45.687703 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 08:50:45.687703 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c402c828-5101-40cc-8ac8-b3d1470028ed could not be found. Sep 14 08:50:45.687703 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:50:45.687703 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:50:45.687703 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:50:45.687703 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:50:45.687703 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:50:45.687703 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:50:45.687703 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:50:45.687703 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:50:45.689167 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:50:45.689167 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:50:45.689167 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 08:50:45.689167 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 08:50:45.689167 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 08:50:45.689167 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 08:50:45.689167 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 08:50:45.689167 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 08:50:45.689167 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c402c828-5101-40cc-8ac8-b3d1470028ed could not be found. Sep 14 08:50:45.689167 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:50:45.689167 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:50:45.689167 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:50:45.689167 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:50:45.689167 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:50:45.689167 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:50:45.689167 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:50:45.689167 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:50:45.689167 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c402c828-5101-40cc-8ac8-b3d1470028ed could not be found. Sep 14 08:50:45.689167 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:50:45.697301 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-0efe7dd2-7372-4f3b-91c3-8ce208f7bf01 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] Returning 404 to user: Instance c402c828-5101-40cc-8ac8-b3d1470028ed could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:50:45.699289 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-0efe7dd2-7372-4f3b-91c3-8ce208f7bf01 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956 tempest-FloatingIPsAssociationNegativeTestJSON-1678759956-project] 10.222.0.60 "GET /compute/v2.1/servers/c402c828-5101-40cc-8ac8-b3d1470028ed" status: 404 len: 111 microversion: 2.1 time: 0.093616 Sep 14 08:50:45.700381 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 298/629] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:50:45 2022] GET /compute/v2.1/servers/c402c828-5101-40cc-8ac8-b3d1470028ed => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 08:50:45.708303 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-73a72c0a-124f-48a7-9353-2e11da75c6cb req-d92c257d-07dc-402f-81de-8c42418e4204 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5059f5d9-6903-4cf4-a999-01d2d2ba0842", "name": "network-vif-unplugged", "status": "completed", "tag": "0b18a372-58a0-4acd-a4e8-de3db7d03c42"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:50:45.722260 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-73a72c0a-124f-48a7-9353-2e11da75c6cb req-d92c257d-07dc-402f-81de-8c42418e4204 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:45.723622 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-73a72c0a-124f-48a7-9353-2e11da75c6cb req-d92c257d-07dc-402f-81de-8c42418e4204 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:45.723622 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-73a72c0a-124f-48a7-9353-2e11da75c6cb req-d92c257d-07dc-402f-81de-8c42418e4204 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:45.745342 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-73a72c0a-124f-48a7-9353-2e11da75c6cb req-d92c257d-07dc-402f-81de-8c42418e4204 service nova] Creating event network-vif-unplugged:0b18a372-58a0-4acd-a4e8-de3db7d03c42 for instance 5059f5d9-6903-4cf4-a999-01d2d2ba0842 on n-h2-836830-18 Sep 14 08:50:45.756990 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-73a72c0a-124f-48a7-9353-2e11da75c6cb req-d92c257d-07dc-402f-81de-8c42418e4204 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055074 Sep 14 08:50:45.757869 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 299/630] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:50:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:50:45.764438 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-e5538ac5-d164-4e26-bc7b-133d1bf9a91f tempest-ServicesAdminTestJSON-1692687279 tempest-ServicesAdminTestJSON-1692687279-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:50:45.768578 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e5538ac5-d164-4e26-bc7b-133d1bf9a91f tempest-ServicesAdminTestJSON-1692687279 tempest-ServicesAdminTestJSON-1692687279-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:45.773807 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e5538ac5-d164-4e26-bc7b-133d1bf9a91f tempest-ServicesAdminTestJSON-1692687279 tempest-ServicesAdminTestJSON-1692687279-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:45.774613 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e5538ac5-d164-4e26-bc7b-133d1bf9a91f tempest-ServicesAdminTestJSON-1692687279 tempest-ServicesAdminTestJSON-1692687279-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:45.776307 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e5538ac5-d164-4e26-bc7b-133d1bf9a91f tempest-ServicesAdminTestJSON-1692687279 tempest-ServicesAdminTestJSON-1692687279-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:45.777251 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e5538ac5-d164-4e26-bc7b-133d1bf9a91f tempest-ServicesAdminTestJSON-1692687279 tempest-ServicesAdminTestJSON-1692687279-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:45.778660 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e5538ac5-d164-4e26-bc7b-133d1bf9a91f tempest-ServicesAdminTestJSON-1692687279 tempest-ServicesAdminTestJSON-1692687279-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:45.839617 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-e5538ac5-d164-4e26-bc7b-133d1bf9a91f tempest-ServicesAdminTestJSON-1692687279 tempest-ServicesAdminTestJSON-1692687279-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.078866 Sep 14 08:50:45.850656 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 300/631] 10.222.0.60 () {58 vars in 1176 bytes} [Wed Sep 14 08:50:45 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:50:45.857658 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-3f1674b9-c724-4538-bdd5-3192469fbbca tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:50:45.858753 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-3f1674b9-c724-4538-bdd5-3192469fbbca tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: 5059f5d9-6903-4cf4-a999-01d2d2ba0842] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:50:45.872838 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3f1674b9-c724-4538-bdd5-3192469fbbca tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:45.873707 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3f1674b9-c724-4538-bdd5-3192469fbbca tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:45.874380 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3f1674b9-c724-4538-bdd5-3192469fbbca tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:45.875401 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3f1674b9-c724-4538-bdd5-3192469fbbca tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:45.876087 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3f1674b9-c724-4538-bdd5-3192469fbbca tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:45.876740 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3f1674b9-c724-4538-bdd5-3192469fbbca tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:46.044362 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d1aa7d6b-39f9-4017-ac5c-1e22122edf56 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/87a4e8b8-79db-43f6-be85-b738382e4699/action" status: 202 len: 0 microversion: 2.1 time: 2.287457 Sep 14 08:50:46.045796 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 332/632] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 08:50:43 2022] POST /compute/v2.1/servers/87a4e8b8-79db-43f6-be85-b738382e4699/action => generated 0 bytes in 2290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 08:50:46.052020 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-31ef126a-ad0a-431c-9f84-05d0488c9fa9 tempest-ServicesAdminTestJSON-1692687279 tempest-ServicesAdminTestJSON-1692687279-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:50:46.060567 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-31ef126a-ad0a-431c-9f84-05d0488c9fa9 tempest-ServicesAdminTestJSON-1692687279 tempest-ServicesAdminTestJSON-1692687279-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:46.061067 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-31ef126a-ad0a-431c-9f84-05d0488c9fa9 tempest-ServicesAdminTestJSON-1692687279 tempest-ServicesAdminTestJSON-1692687279-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:46.061679 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-31ef126a-ad0a-431c-9f84-05d0488c9fa9 tempest-ServicesAdminTestJSON-1692687279 tempest-ServicesAdminTestJSON-1692687279-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:46.063066 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-31ef126a-ad0a-431c-9f84-05d0488c9fa9 tempest-ServicesAdminTestJSON-1692687279 tempest-ServicesAdminTestJSON-1692687279-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:46.063707 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-31ef126a-ad0a-431c-9f84-05d0488c9fa9 tempest-ServicesAdminTestJSON-1692687279 tempest-ServicesAdminTestJSON-1692687279-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:46.064980 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-31ef126a-ad0a-431c-9f84-05d0488c9fa9 tempest-ServicesAdminTestJSON-1692687279 tempest-ServicesAdminTestJSON-1692687279-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:46.097900 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-31ef126a-ad0a-431c-9f84-05d0488c9fa9 tempest-ServicesAdminTestJSON-1692687279 tempest-ServicesAdminTestJSON-1692687279-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.050903 Sep 14 08:50:46.098580 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 333/633] 10.222.0.60 () {58 vars in 1137 bytes} [Wed Sep 14 08:50:46 2022] GET /compute/v2.1/os-services => generated 949 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:50:46.105465 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-eaa220d7-aa17-4064-aac8-c530e1a581ff tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:50:46.106375 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-eaa220d7-aa17-4064-aac8-c530e1a581ff tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] [instance: 3f9e2d1a-9899-4046-b2af-939db32442b7] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:50:46.117858 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-eaa220d7-aa17-4064-aac8-c530e1a581ff tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:46.120146 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-eaa220d7-aa17-4064-aac8-c530e1a581ff tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:46.120855 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-eaa220d7-aa17-4064-aac8-c530e1a581ff tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:46.121804 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-eaa220d7-aa17-4064-aac8-c530e1a581ff tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:46.122487 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-eaa220d7-aa17-4064-aac8-c530e1a581ff tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:46.123525 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-eaa220d7-aa17-4064-aac8-c530e1a581ff tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:46.604302 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-3f1674b9-c724-4538-bdd5-3192469fbbca tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:50:46.613496 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-3f1674b9-c724-4538-bdd5-3192469fbbca tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:50:46.615153 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-3f1674b9-c724-4538-bdd5-3192469fbbca tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:50:46.616788 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-3f1674b9-c724-4538-bdd5-3192469fbbca tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/5059f5d9-6903-4cf4-a999-01d2d2ba0842" status: 200 len: 1566 microversion: 2.25 time: 0.763870 Sep 14 08:50:46.630967 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 301/634] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:50:45 2022] GET /compute/v2.1/servers/5059f5d9-6903-4cf4-a999-01d2d2ba0842 => generated 1566 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:50:46.630967 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-617106c2-3fdf-416b-9147-dd3f7e0c7582 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:50:46.630967 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-617106c2-3fdf-416b-9147-dd3f7e0c7582 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: 87a4e8b8-79db-43f6-be85-b738382e4699] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:50:46.631356 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-617106c2-3fdf-416b-9147-dd3f7e0c7582 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:46.631729 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-617106c2-3fdf-416b-9147-dd3f7e0c7582 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:46.632429 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-617106c2-3fdf-416b-9147-dd3f7e0c7582 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:46.633414 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-617106c2-3fdf-416b-9147-dd3f7e0c7582 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:46.634596 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-617106c2-3fdf-416b-9147-dd3f7e0c7582 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:46.635300 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-617106c2-3fdf-416b-9147-dd3f7e0c7582 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:46.871207 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-eaa220d7-aa17-4064-aac8-c530e1a581ff tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c7802984cf48d1852832b52abe52e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e326f95a9604fdb9bd075db3837cf62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:50:46.880746 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-eaa220d7-aa17-4064-aac8-c530e1a581ff tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] 10.222.0.60 "GET /compute/v2.1/servers/3f9e2d1a-9899-4046-b2af-939db32442b7" status: 200 len: 1319 microversion: 2.1 time: 0.779477 Sep 14 08:50:46.881713 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 334/635] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:50:46 2022] GET /compute/v2.1/servers/3f9e2d1a-9899-4046-b2af-939db32442b7 => generated 1319 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:50:46.887185 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-92db10f0-89c7-48c7-9f8c-303b460ccb88 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:50:46.887922 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-92db10f0-89c7-48c7-9f8c-303b460ccb88 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: e4c51c69-8c2e-4202-9c2f-3dfae93392e9] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:50:46.899274 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-92db10f0-89c7-48c7-9f8c-303b460ccb88 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:46.900455 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-92db10f0-89c7-48c7-9f8c-303b460ccb88 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:46.901610 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-92db10f0-89c7-48c7-9f8c-303b460ccb88 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:46.903352 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-92db10f0-89c7-48c7-9f8c-303b460ccb88 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:46.904074 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-92db10f0-89c7-48c7-9f8c-303b460ccb88 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:46.904589 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-92db10f0-89c7-48c7-9f8c-303b460ccb88 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:47.124401 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-617106c2-3fdf-416b-9147-dd3f7e0c7582 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:50:47.160015 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-617106c2-3fdf-416b-9147-dd3f7e0c7582 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/87a4e8b8-79db-43f6-be85-b738382e4699" status: 200 len: 1504 microversion: 2.1 time: 0.540959 Sep 14 08:50:47.162765 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 302/636] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:50:46 2022] GET /compute/v2.1/servers/87a4e8b8-79db-43f6-be85-b738382e4699 => generated 1504 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:50:47.172648 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-a3bbf16c-aa43-481d-91da-3ba26897c6fd req-5b5565f6-e5cd-42c0-9d02-6e8281782fb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42265ff9-9c1f-45b6-b92d-0b23de43a8d0", "name": "network-vif-plugged", "status": "completed", "tag": "770d613b-d641-4aed-936e-2e24f2cbfc9b"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:50:47.200578 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-a3bbf16c-aa43-481d-91da-3ba26897c6fd req-5b5565f6-e5cd-42c0-9d02-6e8281782fb0 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:47.201052 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-a3bbf16c-aa43-481d-91da-3ba26897c6fd req-5b5565f6-e5cd-42c0-9d02-6e8281782fb0 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:47.201486 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-a3bbf16c-aa43-481d-91da-3ba26897c6fd req-5b5565f6-e5cd-42c0-9d02-6e8281782fb0 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:47.220925 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-a3bbf16c-aa43-481d-91da-3ba26897c6fd req-5b5565f6-e5cd-42c0-9d02-6e8281782fb0 service nova] Creating event network-vif-plugged:770d613b-d641-4aed-936e-2e24f2cbfc9b for instance 42265ff9-9c1f-45b6-b92d-0b23de43a8d0 on n-h1-836830-18 Sep 14 08:50:47.229800 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-a3bbf16c-aa43-481d-91da-3ba26897c6fd req-5b5565f6-e5cd-42c0-9d02-6e8281782fb0 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064462 Sep 14 08:50:47.232689 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 303/637] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:50:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:50:47.436802 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-92db10f0-89c7-48c7-9f8c-303b460ccb88 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:50:47.465203 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-92db10f0-89c7-48c7-9f8c-303b460ccb88 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/e4c51c69-8c2e-4202-9c2f-3dfae93392e9" status: 200 len: 1476 microversion: 2.1 time: 0.581244 Sep 14 08:50:47.467262 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 335/638] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:50:46 2022] GET /compute/v2.1/servers/e4c51c69-8c2e-4202-9c2f-3dfae93392e9 => generated 1476 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:50:47.651240 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-bd145091-1732-4da4-b63f-acd356f9b66f tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:50:47.652573 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-bd145091-1732-4da4-b63f-acd356f9b66f tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: 5059f5d9-6903-4cf4-a999-01d2d2ba0842] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:50:47.674232 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bd145091-1732-4da4-b63f-acd356f9b66f tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:47.675023 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bd145091-1732-4da4-b63f-acd356f9b66f tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:47.676882 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bd145091-1732-4da4-b63f-acd356f9b66f tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:47.682098 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bd145091-1732-4da4-b63f-acd356f9b66f tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:47.683578 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bd145091-1732-4da4-b63f-acd356f9b66f tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:47.684023 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bd145091-1732-4da4-b63f-acd356f9b66f tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:47.907391 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3de92f26-9a54-4e38-8005-f4451f569fe8 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:50:47.908515 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-3de92f26-9a54-4e38-8005-f4451f569fe8 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] [instance: 3f9e2d1a-9899-4046-b2af-939db32442b7] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:50:47.917689 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3de92f26-9a54-4e38-8005-f4451f569fe8 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:47.920494 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3de92f26-9a54-4e38-8005-f4451f569fe8 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:47.923809 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3de92f26-9a54-4e38-8005-f4451f569fe8 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:47.924972 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3de92f26-9a54-4e38-8005-f4451f569fe8 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:47.925775 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3de92f26-9a54-4e38-8005-f4451f569fe8 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:47.926562 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3de92f26-9a54-4e38-8005-f4451f569fe8 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:48.129968 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-bd145091-1732-4da4-b63f-acd356f9b66f tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:50:48.138867 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-bd145091-1732-4da4-b63f-acd356f9b66f tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:50:48.140773 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-bd145091-1732-4da4-b63f-acd356f9b66f tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:50:48.142206 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-bd145091-1732-4da4-b63f-acd356f9b66f tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/5059f5d9-6903-4cf4-a999-01d2d2ba0842" status: 200 len: 1566 microversion: 2.25 time: 0.499846 Sep 14 08:50:48.155720 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 304/639] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:50:47 2022] GET /compute/v2.1/servers/5059f5d9-6903-4cf4-a999-01d2d2ba0842 => generated 1566 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:50:48.167076 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-b709ded7-839f-4b24-82cc-23748d01a48b req-90fdb8c2-5461-4b0b-a3a7-f520f4279474 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5059f5d9-6903-4cf4-a999-01d2d2ba0842", "tag": "0b18a372-58a0-4acd-a4e8-de3db7d03c42"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:50:48.176714 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-b709ded7-839f-4b24-82cc-23748d01a48b req-90fdb8c2-5461-4b0b-a3a7-f520f4279474 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:48.177526 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-b709ded7-839f-4b24-82cc-23748d01a48b req-90fdb8c2-5461-4b0b-a3a7-f520f4279474 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:48.178178 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-b709ded7-839f-4b24-82cc-23748d01a48b req-90fdb8c2-5461-4b0b-a3a7-f520f4279474 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:48.190447 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-b709ded7-839f-4b24-82cc-23748d01a48b req-90fdb8c2-5461-4b0b-a3a7-f520f4279474 service nova] Creating event network-changed:0b18a372-58a0-4acd-a4e8-de3db7d03c42 for instance 5059f5d9-6903-4cf4-a999-01d2d2ba0842 on n-h2-836830-18 Sep 14 08:50:48.196198 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-b709ded7-839f-4b24-82cc-23748d01a48b req-90fdb8c2-5461-4b0b-a3a7-f520f4279474 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038756 Sep 14 08:50:48.198201 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 305/640] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:50:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:50:48.205211 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-43e65697-6b5c-4c4e-bdf7-aa02881e7e94 req-4cda4e2c-0480-493f-9d9a-6b5a0be873c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87a4e8b8-79db-43f6-be85-b738382e4699", "name": "network-vif-unplugged", "status": "completed", "tag": "94536d67-6c5b-4f6a-b61f-3534a3426e05"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:50:48.218450 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-43e65697-6b5c-4c4e-bdf7-aa02881e7e94 req-4cda4e2c-0480-493f-9d9a-6b5a0be873c3 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:48.219293 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-43e65697-6b5c-4c4e-bdf7-aa02881e7e94 req-4cda4e2c-0480-493f-9d9a-6b5a0be873c3 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:48.219952 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-43e65697-6b5c-4c4e-bdf7-aa02881e7e94 req-4cda4e2c-0480-493f-9d9a-6b5a0be873c3 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:48.242210 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-43e65697-6b5c-4c4e-bdf7-aa02881e7e94 req-4cda4e2c-0480-493f-9d9a-6b5a0be873c3 service nova] Creating event network-vif-unplugged:94536d67-6c5b-4f6a-b61f-3534a3426e05 for instance 87a4e8b8-79db-43f6-be85-b738382e4699 on n-h1-836830-18 Sep 14 08:50:48.250742 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-43e65697-6b5c-4c4e-bdf7-aa02881e7e94 req-4cda4e2c-0480-493f-9d9a-6b5a0be873c3 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050646 Sep 14 08:50:48.251522 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 306/641] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:50:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:50:48.258485 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-686a94bf-4339-4991-a797-a53728067872 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:50:48.260009 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-686a94bf-4339-4991-a797-a53728067872 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: 87a4e8b8-79db-43f6-be85-b738382e4699] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:50:48.265694 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:50:48.267623 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-686a94bf-4339-4991-a797-a53728067872 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:48.268198 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-686a94bf-4339-4991-a797-a53728067872 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:48.268692 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-686a94bf-4339-4991-a797-a53728067872 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:48.269607 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-686a94bf-4339-4991-a797-a53728067872 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:48.270299 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-686a94bf-4339-4991-a797-a53728067872 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:48.270929 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-686a94bf-4339-4991-a797-a53728067872 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:48.292513 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:50:48.424396 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-3de92f26-9a54-4e38-8005-f4451f569fe8 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c7802984cf48d1852832b52abe52e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e326f95a9604fdb9bd075db3837cf62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:50:48.433029 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:50:48.435969 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-3de92f26-9a54-4e38-8005-f4451f569fe8 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] 10.222.0.60 "GET /compute/v2.1/servers/3f9e2d1a-9899-4046-b2af-939db32442b7" status: 200 len: 1319 microversion: 2.1 time: 0.533011 Sep 14 08:50:48.447736 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 336/642] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:50:47 2022] GET /compute/v2.1/servers/3f9e2d1a-9899-4046-b2af-939db32442b7 => generated 1319 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:50:48.496632 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-370ea071-8fdb-414c-a71b-bd152f44467e tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:50:48.497249 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-370ea071-8fdb-414c-a71b-bd152f44467e tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: e4c51c69-8c2e-4202-9c2f-3dfae93392e9] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:50:48.504559 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-370ea071-8fdb-414c-a71b-bd152f44467e tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:48.505044 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-370ea071-8fdb-414c-a71b-bd152f44467e tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:48.505671 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-370ea071-8fdb-414c-a71b-bd152f44467e tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:48.506616 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-370ea071-8fdb-414c-a71b-bd152f44467e tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:48.507102 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-370ea071-8fdb-414c-a71b-bd152f44467e tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:48.507523 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-370ea071-8fdb-414c-a71b-bd152f44467e tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:49.065448 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-686a94bf-4339-4991-a797-a53728067872 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:50:49.073457 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-686a94bf-4339-4991-a797-a53728067872 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/87a4e8b8-79db-43f6-be85-b738382e4699" status: 200 len: 1504 microversion: 2.1 time: 0.820178 Sep 14 08:50:49.074055 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 307/643] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:50:48 2022] GET /compute/v2.1/servers/87a4e8b8-79db-43f6-be85-b738382e4699 => generated 1504 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:50:49.172165 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-f32d7dca-8bb9-42a4-8bd0-f10b122ac23c tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:50:49.172932 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-f32d7dca-8bb9-42a4-8bd0-f10b122ac23c tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: 5059f5d9-6903-4cf4-a999-01d2d2ba0842] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:50:49.180200 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f32d7dca-8bb9-42a4-8bd0-f10b122ac23c tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:49.180698 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f32d7dca-8bb9-42a4-8bd0-f10b122ac23c tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:49.181992 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f32d7dca-8bb9-42a4-8bd0-f10b122ac23c tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:49.182963 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f32d7dca-8bb9-42a4-8bd0-f10b122ac23c tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:49.183196 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f32d7dca-8bb9-42a4-8bd0-f10b122ac23c tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:49.183729 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f32d7dca-8bb9-42a4-8bd0-f10b122ac23c tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:49.286003 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-370ea071-8fdb-414c-a71b-bd152f44467e tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:50:49.303779 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-370ea071-8fdb-414c-a71b-bd152f44467e tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/e4c51c69-8c2e-4202-9c2f-3dfae93392e9" status: 200 len: 1476 microversion: 2.1 time: 0.807961 Sep 14 08:50:49.308820 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 337/644] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:50:48 2022] GET /compute/v2.1/servers/e4c51c69-8c2e-4202-9c2f-3dfae93392e9 => generated 1476 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:50:49.313909 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-5d968ddb-3132-436c-a0ac-350f08b16f4a req-9e8776ba-26ad-4d30-a08c-8e05fc02c968 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f9e2d1a-9899-4046-b2af-939db32442b7", "name": "network-vif-plugged", "status": "completed", "tag": "10461c57-a77f-4f2f-9b54-907e301e22ee"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:50:49.324463 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-5d968ddb-3132-436c-a0ac-350f08b16f4a req-9e8776ba-26ad-4d30-a08c-8e05fc02c968 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:49.325173 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-5d968ddb-3132-436c-a0ac-350f08b16f4a req-9e8776ba-26ad-4d30-a08c-8e05fc02c968 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:49.325763 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-5d968ddb-3132-436c-a0ac-350f08b16f4a req-9e8776ba-26ad-4d30-a08c-8e05fc02c968 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:49.341969 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-5d968ddb-3132-436c-a0ac-350f08b16f4a req-9e8776ba-26ad-4d30-a08c-8e05fc02c968 service nova] Creating event network-vif-plugged:10461c57-a77f-4f2f-9b54-907e301e22ee for instance 3f9e2d1a-9899-4046-b2af-939db32442b7 on n-h2-836830-18 Sep 14 08:50:49.351187 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-5d968ddb-3132-436c-a0ac-350f08b16f4a req-9e8776ba-26ad-4d30-a08c-8e05fc02c968 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039391 Sep 14 08:50:49.352156 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 338/645] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:50:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:50:49.461328 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-2dd871a6-f8cd-4704-8096-e3db13550151 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:50:49.462052 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-2dd871a6-f8cd-4704-8096-e3db13550151 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] [instance: 3f9e2d1a-9899-4046-b2af-939db32442b7] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:50:49.470050 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2dd871a6-f8cd-4704-8096-e3db13550151 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:49.470554 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2dd871a6-f8cd-4704-8096-e3db13550151 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:49.471024 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2dd871a6-f8cd-4704-8096-e3db13550151 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:49.474765 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2dd871a6-f8cd-4704-8096-e3db13550151 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:49.475307 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2dd871a6-f8cd-4704-8096-e3db13550151 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:49.478571 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2dd871a6-f8cd-4704-8096-e3db13550151 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:49.694270 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-f32d7dca-8bb9-42a4-8bd0-f10b122ac23c tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:50:49.708511 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-f32d7dca-8bb9-42a4-8bd0-f10b122ac23c tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:50:49.713392 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-f32d7dca-8bb9-42a4-8bd0-f10b122ac23c tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:50:49.725065 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-f32d7dca-8bb9-42a4-8bd0-f10b122ac23c tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/5059f5d9-6903-4cf4-a999-01d2d2ba0842" status: 200 len: 1566 microversion: 2.25 time: 0.549175 Sep 14 08:50:49.730152 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 308/646] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:50:49 2022] GET /compute/v2.1/servers/5059f5d9-6903-4cf4-a999-01d2d2ba0842 => generated 1566 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 08:50:49.963229 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-2dd871a6-f8cd-4704-8096-e3db13550151 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c7802984cf48d1852832b52abe52e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e326f95a9604fdb9bd075db3837cf62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:50:49.971533 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-2dd871a6-f8cd-4704-8096-e3db13550151 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] 10.222.0.60 "GET /compute/v2.1/servers/3f9e2d1a-9899-4046-b2af-939db32442b7" status: 200 len: 1319 microversion: 2.1 time: 0.514882 Sep 14 08:50:49.983649 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 339/647] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:50:49 2022] GET /compute/v2.1/servers/3f9e2d1a-9899-4046-b2af-939db32442b7 => generated 1319 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:50:50.101675 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b2cf781e-069e-453d-9571-3229e185e8ba tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:50:50.102295 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-b2cf781e-069e-453d-9571-3229e185e8ba tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: 87a4e8b8-79db-43f6-be85-b738382e4699] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:50:50.122252 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b2cf781e-069e-453d-9571-3229e185e8ba tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:50.122803 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b2cf781e-069e-453d-9571-3229e185e8ba tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:50.123286 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b2cf781e-069e-453d-9571-3229e185e8ba tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:50.123999 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b2cf781e-069e-453d-9571-3229e185e8ba tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:50.124458 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b2cf781e-069e-453d-9571-3229e185e8ba tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:50.124887 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b2cf781e-069e-453d-9571-3229e185e8ba tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:50.285154 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-79cf19a8-d6f5-476d-9002-f2b8474b86dd req-9b187aab-483b-456c-b5c8-3a163d2c3259 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87a4e8b8-79db-43f6-be85-b738382e4699", "tag": "94536d67-6c5b-4f6a-b61f-3534a3426e05"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:50:50.300212 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-79cf19a8-d6f5-476d-9002-f2b8474b86dd req-9b187aab-483b-456c-b5c8-3a163d2c3259 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:50.300930 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-79cf19a8-d6f5-476d-9002-f2b8474b86dd req-9b187aab-483b-456c-b5c8-3a163d2c3259 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:50.301514 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-79cf19a8-d6f5-476d-9002-f2b8474b86dd req-9b187aab-483b-456c-b5c8-3a163d2c3259 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:50.313969 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-79cf19a8-d6f5-476d-9002-f2b8474b86dd req-9b187aab-483b-456c-b5c8-3a163d2c3259 service nova] Creating event network-changed:94536d67-6c5b-4f6a-b61f-3534a3426e05 for instance 87a4e8b8-79db-43f6-be85-b738382e4699 on n-h1-836830-18 Sep 14 08:50:50.319069 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-79cf19a8-d6f5-476d-9002-f2b8474b86dd req-9b187aab-483b-456c-b5c8-3a163d2c3259 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042739 Sep 14 08:50:50.319672 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 340/648] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:50:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:50:50.368129 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-b2cf781e-069e-453d-9571-3229e185e8ba tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:50:50.378570 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-b2cf781e-069e-453d-9571-3229e185e8ba tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/87a4e8b8-79db-43f6-be85-b738382e4699" status: 200 len: 1504 microversion: 2.1 time: 0.280487 Sep 14 08:50:50.396149 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 309/649] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:50:50 2022] GET /compute/v2.1/servers/87a4e8b8-79db-43f6-be85-b738382e4699 => generated 1504 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:50:50.402838 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-db5b603b-81ec-40ec-a982-6c3ae9848ca2 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:50:50.404103 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-db5b603b-81ec-40ec-a982-6c3ae9848ca2 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: e4c51c69-8c2e-4202-9c2f-3dfae93392e9] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:50:50.410873 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-db5b603b-81ec-40ec-a982-6c3ae9848ca2 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:50.411764 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-db5b603b-81ec-40ec-a982-6c3ae9848ca2 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:50.412488 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-db5b603b-81ec-40ec-a982-6c3ae9848ca2 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:50.413406 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-db5b603b-81ec-40ec-a982-6c3ae9848ca2 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:50.414069 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-db5b603b-81ec-40ec-a982-6c3ae9848ca2 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:50.414694 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-db5b603b-81ec-40ec-a982-6c3ae9848ca2 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:50.510259 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-cc5db88a-a539-4ba9-a543-f9d8626b80d6 tempest-TenantUsagesNegativeTestJSON-608382591 tempest-TenantUsagesNegativeTestJSON-608382591-project-admin] 10.222.0.60 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-09-13T08%3A50%3A50.282023&end=2022-09-15T08%3A50%3A50.282023" status: 404 len: 112 microversion: - time: 0.188854 Sep 14 08:50:50.515819 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 341/650] 10.222.0.60 () {58 vars in 1316 bytes} [Wed Sep 14 08:50:50 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-09-13T08%3A50%3A50.282023&end=2022-09-15T08%3A50%3A50.282023 => generated 112 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 14 08:50:50.527335 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b6e2b510-5c61-48f1-8ced-303295d329e5 tempest-TenantUsagesNegativeTestJSON-608382591 tempest-TenantUsagesNegativeTestJSON-608382591-project-admin] Calling method '.version_select at 0x7f7d445d43a0>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:50:50.535051 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-b6e2b510-5c61-48f1-8ced-303295d329e5 tempest-TenantUsagesNegativeTestJSON-608382591 tempest-TenantUsagesNegativeTestJSON-608382591-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Sep 14 08:50:50.537107 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b6e2b510-5c61-48f1-8ced-303295d329e5 tempest-TenantUsagesNegativeTestJSON-608382591 tempest-TenantUsagesNegativeTestJSON-608382591-project-admin] Request method failure captured: Sep 14 08:50:50.537107 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/os-simple-tenant-usage/a9ba8355fdf7404fa18b7d0f14214ded?start=2022-09-15T08%3A50%3A50.282023&end=2022-09-13T08%3A50%3A50.282023 HTTP/1.1 Sep 14 08:50:50.537107 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 08:50:50.537107 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 08:50:50.537107 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 08:50:50.537107 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 08:50:50.537107 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 08:50:50.537107 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 08:50:50.537107 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 08:50:50.537107 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 08:50:50.537107 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZXqVaopD93pck6B9ojHt2SHi7BV8bFDh4aD4iYvK9hDDY_0yDmgkFFla0rVgTxNbfrUn_SCB3v7x-pItib7U9Qm7v3f5bnChtV8cD2MpcO4mhw5Ys6ylYmzAuNQT4pb2hYrAfDLyVw9FLYZ7blu3oyDUGvy-8F2O6NeGyCjx_ImMBg Sep 14 08:50:50.537107 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 08:50:50.537107 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 08:50:50.537107 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 08:50:50.537107 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 08:50:50.537107 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 08:50:50.537107 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 08:50:50.537107 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 565e323432a54efda2d14e1b1299985c Sep 14 08:50:50.537107 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-608382591 Sep 14 08:50:50.537107 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member,admin Sep 14 08:50:50.537107 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member,admin Sep 14 08:50:50.538462 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/565e323432a54efda2d14e1b1299985c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_565e323432a54efda2d14e1b1299985c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/565e323432a54efda2d14e1b1299985c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/565e323432a54efda2d14e1b1299985c"}]}] Sep 14 08:50:50.538462 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-608382591 Sep 14 08:50:50.538462 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 565e323432a54efda2d14e1b1299985c Sep 14 08:50:50.538462 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-608382591 Sep 14 08:50:50.538462 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-TenantUsagesNegativeTestJSON-608382591-project-admin Sep 14 08:50:50.538462 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 08:50:50.538462 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 08:50:50.538462 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: e3fed1d61bf6458bae9fcf390bc81a80 Sep 14 08:50:50.538462 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-608382591-project-admin Sep 14 08:50:50.538462 n-d-836830-18 devstack@n-api.service[128759]: method: Sep 14 08:50:50.538462 n-d-836830-18 devstack@n-api.service[128759]: exception: Invalid start time. The start time cannot occur after the end time. Sep 14 08:50:50.538462 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': 'a9ba8355fdf7404fa18b7d0f14214ded'} Sep 14 08:50:50.539291 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:50:50.539291 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:50:50.539291 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:50:50.539291 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:50:50.539291 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:50:50.539291 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:50:50.539291 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 08:50:50.539291 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 08:50:50.539291 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 14 08:50:50.539291 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 08:50:50.539291 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:50:50.539291 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:50:50.539291 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Sep 14 08:50:50.539291 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self._show(req, id) Sep 14 08:50:50.539291 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Sep 14 08:50:50.539291 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Sep 14 08:50:50.539291 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Sep 14 08:50:50.539291 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Sep 14 08:50:50.539291 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Sep 14 08:50:50.541029 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:50:50.541029 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:50:50.541029 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:50:50.541029 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:50:50.541029 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:50:50.541029 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:50:50.541029 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:50:50.541029 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:50:50.541029 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Sep 14 08:50:50.541029 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:50:50.543061 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b6e2b510-5c61-48f1-8ced-303295d329e5 tempest-TenantUsagesNegativeTestJSON-608382591 tempest-TenantUsagesNegativeTestJSON-608382591-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:50:50.545459 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b6e2b510-5c61-48f1-8ced-303295d329e5 tempest-TenantUsagesNegativeTestJSON-608382591 tempest-TenantUsagesNegativeTestJSON-608382591-project-admin] 10.222.0.60 "GET /compute/v2.1/os-simple-tenant-usage/a9ba8355fdf7404fa18b7d0f14214ded?start=2022-09-15T08%3A50%3A50.282023&end=2022-09-13T08%3A50%3A50.282023" status: 400 len: 111 microversion: 2.1 time: 0.028127 Sep 14 08:50:50.547769 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 342/651] 10.222.0.60 () {58 vars in 1412 bytes} [Wed Sep 14 08:50:50 2022] GET /compute/v2.1/os-simple-tenant-usage/a9ba8355fdf7404fa18b7d0f14214ded?start=2022-09-15T08%3A50%3A50.282023&end=2022-09-13T08%3A50%3A50.282023 => generated 111 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 14 08:50:50.741334 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f0dca636-dea3-4217-8257-07a3f3663b39 tempest-TenantUsagesNegativeTestJSON-1098282817 tempest-TenantUsagesNegativeTestJSON-1098282817-project] Calling method '.version_select at 0x7f7d44875b80>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:50:50.746078 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f0dca636-dea3-4217-8257-07a3f3663b39 tempest-TenantUsagesNegativeTestJSON-1098282817 tempest-TenantUsagesNegativeTestJSON-1098282817-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': 'ed2242142b71446db9dc10411a7fabbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ba8355fdf7404fa18b7d0f14214ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:50:50.748150 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f0dca636-dea3-4217-8257-07a3f3663b39 tempest-TenantUsagesNegativeTestJSON-1098282817 tempest-TenantUsagesNegativeTestJSON-1098282817-project] Request method failure captured: Sep 14 08:50:50.748150 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-09-13T08%3A50%3A50.282023&end=2022-09-15T08%3A50%3A50.282023&detailed=1 HTTP/1.1 Sep 14 08:50:50.748150 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 08:50:50.748150 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 08:50:50.748150 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 08:50:50.748150 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 08:50:50.748150 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 08:50:50.748150 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 08:50:50.748150 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 08:50:50.748150 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 08:50:50.748150 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZXpL8_OwvEbsnyFQIMPqZWLJttgmHqjnFo1ZXRqI4D_ZDMNqwB9EvCywNEqTgRjn0Fho5EDV8m9TK58SsEaGSboO63NTWks_7WTmhjeF5O3xE8I7onxHWgFo_xytdP8rABluqY3Ze5w0QT9irkIda2Tcln6i8GUPdQImud9vTPSk0M Sep 14 08:50:50.748150 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 08:50:50.748150 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 08:50:50.748150 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 08:50:50.748150 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 08:50:50.748150 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 08:50:50.748150 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 08:50:50.748150 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: a9ba8355fdf7404fa18b7d0f14214ded Sep 14 08:50:50.748150 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1098282817 Sep 14 08:50:50.748150 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 08:50:50.748150 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 08:50:50.749468 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a9ba8355fdf7404fa18b7d0f14214ded"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a9ba8355fdf7404fa18b7d0f14214ded"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a9ba8355fdf7404fa18b7d0f14214ded"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a9ba8355fdf7404fa18b7d0f14214ded"}]}] Sep 14 08:50:50.749468 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1098282817 Sep 14 08:50:50.749468 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: a9ba8355fdf7404fa18b7d0f14214ded Sep 14 08:50:50.749468 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1098282817 Sep 14 08:50:50.749468 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-TenantUsagesNegativeTestJSON-1098282817-project Sep 14 08:50:50.749468 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 08:50:50.749468 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 08:50:50.749468 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: ed2242142b71446db9dc10411a7fabbe Sep 14 08:50:50.749468 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1098282817-project Sep 14 08:50:50.749468 n-d-836830-18 devstack@n-api.service[128759]: method: Sep 14 08:50:50.749468 n-d-836830-18 devstack@n-api.service[128759]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Sep 14 08:50:50.749468 n-d-836830-18 devstack@n-api.service[128759]: action_args: {} Sep 14 08:50:50.749468 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:50:50.750303 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:50:50.750303 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:50:50.750303 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:50:50.750303 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:50:50.750303 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:50:50.750303 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 08:50:50.750303 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 08:50:50.750303 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 14 08:50:50.750303 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 08:50:50.750303 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:50:50.750303 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:50:50.750303 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Sep 14 08:50:50.750303 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self._index(req) Sep 14 08:50:50.750303 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Sep 14 08:50:50.750303 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Sep 14 08:50:50.750303 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 14 08:50:50.750303 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 14 08:50:50.750303 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 14 08:50:50.750303 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 14 08:50:50.751627 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 14 08:50:50.751627 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 14 08:50:50.751627 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 14 08:50:50.751627 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise self.value Sep 14 08:50:50.751627 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 14 08:50:50.751627 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 14 08:50:50.751627 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 14 08:50:50.751627 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 14 08:50:50.751627 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 14 08:50:50.751627 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 14 08:50:50.751627 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Sep 14 08:50:50.751627 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:50:50.751627 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:50:50.751627 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:50:50.751627 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:50:50.751627 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:50:50.751627 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:50:50.751627 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 14 08:50:50.751627 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 14 08:50:50.753680 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Sep 14 08:50:50.753680 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:50:50.754782 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f0dca636-dea3-4217-8257-07a3f3663b39 tempest-TenantUsagesNegativeTestJSON-1098282817 tempest-TenantUsagesNegativeTestJSON-1098282817-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:50:50.755918 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f0dca636-dea3-4217-8257-07a3f3663b39 tempest-TenantUsagesNegativeTestJSON-1098282817 tempest-TenantUsagesNegativeTestJSON-1098282817-project] 10.222.0.60 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-09-13T08%3A50%3A50.282023&end=2022-09-15T08%3A50%3A50.282023&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.201741 Sep 14 08:50:50.757004 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 343/652] 10.222.0.60 () {58 vars in 1335 bytes} [Wed Sep 14 08:50:50 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-09-13T08%3A50%3A50.282023&end=2022-09-15T08%3A50%3A50.282023&detailed=1 => generated 123 bytes in 203 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 14 08:50:50.765811 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d9d44143-7620-4770-b0b2-4891232fde06 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:50:50.767127 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-d9d44143-7620-4770-b0b2-4891232fde06 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: 5059f5d9-6903-4cf4-a999-01d2d2ba0842] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:50:50.774037 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d9d44143-7620-4770-b0b2-4891232fde06 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:50.775839 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d9d44143-7620-4770-b0b2-4891232fde06 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:50.776530 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d9d44143-7620-4770-b0b2-4891232fde06 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:50.777472 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d9d44143-7620-4770-b0b2-4891232fde06 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:50.778274 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d9d44143-7620-4770-b0b2-4891232fde06 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:50.778982 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d9d44143-7620-4770-b0b2-4891232fde06 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:50.865189 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-db5b603b-81ec-40ec-a982-6c3ae9848ca2 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:50:50.873604 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-db5b603b-81ec-40ec-a982-6c3ae9848ca2 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/e4c51c69-8c2e-4202-9c2f-3dfae93392e9" status: 200 len: 1476 microversion: 2.1 time: 0.476019 Sep 14 08:50:50.876233 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 310/653] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:50:50 2022] GET /compute/v2.1/servers/e4c51c69-8c2e-4202-9c2f-3dfae93392e9 => generated 1476 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:50:50.995462 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-040ddf69-2eb0-4b70-808d-fa07f1f4999b tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:50:50.996333 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-040ddf69-2eb0-4b70-808d-fa07f1f4999b tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] [instance: 3f9e2d1a-9899-4046-b2af-939db32442b7] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:50:51.008534 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-040ddf69-2eb0-4b70-808d-fa07f1f4999b tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:51.010500 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-040ddf69-2eb0-4b70-808d-fa07f1f4999b tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:51.012790 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-040ddf69-2eb0-4b70-808d-fa07f1f4999b tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:51.013830 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-040ddf69-2eb0-4b70-808d-fa07f1f4999b tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:51.016735 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-040ddf69-2eb0-4b70-808d-fa07f1f4999b tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:51.017904 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-040ddf69-2eb0-4b70-808d-fa07f1f4999b tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:51.674033 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-d9d44143-7620-4770-b0b2-4891232fde06 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:50:51.687088 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-d9d44143-7620-4770-b0b2-4891232fde06 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:50:51.690322 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-d9d44143-7620-4770-b0b2-4891232fde06 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:50:51.692792 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-040ddf69-2eb0-4b70-808d-fa07f1f4999b tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c7802984cf48d1852832b52abe52e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e326f95a9604fdb9bd075db3837cf62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:50:51.696177 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d9d44143-7620-4770-b0b2-4891232fde06 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/5059f5d9-6903-4cf4-a999-01d2d2ba0842" status: 200 len: 1566 microversion: 2.25 time: 0.936856 Sep 14 08:50:51.716868 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 344/654] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:50:50 2022] GET /compute/v2.1/servers/5059f5d9-6903-4cf4-a999-01d2d2ba0842 => generated 1566 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:50:51.723225 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c87fc3d2-60a8-4d0e-9057-bf2fc79b0ca9 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:50:51.723945 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-c87fc3d2-60a8-4d0e-9057-bf2fc79b0ca9 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: 87a4e8b8-79db-43f6-be85-b738382e4699] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:50:51.727284 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-040ddf69-2eb0-4b70-808d-fa07f1f4999b tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] 10.222.0.60 "GET /compute/v2.1/servers/3f9e2d1a-9899-4046-b2af-939db32442b7" status: 200 len: 1319 microversion: 2.1 time: 0.735683 Sep 14 08:50:51.728272 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 311/655] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:50:50 2022] GET /compute/v2.1/servers/3f9e2d1a-9899-4046-b2af-939db32442b7 => generated 1319 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:50:51.747807 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c87fc3d2-60a8-4d0e-9057-bf2fc79b0ca9 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:51.748843 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c87fc3d2-60a8-4d0e-9057-bf2fc79b0ca9 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:51.749298 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c87fc3d2-60a8-4d0e-9057-bf2fc79b0ca9 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:51.750017 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c87fc3d2-60a8-4d0e-9057-bf2fc79b0ca9 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:51.750477 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c87fc3d2-60a8-4d0e-9057-bf2fc79b0ca9 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:51.751369 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c87fc3d2-60a8-4d0e-9057-bf2fc79b0ca9 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:51.907863 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-44a5c12b-deba-43d8-8670-262179bf9079 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:50:51.911319 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-44a5c12b-deba-43d8-8670-262179bf9079 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: e4c51c69-8c2e-4202-9c2f-3dfae93392e9] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:50:51.921472 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-44a5c12b-deba-43d8-8670-262179bf9079 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:51.922167 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-44a5c12b-deba-43d8-8670-262179bf9079 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:51.922958 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-44a5c12b-deba-43d8-8670-262179bf9079 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:51.923853 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-44a5c12b-deba-43d8-8670-262179bf9079 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:51.924458 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-44a5c12b-deba-43d8-8670-262179bf9079 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:51.925592 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-44a5c12b-deba-43d8-8670-262179bf9079 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:52.183051 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-c87fc3d2-60a8-4d0e-9057-bf2fc79b0ca9 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:50:52.191037 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-c87fc3d2-60a8-4d0e-9057-bf2fc79b0ca9 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/87a4e8b8-79db-43f6-be85-b738382e4699" status: 200 len: 1504 microversion: 2.1 time: 0.472972 Sep 14 08:50:52.191606 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 345/656] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:50:51 2022] GET /compute/v2.1/servers/87a4e8b8-79db-43f6-be85-b738382e4699 => generated 1504 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:50:52.427595 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-44a5c12b-deba-43d8-8670-262179bf9079 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:50:52.466427 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-44a5c12b-deba-43d8-8670-262179bf9079 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/e4c51c69-8c2e-4202-9c2f-3dfae93392e9" status: 200 len: 1476 microversion: 2.1 time: 0.569038 Sep 14 08:50:52.470680 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 312/657] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:50:51 2022] GET /compute/v2.1/servers/e4c51c69-8c2e-4202-9c2f-3dfae93392e9 => generated 1476 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:50:52.723876 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-108961fa-29d3-4bb6-af3b-379f71307f00 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:50:52.724334 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-108961fa-29d3-4bb6-af3b-379f71307f00 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: 5059f5d9-6903-4cf4-a999-01d2d2ba0842] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:50:52.732628 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-108961fa-29d3-4bb6-af3b-379f71307f00 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:52.733111 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-108961fa-29d3-4bb6-af3b-379f71307f00 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:52.733603 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-108961fa-29d3-4bb6-af3b-379f71307f00 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:52.734300 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-108961fa-29d3-4bb6-af3b-379f71307f00 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:52.734801 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-108961fa-29d3-4bb6-af3b-379f71307f00 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:52.735253 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-108961fa-29d3-4bb6-af3b-379f71307f00 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:52.753252 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-0d0d2820-e0f1-448f-a31f-11ade80a3287 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:50:52.755260 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-0d0d2820-e0f1-448f-a31f-11ade80a3287 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] [instance: 3f9e2d1a-9899-4046-b2af-939db32442b7] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:50:52.764429 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0d0d2820-e0f1-448f-a31f-11ade80a3287 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:52.765235 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0d0d2820-e0f1-448f-a31f-11ade80a3287 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:52.766005 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0d0d2820-e0f1-448f-a31f-11ade80a3287 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:52.768447 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0d0d2820-e0f1-448f-a31f-11ade80a3287 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:52.768996 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0d0d2820-e0f1-448f-a31f-11ade80a3287 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:52.769498 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0d0d2820-e0f1-448f-a31f-11ade80a3287 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:53.083784 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-108961fa-29d3-4bb6-af3b-379f71307f00 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:50:53.093878 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-0d0d2820-e0f1-448f-a31f-11ade80a3287 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c7802984cf48d1852832b52abe52e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e326f95a9604fdb9bd075db3837cf62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:50:53.095639 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-108961fa-29d3-4bb6-af3b-379f71307f00 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:50:53.097283 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-108961fa-29d3-4bb6-af3b-379f71307f00 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:50:53.098574 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-108961fa-29d3-4bb6-af3b-379f71307f00 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/5059f5d9-6903-4cf4-a999-01d2d2ba0842" status: 200 len: 1566 microversion: 2.25 time: 0.379266 Sep 14 08:50:53.101605 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 346/658] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:50:52 2022] GET /compute/v2.1/servers/5059f5d9-6903-4cf4-a999-01d2d2ba0842 => generated 1566 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:50:53.110414 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-0d0d2820-e0f1-448f-a31f-11ade80a3287 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] 10.222.0.60 "GET /compute/v2.1/servers/3f9e2d1a-9899-4046-b2af-939db32442b7" status: 200 len: 1469 microversion: 2.1 time: 0.363646 Sep 14 08:50:53.133819 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 313/659] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:50:52 2022] GET /compute/v2.1/servers/3f9e2d1a-9899-4046-b2af-939db32442b7 => generated 1469 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:50:53.150205 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c23ca2b4-fff2-47f7-b276-e1bee32bfd51 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:50:53.150832 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-c23ca2b4-fff2-47f7-b276-e1bee32bfd51 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] [instance: 42265ff9-9c1f-45b6-b92d-0b23de43a8d0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:50:53.164341 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c23ca2b4-fff2-47f7-b276-e1bee32bfd51 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:53.164839 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c23ca2b4-fff2-47f7-b276-e1bee32bfd51 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:53.165901 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c23ca2b4-fff2-47f7-b276-e1bee32bfd51 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:53.173689 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c23ca2b4-fff2-47f7-b276-e1bee32bfd51 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:53.174171 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c23ca2b4-fff2-47f7-b276-e1bee32bfd51 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:53.174607 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c23ca2b4-fff2-47f7-b276-e1bee32bfd51 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:53.214698 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-4f497bb6-4f10-46ed-8e20-9abaed268e4b tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:50:53.215354 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-4f497bb6-4f10-46ed-8e20-9abaed268e4b tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: 87a4e8b8-79db-43f6-be85-b738382e4699] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:50:53.224763 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4f497bb6-4f10-46ed-8e20-9abaed268e4b tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:53.224763 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4f497bb6-4f10-46ed-8e20-9abaed268e4b tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:53.224763 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4f497bb6-4f10-46ed-8e20-9abaed268e4b tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:53.230447 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4f497bb6-4f10-46ed-8e20-9abaed268e4b tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:53.231087 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4f497bb6-4f10-46ed-8e20-9abaed268e4b tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:53.231640 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4f497bb6-4f10-46ed-8e20-9abaed268e4b tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:53.430230 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-c23ca2b4-fff2-47f7-b276-e1bee32bfd51 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c7802984cf48d1852832b52abe52e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e326f95a9604fdb9bd075db3837cf62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:50:53.447383 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-c23ca2b4-fff2-47f7-b276-e1bee32bfd51 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] 10.222.0.60 "GET /compute/v2.1/servers/42265ff9-9c1f-45b6-b92d-0b23de43a8d0" status: 200 len: 1467 microversion: 2.1 time: 0.311431 Sep 14 08:50:53.459014 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 347/660] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:50:53 2022] GET /compute/v2.1/servers/42265ff9-9c1f-45b6-b92d-0b23de43a8d0 => generated 1467 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:50:53.471143 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-6dd5bb72-1d44-4ae6-b1ad-4e77dd341d2f tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:50:53.475698 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-6dd5bb72-1d44-4ae6-b1ad-4e77dd341d2f tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '89c7802984cf48d1852832b52abe52e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e326f95a9604fdb9bd075db3837cf62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:50:53.476585 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-6dd5bb72-1d44-4ae6-b1ad-4e77dd341d2f tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Searching by: {'reservation_id': 'r-6tw63xo2', 'deleted': False, 'project_id': '5e326f95a9604fdb9bd075db3837cf62'} {{(pid=128759) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 14 08:50:53.482902 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6dd5bb72-1d44-4ae6-b1ad-4e77dd341d2f tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:53.483457 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6dd5bb72-1d44-4ae6-b1ad-4e77dd341d2f tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:53.483860 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6dd5bb72-1d44-4ae6-b1ad-4e77dd341d2f tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:53.484648 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6dd5bb72-1d44-4ae6-b1ad-4e77dd341d2f tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:53.485178 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6dd5bb72-1d44-4ae6-b1ad-4e77dd341d2f tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:53.485607 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6dd5bb72-1d44-4ae6-b1ad-4e77dd341d2f tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:53.525444 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-4f497bb6-4f10-46ed-8e20-9abaed268e4b tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:50:53.538174 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-4f497bb6-4f10-46ed-8e20-9abaed268e4b tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/87a4e8b8-79db-43f6-be85-b738382e4699" status: 200 len: 1504 microversion: 2.1 time: 0.327769 Sep 14 08:50:53.538931 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 314/661] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:50:53 2022] GET /compute/v2.1/servers/87a4e8b8-79db-43f6-be85-b738382e4699 => generated 1504 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:50:53.544432 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-36a17dc5-4b17-4e1e-9138-d10046558014 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:50:53.545038 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-36a17dc5-4b17-4e1e-9138-d10046558014 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: e4c51c69-8c2e-4202-9c2f-3dfae93392e9] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:50:53.550922 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-36a17dc5-4b17-4e1e-9138-d10046558014 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:53.551616 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-36a17dc5-4b17-4e1e-9138-d10046558014 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:53.552201 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-36a17dc5-4b17-4e1e-9138-d10046558014 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:53.553075 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-36a17dc5-4b17-4e1e-9138-d10046558014 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:53.562021 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-36a17dc5-4b17-4e1e-9138-d10046558014 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:53.562670 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-36a17dc5-4b17-4e1e-9138-d10046558014 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:53.601494 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.multi_cell_list [None req-6dd5bb72-1d44-4ae6-b1ad-4e77dd341d2f tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128759) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 14 08:50:53.773476 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-6dd5bb72-1d44-4ae6-b1ad-4e77dd341d2f tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c7802984cf48d1852832b52abe52e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e326f95a9604fdb9bd075db3837cf62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:50:53.782069 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6dd5bb72-1d44-4ae6-b1ad-4e77dd341d2f tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:53.782763 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6dd5bb72-1d44-4ae6-b1ad-4e77dd341d2f tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:53.783376 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6dd5bb72-1d44-4ae6-b1ad-4e77dd341d2f tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:53.938448 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-36a17dc5-4b17-4e1e-9138-d10046558014 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:50:53.950251 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-36a17dc5-4b17-4e1e-9138-d10046558014 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/e4c51c69-8c2e-4202-9c2f-3dfae93392e9" status: 200 len: 1476 microversion: 2.1 time: 0.406050 Sep 14 08:50:53.950873 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 315/662] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:50:53 2022] GET /compute/v2.1/servers/e4c51c69-8c2e-4202-9c2f-3dfae93392e9 => generated 1476 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:50:54.111082 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-6dd5bb72-1d44-4ae6-b1ad-4e77dd341d2f tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] 10.222.0.60 "GET /compute/v2.1/servers/detail?reservation_id=r-6tw63xo2" status: 200 len: 2929 microversion: 2.1 time: 0.644858 Sep 14 08:50:54.111929 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 348/663] 10.222.0.60 () {58 vars in 1197 bytes} [Wed Sep 14 08:50:53 2022] GET /compute/v2.1/servers/detail?reservation_id=r-6tw63xo2 => generated 2929 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:50:54.129698 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-aeb7fb5d-f55e-4c65-9472-8614cc4c7164 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:50:54.130548 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-aeb7fb5d-f55e-4c65-9472-8614cc4c7164 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: 5059f5d9-6903-4cf4-a999-01d2d2ba0842] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:50:54.138115 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-aeb7fb5d-f55e-4c65-9472-8614cc4c7164 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:54.138926 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-aeb7fb5d-f55e-4c65-9472-8614cc4c7164 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:54.139607 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-aeb7fb5d-f55e-4c65-9472-8614cc4c7164 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:54.140565 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-aeb7fb5d-f55e-4c65-9472-8614cc4c7164 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:54.141314 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-aeb7fb5d-f55e-4c65-9472-8614cc4c7164 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:54.141933 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-aeb7fb5d-f55e-4c65-9472-8614cc4c7164 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:54.150060 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-5c2785e7-7b5a-4ac5-b21a-96ad686ee069 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:50:54.192826 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.compute.server_groups [None req-5c2785e7-7b5a-4ac5-b21a-96ad686ee069 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Querying cell 0a35f87f-19b7-4b11-98e6-8bcd07b0466f(cell1) for 2 instances {{(pid=128759) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Sep 14 08:50:54.195125 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5c2785e7-7b5a-4ac5-b21a-96ad686ee069 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:54.196964 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5c2785e7-7b5a-4ac5-b21a-96ad686ee069 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:54.198127 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5c2785e7-7b5a-4ac5-b21a-96ad686ee069 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:54.262831 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-5c2785e7-7b5a-4ac5-b21a-96ad686ee069 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] 10.222.0.60 "GET /compute/v2.1/os-server-groups/8d4e2809-5c95-42e0-8d35-a7c2aa5ab958" status: 200 len: 271 microversion: 2.1 time: 0.122674 Sep 14 08:50:54.264579 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 349/664] 10.222.0.60 () {58 vars in 1263 bytes} [Wed Sep 14 08:50:54 2022] GET /compute/v2.1/os-server-groups/8d4e2809-5c95-42e0-8d35-a7c2aa5ab958 => generated 271 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:50:54.280549 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d71850fb-5e6e-4794-823a-264e1b439d9f tempest-ServersOnMultiNodesTest-1008135845 tempest-ServersOnMultiNodesTest-1008135845-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:50:54.283413 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-d71850fb-5e6e-4794-823a-264e1b439d9f tempest-ServersOnMultiNodesTest-1008135845 tempest-ServersOnMultiNodesTest-1008135845-project-admin] [instance: 3f9e2d1a-9899-4046-b2af-939db32442b7] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:50:54.292388 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d71850fb-5e6e-4794-823a-264e1b439d9f tempest-ServersOnMultiNodesTest-1008135845 tempest-ServersOnMultiNodesTest-1008135845-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:54.295695 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d71850fb-5e6e-4794-823a-264e1b439d9f tempest-ServersOnMultiNodesTest-1008135845 tempest-ServersOnMultiNodesTest-1008135845-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:54.296383 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d71850fb-5e6e-4794-823a-264e1b439d9f tempest-ServersOnMultiNodesTest-1008135845 tempest-ServersOnMultiNodesTest-1008135845-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:54.297453 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d71850fb-5e6e-4794-823a-264e1b439d9f tempest-ServersOnMultiNodesTest-1008135845 tempest-ServersOnMultiNodesTest-1008135845-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:54.298098 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d71850fb-5e6e-4794-823a-264e1b439d9f tempest-ServersOnMultiNodesTest-1008135845 tempest-ServersOnMultiNodesTest-1008135845-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:54.298704 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d71850fb-5e6e-4794-823a-264e1b439d9f tempest-ServersOnMultiNodesTest-1008135845 tempest-ServersOnMultiNodesTest-1008135845-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:54.392709 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-aeb7fb5d-f55e-4c65-9472-8614cc4c7164 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:50:54.404911 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-aeb7fb5d-f55e-4c65-9472-8614cc4c7164 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:50:54.410727 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-aeb7fb5d-f55e-4c65-9472-8614cc4c7164 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:50:54.420532 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-aeb7fb5d-f55e-4c65-9472-8614cc4c7164 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/5059f5d9-6903-4cf4-a999-01d2d2ba0842" status: 200 len: 1566 microversion: 2.25 time: 0.294147 Sep 14 08:50:54.439169 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 316/665] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:50:54 2022] GET /compute/v2.1/servers/5059f5d9-6903-4cf4-a999-01d2d2ba0842 => generated 1566 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:50:54.534011 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d71850fb-5e6e-4794-823a-264e1b439d9f tempest-ServersOnMultiNodesTest-1008135845 tempest-ServersOnMultiNodesTest-1008135845-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/3f9e2d1a-9899-4046-b2af-939db32442b7" status: 200 len: 1622 microversion: 2.1 time: 0.257272 Sep 14 08:50:54.535023 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 350/666] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:50:54 2022] GET /compute/v2.1/servers/3f9e2d1a-9899-4046-b2af-939db32442b7 => generated 1622 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:50:54.571954 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-5543462a-7427-4599-9d12-e4c86122bbfa tempest-ServersOnMultiNodesTest-1008135845 tempest-ServersOnMultiNodesTest-1008135845-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:50:54.572846 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-5543462a-7427-4599-9d12-e4c86122bbfa tempest-ServersOnMultiNodesTest-1008135845 tempest-ServersOnMultiNodesTest-1008135845-project-admin] [instance: 42265ff9-9c1f-45b6-b92d-0b23de43a8d0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:50:54.573422 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-e1e93095-dbe4-43df-bf44-a977c8ed067b tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:50:54.575434 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-e1e93095-dbe4-43df-bf44-a977c8ed067b tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: 87a4e8b8-79db-43f6-be85-b738382e4699] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:50:54.589587 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5543462a-7427-4599-9d12-e4c86122bbfa tempest-ServersOnMultiNodesTest-1008135845 tempest-ServersOnMultiNodesTest-1008135845-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:54.591256 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e1e93095-dbe4-43df-bf44-a977c8ed067b tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:54.592614 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5543462a-7427-4599-9d12-e4c86122bbfa tempest-ServersOnMultiNodesTest-1008135845 tempest-ServersOnMultiNodesTest-1008135845-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:54.593175 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e1e93095-dbe4-43df-bf44-a977c8ed067b tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:54.593614 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e1e93095-dbe4-43df-bf44-a977c8ed067b tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:54.593976 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5543462a-7427-4599-9d12-e4c86122bbfa tempest-ServersOnMultiNodesTest-1008135845 tempest-ServersOnMultiNodesTest-1008135845-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:54.595509 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5543462a-7427-4599-9d12-e4c86122bbfa tempest-ServersOnMultiNodesTest-1008135845 tempest-ServersOnMultiNodesTest-1008135845-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:54.597201 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e1e93095-dbe4-43df-bf44-a977c8ed067b tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:54.598195 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e1e93095-dbe4-43df-bf44-a977c8ed067b tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:54.598955 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e1e93095-dbe4-43df-bf44-a977c8ed067b tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:54.609451 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5543462a-7427-4599-9d12-e4c86122bbfa tempest-ServersOnMultiNodesTest-1008135845 tempest-ServersOnMultiNodesTest-1008135845-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:54.609992 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5543462a-7427-4599-9d12-e4c86122bbfa tempest-ServersOnMultiNodesTest-1008135845 tempest-ServersOnMultiNodesTest-1008135845-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:54.855516 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-e1e93095-dbe4-43df-bf44-a977c8ed067b tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:50:54.867205 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-e1e93095-dbe4-43df-bf44-a977c8ed067b tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/87a4e8b8-79db-43f6-be85-b738382e4699" status: 200 len: 1504 microversion: 2.1 time: 0.304237 Sep 14 08:50:54.868462 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 317/667] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:50:54 2022] GET /compute/v2.1/servers/87a4e8b8-79db-43f6-be85-b738382e4699 => generated 1504 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:50:54.906087 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-5543462a-7427-4599-9d12-e4c86122bbfa tempest-ServersOnMultiNodesTest-1008135845 tempest-ServersOnMultiNodesTest-1008135845-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/42265ff9-9c1f-45b6-b92d-0b23de43a8d0" status: 200 len: 1620 microversion: 2.1 time: 0.340411 Sep 14 08:50:54.915163 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 351/668] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:50:54 2022] GET /compute/v2.1/servers/42265ff9-9c1f-45b6-b92d-0b23de43a8d0 => generated 1620 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:50:54.977403 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-7efcafbf-269b-4620-9db8-12100bd92659 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:50:54.979304 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-7efcafbf-269b-4620-9db8-12100bd92659 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: e4c51c69-8c2e-4202-9c2f-3dfae93392e9] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:50:54.989576 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7efcafbf-269b-4620-9db8-12100bd92659 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:54.990431 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7efcafbf-269b-4620-9db8-12100bd92659 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:54.992269 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7efcafbf-269b-4620-9db8-12100bd92659 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:54.994274 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7efcafbf-269b-4620-9db8-12100bd92659 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:54.994460 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7efcafbf-269b-4620-9db8-12100bd92659 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:54.996010 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7efcafbf-269b-4620-9db8-12100bd92659 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:55.069186 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3bd562fe-8196-44e7-85fc-05cb89f38d1f tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1105469733", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "307b2830-67e6-44ec-845f-9894de16694a"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:50:55.134876 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.network.neutron [None req-3bd562fe-8196-44e7-85fc-05cb89f38d1f tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] validate_networks() for None {{(pid=128759) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 08:50:55.238342 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-7efcafbf-269b-4620-9db8-12100bd92659 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:50:55.249893 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-7efcafbf-269b-4620-9db8-12100bd92659 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/e4c51c69-8c2e-4202-9c2f-3dfae93392e9" status: 200 len: 1476 microversion: 2.1 time: 0.278771 Sep 14 08:50:55.268275 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 318/669] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:50:54 2022] GET /compute/v2.1/servers/e4c51c69-8c2e-4202-9c2f-3dfae93392e9 => generated 1476 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:50:55.422074 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-3bd562fe-8196-44e7-85fc-05cb89f38d1f tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Flavor limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 08:50:55.422637 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-3bd562fe-8196-44e7-85fc-05cb89f38d1f tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Image limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 08:50:55.423653 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-3bd562fe-8196-44e7-85fc-05cb89f38d1f tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Flavor pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 08:50:55.424813 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-3bd562fe-8196-44e7-85fc-05cb89f38d1f tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Image pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 08:50:55.425388 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-3bd562fe-8196-44e7-85fc-05cb89f38d1f tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 08:50:55.436455 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3bd562fe-8196-44e7-85fc-05cb89f38d1f tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:55.437069 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3bd562fe-8196-44e7-85fc-05cb89f38d1f tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:55.437595 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3bd562fe-8196-44e7-85fc-05cb89f38d1f tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:55.438987 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3bd562fe-8196-44e7-85fc-05cb89f38d1f tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:55.439695 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3bd562fe-8196-44e7-85fc-05cb89f38d1f tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:55.440233 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3bd562fe-8196-44e7-85fc-05cb89f38d1f tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:55.457100 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-fae387f3-53a9-4dfe-9968-134d6ab049e7 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:50:55.457963 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-fae387f3-53a9-4dfe-9968-134d6ab049e7 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: 5059f5d9-6903-4cf4-a999-01d2d2ba0842] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:50:55.461291 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-3bd562fe-8196-44e7-85fc-05cb89f38d1f tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Getting quotas for project 5e326f95a9604fdb9bd075db3837cf62. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 08:50:55.464563 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fae387f3-53a9-4dfe-9968-134d6ab049e7 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:55.465055 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fae387f3-53a9-4dfe-9968-134d6ab049e7 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:55.465662 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fae387f3-53a9-4dfe-9968-134d6ab049e7 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:55.466534 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fae387f3-53a9-4dfe-9968-134d6ab049e7 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:55.467376 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fae387f3-53a9-4dfe-9968-134d6ab049e7 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:55.467957 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fae387f3-53a9-4dfe-9968-134d6ab049e7 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:55.470612 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-3bd562fe-8196-44e7-85fc-05cb89f38d1f tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Getting quotas for user 89c7802984cf48d1852832b52abe52e9 and project 5e326f95a9604fdb9bd075db3837cf62. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 08:50:55.485133 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-3bd562fe-8196-44e7-85fc-05cb89f38d1f tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Going to run 1 instances... {{(pid=128759) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 08:50:55.487650 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-3bd562fe-8196-44e7-85fc-05cb89f38d1f tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] [instance: 3067be21-37ff-4a8f-8ca9-b1421e8be78f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128759) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 08:50:55.545000 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-3bd562fe-8196-44e7-85fc-05cb89f38d1f tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.480787 Sep 14 08:50:55.552249 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 352/670] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 08:50:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 484 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 14 08:50:55.566214 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-4c310296-255e-4b0a-9939-f5645c2b302c tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:50:55.567633 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-4c310296-255e-4b0a-9939-f5645c2b302c tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] [instance: 3067be21-37ff-4a8f-8ca9-b1421e8be78f] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:50:55.589861 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:50:55.661750 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-4c310296-255e-4b0a-9939-f5645c2b302c tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c7802984cf48d1852832b52abe52e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e326f95a9604fdb9bd075db3837cf62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:50:55.682992 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-4c310296-255e-4b0a-9939-f5645c2b302c tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] 10.222.0.60 "GET /compute/v2.1/servers/3067be21-37ff-4a8f-8ca9-b1421e8be78f" status: 200 len: 1217 microversion: 2.1 time: 0.127744 Sep 14 08:50:55.685667 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 353/671] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:50:55 2022] GET /compute/v2.1/servers/3067be21-37ff-4a8f-8ca9-b1421e8be78f => generated 1217 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:50:55.797890 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=14 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:50:55.804819 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-fae387f3-53a9-4dfe-9968-134d6ab049e7 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:50:55.825663 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-fae387f3-53a9-4dfe-9968-134d6ab049e7 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:50:55.828532 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-fae387f3-53a9-4dfe-9968-134d6ab049e7 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:50:55.831693 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-fae387f3-53a9-4dfe-9968-134d6ab049e7 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/5059f5d9-6903-4cf4-a999-01d2d2ba0842" status: 200 len: 1566 microversion: 2.25 time: 0.378454 Sep 14 08:50:55.833865 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 319/672] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:50:55 2022] GET /compute/v2.1/servers/5059f5d9-6903-4cf4-a999-01d2d2ba0842 => generated 1566 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 08:50:55.893107 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ffafe243-22d1-4b23-8913-786d7fe25557 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:50:55.893868 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-ffafe243-22d1-4b23-8913-786d7fe25557 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: 87a4e8b8-79db-43f6-be85-b738382e4699] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:50:55.905025 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ffafe243-22d1-4b23-8913-786d7fe25557 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:55.905525 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ffafe243-22d1-4b23-8913-786d7fe25557 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:55.905880 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ffafe243-22d1-4b23-8913-786d7fe25557 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:55.906592 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ffafe243-22d1-4b23-8913-786d7fe25557 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:55.912601 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ffafe243-22d1-4b23-8913-786d7fe25557 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:55.913148 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ffafe243-22d1-4b23-8913-786d7fe25557 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:56.127811 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-ffafe243-22d1-4b23-8913-786d7fe25557 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:50:56.142356 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-ffafe243-22d1-4b23-8913-786d7fe25557 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/87a4e8b8-79db-43f6-be85-b738382e4699" status: 200 len: 1504 microversion: 2.1 time: 0.254210 Sep 14 08:50:56.144071 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 354/673] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:50:55 2022] GET /compute/v2.1/servers/87a4e8b8-79db-43f6-be85-b738382e4699 => generated 1504 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:50:56.274706 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-4148971d-bec1-4380-a842-976e7a4067c3 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:50:56.275394 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-4148971d-bec1-4380-a842-976e7a4067c3 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: e4c51c69-8c2e-4202-9c2f-3dfae93392e9] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:50:56.284745 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4148971d-bec1-4380-a842-976e7a4067c3 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:56.285416 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4148971d-bec1-4380-a842-976e7a4067c3 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:56.286357 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4148971d-bec1-4380-a842-976e7a4067c3 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:56.287262 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4148971d-bec1-4380-a842-976e7a4067c3 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:56.288641 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4148971d-bec1-4380-a842-976e7a4067c3 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:56.290320 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4148971d-bec1-4380-a842-976e7a4067c3 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:56.495464 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-4148971d-bec1-4380-a842-976e7a4067c3 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:50:56.506266 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-4148971d-bec1-4380-a842-976e7a4067c3 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/e4c51c69-8c2e-4202-9c2f-3dfae93392e9" status: 200 len: 1476 microversion: 2.1 time: 0.235297 Sep 14 08:50:56.507745 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 320/674] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:50:56 2022] GET /compute/v2.1/servers/e4c51c69-8c2e-4202-9c2f-3dfae93392e9 => generated 1476 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:50:56.709987 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-5a79d0b8-97a8-4efe-b92d-8669f15a7b41 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:50:56.710701 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-5a79d0b8-97a8-4efe-b92d-8669f15a7b41 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] [instance: 3067be21-37ff-4a8f-8ca9-b1421e8be78f] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:50:56.719396 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5a79d0b8-97a8-4efe-b92d-8669f15a7b41 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:56.720233 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5a79d0b8-97a8-4efe-b92d-8669f15a7b41 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:56.720949 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5a79d0b8-97a8-4efe-b92d-8669f15a7b41 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:56.722020 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5a79d0b8-97a8-4efe-b92d-8669f15a7b41 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:56.722491 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5a79d0b8-97a8-4efe-b92d-8669f15a7b41 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:56.723013 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5a79d0b8-97a8-4efe-b92d-8669f15a7b41 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:56.806038 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-5a79d0b8-97a8-4efe-b92d-8669f15a7b41 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c7802984cf48d1852832b52abe52e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e326f95a9604fdb9bd075db3837cf62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:50:56.817215 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-5a79d0b8-97a8-4efe-b92d-8669f15a7b41 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] 10.222.0.60 "GET /compute/v2.1/servers/3067be21-37ff-4a8f-8ca9-b1421e8be78f" status: 200 len: 1213 microversion: 2.1 time: 0.109725 Sep 14 08:50:56.818458 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 355/675] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:50:56 2022] GET /compute/v2.1/servers/3067be21-37ff-4a8f-8ca9-b1421e8be78f => generated 1213 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:50:56.861063 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-04a69351-68f6-47b4-a25a-a014baa023d2 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:50:56.861271 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-04a69351-68f6-47b4-a25a-a014baa023d2 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: 5059f5d9-6903-4cf4-a999-01d2d2ba0842] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:50:56.868416 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-04a69351-68f6-47b4-a25a-a014baa023d2 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:56.868886 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-04a69351-68f6-47b4-a25a-a014baa023d2 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:56.869471 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-04a69351-68f6-47b4-a25a-a014baa023d2 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:56.870233 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-04a69351-68f6-47b4-a25a-a014baa023d2 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:56.871132 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-04a69351-68f6-47b4-a25a-a014baa023d2 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:56.871758 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-04a69351-68f6-47b4-a25a-a014baa023d2 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:57.032735 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-04a69351-68f6-47b4-a25a-a014baa023d2 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:50:57.042700 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-04a69351-68f6-47b4-a25a-a014baa023d2 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:50:57.044629 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-04a69351-68f6-47b4-a25a-a014baa023d2 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:50:57.045953 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-04a69351-68f6-47b4-a25a-a014baa023d2 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/5059f5d9-6903-4cf4-a999-01d2d2ba0842" status: 200 len: 1566 microversion: 2.25 time: 0.190791 Sep 14 08:50:57.046583 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 321/676] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:50:56 2022] GET /compute/v2.1/servers/5059f5d9-6903-4cf4-a999-01d2d2ba0842 => generated 1566 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:50:57.169463 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-7b13a9ba-e74e-4a7f-9ace-77c6f6d5623e tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:50:57.171346 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-7b13a9ba-e74e-4a7f-9ace-77c6f6d5623e tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: 87a4e8b8-79db-43f6-be85-b738382e4699] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:50:57.216815 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7b13a9ba-e74e-4a7f-9ace-77c6f6d5623e tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:57.221759 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7b13a9ba-e74e-4a7f-9ace-77c6f6d5623e tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:57.223008 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7b13a9ba-e74e-4a7f-9ace-77c6f6d5623e tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:57.224279 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7b13a9ba-e74e-4a7f-9ace-77c6f6d5623e tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:57.225022 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7b13a9ba-e74e-4a7f-9ace-77c6f6d5623e tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:57.226249 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7b13a9ba-e74e-4a7f-9ace-77c6f6d5623e tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:57.542015 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-e0b2b8fd-c8f0-4a21-90c0-0c258d16281e tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:50:57.544268 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-e0b2b8fd-c8f0-4a21-90c0-0c258d16281e tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: e4c51c69-8c2e-4202-9c2f-3dfae93392e9] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:50:57.559786 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e0b2b8fd-c8f0-4a21-90c0-0c258d16281e tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:57.561357 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e0b2b8fd-c8f0-4a21-90c0-0c258d16281e tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:57.564934 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e0b2b8fd-c8f0-4a21-90c0-0c258d16281e tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:57.565963 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e0b2b8fd-c8f0-4a21-90c0-0c258d16281e tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:57.566782 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e0b2b8fd-c8f0-4a21-90c0-0c258d16281e tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:57.577379 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e0b2b8fd-c8f0-4a21-90c0-0c258d16281e tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:57.681305 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-7b13a9ba-e74e-4a7f-9ace-77c6f6d5623e tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:50:57.692328 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-7b13a9ba-e74e-4a7f-9ace-77c6f6d5623e tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/87a4e8b8-79db-43f6-be85-b738382e4699" status: 200 len: 1504 microversion: 2.1 time: 0.530407 Sep 14 08:50:57.693159 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 356/677] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:50:57 2022] GET /compute/v2.1/servers/87a4e8b8-79db-43f6-be85-b738382e4699 => generated 1504 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:50:57.847943 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-fca1de6e-59d3-418d-9298-6df7e1c6a706 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:50:57.848625 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-fca1de6e-59d3-418d-9298-6df7e1c6a706 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] [instance: 3067be21-37ff-4a8f-8ca9-b1421e8be78f] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:50:57.860058 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fca1de6e-59d3-418d-9298-6df7e1c6a706 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:57.861896 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fca1de6e-59d3-418d-9298-6df7e1c6a706 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:57.862515 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fca1de6e-59d3-418d-9298-6df7e1c6a706 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:57.864699 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fca1de6e-59d3-418d-9298-6df7e1c6a706 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:57.865470 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fca1de6e-59d3-418d-9298-6df7e1c6a706 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:57.866161 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fca1de6e-59d3-418d-9298-6df7e1c6a706 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:57.932194 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-e0b2b8fd-c8f0-4a21-90c0-0c258d16281e tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:50:57.951435 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-e0b2b8fd-c8f0-4a21-90c0-0c258d16281e tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/e4c51c69-8c2e-4202-9c2f-3dfae93392e9" status: 200 len: 1476 microversion: 2.1 time: 0.421136 Sep 14 08:50:57.952741 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 322/678] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:50:57 2022] GET /compute/v2.1/servers/e4c51c69-8c2e-4202-9c2f-3dfae93392e9 => generated 1476 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:50:58.031717 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-fca1de6e-59d3-418d-9298-6df7e1c6a706 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c7802984cf48d1852832b52abe52e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e326f95a9604fdb9bd075db3837cf62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:50:58.065735 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-fca1de6e-59d3-418d-9298-6df7e1c6a706 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] 10.222.0.60 "GET /compute/v2.1/servers/3067be21-37ff-4a8f-8ca9-b1421e8be78f" status: 200 len: 1213 microversion: 2.1 time: 0.223074 Sep 14 08:50:58.067576 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 357/679] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:50:57 2022] GET /compute/v2.1/servers/3067be21-37ff-4a8f-8ca9-b1421e8be78f => generated 1213 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:50:58.089331 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-0875a475-ece2-4dda-a30e-83379926a4ac tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:50:58.089965 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-0875a475-ece2-4dda-a30e-83379926a4ac tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: 5059f5d9-6903-4cf4-a999-01d2d2ba0842] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:50:58.103869 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0875a475-ece2-4dda-a30e-83379926a4ac tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:58.104578 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0875a475-ece2-4dda-a30e-83379926a4ac tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:58.105029 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0875a475-ece2-4dda-a30e-83379926a4ac tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:58.105765 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0875a475-ece2-4dda-a30e-83379926a4ac tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:58.106227 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0875a475-ece2-4dda-a30e-83379926a4ac tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:58.106656 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0875a475-ece2-4dda-a30e-83379926a4ac tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:58.646619 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-0875a475-ece2-4dda-a30e-83379926a4ac tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:50:58.669841 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-0875a475-ece2-4dda-a30e-83379926a4ac tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:50:58.671465 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-0875a475-ece2-4dda-a30e-83379926a4ac tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:50:58.672675 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-0875a475-ece2-4dda-a30e-83379926a4ac tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/5059f5d9-6903-4cf4-a999-01d2d2ba0842" status: 200 len: 1566 microversion: 2.25 time: 0.602601 Sep 14 08:50:58.688286 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 323/680] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:50:58 2022] GET /compute/v2.1/servers/5059f5d9-6903-4cf4-a999-01d2d2ba0842 => generated 1566 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:50:58.718096 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-553268b3-b037-45dd-9507-a750072cf22c tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:50:58.719610 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-553268b3-b037-45dd-9507-a750072cf22c tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: 87a4e8b8-79db-43f6-be85-b738382e4699] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:50:58.744487 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-553268b3-b037-45dd-9507-a750072cf22c tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:58.747713 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-553268b3-b037-45dd-9507-a750072cf22c tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:58.749970 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-553268b3-b037-45dd-9507-a750072cf22c tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:58.750981 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-553268b3-b037-45dd-9507-a750072cf22c tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:58.751733 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-553268b3-b037-45dd-9507-a750072cf22c tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:58.752370 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-553268b3-b037-45dd-9507-a750072cf22c tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:58.979664 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-5e8b6b9a-2192-498b-a9be-196f37e2bb1c tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:50:58.980501 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-5e8b6b9a-2192-498b-a9be-196f37e2bb1c tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: e4c51c69-8c2e-4202-9c2f-3dfae93392e9] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:50:58.988842 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5e8b6b9a-2192-498b-a9be-196f37e2bb1c tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:58.995116 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5e8b6b9a-2192-498b-a9be-196f37e2bb1c tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:58.995796 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5e8b6b9a-2192-498b-a9be-196f37e2bb1c tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:58.996707 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5e8b6b9a-2192-498b-a9be-196f37e2bb1c tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:58.997318 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5e8b6b9a-2192-498b-a9be-196f37e2bb1c tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:58.997885 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5e8b6b9a-2192-498b-a9be-196f37e2bb1c tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:59.013010 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=100 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:50:59.614708 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-553268b3-b037-45dd-9507-a750072cf22c tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:50:59.623952 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-553268b3-b037-45dd-9507-a750072cf22c tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/87a4e8b8-79db-43f6-be85-b738382e4699" status: 200 len: 1504 microversion: 2.1 time: 0.911465 Sep 14 08:50:59.636072 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 358/681] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:50:58 2022] GET /compute/v2.1/servers/87a4e8b8-79db-43f6-be85-b738382e4699 => generated 1504 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:50:59.641237 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-cb5f37fd-f2fb-4b12-843f-5a7baea4c059 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:50:59.641852 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-cb5f37fd-f2fb-4b12-843f-5a7baea4c059 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] [instance: 3067be21-37ff-4a8f-8ca9-b1421e8be78f] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:50:59.648193 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cb5f37fd-f2fb-4b12-843f-5a7baea4c059 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:59.648897 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cb5f37fd-f2fb-4b12-843f-5a7baea4c059 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:59.649537 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cb5f37fd-f2fb-4b12-843f-5a7baea4c059 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:59.650440 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cb5f37fd-f2fb-4b12-843f-5a7baea4c059 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:59.651093 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cb5f37fd-f2fb-4b12-843f-5a7baea4c059 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:59.651677 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cb5f37fd-f2fb-4b12-843f-5a7baea4c059 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:59.664679 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=100 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:50:59.889423 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-cb5f37fd-f2fb-4b12-843f-5a7baea4c059 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c7802984cf48d1852832b52abe52e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e326f95a9604fdb9bd075db3837cf62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:50:59.899167 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-cb5f37fd-f2fb-4b12-843f-5a7baea4c059 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] 10.222.0.60 "GET /compute/v2.1/servers/3067be21-37ff-4a8f-8ca9-b1421e8be78f" status: 200 len: 1269 microversion: 2.1 time: 0.261641 Sep 14 08:50:59.905059 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 359/682] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:50:59 2022] GET /compute/v2.1/servers/3067be21-37ff-4a8f-8ca9-b1421e8be78f => generated 1269 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:50:59.920588 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a3e37192-b8e6-43a8-8dd0-78bfae1e3968 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:50:59.921658 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-a3e37192-b8e6-43a8-8dd0-78bfae1e3968 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: 5059f5d9-6903-4cf4-a999-01d2d2ba0842] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:50:59.928584 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a3e37192-b8e6-43a8-8dd0-78bfae1e3968 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:59.929355 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a3e37192-b8e6-43a8-8dd0-78bfae1e3968 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:59.930253 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a3e37192-b8e6-43a8-8dd0-78bfae1e3968 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:59.931790 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a3e37192-b8e6-43a8-8dd0-78bfae1e3968 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:50:59.932660 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a3e37192-b8e6-43a8-8dd0-78bfae1e3968 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:50:59.933343 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a3e37192-b8e6-43a8-8dd0-78bfae1e3968 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:50:59.971392 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-5e8b6b9a-2192-498b-a9be-196f37e2bb1c tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:50:59.988026 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-5e8b6b9a-2192-498b-a9be-196f37e2bb1c tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/e4c51c69-8c2e-4202-9c2f-3dfae93392e9" status: 200 len: 1475 microversion: 2.1 time: 1.012132 Sep 14 08:50:59.989231 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 324/683] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:50:58 2022] GET /compute/v2.1/servers/e4c51c69-8c2e-4202-9c2f-3dfae93392e9 => generated 1475 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:51:00.663798 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-72d5d0dd-6d9b-47c3-8574-c28b2094555c tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:51:00.664804 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-72d5d0dd-6d9b-47c3-8574-c28b2094555c tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: 87a4e8b8-79db-43f6-be85-b738382e4699] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:51:00.675186 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-72d5d0dd-6d9b-47c3-8574-c28b2094555c tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:00.676330 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-72d5d0dd-6d9b-47c3-8574-c28b2094555c tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:00.676973 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-72d5d0dd-6d9b-47c3-8574-c28b2094555c tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:00.677884 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-72d5d0dd-6d9b-47c3-8574-c28b2094555c tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:00.678538 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-72d5d0dd-6d9b-47c3-8574-c28b2094555c tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:00.679316 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-72d5d0dd-6d9b-47c3-8574-c28b2094555c tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:00.863143 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-a3e37192-b8e6-43a8-8dd0-78bfae1e3968 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:00.877357 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-a3e37192-b8e6-43a8-8dd0-78bfae1e3968 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:00.882465 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-a3e37192-b8e6-43a8-8dd0-78bfae1e3968 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:00.885452 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a3e37192-b8e6-43a8-8dd0-78bfae1e3968 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/5059f5d9-6903-4cf4-a999-01d2d2ba0842" status: 200 len: 1566 microversion: 2.25 time: 0.978979 Sep 14 08:51:00.887187 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 360/684] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:50:59 2022] GET /compute/v2.1/servers/5059f5d9-6903-4cf4-a999-01d2d2ba0842 => generated 1566 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:51:00.900086 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-c613fac7-deb8-4ca7-b32c-ad417684d724 req-86799249-6ab9-4cb8-8e15-1c527763a933 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4c51c69-8c2e-4202-9c2f-3dfae93392e9", "name": "network-vif-unplugged", "status": "completed", "tag": "158744dd-786d-4346-8779-274378b61a47"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:51:00.925552 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-c613fac7-deb8-4ca7-b32c-ad417684d724 req-86799249-6ab9-4cb8-8e15-1c527763a933 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:00.929083 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-c613fac7-deb8-4ca7-b32c-ad417684d724 req-86799249-6ab9-4cb8-8e15-1c527763a933 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:00.929746 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-c613fac7-deb8-4ca7-b32c-ad417684d724 req-86799249-6ab9-4cb8-8e15-1c527763a933 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:00.964202 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-c613fac7-deb8-4ca7-b32c-ad417684d724 req-86799249-6ab9-4cb8-8e15-1c527763a933 service nova] Creating event network-vif-unplugged:158744dd-786d-4346-8779-274378b61a47 for instance e4c51c69-8c2e-4202-9c2f-3dfae93392e9 on n-h1-836830-18 Sep 14 08:51:00.978677 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [req-c613fac7-deb8-4ca7-b32c-ad417684d724 req-86799249-6ab9-4cb8-8e15-1c527763a933 service nova] Instance e4c51c69-8c2e-4202-9c2f-3dfae93392e9 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-836830-18', 'n-h2-836830-18'} {{(pid=128759) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 14 08:51:00.995109 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-c613fac7-deb8-4ca7-b32c-ad417684d724 req-86799249-6ab9-4cb8-8e15-1c527763a933 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.104892 Sep 14 08:51:00.996454 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 361/685] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:51:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:51:01.002356 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c4d96382-4d5c-4607-b84f-c9c74ef156b0 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:51:01.003299 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-c4d96382-4d5c-4607-b84f-c9c74ef156b0 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] [instance: 3067be21-37ff-4a8f-8ca9-b1421e8be78f] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:51:01.013207 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c4d96382-4d5c-4607-b84f-c9c74ef156b0 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:01.014772 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c4d96382-4d5c-4607-b84f-c9c74ef156b0 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:01.015571 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c4d96382-4d5c-4607-b84f-c9c74ef156b0 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:01.016642 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c4d96382-4d5c-4607-b84f-c9c74ef156b0 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:01.017391 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c4d96382-4d5c-4607-b84f-c9c74ef156b0 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:01.019484 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c4d96382-4d5c-4607-b84f-c9c74ef156b0 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:01.319407 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-c4d96382-4d5c-4607-b84f-c9c74ef156b0 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c7802984cf48d1852832b52abe52e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e326f95a9604fdb9bd075db3837cf62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:01.332504 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-c4d96382-4d5c-4607-b84f-c9c74ef156b0 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] 10.222.0.60 "GET /compute/v2.1/servers/3067be21-37ff-4a8f-8ca9-b1421e8be78f" status: 200 len: 1275 microversion: 2.1 time: 0.334285 Sep 14 08:51:01.332791 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 362/686] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:51:00 2022] GET /compute/v2.1/servers/3067be21-37ff-4a8f-8ca9-b1421e8be78f => generated 1275 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:51:01.344968 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-6cc7e4a5-4bf3-4604-ac8a-f9231330a9ec tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:51:01.345597 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-6cc7e4a5-4bf3-4604-ac8a-f9231330a9ec tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: e4c51c69-8c2e-4202-9c2f-3dfae93392e9] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:51:01.365082 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6cc7e4a5-4bf3-4604-ac8a-f9231330a9ec tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:01.365347 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6cc7e4a5-4bf3-4604-ac8a-f9231330a9ec tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:01.365646 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6cc7e4a5-4bf3-4604-ac8a-f9231330a9ec tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:01.371457 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6cc7e4a5-4bf3-4604-ac8a-f9231330a9ec tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:01.372039 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6cc7e4a5-4bf3-4604-ac8a-f9231330a9ec tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:01.372483 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6cc7e4a5-4bf3-4604-ac8a-f9231330a9ec tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:01.895120 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-72d5d0dd-6d9b-47c3-8574-c28b2094555c tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:01.903567 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-72d5d0dd-6d9b-47c3-8574-c28b2094555c tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/87a4e8b8-79db-43f6-be85-b738382e4699" status: 200 len: 1504 microversion: 2.1 time: 1.244846 Sep 14 08:51:01.904161 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 325/687] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:51:00 2022] GET /compute/v2.1/servers/87a4e8b8-79db-43f6-be85-b738382e4699 => generated 1504 bytes in 1247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:51:01.924187 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-f4224878-6fd6-4725-be9d-23f117111d1f tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:51:01.925035 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-f4224878-6fd6-4725-be9d-23f117111d1f tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: 5059f5d9-6903-4cf4-a999-01d2d2ba0842] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:51:01.931774 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f4224878-6fd6-4725-be9d-23f117111d1f tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:01.932515 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f4224878-6fd6-4725-be9d-23f117111d1f tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:01.933870 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f4224878-6fd6-4725-be9d-23f117111d1f tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:01.934837 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f4224878-6fd6-4725-be9d-23f117111d1f tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:01.935597 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f4224878-6fd6-4725-be9d-23f117111d1f tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:01.936171 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f4224878-6fd6-4725-be9d-23f117111d1f tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:02.188356 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-6cc7e4a5-4bf3-4604-ac8a-f9231330a9ec tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:02.199084 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-6cc7e4a5-4bf3-4604-ac8a-f9231330a9ec tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/e4c51c69-8c2e-4202-9c2f-3dfae93392e9" status: 200 len: 1475 microversion: 2.1 time: 0.865205 Sep 14 08:51:02.199679 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 363/688] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:51:01 2022] GET /compute/v2.1/servers/e4c51c69-8c2e-4202-9c2f-3dfae93392e9 => generated 1475 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:51:02.299512 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-f4224878-6fd6-4725-be9d-23f117111d1f tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:02.313485 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-f4224878-6fd6-4725-be9d-23f117111d1f tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:02.315859 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-f4224878-6fd6-4725-be9d-23f117111d1f tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:02.317721 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-f4224878-6fd6-4725-be9d-23f117111d1f tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/5059f5d9-6903-4cf4-a999-01d2d2ba0842" status: 200 len: 1566 microversion: 2.25 time: 0.397408 Sep 14 08:51:02.319596 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 326/689] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:51:01 2022] GET /compute/v2.1/servers/5059f5d9-6903-4cf4-a999-01d2d2ba0842 => generated 1566 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:51:02.361490 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-0a0954d9-7730-4032-ab91-db27276e2a94 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:51:02.362110 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-0a0954d9-7730-4032-ab91-db27276e2a94 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] [instance: 3067be21-37ff-4a8f-8ca9-b1421e8be78f] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:51:02.369242 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0a0954d9-7730-4032-ab91-db27276e2a94 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:02.371334 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0a0954d9-7730-4032-ab91-db27276e2a94 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:02.371978 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0a0954d9-7730-4032-ab91-db27276e2a94 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:02.374026 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0a0954d9-7730-4032-ab91-db27276e2a94 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:02.381201 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0a0954d9-7730-4032-ab91-db27276e2a94 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:02.381874 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0a0954d9-7730-4032-ab91-db27276e2a94 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:02.939741 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-9e196d8d-3102-47b0-9bcb-665228c9f909 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:51:02.940199 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-9e196d8d-3102-47b0-9bcb-665228c9f909 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: 87a4e8b8-79db-43f6-be85-b738382e4699] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:51:02.959901 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9e196d8d-3102-47b0-9bcb-665228c9f909 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:02.960499 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9e196d8d-3102-47b0-9bcb-665228c9f909 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:02.960931 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9e196d8d-3102-47b0-9bcb-665228c9f909 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:02.961916 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9e196d8d-3102-47b0-9bcb-665228c9f909 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:02.962689 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9e196d8d-3102-47b0-9bcb-665228c9f909 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:02.963773 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9e196d8d-3102-47b0-9bcb-665228c9f909 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:03.230520 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-0a0954d9-7730-4032-ab91-db27276e2a94 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c7802984cf48d1852832b52abe52e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e326f95a9604fdb9bd075db3837cf62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:03.261138 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-0a0954d9-7730-4032-ab91-db27276e2a94 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] 10.222.0.60 "GET /compute/v2.1/servers/3067be21-37ff-4a8f-8ca9-b1421e8be78f" status: 200 len: 1317 microversion: 2.1 time: 0.903797 Sep 14 08:51:03.262411 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 364/690] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:51:02 2022] GET /compute/v2.1/servers/3067be21-37ff-4a8f-8ca9-b1421e8be78f => generated 1317 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:51:03.269968 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-32428d95-a0e5-49fe-8ae8-43f3c6253919 req-e1f97af9-7188-47d7-8d39-8064e33120e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4c51c69-8c2e-4202-9c2f-3dfae93392e9", "tag": "158744dd-786d-4346-8779-274378b61a47"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:51:03.287229 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-32428d95-a0e5-49fe-8ae8-43f3c6253919 req-e1f97af9-7188-47d7-8d39-8064e33120e1 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:03.288242 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-32428d95-a0e5-49fe-8ae8-43f3c6253919 req-e1f97af9-7188-47d7-8d39-8064e33120e1 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:03.288911 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-32428d95-a0e5-49fe-8ae8-43f3c6253919 req-e1f97af9-7188-47d7-8d39-8064e33120e1 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:03.313219 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-32428d95-a0e5-49fe-8ae8-43f3c6253919 req-e1f97af9-7188-47d7-8d39-8064e33120e1 service nova] Creating event network-changed:158744dd-786d-4346-8779-274378b61a47 for instance e4c51c69-8c2e-4202-9c2f-3dfae93392e9 on n-h1-836830-18 Sep 14 08:51:03.322501 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [req-32428d95-a0e5-49fe-8ae8-43f3c6253919 req-e1f97af9-7188-47d7-8d39-8064e33120e1 service nova] Instance e4c51c69-8c2e-4202-9c2f-3dfae93392e9 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-836830-18', 'n-h2-836830-18'} {{(pid=128759) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 14 08:51:03.337912 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-32428d95-a0e5-49fe-8ae8-43f3c6253919 req-e1f97af9-7188-47d7-8d39-8064e33120e1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072806 Sep 14 08:51:03.339909 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 365/691] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:51:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:51:03.367833 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-6cd55424-9a83-4d4a-8e68-c11fceb478f2 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:51:03.372151 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-6cd55424-9a83-4d4a-8e68-c11fceb478f2 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: e4c51c69-8c2e-4202-9c2f-3dfae93392e9] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:51:03.391240 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6cd55424-9a83-4d4a-8e68-c11fceb478f2 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:03.392642 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6cd55424-9a83-4d4a-8e68-c11fceb478f2 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:03.393293 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6cd55424-9a83-4d4a-8e68-c11fceb478f2 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:03.398869 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6cd55424-9a83-4d4a-8e68-c11fceb478f2 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:03.400398 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6cd55424-9a83-4d4a-8e68-c11fceb478f2 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:03.401522 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6cd55424-9a83-4d4a-8e68-c11fceb478f2 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:03.471231 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-9e196d8d-3102-47b0-9bcb-665228c9f909 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:03.486325 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-9e196d8d-3102-47b0-9bcb-665228c9f909 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/87a4e8b8-79db-43f6-be85-b738382e4699" status: 200 len: 1494 microversion: 2.1 time: 0.562206 Sep 14 08:51:03.487651 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 327/692] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:51:02 2022] GET /compute/v2.1/servers/87a4e8b8-79db-43f6-be85-b738382e4699 => generated 1494 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:51:03.494993 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-9e99994e-d143-4786-8b72-d71439d760ad tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:51:03.496363 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-9e99994e-d143-4786-8b72-d71439d760ad tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: 5059f5d9-6903-4cf4-a999-01d2d2ba0842] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:51:03.507580 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9e99994e-d143-4786-8b72-d71439d760ad tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:03.508379 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9e99994e-d143-4786-8b72-d71439d760ad tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:03.509797 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9e99994e-d143-4786-8b72-d71439d760ad tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:03.511138 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9e99994e-d143-4786-8b72-d71439d760ad tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:03.515788 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9e99994e-d143-4786-8b72-d71439d760ad tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:03.516522 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9e99994e-d143-4786-8b72-d71439d760ad tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:04.039609 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-6cd55424-9a83-4d4a-8e68-c11fceb478f2 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:04.052389 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-6cd55424-9a83-4d4a-8e68-c11fceb478f2 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/e4c51c69-8c2e-4202-9c2f-3dfae93392e9" status: 200 len: 1475 microversion: 2.1 time: 0.708415 Sep 14 08:51:04.054770 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 366/693] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:51:03 2022] GET /compute/v2.1/servers/e4c51c69-8c2e-4202-9c2f-3dfae93392e9 => generated 1475 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:51:04.069511 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-5a53595f-9298-4086-bd35-24a8565224d4 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Calling method '.version_select at 0x7f7d4443ad30>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:51:04.080134 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5a53595f-9298-4086-bd35-24a8565224d4 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:04.081293 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5a53595f-9298-4086-bd35-24a8565224d4 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:04.084861 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5a53595f-9298-4086-bd35-24a8565224d4 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:04.118654 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-5a53595f-9298-4086-bd35-24a8565224d4 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] 10.222.0.60 "GET /compute/v2.1/os-migrations" status: 200 len: 1587 microversion: 2.1 time: 0.061239 Sep 14 08:51:04.119630 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 367/694] 10.222.0.60 () {58 vars in 1143 bytes} [Wed Sep 14 08:51:04 2022] GET /compute/v2.1/os-migrations => generated 1587 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:51:04.136060 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-189d6331-f784-45fd-ab18-0dbca89daefc tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:51:04.136837 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-189d6331-f784-45fd-ab18-0dbca89daefc tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] [instance: 87a4e8b8-79db-43f6-be85-b738382e4699] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:51:04.144525 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-189d6331-f784-45fd-ab18-0dbca89daefc tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:04.145132 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-189d6331-f784-45fd-ab18-0dbca89daefc tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:04.145672 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-189d6331-f784-45fd-ab18-0dbca89daefc tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:04.146635 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-189d6331-f784-45fd-ab18-0dbca89daefc tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:04.147252 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-189d6331-f784-45fd-ab18-0dbca89daefc tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:04.147951 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-189d6331-f784-45fd-ab18-0dbca89daefc tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:04.409616 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-9e99994e-d143-4786-8b72-d71439d760ad tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:04.431411 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-9e99994e-d143-4786-8b72-d71439d760ad tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:04.433131 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-9e99994e-d143-4786-8b72-d71439d760ad tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:04.436463 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-9e99994e-d143-4786-8b72-d71439d760ad tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/5059f5d9-6903-4cf4-a999-01d2d2ba0842" status: 200 len: 1566 microversion: 2.25 time: 0.946131 Sep 14 08:51:04.442141 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 328/695] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:51:03 2022] GET /compute/v2.1/servers/5059f5d9-6903-4cf4-a999-01d2d2ba0842 => generated 1566 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:51:04.463934 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-dc72484a-9d93-47a5-b65b-1a3ba390ebd4 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:51:04.465081 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-dc72484a-9d93-47a5-b65b-1a3ba390ebd4 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] [instance: 3067be21-37ff-4a8f-8ca9-b1421e8be78f] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:51:04.472933 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dc72484a-9d93-47a5-b65b-1a3ba390ebd4 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:04.475662 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dc72484a-9d93-47a5-b65b-1a3ba390ebd4 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:04.476109 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dc72484a-9d93-47a5-b65b-1a3ba390ebd4 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:04.476858 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dc72484a-9d93-47a5-b65b-1a3ba390ebd4 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:04.477379 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dc72484a-9d93-47a5-b65b-1a3ba390ebd4 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:04.482225 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dc72484a-9d93-47a5-b65b-1a3ba390ebd4 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:04.868568 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-189d6331-f784-45fd-ab18-0dbca89daefc tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/87a4e8b8-79db-43f6-be85-b738382e4699" status: 200 len: 1647 microversion: 2.1 time: 0.738490 Sep 14 08:51:04.870294 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 368/696] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:51:04 2022] GET /compute/v2.1/servers/87a4e8b8-79db-43f6-be85-b738382e4699 => generated 1647 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:51:05.079619 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-794a9f39-e4dc-4d62-b38a-02ad1eb87d91 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-209014786", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "networks": [{"uuid": "3e96754e-5525-4c7d-b9d8-ac1d87e859d5"}]}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:51:05.155138 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-dc72484a-9d93-47a5-b65b-1a3ba390ebd4 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c7802984cf48d1852832b52abe52e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e326f95a9604fdb9bd075db3837cf62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:05.169993 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.network.neutron [None req-794a9f39-e4dc-4d62-b38a-02ad1eb87d91 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] validate_networks() for [('3e96754e-5525-4c7d-b9d8-ac1d87e859d5', None, None, None, None, None)] {{(pid=128759) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 08:51:05.170623 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-dc72484a-9d93-47a5-b65b-1a3ba390ebd4 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] 10.222.0.60 "GET /compute/v2.1/servers/3067be21-37ff-4a8f-8ca9-b1421e8be78f" status: 200 len: 1317 microversion: 2.1 time: 0.726853 Sep 14 08:51:05.177318 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 329/697] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:51:04 2022] GET /compute/v2.1/servers/3067be21-37ff-4a8f-8ca9-b1421e8be78f => generated 1317 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:51:05.183193 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d67c8e54-2b4f-49b3-a91c-641b3a389e03 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:51:05.184104 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-d67c8e54-2b4f-49b3-a91c-641b3a389e03 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: e4c51c69-8c2e-4202-9c2f-3dfae93392e9] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:51:05.192114 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d67c8e54-2b4f-49b3-a91c-641b3a389e03 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:05.193437 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d67c8e54-2b4f-49b3-a91c-641b3a389e03 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:05.195710 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d67c8e54-2b4f-49b3-a91c-641b3a389e03 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:05.197037 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d67c8e54-2b4f-49b3-a91c-641b3a389e03 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:05.197649 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d67c8e54-2b4f-49b3-a91c-641b3a389e03 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:05.198423 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d67c8e54-2b4f-49b3-a91c-641b3a389e03 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:05.451764 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=6 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:51:05.680856 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=10 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:51:05.705198 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-d67c8e54-2b4f-49b3-a91c-641b3a389e03 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:05.716168 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-d67c8e54-2b4f-49b3-a91c-641b3a389e03 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/e4c51c69-8c2e-4202-9c2f-3dfae93392e9" status: 200 len: 1475 microversion: 2.1 time: 0.537423 Sep 14 08:51:05.720250 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 330/698] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:51:05 2022] GET /compute/v2.1/servers/e4c51c69-8c2e-4202-9c2f-3dfae93392e9 => generated 1475 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:51:05.733379 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-572e390e-2378-4e19-9784-1fcfffa61886 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:51:05.734397 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-572e390e-2378-4e19-9784-1fcfffa61886 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: 5059f5d9-6903-4cf4-a999-01d2d2ba0842] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:51:05.745037 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-572e390e-2378-4e19-9784-1fcfffa61886 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:05.745881 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-572e390e-2378-4e19-9784-1fcfffa61886 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:05.746571 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-572e390e-2378-4e19-9784-1fcfffa61886 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:05.747570 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-572e390e-2378-4e19-9784-1fcfffa61886 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:05.748245 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-572e390e-2378-4e19-9784-1fcfffa61886 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:05.749077 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-572e390e-2378-4e19-9784-1fcfffa61886 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:06.456525 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-572e390e-2378-4e19-9784-1fcfffa61886 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:06.480659 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-572e390e-2378-4e19-9784-1fcfffa61886 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:06.517215 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-572e390e-2378-4e19-9784-1fcfffa61886 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:06.524633 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-572e390e-2378-4e19-9784-1fcfffa61886 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/5059f5d9-6903-4cf4-a999-01d2d2ba0842" status: 200 len: 1556 microversion: 2.25 time: 0.796888 Sep 14 08:51:06.526378 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 331/699] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:51:05 2022] GET /compute/v2.1/servers/5059f5d9-6903-4cf4-a999-01d2d2ba0842 => generated 1556 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:51:06.537897 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-e8695d1a-9dc5-4941-9854-fb8284b45e48 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:51:06.538516 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-e8695d1a-9dc5-4941-9854-fb8284b45e48 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] [instance: 3067be21-37ff-4a8f-8ca9-b1421e8be78f] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:51:06.569367 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e8695d1a-9dc5-4941-9854-fb8284b45e48 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:06.570055 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e8695d1a-9dc5-4941-9854-fb8284b45e48 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:06.570485 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e8695d1a-9dc5-4941-9854-fb8284b45e48 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:06.571258 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e8695d1a-9dc5-4941-9854-fb8284b45e48 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:06.576876 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e8695d1a-9dc5-4941-9854-fb8284b45e48 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:06.579045 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e8695d1a-9dc5-4941-9854-fb8284b45e48 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:06.618105 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-794a9f39-e4dc-4d62-b38a-02ad1eb87d91 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Flavor limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 08:51:06.619274 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-794a9f39-e4dc-4d62-b38a-02ad1eb87d91 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Image limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 08:51:06.620231 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-794a9f39-e4dc-4d62-b38a-02ad1eb87d91 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Flavor pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 08:51:06.621300 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-794a9f39-e4dc-4d62-b38a-02ad1eb87d91 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Image pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 08:51:06.622252 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-794a9f39-e4dc-4d62-b38a-02ad1eb87d91 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 08:51:06.642559 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-794a9f39-e4dc-4d62-b38a-02ad1eb87d91 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:06.643907 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-794a9f39-e4dc-4d62-b38a-02ad1eb87d91 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:06.647711 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-794a9f39-e4dc-4d62-b38a-02ad1eb87d91 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:06.649791 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-794a9f39-e4dc-4d62-b38a-02ad1eb87d91 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:06.652524 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-794a9f39-e4dc-4d62-b38a-02ad1eb87d91 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:06.653232 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-794a9f39-e4dc-4d62-b38a-02ad1eb87d91 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:06.724756 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-794a9f39-e4dc-4d62-b38a-02ad1eb87d91 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Getting quotas for project a7342631eeb747ba831f1d8a20fb8bf3. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 08:51:06.740343 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-794a9f39-e4dc-4d62-b38a-02ad1eb87d91 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Getting quotas for user cd713a1c3e7148ef8bfcbe44d1a80a18 and project a7342631eeb747ba831f1d8a20fb8bf3. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 08:51:06.785749 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-794a9f39-e4dc-4d62-b38a-02ad1eb87d91 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Going to run 1 instances... {{(pid=128759) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 08:51:06.792606 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-794a9f39-e4dc-4d62-b38a-02ad1eb87d91 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: 874205eb-5321-4a9a-aa38-3cd83b2ac1a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128759) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 08:51:06.933680 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-794a9f39-e4dc-4d62-b38a-02ad1eb87d91 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.869386 Sep 14 08:51:06.942021 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 369/700] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 08:51:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1878 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 08:51:06.952090 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e904478c-e365-4c80-97db-5113781d28cd tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Calling method '.version_select at 0x7f7d44427820>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:51:06.962890 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e904478c-e365-4c80-97db-5113781d28cd tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:06.963458 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e904478c-e365-4c80-97db-5113781d28cd tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:06.980100 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e904478c-e365-4c80-97db-5113781d28cd tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:07.015035 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e904478c-e365-4c80-97db-5113781d28cd tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] 10.222.0.60 "GET /compute/v2.1/os-migrations" status: 200 len: 1966 microversion: 2.25 time: 0.069225 Sep 14 08:51:07.015441 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 370/701] 10.222.0.60 () {60 vars in 1184 bytes} [Wed Sep 14 08:51:06 2022] GET /compute/v2.1/os-migrations => generated 1966 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:51:07.029620 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8e5b54d3-d911-4649-a024-ffbde9e96037 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:51:07.030708 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-8e5b54d3-d911-4649-a024-ffbde9e96037 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: e4c51c69-8c2e-4202-9c2f-3dfae93392e9] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:51:07.051101 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8e5b54d3-d911-4649-a024-ffbde9e96037 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:07.051605 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8e5b54d3-d911-4649-a024-ffbde9e96037 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:07.052039 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8e5b54d3-d911-4649-a024-ffbde9e96037 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:07.052951 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8e5b54d3-d911-4649-a024-ffbde9e96037 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:07.060814 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8e5b54d3-d911-4649-a024-ffbde9e96037 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:07.060814 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8e5b54d3-d911-4649-a024-ffbde9e96037 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:07.291587 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-e8695d1a-9dc5-4941-9854-fb8284b45e48 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c7802984cf48d1852832b52abe52e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e326f95a9604fdb9bd075db3837cf62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:07.300884 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-e8695d1a-9dc5-4941-9854-fb8284b45e48 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] 10.222.0.60 "GET /compute/v2.1/servers/3067be21-37ff-4a8f-8ca9-b1421e8be78f" status: 200 len: 1317 microversion: 2.1 time: 0.769451 Sep 14 08:51:07.311379 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 332/702] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:51:06 2022] GET /compute/v2.1/servers/3067be21-37ff-4a8f-8ca9-b1421e8be78f => generated 1317 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:51:07.316470 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-444d0c80-cab7-42d8-a53a-3790453fb680 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:51:07.317082 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-444d0c80-cab7-42d8-a53a-3790453fb680 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: 874205eb-5321-4a9a-aa38-3cd83b2ac1a3] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:51:07.741601 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-444d0c80-cab7-42d8-a53a-3790453fb680 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:07.751819 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-444d0c80-cab7-42d8-a53a-3790453fb680 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/874205eb-5321-4a9a-aa38-3cd83b2ac1a3" status: 200 len: 1210 microversion: 2.1 time: 0.439213 Sep 14 08:51:07.754527 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 333/703] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:51:07 2022] GET /compute/v2.1/servers/874205eb-5321-4a9a-aa38-3cd83b2ac1a3 => generated 1210 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:51:07.766984 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-656a509f-49c4-404c-841e-e161decd4ce0 tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:51:07.767735 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-656a509f-49c4-404c-841e-e161decd4ce0 tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] [instance: 5059f5d9-6903-4cf4-a999-01d2d2ba0842] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:51:07.780427 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-656a509f-49c4-404c-841e-e161decd4ce0 tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:07.782147 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-656a509f-49c4-404c-841e-e161decd4ce0 tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:07.783899 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-656a509f-49c4-404c-841e-e161decd4ce0 tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:07.785227 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-656a509f-49c4-404c-841e-e161decd4ce0 tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:07.788286 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-656a509f-49c4-404c-841e-e161decd4ce0 tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:07.790666 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-656a509f-49c4-404c-841e-e161decd4ce0 tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:07.851131 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-8e5b54d3-d911-4649-a024-ffbde9e96037 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:07.866530 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-8e5b54d3-d911-4649-a024-ffbde9e96037 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/e4c51c69-8c2e-4202-9c2f-3dfae93392e9" status: 200 len: 1473 microversion: 2.1 time: 0.848866 Sep 14 08:51:07.879587 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 371/704] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:51:07 2022] GET /compute/v2.1/servers/e4c51c69-8c2e-4202-9c2f-3dfae93392e9 => generated 1473 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:51:07.897752 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-61eb809c-5a7f-4b4e-9c1e-bd5115a6a396 req-7587799d-3500-49e7-9e87-9a0490cd0277 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3067be21-37ff-4a8f-8ca9-b1421e8be78f", "tag": "44871f2d-de05-4001-8dcf-b562431aacba"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:51:07.922728 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-61eb809c-5a7f-4b4e-9c1e-bd5115a6a396 req-7587799d-3500-49e7-9e87-9a0490cd0277 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:07.923516 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-61eb809c-5a7f-4b4e-9c1e-bd5115a6a396 req-7587799d-3500-49e7-9e87-9a0490cd0277 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:07.925340 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-61eb809c-5a7f-4b4e-9c1e-bd5115a6a396 req-7587799d-3500-49e7-9e87-9a0490cd0277 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:07.956258 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-61eb809c-5a7f-4b4e-9c1e-bd5115a6a396 req-7587799d-3500-49e7-9e87-9a0490cd0277 service nova] Creating event network-changed:44871f2d-de05-4001-8dcf-b562431aacba for instance 3067be21-37ff-4a8f-8ca9-b1421e8be78f on n-h2-836830-18 Sep 14 08:51:07.967705 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-61eb809c-5a7f-4b4e-9c1e-bd5115a6a396 req-7587799d-3500-49e7-9e87-9a0490cd0277 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078926 Sep 14 08:51:07.968321 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 372/705] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:51:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:51:08.150453 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.objects.instance [None req-656a509f-49c4-404c-841e-e161decd4ce0 tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Lazy-loading 'services' on Instance uuid 5059f5d9-6903-4cf4-a999-01d2d2ba0842 {{(pid=128758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 08:51:08.261132 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-656a509f-49c4-404c-841e-e161decd4ce0 tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/5059f5d9-6903-4cf4-a999-01d2d2ba0842" status: 200 len: 2050 microversion: 2.25 time: 0.502568 Sep 14 08:51:08.262115 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 334/706] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:51:07 2022] GET /compute/v2.1/servers/5059f5d9-6903-4cf4-a999-01d2d2ba0842 => generated 2050 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:51:08.331842 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b12475da-1483-42dc-a593-aca70ea2a4e7 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:51:08.332877 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b12475da-1483-42dc-a593-aca70ea2a4e7 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] [instance: 3067be21-37ff-4a8f-8ca9-b1421e8be78f] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:51:08.348952 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b12475da-1483-42dc-a593-aca70ea2a4e7 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:08.351291 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b12475da-1483-42dc-a593-aca70ea2a4e7 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:08.353356 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b12475da-1483-42dc-a593-aca70ea2a4e7 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:08.354312 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b12475da-1483-42dc-a593-aca70ea2a4e7 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:08.354797 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b12475da-1483-42dc-a593-aca70ea2a4e7 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:08.355269 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b12475da-1483-42dc-a593-aca70ea2a4e7 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:08.428198 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-54726f8a-5aae-42bc-b1cd-9a2736df59c1 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1841393817", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "networks": [{"uuid": "371ca8d4-dbd6-426c-b295-7fe3200f1240"}]}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:51:08.507244 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.network.neutron [None req-54726f8a-5aae-42bc-b1cd-9a2736df59c1 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] validate_networks() for [('371ca8d4-dbd6-426c-b295-7fe3200f1240', None, None, None, None, None)] {{(pid=128758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 08:51:08.807918 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b12475da-1483-42dc-a593-aca70ea2a4e7 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c7802984cf48d1852832b52abe52e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e326f95a9604fdb9bd075db3837cf62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:08.827026 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b12475da-1483-42dc-a593-aca70ea2a4e7 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] 10.222.0.60 "GET /compute/v2.1/servers/3067be21-37ff-4a8f-8ca9-b1421e8be78f" status: 200 len: 1317 microversion: 2.1 time: 0.497527 Sep 14 08:51:08.840603 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 373/707] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:51:08 2022] GET /compute/v2.1/servers/3067be21-37ff-4a8f-8ca9-b1421e8be78f => generated 1317 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:51:08.855043 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-344bba79-7e08-418d-adaa-9a80ab906907 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:51:08.856687 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-344bba79-7e08-418d-adaa-9a80ab906907 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: 874205eb-5321-4a9a-aa38-3cd83b2ac1a3] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:51:08.882331 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-344bba79-7e08-418d-adaa-9a80ab906907 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:08.884508 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-344bba79-7e08-418d-adaa-9a80ab906907 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:08.889441 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-344bba79-7e08-418d-adaa-9a80ab906907 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:08.890505 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-344bba79-7e08-418d-adaa-9a80ab906907 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:08.894611 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-344bba79-7e08-418d-adaa-9a80ab906907 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:08.896092 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-344bba79-7e08-418d-adaa-9a80ab906907 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:09.037858 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-344bba79-7e08-418d-adaa-9a80ab906907 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:09.050428 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-344bba79-7e08-418d-adaa-9a80ab906907 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/874205eb-5321-4a9a-aa38-3cd83b2ac1a3" status: 200 len: 1214 microversion: 2.1 time: 0.207166 Sep 14 08:51:09.051072 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 374/708] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:51:08 2022] GET /compute/v2.1/servers/874205eb-5321-4a9a-aa38-3cd83b2ac1a3 => generated 1214 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:51:09.061091 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b61ff199-7cbe-4e6b-b93c-7abbf6d80b5d tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:51:09.066374 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b61ff199-7cbe-4e6b-b93c-7abbf6d80b5d tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: e4c51c69-8c2e-4202-9c2f-3dfae93392e9] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:51:09.075076 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b61ff199-7cbe-4e6b-b93c-7abbf6d80b5d tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:09.075475 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b61ff199-7cbe-4e6b-b93c-7abbf6d80b5d tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:09.076082 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b61ff199-7cbe-4e6b-b93c-7abbf6d80b5d tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:09.076964 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b61ff199-7cbe-4e6b-b93c-7abbf6d80b5d tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:09.077583 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b61ff199-7cbe-4e6b-b93c-7abbf6d80b5d tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:09.079012 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b61ff199-7cbe-4e6b-b93c-7abbf6d80b5d tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:09.899995 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b61ff199-7cbe-4e6b-b93c-7abbf6d80b5d tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:09.912068 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b61ff199-7cbe-4e6b-b93c-7abbf6d80b5d tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/e4c51c69-8c2e-4202-9c2f-3dfae93392e9" status: 200 len: 1473 microversion: 2.1 time: 0.858959 Sep 14 08:51:09.915835 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 375/709] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:51:09 2022] GET /compute/v2.1/servers/e4c51c69-8c2e-4202-9c2f-3dfae93392e9 => generated 1473 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:51:09.921006 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f6e6f8a9-7862-4921-b859-ac7776a5fd18 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:51:09.936773 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f6e6f8a9-7862-4921-b859-ac7776a5fd18 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] [instance: 3067be21-37ff-4a8f-8ca9-b1421e8be78f] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:51:09.950043 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f6e6f8a9-7862-4921-b859-ac7776a5fd18 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:09.950577 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f6e6f8a9-7862-4921-b859-ac7776a5fd18 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:09.951081 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f6e6f8a9-7862-4921-b859-ac7776a5fd18 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:09.951819 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f6e6f8a9-7862-4921-b859-ac7776a5fd18 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:09.952273 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f6e6f8a9-7862-4921-b859-ac7776a5fd18 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:09.952754 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f6e6f8a9-7862-4921-b859-ac7776a5fd18 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:10.208392 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-54726f8a-5aae-42bc-b1cd-9a2736df59c1 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Flavor limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 08:51:10.210160 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-54726f8a-5aae-42bc-b1cd-9a2736df59c1 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Image limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 08:51:10.211147 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-54726f8a-5aae-42bc-b1cd-9a2736df59c1 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Flavor pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 08:51:10.212575 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-54726f8a-5aae-42bc-b1cd-9a2736df59c1 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Image pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 08:51:10.213412 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-54726f8a-5aae-42bc-b1cd-9a2736df59c1 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 08:51:10.245456 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-54726f8a-5aae-42bc-b1cd-9a2736df59c1 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:10.251514 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-54726f8a-5aae-42bc-b1cd-9a2736df59c1 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:10.252439 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-54726f8a-5aae-42bc-b1cd-9a2736df59c1 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:10.253859 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-54726f8a-5aae-42bc-b1cd-9a2736df59c1 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:10.255229 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-54726f8a-5aae-42bc-b1cd-9a2736df59c1 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:10.256274 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-54726f8a-5aae-42bc-b1cd-9a2736df59c1 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:10.281695 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f6e6f8a9-7862-4921-b859-ac7776a5fd18 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c7802984cf48d1852832b52abe52e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e326f95a9604fdb9bd075db3837cf62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:10.291733 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f6e6f8a9-7862-4921-b859-ac7776a5fd18 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] 10.222.0.60 "GET /compute/v2.1/servers/3067be21-37ff-4a8f-8ca9-b1421e8be78f" status: 200 len: 1317 microversion: 2.1 time: 0.374634 Sep 14 08:51:10.295485 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 376/710] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:51:09 2022] GET /compute/v2.1/servers/3067be21-37ff-4a8f-8ca9-b1421e8be78f => generated 1317 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:51:10.312755 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-bd7174fe-938e-4ae9-940a-4df5a0ec4424 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:51:10.313928 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-bd7174fe-938e-4ae9-940a-4df5a0ec4424 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: 874205eb-5321-4a9a-aa38-3cd83b2ac1a3] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:51:10.320414 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bd7174fe-938e-4ae9-940a-4df5a0ec4424 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:10.321742 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bd7174fe-938e-4ae9-940a-4df5a0ec4424 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:10.322360 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bd7174fe-938e-4ae9-940a-4df5a0ec4424 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:10.323384 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bd7174fe-938e-4ae9-940a-4df5a0ec4424 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:10.323857 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bd7174fe-938e-4ae9-940a-4df5a0ec4424 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:10.324319 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bd7174fe-938e-4ae9-940a-4df5a0ec4424 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:10.330035 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-54726f8a-5aae-42bc-b1cd-9a2736df59c1 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Getting quotas for project 3850954316f34104b2a8052dc78a50d7. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 08:51:10.342416 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-54726f8a-5aae-42bc-b1cd-9a2736df59c1 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Getting quotas for user f140347422af48a4875e80337a272e29 and project 3850954316f34104b2a8052dc78a50d7. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 08:51:10.366532 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-54726f8a-5aae-42bc-b1cd-9a2736df59c1 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Going to run 1 instances... {{(pid=128758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 08:51:10.369487 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-54726f8a-5aae-42bc-b1cd-9a2736df59c1 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: bf59291e-0a19-499b-a95b-a76d82b5e307] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 08:51:10.469045 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-54726f8a-5aae-42bc-b1cd-9a2736df59c1 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.044976 Sep 14 08:51:10.481778 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 335/711] 10.222.0.60 () {62 vars in 1188 bytes} [Wed Sep 14 08:51:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 2058 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Sep 14 08:51:10.488680 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-4681ecb6-e25f-4fa4-a886-b8fa2fb38eed tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:51:10.489511 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-4681ecb6-e25f-4fa4-a886-b8fa2fb38eed tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: bf59291e-0a19-499b-a95b-a76d82b5e307] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:51:10.631862 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-bd7174fe-938e-4ae9-940a-4df5a0ec4424 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:10.673613 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-bd7174fe-938e-4ae9-940a-4df5a0ec4424 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/874205eb-5321-4a9a-aa38-3cd83b2ac1a3" status: 200 len: 1262 microversion: 2.1 time: 0.375237 Sep 14 08:51:10.680953 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 377/712] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:51:10 2022] GET /compute/v2.1/servers/874205eb-5321-4a9a-aa38-3cd83b2ac1a3 => generated 1262 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:51:10.686517 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-4681ecb6-e25f-4fa4-a886-b8fa2fb38eed tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:10.707316 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-4681ecb6-e25f-4fa4-a886-b8fa2fb38eed tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:10.714363 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-4681ecb6-e25f-4fa4-a886-b8fa2fb38eed tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:10.715547 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-4681ecb6-e25f-4fa4-a886-b8fa2fb38eed tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/bf59291e-0a19-499b-a95b-a76d82b5e307" status: 200 len: 1262 microversion: 2.25 time: 0.232221 Sep 14 08:51:10.738234 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 336/713] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:51:10 2022] GET /compute/v2.1/servers/bf59291e-0a19-499b-a95b-a76d82b5e307 => generated 1262 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:51:10.942367 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d3ef65d4-8850-4c43-b2f4-9edd1aaa736d tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:51:10.943021 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-d3ef65d4-8850-4c43-b2f4-9edd1aaa736d tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: e4c51c69-8c2e-4202-9c2f-3dfae93392e9] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:51:10.952817 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d3ef65d4-8850-4c43-b2f4-9edd1aaa736d tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:10.953335 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d3ef65d4-8850-4c43-b2f4-9edd1aaa736d tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:10.956820 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d3ef65d4-8850-4c43-b2f4-9edd1aaa736d tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:10.958217 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d3ef65d4-8850-4c43-b2f4-9edd1aaa736d tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:10.959358 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d3ef65d4-8850-4c43-b2f4-9edd1aaa736d tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:10.961406 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d3ef65d4-8850-4c43-b2f4-9edd1aaa736d tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:11.322220 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-7ed7e0d8-7428-4737-916a-917445512b5a tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:51:11.323730 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-7ed7e0d8-7428-4737-916a-917445512b5a tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] [instance: 3067be21-37ff-4a8f-8ca9-b1421e8be78f] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:51:11.338613 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7ed7e0d8-7428-4737-916a-917445512b5a tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:11.350445 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7ed7e0d8-7428-4737-916a-917445512b5a tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:11.352905 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7ed7e0d8-7428-4737-916a-917445512b5a tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:11.353695 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7ed7e0d8-7428-4737-916a-917445512b5a tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:11.354168 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7ed7e0d8-7428-4737-916a-917445512b5a tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:11.354602 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7ed7e0d8-7428-4737-916a-917445512b5a tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:12.177279 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-7ed7e0d8-7428-4737-916a-917445512b5a tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c7802984cf48d1852832b52abe52e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e326f95a9604fdb9bd075db3837cf62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:12.198413 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-7ed7e0d8-7428-4737-916a-917445512b5a tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] 10.222.0.60 "GET /compute/v2.1/servers/3067be21-37ff-4a8f-8ca9-b1421e8be78f" status: 200 len: 1317 microversion: 2.1 time: 0.880117 Sep 14 08:51:12.199662 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 337/714] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:51:11 2022] GET /compute/v2.1/servers/3067be21-37ff-4a8f-8ca9-b1421e8be78f => generated 1317 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:51:12.275459 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-d3ef65d4-8850-4c43-b2f4-9edd1aaa736d tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:12.298668 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d3ef65d4-8850-4c43-b2f4-9edd1aaa736d tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/e4c51c69-8c2e-4202-9c2f-3dfae93392e9" status: 200 len: 1470 microversion: 2.1 time: 1.358747 Sep 14 08:51:12.299576 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 378/715] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:51:10 2022] GET /compute/v2.1/servers/e4c51c69-8c2e-4202-9c2f-3dfae93392e9 => generated 1470 bytes in 1362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:51:12.309831 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-89506833-3512-4da5-8ff2-22c28bb66e86 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:51:12.323679 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-89506833-3512-4da5-8ff2-22c28bb66e86 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: 874205eb-5321-4a9a-aa38-3cd83b2ac1a3] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:51:12.339919 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-89506833-3512-4da5-8ff2-22c28bb66e86 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:12.341989 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-89506833-3512-4da5-8ff2-22c28bb66e86 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:12.342637 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-89506833-3512-4da5-8ff2-22c28bb66e86 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:12.343512 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-89506833-3512-4da5-8ff2-22c28bb66e86 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:12.346350 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-89506833-3512-4da5-8ff2-22c28bb66e86 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:12.349706 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-89506833-3512-4da5-8ff2-22c28bb66e86 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:12.397654 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=100 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:51:12.521096 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-06ae55ce-2107-4e43-97df-97d4428f0814 tempest-SecurityGroupRulesNegativeTestJSON-455183585 tempest-SecurityGroupRulesNegativeTestJSON-455183585-project] Action: 'create', calling method: .version_select at 0x7f7d448188b0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1548877811", "description": "tempest-description-517657472"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:51:12.534432 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-89506833-3512-4da5-8ff2-22c28bb66e86 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:12.556724 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-89506833-3512-4da5-8ff2-22c28bb66e86 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/874205eb-5321-4a9a-aa38-3cd83b2ac1a3" status: 200 len: 1268 microversion: 2.1 time: 0.253758 Sep 14 08:51:12.562418 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 379/716] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:51:12 2022] GET /compute/v2.1/servers/874205eb-5321-4a9a-aa38-3cd83b2ac1a3 => generated 1268 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:51:12.568664 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-bbc183b0-7894-4f40-a534-7a95999ae85c tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:51:12.569545 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-bbc183b0-7894-4f40-a534-7a95999ae85c tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: bf59291e-0a19-499b-a95b-a76d82b5e307] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:51:12.577798 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bbc183b0-7894-4f40-a534-7a95999ae85c tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:12.578570 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bbc183b0-7894-4f40-a534-7a95999ae85c tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:12.579892 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bbc183b0-7894-4f40-a534-7a95999ae85c tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:12.584419 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bbc183b0-7894-4f40-a534-7a95999ae85c tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:12.585197 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bbc183b0-7894-4f40-a534-7a95999ae85c tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:12.586444 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bbc183b0-7894-4f40-a534-7a95999ae85c tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:12.801919 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-bbc183b0-7894-4f40-a534-7a95999ae85c tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:12.816809 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-bbc183b0-7894-4f40-a534-7a95999ae85c tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:12.821767 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-bbc183b0-7894-4f40-a534-7a95999ae85c tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:12.823863 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-bbc183b0-7894-4f40-a534-7a95999ae85c tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/bf59291e-0a19-499b-a95b-a76d82b5e307" status: 200 len: 1314 microversion: 2.25 time: 0.259766 Sep 14 08:51:12.825224 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 380/717] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:51:12 2022] GET /compute/v2.1/servers/bf59291e-0a19-499b-a95b-a76d82b5e307 => generated 1314 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:51:12.831470 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-07357406-4cdf-44ad-9b85-80420de3afdb tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:51:12.832284 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-07357406-4cdf-44ad-9b85-80420de3afdb tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: e4c51c69-8c2e-4202-9c2f-3dfae93392e9] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:51:12.840756 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-07357406-4cdf-44ad-9b85-80420de3afdb tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:12.841597 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-07357406-4cdf-44ad-9b85-80420de3afdb tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:12.842276 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-07357406-4cdf-44ad-9b85-80420de3afdb tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:12.843215 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-07357406-4cdf-44ad-9b85-80420de3afdb tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:12.844039 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-07357406-4cdf-44ad-9b85-80420de3afdb tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:12.844669 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-07357406-4cdf-44ad-9b85-80420de3afdb tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:12.956778 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-07357406-4cdf-44ad-9b85-80420de3afdb tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "POST /compute/v2.1/servers/e4c51c69-8c2e-4202-9c2f-3dfae93392e9/action" status: 204 len: 0 microversion: 2.1 time: 0.129938 Sep 14 08:51:12.957442 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 381/718] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 08:51:12 2022] POST /compute/v2.1/servers/e4c51c69-8c2e-4202-9c2f-3dfae93392e9/action => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 08:51:13.051203 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-92267a81-f041-4e53-97d0-ad40db0b39a6 tempest-FloatingIPsNegativeTestJSON-1367728790 tempest-FloatingIPsNegativeTestJSON-1367728790-project] Calling method '.version_select at 0x7f7d4445bc10>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:51:13.147746 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-92267a81-f041-4e53-97d0-ad40db0b39a6 tempest-FloatingIPsNegativeTestJSON-1367728790 tempest-FloatingIPsNegativeTestJSON-1367728790-project] 10.222.0.60 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.188915 Sep 14 08:51:13.148534 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 382/719] 10.222.0.60 () {58 vars in 1149 bytes} [Wed Sep 14 08:51:12 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 08:51:13.163514 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b092225b-226a-42de-9b07-f03873a4f865 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:51:13.164135 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b092225b-226a-42de-9b07-f03873a4f865 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: e4c51c69-8c2e-4202-9c2f-3dfae93392e9] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:51:13.167816 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-06ae55ce-2107-4e43-97df-97d4428f0814 tempest-SecurityGroupRulesNegativeTestJSON-455183585 tempest-SecurityGroupRulesNegativeTestJSON-455183585-project] 10.222.0.60 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.966884 Sep 14 08:51:13.168859 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 338/720] 10.222.0.60 () {60 vars in 1180 bytes} [Wed Sep 14 08:51:12 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:51:13.174926 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-2660a239-144c-42bb-bbab-dd8673114070 tempest-FloatingIPsNegativeTestJSON-1367728790 tempest-FloatingIPsNegativeTestJSON-1367728790-project] Action: 'create', calling method: .version_select at 0x7f7d447b73a0>, body: {"pool": "non_exist_pool"} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:51:13.209222 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b092225b-226a-42de-9b07-f03873a4f865 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:13.213747 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b092225b-226a-42de-9b07-f03873a4f865 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:13.220836 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b092225b-226a-42de-9b07-f03873a4f865 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:13.222791 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b092225b-226a-42de-9b07-f03873a4f865 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:13.226130 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b092225b-226a-42de-9b07-f03873a4f865 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:13.226795 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b092225b-226a-42de-9b07-f03873a4f865 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:13.276015 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-2660a239-144c-42bb-bbab-dd8673114070 tempest-FloatingIPsNegativeTestJSON-1367728790 tempest-FloatingIPsNegativeTestJSON-1367728790-project] HTTP exception thrown: Floating IP pool not found. Sep 14 08:51:13.278400 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-2660a239-144c-42bb-bbab-dd8673114070 tempest-FloatingIPsNegativeTestJSON-1367728790 tempest-FloatingIPsNegativeTestJSON-1367728790-project] Request method failure captured: Sep 14 08:51:13.278400 n-d-836830-18 devstack@n-api.service[128758]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Sep 14 08:51:13.278400 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 08:51:13.278400 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 08:51:13.278400 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 08:51:13.278400 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 26 Sep 14 08:51:13.278400 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 08:51:13.278400 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 08:51:13.278400 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 08:51:13.278400 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 08:51:13.278400 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZYA9fZ8bhG7HIWpiKrAtgv7fo9sOhvGDGsxZ3JtaqUerDei_0W9-PHuEryaFTAsrsKp6XSDuahXdDHeZzjeLNUHGujWCRWAYIG1kBdJFOPCTus7qQKCHrxMxDCU03_3YKZyNfku9kjC0ZoGdnPxA6mUjuKew0guQ81zzKYruEuIhxE Sep 14 08:51:13.278400 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 08:51:13.278400 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 08:51:13.278400 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 08:51:13.278400 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 08:51:13.278400 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 08:51:13.278400 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 08:51:13.278400 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: d1e20adb8fb54cfa9117fcf2bdc46bff Sep 14 08:51:13.278400 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1367728790 Sep 14 08:51:13.278400 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 08:51:13.278400 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 08:51:13.279860 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/d1e20adb8fb54cfa9117fcf2bdc46bff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_d1e20adb8fb54cfa9117fcf2bdc46bff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d1e20adb8fb54cfa9117fcf2bdc46bff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d1e20adb8fb54cfa9117fcf2bdc46bff"}]}] Sep 14 08:51:13.279860 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1367728790 Sep 14 08:51:13.279860 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: d1e20adb8fb54cfa9117fcf2bdc46bff Sep 14 08:51:13.279860 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1367728790 Sep 14 08:51:13.279860 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-FloatingIPsNegativeTestJSON-1367728790-project Sep 14 08:51:13.279860 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 08:51:13.279860 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 08:51:13.279860 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: a0300629eed94801af7cfa4e84516ba1 Sep 14 08:51:13.279860 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1367728790-project Sep 14 08:51:13.279860 n-d-836830-18 devstack@n-api.service[128758]: Sep 14 08:51:13.279860 n-d-836830-18 devstack@n-api.service[128758]: {"pool": "non_exist_pool"} Sep 14 08:51:13.279860 n-d-836830-18 devstack@n-api.service[128758]: method: Sep 14 08:51:13.279860 n-d-836830-18 devstack@n-api.service[128758]: exception: Floating IP pool not found. Sep 14 08:51:13.279860 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'body': {'pool': 'non_exist_pool'}} Sep 14 08:51:13.279860 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:51:13.280834 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:51:13.280834 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Sep 14 08:51:13.280834 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Sep 14 08:51:13.280834 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2972, in allocate_floating_ip Sep 14 08:51:13.280834 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Sep 14 08:51:13.280834 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2962, in _get_floating_ip_pool_id_by_name_or_id Sep 14 08:51:13.280834 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Sep 14 08:51:13.280834 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Sep 14 08:51:13.280834 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:51:13.280834 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:51:13.280834 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:51:13.280834 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:51:13.280834 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:51:13.280834 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:51:13.280834 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:51:13.280834 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:51:13.280834 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 08:51:13.280834 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 08:51:13.280834 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:51:13.280834 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:51:13.285048 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Sep 14 08:51:13.285048 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 14 08:51:13.285048 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Sep 14 08:51:13.285048 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:51:13.285048 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:51:13.285048 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:51:13.285048 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:51:13.285048 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:51:13.285048 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:51:13.285048 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:51:13.285048 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:51:13.285048 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Sep 14 08:51:13.285048 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:51:13.285048 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-2660a239-144c-42bb-bbab-dd8673114070 tempest-FloatingIPsNegativeTestJSON-1367728790 tempest-FloatingIPsNegativeTestJSON-1367728790-project] Returning 404 to user: Floating IP pool not found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:51:13.285048 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-2660a239-144c-42bb-bbab-dd8673114070 tempest-FloatingIPsNegativeTestJSON-1367728790 tempest-FloatingIPsNegativeTestJSON-1367728790-project] 10.222.0.60 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.109967 Sep 14 08:51:13.286202 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 339/721] 10.222.0.60 () {60 vars in 1170 bytes} [Wed Sep 14 08:51:13 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 14 08:51:13.292816 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-80fc6832-084d-414c-bc51-dbe9b652cc81 tempest-SecurityGroupRulesNegativeTestJSON-455183585 tempest-SecurityGroupRulesNegativeTestJSON-455183585-project] Action: 'create', calling method: .version_select at 0x7f7d447fb550>, body: {"security_group_rule": {"parent_group_id": "048f6081-2c69-465a-abab-5ae2fd60be11", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:51:13.888931 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b092225b-226a-42de-9b07-f03873a4f865 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:13.912906 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b092225b-226a-42de-9b07-f03873a4f865 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/e4c51c69-8c2e-4202-9c2f-3dfae93392e9" status: 200 len: 1470 microversion: 2.1 time: 0.749975 Sep 14 08:51:13.916829 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 383/722] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:51:13 2022] GET /compute/v2.1/servers/e4c51c69-8c2e-4202-9c2f-3dfae93392e9 => generated 1470 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:51:13.937000 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-33fae4a9-a597-42ce-9dbc-64181527a044 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:51:13.938112 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-33fae4a9-a597-42ce-9dbc-64181527a044 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] [instance: 3067be21-37ff-4a8f-8ca9-b1421e8be78f] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:51:13.956755 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-33fae4a9-a597-42ce-9dbc-64181527a044 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:13.957339 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-33fae4a9-a597-42ce-9dbc-64181527a044 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:13.957791 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-33fae4a9-a597-42ce-9dbc-64181527a044 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:13.958532 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-33fae4a9-a597-42ce-9dbc-64181527a044 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:13.962205 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-33fae4a9-a597-42ce-9dbc-64181527a044 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:13.966305 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-33fae4a9-a597-42ce-9dbc-64181527a044 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:14.377087 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-33fae4a9-a597-42ce-9dbc-64181527a044 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c7802984cf48d1852832b52abe52e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e326f95a9604fdb9bd075db3837cf62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:14.389082 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-33fae4a9-a597-42ce-9dbc-64181527a044 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] 10.222.0.60 "GET /compute/v2.1/servers/3067be21-37ff-4a8f-8ca9-b1421e8be78f" status: 200 len: 1317 microversion: 2.1 time: 0.470562 Sep 14 08:51:14.407613 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 384/723] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:51:13 2022] GET /compute/v2.1/servers/3067be21-37ff-4a8f-8ca9-b1421e8be78f => generated 1317 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:51:14.413849 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-80fc6832-084d-414c-bc51-dbe9b652cc81 tempest-SecurityGroupRulesNegativeTestJSON-455183585 tempest-SecurityGroupRulesNegativeTestJSON-455183585-project] 10.222.0.60 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.130134 Sep 14 08:51:14.417076 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 340/724] 10.222.0.60 () {60 vars in 1195 bytes} [Wed Sep 14 08:51:13 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:51:14.430855 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a25c938f-5be1-42fc-88ed-b6f4531ed6ae tempest-FloatingIPsNegativeTestJSON-1367728790 tempest-FloatingIPsNegativeTestJSON-1367728790-project] Calling method '.version_select at 0x7f7d445cf0d0>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:51:14.516373 n-d-836830-18 devstack@n-api.service[128759]: DEBUG neutronclient.v2_0.client [None req-a25c938f-5be1-42fc-88ed-b6f4531ed6ae tempest-FloatingIPsNegativeTestJSON-1367728790 tempest-FloatingIPsNegativeTestJSON-1367728790-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP a48171d9-0b4c-4cc9-93f6-3d8832a9f73b could not be found", "detail": ""}} {{(pid=128759) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 14 08:51:14.517064 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-a25c938f-5be1-42fc-88ed-b6f4531ed6ae tempest-FloatingIPsNegativeTestJSON-1367728790 tempest-FloatingIPsNegativeTestJSON-1367728790-project] HTTP exception thrown: Floating IP not found for ID a48171d9-0b4c-4cc9-93f6-3d8832a9f73b Sep 14 08:51:14.523728 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a25c938f-5be1-42fc-88ed-b6f4531ed6ae tempest-FloatingIPsNegativeTestJSON-1367728790 tempest-FloatingIPsNegativeTestJSON-1367728790-project] Request method failure captured: Sep 14 08:51:14.523728 n-d-836830-18 devstack@n-api.service[128759]: request: DELETE /compute/v2.1/os-floating-ips/a48171d9-0b4c-4cc9-93f6-3d8832a9f73b HTTP/1.1 Sep 14 08:51:14.523728 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 08:51:14.523728 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 08:51:14.523728 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 08:51:14.523728 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 08:51:14.523728 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 08:51:14.523728 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 08:51:14.523728 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 08:51:14.523728 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 08:51:14.523728 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZYA9fZ8bhG7HIWpiKrAtgv7fo9sOhvGDGsxZ3JtaqUerDei_0W9-PHuEryaFTAsrsKp6XSDuahXdDHeZzjeLNUHGujWCRWAYIG1kBdJFOPCTus7qQKCHrxMxDCU03_3YKZyNfku9kjC0ZoGdnPxA6mUjuKew0guQ81zzKYruEuIhxE Sep 14 08:51:14.523728 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 08:51:14.523728 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 08:51:14.523728 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 08:51:14.523728 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 08:51:14.523728 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 08:51:14.523728 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 08:51:14.523728 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: d1e20adb8fb54cfa9117fcf2bdc46bff Sep 14 08:51:14.523728 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1367728790 Sep 14 08:51:14.523728 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 08:51:14.523728 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 08:51:14.525805 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/d1e20adb8fb54cfa9117fcf2bdc46bff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_d1e20adb8fb54cfa9117fcf2bdc46bff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d1e20adb8fb54cfa9117fcf2bdc46bff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d1e20adb8fb54cfa9117fcf2bdc46bff"}]}] Sep 14 08:51:14.525805 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1367728790 Sep 14 08:51:14.525805 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: d1e20adb8fb54cfa9117fcf2bdc46bff Sep 14 08:51:14.525805 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1367728790 Sep 14 08:51:14.525805 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-FloatingIPsNegativeTestJSON-1367728790-project Sep 14 08:51:14.525805 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 08:51:14.525805 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 08:51:14.525805 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: a0300629eed94801af7cfa4e84516ba1 Sep 14 08:51:14.525805 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1367728790-project Sep 14 08:51:14.525805 n-d-836830-18 devstack@n-api.service[128759]: method: Sep 14 08:51:14.525805 n-d-836830-18 devstack@n-api.service[128759]: exception: Floating IP not found for ID a48171d9-0b4c-4cc9-93f6-3d8832a9f73b Sep 14 08:51:14.525805 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': 'a48171d9-0b4c-4cc9-93f6-3d8832a9f73b'} Sep 14 08:51:14.525805 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:51:14.526602 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:51:14.526602 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Sep 14 08:51:14.526602 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Sep 14 08:51:14.526602 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 08:51:14.526602 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 08:51:14.526602 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Sep 14 08:51:14.526602 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Sep 14 08:51:14.526602 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 08:51:14.526602 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 08:51:14.526602 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 14 08:51:14.526602 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 14 08:51:14.526602 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 08:51:14.526602 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 08:51:14.526602 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 14 08:51:14.526602 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 14 08:51:14.526602 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 08:51:14.526602 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 08:51:14.526602 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 14 08:51:14.526602 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 14 08:51:14.527781 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 08:51:14.527781 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 08:51:14.527781 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 14 08:51:14.527781 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 14 08:51:14.527781 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 14 08:51:14.527781 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 14 08:51:14.527781 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP a48171d9-0b4c-4cc9-93f6-3d8832a9f73b could not be found Sep 14 08:51:14.527781 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e1f4dbe4-d697-46c6-af5d-3140dc0d91c9'] Sep 14 08:51:14.527781 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:51:14.527781 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:51:14.527781 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:51:14.527781 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:51:14.527781 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Sep 14 08:51:14.527781 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Sep 14 08:51:14.527781 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Sep 14 08:51:14.527781 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Sep 14 08:51:14.527781 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID a48171d9-0b4c-4cc9-93f6-3d8832a9f73b. Sep 14 08:51:14.527781 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:51:14.527781 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:51:14.527781 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:51:14.528974 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:51:14.528974 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:51:14.528974 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:51:14.528974 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:51:14.528974 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:51:14.528974 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 08:51:14.528974 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 08:51:14.528974 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:51:14.528974 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:51:14.528974 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Sep 14 08:51:14.528974 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 14 08:51:14.528974 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID a48171d9-0b4c-4cc9-93f6-3d8832a9f73b Sep 14 08:51:14.528974 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:51:14.528974 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:51:14.528974 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:51:14.528974 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:51:14.528974 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:51:14.528974 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:51:14.528974 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:51:14.528974 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:51:14.530195 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID a48171d9-0b4c-4cc9-93f6-3d8832a9f73b Sep 14 08:51:14.530195 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:51:14.530195 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a25c938f-5be1-42fc-88ed-b6f4531ed6ae tempest-FloatingIPsNegativeTestJSON-1367728790 tempest-FloatingIPsNegativeTestJSON-1367728790-project] Returning 404 to user: Floating IP not found for ID a48171d9-0b4c-4cc9-93f6-3d8832a9f73b {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:51:14.530195 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a25c938f-5be1-42fc-88ed-b6f4531ed6ae tempest-FloatingIPsNegativeTestJSON-1367728790 tempest-FloatingIPsNegativeTestJSON-1367728790-project] 10.222.0.60 "DELETE /compute/v2.1/os-floating-ips/a48171d9-0b4c-4cc9-93f6-3d8832a9f73b" status: 404 len: 111 microversion: 2.1 time: 0.116953 Sep 14 08:51:14.530195 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 385/725] 10.222.0.60 () {58 vars in 1263 bytes} [Wed Sep 14 08:51:14 2022] DELETE /compute/v2.1/os-floating-ips/a48171d9-0b4c-4cc9-93f6-3d8832a9f73b => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 08:51:14.534852 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a6a05cf5-3238-46eb-ad75-96d9c6af5b4e tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:51:14.535513 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-a6a05cf5-3238-46eb-ad75-96d9c6af5b4e tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: 874205eb-5321-4a9a-aa38-3cd83b2ac1a3] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:51:14.556079 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a6a05cf5-3238-46eb-ad75-96d9c6af5b4e tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:14.556580 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a6a05cf5-3238-46eb-ad75-96d9c6af5b4e tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:14.562896 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a6a05cf5-3238-46eb-ad75-96d9c6af5b4e tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:14.564340 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a6a05cf5-3238-46eb-ad75-96d9c6af5b4e tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:14.570398 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a6a05cf5-3238-46eb-ad75-96d9c6af5b4e tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:14.572751 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a6a05cf5-3238-46eb-ad75-96d9c6af5b4e tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:14.625373 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-73fbeb6d-a610-4686-9f3e-f834e182a256 tempest-FloatingIPDetailsNegativeTestJSON-716078210 tempest-FloatingIPDetailsNegativeTestJSON-716078210-project] Calling method '.version_select at 0x7f7d44818160>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:51:14.866374 n-d-836830-18 devstack@n-api.service[128758]: DEBUG neutronclient.v2_0.client [None req-73fbeb6d-a610-4686-9f3e-f834e182a256 tempest-FloatingIPDetailsNegativeTestJSON-716078210 tempest-FloatingIPDetailsNegativeTestJSON-716078210-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP ca5c8cd1-bf65-455d-9ffb-ad08b264e156 could not be found", "detail": ""}} {{(pid=128758) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 14 08:51:14.867308 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-73fbeb6d-a610-4686-9f3e-f834e182a256 tempest-FloatingIPDetailsNegativeTestJSON-716078210 tempest-FloatingIPDetailsNegativeTestJSON-716078210-project] HTTP exception thrown: Floating IP not found for ID ca5c8cd1-bf65-455d-9ffb-ad08b264e156 Sep 14 08:51:14.870154 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-73fbeb6d-a610-4686-9f3e-f834e182a256 tempest-FloatingIPDetailsNegativeTestJSON-716078210 tempest-FloatingIPDetailsNegativeTestJSON-716078210-project] Request method failure captured: Sep 14 08:51:14.870154 n-d-836830-18 devstack@n-api.service[128758]: request: GET /compute/v2.1/os-floating-ips/ca5c8cd1-bf65-455d-9ffb-ad08b264e156 HTTP/1.1 Sep 14 08:51:14.870154 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 08:51:14.870154 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 08:51:14.870154 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 08:51:14.870154 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 08:51:14.870154 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 08:51:14.870154 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 08:51:14.870154 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 08:51:14.870154 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 08:51:14.870154 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZYBxzwsa_GT8QNtcWTk1rogamc-3cFiIWag3oSV77XksTvU_flGQeU1qC01momECOMMss24VxQMLrqpx7owTTwH5O1v8I3RXGVk9v9ZojffFVcQqsx7Kkv-VOAm6xiG7KihJt7A5odDVB_f74j7yjjkYrTxBcqmyUU9zlga8tbtsQc Sep 14 08:51:14.870154 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 08:51:14.870154 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 08:51:14.870154 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 08:51:14.870154 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 08:51:14.870154 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 08:51:14.870154 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 08:51:14.870154 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: ef0900341dfc4888b83047be13f42091 Sep 14 08:51:14.870154 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-716078210 Sep 14 08:51:14.870154 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 08:51:14.870154 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 08:51:14.871766 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/ef0900341dfc4888b83047be13f42091"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_ef0900341dfc4888b83047be13f42091"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ef0900341dfc4888b83047be13f42091"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ef0900341dfc4888b83047be13f42091"}]}] Sep 14 08:51:14.871766 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-716078210 Sep 14 08:51:14.871766 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: ef0900341dfc4888b83047be13f42091 Sep 14 08:51:14.871766 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-716078210 Sep 14 08:51:14.871766 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-716078210-project Sep 14 08:51:14.871766 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 08:51:14.871766 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 08:51:14.871766 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 64515d9f03fb4f65a41d1d9229cdd35c Sep 14 08:51:14.871766 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-716078210-project Sep 14 08:51:14.871766 n-d-836830-18 devstack@n-api.service[128758]: method: Sep 14 08:51:14.871766 n-d-836830-18 devstack@n-api.service[128758]: exception: Floating IP not found for ID ca5c8cd1-bf65-455d-9ffb-ad08b264e156 Sep 14 08:51:14.871766 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': 'ca5c8cd1-bf65-455d-9ffb-ad08b264e156'} Sep 14 08:51:14.872610 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:51:14.872610 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:51:14.872610 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Sep 14 08:51:14.872610 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Sep 14 08:51:14.872610 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 08:51:14.872610 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 08:51:14.872610 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Sep 14 08:51:14.872610 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Sep 14 08:51:14.872610 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 08:51:14.872610 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 08:51:14.872610 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 14 08:51:14.872610 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 14 08:51:14.872610 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 08:51:14.872610 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 08:51:14.872610 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 14 08:51:14.872610 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 14 08:51:14.872610 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 08:51:14.872610 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 08:51:14.872610 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 14 08:51:14.873711 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 14 08:51:14.873711 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 08:51:14.873711 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 08:51:14.873711 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 14 08:51:14.873711 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 14 08:51:14.873711 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 14 08:51:14.873711 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 14 08:51:14.873711 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP ca5c8cd1-bf65-455d-9ffb-ad08b264e156 could not be found Sep 14 08:51:14.873711 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-860d551f-4855-4d52-b808-bcc2749ccd0c'] Sep 14 08:51:14.873711 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:51:14.873711 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:51:14.873711 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:51:14.873711 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:51:14.873711 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Sep 14 08:51:14.873711 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Sep 14 08:51:14.873711 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Sep 14 08:51:14.873711 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Sep 14 08:51:14.873711 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID ca5c8cd1-bf65-455d-9ffb-ad08b264e156. Sep 14 08:51:14.873711 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:51:14.874815 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:51:14.874815 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:51:14.874815 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:51:14.874815 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:51:14.874815 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:51:14.874815 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:51:14.874815 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:51:14.874815 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 08:51:14.874815 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 08:51:14.874815 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:51:14.874815 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:51:14.874815 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Sep 14 08:51:14.874815 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 14 08:51:14.874815 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID ca5c8cd1-bf65-455d-9ffb-ad08b264e156 Sep 14 08:51:14.874815 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:51:14.874815 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:51:14.874815 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:51:14.874815 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:51:14.874815 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:51:14.874815 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:51:14.874815 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:51:14.876207 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:51:14.876207 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID ca5c8cd1-bf65-455d-9ffb-ad08b264e156 Sep 14 08:51:14.876207 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:51:14.878011 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-73fbeb6d-a610-4686-9f3e-f834e182a256 tempest-FloatingIPDetailsNegativeTestJSON-716078210 tempest-FloatingIPDetailsNegativeTestJSON-716078210-project] Returning 404 to user: Floating IP not found for ID ca5c8cd1-bf65-455d-9ffb-ad08b264e156 {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:51:14.879258 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-73fbeb6d-a610-4686-9f3e-f834e182a256 tempest-FloatingIPDetailsNegativeTestJSON-716078210 tempest-FloatingIPDetailsNegativeTestJSON-716078210-project] 10.222.0.60 "GET /compute/v2.1/os-floating-ips/ca5c8cd1-bf65-455d-9ffb-ad08b264e156" status: 404 len: 111 microversion: 2.1 time: 0.460311 Sep 14 08:51:14.880811 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 341/726] 10.222.0.60 () {58 vars in 1260 bytes} [Wed Sep 14 08:51:14 2022] GET /compute/v2.1/os-floating-ips/ca5c8cd1-bf65-455d-9ffb-ad08b264e156 => generated 111 bytes in 462 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 08:51:14.891443 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-cded86ce-018c-4114-8d6e-8285254a6d20 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:51:14.894678 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-cded86ce-018c-4114-8d6e-8285254a6d20 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: bf59291e-0a19-499b-a95b-a76d82b5e307] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:51:14.911174 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cded86ce-018c-4114-8d6e-8285254a6d20 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:14.911974 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cded86ce-018c-4114-8d6e-8285254a6d20 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:14.917811 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cded86ce-018c-4114-8d6e-8285254a6d20 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:14.918894 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cded86ce-018c-4114-8d6e-8285254a6d20 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:14.920099 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cded86ce-018c-4114-8d6e-8285254a6d20 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:14.921021 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cded86ce-018c-4114-8d6e-8285254a6d20 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:15.510818 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-a6a05cf5-3238-46eb-ad75-96d9c6af5b4e tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:15.529682 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a6a05cf5-3238-46eb-ad75-96d9c6af5b4e tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/874205eb-5321-4a9a-aa38-3cd83b2ac1a3" status: 200 len: 1310 microversion: 2.1 time: 1.001725 Sep 14 08:51:15.530271 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 386/727] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:51:14 2022] GET /compute/v2.1/servers/874205eb-5321-4a9a-aa38-3cd83b2ac1a3 => generated 1310 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:51:15.535487 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-4cb6a507-3536-4b12-a1dd-3d1f9bbaed94 tempest-SecurityGroupRulesNegativeTestJSON-455183585 tempest-SecurityGroupRulesNegativeTestJSON-455183585-project] Action: 'create', calling method: .version_select at 0x7f7d4445b040>, body: {"security_group_rule": {"parent_group_id": "048f6081-2c69-465a-abab-5ae2fd60be11", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:51:15.607261 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-cded86ce-018c-4114-8d6e-8285254a6d20 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:15.621782 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-cded86ce-018c-4114-8d6e-8285254a6d20 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:15.623883 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-cded86ce-018c-4114-8d6e-8285254a6d20 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:15.625422 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-cded86ce-018c-4114-8d6e-8285254a6d20 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/bf59291e-0a19-499b-a95b-a76d82b5e307" status: 200 len: 1362 microversion: 2.25 time: 0.743266 Sep 14 08:51:15.627240 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 342/728] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:51:14 2022] GET /compute/v2.1/servers/bf59291e-0a19-499b-a95b-a76d82b5e307 => generated 1362 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:51:15.633394 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-628477cc-1a13-48e0-9fc9-14f34f551f0c req-18e40136-4883-4420-9279-73bee54f55a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4c51c69-8c2e-4202-9c2f-3dfae93392e9", "name": "network-vif-plugged", "status": "completed", "tag": "158744dd-786d-4346-8779-274378b61a47"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:51:15.659511 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-628477cc-1a13-48e0-9fc9-14f34f551f0c req-18e40136-4883-4420-9279-73bee54f55a3 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:15.660852 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-628477cc-1a13-48e0-9fc9-14f34f551f0c req-18e40136-4883-4420-9279-73bee54f55a3 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:15.661508 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-628477cc-1a13-48e0-9fc9-14f34f551f0c req-18e40136-4883-4420-9279-73bee54f55a3 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:15.683206 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-628477cc-1a13-48e0-9fc9-14f34f551f0c req-18e40136-4883-4420-9279-73bee54f55a3 service nova] Creating event network-vif-plugged:158744dd-786d-4346-8779-274378b61a47 for instance e4c51c69-8c2e-4202-9c2f-3dfae93392e9 on n-h1-836830-18 Sep 14 08:51:15.691762 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [req-628477cc-1a13-48e0-9fc9-14f34f551f0c req-18e40136-4883-4420-9279-73bee54f55a3 service nova] Instance e4c51c69-8c2e-4202-9c2f-3dfae93392e9 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-836830-18', 'n-h2-836830-18'} {{(pid=128758) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 14 08:51:15.705666 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-628477cc-1a13-48e0-9fc9-14f34f551f0c req-18e40136-4883-4420-9279-73bee54f55a3 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076880 Sep 14 08:51:15.706990 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 343/729] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:51:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:51:15.713813 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-835323f0-df10-43d3-804b-04fe44a5ee7f tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:51:15.714908 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-835323f0-df10-43d3-804b-04fe44a5ee7f tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: e4c51c69-8c2e-4202-9c2f-3dfae93392e9] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:51:15.722643 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-835323f0-df10-43d3-804b-04fe44a5ee7f tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:15.723527 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-835323f0-df10-43d3-804b-04fe44a5ee7f tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:15.724211 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-835323f0-df10-43d3-804b-04fe44a5ee7f tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:15.725152 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-835323f0-df10-43d3-804b-04fe44a5ee7f tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:15.725828 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-835323f0-df10-43d3-804b-04fe44a5ee7f tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:15.726500 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-835323f0-df10-43d3-804b-04fe44a5ee7f tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:15.897188 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-4cb6a507-3536-4b12-a1dd-3d1f9bbaed94 tempest-SecurityGroupRulesNegativeTestJSON-455183585 tempest-SecurityGroupRulesNegativeTestJSON-455183585-project] HTTP exception thrown: This rule already exists in group 048f6081-2c69-465a-abab-5ae2fd60be11 Sep 14 08:51:15.902965 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-4cb6a507-3536-4b12-a1dd-3d1f9bbaed94 tempest-SecurityGroupRulesNegativeTestJSON-455183585 tempest-SecurityGroupRulesNegativeTestJSON-455183585-project] Request method failure captured: Sep 14 08:51:15.902965 n-d-836830-18 devstack@n-api.service[128759]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 14 08:51:15.902965 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 08:51:15.902965 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 08:51:15.902965 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 08:51:15.902965 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 138 Sep 14 08:51:15.902965 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 08:51:15.902965 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 08:51:15.902965 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 08:51:15.902965 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 08:51:15.902965 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZX_2uk9BgU5ZQ2oEmzXfPu9DLzwKRqFDvbKoowTS32zuZQLou4eBE4uW6-cZ7Wejp54Xney_cysQaxIMME-EJFZrtYmhJv1QnidDtCBAPgDNUT_XdHbRnJBgbDqYnDXW3mOOM_MWm7SlMehwrHPMQM0Y7AafT3Br4VJZzngqDBvi2I Sep 14 08:51:15.902965 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 08:51:15.902965 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 08:51:15.902965 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 08:51:15.902965 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 08:51:15.902965 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 08:51:15.902965 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 08:51:15.902965 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 3905ac6b31274a1892b2be9492bb64f6 Sep 14 08:51:15.902965 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-455183585 Sep 14 08:51:15.902965 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 08:51:15.902965 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 08:51:15.904386 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/3905ac6b31274a1892b2be9492bb64f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_3905ac6b31274a1892b2be9492bb64f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3905ac6b31274a1892b2be9492bb64f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3905ac6b31274a1892b2be9492bb64f6"}]}] Sep 14 08:51:15.904386 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-455183585 Sep 14 08:51:15.904386 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 3905ac6b31274a1892b2be9492bb64f6 Sep 14 08:51:15.904386 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-455183585 Sep 14 08:51:15.904386 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-455183585-project Sep 14 08:51:15.904386 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 08:51:15.904386 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 08:51:15.904386 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 70324b68330b408ca331761516254690 Sep 14 08:51:15.904386 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-455183585-project Sep 14 08:51:15.904386 n-d-836830-18 devstack@n-api.service[128759]: Sep 14 08:51:15.904386 n-d-836830-18 devstack@n-api.service[128759]: {"security_group_rule": {"parent_group_id": "048f6081-2c69-465a-abab-5ae2fd60be11", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Sep 14 08:51:15.904386 n-d-836830-18 devstack@n-api.service[128759]: method: Sep 14 08:51:15.905210 n-d-836830-18 devstack@n-api.service[128759]: exception: This rule already exists in group 048f6081-2c69-465a-abab-5ae2fd60be11 Sep 14 08:51:15.905210 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'body': {'security_group_rule': {'parent_group_id': '048f6081-2c69-465a-abab-5ae2fd60be11', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Sep 14 08:51:15.905210 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:51:15.905210 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:51:15.905210 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Sep 14 08:51:15.905210 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Sep 14 08:51:15.905210 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Sep 14 08:51:15.905210 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Sep 14 08:51:15.905210 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group 048f6081-2c69-465a-abab-5ae2fd60be11 Sep 14 08:51:15.905210 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:51:15.905210 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:51:15.905210 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:51:15.905210 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:51:15.905210 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:51:15.905210 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:51:15.905210 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:51:15.905210 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:51:15.905210 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 08:51:15.905210 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 08:51:15.905210 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:51:15.906612 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:51:15.906612 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Sep 14 08:51:15.906612 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 14 08:51:15.906612 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group 048f6081-2c69-465a-abab-5ae2fd60be11 Sep 14 08:51:15.906612 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:51:15.906612 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:51:15.906612 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:51:15.906612 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:51:15.906612 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:51:15.906612 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:51:15.906612 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:51:15.906612 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:51:15.906612 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group 048f6081-2c69-465a-abab-5ae2fd60be11 Sep 14 08:51:15.906612 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:51:15.912199 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-4cb6a507-3536-4b12-a1dd-3d1f9bbaed94 tempest-SecurityGroupRulesNegativeTestJSON-455183585 tempest-SecurityGroupRulesNegativeTestJSON-455183585-project] Returning 400 to user: This rule already exists in group 048f6081-2c69-465a-abab-5ae2fd60be11 {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:51:15.913411 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-4cb6a507-3536-4b12-a1dd-3d1f9bbaed94 tempest-SecurityGroupRulesNegativeTestJSON-455183585 tempest-SecurityGroupRulesNegativeTestJSON-455183585-project] 10.222.0.60 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.382052 Sep 14 08:51:15.914676 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 387/730] 10.222.0.60 () {60 vars in 1195 bytes} [Wed Sep 14 08:51:15 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 384 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 14 08:51:15.919768 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b108d290-6d47-4087-b762-c7725c4c6ec6 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:51:15.922660 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b108d290-6d47-4087-b762-c7725c4c6ec6 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] [instance: 3067be21-37ff-4a8f-8ca9-b1421e8be78f] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:51:15.934704 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b108d290-6d47-4087-b762-c7725c4c6ec6 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:15.935614 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b108d290-6d47-4087-b762-c7725c4c6ec6 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:15.936279 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b108d290-6d47-4087-b762-c7725c4c6ec6 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:15.937237 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b108d290-6d47-4087-b762-c7725c4c6ec6 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:15.937953 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b108d290-6d47-4087-b762-c7725c4c6ec6 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:15.940408 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b108d290-6d47-4087-b762-c7725c4c6ec6 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:16.338719 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-835323f0-df10-43d3-804b-04fe44a5ee7f tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:16.358098 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-835323f0-df10-43d3-804b-04fe44a5ee7f tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/e4c51c69-8c2e-4202-9c2f-3dfae93392e9" status: 200 len: 1470 microversion: 2.1 time: 0.649485 Sep 14 08:51:16.362625 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 344/731] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:51:15 2022] GET /compute/v2.1/servers/e4c51c69-8c2e-4202-9c2f-3dfae93392e9 => generated 1470 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:51:16.370103 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-06d9de18-aad3-4446-a405-39cc32935067 tempest-SecurityGroupRulesNegativeTestJSON-455183585 tempest-SecurityGroupRulesNegativeTestJSON-455183585-project] Calling method '.version_select at 0x7f7d44789040>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:51:16.397477 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b108d290-6d47-4087-b762-c7725c4c6ec6 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c7802984cf48d1852832b52abe52e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e326f95a9604fdb9bd075db3837cf62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:16.406213 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b108d290-6d47-4087-b762-c7725c4c6ec6 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] 10.222.0.60 "GET /compute/v2.1/servers/3067be21-37ff-4a8f-8ca9-b1421e8be78f" status: 200 len: 1317 microversion: 2.1 time: 0.490183 Sep 14 08:51:16.407464 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 388/732] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:51:15 2022] GET /compute/v2.1/servers/3067be21-37ff-4a8f-8ca9-b1421e8be78f => generated 1317 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:51:16.553270 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f82e1984-93cb-4822-92c4-020d1508c4ea tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:51:16.554612 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f82e1984-93cb-4822-92c4-020d1508c4ea tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: 874205eb-5321-4a9a-aa38-3cd83b2ac1a3] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:51:16.578350 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f82e1984-93cb-4822-92c4-020d1508c4ea tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:16.579657 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f82e1984-93cb-4822-92c4-020d1508c4ea tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:16.580808 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f82e1984-93cb-4822-92c4-020d1508c4ea tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:16.582274 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f82e1984-93cb-4822-92c4-020d1508c4ea tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:16.583446 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f82e1984-93cb-4822-92c4-020d1508c4ea tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:16.584154 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f82e1984-93cb-4822-92c4-020d1508c4ea tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:16.700463 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=2 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:51:16.762211 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=6 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:51:17.476372 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f82e1984-93cb-4822-92c4-020d1508c4ea tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:17.486240 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f82e1984-93cb-4822-92c4-020d1508c4ea tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/874205eb-5321-4a9a-aa38-3cd83b2ac1a3" status: 200 len: 1310 microversion: 2.1 time: 0.936872 Sep 14 08:51:17.487407 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 389/733] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:51:16 2022] GET /compute/v2.1/servers/874205eb-5321-4a9a-aa38-3cd83b2ac1a3 => generated 1310 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:51:17.496121 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-afe5a58f-7de6-433b-9112-832a37c752f5 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:51:17.497275 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-afe5a58f-7de6-433b-9112-832a37c752f5 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: bf59291e-0a19-499b-a95b-a76d82b5e307] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:51:17.509790 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-afe5a58f-7de6-433b-9112-832a37c752f5 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:17.525017 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-afe5a58f-7de6-433b-9112-832a37c752f5 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:17.525649 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-afe5a58f-7de6-433b-9112-832a37c752f5 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:17.528377 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-afe5a58f-7de6-433b-9112-832a37c752f5 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:17.529919 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-afe5a58f-7de6-433b-9112-832a37c752f5 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:17.533930 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-afe5a58f-7de6-433b-9112-832a37c752f5 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:17.542030 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-06d9de18-aad3-4446-a405-39cc32935067 tempest-SecurityGroupRulesNegativeTestJSON-455183585 tempest-SecurityGroupRulesNegativeTestJSON-455183585-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-group-rules/d0d32d1c-caff-4f8b-a0f8-37fee68ed304" status: 202 len: 0 microversion: 2.1 time: 1.174765 Sep 14 08:51:17.542718 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 345/734] 10.222.0.60 () {58 vars in 1287 bytes} [Wed Sep 14 08:51:16 2022] DELETE /compute/v2.1/os-security-group-rules/d0d32d1c-caff-4f8b-a0f8-37fee68ed304 => generated 0 bytes in 1179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 08:51:17.558549 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-fd293be6-4045-4893-a1eb-7712dc2555a6 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:51:17.561048 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-fd293be6-4045-4893-a1eb-7712dc2555a6 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: e4c51c69-8c2e-4202-9c2f-3dfae93392e9] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:51:17.582101 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fd293be6-4045-4893-a1eb-7712dc2555a6 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:17.582606 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fd293be6-4045-4893-a1eb-7712dc2555a6 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:17.583073 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fd293be6-4045-4893-a1eb-7712dc2555a6 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:17.588780 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fd293be6-4045-4893-a1eb-7712dc2555a6 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:17.589565 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fd293be6-4045-4893-a1eb-7712dc2555a6 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:17.592840 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fd293be6-4045-4893-a1eb-7712dc2555a6 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:18.086121 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-afe5a58f-7de6-433b-9112-832a37c752f5 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:18.092789 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-fd293be6-4045-4893-a1eb-7712dc2555a6 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:18.099656 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-afe5a58f-7de6-433b-9112-832a37c752f5 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:18.101125 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-afe5a58f-7de6-433b-9112-832a37c752f5 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:18.102804 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-afe5a58f-7de6-433b-9112-832a37c752f5 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/bf59291e-0a19-499b-a95b-a76d82b5e307" status: 200 len: 1362 microversion: 2.25 time: 0.613734 Sep 14 08:51:18.103763 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-fd293be6-4045-4893-a1eb-7712dc2555a6 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/e4c51c69-8c2e-4202-9c2f-3dfae93392e9" status: 200 len: 1462 microversion: 2.1 time: 0.550741 Sep 14 08:51:18.105733 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 346/735] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:51:17 2022] GET /compute/v2.1/servers/e4c51c69-8c2e-4202-9c2f-3dfae93392e9 => generated 1462 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:51:18.114061 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 390/736] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:51:17 2022] GET /compute/v2.1/servers/bf59291e-0a19-499b-a95b-a76d82b5e307 => generated 1362 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:51:18.114884 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-0fde9e22-107f-499d-9a83-a68b4f0a123f req-17a4b322-0521-4040-ba63-727f86ffaef3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf59291e-0a19-499b-a95b-a76d82b5e307", "tag": "f8233fbd-017c-41f3-ac0a-d6c9e916d35e"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:51:18.119816 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-1aee8b1e-dd8b-4d00-9a73-7890b6669248 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:51:18.120435 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-1aee8b1e-dd8b-4d00-9a73-7890b6669248 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] [instance: 3067be21-37ff-4a8f-8ca9-b1421e8be78f] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:51:18.132922 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1aee8b1e-dd8b-4d00-9a73-7890b6669248 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:18.133703 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1aee8b1e-dd8b-4d00-9a73-7890b6669248 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:18.134307 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1aee8b1e-dd8b-4d00-9a73-7890b6669248 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:18.135401 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1aee8b1e-dd8b-4d00-9a73-7890b6669248 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:18.136056 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1aee8b1e-dd8b-4d00-9a73-7890b6669248 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:18.136647 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1aee8b1e-dd8b-4d00-9a73-7890b6669248 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:18.140979 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-0fde9e22-107f-499d-9a83-a68b4f0a123f req-17a4b322-0521-4040-ba63-727f86ffaef3 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:18.141469 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-0fde9e22-107f-499d-9a83-a68b4f0a123f req-17a4b322-0521-4040-ba63-727f86ffaef3 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:18.142052 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-0fde9e22-107f-499d-9a83-a68b4f0a123f req-17a4b322-0521-4040-ba63-727f86ffaef3 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:18.163213 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-0fde9e22-107f-499d-9a83-a68b4f0a123f req-17a4b322-0521-4040-ba63-727f86ffaef3 service nova] Creating event network-changed:f8233fbd-017c-41f3-ac0a-d6c9e916d35e for instance bf59291e-0a19-499b-a95b-a76d82b5e307 on n-h1-836830-18 Sep 14 08:51:18.174290 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-0fde9e22-107f-499d-9a83-a68b4f0a123f req-17a4b322-0521-4040-ba63-727f86ffaef3 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065682 Sep 14 08:51:18.177341 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 347/737] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:51:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:51:18.187111 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-85297c7a-4573-49e3-82d5-b2dd4c91a571 tempest-SecurityGroupRulesNegativeTestJSON-455183585 tempest-SecurityGroupRulesNegativeTestJSON-455183585-project] Action: 'create', calling method: .version_select at 0x7f7d44808700>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1285822276", "description": "tempest-description-1244619533"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:51:18.787933 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-1aee8b1e-dd8b-4d00-9a73-7890b6669248 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c7802984cf48d1852832b52abe52e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e326f95a9604fdb9bd075db3837cf62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:18.811550 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-1aee8b1e-dd8b-4d00-9a73-7890b6669248 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] 10.222.0.60 "GET /compute/v2.1/servers/3067be21-37ff-4a8f-8ca9-b1421e8be78f" status: 200 len: 1317 microversion: 2.1 time: 0.695843 Sep 14 08:51:18.814490 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 391/738] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:51:18 2022] GET /compute/v2.1/servers/3067be21-37ff-4a8f-8ca9-b1421e8be78f => generated 1317 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:51:18.818039 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-92de6cd5-785b-4b4b-be3b-83e50d0bd3ca req-42a46b73-e3e3-436c-90fc-bff8ae6f7bac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3067be21-37ff-4a8f-8ca9-b1421e8be78f", "name": "network-vif-plugged", "status": "completed", "tag": "44871f2d-de05-4001-8dcf-b562431aacba"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:51:18.844664 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-92de6cd5-785b-4b4b-be3b-83e50d0bd3ca req-42a46b73-e3e3-436c-90fc-bff8ae6f7bac service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:18.845768 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-92de6cd5-785b-4b4b-be3b-83e50d0bd3ca req-42a46b73-e3e3-436c-90fc-bff8ae6f7bac service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:18.846405 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-92de6cd5-785b-4b4b-be3b-83e50d0bd3ca req-42a46b73-e3e3-436c-90fc-bff8ae6f7bac service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:18.877687 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-92de6cd5-785b-4b4b-be3b-83e50d0bd3ca req-42a46b73-e3e3-436c-90fc-bff8ae6f7bac service nova] Creating event network-vif-plugged:44871f2d-de05-4001-8dcf-b562431aacba for instance 3067be21-37ff-4a8f-8ca9-b1421e8be78f on n-h2-836830-18 Sep 14 08:51:18.884583 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-92de6cd5-785b-4b4b-be3b-83e50d0bd3ca req-42a46b73-e3e3-436c-90fc-bff8ae6f7bac service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070155 Sep 14 08:51:18.886748 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 392/739] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:51:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:51:18.892072 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-69dc735d-cc7c-4c28-b5b6-e351ad441824 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:51:18.892788 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-69dc735d-cc7c-4c28-b5b6-e351ad441824 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: e4c51c69-8c2e-4202-9c2f-3dfae93392e9] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:51:18.906204 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-69dc735d-cc7c-4c28-b5b6-e351ad441824 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:18.906883 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-69dc735d-cc7c-4c28-b5b6-e351ad441824 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:18.907542 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-69dc735d-cc7c-4c28-b5b6-e351ad441824 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:18.908424 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-69dc735d-cc7c-4c28-b5b6-e351ad441824 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:18.909057 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-69dc735d-cc7c-4c28-b5b6-e351ad441824 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:18.909643 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-69dc735d-cc7c-4c28-b5b6-e351ad441824 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:19.000123 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-85297c7a-4573-49e3-82d5-b2dd4c91a571 tempest-SecurityGroupRulesNegativeTestJSON-455183585 tempest-SecurityGroupRulesNegativeTestJSON-455183585-project] 10.222.0.60 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.821439 Sep 14 08:51:19.001783 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 348/740] 10.222.0.60 () {60 vars in 1180 bytes} [Wed Sep 14 08:51:18 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:51:19.007337 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-42ce8a19-0325-424d-a431-99e924b956cb tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:51:19.008831 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-42ce8a19-0325-424d-a431-99e924b956cb tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: 874205eb-5321-4a9a-aa38-3cd83b2ac1a3] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:51:19.011576 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=3 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:51:19.035875 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-42ce8a19-0325-424d-a431-99e924b956cb tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:19.038380 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-42ce8a19-0325-424d-a431-99e924b956cb tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:19.039066 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-42ce8a19-0325-424d-a431-99e924b956cb tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:19.040616 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-42ce8a19-0325-424d-a431-99e924b956cb tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:19.041250 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-42ce8a19-0325-424d-a431-99e924b956cb tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:19.041897 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-42ce8a19-0325-424d-a431-99e924b956cb tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:19.331180 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-69dc735d-cc7c-4c28-b5b6-e351ad441824 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:19.342976 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-69dc735d-cc7c-4c28-b5b6-e351ad441824 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/e4c51c69-8c2e-4202-9c2f-3dfae93392e9" status: 200 len: 1462 microversion: 2.1 time: 0.454943 Sep 14 08:51:19.358168 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 393/741] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:51:18 2022] GET /compute/v2.1/servers/e4c51c69-8c2e-4202-9c2f-3dfae93392e9 => generated 1462 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:51:19.363180 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-b9e69ffc-c6bd-4dc0-b252-0a0dd4a370ef req-9073dfdf-d91f-4d93-aa0a-181148aa1bdf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "874205eb-5321-4a9a-aa38-3cd83b2ac1a3", "tag": "629e6ee9-90f6-4562-b850-5f55a39582b9"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:51:19.378000 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-b9e69ffc-c6bd-4dc0-b252-0a0dd4a370ef req-9073dfdf-d91f-4d93-aa0a-181148aa1bdf service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:19.378535 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-b9e69ffc-c6bd-4dc0-b252-0a0dd4a370ef req-9073dfdf-d91f-4d93-aa0a-181148aa1bdf service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:19.379136 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-b9e69ffc-c6bd-4dc0-b252-0a0dd4a370ef req-9073dfdf-d91f-4d93-aa0a-181148aa1bdf service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:19.390413 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-b9e69ffc-c6bd-4dc0-b252-0a0dd4a370ef req-9073dfdf-d91f-4d93-aa0a-181148aa1bdf service nova] Creating event network-changed:629e6ee9-90f6-4562-b850-5f55a39582b9 for instance 874205eb-5321-4a9a-aa38-3cd83b2ac1a3 on n-h1-836830-18 Sep 14 08:51:19.395549 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-b9e69ffc-c6bd-4dc0-b252-0a0dd4a370ef req-9073dfdf-d91f-4d93-aa0a-181148aa1bdf service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036002 Sep 14 08:51:19.396310 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 394/742] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:51:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:51:19.402020 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-5b223c64-3978-4839-a967-9ae610b24dc6 tempest-SecurityGroupRulesNegativeTestJSON-455183585 tempest-SecurityGroupRulesNegativeTestJSON-455183585-project] Action: 'create', calling method: .version_select at 0x7f7d443cbf70>, body: {"security_group_rule": {"parent_group_id": "023d29ae-1258-4c8d-8de6-e4304072293b", "ip_protocol": "tcp", "from_port": 146690547, "to_port": 22}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:51:19.537839 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-5b223c64-3978-4839-a967-9ae610b24dc6 tempest-SecurityGroupRulesNegativeTestJSON-455183585 tempest-SecurityGroupRulesNegativeTestJSON-455183585-project] HTTP exception thrown: Invalid port range 146690547:22. Former value cannot be greater than the later Sep 14 08:51:19.544752 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-5b223c64-3978-4839-a967-9ae610b24dc6 tempest-SecurityGroupRulesNegativeTestJSON-455183585 tempest-SecurityGroupRulesNegativeTestJSON-455183585-project] Request method failure captured: Sep 14 08:51:19.544752 n-d-836830-18 devstack@n-api.service[128759]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 14 08:51:19.544752 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 08:51:19.544752 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 08:51:19.544752 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 08:51:19.544752 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 145 Sep 14 08:51:19.544752 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 08:51:19.544752 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 08:51:19.544752 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 08:51:19.544752 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 08:51:19.544752 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZX_2uk9BgU5ZQ2oEmzXfPu9DLzwKRqFDvbKoowTS32zuZQLou4eBE4uW6-cZ7Wejp54Xney_cysQaxIMME-EJFZrtYmhJv1QnidDtCBAPgDNUT_XdHbRnJBgbDqYnDXW3mOOM_MWm7SlMehwrHPMQM0Y7AafT3Br4VJZzngqDBvi2I Sep 14 08:51:19.544752 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 08:51:19.544752 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 08:51:19.544752 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 08:51:19.544752 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 08:51:19.544752 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 08:51:19.544752 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 08:51:19.544752 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 3905ac6b31274a1892b2be9492bb64f6 Sep 14 08:51:19.544752 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-455183585 Sep 14 08:51:19.544752 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 08:51:19.544752 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 08:51:19.546525 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/3905ac6b31274a1892b2be9492bb64f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_3905ac6b31274a1892b2be9492bb64f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3905ac6b31274a1892b2be9492bb64f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3905ac6b31274a1892b2be9492bb64f6"}]}] Sep 14 08:51:19.546525 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-455183585 Sep 14 08:51:19.546525 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 3905ac6b31274a1892b2be9492bb64f6 Sep 14 08:51:19.546525 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-455183585 Sep 14 08:51:19.546525 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-455183585-project Sep 14 08:51:19.546525 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 08:51:19.546525 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 08:51:19.546525 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 70324b68330b408ca331761516254690 Sep 14 08:51:19.546525 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-455183585-project Sep 14 08:51:19.546525 n-d-836830-18 devstack@n-api.service[128759]: Sep 14 08:51:19.546525 n-d-836830-18 devstack@n-api.service[128759]: {"security_group_rule": {"parent_group_id": "023d29ae-1258-4c8d-8de6-e4304072293b", "ip_protocol": "tcp", "from_port": 146690547, "to_port": 22}} Sep 14 08:51:19.546525 n-d-836830-18 devstack@n-api.service[128759]: method: Sep 14 08:51:19.547387 n-d-836830-18 devstack@n-api.service[128759]: exception: Invalid port range 146690547:22. Former value cannot be greater than the later Sep 14 08:51:19.547387 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'body': {'security_group_rule': {'parent_group_id': '023d29ae-1258-4c8d-8de6-e4304072293b', 'ip_protocol': 'tcp', 'from_port': 146690547, 'to_port': 22}}} Sep 14 08:51:19.547387 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:51:19.547387 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:51:19.547387 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Sep 14 08:51:19.547387 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Sep 14 08:51:19.547387 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Sep 14 08:51:19.547387 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Sep 14 08:51:19.547387 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Sep 14 08:51:19.547387 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Sep 14 08:51:19.547387 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Sep 14 08:51:19.547387 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Sep 14 08:51:19.547387 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 146690547:22. Former value cannot be greater than the later Sep 14 08:51:19.547387 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:51:19.547387 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:51:19.547387 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:51:19.547387 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:51:19.547387 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:51:19.547387 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:51:19.548731 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:51:19.548731 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:51:19.548731 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 08:51:19.548731 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 08:51:19.548731 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:51:19.548731 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:51:19.548731 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Sep 14 08:51:19.548731 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 14 08:51:19.548731 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 146690547:22. Former value cannot be greater than the later Sep 14 08:51:19.548731 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:51:19.548731 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:51:19.548731 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:51:19.548731 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:51:19.548731 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:51:19.548731 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:51:19.548731 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:51:19.548731 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:51:19.548731 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 146690547:22. Former value cannot be greater than the later Sep 14 08:51:19.548731 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:51:19.549882 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-5b223c64-3978-4839-a967-9ae610b24dc6 tempest-SecurityGroupRulesNegativeTestJSON-455183585 tempest-SecurityGroupRulesNegativeTestJSON-455183585-project] Returning 400 to user: Invalid port range 146690547:22. Former value cannot be greater than the later {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:51:19.549882 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-5b223c64-3978-4839-a967-9ae610b24dc6 tempest-SecurityGroupRulesNegativeTestJSON-455183585 tempest-SecurityGroupRulesNegativeTestJSON-455183585-project] 10.222.0.60 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 122 microversion: 2.1 time: 0.149951 Sep 14 08:51:19.552054 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-42ce8a19-0325-424d-a431-99e924b956cb tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:19.552991 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 395/743] 10.222.0.60 () {60 vars in 1195 bytes} [Wed Sep 14 08:51:19 2022] POST /compute/v2.1/os-security-group-rules => generated 122 bytes in 156 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 14 08:51:19.564759 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ca34e245-fa99-4b97-b54d-59647dab9ff9 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:51:19.565495 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-ca34e245-fa99-4b97-b54d-59647dab9ff9 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: bf59291e-0a19-499b-a95b-a76d82b5e307] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:51:19.573589 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ca34e245-fa99-4b97-b54d-59647dab9ff9 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:19.574338 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ca34e245-fa99-4b97-b54d-59647dab9ff9 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:19.575590 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ca34e245-fa99-4b97-b54d-59647dab9ff9 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:19.575968 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-42ce8a19-0325-424d-a431-99e924b956cb tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/874205eb-5321-4a9a-aa38-3cd83b2ac1a3" status: 200 len: 1310 microversion: 2.1 time: 0.572937 Sep 14 08:51:19.576850 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ca34e245-fa99-4b97-b54d-59647dab9ff9 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:19.577312 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ca34e245-fa99-4b97-b54d-59647dab9ff9 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:19.577742 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ca34e245-fa99-4b97-b54d-59647dab9ff9 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:19.591072 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 349/744] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:51:19 2022] GET /compute/v2.1/servers/874205eb-5321-4a9a-aa38-3cd83b2ac1a3 => generated 1310 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:51:19.598565 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-5c3ab3fb-50f8-4fbe-8a0b-6af44751e9d9 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Action: 'create', calling method: .version_select at 0x7f7d44808700>, body: {"keypair": {"name": "tempest-keypair-111523344", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNbJ5FMRsrrAUPDUtJ5xawt+Mvk847Q6q0AipxonaVSWVR2nbvViYonc+8l3U1ibPDtLPbYlgINHTHqCJBAXrUZh7AQ9BwBb99gsVxFzOX24Xjxs8pVXsePofndgFHHJgw=="}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:51:19.617520 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-5c3ab3fb-50f8-4fbe-8a0b-6af44751e9d9 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Getting quotas for project 8fd62edd611c4390be2403972b99aa15. Resources: {'key_pairs'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 08:51:19.622931 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-5c3ab3fb-50f8-4fbe-8a0b-6af44751e9d9 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Getting quotas for user 264fb30236d54248ad0ecf79a177849f and project 8fd62edd611c4390be2403972b99aa15. Resources: {'key_pairs'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 08:51:19.653475 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-5c3ab3fb-50f8-4fbe-8a0b-6af44751e9d9 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.060155 Sep 14 08:51:19.654079 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 350/745] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Sep 14 08:51:19 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:51:19.660981 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-e40ebc6e-7452-442d-8f37-7a8d81064f4c tempest-SecurityGroupRulesNegativeTestJSON-455183585 tempest-SecurityGroupRulesNegativeTestJSON-455183585-project] Action: 'create', calling method: .version_select at 0x7f7d44957310>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1579151462", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:51:19.663538 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-e40ebc6e-7452-442d-8f37-7a8d81064f4c tempest-SecurityGroupRulesNegativeTestJSON-455183585 tempest-SecurityGroupRulesNegativeTestJSON-455183585-project] HTTP exception thrown: Security group id should be uuid Sep 14 08:51:19.666506 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-e40ebc6e-7452-442d-8f37-7a8d81064f4c tempest-SecurityGroupRulesNegativeTestJSON-455183585 tempest-SecurityGroupRulesNegativeTestJSON-455183585-project] Request method failure captured: Sep 14 08:51:19.666506 n-d-836830-18 devstack@n-api.service[128758]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 14 08:51:19.666506 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 08:51:19.666506 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 08:51:19.666506 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 08:51:19.666506 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 131 Sep 14 08:51:19.666506 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 08:51:19.666506 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 08:51:19.666506 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 08:51:19.666506 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 08:51:19.666506 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZX_2uk9BgU5ZQ2oEmzXfPu9DLzwKRqFDvbKoowTS32zuZQLou4eBE4uW6-cZ7Wejp54Xney_cysQaxIMME-EJFZrtYmhJv1QnidDtCBAPgDNUT_XdHbRnJBgbDqYnDXW3mOOM_MWm7SlMehwrHPMQM0Y7AafT3Br4VJZzngqDBvi2I Sep 14 08:51:19.666506 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 08:51:19.666506 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 08:51:19.666506 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 08:51:19.666506 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 08:51:19.666506 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 08:51:19.666506 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 08:51:19.666506 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 3905ac6b31274a1892b2be9492bb64f6 Sep 14 08:51:19.666506 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-455183585 Sep 14 08:51:19.666506 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 08:51:19.666506 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 08:51:19.668153 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/3905ac6b31274a1892b2be9492bb64f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_3905ac6b31274a1892b2be9492bb64f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3905ac6b31274a1892b2be9492bb64f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3905ac6b31274a1892b2be9492bb64f6"}]}] Sep 14 08:51:19.668153 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-455183585 Sep 14 08:51:19.668153 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 3905ac6b31274a1892b2be9492bb64f6 Sep 14 08:51:19.668153 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-455183585 Sep 14 08:51:19.668153 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-455183585-project Sep 14 08:51:19.668153 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 08:51:19.668153 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 08:51:19.668153 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 70324b68330b408ca331761516254690 Sep 14 08:51:19.668153 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-455183585-project Sep 14 08:51:19.668153 n-d-836830-18 devstack@n-api.service[128758]: Sep 14 08:51:19.668153 n-d-836830-18 devstack@n-api.service[128758]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1579151462", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Sep 14 08:51:19.668153 n-d-836830-18 devstack@n-api.service[128758]: method: Sep 14 08:51:19.668153 n-d-836830-18 devstack@n-api.service[128758]: exception: Security group id should be uuid Sep 14 08:51:19.669139 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-1579151462', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Sep 14 08:51:19.669139 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:51:19.669139 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:51:19.669139 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Sep 14 08:51:19.669139 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Sep 14 08:51:19.669139 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Sep 14 08:51:19.669139 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Sep 14 08:51:19.669139 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Sep 14 08:51:19.669139 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:51:19.669139 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:51:19.669139 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:51:19.669139 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:51:19.669139 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:51:19.669139 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:51:19.669139 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:51:19.669139 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:51:19.669139 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 08:51:19.669139 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 08:51:19.669139 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:51:19.669139 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:51:19.670607 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Sep 14 08:51:19.670607 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 14 08:51:19.670607 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Sep 14 08:51:19.670607 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:51:19.670607 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:51:19.670607 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:51:19.670607 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:51:19.670607 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:51:19.670607 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:51:19.670607 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:51:19.670607 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:51:19.670607 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Sep 14 08:51:19.670607 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:51:19.673220 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-e40ebc6e-7452-442d-8f37-7a8d81064f4c tempest-SecurityGroupRulesNegativeTestJSON-455183585 tempest-SecurityGroupRulesNegativeTestJSON-455183585-project] Returning 400 to user: Security group id should be uuid {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:51:19.674063 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-e40ebc6e-7452-442d-8f37-7a8d81064f4c tempest-SecurityGroupRulesNegativeTestJSON-455183585 tempest-SecurityGroupRulesNegativeTestJSON-455183585-project] 10.222.0.60 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.018734 Sep 14 08:51:19.674763 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 351/746] 10.222.0.60 () {60 vars in 1195 bytes} [Wed Sep 14 08:51:19 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 14 08:51:19.685450 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-3b15d1d9-158e-4f17-b9e9-0cdae601a0dd tempest-SecurityGroupRulesNegativeTestJSON-455183585 tempest-SecurityGroupRulesNegativeTestJSON-455183585-project] Action: 'create', calling method: .version_select at 0x7f7d44957790>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-391689737", "description": "tempest-description-1983777213"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:51:19.806644 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-ca34e245-fa99-4b97-b54d-59647dab9ff9 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:19.818200 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-ca34e245-fa99-4b97-b54d-59647dab9ff9 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:19.819835 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-ca34e245-fa99-4b97-b54d-59647dab9ff9 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:19.822023 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-ca34e245-fa99-4b97-b54d-59647dab9ff9 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/bf59291e-0a19-499b-a95b-a76d82b5e307" status: 200 len: 1362 microversion: 2.25 time: 0.261583 Sep 14 08:51:19.822781 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 396/747] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:51:19 2022] GET /compute/v2.1/servers/bf59291e-0a19-499b-a95b-a76d82b5e307 => generated 1362 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:51:19.843664 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-66e519f0-291e-4721-8280-68f9cd18e417 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:51:19.844233 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-66e519f0-291e-4721-8280-68f9cd18e417 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] [instance: 3067be21-37ff-4a8f-8ca9-b1421e8be78f] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:51:19.851270 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-66e519f0-291e-4721-8280-68f9cd18e417 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:19.851787 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-66e519f0-291e-4721-8280-68f9cd18e417 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:19.852423 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-66e519f0-291e-4721-8280-68f9cd18e417 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:19.853296 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-66e519f0-291e-4721-8280-68f9cd18e417 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:19.853937 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-66e519f0-291e-4721-8280-68f9cd18e417 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:19.854399 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-66e519f0-291e-4721-8280-68f9cd18e417 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:20.177771 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-66e519f0-291e-4721-8280-68f9cd18e417 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c7802984cf48d1852832b52abe52e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e326f95a9604fdb9bd075db3837cf62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:20.194504 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-66e519f0-291e-4721-8280-68f9cd18e417 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] 10.222.0.60 "GET /compute/v2.1/servers/3067be21-37ff-4a8f-8ca9-b1421e8be78f" status: 200 len: 1317 microversion: 2.1 time: 0.356531 Sep 14 08:51:20.210594 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 397/748] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:51:19 2022] GET /compute/v2.1/servers/3067be21-37ff-4a8f-8ca9-b1421e8be78f => generated 1317 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:51:20.295284 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=2 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:51:20.391303 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-3b15d1d9-158e-4f17-b9e9-0cdae601a0dd tempest-SecurityGroupRulesNegativeTestJSON-455183585 tempest-SecurityGroupRulesNegativeTestJSON-455183585-project] 10.222.0.60 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.710635 Sep 14 08:51:20.392775 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 352/749] 10.222.0.60 () {60 vars in 1180 bytes} [Wed Sep 14 08:51:19 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:51:20.406729 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b11473d4-bd1e-4862-9537-99683568e88c tempest-SecurityGroupRulesNegativeTestJSON-455183585 tempest-SecurityGroupRulesNegativeTestJSON-455183585-project] Action: 'create', calling method: .version_select at 0x7f7d445824c0>, body: {"security_group_rule": {"parent_group_id": "2fc6bbf8-62ee-456d-a020-a03a5a7f1024", "ip_protocol": "tempest-999-557497958", "from_port": 22, "to_port": 22}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:51:20.515291 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-b11473d4-bd1e-4862-9537-99683568e88c tempest-SecurityGroupRulesNegativeTestJSON-455183585 tempest-SecurityGroupRulesNegativeTestJSON-455183585-project] HTTP exception thrown: Invalid IP protocol tempest-999-557497958. Sep 14 08:51:20.517409 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b11473d4-bd1e-4862-9537-99683568e88c tempest-SecurityGroupRulesNegativeTestJSON-455183585 tempest-SecurityGroupRulesNegativeTestJSON-455183585-project] Request method failure captured: Sep 14 08:51:20.517409 n-d-836830-18 devstack@n-api.service[128759]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 14 08:51:20.517409 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 08:51:20.517409 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 08:51:20.517409 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 08:51:20.517409 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 156 Sep 14 08:51:20.517409 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 08:51:20.517409 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 08:51:20.517409 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 08:51:20.517409 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 08:51:20.517409 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZX_2uk9BgU5ZQ2oEmzXfPu9DLzwKRqFDvbKoowTS32zuZQLou4eBE4uW6-cZ7Wejp54Xney_cysQaxIMME-EJFZrtYmhJv1QnidDtCBAPgDNUT_XdHbRnJBgbDqYnDXW3mOOM_MWm7SlMehwrHPMQM0Y7AafT3Br4VJZzngqDBvi2I Sep 14 08:51:20.517409 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 08:51:20.517409 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 08:51:20.517409 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 08:51:20.517409 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 08:51:20.517409 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 08:51:20.517409 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 08:51:20.517409 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 3905ac6b31274a1892b2be9492bb64f6 Sep 14 08:51:20.517409 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-455183585 Sep 14 08:51:20.517409 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 08:51:20.517409 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 08:51:20.518710 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/3905ac6b31274a1892b2be9492bb64f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_3905ac6b31274a1892b2be9492bb64f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3905ac6b31274a1892b2be9492bb64f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3905ac6b31274a1892b2be9492bb64f6"}]}] Sep 14 08:51:20.518710 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-455183585 Sep 14 08:51:20.518710 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 3905ac6b31274a1892b2be9492bb64f6 Sep 14 08:51:20.518710 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-455183585 Sep 14 08:51:20.518710 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-455183585-project Sep 14 08:51:20.518710 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 08:51:20.518710 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 08:51:20.518710 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 70324b68330b408ca331761516254690 Sep 14 08:51:20.518710 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-455183585-project Sep 14 08:51:20.518710 n-d-836830-18 devstack@n-api.service[128759]: Sep 14 08:51:20.518710 n-d-836830-18 devstack@n-api.service[128759]: {"security_group_rule": {"parent_group_id": "2fc6bbf8-62ee-456d-a020-a03a5a7f1024", "ip_protocol": "tempest-999-557497958", "from_port": 22, "to_port": 22}} Sep 14 08:51:20.518710 n-d-836830-18 devstack@n-api.service[128759]: method: Sep 14 08:51:20.519484 n-d-836830-18 devstack@n-api.service[128759]: exception: Invalid IP protocol tempest-999-557497958. Sep 14 08:51:20.519484 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'body': {'security_group_rule': {'parent_group_id': '2fc6bbf8-62ee-456d-a020-a03a5a7f1024', 'ip_protocol': 'tempest-999-557497958', 'from_port': 22, 'to_port': 22}}} Sep 14 08:51:20.519484 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:51:20.519484 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:51:20.519484 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Sep 14 08:51:20.519484 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Sep 14 08:51:20.519484 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Sep 14 08:51:20.519484 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Sep 14 08:51:20.519484 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Sep 14 08:51:20.519484 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Sep 14 08:51:20.519484 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Sep 14 08:51:20.519484 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Sep 14 08:51:20.519484 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-557497958. Sep 14 08:51:20.519484 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:51:20.519484 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:51:20.519484 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:51:20.519484 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:51:20.519484 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:51:20.519484 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:51:20.520923 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:51:20.520923 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:51:20.520923 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 08:51:20.520923 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 08:51:20.520923 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:51:20.520923 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:51:20.520923 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Sep 14 08:51:20.520923 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 14 08:51:20.520923 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-557497958. Sep 14 08:51:20.520923 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:51:20.520923 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:51:20.520923 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:51:20.520923 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:51:20.520923 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:51:20.520923 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:51:20.520923 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:51:20.520923 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:51:20.520923 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-557497958. Sep 14 08:51:20.520923 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:51:20.522491 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b11473d4-bd1e-4862-9537-99683568e88c tempest-SecurityGroupRulesNegativeTestJSON-455183585 tempest-SecurityGroupRulesNegativeTestJSON-455183585-project] Returning 400 to user: Invalid IP protocol tempest-999-557497958. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:51:20.522491 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b11473d4-bd1e-4862-9537-99683568e88c tempest-SecurityGroupRulesNegativeTestJSON-455183585 tempest-SecurityGroupRulesNegativeTestJSON-455183585-project] 10.222.0.60 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 86 microversion: 2.1 time: 0.116419 Sep 14 08:51:20.524595 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 398/750] 10.222.0.60 () {60 vars in 1195 bytes} [Wed Sep 14 08:51:20 2022] POST /compute/v2.1/os-security-group-rules => generated 86 bytes in 124 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 14 08:51:20.530950 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-3e827022-17f6-4336-8943-a4df8ef2dcf4 tempest-SecurityGroupRulesNegativeTestJSON-455183585 tempest-SecurityGroupRulesNegativeTestJSON-455183585-project] Action: 'create', calling method: .version_select at 0x7f7d4490e280>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-469090281", "description": "tempest-description-122813231"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:51:20.602766 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f9ee4220-f5e5-40ac-afbc-2035e12d9c44 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:51:20.604338 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f9ee4220-f5e5-40ac-afbc-2035e12d9c44 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: 874205eb-5321-4a9a-aa38-3cd83b2ac1a3] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:51:20.627449 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f9ee4220-f5e5-40ac-afbc-2035e12d9c44 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:20.631275 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f9ee4220-f5e5-40ac-afbc-2035e12d9c44 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:20.632729 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f9ee4220-f5e5-40ac-afbc-2035e12d9c44 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:20.654777 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f9ee4220-f5e5-40ac-afbc-2035e12d9c44 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:20.662395 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f9ee4220-f5e5-40ac-afbc-2035e12d9c44 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:20.662880 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f9ee4220-f5e5-40ac-afbc-2035e12d9c44 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:21.059759 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-3e827022-17f6-4336-8943-a4df8ef2dcf4 tempest-SecurityGroupRulesNegativeTestJSON-455183585 tempest-SecurityGroupRulesNegativeTestJSON-455183585-project] 10.222.0.60 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.533582 Sep 14 08:51:21.060575 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 353/751] 10.222.0.60 () {60 vars in 1180 bytes} [Wed Sep 14 08:51:20 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:51:21.074211 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-74e41a4a-b7db-4731-8ef8-eaf63efd1250 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:51:21.075317 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-74e41a4a-b7db-4731-8ef8-eaf63efd1250 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: bf59291e-0a19-499b-a95b-a76d82b5e307] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:51:21.082229 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-74e41a4a-b7db-4731-8ef8-eaf63efd1250 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:21.083040 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-74e41a4a-b7db-4731-8ef8-eaf63efd1250 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:21.083701 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-74e41a4a-b7db-4731-8ef8-eaf63efd1250 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:21.084823 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-74e41a4a-b7db-4731-8ef8-eaf63efd1250 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:21.087389 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-74e41a4a-b7db-4731-8ef8-eaf63efd1250 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:21.088069 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-74e41a4a-b7db-4731-8ef8-eaf63efd1250 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:21.093675 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=100 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:51:21.134487 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f9ee4220-f5e5-40ac-afbc-2035e12d9c44 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:21.147135 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f9ee4220-f5e5-40ac-afbc-2035e12d9c44 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/874205eb-5321-4a9a-aa38-3cd83b2ac1a3" status: 200 len: 1310 microversion: 2.1 time: 0.549752 Sep 14 08:51:21.167127 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 399/752] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:51:20 2022] GET /compute/v2.1/servers/874205eb-5321-4a9a-aa38-3cd83b2ac1a3 => generated 1310 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:51:21.195866 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3023e397-7df6-4e2a-93c4-8922b92ff781 tempest-SecurityGroupRulesNegativeTestJSON-455183585 tempest-SecurityGroupRulesNegativeTestJSON-455183585-project] Action: 'create', calling method: .version_select at 0x7f7d4456a0d0>, body: {"security_group_rule": {"parent_group_id": "b43028a9-d89d-42b5-9791-298c358f675c", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:51:21.392416 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-3023e397-7df6-4e2a-93c4-8922b92ff781 tempest-SecurityGroupRulesNegativeTestJSON-455183585 tempest-SecurityGroupRulesNegativeTestJSON-455183585-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Sep 14 08:51:21.396507 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3023e397-7df6-4e2a-93c4-8922b92ff781 tempest-SecurityGroupRulesNegativeTestJSON-455183585 tempest-SecurityGroupRulesNegativeTestJSON-455183585-project] Request method failure captured: Sep 14 08:51:21.396507 n-d-836830-18 devstack@n-api.service[128759]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 14 08:51:21.396507 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 08:51:21.396507 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 08:51:21.396507 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 08:51:21.396507 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 138 Sep 14 08:51:21.396507 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 08:51:21.396507 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 08:51:21.396507 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 08:51:21.396507 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 08:51:21.396507 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZX_2uk9BgU5ZQ2oEmzXfPu9DLzwKRqFDvbKoowTS32zuZQLou4eBE4uW6-cZ7Wejp54Xney_cysQaxIMME-EJFZrtYmhJv1QnidDtCBAPgDNUT_XdHbRnJBgbDqYnDXW3mOOM_MWm7SlMehwrHPMQM0Y7AafT3Br4VJZzngqDBvi2I Sep 14 08:51:21.396507 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 08:51:21.396507 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 08:51:21.396507 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 08:51:21.396507 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 08:51:21.396507 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 08:51:21.396507 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 08:51:21.396507 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 3905ac6b31274a1892b2be9492bb64f6 Sep 14 08:51:21.396507 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-455183585 Sep 14 08:51:21.396507 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 08:51:21.396507 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 08:51:21.397823 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/3905ac6b31274a1892b2be9492bb64f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_3905ac6b31274a1892b2be9492bb64f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3905ac6b31274a1892b2be9492bb64f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3905ac6b31274a1892b2be9492bb64f6"}]}] Sep 14 08:51:21.397823 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-455183585 Sep 14 08:51:21.397823 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 3905ac6b31274a1892b2be9492bb64f6 Sep 14 08:51:21.397823 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-455183585 Sep 14 08:51:21.397823 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-455183585-project Sep 14 08:51:21.397823 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 08:51:21.397823 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 08:51:21.397823 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 70324b68330b408ca331761516254690 Sep 14 08:51:21.397823 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-455183585-project Sep 14 08:51:21.397823 n-d-836830-18 devstack@n-api.service[128759]: Sep 14 08:51:21.397823 n-d-836830-18 devstack@n-api.service[128759]: {"security_group_rule": {"parent_group_id": "b43028a9-d89d-42b5-9791-298c358f675c", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Sep 14 08:51:21.397823 n-d-836830-18 devstack@n-api.service[128759]: method: Sep 14 08:51:21.398673 n-d-836830-18 devstack@n-api.service[128759]: exception: Invalid port range 22:21. Former value cannot be greater than the later Sep 14 08:51:21.398673 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'b43028a9-d89d-42b5-9791-298c358f675c', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Sep 14 08:51:21.398673 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:51:21.398673 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:51:21.398673 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Sep 14 08:51:21.398673 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Sep 14 08:51:21.398673 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Sep 14 08:51:21.398673 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Sep 14 08:51:21.398673 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Sep 14 08:51:21.398673 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Sep 14 08:51:21.398673 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Sep 14 08:51:21.398673 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Sep 14 08:51:21.398673 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Sep 14 08:51:21.398673 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:51:21.398673 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:51:21.398673 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:51:21.398673 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:51:21.398673 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:51:21.398673 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:51:21.400867 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:51:21.400867 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:51:21.400867 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 08:51:21.400867 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 08:51:21.400867 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:51:21.400867 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:51:21.400867 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Sep 14 08:51:21.400867 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 14 08:51:21.400867 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Sep 14 08:51:21.400867 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:51:21.400867 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:51:21.400867 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:51:21.400867 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:51:21.400867 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:51:21.400867 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:51:21.400867 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:51:21.400867 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:51:21.400867 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Sep 14 08:51:21.400867 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:51:21.403993 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3023e397-7df6-4e2a-93c4-8922b92ff781 tempest-SecurityGroupRulesNegativeTestJSON-455183585 tempest-SecurityGroupRulesNegativeTestJSON-455183585-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:51:21.405077 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-3023e397-7df6-4e2a-93c4-8922b92ff781 tempest-SecurityGroupRulesNegativeTestJSON-455183585 tempest-SecurityGroupRulesNegativeTestJSON-455183585-project] 10.222.0.60 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.236677 Sep 14 08:51:21.407603 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 400/753] 10.222.0.60 () {60 vars in 1195 bytes} [Wed Sep 14 08:51:21 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 240 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 14 08:51:21.414662 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d26920d7-48df-4a8f-a1b8-a592e3555ead tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:51:21.416163 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-d26920d7-48df-4a8f-a1b8-a592e3555ead tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] [instance: 3067be21-37ff-4a8f-8ca9-b1421e8be78f] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:51:21.429395 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d26920d7-48df-4a8f-a1b8-a592e3555ead tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:21.435446 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d26920d7-48df-4a8f-a1b8-a592e3555ead tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:21.438272 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d26920d7-48df-4a8f-a1b8-a592e3555ead tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:21.443605 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d26920d7-48df-4a8f-a1b8-a592e3555ead tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:21.445351 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d26920d7-48df-4a8f-a1b8-a592e3555ead tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:21.446528 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d26920d7-48df-4a8f-a1b8-a592e3555ead tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:21.460660 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-74e41a4a-b7db-4731-8ef8-eaf63efd1250 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:21.477300 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-74e41a4a-b7db-4731-8ef8-eaf63efd1250 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:21.479358 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-74e41a4a-b7db-4731-8ef8-eaf63efd1250 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:21.485056 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-74e41a4a-b7db-4731-8ef8-eaf63efd1250 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/bf59291e-0a19-499b-a95b-a76d82b5e307" status: 200 len: 1362 microversion: 2.25 time: 0.419261 Sep 14 08:51:21.505614 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 354/754] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:51:21 2022] GET /compute/v2.1/servers/bf59291e-0a19-499b-a95b-a76d82b5e307 => generated 1362 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:51:21.514119 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-6d277a5c-2b66-4e4a-b381-a3edfca50f31 tempest-SecurityGroupRulesNegativeTestJSON-455183585 tempest-SecurityGroupRulesNegativeTestJSON-455183585-project] Action: 'create', calling method: .version_select at 0x7f7d4490e1f0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-837900226", "description": "tempest-description-448138427"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:51:21.898738 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-d26920d7-48df-4a8f-a1b8-a592e3555ead tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c7802984cf48d1852832b52abe52e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e326f95a9604fdb9bd075db3837cf62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:21.911741 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d26920d7-48df-4a8f-a1b8-a592e3555ead tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] 10.222.0.60 "GET /compute/v2.1/servers/3067be21-37ff-4a8f-8ca9-b1421e8be78f" status: 200 len: 1466 microversion: 2.1 time: 0.502293 Sep 14 08:51:21.915926 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 401/755] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:51:21 2022] GET /compute/v2.1/servers/3067be21-37ff-4a8f-8ca9-b1421e8be78f => generated 1466 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:51:21.940449 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8d29d224-ef4e-4161-ad05-e6da353827c6 tempest-ServersOnMultiNodesTest-1008135845 tempest-ServersOnMultiNodesTest-1008135845-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:51:21.947997 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-8d29d224-ef4e-4161-ad05-e6da353827c6 tempest-ServersOnMultiNodesTest-1008135845 tempest-ServersOnMultiNodesTest-1008135845-project-admin] [instance: 3067be21-37ff-4a8f-8ca9-b1421e8be78f] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:51:21.961000 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8d29d224-ef4e-4161-ad05-e6da353827c6 tempest-ServersOnMultiNodesTest-1008135845 tempest-ServersOnMultiNodesTest-1008135845-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:21.961692 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8d29d224-ef4e-4161-ad05-e6da353827c6 tempest-ServersOnMultiNodesTest-1008135845 tempest-ServersOnMultiNodesTest-1008135845-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:21.964520 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8d29d224-ef4e-4161-ad05-e6da353827c6 tempest-ServersOnMultiNodesTest-1008135845 tempest-ServersOnMultiNodesTest-1008135845-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:21.965595 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8d29d224-ef4e-4161-ad05-e6da353827c6 tempest-ServersOnMultiNodesTest-1008135845 tempest-ServersOnMultiNodesTest-1008135845-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:21.967651 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8d29d224-ef4e-4161-ad05-e6da353827c6 tempest-ServersOnMultiNodesTest-1008135845 tempest-ServersOnMultiNodesTest-1008135845-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:21.968111 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8d29d224-ef4e-4161-ad05-e6da353827c6 tempest-ServersOnMultiNodesTest-1008135845 tempest-ServersOnMultiNodesTest-1008135845-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:21.973402 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:51:22.457587 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-6d277a5c-2b66-4e4a-b381-a3edfca50f31 tempest-SecurityGroupRulesNegativeTestJSON-455183585 tempest-SecurityGroupRulesNegativeTestJSON-455183585-project] 10.222.0.60 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.946704 Sep 14 08:51:22.458643 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 355/756] 10.222.0.60 () {60 vars in 1180 bytes} [Wed Sep 14 08:51:21 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:51:22.486383 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c9e42e43-cc36-423c-a7b7-db1c0a311f0f tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:51:22.487045 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-c9e42e43-cc36-423c-a7b7-db1c0a311f0f tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: 874205eb-5321-4a9a-aa38-3cd83b2ac1a3] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:51:22.499115 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c9e42e43-cc36-423c-a7b7-db1c0a311f0f tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:22.499624 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c9e42e43-cc36-423c-a7b7-db1c0a311f0f tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:22.500707 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c9e42e43-cc36-423c-a7b7-db1c0a311f0f tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:22.503557 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c9e42e43-cc36-423c-a7b7-db1c0a311f0f tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:22.504290 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c9e42e43-cc36-423c-a7b7-db1c0a311f0f tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:22.505478 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c9e42e43-cc36-423c-a7b7-db1c0a311f0f tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:22.816593 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-8d29d224-ef4e-4161-ad05-e6da353827c6 tempest-ServersOnMultiNodesTest-1008135845 tempest-ServersOnMultiNodesTest-1008135845-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/3067be21-37ff-4a8f-8ca9-b1421e8be78f" status: 200 len: 1619 microversion: 2.1 time: 0.880826 Sep 14 08:51:22.817600 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 402/757] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:51:21 2022] GET /compute/v2.1/servers/3067be21-37ff-4a8f-8ca9-b1421e8be78f => generated 1619 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:51:22.826585 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-67620564-bbdd-4df4-a06e-d2661aa7742d tempest-SecurityGroupRulesNegativeTestJSON-455183585 tempest-SecurityGroupRulesNegativeTestJSON-455183585-project] Action: 'create', calling method: .version_select at 0x7f7d44427a60>, body: {"security_group_rule": {"parent_group_id": "b10fee82-ee8f-431d-8b62-c7ba67fe906a", "ip_protocol": "tcp", "from_port": 22, "to_port": 603710085}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:51:23.046267 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-c9e42e43-cc36-423c-a7b7-db1c0a311f0f tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:23.071136 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-c9e42e43-cc36-423c-a7b7-db1c0a311f0f tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/874205eb-5321-4a9a-aa38-3cd83b2ac1a3" status: 200 len: 1310 microversion: 2.1 time: 0.611045 Sep 14 08:51:23.072603 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 356/758] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:51:22 2022] GET /compute/v2.1/servers/874205eb-5321-4a9a-aa38-3cd83b2ac1a3 => generated 1310 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:51:23.085337 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ab317dfd-0a3c-4c4c-a059-1d57fb7eafcf tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:51:23.087156 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-ab317dfd-0a3c-4c4c-a059-1d57fb7eafcf tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: bf59291e-0a19-499b-a95b-a76d82b5e307] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:51:23.097023 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-67620564-bbdd-4df4-a06e-d2661aa7742d tempest-SecurityGroupRulesNegativeTestJSON-455183585 tempest-SecurityGroupRulesNegativeTestJSON-455183585-project] HTTP exception thrown: Invalid port range 22:603710085. Valid TCP ports should be between 1-65535 Sep 14 08:51:23.100008 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-67620564-bbdd-4df4-a06e-d2661aa7742d tempest-SecurityGroupRulesNegativeTestJSON-455183585 tempest-SecurityGroupRulesNegativeTestJSON-455183585-project] Request method failure captured: Sep 14 08:51:23.100008 n-d-836830-18 devstack@n-api.service[128759]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 14 08:51:23.100008 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 08:51:23.100008 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 08:51:23.100008 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 08:51:23.100008 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 145 Sep 14 08:51:23.100008 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 08:51:23.100008 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 08:51:23.100008 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 08:51:23.100008 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 08:51:23.100008 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZX_2uk9BgU5ZQ2oEmzXfPu9DLzwKRqFDvbKoowTS32zuZQLou4eBE4uW6-cZ7Wejp54Xney_cysQaxIMME-EJFZrtYmhJv1QnidDtCBAPgDNUT_XdHbRnJBgbDqYnDXW3mOOM_MWm7SlMehwrHPMQM0Y7AafT3Br4VJZzngqDBvi2I Sep 14 08:51:23.100008 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 08:51:23.100008 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 08:51:23.100008 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 08:51:23.100008 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 08:51:23.100008 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 08:51:23.100008 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 08:51:23.100008 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 3905ac6b31274a1892b2be9492bb64f6 Sep 14 08:51:23.100008 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-455183585 Sep 14 08:51:23.100008 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 08:51:23.100008 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 08:51:23.101551 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/3905ac6b31274a1892b2be9492bb64f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_3905ac6b31274a1892b2be9492bb64f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3905ac6b31274a1892b2be9492bb64f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3905ac6b31274a1892b2be9492bb64f6"}]}] Sep 14 08:51:23.101551 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-455183585 Sep 14 08:51:23.101551 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 3905ac6b31274a1892b2be9492bb64f6 Sep 14 08:51:23.101551 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-455183585 Sep 14 08:51:23.101551 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-455183585-project Sep 14 08:51:23.101551 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 08:51:23.101551 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 08:51:23.101551 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 70324b68330b408ca331761516254690 Sep 14 08:51:23.101551 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-455183585-project Sep 14 08:51:23.101551 n-d-836830-18 devstack@n-api.service[128759]: Sep 14 08:51:23.101551 n-d-836830-18 devstack@n-api.service[128759]: {"security_group_rule": {"parent_group_id": "b10fee82-ee8f-431d-8b62-c7ba67fe906a", "ip_protocol": "tcp", "from_port": 22, "to_port": 603710085}} Sep 14 08:51:23.101551 n-d-836830-18 devstack@n-api.service[128759]: method: Sep 14 08:51:23.102994 n-d-836830-18 devstack@n-api.service[128759]: exception: Invalid port range 22:603710085. Valid TCP ports should be between 1-65535 Sep 14 08:51:23.102994 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'b10fee82-ee8f-431d-8b62-c7ba67fe906a', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 603710085}}} Sep 14 08:51:23.102994 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:51:23.102994 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:51:23.102994 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Sep 14 08:51:23.102994 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Sep 14 08:51:23.102994 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Sep 14 08:51:23.102994 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Sep 14 08:51:23.102994 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Sep 14 08:51:23.102994 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Sep 14 08:51:23.102994 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Sep 14 08:51:23.102994 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Sep 14 08:51:23.102994 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:603710085. Valid TCP ports should be between 1-65535 Sep 14 08:51:23.102994 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:51:23.102994 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:51:23.102994 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:51:23.102994 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:51:23.102994 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:51:23.102994 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:51:23.104391 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:51:23.104391 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:51:23.104391 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 08:51:23.104391 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 08:51:23.104391 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:51:23.104391 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:51:23.104391 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Sep 14 08:51:23.104391 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 14 08:51:23.104391 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:603710085. Valid TCP ports should be between 1-65535 Sep 14 08:51:23.104391 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:51:23.104391 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:51:23.104391 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:51:23.104391 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:51:23.104391 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:51:23.104391 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:51:23.104391 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:51:23.104391 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:51:23.104391 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:603710085. Valid TCP ports should be between 1-65535 Sep 14 08:51:23.104391 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:51:23.105737 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-67620564-bbdd-4df4-a06e-d2661aa7742d tempest-SecurityGroupRulesNegativeTestJSON-455183585 tempest-SecurityGroupRulesNegativeTestJSON-455183585-project] Returning 400 to user: Invalid port range 22:603710085. Valid TCP ports should be between 1-65535 {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:51:23.105828 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ab317dfd-0a3c-4c4c-a059-1d57fb7eafcf tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:23.105828 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ab317dfd-0a3c-4c4c-a059-1d57fb7eafcf tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:23.105828 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ab317dfd-0a3c-4c4c-a059-1d57fb7eafcf tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:23.106619 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ab317dfd-0a3c-4c4c-a059-1d57fb7eafcf tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:23.106827 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-67620564-bbdd-4df4-a06e-d2661aa7742d tempest-SecurityGroupRulesNegativeTestJSON-455183585 tempest-SecurityGroupRulesNegativeTestJSON-455183585-project] 10.222.0.60 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 118 microversion: 2.1 time: 0.284012 Sep 14 08:51:23.107257 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ab317dfd-0a3c-4c4c-a059-1d57fb7eafcf tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:23.108145 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 403/759] 10.222.0.60 () {60 vars in 1195 bytes} [Wed Sep 14 08:51:22 2022] POST /compute/v2.1/os-security-group-rules => generated 118 bytes in 290 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 14 08:51:23.112882 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ab317dfd-0a3c-4c4c-a059-1d57fb7eafcf tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:23.118413 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-58a91a2d-3824-4f7a-8516-345936a09e7b tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-631578557", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["307b2830-67e6-44ec-845f-9894de16694a"]}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:51:23.191170 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.network.neutron [None req-58a91a2d-3824-4f7a-8516-345936a09e7b tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] validate_networks() for None {{(pid=128759) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 08:51:23.535322 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-ab317dfd-0a3c-4c4c-a059-1d57fb7eafcf tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:23.550674 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-ab317dfd-0a3c-4c4c-a059-1d57fb7eafcf tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:23.552792 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-ab317dfd-0a3c-4c4c-a059-1d57fb7eafcf tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:23.554319 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-ab317dfd-0a3c-4c4c-a059-1d57fb7eafcf tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/bf59291e-0a19-499b-a95b-a76d82b5e307" status: 200 len: 1362 microversion: 2.25 time: 0.480453 Sep 14 08:51:23.564115 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 357/760] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:51:23 2022] GET /compute/v2.1/servers/bf59291e-0a19-499b-a95b-a76d82b5e307 => generated 1362 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:51:23.577775 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a444881c-ddbe-4a31-89b6-6e1559cfdec5 tempest-SecurityGroupRulesNegativeTestJSON-455183585 tempest-SecurityGroupRulesNegativeTestJSON-455183585-project] Action: 'create', calling method: .version_select at 0x7f7d448088b0>, body: {"security_group_rule": {"parent_group_id": "970d64cc-15a3-404e-a969-a1e2fa487e69", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:51:23.617748 n-d-836830-18 devstack@n-api.service[128758]: DEBUG neutronclient.v2_0.client [None req-a444881c-ddbe-4a31-89b6-6e1559cfdec5 tempest-SecurityGroupRulesNegativeTestJSON-455183585 tempest-SecurityGroupRulesNegativeTestJSON-455183585-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 970d64cc-15a3-404e-a969-a1e2fa487e69 does not exist", "detail": ""}} {{(pid=128758) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 14 08:51:23.618522 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.network.security_group_api [None req-a444881c-ddbe-4a31-89b6-6e1559cfdec5 tempest-SecurityGroupRulesNegativeTestJSON-455183585 tempest-SecurityGroupRulesNegativeTestJSON-455183585-project] Neutron security group 970d64cc-15a3-404e-a969-a1e2fa487e69 not found {{(pid=128758) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 14 08:51:23.619223 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-a444881c-ddbe-4a31-89b6-6e1559cfdec5 tempest-SecurityGroupRulesNegativeTestJSON-455183585 tempest-SecurityGroupRulesNegativeTestJSON-455183585-project] HTTP exception thrown: Security group 970d64cc-15a3-404e-a969-a1e2fa487e69 does not exist Sep 14 08:51:23.619223 n-d-836830-18 devstack@n-api.service[128758]: Neutron server returns request_ids: ['req-0a9259ed-ba3f-47fc-a8a2-ee62a550315a'] Sep 14 08:51:23.621583 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a444881c-ddbe-4a31-89b6-6e1559cfdec5 tempest-SecurityGroupRulesNegativeTestJSON-455183585 tempest-SecurityGroupRulesNegativeTestJSON-455183585-project] Request method failure captured: Sep 14 08:51:23.621583 n-d-836830-18 devstack@n-api.service[128758]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 14 08:51:23.621583 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 08:51:23.621583 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 08:51:23.621583 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 08:51:23.621583 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 138 Sep 14 08:51:23.621583 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 08:51:23.621583 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 08:51:23.621583 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 08:51:23.621583 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 08:51:23.621583 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZX_2uk9BgU5ZQ2oEmzXfPu9DLzwKRqFDvbKoowTS32zuZQLou4eBE4uW6-cZ7Wejp54Xney_cysQaxIMME-EJFZrtYmhJv1QnidDtCBAPgDNUT_XdHbRnJBgbDqYnDXW3mOOM_MWm7SlMehwrHPMQM0Y7AafT3Br4VJZzngqDBvi2I Sep 14 08:51:23.621583 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 08:51:23.621583 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 08:51:23.621583 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 08:51:23.621583 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 08:51:23.621583 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 08:51:23.621583 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 08:51:23.621583 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 3905ac6b31274a1892b2be9492bb64f6 Sep 14 08:51:23.621583 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-455183585 Sep 14 08:51:23.621583 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 08:51:23.621583 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 08:51:23.623126 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/3905ac6b31274a1892b2be9492bb64f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_3905ac6b31274a1892b2be9492bb64f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3905ac6b31274a1892b2be9492bb64f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3905ac6b31274a1892b2be9492bb64f6"}]}] Sep 14 08:51:23.623126 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-455183585 Sep 14 08:51:23.623126 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 3905ac6b31274a1892b2be9492bb64f6 Sep 14 08:51:23.623126 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-455183585 Sep 14 08:51:23.623126 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-455183585-project Sep 14 08:51:23.623126 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 08:51:23.623126 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 08:51:23.623126 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 70324b68330b408ca331761516254690 Sep 14 08:51:23.623126 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-455183585-project Sep 14 08:51:23.623126 n-d-836830-18 devstack@n-api.service[128758]: Sep 14 08:51:23.623126 n-d-836830-18 devstack@n-api.service[128758]: {"security_group_rule": {"parent_group_id": "970d64cc-15a3-404e-a969-a1e2fa487e69", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Sep 14 08:51:23.623126 n-d-836830-18 devstack@n-api.service[128758]: method: Sep 14 08:51:23.624005 n-d-836830-18 devstack@n-api.service[128758]: exception: Security group 970d64cc-15a3-404e-a969-a1e2fa487e69 does not exist Sep 14 08:51:23.624005 n-d-836830-18 devstack@n-api.service[128758]: Neutron server returns request_ids: ['req-0a9259ed-ba3f-47fc-a8a2-ee62a550315a'] Sep 14 08:51:23.624005 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'body': {'security_group_rule': {'parent_group_id': '970d64cc-15a3-404e-a969-a1e2fa487e69', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Sep 14 08:51:23.624005 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:51:23.624005 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:51:23.624005 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 14 08:51:23.624005 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 14 08:51:23.624005 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 08:51:23.624005 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 08:51:23.624005 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 14 08:51:23.624005 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 14 08:51:23.624005 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 08:51:23.624005 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 08:51:23.624005 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 14 08:51:23.624005 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 14 08:51:23.624005 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 08:51:23.624005 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 08:51:23.624005 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 14 08:51:23.624005 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 14 08:51:23.625362 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 08:51:23.625362 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 08:51:23.625362 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 14 08:51:23.625362 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 14 08:51:23.625362 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 08:51:23.625362 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 08:51:23.625362 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 14 08:51:23.625362 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 14 08:51:23.625362 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 14 08:51:23.625362 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 14 08:51:23.625362 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 970d64cc-15a3-404e-a969-a1e2fa487e69 does not exist Sep 14 08:51:23.625362 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0a9259ed-ba3f-47fc-a8a2-ee62a550315a'] Sep 14 08:51:23.625362 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:51:23.625362 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:51:23.625362 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:51:23.625362 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:51:23.625362 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Sep 14 08:51:23.625362 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Sep 14 08:51:23.625362 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 14 08:51:23.626702 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 14 08:51:23.626702 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 970d64cc-15a3-404e-a969-a1e2fa487e69 does not exist Sep 14 08:51:23.626702 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0a9259ed-ba3f-47fc-a8a2-ee62a550315a'] Sep 14 08:51:23.626702 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:51:23.626702 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:51:23.626702 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:51:23.626702 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:51:23.626702 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:51:23.626702 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:51:23.626702 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:51:23.626702 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:51:23.626702 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 08:51:23.626702 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 08:51:23.626702 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:51:23.626702 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:51:23.626702 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Sep 14 08:51:23.626702 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 14 08:51:23.626702 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 970d64cc-15a3-404e-a969-a1e2fa487e69 does not exist Sep 14 08:51:23.626702 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0a9259ed-ba3f-47fc-a8a2-ee62a550315a'] Sep 14 08:51:23.626702 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:51:23.628129 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:51:23.628129 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:51:23.628129 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:51:23.628129 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:51:23.628129 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:51:23.628129 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:51:23.628129 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:51:23.628129 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 970d64cc-15a3-404e-a969-a1e2fa487e69 does not exist Sep 14 08:51:23.628129 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0a9259ed-ba3f-47fc-a8a2-ee62a550315a'] Sep 14 08:51:23.628129 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:51:23.629583 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a444881c-ddbe-4a31-89b6-6e1559cfdec5 tempest-SecurityGroupRulesNegativeTestJSON-455183585 tempest-SecurityGroupRulesNegativeTestJSON-455183585-project] Returning 404 to user: Security group 970d64cc-15a3-404e-a969-a1e2fa487e69 does not exist Sep 14 08:51:23.629583 n-d-836830-18 devstack@n-api.service[128758]: Neutron server returns request_ids: ['req-0a9259ed-ba3f-47fc-a8a2-ee62a550315a'] {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:51:23.630443 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-a444881c-ddbe-4a31-89b6-6e1559cfdec5 tempest-SecurityGroupRulesNegativeTestJSON-455183585 tempest-SecurityGroupRulesNegativeTestJSON-455183585-project] 10.222.0.60 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.065168 Sep 14 08:51:23.631365 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 358/761] 10.222.0.60 () {60 vars in 1195 bytes} [Wed Sep 14 08:51:23 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 08:51:23.640480 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-2617a9bb-56d4-4d6c-bb69-4b05fb7db15c tempest-MigrationsAdminTest-1443382137 tempest-MigrationsAdminTest-1443382137-project-admin] Calling method '.version_select at 0x7f7d447894c0>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:51:23.652257 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2617a9bb-56d4-4d6c-bb69-4b05fb7db15c tempest-MigrationsAdminTest-1443382137 tempest-MigrationsAdminTest-1443382137-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:23.653090 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2617a9bb-56d4-4d6c-bb69-4b05fb7db15c tempest-MigrationsAdminTest-1443382137 tempest-MigrationsAdminTest-1443382137-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:23.653606 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2617a9bb-56d4-4d6c-bb69-4b05fb7db15c tempest-MigrationsAdminTest-1443382137 tempest-MigrationsAdminTest-1443382137-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:23.677226 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-2617a9bb-56d4-4d6c-bb69-4b05fb7db15c tempest-MigrationsAdminTest-1443382137 tempest-MigrationsAdminTest-1443382137-project-admin] 10.222.0.60 "GET /compute/v2.1/os-migrations" status: 200 len: 1586 microversion: 2.1 time: 0.044257 Sep 14 08:51:23.678154 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 359/762] 10.222.0.60 () {58 vars in 1143 bytes} [Wed Sep 14 08:51:23 2022] GET /compute/v2.1/os-migrations => generated 1586 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:51:23.697671 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b2ebcfaa-8ebb-4bed-9878-df6e8c8755cd tempest-SecurityGroupRulesNegativeTestJSON-455183585 tempest-SecurityGroupRulesNegativeTestJSON-455183585-project] Calling method '.version_select at 0x7f7d4490e040>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:51:23.712094 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-58a91a2d-3824-4f7a-8516-345936a09e7b tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Flavor limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 08:51:23.713151 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-58a91a2d-3824-4f7a-8516-345936a09e7b tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Image limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 08:51:23.713896 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-58a91a2d-3824-4f7a-8516-345936a09e7b tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Flavor pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 08:51:23.714800 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-58a91a2d-3824-4f7a-8516-345936a09e7b tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Image pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 08:51:23.715334 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-58a91a2d-3824-4f7a-8516-345936a09e7b tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 08:51:23.717526 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:51:23.723015 n-d-836830-18 devstack@n-api.service[128758]: DEBUG neutronclient.v2_0.client [None req-b2ebcfaa-8ebb-4bed-9878-df6e8c8755cd tempest-SecurityGroupRulesNegativeTestJSON-455183585 tempest-SecurityGroupRulesNegativeTestJSON-455183585-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule 0b298c31-e674-4e22-b35c-88449098a577 does not exist", "detail": ""}} {{(pid=128758) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 14 08:51:23.723692 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.network.security_group_api [None req-b2ebcfaa-8ebb-4bed-9878-df6e8c8755cd tempest-SecurityGroupRulesNegativeTestJSON-455183585 tempest-SecurityGroupRulesNegativeTestJSON-455183585-project] Neutron security group rule 0b298c31-e674-4e22-b35c-88449098a577 not found {{(pid=128758) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Sep 14 08:51:23.725648 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-b2ebcfaa-8ebb-4bed-9878-df6e8c8755cd tempest-SecurityGroupRulesNegativeTestJSON-455183585 tempest-SecurityGroupRulesNegativeTestJSON-455183585-project] HTTP exception thrown: Security group rule 0b298c31-e674-4e22-b35c-88449098a577 does not exist Sep 14 08:51:23.725648 n-d-836830-18 devstack@n-api.service[128758]: Neutron server returns request_ids: ['req-a0cd5fcd-b643-4341-af9a-309b03c53a89'] Sep 14 08:51:23.731647 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b2ebcfaa-8ebb-4bed-9878-df6e8c8755cd tempest-SecurityGroupRulesNegativeTestJSON-455183585 tempest-SecurityGroupRulesNegativeTestJSON-455183585-project] Request method failure captured: Sep 14 08:51:23.731647 n-d-836830-18 devstack@n-api.service[128758]: request: DELETE /compute/v2.1/os-security-group-rules/0b298c31-e674-4e22-b35c-88449098a577 HTTP/1.1 Sep 14 08:51:23.731647 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 08:51:23.731647 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 08:51:23.731647 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 08:51:23.731647 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 08:51:23.731647 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 08:51:23.731647 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 08:51:23.731647 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 08:51:23.731647 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 08:51:23.731647 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZX_2uk9BgU5ZQ2oEmzXfPu9DLzwKRqFDvbKoowTS32zuZQLou4eBE4uW6-cZ7Wejp54Xney_cysQaxIMME-EJFZrtYmhJv1QnidDtCBAPgDNUT_XdHbRnJBgbDqYnDXW3mOOM_MWm7SlMehwrHPMQM0Y7AafT3Br4VJZzngqDBvi2I Sep 14 08:51:23.731647 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 08:51:23.731647 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 08:51:23.731647 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 08:51:23.731647 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 08:51:23.731647 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 08:51:23.731647 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 08:51:23.731647 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 3905ac6b31274a1892b2be9492bb64f6 Sep 14 08:51:23.731647 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-455183585 Sep 14 08:51:23.731647 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 08:51:23.731647 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 08:51:23.733298 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/3905ac6b31274a1892b2be9492bb64f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_3905ac6b31274a1892b2be9492bb64f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3905ac6b31274a1892b2be9492bb64f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3905ac6b31274a1892b2be9492bb64f6"}]}] Sep 14 08:51:23.733298 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-455183585 Sep 14 08:51:23.733298 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 3905ac6b31274a1892b2be9492bb64f6 Sep 14 08:51:23.733298 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-455183585 Sep 14 08:51:23.733298 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-455183585-project Sep 14 08:51:23.733298 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 08:51:23.733298 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 08:51:23.733298 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 70324b68330b408ca331761516254690 Sep 14 08:51:23.733298 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-455183585-project Sep 14 08:51:23.733298 n-d-836830-18 devstack@n-api.service[128758]: method: Sep 14 08:51:23.733298 n-d-836830-18 devstack@n-api.service[128758]: exception: Security group rule 0b298c31-e674-4e22-b35c-88449098a577 does not exist Sep 14 08:51:23.733298 n-d-836830-18 devstack@n-api.service[128758]: Neutron server returns request_ids: ['req-a0cd5fcd-b643-4341-af9a-309b03c53a89'] Sep 14 08:51:23.734217 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': '0b298c31-e674-4e22-b35c-88449098a577'} Sep 14 08:51:23.734217 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:51:23.734217 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:51:23.734217 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Sep 14 08:51:23.734217 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Sep 14 08:51:23.734217 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 08:51:23.734217 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 08:51:23.734217 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1092, in show_security_group_rule Sep 14 08:51:23.734217 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Sep 14 08:51:23.734217 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 08:51:23.734217 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 08:51:23.734217 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 14 08:51:23.734217 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 14 08:51:23.734217 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 08:51:23.734217 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 08:51:23.734217 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 14 08:51:23.734217 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 14 08:51:23.734217 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 08:51:23.734217 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 08:51:23.736488 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 14 08:51:23.736488 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 14 08:51:23.736488 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 08:51:23.736488 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 08:51:23.736488 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 14 08:51:23.736488 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 14 08:51:23.736488 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 14 08:51:23.736488 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 14 08:51:23.736488 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule 0b298c31-e674-4e22-b35c-88449098a577 does not exist Sep 14 08:51:23.736488 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a0cd5fcd-b643-4341-af9a-309b03c53a89'] Sep 14 08:51:23.736488 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:51:23.736488 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:51:23.736488 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:51:23.736488 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:51:23.736488 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Sep 14 08:51:23.736488 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Sep 14 08:51:23.736488 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Sep 14 08:51:23.736488 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 14 08:51:23.739047 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule 0b298c31-e674-4e22-b35c-88449098a577 does not exist Sep 14 08:51:23.739047 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a0cd5fcd-b643-4341-af9a-309b03c53a89'] Sep 14 08:51:23.739047 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:51:23.739047 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:51:23.739047 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:51:23.739047 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:51:23.739047 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:51:23.739047 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:51:23.739047 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:51:23.739047 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:51:23.739047 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 08:51:23.739047 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 08:51:23.739047 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:51:23.739047 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:51:23.739047 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Sep 14 08:51:23.739047 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 14 08:51:23.739047 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule 0b298c31-e674-4e22-b35c-88449098a577 does not exist Sep 14 08:51:23.739047 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a0cd5fcd-b643-4341-af9a-309b03c53a89'] Sep 14 08:51:23.739047 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:51:23.739047 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:51:23.741857 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:51:23.741857 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:51:23.741857 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:51:23.741857 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:51:23.741857 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:51:23.741857 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:51:23.741857 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule 0b298c31-e674-4e22-b35c-88449098a577 does not exist Sep 14 08:51:23.741857 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a0cd5fcd-b643-4341-af9a-309b03c53a89'] Sep 14 08:51:23.741857 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:51:23.744083 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-58a91a2d-3824-4f7a-8516-345936a09e7b tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:23.744083 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-58a91a2d-3824-4f7a-8516-345936a09e7b tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:23.744083 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-58a91a2d-3824-4f7a-8516-345936a09e7b tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:23.744083 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-58a91a2d-3824-4f7a-8516-345936a09e7b tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:23.744691 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-58a91a2d-3824-4f7a-8516-345936a09e7b tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:23.744691 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-58a91a2d-3824-4f7a-8516-345936a09e7b tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:23.745711 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b2ebcfaa-8ebb-4bed-9878-df6e8c8755cd tempest-SecurityGroupRulesNegativeTestJSON-455183585 tempest-SecurityGroupRulesNegativeTestJSON-455183585-project] Returning 404 to user: Security group rule 0b298c31-e674-4e22-b35c-88449098a577 does not exist Sep 14 08:51:23.745711 n-d-836830-18 devstack@n-api.service[128758]: Neutron server returns request_ids: ['req-a0cd5fcd-b643-4341-af9a-309b03c53a89'] {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:51:23.747043 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-b2ebcfaa-8ebb-4bed-9878-df6e8c8755cd tempest-SecurityGroupRulesNegativeTestJSON-455183585 tempest-SecurityGroupRulesNegativeTestJSON-455183585-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-group-rules/0b298c31-e674-4e22-b35c-88449098a577" status: 404 len: 199 microversion: 2.1 time: 0.057710 Sep 14 08:51:23.751942 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 360/763] 10.222.0.60 () {58 vars in 1287 bytes} [Wed Sep 14 08:51:23 2022] DELETE /compute/v2.1/os-security-group-rules/0b298c31-e674-4e22-b35c-88449098a577 => generated 199 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 08:51:23.758036 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-cff7dd04-670f-403f-8e62-3e821c7599cf tempest-MigrationsAdminTest-1443382137 tempest-MigrationsAdminTest-1443382137-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:51:23.765285 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-58a91a2d-3824-4f7a-8516-345936a09e7b tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Getting quotas for project 5e326f95a9604fdb9bd075db3837cf62. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 08:51:23.767706 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-cff7dd04-670f-403f-8e62-3e821c7599cf tempest-MigrationsAdminTest-1443382137 tempest-MigrationsAdminTest-1443382137-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013945 Sep 14 08:51:23.772482 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-58a91a2d-3824-4f7a-8516-345936a09e7b tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Getting quotas for user 89c7802984cf48d1852832b52abe52e9 and project 5e326f95a9604fdb9bd075db3837cf62. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 08:51:23.775778 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 361/764] 10.222.0.60 () {58 vars in 1137 bytes} [Wed Sep 14 08:51:23 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:51:23.786380 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-9005e7d6-33c6-4672-b8a8-d0a8c35773d4 tempest-SecurityGroupRulesNegativeTestJSON-455183585 tempest-SecurityGroupRulesNegativeTestJSON-455183585-project] Calling method '.version_select at 0x7f7d44808940>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:51:23.804294 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-58a91a2d-3824-4f7a-8516-345936a09e7b tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Going to run 1 instances... {{(pid=128759) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 08:51:23.812751 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-58a91a2d-3824-4f7a-8516-345936a09e7b tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] [instance: bc188404-0e98-4977-9283-5360293f19e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128759) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 08:51:23.863099 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-58a91a2d-3824-4f7a-8516-345936a09e7b tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.753680 Sep 14 08:51:23.864603 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 404/765] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 08:51:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 756 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 08:51:23.870574 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-4282a6d1-6833-4d4e-9407-d4d0a426190b req-421eb3b3-543c-440c-b9ae-2901c387087e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf59291e-0a19-499b-a95b-a76d82b5e307", "name": "network-vif-plugged", "status": "completed", "tag": "f8233fbd-017c-41f3-ac0a-d6c9e916d35e"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:51:23.883766 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-4282a6d1-6833-4d4e-9407-d4d0a426190b req-421eb3b3-543c-440c-b9ae-2901c387087e service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:23.884850 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-4282a6d1-6833-4d4e-9407-d4d0a426190b req-421eb3b3-543c-440c-b9ae-2901c387087e service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:23.885494 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-4282a6d1-6833-4d4e-9407-d4d0a426190b req-421eb3b3-543c-440c-b9ae-2901c387087e service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:23.897146 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-4282a6d1-6833-4d4e-9407-d4d0a426190b req-421eb3b3-543c-440c-b9ae-2901c387087e service nova] Creating event network-vif-plugged:f8233fbd-017c-41f3-ac0a-d6c9e916d35e for instance bf59291e-0a19-499b-a95b-a76d82b5e307 on n-h1-836830-18 Sep 14 08:51:23.902821 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-4282a6d1-6833-4d4e-9407-d4d0a426190b req-421eb3b3-543c-440c-b9ae-2901c387087e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036807 Sep 14 08:51:23.903565 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 405/766] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:51:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:51:23.910168 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8aaec908-1da5-4ac9-ad58-ba8d9c8bbfbc tempest-MigrationsAdminTest-1443382137 tempest-MigrationsAdminTest-1443382137-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-148975218", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:51:23.954330 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-8aaec908-1da5-4ac9-ad58-ba8d9c8bbfbc tempest-MigrationsAdminTest-1443382137 tempest-MigrationsAdminTest-1443382137-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 498 microversion: 2.1 time: 0.049131 Sep 14 08:51:23.959363 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 406/767] 10.222.0.60 () {60 vars in 1146 bytes} [Wed Sep 14 08:51:23 2022] POST /compute/v2.1/flavors => generated 498 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:51:23.972192 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e184141c-1229-482b-a45f-c7e7ebbb1858 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:51:23.975736 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e184141c-1229-482b-a45f-c7e7ebbb1858 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] [instance: bc188404-0e98-4977-9283-5360293f19e4] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:51:24.078967 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-e184141c-1229-482b-a45f-c7e7ebbb1858 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c7802984cf48d1852832b52abe52e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e326f95a9604fdb9bd075db3837cf62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:24.091292 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e184141c-1229-482b-a45f-c7e7ebbb1858 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] 10.222.0.60 "GET /compute/v2.1/servers/bc188404-0e98-4977-9283-5360293f19e4" status: 200 len: 1216 microversion: 2.1 time: 0.126662 Sep 14 08:51:24.093568 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 407/768] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:51:23 2022] GET /compute/v2.1/servers/bc188404-0e98-4977-9283-5360293f19e4 => generated 1216 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:51:24.098197 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-86b8ca1c-62b3-439e-8883-bf5bafd3634b tempest-MigrationsAdminTest-1443382137 tempest-MigrationsAdminTest-1443382137-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:51:24.116068 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-86b8ca1c-62b3-439e-8883-bf5bafd3634b tempest-MigrationsAdminTest-1443382137 tempest-MigrationsAdminTest-1443382137-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.021382 Sep 14 08:51:24.116983 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 408/769] 10.222.0.60 () {58 vars in 1182 bytes} [Wed Sep 14 08:51:24 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 08:51:24.144532 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-fee6be70-29fd-4dcb-8f17-d937db1fd075 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:51:24.145171 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-fee6be70-29fd-4dcb-8f17-d937db1fd075 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: 874205eb-5321-4a9a-aa38-3cd83b2ac1a3] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:51:24.162625 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fee6be70-29fd-4dcb-8f17-d937db1fd075 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:24.169285 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fee6be70-29fd-4dcb-8f17-d937db1fd075 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:24.170075 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fee6be70-29fd-4dcb-8f17-d937db1fd075 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:24.171120 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fee6be70-29fd-4dcb-8f17-d937db1fd075 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:24.172074 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fee6be70-29fd-4dcb-8f17-d937db1fd075 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:24.172753 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fee6be70-29fd-4dcb-8f17-d937db1fd075 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:24.182136 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-9005e7d6-33c6-4672-b8a8-d0a8c35773d4 tempest-SecurityGroupRulesNegativeTestJSON-455183585 tempest-SecurityGroupRulesNegativeTestJSON-455183585-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/b10fee82-ee8f-431d-8b62-c7ba67fe906a" status: 202 len: 0 microversion: 2.1 time: 0.401809 Sep 14 08:51:24.184966 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 362/770] 10.222.0.60 () {58 vars in 1272 bytes} [Wed Sep 14 08:51:23 2022] DELETE /compute/v2.1/os-security-groups/b10fee82-ee8f-431d-8b62-c7ba67fe906a => generated 0 bytes in 407 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 08:51:24.191840 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-98565ad5-6dd4-4cec-a5ec-147f6946b547 tempest-SecurityGroupRulesNegativeTestJSON-455183585 tempest-SecurityGroupRulesNegativeTestJSON-455183585-project] Calling method '.version_select at 0x7f7d44939280>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:51:24.424692 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-fee6be70-29fd-4dcb-8f17-d937db1fd075 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:24.438113 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-fee6be70-29fd-4dcb-8f17-d937db1fd075 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/874205eb-5321-4a9a-aa38-3cd83b2ac1a3" status: 200 len: 1310 microversion: 2.1 time: 0.315934 Sep 14 08:51:24.438751 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 409/771] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:51:24 2022] GET /compute/v2.1/servers/874205eb-5321-4a9a-aa38-3cd83b2ac1a3 => generated 1310 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:51:24.464543 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3406e90a-ca3d-4b67-8009-f7d4fc4be5f8 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-968787941", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "306d3b58-2a12-439e-a2b9-f9aaae74d166"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:51:24.591025 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.network.neutron [None req-3406e90a-ca3d-4b67-8009-f7d4fc4be5f8 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] validate_networks() for None {{(pid=128759) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 08:51:24.595428 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-98565ad5-6dd4-4cec-a5ec-147f6946b547 tempest-SecurityGroupRulesNegativeTestJSON-455183585 tempest-SecurityGroupRulesNegativeTestJSON-455183585-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/b43028a9-d89d-42b5-9791-298c358f675c" status: 202 len: 0 microversion: 2.1 time: 0.407959 Sep 14 08:51:24.596958 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 363/772] 10.222.0.60 () {58 vars in 1272 bytes} [Wed Sep 14 08:51:24 2022] DELETE /compute/v2.1/os-security-groups/b43028a9-d89d-42b5-9791-298c358f675c => generated 0 bytes in 410 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 08:51:24.603411 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-f5e4ff25-77b0-49c5-a5a2-0661b94eac59 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:51:24.604511 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-f5e4ff25-77b0-49c5-a5a2-0661b94eac59 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: bf59291e-0a19-499b-a95b-a76d82b5e307] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:51:24.616404 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f5e4ff25-77b0-49c5-a5a2-0661b94eac59 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:24.616965 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f5e4ff25-77b0-49c5-a5a2-0661b94eac59 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:24.617949 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f5e4ff25-77b0-49c5-a5a2-0661b94eac59 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:24.619035 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f5e4ff25-77b0-49c5-a5a2-0661b94eac59 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:24.619426 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f5e4ff25-77b0-49c5-a5a2-0661b94eac59 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:24.619901 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f5e4ff25-77b0-49c5-a5a2-0661b94eac59 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:24.894112 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-f5e4ff25-77b0-49c5-a5a2-0661b94eac59 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:24.909399 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-f5e4ff25-77b0-49c5-a5a2-0661b94eac59 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:24.911305 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-f5e4ff25-77b0-49c5-a5a2-0661b94eac59 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:24.912633 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-f5e4ff25-77b0-49c5-a5a2-0661b94eac59 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/bf59291e-0a19-499b-a95b-a76d82b5e307" status: 200 len: 1362 microversion: 2.25 time: 0.314483 Sep 14 08:51:24.936739 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 364/773] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:51:24 2022] GET /compute/v2.1/servers/bf59291e-0a19-499b-a95b-a76d82b5e307 => generated 1362 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:51:24.942229 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-512145e8-7754-4dee-a6d3-9be30aa5ecd1 tempest-SecurityGroupRulesNegativeTestJSON-455183585 tempest-SecurityGroupRulesNegativeTestJSON-455183585-project] Calling method '.version_select at 0x7f7d44a37940>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:51:25.141006 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-3406e90a-ca3d-4b67-8009-f7d4fc4be5f8 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Flavor limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 08:51:25.142002 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-3406e90a-ca3d-4b67-8009-f7d4fc4be5f8 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Image limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 08:51:25.142642 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-3406e90a-ca3d-4b67-8009-f7d4fc4be5f8 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Flavor pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 08:51:25.143243 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-3406e90a-ca3d-4b67-8009-f7d4fc4be5f8 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Image pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 08:51:25.143822 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-3406e90a-ca3d-4b67-8009-f7d4fc4be5f8 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 08:51:25.155444 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3406e90a-ca3d-4b67-8009-f7d4fc4be5f8 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:25.156140 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3406e90a-ca3d-4b67-8009-f7d4fc4be5f8 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:25.156821 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3406e90a-ca3d-4b67-8009-f7d4fc4be5f8 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:25.157762 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3406e90a-ca3d-4b67-8009-f7d4fc4be5f8 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:25.158418 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3406e90a-ca3d-4b67-8009-f7d4fc4be5f8 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:25.159164 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3406e90a-ca3d-4b67-8009-f7d4fc4be5f8 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:25.186519 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-3406e90a-ca3d-4b67-8009-f7d4fc4be5f8 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Getting quotas for project 8fd62edd611c4390be2403972b99aa15. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 08:51:25.201987 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-3406e90a-ca3d-4b67-8009-f7d4fc4be5f8 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Getting quotas for user 264fb30236d54248ad0ecf79a177849f and project 8fd62edd611c4390be2403972b99aa15. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 08:51:25.230743 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-3406e90a-ca3d-4b67-8009-f7d4fc4be5f8 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Going to run 1 instances... {{(pid=128759) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 08:51:25.238312 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-3406e90a-ca3d-4b67-8009-f7d4fc4be5f8 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: af183467-9304-4c73-a29f-196e76ba21b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128759) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 08:51:25.280055 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-512145e8-7754-4dee-a6d3-9be30aa5ecd1 tempest-SecurityGroupRulesNegativeTestJSON-455183585 tempest-SecurityGroupRulesNegativeTestJSON-455183585-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/2fc6bbf8-62ee-456d-a020-a03a5a7f1024" status: 202 len: 0 microversion: 2.1 time: 0.341786 Sep 14 08:51:25.283404 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 365/774] 10.222.0.60 () {58 vars in 1272 bytes} [Wed Sep 14 08:51:24 2022] DELETE /compute/v2.1/os-security-groups/2fc6bbf8-62ee-456d-a020-a03a5a7f1024 => generated 0 bytes in 344 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 08:51:25.295214 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-3406e90a-ca3d-4b67-8009-f7d4fc4be5f8 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.842628 Sep 14 08:51:25.296398 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 410/775] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 08:51:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 857 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 08:51:25.301526 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-eb6214c9-9031-40e8-a1eb-020bef8e1437 tempest-SecurityGroupRulesNegativeTestJSON-455183585 tempest-SecurityGroupRulesNegativeTestJSON-455183585-project] Calling method '.version_select at 0x7f7d44582f70>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:51:25.302631 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-18c734c6-1c53-4ba6-a831-bc071af07b22 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:51:25.303458 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-18c734c6-1c53-4ba6-a831-bc071af07b22 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] [instance: bc188404-0e98-4977-9283-5360293f19e4] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:51:25.337100 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-18c734c6-1c53-4ba6-a831-bc071af07b22 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:25.337616 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-18c734c6-1c53-4ba6-a831-bc071af07b22 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:25.338057 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-18c734c6-1c53-4ba6-a831-bc071af07b22 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:25.338798 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-18c734c6-1c53-4ba6-a831-bc071af07b22 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:25.343638 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-18c734c6-1c53-4ba6-a831-bc071af07b22 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:25.344091 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-18c734c6-1c53-4ba6-a831-bc071af07b22 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:25.494085 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-18c734c6-1c53-4ba6-a831-bc071af07b22 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c7802984cf48d1852832b52abe52e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e326f95a9604fdb9bd075db3837cf62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:25.527601 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-18c734c6-1c53-4ba6-a831-bc071af07b22 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] 10.222.0.60 "GET /compute/v2.1/servers/bc188404-0e98-4977-9283-5360293f19e4" status: 200 len: 1268 microversion: 2.1 time: 0.244258 Sep 14 08:51:25.530810 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 366/776] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:51:25 2022] GET /compute/v2.1/servers/bc188404-0e98-4977-9283-5360293f19e4 => generated 1268 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:51:25.565803 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-50d2ef5b-1e95-4b51-a193-0930ef471421 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:51:25.567762 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-50d2ef5b-1e95-4b51-a193-0930ef471421 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: af183467-9304-4c73-a29f-196e76ba21b5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:51:25.711856 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-50d2ef5b-1e95-4b51-a193-0930ef471421 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:25.724864 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-50d2ef5b-1e95-4b51-a193-0930ef471421 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/af183467-9304-4c73-a29f-196e76ba21b5" status: 200 len: 1278 microversion: 2.1 time: 0.192291 Sep 14 08:51:25.726403 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 367/777] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:51:25 2022] GET /compute/v2.1/servers/af183467-9304-4c73-a29f-196e76ba21b5 => generated 1278 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:51:25.741178 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-043284b9-aea4-48db-bdaa-2d4a90876ea1 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:51:25.744539 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-043284b9-aea4-48db-bdaa-2d4a90876ea1 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: 874205eb-5321-4a9a-aa38-3cd83b2ac1a3] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:51:25.772258 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-043284b9-aea4-48db-bdaa-2d4a90876ea1 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:25.776235 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-043284b9-aea4-48db-bdaa-2d4a90876ea1 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:25.776921 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-043284b9-aea4-48db-bdaa-2d4a90876ea1 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:25.779473 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-043284b9-aea4-48db-bdaa-2d4a90876ea1 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:25.780030 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-043284b9-aea4-48db-bdaa-2d4a90876ea1 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:25.783472 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-043284b9-aea4-48db-bdaa-2d4a90876ea1 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:25.842365 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-eb6214c9-9031-40e8-a1eb-020bef8e1437 tempest-SecurityGroupRulesNegativeTestJSON-455183585 tempest-SecurityGroupRulesNegativeTestJSON-455183585-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/023d29ae-1258-4c8d-8de6-e4304072293b" status: 202 len: 0 microversion: 2.1 time: 0.544553 Sep 14 08:51:25.843690 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 411/778] 10.222.0.60 () {58 vars in 1272 bytes} [Wed Sep 14 08:51:25 2022] DELETE /compute/v2.1/os-security-groups/023d29ae-1258-4c8d-8de6-e4304072293b => generated 0 bytes in 546 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 08:51:25.854517 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f2caab43-34c6-467e-9501-9c5c3dce9637 tempest-SecurityGroupRulesNegativeTestJSON-455183585 tempest-SecurityGroupRulesNegativeTestJSON-455183585-project] Calling method '.version_select at 0x7f7d4452de50>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:51:26.174438 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-043284b9-aea4-48db-bdaa-2d4a90876ea1 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:26.188581 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-043284b9-aea4-48db-bdaa-2d4a90876ea1 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/874205eb-5321-4a9a-aa38-3cd83b2ac1a3" status: 200 len: 1310 microversion: 2.1 time: 0.456625 Sep 14 08:51:26.192375 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 368/779] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:51:25 2022] GET /compute/v2.1/servers/874205eb-5321-4a9a-aa38-3cd83b2ac1a3 => generated 1310 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:51:26.206806 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-dccfd171-382e-4a8f-aa7c-4a7723b648fc tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:51:26.208088 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-dccfd171-382e-4a8f-aa7c-4a7723b648fc tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: bf59291e-0a19-499b-a95b-a76d82b5e307] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:51:26.225826 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dccfd171-382e-4a8f-aa7c-4a7723b648fc tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:26.226652 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dccfd171-382e-4a8f-aa7c-4a7723b648fc tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:26.227248 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dccfd171-382e-4a8f-aa7c-4a7723b648fc tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:26.230841 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dccfd171-382e-4a8f-aa7c-4a7723b648fc tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:26.232062 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dccfd171-382e-4a8f-aa7c-4a7723b648fc tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:26.235718 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dccfd171-382e-4a8f-aa7c-4a7723b648fc tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:26.610187 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-dccfd171-382e-4a8f-aa7c-4a7723b648fc tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:26.630800 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-dccfd171-382e-4a8f-aa7c-4a7723b648fc tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:26.633185 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-dccfd171-382e-4a8f-aa7c-4a7723b648fc tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:26.635152 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-dccfd171-382e-4a8f-aa7c-4a7723b648fc tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/bf59291e-0a19-499b-a95b-a76d82b5e307" status: 200 len: 1362 microversion: 2.25 time: 0.441404 Sep 14 08:51:26.648269 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 369/780] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:51:26 2022] GET /compute/v2.1/servers/bf59291e-0a19-499b-a95b-a76d82b5e307 => generated 1362 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:51:26.670585 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f2caab43-34c6-467e-9501-9c5c3dce9637 tempest-SecurityGroupRulesNegativeTestJSON-455183585 tempest-SecurityGroupRulesNegativeTestJSON-455183585-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/048f6081-2c69-465a-abab-5ae2fd60be11" status: 202 len: 0 microversion: 2.1 time: 0.820848 Sep 14 08:51:26.672105 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-99f357a4-76cc-4946-8906-d4ba38f971a9 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:51:26.672741 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-99f357a4-76cc-4946-8906-d4ba38f971a9 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] [instance: bc188404-0e98-4977-9283-5360293f19e4] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:51:26.673362 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 412/781] 10.222.0.60 () {58 vars in 1272 bytes} [Wed Sep 14 08:51:25 2022] DELETE /compute/v2.1/os-security-groups/048f6081-2c69-465a-abab-5ae2fd60be11 => generated 0 bytes in 825 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 14 08:51:26.691362 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-99f357a4-76cc-4946-8906-d4ba38f971a9 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:26.691868 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-99f357a4-76cc-4946-8906-d4ba38f971a9 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:26.692314 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-99f357a4-76cc-4946-8906-d4ba38f971a9 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:26.693034 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-99f357a4-76cc-4946-8906-d4ba38f971a9 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:26.693495 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-99f357a4-76cc-4946-8906-d4ba38f971a9 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:26.693934 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-99f357a4-76cc-4946-8906-d4ba38f971a9 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:26.766023 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-799e9d97-d615-4aaf-9a71-100aabe2f105 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:51:26.766900 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-799e9d97-d615-4aaf-9a71-100aabe2f105 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: af183467-9304-4c73-a29f-196e76ba21b5] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:51:26.779320 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-799e9d97-d615-4aaf-9a71-100aabe2f105 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:26.780419 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-799e9d97-d615-4aaf-9a71-100aabe2f105 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:26.781530 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-799e9d97-d615-4aaf-9a71-100aabe2f105 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:26.783354 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-799e9d97-d615-4aaf-9a71-100aabe2f105 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:26.784383 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-799e9d97-d615-4aaf-9a71-100aabe2f105 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:26.785338 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-799e9d97-d615-4aaf-9a71-100aabe2f105 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:26.826770 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-99f357a4-76cc-4946-8906-d4ba38f971a9 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c7802984cf48d1852832b52abe52e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e326f95a9604fdb9bd075db3837cf62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:26.835646 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-99f357a4-76cc-4946-8906-d4ba38f971a9 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] 10.222.0.60 "GET /compute/v2.1/servers/bc188404-0e98-4977-9283-5360293f19e4" status: 200 len: 1274 microversion: 2.1 time: 0.186213 Sep 14 08:51:26.853589 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 370/782] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:51:26 2022] GET /compute/v2.1/servers/bc188404-0e98-4977-9283-5360293f19e4 => generated 1274 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:51:26.872572 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-799e9d97-d615-4aaf-9a71-100aabe2f105 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:26.881005 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-799e9d97-d615-4aaf-9a71-100aabe2f105 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/af183467-9304-4c73-a29f-196e76ba21b5" status: 200 len: 1274 microversion: 2.1 time: 0.120399 Sep 14 08:51:26.899499 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 413/783] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:51:26 2022] GET /compute/v2.1/servers/af183467-9304-4c73-a29f-196e76ba21b5 => generated 1274 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:51:27.238110 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ef8f33f0-5cf5-4f6d-a9bb-5bf345323004 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:51:27.240084 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-ef8f33f0-5cf5-4f6d-a9bb-5bf345323004 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: 874205eb-5321-4a9a-aa38-3cd83b2ac1a3] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:51:27.263896 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ef8f33f0-5cf5-4f6d-a9bb-5bf345323004 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:27.265338 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ef8f33f0-5cf5-4f6d-a9bb-5bf345323004 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:27.265791 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ef8f33f0-5cf5-4f6d-a9bb-5bf345323004 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:27.268699 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ef8f33f0-5cf5-4f6d-a9bb-5bf345323004 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:27.271095 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ef8f33f0-5cf5-4f6d-a9bb-5bf345323004 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:27.272138 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ef8f33f0-5cf5-4f6d-a9bb-5bf345323004 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:27.640998 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-ef8f33f0-5cf5-4f6d-a9bb-5bf345323004 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:27.653639 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-ef8f33f0-5cf5-4f6d-a9bb-5bf345323004 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/874205eb-5321-4a9a-aa38-3cd83b2ac1a3" status: 200 len: 1310 microversion: 2.1 time: 0.423280 Sep 14 08:51:27.659830 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 371/784] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:51:27 2022] GET /compute/v2.1/servers/874205eb-5321-4a9a-aa38-3cd83b2ac1a3 => generated 1310 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:51:27.663365 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-0a3b008a-0c9e-4144-b02f-4d9bf299b759 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:51:27.664039 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-0a3b008a-0c9e-4144-b02f-4d9bf299b759 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: bf59291e-0a19-499b-a95b-a76d82b5e307] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:51:27.673048 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0a3b008a-0c9e-4144-b02f-4d9bf299b759 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:27.673868 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0a3b008a-0c9e-4144-b02f-4d9bf299b759 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:27.673997 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0a3b008a-0c9e-4144-b02f-4d9bf299b759 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:27.674832 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0a3b008a-0c9e-4144-b02f-4d9bf299b759 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:27.675320 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0a3b008a-0c9e-4144-b02f-4d9bf299b759 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:27.675769 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0a3b008a-0c9e-4144-b02f-4d9bf299b759 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:27.874964 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-bc0e87ae-f55e-435b-ac13-62b5d1b61799 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:51:27.876362 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-bc0e87ae-f55e-435b-ac13-62b5d1b61799 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] [instance: bc188404-0e98-4977-9283-5360293f19e4] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:51:27.897099 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bc0e87ae-f55e-435b-ac13-62b5d1b61799 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:27.901261 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bc0e87ae-f55e-435b-ac13-62b5d1b61799 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:27.901943 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bc0e87ae-f55e-435b-ac13-62b5d1b61799 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:27.903168 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bc0e87ae-f55e-435b-ac13-62b5d1b61799 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:27.903967 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bc0e87ae-f55e-435b-ac13-62b5d1b61799 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:27.904967 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bc0e87ae-f55e-435b-ac13-62b5d1b61799 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:28.564950 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-bc0e87ae-f55e-435b-ac13-62b5d1b61799 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c7802984cf48d1852832b52abe52e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e326f95a9604fdb9bd075db3837cf62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:28.575581 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-bc0e87ae-f55e-435b-ac13-62b5d1b61799 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] 10.222.0.60 "GET /compute/v2.1/servers/bc188404-0e98-4977-9283-5360293f19e4" status: 200 len: 1316 microversion: 2.1 time: 0.717442 Sep 14 08:51:28.579788 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 372/785] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:51:27 2022] GET /compute/v2.1/servers/bc188404-0e98-4977-9283-5360293f19e4 => generated 1316 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:51:28.588045 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-dd8bd08e-e21d-46f1-8a50-fe74945a809d tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:51:28.589171 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-dd8bd08e-e21d-46f1-8a50-fe74945a809d tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: af183467-9304-4c73-a29f-196e76ba21b5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:51:28.613293 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dd8bd08e-e21d-46f1-8a50-fe74945a809d tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:28.614376 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dd8bd08e-e21d-46f1-8a50-fe74945a809d tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:28.617074 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dd8bd08e-e21d-46f1-8a50-fe74945a809d tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:28.618144 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dd8bd08e-e21d-46f1-8a50-fe74945a809d tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:28.619061 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dd8bd08e-e21d-46f1-8a50-fe74945a809d tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:28.619716 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dd8bd08e-e21d-46f1-8a50-fe74945a809d tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:28.696009 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-0a3b008a-0c9e-4144-b02f-4d9bf299b759 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:28.705664 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-0a3b008a-0c9e-4144-b02f-4d9bf299b759 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:28.709899 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-0a3b008a-0c9e-4144-b02f-4d9bf299b759 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:28.711631 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-0a3b008a-0c9e-4144-b02f-4d9bf299b759 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/bf59291e-0a19-499b-a95b-a76d82b5e307" status: 200 len: 1362 microversion: 2.25 time: 1.051888 Sep 14 08:51:28.712202 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 414/786] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:51:27 2022] GET /compute/v2.1/servers/bf59291e-0a19-499b-a95b-a76d82b5e307 => generated 1362 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:51:28.721508 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a1600a27-b0b4-45b8-b142-5a1845ca06f3 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:51:28.722137 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-a1600a27-b0b4-45b8-b142-5a1845ca06f3 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: 874205eb-5321-4a9a-aa38-3cd83b2ac1a3] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:51:28.741877 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a1600a27-b0b4-45b8-b142-5a1845ca06f3 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:28.742422 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a1600a27-b0b4-45b8-b142-5a1845ca06f3 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:28.742862 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a1600a27-b0b4-45b8-b142-5a1845ca06f3 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:28.744234 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a1600a27-b0b4-45b8-b142-5a1845ca06f3 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:28.744702 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a1600a27-b0b4-45b8-b142-5a1845ca06f3 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:28.745131 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a1600a27-b0b4-45b8-b142-5a1845ca06f3 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:28.812618 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-dd8bd08e-e21d-46f1-8a50-fe74945a809d tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:28.834220 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-dd8bd08e-e21d-46f1-8a50-fe74945a809d tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/af183467-9304-4c73-a29f-196e76ba21b5" status: 200 len: 1330 microversion: 2.1 time: 0.250609 Sep 14 08:51:28.836599 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 373/787] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:51:28 2022] GET /compute/v2.1/servers/af183467-9304-4c73-a29f-196e76ba21b5 => generated 1330 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:51:29.034228 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-a1600a27-b0b4-45b8-b142-5a1845ca06f3 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:29.052714 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a1600a27-b0b4-45b8-b142-5a1845ca06f3 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/874205eb-5321-4a9a-aa38-3cd83b2ac1a3" status: 200 len: 1310 microversion: 2.1 time: 0.338450 Sep 14 08:51:29.059240 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 415/788] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:51:28 2022] GET /compute/v2.1/servers/874205eb-5321-4a9a-aa38-3cd83b2ac1a3 => generated 1310 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:51:29.606191 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-362d541b-1cd3-405f-ab4e-0812e68c46ac tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:51:29.607506 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-362d541b-1cd3-405f-ab4e-0812e68c46ac tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] [instance: bc188404-0e98-4977-9283-5360293f19e4] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:51:29.620664 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-362d541b-1cd3-405f-ab4e-0812e68c46ac tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:29.625126 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-362d541b-1cd3-405f-ab4e-0812e68c46ac tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:29.627998 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-362d541b-1cd3-405f-ab4e-0812e68c46ac tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:29.636136 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-362d541b-1cd3-405f-ab4e-0812e68c46ac tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:29.652104 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-362d541b-1cd3-405f-ab4e-0812e68c46ac tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:29.652572 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-362d541b-1cd3-405f-ab4e-0812e68c46ac tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:29.743177 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-bb9c4080-cfc2-412a-85d6-6bed57f2985d tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:51:29.744684 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-bb9c4080-cfc2-412a-85d6-6bed57f2985d tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: bf59291e-0a19-499b-a95b-a76d82b5e307] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:51:29.758256 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bb9c4080-cfc2-412a-85d6-6bed57f2985d tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:29.759660 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bb9c4080-cfc2-412a-85d6-6bed57f2985d tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:29.760884 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bb9c4080-cfc2-412a-85d6-6bed57f2985d tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:29.762309 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bb9c4080-cfc2-412a-85d6-6bed57f2985d tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:29.763290 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bb9c4080-cfc2-412a-85d6-6bed57f2985d tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:29.772528 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bb9c4080-cfc2-412a-85d6-6bed57f2985d tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:30.249853 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-362d541b-1cd3-405f-ab4e-0812e68c46ac tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c7802984cf48d1852832b52abe52e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e326f95a9604fdb9bd075db3837cf62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:30.260559 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-362d541b-1cd3-405f-ab4e-0812e68c46ac tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] 10.222.0.60 "GET /compute/v2.1/servers/bc188404-0e98-4977-9283-5360293f19e4" status: 200 len: 1316 microversion: 2.1 time: 0.660627 Sep 14 08:51:30.279341 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 374/789] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:51:29 2022] GET /compute/v2.1/servers/bc188404-0e98-4977-9283-5360293f19e4 => generated 1316 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:51:30.291414 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-26287fa6-7e3c-4576-8f27-da0fe250f08c tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:51:30.292019 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-26287fa6-7e3c-4576-8f27-da0fe250f08c tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: af183467-9304-4c73-a29f-196e76ba21b5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:51:30.308493 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-26287fa6-7e3c-4576-8f27-da0fe250f08c tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:30.308994 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-26287fa6-7e3c-4576-8f27-da0fe250f08c tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:30.309429 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-26287fa6-7e3c-4576-8f27-da0fe250f08c tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:30.310135 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-26287fa6-7e3c-4576-8f27-da0fe250f08c tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:30.310588 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-26287fa6-7e3c-4576-8f27-da0fe250f08c tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:30.311040 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-26287fa6-7e3c-4576-8f27-da0fe250f08c tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:30.333091 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-bb9c4080-cfc2-412a-85d6-6bed57f2985d tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:30.342566 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-bb9c4080-cfc2-412a-85d6-6bed57f2985d tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:30.348147 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-bb9c4080-cfc2-412a-85d6-6bed57f2985d tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:30.353282 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-bb9c4080-cfc2-412a-85d6-6bed57f2985d tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/bf59291e-0a19-499b-a95b-a76d82b5e307" status: 200 len: 1558 microversion: 2.25 time: 0.612796 Sep 14 08:51:30.354743 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 416/790] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:51:29 2022] GET /compute/v2.1/servers/bf59291e-0a19-499b-a95b-a76d82b5e307 => generated 1558 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 08:51:30.369244 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ef5ab0d3-7e6d-4620-9ff1-7542b6aea9a7 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:51:30.370137 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-ef5ab0d3-7e6d-4620-9ff1-7542b6aea9a7 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: 874205eb-5321-4a9a-aa38-3cd83b2ac1a3] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:51:30.405620 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ef5ab0d3-7e6d-4620-9ff1-7542b6aea9a7 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:30.407554 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ef5ab0d3-7e6d-4620-9ff1-7542b6aea9a7 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:30.408844 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ef5ab0d3-7e6d-4620-9ff1-7542b6aea9a7 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:30.411353 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ef5ab0d3-7e6d-4620-9ff1-7542b6aea9a7 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:30.412062 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ef5ab0d3-7e6d-4620-9ff1-7542b6aea9a7 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:30.413107 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ef5ab0d3-7e6d-4620-9ff1-7542b6aea9a7 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:30.581137 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-26287fa6-7e3c-4576-8f27-da0fe250f08c tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:30.597342 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-26287fa6-7e3c-4576-8f27-da0fe250f08c tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/af183467-9304-4c73-a29f-196e76ba21b5" status: 200 len: 1336 microversion: 2.1 time: 0.316092 Sep 14 08:51:30.598282 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 375/791] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:51:30 2022] GET /compute/v2.1/servers/af183467-9304-4c73-a29f-196e76ba21b5 => generated 1336 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:51:30.614801 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-3248f246-5509-4ca9-8ff8-e075efc6773d tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:51:30.616202 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-3248f246-5509-4ca9-8ff8-e075efc6773d tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] [instance: bf59291e-0a19-499b-a95b-a76d82b5e307] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:51:30.635208 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3248f246-5509-4ca9-8ff8-e075efc6773d tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:30.635959 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3248f246-5509-4ca9-8ff8-e075efc6773d tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:30.636649 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3248f246-5509-4ca9-8ff8-e075efc6773d tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:30.637575 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3248f246-5509-4ca9-8ff8-e075efc6773d tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:30.638237 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3248f246-5509-4ca9-8ff8-e075efc6773d tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:30.638868 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3248f246-5509-4ca9-8ff8-e075efc6773d tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:31.256894 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.objects.instance [None req-3248f246-5509-4ca9-8ff8-e075efc6773d tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Lazy-loading 'services' on Instance uuid bf59291e-0a19-499b-a95b-a76d82b5e307 {{(pid=128758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 08:51:31.291938 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-3248f246-5509-4ca9-8ff8-e075efc6773d tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/bf59291e-0a19-499b-a95b-a76d82b5e307" status: 200 len: 2053 microversion: 2.25 time: 0.689654 Sep 14 08:51:31.308798 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 376/792] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:51:30 2022] GET /compute/v2.1/servers/bf59291e-0a19-499b-a95b-a76d82b5e307 => generated 2053 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:51:31.321268 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-ef5ab0d3-7e6d-4620-9ff1-7542b6aea9a7 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:31.322292 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-468779e0-e48a-4596-8599-c9507604c20b req-04ac9c62-8b9e-47b8-9867-0db7f903d716 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc188404-0e98-4977-9283-5360293f19e4", "tag": "7f4ebc9e-5bd1-4dd1-a610-5d01c4399dae"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:51:31.334347 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-468779e0-e48a-4596-8599-c9507604c20b req-04ac9c62-8b9e-47b8-9867-0db7f903d716 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:31.334571 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-ef5ab0d3-7e6d-4620-9ff1-7542b6aea9a7 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/874205eb-5321-4a9a-aa38-3cd83b2ac1a3" status: 200 len: 1310 microversion: 2.1 time: 0.972725 Sep 14 08:51:31.335430 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 417/793] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:51:30 2022] GET /compute/v2.1/servers/874205eb-5321-4a9a-aa38-3cd83b2ac1a3 => generated 1310 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:51:31.336872 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-468779e0-e48a-4596-8599-c9507604c20b req-04ac9c62-8b9e-47b8-9867-0db7f903d716 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:31.337928 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-468779e0-e48a-4596-8599-c9507604c20b req-04ac9c62-8b9e-47b8-9867-0db7f903d716 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:31.348914 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-7127e51c-7f14-43dc-b8c1-25d02c2a6888 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:51:31.353814 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-7127e51c-7f14-43dc-b8c1-25d02c2a6888 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] [instance: bc188404-0e98-4977-9283-5360293f19e4] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:51:31.356762 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-468779e0-e48a-4596-8599-c9507604c20b req-04ac9c62-8b9e-47b8-9867-0db7f903d716 service nova] Creating event network-changed:7f4ebc9e-5bd1-4dd1-a610-5d01c4399dae for instance bc188404-0e98-4977-9283-5360293f19e4 on n-h2-836830-18 Sep 14 08:51:31.366694 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7127e51c-7f14-43dc-b8c1-25d02c2a6888 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:31.368775 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-468779e0-e48a-4596-8599-c9507604c20b req-04ac9c62-8b9e-47b8-9867-0db7f903d716 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058474 Sep 14 08:51:31.369730 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7127e51c-7f14-43dc-b8c1-25d02c2a6888 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:31.370887 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7127e51c-7f14-43dc-b8c1-25d02c2a6888 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:31.372600 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 377/794] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:51:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:51:31.373743 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7127e51c-7f14-43dc-b8c1-25d02c2a6888 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:31.375037 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7127e51c-7f14-43dc-b8c1-25d02c2a6888 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:31.377211 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7127e51c-7f14-43dc-b8c1-25d02c2a6888 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:31.387729 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b0bb0cdc-fe80-4d1e-ba09-a055932a064a tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:51:31.397502 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-b0bb0cdc-fe80-4d1e-ba09-a055932a064a tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] [instance: bf59291e-0a19-499b-a95b-a76d82b5e307] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:51:31.416574 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b0bb0cdc-fe80-4d1e-ba09-a055932a064a tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:31.418219 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b0bb0cdc-fe80-4d1e-ba09-a055932a064a tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:31.418693 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b0bb0cdc-fe80-4d1e-ba09-a055932a064a tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:31.419511 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b0bb0cdc-fe80-4d1e-ba09-a055932a064a tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:31.420112 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b0bb0cdc-fe80-4d1e-ba09-a055932a064a tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:31.423533 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b0bb0cdc-fe80-4d1e-ba09-a055932a064a tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:32.639574 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.objects.instance [None req-b0bb0cdc-fe80-4d1e-ba09-a055932a064a tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Lazy-loading 'services' on Instance uuid bf59291e-0a19-499b-a95b-a76d82b5e307 {{(pid=128758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 08:51:32.690557 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-b0bb0cdc-fe80-4d1e-ba09-a055932a064a tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/bf59291e-0a19-499b-a95b-a76d82b5e307" status: 200 len: 2053 microversion: 2.25 time: 1.316678 Sep 14 08:51:32.702894 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 378/795] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:51:31 2022] GET /compute/v2.1/servers/bf59291e-0a19-499b-a95b-a76d82b5e307 => generated 2053 bytes in 1330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:51:32.726925 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a53395bd-233e-479c-aeaa-f4689ffe386b tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:51:32.727893 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-a53395bd-233e-479c-aeaa-f4689ffe386b tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: af183467-9304-4c73-a29f-196e76ba21b5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:51:32.740506 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a53395bd-233e-479c-aeaa-f4689ffe386b tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:32.741008 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a53395bd-233e-479c-aeaa-f4689ffe386b tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:32.741451 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a53395bd-233e-479c-aeaa-f4689ffe386b tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:32.742726 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a53395bd-233e-479c-aeaa-f4689ffe386b tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:32.743440 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a53395bd-233e-479c-aeaa-f4689ffe386b tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:32.743877 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a53395bd-233e-479c-aeaa-f4689ffe386b tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:32.773885 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=100 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:51:32.851214 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-7127e51c-7f14-43dc-b8c1-25d02c2a6888 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c7802984cf48d1852832b52abe52e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e326f95a9604fdb9bd075db3837cf62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:32.862116 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-7127e51c-7f14-43dc-b8c1-25d02c2a6888 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] 10.222.0.60 "GET /compute/v2.1/servers/bc188404-0e98-4977-9283-5360293f19e4" status: 200 len: 1316 microversion: 2.1 time: 1.522760 Sep 14 08:51:32.868189 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 418/796] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:51:31 2022] GET /compute/v2.1/servers/bc188404-0e98-4977-9283-5360293f19e4 => generated 1316 bytes in 1532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:51:32.881330 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-2dbb60e5-141b-4340-95c7-a2a204eb6f8d tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:51:32.881952 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-2dbb60e5-141b-4340-95c7-a2a204eb6f8d tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: 874205eb-5321-4a9a-aa38-3cd83b2ac1a3] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:51:32.897586 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2dbb60e5-141b-4340-95c7-a2a204eb6f8d tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:32.898484 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2dbb60e5-141b-4340-95c7-a2a204eb6f8d tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:32.899118 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2dbb60e5-141b-4340-95c7-a2a204eb6f8d tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:32.900062 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2dbb60e5-141b-4340-95c7-a2a204eb6f8d tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:32.900695 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2dbb60e5-141b-4340-95c7-a2a204eb6f8d tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:32.901491 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2dbb60e5-141b-4340-95c7-a2a204eb6f8d tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:33.708644 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-2dbb60e5-141b-4340-95c7-a2a204eb6f8d tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:33.723751 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-2dbb60e5-141b-4340-95c7-a2a204eb6f8d tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/874205eb-5321-4a9a-aa38-3cd83b2ac1a3" status: 200 len: 1310 microversion: 2.1 time: 0.854687 Sep 14 08:51:33.724969 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 419/797] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:51:32 2022] GET /compute/v2.1/servers/874205eb-5321-4a9a-aa38-3cd83b2ac1a3 => generated 1310 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:51:33.734757 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d61e20a2-64f9-418f-b2ad-cee8754f8b46 tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:51:33.759149 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d61e20a2-64f9-418f-b2ad-cee8754f8b46 tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:33.760272 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d61e20a2-64f9-418f-b2ad-cee8754f8b46 tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:33.760975 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d61e20a2-64f9-418f-b2ad-cee8754f8b46 tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:33.762029 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d61e20a2-64f9-418f-b2ad-cee8754f8b46 tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:33.762735 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d61e20a2-64f9-418f-b2ad-cee8754f8b46 tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:33.763407 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d61e20a2-64f9-418f-b2ad-cee8754f8b46 tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:33.813860 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-a53395bd-233e-479c-aeaa-f4689ffe386b tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:33.814768 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d61e20a2-64f9-418f-b2ad-cee8754f8b46 tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.083851 Sep 14 08:51:33.825322 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 420/798] 10.222.0.60 () {60 vars in 1217 bytes} [Wed Sep 14 08:51:33 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 08:51:33.834690 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-a53395bd-233e-479c-aeaa-f4689ffe386b tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/af183467-9304-4c73-a29f-196e76ba21b5" status: 200 len: 1378 microversion: 2.1 time: 1.121109 Sep 14 08:51:33.837682 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-b5c63c0c-a8be-4a99-b8da-216df523eeb7 req-73ceea18-61f1-4f5c-a839-dfb0c65b507c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "874205eb-5321-4a9a-aa38-3cd83b2ac1a3", "name": "network-vif-plugged", "status": "completed", "tag": "629e6ee9-90f6-4562-b850-5f55a39582b9"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:51:33.841066 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 379/799] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:51:32 2022] GET /compute/v2.1/servers/af183467-9304-4c73-a29f-196e76ba21b5 => generated 1378 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:51:33.849174 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-92dff78b-04bb-4e95-a8bb-3525c954722b tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:51:33.852337 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-92dff78b-04bb-4e95-a8bb-3525c954722b tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] [instance: bf59291e-0a19-499b-a95b-a76d82b5e307] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:51:33.859503 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-b5c63c0c-a8be-4a99-b8da-216df523eeb7 req-73ceea18-61f1-4f5c-a839-dfb0c65b507c service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:33.860740 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-b5c63c0c-a8be-4a99-b8da-216df523eeb7 req-73ceea18-61f1-4f5c-a839-dfb0c65b507c service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:33.862419 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-b5c63c0c-a8be-4a99-b8da-216df523eeb7 req-73ceea18-61f1-4f5c-a839-dfb0c65b507c service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:33.870032 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-92dff78b-04bb-4e95-a8bb-3525c954722b tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:33.870805 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-92dff78b-04bb-4e95-a8bb-3525c954722b tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:33.871436 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-92dff78b-04bb-4e95-a8bb-3525c954722b tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:33.872435 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-92dff78b-04bb-4e95-a8bb-3525c954722b tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:33.889703 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-b5c63c0c-a8be-4a99-b8da-216df523eeb7 req-73ceea18-61f1-4f5c-a839-dfb0c65b507c service nova] Creating event network-vif-plugged:629e6ee9-90f6-4562-b850-5f55a39582b9 for instance 874205eb-5321-4a9a-aa38-3cd83b2ac1a3 on n-h1-836830-18 Sep 14 08:51:33.895706 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-92dff78b-04bb-4e95-a8bb-3525c954722b tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:33.896372 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-92dff78b-04bb-4e95-a8bb-3525c954722b tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:33.900340 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-b5c63c0c-a8be-4a99-b8da-216df523eeb7 req-73ceea18-61f1-4f5c-a839-dfb0c65b507c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073210 Sep 14 08:51:33.901050 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 421/800] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:51:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:51:33.910977 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a8679293-88e5-4bb6-b87c-ef43bc5437cc tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:51:33.916225 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-a8679293-88e5-4bb6-b87c-ef43bc5437cc tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] [instance: bc188404-0e98-4977-9283-5360293f19e4] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:51:33.928106 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a8679293-88e5-4bb6-b87c-ef43bc5437cc tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:33.930773 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a8679293-88e5-4bb6-b87c-ef43bc5437cc tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:33.931479 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a8679293-88e5-4bb6-b87c-ef43bc5437cc tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:33.933558 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a8679293-88e5-4bb6-b87c-ef43bc5437cc tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:33.938817 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a8679293-88e5-4bb6-b87c-ef43bc5437cc tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:33.939624 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a8679293-88e5-4bb6-b87c-ef43bc5437cc tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:34.046173 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-92dff78b-04bb-4e95-a8bb-3525c954722b tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/bf59291e-0a19-499b-a95b-a76d82b5e307/action" status: 202 len: 0 microversion: 2.25 time: 0.203147 Sep 14 08:51:34.047193 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 380/801] 10.222.0.60 () {62 vars in 1319 bytes} [Wed Sep 14 08:51:33 2022] POST /compute/v2.1/servers/bf59291e-0a19-499b-a95b-a76d82b5e307/action => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 14 08:51:34.060253 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-e743f825-59a1-46eb-8511-9b6466526cd4 tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:51:34.061310 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-e743f825-59a1-46eb-8511-9b6466526cd4 tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] [instance: bf59291e-0a19-499b-a95b-a76d82b5e307] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:51:34.082988 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e743f825-59a1-46eb-8511-9b6466526cd4 tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:34.088479 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e743f825-59a1-46eb-8511-9b6466526cd4 tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:34.089163 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e743f825-59a1-46eb-8511-9b6466526cd4 tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:34.113297 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e743f825-59a1-46eb-8511-9b6466526cd4 tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:34.116264 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e743f825-59a1-46eb-8511-9b6466526cd4 tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:34.116835 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e743f825-59a1-46eb-8511-9b6466526cd4 tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:34.675863 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-a8679293-88e5-4bb6-b87c-ef43bc5437cc tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c7802984cf48d1852832b52abe52e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e326f95a9604fdb9bd075db3837cf62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:34.695994 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a8679293-88e5-4bb6-b87c-ef43bc5437cc tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] 10.222.0.60 "GET /compute/v2.1/servers/bc188404-0e98-4977-9283-5360293f19e4" status: 200 len: 1316 microversion: 2.1 time: 0.790107 Sep 14 08:51:34.700080 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 422/802] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:51:33 2022] GET /compute/v2.1/servers/bc188404-0e98-4977-9283-5360293f19e4 => generated 1316 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:51:34.755163 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-207bf4e3-12d8-486b-bd6e-cdf225b9a774 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:51:34.756079 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-207bf4e3-12d8-486b-bd6e-cdf225b9a774 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: 874205eb-5321-4a9a-aa38-3cd83b2ac1a3] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:51:34.768717 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-207bf4e3-12d8-486b-bd6e-cdf225b9a774 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:34.770793 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-207bf4e3-12d8-486b-bd6e-cdf225b9a774 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:34.772129 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-207bf4e3-12d8-486b-bd6e-cdf225b9a774 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:34.775080 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-207bf4e3-12d8-486b-bd6e-cdf225b9a774 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:34.775976 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-207bf4e3-12d8-486b-bd6e-cdf225b9a774 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:34.778314 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-207bf4e3-12d8-486b-bd6e-cdf225b9a774 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:35.008717 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.objects.instance [None req-e743f825-59a1-46eb-8511-9b6466526cd4 tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Lazy-loading 'services' on Instance uuid bf59291e-0a19-499b-a95b-a76d82b5e307 {{(pid=128758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 08:51:35.035441 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-e743f825-59a1-46eb-8511-9b6466526cd4 tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/bf59291e-0a19-499b-a95b-a76d82b5e307" status: 200 len: 2058 microversion: 2.25 time: 0.980798 Sep 14 08:51:35.037144 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 381/803] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:51:34 2022] GET /compute/v2.1/servers/bf59291e-0a19-499b-a95b-a76d82b5e307 => generated 2058 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:51:35.045266 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a5a0c65f-17c7-40dd-9961-da5a2b85f30f tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:51:35.046410 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-a5a0c65f-17c7-40dd-9961-da5a2b85f30f tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: af183467-9304-4c73-a29f-196e76ba21b5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:51:35.053210 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a5a0c65f-17c7-40dd-9961-da5a2b85f30f tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:35.054006 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a5a0c65f-17c7-40dd-9961-da5a2b85f30f tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:35.056196 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a5a0c65f-17c7-40dd-9961-da5a2b85f30f tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:35.058047 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a5a0c65f-17c7-40dd-9961-da5a2b85f30f tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:35.059422 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a5a0c65f-17c7-40dd-9961-da5a2b85f30f tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:35.060500 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a5a0c65f-17c7-40dd-9961-da5a2b85f30f tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:35.125362 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-207bf4e3-12d8-486b-bd6e-cdf225b9a774 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:35.139872 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-207bf4e3-12d8-486b-bd6e-cdf225b9a774 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/874205eb-5321-4a9a-aa38-3cd83b2ac1a3" status: 200 len: 1310 microversion: 2.1 time: 0.390935 Sep 14 08:51:35.147588 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 423/804] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:51:34 2022] GET /compute/v2.1/servers/874205eb-5321-4a9a-aa38-3cd83b2ac1a3 => generated 1310 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:51:35.497822 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-a5a0c65f-17c7-40dd-9961-da5a2b85f30f tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:35.510050 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-a5a0c65f-17c7-40dd-9961-da5a2b85f30f tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/af183467-9304-4c73-a29f-196e76ba21b5" status: 200 len: 1378 microversion: 2.1 time: 0.470747 Sep 14 08:51:35.511001 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 382/805] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:51:35 2022] GET /compute/v2.1/servers/af183467-9304-4c73-a29f-196e76ba21b5 => generated 1378 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:51:35.723641 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b285b1db-6ca1-4132-87ab-45eb18f882de tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:51:35.724703 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b285b1db-6ca1-4132-87ab-45eb18f882de tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] [instance: bc188404-0e98-4977-9283-5360293f19e4] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:51:35.734917 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=14 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:51:35.741232 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b285b1db-6ca1-4132-87ab-45eb18f882de tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:35.741232 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b285b1db-6ca1-4132-87ab-45eb18f882de tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:35.741635 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b285b1db-6ca1-4132-87ab-45eb18f882de tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:35.742388 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b285b1db-6ca1-4132-87ab-45eb18f882de tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:35.742871 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b285b1db-6ca1-4132-87ab-45eb18f882de tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:35.747406 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b285b1db-6ca1-4132-87ab-45eb18f882de tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:36.067739 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-065bb2b7-aa6f-4366-8c5b-3b3d602a4bd1 tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:51:36.073865 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-065bb2b7-aa6f-4366-8c5b-3b3d602a4bd1 tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] [instance: bf59291e-0a19-499b-a95b-a76d82b5e307] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:51:36.083367 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=16 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:51:36.085720 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-065bb2b7-aa6f-4366-8c5b-3b3d602a4bd1 tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:36.087255 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-065bb2b7-aa6f-4366-8c5b-3b3d602a4bd1 tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:36.088252 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-065bb2b7-aa6f-4366-8c5b-3b3d602a4bd1 tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:36.089970 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-065bb2b7-aa6f-4366-8c5b-3b3d602a4bd1 tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:36.090734 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-065bb2b7-aa6f-4366-8c5b-3b3d602a4bd1 tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:36.091631 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-065bb2b7-aa6f-4366-8c5b-3b3d602a4bd1 tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:36.543154 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b285b1db-6ca1-4132-87ab-45eb18f882de tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c7802984cf48d1852832b52abe52e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e326f95a9604fdb9bd075db3837cf62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:36.552067 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b285b1db-6ca1-4132-87ab-45eb18f882de tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] 10.222.0.60 "GET /compute/v2.1/servers/bc188404-0e98-4977-9283-5360293f19e4" status: 200 len: 1316 microversion: 2.1 time: 0.834256 Sep 14 08:51:36.553376 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 424/806] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:51:35 2022] GET /compute/v2.1/servers/bc188404-0e98-4977-9283-5360293f19e4 => generated 1316 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:51:36.559137 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-74c34b41-cf17-428b-9d8e-166f277dc104 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:51:36.560025 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-74c34b41-cf17-428b-9d8e-166f277dc104 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: 874205eb-5321-4a9a-aa38-3cd83b2ac1a3] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:51:36.568082 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-74c34b41-cf17-428b-9d8e-166f277dc104 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:36.568965 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-74c34b41-cf17-428b-9d8e-166f277dc104 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:36.569729 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-74c34b41-cf17-428b-9d8e-166f277dc104 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:36.571602 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-74c34b41-cf17-428b-9d8e-166f277dc104 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:36.572302 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-74c34b41-cf17-428b-9d8e-166f277dc104 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:36.572998 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-74c34b41-cf17-428b-9d8e-166f277dc104 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:36.768307 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.objects.instance [None req-065bb2b7-aa6f-4366-8c5b-3b3d602a4bd1 tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Lazy-loading 'services' on Instance uuid bf59291e-0a19-499b-a95b-a76d82b5e307 {{(pid=128758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 08:51:36.788176 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-065bb2b7-aa6f-4366-8c5b-3b3d602a4bd1 tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/bf59291e-0a19-499b-a95b-a76d82b5e307" status: 200 len: 2038 microversion: 2.25 time: 0.726285 Sep 14 08:51:36.789042 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 383/807] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:51:36 2022] GET /compute/v2.1/servers/bf59291e-0a19-499b-a95b-a76d82b5e307 => generated 2038 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 08:51:36.794966 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-161fac56-012a-4f32-aa29-7b38f4a045a1 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:51:36.795615 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-161fac56-012a-4f32-aa29-7b38f4a045a1 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: af183467-9304-4c73-a29f-196e76ba21b5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:51:36.802882 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-161fac56-012a-4f32-aa29-7b38f4a045a1 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:36.804109 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-161fac56-012a-4f32-aa29-7b38f4a045a1 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:36.806172 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-161fac56-012a-4f32-aa29-7b38f4a045a1 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:36.807134 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-161fac56-012a-4f32-aa29-7b38f4a045a1 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:36.808275 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-161fac56-012a-4f32-aa29-7b38f4a045a1 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:36.808878 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-161fac56-012a-4f32-aa29-7b38f4a045a1 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:37.171248 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-74c34b41-cf17-428b-9d8e-166f277dc104 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:37.186646 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-74c34b41-cf17-428b-9d8e-166f277dc104 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/874205eb-5321-4a9a-aa38-3cd83b2ac1a3" status: 200 len: 1493 microversion: 2.1 time: 0.631882 Sep 14 08:51:37.194489 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 425/808] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:51:36 2022] GET /compute/v2.1/servers/874205eb-5321-4a9a-aa38-3cd83b2ac1a3 => generated 1493 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:51:37.201928 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-4de5f710-6366-4acc-93a5-44255c38e63e tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-836830-18", "block_migration": "auto"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:51:37.205370 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-4de5f710-6366-4acc-93a5-44255c38e63e tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] [instance: bf59291e-0a19-499b-a95b-a76d82b5e307] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:51:37.215529 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4de5f710-6366-4acc-93a5-44255c38e63e tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:37.217600 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4de5f710-6366-4acc-93a5-44255c38e63e tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:37.218348 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4de5f710-6366-4acc-93a5-44255c38e63e tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:37.219538 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4de5f710-6366-4acc-93a5-44255c38e63e tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:37.220222 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4de5f710-6366-4acc-93a5-44255c38e63e tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:37.221795 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4de5f710-6366-4acc-93a5-44255c38e63e tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:37.264286 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.objects.instance [None req-4de5f710-6366-4acc-93a5-44255c38e63e tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Lazy-loading 'flavor' on Instance uuid bf59291e-0a19-499b-a95b-a76d82b5e307 {{(pid=128759) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 08:51:37.294798 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-4de5f710-6366-4acc-93a5-44255c38e63e tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] [instance: bf59291e-0a19-499b-a95b-a76d82b5e307] Going to try to live migrate instance to n-h2-836830-18 {{(pid=128759) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 14 08:51:37.378237 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:51:37.383756 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-161fac56-012a-4f32-aa29-7b38f4a045a1 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:37.399405 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-161fac56-012a-4f32-aa29-7b38f4a045a1 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/af183467-9304-4c73-a29f-196e76ba21b5" status: 200 len: 1378 microversion: 2.1 time: 0.609065 Sep 14 08:51:37.400025 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 384/809] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:51:36 2022] GET /compute/v2.1/servers/af183467-9304-4c73-a29f-196e76ba21b5 => generated 1378 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:51:37.427784 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-9efb5cee-7379-4b37-937c-41006d85b343 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:51:37.432592 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-9efb5cee-7379-4b37-937c-41006d85b343 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] [instance: 874205eb-5321-4a9a-aa38-3cd83b2ac1a3] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:51:37.442802 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9efb5cee-7379-4b37-937c-41006d85b343 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:37.451465 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9efb5cee-7379-4b37-937c-41006d85b343 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:37.452588 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9efb5cee-7379-4b37-937c-41006d85b343 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:37.453678 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9efb5cee-7379-4b37-937c-41006d85b343 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:37.454345 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9efb5cee-7379-4b37-937c-41006d85b343 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:37.454979 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9efb5cee-7379-4b37-937c-41006d85b343 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:37.923854 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-9efb5cee-7379-4b37-937c-41006d85b343 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/874205eb-5321-4a9a-aa38-3cd83b2ac1a3" status: 200 len: 1646 microversion: 2.1 time: 0.499905 Sep 14 08:51:37.927724 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 385/810] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:51:37 2022] GET /compute/v2.1/servers/874205eb-5321-4a9a-aa38-3cd83b2ac1a3 => generated 1646 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:51:37.943270 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-d18b8f45-96c5-4c31-beb7-2c477f59b1f2 req-0e964acf-4e9d-4357-967e-13b9f70f79d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af183467-9304-4c73-a29f-196e76ba21b5", "tag": "9664d857-e4a0-4edd-b5e2-e3a3058cb696"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:51:37.958536 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-d18b8f45-96c5-4c31-beb7-2c477f59b1f2 req-0e964acf-4e9d-4357-967e-13b9f70f79d7 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:37.970347 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-d18b8f45-96c5-4c31-beb7-2c477f59b1f2 req-0e964acf-4e9d-4357-967e-13b9f70f79d7 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:37.971519 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-d18b8f45-96c5-4c31-beb7-2c477f59b1f2 req-0e964acf-4e9d-4357-967e-13b9f70f79d7 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:37.988358 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-d18b8f45-96c5-4c31-beb7-2c477f59b1f2 req-0e964acf-4e9d-4357-967e-13b9f70f79d7 service nova] Creating event network-changed:9664d857-e4a0-4edd-b5e2-e3a3058cb696 for instance af183467-9304-4c73-a29f-196e76ba21b5 on n-h1-836830-18 Sep 14 08:51:38.006719 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-d18b8f45-96c5-4c31-beb7-2c477f59b1f2 req-0e964acf-4e9d-4357-967e-13b9f70f79d7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074649 Sep 14 08:51:38.011850 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 386/811] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:51:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:51:38.029322 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-8baa64c4-750b-449e-a05c-05de09265c78 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:51:38.030288 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-8baa64c4-750b-449e-a05c-05de09265c78 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] [instance: bc188404-0e98-4977-9283-5360293f19e4] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:51:38.045526 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8baa64c4-750b-449e-a05c-05de09265c78 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:38.046034 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8baa64c4-750b-449e-a05c-05de09265c78 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:38.047426 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8baa64c4-750b-449e-a05c-05de09265c78 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:38.057269 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8baa64c4-750b-449e-a05c-05de09265c78 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:38.058001 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8baa64c4-750b-449e-a05c-05de09265c78 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:38.059971 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8baa64c4-750b-449e-a05c-05de09265c78 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:38.825308 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-8baa64c4-750b-449e-a05c-05de09265c78 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c7802984cf48d1852832b52abe52e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e326f95a9604fdb9bd075db3837cf62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:38.838371 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-8baa64c4-750b-449e-a05c-05de09265c78 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] 10.222.0.60 "GET /compute/v2.1/servers/bc188404-0e98-4977-9283-5360293f19e4" status: 200 len: 1316 microversion: 2.1 time: 0.818552 Sep 14 08:51:38.853307 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 387/812] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:51:38 2022] GET /compute/v2.1/servers/bc188404-0e98-4977-9283-5360293f19e4 => generated 1316 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:51:38.853307 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-4fa2b967-f22d-4658-950c-03012fbed6d7 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:51:38.853307 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-4fa2b967-f22d-4658-950c-03012fbed6d7 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] [instance: 874205eb-5321-4a9a-aa38-3cd83b2ac1a3] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:51:38.853307 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4fa2b967-f22d-4658-950c-03012fbed6d7 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:38.853307 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4fa2b967-f22d-4658-950c-03012fbed6d7 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:38.853756 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4fa2b967-f22d-4658-950c-03012fbed6d7 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:38.853756 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4fa2b967-f22d-4658-950c-03012fbed6d7 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:38.853756 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4fa2b967-f22d-4658-950c-03012fbed6d7 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:38.853756 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4fa2b967-f22d-4658-950c-03012fbed6d7 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:39.375610 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-4fa2b967-f22d-4658-950c-03012fbed6d7 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/874205eb-5321-4a9a-aa38-3cd83b2ac1a3" status: 200 len: 1646 microversion: 2.1 time: 0.535540 Sep 14 08:51:39.378504 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 388/813] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:51:38 2022] GET /compute/v2.1/servers/874205eb-5321-4a9a-aa38-3cd83b2ac1a3 => generated 1646 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:51:39.391619 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-fb1ab94b-abc1-49fa-891f-357227f84bc1 req-68f78255-736c-4f26-af98-9cac16ca6e21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc188404-0e98-4977-9283-5360293f19e4", "name": "network-vif-plugged", "status": "completed", "tag": "7f4ebc9e-5bd1-4dd1-a610-5d01c4399dae"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:51:39.415054 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-fb1ab94b-abc1-49fa-891f-357227f84bc1 req-68f78255-736c-4f26-af98-9cac16ca6e21 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:39.415724 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-fb1ab94b-abc1-49fa-891f-357227f84bc1 req-68f78255-736c-4f26-af98-9cac16ca6e21 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:39.416282 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-fb1ab94b-abc1-49fa-891f-357227f84bc1 req-68f78255-736c-4f26-af98-9cac16ca6e21 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:39.442358 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-fb1ab94b-abc1-49fa-891f-357227f84bc1 req-68f78255-736c-4f26-af98-9cac16ca6e21 service nova] Creating event network-vif-plugged:7f4ebc9e-5bd1-4dd1-a610-5d01c4399dae for instance bc188404-0e98-4977-9283-5360293f19e4 on n-h2-836830-18 Sep 14 08:51:39.460255 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-fb1ab94b-abc1-49fa-891f-357227f84bc1 req-68f78255-736c-4f26-af98-9cac16ca6e21 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075740 Sep 14 08:51:39.461741 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 389/814] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:51:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:51:39.475543 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-31c66c3b-a6cd-418d-a605-f61266e141e3 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:51:39.477140 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-31c66c3b-a6cd-418d-a605-f61266e141e3 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: af183467-9304-4c73-a29f-196e76ba21b5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:51:39.491453 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-31c66c3b-a6cd-418d-a605-f61266e141e3 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:39.493559 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-31c66c3b-a6cd-418d-a605-f61266e141e3 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:39.494040 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-31c66c3b-a6cd-418d-a605-f61266e141e3 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:39.495421 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-31c66c3b-a6cd-418d-a605-f61266e141e3 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:39.495905 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-31c66c3b-a6cd-418d-a605-f61266e141e3 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:39.497696 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-31c66c3b-a6cd-418d-a605-f61266e141e3 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:39.573785 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-4de5f710-6366-4acc-93a5-44255c38e63e tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/bf59291e-0a19-499b-a95b-a76d82b5e307/action" status: 202 len: 0 microversion: 2.25 time: 2.370991 Sep 14 08:51:39.575301 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 426/815] 10.222.0.60 () {62 vars in 1319 bytes} [Wed Sep 14 08:51:37 2022] POST /compute/v2.1/servers/bf59291e-0a19-499b-a95b-a76d82b5e307/action => generated 0 bytes in 2379 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 14 08:51:39.585418 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-4351c604-9db9-4e94-84c2-a5da71a9767a tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:51:39.597453 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4351c604-9db9-4e94-84c2-a5da71a9767a tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:39.597997 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4351c604-9db9-4e94-84c2-a5da71a9767a tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:39.598414 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4351c604-9db9-4e94-84c2-a5da71a9767a tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:39.604299 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4351c604-9db9-4e94-84c2-a5da71a9767a tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:39.604801 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4351c604-9db9-4e94-84c2-a5da71a9767a tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:39.611523 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4351c604-9db9-4e94-84c2-a5da71a9767a tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:39.651924 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-4351c604-9db9-4e94-84c2-a5da71a9767a tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.071884 Sep 14 08:51:39.652533 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 427/816] 10.222.0.60 () {58 vars in 1176 bytes} [Wed Sep 14 08:51:39 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:51:39.667951 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-7fae40bb-76fc-4f87-bf42-1d5179064dc8 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:51:39.668418 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-7fae40bb-76fc-4f87-bf42-1d5179064dc8 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: bf59291e-0a19-499b-a95b-a76d82b5e307] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:51:39.676062 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7fae40bb-76fc-4f87-bf42-1d5179064dc8 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:39.676563 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7fae40bb-76fc-4f87-bf42-1d5179064dc8 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:39.677016 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7fae40bb-76fc-4f87-bf42-1d5179064dc8 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:39.677737 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7fae40bb-76fc-4f87-bf42-1d5179064dc8 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:39.678197 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7fae40bb-76fc-4f87-bf42-1d5179064dc8 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:39.679340 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7fae40bb-76fc-4f87-bf42-1d5179064dc8 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:39.980617 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-31c66c3b-a6cd-418d-a605-f61266e141e3 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:39.990157 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-31c66c3b-a6cd-418d-a605-f61266e141e3 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/af183467-9304-4c73-a29f-196e76ba21b5" status: 200 len: 1378 microversion: 2.1 time: 0.526896 Sep 14 08:51:39.994513 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 390/817] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:51:39 2022] GET /compute/v2.1/servers/af183467-9304-4c73-a29f-196e76ba21b5 => generated 1378 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:51:40.005703 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-6940c0bc-96da-420d-af5b-b060828032f2 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:51:40.011642 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-6940c0bc-96da-420d-af5b-b060828032f2 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] [instance: 874205eb-5321-4a9a-aa38-3cd83b2ac1a3] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:51:40.027885 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6940c0bc-96da-420d-af5b-b060828032f2 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:40.031353 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6940c0bc-96da-420d-af5b-b060828032f2 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:40.032764 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6940c0bc-96da-420d-af5b-b060828032f2 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:40.035734 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6940c0bc-96da-420d-af5b-b060828032f2 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:40.041781 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6940c0bc-96da-420d-af5b-b060828032f2 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:40.042615 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6940c0bc-96da-420d-af5b-b060828032f2 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:40.069781 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-7fae40bb-76fc-4f87-bf42-1d5179064dc8 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:40.083836 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-7fae40bb-76fc-4f87-bf42-1d5179064dc8 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:40.085326 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-7fae40bb-76fc-4f87-bf42-1d5179064dc8 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:40.090824 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-7fae40bb-76fc-4f87-bf42-1d5179064dc8 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/bf59291e-0a19-499b-a95b-a76d82b5e307" status: 200 len: 1568 microversion: 2.25 time: 0.428969 Sep 14 08:51:40.112833 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 428/818] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:51:39 2022] GET /compute/v2.1/servers/bf59291e-0a19-499b-a95b-a76d82b5e307 => generated 1568 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:51:40.123087 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8c0fd8ed-642f-4fcc-bd4b-617e44bd9b2c tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:51:40.133526 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-8c0fd8ed-642f-4fcc-bd4b-617e44bd9b2c tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] [instance: bc188404-0e98-4977-9283-5360293f19e4] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:51:40.160664 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8c0fd8ed-642f-4fcc-bd4b-617e44bd9b2c tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:40.167516 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8c0fd8ed-642f-4fcc-bd4b-617e44bd9b2c tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:40.171657 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8c0fd8ed-642f-4fcc-bd4b-617e44bd9b2c tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:40.172598 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8c0fd8ed-642f-4fcc-bd4b-617e44bd9b2c tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:40.174107 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8c0fd8ed-642f-4fcc-bd4b-617e44bd9b2c tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:40.176479 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8c0fd8ed-642f-4fcc-bd4b-617e44bd9b2c tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:40.261989 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-6940c0bc-96da-420d-af5b-b060828032f2 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/874205eb-5321-4a9a-aa38-3cd83b2ac1a3/action" status: 202 len: 0 microversion: 2.1 time: 0.264928 Sep 14 08:51:40.262667 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 391/819] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 08:51:39 2022] POST /compute/v2.1/servers/874205eb-5321-4a9a-aa38-3cd83b2ac1a3/action => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 08:51:40.277671 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c8bf9e16-60f0-4c92-a898-c0768df09871 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:51:40.279403 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-c8bf9e16-60f0-4c92-a898-c0768df09871 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] [instance: 874205eb-5321-4a9a-aa38-3cd83b2ac1a3] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:51:40.293634 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c8bf9e16-60f0-4c92-a898-c0768df09871 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:40.303705 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c8bf9e16-60f0-4c92-a898-c0768df09871 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:40.304160 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c8bf9e16-60f0-4c92-a898-c0768df09871 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:40.305838 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c8bf9e16-60f0-4c92-a898-c0768df09871 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:40.306302 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c8bf9e16-60f0-4c92-a898-c0768df09871 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:40.306733 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c8bf9e16-60f0-4c92-a898-c0768df09871 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:40.623472 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-c8bf9e16-60f0-4c92-a898-c0768df09871 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/874205eb-5321-4a9a-aa38-3cd83b2ac1a3" status: 200 len: 1651 microversion: 2.1 time: 0.355725 Sep 14 08:51:40.624693 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 392/820] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:51:40 2022] GET /compute/v2.1/servers/874205eb-5321-4a9a-aa38-3cd83b2ac1a3 => generated 1651 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:51:40.746365 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-8c0fd8ed-642f-4fcc-bd4b-617e44bd9b2c tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c7802984cf48d1852832b52abe52e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e326f95a9604fdb9bd075db3837cf62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:40.754931 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-8c0fd8ed-642f-4fcc-bd4b-617e44bd9b2c tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] 10.222.0.60 "GET /compute/v2.1/servers/bc188404-0e98-4977-9283-5360293f19e4" status: 200 len: 1316 microversion: 2.1 time: 0.636503 Sep 14 08:51:40.756697 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 429/821] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:51:40 2022] GET /compute/v2.1/servers/bc188404-0e98-4977-9283-5360293f19e4 => generated 1316 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:51:40.885735 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-e0315fd4-42f6-45a7-8514-06c955ce6098 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-2042731392", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "networks": [{"uuid": "9515e95c-a943-42ca-9feb-b6086ababa8f"}]}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:51:40.985803 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.network.neutron [None req-e0315fd4-42f6-45a7-8514-06c955ce6098 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] validate_networks() for [('9515e95c-a943-42ca-9feb-b6086ababa8f', None, None, None, None, None)] {{(pid=128758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 08:51:41.022104 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-04cbceb7-08e5-469f-bbbb-e3be77daa7e5 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:51:41.022727 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-04cbceb7-08e5-469f-bbbb-e3be77daa7e5 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: af183467-9304-4c73-a29f-196e76ba21b5] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:51:41.032461 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-04cbceb7-08e5-469f-bbbb-e3be77daa7e5 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:41.035466 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-04cbceb7-08e5-469f-bbbb-e3be77daa7e5 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:41.037186 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-04cbceb7-08e5-469f-bbbb-e3be77daa7e5 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:41.038306 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-04cbceb7-08e5-469f-bbbb-e3be77daa7e5 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:41.040581 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-04cbceb7-08e5-469f-bbbb-e3be77daa7e5 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:41.042050 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-04cbceb7-08e5-469f-bbbb-e3be77daa7e5 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:41.418229 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-04cbceb7-08e5-469f-bbbb-e3be77daa7e5 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:41.427958 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-04cbceb7-08e5-469f-bbbb-e3be77daa7e5 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/af183467-9304-4c73-a29f-196e76ba21b5" status: 200 len: 1378 microversion: 2.1 time: 0.409592 Sep 14 08:51:41.441554 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 430/822] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:51:41 2022] GET /compute/v2.1/servers/af183467-9304-4c73-a29f-196e76ba21b5 => generated 1378 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:51:41.447474 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-5c88a919-5b6c-42f6-b5e1-1b0b6b1e8b07 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:51:41.453509 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-5c88a919-5b6c-42f6-b5e1-1b0b6b1e8b07 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: bf59291e-0a19-499b-a95b-a76d82b5e307] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:51:41.469354 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5c88a919-5b6c-42f6-b5e1-1b0b6b1e8b07 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:41.469777 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5c88a919-5b6c-42f6-b5e1-1b0b6b1e8b07 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:41.470220 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5c88a919-5b6c-42f6-b5e1-1b0b6b1e8b07 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:41.470931 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5c88a919-5b6c-42f6-b5e1-1b0b6b1e8b07 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:41.471413 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5c88a919-5b6c-42f6-b5e1-1b0b6b1e8b07 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:41.471844 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5c88a919-5b6c-42f6-b5e1-1b0b6b1e8b07 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:42.153798 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-5c88a919-5b6c-42f6-b5e1-1b0b6b1e8b07 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:42.175857 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-5c88a919-5b6c-42f6-b5e1-1b0b6b1e8b07 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:42.177277 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-5c88a919-5b6c-42f6-b5e1-1b0b6b1e8b07 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:42.178480 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-5c88a919-5b6c-42f6-b5e1-1b0b6b1e8b07 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/bf59291e-0a19-499b-a95b-a76d82b5e307" status: 200 len: 1568 microversion: 2.25 time: 0.735583 Sep 14 08:51:42.186075 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 431/823] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:51:41 2022] GET /compute/v2.1/servers/bf59291e-0a19-499b-a95b-a76d82b5e307 => generated 1568 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:51:42.198161 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-1a523f1a-39eb-44a7-9cfa-0b4fc6dff8e4 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:51:42.198795 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-1a523f1a-39eb-44a7-9cfa-0b4fc6dff8e4 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] [instance: 874205eb-5321-4a9a-aa38-3cd83b2ac1a3] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:51:42.232795 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1a523f1a-39eb-44a7-9cfa-0b4fc6dff8e4 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:42.234477 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1a523f1a-39eb-44a7-9cfa-0b4fc6dff8e4 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:42.234477 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1a523f1a-39eb-44a7-9cfa-0b4fc6dff8e4 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:42.235345 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1a523f1a-39eb-44a7-9cfa-0b4fc6dff8e4 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:42.236592 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1a523f1a-39eb-44a7-9cfa-0b4fc6dff8e4 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:42.236592 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1a523f1a-39eb-44a7-9cfa-0b4fc6dff8e4 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:42.937174 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-e0315fd4-42f6-45a7-8514-06c955ce6098 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Flavor limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 08:51:42.937689 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-e0315fd4-42f6-45a7-8514-06c955ce6098 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Image limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 08:51:42.938117 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-e0315fd4-42f6-45a7-8514-06c955ce6098 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Flavor pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 08:51:42.938818 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-e0315fd4-42f6-45a7-8514-06c955ce6098 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Image pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 08:51:42.940189 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-e0315fd4-42f6-45a7-8514-06c955ce6098 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 08:51:42.959951 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e0315fd4-42f6-45a7-8514-06c955ce6098 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:42.962959 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e0315fd4-42f6-45a7-8514-06c955ce6098 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:42.963604 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e0315fd4-42f6-45a7-8514-06c955ce6098 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:42.965235 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e0315fd4-42f6-45a7-8514-06c955ce6098 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:42.968250 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e0315fd4-42f6-45a7-8514-06c955ce6098 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:42.970166 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e0315fd4-42f6-45a7-8514-06c955ce6098 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:43.029505 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-e0315fd4-42f6-45a7-8514-06c955ce6098 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Getting quotas for project aac1cc0aa271432d9b256569e220fc75. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 08:51:43.038962 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-e0315fd4-42f6-45a7-8514-06c955ce6098 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Getting quotas for user be69c6b130994b87b32fe1b50916b500 and project aac1cc0aa271432d9b256569e220fc75. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 08:51:43.072906 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-e0315fd4-42f6-45a7-8514-06c955ce6098 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Going to run 1 instances... {{(pid=128758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 08:51:43.076347 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-e0315fd4-42f6-45a7-8514-06c955ce6098 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] [instance: 3d2d7f4d-e204-42c4-b977-63119c1b8783] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 08:51:43.152284 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-e0315fd4-42f6-45a7-8514-06c955ce6098 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.525585 Sep 14 08:51:43.153807 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 393/824] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 08:51:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 2528 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 08:51:43.159096 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-19938415-c97c-4112-9983-2969712b34a0 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:51:43.159963 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-19938415-c97c-4112-9983-2969712b34a0 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] [instance: bc188404-0e98-4977-9283-5360293f19e4] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:51:43.167725 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-19938415-c97c-4112-9983-2969712b34a0 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:43.168455 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-19938415-c97c-4112-9983-2969712b34a0 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:43.169068 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-19938415-c97c-4112-9983-2969712b34a0 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:43.169997 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-19938415-c97c-4112-9983-2969712b34a0 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:43.170609 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-19938415-c97c-4112-9983-2969712b34a0 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:43.171263 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-19938415-c97c-4112-9983-2969712b34a0 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:43.393238 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-1a523f1a-39eb-44a7-9cfa-0b4fc6dff8e4 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/874205eb-5321-4a9a-aa38-3cd83b2ac1a3" status: 200 len: 1631 microversion: 2.1 time: 1.203729 Sep 14 08:51:43.403236 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 432/825] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:51:42 2022] GET /compute/v2.1/servers/874205eb-5321-4a9a-aa38-3cd83b2ac1a3 => generated 1631 bytes in 1216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:51:43.424139 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d14ecabe-3737-4c31-8b7c-87ddc5610bd6 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:51:43.425508 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-d14ecabe-3737-4c31-8b7c-87ddc5610bd6 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: af183467-9304-4c73-a29f-196e76ba21b5] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:51:43.471109 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d14ecabe-3737-4c31-8b7c-87ddc5610bd6 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:43.471803 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d14ecabe-3737-4c31-8b7c-87ddc5610bd6 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:43.472333 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d14ecabe-3737-4c31-8b7c-87ddc5610bd6 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:43.473492 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d14ecabe-3737-4c31-8b7c-87ddc5610bd6 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:43.476344 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d14ecabe-3737-4c31-8b7c-87ddc5610bd6 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:43.476344 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d14ecabe-3737-4c31-8b7c-87ddc5610bd6 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:44.115522 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-19938415-c97c-4112-9983-2969712b34a0 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c7802984cf48d1852832b52abe52e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e326f95a9604fdb9bd075db3837cf62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:44.135994 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-19938415-c97c-4112-9983-2969712b34a0 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] 10.222.0.60 "GET /compute/v2.1/servers/bc188404-0e98-4977-9283-5360293f19e4" status: 200 len: 1465 microversion: 2.1 time: 0.980403 Sep 14 08:51:44.151700 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 394/826] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:51:43 2022] GET /compute/v2.1/servers/bc188404-0e98-4977-9283-5360293f19e4 => generated 1465 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:51:44.188755 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-bfda2cd0-c227-4002-836f-44e73f767d15 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:51:44.189386 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-bfda2cd0-c227-4002-836f-44e73f767d15 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] [instance: 3d2d7f4d-e204-42c4-b977-63119c1b8783] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:51:44.214380 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bfda2cd0-c227-4002-836f-44e73f767d15 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:44.215489 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bfda2cd0-c227-4002-836f-44e73f767d15 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:44.216177 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bfda2cd0-c227-4002-836f-44e73f767d15 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:44.217206 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bfda2cd0-c227-4002-836f-44e73f767d15 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:44.218643 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bfda2cd0-c227-4002-836f-44e73f767d15 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:44.220380 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bfda2cd0-c227-4002-836f-44e73f767d15 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:44.301679 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:51:45.007035 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-d14ecabe-3737-4c31-8b7c-87ddc5610bd6 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:45.016849 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d14ecabe-3737-4c31-8b7c-87ddc5610bd6 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/af183467-9304-4c73-a29f-196e76ba21b5" status: 200 len: 1378 microversion: 2.1 time: 1.612388 Sep 14 08:51:45.017785 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 433/827] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:51:43 2022] GET /compute/v2.1/servers/af183467-9304-4c73-a29f-196e76ba21b5 => generated 1378 bytes in 1614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:51:45.023681 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9da7b9d8-c858-4ff4-9348-a868bf0a6b72 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:51:45.024520 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-9da7b9d8-c858-4ff4-9348-a868bf0a6b72 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: bf59291e-0a19-499b-a95b-a76d82b5e307] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:51:45.031246 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9da7b9d8-c858-4ff4-9348-a868bf0a6b72 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:45.032062 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9da7b9d8-c858-4ff4-9348-a868bf0a6b72 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:45.032727 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9da7b9d8-c858-4ff4-9348-a868bf0a6b72 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:45.033845 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9da7b9d8-c858-4ff4-9348-a868bf0a6b72 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:45.038236 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9da7b9d8-c858-4ff4-9348-a868bf0a6b72 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:45.039027 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9da7b9d8-c858-4ff4-9348-a868bf0a6b72 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:45.073586 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-bfda2cd0-c227-4002-836f-44e73f767d15 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be69c6b130994b87b32fe1b50916b500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac1cc0aa271432d9b256569e220fc75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:45.086836 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-bfda2cd0-c227-4002-836f-44e73f767d15 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] 10.222.0.60 "GET /compute/v2.1/servers/3d2d7f4d-e204-42c4-b977-63119c1b8783" status: 200 len: 1220 microversion: 2.1 time: 0.931456 Sep 14 08:51:45.087625 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 395/828] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:51:44 2022] GET /compute/v2.1/servers/3d2d7f4d-e204-42c4-b977-63119c1b8783 => generated 1220 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:51:45.096977 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ab3d9ea2-6930-4a1a-9a39-7afe4c82c4d3 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-836830-18", "block_migration": true, "disk_over_commit": false}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:51:45.103953 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-ab3d9ea2-6930-4a1a-9a39-7afe4c82c4d3 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] [instance: 874205eb-5321-4a9a-aa38-3cd83b2ac1a3] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:51:45.116534 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:51:45.129163 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ab3d9ea2-6930-4a1a-9a39-7afe4c82c4d3 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:45.136213 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ab3d9ea2-6930-4a1a-9a39-7afe4c82c4d3 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:45.142381 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ab3d9ea2-6930-4a1a-9a39-7afe4c82c4d3 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:45.143348 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ab3d9ea2-6930-4a1a-9a39-7afe4c82c4d3 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:45.143948 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ab3d9ea2-6930-4a1a-9a39-7afe4c82c4d3 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:45.144513 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ab3d9ea2-6930-4a1a-9a39-7afe4c82c4d3 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:45.365017 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.objects.instance [None req-ab3d9ea2-6930-4a1a-9a39-7afe4c82c4d3 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Lazy-loading 'flavor' on Instance uuid 874205eb-5321-4a9a-aa38-3cd83b2ac1a3 {{(pid=128758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 08:51:45.392843 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-ab3d9ea2-6930-4a1a-9a39-7afe4c82c4d3 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] [instance: 874205eb-5321-4a9a-aa38-3cd83b2ac1a3] Going to try to live migrate instance to n-h2-836830-18 {{(pid=128758) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 14 08:51:45.741693 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-9da7b9d8-c858-4ff4-9348-a868bf0a6b72 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:45.762881 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-9da7b9d8-c858-4ff4-9348-a868bf0a6b72 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:45.766209 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-9da7b9d8-c858-4ff4-9348-a868bf0a6b72 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:45.769139 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-9da7b9d8-c858-4ff4-9348-a868bf0a6b72 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/bf59291e-0a19-499b-a95b-a76d82b5e307" status: 200 len: 1568 microversion: 2.25 time: 0.749169 Sep 14 08:51:45.770201 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 434/829] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:51:45 2022] GET /compute/v2.1/servers/bf59291e-0a19-499b-a95b-a76d82b5e307 => generated 1568 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:51:45.785567 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b1b56352-e009-4ecd-a8f8-5d2690d0820d tempest-ServersOnMultiNodesTest-1008135845 tempest-ServersOnMultiNodesTest-1008135845-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:51:45.788917 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b1b56352-e009-4ecd-a8f8-5d2690d0820d tempest-ServersOnMultiNodesTest-1008135845 tempest-ServersOnMultiNodesTest-1008135845-project-admin] [instance: bc188404-0e98-4977-9283-5360293f19e4] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:51:45.825481 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b1b56352-e009-4ecd-a8f8-5d2690d0820d tempest-ServersOnMultiNodesTest-1008135845 tempest-ServersOnMultiNodesTest-1008135845-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:45.827279 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b1b56352-e009-4ecd-a8f8-5d2690d0820d tempest-ServersOnMultiNodesTest-1008135845 tempest-ServersOnMultiNodesTest-1008135845-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:45.827961 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b1b56352-e009-4ecd-a8f8-5d2690d0820d tempest-ServersOnMultiNodesTest-1008135845 tempest-ServersOnMultiNodesTest-1008135845-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:45.829058 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b1b56352-e009-4ecd-a8f8-5d2690d0820d tempest-ServersOnMultiNodesTest-1008135845 tempest-ServersOnMultiNodesTest-1008135845-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:45.830715 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b1b56352-e009-4ecd-a8f8-5d2690d0820d tempest-ServersOnMultiNodesTest-1008135845 tempest-ServersOnMultiNodesTest-1008135845-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:45.831430 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b1b56352-e009-4ecd-a8f8-5d2690d0820d tempest-ServersOnMultiNodesTest-1008135845 tempest-ServersOnMultiNodesTest-1008135845-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:46.224948 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b1b56352-e009-4ecd-a8f8-5d2690d0820d tempest-ServersOnMultiNodesTest-1008135845 tempest-ServersOnMultiNodesTest-1008135845-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/bc188404-0e98-4977-9283-5360293f19e4" status: 200 len: 1618 microversion: 2.1 time: 0.452411 Sep 14 08:51:46.225980 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 435/830] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:51:45 2022] GET /compute/v2.1/servers/bc188404-0e98-4977-9283-5360293f19e4 => generated 1618 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:51:46.232366 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9220b2af-4ee4-4c0f-ab04-18f9a9b02aad tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:51:46.232927 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-9220b2af-4ee4-4c0f-ab04-18f9a9b02aad tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] [instance: 2d2c444a-e84e-40c5-aec1-375cd14f67c8] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:51:46.263659 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9220b2af-4ee4-4c0f-ab04-18f9a9b02aad tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:46.264030 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9220b2af-4ee4-4c0f-ab04-18f9a9b02aad tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:46.269091 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9220b2af-4ee4-4c0f-ab04-18f9a9b02aad tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:46.269982 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9220b2af-4ee4-4c0f-ab04-18f9a9b02aad tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:46.271622 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9220b2af-4ee4-4c0f-ab04-18f9a9b02aad tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:46.273305 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9220b2af-4ee4-4c0f-ab04-18f9a9b02aad tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:46.343347 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-9220b2af-4ee4-4c0f-ab04-18f9a9b02aad tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] [instance: 2d2c444a-e84e-40c5-aec1-375cd14f67c8] Going to try to terminate instance {{(pid=128759) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 08:51:46.470586 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:51:46.477073 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-9220b2af-4ee4-4c0f-ab04-18f9a9b02aad tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] 10.222.0.60 "DELETE /compute/v2.1/servers/2d2c444a-e84e-40c5-aec1-375cd14f67c8" status: 204 len: 0 microversion: 2.1 time: 0.249557 Sep 14 08:51:46.478356 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 436/831] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 08:51:46 2022] DELETE /compute/v2.1/servers/2d2c444a-e84e-40c5-aec1-375cd14f67c8 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 08:51:46.549870 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9f1b625d-73c1-484c-9529-ec75b83b5219 tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Action: 'create', calling method: .version_select at 0x7f7d44c4cee0>, body: {"keypair": {"name": "tempest-keypair-85366435", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOa0zWB8P32Y2oJFOqdATTlI4qinQntTUnZOJj9IXjToZRjzy7RFyf8csDqlBPlxcGCURBA2aed+6EkIGoVMwnUvuIRBgVenC6rZ4TMURA3zs8vOBGWMKefngG2HEk2xEg=="}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:51:46.568065 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-9f1b625d-73c1-484c-9529-ec75b83b5219 tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Getting quotas for project 38a515fd540744a2bdf6fb971f4a6924. Resources: {'key_pairs'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 08:51:46.574401 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-9f1b625d-73c1-484c-9529-ec75b83b5219 tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Getting quotas for user aeaac454f233408ba1597b36bb9277dc and project 38a515fd540744a2bdf6fb971f4a6924. Resources: {'key_pairs'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 08:51:46.608576 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-9f1b625d-73c1-484c-9529-ec75b83b5219 tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.126552 Sep 14 08:51:46.611104 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 437/832] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Sep 14 08:51:46 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:51:46.638686 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-fe46bd5e-edfa-4bdb-a5e2-c19ae7edd5da req-22d22c94-8b63-41f6-bbfd-f403e811861e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf59291e-0a19-499b-a95b-a76d82b5e307", "name": "network-vif-unplugged", "status": "completed", "tag": "f8233fbd-017c-41f3-ac0a-d6c9e916d35e"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:51:46.657395 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-fe46bd5e-edfa-4bdb-a5e2-c19ae7edd5da req-22d22c94-8b63-41f6-bbfd-f403e811861e service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:46.658870 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-fe46bd5e-edfa-4bdb-a5e2-c19ae7edd5da req-22d22c94-8b63-41f6-bbfd-f403e811861e service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:46.659924 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-fe46bd5e-edfa-4bdb-a5e2-c19ae7edd5da req-22d22c94-8b63-41f6-bbfd-f403e811861e service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:46.676523 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-fe46bd5e-edfa-4bdb-a5e2-c19ae7edd5da req-22d22c94-8b63-41f6-bbfd-f403e811861e service nova] Creating event network-vif-unplugged:f8233fbd-017c-41f3-ac0a-d6c9e916d35e for instance bf59291e-0a19-499b-a95b-a76d82b5e307 on n-h1-836830-18 Sep 14 08:51:46.683841 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-fe46bd5e-edfa-4bdb-a5e2-c19ae7edd5da req-22d22c94-8b63-41f6-bbfd-f403e811861e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.068286 Sep 14 08:51:46.684821 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 438/833] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:51:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:51:46.690409 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-e3d73e4b-2a26-468c-a237-69be503a07e0 req-4faad291-ab94-4227-aeb4-e12f32d219c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af183467-9304-4c73-a29f-196e76ba21b5", "name": "network-vif-plugged", "status": "completed", "tag": "9664d857-e4a0-4edd-b5e2-e3a3058cb696"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:51:46.703149 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-e3d73e4b-2a26-468c-a237-69be503a07e0 req-4faad291-ab94-4227-aeb4-e12f32d219c5 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:46.703962 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-e3d73e4b-2a26-468c-a237-69be503a07e0 req-4faad291-ab94-4227-aeb4-e12f32d219c5 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:46.704645 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-e3d73e4b-2a26-468c-a237-69be503a07e0 req-4faad291-ab94-4227-aeb4-e12f32d219c5 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:46.721643 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-e3d73e4b-2a26-468c-a237-69be503a07e0 req-4faad291-ab94-4227-aeb4-e12f32d219c5 service nova] Creating event network-vif-plugged:9664d857-e4a0-4edd-b5e2-e3a3058cb696 for instance af183467-9304-4c73-a29f-196e76ba21b5 on n-h1-836830-18 Sep 14 08:51:46.730061 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-e3d73e4b-2a26-468c-a237-69be503a07e0 req-4faad291-ab94-4227-aeb4-e12f32d219c5 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043512 Sep 14 08:51:46.731337 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 439/834] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:51:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:51:46.737236 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-1947649d-43c6-45a5-a0ed-013f2bc57882 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:51:46.738358 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-1947649d-43c6-45a5-a0ed-013f2bc57882 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: af183467-9304-4c73-a29f-196e76ba21b5] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:51:46.746537 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1947649d-43c6-45a5-a0ed-013f2bc57882 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:46.747440 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1947649d-43c6-45a5-a0ed-013f2bc57882 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:46.748701 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1947649d-43c6-45a5-a0ed-013f2bc57882 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:46.749658 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1947649d-43c6-45a5-a0ed-013f2bc57882 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:46.750505 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1947649d-43c6-45a5-a0ed-013f2bc57882 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:46.751673 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1947649d-43c6-45a5-a0ed-013f2bc57882 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:46.973228 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-1947649d-43c6-45a5-a0ed-013f2bc57882 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:46.988920 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-1947649d-43c6-45a5-a0ed-013f2bc57882 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/af183467-9304-4c73-a29f-196e76ba21b5" status: 200 len: 1378 microversion: 2.1 time: 0.254951 Sep 14 08:51:46.989643 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 440/835] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:51:46 2022] GET /compute/v2.1/servers/af183467-9304-4c73-a29f-196e76ba21b5 => generated 1378 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:51:47.020009 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8b9d9898-7a62-4840-9204-e5385522d90a tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:51:47.023656 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-8b9d9898-7a62-4840-9204-e5385522d90a tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] [instance: 3d2d7f4d-e204-42c4-b977-63119c1b8783] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:51:47.031793 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8b9d9898-7a62-4840-9204-e5385522d90a tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:47.032722 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8b9d9898-7a62-4840-9204-e5385522d90a tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:47.039556 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8b9d9898-7a62-4840-9204-e5385522d90a tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:47.041264 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8b9d9898-7a62-4840-9204-e5385522d90a tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:47.042594 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8b9d9898-7a62-4840-9204-e5385522d90a tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:47.044343 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8b9d9898-7a62-4840-9204-e5385522d90a tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:47.305332 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-8b9d9898-7a62-4840-9204-e5385522d90a tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be69c6b130994b87b32fe1b50916b500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac1cc0aa271432d9b256569e220fc75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:47.328571 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-8b9d9898-7a62-4840-9204-e5385522d90a tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] 10.222.0.60 "GET /compute/v2.1/servers/3d2d7f4d-e204-42c4-b977-63119c1b8783" status: 200 len: 1316 microversion: 2.1 time: 0.314811 Sep 14 08:51:47.333052 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 441/836] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:51:46 2022] GET /compute/v2.1/servers/3d2d7f4d-e204-42c4-b977-63119c1b8783 => generated 1316 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:51:47.423411 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d616de84-4000-4f5e-ac08-6a3058c2ad62 tempest-FloatingIPDetailsTestJSON-894349538 tempest-FloatingIPDetailsTestJSON-894349538-project] Action: 'create', calling method: .version_select at 0x7f7d445cf040>, body: {"pool": null} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:51:48.950435 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-ab3d9ea2-6930-4a1a-9a39-7afe4c82c4d3 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/874205eb-5321-4a9a-aa38-3cd83b2ac1a3/action" status: 202 len: 0 microversion: 2.1 time: 3.857131 Sep 14 08:51:48.951185 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 396/837] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 08:51:45 2022] POST /compute/v2.1/servers/874205eb-5321-4a9a-aa38-3cd83b2ac1a3/action => generated 0 bytes in 3863 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 08:51:48.957702 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b733c592-0abe-467b-8df0-62c116012a54 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-182055608", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "307b2830-67e6-44ec-845f-9894de16694a"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:51:49.025164 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.network.neutron [None req-b733c592-0abe-467b-8df0-62c116012a54 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] validate_networks() for None {{(pid=128758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 08:51:49.635611 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=8 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:51:49.792226 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-b733c592-0abe-467b-8df0-62c116012a54 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Flavor limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 08:51:49.792660 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-b733c592-0abe-467b-8df0-62c116012a54 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Image limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 08:51:49.793140 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-b733c592-0abe-467b-8df0-62c116012a54 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Flavor pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 08:51:49.793556 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-b733c592-0abe-467b-8df0-62c116012a54 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Image pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 08:51:49.794393 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-b733c592-0abe-467b-8df0-62c116012a54 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 08:51:49.816279 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b733c592-0abe-467b-8df0-62c116012a54 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:49.816776 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b733c592-0abe-467b-8df0-62c116012a54 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:49.828542 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b733c592-0abe-467b-8df0-62c116012a54 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:49.840563 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b733c592-0abe-467b-8df0-62c116012a54 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:49.842582 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b733c592-0abe-467b-8df0-62c116012a54 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:49.843619 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b733c592-0abe-467b-8df0-62c116012a54 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:49.883459 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-b733c592-0abe-467b-8df0-62c116012a54 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Getting quotas for project 5e326f95a9604fdb9bd075db3837cf62. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 08:51:49.890586 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-b733c592-0abe-467b-8df0-62c116012a54 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Getting quotas for user 89c7802984cf48d1852832b52abe52e9 and project 5e326f95a9604fdb9bd075db3837cf62. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 08:51:49.930817 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-b733c592-0abe-467b-8df0-62c116012a54 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Going to run 1 instances... {{(pid=128758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 08:51:49.933794 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-b733c592-0abe-467b-8df0-62c116012a54 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] [instance: d4344070-484a-4a5e-9e37-5f3dad6ba536] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 08:51:49.950382 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d616de84-4000-4f5e-ac08-6a3058c2ad62 tempest-FloatingIPDetailsTestJSON-894349538 tempest-FloatingIPDetailsTestJSON-894349538-project] 10.222.0.60 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.611495 Sep 14 08:51:49.951845 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 442/838] 10.222.0.60 () {60 vars in 1170 bytes} [Wed Sep 14 08:51:47 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2613 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:51:49.958069 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8d3d37ed-4614-46a7-a5a2-ae9e2ad65cd8 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-600369347", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "120035608", "adminPass": "***", "networks": [{"uuid": "cbace868-f7ef-4631-aed2-33869360fdb4"}], "security_groups": [{"name": "tempest-securitygroup--458484819"}], "key_name": "tempest-keypair-1720139900", "user_data": "}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:51:50.065861 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-b733c592-0abe-467b-8df0-62c116012a54 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.110279 Sep 14 08:51:50.067698 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 397/839] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 08:51:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1116 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 08:51:50.073985 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a9f25cc5-93b5-4b16-a495-ef2f1f2e42fe tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:51:50.074859 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-a9f25cc5-93b5-4b16-a495-ef2f1f2e42fe tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: bf59291e-0a19-499b-a95b-a76d82b5e307] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:51:50.090286 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a9f25cc5-93b5-4b16-a495-ef2f1f2e42fe tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:50.091020 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a9f25cc5-93b5-4b16-a495-ef2f1f2e42fe tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:50.091621 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a9f25cc5-93b5-4b16-a495-ef2f1f2e42fe tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:50.092528 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a9f25cc5-93b5-4b16-a495-ef2f1f2e42fe tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:50.093224 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a9f25cc5-93b5-4b16-a495-ef2f1f2e42fe tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:50.093816 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a9f25cc5-93b5-4b16-a495-ef2f1f2e42fe tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:50.324061 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.network.neutron [None req-8d3d37ed-4614-46a7-a5a2-ae9e2ad65cd8 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] validate_networks() for [('cbace868-f7ef-4631-aed2-33869360fdb4', None, None, None, None, None)] {{(pid=128759) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 08:51:50.437435 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-a9f25cc5-93b5-4b16-a495-ef2f1f2e42fe tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:50.449440 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-a9f25cc5-93b5-4b16-a495-ef2f1f2e42fe tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:50.451939 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-a9f25cc5-93b5-4b16-a495-ef2f1f2e42fe tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:50.453561 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-a9f25cc5-93b5-4b16-a495-ef2f1f2e42fe tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/bf59291e-0a19-499b-a95b-a76d82b5e307" status: 200 len: 1568 microversion: 2.25 time: 0.384011 Sep 14 08:51:50.476508 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 398/840] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:51:50 2022] GET /compute/v2.1/servers/bf59291e-0a19-499b-a95b-a76d82b5e307 => generated 1568 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:51:50.482774 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-662e1d6e-e8b2-4359-a24d-ad7152c84d99 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:51:50.483723 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-662e1d6e-e8b2-4359-a24d-ad7152c84d99 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: af183467-9304-4c73-a29f-196e76ba21b5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:51:50.500557 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-662e1d6e-e8b2-4359-a24d-ad7152c84d99 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:50.501402 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-662e1d6e-e8b2-4359-a24d-ad7152c84d99 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:50.502189 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-662e1d6e-e8b2-4359-a24d-ad7152c84d99 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:50.504812 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-662e1d6e-e8b2-4359-a24d-ad7152c84d99 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:50.506349 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-662e1d6e-e8b2-4359-a24d-ad7152c84d99 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:50.507773 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-662e1d6e-e8b2-4359-a24d-ad7152c84d99 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:50.887904 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-662e1d6e-e8b2-4359-a24d-ad7152c84d99 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:50.896570 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-662e1d6e-e8b2-4359-a24d-ad7152c84d99 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/af183467-9304-4c73-a29f-196e76ba21b5" status: 200 len: 1378 microversion: 2.1 time: 0.418544 Sep 14 08:51:50.926334 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 399/841] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:51:50 2022] GET /compute/v2.1/servers/af183467-9304-4c73-a29f-196e76ba21b5 => generated 1378 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:51:50.932015 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ecefb555-6208-4790-a526-871fc13facd4 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:51:50.933042 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-ecefb555-6208-4790-a526-871fc13facd4 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] [instance: 3d2d7f4d-e204-42c4-b977-63119c1b8783] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:51:50.939642 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ecefb555-6208-4790-a526-871fc13facd4 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:50.940510 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ecefb555-6208-4790-a526-871fc13facd4 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:50.941174 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ecefb555-6208-4790-a526-871fc13facd4 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:50.942156 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ecefb555-6208-4790-a526-871fc13facd4 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:50.942863 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ecefb555-6208-4790-a526-871fc13facd4 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:50.943603 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ecefb555-6208-4790-a526-871fc13facd4 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:51.611506 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-ecefb555-6208-4790-a526-871fc13facd4 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be69c6b130994b87b32fe1b50916b500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac1cc0aa271432d9b256569e220fc75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:51.629722 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-ecefb555-6208-4790-a526-871fc13facd4 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] 10.222.0.60 "GET /compute/v2.1/servers/3d2d7f4d-e204-42c4-b977-63119c1b8783" status: 200 len: 1316 microversion: 2.1 time: 0.701822 Sep 14 08:51:51.646269 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 400/842] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:51:50 2022] GET /compute/v2.1/servers/3d2d7f4d-e204-42c4-b977-63119c1b8783 => generated 1316 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:51:51.650051 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-39ad2b03-57e1-4f89-ae4f-d1bab53a1c15 req-6479b2e2-c3a6-44ba-b9f6-0faf4dbae972 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf59291e-0a19-499b-a95b-a76d82b5e307", "tag": "f8233fbd-017c-41f3-ac0a-d6c9e916d35e"}, {"name": "network-changed", "server_uuid": "3d2d7f4d-e204-42c4-b977-63119c1b8783", "tag": "a126ba35-89e7-4474-9131-e294b3d8bdb6"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:51:51.662546 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-39ad2b03-57e1-4f89-ae4f-d1bab53a1c15 req-6479b2e2-c3a6-44ba-b9f6-0faf4dbae972 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:51.663064 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-39ad2b03-57e1-4f89-ae4f-d1bab53a1c15 req-6479b2e2-c3a6-44ba-b9f6-0faf4dbae972 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:51.664181 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-39ad2b03-57e1-4f89-ae4f-d1bab53a1c15 req-6479b2e2-c3a6-44ba-b9f6-0faf4dbae972 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:51.681668 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-39ad2b03-57e1-4f89-ae4f-d1bab53a1c15 req-6479b2e2-c3a6-44ba-b9f6-0faf4dbae972 service nova] Creating event network-changed:f8233fbd-017c-41f3-ac0a-d6c9e916d35e for instance bf59291e-0a19-499b-a95b-a76d82b5e307 on n-h1-836830-18 Sep 14 08:51:51.682321 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-39ad2b03-57e1-4f89-ae4f-d1bab53a1c15 req-6479b2e2-c3a6-44ba-b9f6-0faf4dbae972 service nova] Creating event network-changed:a126ba35-89e7-4474-9131-e294b3d8bdb6 for instance 3d2d7f4d-e204-42c4-b977-63119c1b8783 on n-h2-836830-18 Sep 14 08:51:51.696855 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-39ad2b03-57e1-4f89-ae4f-d1bab53a1c15 req-6479b2e2-c3a6-44ba-b9f6-0faf4dbae972 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.051281 Sep 14 08:51:51.697809 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 401/843] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:51:51 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:51:51.715272 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b6b9956b-a18a-417d-8229-d79cbca5e8a5 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:51:51.720709 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-b6b9956b-a18a-417d-8229-d79cbca5e8a5 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: 874205eb-5321-4a9a-aa38-3cd83b2ac1a3] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:51:51.733851 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b6b9956b-a18a-417d-8229-d79cbca5e8a5 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:51.736854 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b6b9956b-a18a-417d-8229-d79cbca5e8a5 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:51.738516 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b6b9956b-a18a-417d-8229-d79cbca5e8a5 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:51.741338 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b6b9956b-a18a-417d-8229-d79cbca5e8a5 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:51.742149 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b6b9956b-a18a-417d-8229-d79cbca5e8a5 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:51.742589 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b6b9956b-a18a-417d-8229-d79cbca5e8a5 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:51.758367 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-8d3d37ed-4614-46a7-a5a2-ae9e2ad65cd8 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Flavor limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 08:51:51.758877 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-8d3d37ed-4614-46a7-a5a2-ae9e2ad65cd8 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Image limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 08:51:51.759747 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-8d3d37ed-4614-46a7-a5a2-ae9e2ad65cd8 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Flavor pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 08:51:51.760169 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-8d3d37ed-4614-46a7-a5a2-ae9e2ad65cd8 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Image pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 08:51:51.760588 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-8d3d37ed-4614-46a7-a5a2-ae9e2ad65cd8 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 08:51:51.788053 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8d3d37ed-4614-46a7-a5a2-ae9e2ad65cd8 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:51.791891 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8d3d37ed-4614-46a7-a5a2-ae9e2ad65cd8 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:51.792655 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8d3d37ed-4614-46a7-a5a2-ae9e2ad65cd8 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:51.795649 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8d3d37ed-4614-46a7-a5a2-ae9e2ad65cd8 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:51.800095 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8d3d37ed-4614-46a7-a5a2-ae9e2ad65cd8 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:51.801844 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8d3d37ed-4614-46a7-a5a2-ae9e2ad65cd8 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:51.846864 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-8d3d37ed-4614-46a7-a5a2-ae9e2ad65cd8 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Getting quotas for project ee17e19b2f094a899dfc8966152fd642. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 08:51:51.859110 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-8d3d37ed-4614-46a7-a5a2-ae9e2ad65cd8 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Getting quotas for user 24b938da87b14cd79c3c6dd85818cd02 and project ee17e19b2f094a899dfc8966152fd642. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 08:51:51.886421 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-8d3d37ed-4614-46a7-a5a2-ae9e2ad65cd8 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Going to run 1 instances... {{(pid=128759) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 08:51:51.890683 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-8d3d37ed-4614-46a7-a5a2-ae9e2ad65cd8 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] [instance: 4df3f3eb-e900-497d-a1ed-f5e12a0d69a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=128759) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 08:51:52.006661 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-8d3d37ed-4614-46a7-a5a2-ae9e2ad65cd8 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.053375 Sep 14 08:51:52.008267 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 443/844] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 08:51:49 2022] POST /compute/v2.1/servers => generated 401 bytes in 2056 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 08:51:52.018435 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-492d5183-405d-40cb-ba07-05f358cc8df1 tempest-FloatingIPDetailsTestJSON-894349538 tempest-FloatingIPDetailsTestJSON-894349538-project] Action: 'create', calling method: .version_select at 0x7f7d443cbca0>, body: {"pool": null} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:51:52.266970 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-b6b9956b-a18a-417d-8229-d79cbca5e8a5 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:52.280577 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-b6b9956b-a18a-417d-8229-d79cbca5e8a5 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/874205eb-5321-4a9a-aa38-3cd83b2ac1a3" status: 200 len: 1503 microversion: 2.1 time: 0.581396 Sep 14 08:51:52.282204 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 402/845] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:51:51 2022] GET /compute/v2.1/servers/874205eb-5321-4a9a-aa38-3cd83b2ac1a3 => generated 1503 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:51:52.291051 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-81d4895d-aa5e-4d5d-8e8e-1bb2f7b564ee tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:51:52.292283 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-81d4895d-aa5e-4d5d-8e8e-1bb2f7b564ee tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] [instance: d4344070-484a-4a5e-9e37-5f3dad6ba536] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:51:52.310862 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-81d4895d-aa5e-4d5d-8e8e-1bb2f7b564ee tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:52.311632 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-81d4895d-aa5e-4d5d-8e8e-1bb2f7b564ee tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:52.312166 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-81d4895d-aa5e-4d5d-8e8e-1bb2f7b564ee tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:52.313142 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-81d4895d-aa5e-4d5d-8e8e-1bb2f7b564ee tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:52.313950 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-81d4895d-aa5e-4d5d-8e8e-1bb2f7b564ee tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:52.314737 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-81d4895d-aa5e-4d5d-8e8e-1bb2f7b564ee tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:52.413075 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-81d4895d-aa5e-4d5d-8e8e-1bb2f7b564ee tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c7802984cf48d1852832b52abe52e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e326f95a9604fdb9bd075db3837cf62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:52.429636 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-81d4895d-aa5e-4d5d-8e8e-1bb2f7b564ee tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] 10.222.0.60 "GET /compute/v2.1/servers/d4344070-484a-4a5e-9e37-5f3dad6ba536" status: 200 len: 1268 microversion: 2.1 time: 0.141831 Sep 14 08:51:52.452215 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 403/846] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:51:52 2022] GET /compute/v2.1/servers/d4344070-484a-4a5e-9e37-5f3dad6ba536 => generated 1268 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:51:52.464248 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-02e887f8-f64b-4198-9ce8-9f3e3dbbff6b tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-1570064803", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "03bf135c-eb6e-4ed1-8097-87db14576b65"}], "security_groups": [{"name": "tempest-securitygroup--1220391126"}], "key_name": "tempest-keypair-85366435", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:51:52.670773 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.network.neutron [None req-02e887f8-f64b-4198-9ce8-9f3e3dbbff6b tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] validate_networks() for [('03bf135c-eb6e-4ed1-8097-87db14576b65', None, None, None, None, None)] {{(pid=128758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 08:51:53.970236 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-02e887f8-f64b-4198-9ce8-9f3e3dbbff6b tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Getting quotas for project 38a515fd540744a2bdf6fb971f4a6924. Resources: dict_keys(['metadata_items']) {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 08:51:53.975544 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-02e887f8-f64b-4198-9ce8-9f3e3dbbff6b tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Getting quotas for user aeaac454f233408ba1597b36bb9277dc and project 38a515fd540744a2bdf6fb971f4a6924. Resources: dict_keys(['metadata_items']) {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 08:51:53.988782 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-02e887f8-f64b-4198-9ce8-9f3e3dbbff6b tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Flavor limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 08:51:53.989203 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-02e887f8-f64b-4198-9ce8-9f3e3dbbff6b tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Image limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 08:51:53.989679 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-02e887f8-f64b-4198-9ce8-9f3e3dbbff6b tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Flavor pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 08:51:53.990088 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-02e887f8-f64b-4198-9ce8-9f3e3dbbff6b tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Image pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 08:51:53.990497 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-02e887f8-f64b-4198-9ce8-9f3e3dbbff6b tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 08:51:53.999323 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-02e887f8-f64b-4198-9ce8-9f3e3dbbff6b tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:53.999516 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-02e887f8-f64b-4198-9ce8-9f3e3dbbff6b tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:53.999955 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-02e887f8-f64b-4198-9ce8-9f3e3dbbff6b tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:54.000675 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-02e887f8-f64b-4198-9ce8-9f3e3dbbff6b tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:54.001128 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-02e887f8-f64b-4198-9ce8-9f3e3dbbff6b tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:54.001565 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-02e887f8-f64b-4198-9ce8-9f3e3dbbff6b tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:54.018483 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-02e887f8-f64b-4198-9ce8-9f3e3dbbff6b tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Getting quotas for project 38a515fd540744a2bdf6fb971f4a6924. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 08:51:54.024321 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-02e887f8-f64b-4198-9ce8-9f3e3dbbff6b tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Getting quotas for user aeaac454f233408ba1597b36bb9277dc and project 38a515fd540744a2bdf6fb971f4a6924. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 08:51:54.038011 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-02e887f8-f64b-4198-9ce8-9f3e3dbbff6b tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Going to run 1 instances... {{(pid=128758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 08:51:54.041057 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-02e887f8-f64b-4198-9ce8-9f3e3dbbff6b tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] [instance: 58b5d8a4-035b-4a2f-8a83-02ea69847900] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 08:51:54.101443 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-02e887f8-f64b-4198-9ce8-9f3e3dbbff6b tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.647668 Sep 14 08:51:54.102668 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 404/847] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 08:51:52 2022] POST /compute/v2.1/servers => generated 409 bytes in 1649 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 08:51:54.107447 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ca77e757-b455-4da6-8731-e277dae9f202 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:51:54.108093 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-ca77e757-b455-4da6-8731-e277dae9f202 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: bf59291e-0a19-499b-a95b-a76d82b5e307] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:51:54.114575 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ca77e757-b455-4da6-8731-e277dae9f202 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:54.115497 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ca77e757-b455-4da6-8731-e277dae9f202 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:54.116103 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ca77e757-b455-4da6-8731-e277dae9f202 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:54.117046 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ca77e757-b455-4da6-8731-e277dae9f202 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:54.117664 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ca77e757-b455-4da6-8731-e277dae9f202 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:54.118261 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ca77e757-b455-4da6-8731-e277dae9f202 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:54.636964 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-ca77e757-b455-4da6-8731-e277dae9f202 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:54.646362 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-ca77e757-b455-4da6-8731-e277dae9f202 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:54.653840 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-ca77e757-b455-4da6-8731-e277dae9f202 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:54.657501 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-ca77e757-b455-4da6-8731-e277dae9f202 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/bf59291e-0a19-499b-a95b-a76d82b5e307" status: 200 len: 1568 microversion: 2.25 time: 0.551290 Sep 14 08:51:54.659443 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 405/848] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:51:54 2022] GET /compute/v2.1/servers/bf59291e-0a19-499b-a95b-a76d82b5e307 => generated 1568 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:51:54.683462 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c2de6e27-1a49-4a96-98ab-a5b01724e7bf tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:51:54.684388 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-c2de6e27-1a49-4a96-98ab-a5b01724e7bf tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: af183467-9304-4c73-a29f-196e76ba21b5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:51:54.690713 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c2de6e27-1a49-4a96-98ab-a5b01724e7bf tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:54.691530 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c2de6e27-1a49-4a96-98ab-a5b01724e7bf tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:54.692196 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c2de6e27-1a49-4a96-98ab-a5b01724e7bf tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:54.693131 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c2de6e27-1a49-4a96-98ab-a5b01724e7bf tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:54.693911 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c2de6e27-1a49-4a96-98ab-a5b01724e7bf tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:54.695172 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c2de6e27-1a49-4a96-98ab-a5b01724e7bf tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:54.927376 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-492d5183-405d-40cb-ba07-05f358cc8df1 tempest-FloatingIPDetailsTestJSON-894349538 tempest-FloatingIPDetailsTestJSON-894349538-project] 10.222.0.60 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.917696 Sep 14 08:51:54.936032 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 444/849] 10.222.0.60 () {60 vars in 1170 bytes} [Wed Sep 14 08:51:52 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2919 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:51:54.941307 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3efb0177-8d39-44e2-82fe-e7393b72be6c tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:51:54.941936 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-3efb0177-8d39-44e2-82fe-e7393b72be6c tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] [instance: 4df3f3eb-e900-497d-a1ed-f5e12a0d69a8] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:51:54.959566 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3efb0177-8d39-44e2-82fe-e7393b72be6c tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:54.961737 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3efb0177-8d39-44e2-82fe-e7393b72be6c tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:54.962479 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3efb0177-8d39-44e2-82fe-e7393b72be6c tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:54.965735 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3efb0177-8d39-44e2-82fe-e7393b72be6c tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:54.966457 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3efb0177-8d39-44e2-82fe-e7393b72be6c tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:54.967161 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3efb0177-8d39-44e2-82fe-e7393b72be6c tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:55.011921 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-c2de6e27-1a49-4a96-98ab-a5b01724e7bf tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:55.021120 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-c2de6e27-1a49-4a96-98ab-a5b01724e7bf tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/af183467-9304-4c73-a29f-196e76ba21b5" status: 200 len: 1527 microversion: 2.1 time: 0.348954 Sep 14 08:51:55.021718 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 406/850] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:51:54 2022] GET /compute/v2.1/servers/af183467-9304-4c73-a29f-196e76ba21b5 => generated 1527 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:51:55.044462 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-82a746d4-8558-4030-843b-fdff42371786 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:51:55.045093 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-82a746d4-8558-4030-843b-fdff42371786 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] [instance: 3d2d7f4d-e204-42c4-b977-63119c1b8783] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:51:55.052889 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-82a746d4-8558-4030-843b-fdff42371786 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:55.053602 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-82a746d4-8558-4030-843b-fdff42371786 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:55.055113 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-82a746d4-8558-4030-843b-fdff42371786 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:55.056209 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-82a746d4-8558-4030-843b-fdff42371786 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:55.056828 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-82a746d4-8558-4030-843b-fdff42371786 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:55.057420 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-82a746d4-8558-4030-843b-fdff42371786 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:55.163954 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-3efb0177-8d39-44e2-82fe-e7393b72be6c tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b938da87b14cd79c3c6dd85818cd02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee17e19b2f094a899dfc8966152fd642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:55.189154 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-3efb0177-8d39-44e2-82fe-e7393b72be6c tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] 10.222.0.60 "GET /compute/v2.1/servers/4df3f3eb-e900-497d-a1ed-f5e12a0d69a8" status: 200 len: 1320 microversion: 2.1 time: 0.257166 Sep 14 08:51:55.190998 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 445/851] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:51:54 2022] GET /compute/v2.1/servers/4df3f3eb-e900-497d-a1ed-f5e12a0d69a8 => generated 1320 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:51:55.223470 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-fc272895-e495-44d2-b0d8-832c960cf789 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:51:55.224376 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-fc272895-e495-44d2-b0d8-832c960cf789 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: 874205eb-5321-4a9a-aa38-3cd83b2ac1a3] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:51:55.244990 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fc272895-e495-44d2-b0d8-832c960cf789 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:55.248871 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fc272895-e495-44d2-b0d8-832c960cf789 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:55.250186 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fc272895-e495-44d2-b0d8-832c960cf789 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:55.255330 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fc272895-e495-44d2-b0d8-832c960cf789 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:55.256204 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fc272895-e495-44d2-b0d8-832c960cf789 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:55.259452 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fc272895-e495-44d2-b0d8-832c960cf789 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:55.409320 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-82a746d4-8558-4030-843b-fdff42371786 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be69c6b130994b87b32fe1b50916b500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac1cc0aa271432d9b256569e220fc75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:55.423017 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-82a746d4-8558-4030-843b-fdff42371786 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] 10.222.0.60 "GET /compute/v2.1/servers/3d2d7f4d-e204-42c4-b977-63119c1b8783" status: 200 len: 1316 microversion: 2.1 time: 0.386597 Sep 14 08:51:55.423628 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 407/852] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:51:55 2022] GET /compute/v2.1/servers/3d2d7f4d-e204-42c4-b977-63119c1b8783 => generated 1316 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:51:55.439461 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1ec94361-95ed-4c04-bc3d-fd900452d2f8 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:51:55.440092 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-1ec94361-95ed-4c04-bc3d-fd900452d2f8 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] [instance: d4344070-484a-4a5e-9e37-5f3dad6ba536] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:51:55.458033 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1ec94361-95ed-4c04-bc3d-fd900452d2f8 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:55.458541 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1ec94361-95ed-4c04-bc3d-fd900452d2f8 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:55.459533 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1ec94361-95ed-4c04-bc3d-fd900452d2f8 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:55.468631 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1ec94361-95ed-4c04-bc3d-fd900452d2f8 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:55.470388 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1ec94361-95ed-4c04-bc3d-fd900452d2f8 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:55.471240 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1ec94361-95ed-4c04-bc3d-fd900452d2f8 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:55.730224 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-fc272895-e495-44d2-b0d8-832c960cf789 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:55.732756 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:51:55.745272 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-fc272895-e495-44d2-b0d8-832c960cf789 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/874205eb-5321-4a9a-aa38-3cd83b2ac1a3" status: 200 len: 1503 microversion: 2.1 time: 0.552960 Sep 14 08:51:55.768170 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 446/853] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:51:55 2022] GET /compute/v2.1/servers/874205eb-5321-4a9a-aa38-3cd83b2ac1a3 => generated 1503 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:51:55.776736 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-02f4cfd5-d21d-4840-bfe0-8fd20cc2eb89 req-5491b3b4-7988-4991-936a-e20bb7399822 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d2c444a-e84e-40c5-aec1-375cd14f67c8", "name": "network-vif-deleted", "tag": "19ff01df-4500-4f30-970d-7bee0d4b0a4f"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:51:55.790055 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-02f4cfd5-d21d-4840-bfe0-8fd20cc2eb89 req-5491b3b4-7988-4991-936a-e20bb7399822 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:55.791016 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-02f4cfd5-d21d-4840-bfe0-8fd20cc2eb89 req-5491b3b4-7988-4991-936a-e20bb7399822 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:55.791631 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-02f4cfd5-d21d-4840-bfe0-8fd20cc2eb89 req-5491b3b4-7988-4991-936a-e20bb7399822 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:55.805360 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-02f4cfd5-d21d-4840-bfe0-8fd20cc2eb89 req-5491b3b4-7988-4991-936a-e20bb7399822 service nova] Creating event network-vif-deleted:19ff01df-4500-4f30-970d-7bee0d4b0a4f for instance 2d2c444a-e84e-40c5-aec1-375cd14f67c8 on n-h1-836830-18 Sep 14 08:51:55.810834 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-02f4cfd5-d21d-4840-bfe0-8fd20cc2eb89 req-5491b3b4-7988-4991-936a-e20bb7399822 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040310 Sep 14 08:51:55.811510 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 447/854] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:51:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:51:55.816723 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e4527a80-5c85-4943-8af0-86f53efc56fd tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:51:55.817890 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e4527a80-5c85-4943-8af0-86f53efc56fd tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] [instance: 58b5d8a4-035b-4a2f-8a83-02ea69847900] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:51:55.826010 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e4527a80-5c85-4943-8af0-86f53efc56fd tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:55.826503 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e4527a80-5c85-4943-8af0-86f53efc56fd tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:55.826958 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e4527a80-5c85-4943-8af0-86f53efc56fd tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:55.827648 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e4527a80-5c85-4943-8af0-86f53efc56fd tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:55.828100 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e4527a80-5c85-4943-8af0-86f53efc56fd tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:55.828519 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e4527a80-5c85-4943-8af0-86f53efc56fd tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:55.963547 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-e4527a80-5c85-4943-8af0-86f53efc56fd tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeaac454f233408ba1597b36bb9277dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38a515fd540744a2bdf6fb971f4a6924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:55.978061 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e4527a80-5c85-4943-8af0-86f53efc56fd tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] 10.222.0.60 "GET /compute/v2.1/servers/58b5d8a4-035b-4a2f-8a83-02ea69847900" status: 200 len: 1272 microversion: 2.1 time: 0.165030 Sep 14 08:51:55.979285 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 448/855] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:51:55 2022] GET /compute/v2.1/servers/58b5d8a4-035b-4a2f-8a83-02ea69847900 => generated 1272 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:51:55.997209 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a89628fe-da06-4aff-934d-ce0f3b4d2bb1 tempest-FloatingIPDetailsTestJSON-894349538 tempest-FloatingIPDetailsTestJSON-894349538-project] Action: 'create', calling method: .version_select at 0x7f7d445cf700>, body: {"pool": null} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:51:56.054391 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-1ec94361-95ed-4c04-bc3d-fd900452d2f8 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c7802984cf48d1852832b52abe52e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e326f95a9604fdb9bd075db3837cf62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:56.064263 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-1ec94361-95ed-4c04-bc3d-fd900452d2f8 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] 10.222.0.60 "GET /compute/v2.1/servers/d4344070-484a-4a5e-9e37-5f3dad6ba536" status: 200 len: 1316 microversion: 2.1 time: 0.633182 Sep 14 08:51:56.067979 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 408/856] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:51:55 2022] GET /compute/v2.1/servers/d4344070-484a-4a5e-9e37-5f3dad6ba536 => generated 1316 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:51:56.083701 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-da815428-2e10-4531-90c6-347f349610cc tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:51:56.085204 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-da815428-2e10-4531-90c6-347f349610cc tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: af183467-9304-4c73-a29f-196e76ba21b5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:51:56.101683 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-da815428-2e10-4531-90c6-347f349610cc tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:56.102365 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-da815428-2e10-4531-90c6-347f349610cc tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:56.102890 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-da815428-2e10-4531-90c6-347f349610cc tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:56.103818 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-da815428-2e10-4531-90c6-347f349610cc tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:56.108237 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-da815428-2e10-4531-90c6-347f349610cc tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:56.108818 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-da815428-2e10-4531-90c6-347f349610cc tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:56.737026 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-da815428-2e10-4531-90c6-347f349610cc tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:56.746514 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-da815428-2e10-4531-90c6-347f349610cc tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/af183467-9304-4c73-a29f-196e76ba21b5" status: 200 len: 1527 microversion: 2.1 time: 0.676727 Sep 14 08:51:56.775120 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 409/857] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:51:56 2022] GET /compute/v2.1/servers/af183467-9304-4c73-a29f-196e76ba21b5 => generated 1527 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:51:56.781194 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a84a534c-625c-4aee-a64d-0eef2fbfd786 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:51:56.782087 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-a84a534c-625c-4aee-a64d-0eef2fbfd786 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: bf59291e-0a19-499b-a95b-a76d82b5e307] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:51:56.799365 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a84a534c-625c-4aee-a64d-0eef2fbfd786 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:56.800253 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a84a534c-625c-4aee-a64d-0eef2fbfd786 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:56.800944 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a84a534c-625c-4aee-a64d-0eef2fbfd786 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:56.802555 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a84a534c-625c-4aee-a64d-0eef2fbfd786 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:56.805966 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a84a534c-625c-4aee-a64d-0eef2fbfd786 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:56.806552 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a84a534c-625c-4aee-a64d-0eef2fbfd786 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:57.273245 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-a84a534c-625c-4aee-a64d-0eef2fbfd786 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:57.287601 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-a84a534c-625c-4aee-a64d-0eef2fbfd786 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:57.290046 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-a84a534c-625c-4aee-a64d-0eef2fbfd786 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:57.295129 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-a84a534c-625c-4aee-a64d-0eef2fbfd786 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/bf59291e-0a19-499b-a95b-a76d82b5e307" status: 200 len: 1543 microversion: 2.25 time: 0.517868 Sep 14 08:51:57.296252 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 410/858] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:51:56 2022] GET /compute/v2.1/servers/bf59291e-0a19-499b-a95b-a76d82b5e307 => generated 1543 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:51:57.316273 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-c9377459-7f1a-462c-9170-21195b2fe69f req-2989e3d7-bf37-4a87-bc03-24b62d03b8a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d2d7f4d-e204-42c4-b977-63119c1b8783", "name": "network-vif-plugged", "status": "completed", "tag": "a126ba35-89e7-4474-9131-e294b3d8bdb6"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:51:57.350157 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-c9377459-7f1a-462c-9170-21195b2fe69f req-2989e3d7-bf37-4a87-bc03-24b62d03b8a5 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:57.352214 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-c9377459-7f1a-462c-9170-21195b2fe69f req-2989e3d7-bf37-4a87-bc03-24b62d03b8a5 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:57.352822 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-c9377459-7f1a-462c-9170-21195b2fe69f req-2989e3d7-bf37-4a87-bc03-24b62d03b8a5 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:57.366896 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-c9377459-7f1a-462c-9170-21195b2fe69f req-2989e3d7-bf37-4a87-bc03-24b62d03b8a5 service nova] Creating event network-vif-plugged:a126ba35-89e7-4474-9131-e294b3d8bdb6 for instance 3d2d7f4d-e204-42c4-b977-63119c1b8783 on n-h2-836830-18 Sep 14 08:51:57.374087 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-c9377459-7f1a-462c-9170-21195b2fe69f req-2989e3d7-bf37-4a87-bc03-24b62d03b8a5 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074026 Sep 14 08:51:57.375447 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 411/859] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:51:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:51:57.386733 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-cff836f2-efaf-4a1e-b77e-b36512c7e341 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:51:57.388121 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-cff836f2-efaf-4a1e-b77e-b36512c7e341 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] [instance: 4df3f3eb-e900-497d-a1ed-f5e12a0d69a8] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:51:57.401460 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cff836f2-efaf-4a1e-b77e-b36512c7e341 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:57.403830 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cff836f2-efaf-4a1e-b77e-b36512c7e341 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:57.404389 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cff836f2-efaf-4a1e-b77e-b36512c7e341 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:57.405389 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cff836f2-efaf-4a1e-b77e-b36512c7e341 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:57.406033 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cff836f2-efaf-4a1e-b77e-b36512c7e341 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:57.406501 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cff836f2-efaf-4a1e-b77e-b36512c7e341 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:57.811973 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-cff836f2-efaf-4a1e-b77e-b36512c7e341 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b938da87b14cd79c3c6dd85818cd02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee17e19b2f094a899dfc8966152fd642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:57.822539 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:51:57.828169 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-cff836f2-efaf-4a1e-b77e-b36512c7e341 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] 10.222.0.60 "GET /compute/v2.1/servers/4df3f3eb-e900-497d-a1ed-f5e12a0d69a8" status: 200 len: 1387 microversion: 2.1 time: 0.451204 Sep 14 08:51:57.841373 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 412/860] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:51:57 2022] GET /compute/v2.1/servers/4df3f3eb-e900-497d-a1ed-f5e12a0d69a8 => generated 1387 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:51:57.841373 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b53a365e-fa15-4f20-b8d2-aeee14e6bef7 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:51:57.841373 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-b53a365e-fa15-4f20-b8d2-aeee14e6bef7 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] [instance: 3d2d7f4d-e204-42c4-b977-63119c1b8783] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:51:57.849102 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b53a365e-fa15-4f20-b8d2-aeee14e6bef7 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:57.850273 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b53a365e-fa15-4f20-b8d2-aeee14e6bef7 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:57.851394 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b53a365e-fa15-4f20-b8d2-aeee14e6bef7 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:57.852655 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b53a365e-fa15-4f20-b8d2-aeee14e6bef7 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:57.853070 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b53a365e-fa15-4f20-b8d2-aeee14e6bef7 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:57.853513 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b53a365e-fa15-4f20-b8d2-aeee14e6bef7 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:58.303013 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-b53a365e-fa15-4f20-b8d2-aeee14e6bef7 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be69c6b130994b87b32fe1b50916b500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac1cc0aa271432d9b256569e220fc75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:58.313852 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-b53a365e-fa15-4f20-b8d2-aeee14e6bef7 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] 10.222.0.60 "GET /compute/v2.1/servers/3d2d7f4d-e204-42c4-b977-63119c1b8783" status: 200 len: 1316 microversion: 2.1 time: 0.483825 Sep 14 08:51:58.330180 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 413/861] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:51:57 2022] GET /compute/v2.1/servers/3d2d7f4d-e204-42c4-b977-63119c1b8783 => generated 1316 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:51:58.336426 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-bd6e60fc-e6f4-4bf1-83bb-5b3d9138aac3 tempest-MigrationsAdminTest-1443382137 tempest-MigrationsAdminTest-1443382137-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:51:58.357874 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-bd6e60fc-e6f4-4bf1-83bb-5b3d9138aac3 tempest-MigrationsAdminTest-1443382137 tempest-MigrationsAdminTest-1443382137-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/306d3b58-2a12-439e-a2b9-f9aaae74d166" status: 202 len: 0 microversion: 2.1 time: 0.026148 Sep 14 08:51:58.358482 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 414/862] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 08:51:58 2022] DELETE /compute/v2.1/flavors/306d3b58-2a12-439e-a2b9-f9aaae74d166 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 08:51:58.364798 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1f8aa8c5-89d8-4222-b1d1-0e9420c9749b tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:51:58.366250 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-1f8aa8c5-89d8-4222-b1d1-0e9420c9749b tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: 874205eb-5321-4a9a-aa38-3cd83b2ac1a3] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:51:58.373683 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1f8aa8c5-89d8-4222-b1d1-0e9420c9749b tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:58.374420 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1f8aa8c5-89d8-4222-b1d1-0e9420c9749b tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:58.375061 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1f8aa8c5-89d8-4222-b1d1-0e9420c9749b tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:58.375961 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1f8aa8c5-89d8-4222-b1d1-0e9420c9749b tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:58.376581 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1f8aa8c5-89d8-4222-b1d1-0e9420c9749b tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:58.377164 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1f8aa8c5-89d8-4222-b1d1-0e9420c9749b tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:58.728414 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-1f8aa8c5-89d8-4222-b1d1-0e9420c9749b tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:58.744717 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-1f8aa8c5-89d8-4222-b1d1-0e9420c9749b tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/874205eb-5321-4a9a-aa38-3cd83b2ac1a3" status: 200 len: 1503 microversion: 2.1 time: 0.383120 Sep 14 08:51:58.746206 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 415/863] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:51:58 2022] GET /compute/v2.1/servers/874205eb-5321-4a9a-aa38-3cd83b2ac1a3 => generated 1503 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:51:58.755213 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-6d35c4dc-3297-474d-9fe9-13614c9beab7 tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:51:58.755875 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-6d35c4dc-3297-474d-9fe9-13614c9beab7 tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] [instance: 58b5d8a4-035b-4a2f-8a83-02ea69847900] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:51:58.764543 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6d35c4dc-3297-474d-9fe9-13614c9beab7 tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:58.765032 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6d35c4dc-3297-474d-9fe9-13614c9beab7 tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:58.765679 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6d35c4dc-3297-474d-9fe9-13614c9beab7 tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:58.766413 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6d35c4dc-3297-474d-9fe9-13614c9beab7 tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:58.767115 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6d35c4dc-3297-474d-9fe9-13614c9beab7 tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:58.767327 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6d35c4dc-3297-474d-9fe9-13614c9beab7 tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:59.073833 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-6d35c4dc-3297-474d-9fe9-13614c9beab7 tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeaac454f233408ba1597b36bb9277dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38a515fd540744a2bdf6fb971f4a6924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:59.089146 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-6d35c4dc-3297-474d-9fe9-13614c9beab7 tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] 10.222.0.60 "GET /compute/v2.1/servers/58b5d8a4-035b-4a2f-8a83-02ea69847900" status: 200 len: 1402 microversion: 2.1 time: 0.341078 Sep 14 08:51:59.090141 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 416/864] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:51:58 2022] GET /compute/v2.1/servers/58b5d8a4-035b-4a2f-8a83-02ea69847900 => generated 1402 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:51:59.095130 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-46701e8d-a0ae-448d-b934-0e475a59ff4f tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:51:59.095847 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-46701e8d-a0ae-448d-b934-0e475a59ff4f tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] [instance: d4344070-484a-4a5e-9e37-5f3dad6ba536] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:51:59.102228 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-46701e8d-a0ae-448d-b934-0e475a59ff4f tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:59.103483 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-46701e8d-a0ae-448d-b934-0e475a59ff4f tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:59.104149 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-46701e8d-a0ae-448d-b934-0e475a59ff4f tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:59.104969 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-46701e8d-a0ae-448d-b934-0e475a59ff4f tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:59.105537 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-46701e8d-a0ae-448d-b934-0e475a59ff4f tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:59.106067 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-46701e8d-a0ae-448d-b934-0e475a59ff4f tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:59.327175 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-46701e8d-a0ae-448d-b934-0e475a59ff4f tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c7802984cf48d1852832b52abe52e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e326f95a9604fdb9bd075db3837cf62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:59.334078 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a89628fe-da06-4aff-934d-ce0f3b4d2bb1 tempest-FloatingIPDetailsTestJSON-894349538 tempest-FloatingIPDetailsTestJSON-894349538-project] 10.222.0.60 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.353290 Sep 14 08:51:59.334685 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 449/865] 10.222.0.60 () {60 vars in 1170 bytes} [Wed Sep 14 08:51:55 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3355 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:51:59.336534 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-46701e8d-a0ae-448d-b934-0e475a59ff4f tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] 10.222.0.60 "GET /compute/v2.1/servers/d4344070-484a-4a5e-9e37-5f3dad6ba536" status: 200 len: 1316 microversion: 2.1 time: 0.245167 Sep 14 08:51:59.337123 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 417/866] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:51:59 2022] GET /compute/v2.1/servers/d4344070-484a-4a5e-9e37-5f3dad6ba536 => generated 1316 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:51:59.339784 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-0614cd0a-4a0d-44a1-b544-020a7cc515eb tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Calling method '.version_select at 0x7f7d445cf0d0>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:51:59.342277 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-4e0a7403-ab24-4c91-a582-bb168d647ae7 req-a493142b-7828-4ebb-a6cc-d7db850b7197 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4df3f3eb-e900-497d-a1ed-f5e12a0d69a8", "tag": "2598a43e-0827-49bc-952a-840f14b2612a"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:51:59.343566 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0614cd0a-4a0d-44a1-b544-020a7cc515eb tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:59.344058 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0614cd0a-4a0d-44a1-b544-020a7cc515eb tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:59.344494 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0614cd0a-4a0d-44a1-b544-020a7cc515eb tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:59.353245 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-4e0a7403-ab24-4c91-a582-bb168d647ae7 req-a493142b-7828-4ebb-a6cc-d7db850b7197 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:59.353730 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-4e0a7403-ab24-4c91-a582-bb168d647ae7 req-a493142b-7828-4ebb-a6cc-d7db850b7197 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:59.354162 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-4e0a7403-ab24-4c91-a582-bb168d647ae7 req-a493142b-7828-4ebb-a6cc-d7db850b7197 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:59.356424 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-0614cd0a-4a0d-44a1-b544-020a7cc515eb tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] 10.222.0.60 "GET /compute/v2.1/os-migrations" status: 200 len: 2811 microversion: 2.25 time: 0.020484 Sep 14 08:51:59.357008 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 450/867] 10.222.0.60 () {60 vars in 1184 bytes} [Wed Sep 14 08:51:59 2022] GET /compute/v2.1/os-migrations => generated 2811 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:51:59.361695 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-2778db19-a6c3-4893-a0b6-914b5268c54a req-255f373e-0594-4afa-9ba3-0d075f950383 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4344070-484a-4a5e-9e37-5f3dad6ba536", "tag": "8377f14b-e4ff-4eaf-9b6b-075a29964f0f"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:51:59.367167 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-4e0a7403-ab24-4c91-a582-bb168d647ae7 req-a493142b-7828-4ebb-a6cc-d7db850b7197 service nova] Creating event network-changed:2598a43e-0827-49bc-952a-840f14b2612a for instance 4df3f3eb-e900-497d-a1ed-f5e12a0d69a8 on n-h2-836830-18 Sep 14 08:51:59.371971 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-2778db19-a6c3-4893-a0b6-914b5268c54a req-255f373e-0594-4afa-9ba3-0d075f950383 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:59.372463 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-2778db19-a6c3-4893-a0b6-914b5268c54a req-255f373e-0594-4afa-9ba3-0d075f950383 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:59.372893 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-2778db19-a6c3-4893-a0b6-914b5268c54a req-255f373e-0594-4afa-9ba3-0d075f950383 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:59.374096 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-4e0a7403-ab24-4c91-a582-bb168d647ae7 req-a493142b-7828-4ebb-a6cc-d7db850b7197 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035683 Sep 14 08:51:59.374706 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 418/868] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:51:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:51:59.379583 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-edda40ed-839b-47d0-9a8a-9c004d34b66e tempest-MigrationsAdminTest-1443382137 tempest-MigrationsAdminTest-1443382137-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:51:59.387177 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-2778db19-a6c3-4893-a0b6-914b5268c54a req-255f373e-0594-4afa-9ba3-0d075f950383 service nova] Creating event network-changed:8377f14b-e4ff-4eaf-9b6b-075a29964f0f for instance d4344070-484a-4a5e-9e37-5f3dad6ba536 on n-h1-836830-18 Sep 14 08:51:59.392079 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-2778db19-a6c3-4893-a0b6-914b5268c54a req-255f373e-0594-4afa-9ba3-0d075f950383 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033818 Sep 14 08:51:59.392671 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 451/869] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:51:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:51:59.397650 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a68967f7-1184-408b-a708-af450cf597d7 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:51:59.398354 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-a68967f7-1184-408b-a708-af450cf597d7 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] [instance: 4df3f3eb-e900-497d-a1ed-f5e12a0d69a8] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:51:59.401602 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-edda40ed-839b-47d0-9a8a-9c004d34b66e tempest-MigrationsAdminTest-1443382137 tempest-MigrationsAdminTest-1443382137-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 5813 microversion: 2.1 time: 0.025699 Sep 14 08:51:59.402191 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 419/870] 10.222.0.60 () {58 vars in 1146 bytes} [Wed Sep 14 08:51:59 2022] GET /compute/v2.1/flavors/detail => generated 5813 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:51:59.404383 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a68967f7-1184-408b-a708-af450cf597d7 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:59.404868 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a68967f7-1184-408b-a708-af450cf597d7 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:59.405300 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a68967f7-1184-408b-a708-af450cf597d7 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:59.405987 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a68967f7-1184-408b-a708-af450cf597d7 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:59.406442 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a68967f7-1184-408b-a708-af450cf597d7 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:59.406642 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-95d8cde0-a9ce-4f5a-a532-242eb3817ec5 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:51:59.406869 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a68967f7-1184-408b-a708-af450cf597d7 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:59.407385 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-95d8cde0-a9ce-4f5a-a532-242eb3817ec5 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] [instance: 3d2d7f4d-e204-42c4-b977-63119c1b8783] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:51:59.413901 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-95d8cde0-a9ce-4f5a-a532-242eb3817ec5 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:59.414383 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-95d8cde0-a9ce-4f5a-a532-242eb3817ec5 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:59.414815 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-95d8cde0-a9ce-4f5a-a532-242eb3817ec5 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:59.415534 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-95d8cde0-a9ce-4f5a-a532-242eb3817ec5 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:59.415991 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-95d8cde0-a9ce-4f5a-a532-242eb3817ec5 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:59.416415 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-95d8cde0-a9ce-4f5a-a532-242eb3817ec5 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:59.599661 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-a68967f7-1184-408b-a708-af450cf597d7 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b938da87b14cd79c3c6dd85818cd02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee17e19b2f094a899dfc8966152fd642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:59.607531 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-95d8cde0-a9ce-4f5a-a532-242eb3817ec5 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be69c6b130994b87b32fe1b50916b500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac1cc0aa271432d9b256569e220fc75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:59.608764 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a68967f7-1184-408b-a708-af450cf597d7 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] 10.222.0.60 "GET /compute/v2.1/servers/4df3f3eb-e900-497d-a1ed-f5e12a0d69a8" status: 200 len: 1387 microversion: 2.1 time: 0.214967 Sep 14 08:51:59.609349 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 452/871] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:51:59 2022] GET /compute/v2.1/servers/4df3f3eb-e900-497d-a1ed-f5e12a0d69a8 => generated 1387 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:51:59.613789 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-424af7a1-8333-4115-a099-1d55eeba76f9 tempest-FloatingIPDetailsTestJSON-894349538 tempest-FloatingIPDetailsTestJSON-894349538-project] Action: 'create', calling method: .version_select at 0x7f7d44360e50>, body: {"pool": null} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:51:59.621108 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-95d8cde0-a9ce-4f5a-a532-242eb3817ec5 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] 10.222.0.60 "GET /compute/v2.1/servers/3d2d7f4d-e204-42c4-b977-63119c1b8783" status: 200 len: 1316 microversion: 2.1 time: 0.217885 Sep 14 08:51:59.621881 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 420/872] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:51:59 2022] GET /compute/v2.1/servers/3d2d7f4d-e204-42c4-b977-63119c1b8783 => generated 1316 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:51:59.626505 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c272251b-629a-4183-8302-16398d62a928 tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:51:59.627624 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-c272251b-629a-4183-8302-16398d62a928 tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] [instance: bf59291e-0a19-499b-a95b-a76d82b5e307] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:51:59.633569 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c272251b-629a-4183-8302-16398d62a928 tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:59.634143 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c272251b-629a-4183-8302-16398d62a928 tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:59.634679 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c272251b-629a-4183-8302-16398d62a928 tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:59.635497 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c272251b-629a-4183-8302-16398d62a928 tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:59.636028 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c272251b-629a-4183-8302-16398d62a928 tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:59.636539 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c272251b-629a-4183-8302-16398d62a928 tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:59.825711 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.objects.instance [None req-c272251b-629a-4183-8302-16398d62a928 tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Lazy-loading 'services' on Instance uuid bf59291e-0a19-499b-a95b-a76d82b5e307 {{(pid=128758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 08:51:59.840584 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-c272251b-629a-4183-8302-16398d62a928 tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/bf59291e-0a19-499b-a95b-a76d82b5e307" status: 200 len: 2038 microversion: 2.25 time: 0.217370 Sep 14 08:51:59.841331 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 421/873] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:51:59 2022] GET /compute/v2.1/servers/bf59291e-0a19-499b-a95b-a76d82b5e307 => generated 2038 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:51:59.845851 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-616b266f-e5cb-44ed-a498-1156ee9b91a1 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:51:59.848088 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-616b266f-e5cb-44ed-a498-1156ee9b91a1 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: af183467-9304-4c73-a29f-196e76ba21b5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:51:59.854798 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-616b266f-e5cb-44ed-a498-1156ee9b91a1 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:59.855323 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-616b266f-e5cb-44ed-a498-1156ee9b91a1 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:59.855758 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-616b266f-e5cb-44ed-a498-1156ee9b91a1 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:59.856449 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-616b266f-e5cb-44ed-a498-1156ee9b91a1 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:51:59.856905 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-616b266f-e5cb-44ed-a498-1156ee9b91a1 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:51:59.857332 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-616b266f-e5cb-44ed-a498-1156ee9b91a1 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:51:59.954749 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-616b266f-e5cb-44ed-a498-1156ee9b91a1 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:51:59.958497 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:DELETE=3 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:51:59.961575 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-616b266f-e5cb-44ed-a498-1156ee9b91a1 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: af183467-9304-4c73-a29f-196e76ba21b5] Old instance type tempest-test_resize_flavor_-148975218, new instance type m1.heat {{(pid=128758) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 14 08:51:59.969855 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-616b266f-e5cb-44ed-a498-1156ee9b91a1 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Flavor limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 08:51:59.970279 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-616b266f-e5cb-44ed-a498-1156ee9b91a1 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Image limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 08:51:59.970751 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-616b266f-e5cb-44ed-a498-1156ee9b91a1 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Flavor pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 08:51:59.971194 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-616b266f-e5cb-44ed-a498-1156ee9b91a1 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Image pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 08:51:59.971608 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-616b266f-e5cb-44ed-a498-1156ee9b91a1 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 08:52:00.085369 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-616b266f-e5cb-44ed-a498-1156ee9b91a1 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "POST /compute/v2.1/servers/af183467-9304-4c73-a29f-196e76ba21b5/action" status: 202 len: 0 microversion: 2.1 time: 0.242939 Sep 14 08:52:00.086761 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 422/874] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 08:51:59 2022] POST /compute/v2.1/servers/af183467-9304-4c73-a29f-196e76ba21b5/action => generated 0 bytes in 245 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 08:52:00.092979 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-589786ba-5419-4107-b314-cb8c5090cbb4 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:00.093605 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-589786ba-5419-4107-b314-cb8c5090cbb4 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: 874205eb-5321-4a9a-aa38-3cd83b2ac1a3] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:00.101697 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-589786ba-5419-4107-b314-cb8c5090cbb4 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:00.102206 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-589786ba-5419-4107-b314-cb8c5090cbb4 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:00.102650 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-589786ba-5419-4107-b314-cb8c5090cbb4 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:00.103400 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-589786ba-5419-4107-b314-cb8c5090cbb4 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:00.104256 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-589786ba-5419-4107-b314-cb8c5090cbb4 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:00.104695 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-589786ba-5419-4107-b314-cb8c5090cbb4 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:00.688971 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-589786ba-5419-4107-b314-cb8c5090cbb4 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:00.702057 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-589786ba-5419-4107-b314-cb8c5090cbb4 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/874205eb-5321-4a9a-aa38-3cd83b2ac1a3" status: 200 len: 1503 microversion: 2.1 time: 0.613528 Sep 14 08:52:00.703378 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 423/875] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:00 2022] GET /compute/v2.1/servers/874205eb-5321-4a9a-aa38-3cd83b2ac1a3 => generated 1503 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:52:00.712914 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ce1cbf96-da7c-463c-b9a6-7ac44e5bfde7 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Action: 'create', calling method: .version_select at 0x7f7d44939d30>, body: {"keypair": {"name": "tempest-keypair-1521095948", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGVopqdmkg/LnTvY2ovyFuzbCjiRwCE4iuIho3Sern0flS3+woFmjwOfkC+vHMGkGCuCr3GS+OzAHZOZy6H2a0pjLVJlSfhsci34l0cAFXD7otW8xLS2sv3NJA4askCX4g=="}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:52:00.737159 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-ce1cbf96-da7c-463c-b9a6-7ac44e5bfde7 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Getting quotas for project 3850954316f34104b2a8052dc78a50d7. Resources: {'key_pairs'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 08:52:00.743676 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-ce1cbf96-da7c-463c-b9a6-7ac44e5bfde7 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Getting quotas for user f140347422af48a4875e80337a272e29 and project 3850954316f34104b2a8052dc78a50d7. Resources: {'key_pairs'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 08:52:00.798269 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-ce1cbf96-da7c-463c-b9a6-7ac44e5bfde7 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.25 time: 0.092329 Sep 14 08:52:00.800738 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 424/876] 10.222.0.60 () {62 vars in 1200 bytes} [Wed Sep 14 08:52:00 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 97 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 14 08:52:00.815742 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-8a9c0e73-2599-4238-8386-d7451681c60f tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:00.816378 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-8a9c0e73-2599-4238-8386-d7451681c60f tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: af183467-9304-4c73-a29f-196e76ba21b5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:00.836568 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8a9c0e73-2599-4238-8386-d7451681c60f tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:00.839077 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8a9c0e73-2599-4238-8386-d7451681c60f tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:00.839791 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8a9c0e73-2599-4238-8386-d7451681c60f tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:00.842634 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8a9c0e73-2599-4238-8386-d7451681c60f tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:00.843844 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8a9c0e73-2599-4238-8386-d7451681c60f tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:00.844309 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8a9c0e73-2599-4238-8386-d7451681c60f tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:01.218174 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-8a9c0e73-2599-4238-8386-d7451681c60f tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:01.229633 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-8a9c0e73-2599-4238-8386-d7451681c60f tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/af183467-9304-4c73-a29f-196e76ba21b5" status: 200 len: 1536 microversion: 2.1 time: 0.425309 Sep 14 08:52:01.230369 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 425/877] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:00 2022] GET /compute/v2.1/servers/af183467-9304-4c73-a29f-196e76ba21b5 => generated 1536 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:52:01.235896 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d26348a7-b4c7-4d6a-b0ba-106f2c380469 tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:01.236786 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-d26348a7-b4c7-4d6a-b0ba-106f2c380469 tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] [instance: 58b5d8a4-035b-4a2f-8a83-02ea69847900] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:01.248570 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d26348a7-b4c7-4d6a-b0ba-106f2c380469 tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:01.249171 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d26348a7-b4c7-4d6a-b0ba-106f2c380469 tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:01.249777 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d26348a7-b4c7-4d6a-b0ba-106f2c380469 tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:01.250529 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d26348a7-b4c7-4d6a-b0ba-106f2c380469 tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:01.251226 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d26348a7-b4c7-4d6a-b0ba-106f2c380469 tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:01.251890 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d26348a7-b4c7-4d6a-b0ba-106f2c380469 tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:01.586296 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-d26348a7-b4c7-4d6a-b0ba-106f2c380469 tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeaac454f233408ba1597b36bb9277dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38a515fd540744a2bdf6fb971f4a6924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:01.597405 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-d26348a7-b4c7-4d6a-b0ba-106f2c380469 tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] 10.222.0.60 "GET /compute/v2.1/servers/58b5d8a4-035b-4a2f-8a83-02ea69847900" status: 200 len: 1402 microversion: 2.1 time: 0.365691 Sep 14 08:52:01.598672 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 426/878] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:01 2022] GET /compute/v2.1/servers/58b5d8a4-035b-4a2f-8a83-02ea69847900 => generated 1402 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:52:01.605071 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-4a7fde87-7ba0-48e4-ab79-ff097b22e1a8 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:01.605694 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-4a7fde87-7ba0-48e4-ab79-ff097b22e1a8 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] [instance: d4344070-484a-4a5e-9e37-5f3dad6ba536] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:01.620112 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4a7fde87-7ba0-48e4-ab79-ff097b22e1a8 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:01.620666 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4a7fde87-7ba0-48e4-ab79-ff097b22e1a8 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:01.621305 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4a7fde87-7ba0-48e4-ab79-ff097b22e1a8 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:01.621804 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4a7fde87-7ba0-48e4-ab79-ff097b22e1a8 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:01.622264 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4a7fde87-7ba0-48e4-ab79-ff097b22e1a8 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:01.622694 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4a7fde87-7ba0-48e4-ab79-ff097b22e1a8 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:01.817665 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=2 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:52:01.873584 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=10 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:52:01.956063 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-424af7a1-8333-4115-a099-1d55eeba76f9 tempest-FloatingIPDetailsTestJSON-894349538 tempest-FloatingIPDetailsTestJSON-894349538-project] 10.222.0.60 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.345661 Sep 14 08:52:01.967681 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 453/879] 10.222.0.60 () {60 vars in 1170 bytes} [Wed Sep 14 08:51:59 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:52:01.973714 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-1bec41e3-4849-4f4c-a5db-36613800875c tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:01.974624 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-1bec41e3-4849-4f4c-a5db-36613800875c tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] [instance: 4df3f3eb-e900-497d-a1ed-f5e12a0d69a8] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:01.991660 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1bec41e3-4849-4f4c-a5db-36613800875c tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:01.992582 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1bec41e3-4849-4f4c-a5db-36613800875c tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:01.993944 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1bec41e3-4849-4f4c-a5db-36613800875c tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:01.996123 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1bec41e3-4849-4f4c-a5db-36613800875c tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:01.998275 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1bec41e3-4849-4f4c-a5db-36613800875c tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:01.999444 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1bec41e3-4849-4f4c-a5db-36613800875c tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:02.041765 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-4a7fde87-7ba0-48e4-ab79-ff097b22e1a8 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c7802984cf48d1852832b52abe52e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e326f95a9604fdb9bd075db3837cf62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:02.049583 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-4a7fde87-7ba0-48e4-ab79-ff097b22e1a8 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] 10.222.0.60 "GET /compute/v2.1/servers/d4344070-484a-4a5e-9e37-5f3dad6ba536" status: 200 len: 1316 microversion: 2.1 time: 0.449628 Sep 14 08:52:02.050176 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 427/880] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:01 2022] GET /compute/v2.1/servers/d4344070-484a-4a5e-9e37-5f3dad6ba536 => generated 1316 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:52:02.067535 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-11da1b0c-7ff1-456d-bfcb-80ef6bf0e195 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:02.068373 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-11da1b0c-7ff1-456d-bfcb-80ef6bf0e195 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] [instance: 3d2d7f4d-e204-42c4-b977-63119c1b8783] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:02.081692 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-11da1b0c-7ff1-456d-bfcb-80ef6bf0e195 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:02.081901 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-11da1b0c-7ff1-456d-bfcb-80ef6bf0e195 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:02.082297 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-11da1b0c-7ff1-456d-bfcb-80ef6bf0e195 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:02.083225 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-11da1b0c-7ff1-456d-bfcb-80ef6bf0e195 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:02.083842 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-11da1b0c-7ff1-456d-bfcb-80ef6bf0e195 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:02.084649 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-11da1b0c-7ff1-456d-bfcb-80ef6bf0e195 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:02.618656 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-1bec41e3-4849-4f4c-a5db-36613800875c tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b938da87b14cd79c3c6dd85818cd02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee17e19b2f094a899dfc8966152fd642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:02.621110 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-11da1b0c-7ff1-456d-bfcb-80ef6bf0e195 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be69c6b130994b87b32fe1b50916b500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac1cc0aa271432d9b256569e220fc75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:02.633298 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-1bec41e3-4849-4f4c-a5db-36613800875c tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] 10.222.0.60 "GET /compute/v2.1/servers/4df3f3eb-e900-497d-a1ed-f5e12a0d69a8" status: 200 len: 1387 microversion: 2.1 time: 0.663678 Sep 14 08:52:02.634724 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 454/881] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:01 2022] GET /compute/v2.1/servers/4df3f3eb-e900-497d-a1ed-f5e12a0d69a8 => generated 1387 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:52:02.636213 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-11da1b0c-7ff1-456d-bfcb-80ef6bf0e195 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] 10.222.0.60 "GET /compute/v2.1/servers/3d2d7f4d-e204-42c4-b977-63119c1b8783" status: 200 len: 1504 microversion: 2.1 time: 0.584990 Sep 14 08:52:02.640194 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 428/882] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:02 2022] GET /compute/v2.1/servers/3d2d7f4d-e204-42c4-b977-63119c1b8783 => generated 1504 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:52:02.640844 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-8d7c86a2-d12f-401b-a1c1-7b74127423fb req-9ebe44e7-35b8-4249-a8a3-409f1d663b63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58b5d8a4-035b-4a2f-8a83-02ea69847900", "tag": "742f5d4d-837e-4e1e-8b53-228d7a64de9b"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:52:02.649108 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-7cfda058-5477-43d4-98db-a1e8f2a213e3 req-f5a6aacc-21d2-4d1d-a588-9c578ec880e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "874205eb-5321-4a9a-aa38-3cd83b2ac1a3", "name": "network-vif-unplugged", "status": "completed", "tag": "629e6ee9-90f6-4562-b850-5f55a39582b9"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:52:02.666015 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-8d7c86a2-d12f-401b-a1c1-7b74127423fb req-9ebe44e7-35b8-4249-a8a3-409f1d663b63 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:02.666791 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-8d7c86a2-d12f-401b-a1c1-7b74127423fb req-9ebe44e7-35b8-4249-a8a3-409f1d663b63 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:02.667364 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-8d7c86a2-d12f-401b-a1c1-7b74127423fb req-9ebe44e7-35b8-4249-a8a3-409f1d663b63 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:02.668036 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-7cfda058-5477-43d4-98db-a1e8f2a213e3 req-f5a6aacc-21d2-4d1d-a588-9c578ec880e3 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:02.668603 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-7cfda058-5477-43d4-98db-a1e8f2a213e3 req-f5a6aacc-21d2-4d1d-a588-9c578ec880e3 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:02.669273 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-7cfda058-5477-43d4-98db-a1e8f2a213e3 req-f5a6aacc-21d2-4d1d-a588-9c578ec880e3 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:02.687509 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-8d7c86a2-d12f-401b-a1c1-7b74127423fb req-9ebe44e7-35b8-4249-a8a3-409f1d663b63 service nova] Creating event network-changed:742f5d4d-837e-4e1e-8b53-228d7a64de9b for instance 58b5d8a4-035b-4a2f-8a83-02ea69847900 on n-h1-836830-18 Sep 14 08:52:02.693450 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-8d7c86a2-d12f-401b-a1c1-7b74127423fb req-9ebe44e7-35b8-4249-a8a3-409f1d663b63 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057203 Sep 14 08:52:02.694682 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 455/883] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:52:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:52:02.697251 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-7cfda058-5477-43d4-98db-a1e8f2a213e3 req-f5a6aacc-21d2-4d1d-a588-9c578ec880e3 service nova] Creating event network-vif-unplugged:629e6ee9-90f6-4562-b850-5f55a39582b9 for instance 874205eb-5321-4a9a-aa38-3cd83b2ac1a3 on n-h1-836830-18 Sep 14 08:52:02.702996 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-61249077-5567-415a-9131-1978bf982ffd tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:02.704002 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-61249077-5567-415a-9131-1978bf982ffd tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: 874205eb-5321-4a9a-aa38-3cd83b2ac1a3] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:02.707400 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-7cfda058-5477-43d4-98db-a1e8f2a213e3 req-f5a6aacc-21d2-4d1d-a588-9c578ec880e3 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.065551 Sep 14 08:52:02.708611 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 429/884] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:52:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:52:02.714516 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-7a48c56b-c5b6-40ed-8910-b18edceca04e tempest-FloatingIPDetailsTestJSON-894349538 tempest-FloatingIPDetailsTestJSON-894349538-project] Calling method '.version_select at 0x7f7d44cbb5e0>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:02.715341 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-61249077-5567-415a-9131-1978bf982ffd tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:02.716019 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-61249077-5567-415a-9131-1978bf982ffd tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:02.717133 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-61249077-5567-415a-9131-1978bf982ffd tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:02.718001 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-61249077-5567-415a-9131-1978bf982ffd tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:02.718605 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-61249077-5567-415a-9131-1978bf982ffd tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:02.719947 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-61249077-5567-415a-9131-1978bf982ffd tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:03.194091 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-61249077-5567-415a-9131-1978bf982ffd tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:03.207555 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-61249077-5567-415a-9131-1978bf982ffd tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/874205eb-5321-4a9a-aa38-3cd83b2ac1a3" status: 200 len: 1503 microversion: 2.1 time: 0.511168 Sep 14 08:52:03.208722 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 456/885] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:02 2022] GET /compute/v2.1/servers/874205eb-5321-4a9a-aa38-3cd83b2ac1a3 => generated 1503 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:52:03.214455 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-bfcea1c2-8d1b-43ea-a599-8d4512da34e9 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:03.215094 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-bfcea1c2-8d1b-43ea-a599-8d4512da34e9 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: af183467-9304-4c73-a29f-196e76ba21b5] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:03.223254 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bfcea1c2-8d1b-43ea-a599-8d4512da34e9 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:03.223944 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bfcea1c2-8d1b-43ea-a599-8d4512da34e9 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:03.224534 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bfcea1c2-8d1b-43ea-a599-8d4512da34e9 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:03.225641 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bfcea1c2-8d1b-43ea-a599-8d4512da34e9 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:03.226249 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bfcea1c2-8d1b-43ea-a599-8d4512da34e9 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:03.226831 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bfcea1c2-8d1b-43ea-a599-8d4512da34e9 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:03.228222 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-7a48c56b-c5b6-40ed-8910-b18edceca04e tempest-FloatingIPDetailsTestJSON-894349538 tempest-FloatingIPDetailsTestJSON-894349538-project] 10.222.0.60 "GET /compute/v2.1/os-floating-ips/bbd3fd32-cc52-47d2-9cc8-760e3cf1d761" status: 200 len: 142 microversion: 2.1 time: 0.518230 Sep 14 08:52:03.228809 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 430/886] 10.222.0.60 () {58 vars in 1260 bytes} [Wed Sep 14 08:52:02 2022] GET /compute/v2.1/os-floating-ips/bbd3fd32-cc52-47d2-9cc8-760e3cf1d761 => generated 142 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:52:03.234093 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-47189734-56c7-4277-8cf6-44e1e41a2160 tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:03.235026 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-47189734-56c7-4277-8cf6-44e1e41a2160 tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] [instance: 58b5d8a4-035b-4a2f-8a83-02ea69847900] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:03.248807 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-47189734-56c7-4277-8cf6-44e1e41a2160 tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:03.251588 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-47189734-56c7-4277-8cf6-44e1e41a2160 tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:03.252238 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-47189734-56c7-4277-8cf6-44e1e41a2160 tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:03.253128 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-47189734-56c7-4277-8cf6-44e1e41a2160 tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:03.258482 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-47189734-56c7-4277-8cf6-44e1e41a2160 tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:03.259159 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-47189734-56c7-4277-8cf6-44e1e41a2160 tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:03.463034 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-bfcea1c2-8d1b-43ea-a599-8d4512da34e9 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:03.471415 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-47189734-56c7-4277-8cf6-44e1e41a2160 tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeaac454f233408ba1597b36bb9277dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38a515fd540744a2bdf6fb971f4a6924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:03.472262 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-bfcea1c2-8d1b-43ea-a599-8d4512da34e9 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/af183467-9304-4c73-a29f-196e76ba21b5" status: 200 len: 1536 microversion: 2.1 time: 0.262260 Sep 14 08:52:03.473413 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 457/887] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:03 2022] GET /compute/v2.1/servers/af183467-9304-4c73-a29f-196e76ba21b5 => generated 1536 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:52:03.479284 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-47bbea9d-a760-4783-8e6b-c09c148c874b tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:03.479730 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-47189734-56c7-4277-8cf6-44e1e41a2160 tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] 10.222.0.60 "GET /compute/v2.1/servers/58b5d8a4-035b-4a2f-8a83-02ea69847900" status: 200 len: 1402 microversion: 2.1 time: 0.249478 Sep 14 08:52:03.480546 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 431/888] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:03 2022] GET /compute/v2.1/servers/58b5d8a4-035b-4a2f-8a83-02ea69847900 => generated 1402 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:52:03.480671 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-47bbea9d-a760-4783-8e6b-c09c148c874b tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] [instance: 3d2d7f4d-e204-42c4-b977-63119c1b8783] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:03.486746 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-47bbea9d-a760-4783-8e6b-c09c148c874b tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:03.487316 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-47bbea9d-a760-4783-8e6b-c09c148c874b tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:03.488840 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-47bbea9d-a760-4783-8e6b-c09c148c874b tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:03.489540 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-47bbea9d-a760-4783-8e6b-c09c148c874b tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:03.489995 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-47bbea9d-a760-4783-8e6b-c09c148c874b tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:03.490413 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-47bbea9d-a760-4783-8e6b-c09c148c874b tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:03.510365 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ff3589ab-bf83-418f-a1ba-cd91bcf66a75 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1913417741", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "networks": [{"uuid": "371ca8d4-dbd6-426c-b295-7fe3200f1240"}], "security_groups": [{"name": "tempest-securitygroup--1932373497"}], "key_name": "tempest-keypair-1521095948", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:52:03.518266 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-47bbea9d-a760-4783-8e6b-c09c148c874b tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] [instance: 3d2d7f4d-e204-42c4-b977-63119c1b8783] Going to try to terminate instance {{(pid=128759) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 08:52:03.623997 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-47bbea9d-a760-4783-8e6b-c09c148c874b tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] 10.222.0.60 "DELETE /compute/v2.1/servers/3d2d7f4d-e204-42c4-b977-63119c1b8783" status: 204 len: 0 microversion: 2.1 time: 0.148932 Sep 14 08:52:03.624595 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 458/889] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 08:52:03 2022] DELETE /compute/v2.1/servers/3d2d7f4d-e204-42c4-b977-63119c1b8783 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 08:52:03.631895 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-baff8130-a30b-42df-aa5a-31cc5e5a50be tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:03.632597 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-baff8130-a30b-42df-aa5a-31cc5e5a50be tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] [instance: d4344070-484a-4a5e-9e37-5f3dad6ba536] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:03.633641 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.network.neutron [None req-ff3589ab-bf83-418f-a1ba-cd91bcf66a75 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] validate_networks() for [('371ca8d4-dbd6-426c-b295-7fe3200f1240', None, None, None, None, None)] {{(pid=128758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 08:52:03.638354 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-baff8130-a30b-42df-aa5a-31cc5e5a50be tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:03.638840 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-baff8130-a30b-42df-aa5a-31cc5e5a50be tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:03.639315 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-baff8130-a30b-42df-aa5a-31cc5e5a50be tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:03.640006 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-baff8130-a30b-42df-aa5a-31cc5e5a50be tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:03.640458 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-baff8130-a30b-42df-aa5a-31cc5e5a50be tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:03.640882 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-baff8130-a30b-42df-aa5a-31cc5e5a50be tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:03.837667 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-baff8130-a30b-42df-aa5a-31cc5e5a50be tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c7802984cf48d1852832b52abe52e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e326f95a9604fdb9bd075db3837cf62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:03.845923 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-baff8130-a30b-42df-aa5a-31cc5e5a50be tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] 10.222.0.60 "GET /compute/v2.1/servers/d4344070-484a-4a5e-9e37-5f3dad6ba536" status: 200 len: 1316 microversion: 2.1 time: 0.220146 Sep 14 08:52:03.846501 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 459/890] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:03 2022] GET /compute/v2.1/servers/d4344070-484a-4a5e-9e37-5f3dad6ba536 => generated 1316 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:52:03.851137 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-170200c3-457f-4ead-97aa-f6b06f084d37 tempest-FloatingIPDetailsTestJSON-894349538 tempest-FloatingIPDetailsTestJSON-894349538-project] Calling method '.version_select at 0x7f7d4452de50>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:04.009472 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=6 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:52:04.554197 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-ff3589ab-bf83-418f-a1ba-cd91bcf66a75 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Flavor limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 08:52:04.555100 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-ff3589ab-bf83-418f-a1ba-cd91bcf66a75 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Image limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 08:52:04.555986 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-ff3589ab-bf83-418f-a1ba-cd91bcf66a75 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Flavor pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 08:52:04.556749 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-ff3589ab-bf83-418f-a1ba-cd91bcf66a75 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Image pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 08:52:04.557399 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-ff3589ab-bf83-418f-a1ba-cd91bcf66a75 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 08:52:04.571601 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ff3589ab-bf83-418f-a1ba-cd91bcf66a75 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:04.572280 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ff3589ab-bf83-418f-a1ba-cd91bcf66a75 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:04.572815 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ff3589ab-bf83-418f-a1ba-cd91bcf66a75 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:04.573661 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ff3589ab-bf83-418f-a1ba-cd91bcf66a75 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:04.574188 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ff3589ab-bf83-418f-a1ba-cd91bcf66a75 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:04.574770 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ff3589ab-bf83-418f-a1ba-cd91bcf66a75 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:04.592214 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-ff3589ab-bf83-418f-a1ba-cd91bcf66a75 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Getting quotas for project 3850954316f34104b2a8052dc78a50d7. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 08:52:04.598038 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-ff3589ab-bf83-418f-a1ba-cd91bcf66a75 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Getting quotas for user f140347422af48a4875e80337a272e29 and project 3850954316f34104b2a8052dc78a50d7. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 08:52:04.611564 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-ff3589ab-bf83-418f-a1ba-cd91bcf66a75 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Going to run 1 instances... {{(pid=128758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 08:52:04.613874 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-ff3589ab-bf83-418f-a1ba-cd91bcf66a75 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: 8fce8438-d6ae-408d-8b4f-ee14d4021fdd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 08:52:04.661636 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-ff3589ab-bf83-418f-a1ba-cd91bcf66a75 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.25 time: 1.179661 Sep 14 08:52:04.662214 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 432/891] 10.222.0.60 () {62 vars in 1188 bytes} [Wed Sep 14 08:52:03 2022] POST /compute/v2.1/servers => generated 406 bytes in 1181 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 14 08:52:04.667583 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-0160c2e0-3824-4661-83ad-03bc6a6f9b49 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:04.668200 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-0160c2e0-3824-4661-83ad-03bc6a6f9b49 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] [instance: 3d2d7f4d-e204-42c4-b977-63119c1b8783] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:04.674528 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0160c2e0-3824-4661-83ad-03bc6a6f9b49 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:04.675279 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0160c2e0-3824-4661-83ad-03bc6a6f9b49 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:04.675890 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0160c2e0-3824-4661-83ad-03bc6a6f9b49 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:04.676756 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0160c2e0-3824-4661-83ad-03bc6a6f9b49 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:04.677375 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0160c2e0-3824-4661-83ad-03bc6a6f9b49 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:04.677975 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0160c2e0-3824-4661-83ad-03bc6a6f9b49 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:04.880814 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-0160c2e0-3824-4661-83ad-03bc6a6f9b49 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be69c6b130994b87b32fe1b50916b500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac1cc0aa271432d9b256569e220fc75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:04.883836 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:52:04.891291 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-0160c2e0-3824-4661-83ad-03bc6a6f9b49 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] 10.222.0.60 "GET /compute/v2.1/servers/3d2d7f4d-e204-42c4-b977-63119c1b8783" status: 200 len: 1510 microversion: 2.1 time: 0.227180 Sep 14 08:52:04.891886 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 433/892] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:04 2022] GET /compute/v2.1/servers/3d2d7f4d-e204-42c4-b977-63119c1b8783 => generated 1510 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:52:04.896656 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-637f25ff-297d-4709-8c85-ad672e08bc6a tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:04.897883 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-637f25ff-297d-4709-8c85-ad672e08bc6a tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] [instance: 4df3f3eb-e900-497d-a1ed-f5e12a0d69a8] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:04.905273 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-637f25ff-297d-4709-8c85-ad672e08bc6a tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:04.905765 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-637f25ff-297d-4709-8c85-ad672e08bc6a tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:04.906199 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-637f25ff-297d-4709-8c85-ad672e08bc6a tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:04.906895 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-637f25ff-297d-4709-8c85-ad672e08bc6a tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:04.907376 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-637f25ff-297d-4709-8c85-ad672e08bc6a tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:04.907799 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-637f25ff-297d-4709-8c85-ad672e08bc6a tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:05.128402 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-637f25ff-297d-4709-8c85-ad672e08bc6a tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b938da87b14cd79c3c6dd85818cd02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee17e19b2f094a899dfc8966152fd642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:05.140694 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-637f25ff-297d-4709-8c85-ad672e08bc6a tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] 10.222.0.60 "GET /compute/v2.1/servers/4df3f3eb-e900-497d-a1ed-f5e12a0d69a8" status: 200 len: 1387 microversion: 2.1 time: 0.247731 Sep 14 08:52:05.151056 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 434/893] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:04 2022] GET /compute/v2.1/servers/4df3f3eb-e900-497d-a1ed-f5e12a0d69a8 => generated 1387 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:52:05.151056 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-c49568b4-2567-4d2f-b08f-e7b60a14cb81 req-92dee72a-eb39-43ac-aa2c-07fa662933bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4df3f3eb-e900-497d-a1ed-f5e12a0d69a8", "name": "network-vif-plugged", "status": "completed", "tag": "2598a43e-0827-49bc-952a-840f14b2612a"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:52:05.160618 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-c49568b4-2567-4d2f-b08f-e7b60a14cb81 req-92dee72a-eb39-43ac-aa2c-07fa662933bb service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:05.161102 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-c49568b4-2567-4d2f-b08f-e7b60a14cb81 req-92dee72a-eb39-43ac-aa2c-07fa662933bb service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:05.161527 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-c49568b4-2567-4d2f-b08f-e7b60a14cb81 req-92dee72a-eb39-43ac-aa2c-07fa662933bb service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:05.175368 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-c49568b4-2567-4d2f-b08f-e7b60a14cb81 req-92dee72a-eb39-43ac-aa2c-07fa662933bb service nova] Creating event network-vif-plugged:2598a43e-0827-49bc-952a-840f14b2612a for instance 4df3f3eb-e900-497d-a1ed-f5e12a0d69a8 on n-h2-836830-18 Sep 14 08:52:05.180889 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-c49568b4-2567-4d2f-b08f-e7b60a14cb81 req-92dee72a-eb39-43ac-aa2c-07fa662933bb service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035750 Sep 14 08:52:05.181787 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 435/894] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:52:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:52:05.187221 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-cec6932a-6564-400d-86bf-bf605e3f807f tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:05.188436 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-cec6932a-6564-400d-86bf-bf605e3f807f tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: 874205eb-5321-4a9a-aa38-3cd83b2ac1a3] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:05.195234 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cec6932a-6564-400d-86bf-bf605e3f807f tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:05.195772 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cec6932a-6564-400d-86bf-bf605e3f807f tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:05.196117 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-170200c3-457f-4ead-97aa-f6b06f084d37 tempest-FloatingIPDetailsTestJSON-894349538 tempest-FloatingIPDetailsTestJSON-894349538-project] 10.222.0.60 "DELETE /compute/v2.1/os-floating-ips/bbd3fd32-cc52-47d2-9cc8-760e3cf1d761" status: 202 len: 0 microversion: 2.1 time: 1.348382 Sep 14 08:52:05.196585 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cec6932a-6564-400d-86bf-bf605e3f807f tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:05.196894 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cec6932a-6564-400d-86bf-bf605e3f807f tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:05.197350 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cec6932a-6564-400d-86bf-bf605e3f807f tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:05.197544 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 460/895] 10.222.0.60 () {58 vars in 1263 bytes} [Wed Sep 14 08:52:03 2022] DELETE /compute/v2.1/os-floating-ips/bbd3fd32-cc52-47d2-9cc8-760e3cf1d761 => generated 0 bytes in 1350 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 08:52:05.202594 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e72b2f3d-5508-45cf-af52-d15b99049d6f tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:05.202731 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cec6932a-6564-400d-86bf-bf605e3f807f tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:05.203236 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e72b2f3d-5508-45cf-af52-d15b99049d6f tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: af183467-9304-4c73-a29f-196e76ba21b5] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:05.210343 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e72b2f3d-5508-45cf-af52-d15b99049d6f tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:05.210839 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e72b2f3d-5508-45cf-af52-d15b99049d6f tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:05.211312 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e72b2f3d-5508-45cf-af52-d15b99049d6f tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:05.212101 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e72b2f3d-5508-45cf-af52-d15b99049d6f tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:05.212670 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e72b2f3d-5508-45cf-af52-d15b99049d6f tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:05.213312 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e72b2f3d-5508-45cf-af52-d15b99049d6f tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:05.550417 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-e72b2f3d-5508-45cf-af52-d15b99049d6f tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:05.569423 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e72b2f3d-5508-45cf-af52-d15b99049d6f tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/af183467-9304-4c73-a29f-196e76ba21b5" status: 200 len: 1536 microversion: 2.1 time: 0.370787 Sep 14 08:52:05.583883 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-cec6932a-6564-400d-86bf-bf605e3f807f tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:05.584799 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 461/896] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:05 2022] GET /compute/v2.1/servers/af183467-9304-4c73-a29f-196e76ba21b5 => generated 1536 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:52:05.591997 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-2fd3f765-b491-49c7-ba8a-512e0e88818a tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:05.592843 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-2fd3f765-b491-49c7-ba8a-512e0e88818a tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] [instance: 58b5d8a4-035b-4a2f-8a83-02ea69847900] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:05.593148 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-cec6932a-6564-400d-86bf-bf605e3f807f tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/874205eb-5321-4a9a-aa38-3cd83b2ac1a3" status: 200 len: 1503 microversion: 2.1 time: 0.409887 Sep 14 08:52:05.593768 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 436/897] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:05 2022] GET /compute/v2.1/servers/874205eb-5321-4a9a-aa38-3cd83b2ac1a3 => generated 1503 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:52:05.599892 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2fd3f765-b491-49c7-ba8a-512e0e88818a tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:05.600983 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-7a0342cf-8337-41d0-b2cc-c3f3d0e61a0d tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:05.601350 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2fd3f765-b491-49c7-ba8a-512e0e88818a tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:05.601610 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-7a0342cf-8337-41d0-b2cc-c3f3d0e61a0d tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: 8fce8438-d6ae-408d-8b4f-ee14d4021fdd] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:05.602120 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2fd3f765-b491-49c7-ba8a-512e0e88818a tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:05.603102 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2fd3f765-b491-49c7-ba8a-512e0e88818a tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:05.603711 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2fd3f765-b491-49c7-ba8a-512e0e88818a tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:05.604290 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2fd3f765-b491-49c7-ba8a-512e0e88818a tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:05.621104 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7a0342cf-8337-41d0-b2cc-c3f3d0e61a0d tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:05.622424 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7a0342cf-8337-41d0-b2cc-c3f3d0e61a0d tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:05.622872 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7a0342cf-8337-41d0-b2cc-c3f3d0e61a0d tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:05.623649 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7a0342cf-8337-41d0-b2cc-c3f3d0e61a0d tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:05.624114 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7a0342cf-8337-41d0-b2cc-c3f3d0e61a0d tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:05.624693 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7a0342cf-8337-41d0-b2cc-c3f3d0e61a0d tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:05.737641 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-7a0342cf-8337-41d0-b2cc-c3f3d0e61a0d tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:05.746016 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-7a0342cf-8337-41d0-b2cc-c3f3d0e61a0d tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:05.747537 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-7a0342cf-8337-41d0-b2cc-c3f3d0e61a0d tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:05.748855 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-7a0342cf-8337-41d0-b2cc-c3f3d0e61a0d tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd" status: 200 len: 1338 microversion: 2.25 time: 0.153851 Sep 14 08:52:05.749422 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 437/898] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:52:05 2022] GET /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd => generated 1338 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:52:05.753922 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-440b9619-caab-423a-b136-7d840c778eb2 req-5f41d8ff-b596-45ac-a7ca-cfa8e7f3776e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "874205eb-5321-4a9a-aa38-3cd83b2ac1a3", "tag": "629e6ee9-90f6-4562-b850-5f55a39582b9"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:52:05.763117 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-440b9619-caab-423a-b136-7d840c778eb2 req-5f41d8ff-b596-45ac-a7ca-cfa8e7f3776e service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:05.763595 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-440b9619-caab-423a-b136-7d840c778eb2 req-5f41d8ff-b596-45ac-a7ca-cfa8e7f3776e service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:05.764023 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-440b9619-caab-423a-b136-7d840c778eb2 req-5f41d8ff-b596-45ac-a7ca-cfa8e7f3776e service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:05.775486 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-440b9619-caab-423a-b136-7d840c778eb2 req-5f41d8ff-b596-45ac-a7ca-cfa8e7f3776e service nova] Creating event network-changed:629e6ee9-90f6-4562-b850-5f55a39582b9 for instance 874205eb-5321-4a9a-aa38-3cd83b2ac1a3 on n-h1-836830-18 Sep 14 08:52:05.780262 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-440b9619-caab-423a-b136-7d840c778eb2 req-5f41d8ff-b596-45ac-a7ca-cfa8e7f3776e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029577 Sep 14 08:52:05.780860 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 438/899] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:52:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:52:05.785745 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-064289de-cadf-4792-bdc3-1e66f7344e3c tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:05.786453 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-064289de-cadf-4792-bdc3-1e66f7344e3c tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] [instance: d4344070-484a-4a5e-9e37-5f3dad6ba536] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:05.793037 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-064289de-cadf-4792-bdc3-1e66f7344e3c tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:05.793525 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-064289de-cadf-4792-bdc3-1e66f7344e3c tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:05.793960 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-064289de-cadf-4792-bdc3-1e66f7344e3c tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:05.794685 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-064289de-cadf-4792-bdc3-1e66f7344e3c tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:05.795167 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-064289de-cadf-4792-bdc3-1e66f7344e3c tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:05.795585 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-064289de-cadf-4792-bdc3-1e66f7344e3c tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:05.885933 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-2fd3f765-b491-49c7-ba8a-512e0e88818a tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeaac454f233408ba1597b36bb9277dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38a515fd540744a2bdf6fb971f4a6924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:05.895060 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-2fd3f765-b491-49c7-ba8a-512e0e88818a tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] 10.222.0.60 "GET /compute/v2.1/servers/58b5d8a4-035b-4a2f-8a83-02ea69847900" status: 200 len: 1402 microversion: 2.1 time: 0.308957 Sep 14 08:52:05.895905 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 462/900] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:05 2022] GET /compute/v2.1/servers/58b5d8a4-035b-4a2f-8a83-02ea69847900 => generated 1402 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:52:05.901031 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e41c798a-3763-436e-8618-e4dabf78c8c3 tempest-FloatingIPDetailsTestJSON-894349538 tempest-FloatingIPDetailsTestJSON-894349538-project] Calling method '.version_select at 0x7f7d443a8310>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:06.183200 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-064289de-cadf-4792-bdc3-1e66f7344e3c tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c7802984cf48d1852832b52abe52e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e326f95a9604fdb9bd075db3837cf62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:06.192039 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-064289de-cadf-4792-bdc3-1e66f7344e3c tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] 10.222.0.60 "GET /compute/v2.1/servers/d4344070-484a-4a5e-9e37-5f3dad6ba536" status: 200 len: 1316 microversion: 2.1 time: 0.410006 Sep 14 08:52:06.192648 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 439/901] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:05 2022] GET /compute/v2.1/servers/d4344070-484a-4a5e-9e37-5f3dad6ba536 => generated 1316 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:52:06.200740 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-f2974b30-6c92-4632-9e7e-60d69d856cb0 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:06.201360 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-f2974b30-6c92-4632-9e7e-60d69d856cb0 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] [instance: 3d2d7f4d-e204-42c4-b977-63119c1b8783] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:06.207560 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f2974b30-6c92-4632-9e7e-60d69d856cb0 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:06.208245 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f2974b30-6c92-4632-9e7e-60d69d856cb0 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:06.208963 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f2974b30-6c92-4632-9e7e-60d69d856cb0 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:06.210378 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f2974b30-6c92-4632-9e7e-60d69d856cb0 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:06.211053 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f2974b30-6c92-4632-9e7e-60d69d856cb0 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:06.211634 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f2974b30-6c92-4632-9e7e-60d69d856cb0 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:06.212902 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e41c798a-3763-436e-8618-e4dabf78c8c3 tempest-FloatingIPDetailsTestJSON-894349538 tempest-FloatingIPDetailsTestJSON-894349538-project] 10.222.0.60 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.315545 Sep 14 08:52:06.213975 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 463/902] 10.222.0.60 () {58 vars in 1164 bytes} [Wed Sep 14 08:52:05 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 08:52:06.220760 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-5528667c-2986-428f-b7a7-fd7ecc2eb7bb tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:06.221913 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-5528667c-2986-428f-b7a7-fd7ecc2eb7bb tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] [instance: 4df3f3eb-e900-497d-a1ed-f5e12a0d69a8] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:06.228696 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5528667c-2986-428f-b7a7-fd7ecc2eb7bb tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:06.230044 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5528667c-2986-428f-b7a7-fd7ecc2eb7bb tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:06.230597 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5528667c-2986-428f-b7a7-fd7ecc2eb7bb tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:06.231495 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5528667c-2986-428f-b7a7-fd7ecc2eb7bb tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:06.233135 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5528667c-2986-428f-b7a7-fd7ecc2eb7bb tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:06.234467 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5528667c-2986-428f-b7a7-fd7ecc2eb7bb tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:06.292418 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-f2974b30-6c92-4632-9e7e-60d69d856cb0 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be69c6b130994b87b32fe1b50916b500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac1cc0aa271432d9b256569e220fc75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:06.300435 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-f2974b30-6c92-4632-9e7e-60d69d856cb0 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] 10.222.0.60 "GET /compute/v2.1/servers/3d2d7f4d-e204-42c4-b977-63119c1b8783" status: 200 len: 1468 microversion: 2.1 time: 0.106519 Sep 14 08:52:06.301008 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 440/903] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:06 2022] GET /compute/v2.1/servers/3d2d7f4d-e204-42c4-b977-63119c1b8783 => generated 1468 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:52:06.305711 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c40ebce9-0f52-44c1-80fb-41dcdc3701da tempest-FloatingIPDetailsTestJSON-894349538 tempest-FloatingIPDetailsTestJSON-894349538-project] Calling method '.version_select at 0x7f7d44b9d940>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:06.638701 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-5528667c-2986-428f-b7a7-fd7ecc2eb7bb tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b938da87b14cd79c3c6dd85818cd02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee17e19b2f094a899dfc8966152fd642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:06.646860 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-5528667c-2986-428f-b7a7-fd7ecc2eb7bb tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] 10.222.0.60 "GET /compute/v2.1/servers/4df3f3eb-e900-497d-a1ed-f5e12a0d69a8" status: 200 len: 1387 microversion: 2.1 time: 0.431654 Sep 14 08:52:06.647469 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 464/904] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:06 2022] GET /compute/v2.1/servers/4df3f3eb-e900-497d-a1ed-f5e12a0d69a8 => generated 1387 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:52:06.651999 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-0f5de285-a654-45bd-9e0a-5f18e9875d73 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:06.652620 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-0f5de285-a654-45bd-9e0a-5f18e9875d73 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: af183467-9304-4c73-a29f-196e76ba21b5] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:06.658233 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0f5de285-a654-45bd-9e0a-5f18e9875d73 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:06.658722 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0f5de285-a654-45bd-9e0a-5f18e9875d73 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:06.659197 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0f5de285-a654-45bd-9e0a-5f18e9875d73 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:06.660092 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0f5de285-a654-45bd-9e0a-5f18e9875d73 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:06.660551 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0f5de285-a654-45bd-9e0a-5f18e9875d73 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:06.660981 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0f5de285-a654-45bd-9e0a-5f18e9875d73 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:06.678188 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-c40ebce9-0f52-44c1-80fb-41dcdc3701da tempest-FloatingIPDetailsTestJSON-894349538 tempest-FloatingIPDetailsTestJSON-894349538-project] 10.222.0.60 "GET /compute/v2.1/os-floating-ips" status: 200 len: 398 microversion: 2.1 time: 0.376137 Sep 14 08:52:06.679498 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 441/905] 10.222.0.60 () {58 vars in 1149 bytes} [Wed Sep 14 08:52:06 2022] GET /compute/v2.1/os-floating-ips => generated 398 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:52:06.684657 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d5c7b141-c476-45a7-81f5-00ba83ba04dc tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:06.685274 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-d5c7b141-c476-45a7-81f5-00ba83ba04dc tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: 874205eb-5321-4a9a-aa38-3cd83b2ac1a3] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:06.691678 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d5c7b141-c476-45a7-81f5-00ba83ba04dc tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:06.692247 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d5c7b141-c476-45a7-81f5-00ba83ba04dc tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:06.692688 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d5c7b141-c476-45a7-81f5-00ba83ba04dc tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:06.693424 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d5c7b141-c476-45a7-81f5-00ba83ba04dc tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:06.693882 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d5c7b141-c476-45a7-81f5-00ba83ba04dc tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:06.695078 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d5c7b141-c476-45a7-81f5-00ba83ba04dc tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:06.973384 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-0f5de285-a654-45bd-9e0a-5f18e9875d73 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:06.983006 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-0f5de285-a654-45bd-9e0a-5f18e9875d73 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/af183467-9304-4c73-a29f-196e76ba21b5" status: 200 len: 1536 microversion: 2.1 time: 0.334497 Sep 14 08:52:06.983988 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 465/906] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:06 2022] GET /compute/v2.1/servers/af183467-9304-4c73-a29f-196e76ba21b5 => generated 1536 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:52:06.990039 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-eb2a43e0-bacb-4554-b1e5-6777b25c73cd tempest-FloatingIPDetailsTestJSON-894349538 tempest-FloatingIPDetailsTestJSON-894349538-project] Calling method '.version_select at 0x7f7d44384e50>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:07.100884 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-d5c7b141-c476-45a7-81f5-00ba83ba04dc tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:07.109632 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-d5c7b141-c476-45a7-81f5-00ba83ba04dc tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/874205eb-5321-4a9a-aa38-3cd83b2ac1a3" status: 200 len: 1503 microversion: 2.1 time: 0.428707 Sep 14 08:52:07.124404 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 442/907] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:06 2022] GET /compute/v2.1/servers/874205eb-5321-4a9a-aa38-3cd83b2ac1a3 => generated 1503 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:52:07.134501 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b44c3776-0240-43b4-84cf-0a1be6947504 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:07.135492 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-b44c3776-0240-43b4-84cf-0a1be6947504 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: 8fce8438-d6ae-408d-8b4f-ee14d4021fdd] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:07.142798 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b44c3776-0240-43b4-84cf-0a1be6947504 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:07.143746 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b44c3776-0240-43b4-84cf-0a1be6947504 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:07.144394 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b44c3776-0240-43b4-84cf-0a1be6947504 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:07.145465 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b44c3776-0240-43b4-84cf-0a1be6947504 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:07.146246 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b44c3776-0240-43b4-84cf-0a1be6947504 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:07.146874 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b44c3776-0240-43b4-84cf-0a1be6947504 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:07.278764 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-b44c3776-0240-43b4-84cf-0a1be6947504 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:07.288151 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-b44c3776-0240-43b4-84cf-0a1be6947504 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:07.289601 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-b44c3776-0240-43b4-84cf-0a1be6947504 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:07.290706 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-b44c3776-0240-43b4-84cf-0a1be6947504 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd" status: 200 len: 1356 microversion: 2.25 time: 0.165039 Sep 14 08:52:07.291297 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 443/908] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:52:07 2022] GET /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd => generated 1356 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:52:07.295700 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-7817236f-2ee7-4e2a-b23d-d9d92c36f5d7 tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:07.296299 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-7817236f-2ee7-4e2a-b23d-d9d92c36f5d7 tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] [instance: 58b5d8a4-035b-4a2f-8a83-02ea69847900] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:07.302151 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7817236f-2ee7-4e2a-b23d-d9d92c36f5d7 tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:07.302638 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7817236f-2ee7-4e2a-b23d-d9d92c36f5d7 tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:07.303112 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7817236f-2ee7-4e2a-b23d-d9d92c36f5d7 tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:07.304327 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7817236f-2ee7-4e2a-b23d-d9d92c36f5d7 tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:07.304785 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7817236f-2ee7-4e2a-b23d-d9d92c36f5d7 tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:07.305464 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7817236f-2ee7-4e2a-b23d-d9d92c36f5d7 tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:08.060860 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-7817236f-2ee7-4e2a-b23d-d9d92c36f5d7 tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeaac454f233408ba1597b36bb9277dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38a515fd540744a2bdf6fb971f4a6924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:08.074777 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-7817236f-2ee7-4e2a-b23d-d9d92c36f5d7 tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] 10.222.0.60 "GET /compute/v2.1/servers/58b5d8a4-035b-4a2f-8a83-02ea69847900" status: 200 len: 1402 microversion: 2.1 time: 0.782090 Sep 14 08:52:08.088853 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 444/909] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:07 2022] GET /compute/v2.1/servers/58b5d8a4-035b-4a2f-8a83-02ea69847900 => generated 1402 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:52:08.108113 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-acb97f7d-0b08-4914-8d09-5b267b337861 req-253dd80e-4f8f-4319-bcd3-a478b9ad3500 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4344070-484a-4a5e-9e37-5f3dad6ba536", "name": "network-vif-plugged", "status": "completed", "tag": "8377f14b-e4ff-4eaf-9b6b-075a29964f0f"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:52:08.120486 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-acb97f7d-0b08-4914-8d09-5b267b337861 req-253dd80e-4f8f-4319-bcd3-a478b9ad3500 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:08.121070 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-acb97f7d-0b08-4914-8d09-5b267b337861 req-253dd80e-4f8f-4319-bcd3-a478b9ad3500 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:08.121578 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-acb97f7d-0b08-4914-8d09-5b267b337861 req-253dd80e-4f8f-4319-bcd3-a478b9ad3500 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:08.136543 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-acb97f7d-0b08-4914-8d09-5b267b337861 req-253dd80e-4f8f-4319-bcd3-a478b9ad3500 service nova] Creating event network-vif-plugged:8377f14b-e4ff-4eaf-9b6b-075a29964f0f for instance d4344070-484a-4a5e-9e37-5f3dad6ba536 on n-h1-836830-18 Sep 14 08:52:08.143379 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-acb97f7d-0b08-4914-8d09-5b267b337861 req-253dd80e-4f8f-4319-bcd3-a478b9ad3500 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052277 Sep 14 08:52:08.145060 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 445/910] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:52:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:52:08.151809 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-57030cee-42e1-457e-93d3-e83e896a6ff0 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:08.152522 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-57030cee-42e1-457e-93d3-e83e896a6ff0 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] [instance: d4344070-484a-4a5e-9e37-5f3dad6ba536] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:08.159724 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-57030cee-42e1-457e-93d3-e83e896a6ff0 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:08.160223 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-57030cee-42e1-457e-93d3-e83e896a6ff0 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:08.160662 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-57030cee-42e1-457e-93d3-e83e896a6ff0 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:08.161376 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-57030cee-42e1-457e-93d3-e83e896a6ff0 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:08.161834 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-57030cee-42e1-457e-93d3-e83e896a6ff0 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:08.162265 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-57030cee-42e1-457e-93d3-e83e896a6ff0 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:08.598311 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-57030cee-42e1-457e-93d3-e83e896a6ff0 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c7802984cf48d1852832b52abe52e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e326f95a9604fdb9bd075db3837cf62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:08.606926 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-57030cee-42e1-457e-93d3-e83e896a6ff0 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] 10.222.0.60 "GET /compute/v2.1/servers/d4344070-484a-4a5e-9e37-5f3dad6ba536" status: 200 len: 1316 microversion: 2.1 time: 0.460111 Sep 14 08:52:08.607476 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 446/911] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:08 2022] GET /compute/v2.1/servers/d4344070-484a-4a5e-9e37-5f3dad6ba536 => generated 1316 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:52:08.615503 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-69476842-d458-4278-95dd-cf6a69071636 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:08.616427 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-69476842-d458-4278-95dd-cf6a69071636 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] [instance: 3d2d7f4d-e204-42c4-b977-63119c1b8783] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:08.624148 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-69476842-d458-4278-95dd-cf6a69071636 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:08.624717 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-69476842-d458-4278-95dd-cf6a69071636 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:08.625206 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-69476842-d458-4278-95dd-cf6a69071636 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:08.625927 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-69476842-d458-4278-95dd-cf6a69071636 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:08.626389 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-69476842-d458-4278-95dd-cf6a69071636 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:08.626818 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-69476842-d458-4278-95dd-cf6a69071636 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:08.642848 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-69476842-d458-4278-95dd-cf6a69071636 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] HTTP exception thrown: Instance 3d2d7f4d-e204-42c4-b977-63119c1b8783 could not be found. Sep 14 08:52:08.644549 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-69476842-d458-4278-95dd-cf6a69071636 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Request method failure captured: Sep 14 08:52:08.644549 n-d-836830-18 devstack@n-api.service[128758]: request: GET /compute/v2.1/servers/3d2d7f4d-e204-42c4-b977-63119c1b8783 HTTP/1.1 Sep 14 08:52:08.644549 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 08:52:08.644549 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 08:52:08.644549 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 08:52:08.644549 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 08:52:08.644549 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 08:52:08.644549 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 08:52:08.644549 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 08:52:08.644549 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 08:52:08.644549 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZYbFdsAkaeXvPs5YoyBAoaPxbce1dDMHfSa781h7LPqUZ94lVpHSUwVLgjMzTID9lMOlKLs5425tlDhaDWg1KNe8NNzZqld0KTbYWNFsILZwfo8XT4y-cF9TWt5He3KTVm0WBxafs8mCKZVC7k4VkWeCSkSeXf2lVFfjWelxpPnTNQ Sep 14 08:52:08.644549 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 08:52:08.644549 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 08:52:08.644549 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 08:52:08.644549 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 08:52:08.644549 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 08:52:08.644549 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 08:52:08.644549 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: aac1cc0aa271432d9b256569e220fc75 Sep 14 08:52:08.644549 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-ImagesNegativeTestJSON-463176074 Sep 14 08:52:08.644549 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 08:52:08.644549 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 08:52:08.646329 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/aac1cc0aa271432d9b256569e220fc75"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_aac1cc0aa271432d9b256569e220fc75"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/aac1cc0aa271432d9b256569e220fc75"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/aac1cc0aa271432d9b256569e220fc75"}]}] Sep 14 08:52:08.646329 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-ImagesNegativeTestJSON-463176074 Sep 14 08:52:08.646329 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: aac1cc0aa271432d9b256569e220fc75 Sep 14 08:52:08.646329 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-463176074 Sep 14 08:52:08.646329 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-ImagesNegativeTestJSON-463176074-project Sep 14 08:52:08.646329 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 08:52:08.646329 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 08:52:08.646329 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: be69c6b130994b87b32fe1b50916b500 Sep 14 08:52:08.646329 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-ImagesNegativeTestJSON-463176074-project Sep 14 08:52:08.646329 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 08:52:08.646329 n-d-836830-18 devstack@n-api.service[128758]: exception: Instance 3d2d7f4d-e204-42c4-b977-63119c1b8783 could not be found. Sep 14 08:52:08.646329 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': '3d2d7f4d-e204-42c4-b977-63119c1b8783'} Sep 14 08:52:08.651458 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:52:08.651458 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:52:08.651458 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 08:52:08.651458 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 08:52:08.651458 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 08:52:08.651458 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 08:52:08.651458 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 08:52:08.651458 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 08:52:08.651458 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 08:52:08.651458 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 08:52:08.651458 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d2d7f4d-e204-42c4-b977-63119c1b8783 could not be found. Sep 14 08:52:08.651458 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:52:08.651458 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:52:08.651458 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:52:08.651458 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:52:08.651458 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:52:08.651458 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:52:08.651458 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:52:08.651458 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:52:08.651458 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:52:08.653007 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:52:08.653007 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 08:52:08.653007 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 08:52:08.653007 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 08:52:08.653007 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 08:52:08.653007 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 08:52:08.653007 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 08:52:08.653007 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d2d7f4d-e204-42c4-b977-63119c1b8783 could not be found. Sep 14 08:52:08.653007 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:52:08.653007 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:52:08.653007 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:52:08.653007 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:52:08.653007 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:52:08.653007 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:52:08.653007 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:52:08.653007 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:52:08.653007 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d2d7f4d-e204-42c4-b977-63119c1b8783 could not be found. Sep 14 08:52:08.653007 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:52:08.654467 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-69476842-d458-4278-95dd-cf6a69071636 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Returning 404 to user: Instance 3d2d7f4d-e204-42c4-b977-63119c1b8783 could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:52:08.654467 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-69476842-d458-4278-95dd-cf6a69071636 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] 10.222.0.60 "GET /compute/v2.1/servers/3d2d7f4d-e204-42c4-b977-63119c1b8783" status: 404 len: 111 microversion: 2.1 time: 0.037109 Sep 14 08:52:08.654467 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 447/912] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:08 2022] GET /compute/v2.1/servers/3d2d7f4d-e204-42c4-b977-63119c1b8783 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 08:52:08.654467 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-500d9e51-6cc3-4fe1-aa4e-c9c81481fe38 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:08.656126 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-500d9e51-6cc3-4fe1-aa4e-c9c81481fe38 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] [instance: 4df3f3eb-e900-497d-a1ed-f5e12a0d69a8] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:08.662779 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-500d9e51-6cc3-4fe1-aa4e-c9c81481fe38 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:08.663311 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-500d9e51-6cc3-4fe1-aa4e-c9c81481fe38 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:08.663791 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-500d9e51-6cc3-4fe1-aa4e-c9c81481fe38 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:08.664509 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-500d9e51-6cc3-4fe1-aa4e-c9c81481fe38 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:08.664975 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-500d9e51-6cc3-4fe1-aa4e-c9c81481fe38 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:08.665414 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-500d9e51-6cc3-4fe1-aa4e-c9c81481fe38 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:09.065051 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-500d9e51-6cc3-4fe1-aa4e-c9c81481fe38 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b938da87b14cd79c3c6dd85818cd02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee17e19b2f094a899dfc8966152fd642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:09.074003 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-500d9e51-6cc3-4fe1-aa4e-c9c81481fe38 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] 10.222.0.60 "GET /compute/v2.1/servers/4df3f3eb-e900-497d-a1ed-f5e12a0d69a8" status: 200 len: 1586 microversion: 2.1 time: 0.423952 Sep 14 08:52:09.075281 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 448/913] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:08 2022] GET /compute/v2.1/servers/4df3f3eb-e900-497d-a1ed-f5e12a0d69a8 => generated 1586 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:52:09.079268 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-f94fb773-3a71-4cee-a062-e8e87026e7d5 req-b7b4e62f-99cc-47e4-87ff-2ecaa62297a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d2d7f4d-e204-42c4-b977-63119c1b8783", "name": "network-vif-deleted", "tag": "a126ba35-89e7-4474-9131-e294b3d8bdb6"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:52:09.088601 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-f94fb773-3a71-4cee-a062-e8e87026e7d5 req-b7b4e62f-99cc-47e4-87ff-2ecaa62297a4 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:09.089062 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-f94fb773-3a71-4cee-a062-e8e87026e7d5 req-b7b4e62f-99cc-47e4-87ff-2ecaa62297a4 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:09.089524 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-f94fb773-3a71-4cee-a062-e8e87026e7d5 req-b7b4e62f-99cc-47e4-87ff-2ecaa62297a4 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:09.101778 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-f94fb773-3a71-4cee-a062-e8e87026e7d5 req-b7b4e62f-99cc-47e4-87ff-2ecaa62297a4 service nova] Creating event network-vif-deleted:a126ba35-89e7-4474-9131-e294b3d8bdb6 for instance 3d2d7f4d-e204-42c4-b977-63119c1b8783 on n-h2-836830-18 Sep 14 08:52:09.106885 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-f94fb773-3a71-4cee-a062-e8e87026e7d5 req-b7b4e62f-99cc-47e4-87ff-2ecaa62297a4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030933 Sep 14 08:52:09.107521 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 449/914] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:52:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:52:09.113698 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-72ece67d-ebcf-4d73-ba1e-d6f0db956e1c tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:09.114406 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-72ece67d-ebcf-4d73-ba1e-d6f0db956e1c tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: af183467-9304-4c73-a29f-196e76ba21b5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:09.121495 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-72ece67d-ebcf-4d73-ba1e-d6f0db956e1c tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:09.121988 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-72ece67d-ebcf-4d73-ba1e-d6f0db956e1c tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:09.122427 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-72ece67d-ebcf-4d73-ba1e-d6f0db956e1c tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:09.123162 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-72ece67d-ebcf-4d73-ba1e-d6f0db956e1c tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:09.123624 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-72ece67d-ebcf-4d73-ba1e-d6f0db956e1c tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:09.124051 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-72ece67d-ebcf-4d73-ba1e-d6f0db956e1c tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:09.400077 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-72ece67d-ebcf-4d73-ba1e-d6f0db956e1c tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:09.409530 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-72ece67d-ebcf-4d73-ba1e-d6f0db956e1c tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/af183467-9304-4c73-a29f-196e76ba21b5" status: 200 len: 1541 microversion: 2.1 time: 0.300400 Sep 14 08:52:09.411585 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 450/915] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:09 2022] GET /compute/v2.1/servers/af183467-9304-4c73-a29f-196e76ba21b5 => generated 1541 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:52:09.412447 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-eb2a43e0-bacb-4554-b1e5-6777b25c73cd tempest-FloatingIPDetailsTestJSON-894349538 tempest-FloatingIPDetailsTestJSON-894349538-project] 10.222.0.60 "DELETE /compute/v2.1/os-floating-ips/bfa2f54c-3428-4031-8aab-bbe82b1e2ee9" status: 202 len: 0 microversion: 2.1 time: 2.426591 Sep 14 08:52:09.416861 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 466/916] 10.222.0.60 () {58 vars in 1263 bytes} [Wed Sep 14 08:52:06 2022] DELETE /compute/v2.1/os-floating-ips/bfa2f54c-3428-4031-8aab-bbe82b1e2ee9 => generated 0 bytes in 2430 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 08:52:09.417007 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-210d4174-b0ef-48c2-bd4d-464c188386e9 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:09.417007 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-210d4174-b0ef-48c2-bd4d-464c188386e9 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: 874205eb-5321-4a9a-aa38-3cd83b2ac1a3] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:09.422424 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-210d4174-b0ef-48c2-bd4d-464c188386e9 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:09.423158 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-27409cba-5259-43c8-af93-6502c131e5f1 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:09.423411 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-210d4174-b0ef-48c2-bd4d-464c188386e9 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:09.423840 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-210d4174-b0ef-48c2-bd4d-464c188386e9 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:09.424134 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-27409cba-5259-43c8-af93-6502c131e5f1 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: 8fce8438-d6ae-408d-8b4f-ee14d4021fdd] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:09.424929 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-210d4174-b0ef-48c2-bd4d-464c188386e9 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:09.425632 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-210d4174-b0ef-48c2-bd4d-464c188386e9 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:09.426300 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-210d4174-b0ef-48c2-bd4d-464c188386e9 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:09.432064 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-27409cba-5259-43c8-af93-6502c131e5f1 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:09.432636 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-27409cba-5259-43c8-af93-6502c131e5f1 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:09.434500 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-27409cba-5259-43c8-af93-6502c131e5f1 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:09.434500 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-27409cba-5259-43c8-af93-6502c131e5f1 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:09.434500 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-27409cba-5259-43c8-af93-6502c131e5f1 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:09.434922 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-27409cba-5259-43c8-af93-6502c131e5f1 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:09.721207 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-210d4174-b0ef-48c2-bd4d-464c188386e9 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:09.728075 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-27409cba-5259-43c8-af93-6502c131e5f1 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:09.729630 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-210d4174-b0ef-48c2-bd4d-464c188386e9 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/874205eb-5321-4a9a-aa38-3cd83b2ac1a3" status: 200 len: 1503 microversion: 2.1 time: 0.318156 Sep 14 08:52:09.730221 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 451/917] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:09 2022] GET /compute/v2.1/servers/874205eb-5321-4a9a-aa38-3cd83b2ac1a3 => generated 1503 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:52:09.737805 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-548808eb-48f0-419b-beb9-25fc1a4eb979 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1451465111", "metadata": {"image_type": "test"}}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:52:09.740935 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-548808eb-48f0-419b-beb9-25fc1a4eb979 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] [instance: 3d2d7f4d-e204-42c4-b977-63119c1b8783] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:09.747685 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-548808eb-48f0-419b-beb9-25fc1a4eb979 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:09.748436 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-548808eb-48f0-419b-beb9-25fc1a4eb979 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:09.749053 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-548808eb-48f0-419b-beb9-25fc1a4eb979 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:09.749946 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-548808eb-48f0-419b-beb9-25fc1a4eb979 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:09.750779 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-548808eb-48f0-419b-beb9-25fc1a4eb979 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:09.751747 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-548808eb-48f0-419b-beb9-25fc1a4eb979 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:09.757391 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-27409cba-5259-43c8-af93-6502c131e5f1 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:09.759093 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-27409cba-5259-43c8-af93-6502c131e5f1 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:09.760388 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-27409cba-5259-43c8-af93-6502c131e5f1 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd" status: 200 len: 1412 microversion: 2.25 time: 0.345153 Sep 14 08:52:09.761754 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 467/918] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:52:09 2022] GET /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd => generated 1412 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:52:09.767284 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ef1dec76-66e1-4e5e-a383-07554a6032f6 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:09.767957 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-ef1dec76-66e1-4e5e-a383-07554a6032f6 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] [instance: 4df3f3eb-e900-497d-a1ed-f5e12a0d69a8] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:09.769015 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-548808eb-48f0-419b-beb9-25fc1a4eb979 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] HTTP exception thrown: Instance 3d2d7f4d-e204-42c4-b977-63119c1b8783 could not be found. Sep 14 08:52:09.770908 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-548808eb-48f0-419b-beb9-25fc1a4eb979 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Request method failure captured: Sep 14 08:52:09.770908 n-d-836830-18 devstack@n-api.service[128758]: request: POST /compute/v2.1/servers/3d2d7f4d-e204-42c4-b977-63119c1b8783/action HTTP/1.1 Sep 14 08:52:09.770908 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 08:52:09.770908 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 08:52:09.770908 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 08:52:09.770908 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 112 Sep 14 08:52:09.770908 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 08:52:09.770908 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 08:52:09.770908 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 08:52:09.770908 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 08:52:09.770908 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZYbFdsAkaeXvPs5YoyBAoaPxbce1dDMHfSa781h7LPqUZ94lVpHSUwVLgjMzTID9lMOlKLs5425tlDhaDWg1KNe8NNzZqld0KTbYWNFsILZwfo8XT4y-cF9TWt5He3KTVm0WBxafs8mCKZVC7k4VkWeCSkSeXf2lVFfjWelxpPnTNQ Sep 14 08:52:09.770908 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 08:52:09.770908 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 08:52:09.770908 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 08:52:09.770908 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 08:52:09.770908 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 08:52:09.770908 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 08:52:09.770908 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: aac1cc0aa271432d9b256569e220fc75 Sep 14 08:52:09.770908 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-ImagesNegativeTestJSON-463176074 Sep 14 08:52:09.770908 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 08:52:09.770908 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 08:52:09.773291 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/aac1cc0aa271432d9b256569e220fc75"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_aac1cc0aa271432d9b256569e220fc75"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/aac1cc0aa271432d9b256569e220fc75"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/aac1cc0aa271432d9b256569e220fc75"}]}] Sep 14 08:52:09.773291 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-ImagesNegativeTestJSON-463176074 Sep 14 08:52:09.773291 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: aac1cc0aa271432d9b256569e220fc75 Sep 14 08:52:09.773291 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-463176074 Sep 14 08:52:09.773291 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-ImagesNegativeTestJSON-463176074-project Sep 14 08:52:09.773291 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 08:52:09.773291 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 08:52:09.773291 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: be69c6b130994b87b32fe1b50916b500 Sep 14 08:52:09.773291 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-ImagesNegativeTestJSON-463176074-project Sep 14 08:52:09.773291 n-d-836830-18 devstack@n-api.service[128758]: Sep 14 08:52:09.773291 n-d-836830-18 devstack@n-api.service[128758]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1451465111", "metadata": {"image_type": "test"}}} Sep 14 08:52:09.773291 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 08:52:09.774277 n-d-836830-18 devstack@n-api.service[128758]: exception: Instance 3d2d7f4d-e204-42c4-b977-63119c1b8783 could not be found. Sep 14 08:52:09.774277 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': '3d2d7f4d-e204-42c4-b977-63119c1b8783', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1451465111', 'metadata': {'image_type': 'test'}}}} Sep 14 08:52:09.774277 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:52:09.774277 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:52:09.774277 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 08:52:09.774277 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 08:52:09.774277 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 08:52:09.774277 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 08:52:09.774277 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 08:52:09.774277 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 08:52:09.774277 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 08:52:09.774277 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 08:52:09.774277 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d2d7f4d-e204-42c4-b977-63119c1b8783 could not be found. Sep 14 08:52:09.774277 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:52:09.774277 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:52:09.774277 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:52:09.774277 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:52:09.774277 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:52:09.774277 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:52:09.775772 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:52:09.775772 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:52:09.775772 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:52:09.775772 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:52:09.775772 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 08:52:09.775772 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 08:52:09.775772 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 08:52:09.775772 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 08:52:09.775772 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Sep 14 08:52:09.775772 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 14 08:52:09.775772 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 08:52:09.775772 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 08:52:09.775772 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 08:52:09.775772 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 08:52:09.775772 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d2d7f4d-e204-42c4-b977-63119c1b8783 could not be found. Sep 14 08:52:09.775772 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:52:09.775772 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:52:09.775772 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:52:09.775772 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:52:09.775772 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:52:09.777262 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:52:09.777262 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:52:09.777262 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:52:09.777262 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d2d7f4d-e204-42c4-b977-63119c1b8783 could not be found. Sep 14 08:52:09.777262 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:52:09.777690 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ef1dec76-66e1-4e5e-a383-07554a6032f6 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:09.778523 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ef1dec76-66e1-4e5e-a383-07554a6032f6 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:09.778882 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-548808eb-48f0-419b-beb9-25fc1a4eb979 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Returning 404 to user: Instance 3d2d7f4d-e204-42c4-b977-63119c1b8783 could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:52:09.780208 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-548808eb-48f0-419b-beb9-25fc1a4eb979 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] 10.222.0.60 "POST /compute/v2.1/servers/3d2d7f4d-e204-42c4-b977-63119c1b8783/action" status: 404 len: 111 microversion: 2.1 time: 0.048653 Sep 14 08:52:09.780336 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ef1dec76-66e1-4e5e-a383-07554a6032f6 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:09.785438 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 452/919] 10.222.0.60 () {60 vars in 1279 bytes} [Wed Sep 14 08:52:09 2022] POST /compute/v2.1/servers/3d2d7f4d-e204-42c4-b977-63119c1b8783/action => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 08:52:09.785554 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d1ad2de4-1231-4493-8bc0-11b93ce8cb61 tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:09.786175 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-d1ad2de4-1231-4493-8bc0-11b93ce8cb61 tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] [instance: 58b5d8a4-035b-4a2f-8a83-02ea69847900] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:09.789240 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ef1dec76-66e1-4e5e-a383-07554a6032f6 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:09.790064 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ef1dec76-66e1-4e5e-a383-07554a6032f6 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:09.790688 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ef1dec76-66e1-4e5e-a383-07554a6032f6 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:09.793157 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d1ad2de4-1231-4493-8bc0-11b93ce8cb61 tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:09.793707 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d1ad2de4-1231-4493-8bc0-11b93ce8cb61 tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:09.794154 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d1ad2de4-1231-4493-8bc0-11b93ce8cb61 tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:09.794860 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d1ad2de4-1231-4493-8bc0-11b93ce8cb61 tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:09.795370 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d1ad2de4-1231-4493-8bc0-11b93ce8cb61 tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:09.795843 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d1ad2de4-1231-4493-8bc0-11b93ce8cb61 tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:09.931251 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-ef1dec76-66e1-4e5e-a383-07554a6032f6 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] 10.222.0.60 "GET /compute/v2.1/servers/4df3f3eb-e900-497d-a1ed-f5e12a0d69a8/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.168342 Sep 14 08:52:09.931884 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 468/920] 10.222.0.60 () {58 vars in 1275 bytes} [Wed Sep 14 08:52:09 2022] GET /compute/v2.1/servers/4df3f3eb-e900-497d-a1ed-f5e12a0d69a8/os-interface => generated 285 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:52:09.936428 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-02bddfb2-8c3e-43c2-8af2-870a8bfe798c tempest-FloatingIPDetailsTestJSON-894349538 tempest-FloatingIPDetailsTestJSON-894349538-project] Calling method '.version_select at 0x7f7d44427280>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:10.166869 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-d1ad2de4-1231-4493-8bc0-11b93ce8cb61 tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeaac454f233408ba1597b36bb9277dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38a515fd540744a2bdf6fb971f4a6924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:10.177981 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-d1ad2de4-1231-4493-8bc0-11b93ce8cb61 tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] 10.222.0.60 "GET /compute/v2.1/servers/58b5d8a4-035b-4a2f-8a83-02ea69847900" status: 200 len: 1402 microversion: 2.1 time: 0.396046 Sep 14 08:52:10.199327 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 453/921] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:09 2022] GET /compute/v2.1/servers/58b5d8a4-035b-4a2f-8a83-02ea69847900 => generated 1402 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:52:10.205383 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-e08b331e-c85c-44d6-bbce-693aa3f60ed1 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:10.206240 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-e08b331e-c85c-44d6-bbce-693aa3f60ed1 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] [instance: d4344070-484a-4a5e-9e37-5f3dad6ba536] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:10.213626 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e08b331e-c85c-44d6-bbce-693aa3f60ed1 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:10.214363 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e08b331e-c85c-44d6-bbce-693aa3f60ed1 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:10.215110 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e08b331e-c85c-44d6-bbce-693aa3f60ed1 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:10.216122 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e08b331e-c85c-44d6-bbce-693aa3f60ed1 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:10.216739 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e08b331e-c85c-44d6-bbce-693aa3f60ed1 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:10.217322 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e08b331e-c85c-44d6-bbce-693aa3f60ed1 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:10.525009 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-e08b331e-c85c-44d6-bbce-693aa3f60ed1 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c7802984cf48d1852832b52abe52e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e326f95a9604fdb9bd075db3837cf62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:10.547176 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-e08b331e-c85c-44d6-bbce-693aa3f60ed1 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] 10.222.0.60 "GET /compute/v2.1/servers/d4344070-484a-4a5e-9e37-5f3dad6ba536" status: 200 len: 1316 microversion: 2.1 time: 0.346314 Sep 14 08:52:10.548171 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 454/922] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:10 2022] GET /compute/v2.1/servers/d4344070-484a-4a5e-9e37-5f3dad6ba536 => generated 1316 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:52:10.559225 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-f6742380-41e8-4951-b43f-29e174706fbb tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1327593431", "metadata": {"image_type": "test"}}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:52:10.562044 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-f6742380-41e8-4951-b43f-29e174706fbb tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Failed to fetch instance by id tempest-invalid-732380315 {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 14 08:52:10.565026 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-f6742380-41e8-4951-b43f-29e174706fbb tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] HTTP exception thrown: Instance tempest-invalid-732380315 could not be found. Sep 14 08:52:10.567321 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-f6742380-41e8-4951-b43f-29e174706fbb tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Request method failure captured: Sep 14 08:52:10.567321 n-d-836830-18 devstack@n-api.service[128758]: request: POST /compute/v2.1/servers/tempest-invalid-732380315/action HTTP/1.1 Sep 14 08:52:10.567321 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 08:52:10.567321 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 08:52:10.567321 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 08:52:10.567321 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 112 Sep 14 08:52:10.567321 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 08:52:10.567321 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 08:52:10.567321 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 08:52:10.567321 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 08:52:10.567321 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZYbFdsAkaeXvPs5YoyBAoaPxbce1dDMHfSa781h7LPqUZ94lVpHSUwVLgjMzTID9lMOlKLs5425tlDhaDWg1KNe8NNzZqld0KTbYWNFsILZwfo8XT4y-cF9TWt5He3KTVm0WBxafs8mCKZVC7k4VkWeCSkSeXf2lVFfjWelxpPnTNQ Sep 14 08:52:10.567321 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 08:52:10.567321 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 08:52:10.567321 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 08:52:10.567321 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 08:52:10.567321 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 08:52:10.567321 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 08:52:10.567321 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: aac1cc0aa271432d9b256569e220fc75 Sep 14 08:52:10.567321 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-ImagesNegativeTestJSON-463176074 Sep 14 08:52:10.567321 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 08:52:10.567321 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 08:52:10.568680 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/aac1cc0aa271432d9b256569e220fc75"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_aac1cc0aa271432d9b256569e220fc75"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/aac1cc0aa271432d9b256569e220fc75"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/aac1cc0aa271432d9b256569e220fc75"}]}] Sep 14 08:52:10.568680 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-ImagesNegativeTestJSON-463176074 Sep 14 08:52:10.568680 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: aac1cc0aa271432d9b256569e220fc75 Sep 14 08:52:10.568680 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-463176074 Sep 14 08:52:10.568680 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-ImagesNegativeTestJSON-463176074-project Sep 14 08:52:10.568680 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 08:52:10.568680 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 08:52:10.568680 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: be69c6b130994b87b32fe1b50916b500 Sep 14 08:52:10.568680 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-ImagesNegativeTestJSON-463176074-project Sep 14 08:52:10.568680 n-d-836830-18 devstack@n-api.service[128758]: Sep 14 08:52:10.568680 n-d-836830-18 devstack@n-api.service[128758]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1327593431", "metadata": {"image_type": "test"}}} Sep 14 08:52:10.568680 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 08:52:10.568680 n-d-836830-18 devstack@n-api.service[128758]: exception: Instance tempest-invalid-732380315 could not be found. Sep 14 08:52:10.570087 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': 'tempest-invalid-732380315', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1327593431', 'metadata': {'image_type': 'test'}}}} Sep 14 08:52:10.570087 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:52:10.570087 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:52:10.570087 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 08:52:10.570087 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 08:52:10.570087 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 14 08:52:10.570087 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 14 08:52:10.570087 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-732380315 could not be found. Sep 14 08:52:10.570087 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:52:10.570087 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:52:10.570087 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:52:10.570087 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:52:10.570087 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:52:10.570087 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:52:10.570087 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:52:10.570087 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:52:10.570087 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:52:10.570087 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:52:10.570087 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 08:52:10.570087 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 08:52:10.571344 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 08:52:10.571344 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 08:52:10.571344 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Sep 14 08:52:10.571344 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 14 08:52:10.571344 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 08:52:10.571344 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 08:52:10.571344 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 08:52:10.571344 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 08:52:10.571344 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-732380315 could not be found. Sep 14 08:52:10.571344 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:52:10.571344 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:52:10.571344 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:52:10.571344 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:52:10.571344 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:52:10.571344 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:52:10.571344 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:52:10.571344 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:52:10.571344 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-732380315 could not be found. Sep 14 08:52:10.571344 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:52:10.577650 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-f6742380-41e8-4951-b43f-29e174706fbb tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Returning 404 to user: Instance tempest-invalid-732380315 could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:52:10.578673 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-f6742380-41e8-4951-b43f-29e174706fbb tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] 10.222.0.60 "POST /compute/v2.1/servers/tempest-invalid-732380315/action" status: 404 len: 100 microversion: 2.1 time: 0.029009 Sep 14 08:52:10.580443 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 455/923] 10.222.0.60 () {60 vars in 1246 bytes} [Wed Sep 14 08:52:10 2022] POST /compute/v2.1/servers/tempest-invalid-732380315/action => generated 100 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 08:52:10.597595 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-5048550b-28d1-462f-9e29-9b778551a001 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:10.598587 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-5048550b-28d1-462f-9e29-9b778551a001 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: af183467-9304-4c73-a29f-196e76ba21b5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:10.616798 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5048550b-28d1-462f-9e29-9b778551a001 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:10.617689 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5048550b-28d1-462f-9e29-9b778551a001 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:10.622339 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5048550b-28d1-462f-9e29-9b778551a001 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:10.623467 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5048550b-28d1-462f-9e29-9b778551a001 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:10.626018 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5048550b-28d1-462f-9e29-9b778551a001 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:10.627604 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5048550b-28d1-462f-9e29-9b778551a001 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:10.654089 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=100 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:52:11.401200 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-5048550b-28d1-462f-9e29-9b778551a001 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:11.409604 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-5048550b-28d1-462f-9e29-9b778551a001 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/af183467-9304-4c73-a29f-196e76ba21b5" status: 200 len: 1541 microversion: 2.1 time: 0.822325 Sep 14 08:52:11.410273 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 456/924] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:10 2022] GET /compute/v2.1/servers/af183467-9304-4c73-a29f-196e76ba21b5 => generated 1541 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:52:11.424608 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-0b47a6f0-f97f-4062-9833-b536270a680d req-6ffabf94-538a-42ee-8ff9-90fe2ca6d43d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58b5d8a4-035b-4a2f-8a83-02ea69847900", "name": "network-vif-plugged", "status": "completed", "tag": "742f5d4d-837e-4e1e-8b53-228d7a64de9b"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:52:11.435900 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-0b47a6f0-f97f-4062-9833-b536270a680d req-6ffabf94-538a-42ee-8ff9-90fe2ca6d43d service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:11.436585 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-0b47a6f0-f97f-4062-9833-b536270a680d req-6ffabf94-538a-42ee-8ff9-90fe2ca6d43d service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:11.437007 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-0b47a6f0-f97f-4062-9833-b536270a680d req-6ffabf94-538a-42ee-8ff9-90fe2ca6d43d service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:11.448788 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-0b47a6f0-f97f-4062-9833-b536270a680d req-6ffabf94-538a-42ee-8ff9-90fe2ca6d43d service nova] Creating event network-vif-plugged:742f5d4d-837e-4e1e-8b53-228d7a64de9b for instance 58b5d8a4-035b-4a2f-8a83-02ea69847900 on n-h1-836830-18 Sep 14 08:52:11.454670 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-0b47a6f0-f97f-4062-9833-b536270a680d req-6ffabf94-538a-42ee-8ff9-90fe2ca6d43d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042525 Sep 14 08:52:11.455230 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 457/925] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:52:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:52:11.460488 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-48d7804f-e277-42a3-91cf-d71f46593df9 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-313339936"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:52:11.462724 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-48d7804f-e277-42a3-91cf-d71f46593df9 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 14 08:52:11.463261 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-48d7804f-e277-42a3-91cf-d71f46593df9 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 14 08:52:11.464953 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-48d7804f-e277-42a3-91cf-d71f46593df9 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Request method failure captured: Sep 14 08:52:11.464953 n-d-836830-18 devstack@n-api.service[128758]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Sep 14 08:52:11.464953 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 08:52:11.464953 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 08:52:11.464953 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 08:52:11.464953 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 56 Sep 14 08:52:11.464953 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 08:52:11.464953 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 08:52:11.464953 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 08:52:11.464953 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 08:52:11.464953 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZYbFdsAkaeXvPs5YoyBAoaPxbce1dDMHfSa781h7LPqUZ94lVpHSUwVLgjMzTID9lMOlKLs5425tlDhaDWg1KNe8NNzZqld0KTbYWNFsILZwfo8XT4y-cF9TWt5He3KTVm0WBxafs8mCKZVC7k4VkWeCSkSeXf2lVFfjWelxpPnTNQ Sep 14 08:52:11.464953 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 08:52:11.464953 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 08:52:11.464953 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 08:52:11.464953 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 08:52:11.464953 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 08:52:11.464953 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 08:52:11.464953 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: aac1cc0aa271432d9b256569e220fc75 Sep 14 08:52:11.464953 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-ImagesNegativeTestJSON-463176074 Sep 14 08:52:11.464953 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 08:52:11.464953 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 08:52:11.466262 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/aac1cc0aa271432d9b256569e220fc75"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_aac1cc0aa271432d9b256569e220fc75"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/aac1cc0aa271432d9b256569e220fc75"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/aac1cc0aa271432d9b256569e220fc75"}]}] Sep 14 08:52:11.466262 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-ImagesNegativeTestJSON-463176074 Sep 14 08:52:11.466262 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: aac1cc0aa271432d9b256569e220fc75 Sep 14 08:52:11.466262 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-463176074 Sep 14 08:52:11.466262 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-ImagesNegativeTestJSON-463176074-project Sep 14 08:52:11.466262 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 08:52:11.466262 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 08:52:11.466262 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: be69c6b130994b87b32fe1b50916b500 Sep 14 08:52:11.466262 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-ImagesNegativeTestJSON-463176074-project Sep 14 08:52:11.466262 n-d-836830-18 devstack@n-api.service[128758]: Sep 14 08:52:11.466262 n-d-836830-18 devstack@n-api.service[128758]: {"createImage": {"name": "tempest-test-snap-313339936"}} Sep 14 08:52:11.466262 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 08:52:11.466262 n-d-836830-18 devstack@n-api.service[128758]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 14 08:52:11.467117 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-313339936'}}} Sep 14 08:52:11.467117 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:52:11.467117 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:52:11.467117 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 08:52:11.467117 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 08:52:11.467117 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 14 08:52:11.467117 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 14 08:52:11.467117 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 14 08:52:11.467117 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:52:11.467117 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:52:11.467117 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:52:11.467117 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:52:11.467117 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:52:11.467117 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:52:11.467117 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:52:11.467117 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:52:11.467117 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:52:11.467117 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:52:11.467117 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 08:52:11.467117 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 08:52:11.468312 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 08:52:11.468312 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 08:52:11.468312 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Sep 14 08:52:11.468312 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 14 08:52:11.468312 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 08:52:11.468312 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 08:52:11.468312 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 08:52:11.468312 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 08:52:11.468312 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 14 08:52:11.468312 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:52:11.468312 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:52:11.468312 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:52:11.468312 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:52:11.468312 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:52:11.468312 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:52:11.468312 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:52:11.468312 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:52:11.468312 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 14 08:52:11.468312 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:52:11.469494 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-48d7804f-e277-42a3-91cf-d71f46593df9 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:52:11.469494 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-48d7804f-e277-42a3-91cf-d71f46593df9 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] 10.222.0.60 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.009841 Sep 14 08:52:11.469494 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 458/926] 10.222.0.60 () {60 vars in 1275 bytes} [Wed Sep 14 08:52:11 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 08:52:11.470856 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-e1b9fe8f-f051-488e-9efc-71e666b438c3 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:11.471576 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-e1b9fe8f-f051-488e-9efc-71e666b438c3 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: 874205eb-5321-4a9a-aa38-3cd83b2ac1a3] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:11.479225 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e1b9fe8f-f051-488e-9efc-71e666b438c3 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:11.479711 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e1b9fe8f-f051-488e-9efc-71e666b438c3 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:11.480171 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e1b9fe8f-f051-488e-9efc-71e666b438c3 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:11.480868 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e1b9fe8f-f051-488e-9efc-71e666b438c3 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:11.481484 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e1b9fe8f-f051-488e-9efc-71e666b438c3 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:11.482060 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e1b9fe8f-f051-488e-9efc-71e666b438c3 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:11.950700 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-e1b9fe8f-f051-488e-9efc-71e666b438c3 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:11.958630 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-e1b9fe8f-f051-488e-9efc-71e666b438c3 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/874205eb-5321-4a9a-aa38-3cd83b2ac1a3" status: 200 len: 1503 microversion: 2.1 time: 0.490884 Sep 14 08:52:11.959438 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 459/927] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:11 2022] GET /compute/v2.1/servers/874205eb-5321-4a9a-aa38-3cd83b2ac1a3 => generated 1503 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:52:11.980917 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b860f63f-e795-4cfc-9ad3-193b9c26b033 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:11.981361 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-b860f63f-e795-4cfc-9ad3-193b9c26b033 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: 8fce8438-d6ae-408d-8b4f-ee14d4021fdd] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:11.988926 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b860f63f-e795-4cfc-9ad3-193b9c26b033 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:11.990244 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b860f63f-e795-4cfc-9ad3-193b9c26b033 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:11.990717 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b860f63f-e795-4cfc-9ad3-193b9c26b033 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:11.991513 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b860f63f-e795-4cfc-9ad3-193b9c26b033 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:11.991985 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b860f63f-e795-4cfc-9ad3-193b9c26b033 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:11.992416 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b860f63f-e795-4cfc-9ad3-193b9c26b033 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:12.364774 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-02bddfb2-8c3e-43c2-8af2-870a8bfe798c tempest-FloatingIPDetailsTestJSON-894349538 tempest-FloatingIPDetailsTestJSON-894349538-project] 10.222.0.60 "DELETE /compute/v2.1/os-floating-ips/30e432e7-59af-4f32-8b72-96dcf47a0217" status: 202 len: 0 microversion: 2.1 time: 2.431782 Sep 14 08:52:12.365578 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 469/928] 10.222.0.60 () {58 vars in 1263 bytes} [Wed Sep 14 08:52:09 2022] DELETE /compute/v2.1/os-floating-ips/30e432e7-59af-4f32-8b72-96dcf47a0217 => generated 0 bytes in 2433 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 08:52:12.373878 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-68f465ca-a24f-419b-8f0d-7e6112ace0f9 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:12.374515 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-68f465ca-a24f-419b-8f0d-7e6112ace0f9 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] [instance: 4df3f3eb-e900-497d-a1ed-f5e12a0d69a8] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:12.380893 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-68f465ca-a24f-419b-8f0d-7e6112ace0f9 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:12.381403 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-68f465ca-a24f-419b-8f0d-7e6112ace0f9 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:12.381849 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-68f465ca-a24f-419b-8f0d-7e6112ace0f9 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:12.382557 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-68f465ca-a24f-419b-8f0d-7e6112ace0f9 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:12.383047 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-68f465ca-a24f-419b-8f0d-7e6112ace0f9 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:12.383483 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-68f465ca-a24f-419b-8f0d-7e6112ace0f9 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:12.450963 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-b860f63f-e795-4cfc-9ad3-193b9c26b033 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:12.460200 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-b860f63f-e795-4cfc-9ad3-193b9c26b033 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:12.461665 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-b860f63f-e795-4cfc-9ad3-193b9c26b033 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:12.462779 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-b860f63f-e795-4cfc-9ad3-193b9c26b033 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd" status: 200 len: 1412 microversion: 2.25 time: 0.486000 Sep 14 08:52:12.463380 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 460/929] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:52:11 2022] GET /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd => generated 1412 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:52:12.483680 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-cbc86aad-8c9f-443b-b423-62a74fa38fb9 req-a19880fe-5a9c-48ad-baf9-31da0d1fce41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4df3f3eb-e900-497d-a1ed-f5e12a0d69a8", "tag": "2598a43e-0827-49bc-952a-840f14b2612a"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:52:12.493305 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-cbc86aad-8c9f-443b-b423-62a74fa38fb9 req-a19880fe-5a9c-48ad-baf9-31da0d1fce41 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:12.493786 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-cbc86aad-8c9f-443b-b423-62a74fa38fb9 req-a19880fe-5a9c-48ad-baf9-31da0d1fce41 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:12.494222 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-cbc86aad-8c9f-443b-b423-62a74fa38fb9 req-a19880fe-5a9c-48ad-baf9-31da0d1fce41 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:12.505766 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-cbc86aad-8c9f-443b-b423-62a74fa38fb9 req-a19880fe-5a9c-48ad-baf9-31da0d1fce41 service nova] Creating event network-changed:2598a43e-0827-49bc-952a-840f14b2612a for instance 4df3f3eb-e900-497d-a1ed-f5e12a0d69a8 on n-h2-836830-18 Sep 14 08:52:12.510597 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-cbc86aad-8c9f-443b-b423-62a74fa38fb9 req-a19880fe-5a9c-48ad-baf9-31da0d1fce41 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030474 Sep 14 08:52:12.511286 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 461/930] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:52:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:52:12.516355 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-f996b46c-7a12-4750-86a0-ab45edc2a83d tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:12.517082 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-f996b46c-7a12-4750-86a0-ab45edc2a83d tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] [instance: 58b5d8a4-035b-4a2f-8a83-02ea69847900] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:12.520127 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:52:12.525046 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f996b46c-7a12-4750-86a0-ab45edc2a83d tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:12.525667 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f996b46c-7a12-4750-86a0-ab45edc2a83d tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:12.525991 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f996b46c-7a12-4750-86a0-ab45edc2a83d tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:12.527258 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f996b46c-7a12-4750-86a0-ab45edc2a83d tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:12.527258 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f996b46c-7a12-4750-86a0-ab45edc2a83d tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:12.527610 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f996b46c-7a12-4750-86a0-ab45edc2a83d tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:12.772934 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-68f465ca-a24f-419b-8f0d-7e6112ace0f9 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b938da87b14cd79c3c6dd85818cd02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee17e19b2f094a899dfc8966152fd642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:12.776530 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:52:12.782722 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-68f465ca-a24f-419b-8f0d-7e6112ace0f9 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] 10.222.0.60 "GET /compute/v2.1/servers/4df3f3eb-e900-497d-a1ed-f5e12a0d69a8" status: 200 len: 1586 microversion: 2.1 time: 0.412672 Sep 14 08:52:12.783357 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 470/931] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:12 2022] GET /compute/v2.1/servers/4df3f3eb-e900-497d-a1ed-f5e12a0d69a8 => generated 1586 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:52:12.788193 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3fae39ee-0ccb-4bc1-bd57-76ff59d1901e tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1652233879"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:52:12.790734 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-3fae39ee-0ccb-4bc1-bd57-76ff59d1901e tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 14 08:52:12.791281 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-3fae39ee-0ccb-4bc1-bd57-76ff59d1901e tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 14 08:52:12.794259 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3fae39ee-0ccb-4bc1-bd57-76ff59d1901e tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Request method failure captured: Sep 14 08:52:12.794259 n-d-836830-18 devstack@n-api.service[128759]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Sep 14 08:52:12.794259 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 08:52:12.794259 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 08:52:12.794259 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 08:52:12.794259 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 57 Sep 14 08:52:12.794259 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 08:52:12.794259 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 08:52:12.794259 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 08:52:12.794259 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 08:52:12.794259 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZYbFdsAkaeXvPs5YoyBAoaPxbce1dDMHfSa781h7LPqUZ94lVpHSUwVLgjMzTID9lMOlKLs5425tlDhaDWg1KNe8NNzZqld0KTbYWNFsILZwfo8XT4y-cF9TWt5He3KTVm0WBxafs8mCKZVC7k4VkWeCSkSeXf2lVFfjWelxpPnTNQ Sep 14 08:52:12.794259 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 08:52:12.794259 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 08:52:12.794259 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 08:52:12.794259 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 08:52:12.794259 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 08:52:12.794259 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 08:52:12.794259 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: aac1cc0aa271432d9b256569e220fc75 Sep 14 08:52:12.794259 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ImagesNegativeTestJSON-463176074 Sep 14 08:52:12.794259 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 08:52:12.794259 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 08:52:12.795632 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/aac1cc0aa271432d9b256569e220fc75"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_aac1cc0aa271432d9b256569e220fc75"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/aac1cc0aa271432d9b256569e220fc75"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/aac1cc0aa271432d9b256569e220fc75"}]}] Sep 14 08:52:12.795632 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ImagesNegativeTestJSON-463176074 Sep 14 08:52:12.795632 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: aac1cc0aa271432d9b256569e220fc75 Sep 14 08:52:12.795632 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-463176074 Sep 14 08:52:12.795632 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ImagesNegativeTestJSON-463176074-project Sep 14 08:52:12.795632 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 08:52:12.795632 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 08:52:12.795632 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: be69c6b130994b87b32fe1b50916b500 Sep 14 08:52:12.795632 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ImagesNegativeTestJSON-463176074-project Sep 14 08:52:12.795632 n-d-836830-18 devstack@n-api.service[128759]: Sep 14 08:52:12.795632 n-d-836830-18 devstack@n-api.service[128759]: {"createImage": {"name": "tempest-test-snap-1652233879"}} Sep 14 08:52:12.795632 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 08:52:12.795632 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 14 08:52:12.796446 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1652233879'}}} Sep 14 08:52:12.796446 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:52:12.796446 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:52:12.796446 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 08:52:12.796446 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 08:52:12.796446 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 14 08:52:12.796446 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 14 08:52:12.796446 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 14 08:52:12.796446 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:52:12.796446 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:52:12.796446 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:52:12.796446 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:52:12.796446 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:52:12.796446 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:52:12.796446 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:52:12.796446 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:52:12.796446 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:52:12.796446 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:52:12.796446 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 08:52:12.796446 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 08:52:12.797661 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 08:52:12.797661 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 08:52:12.797661 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Sep 14 08:52:12.797661 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 14 08:52:12.797661 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 08:52:12.797661 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 08:52:12.797661 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 08:52:12.797661 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 08:52:12.797661 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 14 08:52:12.797661 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:52:12.797661 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:52:12.797661 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:52:12.797661 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:52:12.797661 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:52:12.797661 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:52:12.797661 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:52:12.797661 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:52:12.797661 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 14 08:52:12.797661 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:52:12.800302 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3fae39ee-0ccb-4bc1-bd57-76ff59d1901e tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:52:12.801166 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-3fae39ee-0ccb-4bc1-bd57-76ff59d1901e tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] 10.222.0.60 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.016878 Sep 14 08:52:12.801742 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 471/932] 10.222.0.60 () {60 vars in 1281 bytes} [Wed Sep 14 08:52:12 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 08:52:12.809822 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-4659ec18-f6da-4871-ba79-0d86e720db4e tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:12.810706 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-4659ec18-f6da-4871-ba79-0d86e720db4e tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] [instance: d4344070-484a-4a5e-9e37-5f3dad6ba536] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:12.820633 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4659ec18-f6da-4871-ba79-0d86e720db4e tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:12.821403 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4659ec18-f6da-4871-ba79-0d86e720db4e tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:12.821850 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4659ec18-f6da-4871-ba79-0d86e720db4e tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:12.822557 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4659ec18-f6da-4871-ba79-0d86e720db4e tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:12.823365 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4659ec18-f6da-4871-ba79-0d86e720db4e tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:12.823802 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4659ec18-f6da-4871-ba79-0d86e720db4e tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:12.839432 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-f996b46c-7a12-4750-86a0-ab45edc2a83d tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeaac454f233408ba1597b36bb9277dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38a515fd540744a2bdf6fb971f4a6924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:12.851940 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-f996b46c-7a12-4750-86a0-ab45edc2a83d tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] 10.222.0.60 "GET /compute/v2.1/servers/58b5d8a4-035b-4a2f-8a83-02ea69847900" status: 200 len: 1402 microversion: 2.1 time: 0.339473 Sep 14 08:52:12.852537 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 462/933] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:12 2022] GET /compute/v2.1/servers/58b5d8a4-035b-4a2f-8a83-02ea69847900 => generated 1402 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:52:12.857748 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-8e32e693-eb00-4f0d-9816-f5aa016c0620 req-55e1c06c-1917-4b25-bbdc-04353c79485c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8fce8438-d6ae-408d-8b4f-ee14d4021fdd", "tag": "8a7f2660-c507-4973-b860-0358d6cdd4f1"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:52:12.867643 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-8e32e693-eb00-4f0d-9816-f5aa016c0620 req-55e1c06c-1917-4b25-bbdc-04353c79485c service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:12.868457 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-8e32e693-eb00-4f0d-9816-f5aa016c0620 req-55e1c06c-1917-4b25-bbdc-04353c79485c service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:12.868898 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-8e32e693-eb00-4f0d-9816-f5aa016c0620 req-55e1c06c-1917-4b25-bbdc-04353c79485c service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:12.882722 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-8e32e693-eb00-4f0d-9816-f5aa016c0620 req-55e1c06c-1917-4b25-bbdc-04353c79485c service nova] Creating event network-changed:8a7f2660-c507-4973-b860-0358d6cdd4f1 for instance 8fce8438-d6ae-408d-8b4f-ee14d4021fdd on n-h2-836830-18 Sep 14 08:52:12.887592 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-8e32e693-eb00-4f0d-9816-f5aa016c0620 req-55e1c06c-1917-4b25-bbdc-04353c79485c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033879 Sep 14 08:52:12.888390 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 463/934] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:52:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:52:12.893288 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b1dcb225-a08d-4840-9115-f14075f7ad99 tempest-FloatingIPDetailsTestJSON-894349538 tempest-FloatingIPDetailsTestJSON-894349538-project] Calling method '.version_select at 0x7f7d44b9dee0>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:13.136517 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-4659ec18-f6da-4871-ba79-0d86e720db4e tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c7802984cf48d1852832b52abe52e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e326f95a9604fdb9bd075db3837cf62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:13.145002 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-4659ec18-f6da-4871-ba79-0d86e720db4e tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] 10.222.0.60 "GET /compute/v2.1/servers/d4344070-484a-4a5e-9e37-5f3dad6ba536" status: 200 len: 1466 microversion: 2.1 time: 0.342241 Sep 14 08:52:13.145742 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 472/935] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:12 2022] GET /compute/v2.1/servers/d4344070-484a-4a5e-9e37-5f3dad6ba536 => generated 1466 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:52:13.150902 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-58148677-65ad-48df-a4f7-6af6d6cd1342 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:13.151549 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-58148677-65ad-48df-a4f7-6af6d6cd1342 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: af183467-9304-4c73-a29f-196e76ba21b5] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:13.157780 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-58148677-65ad-48df-a4f7-6af6d6cd1342 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:13.158496 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-58148677-65ad-48df-a4f7-6af6d6cd1342 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:13.159218 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-58148677-65ad-48df-a4f7-6af6d6cd1342 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:13.160178 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-58148677-65ad-48df-a4f7-6af6d6cd1342 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:13.160645 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-58148677-65ad-48df-a4f7-6af6d6cd1342 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:13.161121 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-58148677-65ad-48df-a4f7-6af6d6cd1342 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:13.480080 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-58148677-65ad-48df-a4f7-6af6d6cd1342 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:13.487876 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-58148677-65ad-48df-a4f7-6af6d6cd1342 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/af183467-9304-4c73-a29f-196e76ba21b5" status: 200 len: 1541 microversion: 2.1 time: 0.340636 Sep 14 08:52:13.488447 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 473/936] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:13 2022] GET /compute/v2.1/servers/af183467-9304-4c73-a29f-196e76ba21b5 => generated 1541 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:52:13.492882 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-14c6a7e5-0841-4df5-a24a-fc2bfd5c050b tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:13.493377 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-14c6a7e5-0841-4df5-a24a-fc2bfd5c050b tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] [instance: 3d2d7f4d-e204-42c4-b977-63119c1b8783] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:13.498924 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-14c6a7e5-0841-4df5-a24a-fc2bfd5c050b tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:13.499462 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-14c6a7e5-0841-4df5-a24a-fc2bfd5c050b tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:13.499884 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-14c6a7e5-0841-4df5-a24a-fc2bfd5c050b tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:13.501210 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-14c6a7e5-0841-4df5-a24a-fc2bfd5c050b tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:13.502129 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-14c6a7e5-0841-4df5-a24a-fc2bfd5c050b tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:13.502129 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-14c6a7e5-0841-4df5-a24a-fc2bfd5c050b tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:13.515552 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-14c6a7e5-0841-4df5-a24a-fc2bfd5c050b tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] HTTP exception thrown: Instance 3d2d7f4d-e204-42c4-b977-63119c1b8783 could not be found. Sep 14 08:52:13.517114 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-14c6a7e5-0841-4df5-a24a-fc2bfd5c050b tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Request method failure captured: Sep 14 08:52:13.517114 n-d-836830-18 devstack@n-api.service[128759]: request: DELETE /compute/v2.1/servers/3d2d7f4d-e204-42c4-b977-63119c1b8783 HTTP/1.1 Sep 14 08:52:13.517114 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 08:52:13.517114 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 08:52:13.517114 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 08:52:13.517114 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 08:52:13.517114 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 08:52:13.517114 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 08:52:13.517114 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 08:52:13.517114 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 08:52:13.517114 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZYbFdsAkaeXvPs5YoyBAoaPxbce1dDMHfSa781h7LPqUZ94lVpHSUwVLgjMzTID9lMOlKLs5425tlDhaDWg1KNe8NNzZqld0KTbYWNFsILZwfo8XT4y-cF9TWt5He3KTVm0WBxafs8mCKZVC7k4VkWeCSkSeXf2lVFfjWelxpPnTNQ Sep 14 08:52:13.517114 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 08:52:13.517114 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 08:52:13.517114 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 08:52:13.517114 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 08:52:13.517114 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 08:52:13.517114 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 08:52:13.517114 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: aac1cc0aa271432d9b256569e220fc75 Sep 14 08:52:13.517114 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ImagesNegativeTestJSON-463176074 Sep 14 08:52:13.517114 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 08:52:13.517114 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 08:52:13.518706 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/aac1cc0aa271432d9b256569e220fc75"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_aac1cc0aa271432d9b256569e220fc75"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/aac1cc0aa271432d9b256569e220fc75"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/aac1cc0aa271432d9b256569e220fc75"}]}] Sep 14 08:52:13.518706 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ImagesNegativeTestJSON-463176074 Sep 14 08:52:13.518706 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: aac1cc0aa271432d9b256569e220fc75 Sep 14 08:52:13.518706 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-463176074 Sep 14 08:52:13.518706 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ImagesNegativeTestJSON-463176074-project Sep 14 08:52:13.518706 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 08:52:13.518706 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 08:52:13.518706 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: be69c6b130994b87b32fe1b50916b500 Sep 14 08:52:13.518706 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ImagesNegativeTestJSON-463176074-project Sep 14 08:52:13.518706 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 08:52:13.518706 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance 3d2d7f4d-e204-42c4-b977-63119c1b8783 could not be found. Sep 14 08:52:13.518706 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '3d2d7f4d-e204-42c4-b977-63119c1b8783'} Sep 14 08:52:13.519649 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:52:13.519649 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:52:13.519649 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 08:52:13.519649 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 08:52:13.519649 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 08:52:13.519649 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 08:52:13.519649 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 08:52:13.519649 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 08:52:13.519649 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 08:52:13.519649 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 08:52:13.519649 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d2d7f4d-e204-42c4-b977-63119c1b8783 could not be found. Sep 14 08:52:13.519649 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:52:13.519649 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:52:13.519649 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:52:13.519649 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:52:13.519649 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:52:13.519649 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:52:13.519649 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:52:13.519649 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:52:13.519649 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:52:13.521246 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:52:13.521246 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 08:52:13.521246 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 08:52:13.521246 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 08:52:13.521246 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 08:52:13.521246 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 08:52:13.521246 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 08:52:13.521246 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 08:52:13.521246 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 08:52:13.521246 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d2d7f4d-e204-42c4-b977-63119c1b8783 could not be found. Sep 14 08:52:13.521246 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:52:13.521246 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:52:13.521246 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:52:13.521246 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:52:13.521246 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:52:13.521246 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:52:13.521246 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:52:13.521246 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:52:13.521246 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d2d7f4d-e204-42c4-b977-63119c1b8783 could not be found. Sep 14 08:52:13.521246 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:52:13.523539 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-14c6a7e5-0841-4df5-a24a-fc2bfd5c050b tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Returning 404 to user: Instance 3d2d7f4d-e204-42c4-b977-63119c1b8783 could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:52:13.523539 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-14c6a7e5-0841-4df5-a24a-fc2bfd5c050b tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] 10.222.0.60 "DELETE /compute/v2.1/servers/3d2d7f4d-e204-42c4-b977-63119c1b8783" status: 404 len: 111 microversion: 2.1 time: 0.029153 Sep 14 08:52:13.523539 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 474/937] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 08:52:13 2022] DELETE /compute/v2.1/servers/3d2d7f4d-e204-42c4-b977-63119c1b8783 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 08:52:13.527132 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-45d77955-3940-44f6-b2ab-62b27daeeca2 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:13.527745 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-45d77955-3940-44f6-b2ab-62b27daeeca2 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: 874205eb-5321-4a9a-aa38-3cd83b2ac1a3] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:13.533442 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-45d77955-3940-44f6-b2ab-62b27daeeca2 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:13.533923 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-45d77955-3940-44f6-b2ab-62b27daeeca2 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:13.534362 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-45d77955-3940-44f6-b2ab-62b27daeeca2 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:13.535076 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-45d77955-3940-44f6-b2ab-62b27daeeca2 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:13.535535 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-45d77955-3940-44f6-b2ab-62b27daeeca2 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:13.535957 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-45d77955-3940-44f6-b2ab-62b27daeeca2 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:13.741070 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-45d77955-3940-44f6-b2ab-62b27daeeca2 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:13.749384 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-45d77955-3940-44f6-b2ab-62b27daeeca2 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/874205eb-5321-4a9a-aa38-3cd83b2ac1a3" status: 200 len: 1503 microversion: 2.1 time: 0.225665 Sep 14 08:52:13.750122 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 475/938] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:13 2022] GET /compute/v2.1/servers/874205eb-5321-4a9a-aa38-3cd83b2ac1a3 => generated 1503 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:52:13.754651 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-14cfa3ef-9db3-4c88-b26e-f54da5747aa4 tempest-ServersOnMultiNodesTest-1008135845 tempest-ServersOnMultiNodesTest-1008135845-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:13.755540 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-14cfa3ef-9db3-4c88-b26e-f54da5747aa4 tempest-ServersOnMultiNodesTest-1008135845 tempest-ServersOnMultiNodesTest-1008135845-project-admin] [instance: d4344070-484a-4a5e-9e37-5f3dad6ba536] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:13.762020 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-14cfa3ef-9db3-4c88-b26e-f54da5747aa4 tempest-ServersOnMultiNodesTest-1008135845 tempest-ServersOnMultiNodesTest-1008135845-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:13.762618 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-14cfa3ef-9db3-4c88-b26e-f54da5747aa4 tempest-ServersOnMultiNodesTest-1008135845 tempest-ServersOnMultiNodesTest-1008135845-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:13.763371 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-14cfa3ef-9db3-4c88-b26e-f54da5747aa4 tempest-ServersOnMultiNodesTest-1008135845 tempest-ServersOnMultiNodesTest-1008135845-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:13.764177 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-14cfa3ef-9db3-4c88-b26e-f54da5747aa4 tempest-ServersOnMultiNodesTest-1008135845 tempest-ServersOnMultiNodesTest-1008135845-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:13.764742 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-14cfa3ef-9db3-4c88-b26e-f54da5747aa4 tempest-ServersOnMultiNodesTest-1008135845 tempest-ServersOnMultiNodesTest-1008135845-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:13.765276 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-14cfa3ef-9db3-4c88-b26e-f54da5747aa4 tempest-ServersOnMultiNodesTest-1008135845 tempest-ServersOnMultiNodesTest-1008135845-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:14.081447 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-14cfa3ef-9db3-4c88-b26e-f54da5747aa4 tempest-ServersOnMultiNodesTest-1008135845 tempest-ServersOnMultiNodesTest-1008135845-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/d4344070-484a-4a5e-9e37-5f3dad6ba536" status: 200 len: 1619 microversion: 2.1 time: 0.329956 Sep 14 08:52:14.082428 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 476/939] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:13 2022] GET /compute/v2.1/servers/d4344070-484a-4a5e-9e37-5f3dad6ba536 => generated 1619 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:52:14.088052 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-37361779-0c67-443b-9eb1-cd3454c077db tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:14.088664 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-37361779-0c67-443b-9eb1-cd3454c077db tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: 8fce8438-d6ae-408d-8b4f-ee14d4021fdd] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:14.094576 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-37361779-0c67-443b-9eb1-cd3454c077db tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:14.095094 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-37361779-0c67-443b-9eb1-cd3454c077db tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:14.095536 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-37361779-0c67-443b-9eb1-cd3454c077db tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:14.096818 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-37361779-0c67-443b-9eb1-cd3454c077db tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:14.097293 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-37361779-0c67-443b-9eb1-cd3454c077db tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:14.097732 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-37361779-0c67-443b-9eb1-cd3454c077db tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:14.208934 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-b1dcb225-a08d-4840-9115-f14075f7ad99 tempest-FloatingIPDetailsTestJSON-894349538 tempest-FloatingIPDetailsTestJSON-894349538-project] 10.222.0.60 "DELETE /compute/v2.1/os-floating-ips/78ee8938-896b-4e85-b431-a0180a90ccc8" status: 202 len: 0 microversion: 2.1 time: 1.319405 Sep 14 08:52:14.213314 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 464/940] 10.222.0.60 () {58 vars in 1263 bytes} [Wed Sep 14 08:52:12 2022] DELETE /compute/v2.1/os-floating-ips/78ee8938-896b-4e85-b431-a0180a90ccc8 => generated 0 bytes in 1322 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 08:52:14.215424 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-99615715-b3f9-46d5-bef6-a060d0c8b165 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:14.216176 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-99615715-b3f9-46d5-bef6-a060d0c8b165 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] [instance: 3d2d7f4d-e204-42c4-b977-63119c1b8783] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:14.223382 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-99615715-b3f9-46d5-bef6-a060d0c8b165 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:14.223868 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-99615715-b3f9-46d5-bef6-a060d0c8b165 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:14.224303 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-99615715-b3f9-46d5-bef6-a060d0c8b165 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:14.224999 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-99615715-b3f9-46d5-bef6-a060d0c8b165 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:14.226175 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-99615715-b3f9-46d5-bef6-a060d0c8b165 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:14.226840 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-99615715-b3f9-46d5-bef6-a060d0c8b165 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:14.242279 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-99615715-b3f9-46d5-bef6-a060d0c8b165 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] HTTP exception thrown: Instance 3d2d7f4d-e204-42c4-b977-63119c1b8783 could not be found. Sep 14 08:52:14.244080 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-99615715-b3f9-46d5-bef6-a060d0c8b165 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Request method failure captured: Sep 14 08:52:14.244080 n-d-836830-18 devstack@n-api.service[128758]: request: GET /compute/v2.1/servers/3d2d7f4d-e204-42c4-b977-63119c1b8783 HTTP/1.1 Sep 14 08:52:14.244080 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 08:52:14.244080 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 08:52:14.244080 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 08:52:14.244080 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 08:52:14.244080 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 08:52:14.244080 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 08:52:14.244080 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 08:52:14.244080 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 08:52:14.244080 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZYbFdsAkaeXvPs5YoyBAoaPxbce1dDMHfSa781h7LPqUZ94lVpHSUwVLgjMzTID9lMOlKLs5425tlDhaDWg1KNe8NNzZqld0KTbYWNFsILZwfo8XT4y-cF9TWt5He3KTVm0WBxafs8mCKZVC7k4VkWeCSkSeXf2lVFfjWelxpPnTNQ Sep 14 08:52:14.244080 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 08:52:14.244080 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 08:52:14.244080 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 08:52:14.244080 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 08:52:14.244080 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 08:52:14.244080 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 08:52:14.244080 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: aac1cc0aa271432d9b256569e220fc75 Sep 14 08:52:14.244080 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-ImagesNegativeTestJSON-463176074 Sep 14 08:52:14.244080 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 08:52:14.244080 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 08:52:14.245402 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/aac1cc0aa271432d9b256569e220fc75"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_aac1cc0aa271432d9b256569e220fc75"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/aac1cc0aa271432d9b256569e220fc75"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/aac1cc0aa271432d9b256569e220fc75"}]}] Sep 14 08:52:14.245402 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-ImagesNegativeTestJSON-463176074 Sep 14 08:52:14.245402 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: aac1cc0aa271432d9b256569e220fc75 Sep 14 08:52:14.245402 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-463176074 Sep 14 08:52:14.245402 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-ImagesNegativeTestJSON-463176074-project Sep 14 08:52:14.245402 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 08:52:14.245402 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 08:52:14.245402 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: be69c6b130994b87b32fe1b50916b500 Sep 14 08:52:14.245402 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-ImagesNegativeTestJSON-463176074-project Sep 14 08:52:14.245402 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 08:52:14.245402 n-d-836830-18 devstack@n-api.service[128758]: exception: Instance 3d2d7f4d-e204-42c4-b977-63119c1b8783 could not be found. Sep 14 08:52:14.245402 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': '3d2d7f4d-e204-42c4-b977-63119c1b8783'} Sep 14 08:52:14.246189 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:52:14.246189 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:52:14.246189 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 08:52:14.246189 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 08:52:14.246189 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 08:52:14.246189 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 08:52:14.246189 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 08:52:14.246189 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 08:52:14.246189 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 08:52:14.246189 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 08:52:14.246189 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d2d7f4d-e204-42c4-b977-63119c1b8783 could not be found. Sep 14 08:52:14.246189 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:52:14.246189 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:52:14.246189 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:52:14.246189 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:52:14.246189 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:52:14.246189 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:52:14.246189 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:52:14.246189 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:52:14.246189 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:52:14.247465 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:52:14.247465 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 08:52:14.247465 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 08:52:14.247465 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 08:52:14.247465 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 08:52:14.247465 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 08:52:14.247465 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 08:52:14.247465 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d2d7f4d-e204-42c4-b977-63119c1b8783 could not be found. Sep 14 08:52:14.247465 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:52:14.247465 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:52:14.247465 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:52:14.247465 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:52:14.247465 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:52:14.247465 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:52:14.247465 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:52:14.247465 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:52:14.247465 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d2d7f4d-e204-42c4-b977-63119c1b8783 could not be found. Sep 14 08:52:14.247465 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:52:14.248577 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-99615715-b3f9-46d5-bef6-a060d0c8b165 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] Returning 404 to user: Instance 3d2d7f4d-e204-42c4-b977-63119c1b8783 could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:52:14.248577 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-99615715-b3f9-46d5-bef6-a060d0c8b165 tempest-ImagesNegativeTestJSON-463176074 tempest-ImagesNegativeTestJSON-463176074-project] 10.222.0.60 "GET /compute/v2.1/servers/3d2d7f4d-e204-42c4-b977-63119c1b8783" status: 404 len: 111 microversion: 2.1 time: 0.033870 Sep 14 08:52:14.249718 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 465/941] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:14 2022] GET /compute/v2.1/servers/3d2d7f4d-e204-42c4-b977-63119c1b8783 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 08:52:14.254673 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-038cbac5-3e3b-4fd3-ba40-9b5c6f03d9cf tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:14.255402 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-038cbac5-3e3b-4fd3-ba40-9b5c6f03d9cf tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] [instance: 58b5d8a4-035b-4a2f-8a83-02ea69847900] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:14.261265 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-038cbac5-3e3b-4fd3-ba40-9b5c6f03d9cf tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:14.262022 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-038cbac5-3e3b-4fd3-ba40-9b5c6f03d9cf tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:14.262525 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-038cbac5-3e3b-4fd3-ba40-9b5c6f03d9cf tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:14.263344 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-038cbac5-3e3b-4fd3-ba40-9b5c6f03d9cf tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:14.263864 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-038cbac5-3e3b-4fd3-ba40-9b5c6f03d9cf tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:14.264368 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-038cbac5-3e3b-4fd3-ba40-9b5c6f03d9cf tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:14.401079 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-37361779-0c67-443b-9eb1-cd3454c077db tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:14.410325 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-37361779-0c67-443b-9eb1-cd3454c077db tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:14.411935 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-37361779-0c67-443b-9eb1-cd3454c077db tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:14.413131 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-37361779-0c67-443b-9eb1-cd3454c077db tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd" status: 200 len: 1412 microversion: 2.25 time: 0.329977 Sep 14 08:52:14.413900 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 477/942] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:52:14 2022] GET /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd => generated 1412 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:52:14.418901 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-76846684-7c3d-49d2-8196-8b5a4fccef03 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:14.419503 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-76846684-7c3d-49d2-8196-8b5a4fccef03 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] [instance: d4344070-484a-4a5e-9e37-5f3dad6ba536] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:14.428682 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-76846684-7c3d-49d2-8196-8b5a4fccef03 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:14.429769 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-76846684-7c3d-49d2-8196-8b5a4fccef03 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:14.430715 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-76846684-7c3d-49d2-8196-8b5a4fccef03 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:14.431541 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-76846684-7c3d-49d2-8196-8b5a4fccef03 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:14.432102 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-76846684-7c3d-49d2-8196-8b5a4fccef03 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:14.432627 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-76846684-7c3d-49d2-8196-8b5a4fccef03 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:14.460869 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-76846684-7c3d-49d2-8196-8b5a4fccef03 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] [instance: d4344070-484a-4a5e-9e37-5f3dad6ba536] Going to try to terminate instance {{(pid=128759) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 08:52:14.536220 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:52:14.554434 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-76846684-7c3d-49d2-8196-8b5a4fccef03 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] 10.222.0.60 "DELETE /compute/v2.1/servers/d4344070-484a-4a5e-9e37-5f3dad6ba536" status: 204 len: 0 microversion: 2.1 time: 0.138488 Sep 14 08:52:14.556062 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 478/943] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 08:52:14 2022] DELETE /compute/v2.1/servers/d4344070-484a-4a5e-9e37-5f3dad6ba536 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 08:52:14.564382 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-967eb334-fbce-41dc-a07d-37fec3983194 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:14.565260 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-967eb334-fbce-41dc-a07d-37fec3983194 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: af183467-9304-4c73-a29f-196e76ba21b5] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:14.574073 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-967eb334-fbce-41dc-a07d-37fec3983194 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:14.578368 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-967eb334-fbce-41dc-a07d-37fec3983194 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:14.579187 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-967eb334-fbce-41dc-a07d-37fec3983194 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:14.580335 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-967eb334-fbce-41dc-a07d-37fec3983194 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:14.581781 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-967eb334-fbce-41dc-a07d-37fec3983194 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:14.582352 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-967eb334-fbce-41dc-a07d-37fec3983194 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:14.582917 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=2 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:52:14.608169 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=32 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:52:15.166217 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-038cbac5-3e3b-4fd3-ba40-9b5c6f03d9cf tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeaac454f233408ba1597b36bb9277dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38a515fd540744a2bdf6fb971f4a6924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:15.174403 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-038cbac5-3e3b-4fd3-ba40-9b5c6f03d9cf tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] 10.222.0.60 "GET /compute/v2.1/servers/58b5d8a4-035b-4a2f-8a83-02ea69847900" status: 200 len: 1590 microversion: 2.1 time: 0.923409 Sep 14 08:52:15.175299 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 466/944] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:14 2022] GET /compute/v2.1/servers/58b5d8a4-035b-4a2f-8a83-02ea69847900 => generated 1590 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:52:15.180658 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-dffea941-49c3-4324-83bc-a6cc54846bee tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:15.181755 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-dffea941-49c3-4324-83bc-a6cc54846bee tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] [instance: d4344070-484a-4a5e-9e37-5f3dad6ba536] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:15.192101 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dffea941-49c3-4324-83bc-a6cc54846bee tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:15.192949 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dffea941-49c3-4324-83bc-a6cc54846bee tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:15.194581 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dffea941-49c3-4324-83bc-a6cc54846bee tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:15.195697 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dffea941-49c3-4324-83bc-a6cc54846bee tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:15.196903 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dffea941-49c3-4324-83bc-a6cc54846bee tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:15.198054 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-967eb334-fbce-41dc-a07d-37fec3983194 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:15.198342 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dffea941-49c3-4324-83bc-a6cc54846bee tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:15.220270 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-967eb334-fbce-41dc-a07d-37fec3983194 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/af183467-9304-4c73-a29f-196e76ba21b5" status: 200 len: 1541 microversion: 2.1 time: 0.661098 Sep 14 08:52:15.228459 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 479/945] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:14 2022] GET /compute/v2.1/servers/af183467-9304-4c73-a29f-196e76ba21b5 => generated 1541 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:52:15.235220 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-099758c3-c842-4b77-a931-865172be55df tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:15.237359 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-099758c3-c842-4b77-a931-865172be55df tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: 874205eb-5321-4a9a-aa38-3cd83b2ac1a3] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:15.248522 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-099758c3-c842-4b77-a931-865172be55df tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:15.249528 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-099758c3-c842-4b77-a931-865172be55df tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:15.250061 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-099758c3-c842-4b77-a931-865172be55df tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:15.251142 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-099758c3-c842-4b77-a931-865172be55df tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:15.251617 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-099758c3-c842-4b77-a931-865172be55df tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:15.252118 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-099758c3-c842-4b77-a931-865172be55df tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:15.624924 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-dffea941-49c3-4324-83bc-a6cc54846bee tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c7802984cf48d1852832b52abe52e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e326f95a9604fdb9bd075db3837cf62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:15.633761 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-dffea941-49c3-4324-83bc-a6cc54846bee tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] 10.222.0.60 "GET /compute/v2.1/servers/d4344070-484a-4a5e-9e37-5f3dad6ba536" status: 200 len: 1472 microversion: 2.1 time: 0.457222 Sep 14 08:52:15.644251 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 467/946] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:15 2022] GET /compute/v2.1/servers/d4344070-484a-4a5e-9e37-5f3dad6ba536 => generated 1472 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:52:15.653126 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-be0c3b3d-7d95-41b2-8da9-1bf76bb13c55 tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:15.653790 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-be0c3b3d-7d95-41b2-8da9-1bf76bb13c55 tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] [instance: 58b5d8a4-035b-4a2f-8a83-02ea69847900] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:15.661765 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-be0c3b3d-7d95-41b2-8da9-1bf76bb13c55 tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:15.662405 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-be0c3b3d-7d95-41b2-8da9-1bf76bb13c55 tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:15.664099 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-be0c3b3d-7d95-41b2-8da9-1bf76bb13c55 tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:15.665017 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-be0c3b3d-7d95-41b2-8da9-1bf76bb13c55 tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:15.665751 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-be0c3b3d-7d95-41b2-8da9-1bf76bb13c55 tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:15.666457 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-be0c3b3d-7d95-41b2-8da9-1bf76bb13c55 tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:15.682318 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-099758c3-c842-4b77-a931-865172be55df tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:15.696109 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-099758c3-c842-4b77-a931-865172be55df tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/874205eb-5321-4a9a-aa38-3cd83b2ac1a3" status: 200 len: 1503 microversion: 2.1 time: 0.466241 Sep 14 08:52:15.707126 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 480/947] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:15 2022] GET /compute/v2.1/servers/874205eb-5321-4a9a-aa38-3cd83b2ac1a3 => generated 1503 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:52:15.718511 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-dbf4bab5-875f-4804-9229-c0d4cc78a415 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:15.719181 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-dbf4bab5-875f-4804-9229-c0d4cc78a415 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: 8fce8438-d6ae-408d-8b4f-ee14d4021fdd] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:15.725311 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dbf4bab5-875f-4804-9229-c0d4cc78a415 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:15.726112 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dbf4bab5-875f-4804-9229-c0d4cc78a415 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:15.726726 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dbf4bab5-875f-4804-9229-c0d4cc78a415 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:15.727612 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dbf4bab5-875f-4804-9229-c0d4cc78a415 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:15.728087 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dbf4bab5-875f-4804-9229-c0d4cc78a415 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:15.728508 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dbf4bab5-875f-4804-9229-c0d4cc78a415 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:15.899887 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-be0c3b3d-7d95-41b2-8da9-1bf76bb13c55 tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] 10.222.0.60 "GET /compute/v2.1/servers/58b5d8a4-035b-4a2f-8a83-02ea69847900/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.252580 Sep 14 08:52:15.900887 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 468/948] 10.222.0.60 () {58 vars in 1275 bytes} [Wed Sep 14 08:52:15 2022] GET /compute/v2.1/servers/58b5d8a4-035b-4a2f-8a83-02ea69847900/os-interface => generated 285 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:52:16.199837 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-dbf4bab5-875f-4804-9229-c0d4cc78a415 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:16.208962 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-dbf4bab5-875f-4804-9229-c0d4cc78a415 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:16.216115 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-dbf4bab5-875f-4804-9229-c0d4cc78a415 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:16.217293 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-dbf4bab5-875f-4804-9229-c0d4cc78a415 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd" status: 200 len: 1412 microversion: 2.25 time: 0.508963 Sep 14 08:52:16.217889 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 481/949] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:52:15 2022] GET /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd => generated 1412 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:52:16.246479 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d0805eb0-c560-4a3d-80b5-9c019ac5624a tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:16.247570 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-d0805eb0-c560-4a3d-80b5-9c019ac5624a tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: af183467-9304-4c73-a29f-196e76ba21b5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:16.254581 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d0805eb0-c560-4a3d-80b5-9c019ac5624a tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:16.255373 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d0805eb0-c560-4a3d-80b5-9c019ac5624a tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:16.256020 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d0805eb0-c560-4a3d-80b5-9c019ac5624a tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:16.257296 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d0805eb0-c560-4a3d-80b5-9c019ac5624a tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:16.257942 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d0805eb0-c560-4a3d-80b5-9c019ac5624a tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:16.259175 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d0805eb0-c560-4a3d-80b5-9c019ac5624a tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:16.519854 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-d0805eb0-c560-4a3d-80b5-9c019ac5624a tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:16.528983 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-d0805eb0-c560-4a3d-80b5-9c019ac5624a tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/af183467-9304-4c73-a29f-196e76ba21b5" status: 200 len: 1541 microversion: 2.1 time: 0.286918 Sep 14 08:52:16.530199 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 469/950] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:16 2022] GET /compute/v2.1/servers/af183467-9304-4c73-a29f-196e76ba21b5 => generated 1541 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:52:16.658189 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-17489e6f-e153-46c9-b27f-c4964e3be1dc tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:16.658821 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-17489e6f-e153-46c9-b27f-c4964e3be1dc tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] [instance: d4344070-484a-4a5e-9e37-5f3dad6ba536] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:16.665428 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-17489e6f-e153-46c9-b27f-c4964e3be1dc tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:16.666079 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-17489e6f-e153-46c9-b27f-c4964e3be1dc tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:16.666521 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-17489e6f-e153-46c9-b27f-c4964e3be1dc tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:16.667255 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-17489e6f-e153-46c9-b27f-c4964e3be1dc tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:16.667885 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-17489e6f-e153-46c9-b27f-c4964e3be1dc tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:16.669317 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-17489e6f-e153-46c9-b27f-c4964e3be1dc tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:16.722232 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-443f50fa-09a4-4160-b4af-0d98162dd926 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:16.722857 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-443f50fa-09a4-4160-b4af-0d98162dd926 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: 874205eb-5321-4a9a-aa38-3cd83b2ac1a3] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:16.729834 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-443f50fa-09a4-4160-b4af-0d98162dd926 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:16.730322 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-443f50fa-09a4-4160-b4af-0d98162dd926 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:16.730974 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-443f50fa-09a4-4160-b4af-0d98162dd926 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:16.731695 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-443f50fa-09a4-4160-b4af-0d98162dd926 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:16.732149 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-443f50fa-09a4-4160-b4af-0d98162dd926 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:16.732728 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-443f50fa-09a4-4160-b4af-0d98162dd926 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:17.120063 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-17489e6f-e153-46c9-b27f-c4964e3be1dc tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c7802984cf48d1852832b52abe52e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e326f95a9604fdb9bd075db3837cf62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:17.132156 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-17489e6f-e153-46c9-b27f-c4964e3be1dc tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] 10.222.0.60 "GET /compute/v2.1/servers/d4344070-484a-4a5e-9e37-5f3dad6ba536" status: 200 len: 1472 microversion: 2.1 time: 0.477997 Sep 14 08:52:17.135414 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 482/951] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:16 2022] GET /compute/v2.1/servers/d4344070-484a-4a5e-9e37-5f3dad6ba536 => generated 1472 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:52:17.245039 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-182ed1a2-6b43-44c6-931d-09042edcc15b tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:17.246023 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-182ed1a2-6b43-44c6-931d-09042edcc15b tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: 8fce8438-d6ae-408d-8b4f-ee14d4021fdd] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:17.258954 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-182ed1a2-6b43-44c6-931d-09042edcc15b tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:17.259636 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-182ed1a2-6b43-44c6-931d-09042edcc15b tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:17.260354 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-182ed1a2-6b43-44c6-931d-09042edcc15b tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:17.263792 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-182ed1a2-6b43-44c6-931d-09042edcc15b tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:17.264786 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-182ed1a2-6b43-44c6-931d-09042edcc15b tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:17.265499 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-182ed1a2-6b43-44c6-931d-09042edcc15b tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:17.592577 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-443f50fa-09a4-4160-b4af-0d98162dd926 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:17.604322 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-443f50fa-09a4-4160-b4af-0d98162dd926 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/874205eb-5321-4a9a-aa38-3cd83b2ac1a3" status: 200 len: 1478 microversion: 2.1 time: 0.885457 Sep 14 08:52:17.605334 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 470/952] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:16 2022] GET /compute/v2.1/servers/874205eb-5321-4a9a-aa38-3cd83b2ac1a3 => generated 1478 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:52:17.610135 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-24afdebc-6dc5-43e1-8e3c-7509563e48ad tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:17.611031 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-24afdebc-6dc5-43e1-8e3c-7509563e48ad tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: af183467-9304-4c73-a29f-196e76ba21b5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:17.624375 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-24afdebc-6dc5-43e1-8e3c-7509563e48ad tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:17.625463 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-24afdebc-6dc5-43e1-8e3c-7509563e48ad tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:17.626224 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-24afdebc-6dc5-43e1-8e3c-7509563e48ad tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:17.627248 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-24afdebc-6dc5-43e1-8e3c-7509563e48ad tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:17.627935 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-24afdebc-6dc5-43e1-8e3c-7509563e48ad tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:17.628597 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-24afdebc-6dc5-43e1-8e3c-7509563e48ad tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:18.039853 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-182ed1a2-6b43-44c6-931d-09042edcc15b tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:18.048222 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-182ed1a2-6b43-44c6-931d-09042edcc15b tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:18.050202 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-182ed1a2-6b43-44c6-931d-09042edcc15b tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:18.051511 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-182ed1a2-6b43-44c6-931d-09042edcc15b tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd" status: 200 len: 1412 microversion: 2.25 time: 0.812834 Sep 14 08:52:18.052177 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 483/953] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:52:17 2022] GET /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd => generated 1412 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:52:18.057212 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d17b2b64-6a29-45a8-9ce0-6d6ca8b11291 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Calling method '.version_select at 0x7f7d44375280>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:18.061429 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d17b2b64-6a29-45a8-9ce0-6d6ca8b11291 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:18.062180 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d17b2b64-6a29-45a8-9ce0-6d6ca8b11291 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:18.062828 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d17b2b64-6a29-45a8-9ce0-6d6ca8b11291 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:18.083708 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-24afdebc-6dc5-43e1-8e3c-7509563e48ad tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:18.084208 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d17b2b64-6a29-45a8-9ce0-6d6ca8b11291 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] 10.222.0.60 "GET /compute/v2.1/os-migrations" status: 200 len: 2757 microversion: 2.1 time: 0.030373 Sep 14 08:52:18.092932 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 484/954] 10.222.0.60 () {58 vars in 1143 bytes} [Wed Sep 14 08:52:18 2022] GET /compute/v2.1/os-migrations => generated 2757 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:52:18.095977 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-24afdebc-6dc5-43e1-8e3c-7509563e48ad tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/af183467-9304-4c73-a29f-196e76ba21b5" status: 200 len: 1541 microversion: 2.1 time: 0.489328 Sep 14 08:52:18.098269 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 471/955] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:17 2022] GET /compute/v2.1/servers/af183467-9304-4c73-a29f-196e76ba21b5 => generated 1541 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:52:18.100341 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8f5f2db5-ef87-46b3-9c6c-261f8cc945f9 tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:18.101078 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-8f5f2db5-ef87-46b3-9c6c-261f8cc945f9 tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] [instance: 58b5d8a4-035b-4a2f-8a83-02ea69847900] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:18.106263 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-033aceec-5b19-434b-b75a-840191c46726 req-ccba4f12-761b-49f5-bfdf-5a87ff598d4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58b5d8a4-035b-4a2f-8a83-02ea69847900", "tag": "742f5d4d-837e-4e1e-8b53-228d7a64de9b"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:52:18.119090 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-033aceec-5b19-434b-b75a-840191c46726 req-ccba4f12-761b-49f5-bfdf-5a87ff598d4f service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:18.119992 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-033aceec-5b19-434b-b75a-840191c46726 req-ccba4f12-761b-49f5-bfdf-5a87ff598d4f service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:18.120593 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-033aceec-5b19-434b-b75a-840191c46726 req-ccba4f12-761b-49f5-bfdf-5a87ff598d4f service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:18.125052 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8f5f2db5-ef87-46b3-9c6c-261f8cc945f9 tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:18.128008 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8f5f2db5-ef87-46b3-9c6c-261f8cc945f9 tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:18.130889 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8f5f2db5-ef87-46b3-9c6c-261f8cc945f9 tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:18.134803 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8f5f2db5-ef87-46b3-9c6c-261f8cc945f9 tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:18.135376 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8f5f2db5-ef87-46b3-9c6c-261f8cc945f9 tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:18.137531 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8f5f2db5-ef87-46b3-9c6c-261f8cc945f9 tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:18.138426 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-033aceec-5b19-434b-b75a-840191c46726 req-ccba4f12-761b-49f5-bfdf-5a87ff598d4f service nova] Creating event network-changed:742f5d4d-837e-4e1e-8b53-228d7a64de9b for instance 58b5d8a4-035b-4a2f-8a83-02ea69847900 on n-h1-836830-18 Sep 14 08:52:18.145177 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-033aceec-5b19-434b-b75a-840191c46726 req-ccba4f12-761b-49f5-bfdf-5a87ff598d4f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045364 Sep 14 08:52:18.146272 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 472/956] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:52:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:52:18.172809 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-5fc96dbc-06d7-41c9-8b5e-fc5effed051c tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:18.177623 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-5fc96dbc-06d7-41c9-8b5e-fc5effed051c tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] [instance: 874205eb-5321-4a9a-aa38-3cd83b2ac1a3] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:18.196940 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5fc96dbc-06d7-41c9-8b5e-fc5effed051c tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:18.197777 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5fc96dbc-06d7-41c9-8b5e-fc5effed051c tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:18.199203 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5fc96dbc-06d7-41c9-8b5e-fc5effed051c tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:18.201625 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5fc96dbc-06d7-41c9-8b5e-fc5effed051c tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:18.204564 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5fc96dbc-06d7-41c9-8b5e-fc5effed051c tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:18.205181 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5fc96dbc-06d7-41c9-8b5e-fc5effed051c tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:18.717274 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-8f5f2db5-ef87-46b3-9c6c-261f8cc945f9 tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeaac454f233408ba1597b36bb9277dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38a515fd540744a2bdf6fb971f4a6924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:18.745746 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-8f5f2db5-ef87-46b3-9c6c-261f8cc945f9 tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] 10.222.0.60 "GET /compute/v2.1/servers/58b5d8a4-035b-4a2f-8a83-02ea69847900" status: 200 len: 1590 microversion: 2.1 time: 0.651508 Sep 14 08:52:18.747301 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 485/957] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:18 2022] GET /compute/v2.1/servers/58b5d8a4-035b-4a2f-8a83-02ea69847900 => generated 1590 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:52:18.754102 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e8f61d79-6ec0-48b4-860a-1a614b94e6d3 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:18.754843 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e8f61d79-6ec0-48b4-860a-1a614b94e6d3 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] [instance: d4344070-484a-4a5e-9e37-5f3dad6ba536] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:18.761397 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e8f61d79-6ec0-48b4-860a-1a614b94e6d3 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:18.761890 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e8f61d79-6ec0-48b4-860a-1a614b94e6d3 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:18.762323 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e8f61d79-6ec0-48b4-860a-1a614b94e6d3 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:18.763188 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e8f61d79-6ec0-48b4-860a-1a614b94e6d3 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:18.763833 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e8f61d79-6ec0-48b4-860a-1a614b94e6d3 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:18.766912 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e8f61d79-6ec0-48b4-860a-1a614b94e6d3 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:19.042512 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-5fc96dbc-06d7-41c9-8b5e-fc5effed051c tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/874205eb-5321-4a9a-aa38-3cd83b2ac1a3" status: 200 len: 1631 microversion: 2.1 time: 0.892454 Sep 14 08:52:19.044994 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 473/958] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:18 2022] GET /compute/v2.1/servers/874205eb-5321-4a9a-aa38-3cd83b2ac1a3 => generated 1631 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:52:19.055461 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-e8f61d79-6ec0-48b4-860a-1a614b94e6d3 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c7802984cf48d1852832b52abe52e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e326f95a9604fdb9bd075db3837cf62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:19.070275 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e8f61d79-6ec0-48b4-860a-1a614b94e6d3 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] 10.222.0.60 "GET /compute/v2.1/servers/d4344070-484a-4a5e-9e37-5f3dad6ba536" status: 200 len: 1430 microversion: 2.1 time: 0.314957 Sep 14 08:52:19.072714 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 486/959] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:18 2022] GET /compute/v2.1/servers/d4344070-484a-4a5e-9e37-5f3dad6ba536 => generated 1430 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:52:19.077414 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-daec3057-6d20-4cf6-8681-d571a2e7c4b9 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:19.077823 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-34314f8d-5bf9-4312-bdff-9f09bc9674fb tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Action: 'create', calling method: .version_select at 0x7f7d447bf0d0>, body: {"keypair": {"name": "tempest-keypair-384781694", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF/jAZAIRmE4REfOiCuitoFNseRjFzpcaDuwjQarOgNbDrnAAWSOM3zMtG2OoglN3pQ+okRXMRADZIbubUyu8mELR3xFYbshOY5vPilf4/uaM/ZSL6WHMLW87eaDKqhX+Q=="}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:52:19.078041 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-daec3057-6d20-4cf6-8681-d571a2e7c4b9 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: 8fce8438-d6ae-408d-8b4f-ee14d4021fdd] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:19.098484 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-daec3057-6d20-4cf6-8681-d571a2e7c4b9 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:19.099016 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-daec3057-6d20-4cf6-8681-d571a2e7c4b9 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:19.099464 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-daec3057-6d20-4cf6-8681-d571a2e7c4b9 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:19.101314 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-daec3057-6d20-4cf6-8681-d571a2e7c4b9 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:19.101794 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-daec3057-6d20-4cf6-8681-d571a2e7c4b9 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:19.102229 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-daec3057-6d20-4cf6-8681-d571a2e7c4b9 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:19.107879 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-34314f8d-5bf9-4312-bdff-9f09bc9674fb tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Getting quotas for project a7342631eeb747ba831f1d8a20fb8bf3. Resources: {'key_pairs'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 08:52:19.114554 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-34314f8d-5bf9-4312-bdff-9f09bc9674fb tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Getting quotas for user cd713a1c3e7148ef8bfcbe44d1a80a18 and project a7342631eeb747ba831f1d8a20fb8bf3. Resources: {'key_pairs'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 08:52:19.148622 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-34314f8d-5bf9-4312-bdff-9f09bc9674fb tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.075585 Sep 14 08:52:19.150490 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 474/960] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Sep 14 08:52:19 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:52:19.155384 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-c8679199-2bee-4f05-9003-b4165e0eaa28 req-d36bf92d-6399-4840-a7c6-caa97da0d979 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4344070-484a-4a5e-9e37-5f3dad6ba536", "name": "network-vif-deleted", "tag": "8377f14b-e4ff-4eaf-9b6b-075a29964f0f"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:52:19.185043 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-c8679199-2bee-4f05-9003-b4165e0eaa28 req-d36bf92d-6399-4840-a7c6-caa97da0d979 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:19.185511 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-c8679199-2bee-4f05-9003-b4165e0eaa28 req-d36bf92d-6399-4840-a7c6-caa97da0d979 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:19.185938 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-c8679199-2bee-4f05-9003-b4165e0eaa28 req-d36bf92d-6399-4840-a7c6-caa97da0d979 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:19.213095 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-c8679199-2bee-4f05-9003-b4165e0eaa28 req-d36bf92d-6399-4840-a7c6-caa97da0d979 service nova] Creating event network-vif-deleted:8377f14b-e4ff-4eaf-9b6b-075a29964f0f for instance d4344070-484a-4a5e-9e37-5f3dad6ba536 on n-h1-836830-18 Sep 14 08:52:19.222868 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-c8679199-2bee-4f05-9003-b4165e0eaa28 req-d36bf92d-6399-4840-a7c6-caa97da0d979 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070792 Sep 14 08:52:19.224263 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 475/961] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:52:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:52:19.230404 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-7420fe11-4b61-4e3b-9127-9d50349e9ecc tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:19.231677 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-7420fe11-4b61-4e3b-9127-9d50349e9ecc tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: af183467-9304-4c73-a29f-196e76ba21b5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:19.242491 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7420fe11-4b61-4e3b-9127-9d50349e9ecc tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:19.243142 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7420fe11-4b61-4e3b-9127-9d50349e9ecc tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:19.243731 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7420fe11-4b61-4e3b-9127-9d50349e9ecc tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:19.244437 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7420fe11-4b61-4e3b-9127-9d50349e9ecc tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:19.244925 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7420fe11-4b61-4e3b-9127-9d50349e9ecc tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:19.245368 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7420fe11-4b61-4e3b-9127-9d50349e9ecc tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:19.754807 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-daec3057-6d20-4cf6-8681-d571a2e7c4b9 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:19.768627 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-daec3057-6d20-4cf6-8681-d571a2e7c4b9 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:19.770291 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-daec3057-6d20-4cf6-8681-d571a2e7c4b9 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:19.771449 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-daec3057-6d20-4cf6-8681-d571a2e7c4b9 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd" status: 200 len: 1412 microversion: 2.25 time: 0.697769 Sep 14 08:52:19.772903 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 487/962] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:52:19 2022] GET /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd => generated 1412 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:52:19.775992 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-7420fe11-4b61-4e3b-9127-9d50349e9ecc tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:19.799869 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-7420fe11-4b61-4e3b-9127-9d50349e9ecc tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/af183467-9304-4c73-a29f-196e76ba21b5" status: 200 len: 1541 microversion: 2.1 time: 0.573632 Sep 14 08:52:19.801261 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 476/963] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:19 2022] GET /compute/v2.1/servers/af183467-9304-4c73-a29f-196e76ba21b5 => generated 1541 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:52:20.097991 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-41af205b-76d9-4740-b460-b1d3ad6d19d2 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:20.101975 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-41af205b-76d9-4740-b460-b1d3ad6d19d2 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] [instance: d4344070-484a-4a5e-9e37-5f3dad6ba536] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:20.126554 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-41af205b-76d9-4740-b460-b1d3ad6d19d2 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:20.129529 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-41af205b-76d9-4740-b460-b1d3ad6d19d2 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:20.130928 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-41af205b-76d9-4740-b460-b1d3ad6d19d2 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:20.135149 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-41af205b-76d9-4740-b460-b1d3ad6d19d2 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:20.137710 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-41af205b-76d9-4740-b460-b1d3ad6d19d2 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:20.139296 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-41af205b-76d9-4740-b460-b1d3ad6d19d2 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:20.160257 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:52:20.242623 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-41af205b-76d9-4740-b460-b1d3ad6d19d2 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:20.244071 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-41af205b-76d9-4740-b460-b1d3ad6d19d2 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:20.245221 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-41af205b-76d9-4740-b460-b1d3ad6d19d2 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:20.246686 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.objects.instance [None req-41af205b-76d9-4740-b460-b1d3ad6d19d2 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lazy-loading 'fault' on Instance uuid d4344070-484a-4a5e-9e37-5f3dad6ba536 {{(pid=128759) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 08:52:20.755072 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-0a5c4dba-3608-482b-806e-8c587a711ac9 req-b6f8d172-335e-42ab-8cb1-7433ef636d8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fce8438-d6ae-408d-8b4f-ee14d4021fdd", "name": "network-vif-plugged", "status": "completed", "tag": "8a7f2660-c507-4973-b860-0358d6cdd4f1"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:52:20.776066 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-0a5c4dba-3608-482b-806e-8c587a711ac9 req-b6f8d172-335e-42ab-8cb1-7433ef636d8d service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:20.782535 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-0a5c4dba-3608-482b-806e-8c587a711ac9 req-b6f8d172-335e-42ab-8cb1-7433ef636d8d service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:20.783408 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-0a5c4dba-3608-482b-806e-8c587a711ac9 req-b6f8d172-335e-42ab-8cb1-7433ef636d8d service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:20.807706 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-0a5c4dba-3608-482b-806e-8c587a711ac9 req-b6f8d172-335e-42ab-8cb1-7433ef636d8d service nova] Creating event network-vif-plugged:8a7f2660-c507-4973-b860-0358d6cdd4f1 for instance 8fce8438-d6ae-408d-8b4f-ee14d4021fdd on n-h2-836830-18 Sep 14 08:52:20.818145 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-0a5c4dba-3608-482b-806e-8c587a711ac9 req-b6f8d172-335e-42ab-8cb1-7433ef636d8d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076658 Sep 14 08:52:20.820663 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 477/964] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:52:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:52:20.883089 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-38a8dc50-b9c2-4ab7-81af-fedb3555b1b4 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:20.885125 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-38a8dc50-b9c2-4ab7-81af-fedb3555b1b4 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: 8fce8438-d6ae-408d-8b4f-ee14d4021fdd] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:20.917861 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-38a8dc50-b9c2-4ab7-81af-fedb3555b1b4 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:20.921018 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-38a8dc50-b9c2-4ab7-81af-fedb3555b1b4 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:20.925507 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-38a8dc50-b9c2-4ab7-81af-fedb3555b1b4 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:20.927359 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-38a8dc50-b9c2-4ab7-81af-fedb3555b1b4 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:20.928391 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-38a8dc50-b9c2-4ab7-81af-fedb3555b1b4 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:20.931632 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-38a8dc50-b9c2-4ab7-81af-fedb3555b1b4 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:20.992462 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-41af205b-76d9-4740-b460-b1d3ad6d19d2 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c7802984cf48d1852832b52abe52e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e326f95a9604fdb9bd075db3837cf62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:21.004707 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-41af205b-76d9-4740-b460-b1d3ad6d19d2 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] 10.222.0.60 "GET /compute/v2.1/servers/d4344070-484a-4a5e-9e37-5f3dad6ba536" status: 200 len: 1306 microversion: 2.1 time: 0.913630 Sep 14 08:52:21.006750 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 488/965] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:20 2022] GET /compute/v2.1/servers/d4344070-484a-4a5e-9e37-5f3dad6ba536 => generated 1306 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:52:21.014254 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-bb735228-37b0-477d-a7f5-ee930566d1c5 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:21.015694 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-bb735228-37b0-477d-a7f5-ee930566d1c5 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: af183467-9304-4c73-a29f-196e76ba21b5] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:21.024512 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bb735228-37b0-477d-a7f5-ee930566d1c5 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:21.025660 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bb735228-37b0-477d-a7f5-ee930566d1c5 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:21.026444 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bb735228-37b0-477d-a7f5-ee930566d1c5 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:21.029782 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bb735228-37b0-477d-a7f5-ee930566d1c5 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:21.030537 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bb735228-37b0-477d-a7f5-ee930566d1c5 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:21.031546 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bb735228-37b0-477d-a7f5-ee930566d1c5 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:21.483636 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-38a8dc50-b9c2-4ab7-81af-fedb3555b1b4 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:21.487360 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-bb735228-37b0-477d-a7f5-ee930566d1c5 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:21.494665 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-38a8dc50-b9c2-4ab7-81af-fedb3555b1b4 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:21.498316 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-38a8dc50-b9c2-4ab7-81af-fedb3555b1b4 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:21.498475 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-bb735228-37b0-477d-a7f5-ee930566d1c5 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/af183467-9304-4c73-a29f-196e76ba21b5" status: 200 len: 1541 microversion: 2.1 time: 0.489120 Sep 14 08:52:21.500910 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-38a8dc50-b9c2-4ab7-81af-fedb3555b1b4 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd" status: 200 len: 1412 microversion: 2.25 time: 0.678316 Sep 14 08:52:21.505824 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 489/966] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:21 2022] GET /compute/v2.1/servers/af183467-9304-4c73-a29f-196e76ba21b5 => generated 1541 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:52:21.520420 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 478/967] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:52:20 2022] GET /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd => generated 1412 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:52:22.028434 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-5870bd9f-2081-4a15-a66e-442be0b184ee tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:22.029423 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-5870bd9f-2081-4a15-a66e-442be0b184ee tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] [instance: d4344070-484a-4a5e-9e37-5f3dad6ba536] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:22.035714 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5870bd9f-2081-4a15-a66e-442be0b184ee tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:22.036469 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5870bd9f-2081-4a15-a66e-442be0b184ee tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:22.037080 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5870bd9f-2081-4a15-a66e-442be0b184ee tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:22.037981 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5870bd9f-2081-4a15-a66e-442be0b184ee tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:22.038604 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5870bd9f-2081-4a15-a66e-442be0b184ee tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:22.039235 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5870bd9f-2081-4a15-a66e-442be0b184ee tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:22.055574 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-5870bd9f-2081-4a15-a66e-442be0b184ee tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] HTTP exception thrown: Instance d4344070-484a-4a5e-9e37-5f3dad6ba536 could not be found. Sep 14 08:52:22.057523 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-5870bd9f-2081-4a15-a66e-442be0b184ee tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Request method failure captured: Sep 14 08:52:22.057523 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/d4344070-484a-4a5e-9e37-5f3dad6ba536 HTTP/1.1 Sep 14 08:52:22.057523 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 08:52:22.057523 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 08:52:22.057523 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 08:52:22.057523 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 08:52:22.057523 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 08:52:22.057523 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 08:52:22.057523 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 08:52:22.057523 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 08:52:22.057523 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZWCl-PBW4XwTIAlm_HDzFNUEwKCR-QX8kRMQlkDQ28-th7Hv5Ami7B5CdfKebuOcYBY8pBDcErYnw6Yoo-AEMZOR30AfoQXWHysSwGGQuX7FJimJhZb77LDAXJX1PJ_CPAwODcQceVHue0gK59ez0nQzHL0ZkFBiu-KQzoh7YQB5n0 Sep 14 08:52:22.057523 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 08:52:22.057523 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 08:52:22.057523 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 08:52:22.057523 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 08:52:22.057523 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 08:52:22.057523 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 08:52:22.057523 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 5e326f95a9604fdb9bd075db3837cf62 Sep 14 08:52:22.057523 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ServersOnMultiNodesTest-1258517383 Sep 14 08:52:22.057523 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 08:52:22.057523 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 08:52:22.058854 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/5e326f95a9604fdb9bd075db3837cf62"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_5e326f95a9604fdb9bd075db3837cf62"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5e326f95a9604fdb9bd075db3837cf62"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5e326f95a9604fdb9bd075db3837cf62"}]}] Sep 14 08:52:22.058854 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ServersOnMultiNodesTest-1258517383 Sep 14 08:52:22.058854 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 5e326f95a9604fdb9bd075db3837cf62 Sep 14 08:52:22.058854 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1258517383 Sep 14 08:52:22.058854 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ServersOnMultiNodesTest-1258517383-project Sep 14 08:52:22.058854 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 08:52:22.058854 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 08:52:22.058854 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 89c7802984cf48d1852832b52abe52e9 Sep 14 08:52:22.058854 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ServersOnMultiNodesTest-1258517383-project Sep 14 08:52:22.058854 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 08:52:22.058854 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance d4344070-484a-4a5e-9e37-5f3dad6ba536 could not be found. Sep 14 08:52:22.058854 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': 'd4344070-484a-4a5e-9e37-5f3dad6ba536'} Sep 14 08:52:22.059731 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:52:22.059731 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:52:22.059731 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 08:52:22.059731 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 08:52:22.059731 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 08:52:22.059731 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 08:52:22.059731 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 08:52:22.059731 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 08:52:22.059731 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 08:52:22.059731 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 08:52:22.059731 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4344070-484a-4a5e-9e37-5f3dad6ba536 could not be found. Sep 14 08:52:22.059731 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:52:22.059731 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:52:22.059731 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:52:22.059731 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:52:22.059731 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:52:22.059731 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:52:22.059731 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:52:22.059731 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:52:22.059731 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:52:22.061179 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:52:22.061179 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 08:52:22.061179 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 08:52:22.061179 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 08:52:22.061179 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 08:52:22.061179 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 08:52:22.061179 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 08:52:22.061179 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4344070-484a-4a5e-9e37-5f3dad6ba536 could not be found. Sep 14 08:52:22.061179 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:52:22.061179 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:52:22.061179 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:52:22.061179 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:52:22.061179 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:52:22.061179 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:52:22.061179 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:52:22.061179 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:52:22.061179 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4344070-484a-4a5e-9e37-5f3dad6ba536 could not be found. Sep 14 08:52:22.061179 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:52:22.062297 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-5870bd9f-2081-4a15-a66e-442be0b184ee tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Returning 404 to user: Instance d4344070-484a-4a5e-9e37-5f3dad6ba536 could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:52:22.062297 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-5870bd9f-2081-4a15-a66e-442be0b184ee tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] 10.222.0.60 "GET /compute/v2.1/servers/d4344070-484a-4a5e-9e37-5f3dad6ba536" status: 404 len: 111 microversion: 2.1 time: 0.034374 Sep 14 08:52:22.062895 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 490/968] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:22 2022] GET /compute/v2.1/servers/d4344070-484a-4a5e-9e37-5f3dad6ba536 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 08:52:22.068244 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-e1418d2d-7981-41be-85e3-112e78a78718 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:22.069267 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-e1418d2d-7981-41be-85e3-112e78a78718 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] [instance: bc188404-0e98-4977-9283-5360293f19e4] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:22.076266 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e1418d2d-7981-41be-85e3-112e78a78718 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:22.076755 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e1418d2d-7981-41be-85e3-112e78a78718 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:22.077188 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e1418d2d-7981-41be-85e3-112e78a78718 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:22.077882 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e1418d2d-7981-41be-85e3-112e78a78718 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:22.078333 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e1418d2d-7981-41be-85e3-112e78a78718 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:22.078753 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e1418d2d-7981-41be-85e3-112e78a78718 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:22.108979 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-e1418d2d-7981-41be-85e3-112e78a78718 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] [instance: bc188404-0e98-4977-9283-5360293f19e4] Going to try to terminate instance {{(pid=128758) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 08:52:22.185817 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:52:22.247067 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-e1418d2d-7981-41be-85e3-112e78a78718 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] 10.222.0.60 "DELETE /compute/v2.1/servers/bc188404-0e98-4977-9283-5360293f19e4" status: 204 len: 0 microversion: 2.1 time: 0.182430 Sep 14 08:52:22.248637 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 479/969] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 08:52:22 2022] DELETE /compute/v2.1/servers/bc188404-0e98-4977-9283-5360293f19e4 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 14 08:52:22.258106 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-78c6b1f6-5ded-49fb-8224-4d0ae446b0bb tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:22.258663 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-78c6b1f6-5ded-49fb-8224-4d0ae446b0bb tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] [instance: bc188404-0e98-4977-9283-5360293f19e4] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:22.269706 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-78c6b1f6-5ded-49fb-8224-4d0ae446b0bb tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:22.271419 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-78c6b1f6-5ded-49fb-8224-4d0ae446b0bb tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:22.272502 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-78c6b1f6-5ded-49fb-8224-4d0ae446b0bb tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:22.274423 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-78c6b1f6-5ded-49fb-8224-4d0ae446b0bb tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:22.278956 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-78c6b1f6-5ded-49fb-8224-4d0ae446b0bb tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:22.279706 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-78c6b1f6-5ded-49fb-8224-4d0ae446b0bb tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:22.340616 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-362b5f37-b7e5-4bdd-b6c3-0221db4d8773 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1482136392", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "networks": [{"uuid": "3e96754e-5525-4c7d-b9d8-ac1d87e859d5"}], "security_groups": [{"name": "tempest-securitygroup--499078622"}], "key_name": "tempest-keypair-384781694", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:52:22.524814 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-78c6b1f6-5ded-49fb-8224-4d0ae446b0bb tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c7802984cf48d1852832b52abe52e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e326f95a9604fdb9bd075db3837cf62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:22.532676 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-78c6b1f6-5ded-49fb-8224-4d0ae446b0bb tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] 10.222.0.60 "GET /compute/v2.1/servers/bc188404-0e98-4977-9283-5360293f19e4" status: 200 len: 1471 microversion: 2.1 time: 0.279539 Sep 14 08:52:22.539158 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.network.neutron [None req-362b5f37-b7e5-4bdd-b6c3-0221db4d8773 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] validate_networks() for [('3e96754e-5525-4c7d-b9d8-ac1d87e859d5', None, None, None, None, None)] {{(pid=128758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 08:52:22.543516 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 491/970] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:22 2022] GET /compute/v2.1/servers/bc188404-0e98-4977-9283-5360293f19e4 => generated 1471 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:52:22.551568 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9b591947-a272-4bf1-9c94-630829734bcb tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:22.553549 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-9b591947-a272-4bf1-9c94-630829734bcb tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: af183467-9304-4c73-a29f-196e76ba21b5] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:22.560593 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9b591947-a272-4bf1-9c94-630829734bcb tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:22.561091 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9b591947-a272-4bf1-9c94-630829734bcb tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:22.561520 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9b591947-a272-4bf1-9c94-630829734bcb tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:22.563704 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9b591947-a272-4bf1-9c94-630829734bcb tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:22.564174 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9b591947-a272-4bf1-9c94-630829734bcb tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:22.566601 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9b591947-a272-4bf1-9c94-630829734bcb tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:22.781751 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-9b591947-a272-4bf1-9c94-630829734bcb tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:22.796007 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-9b591947-a272-4bf1-9c94-630829734bcb tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/af183467-9304-4c73-a29f-196e76ba21b5" status: 200 len: 1541 microversion: 2.1 time: 0.251076 Sep 14 08:52:22.797740 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 492/971] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:22 2022] GET /compute/v2.1/servers/af183467-9304-4c73-a29f-196e76ba21b5 => generated 1541 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:52:22.803164 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8de94e41-aef6-442b-af9d-a257f0319ece tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:22.803939 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-8de94e41-aef6-442b-af9d-a257f0319ece tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: 8fce8438-d6ae-408d-8b4f-ee14d4021fdd] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:22.813235 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8de94e41-aef6-442b-af9d-a257f0319ece tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:22.813922 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8de94e41-aef6-442b-af9d-a257f0319ece tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:22.814520 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8de94e41-aef6-442b-af9d-a257f0319ece tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:22.815425 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8de94e41-aef6-442b-af9d-a257f0319ece tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:22.817212 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8de94e41-aef6-442b-af9d-a257f0319ece tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:22.817857 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8de94e41-aef6-442b-af9d-a257f0319ece tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:23.100188 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-8de94e41-aef6-442b-af9d-a257f0319ece tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:23.112189 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-8de94e41-aef6-442b-af9d-a257f0319ece tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:23.115145 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-8de94e41-aef6-442b-af9d-a257f0319ece tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:23.117676 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-8de94e41-aef6-442b-af9d-a257f0319ece tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd" status: 200 len: 1412 microversion: 2.25 time: 0.318830 Sep 14 08:52:23.118524 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 493/972] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:52:22 2022] GET /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd => generated 1412 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:52:23.177202 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-362b5f37-b7e5-4bdd-b6c3-0221db4d8773 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Flavor limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 08:52:23.177703 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-362b5f37-b7e5-4bdd-b6c3-0221db4d8773 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Image limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 08:52:23.178653 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-362b5f37-b7e5-4bdd-b6c3-0221db4d8773 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Flavor pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 08:52:23.179141 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-362b5f37-b7e5-4bdd-b6c3-0221db4d8773 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Image pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 08:52:23.179729 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-362b5f37-b7e5-4bdd-b6c3-0221db4d8773 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 08:52:23.190467 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-362b5f37-b7e5-4bdd-b6c3-0221db4d8773 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:23.190972 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-362b5f37-b7e5-4bdd-b6c3-0221db4d8773 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:23.191584 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-362b5f37-b7e5-4bdd-b6c3-0221db4d8773 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:23.192484 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-362b5f37-b7e5-4bdd-b6c3-0221db4d8773 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:23.193059 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-362b5f37-b7e5-4bdd-b6c3-0221db4d8773 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:23.193407 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-362b5f37-b7e5-4bdd-b6c3-0221db4d8773 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:23.219437 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-362b5f37-b7e5-4bdd-b6c3-0221db4d8773 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Getting quotas for project a7342631eeb747ba831f1d8a20fb8bf3. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 08:52:23.225699 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-362b5f37-b7e5-4bdd-b6c3-0221db4d8773 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Getting quotas for user cd713a1c3e7148ef8bfcbe44d1a80a18 and project a7342631eeb747ba831f1d8a20fb8bf3. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 08:52:23.245049 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-362b5f37-b7e5-4bdd-b6c3-0221db4d8773 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Going to run 1 instances... {{(pid=128758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 08:52:23.247611 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-362b5f37-b7e5-4bdd-b6c3-0221db4d8773 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: 2098e0b9-b628-4b9e-979b-960c68830fee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 08:52:23.317505 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-362b5f37-b7e5-4bdd-b6c3-0221db4d8773 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.981867 Sep 14 08:52:23.319491 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 480/973] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 08:52:22 2022] POST /compute/v2.1/servers => generated 405 bytes in 985 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 08:52:23.333836 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f794129f-c100-4f3f-bf02-3a9bc8d0ed9c tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:23.334923 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f794129f-c100-4f3f-bf02-3a9bc8d0ed9c tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: 2098e0b9-b628-4b9e-979b-960c68830fee] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:23.414885 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f794129f-c100-4f3f-bf02-3a9bc8d0ed9c tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:23.422750 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f794129f-c100-4f3f-bf02-3a9bc8d0ed9c tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/2098e0b9-b628-4b9e-979b-960c68830fee" status: 200 len: 1234 microversion: 2.1 time: 0.096030 Sep 14 08:52:23.424217 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 494/974] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:23 2022] GET /compute/v2.1/servers/2098e0b9-b628-4b9e-979b-960c68830fee => generated 1234 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:52:23.563244 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-5ab715fd-0efb-41f5-b77a-e5548eeb101b tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:23.563873 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-5ab715fd-0efb-41f5-b77a-e5548eeb101b tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] [instance: bc188404-0e98-4977-9283-5360293f19e4] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:23.572766 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5ab715fd-0efb-41f5-b77a-e5548eeb101b tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:23.573434 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5ab715fd-0efb-41f5-b77a-e5548eeb101b tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:23.573887 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5ab715fd-0efb-41f5-b77a-e5548eeb101b tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:23.574616 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5ab715fd-0efb-41f5-b77a-e5548eeb101b tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:23.575121 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5ab715fd-0efb-41f5-b77a-e5548eeb101b tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:23.575539 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5ab715fd-0efb-41f5-b77a-e5548eeb101b tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:23.780636 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-5ab715fd-0efb-41f5-b77a-e5548eeb101b tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c7802984cf48d1852832b52abe52e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e326f95a9604fdb9bd075db3837cf62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:23.789607 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-5ab715fd-0efb-41f5-b77a-e5548eeb101b tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] 10.222.0.60 "GET /compute/v2.1/servers/bc188404-0e98-4977-9283-5360293f19e4" status: 200 len: 1471 microversion: 2.1 time: 0.237036 Sep 14 08:52:23.799750 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 481/975] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:23 2022] GET /compute/v2.1/servers/bc188404-0e98-4977-9283-5360293f19e4 => generated 1471 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:52:23.823177 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-82da1fc0-f953-4f9d-9cb1-66de4089adcf tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:23.824102 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-82da1fc0-f953-4f9d-9cb1-66de4089adcf tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: af183467-9304-4c73-a29f-196e76ba21b5] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:23.830870 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-82da1fc0-f953-4f9d-9cb1-66de4089adcf tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:23.831560 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-82da1fc0-f953-4f9d-9cb1-66de4089adcf tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:23.832182 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-82da1fc0-f953-4f9d-9cb1-66de4089adcf tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:23.833042 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-82da1fc0-f953-4f9d-9cb1-66de4089adcf tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:23.834641 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-82da1fc0-f953-4f9d-9cb1-66de4089adcf tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:23.836283 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-82da1fc0-f953-4f9d-9cb1-66de4089adcf tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:24.089928 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-82da1fc0-f953-4f9d-9cb1-66de4089adcf tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:24.101892 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-82da1fc0-f953-4f9d-9cb1-66de4089adcf tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/af183467-9304-4c73-a29f-196e76ba21b5" status: 200 len: 1541 microversion: 2.1 time: 0.283953 Sep 14 08:52:24.103735 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 495/976] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:23 2022] GET /compute/v2.1/servers/af183467-9304-4c73-a29f-196e76ba21b5 => generated 1541 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:52:24.150652 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-7adc35a2-68cc-4481-9adf-e59786a894b7 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:24.151307 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-7adc35a2-68cc-4481-9adf-e59786a894b7 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: 8fce8438-d6ae-408d-8b4f-ee14d4021fdd] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:24.157729 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7adc35a2-68cc-4481-9adf-e59786a894b7 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:24.158222 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7adc35a2-68cc-4481-9adf-e59786a894b7 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:24.158660 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7adc35a2-68cc-4481-9adf-e59786a894b7 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:24.159406 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7adc35a2-68cc-4481-9adf-e59786a894b7 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:24.160064 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7adc35a2-68cc-4481-9adf-e59786a894b7 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:24.160499 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7adc35a2-68cc-4481-9adf-e59786a894b7 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:24.367940 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-7adc35a2-68cc-4481-9adf-e59786a894b7 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:24.377851 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-7adc35a2-68cc-4481-9adf-e59786a894b7 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:24.379868 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-7adc35a2-68cc-4481-9adf-e59786a894b7 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:24.381626 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-7adc35a2-68cc-4481-9adf-e59786a894b7 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd" status: 200 len: 1608 microversion: 2.25 time: 0.235877 Sep 14 08:52:24.402743 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 482/977] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:52:24 2022] GET /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd => generated 1608 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:52:24.408662 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-65373959-918b-4531-8001-4aaaa66d05d0 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:24.409170 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-65373959-918b-4531-8001-4aaaa66d05d0 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: 8fce8438-d6ae-408d-8b4f-ee14d4021fdd] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:24.417054 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-65373959-918b-4531-8001-4aaaa66d05d0 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:24.417560 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-65373959-918b-4531-8001-4aaaa66d05d0 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:24.417996 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-65373959-918b-4531-8001-4aaaa66d05d0 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:24.418767 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-65373959-918b-4531-8001-4aaaa66d05d0 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:24.419422 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-65373959-918b-4531-8001-4aaaa66d05d0 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:24.419857 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-65373959-918b-4531-8001-4aaaa66d05d0 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:24.449417 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-63faa9f0-5a11-4ddb-bbbe-8878a4b19ac4 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:24.450057 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-63faa9f0-5a11-4ddb-bbbe-8878a4b19ac4 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: 2098e0b9-b628-4b9e-979b-960c68830fee] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:24.460466 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-63faa9f0-5a11-4ddb-bbbe-8878a4b19ac4 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:24.460985 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-63faa9f0-5a11-4ddb-bbbe-8878a4b19ac4 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:24.461440 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-63faa9f0-5a11-4ddb-bbbe-8878a4b19ac4 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:24.462125 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-63faa9f0-5a11-4ddb-bbbe-8878a4b19ac4 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:24.462583 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-63faa9f0-5a11-4ddb-bbbe-8878a4b19ac4 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:24.463041 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-63faa9f0-5a11-4ddb-bbbe-8878a4b19ac4 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:24.668477 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-63faa9f0-5a11-4ddb-bbbe-8878a4b19ac4 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:24.682392 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-63faa9f0-5a11-4ddb-bbbe-8878a4b19ac4 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/2098e0b9-b628-4b9e-979b-960c68830fee" status: 200 len: 1286 microversion: 2.1 time: 0.236255 Sep 14 08:52:24.694970 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 483/978] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:24 2022] GET /compute/v2.1/servers/2098e0b9-b628-4b9e-979b-960c68830fee => generated 1286 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:52:24.703010 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-65373959-918b-4531-8001-4aaaa66d05d0 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd/os-interface" status: 200 len: 285 microversion: 2.25 time: 0.298522 Sep 14 08:52:24.712635 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 496/979] 10.222.0.60 () {60 vars in 1316 bytes} [Wed Sep 14 08:52:24 2022] GET /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd/os-interface => generated 285 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 08:52:24.723045 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-56886077-1048-467f-ad23-fdad645df358 req-652c3c13-9e2c-48a8-8f9e-b7f2cff284ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc188404-0e98-4977-9283-5360293f19e4", "name": "network-vif-deleted", "tag": "7f4ebc9e-5bd1-4dd1-a610-5d01c4399dae"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:52:24.739893 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-56886077-1048-467f-ad23-fdad645df358 req-652c3c13-9e2c-48a8-8f9e-b7f2cff284ae service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:24.740544 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-56886077-1048-467f-ad23-fdad645df358 req-652c3c13-9e2c-48a8-8f9e-b7f2cff284ae service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:24.741069 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-56886077-1048-467f-ad23-fdad645df358 req-652c3c13-9e2c-48a8-8f9e-b7f2cff284ae service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:24.757907 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-56886077-1048-467f-ad23-fdad645df358 req-652c3c13-9e2c-48a8-8f9e-b7f2cff284ae service nova] Creating event network-vif-deleted:7f4ebc9e-5bd1-4dd1-a610-5d01c4399dae for instance bc188404-0e98-4977-9283-5360293f19e4 on n-h2-836830-18 Sep 14 08:52:24.764441 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-56886077-1048-467f-ad23-fdad645df358 req-652c3c13-9e2c-48a8-8f9e-b7f2cff284ae service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045843 Sep 14 08:52:24.766042 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 484/980] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:52:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:52:24.814714 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-5344a8d8-8002-4a9e-9b4d-947c723fe830 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:24.815632 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-5344a8d8-8002-4a9e-9b4d-947c723fe830 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] [instance: bc188404-0e98-4977-9283-5360293f19e4] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:24.828376 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5344a8d8-8002-4a9e-9b4d-947c723fe830 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:24.829179 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5344a8d8-8002-4a9e-9b4d-947c723fe830 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:24.829720 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5344a8d8-8002-4a9e-9b4d-947c723fe830 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:24.831581 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5344a8d8-8002-4a9e-9b4d-947c723fe830 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:24.832144 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5344a8d8-8002-4a9e-9b4d-947c723fe830 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:24.832722 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5344a8d8-8002-4a9e-9b4d-947c723fe830 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:24.896334 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5344a8d8-8002-4a9e-9b4d-947c723fe830 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:24.897765 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5344a8d8-8002-4a9e-9b4d-947c723fe830 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:24.898579 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5344a8d8-8002-4a9e-9b4d-947c723fe830 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:24.899419 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.objects.instance [None req-5344a8d8-8002-4a9e-9b4d-947c723fe830 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lazy-loading 'fault' on Instance uuid bc188404-0e98-4977-9283-5360293f19e4 {{(pid=128759) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 08:52:25.013042 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-5344a8d8-8002-4a9e-9b4d-947c723fe830 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c7802984cf48d1852832b52abe52e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e326f95a9604fdb9bd075db3837cf62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:25.024806 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-5344a8d8-8002-4a9e-9b4d-947c723fe830 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] 10.222.0.60 "GET /compute/v2.1/servers/bc188404-0e98-4977-9283-5360293f19e4" status: 200 len: 1306 microversion: 2.1 time: 0.214455 Sep 14 08:52:25.027631 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 497/981] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:24 2022] GET /compute/v2.1/servers/bc188404-0e98-4977-9283-5360293f19e4 => generated 1306 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:52:25.136521 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-0acf88d6-3993-4ab7-a63b-bf1826b678be tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:25.141119 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-0acf88d6-3993-4ab7-a63b-bf1826b678be tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: af183467-9304-4c73-a29f-196e76ba21b5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:25.160512 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0acf88d6-3993-4ab7-a63b-bf1826b678be tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:25.161011 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0acf88d6-3993-4ab7-a63b-bf1826b678be tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:25.161454 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0acf88d6-3993-4ab7-a63b-bf1826b678be tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:25.162694 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0acf88d6-3993-4ab7-a63b-bf1826b678be tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:25.181889 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0acf88d6-3993-4ab7-a63b-bf1826b678be tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:25.182511 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0acf88d6-3993-4ab7-a63b-bf1826b678be tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:25.298009 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f3091334-9172-4e6a-bbed-44b495c590f6 tempest-ImagesMetadataTestJSON-553932472 tempest-ImagesMetadataTestJSON-553932472-project] Calling method '.version_select at 0x7f7d442e35e0>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:25.363644 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f3091334-9172-4e6a-bbed-44b495c590f6 tempest-ImagesMetadataTestJSON-553932472 tempest-ImagesMetadataTestJSON-553932472-project] 10.222.0.60 "GET /compute/v2.1/images/360ec463-8154-4d82-b551-86eca9db5e18" status: 200 len: 636 microversion: 2.1 time: 0.069399 Sep 14 08:52:25.376501 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 498/982] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 08:52:25 2022] GET /compute/v2.1/images/360ec463-8154-4d82-b551-86eca9db5e18 => generated 636 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:52:25.383404 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-506a3ab3-c95b-4ddd-aee5-a58e4739cc97 tempest-ImagesMetadataTestJSON-553932472 tempest-ImagesMetadataTestJSON-553932472-project] Action: 'update_all', calling method: .version_select at 0x7f7d442eb1f0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:52:25.474397 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-506a3ab3-c95b-4ddd-aee5-a58e4739cc97 tempest-ImagesMetadataTestJSON-553932472 tempest-ImagesMetadataTestJSON-553932472-project] Getting quotas for project 28844478ec7740b7b959775b5c0fea77. Resources: dict_keys(['metadata_items']) {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 08:52:25.481474 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-506a3ab3-c95b-4ddd-aee5-a58e4739cc97 tempest-ImagesMetadataTestJSON-553932472 tempest-ImagesMetadataTestJSON-553932472-project] Getting quotas for user c59c81e3be6342b2a446ea246fc8c53d and project 28844478ec7740b7b959775b5c0fea77. Resources: dict_keys(['metadata_items']) {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 08:52:25.833493 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-506a3ab3-c95b-4ddd-aee5-a58e4739cc97 tempest-ImagesMetadataTestJSON-553932472 tempest-ImagesMetadataTestJSON-553932472-project] 10.222.0.60 "PUT /compute/v2.1/images/360ec463-8154-4d82-b551-86eca9db5e18/metadata" status: 200 len: 61 microversion: 2.1 time: 0.455029 Sep 14 08:52:25.834529 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 499/983] 10.222.0.60 () {60 vars in 1280 bytes} [Wed Sep 14 08:52:25 2022] PUT /compute/v2.1/images/360ec463-8154-4d82-b551-86eca9db5e18/metadata => generated 61 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 08:52:25.839961 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b38d23b6-3b59-4970-9468-18590dfb52e6 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:25.840588 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b38d23b6-3b59-4970-9468-18590dfb52e6 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: 2098e0b9-b628-4b9e-979b-960c68830fee] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:25.846399 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-0acf88d6-3993-4ab7-a63b-bf1826b678be tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:25.847425 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b38d23b6-3b59-4970-9468-18590dfb52e6 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:25.848129 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b38d23b6-3b59-4970-9468-18590dfb52e6 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:25.848739 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b38d23b6-3b59-4970-9468-18590dfb52e6 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:25.849609 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b38d23b6-3b59-4970-9468-18590dfb52e6 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:25.850994 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b38d23b6-3b59-4970-9468-18590dfb52e6 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:25.851386 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b38d23b6-3b59-4970-9468-18590dfb52e6 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:25.867762 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-0acf88d6-3993-4ab7-a63b-bf1826b678be tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/af183467-9304-4c73-a29f-196e76ba21b5" status: 200 len: 1541 microversion: 2.1 time: 0.742640 Sep 14 08:52:25.868382 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 485/984] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:25 2022] GET /compute/v2.1/servers/af183467-9304-4c73-a29f-196e76ba21b5 => generated 1541 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:52:25.881028 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1ef39ead-f5a4-4e28-b132-5ddd2414992b tempest-ImagesMetadataTestJSON-553932472 tempest-ImagesMetadataTestJSON-553932472-project] Calling method '.version_select at 0x7f7d45040430>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:26.029905 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b38d23b6-3b59-4970-9468-18590dfb52e6 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:26.055275 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b38d23b6-3b59-4970-9468-18590dfb52e6 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/2098e0b9-b628-4b9e-979b-960c68830fee" status: 200 len: 1292 microversion: 2.1 time: 0.219019 Sep 14 08:52:26.072366 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 500/985] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:25 2022] GET /compute/v2.1/servers/2098e0b9-b628-4b9e-979b-960c68830fee => generated 1292 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:52:26.079613 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-978fd136-8b26-45c9-ab40-a524fbf0d121 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:26.081831 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-978fd136-8b26-45c9-ab40-a524fbf0d121 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] [instance: bc188404-0e98-4977-9283-5360293f19e4] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:26.089205 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-978fd136-8b26-45c9-ab40-a524fbf0d121 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:26.090060 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-978fd136-8b26-45c9-ab40-a524fbf0d121 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:26.091520 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-978fd136-8b26-45c9-ab40-a524fbf0d121 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:26.092501 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-978fd136-8b26-45c9-ab40-a524fbf0d121 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:26.093217 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-978fd136-8b26-45c9-ab40-a524fbf0d121 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:26.093866 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-978fd136-8b26-45c9-ab40-a524fbf0d121 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:26.110437 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-978fd136-8b26-45c9-ab40-a524fbf0d121 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] HTTP exception thrown: Instance bc188404-0e98-4977-9283-5360293f19e4 could not be found. Sep 14 08:52:26.113174 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-978fd136-8b26-45c9-ab40-a524fbf0d121 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Request method failure captured: Sep 14 08:52:26.113174 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/bc188404-0e98-4977-9283-5360293f19e4 HTTP/1.1 Sep 14 08:52:26.113174 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 08:52:26.113174 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 08:52:26.113174 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 08:52:26.113174 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 08:52:26.113174 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 08:52:26.113174 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 08:52:26.113174 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 08:52:26.113174 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 08:52:26.113174 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZWCl-PBW4XwTIAlm_HDzFNUEwKCR-QX8kRMQlkDQ28-th7Hv5Ami7B5CdfKebuOcYBY8pBDcErYnw6Yoo-AEMZOR30AfoQXWHysSwGGQuX7FJimJhZb77LDAXJX1PJ_CPAwODcQceVHue0gK59ez0nQzHL0ZkFBiu-KQzoh7YQB5n0 Sep 14 08:52:26.113174 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 08:52:26.113174 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 08:52:26.113174 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 08:52:26.113174 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 08:52:26.113174 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 08:52:26.113174 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 08:52:26.113174 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 5e326f95a9604fdb9bd075db3837cf62 Sep 14 08:52:26.113174 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ServersOnMultiNodesTest-1258517383 Sep 14 08:52:26.113174 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 08:52:26.113174 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 08:52:26.114562 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/5e326f95a9604fdb9bd075db3837cf62"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_5e326f95a9604fdb9bd075db3837cf62"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5e326f95a9604fdb9bd075db3837cf62"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5e326f95a9604fdb9bd075db3837cf62"}]}] Sep 14 08:52:26.114562 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ServersOnMultiNodesTest-1258517383 Sep 14 08:52:26.114562 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 5e326f95a9604fdb9bd075db3837cf62 Sep 14 08:52:26.114562 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1258517383 Sep 14 08:52:26.114562 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ServersOnMultiNodesTest-1258517383-project Sep 14 08:52:26.114562 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 08:52:26.114562 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 08:52:26.114562 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 89c7802984cf48d1852832b52abe52e9 Sep 14 08:52:26.114562 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ServersOnMultiNodesTest-1258517383-project Sep 14 08:52:26.114562 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 08:52:26.114562 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance bc188404-0e98-4977-9283-5360293f19e4 could not be found. Sep 14 08:52:26.114562 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': 'bc188404-0e98-4977-9283-5360293f19e4'} Sep 14 08:52:26.115433 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:52:26.115433 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:52:26.115433 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 08:52:26.115433 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 08:52:26.115433 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 08:52:26.115433 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 08:52:26.115433 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 08:52:26.115433 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 08:52:26.115433 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 08:52:26.115433 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 08:52:26.115433 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc188404-0e98-4977-9283-5360293f19e4 could not be found. Sep 14 08:52:26.115433 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:52:26.115433 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:52:26.115433 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:52:26.115433 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:52:26.115433 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:52:26.115433 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:52:26.115433 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:52:26.115433 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:52:26.115433 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:52:26.116684 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:52:26.116684 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 08:52:26.116684 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 08:52:26.116684 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 08:52:26.116684 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 08:52:26.116684 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 08:52:26.116684 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 08:52:26.116684 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc188404-0e98-4977-9283-5360293f19e4 could not be found. Sep 14 08:52:26.116684 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:52:26.116684 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:52:26.116684 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:52:26.116684 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:52:26.116684 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:52:26.116684 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:52:26.116684 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:52:26.116684 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:52:26.116684 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc188404-0e98-4977-9283-5360293f19e4 could not be found. Sep 14 08:52:26.116684 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:52:26.119822 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-978fd136-8b26-45c9-ab40-a524fbf0d121 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Returning 404 to user: Instance bc188404-0e98-4977-9283-5360293f19e4 could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:52:26.120944 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-978fd136-8b26-45c9-ab40-a524fbf0d121 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] 10.222.0.60 "GET /compute/v2.1/servers/bc188404-0e98-4977-9283-5360293f19e4" status: 404 len: 111 microversion: 2.1 time: 0.046795 Sep 14 08:52:26.122776 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 501/986] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:26 2022] GET /compute/v2.1/servers/bc188404-0e98-4977-9283-5360293f19e4 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 08:52:26.131078 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-faa3f80d-5720-403b-ab92-fd6a6e2601b6 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:26.132710 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-faa3f80d-5720-403b-ab92-fd6a6e2601b6 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] [instance: 3067be21-37ff-4a8f-8ca9-b1421e8be78f] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:26.139387 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-faa3f80d-5720-403b-ab92-fd6a6e2601b6 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:26.140411 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-faa3f80d-5720-403b-ab92-fd6a6e2601b6 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:26.141067 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-faa3f80d-5720-403b-ab92-fd6a6e2601b6 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:26.142771 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-faa3f80d-5720-403b-ab92-fd6a6e2601b6 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:26.143576 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-faa3f80d-5720-403b-ab92-fd6a6e2601b6 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:26.144263 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-faa3f80d-5720-403b-ab92-fd6a6e2601b6 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:26.177858 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-faa3f80d-5720-403b-ab92-fd6a6e2601b6 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] [instance: 3067be21-37ff-4a8f-8ca9-b1421e8be78f] Going to try to terminate instance {{(pid=128759) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 08:52:26.253123 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-1ef39ead-f5a4-4e28-b132-5ddd2414992b tempest-ImagesMetadataTestJSON-553932472 tempest-ImagesMetadataTestJSON-553932472-project] 10.222.0.60 "DELETE /compute/v2.1/images/360ec463-8154-4d82-b551-86eca9db5e18/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.383569 Sep 14 08:52:26.255208 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 486/987] 10.222.0.60 () {58 vars in 1296 bytes} [Wed Sep 14 08:52:25 2022] DELETE /compute/v2.1/images/360ec463-8154-4d82-b551-86eca9db5e18/metadata/os_version => generated 0 bytes in 386 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 08:52:26.266106 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-56a11e1c-b0c4-42fb-bb2e-80a547b16e6e tempest-ImagesMetadataTestJSON-553932472 tempest-ImagesMetadataTestJSON-553932472-project] Calling method '.version_select at 0x7f7d44604310>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:26.302901 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-faa3f80d-5720-403b-ab92-fd6a6e2601b6 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] 10.222.0.60 "DELETE /compute/v2.1/servers/3067be21-37ff-4a8f-8ca9-b1421e8be78f" status: 204 len: 0 microversion: 2.1 time: 0.175255 Sep 14 08:52:26.305273 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 502/988] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 08:52:26 2022] DELETE /compute/v2.1/servers/3067be21-37ff-4a8f-8ca9-b1421e8be78f => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 14 08:52:26.316044 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-20b55ec8-a128-477f-833b-87d36725b6c6 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:26.316784 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-20b55ec8-a128-477f-833b-87d36725b6c6 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] [instance: 3067be21-37ff-4a8f-8ca9-b1421e8be78f] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:26.325760 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-20b55ec8-a128-477f-833b-87d36725b6c6 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:26.326462 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-20b55ec8-a128-477f-833b-87d36725b6c6 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:26.327398 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-20b55ec8-a128-477f-833b-87d36725b6c6 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:26.328135 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-20b55ec8-a128-477f-833b-87d36725b6c6 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:26.328740 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-20b55ec8-a128-477f-833b-87d36725b6c6 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:26.329218 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-20b55ec8-a128-477f-833b-87d36725b6c6 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:26.331000 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-56a11e1c-b0c4-42fb-bb2e-80a547b16e6e tempest-ImagesMetadataTestJSON-553932472 tempest-ImagesMetadataTestJSON-553932472-project] 10.222.0.60 "GET /compute/v2.1/images/360ec463-8154-4d82-b551-86eca9db5e18/metadata" status: 200 len: 37 microversion: 2.1 time: 0.069180 Sep 14 08:52:26.331975 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 487/989] 10.222.0.60 () {58 vars in 1260 bytes} [Wed Sep 14 08:52:26 2022] GET /compute/v2.1/images/360ec463-8154-4d82-b551-86eca9db5e18/metadata => generated 37 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 08:52:26.343953 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-7c72db9e-2df6-4373-8c67-7f8c50e1be21 tempest-ImagesMetadataTestJSON-553932472 tempest-ImagesMetadataTestJSON-553932472-project] Action: 'update_all', calling method: .version_select at 0x7f7d448ee820>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:52:26.408025 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-7c72db9e-2df6-4373-8c67-7f8c50e1be21 tempest-ImagesMetadataTestJSON-553932472 tempest-ImagesMetadataTestJSON-553932472-project] Getting quotas for project 28844478ec7740b7b959775b5c0fea77. Resources: dict_keys(['metadata_items']) {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 08:52:26.415568 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-7c72db9e-2df6-4373-8c67-7f8c50e1be21 tempest-ImagesMetadataTestJSON-553932472 tempest-ImagesMetadataTestJSON-553932472-project] Getting quotas for user c59c81e3be6342b2a446ea246fc8c53d and project 28844478ec7740b7b959775b5c0fea77. Resources: dict_keys(['metadata_items']) {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 08:52:26.778559 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-7c72db9e-2df6-4373-8c67-7f8c50e1be21 tempest-ImagesMetadataTestJSON-553932472 tempest-ImagesMetadataTestJSON-553932472-project] 10.222.0.60 "PUT /compute/v2.1/images/360ec463-8154-4d82-b551-86eca9db5e18/metadata" status: 200 len: 61 microversion: 2.1 time: 0.438900 Sep 14 08:52:26.779210 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 488/990] 10.222.0.60 () {60 vars in 1280 bytes} [Wed Sep 14 08:52:26 2022] PUT /compute/v2.1/images/360ec463-8154-4d82-b551-86eca9db5e18/metadata => generated 61 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 08:52:26.789733 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ac8b79b3-2a8a-4dc8-9b1d-fda60937c104 tempest-ImagesMetadataTestJSON-553932472 tempest-ImagesMetadataTestJSON-553932472-project] Calling method '.version_select at 0x7f7d44604430>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:26.849248 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-ac8b79b3-2a8a-4dc8-9b1d-fda60937c104 tempest-ImagesMetadataTestJSON-553932472 tempest-ImagesMetadataTestJSON-553932472-project] 10.222.0.60 "GET /compute/v2.1/images/360ec463-8154-4d82-b551-86eca9db5e18/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.064455 Sep 14 08:52:26.851010 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 489/991] 10.222.0.60 () {58 vars in 1290 bytes} [Wed Sep 14 08:52:26 2022] GET /compute/v2.1/images/360ec463-8154-4d82-b551-86eca9db5e18/metadata/os_distro => generated 33 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 08:52:26.864437 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-4ced3bd4-0d93-4852-9718-6cd2d5407df2 tempest-ImagesMetadataTestJSON-553932472 tempest-ImagesMetadataTestJSON-553932472-project] Action: 'update_all', calling method: .version_select at 0x7f7d44628940>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:52:26.922003 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-4ced3bd4-0d93-4852-9718-6cd2d5407df2 tempest-ImagesMetadataTestJSON-553932472 tempest-ImagesMetadataTestJSON-553932472-project] Getting quotas for project 28844478ec7740b7b959775b5c0fea77. Resources: dict_keys(['metadata_items']) {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 08:52:26.927250 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-4ced3bd4-0d93-4852-9718-6cd2d5407df2 tempest-ImagesMetadataTestJSON-553932472 tempest-ImagesMetadataTestJSON-553932472-project] Getting quotas for user c59c81e3be6342b2a446ea246fc8c53d and project 28844478ec7740b7b959775b5c0fea77. Resources: dict_keys(['metadata_items']) {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 08:52:27.007422 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-20b55ec8-a128-477f-833b-87d36725b6c6 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c7802984cf48d1852832b52abe52e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e326f95a9604fdb9bd075db3837cf62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:27.021223 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-20b55ec8-a128-477f-833b-87d36725b6c6 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] 10.222.0.60 "GET /compute/v2.1/servers/3067be21-37ff-4a8f-8ca9-b1421e8be78f" status: 200 len: 1472 microversion: 2.1 time: 0.711014 Sep 14 08:52:27.034965 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 503/992] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:26 2022] GET /compute/v2.1/servers/3067be21-37ff-4a8f-8ca9-b1421e8be78f => generated 1472 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:52:27.036468 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9fd3f499-e972-4a72-ad64-7c608c231889 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:27.037913 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-9fd3f499-e972-4a72-ad64-7c608c231889 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: af183467-9304-4c73-a29f-196e76ba21b5] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:27.047531 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9fd3f499-e972-4a72-ad64-7c608c231889 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:27.048035 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9fd3f499-e972-4a72-ad64-7c608c231889 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:27.048576 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9fd3f499-e972-4a72-ad64-7c608c231889 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:27.049378 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9fd3f499-e972-4a72-ad64-7c608c231889 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:27.050991 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9fd3f499-e972-4a72-ad64-7c608c231889 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:27.053502 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9fd3f499-e972-4a72-ad64-7c608c231889 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:27.167183 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-4ced3bd4-0d93-4852-9718-6cd2d5407df2 tempest-ImagesMetadataTestJSON-553932472 tempest-ImagesMetadataTestJSON-553932472-project] 10.222.0.60 "PUT /compute/v2.1/images/360ec463-8154-4d82-b551-86eca9db5e18/metadata" status: 200 len: 61 microversion: 2.1 time: 0.308248 Sep 14 08:52:27.168278 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 490/993] 10.222.0.60 () {60 vars in 1280 bytes} [Wed Sep 14 08:52:26 2022] PUT /compute/v2.1/images/360ec463-8154-4d82-b551-86eca9db5e18/metadata => generated 61 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 08:52:27.174708 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-17b6303b-b1f7-487f-9939-806c37d70148 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:27.176100 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-17b6303b-b1f7-487f-9939-806c37d70148 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: 2098e0b9-b628-4b9e-979b-960c68830fee] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:27.188056 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-17b6303b-b1f7-487f-9939-806c37d70148 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:27.189558 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-17b6303b-b1f7-487f-9939-806c37d70148 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:27.190084 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-17b6303b-b1f7-487f-9939-806c37d70148 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:27.191036 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-17b6303b-b1f7-487f-9939-806c37d70148 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:27.191697 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-17b6303b-b1f7-487f-9939-806c37d70148 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:27.192907 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-17b6303b-b1f7-487f-9939-806c37d70148 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:27.332685 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-17b6303b-b1f7-487f-9939-806c37d70148 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:27.348367 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-17b6303b-b1f7-487f-9939-806c37d70148 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/2098e0b9-b628-4b9e-979b-960c68830fee" status: 200 len: 1292 microversion: 2.1 time: 0.178870 Sep 14 08:52:27.349270 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 491/994] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:27 2022] GET /compute/v2.1/servers/2098e0b9-b628-4b9e-979b-960c68830fee => generated 1292 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:52:27.372569 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-3c9e7c64-ef47-4acc-8070-b44fe7e0e495 tempest-ImagesMetadataTestJSON-553932472 tempest-ImagesMetadataTestJSON-553932472-project] Calling method '.version_select at 0x7f7d445aa8b0>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:27.423905 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-3c9e7c64-ef47-4acc-8070-b44fe7e0e495 tempest-ImagesMetadataTestJSON-553932472 tempest-ImagesMetadataTestJSON-553932472-project] 10.222.0.60 "GET /compute/v2.1/images/360ec463-8154-4d82-b551-86eca9db5e18/metadata" status: 200 len: 61 microversion: 2.1 time: 0.059070 Sep 14 08:52:27.425530 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 492/995] 10.222.0.60 () {58 vars in 1260 bytes} [Wed Sep 14 08:52:27 2022] GET /compute/v2.1/images/360ec463-8154-4d82-b551-86eca9db5e18/metadata => generated 61 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 08:52:27.436719 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c05fe802-8c70-4824-8065-1a80ca8c8b98 tempest-ImagesMetadataTestJSON-553932472 tempest-ImagesMetadataTestJSON-553932472-project] Action: 'update_all', calling method: .version_select at 0x7f7d445aa0d0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:52:27.486388 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-9fd3f499-e972-4a72-ad64-7c608c231889 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:27.501985 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-9fd3f499-e972-4a72-ad64-7c608c231889 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/af183467-9304-4c73-a29f-196e76ba21b5" status: 200 len: 1541 microversion: 2.1 time: 0.478752 Sep 14 08:52:27.503397 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 504/996] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:27 2022] GET /compute/v2.1/servers/af183467-9304-4c73-a29f-196e76ba21b5 => generated 1541 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:52:27.519451 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-c05fe802-8c70-4824-8065-1a80ca8c8b98 tempest-ImagesMetadataTestJSON-553932472 tempest-ImagesMetadataTestJSON-553932472-project] Getting quotas for project 28844478ec7740b7b959775b5c0fea77. Resources: dict_keys(['metadata_items']) {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 08:52:27.529486 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-c05fe802-8c70-4824-8065-1a80ca8c8b98 tempest-ImagesMetadataTestJSON-553932472 tempest-ImagesMetadataTestJSON-553932472-project] Getting quotas for user c59c81e3be6342b2a446ea246fc8c53d and project 28844478ec7740b7b959775b5c0fea77. Resources: dict_keys(['metadata_items']) {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 08:52:27.532454 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:52:27.768883 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-7a9678ce-b90b-4bfb-8b2b-43d4e44d7f6e req-2e95c601-db1c-48c8-a941-fe20d5c33e94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8fce8438-d6ae-408d-8b4f-ee14d4021fdd", "tag": "8a7f2660-c507-4973-b860-0358d6cdd4f1"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:52:27.790396 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-7a9678ce-b90b-4bfb-8b2b-43d4e44d7f6e req-2e95c601-db1c-48c8-a941-fe20d5c33e94 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:27.791670 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-7a9678ce-b90b-4bfb-8b2b-43d4e44d7f6e req-2e95c601-db1c-48c8-a941-fe20d5c33e94 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:27.799234 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-7a9678ce-b90b-4bfb-8b2b-43d4e44d7f6e req-2e95c601-db1c-48c8-a941-fe20d5c33e94 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:27.813375 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-7a9678ce-b90b-4bfb-8b2b-43d4e44d7f6e req-2e95c601-db1c-48c8-a941-fe20d5c33e94 service nova] Creating event network-changed:8a7f2660-c507-4973-b860-0358d6cdd4f1 for instance 8fce8438-d6ae-408d-8b4f-ee14d4021fdd on n-h2-836830-18 Sep 14 08:52:27.820644 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-7a9678ce-b90b-4bfb-8b2b-43d4e44d7f6e req-2e95c601-db1c-48c8-a941-fe20d5c33e94 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058112 Sep 14 08:52:27.822764 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 505/997] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:52:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:52:27.830074 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-c05fe802-8c70-4824-8065-1a80ca8c8b98 tempest-ImagesMetadataTestJSON-553932472 tempest-ImagesMetadataTestJSON-553932472-project] 10.222.0.60 "PUT /compute/v2.1/images/360ec463-8154-4d82-b551-86eca9db5e18/metadata" status: 200 len: 61 microversion: 2.1 time: 0.397605 Sep 14 08:52:27.830676 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 493/998] 10.222.0.60 () {60 vars in 1280 bytes} [Wed Sep 14 08:52:27 2022] PUT /compute/v2.1/images/360ec463-8154-4d82-b551-86eca9db5e18/metadata => generated 61 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 08:52:27.841569 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-990def9b-4216-4285-86d0-775c13528732 tempest-ImagesMetadataTestJSON-553932472 tempest-ImagesMetadataTestJSON-553932472-project] Action: 'update_all', calling method: .version_select at 0x7f7d4456aa60>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:52:27.924055 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-990def9b-4216-4285-86d0-775c13528732 tempest-ImagesMetadataTestJSON-553932472 tempest-ImagesMetadataTestJSON-553932472-project] Getting quotas for project 28844478ec7740b7b959775b5c0fea77. Resources: dict_keys(['metadata_items']) {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 08:52:27.936869 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-990def9b-4216-4285-86d0-775c13528732 tempest-ImagesMetadataTestJSON-553932472 tempest-ImagesMetadataTestJSON-553932472-project] Getting quotas for user c59c81e3be6342b2a446ea246fc8c53d and project 28844478ec7740b7b959775b5c0fea77. Resources: dict_keys(['metadata_items']) {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 08:52:28.048916 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-712887c6-8eb2-4210-bd51-b317a12b146a tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:28.049563 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-712887c6-8eb2-4210-bd51-b317a12b146a tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] [instance: 3067be21-37ff-4a8f-8ca9-b1421e8be78f] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:28.060733 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-712887c6-8eb2-4210-bd51-b317a12b146a tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:28.061391 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-712887c6-8eb2-4210-bd51-b317a12b146a tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:28.061666 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-712887c6-8eb2-4210-bd51-b317a12b146a tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:28.062394 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-712887c6-8eb2-4210-bd51-b317a12b146a tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:28.062858 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-712887c6-8eb2-4210-bd51-b317a12b146a tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:28.071275 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-712887c6-8eb2-4210-bd51-b317a12b146a tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:28.444550 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-712887c6-8eb2-4210-bd51-b317a12b146a tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c7802984cf48d1852832b52abe52e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e326f95a9604fdb9bd075db3837cf62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:28.452494 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-712887c6-8eb2-4210-bd51-b317a12b146a tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] 10.222.0.60 "GET /compute/v2.1/servers/3067be21-37ff-4a8f-8ca9-b1421e8be78f" status: 200 len: 1472 microversion: 2.1 time: 0.412155 Sep 14 08:52:28.457099 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 494/999] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:28 2022] GET /compute/v2.1/servers/3067be21-37ff-4a8f-8ca9-b1421e8be78f => generated 1472 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:52:28.476074 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-19a24be2-31bc-4c4e-8b93-14dee836b86a tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:28.476984 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-19a24be2-31bc-4c4e-8b93-14dee836b86a tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: 2098e0b9-b628-4b9e-979b-960c68830fee] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:28.487873 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-19a24be2-31bc-4c4e-8b93-14dee836b86a tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:28.493031 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-19a24be2-31bc-4c4e-8b93-14dee836b86a tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:28.495989 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-19a24be2-31bc-4c4e-8b93-14dee836b86a tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:28.497013 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-19a24be2-31bc-4c4e-8b93-14dee836b86a tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:28.498896 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-19a24be2-31bc-4c4e-8b93-14dee836b86a tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:28.501850 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-19a24be2-31bc-4c4e-8b93-14dee836b86a tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:28.588026 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-990def9b-4216-4285-86d0-775c13528732 tempest-ImagesMetadataTestJSON-553932472 tempest-ImagesMetadataTestJSON-553932472-project] 10.222.0.60 "PUT /compute/v2.1/images/360ec463-8154-4d82-b551-86eca9db5e18/metadata" status: 200 len: 64 microversion: 2.1 time: 0.750750 Sep 14 08:52:28.589406 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 506/1000] 10.222.0.60 () {60 vars in 1280 bytes} [Wed Sep 14 08:52:27 2022] PUT /compute/v2.1/images/360ec463-8154-4d82-b551-86eca9db5e18/metadata => generated 64 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 14 08:52:28.595357 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-697f0060-e7f9-476e-ab00-046fb26e2a43 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:28.596182 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-697f0060-e7f9-476e-ab00-046fb26e2a43 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: af183467-9304-4c73-a29f-196e76ba21b5] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:28.612972 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-697f0060-e7f9-476e-ab00-046fb26e2a43 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:28.613566 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-697f0060-e7f9-476e-ab00-046fb26e2a43 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:28.614077 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-697f0060-e7f9-476e-ab00-046fb26e2a43 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:28.614850 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-697f0060-e7f9-476e-ab00-046fb26e2a43 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:28.616338 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-697f0060-e7f9-476e-ab00-046fb26e2a43 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:28.616813 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-697f0060-e7f9-476e-ab00-046fb26e2a43 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:28.866301 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-19a24be2-31bc-4c4e-8b93-14dee836b86a tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:28.879366 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-19a24be2-31bc-4c4e-8b93-14dee836b86a tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/2098e0b9-b628-4b9e-979b-960c68830fee" status: 200 len: 1359 microversion: 2.1 time: 0.420807 Sep 14 08:52:28.883375 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 495/1001] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:28 2022] GET /compute/v2.1/servers/2098e0b9-b628-4b9e-979b-960c68830fee => generated 1359 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:52:28.890209 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ba5a9320-1735-4ad6-8dd3-d017cf239a96 tempest-ImagesMetadataTestJSON-553932472 tempest-ImagesMetadataTestJSON-553932472-project] Calling method '.version_select at 0x7f7d44604a60>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:28.920343 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-697f0060-e7f9-476e-ab00-046fb26e2a43 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:28.932921 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-697f0060-e7f9-476e-ab00-046fb26e2a43 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/af183467-9304-4c73-a29f-196e76ba21b5" status: 200 len: 1541 microversion: 2.1 time: 0.340770 Sep 14 08:52:28.935917 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 507/1002] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:28 2022] GET /compute/v2.1/servers/af183467-9304-4c73-a29f-196e76ba21b5 => generated 1541 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:52:28.971769 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-ba5a9320-1735-4ad6-8dd3-d017cf239a96 tempest-ImagesMetadataTestJSON-553932472 tempest-ImagesMetadataTestJSON-553932472-project] 10.222.0.60 "GET /compute/v2.1/images/360ec463-8154-4d82-b551-86eca9db5e18/metadata" status: 200 len: 64 microversion: 2.1 time: 0.085925 Sep 14 08:52:28.972857 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 496/1003] 10.222.0.60 () {58 vars in 1260 bytes} [Wed Sep 14 08:52:28 2022] GET /compute/v2.1/images/360ec463-8154-4d82-b551-86eca9db5e18/metadata => generated 64 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 08:52:28.984694 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-700cdcdb-ba78-4326-8105-3d3467e74f11 tempest-ImagesMetadataTestJSON-553932472 tempest-ImagesMetadataTestJSON-553932472-project] Action: 'update_all', calling method: .version_select at 0x7f7d442eb820>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:52:29.040715 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-700cdcdb-ba78-4326-8105-3d3467e74f11 tempest-ImagesMetadataTestJSON-553932472 tempest-ImagesMetadataTestJSON-553932472-project] Getting quotas for project 28844478ec7740b7b959775b5c0fea77. Resources: dict_keys(['metadata_items']) {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 08:52:29.048150 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-700cdcdb-ba78-4326-8105-3d3467e74f11 tempest-ImagesMetadataTestJSON-553932472 tempest-ImagesMetadataTestJSON-553932472-project] Getting quotas for user c59c81e3be6342b2a446ea246fc8c53d and project 28844478ec7740b7b959775b5c0fea77. Resources: dict_keys(['metadata_items']) {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 08:52:29.573364 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-f854ac77-d2c9-49bb-83df-862fb0e099d1 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:29.576253 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-f854ac77-d2c9-49bb-83df-862fb0e099d1 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] [instance: 3067be21-37ff-4a8f-8ca9-b1421e8be78f] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:29.598000 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f854ac77-d2c9-49bb-83df-862fb0e099d1 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:29.602815 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f854ac77-d2c9-49bb-83df-862fb0e099d1 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:29.607185 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f854ac77-d2c9-49bb-83df-862fb0e099d1 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:29.608012 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f854ac77-d2c9-49bb-83df-862fb0e099d1 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:29.608497 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f854ac77-d2c9-49bb-83df-862fb0e099d1 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:29.608931 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f854ac77-d2c9-49bb-83df-862fb0e099d1 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:29.794530 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f854ac77-d2c9-49bb-83df-862fb0e099d1 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:29.795070 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f854ac77-d2c9-49bb-83df-862fb0e099d1 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:29.797140 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f854ac77-d2c9-49bb-83df-862fb0e099d1 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:29.801977 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.objects.instance [None req-f854ac77-d2c9-49bb-83df-862fb0e099d1 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lazy-loading 'fault' on Instance uuid 3067be21-37ff-4a8f-8ca9-b1421e8be78f {{(pid=128758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 08:52:29.814358 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-700cdcdb-ba78-4326-8105-3d3467e74f11 tempest-ImagesMetadataTestJSON-553932472 tempest-ImagesMetadataTestJSON-553932472-project] 10.222.0.60 "PUT /compute/v2.1/images/360ec463-8154-4d82-b551-86eca9db5e18/metadata" status: 200 len: 61 microversion: 2.1 time: 0.833373 Sep 14 08:52:29.823390 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 508/1004] 10.222.0.60 () {60 vars in 1280 bytes} [Wed Sep 14 08:52:28 2022] PUT /compute/v2.1/images/360ec463-8154-4d82-b551-86eca9db5e18/metadata => generated 61 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 08:52:29.830265 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-cc907686-2183-4716-a3dc-8354caf3d64d tempest-ImagesMetadataTestJSON-553932472 tempest-ImagesMetadataTestJSON-553932472-project] Action: 'update', calling method: .version_select at 0x7f7d445cfd30>, body: {"meta": {"os_version": "alt"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:52:29.914921 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-cc907686-2183-4716-a3dc-8354caf3d64d tempest-ImagesMetadataTestJSON-553932472 tempest-ImagesMetadataTestJSON-553932472-project] Getting quotas for project 28844478ec7740b7b959775b5c0fea77. Resources: dict_keys(['metadata_items']) {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 08:52:29.930412 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-cc907686-2183-4716-a3dc-8354caf3d64d tempest-ImagesMetadataTestJSON-553932472 tempest-ImagesMetadataTestJSON-553932472-project] Getting quotas for user c59c81e3be6342b2a446ea246fc8c53d and project 28844478ec7740b7b959775b5c0fea77. Resources: dict_keys(['metadata_items']) {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 08:52:30.100955 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-f854ac77-d2c9-49bb-83df-862fb0e099d1 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c7802984cf48d1852832b52abe52e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e326f95a9604fdb9bd075db3837cf62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:30.114688 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-f854ac77-d2c9-49bb-83df-862fb0e099d1 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] 10.222.0.60 "GET /compute/v2.1/servers/3067be21-37ff-4a8f-8ca9-b1421e8be78f" status: 200 len: 1307 microversion: 2.1 time: 0.550570 Sep 14 08:52:30.145487 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 497/1005] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:29 2022] GET /compute/v2.1/servers/3067be21-37ff-4a8f-8ca9-b1421e8be78f => generated 1307 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:52:30.160893 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-9d50f467-ea5f-4642-b2ed-68ad0da5fa95 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:30.164185 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-9d50f467-ea5f-4642-b2ed-68ad0da5fa95 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: 2098e0b9-b628-4b9e-979b-960c68830fee] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:30.186253 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9d50f467-ea5f-4642-b2ed-68ad0da5fa95 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:30.187505 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9d50f467-ea5f-4642-b2ed-68ad0da5fa95 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:30.191512 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9d50f467-ea5f-4642-b2ed-68ad0da5fa95 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:30.192675 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9d50f467-ea5f-4642-b2ed-68ad0da5fa95 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:30.206607 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9d50f467-ea5f-4642-b2ed-68ad0da5fa95 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:30.208479 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9d50f467-ea5f-4642-b2ed-68ad0da5fa95 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:30.523706 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-cc907686-2183-4716-a3dc-8354caf3d64d tempest-ImagesMetadataTestJSON-553932472 tempest-ImagesMetadataTestJSON-553932472-project] 10.222.0.60 "PUT /compute/v2.1/images/360ec463-8154-4d82-b551-86eca9db5e18/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.698616 Sep 14 08:52:30.529860 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 509/1006] 10.222.0.60 () {60 vars in 1313 bytes} [Wed Sep 14 08:52:29 2022] PUT /compute/v2.1/images/360ec463-8154-4d82-b551-86eca9db5e18/metadata/os_version => generated 31 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 08:52:30.539960 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-fb5aeabd-8b9a-451e-af19-130bbbceeb2e req-e71aae37-5d0c-4106-bc60-bb99c7e8b140 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3067be21-37ff-4a8f-8ca9-b1421e8be78f", "name": "network-vif-deleted", "tag": "44871f2d-de05-4001-8dcf-b562431aacba"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:52:30.551842 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:52:30.576681 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-fb5aeabd-8b9a-451e-af19-130bbbceeb2e req-e71aae37-5d0c-4106-bc60-bb99c7e8b140 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:30.578251 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-fb5aeabd-8b9a-451e-af19-130bbbceeb2e req-e71aae37-5d0c-4106-bc60-bb99c7e8b140 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:30.578863 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-fb5aeabd-8b9a-451e-af19-130bbbceeb2e req-e71aae37-5d0c-4106-bc60-bb99c7e8b140 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:30.616938 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-fb5aeabd-8b9a-451e-af19-130bbbceeb2e req-e71aae37-5d0c-4106-bc60-bb99c7e8b140 service nova] Creating event network-vif-deleted:44871f2d-de05-4001-8dcf-b562431aacba for instance 3067be21-37ff-4a8f-8ca9-b1421e8be78f on n-h2-836830-18 Sep 14 08:52:30.633590 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-fb5aeabd-8b9a-451e-af19-130bbbceeb2e req-e71aae37-5d0c-4106-bc60-bb99c7e8b140 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099669 Sep 14 08:52:30.635758 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 510/1007] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:52:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:52:30.653140 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d78d3687-a789-400b-a67d-b1f22dd6cbf8 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:30.653911 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-d78d3687-a789-400b-a67d-b1f22dd6cbf8 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: af183467-9304-4c73-a29f-196e76ba21b5] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:30.668868 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d78d3687-a789-400b-a67d-b1f22dd6cbf8 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:30.669955 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d78d3687-a789-400b-a67d-b1f22dd6cbf8 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:30.671749 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d78d3687-a789-400b-a67d-b1f22dd6cbf8 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:30.673588 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d78d3687-a789-400b-a67d-b1f22dd6cbf8 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:30.675725 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d78d3687-a789-400b-a67d-b1f22dd6cbf8 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:30.676659 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d78d3687-a789-400b-a67d-b1f22dd6cbf8 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:30.717621 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:52:31.157572 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-9d50f467-ea5f-4642-b2ed-68ad0da5fa95 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:31.169615 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-9d50f467-ea5f-4642-b2ed-68ad0da5fa95 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/2098e0b9-b628-4b9e-979b-960c68830fee" status: 200 len: 1359 microversion: 2.1 time: 1.020244 Sep 14 08:52:31.174858 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 498/1008] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:30 2022] GET /compute/v2.1/servers/2098e0b9-b628-4b9e-979b-960c68830fee => generated 1359 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:52:31.190525 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-3c0eb27f-a88d-4ba9-9cab-c0499042c4b3 tempest-ImagesMetadataTestJSON-553932472 tempest-ImagesMetadataTestJSON-553932472-project] Calling method '.version_select at 0x7f7d445aa9d0>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:31.230148 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-d78d3687-a789-400b-a67d-b1f22dd6cbf8 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:31.240789 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d78d3687-a789-400b-a67d-b1f22dd6cbf8 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/af183467-9304-4c73-a29f-196e76ba21b5" status: 200 len: 1540 microversion: 2.1 time: 0.600693 Sep 14 08:52:31.247163 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 511/1009] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:30 2022] GET /compute/v2.1/servers/af183467-9304-4c73-a29f-196e76ba21b5 => generated 1540 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:52:31.265046 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-3c0eb27f-a88d-4ba9-9cab-c0499042c4b3 tempest-ImagesMetadataTestJSON-553932472 tempest-ImagesMetadataTestJSON-553932472-project] 10.222.0.60 "GET /compute/v2.1/images/360ec463-8154-4d82-b551-86eca9db5e18/metadata" status: 200 len: 58 microversion: 2.1 time: 0.086483 Sep 14 08:52:31.265738 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 499/1010] 10.222.0.60 () {58 vars in 1260 bytes} [Wed Sep 14 08:52:31 2022] GET /compute/v2.1/images/360ec463-8154-4d82-b551-86eca9db5e18/metadata => generated 58 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 08:52:31.274869 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a08c491a-85ae-4da7-932a-a198132e960f tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:31.275683 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-a08c491a-85ae-4da7-932a-a198132e960f tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] [instance: 3067be21-37ff-4a8f-8ca9-b1421e8be78f] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:31.282671 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a08c491a-85ae-4da7-932a-a198132e960f tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:31.283021 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-225c47dc-1eb6-40ae-9e01-287456f80573 tempest-ImagesMetadataTestJSON-553932472 tempest-ImagesMetadataTestJSON-553932472-project] Action: 'update_all', calling method: .version_select at 0x7f7d445aa040>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:52:31.285293 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a08c491a-85ae-4da7-932a-a198132e960f tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:31.286265 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a08c491a-85ae-4da7-932a-a198132e960f tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:31.287529 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a08c491a-85ae-4da7-932a-a198132e960f tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:31.288228 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a08c491a-85ae-4da7-932a-a198132e960f tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:31.288879 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a08c491a-85ae-4da7-932a-a198132e960f tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:31.317076 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-a08c491a-85ae-4da7-932a-a198132e960f tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] HTTP exception thrown: Instance 3067be21-37ff-4a8f-8ca9-b1421e8be78f could not be found. Sep 14 08:52:31.321451 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a08c491a-85ae-4da7-932a-a198132e960f tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Request method failure captured: Sep 14 08:52:31.321451 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/3067be21-37ff-4a8f-8ca9-b1421e8be78f HTTP/1.1 Sep 14 08:52:31.321451 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 08:52:31.321451 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 08:52:31.321451 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 08:52:31.321451 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 08:52:31.321451 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 08:52:31.321451 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 08:52:31.321451 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 08:52:31.321451 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 08:52:31.321451 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZWCl-PBW4XwTIAlm_HDzFNUEwKCR-QX8kRMQlkDQ28-th7Hv5Ami7B5CdfKebuOcYBY8pBDcErYnw6Yoo-AEMZOR30AfoQXWHysSwGGQuX7FJimJhZb77LDAXJX1PJ_CPAwODcQceVHue0gK59ez0nQzHL0ZkFBiu-KQzoh7YQB5n0 Sep 14 08:52:31.321451 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 08:52:31.321451 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 08:52:31.321451 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 08:52:31.321451 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 08:52:31.321451 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 08:52:31.321451 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 08:52:31.321451 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 5e326f95a9604fdb9bd075db3837cf62 Sep 14 08:52:31.321451 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ServersOnMultiNodesTest-1258517383 Sep 14 08:52:31.321451 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 08:52:31.321451 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 08:52:31.322813 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/5e326f95a9604fdb9bd075db3837cf62"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_5e326f95a9604fdb9bd075db3837cf62"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5e326f95a9604fdb9bd075db3837cf62"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5e326f95a9604fdb9bd075db3837cf62"}]}] Sep 14 08:52:31.322813 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ServersOnMultiNodesTest-1258517383 Sep 14 08:52:31.322813 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 5e326f95a9604fdb9bd075db3837cf62 Sep 14 08:52:31.322813 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1258517383 Sep 14 08:52:31.322813 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ServersOnMultiNodesTest-1258517383-project Sep 14 08:52:31.322813 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 08:52:31.322813 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 08:52:31.322813 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 89c7802984cf48d1852832b52abe52e9 Sep 14 08:52:31.322813 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ServersOnMultiNodesTest-1258517383-project Sep 14 08:52:31.322813 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 08:52:31.322813 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance 3067be21-37ff-4a8f-8ca9-b1421e8be78f could not be found. Sep 14 08:52:31.322813 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '3067be21-37ff-4a8f-8ca9-b1421e8be78f'} Sep 14 08:52:31.323653 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:52:31.323653 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:52:31.323653 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 08:52:31.323653 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 08:52:31.323653 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 08:52:31.323653 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 08:52:31.323653 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 08:52:31.323653 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 08:52:31.323653 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 08:52:31.323653 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 08:52:31.323653 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3067be21-37ff-4a8f-8ca9-b1421e8be78f could not be found. Sep 14 08:52:31.323653 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:52:31.323653 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:52:31.323653 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:52:31.323653 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:52:31.323653 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:52:31.323653 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:52:31.323653 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:52:31.323653 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:52:31.323653 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:52:31.324899 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:52:31.324899 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 08:52:31.324899 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 08:52:31.324899 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 08:52:31.324899 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 08:52:31.324899 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 08:52:31.324899 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 08:52:31.324899 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3067be21-37ff-4a8f-8ca9-b1421e8be78f could not be found. Sep 14 08:52:31.324899 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:52:31.324899 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:52:31.324899 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:52:31.324899 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:52:31.324899 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:52:31.324899 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:52:31.324899 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:52:31.324899 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:52:31.324899 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3067be21-37ff-4a8f-8ca9-b1421e8be78f could not be found. Sep 14 08:52:31.324899 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:52:31.327872 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a08c491a-85ae-4da7-932a-a198132e960f tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Returning 404 to user: Instance 3067be21-37ff-4a8f-8ca9-b1421e8be78f could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:52:31.330353 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a08c491a-85ae-4da7-932a-a198132e960f tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] 10.222.0.60 "GET /compute/v2.1/servers/3067be21-37ff-4a8f-8ca9-b1421e8be78f" status: 404 len: 111 microversion: 2.1 time: 0.071860 Sep 14 08:52:31.333417 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 512/1011] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:31 2022] GET /compute/v2.1/servers/3067be21-37ff-4a8f-8ca9-b1421e8be78f => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 08:52:31.347465 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-7b0a4088-d1fe-4dcb-9a4a-27c94efad950 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:31.350631 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-7b0a4088-d1fe-4dcb-9a4a-27c94efad950 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] [instance: 42265ff9-9c1f-45b6-b92d-0b23de43a8d0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:31.361880 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7b0a4088-d1fe-4dcb-9a4a-27c94efad950 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:31.362728 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7b0a4088-d1fe-4dcb-9a4a-27c94efad950 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:31.363447 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7b0a4088-d1fe-4dcb-9a4a-27c94efad950 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:31.364428 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7b0a4088-d1fe-4dcb-9a4a-27c94efad950 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:31.365720 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7b0a4088-d1fe-4dcb-9a4a-27c94efad950 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:31.366434 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7b0a4088-d1fe-4dcb-9a4a-27c94efad950 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:31.375434 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-225c47dc-1eb6-40ae-9e01-287456f80573 tempest-ImagesMetadataTestJSON-553932472 tempest-ImagesMetadataTestJSON-553932472-project] Getting quotas for project 28844478ec7740b7b959775b5c0fea77. Resources: dict_keys(['metadata_items']) {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 08:52:31.402605 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-225c47dc-1eb6-40ae-9e01-287456f80573 tempest-ImagesMetadataTestJSON-553932472 tempest-ImagesMetadataTestJSON-553932472-project] Getting quotas for user c59c81e3be6342b2a446ea246fc8c53d and project 28844478ec7740b7b959775b5c0fea77. Resources: dict_keys(['metadata_items']) {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 08:52:31.421877 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-7b0a4088-d1fe-4dcb-9a4a-27c94efad950 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] [instance: 42265ff9-9c1f-45b6-b92d-0b23de43a8d0] Going to try to terminate instance {{(pid=128759) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 08:52:31.660366 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-7b0a4088-d1fe-4dcb-9a4a-27c94efad950 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] 10.222.0.60 "DELETE /compute/v2.1/servers/42265ff9-9c1f-45b6-b92d-0b23de43a8d0" status: 204 len: 0 microversion: 2.1 time: 0.317547 Sep 14 08:52:31.666360 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 513/1012] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 08:52:31 2022] DELETE /compute/v2.1/servers/42265ff9-9c1f-45b6-b92d-0b23de43a8d0 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 08:52:31.685158 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8b2e98bd-9c3f-4013-abfe-8422c6726225 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:31.686008 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-8b2e98bd-9c3f-4013-abfe-8422c6726225 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] [instance: 3f9e2d1a-9899-4046-b2af-939db32442b7] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:31.702845 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8b2e98bd-9c3f-4013-abfe-8422c6726225 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:31.706604 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8b2e98bd-9c3f-4013-abfe-8422c6726225 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:31.708207 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8b2e98bd-9c3f-4013-abfe-8422c6726225 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:31.726617 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8b2e98bd-9c3f-4013-abfe-8422c6726225 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:31.731860 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8b2e98bd-9c3f-4013-abfe-8422c6726225 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:31.733369 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8b2e98bd-9c3f-4013-abfe-8422c6726225 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:31.804018 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-8b2e98bd-9c3f-4013-abfe-8422c6726225 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] [instance: 3f9e2d1a-9899-4046-b2af-939db32442b7] Going to try to terminate instance {{(pid=128759) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 08:52:31.980898 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-225c47dc-1eb6-40ae-9e01-287456f80573 tempest-ImagesMetadataTestJSON-553932472 tempest-ImagesMetadataTestJSON-553932472-project] 10.222.0.60 "PUT /compute/v2.1/images/360ec463-8154-4d82-b551-86eca9db5e18/metadata" status: 200 len: 61 microversion: 2.1 time: 0.705701 Sep 14 08:52:31.982623 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 500/1013] 10.222.0.60 () {60 vars in 1280 bytes} [Wed Sep 14 08:52:31 2022] PUT /compute/v2.1/images/360ec463-8154-4d82-b551-86eca9db5e18/metadata => generated 61 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 08:52:31.993486 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-73fe9b6a-bea2-44af-b43c-34dba5970793 tempest-ImagesMetadataTestJSON-553932472 tempest-ImagesMetadataTestJSON-553932472-project] Action: 'create', calling method: .version_select at 0x7f7d445c9550>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:52:32.005132 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-8b2e98bd-9c3f-4013-abfe-8422c6726225 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] 10.222.0.60 "DELETE /compute/v2.1/servers/3f9e2d1a-9899-4046-b2af-939db32442b7" status: 204 len: 0 microversion: 2.1 time: 0.334752 Sep 14 08:52:32.006095 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 514/1014] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 08:52:31 2022] DELETE /compute/v2.1/servers/3f9e2d1a-9899-4046-b2af-939db32442b7 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 08:52:32.028717 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c02195c4-d67f-4cff-b356-400e2f221859 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:32.030986 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-c02195c4-d67f-4cff-b356-400e2f221859 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] [instance: 42265ff9-9c1f-45b6-b92d-0b23de43a8d0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:32.045556 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c02195c4-d67f-4cff-b356-400e2f221859 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:32.046194 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c02195c4-d67f-4cff-b356-400e2f221859 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:32.051058 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c02195c4-d67f-4cff-b356-400e2f221859 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:32.056839 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c02195c4-d67f-4cff-b356-400e2f221859 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:32.057442 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c02195c4-d67f-4cff-b356-400e2f221859 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:32.057961 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c02195c4-d67f-4cff-b356-400e2f221859 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:32.068349 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-73fe9b6a-bea2-44af-b43c-34dba5970793 tempest-ImagesMetadataTestJSON-553932472 tempest-ImagesMetadataTestJSON-553932472-project] Getting quotas for project 28844478ec7740b7b959775b5c0fea77. Resources: dict_keys(['metadata_items']) {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 08:52:32.074832 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-73fe9b6a-bea2-44af-b43c-34dba5970793 tempest-ImagesMetadataTestJSON-553932472 tempest-ImagesMetadataTestJSON-553932472-project] Getting quotas for user c59c81e3be6342b2a446ea246fc8c53d and project 28844478ec7740b7b959775b5c0fea77. Resources: dict_keys(['metadata_items']) {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 08:52:32.254546 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-c02195c4-d67f-4cff-b356-400e2f221859 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c7802984cf48d1852832b52abe52e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e326f95a9604fdb9bd075db3837cf62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:32.264367 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-c02195c4-d67f-4cff-b356-400e2f221859 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] 10.222.0.60 "GET /compute/v2.1/servers/42265ff9-9c1f-45b6-b92d-0b23de43a8d0" status: 200 len: 1473 microversion: 2.1 time: 0.254065 Sep 14 08:52:32.266029 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 515/1015] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:32 2022] GET /compute/v2.1/servers/42265ff9-9c1f-45b6-b92d-0b23de43a8d0 => generated 1473 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:52:32.284769 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ff0f80d0-c426-4e0b-b5b4-c6025515d61f tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:32.286247 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-ff0f80d0-c426-4e0b-b5b4-c6025515d61f tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: 2098e0b9-b628-4b9e-979b-960c68830fee] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:32.298968 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ff0f80d0-c426-4e0b-b5b4-c6025515d61f tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:32.299389 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ff0f80d0-c426-4e0b-b5b4-c6025515d61f tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:32.301542 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ff0f80d0-c426-4e0b-b5b4-c6025515d61f tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:32.302997 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ff0f80d0-c426-4e0b-b5b4-c6025515d61f tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:32.303523 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ff0f80d0-c426-4e0b-b5b4-c6025515d61f tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:32.303966 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ff0f80d0-c426-4e0b-b5b4-c6025515d61f tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:32.496776 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-ff0f80d0-c426-4e0b-b5b4-c6025515d61f tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:32.511740 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-ff0f80d0-c426-4e0b-b5b4-c6025515d61f tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/2098e0b9-b628-4b9e-979b-960c68830fee" status: 200 len: 1359 microversion: 2.1 time: 0.242438 Sep 14 08:52:32.519383 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 516/1016] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:32 2022] GET /compute/v2.1/servers/2098e0b9-b628-4b9e-979b-960c68830fee => generated 1359 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:52:32.540279 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-73fe9b6a-bea2-44af-b43c-34dba5970793 tempest-ImagesMetadataTestJSON-553932472 tempest-ImagesMetadataTestJSON-553932472-project] 10.222.0.60 "POST /compute/v2.1/images/360ec463-8154-4d82-b551-86eca9db5e18/metadata" status: 200 len: 85 microversion: 2.1 time: 0.551487 Sep 14 08:52:32.541571 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 501/1017] 10.222.0.60 () {60 vars in 1281 bytes} [Wed Sep 14 08:52:31 2022] POST /compute/v2.1/images/360ec463-8154-4d82-b551-86eca9db5e18/metadata => generated 85 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 08:52:32.549873 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-613b7c14-6570-4a28-8c5a-a6ab60d626a7 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:32.551348 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b7788c21-3afe-4c0a-9e58-603237494cbf tempest-ImagesMetadataTestJSON-553932472 tempest-ImagesMetadataTestJSON-553932472-project] Calling method '.version_select at 0x7f7d445c9430>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:32.553661 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-613b7c14-6570-4a28-8c5a-a6ab60d626a7 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: af183467-9304-4c73-a29f-196e76ba21b5] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:32.573606 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-613b7c14-6570-4a28-8c5a-a6ab60d626a7 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:32.574121 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-613b7c14-6570-4a28-8c5a-a6ab60d626a7 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:32.574572 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-613b7c14-6570-4a28-8c5a-a6ab60d626a7 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:32.575810 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-613b7c14-6570-4a28-8c5a-a6ab60d626a7 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:32.576273 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-613b7c14-6570-4a28-8c5a-a6ab60d626a7 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:32.576819 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-613b7c14-6570-4a28-8c5a-a6ab60d626a7 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:32.618130 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-b7788c21-3afe-4c0a-9e58-603237494cbf tempest-ImagesMetadataTestJSON-553932472 tempest-ImagesMetadataTestJSON-553932472-project] 10.222.0.60 "GET /compute/v2.1/images/360ec463-8154-4d82-b551-86eca9db5e18/metadata" status: 200 len: 85 microversion: 2.1 time: 0.070586 Sep 14 08:52:32.620366 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 502/1018] 10.222.0.60 () {58 vars in 1260 bytes} [Wed Sep 14 08:52:32 2022] GET /compute/v2.1/images/360ec463-8154-4d82-b551-86eca9db5e18/metadata => generated 85 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 14 08:52:32.625706 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-41fe9560-8c0d-4b45-b9c5-fa715dfbc837 req-52f5292f-064d-4091-90ae-e06002883832 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af183467-9304-4c73-a29f-196e76ba21b5", "name": "network-vif-unplugged", "status": "completed", "tag": "9664d857-e4a0-4edd-b5e2-e3a3058cb696"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:52:32.669219 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-41fe9560-8c0d-4b45-b9c5-fa715dfbc837 req-52f5292f-064d-4091-90ae-e06002883832 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:32.673096 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-41fe9560-8c0d-4b45-b9c5-fa715dfbc837 req-52f5292f-064d-4091-90ae-e06002883832 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:32.674504 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-41fe9560-8c0d-4b45-b9c5-fa715dfbc837 req-52f5292f-064d-4091-90ae-e06002883832 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:32.697622 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-41fe9560-8c0d-4b45-b9c5-fa715dfbc837 req-52f5292f-064d-4091-90ae-e06002883832 service nova] Creating event network-vif-unplugged:9664d857-e4a0-4edd-b5e2-e3a3058cb696 for instance af183467-9304-4c73-a29f-196e76ba21b5 on n-h1-836830-18 Sep 14 08:52:32.710583 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [req-41fe9560-8c0d-4b45-b9c5-fa715dfbc837 req-52f5292f-064d-4091-90ae-e06002883832 service nova] Instance af183467-9304-4c73-a29f-196e76ba21b5 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-836830-18'} {{(pid=128758) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 14 08:52:32.722737 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-41fe9560-8c0d-4b45-b9c5-fa715dfbc837 req-52f5292f-064d-4091-90ae-e06002883832 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.100933 Sep 14 08:52:32.724073 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 503/1019] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:52:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:52:32.733381 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-79db4089-4a19-43be-a0f1-0d4f236c4f4a req-5e698ac4-3093-4726-aee2-9e5087c471e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2098e0b9-b628-4b9e-979b-960c68830fee", "tag": "a7cbc77d-b7b8-47d5-a1b4-d36705ecf7a0"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:52:32.747769 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-79db4089-4a19-43be-a0f1-0d4f236c4f4a req-5e698ac4-3093-4726-aee2-9e5087c471e6 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:32.754729 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-79db4089-4a19-43be-a0f1-0d4f236c4f4a req-5e698ac4-3093-4726-aee2-9e5087c471e6 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:32.755869 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-79db4089-4a19-43be-a0f1-0d4f236c4f4a req-5e698ac4-3093-4726-aee2-9e5087c471e6 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:32.785251 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-79db4089-4a19-43be-a0f1-0d4f236c4f4a req-5e698ac4-3093-4726-aee2-9e5087c471e6 service nova] Creating event network-changed:a7cbc77d-b7b8-47d5-a1b4-d36705ecf7a0 for instance 2098e0b9-b628-4b9e-979b-960c68830fee on n-h1-836830-18 Sep 14 08:52:32.792003 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-79db4089-4a19-43be-a0f1-0d4f236c4f4a req-5e698ac4-3093-4726-aee2-9e5087c471e6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065417 Sep 14 08:52:32.793117 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 504/1020] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:52:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:52:32.979962 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-613b7c14-6570-4a28-8c5a-a6ab60d626a7 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:32.992365 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-613b7c14-6570-4a28-8c5a-a6ab60d626a7 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/af183467-9304-4c73-a29f-196e76ba21b5" status: 200 len: 1540 microversion: 2.1 time: 0.471768 Sep 14 08:52:32.995835 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 517/1021] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:32 2022] GET /compute/v2.1/servers/af183467-9304-4c73-a29f-196e76ba21b5 => generated 1540 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:52:33.291631 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-0bd81688-085c-48cb-953e-48bd2a5ece73 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:33.292336 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-0bd81688-085c-48cb-953e-48bd2a5ece73 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] [instance: 42265ff9-9c1f-45b6-b92d-0b23de43a8d0] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:33.305941 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=2 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:52:33.313882 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0bd81688-085c-48cb-953e-48bd2a5ece73 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:33.318287 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0bd81688-085c-48cb-953e-48bd2a5ece73 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:33.319980 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0bd81688-085c-48cb-953e-48bd2a5ece73 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:33.323101 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0bd81688-085c-48cb-953e-48bd2a5ece73 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:33.324238 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0bd81688-085c-48cb-953e-48bd2a5ece73 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:33.324843 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0bd81688-085c-48cb-953e-48bd2a5ece73 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:33.540056 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-2f037ef0-8def-45ce-ac91-0c27cf44db53 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:33.540737 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-2f037ef0-8def-45ce-ac91-0c27cf44db53 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: 2098e0b9-b628-4b9e-979b-960c68830fee] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:33.553394 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2f037ef0-8def-45ce-ac91-0c27cf44db53 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:33.553904 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2f037ef0-8def-45ce-ac91-0c27cf44db53 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:33.554341 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2f037ef0-8def-45ce-ac91-0c27cf44db53 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:33.555695 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2f037ef0-8def-45ce-ac91-0c27cf44db53 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:33.568723 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2f037ef0-8def-45ce-ac91-0c27cf44db53 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:33.569224 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2f037ef0-8def-45ce-ac91-0c27cf44db53 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:34.443166 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-2f037ef0-8def-45ce-ac91-0c27cf44db53 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:34.453842 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-2f037ef0-8def-45ce-ac91-0c27cf44db53 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/2098e0b9-b628-4b9e-979b-960c68830fee" status: 200 len: 1359 microversion: 2.1 time: 0.918596 Sep 14 08:52:34.473610 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 518/1022] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:33 2022] GET /compute/v2.1/servers/2098e0b9-b628-4b9e-979b-960c68830fee => generated 1359 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:52:34.481056 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-25defcaf-bf94-4af2-8d7f-87775df4a178 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:34.484511 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-0bd81688-085c-48cb-953e-48bd2a5ece73 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c7802984cf48d1852832b52abe52e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e326f95a9604fdb9bd075db3837cf62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:34.487998 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-25defcaf-bf94-4af2-8d7f-87775df4a178 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: af183467-9304-4c73-a29f-196e76ba21b5] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:34.499311 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-25defcaf-bf94-4af2-8d7f-87775df4a178 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:34.500184 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-25defcaf-bf94-4af2-8d7f-87775df4a178 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:34.501862 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-25defcaf-bf94-4af2-8d7f-87775df4a178 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:34.515592 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-25defcaf-bf94-4af2-8d7f-87775df4a178 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:34.516305 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-25defcaf-bf94-4af2-8d7f-87775df4a178 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:34.518376 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-25defcaf-bf94-4af2-8d7f-87775df4a178 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:34.529083 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-0bd81688-085c-48cb-953e-48bd2a5ece73 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] 10.222.0.60 "GET /compute/v2.1/servers/42265ff9-9c1f-45b6-b92d-0b23de43a8d0" status: 200 len: 1473 microversion: 2.1 time: 1.242802 Sep 14 08:52:34.533726 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 505/1023] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:33 2022] GET /compute/v2.1/servers/42265ff9-9c1f-45b6-b92d-0b23de43a8d0 => generated 1473 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:52:34.895767 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-25defcaf-bf94-4af2-8d7f-87775df4a178 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:34.908158 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-25defcaf-bf94-4af2-8d7f-87775df4a178 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/af183467-9304-4c73-a29f-196e76ba21b5" status: 200 len: 1540 microversion: 2.1 time: 0.433105 Sep 14 08:52:34.909357 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 519/1024] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:34 2022] GET /compute/v2.1/servers/af183467-9304-4c73-a29f-196e76ba21b5 => generated 1540 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:52:34.914755 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-2de9ef72-8dae-486e-9927-6ba388ebf376 req-c28a560b-c0f5-4f0e-b4fb-3ae5b5ddb66a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42265ff9-9c1f-45b6-b92d-0b23de43a8d0", "name": "network-vif-deleted", "tag": "770d613b-d641-4aed-936e-2e24f2cbfc9b"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:52:34.957460 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-2de9ef72-8dae-486e-9927-6ba388ebf376 req-c28a560b-c0f5-4f0e-b4fb-3ae5b5ddb66a service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:34.957951 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-2de9ef72-8dae-486e-9927-6ba388ebf376 req-c28a560b-c0f5-4f0e-b4fb-3ae5b5ddb66a service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:34.958394 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-2de9ef72-8dae-486e-9927-6ba388ebf376 req-c28a560b-c0f5-4f0e-b4fb-3ae5b5ddb66a service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:34.987664 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-2de9ef72-8dae-486e-9927-6ba388ebf376 req-c28a560b-c0f5-4f0e-b4fb-3ae5b5ddb66a service nova] Creating event network-vif-deleted:770d613b-d641-4aed-936e-2e24f2cbfc9b for instance 42265ff9-9c1f-45b6-b92d-0b23de43a8d0 on n-h1-836830-18 Sep 14 08:52:35.002422 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-2de9ef72-8dae-486e-9927-6ba388ebf376 req-c28a560b-c0f5-4f0e-b4fb-3ae5b5ddb66a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091587 Sep 14 08:52:35.003419 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 520/1025] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:52:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:52:35.208372 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-74d01caa-60b5-4eda-9c53-7280250191cd tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-735684950", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "networks": [{"uuid": "3aed98a5-2a8d-47be-aa58-f6f22237126d"}]}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:52:35.245041 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-f0140cc8-d665-4c1b-9e38-d7a1e5e99c63 req-ae62979a-bdca-46d5-9b07-398666131ec5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f9e2d1a-9899-4046-b2af-939db32442b7", "name": "network-vif-deleted", "tag": "10461c57-a77f-4f2f-9b54-907e301e22ee"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:52:35.274017 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-f0140cc8-d665-4c1b-9e38-d7a1e5e99c63 req-ae62979a-bdca-46d5-9b07-398666131ec5 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:35.274892 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-f0140cc8-d665-4c1b-9e38-d7a1e5e99c63 req-ae62979a-bdca-46d5-9b07-398666131ec5 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:35.275381 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-f0140cc8-d665-4c1b-9e38-d7a1e5e99c63 req-ae62979a-bdca-46d5-9b07-398666131ec5 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:35.291582 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-f0140cc8-d665-4c1b-9e38-d7a1e5e99c63 req-ae62979a-bdca-46d5-9b07-398666131ec5 service nova] Creating event network-vif-deleted:10461c57-a77f-4f2f-9b54-907e301e22ee for instance 3f9e2d1a-9899-4046-b2af-939db32442b7 on n-h2-836830-18 Sep 14 08:52:35.301193 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-f0140cc8-d665-4c1b-9e38-d7a1e5e99c63 req-ae62979a-bdca-46d5-9b07-398666131ec5 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062661 Sep 14 08:52:35.303921 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 521/1026] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:52:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 08:52:35.362437 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.network.neutron [None req-74d01caa-60b5-4eda-9c53-7280250191cd tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] validate_networks() for [('3aed98a5-2a8d-47be-aa58-f6f22237126d', None, None, None, None, None)] {{(pid=128758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 08:52:35.499649 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-06bdb5ae-af72-4be7-b124-89baccf99dc4 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:35.503660 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-06bdb5ae-af72-4be7-b124-89baccf99dc4 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: 2098e0b9-b628-4b9e-979b-960c68830fee] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:35.532817 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-06bdb5ae-af72-4be7-b124-89baccf99dc4 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:35.535196 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-06bdb5ae-af72-4be7-b124-89baccf99dc4 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:35.538875 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-06bdb5ae-af72-4be7-b124-89baccf99dc4 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:35.542570 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-06bdb5ae-af72-4be7-b124-89baccf99dc4 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:35.544667 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-06bdb5ae-af72-4be7-b124-89baccf99dc4 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:35.545393 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-06bdb5ae-af72-4be7-b124-89baccf99dc4 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:35.927368 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-06bdb5ae-af72-4be7-b124-89baccf99dc4 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:35.940238 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-06bdb5ae-af72-4be7-b124-89baccf99dc4 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/2098e0b9-b628-4b9e-979b-960c68830fee" status: 200 len: 1359 microversion: 2.1 time: 0.465427 Sep 14 08:52:35.940830 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 522/1027] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:35 2022] GET /compute/v2.1/servers/2098e0b9-b628-4b9e-979b-960c68830fee => generated 1359 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:52:35.959735 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f5109521-9a0a-4df4-acb5-87d223636163 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:35.960614 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f5109521-9a0a-4df4-acb5-87d223636163 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] [instance: 42265ff9-9c1f-45b6-b92d-0b23de43a8d0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:35.973574 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f5109521-9a0a-4df4-acb5-87d223636163 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:35.974134 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f5109521-9a0a-4df4-acb5-87d223636163 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:35.974626 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f5109521-9a0a-4df4-acb5-87d223636163 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:35.975394 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f5109521-9a0a-4df4-acb5-87d223636163 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:35.975856 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f5109521-9a0a-4df4-acb5-87d223636163 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:35.977686 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f5109521-9a0a-4df4-acb5-87d223636163 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:36.069687 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f5109521-9a0a-4df4-acb5-87d223636163 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:36.070644 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f5109521-9a0a-4df4-acb5-87d223636163 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:36.070644 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f5109521-9a0a-4df4-acb5-87d223636163 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:36.071127 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.objects.instance [None req-f5109521-9a0a-4df4-acb5-87d223636163 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lazy-loading 'fault' on Instance uuid 42265ff9-9c1f-45b6-b92d-0b23de43a8d0 {{(pid=128759) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 08:52:36.146298 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f5109521-9a0a-4df4-acb5-87d223636163 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c7802984cf48d1852832b52abe52e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e326f95a9604fdb9bd075db3837cf62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:36.154856 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f5109521-9a0a-4df4-acb5-87d223636163 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] 10.222.0.60 "GET /compute/v2.1/servers/42265ff9-9c1f-45b6-b92d-0b23de43a8d0" status: 200 len: 1309 microversion: 2.1 time: 0.213045 Sep 14 08:52:36.155589 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 523/1028] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:35 2022] GET /compute/v2.1/servers/42265ff9-9c1f-45b6-b92d-0b23de43a8d0 => generated 1309 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:52:36.166279 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-02d1cb08-b010-4e18-be11-5f0cd8bac2f7 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:36.166993 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-02d1cb08-b010-4e18-be11-5f0cd8bac2f7 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: af183467-9304-4c73-a29f-196e76ba21b5] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:36.172858 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-02d1cb08-b010-4e18-be11-5f0cd8bac2f7 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:36.173348 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-02d1cb08-b010-4e18-be11-5f0cd8bac2f7 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:36.173780 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-02d1cb08-b010-4e18-be11-5f0cd8bac2f7 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:36.174472 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-02d1cb08-b010-4e18-be11-5f0cd8bac2f7 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:36.175503 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-02d1cb08-b010-4e18-be11-5f0cd8bac2f7 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:36.175503 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-02d1cb08-b010-4e18-be11-5f0cd8bac2f7 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:36.182903 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-74d01caa-60b5-4eda-9c53-7280250191cd tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Flavor limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 08:52:36.183409 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-74d01caa-60b5-4eda-9c53-7280250191cd tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Image limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 08:52:36.183877 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-74d01caa-60b5-4eda-9c53-7280250191cd tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Flavor pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 08:52:36.184282 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-74d01caa-60b5-4eda-9c53-7280250191cd tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Image pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 08:52:36.184903 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-74d01caa-60b5-4eda-9c53-7280250191cd tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 08:52:36.194141 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-74d01caa-60b5-4eda-9c53-7280250191cd tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:36.194627 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-74d01caa-60b5-4eda-9c53-7280250191cd tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:36.195078 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-74d01caa-60b5-4eda-9c53-7280250191cd tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:36.195798 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-74d01caa-60b5-4eda-9c53-7280250191cd tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:36.196465 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-74d01caa-60b5-4eda-9c53-7280250191cd tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:36.196881 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-74d01caa-60b5-4eda-9c53-7280250191cd tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:36.214647 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-74d01caa-60b5-4eda-9c53-7280250191cd tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Getting quotas for project 0a87a909133e42e1a82e3a623536935c. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 08:52:36.219936 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-74d01caa-60b5-4eda-9c53-7280250191cd tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Getting quotas for user a3ace9012a7c4ce59c01858b6984b766 and project 0a87a909133e42e1a82e3a623536935c. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 08:52:36.233008 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-74d01caa-60b5-4eda-9c53-7280250191cd tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Going to run 1 instances... {{(pid=128758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 08:52:36.236119 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-74d01caa-60b5-4eda-9c53-7280250191cd tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] [instance: 67f3a983-b33f-49c8-9c91-988e8553563c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 08:52:36.285901 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-74d01caa-60b5-4eda-9c53-7280250191cd tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.750853 Sep 14 08:52:36.286565 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 506/1029] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 08:52:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1752 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 08:52:36.333089 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-02d1cb08-b010-4e18-be11-5f0cd8bac2f7 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:36.342730 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-02d1cb08-b010-4e18-be11-5f0cd8bac2f7 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/af183467-9304-4c73-a29f-196e76ba21b5" status: 200 len: 1472 microversion: 2.1 time: 0.185886 Sep 14 08:52:36.343363 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 524/1030] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:36 2022] GET /compute/v2.1/servers/af183467-9304-4c73-a29f-196e76ba21b5 => generated 1472 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:52:36.350553 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-bcca325d-c982-4f47-8caf-22c2a2f3bc10 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:36.353651 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-bcca325d-c982-4f47-8caf-22c2a2f3bc10 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] [instance: 67f3a983-b33f-49c8-9c91-988e8553563c] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:36.437622 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-bcca325d-c982-4f47-8caf-22c2a2f3bc10 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ace9012a7c4ce59c01858b6984b766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a87a909133e42e1a82e3a623536935c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:36.448192 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-bcca325d-c982-4f47-8caf-22c2a2f3bc10 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] 10.222.0.60 "GET /compute/v2.1/servers/67f3a983-b33f-49c8-9c91-988e8553563c" status: 200 len: 1224 microversion: 2.1 time: 0.102234 Sep 14 08:52:36.449037 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 525/1031] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:36 2022] GET /compute/v2.1/servers/67f3a983-b33f-49c8-9c91-988e8553563c => generated 1224 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:52:36.477451 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-915307e6-d7b7-4b69-b087-6f4e7157f9f0 tempest-KeyPairsV22TestJSON-1379457543 tempest-KeyPairsV22TestJSON-1379457543-project] Action: 'create', calling method: .version_select at 0x7f7d446041f0>, body: {"keypair": {"name": "tempest-keypair-2001771174", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMrlzsBQr7HqY0N3TdN0hOWkvpH4NGl+Sfmxj2JRqfjjG+7cxl/ct0/6rlXG9XbTn7m6dvPuLI82pFlMzOirOCvuibS0DFh3GLTvDEzRiYsauN1E3nuFLFPe8drzRTwuhw=="}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:52:36.513755 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-915307e6-d7b7-4b69-b087-6f4e7157f9f0 tempest-KeyPairsV22TestJSON-1379457543 tempest-KeyPairsV22TestJSON-1379457543-project] Getting quotas for project c8d43c25c2af46e586e3832b766fda04. Resources: {'key_pairs'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 08:52:36.526716 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-915307e6-d7b7-4b69-b087-6f4e7157f9f0 tempest-KeyPairsV22TestJSON-1379457543 tempest-KeyPairsV22TestJSON-1379457543-project] Getting quotas for user 6488876245ba40efa7e5db57fb7ee7bc and project c8d43c25c2af46e586e3832b766fda04. Resources: {'key_pairs'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 08:52:36.567493 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-915307e6-d7b7-4b69-b087-6f4e7157f9f0 tempest-KeyPairsV22TestJSON-1379457543 tempest-KeyPairsV22TestJSON-1379457543-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.279087 Sep 14 08:52:36.568499 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 507/1032] 10.222.0.60 () {62 vars in 1199 bytes} [Wed Sep 14 08:52:36 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 281 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 14 08:52:36.590747 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a8718d0d-017c-4b9f-8108-8498f196b3dc tempest-KeyPairsV22TestJSON-1379457543 tempest-KeyPairsV22TestJSON-1379457543-project] Calling method '.version_select at 0x7f7d443011f0>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:36.611792 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a8718d0d-017c-4b9f-8108-8498f196b3dc tempest-KeyPairsV22TestJSON-1379457543 tempest-KeyPairsV22TestJSON-1379457543-project] 10.222.0.60 "GET /compute/v2.1/os-keypairs/tempest-keypair-2001771174" status: 200 len: 512 microversion: 2.2 time: 0.034929 Sep 14 08:52:36.613048 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 526/1033] 10.222.0.60 () {60 vars in 1258 bytes} [Wed Sep 14 08:52:36 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-2001771174 => generated 512 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:52:36.626540 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-67becaeb-7c86-4862-98cc-0d479840e554 tempest-KeyPairsV22TestJSON-1379457543 tempest-KeyPairsV22TestJSON-1379457543-project] Calling method '.version_select at 0x7f7d44604e50>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:36.663546 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-67becaeb-7c86-4862-98cc-0d479840e554 tempest-KeyPairsV22TestJSON-1379457543 tempest-KeyPairsV22TestJSON-1379457543-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2001771174" status: 204 len: 0 microversion: 2.2 time: 0.043165 Sep 14 08:52:36.664301 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 508/1034] 10.222.0.60 () {60 vars in 1261 bytes} [Wed Sep 14 08:52:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2001771174 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 14 08:52:36.676329 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-5189b7cd-3519-4540-b814-5be97fb034cd tempest-KeyPairsV22TestJSON-1379457543 tempest-KeyPairsV22TestJSON-1379457543-project] Action: 'create', calling method: .version_select at 0x7f7d444271f0>, body: {"keypair": {"name": "tempest-keypair-1248013452", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJA7p8Rb9rLY+xJgi0Pu+lz5edGgLnTKO8UItC7v/ZU3IFcj3dMWUpqEIpM13iMCQoNZkPER3sEUC1tBx+2dxNEOXpZM23tXcKXNvuGkW7wi62yQ/3A31cG/HlH1clfa1A=="}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:52:36.695857 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-5189b7cd-3519-4540-b814-5be97fb034cd tempest-KeyPairsV22TestJSON-1379457543 tempest-KeyPairsV22TestJSON-1379457543-project] Getting quotas for project c8d43c25c2af46e586e3832b766fda04. Resources: {'key_pairs'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 08:52:36.702566 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-5189b7cd-3519-4540-b814-5be97fb034cd tempest-KeyPairsV22TestJSON-1379457543 tempest-KeyPairsV22TestJSON-1379457543-project] Getting quotas for user 6488876245ba40efa7e5db57fb7ee7bc and project c8d43c25c2af46e586e3832b766fda04. Resources: {'key_pairs'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 08:52:36.734201 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-5189b7cd-3519-4540-b814-5be97fb034cd tempest-KeyPairsV22TestJSON-1379457543 tempest-KeyPairsV22TestJSON-1379457543-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.061815 Sep 14 08:52:36.735374 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 527/1035] 10.222.0.60 () {62 vars in 1199 bytes} [Wed Sep 14 08:52:36 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 64 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 14 08:52:36.747912 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a13dd728-5943-426a-bc52-a878454873e2 tempest-KeyPairsV22TestJSON-1379457543 tempest-KeyPairsV22TestJSON-1379457543-project] Calling method '.version_select at 0x7f7d445aa310>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:36.773256 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-a13dd728-5943-426a-bc52-a878454873e2 tempest-KeyPairsV22TestJSON-1379457543 tempest-KeyPairsV22TestJSON-1379457543-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1248013452" status: 204 len: 0 microversion: 2.2 time: 0.030468 Sep 14 08:52:36.774378 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 509/1036] 10.222.0.60 () {60 vars in 1261 bytes} [Wed Sep 14 08:52:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1248013452 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 08:52:36.787951 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e27d71ee-95ff-4f30-ba4b-6701ee62f7b7 tempest-KeyPairsV22TestJSON-1379457543 tempest-KeyPairsV22TestJSON-1379457543-project] Action: 'create', calling method: .version_select at 0x7f7d44427160>, body: {"keypair": {"name": "tempest-keypair-1649801976", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:52:36.811116 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-e27d71ee-95ff-4f30-ba4b-6701ee62f7b7 tempest-KeyPairsV22TestJSON-1379457543 tempest-KeyPairsV22TestJSON-1379457543-project] Getting quotas for project c8d43c25c2af46e586e3832b766fda04. Resources: {'key_pairs'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 08:52:36.819572 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-e27d71ee-95ff-4f30-ba4b-6701ee62f7b7 tempest-KeyPairsV22TestJSON-1379457543 tempest-KeyPairsV22TestJSON-1379457543-project] Getting quotas for user 6488876245ba40efa7e5db57fb7ee7bc and project c8d43c25c2af46e586e3832b766fda04. Resources: {'key_pairs'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 08:52:36.849421 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e27d71ee-95ff-4f30-ba4b-6701ee62f7b7 tempest-KeyPairsV22TestJSON-1379457543 tempest-KeyPairsV22TestJSON-1379457543-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 201 len: 589 microversion: 2.2 time: 0.069356 Sep 14 08:52:36.860351 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 528/1037] 10.222.0.60 () {62 vars in 1199 bytes} [Wed Sep 14 08:52:36 2022] POST /compute/v2.1/os-keypairs => generated 589 bytes in 81 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 14 08:52:36.862820 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-227782d6-7afe-4e31-972d-4a7d9f51e06c tempest-KeyPairsV22TestJSON-1379457543 tempest-KeyPairsV22TestJSON-1379457543-project] Calling method '.version_select at 0x7f7d445d9700>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:36.887743 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-227782d6-7afe-4e31-972d-4a7d9f51e06c tempest-KeyPairsV22TestJSON-1379457543 tempest-KeyPairsV22TestJSON-1379457543-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1649801976" status: 204 len: 0 microversion: 2.2 time: 0.029177 Sep 14 08:52:36.889071 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 510/1038] 10.222.0.60 () {60 vars in 1261 bytes} [Wed Sep 14 08:52:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1649801976 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 14 08:52:36.901935 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3df55a39-79e9-4cc7-9ced-7941e9dfdcea tempest-KeyPairsV22TestJSON-1379457543 tempest-KeyPairsV22TestJSON-1379457543-project] Action: 'create', calling method: .version_select at 0x7f7d443cb820>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1693530707", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAUDP9TGLM+SEZFxVInOHq5WHpgcuGkrhaOfPoVEBkj14H3g9nWIKdVFKt8ewndweura3Zd8RH6GXff7y4t3mR+83SJFe9sHgnVuiAml4jCvExabdKwlTPp6FWLQHZ+ARA=="}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:52:36.919317 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-3df55a39-79e9-4cc7-9ced-7941e9dfdcea tempest-KeyPairsV22TestJSON-1379457543 tempest-KeyPairsV22TestJSON-1379457543-project] Getting quotas for project c8d43c25c2af46e586e3832b766fda04. Resources: {'key_pairs'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 08:52:36.925060 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-3df55a39-79e9-4cc7-9ced-7941e9dfdcea tempest-KeyPairsV22TestJSON-1379457543 tempest-KeyPairsV22TestJSON-1379457543-project] Getting quotas for user 6488876245ba40efa7e5db57fb7ee7bc and project c8d43c25c2af46e586e3832b766fda04. Resources: {'key_pairs'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 08:52:36.956368 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-3df55a39-79e9-4cc7-9ced-7941e9dfdcea tempest-KeyPairsV22TestJSON-1379457543 tempest-KeyPairsV22TestJSON-1379457543-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.058794 Sep 14 08:52:36.957192 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 529/1039] 10.222.0.60 () {62 vars in 1199 bytes} [Wed Sep 14 08:52:36 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 61 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 14 08:52:36.969279 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-56838bfc-ad9d-4bcf-9521-9277eb6921ca tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:36.970197 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-56838bfc-ad9d-4bcf-9521-9277eb6921ca tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: 2098e0b9-b628-4b9e-979b-960c68830fee] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:36.970995 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8697e319-2d07-4858-811f-cae4ef337ea4 tempest-KeyPairsV22TestJSON-1379457543 tempest-KeyPairsV22TestJSON-1379457543-project] Action: 'create', calling method: .version_select at 0x7f7d442e3f70>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1512197797", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOXeQbJH5LRIav2m2RtjehetI5GGjNOFTW6AMKlNbVTO3Gd8gCVNT4DV7/+Eb0sYsvmR/h7BRIAudVZbuqcaCB+NOc+aK66atrYJY1Nsg+uLA6JZ+8yASk1uRTcXDAibMQ=="}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:52:36.977405 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-56838bfc-ad9d-4bcf-9521-9277eb6921ca tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:36.977898 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-56838bfc-ad9d-4bcf-9521-9277eb6921ca tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:36.978380 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-56838bfc-ad9d-4bcf-9521-9277eb6921ca tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:36.979192 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-56838bfc-ad9d-4bcf-9521-9277eb6921ca tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:36.979853 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-56838bfc-ad9d-4bcf-9521-9277eb6921ca tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:36.981605 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-56838bfc-ad9d-4bcf-9521-9277eb6921ca tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:36.989228 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-8697e319-2d07-4858-811f-cae4ef337ea4 tempest-KeyPairsV22TestJSON-1379457543 tempest-KeyPairsV22TestJSON-1379457543-project] Getting quotas for project c8d43c25c2af46e586e3832b766fda04. Resources: {'key_pairs'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 08:52:36.994665 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-8697e319-2d07-4858-811f-cae4ef337ea4 tempest-KeyPairsV22TestJSON-1379457543 tempest-KeyPairsV22TestJSON-1379457543-project] Getting quotas for user 6488876245ba40efa7e5db57fb7ee7bc and project c8d43c25c2af46e586e3832b766fda04. Resources: {'key_pairs'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 08:52:37.020635 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-8697e319-2d07-4858-811f-cae4ef337ea4 tempest-KeyPairsV22TestJSON-1379457543 tempest-KeyPairsV22TestJSON-1379457543-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.053349 Sep 14 08:52:37.021783 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 530/1040] 10.222.0.60 () {62 vars in 1199 bytes} [Wed Sep 14 08:52:36 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 55 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Sep 14 08:52:37.035360 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-db05182a-c71c-47bb-9f23-214efa7c8e0c tempest-KeyPairsV22TestJSON-1379457543 tempest-KeyPairsV22TestJSON-1379457543-project] Action: 'create', calling method: .version_select at 0x7f7d445cfe50>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1659298468", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBA09pyr/OKhcRdKi64DwDyA029jz3AyM61qdcsDj3JNQWrCnYiO6rzdVx1Khy6z08DQzGDasDH6Fpj8ImgjuVVDwAeSns+UiV23+vmQ7iKFfwuL8RvOwGFHIK+HAVGZcA=="}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:52:37.045676 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:52:37.055501 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-db05182a-c71c-47bb-9f23-214efa7c8e0c tempest-KeyPairsV22TestJSON-1379457543 tempest-KeyPairsV22TestJSON-1379457543-project] Getting quotas for project c8d43c25c2af46e586e3832b766fda04. Resources: {'key_pairs'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 08:52:37.061818 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-db05182a-c71c-47bb-9f23-214efa7c8e0c tempest-KeyPairsV22TestJSON-1379457543 tempest-KeyPairsV22TestJSON-1379457543-project] Getting quotas for user 6488876245ba40efa7e5db57fb7ee7bc and project c8d43c25c2af46e586e3832b766fda04. Resources: {'key_pairs'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 08:52:37.088351 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-db05182a-c71c-47bb-9f23-214efa7c8e0c tempest-KeyPairsV22TestJSON-1379457543 tempest-KeyPairsV22TestJSON-1379457543-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.057006 Sep 14 08:52:37.089134 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 531/1041] 10.222.0.60 () {62 vars in 1199 bytes} [Wed Sep 14 08:52:37 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 58 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 14 08:52:37.101193 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-52c2c528-875a-469c-940c-bca95326c75b tempest-KeyPairsV22TestJSON-1379457543 tempest-KeyPairsV22TestJSON-1379457543-project] Calling method '.version_select at 0x7f7d44427430>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:37.105763 n-d-836830-18 devstack@n-api.service[128759]: WARNING oslo_db.sqlalchemy.utils [None req-52c2c528-875a-469c-940c-bca95326c75b tempest-KeyPairsV22TestJSON-1379457543 tempest-KeyPairsV22TestJSON-1379457543-project] Unique keys not in sort_keys. The sorting order may be unstable. Sep 14 08:52:37.113266 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-52c2c528-875a-469c-940c-bca95326c75b tempest-KeyPairsV22TestJSON-1379457543 tempest-KeyPairsV22TestJSON-1379457543-project] 10.222.0.60 "GET /compute/v2.1/os-keypairs" status: 200 len: 1142 microversion: 2.2 time: 0.016968 Sep 14 08:52:37.114559 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 532/1042] 10.222.0.60 () {60 vars in 1177 bytes} [Wed Sep 14 08:52:37 2022] GET /compute/v2.1/os-keypairs => generated 1142 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:52:37.125025 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-456fffaa-7293-4a12-b465-256bef8596a0 tempest-KeyPairsV22TestJSON-1379457543 tempest-KeyPairsV22TestJSON-1379457543-project] Calling method '.version_select at 0x7f7d44c4c940>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:37.128561 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-56838bfc-ad9d-4bcf-9521-9277eb6921ca tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:37.139474 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-56838bfc-ad9d-4bcf-9521-9277eb6921ca tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/2098e0b9-b628-4b9e-979b-960c68830fee" status: 200 len: 1359 microversion: 2.1 time: 0.174129 Sep 14 08:52:37.140396 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 511/1043] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:36 2022] GET /compute/v2.1/servers/2098e0b9-b628-4b9e-979b-960c68830fee => generated 1359 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:52:37.147629 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-456fffaa-7293-4a12-b465-256bef8596a0 tempest-KeyPairsV22TestJSON-1379457543 tempest-KeyPairsV22TestJSON-1379457543-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1659298468" status: 204 len: 0 microversion: 2.2 time: 0.026258 Sep 14 08:52:37.148466 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 533/1044] 10.222.0.60 () {60 vars in 1321 bytes} [Wed Sep 14 08:52:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1659298468 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 08:52:37.156699 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c434ea51-3576-477d-9a28-fd1b7b8e6058 tempest-KeyPairsV22TestJSON-1379457543 tempest-KeyPairsV22TestJSON-1379457543-project] Calling method '.version_select at 0x7f7d44789a60>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:37.176679 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-c434ea51-3576-477d-9a28-fd1b7b8e6058 tempest-KeyPairsV22TestJSON-1379457543 tempest-KeyPairsV22TestJSON-1379457543-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1512197797" status: 204 len: 0 microversion: 2.2 time: 0.023725 Sep 14 08:52:37.177280 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 512/1045] 10.222.0.60 () {60 vars in 1321 bytes} [Wed Sep 14 08:52:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1512197797 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 14 08:52:37.181148 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-995931a0-075f-43a6-9c12-7f0c2f832a49 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:37.181984 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-995931a0-075f-43a6-9c12-7f0c2f832a49 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] [instance: 42265ff9-9c1f-45b6-b92d-0b23de43a8d0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:37.186284 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c6b949a2-b2e1-4563-8dd1-20018a783b64 tempest-KeyPairsV22TestJSON-1379457543 tempest-KeyPairsV22TestJSON-1379457543-project] Calling method '.version_select at 0x7f7d445aaaf0>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:37.188960 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-995931a0-075f-43a6-9c12-7f0c2f832a49 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:37.189450 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-995931a0-075f-43a6-9c12-7f0c2f832a49 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:37.189888 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-995931a0-075f-43a6-9c12-7f0c2f832a49 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:37.190598 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-995931a0-075f-43a6-9c12-7f0c2f832a49 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:37.191222 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-995931a0-075f-43a6-9c12-7f0c2f832a49 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:37.191676 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-995931a0-075f-43a6-9c12-7f0c2f832a49 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:37.226537 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-c6b949a2-b2e1-4563-8dd1-20018a783b64 tempest-KeyPairsV22TestJSON-1379457543 tempest-KeyPairsV22TestJSON-1379457543-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1693530707" status: 204 len: 0 microversion: 2.2 time: 0.044569 Sep 14 08:52:37.227164 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 513/1046] 10.222.0.60 () {60 vars in 1321 bytes} [Wed Sep 14 08:52:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1693530707 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 14 08:52:37.229043 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-995931a0-075f-43a6-9c12-7f0c2f832a49 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:37.229867 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-995931a0-075f-43a6-9c12-7f0c2f832a49 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:37.230459 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-995931a0-075f-43a6-9c12-7f0c2f832a49 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:37.231088 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.objects.instance [None req-995931a0-075f-43a6-9c12-7f0c2f832a49 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lazy-loading 'fault' on Instance uuid 42265ff9-9c1f-45b6-b92d-0b23de43a8d0 {{(pid=128759) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 08:52:37.246836 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-dcca1232-5d62-41ee-a9ba-bde9f22a0916 tempest-KeyPairsV22TestJSON-1379457543 tempest-KeyPairsV22TestJSON-1379457543-project] Action: 'create', calling method: .version_select at 0x7f7d4455eee0>, body: {"keypair": {"name": "tempest-keypair-28292586", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHsTSRbqFgO2UT0Ll1wYJFAvZrdjlCrFtjOJN+nMyKSCnN2zD5w6NKM4DLqopRvnYeGGvbmLUqDuv9gu2bIZz3hc5U4+liTFD373TGPMujmo+p1VwCjv4mFO+GBghteuEA=="}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:52:37.266328 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-dcca1232-5d62-41ee-a9ba-bde9f22a0916 tempest-KeyPairsV22TestJSON-1379457543 tempest-KeyPairsV22TestJSON-1379457543-project] Getting quotas for project c8d43c25c2af46e586e3832b766fda04. Resources: {'key_pairs'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 08:52:37.283854 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-dcca1232-5d62-41ee-a9ba-bde9f22a0916 tempest-KeyPairsV22TestJSON-1379457543 tempest-KeyPairsV22TestJSON-1379457543-project] Getting quotas for user 6488876245ba40efa7e5db57fb7ee7bc and project c8d43c25c2af46e586e3832b766fda04. Resources: {'key_pairs'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 08:52:37.292321 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-995931a0-075f-43a6-9c12-7f0c2f832a49 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c7802984cf48d1852832b52abe52e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e326f95a9604fdb9bd075db3837cf62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:37.303817 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-995931a0-075f-43a6-9c12-7f0c2f832a49 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] 10.222.0.60 "GET /compute/v2.1/servers/42265ff9-9c1f-45b6-b92d-0b23de43a8d0" status: 200 len: 1309 microversion: 2.1 time: 0.129968 Sep 14 08:52:37.307401 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 534/1047] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:37 2022] GET /compute/v2.1/servers/42265ff9-9c1f-45b6-b92d-0b23de43a8d0 => generated 1309 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:52:37.342855 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-dcca1232-5d62-41ee-a9ba-bde9f22a0916 tempest-KeyPairsV22TestJSON-1379457543 tempest-KeyPairsV22TestJSON-1379457543-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.2 time: 0.104552 Sep 14 08:52:37.344117 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 514/1048] 10.222.0.60 () {62 vars in 1199 bytes} [Wed Sep 14 08:52:37 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 109 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 14 08:52:37.355360 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-0e829784-abe5-4d86-bc98-67950cefe924 tempest-KeyPairsV22TestJSON-1379457543 tempest-KeyPairsV22TestJSON-1379457543-project] Calling method '.version_select at 0x7f7d442e38b0>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:37.369945 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-69fedfde-90f3-4f2c-b969-faf08f5075e7 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:37.370183 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-0e829784-abe5-4d86-bc98-67950cefe924 tempest-KeyPairsV22TestJSON-1379457543 tempest-KeyPairsV22TestJSON-1379457543-project] 10.222.0.60 "GET /compute/v2.1/os-keypairs/tempest-keypair-28292586" status: 200 len: 511 microversion: 2.2 time: 0.019104 Sep 14 08:52:37.370710 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 535/1049] 10.222.0.60 () {60 vars in 1252 bytes} [Wed Sep 14 08:52:37 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-28292586 => generated 511 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:52:37.370823 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-69fedfde-90f3-4f2c-b969-faf08f5075e7 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: af183467-9304-4c73-a29f-196e76ba21b5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:37.380162 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-69fedfde-90f3-4f2c-b969-faf08f5075e7 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:37.381353 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-69fedfde-90f3-4f2c-b969-faf08f5075e7 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:37.382691 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-69fedfde-90f3-4f2c-b969-faf08f5075e7 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:37.383635 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-69fedfde-90f3-4f2c-b969-faf08f5075e7 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:37.384257 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-69fedfde-90f3-4f2c-b969-faf08f5075e7 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:37.385370 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-69fedfde-90f3-4f2c-b969-faf08f5075e7 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:37.389240 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-35cac1e3-651a-4d32-944a-a4c34a2abc5d tempest-KeyPairsV22TestJSON-1379457543 tempest-KeyPairsV22TestJSON-1379457543-project] Calling method '.version_select at 0x7f7d4430b5e0>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:37.403745 n-d-836830-18 devstack@n-api.service[128759]: WARNING oslo_db.sqlalchemy.utils [None req-35cac1e3-651a-4d32-944a-a4c34a2abc5d tempest-KeyPairsV22TestJSON-1379457543 tempest-KeyPairsV22TestJSON-1379457543-project] Unique keys not in sort_keys. The sorting order may be unstable. Sep 14 08:52:37.410823 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-35cac1e3-651a-4d32-944a-a4c34a2abc5d tempest-KeyPairsV22TestJSON-1379457543 tempest-KeyPairsV22TestJSON-1379457543-project] 10.222.0.60 "GET /compute/v2.1/os-keypairs" status: 200 len: 368 microversion: 2.2 time: 0.032088 Sep 14 08:52:37.417772 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 536/1050] 10.222.0.60 () {60 vars in 1177 bytes} [Wed Sep 14 08:52:37 2022] GET /compute/v2.1/os-keypairs => generated 368 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:52:37.425613 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-672ab689-10c9-4dc7-8bf0-69d1613ade62 tempest-KeyPairsV22TestJSON-1379457543 tempest-KeyPairsV22TestJSON-1379457543-project] Calling method '.version_select at 0x7f7d442eb820>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:37.471483 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-672ab689-10c9-4dc7-8bf0-69d1613ade62 tempest-KeyPairsV22TestJSON-1379457543 tempest-KeyPairsV22TestJSON-1379457543-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-28292586" status: 204 len: 0 microversion: 2.2 time: 0.052111 Sep 14 08:52:37.472830 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 537/1051] 10.222.0.60 () {60 vars in 1255 bytes} [Wed Sep 14 08:52:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-28292586 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 08:52:37.478221 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-7a8c940a-5c45-4c34-9b03-2b1df88b67c8 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:37.479174 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-7a8c940a-5c45-4c34-9b03-2b1df88b67c8 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] [instance: 67f3a983-b33f-49c8-9c91-988e8553563c] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:37.486306 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7a8c940a-5c45-4c34-9b03-2b1df88b67c8 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:37.486894 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7a8c940a-5c45-4c34-9b03-2b1df88b67c8 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:37.487429 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7a8c940a-5c45-4c34-9b03-2b1df88b67c8 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:37.488137 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7a8c940a-5c45-4c34-9b03-2b1df88b67c8 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:37.488616 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7a8c940a-5c45-4c34-9b03-2b1df88b67c8 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:37.489028 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7a8c940a-5c45-4c34-9b03-2b1df88b67c8 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:37.519423 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:52:37.582216 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-7a8c940a-5c45-4c34-9b03-2b1df88b67c8 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ace9012a7c4ce59c01858b6984b766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a87a909133e42e1a82e3a623536935c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:37.586573 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-69fedfde-90f3-4f2c-b969-faf08f5075e7 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:37.591665 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-7a8c940a-5c45-4c34-9b03-2b1df88b67c8 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] 10.222.0.60 "GET /compute/v2.1/servers/67f3a983-b33f-49c8-9c91-988e8553563c" status: 200 len: 1228 microversion: 2.1 time: 0.117526 Sep 14 08:52:37.592295 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 538/1052] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:37 2022] GET /compute/v2.1/servers/67f3a983-b33f-49c8-9c91-988e8553563c => generated 1228 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:52:37.597308 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-69fedfde-90f3-4f2c-b969-faf08f5075e7 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/af183467-9304-4c73-a29f-196e76ba21b5" status: 200 len: 1472 microversion: 2.1 time: 0.229241 Sep 14 08:52:37.597308 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 515/1053] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:37 2022] GET /compute/v2.1/servers/af183467-9304-4c73-a29f-196e76ba21b5 => generated 1472 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:52:37.600955 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-f879c895-a091-4ea9-8372-0d994f50050d tempest-KeyPairsV22TestJSON-1379457543 tempest-KeyPairsV22TestJSON-1379457543-project] Action: 'create', calling method: .version_select at 0x7f7d4455e9d0>, body: {"keypair": {"name": "tempest-keypair-1781601067", "type": "x509"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:52:37.609661 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=5,nova_api:DELETE=5 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:52:37.627322 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-f879c895-a091-4ea9-8372-0d994f50050d tempest-KeyPairsV22TestJSON-1379457543 tempest-KeyPairsV22TestJSON-1379457543-project] Getting quotas for project c8d43c25c2af46e586e3832b766fda04. Resources: {'key_pairs'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 08:52:37.635357 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-f879c895-a091-4ea9-8372-0d994f50050d tempest-KeyPairsV22TestJSON-1379457543 tempest-KeyPairsV22TestJSON-1379457543-project] Getting quotas for user 6488876245ba40efa7e5db57fb7ee7bc and project c8d43c25c2af46e586e3832b766fda04. Resources: {'key_pairs'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 08:52:37.652887 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.processutils [None req-f879c895-a091-4ea9-8372-0d994f50050d tempest-KeyPairsV22TestJSON-1379457543 tempest-KeyPairsV22TestJSON-1379457543-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmpziriw_ei/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpziriw_ei/temp.key -subj /CN=6488876245ba40efa7e5db57fb7ee7bc -extensions v3_req_client {{(pid=128758) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Sep 14 08:52:37.977609 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.processutils [None req-f879c895-a091-4ea9-8372-0d994f50050d tempest-KeyPairsV22TestJSON-1379457543 tempest-KeyPairsV22TestJSON-1379457543-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmpziriw_ei/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpziriw_ei/temp.key -subj /CN=6488876245ba40efa7e5db57fb7ee7bc -extensions v3_req_client" returned: 0 in 0.324s {{(pid=128758) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Sep 14 08:52:37.979469 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.processutils [None req-f879c895-a091-4ea9-8372-0d994f50050d tempest-KeyPairsV22TestJSON-1379457543 tempest-KeyPairsV22TestJSON-1379457543-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmpziriw_ei/temp.key -password pass: {{(pid=128758) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Sep 14 08:52:38.001167 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.processutils [None req-f879c895-a091-4ea9-8372-0d994f50050d tempest-KeyPairsV22TestJSON-1379457543 tempest-KeyPairsV22TestJSON-1379457543-project] CMD "openssl pkcs12 -export -inkey /tmp/tmpziriw_ei/temp.key -password pass:" returned: 0 in 0.021s {{(pid=128758) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Sep 14 08:52:38.063898 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-f879c895-a091-4ea9-8372-0d994f50050d tempest-KeyPairsV22TestJSON-1379457543 tempest-KeyPairsV22TestJSON-1379457543-project] Getting quotas for project c8d43c25c2af46e586e3832b766fda04. Resources: {'key_pairs'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 08:52:38.069734 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-f879c895-a091-4ea9-8372-0d994f50050d tempest-KeyPairsV22TestJSON-1379457543 tempest-KeyPairsV22TestJSON-1379457543-project] Getting quotas for user 6488876245ba40efa7e5db57fb7ee7bc and project c8d43c25c2af46e586e3832b766fda04. Resources: {'key_pairs'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 08:52:38.087528 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-f879c895-a091-4ea9-8372-0d994f50050d tempest-KeyPairsV22TestJSON-1379457543 tempest-KeyPairsV22TestJSON-1379457543-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 201 len: 4693 microversion: 2.2 time: 0.490545 Sep 14 08:52:38.089513 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 516/1054] 10.222.0.60 () {62 vars in 1198 bytes} [Wed Sep 14 08:52:37 2022] POST /compute/v2.1/os-keypairs => generated 4693 bytes in 493 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Sep 14 08:52:38.100715 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-72963877-06c7-45b1-a244-3eedbcf50d4f tempest-KeyPairsV22TestJSON-1379457543 tempest-KeyPairsV22TestJSON-1379457543-project] Calling method '.version_select at 0x7f7d44375d30>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:38.109568 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-72963877-06c7-45b1-a244-3eedbcf50d4f tempest-KeyPairsV22TestJSON-1379457543 tempest-KeyPairsV22TestJSON-1379457543-project] 10.222.0.60 "GET /compute/v2.1/os-keypairs/tempest-keypair-1781601067" status: 200 len: 1534 microversion: 2.2 time: 0.013691 Sep 14 08:52:38.110269 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 539/1055] 10.222.0.60 () {60 vars in 1258 bytes} [Wed Sep 14 08:52:38 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1781601067 => generated 1534 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:52:38.125135 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-51c0ea4d-eacf-4517-b2de-f0b6da88db39 tempest-KeyPairsV22TestJSON-1379457543 tempest-KeyPairsV22TestJSON-1379457543-project] Calling method '.version_select at 0x7f7d445d9c10>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:38.130041 n-d-836830-18 devstack@n-api.service[128758]: WARNING oslo_db.sqlalchemy.utils [None req-51c0ea4d-eacf-4517-b2de-f0b6da88db39 tempest-KeyPairsV22TestJSON-1379457543 tempest-KeyPairsV22TestJSON-1379457543-project] Unique keys not in sort_keys. The sorting order may be unstable. Sep 14 08:52:38.138687 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-51c0ea4d-eacf-4517-b2de-f0b6da88db39 tempest-KeyPairsV22TestJSON-1379457543 tempest-KeyPairsV22TestJSON-1379457543-project] 10.222.0.60 "GET /compute/v2.1/os-keypairs" status: 200 len: 1391 microversion: 2.2 time: 0.019444 Sep 14 08:52:38.139318 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 517/1056] 10.222.0.60 () {60 vars in 1177 bytes} [Wed Sep 14 08:52:38 2022] GET /compute/v2.1/os-keypairs => generated 1391 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:52:38.151567 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-fc474057-c373-49fb-aca4-4996b7a30ac0 tempest-KeyPairsV22TestJSON-1379457543 tempest-KeyPairsV22TestJSON-1379457543-project] Calling method '.version_select at 0x7f7d44427430>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:38.167590 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-9c8d5b9f-d343-4a4e-adda-4562e341e7aa tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:38.169447 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-9c8d5b9f-d343-4a4e-adda-4562e341e7aa tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: 2098e0b9-b628-4b9e-979b-960c68830fee] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:38.181752 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9c8d5b9f-d343-4a4e-adda-4562e341e7aa tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:38.185602 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9c8d5b9f-d343-4a4e-adda-4562e341e7aa tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:38.186305 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9c8d5b9f-d343-4a4e-adda-4562e341e7aa tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:38.189236 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9c8d5b9f-d343-4a4e-adda-4562e341e7aa tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:38.190052 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9c8d5b9f-d343-4a4e-adda-4562e341e7aa tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:38.190692 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9c8d5b9f-d343-4a4e-adda-4562e341e7aa tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:38.200396 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-fc474057-c373-49fb-aca4-4996b7a30ac0 tempest-KeyPairsV22TestJSON-1379457543 tempest-KeyPairsV22TestJSON-1379457543-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1781601067" status: 204 len: 0 microversion: 2.2 time: 0.052963 Sep 14 08:52:38.201599 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 540/1057] 10.222.0.60 () {60 vars in 1261 bytes} [Wed Sep 14 08:52:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1781601067 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 14 08:52:38.327313 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-29aa90bc-8362-4f24-819f-53b75454f77a tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:38.327956 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-29aa90bc-8362-4f24-819f-53b75454f77a tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] [instance: 42265ff9-9c1f-45b6-b92d-0b23de43a8d0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:38.335594 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-29aa90bc-8362-4f24-819f-53b75454f77a tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:38.336377 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-29aa90bc-8362-4f24-819f-53b75454f77a tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:38.336785 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-29aa90bc-8362-4f24-819f-53b75454f77a tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:38.337662 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-29aa90bc-8362-4f24-819f-53b75454f77a tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:38.338358 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-29aa90bc-8362-4f24-819f-53b75454f77a tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:38.338543 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-29aa90bc-8362-4f24-819f-53b75454f77a tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:38.371991 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-29aa90bc-8362-4f24-819f-53b75454f77a tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:38.372589 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-29aa90bc-8362-4f24-819f-53b75454f77a tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:38.373120 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-29aa90bc-8362-4f24-819f-53b75454f77a tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:38.373649 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.objects.instance [None req-29aa90bc-8362-4f24-819f-53b75454f77a tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lazy-loading 'fault' on Instance uuid 42265ff9-9c1f-45b6-b92d-0b23de43a8d0 {{(pid=128759) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 08:52:38.379887 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-9c8d5b9f-d343-4a4e-adda-4562e341e7aa tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:38.389497 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-9c8d5b9f-d343-4a4e-adda-4562e341e7aa tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/2098e0b9-b628-4b9e-979b-960c68830fee" status: 200 len: 1359 microversion: 2.1 time: 0.227028 Sep 14 08:52:38.390140 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 518/1058] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:38 2022] GET /compute/v2.1/servers/2098e0b9-b628-4b9e-979b-960c68830fee => generated 1359 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:52:38.424328 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-29aa90bc-8362-4f24-819f-53b75454f77a tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c7802984cf48d1852832b52abe52e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e326f95a9604fdb9bd075db3837cf62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:38.435182 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-29aa90bc-8362-4f24-819f-53b75454f77a tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] 10.222.0.60 "GET /compute/v2.1/servers/42265ff9-9c1f-45b6-b92d-0b23de43a8d0" status: 200 len: 1309 microversion: 2.1 time: 0.111532 Sep 14 08:52:38.436125 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 541/1059] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:38 2022] GET /compute/v2.1/servers/42265ff9-9c1f-45b6-b92d-0b23de43a8d0 => generated 1309 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:52:38.615684 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1ec92a90-d972-49cf-b38b-2dbde71bf856 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:38.616333 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-1ec92a90-d972-49cf-b38b-2dbde71bf856 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] [instance: 67f3a983-b33f-49c8-9c91-988e8553563c] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:38.624019 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d772e027-2c06-4bde-a72e-24e6f7791384 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:38.624993 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-d772e027-2c06-4bde-a72e-24e6f7791384 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: af183467-9304-4c73-a29f-196e76ba21b5] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:38.626839 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1ec92a90-d972-49cf-b38b-2dbde71bf856 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:38.627372 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1ec92a90-d972-49cf-b38b-2dbde71bf856 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:38.627815 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1ec92a90-d972-49cf-b38b-2dbde71bf856 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:38.628531 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1ec92a90-d972-49cf-b38b-2dbde71bf856 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:38.628990 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1ec92a90-d972-49cf-b38b-2dbde71bf856 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:38.629420 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1ec92a90-d972-49cf-b38b-2dbde71bf856 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:38.649432 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d772e027-2c06-4bde-a72e-24e6f7791384 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:38.652103 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d772e027-2c06-4bde-a72e-24e6f7791384 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:38.653694 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d772e027-2c06-4bde-a72e-24e6f7791384 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:38.654447 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d772e027-2c06-4bde-a72e-24e6f7791384 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:38.657540 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d772e027-2c06-4bde-a72e-24e6f7791384 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:38.659315 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d772e027-2c06-4bde-a72e-24e6f7791384 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:38.744369 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-1ec92a90-d972-49cf-b38b-2dbde71bf856 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ace9012a7c4ce59c01858b6984b766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a87a909133e42e1a82e3a623536935c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:38.747109 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:52:38.757056 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-1ec92a90-d972-49cf-b38b-2dbde71bf856 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] 10.222.0.60 "GET /compute/v2.1/servers/67f3a983-b33f-49c8-9c91-988e8553563c" status: 200 len: 1220 microversion: 2.1 time: 0.145820 Sep 14 08:52:38.757719 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 519/1060] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:38 2022] GET /compute/v2.1/servers/67f3a983-b33f-49c8-9c91-988e8553563c => generated 1220 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:52:38.888422 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-d772e027-2c06-4bde-a72e-24e6f7791384 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:38.896514 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d772e027-2c06-4bde-a72e-24e6f7791384 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/af183467-9304-4c73-a29f-196e76ba21b5" status: 200 len: 1472 microversion: 2.1 time: 0.278602 Sep 14 08:52:38.897184 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 542/1061] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:38 2022] GET /compute/v2.1/servers/af183467-9304-4c73-a29f-196e76ba21b5 => generated 1472 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:52:39.415080 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-cc406c20-5245-4072-b88f-ad83dc0014eb tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:39.416442 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-cc406c20-5245-4072-b88f-ad83dc0014eb tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: 2098e0b9-b628-4b9e-979b-960c68830fee] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:39.423418 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cc406c20-5245-4072-b88f-ad83dc0014eb tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:39.423943 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cc406c20-5245-4072-b88f-ad83dc0014eb tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:39.424334 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cc406c20-5245-4072-b88f-ad83dc0014eb tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:39.425037 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cc406c20-5245-4072-b88f-ad83dc0014eb tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:39.425490 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cc406c20-5245-4072-b88f-ad83dc0014eb tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:39.425912 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cc406c20-5245-4072-b88f-ad83dc0014eb tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:39.468889 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-963cec12-10c8-4258-b47b-7e859f150e0f tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:39.470367 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-963cec12-10c8-4258-b47b-7e859f150e0f tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] [instance: 42265ff9-9c1f-45b6-b92d-0b23de43a8d0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:39.479351 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-963cec12-10c8-4258-b47b-7e859f150e0f tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:39.479979 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-963cec12-10c8-4258-b47b-7e859f150e0f tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:39.480435 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-963cec12-10c8-4258-b47b-7e859f150e0f tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:39.481140 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-963cec12-10c8-4258-b47b-7e859f150e0f tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:39.481749 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-963cec12-10c8-4258-b47b-7e859f150e0f tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:39.482179 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-963cec12-10c8-4258-b47b-7e859f150e0f tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:39.518550 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-963cec12-10c8-4258-b47b-7e859f150e0f tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:39.519075 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-963cec12-10c8-4258-b47b-7e859f150e0f tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:39.519641 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-963cec12-10c8-4258-b47b-7e859f150e0f tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:39.520287 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.objects.instance [None req-963cec12-10c8-4258-b47b-7e859f150e0f tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lazy-loading 'fault' on Instance uuid 42265ff9-9c1f-45b6-b92d-0b23de43a8d0 {{(pid=128759) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 08:52:39.577972 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-963cec12-10c8-4258-b47b-7e859f150e0f tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c7802984cf48d1852832b52abe52e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e326f95a9604fdb9bd075db3837cf62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:39.588971 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-963cec12-10c8-4258-b47b-7e859f150e0f tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] 10.222.0.60 "GET /compute/v2.1/servers/42265ff9-9c1f-45b6-b92d-0b23de43a8d0" status: 200 len: 1309 microversion: 2.1 time: 0.131129 Sep 14 08:52:39.590086 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 543/1062] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:39 2022] GET /compute/v2.1/servers/42265ff9-9c1f-45b6-b92d-0b23de43a8d0 => generated 1309 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:52:39.616095 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-cc406c20-5245-4072-b88f-ad83dc0014eb tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:39.623717 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-cc406c20-5245-4072-b88f-ad83dc0014eb tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/2098e0b9-b628-4b9e-979b-960c68830fee" status: 200 len: 1359 microversion: 2.1 time: 0.214126 Sep 14 08:52:39.624532 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 520/1063] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:39 2022] GET /compute/v2.1/servers/2098e0b9-b628-4b9e-979b-960c68830fee => generated 1359 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:52:39.780112 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e599cefc-3f1e-4df8-b72c-89e5af5fb5ec tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:39.780726 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e599cefc-3f1e-4df8-b72c-89e5af5fb5ec tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] [instance: 67f3a983-b33f-49c8-9c91-988e8553563c] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:39.787106 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e599cefc-3f1e-4df8-b72c-89e5af5fb5ec tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:39.788099 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e599cefc-3f1e-4df8-b72c-89e5af5fb5ec tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:39.788536 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e599cefc-3f1e-4df8-b72c-89e5af5fb5ec tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:39.789234 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e599cefc-3f1e-4df8-b72c-89e5af5fb5ec tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:39.789690 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e599cefc-3f1e-4df8-b72c-89e5af5fb5ec tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:39.790113 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e599cefc-3f1e-4df8-b72c-89e5af5fb5ec tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:39.858884 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-e599cefc-3f1e-4df8-b72c-89e5af5fb5ec tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ace9012a7c4ce59c01858b6984b766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a87a909133e42e1a82e3a623536935c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:39.866852 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e599cefc-3f1e-4df8-b72c-89e5af5fb5ec tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] 10.222.0.60 "GET /compute/v2.1/servers/67f3a983-b33f-49c8-9c91-988e8553563c" status: 200 len: 1276 microversion: 2.1 time: 0.090541 Sep 14 08:52:39.867586 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 544/1064] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:39 2022] GET /compute/v2.1/servers/67f3a983-b33f-49c8-9c91-988e8553563c => generated 1276 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:52:39.919954 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-41387842-7992-45dc-a504-7c9c3227f8a4 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:39.920769 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-41387842-7992-45dc-a504-7c9c3227f8a4 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: af183467-9304-4c73-a29f-196e76ba21b5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:39.927628 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-41387842-7992-45dc-a504-7c9c3227f8a4 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:39.928189 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-41387842-7992-45dc-a504-7c9c3227f8a4 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:39.928627 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-41387842-7992-45dc-a504-7c9c3227f8a4 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:39.929361 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-41387842-7992-45dc-a504-7c9c3227f8a4 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:39.930077 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-41387842-7992-45dc-a504-7c9c3227f8a4 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:39.930514 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-41387842-7992-45dc-a504-7c9c3227f8a4 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:40.065418 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-41387842-7992-45dc-a504-7c9c3227f8a4 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:40.074111 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-41387842-7992-45dc-a504-7c9c3227f8a4 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/af183467-9304-4c73-a29f-196e76ba21b5" status: 200 len: 1469 microversion: 2.1 time: 0.158142 Sep 14 08:52:40.074777 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 521/1065] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:39 2022] GET /compute/v2.1/servers/af183467-9304-4c73-a29f-196e76ba21b5 => generated 1469 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:52:40.098216 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-2e17a53f-8a67-4d6b-907f-f5d7e725007f tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:52:40.098756 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-2e17a53f-8a67-4d6b-907f-f5d7e725007f tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: af183467-9304-4c73-a29f-196e76ba21b5] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:40.105232 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2e17a53f-8a67-4d6b-907f-f5d7e725007f tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:40.105720 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2e17a53f-8a67-4d6b-907f-f5d7e725007f tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:40.106212 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2e17a53f-8a67-4d6b-907f-f5d7e725007f tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:40.106828 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2e17a53f-8a67-4d6b-907f-f5d7e725007f tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:40.107311 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2e17a53f-8a67-4d6b-907f-f5d7e725007f tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:40.107741 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2e17a53f-8a67-4d6b-907f-f5d7e725007f tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:40.154604 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2e17a53f-8a67-4d6b-907f-f5d7e725007f tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:40.155136 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2e17a53f-8a67-4d6b-907f-f5d7e725007f tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:40.155573 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2e17a53f-8a67-4d6b-907f-f5d7e725007f tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:40.156302 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2e17a53f-8a67-4d6b-907f-f5d7e725007f tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:40.156758 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2e17a53f-8a67-4d6b-907f-f5d7e725007f tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:40.157188 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2e17a53f-8a67-4d6b-907f-f5d7e725007f tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:40.184390 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-2e17a53f-8a67-4d6b-907f-f5d7e725007f tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Getting quotas for project 8fd62edd611c4390be2403972b99aa15. Resources: {'cores', 'ram'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 08:52:40.189576 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-2e17a53f-8a67-4d6b-907f-f5d7e725007f tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Getting quotas for user 264fb30236d54248ad0ecf79a177849f and project 8fd62edd611c4390be2403972b99aa15. Resources: {'cores', 'ram'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 08:52:40.297343 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-2e17a53f-8a67-4d6b-907f-f5d7e725007f tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "POST /compute/v2.1/servers/af183467-9304-4c73-a29f-196e76ba21b5/action" status: 202 len: 0 microversion: 2.1 time: 0.202809 Sep 14 08:52:40.298744 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 545/1066] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 08:52:40 2022] POST /compute/v2.1/servers/af183467-9304-4c73-a29f-196e76ba21b5/action => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 08:52:40.308185 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-958f1940-8ad2-4dec-adf3-f70abaf816c1 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:40.308821 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-958f1940-8ad2-4dec-adf3-f70abaf816c1 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: af183467-9304-4c73-a29f-196e76ba21b5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:40.315036 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-958f1940-8ad2-4dec-adf3-f70abaf816c1 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:40.315643 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-958f1940-8ad2-4dec-adf3-f70abaf816c1 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:40.316162 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-958f1940-8ad2-4dec-adf3-f70abaf816c1 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:40.316965 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-958f1940-8ad2-4dec-adf3-f70abaf816c1 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:40.317540 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-958f1940-8ad2-4dec-adf3-f70abaf816c1 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:40.318069 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-958f1940-8ad2-4dec-adf3-f70abaf816c1 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:40.527279 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-958f1940-8ad2-4dec-adf3-f70abaf816c1 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:40.535646 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-958f1940-8ad2-4dec-adf3-f70abaf816c1 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/af183467-9304-4c73-a29f-196e76ba21b5" status: 200 len: 1468 microversion: 2.1 time: 0.231955 Sep 14 08:52:40.536854 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 522/1067] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:40 2022] GET /compute/v2.1/servers/af183467-9304-4c73-a29f-196e76ba21b5 => generated 1468 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:52:40.613563 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-400590a9-018a-4566-aae6-8ee3532ff76f tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:40.614499 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-400590a9-018a-4566-aae6-8ee3532ff76f tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] [instance: 42265ff9-9c1f-45b6-b92d-0b23de43a8d0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:40.621271 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-400590a9-018a-4566-aae6-8ee3532ff76f tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:40.621831 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-400590a9-018a-4566-aae6-8ee3532ff76f tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:40.622596 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-400590a9-018a-4566-aae6-8ee3532ff76f tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:40.623333 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-400590a9-018a-4566-aae6-8ee3532ff76f tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:40.623927 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-400590a9-018a-4566-aae6-8ee3532ff76f tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:40.624475 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-400590a9-018a-4566-aae6-8ee3532ff76f tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:40.654780 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b231cfcb-4aaf-4da3-85d5-c521082af62d tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:40.656700 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-b231cfcb-4aaf-4da3-85d5-c521082af62d tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: 2098e0b9-b628-4b9e-979b-960c68830fee] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:40.658957 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-400590a9-018a-4566-aae6-8ee3532ff76f tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:40.659738 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-400590a9-018a-4566-aae6-8ee3532ff76f tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:40.660076 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-400590a9-018a-4566-aae6-8ee3532ff76f tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:40.660593 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.objects.instance [None req-400590a9-018a-4566-aae6-8ee3532ff76f tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lazy-loading 'fault' on Instance uuid 42265ff9-9c1f-45b6-b92d-0b23de43a8d0 {{(pid=128759) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 08:52:40.670778 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b231cfcb-4aaf-4da3-85d5-c521082af62d tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:40.671264 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b231cfcb-4aaf-4da3-85d5-c521082af62d tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:40.671633 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b231cfcb-4aaf-4da3-85d5-c521082af62d tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:40.672296 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b231cfcb-4aaf-4da3-85d5-c521082af62d tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:40.672770 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b231cfcb-4aaf-4da3-85d5-c521082af62d tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:40.680574 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b231cfcb-4aaf-4da3-85d5-c521082af62d tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:40.742925 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-400590a9-018a-4566-aae6-8ee3532ff76f tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c7802984cf48d1852832b52abe52e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e326f95a9604fdb9bd075db3837cf62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:40.757395 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-400590a9-018a-4566-aae6-8ee3532ff76f tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] 10.222.0.60 "GET /compute/v2.1/servers/42265ff9-9c1f-45b6-b92d-0b23de43a8d0" status: 200 len: 1309 microversion: 2.1 time: 0.148640 Sep 14 08:52:40.758054 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 546/1068] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:40 2022] GET /compute/v2.1/servers/42265ff9-9c1f-45b6-b92d-0b23de43a8d0 => generated 1309 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:52:40.866071 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-b231cfcb-4aaf-4da3-85d5-c521082af62d tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:40.874575 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-b231cfcb-4aaf-4da3-85d5-c521082af62d tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/2098e0b9-b628-4b9e-979b-960c68830fee" status: 200 len: 1359 microversion: 2.1 time: 0.230321 Sep 14 08:52:40.875751 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 523/1069] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:40 2022] GET /compute/v2.1/servers/2098e0b9-b628-4b9e-979b-960c68830fee => generated 1359 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:52:40.890156 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e9675069-36b9-4d90-8eaa-ec51a8467db8 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:40.890871 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e9675069-36b9-4d90-8eaa-ec51a8467db8 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] [instance: 67f3a983-b33f-49c8-9c91-988e8553563c] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:40.902214 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e9675069-36b9-4d90-8eaa-ec51a8467db8 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:40.902967 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e9675069-36b9-4d90-8eaa-ec51a8467db8 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:40.903487 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e9675069-36b9-4d90-8eaa-ec51a8467db8 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:40.908438 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e9675069-36b9-4d90-8eaa-ec51a8467db8 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:40.909147 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e9675069-36b9-4d90-8eaa-ec51a8467db8 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:40.910646 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e9675069-36b9-4d90-8eaa-ec51a8467db8 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:40.995858 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-e9675069-36b9-4d90-8eaa-ec51a8467db8 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ace9012a7c4ce59c01858b6984b766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a87a909133e42e1a82e3a623536935c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:41.006599 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e9675069-36b9-4d90-8eaa-ec51a8467db8 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] 10.222.0.60 "GET /compute/v2.1/servers/67f3a983-b33f-49c8-9c91-988e8553563c" status: 200 len: 1276 microversion: 2.1 time: 0.119866 Sep 14 08:52:41.007941 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 547/1070] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:40 2022] GET /compute/v2.1/servers/67f3a983-b33f-49c8-9c91-988e8553563c => generated 1276 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:52:41.162718 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-d46c4384-0f64-412e-a5d2-23517d55f1f0 req-026fc3a6-1dff-438c-9242-2ff77e2133e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af183467-9304-4c73-a29f-196e76ba21b5", "name": "network-vif-plugged", "status": "completed", "tag": "9664d857-e4a0-4edd-b5e2-e3a3058cb696"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:52:41.173865 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-d46c4384-0f64-412e-a5d2-23517d55f1f0 req-026fc3a6-1dff-438c-9242-2ff77e2133e2 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:41.174349 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-d46c4384-0f64-412e-a5d2-23517d55f1f0 req-026fc3a6-1dff-438c-9242-2ff77e2133e2 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:41.174982 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-d46c4384-0f64-412e-a5d2-23517d55f1f0 req-026fc3a6-1dff-438c-9242-2ff77e2133e2 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:41.189775 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-d46c4384-0f64-412e-a5d2-23517d55f1f0 req-026fc3a6-1dff-438c-9242-2ff77e2133e2 service nova] Creating event network-vif-plugged:9664d857-e4a0-4edd-b5e2-e3a3058cb696 for instance af183467-9304-4c73-a29f-196e76ba21b5 on n-h1-836830-18 Sep 14 08:52:41.199098 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [req-d46c4384-0f64-412e-a5d2-23517d55f1f0 req-026fc3a6-1dff-438c-9242-2ff77e2133e2 service nova] Instance af183467-9304-4c73-a29f-196e76ba21b5 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-836830-18'} {{(pid=128758) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 14 08:52:41.206685 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-d46c4384-0f64-412e-a5d2-23517d55f1f0 req-026fc3a6-1dff-438c-9242-2ff77e2133e2 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047747 Sep 14 08:52:41.207554 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 524/1071] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:52:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:52:41.567217 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d1c2013c-660d-449f-83e0-abe99a362042 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:41.585954 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-d1c2013c-660d-449f-83e0-abe99a362042 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: af183467-9304-4c73-a29f-196e76ba21b5] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:41.599384 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d1c2013c-660d-449f-83e0-abe99a362042 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:41.600421 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d1c2013c-660d-449f-83e0-abe99a362042 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:41.600868 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d1c2013c-660d-449f-83e0-abe99a362042 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:41.601577 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d1c2013c-660d-449f-83e0-abe99a362042 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:41.602036 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d1c2013c-660d-449f-83e0-abe99a362042 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:41.602468 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d1c2013c-660d-449f-83e0-abe99a362042 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:41.794248 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-9b56990b-cf1a-4f19-9bf5-18167869ef88 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:41.802419 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-d1c2013c-660d-449f-83e0-abe99a362042 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:41.802861 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-9b56990b-cf1a-4f19-9bf5-18167869ef88 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] [instance: 42265ff9-9c1f-45b6-b92d-0b23de43a8d0] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:41.825640 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d1c2013c-660d-449f-83e0-abe99a362042 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/af183467-9304-4c73-a29f-196e76ba21b5" status: 200 len: 1468 microversion: 2.1 time: 0.261980 Sep 14 08:52:41.829223 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 548/1072] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:41 2022] GET /compute/v2.1/servers/af183467-9304-4c73-a29f-196e76ba21b5 => generated 1468 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:52:41.841753 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9b56990b-cf1a-4f19-9bf5-18167869ef88 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:41.842571 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9b56990b-cf1a-4f19-9bf5-18167869ef88 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:41.843292 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9b56990b-cf1a-4f19-9bf5-18167869ef88 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:41.847970 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9b56990b-cf1a-4f19-9bf5-18167869ef88 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:41.849639 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9b56990b-cf1a-4f19-9bf5-18167869ef88 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:41.851384 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9b56990b-cf1a-4f19-9bf5-18167869ef88 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:41.873782 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-9b56990b-cf1a-4f19-9bf5-18167869ef88 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] HTTP exception thrown: Instance 42265ff9-9c1f-45b6-b92d-0b23de43a8d0 could not be found. Sep 14 08:52:41.875641 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-9b56990b-cf1a-4f19-9bf5-18167869ef88 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Request method failure captured: Sep 14 08:52:41.875641 n-d-836830-18 devstack@n-api.service[128758]: request: GET /compute/v2.1/servers/42265ff9-9c1f-45b6-b92d-0b23de43a8d0 HTTP/1.1 Sep 14 08:52:41.875641 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 08:52:41.875641 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 08:52:41.875641 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 08:52:41.875641 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 08:52:41.875641 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 08:52:41.875641 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 08:52:41.875641 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 08:52:41.875641 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 08:52:41.875641 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZWCl-PBW4XwTIAlm_HDzFNUEwKCR-QX8kRMQlkDQ28-th7Hv5Ami7B5CdfKebuOcYBY8pBDcErYnw6Yoo-AEMZOR30AfoQXWHysSwGGQuX7FJimJhZb77LDAXJX1PJ_CPAwODcQceVHue0gK59ez0nQzHL0ZkFBiu-KQzoh7YQB5n0 Sep 14 08:52:41.875641 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 08:52:41.875641 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 08:52:41.875641 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 08:52:41.875641 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 08:52:41.875641 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 08:52:41.875641 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 08:52:41.875641 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 5e326f95a9604fdb9bd075db3837cf62 Sep 14 08:52:41.875641 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-ServersOnMultiNodesTest-1258517383 Sep 14 08:52:41.875641 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 08:52:41.875641 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 08:52:41.877433 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/5e326f95a9604fdb9bd075db3837cf62"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_5e326f95a9604fdb9bd075db3837cf62"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5e326f95a9604fdb9bd075db3837cf62"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5e326f95a9604fdb9bd075db3837cf62"}]}] Sep 14 08:52:41.877433 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-ServersOnMultiNodesTest-1258517383 Sep 14 08:52:41.877433 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 5e326f95a9604fdb9bd075db3837cf62 Sep 14 08:52:41.877433 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1258517383 Sep 14 08:52:41.877433 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-ServersOnMultiNodesTest-1258517383-project Sep 14 08:52:41.877433 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 08:52:41.877433 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 08:52:41.877433 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 89c7802984cf48d1852832b52abe52e9 Sep 14 08:52:41.877433 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-ServersOnMultiNodesTest-1258517383-project Sep 14 08:52:41.877433 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 08:52:41.877433 n-d-836830-18 devstack@n-api.service[128758]: exception: Instance 42265ff9-9c1f-45b6-b92d-0b23de43a8d0 could not be found. Sep 14 08:52:41.877433 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': '42265ff9-9c1f-45b6-b92d-0b23de43a8d0'} Sep 14 08:52:41.878363 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:52:41.878363 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:52:41.878363 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 08:52:41.878363 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 08:52:41.878363 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 08:52:41.878363 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 08:52:41.878363 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 08:52:41.878363 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 08:52:41.878363 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 08:52:41.878363 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 08:52:41.878363 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42265ff9-9c1f-45b6-b92d-0b23de43a8d0 could not be found. Sep 14 08:52:41.878363 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:52:41.878363 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:52:41.878363 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:52:41.878363 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:52:41.878363 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:52:41.878363 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:52:41.878363 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:52:41.878363 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:52:41.878363 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:52:41.880002 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:52:41.880002 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 08:52:41.880002 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 08:52:41.880002 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 08:52:41.880002 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 08:52:41.880002 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 08:52:41.880002 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 08:52:41.880002 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42265ff9-9c1f-45b6-b92d-0b23de43a8d0 could not be found. Sep 14 08:52:41.880002 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:52:41.880002 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:52:41.880002 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:52:41.880002 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:52:41.880002 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:52:41.880002 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:52:41.880002 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:52:41.880002 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:52:41.880002 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42265ff9-9c1f-45b6-b92d-0b23de43a8d0 could not be found. Sep 14 08:52:41.880002 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:52:41.881464 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-9b56990b-cf1a-4f19-9bf5-18167869ef88 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Returning 404 to user: Instance 42265ff9-9c1f-45b6-b92d-0b23de43a8d0 could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:52:41.881986 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-9b56990b-cf1a-4f19-9bf5-18167869ef88 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] 10.222.0.60 "GET /compute/v2.1/servers/42265ff9-9c1f-45b6-b92d-0b23de43a8d0" status: 404 len: 111 microversion: 2.1 time: 0.104885 Sep 14 08:52:41.882714 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 525/1073] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:41 2022] GET /compute/v2.1/servers/42265ff9-9c1f-45b6-b92d-0b23de43a8d0 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 08:52:41.898746 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-8eb435e0-ff1e-4b97-aafb-5ec921c55f14 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:41.899642 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-8eb435e0-ff1e-4b97-aafb-5ec921c55f14 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: 2098e0b9-b628-4b9e-979b-960c68830fee] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:41.907393 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8eb435e0-ff1e-4b97-aafb-5ec921c55f14 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:41.908264 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8eb435e0-ff1e-4b97-aafb-5ec921c55f14 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:41.909046 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8eb435e0-ff1e-4b97-aafb-5ec921c55f14 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:41.909908 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8eb435e0-ff1e-4b97-aafb-5ec921c55f14 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:41.910521 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8eb435e0-ff1e-4b97-aafb-5ec921c55f14 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:41.911131 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8eb435e0-ff1e-4b97-aafb-5ec921c55f14 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:41.918437 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-7c792b68-f7c5-4161-95ac-c996fd7b39c1 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:41.919461 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-7c792b68-f7c5-4161-95ac-c996fd7b39c1 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] [instance: 3f9e2d1a-9899-4046-b2af-939db32442b7] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:41.933407 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7c792b68-f7c5-4161-95ac-c996fd7b39c1 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:41.934178 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7c792b68-f7c5-4161-95ac-c996fd7b39c1 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:41.937214 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7c792b68-f7c5-4161-95ac-c996fd7b39c1 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:41.938784 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7c792b68-f7c5-4161-95ac-c996fd7b39c1 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:41.939480 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7c792b68-f7c5-4161-95ac-c996fd7b39c1 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:41.940122 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7c792b68-f7c5-4161-95ac-c996fd7b39c1 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:41.961359 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-7c792b68-f7c5-4161-95ac-c996fd7b39c1 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] HTTP exception thrown: Instance 3f9e2d1a-9899-4046-b2af-939db32442b7 could not be found. Sep 14 08:52:41.963320 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-7c792b68-f7c5-4161-95ac-c996fd7b39c1 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Request method failure captured: Sep 14 08:52:41.963320 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/3f9e2d1a-9899-4046-b2af-939db32442b7 HTTP/1.1 Sep 14 08:52:41.963320 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 08:52:41.963320 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 08:52:41.963320 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 08:52:41.963320 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 08:52:41.963320 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 08:52:41.963320 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 08:52:41.963320 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 08:52:41.963320 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 08:52:41.963320 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZWCl-PBW4XwTIAlm_HDzFNUEwKCR-QX8kRMQlkDQ28-th7Hv5Ami7B5CdfKebuOcYBY8pBDcErYnw6Yoo-AEMZOR30AfoQXWHysSwGGQuX7FJimJhZb77LDAXJX1PJ_CPAwODcQceVHue0gK59ez0nQzHL0ZkFBiu-KQzoh7YQB5n0 Sep 14 08:52:41.963320 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 08:52:41.963320 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 08:52:41.963320 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 08:52:41.963320 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 08:52:41.963320 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 08:52:41.963320 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 08:52:41.963320 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 5e326f95a9604fdb9bd075db3837cf62 Sep 14 08:52:41.963320 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ServersOnMultiNodesTest-1258517383 Sep 14 08:52:41.963320 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 08:52:41.963320 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 08:52:41.964724 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/5e326f95a9604fdb9bd075db3837cf62"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_5e326f95a9604fdb9bd075db3837cf62"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5e326f95a9604fdb9bd075db3837cf62"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5e326f95a9604fdb9bd075db3837cf62"}]}] Sep 14 08:52:41.964724 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ServersOnMultiNodesTest-1258517383 Sep 14 08:52:41.964724 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 5e326f95a9604fdb9bd075db3837cf62 Sep 14 08:52:41.964724 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1258517383 Sep 14 08:52:41.964724 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ServersOnMultiNodesTest-1258517383-project Sep 14 08:52:41.964724 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 08:52:41.964724 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 08:52:41.964724 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 89c7802984cf48d1852832b52abe52e9 Sep 14 08:52:41.964724 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ServersOnMultiNodesTest-1258517383-project Sep 14 08:52:41.964724 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 08:52:41.964724 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance 3f9e2d1a-9899-4046-b2af-939db32442b7 could not be found. Sep 14 08:52:41.964724 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '3f9e2d1a-9899-4046-b2af-939db32442b7'} Sep 14 08:52:41.965583 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:52:41.965583 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:52:41.965583 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 08:52:41.965583 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 08:52:41.965583 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 08:52:41.965583 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 08:52:41.965583 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 08:52:41.965583 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 08:52:41.965583 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 08:52:41.965583 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 08:52:41.965583 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f9e2d1a-9899-4046-b2af-939db32442b7 could not be found. Sep 14 08:52:41.965583 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:52:41.965583 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:52:41.965583 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:52:41.965583 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:52:41.965583 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:52:41.965583 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:52:41.965583 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:52:41.965583 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:52:41.965583 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:52:41.967046 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:52:41.967046 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 08:52:41.967046 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 08:52:41.967046 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 08:52:41.967046 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 08:52:41.967046 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 08:52:41.967046 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 08:52:41.967046 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f9e2d1a-9899-4046-b2af-939db32442b7 could not be found. Sep 14 08:52:41.967046 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:52:41.967046 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:52:41.967046 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:52:41.967046 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:52:41.967046 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:52:41.967046 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:52:41.967046 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:52:41.967046 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:52:41.967046 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f9e2d1a-9899-4046-b2af-939db32442b7 could not be found. Sep 14 08:52:41.967046 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:52:41.969030 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-7c792b68-f7c5-4161-95ac-c996fd7b39c1 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Returning 404 to user: Instance 3f9e2d1a-9899-4046-b2af-939db32442b7 could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:52:41.970035 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-7c792b68-f7c5-4161-95ac-c996fd7b39c1 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] 10.222.0.60 "GET /compute/v2.1/servers/3f9e2d1a-9899-4046-b2af-939db32442b7" status: 404 len: 111 microversion: 2.1 time: 0.083116 Sep 14 08:52:41.974160 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 549/1074] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:41 2022] GET /compute/v2.1/servers/3f9e2d1a-9899-4046-b2af-939db32442b7 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 08:52:41.979789 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-81c372d0-75b7-4281-9164-d1ca9cbce85d tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:42.030105 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-81c372d0-75b7-4281-9164-d1ca9cbce85d tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] 10.222.0.60 "DELETE /compute/v2.1/os-server-groups/8d4e2809-5c95-42e0-8d35-a7c2aa5ab958" status: 204 len: 0 microversion: 2.1 time: 0.054079 Sep 14 08:52:42.035675 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 550/1075] 10.222.0.60 () {58 vars in 1266 bytes} [Wed Sep 14 08:52:41 2022] DELETE /compute/v2.1/os-server-groups/8d4e2809-5c95-42e0-8d35-a7c2aa5ab958 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 08:52:42.047092 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8c414e34-bd2f-4a1d-9d6e-0c230542cf9d tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:42.048043 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-8c414e34-bd2f-4a1d-9d6e-0c230542cf9d tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] [instance: 67f3a983-b33f-49c8-9c91-988e8553563c] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:42.055558 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8c414e34-bd2f-4a1d-9d6e-0c230542cf9d tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:42.056309 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8c414e34-bd2f-4a1d-9d6e-0c230542cf9d tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:42.056926 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8c414e34-bd2f-4a1d-9d6e-0c230542cf9d tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:42.057800 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8c414e34-bd2f-4a1d-9d6e-0c230542cf9d tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:42.058425 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8c414e34-bd2f-4a1d-9d6e-0c230542cf9d tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:42.059033 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8c414e34-bd2f-4a1d-9d6e-0c230542cf9d tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:42.141304 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-8eb435e0-ff1e-4b97-aafb-5ec921c55f14 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:42.143391 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-8c414e34-bd2f-4a1d-9d6e-0c230542cf9d tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ace9012a7c4ce59c01858b6984b766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a87a909133e42e1a82e3a623536935c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:42.150192 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-8eb435e0-ff1e-4b97-aafb-5ec921c55f14 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/2098e0b9-b628-4b9e-979b-960c68830fee" status: 200 len: 1359 microversion: 2.1 time: 0.255718 Sep 14 08:52:42.150931 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 526/1076] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:41 2022] GET /compute/v2.1/servers/2098e0b9-b628-4b9e-979b-960c68830fee => generated 1359 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:52:42.152073 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-8c414e34-bd2f-4a1d-9d6e-0c230542cf9d tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] 10.222.0.60 "GET /compute/v2.1/servers/67f3a983-b33f-49c8-9c91-988e8553563c" status: 200 len: 1276 microversion: 2.1 time: 0.115120 Sep 14 08:52:42.153027 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 551/1077] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:42 2022] GET /compute/v2.1/servers/67f3a983-b33f-49c8-9c91-988e8553563c => generated 1276 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:52:42.156931 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-8aba8896-126b-4df2-a8d4-9e7b58350ea1 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:42.157653 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-8aba8896-126b-4df2-a8d4-9e7b58350ea1 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] [instance: 9507f778-dd44-4db1-b36e-fecd603b2487] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:42.163946 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8aba8896-126b-4df2-a8d4-9e7b58350ea1 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:42.164758 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8aba8896-126b-4df2-a8d4-9e7b58350ea1 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:42.165418 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8aba8896-126b-4df2-a8d4-9e7b58350ea1 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:42.166356 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8aba8896-126b-4df2-a8d4-9e7b58350ea1 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:42.167057 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8aba8896-126b-4df2-a8d4-9e7b58350ea1 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:42.167658 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8aba8896-126b-4df2-a8d4-9e7b58350ea1 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:42.195728 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-8aba8896-126b-4df2-a8d4-9e7b58350ea1 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] [instance: 9507f778-dd44-4db1-b36e-fecd603b2487] Going to try to terminate instance {{(pid=128758) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 08:52:42.280310 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-8aba8896-126b-4df2-a8d4-9e7b58350ea1 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] 10.222.0.60 "DELETE /compute/v2.1/servers/9507f778-dd44-4db1-b36e-fecd603b2487" status: 204 len: 0 microversion: 2.1 time: 0.127870 Sep 14 08:52:42.281381 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 527/1078] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 08:52:42 2022] DELETE /compute/v2.1/servers/9507f778-dd44-4db1-b36e-fecd603b2487 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 08:52:42.289528 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c9e44e66-c258-4c5a-8d5f-1637734c8aa1 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:42.290034 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-c9e44e66-c258-4c5a-8d5f-1637734c8aa1 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] [instance: 3acd19ba-a5b9-4bac-a4a3-2c274448c374] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:42.295956 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c9e44e66-c258-4c5a-8d5f-1637734c8aa1 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:42.296433 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c9e44e66-c258-4c5a-8d5f-1637734c8aa1 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:42.296872 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c9e44e66-c258-4c5a-8d5f-1637734c8aa1 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:42.297582 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c9e44e66-c258-4c5a-8d5f-1637734c8aa1 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:42.298028 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c9e44e66-c258-4c5a-8d5f-1637734c8aa1 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:42.298642 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c9e44e66-c258-4c5a-8d5f-1637734c8aa1 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:42.325013 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-c9e44e66-c258-4c5a-8d5f-1637734c8aa1 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] [instance: 3acd19ba-a5b9-4bac-a4a3-2c274448c374] Going to try to terminate instance {{(pid=128759) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 08:52:42.385774 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:52:42.419476 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-c9e44e66-c258-4c5a-8d5f-1637734c8aa1 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] 10.222.0.60 "DELETE /compute/v2.1/servers/3acd19ba-a5b9-4bac-a4a3-2c274448c374" status: 204 len: 0 microversion: 2.1 time: 0.133234 Sep 14 08:52:42.420378 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 552/1079] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 08:52:42 2022] DELETE /compute/v2.1/servers/3acd19ba-a5b9-4bac-a4a3-2c274448c374 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 14 08:52:42.429336 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a319dbb6-5aef-4552-8e6c-e5fdf34835ca tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:42.430671 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-a319dbb6-5aef-4552-8e6c-e5fdf34835ca tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] [instance: 9507f778-dd44-4db1-b36e-fecd603b2487] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:42.437646 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a319dbb6-5aef-4552-8e6c-e5fdf34835ca tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:42.438254 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a319dbb6-5aef-4552-8e6c-e5fdf34835ca tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:42.438921 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a319dbb6-5aef-4552-8e6c-e5fdf34835ca tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:42.439835 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a319dbb6-5aef-4552-8e6c-e5fdf34835ca tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:42.440500 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a319dbb6-5aef-4552-8e6c-e5fdf34835ca tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:42.443848 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a319dbb6-5aef-4552-8e6c-e5fdf34835ca tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:42.696237 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-a319dbb6-5aef-4552-8e6c-e5fdf34835ca tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c7802984cf48d1852832b52abe52e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e326f95a9604fdb9bd075db3837cf62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:42.704711 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-a319dbb6-5aef-4552-8e6c-e5fdf34835ca tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] 10.222.0.60 "GET /compute/v2.1/servers/9507f778-dd44-4db1-b36e-fecd603b2487" status: 200 len: 1475 microversion: 2.1 time: 0.280076 Sep 14 08:52:42.706612 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 528/1080] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:42 2022] GET /compute/v2.1/servers/9507f778-dd44-4db1-b36e-fecd603b2487 => generated 1475 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:52:42.860455 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-6e9a30f7-79f9-4b20-99b8-f0341e528b19 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:42.862733 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-6e9a30f7-79f9-4b20-99b8-f0341e528b19 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: af183467-9304-4c73-a29f-196e76ba21b5] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:42.874006 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6e9a30f7-79f9-4b20-99b8-f0341e528b19 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:42.876557 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6e9a30f7-79f9-4b20-99b8-f0341e528b19 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:42.877311 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6e9a30f7-79f9-4b20-99b8-f0341e528b19 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:42.878225 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6e9a30f7-79f9-4b20-99b8-f0341e528b19 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:42.878850 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6e9a30f7-79f9-4b20-99b8-f0341e528b19 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:42.880349 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6e9a30f7-79f9-4b20-99b8-f0341e528b19 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:43.152124 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-6e9a30f7-79f9-4b20-99b8-f0341e528b19 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:43.176623 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-4c3c9939-dfc1-4d6d-b6b6-fe0cc59cc7d1 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:43.180372 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-4c3c9939-dfc1-4d6d-b6b6-fe0cc59cc7d1 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: 2098e0b9-b628-4b9e-979b-960c68830fee] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:43.210823 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4c3c9939-dfc1-4d6d-b6b6-fe0cc59cc7d1 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:43.213675 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4c3c9939-dfc1-4d6d-b6b6-fe0cc59cc7d1 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:43.217162 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4c3c9939-dfc1-4d6d-b6b6-fe0cc59cc7d1 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:43.220478 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4c3c9939-dfc1-4d6d-b6b6-fe0cc59cc7d1 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:43.220987 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4c3c9939-dfc1-4d6d-b6b6-fe0cc59cc7d1 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:43.221379 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-6e9a30f7-79f9-4b20-99b8-f0341e528b19 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/af183467-9304-4c73-a29f-196e76ba21b5" status: 200 len: 1468 microversion: 2.1 time: 0.369527 Sep 14 08:52:43.241489 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 553/1081] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:42 2022] GET /compute/v2.1/servers/af183467-9304-4c73-a29f-196e76ba21b5 => generated 1468 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:52:43.244768 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4c3c9939-dfc1-4d6d-b6b6-fe0cc59cc7d1 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:43.261406 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-5cf0a1f6-0b75-4746-962e-b516a4299a10 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:43.263598 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-5cf0a1f6-0b75-4746-962e-b516a4299a10 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] [instance: 67f3a983-b33f-49c8-9c91-988e8553563c] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:43.278549 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5cf0a1f6-0b75-4746-962e-b516a4299a10 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:43.283312 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5cf0a1f6-0b75-4746-962e-b516a4299a10 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:43.283824 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5cf0a1f6-0b75-4746-962e-b516a4299a10 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:43.284565 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5cf0a1f6-0b75-4746-962e-b516a4299a10 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:43.285105 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5cf0a1f6-0b75-4746-962e-b516a4299a10 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:43.285434 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5cf0a1f6-0b75-4746-962e-b516a4299a10 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:43.465563 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-5cf0a1f6-0b75-4746-962e-b516a4299a10 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ace9012a7c4ce59c01858b6984b766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a87a909133e42e1a82e3a623536935c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:43.480839 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-5cf0a1f6-0b75-4746-962e-b516a4299a10 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] 10.222.0.60 "GET /compute/v2.1/servers/67f3a983-b33f-49c8-9c91-988e8553563c" status: 200 len: 1282 microversion: 2.1 time: 0.236830 Sep 14 08:52:43.496914 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 554/1082] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:43 2022] GET /compute/v2.1/servers/67f3a983-b33f-49c8-9c91-988e8553563c => generated 1282 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:52:43.564327 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-4c3c9939-dfc1-4d6d-b6b6-fe0cc59cc7d1 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:43.573338 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-4c3c9939-dfc1-4d6d-b6b6-fe0cc59cc7d1 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/2098e0b9-b628-4b9e-979b-960c68830fee" status: 200 len: 1359 microversion: 2.1 time: 0.401120 Sep 14 08:52:43.587896 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 529/1083] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:43 2022] GET /compute/v2.1/servers/2098e0b9-b628-4b9e-979b-960c68830fee => generated 1359 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:52:43.730026 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e67b2865-fdbb-4f07-aed3-313bf7b54fce tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:43.731087 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e67b2865-fdbb-4f07-aed3-313bf7b54fce tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] [instance: 9507f778-dd44-4db1-b36e-fecd603b2487] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:43.742846 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e67b2865-fdbb-4f07-aed3-313bf7b54fce tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:43.743452 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e67b2865-fdbb-4f07-aed3-313bf7b54fce tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:43.743897 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e67b2865-fdbb-4f07-aed3-313bf7b54fce tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:43.744614 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e67b2865-fdbb-4f07-aed3-313bf7b54fce tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:43.745083 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e67b2865-fdbb-4f07-aed3-313bf7b54fce tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:43.745515 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e67b2865-fdbb-4f07-aed3-313bf7b54fce tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:43.996942 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-e67b2865-fdbb-4f07-aed3-313bf7b54fce tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c7802984cf48d1852832b52abe52e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e326f95a9604fdb9bd075db3837cf62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:44.006410 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e67b2865-fdbb-4f07-aed3-313bf7b54fce tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] 10.222.0.60 "GET /compute/v2.1/servers/9507f778-dd44-4db1-b36e-fecd603b2487" status: 200 len: 1475 microversion: 2.1 time: 0.280463 Sep 14 08:52:44.007583 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 555/1084] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:43 2022] GET /compute/v2.1/servers/9507f778-dd44-4db1-b36e-fecd603b2487 => generated 1475 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:52:44.253424 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-72a35b54-42f9-4ad5-81b7-ba84b6447bce tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:44.254141 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-72a35b54-42f9-4ad5-81b7-ba84b6447bce tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: af183467-9304-4c73-a29f-196e76ba21b5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:44.264212 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-72a35b54-42f9-4ad5-81b7-ba84b6447bce tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:44.264956 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-72a35b54-42f9-4ad5-81b7-ba84b6447bce tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:44.265667 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-72a35b54-42f9-4ad5-81b7-ba84b6447bce tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:44.266555 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-72a35b54-42f9-4ad5-81b7-ba84b6447bce tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:44.267222 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-72a35b54-42f9-4ad5-81b7-ba84b6447bce tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:44.267814 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-72a35b54-42f9-4ad5-81b7-ba84b6447bce tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:44.448337 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-72a35b54-42f9-4ad5-81b7-ba84b6447bce tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:44.458767 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-72a35b54-42f9-4ad5-81b7-ba84b6447bce tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/af183467-9304-4c73-a29f-196e76ba21b5" status: 200 len: 1468 microversion: 2.1 time: 0.212651 Sep 14 08:52:44.459732 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 530/1085] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:44 2022] GET /compute/v2.1/servers/af183467-9304-4c73-a29f-196e76ba21b5 => generated 1468 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:52:44.508593 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-719db9e5-3ed6-45f4-8a07-f7870789dce3 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:44.509132 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-719db9e5-3ed6-45f4-8a07-f7870789dce3 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] [instance: 67f3a983-b33f-49c8-9c91-988e8553563c] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:44.514568 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=1,nova_api:DELETE=6,nova_api:UPDATE=2 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:52:44.516667 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-719db9e5-3ed6-45f4-8a07-f7870789dce3 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:44.517160 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-719db9e5-3ed6-45f4-8a07-f7870789dce3 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:44.517881 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-719db9e5-3ed6-45f4-8a07-f7870789dce3 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:44.518854 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-719db9e5-3ed6-45f4-8a07-f7870789dce3 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:44.519759 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-719db9e5-3ed6-45f4-8a07-f7870789dce3 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:44.520399 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-719db9e5-3ed6-45f4-8a07-f7870789dce3 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:44.599990 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-08ebf38f-b001-4ffe-9cbc-aa5fa2e65574 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:44.600875 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-08ebf38f-b001-4ffe-9cbc-aa5fa2e65574 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: 2098e0b9-b628-4b9e-979b-960c68830fee] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:44.608946 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-08ebf38f-b001-4ffe-9cbc-aa5fa2e65574 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:44.609718 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-08ebf38f-b001-4ffe-9cbc-aa5fa2e65574 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:44.610475 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-08ebf38f-b001-4ffe-9cbc-aa5fa2e65574 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:44.611627 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-08ebf38f-b001-4ffe-9cbc-aa5fa2e65574 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:44.612327 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-08ebf38f-b001-4ffe-9cbc-aa5fa2e65574 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:44.614204 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-08ebf38f-b001-4ffe-9cbc-aa5fa2e65574 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:44.810986 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-719db9e5-3ed6-45f4-8a07-f7870789dce3 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ace9012a7c4ce59c01858b6984b766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a87a909133e42e1a82e3a623536935c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:44.823917 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-719db9e5-3ed6-45f4-8a07-f7870789dce3 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] 10.222.0.60 "GET /compute/v2.1/servers/67f3a983-b33f-49c8-9c91-988e8553563c" status: 200 len: 1324 microversion: 2.1 time: 0.319197 Sep 14 08:52:44.838689 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 556/1086] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:44 2022] GET /compute/v2.1/servers/67f3a983-b33f-49c8-9c91-988e8553563c => generated 1324 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:52:44.901247 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-08ebf38f-b001-4ffe-9cbc-aa5fa2e65574 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:44.909706 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-08ebf38f-b001-4ffe-9cbc-aa5fa2e65574 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/2098e0b9-b628-4b9e-979b-960c68830fee" status: 200 len: 1359 microversion: 2.1 time: 0.316057 Sep 14 08:52:44.914666 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 531/1087] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:44 2022] GET /compute/v2.1/servers/2098e0b9-b628-4b9e-979b-960c68830fee => generated 1359 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:52:45.029968 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-6ddc764b-21c8-4b62-84a5-54fd0a8f1420 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:45.031260 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-6ddc764b-21c8-4b62-84a5-54fd0a8f1420 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] [instance: 9507f778-dd44-4db1-b36e-fecd603b2487] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:45.050611 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6ddc764b-21c8-4b62-84a5-54fd0a8f1420 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:45.051167 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6ddc764b-21c8-4b62-84a5-54fd0a8f1420 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:45.051621 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6ddc764b-21c8-4b62-84a5-54fd0a8f1420 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:45.052450 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6ddc764b-21c8-4b62-84a5-54fd0a8f1420 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:45.052946 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6ddc764b-21c8-4b62-84a5-54fd0a8f1420 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:45.053372 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6ddc764b-21c8-4b62-84a5-54fd0a8f1420 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:45.707785 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-4ef35121-a31c-48e7-91ed-5f553389f251 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Action: 'create', calling method: .version_select at 0x7f7d44571790>, body: {"keypair": {"name": "tempest-keypair-1657974209", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHXOG5ofRXpOENqQBD7sXqbUORtjL/TmyQIh9h7gm5/hZRA2P0lF5u1jqA0RymnZqxtC6kU5fCUTlylewF6oKB6WBU5kT+6Jl1Z4b9qm2dB3N9UlhIdqATyWkxLPhLESwQ=="}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:52:45.728931 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=53 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:52:45.734787 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-4ef35121-a31c-48e7-91ed-5f553389f251 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Getting quotas for project 575684f36f9c4019926fc83541e152c0. Resources: {'key_pairs'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 08:52:45.744683 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-4ef35121-a31c-48e7-91ed-5f553389f251 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Getting quotas for user 9810376d6f0b4329abe0f8f79800b754 and project 575684f36f9c4019926fc83541e152c0. Resources: {'key_pairs'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 08:52:45.783229 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-4ef35121-a31c-48e7-91ed-5f553389f251 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.380096 Sep 14 08:52:45.784658 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 532/1088] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Sep 14 08:52:45 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 08:52:45.790742 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-cccfa244-7d1d-4bea-813d-f0e5d8ac8b9a tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:45.791742 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-cccfa244-7d1d-4bea-813d-f0e5d8ac8b9a tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: af183467-9304-4c73-a29f-196e76ba21b5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:45.801966 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cccfa244-7d1d-4bea-813d-f0e5d8ac8b9a tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:45.802847 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cccfa244-7d1d-4bea-813d-f0e5d8ac8b9a tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:45.803484 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cccfa244-7d1d-4bea-813d-f0e5d8ac8b9a tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:45.804557 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cccfa244-7d1d-4bea-813d-f0e5d8ac8b9a tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:45.805462 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cccfa244-7d1d-4bea-813d-f0e5d8ac8b9a tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:45.806050 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cccfa244-7d1d-4bea-813d-f0e5d8ac8b9a tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:46.139993 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-cccfa244-7d1d-4bea-813d-f0e5d8ac8b9a tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:46.166155 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-cccfa244-7d1d-4bea-813d-f0e5d8ac8b9a tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/af183467-9304-4c73-a29f-196e76ba21b5" status: 200 len: 1468 microversion: 2.1 time: 0.380051 Sep 14 08:52:46.167265 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 533/1089] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:45 2022] GET /compute/v2.1/servers/af183467-9304-4c73-a29f-196e76ba21b5 => generated 1468 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:52:46.189073 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-feadca82-1d66-4ae3-8b76-af1ef7f9e8a2 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:46.189901 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-feadca82-1d66-4ae3-8b76-af1ef7f9e8a2 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] [instance: 67f3a983-b33f-49c8-9c91-988e8553563c] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:46.211291 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-feadca82-1d66-4ae3-8b76-af1ef7f9e8a2 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:46.228581 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-feadca82-1d66-4ae3-8b76-af1ef7f9e8a2 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:46.233926 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-feadca82-1d66-4ae3-8b76-af1ef7f9e8a2 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:46.238844 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-feadca82-1d66-4ae3-8b76-af1ef7f9e8a2 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:46.241345 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-feadca82-1d66-4ae3-8b76-af1ef7f9e8a2 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:46.249676 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-feadca82-1d66-4ae3-8b76-af1ef7f9e8a2 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:46.253143 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=2 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:52:46.291613 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-6ddc764b-21c8-4b62-84a5-54fd0a8f1420 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c7802984cf48d1852832b52abe52e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e326f95a9604fdb9bd075db3837cf62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:46.313936 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-6ddc764b-21c8-4b62-84a5-54fd0a8f1420 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] 10.222.0.60 "GET /compute/v2.1/servers/9507f778-dd44-4db1-b36e-fecd603b2487" status: 200 len: 1475 microversion: 2.1 time: 1.287769 Sep 14 08:52:46.314547 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 557/1090] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:45 2022] GET /compute/v2.1/servers/9507f778-dd44-4db1-b36e-fecd603b2487 => generated 1475 bytes in 1289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:52:46.325350 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-94a7da30-2867-4a2e-9f0c-2e449b4e3738 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:46.326012 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-94a7da30-2867-4a2e-9f0c-2e449b4e3738 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: 2098e0b9-b628-4b9e-979b-960c68830fee] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:46.335989 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-94a7da30-2867-4a2e-9f0c-2e449b4e3738 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:46.336763 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-94a7da30-2867-4a2e-9f0c-2e449b4e3738 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:46.337468 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-94a7da30-2867-4a2e-9f0c-2e449b4e3738 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:46.338342 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-94a7da30-2867-4a2e-9f0c-2e449b4e3738 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:46.338996 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-94a7da30-2867-4a2e-9f0c-2e449b4e3738 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:46.339601 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-94a7da30-2867-4a2e-9f0c-2e449b4e3738 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:46.890336 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-94a7da30-2867-4a2e-9f0c-2e449b4e3738 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:46.899322 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-94a7da30-2867-4a2e-9f0c-2e449b4e3738 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/2098e0b9-b628-4b9e-979b-960c68830fee" status: 200 len: 1359 microversion: 2.1 time: 0.580200 Sep 14 08:52:46.905620 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 558/1091] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:46 2022] GET /compute/v2.1/servers/2098e0b9-b628-4b9e-979b-960c68830fee => generated 1359 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:52:46.912313 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-2df40a96-4538-4267-b3d8-1593f307235c req-227cfe37-e3b4-4fdc-b873-da0906544ee6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3acd19ba-a5b9-4bac-a4a3-2c274448c374", "name": "network-vif-deleted", "tag": "5370b892-fe15-4759-b6f3-2c8b78b6eb86"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:52:46.941382 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-2df40a96-4538-4267-b3d8-1593f307235c req-227cfe37-e3b4-4fdc-b873-da0906544ee6 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:46.942125 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-2df40a96-4538-4267-b3d8-1593f307235c req-227cfe37-e3b4-4fdc-b873-da0906544ee6 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:46.942762 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-2df40a96-4538-4267-b3d8-1593f307235c req-227cfe37-e3b4-4fdc-b873-da0906544ee6 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:46.970407 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-2df40a96-4538-4267-b3d8-1593f307235c req-227cfe37-e3b4-4fdc-b873-da0906544ee6 service nova] Creating event network-vif-deleted:5370b892-fe15-4759-b6f3-2c8b78b6eb86 for instance 3acd19ba-a5b9-4bac-a4a3-2c274448c374 on n-h2-836830-18 Sep 14 08:52:46.985142 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-2df40a96-4538-4267-b3d8-1593f307235c req-227cfe37-e3b4-4fdc-b873-da0906544ee6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077899 Sep 14 08:52:46.987088 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 559/1092] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:52:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:52:47.040907 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-feadca82-1d66-4ae3-8b76-af1ef7f9e8a2 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ace9012a7c4ce59c01858b6984b766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a87a909133e42e1a82e3a623536935c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:47.052927 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-feadca82-1d66-4ae3-8b76-af1ef7f9e8a2 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] 10.222.0.60 "GET /compute/v2.1/servers/67f3a983-b33f-49c8-9c91-988e8553563c" status: 200 len: 1324 microversion: 2.1 time: 0.867928 Sep 14 08:52:47.056541 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 534/1093] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:46 2022] GET /compute/v2.1/servers/67f3a983-b33f-49c8-9c91-988e8553563c => generated 1324 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:52:47.191731 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-05587eaf-71ff-4685-91a9-72f90f32e138 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:47.192744 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-05587eaf-71ff-4685-91a9-72f90f32e138 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: af183467-9304-4c73-a29f-196e76ba21b5] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:47.195536 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=40 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:52:47.205088 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-05587eaf-71ff-4685-91a9-72f90f32e138 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:47.216051 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-05587eaf-71ff-4685-91a9-72f90f32e138 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:47.216750 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-05587eaf-71ff-4685-91a9-72f90f32e138 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:47.217940 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-05587eaf-71ff-4685-91a9-72f90f32e138 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:47.218615 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-05587eaf-71ff-4685-91a9-72f90f32e138 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:47.219496 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-05587eaf-71ff-4685-91a9-72f90f32e138 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:47.227626 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-1366a0e6-6341-4121-9e67-a926b795999a req-a6f517b2-fd64-41be-97a2-74806ab797b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2098e0b9-b628-4b9e-979b-960c68830fee", "name": "network-vif-plugged", "status": "completed", "tag": "a7cbc77d-b7b8-47d5-a1b4-d36705ecf7a0"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:52:47.246482 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-1366a0e6-6341-4121-9e67-a926b795999a req-a6f517b2-fd64-41be-97a2-74806ab797b2 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:47.248204 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-1366a0e6-6341-4121-9e67-a926b795999a req-a6f517b2-fd64-41be-97a2-74806ab797b2 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:47.249923 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-1366a0e6-6341-4121-9e67-a926b795999a req-a6f517b2-fd64-41be-97a2-74806ab797b2 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:47.288117 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-1366a0e6-6341-4121-9e67-a926b795999a req-a6f517b2-fd64-41be-97a2-74806ab797b2 service nova] Creating event network-vif-plugged:a7cbc77d-b7b8-47d5-a1b4-d36705ecf7a0 for instance 2098e0b9-b628-4b9e-979b-960c68830fee on n-h1-836830-18 Sep 14 08:52:47.304278 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-1366a0e6-6341-4121-9e67-a926b795999a req-a6f517b2-fd64-41be-97a2-74806ab797b2 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080836 Sep 14 08:52:47.305564 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 535/1094] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:52:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:52:47.343654 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-801422cb-9161-493a-b384-6471b3e3aae5 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:47.345019 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-801422cb-9161-493a-b384-6471b3e3aae5 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] [instance: 9507f778-dd44-4db1-b36e-fecd603b2487] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:47.360096 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-801422cb-9161-493a-b384-6471b3e3aae5 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:47.366423 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-801422cb-9161-493a-b384-6471b3e3aae5 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:47.366979 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-801422cb-9161-493a-b384-6471b3e3aae5 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:47.368050 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-801422cb-9161-493a-b384-6471b3e3aae5 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:47.368902 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-801422cb-9161-493a-b384-6471b3e3aae5 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:47.369894 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-801422cb-9161-493a-b384-6471b3e3aae5 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:47.534126 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-801422cb-9161-493a-b384-6471b3e3aae5 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c7802984cf48d1852832b52abe52e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e326f95a9604fdb9bd075db3837cf62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:47.548969 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-801422cb-9161-493a-b384-6471b3e3aae5 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] 10.222.0.60 "GET /compute/v2.1/servers/9507f778-dd44-4db1-b36e-fecd603b2487" status: 200 len: 1433 microversion: 2.1 time: 0.211002 Sep 14 08:52:47.549762 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 536/1095] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:47 2022] GET /compute/v2.1/servers/9507f778-dd44-4db1-b36e-fecd603b2487 => generated 1433 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:52:47.588582 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-d70d5199-17ce-4e23-899c-b6151c5c845f req-8b2ae3f6-1673-43ed-96cd-a2f496e2fc4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9507f778-dd44-4db1-b36e-fecd603b2487", "name": "network-vif-deleted", "tag": "7de514e0-ca4d-44bd-881b-61b7fec81020"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:52:47.598403 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-d70d5199-17ce-4e23-899c-b6151c5c845f req-8b2ae3f6-1673-43ed-96cd-a2f496e2fc4c service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:47.599181 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-d70d5199-17ce-4e23-899c-b6151c5c845f req-8b2ae3f6-1673-43ed-96cd-a2f496e2fc4c service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:47.599808 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-d70d5199-17ce-4e23-899c-b6151c5c845f req-8b2ae3f6-1673-43ed-96cd-a2f496e2fc4c service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:47.615910 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-d70d5199-17ce-4e23-899c-b6151c5c845f req-8b2ae3f6-1673-43ed-96cd-a2f496e2fc4c service nova] Creating event network-vif-deleted:7de514e0-ca4d-44bd-881b-61b7fec81020 for instance 9507f778-dd44-4db1-b36e-fecd603b2487 on n-h2-836830-18 Sep 14 08:52:47.623310 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-d70d5199-17ce-4e23-899c-b6151c5c845f req-8b2ae3f6-1673-43ed-96cd-a2f496e2fc4c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039224 Sep 14 08:52:47.624629 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 537/1096] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:52:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:52:47.674117 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-05587eaf-71ff-4685-91a9-72f90f32e138 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:47.686403 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-05587eaf-71ff-4685-91a9-72f90f32e138 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/af183467-9304-4c73-a29f-196e76ba21b5" status: 200 len: 1534 microversion: 2.1 time: 0.498672 Sep 14 08:52:47.687916 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 560/1097] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:47 2022] GET /compute/v2.1/servers/af183467-9304-4c73-a29f-196e76ba21b5 => generated 1534 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:52:47.931652 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b07d65fc-5b66-4fb9-9dc3-6f17c594d2bf tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:47.932642 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-b07d65fc-5b66-4fb9-9dc3-6f17c594d2bf tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: 2098e0b9-b628-4b9e-979b-960c68830fee] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:47.940078 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b07d65fc-5b66-4fb9-9dc3-6f17c594d2bf tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:47.940791 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b07d65fc-5b66-4fb9-9dc3-6f17c594d2bf tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:47.941428 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b07d65fc-5b66-4fb9-9dc3-6f17c594d2bf tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:47.942367 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b07d65fc-5b66-4fb9-9dc3-6f17c594d2bf tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:47.942895 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b07d65fc-5b66-4fb9-9dc3-6f17c594d2bf tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:47.944133 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b07d65fc-5b66-4fb9-9dc3-6f17c594d2bf tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:47.948730 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:52:48.085102 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-0786732f-fa60-4460-bb84-9b1da7a3492a tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:48.085732 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-0786732f-fa60-4460-bb84-9b1da7a3492a tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] [instance: 67f3a983-b33f-49c8-9c91-988e8553563c] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:48.092998 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0786732f-fa60-4460-bb84-9b1da7a3492a tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:48.100893 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0786732f-fa60-4460-bb84-9b1da7a3492a tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:48.101950 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0786732f-fa60-4460-bb84-9b1da7a3492a tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:48.102725 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0786732f-fa60-4460-bb84-9b1da7a3492a tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:48.104036 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0786732f-fa60-4460-bb84-9b1da7a3492a tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:48.104466 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0786732f-fa60-4460-bb84-9b1da7a3492a tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:48.169116 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-b07d65fc-5b66-4fb9-9dc3-6f17c594d2bf tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:48.182980 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-b07d65fc-5b66-4fb9-9dc3-6f17c594d2bf tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/2098e0b9-b628-4b9e-979b-960c68830fee" status: 200 len: 1359 microversion: 2.1 time: 0.256406 Sep 14 08:52:48.185091 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 538/1098] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:47 2022] GET /compute/v2.1/servers/2098e0b9-b628-4b9e-979b-960c68830fee => generated 1359 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:52:48.268497 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-0786732f-fa60-4460-bb84-9b1da7a3492a tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ace9012a7c4ce59c01858b6984b766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a87a909133e42e1a82e3a623536935c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:48.278744 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-0786732f-fa60-4460-bb84-9b1da7a3492a tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] 10.222.0.60 "GET /compute/v2.1/servers/67f3a983-b33f-49c8-9c91-988e8553563c" status: 200 len: 1324 microversion: 2.1 time: 0.199149 Sep 14 08:52:48.279784 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 561/1099] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:48 2022] GET /compute/v2.1/servers/67f3a983-b33f-49c8-9c91-988e8553563c => generated 1324 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:52:48.573741 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-234d04bb-86c7-4264-8495-8b29743607f1 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:48.574315 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-234d04bb-86c7-4264-8495-8b29743607f1 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] [instance: 9507f778-dd44-4db1-b36e-fecd603b2487] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:48.582287 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-234d04bb-86c7-4264-8495-8b29743607f1 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:48.582792 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-234d04bb-86c7-4264-8495-8b29743607f1 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:48.583403 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-234d04bb-86c7-4264-8495-8b29743607f1 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:48.584640 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-234d04bb-86c7-4264-8495-8b29743607f1 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:48.585272 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-234d04bb-86c7-4264-8495-8b29743607f1 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:48.585706 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-234d04bb-86c7-4264-8495-8b29743607f1 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:48.602694 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-234d04bb-86c7-4264-8495-8b29743607f1 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] HTTP exception thrown: Instance 9507f778-dd44-4db1-b36e-fecd603b2487 could not be found. Sep 14 08:52:48.605869 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-234d04bb-86c7-4264-8495-8b29743607f1 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Request method failure captured: Sep 14 08:52:48.605869 n-d-836830-18 devstack@n-api.service[128758]: request: GET /compute/v2.1/servers/9507f778-dd44-4db1-b36e-fecd603b2487 HTTP/1.1 Sep 14 08:52:48.605869 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 08:52:48.605869 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 08:52:48.605869 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 08:52:48.605869 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 08:52:48.605869 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 08:52:48.605869 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 08:52:48.605869 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 08:52:48.605869 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 08:52:48.605869 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZWCl-PBW4XwTIAlm_HDzFNUEwKCR-QX8kRMQlkDQ28-th7Hv5Ami7B5CdfKebuOcYBY8pBDcErYnw6Yoo-AEMZOR30AfoQXWHysSwGGQuX7FJimJhZb77LDAXJX1PJ_CPAwODcQceVHue0gK59ez0nQzHL0ZkFBiu-KQzoh7YQB5n0 Sep 14 08:52:48.605869 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 08:52:48.605869 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 08:52:48.605869 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 08:52:48.605869 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 08:52:48.605869 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 08:52:48.605869 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 08:52:48.605869 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 5e326f95a9604fdb9bd075db3837cf62 Sep 14 08:52:48.605869 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-ServersOnMultiNodesTest-1258517383 Sep 14 08:52:48.605869 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 08:52:48.605869 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 08:52:48.608259 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/5e326f95a9604fdb9bd075db3837cf62"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_5e326f95a9604fdb9bd075db3837cf62"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5e326f95a9604fdb9bd075db3837cf62"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5e326f95a9604fdb9bd075db3837cf62"}]}] Sep 14 08:52:48.608259 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-ServersOnMultiNodesTest-1258517383 Sep 14 08:52:48.608259 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 5e326f95a9604fdb9bd075db3837cf62 Sep 14 08:52:48.608259 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1258517383 Sep 14 08:52:48.608259 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-ServersOnMultiNodesTest-1258517383-project Sep 14 08:52:48.608259 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 08:52:48.608259 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 08:52:48.608259 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 89c7802984cf48d1852832b52abe52e9 Sep 14 08:52:48.608259 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-ServersOnMultiNodesTest-1258517383-project Sep 14 08:52:48.608259 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 08:52:48.608259 n-d-836830-18 devstack@n-api.service[128758]: exception: Instance 9507f778-dd44-4db1-b36e-fecd603b2487 could not be found. Sep 14 08:52:48.608259 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': '9507f778-dd44-4db1-b36e-fecd603b2487'} Sep 14 08:52:48.609422 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:52:48.609422 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:52:48.609422 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 08:52:48.609422 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 08:52:48.609422 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 08:52:48.609422 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 08:52:48.609422 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 08:52:48.609422 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 08:52:48.609422 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 08:52:48.609422 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 08:52:48.609422 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9507f778-dd44-4db1-b36e-fecd603b2487 could not be found. Sep 14 08:52:48.609422 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:52:48.609422 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:52:48.609422 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:52:48.609422 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:52:48.609422 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:52:48.609422 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:52:48.609422 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:52:48.609422 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:52:48.609422 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:52:48.611131 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:52:48.611131 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 08:52:48.611131 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 08:52:48.611131 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 08:52:48.611131 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 08:52:48.611131 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 08:52:48.611131 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 08:52:48.611131 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9507f778-dd44-4db1-b36e-fecd603b2487 could not be found. Sep 14 08:52:48.611131 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:52:48.611131 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:52:48.611131 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:52:48.611131 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:52:48.611131 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:52:48.611131 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:52:48.611131 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:52:48.611131 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:52:48.611131 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9507f778-dd44-4db1-b36e-fecd603b2487 could not be found. Sep 14 08:52:48.611131 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:52:48.614671 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-234d04bb-86c7-4264-8495-8b29743607f1 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Returning 404 to user: Instance 9507f778-dd44-4db1-b36e-fecd603b2487 could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:52:48.615831 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-234d04bb-86c7-4264-8495-8b29743607f1 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] 10.222.0.60 "GET /compute/v2.1/servers/9507f778-dd44-4db1-b36e-fecd603b2487" status: 404 len: 111 microversion: 2.1 time: 0.046012 Sep 14 08:52:48.616635 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 539/1100] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:48 2022] GET /compute/v2.1/servers/9507f778-dd44-4db1-b36e-fecd603b2487 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 08:52:48.624769 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-890b2762-fae9-489f-84d0-0fdc892d5eb6 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:48.625911 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-890b2762-fae9-489f-84d0-0fdc892d5eb6 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] [instance: 3acd19ba-a5b9-4bac-a4a3-2c274448c374] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:48.633813 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-890b2762-fae9-489f-84d0-0fdc892d5eb6 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:48.635731 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-890b2762-fae9-489f-84d0-0fdc892d5eb6 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:48.636538 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-890b2762-fae9-489f-84d0-0fdc892d5eb6 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:48.637962 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-890b2762-fae9-489f-84d0-0fdc892d5eb6 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:48.638511 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-890b2762-fae9-489f-84d0-0fdc892d5eb6 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:48.639401 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-890b2762-fae9-489f-84d0-0fdc892d5eb6 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:48.656000 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-890b2762-fae9-489f-84d0-0fdc892d5eb6 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] HTTP exception thrown: Instance 3acd19ba-a5b9-4bac-a4a3-2c274448c374 could not be found. Sep 14 08:52:48.657619 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-890b2762-fae9-489f-84d0-0fdc892d5eb6 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Request method failure captured: Sep 14 08:52:48.657619 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/3acd19ba-a5b9-4bac-a4a3-2c274448c374 HTTP/1.1 Sep 14 08:52:48.657619 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 08:52:48.657619 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 08:52:48.657619 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 08:52:48.657619 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 08:52:48.657619 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 08:52:48.657619 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 08:52:48.657619 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 08:52:48.657619 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 08:52:48.657619 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZWCl-PBW4XwTIAlm_HDzFNUEwKCR-QX8kRMQlkDQ28-th7Hv5Ami7B5CdfKebuOcYBY8pBDcErYnw6Yoo-AEMZOR30AfoQXWHysSwGGQuX7FJimJhZb77LDAXJX1PJ_CPAwODcQceVHue0gK59ez0nQzHL0ZkFBiu-KQzoh7YQB5n0 Sep 14 08:52:48.657619 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 08:52:48.657619 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 08:52:48.657619 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 08:52:48.657619 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 08:52:48.657619 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 08:52:48.657619 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 08:52:48.657619 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 5e326f95a9604fdb9bd075db3837cf62 Sep 14 08:52:48.657619 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ServersOnMultiNodesTest-1258517383 Sep 14 08:52:48.657619 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 08:52:48.657619 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 08:52:48.659020 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/5e326f95a9604fdb9bd075db3837cf62"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_5e326f95a9604fdb9bd075db3837cf62"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5e326f95a9604fdb9bd075db3837cf62"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5e326f95a9604fdb9bd075db3837cf62"}]}] Sep 14 08:52:48.659020 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ServersOnMultiNodesTest-1258517383 Sep 14 08:52:48.659020 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 5e326f95a9604fdb9bd075db3837cf62 Sep 14 08:52:48.659020 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1258517383 Sep 14 08:52:48.659020 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ServersOnMultiNodesTest-1258517383-project Sep 14 08:52:48.659020 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 08:52:48.659020 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 08:52:48.659020 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 89c7802984cf48d1852832b52abe52e9 Sep 14 08:52:48.659020 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ServersOnMultiNodesTest-1258517383-project Sep 14 08:52:48.659020 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 08:52:48.659020 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance 3acd19ba-a5b9-4bac-a4a3-2c274448c374 could not be found. Sep 14 08:52:48.659020 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '3acd19ba-a5b9-4bac-a4a3-2c274448c374'} Sep 14 08:52:48.659850 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:52:48.659850 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:52:48.659850 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 08:52:48.659850 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 08:52:48.659850 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 08:52:48.659850 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 08:52:48.659850 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 08:52:48.659850 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 08:52:48.659850 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 08:52:48.659850 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 08:52:48.659850 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3acd19ba-a5b9-4bac-a4a3-2c274448c374 could not be found. Sep 14 08:52:48.659850 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:52:48.659850 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:52:48.659850 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:52:48.659850 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:52:48.659850 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:52:48.659850 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:52:48.659850 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:52:48.659850 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:52:48.659850 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:52:48.661062 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:52:48.661062 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 08:52:48.661062 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 08:52:48.661062 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 08:52:48.661062 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 08:52:48.661062 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 08:52:48.661062 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 08:52:48.661062 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3acd19ba-a5b9-4bac-a4a3-2c274448c374 could not be found. Sep 14 08:52:48.661062 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:52:48.661062 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:52:48.661062 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:52:48.661062 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:52:48.661062 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:52:48.661062 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:52:48.661062 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:52:48.661062 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:52:48.661062 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3acd19ba-a5b9-4bac-a4a3-2c274448c374 could not be found. Sep 14 08:52:48.661062 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:52:48.664170 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-890b2762-fae9-489f-84d0-0fdc892d5eb6 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Returning 404 to user: Instance 3acd19ba-a5b9-4bac-a4a3-2c274448c374 could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:52:48.664170 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-890b2762-fae9-489f-84d0-0fdc892d5eb6 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] 10.222.0.60 "GET /compute/v2.1/servers/3acd19ba-a5b9-4bac-a4a3-2c274448c374" status: 404 len: 111 microversion: 2.1 time: 0.038265 Sep 14 08:52:48.664170 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 562/1101] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:48 2022] GET /compute/v2.1/servers/3acd19ba-a5b9-4bac-a4a3-2c274448c374 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 08:52:48.673377 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-5a96fad7-7fb4-4685-bf29-e012f7db1315 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:48.708540 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-5a96fad7-7fb4-4685-bf29-e012f7db1315 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] 10.222.0.60 "DELETE /compute/v2.1/os-server-groups/772977de-b17d-439d-af7a-58894a154ed1" status: 204 len: 0 microversion: 2.1 time: 0.043216 Sep 14 08:52:48.709772 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 540/1102] 10.222.0.60 () {58 vars in 1266 bytes} [Wed Sep 14 08:52:48 2022] DELETE /compute/v2.1/os-server-groups/772977de-b17d-439d-af7a-58894a154ed1 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 08:52:48.717995 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-af1277e0-bb9d-4d87-a731-e6fb17bc2465 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:48.718588 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-af1277e0-bb9d-4d87-a731-e6fb17bc2465 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] [instance: 307b2830-67e6-44ec-845f-9894de16694a] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:48.721156 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-fa832a98-62e1-43fc-af3a-f0666482c153 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:48.721770 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-fa832a98-62e1-43fc-af3a-f0666482c153 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: af183467-9304-4c73-a29f-196e76ba21b5] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:48.725873 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-af1277e0-bb9d-4d87-a731-e6fb17bc2465 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:48.726439 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-af1277e0-bb9d-4d87-a731-e6fb17bc2465 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:48.726919 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-af1277e0-bb9d-4d87-a731-e6fb17bc2465 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:48.727935 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-af1277e0-bb9d-4d87-a731-e6fb17bc2465 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:48.728553 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-af1277e0-bb9d-4d87-a731-e6fb17bc2465 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:48.728988 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-af1277e0-bb9d-4d87-a731-e6fb17bc2465 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:48.729440 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fa832a98-62e1-43fc-af3a-f0666482c153 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:48.729940 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fa832a98-62e1-43fc-af3a-f0666482c153 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:48.730377 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fa832a98-62e1-43fc-af3a-f0666482c153 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:48.731286 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fa832a98-62e1-43fc-af3a-f0666482c153 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:48.731751 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fa832a98-62e1-43fc-af3a-f0666482c153 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:48.732177 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fa832a98-62e1-43fc-af3a-f0666482c153 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:48.760368 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-af1277e0-bb9d-4d87-a731-e6fb17bc2465 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] [instance: 307b2830-67e6-44ec-845f-9894de16694a] Going to try to terminate instance {{(pid=128758) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 08:52:48.852837 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-af1277e0-bb9d-4d87-a731-e6fb17bc2465 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] 10.222.0.60 "DELETE /compute/v2.1/servers/307b2830-67e6-44ec-845f-9894de16694a" status: 204 len: 0 microversion: 2.1 time: 0.138719 Sep 14 08:52:48.853641 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 541/1103] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 08:52:48 2022] DELETE /compute/v2.1/servers/307b2830-67e6-44ec-845f-9894de16694a => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 08:52:48.862030 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b755b36d-ba6c-46e9-b91c-fcbb08aece8e tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:48.862728 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-b755b36d-ba6c-46e9-b91c-fcbb08aece8e tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] [instance: 307b2830-67e6-44ec-845f-9894de16694a] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:48.865893 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=2,nova_api:UPDATE=2,nova_api:DELETE=3 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:52:48.870181 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b755b36d-ba6c-46e9-b91c-fcbb08aece8e tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:48.870910 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b755b36d-ba6c-46e9-b91c-fcbb08aece8e tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:48.871687 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b755b36d-ba6c-46e9-b91c-fcbb08aece8e tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:48.876628 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b755b36d-ba6c-46e9-b91c-fcbb08aece8e tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:48.876628 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b755b36d-ba6c-46e9-b91c-fcbb08aece8e tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:48.876628 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b755b36d-ba6c-46e9-b91c-fcbb08aece8e tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:48.920552 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-fa832a98-62e1-43fc-af3a-f0666482c153 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:48.946426 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-fa832a98-62e1-43fc-af3a-f0666482c153 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/af183467-9304-4c73-a29f-196e76ba21b5" status: 200 len: 1534 microversion: 2.1 time: 0.231472 Sep 14 08:52:48.947401 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 563/1104] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:48 2022] GET /compute/v2.1/servers/af183467-9304-4c73-a29f-196e76ba21b5 => generated 1534 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:52:49.052746 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-b755b36d-ba6c-46e9-b91c-fcbb08aece8e tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c7802984cf48d1852832b52abe52e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e326f95a9604fdb9bd075db3837cf62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:49.062089 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-b755b36d-ba6c-46e9-b91c-fcbb08aece8e tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] 10.222.0.60 "GET /compute/v2.1/servers/307b2830-67e6-44ec-845f-9894de16694a" status: 200 len: 1472 microversion: 2.1 time: 0.204144 Sep 14 08:52:49.062680 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 542/1105] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:48 2022] GET /compute/v2.1/servers/307b2830-67e6-44ec-845f-9894de16694a => generated 1472 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:52:49.208808 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-60bbec2b-636d-42c4-a4a6-1c653ad70a5e tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:49.209950 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-60bbec2b-636d-42c4-a4a6-1c653ad70a5e tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: 2098e0b9-b628-4b9e-979b-960c68830fee] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:49.216503 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-60bbec2b-636d-42c4-a4a6-1c653ad70a5e tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:49.217246 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-60bbec2b-636d-42c4-a4a6-1c653ad70a5e tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:49.217841 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-60bbec2b-636d-42c4-a4a6-1c653ad70a5e tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:49.218740 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-60bbec2b-636d-42c4-a4a6-1c653ad70a5e tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:49.219454 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-60bbec2b-636d-42c4-a4a6-1c653ad70a5e tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:49.220048 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-60bbec2b-636d-42c4-a4a6-1c653ad70a5e tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:49.285002 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-95f94521-de40-43df-8ee2-8e8f59148d28 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:49.285516 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-95f94521-de40-43df-8ee2-8e8f59148d28 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] [instance: 4df3f3eb-e900-497d-a1ed-f5e12a0d69a8] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:49.298895 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-95f94521-de40-43df-8ee2-8e8f59148d28 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:49.299501 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-95f94521-de40-43df-8ee2-8e8f59148d28 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:49.299944 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-95f94521-de40-43df-8ee2-8e8f59148d28 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:49.300658 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-95f94521-de40-43df-8ee2-8e8f59148d28 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:49.303684 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-95f94521-de40-43df-8ee2-8e8f59148d28 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:49.304302 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-95f94521-de40-43df-8ee2-8e8f59148d28 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:49.377232 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-95f94521-de40-43df-8ee2-8e8f59148d28 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] [instance: 4df3f3eb-e900-497d-a1ed-f5e12a0d69a8] Going to try to terminate instance {{(pid=128758) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 08:52:49.391995 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-60bbec2b-636d-42c4-a4a6-1c653ad70a5e tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:49.402569 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-60bbec2b-636d-42c4-a4a6-1c653ad70a5e tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/2098e0b9-b628-4b9e-979b-960c68830fee" status: 200 len: 1359 microversion: 2.1 time: 0.199297 Sep 14 08:52:49.415675 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 564/1106] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:49 2022] GET /compute/v2.1/servers/2098e0b9-b628-4b9e-979b-960c68830fee => generated 1359 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:52:49.424660 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-475c4a11-ae68-46d9-b088-96108e2b372d tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:49.425558 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-475c4a11-ae68-46d9-b088-96108e2b372d tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] [instance: 67f3a983-b33f-49c8-9c91-988e8553563c] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:49.433809 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-475c4a11-ae68-46d9-b088-96108e2b372d tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:49.434635 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-475c4a11-ae68-46d9-b088-96108e2b372d tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:49.435365 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-475c4a11-ae68-46d9-b088-96108e2b372d tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:49.436317 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-475c4a11-ae68-46d9-b088-96108e2b372d tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:49.437034 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-475c4a11-ae68-46d9-b088-96108e2b372d tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:49.437657 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-475c4a11-ae68-46d9-b088-96108e2b372d tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:49.575121 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-95f94521-de40-43df-8ee2-8e8f59148d28 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] 10.222.0.60 "DELETE /compute/v2.1/servers/4df3f3eb-e900-497d-a1ed-f5e12a0d69a8" status: 204 len: 0 microversion: 2.1 time: 0.294701 Sep 14 08:52:49.580927 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 543/1107] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 08:52:49 2022] DELETE /compute/v2.1/servers/4df3f3eb-e900-497d-a1ed-f5e12a0d69a8 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 08:52:49.587319 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-ab93a129-05f1-4eb1-9130-51aeb8f345f4 req-5b759a53-edd2-4ea3-a27d-731740321cfa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af183467-9304-4c73-a29f-196e76ba21b5", "name": "network-vif-unplugged", "status": "completed", "tag": "9664d857-e4a0-4edd-b5e2-e3a3058cb696"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:52:49.613087 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-ab93a129-05f1-4eb1-9130-51aeb8f345f4 req-5b759a53-edd2-4ea3-a27d-731740321cfa service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:49.616501 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-ab93a129-05f1-4eb1-9130-51aeb8f345f4 req-5b759a53-edd2-4ea3-a27d-731740321cfa service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:49.617152 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-ab93a129-05f1-4eb1-9130-51aeb8f345f4 req-5b759a53-edd2-4ea3-a27d-731740321cfa service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:49.644416 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-ab93a129-05f1-4eb1-9130-51aeb8f345f4 req-5b759a53-edd2-4ea3-a27d-731740321cfa service nova] Creating event network-vif-unplugged:9664d857-e4a0-4edd-b5e2-e3a3058cb696 for instance af183467-9304-4c73-a29f-196e76ba21b5 on n-h1-836830-18 Sep 14 08:52:49.667040 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [req-ab93a129-05f1-4eb1-9130-51aeb8f345f4 req-5b759a53-edd2-4ea3-a27d-731740321cfa service nova] Instance af183467-9304-4c73-a29f-196e76ba21b5 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-836830-18'} {{(pid=128758) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 14 08:52:49.673871 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-ab93a129-05f1-4eb1-9130-51aeb8f345f4 req-5b759a53-edd2-4ea3-a27d-731740321cfa service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.090812 Sep 14 08:52:49.676874 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-475c4a11-ae68-46d9-b088-96108e2b372d tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ace9012a7c4ce59c01858b6984b766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a87a909133e42e1a82e3a623536935c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:49.678680 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 544/1108] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:52:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:52:49.684755 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-7d14f512-6112-4094-9397-45ba582c8bb5 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:49.685970 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-7d14f512-6112-4094-9397-45ba582c8bb5 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] [instance: 4df3f3eb-e900-497d-a1ed-f5e12a0d69a8] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:49.686108 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-475c4a11-ae68-46d9-b088-96108e2b372d tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] 10.222.0.60 "GET /compute/v2.1/servers/67f3a983-b33f-49c8-9c91-988e8553563c" status: 200 len: 1324 microversion: 2.1 time: 0.269171 Sep 14 08:52:49.686560 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 565/1109] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:49 2022] GET /compute/v2.1/servers/67f3a983-b33f-49c8-9c91-988e8553563c => generated 1324 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:52:49.694062 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-8d8e043e-ce02-43ae-aeda-80986c9e2a34 req-629d6ff6-3e21-4590-a761-63be72eec373 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67f3a983-b33f-49c8-9c91-988e8553563c", "tag": "07668b52-5928-40b0-b852-24d2a561fd3d"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:52:49.703702 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-8d8e043e-ce02-43ae-aeda-80986c9e2a34 req-629d6ff6-3e21-4590-a761-63be72eec373 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:49.704175 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-8d8e043e-ce02-43ae-aeda-80986c9e2a34 req-629d6ff6-3e21-4590-a761-63be72eec373 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:49.704772 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-8d8e043e-ce02-43ae-aeda-80986c9e2a34 req-629d6ff6-3e21-4590-a761-63be72eec373 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:49.710873 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7d14f512-6112-4094-9397-45ba582c8bb5 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:49.711491 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7d14f512-6112-4094-9397-45ba582c8bb5 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:49.712016 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7d14f512-6112-4094-9397-45ba582c8bb5 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:49.712791 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7d14f512-6112-4094-9397-45ba582c8bb5 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:49.713318 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7d14f512-6112-4094-9397-45ba582c8bb5 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:49.713812 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7d14f512-6112-4094-9397-45ba582c8bb5 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:49.718392 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-8d8e043e-ce02-43ae-aeda-80986c9e2a34 req-629d6ff6-3e21-4590-a761-63be72eec373 service nova] Creating event network-changed:07668b52-5928-40b0-b852-24d2a561fd3d for instance 67f3a983-b33f-49c8-9c91-988e8553563c on n-h1-836830-18 Sep 14 08:52:49.723457 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-8d8e043e-ce02-43ae-aeda-80986c9e2a34 req-629d6ff6-3e21-4590-a761-63be72eec373 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033221 Sep 14 08:52:49.728886 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 566/1110] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:52:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:52:49.874530 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-7d14f512-6112-4094-9397-45ba582c8bb5 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b938da87b14cd79c3c6dd85818cd02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee17e19b2f094a899dfc8966152fd642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:49.885359 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-7d14f512-6112-4094-9397-45ba582c8bb5 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] 10.222.0.60 "GET /compute/v2.1/servers/4df3f3eb-e900-497d-a1ed-f5e12a0d69a8" status: 200 len: 1710 microversion: 2.1 time: 0.205135 Sep 14 08:52:49.899488 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 545/1111] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:49 2022] GET /compute/v2.1/servers/4df3f3eb-e900-497d-a1ed-f5e12a0d69a8 => generated 1710 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:52:49.975290 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-804dd872-d60e-4c37-8629-522aafe27fb2 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:49.976098 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-804dd872-d60e-4c37-8629-522aafe27fb2 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: af183467-9304-4c73-a29f-196e76ba21b5] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:49.983273 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-804dd872-d60e-4c37-8629-522aafe27fb2 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:49.984076 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-804dd872-d60e-4c37-8629-522aafe27fb2 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:49.984609 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-804dd872-d60e-4c37-8629-522aafe27fb2 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:49.985407 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-804dd872-d60e-4c37-8629-522aafe27fb2 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:49.986082 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-804dd872-d60e-4c37-8629-522aafe27fb2 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:49.986967 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-804dd872-d60e-4c37-8629-522aafe27fb2 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:50.088005 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-6a6f7c03-ab2a-4011-8b1a-66978b646106 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:50.088746 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-6a6f7c03-ab2a-4011-8b1a-66978b646106 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] [instance: 307b2830-67e6-44ec-845f-9894de16694a] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:50.096596 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6a6f7c03-ab2a-4011-8b1a-66978b646106 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:50.097296 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6a6f7c03-ab2a-4011-8b1a-66978b646106 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:50.097829 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6a6f7c03-ab2a-4011-8b1a-66978b646106 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:50.098824 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6a6f7c03-ab2a-4011-8b1a-66978b646106 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:50.099446 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6a6f7c03-ab2a-4011-8b1a-66978b646106 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:50.099989 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6a6f7c03-ab2a-4011-8b1a-66978b646106 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:50.161939 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-804dd872-d60e-4c37-8629-522aafe27fb2 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:50.171866 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=3 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:52:50.175373 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-804dd872-d60e-4c37-8629-522aafe27fb2 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/af183467-9304-4c73-a29f-196e76ba21b5" status: 200 len: 1534 microversion: 2.1 time: 0.204997 Sep 14 08:52:50.176934 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 567/1112] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:49 2022] GET /compute/v2.1/servers/af183467-9304-4c73-a29f-196e76ba21b5 => generated 1534 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:52:50.290378 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-6a6f7c03-ab2a-4011-8b1a-66978b646106 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c7802984cf48d1852832b52abe52e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e326f95a9604fdb9bd075db3837cf62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:50.301775 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-6a6f7c03-ab2a-4011-8b1a-66978b646106 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] 10.222.0.60 "GET /compute/v2.1/servers/307b2830-67e6-44ec-845f-9894de16694a" status: 200 len: 1472 microversion: 2.1 time: 0.218668 Sep 14 08:52:50.303191 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 546/1113] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:50 2022] GET /compute/v2.1/servers/307b2830-67e6-44ec-845f-9894de16694a => generated 1472 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:52:50.430618 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a40e2563-a4f3-42bc-9e47-d76eb6b5a8c4 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:50.431246 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-a40e2563-a4f3-42bc-9e47-d76eb6b5a8c4 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: 2098e0b9-b628-4b9e-979b-960c68830fee] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:50.440417 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a40e2563-a4f3-42bc-9e47-d76eb6b5a8c4 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:50.440968 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a40e2563-a4f3-42bc-9e47-d76eb6b5a8c4 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:50.441391 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a40e2563-a4f3-42bc-9e47-d76eb6b5a8c4 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:50.442238 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a40e2563-a4f3-42bc-9e47-d76eb6b5a8c4 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:50.442820 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a40e2563-a4f3-42bc-9e47-d76eb6b5a8c4 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:50.443372 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a40e2563-a4f3-42bc-9e47-d76eb6b5a8c4 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:50.605830 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-a40e2563-a4f3-42bc-9e47-d76eb6b5a8c4 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:50.616635 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a40e2563-a4f3-42bc-9e47-d76eb6b5a8c4 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/2098e0b9-b628-4b9e-979b-960c68830fee" status: 200 len: 1359 microversion: 2.1 time: 0.190991 Sep 14 08:52:50.631744 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 568/1114] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:50 2022] GET /compute/v2.1/servers/2098e0b9-b628-4b9e-979b-960c68830fee => generated 1359 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:52:50.718077 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-2cde8f7e-138a-43cb-a5b8-86f9efa48021 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:50.719198 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-2cde8f7e-138a-43cb-a5b8-86f9efa48021 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] [instance: 67f3a983-b33f-49c8-9c91-988e8553563c] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:50.727358 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2cde8f7e-138a-43cb-a5b8-86f9efa48021 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:50.728083 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2cde8f7e-138a-43cb-a5b8-86f9efa48021 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:50.728689 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2cde8f7e-138a-43cb-a5b8-86f9efa48021 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:50.729603 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2cde8f7e-138a-43cb-a5b8-86f9efa48021 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:50.730503 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2cde8f7e-138a-43cb-a5b8-86f9efa48021 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:50.731128 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2cde8f7e-138a-43cb-a5b8-86f9efa48021 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:50.909811 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-03644b6d-0d9a-46aa-8763-6bbfc74da61c tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:50.910471 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-03644b6d-0d9a-46aa-8763-6bbfc74da61c tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] [instance: 4df3f3eb-e900-497d-a1ed-f5e12a0d69a8] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:50.918094 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-03644b6d-0d9a-46aa-8763-6bbfc74da61c tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:50.918976 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-03644b6d-0d9a-46aa-8763-6bbfc74da61c tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:50.919412 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-03644b6d-0d9a-46aa-8763-6bbfc74da61c tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:50.920764 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-03644b6d-0d9a-46aa-8763-6bbfc74da61c tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:50.921226 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-03644b6d-0d9a-46aa-8763-6bbfc74da61c tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:50.921655 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-03644b6d-0d9a-46aa-8763-6bbfc74da61c tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:50.924523 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-2cde8f7e-138a-43cb-a5b8-86f9efa48021 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ace9012a7c4ce59c01858b6984b766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a87a909133e42e1a82e3a623536935c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:50.936377 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-2cde8f7e-138a-43cb-a5b8-86f9efa48021 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] 10.222.0.60 "GET /compute/v2.1/servers/67f3a983-b33f-49c8-9c91-988e8553563c" status: 200 len: 1324 microversion: 2.1 time: 0.226745 Sep 14 08:52:50.939589 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 547/1115] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:50 2022] GET /compute/v2.1/servers/67f3a983-b33f-49c8-9c91-988e8553563c => generated 1324 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:52:51.093403 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-03644b6d-0d9a-46aa-8763-6bbfc74da61c tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b938da87b14cd79c3c6dd85818cd02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee17e19b2f094a899dfc8966152fd642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:51.104160 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-03644b6d-0d9a-46aa-8763-6bbfc74da61c tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] 10.222.0.60 "GET /compute/v2.1/servers/4df3f3eb-e900-497d-a1ed-f5e12a0d69a8" status: 200 len: 1710 microversion: 2.1 time: 0.197310 Sep 14 08:52:51.118982 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 569/1116] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:50 2022] GET /compute/v2.1/servers/4df3f3eb-e900-497d-a1ed-f5e12a0d69a8 => generated 1710 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:52:51.202496 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-96f474b7-1c80-42df-b57c-955407700c2f tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:51.203623 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-96f474b7-1c80-42df-b57c-955407700c2f tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: af183467-9304-4c73-a29f-196e76ba21b5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:51.214023 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-96f474b7-1c80-42df-b57c-955407700c2f tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:51.214528 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-96f474b7-1c80-42df-b57c-955407700c2f tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:51.214998 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-96f474b7-1c80-42df-b57c-955407700c2f tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:51.215716 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-96f474b7-1c80-42df-b57c-955407700c2f tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:51.216222 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-96f474b7-1c80-42df-b57c-955407700c2f tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:51.216650 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-96f474b7-1c80-42df-b57c-955407700c2f tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:51.327218 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-91c9e1c1-b9a8-45a3-a86f-a31e64cbe9ab tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:51.328165 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-91c9e1c1-b9a8-45a3-a86f-a31e64cbe9ab tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] [instance: 307b2830-67e6-44ec-845f-9894de16694a] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:51.335620 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-91c9e1c1-b9a8-45a3-a86f-a31e64cbe9ab tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:51.341875 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-91c9e1c1-b9a8-45a3-a86f-a31e64cbe9ab tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:51.342608 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-91c9e1c1-b9a8-45a3-a86f-a31e64cbe9ab tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:51.345544 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-91c9e1c1-b9a8-45a3-a86f-a31e64cbe9ab tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:51.346098 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-91c9e1c1-b9a8-45a3-a86f-a31e64cbe9ab tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:51.346612 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-91c9e1c1-b9a8-45a3-a86f-a31e64cbe9ab tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:51.614125 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-96f474b7-1c80-42df-b57c-955407700c2f tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:51.653280 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-96f474b7-1c80-42df-b57c-955407700c2f tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/af183467-9304-4c73-a29f-196e76ba21b5" status: 200 len: 1534 microversion: 2.1 time: 0.455750 Sep 14 08:52:51.656121 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 548/1117] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:51 2022] GET /compute/v2.1/servers/af183467-9304-4c73-a29f-196e76ba21b5 => generated 1534 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:52:51.666975 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-399c796e-3c0c-40f8-899c-07f0a7dae2d5 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:51.672063 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-399c796e-3c0c-40f8-899c-07f0a7dae2d5 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: 2098e0b9-b628-4b9e-979b-960c68830fee] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:51.698590 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-399c796e-3c0c-40f8-899c-07f0a7dae2d5 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:51.699652 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-399c796e-3c0c-40f8-899c-07f0a7dae2d5 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:51.700391 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-399c796e-3c0c-40f8-899c-07f0a7dae2d5 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:51.702078 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-399c796e-3c0c-40f8-899c-07f0a7dae2d5 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:51.702774 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-399c796e-3c0c-40f8-899c-07f0a7dae2d5 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:51.703651 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-399c796e-3c0c-40f8-899c-07f0a7dae2d5 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:51.735619 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-91c9e1c1-b9a8-45a3-a86f-a31e64cbe9ab tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c7802984cf48d1852832b52abe52e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e326f95a9604fdb9bd075db3837cf62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:51.751781 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-91c9e1c1-b9a8-45a3-a86f-a31e64cbe9ab tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] 10.222.0.60 "GET /compute/v2.1/servers/307b2830-67e6-44ec-845f-9894de16694a" status: 200 len: 1472 microversion: 2.1 time: 0.427789 Sep 14 08:52:51.753479 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 570/1118] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:51 2022] GET /compute/v2.1/servers/307b2830-67e6-44ec-845f-9894de16694a => generated 1472 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:52:51.962315 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f820f603-f22a-4cb9-ab8c-6359baebfeb2 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:51.964153 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f820f603-f22a-4cb9-ab8c-6359baebfeb2 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] [instance: 67f3a983-b33f-49c8-9c91-988e8553563c] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:51.970613 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f820f603-f22a-4cb9-ab8c-6359baebfeb2 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:51.972729 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f820f603-f22a-4cb9-ab8c-6359baebfeb2 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:51.973723 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f820f603-f22a-4cb9-ab8c-6359baebfeb2 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:51.975900 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f820f603-f22a-4cb9-ab8c-6359baebfeb2 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:51.976807 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f820f603-f22a-4cb9-ab8c-6359baebfeb2 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:51.977458 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f820f603-f22a-4cb9-ab8c-6359baebfeb2 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:51.997294 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:52:52.006327 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-399c796e-3c0c-40f8-899c-07f0a7dae2d5 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:52.014237 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-399c796e-3c0c-40f8-899c-07f0a7dae2d5 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/2098e0b9-b628-4b9e-979b-960c68830fee" status: 200 len: 1359 microversion: 2.1 time: 0.356846 Sep 14 08:52:52.015442 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 549/1119] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:51 2022] GET /compute/v2.1/servers/2098e0b9-b628-4b9e-979b-960c68830fee => generated 1359 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:52:52.128577 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-7a6348a6-14c7-409c-b3e9-f4a3bd570295 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:52.129135 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-7a6348a6-14c7-409c-b3e9-f4a3bd570295 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] [instance: 4df3f3eb-e900-497d-a1ed-f5e12a0d69a8] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:52.137386 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7a6348a6-14c7-409c-b3e9-f4a3bd570295 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:52.138376 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7a6348a6-14c7-409c-b3e9-f4a3bd570295 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:52.139440 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7a6348a6-14c7-409c-b3e9-f4a3bd570295 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:52.141182 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7a6348a6-14c7-409c-b3e9-f4a3bd570295 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:52.141849 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7a6348a6-14c7-409c-b3e9-f4a3bd570295 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:52.142824 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7a6348a6-14c7-409c-b3e9-f4a3bd570295 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:52.209909 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f820f603-f22a-4cb9-ab8c-6359baebfeb2 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ace9012a7c4ce59c01858b6984b766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a87a909133e42e1a82e3a623536935c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:52.232020 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f820f603-f22a-4cb9-ab8c-6359baebfeb2 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] 10.222.0.60 "GET /compute/v2.1/servers/67f3a983-b33f-49c8-9c91-988e8553563c" status: 200 len: 1324 microversion: 2.1 time: 0.273814 Sep 14 08:52:52.236659 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 571/1120] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:51 2022] GET /compute/v2.1/servers/67f3a983-b33f-49c8-9c91-988e8553563c => generated 1324 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:52:52.493509 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-7a6348a6-14c7-409c-b3e9-f4a3bd570295 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b938da87b14cd79c3c6dd85818cd02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee17e19b2f094a899dfc8966152fd642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:52.502628 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-7a6348a6-14c7-409c-b3e9-f4a3bd570295 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] 10.222.0.60 "GET /compute/v2.1/servers/4df3f3eb-e900-497d-a1ed-f5e12a0d69a8" status: 200 len: 1710 microversion: 2.1 time: 0.377922 Sep 14 08:52:52.503470 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 550/1121] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:52 2022] GET /compute/v2.1/servers/4df3f3eb-e900-497d-a1ed-f5e12a0d69a8 => generated 1710 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:52:52.681672 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9a6cc2c4-f85b-4c97-bca7-27cff420bda5 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:52.682623 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-9a6cc2c4-f85b-4c97-bca7-27cff420bda5 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: af183467-9304-4c73-a29f-196e76ba21b5] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:52.689616 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9a6cc2c4-f85b-4c97-bca7-27cff420bda5 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:52.690700 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9a6cc2c4-f85b-4c97-bca7-27cff420bda5 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:52.691425 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9a6cc2c4-f85b-4c97-bca7-27cff420bda5 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:52.692149 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9a6cc2c4-f85b-4c97-bca7-27cff420bda5 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:52.692611 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9a6cc2c4-f85b-4c97-bca7-27cff420bda5 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:52.693079 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9a6cc2c4-f85b-4c97-bca7-27cff420bda5 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:52.779035 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b34b9f54-ba53-44ae-a0e9-95f69c608874 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:52.779760 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-b34b9f54-ba53-44ae-a0e9-95f69c608874 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] [instance: 307b2830-67e6-44ec-845f-9894de16694a] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:52.804012 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b34b9f54-ba53-44ae-a0e9-95f69c608874 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:52.805281 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b34b9f54-ba53-44ae-a0e9-95f69c608874 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:52.806059 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b34b9f54-ba53-44ae-a0e9-95f69c608874 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:52.807083 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b34b9f54-ba53-44ae-a0e9-95f69c608874 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:52.807541 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b34b9f54-ba53-44ae-a0e9-95f69c608874 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:52.808171 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b34b9f54-ba53-44ae-a0e9-95f69c608874 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:53.444053 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-b34b9f54-ba53-44ae-a0e9-95f69c608874 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c7802984cf48d1852832b52abe52e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e326f95a9604fdb9bd075db3837cf62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:53.453728 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-b34b9f54-ba53-44ae-a0e9-95f69c608874 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] 10.222.0.60 "GET /compute/v2.1/servers/307b2830-67e6-44ec-845f-9894de16694a" status: 200 len: 1430 microversion: 2.1 time: 0.681113 Sep 14 08:52:53.470406 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 551/1122] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:52 2022] GET /compute/v2.1/servers/307b2830-67e6-44ec-845f-9894de16694a => generated 1430 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:52:53.478617 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-90f9b95d-0197-4b41-a982-dfab4fd4d129 req-287b3d40-40b3-469b-93b6-2ffaf91be93e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "307b2830-67e6-44ec-845f-9894de16694a", "name": "network-vif-deleted", "tag": "bfa5166f-08ce-4ac5-b444-021ba67b84d5"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:52:53.490741 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-90f9b95d-0197-4b41-a982-dfab4fd4d129 req-287b3d40-40b3-469b-93b6-2ffaf91be93e service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:53.491508 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-90f9b95d-0197-4b41-a982-dfab4fd4d129 req-287b3d40-40b3-469b-93b6-2ffaf91be93e service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:53.492183 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-90f9b95d-0197-4b41-a982-dfab4fd4d129 req-287b3d40-40b3-469b-93b6-2ffaf91be93e service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:53.504825 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-90f9b95d-0197-4b41-a982-dfab4fd4d129 req-287b3d40-40b3-469b-93b6-2ffaf91be93e service nova] Creating event network-vif-deleted:bfa5166f-08ce-4ac5-b444-021ba67b84d5 for instance 307b2830-67e6-44ec-845f-9894de16694a on n-h1-836830-18 Sep 14 08:52:53.510650 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-90f9b95d-0197-4b41-a982-dfab4fd4d129 req-287b3d40-40b3-469b-93b6-2ffaf91be93e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038327 Sep 14 08:52:53.511320 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 552/1123] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:52:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:52:53.519565 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-dfbd91d7-6b02-4708-98d1-7c26038c9ec2 req-8ff73f09-fe57-40ce-8e13-7040eda8bbdd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4df3f3eb-e900-497d-a1ed-f5e12a0d69a8", "name": "network-vif-deleted", "tag": "2598a43e-0827-49bc-952a-840f14b2612a"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:52:53.542661 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-dfbd91d7-6b02-4708-98d1-7c26038c9ec2 req-8ff73f09-fe57-40ce-8e13-7040eda8bbdd service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:53.543484 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-dfbd91d7-6b02-4708-98d1-7c26038c9ec2 req-8ff73f09-fe57-40ce-8e13-7040eda8bbdd service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:53.544034 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-dfbd91d7-6b02-4708-98d1-7c26038c9ec2 req-8ff73f09-fe57-40ce-8e13-7040eda8bbdd service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:53.558081 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-dfbd91d7-6b02-4708-98d1-7c26038c9ec2 req-8ff73f09-fe57-40ce-8e13-7040eda8bbdd service nova] Creating event network-vif-deleted:2598a43e-0827-49bc-952a-840f14b2612a for instance 4df3f3eb-e900-497d-a1ed-f5e12a0d69a8 on n-h2-836830-18 Sep 14 08:52:53.563990 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-dfbd91d7-6b02-4708-98d1-7c26038c9ec2 req-8ff73f09-fe57-40ce-8e13-7040eda8bbdd service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047584 Sep 14 08:52:53.564214 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 553/1124] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:52:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:52:53.571407 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-98468fdd-d502-4e18-8c4d-d276f3c485d2 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:53.572205 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-98468fdd-d502-4e18-8c4d-d276f3c485d2 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: 2098e0b9-b628-4b9e-979b-960c68830fee] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:53.581419 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-98468fdd-d502-4e18-8c4d-d276f3c485d2 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:53.582219 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-98468fdd-d502-4e18-8c4d-d276f3c485d2 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:53.583242 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-98468fdd-d502-4e18-8c4d-d276f3c485d2 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:53.584079 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-98468fdd-d502-4e18-8c4d-d276f3c485d2 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:53.585342 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-98468fdd-d502-4e18-8c4d-d276f3c485d2 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:53.585865 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-98468fdd-d502-4e18-8c4d-d276f3c485d2 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:53.766119 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-9a6cc2c4-f85b-4c97-bca7-27cff420bda5 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:53.788017 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-9a6cc2c4-f85b-4c97-bca7-27cff420bda5 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/af183467-9304-4c73-a29f-196e76ba21b5" status: 200 len: 1527 microversion: 2.1 time: 1.111107 Sep 14 08:52:53.794111 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 572/1125] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:52 2022] GET /compute/v2.1/servers/af183467-9304-4c73-a29f-196e76ba21b5 => generated 1527 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:52:53.812005 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-fc9e67b2-050f-4953-aec6-c24bdb0c5963 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:53.814055 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-fc9e67b2-050f-4953-aec6-c24bdb0c5963 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] [instance: 67f3a983-b33f-49c8-9c91-988e8553563c] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:53.829855 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fc9e67b2-050f-4953-aec6-c24bdb0c5963 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:53.835509 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fc9e67b2-050f-4953-aec6-c24bdb0c5963 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:53.837096 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fc9e67b2-050f-4953-aec6-c24bdb0c5963 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:53.839722 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fc9e67b2-050f-4953-aec6-c24bdb0c5963 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:53.841882 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fc9e67b2-050f-4953-aec6-c24bdb0c5963 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:53.843451 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fc9e67b2-050f-4953-aec6-c24bdb0c5963 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:53.890638 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-98468fdd-d502-4e18-8c4d-d276f3c485d2 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:53.893111 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:52:53.901122 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-98468fdd-d502-4e18-8c4d-d276f3c485d2 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/2098e0b9-b628-4b9e-979b-960c68830fee" status: 200 len: 1359 microversion: 2.1 time: 0.335665 Sep 14 08:52:53.917616 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 554/1126] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:53 2022] GET /compute/v2.1/servers/2098e0b9-b628-4b9e-979b-960c68830fee => generated 1359 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:52:53.923052 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-aa9855cb-6df5-41d8-87fa-589b36bbb5c7 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:53.923685 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-aa9855cb-6df5-41d8-87fa-589b36bbb5c7 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] [instance: 4df3f3eb-e900-497d-a1ed-f5e12a0d69a8] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:53.933817 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-aa9855cb-6df5-41d8-87fa-589b36bbb5c7 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:53.934542 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-aa9855cb-6df5-41d8-87fa-589b36bbb5c7 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:53.940908 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-aa9855cb-6df5-41d8-87fa-589b36bbb5c7 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:53.941731 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-aa9855cb-6df5-41d8-87fa-589b36bbb5c7 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:53.942226 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-aa9855cb-6df5-41d8-87fa-589b36bbb5c7 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:53.942675 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-aa9855cb-6df5-41d8-87fa-589b36bbb5c7 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:53.976643 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-aa9855cb-6df5-41d8-87fa-589b36bbb5c7 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] HTTP exception thrown: Instance 4df3f3eb-e900-497d-a1ed-f5e12a0d69a8 could not be found. Sep 14 08:52:53.986202 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-aa9855cb-6df5-41d8-87fa-589b36bbb5c7 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Request method failure captured: Sep 14 08:52:53.986202 n-d-836830-18 devstack@n-api.service[128758]: request: GET /compute/v2.1/servers/4df3f3eb-e900-497d-a1ed-f5e12a0d69a8 HTTP/1.1 Sep 14 08:52:53.986202 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 08:52:53.986202 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 08:52:53.986202 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 08:52:53.986202 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 08:52:53.986202 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 08:52:53.986202 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 08:52:53.986202 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 08:52:53.986202 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 08:52:53.986202 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZWK138Ps18GQEwLoBmhO0Hvnq1n8zIZnLeKzz6Mw2vHpgjb3Bx2HpWzPKBZs-SQXwcDd-PWEaI4snbLmBn2qDf5FMs8e5CERqW4qIQRV6ackSPgPz-lbL3l0dnfFp3onsN1Rh-gX4-O4bIy9T84pw52qPCm7tSSFv9tLLyKhOqGCNc Sep 14 08:52:53.986202 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 08:52:53.986202 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 08:52:53.986202 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 08:52:53.986202 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 08:52:53.986202 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 08:52:53.986202 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 08:52:53.986202 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: ee17e19b2f094a899dfc8966152fd642 Sep 14 08:52:53.986202 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1768249818 Sep 14 08:52:53.986202 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 08:52:53.986202 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 08:52:53.988080 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/ee17e19b2f094a899dfc8966152fd642"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_ee17e19b2f094a899dfc8966152fd642"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ee17e19b2f094a899dfc8966152fd642"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ee17e19b2f094a899dfc8966152fd642"}]}] Sep 14 08:52:53.988080 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1768249818 Sep 14 08:52:53.988080 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: ee17e19b2f094a899dfc8966152fd642 Sep 14 08:52:53.988080 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1768249818 Sep 14 08:52:53.988080 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1768249818-project Sep 14 08:52:53.988080 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 08:52:53.988080 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 08:52:53.988080 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 24b938da87b14cd79c3c6dd85818cd02 Sep 14 08:52:53.988080 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1768249818-project Sep 14 08:52:53.988080 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 08:52:53.988080 n-d-836830-18 devstack@n-api.service[128758]: exception: Instance 4df3f3eb-e900-497d-a1ed-f5e12a0d69a8 could not be found. Sep 14 08:52:53.988080 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': '4df3f3eb-e900-497d-a1ed-f5e12a0d69a8'} Sep 14 08:52:53.989247 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:52:53.989247 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:52:53.989247 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 08:52:53.989247 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 08:52:53.989247 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 08:52:53.989247 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 08:52:53.989247 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 08:52:53.989247 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 08:52:53.989247 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 08:52:53.989247 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 08:52:53.989247 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4df3f3eb-e900-497d-a1ed-f5e12a0d69a8 could not be found. Sep 14 08:52:53.989247 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:52:53.989247 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:52:53.989247 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:52:53.989247 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:52:53.989247 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:52:53.989247 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:52:53.989247 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:52:53.989247 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:52:53.989247 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:52:53.990805 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:52:53.990805 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 08:52:53.990805 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 08:52:53.990805 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 08:52:53.990805 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 08:52:53.990805 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 08:52:53.990805 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 08:52:53.990805 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4df3f3eb-e900-497d-a1ed-f5e12a0d69a8 could not be found. Sep 14 08:52:53.990805 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:52:53.990805 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:52:53.990805 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:52:53.990805 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:52:53.990805 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:52:53.990805 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:52:53.990805 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:52:53.990805 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:52:53.990805 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4df3f3eb-e900-497d-a1ed-f5e12a0d69a8 could not be found. Sep 14 08:52:53.990805 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:52:53.992307 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-aa9855cb-6df5-41d8-87fa-589b36bbb5c7 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Returning 404 to user: Instance 4df3f3eb-e900-497d-a1ed-f5e12a0d69a8 could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:52:53.992307 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-aa9855cb-6df5-41d8-87fa-589b36bbb5c7 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] 10.222.0.60 "GET /compute/v2.1/servers/4df3f3eb-e900-497d-a1ed-f5e12a0d69a8" status: 404 len: 111 microversion: 2.1 time: 0.068774 Sep 14 08:52:53.992307 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 555/1127] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:53 2022] GET /compute/v2.1/servers/4df3f3eb-e900-497d-a1ed-f5e12a0d69a8 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 08:52:53.995843 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-34f49960-d9f9-479f-b207-402fff30629d req-737eb405-1db3-4b78-b967-d54fa74db63c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af183467-9304-4c73-a29f-196e76ba21b5", "name": "network-vif-plugged", "status": "completed", "tag": "9664d857-e4a0-4edd-b5e2-e3a3058cb696"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:52:54.010358 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-34f49960-d9f9-479f-b207-402fff30629d req-737eb405-1db3-4b78-b967-d54fa74db63c service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:54.011096 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-34f49960-d9f9-479f-b207-402fff30629d req-737eb405-1db3-4b78-b967-d54fa74db63c service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:54.011716 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-34f49960-d9f9-479f-b207-402fff30629d req-737eb405-1db3-4b78-b967-d54fa74db63c service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:54.023913 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-34f49960-d9f9-479f-b207-402fff30629d req-737eb405-1db3-4b78-b967-d54fa74db63c service nova] Creating event network-vif-plugged:9664d857-e4a0-4edd-b5e2-e3a3058cb696 for instance af183467-9304-4c73-a29f-196e76ba21b5 on n-h1-836830-18 Sep 14 08:52:54.030015 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-34f49960-d9f9-479f-b207-402fff30629d req-737eb405-1db3-4b78-b967-d54fa74db63c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038704 Sep 14 08:52:54.030907 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 556/1128] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:52:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:52:54.038305 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-58470473-87c8-48ef-8cda-64bfea29fc97 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:54.039041 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-58470473-87c8-48ef-8cda-64bfea29fc97 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: af183467-9304-4c73-a29f-196e76ba21b5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:54.045434 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-58470473-87c8-48ef-8cda-64bfea29fc97 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:54.045920 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-58470473-87c8-48ef-8cda-64bfea29fc97 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:54.046350 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-58470473-87c8-48ef-8cda-64bfea29fc97 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:54.047072 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-58470473-87c8-48ef-8cda-64bfea29fc97 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:54.047524 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-58470473-87c8-48ef-8cda-64bfea29fc97 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:54.048216 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-58470473-87c8-48ef-8cda-64bfea29fc97 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:54.132904 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-fc9e67b2-050f-4953-aec6-c24bdb0c5963 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ace9012a7c4ce59c01858b6984b766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a87a909133e42e1a82e3a623536935c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:54.149863 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-fc9e67b2-050f-4953-aec6-c24bdb0c5963 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] 10.222.0.60 "GET /compute/v2.1/servers/67f3a983-b33f-49c8-9c91-988e8553563c" status: 200 len: 1324 microversion: 2.1 time: 0.348480 Sep 14 08:52:54.150523 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 573/1129] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:53 2022] GET /compute/v2.1/servers/67f3a983-b33f-49c8-9c91-988e8553563c => generated 1324 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:52:54.163218 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-fa0a373b-c59d-4867-b951-e596c400f650 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:54.163218 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-fa0a373b-c59d-4867-b951-e596c400f650 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] [instance: 2d2c444a-e84e-40c5-aec1-375cd14f67c8] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:54.176946 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fa0a373b-c59d-4867-b951-e596c400f650 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:54.179058 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fa0a373b-c59d-4867-b951-e596c400f650 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:54.179690 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fa0a373b-c59d-4867-b951-e596c400f650 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:54.180923 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fa0a373b-c59d-4867-b951-e596c400f650 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:54.182250 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fa0a373b-c59d-4867-b951-e596c400f650 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:54.182765 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fa0a373b-c59d-4867-b951-e596c400f650 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:54.217850 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-fa0a373b-c59d-4867-b951-e596c400f650 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] HTTP exception thrown: Instance 2d2c444a-e84e-40c5-aec1-375cd14f67c8 could not be found. Sep 14 08:52:54.220605 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-fa0a373b-c59d-4867-b951-e596c400f650 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Request method failure captured: Sep 14 08:52:54.220605 n-d-836830-18 devstack@n-api.service[128759]: request: DELETE /compute/v2.1/servers/2d2c444a-e84e-40c5-aec1-375cd14f67c8 HTTP/1.1 Sep 14 08:52:54.220605 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 08:52:54.220605 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 08:52:54.220605 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 08:52:54.220605 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 08:52:54.220605 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 08:52:54.220605 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 08:52:54.220605 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 08:52:54.220605 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 08:52:54.220605 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZWK138Ps18GQEwLoBmhO0Hvnq1n8zIZnLeKzz6Mw2vHpgjb3Bx2HpWzPKBZs-SQXwcDd-PWEaI4snbLmBn2qDf5FMs8e5CERqW4qIQRV6ackSPgPz-lbL3l0dnfFp3onsN1Rh-gX4-O4bIy9T84pw52qPCm7tSSFv9tLLyKhOqGCNc Sep 14 08:52:54.220605 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 08:52:54.220605 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 08:52:54.220605 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 08:52:54.220605 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 08:52:54.220605 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 08:52:54.220605 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 08:52:54.220605 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: ee17e19b2f094a899dfc8966152fd642 Sep 14 08:52:54.220605 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1768249818 Sep 14 08:52:54.220605 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 08:52:54.220605 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 08:52:54.222361 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/ee17e19b2f094a899dfc8966152fd642"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_ee17e19b2f094a899dfc8966152fd642"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ee17e19b2f094a899dfc8966152fd642"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ee17e19b2f094a899dfc8966152fd642"}]}] Sep 14 08:52:54.222361 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1768249818 Sep 14 08:52:54.222361 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: ee17e19b2f094a899dfc8966152fd642 Sep 14 08:52:54.222361 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1768249818 Sep 14 08:52:54.222361 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1768249818-project Sep 14 08:52:54.222361 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 08:52:54.222361 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 08:52:54.222361 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 24b938da87b14cd79c3c6dd85818cd02 Sep 14 08:52:54.222361 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1768249818-project Sep 14 08:52:54.222361 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 08:52:54.222361 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance 2d2c444a-e84e-40c5-aec1-375cd14f67c8 could not be found. Sep 14 08:52:54.222361 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '2d2c444a-e84e-40c5-aec1-375cd14f67c8'} Sep 14 08:52:54.223662 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:52:54.223662 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:52:54.223662 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 08:52:54.223662 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 08:52:54.223662 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 08:52:54.223662 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 08:52:54.223662 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 08:52:54.223662 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 08:52:54.223662 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 08:52:54.223662 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 08:52:54.223662 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d2c444a-e84e-40c5-aec1-375cd14f67c8 could not be found. Sep 14 08:52:54.223662 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:52:54.223662 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:52:54.223662 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:52:54.223662 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:52:54.223662 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:52:54.223662 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:52:54.223662 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:52:54.223662 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:52:54.223662 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:52:54.225836 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:52:54.225836 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 08:52:54.225836 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 08:52:54.225836 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 08:52:54.225836 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 08:52:54.225836 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 08:52:54.225836 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 08:52:54.225836 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 08:52:54.225836 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 08:52:54.225836 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d2c444a-e84e-40c5-aec1-375cd14f67c8 could not be found. Sep 14 08:52:54.225836 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:52:54.225836 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:52:54.225836 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:52:54.225836 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:52:54.225836 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:52:54.225836 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:52:54.225836 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:52:54.225836 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:52:54.225836 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d2c444a-e84e-40c5-aec1-375cd14f67c8 could not be found. Sep 14 08:52:54.225836 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:52:54.231651 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-fa0a373b-c59d-4867-b951-e596c400f650 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Returning 404 to user: Instance 2d2c444a-e84e-40c5-aec1-375cd14f67c8 could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:52:54.232787 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-fa0a373b-c59d-4867-b951-e596c400f650 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] 10.222.0.60 "DELETE /compute/v2.1/servers/2d2c444a-e84e-40c5-aec1-375cd14f67c8" status: 404 len: 111 microversion: 2.1 time: 0.081215 Sep 14 08:52:54.233532 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 574/1130] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 08:52:54 2022] DELETE /compute/v2.1/servers/2d2c444a-e84e-40c5-aec1-375cd14f67c8 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 08:52:54.244219 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-fc9a38ce-e5d0-4ea9-b696-568678cbe6d8 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:54.245226 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-fc9a38ce-e5d0-4ea9-b696-568678cbe6d8 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] [instance: 2d2c444a-e84e-40c5-aec1-375cd14f67c8] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:54.254347 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fc9a38ce-e5d0-4ea9-b696-568678cbe6d8 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:54.255210 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fc9a38ce-e5d0-4ea9-b696-568678cbe6d8 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:54.256174 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fc9a38ce-e5d0-4ea9-b696-568678cbe6d8 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:54.257021 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fc9a38ce-e5d0-4ea9-b696-568678cbe6d8 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:54.257659 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fc9a38ce-e5d0-4ea9-b696-568678cbe6d8 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:54.258424 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fc9a38ce-e5d0-4ea9-b696-568678cbe6d8 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:54.276755 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-fc9a38ce-e5d0-4ea9-b696-568678cbe6d8 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] HTTP exception thrown: Instance 2d2c444a-e84e-40c5-aec1-375cd14f67c8 could not be found. Sep 14 08:52:54.279479 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-fc9a38ce-e5d0-4ea9-b696-568678cbe6d8 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Request method failure captured: Sep 14 08:52:54.279479 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/2d2c444a-e84e-40c5-aec1-375cd14f67c8 HTTP/1.1 Sep 14 08:52:54.279479 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 08:52:54.279479 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 08:52:54.279479 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 08:52:54.279479 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 08:52:54.279479 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 08:52:54.279479 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 08:52:54.279479 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 08:52:54.279479 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 08:52:54.279479 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZWK138Ps18GQEwLoBmhO0Hvnq1n8zIZnLeKzz6Mw2vHpgjb3Bx2HpWzPKBZs-SQXwcDd-PWEaI4snbLmBn2qDf5FMs8e5CERqW4qIQRV6ackSPgPz-lbL3l0dnfFp3onsN1Rh-gX4-O4bIy9T84pw52qPCm7tSSFv9tLLyKhOqGCNc Sep 14 08:52:54.279479 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 08:52:54.279479 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 08:52:54.279479 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 08:52:54.279479 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 08:52:54.279479 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 08:52:54.279479 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 08:52:54.279479 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: ee17e19b2f094a899dfc8966152fd642 Sep 14 08:52:54.279479 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1768249818 Sep 14 08:52:54.279479 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 08:52:54.279479 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 08:52:54.281208 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/ee17e19b2f094a899dfc8966152fd642"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_ee17e19b2f094a899dfc8966152fd642"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ee17e19b2f094a899dfc8966152fd642"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ee17e19b2f094a899dfc8966152fd642"}]}] Sep 14 08:52:54.281208 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1768249818 Sep 14 08:52:54.281208 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: ee17e19b2f094a899dfc8966152fd642 Sep 14 08:52:54.281208 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1768249818 Sep 14 08:52:54.281208 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1768249818-project Sep 14 08:52:54.281208 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 08:52:54.281208 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 08:52:54.281208 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 24b938da87b14cd79c3c6dd85818cd02 Sep 14 08:52:54.281208 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1768249818-project Sep 14 08:52:54.281208 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 08:52:54.281208 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance 2d2c444a-e84e-40c5-aec1-375cd14f67c8 could not be found. Sep 14 08:52:54.281208 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '2d2c444a-e84e-40c5-aec1-375cd14f67c8'} Sep 14 08:52:54.282140 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:52:54.282140 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:52:54.282140 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 08:52:54.282140 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 08:52:54.282140 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 08:52:54.282140 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 08:52:54.282140 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 08:52:54.282140 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 08:52:54.282140 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 08:52:54.282140 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 08:52:54.282140 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d2c444a-e84e-40c5-aec1-375cd14f67c8 could not be found. Sep 14 08:52:54.282140 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:52:54.282140 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:52:54.282140 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:52:54.282140 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:52:54.282140 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:52:54.282140 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:52:54.282140 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:52:54.282140 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:52:54.282140 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:52:54.283589 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:52:54.283589 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 08:52:54.283589 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 08:52:54.283589 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 08:52:54.283589 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 08:52:54.283589 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 08:52:54.283589 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 08:52:54.283589 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d2c444a-e84e-40c5-aec1-375cd14f67c8 could not be found. Sep 14 08:52:54.283589 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:52:54.283589 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:52:54.283589 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:52:54.283589 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:52:54.283589 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:52:54.283589 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:52:54.283589 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:52:54.283589 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:52:54.283589 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d2c444a-e84e-40c5-aec1-375cd14f67c8 could not be found. Sep 14 08:52:54.283589 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:52:54.285800 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-fc9a38ce-e5d0-4ea9-b696-568678cbe6d8 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Returning 404 to user: Instance 2d2c444a-e84e-40c5-aec1-375cd14f67c8 could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:52:54.286733 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-fc9a38ce-e5d0-4ea9-b696-568678cbe6d8 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] 10.222.0.60 "GET /compute/v2.1/servers/2d2c444a-e84e-40c5-aec1-375cd14f67c8" status: 404 len: 111 microversion: 2.1 time: 0.048850 Sep 14 08:52:54.291523 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 575/1131] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:54 2022] GET /compute/v2.1/servers/2d2c444a-e84e-40c5-aec1-375cd14f67c8 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 08:52:54.296952 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-15700600-d089-47f5-899f-d513b940b3e1 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Calling method '.version_select at 0x7f7d44274820>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:54.323558 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-15700600-d089-47f5-899f-d513b940b3e1 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1720139900" status: 202 len: 0 microversion: 2.1 time: 0.030729 Sep 14 08:52:54.328818 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 576/1132] 10.222.0.60 () {58 vars in 1221 bytes} [Wed Sep 14 08:52:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1720139900 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 08:52:54.381066 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-58470473-87c8-48ef-8cda-64bfea29fc97 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:54.390675 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-58470473-87c8-48ef-8cda-64bfea29fc97 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/af183467-9304-4c73-a29f-196e76ba21b5" status: 200 len: 1527 microversion: 2.1 time: 0.358329 Sep 14 08:52:54.391572 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 557/1133] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:54 2022] GET /compute/v2.1/servers/af183467-9304-4c73-a29f-196e76ba21b5 => generated 1527 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:52:54.415476 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8c6012f8-9165-4044-aff4-f8897ab3be59 tempest-MigrationsAdminTest-1443382137 tempest-MigrationsAdminTest-1443382137-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:54.422983 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-8c6012f8-9165-4044-aff4-f8897ab3be59 tempest-MigrationsAdminTest-1443382137 tempest-MigrationsAdminTest-1443382137-project-admin] HTTP exception thrown: Flavor 306d3b58-2a12-439e-a2b9-f9aaae74d166 could not be found. Sep 14 08:52:54.431095 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8c6012f8-9165-4044-aff4-f8897ab3be59 tempest-MigrationsAdminTest-1443382137 tempest-MigrationsAdminTest-1443382137-project-admin] Request method failure captured: Sep 14 08:52:54.431095 n-d-836830-18 devstack@n-api.service[128759]: request: DELETE /compute/v2.1/flavors/306d3b58-2a12-439e-a2b9-f9aaae74d166 HTTP/1.1 Sep 14 08:52:54.431095 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 08:52:54.431095 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 08:52:54.431095 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 08:52:54.431095 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 08:52:54.431095 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 08:52:54.431095 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 08:52:54.431095 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 08:52:54.431095 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 08:52:54.431095 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZVXjE1l_cAsYQ7u1ZSS-J_MbjPIcz5YYEVuwGPFIRN0t2h281t5bOx5ScHK-zqztNByPgrpQErhIa6tMMiXeFR2xwOL99lu6MpCyEuiykhD4M3hyDVOo5wFqq8lTjRD_S0D0W9hRfXfUc6FjYNmrWva77XxQfFzIedQot64wi6n2mk Sep 14 08:52:54.431095 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 08:52:54.431095 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 08:52:54.431095 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 08:52:54.431095 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 08:52:54.431095 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 08:52:54.431095 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 08:52:54.431095 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: f46b97c8b36a4f30a38a14e4a5eb8f67 Sep 14 08:52:54.431095 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-MigrationsAdminTest-1443382137 Sep 14 08:52:54.431095 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member,admin Sep 14 08:52:54.431095 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member,admin Sep 14 08:52:54.432550 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f46b97c8b36a4f30a38a14e4a5eb8f67"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f46b97c8b36a4f30a38a14e4a5eb8f67"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f46b97c8b36a4f30a38a14e4a5eb8f67"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f46b97c8b36a4f30a38a14e4a5eb8f67"}]}] Sep 14 08:52:54.432550 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-MigrationsAdminTest-1443382137 Sep 14 08:52:54.432550 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: f46b97c8b36a4f30a38a14e4a5eb8f67 Sep 14 08:52:54.432550 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-MigrationsAdminTest-1443382137 Sep 14 08:52:54.432550 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-MigrationsAdminTest-1443382137-project-admin Sep 14 08:52:54.432550 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 08:52:54.432550 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 08:52:54.432550 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 18b58b52cd8843628ba2ba791b030943 Sep 14 08:52:54.432550 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-MigrationsAdminTest-1443382137-project-admin Sep 14 08:52:54.432550 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 08:52:54.432550 n-d-836830-18 devstack@n-api.service[128759]: exception: Flavor 306d3b58-2a12-439e-a2b9-f9aaae74d166 could not be found. Sep 14 08:52:54.432550 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '306d3b58-2a12-439e-a2b9-f9aaae74d166'} Sep 14 08:52:54.433404 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:52:54.433404 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:52:54.433404 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Sep 14 08:52:54.433404 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi flavor.destroy() Sep 14 08:52:54.433404 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 14 08:52:54.433404 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 14 08:52:54.433404 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Sep 14 08:52:54.433404 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Sep 14 08:52:54.433404 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Sep 14 08:52:54.433404 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Sep 14 08:52:54.433404 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 14 08:52:54.433404 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 14 08:52:54.433404 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Sep 14 08:52:54.433404 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Sep 14 08:52:54.433404 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 306d3b58-2a12-439e-a2b9-f9aaae74d166 could not be found. Sep 14 08:52:54.433404 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:52:54.433404 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:52:54.433404 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:52:54.433404 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:52:54.433404 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:52:54.436582 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:52:54.436582 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:52:54.436582 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:52:54.436582 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:52:54.436582 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:52:54.436582 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Sep 14 08:52:54.436582 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 14 08:52:54.436582 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 306d3b58-2a12-439e-a2b9-f9aaae74d166 could not be found. Sep 14 08:52:54.436582 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:52:54.436582 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:52:54.436582 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:52:54.436582 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:52:54.436582 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:52:54.436582 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:52:54.436582 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:52:54.436582 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:52:54.436582 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 306d3b58-2a12-439e-a2b9-f9aaae74d166 could not be found. Sep 14 08:52:54.436582 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:52:54.437744 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8c6012f8-9165-4044-aff4-f8897ab3be59 tempest-MigrationsAdminTest-1443382137 tempest-MigrationsAdminTest-1443382137-project-admin] Returning 404 to user: Flavor 306d3b58-2a12-439e-a2b9-f9aaae74d166 could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:52:54.437744 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-8c6012f8-9165-4044-aff4-f8897ab3be59 tempest-MigrationsAdminTest-1443382137 tempest-MigrationsAdminTest-1443382137-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/306d3b58-2a12-439e-a2b9-f9aaae74d166" status: 404 len: 109 microversion: 2.1 time: 0.021882 Sep 14 08:52:54.437744 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 577/1134] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 08:52:54 2022] DELETE /compute/v2.1/flavors/306d3b58-2a12-439e-a2b9-f9aaae74d166 => generated 109 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 08:52:54.481202 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a4a871cc-b62f-4501-8448-0036c05d8c26 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:54.481743 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-a4a871cc-b62f-4501-8448-0036c05d8c26 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] [instance: 307b2830-67e6-44ec-845f-9894de16694a] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:54.488235 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a4a871cc-b62f-4501-8448-0036c05d8c26 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:54.488727 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a4a871cc-b62f-4501-8448-0036c05d8c26 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:54.489160 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a4a871cc-b62f-4501-8448-0036c05d8c26 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:54.490420 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a4a871cc-b62f-4501-8448-0036c05d8c26 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:54.492671 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a4a871cc-b62f-4501-8448-0036c05d8c26 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:54.493406 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a4a871cc-b62f-4501-8448-0036c05d8c26 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:54.555065 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a4a871cc-b62f-4501-8448-0036c05d8c26 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:54.555872 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a4a871cc-b62f-4501-8448-0036c05d8c26 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:54.556572 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a4a871cc-b62f-4501-8448-0036c05d8c26 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:54.557277 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.objects.instance [None req-a4a871cc-b62f-4501-8448-0036c05d8c26 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lazy-loading 'fault' on Instance uuid 307b2830-67e6-44ec-845f-9894de16694a {{(pid=128758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 08:52:54.651350 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-a4a871cc-b62f-4501-8448-0036c05d8c26 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c7802984cf48d1852832b52abe52e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e326f95a9604fdb9bd075db3837cf62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:54.659134 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-4fb553e6-8b18-4ed5-aedc-f179d20f6230 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-478929153", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:52:54.663714 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-a4a871cc-b62f-4501-8448-0036c05d8c26 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] 10.222.0.60 "GET /compute/v2.1/servers/307b2830-67e6-44ec-845f-9894de16694a" status: 200 len: 1306 microversion: 2.1 time: 0.189135 Sep 14 08:52:54.684536 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 558/1135] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:54 2022] GET /compute/v2.1/servers/307b2830-67e6-44ec-845f-9894de16694a => generated 1306 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:52:54.759596 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.network.neutron [None req-4fb553e6-8b18-4ed5-aedc-f179d20f6230 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] validate_networks() for None {{(pid=128759) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 08:52:54.928710 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-94a7c060-107e-4843-9638-0d0b37f54f4f tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:54.929507 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-94a7c060-107e-4843-9638-0d0b37f54f4f tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: 2098e0b9-b628-4b9e-979b-960c68830fee] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:54.946619 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-94a7c060-107e-4843-9638-0d0b37f54f4f tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:54.950513 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-94a7c060-107e-4843-9638-0d0b37f54f4f tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:54.952738 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-94a7c060-107e-4843-9638-0d0b37f54f4f tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:54.953712 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-94a7c060-107e-4843-9638-0d0b37f54f4f tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:54.957460 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-94a7c060-107e-4843-9638-0d0b37f54f4f tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:54.958172 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-94a7c060-107e-4843-9638-0d0b37f54f4f tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:55.241465 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-4fb553e6-8b18-4ed5-aedc-f179d20f6230 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Flavor limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 08:52:55.241981 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-4fb553e6-8b18-4ed5-aedc-f179d20f6230 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Image limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 08:52:55.243378 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-4fb553e6-8b18-4ed5-aedc-f179d20f6230 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Flavor pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 08:52:55.244005 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-4fb553e6-8b18-4ed5-aedc-f179d20f6230 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Image pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 08:52:55.244952 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-4fb553e6-8b18-4ed5-aedc-f179d20f6230 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 08:52:55.255385 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4fb553e6-8b18-4ed5-aedc-f179d20f6230 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:55.255973 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4fb553e6-8b18-4ed5-aedc-f179d20f6230 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:55.256476 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4fb553e6-8b18-4ed5-aedc-f179d20f6230 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:55.257524 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4fb553e6-8b18-4ed5-aedc-f179d20f6230 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:55.258284 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4fb553e6-8b18-4ed5-aedc-f179d20f6230 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:55.258779 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4fb553e6-8b18-4ed5-aedc-f179d20f6230 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:55.279136 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-4fb553e6-8b18-4ed5-aedc-f179d20f6230 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Getting quotas for project 8fd62edd611c4390be2403972b99aa15. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 08:52:55.299320 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-4fb553e6-8b18-4ed5-aedc-f179d20f6230 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Getting quotas for user 264fb30236d54248ad0ecf79a177849f and project 8fd62edd611c4390be2403972b99aa15. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 08:52:55.304446 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-94a7c060-107e-4843-9638-0d0b37f54f4f tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:55.313140 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-94a7c060-107e-4843-9638-0d0b37f54f4f tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/2098e0b9-b628-4b9e-979b-960c68830fee" status: 200 len: 1542 microversion: 2.1 time: 0.391724 Sep 14 08:52:55.316047 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-4fb553e6-8b18-4ed5-aedc-f179d20f6230 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Going to run 1 instances... {{(pid=128759) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 08:52:55.319384 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-4fb553e6-8b18-4ed5-aedc-f179d20f6230 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: 1b2a9a93-cad5-4b18-abc3-1b88413f88da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128759) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 08:52:55.328138 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 559/1136] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:54 2022] GET /compute/v2.1/servers/2098e0b9-b628-4b9e-979b-960c68830fee => generated 1542 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:52:55.338089 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-71acbe52-50eb-4742-bdd6-22cf82bfded0 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:55.338736 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-71acbe52-50eb-4742-bdd6-22cf82bfded0 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] [instance: 67f3a983-b33f-49c8-9c91-988e8553563c] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:55.345554 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-71acbe52-50eb-4742-bdd6-22cf82bfded0 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:55.346300 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-71acbe52-50eb-4742-bdd6-22cf82bfded0 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:55.347068 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-71acbe52-50eb-4742-bdd6-22cf82bfded0 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:55.348278 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-71acbe52-50eb-4742-bdd6-22cf82bfded0 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:55.348744 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-71acbe52-50eb-4742-bdd6-22cf82bfded0 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:55.349240 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-71acbe52-50eb-4742-bdd6-22cf82bfded0 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:55.389246 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-4fb553e6-8b18-4ed5-aedc-f179d20f6230 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.736048 Sep 14 08:52:55.389906 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 578/1137] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 08:52:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 737 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 08:52:55.394481 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-083f74c7-60a1-415a-9715-a6bd208a950f tempest-ServersWithSpecificFlavorTestJSON-583330009 tempest-ServersWithSpecificFlavorTestJSON-583330009-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:55.419659 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-083f74c7-60a1-415a-9715-a6bd208a950f tempest-ServersWithSpecificFlavorTestJSON-583330009 tempest-ServersWithSpecificFlavorTestJSON-583330009-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/654124095" status: 202 len: 0 microversion: 2.1 time: 0.028671 Sep 14 08:52:55.420630 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 579/1138] 10.222.0.60 () {58 vars in 1158 bytes} [Wed Sep 14 08:52:55 2022] DELETE /compute/v2.1/flavors/654124095 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 08:52:55.426151 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-800afe0b-dff1-4930-9e2f-6c5da4a1844a tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:55.426928 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-800afe0b-dff1-4930-9e2f-6c5da4a1844a tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: 2098e0b9-b628-4b9e-979b-960c68830fee] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:55.436031 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-800afe0b-dff1-4930-9e2f-6c5da4a1844a tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:55.436875 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-800afe0b-dff1-4930-9e2f-6c5da4a1844a tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:55.437520 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-800afe0b-dff1-4930-9e2f-6c5da4a1844a tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:55.438467 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-800afe0b-dff1-4930-9e2f-6c5da4a1844a tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:55.439775 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-800afe0b-dff1-4930-9e2f-6c5da4a1844a tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:55.441394 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-800afe0b-dff1-4930-9e2f-6c5da4a1844a tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:55.550429 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-800afe0b-dff1-4930-9e2f-6c5da4a1844a tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/2098e0b9-b628-4b9e-979b-960c68830fee/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.128437 Sep 14 08:52:55.551270 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 580/1139] 10.222.0.60 () {58 vars in 1275 bytes} [Wed Sep 14 08:52:55 2022] GET /compute/v2.1/servers/2098e0b9-b628-4b9e-979b-960c68830fee/os-interface => generated 284 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:52:55.557314 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-32545604-0cba-4192-bc70-9a858a70f333 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:55.557943 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-32545604-0cba-4192-bc70-9a858a70f333 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: 1b2a9a93-cad5-4b18-abc3-1b88413f88da] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:55.569288 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-71acbe52-50eb-4742-bdd6-22cf82bfded0 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ace9012a7c4ce59c01858b6984b766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a87a909133e42e1a82e3a623536935c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:55.578284 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-71acbe52-50eb-4742-bdd6-22cf82bfded0 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] 10.222.0.60 "GET /compute/v2.1/servers/67f3a983-b33f-49c8-9c91-988e8553563c" status: 200 len: 1324 microversion: 2.1 time: 0.248310 Sep 14 08:52:55.578888 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 560/1140] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:55 2022] GET /compute/v2.1/servers/67f3a983-b33f-49c8-9c91-988e8553563c => generated 1324 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:52:55.599077 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-86279cee-0651-4405-9c29-f095f28e23c9 tempest-ServersWithSpecificFlavorTestJSON-583330009 tempest-ServersWithSpecificFlavorTestJSON-583330009-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:55.642088 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-32545604-0cba-4192-bc70-9a858a70f333 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:55.649863 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-32545604-0cba-4192-bc70-9a858a70f333 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/1b2a9a93-cad5-4b18-abc3-1b88413f88da" status: 200 len: 1212 microversion: 2.1 time: 0.097705 Sep 14 08:52:55.651019 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 581/1141] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:55 2022] GET /compute/v2.1/servers/1b2a9a93-cad5-4b18-abc3-1b88413f88da => generated 1212 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:52:55.657125 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-86279cee-0651-4405-9c29-f095f28e23c9 tempest-ServersWithSpecificFlavorTestJSON-583330009 tempest-ServersWithSpecificFlavorTestJSON-583330009-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 5402 microversion: 2.1 time: 0.064904 Sep 14 08:52:55.657964 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 561/1142] 10.222.0.60 () {58 vars in 1146 bytes} [Wed Sep 14 08:52:55 2022] GET /compute/v2.1/flavors/detail => generated 5402 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:52:55.678049 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-5a56409e-38f1-4f48-8531-a5cf9a5c7bf1 tempest-ServersWithSpecificFlavorTestJSON-583330009 tempest-ServersWithSpecificFlavorTestJSON-583330009-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:55.694213 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-77383222-8f21-4853-9955-56db9532d166 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:55.695712 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-77383222-8f21-4853-9955-56db9532d166 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] [instance: 307b2830-67e6-44ec-845f-9894de16694a] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:55.706574 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-77383222-8f21-4853-9955-56db9532d166 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:55.707076 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-77383222-8f21-4853-9955-56db9532d166 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:55.707727 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-77383222-8f21-4853-9955-56db9532d166 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:55.708483 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-77383222-8f21-4853-9955-56db9532d166 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:55.709565 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-77383222-8f21-4853-9955-56db9532d166 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:55.712270 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-77383222-8f21-4853-9955-56db9532d166 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:55.721319 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-5a56409e-38f1-4f48-8531-a5cf9a5c7bf1 tempest-ServersWithSpecificFlavorTestJSON-583330009 tempest-ServersWithSpecificFlavorTestJSON-583330009-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/120035608" status: 202 len: 0 microversion: 2.1 time: 0.047580 Sep 14 08:52:55.722137 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 582/1143] 10.222.0.60 () {58 vars in 1158 bytes} [Wed Sep 14 08:52:55 2022] DELETE /compute/v2.1/flavors/120035608 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 08:52:55.737468 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-211789ac-e386-45f3-8331-56f670f83780 tempest-ServersWithSpecificFlavorTestJSON-583330009 tempest-ServersWithSpecificFlavorTestJSON-583330009-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:55.737678 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-77383222-8f21-4853-9955-56db9532d166 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] HTTP exception thrown: Instance 307b2830-67e6-44ec-845f-9894de16694a could not be found. Sep 14 08:52:55.739265 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-77383222-8f21-4853-9955-56db9532d166 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Request method failure captured: Sep 14 08:52:55.739265 n-d-836830-18 devstack@n-api.service[128758]: request: GET /compute/v2.1/servers/307b2830-67e6-44ec-845f-9894de16694a HTTP/1.1 Sep 14 08:52:55.739265 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 08:52:55.739265 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 08:52:55.739265 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 08:52:55.739265 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 08:52:55.739265 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 08:52:55.739265 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 08:52:55.739265 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 08:52:55.739265 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 08:52:55.739265 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZWCl-PBW4XwTIAlm_HDzFNUEwKCR-QX8kRMQlkDQ28-th7Hv5Ami7B5CdfKebuOcYBY8pBDcErYnw6Yoo-AEMZOR30AfoQXWHysSwGGQuX7FJimJhZb77LDAXJX1PJ_CPAwODcQceVHue0gK59ez0nQzHL0ZkFBiu-KQzoh7YQB5n0 Sep 14 08:52:55.739265 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 08:52:55.739265 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 08:52:55.739265 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 08:52:55.739265 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 08:52:55.739265 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 08:52:55.739265 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 08:52:55.739265 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 5e326f95a9604fdb9bd075db3837cf62 Sep 14 08:52:55.739265 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-ServersOnMultiNodesTest-1258517383 Sep 14 08:52:55.739265 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 08:52:55.739265 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 08:52:55.740694 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/5e326f95a9604fdb9bd075db3837cf62"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_5e326f95a9604fdb9bd075db3837cf62"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5e326f95a9604fdb9bd075db3837cf62"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5e326f95a9604fdb9bd075db3837cf62"}]}] Sep 14 08:52:55.740694 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-ServersOnMultiNodesTest-1258517383 Sep 14 08:52:55.740694 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 5e326f95a9604fdb9bd075db3837cf62 Sep 14 08:52:55.740694 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1258517383 Sep 14 08:52:55.740694 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-ServersOnMultiNodesTest-1258517383-project Sep 14 08:52:55.740694 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 08:52:55.740694 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 08:52:55.740694 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 89c7802984cf48d1852832b52abe52e9 Sep 14 08:52:55.740694 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-ServersOnMultiNodesTest-1258517383-project Sep 14 08:52:55.740694 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 08:52:55.740694 n-d-836830-18 devstack@n-api.service[128758]: exception: Instance 307b2830-67e6-44ec-845f-9894de16694a could not be found. Sep 14 08:52:55.740694 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': '307b2830-67e6-44ec-845f-9894de16694a'} Sep 14 08:52:55.741471 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:52:55.741471 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:52:55.741471 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 08:52:55.741471 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 08:52:55.741471 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 08:52:55.741471 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 08:52:55.741471 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 08:52:55.741471 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 08:52:55.741471 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 08:52:55.741471 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 08:52:55.741471 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 307b2830-67e6-44ec-845f-9894de16694a could not be found. Sep 14 08:52:55.741471 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:52:55.741471 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:52:55.741471 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:52:55.741471 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:52:55.741471 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:52:55.741471 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:52:55.741471 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:52:55.741471 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:52:55.741471 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:52:55.742726 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:52:55.742726 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 08:52:55.742726 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 08:52:55.742726 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 08:52:55.742726 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 08:52:55.742726 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 08:52:55.742726 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 08:52:55.742726 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 307b2830-67e6-44ec-845f-9894de16694a could not be found. Sep 14 08:52:55.742726 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:52:55.742726 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:52:55.742726 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:52:55.742726 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:52:55.742726 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:52:55.742726 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:52:55.742726 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:52:55.742726 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:52:55.742726 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 307b2830-67e6-44ec-845f-9894de16694a could not be found. Sep 14 08:52:55.742726 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:52:55.743903 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-77383222-8f21-4853-9955-56db9532d166 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] Returning 404 to user: Instance 307b2830-67e6-44ec-845f-9894de16694a could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:52:55.743903 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-77383222-8f21-4853-9955-56db9532d166 tempest-ServersOnMultiNodesTest-1258517383 tempest-ServersOnMultiNodesTest-1258517383-project] 10.222.0.60 "GET /compute/v2.1/servers/307b2830-67e6-44ec-845f-9894de16694a" status: 404 len: 111 microversion: 2.1 time: 0.050979 Sep 14 08:52:55.743903 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 562/1144] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:55 2022] GET /compute/v2.1/servers/307b2830-67e6-44ec-845f-9894de16694a => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 14 08:52:55.785345 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-211789ac-e386-45f3-8331-56f670f83780 tempest-ServersWithSpecificFlavorTestJSON-583330009 tempest-ServersWithSpecificFlavorTestJSON-583330009-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.056078 Sep 14 08:52:55.786646 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 583/1145] 10.222.0.60 () {58 vars in 1146 bytes} [Wed Sep 14 08:52:55 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:52:55.808735 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d78c9544-4299-4bc1-8890-c2bc3ca2e8b9 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:55.809651 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-d78c9544-4299-4bc1-8890-c2bc3ca2e8b9 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] [instance: 4df3f3eb-e900-497d-a1ed-f5e12a0d69a8] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:55.817357 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=3 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:52:55.821549 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d78c9544-4299-4bc1-8890-c2bc3ca2e8b9 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:55.823750 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d78c9544-4299-4bc1-8890-c2bc3ca2e8b9 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:55.824242 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d78c9544-4299-4bc1-8890-c2bc3ca2e8b9 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:55.826864 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d78c9544-4299-4bc1-8890-c2bc3ca2e8b9 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:55.830126 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d78c9544-4299-4bc1-8890-c2bc3ca2e8b9 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:55.830793 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d78c9544-4299-4bc1-8890-c2bc3ca2e8b9 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:55.859730 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-d78c9544-4299-4bc1-8890-c2bc3ca2e8b9 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] HTTP exception thrown: Instance 4df3f3eb-e900-497d-a1ed-f5e12a0d69a8 could not be found. Sep 14 08:52:55.862353 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d78c9544-4299-4bc1-8890-c2bc3ca2e8b9 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Request method failure captured: Sep 14 08:52:55.862353 n-d-836830-18 devstack@n-api.service[128758]: request: DELETE /compute/v2.1/servers/4df3f3eb-e900-497d-a1ed-f5e12a0d69a8 HTTP/1.1 Sep 14 08:52:55.862353 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 08:52:55.862353 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 08:52:55.862353 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 08:52:55.862353 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 08:52:55.862353 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 08:52:55.862353 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 08:52:55.862353 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 08:52:55.862353 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 08:52:55.862353 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZWK138Ps18GQEwLoBmhO0Hvnq1n8zIZnLeKzz6Mw2vHpgjb3Bx2HpWzPKBZs-SQXwcDd-PWEaI4snbLmBn2qDf5FMs8e5CERqW4qIQRV6ackSPgPz-lbL3l0dnfFp3onsN1Rh-gX4-O4bIy9T84pw52qPCm7tSSFv9tLLyKhOqGCNc Sep 14 08:52:55.862353 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 08:52:55.862353 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 08:52:55.862353 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 08:52:55.862353 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 08:52:55.862353 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 08:52:55.862353 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 08:52:55.862353 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: ee17e19b2f094a899dfc8966152fd642 Sep 14 08:52:55.862353 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1768249818 Sep 14 08:52:55.862353 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 08:52:55.862353 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 08:52:55.864298 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/ee17e19b2f094a899dfc8966152fd642"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_ee17e19b2f094a899dfc8966152fd642"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ee17e19b2f094a899dfc8966152fd642"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ee17e19b2f094a899dfc8966152fd642"}]}] Sep 14 08:52:55.864298 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1768249818 Sep 14 08:52:55.864298 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: ee17e19b2f094a899dfc8966152fd642 Sep 14 08:52:55.864298 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1768249818 Sep 14 08:52:55.864298 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1768249818-project Sep 14 08:52:55.864298 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 08:52:55.864298 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 08:52:55.864298 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 24b938da87b14cd79c3c6dd85818cd02 Sep 14 08:52:55.864298 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1768249818-project Sep 14 08:52:55.864298 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 08:52:55.864298 n-d-836830-18 devstack@n-api.service[128758]: exception: Instance 4df3f3eb-e900-497d-a1ed-f5e12a0d69a8 could not be found. Sep 14 08:52:55.864298 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': '4df3f3eb-e900-497d-a1ed-f5e12a0d69a8'} Sep 14 08:52:55.865254 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:52:55.865254 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:52:55.865254 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 08:52:55.865254 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 08:52:55.865254 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 08:52:55.865254 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 08:52:55.865254 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 08:52:55.865254 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 08:52:55.865254 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 08:52:55.865254 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 08:52:55.865254 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4df3f3eb-e900-497d-a1ed-f5e12a0d69a8 could not be found. Sep 14 08:52:55.865254 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:52:55.865254 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:52:55.865254 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:52:55.865254 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:52:55.865254 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:52:55.865254 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:52:55.865254 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:52:55.865254 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:52:55.865254 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:52:55.866757 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:52:55.866757 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 08:52:55.866757 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 08:52:55.866757 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 08:52:55.866757 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 08:52:55.866757 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 08:52:55.866757 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 08:52:55.866757 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 08:52:55.866757 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 08:52:55.866757 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4df3f3eb-e900-497d-a1ed-f5e12a0d69a8 could not be found. Sep 14 08:52:55.866757 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:52:55.866757 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:52:55.866757 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:52:55.866757 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:52:55.866757 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:52:55.866757 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:52:55.866757 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:52:55.866757 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:52:55.866757 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4df3f3eb-e900-497d-a1ed-f5e12a0d69a8 could not be found. Sep 14 08:52:55.866757 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:52:55.868390 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d78c9544-4299-4bc1-8890-c2bc3ca2e8b9 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Returning 404 to user: Instance 4df3f3eb-e900-497d-a1ed-f5e12a0d69a8 could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:52:55.868390 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-d78c9544-4299-4bc1-8890-c2bc3ca2e8b9 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] 10.222.0.60 "DELETE /compute/v2.1/servers/4df3f3eb-e900-497d-a1ed-f5e12a0d69a8" status: 404 len: 111 microversion: 2.1 time: 0.061917 Sep 14 08:52:55.872385 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 563/1146] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 08:52:55 2022] DELETE /compute/v2.1/servers/4df3f3eb-e900-497d-a1ed-f5e12a0d69a8 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 08:52:55.878125 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8cbc164c-122b-417b-b4b1-e10415f78035 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:55.879041 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-8cbc164c-122b-417b-b4b1-e10415f78035 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] [instance: 4df3f3eb-e900-497d-a1ed-f5e12a0d69a8] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:55.887500 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8cbc164c-122b-417b-b4b1-e10415f78035 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:55.888586 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8cbc164c-122b-417b-b4b1-e10415f78035 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:55.889733 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8cbc164c-122b-417b-b4b1-e10415f78035 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:55.892067 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8cbc164c-122b-417b-b4b1-e10415f78035 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:55.893444 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8cbc164c-122b-417b-b4b1-e10415f78035 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:55.895992 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8cbc164c-122b-417b-b4b1-e10415f78035 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:55.917855 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-8cbc164c-122b-417b-b4b1-e10415f78035 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] HTTP exception thrown: Instance 4df3f3eb-e900-497d-a1ed-f5e12a0d69a8 could not be found. Sep 14 08:52:55.919464 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8cbc164c-122b-417b-b4b1-e10415f78035 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Request method failure captured: Sep 14 08:52:55.919464 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/4df3f3eb-e900-497d-a1ed-f5e12a0d69a8 HTTP/1.1 Sep 14 08:52:55.919464 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 08:52:55.919464 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 08:52:55.919464 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 08:52:55.919464 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 08:52:55.919464 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 08:52:55.919464 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 08:52:55.919464 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 08:52:55.919464 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 08:52:55.919464 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZWK138Ps18GQEwLoBmhO0Hvnq1n8zIZnLeKzz6Mw2vHpgjb3Bx2HpWzPKBZs-SQXwcDd-PWEaI4snbLmBn2qDf5FMs8e5CERqW4qIQRV6ackSPgPz-lbL3l0dnfFp3onsN1Rh-gX4-O4bIy9T84pw52qPCm7tSSFv9tLLyKhOqGCNc Sep 14 08:52:55.919464 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 08:52:55.919464 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 08:52:55.919464 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 08:52:55.919464 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 08:52:55.919464 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 08:52:55.919464 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 08:52:55.919464 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: ee17e19b2f094a899dfc8966152fd642 Sep 14 08:52:55.919464 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1768249818 Sep 14 08:52:55.919464 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 08:52:55.919464 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 08:52:55.920823 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/ee17e19b2f094a899dfc8966152fd642"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_ee17e19b2f094a899dfc8966152fd642"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ee17e19b2f094a899dfc8966152fd642"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ee17e19b2f094a899dfc8966152fd642"}]}] Sep 14 08:52:55.920823 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1768249818 Sep 14 08:52:55.920823 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: ee17e19b2f094a899dfc8966152fd642 Sep 14 08:52:55.920823 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1768249818 Sep 14 08:52:55.920823 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1768249818-project Sep 14 08:52:55.920823 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 08:52:55.920823 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 08:52:55.920823 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 24b938da87b14cd79c3c6dd85818cd02 Sep 14 08:52:55.920823 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1768249818-project Sep 14 08:52:55.920823 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 08:52:55.920823 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance 4df3f3eb-e900-497d-a1ed-f5e12a0d69a8 could not be found. Sep 14 08:52:55.920823 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '4df3f3eb-e900-497d-a1ed-f5e12a0d69a8'} Sep 14 08:52:55.925225 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:52:55.925225 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:52:55.925225 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 08:52:55.925225 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 08:52:55.925225 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 08:52:55.925225 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 08:52:55.925225 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 08:52:55.925225 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 08:52:55.925225 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 08:52:55.925225 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 08:52:55.925225 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4df3f3eb-e900-497d-a1ed-f5e12a0d69a8 could not be found. Sep 14 08:52:55.925225 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:52:55.925225 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:52:55.925225 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:52:55.925225 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:52:55.925225 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:52:55.925225 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:52:55.925225 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:52:55.925225 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:52:55.925225 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:52:55.926593 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:52:55.926593 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 08:52:55.926593 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 08:52:55.926593 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 08:52:55.926593 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 08:52:55.926593 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 08:52:55.926593 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 08:52:55.926593 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4df3f3eb-e900-497d-a1ed-f5e12a0d69a8 could not be found. Sep 14 08:52:55.926593 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:52:55.926593 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:52:55.926593 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:52:55.926593 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:52:55.926593 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:52:55.926593 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:52:55.926593 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:52:55.926593 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:52:55.926593 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4df3f3eb-e900-497d-a1ed-f5e12a0d69a8 could not be found. Sep 14 08:52:55.926593 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:52:55.928831 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8cbc164c-122b-417b-b4b1-e10415f78035 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Returning 404 to user: Instance 4df3f3eb-e900-497d-a1ed-f5e12a0d69a8 could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:52:55.928831 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-8cbc164c-122b-417b-b4b1-e10415f78035 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] 10.222.0.60 "GET /compute/v2.1/servers/4df3f3eb-e900-497d-a1ed-f5e12a0d69a8" status: 404 len: 111 microversion: 2.1 time: 0.047583 Sep 14 08:52:55.928831 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 584/1147] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:55 2022] GET /compute/v2.1/servers/4df3f3eb-e900-497d-a1ed-f5e12a0d69a8 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 08:52:55.933159 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-e0e9483e-a94f-45c7-b4ae-4cedafcc6a9d tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:55.933708 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-e0e9483e-a94f-45c7-b4ae-4cedafcc6a9d tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] [instance: 2d2c444a-e84e-40c5-aec1-375cd14f67c8] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:55.945835 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e0e9483e-a94f-45c7-b4ae-4cedafcc6a9d tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:55.946353 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e0e9483e-a94f-45c7-b4ae-4cedafcc6a9d tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:55.946795 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e0e9483e-a94f-45c7-b4ae-4cedafcc6a9d tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:55.949098 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e0e9483e-a94f-45c7-b4ae-4cedafcc6a9d tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:55.950786 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e0e9483e-a94f-45c7-b4ae-4cedafcc6a9d tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:55.951838 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e0e9483e-a94f-45c7-b4ae-4cedafcc6a9d tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:55.982102 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-e0e9483e-a94f-45c7-b4ae-4cedafcc6a9d tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] HTTP exception thrown: Instance 2d2c444a-e84e-40c5-aec1-375cd14f67c8 could not be found. Sep 14 08:52:55.984118 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-e0e9483e-a94f-45c7-b4ae-4cedafcc6a9d tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Request method failure captured: Sep 14 08:52:55.984118 n-d-836830-18 devstack@n-api.service[128758]: request: DELETE /compute/v2.1/servers/2d2c444a-e84e-40c5-aec1-375cd14f67c8 HTTP/1.1 Sep 14 08:52:55.984118 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 08:52:55.984118 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 08:52:55.984118 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 08:52:55.984118 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 08:52:55.984118 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 08:52:55.984118 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 08:52:55.984118 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 08:52:55.984118 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 08:52:55.984118 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZWK138Ps18GQEwLoBmhO0Hvnq1n8zIZnLeKzz6Mw2vHpgjb3Bx2HpWzPKBZs-SQXwcDd-PWEaI4snbLmBn2qDf5FMs8e5CERqW4qIQRV6ackSPgPz-lbL3l0dnfFp3onsN1Rh-gX4-O4bIy9T84pw52qPCm7tSSFv9tLLyKhOqGCNc Sep 14 08:52:55.984118 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 08:52:55.984118 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 08:52:55.984118 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 08:52:55.984118 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 08:52:55.984118 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 08:52:55.984118 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 08:52:55.984118 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: ee17e19b2f094a899dfc8966152fd642 Sep 14 08:52:55.984118 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1768249818 Sep 14 08:52:55.984118 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 08:52:55.984118 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 08:52:55.985908 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/ee17e19b2f094a899dfc8966152fd642"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_ee17e19b2f094a899dfc8966152fd642"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ee17e19b2f094a899dfc8966152fd642"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ee17e19b2f094a899dfc8966152fd642"}]}] Sep 14 08:52:55.985908 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1768249818 Sep 14 08:52:55.985908 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: ee17e19b2f094a899dfc8966152fd642 Sep 14 08:52:55.985908 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1768249818 Sep 14 08:52:55.985908 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1768249818-project Sep 14 08:52:55.985908 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 08:52:55.985908 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 08:52:55.985908 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 24b938da87b14cd79c3c6dd85818cd02 Sep 14 08:52:55.985908 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1768249818-project Sep 14 08:52:55.985908 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 08:52:55.985908 n-d-836830-18 devstack@n-api.service[128758]: exception: Instance 2d2c444a-e84e-40c5-aec1-375cd14f67c8 could not be found. Sep 14 08:52:55.985908 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': '2d2c444a-e84e-40c5-aec1-375cd14f67c8'} Sep 14 08:52:55.986847 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:52:55.986847 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:52:55.986847 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 08:52:55.986847 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 08:52:55.986847 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 08:52:55.986847 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 08:52:55.986847 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 08:52:55.986847 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 08:52:55.986847 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 08:52:55.986847 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 08:52:55.986847 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d2c444a-e84e-40c5-aec1-375cd14f67c8 could not be found. Sep 14 08:52:55.986847 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:52:55.986847 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:52:55.986847 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:52:55.986847 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:52:55.986847 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:52:55.986847 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:52:55.986847 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:52:55.986847 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:52:55.986847 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:52:55.988444 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:52:55.988444 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 08:52:55.988444 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 08:52:55.988444 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 08:52:55.988444 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 08:52:55.988444 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 08:52:55.988444 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 08:52:55.988444 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 08:52:55.988444 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 08:52:55.988444 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d2c444a-e84e-40c5-aec1-375cd14f67c8 could not be found. Sep 14 08:52:55.988444 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:52:55.988444 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:52:55.988444 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:52:55.988444 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:52:55.988444 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:52:55.988444 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:52:55.988444 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:52:55.988444 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:52:55.988444 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d2c444a-e84e-40c5-aec1-375cd14f67c8 could not be found. Sep 14 08:52:55.988444 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:52:55.991620 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-e0e9483e-a94f-45c7-b4ae-4cedafcc6a9d tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Returning 404 to user: Instance 2d2c444a-e84e-40c5-aec1-375cd14f67c8 could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:52:55.992727 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-e0e9483e-a94f-45c7-b4ae-4cedafcc6a9d tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] 10.222.0.60 "DELETE /compute/v2.1/servers/2d2c444a-e84e-40c5-aec1-375cd14f67c8" status: 404 len: 111 microversion: 2.1 time: 0.064015 Sep 14 08:52:55.994005 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 564/1148] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 08:52:55 2022] DELETE /compute/v2.1/servers/2d2c444a-e84e-40c5-aec1-375cd14f67c8 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 08:52:56.002632 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ac836df6-654f-460b-aa5f-1e37465f3bc4 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:56.003798 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-ac836df6-654f-460b-aa5f-1e37465f3bc4 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] [instance: 2d2c444a-e84e-40c5-aec1-375cd14f67c8] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:56.012691 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ac836df6-654f-460b-aa5f-1e37465f3bc4 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:56.013557 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ac836df6-654f-460b-aa5f-1e37465f3bc4 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:56.014395 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ac836df6-654f-460b-aa5f-1e37465f3bc4 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:56.015554 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ac836df6-654f-460b-aa5f-1e37465f3bc4 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:56.016077 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ac836df6-654f-460b-aa5f-1e37465f3bc4 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:56.016592 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ac836df6-654f-460b-aa5f-1e37465f3bc4 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:56.036032 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-ac836df6-654f-460b-aa5f-1e37465f3bc4 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] HTTP exception thrown: Instance 2d2c444a-e84e-40c5-aec1-375cd14f67c8 could not be found. Sep 14 08:52:56.037609 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ac836df6-654f-460b-aa5f-1e37465f3bc4 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Request method failure captured: Sep 14 08:52:56.037609 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/2d2c444a-e84e-40c5-aec1-375cd14f67c8 HTTP/1.1 Sep 14 08:52:56.037609 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 08:52:56.037609 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 08:52:56.037609 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 08:52:56.037609 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 08:52:56.037609 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 08:52:56.037609 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 08:52:56.037609 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 08:52:56.037609 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 08:52:56.037609 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZWK138Ps18GQEwLoBmhO0Hvnq1n8zIZnLeKzz6Mw2vHpgjb3Bx2HpWzPKBZs-SQXwcDd-PWEaI4snbLmBn2qDf5FMs8e5CERqW4qIQRV6ackSPgPz-lbL3l0dnfFp3onsN1Rh-gX4-O4bIy9T84pw52qPCm7tSSFv9tLLyKhOqGCNc Sep 14 08:52:56.037609 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 08:52:56.037609 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 08:52:56.037609 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 08:52:56.037609 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 08:52:56.037609 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 08:52:56.037609 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 08:52:56.037609 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: ee17e19b2f094a899dfc8966152fd642 Sep 14 08:52:56.037609 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1768249818 Sep 14 08:52:56.037609 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 08:52:56.037609 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 08:52:56.039282 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/ee17e19b2f094a899dfc8966152fd642"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_ee17e19b2f094a899dfc8966152fd642"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ee17e19b2f094a899dfc8966152fd642"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ee17e19b2f094a899dfc8966152fd642"}]}] Sep 14 08:52:56.039282 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1768249818 Sep 14 08:52:56.039282 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: ee17e19b2f094a899dfc8966152fd642 Sep 14 08:52:56.039282 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1768249818 Sep 14 08:52:56.039282 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1768249818-project Sep 14 08:52:56.039282 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 08:52:56.039282 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 08:52:56.039282 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 24b938da87b14cd79c3c6dd85818cd02 Sep 14 08:52:56.039282 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1768249818-project Sep 14 08:52:56.039282 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 08:52:56.039282 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance 2d2c444a-e84e-40c5-aec1-375cd14f67c8 could not be found. Sep 14 08:52:56.039282 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '2d2c444a-e84e-40c5-aec1-375cd14f67c8'} Sep 14 08:52:56.040292 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:52:56.040292 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:52:56.040292 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 08:52:56.040292 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 08:52:56.040292 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 08:52:56.040292 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 08:52:56.040292 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 08:52:56.040292 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 08:52:56.040292 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 08:52:56.040292 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 08:52:56.040292 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d2c444a-e84e-40c5-aec1-375cd14f67c8 could not be found. Sep 14 08:52:56.040292 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:52:56.040292 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:52:56.040292 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:52:56.040292 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:52:56.040292 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:52:56.040292 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:52:56.040292 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:52:56.040292 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:52:56.040292 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:52:56.041879 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:52:56.041879 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 08:52:56.041879 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 08:52:56.041879 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 08:52:56.041879 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 08:52:56.041879 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 08:52:56.041879 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 08:52:56.041879 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d2c444a-e84e-40c5-aec1-375cd14f67c8 could not be found. Sep 14 08:52:56.041879 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:52:56.041879 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:52:56.041879 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:52:56.041879 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:52:56.041879 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:52:56.041879 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:52:56.041879 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:52:56.041879 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:52:56.041879 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d2c444a-e84e-40c5-aec1-375cd14f67c8 could not be found. Sep 14 08:52:56.041879 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:52:56.043470 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ac836df6-654f-460b-aa5f-1e37465f3bc4 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] Returning 404 to user: Instance 2d2c444a-e84e-40c5-aec1-375cd14f67c8 could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:52:56.043470 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-ac836df6-654f-460b-aa5f-1e37465f3bc4 tempest-ServersWithSpecificFlavorTestJSON-1768249818 tempest-ServersWithSpecificFlavorTestJSON-1768249818-project] 10.222.0.60 "GET /compute/v2.1/servers/2d2c444a-e84e-40c5-aec1-375cd14f67c8" status: 404 len: 111 microversion: 2.1 time: 0.041295 Sep 14 08:52:56.051189 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 585/1149] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:55 2022] GET /compute/v2.1/servers/2d2c444a-e84e-40c5-aec1-375cd14f67c8 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 08:52:56.616977 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-04cacb77-2ead-4a9d-8c12-fbe43c38fdd1 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:56.617596 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-04cacb77-2ead-4a9d-8c12-fbe43c38fdd1 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] [instance: 67f3a983-b33f-49c8-9c91-988e8553563c] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:56.628393 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-04cacb77-2ead-4a9d-8c12-fbe43c38fdd1 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:56.630418 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-04cacb77-2ead-4a9d-8c12-fbe43c38fdd1 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:56.643340 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-04cacb77-2ead-4a9d-8c12-fbe43c38fdd1 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:56.644313 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-04cacb77-2ead-4a9d-8c12-fbe43c38fdd1 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:56.644806 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-04cacb77-2ead-4a9d-8c12-fbe43c38fdd1 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:56.645237 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-04cacb77-2ead-4a9d-8c12-fbe43c38fdd1 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:56.678704 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-947832b5-3ae8-427b-9d04-cc07c92a57c9 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:56.680441 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-947832b5-3ae8-427b-9d04-cc07c92a57c9 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: 1b2a9a93-cad5-4b18-abc3-1b88413f88da] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:56.703392 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-947832b5-3ae8-427b-9d04-cc07c92a57c9 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:56.703923 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-947832b5-3ae8-427b-9d04-cc07c92a57c9 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:56.707715 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-947832b5-3ae8-427b-9d04-cc07c92a57c9 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:56.708993 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-947832b5-3ae8-427b-9d04-cc07c92a57c9 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:56.709945 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-947832b5-3ae8-427b-9d04-cc07c92a57c9 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:56.710287 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-947832b5-3ae8-427b-9d04-cc07c92a57c9 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:56.930849 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-947832b5-3ae8-427b-9d04-cc07c92a57c9 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:56.938805 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-947832b5-3ae8-427b-9d04-cc07c92a57c9 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/1b2a9a93-cad5-4b18-abc3-1b88413f88da" status: 200 len: 1264 microversion: 2.1 time: 0.265665 Sep 14 08:52:56.939615 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 586/1150] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:56 2022] GET /compute/v2.1/servers/1b2a9a93-cad5-4b18-abc3-1b88413f88da => generated 1264 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:52:57.062562 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-04cacb77-2ead-4a9d-8c12-fbe43c38fdd1 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ace9012a7c4ce59c01858b6984b766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a87a909133e42e1a82e3a623536935c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:57.075108 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-04cacb77-2ead-4a9d-8c12-fbe43c38fdd1 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] 10.222.0.60 "GET /compute/v2.1/servers/67f3a983-b33f-49c8-9c91-988e8553563c" status: 200 len: 1324 microversion: 2.1 time: 0.467966 Sep 14 08:52:57.077489 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 565/1151] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:56 2022] GET /compute/v2.1/servers/67f3a983-b33f-49c8-9c91-988e8553563c => generated 1324 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:52:57.680824 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-20583a91-2325-47da-bfc1-2b58cedf5545 req-435ad09a-0727-4005-b6d3-56b6287c2429 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2098e0b9-b628-4b9e-979b-960c68830fee", "tag": "a7cbc77d-b7b8-47d5-a1b4-d36705ecf7a0"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:52:57.699649 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-20583a91-2325-47da-bfc1-2b58cedf5545 req-435ad09a-0727-4005-b6d3-56b6287c2429 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:57.701540 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-20583a91-2325-47da-bfc1-2b58cedf5545 req-435ad09a-0727-4005-b6d3-56b6287c2429 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:57.701984 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-20583a91-2325-47da-bfc1-2b58cedf5545 req-435ad09a-0727-4005-b6d3-56b6287c2429 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:57.730047 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-20583a91-2325-47da-bfc1-2b58cedf5545 req-435ad09a-0727-4005-b6d3-56b6287c2429 service nova] Creating event network-changed:a7cbc77d-b7b8-47d5-a1b4-d36705ecf7a0 for instance 2098e0b9-b628-4b9e-979b-960c68830fee on n-h1-836830-18 Sep 14 08:52:57.739437 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-20583a91-2325-47da-bfc1-2b58cedf5545 req-435ad09a-0727-4005-b6d3-56b6287c2429 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062771 Sep 14 08:52:57.741222 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 587/1152] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:52:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:52:57.963979 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-7a5bdf18-e607-4a68-8961-16e72bf4b24e tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:57.964658 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-7a5bdf18-e607-4a68-8961-16e72bf4b24e tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: 1b2a9a93-cad5-4b18-abc3-1b88413f88da] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:57.985343 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7a5bdf18-e607-4a68-8961-16e72bf4b24e tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:57.987299 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7a5bdf18-e607-4a68-8961-16e72bf4b24e tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:57.989151 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7a5bdf18-e607-4a68-8961-16e72bf4b24e tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:57.992340 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7a5bdf18-e607-4a68-8961-16e72bf4b24e tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:57.993281 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7a5bdf18-e607-4a68-8961-16e72bf4b24e tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:57.995298 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7a5bdf18-e607-4a68-8961-16e72bf4b24e tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:58.106473 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-dacb22d6-4d69-44b9-8158-5bb50178948d tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:58.107906 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-dacb22d6-4d69-44b9-8158-5bb50178948d tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] [instance: 67f3a983-b33f-49c8-9c91-988e8553563c] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:58.119571 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dacb22d6-4d69-44b9-8158-5bb50178948d tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:58.120979 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dacb22d6-4d69-44b9-8158-5bb50178948d tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:58.121888 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dacb22d6-4d69-44b9-8158-5bb50178948d tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:58.123734 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dacb22d6-4d69-44b9-8158-5bb50178948d tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:58.125225 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dacb22d6-4d69-44b9-8158-5bb50178948d tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:58.126742 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dacb22d6-4d69-44b9-8158-5bb50178948d tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:58.236973 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-7a5bdf18-e607-4a68-8961-16e72bf4b24e tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:58.251005 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-7a5bdf18-e607-4a68-8961-16e72bf4b24e tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/1b2a9a93-cad5-4b18-abc3-1b88413f88da" status: 200 len: 1270 microversion: 2.1 time: 0.291396 Sep 14 08:52:58.251942 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 566/1153] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:57 2022] GET /compute/v2.1/servers/1b2a9a93-cad5-4b18-abc3-1b88413f88da => generated 1270 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:52:58.584822 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-dacb22d6-4d69-44b9-8158-5bb50178948d tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ace9012a7c4ce59c01858b6984b766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a87a909133e42e1a82e3a623536935c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:58.594219 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-dacb22d6-4d69-44b9-8158-5bb50178948d tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] 10.222.0.60 "GET /compute/v2.1/servers/67f3a983-b33f-49c8-9c91-988e8553563c" status: 200 len: 1324 microversion: 2.1 time: 0.493579 Sep 14 08:52:58.607151 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 588/1154] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:58 2022] GET /compute/v2.1/servers/67f3a983-b33f-49c8-9c91-988e8553563c => generated 1324 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:52:59.281501 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-8f064972-a5a6-4bf6-aa0b-048ca20828e1 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:59.282285 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-8f064972-a5a6-4bf6-aa0b-048ca20828e1 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: 1b2a9a93-cad5-4b18-abc3-1b88413f88da] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:59.309033 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8f064972-a5a6-4bf6-aa0b-048ca20828e1 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:59.309555 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8f064972-a5a6-4bf6-aa0b-048ca20828e1 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:59.310007 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8f064972-a5a6-4bf6-aa0b-048ca20828e1 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:59.312346 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8f064972-a5a6-4bf6-aa0b-048ca20828e1 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:59.312831 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8f064972-a5a6-4bf6-aa0b-048ca20828e1 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:59.313266 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8f064972-a5a6-4bf6-aa0b-048ca20828e1 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:59.624564 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-cba85c22-b579-4139-98ac-bb899f6f2e0c tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:52:59.625255 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-cba85c22-b579-4139-98ac-bb899f6f2e0c tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] [instance: 67f3a983-b33f-49c8-9c91-988e8553563c] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:52:59.644697 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cba85c22-b579-4139-98ac-bb899f6f2e0c tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:59.645205 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cba85c22-b579-4139-98ac-bb899f6f2e0c tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:59.645649 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cba85c22-b579-4139-98ac-bb899f6f2e0c tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:59.647291 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cba85c22-b579-4139-98ac-bb899f6f2e0c tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:52:59.647762 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cba85c22-b579-4139-98ac-bb899f6f2e0c tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:52:59.648197 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cba85c22-b579-4139-98ac-bb899f6f2e0c tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:52:59.851534 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-8f064972-a5a6-4bf6-aa0b-048ca20828e1 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:52:59.862344 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-8f064972-a5a6-4bf6-aa0b-048ca20828e1 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/1b2a9a93-cad5-4b18-abc3-1b88413f88da" status: 200 len: 1312 microversion: 2.1 time: 0.588490 Sep 14 08:52:59.884411 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 567/1155] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:59 2022] GET /compute/v2.1/servers/1b2a9a93-cad5-4b18-abc3-1b88413f88da => generated 1312 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:52:59.989005 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-6eca869b-8d59-47c7-9b11-9187779d97a8 req-e4d9028f-b27f-4132-9a9f-5ec90d087865 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b2a9a93-cad5-4b18-abc3-1b88413f88da", "tag": "3db17a23-17af-436b-96e5-130e5c8353bc"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:53:00.014468 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-6eca869b-8d59-47c7-9b11-9187779d97a8 req-e4d9028f-b27f-4132-9a9f-5ec90d087865 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:00.015527 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-6eca869b-8d59-47c7-9b11-9187779d97a8 req-e4d9028f-b27f-4132-9a9f-5ec90d087865 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:00.016194 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-6eca869b-8d59-47c7-9b11-9187779d97a8 req-e4d9028f-b27f-4132-9a9f-5ec90d087865 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:00.059901 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-6eca869b-8d59-47c7-9b11-9187779d97a8 req-e4d9028f-b27f-4132-9a9f-5ec90d087865 service nova] Creating event network-changed:3db17a23-17af-436b-96e5-130e5c8353bc for instance 1b2a9a93-cad5-4b18-abc3-1b88413f88da on n-h2-836830-18 Sep 14 08:53:00.076645 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-6eca869b-8d59-47c7-9b11-9187779d97a8 req-e4d9028f-b27f-4132-9a9f-5ec90d087865 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092335 Sep 14 08:53:00.079623 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 568/1156] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:52:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 08:53:00.177922 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-cba85c22-b579-4139-98ac-bb899f6f2e0c tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ace9012a7c4ce59c01858b6984b766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a87a909133e42e1a82e3a623536935c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:00.189979 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-cba85c22-b579-4139-98ac-bb899f6f2e0c tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] 10.222.0.60 "GET /compute/v2.1/servers/67f3a983-b33f-49c8-9c91-988e8553563c" status: 200 len: 1324 microversion: 2.1 time: 0.570025 Sep 14 08:53:00.192082 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 589/1157] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:52:59 2022] GET /compute/v2.1/servers/67f3a983-b33f-49c8-9c91-988e8553563c => generated 1324 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:53:00.897361 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b2eecd58-8255-441c-abf5-498091f29fb7 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:00.899328 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-b2eecd58-8255-441c-abf5-498091f29fb7 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: 1b2a9a93-cad5-4b18-abc3-1b88413f88da] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:00.915967 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b2eecd58-8255-441c-abf5-498091f29fb7 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:00.916736 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b2eecd58-8255-441c-abf5-498091f29fb7 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:00.917355 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b2eecd58-8255-441c-abf5-498091f29fb7 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:00.918815 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b2eecd58-8255-441c-abf5-498091f29fb7 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:00.919473 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b2eecd58-8255-441c-abf5-498091f29fb7 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:00.920322 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b2eecd58-8255-441c-abf5-498091f29fb7 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:01.142768 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c3a4831c-a7d2-42a2-8a5e-2120543e2d05 tempest-ServicesAdminNegativeV253TestJSON-573351714 tempest-ServicesAdminNegativeV253TestJSON-573351714-project-admin] Action: 'update', calling method: .version_select at 0x7f7d44274310>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:53:01.148188 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c3a4831c-a7d2-42a2-8a5e-2120543e2d05 tempest-ServicesAdminNegativeV253TestJSON-573351714 tempest-ServicesAdminNegativeV253TestJSON-573351714-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:01.149000 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c3a4831c-a7d2-42a2-8a5e-2120543e2d05 tempest-ServicesAdminNegativeV253TestJSON-573351714 tempest-ServicesAdminNegativeV253TestJSON-573351714-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:01.149905 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c3a4831c-a7d2-42a2-8a5e-2120543e2d05 tempest-ServicesAdminNegativeV253TestJSON-573351714 tempest-ServicesAdminNegativeV253TestJSON-573351714-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:01.158188 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c3a4831c-a7d2-42a2-8a5e-2120543e2d05 tempest-ServicesAdminNegativeV253TestJSON-573351714 tempest-ServicesAdminNegativeV253TestJSON-573351714-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:01.159084 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c3a4831c-a7d2-42a2-8a5e-2120543e2d05 tempest-ServicesAdminNegativeV253TestJSON-573351714 tempest-ServicesAdminNegativeV253TestJSON-573351714-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:01.159734 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c3a4831c-a7d2-42a2-8a5e-2120543e2d05 tempest-ServicesAdminNegativeV253TestJSON-573351714 tempest-ServicesAdminNegativeV253TestJSON-573351714-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:01.169968 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-c3a4831c-a7d2-42a2-8a5e-2120543e2d05 tempest-ServicesAdminNegativeV253TestJSON-573351714 tempest-ServicesAdminNegativeV253TestJSON-573351714-project-admin] HTTP exception thrown: Service 884689ef-7ee0-491e-9844-3d49b03db702 could not be found. Sep 14 08:53:01.173494 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c3a4831c-a7d2-42a2-8a5e-2120543e2d05 tempest-ServicesAdminNegativeV253TestJSON-573351714 tempest-ServicesAdminNegativeV253TestJSON-573351714-project-admin] Request method failure captured: Sep 14 08:53:01.173494 n-d-836830-18 devstack@n-api.service[128759]: request: PUT /compute/v2.1/os-services/884689ef-7ee0-491e-9844-3d49b03db702 HTTP/1.1 Sep 14 08:53:01.173494 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 08:53:01.173494 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 08:53:01.173494 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 08:53:01.173494 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 56 Sep 14 08:53:01.173494 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 08:53:01.173494 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 08:53:01.173494 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 08:53:01.173494 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 08:53:01.173494 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZZsAIHpSRQ-bysShj-5yQQ3z20882j6WaXB53qvPLN69BW75KTY75P-G5hcriqrOyLmRwu3RjQm8kXYYjo62CZsOd1hK09IgcJtaCIyOFzWN3M2QPTpzbsgqvb_FyT8jDhJYCxg8M0adg1E8eTaJF34sTVEaNtvm-X9zBTogI46gyE Sep 14 08:53:01.173494 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 08:53:01.173494 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 08:53:01.173494 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 08:53:01.173494 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 08:53:01.173494 n-d-836830-18 devstack@n-api.service[128759]: X-Openstack-Nova-Api-Version: 2.53 Sep 14 08:53:01.173494 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 08:53:01.173494 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 08:53:01.173494 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: c2542a858c7049f7b733e1ee6a579a9c Sep 14 08:53:01.173494 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-573351714 Sep 14 08:53:01.173494 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member,admin Sep 14 08:53:01.173494 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member,admin Sep 14 08:53:01.175017 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c2542a858c7049f7b733e1ee6a579a9c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c2542a858c7049f7b733e1ee6a579a9c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c2542a858c7049f7b733e1ee6a579a9c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c2542a858c7049f7b733e1ee6a579a9c"}]}] Sep 14 08:53:01.175017 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-573351714 Sep 14 08:53:01.175017 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: c2542a858c7049f7b733e1ee6a579a9c Sep 14 08:53:01.175017 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-573351714 Sep 14 08:53:01.175017 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ServicesAdminNegativeV253TestJSON-573351714-project-admin Sep 14 08:53:01.175017 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 08:53:01.175017 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 08:53:01.175017 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: ed35740f849f4ad5bc7acde215443631 Sep 14 08:53:01.175017 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-573351714-project-admin Sep 14 08:53:01.175017 n-d-836830-18 devstack@n-api.service[128759]: Sep 14 08:53:01.175017 n-d-836830-18 devstack@n-api.service[128759]: {"status": "disabled", "disabled_reason": "maintenance"} Sep 14 08:53:01.175017 n-d-836830-18 devstack@n-api.service[128759]: method: Sep 14 08:53:01.175017 n-d-836830-18 devstack@n-api.service[128759]: exception: Service 884689ef-7ee0-491e-9844-3d49b03db702 could not be found. Sep 14 08:53:01.175925 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '884689ef-7ee0-491e-9844-3d49b03db702', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Sep 14 08:53:01.175925 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:53:01.175925 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:53:01.175925 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Sep 14 08:53:01.175925 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Sep 14 08:53:01.175925 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Sep 14 08:53:01.175925 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Sep 14 08:53:01.175925 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Sep 14 08:53:01.175925 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:53:01.175925 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:53:01.175925 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:53:01.175925 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:53:01.175925 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Sep 14 08:53:01.175925 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Sep 14 08:53:01.175925 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Sep 14 08:53:01.175925 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Sep 14 08:53:01.175925 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 884689ef-7ee0-491e-9844-3d49b03db702 could not be found. Sep 14 08:53:01.175925 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:53:01.175925 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:53:01.175925 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:53:01.175925 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:53:01.177818 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:53:01.177818 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:53:01.177818 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:53:01.177818 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:53:01.177818 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 08:53:01.177818 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 08:53:01.177818 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:53:01.177818 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:53:01.177818 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 08:53:01.177818 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 08:53:01.177818 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Sep 14 08:53:01.177818 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 14 08:53:01.177818 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 884689ef-7ee0-491e-9844-3d49b03db702 could not be found. Sep 14 08:53:01.177818 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:53:01.177818 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:53:01.177818 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:53:01.177818 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:53:01.177818 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:53:01.177818 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:53:01.177818 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:53:01.179097 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:53:01.179097 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 884689ef-7ee0-491e-9844-3d49b03db702 could not be found. Sep 14 08:53:01.179097 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:53:01.183899 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c3a4831c-a7d2-42a2-8a5e-2120543e2d05 tempest-ServicesAdminNegativeV253TestJSON-573351714 tempest-ServicesAdminNegativeV253TestJSON-573351714-project-admin] Returning 404 to user: Service 884689ef-7ee0-491e-9844-3d49b03db702 could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:53:01.185303 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-c3a4831c-a7d2-42a2-8a5e-2120543e2d05 tempest-ServicesAdminNegativeV253TestJSON-573351714 tempest-ServicesAdminNegativeV253TestJSON-573351714-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-services/884689ef-7ee0-491e-9844-3d49b03db702" status: 404 len: 110 microversion: 2.53 time: 0.273899 Sep 14 08:53:01.186110 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 590/1158] 10.222.0.60 () {62 vars in 1309 bytes} [Wed Sep 14 08:53:00 2022] PUT /compute/v2.1/os-services/884689ef-7ee0-491e-9844-3d49b03db702 => generated 110 bytes in 276 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 14 08:53:01.199760 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-618305af-59d3-4b33-826f-6a4995e3b69f tempest-ServicesAdminNegativeV253TestJSON-573351714 tempest-ServicesAdminNegativeV253TestJSON-573351714-project-admin] Action: 'update', calling method: .version_select at 0x7f7d442e3f70>, body: {"status": "disabled"} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:53:01.205275 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-618305af-59d3-4b33-826f-6a4995e3b69f tempest-ServicesAdminNegativeV253TestJSON-573351714 tempest-ServicesAdminNegativeV253TestJSON-573351714-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:01.205792 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-618305af-59d3-4b33-826f-6a4995e3b69f tempest-ServicesAdminNegativeV253TestJSON-573351714 tempest-ServicesAdminNegativeV253TestJSON-573351714-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:01.206362 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-618305af-59d3-4b33-826f-6a4995e3b69f tempest-ServicesAdminNegativeV253TestJSON-573351714 tempest-ServicesAdminNegativeV253TestJSON-573351714-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:01.217382 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-618305af-59d3-4b33-826f-6a4995e3b69f tempest-ServicesAdminNegativeV253TestJSON-573351714 tempest-ServicesAdminNegativeV253TestJSON-573351714-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:01.217878 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-618305af-59d3-4b33-826f-6a4995e3b69f tempest-ServicesAdminNegativeV253TestJSON-573351714 tempest-ServicesAdminNegativeV253TestJSON-573351714-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:01.218317 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-618305af-59d3-4b33-826f-6a4995e3b69f tempest-ServicesAdminNegativeV253TestJSON-573351714 tempest-ServicesAdminNegativeV253TestJSON-573351714-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:01.225573 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-618305af-59d3-4b33-826f-6a4995e3b69f tempest-ServicesAdminNegativeV253TestJSON-573351714 tempest-ServicesAdminNegativeV253TestJSON-573351714-project-admin] HTTP exception thrown: Service 884689ef-7ee0-491e-9844-3d49b03db702 could not be found. Sep 14 08:53:01.228068 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-618305af-59d3-4b33-826f-6a4995e3b69f tempest-ServicesAdminNegativeV253TestJSON-573351714 tempest-ServicesAdminNegativeV253TestJSON-573351714-project-admin] Request method failure captured: Sep 14 08:53:01.228068 n-d-836830-18 devstack@n-api.service[128759]: request: PUT /compute/v2.1/os-services/884689ef-7ee0-491e-9844-3d49b03db702 HTTP/1.1 Sep 14 08:53:01.228068 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 08:53:01.228068 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 08:53:01.228068 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 08:53:01.228068 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 22 Sep 14 08:53:01.228068 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 08:53:01.228068 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 08:53:01.228068 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 08:53:01.228068 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 08:53:01.228068 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZZsAIHpSRQ-bysShj-5yQQ3z20882j6WaXB53qvPLN69BW75KTY75P-G5hcriqrOyLmRwu3RjQm8kXYYjo62CZsOd1hK09IgcJtaCIyOFzWN3M2QPTpzbsgqvb_FyT8jDhJYCxg8M0adg1E8eTaJF34sTVEaNtvm-X9zBTogI46gyE Sep 14 08:53:01.228068 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 08:53:01.228068 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 08:53:01.228068 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 08:53:01.228068 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 08:53:01.228068 n-d-836830-18 devstack@n-api.service[128759]: X-Openstack-Nova-Api-Version: 2.53 Sep 14 08:53:01.228068 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 08:53:01.228068 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 08:53:01.228068 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: c2542a858c7049f7b733e1ee6a579a9c Sep 14 08:53:01.228068 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-573351714 Sep 14 08:53:01.228068 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member,admin Sep 14 08:53:01.228068 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member,admin Sep 14 08:53:01.229526 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c2542a858c7049f7b733e1ee6a579a9c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c2542a858c7049f7b733e1ee6a579a9c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c2542a858c7049f7b733e1ee6a579a9c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c2542a858c7049f7b733e1ee6a579a9c"}]}] Sep 14 08:53:01.229526 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-573351714 Sep 14 08:53:01.229526 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: c2542a858c7049f7b733e1ee6a579a9c Sep 14 08:53:01.229526 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-573351714 Sep 14 08:53:01.229526 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ServicesAdminNegativeV253TestJSON-573351714-project-admin Sep 14 08:53:01.229526 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 08:53:01.229526 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 08:53:01.229526 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: ed35740f849f4ad5bc7acde215443631 Sep 14 08:53:01.229526 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-573351714-project-admin Sep 14 08:53:01.229526 n-d-836830-18 devstack@n-api.service[128759]: Sep 14 08:53:01.229526 n-d-836830-18 devstack@n-api.service[128759]: {"status": "disabled"} Sep 14 08:53:01.229526 n-d-836830-18 devstack@n-api.service[128759]: method: Sep 14 08:53:01.229526 n-d-836830-18 devstack@n-api.service[128759]: exception: Service 884689ef-7ee0-491e-9844-3d49b03db702 could not be found. Sep 14 08:53:01.229526 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '884689ef-7ee0-491e-9844-3d49b03db702', 'body': {'status': 'disabled'}} Sep 14 08:53:01.230436 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:53:01.230436 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:53:01.230436 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Sep 14 08:53:01.230436 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Sep 14 08:53:01.230436 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Sep 14 08:53:01.230436 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Sep 14 08:53:01.230436 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Sep 14 08:53:01.230436 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:53:01.230436 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:53:01.230436 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:53:01.230436 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:53:01.230436 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Sep 14 08:53:01.230436 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Sep 14 08:53:01.230436 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Sep 14 08:53:01.230436 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Sep 14 08:53:01.230436 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 884689ef-7ee0-491e-9844-3d49b03db702 could not be found. Sep 14 08:53:01.230436 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:53:01.230436 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:53:01.230436 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:53:01.230436 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:53:01.230436 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:53:01.234752 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:53:01.234752 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:53:01.234752 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:53:01.234752 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 08:53:01.234752 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 08:53:01.234752 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:53:01.234752 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:53:01.234752 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 08:53:01.234752 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 08:53:01.234752 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Sep 14 08:53:01.234752 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 14 08:53:01.234752 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 884689ef-7ee0-491e-9844-3d49b03db702 could not be found. Sep 14 08:53:01.234752 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:53:01.234752 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:53:01.234752 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:53:01.234752 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:53:01.234752 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:53:01.234752 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:53:01.234752 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:53:01.234752 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:53:01.236786 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 884689ef-7ee0-491e-9844-3d49b03db702 could not be found. Sep 14 08:53:01.236786 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:53:01.236786 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-618305af-59d3-4b33-826f-6a4995e3b69f tempest-ServicesAdminNegativeV253TestJSON-573351714 tempest-ServicesAdminNegativeV253TestJSON-573351714-project-admin] Returning 404 to user: Service 884689ef-7ee0-491e-9844-3d49b03db702 could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:53:01.236786 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-618305af-59d3-4b33-826f-6a4995e3b69f tempest-ServicesAdminNegativeV253TestJSON-573351714 tempest-ServicesAdminNegativeV253TestJSON-573351714-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-services/884689ef-7ee0-491e-9844-3d49b03db702" status: 404 len: 110 microversion: 2.53 time: 0.037317 Sep 14 08:53:01.236786 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 591/1159] 10.222.0.60 () {62 vars in 1309 bytes} [Wed Sep 14 08:53:01 2022] PUT /compute/v2.1/os-services/884689ef-7ee0-491e-9844-3d49b03db702 => generated 110 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 14 08:53:01.237211 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-87c00b70-49e4-401b-beff-02f5c88e729b tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:01.237635 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-87c00b70-49e4-401b-beff-02f5c88e729b tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] [instance: 67f3a983-b33f-49c8-9c91-988e8553563c] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:01.247032 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-87c00b70-49e4-401b-beff-02f5c88e729b tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:01.247485 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-87c00b70-49e4-401b-beff-02f5c88e729b tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:01.248431 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-87c00b70-49e4-401b-beff-02f5c88e729b tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:01.251772 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-87c00b70-49e4-401b-beff-02f5c88e729b tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:01.252596 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-87c00b70-49e4-401b-beff-02f5c88e729b tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:01.253837 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-87c00b70-49e4-401b-beff-02f5c88e729b tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:01.262671 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-b2eecd58-8255-441c-abf5-498091f29fb7 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:01.272155 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-b2eecd58-8255-441c-abf5-498091f29fb7 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/1b2a9a93-cad5-4b18-abc3-1b88413f88da" status: 200 len: 1312 microversion: 2.1 time: 0.381685 Sep 14 08:53:01.287981 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 569/1160] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:00 2022] GET /compute/v2.1/servers/1b2a9a93-cad5-4b18-abc3-1b88413f88da => generated 1312 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:53:01.293719 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ec03f683-cf07-45c0-939c-6e47f9416ed6 tempest-ServicesAdminNegativeV253TestJSON-573351714 tempest-ServicesAdminNegativeV253TestJSON-573351714-project-admin] Action: 'update', calling method: .version_select at 0x7f7d44571040>, body: {"status": "enabled"} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:53:01.297297 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ec03f683-cf07-45c0-939c-6e47f9416ed6 tempest-ServicesAdminNegativeV253TestJSON-573351714 tempest-ServicesAdminNegativeV253TestJSON-573351714-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:01.298162 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ec03f683-cf07-45c0-939c-6e47f9416ed6 tempest-ServicesAdminNegativeV253TestJSON-573351714 tempest-ServicesAdminNegativeV253TestJSON-573351714-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:01.298785 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ec03f683-cf07-45c0-939c-6e47f9416ed6 tempest-ServicesAdminNegativeV253TestJSON-573351714 tempest-ServicesAdminNegativeV253TestJSON-573351714-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:01.307642 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ec03f683-cf07-45c0-939c-6e47f9416ed6 tempest-ServicesAdminNegativeV253TestJSON-573351714 tempest-ServicesAdminNegativeV253TestJSON-573351714-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:01.308272 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ec03f683-cf07-45c0-939c-6e47f9416ed6 tempest-ServicesAdminNegativeV253TestJSON-573351714 tempest-ServicesAdminNegativeV253TestJSON-573351714-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:01.308904 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ec03f683-cf07-45c0-939c-6e47f9416ed6 tempest-ServicesAdminNegativeV253TestJSON-573351714 tempest-ServicesAdminNegativeV253TestJSON-573351714-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:01.316082 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-ec03f683-cf07-45c0-939c-6e47f9416ed6 tempest-ServicesAdminNegativeV253TestJSON-573351714 tempest-ServicesAdminNegativeV253TestJSON-573351714-project-admin] HTTP exception thrown: Service 884689ef-7ee0-491e-9844-3d49b03db702 could not be found. Sep 14 08:53:01.319240 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ec03f683-cf07-45c0-939c-6e47f9416ed6 tempest-ServicesAdminNegativeV253TestJSON-573351714 tempest-ServicesAdminNegativeV253TestJSON-573351714-project-admin] Request method failure captured: Sep 14 08:53:01.319240 n-d-836830-18 devstack@n-api.service[128758]: request: PUT /compute/v2.1/os-services/884689ef-7ee0-491e-9844-3d49b03db702 HTTP/1.1 Sep 14 08:53:01.319240 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 08:53:01.319240 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 08:53:01.319240 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 08:53:01.319240 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 21 Sep 14 08:53:01.319240 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 08:53:01.319240 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 08:53:01.319240 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 08:53:01.319240 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 08:53:01.319240 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZZsAIHpSRQ-bysShj-5yQQ3z20882j6WaXB53qvPLN69BW75KTY75P-G5hcriqrOyLmRwu3RjQm8kXYYjo62CZsOd1hK09IgcJtaCIyOFzWN3M2QPTpzbsgqvb_FyT8jDhJYCxg8M0adg1E8eTaJF34sTVEaNtvm-X9zBTogI46gyE Sep 14 08:53:01.319240 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 08:53:01.319240 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 08:53:01.319240 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 08:53:01.319240 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 08:53:01.319240 n-d-836830-18 devstack@n-api.service[128758]: X-Openstack-Nova-Api-Version: 2.53 Sep 14 08:53:01.319240 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 08:53:01.319240 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 08:53:01.319240 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: c2542a858c7049f7b733e1ee6a579a9c Sep 14 08:53:01.319240 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-573351714 Sep 14 08:53:01.319240 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member,admin Sep 14 08:53:01.319240 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member,admin Sep 14 08:53:01.320968 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c2542a858c7049f7b733e1ee6a579a9c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c2542a858c7049f7b733e1ee6a579a9c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c2542a858c7049f7b733e1ee6a579a9c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c2542a858c7049f7b733e1ee6a579a9c"}]}] Sep 14 08:53:01.320968 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-573351714 Sep 14 08:53:01.320968 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: c2542a858c7049f7b733e1ee6a579a9c Sep 14 08:53:01.320968 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-573351714 Sep 14 08:53:01.320968 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-ServicesAdminNegativeV253TestJSON-573351714-project-admin Sep 14 08:53:01.320968 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 08:53:01.320968 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 08:53:01.320968 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: ed35740f849f4ad5bc7acde215443631 Sep 14 08:53:01.320968 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-573351714-project-admin Sep 14 08:53:01.320968 n-d-836830-18 devstack@n-api.service[128758]: Sep 14 08:53:01.320968 n-d-836830-18 devstack@n-api.service[128758]: {"status": "enabled"} Sep 14 08:53:01.320968 n-d-836830-18 devstack@n-api.service[128758]: method: Sep 14 08:53:01.320968 n-d-836830-18 devstack@n-api.service[128758]: exception: Service 884689ef-7ee0-491e-9844-3d49b03db702 could not be found. Sep 14 08:53:01.320968 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': '884689ef-7ee0-491e-9844-3d49b03db702', 'body': {'status': 'enabled'}} Sep 14 08:53:01.322061 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:53:01.322061 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:53:01.322061 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Sep 14 08:53:01.322061 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Sep 14 08:53:01.322061 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Sep 14 08:53:01.322061 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Sep 14 08:53:01.322061 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Sep 14 08:53:01.322061 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:53:01.322061 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:53:01.322061 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:53:01.322061 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:53:01.322061 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Sep 14 08:53:01.322061 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Sep 14 08:53:01.322061 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Sep 14 08:53:01.322061 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Sep 14 08:53:01.322061 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 884689ef-7ee0-491e-9844-3d49b03db702 could not be found. Sep 14 08:53:01.322061 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:53:01.322061 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:53:01.322061 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:53:01.322061 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:53:01.322061 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:53:01.323714 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:53:01.323714 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:53:01.323714 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:53:01.323714 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 08:53:01.323714 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 08:53:01.323714 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:53:01.323714 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:53:01.323714 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 08:53:01.323714 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 08:53:01.323714 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Sep 14 08:53:01.323714 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 14 08:53:01.323714 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 884689ef-7ee0-491e-9844-3d49b03db702 could not be found. Sep 14 08:53:01.323714 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:53:01.323714 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:53:01.323714 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:53:01.323714 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:53:01.323714 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:53:01.323714 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:53:01.323714 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:53:01.323714 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:53:01.325223 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 884689ef-7ee0-491e-9844-3d49b03db702 could not be found. Sep 14 08:53:01.325223 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:53:01.326189 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ec03f683-cf07-45c0-939c-6e47f9416ed6 tempest-ServicesAdminNegativeV253TestJSON-573351714 tempest-ServicesAdminNegativeV253TestJSON-573351714-project-admin] Returning 404 to user: Service 884689ef-7ee0-491e-9844-3d49b03db702 could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:53:01.327280 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-ec03f683-cf07-45c0-939c-6e47f9416ed6 tempest-ServicesAdminNegativeV253TestJSON-573351714 tempest-ServicesAdminNegativeV253TestJSON-573351714-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-services/884689ef-7ee0-491e-9844-3d49b03db702" status: 404 len: 110 microversion: 2.53 time: 0.037978 Sep 14 08:53:01.332220 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 570/1161] 10.222.0.60 () {62 vars in 1309 bytes} [Wed Sep 14 08:53:01 2022] PUT /compute/v2.1/os-services/884689ef-7ee0-491e-9844-3d49b03db702 => generated 110 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 14 08:53:01.340813 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-dbaa37e8-ccbe-4161-b21c-65bae3c31273 tempest-ServicesAdminNegativeV253TestJSON-573351714 tempest-ServicesAdminNegativeV253TestJSON-573351714-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:01.344910 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dbaa37e8-ccbe-4161-b21c-65bae3c31273 tempest-ServicesAdminNegativeV253TestJSON-573351714 tempest-ServicesAdminNegativeV253TestJSON-573351714-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:01.345596 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dbaa37e8-ccbe-4161-b21c-65bae3c31273 tempest-ServicesAdminNegativeV253TestJSON-573351714 tempest-ServicesAdminNegativeV253TestJSON-573351714-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:01.346371 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dbaa37e8-ccbe-4161-b21c-65bae3c31273 tempest-ServicesAdminNegativeV253TestJSON-573351714 tempest-ServicesAdminNegativeV253TestJSON-573351714-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:01.347343 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dbaa37e8-ccbe-4161-b21c-65bae3c31273 tempest-ServicesAdminNegativeV253TestJSON-573351714 tempest-ServicesAdminNegativeV253TestJSON-573351714-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:01.347971 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dbaa37e8-ccbe-4161-b21c-65bae3c31273 tempest-ServicesAdminNegativeV253TestJSON-573351714 tempest-ServicesAdminNegativeV253TestJSON-573351714-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:01.348585 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dbaa37e8-ccbe-4161-b21c-65bae3c31273 tempest-ServicesAdminNegativeV253TestJSON-573351714 tempest-ServicesAdminNegativeV253TestJSON-573351714-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:01.378823 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-dbaa37e8-ccbe-4161-b21c-65bae3c31273 tempest-ServicesAdminNegativeV253TestJSON-573351714 tempest-ServicesAdminNegativeV253TestJSON-573351714-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.045017 Sep 14 08:53:01.379762 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 571/1162] 10.222.0.60 () {60 vars in 1178 bytes} [Wed Sep 14 08:53:01 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:53:01.393254 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-25906dc9-0871-4fa3-b515-2aa0614ba1cc tempest-ServicesAdminNegativeV253TestJSON-573351714 tempest-ServicesAdminNegativeV253TestJSON-573351714-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:01.397761 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-25906dc9-0871-4fa3-b515-2aa0614ba1cc tempest-ServicesAdminNegativeV253TestJSON-573351714 tempest-ServicesAdminNegativeV253TestJSON-573351714-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:01.398446 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-25906dc9-0871-4fa3-b515-2aa0614ba1cc tempest-ServicesAdminNegativeV253TestJSON-573351714 tempest-ServicesAdminNegativeV253TestJSON-573351714-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:01.399861 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-25906dc9-0871-4fa3-b515-2aa0614ba1cc tempest-ServicesAdminNegativeV253TestJSON-573351714 tempest-ServicesAdminNegativeV253TestJSON-573351714-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:01.402311 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-25906dc9-0871-4fa3-b515-2aa0614ba1cc tempest-ServicesAdminNegativeV253TestJSON-573351714 tempest-ServicesAdminNegativeV253TestJSON-573351714-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:01.404918 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-25906dc9-0871-4fa3-b515-2aa0614ba1cc tempest-ServicesAdminNegativeV253TestJSON-573351714 tempest-ServicesAdminNegativeV253TestJSON-573351714-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:01.405749 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-25906dc9-0871-4fa3-b515-2aa0614ba1cc tempest-ServicesAdminNegativeV253TestJSON-573351714 tempest-ServicesAdminNegativeV253TestJSON-573351714-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:01.473588 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-25906dc9-0871-4fa3-b515-2aa0614ba1cc tempest-ServicesAdminNegativeV253TestJSON-573351714 tempest-ServicesAdminNegativeV253TestJSON-573351714-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.083923 Sep 14 08:53:01.487453 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 572/1163] 10.222.0.60 () {60 vars in 1211 bytes} [Wed Sep 14 08:53:01 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1244 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:53:01.493643 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-43db07c8-8ad9-4230-be3d-de86c58ee6fa tempest-ServicesAdminNegativeV253TestJSON-573351714 tempest-ServicesAdminNegativeV253TestJSON-573351714-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:01.498382 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-43db07c8-8ad9-4230-be3d-de86c58ee6fa tempest-ServicesAdminNegativeV253TestJSON-573351714 tempest-ServicesAdminNegativeV253TestJSON-573351714-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:01.499640 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-43db07c8-8ad9-4230-be3d-de86c58ee6fa tempest-ServicesAdminNegativeV253TestJSON-573351714 tempest-ServicesAdminNegativeV253TestJSON-573351714-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:01.500103 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-43db07c8-8ad9-4230-be3d-de86c58ee6fa tempest-ServicesAdminNegativeV253TestJSON-573351714 tempest-ServicesAdminNegativeV253TestJSON-573351714-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:01.501059 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-43db07c8-8ad9-4230-be3d-de86c58ee6fa tempest-ServicesAdminNegativeV253TestJSON-573351714 tempest-ServicesAdminNegativeV253TestJSON-573351714-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:01.501746 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-43db07c8-8ad9-4230-be3d-de86c58ee6fa tempest-ServicesAdminNegativeV253TestJSON-573351714 tempest-ServicesAdminNegativeV253TestJSON-573351714-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:01.502483 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-43db07c8-8ad9-4230-be3d-de86c58ee6fa tempest-ServicesAdminNegativeV253TestJSON-573351714 tempest-ServicesAdminNegativeV253TestJSON-573351714-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:01.534441 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-43db07c8-8ad9-4230-be3d-de86c58ee6fa tempest-ServicesAdminNegativeV253TestJSON-573351714 tempest-ServicesAdminNegativeV253TestJSON-573351714-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.045775 Sep 14 08:53:01.535360 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 573/1164] 10.222.0.60 () {60 vars in 1178 bytes} [Wed Sep 14 08:53:01 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:53:01.547652 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c18bac14-93c5-4668-80ab-4834448b0dbd tempest-ServicesAdminNegativeV253TestJSON-573351714 tempest-ServicesAdminNegativeV253TestJSON-573351714-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:01.551464 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c18bac14-93c5-4668-80ab-4834448b0dbd tempest-ServicesAdminNegativeV253TestJSON-573351714 tempest-ServicesAdminNegativeV253TestJSON-573351714-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:01.552770 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c18bac14-93c5-4668-80ab-4834448b0dbd tempest-ServicesAdminNegativeV253TestJSON-573351714 tempest-ServicesAdminNegativeV253TestJSON-573351714-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:01.554645 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c18bac14-93c5-4668-80ab-4834448b0dbd tempest-ServicesAdminNegativeV253TestJSON-573351714 tempest-ServicesAdminNegativeV253TestJSON-573351714-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:01.555844 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c18bac14-93c5-4668-80ab-4834448b0dbd tempest-ServicesAdminNegativeV253TestJSON-573351714 tempest-ServicesAdminNegativeV253TestJSON-573351714-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:01.556322 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c18bac14-93c5-4668-80ab-4834448b0dbd tempest-ServicesAdminNegativeV253TestJSON-573351714 tempest-ServicesAdminNegativeV253TestJSON-573351714-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:01.556764 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c18bac14-93c5-4668-80ab-4834448b0dbd tempest-ServicesAdminNegativeV253TestJSON-573351714 tempest-ServicesAdminNegativeV253TestJSON-573351714-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:01.581913 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-c18bac14-93c5-4668-80ab-4834448b0dbd tempest-ServicesAdminNegativeV253TestJSON-573351714 tempest-ServicesAdminNegativeV253TestJSON-573351714-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services?host=n-d-836830-18&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.037876 Sep 14 08:53:01.583065 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 574/1165] 10.222.0.60 () {60 vars in 1237 bytes} [Wed Sep 14 08:53:01 2022] GET /compute/v2.1/os-services?host=n-d-836830-18&binary=xxx => generated 16 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:53:01.595255 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-734f5288-20a3-42d6-b75c-de00e71a28fd tempest-ServicesAdminNegativeV253TestJSON-573351714 tempest-ServicesAdminNegativeV253TestJSON-573351714-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:01.599475 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-734f5288-20a3-42d6-b75c-de00e71a28fd tempest-ServicesAdminNegativeV253TestJSON-573351714 tempest-ServicesAdminNegativeV253TestJSON-573351714-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:01.600228 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-734f5288-20a3-42d6-b75c-de00e71a28fd tempest-ServicesAdminNegativeV253TestJSON-573351714 tempest-ServicesAdminNegativeV253TestJSON-573351714-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:01.600734 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-734f5288-20a3-42d6-b75c-de00e71a28fd tempest-ServicesAdminNegativeV253TestJSON-573351714 tempest-ServicesAdminNegativeV253TestJSON-573351714-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:01.601551 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-734f5288-20a3-42d6-b75c-de00e71a28fd tempest-ServicesAdminNegativeV253TestJSON-573351714 tempest-ServicesAdminNegativeV253TestJSON-573351714-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:01.602086 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-734f5288-20a3-42d6-b75c-de00e71a28fd tempest-ServicesAdminNegativeV253TestJSON-573351714 tempest-ServicesAdminNegativeV253TestJSON-573351714-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:01.602585 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-734f5288-20a3-42d6-b75c-de00e71a28fd tempest-ServicesAdminNegativeV253TestJSON-573351714 tempest-ServicesAdminNegativeV253TestJSON-573351714-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:01.630471 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-734f5288-20a3-42d6-b75c-de00e71a28fd tempest-ServicesAdminNegativeV253TestJSON-573351714 tempest-ServicesAdminNegativeV253TestJSON-573351714-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.039222 Sep 14 08:53:01.631383 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 575/1166] 10.222.0.60 () {60 vars in 1178 bytes} [Wed Sep 14 08:53:01 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:53:01.643360 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-209260e9-bc00-49fa-bc75-d88b720bb5bb tempest-ServicesAdminNegativeV253TestJSON-573351714 tempest-ServicesAdminNegativeV253TestJSON-573351714-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:01.649219 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-209260e9-bc00-49fa-bc75-d88b720bb5bb tempest-ServicesAdminNegativeV253TestJSON-573351714 tempest-ServicesAdminNegativeV253TestJSON-573351714-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:01.649219 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-209260e9-bc00-49fa-bc75-d88b720bb5bb tempest-ServicesAdminNegativeV253TestJSON-573351714 tempest-ServicesAdminNegativeV253TestJSON-573351714-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:01.649219 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-209260e9-bc00-49fa-bc75-d88b720bb5bb tempest-ServicesAdminNegativeV253TestJSON-573351714 tempest-ServicesAdminNegativeV253TestJSON-573351714-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:01.649632 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-209260e9-bc00-49fa-bc75-d88b720bb5bb tempest-ServicesAdminNegativeV253TestJSON-573351714 tempest-ServicesAdminNegativeV253TestJSON-573351714-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:01.649632 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-209260e9-bc00-49fa-bc75-d88b720bb5bb tempest-ServicesAdminNegativeV253TestJSON-573351714 tempest-ServicesAdminNegativeV253TestJSON-573351714-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:01.649840 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-209260e9-bc00-49fa-bc75-d88b720bb5bb tempest-ServicesAdminNegativeV253TestJSON-573351714 tempest-ServicesAdminNegativeV253TestJSON-573351714-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:01.676507 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-209260e9-bc00-49fa-bc75-d88b720bb5bb tempest-ServicesAdminNegativeV253TestJSON-573351714 tempest-ServicesAdminNegativeV253TestJSON-573351714-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.036681 Sep 14 08:53:01.685488 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 576/1167] 10.222.0.60 () {60 vars in 1239 bytes} [Wed Sep 14 08:53:01 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:53:01.752684 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-87c00b70-49e4-401b-beff-02f5c88e729b tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ace9012a7c4ce59c01858b6984b766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a87a909133e42e1a82e3a623536935c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:01.766052 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-87c00b70-49e4-401b-beff-02f5c88e729b tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] 10.222.0.60 "GET /compute/v2.1/servers/67f3a983-b33f-49c8-9c91-988e8553563c" status: 200 len: 1324 microversion: 2.1 time: 0.533288 Sep 14 08:53:01.767190 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 592/1168] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:01 2022] GET /compute/v2.1/servers/67f3a983-b33f-49c8-9c91-988e8553563c => generated 1324 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:53:01.846737 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-6dcbca6a-ffc1-4566-9bd4-c6421507323e tempest-ServicesAdminNegativeV253TestJSON-1103468989 tempest-ServicesAdminNegativeV253TestJSON-1103468989-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:01.854750 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-6dcbca6a-ffc1-4566-9bd4-c6421507323e tempest-ServicesAdminNegativeV253TestJSON-1103468989 tempest-ServicesAdminNegativeV253TestJSON-1103468989-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '779d1a76287f4081accd1de5016ab5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7797bfaa846c5bbef7e9703134678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:01.859134 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-6dcbca6a-ffc1-4566-9bd4-c6421507323e tempest-ServicesAdminNegativeV253TestJSON-1103468989 tempest-ServicesAdminNegativeV253TestJSON-1103468989-project] Request method failure captured: Sep 14 08:53:01.859134 n-d-836830-18 devstack@n-api.service[128758]: request: GET /compute/v2.1/os-services HTTP/1.1 Sep 14 08:53:01.859134 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 08:53:01.859134 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 08:53:01.859134 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 08:53:01.859134 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 08:53:01.859134 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 08:53:01.859134 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 08:53:01.859134 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 08:53:01.859134 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 08:53:01.859134 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZZrwvE1znPDAX0OW98kMdDrOxk1oSQLKw54VPdHRKrvr4iS7IyrJkjgDqQm0nNyHYqyNSgWSqV3VS_UulvP9b8cxxOyoaMHGcx5e8Xd2pI1wnALru9aZZMLdzn4ycA2D54-qbwpOBvofrOua2VzyvKGslfjgNT9KuluksyPUs2UAU8 Sep 14 08:53:01.859134 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 08:53:01.859134 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 08:53:01.859134 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 08:53:01.859134 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 08:53:01.859134 n-d-836830-18 devstack@n-api.service[128758]: X-Openstack-Nova-Api-Version: 2.53 Sep 14 08:53:01.859134 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 08:53:01.859134 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 08:53:01.859134 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 18b7797bfaa846c5bbef7e9703134678 Sep 14 08:53:01.859134 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1103468989 Sep 14 08:53:01.859134 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 08:53:01.859134 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 08:53:01.860846 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/18b7797bfaa846c5bbef7e9703134678"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_18b7797bfaa846c5bbef7e9703134678"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/18b7797bfaa846c5bbef7e9703134678"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/18b7797bfaa846c5bbef7e9703134678"}]}] Sep 14 08:53:01.860846 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1103468989 Sep 14 08:53:01.860846 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 18b7797bfaa846c5bbef7e9703134678 Sep 14 08:53:01.860846 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1103468989 Sep 14 08:53:01.860846 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1103468989-project Sep 14 08:53:01.860846 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 08:53:01.860846 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 08:53:01.860846 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 779d1a76287f4081accd1de5016ab5af Sep 14 08:53:01.860846 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1103468989-project Sep 14 08:53:01.860846 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 08:53:01.860846 n-d-836830-18 devstack@n-api.service[128758]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 14 08:53:01.860846 n-d-836830-18 devstack@n-api.service[128758]: action_args: {} Sep 14 08:53:01.861791 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:53:01.861791 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:53:01.861791 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:53:01.861791 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:53:01.861791 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:53:01.861791 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:53:01.861791 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 14 08:53:01.861791 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 08:53:01.861791 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 14 08:53:01.861791 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 08:53:01.861791 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:53:01.861791 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:53:01.861791 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Sep 14 08:53:01.861791 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Sep 14 08:53:01.861791 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 14 08:53:01.861791 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 14 08:53:01.861791 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 14 08:53:01.861791 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 14 08:53:01.861791 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 14 08:53:01.863274 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 14 08:53:01.863274 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 14 08:53:01.863274 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise self.value Sep 14 08:53:01.863274 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 14 08:53:01.863274 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 14 08:53:01.863274 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 14 08:53:01.863274 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 14 08:53:01.863274 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 14 08:53:01.863274 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 14 08:53:01.863274 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 14 08:53:01.863274 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:53:01.863274 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:53:01.863274 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:53:01.863274 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:53:01.863274 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:53:01.863274 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:53:01.863274 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 14 08:53:01.863274 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 14 08:53:01.863274 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 14 08:53:01.863274 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:53:01.868903 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-6dcbca6a-ffc1-4566-9bd4-c6421507323e tempest-ServicesAdminNegativeV253TestJSON-1103468989 tempest-ServicesAdminNegativeV253TestJSON-1103468989-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:53:01.869967 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-6dcbca6a-ffc1-4566-9bd4-c6421507323e tempest-ServicesAdminNegativeV253TestJSON-1103468989 tempest-ServicesAdminNegativeV253TestJSON-1103468989-project] 10.222.0.60 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.183427 Sep 14 08:53:01.870700 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 577/1169] 10.222.0.60 () {60 vars in 1178 bytes} [Wed Sep 14 08:53:01 2022] GET /compute/v2.1/os-services => generated 112 bytes in 185 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Sep 14 08:53:02.298385 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-709fc11c-16c0-4cf8-ab31-ce292285a30a tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:02.299793 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-709fc11c-16c0-4cf8-ab31-ce292285a30a tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: 1b2a9a93-cad5-4b18-abc3-1b88413f88da] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:02.314003 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-709fc11c-16c0-4cf8-ab31-ce292285a30a tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:02.314003 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-709fc11c-16c0-4cf8-ab31-ce292285a30a tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:02.314003 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-709fc11c-16c0-4cf8-ab31-ce292285a30a tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:02.314003 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-709fc11c-16c0-4cf8-ab31-ce292285a30a tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:02.319153 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-709fc11c-16c0-4cf8-ab31-ce292285a30a tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:02.320736 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-709fc11c-16c0-4cf8-ab31-ce292285a30a tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:02.663990 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-709fc11c-16c0-4cf8-ab31-ce292285a30a tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:02.678811 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-709fc11c-16c0-4cf8-ab31-ce292285a30a tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/1b2a9a93-cad5-4b18-abc3-1b88413f88da" status: 200 len: 1312 microversion: 2.1 time: 0.384880 Sep 14 08:53:02.688248 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 593/1170] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:02 2022] GET /compute/v2.1/servers/1b2a9a93-cad5-4b18-abc3-1b88413f88da => generated 1312 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:53:02.791031 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c1c8878b-4472-42ab-8707-269142b42f14 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:02.791667 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-c1c8878b-4472-42ab-8707-269142b42f14 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] [instance: 67f3a983-b33f-49c8-9c91-988e8553563c] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:02.806709 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c1c8878b-4472-42ab-8707-269142b42f14 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:02.807249 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c1c8878b-4472-42ab-8707-269142b42f14 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:02.807696 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c1c8878b-4472-42ab-8707-269142b42f14 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:02.808413 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c1c8878b-4472-42ab-8707-269142b42f14 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:02.808871 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c1c8878b-4472-42ab-8707-269142b42f14 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:02.809300 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c1c8878b-4472-42ab-8707-269142b42f14 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:03.173494 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-c1c8878b-4472-42ab-8707-269142b42f14 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ace9012a7c4ce59c01858b6984b766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a87a909133e42e1a82e3a623536935c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:03.184080 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-c1c8878b-4472-42ab-8707-269142b42f14 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] 10.222.0.60 "GET /compute/v2.1/servers/67f3a983-b33f-49c8-9c91-988e8553563c" status: 200 len: 1324 microversion: 2.1 time: 0.396141 Sep 14 08:53:03.184912 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 578/1171] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:02 2022] GET /compute/v2.1/servers/67f3a983-b33f-49c8-9c91-988e8553563c => generated 1324 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:53:03.325715 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-d432cbbb-b679-4077-abc1-c17255f8181a req-b9832f19-bd68-43af-8fed-474c8ad0c154 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67f3a983-b33f-49c8-9c91-988e8553563c", "name": "network-vif-plugged", "status": "completed", "tag": "07668b52-5928-40b0-b852-24d2a561fd3d"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:53:03.338743 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=7,nova_api:INSERT=3 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:53:03.344078 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-d432cbbb-b679-4077-abc1-c17255f8181a req-b9832f19-bd68-43af-8fed-474c8ad0c154 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:03.344751 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-d432cbbb-b679-4077-abc1-c17255f8181a req-b9832f19-bd68-43af-8fed-474c8ad0c154 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:03.345547 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-d432cbbb-b679-4077-abc1-c17255f8181a req-b9832f19-bd68-43af-8fed-474c8ad0c154 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:03.364110 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-d432cbbb-b679-4077-abc1-c17255f8181a req-b9832f19-bd68-43af-8fed-474c8ad0c154 service nova] Creating event network-vif-plugged:07668b52-5928-40b0-b852-24d2a561fd3d for instance 67f3a983-b33f-49c8-9c91-988e8553563c on n-h1-836830-18 Sep 14 08:53:03.379523 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-d432cbbb-b679-4077-abc1-c17255f8181a req-b9832f19-bd68-43af-8fed-474c8ad0c154 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058461 Sep 14 08:53:03.380764 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 594/1172] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:53:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:53:03.713855 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-7b59ccf8-6710-4a4b-af78-26a5cf0f0b45 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:03.714918 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-7b59ccf8-6710-4a4b-af78-26a5cf0f0b45 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: 1b2a9a93-cad5-4b18-abc3-1b88413f88da] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:03.721919 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7b59ccf8-6710-4a4b-af78-26a5cf0f0b45 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:03.722749 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7b59ccf8-6710-4a4b-af78-26a5cf0f0b45 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:03.723289 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7b59ccf8-6710-4a4b-af78-26a5cf0f0b45 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:03.724652 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7b59ccf8-6710-4a4b-af78-26a5cf0f0b45 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:03.725311 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7b59ccf8-6710-4a4b-af78-26a5cf0f0b45 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:03.725961 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7b59ccf8-6710-4a4b-af78-26a5cf0f0b45 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:03.876677 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-7b59ccf8-6710-4a4b-af78-26a5cf0f0b45 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:03.885329 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-7b59ccf8-6710-4a4b-af78-26a5cf0f0b45 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/1b2a9a93-cad5-4b18-abc3-1b88413f88da" status: 200 len: 1312 microversion: 2.1 time: 0.175261 Sep 14 08:53:03.886145 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 579/1173] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:03 2022] GET /compute/v2.1/servers/1b2a9a93-cad5-4b18-abc3-1b88413f88da => generated 1312 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:53:04.211500 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-fcb3b89a-6c08-42cd-b1e2-764541376d32 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:04.212506 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-fcb3b89a-6c08-42cd-b1e2-764541376d32 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] [instance: 67f3a983-b33f-49c8-9c91-988e8553563c] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:04.230466 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fcb3b89a-6c08-42cd-b1e2-764541376d32 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:04.230980 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fcb3b89a-6c08-42cd-b1e2-764541376d32 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:04.231409 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fcb3b89a-6c08-42cd-b1e2-764541376d32 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:04.232383 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fcb3b89a-6c08-42cd-b1e2-764541376d32 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:04.232833 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fcb3b89a-6c08-42cd-b1e2-764541376d32 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:04.233423 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fcb3b89a-6c08-42cd-b1e2-764541376d32 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:04.423339 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-fcb3b89a-6c08-42cd-b1e2-764541376d32 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ace9012a7c4ce59c01858b6984b766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a87a909133e42e1a82e3a623536935c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:04.434145 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-fcb3b89a-6c08-42cd-b1e2-764541376d32 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] 10.222.0.60 "GET /compute/v2.1/servers/67f3a983-b33f-49c8-9c91-988e8553563c" status: 200 len: 1324 microversion: 2.1 time: 0.227729 Sep 14 08:53:04.438079 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 595/1174] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:04 2022] GET /compute/v2.1/servers/67f3a983-b33f-49c8-9c91-988e8553563c => generated 1324 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:53:04.918707 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d508d84a-fb79-48c5-aa78-f90d9bf79a20 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:04.920495 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-d508d84a-fb79-48c5-aa78-f90d9bf79a20 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: 1b2a9a93-cad5-4b18-abc3-1b88413f88da] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:04.942257 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d508d84a-fb79-48c5-aa78-f90d9bf79a20 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:04.943644 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d508d84a-fb79-48c5-aa78-f90d9bf79a20 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:04.944274 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d508d84a-fb79-48c5-aa78-f90d9bf79a20 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:04.945961 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d508d84a-fb79-48c5-aa78-f90d9bf79a20 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:04.948114 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d508d84a-fb79-48c5-aa78-f90d9bf79a20 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:04.948746 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d508d84a-fb79-48c5-aa78-f90d9bf79a20 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:05.225413 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-d508d84a-fb79-48c5-aa78-f90d9bf79a20 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:05.249488 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-d508d84a-fb79-48c5-aa78-f90d9bf79a20 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/1b2a9a93-cad5-4b18-abc3-1b88413f88da" status: 200 len: 1312 microversion: 2.1 time: 0.340526 Sep 14 08:53:05.254243 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 580/1175] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:04 2022] GET /compute/v2.1/servers/1b2a9a93-cad5-4b18-abc3-1b88413f88da => generated 1312 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:53:05.462448 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c9932377-f049-438d-9575-f74a230681fd tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:05.464417 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-c9932377-f049-438d-9575-f74a230681fd tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] [instance: 67f3a983-b33f-49c8-9c91-988e8553563c] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:05.471505 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c9932377-f049-438d-9575-f74a230681fd tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:05.472003 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c9932377-f049-438d-9575-f74a230681fd tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:05.472437 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c9932377-f049-438d-9575-f74a230681fd tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:05.473156 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c9932377-f049-438d-9575-f74a230681fd tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:05.473619 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c9932377-f049-438d-9575-f74a230681fd tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:05.474593 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c9932377-f049-438d-9575-f74a230681fd tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:05.648233 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-c9932377-f049-438d-9575-f74a230681fd tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ace9012a7c4ce59c01858b6984b766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a87a909133e42e1a82e3a623536935c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:05.652282 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=8 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:53:05.661820 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-c9932377-f049-438d-9575-f74a230681fd tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] 10.222.0.60 "GET /compute/v2.1/servers/67f3a983-b33f-49c8-9c91-988e8553563c" status: 200 len: 1521 microversion: 2.1 time: 0.204346 Sep 14 08:53:05.664174 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 596/1176] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:05 2022] GET /compute/v2.1/servers/67f3a983-b33f-49c8-9c91-988e8553563c => generated 1521 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:53:05.687386 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-45d61ba6-e9ed-45da-8f88-a6a889106d2f tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:05.688276 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-45d61ba6-e9ed-45da-8f88-a6a889106d2f tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] [instance: 67f3a983-b33f-49c8-9c91-988e8553563c] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:05.695908 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-45d61ba6-e9ed-45da-8f88-a6a889106d2f tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:05.696637 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-45d61ba6-e9ed-45da-8f88-a6a889106d2f tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:05.697323 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-45d61ba6-e9ed-45da-8f88-a6a889106d2f tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:05.698257 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-45d61ba6-e9ed-45da-8f88-a6a889106d2f tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:05.699093 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-45d61ba6-e9ed-45da-8f88-a6a889106d2f tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:05.699739 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-45d61ba6-e9ed-45da-8f88-a6a889106d2f tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:05.892994 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-45d61ba6-e9ed-45da-8f88-a6a889106d2f tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ace9012a7c4ce59c01858b6984b766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a87a909133e42e1a82e3a623536935c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:05.895470 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=100 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:53:05.904538 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-45d61ba6-e9ed-45da-8f88-a6a889106d2f tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] 10.222.0.60 "GET /compute/v2.1/servers/67f3a983-b33f-49c8-9c91-988e8553563c" status: 200 len: 1521 microversion: 2.1 time: 0.220926 Sep 14 08:53:05.915646 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 581/1177] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:05 2022] GET /compute/v2.1/servers/67f3a983-b33f-49c8-9c91-988e8553563c => generated 1521 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:53:05.932807 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8869daa3-75f2-4a42-b56a-93ce67d53d25 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1031449772", "metadata": {"": ""}}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:53:05.938309 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8869daa3-75f2-4a42-b56a-93ce67d53d25 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Request method failure captured: Sep 14 08:53:05.938309 n-d-836830-18 devstack@n-api.service[128759]: request: POST /compute/v2.1/servers/67f3a983-b33f-49c8-9c91-988e8553563c/action HTTP/1.1 Sep 14 08:53:05.938309 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 08:53:05.938309 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 08:53:05.938309 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 08:53:05.938309 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 107 Sep 14 08:53:05.938309 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 08:53:05.938309 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 08:53:05.938309 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 08:53:05.938309 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 08:53:05.938309 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZZS4Po83Aovv_U3RdkjXLQKweaQf-fhAgT61i_A11uamuOl6sYuSjebIurWFthtZrzpGvY9uLyOeI1i9q8ClJm3kMoDWgYaqbwGjdZ-I8VmC2NF95wjpQldZSAgTTLlPF11CuzqbhW26YYuwljJxckz8_fE9N_t89yQzibByeeP394 Sep 14 08:53:05.938309 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 08:53:05.938309 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 08:53:05.938309 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 08:53:05.938309 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 08:53:05.938309 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 08:53:05.938309 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 08:53:05.938309 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 0a87a909133e42e1a82e3a623536935c Sep 14 08:53:05.938309 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1646226177 Sep 14 08:53:05.938309 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 08:53:05.938309 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 08:53:05.940140 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0a87a909133e42e1a82e3a623536935c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0a87a909133e42e1a82e3a623536935c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0a87a909133e42e1a82e3a623536935c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0a87a909133e42e1a82e3a623536935c"}]}] Sep 14 08:53:05.940140 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1646226177 Sep 14 08:53:05.940140 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 0a87a909133e42e1a82e3a623536935c Sep 14 08:53:05.940140 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1646226177 Sep 14 08:53:05.940140 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ImagesOneServerNegativeTestJSON-1646226177-project Sep 14 08:53:05.940140 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 08:53:05.940140 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 08:53:05.940140 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: a3ace9012a7c4ce59c01858b6984b766 Sep 14 08:53:05.940140 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1646226177-project Sep 14 08:53:05.940140 n-d-836830-18 devstack@n-api.service[128759]: Sep 14 08:53:05.940140 n-d-836830-18 devstack@n-api.service[128759]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1031449772", "metadata": {"": ""}}} Sep 14 08:53:05.940140 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 08:53:05.941168 n-d-836830-18 devstack@n-api.service[128759]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 14 08:53:05.941168 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '67f3a983-b33f-49c8-9c91-988e8553563c', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1031449772', 'metadata': {'': ''}}}} Sep 14 08:53:05.941168 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:53:05.941168 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:53:05.941168 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 14 08:53:05.941168 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 14 08:53:05.941168 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 14 08:53:05.941168 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise error Sep 14 08:53:05.941168 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 14 08:53:05.941168 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:53:05.941168 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Sep 14 08:53:05.941168 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 14 08:53:05.941168 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 14 08:53:05.941168 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 14 08:53:05.941168 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 14 08:53:05.941168 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:53:05.941168 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi On instance['createImage']: Sep 14 08:53:05.941168 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi {'': ''} Sep 14 08:53:05.941168 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:53:05.941168 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:53:05.941168 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:53:05.942930 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:53:05.942930 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:53:05.942930 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:53:05.942930 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:53:05.942930 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:53:05.942930 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:53:05.942930 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:53:05.942930 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 08:53:05.942930 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 08:53:05.942930 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 14 08:53:05.942930 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 14 08:53:05.942930 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 14 08:53:05.942930 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 14 08:53:05.942930 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 14 08:53:05.942930 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 14 08:53:05.942930 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 14 08:53:05.942930 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:53:05.942930 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:53:05.942930 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:53:05.942930 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:53:05.944328 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:53:05.944328 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:53:05.944328 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 14 08:53:05.944328 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 14 08:53:05.944328 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 14 08:53:05.944328 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:53:05.944328 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8869daa3-75f2-4a42-b56a-93ce67d53d25 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:53:05.944328 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-8869daa3-75f2-4a42-b56a-93ce67d53d25 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] 10.222.0.60 "POST /compute/v2.1/servers/67f3a983-b33f-49c8-9c91-988e8553563c/action" status: 400 len: 170 microversion: 2.1 time: 0.014215 Sep 14 08:53:05.944328 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 597/1178] 10.222.0.60 () {60 vars in 1279 bytes} [Wed Sep 14 08:53:05 2022] POST /compute/v2.1/servers/67f3a983-b33f-49c8-9c91-988e8553563c/action => generated 170 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 14 08:53:05.953005 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-473769ec-c81c-4c94-93b0-921eff6b5c17 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:05.953714 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-473769ec-c81c-4c94-93b0-921eff6b5c17 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] [instance: 67f3a983-b33f-49c8-9c91-988e8553563c] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:05.961648 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-473769ec-c81c-4c94-93b0-921eff6b5c17 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:05.962239 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-473769ec-c81c-4c94-93b0-921eff6b5c17 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:05.962751 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-473769ec-c81c-4c94-93b0-921eff6b5c17 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:05.965676 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-473769ec-c81c-4c94-93b0-921eff6b5c17 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:05.966446 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-473769ec-c81c-4c94-93b0-921eff6b5c17 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:05.966966 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-473769ec-c81c-4c94-93b0-921eff6b5c17 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:06.151965 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-473769ec-c81c-4c94-93b0-921eff6b5c17 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ace9012a7c4ce59c01858b6984b766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a87a909133e42e1a82e3a623536935c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:06.165776 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-473769ec-c81c-4c94-93b0-921eff6b5c17 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] 10.222.0.60 "GET /compute/v2.1/servers/67f3a983-b33f-49c8-9c91-988e8553563c" status: 200 len: 1521 microversion: 2.1 time: 0.217383 Sep 14 08:53:06.167033 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 582/1179] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:05 2022] GET /compute/v2.1/servers/67f3a983-b33f-49c8-9c91-988e8553563c => generated 1521 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:53:06.191713 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-456a8171-25b1-466d-858e-1d1d16f1bf86 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:06.192346 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-456a8171-25b1-466d-858e-1d1d16f1bf86 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] [instance: 67f3a983-b33f-49c8-9c91-988e8553563c] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:06.205591 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-456a8171-25b1-466d-858e-1d1d16f1bf86 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:06.206383 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-456a8171-25b1-466d-858e-1d1d16f1bf86 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:06.207047 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-456a8171-25b1-466d-858e-1d1d16f1bf86 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:06.208928 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-456a8171-25b1-466d-858e-1d1d16f1bf86 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:06.209563 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-456a8171-25b1-466d-858e-1d1d16f1bf86 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:06.213722 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-456a8171-25b1-466d-858e-1d1d16f1bf86 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:06.275943 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-62155554-0c10-4ada-adf3-9991b3e786ad tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:06.277546 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-62155554-0c10-4ada-adf3-9991b3e786ad tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: 1b2a9a93-cad5-4b18-abc3-1b88413f88da] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:06.301681 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-62155554-0c10-4ada-adf3-9991b3e786ad tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:06.302400 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-62155554-0c10-4ada-adf3-9991b3e786ad tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:06.302845 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-62155554-0c10-4ada-adf3-9991b3e786ad tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:06.311662 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-62155554-0c10-4ada-adf3-9991b3e786ad tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:06.312310 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-62155554-0c10-4ada-adf3-9991b3e786ad tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:06.312759 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-62155554-0c10-4ada-adf3-9991b3e786ad tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:06.510085 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-456a8171-25b1-466d-858e-1d1d16f1bf86 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ace9012a7c4ce59c01858b6984b766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a87a909133e42e1a82e3a623536935c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:06.518882 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-456a8171-25b1-466d-858e-1d1d16f1bf86 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] 10.222.0.60 "GET /compute/v2.1/servers/67f3a983-b33f-49c8-9c91-988e8553563c" status: 200 len: 1521 microversion: 2.1 time: 0.331384 Sep 14 08:53:06.523024 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 598/1180] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:06 2022] GET /compute/v2.1/servers/67f3a983-b33f-49c8-9c91-988e8553563c => generated 1521 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:53:06.592756 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-62155554-0c10-4ada-adf3-9991b3e786ad tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:06.601931 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-62155554-0c10-4ada-adf3-9991b3e786ad tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/1b2a9a93-cad5-4b18-abc3-1b88413f88da" status: 200 len: 1312 microversion: 2.1 time: 0.332042 Sep 14 08:53:06.610969 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 583/1181] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:06 2022] GET /compute/v2.1/servers/1b2a9a93-cad5-4b18-abc3-1b88413f88da => generated 1312 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:53:06.610969 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d2c4f263-b8e8-4a5a-80cc-7ce320b9e694 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1034545334", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:53:06.618974 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d2c4f263-b8e8-4a5a-80cc-7ce320b9e694 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Request method failure captured: Sep 14 08:53:06.618974 n-d-836830-18 devstack@n-api.service[128758]: request: POST /compute/v2.1/servers/67f3a983-b33f-49c8-9c91-988e8553563c/action HTTP/1.1 Sep 14 08:53:06.618974 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 08:53:06.618974 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 08:53:06.618974 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 08:53:06.618974 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 619 Sep 14 08:53:06.618974 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 08:53:06.618974 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 08:53:06.618974 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 08:53:06.618974 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 08:53:06.618974 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZZS4Po83Aovv_U3RdkjXLQKweaQf-fhAgT61i_A11uamuOl6sYuSjebIurWFthtZrzpGvY9uLyOeI1i9q8ClJm3kMoDWgYaqbwGjdZ-I8VmC2NF95wjpQldZSAgTTLlPF11CuzqbhW26YYuwljJxckz8_fE9N_t89yQzibByeeP394 Sep 14 08:53:06.618974 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 08:53:06.618974 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 08:53:06.618974 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 08:53:06.618974 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 08:53:06.618974 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 08:53:06.618974 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 08:53:06.618974 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 0a87a909133e42e1a82e3a623536935c Sep 14 08:53:06.618974 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1646226177 Sep 14 08:53:06.618974 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 08:53:06.618974 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 08:53:06.620410 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0a87a909133e42e1a82e3a623536935c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0a87a909133e42e1a82e3a623536935c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0a87a909133e42e1a82e3a623536935c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0a87a909133e42e1a82e3a623536935c"}]}] Sep 14 08:53:06.620410 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1646226177 Sep 14 08:53:06.620410 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 0a87a909133e42e1a82e3a623536935c Sep 14 08:53:06.620410 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1646226177 Sep 14 08:53:06.620410 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-ImagesOneServerNegativeTestJSON-1646226177-project Sep 14 08:53:06.620410 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 08:53:06.620410 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 08:53:06.620410 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: a3ace9012a7c4ce59c01858b6984b766 Sep 14 08:53:06.620410 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1646226177-project Sep 14 08:53:06.620410 n-d-836830-18 devstack@n-api.service[128758]: Sep 14 08:53:06.621052 n-d-836830-18 devstack@n-api.service[128758]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1034545334", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Sep 14 08:53:06.621052 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 08:53:06.621052 n-d-836830-18 devstack@n-api.service[128758]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 14 08:53:06.621421 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': '67f3a983-b33f-49c8-9c91-988e8553563c', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1034545334', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Sep 14 08:53:06.621421 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:53:06.621421 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:53:06.621421 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 14 08:53:06.621421 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 14 08:53:06.621421 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 14 08:53:06.621421 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise error Sep 14 08:53:06.621421 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 14 08:53:06.621421 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:53:06.621421 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Sep 14 08:53:06.621421 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 14 08:53:06.622215 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 14 08:53:06.622215 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 14 08:53:06.622215 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 14 08:53:06.622215 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:53:06.622215 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi On instance['createImage']: Sep 14 08:53:06.622215 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Sep 14 08:53:06.622215 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:53:06.622215 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:53:06.622215 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:53:06.622215 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:53:06.622215 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:53:06.622215 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:53:06.622215 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:53:06.622215 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:53:06.622215 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:53:06.622215 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:53:06.622215 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 08:53:06.624594 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 08:53:06.624594 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 14 08:53:06.624594 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 14 08:53:06.624594 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 14 08:53:06.624594 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 14 08:53:06.624594 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 14 08:53:06.624594 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 14 08:53:06.624594 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 14 08:53:06.624594 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:53:06.624594 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:53:06.624594 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:53:06.624594 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:53:06.626253 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:53:06.626253 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:53:06.626253 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 14 08:53:06.626253 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 14 08:53:06.626253 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 14 08:53:06.626253 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:53:06.626904 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d2c4f263-b8e8-4a5a-80cc-7ce320b9e694 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:53:06.626904 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-d2c4f263-b8e8-4a5a-80cc-7ce320b9e694 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] 10.222.0.60 "POST /compute/v2.1/servers/67f3a983-b33f-49c8-9c91-988e8553563c/action" status: 400 len: 938 microversion: 2.1 time: 0.010408 Sep 14 08:53:06.626904 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 584/1182] 10.222.0.60 () {60 vars in 1279 bytes} [Wed Sep 14 08:53:06 2022] POST /compute/v2.1/servers/67f3a983-b33f-49c8-9c91-988e8553563c/action => generated 938 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 14 08:53:06.647399 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-aab9a059-2d41-4df3-8770-cecd8a1fec58 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:06.648081 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-aab9a059-2d41-4df3-8770-cecd8a1fec58 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] [instance: 67f3a983-b33f-49c8-9c91-988e8553563c] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:06.655625 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:53:06.662470 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-aab9a059-2d41-4df3-8770-cecd8a1fec58 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:06.663023 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-aab9a059-2d41-4df3-8770-cecd8a1fec58 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:06.663598 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-aab9a059-2d41-4df3-8770-cecd8a1fec58 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:06.665294 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-aab9a059-2d41-4df3-8770-cecd8a1fec58 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:06.665775 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-aab9a059-2d41-4df3-8770-cecd8a1fec58 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:06.666213 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-aab9a059-2d41-4df3-8770-cecd8a1fec58 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:06.769900 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f8c8fb32-1139-4875-8cc7-7c6335a772d8 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-1118520603", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:53:06.853375 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.network.neutron [None req-f8c8fb32-1139-4875-8cc7-7c6335a772d8 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] validate_networks() for None {{(pid=128759) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 08:53:06.862609 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-aab9a059-2d41-4df3-8770-cecd8a1fec58 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ace9012a7c4ce59c01858b6984b766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a87a909133e42e1a82e3a623536935c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:06.871896 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-aab9a059-2d41-4df3-8770-cecd8a1fec58 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] 10.222.0.60 "GET /compute/v2.1/servers/67f3a983-b33f-49c8-9c91-988e8553563c" status: 200 len: 1521 microversion: 2.1 time: 0.240548 Sep 14 08:53:06.887600 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 585/1183] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:06 2022] GET /compute/v2.1/servers/67f3a983-b33f-49c8-9c91-988e8553563c => generated 1521 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:53:06.896528 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-914104e2-cbe3-4c4a-9108-8de590b549f2 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:06.897152 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-914104e2-cbe3-4c4a-9108-8de590b549f2 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] [instance: 67f3a983-b33f-49c8-9c91-988e8553563c] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:06.903944 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-914104e2-cbe3-4c4a-9108-8de590b549f2 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:06.904500 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-914104e2-cbe3-4c4a-9108-8de590b549f2 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:06.904946 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-914104e2-cbe3-4c4a-9108-8de590b549f2 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:06.905653 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-914104e2-cbe3-4c4a-9108-8de590b549f2 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:06.906111 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-914104e2-cbe3-4c4a-9108-8de590b549f2 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:06.906539 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-914104e2-cbe3-4c4a-9108-8de590b549f2 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:07.150774 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-914104e2-cbe3-4c4a-9108-8de590b549f2 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ace9012a7c4ce59c01858b6984b766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a87a909133e42e1a82e3a623536935c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:07.159854 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-914104e2-cbe3-4c4a-9108-8de590b549f2 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] 10.222.0.60 "GET /compute/v2.1/servers/67f3a983-b33f-49c8-9c91-988e8553563c" status: 200 len: 1521 microversion: 2.1 time: 0.267293 Sep 14 08:53:07.180221 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 586/1184] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:06 2022] GET /compute/v2.1/servers/67f3a983-b33f-49c8-9c91-988e8553563c => generated 1521 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:53:07.187711 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-547dfe77-6f90-4024-b8cb-e3403c6c6271 req-28196d36-ced7-4e1f-b4e2-347e8fe1130d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b2a9a93-cad5-4b18-abc3-1b88413f88da", "name": "network-vif-plugged", "status": "completed", "tag": "3db17a23-17af-436b-96e5-130e5c8353bc"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:53:07.206458 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-547dfe77-6f90-4024-b8cb-e3403c6c6271 req-28196d36-ced7-4e1f-b4e2-347e8fe1130d service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:07.207234 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-547dfe77-6f90-4024-b8cb-e3403c6c6271 req-28196d36-ced7-4e1f-b4e2-347e8fe1130d service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:07.207849 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-547dfe77-6f90-4024-b8cb-e3403c6c6271 req-28196d36-ced7-4e1f-b4e2-347e8fe1130d service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:07.219762 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-f8c8fb32-1139-4875-8cc7-7c6335a772d8 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Flavor limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 08:53:07.220543 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-f8c8fb32-1139-4875-8cc7-7c6335a772d8 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Image limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 08:53:07.221430 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-f8c8fb32-1139-4875-8cc7-7c6335a772d8 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Flavor pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 08:53:07.222260 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-f8c8fb32-1139-4875-8cc7-7c6335a772d8 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Image pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 08:53:07.222837 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-f8c8fb32-1139-4875-8cc7-7c6335a772d8 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 08:53:07.226216 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-547dfe77-6f90-4024-b8cb-e3403c6c6271 req-28196d36-ced7-4e1f-b4e2-347e8fe1130d service nova] Creating event network-vif-plugged:3db17a23-17af-436b-96e5-130e5c8353bc for instance 1b2a9a93-cad5-4b18-abc3-1b88413f88da on n-h2-836830-18 Sep 14 08:53:07.234310 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f8c8fb32-1139-4875-8cc7-7c6335a772d8 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:07.235248 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f8c8fb32-1139-4875-8cc7-7c6335a772d8 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:07.235533 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-547dfe77-6f90-4024-b8cb-e3403c6c6271 req-28196d36-ced7-4e1f-b4e2-347e8fe1130d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053861 Sep 14 08:53:07.236031 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f8c8fb32-1139-4875-8cc7-7c6335a772d8 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:07.236894 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 587/1185] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:53:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:53:07.237397 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f8c8fb32-1139-4875-8cc7-7c6335a772d8 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:07.238032 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f8c8fb32-1139-4875-8cc7-7c6335a772d8 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:07.239201 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f8c8fb32-1139-4875-8cc7-7c6335a772d8 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:07.244442 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-9351ea6e-eeb2-4af7-8c4e-de423b1a4a18 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:53:07.265736 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-9351ea6e-eeb2-4af7-8c4e-de423b1a4a18 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Request method failure captured: Sep 14 08:53:07.265736 n-d-836830-18 devstack@n-api.service[128758]: request: POST /compute/v2.1/servers/67f3a983-b33f-49c8-9c91-988e8553563c/action HTTP/1.1 Sep 14 08:53:07.265736 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 08:53:07.265736 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 08:53:07.265736 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 08:53:07.265736 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 285 Sep 14 08:53:07.265736 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 08:53:07.265736 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 08:53:07.265736 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 08:53:07.265736 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 08:53:07.265736 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZZS4Po83Aovv_U3RdkjXLQKweaQf-fhAgT61i_A11uamuOl6sYuSjebIurWFthtZrzpGvY9uLyOeI1i9q8ClJm3kMoDWgYaqbwGjdZ-I8VmC2NF95wjpQldZSAgTTLlPF11CuzqbhW26YYuwljJxckz8_fE9N_t89yQzibByeeP394 Sep 14 08:53:07.265736 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 08:53:07.265736 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 08:53:07.265736 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 08:53:07.265736 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 08:53:07.265736 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 08:53:07.265736 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 08:53:07.265736 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 0a87a909133e42e1a82e3a623536935c Sep 14 08:53:07.265736 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1646226177 Sep 14 08:53:07.265736 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 08:53:07.265736 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 08:53:07.267293 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0a87a909133e42e1a82e3a623536935c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0a87a909133e42e1a82e3a623536935c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0a87a909133e42e1a82e3a623536935c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0a87a909133e42e1a82e3a623536935c"}]}] Sep 14 08:53:07.267293 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1646226177 Sep 14 08:53:07.267293 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 0a87a909133e42e1a82e3a623536935c Sep 14 08:53:07.267293 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1646226177 Sep 14 08:53:07.267293 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-ImagesOneServerNegativeTestJSON-1646226177-project Sep 14 08:53:07.267293 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 08:53:07.267293 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 08:53:07.267293 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: a3ace9012a7c4ce59c01858b6984b766 Sep 14 08:53:07.267293 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1646226177-project Sep 14 08:53:07.267293 n-d-836830-18 devstack@n-api.service[128758]: Sep 14 08:53:07.267293 n-d-836830-18 devstack@n-api.service[128758]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Sep 14 08:53:07.271912 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 08:53:07.271912 n-d-836830-18 devstack@n-api.service[128758]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 14 08:53:07.271912 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': '67f3a983-b33f-49c8-9c91-988e8553563c', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Sep 14 08:53:07.271912 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:53:07.271912 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:53:07.271912 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 14 08:53:07.271912 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 14 08:53:07.271912 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 14 08:53:07.271912 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise error Sep 14 08:53:07.271912 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 14 08:53:07.272612 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:53:07.272612 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Sep 14 08:53:07.272612 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 14 08:53:07.272612 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:53:07.272612 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi On instance['createImage']: Sep 14 08:53:07.272612 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Sep 14 08:53:07.272612 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:53:07.272612 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:53:07.272612 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:53:07.272612 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:53:07.272612 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:53:07.272612 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:53:07.272612 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:53:07.272612 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:53:07.272612 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:53:07.272612 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:53:07.272612 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 08:53:07.272612 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 08:53:07.272612 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 14 08:53:07.272612 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 14 08:53:07.274390 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 14 08:53:07.274390 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 14 08:53:07.274390 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 14 08:53:07.274390 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 14 08:53:07.274390 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 14 08:53:07.274390 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:53:07.274390 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:53:07.274390 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:53:07.274390 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:53:07.274390 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:53:07.274390 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:53:07.274390 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 14 08:53:07.274390 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 14 08:53:07.275518 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 14 08:53:07.275518 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:53:07.275518 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-9351ea6e-eeb2-4af7-8c4e-de423b1a4a18 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:53:07.275518 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-9351ea6e-eeb2-4af7-8c4e-de423b1a4a18 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] 10.222.0.60 "POST /compute/v2.1/servers/67f3a983-b33f-49c8-9c91-988e8553563c/action" status: 400 len: 619 microversion: 2.1 time: 0.029226 Sep 14 08:53:07.275884 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 588/1186] 10.222.0.60 () {60 vars in 1279 bytes} [Wed Sep 14 08:53:07 2022] POST /compute/v2.1/servers/67f3a983-b33f-49c8-9c91-988e8553563c/action => generated 619 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 14 08:53:07.290381 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-9add1c3a-6bcd-44a5-93bb-5178cf812c8b tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:07.292717 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-9add1c3a-6bcd-44a5-93bb-5178cf812c8b tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] [instance: 67f3a983-b33f-49c8-9c91-988e8553563c] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:07.324090 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9add1c3a-6bcd-44a5-93bb-5178cf812c8b tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:07.324824 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9add1c3a-6bcd-44a5-93bb-5178cf812c8b tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:07.325431 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9add1c3a-6bcd-44a5-93bb-5178cf812c8b tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:07.326313 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9add1c3a-6bcd-44a5-93bb-5178cf812c8b tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:07.326968 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9add1c3a-6bcd-44a5-93bb-5178cf812c8b tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:07.327551 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9add1c3a-6bcd-44a5-93bb-5178cf812c8b tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:07.333125 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-f8c8fb32-1139-4875-8cc7-7c6335a772d8 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Getting quotas for project 7ffed678f9684721b3342a11fa885200. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 08:53:07.346836 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-f8c8fb32-1139-4875-8cc7-7c6335a772d8 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Getting quotas for user baa9e50aadef494c8f72ccf88bdc5dbd and project 7ffed678f9684721b3342a11fa885200. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 08:53:07.366445 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f8c8fb32-1139-4875-8cc7-7c6335a772d8 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Going to run 1 instances... {{(pid=128759) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 08:53:07.386638 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f8c8fb32-1139-4875-8cc7-7c6335a772d8 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] [instance: 43730a9e-d747-4589-863f-a1c68e14b2a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128759) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 08:53:07.451908 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f8c8fb32-1139-4875-8cc7-7c6335a772d8 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.927720 Sep 14 08:53:07.460820 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 599/1187] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 08:53:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 931 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 08:53:07.467546 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e715a5e3-6d45-406b-9495-0e784284786e tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:07.468770 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e715a5e3-6d45-406b-9495-0e784284786e tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] [instance: 43730a9e-d747-4589-863f-a1c68e14b2a7] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:07.558272 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-9add1c3a-6bcd-44a5-93bb-5178cf812c8b tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ace9012a7c4ce59c01858b6984b766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a87a909133e42e1a82e3a623536935c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:07.561499 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-e715a5e3-6d45-406b-9495-0e784284786e tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa9e50aadef494c8f72ccf88bdc5dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ffed678f9684721b3342a11fa885200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:07.572429 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-9add1c3a-6bcd-44a5-93bb-5178cf812c8b tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] 10.222.0.60 "GET /compute/v2.1/servers/67f3a983-b33f-49c8-9c91-988e8553563c" status: 200 len: 1521 microversion: 2.1 time: 0.299378 Sep 14 08:53:07.579259 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 589/1188] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:07 2022] GET /compute/v2.1/servers/67f3a983-b33f-49c8-9c91-988e8553563c => generated 1521 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:53:07.585089 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e715a5e3-6d45-406b-9495-0e784284786e tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] 10.222.0.60 "GET /compute/v2.1/servers/43730a9e-d747-4589-863f-a1c68e14b2a7" status: 200 len: 1214 microversion: 2.1 time: 0.122671 Sep 14 08:53:07.587536 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 600/1189] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:07 2022] GET /compute/v2.1/servers/43730a9e-d747-4589-863f-a1c68e14b2a7 => generated 1214 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:53:07.600614 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-25844564-8fc1-4e41-94a3-487b5d509470 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:07.601646 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-25844564-8fc1-4e41-94a3-487b5d509470 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] [instance: 67f3a983-b33f-49c8-9c91-988e8553563c] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:07.622071 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-25844564-8fc1-4e41-94a3-487b5d509470 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:07.622576 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-25844564-8fc1-4e41-94a3-487b5d509470 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:07.623032 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-25844564-8fc1-4e41-94a3-487b5d509470 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:07.624680 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-25844564-8fc1-4e41-94a3-487b5d509470 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:07.625475 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-25844564-8fc1-4e41-94a3-487b5d509470 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:07.631713 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-07d22379-b8ea-47b2-afad-9a0067f7fcd1 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:07.632539 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-07d22379-b8ea-47b2-afad-9a0067f7fcd1 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: 1b2a9a93-cad5-4b18-abc3-1b88413f88da] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:07.641094 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-25844564-8fc1-4e41-94a3-487b5d509470 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:07.658666 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-07d22379-b8ea-47b2-afad-9a0067f7fcd1 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:07.659214 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-07d22379-b8ea-47b2-afad-9a0067f7fcd1 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:07.659660 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-07d22379-b8ea-47b2-afad-9a0067f7fcd1 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:07.660378 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-07d22379-b8ea-47b2-afad-9a0067f7fcd1 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:07.660841 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-07d22379-b8ea-47b2-afad-9a0067f7fcd1 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:07.665047 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-07d22379-b8ea-47b2-afad-9a0067f7fcd1 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:08.031963 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-07d22379-b8ea-47b2-afad-9a0067f7fcd1 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:08.049028 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-07d22379-b8ea-47b2-afad-9a0067f7fcd1 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/1b2a9a93-cad5-4b18-abc3-1b88413f88da" status: 200 len: 1312 microversion: 2.1 time: 0.421816 Sep 14 08:53:08.049639 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 601/1190] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:07 2022] GET /compute/v2.1/servers/1b2a9a93-cad5-4b18-abc3-1b88413f88da => generated 1312 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:53:08.062514 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-25844564-8fc1-4e41-94a3-487b5d509470 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ace9012a7c4ce59c01858b6984b766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a87a909133e42e1a82e3a623536935c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:08.074904 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-25844564-8fc1-4e41-94a3-487b5d509470 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] 10.222.0.60 "GET /compute/v2.1/servers/67f3a983-b33f-49c8-9c91-988e8553563c" status: 200 len: 1521 microversion: 2.1 time: 0.478625 Sep 14 08:53:08.078269 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 590/1191] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:07 2022] GET /compute/v2.1/servers/67f3a983-b33f-49c8-9c91-988e8553563c => generated 1521 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:53:08.104711 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e5608fab-4c2d-499a-8e34-342dd9d6ca80 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1012073781"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:53:08.107409 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e5608fab-4c2d-499a-8e34-342dd9d6ca80 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] [instance: 67f3a983-b33f-49c8-9c91-988e8553563c] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:08.119951 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e5608fab-4c2d-499a-8e34-342dd9d6ca80 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:08.120446 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e5608fab-4c2d-499a-8e34-342dd9d6ca80 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:08.120885 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e5608fab-4c2d-499a-8e34-342dd9d6ca80 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:08.121619 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e5608fab-4c2d-499a-8e34-342dd9d6ca80 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:08.122044 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e5608fab-4c2d-499a-8e34-342dd9d6ca80 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:08.122473 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e5608fab-4c2d-499a-8e34-342dd9d6ca80 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:08.403022 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=100 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:53:08.425628 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-20f08a3c-ccc2-4077-b215-a00d957b2fdc tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:08.426409 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-20f08a3c-ccc2-4077-b215-a00d957b2fdc tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] [instance: 8fce8438-d6ae-408d-8b4f-ee14d4021fdd] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:08.439887 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-20f08a3c-ccc2-4077-b215-a00d957b2fdc tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:08.444779 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-20f08a3c-ccc2-4077-b215-a00d957b2fdc tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:08.445610 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-20f08a3c-ccc2-4077-b215-a00d957b2fdc tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:08.447449 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-20f08a3c-ccc2-4077-b215-a00d957b2fdc tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:08.449028 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-20f08a3c-ccc2-4077-b215-a00d957b2fdc tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:08.450250 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-20f08a3c-ccc2-4077-b215-a00d957b2fdc tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:08.469990 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e5608fab-4c2d-499a-8e34-342dd9d6ca80 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] 10.222.0.60 "POST /compute/v2.1/servers/67f3a983-b33f-49c8-9c91-988e8553563c/action" status: 202 len: 0 microversion: 2.1 time: 0.368916 Sep 14 08:53:08.478587 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 602/1192] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 08:53:08 2022] POST /compute/v2.1/servers/67f3a983-b33f-49c8-9c91-988e8553563c/action => generated 0 bytes in 378 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 14 08:53:08.484472 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b9e4ce8d-1ccd-4b65-8719-242f9dea4150 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-63650251"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:53:08.487470 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b9e4ce8d-1ccd-4b65-8719-242f9dea4150 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] [instance: 67f3a983-b33f-49c8-9c91-988e8553563c] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:08.496628 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b9e4ce8d-1ccd-4b65-8719-242f9dea4150 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:08.497991 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b9e4ce8d-1ccd-4b65-8719-242f9dea4150 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:08.498817 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b9e4ce8d-1ccd-4b65-8719-242f9dea4150 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:08.499756 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b9e4ce8d-1ccd-4b65-8719-242f9dea4150 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:08.500374 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b9e4ce8d-1ccd-4b65-8719-242f9dea4150 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:08.501658 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b9e4ce8d-1ccd-4b65-8719-242f9dea4150 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:08.586141 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-b9e4ce8d-1ccd-4b65-8719-242f9dea4150 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] HTTP exception thrown: Cannot 'createImage' instance 67f3a983-b33f-49c8-9c91-988e8553563c while it is in task_state image_snapshot_pending Sep 14 08:53:08.605891 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b9e4ce8d-1ccd-4b65-8719-242f9dea4150 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Request method failure captured: Sep 14 08:53:08.605891 n-d-836830-18 devstack@n-api.service[128759]: request: POST /compute/v2.1/servers/67f3a983-b33f-49c8-9c91-988e8553563c/action HTTP/1.1 Sep 14 08:53:08.605891 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 08:53:08.605891 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 08:53:08.605891 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 08:53:08.605891 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 83 Sep 14 08:53:08.605891 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 08:53:08.605891 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 08:53:08.605891 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 08:53:08.605891 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 08:53:08.605891 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZZS4Po83Aovv_U3RdkjXLQKweaQf-fhAgT61i_A11uamuOl6sYuSjebIurWFthtZrzpGvY9uLyOeI1i9q8ClJm3kMoDWgYaqbwGjdZ-I8VmC2NF95wjpQldZSAgTTLlPF11CuzqbhW26YYuwljJxckz8_fE9N_t89yQzibByeeP394 Sep 14 08:53:08.605891 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 08:53:08.605891 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 08:53:08.605891 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 08:53:08.605891 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 08:53:08.605891 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 08:53:08.605891 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 08:53:08.605891 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 0a87a909133e42e1a82e3a623536935c Sep 14 08:53:08.605891 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1646226177 Sep 14 08:53:08.605891 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 08:53:08.605891 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 08:53:08.607445 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0a87a909133e42e1a82e3a623536935c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0a87a909133e42e1a82e3a623536935c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0a87a909133e42e1a82e3a623536935c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0a87a909133e42e1a82e3a623536935c"}]}] Sep 14 08:53:08.607445 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1646226177 Sep 14 08:53:08.607445 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 0a87a909133e42e1a82e3a623536935c Sep 14 08:53:08.607445 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1646226177 Sep 14 08:53:08.607445 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ImagesOneServerNegativeTestJSON-1646226177-project Sep 14 08:53:08.607445 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 08:53:08.607445 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 08:53:08.607445 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: a3ace9012a7c4ce59c01858b6984b766 Sep 14 08:53:08.607445 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1646226177-project Sep 14 08:53:08.607445 n-d-836830-18 devstack@n-api.service[128759]: Sep 14 08:53:08.607445 n-d-836830-18 devstack@n-api.service[128759]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-63650251"}} Sep 14 08:53:08.607445 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 08:53:08.608258 n-d-836830-18 devstack@n-api.service[128759]: exception: Cannot 'createImage' instance 67f3a983-b33f-49c8-9c91-988e8553563c while it is in task_state image_snapshot_pending Sep 14 08:53:08.608258 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '67f3a983-b33f-49c8-9c91-988e8553563c', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-63650251'}}} Sep 14 08:53:08.608258 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:53:08.608258 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:53:08.608258 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1349, in _action_create_image Sep 14 08:53:08.608258 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Sep 14 08:53:08.608258 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 155, in inner Sep 14 08:53:08.608258 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 14 08:53:08.608258 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 67f3a983-b33f-49c8-9c91-988e8553563c in task_state image_snapshot_pending. Cannot snapshot while the instance is in this state. Sep 14 08:53:08.608258 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:53:08.608258 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:53:08.608258 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:53:08.608258 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:53:08.608258 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:53:08.608258 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:53:08.608258 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:53:08.608258 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:53:08.608258 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:53:08.608258 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:53:08.609506 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 08:53:08.609506 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 08:53:08.609506 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 08:53:08.609506 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 08:53:08.609506 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1354, in _action_create_image Sep 14 08:53:08.609506 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 14 08:53:08.609506 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 14 08:53:08.609506 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 14 08:53:08.609506 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance 67f3a983-b33f-49c8-9c91-988e8553563c while it is in task_state image_snapshot_pending Sep 14 08:53:08.609506 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:53:08.609506 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:53:08.609506 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:53:08.609506 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:53:08.609506 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:53:08.609506 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:53:08.609506 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:53:08.609506 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:53:08.609506 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance 67f3a983-b33f-49c8-9c91-988e8553563c while it is in task_state image_snapshot_pending Sep 14 08:53:08.609506 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:53:08.611410 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b9e4ce8d-1ccd-4b65-8719-242f9dea4150 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Returning 409 to user: Cannot 'createImage' instance 67f3a983-b33f-49c8-9c91-988e8553563c while it is in task_state image_snapshot_pending {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:53:08.611410 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b9e4ce8d-1ccd-4b65-8719-242f9dea4150 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] 10.222.0.60 "POST /compute/v2.1/servers/67f3a983-b33f-49c8-9c91-988e8553563c/action" status: 409 len: 167 microversion: 2.1 time: 0.128466 Sep 14 08:53:08.611410 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 603/1193] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 08:53:08 2022] POST /compute/v2.1/servers/67f3a983-b33f-49c8-9c91-988e8553563c/action => generated 167 bytes in 130 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 14 08:53:08.622022 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3c488be9-65c0-4a07-a65c-fcdc22c653f6 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:08.624747 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-3c488be9-65c0-4a07-a65c-fcdc22c653f6 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] [instance: 43730a9e-d747-4589-863f-a1c68e14b2a7] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:08.648382 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3c488be9-65c0-4a07-a65c-fcdc22c653f6 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:08.649535 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3c488be9-65c0-4a07-a65c-fcdc22c653f6 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:08.651413 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3c488be9-65c0-4a07-a65c-fcdc22c653f6 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:08.652396 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3c488be9-65c0-4a07-a65c-fcdc22c653f6 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:08.657070 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3c488be9-65c0-4a07-a65c-fcdc22c653f6 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:08.657745 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3c488be9-65c0-4a07-a65c-fcdc22c653f6 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:08.764415 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.objects.instance [None req-20f08a3c-ccc2-4077-b215-a00d957b2fdc tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Lazy-loading 'services' on Instance uuid 8fce8438-d6ae-408d-8b4f-ee14d4021fdd {{(pid=128758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 08:53:08.766406 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-3c488be9-65c0-4a07-a65c-fcdc22c653f6 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa9e50aadef494c8f72ccf88bdc5dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ffed678f9684721b3342a11fa885200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:08.775926 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-3c488be9-65c0-4a07-a65c-fcdc22c653f6 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] 10.222.0.60 "GET /compute/v2.1/servers/43730a9e-d747-4589-863f-a1c68e14b2a7" status: 200 len: 1210 microversion: 2.1 time: 0.163315 Sep 14 08:53:08.795449 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 604/1194] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:08 2022] GET /compute/v2.1/servers/43730a9e-d747-4589-863f-a1c68e14b2a7 => generated 1210 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:53:08.802818 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-59939d8f-fe12-428d-afbe-ab398e4867b9 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Calling method '.version_select at 0x7f7d442d90d0>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:08.806785 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-20f08a3c-ccc2-4077-b215-a00d957b2fdc tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd" status: 200 len: 2348 microversion: 2.25 time: 0.385161 Sep 14 08:53:08.815883 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 591/1195] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:53:08 2022] GET /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd => generated 2348 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 08:53:08.836520 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-4cbc4580-2d3d-4e79-9850-8762688f622b tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:08.843115 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4cbc4580-2d3d-4e79-9850-8762688f622b tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:08.844557 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4cbc4580-2d3d-4e79-9850-8762688f622b tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:08.845713 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4cbc4580-2d3d-4e79-9850-8762688f622b tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:08.846858 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4cbc4580-2d3d-4e79-9850-8762688f622b tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:08.847684 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4cbc4580-2d3d-4e79-9850-8762688f622b tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:08.849238 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4cbc4580-2d3d-4e79-9850-8762688f622b tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:08.889049 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-4cbc4580-2d3d-4e79-9850-8762688f622b tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.057409 Sep 14 08:53:08.889678 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 592/1196] 10.222.0.60 () {60 vars in 1217 bytes} [Wed Sep 14 08:53:08 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 14 08:53:08.969061 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-59939d8f-fe12-428d-afbe-ab398e4867b9 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] 10.222.0.60 "DELETE /compute/v2.1/images/7aaf5b60-fd48-45cd-9151-f90bc39f616b" status: 204 len: 0 microversion: 2.1 time: 0.172128 Sep 14 08:53:08.969956 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 605/1197] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:08 2022] DELETE /compute/v2.1/images/7aaf5b60-fd48-45cd-9151-f90bc39f616b => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 08:53:08.978866 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-caae81b2-b623-4b31-86d2-8c2f14d92e61 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:08.979922 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-caae81b2-b623-4b31-86d2-8c2f14d92e61 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] [instance: 67f3a983-b33f-49c8-9c91-988e8553563c] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:08.988434 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-caae81b2-b623-4b31-86d2-8c2f14d92e61 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:08.989186 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-caae81b2-b623-4b31-86d2-8c2f14d92e61 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:08.990327 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-caae81b2-b623-4b31-86d2-8c2f14d92e61 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:08.991226 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-caae81b2-b623-4b31-86d2-8c2f14d92e61 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:08.991845 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-caae81b2-b623-4b31-86d2-8c2f14d92e61 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:08.992432 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-caae81b2-b623-4b31-86d2-8c2f14d92e61 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:09.084932 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-1bbcafe6-afd9-459a-afa3-c35e0b1efa5d tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:09.085991 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-1bbcafe6-afd9-459a-afa3-c35e0b1efa5d tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: 1b2a9a93-cad5-4b18-abc3-1b88413f88da] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:09.096822 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1bbcafe6-afd9-459a-afa3-c35e0b1efa5d tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:09.099757 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1bbcafe6-afd9-459a-afa3-c35e0b1efa5d tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:09.101606 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1bbcafe6-afd9-459a-afa3-c35e0b1efa5d tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:09.102691 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1bbcafe6-afd9-459a-afa3-c35e0b1efa5d tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:09.104833 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1bbcafe6-afd9-459a-afa3-c35e0b1efa5d tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:09.105482 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1bbcafe6-afd9-459a-afa3-c35e0b1efa5d tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:09.254986 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-caae81b2-b623-4b31-86d2-8c2f14d92e61 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ace9012a7c4ce59c01858b6984b766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a87a909133e42e1a82e3a623536935c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:09.267652 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-caae81b2-b623-4b31-86d2-8c2f14d92e61 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] 10.222.0.60 "GET /compute/v2.1/servers/67f3a983-b33f-49c8-9c91-988e8553563c" status: 200 len: 1533 microversion: 2.1 time: 0.292859 Sep 14 08:53:09.269031 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 593/1198] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:08 2022] GET /compute/v2.1/servers/67f3a983-b33f-49c8-9c91-988e8553563c => generated 1533 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:53:09.384286 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-1bbcafe6-afd9-459a-afa3-c35e0b1efa5d tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:09.395048 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-1bbcafe6-afd9-459a-afa3-c35e0b1efa5d tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/1b2a9a93-cad5-4b18-abc3-1b88413f88da" status: 200 len: 1461 microversion: 2.1 time: 0.323022 Sep 14 08:53:09.396191 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 606/1199] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:09 2022] GET /compute/v2.1/servers/1b2a9a93-cad5-4b18-abc3-1b88413f88da => generated 1461 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:53:09.419728 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c7e2b294-2400-4fb1-94e0-7ee58c5420c7 tempest-MigrationsAdminTest-1443382137 tempest-MigrationsAdminTest-1443382137-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:09.420359 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-c7e2b294-2400-4fb1-94e0-7ee58c5420c7 tempest-MigrationsAdminTest-1443382137 tempest-MigrationsAdminTest-1443382137-project-admin] [instance: 1b2a9a93-cad5-4b18-abc3-1b88413f88da] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:09.428589 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c7e2b294-2400-4fb1-94e0-7ee58c5420c7 tempest-MigrationsAdminTest-1443382137 tempest-MigrationsAdminTest-1443382137-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:09.429163 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c7e2b294-2400-4fb1-94e0-7ee58c5420c7 tempest-MigrationsAdminTest-1443382137 tempest-MigrationsAdminTest-1443382137-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:09.430012 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c7e2b294-2400-4fb1-94e0-7ee58c5420c7 tempest-MigrationsAdminTest-1443382137 tempest-MigrationsAdminTest-1443382137-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:09.430740 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c7e2b294-2400-4fb1-94e0-7ee58c5420c7 tempest-MigrationsAdminTest-1443382137 tempest-MigrationsAdminTest-1443382137-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:09.431223 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c7e2b294-2400-4fb1-94e0-7ee58c5420c7 tempest-MigrationsAdminTest-1443382137 tempest-MigrationsAdminTest-1443382137-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:09.431650 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c7e2b294-2400-4fb1-94e0-7ee58c5420c7 tempest-MigrationsAdminTest-1443382137 tempest-MigrationsAdminTest-1443382137-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:09.648981 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-c7e2b294-2400-4fb1-94e0-7ee58c5420c7 tempest-MigrationsAdminTest-1443382137 tempest-MigrationsAdminTest-1443382137-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/1b2a9a93-cad5-4b18-abc3-1b88413f88da" status: 200 len: 1614 microversion: 2.1 time: 0.233999 Sep 14 08:53:09.654118 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 594/1200] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:09 2022] GET /compute/v2.1/servers/1b2a9a93-cad5-4b18-abc3-1b88413f88da => generated 1614 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:53:09.672997 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-bf093aa9-1f83-4a14-91c0-e864f66c10f5 tempest-MigrationsAdminTest-1443382137 tempest-MigrationsAdminTest-1443382137-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:53:09.673846 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-bf093aa9-1f83-4a14-91c0-e864f66c10f5 tempest-MigrationsAdminTest-1443382137 tempest-MigrationsAdminTest-1443382137-project-admin] [instance: 1b2a9a93-cad5-4b18-abc3-1b88413f88da] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:09.691641 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bf093aa9-1f83-4a14-91c0-e864f66c10f5 tempest-MigrationsAdminTest-1443382137 tempest-MigrationsAdminTest-1443382137-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:09.692561 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bf093aa9-1f83-4a14-91c0-e864f66c10f5 tempest-MigrationsAdminTest-1443382137 tempest-MigrationsAdminTest-1443382137-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:09.693046 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bf093aa9-1f83-4a14-91c0-e864f66c10f5 tempest-MigrationsAdminTest-1443382137 tempest-MigrationsAdminTest-1443382137-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:09.693868 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bf093aa9-1f83-4a14-91c0-e864f66c10f5 tempest-MigrationsAdminTest-1443382137 tempest-MigrationsAdminTest-1443382137-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:09.694873 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bf093aa9-1f83-4a14-91c0-e864f66c10f5 tempest-MigrationsAdminTest-1443382137 tempest-MigrationsAdminTest-1443382137-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:09.695608 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bf093aa9-1f83-4a14-91c0-e864f66c10f5 tempest-MigrationsAdminTest-1443382137 tempest-MigrationsAdminTest-1443382137-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:09.766362 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-bf093aa9-1f83-4a14-91c0-e864f66c10f5 tempest-MigrationsAdminTest-1443382137 tempest-MigrationsAdminTest-1443382137-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '18b58b52cd8843628ba2ba791b030943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46b97c8b36a4f30a38a14e4a5eb8f67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:09.766974 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-bf093aa9-1f83-4a14-91c0-e864f66c10f5 tempest-MigrationsAdminTest-1443382137 tempest-MigrationsAdminTest-1443382137-project-admin] [instance: 1b2a9a93-cad5-4b18-abc3-1b88413f88da] flavor_id is None. Assuming migration. {{(pid=128759) resize /opt/stack/nova/nova/compute/api.py:4196}} Sep 14 08:53:09.767441 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-bf093aa9-1f83-4a14-91c0-e864f66c10f5 tempest-MigrationsAdminTest-1443382137 tempest-MigrationsAdminTest-1443382137-project-admin] [instance: 1b2a9a93-cad5-4b18-abc3-1b88413f88da] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=128759) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 14 08:53:09.809385 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-cbbcfd6f-2dc0-4ac6-b873-cdcb815b5cc8 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:09.810279 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-cbbcfd6f-2dc0-4ac6-b873-cdcb815b5cc8 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] [instance: 43730a9e-d747-4589-863f-a1c68e14b2a7] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:09.818018 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cbbcfd6f-2dc0-4ac6-b873-cdcb815b5cc8 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:09.829664 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cbbcfd6f-2dc0-4ac6-b873-cdcb815b5cc8 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:09.829664 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cbbcfd6f-2dc0-4ac6-b873-cdcb815b5cc8 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:09.829664 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cbbcfd6f-2dc0-4ac6-b873-cdcb815b5cc8 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:09.829664 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cbbcfd6f-2dc0-4ac6-b873-cdcb815b5cc8 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:09.830015 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cbbcfd6f-2dc0-4ac6-b873-cdcb815b5cc8 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:09.934527 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-cbbcfd6f-2dc0-4ac6-b873-cdcb815b5cc8 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa9e50aadef494c8f72ccf88bdc5dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ffed678f9684721b3342a11fa885200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:09.943668 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-cbbcfd6f-2dc0-4ac6-b873-cdcb815b5cc8 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] 10.222.0.60 "GET /compute/v2.1/servers/43730a9e-d747-4589-863f-a1c68e14b2a7" status: 200 len: 1272 microversion: 2.1 time: 0.138722 Sep 14 08:53:09.953167 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 595/1201] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:09 2022] GET /compute/v2.1/servers/43730a9e-d747-4589-863f-a1c68e14b2a7 => generated 1272 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:53:09.979085 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-bf093aa9-1f83-4a14-91c0-e864f66c10f5 tempest-MigrationsAdminTest-1443382137 tempest-MigrationsAdminTest-1443382137-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/1b2a9a93-cad5-4b18-abc3-1b88413f88da/action" status: 202 len: 0 microversion: 2.1 time: 0.309813 Sep 14 08:53:09.981875 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 607/1202] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 08:53:09 2022] POST /compute/v2.1/servers/1b2a9a93-cad5-4b18-abc3-1b88413f88da/action => generated 0 bytes in 314 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 08:53:10.009342 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-0c73944b-8ee4-4575-bd66-30a9880ad342 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:10.011523 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-0c73944b-8ee4-4575-bd66-30a9880ad342 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: 1b2a9a93-cad5-4b18-abc3-1b88413f88da] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:10.029460 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0c73944b-8ee4-4575-bd66-30a9880ad342 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:10.031630 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0c73944b-8ee4-4575-bd66-30a9880ad342 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:10.033236 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0c73944b-8ee4-4575-bd66-30a9880ad342 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:10.034563 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0c73944b-8ee4-4575-bd66-30a9880ad342 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:10.038696 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0c73944b-8ee4-4575-bd66-30a9880ad342 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:10.039882 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0c73944b-8ee4-4575-bd66-30a9880ad342 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:10.297982 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-40b7fedb-956b-4bf1-b3ae-98b5ffe899c9 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:10.299070 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-40b7fedb-956b-4bf1-b3ae-98b5ffe899c9 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] [instance: 67f3a983-b33f-49c8-9c91-988e8553563c] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:10.313877 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-40b7fedb-956b-4bf1-b3ae-98b5ffe899c9 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:10.315711 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-40b7fedb-956b-4bf1-b3ae-98b5ffe899c9 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:10.316349 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-40b7fedb-956b-4bf1-b3ae-98b5ffe899c9 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:10.319815 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-40b7fedb-956b-4bf1-b3ae-98b5ffe899c9 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:10.329493 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-40b7fedb-956b-4bf1-b3ae-98b5ffe899c9 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:10.335591 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-40b7fedb-956b-4bf1-b3ae-98b5ffe899c9 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:10.349978 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-0c73944b-8ee4-4575-bd66-30a9880ad342 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:10.367220 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-0c73944b-8ee4-4575-bd66-30a9880ad342 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/1b2a9a93-cad5-4b18-abc3-1b88413f88da" status: 200 len: 1470 microversion: 2.1 time: 0.365524 Sep 14 08:53:10.368293 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 596/1203] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:09 2022] GET /compute/v2.1/servers/1b2a9a93-cad5-4b18-abc3-1b88413f88da => generated 1470 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:53:10.653194 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-40b7fedb-956b-4bf1-b3ae-98b5ffe899c9 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ace9012a7c4ce59c01858b6984b766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a87a909133e42e1a82e3a623536935c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:10.662282 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-40b7fedb-956b-4bf1-b3ae-98b5ffe899c9 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] 10.222.0.60 "GET /compute/v2.1/servers/67f3a983-b33f-49c8-9c91-988e8553563c" status: 200 len: 1533 microversion: 2.1 time: 0.372977 Sep 14 08:53:10.662958 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 608/1204] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:10 2022] GET /compute/v2.1/servers/67f3a983-b33f-49c8-9c91-988e8553563c => generated 1533 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:53:10.980533 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-8aee112b-819b-496d-9ea8-0e4e68aed686 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:10.981179 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-8aee112b-819b-496d-9ea8-0e4e68aed686 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] [instance: 43730a9e-d747-4589-863f-a1c68e14b2a7] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:10.993506 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8aee112b-819b-496d-9ea8-0e4e68aed686 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:10.994982 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8aee112b-819b-496d-9ea8-0e4e68aed686 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:10.997536 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8aee112b-819b-496d-9ea8-0e4e68aed686 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:11.000821 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8aee112b-819b-496d-9ea8-0e4e68aed686 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:11.001971 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8aee112b-819b-496d-9ea8-0e4e68aed686 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:11.002816 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8aee112b-819b-496d-9ea8-0e4e68aed686 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:11.340067 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-8aee112b-819b-496d-9ea8-0e4e68aed686 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa9e50aadef494c8f72ccf88bdc5dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ffed678f9684721b3342a11fa885200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:11.358203 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-8aee112b-819b-496d-9ea8-0e4e68aed686 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] 10.222.0.60 "GET /compute/v2.1/servers/43730a9e-d747-4589-863f-a1c68e14b2a7" status: 200 len: 1314 microversion: 2.1 time: 0.382205 Sep 14 08:53:11.364195 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 597/1205] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:10 2022] GET /compute/v2.1/servers/43730a9e-d747-4589-863f-a1c68e14b2a7 => generated 1314 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:53:11.396972 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-35952dc3-39f0-43aa-9128-0b591b59e09a tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:11.399577 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-35952dc3-39f0-43aa-9128-0b591b59e09a tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: 1b2a9a93-cad5-4b18-abc3-1b88413f88da] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:11.420378 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-35952dc3-39f0-43aa-9128-0b591b59e09a tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:11.422381 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-35952dc3-39f0-43aa-9128-0b591b59e09a tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:11.423034 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-35952dc3-39f0-43aa-9128-0b591b59e09a tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:11.447475 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-35952dc3-39f0-43aa-9128-0b591b59e09a tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:11.449954 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-35952dc3-39f0-43aa-9128-0b591b59e09a tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:11.450728 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-35952dc3-39f0-43aa-9128-0b591b59e09a tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:11.688947 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ad0e0cb8-3d3b-40f1-8536-d5d9df17ba58 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:11.689884 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-ad0e0cb8-3d3b-40f1-8536-d5d9df17ba58 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] [instance: 67f3a983-b33f-49c8-9c91-988e8553563c] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:11.700699 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ad0e0cb8-3d3b-40f1-8536-d5d9df17ba58 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:11.704494 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ad0e0cb8-3d3b-40f1-8536-d5d9df17ba58 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:11.705581 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ad0e0cb8-3d3b-40f1-8536-d5d9df17ba58 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:11.708455 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ad0e0cb8-3d3b-40f1-8536-d5d9df17ba58 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:11.708945 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ad0e0cb8-3d3b-40f1-8536-d5d9df17ba58 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:11.709376 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ad0e0cb8-3d3b-40f1-8536-d5d9df17ba58 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:11.745964 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-35952dc3-39f0-43aa-9128-0b591b59e09a tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:11.754143 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-35952dc3-39f0-43aa-9128-0b591b59e09a tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/1b2a9a93-cad5-4b18-abc3-1b88413f88da" status: 200 len: 1470 microversion: 2.1 time: 0.364617 Sep 14 08:53:11.756260 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 609/1206] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:11 2022] GET /compute/v2.1/servers/1b2a9a93-cad5-4b18-abc3-1b88413f88da => generated 1470 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:53:11.934831 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-ad0e0cb8-3d3b-40f1-8536-d5d9df17ba58 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ace9012a7c4ce59c01858b6984b766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a87a909133e42e1a82e3a623536935c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:11.945057 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-ad0e0cb8-3d3b-40f1-8536-d5d9df17ba58 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] 10.222.0.60 "GET /compute/v2.1/servers/67f3a983-b33f-49c8-9c91-988e8553563c" status: 200 len: 1539 microversion: 2.1 time: 0.260489 Sep 14 08:53:11.960212 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 598/1207] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:11 2022] GET /compute/v2.1/servers/67f3a983-b33f-49c8-9c91-988e8553563c => generated 1539 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:53:12.189448 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-ae4759f7-65b5-4c89-9787-e9c74a3b095e req-f11697b7-c69d-43cf-b51b-f22d4c5434a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43730a9e-d747-4589-863f-a1c68e14b2a7", "tag": "0c78838d-0a7a-4e27-9dab-7b72a94dd866"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:53:12.210619 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-ae4759f7-65b5-4c89-9787-e9c74a3b095e req-f11697b7-c69d-43cf-b51b-f22d4c5434a5 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:12.211557 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-ae4759f7-65b5-4c89-9787-e9c74a3b095e req-f11697b7-c69d-43cf-b51b-f22d4c5434a5 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:12.212609 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-ae4759f7-65b5-4c89-9787-e9c74a3b095e req-f11697b7-c69d-43cf-b51b-f22d4c5434a5 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:12.227894 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-ae4759f7-65b5-4c89-9787-e9c74a3b095e req-f11697b7-c69d-43cf-b51b-f22d4c5434a5 service nova] Creating event network-changed:0c78838d-0a7a-4e27-9dab-7b72a94dd866 for instance 43730a9e-d747-4589-863f-a1c68e14b2a7 on n-h2-836830-18 Sep 14 08:53:12.244760 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-ae4759f7-65b5-4c89-9787-e9c74a3b095e req-f11697b7-c69d-43cf-b51b-f22d4c5434a5 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049051 Sep 14 08:53:12.245629 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 610/1208] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:53:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:53:12.340710 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-31aede23-1572-4f09-ade1-88c321800b0c tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d8d327e0-5566-4083-87a2-5d3266f124ff", "device": "/dev/xvdb"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:53:12.344448 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-31aede23-1572-4f09-ade1-88c321800b0c tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: 8fce8438-d6ae-408d-8b4f-ee14d4021fdd] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:12.360835 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-31aede23-1572-4f09-ade1-88c321800b0c tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:12.361402 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-31aede23-1572-4f09-ade1-88c321800b0c tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:12.361812 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-31aede23-1572-4f09-ade1-88c321800b0c tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:12.362524 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-31aede23-1572-4f09-ade1-88c321800b0c tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:12.363000 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-31aede23-1572-4f09-ade1-88c321800b0c tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:12.363623 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-31aede23-1572-4f09-ade1-88c321800b0c tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:12.387185 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-07a66730-d0b6-4e34-a2b3-417a9345d374 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:12.388008 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-07a66730-d0b6-4e34-a2b3-417a9345d374 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] [instance: 43730a9e-d747-4589-863f-a1c68e14b2a7] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:12.398790 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-07a66730-d0b6-4e34-a2b3-417a9345d374 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:12.399563 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-07a66730-d0b6-4e34-a2b3-417a9345d374 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:12.400243 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-07a66730-d0b6-4e34-a2b3-417a9345d374 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:12.403027 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-07a66730-d0b6-4e34-a2b3-417a9345d374 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:12.403704 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-07a66730-d0b6-4e34-a2b3-417a9345d374 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:12.405769 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-07a66730-d0b6-4e34-a2b3-417a9345d374 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:12.644500 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-07a66730-d0b6-4e34-a2b3-417a9345d374 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa9e50aadef494c8f72ccf88bdc5dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ffed678f9684721b3342a11fa885200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:12.668701 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-07a66730-d0b6-4e34-a2b3-417a9345d374 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] 10.222.0.60 "GET /compute/v2.1/servers/43730a9e-d747-4589-863f-a1c68e14b2a7" status: 200 len: 1314 microversion: 2.1 time: 0.284353 Sep 14 08:53:12.675539 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 611/1209] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:12 2022] GET /compute/v2.1/servers/43730a9e-d747-4589-863f-a1c68e14b2a7 => generated 1314 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:53:12.790820 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-91da873d-c34c-45db-a4cd-5aaa67a5123c tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:12.793604 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-91da873d-c34c-45db-a4cd-5aaa67a5123c tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: 1b2a9a93-cad5-4b18-abc3-1b88413f88da] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:12.813487 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-91da873d-c34c-45db-a4cd-5aaa67a5123c tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:12.815180 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-91da873d-c34c-45db-a4cd-5aaa67a5123c tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:12.815628 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-91da873d-c34c-45db-a4cd-5aaa67a5123c tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:12.819345 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-91da873d-c34c-45db-a4cd-5aaa67a5123c tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:12.820343 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-91da873d-c34c-45db-a4cd-5aaa67a5123c tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:12.828690 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-91da873d-c34c-45db-a4cd-5aaa67a5123c tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:12.886164 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-31aede23-1572-4f09-ade1-88c321800b0c tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "POST /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 0.548601 Sep 14 08:53:12.887570 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 599/1210] 10.222.0.60 () {62 vars in 1364 bytes} [Wed Sep 14 08:53:12 2022] POST /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd/os-volume_attachments => generated 194 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 08:53:13.063946 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-91da873d-c34c-45db-a4cd-5aaa67a5123c tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:13.074377 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-91da873d-c34c-45db-a4cd-5aaa67a5123c tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/1b2a9a93-cad5-4b18-abc3-1b88413f88da" status: 200 len: 1470 microversion: 2.1 time: 0.298309 Sep 14 08:53:13.075084 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 612/1211] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:12 2022] GET /compute/v2.1/servers/1b2a9a93-cad5-4b18-abc3-1b88413f88da => generated 1470 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:53:13.090339 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ebdc4260-2f47-46ab-a1d1-2cad1d4e2230 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:13.091337 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-ebdc4260-2f47-46ab-a1d1-2cad1d4e2230 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] [instance: 67f3a983-b33f-49c8-9c91-988e8553563c] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:13.097432 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ebdc4260-2f47-46ab-a1d1-2cad1d4e2230 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:13.098518 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ebdc4260-2f47-46ab-a1d1-2cad1d4e2230 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:13.099063 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ebdc4260-2f47-46ab-a1d1-2cad1d4e2230 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:13.099827 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ebdc4260-2f47-46ab-a1d1-2cad1d4e2230 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:13.100343 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ebdc4260-2f47-46ab-a1d1-2cad1d4e2230 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:13.100845 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ebdc4260-2f47-46ab-a1d1-2cad1d4e2230 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:13.103214 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-dbde87c3-2f19-4181-a7cc-f617c1c6ab7e tempest-FlavorsExtraSpecsNegativeTestJSON-1106248544 tempest-FlavorsExtraSpecsNegativeTestJSON-1106248544-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-285113987", "ram": 512, "vcpus": 1, "disk": 10, "id": 643707084, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:53:13.127285 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-dbde87c3-2f19-4181-a7cc-f617c1c6ab7e tempest-FlavorsExtraSpecsNegativeTestJSON-1106248544 tempest-FlavorsExtraSpecsNegativeTestJSON-1106248544-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.237541 Sep 14 08:53:13.138222 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 600/1212] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 08:53:12 2022] POST /compute/v2.1/flavors => generated 412 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:53:13.271204 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c3f75e85-a923-4e84-a524-fea357b523be tempest-FlavorsExtraSpecsNegativeTestJSON-353517429 tempest-FlavorsExtraSpecsNegativeTestJSON-353517429-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:13.288726 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-c3f75e85-a923-4e84-a524-fea357b523be tempest-FlavorsExtraSpecsNegativeTestJSON-353517429 tempest-FlavorsExtraSpecsNegativeTestJSON-353517429-project] HTTP exception thrown: Flavor 643707084 has no extra specs with key hw:cpu_thread_policy. Sep 14 08:53:13.295879 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c3f75e85-a923-4e84-a524-fea357b523be tempest-FlavorsExtraSpecsNegativeTestJSON-353517429 tempest-FlavorsExtraSpecsNegativeTestJSON-353517429-project] Request method failure captured: Sep 14 08:53:13.295879 n-d-836830-18 devstack@n-api.service[128758]: request: GET /compute/v2.1/flavors/643707084/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Sep 14 08:53:13.295879 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 08:53:13.295879 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 08:53:13.295879 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 08:53:13.295879 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 08:53:13.295879 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 08:53:13.295879 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 08:53:13.295879 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 08:53:13.295879 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 08:53:13.295879 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZZ3sEBYvIklTcZIuH4DSQHZdWF4s2UQVz_R48NB43TURObh8Mw3UCxAU9YLk-CX2xwpsgqZ0S27gFSRONrKOhsZYiD35y7zmZyzyPvskc0xfF3Cga7xDAzVWak4CQ6-k_gxNqQflP0TLAEfqhaOjpt8lcZmVUUZRjLcWu6yOOAGwaE Sep 14 08:53:13.295879 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 08:53:13.295879 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 08:53:13.295879 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 08:53:13.295879 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 08:53:13.295879 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 08:53:13.295879 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 08:53:13.295879 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: a9b1ab0f29a5475e9d6a624372333f29 Sep 14 08:53:13.295879 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-353517429 Sep 14 08:53:13.295879 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 08:53:13.295879 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 08:53:13.297372 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a9b1ab0f29a5475e9d6a624372333f29"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a9b1ab0f29a5475e9d6a624372333f29"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a9b1ab0f29a5475e9d6a624372333f29"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a9b1ab0f29a5475e9d6a624372333f29"}]}] Sep 14 08:53:13.297372 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-353517429 Sep 14 08:53:13.297372 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: a9b1ab0f29a5475e9d6a624372333f29 Sep 14 08:53:13.297372 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-353517429 Sep 14 08:53:13.297372 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-353517429-project Sep 14 08:53:13.297372 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 08:53:13.297372 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 08:53:13.297372 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: fce5cce4caa54f7aa9343eac0e541f93 Sep 14 08:53:13.297372 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-353517429-project Sep 14 08:53:13.297372 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 08:53:13.297372 n-d-836830-18 devstack@n-api.service[128758]: exception: Flavor 643707084 has no extra specs with key hw:cpu_thread_policy. Sep 14 08:53:13.298130 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'flavor_id': '643707084', 'id': 'hw:cpu_thread_policy'} Sep 14 08:53:13.298130 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:53:13.298130 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:53:13.298130 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Sep 14 08:53:13.298130 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Sep 14 08:53:13.298130 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Sep 14 08:53:13.298130 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:53:13.298130 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:53:13.298130 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:53:13.298130 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:53:13.298130 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:53:13.298130 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:53:13.298130 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:53:13.298130 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:53:13.298130 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:53:13.298130 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:53:13.298130 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Sep 14 08:53:13.298130 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 14 08:53:13.298130 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 643707084 has no extra specs with key hw:cpu_thread_policy. Sep 14 08:53:13.298130 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:53:13.298130 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:53:13.298130 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:53:13.299608 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:53:13.299608 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:53:13.299608 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:53:13.299608 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:53:13.299608 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:53:13.299608 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 643707084 has no extra specs with key hw:cpu_thread_policy. Sep 14 08:53:13.299608 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:53:13.301547 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c3f75e85-a923-4e84-a524-fea357b523be tempest-FlavorsExtraSpecsNegativeTestJSON-353517429 tempest-FlavorsExtraSpecsNegativeTestJSON-353517429-project] Returning 404 to user: Flavor 643707084 has no extra specs with key hw:cpu_thread_policy. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:53:13.303797 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-c3f75e85-a923-4e84-a524-fea357b523be tempest-FlavorsExtraSpecsNegativeTestJSON-353517429 tempest-FlavorsExtraSpecsNegativeTestJSON-353517429-project] 10.222.0.60 "GET /compute/v2.1/flavors/643707084/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.164454 Sep 14 08:53:13.305179 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 601/1213] 10.222.0.60 () {58 vars in 1263 bytes} [Wed Sep 14 08:53:13 2022] GET /compute/v2.1/flavors/643707084/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 166 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 08:53:13.316924 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c16d43cb-82ca-438c-919c-046f529fe15b tempest-FlavorsExtraSpecsNegativeTestJSON-353517429 tempest-FlavorsExtraSpecsNegativeTestJSON-353517429-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:53:13.322554 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-ebdc4260-2f47-46ab-a1d1-2cad1d4e2230 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ace9012a7c4ce59c01858b6984b766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a87a909133e42e1a82e3a623536935c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:13.324385 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-c16d43cb-82ca-438c-919c-046f529fe15b tempest-FlavorsExtraSpecsNegativeTestJSON-353517429 tempest-FlavorsExtraSpecsNegativeTestJSON-353517429-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': 'fce5cce4caa54f7aa9343eac0e541f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b1ab0f29a5475e9d6a624372333f29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:13.326404 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c16d43cb-82ca-438c-919c-046f529fe15b tempest-FlavorsExtraSpecsNegativeTestJSON-353517429 tempest-FlavorsExtraSpecsNegativeTestJSON-353517429-project] Request method failure captured: Sep 14 08:53:13.326404 n-d-836830-18 devstack@n-api.service[128758]: request: POST /compute/v2.1/flavors/643707084/os-extra_specs HTTP/1.1 Sep 14 08:53:13.326404 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 08:53:13.326404 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 08:53:13.326404 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 08:53:13.326404 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 66 Sep 14 08:53:13.326404 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 08:53:13.326404 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 08:53:13.326404 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 08:53:13.326404 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 08:53:13.326404 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZZ3sEBYvIklTcZIuH4DSQHZdWF4s2UQVz_R48NB43TURObh8Mw3UCxAU9YLk-CX2xwpsgqZ0S27gFSRONrKOhsZYiD35y7zmZyzyPvskc0xfF3Cga7xDAzVWak4CQ6-k_gxNqQflP0TLAEfqhaOjpt8lcZmVUUZRjLcWu6yOOAGwaE Sep 14 08:53:13.326404 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 08:53:13.326404 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 08:53:13.326404 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 08:53:13.326404 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 08:53:13.326404 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 08:53:13.326404 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 08:53:13.326404 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: a9b1ab0f29a5475e9d6a624372333f29 Sep 14 08:53:13.326404 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-353517429 Sep 14 08:53:13.326404 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 08:53:13.326404 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 08:53:13.328008 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a9b1ab0f29a5475e9d6a624372333f29"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a9b1ab0f29a5475e9d6a624372333f29"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a9b1ab0f29a5475e9d6a624372333f29"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a9b1ab0f29a5475e9d6a624372333f29"}]}] Sep 14 08:53:13.328008 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-353517429 Sep 14 08:53:13.328008 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: a9b1ab0f29a5475e9d6a624372333f29 Sep 14 08:53:13.328008 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-353517429 Sep 14 08:53:13.328008 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-353517429-project Sep 14 08:53:13.328008 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 08:53:13.328008 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 08:53:13.328008 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: fce5cce4caa54f7aa9343eac0e541f93 Sep 14 08:53:13.328008 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-353517429-project Sep 14 08:53:13.328008 n-d-836830-18 devstack@n-api.service[128758]: Sep 14 08:53:13.328008 n-d-836830-18 devstack@n-api.service[128758]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Sep 14 08:53:13.328008 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 08:53:13.328791 n-d-836830-18 devstack@n-api.service[128758]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Sep 14 08:53:13.328791 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'flavor_id': '643707084', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Sep 14 08:53:13.328791 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:53:13.328791 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:53:13.328791 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:53:13.328791 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:53:13.328791 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:53:13.328791 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:53:13.328791 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:53:13.328791 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:53:13.328791 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 08:53:13.328791 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 08:53:13.328791 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Sep 14 08:53:13.328791 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Sep 14 08:53:13.328791 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 14 08:53:13.328791 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 14 08:53:13.328791 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 14 08:53:13.328791 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 14 08:53:13.328791 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 14 08:53:13.330109 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 14 08:53:13.330109 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 14 08:53:13.330109 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise self.value Sep 14 08:53:13.330109 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 14 08:53:13.330109 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 14 08:53:13.330109 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 14 08:53:13.330109 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 14 08:53:13.330109 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 14 08:53:13.330109 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 14 08:53:13.330109 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Sep 14 08:53:13.330109 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:53:13.330109 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:53:13.330109 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:53:13.330109 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:53:13.330109 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:53:13.330109 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:53:13.330109 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 14 08:53:13.330109 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 14 08:53:13.330109 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Sep 14 08:53:13.330109 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:53:13.333186 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-ebdc4260-2f47-46ab-a1d1-2cad1d4e2230 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] 10.222.0.60 "GET /compute/v2.1/servers/67f3a983-b33f-49c8-9c91-988e8553563c" status: 200 len: 1539 microversion: 2.1 time: 0.244681 Sep 14 08:53:13.333186 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 613/1214] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:13 2022] GET /compute/v2.1/servers/67f3a983-b33f-49c8-9c91-988e8553563c => generated 1539 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:53:13.334192 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c16d43cb-82ca-438c-919c-046f529fe15b tempest-FlavorsExtraSpecsNegativeTestJSON-353517429 tempest-FlavorsExtraSpecsNegativeTestJSON-353517429-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:53:13.335170 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-c16d43cb-82ca-438c-919c-046f529fe15b tempest-FlavorsExtraSpecsNegativeTestJSON-353517429 tempest-FlavorsExtraSpecsNegativeTestJSON-353517429-project] 10.222.0.60 "POST /compute/v2.1/flavors/643707084/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.024985 Sep 14 08:53:13.335850 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 602/1215] 10.222.0.60 () {60 vars in 1221 bytes} [Wed Sep 14 08:53:13 2022] POST /compute/v2.1/flavors/643707084/os-extra_specs => generated 124 bytes in 26 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 14 08:53:13.354645 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-0fe3647c-7d2b-4e5f-825f-bac4c1da5eb0 tempest-FlavorsExtraSpecsNegativeTestJSON-1106248544 tempest-FlavorsExtraSpecsNegativeTestJSON-1106248544-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:53:13.391500 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-0fe3647c-7d2b-4e5f-825f-bac4c1da5eb0 tempest-FlavorsExtraSpecsNegativeTestJSON-1106248544 tempest-FlavorsExtraSpecsNegativeTestJSON-1106248544-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors/643707084/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.050610 Sep 14 08:53:13.392735 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 614/1216] 10.222.0.60 () {60 vars in 1221 bytes} [Wed Sep 14 08:53:13 2022] POST /compute/v2.1/flavors/643707084/os-extra_specs => generated 66 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 14 08:53:13.402971 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-228b3dc9-573a-4ddc-bba6-666f53e6e91b tempest-FlavorsExtraSpecsNegativeTestJSON-353517429 tempest-FlavorsExtraSpecsNegativeTestJSON-353517429-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:13.404534 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-228b3dc9-573a-4ddc-bba6-666f53e6e91b tempest-FlavorsExtraSpecsNegativeTestJSON-353517429 tempest-FlavorsExtraSpecsNegativeTestJSON-353517429-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': 'fce5cce4caa54f7aa9343eac0e541f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b1ab0f29a5475e9d6a624372333f29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:13.409779 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-228b3dc9-573a-4ddc-bba6-666f53e6e91b tempest-FlavorsExtraSpecsNegativeTestJSON-353517429 tempest-FlavorsExtraSpecsNegativeTestJSON-353517429-project] Request method failure captured: Sep 14 08:53:13.409779 n-d-836830-18 devstack@n-api.service[128758]: request: DELETE /compute/v2.1/flavors/643707084/os-extra_specs/hw:numa_nodes HTTP/1.1 Sep 14 08:53:13.409779 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 08:53:13.409779 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 08:53:13.409779 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 08:53:13.409779 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 08:53:13.409779 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 08:53:13.409779 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 08:53:13.409779 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 08:53:13.409779 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 08:53:13.409779 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZZ3sEBYvIklTcZIuH4DSQHZdWF4s2UQVz_R48NB43TURObh8Mw3UCxAU9YLk-CX2xwpsgqZ0S27gFSRONrKOhsZYiD35y7zmZyzyPvskc0xfF3Cga7xDAzVWak4CQ6-k_gxNqQflP0TLAEfqhaOjpt8lcZmVUUZRjLcWu6yOOAGwaE Sep 14 08:53:13.409779 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 08:53:13.409779 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 08:53:13.409779 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 08:53:13.409779 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 08:53:13.409779 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 08:53:13.409779 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 08:53:13.409779 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: a9b1ab0f29a5475e9d6a624372333f29 Sep 14 08:53:13.409779 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-353517429 Sep 14 08:53:13.409779 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 08:53:13.409779 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 08:53:13.411505 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a9b1ab0f29a5475e9d6a624372333f29"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a9b1ab0f29a5475e9d6a624372333f29"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a9b1ab0f29a5475e9d6a624372333f29"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a9b1ab0f29a5475e9d6a624372333f29"}]}] Sep 14 08:53:13.411505 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-353517429 Sep 14 08:53:13.411505 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: a9b1ab0f29a5475e9d6a624372333f29 Sep 14 08:53:13.411505 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-353517429 Sep 14 08:53:13.411505 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-353517429-project Sep 14 08:53:13.411505 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 08:53:13.411505 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 08:53:13.411505 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: fce5cce4caa54f7aa9343eac0e541f93 Sep 14 08:53:13.411505 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-353517429-project Sep 14 08:53:13.411505 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 08:53:13.411505 n-d-836830-18 devstack@n-api.service[128758]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Sep 14 08:53:13.412361 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'flavor_id': '643707084', 'id': 'hw:numa_nodes'} Sep 14 08:53:13.412361 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:53:13.412361 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:53:13.412361 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:53:13.412361 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:53:13.412361 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:53:13.412361 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:53:13.412361 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:53:13.412361 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:53:13.412361 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Sep 14 08:53:13.412361 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Sep 14 08:53:13.412361 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 14 08:53:13.412361 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 14 08:53:13.412361 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 14 08:53:13.412361 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 14 08:53:13.412361 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 14 08:53:13.412361 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 14 08:53:13.412361 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 14 08:53:13.412361 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise self.value Sep 14 08:53:13.412361 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 14 08:53:13.414272 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 14 08:53:13.414272 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 14 08:53:13.414272 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 14 08:53:13.414272 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 14 08:53:13.414272 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 14 08:53:13.414272 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Sep 14 08:53:13.414272 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:53:13.414272 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:53:13.414272 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:53:13.414272 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:53:13.414272 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:53:13.414272 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:53:13.414272 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 14 08:53:13.414272 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 14 08:53:13.414272 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Sep 14 08:53:13.414272 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:53:13.417001 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-228b3dc9-573a-4ddc-bba6-666f53e6e91b tempest-FlavorsExtraSpecsNegativeTestJSON-353517429 tempest-FlavorsExtraSpecsNegativeTestJSON-353517429-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:53:13.418049 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-228b3dc9-573a-4ddc-bba6-666f53e6e91b tempest-FlavorsExtraSpecsNegativeTestJSON-353517429 tempest-FlavorsExtraSpecsNegativeTestJSON-353517429-project] 10.222.0.60 "DELETE /compute/v2.1/flavors/643707084/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.019847 Sep 14 08:53:13.419147 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 603/1217] 10.222.0.60 () {58 vars in 1245 bytes} [Wed Sep 14 08:53:13 2022] DELETE /compute/v2.1/flavors/643707084/os-extra_specs/hw:numa_nodes => generated 124 bytes in 21 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 14 08:53:13.428279 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b351e180-2cbe-44e4-800a-df867aff4980 tempest-FlavorsExtraSpecsNegativeTestJSON-1106248544 tempest-FlavorsExtraSpecsNegativeTestJSON-1106248544-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:53:13.456447 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b351e180-2cbe-44e4-800a-df867aff4980 tempest-FlavorsExtraSpecsNegativeTestJSON-1106248544 tempest-FlavorsExtraSpecsNegativeTestJSON-1106248544-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors/643707084/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.032263 Sep 14 08:53:13.457859 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 615/1218] 10.222.0.60 () {60 vars in 1221 bytes} [Wed Sep 14 08:53:13 2022] POST /compute/v2.1/flavors/643707084/os-extra_specs => generated 66 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 08:53:13.467000 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-74674655-96d7-4002-9c50-b3bd842fc441 tempest-FlavorsExtraSpecsNegativeTestJSON-353517429 tempest-FlavorsExtraSpecsNegativeTestJSON-353517429-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:53:13.470205 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-74674655-96d7-4002-9c50-b3bd842fc441 tempest-FlavorsExtraSpecsNegativeTestJSON-353517429 tempest-FlavorsExtraSpecsNegativeTestJSON-353517429-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': 'fce5cce4caa54f7aa9343eac0e541f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b1ab0f29a5475e9d6a624372333f29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:13.471790 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-74674655-96d7-4002-9c50-b3bd842fc441 tempest-FlavorsExtraSpecsNegativeTestJSON-353517429 tempest-FlavorsExtraSpecsNegativeTestJSON-353517429-project] Request method failure captured: Sep 14 08:53:13.471790 n-d-836830-18 devstack@n-api.service[128758]: request: PUT /compute/v2.1/flavors/643707084/os-extra_specs/hw:numa_nodes HTTP/1.1 Sep 14 08:53:13.471790 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 08:53:13.471790 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 08:53:13.471790 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 08:53:13.471790 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 22 Sep 14 08:53:13.471790 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 08:53:13.471790 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 08:53:13.471790 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 08:53:13.471790 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 08:53:13.471790 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZZ3sEBYvIklTcZIuH4DSQHZdWF4s2UQVz_R48NB43TURObh8Mw3UCxAU9YLk-CX2xwpsgqZ0S27gFSRONrKOhsZYiD35y7zmZyzyPvskc0xfF3Cga7xDAzVWak4CQ6-k_gxNqQflP0TLAEfqhaOjpt8lcZmVUUZRjLcWu6yOOAGwaE Sep 14 08:53:13.471790 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 08:53:13.471790 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 08:53:13.471790 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 08:53:13.471790 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 08:53:13.471790 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 08:53:13.471790 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 08:53:13.471790 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: a9b1ab0f29a5475e9d6a624372333f29 Sep 14 08:53:13.471790 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-353517429 Sep 14 08:53:13.471790 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 08:53:13.471790 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 08:53:13.473359 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a9b1ab0f29a5475e9d6a624372333f29"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a9b1ab0f29a5475e9d6a624372333f29"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a9b1ab0f29a5475e9d6a624372333f29"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a9b1ab0f29a5475e9d6a624372333f29"}]}] Sep 14 08:53:13.473359 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-353517429 Sep 14 08:53:13.473359 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: a9b1ab0f29a5475e9d6a624372333f29 Sep 14 08:53:13.473359 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-353517429 Sep 14 08:53:13.473359 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-353517429-project Sep 14 08:53:13.473359 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 08:53:13.473359 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 08:53:13.473359 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: fce5cce4caa54f7aa9343eac0e541f93 Sep 14 08:53:13.473359 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-353517429-project Sep 14 08:53:13.473359 n-d-836830-18 devstack@n-api.service[128758]: Sep 14 08:53:13.473359 n-d-836830-18 devstack@n-api.service[128758]: {"hw:numa_nodes": "1"} Sep 14 08:53:13.473359 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 08:53:13.473359 n-d-836830-18 devstack@n-api.service[128758]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Sep 14 08:53:13.474302 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'flavor_id': '643707084', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Sep 14 08:53:13.474302 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:53:13.474302 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:53:13.474302 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:53:13.474302 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:53:13.474302 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:53:13.474302 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:53:13.474302 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:53:13.474302 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:53:13.474302 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 08:53:13.474302 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 08:53:13.474302 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Sep 14 08:53:13.474302 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Sep 14 08:53:13.474302 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 14 08:53:13.474302 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 14 08:53:13.474302 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 14 08:53:13.474302 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 14 08:53:13.474302 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 14 08:53:13.474302 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 14 08:53:13.475561 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 14 08:53:13.475561 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise self.value Sep 14 08:53:13.475561 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 14 08:53:13.475561 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 14 08:53:13.475561 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 14 08:53:13.475561 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 14 08:53:13.475561 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 14 08:53:13.475561 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 14 08:53:13.475561 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Sep 14 08:53:13.475561 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:53:13.475561 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:53:13.475561 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:53:13.475561 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:53:13.475561 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:53:13.475561 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:53:13.475561 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 14 08:53:13.475561 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 14 08:53:13.475561 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Sep 14 08:53:13.475561 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:53:13.476787 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-74674655-96d7-4002-9c50-b3bd842fc441 tempest-FlavorsExtraSpecsNegativeTestJSON-353517429 tempest-FlavorsExtraSpecsNegativeTestJSON-353517429-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:53:13.476787 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-74674655-96d7-4002-9c50-b3bd842fc441 tempest-FlavorsExtraSpecsNegativeTestJSON-353517429 tempest-FlavorsExtraSpecsNegativeTestJSON-353517429-project] 10.222.0.60 "PUT /compute/v2.1/flavors/643707084/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.010180 Sep 14 08:53:13.476787 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 604/1219] 10.222.0.60 () {60 vars in 1262 bytes} [Wed Sep 14 08:53:13 2022] PUT /compute/v2.1/flavors/643707084/os-extra_specs/hw:numa_nodes => generated 124 bytes in 11 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 14 08:53:13.486516 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-121a12b6-6f4b-42bd-8042-be6f36c9f148 tempest-FlavorsExtraSpecsNegativeTestJSON-1106248544 tempest-FlavorsExtraSpecsNegativeTestJSON-1106248544-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:13.495430 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-121a12b6-6f4b-42bd-8042-be6f36c9f148 tempest-FlavorsExtraSpecsNegativeTestJSON-1106248544 tempest-FlavorsExtraSpecsNegativeTestJSON-1106248544-project-admin] HTTP exception thrown: Flavor 643707084 has no extra specs with key hw:cpu_thread_policy. Sep 14 08:53:13.497201 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-121a12b6-6f4b-42bd-8042-be6f36c9f148 tempest-FlavorsExtraSpecsNegativeTestJSON-1106248544 tempest-FlavorsExtraSpecsNegativeTestJSON-1106248544-project-admin] Request method failure captured: Sep 14 08:53:13.497201 n-d-836830-18 devstack@n-api.service[128759]: request: DELETE /compute/v2.1/flavors/643707084/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Sep 14 08:53:13.497201 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 08:53:13.497201 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 08:53:13.497201 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 08:53:13.497201 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 08:53:13.497201 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 08:53:13.497201 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 08:53:13.497201 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 08:53:13.497201 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 08:53:13.497201 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZZ4yl6cV8DiVKrifM5BerMUK72Btk1LqMA4D6m_XK3xNwBY-lav7Jndc6XMeOHW6WQjKhQP6f__sjeyZSG_nPb-V4s_VyWQfIBZvs_cX5aDz-w70UhLks-39dHfB18xAEgkkBd17m5GmxMxUrRCWAlA77eVJyz2FOvdPkzs0v4xi6Y Sep 14 08:53:13.497201 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 08:53:13.497201 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 08:53:13.497201 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 08:53:13.497201 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 08:53:13.497201 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 08:53:13.497201 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 08:53:13.497201 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 312c073ffe3e4e6e8d1f1c6248210e38 Sep 14 08:53:13.497201 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1106248544 Sep 14 08:53:13.497201 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member,admin Sep 14 08:53:13.497201 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member,admin Sep 14 08:53:13.499932 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/312c073ffe3e4e6e8d1f1c6248210e38"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_312c073ffe3e4e6e8d1f1c6248210e38"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/312c073ffe3e4e6e8d1f1c6248210e38"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/312c073ffe3e4e6e8d1f1c6248210e38"}]}] Sep 14 08:53:13.499932 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1106248544 Sep 14 08:53:13.499932 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 312c073ffe3e4e6e8d1f1c6248210e38 Sep 14 08:53:13.499932 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1106248544 Sep 14 08:53:13.499932 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1106248544-project-admin Sep 14 08:53:13.499932 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 08:53:13.499932 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 08:53:13.499932 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 49c117434c8043c3936a2c7e4b896aaa Sep 14 08:53:13.499932 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1106248544-project-admin Sep 14 08:53:13.499932 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 08:53:13.499932 n-d-836830-18 devstack@n-api.service[128759]: exception: Flavor 643707084 has no extra specs with key hw:cpu_thread_policy. Sep 14 08:53:13.500836 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'flavor_id': '643707084', 'id': 'hw:cpu_thread_policy'} Sep 14 08:53:13.500836 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:53:13.500836 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:53:13.500836 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Sep 14 08:53:13.500836 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Sep 14 08:53:13.500836 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Sep 14 08:53:13.500836 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:53:13.500836 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:53:13.500836 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:53:13.500836 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:53:13.500836 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:53:13.500836 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:53:13.500836 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:53:13.500836 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:53:13.500836 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:53:13.500836 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:53:13.500836 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Sep 14 08:53:13.500836 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 14 08:53:13.500836 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 643707084 has no extra specs with key hw:cpu_thread_policy. Sep 14 08:53:13.500836 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:53:13.500836 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:53:13.500836 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:53:13.502865 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:53:13.502865 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:53:13.502865 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:53:13.502865 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:53:13.502865 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:53:13.502865 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 643707084 has no extra specs with key hw:cpu_thread_policy. Sep 14 08:53:13.502865 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:53:13.504314 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-121a12b6-6f4b-42bd-8042-be6f36c9f148 tempest-FlavorsExtraSpecsNegativeTestJSON-1106248544 tempest-FlavorsExtraSpecsNegativeTestJSON-1106248544-project-admin] Returning 404 to user: Flavor 643707084 has no extra specs with key hw:cpu_thread_policy. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:53:13.505935 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-121a12b6-6f4b-42bd-8042-be6f36c9f148 tempest-FlavorsExtraSpecsNegativeTestJSON-1106248544 tempest-FlavorsExtraSpecsNegativeTestJSON-1106248544-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/643707084/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.023207 Sep 14 08:53:13.506511 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 616/1220] 10.222.0.60 () {58 vars in 1266 bytes} [Wed Sep 14 08:53:13 2022] DELETE /compute/v2.1/flavors/643707084/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 08:53:13.517410 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-aab4e242-1ad5-44e1-8305-3e9979cc11ac tempest-FlavorsExtraSpecsNegativeTestJSON-1106248544 tempest-FlavorsExtraSpecsNegativeTestJSON-1106248544-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:53:13.520743 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-aab4e242-1ad5-44e1-8305-3e9979cc11ac tempest-FlavorsExtraSpecsNegativeTestJSON-1106248544 tempest-FlavorsExtraSpecsNegativeTestJSON-1106248544-project-admin] HTTP exception thrown: Request body and URI mismatch Sep 14 08:53:13.522017 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-aab4e242-1ad5-44e1-8305-3e9979cc11ac tempest-FlavorsExtraSpecsNegativeTestJSON-1106248544 tempest-FlavorsExtraSpecsNegativeTestJSON-1106248544-project-admin] Request method failure captured: Sep 14 08:53:13.522017 n-d-836830-18 devstack@n-api.service[128758]: request: PUT /compute/v2.1/flavors/643707084/os-extra_specs/hw:numa_nodes HTTP/1.1 Sep 14 08:53:13.522017 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 08:53:13.522017 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 08:53:13.522017 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 08:53:13.522017 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 27 Sep 14 08:53:13.522017 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 08:53:13.522017 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 08:53:13.522017 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 08:53:13.522017 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 08:53:13.522017 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZZ4yl6cV8DiVKrifM5BerMUK72Btk1LqMA4D6m_XK3xNwBY-lav7Jndc6XMeOHW6WQjKhQP6f__sjeyZSG_nPb-V4s_VyWQfIBZvs_cX5aDz-w70UhLks-39dHfB18xAEgkkBd17m5GmxMxUrRCWAlA77eVJyz2FOvdPkzs0v4xi6Y Sep 14 08:53:13.522017 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 08:53:13.522017 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 08:53:13.522017 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 08:53:13.522017 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 08:53:13.522017 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 08:53:13.522017 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 08:53:13.522017 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 312c073ffe3e4e6e8d1f1c6248210e38 Sep 14 08:53:13.522017 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1106248544 Sep 14 08:53:13.522017 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member,admin Sep 14 08:53:13.522017 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member,admin Sep 14 08:53:13.523450 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/312c073ffe3e4e6e8d1f1c6248210e38"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_312c073ffe3e4e6e8d1f1c6248210e38"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/312c073ffe3e4e6e8d1f1c6248210e38"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/312c073ffe3e4e6e8d1f1c6248210e38"}]}] Sep 14 08:53:13.523450 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1106248544 Sep 14 08:53:13.523450 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 312c073ffe3e4e6e8d1f1c6248210e38 Sep 14 08:53:13.523450 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1106248544 Sep 14 08:53:13.523450 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1106248544-project-admin Sep 14 08:53:13.523450 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 08:53:13.523450 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 08:53:13.523450 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 49c117434c8043c3936a2c7e4b896aaa Sep 14 08:53:13.523450 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1106248544-project-admin Sep 14 08:53:13.523450 n-d-836830-18 devstack@n-api.service[128758]: Sep 14 08:53:13.523450 n-d-836830-18 devstack@n-api.service[128758]: {"hw:cpu_policy": "shared"} Sep 14 08:53:13.523450 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 08:53:13.523450 n-d-836830-18 devstack@n-api.service[128758]: exception: Request body and URI mismatch Sep 14 08:53:13.524824 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'flavor_id': '643707084', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Sep 14 08:53:13.524824 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:53:13.524824 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:53:13.524824 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:53:13.524824 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:53:13.524824 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:53:13.524824 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:53:13.524824 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:53:13.524824 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:53:13.524824 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 08:53:13.524824 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 08:53:13.524824 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Sep 14 08:53:13.524824 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Sep 14 08:53:13.524824 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Sep 14 08:53:13.524824 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:53:13.524824 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:53:13.524824 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:53:13.524824 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:53:13.524824 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:53:13.524824 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:53:13.526061 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:53:13.526061 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:53:13.526061 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Sep 14 08:53:13.526061 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:53:13.526061 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-aab4e242-1ad5-44e1-8305-3e9979cc11ac tempest-FlavorsExtraSpecsNegativeTestJSON-1106248544 tempest-FlavorsExtraSpecsNegativeTestJSON-1106248544-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:53:13.526061 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-aab4e242-1ad5-44e1-8305-3e9979cc11ac tempest-FlavorsExtraSpecsNegativeTestJSON-1106248544 tempest-FlavorsExtraSpecsNegativeTestJSON-1106248544-project-admin] 10.222.0.60 "PUT /compute/v2.1/flavors/643707084/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.010622 Sep 14 08:53:13.526061 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 605/1221] 10.222.0.60 () {60 vars in 1262 bytes} [Wed Sep 14 08:53:13 2022] PUT /compute/v2.1/flavors/643707084/os-extra_specs/hw:numa_nodes => generated 73 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Sep 14 08:53:13.533322 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e8dbc46d-c08b-470f-9c01-7618dcf69b11 tempest-FlavorsExtraSpecsNegativeTestJSON-1106248544 tempest-FlavorsExtraSpecsNegativeTestJSON-1106248544-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:53:13.540971 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e8dbc46d-c08b-470f-9c01-7618dcf69b11 tempest-FlavorsExtraSpecsNegativeTestJSON-1106248544 tempest-FlavorsExtraSpecsNegativeTestJSON-1106248544-project-admin] Request method failure captured: Sep 14 08:53:13.540971 n-d-836830-18 devstack@n-api.service[128759]: request: PUT /compute/v2.1/flavors/643707084/os-extra_specs/hw:numa_nodes HTTP/1.1 Sep 14 08:53:13.540971 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 08:53:13.540971 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 08:53:13.540971 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 08:53:13.540971 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 49 Sep 14 08:53:13.540971 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 08:53:13.540971 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 08:53:13.540971 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 08:53:13.540971 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 08:53:13.540971 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZZ4yl6cV8DiVKrifM5BerMUK72Btk1LqMA4D6m_XK3xNwBY-lav7Jndc6XMeOHW6WQjKhQP6f__sjeyZSG_nPb-V4s_VyWQfIBZvs_cX5aDz-w70UhLks-39dHfB18xAEgkkBd17m5GmxMxUrRCWAlA77eVJyz2FOvdPkzs0v4xi6Y Sep 14 08:53:13.540971 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 08:53:13.540971 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 08:53:13.540971 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 08:53:13.540971 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 08:53:13.540971 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 08:53:13.540971 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 08:53:13.540971 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 312c073ffe3e4e6e8d1f1c6248210e38 Sep 14 08:53:13.540971 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1106248544 Sep 14 08:53:13.540971 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member,admin Sep 14 08:53:13.540971 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member,admin Sep 14 08:53:13.542421 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/312c073ffe3e4e6e8d1f1c6248210e38"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_312c073ffe3e4e6e8d1f1c6248210e38"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/312c073ffe3e4e6e8d1f1c6248210e38"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/312c073ffe3e4e6e8d1f1c6248210e38"}]}] Sep 14 08:53:13.542421 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1106248544 Sep 14 08:53:13.542421 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 312c073ffe3e4e6e8d1f1c6248210e38 Sep 14 08:53:13.542421 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1106248544 Sep 14 08:53:13.542421 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1106248544-project-admin Sep 14 08:53:13.542421 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 08:53:13.542421 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 08:53:13.542421 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 49c117434c8043c3936a2c7e4b896aaa Sep 14 08:53:13.542421 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1106248544-project-admin Sep 14 08:53:13.542421 n-d-836830-18 devstack@n-api.service[128759]: Sep 14 08:53:13.542421 n-d-836830-18 devstack@n-api.service[128759]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Sep 14 08:53:13.542421 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 08:53:13.543577 n-d-836830-18 devstack@n-api.service[128759]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Sep 14 08:53:13.543577 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'flavor_id': '643707084', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Sep 14 08:53:13.543577 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:53:13.543577 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:53:13.543577 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 14 08:53:13.543577 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 14 08:53:13.543577 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 14 08:53:13.543577 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise error Sep 14 08:53:13.543577 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Sep 14 08:53:13.543577 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:53:13.543577 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Sep 14 08:53:13.543577 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 14 08:53:13.543577 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Sep 14 08:53:13.543577 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Sep 14 08:53:13.543577 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 14 08:53:13.543577 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi 'type': ['string', Sep 14 08:53:13.543577 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi 'number']}}, Sep 14 08:53:13.543577 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 14 08:53:13.543577 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:53:13.543577 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi On instance: Sep 14 08:53:13.543577 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Sep 14 08:53:13.543577 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:53:13.548176 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:53:13.548176 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:53:13.548176 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:53:13.548176 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:53:13.548176 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:53:13.548176 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:53:13.548176 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:53:13.548176 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:53:13.548176 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:53:13.548176 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 14 08:53:13.548176 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 14 08:53:13.548176 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 14 08:53:13.548176 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 14 08:53:13.548176 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 14 08:53:13.548176 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 14 08:53:13.548176 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Sep 14 08:53:13.548176 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:53:13.548176 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:53:13.548176 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:53:13.548176 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:53:13.551219 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:53:13.551219 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:53:13.551219 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 14 08:53:13.551219 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 14 08:53:13.551219 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Sep 14 08:53:13.551219 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:53:13.551219 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e8dbc46d-c08b-470f-9c01-7618dcf69b11 tempest-FlavorsExtraSpecsNegativeTestJSON-1106248544 tempest-FlavorsExtraSpecsNegativeTestJSON-1106248544-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:53:13.551219 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e8dbc46d-c08b-470f-9c01-7618dcf69b11 tempest-FlavorsExtraSpecsNegativeTestJSON-1106248544 tempest-FlavorsExtraSpecsNegativeTestJSON-1106248544-project-admin] 10.222.0.60 "PUT /compute/v2.1/flavors/643707084/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.013039 Sep 14 08:53:13.551219 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 617/1222] 10.222.0.60 () {60 vars in 1262 bytes} [Wed Sep 14 08:53:13 2022] PUT /compute/v2.1/flavors/643707084/os-extra_specs/hw:numa_nodes => generated 117 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 14 08:53:13.555237 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c175423d-696a-4b50-b0dd-97776d0c1280 tempest-FlavorsExtraSpecsNegativeTestJSON-1106248544 tempest-FlavorsExtraSpecsNegativeTestJSON-1106248544-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:13.579600 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-c175423d-696a-4b50-b0dd-97776d0c1280 tempest-FlavorsExtraSpecsNegativeTestJSON-1106248544 tempest-FlavorsExtraSpecsNegativeTestJSON-1106248544-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/643707084" status: 202 len: 0 microversion: 2.1 time: 0.031238 Sep 14 08:53:13.580521 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 606/1223] 10.222.0.60 () {58 vars in 1158 bytes} [Wed Sep 14 08:53:13 2022] DELETE /compute/v2.1/flavors/643707084 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 08:53:13.589340 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-bb6f9672-48a5-49c4-954b-51a185be0571 tempest-FlavorsExtraSpecsNegativeTestJSON-1106248544 tempest-FlavorsExtraSpecsNegativeTestJSON-1106248544-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:13.616924 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-bb6f9672-48a5-49c4-954b-51a185be0571 tempest-FlavorsExtraSpecsNegativeTestJSON-1106248544 tempest-FlavorsExtraSpecsNegativeTestJSON-1106248544-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.031421 Sep 14 08:53:13.632094 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 618/1224] 10.222.0.60 () {58 vars in 1146 bytes} [Wed Sep 14 08:53:13 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:53:13.691601 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-65e85632-c470-4537-a612-5e657be5278f tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:13.692968 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-65e85632-c470-4537-a612-5e657be5278f tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] [instance: 43730a9e-d747-4589-863f-a1c68e14b2a7] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:13.707675 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-65e85632-c470-4537-a612-5e657be5278f tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:13.709695 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-65e85632-c470-4537-a612-5e657be5278f tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:13.714143 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-65e85632-c470-4537-a612-5e657be5278f tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:13.715353 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-65e85632-c470-4537-a612-5e657be5278f tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:13.719256 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-65e85632-c470-4537-a612-5e657be5278f tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:13.720066 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-65e85632-c470-4537-a612-5e657be5278f tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:13.750035 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:53:14.108985 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-14203976-02a7-4c87-8d99-4641b890e17a tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:14.110252 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-14203976-02a7-4c87-8d99-4641b890e17a tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: 1b2a9a93-cad5-4b18-abc3-1b88413f88da] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:14.126404 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-14203976-02a7-4c87-8d99-4641b890e17a tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:14.126918 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-14203976-02a7-4c87-8d99-4641b890e17a tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:14.127387 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-14203976-02a7-4c87-8d99-4641b890e17a tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:14.128113 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-14203976-02a7-4c87-8d99-4641b890e17a tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:14.128575 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-14203976-02a7-4c87-8d99-4641b890e17a tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:14.129007 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-14203976-02a7-4c87-8d99-4641b890e17a tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:14.330250 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-65e85632-c470-4537-a612-5e657be5278f tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa9e50aadef494c8f72ccf88bdc5dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ffed678f9684721b3342a11fa885200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:14.341991 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-65e85632-c470-4537-a612-5e657be5278f tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] 10.222.0.60 "GET /compute/v2.1/servers/43730a9e-d747-4589-863f-a1c68e14b2a7" status: 200 len: 1314 microversion: 2.1 time: 0.654518 Sep 14 08:53:14.350798 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 607/1225] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:13 2022] GET /compute/v2.1/servers/43730a9e-d747-4589-863f-a1c68e14b2a7 => generated 1314 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:53:14.367899 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-18385e05-14a3-42cc-8398-f9fb5035911f tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:14.368850 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-18385e05-14a3-42cc-8398-f9fb5035911f tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] [instance: 67f3a983-b33f-49c8-9c91-988e8553563c] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:14.380104 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-18385e05-14a3-42cc-8398-f9fb5035911f tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:14.380639 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-18385e05-14a3-42cc-8398-f9fb5035911f tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:14.381082 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-18385e05-14a3-42cc-8398-f9fb5035911f tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:14.381814 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-18385e05-14a3-42cc-8398-f9fb5035911f tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:14.382286 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-18385e05-14a3-42cc-8398-f9fb5035911f tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:14.382727 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-18385e05-14a3-42cc-8398-f9fb5035911f tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:14.706795 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-14203976-02a7-4c87-8d99-4641b890e17a tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:14.732563 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-14203976-02a7-4c87-8d99-4641b890e17a tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/1b2a9a93-cad5-4b18-abc3-1b88413f88da" status: 200 len: 1470 microversion: 2.1 time: 0.623438 Sep 14 08:53:14.734979 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 619/1226] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:14 2022] GET /compute/v2.1/servers/1b2a9a93-cad5-4b18-abc3-1b88413f88da => generated 1470 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:53:15.046585 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-18385e05-14a3-42cc-8398-f9fb5035911f tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ace9012a7c4ce59c01858b6984b766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a87a909133e42e1a82e3a623536935c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:15.059231 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-18385e05-14a3-42cc-8398-f9fb5035911f tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] 10.222.0.60 "GET /compute/v2.1/servers/67f3a983-b33f-49c8-9c91-988e8553563c" status: 200 len: 1539 microversion: 2.1 time: 0.706917 Sep 14 08:53:15.074817 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 608/1227] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:14 2022] GET /compute/v2.1/servers/67f3a983-b33f-49c8-9c91-988e8553563c => generated 1539 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:53:15.388882 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-065ca610-4368-4b99-882d-a2f7d4ca427c tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:15.389565 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-065ca610-4368-4b99-882d-a2f7d4ca427c tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] [instance: 43730a9e-d747-4589-863f-a1c68e14b2a7] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:15.400131 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-065ca610-4368-4b99-882d-a2f7d4ca427c tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:15.403093 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-065ca610-4368-4b99-882d-a2f7d4ca427c tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:15.404124 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-065ca610-4368-4b99-882d-a2f7d4ca427c tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:15.405307 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-065ca610-4368-4b99-882d-a2f7d4ca427c tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:15.406445 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-065ca610-4368-4b99-882d-a2f7d4ca427c tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:15.407107 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-065ca610-4368-4b99-882d-a2f7d4ca427c tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:15.429467 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-c7591b4e-95b2-44da-bf9a-dd5cd5ffada4 req-04c4f549-6929-40b1-88c8-0e743cd97bb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67f3a983-b33f-49c8-9c91-988e8553563c", "name": "network-vif-plugged", "status": "completed", "tag": "07668b52-5928-40b0-b852-24d2a561fd3d"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:53:15.441116 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-c7591b4e-95b2-44da-bf9a-dd5cd5ffada4 req-04c4f549-6929-40b1-88c8-0e743cd97bb4 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:15.442043 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-c7591b4e-95b2-44da-bf9a-dd5cd5ffada4 req-04c4f549-6929-40b1-88c8-0e743cd97bb4 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:15.443468 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-c7591b4e-95b2-44da-bf9a-dd5cd5ffada4 req-04c4f549-6929-40b1-88c8-0e743cd97bb4 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:15.466753 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-c7591b4e-95b2-44da-bf9a-dd5cd5ffada4 req-04c4f549-6929-40b1-88c8-0e743cd97bb4 service nova] Creating event network-vif-plugged:07668b52-5928-40b0-b852-24d2a561fd3d for instance 67f3a983-b33f-49c8-9c91-988e8553563c on n-h1-836830-18 Sep 14 08:53:15.474716 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-c7591b4e-95b2-44da-bf9a-dd5cd5ffada4 req-04c4f549-6929-40b1-88c8-0e743cd97bb4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049821 Sep 14 08:53:15.476657 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 609/1228] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:53:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 08:53:15.607183 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-065ca610-4368-4b99-882d-a2f7d4ca427c tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa9e50aadef494c8f72ccf88bdc5dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ffed678f9684721b3342a11fa885200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:15.617352 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-065ca610-4368-4b99-882d-a2f7d4ca427c tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] 10.222.0.60 "GET /compute/v2.1/servers/43730a9e-d747-4589-863f-a1c68e14b2a7" status: 200 len: 1314 microversion: 2.1 time: 0.233070 Sep 14 08:53:15.618582 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 620/1229] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:15 2022] GET /compute/v2.1/servers/43730a9e-d747-4589-863f-a1c68e14b2a7 => generated 1314 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:53:15.761448 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a74241e7-e935-4d90-b3cd-cb96918306ae tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:15.763214 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-a74241e7-e935-4d90-b3cd-cb96918306ae tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: 1b2a9a93-cad5-4b18-abc3-1b88413f88da] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:15.773528 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a74241e7-e935-4d90-b3cd-cb96918306ae tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:15.774303 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a74241e7-e935-4d90-b3cd-cb96918306ae tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:15.775294 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a74241e7-e935-4d90-b3cd-cb96918306ae tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:15.776452 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a74241e7-e935-4d90-b3cd-cb96918306ae tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:15.777135 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a74241e7-e935-4d90-b3cd-cb96918306ae tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:15.777980 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a74241e7-e935-4d90-b3cd-cb96918306ae tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:15.983042 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-a74241e7-e935-4d90-b3cd-cb96918306ae tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:15.992808 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-a74241e7-e935-4d90-b3cd-cb96918306ae tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/1b2a9a93-cad5-4b18-abc3-1b88413f88da" status: 200 len: 1475 microversion: 2.1 time: 0.237979 Sep 14 08:53:15.993707 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 610/1230] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:15 2022] GET /compute/v2.1/servers/1b2a9a93-cad5-4b18-abc3-1b88413f88da => generated 1475 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:53:16.088045 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-6f420b72-aa07-4b83-946e-e473a1c8cbae tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:16.089310 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-6f420b72-aa07-4b83-946e-e473a1c8cbae tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] [instance: 67f3a983-b33f-49c8-9c91-988e8553563c] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:16.116241 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6f420b72-aa07-4b83-946e-e473a1c8cbae tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:16.117096 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6f420b72-aa07-4b83-946e-e473a1c8cbae tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:16.117708 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6f420b72-aa07-4b83-946e-e473a1c8cbae tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:16.118652 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6f420b72-aa07-4b83-946e-e473a1c8cbae tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:16.119315 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6f420b72-aa07-4b83-946e-e473a1c8cbae tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:16.119909 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6f420b72-aa07-4b83-946e-e473a1c8cbae tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:16.326007 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-6f420b72-aa07-4b83-946e-e473a1c8cbae tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ace9012a7c4ce59c01858b6984b766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a87a909133e42e1a82e3a623536935c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:16.334775 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-6f420b72-aa07-4b83-946e-e473a1c8cbae tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] 10.222.0.60 "GET /compute/v2.1/servers/67f3a983-b33f-49c8-9c91-988e8553563c" status: 200 len: 1539 microversion: 2.1 time: 0.250410 Sep 14 08:53:16.339031 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 621/1231] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:16 2022] GET /compute/v2.1/servers/67f3a983-b33f-49c8-9c91-988e8553563c => generated 1539 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:53:16.644566 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d5e87b75-6c5a-48c2-a5d7-2679f5a00dc6 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:16.645291 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-d5e87b75-6c5a-48c2-a5d7-2679f5a00dc6 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] [instance: 43730a9e-d747-4589-863f-a1c68e14b2a7] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:16.652156 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d5e87b75-6c5a-48c2-a5d7-2679f5a00dc6 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:16.652712 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d5e87b75-6c5a-48c2-a5d7-2679f5a00dc6 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:16.653324 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d5e87b75-6c5a-48c2-a5d7-2679f5a00dc6 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:16.654121 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d5e87b75-6c5a-48c2-a5d7-2679f5a00dc6 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:16.654671 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d5e87b75-6c5a-48c2-a5d7-2679f5a00dc6 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:16.655353 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d5e87b75-6c5a-48c2-a5d7-2679f5a00dc6 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:16.823206 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-d5e87b75-6c5a-48c2-a5d7-2679f5a00dc6 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa9e50aadef494c8f72ccf88bdc5dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ffed678f9684721b3342a11fa885200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:16.832482 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-d5e87b75-6c5a-48c2-a5d7-2679f5a00dc6 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] 10.222.0.60 "GET /compute/v2.1/servers/43730a9e-d747-4589-863f-a1c68e14b2a7" status: 200 len: 1314 microversion: 2.1 time: 0.194556 Sep 14 08:53:16.833144 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 611/1232] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:16 2022] GET /compute/v2.1/servers/43730a9e-d747-4589-863f-a1c68e14b2a7 => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:53:17.017525 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-5aa47d39-d014-4b6b-904f-b7931879e197 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:17.018240 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-5aa47d39-d014-4b6b-904f-b7931879e197 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: 1b2a9a93-cad5-4b18-abc3-1b88413f88da] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:17.025290 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5aa47d39-d014-4b6b-904f-b7931879e197 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:17.034574 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5aa47d39-d014-4b6b-904f-b7931879e197 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:17.035405 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5aa47d39-d014-4b6b-904f-b7931879e197 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:17.036212 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5aa47d39-d014-4b6b-904f-b7931879e197 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:17.036892 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5aa47d39-d014-4b6b-904f-b7931879e197 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:17.037402 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5aa47d39-d014-4b6b-904f-b7931879e197 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:17.272646 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-342ed15d-693d-4684-9a78-5f04a7ad2be0 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-2004622955", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "e4b7c003-9e5d-4aea-87a0-7886a038a2d2"}], "security_groups": [{"name": "tempest-securitygroup--793046749"}], "key_name": "tempest-keypair-1657974209", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "6d0a4ae0-2948-40a2-92d5-9524c767931c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:53:17.294591 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=8 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:53:17.518241 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.network.neutron [None req-342ed15d-693d-4684-9a78-5f04a7ad2be0 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] validate_networks() for [('e4b7c003-9e5d-4aea-87a0-7886a038a2d2', None, None, None, None, None)] {{(pid=128758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 08:53:17.578864 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=8 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:53:17.723025 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-5aa47d39-d014-4b6b-904f-b7931879e197 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:17.742609 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-5aa47d39-d014-4b6b-904f-b7931879e197 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/1b2a9a93-cad5-4b18-abc3-1b88413f88da" status: 200 len: 1475 microversion: 2.1 time: 0.728841 Sep 14 08:53:17.755295 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 622/1233] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:17 2022] GET /compute/v2.1/servers/1b2a9a93-cad5-4b18-abc3-1b88413f88da => generated 1475 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:53:17.761062 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-53103ca3-6ec6-454f-8f51-b1c43e564492 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:17.761893 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-53103ca3-6ec6-454f-8f51-b1c43e564492 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] [instance: 67f3a983-b33f-49c8-9c91-988e8553563c] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:17.769218 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-53103ca3-6ec6-454f-8f51-b1c43e564492 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:17.770118 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-53103ca3-6ec6-454f-8f51-b1c43e564492 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:17.771323 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-53103ca3-6ec6-454f-8f51-b1c43e564492 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:17.772331 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-53103ca3-6ec6-454f-8f51-b1c43e564492 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:17.772936 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-53103ca3-6ec6-454f-8f51-b1c43e564492 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:17.773611 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-53103ca3-6ec6-454f-8f51-b1c43e564492 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:17.792118 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:53:17.992627 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-53103ca3-6ec6-454f-8f51-b1c43e564492 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ace9012a7c4ce59c01858b6984b766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a87a909133e42e1a82e3a623536935c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:18.001241 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-53103ca3-6ec6-454f-8f51-b1c43e564492 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] 10.222.0.60 "GET /compute/v2.1/servers/67f3a983-b33f-49c8-9c91-988e8553563c" status: 200 len: 1539 microversion: 2.1 time: 0.244563 Sep 14 08:53:18.001865 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 623/1234] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:17 2022] GET /compute/v2.1/servers/67f3a983-b33f-49c8-9c91-988e8553563c => generated 1539 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:53:18.105616 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-342ed15d-693d-4684-9a78-5f04a7ad2be0 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Getting quotas for project 575684f36f9c4019926fc83541e152c0. Resources: dict_keys(['metadata_items']) {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 08:53:18.113252 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-342ed15d-693d-4684-9a78-5f04a7ad2be0 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Getting quotas for user 9810376d6f0b4329abe0f8f79800b754 and project 575684f36f9c4019926fc83541e152c0. Resources: dict_keys(['metadata_items']) {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 08:53:18.126049 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-342ed15d-693d-4684-9a78-5f04a7ad2be0 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Flavor limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 08:53:18.126465 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-342ed15d-693d-4684-9a78-5f04a7ad2be0 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Image limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 08:53:18.127164 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-342ed15d-693d-4684-9a78-5f04a7ad2be0 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Flavor pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 08:53:18.127581 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-342ed15d-693d-4684-9a78-5f04a7ad2be0 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Image pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 08:53:18.127997 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-342ed15d-693d-4684-9a78-5f04a7ad2be0 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 08:53:18.137031 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-342ed15d-693d-4684-9a78-5f04a7ad2be0 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:18.137504 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-342ed15d-693d-4684-9a78-5f04a7ad2be0 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:18.138100 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-342ed15d-693d-4684-9a78-5f04a7ad2be0 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:18.139203 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-342ed15d-693d-4684-9a78-5f04a7ad2be0 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:18.139691 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-342ed15d-693d-4684-9a78-5f04a7ad2be0 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:18.140155 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-342ed15d-693d-4684-9a78-5f04a7ad2be0 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:18.149131 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-38590123-d33a-4b1a-b382-3e710dd3e9bd tempest-FlavorsV255TestJSON-1492916001 tempest-FlavorsV255TestJSON-1492916001-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-1850156443", "id": 1996820189, "os-flavor-access:is_public": "True"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:53:18.161986 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-342ed15d-693d-4684-9a78-5f04a7ad2be0 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Getting quotas for project 575684f36f9c4019926fc83541e152c0. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 08:53:18.167823 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-342ed15d-693d-4684-9a78-5f04a7ad2be0 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Getting quotas for user 9810376d6f0b4329abe0f8f79800b754 and project 575684f36f9c4019926fc83541e152c0. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 08:53:18.167975 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-38590123-d33a-4b1a-b382-3e710dd3e9bd tempest-FlavorsV255TestJSON-1492916001 tempest-FlavorsV255TestJSON-1492916001-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 449 microversion: 2.55 time: 0.164802 Sep 14 08:53:18.168825 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 624/1235] 10.222.0.60 () {62 vars in 1188 bytes} [Wed Sep 14 08:53:18 2022] POST /compute/v2.1/flavors => generated 449 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 08:53:18.181679 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-228ff40f-a578-47fa-83c3-997523561716 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:18.182526 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-228ff40f-a578-47fa-83c3-997523561716 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] [instance: 43730a9e-d747-4589-863f-a1c68e14b2a7] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:18.188588 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-228ff40f-a578-47fa-83c3-997523561716 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:18.189326 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-228ff40f-a578-47fa-83c3-997523561716 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:18.189927 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-228ff40f-a578-47fa-83c3-997523561716 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:18.190870 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-228ff40f-a578-47fa-83c3-997523561716 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:18.191506 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-228ff40f-a578-47fa-83c3-997523561716 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:18.192622 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-228ff40f-a578-47fa-83c3-997523561716 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:18.240506 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-342ed15d-693d-4684-9a78-5f04a7ad2be0 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Going to run 1 instances... {{(pid=128758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 08:53:18.243499 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-342ed15d-693d-4684-9a78-5f04a7ad2be0 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] [instance: 4ea5843e-ecf7-4b84-80cb-3f05b2b20982] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6d0a4ae0-2948-40a2-92d5-9524c767931c',volume_size=None,volume_type=None)] {{(pid=128758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 08:53:18.348563 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-228ff40f-a578-47fa-83c3-997523561716 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa9e50aadef494c8f72ccf88bdc5dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ffed678f9684721b3342a11fa885200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:18.356799 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-228ff40f-a578-47fa-83c3-997523561716 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] 10.222.0.60 "GET /compute/v2.1/servers/43730a9e-d747-4589-863f-a1c68e14b2a7" status: 200 len: 1314 microversion: 2.1 time: 0.178984 Sep 14 08:53:18.357384 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 625/1236] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:18 2022] GET /compute/v2.1/servers/43730a9e-d747-4589-863f-a1c68e14b2a7 => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:53:18.407078 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-342ed15d-693d-4684-9a78-5f04a7ad2be0 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.139034 Sep 14 08:53:18.414033 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 612/1237] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 08:53:17 2022] POST /compute/v2.1/servers => generated 406 bytes in 1147 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 14 08:53:18.419071 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-4e9c90a2-8152-44ba-a4c9-0666db971412 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:18.419937 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-4e9c90a2-8152-44ba-a4c9-0666db971412 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] [instance: 4ea5843e-ecf7-4b84-80cb-3f05b2b20982] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:18.476760 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-4e9c90a2-8152-44ba-a4c9-0666db971412 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810376d6f0b4329abe0f8f79800b754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575684f36f9c4019926fc83541e152c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:18.484795 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-4e9c90a2-8152-44ba-a4c9-0666db971412 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] 10.222.0.60 "GET /compute/v2.1/servers/4ea5843e-ecf7-4b84-80cb-3f05b2b20982" status: 200 len: 1122 microversion: 2.1 time: 0.069306 Sep 14 08:53:18.499435 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 613/1238] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:18 2022] GET /compute/v2.1/servers/4ea5843e-ecf7-4b84-80cb-3f05b2b20982 => generated 1122 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:53:18.510327 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3c1e4c39-ea2c-4d9d-ae94-fc38870b29c9 tempest-FlavorsV255TestJSON-1365280572 tempest-FlavorsV255TestJSON-1365280572-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:18.522142 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-3c1e4c39-ea2c-4d9d-ae94-fc38870b29c9 tempest-FlavorsV255TestJSON-1365280572 tempest-FlavorsV255TestJSON-1365280572-project] 10.222.0.60 "GET /compute/v2.1/flavors/1996820189" status: 200 len: 449 microversion: 2.55 time: 0.163214 Sep 14 08:53:18.523180 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 626/1239] 10.222.0.60 () {60 vars in 1199 bytes} [Wed Sep 14 08:53:18 2022] GET /compute/v2.1/flavors/1996820189 => generated 449 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 08:53:18.536928 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-6861e61a-86d8-4d11-8c9b-0d2d13195ce0 tempest-FlavorsV255TestJSON-1492916001 tempest-FlavorsV255TestJSON-1492916001-project-admin] Action: 'update', calling method: .version_select at 0x7f7d462cca60>, body: {"flavor": {"description": "new"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:53:18.592194 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-6861e61a-86d8-4d11-8c9b-0d2d13195ce0 tempest-FlavorsV255TestJSON-1492916001 tempest-FlavorsV255TestJSON-1492916001-project-admin] 10.222.0.60 "PUT /compute/v2.1/flavors/1996820189" status: 200 len: 450 microversion: 2.55 time: 0.059848 Sep 14 08:53:18.592843 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 614/1240] 10.222.0.60 () {62 vars in 1219 bytes} [Wed Sep 14 08:53:18 2022] PUT /compute/v2.1/flavors/1996820189 => generated 450 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 08:53:18.606334 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-2c09c1a5-885a-43fc-a0e0-50ffa10f6fc3 tempest-FlavorsV255TestJSON-1365280572 tempest-FlavorsV255TestJSON-1365280572-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:18.628876 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-2c09c1a5-885a-43fc-a0e0-50ffa10f6fc3 tempest-FlavorsV255TestJSON-1365280572 tempest-FlavorsV255TestJSON-1365280572-project] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 5725 microversion: 2.55 time: 0.026394 Sep 14 08:53:18.630264 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 627/1241] 10.222.0.60 () {60 vars in 1187 bytes} [Wed Sep 14 08:53:18 2022] GET /compute/v2.1/flavors/detail => generated 5725 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:53:18.651989 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ea91df1e-06b1-4ab3-b233-df7fe7d406a5 tempest-FlavorsV255TestJSON-1365280572 tempest-FlavorsV255TestJSON-1365280572-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:18.672743 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-ea91df1e-06b1-4ab3-b233-df7fe7d406a5 tempest-FlavorsV255TestJSON-1365280572 tempest-FlavorsV255TestJSON-1365280572-project] 10.222.0.60 "GET /compute/v2.1/flavors" status: 200 len: 3157 microversion: 2.55 time: 0.025092 Sep 14 08:53:18.673843 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 615/1242] 10.222.0.60 () {60 vars in 1166 bytes} [Wed Sep 14 08:53:18 2022] GET /compute/v2.1/flavors => generated 3157 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:53:18.690691 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ffa69584-3287-4c72-9642-880117208f09 tempest-FlavorsV255TestJSON-1492916001 tempest-FlavorsV255TestJSON-1492916001-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:18.697148 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=6,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:53:18.715752 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-ffa69584-3287-4c72-9642-880117208f09 tempest-FlavorsV255TestJSON-1492916001 tempest-FlavorsV255TestJSON-1492916001-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/1996820189" status: 202 len: 0 microversion: 2.55 time: 0.029007 Sep 14 08:53:18.716845 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 628/1243] 10.222.0.60 () {60 vars in 1202 bytes} [Wed Sep 14 08:53:18 2022] DELETE /compute/v2.1/flavors/1996820189 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 14 08:53:18.724509 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-397c457e-2571-4391-bd1d-5018aa90410e tempest-FlavorsV255TestJSON-1492916001 tempest-FlavorsV255TestJSON-1492916001-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:18.746235 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-397c457e-2571-4391-bd1d-5018aa90410e tempest-FlavorsV255TestJSON-1492916001 tempest-FlavorsV255TestJSON-1492916001-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 5285 microversion: 2.55 time: 0.025436 Sep 14 08:53:18.752569 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 616/1244] 10.222.0.60 () {60 vars in 1187 bytes} [Wed Sep 14 08:53:18 2022] GET /compute/v2.1/flavors/detail => generated 5285 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:53:18.780280 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-df60d689-f6da-4760-8839-a94f17315e1d tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:18.781158 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-df60d689-f6da-4760-8839-a94f17315e1d tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: 1b2a9a93-cad5-4b18-abc3-1b88413f88da] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:18.796326 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-df60d689-f6da-4760-8839-a94f17315e1d tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:18.797582 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-df60d689-f6da-4760-8839-a94f17315e1d tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:18.799181 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-df60d689-f6da-4760-8839-a94f17315e1d tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:18.802496 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-df60d689-f6da-4760-8839-a94f17315e1d tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:18.803274 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-df60d689-f6da-4760-8839-a94f17315e1d tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:18.805258 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-df60d689-f6da-4760-8839-a94f17315e1d tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:18.905987 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-36904622-f4be-4069-8791-d7420b00dc66 req-cfde7898-a03d-43d5-8a2a-b7f168a5783e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43730a9e-d747-4589-863f-a1c68e14b2a7", "name": "network-vif-plugged", "status": "completed", "tag": "0c78838d-0a7a-4e27-9dab-7b72a94dd866"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:53:18.927299 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-36904622-f4be-4069-8791-d7420b00dc66 req-cfde7898-a03d-43d5-8a2a-b7f168a5783e service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:18.928177 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-36904622-f4be-4069-8791-d7420b00dc66 req-cfde7898-a03d-43d5-8a2a-b7f168a5783e service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:18.928807 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-36904622-f4be-4069-8791-d7420b00dc66 req-cfde7898-a03d-43d5-8a2a-b7f168a5783e service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:18.957754 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-36904622-f4be-4069-8791-d7420b00dc66 req-cfde7898-a03d-43d5-8a2a-b7f168a5783e service nova] Creating event network-vif-plugged:0c78838d-0a7a-4e27-9dab-7b72a94dd866 for instance 43730a9e-d747-4589-863f-a1c68e14b2a7 on n-h2-836830-18 Sep 14 08:53:18.963259 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-36904622-f4be-4069-8791-d7420b00dc66 req-cfde7898-a03d-43d5-8a2a-b7f168a5783e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060739 Sep 14 08:53:18.964527 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 617/1245] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:53:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 08:53:18.995209 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-df60d689-f6da-4760-8839-a94f17315e1d tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:19.007173 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-df60d689-f6da-4760-8839-a94f17315e1d tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/1b2a9a93-cad5-4b18-abc3-1b88413f88da" status: 200 len: 1475 microversion: 2.1 time: 0.231682 Sep 14 08:53:19.008995 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 629/1246] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:18 2022] GET /compute/v2.1/servers/1b2a9a93-cad5-4b18-abc3-1b88413f88da => generated 1475 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:53:19.027690 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-540887ad-8794-497b-aff3-06cabdbf0b63 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:19.029377 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-540887ad-8794-497b-aff3-06cabdbf0b63 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] [instance: 67f3a983-b33f-49c8-9c91-988e8553563c] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:19.044428 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-540887ad-8794-497b-aff3-06cabdbf0b63 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:19.044428 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-540887ad-8794-497b-aff3-06cabdbf0b63 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:19.044842 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-540887ad-8794-497b-aff3-06cabdbf0b63 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:19.045563 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-540887ad-8794-497b-aff3-06cabdbf0b63 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:19.046040 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-540887ad-8794-497b-aff3-06cabdbf0b63 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:19.046470 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-540887ad-8794-497b-aff3-06cabdbf0b63 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:19.302843 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-540887ad-8794-497b-aff3-06cabdbf0b63 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ace9012a7c4ce59c01858b6984b766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a87a909133e42e1a82e3a623536935c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:19.338669 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-540887ad-8794-497b-aff3-06cabdbf0b63 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] 10.222.0.60 "GET /compute/v2.1/servers/67f3a983-b33f-49c8-9c91-988e8553563c" status: 200 len: 1521 microversion: 2.1 time: 0.308184 Sep 14 08:53:19.339873 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 618/1247] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:19 2022] GET /compute/v2.1/servers/67f3a983-b33f-49c8-9c91-988e8553563c => generated 1521 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:53:19.363105 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-563bdaf6-b88c-4de4-9add-13657370bb1f tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:19.365282 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-563bdaf6-b88c-4de4-9add-13657370bb1f tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] [instance: 67f3a983-b33f-49c8-9c91-988e8553563c] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:19.376296 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-563bdaf6-b88c-4de4-9add-13657370bb1f tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:19.377134 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-563bdaf6-b88c-4de4-9add-13657370bb1f tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:19.377878 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-563bdaf6-b88c-4de4-9add-13657370bb1f tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:19.378784 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-563bdaf6-b88c-4de4-9add-13657370bb1f tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:19.380707 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-70c77f1a-a4a9-4140-8b8a-8c91f9352e1a tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:19.381470 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-70c77f1a-a4a9-4140-8b8a-8c91f9352e1a tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] [instance: 43730a9e-d747-4589-863f-a1c68e14b2a7] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:19.382280 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-563bdaf6-b88c-4de4-9add-13657370bb1f tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:19.382280 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-563bdaf6-b88c-4de4-9add-13657370bb1f tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:19.387728 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-70c77f1a-a4a9-4140-8b8a-8c91f9352e1a tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:19.388405 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-70c77f1a-a4a9-4140-8b8a-8c91f9352e1a tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:19.389020 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-70c77f1a-a4a9-4140-8b8a-8c91f9352e1a tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:19.389893 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-70c77f1a-a4a9-4140-8b8a-8c91f9352e1a tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:19.390348 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-70c77f1a-a4a9-4140-8b8a-8c91f9352e1a tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:19.390758 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-70c77f1a-a4a9-4140-8b8a-8c91f9352e1a tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:19.416493 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-563bdaf6-b88c-4de4-9add-13657370bb1f tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] [instance: 67f3a983-b33f-49c8-9c91-988e8553563c] Going to try to terminate instance {{(pid=128759) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 08:53:19.578702 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-563bdaf6-b88c-4de4-9add-13657370bb1f tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] 10.222.0.60 "DELETE /compute/v2.1/servers/67f3a983-b33f-49c8-9c91-988e8553563c" status: 204 len: 0 microversion: 2.1 time: 0.220248 Sep 14 08:53:19.579855 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 630/1248] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 08:53:19 2022] DELETE /compute/v2.1/servers/67f3a983-b33f-49c8-9c91-988e8553563c => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 08:53:19.585533 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-70c77f1a-a4a9-4140-8b8a-8c91f9352e1a tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa9e50aadef494c8f72ccf88bdc5dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ffed678f9684721b3342a11fa885200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:19.591714 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f8bbff77-ec86-4ece-8899-bfd986c8c213 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:19.592573 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f8bbff77-ec86-4ece-8899-bfd986c8c213 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] [instance: 4ea5843e-ecf7-4b84-80cb-3f05b2b20982] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:19.619501 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-70c77f1a-a4a9-4140-8b8a-8c91f9352e1a tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] 10.222.0.60 "GET /compute/v2.1/servers/43730a9e-d747-4589-863f-a1c68e14b2a7" status: 200 len: 1314 microversion: 2.1 time: 0.242917 Sep 14 08:53:19.624265 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 619/1249] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:19 2022] GET /compute/v2.1/servers/43730a9e-d747-4589-863f-a1c68e14b2a7 => generated 1314 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:53:19.632659 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-bc2b39e9-2e6a-4bbc-bea1-c2fc193030fa tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:19.633561 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-bc2b39e9-2e6a-4bbc-bea1-c2fc193030fa tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] [instance: 67f3a983-b33f-49c8-9c91-988e8553563c] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:19.641703 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=4,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:53:19.642369 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f8bbff77-ec86-4ece-8899-bfd986c8c213 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:19.643054 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f8bbff77-ec86-4ece-8899-bfd986c8c213 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:19.646188 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f8bbff77-ec86-4ece-8899-bfd986c8c213 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:19.647141 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f8bbff77-ec86-4ece-8899-bfd986c8c213 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:19.648767 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f8bbff77-ec86-4ece-8899-bfd986c8c213 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:19.649218 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f8bbff77-ec86-4ece-8899-bfd986c8c213 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:19.654181 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bc2b39e9-2e6a-4bbc-bea1-c2fc193030fa tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:19.654818 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bc2b39e9-2e6a-4bbc-bea1-c2fc193030fa tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:19.656034 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bc2b39e9-2e6a-4bbc-bea1-c2fc193030fa tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:19.656876 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bc2b39e9-2e6a-4bbc-bea1-c2fc193030fa tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:19.659104 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bc2b39e9-2e6a-4bbc-bea1-c2fc193030fa tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:19.661647 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bc2b39e9-2e6a-4bbc-bea1-c2fc193030fa tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:19.777843 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f8bbff77-ec86-4ece-8899-bfd986c8c213 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810376d6f0b4329abe0f8f79800b754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575684f36f9c4019926fc83541e152c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:19.789124 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f8bbff77-ec86-4ece-8899-bfd986c8c213 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] 10.222.0.60 "GET /compute/v2.1/servers/4ea5843e-ecf7-4b84-80cb-3f05b2b20982" status: 200 len: 1220 microversion: 2.1 time: 0.207784 Sep 14 08:53:19.805878 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 631/1250] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:19 2022] GET /compute/v2.1/servers/4ea5843e-ecf7-4b84-80cb-3f05b2b20982 => generated 1220 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:53:19.857616 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-bc2b39e9-2e6a-4bbc-bea1-c2fc193030fa tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ace9012a7c4ce59c01858b6984b766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a87a909133e42e1a82e3a623536935c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:19.865667 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-bc2b39e9-2e6a-4bbc-bea1-c2fc193030fa tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] 10.222.0.60 "GET /compute/v2.1/servers/67f3a983-b33f-49c8-9c91-988e8553563c" status: 200 len: 1527 microversion: 2.1 time: 0.239004 Sep 14 08:53:19.866255 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 620/1251] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:19 2022] GET /compute/v2.1/servers/67f3a983-b33f-49c8-9c91-988e8553563c => generated 1527 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:53:20.033849 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d6697fc7-5ae9-46bf-b743-fbf8ad6af6c7 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:20.034375 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-d6697fc7-5ae9-46bf-b743-fbf8ad6af6c7 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: 1b2a9a93-cad5-4b18-abc3-1b88413f88da] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:20.041451 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d6697fc7-5ae9-46bf-b743-fbf8ad6af6c7 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:20.041949 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d6697fc7-5ae9-46bf-b743-fbf8ad6af6c7 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:20.042384 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d6697fc7-5ae9-46bf-b743-fbf8ad6af6c7 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:20.043121 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d6697fc7-5ae9-46bf-b743-fbf8ad6af6c7 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:20.043587 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d6697fc7-5ae9-46bf-b743-fbf8ad6af6c7 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:20.044014 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d6697fc7-5ae9-46bf-b743-fbf8ad6af6c7 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:20.237645 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-d6697fc7-5ae9-46bf-b743-fbf8ad6af6c7 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:20.247456 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d6697fc7-5ae9-46bf-b743-fbf8ad6af6c7 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/1b2a9a93-cad5-4b18-abc3-1b88413f88da" status: 200 len: 1475 microversion: 2.1 time: 0.217254 Sep 14 08:53:20.248838 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 632/1252] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:20 2022] GET /compute/v2.1/servers/1b2a9a93-cad5-4b18-abc3-1b88413f88da => generated 1475 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:53:20.648295 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a9125bb5-43b6-4a8d-8120-7979aef50704 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:20.648918 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-a9125bb5-43b6-4a8d-8120-7979aef50704 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] [instance: 43730a9e-d747-4589-863f-a1c68e14b2a7] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:20.655798 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a9125bb5-43b6-4a8d-8120-7979aef50704 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:20.656290 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a9125bb5-43b6-4a8d-8120-7979aef50704 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:20.656730 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a9125bb5-43b6-4a8d-8120-7979aef50704 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:20.657647 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a9125bb5-43b6-4a8d-8120-7979aef50704 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:20.657894 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a9125bb5-43b6-4a8d-8120-7979aef50704 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:20.658324 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a9125bb5-43b6-4a8d-8120-7979aef50704 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:20.800530 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-a9125bb5-43b6-4a8d-8120-7979aef50704 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa9e50aadef494c8f72ccf88bdc5dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ffed678f9684721b3342a11fa885200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:20.809713 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-a9125bb5-43b6-4a8d-8120-7979aef50704 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] 10.222.0.60 "GET /compute/v2.1/servers/43730a9e-d747-4589-863f-a1c68e14b2a7" status: 200 len: 1464 microversion: 2.1 time: 0.165946 Sep 14 08:53:20.814431 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 621/1253] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:20 2022] GET /compute/v2.1/servers/43730a9e-d747-4589-863f-a1c68e14b2a7 => generated 1464 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:53:20.815668 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f5946cb0-372e-4a40-8b72-e12e66a3bb30 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:20.817033 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f5946cb0-372e-4a40-8b72-e12e66a3bb30 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] [instance: 4ea5843e-ecf7-4b84-80cb-3f05b2b20982] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:20.825137 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f5946cb0-372e-4a40-8b72-e12e66a3bb30 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:20.825941 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f5946cb0-372e-4a40-8b72-e12e66a3bb30 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:20.826709 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f5946cb0-372e-4a40-8b72-e12e66a3bb30 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:20.827653 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f5946cb0-372e-4a40-8b72-e12e66a3bb30 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:20.831476 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f5946cb0-372e-4a40-8b72-e12e66a3bb30 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:20.832015 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f5946cb0-372e-4a40-8b72-e12e66a3bb30 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:20.906994 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f5946cb0-372e-4a40-8b72-e12e66a3bb30 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810376d6f0b4329abe0f8f79800b754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575684f36f9c4019926fc83541e152c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:20.915397 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f5946cb0-372e-4a40-8b72-e12e66a3bb30 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] 10.222.0.60 "GET /compute/v2.1/servers/4ea5843e-ecf7-4b84-80cb-3f05b2b20982" status: 200 len: 1220 microversion: 2.1 time: 0.103616 Sep 14 08:53:20.917693 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 633/1254] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:20 2022] GET /compute/v2.1/servers/4ea5843e-ecf7-4b84-80cb-3f05b2b20982 => generated 1220 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:53:20.931352 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-fb14a38f-ea57-483a-80d9-c288d3bfa4a1 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:20.932268 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-fb14a38f-ea57-483a-80d9-c288d3bfa4a1 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] [instance: 67f3a983-b33f-49c8-9c91-988e8553563c] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:20.938810 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fb14a38f-ea57-483a-80d9-c288d3bfa4a1 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:20.939373 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fb14a38f-ea57-483a-80d9-c288d3bfa4a1 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:20.939800 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fb14a38f-ea57-483a-80d9-c288d3bfa4a1 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:20.940672 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fb14a38f-ea57-483a-80d9-c288d3bfa4a1 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:20.941142 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fb14a38f-ea57-483a-80d9-c288d3bfa4a1 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:20.941965 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fb14a38f-ea57-483a-80d9-c288d3bfa4a1 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:21.090242 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-fb14a38f-ea57-483a-80d9-c288d3bfa4a1 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ace9012a7c4ce59c01858b6984b766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a87a909133e42e1a82e3a623536935c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:21.101598 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-fb14a38f-ea57-483a-80d9-c288d3bfa4a1 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] 10.222.0.60 "GET /compute/v2.1/servers/67f3a983-b33f-49c8-9c91-988e8553563c" status: 200 len: 1527 microversion: 2.1 time: 0.182218 Sep 14 08:53:21.102416 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 634/1255] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:20 2022] GET /compute/v2.1/servers/67f3a983-b33f-49c8-9c91-988e8553563c => generated 1527 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:53:21.129216 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-e38d8e1c-074d-457f-82f7-aebfea5ee158 tempest-TenantUsagesTestJSON-566795084 tempest-TenantUsagesTestJSON-566795084-project-admin] Calling method '.version_select at 0x7f7d44478040>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:21.140464 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e38d8e1c-074d-457f-82f7-aebfea5ee158 tempest-TenantUsagesTestJSON-566795084 tempest-TenantUsagesTestJSON-566795084-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:21.140943 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e38d8e1c-074d-457f-82f7-aebfea5ee158 tempest-TenantUsagesTestJSON-566795084 tempest-TenantUsagesTestJSON-566795084-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:21.141368 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e38d8e1c-074d-457f-82f7-aebfea5ee158 tempest-TenantUsagesTestJSON-566795084 tempest-TenantUsagesTestJSON-566795084-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:21.158262 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e38d8e1c-074d-457f-82f7-aebfea5ee158 tempest-TenantUsagesTestJSON-566795084 tempest-TenantUsagesTestJSON-566795084-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:21.158734 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e38d8e1c-074d-457f-82f7-aebfea5ee158 tempest-TenantUsagesTestJSON-566795084 tempest-TenantUsagesTestJSON-566795084-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:21.159192 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e38d8e1c-074d-457f-82f7-aebfea5ee158 tempest-TenantUsagesTestJSON-566795084 tempest-TenantUsagesTestJSON-566795084-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:21.177837 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-e38d8e1c-074d-457f-82f7-aebfea5ee158 tempest-TenantUsagesTestJSON-566795084 tempest-TenantUsagesTestJSON-566795084-project-admin] 10.222.0.60 "GET /compute/v2.1/os-simple-tenant-usage/7ffed678f9684721b3342a11fa885200?start=2022-09-13T08%3A53%3A20.825750&end=2022-09-15T08%3A53%3A20.825750" status: 200 len: 695 microversion: 2.1 time: 0.345528 Sep 14 08:53:21.179090 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 622/1256] 10.222.0.60 () {58 vars in 1412 bytes} [Wed Sep 14 08:53:20 2022] GET /compute/v2.1/os-simple-tenant-usage/7ffed678f9684721b3342a11fa885200?start=2022-09-13T08%3A53%3A20.825750&end=2022-09-15T08%3A53%3A20.825750 => generated 695 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:53:21.194378 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-88bdcf06-6329-47ed-94f5-a8cb97a12833 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Calling method '.version_select at 0x7f7d442748b0>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:21.204270 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-88bdcf06-6329-47ed-94f5-a8cb97a12833 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:21.204767 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-88bdcf06-6329-47ed-94f5-a8cb97a12833 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:21.205395 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-88bdcf06-6329-47ed-94f5-a8cb97a12833 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:21.222886 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-88bdcf06-6329-47ed-94f5-a8cb97a12833 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:21.223942 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-88bdcf06-6329-47ed-94f5-a8cb97a12833 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:21.224380 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-88bdcf06-6329-47ed-94f5-a8cb97a12833 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:21.242440 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-88bdcf06-6329-47ed-94f5-a8cb97a12833 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] 10.222.0.60 "GET /compute/v2.1/os-simple-tenant-usage/7ffed678f9684721b3342a11fa885200?start=2022-09-13T08%3A53%3A20.825750&end=2022-09-15T08%3A53%3A20.825750" status: 200 len: 699 microversion: 2.1 time: 0.051898 Sep 14 08:53:21.243390 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 635/1257] 10.222.0.60 () {58 vars in 1412 bytes} [Wed Sep 14 08:53:21 2022] GET /compute/v2.1/os-simple-tenant-usage/7ffed678f9684721b3342a11fa885200?start=2022-09-13T08%3A53%3A20.825750&end=2022-09-15T08%3A53%3A20.825750 => generated 699 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:53:21.259786 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-4266274c-e415-4d7f-8bbb-b1dd601abb55 tempest-TenantUsagesTestJSON-566795084 tempest-TenantUsagesTestJSON-566795084-project-admin] Calling method '.version_select at 0x7f7d44540c10>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:21.272708 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-1ac39032-de98-4284-b57f-aca016d72c88 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:21.273202 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-1ac39032-de98-4284-b57f-aca016d72c88 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: 1b2a9a93-cad5-4b18-abc3-1b88413f88da] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:21.278115 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4266274c-e415-4d7f-8bbb-b1dd601abb55 tempest-TenantUsagesTestJSON-566795084 tempest-TenantUsagesTestJSON-566795084-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:21.279007 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4266274c-e415-4d7f-8bbb-b1dd601abb55 tempest-TenantUsagesTestJSON-566795084 tempest-TenantUsagesTestJSON-566795084-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:21.279623 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4266274c-e415-4d7f-8bbb-b1dd601abb55 tempest-TenantUsagesTestJSON-566795084 tempest-TenantUsagesTestJSON-566795084-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:21.279786 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1ac39032-de98-4284-b57f-aca016d72c88 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:21.280260 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1ac39032-de98-4284-b57f-aca016d72c88 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:21.280689 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1ac39032-de98-4284-b57f-aca016d72c88 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:21.281572 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1ac39032-de98-4284-b57f-aca016d72c88 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:21.282184 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1ac39032-de98-4284-b57f-aca016d72c88 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:21.282763 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1ac39032-de98-4284-b57f-aca016d72c88 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:21.306834 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4266274c-e415-4d7f-8bbb-b1dd601abb55 tempest-TenantUsagesTestJSON-566795084 tempest-TenantUsagesTestJSON-566795084-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:21.307445 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4266274c-e415-4d7f-8bbb-b1dd601abb55 tempest-TenantUsagesTestJSON-566795084 tempest-TenantUsagesTestJSON-566795084-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:21.307962 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4266274c-e415-4d7f-8bbb-b1dd601abb55 tempest-TenantUsagesTestJSON-566795084 tempest-TenantUsagesTestJSON-566795084-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:21.395106 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-4266274c-e415-4d7f-8bbb-b1dd601abb55 tempest-TenantUsagesTestJSON-566795084 tempest-TenantUsagesTestJSON-566795084-project-admin] 10.222.0.60 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-09-13T08%3A53%3A20.825750&end=2022-09-15T08%3A53%3A20.825750&detailed=1" status: 200 len: 15453 microversion: 2.1 time: 0.140248 Sep 14 08:53:21.396426 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 623/1258] 10.222.0.60 () {58 vars in 1335 bytes} [Wed Sep 14 08:53:21 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-09-13T08%3A53%3A20.825750&end=2022-09-15T08%3A53%3A20.825750&detailed=1 => generated 15453 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 08:53:21.401657 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-73559ebf-6708-498c-bd4f-96d0a1ebac99 req-de392873-f3a2-4252-9504-e283911787a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67f3a983-b33f-49c8-9c91-988e8553563c", "name": "network-vif-unplugged", "status": "completed", "tag": "07668b52-5928-40b0-b852-24d2a561fd3d"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:53:21.422914 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-73559ebf-6708-498c-bd4f-96d0a1ebac99 req-de392873-f3a2-4252-9504-e283911787a1 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:21.431388 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-73559ebf-6708-498c-bd4f-96d0a1ebac99 req-de392873-f3a2-4252-9504-e283911787a1 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:21.432640 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-73559ebf-6708-498c-bd4f-96d0a1ebac99 req-de392873-f3a2-4252-9504-e283911787a1 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:21.448368 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-73559ebf-6708-498c-bd4f-96d0a1ebac99 req-de392873-f3a2-4252-9504-e283911787a1 service nova] Creating event network-vif-unplugged:07668b52-5928-40b0-b852-24d2a561fd3d for instance 67f3a983-b33f-49c8-9c91-988e8553563c on n-h1-836830-18 Sep 14 08:53:21.451317 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-1ac39032-de98-4284-b57f-aca016d72c88 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:21.454755 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-73559ebf-6708-498c-bd4f-96d0a1ebac99 req-de392873-f3a2-4252-9504-e283911787a1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.056571 Sep 14 08:53:21.459745 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 624/1259] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:53:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:53:21.462397 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-1ac39032-de98-4284-b57f-aca016d72c88 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/1b2a9a93-cad5-4b18-abc3-1b88413f88da" status: 200 len: 1475 microversion: 2.1 time: 0.194995 Sep 14 08:53:21.469670 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-2d508c03-da35-4fe7-900b-b44e6de6dcb9 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:21.471008 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-2d508c03-da35-4fe7-900b-b44e6de6dcb9 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] [instance: 43730a9e-d747-4589-863f-a1c68e14b2a7] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:21.476767 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 636/1260] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:21 2022] GET /compute/v2.1/servers/1b2a9a93-cad5-4b18-abc3-1b88413f88da => generated 1475 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:53:21.477840 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2d508c03-da35-4fe7-900b-b44e6de6dcb9 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:21.478324 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2d508c03-da35-4fe7-900b-b44e6de6dcb9 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:21.478755 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2d508c03-da35-4fe7-900b-b44e6de6dcb9 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:21.479476 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2d508c03-da35-4fe7-900b-b44e6de6dcb9 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:21.479924 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2d508c03-da35-4fe7-900b-b44e6de6dcb9 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:21.480342 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2d508c03-da35-4fe7-900b-b44e6de6dcb9 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:21.508274 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-2d508c03-da35-4fe7-900b-b44e6de6dcb9 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] [instance: 43730a9e-d747-4589-863f-a1c68e14b2a7] Going to try to terminate instance {{(pid=128758) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 08:53:21.594551 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-2d508c03-da35-4fe7-900b-b44e6de6dcb9 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] 10.222.0.60 "DELETE /compute/v2.1/servers/43730a9e-d747-4589-863f-a1c68e14b2a7" status: 204 len: 0 microversion: 2.1 time: 0.133264 Sep 14 08:53:21.595241 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 625/1261] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 08:53:21 2022] DELETE /compute/v2.1/servers/43730a9e-d747-4589-863f-a1c68e14b2a7 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 08:53:21.603740 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d0e74542-ea32-4bef-bef8-cc00662438b7 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:21.604576 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-d0e74542-ea32-4bef-bef8-cc00662438b7 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] [instance: 43730a9e-d747-4589-863f-a1c68e14b2a7] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:21.611081 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d0e74542-ea32-4bef-bef8-cc00662438b7 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:21.611646 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d0e74542-ea32-4bef-bef8-cc00662438b7 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:21.612281 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d0e74542-ea32-4bef-bef8-cc00662438b7 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:21.612982 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d0e74542-ea32-4bef-bef8-cc00662438b7 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:21.613444 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d0e74542-ea32-4bef-bef8-cc00662438b7 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:21.614374 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d0e74542-ea32-4bef-bef8-cc00662438b7 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:21.759138 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-d0e74542-ea32-4bef-bef8-cc00662438b7 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa9e50aadef494c8f72ccf88bdc5dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ffed678f9684721b3342a11fa885200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:21.767002 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d0e74542-ea32-4bef-bef8-cc00662438b7 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] 10.222.0.60 "GET /compute/v2.1/servers/43730a9e-d747-4589-863f-a1c68e14b2a7" status: 200 len: 1470 microversion: 2.1 time: 0.167203 Sep 14 08:53:21.767571 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 637/1262] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:21 2022] GET /compute/v2.1/servers/43730a9e-d747-4589-863f-a1c68e14b2a7 => generated 1470 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:53:21.948284 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-56636eb7-10f4-4c0d-a051-945d2dbb70c8 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:21.949869 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-56636eb7-10f4-4c0d-a051-945d2dbb70c8 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] [instance: 4ea5843e-ecf7-4b84-80cb-3f05b2b20982] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:21.959183 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-56636eb7-10f4-4c0d-a051-945d2dbb70c8 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:21.959902 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-56636eb7-10f4-4c0d-a051-945d2dbb70c8 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:21.960570 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-56636eb7-10f4-4c0d-a051-945d2dbb70c8 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:21.961275 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-56636eb7-10f4-4c0d-a051-945d2dbb70c8 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:21.961952 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-56636eb7-10f4-4c0d-a051-945d2dbb70c8 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:21.962387 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-56636eb7-10f4-4c0d-a051-945d2dbb70c8 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:22.047583 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-56636eb7-10f4-4c0d-a051-945d2dbb70c8 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810376d6f0b4329abe0f8f79800b754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575684f36f9c4019926fc83541e152c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:22.056886 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-56636eb7-10f4-4c0d-a051-945d2dbb70c8 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] 10.222.0.60 "GET /compute/v2.1/servers/4ea5843e-ecf7-4b84-80cb-3f05b2b20982" status: 200 len: 1220 microversion: 2.1 time: 0.115398 Sep 14 08:53:22.057578 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 626/1263] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:21 2022] GET /compute/v2.1/servers/4ea5843e-ecf7-4b84-80cb-3f05b2b20982 => generated 1220 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:53:22.125042 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-12ea6b51-9ca0-4700-af57-c301c84d62f3 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:22.125656 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-12ea6b51-9ca0-4700-af57-c301c84d62f3 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] [instance: 67f3a983-b33f-49c8-9c91-988e8553563c] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:22.132403 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-12ea6b51-9ca0-4700-af57-c301c84d62f3 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:22.132892 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-12ea6b51-9ca0-4700-af57-c301c84d62f3 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:22.133324 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-12ea6b51-9ca0-4700-af57-c301c84d62f3 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:22.134020 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-12ea6b51-9ca0-4700-af57-c301c84d62f3 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:22.134475 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-12ea6b51-9ca0-4700-af57-c301c84d62f3 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:22.134896 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-12ea6b51-9ca0-4700-af57-c301c84d62f3 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:22.143240 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-607c3cd3-60ec-4497-a217-8b6a396bdba5 tempest-HostsAdminTestJSON-787949312 tempest-HostsAdminTestJSON-787949312-project-admin] Calling method '.version_select at 0x7f7d44279d30>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:22.148947 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-607c3cd3-60ec-4497-a217-8b6a396bdba5 tempest-HostsAdminTestJSON-787949312 tempest-HostsAdminTestJSON-787949312-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:22.149532 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-607c3cd3-60ec-4497-a217-8b6a396bdba5 tempest-HostsAdminTestJSON-787949312 tempest-HostsAdminTestJSON-787949312-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:22.150838 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-607c3cd3-60ec-4497-a217-8b6a396bdba5 tempest-HostsAdminTestJSON-787949312 tempest-HostsAdminTestJSON-787949312-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:22.151794 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-607c3cd3-60ec-4497-a217-8b6a396bdba5 tempest-HostsAdminTestJSON-787949312 tempest-HostsAdminTestJSON-787949312-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:22.152505 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-607c3cd3-60ec-4497-a217-8b6a396bdba5 tempest-HostsAdminTestJSON-787949312 tempest-HostsAdminTestJSON-787949312-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:22.153051 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-607c3cd3-60ec-4497-a217-8b6a396bdba5 tempest-HostsAdminTestJSON-787949312 tempest-HostsAdminTestJSON-787949312-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:22.182768 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-607c3cd3-60ec-4497-a217-8b6a396bdba5 tempest-HostsAdminTestJSON-787949312 tempest-HostsAdminTestJSON-787949312-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.174658 Sep 14 08:53:22.183748 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 638/1264] 10.222.0.60 () {58 vars in 1128 bytes} [Wed Sep 14 08:53:22 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 08:53:22.195254 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-0dc770d9-bfd8-44cd-948d-6b45f4269643 tempest-HostsAdminTestJSON-787949312 tempest-HostsAdminTestJSON-787949312-project-admin] Calling method '.version_select at 0x7f7d44668a60>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:22.198841 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0dc770d9-bfd8-44cd-948d-6b45f4269643 tempest-HostsAdminTestJSON-787949312 tempest-HostsAdminTestJSON-787949312-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:22.199430 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0dc770d9-bfd8-44cd-948d-6b45f4269643 tempest-HostsAdminTestJSON-787949312 tempest-HostsAdminTestJSON-787949312-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:22.199948 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0dc770d9-bfd8-44cd-948d-6b45f4269643 tempest-HostsAdminTestJSON-787949312 tempest-HostsAdminTestJSON-787949312-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:22.200754 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0dc770d9-bfd8-44cd-948d-6b45f4269643 tempest-HostsAdminTestJSON-787949312 tempest-HostsAdminTestJSON-787949312-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:22.201287 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0dc770d9-bfd8-44cd-948d-6b45f4269643 tempest-HostsAdminTestJSON-787949312 tempest-HostsAdminTestJSON-787949312-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:22.201785 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0dc770d9-bfd8-44cd-948d-6b45f4269643 tempest-HostsAdminTestJSON-787949312 tempest-HostsAdminTestJSON-787949312-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:22.226719 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-0dc770d9-bfd8-44cd-948d-6b45f4269643 tempest-HostsAdminTestJSON-787949312 tempest-HostsAdminTestJSON-787949312-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 381 microversion: 2.1 time: 0.035233 Sep 14 08:53:22.227580 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 639/1265] 10.222.0.60 () {58 vars in 1139 bytes} [Wed Sep 14 08:53:22 2022] GET /compute/v2.1/os-hosts?zone= => generated 381 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:53:22.240790 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-1837749a-077b-44d0-80c7-f124d4cf03fa tempest-HostsAdminTestJSON-787949312 tempest-HostsAdminTestJSON-787949312-project-admin] Calling method '.version_select at 0x7f7d44233280>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:22.244568 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1837749a-077b-44d0-80c7-f124d4cf03fa tempest-HostsAdminTestJSON-787949312 tempest-HostsAdminTestJSON-787949312-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:22.245403 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1837749a-077b-44d0-80c7-f124d4cf03fa tempest-HostsAdminTestJSON-787949312 tempest-HostsAdminTestJSON-787949312-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:22.245839 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1837749a-077b-44d0-80c7-f124d4cf03fa tempest-HostsAdminTestJSON-787949312 tempest-HostsAdminTestJSON-787949312-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:22.246824 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1837749a-077b-44d0-80c7-f124d4cf03fa tempest-HostsAdminTestJSON-787949312 tempest-HostsAdminTestJSON-787949312-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:22.247315 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1837749a-077b-44d0-80c7-f124d4cf03fa tempest-HostsAdminTestJSON-787949312 tempest-HostsAdminTestJSON-787949312-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:22.248685 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1837749a-077b-44d0-80c7-f124d4cf03fa tempest-HostsAdminTestJSON-787949312 tempest-HostsAdminTestJSON-787949312-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:22.276019 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-1837749a-077b-44d0-80c7-f124d4cf03fa tempest-HostsAdminTestJSON-787949312 tempest-HostsAdminTestJSON-787949312-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.040625 Sep 14 08:53:22.276630 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 640/1266] 10.222.0.60 () {58 vars in 1145 bytes} [Wed Sep 14 08:53:22 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 08:53:22.289338 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-52601ca4-a570-4de8-9eba-5dfa74bafbcb tempest-HostsAdminTestJSON-787949312 tempest-HostsAdminTestJSON-787949312-project-admin] Calling method '.version_select at 0x7f7d442e3a60>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:22.293039 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-52601ca4-a570-4de8-9eba-5dfa74bafbcb tempest-HostsAdminTestJSON-787949312 tempest-HostsAdminTestJSON-787949312-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:22.293532 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-52601ca4-a570-4de8-9eba-5dfa74bafbcb tempest-HostsAdminTestJSON-787949312 tempest-HostsAdminTestJSON-787949312-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:22.294301 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-52601ca4-a570-4de8-9eba-5dfa74bafbcb tempest-HostsAdminTestJSON-787949312 tempest-HostsAdminTestJSON-787949312-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:22.295259 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-52601ca4-a570-4de8-9eba-5dfa74bafbcb tempest-HostsAdminTestJSON-787949312 tempest-HostsAdminTestJSON-787949312-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:22.295720 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-52601ca4-a570-4de8-9eba-5dfa74bafbcb tempest-HostsAdminTestJSON-787949312 tempest-HostsAdminTestJSON-787949312-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:22.296148 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-52601ca4-a570-4de8-9eba-5dfa74bafbcb tempest-HostsAdminTestJSON-787949312 tempest-HostsAdminTestJSON-787949312-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:22.321422 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-52601ca4-a570-4de8-9eba-5dfa74bafbcb tempest-HostsAdminTestJSON-787949312 tempest-HostsAdminTestJSON-787949312-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.036414 Sep 14 08:53:22.322989 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 641/1267] 10.222.0.60 () {58 vars in 1128 bytes} [Wed Sep 14 08:53:22 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:53:22.332459 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-2136a4fa-2fc8-4f8e-9b97-fa178276c560 tempest-HostsAdminTestJSON-787949312 tempest-HostsAdminTestJSON-787949312-project-admin] Calling method '.version_select at 0x7f7d442743a0>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:22.336673 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2136a4fa-2fc8-4f8e-9b97-fa178276c560 tempest-HostsAdminTestJSON-787949312 tempest-HostsAdminTestJSON-787949312-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:22.337160 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2136a4fa-2fc8-4f8e-9b97-fa178276c560 tempest-HostsAdminTestJSON-787949312 tempest-HostsAdminTestJSON-787949312-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:22.337595 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2136a4fa-2fc8-4f8e-9b97-fa178276c560 tempest-HostsAdminTestJSON-787949312 tempest-HostsAdminTestJSON-787949312-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:22.338321 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2136a4fa-2fc8-4f8e-9b97-fa178276c560 tempest-HostsAdminTestJSON-787949312 tempest-HostsAdminTestJSON-787949312-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:22.338776 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2136a4fa-2fc8-4f8e-9b97-fa178276c560 tempest-HostsAdminTestJSON-787949312 tempest-HostsAdminTestJSON-787949312-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:22.339219 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2136a4fa-2fc8-4f8e-9b97-fa178276c560 tempest-HostsAdminTestJSON-787949312 tempest-HostsAdminTestJSON-787949312-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:22.365745 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-2136a4fa-2fc8-4f8e-9b97-fa178276c560 tempest-HostsAdminTestJSON-787949312 tempest-HostsAdminTestJSON-787949312-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 239 microversion: 2.1 time: 0.036638 Sep 14 08:53:22.366300 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 642/1268] 10.222.0.60 () {58 vars in 1155 bytes} [Wed Sep 14 08:53:22 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 239 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 08:53:22.372716 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-12ea6b51-9ca0-4700-af57-c301c84d62f3 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ace9012a7c4ce59c01858b6984b766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a87a909133e42e1a82e3a623536935c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:22.379735 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-313e8348-a58d-418b-98fe-b1afac235608 tempest-HostsAdminTestJSON-787949312 tempest-HostsAdminTestJSON-787949312-project-admin] Calling method '.version_select at 0x7f7d443011f0>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:22.382851 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-12ea6b51-9ca0-4700-af57-c301c84d62f3 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] 10.222.0.60 "GET /compute/v2.1/servers/67f3a983-b33f-49c8-9c91-988e8553563c" status: 200 len: 1527 microversion: 2.1 time: 0.261585 Sep 14 08:53:22.383478 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 627/1269] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:22 2022] GET /compute/v2.1/servers/67f3a983-b33f-49c8-9c91-988e8553563c => generated 1527 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:53:22.384624 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-313e8348-a58d-418b-98fe-b1afac235608 tempest-HostsAdminTestJSON-787949312 tempest-HostsAdminTestJSON-787949312-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:22.385267 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-313e8348-a58d-418b-98fe-b1afac235608 tempest-HostsAdminTestJSON-787949312 tempest-HostsAdminTestJSON-787949312-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:22.385873 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-313e8348-a58d-418b-98fe-b1afac235608 tempest-HostsAdminTestJSON-787949312 tempest-HostsAdminTestJSON-787949312-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:22.386771 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-313e8348-a58d-418b-98fe-b1afac235608 tempest-HostsAdminTestJSON-787949312 tempest-HostsAdminTestJSON-787949312-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:22.387412 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-313e8348-a58d-418b-98fe-b1afac235608 tempest-HostsAdminTestJSON-787949312 tempest-HostsAdminTestJSON-787949312-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:22.387837 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-313e8348-a58d-418b-98fe-b1afac235608 tempest-HostsAdminTestJSON-787949312 tempest-HostsAdminTestJSON-787949312-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:22.413447 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-313e8348-a58d-418b-98fe-b1afac235608 tempest-HostsAdminTestJSON-787949312 tempest-HostsAdminTestJSON-787949312-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.039330 Sep 14 08:53:22.414629 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 643/1270] 10.222.0.60 () {58 vars in 1128 bytes} [Wed Sep 14 08:53:22 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 08:53:22.425584 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-31b40013-700d-49d8-a24a-98776b59f823 tempest-HostsAdminTestJSON-787949312 tempest-HostsAdminTestJSON-787949312-project-admin] Calling method '.version_select at 0x7f7d444783a0>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:22.433393 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-31b40013-700d-49d8-a24a-98776b59f823 tempest-HostsAdminTestJSON-787949312 tempest-HostsAdminTestJSON-787949312-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:22.434278 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-31b40013-700d-49d8-a24a-98776b59f823 tempest-HostsAdminTestJSON-787949312 tempest-HostsAdminTestJSON-787949312-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:22.434794 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-31b40013-700d-49d8-a24a-98776b59f823 tempest-HostsAdminTestJSON-787949312 tempest-HostsAdminTestJSON-787949312-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:22.455272 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-31b40013-700d-49d8-a24a-98776b59f823 tempest-HostsAdminTestJSON-787949312 tempest-HostsAdminTestJSON-787949312-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:22.456026 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-31b40013-700d-49d8-a24a-98776b59f823 tempest-HostsAdminTestJSON-787949312 tempest-HostsAdminTestJSON-787949312-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:22.457122 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-31b40013-700d-49d8-a24a-98776b59f823 tempest-HostsAdminTestJSON-787949312 tempest-HostsAdminTestJSON-787949312-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:22.485797 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-7c3df796-420a-4325-ad67-81f46914f6b5 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:22.486422 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-7c3df796-420a-4325-ad67-81f46914f6b5 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: 1b2a9a93-cad5-4b18-abc3-1b88413f88da] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:22.493287 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7c3df796-420a-4325-ad67-81f46914f6b5 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:22.494405 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7c3df796-420a-4325-ad67-81f46914f6b5 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:22.495143 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7c3df796-420a-4325-ad67-81f46914f6b5 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:22.496283 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7c3df796-420a-4325-ad67-81f46914f6b5 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:22.496972 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7c3df796-420a-4325-ad67-81f46914f6b5 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:22.497755 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7c3df796-420a-4325-ad67-81f46914f6b5 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:22.498109 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-31b40013-700d-49d8-a24a-98776b59f823 tempest-HostsAdminTestJSON-787949312 tempest-HostsAdminTestJSON-787949312-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hosts/n-h2-836830-18" status: 200 len: 867 microversion: 2.1 time: 0.076743 Sep 14 08:53:22.498889 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 628/1271] 10.222.0.60 () {58 vars in 1173 bytes} [Wed Sep 14 08:53:22 2022] GET /compute/v2.1/os-hosts/n-h2-836830-18 => generated 867 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 08:53:22.510482 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d70e92e0-0958-4ea6-b986-2241bdf81847 tempest-HostsAdminTestJSON-787949312 tempest-HostsAdminTestJSON-787949312-project-admin] Calling method '.version_select at 0x7f7d443fc8b0>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:22.534227 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d70e92e0-0958-4ea6-b986-2241bdf81847 tempest-HostsAdminTestJSON-787949312 tempest-HostsAdminTestJSON-787949312-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:22.534896 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d70e92e0-0958-4ea6-b986-2241bdf81847 tempest-HostsAdminTestJSON-787949312 tempest-HostsAdminTestJSON-787949312-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:22.535350 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d70e92e0-0958-4ea6-b986-2241bdf81847 tempest-HostsAdminTestJSON-787949312 tempest-HostsAdminTestJSON-787949312-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:22.552741 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d70e92e0-0958-4ea6-b986-2241bdf81847 tempest-HostsAdminTestJSON-787949312 tempest-HostsAdminTestJSON-787949312-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:22.553385 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d70e92e0-0958-4ea6-b986-2241bdf81847 tempest-HostsAdminTestJSON-787949312 tempest-HostsAdminTestJSON-787949312-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:22.553859 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d70e92e0-0958-4ea6-b986-2241bdf81847 tempest-HostsAdminTestJSON-787949312 tempest-HostsAdminTestJSON-787949312-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:22.586564 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-d70e92e0-0958-4ea6-b986-2241bdf81847 tempest-HostsAdminTestJSON-787949312 tempest-HostsAdminTestJSON-787949312-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hosts/n-h1-836830-18" status: 200 len: 1131 microversion: 2.1 time: 0.080188 Sep 14 08:53:22.587652 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 629/1272] 10.222.0.60 () {58 vars in 1173 bytes} [Wed Sep 14 08:53:22 2022] GET /compute/v2.1/os-hosts/n-h1-836830-18 => generated 1131 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:53:22.592456 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-df16a611-fee7-4bce-8ff1-0a424bf941ab req-a435436c-edf1-4515-bc4b-434723f45ed6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67f3a983-b33f-49c8-9c91-988e8553563c", "name": "network-vif-deleted", "tag": "07668b52-5928-40b0-b852-24d2a561fd3d"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:53:22.607107 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-df16a611-fee7-4bce-8ff1-0a424bf941ab req-a435436c-edf1-4515-bc4b-434723f45ed6 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:22.607656 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-df16a611-fee7-4bce-8ff1-0a424bf941ab req-a435436c-edf1-4515-bc4b-434723f45ed6 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:22.608086 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-df16a611-fee7-4bce-8ff1-0a424bf941ab req-a435436c-edf1-4515-bc4b-434723f45ed6 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:22.612293 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:53:22.620348 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-df16a611-fee7-4bce-8ff1-0a424bf941ab req-a435436c-edf1-4515-bc4b-434723f45ed6 service nova] Creating event network-vif-deleted:07668b52-5928-40b0-b852-24d2a561fd3d for instance 67f3a983-b33f-49c8-9c91-988e8553563c on n-h1-836830-18 Sep 14 08:53:22.625712 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-df16a611-fee7-4bce-8ff1-0a424bf941ab req-a435436c-edf1-4515-bc4b-434723f45ed6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036481 Sep 14 08:53:22.626435 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 630/1273] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:53:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:53:22.680919 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-7c3df796-420a-4325-ad67-81f46914f6b5 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:22.690197 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-7c3df796-420a-4325-ad67-81f46914f6b5 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/1b2a9a93-cad5-4b18-abc3-1b88413f88da" status: 200 len: 1475 microversion: 2.1 time: 0.208412 Sep 14 08:53:22.690787 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 644/1274] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:22 2022] GET /compute/v2.1/servers/1b2a9a93-cad5-4b18-abc3-1b88413f88da => generated 1475 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:53:22.790852 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-6f6382dd-6278-40cb-a303-13a39a380116 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:22.791813 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-6f6382dd-6278-40cb-a303-13a39a380116 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] [instance: 43730a9e-d747-4589-863f-a1c68e14b2a7] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:22.798446 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6f6382dd-6278-40cb-a303-13a39a380116 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:22.798929 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6f6382dd-6278-40cb-a303-13a39a380116 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:22.799386 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6f6382dd-6278-40cb-a303-13a39a380116 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:22.800075 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6f6382dd-6278-40cb-a303-13a39a380116 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:22.800524 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6f6382dd-6278-40cb-a303-13a39a380116 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:22.800941 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6f6382dd-6278-40cb-a303-13a39a380116 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:23.009659 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-6f6382dd-6278-40cb-a303-13a39a380116 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa9e50aadef494c8f72ccf88bdc5dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ffed678f9684721b3342a11fa885200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:23.019474 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-6f6382dd-6278-40cb-a303-13a39a380116 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] 10.222.0.60 "GET /compute/v2.1/servers/43730a9e-d747-4589-863f-a1c68e14b2a7" status: 200 len: 1470 microversion: 2.1 time: 0.233420 Sep 14 08:53:23.020712 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 631/1275] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:22 2022] GET /compute/v2.1/servers/43730a9e-d747-4589-863f-a1c68e14b2a7 => generated 1470 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:53:23.079709 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3e94ce58-66a5-4730-a413-37117395ac92 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:23.080360 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-3e94ce58-66a5-4730-a413-37117395ac92 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] [instance: 4ea5843e-ecf7-4b84-80cb-3f05b2b20982] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:23.087896 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3e94ce58-66a5-4730-a413-37117395ac92 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:23.088397 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3e94ce58-66a5-4730-a413-37117395ac92 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:23.088827 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3e94ce58-66a5-4730-a413-37117395ac92 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:23.089698 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3e94ce58-66a5-4730-a413-37117395ac92 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:23.090319 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3e94ce58-66a5-4730-a413-37117395ac92 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:23.090751 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3e94ce58-66a5-4730-a413-37117395ac92 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:23.178011 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-3e94ce58-66a5-4730-a413-37117395ac92 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810376d6f0b4329abe0f8f79800b754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575684f36f9c4019926fc83541e152c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:23.187557 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-3e94ce58-66a5-4730-a413-37117395ac92 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] 10.222.0.60 "GET /compute/v2.1/servers/4ea5843e-ecf7-4b84-80cb-3f05b2b20982" status: 200 len: 1238 microversion: 2.1 time: 0.111729 Sep 14 08:53:23.188157 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 645/1276] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:23 2022] GET /compute/v2.1/servers/4ea5843e-ecf7-4b84-80cb-3f05b2b20982 => generated 1238 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:53:23.407630 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-5e769ecf-50a8-4f05-a4a8-2fc83fa76c6f tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:23.408752 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-5e769ecf-50a8-4f05-a4a8-2fc83fa76c6f tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] [instance: 67f3a983-b33f-49c8-9c91-988e8553563c] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:23.417502 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5e769ecf-50a8-4f05-a4a8-2fc83fa76c6f tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:23.418178 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5e769ecf-50a8-4f05-a4a8-2fc83fa76c6f tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:23.418783 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5e769ecf-50a8-4f05-a4a8-2fc83fa76c6f tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:23.419984 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5e769ecf-50a8-4f05-a4a8-2fc83fa76c6f tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:23.420742 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5e769ecf-50a8-4f05-a4a8-2fc83fa76c6f tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:23.421391 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5e769ecf-50a8-4f05-a4a8-2fc83fa76c6f tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:23.480260 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5e769ecf-50a8-4f05-a4a8-2fc83fa76c6f tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:23.480867 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5e769ecf-50a8-4f05-a4a8-2fc83fa76c6f tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:23.481312 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5e769ecf-50a8-4f05-a4a8-2fc83fa76c6f tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:23.481954 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.objects.instance [None req-5e769ecf-50a8-4f05-a4a8-2fc83fa76c6f tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lazy-loading 'fault' on Instance uuid 67f3a983-b33f-49c8-9c91-988e8553563c {{(pid=128758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 08:53:23.581543 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-5e769ecf-50a8-4f05-a4a8-2fc83fa76c6f tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ace9012a7c4ce59c01858b6984b766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a87a909133e42e1a82e3a623536935c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:23.590230 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-5e769ecf-50a8-4f05-a4a8-2fc83fa76c6f tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] 10.222.0.60 "GET /compute/v2.1/servers/67f3a983-b33f-49c8-9c91-988e8553563c" status: 200 len: 1314 microversion: 2.1 time: 0.187176 Sep 14 08:53:23.591049 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 632/1277] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:23 2022] GET /compute/v2.1/servers/67f3a983-b33f-49c8-9c91-988e8553563c => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:53:23.717977 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-6dba9895-5103-492f-aa66-1af227671155 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:23.718980 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-6dba9895-5103-492f-aa66-1af227671155 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: 1b2a9a93-cad5-4b18-abc3-1b88413f88da] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:23.727611 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6dba9895-5103-492f-aa66-1af227671155 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:23.728461 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6dba9895-5103-492f-aa66-1af227671155 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:23.729133 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6dba9895-5103-492f-aa66-1af227671155 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:23.730179 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6dba9895-5103-492f-aa66-1af227671155 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:23.765355 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6dba9895-5103-492f-aa66-1af227671155 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.035s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:23.769759 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6dba9895-5103-492f-aa66-1af227671155 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:24.044314 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-e9bc521a-6853-4e9e-9601-4f40b9741ac0 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:24.045027 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-e9bc521a-6853-4e9e-9601-4f40b9741ac0 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] [instance: 43730a9e-d747-4589-863f-a1c68e14b2a7] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:24.080126 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e9bc521a-6853-4e9e-9601-4f40b9741ac0 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:24.081880 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e9bc521a-6853-4e9e-9601-4f40b9741ac0 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:24.084243 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e9bc521a-6853-4e9e-9601-4f40b9741ac0 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:24.085287 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e9bc521a-6853-4e9e-9601-4f40b9741ac0 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:24.091752 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e9bc521a-6853-4e9e-9601-4f40b9741ac0 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:24.095377 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e9bc521a-6853-4e9e-9601-4f40b9741ac0 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:24.186408 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-6dba9895-5103-492f-aa66-1af227671155 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:24.196265 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e9bc521a-6853-4e9e-9601-4f40b9741ac0 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:24.198184 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-6dba9895-5103-492f-aa66-1af227671155 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/1b2a9a93-cad5-4b18-abc3-1b88413f88da" status: 200 len: 1475 microversion: 2.1 time: 0.486985 Sep 14 08:53:24.198692 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e9bc521a-6853-4e9e-9601-4f40b9741ac0 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:24.199171 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e9bc521a-6853-4e9e-9601-4f40b9741ac0 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:24.200808 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.objects.instance [None req-e9bc521a-6853-4e9e-9601-4f40b9741ac0 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Lazy-loading 'fault' on Instance uuid 43730a9e-d747-4589-863f-a1c68e14b2a7 {{(pid=128758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 08:53:24.201139 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 646/1278] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:23 2022] GET /compute/v2.1/servers/1b2a9a93-cad5-4b18-abc3-1b88413f88da => generated 1475 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:53:24.220320 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b3d5443f-a1bf-4a6a-b98b-648933a5f37d tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:24.223362 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b3d5443f-a1bf-4a6a-b98b-648933a5f37d tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] [instance: 4ea5843e-ecf7-4b84-80cb-3f05b2b20982] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:24.260040 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b3d5443f-a1bf-4a6a-b98b-648933a5f37d tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:24.260900 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b3d5443f-a1bf-4a6a-b98b-648933a5f37d tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:24.261992 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b3d5443f-a1bf-4a6a-b98b-648933a5f37d tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:24.265718 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b3d5443f-a1bf-4a6a-b98b-648933a5f37d tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:24.266130 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b3d5443f-a1bf-4a6a-b98b-648933a5f37d tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:24.266583 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b3d5443f-a1bf-4a6a-b98b-648933a5f37d tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:24.285728 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:53:24.320756 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-e9bc521a-6853-4e9e-9601-4f40b9741ac0 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa9e50aadef494c8f72ccf88bdc5dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ffed678f9684721b3342a11fa885200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:24.336871 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-e9bc521a-6853-4e9e-9601-4f40b9741ac0 tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] 10.222.0.60 "GET /compute/v2.1/servers/43730a9e-d747-4589-863f-a1c68e14b2a7" status: 200 len: 1304 microversion: 2.1 time: 0.297339 Sep 14 08:53:24.352532 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 633/1279] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:24 2022] GET /compute/v2.1/servers/43730a9e-d747-4589-863f-a1c68e14b2a7 => generated 1304 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:53:24.561714 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b3d5443f-a1bf-4a6a-b98b-648933a5f37d tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810376d6f0b4329abe0f8f79800b754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575684f36f9c4019926fc83541e152c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:24.581233 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b3d5443f-a1bf-4a6a-b98b-648933a5f37d tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] 10.222.0.60 "GET /compute/v2.1/servers/4ea5843e-ecf7-4b84-80cb-3f05b2b20982" status: 200 len: 1305 microversion: 2.1 time: 0.374296 Sep 14 08:53:24.590536 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 647/1280] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:24 2022] GET /compute/v2.1/servers/4ea5843e-ecf7-4b84-80cb-3f05b2b20982 => generated 1305 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:53:24.613937 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-3dde37ca-f47a-46b3-a2b4-41b9fcbaf1c3 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:24.615432 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-3dde37ca-f47a-46b3-a2b4-41b9fcbaf1c3 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] [instance: 67f3a983-b33f-49c8-9c91-988e8553563c] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:24.623148 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3dde37ca-f47a-46b3-a2b4-41b9fcbaf1c3 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:24.624091 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3dde37ca-f47a-46b3-a2b4-41b9fcbaf1c3 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:24.625320 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3dde37ca-f47a-46b3-a2b4-41b9fcbaf1c3 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:24.626564 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3dde37ca-f47a-46b3-a2b4-41b9fcbaf1c3 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:24.627363 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3dde37ca-f47a-46b3-a2b4-41b9fcbaf1c3 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:24.628031 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3dde37ca-f47a-46b3-a2b4-41b9fcbaf1c3 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:24.650327 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-3dde37ca-f47a-46b3-a2b4-41b9fcbaf1c3 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] HTTP exception thrown: Instance 67f3a983-b33f-49c8-9c91-988e8553563c could not be found. Sep 14 08:53:24.652487 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-3dde37ca-f47a-46b3-a2b4-41b9fcbaf1c3 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Request method failure captured: Sep 14 08:53:24.652487 n-d-836830-18 devstack@n-api.service[128758]: request: GET /compute/v2.1/servers/67f3a983-b33f-49c8-9c91-988e8553563c HTTP/1.1 Sep 14 08:53:24.652487 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 08:53:24.652487 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 08:53:24.652487 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 08:53:24.652487 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 08:53:24.652487 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 08:53:24.652487 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 08:53:24.652487 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 08:53:24.652487 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 08:53:24.652487 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZZS4Po83Aovv_U3RdkjXLQKweaQf-fhAgT61i_A11uamuOl6sYuSjebIurWFthtZrzpGvY9uLyOeI1i9q8ClJm3kMoDWgYaqbwGjdZ-I8VmC2NF95wjpQldZSAgTTLlPF11CuzqbhW26YYuwljJxckz8_fE9N_t89yQzibByeeP394 Sep 14 08:53:24.652487 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 08:53:24.652487 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 08:53:24.652487 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 08:53:24.652487 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 08:53:24.652487 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 08:53:24.652487 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 08:53:24.652487 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 0a87a909133e42e1a82e3a623536935c Sep 14 08:53:24.652487 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1646226177 Sep 14 08:53:24.652487 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 08:53:24.652487 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 08:53:24.653937 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0a87a909133e42e1a82e3a623536935c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0a87a909133e42e1a82e3a623536935c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0a87a909133e42e1a82e3a623536935c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0a87a909133e42e1a82e3a623536935c"}]}] Sep 14 08:53:24.653937 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1646226177 Sep 14 08:53:24.653937 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 0a87a909133e42e1a82e3a623536935c Sep 14 08:53:24.653937 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1646226177 Sep 14 08:53:24.653937 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-ImagesOneServerNegativeTestJSON-1646226177-project Sep 14 08:53:24.653937 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 08:53:24.653937 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 08:53:24.653937 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: a3ace9012a7c4ce59c01858b6984b766 Sep 14 08:53:24.653937 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1646226177-project Sep 14 08:53:24.653937 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 08:53:24.653937 n-d-836830-18 devstack@n-api.service[128758]: exception: Instance 67f3a983-b33f-49c8-9c91-988e8553563c could not be found. Sep 14 08:53:24.653937 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': '67f3a983-b33f-49c8-9c91-988e8553563c'} Sep 14 08:53:24.654784 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:53:24.654784 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:53:24.654784 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 08:53:24.654784 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 08:53:24.654784 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 08:53:24.654784 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 08:53:24.654784 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 08:53:24.654784 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 08:53:24.654784 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 08:53:24.654784 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 08:53:24.654784 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67f3a983-b33f-49c8-9c91-988e8553563c could not be found. Sep 14 08:53:24.654784 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:53:24.654784 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:53:24.654784 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:53:24.654784 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:53:24.654784 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:53:24.654784 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:53:24.654784 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:53:24.654784 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:53:24.654784 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:53:24.656217 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:53:24.656217 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 08:53:24.656217 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 08:53:24.656217 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 08:53:24.656217 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 08:53:24.656217 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 08:53:24.656217 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 08:53:24.656217 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67f3a983-b33f-49c8-9c91-988e8553563c could not be found. Sep 14 08:53:24.656217 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:53:24.656217 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:53:24.656217 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:53:24.656217 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:53:24.656217 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:53:24.656217 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:53:24.656217 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:53:24.656217 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:53:24.656217 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67f3a983-b33f-49c8-9c91-988e8553563c could not be found. Sep 14 08:53:24.656217 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:53:24.658066 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-215cfee0-85b8-48f8-af5c-48b01ad21a82 req-29e5ed75-4bc8-4357-8d98-e715c606ab98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43730a9e-d747-4589-863f-a1c68e14b2a7", "name": "network-vif-deleted", "tag": "0c78838d-0a7a-4e27-9dab-7b72a94dd866"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:53:24.659385 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-3dde37ca-f47a-46b3-a2b4-41b9fcbaf1c3 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Returning 404 to user: Instance 67f3a983-b33f-49c8-9c91-988e8553563c could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:53:24.660660 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-3dde37ca-f47a-46b3-a2b4-41b9fcbaf1c3 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] 10.222.0.60 "GET /compute/v2.1/servers/67f3a983-b33f-49c8-9c91-988e8553563c" status: 404 len: 111 microversion: 2.1 time: 0.050751 Sep 14 08:53:24.669343 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 634/1281] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:24 2022] GET /compute/v2.1/servers/67f3a983-b33f-49c8-9c91-988e8553563c => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 08:53:24.674224 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-215cfee0-85b8-48f8-af5c-48b01ad21a82 req-29e5ed75-4bc8-4357-8d98-e715c606ab98 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:24.675392 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1b8fd27e-0d49-445a-b9b1-953b539c4465 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Action: 'create', calling method: .version_select at 0x7f7d44418af0>, body: {"keypair": {"name": "tempest-keypair-1365607731", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI+dOPdTnaZaDfZ+iO3T4uaIpH7HZBwpDnFy5L9QDMi31CwXriOTUQGYMXyOB91HCf7PUkUN79wxeFddYE2X/zZ6Xzm5iBVpXpNWYCrmLUpXldC0V7+2Qnti1tHWw/hGPw=="}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:53:24.676590 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-215cfee0-85b8-48f8-af5c-48b01ad21a82 req-29e5ed75-4bc8-4357-8d98-e715c606ab98 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:24.677048 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-215cfee0-85b8-48f8-af5c-48b01ad21a82 req-29e5ed75-4bc8-4357-8d98-e715c606ab98 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:24.696389 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-1b8fd27e-0d49-445a-b9b1-953b539c4465 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Getting quotas for project 0a87a909133e42e1a82e3a623536935c. Resources: {'key_pairs'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 08:53:24.703558 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-1b8fd27e-0d49-445a-b9b1-953b539c4465 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Getting quotas for user a3ace9012a7c4ce59c01858b6984b766 and project 0a87a909133e42e1a82e3a623536935c. Resources: {'key_pairs'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 08:53:24.710095 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-215cfee0-85b8-48f8-af5c-48b01ad21a82 req-29e5ed75-4bc8-4357-8d98-e715c606ab98 service nova] Creating event network-vif-deleted:0c78838d-0a7a-4e27-9dab-7b72a94dd866 for instance 43730a9e-d747-4589-863f-a1c68e14b2a7 on n-h2-836830-18 Sep 14 08:53:24.723278 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-215cfee0-85b8-48f8-af5c-48b01ad21a82 req-29e5ed75-4bc8-4357-8d98-e715c606ab98 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067860 Sep 14 08:53:24.726451 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 648/1282] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:53:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 08:53:24.737694 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-1b8fd27e-0d49-445a-b9b1-953b539c4465 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.066908 Sep 14 08:53:24.746314 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 635/1283] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Sep 14 08:53:24 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:53:25.370731 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-4b4ccc74-edb7-4bb8-bc18-ce8a121d53ef tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:25.377365 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-4b4ccc74-edb7-4bb8-bc18-ce8a121d53ef tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] [instance: 43730a9e-d747-4589-863f-a1c68e14b2a7] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:25.387223 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4b4ccc74-edb7-4bb8-bc18-ce8a121d53ef tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:25.388109 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4b4ccc74-edb7-4bb8-bc18-ce8a121d53ef tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:25.388854 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4b4ccc74-edb7-4bb8-bc18-ce8a121d53ef tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:25.389874 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4b4ccc74-edb7-4bb8-bc18-ce8a121d53ef tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:25.390594 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4b4ccc74-edb7-4bb8-bc18-ce8a121d53ef tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:25.391327 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4b4ccc74-edb7-4bb8-bc18-ce8a121d53ef tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:25.408139 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-4b4ccc74-edb7-4bb8-bc18-ce8a121d53ef tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] HTTP exception thrown: Instance 43730a9e-d747-4589-863f-a1c68e14b2a7 could not be found. Sep 14 08:53:25.410181 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-4b4ccc74-edb7-4bb8-bc18-ce8a121d53ef tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Request method failure captured: Sep 14 08:53:25.410181 n-d-836830-18 devstack@n-api.service[128758]: request: GET /compute/v2.1/servers/43730a9e-d747-4589-863f-a1c68e14b2a7 HTTP/1.1 Sep 14 08:53:25.410181 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 08:53:25.410181 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 08:53:25.410181 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 08:53:25.410181 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 08:53:25.410181 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 08:53:25.410181 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 08:53:25.410181 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 08:53:25.410181 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 08:53:25.410181 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZZxOYITHoX2OSJ2GLTxz5MjyBgrqiMvvvyEKOTVqq31pfsD23LvOt3WC6KBL1kQBceTy60CsiZJjUWza8A0Ev-xly0laPX7xBgBeHNFFuaBiE8c2lLig-Hvozp4U-uBj0EvLyf-eiEaI2Tl8kTUV0fYgZKIZdbFX6yuz1WbwQ67Z6A Sep 14 08:53:25.410181 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 08:53:25.410181 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 08:53:25.410181 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 08:53:25.410181 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 08:53:25.410181 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 08:53:25.410181 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 08:53:25.410181 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 7ffed678f9684721b3342a11fa885200 Sep 14 08:53:25.410181 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-TenantUsagesTestJSON-1807505247 Sep 14 08:53:25.410181 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 08:53:25.410181 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 08:53:25.411641 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/7ffed678f9684721b3342a11fa885200"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_7ffed678f9684721b3342a11fa885200"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/7ffed678f9684721b3342a11fa885200"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/7ffed678f9684721b3342a11fa885200"}]}] Sep 14 08:53:25.411641 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-TenantUsagesTestJSON-1807505247 Sep 14 08:53:25.411641 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 7ffed678f9684721b3342a11fa885200 Sep 14 08:53:25.411641 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-TenantUsagesTestJSON-1807505247 Sep 14 08:53:25.411641 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-TenantUsagesTestJSON-1807505247-project Sep 14 08:53:25.411641 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 08:53:25.411641 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 08:53:25.411641 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: baa9e50aadef494c8f72ccf88bdc5dbd Sep 14 08:53:25.411641 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-TenantUsagesTestJSON-1807505247-project Sep 14 08:53:25.411641 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 08:53:25.411641 n-d-836830-18 devstack@n-api.service[128758]: exception: Instance 43730a9e-d747-4589-863f-a1c68e14b2a7 could not be found. Sep 14 08:53:25.411641 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': '43730a9e-d747-4589-863f-a1c68e14b2a7'} Sep 14 08:53:25.412534 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:53:25.412534 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:53:25.412534 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 08:53:25.412534 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 08:53:25.412534 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 08:53:25.412534 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 08:53:25.412534 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 08:53:25.412534 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 08:53:25.412534 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 08:53:25.412534 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 08:53:25.412534 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43730a9e-d747-4589-863f-a1c68e14b2a7 could not be found. Sep 14 08:53:25.412534 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:53:25.412534 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:53:25.412534 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:53:25.412534 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:53:25.412534 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:53:25.412534 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:53:25.412534 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:53:25.412534 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:53:25.412534 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:53:25.413790 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:53:25.413790 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 08:53:25.413790 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 08:53:25.413790 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 08:53:25.413790 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 08:53:25.413790 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 08:53:25.413790 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 08:53:25.413790 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43730a9e-d747-4589-863f-a1c68e14b2a7 could not be found. Sep 14 08:53:25.413790 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:53:25.413790 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:53:25.413790 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:53:25.413790 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:53:25.413790 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:53:25.413790 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:53:25.413790 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:53:25.413790 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:53:25.413790 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43730a9e-d747-4589-863f-a1c68e14b2a7 could not be found. Sep 14 08:53:25.413790 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:53:25.418877 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-4b4ccc74-edb7-4bb8-bc18-ce8a121d53ef tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] Returning 404 to user: Instance 43730a9e-d747-4589-863f-a1c68e14b2a7 could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:53:25.420072 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-4b4ccc74-edb7-4bb8-bc18-ce8a121d53ef tempest-TenantUsagesTestJSON-1807505247 tempest-TenantUsagesTestJSON-1807505247-project] 10.222.0.60 "GET /compute/v2.1/servers/43730a9e-d747-4589-863f-a1c68e14b2a7" status: 404 len: 111 microversion: 2.1 time: 0.059010 Sep 14 08:53:25.425497 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 636/1284] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:25 2022] GET /compute/v2.1/servers/43730a9e-d747-4589-863f-a1c68e14b2a7 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 14 08:53:25.608490 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c3d315ac-5192-4db4-b000-a3c865ab4aaa tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:25.609203 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-c3d315ac-5192-4db4-b000-a3c865ab4aaa tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] [instance: 4ea5843e-ecf7-4b84-80cb-3f05b2b20982] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:25.626694 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c3d315ac-5192-4db4-b000-a3c865ab4aaa tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:25.627268 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c3d315ac-5192-4db4-b000-a3c865ab4aaa tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:25.627836 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c3d315ac-5192-4db4-b000-a3c865ab4aaa tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:25.628627 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c3d315ac-5192-4db4-b000-a3c865ab4aaa tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:25.629155 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c3d315ac-5192-4db4-b000-a3c865ab4aaa tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:25.630354 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c3d315ac-5192-4db4-b000-a3c865ab4aaa tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:25.685928 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c95ad681-5e61-41fc-b95d-9db9910636aa tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:25.686668 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-c95ad681-5e61-41fc-b95d-9db9910636aa tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: 1b2a9a93-cad5-4b18-abc3-1b88413f88da] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:25.703144 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c95ad681-5e61-41fc-b95d-9db9910636aa tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:25.703741 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c95ad681-5e61-41fc-b95d-9db9910636aa tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:25.704222 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c95ad681-5e61-41fc-b95d-9db9910636aa tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:25.704968 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c95ad681-5e61-41fc-b95d-9db9910636aa tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:25.711721 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c95ad681-5e61-41fc-b95d-9db9910636aa tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:25.713412 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c95ad681-5e61-41fc-b95d-9db9910636aa tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:25.953745 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-c3d315ac-5192-4db4-b000-a3c865ab4aaa tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810376d6f0b4329abe0f8f79800b754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575684f36f9c4019926fc83541e152c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:25.971824 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-c3d315ac-5192-4db4-b000-a3c865ab4aaa tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] 10.222.0.60 "GET /compute/v2.1/servers/4ea5843e-ecf7-4b84-80cb-3f05b2b20982" status: 200 len: 1305 microversion: 2.1 time: 0.364855 Sep 14 08:53:25.977490 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 637/1285] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:25 2022] GET /compute/v2.1/servers/4ea5843e-ecf7-4b84-80cb-3f05b2b20982 => generated 1305 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:53:25.985988 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-d821ca01-8bce-496d-9e2b-6c31bb07120f req-47843488-a9fb-4855-8e7c-40dfeda52f7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ea5843e-ecf7-4b84-80cb-3f05b2b20982", "tag": "413aded5-fbf0-4893-9752-3f4384abde15"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:53:26.010913 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-d821ca01-8bce-496d-9e2b-6c31bb07120f req-47843488-a9fb-4855-8e7c-40dfeda52f7c service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:26.011432 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-d821ca01-8bce-496d-9e2b-6c31bb07120f req-47843488-a9fb-4855-8e7c-40dfeda52f7c service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:26.011866 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-d821ca01-8bce-496d-9e2b-6c31bb07120f req-47843488-a9fb-4855-8e7c-40dfeda52f7c service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:26.037196 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-d821ca01-8bce-496d-9e2b-6c31bb07120f req-47843488-a9fb-4855-8e7c-40dfeda52f7c service nova] Creating event network-changed:413aded5-fbf0-4893-9752-3f4384abde15 for instance 4ea5843e-ecf7-4b84-80cb-3f05b2b20982 on n-h1-836830-18 Sep 14 08:53:26.045578 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-d821ca01-8bce-496d-9e2b-6c31bb07120f req-47843488-a9fb-4855-8e7c-40dfeda52f7c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064960 Sep 14 08:53:26.046496 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 638/1286] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:53:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:53:26.136747 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-c95ad681-5e61-41fc-b95d-9db9910636aa tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:26.157518 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-c95ad681-5e61-41fc-b95d-9db9910636aa tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/1b2a9a93-cad5-4b18-abc3-1b88413f88da" status: 200 len: 1475 microversion: 2.1 time: 0.932791 Sep 14 08:53:26.158115 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 649/1287] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:25 2022] GET /compute/v2.1/servers/1b2a9a93-cad5-4b18-abc3-1b88413f88da => generated 1475 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:53:27.000354 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-f8f53ec8-7cf2-4725-a4ee-7080ca0a7105 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:27.001133 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-f8f53ec8-7cf2-4725-a4ee-7080ca0a7105 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] [instance: 4ea5843e-ecf7-4b84-80cb-3f05b2b20982] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:27.021654 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f8f53ec8-7cf2-4725-a4ee-7080ca0a7105 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:27.021970 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f8f53ec8-7cf2-4725-a4ee-7080ca0a7105 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:27.022413 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f8f53ec8-7cf2-4725-a4ee-7080ca0a7105 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:27.024102 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f8f53ec8-7cf2-4725-a4ee-7080ca0a7105 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:27.024771 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f8f53ec8-7cf2-4725-a4ee-7080ca0a7105 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:27.025406 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f8f53ec8-7cf2-4725-a4ee-7080ca0a7105 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:27.183572 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f8783f45-510e-4209-abd2-014228f4434f tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:27.184233 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f8783f45-510e-4209-abd2-014228f4434f tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: 1b2a9a93-cad5-4b18-abc3-1b88413f88da] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:27.206438 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f8783f45-510e-4209-abd2-014228f4434f tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:27.213954 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f8783f45-510e-4209-abd2-014228f4434f tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:27.216744 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f8783f45-510e-4209-abd2-014228f4434f tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:27.217557 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f8783f45-510e-4209-abd2-014228f4434f tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:27.221228 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f8783f45-510e-4209-abd2-014228f4434f tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:27.224000 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f8783f45-510e-4209-abd2-014228f4434f tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:27.227601 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-f8f53ec8-7cf2-4725-a4ee-7080ca0a7105 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810376d6f0b4329abe0f8f79800b754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575684f36f9c4019926fc83541e152c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:27.238373 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-f8f53ec8-7cf2-4725-a4ee-7080ca0a7105 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] 10.222.0.60 "GET /compute/v2.1/servers/4ea5843e-ecf7-4b84-80cb-3f05b2b20982" status: 200 len: 1305 microversion: 2.1 time: 0.242623 Sep 14 08:53:27.241741 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 639/1288] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:26 2022] GET /compute/v2.1/servers/4ea5843e-ecf7-4b84-80cb-3f05b2b20982 => generated 1305 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:53:27.266716 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-0d618838-b067-45a3-a937-8870ca65f1e8 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-721823690", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:53:27.405226 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.network.neutron [None req-0d618838-b067-45a3-a937-8870ca65f1e8 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] validate_networks() for [('3aed98a5-2a8d-47be-aa58-f6f22237126d', None, None, None, None, None)] {{(pid=128758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 08:53:27.654813 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f8783f45-510e-4209-abd2-014228f4434f tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:27.672406 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f8783f45-510e-4209-abd2-014228f4434f tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/1b2a9a93-cad5-4b18-abc3-1b88413f88da" status: 200 len: 1475 microversion: 2.1 time: 0.488121 Sep 14 08:53:27.674117 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 650/1289] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:27 2022] GET /compute/v2.1/servers/1b2a9a93-cad5-4b18-abc3-1b88413f88da => generated 1475 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:53:27.691443 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-6b9f86c1-f786-4742-822f-0060183069da tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:27.694982 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-6b9f86c1-f786-4742-822f-0060183069da tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] [instance: 8fce8438-d6ae-408d-8b4f-ee14d4021fdd] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:27.711342 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6b9f86c1-f786-4742-822f-0060183069da tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:27.712228 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6b9f86c1-f786-4742-822f-0060183069da tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:27.714102 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6b9f86c1-f786-4742-822f-0060183069da tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:27.717209 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6b9f86c1-f786-4742-822f-0060183069da tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:27.717966 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6b9f86c1-f786-4742-822f-0060183069da tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:27.719541 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6b9f86c1-f786-4742-822f-0060183069da tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:28.087826 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.objects.instance [None req-6b9f86c1-f786-4742-822f-0060183069da tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Lazy-loading 'services' on Instance uuid 8fce8438-d6ae-408d-8b4f-ee14d4021fdd {{(pid=128759) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 08:53:28.101022 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-0d618838-b067-45a3-a937-8870ca65f1e8 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Flavor limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 08:53:28.101711 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-0d618838-b067-45a3-a937-8870ca65f1e8 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Image limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 08:53:28.102499 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-0d618838-b067-45a3-a937-8870ca65f1e8 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Flavor pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 08:53:28.103080 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-0d618838-b067-45a3-a937-8870ca65f1e8 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Image pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 08:53:28.103579 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-0d618838-b067-45a3-a937-8870ca65f1e8 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 08:53:28.114311 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0d618838-b067-45a3-a937-8870ca65f1e8 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:28.114745 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0d618838-b067-45a3-a937-8870ca65f1e8 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:28.115218 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0d618838-b067-45a3-a937-8870ca65f1e8 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:28.116010 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0d618838-b067-45a3-a937-8870ca65f1e8 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:28.116469 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0d618838-b067-45a3-a937-8870ca65f1e8 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:28.116885 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0d618838-b067-45a3-a937-8870ca65f1e8 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:28.126688 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-6b9f86c1-f786-4742-822f-0060183069da tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd" status: 200 len: 2426 microversion: 2.25 time: 0.445393 Sep 14 08:53:28.128183 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 651/1290] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:53:27 2022] GET /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd => generated 2426 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:53:28.129753 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=23 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:53:28.139632 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-0d618838-b067-45a3-a937-8870ca65f1e8 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Getting quotas for project 0a87a909133e42e1a82e3a623536935c. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 08:53:28.146176 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-0d618838-b067-45a3-a937-8870ca65f1e8 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Getting quotas for user a3ace9012a7c4ce59c01858b6984b766 and project 0a87a909133e42e1a82e3a623536935c. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 08:53:28.154180 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3894181f-b8e2-4d40-9c59-8f284417c80b tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-836830-18", "block_migration": "auto"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:53:28.157215 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-3894181f-b8e2-4d40-9c59-8f284417c80b tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] [instance: 8fce8438-d6ae-408d-8b4f-ee14d4021fdd] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:28.160210 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-0d618838-b067-45a3-a937-8870ca65f1e8 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Going to run 1 instances... {{(pid=128758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 08:53:28.162902 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-0d618838-b067-45a3-a937-8870ca65f1e8 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] [instance: feeb311c-8462-4539-bbc8-4120559413cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 08:53:28.175039 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3894181f-b8e2-4d40-9c59-8f284417c80b tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:28.175725 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3894181f-b8e2-4d40-9c59-8f284417c80b tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:28.176790 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3894181f-b8e2-4d40-9c59-8f284417c80b tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:28.178766 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3894181f-b8e2-4d40-9c59-8f284417c80b tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:28.180046 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3894181f-b8e2-4d40-9c59-8f284417c80b tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:28.180621 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3894181f-b8e2-4d40-9c59-8f284417c80b tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:28.217395 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.objects.instance [None req-3894181f-b8e2-4d40-9c59-8f284417c80b tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Lazy-loading 'flavor' on Instance uuid 8fce8438-d6ae-408d-8b4f-ee14d4021fdd {{(pid=128759) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 08:53:28.228663 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-0d618838-b067-45a3-a937-8870ca65f1e8 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.984869 Sep 14 08:53:28.229329 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 640/1291] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 08:53:27 2022] POST /compute/v2.1/servers => generated 383 bytes in 987 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 08:53:28.237575 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-3894181f-b8e2-4d40-9c59-8f284417c80b tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] [instance: 8fce8438-d6ae-408d-8b4f-ee14d4021fdd] Going to try to live migrate instance to n-h1-836830-18 {{(pid=128759) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 14 08:53:28.633491 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b4b5c810-6ce2-4fc3-a883-804eafc6a903 tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-1458800397", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:53:28.710860 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.network.neutron [None req-b4b5c810-6ce2-4fc3-a883-804eafc6a903 tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] validate_networks() for None {{(pid=128758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 08:53:29.309807 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-b4b5c810-6ce2-4fc3-a883-804eafc6a903 tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Flavor limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 08:53:29.310375 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-b4b5c810-6ce2-4fc3-a883-804eafc6a903 tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Image limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 08:53:29.310805 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-b4b5c810-6ce2-4fc3-a883-804eafc6a903 tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Flavor pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 08:53:29.311250 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-b4b5c810-6ce2-4fc3-a883-804eafc6a903 tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Image pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 08:53:29.311667 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-b4b5c810-6ce2-4fc3-a883-804eafc6a903 tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 08:53:29.323368 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b4b5c810-6ce2-4fc3-a883-804eafc6a903 tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:29.324297 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b4b5c810-6ce2-4fc3-a883-804eafc6a903 tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:29.325303 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b4b5c810-6ce2-4fc3-a883-804eafc6a903 tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:29.326222 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b4b5c810-6ce2-4fc3-a883-804eafc6a903 tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:29.326881 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b4b5c810-6ce2-4fc3-a883-804eafc6a903 tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:29.327749 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b4b5c810-6ce2-4fc3-a883-804eafc6a903 tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:29.351515 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-b4b5c810-6ce2-4fc3-a883-804eafc6a903 tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Getting quotas for project 545d0b704b5d455c8ffaeacb7cebace0. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 08:53:29.357514 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-b4b5c810-6ce2-4fc3-a883-804eafc6a903 tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Getting quotas for user c562ad6d5022429ba559a25c20c7569b and project 545d0b704b5d455c8ffaeacb7cebace0. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 08:53:29.372345 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-b4b5c810-6ce2-4fc3-a883-804eafc6a903 tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Going to run 1 instances... {{(pid=128758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 08:53:29.374800 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-b4b5c810-6ce2-4fc3-a883-804eafc6a903 tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] [instance: 505d2e57-caf3-43d1-b6d6-9678e38c1aab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 08:53:29.446796 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-b4b5c810-6ce2-4fc3-a883-804eafc6a903 tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.216001 Sep 14 08:53:29.457407 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 641/1292] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 08:53:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 1227 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 08:53:29.463287 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-05031b84-b287-4a3e-a540-6e00533d0f7e tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:29.464121 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-05031b84-b287-4a3e-a540-6e00533d0f7e tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] [instance: feeb311c-8462-4539-bbc8-4120559413cb] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:29.472704 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-05031b84-b287-4a3e-a540-6e00533d0f7e tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:29.473413 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-05031b84-b287-4a3e-a540-6e00533d0f7e tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:29.474033 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-05031b84-b287-4a3e-a540-6e00533d0f7e tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:29.474924 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-05031b84-b287-4a3e-a540-6e00533d0f7e tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:29.475584 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-05031b84-b287-4a3e-a540-6e00533d0f7e tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:29.476190 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-05031b84-b287-4a3e-a540-6e00533d0f7e tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:29.564330 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-05031b84-b287-4a3e-a540-6e00533d0f7e tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ace9012a7c4ce59c01858b6984b766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a87a909133e42e1a82e3a623536935c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:29.579417 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-05031b84-b287-4a3e-a540-6e00533d0f7e tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] 10.222.0.60 "GET /compute/v2.1/servers/feeb311c-8462-4539-bbc8-4120559413cb" status: 200 len: 1276 microversion: 2.1 time: 0.120131 Sep 14 08:53:29.592506 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 642/1293] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:29 2022] GET /compute/v2.1/servers/feeb311c-8462-4539-bbc8-4120559413cb => generated 1276 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:53:29.609862 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-4f5dc116-34a2-4942-a0bc-fd1181a86d98 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:29.610686 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-4f5dc116-34a2-4942-a0bc-fd1181a86d98 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] [instance: 4ea5843e-ecf7-4b84-80cb-3f05b2b20982] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:29.626866 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4f5dc116-34a2-4942-a0bc-fd1181a86d98 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:29.627395 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4f5dc116-34a2-4942-a0bc-fd1181a86d98 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:29.628067 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4f5dc116-34a2-4942-a0bc-fd1181a86d98 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:29.629112 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4f5dc116-34a2-4942-a0bc-fd1181a86d98 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:29.631218 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4f5dc116-34a2-4942-a0bc-fd1181a86d98 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:29.631974 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4f5dc116-34a2-4942-a0bc-fd1181a86d98 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:29.813560 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-3894181f-b8e2-4d40-9c59-8f284417c80b tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd/action" status: 202 len: 0 microversion: 2.25 time: 1.662718 Sep 14 08:53:29.814121 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 652/1294] 10.222.0.60 () {62 vars in 1319 bytes} [Wed Sep 14 08:53:28 2022] POST /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd/action => generated 0 bytes in 1665 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 14 08:53:29.816095 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-4f5dc116-34a2-4942-a0bc-fd1181a86d98 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810376d6f0b4329abe0f8f79800b754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575684f36f9c4019926fc83541e152c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:29.819925 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c2fc8efb-6e96-4d97-baa4-987d23f54ca7 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:29.820639 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-c2fc8efb-6e96-4d97-baa4-987d23f54ca7 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: 1b2a9a93-cad5-4b18-abc3-1b88413f88da] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:29.826995 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-4f5dc116-34a2-4942-a0bc-fd1181a86d98 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] 10.222.0.60 "GET /compute/v2.1/servers/4ea5843e-ecf7-4b84-80cb-3f05b2b20982" status: 200 len: 1305 microversion: 2.1 time: 0.233164 Sep 14 08:53:29.842770 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c2fc8efb-6e96-4d97-baa4-987d23f54ca7 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:29.843320 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 643/1295] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:29 2022] GET /compute/v2.1/servers/4ea5843e-ecf7-4b84-80cb-3f05b2b20982 => generated 1305 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:53:29.843423 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c2fc8efb-6e96-4d97-baa4-987d23f54ca7 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:29.843423 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c2fc8efb-6e96-4d97-baa4-987d23f54ca7 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:29.843423 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c2fc8efb-6e96-4d97-baa4-987d23f54ca7 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:29.843423 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c2fc8efb-6e96-4d97-baa4-987d23f54ca7 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:29.843798 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c2fc8efb-6e96-4d97-baa4-987d23f54ca7 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:30.062560 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-6fe6dd59-0b37-462d-8cdf-fd1ba06a5848 tempest-FlavorsV2NegativeTest-1613889732 tempest-FlavorsV2NegativeTest-1613889732-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:30.068379 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=7 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:53:30.074590 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-6fe6dd59-0b37-462d-8cdf-fd1ba06a5848 tempest-FlavorsV2NegativeTest-1613889732 tempest-FlavorsV2NegativeTest-1613889732-project] 10.222.0.60 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.240597 Sep 14 08:53:30.082976 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 644/1296] 10.222.0.60 () {58 vars in 1137 bytes} [Wed Sep 14 08:53:29 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:53:30.083160 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1f536e9c-3d56-410e-9f0b-bd2e95ae201a tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:30.083734 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-1f536e9c-3d56-410e-9f0b-bd2e95ae201a tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] [instance: 505d2e57-caf3-43d1-b6d6-9678e38c1aab] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:30.096412 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-c2fc8efb-6e96-4d97-baa4-987d23f54ca7 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:30.110637 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-c2fc8efb-6e96-4d97-baa4-987d23f54ca7 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/1b2a9a93-cad5-4b18-abc3-1b88413f88da" status: 200 len: 1475 microversion: 2.1 time: 0.293424 Sep 14 08:53:30.113062 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 653/1297] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:29 2022] GET /compute/v2.1/servers/1b2a9a93-cad5-4b18-abc3-1b88413f88da => generated 1475 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:53:30.124033 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-2926e2cf-6671-4548-bed8-f92c04cd4b04 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:30.128507 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-2926e2cf-6671-4548-bed8-f92c04cd4b04 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: 8fce8438-d6ae-408d-8b4f-ee14d4021fdd] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:30.138847 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2926e2cf-6671-4548-bed8-f92c04cd4b04 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:30.139741 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2926e2cf-6671-4548-bed8-f92c04cd4b04 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:30.140713 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2926e2cf-6671-4548-bed8-f92c04cd4b04 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:30.142981 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2926e2cf-6671-4548-bed8-f92c04cd4b04 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:30.143696 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2926e2cf-6671-4548-bed8-f92c04cd4b04 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:30.144361 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2926e2cf-6671-4548-bed8-f92c04cd4b04 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:30.349516 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-1f536e9c-3d56-410e-9f0b-bd2e95ae201a tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c562ad6d5022429ba559a25c20c7569b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '545d0b704b5d455c8ffaeacb7cebace0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:30.360857 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-1f536e9c-3d56-410e-9f0b-bd2e95ae201a tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] 10.222.0.60 "GET /compute/v2.1/servers/505d2e57-caf3-43d1-b6d6-9678e38c1aab" status: 200 len: 1223 microversion: 2.1 time: 0.284210 Sep 14 08:53:30.361589 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 645/1298] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:30 2022] GET /compute/v2.1/servers/505d2e57-caf3-43d1-b6d6-9678e38c1aab => generated 1223 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:53:30.568455 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-2926e2cf-6671-4548-bed8-f92c04cd4b04 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:30.581651 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-2926e2cf-6671-4548-bed8-f92c04cd4b04 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:30.585771 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-2926e2cf-6671-4548-bed8-f92c04cd4b04 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:30.587382 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-2926e2cf-6671-4548-bed8-f92c04cd4b04 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd" status: 200 len: 1815 microversion: 2.25 time: 0.471544 Sep 14 08:53:30.588176 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 654/1299] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:53:30 2022] GET /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd => generated 1815 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:53:30.616429 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-78dfde2f-3cea-4039-8c90-abd7597a5909 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:30.621116 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-78dfde2f-3cea-4039-8c90-abd7597a5909 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] [instance: feeb311c-8462-4539-bbc8-4120559413cb] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:30.633801 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-78dfde2f-3cea-4039-8c90-abd7597a5909 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:30.641122 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-78dfde2f-3cea-4039-8c90-abd7597a5909 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:30.641574 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-78dfde2f-3cea-4039-8c90-abd7597a5909 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:30.642318 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-78dfde2f-3cea-4039-8c90-abd7597a5909 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:30.642852 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-78dfde2f-3cea-4039-8c90-abd7597a5909 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:30.643299 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-78dfde2f-3cea-4039-8c90-abd7597a5909 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:30.785095 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-78dfde2f-3cea-4039-8c90-abd7597a5909 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ace9012a7c4ce59c01858b6984b766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a87a909133e42e1a82e3a623536935c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:30.794965 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-78dfde2f-3cea-4039-8c90-abd7597a5909 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] 10.222.0.60 "GET /compute/v2.1/servers/feeb311c-8462-4539-bbc8-4120559413cb" status: 200 len: 1282 microversion: 2.1 time: 0.185253 Sep 14 08:53:30.799258 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 646/1300] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:30 2022] GET /compute/v2.1/servers/feeb311c-8462-4539-bbc8-4120559413cb => generated 1282 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:53:30.850310 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f773c556-d602-42ad-bb88-d31f29c42a87 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:30.851003 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f773c556-d602-42ad-bb88-d31f29c42a87 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] [instance: 4ea5843e-ecf7-4b84-80cb-3f05b2b20982] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:30.857538 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f773c556-d602-42ad-bb88-d31f29c42a87 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:30.858036 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f773c556-d602-42ad-bb88-d31f29c42a87 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:30.858479 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f773c556-d602-42ad-bb88-d31f29c42a87 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:30.859348 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f773c556-d602-42ad-bb88-d31f29c42a87 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:30.859807 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f773c556-d602-42ad-bb88-d31f29c42a87 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:30.860232 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f773c556-d602-42ad-bb88-d31f29c42a87 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:31.052016 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-fc2d20e4-f83b-473d-9b0d-666dc049ad3f tempest-FlavorsV2NegativeTest-1613889732 tempest-FlavorsV2NegativeTest-1613889732-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-2082668038", "imageRef": "cf451c94-3741-4aaf-b218-0c2e0605518a", "flavorRef": "452"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:53:31.092245 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f773c556-d602-42ad-bb88-d31f29c42a87 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810376d6f0b4329abe0f8f79800b754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575684f36f9c4019926fc83541e152c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:31.101187 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f773c556-d602-42ad-bb88-d31f29c42a87 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] 10.222.0.60 "GET /compute/v2.1/servers/4ea5843e-ecf7-4b84-80cb-3f05b2b20982" status: 200 len: 1293 microversion: 2.1 time: 0.255372 Sep 14 08:53:31.102536 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 655/1301] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:30 2022] GET /compute/v2.1/servers/4ea5843e-ecf7-4b84-80cb-3f05b2b20982 => generated 1293 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:53:31.115906 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.network.neutron [None req-fc2d20e4-f83b-473d-9b0d-666dc049ad3f tempest-FlavorsV2NegativeTest-1613889732 tempest-FlavorsV2NegativeTest-1613889732-project] validate_networks() for None {{(pid=128758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 08:53:31.134181 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-6011ae4c-a56a-403c-9b0c-f311a20d1625 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:31.134862 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-6011ae4c-a56a-403c-9b0c-f311a20d1625 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: 1b2a9a93-cad5-4b18-abc3-1b88413f88da] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:31.141424 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6011ae4c-a56a-403c-9b0c-f311a20d1625 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:31.141985 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6011ae4c-a56a-403c-9b0c-f311a20d1625 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:31.142663 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6011ae4c-a56a-403c-9b0c-f311a20d1625 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:31.143617 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6011ae4c-a56a-403c-9b0c-f311a20d1625 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:31.144084 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6011ae4c-a56a-403c-9b0c-f311a20d1625 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:31.144523 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6011ae4c-a56a-403c-9b0c-f311a20d1625 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:31.439970 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-6011ae4c-a56a-403c-9b0c-f311a20d1625 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:31.448848 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-6011ae4c-a56a-403c-9b0c-f311a20d1625 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/1b2a9a93-cad5-4b18-abc3-1b88413f88da" status: 200 len: 1475 microversion: 2.1 time: 0.318820 Sep 14 08:53:31.449716 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 656/1302] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:31 2022] GET /compute/v2.1/servers/1b2a9a93-cad5-4b18-abc3-1b88413f88da => generated 1475 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:53:31.455400 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-4557a004-c9ad-4699-ab6a-54e61b53a05b tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:31.456192 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-4557a004-c9ad-4699-ab6a-54e61b53a05b tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] [instance: 505d2e57-caf3-43d1-b6d6-9678e38c1aab] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:31.463334 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4557a004-c9ad-4699-ab6a-54e61b53a05b tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:31.463850 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4557a004-c9ad-4699-ab6a-54e61b53a05b tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:31.464282 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4557a004-c9ad-4699-ab6a-54e61b53a05b tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:31.464967 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4557a004-c9ad-4699-ab6a-54e61b53a05b tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:31.465415 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4557a004-c9ad-4699-ab6a-54e61b53a05b tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:31.465858 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4557a004-c9ad-4699-ab6a-54e61b53a05b tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:31.559842 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-fc2d20e4-f83b-473d-9b0d-666dc049ad3f tempest-FlavorsV2NegativeTest-1613889732 tempest-FlavorsV2NegativeTest-1613889732-project] HTTP exception thrown: Flavor's memory is too small for requested image. Sep 14 08:53:31.562075 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-fc2d20e4-f83b-473d-9b0d-666dc049ad3f tempest-FlavorsV2NegativeTest-1613889732 tempest-FlavorsV2NegativeTest-1613889732-project] Request method failure captured: Sep 14 08:53:31.562075 n-d-836830-18 devstack@n-api.service[128758]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 14 08:53:31.562075 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 08:53:31.562075 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 08:53:31.562075 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 08:53:31.562075 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 143 Sep 14 08:53:31.562075 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 08:53:31.562075 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 08:53:31.562075 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 08:53:31.562075 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 08:53:31.562075 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZaIhOJJ-I3vdRgQ-ldmr-zdPUYIH9wNgDWIAwc3rT_vZSm5agxyAo2OJL0NQPnPKIi8R5eAJK1FkSEd2GrX9tuByHT1aCryQglBVJHPXnexLysf1pIUCeZZTK2FBNDyd0iyzYJPx9-VfJwQt4S2DZhVvZCGn8AHUCRHH3XiWJZCxUo Sep 14 08:53:31.562075 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 08:53:31.562075 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 08:53:31.562075 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 08:53:31.562075 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 08:53:31.562075 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 08:53:31.562075 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 08:53:31.562075 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 7d1cdd643587499abd6dfa7f6f12b9b6 Sep 14 08:53:31.562075 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-FlavorsV2NegativeTest-1613889732 Sep 14 08:53:31.562075 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 08:53:31.562075 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 08:53:31.563570 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/7d1cdd643587499abd6dfa7f6f12b9b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_7d1cdd643587499abd6dfa7f6f12b9b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/7d1cdd643587499abd6dfa7f6f12b9b6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/7d1cdd643587499abd6dfa7f6f12b9b6"}]}] Sep 14 08:53:31.563570 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-FlavorsV2NegativeTest-1613889732 Sep 14 08:53:31.563570 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 7d1cdd643587499abd6dfa7f6f12b9b6 Sep 14 08:53:31.563570 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-1613889732 Sep 14 08:53:31.563570 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-FlavorsV2NegativeTest-1613889732-project Sep 14 08:53:31.563570 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 08:53:31.563570 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 08:53:31.563570 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 3cf36e2faee74016bbe7c7f6f157d99f Sep 14 08:53:31.563570 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-FlavorsV2NegativeTest-1613889732-project Sep 14 08:53:31.563570 n-d-836830-18 devstack@n-api.service[128758]: Sep 14 08:53:31.563570 n-d-836830-18 devstack@n-api.service[128758]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-2082668038", "imageRef": "cf451c94-3741-4aaf-b218-0c2e0605518a", "flavorRef": "452"}} Sep 14 08:53:31.563570 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 08:53:31.564380 n-d-836830-18 devstack@n-api.service[128758]: exception: Flavor's memory is too small for requested image. Sep 14 08:53:31.564380 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-2082668038', 'imageRef': 'cf451c94-3741-4aaf-b218-0c2e0605518a', 'flavorRef': '452'}}} Sep 14 08:53:31.564380 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:53:31.564380 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:53:31.564380 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 14 08:53:31.564380 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 14 08:53:31.564380 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 14 08:53:31.564380 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 14 08:53:31.564380 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Sep 14 08:53:31.564380 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Sep 14 08:53:31.564380 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1019, in _checks_for_create_and_rebuild Sep 14 08:53:31.564380 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Sep 14 08:53:31.564380 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 683, in _validate_flavor_image Sep 14 08:53:31.564380 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Sep 14 08:53:31.564380 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 751, in _validate_flavor_image_nostatus Sep 14 08:53:31.564380 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Sep 14 08:53:31.564380 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Sep 14 08:53:31.564380 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:53:31.564380 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:53:31.564380 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:53:31.566381 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:53:31.566381 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:53:31.566381 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:53:31.566381 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:53:31.566381 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:53:31.566381 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:53:31.566381 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:53:31.566381 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 08:53:31.566381 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 08:53:31.566381 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 08:53:31.566381 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 08:53:31.566381 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 08:53:31.566381 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 08:53:31.566381 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 14 08:53:31.566381 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Sep 14 08:53:31.566381 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Sep 14 08:53:31.566381 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Sep 14 08:53:31.566381 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:53:31.566381 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:53:31.566381 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:53:31.566381 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:53:31.568398 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:53:31.568398 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:53:31.568398 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:53:31.568398 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:53:31.568398 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Sep 14 08:53:31.568398 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:53:31.568398 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-fc2d20e4-f83b-473d-9b0d-666dc049ad3f tempest-FlavorsV2NegativeTest-1613889732 tempest-FlavorsV2NegativeTest-1613889732-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:53:31.568398 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-fc2d20e4-f83b-473d-9b0d-666dc049ad3f tempest-FlavorsV2NegativeTest-1613889732 tempest-FlavorsV2NegativeTest-1613889732-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.516627 Sep 14 08:53:31.568398 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 647/1303] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 08:53:31 2022] POST /compute/v2.1/servers => generated 93 bytes in 518 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Sep 14 08:53:31.584146 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-4557a004-c9ad-4699-ab6a-54e61b53a05b tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c562ad6d5022429ba559a25c20c7569b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '545d0b704b5d455c8ffaeacb7cebace0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:31.596295 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-4557a004-c9ad-4699-ab6a-54e61b53a05b tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] 10.222.0.60 "GET /compute/v2.1/servers/505d2e57-caf3-43d1-b6d6-9678e38c1aab" status: 200 len: 1275 microversion: 2.1 time: 0.145349 Sep 14 08:53:31.603825 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 657/1304] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:31 2022] GET /compute/v2.1/servers/505d2e57-caf3-43d1-b6d6-9678e38c1aab => generated 1275 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:53:31.624405 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b03c0cb5-066b-4aba-932b-e91a94d7e3db tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:31.625501 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-b03c0cb5-066b-4aba-932b-e91a94d7e3db tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: 8fce8438-d6ae-408d-8b4f-ee14d4021fdd] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:31.633631 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b03c0cb5-066b-4aba-932b-e91a94d7e3db tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:31.634824 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b03c0cb5-066b-4aba-932b-e91a94d7e3db tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:31.635678 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b03c0cb5-066b-4aba-932b-e91a94d7e3db tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:31.636678 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b03c0cb5-066b-4aba-932b-e91a94d7e3db tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:31.637339 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b03c0cb5-066b-4aba-932b-e91a94d7e3db tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:31.638319 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b03c0cb5-066b-4aba-932b-e91a94d7e3db tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:31.792959 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-b03c0cb5-066b-4aba-932b-e91a94d7e3db tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:31.802030 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-b03c0cb5-066b-4aba-932b-e91a94d7e3db tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:31.803511 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-b03c0cb5-066b-4aba-932b-e91a94d7e3db tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:31.804686 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-b03c0cb5-066b-4aba-932b-e91a94d7e3db tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd" status: 200 len: 1815 microversion: 2.25 time: 0.194883 Sep 14 08:53:31.805501 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 648/1305] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:53:31 2022] GET /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd => generated 1815 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:53:31.825950 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-04d1763b-ce79-472d-ab5d-2a444eabb7d1 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:31.826776 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-04d1763b-ce79-472d-ab5d-2a444eabb7d1 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] [instance: feeb311c-8462-4539-bbc8-4120559413cb] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:31.833659 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-04d1763b-ce79-472d-ab5d-2a444eabb7d1 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:31.834151 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-04d1763b-ce79-472d-ab5d-2a444eabb7d1 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:31.834594 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-04d1763b-ce79-472d-ab5d-2a444eabb7d1 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:31.835330 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-04d1763b-ce79-472d-ab5d-2a444eabb7d1 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:31.835791 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-04d1763b-ce79-472d-ab5d-2a444eabb7d1 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:31.836279 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-04d1763b-ce79-472d-ab5d-2a444eabb7d1 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:31.971786 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-04d1763b-ce79-472d-ab5d-2a444eabb7d1 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ace9012a7c4ce59c01858b6984b766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a87a909133e42e1a82e3a623536935c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:31.979786 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-04d1763b-ce79-472d-ab5d-2a444eabb7d1 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] 10.222.0.60 "GET /compute/v2.1/servers/feeb311c-8462-4539-bbc8-4120559413cb" status: 200 len: 1324 microversion: 2.1 time: 0.159604 Sep 14 08:53:31.980365 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 658/1306] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:31 2022] GET /compute/v2.1/servers/feeb311c-8462-4539-bbc8-4120559413cb => generated 1324 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:53:32.137849 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-da336055-64dc-4f44-b161-685dec903330 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:32.138314 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-da336055-64dc-4f44-b161-685dec903330 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] [instance: 4ea5843e-ecf7-4b84-80cb-3f05b2b20982] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:32.145350 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-da336055-64dc-4f44-b161-685dec903330 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:32.145837 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-da336055-64dc-4f44-b161-685dec903330 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:32.146275 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-da336055-64dc-4f44-b161-685dec903330 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:32.146994 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-da336055-64dc-4f44-b161-685dec903330 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:32.147452 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-da336055-64dc-4f44-b161-685dec903330 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:32.147884 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-da336055-64dc-4f44-b161-685dec903330 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:32.291096 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-da336055-64dc-4f44-b161-685dec903330 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810376d6f0b4329abe0f8f79800b754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575684f36f9c4019926fc83541e152c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:32.300080 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-da336055-64dc-4f44-b161-685dec903330 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] 10.222.0.60 "GET /compute/v2.1/servers/4ea5843e-ecf7-4b84-80cb-3f05b2b20982" status: 200 len: 1293 microversion: 2.1 time: 0.166159 Sep 14 08:53:32.303146 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 649/1307] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:32 2022] GET /compute/v2.1/servers/4ea5843e-ecf7-4b84-80cb-3f05b2b20982 => generated 1293 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:53:32.476257 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-fd85967f-6480-4baf-8bbd-536f6ef4c0d7 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:32.477116 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-fd85967f-6480-4baf-8bbd-536f6ef4c0d7 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: 1b2a9a93-cad5-4b18-abc3-1b88413f88da] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:32.482797 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=14 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:53:32.484624 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fd85967f-6480-4baf-8bbd-536f6ef4c0d7 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:32.485310 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fd85967f-6480-4baf-8bbd-536f6ef4c0d7 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:32.485973 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fd85967f-6480-4baf-8bbd-536f6ef4c0d7 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:32.486910 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fd85967f-6480-4baf-8bbd-536f6ef4c0d7 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:32.487581 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fd85967f-6480-4baf-8bbd-536f6ef4c0d7 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:32.488174 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fd85967f-6480-4baf-8bbd-536f6ef4c0d7 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:32.626569 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-8f6ee55f-be28-4c5d-8d45-c410c494642b tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:32.627786 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-8f6ee55f-be28-4c5d-8d45-c410c494642b tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] [instance: 505d2e57-caf3-43d1-b6d6-9678e38c1aab] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:32.635231 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8f6ee55f-be28-4c5d-8d45-c410c494642b tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:32.636013 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8f6ee55f-be28-4c5d-8d45-c410c494642b tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:32.636608 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8f6ee55f-be28-4c5d-8d45-c410c494642b tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:32.637510 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8f6ee55f-be28-4c5d-8d45-c410c494642b tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:32.638123 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8f6ee55f-be28-4c5d-8d45-c410c494642b tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:32.638707 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8f6ee55f-be28-4c5d-8d45-c410c494642b tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:32.762266 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-8f6ee55f-be28-4c5d-8d45-c410c494642b tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c562ad6d5022429ba559a25c20c7569b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '545d0b704b5d455c8ffaeacb7cebace0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:32.773853 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-8f6ee55f-be28-4c5d-8d45-c410c494642b tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] 10.222.0.60 "GET /compute/v2.1/servers/505d2e57-caf3-43d1-b6d6-9678e38c1aab" status: 200 len: 1275 microversion: 2.1 time: 0.151295 Sep 14 08:53:32.774817 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 650/1308] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:32 2022] GET /compute/v2.1/servers/505d2e57-caf3-43d1-b6d6-9678e38c1aab => generated 1275 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:53:32.787615 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-fd85967f-6480-4baf-8bbd-536f6ef4c0d7 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:32.804378 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-fd85967f-6480-4baf-8bbd-536f6ef4c0d7 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/1b2a9a93-cad5-4b18-abc3-1b88413f88da" status: 200 len: 1475 microversion: 2.1 time: 0.333519 Sep 14 08:53:32.805631 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 659/1309] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:32 2022] GET /compute/v2.1/servers/1b2a9a93-cad5-4b18-abc3-1b88413f88da => generated 1475 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:53:32.834011 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-9567496d-f109-40c0-b551-a6f0f98f5812 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:32.834891 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-9567496d-f109-40c0-b551-a6f0f98f5812 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: 8fce8438-d6ae-408d-8b4f-ee14d4021fdd] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:32.846074 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9567496d-f109-40c0-b551-a6f0f98f5812 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:32.846823 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9567496d-f109-40c0-b551-a6f0f98f5812 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:32.848085 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9567496d-f109-40c0-b551-a6f0f98f5812 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:32.852800 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9567496d-f109-40c0-b551-a6f0f98f5812 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:32.853540 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9567496d-f109-40c0-b551-a6f0f98f5812 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:32.853980 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9567496d-f109-40c0-b551-a6f0f98f5812 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:33.009507 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-85e0dafc-1ae1-49d2-95f9-296a8377f46f tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:33.010137 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-85e0dafc-1ae1-49d2-95f9-296a8377f46f tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] [instance: feeb311c-8462-4539-bbc8-4120559413cb] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:33.024780 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-85e0dafc-1ae1-49d2-95f9-296a8377f46f tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:33.027986 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-85e0dafc-1ae1-49d2-95f9-296a8377f46f tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:33.028832 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-85e0dafc-1ae1-49d2-95f9-296a8377f46f tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:33.029829 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-85e0dafc-1ae1-49d2-95f9-296a8377f46f tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:33.030702 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-85e0dafc-1ae1-49d2-95f9-296a8377f46f tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:33.031499 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-85e0dafc-1ae1-49d2-95f9-296a8377f46f tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:33.366615 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-9567496d-f109-40c0-b551-a6f0f98f5812 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:33.380570 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-9567496d-f109-40c0-b551-a6f0f98f5812 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:33.382024 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-9567496d-f109-40c0-b551-a6f0f98f5812 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:33.395109 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-9567496d-f109-40c0-b551-a6f0f98f5812 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd" status: 200 len: 1815 microversion: 2.25 time: 0.553809 Sep 14 08:53:33.411329 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 651/1310] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:53:32 2022] GET /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd => generated 1815 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:53:33.419166 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-7d0a7a41-eea9-4f22-8cc3-c7b07cd4fd22 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:33.420011 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-7d0a7a41-eea9-4f22-8cc3-c7b07cd4fd22 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] [instance: 4ea5843e-ecf7-4b84-80cb-3f05b2b20982] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:33.426807 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7d0a7a41-eea9-4f22-8cc3-c7b07cd4fd22 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:33.427578 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7d0a7a41-eea9-4f22-8cc3-c7b07cd4fd22 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:33.428187 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7d0a7a41-eea9-4f22-8cc3-c7b07cd4fd22 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:33.429153 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7d0a7a41-eea9-4f22-8cc3-c7b07cd4fd22 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:33.430007 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7d0a7a41-eea9-4f22-8cc3-c7b07cd4fd22 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:33.430597 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7d0a7a41-eea9-4f22-8cc3-c7b07cd4fd22 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:33.437881 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-85e0dafc-1ae1-49d2-95f9-296a8377f46f tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ace9012a7c4ce59c01858b6984b766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a87a909133e42e1a82e3a623536935c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:33.454150 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-85e0dafc-1ae1-49d2-95f9-296a8377f46f tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] 10.222.0.60 "GET /compute/v2.1/servers/feeb311c-8462-4539-bbc8-4120559413cb" status: 200 len: 1324 microversion: 2.1 time: 0.451099 Sep 14 08:53:33.455158 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 660/1311] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:32 2022] GET /compute/v2.1/servers/feeb311c-8462-4539-bbc8-4120559413cb => generated 1324 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:53:33.985340 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-7d0a7a41-eea9-4f22-8cc3-c7b07cd4fd22 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810376d6f0b4329abe0f8f79800b754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575684f36f9c4019926fc83541e152c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:33.996016 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-7d0a7a41-eea9-4f22-8cc3-c7b07cd4fd22 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] 10.222.0.60 "GET /compute/v2.1/servers/4ea5843e-ecf7-4b84-80cb-3f05b2b20982" status: 200 len: 1293 microversion: 2.1 time: 0.583017 Sep 14 08:53:34.000590 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 652/1312] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:33 2022] GET /compute/v2.1/servers/4ea5843e-ecf7-4b84-80cb-3f05b2b20982 => generated 1293 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:53:34.011920 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-34c1906a-bcce-40cf-9599-ea4dc68f1f8c tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:34.013788 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-34c1906a-bcce-40cf-9599-ea4dc68f1f8c tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] [instance: 505d2e57-caf3-43d1-b6d6-9678e38c1aab] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:34.032462 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-34c1906a-bcce-40cf-9599-ea4dc68f1f8c tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:34.034008 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-34c1906a-bcce-40cf-9599-ea4dc68f1f8c tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:34.034914 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-34c1906a-bcce-40cf-9599-ea4dc68f1f8c tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:34.036148 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-34c1906a-bcce-40cf-9599-ea4dc68f1f8c tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:34.036907 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-34c1906a-bcce-40cf-9599-ea4dc68f1f8c tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:34.037463 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f9a884b9-80fa-400a-b090-e3fbaebf4471 tempest-KeyPairsV2TestJSON-328330388 tempest-KeyPairsV2TestJSON-328330388-project] Action: 'create', calling method: .version_select at 0x7f7d441c4d30>, body: {"keypair": {"name": "tempest-keypair-223030509", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP8rgseMmGViJ3q1/T3dquVvuMKLwUbtA8lMEQnrHhRSd9rnE8qlsk/zxKLelQtMB6uj0Sp4JeWdZ4o1Okq5sGcxnJ2oPT6ABsDcoi6qRB4kYSsCCyxzrOREB/3oetucEA=="}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:53:34.038395 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-34c1906a-bcce-40cf-9599-ea4dc68f1f8c tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:34.072246 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-f9a884b9-80fa-400a-b090-e3fbaebf4471 tempest-KeyPairsV2TestJSON-328330388 tempest-KeyPairsV2TestJSON-328330388-project] Getting quotas for project 28c3dcde865340c2b8359273c5f15f0f. Resources: {'key_pairs'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 08:53:34.079419 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-f9a884b9-80fa-400a-b090-e3fbaebf4471 tempest-KeyPairsV2TestJSON-328330388 tempest-KeyPairsV2TestJSON-328330388-project] Getting quotas for user c7732618448547599ccdc9b622c3fbb5 and project 28c3dcde865340c2b8359273c5f15f0f. Resources: {'key_pairs'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 08:53:34.102626 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:DELETE=3,nova_api:SELECT=96,nova_api:UPDATE=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:53:34.109812 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f9a884b9-80fa-400a-b090-e3fbaebf4471 tempest-KeyPairsV2TestJSON-328330388 tempest-KeyPairsV2TestJSON-328330388-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.354452 Sep 14 08:53:34.110684 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 661/1313] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Sep 14 08:53:33 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 08:53:34.127845 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b9d92dfa-bc07-4d02-865c-9259f90eaa6a tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:34.133273 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b9d92dfa-bc07-4d02-865c-9259f90eaa6a tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: 1b2a9a93-cad5-4b18-abc3-1b88413f88da] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:34.145940 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b9d92dfa-bc07-4d02-865c-9259f90eaa6a tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:34.146344 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b9d92dfa-bc07-4d02-865c-9259f90eaa6a tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:34.147406 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b9d92dfa-bc07-4d02-865c-9259f90eaa6a tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:34.148391 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b9d92dfa-bc07-4d02-865c-9259f90eaa6a tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:34.149178 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b9d92dfa-bc07-4d02-865c-9259f90eaa6a tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:34.149886 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b9d92dfa-bc07-4d02-865c-9259f90eaa6a tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:34.320065 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-34c1906a-bcce-40cf-9599-ea4dc68f1f8c tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c562ad6d5022429ba559a25c20c7569b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '545d0b704b5d455c8ffaeacb7cebace0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:34.328609 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-34c1906a-bcce-40cf-9599-ea4dc68f1f8c tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] 10.222.0.60 "GET /compute/v2.1/servers/505d2e57-caf3-43d1-b6d6-9678e38c1aab" status: 200 len: 1281 microversion: 2.1 time: 0.326648 Sep 14 08:53:34.329800 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 653/1314] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:34 2022] GET /compute/v2.1/servers/505d2e57-caf3-43d1-b6d6-9678e38c1aab => generated 1281 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:53:34.335979 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-009f140e-d2da-4ada-9edd-5454fda76ea5 tempest-KeyPairsV2TestJSON-328330388 tempest-KeyPairsV2TestJSON-328330388-project] Calling method '.version_select at 0x7f7d444783a0>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:34.346440 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-009f140e-d2da-4ada-9edd-5454fda76ea5 tempest-KeyPairsV2TestJSON-328330388 tempest-KeyPairsV2TestJSON-328330388-project] 10.222.0.60 "GET /compute/v2.1/os-keypairs/tempest-keypair-223030509" status: 200 len: 497 microversion: 2.1 time: 0.015033 Sep 14 08:53:34.347448 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 654/1315] 10.222.0.60 () {58 vars in 1215 bytes} [Wed Sep 14 08:53:34 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-223030509 => generated 497 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:53:34.432999 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-7af52eca-bd4e-4403-98b3-b33f96be2cdf req-a4e81be0-45d3-4d7c-a53b-cedb47d2bd03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "feeb311c-8462-4539-bbc8-4120559413cb", "tag": "4a1be6f1-1a5b-4e4b-a505-9c04755c817d"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:53:34.443590 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-7af52eca-bd4e-4403-98b3-b33f96be2cdf req-a4e81be0-45d3-4d7c-a53b-cedb47d2bd03 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:34.444066 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-7af52eca-bd4e-4403-98b3-b33f96be2cdf req-a4e81be0-45d3-4d7c-a53b-cedb47d2bd03 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:34.444493 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-7af52eca-bd4e-4403-98b3-b33f96be2cdf req-a4e81be0-45d3-4d7c-a53b-cedb47d2bd03 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:34.448562 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=100 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:53:34.457804 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-7af52eca-bd4e-4403-98b3-b33f96be2cdf req-a4e81be0-45d3-4d7c-a53b-cedb47d2bd03 service nova] Creating event network-changed:4a1be6f1-1a5b-4e4b-a505-9c04755c817d for instance feeb311c-8462-4539-bbc8-4120559413cb on n-h2-836830-18 Sep 14 08:53:34.463008 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-7af52eca-bd4e-4403-98b3-b33f96be2cdf req-a4e81be0-45d3-4d7c-a53b-cedb47d2bd03 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111109 Sep 14 08:53:34.464154 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 655/1316] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:53:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:53:34.465258 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b9d92dfa-bc07-4d02-865c-9259f90eaa6a tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:34.470107 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1861354b-94b9-4a51-a59d-911cbf9e9d06 tempest-KeyPairsV2TestJSON-328330388 tempest-KeyPairsV2TestJSON-328330388-project] Calling method '.version_select at 0x7f7d443ae8b0>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:34.476753 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b9d92dfa-bc07-4d02-865c-9259f90eaa6a tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/1b2a9a93-cad5-4b18-abc3-1b88413f88da" status: 200 len: 1474 microversion: 2.1 time: 0.364843 Sep 14 08:53:34.479184 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 662/1317] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:34 2022] GET /compute/v2.1/servers/1b2a9a93-cad5-4b18-abc3-1b88413f88da => generated 1474 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:53:34.508352 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-cee03cd9-ad92-44ec-a38d-de05bfd13df7 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:34.511688 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-cee03cd9-ad92-44ec-a38d-de05bfd13df7 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: 8fce8438-d6ae-408d-8b4f-ee14d4021fdd] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:34.512214 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-1861354b-94b9-4a51-a59d-911cbf9e9d06 tempest-KeyPairsV2TestJSON-328330388 tempest-KeyPairsV2TestJSON-328330388-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-223030509" status: 202 len: 0 microversion: 2.1 time: 0.046522 Sep 14 08:53:34.513125 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 656/1318] 10.222.0.60 () {58 vars in 1218 bytes} [Wed Sep 14 08:53:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-223030509 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 08:53:34.525787 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c47e8b0c-3211-4ba7-b9c3-59abe1e560ae tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:34.526830 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-c47e8b0c-3211-4ba7-b9c3-59abe1e560ae tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] [instance: feeb311c-8462-4539-bbc8-4120559413cb] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:34.533173 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cee03cd9-ad92-44ec-a38d-de05bfd13df7 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:34.535179 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c47e8b0c-3211-4ba7-b9c3-59abe1e560ae tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:34.535737 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cee03cd9-ad92-44ec-a38d-de05bfd13df7 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:34.536245 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c47e8b0c-3211-4ba7-b9c3-59abe1e560ae tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:34.536831 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cee03cd9-ad92-44ec-a38d-de05bfd13df7 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:34.537098 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c47e8b0c-3211-4ba7-b9c3-59abe1e560ae tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:34.538036 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c47e8b0c-3211-4ba7-b9c3-59abe1e560ae tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:34.538700 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c47e8b0c-3211-4ba7-b9c3-59abe1e560ae tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:34.539374 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c47e8b0c-3211-4ba7-b9c3-59abe1e560ae tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:34.539815 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cee03cd9-ad92-44ec-a38d-de05bfd13df7 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:34.543886 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cee03cd9-ad92-44ec-a38d-de05bfd13df7 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:34.544472 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cee03cd9-ad92-44ec-a38d-de05bfd13df7 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:34.557579 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:53:35.042089 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-c47e8b0c-3211-4ba7-b9c3-59abe1e560ae tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ace9012a7c4ce59c01858b6984b766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a87a909133e42e1a82e3a623536935c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:35.063873 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-c47e8b0c-3211-4ba7-b9c3-59abe1e560ae tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] 10.222.0.60 "GET /compute/v2.1/servers/feeb311c-8462-4539-bbc8-4120559413cb" status: 200 len: 1324 microversion: 2.1 time: 0.542386 Sep 14 08:53:35.066112 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 657/1319] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:34 2022] GET /compute/v2.1/servers/feeb311c-8462-4539-bbc8-4120559413cb => generated 1324 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:53:35.070283 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-cee03cd9-ad92-44ec-a38d-de05bfd13df7 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:35.080459 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-8eb5c0d8-e9d3-4a49-9e24-e7fbe2aa11c8 tempest-KeyPairsV2TestJSON-328330388 tempest-KeyPairsV2TestJSON-328330388-project] Action: 'create', calling method: .version_select at 0x7f7d44509f70>, body: {"keypair": {"name": "tempest-keypair-249288086", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCOxVFiLPk+r5TJTNov/nr3ubcjWF19eGCVRnLgCaAmUIlSFM+VXUb0bl6czq9qKWxhPG/NblYnyB55+mXEFYUQaY1VK6WJBUmwtAjAM1X4A2KxMK1c5mJzYziKx2OPFeQ=="}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:53:35.085502 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-cee03cd9-ad92-44ec-a38d-de05bfd13df7 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:35.089383 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-cee03cd9-ad92-44ec-a38d-de05bfd13df7 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:35.092073 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-cee03cd9-ad92-44ec-a38d-de05bfd13df7 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd" status: 200 len: 1815 microversion: 2.25 time: 0.611085 Sep 14 08:53:35.095698 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 663/1320] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:53:34 2022] GET /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd => generated 1815 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:53:35.115220 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a5e1193e-7328-4b03-bd8c-9eaddc2ad742 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:35.116226 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-a5e1193e-7328-4b03-bd8c-9eaddc2ad742 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] [instance: 4ea5843e-ecf7-4b84-80cb-3f05b2b20982] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:35.123856 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-8eb5c0d8-e9d3-4a49-9e24-e7fbe2aa11c8 tempest-KeyPairsV2TestJSON-328330388 tempest-KeyPairsV2TestJSON-328330388-project] Getting quotas for project 28c3dcde865340c2b8359273c5f15f0f. Resources: {'key_pairs'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 08:53:35.125126 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a5e1193e-7328-4b03-bd8c-9eaddc2ad742 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:35.125831 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a5e1193e-7328-4b03-bd8c-9eaddc2ad742 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:35.126433 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a5e1193e-7328-4b03-bd8c-9eaddc2ad742 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:35.129290 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a5e1193e-7328-4b03-bd8c-9eaddc2ad742 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:35.130107 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a5e1193e-7328-4b03-bd8c-9eaddc2ad742 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:35.130772 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a5e1193e-7328-4b03-bd8c-9eaddc2ad742 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:35.131886 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-8eb5c0d8-e9d3-4a49-9e24-e7fbe2aa11c8 tempest-KeyPairsV2TestJSON-328330388 tempest-KeyPairsV2TestJSON-328330388-project] Getting quotas for user c7732618448547599ccdc9b622c3fbb5 and project 28c3dcde865340c2b8359273c5f15f0f. Resources: {'key_pairs'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 08:53:35.193375 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-8eb5c0d8-e9d3-4a49-9e24-e7fbe2aa11c8 tempest-KeyPairsV2TestJSON-328330388 tempest-KeyPairsV2TestJSON-328330388-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.125895 Sep 14 08:53:35.194439 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 658/1321] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Sep 14 08:53:35 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:53:35.205041 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1b649a10-c74c-42fe-aaaa-c0bb5e3afcfd tempest-KeyPairsV2TestJSON-328330388 tempest-KeyPairsV2TestJSON-328330388-project] Calling method '.version_select at 0x7f7d443aedc0>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:35.227621 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-1b649a10-c74c-42fe-aaaa-c0bb5e3afcfd tempest-KeyPairsV2TestJSON-328330388 tempest-KeyPairsV2TestJSON-328330388-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-249288086" status: 202 len: 0 microversion: 2.1 time: 0.026920 Sep 14 08:53:35.228816 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 659/1322] 10.222.0.60 () {58 vars in 1218 bytes} [Wed Sep 14 08:53:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-249288086 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 08:53:35.240835 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b92dee12-6ad3-4a17-9025-0be6422942cd tempest-KeyPairsV2TestJSON-328330388 tempest-KeyPairsV2TestJSON-328330388-project] Action: 'create', calling method: .version_select at 0x7f7d444780d0>, body: {"keypair": {"name": "tempest-keypair-1247724648", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:53:35.264811 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-b92dee12-6ad3-4a17-9025-0be6422942cd tempest-KeyPairsV2TestJSON-328330388 tempest-KeyPairsV2TestJSON-328330388-project] Getting quotas for project 28c3dcde865340c2b8359273c5f15f0f. Resources: {'key_pairs'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 08:53:35.272185 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-b92dee12-6ad3-4a17-9025-0be6422942cd tempest-KeyPairsV2TestJSON-328330388 tempest-KeyPairsV2TestJSON-328330388-project] Getting quotas for user c7732618448547599ccdc9b622c3fbb5 and project 28c3dcde865340c2b8359273c5f15f0f. Resources: {'key_pairs'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 08:53:35.309010 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-b92dee12-6ad3-4a17-9025-0be6422942cd tempest-KeyPairsV2TestJSON-328330388 tempest-KeyPairsV2TestJSON-328330388-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 574 microversion: 2.1 time: 0.074613 Sep 14 08:53:35.310579 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 660/1323] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Sep 14 08:53:35 2022] POST /compute/v2.1/os-keypairs => generated 574 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:53:35.337488 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ec548828-38fa-4770-95c1-5116a21997b2 tempest-KeyPairsV2TestJSON-328330388 tempest-KeyPairsV2TestJSON-328330388-project] Calling method '.version_select at 0x7f7d443c6700>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:35.382856 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-ec548828-38fa-4770-95c1-5116a21997b2 tempest-KeyPairsV2TestJSON-328330388 tempest-KeyPairsV2TestJSON-328330388-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1247724648" status: 202 len: 0 microversion: 2.1 time: 0.064598 Sep 14 08:53:35.384269 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 661/1324] 10.222.0.60 () {58 vars in 1221 bytes} [Wed Sep 14 08:53:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1247724648 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 08:53:35.394855 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-8882a43d-5736-4859-a0e1-947a469f6a93 tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:35.396385 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-8882a43d-5736-4859-a0e1-947a469f6a93 tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] [instance: 505d2e57-caf3-43d1-b6d6-9678e38c1aab] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:35.405088 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8882a43d-5736-4859-a0e1-947a469f6a93 tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:35.406438 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8882a43d-5736-4859-a0e1-947a469f6a93 tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:35.407433 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8882a43d-5736-4859-a0e1-947a469f6a93 tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:35.408563 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8882a43d-5736-4859-a0e1-947a469f6a93 tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:35.409398 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8882a43d-5736-4859-a0e1-947a469f6a93 tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:35.410906 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8882a43d-5736-4859-a0e1-947a469f6a93 tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:35.821704 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-a5e1193e-7328-4b03-bd8c-9eaddc2ad742 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810376d6f0b4329abe0f8f79800b754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575684f36f9c4019926fc83541e152c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:35.835453 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a5e1193e-7328-4b03-bd8c-9eaddc2ad742 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] 10.222.0.60 "GET /compute/v2.1/servers/4ea5843e-ecf7-4b84-80cb-3f05b2b20982" status: 200 len: 1293 microversion: 2.1 time: 0.735395 Sep 14 08:53:35.836687 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 664/1325] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:35 2022] GET /compute/v2.1/servers/4ea5843e-ecf7-4b84-80cb-3f05b2b20982 => generated 1293 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:53:35.842096 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-5a4d6c9d-89a1-4981-a4ce-e1051298fd6a tempest-KeyPairsV2TestJSON-328330388 tempest-KeyPairsV2TestJSON-328330388-project] Action: 'create', calling method: .version_select at 0x7f7d44206430>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1613430038", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFmJw2JlTz1ymekgpNpnl551DKS+AO076AD27buyH5wsEAaFi2O+tlU7Du6F7GGFhU7IvPxAICNAFh81yGu3KLQmdVBAGX/xw61Jnbieb9ztYMEMAZgB22iivImXpbmYXw=="}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:53:35.868663 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-5a4d6c9d-89a1-4981-a4ce-e1051298fd6a tempest-KeyPairsV2TestJSON-328330388 tempest-KeyPairsV2TestJSON-328330388-project] Getting quotas for project 28c3dcde865340c2b8359273c5f15f0f. Resources: {'key_pairs'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 08:53:35.877604 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-5a4d6c9d-89a1-4981-a4ce-e1051298fd6a tempest-KeyPairsV2TestJSON-328330388 tempest-KeyPairsV2TestJSON-328330388-project] Getting quotas for user c7732618448547599ccdc9b622c3fbb5 and project 28c3dcde865340c2b8359273c5f15f0f. Resources: {'key_pairs'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 08:53:35.927415 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-5a4d6c9d-89a1-4981-a4ce-e1051298fd6a tempest-KeyPairsV2TestJSON-328330388 tempest-KeyPairsV2TestJSON-328330388-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.089121 Sep 14 08:53:35.930073 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 665/1326] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Sep 14 08:53:35 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:53:35.956937 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-4934c7e2-ca0f-40d8-b0b3-25ae8fe4d56d tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:35.961376 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-4934c7e2-ca0f-40d8-b0b3-25ae8fe4d56d tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: 1b2a9a93-cad5-4b18-abc3-1b88413f88da] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:35.974047 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4934c7e2-ca0f-40d8-b0b3-25ae8fe4d56d tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:35.976174 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4934c7e2-ca0f-40d8-b0b3-25ae8fe4d56d tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:35.977121 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4934c7e2-ca0f-40d8-b0b3-25ae8fe4d56d tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:35.984524 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-8882a43d-5736-4859-a0e1-947a469f6a93 tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c562ad6d5022429ba559a25c20c7569b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '545d0b704b5d455c8ffaeacb7cebace0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:35.988387 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4934c7e2-ca0f-40d8-b0b3-25ae8fe4d56d tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:35.989210 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4934c7e2-ca0f-40d8-b0b3-25ae8fe4d56d tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:35.989982 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4934c7e2-ca0f-40d8-b0b3-25ae8fe4d56d tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:35.997995 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-8882a43d-5736-4859-a0e1-947a469f6a93 tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] 10.222.0.60 "GET /compute/v2.1/servers/505d2e57-caf3-43d1-b6d6-9678e38c1aab" status: 200 len: 1323 microversion: 2.1 time: 0.612010 Sep 14 08:53:35.998598 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 662/1327] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:35 2022] GET /compute/v2.1/servers/505d2e57-caf3-43d1-b6d6-9678e38c1aab => generated 1323 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:53:36.014927 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-46721f8c-4376-4c2a-a39c-d83a3e4ee948 tempest-KeyPairsV2TestJSON-328330388 tempest-KeyPairsV2TestJSON-328330388-project] Action: 'create', calling method: .version_select at 0x7f7d44560ca0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1263931443", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCS/pBDrGqmVFQ3IP/rFCsHIPCMacsIh6z/g/FPkYXpl+QTuT9d6B6WvFzNxa2vndRxOIk33y/4ByuJrKYy1qxBcHu/HA5kN0ILx66vwxCPOUEiZl1fUWJE0etz3QszzMw=="}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:53:36.037945 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-46721f8c-4376-4c2a-a39c-d83a3e4ee948 tempest-KeyPairsV2TestJSON-328330388 tempest-KeyPairsV2TestJSON-328330388-project] Getting quotas for project 28c3dcde865340c2b8359273c5f15f0f. Resources: {'key_pairs'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 08:53:36.044283 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-46721f8c-4376-4c2a-a39c-d83a3e4ee948 tempest-KeyPairsV2TestJSON-328330388 tempest-KeyPairsV2TestJSON-328330388-project] Getting quotas for user c7732618448547599ccdc9b622c3fbb5 and project 28c3dcde865340c2b8359273c5f15f0f. Resources: {'key_pairs'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 08:53:36.076794 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-46721f8c-4376-4c2a-a39c-d83a3e4ee948 tempest-KeyPairsV2TestJSON-328330388 tempest-KeyPairsV2TestJSON-328330388-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.068345 Sep 14 08:53:36.077792 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 663/1328] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Sep 14 08:53:35 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:53:36.173758 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-0de78c29-10f5-4232-b9c4-8d5642f8a5a9 req-1c2d7182-b66e-42ab-8cf8-7f1cb531d253 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "505d2e57-caf3-43d1-b6d6-9678e38c1aab", "tag": "84d11647-e317-4b0b-b0cb-70b8cae4e6fb"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:53:36.185643 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-0de78c29-10f5-4232-b9c4-8d5642f8a5a9 req-1c2d7182-b66e-42ab-8cf8-7f1cb531d253 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:36.186436 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-0de78c29-10f5-4232-b9c4-8d5642f8a5a9 req-1c2d7182-b66e-42ab-8cf8-7f1cb531d253 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:36.187111 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-0de78c29-10f5-4232-b9c4-8d5642f8a5a9 req-1c2d7182-b66e-42ab-8cf8-7f1cb531d253 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:36.199622 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-0de78c29-10f5-4232-b9c4-8d5642f8a5a9 req-1c2d7182-b66e-42ab-8cf8-7f1cb531d253 service nova] Creating event network-changed:84d11647-e317-4b0b-b0cb-70b8cae4e6fb for instance 505d2e57-caf3-43d1-b6d6-9678e38c1aab on n-h1-836830-18 Sep 14 08:53:36.205641 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-0de78c29-10f5-4232-b9c4-8d5642f8a5a9 req-1c2d7182-b66e-42ab-8cf8-7f1cb531d253 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126024 Sep 14 08:53:36.206566 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 664/1329] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:53:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:53:36.212865 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-82329c6a-9fd9-4859-8e3c-30a29c9ae780 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:36.214070 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-82329c6a-9fd9-4859-8e3c-30a29c9ae780 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] [instance: feeb311c-8462-4539-bbc8-4120559413cb] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:36.222460 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-82329c6a-9fd9-4859-8e3c-30a29c9ae780 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:36.223384 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-82329c6a-9fd9-4859-8e3c-30a29c9ae780 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:36.224140 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-82329c6a-9fd9-4859-8e3c-30a29c9ae780 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:36.225053 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-82329c6a-9fd9-4859-8e3c-30a29c9ae780 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:36.225712 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-82329c6a-9fd9-4859-8e3c-30a29c9ae780 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:36.226300 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-82329c6a-9fd9-4859-8e3c-30a29c9ae780 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:36.344022 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-4934c7e2-ca0f-40d8-b0b3-25ae8fe4d56d tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:36.358153 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-4934c7e2-ca0f-40d8-b0b3-25ae8fe4d56d tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/1b2a9a93-cad5-4b18-abc3-1b88413f88da" status: 200 len: 1474 microversion: 2.1 time: 0.426431 Sep 14 08:53:36.359361 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 666/1330] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:35 2022] GET /compute/v2.1/servers/1b2a9a93-cad5-4b18-abc3-1b88413f88da => generated 1474 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:53:36.375177 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ec1786f4-6a7f-42af-933e-2220d3053293 tempest-KeyPairsV2TestJSON-328330388 tempest-KeyPairsV2TestJSON-328330388-project] Action: 'create', calling method: .version_select at 0x7f7d441a4430>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-12093893", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJMbgGz3/Ab0fxK08qS7HfT8b1o52wa7f0UhX1GQ3GjaPnar1XueeVs8t+ZFk7oDfxn+Ip2BxHQPZI4BPCPfmJYJMIbpgK3unfGYeDcLhmts0VPXpRqCemuVwGb9EhhMrg=="}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:53:36.393456 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-ec1786f4-6a7f-42af-933e-2220d3053293 tempest-KeyPairsV2TestJSON-328330388 tempest-KeyPairsV2TestJSON-328330388-project] Getting quotas for project 28c3dcde865340c2b8359273c5f15f0f. Resources: {'key_pairs'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 08:53:36.399178 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-ec1786f4-6a7f-42af-933e-2220d3053293 tempest-KeyPairsV2TestJSON-328330388 tempest-KeyPairsV2TestJSON-328330388-project] Getting quotas for user c7732618448547599ccdc9b622c3fbb5 and project 28c3dcde865340c2b8359273c5f15f0f. Resources: {'key_pairs'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 08:53:36.433425 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-ec1786f4-6a7f-42af-933e-2220d3053293 tempest-KeyPairsV2TestJSON-328330388 tempest-KeyPairsV2TestJSON-328330388-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.072656 Sep 14 08:53:36.434412 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 667/1331] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Sep 14 08:53:36 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:53:36.443667 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-afb300f7-7e60-4a78-a0e6-a4082190a4fe tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:36.445297 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-afb300f7-7e60-4a78-a0e6-a4082190a4fe tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: 8fce8438-d6ae-408d-8b4f-ee14d4021fdd] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:36.453224 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-afb300f7-7e60-4a78-a0e6-a4082190a4fe tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:36.454511 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-afb300f7-7e60-4a78-a0e6-a4082190a4fe tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:36.455188 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-afb300f7-7e60-4a78-a0e6-a4082190a4fe tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:36.456108 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-afb300f7-7e60-4a78-a0e6-a4082190a4fe tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:36.456750 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-afb300f7-7e60-4a78-a0e6-a4082190a4fe tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:36.459030 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-afb300f7-7e60-4a78-a0e6-a4082190a4fe tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:36.504016 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-82329c6a-9fd9-4859-8e3c-30a29c9ae780 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ace9012a7c4ce59c01858b6984b766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a87a909133e42e1a82e3a623536935c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:36.512500 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-82329c6a-9fd9-4859-8e3c-30a29c9ae780 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] 10.222.0.60 "GET /compute/v2.1/servers/feeb311c-8462-4539-bbc8-4120559413cb" status: 200 len: 1324 microversion: 2.1 time: 0.303792 Sep 14 08:53:36.513732 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 665/1332] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:36 2022] GET /compute/v2.1/servers/feeb311c-8462-4539-bbc8-4120559413cb => generated 1324 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:53:36.518558 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-44444911-cd69-427d-919c-9326e18fe979 tempest-KeyPairsV2TestJSON-328330388 tempest-KeyPairsV2TestJSON-328330388-project] Calling method '.version_select at 0x7f7d443c6700>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:36.523553 n-d-836830-18 devstack@n-api.service[128758]: WARNING oslo_db.sqlalchemy.utils [None req-44444911-cd69-427d-919c-9326e18fe979 tempest-KeyPairsV2TestJSON-328330388 tempest-KeyPairsV2TestJSON-328330388-project] Unique keys not in sort_keys. The sorting order may be unstable. Sep 14 08:53:36.529313 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-44444911-cd69-427d-919c-9326e18fe979 tempest-KeyPairsV2TestJSON-328330388 tempest-KeyPairsV2TestJSON-328330388-project] 10.222.0.60 "GET /compute/v2.1/os-keypairs" status: 200 len: 1092 microversion: 2.1 time: 0.014310 Sep 14 08:53:36.530698 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 666/1333] 10.222.0.60 () {58 vars in 1137 bytes} [Wed Sep 14 08:53:36 2022] GET /compute/v2.1/os-keypairs => generated 1092 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:53:36.536935 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-bd812e86-3dd3-4cb0-8163-09fa1ca0afce req-6fc49422-1147-46dd-8d6a-a8898d426344 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b2a9a93-cad5-4b18-abc3-1b88413f88da", "name": "network-vif-unplugged", "status": "completed", "tag": "3db17a23-17af-436b-96e5-130e5c8353bc"}, {"name": "network-changed", "server_uuid": "1b2a9a93-cad5-4b18-abc3-1b88413f88da", "tag": "3db17a23-17af-436b-96e5-130e5c8353bc"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:53:36.548366 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-bd812e86-3dd3-4cb0-8163-09fa1ca0afce req-6fc49422-1147-46dd-8d6a-a8898d426344 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:36.549124 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-bd812e86-3dd3-4cb0-8163-09fa1ca0afce req-6fc49422-1147-46dd-8d6a-a8898d426344 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:36.549720 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-bd812e86-3dd3-4cb0-8163-09fa1ca0afce req-6fc49422-1147-46dd-8d6a-a8898d426344 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:36.566107 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-bd812e86-3dd3-4cb0-8163-09fa1ca0afce req-6fc49422-1147-46dd-8d6a-a8898d426344 service nova] Creating event network-vif-unplugged:3db17a23-17af-436b-96e5-130e5c8353bc for instance 1b2a9a93-cad5-4b18-abc3-1b88413f88da on n-h1-836830-18 Sep 14 08:53:36.566779 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-bd812e86-3dd3-4cb0-8163-09fa1ca0afce req-6fc49422-1147-46dd-8d6a-a8898d426344 service nova] Creating event network-changed:3db17a23-17af-436b-96e5-130e5c8353bc for instance 1b2a9a93-cad5-4b18-abc3-1b88413f88da on n-h1-836830-18 Sep 14 08:53:36.573440 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [req-bd812e86-3dd3-4cb0-8163-09fa1ca0afce req-6fc49422-1147-46dd-8d6a-a8898d426344 service nova] Instance 1b2a9a93-cad5-4b18-abc3-1b88413f88da is migrating within the same cell, copying events to all relevant hosts: {'n-h1-836830-18', 'n-h2-836830-18'} {{(pid=128758) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 14 08:53:36.586081 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-bd812e86-3dd3-4cb0-8163-09fa1ca0afce req-6fc49422-1147-46dd-8d6a-a8898d426344 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.053826 Sep 14 08:53:36.586623 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 667/1334] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:53:36 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:53:36.592292 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-5714f82c-78e8-45c6-a266-76cc8011a381 tempest-KeyPairsV2TestJSON-328330388 tempest-KeyPairsV2TestJSON-328330388-project] Calling method '.version_select at 0x7f7d443fc550>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:36.614264 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-5714f82c-78e8-45c6-a266-76cc8011a381 tempest-KeyPairsV2TestJSON-328330388 tempest-KeyPairsV2TestJSON-328330388-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-12093893" status: 202 len: 0 microversion: 2.1 time: 0.026104 Sep 14 08:53:36.615139 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 668/1335] 10.222.0.60 () {58 vars in 1272 bytes} [Wed Sep 14 08:53:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-12093893 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 08:53:36.622959 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-79dbfdca-7c61-4fdb-8d65-21d690bdeb75 tempest-KeyPairsV2TestJSON-328330388 tempest-KeyPairsV2TestJSON-328330388-project] Calling method '.version_select at 0x7f7d443f2670>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:36.643449 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-79dbfdca-7c61-4fdb-8d65-21d690bdeb75 tempest-KeyPairsV2TestJSON-328330388 tempest-KeyPairsV2TestJSON-328330388-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1263931443" status: 202 len: 0 microversion: 2.1 time: 0.024235 Sep 14 08:53:36.644256 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 669/1336] 10.222.0.60 () {58 vars in 1278 bytes} [Wed Sep 14 08:53:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1263931443 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 14 08:53:36.654530 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-30d66cd3-1f06-4400-a0d6-50cd72511fe5 tempest-KeyPairsV2TestJSON-328330388 tempest-KeyPairsV2TestJSON-328330388-project] Calling method '.version_select at 0x7f7d44418160>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:36.680828 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-30d66cd3-1f06-4400-a0d6-50cd72511fe5 tempest-KeyPairsV2TestJSON-328330388 tempest-KeyPairsV2TestJSON-328330388-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1613430038" status: 202 len: 0 microversion: 2.1 time: 0.031440 Sep 14 08:53:36.681640 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 670/1337] 10.222.0.60 () {58 vars in 1278 bytes} [Wed Sep 14 08:53:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1613430038 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 08:53:36.709754 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-afb300f7-7e60-4a78-a0e6-a4082190a4fe tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:36.752140 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-afb300f7-7e60-4a78-a0e6-a4082190a4fe tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:36.756764 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-afb300f7-7e60-4a78-a0e6-a4082190a4fe tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:36.762423 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-afb300f7-7e60-4a78-a0e6-a4082190a4fe tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd" status: 200 len: 1815 microversion: 2.25 time: 0.325736 Sep 14 08:53:36.779471 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 668/1338] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:53:36 2022] GET /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd => generated 1815 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:53:36.861504 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-150fff93-f527-4a27-b0bd-3bde5c7994c7 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:36.862247 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-150fff93-f527-4a27-b0bd-3bde5c7994c7 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] [instance: 4ea5843e-ecf7-4b84-80cb-3f05b2b20982] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:36.869295 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-150fff93-f527-4a27-b0bd-3bde5c7994c7 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:36.869787 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-150fff93-f527-4a27-b0bd-3bde5c7994c7 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:36.870223 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-150fff93-f527-4a27-b0bd-3bde5c7994c7 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:36.870925 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-150fff93-f527-4a27-b0bd-3bde5c7994c7 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:36.871416 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-150fff93-f527-4a27-b0bd-3bde5c7994c7 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:36.875479 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-150fff93-f527-4a27-b0bd-3bde5c7994c7 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:37.021606 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-2a218ec2-81f5-40bf-836d-6b3b16df8968 tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:37.022620 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-2a218ec2-81f5-40bf-836d-6b3b16df8968 tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] [instance: 505d2e57-caf3-43d1-b6d6-9678e38c1aab] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:37.029213 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2a218ec2-81f5-40bf-836d-6b3b16df8968 tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:37.029791 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2a218ec2-81f5-40bf-836d-6b3b16df8968 tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:37.030414 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2a218ec2-81f5-40bf-836d-6b3b16df8968 tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:37.031234 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2a218ec2-81f5-40bf-836d-6b3b16df8968 tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:37.031768 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2a218ec2-81f5-40bf-836d-6b3b16df8968 tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:37.035382 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2a218ec2-81f5-40bf-836d-6b3b16df8968 tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:37.228084 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-150fff93-f527-4a27-b0bd-3bde5c7994c7 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810376d6f0b4329abe0f8f79800b754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575684f36f9c4019926fc83541e152c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:37.250715 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-150fff93-f527-4a27-b0bd-3bde5c7994c7 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] 10.222.0.60 "GET /compute/v2.1/servers/4ea5843e-ecf7-4b84-80cb-3f05b2b20982" status: 200 len: 1293 microversion: 2.1 time: 0.392422 Sep 14 08:53:37.251594 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 671/1339] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:36 2022] GET /compute/v2.1/servers/4ea5843e-ecf7-4b84-80cb-3f05b2b20982 => generated 1293 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:53:37.369426 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-2a218ec2-81f5-40bf-836d-6b3b16df8968 tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c562ad6d5022429ba559a25c20c7569b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '545d0b704b5d455c8ffaeacb7cebace0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:37.383410 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c17176bb-0fd4-4e80-9eb2-73dc3c307b3a tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:37.384240 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-2a218ec2-81f5-40bf-836d-6b3b16df8968 tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] 10.222.0.60 "GET /compute/v2.1/servers/505d2e57-caf3-43d1-b6d6-9678e38c1aab" status: 200 len: 1323 microversion: 2.1 time: 0.366229 Sep 14 08:53:37.384430 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-c17176bb-0fd4-4e80-9eb2-73dc3c307b3a tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: 1b2a9a93-cad5-4b18-abc3-1b88413f88da] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:37.387403 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=6,nova_api:INSERT=3 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:53:37.393788 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 669/1340] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:37 2022] GET /compute/v2.1/servers/505d2e57-caf3-43d1-b6d6-9678e38c1aab => generated 1323 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:53:37.396275 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c17176bb-0fd4-4e80-9eb2-73dc3c307b3a tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:37.396969 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c17176bb-0fd4-4e80-9eb2-73dc3c307b3a tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:37.398789 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c17176bb-0fd4-4e80-9eb2-73dc3c307b3a tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:37.399653 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c17176bb-0fd4-4e80-9eb2-73dc3c307b3a tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:37.400220 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c17176bb-0fd4-4e80-9eb2-73dc3c307b3a tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:37.400746 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c17176bb-0fd4-4e80-9eb2-73dc3c307b3a tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:37.549440 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-7c01c7a5-b825-46c8-bd3b-d5aee707507d tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:37.550510 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-7c01c7a5-b825-46c8-bd3b-d5aee707507d tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] [instance: feeb311c-8462-4539-bbc8-4120559413cb] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:37.560204 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7c01c7a5-b825-46c8-bd3b-d5aee707507d tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:37.561068 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7c01c7a5-b825-46c8-bd3b-d5aee707507d tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:37.561738 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7c01c7a5-b825-46c8-bd3b-d5aee707507d tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:37.562739 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7c01c7a5-b825-46c8-bd3b-d5aee707507d tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:37.563446 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7c01c7a5-b825-46c8-bd3b-d5aee707507d tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:37.564136 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7c01c7a5-b825-46c8-bd3b-d5aee707507d tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:37.676588 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-c17176bb-0fd4-4e80-9eb2-73dc3c307b3a tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:37.689101 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-c17176bb-0fd4-4e80-9eb2-73dc3c307b3a tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/1b2a9a93-cad5-4b18-abc3-1b88413f88da" status: 200 len: 1474 microversion: 2.1 time: 0.310108 Sep 14 08:53:37.690529 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 672/1341] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:37 2022] GET /compute/v2.1/servers/1b2a9a93-cad5-4b18-abc3-1b88413f88da => generated 1474 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:53:37.769184 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-7c01c7a5-b825-46c8-bd3b-d5aee707507d tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ace9012a7c4ce59c01858b6984b766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a87a909133e42e1a82e3a623536935c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:37.777397 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-7c01c7a5-b825-46c8-bd3b-d5aee707507d tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] 10.222.0.60 "GET /compute/v2.1/servers/feeb311c-8462-4539-bbc8-4120559413cb" status: 200 len: 1324 microversion: 2.1 time: 0.234113 Sep 14 08:53:37.778210 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 670/1342] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:37 2022] GET /compute/v2.1/servers/feeb311c-8462-4539-bbc8-4120559413cb => generated 1324 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:53:37.796677 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-fcf06099-7b59-4c20-b958-34f22eb9c1f3 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:37.797488 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-fcf06099-7b59-4c20-b958-34f22eb9c1f3 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: 8fce8438-d6ae-408d-8b4f-ee14d4021fdd] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:37.810628 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fcf06099-7b59-4c20-b958-34f22eb9c1f3 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:37.811206 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fcf06099-7b59-4c20-b958-34f22eb9c1f3 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:37.811887 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fcf06099-7b59-4c20-b958-34f22eb9c1f3 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:37.812660 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fcf06099-7b59-4c20-b958-34f22eb9c1f3 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:37.813116 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fcf06099-7b59-4c20-b958-34f22eb9c1f3 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:37.813594 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fcf06099-7b59-4c20-b958-34f22eb9c1f3 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:37.963317 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-fcf06099-7b59-4c20-b958-34f22eb9c1f3 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:37.977892 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-fcf06099-7b59-4c20-b958-34f22eb9c1f3 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:37.979652 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-fcf06099-7b59-4c20-b958-34f22eb9c1f3 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:37.981033 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-fcf06099-7b59-4c20-b958-34f22eb9c1f3 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd" status: 200 len: 1815 microversion: 2.25 time: 0.189139 Sep 14 08:53:37.982447 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 673/1343] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:53:37 2022] GET /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd => generated 1815 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:53:38.274816 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8108fda4-1a2b-4905-8829-1f2479733775 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:38.275478 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-8108fda4-1a2b-4905-8829-1f2479733775 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] [instance: 4ea5843e-ecf7-4b84-80cb-3f05b2b20982] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:38.282873 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8108fda4-1a2b-4905-8829-1f2479733775 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:38.283612 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8108fda4-1a2b-4905-8829-1f2479733775 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:38.284115 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8108fda4-1a2b-4905-8829-1f2479733775 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:38.286189 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8108fda4-1a2b-4905-8829-1f2479733775 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:38.286723 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8108fda4-1a2b-4905-8829-1f2479733775 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:38.287194 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8108fda4-1a2b-4905-8829-1f2479733775 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:38.412004 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-98aa9f4a-1236-4901-8765-a576a5bf4e6f tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:38.413036 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-98aa9f4a-1236-4901-8765-a576a5bf4e6f tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] [instance: 505d2e57-caf3-43d1-b6d6-9678e38c1aab] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:38.422849 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-98aa9f4a-1236-4901-8765-a576a5bf4e6f tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:38.423487 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-98aa9f4a-1236-4901-8765-a576a5bf4e6f tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:38.424047 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-98aa9f4a-1236-4901-8765-a576a5bf4e6f tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:38.425082 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-98aa9f4a-1236-4901-8765-a576a5bf4e6f tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:38.425647 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-98aa9f4a-1236-4901-8765-a576a5bf4e6f tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:38.427145 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-98aa9f4a-1236-4901-8765-a576a5bf4e6f tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:38.447277 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-8108fda4-1a2b-4905-8829-1f2479733775 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810376d6f0b4329abe0f8f79800b754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575684f36f9c4019926fc83541e152c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:38.458236 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-8108fda4-1a2b-4905-8829-1f2479733775 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] 10.222.0.60 "GET /compute/v2.1/servers/4ea5843e-ecf7-4b84-80cb-3f05b2b20982" status: 200 len: 1293 microversion: 2.1 time: 0.188441 Sep 14 08:53:38.459473 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 671/1344] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:38 2022] GET /compute/v2.1/servers/4ea5843e-ecf7-4b84-80cb-3f05b2b20982 => generated 1293 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:53:38.610816 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-98aa9f4a-1236-4901-8765-a576a5bf4e6f tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c562ad6d5022429ba559a25c20c7569b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '545d0b704b5d455c8ffaeacb7cebace0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:38.619648 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-98aa9f4a-1236-4901-8765-a576a5bf4e6f tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] 10.222.0.60 "GET /compute/v2.1/servers/505d2e57-caf3-43d1-b6d6-9678e38c1aab" status: 200 len: 1323 microversion: 2.1 time: 0.213418 Sep 14 08:53:38.620393 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 674/1345] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:38 2022] GET /compute/v2.1/servers/505d2e57-caf3-43d1-b6d6-9678e38c1aab => generated 1323 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:53:38.714476 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ea7472ac-0a4d-4355-925e-87d336f72ebf tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:38.715397 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-ea7472ac-0a4d-4355-925e-87d336f72ebf tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: 1b2a9a93-cad5-4b18-abc3-1b88413f88da] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:38.723494 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ea7472ac-0a4d-4355-925e-87d336f72ebf tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:38.724202 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ea7472ac-0a4d-4355-925e-87d336f72ebf tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:38.724956 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ea7472ac-0a4d-4355-925e-87d336f72ebf tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:38.726576 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ea7472ac-0a4d-4355-925e-87d336f72ebf tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:38.727515 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ea7472ac-0a4d-4355-925e-87d336f72ebf tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:38.728328 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ea7472ac-0a4d-4355-925e-87d336f72ebf tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:38.805730 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b00f99e5-9daf-4ce4-b14d-5d7ea5581e3e tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:38.806123 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-b00f99e5-9daf-4ce4-b14d-5d7ea5581e3e tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] [instance: feeb311c-8462-4539-bbc8-4120559413cb] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:38.812102 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b00f99e5-9daf-4ce4-b14d-5d7ea5581e3e tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:38.812587 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b00f99e5-9daf-4ce4-b14d-5d7ea5581e3e tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:38.813016 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b00f99e5-9daf-4ce4-b14d-5d7ea5581e3e tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:38.813720 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b00f99e5-9daf-4ce4-b14d-5d7ea5581e3e tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:38.814344 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b00f99e5-9daf-4ce4-b14d-5d7ea5581e3e tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:38.814960 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b00f99e5-9daf-4ce4-b14d-5d7ea5581e3e tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:38.895622 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-ea7472ac-0a4d-4355-925e-87d336f72ebf tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:38.904981 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-ea7472ac-0a4d-4355-925e-87d336f72ebf tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/1b2a9a93-cad5-4b18-abc3-1b88413f88da" status: 200 len: 1474 microversion: 2.1 time: 0.195642 Sep 14 08:53:38.915783 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 672/1346] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:38 2022] GET /compute/v2.1/servers/1b2a9a93-cad5-4b18-abc3-1b88413f88da => generated 1474 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:53:39.009420 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e3de226d-7b10-4179-85f4-ee0b2bdd8519 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:39.010082 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e3de226d-7b10-4179-85f4-ee0b2bdd8519 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: 8fce8438-d6ae-408d-8b4f-ee14d4021fdd] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:39.019024 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e3de226d-7b10-4179-85f4-ee0b2bdd8519 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:39.020426 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e3de226d-7b10-4179-85f4-ee0b2bdd8519 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:39.020538 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e3de226d-7b10-4179-85f4-ee0b2bdd8519 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:39.021753 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e3de226d-7b10-4179-85f4-ee0b2bdd8519 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:39.022274 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e3de226d-7b10-4179-85f4-ee0b2bdd8519 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:39.022699 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e3de226d-7b10-4179-85f4-ee0b2bdd8519 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:39.059073 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-b00f99e5-9daf-4ce4-b14d-5d7ea5581e3e tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ace9012a7c4ce59c01858b6984b766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a87a909133e42e1a82e3a623536935c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:39.074331 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-b00f99e5-9daf-4ce4-b14d-5d7ea5581e3e tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] 10.222.0.60 "GET /compute/v2.1/servers/feeb311c-8462-4539-bbc8-4120559413cb" status: 200 len: 1324 microversion: 2.1 time: 0.273043 Sep 14 08:53:39.082976 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 675/1347] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:38 2022] GET /compute/v2.1/servers/feeb311c-8462-4539-bbc8-4120559413cb => generated 1324 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:53:39.217064 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-e3de226d-7b10-4179-85f4-ee0b2bdd8519 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:39.228533 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-e3de226d-7b10-4179-85f4-ee0b2bdd8519 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:39.230112 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-e3de226d-7b10-4179-85f4-ee0b2bdd8519 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:39.231347 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e3de226d-7b10-4179-85f4-ee0b2bdd8519 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd" status: 200 len: 1815 microversion: 2.25 time: 0.227742 Sep 14 08:53:39.232024 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 673/1348] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:53:39 2022] GET /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd => generated 1815 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 08:53:39.484488 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-70979b2f-0e03-4798-9f92-28e8036091c7 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:39.485103 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-70979b2f-0e03-4798-9f92-28e8036091c7 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] [instance: 4ea5843e-ecf7-4b84-80cb-3f05b2b20982] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:39.489569 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=3 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:53:39.496544 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-70979b2f-0e03-4798-9f92-28e8036091c7 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:39.497037 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-70979b2f-0e03-4798-9f92-28e8036091c7 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:39.497466 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-70979b2f-0e03-4798-9f92-28e8036091c7 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:39.498453 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-70979b2f-0e03-4798-9f92-28e8036091c7 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:39.499099 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-70979b2f-0e03-4798-9f92-28e8036091c7 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:39.499527 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-70979b2f-0e03-4798-9f92-28e8036091c7 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:39.642449 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-5157cf4f-3ffd-4d42-b369-ae014ae7355d tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:39.643169 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-5157cf4f-3ffd-4d42-b369-ae014ae7355d tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] [instance: 505d2e57-caf3-43d1-b6d6-9678e38c1aab] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:39.651303 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5157cf4f-3ffd-4d42-b369-ae014ae7355d tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:39.652163 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5157cf4f-3ffd-4d42-b369-ae014ae7355d tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:39.652917 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5157cf4f-3ffd-4d42-b369-ae014ae7355d tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:39.654386 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5157cf4f-3ffd-4d42-b369-ae014ae7355d tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:39.655537 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5157cf4f-3ffd-4d42-b369-ae014ae7355d tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:39.656198 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5157cf4f-3ffd-4d42-b369-ae014ae7355d tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:39.701873 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-70979b2f-0e03-4798-9f92-28e8036091c7 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810376d6f0b4329abe0f8f79800b754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575684f36f9c4019926fc83541e152c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:39.710115 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-70979b2f-0e03-4798-9f92-28e8036091c7 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] 10.222.0.60 "GET /compute/v2.1/servers/4ea5843e-ecf7-4b84-80cb-3f05b2b20982" status: 200 len: 1293 microversion: 2.1 time: 0.230227 Sep 14 08:53:39.710799 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 676/1349] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:39 2022] GET /compute/v2.1/servers/4ea5843e-ecf7-4b84-80cb-3f05b2b20982 => generated 1293 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:53:39.943908 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-4807ce46-c576-4bf2-9ea3-9c6f35da6ed4 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:39.944869 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-4807ce46-c576-4bf2-9ea3-9c6f35da6ed4 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: 1b2a9a93-cad5-4b18-abc3-1b88413f88da] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:39.954898 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4807ce46-c576-4bf2-9ea3-9c6f35da6ed4 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:39.956092 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4807ce46-c576-4bf2-9ea3-9c6f35da6ed4 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:39.956710 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4807ce46-c576-4bf2-9ea3-9c6f35da6ed4 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:39.958072 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4807ce46-c576-4bf2-9ea3-9c6f35da6ed4 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:39.958850 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4807ce46-c576-4bf2-9ea3-9c6f35da6ed4 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:39.959463 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4807ce46-c576-4bf2-9ea3-9c6f35da6ed4 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:40.003806 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-5157cf4f-3ffd-4d42-b369-ae014ae7355d tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c562ad6d5022429ba559a25c20c7569b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '545d0b704b5d455c8ffaeacb7cebace0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:40.013100 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-5157cf4f-3ffd-4d42-b369-ae014ae7355d tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] 10.222.0.60 "GET /compute/v2.1/servers/505d2e57-caf3-43d1-b6d6-9678e38c1aab" status: 200 len: 1323 microversion: 2.1 time: 0.374526 Sep 14 08:53:40.014603 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 674/1350] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:39 2022] GET /compute/v2.1/servers/505d2e57-caf3-43d1-b6d6-9678e38c1aab => generated 1323 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:53:40.102335 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d99ca1a0-438f-4035-87c8-555f8fd483e5 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:40.103961 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-d99ca1a0-438f-4035-87c8-555f8fd483e5 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] [instance: feeb311c-8462-4539-bbc8-4120559413cb] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:40.112625 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d99ca1a0-438f-4035-87c8-555f8fd483e5 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:40.113394 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d99ca1a0-438f-4035-87c8-555f8fd483e5 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:40.114243 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d99ca1a0-438f-4035-87c8-555f8fd483e5 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:40.115191 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d99ca1a0-438f-4035-87c8-555f8fd483e5 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:40.115809 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d99ca1a0-438f-4035-87c8-555f8fd483e5 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:40.116568 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d99ca1a0-438f-4035-87c8-555f8fd483e5 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:40.259390 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-4807ce46-c576-4bf2-9ea3-9c6f35da6ed4 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:40.273121 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-4807ce46-c576-4bf2-9ea3-9c6f35da6ed4 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/1b2a9a93-cad5-4b18-abc3-1b88413f88da" status: 200 len: 1472 microversion: 2.1 time: 0.336181 Sep 14 08:53:40.274468 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 677/1351] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:39 2022] GET /compute/v2.1/servers/1b2a9a93-cad5-4b18-abc3-1b88413f88da => generated 1472 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:53:40.279843 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-0919f499-458c-4a6a-afab-4f484183099a tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:40.280677 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-0919f499-458c-4a6a-afab-4f484183099a tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: 8fce8438-d6ae-408d-8b4f-ee14d4021fdd] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:40.291200 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0919f499-458c-4a6a-afab-4f484183099a tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:40.291700 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0919f499-458c-4a6a-afab-4f484183099a tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:40.292140 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0919f499-458c-4a6a-afab-4f484183099a tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:40.292851 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0919f499-458c-4a6a-afab-4f484183099a tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:40.293310 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0919f499-458c-4a6a-afab-4f484183099a tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:40.293735 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0919f499-458c-4a6a-afab-4f484183099a tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:40.502531 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-d99ca1a0-438f-4035-87c8-555f8fd483e5 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ace9012a7c4ce59c01858b6984b766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a87a909133e42e1a82e3a623536935c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:40.511618 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d99ca1a0-438f-4035-87c8-555f8fd483e5 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] 10.222.0.60 "GET /compute/v2.1/servers/feeb311c-8462-4539-bbc8-4120559413cb" status: 200 len: 1324 microversion: 2.1 time: 0.415925 Sep 14 08:53:40.512359 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 675/1352] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:40 2022] GET /compute/v2.1/servers/feeb311c-8462-4539-bbc8-4120559413cb => generated 1324 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:53:40.589568 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-0919f499-458c-4a6a-afab-4f484183099a tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:40.599197 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-0919f499-458c-4a6a-afab-4f484183099a tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:40.600624 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-0919f499-458c-4a6a-afab-4f484183099a tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:40.601780 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-0919f499-458c-4a6a-afab-4f484183099a tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd" status: 200 len: 1815 microversion: 2.25 time: 0.326078 Sep 14 08:53:40.602333 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 678/1353] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:53:40 2022] GET /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd => generated 1815 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:53:40.733335 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9e3909d1-2932-41a9-ae06-c2cfaa3de413 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:40.733984 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-9e3909d1-2932-41a9-ae06-c2cfaa3de413 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] [instance: 4ea5843e-ecf7-4b84-80cb-3f05b2b20982] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:40.742105 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9e3909d1-2932-41a9-ae06-c2cfaa3de413 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:40.742384 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9e3909d1-2932-41a9-ae06-c2cfaa3de413 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:40.742847 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9e3909d1-2932-41a9-ae06-c2cfaa3de413 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:40.743599 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9e3909d1-2932-41a9-ae06-c2cfaa3de413 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:40.744045 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9e3909d1-2932-41a9-ae06-c2cfaa3de413 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:40.744506 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9e3909d1-2932-41a9-ae06-c2cfaa3de413 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:41.007933 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-9e3909d1-2932-41a9-ae06-c2cfaa3de413 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810376d6f0b4329abe0f8f79800b754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575684f36f9c4019926fc83541e152c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:41.016719 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-9e3909d1-2932-41a9-ae06-c2cfaa3de413 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] 10.222.0.60 "GET /compute/v2.1/servers/4ea5843e-ecf7-4b84-80cb-3f05b2b20982" status: 200 len: 1293 microversion: 2.1 time: 0.286988 Sep 14 08:53:41.017717 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 676/1354] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:40 2022] GET /compute/v2.1/servers/4ea5843e-ecf7-4b84-80cb-3f05b2b20982 => generated 1293 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:53:41.036828 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-39e3e24d-6cf5-42d7-8207-e41e3c51abcf tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:41.037582 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-39e3e24d-6cf5-42d7-8207-e41e3c51abcf tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] [instance: 505d2e57-caf3-43d1-b6d6-9678e38c1aab] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:41.043996 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-39e3e24d-6cf5-42d7-8207-e41e3c51abcf tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:41.044740 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-39e3e24d-6cf5-42d7-8207-e41e3c51abcf tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:41.045495 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-39e3e24d-6cf5-42d7-8207-e41e3c51abcf tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:41.046415 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-39e3e24d-6cf5-42d7-8207-e41e3c51abcf tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:41.047103 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-39e3e24d-6cf5-42d7-8207-e41e3c51abcf tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:41.047759 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-39e3e24d-6cf5-42d7-8207-e41e3c51abcf tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:41.178705 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-ae5451e0-44f5-4eab-a82a-c09333cc2906 req-49fd45cf-4e07-4563-96aa-5e9d2b1ef30a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "feeb311c-8462-4539-bbc8-4120559413cb", "name": "network-vif-plugged", "status": "completed", "tag": "4a1be6f1-1a5b-4e4b-a505-9c04755c817d"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:53:41.189014 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-ae5451e0-44f5-4eab-a82a-c09333cc2906 req-49fd45cf-4e07-4563-96aa-5e9d2b1ef30a service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:41.189756 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-ae5451e0-44f5-4eab-a82a-c09333cc2906 req-49fd45cf-4e07-4563-96aa-5e9d2b1ef30a service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:41.190437 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-ae5451e0-44f5-4eab-a82a-c09333cc2906 req-49fd45cf-4e07-4563-96aa-5e9d2b1ef30a service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:41.202985 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-ae5451e0-44f5-4eab-a82a-c09333cc2906 req-49fd45cf-4e07-4563-96aa-5e9d2b1ef30a service nova] Creating event network-vif-plugged:4a1be6f1-1a5b-4e4b-a505-9c04755c817d for instance feeb311c-8462-4539-bbc8-4120559413cb on n-h2-836830-18 Sep 14 08:53:41.208327 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-ae5451e0-44f5-4eab-a82a-c09333cc2906 req-49fd45cf-4e07-4563-96aa-5e9d2b1ef30a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.212228 Sep 14 08:53:41.209159 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 679/1355] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:53:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:53:41.298208 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-5a587ec1-1e3b-428e-9241-9b2c4b4a9f09 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:41.298916 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-5a587ec1-1e3b-428e-9241-9b2c4b4a9f09 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: 1b2a9a93-cad5-4b18-abc3-1b88413f88da] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:41.313417 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5a587ec1-1e3b-428e-9241-9b2c4b4a9f09 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:41.314030 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5a587ec1-1e3b-428e-9241-9b2c4b4a9f09 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:41.314389 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5a587ec1-1e3b-428e-9241-9b2c4b4a9f09 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:41.316396 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5a587ec1-1e3b-428e-9241-9b2c4b4a9f09 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:41.317035 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5a587ec1-1e3b-428e-9241-9b2c4b4a9f09 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:41.317630 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5a587ec1-1e3b-428e-9241-9b2c4b4a9f09 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:41.360363 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-39e3e24d-6cf5-42d7-8207-e41e3c51abcf tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c562ad6d5022429ba559a25c20c7569b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '545d0b704b5d455c8ffaeacb7cebace0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:41.370363 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-39e3e24d-6cf5-42d7-8207-e41e3c51abcf tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] 10.222.0.60 "GET /compute/v2.1/servers/505d2e57-caf3-43d1-b6d6-9678e38c1aab" status: 200 len: 1323 microversion: 2.1 time: 0.336297 Sep 14 08:53:41.372974 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 677/1356] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:41 2022] GET /compute/v2.1/servers/505d2e57-caf3-43d1-b6d6-9678e38c1aab => generated 1323 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:53:41.535433 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3f911cd5-97f2-45e0-b403-282ec62e9be7 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:41.536437 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-3f911cd5-97f2-45e0-b403-282ec62e9be7 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] [instance: feeb311c-8462-4539-bbc8-4120559413cb] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:41.542460 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3f911cd5-97f2-45e0-b403-282ec62e9be7 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:41.543126 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3f911cd5-97f2-45e0-b403-282ec62e9be7 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:41.543842 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3f911cd5-97f2-45e0-b403-282ec62e9be7 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:41.544833 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3f911cd5-97f2-45e0-b403-282ec62e9be7 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:41.545362 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3f911cd5-97f2-45e0-b403-282ec62e9be7 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:41.546029 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3f911cd5-97f2-45e0-b403-282ec62e9be7 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:41.594279 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-5a587ec1-1e3b-428e-9241-9b2c4b4a9f09 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:41.603513 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-5a587ec1-1e3b-428e-9241-9b2c4b4a9f09 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/1b2a9a93-cad5-4b18-abc3-1b88413f88da" status: 200 len: 1472 microversion: 2.1 time: 0.309391 Sep 14 08:53:41.620031 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 680/1357] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:41 2022] GET /compute/v2.1/servers/1b2a9a93-cad5-4b18-abc3-1b88413f88da => generated 1472 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:53:41.632309 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-72258a57-0ccf-46fd-afa5-82a791bbee27 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:41.633237 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-72258a57-0ccf-46fd-afa5-82a791bbee27 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: 8fce8438-d6ae-408d-8b4f-ee14d4021fdd] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:41.640272 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-72258a57-0ccf-46fd-afa5-82a791bbee27 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:41.640662 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-72258a57-0ccf-46fd-afa5-82a791bbee27 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:41.641955 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-72258a57-0ccf-46fd-afa5-82a791bbee27 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:41.642736 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-72258a57-0ccf-46fd-afa5-82a791bbee27 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:41.643283 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-72258a57-0ccf-46fd-afa5-82a791bbee27 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:41.644076 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-72258a57-0ccf-46fd-afa5-82a791bbee27 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:42.185920 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-3f911cd5-97f2-45e0-b403-282ec62e9be7 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ace9012a7c4ce59c01858b6984b766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a87a909133e42e1a82e3a623536935c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:42.199706 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-3f911cd5-97f2-45e0-b403-282ec62e9be7 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] 10.222.0.60 "GET /compute/v2.1/servers/feeb311c-8462-4539-bbc8-4120559413cb" status: 200 len: 1324 microversion: 2.1 time: 0.668039 Sep 14 08:53:42.201607 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 678/1358] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:41 2022] GET /compute/v2.1/servers/feeb311c-8462-4539-bbc8-4120559413cb => generated 1324 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:53:42.215578 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-7c34aca7-98c4-4c76-9a6e-d926db83383b tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:42.216296 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-7c34aca7-98c4-4c76-9a6e-d926db83383b tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] [instance: 4ea5843e-ecf7-4b84-80cb-3f05b2b20982] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:42.220067 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-72258a57-0ccf-46fd-afa5-82a791bbee27 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:42.223030 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7c34aca7-98c4-4c76-9a6e-d926db83383b tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:42.224641 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7c34aca7-98c4-4c76-9a6e-d926db83383b tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:42.225503 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7c34aca7-98c4-4c76-9a6e-d926db83383b tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:42.226886 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7c34aca7-98c4-4c76-9a6e-d926db83383b tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:42.227552 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7c34aca7-98c4-4c76-9a6e-d926db83383b tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:42.228163 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7c34aca7-98c4-4c76-9a6e-d926db83383b tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:42.231952 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-72258a57-0ccf-46fd-afa5-82a791bbee27 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:42.234326 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-72258a57-0ccf-46fd-afa5-82a791bbee27 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:42.236521 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-72258a57-0ccf-46fd-afa5-82a791bbee27 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd" status: 200 len: 1815 microversion: 2.25 time: 0.608933 Sep 14 08:53:42.237099 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 681/1359] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:53:41 2022] GET /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd => generated 1815 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:53:42.402702 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-cd4c4592-4e60-42b6-a183-1f7727bd727e tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:42.403710 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-cd4c4592-4e60-42b6-a183-1f7727bd727e tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] [instance: 505d2e57-caf3-43d1-b6d6-9678e38c1aab] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:42.410433 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cd4c4592-4e60-42b6-a183-1f7727bd727e tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:42.411952 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cd4c4592-4e60-42b6-a183-1f7727bd727e tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:42.412616 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cd4c4592-4e60-42b6-a183-1f7727bd727e tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:42.413926 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cd4c4592-4e60-42b6-a183-1f7727bd727e tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:42.414416 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cd4c4592-4e60-42b6-a183-1f7727bd727e tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:42.415236 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cd4c4592-4e60-42b6-a183-1f7727bd727e tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:42.573490 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-7c34aca7-98c4-4c76-9a6e-d926db83383b tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810376d6f0b4329abe0f8f79800b754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575684f36f9c4019926fc83541e152c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:42.582588 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-7c34aca7-98c4-4c76-9a6e-d926db83383b tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] 10.222.0.60 "GET /compute/v2.1/servers/4ea5843e-ecf7-4b84-80cb-3f05b2b20982" status: 200 len: 1293 microversion: 2.1 time: 0.379436 Sep 14 08:53:42.583527 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 679/1360] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:42 2022] GET /compute/v2.1/servers/4ea5843e-ecf7-4b84-80cb-3f05b2b20982 => generated 1293 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:53:42.625790 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a13b3691-d833-41ef-850e-e49ea33d92c5 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:42.626425 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-a13b3691-d833-41ef-850e-e49ea33d92c5 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: 1b2a9a93-cad5-4b18-abc3-1b88413f88da] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:42.642724 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a13b3691-d833-41ef-850e-e49ea33d92c5 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:42.643448 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a13b3691-d833-41ef-850e-e49ea33d92c5 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:42.644012 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a13b3691-d833-41ef-850e-e49ea33d92c5 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:42.645243 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a13b3691-d833-41ef-850e-e49ea33d92c5 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:42.645820 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a13b3691-d833-41ef-850e-e49ea33d92c5 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:42.646536 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a13b3691-d833-41ef-850e-e49ea33d92c5 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:42.646975 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-cd4c4592-4e60-42b6-a183-1f7727bd727e tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c562ad6d5022429ba559a25c20c7569b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '545d0b704b5d455c8ffaeacb7cebace0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:42.655575 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-cd4c4592-4e60-42b6-a183-1f7727bd727e tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] 10.222.0.60 "GET /compute/v2.1/servers/505d2e57-caf3-43d1-b6d6-9678e38c1aab" status: 200 len: 1323 microversion: 2.1 time: 0.256657 Sep 14 08:53:42.656170 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 682/1361] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:42 2022] GET /compute/v2.1/servers/505d2e57-caf3-43d1-b6d6-9678e38c1aab => generated 1323 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:53:42.791998 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-a13b3691-d833-41ef-850e-e49ea33d92c5 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:42.801876 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a13b3691-d833-41ef-850e-e49ea33d92c5 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/1b2a9a93-cad5-4b18-abc3-1b88413f88da" status: 200 len: 1472 microversion: 2.1 time: 0.180027 Sep 14 08:53:42.802754 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 680/1362] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:42 2022] GET /compute/v2.1/servers/1b2a9a93-cad5-4b18-abc3-1b88413f88da => generated 1472 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:53:43.227927 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-878ed01f-27f4-468e-baf7-5d6b4532c7eb tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:43.229308 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-878ed01f-27f4-468e-baf7-5d6b4532c7eb tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] [instance: feeb311c-8462-4539-bbc8-4120559413cb] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:43.236087 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-878ed01f-27f4-468e-baf7-5d6b4532c7eb tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:43.236709 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-878ed01f-27f4-468e-baf7-5d6b4532c7eb tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:43.237253 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-878ed01f-27f4-468e-baf7-5d6b4532c7eb tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:43.238078 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-878ed01f-27f4-468e-baf7-5d6b4532c7eb tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:43.238734 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-878ed01f-27f4-468e-baf7-5d6b4532c7eb tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:43.239367 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-878ed01f-27f4-468e-baf7-5d6b4532c7eb tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:43.264310 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c21b4066-6bdf-4415-8fc0-8a76d01ac393 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:43.265708 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-c21b4066-6bdf-4415-8fc0-8a76d01ac393 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: 8fce8438-d6ae-408d-8b4f-ee14d4021fdd] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:43.287428 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c21b4066-6bdf-4415-8fc0-8a76d01ac393 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:43.287949 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c21b4066-6bdf-4415-8fc0-8a76d01ac393 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:43.288387 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c21b4066-6bdf-4415-8fc0-8a76d01ac393 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:43.289117 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c21b4066-6bdf-4415-8fc0-8a76d01ac393 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:43.289581 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c21b4066-6bdf-4415-8fc0-8a76d01ac393 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:43.290012 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c21b4066-6bdf-4415-8fc0-8a76d01ac393 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:43.535843 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-c21b4066-6bdf-4415-8fc0-8a76d01ac393 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:43.538067 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=100 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:53:43.547140 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-c21b4066-6bdf-4415-8fc0-8a76d01ac393 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:43.553113 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-c21b4066-6bdf-4415-8fc0-8a76d01ac393 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:43.559491 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-c21b4066-6bdf-4415-8fc0-8a76d01ac393 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd" status: 200 len: 1815 microversion: 2.25 time: 0.298933 Sep 14 08:53:43.560561 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 681/1363] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:53:43 2022] GET /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd => generated 1815 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 08:53:43.573347 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-878ed01f-27f4-468e-baf7-5d6b4532c7eb tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ace9012a7c4ce59c01858b6984b766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a87a909133e42e1a82e3a623536935c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:43.586496 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-878ed01f-27f4-468e-baf7-5d6b4532c7eb tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] 10.222.0.60 "GET /compute/v2.1/servers/feeb311c-8462-4539-bbc8-4120559413cb" status: 200 len: 1521 microversion: 2.1 time: 0.362640 Sep 14 08:53:43.599373 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 683/1364] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:43 2022] GET /compute/v2.1/servers/feeb311c-8462-4539-bbc8-4120559413cb => generated 1521 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:53:43.605435 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-5de59713-42d4-44b2-af51-54c31c3a6034 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:43.606204 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-5de59713-42d4-44b2-af51-54c31c3a6034 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] [instance: 4ea5843e-ecf7-4b84-80cb-3f05b2b20982] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:43.616156 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-cdc9ae85-b294-48cb-a6b7-b18560a1fe76 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:43.616774 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-cdc9ae85-b294-48cb-a6b7-b18560a1fe76 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] [instance: feeb311c-8462-4539-bbc8-4120559413cb] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:43.624741 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cdc9ae85-b294-48cb-a6b7-b18560a1fe76 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:43.625528 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5de59713-42d4-44b2-af51-54c31c3a6034 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:43.625696 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cdc9ae85-b294-48cb-a6b7-b18560a1fe76 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:43.626035 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5de59713-42d4-44b2-af51-54c31c3a6034 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:43.626455 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cdc9ae85-b294-48cb-a6b7-b18560a1fe76 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:43.626600 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5de59713-42d4-44b2-af51-54c31c3a6034 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:43.627470 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5de59713-42d4-44b2-af51-54c31c3a6034 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:43.627649 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cdc9ae85-b294-48cb-a6b7-b18560a1fe76 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:43.627924 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5de59713-42d4-44b2-af51-54c31c3a6034 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:43.628399 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5de59713-42d4-44b2-af51-54c31c3a6034 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:43.628582 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cdc9ae85-b294-48cb-a6b7-b18560a1fe76 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:43.629722 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cdc9ae85-b294-48cb-a6b7-b18560a1fe76 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:43.636073 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=100 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:53:43.867362 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-5de59713-42d4-44b2-af51-54c31c3a6034 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810376d6f0b4329abe0f8f79800b754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575684f36f9c4019926fc83541e152c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:43.867783 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-cdc9ae85-b294-48cb-a6b7-b18560a1fe76 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ace9012a7c4ce59c01858b6984b766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a87a909133e42e1a82e3a623536935c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:43.876267 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-5de59713-42d4-44b2-af51-54c31c3a6034 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] 10.222.0.60 "GET /compute/v2.1/servers/4ea5843e-ecf7-4b84-80cb-3f05b2b20982" status: 200 len: 1293 microversion: 2.1 time: 0.274886 Sep 14 08:53:43.876860 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 682/1365] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:43 2022] GET /compute/v2.1/servers/4ea5843e-ecf7-4b84-80cb-3f05b2b20982 => generated 1293 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:53:43.884734 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-23fec95b-c60a-4e09-9adb-190651d5b28d tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:43.884734 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-23fec95b-c60a-4e09-9adb-190651d5b28d tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] [instance: 505d2e57-caf3-43d1-b6d6-9678e38c1aab] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:43.889048 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-cdc9ae85-b294-48cb-a6b7-b18560a1fe76 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] 10.222.0.60 "GET /compute/v2.1/servers/feeb311c-8462-4539-bbc8-4120559413cb" status: 200 len: 1521 microversion: 2.1 time: 0.276868 Sep 14 08:53:43.889576 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-23fec95b-c60a-4e09-9adb-190651d5b28d tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:43.890280 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-23fec95b-c60a-4e09-9adb-190651d5b28d tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:43.891043 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-23fec95b-c60a-4e09-9adb-190651d5b28d tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:43.892316 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-23fec95b-c60a-4e09-9adb-190651d5b28d tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:43.892935 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 684/1366] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:43 2022] GET /compute/v2.1/servers/feeb311c-8462-4539-bbc8-4120559413cb => generated 1521 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:53:43.893088 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-23fec95b-c60a-4e09-9adb-190651d5b28d tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:43.893667 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-23fec95b-c60a-4e09-9adb-190651d5b28d tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:43.905753 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-83e07797-026b-41d5-af41-5060f030aa8f tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:43.907003 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-83e07797-026b-41d5-af41-5060f030aa8f tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: 1b2a9a93-cad5-4b18-abc3-1b88413f88da] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:43.919611 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-83e07797-026b-41d5-af41-5060f030aa8f tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:43.920152 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-83e07797-026b-41d5-af41-5060f030aa8f tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:43.920601 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-83e07797-026b-41d5-af41-5060f030aa8f tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:43.922227 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-83e07797-026b-41d5-af41-5060f030aa8f tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:43.923157 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-83e07797-026b-41d5-af41-5060f030aa8f tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:43.923760 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-83e07797-026b-41d5-af41-5060f030aa8f tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:44.141576 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-83e07797-026b-41d5-af41-5060f030aa8f tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:44.158708 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-83e07797-026b-41d5-af41-5060f030aa8f tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/1b2a9a93-cad5-4b18-abc3-1b88413f88da" status: 200 len: 1472 microversion: 2.1 time: 0.263985 Sep 14 08:53:44.172834 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-23fec95b-c60a-4e09-9adb-190651d5b28d tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c562ad6d5022429ba559a25c20c7569b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '545d0b704b5d455c8ffaeacb7cebace0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:44.176291 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 685/1367] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:43 2022] GET /compute/v2.1/servers/1b2a9a93-cad5-4b18-abc3-1b88413f88da => generated 1472 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:53:44.186204 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-23fec95b-c60a-4e09-9adb-190651d5b28d tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] 10.222.0.60 "GET /compute/v2.1/servers/505d2e57-caf3-43d1-b6d6-9678e38c1aab" status: 200 len: 1323 microversion: 2.1 time: 0.303776 Sep 14 08:53:44.186588 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-61a2060e-1bc2-4c3e-811a-7c140c9b236d tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-317607980"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:53:44.186855 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 683/1368] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:43 2022] GET /compute/v2.1/servers/505d2e57-caf3-43d1-b6d6-9678e38c1aab => generated 1323 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:53:44.189676 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-61a2060e-1bc2-4c3e-811a-7c140c9b236d tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] [instance: feeb311c-8462-4539-bbc8-4120559413cb] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:44.196173 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-61a2060e-1bc2-4c3e-811a-7c140c9b236d tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:44.196965 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-61a2060e-1bc2-4c3e-811a-7c140c9b236d tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:44.197652 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-61a2060e-1bc2-4c3e-811a-7c140c9b236d tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:44.198599 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-61a2060e-1bc2-4c3e-811a-7c140c9b236d tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:44.199230 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-61a2060e-1bc2-4c3e-811a-7c140c9b236d tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:44.199698 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-61a2060e-1bc2-4c3e-811a-7c140c9b236d tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:44.367194 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-0884dc15-9fd3-4b92-b535-4dc96674c3ae req-4bb73902-bd5f-4c17-9236-51de6b5a9ec2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "505d2e57-caf3-43d1-b6d6-9678e38c1aab", "name": "network-vif-plugged", "status": "completed", "tag": "84d11647-e317-4b0b-b0cb-70b8cae4e6fb"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:53:44.382513 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-0884dc15-9fd3-4b92-b535-4dc96674c3ae req-4bb73902-bd5f-4c17-9236-51de6b5a9ec2 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:44.383788 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-0884dc15-9fd3-4b92-b535-4dc96674c3ae req-4bb73902-bd5f-4c17-9236-51de6b5a9ec2 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:44.384582 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-0884dc15-9fd3-4b92-b535-4dc96674c3ae req-4bb73902-bd5f-4c17-9236-51de6b5a9ec2 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:44.405655 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-0884dc15-9fd3-4b92-b535-4dc96674c3ae req-4bb73902-bd5f-4c17-9236-51de6b5a9ec2 service nova] Creating event network-vif-plugged:84d11647-e317-4b0b-b0cb-70b8cae4e6fb for instance 505d2e57-caf3-43d1-b6d6-9678e38c1aab on n-h1-836830-18 Sep 14 08:53:44.418248 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-0884dc15-9fd3-4b92-b535-4dc96674c3ae req-4bb73902-bd5f-4c17-9236-51de6b5a9ec2 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058661 Sep 14 08:53:44.420287 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 684/1369] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:53:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:53:44.489350 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-61a2060e-1bc2-4c3e-811a-7c140c9b236d tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] 10.222.0.60 "POST /compute/v2.1/servers/feeb311c-8462-4539-bbc8-4120559413cb/action" status: 202 len: 0 microversion: 2.1 time: 0.310669 Sep 14 08:53:44.490021 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 686/1370] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 08:53:44 2022] POST /compute/v2.1/servers/feeb311c-8462-4539-bbc8-4120559413cb/action => generated 0 bytes in 313 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 14 08:53:44.501241 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f42905bc-59ed-4df9-b398-5be0d500e533 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Calling method '.version_select at 0x7f7d441c4430>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:44.591866 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-83aa5542-6a7b-4d2c-a39e-e45a868693b0 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:44.592611 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-83aa5542-6a7b-4d2c-a39e-e45a868693b0 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: 8fce8438-d6ae-408d-8b4f-ee14d4021fdd] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:44.615731 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-83aa5542-6a7b-4d2c-a39e-e45a868693b0 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:44.616225 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-83aa5542-6a7b-4d2c-a39e-e45a868693b0 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:44.616667 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-83aa5542-6a7b-4d2c-a39e-e45a868693b0 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:44.617376 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-83aa5542-6a7b-4d2c-a39e-e45a868693b0 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:44.617840 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-83aa5542-6a7b-4d2c-a39e-e45a868693b0 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:44.618267 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-83aa5542-6a7b-4d2c-a39e-e45a868693b0 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:44.697307 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f42905bc-59ed-4df9-b398-5be0d500e533 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] 10.222.0.60 "DELETE /compute/v2.1/images/b70a0f47-ac87-44f7-9270-1a7a2cbb5965" status: 204 len: 0 microversion: 2.1 time: 0.198304 Sep 14 08:53:44.697926 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 685/1371] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:44 2022] DELETE /compute/v2.1/images/b70a0f47-ac87-44f7-9270-1a7a2cbb5965 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 08:53:44.779375 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-84d13961-c018-4d54-a749-32450c050c00 tempest-SecurityGroupRulesTestJSON-782480009 tempest-SecurityGroupRulesTestJSON-782480009-project] Action: 'create', calling method: .version_select at 0x7f7d44279940>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-960077767", "description": "tempest-description-88161784"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:53:44.781782 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-83aa5542-6a7b-4d2c-a39e-e45a868693b0 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:44.792129 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-83aa5542-6a7b-4d2c-a39e-e45a868693b0 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:44.793487 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-83aa5542-6a7b-4d2c-a39e-e45a868693b0 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:44.794734 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-83aa5542-6a7b-4d2c-a39e-e45a868693b0 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd" status: 200 len: 1815 microversion: 2.25 time: 0.207072 Sep 14 08:53:44.795326 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 687/1372] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:53:44 2022] GET /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd => generated 1815 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:53:44.810084 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c0405b1c-16c1-48a4-b06a-a707cf838685 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Calling method '.version_select at 0x7f7d487fb5e0>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:44.840310 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-c0405b1c-16c1-48a4-b06a-a707cf838685 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] HTTP exception thrown: Image not found. Sep 14 08:53:44.846985 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c0405b1c-16c1-48a4-b06a-a707cf838685 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Request method failure captured: Sep 14 08:53:44.846985 n-d-836830-18 devstack@n-api.service[128758]: request: GET /compute/v2.1/images/b70a0f47-ac87-44f7-9270-1a7a2cbb5965 HTTP/1.1 Sep 14 08:53:44.846985 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 08:53:44.846985 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 08:53:44.846985 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 08:53:44.846985 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 08:53:44.846985 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 08:53:44.846985 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 08:53:44.846985 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 08:53:44.846985 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 08:53:44.846985 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZZS4Po83Aovv_U3RdkjXLQKweaQf-fhAgT61i_A11uamuOl6sYuSjebIurWFthtZrzpGvY9uLyOeI1i9q8ClJm3kMoDWgYaqbwGjdZ-I8VmC2NF95wjpQldZSAgTTLlPF11CuzqbhW26YYuwljJxckz8_fE9N_t89yQzibByeeP394 Sep 14 08:53:44.846985 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 08:53:44.846985 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 08:53:44.846985 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 08:53:44.846985 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 08:53:44.846985 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 08:53:44.846985 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 08:53:44.846985 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 0a87a909133e42e1a82e3a623536935c Sep 14 08:53:44.846985 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1646226177 Sep 14 08:53:44.846985 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 08:53:44.846985 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 08:53:44.849230 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0a87a909133e42e1a82e3a623536935c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0a87a909133e42e1a82e3a623536935c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0a87a909133e42e1a82e3a623536935c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0a87a909133e42e1a82e3a623536935c"}]}] Sep 14 08:53:44.849230 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1646226177 Sep 14 08:53:44.849230 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 0a87a909133e42e1a82e3a623536935c Sep 14 08:53:44.849230 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1646226177 Sep 14 08:53:44.849230 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-ImagesOneServerNegativeTestJSON-1646226177-project Sep 14 08:53:44.849230 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 08:53:44.849230 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 08:53:44.849230 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: a3ace9012a7c4ce59c01858b6984b766 Sep 14 08:53:44.849230 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1646226177-project Sep 14 08:53:44.849230 n-d-836830-18 devstack@n-api.service[128758]: method: Sep 14 08:53:44.849230 n-d-836830-18 devstack@n-api.service[128758]: exception: Image not found. Sep 14 08:53:44.849230 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': 'b70a0f47-ac87-44f7-9270-1a7a2cbb5965'} Sep 14 08:53:44.849230 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:53:44.851525 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:53:44.851525 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 14 08:53:44.851525 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 14 08:53:44.851525 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 14 08:53:44.851525 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 14 08:53:44.851525 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 14 08:53:44.851525 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 14 08:53:44.851525 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 14 08:53:44.851525 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 14 08:53:44.851525 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 14 08:53:44.851525 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 14 08:53:44.851525 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 14 08:53:44.851525 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 14 08:53:44.851525 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 14 08:53:44.851525 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 14 08:53:44.851525 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 14 08:53:44.851525 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 14 08:53:44.851525 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID b70a0f47-ac87-44f7-9270-1a7a2cbb5965 Sep 14 08:53:44.852926 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:53:44.852926 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:53:44.852926 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:53:44.852926 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:53:44.852926 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Sep 14 08:53:44.852926 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Sep 14 08:53:44.852926 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 14 08:53:44.852926 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 14 08:53:44.852926 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 14 08:53:44.852926 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 14 08:53:44.852926 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 14 08:53:44.852926 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 14 08:53:44.852926 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 14 08:53:44.852926 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 14 08:53:44.852926 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 14 08:53:44.852926 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 14 08:53:44.852926 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 14 08:53:44.852926 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 14 08:53:44.852926 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 14 08:53:44.852926 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 14 08:53:44.854607 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 14 08:53:44.854607 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 14 08:53:44.854607 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 14 08:53:44.854607 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 14 08:53:44.854607 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 14 08:53:44.854607 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 14 08:53:44.854607 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 14 08:53:44.854607 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 14 08:53:44.854607 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image b70a0f47-ac87-44f7-9270-1a7a2cbb5965 could not be found. Sep 14 08:53:44.854607 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:53:44.854607 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:53:44.854607 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:53:44.854607 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:53:44.854607 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:53:44.854607 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:53:44.854607 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:53:44.854607 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:53:44.854607 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 08:53:44.854607 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 08:53:44.856237 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:53:44.856237 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:53:44.856237 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Sep 14 08:53:44.856237 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 14 08:53:44.856237 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 14 08:53:44.856237 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:53:44.856237 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:53:44.856237 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:53:44.856237 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:53:44.856237 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:53:44.856237 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:53:44.856237 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:53:44.856237 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:53:44.856237 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 14 08:53:44.856237 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:53:44.856237 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c0405b1c-16c1-48a4-b06a-a707cf838685 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Returning 404 to user: Image not found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:53:44.857522 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-c0405b1c-16c1-48a4-b06a-a707cf838685 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] 10.222.0.60 "GET /compute/v2.1/images/b70a0f47-ac87-44f7-9270-1a7a2cbb5965" status: 404 len: 62 microversion: 2.1 time: 0.044680 Sep 14 08:53:44.857522 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 688/1373] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 08:53:44 2022] GET /compute/v2.1/images/b70a0f47-ac87-44f7-9270-1a7a2cbb5965 => generated 62 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 14 08:53:44.858563 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-846c1878-9e8b-4fe4-a323-a1583aceebc4 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:44.859406 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-846c1878-9e8b-4fe4-a323-a1583aceebc4 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] [instance: feeb311c-8462-4539-bbc8-4120559413cb] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:44.867246 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-846c1878-9e8b-4fe4-a323-a1583aceebc4 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:44.867746 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-846c1878-9e8b-4fe4-a323-a1583aceebc4 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:44.868190 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-846c1878-9e8b-4fe4-a323-a1583aceebc4 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:44.868911 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-846c1878-9e8b-4fe4-a323-a1583aceebc4 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:44.869499 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-846c1878-9e8b-4fe4-a323-a1583aceebc4 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:44.869943 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-846c1878-9e8b-4fe4-a323-a1583aceebc4 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:44.996683 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-84d13961-c018-4d54-a749-32450c050c00 tempest-SecurityGroupRulesTestJSON-782480009 tempest-SecurityGroupRulesTestJSON-782480009-project] 10.222.0.60 "POST /compute/v2.1/os-security-groups" status: 200 len: 245 microversion: 2.1 time: 0.296343 Sep 14 08:53:44.997592 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 686/1374] 10.222.0.60 () {60 vars in 1180 bytes} [Wed Sep 14 08:53:44 2022] POST /compute/v2.1/os-security-groups => generated 245 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:53:45.010131 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d624d9d4-aedc-460c-a7ca-1e1bd20c5f91 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:45.011265 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-d624d9d4-aedc-460c-a7ca-1e1bd20c5f91 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] [instance: 4ea5843e-ecf7-4b84-80cb-3f05b2b20982] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:45.021005 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d624d9d4-aedc-460c-a7ca-1e1bd20c5f91 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:45.031229 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d624d9d4-aedc-460c-a7ca-1e1bd20c5f91 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:45.031953 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d624d9d4-aedc-460c-a7ca-1e1bd20c5f91 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:45.032892 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d624d9d4-aedc-460c-a7ca-1e1bd20c5f91 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:45.033525 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d624d9d4-aedc-460c-a7ca-1e1bd20c5f91 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:45.034131 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d624d9d4-aedc-460c-a7ca-1e1bd20c5f91 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:45.053468 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-846c1878-9e8b-4fe4-a323-a1583aceebc4 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ace9012a7c4ce59c01858b6984b766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a87a909133e42e1a82e3a623536935c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:45.062235 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-846c1878-9e8b-4fe4-a323-a1583aceebc4 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] 10.222.0.60 "GET /compute/v2.1/servers/feeb311c-8462-4539-bbc8-4120559413cb" status: 200 len: 1533 microversion: 2.1 time: 0.207607 Sep 14 08:53:45.067393 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 689/1375] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:44 2022] GET /compute/v2.1/servers/feeb311c-8462-4539-bbc8-4120559413cb => generated 1533 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:53:45.075680 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-70d3f086-145e-46d0-9b23-8a8b9c797fc6 tempest-SecurityGroupRulesTestJSON-782480009 tempest-SecurityGroupRulesTestJSON-782480009-project] Action: 'create', calling method: .version_select at 0x7f7d444780d0>, body: {"security_group_rule": {"parent_group_id": "48bff045-6c6b-490b-ab6e-8e8076c764a6", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:53:45.226881 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-d624d9d4-aedc-460c-a7ca-1e1bd20c5f91 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810376d6f0b4329abe0f8f79800b754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575684f36f9c4019926fc83541e152c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:45.235026 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d624d9d4-aedc-460c-a7ca-1e1bd20c5f91 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] 10.222.0.60 "GET /compute/v2.1/servers/4ea5843e-ecf7-4b84-80cb-3f05b2b20982" status: 200 len: 1293 microversion: 2.1 time: 0.228728 Sep 14 08:53:45.235800 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 687/1376] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:44 2022] GET /compute/v2.1/servers/4ea5843e-ecf7-4b84-80cb-3f05b2b20982 => generated 1293 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:53:45.240328 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-6d48df2d-0b4e-42ab-b15c-f2eeba1eece3 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:45.240945 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-6d48df2d-0b4e-42ab-b15c-f2eeba1eece3 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: 1b2a9a93-cad5-4b18-abc3-1b88413f88da] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:45.246765 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6d48df2d-0b4e-42ab-b15c-f2eeba1eece3 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:45.247394 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6d48df2d-0b4e-42ab-b15c-f2eeba1eece3 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:45.247851 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6d48df2d-0b4e-42ab-b15c-f2eeba1eece3 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:45.248604 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6d48df2d-0b4e-42ab-b15c-f2eeba1eece3 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:45.249284 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6d48df2d-0b4e-42ab-b15c-f2eeba1eece3 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:45.249913 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6d48df2d-0b4e-42ab-b15c-f2eeba1eece3 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:45.407063 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-70d3f086-145e-46d0-9b23-8a8b9c797fc6 tempest-SecurityGroupRulesTestJSON-782480009 tempest-SecurityGroupRulesTestJSON-782480009-project] 10.222.0.60 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.338090 Sep 14 08:53:45.407927 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 690/1377] 10.222.0.60 () {60 vars in 1195 bytes} [Wed Sep 14 08:53:45 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:53:45.421473 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-e818a9ce-8a2e-4a94-8ce4-a409afc0d4dd tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:45.422317 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-e818a9ce-8a2e-4a94-8ce4-a409afc0d4dd tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] [instance: 505d2e57-caf3-43d1-b6d6-9678e38c1aab] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:45.428969 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e818a9ce-8a2e-4a94-8ce4-a409afc0d4dd tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:45.429530 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e818a9ce-8a2e-4a94-8ce4-a409afc0d4dd tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:45.430302 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e818a9ce-8a2e-4a94-8ce4-a409afc0d4dd tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:45.431281 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e818a9ce-8a2e-4a94-8ce4-a409afc0d4dd tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:45.431806 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e818a9ce-8a2e-4a94-8ce4-a409afc0d4dd tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:45.432293 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e818a9ce-8a2e-4a94-8ce4-a409afc0d4dd tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:45.444755 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-6d48df2d-0b4e-42ab-b15c-f2eeba1eece3 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:45.453951 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-6d48df2d-0b4e-42ab-b15c-f2eeba1eece3 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/1b2a9a93-cad5-4b18-abc3-1b88413f88da" status: 200 len: 1472 microversion: 2.1 time: 0.217246 Sep 14 08:53:45.463746 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 688/1378] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:45 2022] GET /compute/v2.1/servers/1b2a9a93-cad5-4b18-abc3-1b88413f88da => generated 1472 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:53:45.463746 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-252cc7f2-90f6-4286-b87a-a51650e71cd1 tempest-SecurityGroupRulesTestJSON-782480009 tempest-SecurityGroupRulesTestJSON-782480009-project] Action: 'create', calling method: .version_select at 0x7f7d44206b80>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-693662957", "description": "tempest-description-1369770550"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:53:45.630070 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-e818a9ce-8a2e-4a94-8ce4-a409afc0d4dd tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c562ad6d5022429ba559a25c20c7569b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '545d0b704b5d455c8ffaeacb7cebace0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:45.639174 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-e818a9ce-8a2e-4a94-8ce4-a409afc0d4dd tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] 10.222.0.60 "GET /compute/v2.1/servers/505d2e57-caf3-43d1-b6d6-9678e38c1aab" status: 200 len: 1323 microversion: 2.1 time: 0.221569 Sep 14 08:53:45.639769 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 691/1379] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:45 2022] GET /compute/v2.1/servers/505d2e57-caf3-43d1-b6d6-9678e38c1aab => generated 1323 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:53:45.683326 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-e71746f9-95a1-47aa-a5ad-059a6cfb5d2b tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:45.689958 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-e71746f9-95a1-47aa-a5ad-059a6cfb5d2b tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'aeaac454f233408ba1597b36bb9277dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38a515fd540744a2bdf6fb971f4a6924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:45.691099 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-e71746f9-95a1-47aa-a5ad-059a6cfb5d2b tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Searching by: {'deleted': False, 'project_id': '38a515fd540744a2bdf6fb971f4a6924'} {{(pid=128758) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 14 08:53:45.699677 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e71746f9-95a1-47aa-a5ad-059a6cfb5d2b tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:45.700634 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e71746f9-95a1-47aa-a5ad-059a6cfb5d2b tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:45.701311 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e71746f9-95a1-47aa-a5ad-059a6cfb5d2b tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:45.702308 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e71746f9-95a1-47aa-a5ad-059a6cfb5d2b tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:45.702998 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e71746f9-95a1-47aa-a5ad-059a6cfb5d2b tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:45.703769 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e71746f9-95a1-47aa-a5ad-059a6cfb5d2b tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:45.709662 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-252cc7f2-90f6-4286-b87a-a51650e71cd1 tempest-SecurityGroupRulesTestJSON-782480009 tempest-SecurityGroupRulesTestJSON-782480009-project] 10.222.0.60 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.253133 Sep 14 08:53:45.710430 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 689/1380] 10.222.0.60 () {60 vars in 1180 bytes} [Wed Sep 14 08:53:45 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:53:45.724285 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-862e29e1-1c0a-4108-87f1-dc6743dedf40 tempest-SecurityGroupRulesTestJSON-782480009 tempest-SecurityGroupRulesTestJSON-782480009-project] Action: 'create', calling method: .version_select at 0x7f7d44206280>, body: {"security_group_rule": {"parent_group_id": "6429814a-1e83-4a2b-a1bd-337d8a9d8bb5", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:53:45.760974 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.multi_cell_list [None req-e71746f9-95a1-47aa-a5ad-059a6cfb5d2b tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128758) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 14 08:53:45.799808 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-e71746f9-95a1-47aa-a5ad-059a6cfb5d2b tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] 10.222.0.60 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.120841 Sep 14 08:53:45.801036 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 692/1381] 10.222.0.60 () {58 vars in 1125 bytes} [Wed Sep 14 08:53:45 2022] GET /compute/v2.1/servers => generated 340 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 08:53:45.814090 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a2883db8-7461-472d-8fbc-9fe35095063d tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:45.819811 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-a2883db8-7461-472d-8fbc-9fe35095063d tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'aeaac454f233408ba1597b36bb9277dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38a515fd540744a2bdf6fb971f4a6924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:45.820676 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-a2883db8-7461-472d-8fbc-9fe35095063d tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Searching by: {'deleted': False, 'project_id': '38a515fd540744a2bdf6fb971f4a6924'} {{(pid=128758) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 14 08:53:45.826061 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a2883db8-7461-472d-8fbc-9fe35095063d tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:45.826649 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a2883db8-7461-472d-8fbc-9fe35095063d tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:45.827384 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a2883db8-7461-472d-8fbc-9fe35095063d tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:45.828352 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a2883db8-7461-472d-8fbc-9fe35095063d tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:45.830125 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a2883db8-7461-472d-8fbc-9fe35095063d tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:45.834191 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a2883db8-7461-472d-8fbc-9fe35095063d tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:46.007260 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.multi_cell_list [None req-a2883db8-7461-472d-8fbc-9fe35095063d tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128758) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 14 08:53:46.062571 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-862e29e1-1c0a-4108-87f1-dc6743dedf40 tempest-SecurityGroupRulesTestJSON-782480009 tempest-SecurityGroupRulesTestJSON-782480009-project] 10.222.0.60 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 0.343146 Sep 14 08:53:46.063205 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 690/1382] 10.222.0.60 () {60 vars in 1195 bytes} [Wed Sep 14 08:53:45 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 08:53:46.075883 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-0c2137c8-fd6c-4392-8250-9b4f416b56c0 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:46.077154 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-0c2137c8-fd6c-4392-8250-9b4f416b56c0 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: 8fce8438-d6ae-408d-8b4f-ee14d4021fdd] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:46.085836 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0c2137c8-fd6c-4392-8250-9b4f416b56c0 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:46.087127 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0c2137c8-fd6c-4392-8250-9b4f416b56c0 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:46.088010 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0c2137c8-fd6c-4392-8250-9b4f416b56c0 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:46.089184 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0c2137c8-fd6c-4392-8250-9b4f416b56c0 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:46.089931 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0c2137c8-fd6c-4392-8250-9b4f416b56c0 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:46.090606 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0c2137c8-fd6c-4392-8250-9b4f416b56c0 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:46.108301 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=42 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:53:46.167916 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-a2883db8-7461-472d-8fbc-9fe35095063d tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeaac454f233408ba1597b36bb9277dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38a515fd540744a2bdf6fb971f4a6924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:46.175847 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a2883db8-7461-472d-8fbc-9fe35095063d tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:46.177521 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a2883db8-7461-472d-8fbc-9fe35095063d tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:46.178244 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a2883db8-7461-472d-8fbc-9fe35095063d tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:46.406006 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=12 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:53:46.532839 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-0c2137c8-fd6c-4392-8250-9b4f416b56c0 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:46.536569 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-a2883db8-7461-472d-8fbc-9fe35095063d tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] 10.222.0.60 "GET /compute/v2.1/servers/detail" status: 200 len: 1712 microversion: 2.1 time: 0.726373 Sep 14 08:53:46.537484 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 693/1383] 10.222.0.60 () {58 vars in 1146 bytes} [Wed Sep 14 08:53:45 2022] GET /compute/v2.1/servers/detail => generated 1712 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:53:46.542081 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-8d25ff01-6c55-4a40-911a-7a29173f6f8e tempest-SecurityGroupRulesTestJSON-782480009 tempest-SecurityGroupRulesTestJSON-782480009-project] Action: 'create', calling method: .version_select at 0x7f7d443fe040>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1189487553", "description": "tempest-description-854389557"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:53:46.564955 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-0c2137c8-fd6c-4392-8250-9b4f416b56c0 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:46.567002 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-0c2137c8-fd6c-4392-8250-9b4f416b56c0 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:46.568639 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-0c2137c8-fd6c-4392-8250-9b4f416b56c0 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd" status: 200 len: 1815 microversion: 2.25 time: 0.500569 Sep 14 08:53:46.569407 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 691/1384] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:53:46 2022] GET /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd => generated 1815 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:53:46.577707 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ebc40d75-4f77-41be-a8aa-6392bd64c1f9 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:46.579207 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-ebc40d75-4f77-41be-a8aa-6392bd64c1f9 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] [instance: feeb311c-8462-4539-bbc8-4120559413cb] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:46.586705 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ebc40d75-4f77-41be-a8aa-6392bd64c1f9 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:46.587502 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ebc40d75-4f77-41be-a8aa-6392bd64c1f9 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:46.588206 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ebc40d75-4f77-41be-a8aa-6392bd64c1f9 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:46.588990 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ebc40d75-4f77-41be-a8aa-6392bd64c1f9 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:46.589460 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ebc40d75-4f77-41be-a8aa-6392bd64c1f9 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:46.589997 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ebc40d75-4f77-41be-a8aa-6392bd64c1f9 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:46.783305 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-8d25ff01-6c55-4a40-911a-7a29173f6f8e tempest-SecurityGroupRulesTestJSON-782480009 tempest-SecurityGroupRulesTestJSON-782480009-project] 10.222.0.60 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.243390 Sep 14 08:53:46.784102 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 694/1385] 10.222.0.60 () {60 vars in 1180 bytes} [Wed Sep 14 08:53:46 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:53:46.792672 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-ebc40d75-4f77-41be-a8aa-6392bd64c1f9 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ace9012a7c4ce59c01858b6984b766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a87a909133e42e1a82e3a623536935c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:46.800836 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-98bf2677-998d-4716-aa90-88da5539c557 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:46.801467 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-98bf2677-998d-4716-aa90-88da5539c557 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] [instance: 4ea5843e-ecf7-4b84-80cb-3f05b2b20982] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:46.808890 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-98bf2677-998d-4716-aa90-88da5539c557 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:46.809389 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-98bf2677-998d-4716-aa90-88da5539c557 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:46.809643 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-ebc40d75-4f77-41be-a8aa-6392bd64c1f9 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] 10.222.0.60 "GET /compute/v2.1/servers/feeb311c-8462-4539-bbc8-4120559413cb" status: 200 len: 1539 microversion: 2.1 time: 0.238431 Sep 14 08:53:46.809826 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-98bf2677-998d-4716-aa90-88da5539c557 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:46.810533 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-98bf2677-998d-4716-aa90-88da5539c557 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:46.810670 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 692/1386] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:46 2022] GET /compute/v2.1/servers/feeb311c-8462-4539-bbc8-4120559413cb => generated 1539 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:53:46.811296 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-98bf2677-998d-4716-aa90-88da5539c557 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:46.811889 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-98bf2677-998d-4716-aa90-88da5539c557 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:46.819826 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-594f929e-0f91-4383-a9bf-ec932d2daa26 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:46.821001 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-594f929e-0f91-4383-a9bf-ec932d2daa26 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: 1b2a9a93-cad5-4b18-abc3-1b88413f88da] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:46.828514 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-594f929e-0f91-4383-a9bf-ec932d2daa26 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:46.829392 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-594f929e-0f91-4383-a9bf-ec932d2daa26 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:46.830056 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-594f929e-0f91-4383-a9bf-ec932d2daa26 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:46.831042 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-594f929e-0f91-4383-a9bf-ec932d2daa26 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:46.831747 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-594f929e-0f91-4383-a9bf-ec932d2daa26 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:46.832956 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-594f929e-0f91-4383-a9bf-ec932d2daa26 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:47.115721 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-594f929e-0f91-4383-a9bf-ec932d2daa26 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:47.125399 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-594f929e-0f91-4383-a9bf-ec932d2daa26 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/1b2a9a93-cad5-4b18-abc3-1b88413f88da" status: 200 len: 1472 microversion: 2.1 time: 0.312573 Sep 14 08:53:47.126212 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 693/1387] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:46 2022] GET /compute/v2.1/servers/1b2a9a93-cad5-4b18-abc3-1b88413f88da => generated 1472 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:53:47.138649 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-17c17846-5b5b-48e5-a510-1623422baa7a tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:47.149573 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-17c17846-5b5b-48e5-a510-1623422baa7a tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] 10.222.0.60 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.017163 Sep 14 08:53:47.150516 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 694/1388] 10.222.0.60 () {58 vars in 1137 bytes} [Wed Sep 14 08:53:47 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:53:47.156065 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-dd61a362-f272-463f-8574-cc837c1ff95c tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:47.157394 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-dd61a362-f272-463f-8574-cc837c1ff95c tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] [instance: 505d2e57-caf3-43d1-b6d6-9678e38c1aab] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:47.164051 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dd61a362-f272-463f-8574-cc837c1ff95c tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:47.164634 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dd61a362-f272-463f-8574-cc837c1ff95c tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:47.165146 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dd61a362-f272-463f-8574-cc837c1ff95c tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:47.165929 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dd61a362-f272-463f-8574-cc837c1ff95c tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:47.166511 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dd61a362-f272-463f-8574-cc837c1ff95c tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:47.167503 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dd61a362-f272-463f-8574-cc837c1ff95c tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:47.260127 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-98bf2677-998d-4716-aa90-88da5539c557 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810376d6f0b4329abe0f8f79800b754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575684f36f9c4019926fc83541e152c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:47.275103 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-98bf2677-998d-4716-aa90-88da5539c557 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] 10.222.0.60 "GET /compute/v2.1/servers/4ea5843e-ecf7-4b84-80cb-3f05b2b20982" status: 200 len: 1293 microversion: 2.1 time: 0.478265 Sep 14 08:53:47.287753 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 695/1389] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:46 2022] GET /compute/v2.1/servers/4ea5843e-ecf7-4b84-80cb-3f05b2b20982 => generated 1293 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:53:47.299651 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-7bc97c7f-66d2-4e03-a7f0-9f080df765b9 tempest-SecurityGroupRulesTestJSON-782480009 tempest-SecurityGroupRulesTestJSON-782480009-project] Action: 'create', calling method: .version_select at 0x7f7d487b9790>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-2101308511", "description": "tempest-description-173458718"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:53:47.347890 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-dd61a362-f272-463f-8574-cc837c1ff95c tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c562ad6d5022429ba559a25c20c7569b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '545d0b704b5d455c8ffaeacb7cebace0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:47.365622 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-dd61a362-f272-463f-8574-cc837c1ff95c tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] 10.222.0.60 "GET /compute/v2.1/servers/505d2e57-caf3-43d1-b6d6-9678e38c1aab" status: 200 len: 1323 microversion: 2.1 time: 0.213708 Sep 14 08:53:47.379680 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 695/1390] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:47 2022] GET /compute/v2.1/servers/505d2e57-caf3-43d1-b6d6-9678e38c1aab => generated 1323 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:53:47.505040 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-7bc97c7f-66d2-4e03-a7f0-9f080df765b9 tempest-SecurityGroupRulesTestJSON-782480009 tempest-SecurityGroupRulesTestJSON-782480009-project] 10.222.0.60 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.216090 Sep 14 08:53:47.505975 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 696/1391] 10.222.0.60 () {60 vars in 1180 bytes} [Wed Sep 14 08:53:47 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:53:47.523580 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e47f671c-421c-4d2d-b70b-3ef5263abd43 tempest-SecurityGroupRulesTestJSON-782480009 tempest-SecurityGroupRulesTestJSON-782480009-project] Action: 'create', calling method: .version_select at 0x7f7d44251670>, body: {"security_group_rule": {"parent_group_id": "62480f1f-4ca6-4af1-a06c-abb29c900364", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "bb6bd2fe-5354-48b8-ab3e-2f3ccff1a4ed"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:53:47.524408 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-0d187534-0372-4827-86eb-1466b2a26b0d tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:47.525179 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-0d187534-0372-4827-86eb-1466b2a26b0d tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] [instance: 58b5d8a4-035b-4a2f-8a83-02ea69847900] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:47.532878 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0d187534-0372-4827-86eb-1466b2a26b0d tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:47.539756 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0d187534-0372-4827-86eb-1466b2a26b0d tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:47.544400 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0d187534-0372-4827-86eb-1466b2a26b0d tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:47.546096 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0d187534-0372-4827-86eb-1466b2a26b0d tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:47.546831 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0d187534-0372-4827-86eb-1466b2a26b0d tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:47.547532 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0d187534-0372-4827-86eb-1466b2a26b0d tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:47.599076 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-0d187534-0372-4827-86eb-1466b2a26b0d tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] [instance: 58b5d8a4-035b-4a2f-8a83-02ea69847900] Going to try to terminate instance {{(pid=128758) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 08:53:47.721140 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-0d187534-0372-4827-86eb-1466b2a26b0d tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] 10.222.0.60 "DELETE /compute/v2.1/servers/58b5d8a4-035b-4a2f-8a83-02ea69847900" status: 204 len: 0 microversion: 2.1 time: 0.200661 Sep 14 08:53:47.722518 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 697/1392] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 08:53:47 2022] DELETE /compute/v2.1/servers/58b5d8a4-035b-4a2f-8a83-02ea69847900 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 08:53:47.731276 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-39734cc5-4ba3-4364-adc3-68eef3ce353a tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:47.732545 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-39734cc5-4ba3-4364-adc3-68eef3ce353a tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: 8fce8438-d6ae-408d-8b4f-ee14d4021fdd] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:47.740931 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-39734cc5-4ba3-4364-adc3-68eef3ce353a tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:47.741708 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-39734cc5-4ba3-4364-adc3-68eef3ce353a tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:47.743479 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-39734cc5-4ba3-4364-adc3-68eef3ce353a tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:47.744554 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-39734cc5-4ba3-4364-adc3-68eef3ce353a tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:47.745235 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-39734cc5-4ba3-4364-adc3-68eef3ce353a tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:47.746988 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-39734cc5-4ba3-4364-adc3-68eef3ce353a tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:48.020737 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e47f671c-421c-4d2d-b70b-3ef5263abd43 tempest-SecurityGroupRulesTestJSON-782480009 tempest-SecurityGroupRulesTestJSON-782480009-project] 10.222.0.60 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 0.501538 Sep 14 08:53:48.022334 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 696/1393] 10.222.0.60 () {60 vars in 1195 bytes} [Wed Sep 14 08:53:47 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:53:48.032697 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8aa028c6-cef3-49ef-b764-c417699c2b21 tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:48.033622 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-8aa028c6-cef3-49ef-b764-c417699c2b21 tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] [instance: 58b5d8a4-035b-4a2f-8a83-02ea69847900] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:48.042124 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8aa028c6-cef3-49ef-b764-c417699c2b21 tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:48.042725 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8aa028c6-cef3-49ef-b764-c417699c2b21 tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:48.043311 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8aa028c6-cef3-49ef-b764-c417699c2b21 tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:48.043814 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-39734cc5-4ba3-4364-adc3-68eef3ce353a tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:48.044543 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8aa028c6-cef3-49ef-b764-c417699c2b21 tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:48.045945 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8aa028c6-cef3-49ef-b764-c417699c2b21 tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:48.046613 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8aa028c6-cef3-49ef-b764-c417699c2b21 tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:48.054616 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-39734cc5-4ba3-4364-adc3-68eef3ce353a tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:48.056433 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-39734cc5-4ba3-4364-adc3-68eef3ce353a tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:48.057854 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-39734cc5-4ba3-4364-adc3-68eef3ce353a tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd" status: 200 len: 1815 microversion: 2.25 time: 0.333744 Sep 14 08:53:48.058589 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 698/1394] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:53:47 2022] GET /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd => generated 1815 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:53:48.063475 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-e2ad8078-9628-402b-b61d-8635ae794fde tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:48.064316 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-e2ad8078-9628-402b-b61d-8635ae794fde tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] [instance: feeb311c-8462-4539-bbc8-4120559413cb] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:48.071574 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e2ad8078-9628-402b-b61d-8635ae794fde tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:48.072315 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e2ad8078-9628-402b-b61d-8635ae794fde tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:48.072970 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e2ad8078-9628-402b-b61d-8635ae794fde tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:48.074110 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e2ad8078-9628-402b-b61d-8635ae794fde tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:48.074772 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e2ad8078-9628-402b-b61d-8635ae794fde tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:48.075418 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e2ad8078-9628-402b-b61d-8635ae794fde tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:48.274751 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-8aa028c6-cef3-49ef-b764-c417699c2b21 tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeaac454f233408ba1597b36bb9277dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38a515fd540744a2bdf6fb971f4a6924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:48.283168 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-e2ad8078-9628-402b-b61d-8635ae794fde tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ace9012a7c4ce59c01858b6984b766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a87a909133e42e1a82e3a623536935c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:48.284756 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-8aa028c6-cef3-49ef-b764-c417699c2b21 tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] 10.222.0.60 "GET /compute/v2.1/servers/58b5d8a4-035b-4a2f-8a83-02ea69847900" status: 200 len: 1715 microversion: 2.1 time: 0.261132 Sep 14 08:53:48.285554 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 697/1395] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:48 2022] GET /compute/v2.1/servers/58b5d8a4-035b-4a2f-8a83-02ea69847900 => generated 1715 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:53:48.291641 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f5265a7c-3bdf-4eb9-937e-25e2efcec7ca tempest-SecurityGroupRulesTestJSON-782480009 tempest-SecurityGroupRulesTestJSON-782480009-project] Action: 'create', calling method: .version_select at 0x7f7d44251e50>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-665167376", "description": "tempest-description-739925004"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:53:48.295468 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-e2ad8078-9628-402b-b61d-8635ae794fde tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] 10.222.0.60 "GET /compute/v2.1/servers/feeb311c-8462-4539-bbc8-4120559413cb" status: 200 len: 1521 microversion: 2.1 time: 0.235533 Sep 14 08:53:48.308746 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 699/1396] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:48 2022] GET /compute/v2.1/servers/feeb311c-8462-4539-bbc8-4120559413cb => generated 1521 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:53:48.308746 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-578ce058-65b7-440b-9e41-6f40bc220645 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:48.308746 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-578ce058-65b7-440b-9e41-6f40bc220645 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: 1b2a9a93-cad5-4b18-abc3-1b88413f88da] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:48.309109 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-578ce058-65b7-440b-9e41-6f40bc220645 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:48.309453 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-578ce058-65b7-440b-9e41-6f40bc220645 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:48.309890 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-578ce058-65b7-440b-9e41-6f40bc220645 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:48.310594 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-578ce058-65b7-440b-9e41-6f40bc220645 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:48.311260 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-578ce058-65b7-440b-9e41-6f40bc220645 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:48.311687 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-578ce058-65b7-440b-9e41-6f40bc220645 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:48.500337 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-578ce058-65b7-440b-9e41-6f40bc220645 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:48.503515 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:53:48.515243 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-578ce058-65b7-440b-9e41-6f40bc220645 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/1b2a9a93-cad5-4b18-abc3-1b88413f88da" status: 200 len: 1469 microversion: 2.1 time: 0.217784 Sep 14 08:53:48.516156 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 700/1397] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:48 2022] GET /compute/v2.1/servers/1b2a9a93-cad5-4b18-abc3-1b88413f88da => generated 1469 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:53:48.522045 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-717f78a6-7ee3-4fe0-9776-617d89a3f418 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:48.522780 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-717f78a6-7ee3-4fe0-9776-617d89a3f418 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] [instance: 4ea5843e-ecf7-4b84-80cb-3f05b2b20982] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:48.531469 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-717f78a6-7ee3-4fe0-9776-617d89a3f418 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:48.531969 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-717f78a6-7ee3-4fe0-9776-617d89a3f418 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:48.532411 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-717f78a6-7ee3-4fe0-9776-617d89a3f418 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:48.534021 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-717f78a6-7ee3-4fe0-9776-617d89a3f418 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:48.534506 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-717f78a6-7ee3-4fe0-9776-617d89a3f418 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:48.535535 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-717f78a6-7ee3-4fe0-9776-617d89a3f418 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:48.556927 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f5265a7c-3bdf-4eb9-937e-25e2efcec7ca tempest-SecurityGroupRulesTestJSON-782480009 tempest-SecurityGroupRulesTestJSON-782480009-project] 10.222.0.60 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.269839 Sep 14 08:53:48.557721 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 698/1398] 10.222.0.60 () {60 vars in 1180 bytes} [Wed Sep 14 08:53:48 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:53:48.564027 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-87517115-50e2-46de-8378-e8d5757366c3 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:48.564533 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-87517115-50e2-46de-8378-e8d5757366c3 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] [instance: feeb311c-8462-4539-bbc8-4120559413cb] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:48.581489 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-87517115-50e2-46de-8378-e8d5757366c3 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:48.583419 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-87517115-50e2-46de-8378-e8d5757366c3 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:48.584510 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-87517115-50e2-46de-8378-e8d5757366c3 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:48.585381 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-87517115-50e2-46de-8378-e8d5757366c3 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:48.585961 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-87517115-50e2-46de-8378-e8d5757366c3 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:48.586560 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-87517115-50e2-46de-8378-e8d5757366c3 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:48.616374 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-87517115-50e2-46de-8378-e8d5757366c3 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] [instance: feeb311c-8462-4539-bbc8-4120559413cb] Going to try to terminate instance {{(pid=128759) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 08:53:48.703597 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-87517115-50e2-46de-8378-e8d5757366c3 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] 10.222.0.60 "DELETE /compute/v2.1/servers/feeb311c-8462-4539-bbc8-4120559413cb" status: 204 len: 0 microversion: 2.1 time: 0.142898 Sep 14 08:53:48.704302 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 699/1399] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 08:53:48 2022] DELETE /compute/v2.1/servers/feeb311c-8462-4539-bbc8-4120559413cb => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 08:53:48.713160 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-717f78a6-7ee3-4fe0-9776-617d89a3f418 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810376d6f0b4329abe0f8f79800b754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575684f36f9c4019926fc83541e152c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:48.715438 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-bbe978fd-a6a6-4b37-ade1-6809e9e8aad0 tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:48.717316 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-bbe978fd-a6a6-4b37-ade1-6809e9e8aad0 tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] [instance: 505d2e57-caf3-43d1-b6d6-9678e38c1aab] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:48.722454 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-717f78a6-7ee3-4fe0-9776-617d89a3f418 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] 10.222.0.60 "GET /compute/v2.1/servers/4ea5843e-ecf7-4b84-80cb-3f05b2b20982" status: 200 len: 1293 microversion: 2.1 time: 0.205286 Sep 14 08:53:48.723900 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 701/1400] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:48 2022] GET /compute/v2.1/servers/4ea5843e-ecf7-4b84-80cb-3f05b2b20982 => generated 1293 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:53:48.728665 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-86ed00b8-ba6c-429b-a4ff-41dea44e4022 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:53:48.729201 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-86ed00b8-ba6c-429b-a4ff-41dea44e4022 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: 1b2a9a93-cad5-4b18-abc3-1b88413f88da] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:48.735719 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-86ed00b8-ba6c-429b-a4ff-41dea44e4022 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:48.736214 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-86ed00b8-ba6c-429b-a4ff-41dea44e4022 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:48.736650 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-86ed00b8-ba6c-429b-a4ff-41dea44e4022 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:48.737355 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-86ed00b8-ba6c-429b-a4ff-41dea44e4022 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:48.737616 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bbe978fd-a6a6-4b37-ade1-6809e9e8aad0 tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:48.737814 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-86ed00b8-ba6c-429b-a4ff-41dea44e4022 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:48.738153 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bbe978fd-a6a6-4b37-ade1-6809e9e8aad0 tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:48.738294 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-86ed00b8-ba6c-429b-a4ff-41dea44e4022 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:48.738594 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bbe978fd-a6a6-4b37-ade1-6809e9e8aad0 tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:48.739991 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bbe978fd-a6a6-4b37-ade1-6809e9e8aad0 tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:48.740451 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bbe978fd-a6a6-4b37-ade1-6809e9e8aad0 tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:48.740866 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bbe978fd-a6a6-4b37-ade1-6809e9e8aad0 tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:48.869465 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-86ed00b8-ba6c-429b-a4ff-41dea44e4022 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "POST /compute/v2.1/servers/1b2a9a93-cad5-4b18-abc3-1b88413f88da/action" status: 202 len: 0 microversion: 2.1 time: 0.144317 Sep 14 08:53:48.870228 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 702/1401] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 08:53:48 2022] POST /compute/v2.1/servers/1b2a9a93-cad5-4b18-abc3-1b88413f88da/action => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 08:53:48.879778 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d43883be-2cd2-4c1c-8ef7-8736b1ec3595 tempest-SecurityGroupRulesTestJSON-782480009 tempest-SecurityGroupRulesTestJSON-782480009-project] Action: 'create', calling method: .version_select at 0x7f7d443ae280>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1978931757", "description": "tempest-description-1182396964"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:53:48.890889 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-bbe978fd-a6a6-4b37-ade1-6809e9e8aad0 tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c562ad6d5022429ba559a25c20c7569b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '545d0b704b5d455c8ffaeacb7cebace0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:48.902716 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-bbe978fd-a6a6-4b37-ade1-6809e9e8aad0 tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] 10.222.0.60 "GET /compute/v2.1/servers/505d2e57-caf3-43d1-b6d6-9678e38c1aab" status: 200 len: 1323 microversion: 2.1 time: 0.196397 Sep 14 08:53:48.903637 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 700/1402] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:48 2022] GET /compute/v2.1/servers/505d2e57-caf3-43d1-b6d6-9678e38c1aab => generated 1323 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:53:48.923662 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-45523cbf-f620-4a57-b9ff-34c972ee78ad tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:48.924365 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-45523cbf-f620-4a57-b9ff-34c972ee78ad tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] [instance: feeb311c-8462-4539-bbc8-4120559413cb] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:48.932817 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-45523cbf-f620-4a57-b9ff-34c972ee78ad tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:48.933650 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-45523cbf-f620-4a57-b9ff-34c972ee78ad tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:48.934236 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-45523cbf-f620-4a57-b9ff-34c972ee78ad tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:48.935031 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-45523cbf-f620-4a57-b9ff-34c972ee78ad tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:48.935488 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-45523cbf-f620-4a57-b9ff-34c972ee78ad tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:48.935915 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-45523cbf-f620-4a57-b9ff-34c972ee78ad tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:49.105441 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-d43883be-2cd2-4c1c-8ef7-8736b1ec3595 tempest-SecurityGroupRulesTestJSON-782480009 tempest-SecurityGroupRulesTestJSON-782480009-project] 10.222.0.60 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.230483 Sep 14 08:53:49.106245 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 703/1403] 10.222.0.60 () {60 vars in 1180 bytes} [Wed Sep 14 08:53:48 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:53:49.118972 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d5ddc6d5-4167-419f-819a-86e9ac52cd1d tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:49.120130 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-d5ddc6d5-4167-419f-819a-86e9ac52cd1d tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: 1b2a9a93-cad5-4b18-abc3-1b88413f88da] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:49.131063 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d5ddc6d5-4167-419f-819a-86e9ac52cd1d tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:49.131788 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d5ddc6d5-4167-419f-819a-86e9ac52cd1d tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:49.132600 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d5ddc6d5-4167-419f-819a-86e9ac52cd1d tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:49.133574 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d5ddc6d5-4167-419f-819a-86e9ac52cd1d tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:49.134240 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d5ddc6d5-4167-419f-819a-86e9ac52cd1d tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:49.135390 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d5ddc6d5-4167-419f-819a-86e9ac52cd1d tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:49.138853 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-45523cbf-f620-4a57-b9ff-34c972ee78ad tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ace9012a7c4ce59c01858b6984b766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a87a909133e42e1a82e3a623536935c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:49.154995 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-45523cbf-f620-4a57-b9ff-34c972ee78ad tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] 10.222.0.60 "GET /compute/v2.1/servers/feeb311c-8462-4539-bbc8-4120559413cb" status: 200 len: 1527 microversion: 2.1 time: 0.237820 Sep 14 08:53:49.155883 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 701/1404] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:48 2022] GET /compute/v2.1/servers/feeb311c-8462-4539-bbc8-4120559413cb => generated 1527 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:53:49.160717 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-84677bde-74d8-4b56-8b16-2ffa64415395 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:49.161591 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-84677bde-74d8-4b56-8b16-2ffa64415395 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: 8fce8438-d6ae-408d-8b4f-ee14d4021fdd] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:49.167739 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-84677bde-74d8-4b56-8b16-2ffa64415395 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:49.168485 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-84677bde-74d8-4b56-8b16-2ffa64415395 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:49.169156 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-84677bde-74d8-4b56-8b16-2ffa64415395 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:49.170348 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-84677bde-74d8-4b56-8b16-2ffa64415395 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:49.171085 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-84677bde-74d8-4b56-8b16-2ffa64415395 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:49.171737 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-84677bde-74d8-4b56-8b16-2ffa64415395 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:49.379477 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-d5ddc6d5-4167-419f-819a-86e9ac52cd1d tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:49.394375 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-84677bde-74d8-4b56-8b16-2ffa64415395 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:49.398454 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-d5ddc6d5-4167-419f-819a-86e9ac52cd1d tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/1b2a9a93-cad5-4b18-abc3-1b88413f88da" status: 200 len: 1468 microversion: 2.1 time: 0.275985 Sep 14 08:53:49.405467 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 704/1405] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:49 2022] GET /compute/v2.1/servers/1b2a9a93-cad5-4b18-abc3-1b88413f88da => generated 1468 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:53:49.409052 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-84677bde-74d8-4b56-8b16-2ffa64415395 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:49.413331 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-84677bde-74d8-4b56-8b16-2ffa64415395 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:49.416329 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-84677bde-74d8-4b56-8b16-2ffa64415395 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd" status: 200 len: 1815 microversion: 2.25 time: 0.259290 Sep 14 08:53:49.417055 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-308d750d-6747-4c82-928b-f0ab7b81bcb4 tempest-SecurityGroupRulesTestJSON-782480009 tempest-SecurityGroupRulesTestJSON-782480009-project] Action: 'create', calling method: .version_select at 0x7f7d443fe1f0>, body: {"security_group_rule": {"parent_group_id": "9866eff0-296e-4ce2-add0-9539d445bbd4", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "40fba3a1-d32a-4328-a6d1-6f00be18539c"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:53:49.419778 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 702/1406] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:53:49 2022] GET /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd => generated 1815 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:53:49.429573 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-976fccb9-3190-4228-b71f-4d34cee234eb tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:49.430625 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-976fccb9-3190-4228-b71f-4d34cee234eb tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] [instance: 58b5d8a4-035b-4a2f-8a83-02ea69847900] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:49.443574 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-976fccb9-3190-4228-b71f-4d34cee234eb tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:49.447722 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-976fccb9-3190-4228-b71f-4d34cee234eb tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:49.448261 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-976fccb9-3190-4228-b71f-4d34cee234eb tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:49.449208 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-976fccb9-3190-4228-b71f-4d34cee234eb tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:49.449683 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-976fccb9-3190-4228-b71f-4d34cee234eb tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:49.450111 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-976fccb9-3190-4228-b71f-4d34cee234eb tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:49.657124 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-976fccb9-3190-4228-b71f-4d34cee234eb tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeaac454f233408ba1597b36bb9277dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38a515fd540744a2bdf6fb971f4a6924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:49.665244 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-976fccb9-3190-4228-b71f-4d34cee234eb tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] 10.222.0.60 "GET /compute/v2.1/servers/58b5d8a4-035b-4a2f-8a83-02ea69847900" status: 200 len: 1715 microversion: 2.1 time: 0.244493 Sep 14 08:53:49.666046 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 703/1407] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:49 2022] GET /compute/v2.1/servers/58b5d8a4-035b-4a2f-8a83-02ea69847900 => generated 1715 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:53:49.747855 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-1abc94b2-7b63-44c5-8133-823fcbabf523 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:49.748609 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-1abc94b2-7b63-44c5-8133-823fcbabf523 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] [instance: 4ea5843e-ecf7-4b84-80cb-3f05b2b20982] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:49.750686 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=96,nova_api:UPDATE=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:53:49.756979 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1abc94b2-7b63-44c5-8133-823fcbabf523 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:49.757503 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1abc94b2-7b63-44c5-8133-823fcbabf523 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:49.757924 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1abc94b2-7b63-44c5-8133-823fcbabf523 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:49.759146 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1abc94b2-7b63-44c5-8133-823fcbabf523 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:49.759420 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1abc94b2-7b63-44c5-8133-823fcbabf523 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:49.759854 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1abc94b2-7b63-44c5-8133-823fcbabf523 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:49.762417 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-308d750d-6747-4c82-928b-f0ab7b81bcb4 tempest-SecurityGroupRulesTestJSON-782480009 tempest-SecurityGroupRulesTestJSON-782480009-project] 10.222.0.60 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 0.355614 Sep 14 08:53:49.763206 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 705/1408] 10.222.0.60 () {60 vars in 1195 bytes} [Wed Sep 14 08:53:49 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:53:49.775585 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-14ab33c5-8a01-47c3-b51f-bf621515d10a tempest-SecurityGroupRulesTestJSON-782480009 tempest-SecurityGroupRulesTestJSON-782480009-project] Calling method '.version_select at 0x7f7d443ae1f0>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:49.777822 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:53:49.986245 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-1abc94b2-7b63-44c5-8133-823fcbabf523 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810376d6f0b4329abe0f8f79800b754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575684f36f9c4019926fc83541e152c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:49.996941 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-1abc94b2-7b63-44c5-8133-823fcbabf523 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] 10.222.0.60 "GET /compute/v2.1/servers/4ea5843e-ecf7-4b84-80cb-3f05b2b20982" status: 200 len: 1293 microversion: 2.1 time: 0.253076 Sep 14 08:53:49.997539 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 704/1409] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:49 2022] GET /compute/v2.1/servers/4ea5843e-ecf7-4b84-80cb-3f05b2b20982 => generated 1293 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:53:50.019775 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-5d9006ed-5b6d-4240-a3a0-f3ebfd0faa76 tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:50.020490 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-5d9006ed-5b6d-4240-a3a0-f3ebfd0faa76 tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] [instance: 505d2e57-caf3-43d1-b6d6-9678e38c1aab] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:50.026507 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5d9006ed-5b6d-4240-a3a0-f3ebfd0faa76 tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:50.027043 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5d9006ed-5b6d-4240-a3a0-f3ebfd0faa76 tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:50.027492 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5d9006ed-5b6d-4240-a3a0-f3ebfd0faa76 tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:50.028199 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5d9006ed-5b6d-4240-a3a0-f3ebfd0faa76 tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:50.028665 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5d9006ed-5b6d-4240-a3a0-f3ebfd0faa76 tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:50.029095 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5d9006ed-5b6d-4240-a3a0-f3ebfd0faa76 tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:50.158929 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-14ab33c5-8a01-47c3-b51f-bf621515d10a tempest-SecurityGroupRulesTestJSON-782480009 tempest-SecurityGroupRulesTestJSON-782480009-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/40fba3a1-d32a-4328-a6d1-6f00be18539c" status: 202 len: 0 microversion: 2.1 time: 0.387453 Sep 14 08:53:50.159542 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 706/1410] 10.222.0.60 () {58 vars in 1272 bytes} [Wed Sep 14 08:53:49 2022] DELETE /compute/v2.1/os-security-groups/40fba3a1-d32a-4328-a6d1-6f00be18539c => generated 0 bytes in 389 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 08:53:50.168059 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-99ca77bc-e3f0-42ea-8c8c-8e6c602be0e4 tempest-SecurityGroupRulesTestJSON-782480009 tempest-SecurityGroupRulesTestJSON-782480009-project] Calling method '.version_select at 0x7f7d44418790>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:50.221043 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-5d9006ed-5b6d-4240-a3a0-f3ebfd0faa76 tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c562ad6d5022429ba559a25c20c7569b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '545d0b704b5d455c8ffaeacb7cebace0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:50.232113 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-5d9006ed-5b6d-4240-a3a0-f3ebfd0faa76 tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] 10.222.0.60 "GET /compute/v2.1/servers/505d2e57-caf3-43d1-b6d6-9678e38c1aab" status: 200 len: 1472 microversion: 2.1 time: 0.219781 Sep 14 08:53:50.232705 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 705/1411] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:49 2022] GET /compute/v2.1/servers/505d2e57-caf3-43d1-b6d6-9678e38c1aab => generated 1472 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:53:50.235448 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-99ca77bc-e3f0-42ea-8c8c-8e6c602be0e4 tempest-SecurityGroupRulesTestJSON-782480009 tempest-SecurityGroupRulesTestJSON-782480009-project] 10.222.0.60 "GET /compute/v2.1/os-security-groups/9866eff0-296e-4ce2-add0-9539d445bbd4" status: 200 len: 246 microversion: 2.1 time: 0.071006 Sep 14 08:53:50.236167 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 707/1412] 10.222.0.60 () {58 vars in 1269 bytes} [Wed Sep 14 08:53:50 2022] GET /compute/v2.1/os-security-groups/9866eff0-296e-4ce2-add0-9539d445bbd4 => generated 246 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 08:53:50.237772 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-26f7c935-5d3a-427e-8318-883f85b44f86 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:50.238438 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-26f7c935-5d3a-427e-8318-883f85b44f86 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] [instance: feeb311c-8462-4539-bbc8-4120559413cb] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:50.244523 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-26f7c935-5d3a-427e-8318-883f85b44f86 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:50.245095 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-26f7c935-5d3a-427e-8318-883f85b44f86 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:50.245612 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-26f7c935-5d3a-427e-8318-883f85b44f86 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:50.246392 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-26f7c935-5d3a-427e-8318-883f85b44f86 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:50.247290 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-26f7c935-5d3a-427e-8318-883f85b44f86 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:50.247855 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-26f7c935-5d3a-427e-8318-883f85b44f86 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:50.254028 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-552b8f16-c539-444a-af20-851d1b8417f2 tempest-SecurityGroupRulesTestJSON-782480009 tempest-SecurityGroupRulesTestJSON-782480009-project] Action: 'create', calling method: .version_select at 0x7f7d443f2b80>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-2070284157", "description": "tempest-description-884227707"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:53:50.453450 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-26f7c935-5d3a-427e-8318-883f85b44f86 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ace9012a7c4ce59c01858b6984b766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a87a909133e42e1a82e3a623536935c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:50.470274 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-26f7c935-5d3a-427e-8318-883f85b44f86 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] 10.222.0.60 "GET /compute/v2.1/servers/feeb311c-8462-4539-bbc8-4120559413cb" status: 200 len: 1527 microversion: 2.1 time: 0.236049 Sep 14 08:53:50.471585 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 706/1413] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:50 2022] GET /compute/v2.1/servers/feeb311c-8462-4539-bbc8-4120559413cb => generated 1527 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:53:50.493943 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a3c878e6-0202-4f2b-9407-2b2875b47101 tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:50.495241 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-a3c878e6-0202-4f2b-9407-2b2875b47101 tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] [instance: 505d2e57-caf3-43d1-b6d6-9678e38c1aab] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:50.507443 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-552b8f16-c539-444a-af20-851d1b8417f2 tempest-SecurityGroupRulesTestJSON-782480009 tempest-SecurityGroupRulesTestJSON-782480009-project] 10.222.0.60 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.258999 Sep 14 08:53:50.516738 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 708/1414] 10.222.0.60 () {60 vars in 1180 bytes} [Wed Sep 14 08:53:50 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 08:53:50.521417 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a3c878e6-0202-4f2b-9407-2b2875b47101 tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:50.522171 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b81c12d2-cb03-42f4-892c-343b5bb71d7a tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:50.522453 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a3c878e6-0202-4f2b-9407-2b2875b47101 tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:50.522980 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a3c878e6-0202-4f2b-9407-2b2875b47101 tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:50.523414 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-b81c12d2-cb03-42f4-892c-343b5bb71d7a tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: 1b2a9a93-cad5-4b18-abc3-1b88413f88da] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:50.523924 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a3c878e6-0202-4f2b-9407-2b2875b47101 tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:50.524792 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a3c878e6-0202-4f2b-9407-2b2875b47101 tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:50.525334 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a3c878e6-0202-4f2b-9407-2b2875b47101 tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:50.531601 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b81c12d2-cb03-42f4-892c-343b5bb71d7a tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:50.532346 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b81c12d2-cb03-42f4-892c-343b5bb71d7a tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:50.533173 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b81c12d2-cb03-42f4-892c-343b5bb71d7a tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:50.534060 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b81c12d2-cb03-42f4-892c-343b5bb71d7a tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:50.534513 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b81c12d2-cb03-42f4-892c-343b5bb71d7a tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:50.535166 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b81c12d2-cb03-42f4-892c-343b5bb71d7a tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:50.557156 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-a3c878e6-0202-4f2b-9407-2b2875b47101 tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': 'c562ad6d5022429ba559a25c20c7569b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '545d0b704b5d455c8ffaeacb7cebace0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:50.559154 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a3c878e6-0202-4f2b-9407-2b2875b47101 tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Request method failure captured: Sep 14 08:53:50.559154 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/505d2e57-caf3-43d1-b6d6-9678e38c1aab/diagnostics HTTP/1.1 Sep 14 08:53:50.559154 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 08:53:50.559154 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 08:53:50.559154 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 08:53:50.559154 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 08:53:50.559154 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 08:53:50.559154 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 08:53:50.559154 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 08:53:50.559154 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 08:53:50.559154 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZaGAyCdIRbSVPK4zHGpoFMN8safuoIspaRFmaGSzFqKUICUIO4QUn_v4uBHD4buNj0nRzihqVOSgXRSBw9ntVyWkhl0rfrkTdttSa9xDMM-ihtdDRQJV0hFMWKjpEgw-D2E39dO-zvB6YugiVwFkuB1rJhvFHqaMNh2ncmmJ5WyD9U Sep 14 08:53:50.559154 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 08:53:50.559154 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 08:53:50.559154 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 08:53:50.559154 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 08:53:50.559154 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 08:53:50.559154 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 08:53:50.559154 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 545d0b704b5d455c8ffaeacb7cebace0 Sep 14 08:53:50.559154 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1393911297 Sep 14 08:53:50.559154 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 08:53:50.559154 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 08:53:50.560591 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/545d0b704b5d455c8ffaeacb7cebace0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_545d0b704b5d455c8ffaeacb7cebace0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/545d0b704b5d455c8ffaeacb7cebace0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/545d0b704b5d455c8ffaeacb7cebace0"}]}] Sep 14 08:53:50.560591 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1393911297 Sep 14 08:53:50.560591 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 545d0b704b5d455c8ffaeacb7cebace0 Sep 14 08:53:50.560591 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1393911297 Sep 14 08:53:50.560591 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ServerDiagnosticsNegativeTest-1393911297-project Sep 14 08:53:50.560591 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 08:53:50.560591 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 08:53:50.560591 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: c562ad6d5022429ba559a25c20c7569b Sep 14 08:53:50.560591 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1393911297-project Sep 14 08:53:50.560591 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 08:53:50.560591 n-d-836830-18 devstack@n-api.service[128759]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Sep 14 08:53:50.561388 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'server_id': '505d2e57-caf3-43d1-b6d6-9678e38c1aab'} Sep 14 08:53:50.561388 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:53:50.561388 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:53:50.561388 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:53:50.561388 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:53:50.561388 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:53:50.561388 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:53:50.561388 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:53:50.561388 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:53:50.561388 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Sep 14 08:53:50.561388 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Sep 14 08:53:50.561388 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 14 08:53:50.561388 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 14 08:53:50.561388 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 14 08:53:50.561388 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 14 08:53:50.561388 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 14 08:53:50.561388 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 14 08:53:50.561388 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 14 08:53:50.561388 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise self.value Sep 14 08:53:50.561388 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 14 08:53:50.562754 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 14 08:53:50.562754 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 14 08:53:50.562754 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 14 08:53:50.562754 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 14 08:53:50.562754 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 14 08:53:50.562754 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Sep 14 08:53:50.562754 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:53:50.562754 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:53:50.562754 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:53:50.562754 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:53:50.562754 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:53:50.562754 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:53:50.562754 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 14 08:53:50.562754 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 14 08:53:50.562754 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Sep 14 08:53:50.562754 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:53:50.562754 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a3c878e6-0202-4f2b-9407-2b2875b47101 tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:53:50.564050 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a3c878e6-0202-4f2b-9407-2b2875b47101 tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] 10.222.0.60 "GET /compute/v2.1/servers/505d2e57-caf3-43d1-b6d6-9678e38c1aab/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.087197 Sep 14 08:53:50.564050 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 707/1415] 10.222.0.60 () {58 vars in 1272 bytes} [Wed Sep 14 08:53:50 2022] GET /compute/v2.1/servers/505d2e57-caf3-43d1-b6d6-9678e38c1aab/diagnostics => generated 117 bytes in 89 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 14 08:53:50.572754 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-14dafcf4-e2d7-4bcd-bc06-3c26a99f2645 req-02206381-d78d-430c-ab7b-61b31378abb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b2a9a93-cad5-4b18-abc3-1b88413f88da", "name": "network-vif-plugged", "status": "completed", "tag": "3db17a23-17af-436b-96e5-130e5c8353bc"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:53:50.584089 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-14dafcf4-e2d7-4bcd-bc06-3c26a99f2645 req-02206381-d78d-430c-ab7b-61b31378abb2 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:50.584576 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-14dafcf4-e2d7-4bcd-bc06-3c26a99f2645 req-02206381-d78d-430c-ab7b-61b31378abb2 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:50.585071 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-14dafcf4-e2d7-4bcd-bc06-3c26a99f2645 req-02206381-d78d-430c-ab7b-61b31378abb2 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:50.599697 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-14dafcf4-e2d7-4bcd-bc06-3c26a99f2645 req-02206381-d78d-430c-ab7b-61b31378abb2 service nova] Creating event network-vif-plugged:3db17a23-17af-436b-96e5-130e5c8353bc for instance 1b2a9a93-cad5-4b18-abc3-1b88413f88da on n-h1-836830-18 Sep 14 08:53:50.608968 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [req-14dafcf4-e2d7-4bcd-bc06-3c26a99f2645 req-02206381-d78d-430c-ab7b-61b31378abb2 service nova] Instance 1b2a9a93-cad5-4b18-abc3-1b88413f88da is migrating within the same cell, copying events to all relevant hosts: {'n-h1-836830-18', 'n-h2-836830-18'} {{(pid=128759) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 14 08:53:50.624939 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-14dafcf4-e2d7-4bcd-bc06-3c26a99f2645 req-02206381-d78d-430c-ab7b-61b31378abb2 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055614 Sep 14 08:53:50.627171 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 708/1416] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:53:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:53:50.636942 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-1c9a871a-c5c7-4f09-9c9d-8677a48ba754 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:50.639388 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-1c9a871a-c5c7-4f09-9c9d-8677a48ba754 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: 8fce8438-d6ae-408d-8b4f-ee14d4021fdd] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:50.649947 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1c9a871a-c5c7-4f09-9c9d-8677a48ba754 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:50.651290 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1c9a871a-c5c7-4f09-9c9d-8677a48ba754 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:50.651965 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1c9a871a-c5c7-4f09-9c9d-8677a48ba754 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:50.652868 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1c9a871a-c5c7-4f09-9c9d-8677a48ba754 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:50.653490 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1c9a871a-c5c7-4f09-9c9d-8677a48ba754 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:50.654078 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1c9a871a-c5c7-4f09-9c9d-8677a48ba754 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:50.790608 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-b81c12d2-cb03-42f4-892c-343b5bb71d7a tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:50.812283 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-b81c12d2-cb03-42f4-892c-343b5bb71d7a tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/1b2a9a93-cad5-4b18-abc3-1b88413f88da" status: 200 len: 1468 microversion: 2.1 time: 0.293711 Sep 14 08:53:50.831547 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 709/1417] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:50 2022] GET /compute/v2.1/servers/1b2a9a93-cad5-4b18-abc3-1b88413f88da => generated 1468 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:53:50.838565 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-6f860148-6078-4122-987e-3a64268d5ecb tempest-SecurityGroupRulesTestJSON-782480009 tempest-SecurityGroupRulesTestJSON-782480009-project] Action: 'create', calling method: .version_select at 0x7f7d443fe040>, body: {"security_group_rule": {"parent_group_id": "eea59c46-052d-4c42-8d19-8d4913cce7e3", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:53:50.899668 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-1c9a871a-c5c7-4f09-9c9d-8677a48ba754 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:50.911615 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-1c9a871a-c5c7-4f09-9c9d-8677a48ba754 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:50.915588 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-1c9a871a-c5c7-4f09-9c9d-8677a48ba754 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:50.916861 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-1c9a871a-c5c7-4f09-9c9d-8677a48ba754 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd" status: 200 len: 1815 microversion: 2.25 time: 0.288370 Sep 14 08:53:50.917432 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 709/1418] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:53:50 2022] GET /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd => generated 1815 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:53:50.933191 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b177e43e-eb29-47be-b9b0-01bb35c528c6 tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:50.934578 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b177e43e-eb29-47be-b9b0-01bb35c528c6 tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] [instance: 505d2e57-caf3-43d1-b6d6-9678e38c1aab] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:50.944416 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b177e43e-eb29-47be-b9b0-01bb35c528c6 tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:50.945152 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b177e43e-eb29-47be-b9b0-01bb35c528c6 tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:50.946045 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b177e43e-eb29-47be-b9b0-01bb35c528c6 tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:50.947033 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b177e43e-eb29-47be-b9b0-01bb35c528c6 tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:50.947642 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b177e43e-eb29-47be-b9b0-01bb35c528c6 tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:50.948252 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b177e43e-eb29-47be-b9b0-01bb35c528c6 tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:50.985315 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b177e43e-eb29-47be-b9b0-01bb35c528c6 tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] [instance: 505d2e57-caf3-43d1-b6d6-9678e38c1aab] Going to try to terminate instance {{(pid=128759) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 08:53:51.111747 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b177e43e-eb29-47be-b9b0-01bb35c528c6 tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] 10.222.0.60 "DELETE /compute/v2.1/servers/505d2e57-caf3-43d1-b6d6-9678e38c1aab" status: 204 len: 0 microversion: 2.1 time: 0.192871 Sep 14 08:53:51.112633 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 710/1419] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 08:53:50 2022] DELETE /compute/v2.1/servers/505d2e57-caf3-43d1-b6d6-9678e38c1aab => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 08:53:51.119712 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-156f811f-c844-45b6-856e-3ca27378c94c tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:51.120408 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-156f811f-c844-45b6-856e-3ca27378c94c tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] [instance: 58b5d8a4-035b-4a2f-8a83-02ea69847900] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:51.126262 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-156f811f-c844-45b6-856e-3ca27378c94c tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:51.126758 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-156f811f-c844-45b6-856e-3ca27378c94c tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:51.127262 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-156f811f-c844-45b6-856e-3ca27378c94c tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:51.128262 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-156f811f-c844-45b6-856e-3ca27378c94c tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:51.128384 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-156f811f-c844-45b6-856e-3ca27378c94c tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:51.129129 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-156f811f-c844-45b6-856e-3ca27378c94c tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:51.145807 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-6f860148-6078-4122-987e-3a64268d5ecb tempest-SecurityGroupRulesTestJSON-782480009 tempest-SecurityGroupRulesTestJSON-782480009-project] 10.222.0.60 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.312241 Sep 14 08:53:51.146546 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 710/1420] 10.222.0.60 () {60 vars in 1195 bytes} [Wed Sep 14 08:53:50 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:53:51.151917 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-9d158184-2efc-4e2a-b2a4-e06f938e8168 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:51.152773 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-9d158184-2efc-4e2a-b2a4-e06f938e8168 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] [instance: 4ea5843e-ecf7-4b84-80cb-3f05b2b20982] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:51.160938 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9d158184-2efc-4e2a-b2a4-e06f938e8168 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:51.161695 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9d158184-2efc-4e2a-b2a4-e06f938e8168 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:51.162148 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9d158184-2efc-4e2a-b2a4-e06f938e8168 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:51.162854 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9d158184-2efc-4e2a-b2a4-e06f938e8168 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:51.163337 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9d158184-2efc-4e2a-b2a4-e06f938e8168 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:51.163769 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9d158184-2efc-4e2a-b2a4-e06f938e8168 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:51.474063 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-9d158184-2efc-4e2a-b2a4-e06f938e8168 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810376d6f0b4329abe0f8f79800b754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575684f36f9c4019926fc83541e152c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:51.485586 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-9d158184-2efc-4e2a-b2a4-e06f938e8168 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] 10.222.0.60 "GET /compute/v2.1/servers/4ea5843e-ecf7-4b84-80cb-3f05b2b20982" status: 200 len: 1293 microversion: 2.1 time: 0.335564 Sep 14 08:53:51.487424 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 711/1421] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:51 2022] GET /compute/v2.1/servers/4ea5843e-ecf7-4b84-80cb-3f05b2b20982 => generated 1293 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:53:51.498373 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c22c8c94-1f64-4e4b-ac7c-a77132caac69 tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:51.498798 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-156f811f-c844-45b6-856e-3ca27378c94c tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeaac454f233408ba1597b36bb9277dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38a515fd540744a2bdf6fb971f4a6924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:51.502203 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-c22c8c94-1f64-4e4b-ac7c-a77132caac69 tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] [instance: 505d2e57-caf3-43d1-b6d6-9678e38c1aab] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:51.509527 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c22c8c94-1f64-4e4b-ac7c-a77132caac69 tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:51.510180 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-156f811f-c844-45b6-856e-3ca27378c94c tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] 10.222.0.60 "GET /compute/v2.1/servers/58b5d8a4-035b-4a2f-8a83-02ea69847900" status: 200 len: 1715 microversion: 2.1 time: 0.395295 Sep 14 08:53:51.510275 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c22c8c94-1f64-4e4b-ac7c-a77132caac69 tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:51.510445 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c22c8c94-1f64-4e4b-ac7c-a77132caac69 tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:51.511212 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c22c8c94-1f64-4e4b-ac7c-a77132caac69 tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:51.511671 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c22c8c94-1f64-4e4b-ac7c-a77132caac69 tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:51.512096 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c22c8c94-1f64-4e4b-ac7c-a77132caac69 tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:51.519631 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 711/1422] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:51 2022] GET /compute/v2.1/servers/58b5d8a4-035b-4a2f-8a83-02ea69847900 => generated 1715 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:53:51.532503 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f6d85f86-046e-48cf-a06c-cb94ec8c2ade tempest-SecurityGroupRulesTestJSON-782480009 tempest-SecurityGroupRulesTestJSON-782480009-project] Action: 'create', calling method: .version_select at 0x7f7d442514c0>, body: {"security_group_rule": {"parent_group_id": "eea59c46-052d-4c42-8d19-8d4913cce7e3", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:53:51.730715 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-c22c8c94-1f64-4e4b-ac7c-a77132caac69 tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c562ad6d5022429ba559a25c20c7569b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '545d0b704b5d455c8ffaeacb7cebace0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:51.740090 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-c22c8c94-1f64-4e4b-ac7c-a77132caac69 tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] 10.222.0.60 "GET /compute/v2.1/servers/505d2e57-caf3-43d1-b6d6-9678e38c1aab" status: 200 len: 1478 microversion: 2.1 time: 0.247158 Sep 14 08:53:51.740789 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 712/1423] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:51 2022] GET /compute/v2.1/servers/505d2e57-caf3-43d1-b6d6-9678e38c1aab => generated 1478 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:53:51.746118 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-05ba20e5-24a0-428d-a864-2d566570d91c req-a6fdd08b-fe36-4fae-ac9e-553a6755f4f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "feeb311c-8462-4539-bbc8-4120559413cb", "name": "network-vif-deleted", "tag": "4a1be6f1-1a5b-4e4b-a505-9c04755c817d"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:53:51.756875 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-05ba20e5-24a0-428d-a864-2d566570d91c req-a6fdd08b-fe36-4fae-ac9e-553a6755f4f4 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:51.757368 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-05ba20e5-24a0-428d-a864-2d566570d91c req-a6fdd08b-fe36-4fae-ac9e-553a6755f4f4 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:51.757797 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-05ba20e5-24a0-428d-a864-2d566570d91c req-a6fdd08b-fe36-4fae-ac9e-553a6755f4f4 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:51.771308 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-05ba20e5-24a0-428d-a864-2d566570d91c req-a6fdd08b-fe36-4fae-ac9e-553a6755f4f4 service nova] Creating event network-vif-deleted:4a1be6f1-1a5b-4e4b-a505-9c04755c817d for instance feeb311c-8462-4539-bbc8-4120559413cb on n-h2-836830-18 Sep 14 08:53:51.776519 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-05ba20e5-24a0-428d-a864-2d566570d91c req-a6fdd08b-fe36-4fae-ac9e-553a6755f4f4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034136 Sep 14 08:53:51.777978 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 713/1424] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:53:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:53:51.784104 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-07551d18-d88d-4849-a599-a6a0896f75ce tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:51.785842 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-07551d18-d88d-4849-a599-a6a0896f75ce tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] [instance: feeb311c-8462-4539-bbc8-4120559413cb] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:51.793157 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-07551d18-d88d-4849-a599-a6a0896f75ce tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:51.793782 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-07551d18-d88d-4849-a599-a6a0896f75ce tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:51.794325 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-07551d18-d88d-4849-a599-a6a0896f75ce tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:51.795177 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-07551d18-d88d-4849-a599-a6a0896f75ce tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:51.795786 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-07551d18-d88d-4849-a599-a6a0896f75ce tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:51.796311 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-07551d18-d88d-4849-a599-a6a0896f75ce tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:51.835370 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-07551d18-d88d-4849-a599-a6a0896f75ce tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:51.835862 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-07551d18-d88d-4849-a599-a6a0896f75ce tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:51.836493 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-07551d18-d88d-4849-a599-a6a0896f75ce tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:51.837123 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.objects.instance [None req-07551d18-d88d-4849-a599-a6a0896f75ce tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lazy-loading 'fault' on Instance uuid feeb311c-8462-4539-bbc8-4120559413cb {{(pid=128758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 08:53:51.843515 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f6d85f86-046e-48cf-a06c-cb94ec8c2ade tempest-SecurityGroupRulesTestJSON-782480009 tempest-SecurityGroupRulesTestJSON-782480009-project] 10.222.0.60 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.322376 Sep 14 08:53:51.851846 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 712/1425] 10.222.0.60 () {60 vars in 1195 bytes} [Wed Sep 14 08:53:51 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:53:51.851846 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-90807bb1-2210-4533-9347-19cb876b9115 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:51.851846 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-90807bb1-2210-4533-9347-19cb876b9115 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: 1b2a9a93-cad5-4b18-abc3-1b88413f88da] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:51.856497 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-90807bb1-2210-4533-9347-19cb876b9115 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:51.857052 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-90807bb1-2210-4533-9347-19cb876b9115 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:51.857504 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-90807bb1-2210-4533-9347-19cb876b9115 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:51.858210 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-90807bb1-2210-4533-9347-19cb876b9115 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:51.858807 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-90807bb1-2210-4533-9347-19cb876b9115 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:51.859356 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-90807bb1-2210-4533-9347-19cb876b9115 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:51.889824 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-07551d18-d88d-4849-a599-a6a0896f75ce tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ace9012a7c4ce59c01858b6984b766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a87a909133e42e1a82e3a623536935c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:51.899101 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-07551d18-d88d-4849-a599-a6a0896f75ce tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] 10.222.0.60 "GET /compute/v2.1/servers/feeb311c-8462-4539-bbc8-4120559413cb" status: 200 len: 1314 microversion: 2.1 time: 0.119475 Sep 14 08:53:51.910071 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 714/1426] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:51 2022] GET /compute/v2.1/servers/feeb311c-8462-4539-bbc8-4120559413cb => generated 1314 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:53:51.917871 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-3c1bab21-ba6e-4ba4-b8c6-c30b37ce5e77 tempest-SecurityGroupRulesTestJSON-782480009 tempest-SecurityGroupRulesTestJSON-782480009-project] Calling method '.version_select at 0x7f7d44535d30>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:52.030021 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-3c1bab21-ba6e-4ba4-b8c6-c30b37ce5e77 tempest-SecurityGroupRulesTestJSON-782480009 tempest-SecurityGroupRulesTestJSON-782480009-project] 10.222.0.60 "GET /compute/v2.1/os-security-groups/eea59c46-052d-4c42-8d19-8d4913cce7e3" status: 200 len: 664 microversion: 2.1 time: 0.118666 Sep 14 08:53:52.030679 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 715/1427] 10.222.0.60 () {58 vars in 1269 bytes} [Wed Sep 14 08:53:51 2022] GET /compute/v2.1/os-security-groups/eea59c46-052d-4c42-8d19-8d4913cce7e3 => generated 664 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:53:52.035709 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-4a46ab58-4374-4094-9906-21cd6b8c032c tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:52.036557 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-4a46ab58-4374-4094-9906-21cd6b8c032c tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: 8fce8438-d6ae-408d-8b4f-ee14d4021fdd] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:52.050204 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4a46ab58-4374-4094-9906-21cd6b8c032c tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:52.050849 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4a46ab58-4374-4094-9906-21cd6b8c032c tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:52.051423 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4a46ab58-4374-4094-9906-21cd6b8c032c tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:52.052147 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-90807bb1-2210-4533-9347-19cb876b9115 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:52.052324 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4a46ab58-4374-4094-9906-21cd6b8c032c tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:52.052904 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4a46ab58-4374-4094-9906-21cd6b8c032c tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:52.053440 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4a46ab58-4374-4094-9906-21cd6b8c032c tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:52.062608 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-90807bb1-2210-4533-9347-19cb876b9115 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/1b2a9a93-cad5-4b18-abc3-1b88413f88da" status: 200 len: 1468 microversion: 2.1 time: 0.217048 Sep 14 08:53:52.067407 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 713/1428] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:51 2022] GET /compute/v2.1/servers/1b2a9a93-cad5-4b18-abc3-1b88413f88da => generated 1468 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:53:52.076910 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9b2d2b35-97ac-4292-b0f4-1fc76ac29ec3 tempest-SecurityGroupRulesTestJSON-782480009 tempest-SecurityGroupRulesTestJSON-782480009-project] Calling method '.version_select at 0x7f7d44251310>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:52.604276 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-4a46ab58-4374-4094-9906-21cd6b8c032c tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:52.614488 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-4a46ab58-4374-4094-9906-21cd6b8c032c tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:52.616196 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-4a46ab58-4374-4094-9906-21cd6b8c032c tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:52.617833 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-4a46ab58-4374-4094-9906-21cd6b8c032c tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd" status: 200 len: 1815 microversion: 2.25 time: 0.585922 Sep 14 08:53:52.618818 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 716/1429] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:53:52 2022] GET /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd => generated 1815 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:53:52.623675 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-3976d4b5-5355-46df-8403-1abcc1c24229 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:52.624543 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-3976d4b5-5355-46df-8403-1abcc1c24229 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] [instance: 4ea5843e-ecf7-4b84-80cb-3f05b2b20982] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:52.631107 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3976d4b5-5355-46df-8403-1abcc1c24229 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:52.631671 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3976d4b5-5355-46df-8403-1abcc1c24229 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:52.632179 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3976d4b5-5355-46df-8403-1abcc1c24229 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:52.632940 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3976d4b5-5355-46df-8403-1abcc1c24229 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:52.633468 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3976d4b5-5355-46df-8403-1abcc1c24229 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:52.633960 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3976d4b5-5355-46df-8403-1abcc1c24229 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:52.675182 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-9b2d2b35-97ac-4292-b0f4-1fc76ac29ec3 tempest-SecurityGroupRulesTestJSON-782480009 tempest-SecurityGroupRulesTestJSON-782480009-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-group-rules/90363b79-f1c6-4061-9e12-413626b8ced9" status: 202 len: 0 microversion: 2.1 time: 0.603220 Sep 14 08:53:52.680160 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 714/1430] 10.222.0.60 () {58 vars in 1287 bytes} [Wed Sep 14 08:53:52 2022] DELETE /compute/v2.1/os-security-group-rules/90363b79-f1c6-4061-9e12-413626b8ced9 => generated 0 bytes in 605 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 08:53:52.683758 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-99b9d9be-85c1-45bf-9dbf-4dbd31f52ec6 tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:52.684387 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-99b9d9be-85c1-45bf-9dbf-4dbd31f52ec6 tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] [instance: 58b5d8a4-035b-4a2f-8a83-02ea69847900] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:52.690644 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-99b9d9be-85c1-45bf-9dbf-4dbd31f52ec6 tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:52.691701 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-99b9d9be-85c1-45bf-9dbf-4dbd31f52ec6 tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:52.692150 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-99b9d9be-85c1-45bf-9dbf-4dbd31f52ec6 tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:52.692913 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-99b9d9be-85c1-45bf-9dbf-4dbd31f52ec6 tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:52.693372 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-99b9d9be-85c1-45bf-9dbf-4dbd31f52ec6 tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:52.693801 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-99b9d9be-85c1-45bf-9dbf-4dbd31f52ec6 tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:52.775972 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-99b9d9be-85c1-45bf-9dbf-4dbd31f52ec6 tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeaac454f233408ba1597b36bb9277dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38a515fd540744a2bdf6fb971f4a6924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:52.789098 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-99b9d9be-85c1-45bf-9dbf-4dbd31f52ec6 tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] 10.222.0.60 "GET /compute/v2.1/servers/58b5d8a4-035b-4a2f-8a83-02ea69847900" status: 200 len: 1647 microversion: 2.1 time: 0.111094 Sep 14 08:53:52.789778 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 715/1431] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:52 2022] GET /compute/v2.1/servers/58b5d8a4-035b-4a2f-8a83-02ea69847900 => generated 1647 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:53:52.794381 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-31155e16-b1ac-4362-a4cc-5a70fb13cfba tempest-SecurityGroupRulesTestJSON-782480009 tempest-SecurityGroupRulesTestJSON-782480009-project] Calling method '.version_select at 0x7f7d44251310>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:52.820927 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-3976d4b5-5355-46df-8403-1abcc1c24229 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810376d6f0b4329abe0f8f79800b754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575684f36f9c4019926fc83541e152c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:52.829748 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-3976d4b5-5355-46df-8403-1abcc1c24229 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] 10.222.0.60 "GET /compute/v2.1/servers/4ea5843e-ecf7-4b84-80cb-3f05b2b20982" status: 200 len: 1293 microversion: 2.1 time: 0.209567 Sep 14 08:53:52.830338 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 717/1432] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:52 2022] GET /compute/v2.1/servers/4ea5843e-ecf7-4b84-80cb-3f05b2b20982 => generated 1293 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:53:52.835788 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-ec6e8081-1b64-4636-aea9-2d3d1e04cbea req-f670537c-f6a3-4f25-af84-9ccfc3bce9b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ea5843e-ecf7-4b84-80cb-3f05b2b20982", "name": "network-vif-plugged", "status": "completed", "tag": "413aded5-fbf0-4893-9752-3f4384abde15"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:53:52.856227 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-ec6e8081-1b64-4636-aea9-2d3d1e04cbea req-f670537c-f6a3-4f25-af84-9ccfc3bce9b3 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:52.856727 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-ec6e8081-1b64-4636-aea9-2d3d1e04cbea req-f670537c-f6a3-4f25-af84-9ccfc3bce9b3 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:52.857169 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-ec6e8081-1b64-4636-aea9-2d3d1e04cbea req-f670537c-f6a3-4f25-af84-9ccfc3bce9b3 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:52.869391 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-ec6e8081-1b64-4636-aea9-2d3d1e04cbea req-f670537c-f6a3-4f25-af84-9ccfc3bce9b3 service nova] Creating event network-vif-plugged:413aded5-fbf0-4893-9752-3f4384abde15 for instance 4ea5843e-ecf7-4b84-80cb-3f05b2b20982 on n-h1-836830-18 Sep 14 08:53:52.874876 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-ec6e8081-1b64-4636-aea9-2d3d1e04cbea req-f670537c-f6a3-4f25-af84-9ccfc3bce9b3 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043193 Sep 14 08:53:52.875836 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 718/1433] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:53:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:53:52.881507 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1656cc56-6e45-4117-8bdf-2bc60d81a89b tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:52.882223 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-1656cc56-6e45-4117-8bdf-2bc60d81a89b tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] [instance: 505d2e57-caf3-43d1-b6d6-9678e38c1aab] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:52.888455 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1656cc56-6e45-4117-8bdf-2bc60d81a89b tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:52.888950 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1656cc56-6e45-4117-8bdf-2bc60d81a89b tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:52.889391 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1656cc56-6e45-4117-8bdf-2bc60d81a89b tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:52.890117 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1656cc56-6e45-4117-8bdf-2bc60d81a89b tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:52.890572 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1656cc56-6e45-4117-8bdf-2bc60d81a89b tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:52.891023 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1656cc56-6e45-4117-8bdf-2bc60d81a89b tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:53.071715 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-31155e16-b1ac-4362-a4cc-5a70fb13cfba tempest-SecurityGroupRulesTestJSON-782480009 tempest-SecurityGroupRulesTestJSON-782480009-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/eea59c46-052d-4c42-8d19-8d4913cce7e3" status: 202 len: 0 microversion: 2.1 time: 0.280815 Sep 14 08:53:53.072972 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 716/1434] 10.222.0.60 () {58 vars in 1272 bytes} [Wed Sep 14 08:53:52 2022] DELETE /compute/v2.1/os-security-groups/eea59c46-052d-4c42-8d19-8d4913cce7e3 => generated 0 bytes in 282 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 08:53:53.079388 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-1656cc56-6e45-4117-8bdf-2bc60d81a89b tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c562ad6d5022429ba559a25c20c7569b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '545d0b704b5d455c8ffaeacb7cebace0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:53.088317 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-0a8947d3-8b3c-4f92-8e07-09bf53dadfaa tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:53.089952 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-0a8947d3-8b3c-4f92-8e07-09bf53dadfaa tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] [instance: feeb311c-8462-4539-bbc8-4120559413cb] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:53.090330 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-1656cc56-6e45-4117-8bdf-2bc60d81a89b tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] 10.222.0.60 "GET /compute/v2.1/servers/505d2e57-caf3-43d1-b6d6-9678e38c1aab" status: 200 len: 1478 microversion: 2.1 time: 0.213135 Sep 14 08:53:53.091261 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 719/1435] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:52 2022] GET /compute/v2.1/servers/505d2e57-caf3-43d1-b6d6-9678e38c1aab => generated 1478 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:53:53.096271 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-cb4c2035-4ed2-46cf-aecd-77f141f5073e tempest-SecurityGroupRulesTestJSON-782480009 tempest-SecurityGroupRulesTestJSON-782480009-project] Calling method '.version_select at 0x7f7d44418dc0>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:53.097023 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0a8947d3-8b3c-4f92-8e07-09bf53dadfaa tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:53.097734 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0a8947d3-8b3c-4f92-8e07-09bf53dadfaa tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:53.098407 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0a8947d3-8b3c-4f92-8e07-09bf53dadfaa tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:53.099423 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0a8947d3-8b3c-4f92-8e07-09bf53dadfaa tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:53.100028 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0a8947d3-8b3c-4f92-8e07-09bf53dadfaa tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:53.100557 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0a8947d3-8b3c-4f92-8e07-09bf53dadfaa tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:53.123982 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-0a8947d3-8b3c-4f92-8e07-09bf53dadfaa tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] HTTP exception thrown: Instance feeb311c-8462-4539-bbc8-4120559413cb could not be found. Sep 14 08:53:53.124793 n-d-836830-18 devstack@n-api.service[128758]: DEBUG neutronclient.v2_0.client [None req-cb4c2035-4ed2-46cf-aecd-77f141f5073e tempest-SecurityGroupRulesTestJSON-782480009 tempest-SecurityGroupRulesTestJSON-782480009-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 40fba3a1-d32a-4328-a6d1-6f00be18539c does not exist", "detail": ""}} {{(pid=128758) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 14 08:53:53.125416 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.network.security_group_api [None req-cb4c2035-4ed2-46cf-aecd-77f141f5073e tempest-SecurityGroupRulesTestJSON-782480009 tempest-SecurityGroupRulesTestJSON-782480009-project] Neutron security group 40fba3a1-d32a-4328-a6d1-6f00be18539c not found {{(pid=128758) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 14 08:53:53.126257 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-0a8947d3-8b3c-4f92-8e07-09bf53dadfaa tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Request method failure captured: Sep 14 08:53:53.126257 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/feeb311c-8462-4539-bbc8-4120559413cb HTTP/1.1 Sep 14 08:53:53.126257 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 08:53:53.126257 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 08:53:53.126257 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 08:53:53.126257 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 08:53:53.126257 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 08:53:53.126257 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 08:53:53.126257 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 08:53:53.126257 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 08:53:53.126257 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZZS4Po83Aovv_U3RdkjXLQKweaQf-fhAgT61i_A11uamuOl6sYuSjebIurWFthtZrzpGvY9uLyOeI1i9q8ClJm3kMoDWgYaqbwGjdZ-I8VmC2NF95wjpQldZSAgTTLlPF11CuzqbhW26YYuwljJxckz8_fE9N_t89yQzibByeeP394 Sep 14 08:53:53.126257 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 08:53:53.126257 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 08:53:53.126257 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 08:53:53.126257 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 08:53:53.126257 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 08:53:53.126257 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 08:53:53.126257 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 0a87a909133e42e1a82e3a623536935c Sep 14 08:53:53.126257 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1646226177 Sep 14 08:53:53.126257 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 08:53:53.126257 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 08:53:53.127955 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0a87a909133e42e1a82e3a623536935c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0a87a909133e42e1a82e3a623536935c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0a87a909133e42e1a82e3a623536935c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0a87a909133e42e1a82e3a623536935c"}]}] Sep 14 08:53:53.127955 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1646226177 Sep 14 08:53:53.127955 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 0a87a909133e42e1a82e3a623536935c Sep 14 08:53:53.127955 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1646226177 Sep 14 08:53:53.127955 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ImagesOneServerNegativeTestJSON-1646226177-project Sep 14 08:53:53.127955 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 08:53:53.127955 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 08:53:53.127955 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: a3ace9012a7c4ce59c01858b6984b766 Sep 14 08:53:53.127955 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1646226177-project Sep 14 08:53:53.127955 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 08:53:53.127955 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance feeb311c-8462-4539-bbc8-4120559413cb could not be found. Sep 14 08:53:53.127955 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': 'feeb311c-8462-4539-bbc8-4120559413cb'} Sep 14 08:53:53.129381 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:53:53.129381 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:53:53.129381 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 08:53:53.129381 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 08:53:53.129381 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 08:53:53.129381 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 08:53:53.129381 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 08:53:53.129381 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 08:53:53.129381 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 08:53:53.129381 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 08:53:53.129381 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance feeb311c-8462-4539-bbc8-4120559413cb could not be found. Sep 14 08:53:53.129381 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:53:53.129381 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:53:53.129381 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:53:53.129381 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:53:53.129381 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:53:53.129381 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:53:53.129381 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:53:53.129381 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:53:53.129381 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:53:53.140429 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:53:53.140429 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 08:53:53.140429 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 08:53:53.140429 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 08:53:53.140429 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 08:53:53.140429 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 08:53:53.140429 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 08:53:53.140429 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance feeb311c-8462-4539-bbc8-4120559413cb could not be found. Sep 14 08:53:53.140429 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:53:53.140429 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:53:53.140429 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:53:53.140429 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:53:53.140429 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:53:53.140429 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:53:53.140429 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:53:53.140429 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:53:53.140429 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance feeb311c-8462-4539-bbc8-4120559413cb could not be found. Sep 14 08:53:53.140429 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:53:53.143538 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-0a8947d3-8b3c-4f92-8e07-09bf53dadfaa tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Returning 404 to user: Instance feeb311c-8462-4539-bbc8-4120559413cb could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:53:53.143538 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-0a8947d3-8b3c-4f92-8e07-09bf53dadfaa tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] 10.222.0.60 "GET /compute/v2.1/servers/feeb311c-8462-4539-bbc8-4120559413cb" status: 404 len: 111 microversion: 2.1 time: 0.053633 Sep 14 08:53:53.143815 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-cb4c2035-4ed2-46cf-aecd-77f141f5073e tempest-SecurityGroupRulesTestJSON-782480009 tempest-SecurityGroupRulesTestJSON-782480009-project] HTTP exception thrown: Security group 40fba3a1-d32a-4328-a6d1-6f00be18539c does not exist Sep 14 08:53:53.143815 n-d-836830-18 devstack@n-api.service[128758]: Neutron server returns request_ids: ['req-7d0fa87f-0ad7-4c05-b9b8-6e93ea3c9923'] Sep 14 08:53:53.144113 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 717/1436] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:53 2022] GET /compute/v2.1/servers/feeb311c-8462-4539-bbc8-4120559413cb => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 08:53:53.144263 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-cb4c2035-4ed2-46cf-aecd-77f141f5073e tempest-SecurityGroupRulesTestJSON-782480009 tempest-SecurityGroupRulesTestJSON-782480009-project] Request method failure captured: Sep 14 08:53:53.144263 n-d-836830-18 devstack@n-api.service[128758]: request: DELETE /compute/v2.1/os-security-groups/40fba3a1-d32a-4328-a6d1-6f00be18539c HTTP/1.1 Sep 14 08:53:53.144263 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 08:53:53.144263 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 08:53:53.144263 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 08:53:53.144263 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 08:53:53.144263 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 08:53:53.144263 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 08:53:53.144263 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 08:53:53.144263 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 08:53:53.144263 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZaYDo_22hmLmrxKNcD3728COT03oJajLwdPvuq5Hh2HV7KsSHBdLtHsJH4PhR6uJUBbIy5VA4tHQs4f21WjZcKgLgFaiHPh6UVoQE_0lJqnGfVO4xQyl0kzTFC1OeSWx2VX6WwymWrw5uPKg7ggudeZ91fqHxn9u-aKXbs1IZ4a8NY Sep 14 08:53:53.144263 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 08:53:53.144263 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 08:53:53.144263 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 08:53:53.144263 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 08:53:53.144263 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 08:53:53.144263 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 08:53:53.144263 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 6a4e124ea3f24b88b89b1337fcab55eb Sep 14 08:53:53.144263 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-782480009 Sep 14 08:53:53.144263 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 08:53:53.144263 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 08:53:53.147996 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6a4e124ea3f24b88b89b1337fcab55eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6a4e124ea3f24b88b89b1337fcab55eb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a4e124ea3f24b88b89b1337fcab55eb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a4e124ea3f24b88b89b1337fcab55eb"}]}] Sep 14 08:53:53.147996 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-SecurityGroupRulesTestJSON-782480009 Sep 14 08:53:53.147996 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 6a4e124ea3f24b88b89b1337fcab55eb Sep 14 08:53:53.147996 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-782480009 Sep 14 08:53:53.147996 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-SecurityGroupRulesTestJSON-782480009-project Sep 14 08:53:53.147996 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 08:53:53.147996 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 08:53:53.147996 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 97a72ecf50cb497783297e48e82f811d Sep 14 08:53:53.147996 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-SecurityGroupRulesTestJSON-782480009-project Sep 14 08:53:53.147996 n-d-836830-18 devstack@n-api.service[128758]: method: Sep 14 08:53:53.147996 n-d-836830-18 devstack@n-api.service[128758]: exception: Security group 40fba3a1-d32a-4328-a6d1-6f00be18539c does not exist Sep 14 08:53:53.147996 n-d-836830-18 devstack@n-api.service[128758]: Neutron server returns request_ids: ['req-7d0fa87f-0ad7-4c05-b9b8-6e93ea3c9923'] Sep 14 08:53:53.147996 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': '40fba3a1-d32a-4328-a6d1-6f00be18539c'} Sep 14 08:53:53.151865 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:53:53.151865 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:53:53.151865 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 14 08:53:53.151865 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 14 08:53:53.151865 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 08:53:53.151865 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 08:53:53.151865 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 14 08:53:53.151865 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 14 08:53:53.151865 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 08:53:53.151865 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 08:53:53.151865 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 14 08:53:53.151865 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 14 08:53:53.151865 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 08:53:53.151865 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 08:53:53.151865 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 14 08:53:53.151865 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 14 08:53:53.151865 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 08:53:53.151865 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 08:53:53.151865 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 14 08:53:53.154320 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 14 08:53:53.154320 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 08:53:53.154320 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 08:53:53.154320 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 14 08:53:53.154320 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 14 08:53:53.154320 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 14 08:53:53.154320 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 14 08:53:53.154320 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 40fba3a1-d32a-4328-a6d1-6f00be18539c does not exist Sep 14 08:53:53.154320 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7d0fa87f-0ad7-4c05-b9b8-6e93ea3c9923'] Sep 14 08:53:53.154320 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:53:53.154320 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:53:53.154320 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:53:53.154320 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:53:53.154320 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 14 08:53:53.154320 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 14 08:53:53.154320 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 14 08:53:53.154320 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 14 08:53:53.154320 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 40fba3a1-d32a-4328-a6d1-6f00be18539c does not exist Sep 14 08:53:53.156614 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7d0fa87f-0ad7-4c05-b9b8-6e93ea3c9923'] Sep 14 08:53:53.156614 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:53:53.156614 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:53:53.156614 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:53:53.156614 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:53:53.156614 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:53:53.156614 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:53:53.156614 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:53:53.156614 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:53:53.156614 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 08:53:53.156614 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 08:53:53.156614 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:53:53.156614 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:53:53.156614 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 14 08:53:53.156614 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 14 08:53:53.156614 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 40fba3a1-d32a-4328-a6d1-6f00be18539c does not exist Sep 14 08:53:53.156614 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7d0fa87f-0ad7-4c05-b9b8-6e93ea3c9923'] Sep 14 08:53:53.156614 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:53:53.156614 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:53:53.156614 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:53:53.156614 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:53:53.160947 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:53:53.160947 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:53:53.160947 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:53:53.160947 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:53:53.160947 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 40fba3a1-d32a-4328-a6d1-6f00be18539c does not exist Sep 14 08:53:53.160947 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7d0fa87f-0ad7-4c05-b9b8-6e93ea3c9923'] Sep 14 08:53:53.160947 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:53:53.160947 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-cb4c2035-4ed2-46cf-aecd-77f141f5073e tempest-SecurityGroupRulesTestJSON-782480009 tempest-SecurityGroupRulesTestJSON-782480009-project] Returning 404 to user: Security group 40fba3a1-d32a-4328-a6d1-6f00be18539c does not exist Sep 14 08:53:53.160947 n-d-836830-18 devstack@n-api.service[128758]: Neutron server returns request_ids: ['req-7d0fa87f-0ad7-4c05-b9b8-6e93ea3c9923'] {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:53:53.160947 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-cb4c2035-4ed2-46cf-aecd-77f141f5073e tempest-SecurityGroupRulesTestJSON-782480009 tempest-SecurityGroupRulesTestJSON-782480009-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/40fba3a1-d32a-4328-a6d1-6f00be18539c" status: 404 len: 194 microversion: 2.1 time: 0.040725 Sep 14 08:53:53.160947 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 720/1437] 10.222.0.60 () {58 vars in 1272 bytes} [Wed Sep 14 08:53:53 2022] DELETE /compute/v2.1/os-security-groups/40fba3a1-d32a-4328-a6d1-6f00be18539c => generated 194 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 08:53:53.162364 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-00912441-3ade-4f0d-8d61-4bfea4e30388 tempest-SecurityGroupRulesTestJSON-782480009 tempest-SecurityGroupRulesTestJSON-782480009-project] Calling method '.version_select at 0x7f7d443fe310>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:53.168837 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-57da153a-e764-4177-bb5c-38d871af50ef tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:53.170293 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-57da153a-e764-4177-bb5c-38d871af50ef tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: 1b2a9a93-cad5-4b18-abc3-1b88413f88da] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:53.177901 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-57da153a-e764-4177-bb5c-38d871af50ef tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:53.178782 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-57da153a-e764-4177-bb5c-38d871af50ef tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:53.179416 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-57da153a-e764-4177-bb5c-38d871af50ef tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:53.180807 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-57da153a-e764-4177-bb5c-38d871af50ef tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:53.181456 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-57da153a-e764-4177-bb5c-38d871af50ef tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:53.182082 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-57da153a-e764-4177-bb5c-38d871af50ef tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:53.628221 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-57da153a-e764-4177-bb5c-38d871af50ef tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:53.637428 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-57da153a-e764-4177-bb5c-38d871af50ef tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/1b2a9a93-cad5-4b18-abc3-1b88413f88da" status: 200 len: 1468 microversion: 2.1 time: 0.505144 Sep 14 08:53:53.638018 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 718/1438] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:53 2022] GET /compute/v2.1/servers/1b2a9a93-cad5-4b18-abc3-1b88413f88da => generated 1468 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:53:53.648471 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-429c6b25-a7d2-4a9c-8f2c-f730a82fdf9d tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1151243542", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:53:53.684106 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-00912441-3ade-4f0d-8d61-4bfea4e30388 tempest-SecurityGroupRulesTestJSON-782480009 tempest-SecurityGroupRulesTestJSON-782480009-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/9866eff0-296e-4ce2-add0-9539d445bbd4" status: 202 len: 0 microversion: 2.1 time: 0.544820 Sep 14 08:53:53.687306 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 721/1439] 10.222.0.60 () {58 vars in 1272 bytes} [Wed Sep 14 08:53:53 2022] DELETE /compute/v2.1/os-security-groups/9866eff0-296e-4ce2-add0-9539d445bbd4 => generated 0 bytes in 549 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 08:53:53.697698 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-7322324d-2e9a-496c-a8e4-294e758e6274 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:53.698716 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-7322324d-2e9a-496c-a8e4-294e758e6274 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: 8fce8438-d6ae-408d-8b4f-ee14d4021fdd] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:53.709269 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7322324d-2e9a-496c-a8e4-294e758e6274 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:53.710128 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7322324d-2e9a-496c-a8e4-294e758e6274 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:53.710765 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7322324d-2e9a-496c-a8e4-294e758e6274 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:53.711687 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7322324d-2e9a-496c-a8e4-294e758e6274 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:53.712506 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7322324d-2e9a-496c-a8e4-294e758e6274 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:53.725388 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7322324d-2e9a-496c-a8e4-294e758e6274 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:53.746022 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.network.neutron [None req-429c6b25-a7d2-4a9c-8f2c-f730a82fdf9d tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] validate_networks() for [('3aed98a5-2a8d-47be-aa58-f6f22237126d', None, None, None, None, None)] {{(pid=128759) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 08:53:54.154179 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-7322324d-2e9a-496c-a8e4-294e758e6274 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:54.165377 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-7322324d-2e9a-496c-a8e4-294e758e6274 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:54.167705 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-7322324d-2e9a-496c-a8e4-294e758e6274 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:54.169057 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-7322324d-2e9a-496c-a8e4-294e758e6274 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd" status: 200 len: 1815 microversion: 2.25 time: 0.479723 Sep 14 08:53:54.170230 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 722/1440] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:53:53 2022] GET /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd => generated 1815 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:53:54.176787 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-5e595a4e-df3a-42d1-b5b3-1554d112e15c tempest-SecurityGroupRulesTestJSON-782480009 tempest-SecurityGroupRulesTestJSON-782480009-project] Calling method '.version_select at 0x7f7d443aee50>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:54.730316 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-429c6b25-a7d2-4a9c-8f2c-f730a82fdf9d tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Flavor limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 08:53:54.730836 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-429c6b25-a7d2-4a9c-8f2c-f730a82fdf9d tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Image limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 08:53:54.731435 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-429c6b25-a7d2-4a9c-8f2c-f730a82fdf9d tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Flavor pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 08:53:54.731931 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-429c6b25-a7d2-4a9c-8f2c-f730a82fdf9d tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Image pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 08:53:54.732400 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-429c6b25-a7d2-4a9c-8f2c-f730a82fdf9d tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 08:53:54.742257 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-429c6b25-a7d2-4a9c-8f2c-f730a82fdf9d tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:54.742257 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-429c6b25-a7d2-4a9c-8f2c-f730a82fdf9d tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:54.742823 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-429c6b25-a7d2-4a9c-8f2c-f730a82fdf9d tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:54.743682 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-429c6b25-a7d2-4a9c-8f2c-f730a82fdf9d tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:54.744135 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-429c6b25-a7d2-4a9c-8f2c-f730a82fdf9d tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:54.744561 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-429c6b25-a7d2-4a9c-8f2c-f730a82fdf9d tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:54.761362 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-5e595a4e-df3a-42d1-b5b3-1554d112e15c tempest-SecurityGroupRulesTestJSON-782480009 tempest-SecurityGroupRulesTestJSON-782480009-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/bb6bd2fe-5354-48b8-ab3e-2f3ccff1a4ed" status: 202 len: 0 microversion: 2.1 time: 0.589250 Sep 14 08:53:54.761954 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 723/1441] 10.222.0.60 () {58 vars in 1272 bytes} [Wed Sep 14 08:53:54 2022] DELETE /compute/v2.1/os-security-groups/bb6bd2fe-5354-48b8-ab3e-2f3ccff1a4ed => generated 0 bytes in 591 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 08:53:54.767274 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-6f33af35-5200-4fff-8190-328f4a73d774 tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:54.768063 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-6f33af35-5200-4fff-8190-328f4a73d774 tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] [instance: 58b5d8a4-035b-4a2f-8a83-02ea69847900] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:54.779852 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-429c6b25-a7d2-4a9c-8f2c-f730a82fdf9d tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Getting quotas for project 0a87a909133e42e1a82e3a623536935c. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 08:53:54.785850 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6f33af35-5200-4fff-8190-328f4a73d774 tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:54.786284 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6f33af35-5200-4fff-8190-328f4a73d774 tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:54.786723 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6f33af35-5200-4fff-8190-328f4a73d774 tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:54.787482 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6f33af35-5200-4fff-8190-328f4a73d774 tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:54.787947 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6f33af35-5200-4fff-8190-328f4a73d774 tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:54.791133 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6f33af35-5200-4fff-8190-328f4a73d774 tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:54.791696 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-429c6b25-a7d2-4a9c-8f2c-f730a82fdf9d tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Getting quotas for user a3ace9012a7c4ce59c01858b6984b766 and project 0a87a909133e42e1a82e3a623536935c. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 08:53:54.810877 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-429c6b25-a7d2-4a9c-8f2c-f730a82fdf9d tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Going to run 1 instances... {{(pid=128759) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 08:53:54.813717 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-429c6b25-a7d2-4a9c-8f2c-f730a82fdf9d tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] [instance: 710fefb7-9a2d-41a2-b0b0-9d176a3d33d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128759) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 08:53:54.860429 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6f33af35-5200-4fff-8190-328f4a73d774 tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:54.861156 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6f33af35-5200-4fff-8190-328f4a73d774 tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:54.861750 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6f33af35-5200-4fff-8190-328f4a73d774 tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:54.862492 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.objects.instance [None req-6f33af35-5200-4fff-8190-328f4a73d774 tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Lazy-loading 'fault' on Instance uuid 58b5d8a4-035b-4a2f-8a83-02ea69847900 {{(pid=128758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 08:53:54.869402 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-429c6b25-a7d2-4a9c-8f2c-f730a82fdf9d tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.225179 Sep 14 08:53:54.870155 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 719/1442] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 08:53:53 2022] POST /compute/v2.1/servers => generated 383 bytes in 1227 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 08:53:54.876935 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-a272995c-2a0d-4fa1-b348-97d99a026222 req-ebddc7cb-a8ea-4fc8-87f7-43ebb2b99868 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58b5d8a4-035b-4a2f-8a83-02ea69847900", "name": "network-vif-deleted", "tag": "742f5d4d-837e-4e1e-8b53-228d7a64de9b"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:53:54.895728 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-a272995c-2a0d-4fa1-b348-97d99a026222 req-ebddc7cb-a8ea-4fc8-87f7-43ebb2b99868 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:54.896296 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-a272995c-2a0d-4fa1-b348-97d99a026222 req-ebddc7cb-a8ea-4fc8-87f7-43ebb2b99868 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:54.896943 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-a272995c-2a0d-4fa1-b348-97d99a026222 req-ebddc7cb-a8ea-4fc8-87f7-43ebb2b99868 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:54.908788 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-a272995c-2a0d-4fa1-b348-97d99a026222 req-ebddc7cb-a8ea-4fc8-87f7-43ebb2b99868 service nova] Creating event network-vif-deleted:742f5d4d-837e-4e1e-8b53-228d7a64de9b for instance 58b5d8a4-035b-4a2f-8a83-02ea69847900 on n-h1-836830-18 Sep 14 08:53:54.915060 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-a272995c-2a0d-4fa1-b348-97d99a026222 req-ebddc7cb-a8ea-4fc8-87f7-43ebb2b99868 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043268 Sep 14 08:53:54.915658 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 720/1443] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:53:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:53:54.917615 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-6f33af35-5200-4fff-8190-328f4a73d774 tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeaac454f233408ba1597b36bb9277dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38a515fd540744a2bdf6fb971f4a6924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:54.922117 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-4194d3c3-e458-4c2d-82c9-2877fbd9fe8d tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:54.922828 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-4194d3c3-e458-4c2d-82c9-2877fbd9fe8d tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] [instance: 4ea5843e-ecf7-4b84-80cb-3f05b2b20982] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:54.927871 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-6f33af35-5200-4fff-8190-328f4a73d774 tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] 10.222.0.60 "GET /compute/v2.1/servers/58b5d8a4-035b-4a2f-8a83-02ea69847900" status: 200 len: 1366 microversion: 2.1 time: 0.164549 Sep 14 08:53:54.938964 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 724/1444] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:54 2022] GET /compute/v2.1/servers/58b5d8a4-035b-4a2f-8a83-02ea69847900 => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:53:54.939142 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4194d3c3-e458-4c2d-82c9-2877fbd9fe8d tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:54.939142 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4194d3c3-e458-4c2d-82c9-2877fbd9fe8d tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:54.939142 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4194d3c3-e458-4c2d-82c9-2877fbd9fe8d tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:54.939142 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4194d3c3-e458-4c2d-82c9-2877fbd9fe8d tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:54.939542 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4194d3c3-e458-4c2d-82c9-2877fbd9fe8d tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:54.939542 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4194d3c3-e458-4c2d-82c9-2877fbd9fe8d tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:54.939717 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-866d8332-914f-4b1a-8aa4-f5eca187104a tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:54.939717 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-866d8332-914f-4b1a-8aa4-f5eca187104a tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] [instance: 505d2e57-caf3-43d1-b6d6-9678e38c1aab] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:54.946020 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-866d8332-914f-4b1a-8aa4-f5eca187104a tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:54.946020 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-866d8332-914f-4b1a-8aa4-f5eca187104a tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:54.946782 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-866d8332-914f-4b1a-8aa4-f5eca187104a tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:54.947581 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-866d8332-914f-4b1a-8aa4-f5eca187104a tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:54.948110 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-866d8332-914f-4b1a-8aa4-f5eca187104a tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:54.948605 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-866d8332-914f-4b1a-8aa4-f5eca187104a tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:55.033060 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-866d8332-914f-4b1a-8aa4-f5eca187104a tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c562ad6d5022429ba559a25c20c7569b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '545d0b704b5d455c8ffaeacb7cebace0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:55.042357 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-866d8332-914f-4b1a-8aa4-f5eca187104a tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] 10.222.0.60 "GET /compute/v2.1/servers/505d2e57-caf3-43d1-b6d6-9678e38c1aab" status: 200 len: 1436 microversion: 2.1 time: 0.112327 Sep 14 08:53:55.042931 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 725/1445] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:54 2022] GET /compute/v2.1/servers/505d2e57-caf3-43d1-b6d6-9678e38c1aab => generated 1436 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:53:55.051826 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-5e1bff78-a9e1-4448-8c55-34e3bd885fab tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:55.052662 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-5e1bff78-a9e1-4448-8c55-34e3bd885fab tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: 1b2a9a93-cad5-4b18-abc3-1b88413f88da] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:55.066496 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5e1bff78-a9e1-4448-8c55-34e3bd885fab tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:55.067022 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5e1bff78-a9e1-4448-8c55-34e3bd885fab tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:55.067573 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5e1bff78-a9e1-4448-8c55-34e3bd885fab tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:55.071607 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5e1bff78-a9e1-4448-8c55-34e3bd885fab tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:55.072131 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5e1bff78-a9e1-4448-8c55-34e3bd885fab tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:55.072665 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5e1bff78-a9e1-4448-8c55-34e3bd885fab tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:55.077845 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:53:55.124873 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-4194d3c3-e458-4c2d-82c9-2877fbd9fe8d tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810376d6f0b4329abe0f8f79800b754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575684f36f9c4019926fc83541e152c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:55.139205 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-4194d3c3-e458-4c2d-82c9-2877fbd9fe8d tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] 10.222.0.60 "GET /compute/v2.1/servers/4ea5843e-ecf7-4b84-80cb-3f05b2b20982" status: 200 len: 1293 microversion: 2.1 time: 0.221182 Sep 14 08:53:55.170611 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 721/1446] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:54 2022] GET /compute/v2.1/servers/4ea5843e-ecf7-4b84-80cb-3f05b2b20982 => generated 1293 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:53:55.181517 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-056d4140-e625-4567-9047-97842e642da4 req-ab0139b7-30a3-4cd3-88c3-f8474b591099 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "505d2e57-caf3-43d1-b6d6-9678e38c1aab", "name": "network-vif-deleted", "tag": "84d11647-e317-4b0b-b0cb-70b8cae4e6fb"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:53:55.193596 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-056d4140-e625-4567-9047-97842e642da4 req-ab0139b7-30a3-4cd3-88c3-f8474b591099 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:55.194581 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-056d4140-e625-4567-9047-97842e642da4 req-ab0139b7-30a3-4cd3-88c3-f8474b591099 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:55.195040 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-056d4140-e625-4567-9047-97842e642da4 req-ab0139b7-30a3-4cd3-88c3-f8474b591099 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:55.299473 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-5e1bff78-a9e1-4448-8c55-34e3bd885fab tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:55.308383 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-5e1bff78-a9e1-4448-8c55-34e3bd885fab tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/1b2a9a93-cad5-4b18-abc3-1b88413f88da" status: 200 len: 1468 microversion: 2.1 time: 0.264199 Sep 14 08:53:55.309279 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 726/1447] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:55 2022] GET /compute/v2.1/servers/1b2a9a93-cad5-4b18-abc3-1b88413f88da => generated 1468 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:53:55.331316 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ef211823-6646-461b-8f86-5fe89f1cd7b8 tempest-SecurityGroupRulesTestJSON-782480009 tempest-SecurityGroupRulesTestJSON-782480009-project] Calling method '.version_select at 0x7f7d44497820>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:55.425138 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-056d4140-e625-4567-9047-97842e642da4 req-ab0139b7-30a3-4cd3-88c3-f8474b591099 service nova] Creating event network-vif-deleted:84d11647-e317-4b0b-b0cb-70b8cae4e6fb for instance 505d2e57-caf3-43d1-b6d6-9678e38c1aab on n-h1-836830-18 Sep 14 08:53:55.430351 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-056d4140-e625-4567-9047-97842e642da4 req-ab0139b7-30a3-4cd3-88c3-f8474b591099 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.258156 Sep 14 08:53:55.430967 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 722/1448] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:53:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:53:55.436714 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-2f8b3ea5-dcf0-41a0-91da-0905a414f662 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:55.437774 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-2f8b3ea5-dcf0-41a0-91da-0905a414f662 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] [instance: 710fefb7-9a2d-41a2-b0b0-9d176a3d33d9] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:55.444763 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2f8b3ea5-dcf0-41a0-91da-0905a414f662 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:55.445491 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2f8b3ea5-dcf0-41a0-91da-0905a414f662 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:55.446078 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2f8b3ea5-dcf0-41a0-91da-0905a414f662 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:55.446952 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2f8b3ea5-dcf0-41a0-91da-0905a414f662 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:55.447419 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2f8b3ea5-dcf0-41a0-91da-0905a414f662 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:55.447841 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2f8b3ea5-dcf0-41a0-91da-0905a414f662 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:55.525823 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-2f8b3ea5-dcf0-41a0-91da-0905a414f662 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ace9012a7c4ce59c01858b6984b766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a87a909133e42e1a82e3a623536935c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:55.533870 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-2f8b3ea5-dcf0-41a0-91da-0905a414f662 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] 10.222.0.60 "GET /compute/v2.1/servers/710fefb7-9a2d-41a2-b0b0-9d176a3d33d9" status: 200 len: 1229 microversion: 2.1 time: 0.101596 Sep 14 08:53:55.534447 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 723/1449] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:55 2022] GET /compute/v2.1/servers/710fefb7-9a2d-41a2-b0b0-9d176a3d33d9 => generated 1229 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:53:55.539717 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b806856a-c2c8-48dc-bb50-ec934d43cc7c tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:55.540323 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b806856a-c2c8-48dc-bb50-ec934d43cc7c tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: 8fce8438-d6ae-408d-8b4f-ee14d4021fdd] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:55.546040 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b806856a-c2c8-48dc-bb50-ec934d43cc7c tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:55.546519 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b806856a-c2c8-48dc-bb50-ec934d43cc7c tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:55.547257 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b806856a-c2c8-48dc-bb50-ec934d43cc7c tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:55.548134 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b806856a-c2c8-48dc-bb50-ec934d43cc7c tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:55.548743 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b806856a-c2c8-48dc-bb50-ec934d43cc7c tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:55.549332 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b806856a-c2c8-48dc-bb50-ec934d43cc7c tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:55.585511 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-ef211823-6646-461b-8f86-5fe89f1cd7b8 tempest-SecurityGroupRulesTestJSON-782480009 tempest-SecurityGroupRulesTestJSON-782480009-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/62480f1f-4ca6-4af1-a06c-abb29c900364" status: 202 len: 0 microversion: 2.1 time: 0.260248 Sep 14 08:53:55.589426 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 727/1450] 10.222.0.60 () {58 vars in 1272 bytes} [Wed Sep 14 08:53:55 2022] DELETE /compute/v2.1/os-security-groups/62480f1f-4ca6-4af1-a06c-abb29c900364 => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 08:53:55.596524 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-2c917126-3abf-4811-b4a9-256632279dc8 tempest-SecurityGroupRulesTestJSON-782480009 tempest-SecurityGroupRulesTestJSON-782480009-project] Calling method '.version_select at 0x7f7d444c2310>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:55.835099 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b806856a-c2c8-48dc-bb50-ec934d43cc7c tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:55.844414 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b806856a-c2c8-48dc-bb50-ec934d43cc7c tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:55.846070 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b806856a-c2c8-48dc-bb50-ec934d43cc7c tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:55.847499 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b806856a-c2c8-48dc-bb50-ec934d43cc7c tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd" status: 200 len: 1815 microversion: 2.25 time: 0.311948 Sep 14 08:53:55.848563 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 724/1451] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:53:55 2022] GET /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd => generated 1815 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:53:55.934757 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-2c917126-3abf-4811-b4a9-256632279dc8 tempest-SecurityGroupRulesTestJSON-782480009 tempest-SecurityGroupRulesTestJSON-782480009-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/6429814a-1e83-4a2b-a1bd-337d8a9d8bb5" status: 202 len: 0 microversion: 2.1 time: 0.343668 Sep 14 08:53:55.935722 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 728/1452] 10.222.0.60 () {58 vars in 1272 bytes} [Wed Sep 14 08:53:55 2022] DELETE /compute/v2.1/os-security-groups/6429814a-1e83-4a2b-a1bd-337d8a9d8bb5 => generated 0 bytes in 346 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 14 08:53:55.944056 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e59119c4-4940-47d8-b214-4d1615439dcb tempest-SecurityGroupRulesTestJSON-782480009 tempest-SecurityGroupRulesTestJSON-782480009-project] Calling method '.version_select at 0x7f7d441c44c0>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:55.950630 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=4 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:53:55.957895 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ca21c20d-17a5-452c-97b7-f0ec18bce11a tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:55.958526 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-ca21c20d-17a5-452c-97b7-f0ec18bce11a tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] [instance: 58b5d8a4-035b-4a2f-8a83-02ea69847900] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:55.974859 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ca21c20d-17a5-452c-97b7-f0ec18bce11a tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:55.975390 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ca21c20d-17a5-452c-97b7-f0ec18bce11a tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:55.975838 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ca21c20d-17a5-452c-97b7-f0ec18bce11a tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:55.976551 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ca21c20d-17a5-452c-97b7-f0ec18bce11a tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:55.977018 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ca21c20d-17a5-452c-97b7-f0ec18bce11a tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:55.977449 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ca21c20d-17a5-452c-97b7-f0ec18bce11a tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:55.991738 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-ca21c20d-17a5-452c-97b7-f0ec18bce11a tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] HTTP exception thrown: Instance 58b5d8a4-035b-4a2f-8a83-02ea69847900 could not be found. Sep 14 08:53:55.993304 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ca21c20d-17a5-452c-97b7-f0ec18bce11a tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Request method failure captured: Sep 14 08:53:55.993304 n-d-836830-18 devstack@n-api.service[128758]: request: GET /compute/v2.1/servers/58b5d8a4-035b-4a2f-8a83-02ea69847900 HTTP/1.1 Sep 14 08:53:55.993304 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 08:53:55.993304 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 08:53:55.993304 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 08:53:55.993304 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 08:53:55.993304 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 08:53:55.993304 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 08:53:55.993304 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 08:53:55.993304 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 08:53:55.993304 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZYguR9tpY8Pnt7q7I3O21FSDAXt7adc8vioyg_ol0-wx9Odle7OLfY9xMgJn3JGgkDA1euQ5Iveol1ViSzRWGuWvUgNBHZ2PV8w0EuVPBSKZNQQZ45uoQYwRcKiaslw4Wwck2NhYv3dGWTgLudKSLomSfCP0lbs7set23Fc6gO0f_M Sep 14 08:53:55.993304 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 08:53:55.993304 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 08:53:55.993304 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 08:53:55.993304 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 08:53:55.993304 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 08:53:55.993304 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 08:53:55.993304 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 38a515fd540744a2bdf6fb971f4a6924 Sep 14 08:53:55.993304 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-ServersTestManualDisk-636197783 Sep 14 08:53:55.993304 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 08:53:55.993304 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 08:53:55.995167 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/38a515fd540744a2bdf6fb971f4a6924"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_38a515fd540744a2bdf6fb971f4a6924"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/38a515fd540744a2bdf6fb971f4a6924"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/38a515fd540744a2bdf6fb971f4a6924"}]}] Sep 14 08:53:55.995167 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-ServersTestManualDisk-636197783 Sep 14 08:53:55.995167 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 38a515fd540744a2bdf6fb971f4a6924 Sep 14 08:53:55.995167 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-ServersTestManualDisk-636197783 Sep 14 08:53:55.995167 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-ServersTestManualDisk-636197783-project Sep 14 08:53:55.995167 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 08:53:55.995167 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 08:53:55.995167 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: aeaac454f233408ba1597b36bb9277dc Sep 14 08:53:55.995167 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-ServersTestManualDisk-636197783-project Sep 14 08:53:55.995167 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 08:53:55.995167 n-d-836830-18 devstack@n-api.service[128758]: exception: Instance 58b5d8a4-035b-4a2f-8a83-02ea69847900 could not be found. Sep 14 08:53:55.995167 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': '58b5d8a4-035b-4a2f-8a83-02ea69847900'} Sep 14 08:53:55.996266 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:53:55.996266 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:53:55.996266 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 08:53:55.996266 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 08:53:55.996266 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 08:53:55.996266 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 08:53:55.996266 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 08:53:55.996266 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 08:53:55.996266 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 08:53:55.996266 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 08:53:55.996266 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58b5d8a4-035b-4a2f-8a83-02ea69847900 could not be found. Sep 14 08:53:55.996266 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:53:55.996266 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:53:55.996266 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:53:55.996266 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:53:55.996266 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:53:55.996266 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:53:55.996266 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:53:55.996266 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:53:55.996266 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:53:55.997786 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:53:55.997786 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 08:53:55.997786 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 08:53:55.997786 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 08:53:55.997786 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 08:53:55.997786 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 08:53:55.997786 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 08:53:55.997786 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58b5d8a4-035b-4a2f-8a83-02ea69847900 could not be found. Sep 14 08:53:55.997786 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:53:55.997786 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:53:55.997786 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:53:55.997786 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:53:55.997786 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:53:55.997786 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:53:55.997786 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:53:55.997786 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:53:55.997786 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58b5d8a4-035b-4a2f-8a83-02ea69847900 could not be found. Sep 14 08:53:55.997786 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:53:55.999315 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ca21c20d-17a5-452c-97b7-f0ec18bce11a tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Returning 404 to user: Instance 58b5d8a4-035b-4a2f-8a83-02ea69847900 could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:53:55.999315 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-ca21c20d-17a5-452c-97b7-f0ec18bce11a tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] 10.222.0.60 "GET /compute/v2.1/servers/58b5d8a4-035b-4a2f-8a83-02ea69847900" status: 404 len: 111 microversion: 2.1 time: 0.044794 Sep 14 08:53:55.999315 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 729/1453] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:55 2022] GET /compute/v2.1/servers/58b5d8a4-035b-4a2f-8a83-02ea69847900 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 08:53:56.003208 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c1827ae1-d78e-4d15-b4d8-cc0fea4fb598 tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] Calling method '.version_select at 0x7f7d44497820>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:56.011779 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:53:56.023901 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-c1827ae1-d78e-4d15-b4d8-cc0fea4fb598 tempest-ServersTestManualDisk-636197783 tempest-ServersTestManualDisk-636197783-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-85366435" status: 202 len: 0 microversion: 2.1 time: 0.024280 Sep 14 08:53:56.024641 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 730/1454] 10.222.0.60 () {58 vars in 1215 bytes} [Wed Sep 14 08:53:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-85366435 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 08:53:56.069393 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-385e9862-5198-452c-82b0-2b23a0ea4b93 tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:56.070052 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-385e9862-5198-452c-82b0-2b23a0ea4b93 tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] [instance: 505d2e57-caf3-43d1-b6d6-9678e38c1aab] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:56.076199 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-385e9862-5198-452c-82b0-2b23a0ea4b93 tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:56.076690 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-385e9862-5198-452c-82b0-2b23a0ea4b93 tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:56.077131 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-385e9862-5198-452c-82b0-2b23a0ea4b93 tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:56.077839 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-385e9862-5198-452c-82b0-2b23a0ea4b93 tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:56.078294 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-385e9862-5198-452c-82b0-2b23a0ea4b93 tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:56.078961 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-385e9862-5198-452c-82b0-2b23a0ea4b93 tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:56.111479 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-385e9862-5198-452c-82b0-2b23a0ea4b93 tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:56.111988 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-385e9862-5198-452c-82b0-2b23a0ea4b93 tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:56.112412 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-385e9862-5198-452c-82b0-2b23a0ea4b93 tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:56.113582 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.objects.instance [None req-385e9862-5198-452c-82b0-2b23a0ea4b93 tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Lazy-loading 'fault' on Instance uuid 505d2e57-caf3-43d1-b6d6-9678e38c1aab {{(pid=128758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 08:53:56.157517 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-385e9862-5198-452c-82b0-2b23a0ea4b93 tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c562ad6d5022429ba559a25c20c7569b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '545d0b704b5d455c8ffaeacb7cebace0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:56.159657 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e59119c4-4940-47d8-b214-4d1615439dcb tempest-SecurityGroupRulesTestJSON-782480009 tempest-SecurityGroupRulesTestJSON-782480009-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/48bff045-6c6b-490b-ab6e-8e8076c764a6" status: 202 len: 0 microversion: 2.1 time: 0.219820 Sep 14 08:53:56.160696 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 725/1455] 10.222.0.60 () {58 vars in 1272 bytes} [Wed Sep 14 08:53:55 2022] DELETE /compute/v2.1/os-security-groups/48bff045-6c6b-490b-ab6e-8e8076c764a6 => generated 0 bytes in 222 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 08:53:56.164268 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=2 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:53:56.166566 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-0231532b-919e-42b1-83e7-bd9803ed2fd9 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:56.167274 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-0231532b-919e-42b1-83e7-bd9803ed2fd9 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] [instance: 4ea5843e-ecf7-4b84-80cb-3f05b2b20982] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:56.170990 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-385e9862-5198-452c-82b0-2b23a0ea4b93 tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] 10.222.0.60 "GET /compute/v2.1/servers/505d2e57-caf3-43d1-b6d6-9678e38c1aab" status: 200 len: 1313 microversion: 2.1 time: 0.105915 Sep 14 08:53:56.171630 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 731/1456] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:56 2022] GET /compute/v2.1/servers/505d2e57-caf3-43d1-b6d6-9678e38c1aab => generated 1313 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:53:56.193066 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0231532b-919e-42b1-83e7-bd9803ed2fd9 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:56.193608 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0231532b-919e-42b1-83e7-bd9803ed2fd9 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:56.194119 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0231532b-919e-42b1-83e7-bd9803ed2fd9 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:56.195435 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0231532b-919e-42b1-83e7-bd9803ed2fd9 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:56.197831 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0231532b-919e-42b1-83e7-bd9803ed2fd9 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:56.204087 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0231532b-919e-42b1-83e7-bd9803ed2fd9 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:56.335519 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-33890905-de0f-4b42-942d-dca7d964cf7d tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:56.336048 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-33890905-de0f-4b42-942d-dca7d964cf7d tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: 1b2a9a93-cad5-4b18-abc3-1b88413f88da] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:56.342930 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-33890905-de0f-4b42-942d-dca7d964cf7d tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:56.343447 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-33890905-de0f-4b42-942d-dca7d964cf7d tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:56.343884 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-33890905-de0f-4b42-942d-dca7d964cf7d tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:56.344584 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-33890905-de0f-4b42-942d-dca7d964cf7d tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:56.345036 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-33890905-de0f-4b42-942d-dca7d964cf7d tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:56.345478 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-33890905-de0f-4b42-942d-dca7d964cf7d tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:56.676464 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-0231532b-919e-42b1-83e7-bd9803ed2fd9 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810376d6f0b4329abe0f8f79800b754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575684f36f9c4019926fc83541e152c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:56.678812 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:53:56.686668 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-0231532b-919e-42b1-83e7-bd9803ed2fd9 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] 10.222.0.60 "GET /compute/v2.1/servers/4ea5843e-ecf7-4b84-80cb-3f05b2b20982" status: 200 len: 1293 microversion: 2.1 time: 0.524828 Sep 14 08:53:56.687266 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 726/1457] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:56 2022] GET /compute/v2.1/servers/4ea5843e-ecf7-4b84-80cb-3f05b2b20982 => generated 1293 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:53:56.691921 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-41ac5e3f-be62-4284-9085-f5a132fa3d3e tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:56.693031 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-41ac5e3f-be62-4284-9085-f5a132fa3d3e tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] [instance: 710fefb7-9a2d-41a2-b0b0-9d176a3d33d9] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:56.699877 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-41ac5e3f-be62-4284-9085-f5a132fa3d3e tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:56.700693 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-41ac5e3f-be62-4284-9085-f5a132fa3d3e tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:56.701308 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-41ac5e3f-be62-4284-9085-f5a132fa3d3e tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:56.702242 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-41ac5e3f-be62-4284-9085-f5a132fa3d3e tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:56.702860 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-41ac5e3f-be62-4284-9085-f5a132fa3d3e tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:56.703479 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-41ac5e3f-be62-4284-9085-f5a132fa3d3e tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:56.748924 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-33890905-de0f-4b42-942d-dca7d964cf7d tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:56.757235 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-33890905-de0f-4b42-942d-dca7d964cf7d tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/1b2a9a93-cad5-4b18-abc3-1b88413f88da" status: 200 len: 1468 microversion: 2.1 time: 0.425649 Sep 14 08:53:56.757955 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 732/1458] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:56 2022] GET /compute/v2.1/servers/1b2a9a93-cad5-4b18-abc3-1b88413f88da => generated 1468 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:53:56.795386 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-41ac5e3f-be62-4284-9085-f5a132fa3d3e tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ace9012a7c4ce59c01858b6984b766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a87a909133e42e1a82e3a623536935c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:56.804415 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-41ac5e3f-be62-4284-9085-f5a132fa3d3e tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] 10.222.0.60 "GET /compute/v2.1/servers/710fefb7-9a2d-41a2-b0b0-9d176a3d33d9" status: 200 len: 1283 microversion: 2.1 time: 0.116100 Sep 14 08:53:56.805272 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 727/1459] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:56 2022] GET /compute/v2.1/servers/710fefb7-9a2d-41a2-b0b0-9d176a3d33d9 => generated 1283 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:53:56.873336 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-7ec97a6e-528d-4ec9-b4a8-527cde1fe6a4 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:56.873946 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-7ec97a6e-528d-4ec9-b4a8-527cde1fe6a4 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: 8fce8438-d6ae-408d-8b4f-ee14d4021fdd] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:56.880355 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7ec97a6e-528d-4ec9-b4a8-527cde1fe6a4 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:56.880845 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7ec97a6e-528d-4ec9-b4a8-527cde1fe6a4 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:56.881273 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7ec97a6e-528d-4ec9-b4a8-527cde1fe6a4 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:56.882186 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7ec97a6e-528d-4ec9-b4a8-527cde1fe6a4 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:56.882640 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7ec97a6e-528d-4ec9-b4a8-527cde1fe6a4 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:56.883084 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7ec97a6e-528d-4ec9-b4a8-527cde1fe6a4 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:56.932645 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-ca902325-bde3-4ffc-9f64-3d3c22d28a4d req-fcfc9451-1f40-4575-a8cb-fe38e53182eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fce8438-d6ae-408d-8b4f-ee14d4021fdd", "name": "network-vif-unplugged", "status": "completed", "tag": "8a7f2660-c507-4973-b860-0358d6cdd4f1"}, {"name": "network-changed", "server_uuid": "8fce8438-d6ae-408d-8b4f-ee14d4021fdd", "tag": "8a7f2660-c507-4973-b860-0358d6cdd4f1"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:53:56.943105 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-ca902325-bde3-4ffc-9f64-3d3c22d28a4d req-fcfc9451-1f40-4575-a8cb-fe38e53182eb service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:56.943994 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-ca902325-bde3-4ffc-9f64-3d3c22d28a4d req-fcfc9451-1f40-4575-a8cb-fe38e53182eb service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:56.944432 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-ca902325-bde3-4ffc-9f64-3d3c22d28a4d req-fcfc9451-1f40-4575-a8cb-fe38e53182eb service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:56.955877 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-ca902325-bde3-4ffc-9f64-3d3c22d28a4d req-fcfc9451-1f40-4575-a8cb-fe38e53182eb service nova] Creating event network-vif-unplugged:8a7f2660-c507-4973-b860-0358d6cdd4f1 for instance 8fce8438-d6ae-408d-8b4f-ee14d4021fdd on n-h2-836830-18 Sep 14 08:53:56.957170 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-ca902325-bde3-4ffc-9f64-3d3c22d28a4d req-fcfc9451-1f40-4575-a8cb-fe38e53182eb service nova] Creating event network-changed:8a7f2660-c507-4973-b860-0358d6cdd4f1 for instance 8fce8438-d6ae-408d-8b4f-ee14d4021fdd on n-h2-836830-18 Sep 14 08:53:56.962185 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-ca902325-bde3-4ffc-9f64-3d3c22d28a4d req-fcfc9451-1f40-4575-a8cb-fe38e53182eb service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.034068 Sep 14 08:53:56.963164 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 728/1460] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:53:56 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:53:57.196119 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9f9901bd-d9f1-4e59-90d8-7e433e6d5c8c tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:57.197161 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-9f9901bd-d9f1-4e59-90d8-7e433e6d5c8c tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] [instance: 505d2e57-caf3-43d1-b6d6-9678e38c1aab] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:57.206694 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9f9901bd-d9f1-4e59-90d8-7e433e6d5c8c tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:57.215401 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9f9901bd-d9f1-4e59-90d8-7e433e6d5c8c tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:57.216310 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9f9901bd-d9f1-4e59-90d8-7e433e6d5c8c tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:57.217324 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9f9901bd-d9f1-4e59-90d8-7e433e6d5c8c tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:57.218077 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9f9901bd-d9f1-4e59-90d8-7e433e6d5c8c tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:57.218778 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9f9901bd-d9f1-4e59-90d8-7e433e6d5c8c tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:57.295016 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9f9901bd-d9f1-4e59-90d8-7e433e6d5c8c tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:57.295531 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9f9901bd-d9f1-4e59-90d8-7e433e6d5c8c tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:57.295979 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9f9901bd-d9f1-4e59-90d8-7e433e6d5c8c tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:57.296448 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.objects.instance [None req-9f9901bd-d9f1-4e59-90d8-7e433e6d5c8c tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Lazy-loading 'fault' on Instance uuid 505d2e57-caf3-43d1-b6d6-9678e38c1aab {{(pid=128759) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 08:53:57.622961 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-9f9901bd-d9f1-4e59-90d8-7e433e6d5c8c tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c562ad6d5022429ba559a25c20c7569b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '545d0b704b5d455c8ffaeacb7cebace0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:57.624909 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-7ec97a6e-528d-4ec9-b4a8-527cde1fe6a4 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:57.631106 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-9f9901bd-d9f1-4e59-90d8-7e433e6d5c8c tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] 10.222.0.60 "GET /compute/v2.1/servers/505d2e57-caf3-43d1-b6d6-9678e38c1aab" status: 200 len: 1313 microversion: 2.1 time: 0.439389 Sep 14 08:53:57.639496 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-7ec97a6e-528d-4ec9-b4a8-527cde1fe6a4 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:57.641474 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-7ec97a6e-528d-4ec9-b4a8-527cde1fe6a4 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:57.645043 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-7ec97a6e-528d-4ec9-b4a8-527cde1fe6a4 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd" status: 200 len: 1815 microversion: 2.25 time: 0.774117 Sep 14 08:53:57.645891 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 733/1461] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:53:56 2022] GET /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd => generated 1815 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:53:57.647329 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 729/1462] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:57 2022] GET /compute/v2.1/servers/505d2e57-caf3-43d1-b6d6-9678e38c1aab => generated 1313 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:53:57.709886 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-6f6a3559-3c9b-4d77-be8b-9d31c8f290fc tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:57.710837 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-6f6a3559-3c9b-4d77-be8b-9d31c8f290fc tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] [instance: 4ea5843e-ecf7-4b84-80cb-3f05b2b20982] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:57.717570 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6f6a3559-3c9b-4d77-be8b-9d31c8f290fc tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:57.718358 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6f6a3559-3c9b-4d77-be8b-9d31c8f290fc tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:57.719077 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6f6a3559-3c9b-4d77-be8b-9d31c8f290fc tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:57.720012 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6f6a3559-3c9b-4d77-be8b-9d31c8f290fc tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:57.720717 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6f6a3559-3c9b-4d77-be8b-9d31c8f290fc tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:57.721367 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6f6a3559-3c9b-4d77-be8b-9d31c8f290fc tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:57.780476 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b952f84b-82d5-4a25-8041-ad2e2bf33eaf tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:57.781109 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b952f84b-82d5-4a25-8041-ad2e2bf33eaf tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: 1b2a9a93-cad5-4b18-abc3-1b88413f88da] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:57.790414 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b952f84b-82d5-4a25-8041-ad2e2bf33eaf tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:57.790908 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b952f84b-82d5-4a25-8041-ad2e2bf33eaf tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:57.791401 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b952f84b-82d5-4a25-8041-ad2e2bf33eaf tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:57.792320 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b952f84b-82d5-4a25-8041-ad2e2bf33eaf tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:57.792978 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b952f84b-82d5-4a25-8041-ad2e2bf33eaf tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:57.793669 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b952f84b-82d5-4a25-8041-ad2e2bf33eaf tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:58.243123 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-6f6a3559-3c9b-4d77-be8b-9d31c8f290fc tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810376d6f0b4329abe0f8f79800b754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575684f36f9c4019926fc83541e152c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:58.257232 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-6f6a3559-3c9b-4d77-be8b-9d31c8f290fc tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] 10.222.0.60 "GET /compute/v2.1/servers/4ea5843e-ecf7-4b84-80cb-3f05b2b20982" status: 200 len: 1485 microversion: 2.1 time: 0.550286 Sep 14 08:53:58.257946 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 734/1463] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:57 2022] GET /compute/v2.1/servers/4ea5843e-ecf7-4b84-80cb-3f05b2b20982 => generated 1485 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:53:58.262886 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-f4609600-ef9e-40c4-a228-08be48a4e1cc tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:58.263783 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-f4609600-ef9e-40c4-a228-08be48a4e1cc tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] [instance: 710fefb7-9a2d-41a2-b0b0-9d176a3d33d9] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:58.271205 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f4609600-ef9e-40c4-a228-08be48a4e1cc tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:58.272513 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f4609600-ef9e-40c4-a228-08be48a4e1cc tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:58.273219 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f4609600-ef9e-40c4-a228-08be48a4e1cc tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:58.274337 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f4609600-ef9e-40c4-a228-08be48a4e1cc tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:58.275534 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f4609600-ef9e-40c4-a228-08be48a4e1cc tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:58.276185 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f4609600-ef9e-40c4-a228-08be48a4e1cc tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:58.302853 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b952f84b-82d5-4a25-8041-ad2e2bf33eaf tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:58.315832 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b952f84b-82d5-4a25-8041-ad2e2bf33eaf tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/1b2a9a93-cad5-4b18-abc3-1b88413f88da" status: 200 len: 1468 microversion: 2.1 time: 0.539145 Sep 14 08:53:58.317134 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 730/1464] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:57 2022] GET /compute/v2.1/servers/1b2a9a93-cad5-4b18-abc3-1b88413f88da => generated 1468 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:53:58.323210 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3912b633-f64c-481a-a055-77f1a23c20da tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:58.324104 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-3912b633-f64c-481a-a055-77f1a23c20da tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] [instance: 4ea5843e-ecf7-4b84-80cb-3f05b2b20982] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:58.330865 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3912b633-f64c-481a-a055-77f1a23c20da tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:58.335403 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3912b633-f64c-481a-a055-77f1a23c20da tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:58.336203 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3912b633-f64c-481a-a055-77f1a23c20da tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:58.337177 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3912b633-f64c-481a-a055-77f1a23c20da tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:58.337635 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3912b633-f64c-481a-a055-77f1a23c20da tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:58.338056 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3912b633-f64c-481a-a055-77f1a23c20da tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:58.634967 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-3912b633-f64c-481a-a055-77f1a23c20da tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] 10.222.0.60 "GET /compute/v2.1/servers/4ea5843e-ecf7-4b84-80cb-3f05b2b20982/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.316199 Sep 14 08:53:58.636650 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 731/1465] 10.222.0.60 () {58 vars in 1275 bytes} [Wed Sep 14 08:53:58 2022] GET /compute/v2.1/servers/4ea5843e-ecf7-4b84-80cb-3f05b2b20982/os-interface => generated 285 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:53:58.677638 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a481707e-cb8f-4d79-823d-bd040739f65e tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:58.678411 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-a481707e-cb8f-4d79-823d-bd040739f65e tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] [instance: 505d2e57-caf3-43d1-b6d6-9678e38c1aab] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:58.685200 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a481707e-cb8f-4d79-823d-bd040739f65e tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:58.686110 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a481707e-cb8f-4d79-823d-bd040739f65e tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:58.686794 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a481707e-cb8f-4d79-823d-bd040739f65e tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:58.687808 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a481707e-cb8f-4d79-823d-bd040739f65e tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:58.688487 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a481707e-cb8f-4d79-823d-bd040739f65e tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:58.689134 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a481707e-cb8f-4d79-823d-bd040739f65e tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:58.713242 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-a481707e-cb8f-4d79-823d-bd040739f65e tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] HTTP exception thrown: Instance 505d2e57-caf3-43d1-b6d6-9678e38c1aab could not be found. Sep 14 08:53:58.716222 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a481707e-cb8f-4d79-823d-bd040739f65e tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Request method failure captured: Sep 14 08:53:58.716222 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/505d2e57-caf3-43d1-b6d6-9678e38c1aab HTTP/1.1 Sep 14 08:53:58.716222 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 08:53:58.716222 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 08:53:58.716222 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 08:53:58.716222 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 08:53:58.716222 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 08:53:58.716222 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 08:53:58.716222 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 08:53:58.716222 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 08:53:58.716222 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZaGAyCdIRbSVPK4zHGpoFMN8safuoIspaRFmaGSzFqKUICUIO4QUn_v4uBHD4buNj0nRzihqVOSgXRSBw9ntVyWkhl0rfrkTdttSa9xDMM-ihtdDRQJV0hFMWKjpEgw-D2E39dO-zvB6YugiVwFkuB1rJhvFHqaMNh2ncmmJ5WyD9U Sep 14 08:53:58.716222 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 08:53:58.716222 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 08:53:58.716222 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 08:53:58.716222 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 08:53:58.716222 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 08:53:58.716222 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 08:53:58.716222 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 545d0b704b5d455c8ffaeacb7cebace0 Sep 14 08:53:58.716222 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1393911297 Sep 14 08:53:58.716222 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 08:53:58.716222 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 08:53:58.717703 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/545d0b704b5d455c8ffaeacb7cebace0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_545d0b704b5d455c8ffaeacb7cebace0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/545d0b704b5d455c8ffaeacb7cebace0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/545d0b704b5d455c8ffaeacb7cebace0"}]}] Sep 14 08:53:58.717703 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1393911297 Sep 14 08:53:58.717703 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 545d0b704b5d455c8ffaeacb7cebace0 Sep 14 08:53:58.717703 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1393911297 Sep 14 08:53:58.717703 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ServerDiagnosticsNegativeTest-1393911297-project Sep 14 08:53:58.717703 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 08:53:58.717703 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 08:53:58.717703 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: c562ad6d5022429ba559a25c20c7569b Sep 14 08:53:58.717703 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1393911297-project Sep 14 08:53:58.717703 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 08:53:58.717703 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance 505d2e57-caf3-43d1-b6d6-9678e38c1aab could not be found. Sep 14 08:53:58.717703 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '505d2e57-caf3-43d1-b6d6-9678e38c1aab'} Sep 14 08:53:58.718530 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:53:58.718530 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:53:58.718530 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 08:53:58.718530 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 08:53:58.718530 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 08:53:58.718530 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 08:53:58.718530 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 08:53:58.718530 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 08:53:58.718530 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 08:53:58.718530 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 08:53:58.718530 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 505d2e57-caf3-43d1-b6d6-9678e38c1aab could not be found. Sep 14 08:53:58.718530 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:53:58.718530 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:53:58.718530 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:53:58.718530 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:53:58.718530 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:53:58.718530 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:53:58.718530 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:53:58.718530 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:53:58.718530 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:53:58.719864 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:53:58.719864 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 08:53:58.719864 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 08:53:58.719864 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 08:53:58.719864 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 08:53:58.719864 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 08:53:58.719864 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 08:53:58.719864 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 505d2e57-caf3-43d1-b6d6-9678e38c1aab could not be found. Sep 14 08:53:58.719864 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:53:58.719864 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:53:58.719864 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:53:58.719864 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:53:58.719864 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:53:58.719864 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:53:58.719864 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:53:58.719864 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:53:58.719864 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 505d2e57-caf3-43d1-b6d6-9678e38c1aab could not be found. Sep 14 08:53:58.719864 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:53:58.728188 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a481707e-cb8f-4d79-823d-bd040739f65e tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] Returning 404 to user: Instance 505d2e57-caf3-43d1-b6d6-9678e38c1aab could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:53:58.729640 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a481707e-cb8f-4d79-823d-bd040739f65e tempest-ServerDiagnosticsNegativeTest-1393911297 tempest-ServerDiagnosticsNegativeTest-1393911297-project] 10.222.0.60 "GET /compute/v2.1/servers/505d2e57-caf3-43d1-b6d6-9678e38c1aab" status: 404 len: 111 microversion: 2.1 time: 0.059090 Sep 14 08:53:58.730762 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 732/1466] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:58 2022] GET /compute/v2.1/servers/505d2e57-caf3-43d1-b6d6-9678e38c1aab => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 14 08:53:58.737652 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-362911be-685c-467d-8f30-f707eb47db60 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:58.739102 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-362911be-685c-467d-8f30-f707eb47db60 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: 8fce8438-d6ae-408d-8b4f-ee14d4021fdd] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:58.750526 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-362911be-685c-467d-8f30-f707eb47db60 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:58.751285 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-362911be-685c-467d-8f30-f707eb47db60 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:58.752007 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-362911be-685c-467d-8f30-f707eb47db60 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:58.755209 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-362911be-685c-467d-8f30-f707eb47db60 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:58.755968 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-362911be-685c-467d-8f30-f707eb47db60 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:58.756622 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-362911be-685c-467d-8f30-f707eb47db60 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:58.976223 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-f4609600-ef9e-40c4-a228-08be48a4e1cc tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ace9012a7c4ce59c01858b6984b766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a87a909133e42e1a82e3a623536935c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:58.985734 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-f4609600-ef9e-40c4-a228-08be48a4e1cc tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] 10.222.0.60 "GET /compute/v2.1/servers/710fefb7-9a2d-41a2-b0b0-9d176a3d33d9" status: 200 len: 1325 microversion: 2.1 time: 0.726360 Sep 14 08:53:58.988187 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 735/1467] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:58 2022] GET /compute/v2.1/servers/710fefb7-9a2d-41a2-b0b0-9d176a3d33d9 => generated 1325 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:53:58.996929 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-3b56b292-816b-4368-afa4-a84d5a589964 req-5f25e069-24fb-4711-abfc-9f562a832b03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "710fefb7-9a2d-41a2-b0b0-9d176a3d33d9", "tag": "5d174d16-22bf-476a-aab3-7e6f54672d60"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:53:59.021408 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-3b56b292-816b-4368-afa4-a84d5a589964 req-5f25e069-24fb-4711-abfc-9f562a832b03 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:59.023911 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-3b56b292-816b-4368-afa4-a84d5a589964 req-5f25e069-24fb-4711-abfc-9f562a832b03 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:59.025820 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-3b56b292-816b-4368-afa4-a84d5a589964 req-5f25e069-24fb-4711-abfc-9f562a832b03 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:59.054343 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-3b56b292-816b-4368-afa4-a84d5a589964 req-5f25e069-24fb-4711-abfc-9f562a832b03 service nova] Creating event network-changed:5d174d16-22bf-476a-aab3-7e6f54672d60 for instance 710fefb7-9a2d-41a2-b0b0-9d176a3d33d9 on n-h2-836830-18 Sep 14 08:53:59.065182 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-3b56b292-816b-4368-afa4-a84d5a589964 req-5f25e069-24fb-4711-abfc-9f562a832b03 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075024 Sep 14 08:53:59.066445 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 736/1468] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:53:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:53:59.205994 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-362911be-685c-467d-8f30-f707eb47db60 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:59.240274 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-362911be-685c-467d-8f30-f707eb47db60 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:59.247468 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-362911be-685c-467d-8f30-f707eb47db60 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:59.255746 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-362911be-685c-467d-8f30-f707eb47db60 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd" status: 200 len: 1815 microversion: 2.25 time: 0.520795 Sep 14 08:53:59.270966 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 733/1469] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:53:58 2022] GET /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd => generated 1815 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:53:59.346289 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ded41fc4-8de1-4573-bd10-6da50136448d tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:53:59.347508 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-ded41fc4-8de1-4573-bd10-6da50136448d tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: 1b2a9a93-cad5-4b18-abc3-1b88413f88da] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:53:59.356635 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ded41fc4-8de1-4573-bd10-6da50136448d tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:59.357421 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ded41fc4-8de1-4573-bd10-6da50136448d tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:59.358217 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ded41fc4-8de1-4573-bd10-6da50136448d tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:59.359750 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ded41fc4-8de1-4573-bd10-6da50136448d tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:53:59.360742 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ded41fc4-8de1-4573-bd10-6da50136448d tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:53:59.361523 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ded41fc4-8de1-4573-bd10-6da50136448d tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:53:59.943086 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-ded41fc4-8de1-4573-bd10-6da50136448d tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:53:59.964098 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-ded41fc4-8de1-4573-bd10-6da50136448d tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/1b2a9a93-cad5-4b18-abc3-1b88413f88da" status: 200 len: 1468 microversion: 2.1 time: 0.623586 Sep 14 08:53:59.965282 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 737/1470] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:53:59 2022] GET /compute/v2.1/servers/1b2a9a93-cad5-4b18-abc3-1b88413f88da => generated 1468 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:54:00.014765 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ca0fbfdb-7834-40be-8f5d-655062127811 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:54:00.015359 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-ca0fbfdb-7834-40be-8f5d-655062127811 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] [instance: 710fefb7-9a2d-41a2-b0b0-9d176a3d33d9] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:54:00.021763 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ca0fbfdb-7834-40be-8f5d-655062127811 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:00.022490 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ca0fbfdb-7834-40be-8f5d-655062127811 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:00.022957 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ca0fbfdb-7834-40be-8f5d-655062127811 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:00.023925 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ca0fbfdb-7834-40be-8f5d-655062127811 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:00.024989 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ca0fbfdb-7834-40be-8f5d-655062127811 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:00.025420 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ca0fbfdb-7834-40be-8f5d-655062127811 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:00.288038 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-49e2b973-0081-423a-afbb-2ca24d5fa835 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:54:00.288661 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-49e2b973-0081-423a-afbb-2ca24d5fa835 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: 8fce8438-d6ae-408d-8b4f-ee14d4021fdd] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:54:00.295350 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-49e2b973-0081-423a-afbb-2ca24d5fa835 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:00.295847 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-49e2b973-0081-423a-afbb-2ca24d5fa835 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:00.296288 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-49e2b973-0081-423a-afbb-2ca24d5fa835 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:00.297006 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-49e2b973-0081-423a-afbb-2ca24d5fa835 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:00.297465 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-49e2b973-0081-423a-afbb-2ca24d5fa835 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:00.297893 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-49e2b973-0081-423a-afbb-2ca24d5fa835 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:00.960406 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-ca0fbfdb-7834-40be-8f5d-655062127811 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ace9012a7c4ce59c01858b6984b766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a87a909133e42e1a82e3a623536935c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:54:00.970967 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-ca0fbfdb-7834-40be-8f5d-655062127811 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] 10.222.0.60 "GET /compute/v2.1/servers/710fefb7-9a2d-41a2-b0b0-9d176a3d33d9" status: 200 len: 1325 microversion: 2.1 time: 0.960404 Sep 14 08:54:00.973970 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 734/1471] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:54:00 2022] GET /compute/v2.1/servers/710fefb7-9a2d-41a2-b0b0-9d176a3d33d9 => generated 1325 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:54:00.983521 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-630a8b8c-c29c-4c1c-9c9e-ae06f5c344cc tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:54:00.989325 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-49e2b973-0081-423a-afbb-2ca24d5fa835 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:54:00.990546 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-630a8b8c-c29c-4c1c-9c9e-ae06f5c344cc tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] [instance: 4ea5843e-ecf7-4b84-80cb-3f05b2b20982] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:54:01.000681 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-630a8b8c-c29c-4c1c-9c9e-ae06f5c344cc tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:01.001446 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-630a8b8c-c29c-4c1c-9c9e-ae06f5c344cc tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:01.002862 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-630a8b8c-c29c-4c1c-9c9e-ae06f5c344cc tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:01.004312 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-630a8b8c-c29c-4c1c-9c9e-ae06f5c344cc tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:01.004997 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-630a8b8c-c29c-4c1c-9c9e-ae06f5c344cc tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:01.005933 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-630a8b8c-c29c-4c1c-9c9e-ae06f5c344cc tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:01.008824 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-49e2b973-0081-423a-afbb-2ca24d5fa835 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:54:01.010296 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-49e2b973-0081-423a-afbb-2ca24d5fa835 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:54:01.011536 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-49e2b973-0081-423a-afbb-2ca24d5fa835 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd" status: 200 len: 1815 microversion: 2.25 time: 0.728048 Sep 14 08:54:01.012738 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 738/1472] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:54:00 2022] GET /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd => generated 1815 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 08:54:01.026850 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ce24af80-962c-4de9-b41f-28518b8ea6be tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:54:01.027827 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-ce24af80-962c-4de9-b41f-28518b8ea6be tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: 1b2a9a93-cad5-4b18-abc3-1b88413f88da] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:54:01.034179 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ce24af80-962c-4de9-b41f-28518b8ea6be tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:01.035463 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ce24af80-962c-4de9-b41f-28518b8ea6be tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:01.036061 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ce24af80-962c-4de9-b41f-28518b8ea6be tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:01.036984 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ce24af80-962c-4de9-b41f-28518b8ea6be tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:01.037608 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ce24af80-962c-4de9-b41f-28518b8ea6be tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:01.038207 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ce24af80-962c-4de9-b41f-28518b8ea6be tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:01.586068 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-630a8b8c-c29c-4c1c-9c9e-ae06f5c344cc tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810376d6f0b4329abe0f8f79800b754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575684f36f9c4019926fc83541e152c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:54:01.591817 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-ce24af80-962c-4de9-b41f-28518b8ea6be tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:54:01.597537 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-630a8b8c-c29c-4c1c-9c9e-ae06f5c344cc tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] 10.222.0.60 "GET /compute/v2.1/servers/4ea5843e-ecf7-4b84-80cb-3f05b2b20982" status: 200 len: 1485 microversion: 2.1 time: 0.620991 Sep 14 08:54:01.598142 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 735/1473] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:54:00 2022] GET /compute/v2.1/servers/4ea5843e-ecf7-4b84-80cb-3f05b2b20982 => generated 1485 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:54:01.622715 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-7802eb6f-ebb0-4ac0-a017-29f1a59cc77e req-877cb2ed-4a30-492e-875b-e6a4a9aaeaed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ea5843e-ecf7-4b84-80cb-3f05b2b20982", "tag": "413aded5-fbf0-4893-9752-3f4384abde15"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:54:01.633012 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-ce24af80-962c-4de9-b41f-28518b8ea6be tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/1b2a9a93-cad5-4b18-abc3-1b88413f88da" status: 200 len: 1468 microversion: 2.1 time: 0.618908 Sep 14 08:54:01.635336 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 739/1474] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:54:01 2022] GET /compute/v2.1/servers/1b2a9a93-cad5-4b18-abc3-1b88413f88da => generated 1468 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:54:01.636630 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-7802eb6f-ebb0-4ac0-a017-29f1a59cc77e req-877cb2ed-4a30-492e-875b-e6a4a9aaeaed service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:01.637115 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-7802eb6f-ebb0-4ac0-a017-29f1a59cc77e req-877cb2ed-4a30-492e-875b-e6a4a9aaeaed service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:01.637545 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-7802eb6f-ebb0-4ac0-a017-29f1a59cc77e req-877cb2ed-4a30-492e-875b-e6a4a9aaeaed service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:01.653958 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-7802eb6f-ebb0-4ac0-a017-29f1a59cc77e req-877cb2ed-4a30-492e-875b-e6a4a9aaeaed service nova] Creating event network-changed:413aded5-fbf0-4893-9752-3f4384abde15 for instance 4ea5843e-ecf7-4b84-80cb-3f05b2b20982 on n-h1-836830-18 Sep 14 08:54:01.661058 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-7802eb6f-ebb0-4ac0-a017-29f1a59cc77e req-877cb2ed-4a30-492e-875b-e6a4a9aaeaed service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046418 Sep 14 08:54:01.662527 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 736/1475] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:54:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:54:01.743298 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-5aeaf50b-5e7c-4eef-8872-087ce7a76683 req-5b923a6d-f37b-4fe7-9475-0372d48ccb47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b2a9a93-cad5-4b18-abc3-1b88413f88da", "name": "network-vif-unplugged", "status": "completed", "tag": "3db17a23-17af-436b-96e5-130e5c8353bc"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:54:01.769680 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-5aeaf50b-5e7c-4eef-8872-087ce7a76683 req-5b923a6d-f37b-4fe7-9475-0372d48ccb47 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:01.770528 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-5aeaf50b-5e7c-4eef-8872-087ce7a76683 req-5b923a6d-f37b-4fe7-9475-0372d48ccb47 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:01.771464 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-5aeaf50b-5e7c-4eef-8872-087ce7a76683 req-5b923a6d-f37b-4fe7-9475-0372d48ccb47 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:01.804339 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-5aeaf50b-5e7c-4eef-8872-087ce7a76683 req-5b923a6d-f37b-4fe7-9475-0372d48ccb47 service nova] Creating event network-vif-unplugged:3db17a23-17af-436b-96e5-130e5c8353bc for instance 1b2a9a93-cad5-4b18-abc3-1b88413f88da on n-h2-836830-18 Sep 14 08:54:01.819046 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [req-5aeaf50b-5e7c-4eef-8872-087ce7a76683 req-5b923a6d-f37b-4fe7-9475-0372d48ccb47 service nova] Instance 1b2a9a93-cad5-4b18-abc3-1b88413f88da is migrating within the same cell, copying events to all relevant hosts: {'n-h1-836830-18', 'n-h2-836830-18'} {{(pid=128758) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 14 08:54:01.846464 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-5aeaf50b-5e7c-4eef-8872-087ce7a76683 req-5b923a6d-f37b-4fe7-9475-0372d48ccb47 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.109245 Sep 14 08:54:01.848766 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 740/1476] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:54:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:54:02.000457 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e9a901c9-bc87-4f56-af08-0cb7bedd974f tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:54:02.001679 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e9a901c9-bc87-4f56-af08-0cb7bedd974f tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] [instance: 710fefb7-9a2d-41a2-b0b0-9d176a3d33d9] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:54:02.014206 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e9a901c9-bc87-4f56-af08-0cb7bedd974f tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:02.015479 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e9a901c9-bc87-4f56-af08-0cb7bedd974f tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:02.016644 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e9a901c9-bc87-4f56-af08-0cb7bedd974f tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:02.017708 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e9a901c9-bc87-4f56-af08-0cb7bedd974f tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:02.018469 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e9a901c9-bc87-4f56-af08-0cb7bedd974f tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:02.019966 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e9a901c9-bc87-4f56-af08-0cb7bedd974f tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:02.040719 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-eb4397ab-2c06-4a80-89c4-85a8f855a163 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:54:02.041920 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-eb4397ab-2c06-4a80-89c4-85a8f855a163 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: 8fce8438-d6ae-408d-8b4f-ee14d4021fdd] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:54:02.058257 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-eb4397ab-2c06-4a80-89c4-85a8f855a163 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:02.061061 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-eb4397ab-2c06-4a80-89c4-85a8f855a163 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:02.067743 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-eb4397ab-2c06-4a80-89c4-85a8f855a163 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:02.069332 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-eb4397ab-2c06-4a80-89c4-85a8f855a163 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:02.071145 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-eb4397ab-2c06-4a80-89c4-85a8f855a163 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:02.072343 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-eb4397ab-2c06-4a80-89c4-85a8f855a163 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:02.671364 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-e9a901c9-bc87-4f56-af08-0cb7bedd974f tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ace9012a7c4ce59c01858b6984b766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a87a909133e42e1a82e3a623536935c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:54:02.681263 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e9a901c9-bc87-4f56-af08-0cb7bedd974f tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] 10.222.0.60 "GET /compute/v2.1/servers/710fefb7-9a2d-41a2-b0b0-9d176a3d33d9" status: 200 len: 1325 microversion: 2.1 time: 0.685420 Sep 14 08:54:02.682612 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 737/1477] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:54:01 2022] GET /compute/v2.1/servers/710fefb7-9a2d-41a2-b0b0-9d176a3d33d9 => generated 1325 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:54:02.687717 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-909deb5e-865d-43bc-b421-88858709cc96 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:54:02.688624 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-909deb5e-865d-43bc-b421-88858709cc96 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: 1b2a9a93-cad5-4b18-abc3-1b88413f88da] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:54:02.701891 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-909deb5e-865d-43bc-b421-88858709cc96 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:02.702624 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-909deb5e-865d-43bc-b421-88858709cc96 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:02.703336 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-909deb5e-865d-43bc-b421-88858709cc96 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:02.704180 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-909deb5e-865d-43bc-b421-88858709cc96 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:02.704742 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-909deb5e-865d-43bc-b421-88858709cc96 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:02.705275 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-909deb5e-865d-43bc-b421-88858709cc96 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:02.748384 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-eb4397ab-2c06-4a80-89c4-85a8f855a163 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:54:02.758015 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-eb4397ab-2c06-4a80-89c4-85a8f855a163 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:54:02.759765 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-eb4397ab-2c06-4a80-89c4-85a8f855a163 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:54:02.761198 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-eb4397ab-2c06-4a80-89c4-85a8f855a163 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd" status: 200 len: 1815 microversion: 2.25 time: 0.726948 Sep 14 08:54:02.761958 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 741/1478] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:54:02 2022] GET /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd => generated 1815 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:54:03.108546 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-909deb5e-865d-43bc-b421-88858709cc96 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:54:03.119021 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-909deb5e-865d-43bc-b421-88858709cc96 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/1b2a9a93-cad5-4b18-abc3-1b88413f88da" status: 200 len: 1468 microversion: 2.1 time: 0.434788 Sep 14 08:54:03.136726 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 738/1479] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:54:02 2022] GET /compute/v2.1/servers/1b2a9a93-cad5-4b18-abc3-1b88413f88da => generated 1468 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:54:03.709582 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-38084a80-4cf1-4897-945d-b8d367f96463 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:54:03.712035 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-38084a80-4cf1-4897-945d-b8d367f96463 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] [instance: 710fefb7-9a2d-41a2-b0b0-9d176a3d33d9] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:54:03.729374 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-38084a80-4cf1-4897-945d-b8d367f96463 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:03.730109 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-38084a80-4cf1-4897-945d-b8d367f96463 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:03.734981 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-38084a80-4cf1-4897-945d-b8d367f96463 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:03.736357 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-38084a80-4cf1-4897-945d-b8d367f96463 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:03.739366 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-38084a80-4cf1-4897-945d-b8d367f96463 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:03.740020 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-38084a80-4cf1-4897-945d-b8d367f96463 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:03.793395 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f330ed1e-9fe4-4072-98a2-c08b7080a7e0 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:54:03.794809 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f330ed1e-9fe4-4072-98a2-c08b7080a7e0 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: 8fce8438-d6ae-408d-8b4f-ee14d4021fdd] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:54:03.808971 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f330ed1e-9fe4-4072-98a2-c08b7080a7e0 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:03.809724 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f330ed1e-9fe4-4072-98a2-c08b7080a7e0 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:03.813281 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f330ed1e-9fe4-4072-98a2-c08b7080a7e0 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:03.814635 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f330ed1e-9fe4-4072-98a2-c08b7080a7e0 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:03.815305 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f330ed1e-9fe4-4072-98a2-c08b7080a7e0 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:03.816463 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f330ed1e-9fe4-4072-98a2-c08b7080a7e0 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:04.447860 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-38084a80-4cf1-4897-945d-b8d367f96463 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ace9012a7c4ce59c01858b6984b766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a87a909133e42e1a82e3a623536935c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:54:04.467697 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-38084a80-4cf1-4897-945d-b8d367f96463 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] 10.222.0.60 "GET /compute/v2.1/servers/710fefb7-9a2d-41a2-b0b0-9d176a3d33d9" status: 200 len: 1325 microversion: 2.1 time: 0.763842 Sep 14 08:54:04.471404 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 742/1480] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:54:03 2022] GET /compute/v2.1/servers/710fefb7-9a2d-41a2-b0b0-9d176a3d33d9 => generated 1325 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:54:04.478323 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-479767e2-0922-498d-ac52-03050e5d1140 req-4ad83b87-5515-4d25-a806-4becb0495fe0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b2a9a93-cad5-4b18-abc3-1b88413f88da", "tag": "3db17a23-17af-436b-96e5-130e5c8353bc"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:54:04.490281 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-479767e2-0922-498d-ac52-03050e5d1140 req-4ad83b87-5515-4d25-a806-4becb0495fe0 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:04.490768 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-479767e2-0922-498d-ac52-03050e5d1140 req-4ad83b87-5515-4d25-a806-4becb0495fe0 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:04.491217 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-479767e2-0922-498d-ac52-03050e5d1140 req-4ad83b87-5515-4d25-a806-4becb0495fe0 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:04.511629 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-479767e2-0922-498d-ac52-03050e5d1140 req-4ad83b87-5515-4d25-a806-4becb0495fe0 service nova] Creating event network-changed:3db17a23-17af-436b-96e5-130e5c8353bc for instance 1b2a9a93-cad5-4b18-abc3-1b88413f88da on n-h2-836830-18 Sep 14 08:54:04.522525 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f330ed1e-9fe4-4072-98a2-c08b7080a7e0 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:54:04.523026 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [req-479767e2-0922-498d-ac52-03050e5d1140 req-4ad83b87-5515-4d25-a806-4becb0495fe0 service nova] Instance 1b2a9a93-cad5-4b18-abc3-1b88413f88da is migrating within the same cell, copying events to all relevant hosts: {'n-h1-836830-18', 'n-h2-836830-18'} {{(pid=128758) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 14 08:54:04.538982 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f330ed1e-9fe4-4072-98a2-c08b7080a7e0 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:54:04.540402 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-479767e2-0922-498d-ac52-03050e5d1140 req-4ad83b87-5515-4d25-a806-4becb0495fe0 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067159 Sep 14 08:54:04.541842 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 743/1481] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:54:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:54:04.542466 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f330ed1e-9fe4-4072-98a2-c08b7080a7e0 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:54:04.549010 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f330ed1e-9fe4-4072-98a2-c08b7080a7e0 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd" status: 200 len: 1815 microversion: 2.25 time: 0.764589 Sep 14 08:54:04.563726 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 739/1482] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:54:03 2022] GET /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd => generated 1815 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:54:04.563895 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-2ea14238-fee8-4aa9-9b80-605a738739bd tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:54:04.563895 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-2ea14238-fee8-4aa9-9b80-605a738739bd tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: 1b2a9a93-cad5-4b18-abc3-1b88413f88da] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:54:04.563895 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2ea14238-fee8-4aa9-9b80-605a738739bd tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:04.563895 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2ea14238-fee8-4aa9-9b80-605a738739bd tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:04.564295 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2ea14238-fee8-4aa9-9b80-605a738739bd tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:04.564295 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2ea14238-fee8-4aa9-9b80-605a738739bd tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:04.564295 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2ea14238-fee8-4aa9-9b80-605a738739bd tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:04.564602 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2ea14238-fee8-4aa9-9b80-605a738739bd tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:04.861394 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-2ea14238-fee8-4aa9-9b80-605a738739bd tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:54:04.876857 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-2ea14238-fee8-4aa9-9b80-605a738739bd tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/1b2a9a93-cad5-4b18-abc3-1b88413f88da" status: 200 len: 1468 microversion: 2.1 time: 0.332727 Sep 14 08:54:04.877836 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 744/1483] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:54:04 2022] GET /compute/v2.1/servers/1b2a9a93-cad5-4b18-abc3-1b88413f88da => generated 1468 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:54:05.305647 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-fa1df478-2fb6-4c11-91b3-ec14181b9086 req-c6030667-58b9-44f3-a92d-f2f65bae6010 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "710fefb7-9a2d-41a2-b0b0-9d176a3d33d9", "name": "network-vif-plugged", "status": "completed", "tag": "5d174d16-22bf-476a-aab3-7e6f54672d60"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:54:05.320816 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=2 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:54:05.321645 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=6 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:54:05.384143 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-fa1df478-2fb6-4c11-91b3-ec14181b9086 req-c6030667-58b9-44f3-a92d-f2f65bae6010 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:05.387296 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-fa1df478-2fb6-4c11-91b3-ec14181b9086 req-c6030667-58b9-44f3-a92d-f2f65bae6010 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:05.388507 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-fa1df478-2fb6-4c11-91b3-ec14181b9086 req-c6030667-58b9-44f3-a92d-f2f65bae6010 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:05.439537 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-fa1df478-2fb6-4c11-91b3-ec14181b9086 req-c6030667-58b9-44f3-a92d-f2f65bae6010 service nova] Creating event network-vif-plugged:5d174d16-22bf-476a-aab3-7e6f54672d60 for instance 710fefb7-9a2d-41a2-b0b0-9d176a3d33d9 on n-h2-836830-18 Sep 14 08:54:05.452928 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-fa1df478-2fb6-4c11-91b3-ec14181b9086 req-c6030667-58b9-44f3-a92d-f2f65bae6010 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.157282 Sep 14 08:54:05.453540 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 740/1484] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:54:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:54:05.493214 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-6487ff52-b098-4379-86f8-264b62d12be6 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:54:05.493894 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-6487ff52-b098-4379-86f8-264b62d12be6 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] [instance: 710fefb7-9a2d-41a2-b0b0-9d176a3d33d9] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:54:05.519439 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6487ff52-b098-4379-86f8-264b62d12be6 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:05.521028 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6487ff52-b098-4379-86f8-264b62d12be6 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:05.521491 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6487ff52-b098-4379-86f8-264b62d12be6 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:05.522233 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6487ff52-b098-4379-86f8-264b62d12be6 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:05.522701 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6487ff52-b098-4379-86f8-264b62d12be6 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:05.527053 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6487ff52-b098-4379-86f8-264b62d12be6 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:05.591433 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-87f63144-9c87-4cbd-96a6-9185e867d2ce tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:54:05.592918 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-87f63144-9c87-4cbd-96a6-9185e867d2ce tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: 8fce8438-d6ae-408d-8b4f-ee14d4021fdd] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:54:05.601212 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-87f63144-9c87-4cbd-96a6-9185e867d2ce tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:05.602175 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-87f63144-9c87-4cbd-96a6-9185e867d2ce tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:05.603456 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-87f63144-9c87-4cbd-96a6-9185e867d2ce tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:05.604433 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-87f63144-9c87-4cbd-96a6-9185e867d2ce tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:05.606099 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-87f63144-9c87-4cbd-96a6-9185e867d2ce tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:05.607053 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-87f63144-9c87-4cbd-96a6-9185e867d2ce tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:06.114855 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-6487ff52-b098-4379-86f8-264b62d12be6 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ace9012a7c4ce59c01858b6984b766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a87a909133e42e1a82e3a623536935c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:54:06.132508 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-87f63144-9c87-4cbd-96a6-9185e867d2ce tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:54:06.137445 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-6487ff52-b098-4379-86f8-264b62d12be6 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] 10.222.0.60 "GET /compute/v2.1/servers/710fefb7-9a2d-41a2-b0b0-9d176a3d33d9" status: 200 len: 1325 microversion: 2.1 time: 0.648223 Sep 14 08:54:06.138834 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 745/1485] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:54:05 2022] GET /compute/v2.1/servers/710fefb7-9a2d-41a2-b0b0-9d176a3d33d9 => generated 1325 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:54:06.141398 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-87f63144-9c87-4cbd-96a6-9185e867d2ce tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:54:06.144637 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-87f63144-9c87-4cbd-96a6-9185e867d2ce tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:54:06.146221 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-87f63144-9c87-4cbd-96a6-9185e867d2ce tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd" status: 200 len: 1815 microversion: 2.25 time: 0.565428 Sep 14 08:54:06.149122 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 741/1486] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:54:05 2022] GET /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd => generated 1815 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 08:54:06.156113 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-846e53ed-5174-4ab7-9962-e2f271fc26d5 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:54:06.157311 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-846e53ed-5174-4ab7-9962-e2f271fc26d5 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: 1b2a9a93-cad5-4b18-abc3-1b88413f88da] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:54:06.183475 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-846e53ed-5174-4ab7-9962-e2f271fc26d5 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:06.186386 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-846e53ed-5174-4ab7-9962-e2f271fc26d5 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:06.188720 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-846e53ed-5174-4ab7-9962-e2f271fc26d5 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:06.194038 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-846e53ed-5174-4ab7-9962-e2f271fc26d5 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:06.208284 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-846e53ed-5174-4ab7-9962-e2f271fc26d5 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:06.209198 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-846e53ed-5174-4ab7-9962-e2f271fc26d5 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:06.451250 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-fcdd1a3b-c539-4558-95b1-71e9179db354 tempest-AZV2TestJSON-661929237 tempest-AZV2TestJSON-661929237-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:54:06.453518 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fcdd1a3b-c539-4558-95b1-71e9179db354 tempest-AZV2TestJSON-661929237 tempest-AZV2TestJSON-661929237-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:06.454715 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fcdd1a3b-c539-4558-95b1-71e9179db354 tempest-AZV2TestJSON-661929237 tempest-AZV2TestJSON-661929237-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:06.455296 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fcdd1a3b-c539-4558-95b1-71e9179db354 tempest-AZV2TestJSON-661929237 tempest-AZV2TestJSON-661929237-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:06.456402 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fcdd1a3b-c539-4558-95b1-71e9179db354 tempest-AZV2TestJSON-661929237 tempest-AZV2TestJSON-661929237-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:06.462650 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fcdd1a3b-c539-4558-95b1-71e9179db354 tempest-AZV2TestJSON-661929237 tempest-AZV2TestJSON-661929237-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:06.463196 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fcdd1a3b-c539-4558-95b1-71e9179db354 tempest-AZV2TestJSON-661929237 tempest-AZV2TestJSON-661929237-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:06.501210 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-fcdd1a3b-c539-4558-95b1-71e9179db354 tempest-AZV2TestJSON-661929237 tempest-AZV2TestJSON-661929237-project] 10.222.0.60 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.360909 Sep 14 08:54:06.514217 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 746/1487] 10.222.0.60 () {58 vars in 1164 bytes} [Wed Sep 14 08:54:06 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 08:54:06.522173 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-846e53ed-5174-4ab7-9962-e2f271fc26d5 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:54:06.531677 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-846e53ed-5174-4ab7-9962-e2f271fc26d5 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/1b2a9a93-cad5-4b18-abc3-1b88413f88da" status: 200 len: 1468 microversion: 2.1 time: 0.379230 Sep 14 08:54:06.546977 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 742/1488] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:54:06 2022] GET /compute/v2.1/servers/1b2a9a93-cad5-4b18-abc3-1b88413f88da => generated 1468 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:54:07.162700 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-91cde942-4764-4ee9-8d58-74adac0ed37c tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:54:07.163711 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-91cde942-4764-4ee9-8d58-74adac0ed37c tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] [instance: 710fefb7-9a2d-41a2-b0b0-9d176a3d33d9] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:54:07.176880 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-91cde942-4764-4ee9-8d58-74adac0ed37c tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:07.177616 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-5f648fea-0d2c-4db6-ad3e-8179abc3f918 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:54:07.178335 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-5f648fea-0d2c-4db6-ad3e-8179abc3f918 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: 8fce8438-d6ae-408d-8b4f-ee14d4021fdd] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:54:07.180196 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-91cde942-4764-4ee9-8d58-74adac0ed37c tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:07.180676 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-91cde942-4764-4ee9-8d58-74adac0ed37c tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:07.184153 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-91cde942-4764-4ee9-8d58-74adac0ed37c tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:07.184656 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-91cde942-4764-4ee9-8d58-74adac0ed37c tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:07.188604 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-91cde942-4764-4ee9-8d58-74adac0ed37c tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:07.201577 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5f648fea-0d2c-4db6-ad3e-8179abc3f918 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:07.206118 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5f648fea-0d2c-4db6-ad3e-8179abc3f918 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:07.209591 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5f648fea-0d2c-4db6-ad3e-8179abc3f918 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:07.211639 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5f648fea-0d2c-4db6-ad3e-8179abc3f918 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:07.212636 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5f648fea-0d2c-4db6-ad3e-8179abc3f918 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:07.215527 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5f648fea-0d2c-4db6-ad3e-8179abc3f918 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:07.727075 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-5f648fea-0d2c-4db6-ad3e-8179abc3f918 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:54:07.729975 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-91cde942-4764-4ee9-8d58-74adac0ed37c tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ace9012a7c4ce59c01858b6984b766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a87a909133e42e1a82e3a623536935c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:54:07.746694 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-91cde942-4764-4ee9-8d58-74adac0ed37c tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] 10.222.0.60 "GET /compute/v2.1/servers/710fefb7-9a2d-41a2-b0b0-9d176a3d33d9" status: 200 len: 1325 microversion: 2.1 time: 0.588735 Sep 14 08:54:07.747067 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-5f648fea-0d2c-4db6-ad3e-8179abc3f918 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:54:07.748746 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 747/1489] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:54:07 2022] GET /compute/v2.1/servers/710fefb7-9a2d-41a2-b0b0-9d176a3d33d9 => generated 1325 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:54:07.751206 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-5f648fea-0d2c-4db6-ad3e-8179abc3f918 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:54:07.753086 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-5f648fea-0d2c-4db6-ad3e-8179abc3f918 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd" status: 200 len: 1815 microversion: 2.25 time: 0.580595 Sep 14 08:54:07.762019 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-8904a71e-2efa-470d-8d62-68b7a9371e53 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:54:07.763784 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 743/1490] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:54:07 2022] GET /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd => generated 1815 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 08:54:07.772005 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-8904a71e-2efa-470d-8d62-68b7a9371e53 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: 1b2a9a93-cad5-4b18-abc3-1b88413f88da] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:54:07.787883 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8904a71e-2efa-470d-8d62-68b7a9371e53 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:07.794512 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8904a71e-2efa-470d-8d62-68b7a9371e53 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:07.798888 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8904a71e-2efa-470d-8d62-68b7a9371e53 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:07.805574 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8904a71e-2efa-470d-8d62-68b7a9371e53 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:07.806377 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8904a71e-2efa-470d-8d62-68b7a9371e53 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:07.807757 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8904a71e-2efa-470d-8d62-68b7a9371e53 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:07.816454 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=100 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:54:08.052308 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-8904a71e-2efa-470d-8d62-68b7a9371e53 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:54:08.065373 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-8904a71e-2efa-470d-8d62-68b7a9371e53 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/1b2a9a93-cad5-4b18-abc3-1b88413f88da" status: 200 len: 1468 microversion: 2.1 time: 0.315255 Sep 14 08:54:08.067406 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 748/1491] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:54:07 2022] GET /compute/v2.1/servers/1b2a9a93-cad5-4b18-abc3-1b88413f88da => generated 1468 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:54:08.781220 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d594b59f-3db8-42db-aa5b-198970055ecc tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:54:08.781932 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-d594b59f-3db8-42db-aa5b-198970055ecc tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] [instance: 710fefb7-9a2d-41a2-b0b0-9d176a3d33d9] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:54:08.782420 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-aa7ad942-f13a-480b-bb12-f541100cf122 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:54:08.783212 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-aa7ad942-f13a-480b-bb12-f541100cf122 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: 8fce8438-d6ae-408d-8b4f-ee14d4021fdd] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:54:08.806607 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d594b59f-3db8-42db-aa5b-198970055ecc tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:08.807619 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-aa7ad942-f13a-480b-bb12-f541100cf122 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:08.808580 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-aa7ad942-f13a-480b-bb12-f541100cf122 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:08.811502 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-aa7ad942-f13a-480b-bb12-f541100cf122 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:08.813102 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d594b59f-3db8-42db-aa5b-198970055ecc tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:08.814431 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-aa7ad942-f13a-480b-bb12-f541100cf122 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:08.815189 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-aa7ad942-f13a-480b-bb12-f541100cf122 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:08.817014 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-aa7ad942-f13a-480b-bb12-f541100cf122 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:08.818571 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d594b59f-3db8-42db-aa5b-198970055ecc tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:08.821562 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d594b59f-3db8-42db-aa5b-198970055ecc tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:08.822055 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d594b59f-3db8-42db-aa5b-198970055ecc tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:08.822508 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d594b59f-3db8-42db-aa5b-198970055ecc tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:09.241146 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-d594b59f-3db8-42db-aa5b-198970055ecc tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ace9012a7c4ce59c01858b6984b766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a87a909133e42e1a82e3a623536935c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:54:09.245223 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-aa7ad942-f13a-480b-bb12-f541100cf122 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:54:09.254109 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d594b59f-3db8-42db-aa5b-198970055ecc tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] 10.222.0.60 "GET /compute/v2.1/servers/710fefb7-9a2d-41a2-b0b0-9d176a3d33d9" status: 200 len: 1521 microversion: 2.1 time: 0.484743 Sep 14 08:54:09.255785 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 744/1492] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:54:08 2022] GET /compute/v2.1/servers/710fefb7-9a2d-41a2-b0b0-9d176a3d33d9 => generated 1521 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:54:09.257482 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-aa7ad942-f13a-480b-bb12-f541100cf122 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:54:09.264007 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-aa7ad942-f13a-480b-bb12-f541100cf122 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:54:09.265482 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-aa7ad942-f13a-480b-bb12-f541100cf122 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd" status: 200 len: 1815 microversion: 2.25 time: 0.488831 Sep 14 08:54:09.266067 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 749/1493] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:54:08 2022] GET /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd => generated 1815 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 08:54:09.282172 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-55ad7a05-1258-42b1-a8cc-f6a7e8333c26 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:54:09.289807 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-55ad7a05-1258-42b1-a8cc-f6a7e8333c26 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: 1b2a9a93-cad5-4b18-abc3-1b88413f88da] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:54:09.290499 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ef87d4c4-0123-44ed-ac51-a92ff0fcfbe9 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:54:09.291049 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-ef87d4c4-0123-44ed-ac51-a92ff0fcfbe9 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] [instance: 710fefb7-9a2d-41a2-b0b0-9d176a3d33d9] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:54:09.303037 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-55ad7a05-1258-42b1-a8cc-f6a7e8333c26 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:09.304974 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-55ad7a05-1258-42b1-a8cc-f6a7e8333c26 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:09.306289 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ef87d4c4-0123-44ed-ac51-a92ff0fcfbe9 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:09.306789 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ef87d4c4-0123-44ed-ac51-a92ff0fcfbe9 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:09.307317 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ef87d4c4-0123-44ed-ac51-a92ff0fcfbe9 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:09.307515 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-55ad7a05-1258-42b1-a8cc-f6a7e8333c26 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:09.308243 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-55ad7a05-1258-42b1-a8cc-f6a7e8333c26 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:09.308675 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ef87d4c4-0123-44ed-ac51-a92ff0fcfbe9 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:09.308825 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-55ad7a05-1258-42b1-a8cc-f6a7e8333c26 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:09.309129 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-55ad7a05-1258-42b1-a8cc-f6a7e8333c26 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:09.313109 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ef87d4c4-0123-44ed-ac51-a92ff0fcfbe9 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:09.313800 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ef87d4c4-0123-44ed-ac51-a92ff0fcfbe9 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:09.402561 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-ef87d4c4-0123-44ed-ac51-a92ff0fcfbe9 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] [instance: 710fefb7-9a2d-41a2-b0b0-9d176a3d33d9] Going to try to terminate instance {{(pid=128758) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 08:54:09.550265 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-ef87d4c4-0123-44ed-ac51-a92ff0fcfbe9 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] 10.222.0.60 "DELETE /compute/v2.1/servers/710fefb7-9a2d-41a2-b0b0-9d176a3d33d9" status: 204 len: 0 microversion: 2.1 time: 0.265272 Sep 14 08:54:09.555046 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 750/1494] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 08:54:09 2022] DELETE /compute/v2.1/servers/710fefb7-9a2d-41a2-b0b0-9d176a3d33d9 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 08:54:09.579092 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-8a1b4823-a5da-4303-91e8-f57be0e44330 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:54:09.580177 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-8a1b4823-a5da-4303-91e8-f57be0e44330 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] [instance: 710fefb7-9a2d-41a2-b0b0-9d176a3d33d9] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:54:09.598724 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8a1b4823-a5da-4303-91e8-f57be0e44330 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:09.599666 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8a1b4823-a5da-4303-91e8-f57be0e44330 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:09.600355 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8a1b4823-a5da-4303-91e8-f57be0e44330 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:09.601381 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8a1b4823-a5da-4303-91e8-f57be0e44330 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:09.602105 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8a1b4823-a5da-4303-91e8-f57be0e44330 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:09.602821 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8a1b4823-a5da-4303-91e8-f57be0e44330 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:09.727454 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-55ad7a05-1258-42b1-a8cc-f6a7e8333c26 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:54:09.745667 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-55ad7a05-1258-42b1-a8cc-f6a7e8333c26 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/1b2a9a93-cad5-4b18-abc3-1b88413f88da" status: 200 len: 1461 microversion: 2.1 time: 0.486576 Sep 14 08:54:09.748593 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 745/1495] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:54:09 2022] GET /compute/v2.1/servers/1b2a9a93-cad5-4b18-abc3-1b88413f88da => generated 1461 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:54:09.825584 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-8a1b4823-a5da-4303-91e8-f57be0e44330 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ace9012a7c4ce59c01858b6984b766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a87a909133e42e1a82e3a623536935c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:54:09.834693 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-8a1b4823-a5da-4303-91e8-f57be0e44330 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] 10.222.0.60 "GET /compute/v2.1/servers/710fefb7-9a2d-41a2-b0b0-9d176a3d33d9" status: 200 len: 1527 microversion: 2.1 time: 0.272108 Sep 14 08:54:09.839716 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 751/1496] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:54:09 2022] GET /compute/v2.1/servers/710fefb7-9a2d-41a2-b0b0-9d176a3d33d9 => generated 1527 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:54:10.128406 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-515b6068-0ea6-4a2b-9fc5-900896255fec tempest-MigrationsAdminTest-1443382137 tempest-MigrationsAdminTest-1443382137-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:54:10.129100 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-515b6068-0ea6-4a2b-9fc5-900896255fec tempest-MigrationsAdminTest-1443382137 tempest-MigrationsAdminTest-1443382137-project-admin] [instance: 1b2a9a93-cad5-4b18-abc3-1b88413f88da] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:54:10.143120 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-515b6068-0ea6-4a2b-9fc5-900896255fec tempest-MigrationsAdminTest-1443382137 tempest-MigrationsAdminTest-1443382137-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:10.143655 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-515b6068-0ea6-4a2b-9fc5-900896255fec tempest-MigrationsAdminTest-1443382137 tempest-MigrationsAdminTest-1443382137-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:10.144158 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-515b6068-0ea6-4a2b-9fc5-900896255fec tempest-MigrationsAdminTest-1443382137 tempest-MigrationsAdminTest-1443382137-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:10.145013 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-515b6068-0ea6-4a2b-9fc5-900896255fec tempest-MigrationsAdminTest-1443382137 tempest-MigrationsAdminTest-1443382137-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:10.145520 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-515b6068-0ea6-4a2b-9fc5-900896255fec tempest-MigrationsAdminTest-1443382137 tempest-MigrationsAdminTest-1443382137-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:10.145945 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-515b6068-0ea6-4a2b-9fc5-900896255fec tempest-MigrationsAdminTest-1443382137 tempest-MigrationsAdminTest-1443382137-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:10.157751 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=100 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:54:10.295616 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-4a4970ce-5ce2-43f0-8155-a60c32147b46 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:54:10.296724 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-4a4970ce-5ce2-43f0-8155-a60c32147b46 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: 8fce8438-d6ae-408d-8b4f-ee14d4021fdd] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:54:10.304157 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4a4970ce-5ce2-43f0-8155-a60c32147b46 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:10.305108 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4a4970ce-5ce2-43f0-8155-a60c32147b46 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:10.305738 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4a4970ce-5ce2-43f0-8155-a60c32147b46 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:10.306672 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4a4970ce-5ce2-43f0-8155-a60c32147b46 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:10.307334 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4a4970ce-5ce2-43f0-8155-a60c32147b46 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:10.307938 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4a4970ce-5ce2-43f0-8155-a60c32147b46 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:10.912225 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-515b6068-0ea6-4a2b-9fc5-900896255fec tempest-MigrationsAdminTest-1443382137 tempest-MigrationsAdminTest-1443382137-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/1b2a9a93-cad5-4b18-abc3-1b88413f88da" status: 200 len: 1614 microversion: 2.1 time: 1.138950 Sep 14 08:54:10.923886 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 746/1497] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:54:09 2022] GET /compute/v2.1/servers/1b2a9a93-cad5-4b18-abc3-1b88413f88da => generated 1614 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:54:10.933148 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-4a4970ce-5ce2-43f0-8155-a60c32147b46 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:54:10.937670 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-eb72a6c9-d6da-4114-8dcc-9e80d4ceb4a3 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:54:10.944048 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-eb72a6c9-d6da-4114-8dcc-9e80d4ceb4a3 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] [instance: 710fefb7-9a2d-41a2-b0b0-9d176a3d33d9] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:54:10.949924 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:54:10.951555 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-eb72a6c9-d6da-4114-8dcc-9e80d4ceb4a3 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:10.952238 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-eb72a6c9-d6da-4114-8dcc-9e80d4ceb4a3 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:10.952871 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-eb72a6c9-d6da-4114-8dcc-9e80d4ceb4a3 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:10.953759 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-eb72a6c9-d6da-4114-8dcc-9e80d4ceb4a3 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:10.953910 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-4a4970ce-5ce2-43f0-8155-a60c32147b46 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:54:10.954543 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-eb72a6c9-d6da-4114-8dcc-9e80d4ceb4a3 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:10.955171 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-eb72a6c9-d6da-4114-8dcc-9e80d4ceb4a3 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:10.956250 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-4a4970ce-5ce2-43f0-8155-a60c32147b46 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:54:10.957697 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-4a4970ce-5ce2-43f0-8155-a60c32147b46 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd" status: 200 len: 1815 microversion: 2.25 time: 0.666107 Sep 14 08:54:10.959377 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 752/1498] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:54:10 2022] GET /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd => generated 1815 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:54:10.967695 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-9e3c7f60-38ca-4476-9b78-7fdf060d529b tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:54:10.968205 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-9e3c7f60-38ca-4476-9b78-7fdf060d529b tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: 1b2a9a93-cad5-4b18-abc3-1b88413f88da] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:54:10.984031 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9e3c7f60-38ca-4476-9b78-7fdf060d529b tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:10.984701 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9e3c7f60-38ca-4476-9b78-7fdf060d529b tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:10.985256 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9e3c7f60-38ca-4476-9b78-7fdf060d529b tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:10.986193 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9e3c7f60-38ca-4476-9b78-7fdf060d529b tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:10.986762 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9e3c7f60-38ca-4476-9b78-7fdf060d529b tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:10.987913 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9e3c7f60-38ca-4476-9b78-7fdf060d529b tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:11.017359 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-9e3c7f60-38ca-4476-9b78-7fdf060d529b tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: 1b2a9a93-cad5-4b18-abc3-1b88413f88da] Going to try to terminate instance {{(pid=128758) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 08:54:11.112053 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-9e3c7f60-38ca-4476-9b78-7fdf060d529b tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "DELETE /compute/v2.1/servers/1b2a9a93-cad5-4b18-abc3-1b88413f88da" status: 204 len: 0 microversion: 2.1 time: 0.151360 Sep 14 08:54:11.113948 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 753/1499] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 08:54:10 2022] DELETE /compute/v2.1/servers/1b2a9a93-cad5-4b18-abc3-1b88413f88da => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 08:54:11.123231 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-e79d8800-4237-4ad5-b291-15135ea12d2c tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:54:11.124229 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-e79d8800-4237-4ad5-b291-15135ea12d2c tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: 1b2a9a93-cad5-4b18-abc3-1b88413f88da] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:54:11.132194 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e79d8800-4237-4ad5-b291-15135ea12d2c tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:11.132757 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e79d8800-4237-4ad5-b291-15135ea12d2c tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:11.133288 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e79d8800-4237-4ad5-b291-15135ea12d2c tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:11.134109 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e79d8800-4237-4ad5-b291-15135ea12d2c tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:11.134609 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e79d8800-4237-4ad5-b291-15135ea12d2c tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:11.135253 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e79d8800-4237-4ad5-b291-15135ea12d2c tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:11.347282 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-eb72a6c9-d6da-4114-8dcc-9e80d4ceb4a3 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ace9012a7c4ce59c01858b6984b766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a87a909133e42e1a82e3a623536935c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:54:11.364477 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-eb72a6c9-d6da-4114-8dcc-9e80d4ceb4a3 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] 10.222.0.60 "GET /compute/v2.1/servers/710fefb7-9a2d-41a2-b0b0-9d176a3d33d9" status: 200 len: 1527 microversion: 2.1 time: 0.439214 Sep 14 08:54:11.366599 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 747/1500] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:54:10 2022] GET /compute/v2.1/servers/710fefb7-9a2d-41a2-b0b0-9d176a3d33d9 => generated 1527 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:54:11.429559 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-e79d8800-4237-4ad5-b291-15135ea12d2c tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:54:11.440445 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-e79d8800-4237-4ad5-b291-15135ea12d2c tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/1b2a9a93-cad5-4b18-abc3-1b88413f88da" status: 200 len: 1467 microversion: 2.1 time: 0.321616 Sep 14 08:54:11.441078 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 754/1501] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:54:11 2022] GET /compute/v2.1/servers/1b2a9a93-cad5-4b18-abc3-1b88413f88da => generated 1467 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:54:11.851107 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-223c5f99-55eb-41f4-b2ce-8ce6e5df78f0 req-2c0904c7-44d0-4020-b0bb-2c11f2a75a1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b2a9a93-cad5-4b18-abc3-1b88413f88da", "name": "network-vif-plugged", "status": "completed", "tag": "3db17a23-17af-436b-96e5-130e5c8353bc"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:54:11.862085 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-223c5f99-55eb-41f4-b2ce-8ce6e5df78f0 req-2c0904c7-44d0-4020-b0bb-2c11f2a75a1b service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:11.862878 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-223c5f99-55eb-41f4-b2ce-8ce6e5df78f0 req-2c0904c7-44d0-4020-b0bb-2c11f2a75a1b service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:11.863329 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-223c5f99-55eb-41f4-b2ce-8ce6e5df78f0 req-2c0904c7-44d0-4020-b0bb-2c11f2a75a1b service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:11.876208 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-223c5f99-55eb-41f4-b2ce-8ce6e5df78f0 req-2c0904c7-44d0-4020-b0bb-2c11f2a75a1b service nova] Creating event network-vif-plugged:3db17a23-17af-436b-96e5-130e5c8353bc for instance 1b2a9a93-cad5-4b18-abc3-1b88413f88da on n-h2-836830-18 Sep 14 08:54:11.882199 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-223c5f99-55eb-41f4-b2ce-8ce6e5df78f0 req-2c0904c7-44d0-4020-b0bb-2c11f2a75a1b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035177 Sep 14 08:54:11.883322 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 748/1502] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:54:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:54:11.990053 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-8e4034c7-6817-4bef-9154-df7c4677de08 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:54:11.991482 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-8e4034c7-6817-4bef-9154-df7c4677de08 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: 8fce8438-d6ae-408d-8b4f-ee14d4021fdd] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:54:12.002101 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8e4034c7-6817-4bef-9154-df7c4677de08 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:12.005865 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8e4034c7-6817-4bef-9154-df7c4677de08 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:12.006499 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8e4034c7-6817-4bef-9154-df7c4677de08 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:12.007452 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8e4034c7-6817-4bef-9154-df7c4677de08 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:12.009110 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8e4034c7-6817-4bef-9154-df7c4677de08 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:12.009750 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8e4034c7-6817-4bef-9154-df7c4677de08 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:12.393738 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e1bd167c-d047-4f0b-8ca0-5f5878de0a87 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:54:12.394446 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e1bd167c-d047-4f0b-8ca0-5f5878de0a87 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] [instance: 710fefb7-9a2d-41a2-b0b0-9d176a3d33d9] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:54:12.404929 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e1bd167c-d047-4f0b-8ca0-5f5878de0a87 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:12.407243 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e1bd167c-d047-4f0b-8ca0-5f5878de0a87 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:12.426467 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e1bd167c-d047-4f0b-8ca0-5f5878de0a87 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:12.430974 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e1bd167c-d047-4f0b-8ca0-5f5878de0a87 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:12.431708 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e1bd167c-d047-4f0b-8ca0-5f5878de0a87 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:12.432795 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e1bd167c-d047-4f0b-8ca0-5f5878de0a87 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:12.954978 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-8e4034c7-6817-4bef-9154-df7c4677de08 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:54:12.981754 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-e1bd167c-d047-4f0b-8ca0-5f5878de0a87 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ace9012a7c4ce59c01858b6984b766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a87a909133e42e1a82e3a623536935c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:54:12.982035 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-8e4034c7-6817-4bef-9154-df7c4677de08 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:54:12.983633 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-8e4034c7-6817-4bef-9154-df7c4677de08 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:54:12.986804 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-8e4034c7-6817-4bef-9154-df7c4677de08 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd" status: 200 len: 1815 microversion: 2.25 time: 0.999997 Sep 14 08:54:12.990081 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 755/1503] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:54:11 2022] GET /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd => generated 1815 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:54:12.997606 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-377fa262-717c-4270-90c9-3ffa08db061b tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:54:12.998711 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-377fa262-717c-4270-90c9-3ffa08db061b tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: 1b2a9a93-cad5-4b18-abc3-1b88413f88da] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:54:13.008629 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-377fa262-717c-4270-90c9-3ffa08db061b tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:13.009547 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-377fa262-717c-4270-90c9-3ffa08db061b tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:13.010335 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-377fa262-717c-4270-90c9-3ffa08db061b tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:13.010979 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e1bd167c-d047-4f0b-8ca0-5f5878de0a87 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] 10.222.0.60 "GET /compute/v2.1/servers/710fefb7-9a2d-41a2-b0b0-9d176a3d33d9" status: 200 len: 1527 microversion: 2.1 time: 0.621308 Sep 14 08:54:13.012047 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-377fa262-717c-4270-90c9-3ffa08db061b tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:13.012759 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-377fa262-717c-4270-90c9-3ffa08db061b tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:13.013490 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-377fa262-717c-4270-90c9-3ffa08db061b tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:13.028184 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 749/1504] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:54:12 2022] GET /compute/v2.1/servers/710fefb7-9a2d-41a2-b0b0-9d176a3d33d9 => generated 1527 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:54:13.581051 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-377fa262-717c-4270-90c9-3ffa08db061b tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:54:13.602279 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-377fa262-717c-4270-90c9-3ffa08db061b tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/1b2a9a93-cad5-4b18-abc3-1b88413f88da" status: 200 len: 1467 microversion: 2.1 time: 0.609961 Sep 14 08:54:13.626530 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 756/1505] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:54:12 2022] GET /compute/v2.1/servers/1b2a9a93-cad5-4b18-abc3-1b88413f88da => generated 1467 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:54:13.955241 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-c8457d0b-7d55-4469-a484-667275bff7f5 req-5f0e4c93-94b1-4e1e-8070-d106cccf3eb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b2a9a93-cad5-4b18-abc3-1b88413f88da", "name": "network-vif-deleted", "tag": "3db17a23-17af-436b-96e5-130e5c8353bc"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:54:14.009720 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-c8457d0b-7d55-4469-a484-667275bff7f5 req-5f0e4c93-94b1-4e1e-8070-d106cccf3eb8 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:14.011673 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-c8457d0b-7d55-4469-a484-667275bff7f5 req-5f0e4c93-94b1-4e1e-8070-d106cccf3eb8 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:14.015633 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-c8457d0b-7d55-4469-a484-667275bff7f5 req-5f0e4c93-94b1-4e1e-8070-d106cccf3eb8 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:14.020909 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-f0ae9808-b2f8-4cfa-937b-253988b3853e tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:54:14.021574 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-f0ae9808-b2f8-4cfa-937b-253988b3853e tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: 8fce8438-d6ae-408d-8b4f-ee14d4021fdd] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:54:14.044683 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-c8457d0b-7d55-4469-a484-667275bff7f5 req-5f0e4c93-94b1-4e1e-8070-d106cccf3eb8 service nova] Creating event network-vif-deleted:3db17a23-17af-436b-96e5-130e5c8353bc for instance 1b2a9a93-cad5-4b18-abc3-1b88413f88da on n-h2-836830-18 Sep 14 08:54:14.053979 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-c8457d0b-7d55-4469-a484-667275bff7f5 req-5f0e4c93-94b1-4e1e-8070-d106cccf3eb8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104435 Sep 14 08:54:14.054292 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f0ae9808-b2f8-4cfa-937b-253988b3853e tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:14.055983 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f0ae9808-b2f8-4cfa-937b-253988b3853e tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:14.056720 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f0ae9808-b2f8-4cfa-937b-253988b3853e tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:14.058501 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 750/1506] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:54:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:54:14.059467 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f0ae9808-b2f8-4cfa-937b-253988b3853e tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:14.060097 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f0ae9808-b2f8-4cfa-937b-253988b3853e tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:14.067398 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f0ae9808-b2f8-4cfa-937b-253988b3853e tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:14.068028 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b987673c-3b4c-47a0-97a6-d3a2ca6c47e4 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:54:14.069007 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b987673c-3b4c-47a0-97a6-d3a2ca6c47e4 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] [instance: 710fefb7-9a2d-41a2-b0b0-9d176a3d33d9] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:54:14.083060 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b987673c-3b4c-47a0-97a6-d3a2ca6c47e4 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:14.084155 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b987673c-3b4c-47a0-97a6-d3a2ca6c47e4 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:14.085552 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b987673c-3b4c-47a0-97a6-d3a2ca6c47e4 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:14.086585 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b987673c-3b4c-47a0-97a6-d3a2ca6c47e4 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:14.087318 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b987673c-3b4c-47a0-97a6-d3a2ca6c47e4 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:14.088166 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b987673c-3b4c-47a0-97a6-d3a2ca6c47e4 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:14.514047 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b987673c-3b4c-47a0-97a6-d3a2ca6c47e4 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ace9012a7c4ce59c01858b6984b766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a87a909133e42e1a82e3a623536935c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:54:14.529863 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b987673c-3b4c-47a0-97a6-d3a2ca6c47e4 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] 10.222.0.60 "GET /compute/v2.1/servers/710fefb7-9a2d-41a2-b0b0-9d176a3d33d9" status: 200 len: 1485 microversion: 2.1 time: 0.467828 Sep 14 08:54:14.557123 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 751/1507] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:54:14 2022] GET /compute/v2.1/servers/710fefb7-9a2d-41a2-b0b0-9d176a3d33d9 => generated 1485 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:54:14.626518 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d49cc1b2-2936-462a-93ea-34e056d83dd3 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:54:14.628723 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-d49cc1b2-2936-462a-93ea-34e056d83dd3 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: 1b2a9a93-cad5-4b18-abc3-1b88413f88da] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:54:14.641455 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d49cc1b2-2936-462a-93ea-34e056d83dd3 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:14.644947 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d49cc1b2-2936-462a-93ea-34e056d83dd3 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:14.646888 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d49cc1b2-2936-462a-93ea-34e056d83dd3 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:14.648290 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d49cc1b2-2936-462a-93ea-34e056d83dd3 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:14.654873 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d49cc1b2-2936-462a-93ea-34e056d83dd3 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:14.655805 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d49cc1b2-2936-462a-93ea-34e056d83dd3 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:14.713216 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d49cc1b2-2936-462a-93ea-34e056d83dd3 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:14.714159 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d49cc1b2-2936-462a-93ea-34e056d83dd3 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:14.715336 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d49cc1b2-2936-462a-93ea-34e056d83dd3 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:14.716024 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.objects.instance [None req-d49cc1b2-2936-462a-93ea-34e056d83dd3 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lazy-loading 'fault' on Instance uuid 1b2a9a93-cad5-4b18-abc3-1b88413f88da {{(pid=128759) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 08:54:14.996993 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-d49cc1b2-2936-462a-93ea-34e056d83dd3 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:54:15.014869 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d49cc1b2-2936-462a-93ea-34e056d83dd3 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/1b2a9a93-cad5-4b18-abc3-1b88413f88da" status: 200 len: 1302 microversion: 2.1 time: 0.391853 Sep 14 08:54:15.018629 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 752/1508] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:54:14 2022] GET /compute/v2.1/servers/1b2a9a93-cad5-4b18-abc3-1b88413f88da => generated 1302 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:54:15.024632 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-0f226bb7-960a-40ae-b9a4-db7e3bc939ce req-4ba3f6bd-2f0b-4902-a8fc-db34c6f7672d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "710fefb7-9a2d-41a2-b0b0-9d176a3d33d9", "name": "network-vif-deleted", "tag": "5d174d16-22bf-476a-aab3-7e6f54672d60"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:54:15.048412 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-f0ae9808-b2f8-4cfa-937b-253988b3853e tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:54:15.059126 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-0f226bb7-960a-40ae-b9a4-db7e3bc939ce req-4ba3f6bd-2f0b-4902-a8fc-db34c6f7672d service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:15.067861 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-0f226bb7-960a-40ae-b9a4-db7e3bc939ce req-4ba3f6bd-2f0b-4902-a8fc-db34c6f7672d service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:15.070051 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-0f226bb7-960a-40ae-b9a4-db7e3bc939ce req-4ba3f6bd-2f0b-4902-a8fc-db34c6f7672d service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:15.092325 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-f0ae9808-b2f8-4cfa-937b-253988b3853e tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:54:15.101329 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-f0ae9808-b2f8-4cfa-937b-253988b3853e tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:54:15.118697 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-f0ae9808-b2f8-4cfa-937b-253988b3853e tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd" status: 200 len: 1815 microversion: 2.25 time: 1.102657 Sep 14 08:54:15.121128 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 757/1509] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:54:14 2022] GET /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd => generated 1815 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 08:54:15.128151 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-0f226bb7-960a-40ae-b9a4-db7e3bc939ce req-4ba3f6bd-2f0b-4902-a8fc-db34c6f7672d service nova] Creating event network-vif-deleted:5d174d16-22bf-476a-aab3-7e6f54672d60 for instance 710fefb7-9a2d-41a2-b0b0-9d176a3d33d9 on n-h2-836830-18 Sep 14 08:54:15.145867 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-0f226bb7-960a-40ae-b9a4-db7e3bc939ce req-4ba3f6bd-2f0b-4902-a8fc-db34c6f7672d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125107 Sep 14 08:54:15.146961 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 753/1510] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:54:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:54:15.570041 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-cb96fd53-9275-4f54-a877-ae1658bd56be tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:54:15.570977 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-cb96fd53-9275-4f54-a877-ae1658bd56be tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] [instance: 710fefb7-9a2d-41a2-b0b0-9d176a3d33d9] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:54:15.593638 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cb96fd53-9275-4f54-a877-ae1658bd56be tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:15.595043 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cb96fd53-9275-4f54-a877-ae1658bd56be tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:15.595602 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cb96fd53-9275-4f54-a877-ae1658bd56be tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:15.599196 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cb96fd53-9275-4f54-a877-ae1658bd56be tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:15.599815 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cb96fd53-9275-4f54-a877-ae1658bd56be tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:15.600373 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cb96fd53-9275-4f54-a877-ae1658bd56be tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:15.681315 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cb96fd53-9275-4f54-a877-ae1658bd56be tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:15.683281 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cb96fd53-9275-4f54-a877-ae1658bd56be tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:15.685113 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cb96fd53-9275-4f54-a877-ae1658bd56be tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:15.687629 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.objects.instance [None req-cb96fd53-9275-4f54-a877-ae1658bd56be tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lazy-loading 'fault' on Instance uuid 710fefb7-9a2d-41a2-b0b0-9d176a3d33d9 {{(pid=128758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 08:54:15.866672 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-cb96fd53-9275-4f54-a877-ae1658bd56be tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ace9012a7c4ce59c01858b6984b766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a87a909133e42e1a82e3a623536935c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:54:15.877518 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-cb96fd53-9275-4f54-a877-ae1658bd56be tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] 10.222.0.60 "GET /compute/v2.1/servers/710fefb7-9a2d-41a2-b0b0-9d176a3d33d9" status: 200 len: 1315 microversion: 2.1 time: 0.318308 Sep 14 08:54:15.900087 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 758/1511] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:54:15 2022] GET /compute/v2.1/servers/710fefb7-9a2d-41a2-b0b0-9d176a3d33d9 => generated 1315 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:54:16.042150 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b337fca6-05a4-4cb9-b0c9-3ad2b1912755 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:54:16.043857 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b337fca6-05a4-4cb9-b0c9-3ad2b1912755 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: 1b2a9a93-cad5-4b18-abc3-1b88413f88da] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:54:16.068876 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b337fca6-05a4-4cb9-b0c9-3ad2b1912755 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:16.075102 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b337fca6-05a4-4cb9-b0c9-3ad2b1912755 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:16.075822 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b337fca6-05a4-4cb9-b0c9-3ad2b1912755 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:16.076757 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b337fca6-05a4-4cb9-b0c9-3ad2b1912755 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:16.077403 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b337fca6-05a4-4cb9-b0c9-3ad2b1912755 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:16.078011 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b337fca6-05a4-4cb9-b0c9-3ad2b1912755 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:16.126517 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-b337fca6-05a4-4cb9-b0c9-3ad2b1912755 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] HTTP exception thrown: Instance 1b2a9a93-cad5-4b18-abc3-1b88413f88da could not be found. Sep 14 08:54:16.129125 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b337fca6-05a4-4cb9-b0c9-3ad2b1912755 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Request method failure captured: Sep 14 08:54:16.129125 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/1b2a9a93-cad5-4b18-abc3-1b88413f88da HTTP/1.1 Sep 14 08:54:16.129125 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 08:54:16.129125 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 08:54:16.129125 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 08:54:16.129125 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 08:54:16.129125 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 08:54:16.129125 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 08:54:16.129125 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 08:54:16.129125 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 08:54:16.129125 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZVVByT_6-JGS6UV1gPynraxOMsYohkVqemIC6AxwdsIEVt3-ZlTQkPOCxPrHC_cjaYNAxgvgTIAX1mcOvoSIexNXMVze3EWvq2nR2PEgoxW6GhfqTZqbUa3ZV75Ae3Xam85qa2KosJ3BA0xkODZucsmvWQPOUvdvFL_EjszmdH9asc Sep 14 08:54:16.129125 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 08:54:16.129125 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 08:54:16.129125 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 08:54:16.129125 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 08:54:16.129125 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 08:54:16.129125 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 08:54:16.129125 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 8fd62edd611c4390be2403972b99aa15 Sep 14 08:54:16.129125 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-MigrationsAdminTest-1911476068 Sep 14 08:54:16.129125 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 08:54:16.129125 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 08:54:16.131044 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/8fd62edd611c4390be2403972b99aa15"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_8fd62edd611c4390be2403972b99aa15"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8fd62edd611c4390be2403972b99aa15"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8fd62edd611c4390be2403972b99aa15"}]}] Sep 14 08:54:16.131044 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-MigrationsAdminTest-1911476068 Sep 14 08:54:16.131044 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 8fd62edd611c4390be2403972b99aa15 Sep 14 08:54:16.131044 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-MigrationsAdminTest-1911476068 Sep 14 08:54:16.131044 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-MigrationsAdminTest-1911476068-project Sep 14 08:54:16.131044 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 08:54:16.131044 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 08:54:16.131044 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 264fb30236d54248ad0ecf79a177849f Sep 14 08:54:16.131044 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-MigrationsAdminTest-1911476068-project Sep 14 08:54:16.131044 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 08:54:16.131044 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance 1b2a9a93-cad5-4b18-abc3-1b88413f88da could not be found. Sep 14 08:54:16.131044 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '1b2a9a93-cad5-4b18-abc3-1b88413f88da'} Sep 14 08:54:16.132126 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:54:16.132126 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:54:16.132126 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 08:54:16.132126 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 08:54:16.132126 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 08:54:16.132126 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 08:54:16.132126 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 08:54:16.132126 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 08:54:16.132126 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 08:54:16.132126 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 08:54:16.132126 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b2a9a93-cad5-4b18-abc3-1b88413f88da could not be found. Sep 14 08:54:16.132126 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:54:16.132126 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:54:16.132126 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:54:16.132126 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:54:16.132126 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:54:16.132126 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:54:16.132126 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:54:16.132126 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:54:16.132126 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:54:16.133783 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:54:16.133783 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 08:54:16.133783 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 08:54:16.133783 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 08:54:16.133783 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 08:54:16.133783 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 08:54:16.133783 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 08:54:16.133783 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b2a9a93-cad5-4b18-abc3-1b88413f88da could not be found. Sep 14 08:54:16.133783 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:54:16.133783 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:54:16.133783 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:54:16.133783 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:54:16.133783 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:54:16.133783 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:54:16.133783 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:54:16.133783 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:54:16.133783 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b2a9a93-cad5-4b18-abc3-1b88413f88da could not be found. Sep 14 08:54:16.133783 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:54:16.136082 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b337fca6-05a4-4cb9-b0c9-3ad2b1912755 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Returning 404 to user: Instance 1b2a9a93-cad5-4b18-abc3-1b88413f88da could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:54:16.137135 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b337fca6-05a4-4cb9-b0c9-3ad2b1912755 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/1b2a9a93-cad5-4b18-abc3-1b88413f88da" status: 404 len: 111 microversion: 2.1 time: 0.100510 Sep 14 08:54:16.138223 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 754/1512] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:54:16 2022] GET /compute/v2.1/servers/1b2a9a93-cad5-4b18-abc3-1b88413f88da => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 08:54:16.149976 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ac29dd83-2937-4c0a-a45f-2586c1efab54 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:54:16.154748 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-89430da0-3c0e-478e-8cd1-7c6d18d0c782 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:54:16.155205 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-ac29dd83-2937-4c0a-a45f-2586c1efab54 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: af183467-9304-4c73-a29f-196e76ba21b5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:54:16.159916 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-89430da0-3c0e-478e-8cd1-7c6d18d0c782 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: 8fce8438-d6ae-408d-8b4f-ee14d4021fdd] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:54:16.176753 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ac29dd83-2937-4c0a-a45f-2586c1efab54 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:16.178424 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-89430da0-3c0e-478e-8cd1-7c6d18d0c782 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:16.178967 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ac29dd83-2937-4c0a-a45f-2586c1efab54 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:16.179553 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ac29dd83-2937-4c0a-a45f-2586c1efab54 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:16.183300 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ac29dd83-2937-4c0a-a45f-2586c1efab54 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:16.184044 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-89430da0-3c0e-478e-8cd1-7c6d18d0c782 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:16.187739 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ac29dd83-2937-4c0a-a45f-2586c1efab54 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:16.187739 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ac29dd83-2937-4c0a-a45f-2586c1efab54 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:16.188407 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-89430da0-3c0e-478e-8cd1-7c6d18d0c782 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:16.188765 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-89430da0-3c0e-478e-8cd1-7c6d18d0c782 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:16.192608 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-89430da0-3c0e-478e-8cd1-7c6d18d0c782 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:16.193441 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-89430da0-3c0e-478e-8cd1-7c6d18d0c782 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:16.272302 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-ac29dd83-2937-4c0a-a45f-2586c1efab54 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: af183467-9304-4c73-a29f-196e76ba21b5] Going to try to terminate instance {{(pid=128758) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 08:54:16.348805 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:54:16.400491 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-ac29dd83-2937-4c0a-a45f-2586c1efab54 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "DELETE /compute/v2.1/servers/af183467-9304-4c73-a29f-196e76ba21b5" status: 204 len: 0 microversion: 2.1 time: 0.255198 Sep 14 08:54:16.401886 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 759/1513] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 08:54:16 2022] DELETE /compute/v2.1/servers/af183467-9304-4c73-a29f-196e76ba21b5 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 08:54:16.414107 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d5223259-939d-4343-a462-d784f051e991 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:54:16.415398 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-d5223259-939d-4343-a462-d784f051e991 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: af183467-9304-4c73-a29f-196e76ba21b5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:54:16.423293 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d5223259-939d-4343-a462-d784f051e991 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:16.425256 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d5223259-939d-4343-a462-d784f051e991 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:16.426020 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d5223259-939d-4343-a462-d784f051e991 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:16.427121 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d5223259-939d-4343-a462-d784f051e991 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:16.427847 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d5223259-939d-4343-a462-d784f051e991 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:16.428882 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d5223259-939d-4343-a462-d784f051e991 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:16.479326 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=2 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:54:16.606265 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-89430da0-3c0e-478e-8cd1-7c6d18d0c782 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:54:16.619809 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-89430da0-3c0e-478e-8cd1-7c6d18d0c782 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:54:16.621853 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-89430da0-3c0e-478e-8cd1-7c6d18d0c782 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:54:16.623943 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-89430da0-3c0e-478e-8cd1-7c6d18d0c782 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd" status: 200 len: 1815 microversion: 2.25 time: 0.475899 Sep 14 08:54:16.640949 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 755/1514] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:54:16 2022] GET /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd => generated 1815 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:54:16.808550 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-d5223259-939d-4343-a462-d784f051e991 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:54:16.853709 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-d5223259-939d-4343-a462-d784f051e991 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/af183467-9304-4c73-a29f-196e76ba21b5" status: 200 len: 1533 microversion: 2.1 time: 0.445201 Sep 14 08:54:16.858267 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 760/1515] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:54:16 2022] GET /compute/v2.1/servers/af183467-9304-4c73-a29f-196e76ba21b5 => generated 1533 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:54:16.915927 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-521ed5eb-ebe1-4940-82e1-bd156478a8e1 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:54:16.916717 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-521ed5eb-ebe1-4940-82e1-bd156478a8e1 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] [instance: 710fefb7-9a2d-41a2-b0b0-9d176a3d33d9] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:54:16.925542 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-521ed5eb-ebe1-4940-82e1-bd156478a8e1 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:16.926450 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-521ed5eb-ebe1-4940-82e1-bd156478a8e1 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:16.927154 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-521ed5eb-ebe1-4940-82e1-bd156478a8e1 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:16.928267 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-521ed5eb-ebe1-4940-82e1-bd156478a8e1 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:16.929534 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-521ed5eb-ebe1-4940-82e1-bd156478a8e1 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:16.930432 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-521ed5eb-ebe1-4940-82e1-bd156478a8e1 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:16.955033 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-521ed5eb-ebe1-4940-82e1-bd156478a8e1 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] HTTP exception thrown: Instance 710fefb7-9a2d-41a2-b0b0-9d176a3d33d9 could not be found. Sep 14 08:54:16.960921 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-521ed5eb-ebe1-4940-82e1-bd156478a8e1 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Request method failure captured: Sep 14 08:54:16.960921 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/710fefb7-9a2d-41a2-b0b0-9d176a3d33d9 HTTP/1.1 Sep 14 08:54:16.960921 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 08:54:16.960921 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 08:54:16.960921 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 08:54:16.960921 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 08:54:16.960921 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 08:54:16.960921 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 08:54:16.960921 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 08:54:16.960921 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 08:54:16.960921 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZZS4Po83Aovv_U3RdkjXLQKweaQf-fhAgT61i_A11uamuOl6sYuSjebIurWFthtZrzpGvY9uLyOeI1i9q8ClJm3kMoDWgYaqbwGjdZ-I8VmC2NF95wjpQldZSAgTTLlPF11CuzqbhW26YYuwljJxckz8_fE9N_t89yQzibByeeP394 Sep 14 08:54:16.960921 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 08:54:16.960921 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 08:54:16.960921 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 08:54:16.960921 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 08:54:16.960921 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 08:54:16.960921 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 08:54:16.960921 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 0a87a909133e42e1a82e3a623536935c Sep 14 08:54:16.960921 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1646226177 Sep 14 08:54:16.960921 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 08:54:16.960921 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 08:54:16.962781 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0a87a909133e42e1a82e3a623536935c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0a87a909133e42e1a82e3a623536935c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0a87a909133e42e1a82e3a623536935c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0a87a909133e42e1a82e3a623536935c"}]}] Sep 14 08:54:16.962781 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1646226177 Sep 14 08:54:16.962781 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 0a87a909133e42e1a82e3a623536935c Sep 14 08:54:16.962781 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1646226177 Sep 14 08:54:16.962781 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ImagesOneServerNegativeTestJSON-1646226177-project Sep 14 08:54:16.962781 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 08:54:16.962781 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 08:54:16.962781 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: a3ace9012a7c4ce59c01858b6984b766 Sep 14 08:54:16.962781 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1646226177-project Sep 14 08:54:16.962781 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 08:54:16.962781 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance 710fefb7-9a2d-41a2-b0b0-9d176a3d33d9 could not be found. Sep 14 08:54:16.962781 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '710fefb7-9a2d-41a2-b0b0-9d176a3d33d9'} Sep 14 08:54:16.963831 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:54:16.963831 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:54:16.963831 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 08:54:16.963831 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 08:54:16.963831 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 08:54:16.963831 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 08:54:16.963831 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 08:54:16.963831 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 08:54:16.963831 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 08:54:16.963831 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 08:54:16.963831 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 710fefb7-9a2d-41a2-b0b0-9d176a3d33d9 could not be found. Sep 14 08:54:16.963831 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:54:16.963831 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:54:16.963831 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:54:16.963831 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:54:16.963831 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:54:16.963831 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:54:16.963831 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:54:16.963831 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:54:16.963831 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:54:16.965463 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:54:16.965463 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 08:54:16.965463 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 08:54:16.965463 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 08:54:16.965463 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 08:54:16.965463 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 08:54:16.965463 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 08:54:16.965463 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 710fefb7-9a2d-41a2-b0b0-9d176a3d33d9 could not be found. Sep 14 08:54:16.965463 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:54:16.965463 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:54:16.965463 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:54:16.965463 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:54:16.965463 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:54:16.965463 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:54:16.965463 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:54:16.965463 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:54:16.965463 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 710fefb7-9a2d-41a2-b0b0-9d176a3d33d9 could not be found. Sep 14 08:54:16.965463 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:54:16.967870 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-521ed5eb-ebe1-4940-82e1-bd156478a8e1 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Returning 404 to user: Instance 710fefb7-9a2d-41a2-b0b0-9d176a3d33d9 could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:54:16.968927 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-521ed5eb-ebe1-4940-82e1-bd156478a8e1 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] 10.222.0.60 "GET /compute/v2.1/servers/710fefb7-9a2d-41a2-b0b0-9d176a3d33d9" status: 404 len: 111 microversion: 2.1 time: 0.059694 Sep 14 08:54:16.975105 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 756/1516] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:54:16 2022] GET /compute/v2.1/servers/710fefb7-9a2d-41a2-b0b0-9d176a3d33d9 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 08:54:16.979482 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a9d3d6e6-f639-4e32-8cb5-5fb10dfa2776 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Calling method '.version_select at 0x7f7d443f21f0>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:54:17.048190 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-a9d3d6e6-f639-4e32-8cb5-5fb10dfa2776 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] HTTP exception thrown: Image not found. Sep 14 08:54:17.053409 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a9d3d6e6-f639-4e32-8cb5-5fb10dfa2776 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Request method failure captured: Sep 14 08:54:17.053409 n-d-836830-18 devstack@n-api.service[128758]: request: DELETE /compute/v2.1/images/b70a0f47-ac87-44f7-9270-1a7a2cbb5965 HTTP/1.1 Sep 14 08:54:17.053409 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 08:54:17.053409 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 08:54:17.053409 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 08:54:17.053409 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 08:54:17.053409 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 08:54:17.053409 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 08:54:17.053409 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 08:54:17.053409 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 08:54:17.053409 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZZS4Po83Aovv_U3RdkjXLQKweaQf-fhAgT61i_A11uamuOl6sYuSjebIurWFthtZrzpGvY9uLyOeI1i9q8ClJm3kMoDWgYaqbwGjdZ-I8VmC2NF95wjpQldZSAgTTLlPF11CuzqbhW26YYuwljJxckz8_fE9N_t89yQzibByeeP394 Sep 14 08:54:17.053409 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 08:54:17.053409 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 08:54:17.053409 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 08:54:17.053409 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 08:54:17.053409 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 08:54:17.053409 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 08:54:17.053409 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 0a87a909133e42e1a82e3a623536935c Sep 14 08:54:17.053409 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1646226177 Sep 14 08:54:17.053409 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 08:54:17.053409 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 08:54:17.055550 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0a87a909133e42e1a82e3a623536935c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0a87a909133e42e1a82e3a623536935c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0a87a909133e42e1a82e3a623536935c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0a87a909133e42e1a82e3a623536935c"}]}] Sep 14 08:54:17.055550 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1646226177 Sep 14 08:54:17.055550 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 0a87a909133e42e1a82e3a623536935c Sep 14 08:54:17.055550 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1646226177 Sep 14 08:54:17.055550 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-ImagesOneServerNegativeTestJSON-1646226177-project Sep 14 08:54:17.055550 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 08:54:17.055550 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 08:54:17.055550 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: a3ace9012a7c4ce59c01858b6984b766 Sep 14 08:54:17.055550 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1646226177-project Sep 14 08:54:17.055550 n-d-836830-18 devstack@n-api.service[128758]: method: Sep 14 08:54:17.055550 n-d-836830-18 devstack@n-api.service[128758]: exception: Image not found. Sep 14 08:54:17.055550 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': 'b70a0f47-ac87-44f7-9270-1a7a2cbb5965'} Sep 14 08:54:17.055550 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:54:17.057306 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:54:17.057306 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 14 08:54:17.057306 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 14 08:54:17.057306 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 14 08:54:17.057306 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 14 08:54:17.057306 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 14 08:54:17.057306 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 14 08:54:17.057306 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 14 08:54:17.057306 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 14 08:54:17.057306 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 14 08:54:17.057306 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 14 08:54:17.057306 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 14 08:54:17.057306 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 14 08:54:17.057306 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 14 08:54:17.057306 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 14 08:54:17.057306 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image b70a0f47-ac87-44f7-9270-1a7a2cbb5965 to delete Sep 14 08:54:17.057306 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:54:17.057306 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:54:17.057306 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:54:17.058969 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:54:17.058969 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 14 08:54:17.058969 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 14 08:54:17.058969 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 14 08:54:17.058969 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 14 08:54:17.058969 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 14 08:54:17.058969 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 14 08:54:17.058969 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image b70a0f47-ac87-44f7-9270-1a7a2cbb5965 could not be found. Sep 14 08:54:17.058969 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:54:17.058969 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:54:17.058969 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:54:17.058969 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:54:17.058969 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:54:17.058969 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:54:17.058969 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:54:17.058969 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:54:17.058969 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 08:54:17.058969 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 08:54:17.058969 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:54:17.058969 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:54:17.060596 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 14 08:54:17.060596 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 14 08:54:17.060596 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 14 08:54:17.060596 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:54:17.060596 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:54:17.060596 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:54:17.060596 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:54:17.060596 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:54:17.060596 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:54:17.060596 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:54:17.060596 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:54:17.060596 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 14 08:54:17.060596 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:54:17.060596 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a9d3d6e6-f639-4e32-8cb5-5fb10dfa2776 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Returning 404 to user: Image not found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:54:17.066334 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-a9d3d6e6-f639-4e32-8cb5-5fb10dfa2776 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] 10.222.0.60 "DELETE /compute/v2.1/images/b70a0f47-ac87-44f7-9270-1a7a2cbb5965" status: 404 len: 62 microversion: 2.1 time: 0.085963 Sep 14 08:54:17.066334 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 761/1517] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:54:16 2022] DELETE /compute/v2.1/images/b70a0f47-ac87-44f7-9270-1a7a2cbb5965 => generated 62 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 14 08:54:17.072356 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-5e1ff477-09a0-46f5-9a8d-dddc948b1d47 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:54:17.072858 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-5e1ff477-09a0-46f5-9a8d-dddc948b1d47 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] [instance: feeb311c-8462-4539-bbc8-4120559413cb] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:54:17.089555 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5e1ff477-09a0-46f5-9a8d-dddc948b1d47 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:17.089960 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5e1ff477-09a0-46f5-9a8d-dddc948b1d47 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:17.090950 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5e1ff477-09a0-46f5-9a8d-dddc948b1d47 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:17.098172 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5e1ff477-09a0-46f5-9a8d-dddc948b1d47 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:17.099917 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5e1ff477-09a0-46f5-9a8d-dddc948b1d47 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:17.100294 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5e1ff477-09a0-46f5-9a8d-dddc948b1d47 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:17.139734 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-5e1ff477-09a0-46f5-9a8d-dddc948b1d47 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] HTTP exception thrown: Instance feeb311c-8462-4539-bbc8-4120559413cb could not be found. Sep 14 08:54:17.141982 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-5e1ff477-09a0-46f5-9a8d-dddc948b1d47 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Request method failure captured: Sep 14 08:54:17.141982 n-d-836830-18 devstack@n-api.service[128759]: request: DELETE /compute/v2.1/servers/feeb311c-8462-4539-bbc8-4120559413cb HTTP/1.1 Sep 14 08:54:17.141982 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 08:54:17.141982 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 08:54:17.141982 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 08:54:17.141982 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 08:54:17.141982 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 08:54:17.141982 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 08:54:17.141982 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 08:54:17.141982 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 08:54:17.141982 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZZS4Po83Aovv_U3RdkjXLQKweaQf-fhAgT61i_A11uamuOl6sYuSjebIurWFthtZrzpGvY9uLyOeI1i9q8ClJm3kMoDWgYaqbwGjdZ-I8VmC2NF95wjpQldZSAgTTLlPF11CuzqbhW26YYuwljJxckz8_fE9N_t89yQzibByeeP394 Sep 14 08:54:17.141982 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 08:54:17.141982 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 08:54:17.141982 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 08:54:17.141982 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 08:54:17.141982 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 08:54:17.141982 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 08:54:17.141982 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 0a87a909133e42e1a82e3a623536935c Sep 14 08:54:17.141982 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1646226177 Sep 14 08:54:17.141982 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 08:54:17.141982 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 08:54:17.145593 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0a87a909133e42e1a82e3a623536935c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0a87a909133e42e1a82e3a623536935c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0a87a909133e42e1a82e3a623536935c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0a87a909133e42e1a82e3a623536935c"}]}] Sep 14 08:54:17.145593 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1646226177 Sep 14 08:54:17.145593 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 0a87a909133e42e1a82e3a623536935c Sep 14 08:54:17.145593 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1646226177 Sep 14 08:54:17.145593 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ImagesOneServerNegativeTestJSON-1646226177-project Sep 14 08:54:17.145593 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 08:54:17.145593 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 08:54:17.145593 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: a3ace9012a7c4ce59c01858b6984b766 Sep 14 08:54:17.145593 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1646226177-project Sep 14 08:54:17.145593 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 08:54:17.145593 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance feeb311c-8462-4539-bbc8-4120559413cb could not be found. Sep 14 08:54:17.145593 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': 'feeb311c-8462-4539-bbc8-4120559413cb'} Sep 14 08:54:17.147621 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:54:17.147621 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:54:17.147621 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 08:54:17.147621 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 08:54:17.147621 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 08:54:17.147621 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 08:54:17.147621 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 08:54:17.147621 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 08:54:17.147621 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 08:54:17.147621 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 08:54:17.147621 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance feeb311c-8462-4539-bbc8-4120559413cb could not be found. Sep 14 08:54:17.147621 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:54:17.147621 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:54:17.147621 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:54:17.147621 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:54:17.147621 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:54:17.147621 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:54:17.147621 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:54:17.147621 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:54:17.147621 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:54:17.151356 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:54:17.151356 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 08:54:17.151356 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 08:54:17.151356 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 08:54:17.151356 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 08:54:17.151356 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 08:54:17.151356 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 08:54:17.151356 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 08:54:17.151356 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 08:54:17.151356 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance feeb311c-8462-4539-bbc8-4120559413cb could not be found. Sep 14 08:54:17.151356 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:54:17.151356 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:54:17.151356 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:54:17.151356 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:54:17.151356 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:54:17.151356 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:54:17.151356 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:54:17.151356 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:54:17.151356 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance feeb311c-8462-4539-bbc8-4120559413cb could not be found. Sep 14 08:54:17.151356 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:54:17.155603 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-5e1ff477-09a0-46f5-9a8d-dddc948b1d47 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Returning 404 to user: Instance feeb311c-8462-4539-bbc8-4120559413cb could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:54:17.155603 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-5e1ff477-09a0-46f5-9a8d-dddc948b1d47 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] 10.222.0.60 "DELETE /compute/v2.1/servers/feeb311c-8462-4539-bbc8-4120559413cb" status: 404 len: 111 microversion: 2.1 time: 0.077438 Sep 14 08:54:17.155603 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 757/1518] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 08:54:17 2022] DELETE /compute/v2.1/servers/feeb311c-8462-4539-bbc8-4120559413cb => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 08:54:17.156775 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-8da0f29b-eb66-43af-b0c8-334c998d8498 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:54:17.157349 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-8da0f29b-eb66-43af-b0c8-334c998d8498 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] [instance: feeb311c-8462-4539-bbc8-4120559413cb] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:54:17.170749 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8da0f29b-eb66-43af-b0c8-334c998d8498 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:17.170749 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8da0f29b-eb66-43af-b0c8-334c998d8498 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:17.170749 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8da0f29b-eb66-43af-b0c8-334c998d8498 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:17.174633 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8da0f29b-eb66-43af-b0c8-334c998d8498 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:17.175347 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8da0f29b-eb66-43af-b0c8-334c998d8498 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:17.176564 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8da0f29b-eb66-43af-b0c8-334c998d8498 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:17.232614 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-8da0f29b-eb66-43af-b0c8-334c998d8498 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] HTTP exception thrown: Instance feeb311c-8462-4539-bbc8-4120559413cb could not be found. Sep 14 08:54:17.236642 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-8da0f29b-eb66-43af-b0c8-334c998d8498 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Request method failure captured: Sep 14 08:54:17.236642 n-d-836830-18 devstack@n-api.service[128758]: request: GET /compute/v2.1/servers/feeb311c-8462-4539-bbc8-4120559413cb HTTP/1.1 Sep 14 08:54:17.236642 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 08:54:17.236642 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 08:54:17.236642 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 08:54:17.236642 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 08:54:17.236642 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 08:54:17.236642 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 08:54:17.236642 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 08:54:17.236642 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 08:54:17.236642 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZZS4Po83Aovv_U3RdkjXLQKweaQf-fhAgT61i_A11uamuOl6sYuSjebIurWFthtZrzpGvY9uLyOeI1i9q8ClJm3kMoDWgYaqbwGjdZ-I8VmC2NF95wjpQldZSAgTTLlPF11CuzqbhW26YYuwljJxckz8_fE9N_t89yQzibByeeP394 Sep 14 08:54:17.236642 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 08:54:17.236642 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 08:54:17.236642 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 08:54:17.236642 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 08:54:17.236642 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 08:54:17.236642 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 08:54:17.236642 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 0a87a909133e42e1a82e3a623536935c Sep 14 08:54:17.236642 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1646226177 Sep 14 08:54:17.236642 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 08:54:17.236642 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 08:54:17.238612 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0a87a909133e42e1a82e3a623536935c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0a87a909133e42e1a82e3a623536935c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0a87a909133e42e1a82e3a623536935c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0a87a909133e42e1a82e3a623536935c"}]}] Sep 14 08:54:17.238612 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1646226177 Sep 14 08:54:17.238612 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 0a87a909133e42e1a82e3a623536935c Sep 14 08:54:17.238612 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1646226177 Sep 14 08:54:17.238612 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-ImagesOneServerNegativeTestJSON-1646226177-project Sep 14 08:54:17.238612 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 08:54:17.238612 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 08:54:17.238612 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: a3ace9012a7c4ce59c01858b6984b766 Sep 14 08:54:17.238612 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1646226177-project Sep 14 08:54:17.238612 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 08:54:17.238612 n-d-836830-18 devstack@n-api.service[128758]: exception: Instance feeb311c-8462-4539-bbc8-4120559413cb could not be found. Sep 14 08:54:17.238612 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': 'feeb311c-8462-4539-bbc8-4120559413cb'} Sep 14 08:54:17.239775 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:54:17.239775 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:54:17.239775 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 08:54:17.239775 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 08:54:17.239775 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 08:54:17.239775 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 08:54:17.239775 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 08:54:17.239775 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 08:54:17.239775 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 08:54:17.239775 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 08:54:17.239775 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance feeb311c-8462-4539-bbc8-4120559413cb could not be found. Sep 14 08:54:17.239775 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:54:17.239775 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:54:17.239775 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:54:17.239775 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:54:17.239775 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:54:17.239775 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:54:17.239775 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:54:17.239775 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:54:17.239775 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:54:17.241414 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:54:17.241414 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 08:54:17.241414 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 08:54:17.241414 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 08:54:17.241414 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 08:54:17.241414 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 08:54:17.241414 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 08:54:17.241414 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance feeb311c-8462-4539-bbc8-4120559413cb could not be found. Sep 14 08:54:17.241414 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:54:17.241414 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:54:17.241414 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:54:17.241414 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:54:17.241414 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:54:17.241414 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:54:17.241414 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:54:17.241414 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:54:17.241414 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance feeb311c-8462-4539-bbc8-4120559413cb could not be found. Sep 14 08:54:17.241414 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:54:17.245255 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-8da0f29b-eb66-43af-b0c8-334c998d8498 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Returning 404 to user: Instance feeb311c-8462-4539-bbc8-4120559413cb could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:54:17.248155 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-8da0f29b-eb66-43af-b0c8-334c998d8498 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] 10.222.0.60 "GET /compute/v2.1/servers/feeb311c-8462-4539-bbc8-4120559413cb" status: 404 len: 111 microversion: 2.1 time: 0.095895 Sep 14 08:54:17.251643 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 762/1519] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:54:17 2022] GET /compute/v2.1/servers/feeb311c-8462-4539-bbc8-4120559413cb => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 08:54:17.260212 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d1cdc80e-b7cb-41e1-8107-35905fd7a914 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Calling method '.version_select at 0x7f7d441a45e0>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:54:17.296891 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d1cdc80e-b7cb-41e1-8107-35905fd7a914 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1365607731" status: 202 len: 0 microversion: 2.1 time: 0.040851 Sep 14 08:54:17.302071 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 758/1520] 10.222.0.60 () {58 vars in 1221 bytes} [Wed Sep 14 08:54:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1365607731 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 08:54:17.658349 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d86ef88a-b152-4743-a143-11e2344c5363 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:54:17.659553 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-d86ef88a-b152-4743-a143-11e2344c5363 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: 8fce8438-d6ae-408d-8b4f-ee14d4021fdd] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:54:17.678977 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d86ef88a-b152-4743-a143-11e2344c5363 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:17.679539 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d86ef88a-b152-4743-a143-11e2344c5363 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:17.680276 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d86ef88a-b152-4743-a143-11e2344c5363 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:17.681016 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d86ef88a-b152-4743-a143-11e2344c5363 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:17.681474 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d86ef88a-b152-4743-a143-11e2344c5363 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:17.681901 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d86ef88a-b152-4743-a143-11e2344c5363 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:17.882097 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-6e28262d-5c11-4115-82a0-2cab64ffb485 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:54:17.882732 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-6e28262d-5c11-4115-82a0-2cab64ffb485 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: af183467-9304-4c73-a29f-196e76ba21b5] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:54:17.901033 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6e28262d-5c11-4115-82a0-2cab64ffb485 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:17.901544 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6e28262d-5c11-4115-82a0-2cab64ffb485 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:17.901989 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6e28262d-5c11-4115-82a0-2cab64ffb485 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:17.902709 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6e28262d-5c11-4115-82a0-2cab64ffb485 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:17.903201 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6e28262d-5c11-4115-82a0-2cab64ffb485 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:17.903632 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6e28262d-5c11-4115-82a0-2cab64ffb485 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:18.147903 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-d86ef88a-b152-4743-a143-11e2344c5363 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:54:18.161427 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-d86ef88a-b152-4743-a143-11e2344c5363 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:54:18.163681 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-d86ef88a-b152-4743-a143-11e2344c5363 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:54:18.166964 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-d86ef88a-b152-4743-a143-11e2344c5363 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd" status: 200 len: 1815 microversion: 2.25 time: 0.512819 Sep 14 08:54:18.183582 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 763/1521] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:54:17 2022] GET /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd => generated 1815 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:54:18.383597 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-6e28262d-5c11-4115-82a0-2cab64ffb485 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:54:18.397344 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-6e28262d-5c11-4115-82a0-2cab64ffb485 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/af183467-9304-4c73-a29f-196e76ba21b5" status: 200 len: 1533 microversion: 2.1 time: 0.518160 Sep 14 08:54:18.400352 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 759/1522] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:54:17 2022] GET /compute/v2.1/servers/af183467-9304-4c73-a29f-196e76ba21b5 => generated 1533 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:54:19.195159 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-468ef21b-f485-4726-81e8-c0cc43660d92 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:54:19.196410 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-468ef21b-f485-4726-81e8-c0cc43660d92 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: 8fce8438-d6ae-408d-8b4f-ee14d4021fdd] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:54:19.214121 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-468ef21b-f485-4726-81e8-c0cc43660d92 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:19.216981 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-468ef21b-f485-4726-81e8-c0cc43660d92 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:19.217815 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-468ef21b-f485-4726-81e8-c0cc43660d92 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:19.221294 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-468ef21b-f485-4726-81e8-c0cc43660d92 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:19.222033 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-468ef21b-f485-4726-81e8-c0cc43660d92 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:19.222709 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-468ef21b-f485-4726-81e8-c0cc43660d92 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:19.435039 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-6658cb3d-f941-492e-abd2-8547e05d3c50 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:54:19.438666 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-6658cb3d-f941-492e-abd2-8547e05d3c50 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: af183467-9304-4c73-a29f-196e76ba21b5] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:54:19.460162 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6658cb3d-f941-492e-abd2-8547e05d3c50 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:19.462571 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6658cb3d-f941-492e-abd2-8547e05d3c50 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:19.464902 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6658cb3d-f941-492e-abd2-8547e05d3c50 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:19.467715 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6658cb3d-f941-492e-abd2-8547e05d3c50 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:19.468299 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6658cb3d-f941-492e-abd2-8547e05d3c50 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:19.468656 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6658cb3d-f941-492e-abd2-8547e05d3c50 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:19.837997 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-468ef21b-f485-4726-81e8-c0cc43660d92 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:54:19.869285 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-468ef21b-f485-4726-81e8-c0cc43660d92 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:54:19.879542 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-468ef21b-f485-4726-81e8-c0cc43660d92 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:54:19.882420 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-468ef21b-f485-4726-81e8-c0cc43660d92 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd" status: 200 len: 1805 microversion: 2.25 time: 0.692493 Sep 14 08:54:19.905992 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 764/1523] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:54:19 2022] GET /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd => generated 1805 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:54:19.911430 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-464c3a65-1d30-465b-b491-3bea9c2f5866 tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Calling method '.version_select at 0x7f7d44418790>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:54:19.932266 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-464c3a65-1d30-465b-b491-3bea9c2f5866 tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:19.946443 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-464c3a65-1d30-465b-b491-3bea9c2f5866 tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:19.947494 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-464c3a65-1d30-465b-b491-3bea9c2f5866 tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:19.983672 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-464c3a65-1d30-465b-b491-3bea9c2f5866 tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] 10.222.0.60 "GET /compute/v2.1/os-migrations" status: 200 len: 3657 microversion: 2.25 time: 0.075827 Sep 14 08:54:20.000150 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 765/1524] 10.222.0.60 () {60 vars in 1184 bytes} [Wed Sep 14 08:54:19 2022] GET /compute/v2.1/os-migrations => generated 3657 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:54:20.017894 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-98fd39b2-ac38-430f-90ac-d86feb144886 tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:54:20.021450 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-98fd39b2-ac38-430f-90ac-d86feb144886 tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] [instance: 8fce8438-d6ae-408d-8b4f-ee14d4021fdd] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:54:20.041147 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-98fd39b2-ac38-430f-90ac-d86feb144886 tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:20.042617 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-98fd39b2-ac38-430f-90ac-d86feb144886 tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:20.043844 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-98fd39b2-ac38-430f-90ac-d86feb144886 tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:20.046551 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-98fd39b2-ac38-430f-90ac-d86feb144886 tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:20.047541 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-98fd39b2-ac38-430f-90ac-d86feb144886 tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:20.049902 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-98fd39b2-ac38-430f-90ac-d86feb144886 tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:20.630422 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.objects.instance [None req-98fd39b2-ac38-430f-90ac-d86feb144886 tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Lazy-loading 'services' on Instance uuid 8fce8438-d6ae-408d-8b4f-ee14d4021fdd {{(pid=128758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 08:54:20.663756 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-98fd39b2-ac38-430f-90ac-d86feb144886 tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd" status: 200 len: 2426 microversion: 2.25 time: 0.650687 Sep 14 08:54:20.665622 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 766/1525] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:54:20 2022] GET /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd => generated 2426 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 08:54:20.682550 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-6658cb3d-f941-492e-abd2-8547e05d3c50 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:54:20.697427 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-250a15b7-8986-4d0a-b46c-b3cbc734909d tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:54:20.697979 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-250a15b7-8986-4d0a-b46c-b3cbc734909d tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] [instance: 8fce8438-d6ae-408d-8b4f-ee14d4021fdd] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:54:20.699089 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-6658cb3d-f941-492e-abd2-8547e05d3c50 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/af183467-9304-4c73-a29f-196e76ba21b5" status: 200 len: 1533 microversion: 2.1 time: 1.282156 Sep 14 08:54:20.703382 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 760/1526] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:54:19 2022] GET /compute/v2.1/servers/af183467-9304-4c73-a29f-196e76ba21b5 => generated 1533 bytes in 1287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:54:20.724570 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-250a15b7-8986-4d0a-b46c-b3cbc734909d tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:20.724934 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-250a15b7-8986-4d0a-b46c-b3cbc734909d tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:20.728065 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-250a15b7-8986-4d0a-b46c-b3cbc734909d tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:20.731561 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-250a15b7-8986-4d0a-b46c-b3cbc734909d tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:20.732063 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-250a15b7-8986-4d0a-b46c-b3cbc734909d tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:20.732518 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-250a15b7-8986-4d0a-b46c-b3cbc734909d tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:21.281835 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.objects.instance [None req-250a15b7-8986-4d0a-b46c-b3cbc734909d tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Lazy-loading 'services' on Instance uuid 8fce8438-d6ae-408d-8b4f-ee14d4021fdd {{(pid=128758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 08:54:21.317157 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-250a15b7-8986-4d0a-b46c-b3cbc734909d tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd" status: 200 len: 2426 microversion: 2.25 time: 0.625497 Sep 14 08:54:21.325910 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 767/1527] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:54:20 2022] GET /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd => generated 2426 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 08:54:21.363900 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-1c12d264-94ca-42e6-ac47-fbe8c59e4479 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Calling method '.version_select at 0x7f7d441c41f0>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:54:21.432118 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-1c12d264-94ca-42e6-ac47-fbe8c59e4479 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] HTTP exception thrown: Image not found. Sep 14 08:54:21.436210 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-1c12d264-94ca-42e6-ac47-fbe8c59e4479 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Request method failure captured: Sep 14 08:54:21.436210 n-d-836830-18 devstack@n-api.service[128759]: request: DELETE /compute/v2.1/images/7aaf5b60-fd48-45cd-9151-f90bc39f616b HTTP/1.1 Sep 14 08:54:21.436210 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 08:54:21.436210 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 08:54:21.436210 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 08:54:21.436210 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 08:54:21.436210 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 08:54:21.436210 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 08:54:21.436210 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 08:54:21.436210 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 08:54:21.436210 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZZS4Po83Aovv_U3RdkjXLQKweaQf-fhAgT61i_A11uamuOl6sYuSjebIurWFthtZrzpGvY9uLyOeI1i9q8ClJm3kMoDWgYaqbwGjdZ-I8VmC2NF95wjpQldZSAgTTLlPF11CuzqbhW26YYuwljJxckz8_fE9N_t89yQzibByeeP394 Sep 14 08:54:21.436210 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 08:54:21.436210 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 08:54:21.436210 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 08:54:21.436210 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 08:54:21.436210 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 08:54:21.436210 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 08:54:21.436210 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 0a87a909133e42e1a82e3a623536935c Sep 14 08:54:21.436210 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1646226177 Sep 14 08:54:21.436210 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 08:54:21.436210 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 08:54:21.438076 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0a87a909133e42e1a82e3a623536935c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0a87a909133e42e1a82e3a623536935c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0a87a909133e42e1a82e3a623536935c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0a87a909133e42e1a82e3a623536935c"}]}] Sep 14 08:54:21.438076 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1646226177 Sep 14 08:54:21.438076 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 0a87a909133e42e1a82e3a623536935c Sep 14 08:54:21.438076 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1646226177 Sep 14 08:54:21.438076 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ImagesOneServerNegativeTestJSON-1646226177-project Sep 14 08:54:21.438076 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 08:54:21.438076 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 08:54:21.438076 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: a3ace9012a7c4ce59c01858b6984b766 Sep 14 08:54:21.438076 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1646226177-project Sep 14 08:54:21.438076 n-d-836830-18 devstack@n-api.service[128759]: method: Sep 14 08:54:21.438076 n-d-836830-18 devstack@n-api.service[128759]: exception: Image not found. Sep 14 08:54:21.438076 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '7aaf5b60-fd48-45cd-9151-f90bc39f616b'} Sep 14 08:54:21.438076 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:54:21.439252 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:54:21.439252 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 14 08:54:21.439252 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 14 08:54:21.439252 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 14 08:54:21.439252 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 14 08:54:21.439252 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 14 08:54:21.439252 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 14 08:54:21.439252 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 14 08:54:21.439252 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 14 08:54:21.439252 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 14 08:54:21.439252 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 14 08:54:21.439252 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 14 08:54:21.439252 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 14 08:54:21.439252 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 14 08:54:21.439252 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 14 08:54:21.439252 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 7aaf5b60-fd48-45cd-9151-f90bc39f616b to delete Sep 14 08:54:21.439252 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:54:21.439252 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:54:21.439252 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:54:21.441512 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:54:21.441512 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 14 08:54:21.441512 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 14 08:54:21.441512 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 14 08:54:21.441512 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 14 08:54:21.441512 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 14 08:54:21.441512 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 14 08:54:21.441512 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 7aaf5b60-fd48-45cd-9151-f90bc39f616b could not be found. Sep 14 08:54:21.441512 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:54:21.441512 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:54:21.441512 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:54:21.441512 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:54:21.441512 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:54:21.441512 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:54:21.441512 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:54:21.441512 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:54:21.441512 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 08:54:21.441512 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 08:54:21.441512 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:54:21.441512 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:54:21.443275 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 14 08:54:21.443275 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 14 08:54:21.443275 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 14 08:54:21.443275 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:54:21.443275 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:54:21.443275 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:54:21.443275 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:54:21.443275 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:54:21.443275 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:54:21.443275 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:54:21.443275 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:54:21.443275 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 14 08:54:21.443275 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:54:21.443275 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-1c12d264-94ca-42e6-ac47-fbe8c59e4479 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Returning 404 to user: Image not found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:54:21.444656 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-1c12d264-94ca-42e6-ac47-fbe8c59e4479 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] 10.222.0.60 "DELETE /compute/v2.1/images/7aaf5b60-fd48-45cd-9151-f90bc39f616b" status: 404 len: 62 microversion: 2.1 time: 0.087697 Sep 14 08:54:21.448463 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 761/1528] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:54:21 2022] DELETE /compute/v2.1/images/7aaf5b60-fd48-45cd-9151-f90bc39f616b => generated 62 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 14 08:54:21.453935 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-f7d58b7f-0ee2-4eb7-87dd-91644d81453b tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:54:21.454612 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-f7d58b7f-0ee2-4eb7-87dd-91644d81453b tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] [instance: 67f3a983-b33f-49c8-9c91-988e8553563c] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:54:21.463201 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f7d58b7f-0ee2-4eb7-87dd-91644d81453b tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:21.467212 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f7d58b7f-0ee2-4eb7-87dd-91644d81453b tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:21.468251 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f7d58b7f-0ee2-4eb7-87dd-91644d81453b tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:21.471250 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f7d58b7f-0ee2-4eb7-87dd-91644d81453b tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:21.472082 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f7d58b7f-0ee2-4eb7-87dd-91644d81453b tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:21.472786 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f7d58b7f-0ee2-4eb7-87dd-91644d81453b tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:21.508553 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-f7d58b7f-0ee2-4eb7-87dd-91644d81453b tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] HTTP exception thrown: Instance 67f3a983-b33f-49c8-9c91-988e8553563c could not be found. Sep 14 08:54:21.518637 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b18d4957-6f78-4ac2-b0e4-aa8217b9ba09 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:54:21.523859 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b18d4957-6f78-4ac2-b0e4-aa8217b9ba09 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: 8fce8438-d6ae-408d-8b4f-ee14d4021fdd] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:54:21.530734 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-f7d58b7f-0ee2-4eb7-87dd-91644d81453b tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Request method failure captured: Sep 14 08:54:21.530734 n-d-836830-18 devstack@n-api.service[128758]: request: DELETE /compute/v2.1/servers/67f3a983-b33f-49c8-9c91-988e8553563c HTTP/1.1 Sep 14 08:54:21.530734 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 08:54:21.530734 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 08:54:21.530734 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 08:54:21.530734 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 08:54:21.530734 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 08:54:21.530734 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 08:54:21.530734 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 08:54:21.530734 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 08:54:21.530734 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZZS4Po83Aovv_U3RdkjXLQKweaQf-fhAgT61i_A11uamuOl6sYuSjebIurWFthtZrzpGvY9uLyOeI1i9q8ClJm3kMoDWgYaqbwGjdZ-I8VmC2NF95wjpQldZSAgTTLlPF11CuzqbhW26YYuwljJxckz8_fE9N_t89yQzibByeeP394 Sep 14 08:54:21.530734 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 08:54:21.530734 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 08:54:21.530734 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 08:54:21.530734 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 08:54:21.530734 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 08:54:21.530734 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 08:54:21.530734 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 0a87a909133e42e1a82e3a623536935c Sep 14 08:54:21.530734 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1646226177 Sep 14 08:54:21.530734 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 08:54:21.530734 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 08:54:21.532405 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0a87a909133e42e1a82e3a623536935c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0a87a909133e42e1a82e3a623536935c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0a87a909133e42e1a82e3a623536935c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0a87a909133e42e1a82e3a623536935c"}]}] Sep 14 08:54:21.532405 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1646226177 Sep 14 08:54:21.532405 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 0a87a909133e42e1a82e3a623536935c Sep 14 08:54:21.532405 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1646226177 Sep 14 08:54:21.532405 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-ImagesOneServerNegativeTestJSON-1646226177-project Sep 14 08:54:21.532405 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 08:54:21.532405 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 08:54:21.532405 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: a3ace9012a7c4ce59c01858b6984b766 Sep 14 08:54:21.532405 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1646226177-project Sep 14 08:54:21.532405 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 08:54:21.532405 n-d-836830-18 devstack@n-api.service[128758]: exception: Instance 67f3a983-b33f-49c8-9c91-988e8553563c could not be found. Sep 14 08:54:21.532405 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': '67f3a983-b33f-49c8-9c91-988e8553563c'} Sep 14 08:54:21.533368 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:54:21.533368 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:54:21.533368 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 08:54:21.533368 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 08:54:21.533368 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 08:54:21.533368 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 08:54:21.533368 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 08:54:21.533368 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 08:54:21.533368 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 08:54:21.533368 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 08:54:21.533368 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67f3a983-b33f-49c8-9c91-988e8553563c could not be found. Sep 14 08:54:21.533368 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:54:21.533368 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:54:21.533368 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:54:21.533368 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:54:21.533368 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:54:21.533368 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:54:21.533368 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:54:21.533368 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:54:21.533368 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:54:21.537359 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:54:21.537359 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 08:54:21.537359 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 08:54:21.537359 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 08:54:21.537359 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 08:54:21.537359 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 08:54:21.537359 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 08:54:21.537359 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 08:54:21.537359 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 08:54:21.537359 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67f3a983-b33f-49c8-9c91-988e8553563c could not be found. Sep 14 08:54:21.537359 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:54:21.537359 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:54:21.537359 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:54:21.537359 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:54:21.537359 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:54:21.537359 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:54:21.537359 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:54:21.537359 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:54:21.537359 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67f3a983-b33f-49c8-9c91-988e8553563c could not be found. Sep 14 08:54:21.537359 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:54:21.547262 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-f7d58b7f-0ee2-4eb7-87dd-91644d81453b tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Returning 404 to user: Instance 67f3a983-b33f-49c8-9c91-988e8553563c could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:54:21.548500 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-f7d58b7f-0ee2-4eb7-87dd-91644d81453b tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] 10.222.0.60 "DELETE /compute/v2.1/servers/67f3a983-b33f-49c8-9c91-988e8553563c" status: 404 len: 111 microversion: 2.1 time: 0.098873 Sep 14 08:54:21.553981 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 768/1529] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 08:54:21 2022] DELETE /compute/v2.1/servers/67f3a983-b33f-49c8-9c91-988e8553563c => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 08:54:21.557457 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b18d4957-6f78-4ac2-b0e4-aa8217b9ba09 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:21.562564 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c5dcd7d1-d45f-41df-9265-bfaaadb62a68 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:54:21.563549 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b18d4957-6f78-4ac2-b0e4-aa8217b9ba09 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:21.567133 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b18d4957-6f78-4ac2-b0e4-aa8217b9ba09 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:21.568228 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b18d4957-6f78-4ac2-b0e4-aa8217b9ba09 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:21.568941 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b18d4957-6f78-4ac2-b0e4-aa8217b9ba09 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:21.573139 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b18d4957-6f78-4ac2-b0e4-aa8217b9ba09 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:21.574218 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-c5dcd7d1-d45f-41df-9265-bfaaadb62a68 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] [instance: 67f3a983-b33f-49c8-9c91-988e8553563c] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:54:21.596574 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:UPDATE=3 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:54:21.598134 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c5dcd7d1-d45f-41df-9265-bfaaadb62a68 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:21.600470 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c5dcd7d1-d45f-41df-9265-bfaaadb62a68 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:21.600995 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c5dcd7d1-d45f-41df-9265-bfaaadb62a68 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:21.613148 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c5dcd7d1-d45f-41df-9265-bfaaadb62a68 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:21.613825 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c5dcd7d1-d45f-41df-9265-bfaaadb62a68 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:21.614392 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c5dcd7d1-d45f-41df-9265-bfaaadb62a68 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:21.665226 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-c5dcd7d1-d45f-41df-9265-bfaaadb62a68 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] HTTP exception thrown: Instance 67f3a983-b33f-49c8-9c91-988e8553563c could not be found. Sep 14 08:54:21.688413 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c5dcd7d1-d45f-41df-9265-bfaaadb62a68 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Request method failure captured: Sep 14 08:54:21.688413 n-d-836830-18 devstack@n-api.service[128758]: request: GET /compute/v2.1/servers/67f3a983-b33f-49c8-9c91-988e8553563c HTTP/1.1 Sep 14 08:54:21.688413 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 08:54:21.688413 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 08:54:21.688413 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 08:54:21.688413 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 08:54:21.688413 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 08:54:21.688413 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 08:54:21.688413 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 08:54:21.688413 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 08:54:21.688413 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZZS4Po83Aovv_U3RdkjXLQKweaQf-fhAgT61i_A11uamuOl6sYuSjebIurWFthtZrzpGvY9uLyOeI1i9q8ClJm3kMoDWgYaqbwGjdZ-I8VmC2NF95wjpQldZSAgTTLlPF11CuzqbhW26YYuwljJxckz8_fE9N_t89yQzibByeeP394 Sep 14 08:54:21.688413 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 08:54:21.688413 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 08:54:21.688413 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 08:54:21.688413 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 08:54:21.688413 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 08:54:21.688413 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 08:54:21.688413 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 0a87a909133e42e1a82e3a623536935c Sep 14 08:54:21.688413 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1646226177 Sep 14 08:54:21.688413 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 08:54:21.688413 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 08:54:21.690008 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0a87a909133e42e1a82e3a623536935c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0a87a909133e42e1a82e3a623536935c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0a87a909133e42e1a82e3a623536935c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0a87a909133e42e1a82e3a623536935c"}]}] Sep 14 08:54:21.690008 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1646226177 Sep 14 08:54:21.690008 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 0a87a909133e42e1a82e3a623536935c Sep 14 08:54:21.690008 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1646226177 Sep 14 08:54:21.690008 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-ImagesOneServerNegativeTestJSON-1646226177-project Sep 14 08:54:21.690008 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 08:54:21.690008 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 08:54:21.690008 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: a3ace9012a7c4ce59c01858b6984b766 Sep 14 08:54:21.690008 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1646226177-project Sep 14 08:54:21.690008 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 08:54:21.690008 n-d-836830-18 devstack@n-api.service[128758]: exception: Instance 67f3a983-b33f-49c8-9c91-988e8553563c could not be found. Sep 14 08:54:21.690008 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': '67f3a983-b33f-49c8-9c91-988e8553563c'} Sep 14 08:54:21.691597 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:54:21.691597 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:54:21.691597 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 08:54:21.691597 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 08:54:21.691597 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 08:54:21.691597 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 08:54:21.691597 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 08:54:21.691597 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 08:54:21.691597 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 08:54:21.691597 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 08:54:21.691597 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67f3a983-b33f-49c8-9c91-988e8553563c could not be found. Sep 14 08:54:21.691597 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:54:21.691597 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:54:21.691597 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:54:21.691597 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:54:21.691597 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:54:21.691597 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:54:21.691597 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:54:21.691597 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:54:21.691597 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:54:21.693108 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:54:21.693108 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 08:54:21.693108 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 08:54:21.693108 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 08:54:21.693108 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 08:54:21.693108 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 08:54:21.693108 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 08:54:21.693108 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67f3a983-b33f-49c8-9c91-988e8553563c could not be found. Sep 14 08:54:21.693108 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:54:21.693108 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:54:21.693108 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:54:21.693108 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:54:21.693108 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:54:21.693108 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:54:21.693108 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:54:21.693108 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:54:21.693108 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67f3a983-b33f-49c8-9c91-988e8553563c could not be found. Sep 14 08:54:21.693108 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:54:21.699512 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c5dcd7d1-d45f-41df-9265-bfaaadb62a68 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] Returning 404 to user: Instance 67f3a983-b33f-49c8-9c91-988e8553563c could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:54:21.703948 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-c5dcd7d1-d45f-41df-9265-bfaaadb62a68 tempest-ImagesOneServerNegativeTestJSON-1646226177 tempest-ImagesOneServerNegativeTestJSON-1646226177-project] 10.222.0.60 "GET /compute/v2.1/servers/67f3a983-b33f-49c8-9c91-988e8553563c" status: 404 len: 111 microversion: 2.1 time: 0.145120 Sep 14 08:54:21.708009 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 769/1530] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:54:21 2022] GET /compute/v2.1/servers/67f3a983-b33f-49c8-9c91-988e8553563c => generated 111 bytes in 150 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 08:54:21.727545 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-edcd78d9-118a-4eca-bcc8-203c330a407c req-2a7e017f-ba5b-4c8e-b3b1-585d83858b29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af183467-9304-4c73-a29f-196e76ba21b5", "name": "network-vif-deleted", "tag": "9664d857-e4a0-4edd-b5e2-e3a3058cb696"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:54:21.765601 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-edcd78d9-118a-4eca-bcc8-203c330a407c req-2a7e017f-ba5b-4c8e-b3b1-585d83858b29 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:21.771612 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-edcd78d9-118a-4eca-bcc8-203c330a407c req-2a7e017f-ba5b-4c8e-b3b1-585d83858b29 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:21.774686 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-edcd78d9-118a-4eca-bcc8-203c330a407c req-2a7e017f-ba5b-4c8e-b3b1-585d83858b29 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:21.809499 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-edcd78d9-118a-4eca-bcc8-203c330a407c req-2a7e017f-ba5b-4c8e-b3b1-585d83858b29 service nova] Creating event network-vif-deleted:9664d857-e4a0-4edd-b5e2-e3a3058cb696 for instance af183467-9304-4c73-a29f-196e76ba21b5 on n-h1-836830-18 Sep 14 08:54:21.833862 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-edcd78d9-118a-4eca-bcc8-203c330a407c req-2a7e017f-ba5b-4c8e-b3b1-585d83858b29 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122337 Sep 14 08:54:21.847930 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 770/1531] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:54:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:54:21.876346 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-54e8c841-a973-4e35-b8ea-07fea3e730a6 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:54:21.891880 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-54e8c841-a973-4e35-b8ea-07fea3e730a6 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: af183467-9304-4c73-a29f-196e76ba21b5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:54:21.915703 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-54e8c841-a973-4e35-b8ea-07fea3e730a6 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:21.920950 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-54e8c841-a973-4e35-b8ea-07fea3e730a6 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:21.921737 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-54e8c841-a973-4e35-b8ea-07fea3e730a6 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:21.922990 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-54e8c841-a973-4e35-b8ea-07fea3e730a6 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:21.923706 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-54e8c841-a973-4e35-b8ea-07fea3e730a6 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:21.928422 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-54e8c841-a973-4e35-b8ea-07fea3e730a6 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:21.986822 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-54e8c841-a973-4e35-b8ea-07fea3e730a6 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:21.987907 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-54e8c841-a973-4e35-b8ea-07fea3e730a6 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:21.988349 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-54e8c841-a973-4e35-b8ea-07fea3e730a6 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:21.988810 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.objects.instance [None req-54e8c841-a973-4e35-b8ea-07fea3e730a6 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lazy-loading 'fault' on Instance uuid af183467-9304-4c73-a29f-196e76ba21b5 {{(pid=128758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 08:54:21.988986 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.objects.instance [None req-b18d4957-6f78-4ac2-b0e4-aa8217b9ba09 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lazy-loading 'services' on Instance uuid 8fce8438-d6ae-408d-8b4f-ee14d4021fdd {{(pid=128759) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 08:54:22.240692 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b18d4957-6f78-4ac2-b0e4-aa8217b9ba09 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "DELETE /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd/os-volume_attachments/d8d327e0-5566-4083-87a2-5d3266f124ff" status: 202 len: 0 microversion: 2.25 time: 0.725775 Sep 14 08:54:22.243604 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 762/1532] 10.222.0.60 () {60 vars in 1457 bytes} [Wed Sep 14 08:54:21 2022] DELETE /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd/os-volume_attachments/d8d327e0-5566-4083-87a2-5d3266f124ff => generated 0 bytes in 730 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 14 08:54:22.254617 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-54e8c841-a973-4e35-b8ea-07fea3e730a6 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:54:22.259307 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f9ab89e5-9015-411b-ac8c-518696a31917 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:54:22.269818 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f9ab89e5-9015-411b-ac8c-518696a31917 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: 8fce8438-d6ae-408d-8b4f-ee14d4021fdd] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:54:22.275055 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-54e8c841-a973-4e35-b8ea-07fea3e730a6 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/af183467-9304-4c73-a29f-196e76ba21b5" status: 200 len: 1368 microversion: 2.1 time: 0.409420 Sep 14 08:54:22.278214 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 771/1533] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:54:21 2022] GET /compute/v2.1/servers/af183467-9304-4c73-a29f-196e76ba21b5 => generated 1368 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:54:22.293045 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f9ab89e5-9015-411b-ac8c-518696a31917 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:22.293877 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f9ab89e5-9015-411b-ac8c-518696a31917 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:22.294779 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f9ab89e5-9015-411b-ac8c-518696a31917 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:22.295919 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f9ab89e5-9015-411b-ac8c-518696a31917 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:22.296607 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f9ab89e5-9015-411b-ac8c-518696a31917 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:22.297237 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f9ab89e5-9015-411b-ac8c-518696a31917 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:22.375817 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f9ab89e5-9015-411b-ac8c-518696a31917 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.127168 Sep 14 08:54:22.378125 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 763/1534] 10.222.0.60 () {60 vars in 1343 bytes} [Wed Sep 14 08:54:22 2022] GET /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd/os-volume_attachments => generated 197 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 14 08:54:23.303509 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-5e92db8c-f3b8-41ba-9e76-bbe88b508799 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:54:23.305605 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-5e92db8c-f3b8-41ba-9e76-bbe88b508799 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: af183467-9304-4c73-a29f-196e76ba21b5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:54:23.317537 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5e92db8c-f3b8-41ba-9e76-bbe88b508799 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:23.322548 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5e92db8c-f3b8-41ba-9e76-bbe88b508799 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:23.328644 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5e92db8c-f3b8-41ba-9e76-bbe88b508799 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:23.329832 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5e92db8c-f3b8-41ba-9e76-bbe88b508799 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:23.330484 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5e92db8c-f3b8-41ba-9e76-bbe88b508799 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:23.331178 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5e92db8c-f3b8-41ba-9e76-bbe88b508799 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:23.371804 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-5e92db8c-f3b8-41ba-9e76-bbe88b508799 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] HTTP exception thrown: Instance af183467-9304-4c73-a29f-196e76ba21b5 could not be found. Sep 14 08:54:23.374130 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-5e92db8c-f3b8-41ba-9e76-bbe88b508799 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Request method failure captured: Sep 14 08:54:23.374130 n-d-836830-18 devstack@n-api.service[128758]: request: GET /compute/v2.1/servers/af183467-9304-4c73-a29f-196e76ba21b5 HTTP/1.1 Sep 14 08:54:23.374130 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 08:54:23.374130 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 08:54:23.374130 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 08:54:23.374130 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 08:54:23.374130 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 08:54:23.374130 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 08:54:23.374130 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 08:54:23.374130 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 08:54:23.374130 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZVVByT_6-JGS6UV1gPynraxOMsYohkVqemIC6AxwdsIEVt3-ZlTQkPOCxPrHC_cjaYNAxgvgTIAX1mcOvoSIexNXMVze3EWvq2nR2PEgoxW6GhfqTZqbUa3ZV75Ae3Xam85qa2KosJ3BA0xkODZucsmvWQPOUvdvFL_EjszmdH9asc Sep 14 08:54:23.374130 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 08:54:23.374130 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 08:54:23.374130 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 08:54:23.374130 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 08:54:23.374130 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 08:54:23.374130 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 08:54:23.374130 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 8fd62edd611c4390be2403972b99aa15 Sep 14 08:54:23.374130 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-MigrationsAdminTest-1911476068 Sep 14 08:54:23.374130 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 08:54:23.374130 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 08:54:23.376020 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/8fd62edd611c4390be2403972b99aa15"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_8fd62edd611c4390be2403972b99aa15"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8fd62edd611c4390be2403972b99aa15"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8fd62edd611c4390be2403972b99aa15"}]}] Sep 14 08:54:23.376020 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-MigrationsAdminTest-1911476068 Sep 14 08:54:23.376020 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 8fd62edd611c4390be2403972b99aa15 Sep 14 08:54:23.376020 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-MigrationsAdminTest-1911476068 Sep 14 08:54:23.376020 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-MigrationsAdminTest-1911476068-project Sep 14 08:54:23.376020 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 08:54:23.376020 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 08:54:23.376020 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 264fb30236d54248ad0ecf79a177849f Sep 14 08:54:23.376020 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-MigrationsAdminTest-1911476068-project Sep 14 08:54:23.376020 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 08:54:23.376020 n-d-836830-18 devstack@n-api.service[128758]: exception: Instance af183467-9304-4c73-a29f-196e76ba21b5 could not be found. Sep 14 08:54:23.376020 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': 'af183467-9304-4c73-a29f-196e76ba21b5'} Sep 14 08:54:23.377092 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:54:23.377092 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:54:23.377092 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 08:54:23.377092 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 08:54:23.377092 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 08:54:23.377092 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 08:54:23.377092 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 08:54:23.377092 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 08:54:23.377092 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 08:54:23.377092 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 08:54:23.377092 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af183467-9304-4c73-a29f-196e76ba21b5 could not be found. Sep 14 08:54:23.377092 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:54:23.377092 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:54:23.377092 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:54:23.377092 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:54:23.377092 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:54:23.377092 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:54:23.377092 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:54:23.377092 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:54:23.377092 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:54:23.379146 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:54:23.379146 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 08:54:23.379146 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 08:54:23.379146 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 08:54:23.379146 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 08:54:23.379146 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 08:54:23.379146 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 08:54:23.379146 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af183467-9304-4c73-a29f-196e76ba21b5 could not be found. Sep 14 08:54:23.379146 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:54:23.379146 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:54:23.379146 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:54:23.379146 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:54:23.379146 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:54:23.379146 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:54:23.379146 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:54:23.379146 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:54:23.379146 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af183467-9304-4c73-a29f-196e76ba21b5 could not be found. Sep 14 08:54:23.379146 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:54:23.384691 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-5e92db8c-f3b8-41ba-9e76-bbe88b508799 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Returning 404 to user: Instance af183467-9304-4c73-a29f-196e76ba21b5 could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:54:23.388059 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-5e92db8c-f3b8-41ba-9e76-bbe88b508799 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/af183467-9304-4c73-a29f-196e76ba21b5" status: 404 len: 111 microversion: 2.1 time: 0.088780 Sep 14 08:54:23.390029 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 772/1535] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:54:23 2022] GET /compute/v2.1/servers/af183467-9304-4c73-a29f-196e76ba21b5 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 08:54:23.390460 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f0567840-0fad-4039-9ff3-3a50c078d2ed tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:54:23.393178 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f0567840-0fad-4039-9ff3-3a50c078d2ed tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: 8fce8438-d6ae-408d-8b4f-ee14d4021fdd] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:54:23.404378 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-7af8258e-3deb-49ee-88ee-c05ea4943805 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '.version_select at 0x7f7d4457cdc0>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:54:23.406374 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f0567840-0fad-4039-9ff3-3a50c078d2ed tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:23.408285 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f0567840-0fad-4039-9ff3-3a50c078d2ed tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:23.411740 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f0567840-0fad-4039-9ff3-3a50c078d2ed tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:23.419587 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f0567840-0fad-4039-9ff3-3a50c078d2ed tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:23.421835 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f0567840-0fad-4039-9ff3-3a50c078d2ed tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:23.422643 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f0567840-0fad-4039-9ff3-3a50c078d2ed tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:23.440394 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-7af8258e-3deb-49ee-88ee-c05ea4943805 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-111523344" status: 202 len: 0 microversion: 2.1 time: 0.046944 Sep 14 08:54:23.441968 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 773/1536] 10.222.0.60 () {58 vars in 1218 bytes} [Wed Sep 14 08:54:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-111523344 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 08:54:23.516559 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f0567840-0fad-4039-9ff3-3a50c078d2ed tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.130548 Sep 14 08:54:23.532023 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 764/1537] 10.222.0.60 () {60 vars in 1343 bytes} [Wed Sep 14 08:54:23 2022] GET /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd/os-volume_attachments => generated 197 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 08:54:24.187388 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-694f92c5-3126-4c66-9c39-5f01878209b9 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:54:24.188704 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-694f92c5-3126-4c66-9c39-5f01878209b9 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] [instance: 2098e0b9-b628-4b9e-979b-960c68830fee] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:54:24.193153 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-bc32864f-8d5a-4323-aed0-c0baf676125a tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Action: 'create', calling method: .version_select at 0x7f7d44418af0>, body: {"keypair": {"name": "tempest-keypair-617872715", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLsASfbi4TglwnKn5sIrGCYDGnI/0DVHHaH0sz+auNAKx/z3uYtNfiSDTbsBVTY7kMQSSlsja8mVUduYR9Amk38h91rsi+nQaLYFKO2L4aov9JeTCxJGRVfm/J7a5ZIOEg=="}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:54:24.209304 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-694f92c5-3126-4c66-9c39-5f01878209b9 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:24.211668 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-694f92c5-3126-4c66-9c39-5f01878209b9 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:24.213775 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-694f92c5-3126-4c66-9c39-5f01878209b9 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:24.214730 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-694f92c5-3126-4c66-9c39-5f01878209b9 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:24.220920 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-694f92c5-3126-4c66-9c39-5f01878209b9 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:24.222660 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-694f92c5-3126-4c66-9c39-5f01878209b9 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:24.245408 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-bc32864f-8d5a-4323-aed0-c0baf676125a tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Getting quotas for project 659a963df1b646f1918426fe1a7cb23c. Resources: {'key_pairs'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 08:54:24.260917 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-bc32864f-8d5a-4323-aed0-c0baf676125a tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Getting quotas for user 5040fc9212814c4fa9e038116578eebd and project 659a963df1b646f1918426fe1a7cb23c. Resources: {'key_pairs'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 08:54:24.333869 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-bc32864f-8d5a-4323-aed0-c0baf676125a tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.528332 Sep 14 08:54:24.335817 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 774/1538] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Sep 14 08:54:23 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:54:24.517001 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-694f92c5-3126-4c66-9c39-5f01878209b9 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/2098e0b9-b628-4b9e-979b-960c68830fee" status: 200 len: 1813 microversion: 2.1 time: 0.333743 Sep 14 08:54:24.520715 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 765/1539] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:54:24 2022] GET /compute/v2.1/servers/2098e0b9-b628-4b9e-979b-960c68830fee => generated 1813 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:54:24.544124 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d2b70742-e5b4-487b-bfa2-f353878f9da7 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:54:24.551864 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a1880d92-f9e9-471a-9427-846dee1567e2 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:54:24.556987 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-d2b70742-e5b4-487b-bfa2-f353878f9da7 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: 8fce8438-d6ae-408d-8b4f-ee14d4021fdd] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:54:24.560269 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a1880d92-f9e9-471a-9427-846dee1567e2 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:24.561873 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a1880d92-f9e9-471a-9427-846dee1567e2 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:24.564221 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a1880d92-f9e9-471a-9427-846dee1567e2 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:24.566385 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a1880d92-f9e9-471a-9427-846dee1567e2 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:24.570361 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a1880d92-f9e9-471a-9427-846dee1567e2 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:24.572283 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a1880d92-f9e9-471a-9427-846dee1567e2 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:24.578182 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d2b70742-e5b4-487b-bfa2-f353878f9da7 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:24.585683 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d2b70742-e5b4-487b-bfa2-f353878f9da7 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:24.587751 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d2b70742-e5b4-487b-bfa2-f353878f9da7 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:24.589594 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d2b70742-e5b4-487b-bfa2-f353878f9da7 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:24.590792 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d2b70742-e5b4-487b-bfa2-f353878f9da7 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:24.593897 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d2b70742-e5b4-487b-bfa2-f353878f9da7 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:24.659466 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a1880d92-f9e9-471a-9427-846dee1567e2 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.110250 Sep 14 08:54:24.661880 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 766/1540] 10.222.0.60 () {58 vars in 1176 bytes} [Wed Sep 14 08:54:24 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 08:54:24.680789 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-d2b70742-e5b4-487b-bfa2-f353878f9da7 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.140079 Sep 14 08:54:24.689793 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 775/1541] 10.222.0.60 () {60 vars in 1343 bytes} [Wed Sep 14 08:54:24 2022] GET /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd/os-volume_attachments => generated 197 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 08:54:24.989114 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-5c6f377f-8538-4ed4-b225-3a5c92b6826a tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:54:24.989728 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-5c6f377f-8538-4ed4-b225-3a5c92b6826a tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: e4c51c69-8c2e-4202-9c2f-3dfae93392e9] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:54:24.997875 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5c6f377f-8538-4ed4-b225-3a5c92b6826a tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:24.998809 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5c6f377f-8538-4ed4-b225-3a5c92b6826a tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:24.999555 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5c6f377f-8538-4ed4-b225-3a5c92b6826a tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:25.000493 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5c6f377f-8538-4ed4-b225-3a5c92b6826a tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:25.001057 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5c6f377f-8538-4ed4-b225-3a5c92b6826a tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:25.002062 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5c6f377f-8538-4ed4-b225-3a5c92b6826a tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:25.044984 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-5c6f377f-8538-4ed4-b225-3a5c92b6826a tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: e4c51c69-8c2e-4202-9c2f-3dfae93392e9] Going to try to terminate instance {{(pid=128759) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 08:54:25.077967 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:54:25.180920 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-5c6f377f-8538-4ed4-b225-3a5c92b6826a tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "DELETE /compute/v2.1/servers/e4c51c69-8c2e-4202-9c2f-3dfae93392e9" status: 204 len: 0 microversion: 2.1 time: 0.195273 Sep 14 08:54:25.181570 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 767/1542] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 08:54:24 2022] DELETE /compute/v2.1/servers/e4c51c69-8c2e-4202-9c2f-3dfae93392e9 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 14 08:54:25.191692 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d8d0936f-3dfd-46dd-9ab8-4f1e3dc31590 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:54:25.192384 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-d8d0936f-3dfd-46dd-9ab8-4f1e3dc31590 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: e4c51c69-8c2e-4202-9c2f-3dfae93392e9] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:54:25.204416 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d8d0936f-3dfd-46dd-9ab8-4f1e3dc31590 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:25.205407 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d8d0936f-3dfd-46dd-9ab8-4f1e3dc31590 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:25.207163 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d8d0936f-3dfd-46dd-9ab8-4f1e3dc31590 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:25.209358 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d8d0936f-3dfd-46dd-9ab8-4f1e3dc31590 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:25.211015 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d8d0936f-3dfd-46dd-9ab8-4f1e3dc31590 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:25.211676 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d8d0936f-3dfd-46dd-9ab8-4f1e3dc31590 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:25.558969 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-d8d0936f-3dfd-46dd-9ab8-4f1e3dc31590 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:54:25.568711 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-d8d0936f-3dfd-46dd-9ab8-4f1e3dc31590 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/e4c51c69-8c2e-4202-9c2f-3dfae93392e9" status: 200 len: 1468 microversion: 2.1 time: 0.382280 Sep 14 08:54:25.574326 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 776/1543] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:54:25 2022] GET /compute/v2.1/servers/e4c51c69-8c2e-4202-9c2f-3dfae93392e9 => generated 1468 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:54:25.697955 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-482a8654-c47a-42f4-b6d0-ca8a22d41c3a tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:54:25.700532 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-482a8654-c47a-42f4-b6d0-ca8a22d41c3a tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: 8fce8438-d6ae-408d-8b4f-ee14d4021fdd] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:54:25.716438 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-482a8654-c47a-42f4-b6d0-ca8a22d41c3a tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:25.717548 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-482a8654-c47a-42f4-b6d0-ca8a22d41c3a tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:25.720014 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-482a8654-c47a-42f4-b6d0-ca8a22d41c3a tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:25.721713 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-482a8654-c47a-42f4-b6d0-ca8a22d41c3a tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:25.725059 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-482a8654-c47a-42f4-b6d0-ca8a22d41c3a tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:25.725984 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-482a8654-c47a-42f4-b6d0-ca8a22d41c3a tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:25.786217 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-482a8654-c47a-42f4-b6d0-ca8a22d41c3a tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.093103 Sep 14 08:54:25.787861 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 768/1544] 10.222.0.60 () {60 vars in 1343 bytes} [Wed Sep 14 08:54:25 2022] GET /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 08:54:26.607086 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-6488b080-ad4b-450b-81a7-75d7230de746 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:54:26.608348 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-6488b080-ad4b-450b-81a7-75d7230de746 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: e4c51c69-8c2e-4202-9c2f-3dfae93392e9] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:54:26.639878 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6488b080-ad4b-450b-81a7-75d7230de746 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:26.642763 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6488b080-ad4b-450b-81a7-75d7230de746 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:26.643520 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6488b080-ad4b-450b-81a7-75d7230de746 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:26.644468 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6488b080-ad4b-450b-81a7-75d7230de746 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:26.647428 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6488b080-ad4b-450b-81a7-75d7230de746 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:26.648105 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6488b080-ad4b-450b-81a7-75d7230de746 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:26.805983 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8d846cec-9eeb-4cd7-8c6c-2e1063894c14 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:54:26.809131 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-8d846cec-9eeb-4cd7-8c6c-2e1063894c14 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: 8fce8438-d6ae-408d-8b4f-ee14d4021fdd] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:54:26.817865 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8d846cec-9eeb-4cd7-8c6c-2e1063894c14 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:26.818760 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8d846cec-9eeb-4cd7-8c6c-2e1063894c14 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:26.819448 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8d846cec-9eeb-4cd7-8c6c-2e1063894c14 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:26.820377 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8d846cec-9eeb-4cd7-8c6c-2e1063894c14 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:26.821542 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8d846cec-9eeb-4cd7-8c6c-2e1063894c14 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:26.822170 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8d846cec-9eeb-4cd7-8c6c-2e1063894c14 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:26.885337 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-8d846cec-9eeb-4cd7-8c6c-2e1063894c14 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.089941 Sep 14 08:54:26.889621 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 769/1545] 10.222.0.60 () {60 vars in 1343 bytes} [Wed Sep 14 08:54:26 2022] GET /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 08:54:27.272535 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-6488b080-ad4b-450b-81a7-75d7230de746 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:54:27.287266 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-6488b080-ad4b-450b-81a7-75d7230de746 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/e4c51c69-8c2e-4202-9c2f-3dfae93392e9" status: 200 len: 1468 microversion: 2.1 time: 0.687008 Sep 14 08:54:27.287873 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 777/1546] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:54:26 2022] GET /compute/v2.1/servers/e4c51c69-8c2e-4202-9c2f-3dfae93392e9 => generated 1468 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:54:27.616499 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-41435d25-bd0b-4c85-80d0-c9b19850f221 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "99af689c-3be6-447e-80d9-94c8fb226d55", "device": "/dev/xvdb"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:54:27.620059 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-41435d25-bd0b-4c85-80d0-c9b19850f221 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: 2098e0b9-b628-4b9e-979b-960c68830fee] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:54:27.645937 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-41435d25-bd0b-4c85-80d0-c9b19850f221 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:27.646779 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-41435d25-bd0b-4c85-80d0-c9b19850f221 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:27.647426 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-41435d25-bd0b-4c85-80d0-c9b19850f221 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:27.651357 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-41435d25-bd0b-4c85-80d0-c9b19850f221 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:27.652051 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-41435d25-bd0b-4c85-80d0-c9b19850f221 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:27.657550 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-41435d25-bd0b-4c85-80d0-c9b19850f221 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:27.902310 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d0fbe476-d371-4841-bc5e-f8cc31fa756c tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:54:27.904735 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-d0fbe476-d371-4841-bc5e-f8cc31fa756c tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: 8fce8438-d6ae-408d-8b4f-ee14d4021fdd] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:54:27.927865 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d0fbe476-d371-4841-bc5e-f8cc31fa756c tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:27.928360 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d0fbe476-d371-4841-bc5e-f8cc31fa756c tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:27.928839 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d0fbe476-d371-4841-bc5e-f8cc31fa756c tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:27.929557 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d0fbe476-d371-4841-bc5e-f8cc31fa756c tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:27.930308 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d0fbe476-d371-4841-bc5e-f8cc31fa756c tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:27.930736 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d0fbe476-d371-4841-bc5e-f8cc31fa756c tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:27.970161 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-d0fbe476-d371-4841-bc5e-f8cc31fa756c tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.072216 Sep 14 08:54:27.976044 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 778/1547] 10.222.0.60 () {60 vars in 1343 bytes} [Wed Sep 14 08:54:27 2022] GET /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 14 08:54:28.144035 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-8474c3ec-7411-4675-ba94-e3167cc56ced req-045bfd11-d808-4978-9051-0276b345481c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4c51c69-8c2e-4202-9c2f-3dfae93392e9", "name": "network-vif-deleted", "tag": "158744dd-786d-4346-8779-274378b61a47"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:54:28.165479 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-8474c3ec-7411-4675-ba94-e3167cc56ced req-045bfd11-d808-4978-9051-0276b345481c service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:28.167556 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-8474c3ec-7411-4675-ba94-e3167cc56ced req-045bfd11-d808-4978-9051-0276b345481c service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:28.168189 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-8474c3ec-7411-4675-ba94-e3167cc56ced req-045bfd11-d808-4978-9051-0276b345481c service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:28.201059 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-41435d25-bd0b-4c85-80d0-c9b19850f221 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "POST /compute/v2.1/servers/2098e0b9-b628-4b9e-979b-960c68830fee/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.588765 Sep 14 08:54:28.202077 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 770/1548] 10.222.0.60 () {60 vars in 1323 bytes} [Wed Sep 14 08:54:27 2022] POST /compute/v2.1/servers/2098e0b9-b628-4b9e-979b-960c68830fee/os-volume_attachments => generated 194 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:54:28.219251 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-8474c3ec-7411-4675-ba94-e3167cc56ced req-045bfd11-d808-4978-9051-0276b345481c service nova] Creating event network-vif-deleted:158744dd-786d-4346-8779-274378b61a47 for instance e4c51c69-8c2e-4202-9c2f-3dfae93392e9 on n-h1-836830-18 Sep 14 08:54:28.232206 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-8474c3ec-7411-4675-ba94-e3167cc56ced req-045bfd11-d808-4978-9051-0276b345481c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092674 Sep 14 08:54:28.235357 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 779/1549] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:54:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:54:28.311783 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-db244c82-c525-4ace-a64c-bc1af8008e4c tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:54:28.313814 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-db244c82-c525-4ace-a64c-bc1af8008e4c tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: e4c51c69-8c2e-4202-9c2f-3dfae93392e9] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:54:28.334401 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-db244c82-c525-4ace-a64c-bc1af8008e4c tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:28.335150 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-db244c82-c525-4ace-a64c-bc1af8008e4c tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:28.336820 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-db244c82-c525-4ace-a64c-bc1af8008e4c tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:28.339882 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-db244c82-c525-4ace-a64c-bc1af8008e4c tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:28.340554 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-db244c82-c525-4ace-a64c-bc1af8008e4c tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:28.341412 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-db244c82-c525-4ace-a64c-bc1af8008e4c tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:28.434757 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-db244c82-c525-4ace-a64c-bc1af8008e4c tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:28.437026 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-db244c82-c525-4ace-a64c-bc1af8008e4c tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:28.440678 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-db244c82-c525-4ace-a64c-bc1af8008e4c tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:28.441471 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.objects.instance [None req-db244c82-c525-4ace-a64c-bc1af8008e4c tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lazy-loading 'fault' on Instance uuid e4c51c69-8c2e-4202-9c2f-3dfae93392e9 {{(pid=128759) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 08:54:28.621140 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-db244c82-c525-4ace-a64c-bc1af8008e4c tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:54:28.633775 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-db244c82-c525-4ace-a64c-bc1af8008e4c tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/e4c51c69-8c2e-4202-9c2f-3dfae93392e9" status: 200 len: 1302 microversion: 2.1 time: 0.327067 Sep 14 08:54:28.635211 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 771/1550] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:54:28 2022] GET /compute/v2.1/servers/e4c51c69-8c2e-4202-9c2f-3dfae93392e9 => generated 1302 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:54:28.986483 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-6ade3825-652f-4409-b71b-4e0105196fc6 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:54:28.989268 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-6ade3825-652f-4409-b71b-4e0105196fc6 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: 8fce8438-d6ae-408d-8b4f-ee14d4021fdd] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:54:29.019861 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6ade3825-652f-4409-b71b-4e0105196fc6 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:29.020374 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6ade3825-652f-4409-b71b-4e0105196fc6 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:29.024141 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6ade3825-652f-4409-b71b-4e0105196fc6 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:29.024948 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6ade3825-652f-4409-b71b-4e0105196fc6 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:29.025440 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6ade3825-652f-4409-b71b-4e0105196fc6 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:29.025885 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6ade3825-652f-4409-b71b-4e0105196fc6 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:29.139332 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-6ade3825-652f-4409-b71b-4e0105196fc6 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.158969 Sep 14 08:54:29.141561 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 780/1551] 10.222.0.60 () {60 vars in 1343 bytes} [Wed Sep 14 08:54:28 2022] GET /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd/os-volume_attachments => generated 197 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 08:54:29.660228 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a1fa436b-8c33-41ca-ae4b-aa4a410c10a1 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:54:29.660973 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-a1fa436b-8c33-41ca-ae4b-aa4a410c10a1 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: e4c51c69-8c2e-4202-9c2f-3dfae93392e9] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:54:29.676354 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a1fa436b-8c33-41ca-ae4b-aa4a410c10a1 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:29.684874 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a1fa436b-8c33-41ca-ae4b-aa4a410c10a1 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:29.685428 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a1fa436b-8c33-41ca-ae4b-aa4a410c10a1 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:29.688878 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a1fa436b-8c33-41ca-ae4b-aa4a410c10a1 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:29.689441 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a1fa436b-8c33-41ca-ae4b-aa4a410c10a1 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:29.690045 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a1fa436b-8c33-41ca-ae4b-aa4a410c10a1 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:29.723570 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-a1fa436b-8c33-41ca-ae4b-aa4a410c10a1 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] HTTP exception thrown: Instance e4c51c69-8c2e-4202-9c2f-3dfae93392e9 could not be found. Sep 14 08:54:29.728183 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a1fa436b-8c33-41ca-ae4b-aa4a410c10a1 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Request method failure captured: Sep 14 08:54:29.728183 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/e4c51c69-8c2e-4202-9c2f-3dfae93392e9 HTTP/1.1 Sep 14 08:54:29.728183 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 08:54:29.728183 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 08:54:29.728183 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 08:54:29.728183 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 08:54:29.728183 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 08:54:29.728183 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 08:54:29.728183 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 08:54:29.728183 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 08:54:29.728183 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZVVByT_6-JGS6UV1gPynraxOMsYohkVqemIC6AxwdsIEVt3-ZlTQkPOCxPrHC_cjaYNAxgvgTIAX1mcOvoSIexNXMVze3EWvq2nR2PEgoxW6GhfqTZqbUa3ZV75Ae3Xam85qa2KosJ3BA0xkODZucsmvWQPOUvdvFL_EjszmdH9asc Sep 14 08:54:29.728183 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 08:54:29.728183 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 08:54:29.728183 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 08:54:29.728183 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 08:54:29.728183 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 08:54:29.728183 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 08:54:29.728183 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 8fd62edd611c4390be2403972b99aa15 Sep 14 08:54:29.728183 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-MigrationsAdminTest-1911476068 Sep 14 08:54:29.728183 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 08:54:29.728183 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 08:54:29.730796 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/8fd62edd611c4390be2403972b99aa15"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_8fd62edd611c4390be2403972b99aa15"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8fd62edd611c4390be2403972b99aa15"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8fd62edd611c4390be2403972b99aa15"}]}] Sep 14 08:54:29.730796 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-MigrationsAdminTest-1911476068 Sep 14 08:54:29.730796 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 8fd62edd611c4390be2403972b99aa15 Sep 14 08:54:29.730796 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-MigrationsAdminTest-1911476068 Sep 14 08:54:29.730796 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-MigrationsAdminTest-1911476068-project Sep 14 08:54:29.730796 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 08:54:29.730796 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 08:54:29.730796 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 264fb30236d54248ad0ecf79a177849f Sep 14 08:54:29.730796 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-MigrationsAdminTest-1911476068-project Sep 14 08:54:29.730796 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 08:54:29.730796 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance e4c51c69-8c2e-4202-9c2f-3dfae93392e9 could not be found. Sep 14 08:54:29.730796 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': 'e4c51c69-8c2e-4202-9c2f-3dfae93392e9'} Sep 14 08:54:29.732039 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:54:29.732039 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:54:29.732039 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 08:54:29.732039 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 08:54:29.732039 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 08:54:29.732039 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 08:54:29.732039 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 08:54:29.732039 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 08:54:29.732039 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 08:54:29.732039 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 08:54:29.732039 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4c51c69-8c2e-4202-9c2f-3dfae93392e9 could not be found. Sep 14 08:54:29.732039 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:54:29.732039 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:54:29.732039 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:54:29.732039 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:54:29.732039 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:54:29.732039 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:54:29.732039 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:54:29.732039 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:54:29.732039 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:54:29.734377 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:54:29.734377 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 08:54:29.734377 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 08:54:29.734377 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 08:54:29.734377 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 08:54:29.734377 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 08:54:29.734377 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 08:54:29.734377 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4c51c69-8c2e-4202-9c2f-3dfae93392e9 could not be found. Sep 14 08:54:29.734377 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:54:29.734377 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:54:29.734377 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:54:29.734377 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:54:29.734377 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:54:29.734377 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:54:29.734377 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:54:29.734377 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:54:29.734377 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4c51c69-8c2e-4202-9c2f-3dfae93392e9 could not be found. Sep 14 08:54:29.734377 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:54:29.736234 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a1fa436b-8c33-41ca-ae4b-aa4a410c10a1 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Returning 404 to user: Instance e4c51c69-8c2e-4202-9c2f-3dfae93392e9 could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:54:29.739227 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a1fa436b-8c33-41ca-ae4b-aa4a410c10a1 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/e4c51c69-8c2e-4202-9c2f-3dfae93392e9" status: 404 len: 111 microversion: 2.1 time: 0.077452 Sep 14 08:54:29.740406 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 772/1552] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:54:29 2022] GET /compute/v2.1/servers/e4c51c69-8c2e-4202-9c2f-3dfae93392e9 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 14 08:54:29.750047 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-9b1a9dd1-56ff-492b-bc05-f3a23151bc99 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:54:29.750572 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-9b1a9dd1-56ff-492b-bc05-f3a23151bc99 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: 0a331816-6b06-40c9-a557-eada274501b5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:54:29.775674 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9b1a9dd1-56ff-492b-bc05-f3a23151bc99 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:29.776234 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9b1a9dd1-56ff-492b-bc05-f3a23151bc99 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:29.783591 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9b1a9dd1-56ff-492b-bc05-f3a23151bc99 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:29.791903 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9b1a9dd1-56ff-492b-bc05-f3a23151bc99 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:29.795733 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9b1a9dd1-56ff-492b-bc05-f3a23151bc99 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:29.797398 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9b1a9dd1-56ff-492b-bc05-f3a23151bc99 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:29.867241 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-bad6b55b-25aa-42fd-b939-ec7f1c746ce7 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1798008066", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "903f8700-ae91-4258-934b-4b36ed10458f"}], "security_groups": [{"name": "tempest-securitygroup--1287915456"}], "key_name": "tempest-keypair-617872715", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:54:29.920934 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-9b1a9dd1-56ff-492b-bc05-f3a23151bc99 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: 0a331816-6b06-40c9-a557-eada274501b5] Going to try to terminate instance {{(pid=128758) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 08:54:30.079541 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:54:30.127304 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.network.neutron [None req-bad6b55b-25aa-42fd-b939-ec7f1c746ce7 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] validate_networks() for [('903f8700-ae91-4258-934b-4b36ed10458f', None, None, None, None, None)] {{(pid=128759) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 08:54:30.223014 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-9b1a9dd1-56ff-492b-bc05-f3a23151bc99 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "DELETE /compute/v2.1/servers/0a331816-6b06-40c9-a557-eada274501b5" status: 204 len: 0 microversion: 2.1 time: 0.475491 Sep 14 08:54:30.225875 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 781/1553] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 08:54:29 2022] DELETE /compute/v2.1/servers/0a331816-6b06-40c9-a557-eada274501b5 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 08:54:30.323858 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-3301461e-7674-480c-b16f-e4901c20ce4e tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Action: 'create', calling method: .version_select at 0x7f7d445c99d0>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-1315039038", "policies": ["affinity"]}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:54:30.420408 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-3301461e-7674-480c-b16f-e4901c20ce4e tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Getting quotas for project 92d8190fe7bb40beaea43a71808dc105. Resources: {'server_groups'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 08:54:30.456172 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-3301461e-7674-480c-b16f-e4901c20ce4e tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Getting quotas for user ba4808b3a03f4bd8ad4af900bc926e77 and project 92d8190fe7bb40beaea43a71808dc105. Resources: {'server_groups'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 08:54:30.584481 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-3301461e-7674-480c-b16f-e4901c20ce4e tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Getting quotas for project 92d8190fe7bb40beaea43a71808dc105. Resources: {'server_groups'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 08:54:30.605130 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-3301461e-7674-480c-b16f-e4901c20ce4e tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Getting quotas for user ba4808b3a03f4bd8ad4af900bc926e77 and project 92d8190fe7bb40beaea43a71808dc105. Resources: {'server_groups'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 08:54:30.644785 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-3301461e-7674-480c-b16f-e4901c20ce4e tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] 10.222.0.60 "POST /compute/v2.1/os-server-groups" status: 200 len: 184 microversion: 2.1 time: 0.416439 Sep 14 08:54:30.646656 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 782/1554] 10.222.0.60 () {60 vars in 1174 bytes} [Wed Sep 14 08:54:30 2022] POST /compute/v2.1/os-server-groups => generated 184 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:54:30.668352 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-76ca15ce-10ab-4fd0-9eba-70fa5753cd47 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:54:30.675572 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-76ca15ce-10ab-4fd0-9eba-70fa5753cd47 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: 8fce8438-d6ae-408d-8b4f-ee14d4021fdd] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:54:30.701777 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-76ca15ce-10ab-4fd0-9eba-70fa5753cd47 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:30.704669 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-76ca15ce-10ab-4fd0-9eba-70fa5753cd47 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:30.705960 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-76ca15ce-10ab-4fd0-9eba-70fa5753cd47 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:30.708242 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-76ca15ce-10ab-4fd0-9eba-70fa5753cd47 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:30.714391 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-76ca15ce-10ab-4fd0-9eba-70fa5753cd47 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:30.714850 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-76ca15ce-10ab-4fd0-9eba-70fa5753cd47 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:30.780361 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-76ca15ce-10ab-4fd0-9eba-70fa5753cd47 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.128048 Sep 14 08:54:30.781773 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 783/1555] 10.222.0.60 () {60 vars in 1343 bytes} [Wed Sep 14 08:54:30 2022] GET /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd/os-volume_attachments => generated 197 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 08:54:30.788379 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-0e7af9a7-a6a3-48b5-a0fc-0927430c2dc4 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:54:30.789365 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-0e7af9a7-a6a3-48b5-a0fc-0927430c2dc4 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: 0a331816-6b06-40c9-a557-eada274501b5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:54:30.798768 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0e7af9a7-a6a3-48b5-a0fc-0927430c2dc4 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:30.799809 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0e7af9a7-a6a3-48b5-a0fc-0927430c2dc4 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:30.800816 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0e7af9a7-a6a3-48b5-a0fc-0927430c2dc4 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:30.801865 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0e7af9a7-a6a3-48b5-a0fc-0927430c2dc4 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:30.802598 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0e7af9a7-a6a3-48b5-a0fc-0927430c2dc4 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:30.803298 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0e7af9a7-a6a3-48b5-a0fc-0927430c2dc4 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:31.035694 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-0e7af9a7-a6a3-48b5-a0fc-0927430c2dc4 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:54:31.057938 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-0e7af9a7-a6a3-48b5-a0fc-0927430c2dc4 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/0a331816-6b06-40c9-a557-eada274501b5" status: 200 len: 1466 microversion: 2.1 time: 0.271860 Sep 14 08:54:31.059156 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 784/1556] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:54:30 2022] GET /compute/v2.1/servers/0a331816-6b06-40c9-a557-eada274501b5 => generated 1466 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:54:31.074127 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d8a81f7c-8056-45d5-bb0e-2b1cf4e4976f tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Action: 'create', calling method: .version_select at 0x7f7d445c9820>, body: {"server_group": {"name": "tempest-server-group-1102004731", "policies": ["affinity"]}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:54:31.134322 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-d8a81f7c-8056-45d5-bb0e-2b1cf4e4976f tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Getting quotas for project 92d8190fe7bb40beaea43a71808dc105. Resources: {'server_groups'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 08:54:31.149549 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-d8a81f7c-8056-45d5-bb0e-2b1cf4e4976f tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Getting quotas for user ba4808b3a03f4bd8ad4af900bc926e77 and project 92d8190fe7bb40beaea43a71808dc105. Resources: {'server_groups'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 08:54:31.289579 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-d8a81f7c-8056-45d5-bb0e-2b1cf4e4976f tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Getting quotas for project 92d8190fe7bb40beaea43a71808dc105. Resources: {'server_groups'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 08:54:31.325062 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-d8a81f7c-8056-45d5-bb0e-2b1cf4e4976f tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Getting quotas for user ba4808b3a03f4bd8ad4af900bc926e77 and project 92d8190fe7bb40beaea43a71808dc105. Resources: {'server_groups'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 08:54:31.338742 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=1,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:54:31.386910 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-d8a81f7c-8056-45d5-bb0e-2b1cf4e4976f tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] 10.222.0.60 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.323346 Sep 14 08:54:31.401235 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 785/1557] 10.222.0.60 () {60 vars in 1173 bytes} [Wed Sep 14 08:54:31 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:54:31.446168 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c9721e3a-df26-4768-ac32-dde2aa3c471a tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Action: 'create', calling method: .version_select at 0x7f7d44547ee0>, body: {"server_group": {"name": "tempest-server-group-1102004731", "policies": ["affinity"]}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:54:31.499297 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-c9721e3a-df26-4768-ac32-dde2aa3c471a tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Getting quotas for project 92d8190fe7bb40beaea43a71808dc105. Resources: {'server_groups'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 08:54:31.512454 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-c9721e3a-df26-4768-ac32-dde2aa3c471a tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Getting quotas for user ba4808b3a03f4bd8ad4af900bc926e77 and project 92d8190fe7bb40beaea43a71808dc105. Resources: {'server_groups'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 08:54:31.643351 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-c9721e3a-df26-4768-ac32-dde2aa3c471a tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Getting quotas for project 92d8190fe7bb40beaea43a71808dc105. Resources: {'server_groups'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 08:54:31.669001 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-c9721e3a-df26-4768-ac32-dde2aa3c471a tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Getting quotas for user ba4808b3a03f4bd8ad4af900bc926e77 and project 92d8190fe7bb40beaea43a71808dc105. Resources: {'server_groups'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 08:54:31.742795 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-c9721e3a-df26-4768-ac32-dde2aa3c471a tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] 10.222.0.60 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.324725 Sep 14 08:54:31.749079 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 786/1558] 10.222.0.60 () {60 vars in 1173 bytes} [Wed Sep 14 08:54:31 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:54:31.761287 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-841203e9-fe62-44fe-b73d-b4ae552129c1 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:54:31.875217 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-841203e9-fe62-44fe-b73d-b4ae552129c1 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] 10.222.0.60 "DELETE /compute/v2.1/os-server-groups/705d24c3-77f2-49fc-89f0-d889411329a2" status: 204 len: 0 microversion: 2.1 time: 0.121501 Sep 14 08:54:31.879903 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 787/1559] 10.222.0.60 () {58 vars in 1266 bytes} [Wed Sep 14 08:54:31 2022] DELETE /compute/v2.1/os-server-groups/705d24c3-77f2-49fc-89f0-d889411329a2 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 14 08:54:31.892616 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-7cfe7d24-ec58-4526-a2f3-29971e6aa93e tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:54:31.904203 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-7cfe7d24-ec58-4526-a2f3-29971e6aa93e tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: 8fce8438-d6ae-408d-8b4f-ee14d4021fdd] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:54:31.932290 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7cfe7d24-ec58-4526-a2f3-29971e6aa93e tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:31.936112 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7cfe7d24-ec58-4526-a2f3-29971e6aa93e tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:31.943694 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7cfe7d24-ec58-4526-a2f3-29971e6aa93e tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:31.947819 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7cfe7d24-ec58-4526-a2f3-29971e6aa93e tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:31.948350 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7cfe7d24-ec58-4526-a2f3-29971e6aa93e tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:31.948797 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7cfe7d24-ec58-4526-a2f3-29971e6aa93e tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:32.056068 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-7cfe7d24-ec58-4526-a2f3-29971e6aa93e tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.174982 Sep 14 08:54:32.056672 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 788/1560] 10.222.0.60 () {60 vars in 1343 bytes} [Wed Sep 14 08:54:31 2022] GET /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd/os-volume_attachments => generated 197 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 08:54:32.069161 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d40ea28f-67bc-4b41-a029-98dc7410f1d1 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:54:32.101354 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-d40ea28f-67bc-4b41-a029-98dc7410f1d1 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] 10.222.0.60 "GET /compute/v2.1/os-server-groups" status: 200 len: 335 microversion: 2.1 time: 0.043586 Sep 14 08:54:32.102382 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 789/1561] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Sep 14 08:54:32 2022] GET /compute/v2.1/os-server-groups => generated 335 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:54:32.106928 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-e62580fa-1033-4d91-91d7-e6aa7b6028c3 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:54:32.107280 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-bad6b55b-25aa-42fd-b939-ec7f1c746ce7 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Getting quotas for project 659a963df1b646f1918426fe1a7cb23c. Resources: dict_keys(['metadata_items']) {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 08:54:32.107863 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-e62580fa-1033-4d91-91d7-e6aa7b6028c3 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: 0a331816-6b06-40c9-a557-eada274501b5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:54:32.114340 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e62580fa-1033-4d91-91d7-e6aa7b6028c3 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:32.115892 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e62580fa-1033-4d91-91d7-e6aa7b6028c3 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:32.116544 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e62580fa-1033-4d91-91d7-e6aa7b6028c3 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:32.117441 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e62580fa-1033-4d91-91d7-e6aa7b6028c3 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:32.118066 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e62580fa-1033-4d91-91d7-e6aa7b6028c3 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:32.118655 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e62580fa-1033-4d91-91d7-e6aa7b6028c3 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:32.129672 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-bad6b55b-25aa-42fd-b939-ec7f1c746ce7 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Getting quotas for user 5040fc9212814c4fa9e038116578eebd and project 659a963df1b646f1918426fe1a7cb23c. Resources: dict_keys(['metadata_items']) {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 08:54:32.182647 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-bad6b55b-25aa-42fd-b939-ec7f1c746ce7 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Flavor limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 08:54:32.183422 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-bad6b55b-25aa-42fd-b939-ec7f1c746ce7 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Image limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 08:54:32.185959 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-bad6b55b-25aa-42fd-b939-ec7f1c746ce7 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Flavor pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 08:54:32.186963 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-bad6b55b-25aa-42fd-b939-ec7f1c746ce7 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Image pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 08:54:32.188533 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-bad6b55b-25aa-42fd-b939-ec7f1c746ce7 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 08:54:32.214342 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bad6b55b-25aa-42fd-b939-ec7f1c746ce7 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:32.215143 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bad6b55b-25aa-42fd-b939-ec7f1c746ce7 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:32.215803 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bad6b55b-25aa-42fd-b939-ec7f1c746ce7 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:32.218984 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bad6b55b-25aa-42fd-b939-ec7f1c746ce7 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:32.219709 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bad6b55b-25aa-42fd-b939-ec7f1c746ce7 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:32.220848 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bad6b55b-25aa-42fd-b939-ec7f1c746ce7 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:32.303559 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-bad6b55b-25aa-42fd-b939-ec7f1c746ce7 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Getting quotas for project 659a963df1b646f1918426fe1a7cb23c. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 08:54:32.323131 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-bad6b55b-25aa-42fd-b939-ec7f1c746ce7 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Getting quotas for user 5040fc9212814c4fa9e038116578eebd and project 659a963df1b646f1918426fe1a7cb23c. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 08:54:32.369599 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-bad6b55b-25aa-42fd-b939-ec7f1c746ce7 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Going to run 1 instances... {{(pid=128759) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 08:54:32.375411 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-bad6b55b-25aa-42fd-b939-ec7f1c746ce7 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] [instance: a4474e04-7712-41de-bbf8-a872101a9808] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128759) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 08:54:32.531830 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-bad6b55b-25aa-42fd-b939-ec7f1c746ce7 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 2.669379 Sep 14 08:54:32.532492 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 773/1562] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 08:54:29 2022] POST /compute/v2.1/servers => generated 407 bytes in 2671 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 08:54:32.552860 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-11e1e29a-6ad4-49b3-bd2e-81918173d303 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:54:32.647906 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-11e1e29a-6ad4-49b3-bd2e-81918173d303 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] 10.222.0.60 "DELETE /compute/v2.1/os-server-groups/c46b8359-ff9c-4ade-825c-98256d3f2a76" status: 204 len: 0 microversion: 2.1 time: 0.107821 Sep 14 08:54:32.651432 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 774/1563] 10.222.0.60 () {58 vars in 1266 bytes} [Wed Sep 14 08:54:32 2022] DELETE /compute/v2.1/os-server-groups/c46b8359-ff9c-4ade-825c-98256d3f2a76 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 08:54:32.654043 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-00a00950-5d6e-45f1-8f39-6cc6d71bda9c tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:54:32.666242 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-00a00950-5d6e-45f1-8f39-6cc6d71bda9c tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] [instance: a4474e04-7712-41de-bbf8-a872101a9808] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:54:32.698032 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=4,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:54:32.859101 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-e62580fa-1033-4d91-91d7-e6aa7b6028c3 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:54:32.889244 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-e62580fa-1033-4d91-91d7-e6aa7b6028c3 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/0a331816-6b06-40c9-a557-eada274501b5" status: 200 len: 1466 microversion: 2.1 time: 0.785753 Sep 14 08:54:32.904395 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 790/1564] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:54:32 2022] GET /compute/v2.1/servers/0a331816-6b06-40c9-a557-eada274501b5 => generated 1466 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:54:32.904395 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-4b09c5d9-2a06-4f14-bdce-5deeb497a7b1 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:54:32.969979 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-4b09c5d9-2a06-4f14-bdce-5deeb497a7b1 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] 10.222.0.60 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.072607 Sep 14 08:54:32.970592 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 791/1565] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Sep 14 08:54:32 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:54:32.982905 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-00a00950-5d6e-45f1-8f39-6cc6d71bda9c tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5040fc9212814c4fa9e038116578eebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a963df1b646f1918426fe1a7cb23c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:54:32.990065 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-f25770e2-0435-4ba8-a317-ed4cf8472d91 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Action: 'create', calling method: .version_select at 0x7f7d443ae4c0>, body: {"server_group": {"name": "tempest-server-group-540229686", "policies": ["affinity"]}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:54:32.991253 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-00a00950-5d6e-45f1-8f39-6cc6d71bda9c tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] 10.222.0.60 "GET /compute/v2.1/servers/a4474e04-7712-41de-bbf8-a872101a9808" status: 200 len: 1269 microversion: 2.1 time: 0.341203 Sep 14 08:54:32.991845 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 775/1566] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:54:32 2022] GET /compute/v2.1/servers/a4474e04-7712-41de-bbf8-a872101a9808 => generated 1269 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:54:33.061038 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-f25770e2-0435-4ba8-a317-ed4cf8472d91 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Getting quotas for project 92d8190fe7bb40beaea43a71808dc105. Resources: {'server_groups'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 08:54:33.069940 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-de346cc1-a50b-425c-a70d-a0c73241caff tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:54:33.072342 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-de346cc1-a50b-425c-a70d-a0c73241caff tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: 8fce8438-d6ae-408d-8b4f-ee14d4021fdd] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:54:33.076518 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-f25770e2-0435-4ba8-a317-ed4cf8472d91 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Getting quotas for user ba4808b3a03f4bd8ad4af900bc926e77 and project 92d8190fe7bb40beaea43a71808dc105. Resources: {'server_groups'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 08:54:33.092876 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-de346cc1-a50b-425c-a70d-a0c73241caff tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:33.093386 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-de346cc1-a50b-425c-a70d-a0c73241caff tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:33.093831 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-de346cc1-a50b-425c-a70d-a0c73241caff tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:33.094550 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-de346cc1-a50b-425c-a70d-a0c73241caff tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:33.095037 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-de346cc1-a50b-425c-a70d-a0c73241caff tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:33.095467 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-de346cc1-a50b-425c-a70d-a0c73241caff tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:33.161913 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-f25770e2-0435-4ba8-a317-ed4cf8472d91 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Getting quotas for project 92d8190fe7bb40beaea43a71808dc105. Resources: {'server_groups'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 08:54:33.168606 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-f25770e2-0435-4ba8-a317-ed4cf8472d91 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Getting quotas for user ba4808b3a03f4bd8ad4af900bc926e77 and project 92d8190fe7bb40beaea43a71808dc105. Resources: {'server_groups'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 08:54:33.184785 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-f25770e2-0435-4ba8-a317-ed4cf8472d91 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] 10.222.0.60 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.200090 Sep 14 08:54:33.186043 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 792/1567] 10.222.0.60 () {60 vars in 1173 bytes} [Wed Sep 14 08:54:32 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 08:54:33.197911 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-075d3ed7-95e5-4718-a082-fe98904fd8fd tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:54:33.234568 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-de346cc1-a50b-425c-a70d-a0c73241caff tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.169188 Sep 14 08:54:33.235690 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 776/1568] 10.222.0.60 () {60 vars in 1343 bytes} [Wed Sep 14 08:54:33 2022] GET /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd/os-volume_attachments => generated 197 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 08:54:33.238788 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-075d3ed7-95e5-4718-a082-fe98904fd8fd tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] 10.222.0.60 "DELETE /compute/v2.1/os-server-groups/19e0a0f8-6176-405f-b85d-31819295e96a" status: 204 len: 0 microversion: 2.1 time: 0.044822 Sep 14 08:54:33.242554 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 793/1569] 10.222.0.60 () {58 vars in 1266 bytes} [Wed Sep 14 08:54:33 2022] DELETE /compute/v2.1/os-server-groups/19e0a0f8-6176-405f-b85d-31819295e96a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 08:54:33.260150 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3adc8a86-9ed0-4fb0-a681-05338b55df1b tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:54:33.294591 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-3adc8a86-9ed0-4fb0-a681-05338b55df1b tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] 10.222.0.60 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.047536 Sep 14 08:54:33.324634 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 777/1570] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Sep 14 08:54:33 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:54:33.331454 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a9aec7b1-eb6a-43b7-b366-e03457494379 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Action: 'create', calling method: .version_select at 0x7f7d445d9ca0>, body: {"server_group": {"name": "tempest-server-group-413745927", "policies": ["anti-affinity"]}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:54:33.389298 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-a9aec7b1-eb6a-43b7-b366-e03457494379 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Getting quotas for project 92d8190fe7bb40beaea43a71808dc105. Resources: {'server_groups'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 08:54:33.405973 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-a9aec7b1-eb6a-43b7-b366-e03457494379 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Getting quotas for user ba4808b3a03f4bd8ad4af900bc926e77 and project 92d8190fe7bb40beaea43a71808dc105. Resources: {'server_groups'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 08:54:33.495325 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=6,nova_api:DELETE=6 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:54:33.525584 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-a9aec7b1-eb6a-43b7-b366-e03457494379 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Getting quotas for project 92d8190fe7bb40beaea43a71808dc105. Resources: {'server_groups'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 08:54:33.563399 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-a9aec7b1-eb6a-43b7-b366-e03457494379 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Getting quotas for user ba4808b3a03f4bd8ad4af900bc926e77 and project 92d8190fe7bb40beaea43a71808dc105. Resources: {'server_groups'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 08:54:33.611021 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-a9aec7b1-eb6a-43b7-b366-e03457494379 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] 10.222.0.60 "POST /compute/v2.1/os-server-groups" status: 200 len: 168 microversion: 2.1 time: 0.285352 Sep 14 08:54:33.623239 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 794/1571] 10.222.0.60 () {60 vars in 1173 bytes} [Wed Sep 14 08:54:33 2022] POST /compute/v2.1/os-server-groups => generated 168 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 08:54:33.637999 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-adb30bd3-d2f0-4b4d-9158-6fe4ba409bad tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:54:33.703436 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-adb30bd3-d2f0-4b4d-9158-6fe4ba409bad tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] 10.222.0.60 "DELETE /compute/v2.1/os-server-groups/c938e012-4c73-4f59-94c5-1ddb754943e7" status: 204 len: 0 microversion: 2.1 time: 0.073883 Sep 14 08:54:33.708747 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 778/1572] 10.222.0.60 () {58 vars in 1266 bytes} [Wed Sep 14 08:54:33 2022] DELETE /compute/v2.1/os-server-groups/c938e012-4c73-4f59-94c5-1ddb754943e7 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 08:54:33.714664 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-99e7a2d7-d6ab-4489-92ba-d96578656a77 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:54:33.747254 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-99e7a2d7-d6ab-4489-92ba-d96578656a77 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] 10.222.0.60 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.035408 Sep 14 08:54:33.750242 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 795/1573] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Sep 14 08:54:33 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:54:33.902376 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f8c6946f-a5f0-403c-ae1a-c7ac19055718 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-443150855", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "networks": [{"uuid": "8301b7e7-ebbd-4512-8ce8-af9306430358"}]}, "os:scheduler_hints": {"group": "ab23666b-035e-4c9f-88a6-d3e41c2eebf9"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:54:33.919728 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-74e3111f-f0d7-44b6-8918-cc38224ec6b1 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:54:33.921395 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-74e3111f-f0d7-44b6-8918-cc38224ec6b1 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: 0a331816-6b06-40c9-a557-eada274501b5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:54:33.970333 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-74e3111f-f0d7-44b6-8918-cc38224ec6b1 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:33.973346 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-74e3111f-f0d7-44b6-8918-cc38224ec6b1 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:33.973863 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-74e3111f-f0d7-44b6-8918-cc38224ec6b1 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:33.974632 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-74e3111f-f0d7-44b6-8918-cc38224ec6b1 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:33.975129 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-74e3111f-f0d7-44b6-8918-cc38224ec6b1 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:33.985018 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-74e3111f-f0d7-44b6-8918-cc38224ec6b1 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:34.028223 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.network.neutron [None req-f8c6946f-a5f0-403c-ae1a-c7ac19055718 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] validate_networks() for [('8301b7e7-ebbd-4512-8ce8-af9306430358', None, None, None, None, None)] {{(pid=128759) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 08:54:34.735433 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-74e3111f-f0d7-44b6-8918-cc38224ec6b1 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264fb30236d54248ad0ecf79a177849f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd62edd611c4390be2403972b99aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:54:34.747405 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-74e3111f-f0d7-44b6-8918-cc38224ec6b1 tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/0a331816-6b06-40c9-a557-eada274501b5" status: 200 len: 1424 microversion: 2.1 time: 0.833541 Sep 14 08:54:34.761294 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 796/1574] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:54:33 2022] GET /compute/v2.1/servers/0a331816-6b06-40c9-a557-eada274501b5 => generated 1424 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:54:34.778551 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d14a695f-3f5b-4208-bcaf-f8e027781536 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:54:34.779326 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-d14a695f-3f5b-4208-bcaf-f8e027781536 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] [instance: a4474e04-7712-41de-bbf8-a872101a9808] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:54:34.812126 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d14a695f-3f5b-4208-bcaf-f8e027781536 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:34.812595 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d14a695f-3f5b-4208-bcaf-f8e027781536 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:34.813038 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d14a695f-3f5b-4208-bcaf-f8e027781536 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:34.827531 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d14a695f-3f5b-4208-bcaf-f8e027781536 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:34.828079 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d14a695f-3f5b-4208-bcaf-f8e027781536 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:34.828527 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d14a695f-3f5b-4208-bcaf-f8e027781536 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:34.984697 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-d14a695f-3f5b-4208-bcaf-f8e027781536 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5040fc9212814c4fa9e038116578eebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a963df1b646f1918426fe1a7cb23c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:54:35.003280 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-d14a695f-3f5b-4208-bcaf-f8e027781536 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] 10.222.0.60 "GET /compute/v2.1/servers/a4474e04-7712-41de-bbf8-a872101a9808" status: 200 len: 1265 microversion: 2.1 time: 0.240116 Sep 14 08:54:35.003896 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 797/1575] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:54:34 2022] GET /compute/v2.1/servers/a4474e04-7712-41de-bbf8-a872101a9808 => generated 1265 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:54:35.017401 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-89272a60-9145-4ff1-84fd-7d0275e48e5a req-1242798c-b6c6-43ab-9b25-c5668ca30339 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a331816-6b06-40c9-a557-eada274501b5", "name": "network-vif-deleted", "tag": "667429a7-9153-49c5-a750-cc44e1cd077d"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:54:35.062051 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-89272a60-9145-4ff1-84fd-7d0275e48e5a req-1242798c-b6c6-43ab-9b25-c5668ca30339 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:35.062534 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-89272a60-9145-4ff1-84fd-7d0275e48e5a req-1242798c-b6c6-43ab-9b25-c5668ca30339 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:35.062995 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-89272a60-9145-4ff1-84fd-7d0275e48e5a req-1242798c-b6c6-43ab-9b25-c5668ca30339 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:35.114969 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-89272a60-9145-4ff1-84fd-7d0275e48e5a req-1242798c-b6c6-43ab-9b25-c5668ca30339 service nova] Creating event network-vif-deleted:667429a7-9153-49c5-a750-cc44e1cd077d for instance 0a331816-6b06-40c9-a557-eada274501b5 on n-h2-836830-18 Sep 14 08:54:35.114969 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-89272a60-9145-4ff1-84fd-7d0275e48e5a req-1242798c-b6c6-43ab-9b25-c5668ca30339 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101205 Sep 14 08:54:35.114969 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 798/1576] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:54:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:54:35.142172 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b7d0f8bf-6d52-49fc-8a60-22f52c8559e2 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:54:35.154667 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-b7d0f8bf-6d52-49fc-8a60-22f52c8559e2 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: 8fce8438-d6ae-408d-8b4f-ee14d4021fdd] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:54:35.180442 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b7d0f8bf-6d52-49fc-8a60-22f52c8559e2 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:35.181437 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b7d0f8bf-6d52-49fc-8a60-22f52c8559e2 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:35.182060 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b7d0f8bf-6d52-49fc-8a60-22f52c8559e2 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:35.183760 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b7d0f8bf-6d52-49fc-8a60-22f52c8559e2 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:35.184706 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b7d0f8bf-6d52-49fc-8a60-22f52c8559e2 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:35.188024 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b7d0f8bf-6d52-49fc-8a60-22f52c8559e2 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:35.291233 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-b7d0f8bf-6d52-49fc-8a60-22f52c8559e2 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.175458 Sep 14 08:54:35.293998 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 799/1577] 10.222.0.60 () {60 vars in 1343 bytes} [Wed Sep 14 08:54:35 2022] GET /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd/os-volume_attachments => generated 25 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:54:35.403135 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-f8c6946f-a5f0-403c-ae1a-c7ac19055718 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Flavor limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 08:54:35.404510 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-f8c6946f-a5f0-403c-ae1a-c7ac19055718 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Image limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 08:54:35.405329 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-f8c6946f-a5f0-403c-ae1a-c7ac19055718 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Flavor pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 08:54:35.406239 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-f8c6946f-a5f0-403c-ae1a-c7ac19055718 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Image pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 08:54:35.406881 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-f8c6946f-a5f0-403c-ae1a-c7ac19055718 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 08:54:35.424070 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f8c6946f-a5f0-403c-ae1a-c7ac19055718 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:35.424935 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f8c6946f-a5f0-403c-ae1a-c7ac19055718 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:35.425707 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f8c6946f-a5f0-403c-ae1a-c7ac19055718 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:35.430085 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f8c6946f-a5f0-403c-ae1a-c7ac19055718 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:35.431033 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f8c6946f-a5f0-403c-ae1a-c7ac19055718 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:35.431691 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f8c6946f-a5f0-403c-ae1a-c7ac19055718 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:35.462132 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-f8c6946f-a5f0-403c-ae1a-c7ac19055718 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Getting quotas for project 92d8190fe7bb40beaea43a71808dc105. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 08:54:35.470626 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-f8c6946f-a5f0-403c-ae1a-c7ac19055718 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Getting quotas for user ba4808b3a03f4bd8ad4af900bc926e77 and project 92d8190fe7bb40beaea43a71808dc105. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 08:54:35.493671 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f8c6946f-a5f0-403c-ae1a-c7ac19055718 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Going to run 1 instances... {{(pid=128759) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 08:54:35.496918 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f8c6946f-a5f0-403c-ae1a-c7ac19055718 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] [instance: c9ccb0fe-b328-45f9-811f-a0ad6068875e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128759) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 08:54:35.581820 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-f8c6946f-a5f0-403c-ae1a-c7ac19055718 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Getting quotas for project 92d8190fe7bb40beaea43a71808dc105. Resources: {'server_group_members'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 08:54:35.602443 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-f8c6946f-a5f0-403c-ae1a-c7ac19055718 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Getting quotas for user ba4808b3a03f4bd8ad4af900bc926e77 and project 92d8190fe7bb40beaea43a71808dc105. Resources: {'server_group_members'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 08:54:35.722801 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-f8c6946f-a5f0-403c-ae1a-c7ac19055718 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Getting quotas for project 92d8190fe7bb40beaea43a71808dc105. Resources: {'server_group_members'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 08:54:35.729714 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-f8c6946f-a5f0-403c-ae1a-c7ac19055718 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Getting quotas for user ba4808b3a03f4bd8ad4af900bc926e77 and project 92d8190fe7bb40beaea43a71808dc105. Resources: {'server_group_members'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 08:54:35.776651 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-0a7fe859-7318-46d9-bfe1-e6fac4ee09bb tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:54:35.777406 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-0a7fe859-7318-46d9-bfe1-e6fac4ee09bb tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] [instance: 0a331816-6b06-40c9-a557-eada274501b5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:54:35.787881 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0a7fe859-7318-46d9-bfe1-e6fac4ee09bb tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:35.794458 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0a7fe859-7318-46d9-bfe1-e6fac4ee09bb tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:35.794458 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0a7fe859-7318-46d9-bfe1-e6fac4ee09bb tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:35.794458 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0a7fe859-7318-46d9-bfe1-e6fac4ee09bb tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:35.794458 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0a7fe859-7318-46d9-bfe1-e6fac4ee09bb tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:35.796609 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0a7fe859-7318-46d9-bfe1-e6fac4ee09bb tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:35.811791 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f8c6946f-a5f0-403c-ae1a-c7ac19055718 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.914037 Sep 14 08:54:35.812764 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 779/1578] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 08:54:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1916 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 08:54:35.825732 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9c13c439-7111-4bb8-b680-b631211f36d9 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:54:35.826929 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-9c13c439-7111-4bb8-b680-b631211f36d9 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] [instance: c9ccb0fe-b328-45f9-811f-a0ad6068875e] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:54:35.858138 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-0a7fe859-7318-46d9-bfe1-e6fac4ee09bb tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] HTTP exception thrown: Instance 0a331816-6b06-40c9-a557-eada274501b5 could not be found. Sep 14 08:54:35.864934 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-0a7fe859-7318-46d9-bfe1-e6fac4ee09bb tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Request method failure captured: Sep 14 08:54:35.864934 n-d-836830-18 devstack@n-api.service[128758]: request: GET /compute/v2.1/servers/0a331816-6b06-40c9-a557-eada274501b5 HTTP/1.1 Sep 14 08:54:35.864934 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 08:54:35.864934 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 08:54:35.864934 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 08:54:35.864934 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 08:54:35.864934 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 08:54:35.864934 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 08:54:35.864934 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 08:54:35.864934 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 08:54:35.864934 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZVVByT_6-JGS6UV1gPynraxOMsYohkVqemIC6AxwdsIEVt3-ZlTQkPOCxPrHC_cjaYNAxgvgTIAX1mcOvoSIexNXMVze3EWvq2nR2PEgoxW6GhfqTZqbUa3ZV75Ae3Xam85qa2KosJ3BA0xkODZucsmvWQPOUvdvFL_EjszmdH9asc Sep 14 08:54:35.864934 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 08:54:35.864934 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 08:54:35.864934 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 08:54:35.864934 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 08:54:35.864934 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 08:54:35.864934 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 08:54:35.864934 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 8fd62edd611c4390be2403972b99aa15 Sep 14 08:54:35.864934 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-MigrationsAdminTest-1911476068 Sep 14 08:54:35.864934 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 08:54:35.864934 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 08:54:35.866778 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/8fd62edd611c4390be2403972b99aa15"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_8fd62edd611c4390be2403972b99aa15"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8fd62edd611c4390be2403972b99aa15"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8fd62edd611c4390be2403972b99aa15"}]}] Sep 14 08:54:35.866778 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-MigrationsAdminTest-1911476068 Sep 14 08:54:35.866778 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 8fd62edd611c4390be2403972b99aa15 Sep 14 08:54:35.866778 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-MigrationsAdminTest-1911476068 Sep 14 08:54:35.866778 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-MigrationsAdminTest-1911476068-project Sep 14 08:54:35.866778 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 08:54:35.866778 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 08:54:35.866778 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 264fb30236d54248ad0ecf79a177849f Sep 14 08:54:35.866778 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-MigrationsAdminTest-1911476068-project Sep 14 08:54:35.866778 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 08:54:35.866778 n-d-836830-18 devstack@n-api.service[128758]: exception: Instance 0a331816-6b06-40c9-a557-eada274501b5 could not be found. Sep 14 08:54:35.866778 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': '0a331816-6b06-40c9-a557-eada274501b5'} Sep 14 08:54:35.867960 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:54:35.867960 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:54:35.867960 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 08:54:35.867960 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 08:54:35.867960 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 08:54:35.867960 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 08:54:35.867960 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 08:54:35.867960 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 08:54:35.867960 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 08:54:35.867960 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 08:54:35.867960 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a331816-6b06-40c9-a557-eada274501b5 could not be found. Sep 14 08:54:35.867960 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:54:35.867960 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:54:35.867960 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:54:35.867960 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:54:35.867960 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:54:35.867960 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:54:35.867960 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:54:35.867960 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:54:35.867960 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:54:35.869621 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:54:35.869621 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 08:54:35.869621 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 08:54:35.869621 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 08:54:35.869621 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 08:54:35.869621 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 08:54:35.869621 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 08:54:35.869621 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a331816-6b06-40c9-a557-eada274501b5 could not be found. Sep 14 08:54:35.869621 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:54:35.869621 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:54:35.869621 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:54:35.869621 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:54:35.869621 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:54:35.869621 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:54:35.869621 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:54:35.869621 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:54:35.869621 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a331816-6b06-40c9-a557-eada274501b5 could not be found. Sep 14 08:54:35.869621 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:54:35.870990 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-0a7fe859-7318-46d9-bfe1-e6fac4ee09bb tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] Returning 404 to user: Instance 0a331816-6b06-40c9-a557-eada274501b5 could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:54:35.870990 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-0a7fe859-7318-46d9-bfe1-e6fac4ee09bb tempest-MigrationsAdminTest-1911476068 tempest-MigrationsAdminTest-1911476068-project] 10.222.0.60 "GET /compute/v2.1/servers/0a331816-6b06-40c9-a557-eada274501b5" status: 404 len: 111 microversion: 2.1 time: 0.097438 Sep 14 08:54:35.872368 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 800/1579] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:54:35 2022] GET /compute/v2.1/servers/0a331816-6b06-40c9-a557-eada274501b5 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 08:54:36.029835 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-77d61263-6c33-4816-85c9-bc1c90635e67 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:54:36.030557 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-77d61263-6c33-4816-85c9-bc1c90635e67 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] [instance: a4474e04-7712-41de-bbf8-a872101a9808] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:54:36.056339 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-77d61263-6c33-4816-85c9-bc1c90635e67 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:36.058767 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-77d61263-6c33-4816-85c9-bc1c90635e67 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:36.060085 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-77d61263-6c33-4816-85c9-bc1c90635e67 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:36.063856 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-77d61263-6c33-4816-85c9-bc1c90635e67 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:36.066088 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-77d61263-6c33-4816-85c9-bc1c90635e67 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:36.067455 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-77d61263-6c33-4816-85c9-bc1c90635e67 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:36.752511 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-9c13c439-7111-4bb8-b680-b631211f36d9 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4808b3a03f4bd8ad4af900bc926e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d8190fe7bb40beaea43a71808dc105', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:54:36.767188 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-9c13c439-7111-4bb8-b680-b631211f36d9 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] 10.222.0.60 "GET /compute/v2.1/servers/c9ccb0fe-b328-45f9-811f-a0ad6068875e" status: 200 len: 1212 microversion: 2.1 time: 0.944796 Sep 14 08:54:36.771276 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 780/1580] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:54:35 2022] GET /compute/v2.1/servers/c9ccb0fe-b328-45f9-811f-a0ad6068875e => generated 1212 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:54:36.781642 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-77d61263-6c33-4816-85c9-bc1c90635e67 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5040fc9212814c4fa9e038116578eebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a963df1b646f1918426fe1a7cb23c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:54:36.806988 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-77d61263-6c33-4816-85c9-bc1c90635e67 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] 10.222.0.60 "GET /compute/v2.1/servers/a4474e04-7712-41de-bbf8-a872101a9808" status: 200 len: 1321 microversion: 2.1 time: 0.783848 Sep 14 08:54:36.818906 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 801/1581] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:54:36 2022] GET /compute/v2.1/servers/a4474e04-7712-41de-bbf8-a872101a9808 => generated 1321 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:54:37.809944 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a92826ca-6667-4bc1-8388-e71b5d83568c tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:54:37.810821 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-a92826ca-6667-4bc1-8388-e71b5d83568c tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] [instance: c9ccb0fe-b328-45f9-811f-a0ad6068875e] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:54:37.848328 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-580769cd-cc5b-4ffb-bcbe-11ff4f7218d6 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:54:37.851121 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-580769cd-cc5b-4ffb-bcbe-11ff4f7218d6 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] [instance: a4474e04-7712-41de-bbf8-a872101a9808] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:54:37.862105 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a92826ca-6667-4bc1-8388-e71b5d83568c tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:37.868206 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a92826ca-6667-4bc1-8388-e71b5d83568c tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:37.868765 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a92826ca-6667-4bc1-8388-e71b5d83568c tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:37.869511 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a92826ca-6667-4bc1-8388-e71b5d83568c tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:37.869981 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a92826ca-6667-4bc1-8388-e71b5d83568c tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:37.870400 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a92826ca-6667-4bc1-8388-e71b5d83568c tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:37.874509 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-580769cd-cc5b-4ffb-bcbe-11ff4f7218d6 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:37.878026 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-580769cd-cc5b-4ffb-bcbe-11ff4f7218d6 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:37.883575 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-580769cd-cc5b-4ffb-bcbe-11ff4f7218d6 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:37.884627 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-580769cd-cc5b-4ffb-bcbe-11ff4f7218d6 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:37.886978 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-580769cd-cc5b-4ffb-bcbe-11ff4f7218d6 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:37.892561 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-580769cd-cc5b-4ffb-bcbe-11ff4f7218d6 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:38.122665 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-580769cd-cc5b-4ffb-bcbe-11ff4f7218d6 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5040fc9212814c4fa9e038116578eebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a963df1b646f1918426fe1a7cb23c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:54:38.164641 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-580769cd-cc5b-4ffb-bcbe-11ff4f7218d6 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] 10.222.0.60 "GET /compute/v2.1/servers/a4474e04-7712-41de-bbf8-a872101a9808" status: 200 len: 1327 microversion: 2.1 time: 0.324676 Sep 14 08:54:38.166732 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 802/1582] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:54:37 2022] GET /compute/v2.1/servers/a4474e04-7712-41de-bbf8-a872101a9808 => generated 1327 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:54:38.341716 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-a92826ca-6667-4bc1-8388-e71b5d83568c tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4808b3a03f4bd8ad4af900bc926e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d8190fe7bb40beaea43a71808dc105', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:54:38.364854 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a92826ca-6667-4bc1-8388-e71b5d83568c tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] 10.222.0.60 "GET /compute/v2.1/servers/c9ccb0fe-b328-45f9-811f-a0ad6068875e" status: 200 len: 1208 microversion: 2.1 time: 0.567359 Sep 14 08:54:38.371245 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 781/1583] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:54:37 2022] GET /compute/v2.1/servers/c9ccb0fe-b328-45f9-811f-a0ad6068875e => generated 1208 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:54:39.195838 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-610eaca9-682e-4efe-abc6-89fae1374172 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:54:39.197077 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-610eaca9-682e-4efe-abc6-89fae1374172 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] [instance: a4474e04-7712-41de-bbf8-a872101a9808] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:54:39.266537 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-610eaca9-682e-4efe-abc6-89fae1374172 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:39.271640 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-610eaca9-682e-4efe-abc6-89fae1374172 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:39.271854 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-610eaca9-682e-4efe-abc6-89fae1374172 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:39.275562 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-610eaca9-682e-4efe-abc6-89fae1374172 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:39.276083 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-610eaca9-682e-4efe-abc6-89fae1374172 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:39.289466 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-610eaca9-682e-4efe-abc6-89fae1374172 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:39.390805 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-656486cf-3f67-403b-b680-230bd1990986 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:54:39.393085 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-656486cf-3f67-403b-b680-230bd1990986 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] [instance: c9ccb0fe-b328-45f9-811f-a0ad6068875e] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:54:39.428935 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-656486cf-3f67-403b-b680-230bd1990986 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:39.462253 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-656486cf-3f67-403b-b680-230bd1990986 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:39.464419 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-656486cf-3f67-403b-b680-230bd1990986 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:39.474280 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-656486cf-3f67-403b-b680-230bd1990986 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:39.484649 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-656486cf-3f67-403b-b680-230bd1990986 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:39.486190 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-656486cf-3f67-403b-b680-230bd1990986 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:40.305493 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-656486cf-3f67-403b-b680-230bd1990986 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4808b3a03f4bd8ad4af900bc926e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d8190fe7bb40beaea43a71808dc105', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:54:40.340168 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-656486cf-3f67-403b-b680-230bd1990986 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] 10.222.0.60 "GET /compute/v2.1/servers/c9ccb0fe-b328-45f9-811f-a0ad6068875e" status: 200 len: 1272 microversion: 2.1 time: 0.950309 Sep 14 08:54:40.361767 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 782/1584] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:54:39 2022] GET /compute/v2.1/servers/c9ccb0fe-b328-45f9-811f-a0ad6068875e => generated 1272 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:54:40.396767 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-610eaca9-682e-4efe-abc6-89fae1374172 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5040fc9212814c4fa9e038116578eebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a963df1b646f1918426fe1a7cb23c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:54:40.408104 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-610eaca9-682e-4efe-abc6-89fae1374172 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] 10.222.0.60 "GET /compute/v2.1/servers/a4474e04-7712-41de-bbf8-a872101a9808" status: 200 len: 1327 microversion: 2.1 time: 1.218205 Sep 14 08:54:40.408748 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 803/1585] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:54:39 2022] GET /compute/v2.1/servers/a4474e04-7712-41de-bbf8-a872101a9808 => generated 1327 bytes in 1220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:54:41.372323 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3ecff7ad-d72b-45c4-9a0f-3809698217d4 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:54:41.373992 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-3ecff7ad-d72b-45c4-9a0f-3809698217d4 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] [instance: c9ccb0fe-b328-45f9-811f-a0ad6068875e] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:54:41.401547 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3ecff7ad-d72b-45c4-9a0f-3809698217d4 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:41.402900 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3ecff7ad-d72b-45c4-9a0f-3809698217d4 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:41.409152 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3ecff7ad-d72b-45c4-9a0f-3809698217d4 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:41.410189 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3ecff7ad-d72b-45c4-9a0f-3809698217d4 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:41.415124 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3ecff7ad-d72b-45c4-9a0f-3809698217d4 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:41.418088 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3ecff7ad-d72b-45c4-9a0f-3809698217d4 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:41.441890 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c1c4a920-41a2-44fa-8357-d54252aac466 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:54:41.446463 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-c1c4a920-41a2-44fa-8357-d54252aac466 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] [instance: a4474e04-7712-41de-bbf8-a872101a9808] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:54:41.472923 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c1c4a920-41a2-44fa-8357-d54252aac466 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:41.481142 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c1c4a920-41a2-44fa-8357-d54252aac466 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:41.486016 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c1c4a920-41a2-44fa-8357-d54252aac466 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:41.498164 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c1c4a920-41a2-44fa-8357-d54252aac466 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:41.501094 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c1c4a920-41a2-44fa-8357-d54252aac466 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:41.503448 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c1c4a920-41a2-44fa-8357-d54252aac466 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:41.933578 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-3ecff7ad-d72b-45c4-9a0f-3809698217d4 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4808b3a03f4bd8ad4af900bc926e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d8190fe7bb40beaea43a71808dc105', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:54:41.951968 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-3ecff7ad-d72b-45c4-9a0f-3809698217d4 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] 10.222.0.60 "GET /compute/v2.1/servers/c9ccb0fe-b328-45f9-811f-a0ad6068875e" status: 200 len: 1270 microversion: 2.1 time: 0.586213 Sep 14 08:54:41.964111 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 783/1586] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:54:41 2022] GET /compute/v2.1/servers/c9ccb0fe-b328-45f9-811f-a0ad6068875e => generated 1270 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:54:42.984156 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-5cfa3b91-a9b1-4d36-a1b4-90bc3f4b4ef4 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:54:42.984804 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-5cfa3b91-a9b1-4d36-a1b4-90bc3f4b4ef4 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] [instance: c9ccb0fe-b328-45f9-811f-a0ad6068875e] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:54:43.006198 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5cfa3b91-a9b1-4d36-a1b4-90bc3f4b4ef4 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:43.024061 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5cfa3b91-a9b1-4d36-a1b4-90bc3f4b4ef4 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:43.025967 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5cfa3b91-a9b1-4d36-a1b4-90bc3f4b4ef4 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:43.032203 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5cfa3b91-a9b1-4d36-a1b4-90bc3f4b4ef4 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:43.034715 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5cfa3b91-a9b1-4d36-a1b4-90bc3f4b4ef4 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:43.038891 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5cfa3b91-a9b1-4d36-a1b4-90bc3f4b4ef4 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:43.113601 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-c1c4a920-41a2-44fa-8357-d54252aac466 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5040fc9212814c4fa9e038116578eebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a963df1b646f1918426fe1a7cb23c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:54:43.148054 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-c1c4a920-41a2-44fa-8357-d54252aac466 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] 10.222.0.60 "GET /compute/v2.1/servers/a4474e04-7712-41de-bbf8-a872101a9808" status: 200 len: 1395 microversion: 2.1 time: 1.707327 Sep 14 08:54:43.151484 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 804/1587] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:54:41 2022] GET /compute/v2.1/servers/a4474e04-7712-41de-bbf8-a872101a9808 => generated 1395 bytes in 1714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:54:43.475820 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-5cfa3b91-a9b1-4d36-a1b4-90bc3f4b4ef4 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4808b3a03f4bd8ad4af900bc926e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d8190fe7bb40beaea43a71808dc105', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:54:43.486914 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-5cfa3b91-a9b1-4d36-a1b4-90bc3f4b4ef4 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] 10.222.0.60 "GET /compute/v2.1/servers/c9ccb0fe-b328-45f9-811f-a0ad6068875e" status: 200 len: 1270 microversion: 2.1 time: 0.506527 Sep 14 08:54:43.500771 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 784/1588] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:54:42 2022] GET /compute/v2.1/servers/c9ccb0fe-b328-45f9-811f-a0ad6068875e => generated 1270 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:54:44.180275 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-f362a070-e72c-4094-8332-6b61f9e91e09 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:54:44.181611 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-f362a070-e72c-4094-8332-6b61f9e91e09 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] [instance: a4474e04-7712-41de-bbf8-a872101a9808] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:54:44.206915 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=44 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:54:44.222306 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f362a070-e72c-4094-8332-6b61f9e91e09 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:44.223830 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f362a070-e72c-4094-8332-6b61f9e91e09 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:44.227224 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f362a070-e72c-4094-8332-6b61f9e91e09 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:44.232805 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f362a070-e72c-4094-8332-6b61f9e91e09 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:44.233850 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f362a070-e72c-4094-8332-6b61f9e91e09 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:44.238630 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f362a070-e72c-4094-8332-6b61f9e91e09 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:45.336805 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-325a1d0e-1a11-4d54-aa9a-c706507c6b3d tempest-QuotasAdminTestJSON-1334580346 tempest-QuotasAdminTestJSON-1334580346-project-admin] Calling method '.version_select at 0x7f7d44176f70>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:54:45.445685 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=6 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:54:45.534027 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-325a1d0e-1a11-4d54-aa9a-c706507c6b3d tempest-QuotasAdminTestJSON-1334580346 tempest-QuotasAdminTestJSON-1334580346-project-admin] 10.222.0.60 "GET /compute/v2.1/os-quota-sets/f14f8537537b43a495c9feec368a599f" status: 200 len: 371 microversion: 2.1 time: 1.157567 Sep 14 08:54:45.544816 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 785/1589] 10.222.0.60 () {58 vars in 1242 bytes} [Wed Sep 14 08:54:44 2022] GET /compute/v2.1/os-quota-sets/f14f8537537b43a495c9feec368a599f => generated 371 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:54:45.605263 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-984ff7c8-89fa-4ccf-9aca-bc0b8ddf45ce tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:54:45.605903 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-984ff7c8-89fa-4ccf-9aca-bc0b8ddf45ce tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] [instance: c9ccb0fe-b328-45f9-811f-a0ad6068875e] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:54:45.630577 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-984ff7c8-89fa-4ccf-9aca-bc0b8ddf45ce tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:45.630577 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-984ff7c8-89fa-4ccf-9aca-bc0b8ddf45ce tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:45.631802 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-984ff7c8-89fa-4ccf-9aca-bc0b8ddf45ce tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:45.632546 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-984ff7c8-89fa-4ccf-9aca-bc0b8ddf45ce tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:45.633021 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-984ff7c8-89fa-4ccf-9aca-bc0b8ddf45ce tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:45.633459 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-984ff7c8-89fa-4ccf-9aca-bc0b8ddf45ce tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:45.745901 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-f362a070-e72c-4094-8332-6b61f9e91e09 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5040fc9212814c4fa9e038116578eebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a963df1b646f1918426fe1a7cb23c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:54:45.764399 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-f362a070-e72c-4094-8332-6b61f9e91e09 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] 10.222.0.60 "GET /compute/v2.1/servers/a4474e04-7712-41de-bbf8-a872101a9808" status: 200 len: 1395 microversion: 2.1 time: 1.592932 Sep 14 08:54:45.775567 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 805/1590] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:54:44 2022] GET /compute/v2.1/servers/a4474e04-7712-41de-bbf8-a872101a9808 => generated 1395 bytes in 1601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:54:45.785425 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-91c32574-146c-4505-b186-9ef4282e8a04 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:54:45.819144 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-91c32574-146c-4505-b186-9ef4282e8a04 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9810376d6f0b4329abe0f8f79800b754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575684f36f9c4019926fc83541e152c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:54:45.819863 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-91c32574-146c-4505-b186-9ef4282e8a04 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Searching by: {'deleted': False, 'project_id': '575684f36f9c4019926fc83541e152c0'} {{(pid=128758) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 14 08:54:45.851974 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-91c32574-146c-4505-b186-9ef4282e8a04 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:45.858463 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-91c32574-146c-4505-b186-9ef4282e8a04 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:45.858923 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-91c32574-146c-4505-b186-9ef4282e8a04 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:45.864198 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-91c32574-146c-4505-b186-9ef4282e8a04 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:45.867479 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-91c32574-146c-4505-b186-9ef4282e8a04 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:45.870013 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-91c32574-146c-4505-b186-9ef4282e8a04 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:46.103214 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.multi_cell_list [None req-91c32574-146c-4505-b186-9ef4282e8a04 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128758) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 14 08:54:46.287186 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-91c32574-146c-4505-b186-9ef4282e8a04 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] 10.222.0.60 "GET /compute/v2.1/servers" status: 200 len: 344 microversion: 2.1 time: 0.514065 Sep 14 08:54:46.293623 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 806/1591] 10.222.0.60 () {58 vars in 1125 bytes} [Wed Sep 14 08:54:45 2022] GET /compute/v2.1/servers => generated 344 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:54:46.317442 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d6cde2f5-63f7-4e13-9dd6-b06257b353d7 tempest-QuotasAdminTestJSON-1334580346 tempest-QuotasAdminTestJSON-1334580346-project-admin] Action: 'update', calling method: .version_select at 0x7f7d443ae4c0>, body: {"quota_set": {"ram": "5120"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:54:46.778262 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-984ff7c8-89fa-4ccf-9aca-bc0b8ddf45ce tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4808b3a03f4bd8ad4af900bc926e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d8190fe7bb40beaea43a71808dc105', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:54:46.795064 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-984ff7c8-89fa-4ccf-9aca-bc0b8ddf45ce tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] 10.222.0.60 "GET /compute/v2.1/servers/c9ccb0fe-b328-45f9-811f-a0ad6068875e" status: 200 len: 1312 microversion: 2.1 time: 1.242902 Sep 14 08:54:46.805495 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 786/1592] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:54:45 2022] GET /compute/v2.1/servers/c9ccb0fe-b328-45f9-811f-a0ad6068875e => generated 1312 bytes in 1257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:54:46.828434 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3f40769b-14b1-4a83-9e43-9ca364ff26ea tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:54:46.843352 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-3f40769b-14b1-4a83-9e43-9ca364ff26ea tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9810376d6f0b4329abe0f8f79800b754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575684f36f9c4019926fc83541e152c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:54:46.854839 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-3f40769b-14b1-4a83-9e43-9ca364ff26ea tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Searching by: {'deleted': False, 'project_id': '575684f36f9c4019926fc83541e152c0'} {{(pid=128759) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 14 08:54:46.871913 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3f40769b-14b1-4a83-9e43-9ca364ff26ea tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:46.884338 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3f40769b-14b1-4a83-9e43-9ca364ff26ea tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:46.888002 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3f40769b-14b1-4a83-9e43-9ca364ff26ea tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:46.889101 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3f40769b-14b1-4a83-9e43-9ca364ff26ea tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:46.890451 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3f40769b-14b1-4a83-9e43-9ca364ff26ea tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:46.891746 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3f40769b-14b1-4a83-9e43-9ca364ff26ea tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:47.281324 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.multi_cell_list [None req-3f40769b-14b1-4a83-9e43-9ca364ff26ea tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128759) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 14 08:54:47.419043 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-3f40769b-14b1-4a83-9e43-9ca364ff26ea tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810376d6f0b4329abe0f8f79800b754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575684f36f9c4019926fc83541e152c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:54:47.426996 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3f40769b-14b1-4a83-9e43-9ca364ff26ea tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:47.427745 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3f40769b-14b1-4a83-9e43-9ca364ff26ea tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:47.428665 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3f40769b-14b1-4a83-9e43-9ca364ff26ea tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:47.432630 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d6cde2f5-63f7-4e13-9dd6-b06257b353d7 tempest-QuotasAdminTestJSON-1334580346 tempest-QuotasAdminTestJSON-1334580346-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:47.436040 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d6cde2f5-63f7-4e13-9dd6-b06257b353d7 tempest-QuotasAdminTestJSON-1334580346 tempest-QuotasAdminTestJSON-1334580346-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:47.436682 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d6cde2f5-63f7-4e13-9dd6-b06257b353d7 tempest-QuotasAdminTestJSON-1334580346 tempest-QuotasAdminTestJSON-1334580346-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:47.445578 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d6cde2f5-63f7-4e13-9dd6-b06257b353d7 tempest-QuotasAdminTestJSON-1334580346 tempest-QuotasAdminTestJSON-1334580346-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:47.448833 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d6cde2f5-63f7-4e13-9dd6-b06257b353d7 tempest-QuotasAdminTestJSON-1334580346 tempest-QuotasAdminTestJSON-1334580346-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:47.452160 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d6cde2f5-63f7-4e13-9dd6-b06257b353d7 tempest-QuotasAdminTestJSON-1334580346 tempest-QuotasAdminTestJSON-1334580346-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:47.677899 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-d6cde2f5-63f7-4e13-9dd6-b06257b353d7 tempest-QuotasAdminTestJSON-1334580346 tempest-QuotasAdminTestJSON-1334580346-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-quota-sets/f14f8537537b43a495c9feec368a599f" status: 200 len: 328 microversion: 2.1 time: 1.379272 Sep 14 08:54:47.679405 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 807/1593] 10.222.0.60 () {60 vars in 1262 bytes} [Wed Sep 14 08:54:46 2022] PUT /compute/v2.1/os-quota-sets/f14f8537537b43a495c9feec368a599f => generated 328 bytes in 1384 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:54:47.685395 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-9c605229-2572-450f-81b2-3bd41a2b9174 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:54:47.687324 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-9c605229-2572-450f-81b2-3bd41a2b9174 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] [instance: a4474e04-7712-41de-bbf8-a872101a9808] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:54:47.716289 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9c605229-2572-450f-81b2-3bd41a2b9174 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:47.718281 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9c605229-2572-450f-81b2-3bd41a2b9174 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:47.719019 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9c605229-2572-450f-81b2-3bd41a2b9174 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:47.720047 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9c605229-2572-450f-81b2-3bd41a2b9174 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:47.729879 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9c605229-2572-450f-81b2-3bd41a2b9174 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:47.730982 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9c605229-2572-450f-81b2-3bd41a2b9174 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:48.618471 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-9c605229-2572-450f-81b2-3bd41a2b9174 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5040fc9212814c4fa9e038116578eebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a963df1b646f1918426fe1a7cb23c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:54:48.634859 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-9c605229-2572-450f-81b2-3bd41a2b9174 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] 10.222.0.60 "GET /compute/v2.1/servers/a4474e04-7712-41de-bbf8-a872101a9808" status: 200 len: 1395 microversion: 2.1 time: 0.953783 Sep 14 08:54:48.643460 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 808/1594] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:54:47 2022] GET /compute/v2.1/servers/a4474e04-7712-41de-bbf8-a872101a9808 => generated 1395 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:54:48.667593 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-22940047-1da1-4c3e-855e-be0014ce91d7 tempest-QuotasAdminTestJSON-1334580346 tempest-QuotasAdminTestJSON-1334580346-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:54:48.683648 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-3f40769b-14b1-4a83-9e43-9ca364ff26ea tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] 10.222.0.60 "GET /compute/v2.1/servers/detail" status: 200 len: 1607 microversion: 2.1 time: 1.876705 Sep 14 08:54:48.684881 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 787/1595] 10.222.0.60 () {58 vars in 1146 bytes} [Wed Sep 14 08:54:46 2022] GET /compute/v2.1/servers/detail => generated 1607 bytes in 1879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:54:48.709912 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-7bcd14f1-b201-4461-b376-0f63f835b85f tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:54:48.711301 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-7bcd14f1-b201-4461-b376-0f63f835b85f tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] [instance: c9ccb0fe-b328-45f9-811f-a0ad6068875e] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:54:48.737901 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7bcd14f1-b201-4461-b376-0f63f835b85f tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:48.738724 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7bcd14f1-b201-4461-b376-0f63f835b85f tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:48.739392 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7bcd14f1-b201-4461-b376-0f63f835b85f tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:48.740486 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7bcd14f1-b201-4461-b376-0f63f835b85f tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:48.741294 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7bcd14f1-b201-4461-b376-0f63f835b85f tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:48.742824 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7bcd14f1-b201-4461-b376-0f63f835b85f tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:48.747236 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-22940047-1da1-4c3e-855e-be0014ce91d7 tempest-QuotasAdminTestJSON-1334580346 tempest-QuotasAdminTestJSON-1334580346-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-quota-sets/f14f8537537b43a495c9feec368a599f" status: 202 len: 0 microversion: 2.1 time: 0.102528 Sep 14 08:54:48.747844 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 809/1596] 10.222.0.60 () {58 vars in 1245 bytes} [Wed Sep 14 08:54:48 2022] DELETE /compute/v2.1/os-quota-sets/f14f8537537b43a495c9feec368a599f => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 08:54:48.755376 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-409cf9c5-50f0-46cf-9728-4238359565e4 req-99774f35-549b-411e-a4f2-869a5cad52af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4474e04-7712-41de-bbf8-a872101a9808", "tag": "9329ba93-e005-46d9-9298-7b803f042b47"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:54:48.788061 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-409cf9c5-50f0-46cf-9728-4238359565e4 req-99774f35-549b-411e-a4f2-869a5cad52af service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:48.792747 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-409cf9c5-50f0-46cf-9728-4238359565e4 req-99774f35-549b-411e-a4f2-869a5cad52af service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:48.806902 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-409cf9c5-50f0-46cf-9728-4238359565e4 req-99774f35-549b-411e-a4f2-869a5cad52af service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:48.836690 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-409cf9c5-50f0-46cf-9728-4238359565e4 req-99774f35-549b-411e-a4f2-869a5cad52af service nova] Creating event network-changed:9329ba93-e005-46d9-9298-7b803f042b47 for instance a4474e04-7712-41de-bbf8-a872101a9808 on n-h2-836830-18 Sep 14 08:54:48.852799 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-409cf9c5-50f0-46cf-9728-4238359565e4 req-99774f35-549b-411e-a4f2-869a5cad52af service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103342 Sep 14 08:54:48.858181 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 810/1597] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:54:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:54:48.867793 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-5f569f2d-3e33-4e37-877f-0c9992b4597b tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:54:48.878151 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-5f569f2d-3e33-4e37-877f-0c9992b4597b tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] 10.222.0.60 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.017661 Sep 14 08:54:48.886824 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 811/1598] 10.222.0.60 () {58 vars in 1137 bytes} [Wed Sep 14 08:54:48 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:54:48.898463 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-e769471a-762a-44b4-b36d-8f0f42ef1858 tempest-QuotasAdminTestJSON-1334580346 tempest-QuotasAdminTestJSON-1334580346-project-admin] Calling method '.version_select at 0x7f7d444c2040>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:54:49.205785 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-e769471a-762a-44b4-b36d-8f0f42ef1858 tempest-QuotasAdminTestJSON-1334580346 tempest-QuotasAdminTestJSON-1334580346-project-admin] 10.222.0.60 "GET /compute/v2.1/os-quota-sets/f14f8537537b43a495c9feec368a599f" status: 200 len: 371 microversion: 2.1 time: 0.316434 Sep 14 08:54:49.206545 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 812/1599] 10.222.0.60 () {58 vars in 1242 bytes} [Wed Sep 14 08:54:48 2022] GET /compute/v2.1/os-quota-sets/f14f8537537b43a495c9feec368a599f => generated 371 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:54:49.212346 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-88d5fc3d-1811-4b38-8c54-214b5aa9db3d tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:54:49.213551 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-88d5fc3d-1811-4b38-8c54-214b5aa9db3d tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] [instance: 4ea5843e-ecf7-4b84-80cb-3f05b2b20982] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:54:49.223253 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-88d5fc3d-1811-4b38-8c54-214b5aa9db3d tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:49.224163 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-88d5fc3d-1811-4b38-8c54-214b5aa9db3d tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:49.224861 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-88d5fc3d-1811-4b38-8c54-214b5aa9db3d tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:49.226120 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-88d5fc3d-1811-4b38-8c54-214b5aa9db3d tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:49.226924 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-88d5fc3d-1811-4b38-8c54-214b5aa9db3d tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:49.227651 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-88d5fc3d-1811-4b38-8c54-214b5aa9db3d tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:49.237965 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-7bcd14f1-b201-4461-b376-0f63f835b85f tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4808b3a03f4bd8ad4af900bc926e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d8190fe7bb40beaea43a71808dc105', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:54:49.246767 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-7bcd14f1-b201-4461-b376-0f63f835b85f tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] 10.222.0.60 "GET /compute/v2.1/servers/c9ccb0fe-b328-45f9-811f-a0ad6068875e" status: 200 len: 1312 microversion: 2.1 time: 0.552953 Sep 14 08:54:49.254606 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 788/1600] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:54:48 2022] GET /compute/v2.1/servers/c9ccb0fe-b328-45f9-811f-a0ad6068875e => generated 1312 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:54:49.269931 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:54:49.294493 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-88d5fc3d-1811-4b38-8c54-214b5aa9db3d tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] [instance: 4ea5843e-ecf7-4b84-80cb-3f05b2b20982] Going to try to terminate instance {{(pid=128758) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 08:54:49.474433 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-88d5fc3d-1811-4b38-8c54-214b5aa9db3d tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] 10.222.0.60 "DELETE /compute/v2.1/servers/4ea5843e-ecf7-4b84-80cb-3f05b2b20982" status: 204 len: 0 microversion: 2.1 time: 0.266114 Sep 14 08:54:49.478077 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 813/1601] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 08:54:49 2022] DELETE /compute/v2.1/servers/4ea5843e-ecf7-4b84-80cb-3f05b2b20982 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 08:54:49.492163 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b773aef4-4366-46ef-a627-eaf667beaf45 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:54:49.492780 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b773aef4-4366-46ef-a627-eaf667beaf45 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] [instance: 4ea5843e-ecf7-4b84-80cb-3f05b2b20982] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:54:49.505499 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ca78c9f0-6846-4864-984f-13f963064f28 tempest-QuotasAdminTestJSON-1334580346 tempest-QuotasAdminTestJSON-1334580346-project-admin] Calling method '.version_select at 0x7f7d44610f70>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:54:49.506892 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b773aef4-4366-46ef-a627-eaf667beaf45 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:49.508250 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b773aef4-4366-46ef-a627-eaf667beaf45 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:49.510733 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b773aef4-4366-46ef-a627-eaf667beaf45 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:49.511684 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b773aef4-4366-46ef-a627-eaf667beaf45 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:49.512502 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b773aef4-4366-46ef-a627-eaf667beaf45 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:49.512947 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b773aef4-4366-46ef-a627-eaf667beaf45 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:49.521834 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:54:49.794227 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-ca78c9f0-6846-4864-984f-13f963064f28 tempest-QuotasAdminTestJSON-1334580346 tempest-QuotasAdminTestJSON-1334580346-project-admin] 10.222.0.60 "GET /compute/v2.1/os-quota-sets/9e5710479076451b947c8ed385f9fff1/defaults" status: 200 len: 371 microversion: 2.1 time: 0.298460 Sep 14 08:54:49.795769 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 814/1602] 10.222.0.60 () {58 vars in 1269 bytes} [Wed Sep 14 08:54:49 2022] GET /compute/v2.1/os-quota-sets/9e5710479076451b947c8ed385f9fff1/defaults => generated 371 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:54:49.822628 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-5a3c07a7-ebec-47ae-84ca-09d1c6bcc264 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:54:49.826109 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-5a3c07a7-ebec-47ae-84ca-09d1c6bcc264 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] [instance: a4474e04-7712-41de-bbf8-a872101a9808] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:54:49.846013 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5a3c07a7-ebec-47ae-84ca-09d1c6bcc264 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:49.847873 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5a3c07a7-ebec-47ae-84ca-09d1c6bcc264 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:49.853437 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5a3c07a7-ebec-47ae-84ca-09d1c6bcc264 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:49.854584 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5a3c07a7-ebec-47ae-84ca-09d1c6bcc264 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:49.856743 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5a3c07a7-ebec-47ae-84ca-09d1c6bcc264 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:49.859649 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5a3c07a7-ebec-47ae-84ca-09d1c6bcc264 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:49.914975 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b773aef4-4366-46ef-a627-eaf667beaf45 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810376d6f0b4329abe0f8f79800b754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575684f36f9c4019926fc83541e152c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:54:49.931922 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b773aef4-4366-46ef-a627-eaf667beaf45 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] 10.222.0.60 "GET /compute/v2.1/servers/4ea5843e-ecf7-4b84-80cb-3f05b2b20982" status: 200 len: 1610 microversion: 2.1 time: 0.440871 Sep 14 08:54:49.932937 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 789/1603] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:54:49 2022] GET /compute/v2.1/servers/4ea5843e-ecf7-4b84-80cb-3f05b2b20982 => generated 1610 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:54:50.136514 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-5a3c07a7-ebec-47ae-84ca-09d1c6bcc264 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5040fc9212814c4fa9e038116578eebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a963df1b646f1918426fe1a7cb23c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:54:50.148962 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-5a3c07a7-ebec-47ae-84ca-09d1c6bcc264 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] 10.222.0.60 "GET /compute/v2.1/servers/a4474e04-7712-41de-bbf8-a872101a9808" status: 200 len: 1395 microversion: 2.1 time: 0.351735 Sep 14 08:54:50.149557 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 815/1604] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:54:49 2022] GET /compute/v2.1/servers/a4474e04-7712-41de-bbf8-a872101a9808 => generated 1395 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:54:50.161646 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-381c30df-2fe3-4323-b658-e47b956054b5 tempest-QuotasAdminTestJSON-1334580346 tempest-QuotasAdminTestJSON-1334580346-project-admin] Action: 'update', calling method: .version_select at 0x7f7d44bd2310>, body: {"quota_set": {"ram": "5120"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:54:50.283371 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-f67632b4-5ca6-4b0d-af5d-cb20bd2f22c1 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:54:50.283802 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-f67632b4-5ca6-4b0d-af5d-cb20bd2f22c1 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] [instance: c9ccb0fe-b328-45f9-811f-a0ad6068875e] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:54:50.310758 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f67632b4-5ca6-4b0d-af5d-cb20bd2f22c1 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:50.311292 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f67632b4-5ca6-4b0d-af5d-cb20bd2f22c1 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:50.311729 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f67632b4-5ca6-4b0d-af5d-cb20bd2f22c1 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:50.312444 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f67632b4-5ca6-4b0d-af5d-cb20bd2f22c1 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:50.312900 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f67632b4-5ca6-4b0d-af5d-cb20bd2f22c1 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:50.313325 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f67632b4-5ca6-4b0d-af5d-cb20bd2f22c1 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:50.346390 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-381c30df-2fe3-4323-b658-e47b956054b5 tempest-QuotasAdminTestJSON-1334580346 tempest-QuotasAdminTestJSON-1334580346-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:50.347257 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-381c30df-2fe3-4323-b658-e47b956054b5 tempest-QuotasAdminTestJSON-1334580346 tempest-QuotasAdminTestJSON-1334580346-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:50.347929 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-381c30df-2fe3-4323-b658-e47b956054b5 tempest-QuotasAdminTestJSON-1334580346 tempest-QuotasAdminTestJSON-1334580346-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:50.348877 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-381c30df-2fe3-4323-b658-e47b956054b5 tempest-QuotasAdminTestJSON-1334580346 tempest-QuotasAdminTestJSON-1334580346-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:50.349593 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-381c30df-2fe3-4323-b658-e47b956054b5 tempest-QuotasAdminTestJSON-1334580346 tempest-QuotasAdminTestJSON-1334580346-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:50.350285 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-381c30df-2fe3-4323-b658-e47b956054b5 tempest-QuotasAdminTestJSON-1334580346 tempest-QuotasAdminTestJSON-1334580346-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:50.460129 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-381c30df-2fe3-4323-b658-e47b956054b5 tempest-QuotasAdminTestJSON-1334580346 tempest-QuotasAdminTestJSON-1334580346-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-quota-sets/d5bbd1950bae44c6ae432f2240884224" status: 200 len: 328 microversion: 2.1 time: 0.308269 Sep 14 08:54:50.468434 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 790/1605] 10.222.0.60 () {60 vars in 1262 bytes} [Wed Sep 14 08:54:50 2022] PUT /compute/v2.1/os-quota-sets/d5bbd1950bae44c6ae432f2240884224 => generated 328 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:54:50.474476 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-29821ffd-2e58-464e-9f51-7dfc737b72cb tempest-QuotasAdminTestJSON-1334580346 tempest-QuotasAdminTestJSON-1334580346-project-admin] Calling method '.version_select at 0x7f7d4421caf0>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:54:50.599657 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-f67632b4-5ca6-4b0d-af5d-cb20bd2f22c1 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4808b3a03f4bd8ad4af900bc926e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d8190fe7bb40beaea43a71808dc105', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:54:50.606971 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-29821ffd-2e58-464e-9f51-7dfc737b72cb tempest-QuotasAdminTestJSON-1334580346 tempest-QuotasAdminTestJSON-1334580346-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:50.607490 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-29821ffd-2e58-464e-9f51-7dfc737b72cb tempest-QuotasAdminTestJSON-1334580346 tempest-QuotasAdminTestJSON-1334580346-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:50.607986 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-29821ffd-2e58-464e-9f51-7dfc737b72cb tempest-QuotasAdminTestJSON-1334580346 tempest-QuotasAdminTestJSON-1334580346-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:50.608441 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-f67632b4-5ca6-4b0d-af5d-cb20bd2f22c1 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] 10.222.0.60 "GET /compute/v2.1/servers/c9ccb0fe-b328-45f9-811f-a0ad6068875e" status: 200 len: 1312 microversion: 2.1 time: 0.329156 Sep 14 08:54:50.608863 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-29821ffd-2e58-464e-9f51-7dfc737b72cb tempest-QuotasAdminTestJSON-1334580346 tempest-QuotasAdminTestJSON-1334580346-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:50.609323 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-29821ffd-2e58-464e-9f51-7dfc737b72cb tempest-QuotasAdminTestJSON-1334580346 tempest-QuotasAdminTestJSON-1334580346-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:50.609751 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-29821ffd-2e58-464e-9f51-7dfc737b72cb tempest-QuotasAdminTestJSON-1334580346 tempest-QuotasAdminTestJSON-1334580346-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:50.612296 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 816/1606] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:54:50 2022] GET /compute/v2.1/servers/c9ccb0fe-b328-45f9-811f-a0ad6068875e => generated 1312 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:54:50.656096 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=3,nova_api:INSERT=5 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:54:50.665891 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-29821ffd-2e58-464e-9f51-7dfc737b72cb tempest-QuotasAdminTestJSON-1334580346 tempest-QuotasAdminTestJSON-1334580346-project-admin] 10.222.0.60 "GET /compute/v2.1/os-quota-sets/d5bbd1950bae44c6ae432f2240884224/detail" status: 200 len: 916 microversion: 2.1 time: 0.196127 Sep 14 08:54:50.667150 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 791/1607] 10.222.0.60 () {58 vars in 1263 bytes} [Wed Sep 14 08:54:50 2022] GET /compute/v2.1/os-quota-sets/d5bbd1950bae44c6ae432f2240884224/detail => generated 916 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:54:50.887743 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-1d2c297a-ecc0-4d1f-b7f7-945a11714954 req-826840a4-b5c3-4530-89a2-335844fde6ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9ccb0fe-b328-45f9-811f-a0ad6068875e", "tag": "be79e1ef-4da1-405c-a53b-2091542beac5"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:54:50.908709 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-1d2c297a-ecc0-4d1f-b7f7-945a11714954 req-826840a4-b5c3-4530-89a2-335844fde6ec service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:50.909179 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-1d2c297a-ecc0-4d1f-b7f7-945a11714954 req-826840a4-b5c3-4530-89a2-335844fde6ec service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:50.909603 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-1d2c297a-ecc0-4d1f-b7f7-945a11714954 req-826840a4-b5c3-4530-89a2-335844fde6ec service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:50.914759 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-501288ce-787c-417c-809a-f4f96e2c62f2 tempest-QuotasAdminTestJSON-1334580346 tempest-QuotasAdminTestJSON-1334580346-project-admin] Action: 'update', calling method: .version_select at 0x7f7d4456a670>, body: {"quota_set": {"ram": "2048"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:54:50.948794 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-1d2c297a-ecc0-4d1f-b7f7-945a11714954 req-826840a4-b5c3-4530-89a2-335844fde6ec service nova] Creating event network-changed:be79e1ef-4da1-405c-a53b-2091542beac5 for instance c9ccb0fe-b328-45f9-811f-a0ad6068875e on n-h1-836830-18 Sep 14 08:54:50.965099 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-1d2c297a-ecc0-4d1f-b7f7-945a11714954 req-826840a4-b5c3-4530-89a2-335844fde6ec service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080926 Sep 14 08:54:50.965731 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 817/1608] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:54:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:54:50.971733 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1d7a7aa6-ac45-448f-8180-30f88ac39a2c tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:54:50.972440 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-1d7a7aa6-ac45-448f-8180-30f88ac39a2c tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] [instance: 4ea5843e-ecf7-4b84-80cb-3f05b2b20982] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:54:50.991632 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1d7a7aa6-ac45-448f-8180-30f88ac39a2c tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:50.992125 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1d7a7aa6-ac45-448f-8180-30f88ac39a2c tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:50.992562 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1d7a7aa6-ac45-448f-8180-30f88ac39a2c tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:50.993427 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1d7a7aa6-ac45-448f-8180-30f88ac39a2c tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:50.993932 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1d7a7aa6-ac45-448f-8180-30f88ac39a2c tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:50.994352 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1d7a7aa6-ac45-448f-8180-30f88ac39a2c tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:51.021459 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-501288ce-787c-417c-809a-f4f96e2c62f2 tempest-QuotasAdminTestJSON-1334580346 tempest-QuotasAdminTestJSON-1334580346-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:51.023021 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-501288ce-787c-417c-809a-f4f96e2c62f2 tempest-QuotasAdminTestJSON-1334580346 tempest-QuotasAdminTestJSON-1334580346-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:51.025818 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-501288ce-787c-417c-809a-f4f96e2c62f2 tempest-QuotasAdminTestJSON-1334580346 tempest-QuotasAdminTestJSON-1334580346-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:51.030158 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-501288ce-787c-417c-809a-f4f96e2c62f2 tempest-QuotasAdminTestJSON-1334580346 tempest-QuotasAdminTestJSON-1334580346-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:51.030846 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-501288ce-787c-417c-809a-f4f96e2c62f2 tempest-QuotasAdminTestJSON-1334580346 tempest-QuotasAdminTestJSON-1334580346-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:51.031946 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-501288ce-787c-417c-809a-f4f96e2c62f2 tempest-QuotasAdminTestJSON-1334580346 tempest-QuotasAdminTestJSON-1334580346-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:51.110282 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-501288ce-787c-417c-809a-f4f96e2c62f2 tempest-QuotasAdminTestJSON-1334580346 tempest-QuotasAdminTestJSON-1334580346-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:51.111971 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-501288ce-787c-417c-809a-f4f96e2c62f2 tempest-QuotasAdminTestJSON-1334580346 tempest-QuotasAdminTestJSON-1334580346-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:51.117489 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-501288ce-787c-417c-809a-f4f96e2c62f2 tempest-QuotasAdminTestJSON-1334580346 tempest-QuotasAdminTestJSON-1334580346-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:51.118775 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-501288ce-787c-417c-809a-f4f96e2c62f2 tempest-QuotasAdminTestJSON-1334580346 tempest-QuotasAdminTestJSON-1334580346-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:51.119731 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-501288ce-787c-417c-809a-f4f96e2c62f2 tempest-QuotasAdminTestJSON-1334580346 tempest-QuotasAdminTestJSON-1334580346-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:51.120478 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-501288ce-787c-417c-809a-f4f96e2c62f2 tempest-QuotasAdminTestJSON-1334580346 tempest-QuotasAdminTestJSON-1334580346-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:51.213021 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-501288ce-787c-417c-809a-f4f96e2c62f2 tempest-QuotasAdminTestJSON-1334580346 tempest-QuotasAdminTestJSON-1334580346-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-quota-sets/d5bbd1950bae44c6ae432f2240884224?user_id=8b93c27f8cc647508e9beb843102044e" status: 200 len: 328 microversion: 2.1 time: 0.305447 Sep 14 08:54:51.214652 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 792/1609] 10.222.0.60 () {60 vars in 1343 bytes} [Wed Sep 14 08:54:50 2022] PUT /compute/v2.1/os-quota-sets/d5bbd1950bae44c6ae432f2240884224?user_id=8b93c27f8cc647508e9beb843102044e => generated 328 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 08:54:51.223246 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e84ab462-1a8a-4bf4-876c-ea9e136a0a8f tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:54:51.224206 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e84ab462-1a8a-4bf4-876c-ea9e136a0a8f tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] [instance: a4474e04-7712-41de-bbf8-a872101a9808] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:54:51.232145 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e84ab462-1a8a-4bf4-876c-ea9e136a0a8f tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:51.233233 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e84ab462-1a8a-4bf4-876c-ea9e136a0a8f tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:51.233969 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e84ab462-1a8a-4bf4-876c-ea9e136a0a8f tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:51.235108 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e84ab462-1a8a-4bf4-876c-ea9e136a0a8f tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:51.236289 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e84ab462-1a8a-4bf4-876c-ea9e136a0a8f tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:51.236948 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e84ab462-1a8a-4bf4-876c-ea9e136a0a8f tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:51.313915 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-1d7a7aa6-ac45-448f-8180-30f88ac39a2c tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810376d6f0b4329abe0f8f79800b754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575684f36f9c4019926fc83541e152c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:54:51.342973 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-1d7a7aa6-ac45-448f-8180-30f88ac39a2c tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] 10.222.0.60 "GET /compute/v2.1/servers/4ea5843e-ecf7-4b84-80cb-3f05b2b20982" status: 200 len: 1610 microversion: 2.1 time: 0.371394 Sep 14 08:54:51.345508 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 818/1610] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:54:50 2022] GET /compute/v2.1/servers/4ea5843e-ecf7-4b84-80cb-3f05b2b20982 => generated 1610 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:54:51.354356 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a37767aa-7a7b-4ceb-877c-e6148d74e014 tempest-QuotasAdminTestJSON-1334580346 tempest-QuotasAdminTestJSON-1334580346-project-admin] Calling method '.version_select at 0x7f7d4882be50>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:54:51.518667 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-a37767aa-7a7b-4ceb-877c-e6148d74e014 tempest-QuotasAdminTestJSON-1334580346 tempest-QuotasAdminTestJSON-1334580346-project-admin] 10.222.0.60 "GET /compute/v2.1/os-quota-sets/d5bbd1950bae44c6ae432f2240884224?user_id=8b93c27f8cc647508e9beb843102044e" status: 200 len: 370 microversion: 2.1 time: 0.171737 Sep 14 08:54:51.520198 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 819/1611] 10.222.0.60 () {58 vars in 1323 bytes} [Wed Sep 14 08:54:51 2022] GET /compute/v2.1/os-quota-sets/d5bbd1950bae44c6ae432f2240884224?user_id=8b93c27f8cc647508e9beb843102044e => generated 370 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:54:51.641154 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-4ea5e667-154e-49f8-9f27-83e68111ff42 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:54:51.642040 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-4ea5e667-154e-49f8-9f27-83e68111ff42 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] [instance: c9ccb0fe-b328-45f9-811f-a0ad6068875e] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:54:51.656116 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4ea5e667-154e-49f8-9f27-83e68111ff42 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:51.657158 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4ea5e667-154e-49f8-9f27-83e68111ff42 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:51.658391 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4ea5e667-154e-49f8-9f27-83e68111ff42 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:51.659811 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4ea5e667-154e-49f8-9f27-83e68111ff42 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:51.660979 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4ea5e667-154e-49f8-9f27-83e68111ff42 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:51.661845 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4ea5e667-154e-49f8-9f27-83e68111ff42 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:51.835104 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-e84ab462-1a8a-4bf4-876c-ea9e136a0a8f tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5040fc9212814c4fa9e038116578eebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a963df1b646f1918426fe1a7cb23c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:54:51.849506 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e84ab462-1a8a-4bf4-876c-ea9e136a0a8f tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] 10.222.0.60 "GET /compute/v2.1/servers/a4474e04-7712-41de-bbf8-a872101a9808" status: 200 len: 1395 microversion: 2.1 time: 0.633417 Sep 14 08:54:51.850664 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 793/1612] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:54:51 2022] GET /compute/v2.1/servers/a4474e04-7712-41de-bbf8-a872101a9808 => generated 1395 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:54:52.139168 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-0ed38235-94bf-4551-9272-0fc51a819b60 tempest-QuotasAdminTestJSON-1334580346 tempest-QuotasAdminTestJSON-1334580346-project-admin] Calling method '.version_select at 0x7f7d44431ca0>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:54:52.504195 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-0ed38235-94bf-4551-9272-0fc51a819b60 tempest-QuotasAdminTestJSON-1334580346 tempest-QuotasAdminTestJSON-1334580346-project-admin] 10.222.0.60 "GET /compute/v2.1/os-quota-sets/9e5710479076451b947c8ed385f9fff1/defaults" status: 200 len: 371 microversion: 2.1 time: 0.378552 Sep 14 08:54:52.514887 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 794/1613] 10.222.0.60 () {58 vars in 1269 bytes} [Wed Sep 14 08:54:52 2022] GET /compute/v2.1/os-quota-sets/9e5710479076451b947c8ed385f9fff1/defaults => generated 371 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:54:52.522812 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ab63e812-7abc-40b4-9dfe-330cf063d4af tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:54:52.525146 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-ab63e812-7abc-40b4-9dfe-330cf063d4af tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] [instance: 4ea5843e-ecf7-4b84-80cb-3f05b2b20982] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:54:52.536223 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ab63e812-7abc-40b4-9dfe-330cf063d4af tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:52.537117 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ab63e812-7abc-40b4-9dfe-330cf063d4af tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:52.538066 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ab63e812-7abc-40b4-9dfe-330cf063d4af tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:52.539297 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ab63e812-7abc-40b4-9dfe-330cf063d4af tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:52.539999 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ab63e812-7abc-40b4-9dfe-330cf063d4af tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:52.540656 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ab63e812-7abc-40b4-9dfe-330cf063d4af tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:52.561724 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-4ea5e667-154e-49f8-9f27-83e68111ff42 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4808b3a03f4bd8ad4af900bc926e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d8190fe7bb40beaea43a71808dc105', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:54:52.570365 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-4ea5e667-154e-49f8-9f27-83e68111ff42 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] 10.222.0.60 "GET /compute/v2.1/servers/c9ccb0fe-b328-45f9-811f-a0ad6068875e" status: 200 len: 1312 microversion: 2.1 time: 0.936589 Sep 14 08:54:52.580565 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 820/1614] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:54:51 2022] GET /compute/v2.1/servers/c9ccb0fe-b328-45f9-811f-a0ad6068875e => generated 1312 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:54:52.585396 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-3ee2e49e-bed7-4824-a3d4-e63a6c9c6765 tempest-QuotasAdminTestJSON-1334580346 tempest-QuotasAdminTestJSON-1334580346-project-admin] Action: 'update', calling method: .version_select at 0x7f7d448ee820>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:54:52.745840 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3ee2e49e-bed7-4824-a3d4-e63a6c9c6765 tempest-QuotasAdminTestJSON-1334580346 tempest-QuotasAdminTestJSON-1334580346-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:52.746557 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3ee2e49e-bed7-4824-a3d4-e63a6c9c6765 tempest-QuotasAdminTestJSON-1334580346 tempest-QuotasAdminTestJSON-1334580346-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:52.747349 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3ee2e49e-bed7-4824-a3d4-e63a6c9c6765 tempest-QuotasAdminTestJSON-1334580346 tempest-QuotasAdminTestJSON-1334580346-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:52.748277 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3ee2e49e-bed7-4824-a3d4-e63a6c9c6765 tempest-QuotasAdminTestJSON-1334580346 tempest-QuotasAdminTestJSON-1334580346-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:52.748903 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3ee2e49e-bed7-4824-a3d4-e63a6c9c6765 tempest-QuotasAdminTestJSON-1334580346 tempest-QuotasAdminTestJSON-1334580346-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:52.749612 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3ee2e49e-bed7-4824-a3d4-e63a6c9c6765 tempest-QuotasAdminTestJSON-1334580346 tempest-QuotasAdminTestJSON-1334580346-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:52.863861 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-ab63e812-7abc-40b4-9dfe-330cf063d4af tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810376d6f0b4329abe0f8f79800b754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575684f36f9c4019926fc83541e152c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:54:52.871873 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=5,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:54:52.879280 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-ab63e812-7abc-40b4-9dfe-330cf063d4af tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] 10.222.0.60 "GET /compute/v2.1/servers/4ea5843e-ecf7-4b84-80cb-3f05b2b20982" status: 200 len: 1610 microversion: 2.1 time: 0.362553 Sep 14 08:54:52.882619 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 795/1615] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:54:52 2022] GET /compute/v2.1/servers/4ea5843e-ecf7-4b84-80cb-3f05b2b20982 => generated 1610 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:54:52.898860 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e699e73c-5353-4ca6-9bbb-db0bd8413ef9 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:54:52.903649 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e699e73c-5353-4ca6-9bbb-db0bd8413ef9 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] [instance: a4474e04-7712-41de-bbf8-a872101a9808] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:54:52.918781 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e699e73c-5353-4ca6-9bbb-db0bd8413ef9 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:52.923865 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e699e73c-5353-4ca6-9bbb-db0bd8413ef9 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:52.924722 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e699e73c-5353-4ca6-9bbb-db0bd8413ef9 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:52.925961 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e699e73c-5353-4ca6-9bbb-db0bd8413ef9 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:52.926628 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e699e73c-5353-4ca6-9bbb-db0bd8413ef9 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:52.927288 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e699e73c-5353-4ca6-9bbb-db0bd8413ef9 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:53.120821 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-3ee2e49e-bed7-4824-a3d4-e63a6c9c6765 tempest-QuotasAdminTestJSON-1334580346 tempest-QuotasAdminTestJSON-1334580346-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-quota-sets/9e5710479076451b947c8ed385f9fff1" status: 200 len: 329 microversion: 2.1 time: 0.539049 Sep 14 08:54:53.122156 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 821/1616] 10.222.0.60 () {60 vars in 1263 bytes} [Wed Sep 14 08:54:52 2022] PUT /compute/v2.1/os-quota-sets/9e5710479076451b947c8ed385f9fff1 => generated 329 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:54:53.137423 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-15794c64-4c25-45e0-96ec-5ffd021257c3 tempest-QuotasAdminTestJSON-1334580346 tempest-QuotasAdminTestJSON-1334580346-project-admin] Action: 'update', calling method: .version_select at 0x7f7d44571670>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:54:53.146593 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-e699e73c-5353-4ca6-9bbb-db0bd8413ef9 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5040fc9212814c4fa9e038116578eebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a963df1b646f1918426fe1a7cb23c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:54:53.154351 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e699e73c-5353-4ca6-9bbb-db0bd8413ef9 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] 10.222.0.60 "GET /compute/v2.1/servers/a4474e04-7712-41de-bbf8-a872101a9808" status: 200 len: 1395 microversion: 2.1 time: 0.269341 Sep 14 08:54:53.162742 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 796/1617] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:54:52 2022] GET /compute/v2.1/servers/a4474e04-7712-41de-bbf8-a872101a9808 => generated 1395 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:54:53.241383 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-15794c64-4c25-45e0-96ec-5ffd021257c3 tempest-QuotasAdminTestJSON-1334580346 tempest-QuotasAdminTestJSON-1334580346-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:53.241879 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-15794c64-4c25-45e0-96ec-5ffd021257c3 tempest-QuotasAdminTestJSON-1334580346 tempest-QuotasAdminTestJSON-1334580346-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:53.242320 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-15794c64-4c25-45e0-96ec-5ffd021257c3 tempest-QuotasAdminTestJSON-1334580346 tempest-QuotasAdminTestJSON-1334580346-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:53.243086 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-15794c64-4c25-45e0-96ec-5ffd021257c3 tempest-QuotasAdminTestJSON-1334580346 tempest-QuotasAdminTestJSON-1334580346-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:53.243548 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-15794c64-4c25-45e0-96ec-5ffd021257c3 tempest-QuotasAdminTestJSON-1334580346 tempest-QuotasAdminTestJSON-1334580346-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:53.243975 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-15794c64-4c25-45e0-96ec-5ffd021257c3 tempest-QuotasAdminTestJSON-1334580346 tempest-QuotasAdminTestJSON-1334580346-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:53.606421 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-646332c7-c1bf-47df-bd23-405121465a37 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:54:53.609633 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-646332c7-c1bf-47df-bd23-405121465a37 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] [instance: c9ccb0fe-b328-45f9-811f-a0ad6068875e] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:54:53.642977 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-646332c7-c1bf-47df-bd23-405121465a37 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:53.646261 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-646332c7-c1bf-47df-bd23-405121465a37 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:53.646991 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-646332c7-c1bf-47df-bd23-405121465a37 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:53.648331 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-646332c7-c1bf-47df-bd23-405121465a37 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:53.649694 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-646332c7-c1bf-47df-bd23-405121465a37 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:53.650426 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-646332c7-c1bf-47df-bd23-405121465a37 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:53.911076 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-15794c64-4c25-45e0-96ec-5ffd021257c3 tempest-QuotasAdminTestJSON-1334580346 tempest-QuotasAdminTestJSON-1334580346-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-quota-sets/9e5710479076451b947c8ed385f9fff1" status: 200 len: 329 microversion: 2.1 time: 0.780459 Sep 14 08:54:53.912354 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 822/1618] 10.222.0.60 () {60 vars in 1263 bytes} [Wed Sep 14 08:54:53 2022] PUT /compute/v2.1/os-quota-sets/9e5710479076451b947c8ed385f9fff1 => generated 329 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 08:54:53.919653 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-90c1d837-1af6-40e7-bdd9-987bba24d235 req-d2685d14-8a46-4b22-9623-8a4c5b90c542 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ea5843e-ecf7-4b84-80cb-3f05b2b20982", "name": "network-vif-deleted", "tag": "413aded5-fbf0-4893-9752-3f4384abde15"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:54:53.976356 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-90c1d837-1af6-40e7-bdd9-987bba24d235 req-d2685d14-8a46-4b22-9623-8a4c5b90c542 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:53.981898 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-90c1d837-1af6-40e7-bdd9-987bba24d235 req-d2685d14-8a46-4b22-9623-8a4c5b90c542 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:53.982550 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-90c1d837-1af6-40e7-bdd9-987bba24d235 req-d2685d14-8a46-4b22-9623-8a4c5b90c542 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:54.015599 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-90c1d837-1af6-40e7-bdd9-987bba24d235 req-d2685d14-8a46-4b22-9623-8a4c5b90c542 service nova] Creating event network-vif-deleted:413aded5-fbf0-4893-9752-3f4384abde15 for instance 4ea5843e-ecf7-4b84-80cb-3f05b2b20982 on n-h1-836830-18 Sep 14 08:54:54.033644 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-90c1d837-1af6-40e7-bdd9-987bba24d235 req-d2685d14-8a46-4b22-9623-8a4c5b90c542 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119909 Sep 14 08:54:54.038586 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 823/1619] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:54:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:54:54.071841 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-94bef9fd-e41d-44a0-908e-1e325a1a9219 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:54:54.074230 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-94bef9fd-e41d-44a0-908e-1e325a1a9219 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] [instance: 4ea5843e-ecf7-4b84-80cb-3f05b2b20982] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:54:54.091766 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-94bef9fd-e41d-44a0-908e-1e325a1a9219 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:54.101929 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-94bef9fd-e41d-44a0-908e-1e325a1a9219 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:54.103469 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-94bef9fd-e41d-44a0-908e-1e325a1a9219 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:54.105091 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-94bef9fd-e41d-44a0-908e-1e325a1a9219 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:54.106040 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-94bef9fd-e41d-44a0-908e-1e325a1a9219 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:54.107875 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-94bef9fd-e41d-44a0-908e-1e325a1a9219 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:54.124742 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-646332c7-c1bf-47df-bd23-405121465a37 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4808b3a03f4bd8ad4af900bc926e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d8190fe7bb40beaea43a71808dc105', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:54:54.138955 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-646332c7-c1bf-47df-bd23-405121465a37 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] 10.222.0.60 "GET /compute/v2.1/servers/c9ccb0fe-b328-45f9-811f-a0ad6068875e" status: 200 len: 1312 microversion: 2.1 time: 0.536435 Sep 14 08:54:54.146781 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 797/1620] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:54:53 2022] GET /compute/v2.1/servers/c9ccb0fe-b328-45f9-811f-a0ad6068875e => generated 1312 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:54:54.287494 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-94bef9fd-e41d-44a0-908e-1e325a1a9219 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810376d6f0b4329abe0f8f79800b754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575684f36f9c4019926fc83541e152c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:54:54.294530 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-94bef9fd-e41d-44a0-908e-1e325a1a9219 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] 10.222.0.60 "GET /compute/v2.1/servers/4ea5843e-ecf7-4b84-80cb-3f05b2b20982" status: 200 len: 1543 microversion: 2.1 time: 0.253109 Sep 14 08:54:54.310617 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 824/1621] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:54:54 2022] GET /compute/v2.1/servers/4ea5843e-ecf7-4b84-80cb-3f05b2b20982 => generated 1543 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:54:54.315532 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d5b4a9ce-cb2c-43bc-8eea-20a7330e56f3 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:54:54.316152 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-d5b4a9ce-cb2c-43bc-8eea-20a7330e56f3 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] [instance: a4474e04-7712-41de-bbf8-a872101a9808] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:54:54.323738 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d5b4a9ce-cb2c-43bc-8eea-20a7330e56f3 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:54.324018 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d5b4a9ce-cb2c-43bc-8eea-20a7330e56f3 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:54.324466 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d5b4a9ce-cb2c-43bc-8eea-20a7330e56f3 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:54.325170 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d5b4a9ce-cb2c-43bc-8eea-20a7330e56f3 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:54.325609 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d5b4a9ce-cb2c-43bc-8eea-20a7330e56f3 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:54.326027 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d5b4a9ce-cb2c-43bc-8eea-20a7330e56f3 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:54.426821 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b4fb00fd-93aa-4c7f-b587-7c1571643546 tempest-AbsoluteLimitsNegativeTestJSON-701431611 tempest-AbsoluteLimitsNegativeTestJSON-701431611-project] Calling method '.version_select at 0x7f7d4443ad30>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:54:54.445153 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b4fb00fd-93aa-4c7f-b587-7c1571643546 tempest-AbsoluteLimitsNegativeTestJSON-701431611 tempest-AbsoluteLimitsNegativeTestJSON-701431611-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:54.446741 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b4fb00fd-93aa-4c7f-b587-7c1571643546 tempest-AbsoluteLimitsNegativeTestJSON-701431611 tempest-AbsoluteLimitsNegativeTestJSON-701431611-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:54.448027 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b4fb00fd-93aa-4c7f-b587-7c1571643546 tempest-AbsoluteLimitsNegativeTestJSON-701431611 tempest-AbsoluteLimitsNegativeTestJSON-701431611-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:54.448814 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b4fb00fd-93aa-4c7f-b587-7c1571643546 tempest-AbsoluteLimitsNegativeTestJSON-701431611 tempest-AbsoluteLimitsNegativeTestJSON-701431611-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:54.449301 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b4fb00fd-93aa-4c7f-b587-7c1571643546 tempest-AbsoluteLimitsNegativeTestJSON-701431611 tempest-AbsoluteLimitsNegativeTestJSON-701431611-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:54.449725 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b4fb00fd-93aa-4c7f-b587-7c1571643546 tempest-AbsoluteLimitsNegativeTestJSON-701431611 tempest-AbsoluteLimitsNegativeTestJSON-701431611-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:54.481910 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b4fb00fd-93aa-4c7f-b587-7c1571643546 tempest-AbsoluteLimitsNegativeTestJSON-701431611 tempest-AbsoluteLimitsNegativeTestJSON-701431611-project] 10.222.0.60 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.332853 Sep 14 08:54:54.494966 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 798/1622] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 14 08:54:54 2022] GET /compute/v2.1/limits => generated 511 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:54:54.683259 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-d5b4a9ce-cb2c-43bc-8eea-20a7330e56f3 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5040fc9212814c4fa9e038116578eebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a963df1b646f1918426fe1a7cb23c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:54:54.696271 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-d5b4a9ce-cb2c-43bc-8eea-20a7330e56f3 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] 10.222.0.60 "GET /compute/v2.1/servers/a4474e04-7712-41de-bbf8-a872101a9808" status: 200 len: 1395 microversion: 2.1 time: 0.384453 Sep 14 08:54:54.698005 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a48fa8f4-b495-4560-a735-a38a37729fa8 tempest-AbsoluteLimitsNegativeTestJSON-701431611 tempest-AbsoluteLimitsNegativeTestJSON-701431611-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1412895357", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:54:54.712407 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 825/1623] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:54:54 2022] GET /compute/v2.1/servers/a4474e04-7712-41de-bbf8-a872101a9808 => generated 1395 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:54:55.168043 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-debe81fa-5a15-47a0-83f4-5d45b9621def tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:54:55.168662 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-debe81fa-5a15-47a0-83f4-5d45b9621def tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] [instance: c9ccb0fe-b328-45f9-811f-a0ad6068875e] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:54:55.172082 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=24,nova_api:UPDATE=14 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:54:55.183626 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-debe81fa-5a15-47a0-83f4-5d45b9621def tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:55.184188 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-debe81fa-5a15-47a0-83f4-5d45b9621def tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:55.184847 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-debe81fa-5a15-47a0-83f4-5d45b9621def tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:55.185375 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-debe81fa-5a15-47a0-83f4-5d45b9621def tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:55.185937 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-debe81fa-5a15-47a0-83f4-5d45b9621def tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:55.186255 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-debe81fa-5a15-47a0-83f4-5d45b9621def tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:55.551293 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-debe81fa-5a15-47a0-83f4-5d45b9621def tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4808b3a03f4bd8ad4af900bc926e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d8190fe7bb40beaea43a71808dc105', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:54:55.565766 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-debe81fa-5a15-47a0-83f4-5d45b9621def tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] 10.222.0.60 "GET /compute/v2.1/servers/c9ccb0fe-b328-45f9-811f-a0ad6068875e" status: 200 len: 1312 microversion: 2.1 time: 0.398561 Sep 14 08:54:55.567044 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 826/1624] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:54:55 2022] GET /compute/v2.1/servers/c9ccb0fe-b328-45f9-811f-a0ad6068875e => generated 1312 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:54:55.576925 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-77c859f8-83c9-4281-bdaf-3885a8c1c45f tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:54:55.577723 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-77c859f8-83c9-4281-bdaf-3885a8c1c45f tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] [instance: 4ea5843e-ecf7-4b84-80cb-3f05b2b20982] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:54:55.592494 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-77c859f8-83c9-4281-bdaf-3885a8c1c45f tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:55.594824 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-77c859f8-83c9-4281-bdaf-3885a8c1c45f tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:55.603468 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-77c859f8-83c9-4281-bdaf-3885a8c1c45f tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:55.604569 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-77c859f8-83c9-4281-bdaf-3885a8c1c45f tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:55.605229 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-77c859f8-83c9-4281-bdaf-3885a8c1c45f tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:55.605860 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-77c859f8-83c9-4281-bdaf-3885a8c1c45f tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:55.715550 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-77c859f8-83c9-4281-bdaf-3885a8c1c45f tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810376d6f0b4329abe0f8f79800b754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575684f36f9c4019926fc83541e152c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:54:55.726639 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-77c859f8-83c9-4281-bdaf-3885a8c1c45f tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] 10.222.0.60 "GET /compute/v2.1/servers/4ea5843e-ecf7-4b84-80cb-3f05b2b20982" status: 200 len: 1253 microversion: 2.1 time: 0.158303 Sep 14 08:54:55.732062 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 827/1625] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:54:55 2022] GET /compute/v2.1/servers/4ea5843e-ecf7-4b84-80cb-3f05b2b20982 => generated 1253 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:54:55.739754 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-18dbf757-10ee-4981-95bf-cbef9e86b769 req-d6c3dd4e-83de-402a-8fb6-457f82dc2807 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4474e04-7712-41de-bbf8-a872101a9808", "name": "network-vif-plugged", "status": "completed", "tag": "9329ba93-e005-46d9-9298-7b803f042b47"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:54:55.763258 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-18dbf757-10ee-4981-95bf-cbef9e86b769 req-d6c3dd4e-83de-402a-8fb6-457f82dc2807 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:55.770758 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-18dbf757-10ee-4981-95bf-cbef9e86b769 req-d6c3dd4e-83de-402a-8fb6-457f82dc2807 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:55.771550 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-18dbf757-10ee-4981-95bf-cbef9e86b769 req-d6c3dd4e-83de-402a-8fb6-457f82dc2807 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:55.793348 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-18dbf757-10ee-4981-95bf-cbef9e86b769 req-d6c3dd4e-83de-402a-8fb6-457f82dc2807 service nova] Creating event network-vif-plugged:9329ba93-e005-46d9-9298-7b803f042b47 for instance a4474e04-7712-41de-bbf8-a872101a9808 on n-h2-836830-18 Sep 14 08:54:55.805587 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-18dbf757-10ee-4981-95bf-cbef9e86b769 req-d6c3dd4e-83de-402a-8fb6-457f82dc2807 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070343 Sep 14 08:54:55.810546 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 828/1626] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:54:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:54:55.818921 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-28b8556a-313b-4ef6-8114-5efa7ff08d80 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:54:55.821448 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-28b8556a-313b-4ef6-8114-5efa7ff08d80 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] [instance: a4474e04-7712-41de-bbf8-a872101a9808] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:54:55.850385 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-28b8556a-313b-4ef6-8114-5efa7ff08d80 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:55.851990 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-28b8556a-313b-4ef6-8114-5efa7ff08d80 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:55.853278 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-28b8556a-313b-4ef6-8114-5efa7ff08d80 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:55.854923 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-28b8556a-313b-4ef6-8114-5efa7ff08d80 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:55.856443 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-28b8556a-313b-4ef6-8114-5efa7ff08d80 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:55.857693 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-28b8556a-313b-4ef6-8114-5efa7ff08d80 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:56.428531 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-28b8556a-313b-4ef6-8114-5efa7ff08d80 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5040fc9212814c4fa9e038116578eebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a963df1b646f1918426fe1a7cb23c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:54:56.440985 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-28b8556a-313b-4ef6-8114-5efa7ff08d80 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] 10.222.0.60 "GET /compute/v2.1/servers/a4474e04-7712-41de-bbf8-a872101a9808" status: 200 len: 1395 microversion: 2.1 time: 0.626704 Sep 14 08:54:56.442010 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 829/1627] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:54:55 2022] GET /compute/v2.1/servers/a4474e04-7712-41de-bbf8-a872101a9808 => generated 1395 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:54:56.447629 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a79af39a-15a8-4874-bd22-5aa0e3a261f2 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:54:56.454676 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-a79af39a-15a8-4874-bd22-5aa0e3a261f2 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] [instance: 2098e0b9-b628-4b9e-979b-960c68830fee] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:54:56.471099 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a79af39a-15a8-4874-bd22-5aa0e3a261f2 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:56.472020 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a79af39a-15a8-4874-bd22-5aa0e3a261f2 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:56.473407 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a79af39a-15a8-4874-bd22-5aa0e3a261f2 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:56.475421 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a79af39a-15a8-4874-bd22-5aa0e3a261f2 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:56.478145 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a79af39a-15a8-4874-bd22-5aa0e3a261f2 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:56.478857 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a79af39a-15a8-4874-bd22-5aa0e3a261f2 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:56.874341 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-a79af39a-15a8-4874-bd22-5aa0e3a261f2 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/2098e0b9-b628-4b9e-979b-960c68830fee" status: 200 len: 1859 microversion: 2.1 time: 0.431137 Sep 14 08:54:56.887859 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 830/1628] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:54:56 2022] GET /compute/v2.1/servers/2098e0b9-b628-4b9e-979b-960c68830fee => generated 1859 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:54:56.899682 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-32e3d6f8-6db8-4d6c-be2b-9db9fb85b93e tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:54:56.900901 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-32e3d6f8-6db8-4d6c-be2b-9db9fb85b93e tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] [instance: c9ccb0fe-b328-45f9-811f-a0ad6068875e] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:54:56.909303 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-32e3d6f8-6db8-4d6c-be2b-9db9fb85b93e tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:56.910091 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-32e3d6f8-6db8-4d6c-be2b-9db9fb85b93e tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:56.910722 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-32e3d6f8-6db8-4d6c-be2b-9db9fb85b93e tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:56.911663 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-32e3d6f8-6db8-4d6c-be2b-9db9fb85b93e tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:56.912305 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-32e3d6f8-6db8-4d6c-be2b-9db9fb85b93e tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:56.912933 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-32e3d6f8-6db8-4d6c-be2b-9db9fb85b93e tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:57.114698 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-32e3d6f8-6db8-4d6c-be2b-9db9fb85b93e tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4808b3a03f4bd8ad4af900bc926e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d8190fe7bb40beaea43a71808dc105', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:54:57.125373 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-32e3d6f8-6db8-4d6c-be2b-9db9fb85b93e tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] 10.222.0.60 "GET /compute/v2.1/servers/c9ccb0fe-b328-45f9-811f-a0ad6068875e" status: 200 len: 1312 microversion: 2.1 time: 0.236025 Sep 14 08:54:57.134768 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 831/1629] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:54:56 2022] GET /compute/v2.1/servers/c9ccb0fe-b328-45f9-811f-a0ad6068875e => generated 1312 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:54:57.169264 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-f41eab21-a1bd-4ce5-97d0-00bcf99f290e tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:54:57.171648 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-f41eab21-a1bd-4ce5-97d0-00bcf99f290e tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] [instance: 4ea5843e-ecf7-4b84-80cb-3f05b2b20982] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:54:57.188923 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f41eab21-a1bd-4ce5-97d0-00bcf99f290e tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:57.190718 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f41eab21-a1bd-4ce5-97d0-00bcf99f290e tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:57.194128 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f41eab21-a1bd-4ce5-97d0-00bcf99f290e tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:57.195263 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f41eab21-a1bd-4ce5-97d0-00bcf99f290e tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:57.203091 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f41eab21-a1bd-4ce5-97d0-00bcf99f290e tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:57.204599 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f41eab21-a1bd-4ce5-97d0-00bcf99f290e tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:57.370323 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-f41eab21-a1bd-4ce5-97d0-00bcf99f290e tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810376d6f0b4329abe0f8f79800b754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575684f36f9c4019926fc83541e152c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:54:57.385768 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-f41eab21-a1bd-4ce5-97d0-00bcf99f290e tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] 10.222.0.60 "GET /compute/v2.1/servers/4ea5843e-ecf7-4b84-80cb-3f05b2b20982" status: 200 len: 1253 microversion: 2.1 time: 0.233249 Sep 14 08:54:57.402825 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 832/1630] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:54:57 2022] GET /compute/v2.1/servers/4ea5843e-ecf7-4b84-80cb-3f05b2b20982 => generated 1253 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:54:57.403194 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-f5ebb277-1992-4a27-bf65-e4cff8c813b3 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-836830-18", "block_migration": true, "disk_over_commit": false}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:54:57.409474 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-f5ebb277-1992-4a27-bf65-e4cff8c813b3 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] [instance: 2098e0b9-b628-4b9e-979b-960c68830fee] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:54:57.429081 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f5ebb277-1992-4a27-bf65-e4cff8c813b3 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:57.430327 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f5ebb277-1992-4a27-bf65-e4cff8c813b3 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:57.430783 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f5ebb277-1992-4a27-bf65-e4cff8c813b3 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:57.431552 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f5ebb277-1992-4a27-bf65-e4cff8c813b3 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:54:57.432014 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f5ebb277-1992-4a27-bf65-e4cff8c813b3 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:54:57.432435 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f5ebb277-1992-4a27-bf65-e4cff8c813b3 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:54:57.476591 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:54:57.544536 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.objects.instance [None req-f5ebb277-1992-4a27-bf65-e4cff8c813b3 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Lazy-loading 'flavor' on Instance uuid 2098e0b9-b628-4b9e-979b-960c68830fee {{(pid=128758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 08:54:57.590903 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-f5ebb277-1992-4a27-bf65-e4cff8c813b3 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] [instance: 2098e0b9-b628-4b9e-979b-960c68830fee] Going to try to live migrate instance to n-h2-836830-18 {{(pid=128758) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 14 08:55:00.198798 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-f5ebb277-1992-4a27-bf65-e4cff8c813b3 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/2098e0b9-b628-4b9e-979b-960c68830fee/action" status: 202 len: 0 microversion: 2.1 time: 2.806633 Sep 14 08:55:00.200498 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 833/1631] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 08:54:57 2022] POST /compute/v2.1/servers/2098e0b9-b628-4b9e-979b-960c68830fee/action => generated 0 bytes in 2811 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 08:55:00.208410 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ce34174b-fef0-4c6e-af91-3b9f846e59d9 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:55:00.209252 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-ce34174b-fef0-4c6e-af91-3b9f846e59d9 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] [instance: a4474e04-7712-41de-bbf8-a872101a9808] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:55:00.221073 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ce34174b-fef0-4c6e-af91-3b9f846e59d9 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:00.221933 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ce34174b-fef0-4c6e-af91-3b9f846e59d9 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:00.222591 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ce34174b-fef0-4c6e-af91-3b9f846e59d9 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:00.223599 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ce34174b-fef0-4c6e-af91-3b9f846e59d9 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:00.224253 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ce34174b-fef0-4c6e-af91-3b9f846e59d9 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:00.224902 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ce34174b-fef0-4c6e-af91-3b9f846e59d9 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:00.484443 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.network.neutron [None req-a48fa8f4-b495-4560-a735-a38a37729fa8 tempest-AbsoluteLimitsNegativeTestJSON-701431611 tempest-AbsoluteLimitsNegativeTestJSON-701431611-project] validate_networks() for None {{(pid=128759) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 08:55:00.498405 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-ce34174b-fef0-4c6e-af91-3b9f846e59d9 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5040fc9212814c4fa9e038116578eebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a963df1b646f1918426fe1a7cb23c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:55:00.507811 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-ce34174b-fef0-4c6e-af91-3b9f846e59d9 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] 10.222.0.60 "GET /compute/v2.1/servers/a4474e04-7712-41de-bbf8-a872101a9808" status: 200 len: 1577 microversion: 2.1 time: 0.305866 Sep 14 08:55:00.508406 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 834/1632] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:55:00 2022] GET /compute/v2.1/servers/a4474e04-7712-41de-bbf8-a872101a9808 => generated 1577 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:55:00.531987 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ead871f2-30cf-4bda-a0de-82ea5edf71a0 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:55:00.537128 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-ead871f2-30cf-4bda-a0de-82ea5edf71a0 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] [instance: c9ccb0fe-b328-45f9-811f-a0ad6068875e] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:55:00.556886 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ead871f2-30cf-4bda-a0de-82ea5edf71a0 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:00.565712 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ead871f2-30cf-4bda-a0de-82ea5edf71a0 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:00.566195 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ead871f2-30cf-4bda-a0de-82ea5edf71a0 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:00.567399 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ead871f2-30cf-4bda-a0de-82ea5edf71a0 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:00.575942 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ead871f2-30cf-4bda-a0de-82ea5edf71a0 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:00.576404 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ead871f2-30cf-4bda-a0de-82ea5edf71a0 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:01.104081 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=57 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:55:01.114563 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-ead871f2-30cf-4bda-a0de-82ea5edf71a0 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4808b3a03f4bd8ad4af900bc926e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d8190fe7bb40beaea43a71808dc105', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:55:01.116364 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-a48fa8f4-b495-4560-a735-a38a37729fa8 tempest-AbsoluteLimitsNegativeTestJSON-701431611 tempest-AbsoluteLimitsNegativeTestJSON-701431611-project] Getting quotas for project 9028ed1dcfe94dde9114e60f5364ac1d. Resources: dict_keys(['metadata_items']) {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 08:55:01.122199 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-a48fa8f4-b495-4560-a735-a38a37729fa8 tempest-AbsoluteLimitsNegativeTestJSON-701431611 tempest-AbsoluteLimitsNegativeTestJSON-701431611-project] Getting quotas for user 9398b2277baf4547a94a6cef7681c97e and project 9028ed1dcfe94dde9114e60f5364ac1d. Resources: dict_keys(['metadata_items']) {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 08:55:01.122599 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-ead871f2-30cf-4bda-a0de-82ea5edf71a0 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] 10.222.0.60 "GET /compute/v2.1/servers/c9ccb0fe-b328-45f9-811f-a0ad6068875e" status: 200 len: 1312 microversion: 2.1 time: 0.598720 Sep 14 08:55:01.134999 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 835/1633] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:55:00 2022] GET /compute/v2.1/servers/c9ccb0fe-b328-45f9-811f-a0ad6068875e => generated 1312 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:55:01.141488 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ef86420a-b75f-4ceb-a2e5-2fcc36db37d1 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:55:01.141488 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-ef86420a-b75f-4ceb-a2e5-2fcc36db37d1 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] [instance: 4ea5843e-ecf7-4b84-80cb-3f05b2b20982] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:55:01.153786 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-a48fa8f4-b495-4560-a735-a38a37729fa8 tempest-AbsoluteLimitsNegativeTestJSON-701431611 tempest-AbsoluteLimitsNegativeTestJSON-701431611-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Sep 14 08:55:01.161601 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ef86420a-b75f-4ceb-a2e5-2fcc36db37d1 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:01.162098 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ef86420a-b75f-4ceb-a2e5-2fcc36db37d1 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:01.162542 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ef86420a-b75f-4ceb-a2e5-2fcc36db37d1 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:01.163298 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ef86420a-b75f-4ceb-a2e5-2fcc36db37d1 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:01.163758 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ef86420a-b75f-4ceb-a2e5-2fcc36db37d1 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:01.164199 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ef86420a-b75f-4ceb-a2e5-2fcc36db37d1 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:01.168757 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a48fa8f4-b495-4560-a735-a38a37729fa8 tempest-AbsoluteLimitsNegativeTestJSON-701431611 tempest-AbsoluteLimitsNegativeTestJSON-701431611-project] Request method failure captured: Sep 14 08:55:01.168757 n-d-836830-18 devstack@n-api.service[128759]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 14 08:55:01.168757 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 08:55:01.168757 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 08:55:01.168757 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 08:55:01.168757 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 1752 Sep 14 08:55:01.168757 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 08:55:01.168757 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 08:55:01.168757 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 08:55:01.168757 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 08:55:01.168757 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZbWjwvkgbg0TZCdpZfqdaQXQeLtONXNnBYqaTSEjEKvh9yripKt-neoewRMgHgDpeuUWRLGSwCqb981puSKXV0wLtoOWE154AkgT9KdqJyDhAWoj49VqmGcaWvZigfXY0kGKnLi9JUUydfM5EM-ICNT9VAbpa_cXvaGW13PX_Qvk84 Sep 14 08:55:01.168757 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 08:55:01.168757 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 08:55:01.168757 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 08:55:01.168757 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 08:55:01.168757 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 08:55:01.168757 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 08:55:01.168757 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 9028ed1dcfe94dde9114e60f5364ac1d Sep 14 08:55:01.168757 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-701431611 Sep 14 08:55:01.168757 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 08:55:01.168757 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 08:55:01.168757 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/9028ed1dcfe94dde9114e60f5364ac1d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_9028ed1dcfe94dde9114e60f5364ac1d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9028ed1dcfe94dde9114e60f5364ac1d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9028ed1dcfe94dde9114e60f5364ac1d"}]}] Sep 14 08:55:01.168757 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-701431611 Sep 14 08:55:01.168757 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 9028ed1dcfe94dde9114e60f5364ac1d Sep 14 08:55:01.168757 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-701431611 Sep 14 08:55:01.168757 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-701431611-project Sep 14 08:55:01.168757 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 08:55:01.168757 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 08:55:01.168757 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 9398b2277baf4547a94a6cef7681c97e Sep 14 08:55:01.168757 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-701431611-project Sep 14 08:55:01.168757 n-d-836830-18 devstack@n-api.service[128759]: Sep 14 08:55:01.168757 n-d-836830-18 devstack@n-api.service[128759]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1412895357", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Sep 14 08:55:01.168757 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 08:55:01.168757 n-d-836830-18 devstack@n-api.service[128759]: exception: Maximum number of metadata items exceeds 128 Sep 14 08:55:01.171534 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-1412895357', 'imageRef': 'bff4ab7f-4846-441f-8940-d96fec4c28e9', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Sep 14 08:55:01.171534 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:55:01.171534 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:55:01.171534 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 476, in _check_metadata_properties_quota Sep 14 08:55:01.171534 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Sep 14 08:55:01.171534 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 14 08:55:01.171534 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 14 08:55:01.171534 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Sep 14 08:55:01.171534 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Sep 14 08:55:01.171534 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Sep 14 08:55:01.171534 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Sep 14 08:55:01.171534 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Sep 14 08:55:01.171534 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Sep 14 08:55:01.171534 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Sep 14 08:55:01.171534 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:55:01.171534 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:55:01.171534 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:55:01.171534 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:55:01.171534 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 14 08:55:01.171534 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 14 08:55:01.171534 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 14 08:55:01.171534 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 14 08:55:01.171534 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Sep 14 08:55:01.171534 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Sep 14 08:55:01.171534 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1016, in _checks_for_create_and_rebuild Sep 14 08:55:01.171534 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Sep 14 08:55:01.171534 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 483, in _check_metadata_properties_quota Sep 14 08:55:01.171534 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Sep 14 08:55:01.171534 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Sep 14 08:55:01.171534 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:55:01.171534 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:55:01.171534 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:55:01.171534 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:55:01.171534 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:55:01.171534 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:55:01.171534 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:55:01.171534 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:55:01.171534 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:55:01.171534 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:55:01.171534 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 08:55:01.171534 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 08:55:01.171534 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 08:55:01.171534 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 08:55:01.171534 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 08:55:01.174877 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 08:55:01.174877 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 14 08:55:01.174877 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Sep 14 08:55:01.174877 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 14 08:55:01.174877 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Sep 14 08:55:01.174877 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:55:01.174877 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:55:01.174877 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:55:01.174877 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:55:01.174877 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:55:01.174877 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:55:01.174877 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:55:01.174877 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:55:01.174877 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Sep 14 08:55:01.174877 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:55:01.178745 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a48fa8f4-b495-4560-a735-a38a37729fa8 tempest-AbsoluteLimitsNegativeTestJSON-701431611 tempest-AbsoluteLimitsNegativeTestJSON-701431611-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:55:01.180148 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a48fa8f4-b495-4560-a735-a38a37729fa8 tempest-AbsoluteLimitsNegativeTestJSON-701431611 tempest-AbsoluteLimitsNegativeTestJSON-701431611-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 6.486112 Sep 14 08:55:01.181283 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 799/1634] 10.222.0.60 () {60 vars in 1148 bytes} [Wed Sep 14 08:54:54 2022] POST /compute/v2.1/servers => generated 87 bytes in 6488 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Sep 14 08:55:01.192612 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-1c1ebea4-4a0d-491a-ad77-d9751f469d92 req-b2cc16e3-ea39-426b-bf61-70a2684233db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9ccb0fe-b328-45f9-811f-a0ad6068875e", "name": "network-vif-plugged", "status": "completed", "tag": "be79e1ef-4da1-405c-a53b-2091542beac5"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:55:01.217364 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-1c1ebea4-4a0d-491a-ad77-d9751f469d92 req-b2cc16e3-ea39-426b-bf61-70a2684233db service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:01.218209 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-1c1ebea4-4a0d-491a-ad77-d9751f469d92 req-b2cc16e3-ea39-426b-bf61-70a2684233db service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:01.218885 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-1c1ebea4-4a0d-491a-ad77-d9751f469d92 req-b2cc16e3-ea39-426b-bf61-70a2684233db service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:01.240825 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-1c1ebea4-4a0d-491a-ad77-d9751f469d92 req-b2cc16e3-ea39-426b-bf61-70a2684233db service nova] Creating event network-vif-plugged:be79e1ef-4da1-405c-a53b-2091542beac5 for instance c9ccb0fe-b328-45f9-811f-a0ad6068875e on n-h1-836830-18 Sep 14 08:55:01.259278 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-1c1ebea4-4a0d-491a-ad77-d9751f469d92 req-b2cc16e3-ea39-426b-bf61-70a2684233db service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076432 Sep 14 08:55:01.260649 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 800/1635] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:55:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:55:01.284776 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-ef86420a-b75f-4ceb-a2e5-2fcc36db37d1 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810376d6f0b4329abe0f8f79800b754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575684f36f9c4019926fc83541e152c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:55:01.293030 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-ef86420a-b75f-4ceb-a2e5-2fcc36db37d1 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] 10.222.0.60 "GET /compute/v2.1/servers/4ea5843e-ecf7-4b84-80cb-3f05b2b20982" status: 200 len: 1253 microversion: 2.1 time: 0.168745 Sep 14 08:55:01.293630 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 836/1636] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:55:01 2022] GET /compute/v2.1/servers/4ea5843e-ecf7-4b84-80cb-3f05b2b20982 => generated 1253 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:55:01.305753 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c7f2f221-bc27-49aa-90a2-4e7f7161c680 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:55:01.306378 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-c7f2f221-bc27-49aa-90a2-4e7f7161c680 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: 2098e0b9-b628-4b9e-979b-960c68830fee] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:55:01.335227 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c7f2f221-bc27-49aa-90a2-4e7f7161c680 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:01.335451 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c7f2f221-bc27-49aa-90a2-4e7f7161c680 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:01.335824 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c7f2f221-bc27-49aa-90a2-4e7f7161c680 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:01.336550 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c7f2f221-bc27-49aa-90a2-4e7f7161c680 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:01.337078 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c7f2f221-bc27-49aa-90a2-4e7f7161c680 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:01.337445 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c7f2f221-bc27-49aa-90a2-4e7f7161c680 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:01.592910 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-0c799563-1c79-4f59-9b61-71f839f022a2 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1468102865", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:55:01.675471 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.network.neutron [None req-0c799563-1c79-4f59-9b61-71f839f022a2 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] validate_networks() for None {{(pid=128759) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 08:55:02.106758 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-c7f2f221-bc27-49aa-90a2-4e7f7161c680 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:55:02.127280 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-c7f2f221-bc27-49aa-90a2-4e7f7161c680 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/2098e0b9-b628-4b9e-979b-960c68830fee" status: 200 len: 1716 microversion: 2.1 time: 0.831923 Sep 14 08:55:02.132974 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 837/1637] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:55:01 2022] GET /compute/v2.1/servers/2098e0b9-b628-4b9e-979b-960c68830fee => generated 1716 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:55:02.150666 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b4dc40ea-df5c-4afc-b1e7-4f751c215aff tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:55:02.152868 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-b4dc40ea-df5c-4afc-b1e7-4f751c215aff tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] [instance: a4474e04-7712-41de-bbf8-a872101a9808] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:55:02.165337 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b4dc40ea-df5c-4afc-b1e7-4f751c215aff tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:02.166130 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b4dc40ea-df5c-4afc-b1e7-4f751c215aff tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:02.166810 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b4dc40ea-df5c-4afc-b1e7-4f751c215aff tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:02.167830 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b4dc40ea-df5c-4afc-b1e7-4f751c215aff tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:02.168518 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b4dc40ea-df5c-4afc-b1e7-4f751c215aff tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:02.169172 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b4dc40ea-df5c-4afc-b1e7-4f751c215aff tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:02.341147 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-0c799563-1c79-4f59-9b61-71f839f022a2 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Flavor limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 08:55:02.343291 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-0c799563-1c79-4f59-9b61-71f839f022a2 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Image limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 08:55:02.344106 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-0c799563-1c79-4f59-9b61-71f839f022a2 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Flavor pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 08:55:02.344749 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-0c799563-1c79-4f59-9b61-71f839f022a2 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Image pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 08:55:02.346606 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-0c799563-1c79-4f59-9b61-71f839f022a2 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 08:55:02.371271 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-b4dc40ea-df5c-4afc-b1e7-4f751c215aff tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] 10.222.0.60 "GET /compute/v2.1/servers/a4474e04-7712-41de-bbf8-a872101a9808/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.236531 Sep 14 08:55:02.373396 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 838/1638] 10.222.0.60 () {58 vars in 1275 bytes} [Wed Sep 14 08:55:02 2022] GET /compute/v2.1/servers/a4474e04-7712-41de-bbf8-a872101a9808/os-interface => generated 285 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:55:02.381998 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a5264ac9-cdae-4a62-bbaa-aa00ef8f57ff tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:55:02.383994 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-a5264ac9-cdae-4a62-bbaa-aa00ef8f57ff tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] [instance: c9ccb0fe-b328-45f9-811f-a0ad6068875e] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:55:02.387692 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0c799563-1c79-4f59-9b61-71f839f022a2 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:02.390472 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0c799563-1c79-4f59-9b61-71f839f022a2 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:02.394057 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0c799563-1c79-4f59-9b61-71f839f022a2 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:02.399314 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0c799563-1c79-4f59-9b61-71f839f022a2 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:02.401824 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0c799563-1c79-4f59-9b61-71f839f022a2 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:02.404127 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0c799563-1c79-4f59-9b61-71f839f022a2 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:02.416640 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a5264ac9-cdae-4a62-bbaa-aa00ef8f57ff tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:02.431933 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a5264ac9-cdae-4a62-bbaa-aa00ef8f57ff tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:02.432890 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a5264ac9-cdae-4a62-bbaa-aa00ef8f57ff tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:02.437051 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a5264ac9-cdae-4a62-bbaa-aa00ef8f57ff tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:02.440457 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a5264ac9-cdae-4a62-bbaa-aa00ef8f57ff tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:02.441002 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a5264ac9-cdae-4a62-bbaa-aa00ef8f57ff tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:02.443981 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-0c799563-1c79-4f59-9b61-71f839f022a2 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Getting quotas for project 51ecc8c1389847c7bcd9cd5570d990e8. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 08:55:02.449902 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-0c799563-1c79-4f59-9b61-71f839f022a2 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Getting quotas for user 0ab2d64c1cb447f9bfd658408aa07e06 and project 51ecc8c1389847c7bcd9cd5570d990e8. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 08:55:02.473212 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-0c799563-1c79-4f59-9b61-71f839f022a2 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Going to run 1 instances... {{(pid=128759) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 08:55:02.476248 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-0c799563-1c79-4f59-9b61-71f839f022a2 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] [instance: 8dd1623b-312c-411d-8f6c-b334195e573b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128759) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 08:55:02.577698 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-0c799563-1c79-4f59-9b61-71f839f022a2 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.312482 Sep 14 08:55:02.578985 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 801/1639] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 08:55:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1318 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 08:55:02.613593 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-4ab6a730-d894-4f7a-8aa2-4d62c76abeac tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:55:02.615250 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-4ab6a730-d894-4f7a-8aa2-4d62c76abeac tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] [instance: 4ea5843e-ecf7-4b84-80cb-3f05b2b20982] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:55:02.634592 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4ab6a730-d894-4f7a-8aa2-4d62c76abeac tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:02.635602 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4ab6a730-d894-4f7a-8aa2-4d62c76abeac tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:02.637016 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4ab6a730-d894-4f7a-8aa2-4d62c76abeac tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:02.637982 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4ab6a730-d894-4f7a-8aa2-4d62c76abeac tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:02.640069 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4ab6a730-d894-4f7a-8aa2-4d62c76abeac tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:02.640760 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4ab6a730-d894-4f7a-8aa2-4d62c76abeac tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:02.830181 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-4ab6a730-d894-4f7a-8aa2-4d62c76abeac tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810376d6f0b4329abe0f8f79800b754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575684f36f9c4019926fc83541e152c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:55:02.839394 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-4ab6a730-d894-4f7a-8aa2-4d62c76abeac tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] 10.222.0.60 "GET /compute/v2.1/servers/4ea5843e-ecf7-4b84-80cb-3f05b2b20982" status: 200 len: 1253 microversion: 2.1 time: 0.254847 Sep 14 08:55:02.843226 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 802/1640] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:55:02 2022] GET /compute/v2.1/servers/4ea5843e-ecf7-4b84-80cb-3f05b2b20982 => generated 1253 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:55:02.856042 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f42dff89-9633-4f2f-b21a-629adf0ef7e4 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1536373077", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:55:02.877728 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-a5264ac9-cdae-4a62-bbaa-aa00ef8f57ff tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4808b3a03f4bd8ad4af900bc926e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d8190fe7bb40beaea43a71808dc105', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:55:02.888600 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-a5264ac9-cdae-4a62-bbaa-aa00ef8f57ff tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] 10.222.0.60 "GET /compute/v2.1/servers/c9ccb0fe-b328-45f9-811f-a0ad6068875e" status: 200 len: 1312 microversion: 2.1 time: 0.513524 Sep 14 08:55:02.891365 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 839/1641] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:55:02 2022] GET /compute/v2.1/servers/c9ccb0fe-b328-45f9-811f-a0ad6068875e => generated 1312 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:55:03.015964 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.network.neutron [None req-f42dff89-9633-4f2f-b21a-629adf0ef7e4 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] validate_networks() for None {{(pid=128759) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 08:55:03.161222 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-3b1635d3-1452-4d78-8421-36af59dd3bff tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:55:03.161865 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-3b1635d3-1452-4d78-8421-36af59dd3bff tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: 2098e0b9-b628-4b9e-979b-960c68830fee] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:55:03.187636 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3b1635d3-1452-4d78-8421-36af59dd3bff tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:03.187636 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3b1635d3-1452-4d78-8421-36af59dd3bff tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:03.187636 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3b1635d3-1452-4d78-8421-36af59dd3bff tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:03.187636 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3b1635d3-1452-4d78-8421-36af59dd3bff tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:03.187636 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3b1635d3-1452-4d78-8421-36af59dd3bff tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:03.187636 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3b1635d3-1452-4d78-8421-36af59dd3bff tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:03.257727 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=8 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:55:03.769290 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-f42dff89-9633-4f2f-b21a-629adf0ef7e4 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Flavor limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 08:55:03.769867 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-f42dff89-9633-4f2f-b21a-629adf0ef7e4 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Image limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 08:55:03.770247 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-f42dff89-9633-4f2f-b21a-629adf0ef7e4 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Flavor pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 08:55:03.770812 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-f42dff89-9633-4f2f-b21a-629adf0ef7e4 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Image pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 08:55:03.771270 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-f42dff89-9633-4f2f-b21a-629adf0ef7e4 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 08:55:03.792893 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f42dff89-9633-4f2f-b21a-629adf0ef7e4 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:03.794019 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f42dff89-9633-4f2f-b21a-629adf0ef7e4 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:03.795730 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f42dff89-9633-4f2f-b21a-629adf0ef7e4 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:03.797400 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f42dff89-9633-4f2f-b21a-629adf0ef7e4 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:03.798611 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f42dff89-9633-4f2f-b21a-629adf0ef7e4 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:03.799280 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f42dff89-9633-4f2f-b21a-629adf0ef7e4 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:03.832228 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-f42dff89-9633-4f2f-b21a-629adf0ef7e4 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Getting quotas for project 51ecc8c1389847c7bcd9cd5570d990e8. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 08:55:03.842319 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-f42dff89-9633-4f2f-b21a-629adf0ef7e4 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Getting quotas for user 0ab2d64c1cb447f9bfd658408aa07e06 and project 51ecc8c1389847c7bcd9cd5570d990e8. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 08:55:03.859390 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f42dff89-9633-4f2f-b21a-629adf0ef7e4 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Going to run 1 instances... {{(pid=128759) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 08:55:03.862414 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f42dff89-9633-4f2f-b21a-629adf0ef7e4 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] [instance: 6ada18a6-f9cb-4bc9-800d-e0218adc4866] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128759) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 08:55:03.893023 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=82 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:55:03.943170 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-3b1635d3-1452-4d78-8421-36af59dd3bff tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:55:03.952997 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-3b1635d3-1452-4d78-8421-36af59dd3bff tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/2098e0b9-b628-4b9e-979b-960c68830fee" status: 200 len: 1716 microversion: 2.1 time: 0.796756 Sep 14 08:55:03.982812 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 840/1642] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:55:03 2022] GET /compute/v2.1/servers/2098e0b9-b628-4b9e-979b-960c68830fee => generated 1716 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:55:04.000725 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-89a2c893-9640-43c4-909c-77b8ffd29f24 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:55:04.002551 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-89a2c893-9640-43c4-909c-77b8ffd29f24 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] [instance: 4ea5843e-ecf7-4b84-80cb-3f05b2b20982] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:55:04.020633 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-89a2c893-9640-43c4-909c-77b8ffd29f24 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:04.021353 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-89a2c893-9640-43c4-909c-77b8ffd29f24 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:04.022009 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-89a2c893-9640-43c4-909c-77b8ffd29f24 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:04.023304 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-89a2c893-9640-43c4-909c-77b8ffd29f24 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:04.023951 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-89a2c893-9640-43c4-909c-77b8ffd29f24 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:04.024634 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-89a2c893-9640-43c4-909c-77b8ffd29f24 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:04.035762 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f42dff89-9633-4f2f-b21a-629adf0ef7e4 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.184455 Sep 14 08:55:04.042597 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 803/1643] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 08:55:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1197 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 08:55:04.107176 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b14bb0f6-c38c-4d71-8a78-c947802af21f tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:55:04.113104 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b14bb0f6-c38c-4d71-8a78-c947802af21f tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] [instance: c9ccb0fe-b328-45f9-811f-a0ad6068875e] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:55:04.136966 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-89a2c893-9640-43c4-909c-77b8ffd29f24 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:04.137643 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-89a2c893-9640-43c4-909c-77b8ffd29f24 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:04.138342 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-89a2c893-9640-43c4-909c-77b8ffd29f24 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:04.139087 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.objects.instance [None req-89a2c893-9640-43c4-909c-77b8ffd29f24 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lazy-loading 'fault' on Instance uuid 4ea5843e-ecf7-4b84-80cb-3f05b2b20982 {{(pid=128758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 08:55:04.158123 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b14bb0f6-c38c-4d71-8a78-c947802af21f tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:04.162241 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b14bb0f6-c38c-4d71-8a78-c947802af21f tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:04.168575 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b14bb0f6-c38c-4d71-8a78-c947802af21f tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:04.177811 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b14bb0f6-c38c-4d71-8a78-c947802af21f tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:04.178323 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b14bb0f6-c38c-4d71-8a78-c947802af21f tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:04.190965 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b14bb0f6-c38c-4d71-8a78-c947802af21f tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:04.236547 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-89a2c893-9640-43c4-909c-77b8ffd29f24 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9810376d6f0b4329abe0f8f79800b754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575684f36f9c4019926fc83541e152c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:55:04.253673 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-89a2c893-9640-43c4-909c-77b8ffd29f24 tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] 10.222.0.60 "GET /compute/v2.1/servers/4ea5843e-ecf7-4b84-80cb-3f05b2b20982" status: 200 len: 1258 microversion: 2.1 time: 0.261913 Sep 14 08:55:04.255464 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 841/1644] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:55:03 2022] GET /compute/v2.1/servers/4ea5843e-ecf7-4b84-80cb-3f05b2b20982 => generated 1258 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:55:04.261514 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-0665d1f8-afc9-4b16-8433-b1e39e0c3975 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:55:04.270641 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-0665d1f8-afc9-4b16-8433-b1e39e0c3975 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] [instance: 6ada18a6-f9cb-4bc9-800d-e0218adc4866] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:55:04.398641 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-0665d1f8-afc9-4b16-8433-b1e39e0c3975 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab2d64c1cb447f9bfd658408aa07e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ecc8c1389847c7bcd9cd5570d990e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:55:04.406911 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-0665d1f8-afc9-4b16-8433-b1e39e0c3975 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] 10.222.0.60 "GET /compute/v2.1/servers/6ada18a6-f9cb-4bc9-800d-e0218adc4866" status: 200 len: 1214 microversion: 2.1 time: 0.150087 Sep 14 08:55:04.415164 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 842/1645] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:55:04 2022] GET /compute/v2.1/servers/6ada18a6-f9cb-4bc9-800d-e0218adc4866 => generated 1214 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:55:04.770397 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b14bb0f6-c38c-4d71-8a78-c947802af21f tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4808b3a03f4bd8ad4af900bc926e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d8190fe7bb40beaea43a71808dc105', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:55:04.784624 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b14bb0f6-c38c-4d71-8a78-c947802af21f tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] 10.222.0.60 "GET /compute/v2.1/servers/c9ccb0fe-b328-45f9-811f-a0ad6068875e" status: 200 len: 1497 microversion: 2.1 time: 0.740779 Sep 14 08:55:04.785939 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 804/1646] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:55:04 2022] GET /compute/v2.1/servers/c9ccb0fe-b328-45f9-811f-a0ad6068875e => generated 1497 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:55:04.812226 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1b02ef5b-ae00-42e0-8a0d-bd77e3198b92 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:55:04.883382 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.compute.server_groups [None req-1b02ef5b-ae00-42e0-8a0d-bd77e3198b92 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Querying cell 0a35f87f-19b7-4b11-98e6-8bcd07b0466f(cell1) for 1 instances {{(pid=128758) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Sep 14 08:55:04.892160 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1b02ef5b-ae00-42e0-8a0d-bd77e3198b92 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:04.893946 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1b02ef5b-ae00-42e0-8a0d-bd77e3198b92 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:04.898315 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1b02ef5b-ae00-42e0-8a0d-bd77e3198b92 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:04.994012 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-6c158cc9-5d0c-4e7d-9aef-743e6e9f6681 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:55:04.995179 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-6c158cc9-5d0c-4e7d-9aef-743e6e9f6681 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: 2098e0b9-b628-4b9e-979b-960c68830fee] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:55:05.021733 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-1b02ef5b-ae00-42e0-8a0d-bd77e3198b92 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] 10.222.0.60 "GET /compute/v2.1/os-server-groups/ab23666b-035e-4c9f-88a6-d3e41c2eebf9" status: 200 len: 222 microversion: 2.1 time: 0.214822 Sep 14 08:55:05.025316 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6c158cc9-5d0c-4e7d-9aef-743e6e9f6681 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:05.032241 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6c158cc9-5d0c-4e7d-9aef-743e6e9f6681 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:05.035813 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 843/1647] 10.222.0.60 () {58 vars in 1263 bytes} [Wed Sep 14 08:55:04 2022] GET /compute/v2.1/os-server-groups/ab23666b-035e-4c9f-88a6-d3e41c2eebf9 => generated 222 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:55:05.039633 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6c158cc9-5d0c-4e7d-9aef-743e6e9f6681 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:05.045684 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6c158cc9-5d0c-4e7d-9aef-743e6e9f6681 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:05.049202 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6c158cc9-5d0c-4e7d-9aef-743e6e9f6681 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:05.054287 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6c158cc9-5d0c-4e7d-9aef-743e6e9f6681 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:05.067626 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a6c616ad-3bf1-4661-96e2-73a92b1d1fc2 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:55:05.073553 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-a6c616ad-3bf1-4661-96e2-73a92b1d1fc2 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] [instance: c9ccb0fe-b328-45f9-811f-a0ad6068875e] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:55:05.106876 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a6c616ad-3bf1-4661-96e2-73a92b1d1fc2 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:05.113106 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a6c616ad-3bf1-4661-96e2-73a92b1d1fc2 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:05.119596 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a6c616ad-3bf1-4661-96e2-73a92b1d1fc2 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:05.127310 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a6c616ad-3bf1-4661-96e2-73a92b1d1fc2 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:05.130898 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a6c616ad-3bf1-4661-96e2-73a92b1d1fc2 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:05.137338 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a6c616ad-3bf1-4661-96e2-73a92b1d1fc2 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:05.218566 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-a6c616ad-3bf1-4661-96e2-73a92b1d1fc2 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] [instance: c9ccb0fe-b328-45f9-811f-a0ad6068875e] Going to try to terminate instance {{(pid=128758) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 08:55:05.573297 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-6c158cc9-5d0c-4e7d-9aef-743e6e9f6681 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:55:05.586736 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-6c158cc9-5d0c-4e7d-9aef-743e6e9f6681 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/2098e0b9-b628-4b9e-979b-960c68830fee" status: 200 len: 1716 microversion: 2.1 time: 0.598477 Sep 14 08:55:05.590461 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 805/1648] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:55:04 2022] GET /compute/v2.1/servers/2098e0b9-b628-4b9e-979b-960c68830fee => generated 1716 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:55:05.595486 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-bb25f43c-7bda-4ee0-af01-7661302b7ddc tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:55:05.596333 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-bb25f43c-7bda-4ee0-af01-7661302b7ddc tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] [instance: 4ea5843e-ecf7-4b84-80cb-3f05b2b20982] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:55:05.637540 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bb25f43c-7bda-4ee0-af01-7661302b7ddc tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:05.639497 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bb25f43c-7bda-4ee0-af01-7661302b7ddc tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:05.644373 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bb25f43c-7bda-4ee0-af01-7661302b7ddc tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:05.646410 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bb25f43c-7bda-4ee0-af01-7661302b7ddc tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:05.651997 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bb25f43c-7bda-4ee0-af01-7661302b7ddc tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:05.654560 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bb25f43c-7bda-4ee0-af01-7661302b7ddc tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:05.673879 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-a6c616ad-3bf1-4661-96e2-73a92b1d1fc2 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] 10.222.0.60 "DELETE /compute/v2.1/servers/c9ccb0fe-b328-45f9-811f-a0ad6068875e" status: 204 len: 0 microversion: 2.1 time: 0.635859 Sep 14 08:55:05.684820 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 844/1649] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 08:55:05 2022] DELETE /compute/v2.1/servers/c9ccb0fe-b328-45f9-811f-a0ad6068875e => generated 0 bytes in 645 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 08:55:05.695150 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-bb25f43c-7bda-4ee0-af01-7661302b7ddc tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] HTTP exception thrown: Instance 4ea5843e-ecf7-4b84-80cb-3f05b2b20982 could not be found. Sep 14 08:55:05.697112 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-bb25f43c-7bda-4ee0-af01-7661302b7ddc tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Request method failure captured: Sep 14 08:55:05.697112 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/4ea5843e-ecf7-4b84-80cb-3f05b2b20982 HTTP/1.1 Sep 14 08:55:05.697112 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 08:55:05.697112 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 08:55:05.697112 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 08:55:05.697112 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 08:55:05.697112 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 08:55:05.697112 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 08:55:05.697112 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 08:55:05.697112 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 08:55:05.697112 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZZdsfEIFRP2_KhDOR6xrJsnu8usYetHgC-tGtSPTv9tRUo2wKYwOc-NlIekG0ycI5HB-8RN9TIPSAZ0852s_-4EmP_fzfiIWYOALGgyjz8izs32YFCgo4wOvVWVVrt8uXun8V8UfJS7tKq52iRJJir9jFBqzAXzYRUkXhokYIvA9IU Sep 14 08:55:05.697112 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 08:55:05.697112 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 08:55:05.697112 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 08:55:05.697112 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 08:55:05.697112 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 08:55:05.697112 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 08:55:05.697112 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 575684f36f9c4019926fc83541e152c0 Sep 14 08:55:05.697112 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ServersTestBootFromVolume-678429228 Sep 14 08:55:05.697112 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 08:55:05.697112 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 08:55:05.697112 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/575684f36f9c4019926fc83541e152c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_575684f36f9c4019926fc83541e152c0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/575684f36f9c4019926fc83541e152c0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/575684f36f9c4019926fc83541e152c0"}]}] Sep 14 08:55:05.697112 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ServersTestBootFromVolume-678429228 Sep 14 08:55:05.697112 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 575684f36f9c4019926fc83541e152c0 Sep 14 08:55:05.697112 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ServersTestBootFromVolume-678429228 Sep 14 08:55:05.697112 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ServersTestBootFromVolume-678429228-project Sep 14 08:55:05.697112 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 08:55:05.697112 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 08:55:05.697112 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 9810376d6f0b4329abe0f8f79800b754 Sep 14 08:55:05.697112 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ServersTestBootFromVolume-678429228-project Sep 14 08:55:05.697112 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 08:55:05.697112 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance 4ea5843e-ecf7-4b84-80cb-3f05b2b20982 could not be found. Sep 14 08:55:05.697112 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '4ea5843e-ecf7-4b84-80cb-3f05b2b20982'} Sep 14 08:55:05.697112 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:55:05.697112 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:55:05.697112 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 08:55:05.697112 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 08:55:05.697112 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 08:55:05.697112 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 08:55:05.697112 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 08:55:05.697112 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 08:55:05.697112 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 08:55:05.697112 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 08:55:05.697112 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ea5843e-ecf7-4b84-80cb-3f05b2b20982 could not be found. Sep 14 08:55:05.697112 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:55:05.697112 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:55:05.697112 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:55:05.697112 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:55:05.697112 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:55:05.697112 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:55:05.697112 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:55:05.697112 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:55:05.697112 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:55:05.697112 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:55:05.697112 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 08:55:05.697112 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 08:55:05.697112 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 08:55:05.697112 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 08:55:05.697112 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 08:55:05.697112 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 08:55:05.697112 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ea5843e-ecf7-4b84-80cb-3f05b2b20982 could not be found. Sep 14 08:55:05.697112 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:55:05.697112 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:55:05.697112 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:55:05.702133 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:55:05.702133 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:55:05.702133 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:55:05.702133 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:55:05.702133 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:55:05.702133 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ea5843e-ecf7-4b84-80cb-3f05b2b20982 could not be found. Sep 14 08:55:05.702133 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:55:05.702756 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-6b0eab21-9296-4a8f-bd07-bce8feadaa82 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:55:05.702756 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-6b0eab21-9296-4a8f-bd07-bce8feadaa82 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] [instance: 6ada18a6-f9cb-4bc9-800d-e0218adc4866] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:55:05.706588 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-bb25f43c-7bda-4ee0-af01-7661302b7ddc tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Returning 404 to user: Instance 4ea5843e-ecf7-4b84-80cb-3f05b2b20982 could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:55:05.708132 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-bb25f43c-7bda-4ee0-af01-7661302b7ddc tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] 10.222.0.60 "GET /compute/v2.1/servers/4ea5843e-ecf7-4b84-80cb-3f05b2b20982" status: 404 len: 111 microversion: 2.1 time: 0.116504 Sep 14 08:55:05.723729 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 806/1650] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:55:05 2022] GET /compute/v2.1/servers/4ea5843e-ecf7-4b84-80cb-3f05b2b20982 => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 08:55:05.740274 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3f820e83-a4b7-4b72-9a8a-e7bb4ece8a41 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:55:05.743289 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6b0eab21-9296-4a8f-bd07-bce8feadaa82 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:05.743798 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6b0eab21-9296-4a8f-bd07-bce8feadaa82 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:05.744243 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6b0eab21-9296-4a8f-bd07-bce8feadaa82 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:05.746647 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6b0eab21-9296-4a8f-bd07-bce8feadaa82 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:05.748050 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-3f820e83-a4b7-4b72-9a8a-e7bb4ece8a41 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] [instance: c9ccb0fe-b328-45f9-811f-a0ad6068875e] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:55:05.749548 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6b0eab21-9296-4a8f-bd07-bce8feadaa82 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:05.750018 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6b0eab21-9296-4a8f-bd07-bce8feadaa82 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:05.777383 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3f820e83-a4b7-4b72-9a8a-e7bb4ece8a41 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:05.782235 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3f820e83-a4b7-4b72-9a8a-e7bb4ece8a41 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:05.784449 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3f820e83-a4b7-4b72-9a8a-e7bb4ece8a41 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:05.785487 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3f820e83-a4b7-4b72-9a8a-e7bb4ece8a41 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:05.789835 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3f820e83-a4b7-4b72-9a8a-e7bb4ece8a41 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:05.795041 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3f820e83-a4b7-4b72-9a8a-e7bb4ece8a41 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:05.913130 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-6b0eab21-9296-4a8f-bd07-bce8feadaa82 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab2d64c1cb447f9bfd658408aa07e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ecc8c1389847c7bcd9cd5570d990e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:55:05.929444 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-6b0eab21-9296-4a8f-bd07-bce8feadaa82 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] 10.222.0.60 "GET /compute/v2.1/servers/6ada18a6-f9cb-4bc9-800d-e0218adc4866" status: 200 len: 1218 microversion: 2.1 time: 0.244953 Sep 14 08:55:05.930197 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 845/1651] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:55:05 2022] GET /compute/v2.1/servers/6ada18a6-f9cb-4bc9-800d-e0218adc4866 => generated 1218 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:55:05.938557 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-6b0b8330-c2e4-4b91-a0d3-7dc56c2a97ff tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] Calling method '.version_select at 0x7f7d445d9d30>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:55:06.072693 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-6b0b8330-c2e4-4b91-a0d3-7dc56c2a97ff tempest-ServersTestBootFromVolume-678429228 tempest-ServersTestBootFromVolume-678429228-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1657974209" status: 202 len: 0 microversion: 2.1 time: 0.134017 Sep 14 08:55:06.076464 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 846/1652] 10.222.0.60 () {58 vars in 1221 bytes} [Wed Sep 14 08:55:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1657974209 => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 08:55:06.203680 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-3f820e83-a4b7-4b72-9a8a-e7bb4ece8a41 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4808b3a03f4bd8ad4af900bc926e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d8190fe7bb40beaea43a71808dc105', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:55:06.212481 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-3f820e83-a4b7-4b72-9a8a-e7bb4ece8a41 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] 10.222.0.60 "GET /compute/v2.1/servers/c9ccb0fe-b328-45f9-811f-a0ad6068875e" status: 200 len: 1503 microversion: 2.1 time: 0.487155 Sep 14 08:55:06.215577 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 807/1653] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:55:05 2022] GET /compute/v2.1/servers/c9ccb0fe-b328-45f9-811f-a0ad6068875e => generated 1503 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:55:06.616686 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-98f97302-6bae-4f54-8952-17416067d61f tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:55:06.618421 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-98f97302-6bae-4f54-8952-17416067d61f tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: 2098e0b9-b628-4b9e-979b-960c68830fee] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:55:06.650143 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-98f97302-6bae-4f54-8952-17416067d61f tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:06.655182 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-98f97302-6bae-4f54-8952-17416067d61f tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:06.658837 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-98f97302-6bae-4f54-8952-17416067d61f tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:06.664364 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-98f97302-6bae-4f54-8952-17416067d61f tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:06.666461 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-98f97302-6bae-4f54-8952-17416067d61f tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:06.670038 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-98f97302-6bae-4f54-8952-17416067d61f tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:06.955299 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-2c80df9c-1c50-4ccc-98f2-4bf1fff139db tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:55:06.956070 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-2c80df9c-1c50-4ccc-98f2-4bf1fff139db tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] [instance: 6ada18a6-f9cb-4bc9-800d-e0218adc4866] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:55:06.979645 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2c80df9c-1c50-4ccc-98f2-4bf1fff139db tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:06.980357 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2c80df9c-1c50-4ccc-98f2-4bf1fff139db tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:06.980921 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2c80df9c-1c50-4ccc-98f2-4bf1fff139db tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:06.981906 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2c80df9c-1c50-4ccc-98f2-4bf1fff139db tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:06.985522 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2c80df9c-1c50-4ccc-98f2-4bf1fff139db tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:06.987238 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2c80df9c-1c50-4ccc-98f2-4bf1fff139db tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:07.299189 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-2c80df9c-1c50-4ccc-98f2-4bf1fff139db tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab2d64c1cb447f9bfd658408aa07e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ecc8c1389847c7bcd9cd5570d990e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:55:07.323113 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-2c80df9c-1c50-4ccc-98f2-4bf1fff139db tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] 10.222.0.60 "GET /compute/v2.1/servers/6ada18a6-f9cb-4bc9-800d-e0218adc4866" status: 200 len: 1266 microversion: 2.1 time: 0.372986 Sep 14 08:55:07.333371 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 808/1654] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:55:06 2022] GET /compute/v2.1/servers/6ada18a6-f9cb-4bc9-800d-e0218adc4866 => generated 1266 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:55:07.350493 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b858fc21-f26e-4a06-a55e-04cc5989098c tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:55:07.351151 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b858fc21-f26e-4a06-a55e-04cc5989098c tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] [instance: c9ccb0fe-b328-45f9-811f-a0ad6068875e] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:55:07.380700 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b858fc21-f26e-4a06-a55e-04cc5989098c tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:07.381210 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b858fc21-f26e-4a06-a55e-04cc5989098c tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:07.381649 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b858fc21-f26e-4a06-a55e-04cc5989098c tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:07.399637 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b858fc21-f26e-4a06-a55e-04cc5989098c tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:07.401096 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b858fc21-f26e-4a06-a55e-04cc5989098c tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:07.402290 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b858fc21-f26e-4a06-a55e-04cc5989098c tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:07.649731 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-98f97302-6bae-4f54-8952-17416067d61f tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:55:07.666318 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-98f97302-6bae-4f54-8952-17416067d61f tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/2098e0b9-b628-4b9e-979b-960c68830fee" status: 200 len: 1716 microversion: 2.1 time: 1.054047 Sep 14 08:55:07.667607 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 847/1655] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:55:06 2022] GET /compute/v2.1/servers/2098e0b9-b628-4b9e-979b-960c68830fee => generated 1716 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:55:08.355377 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-899ee07e-9d51-4074-a4de-28000482ca7f tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:55:08.356009 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-899ee07e-9d51-4074-a4de-28000482ca7f tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] [instance: 6ada18a6-f9cb-4bc9-800d-e0218adc4866] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:55:08.361666 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b858fc21-f26e-4a06-a55e-04cc5989098c tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4808b3a03f4bd8ad4af900bc926e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d8190fe7bb40beaea43a71808dc105', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:55:08.371258 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-899ee07e-9d51-4074-a4de-28000482ca7f tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:08.371760 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-899ee07e-9d51-4074-a4de-28000482ca7f tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:08.375398 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b858fc21-f26e-4a06-a55e-04cc5989098c tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] 10.222.0.60 "GET /compute/v2.1/servers/c9ccb0fe-b328-45f9-811f-a0ad6068875e" status: 200 len: 1503 microversion: 2.1 time: 1.040518 Sep 14 08:55:08.375738 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-899ee07e-9d51-4074-a4de-28000482ca7f tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:08.377284 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-899ee07e-9d51-4074-a4de-28000482ca7f tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:08.377420 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 809/1656] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:55:07 2022] GET /compute/v2.1/servers/c9ccb0fe-b328-45f9-811f-a0ad6068875e => generated 1503 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:55:08.383247 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-899ee07e-9d51-4074-a4de-28000482ca7f tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:08.383993 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-899ee07e-9d51-4074-a4de-28000482ca7f tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:08.696290 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-92cb1e75-899b-4ad1-9745-669e50fe8212 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:55:08.697295 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-92cb1e75-899b-4ad1-9745-669e50fe8212 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: 2098e0b9-b628-4b9e-979b-960c68830fee] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:55:08.705026 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:55:08.723917 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-92cb1e75-899b-4ad1-9745-669e50fe8212 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:08.724437 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-92cb1e75-899b-4ad1-9745-669e50fe8212 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:08.724887 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-92cb1e75-899b-4ad1-9745-669e50fe8212 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:08.725626 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-92cb1e75-899b-4ad1-9745-669e50fe8212 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:08.731606 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-92cb1e75-899b-4ad1-9745-669e50fe8212 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:08.732182 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-92cb1e75-899b-4ad1-9745-669e50fe8212 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:08.890497 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-899ee07e-9d51-4074-a4de-28000482ca7f tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab2d64c1cb447f9bfd658408aa07e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ecc8c1389847c7bcd9cd5570d990e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:55:08.898225 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:55:08.905226 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-899ee07e-9d51-4074-a4de-28000482ca7f tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] 10.222.0.60 "GET /compute/v2.1/servers/6ada18a6-f9cb-4bc9-800d-e0218adc4866" status: 200 len: 1272 microversion: 2.1 time: 0.554223 Sep 14 08:55:08.911767 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 848/1657] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:55:08 2022] GET /compute/v2.1/servers/6ada18a6-f9cb-4bc9-800d-e0218adc4866 => generated 1272 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:55:08.927467 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ac12df47-29a7-43dd-b079-ebe6486a027e tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:55:08.930199 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-ac12df47-29a7-43dd-b079-ebe6486a027e tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] [instance: a4474e04-7712-41de-bbf8-a872101a9808] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:55:08.957729 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ac12df47-29a7-43dd-b079-ebe6486a027e tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:08.960118 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ac12df47-29a7-43dd-b079-ebe6486a027e tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:08.962243 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ac12df47-29a7-43dd-b079-ebe6486a027e tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:08.963292 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ac12df47-29a7-43dd-b079-ebe6486a027e tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:08.969548 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ac12df47-29a7-43dd-b079-ebe6486a027e tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:08.972160 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ac12df47-29a7-43dd-b079-ebe6486a027e tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:10.662085 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-92cb1e75-899b-4ad1-9745-669e50fe8212 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:55:10.694098 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-92cb1e75-899b-4ad1-9745-669e50fe8212 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/2098e0b9-b628-4b9e-979b-960c68830fee" status: 200 len: 1716 microversion: 2.1 time: 2.003001 Sep 14 08:55:10.697591 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 810/1658] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:55:08 2022] GET /compute/v2.1/servers/2098e0b9-b628-4b9e-979b-960c68830fee => generated 1716 bytes in 2007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:55:10.707912 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-ace7b7b8-9871-4914-a8a1-dac48ff42b3b req-3dd4ca68-0fd5-46dd-a857-6436a42e76cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4474e04-7712-41de-bbf8-a872101a9808", "tag": "9329ba93-e005-46d9-9298-7b803f042b47"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:55:10.746307 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-ace7b7b8-9871-4914-a8a1-dac48ff42b3b req-3dd4ca68-0fd5-46dd-a857-6436a42e76cb service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:10.760971 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-ace7b7b8-9871-4914-a8a1-dac48ff42b3b req-3dd4ca68-0fd5-46dd-a857-6436a42e76cb service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:10.762368 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-ace7b7b8-9871-4914-a8a1-dac48ff42b3b req-3dd4ca68-0fd5-46dd-a857-6436a42e76cb service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:10.783821 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-ac12df47-29a7-43dd-b079-ebe6486a027e tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5040fc9212814c4fa9e038116578eebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a963df1b646f1918426fe1a7cb23c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:55:10.798596 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-ac12df47-29a7-43dd-b079-ebe6486a027e tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] 10.222.0.60 "GET /compute/v2.1/servers/a4474e04-7712-41de-bbf8-a872101a9808" status: 200 len: 1577 microversion: 2.1 time: 1.884456 Sep 14 08:55:10.806279 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 849/1659] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:55:08 2022] GET /compute/v2.1/servers/a4474e04-7712-41de-bbf8-a872101a9808 => generated 1577 bytes in 1892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:55:10.825237 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-8fed29e1-4d02-4ec0-b87e-ff18e596ee31 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:55:10.827059 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-ace7b7b8-9871-4914-a8a1-dac48ff42b3b req-3dd4ca68-0fd5-46dd-a857-6436a42e76cb service nova] Creating event network-changed:9329ba93-e005-46d9-9298-7b803f042b47 for instance a4474e04-7712-41de-bbf8-a872101a9808 on n-h2-836830-18 Sep 14 08:55:10.833308 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-8fed29e1-4d02-4ec0-b87e-ff18e596ee31 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] [instance: c9ccb0fe-b328-45f9-811f-a0ad6068875e] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:55:10.839164 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-ace7b7b8-9871-4914-a8a1-dac48ff42b3b req-3dd4ca68-0fd5-46dd-a857-6436a42e76cb service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137449 Sep 14 08:55:10.840089 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 811/1660] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:55:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:55:10.854158 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-39798c22-cc63-4fd3-a8cd-15f67be2cd6a tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:55:10.856176 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-39798c22-cc63-4fd3-a8cd-15f67be2cd6a tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] [instance: 6ada18a6-f9cb-4bc9-800d-e0218adc4866] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:55:10.862475 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8fed29e1-4d02-4ec0-b87e-ff18e596ee31 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:10.863861 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8fed29e1-4d02-4ec0-b87e-ff18e596ee31 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:10.864471 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8fed29e1-4d02-4ec0-b87e-ff18e596ee31 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:10.872962 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8fed29e1-4d02-4ec0-b87e-ff18e596ee31 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:10.873189 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8fed29e1-4d02-4ec0-b87e-ff18e596ee31 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:10.873645 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8fed29e1-4d02-4ec0-b87e-ff18e596ee31 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:10.878345 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-39798c22-cc63-4fd3-a8cd-15f67be2cd6a tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:10.881709 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-39798c22-cc63-4fd3-a8cd-15f67be2cd6a tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:10.882395 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-39798c22-cc63-4fd3-a8cd-15f67be2cd6a tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:10.883765 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-39798c22-cc63-4fd3-a8cd-15f67be2cd6a tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:10.885590 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-39798c22-cc63-4fd3-a8cd-15f67be2cd6a tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:10.888427 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-39798c22-cc63-4fd3-a8cd-15f67be2cd6a tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:11.149034 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-39798c22-cc63-4fd3-a8cd-15f67be2cd6a tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab2d64c1cb447f9bfd658408aa07e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ecc8c1389847c7bcd9cd5570d990e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:55:11.159700 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-39798c22-cc63-4fd3-a8cd-15f67be2cd6a tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] 10.222.0.60 "GET /compute/v2.1/servers/6ada18a6-f9cb-4bc9-800d-e0218adc4866" status: 200 len: 1272 microversion: 2.1 time: 0.315843 Sep 14 08:55:11.164098 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 812/1661] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:55:10 2022] GET /compute/v2.1/servers/6ada18a6-f9cb-4bc9-800d-e0218adc4866 => generated 1272 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:55:11.640269 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-8fed29e1-4d02-4ec0-b87e-ff18e596ee31 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4808b3a03f4bd8ad4af900bc926e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d8190fe7bb40beaea43a71808dc105', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:55:11.660398 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-8fed29e1-4d02-4ec0-b87e-ff18e596ee31 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] 10.222.0.60 "GET /compute/v2.1/servers/c9ccb0fe-b328-45f9-811f-a0ad6068875e" status: 200 len: 1503 microversion: 2.1 time: 0.852607 Sep 14 08:55:11.663170 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 850/1662] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:55:10 2022] GET /compute/v2.1/servers/c9ccb0fe-b328-45f9-811f-a0ad6068875e => generated 1503 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:55:11.722896 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-33b3049e-1370-4bd0-8a3c-e94a21ca098f tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:55:11.724414 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-33b3049e-1370-4bd0-8a3c-e94a21ca098f tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: 2098e0b9-b628-4b9e-979b-960c68830fee] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:55:11.749867 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-33b3049e-1370-4bd0-8a3c-e94a21ca098f tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:11.752521 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-33b3049e-1370-4bd0-8a3c-e94a21ca098f tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:11.753494 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-33b3049e-1370-4bd0-8a3c-e94a21ca098f tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:11.754567 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-33b3049e-1370-4bd0-8a3c-e94a21ca098f tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:11.758235 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-33b3049e-1370-4bd0-8a3c-e94a21ca098f tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:11.760524 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-33b3049e-1370-4bd0-8a3c-e94a21ca098f tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:11.775948 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=100 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:55:12.196880 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-37617039-bbec-4a8c-9acd-628d6bdc21af tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:55:12.197751 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-37617039-bbec-4a8c-9acd-628d6bdc21af tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] [instance: 6ada18a6-f9cb-4bc9-800d-e0218adc4866] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:55:12.217448 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-37617039-bbec-4a8c-9acd-628d6bdc21af tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:12.218223 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-37617039-bbec-4a8c-9acd-628d6bdc21af tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:12.219138 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-37617039-bbec-4a8c-9acd-628d6bdc21af tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:12.220659 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-37617039-bbec-4a8c-9acd-628d6bdc21af tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:12.227707 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-37617039-bbec-4a8c-9acd-628d6bdc21af tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:12.229528 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-37617039-bbec-4a8c-9acd-628d6bdc21af tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:12.424783 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-37617039-bbec-4a8c-9acd-628d6bdc21af tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab2d64c1cb447f9bfd658408aa07e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ecc8c1389847c7bcd9cd5570d990e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:55:12.433573 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-37617039-bbec-4a8c-9acd-628d6bdc21af tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] 10.222.0.60 "GET /compute/v2.1/servers/6ada18a6-f9cb-4bc9-800d-e0218adc4866" status: 200 len: 1272 microversion: 2.1 time: 0.241575 Sep 14 08:55:12.454098 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 851/1663] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:55:12 2022] GET /compute/v2.1/servers/6ada18a6-f9cb-4bc9-800d-e0218adc4866 => generated 1272 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:55:12.587929 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-33b3049e-1370-4bd0-8a3c-e94a21ca098f tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:55:12.602623 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-33b3049e-1370-4bd0-8a3c-e94a21ca098f tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/2098e0b9-b628-4b9e-979b-960c68830fee" status: 200 len: 1716 microversion: 2.1 time: 0.884429 Sep 14 08:55:12.604346 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 813/1664] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:55:11 2022] GET /compute/v2.1/servers/2098e0b9-b628-4b9e-979b-960c68830fee => generated 1716 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:55:12.645031 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-aa534204-d443-4e8f-9868-eafe5f5d6f09 req-e08fc5ae-8899-4a4a-a4ae-c8972cc71b9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9ccb0fe-b328-45f9-811f-a0ad6068875e", "name": "network-vif-deleted", "tag": "be79e1ef-4da1-405c-a53b-2091542beac5"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:55:12.668023 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-aa534204-d443-4e8f-9868-eafe5f5d6f09 req-e08fc5ae-8899-4a4a-a4ae-c8972cc71b9b service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:12.668510 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-aa534204-d443-4e8f-9868-eafe5f5d6f09 req-e08fc5ae-8899-4a4a-a4ae-c8972cc71b9b service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:12.668952 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-aa534204-d443-4e8f-9868-eafe5f5d6f09 req-e08fc5ae-8899-4a4a-a4ae-c8972cc71b9b service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:12.689701 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-73b86a33-be34-4de0-9bdc-7bcf9f3ae471 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:55:12.690334 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-73b86a33-be34-4de0-9bdc-7bcf9f3ae471 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] [instance: c9ccb0fe-b328-45f9-811f-a0ad6068875e] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:55:12.710182 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-73b86a33-be34-4de0-9bdc-7bcf9f3ae471 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:12.710702 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-73b86a33-be34-4de0-9bdc-7bcf9f3ae471 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:12.711179 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-73b86a33-be34-4de0-9bdc-7bcf9f3ae471 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:12.712327 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-73b86a33-be34-4de0-9bdc-7bcf9f3ae471 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:12.712327 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-73b86a33-be34-4de0-9bdc-7bcf9f3ae471 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:12.712729 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-73b86a33-be34-4de0-9bdc-7bcf9f3ae471 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:12.740339 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-aa534204-d443-4e8f-9868-eafe5f5d6f09 req-e08fc5ae-8899-4a4a-a4ae-c8972cc71b9b service nova] Creating event network-vif-deleted:be79e1ef-4da1-405c-a53b-2091542beac5 for instance c9ccb0fe-b328-45f9-811f-a0ad6068875e on n-h1-836830-18 Sep 14 08:55:12.763296 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-aa534204-d443-4e8f-9868-eafe5f5d6f09 req-e08fc5ae-8899-4a4a-a4ae-c8972cc71b9b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122293 Sep 14 08:55:12.767399 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 852/1665] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:55:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:55:12.883296 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-73b86a33-be34-4de0-9bdc-7bcf9f3ae471 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4808b3a03f4bd8ad4af900bc926e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d8190fe7bb40beaea43a71808dc105', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:55:12.893228 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-73b86a33-be34-4de0-9bdc-7bcf9f3ae471 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] 10.222.0.60 "GET /compute/v2.1/servers/c9ccb0fe-b328-45f9-811f-a0ad6068875e" status: 200 len: 1297 microversion: 2.1 time: 0.207391 Sep 14 08:55:12.897045 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 814/1666] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:55:12 2022] GET /compute/v2.1/servers/c9ccb0fe-b328-45f9-811f-a0ad6068875e => generated 1297 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:55:13.462138 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c2194576-cf01-45b5-a21c-d0c8f3ab1468 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:55:13.463794 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-c2194576-cf01-45b5-a21c-d0c8f3ab1468 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] [instance: 6ada18a6-f9cb-4bc9-800d-e0218adc4866] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:55:13.475174 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c2194576-cf01-45b5-a21c-d0c8f3ab1468 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:13.487785 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c2194576-cf01-45b5-a21c-d0c8f3ab1468 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:13.488540 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c2194576-cf01-45b5-a21c-d0c8f3ab1468 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:13.489514 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c2194576-cf01-45b5-a21c-d0c8f3ab1468 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:13.490648 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c2194576-cf01-45b5-a21c-d0c8f3ab1468 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:13.493320 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c2194576-cf01-45b5-a21c-d0c8f3ab1468 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:13.626972 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-715421b4-40fa-45b7-9184-ce914969aa1c tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:55:13.628803 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-715421b4-40fa-45b7-9184-ce914969aa1c tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: 2098e0b9-b628-4b9e-979b-960c68830fee] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:55:13.636665 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-715421b4-40fa-45b7-9184-ce914969aa1c tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:13.637137 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-715421b4-40fa-45b7-9184-ce914969aa1c tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:13.637582 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-715421b4-40fa-45b7-9184-ce914969aa1c tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:13.638277 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-715421b4-40fa-45b7-9184-ce914969aa1c tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:13.638732 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-715421b4-40fa-45b7-9184-ce914969aa1c tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:13.665601 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-715421b4-40fa-45b7-9184-ce914969aa1c tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:13.719362 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-c2194576-cf01-45b5-a21c-d0c8f3ab1468 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab2d64c1cb447f9bfd658408aa07e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ecc8c1389847c7bcd9cd5570d990e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:55:13.728368 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-c2194576-cf01-45b5-a21c-d0c8f3ab1468 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] 10.222.0.60 "GET /compute/v2.1/servers/6ada18a6-f9cb-4bc9-800d-e0218adc4866" status: 200 len: 1272 microversion: 2.1 time: 0.270602 Sep 14 08:55:13.757278 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 853/1667] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:55:13 2022] GET /compute/v2.1/servers/6ada18a6-f9cb-4bc9-800d-e0218adc4866 => generated 1272 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:55:13.820349 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=17 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:55:13.867804 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=15 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:55:13.923921 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b76ac8b5-51a8-4a0a-ab74-ae90b0af3795 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:55:13.924821 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-b76ac8b5-51a8-4a0a-ab74-ae90b0af3795 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] [instance: c9ccb0fe-b328-45f9-811f-a0ad6068875e] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:55:13.938242 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b76ac8b5-51a8-4a0a-ab74-ae90b0af3795 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:13.939135 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b76ac8b5-51a8-4a0a-ab74-ae90b0af3795 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:13.942064 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b76ac8b5-51a8-4a0a-ab74-ae90b0af3795 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:13.945382 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b76ac8b5-51a8-4a0a-ab74-ae90b0af3795 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:13.947482 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b76ac8b5-51a8-4a0a-ab74-ae90b0af3795 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:13.949055 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b76ac8b5-51a8-4a0a-ab74-ae90b0af3795 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:14.018845 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-b76ac8b5-51a8-4a0a-ab74-ae90b0af3795 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] HTTP exception thrown: Instance c9ccb0fe-b328-45f9-811f-a0ad6068875e could not be found. Sep 14 08:55:14.020621 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b76ac8b5-51a8-4a0a-ab74-ae90b0af3795 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Request method failure captured: Sep 14 08:55:14.020621 n-d-836830-18 devstack@n-api.service[128758]: request: GET /compute/v2.1/servers/c9ccb0fe-b328-45f9-811f-a0ad6068875e HTTP/1.1 Sep 14 08:55:14.020621 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 08:55:14.020621 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 08:55:14.020621 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 08:55:14.020621 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 08:55:14.020621 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 08:55:14.020621 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 08:55:14.020621 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 08:55:14.020621 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 08:55:14.020621 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZbFgQns31B4K1Gb363cGXduQLgokw6WfaeT1YVN-c6H3wPCgmBhIJn4L9XWgu7v_8L4sII1J1dPBcOoi0yt1FKhCjoCD8EeMVjP4r5Cnu2pxAissXsejCLG7rKpPmNfdTELvv_bS2NkyNk2Oj-DapSFV5uCPegvUaO_HQ3X_72oJVU Sep 14 08:55:14.020621 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 08:55:14.020621 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 08:55:14.020621 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 08:55:14.020621 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 08:55:14.020621 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 08:55:14.020621 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 08:55:14.020621 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 92d8190fe7bb40beaea43a71808dc105 Sep 14 08:55:14.020621 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-ServerGroupTestJSON-928665897 Sep 14 08:55:14.020621 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 08:55:14.020621 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 08:55:14.020621 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/92d8190fe7bb40beaea43a71808dc105"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_92d8190fe7bb40beaea43a71808dc105"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/92d8190fe7bb40beaea43a71808dc105"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/92d8190fe7bb40beaea43a71808dc105"}]}] Sep 14 08:55:14.020621 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-ServerGroupTestJSON-928665897 Sep 14 08:55:14.020621 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 92d8190fe7bb40beaea43a71808dc105 Sep 14 08:55:14.020621 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-ServerGroupTestJSON-928665897 Sep 14 08:55:14.020621 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-ServerGroupTestJSON-928665897-project Sep 14 08:55:14.020621 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 08:55:14.020621 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 08:55:14.020621 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: ba4808b3a03f4bd8ad4af900bc926e77 Sep 14 08:55:14.020621 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-ServerGroupTestJSON-928665897-project Sep 14 08:55:14.020621 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 08:55:14.020621 n-d-836830-18 devstack@n-api.service[128758]: exception: Instance c9ccb0fe-b328-45f9-811f-a0ad6068875e could not be found. Sep 14 08:55:14.020621 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': 'c9ccb0fe-b328-45f9-811f-a0ad6068875e'} Sep 14 08:55:14.020621 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:55:14.020621 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:55:14.020621 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 08:55:14.020621 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 08:55:14.020621 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 08:55:14.020621 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 08:55:14.020621 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 08:55:14.020621 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 08:55:14.020621 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 08:55:14.020621 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 08:55:14.020621 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9ccb0fe-b328-45f9-811f-a0ad6068875e could not be found. Sep 14 08:55:14.020621 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:55:14.020621 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:55:14.020621 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:55:14.020621 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:55:14.020621 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:55:14.020621 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:55:14.020621 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:55:14.020621 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:55:14.020621 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:55:14.020621 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:55:14.020621 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 08:55:14.020621 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 08:55:14.020621 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 08:55:14.020621 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 08:55:14.020621 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 08:55:14.020621 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 08:55:14.020621 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9ccb0fe-b328-45f9-811f-a0ad6068875e could not be found. Sep 14 08:55:14.020621 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:55:14.020621 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:55:14.020621 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:55:14.025947 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:55:14.025947 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:55:14.025947 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:55:14.025947 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:55:14.025947 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:55:14.025947 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9ccb0fe-b328-45f9-811f-a0ad6068875e could not be found. Sep 14 08:55:14.025947 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:55:14.034247 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b76ac8b5-51a8-4a0a-ab74-ae90b0af3795 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Returning 404 to user: Instance c9ccb0fe-b328-45f9-811f-a0ad6068875e could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:55:14.037915 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-b76ac8b5-51a8-4a0a-ab74-ae90b0af3795 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] 10.222.0.60 "GET /compute/v2.1/servers/c9ccb0fe-b328-45f9-811f-a0ad6068875e" status: 404 len: 111 microversion: 2.1 time: 0.118852 Sep 14 08:55:14.056967 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 854/1668] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:55:13 2022] GET /compute/v2.1/servers/c9ccb0fe-b328-45f9-811f-a0ad6068875e => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 14 08:55:14.069538 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-efc9dedd-9ed5-405a-89ff-ec4a0293e80b tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:55:14.138677 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.compute.server_groups [None req-efc9dedd-9ed5-405a-89ff-ec4a0293e80b tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Querying cell 0a35f87f-19b7-4b11-98e6-8bcd07b0466f(cell1) for 1 instances {{(pid=128758) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Sep 14 08:55:14.144062 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-efc9dedd-9ed5-405a-89ff-ec4a0293e80b tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:14.144798 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-efc9dedd-9ed5-405a-89ff-ec4a0293e80b tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:14.145426 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-efc9dedd-9ed5-405a-89ff-ec4a0293e80b tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:14.170031 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-efc9dedd-9ed5-405a-89ff-ec4a0293e80b tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] 10.222.0.60 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.110451 Sep 14 08:55:14.198312 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 855/1669] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Sep 14 08:55:14 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:55:14.206994 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d52ee7ee-dacd-466e-a288-08f3aed98d4b tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:55:14.269364 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.compute.server_groups [None req-d52ee7ee-dacd-466e-a288-08f3aed98d4b tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Querying cell 0a35f87f-19b7-4b11-98e6-8bcd07b0466f(cell1) for 1 instances {{(pid=128758) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Sep 14 08:55:14.270844 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-715421b4-40fa-45b7-9184-ce914969aa1c tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:55:14.271515 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d52ee7ee-dacd-466e-a288-08f3aed98d4b tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:14.273151 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d52ee7ee-dacd-466e-a288-08f3aed98d4b tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:14.273596 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d52ee7ee-dacd-466e-a288-08f3aed98d4b tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:14.290740 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-715421b4-40fa-45b7-9184-ce914969aa1c tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/2098e0b9-b628-4b9e-979b-960c68830fee" status: 200 len: 1716 microversion: 2.1 time: 0.668247 Sep 14 08:55:14.291683 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 815/1670] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:55:13 2022] GET /compute/v2.1/servers/2098e0b9-b628-4b9e-979b-960c68830fee => generated 1716 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:55:14.314870 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-d52ee7ee-dacd-466e-a288-08f3aed98d4b tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] 10.222.0.60 "GET /compute/v2.1/os-server-groups/ab23666b-035e-4c9f-88a6-d3e41c2eebf9" status: 200 len: 184 microversion: 2.1 time: 0.115275 Sep 14 08:55:14.315489 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 856/1671] 10.222.0.60 () {58 vars in 1263 bytes} [Wed Sep 14 08:55:14 2022] GET /compute/v2.1/os-server-groups/ab23666b-035e-4c9f-88a6-d3e41c2eebf9 => generated 184 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:55:14.327570 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9e2dcde3-bebe-4175-933f-fa189296b878 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:55:14.328285 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-9e2dcde3-bebe-4175-933f-fa189296b878 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] [instance: c9ccb0fe-b328-45f9-811f-a0ad6068875e] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:55:14.356343 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9e2dcde3-bebe-4175-933f-fa189296b878 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:14.356852 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9e2dcde3-bebe-4175-933f-fa189296b878 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:14.357301 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9e2dcde3-bebe-4175-933f-fa189296b878 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:14.358026 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9e2dcde3-bebe-4175-933f-fa189296b878 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:14.358499 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9e2dcde3-bebe-4175-933f-fa189296b878 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:14.358910 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9e2dcde3-bebe-4175-933f-fa189296b878 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:14.388680 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-9e2dcde3-bebe-4175-933f-fa189296b878 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] HTTP exception thrown: Instance c9ccb0fe-b328-45f9-811f-a0ad6068875e could not be found. Sep 14 08:55:14.390707 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9e2dcde3-bebe-4175-933f-fa189296b878 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Request method failure captured: Sep 14 08:55:14.390707 n-d-836830-18 devstack@n-api.service[128759]: request: DELETE /compute/v2.1/servers/c9ccb0fe-b328-45f9-811f-a0ad6068875e HTTP/1.1 Sep 14 08:55:14.390707 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 08:55:14.390707 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 08:55:14.390707 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 08:55:14.390707 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 08:55:14.390707 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 08:55:14.390707 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 08:55:14.390707 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 08:55:14.390707 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 08:55:14.390707 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZbFgQns31B4K1Gb363cGXduQLgokw6WfaeT1YVN-c6H3wPCgmBhIJn4L9XWgu7v_8L4sII1J1dPBcOoi0yt1FKhCjoCD8EeMVjP4r5Cnu2pxAissXsejCLG7rKpPmNfdTELvv_bS2NkyNk2Oj-DapSFV5uCPegvUaO_HQ3X_72oJVU Sep 14 08:55:14.390707 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 08:55:14.390707 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 08:55:14.390707 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 08:55:14.390707 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 08:55:14.390707 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 08:55:14.390707 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 08:55:14.390707 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 92d8190fe7bb40beaea43a71808dc105 Sep 14 08:55:14.390707 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ServerGroupTestJSON-928665897 Sep 14 08:55:14.390707 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 08:55:14.390707 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 08:55:14.390707 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/92d8190fe7bb40beaea43a71808dc105"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_92d8190fe7bb40beaea43a71808dc105"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/92d8190fe7bb40beaea43a71808dc105"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/92d8190fe7bb40beaea43a71808dc105"}]}] Sep 14 08:55:14.390707 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ServerGroupTestJSON-928665897 Sep 14 08:55:14.390707 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 92d8190fe7bb40beaea43a71808dc105 Sep 14 08:55:14.390707 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ServerGroupTestJSON-928665897 Sep 14 08:55:14.390707 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ServerGroupTestJSON-928665897-project Sep 14 08:55:14.390707 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 08:55:14.390707 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 08:55:14.390707 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: ba4808b3a03f4bd8ad4af900bc926e77 Sep 14 08:55:14.390707 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ServerGroupTestJSON-928665897-project Sep 14 08:55:14.390707 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 08:55:14.390707 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance c9ccb0fe-b328-45f9-811f-a0ad6068875e could not be found. Sep 14 08:55:14.390707 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': 'c9ccb0fe-b328-45f9-811f-a0ad6068875e'} Sep 14 08:55:14.390707 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:55:14.390707 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:55:14.390707 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 08:55:14.390707 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 08:55:14.390707 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 08:55:14.390707 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 08:55:14.390707 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 08:55:14.390707 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 08:55:14.390707 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 08:55:14.390707 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 08:55:14.390707 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9ccb0fe-b328-45f9-811f-a0ad6068875e could not be found. Sep 14 08:55:14.390707 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:55:14.390707 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:55:14.390707 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:55:14.390707 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:55:14.390707 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:55:14.390707 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:55:14.390707 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:55:14.390707 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:55:14.390707 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:55:14.390707 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:55:14.390707 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 08:55:14.390707 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 08:55:14.390707 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 08:55:14.390707 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 08:55:14.390707 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 08:55:14.390707 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 08:55:14.390707 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 08:55:14.390707 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 08:55:14.397320 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9ccb0fe-b328-45f9-811f-a0ad6068875e could not be found. Sep 14 08:55:14.397320 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:55:14.397320 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:55:14.397320 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:55:14.397320 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:55:14.397320 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:55:14.397320 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:55:14.397320 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:55:14.397320 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:55:14.397320 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9ccb0fe-b328-45f9-811f-a0ad6068875e could not be found. Sep 14 08:55:14.397320 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:55:14.400767 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9e2dcde3-bebe-4175-933f-fa189296b878 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Returning 404 to user: Instance c9ccb0fe-b328-45f9-811f-a0ad6068875e could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:55:14.402683 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-9e2dcde3-bebe-4175-933f-fa189296b878 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] 10.222.0.60 "DELETE /compute/v2.1/servers/c9ccb0fe-b328-45f9-811f-a0ad6068875e" status: 404 len: 111 microversion: 2.1 time: 0.079375 Sep 14 08:55:14.411775 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 816/1672] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 08:55:14 2022] DELETE /compute/v2.1/servers/c9ccb0fe-b328-45f9-811f-a0ad6068875e => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 08:55:14.420326 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-8d781512-e406-43bb-975f-79f4b3bf2826 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:55:14.421312 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-8d781512-e406-43bb-975f-79f4b3bf2826 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] [instance: c9ccb0fe-b328-45f9-811f-a0ad6068875e] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:55:14.427500 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=2 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:55:14.439523 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8d781512-e406-43bb-975f-79f4b3bf2826 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:14.443688 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8d781512-e406-43bb-975f-79f4b3bf2826 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:14.444476 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8d781512-e406-43bb-975f-79f4b3bf2826 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:14.448094 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8d781512-e406-43bb-975f-79f4b3bf2826 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:14.448943 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8d781512-e406-43bb-975f-79f4b3bf2826 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:14.449623 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8d781512-e406-43bb-975f-79f4b3bf2826 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:14.493154 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-8d781512-e406-43bb-975f-79f4b3bf2826 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] HTTP exception thrown: Instance c9ccb0fe-b328-45f9-811f-a0ad6068875e could not be found. Sep 14 08:55:14.502762 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-8d781512-e406-43bb-975f-79f4b3bf2826 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Request method failure captured: Sep 14 08:55:14.502762 n-d-836830-18 devstack@n-api.service[128758]: request: GET /compute/v2.1/servers/c9ccb0fe-b328-45f9-811f-a0ad6068875e HTTP/1.1 Sep 14 08:55:14.502762 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 08:55:14.502762 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 08:55:14.502762 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 08:55:14.502762 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 08:55:14.502762 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 08:55:14.502762 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 08:55:14.502762 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 08:55:14.502762 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 08:55:14.502762 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZbFgQns31B4K1Gb363cGXduQLgokw6WfaeT1YVN-c6H3wPCgmBhIJn4L9XWgu7v_8L4sII1J1dPBcOoi0yt1FKhCjoCD8EeMVjP4r5Cnu2pxAissXsejCLG7rKpPmNfdTELvv_bS2NkyNk2Oj-DapSFV5uCPegvUaO_HQ3X_72oJVU Sep 14 08:55:14.502762 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 08:55:14.502762 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 08:55:14.502762 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 08:55:14.502762 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 08:55:14.502762 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 08:55:14.502762 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 08:55:14.502762 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 92d8190fe7bb40beaea43a71808dc105 Sep 14 08:55:14.502762 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-ServerGroupTestJSON-928665897 Sep 14 08:55:14.502762 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 08:55:14.502762 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 08:55:14.502762 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/92d8190fe7bb40beaea43a71808dc105"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_92d8190fe7bb40beaea43a71808dc105"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/92d8190fe7bb40beaea43a71808dc105"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/92d8190fe7bb40beaea43a71808dc105"}]}] Sep 14 08:55:14.502762 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-ServerGroupTestJSON-928665897 Sep 14 08:55:14.502762 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 92d8190fe7bb40beaea43a71808dc105 Sep 14 08:55:14.502762 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-ServerGroupTestJSON-928665897 Sep 14 08:55:14.502762 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-ServerGroupTestJSON-928665897-project Sep 14 08:55:14.502762 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 08:55:14.502762 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 08:55:14.502762 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: ba4808b3a03f4bd8ad4af900bc926e77 Sep 14 08:55:14.502762 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-ServerGroupTestJSON-928665897-project Sep 14 08:55:14.502762 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 08:55:14.502762 n-d-836830-18 devstack@n-api.service[128758]: exception: Instance c9ccb0fe-b328-45f9-811f-a0ad6068875e could not be found. Sep 14 08:55:14.502762 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': 'c9ccb0fe-b328-45f9-811f-a0ad6068875e'} Sep 14 08:55:14.502762 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:55:14.502762 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:55:14.502762 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 08:55:14.502762 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 08:55:14.502762 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 08:55:14.502762 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 08:55:14.502762 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 08:55:14.502762 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 08:55:14.502762 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 08:55:14.502762 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 08:55:14.502762 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9ccb0fe-b328-45f9-811f-a0ad6068875e could not be found. Sep 14 08:55:14.502762 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:55:14.502762 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:55:14.502762 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:55:14.502762 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:55:14.502762 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:55:14.502762 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:55:14.502762 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:55:14.502762 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:55:14.502762 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:55:14.502762 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:55:14.502762 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 08:55:14.502762 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 08:55:14.502762 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 08:55:14.502762 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 08:55:14.502762 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 08:55:14.502762 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 08:55:14.502762 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9ccb0fe-b328-45f9-811f-a0ad6068875e could not be found. Sep 14 08:55:14.502762 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:55:14.502762 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:55:14.502762 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:55:14.509405 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:55:14.509405 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:55:14.509405 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:55:14.509405 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:55:14.509405 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:55:14.509405 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9ccb0fe-b328-45f9-811f-a0ad6068875e could not be found. Sep 14 08:55:14.509405 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:55:14.515900 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-8d781512-e406-43bb-975f-79f4b3bf2826 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Returning 404 to user: Instance c9ccb0fe-b328-45f9-811f-a0ad6068875e could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:55:14.518251 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-8d781512-e406-43bb-975f-79f4b3bf2826 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] 10.222.0.60 "GET /compute/v2.1/servers/c9ccb0fe-b328-45f9-811f-a0ad6068875e" status: 404 len: 111 microversion: 2.1 time: 0.101862 Sep 14 08:55:14.529252 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 857/1673] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:55:14 2022] GET /compute/v2.1/servers/c9ccb0fe-b328-45f9-811f-a0ad6068875e => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 08:55:14.538608 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-6a5dfef3-6cfe-43c4-9f59-1b6ea62fa72a tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:55:14.557478 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-6a5dfef3-6cfe-43c4-9f59-1b6ea62fa72a tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] HTTP exception thrown: Instance group c938e012-4c73-4f59-94c5-1ddb754943e7 could not be found. Sep 14 08:55:14.586929 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-6a5dfef3-6cfe-43c4-9f59-1b6ea62fa72a tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Request method failure captured: Sep 14 08:55:14.586929 n-d-836830-18 devstack@n-api.service[128759]: request: DELETE /compute/v2.1/os-server-groups/c938e012-4c73-4f59-94c5-1ddb754943e7 HTTP/1.1 Sep 14 08:55:14.586929 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 08:55:14.586929 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 08:55:14.586929 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 08:55:14.586929 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 08:55:14.586929 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 08:55:14.586929 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 08:55:14.586929 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 08:55:14.586929 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 08:55:14.586929 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZbFgQns31B4K1Gb363cGXduQLgokw6WfaeT1YVN-c6H3wPCgmBhIJn4L9XWgu7v_8L4sII1J1dPBcOoi0yt1FKhCjoCD8EeMVjP4r5Cnu2pxAissXsejCLG7rKpPmNfdTELvv_bS2NkyNk2Oj-DapSFV5uCPegvUaO_HQ3X_72oJVU Sep 14 08:55:14.586929 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 08:55:14.586929 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 08:55:14.586929 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 08:55:14.586929 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 08:55:14.586929 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 08:55:14.586929 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 08:55:14.586929 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 92d8190fe7bb40beaea43a71808dc105 Sep 14 08:55:14.586929 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ServerGroupTestJSON-928665897 Sep 14 08:55:14.586929 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 08:55:14.586929 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 08:55:14.586929 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/92d8190fe7bb40beaea43a71808dc105"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_92d8190fe7bb40beaea43a71808dc105"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/92d8190fe7bb40beaea43a71808dc105"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/92d8190fe7bb40beaea43a71808dc105"}]}] Sep 14 08:55:14.586929 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ServerGroupTestJSON-928665897 Sep 14 08:55:14.586929 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 92d8190fe7bb40beaea43a71808dc105 Sep 14 08:55:14.586929 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ServerGroupTestJSON-928665897 Sep 14 08:55:14.586929 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ServerGroupTestJSON-928665897-project Sep 14 08:55:14.586929 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 08:55:14.586929 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 08:55:14.586929 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: ba4808b3a03f4bd8ad4af900bc926e77 Sep 14 08:55:14.586929 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ServerGroupTestJSON-928665897-project Sep 14 08:55:14.586929 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 08:55:14.586929 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance group c938e012-4c73-4f59-94c5-1ddb754943e7 could not be found. Sep 14 08:55:14.586929 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': 'c938e012-4c73-4f59-94c5-1ddb754943e7'} Sep 14 08:55:14.586929 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:55:14.586929 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:55:14.586929 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Sep 14 08:55:14.586929 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Sep 14 08:55:14.586929 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 14 08:55:14.586929 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 14 08:55:14.586929 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Sep 14 08:55:14.586929 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Sep 14 08:55:14.586929 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 14 08:55:14.586929 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 14 08:55:14.586929 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Sep 14 08:55:14.586929 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Sep 14 08:55:14.586929 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group c938e012-4c73-4f59-94c5-1ddb754943e7 could not be found. Sep 14 08:55:14.586929 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:55:14.586929 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:55:14.586929 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:55:14.586929 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:55:14.586929 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:55:14.586929 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:55:14.586929 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:55:14.586929 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:55:14.586929 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:55:14.586929 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:55:14.586929 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Sep 14 08:55:14.586929 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 14 08:55:14.586929 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group c938e012-4c73-4f59-94c5-1ddb754943e7 could not be found. Sep 14 08:55:14.586929 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:55:14.586929 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:55:14.586929 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:55:14.586929 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:55:14.591576 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:55:14.591576 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:55:14.591576 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:55:14.591576 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:55:14.591576 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group c938e012-4c73-4f59-94c5-1ddb754943e7 could not be found. Sep 14 08:55:14.591576 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:55:14.591576 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-6a5dfef3-6cfe-43c4-9f59-1b6ea62fa72a tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Returning 404 to user: Instance group c938e012-4c73-4f59-94c5-1ddb754943e7 could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:55:14.591576 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-6a5dfef3-6cfe-43c4-9f59-1b6ea62fa72a tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] 10.222.0.60 "DELETE /compute/v2.1/os-server-groups/c938e012-4c73-4f59-94c5-1ddb754943e7" status: 404 len: 117 microversion: 2.1 time: 0.054923 Sep 14 08:55:14.591576 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 817/1674] 10.222.0.60 () {58 vars in 1266 bytes} [Wed Sep 14 08:55:14 2022] DELETE /compute/v2.1/os-server-groups/c938e012-4c73-4f59-94c5-1ddb754943e7 => generated 117 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 08:55:14.600310 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-9debf5a0-7685-4574-819e-f5e665ff57e2 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:55:14.609954 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-9debf5a0-7685-4574-819e-f5e665ff57e2 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] HTTP exception thrown: Instance group 19e0a0f8-6176-405f-b85d-31819295e96a could not be found. Sep 14 08:55:14.614583 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-9debf5a0-7685-4574-819e-f5e665ff57e2 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Request method failure captured: Sep 14 08:55:14.614583 n-d-836830-18 devstack@n-api.service[128758]: request: DELETE /compute/v2.1/os-server-groups/19e0a0f8-6176-405f-b85d-31819295e96a HTTP/1.1 Sep 14 08:55:14.614583 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 08:55:14.614583 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 08:55:14.614583 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 08:55:14.614583 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 08:55:14.614583 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 08:55:14.614583 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 08:55:14.614583 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 08:55:14.614583 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 08:55:14.614583 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZbFgQns31B4K1Gb363cGXduQLgokw6WfaeT1YVN-c6H3wPCgmBhIJn4L9XWgu7v_8L4sII1J1dPBcOoi0yt1FKhCjoCD8EeMVjP4r5Cnu2pxAissXsejCLG7rKpPmNfdTELvv_bS2NkyNk2Oj-DapSFV5uCPegvUaO_HQ3X_72oJVU Sep 14 08:55:14.614583 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 08:55:14.614583 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 08:55:14.614583 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 08:55:14.614583 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 08:55:14.614583 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 08:55:14.614583 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 08:55:14.614583 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 92d8190fe7bb40beaea43a71808dc105 Sep 14 08:55:14.614583 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-ServerGroupTestJSON-928665897 Sep 14 08:55:14.614583 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 08:55:14.614583 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 08:55:14.614583 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/92d8190fe7bb40beaea43a71808dc105"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_92d8190fe7bb40beaea43a71808dc105"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/92d8190fe7bb40beaea43a71808dc105"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/92d8190fe7bb40beaea43a71808dc105"}]}] Sep 14 08:55:14.614583 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-ServerGroupTestJSON-928665897 Sep 14 08:55:14.614583 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 92d8190fe7bb40beaea43a71808dc105 Sep 14 08:55:14.614583 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-ServerGroupTestJSON-928665897 Sep 14 08:55:14.614583 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-ServerGroupTestJSON-928665897-project Sep 14 08:55:14.614583 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 08:55:14.614583 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 08:55:14.614583 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: ba4808b3a03f4bd8ad4af900bc926e77 Sep 14 08:55:14.614583 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-ServerGroupTestJSON-928665897-project Sep 14 08:55:14.614583 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 08:55:14.614583 n-d-836830-18 devstack@n-api.service[128758]: exception: Instance group 19e0a0f8-6176-405f-b85d-31819295e96a could not be found. Sep 14 08:55:14.614583 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': '19e0a0f8-6176-405f-b85d-31819295e96a'} Sep 14 08:55:14.614583 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:55:14.614583 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:55:14.614583 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Sep 14 08:55:14.614583 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Sep 14 08:55:14.614583 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 14 08:55:14.614583 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 14 08:55:14.614583 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Sep 14 08:55:14.614583 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Sep 14 08:55:14.614583 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 14 08:55:14.614583 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 14 08:55:14.614583 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Sep 14 08:55:14.614583 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Sep 14 08:55:14.614583 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 19e0a0f8-6176-405f-b85d-31819295e96a could not be found. Sep 14 08:55:14.614583 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:55:14.614583 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:55:14.614583 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:55:14.614583 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:55:14.614583 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:55:14.614583 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:55:14.614583 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:55:14.614583 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:55:14.614583 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:55:14.614583 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:55:14.614583 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Sep 14 08:55:14.614583 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 14 08:55:14.614583 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 19e0a0f8-6176-405f-b85d-31819295e96a could not be found. Sep 14 08:55:14.614583 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:55:14.614583 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:55:14.614583 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:55:14.614583 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:55:14.619114 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:55:14.619114 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:55:14.619114 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:55:14.619114 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:55:14.619114 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 19e0a0f8-6176-405f-b85d-31819295e96a could not be found. Sep 14 08:55:14.619114 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:55:14.633558 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-9debf5a0-7685-4574-819e-f5e665ff57e2 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Returning 404 to user: Instance group 19e0a0f8-6176-405f-b85d-31819295e96a could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:55:14.635074 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-9debf5a0-7685-4574-819e-f5e665ff57e2 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] 10.222.0.60 "DELETE /compute/v2.1/os-server-groups/19e0a0f8-6176-405f-b85d-31819295e96a" status: 404 len: 117 microversion: 2.1 time: 0.038475 Sep 14 08:55:14.636485 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 858/1675] 10.222.0.60 () {58 vars in 1266 bytes} [Wed Sep 14 08:55:14 2022] DELETE /compute/v2.1/os-server-groups/19e0a0f8-6176-405f-b85d-31819295e96a => generated 117 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 08:55:14.644954 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3e149453-ba96-4e9e-bd02-b95671da14c3 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:55:14.667079 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-3e149453-ba96-4e9e-bd02-b95671da14c3 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] HTTP exception thrown: Instance group c46b8359-ff9c-4ade-825c-98256d3f2a76 could not be found. Sep 14 08:55:14.669375 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3e149453-ba96-4e9e-bd02-b95671da14c3 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Request method failure captured: Sep 14 08:55:14.669375 n-d-836830-18 devstack@n-api.service[128759]: request: DELETE /compute/v2.1/os-server-groups/c46b8359-ff9c-4ade-825c-98256d3f2a76 HTTP/1.1 Sep 14 08:55:14.669375 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 08:55:14.669375 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 08:55:14.669375 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 08:55:14.669375 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 08:55:14.669375 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 08:55:14.669375 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 08:55:14.669375 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 08:55:14.669375 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 08:55:14.669375 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZbFgQns31B4K1Gb363cGXduQLgokw6WfaeT1YVN-c6H3wPCgmBhIJn4L9XWgu7v_8L4sII1J1dPBcOoi0yt1FKhCjoCD8EeMVjP4r5Cnu2pxAissXsejCLG7rKpPmNfdTELvv_bS2NkyNk2Oj-DapSFV5uCPegvUaO_HQ3X_72oJVU Sep 14 08:55:14.669375 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 08:55:14.669375 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 08:55:14.669375 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 08:55:14.669375 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 08:55:14.669375 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 08:55:14.669375 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 08:55:14.669375 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 92d8190fe7bb40beaea43a71808dc105 Sep 14 08:55:14.669375 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ServerGroupTestJSON-928665897 Sep 14 08:55:14.669375 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 08:55:14.669375 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 08:55:14.669375 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/92d8190fe7bb40beaea43a71808dc105"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_92d8190fe7bb40beaea43a71808dc105"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/92d8190fe7bb40beaea43a71808dc105"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/92d8190fe7bb40beaea43a71808dc105"}]}] Sep 14 08:55:14.669375 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ServerGroupTestJSON-928665897 Sep 14 08:55:14.669375 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 92d8190fe7bb40beaea43a71808dc105 Sep 14 08:55:14.669375 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ServerGroupTestJSON-928665897 Sep 14 08:55:14.669375 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ServerGroupTestJSON-928665897-project Sep 14 08:55:14.669375 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 08:55:14.669375 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 08:55:14.669375 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: ba4808b3a03f4bd8ad4af900bc926e77 Sep 14 08:55:14.669375 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ServerGroupTestJSON-928665897-project Sep 14 08:55:14.669375 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 08:55:14.669375 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance group c46b8359-ff9c-4ade-825c-98256d3f2a76 could not be found. Sep 14 08:55:14.669375 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': 'c46b8359-ff9c-4ade-825c-98256d3f2a76'} Sep 14 08:55:14.669375 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:55:14.669375 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:55:14.669375 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Sep 14 08:55:14.669375 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Sep 14 08:55:14.669375 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 14 08:55:14.669375 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 14 08:55:14.669375 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Sep 14 08:55:14.669375 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Sep 14 08:55:14.669375 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 14 08:55:14.669375 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 14 08:55:14.669375 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Sep 14 08:55:14.669375 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Sep 14 08:55:14.669375 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group c46b8359-ff9c-4ade-825c-98256d3f2a76 could not be found. Sep 14 08:55:14.669375 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:55:14.669375 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:55:14.669375 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:55:14.669375 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:55:14.669375 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:55:14.669375 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:55:14.669375 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:55:14.669375 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:55:14.669375 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:55:14.669375 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:55:14.669375 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Sep 14 08:55:14.669375 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 14 08:55:14.669375 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group c46b8359-ff9c-4ade-825c-98256d3f2a76 could not be found. Sep 14 08:55:14.669375 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:55:14.669375 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:55:14.669375 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:55:14.669375 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:55:14.674460 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:55:14.674460 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:55:14.674460 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:55:14.674460 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:55:14.674460 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group c46b8359-ff9c-4ade-825c-98256d3f2a76 could not be found. Sep 14 08:55:14.674460 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:55:14.678445 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3e149453-ba96-4e9e-bd02-b95671da14c3 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Returning 404 to user: Instance group c46b8359-ff9c-4ade-825c-98256d3f2a76 could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:55:14.679591 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-3e149453-ba96-4e9e-bd02-b95671da14c3 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] 10.222.0.60 "DELETE /compute/v2.1/os-server-groups/c46b8359-ff9c-4ade-825c-98256d3f2a76" status: 404 len: 117 microversion: 2.1 time: 0.039045 Sep 14 08:55:14.680961 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 818/1676] 10.222.0.60 () {58 vars in 1266 bytes} [Wed Sep 14 08:55:14 2022] DELETE /compute/v2.1/os-server-groups/c46b8359-ff9c-4ade-825c-98256d3f2a76 => generated 117 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 08:55:14.689703 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c68aa717-0ed0-4643-8e84-1cc5023fd506 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:55:14.708871 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-c68aa717-0ed0-4643-8e84-1cc5023fd506 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] HTTP exception thrown: Instance group 705d24c3-77f2-49fc-89f0-d889411329a2 could not be found. Sep 14 08:55:14.712492 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c68aa717-0ed0-4643-8e84-1cc5023fd506 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Request method failure captured: Sep 14 08:55:14.712492 n-d-836830-18 devstack@n-api.service[128758]: request: DELETE /compute/v2.1/os-server-groups/705d24c3-77f2-49fc-89f0-d889411329a2 HTTP/1.1 Sep 14 08:55:14.712492 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 08:55:14.712492 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 08:55:14.712492 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 08:55:14.712492 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 08:55:14.712492 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 08:55:14.712492 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 08:55:14.712492 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 08:55:14.712492 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 08:55:14.712492 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZbFgQns31B4K1Gb363cGXduQLgokw6WfaeT1YVN-c6H3wPCgmBhIJn4L9XWgu7v_8L4sII1J1dPBcOoi0yt1FKhCjoCD8EeMVjP4r5Cnu2pxAissXsejCLG7rKpPmNfdTELvv_bS2NkyNk2Oj-DapSFV5uCPegvUaO_HQ3X_72oJVU Sep 14 08:55:14.712492 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 08:55:14.712492 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 08:55:14.712492 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 08:55:14.712492 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 08:55:14.712492 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 08:55:14.712492 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 08:55:14.712492 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 92d8190fe7bb40beaea43a71808dc105 Sep 14 08:55:14.712492 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-ServerGroupTestJSON-928665897 Sep 14 08:55:14.712492 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 08:55:14.712492 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 08:55:14.712492 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/92d8190fe7bb40beaea43a71808dc105"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_92d8190fe7bb40beaea43a71808dc105"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/92d8190fe7bb40beaea43a71808dc105"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/92d8190fe7bb40beaea43a71808dc105"}]}] Sep 14 08:55:14.712492 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-ServerGroupTestJSON-928665897 Sep 14 08:55:14.712492 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 92d8190fe7bb40beaea43a71808dc105 Sep 14 08:55:14.712492 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-ServerGroupTestJSON-928665897 Sep 14 08:55:14.712492 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-ServerGroupTestJSON-928665897-project Sep 14 08:55:14.712492 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 08:55:14.712492 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 08:55:14.712492 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: ba4808b3a03f4bd8ad4af900bc926e77 Sep 14 08:55:14.712492 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-ServerGroupTestJSON-928665897-project Sep 14 08:55:14.712492 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 08:55:14.712492 n-d-836830-18 devstack@n-api.service[128758]: exception: Instance group 705d24c3-77f2-49fc-89f0-d889411329a2 could not be found. Sep 14 08:55:14.712492 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': '705d24c3-77f2-49fc-89f0-d889411329a2'} Sep 14 08:55:14.712492 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:55:14.712492 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:55:14.712492 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Sep 14 08:55:14.712492 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Sep 14 08:55:14.712492 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 14 08:55:14.712492 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 14 08:55:14.712492 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Sep 14 08:55:14.712492 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Sep 14 08:55:14.712492 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 14 08:55:14.712492 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 14 08:55:14.712492 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Sep 14 08:55:14.712492 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Sep 14 08:55:14.712492 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 705d24c3-77f2-49fc-89f0-d889411329a2 could not be found. Sep 14 08:55:14.712492 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:55:14.712492 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:55:14.712492 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:55:14.712492 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:55:14.712492 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:55:14.712492 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:55:14.712492 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:55:14.712492 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:55:14.712492 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:55:14.712492 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:55:14.712492 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Sep 14 08:55:14.712492 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 14 08:55:14.712492 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 705d24c3-77f2-49fc-89f0-d889411329a2 could not be found. Sep 14 08:55:14.712492 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:55:14.712492 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:55:14.712492 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:55:14.712492 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:55:14.718660 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:55:14.718660 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:55:14.718660 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:55:14.718660 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:55:14.718660 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 705d24c3-77f2-49fc-89f0-d889411329a2 could not be found. Sep 14 08:55:14.718660 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:55:14.721966 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c68aa717-0ed0-4643-8e84-1cc5023fd506 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Returning 404 to user: Instance group 705d24c3-77f2-49fc-89f0-d889411329a2 could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:55:14.723162 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-c68aa717-0ed0-4643-8e84-1cc5023fd506 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] 10.222.0.60 "DELETE /compute/v2.1/os-server-groups/705d24c3-77f2-49fc-89f0-d889411329a2" status: 404 len: 117 microversion: 2.1 time: 0.038113 Sep 14 08:55:14.732441 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 859/1677] 10.222.0.60 () {58 vars in 1266 bytes} [Wed Sep 14 08:55:14 2022] DELETE /compute/v2.1/os-server-groups/705d24c3-77f2-49fc-89f0-d889411329a2 => generated 117 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 14 08:55:14.742260 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-2879eb0d-1fb7-45d4-9862-bc6f20aa4b83 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:55:14.765602 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-2b12cc1c-e1f7-4f38-a0a3-7c0d6838cb07 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:55:14.766295 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-2b12cc1c-e1f7-4f38-a0a3-7c0d6838cb07 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] [instance: 6ada18a6-f9cb-4bc9-800d-e0218adc4866] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:55:14.781859 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2b12cc1c-e1f7-4f38-a0a3-7c0d6838cb07 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:14.782408 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2b12cc1c-e1f7-4f38-a0a3-7c0d6838cb07 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:14.785811 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2b12cc1c-e1f7-4f38-a0a3-7c0d6838cb07 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:14.786495 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-2879eb0d-1fb7-45d4-9862-bc6f20aa4b83 tempest-ServerGroupTestJSON-928665897 tempest-ServerGroupTestJSON-928665897-project] 10.222.0.60 "DELETE /compute/v2.1/os-server-groups/ab23666b-035e-4c9f-88a6-d3e41c2eebf9" status: 204 len: 0 microversion: 2.1 time: 0.050051 Sep 14 08:55:14.788452 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2b12cc1c-e1f7-4f38-a0a3-7c0d6838cb07 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:14.789750 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2b12cc1c-e1f7-4f38-a0a3-7c0d6838cb07 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:14.790500 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 819/1678] 10.222.0.60 () {58 vars in 1266 bytes} [Wed Sep 14 08:55:14 2022] DELETE /compute/v2.1/os-server-groups/ab23666b-035e-4c9f-88a6-d3e41c2eebf9 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 08:55:14.792821 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2b12cc1c-e1f7-4f38-a0a3-7c0d6838cb07 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:15.097959 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-2b12cc1c-e1f7-4f38-a0a3-7c0d6838cb07 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab2d64c1cb447f9bfd658408aa07e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ecc8c1389847c7bcd9cd5570d990e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:55:15.126431 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-2b12cc1c-e1f7-4f38-a0a3-7c0d6838cb07 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] 10.222.0.60 "GET /compute/v2.1/servers/6ada18a6-f9cb-4bc9-800d-e0218adc4866" status: 200 len: 1272 microversion: 2.1 time: 0.365286 Sep 14 08:55:15.127103 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 860/1679] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:55:14 2022] GET /compute/v2.1/servers/6ada18a6-f9cb-4bc9-800d-e0218adc4866 => generated 1272 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:55:15.315927 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-817410ef-aac9-420f-a2c4-8d233cca79ba tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:55:15.316553 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-817410ef-aac9-420f-a2c4-8d233cca79ba tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: 2098e0b9-b628-4b9e-979b-960c68830fee] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:55:15.334226 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-817410ef-aac9-420f-a2c4-8d233cca79ba tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:15.335244 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-817410ef-aac9-420f-a2c4-8d233cca79ba tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:15.336034 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-817410ef-aac9-420f-a2c4-8d233cca79ba tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:15.337050 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-817410ef-aac9-420f-a2c4-8d233cca79ba tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:15.340200 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-817410ef-aac9-420f-a2c4-8d233cca79ba tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:15.345115 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-817410ef-aac9-420f-a2c4-8d233cca79ba tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:15.490080 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-67eaaf58-5fb8-4277-9981-9aca94c5b3d3 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-753930528", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "371ca8d4-dbd6-426c-b295-7fe3200f1240"}], "block_device_mapping_v2": [{"uuid": "0d3c496c-8f1c-4a5b-9d8c-533d172f09ec", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:55:15.624033 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.network.neutron [None req-67eaaf58-5fb8-4277-9981-9aca94c5b3d3 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] validate_networks() for [('371ca8d4-dbd6-426c-b295-7fe3200f1240', None, None, None, None, None)] {{(pid=128758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 08:55:15.851493 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-817410ef-aac9-420f-a2c4-8d233cca79ba tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:55:15.860448 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-817410ef-aac9-420f-a2c4-8d233cca79ba tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/2098e0b9-b628-4b9e-979b-960c68830fee" status: 200 len: 1716 microversion: 2.1 time: 0.549742 Sep 14 08:55:15.861025 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 820/1680] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:55:15 2022] GET /compute/v2.1/servers/2098e0b9-b628-4b9e-979b-960c68830fee => generated 1716 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:55:16.174219 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-1825021e-eb33-4408-8283-575f19ee8df1 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:55:16.175655 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-1825021e-eb33-4408-8283-575f19ee8df1 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] [instance: 6ada18a6-f9cb-4bc9-800d-e0218adc4866] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:55:16.192032 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1825021e-eb33-4408-8283-575f19ee8df1 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:16.192802 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1825021e-eb33-4408-8283-575f19ee8df1 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:16.193449 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1825021e-eb33-4408-8283-575f19ee8df1 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:16.195128 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1825021e-eb33-4408-8283-575f19ee8df1 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:16.195630 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1825021e-eb33-4408-8283-575f19ee8df1 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:16.196070 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1825021e-eb33-4408-8283-575f19ee8df1 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:16.333333 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-1825021e-eb33-4408-8283-575f19ee8df1 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab2d64c1cb447f9bfd658408aa07e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ecc8c1389847c7bcd9cd5570d990e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:55:16.341221 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-1825021e-eb33-4408-8283-575f19ee8df1 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] 10.222.0.60 "GET /compute/v2.1/servers/6ada18a6-f9cb-4bc9-800d-e0218adc4866" status: 200 len: 1272 microversion: 2.1 time: 0.172288 Sep 14 08:55:16.351438 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 821/1681] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:55:16 2022] GET /compute/v2.1/servers/6ada18a6-f9cb-4bc9-800d-e0218adc4866 => generated 1272 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:55:16.889373 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9dfe60ba-31bb-490e-9ba2-fc4ecbce3d81 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:55:16.890001 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-9dfe60ba-31bb-490e-9ba2-fc4ecbce3d81 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: 2098e0b9-b628-4b9e-979b-960c68830fee] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:55:16.910753 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9dfe60ba-31bb-490e-9ba2-fc4ecbce3d81 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:16.912067 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9dfe60ba-31bb-490e-9ba2-fc4ecbce3d81 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:16.912716 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9dfe60ba-31bb-490e-9ba2-fc4ecbce3d81 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:16.914055 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9dfe60ba-31bb-490e-9ba2-fc4ecbce3d81 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:16.915014 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9dfe60ba-31bb-490e-9ba2-fc4ecbce3d81 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:16.915765 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9dfe60ba-31bb-490e-9ba2-fc4ecbce3d81 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:17.285249 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-67eaaf58-5fb8-4277-9981-9aca94c5b3d3 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Flavor limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 08:55:17.285819 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-67eaaf58-5fb8-4277-9981-9aca94c5b3d3 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Image limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 08:55:17.286239 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-67eaaf58-5fb8-4277-9981-9aca94c5b3d3 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Flavor pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 08:55:17.286653 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-67eaaf58-5fb8-4277-9981-9aca94c5b3d3 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Image pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 08:55:17.287375 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-67eaaf58-5fb8-4277-9981-9aca94c5b3d3 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 08:55:17.324166 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-67eaaf58-5fb8-4277-9981-9aca94c5b3d3 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:17.324979 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-67eaaf58-5fb8-4277-9981-9aca94c5b3d3 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:17.325864 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-67eaaf58-5fb8-4277-9981-9aca94c5b3d3 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:17.327577 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-67eaaf58-5fb8-4277-9981-9aca94c5b3d3 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:17.328306 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-67eaaf58-5fb8-4277-9981-9aca94c5b3d3 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:17.330977 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-67eaaf58-5fb8-4277-9981-9aca94c5b3d3 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:17.365534 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-67eaaf58-5fb8-4277-9981-9aca94c5b3d3 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Getting quotas for project 3850954316f34104b2a8052dc78a50d7. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 08:55:17.372727 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-67eaaf58-5fb8-4277-9981-9aca94c5b3d3 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Getting quotas for user f140347422af48a4875e80337a272e29 and project 3850954316f34104b2a8052dc78a50d7. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 08:55:17.389501 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:55:17.447285 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-9dfe60ba-31bb-490e-9ba2-fc4ecbce3d81 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:55:17.456450 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-9dfe60ba-31bb-490e-9ba2-fc4ecbce3d81 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/2098e0b9-b628-4b9e-979b-960c68830fee" status: 200 len: 1716 microversion: 2.1 time: 0.574863 Sep 14 08:55:17.460245 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 822/1682] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:55:16 2022] GET /compute/v2.1/servers/2098e0b9-b628-4b9e-979b-960c68830fee => generated 1716 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:55:17.471540 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-2478e36c-eab4-4e3e-9b25-78c6fadbf377 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:55:17.472661 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-2478e36c-eab4-4e3e-9b25-78c6fadbf377 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] [instance: 6ada18a6-f9cb-4bc9-800d-e0218adc4866] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:55:17.491140 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2478e36c-eab4-4e3e-9b25-78c6fadbf377 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:17.491878 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2478e36c-eab4-4e3e-9b25-78c6fadbf377 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:17.492567 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2478e36c-eab4-4e3e-9b25-78c6fadbf377 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:17.493542 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2478e36c-eab4-4e3e-9b25-78c6fadbf377 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:17.494237 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2478e36c-eab4-4e3e-9b25-78c6fadbf377 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:17.494885 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2478e36c-eab4-4e3e-9b25-78c6fadbf377 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:17.529561 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-67eaaf58-5fb8-4277-9981-9aca94c5b3d3 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Going to run 1 instances... {{(pid=128758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 08:55:17.539875 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-67eaaf58-5fb8-4277-9981-9aca94c5b3d3 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: bb621205-f7b7-4823-b3b9-fb903ac44b2a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0d3c496c-8f1c-4a5b-9d8c-533d172f09ec',volume_size=None,volume_type=None)] {{(pid=128758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 08:55:17.806124 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-67eaaf58-5fb8-4277-9981-9aca94c5b3d3 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.325836 Sep 14 08:55:17.819144 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 861/1683] 10.222.0.60 () {62 vars in 1188 bytes} [Wed Sep 14 08:55:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 2340 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 14 08:55:17.851693 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-2478e36c-eab4-4e3e-9b25-78c6fadbf377 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab2d64c1cb447f9bfd658408aa07e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ecc8c1389847c7bcd9cd5570d990e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:55:17.868942 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-2478e36c-eab4-4e3e-9b25-78c6fadbf377 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] 10.222.0.60 "GET /compute/v2.1/servers/6ada18a6-f9cb-4bc9-800d-e0218adc4866" status: 200 len: 1314 microversion: 2.1 time: 0.407487 Sep 14 08:55:17.869551 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 823/1684] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:55:17 2022] GET /compute/v2.1/servers/6ada18a6-f9cb-4bc9-800d-e0218adc4866 => generated 1314 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:55:17.898207 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9e4652e0-19b9-4cf9-bf2a-ee36ae149e61 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:55:17.900253 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-9e4652e0-19b9-4cf9-bf2a-ee36ae149e61 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: bb621205-f7b7-4823-b3b9-fb903ac44b2a] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:55:18.095129 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-9e4652e0-19b9-4cf9-bf2a-ee36ae149e61 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:55:18.106358 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-9e4652e0-19b9-4cf9-bf2a-ee36ae149e61 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:55:18.119665 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-139c8e73-9507-417c-930f-c62a2788f45e tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Action: 'create', calling method: .version_select at 0x7f7d44f9aca0>, body: {"keypair": {"name": "tempest-keypair-1978685054", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJwmJv0UriOZPffxA6fpKC9XAOiZQrcRGQEBeMWWDkeTpMFwK2Mj9zXH61G2+obCZh1uAjkPqR+zIJcMx2io5mMYk3dXM5NdYwqYbyaauKo403GVKyeBRP1YYuieb9mngA=="}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:55:18.124518 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-9e4652e0-19b9-4cf9-bf2a-ee36ae149e61 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:55:18.129242 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-9e4652e0-19b9-4cf9-bf2a-ee36ae149e61 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/bb621205-f7b7-4823-b3b9-fb903ac44b2a" status: 200 len: 1103 microversion: 2.25 time: 0.253856 Sep 14 08:55:18.129899 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 824/1685] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:55:17 2022] GET /compute/v2.1/servers/bb621205-f7b7-4823-b3b9-fb903ac44b2a => generated 1103 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:55:18.150549 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-139c8e73-9507-417c-930f-c62a2788f45e tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Getting quotas for project e77c85f074ae4b8cb5a1457a5183197b. Resources: {'key_pairs'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 08:55:18.167418 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-139c8e73-9507-417c-930f-c62a2788f45e tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Getting quotas for user 72e1780ebcf1413fa4f7a9760b761c78 and project e77c85f074ae4b8cb5a1457a5183197b. Resources: {'key_pairs'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 08:55:18.221066 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-139c8e73-9507-417c-930f-c62a2788f45e tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.400444 Sep 14 08:55:18.221691 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 862/1686] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Sep 14 08:55:17 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:55:18.466531 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-ec2ca0a4-599b-463d-9c7e-5d4ab8f90d91 req-2731a546-5eb1-4b8e-b22a-e424368c983e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8dd1623b-312c-411d-8f6c-b334195e573b", "tag": "558f9bbb-f694-40cf-b969-31f1db110da5"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:55:18.478544 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-ec2ca0a4-599b-463d-9c7e-5d4ab8f90d91 req-2731a546-5eb1-4b8e-b22a-e424368c983e service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:18.479497 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-ec2ca0a4-599b-463d-9c7e-5d4ab8f90d91 req-2731a546-5eb1-4b8e-b22a-e424368c983e service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:18.480287 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-ec2ca0a4-599b-463d-9c7e-5d4ab8f90d91 req-2731a546-5eb1-4b8e-b22a-e424368c983e service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:18.481751 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-4e665ad4-288d-4c4e-81ad-b9f244646b08 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:55:18.482675 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-4e665ad4-288d-4c4e-81ad-b9f244646b08 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: 2098e0b9-b628-4b9e-979b-960c68830fee] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:55:18.495120 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-ec2ca0a4-599b-463d-9c7e-5d4ab8f90d91 req-2731a546-5eb1-4b8e-b22a-e424368c983e service nova] Creating event network-changed:558f9bbb-f694-40cf-b969-31f1db110da5 for instance 8dd1623b-312c-411d-8f6c-b334195e573b on n-h2-836830-18 Sep 14 08:55:18.500807 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-ec2ca0a4-599b-463d-9c7e-5d4ab8f90d91 req-2731a546-5eb1-4b8e-b22a-e424368c983e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038413 Sep 14 08:55:18.502089 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 825/1687] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:55:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:55:18.503813 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4e665ad4-288d-4c4e-81ad-b9f244646b08 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:18.504943 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4e665ad4-288d-4c4e-81ad-b9f244646b08 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:18.507519 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4e665ad4-288d-4c4e-81ad-b9f244646b08 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:18.508484 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4e665ad4-288d-4c4e-81ad-b9f244646b08 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:18.509098 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4e665ad4-288d-4c4e-81ad-b9f244646b08 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:18.509677 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4e665ad4-288d-4c4e-81ad-b9f244646b08 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:18.899334 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-70493c11-5b56-4841-98bc-4b67cc930c8f tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:55:18.900068 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-70493c11-5b56-4841-98bc-4b67cc930c8f tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] [instance: 6ada18a6-f9cb-4bc9-800d-e0218adc4866] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:55:18.908181 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-70493c11-5b56-4841-98bc-4b67cc930c8f tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:18.909085 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-70493c11-5b56-4841-98bc-4b67cc930c8f tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:18.910537 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-70493c11-5b56-4841-98bc-4b67cc930c8f tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:18.911599 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-70493c11-5b56-4841-98bc-4b67cc930c8f tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:18.913222 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-70493c11-5b56-4841-98bc-4b67cc930c8f tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:18.913930 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-70493c11-5b56-4841-98bc-4b67cc930c8f tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:19.373565 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-4e665ad4-288d-4c4e-81ad-b9f244646b08 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:55:19.382880 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-4e665ad4-288d-4c4e-81ad-b9f244646b08 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/2098e0b9-b628-4b9e-979b-960c68830fee" status: 200 len: 1716 microversion: 2.1 time: 0.906250 Sep 14 08:55:19.391048 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 863/1688] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:55:18 2022] GET /compute/v2.1/servers/2098e0b9-b628-4b9e-979b-960c68830fee => generated 1716 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:55:19.396724 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-e199fdd3-391c-4b52-b4a9-c97678efdd40 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:55:19.403127 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-e199fdd3-391c-4b52-b4a9-c97678efdd40 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: bb621205-f7b7-4823-b3b9-fb903ac44b2a] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:55:19.414009 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e199fdd3-391c-4b52-b4a9-c97678efdd40 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:19.422242 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e199fdd3-391c-4b52-b4a9-c97678efdd40 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:19.423297 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e199fdd3-391c-4b52-b4a9-c97678efdd40 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:19.424332 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e199fdd3-391c-4b52-b4a9-c97678efdd40 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:19.425006 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e199fdd3-391c-4b52-b4a9-c97678efdd40 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:19.425688 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e199fdd3-391c-4b52-b4a9-c97678efdd40 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:19.570366 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-e199fdd3-391c-4b52-b4a9-c97678efdd40 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:55:19.590378 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-e199fdd3-391c-4b52-b4a9-c97678efdd40 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:55:19.594002 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-e199fdd3-391c-4b52-b4a9-c97678efdd40 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:55:19.599015 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-e199fdd3-391c-4b52-b4a9-c97678efdd40 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/bb621205-f7b7-4823-b3b9-fb903ac44b2a" status: 200 len: 1176 microversion: 2.25 time: 0.205971 Sep 14 08:55:19.599962 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 864/1689] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:55:19 2022] GET /compute/v2.1/servers/bb621205-f7b7-4823-b3b9-fb903ac44b2a => generated 1176 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:55:19.664287 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-70493c11-5b56-4841-98bc-4b67cc930c8f tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab2d64c1cb447f9bfd658408aa07e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ecc8c1389847c7bcd9cd5570d990e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:55:19.677609 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-70493c11-5b56-4841-98bc-4b67cc930c8f tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] 10.222.0.60 "GET /compute/v2.1/servers/6ada18a6-f9cb-4bc9-800d-e0218adc4866" status: 200 len: 1314 microversion: 2.1 time: 0.784013 Sep 14 08:55:19.678518 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 826/1690] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:55:18 2022] GET /compute/v2.1/servers/6ada18a6-f9cb-4bc9-800d-e0218adc4866 => generated 1314 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:55:20.588198 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ba74351c-9aa6-4d9c-864b-070282a98978 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:55:20.589669 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-ba74351c-9aa6-4d9c-864b-070282a98978 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: 2098e0b9-b628-4b9e-979b-960c68830fee] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:55:20.602153 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ba74351c-9aa6-4d9c-864b-070282a98978 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:20.602693 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ba74351c-9aa6-4d9c-864b-070282a98978 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:20.603179 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ba74351c-9aa6-4d9c-864b-070282a98978 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:20.608569 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ba74351c-9aa6-4d9c-864b-070282a98978 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:20.609549 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ba74351c-9aa6-4d9c-864b-070282a98978 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:20.611598 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ba74351c-9aa6-4d9c-864b-070282a98978 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:20.620207 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-ee9a53c0-1417-46d0-85a8-2550a1153285 req-39d238a1-3001-4d3f-a2ac-dab4cec00d64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ada18a6-f9cb-4bc9-800d-e0218adc4866", "tag": "bc272de6-30ab-4921-8e34-2d8757490726"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:55:20.641648 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-ee9a53c0-1417-46d0-85a8-2550a1153285 req-39d238a1-3001-4d3f-a2ac-dab4cec00d64 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:20.645089 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-ee9a53c0-1417-46d0-85a8-2550a1153285 req-39d238a1-3001-4d3f-a2ac-dab4cec00d64 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:20.645538 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-ee9a53c0-1417-46d0-85a8-2550a1153285 req-39d238a1-3001-4d3f-a2ac-dab4cec00d64 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:20.668084 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-ee9a53c0-1417-46d0-85a8-2550a1153285 req-39d238a1-3001-4d3f-a2ac-dab4cec00d64 service nova] Creating event network-changed:bc272de6-30ab-4921-8e34-2d8757490726 for instance 6ada18a6-f9cb-4bc9-800d-e0218adc4866 on n-h2-836830-18 Sep 14 08:55:20.685106 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-ee9a53c0-1417-46d0-85a8-2550a1153285 req-39d238a1-3001-4d3f-a2ac-dab4cec00d64 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067040 Sep 14 08:55:20.686770 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 827/1691] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:55:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 08:55:20.693024 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-7babcbbc-1cc6-4f19-b3c2-23274837d43b tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:55:20.695858 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-7babcbbc-1cc6-4f19-b3c2-23274837d43b tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: bb621205-f7b7-4823-b3b9-fb903ac44b2a] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:55:20.706677 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7babcbbc-1cc6-4f19-b3c2-23274837d43b tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:20.707698 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7babcbbc-1cc6-4f19-b3c2-23274837d43b tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:20.708379 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7babcbbc-1cc6-4f19-b3c2-23274837d43b tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:20.709599 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7babcbbc-1cc6-4f19-b3c2-23274837d43b tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:20.710850 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7babcbbc-1cc6-4f19-b3c2-23274837d43b tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:20.713083 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7babcbbc-1cc6-4f19-b3c2-23274837d43b tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:20.819825 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-7babcbbc-1cc6-4f19-b3c2-23274837d43b tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:55:20.849180 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-7babcbbc-1cc6-4f19-b3c2-23274837d43b tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:55:20.854844 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-7babcbbc-1cc6-4f19-b3c2-23274837d43b tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:55:20.858552 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-7babcbbc-1cc6-4f19-b3c2-23274837d43b tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/bb621205-f7b7-4823-b3b9-fb903ac44b2a" status: 200 len: 1250 microversion: 2.25 time: 0.170149 Sep 14 08:55:20.861934 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 828/1692] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:55:20 2022] GET /compute/v2.1/servers/bb621205-f7b7-4823-b3b9-fb903ac44b2a => generated 1250 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:55:20.869115 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-2a8bfc79-57c2-4f4d-986b-b0f53f34b89c tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:55:20.871884 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-2a8bfc79-57c2-4f4d-986b-b0f53f34b89c tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] [instance: 6ada18a6-f9cb-4bc9-800d-e0218adc4866] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:55:20.888478 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2a8bfc79-57c2-4f4d-986b-b0f53f34b89c tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:20.888983 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2a8bfc79-57c2-4f4d-986b-b0f53f34b89c tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:20.889427 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2a8bfc79-57c2-4f4d-986b-b0f53f34b89c tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:20.890207 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2a8bfc79-57c2-4f4d-986b-b0f53f34b89c tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:20.890670 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2a8bfc79-57c2-4f4d-986b-b0f53f34b89c tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:20.891133 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2a8bfc79-57c2-4f4d-986b-b0f53f34b89c tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:21.450219 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-ba74351c-9aa6-4d9c-864b-070282a98978 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:55:21.459779 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-ba74351c-9aa6-4d9c-864b-070282a98978 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/2098e0b9-b628-4b9e-979b-960c68830fee" status: 200 len: 1716 microversion: 2.1 time: 1.046171 Sep 14 08:55:21.465418 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 865/1693] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:55:20 2022] GET /compute/v2.1/servers/2098e0b9-b628-4b9e-979b-960c68830fee => generated 1716 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:55:21.892210 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-bab9e310-ef73-445b-8965-ec1706ac85fb tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:55:21.892830 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-bab9e310-ef73-445b-8965-ec1706ac85fb tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: bb621205-f7b7-4823-b3b9-fb903ac44b2a] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:55:21.903749 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bab9e310-ef73-445b-8965-ec1706ac85fb tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:21.906650 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bab9e310-ef73-445b-8965-ec1706ac85fb tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:21.907211 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bab9e310-ef73-445b-8965-ec1706ac85fb tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:21.907972 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bab9e310-ef73-445b-8965-ec1706ac85fb tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:21.908453 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bab9e310-ef73-445b-8965-ec1706ac85fb tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:21.908888 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bab9e310-ef73-445b-8965-ec1706ac85fb tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:22.010728 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-2a8bfc79-57c2-4f4d-986b-b0f53f34b89c tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab2d64c1cb447f9bfd658408aa07e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ecc8c1389847c7bcd9cd5570d990e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:55:22.025505 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-2a8bfc79-57c2-4f4d-986b-b0f53f34b89c tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] 10.222.0.60 "GET /compute/v2.1/servers/6ada18a6-f9cb-4bc9-800d-e0218adc4866" status: 200 len: 1314 microversion: 2.1 time: 1.162228 Sep 14 08:55:22.026892 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 829/1694] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:55:20 2022] GET /compute/v2.1/servers/6ada18a6-f9cb-4bc9-800d-e0218adc4866 => generated 1314 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:55:22.316939 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-bab9e310-ef73-445b-8965-ec1706ac85fb tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:55:22.354457 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-bab9e310-ef73-445b-8965-ec1706ac85fb tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:55:22.363046 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-bab9e310-ef73-445b-8965-ec1706ac85fb tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:55:22.365341 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-bab9e310-ef73-445b-8965-ec1706ac85fb tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/bb621205-f7b7-4823-b3b9-fb903ac44b2a" status: 200 len: 1292 microversion: 2.25 time: 0.477687 Sep 14 08:55:22.367873 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 866/1695] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:55:21 2022] GET /compute/v2.1/servers/bb621205-f7b7-4823-b3b9-fb903ac44b2a => generated 1292 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 08:55:22.493948 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-1f44b6cc-6537-4848-8fdd-a471366cdfb7 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:55:22.495014 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-1f44b6cc-6537-4848-8fdd-a471366cdfb7 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: 2098e0b9-b628-4b9e-979b-960c68830fee] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:55:22.504852 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1f44b6cc-6537-4848-8fdd-a471366cdfb7 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:22.506226 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1f44b6cc-6537-4848-8fdd-a471366cdfb7 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:22.507849 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1f44b6cc-6537-4848-8fdd-a471366cdfb7 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:22.512619 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1f44b6cc-6537-4848-8fdd-a471366cdfb7 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:22.513861 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1f44b6cc-6537-4848-8fdd-a471366cdfb7 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:22.515575 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1f44b6cc-6537-4848-8fdd-a471366cdfb7 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:22.867162 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-1f44b6cc-6537-4848-8fdd-a471366cdfb7 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:55:22.879490 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-1f44b6cc-6537-4848-8fdd-a471366cdfb7 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/2098e0b9-b628-4b9e-979b-960c68830fee" status: 200 len: 1716 microversion: 2.1 time: 0.389611 Sep 14 08:55:22.880085 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 830/1696] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:55:22 2022] GET /compute/v2.1/servers/2098e0b9-b628-4b9e-979b-960c68830fee => generated 1716 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:55:23.061170 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b2045c51-5dfc-449c-982a-fcf801965fe5 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:55:23.062510 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-b2045c51-5dfc-449c-982a-fcf801965fe5 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] [instance: 6ada18a6-f9cb-4bc9-800d-e0218adc4866] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:55:23.072320 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b2045c51-5dfc-449c-982a-fcf801965fe5 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:23.073292 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b2045c51-5dfc-449c-982a-fcf801965fe5 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:23.073962 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b2045c51-5dfc-449c-982a-fcf801965fe5 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:23.074900 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b2045c51-5dfc-449c-982a-fcf801965fe5 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:23.075611 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b2045c51-5dfc-449c-982a-fcf801965fe5 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:23.077778 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b2045c51-5dfc-449c-982a-fcf801965fe5 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:23.341553 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-b2045c51-5dfc-449c-982a-fcf801965fe5 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab2d64c1cb447f9bfd658408aa07e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ecc8c1389847c7bcd9cd5570d990e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:55:23.356698 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-b2045c51-5dfc-449c-982a-fcf801965fe5 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] 10.222.0.60 "GET /compute/v2.1/servers/6ada18a6-f9cb-4bc9-800d-e0218adc4866" status: 200 len: 1314 microversion: 2.1 time: 0.308388 Sep 14 08:55:23.357749 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 867/1697] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:55:23 2022] GET /compute/v2.1/servers/6ada18a6-f9cb-4bc9-800d-e0218adc4866 => generated 1314 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:55:23.397172 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-35bb21c2-a7dc-449c-a1f7-118e9585a3f3 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:55:23.397830 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-35bb21c2-a7dc-449c-a1f7-118e9585a3f3 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: bb621205-f7b7-4823-b3b9-fb903ac44b2a] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:55:23.407525 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-35bb21c2-a7dc-449c-a1f7-118e9585a3f3 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:23.411460 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-35bb21c2-a7dc-449c-a1f7-118e9585a3f3 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:23.412203 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-35bb21c2-a7dc-449c-a1f7-118e9585a3f3 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:23.413177 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-35bb21c2-a7dc-449c-a1f7-118e9585a3f3 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:23.413876 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-35bb21c2-a7dc-449c-a1f7-118e9585a3f3 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:23.414960 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-35bb21c2-a7dc-449c-a1f7-118e9585a3f3 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:23.418322 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-fdf52861-278e-4e36-b38d-5e1d86419761 req-90ed600e-9a11-4fc9-8993-b229a182be5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb621205-f7b7-4823-b3b9-fb903ac44b2a", "tag": "977f076f-2424-4d11-aa54-073389c5051f"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:55:23.452895 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-fdf52861-278e-4e36-b38d-5e1d86419761 req-90ed600e-9a11-4fc9-8993-b229a182be5d service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:23.463233 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-fdf52861-278e-4e36-b38d-5e1d86419761 req-90ed600e-9a11-4fc9-8993-b229a182be5d service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:23.464113 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-fdf52861-278e-4e36-b38d-5e1d86419761 req-90ed600e-9a11-4fc9-8993-b229a182be5d service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:23.488937 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-fdf52861-278e-4e36-b38d-5e1d86419761 req-90ed600e-9a11-4fc9-8993-b229a182be5d service nova] Creating event network-changed:977f076f-2424-4d11-aa54-073389c5051f for instance bb621205-f7b7-4823-b3b9-fb903ac44b2a on n-h1-836830-18 Sep 14 08:55:23.498137 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-fdf52861-278e-4e36-b38d-5e1d86419761 req-90ed600e-9a11-4fc9-8993-b229a182be5d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084434 Sep 14 08:55:23.502147 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 868/1698] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:55:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:55:23.908855 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-03489246-9956-4818-a1e0-f0c846a84e47 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:55:23.909597 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-03489246-9956-4818-a1e0-f0c846a84e47 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: 2098e0b9-b628-4b9e-979b-960c68830fee] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:55:23.922193 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-03489246-9956-4818-a1e0-f0c846a84e47 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:23.923285 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-03489246-9956-4818-a1e0-f0c846a84e47 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:23.923734 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-03489246-9956-4818-a1e0-f0c846a84e47 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:23.924461 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-03489246-9956-4818-a1e0-f0c846a84e47 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:23.924923 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-03489246-9956-4818-a1e0-f0c846a84e47 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:23.925352 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-03489246-9956-4818-a1e0-f0c846a84e47 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:23.999533 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-35bb21c2-a7dc-449c-a1f7-118e9585a3f3 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:55:24.011442 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-35bb21c2-a7dc-449c-a1f7-118e9585a3f3 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:55:24.014021 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-35bb21c2-a7dc-449c-a1f7-118e9585a3f3 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:55:24.015477 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-35bb21c2-a7dc-449c-a1f7-118e9585a3f3 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/bb621205-f7b7-4823-b3b9-fb903ac44b2a" status: 200 len: 1292 microversion: 2.25 time: 0.622626 Sep 14 08:55:24.027583 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 831/1699] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:55:23 2022] GET /compute/v2.1/servers/bb621205-f7b7-4823-b3b9-fb903ac44b2a => generated 1292 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 08:55:24.386156 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-898e130b-8728-4e76-8f44-d0839c509334 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:55:24.386793 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-898e130b-8728-4e76-8f44-d0839c509334 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] [instance: 6ada18a6-f9cb-4bc9-800d-e0218adc4866] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:55:24.398208 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-898e130b-8728-4e76-8f44-d0839c509334 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:24.398856 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-898e130b-8728-4e76-8f44-d0839c509334 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:24.399571 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-898e130b-8728-4e76-8f44-d0839c509334 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:24.400301 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-898e130b-8728-4e76-8f44-d0839c509334 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:24.410868 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-898e130b-8728-4e76-8f44-d0839c509334 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:24.411380 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-898e130b-8728-4e76-8f44-d0839c509334 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:24.473933 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-03489246-9956-4818-a1e0-f0c846a84e47 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:55:24.491075 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-03489246-9956-4818-a1e0-f0c846a84e47 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/2098e0b9-b628-4b9e-979b-960c68830fee" status: 200 len: 1716 microversion: 2.1 time: 0.586545 Sep 14 08:55:24.499455 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 869/1700] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:55:23 2022] GET /compute/v2.1/servers/2098e0b9-b628-4b9e-979b-960c68830fee => generated 1716 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:55:25.041377 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-43ce868a-70fb-4972-be3e-ecd97e8f116d tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:55:25.041995 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-43ce868a-70fb-4972-be3e-ecd97e8f116d tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: bb621205-f7b7-4823-b3b9-fb903ac44b2a] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:55:25.055004 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-43ce868a-70fb-4972-be3e-ecd97e8f116d tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:25.055515 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-43ce868a-70fb-4972-be3e-ecd97e8f116d tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:25.056080 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-43ce868a-70fb-4972-be3e-ecd97e8f116d tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:25.056812 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-43ce868a-70fb-4972-be3e-ecd97e8f116d tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:25.057276 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-43ce868a-70fb-4972-be3e-ecd97e8f116d tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:25.057705 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-43ce868a-70fb-4972-be3e-ecd97e8f116d tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:25.675132 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-43ce868a-70fb-4972-be3e-ecd97e8f116d tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:55:25.698387 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-43ce868a-70fb-4972-be3e-ecd97e8f116d tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:55:25.705791 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-43ce868a-70fb-4972-be3e-ecd97e8f116d tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:55:25.707884 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-43ce868a-70fb-4972-be3e-ecd97e8f116d tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/bb621205-f7b7-4823-b3b9-fb903ac44b2a" status: 200 len: 1292 microversion: 2.25 time: 0.670484 Sep 14 08:55:25.725548 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 870/1701] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:55:25 2022] GET /compute/v2.1/servers/bb621205-f7b7-4823-b3b9-fb903ac44b2a => generated 1292 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 08:55:25.739346 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-e63c9727-1a4e-49ed-8ba7-4c093d2e62c3 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-714627539", "imageRef": "061068b3-b54f-4beb-85bc-1b17e1c74d8d", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "98f0af7f-1102-474f-b030-4ac3340cfce6"}], "security_groups": [{"name": "tempest-securitygroup--1216927346"}], "key_name": "tempest-keypair-1978685054", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:55:25.761781 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-898e130b-8728-4e76-8f44-d0839c509334 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab2d64c1cb447f9bfd658408aa07e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ecc8c1389847c7bcd9cd5570d990e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:55:25.771003 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-898e130b-8728-4e76-8f44-d0839c509334 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] 10.222.0.60 "GET /compute/v2.1/servers/6ada18a6-f9cb-4bc9-800d-e0218adc4866" status: 200 len: 1314 microversion: 2.1 time: 1.388747 Sep 14 08:55:25.775002 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 832/1702] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:55:24 2022] GET /compute/v2.1/servers/6ada18a6-f9cb-4bc9-800d-e0218adc4866 => generated 1314 bytes in 1393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:55:25.791140 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8ce0c293-bd69-47ec-9ba5-a9c0400daa47 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:55:25.792246 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-8ce0c293-bd69-47ec-9ba5-a9c0400daa47 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: 2098e0b9-b628-4b9e-979b-960c68830fee] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:55:25.805781 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8ce0c293-bd69-47ec-9ba5-a9c0400daa47 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:25.806615 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8ce0c293-bd69-47ec-9ba5-a9c0400daa47 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:25.807160 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8ce0c293-bd69-47ec-9ba5-a9c0400daa47 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:25.807940 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8ce0c293-bd69-47ec-9ba5-a9c0400daa47 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:25.808477 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8ce0c293-bd69-47ec-9ba5-a9c0400daa47 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:25.808976 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8ce0c293-bd69-47ec-9ba5-a9c0400daa47 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:26.117679 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.network.neutron [None req-e63c9727-1a4e-49ed-8ba7-4c093d2e62c3 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] validate_networks() for [('98f0af7f-1102-474f-b030-4ac3340cfce6', None, None, None, None, None)] {{(pid=128758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 08:55:26.496303 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-8ce0c293-bd69-47ec-9ba5-a9c0400daa47 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:55:26.505457 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-8ce0c293-bd69-47ec-9ba5-a9c0400daa47 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/2098e0b9-b628-4b9e-979b-960c68830fee" status: 200 len: 1716 microversion: 2.1 time: 0.729061 Sep 14 08:55:26.508816 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 833/1703] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:55:25 2022] GET /compute/v2.1/servers/2098e0b9-b628-4b9e-979b-960c68830fee => generated 1716 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:55:26.721612 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-98879801-22fb-4f61-9328-415ab1568054 req-bf98eed5-31dc-444c-baee-bbcabee8fb4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8dd1623b-312c-411d-8f6c-b334195e573b", "name": "network-vif-plugged", "status": "completed", "tag": "558f9bbb-f694-40cf-b969-31f1db110da5"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:55:26.730091 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-e63c9727-1a4e-49ed-8ba7-4c093d2e62c3 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Flavor limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 08:55:26.730680 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-e63c9727-1a4e-49ed-8ba7-4c093d2e62c3 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Image limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 08:55:26.731070 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-e63c9727-1a4e-49ed-8ba7-4c093d2e62c3 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Flavor pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 08:55:26.731570 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-e63c9727-1a4e-49ed-8ba7-4c093d2e62c3 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Image pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 08:55:26.732170 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-e63c9727-1a4e-49ed-8ba7-4c093d2e62c3 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 08:55:26.748839 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-98879801-22fb-4f61-9328-415ab1568054 req-bf98eed5-31dc-444c-baee-bbcabee8fb4a service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:26.749221 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e63c9727-1a4e-49ed-8ba7-4c093d2e62c3 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:26.749371 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-98879801-22fb-4f61-9328-415ab1568054 req-bf98eed5-31dc-444c-baee-bbcabee8fb4a service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:26.749482 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e63c9727-1a4e-49ed-8ba7-4c093d2e62c3 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:26.749735 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-98879801-22fb-4f61-9328-415ab1568054 req-bf98eed5-31dc-444c-baee-bbcabee8fb4a service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:26.749902 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e63c9727-1a4e-49ed-8ba7-4c093d2e62c3 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:26.754722 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e63c9727-1a4e-49ed-8ba7-4c093d2e62c3 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:26.755359 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e63c9727-1a4e-49ed-8ba7-4c093d2e62c3 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:26.755735 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e63c9727-1a4e-49ed-8ba7-4c093d2e62c3 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:26.780077 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-98879801-22fb-4f61-9328-415ab1568054 req-bf98eed5-31dc-444c-baee-bbcabee8fb4a service nova] Creating event network-vif-plugged:558f9bbb-f694-40cf-b969-31f1db110da5 for instance 8dd1623b-312c-411d-8f6c-b334195e573b on n-h2-836830-18 Sep 14 08:55:26.791828 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-98879801-22fb-4f61-9328-415ab1568054 req-bf98eed5-31dc-444c-baee-bbcabee8fb4a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072179 Sep 14 08:55:26.792903 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 834/1704] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:55:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:55:26.799418 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-21e056c6-d6b3-4949-aa29-e397b2d6a5fb tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:55:26.802103 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-21e056c6-d6b3-4949-aa29-e397b2d6a5fb tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: bb621205-f7b7-4823-b3b9-fb903ac44b2a] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:55:26.807484 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-e63c9727-1a4e-49ed-8ba7-4c093d2e62c3 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Getting quotas for project e77c85f074ae4b8cb5a1457a5183197b. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 08:55:26.823989 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-e63c9727-1a4e-49ed-8ba7-4c093d2e62c3 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Getting quotas for user 72e1780ebcf1413fa4f7a9760b761c78 and project e77c85f074ae4b8cb5a1457a5183197b. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 08:55:26.838564 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-21e056c6-d6b3-4949-aa29-e397b2d6a5fb tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:26.840806 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-21e056c6-d6b3-4949-aa29-e397b2d6a5fb tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:26.841404 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-21e056c6-d6b3-4949-aa29-e397b2d6a5fb tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:26.844405 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-21e056c6-d6b3-4949-aa29-e397b2d6a5fb tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:26.847047 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-21e056c6-d6b3-4949-aa29-e397b2d6a5fb tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:26.847984 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-21e056c6-d6b3-4949-aa29-e397b2d6a5fb tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:26.856277 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-e63c9727-1a4e-49ed-8ba7-4c093d2e62c3 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Going to run 1 instances... {{(pid=128758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 08:55:26.864432 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-e63c9727-1a4e-49ed-8ba7-4c093d2e62c3 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] [instance: 0b54f1c2-0d9c-4396-8c79-1e43b612b2ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='061068b3-b54f-4beb-85bc-1b17e1c74d8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 08:55:26.963744 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-e63c9727-1a4e-49ed-8ba7-4c093d2e62c3 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.236343 Sep 14 08:55:26.964733 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 871/1705] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 08:55:25 2022] POST /compute/v2.1/servers => generated 406 bytes in 1238 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 08:55:26.978725 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-87a51135-914a-42f3-a67e-30fcaf718c5c tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:55:26.979701 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-87a51135-914a-42f3-a67e-30fcaf718c5c tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] [instance: 6ada18a6-f9cb-4bc9-800d-e0218adc4866] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:55:26.987835 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-87a51135-914a-42f3-a67e-30fcaf718c5c tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:26.988564 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-87a51135-914a-42f3-a67e-30fcaf718c5c tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:26.989176 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-87a51135-914a-42f3-a67e-30fcaf718c5c tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:26.990306 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-87a51135-914a-42f3-a67e-30fcaf718c5c tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:26.991063 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-87a51135-914a-42f3-a67e-30fcaf718c5c tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:26.991773 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-87a51135-914a-42f3-a67e-30fcaf718c5c tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:27.813549 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-87a51135-914a-42f3-a67e-30fcaf718c5c tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab2d64c1cb447f9bfd658408aa07e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ecc8c1389847c7bcd9cd5570d990e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:55:27.831283 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-87a51135-914a-42f3-a67e-30fcaf718c5c tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] 10.222.0.60 "GET /compute/v2.1/servers/6ada18a6-f9cb-4bc9-800d-e0218adc4866" status: 200 len: 1314 microversion: 2.1 time: 0.853567 Sep 14 08:55:27.833182 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 872/1706] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:55:26 2022] GET /compute/v2.1/servers/6ada18a6-f9cb-4bc9-800d-e0218adc4866 => generated 1314 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:55:27.841439 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c4634349-6c15-46a5-a81a-9b1f989c06d5 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:55:27.844936 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-c4634349-6c15-46a5-a81a-9b1f989c06d5 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] [instance: 0b54f1c2-0d9c-4396-8c79-1e43b612b2ba] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:55:27.861924 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c4634349-6c15-46a5-a81a-9b1f989c06d5 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:27.865009 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c4634349-6c15-46a5-a81a-9b1f989c06d5 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:27.867050 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c4634349-6c15-46a5-a81a-9b1f989c06d5 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:27.868817 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c4634349-6c15-46a5-a81a-9b1f989c06d5 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:27.869561 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c4634349-6c15-46a5-a81a-9b1f989c06d5 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:27.871423 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c4634349-6c15-46a5-a81a-9b1f989c06d5 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:27.898709 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-21e056c6-d6b3-4949-aa29-e397b2d6a5fb tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:55:27.914866 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-21e056c6-d6b3-4949-aa29-e397b2d6a5fb tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:55:27.916406 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-21e056c6-d6b3-4949-aa29-e397b2d6a5fb tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:55:27.927176 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-21e056c6-d6b3-4949-aa29-e397b2d6a5fb tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/bb621205-f7b7-4823-b3b9-fb903ac44b2a" status: 200 len: 1292 microversion: 2.25 time: 1.123373 Sep 14 08:55:27.941988 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 835/1707] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:55:26 2022] GET /compute/v2.1/servers/bb621205-f7b7-4823-b3b9-fb903ac44b2a => generated 1292 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:55:27.950629 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-b6906f06-66cf-4031-ab84-90430620d88a req-9746de4c-0c3c-4817-b46a-0ee0fa3580d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2098e0b9-b628-4b9e-979b-960c68830fee", "name": "network-vif-unplugged", "status": "completed", "tag": "a7cbc77d-b7b8-47d5-a1b4-d36705ecf7a0"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:55:27.998367 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-b6906f06-66cf-4031-ab84-90430620d88a req-9746de4c-0c3c-4817-b46a-0ee0fa3580d2 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:28.000836 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-b6906f06-66cf-4031-ab84-90430620d88a req-9746de4c-0c3c-4817-b46a-0ee0fa3580d2 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:28.001568 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-b6906f06-66cf-4031-ab84-90430620d88a req-9746de4c-0c3c-4817-b46a-0ee0fa3580d2 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:28.034342 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-b6906f06-66cf-4031-ab84-90430620d88a req-9746de4c-0c3c-4817-b46a-0ee0fa3580d2 service nova] Creating event network-vif-unplugged:a7cbc77d-b7b8-47d5-a1b4-d36705ecf7a0 for instance 2098e0b9-b628-4b9e-979b-960c68830fee on n-h1-836830-18 Sep 14 08:55:28.051736 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-b6906f06-66cf-4031-ab84-90430620d88a req-9746de4c-0c3c-4817-b46a-0ee0fa3580d2 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.104612 Sep 14 08:55:28.055563 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 836/1708] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:55:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:55:28.071651 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-1e05e2dd-2f82-477a-b5af-b9bda3f8403e tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:55:28.073291 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-1e05e2dd-2f82-477a-b5af-b9bda3f8403e tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: 2098e0b9-b628-4b9e-979b-960c68830fee] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:55:28.082031 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-c4634349-6c15-46a5-a81a-9b1f989c06d5 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e1780ebcf1413fa4f7a9760b761c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77c85f074ae4b8cb5a1457a5183197b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:55:28.085930 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=100 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:55:28.091521 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-c4634349-6c15-46a5-a81a-9b1f989c06d5 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] 10.222.0.60 "GET /compute/v2.1/servers/0b54f1c2-0d9c-4396-8c79-1e43b612b2ba" status: 200 len: 1249 microversion: 2.1 time: 0.257008 Sep 14 08:55:28.098268 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 873/1709] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:55:27 2022] GET /compute/v2.1/servers/0b54f1c2-0d9c-4396-8c79-1e43b612b2ba => generated 1249 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:55:28.103373 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=2 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:55:28.124770 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1e05e2dd-2f82-477a-b5af-b9bda3f8403e tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:28.125688 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1e05e2dd-2f82-477a-b5af-b9bda3f8403e tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:28.126368 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1e05e2dd-2f82-477a-b5af-b9bda3f8403e tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:28.127395 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1e05e2dd-2f82-477a-b5af-b9bda3f8403e tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:28.128100 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1e05e2dd-2f82-477a-b5af-b9bda3f8403e tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:28.128825 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1e05e2dd-2f82-477a-b5af-b9bda3f8403e tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:28.166763 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=100 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:55:28.451139 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-1e05e2dd-2f82-477a-b5af-b9bda3f8403e tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:55:28.468598 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-1e05e2dd-2f82-477a-b5af-b9bda3f8403e tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/2098e0b9-b628-4b9e-979b-960c68830fee" status: 200 len: 1716 microversion: 2.1 time: 0.408621 Sep 14 08:55:28.472703 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 837/1710] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:55:28 2022] GET /compute/v2.1/servers/2098e0b9-b628-4b9e-979b-960c68830fee => generated 1716 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:55:28.858871 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-7d49cad3-cb46-4177-a832-e17155a59abc tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:55:28.860274 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-7d49cad3-cb46-4177-a832-e17155a59abc tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] [instance: 6ada18a6-f9cb-4bc9-800d-e0218adc4866] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:55:28.889778 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7d49cad3-cb46-4177-a832-e17155a59abc tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:28.890560 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7d49cad3-cb46-4177-a832-e17155a59abc tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:28.891846 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7d49cad3-cb46-4177-a832-e17155a59abc tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:28.893379 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7d49cad3-cb46-4177-a832-e17155a59abc tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:28.894107 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7d49cad3-cb46-4177-a832-e17155a59abc tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:28.894853 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7d49cad3-cb46-4177-a832-e17155a59abc tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:28.971558 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-943968b3-16f0-48f6-89df-e5061ca7f0ba tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:55:28.972961 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-943968b3-16f0-48f6-89df-e5061ca7f0ba tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: bb621205-f7b7-4823-b3b9-fb903ac44b2a] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:55:28.986515 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-943968b3-16f0-48f6-89df-e5061ca7f0ba tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:28.988385 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-943968b3-16f0-48f6-89df-e5061ca7f0ba tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:28.989316 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-943968b3-16f0-48f6-89df-e5061ca7f0ba tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:28.991663 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-943968b3-16f0-48f6-89df-e5061ca7f0ba tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:28.992508 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-943968b3-16f0-48f6-89df-e5061ca7f0ba tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:28.993251 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-943968b3-16f0-48f6-89df-e5061ca7f0ba tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:29.365598 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-7d49cad3-cb46-4177-a832-e17155a59abc tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab2d64c1cb447f9bfd658408aa07e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ecc8c1389847c7bcd9cd5570d990e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:55:29.384410 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-7d49cad3-cb46-4177-a832-e17155a59abc tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] 10.222.0.60 "GET /compute/v2.1/servers/6ada18a6-f9cb-4bc9-800d-e0218adc4866" status: 200 len: 1314 microversion: 2.1 time: 0.529369 Sep 14 08:55:29.390641 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 874/1711] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:55:28 2022] GET /compute/v2.1/servers/6ada18a6-f9cb-4bc9-800d-e0218adc4866 => generated 1314 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:55:29.412658 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-49f17ee5-8950-4651-8411-b149459b0898 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:55:29.413304 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-49f17ee5-8950-4651-8411-b149459b0898 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] [instance: 0b54f1c2-0d9c-4396-8c79-1e43b612b2ba] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:55:29.427572 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-49f17ee5-8950-4651-8411-b149459b0898 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:29.429520 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-49f17ee5-8950-4651-8411-b149459b0898 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:29.431957 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-49f17ee5-8950-4651-8411-b149459b0898 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:29.433727 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-49f17ee5-8950-4651-8411-b149459b0898 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:29.434766 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-49f17ee5-8950-4651-8411-b149459b0898 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:29.436186 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-49f17ee5-8950-4651-8411-b149459b0898 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:29.462470 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-943968b3-16f0-48f6-89df-e5061ca7f0ba tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:55:29.475817 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-943968b3-16f0-48f6-89df-e5061ca7f0ba tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:55:29.488821 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-943968b3-16f0-48f6-89df-e5061ca7f0ba tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:55:29.494825 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-943968b3-16f0-48f6-89df-e5061ca7f0ba tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/bb621205-f7b7-4823-b3b9-fb903ac44b2a" status: 200 len: 1292 microversion: 2.25 time: 0.534489 Sep 14 08:55:29.501625 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 838/1712] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:55:28 2022] GET /compute/v2.1/servers/bb621205-f7b7-4823-b3b9-fb903ac44b2a => generated 1292 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:55:29.518773 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-356c5931-f455-4554-ae19-515efe81f71e tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:55:29.521409 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-356c5931-f455-4554-ae19-515efe81f71e tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: 2098e0b9-b628-4b9e-979b-960c68830fee] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:55:29.541395 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-356c5931-f455-4554-ae19-515efe81f71e tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:29.545489 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-356c5931-f455-4554-ae19-515efe81f71e tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:29.546346 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-356c5931-f455-4554-ae19-515efe81f71e tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:29.550028 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-356c5931-f455-4554-ae19-515efe81f71e tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:29.559096 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-356c5931-f455-4554-ae19-515efe81f71e tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:29.560129 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-356c5931-f455-4554-ae19-515efe81f71e tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:29.615651 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-49f17ee5-8950-4651-8411-b149459b0898 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e1780ebcf1413fa4f7a9760b761c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77c85f074ae4b8cb5a1457a5183197b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:55:29.628945 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-49f17ee5-8950-4651-8411-b149459b0898 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] 10.222.0.60 "GET /compute/v2.1/servers/0b54f1c2-0d9c-4396-8c79-1e43b612b2ba" status: 200 len: 1315 microversion: 2.1 time: 0.231102 Sep 14 08:55:29.640438 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 875/1713] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:55:29 2022] GET /compute/v2.1/servers/0b54f1c2-0d9c-4396-8c79-1e43b612b2ba => generated 1315 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:55:29.766982 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-356c5931-f455-4554-ae19-515efe81f71e tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:55:29.778003 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-356c5931-f455-4554-ae19-515efe81f71e tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/2098e0b9-b628-4b9e-979b-960c68830fee" status: 200 len: 1716 microversion: 2.1 time: 0.274507 Sep 14 08:55:29.778807 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 839/1714] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:55:29 2022] GET /compute/v2.1/servers/2098e0b9-b628-4b9e-979b-960c68830fee => generated 1716 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:55:30.089418 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-1517443e-e1d5-4d66-b446-bcb2011f571c req-8517abf0-d24a-43e4-910b-153f784eece9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2098e0b9-b628-4b9e-979b-960c68830fee", "tag": "a7cbc77d-b7b8-47d5-a1b4-d36705ecf7a0"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:55:30.106353 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-1517443e-e1d5-4d66-b446-bcb2011f571c req-8517abf0-d24a-43e4-910b-153f784eece9 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:30.106849 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-1517443e-e1d5-4d66-b446-bcb2011f571c req-8517abf0-d24a-43e4-910b-153f784eece9 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:30.107322 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-1517443e-e1d5-4d66-b446-bcb2011f571c req-8517abf0-d24a-43e4-910b-153f784eece9 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:30.120796 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-1517443e-e1d5-4d66-b446-bcb2011f571c req-8517abf0-d24a-43e4-910b-153f784eece9 service nova] Creating event network-changed:a7cbc77d-b7b8-47d5-a1b4-d36705ecf7a0 for instance 2098e0b9-b628-4b9e-979b-960c68830fee on n-h1-836830-18 Sep 14 08:55:30.127816 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-1517443e-e1d5-4d66-b446-bcb2011f571c req-8517abf0-d24a-43e4-910b-153f784eece9 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042572 Sep 14 08:55:30.130500 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 876/1715] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:55:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:55:30.412955 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9882f86b-a4fb-4213-b799-e35d0f5adc82 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:55:30.414279 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-9882f86b-a4fb-4213-b799-e35d0f5adc82 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] [instance: 6ada18a6-f9cb-4bc9-800d-e0218adc4866] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:55:30.426485 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-8f7b20ac-2047-4174-99dd-86a4d551e814 req-e3918730-880b-4021-957c-78eb51ec2ba2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ada18a6-f9cb-4bc9-800d-e0218adc4866", "name": "network-vif-plugged", "status": "completed", "tag": "bc272de6-30ab-4921-8e34-2d8757490726"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:55:30.428091 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9882f86b-a4fb-4213-b799-e35d0f5adc82 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:30.428960 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9882f86b-a4fb-4213-b799-e35d0f5adc82 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:30.429588 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9882f86b-a4fb-4213-b799-e35d0f5adc82 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:30.430904 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9882f86b-a4fb-4213-b799-e35d0f5adc82 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:30.433382 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9882f86b-a4fb-4213-b799-e35d0f5adc82 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:30.434002 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9882f86b-a4fb-4213-b799-e35d0f5adc82 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:30.451691 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-8f7b20ac-2047-4174-99dd-86a4d551e814 req-e3918730-880b-4021-957c-78eb51ec2ba2 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:30.452219 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-8f7b20ac-2047-4174-99dd-86a4d551e814 req-e3918730-880b-4021-957c-78eb51ec2ba2 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:30.459075 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-8f7b20ac-2047-4174-99dd-86a4d551e814 req-e3918730-880b-4021-957c-78eb51ec2ba2 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:30.490649 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-8f7b20ac-2047-4174-99dd-86a4d551e814 req-e3918730-880b-4021-957c-78eb51ec2ba2 service nova] Creating event network-vif-plugged:bc272de6-30ab-4921-8e34-2d8757490726 for instance 6ada18a6-f9cb-4bc9-800d-e0218adc4866 on n-h2-836830-18 Sep 14 08:55:30.506457 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-8f7b20ac-2047-4174-99dd-86a4d551e814 req-e3918730-880b-4021-957c-78eb51ec2ba2 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085687 Sep 14 08:55:30.508718 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 877/1716] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:55:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 08:55:30.529853 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1629764d-b2a0-460a-8e0e-c20491bfed8e tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:55:30.530796 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-1629764d-b2a0-460a-8e0e-c20491bfed8e tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: bb621205-f7b7-4823-b3b9-fb903ac44b2a] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:55:30.543839 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1629764d-b2a0-460a-8e0e-c20491bfed8e tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:30.544691 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1629764d-b2a0-460a-8e0e-c20491bfed8e tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:30.548047 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1629764d-b2a0-460a-8e0e-c20491bfed8e tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:30.549623 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1629764d-b2a0-460a-8e0e-c20491bfed8e tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:30.551662 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1629764d-b2a0-460a-8e0e-c20491bfed8e tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:30.561108 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1629764d-b2a0-460a-8e0e-c20491bfed8e tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:31.440097 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-9882f86b-a4fb-4213-b799-e35d0f5adc82 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab2d64c1cb447f9bfd658408aa07e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ecc8c1389847c7bcd9cd5570d990e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:55:31.465600 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-9882f86b-a4fb-4213-b799-e35d0f5adc82 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] 10.222.0.60 "GET /compute/v2.1/servers/6ada18a6-f9cb-4bc9-800d-e0218adc4866" status: 200 len: 1314 microversion: 2.1 time: 1.056561 Sep 14 08:55:31.466708 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 840/1717] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:55:30 2022] GET /compute/v2.1/servers/6ada18a6-f9cb-4bc9-800d-e0218adc4866 => generated 1314 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:55:31.481220 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f94ee8e9-6af9-4d07-863e-b2743fc64a8d tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:55:31.482091 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f94ee8e9-6af9-4d07-863e-b2743fc64a8d tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] [instance: 0b54f1c2-0d9c-4396-8c79-1e43b612b2ba] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:55:31.497349 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f94ee8e9-6af9-4d07-863e-b2743fc64a8d tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:31.498770 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f94ee8e9-6af9-4d07-863e-b2743fc64a8d tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:31.499945 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f94ee8e9-6af9-4d07-863e-b2743fc64a8d tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:31.501479 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f94ee8e9-6af9-4d07-863e-b2743fc64a8d tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:31.502214 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f94ee8e9-6af9-4d07-863e-b2743fc64a8d tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:31.503536 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f94ee8e9-6af9-4d07-863e-b2743fc64a8d tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:31.690262 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-1629764d-b2a0-460a-8e0e-c20491bfed8e tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:55:31.711671 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-1629764d-b2a0-460a-8e0e-c20491bfed8e tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:55:31.723263 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-1629764d-b2a0-460a-8e0e-c20491bfed8e tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:55:31.724590 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-1629764d-b2a0-460a-8e0e-c20491bfed8e tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/bb621205-f7b7-4823-b3b9-fb903ac44b2a" status: 200 len: 1280 microversion: 2.25 time: 1.200246 Sep 14 08:55:31.732971 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 878/1718] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:55:30 2022] GET /compute/v2.1/servers/bb621205-f7b7-4823-b3b9-fb903ac44b2a => generated 1280 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 08:55:31.768958 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-989a5a7f-6c05-4dd1-b5c0-5ad6e1b5638a tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:55:31.770903 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-989a5a7f-6c05-4dd1-b5c0-5ad6e1b5638a tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: 2098e0b9-b628-4b9e-979b-960c68830fee] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:55:31.806493 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-989a5a7f-6c05-4dd1-b5c0-5ad6e1b5638a tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:31.810588 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-989a5a7f-6c05-4dd1-b5c0-5ad6e1b5638a tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:31.812036 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-989a5a7f-6c05-4dd1-b5c0-5ad6e1b5638a tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:31.813392 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-989a5a7f-6c05-4dd1-b5c0-5ad6e1b5638a tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:31.824943 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-989a5a7f-6c05-4dd1-b5c0-5ad6e1b5638a tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:31.826871 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-989a5a7f-6c05-4dd1-b5c0-5ad6e1b5638a tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:31.910166 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f94ee8e9-6af9-4d07-863e-b2743fc64a8d tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e1780ebcf1413fa4f7a9760b761c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77c85f074ae4b8cb5a1457a5183197b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:55:31.925608 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f94ee8e9-6af9-4d07-863e-b2743fc64a8d tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] 10.222.0.60 "GET /compute/v2.1/servers/0b54f1c2-0d9c-4396-8c79-1e43b612b2ba" status: 200 len: 1303 microversion: 2.1 time: 0.457592 Sep 14 08:55:31.927919 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 841/1719] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:55:31 2022] GET /compute/v2.1/servers/0b54f1c2-0d9c-4396-8c79-1e43b612b2ba => generated 1303 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:55:32.494470 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a03400e9-650a-489a-9a63-a3d34ed2fa7b tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:55:32.496146 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-a03400e9-650a-489a-9a63-a3d34ed2fa7b tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] [instance: 6ada18a6-f9cb-4bc9-800d-e0218adc4866] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:55:32.506152 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a03400e9-650a-489a-9a63-a3d34ed2fa7b tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:32.507801 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a03400e9-650a-489a-9a63-a3d34ed2fa7b tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:32.509084 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a03400e9-650a-489a-9a63-a3d34ed2fa7b tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:32.510505 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a03400e9-650a-489a-9a63-a3d34ed2fa7b tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:32.511251 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a03400e9-650a-489a-9a63-a3d34ed2fa7b tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:32.511918 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a03400e9-650a-489a-9a63-a3d34ed2fa7b tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:33.511341 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-989a5a7f-6c05-4dd1-b5c0-5ad6e1b5638a tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:55:33.532161 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-a03400e9-650a-489a-9a63-a3d34ed2fa7b tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab2d64c1cb447f9bfd658408aa07e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ecc8c1389847c7bcd9cd5570d990e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:55:33.542042 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a03400e9-650a-489a-9a63-a3d34ed2fa7b tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] 10.222.0.60 "GET /compute/v2.1/servers/6ada18a6-f9cb-4bc9-800d-e0218adc4866" status: 200 len: 1314 microversion: 2.1 time: 1.052421 Sep 14 08:55:33.543633 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-989a5a7f-6c05-4dd1-b5c0-5ad6e1b5638a tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/2098e0b9-b628-4b9e-979b-960c68830fee" status: 200 len: 1716 microversion: 2.1 time: 1.809320 Sep 14 08:55:33.546475 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 879/1720] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:55:31 2022] GET /compute/v2.1/servers/2098e0b9-b628-4b9e-979b-960c68830fee => generated 1716 bytes in 1813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:55:33.557258 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 842/1721] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:55:32 2022] GET /compute/v2.1/servers/6ada18a6-f9cb-4bc9-800d-e0218adc4866 => generated 1314 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:55:33.578211 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c053a921-37af-4f10-a4a7-7f96d790e724 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:55:33.587333 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b32230bc-ee9b-4211-835f-066deb9a1e37 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:55:33.595709 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-c053a921-37af-4f10-a4a7-7f96d790e724 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: bb621205-f7b7-4823-b3b9-fb903ac44b2a] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:55:33.598989 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b32230bc-ee9b-4211-835f-066deb9a1e37 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] [instance: 0b54f1c2-0d9c-4396-8c79-1e43b612b2ba] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:55:33.608426 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c053a921-37af-4f10-a4a7-7f96d790e724 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:33.608922 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c053a921-37af-4f10-a4a7-7f96d790e724 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:33.609352 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c053a921-37af-4f10-a4a7-7f96d790e724 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:33.613271 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b32230bc-ee9b-4211-835f-066deb9a1e37 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:33.629633 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b32230bc-ee9b-4211-835f-066deb9a1e37 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:33.630356 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b32230bc-ee9b-4211-835f-066deb9a1e37 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:33.630568 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c053a921-37af-4f10-a4a7-7f96d790e724 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:33.632047 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b32230bc-ee9b-4211-835f-066deb9a1e37 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:33.632397 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c053a921-37af-4f10-a4a7-7f96d790e724 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:33.633770 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c053a921-37af-4f10-a4a7-7f96d790e724 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:33.634394 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b32230bc-ee9b-4211-835f-066deb9a1e37 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:33.639392 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b32230bc-ee9b-4211-835f-066deb9a1e37 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:34.339288 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b32230bc-ee9b-4211-835f-066deb9a1e37 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e1780ebcf1413fa4f7a9760b761c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77c85f074ae4b8cb5a1457a5183197b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:55:34.355600 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b32230bc-ee9b-4211-835f-066deb9a1e37 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] 10.222.0.60 "GET /compute/v2.1/servers/0b54f1c2-0d9c-4396-8c79-1e43b612b2ba" status: 200 len: 1303 microversion: 2.1 time: 0.794127 Sep 14 08:55:34.359393 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 843/1722] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:55:33 2022] GET /compute/v2.1/servers/0b54f1c2-0d9c-4396-8c79-1e43b612b2ba => generated 1303 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:55:34.580297 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-65c56f65-35bf-4277-aa98-ac4f0108990f tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:55:34.581800 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-65c56f65-35bf-4277-aa98-ac4f0108990f tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: 2098e0b9-b628-4b9e-979b-960c68830fee] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:55:34.600251 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-65c56f65-35bf-4277-aa98-ac4f0108990f tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:34.604570 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-65c56f65-35bf-4277-aa98-ac4f0108990f tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:34.605888 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-65c56f65-35bf-4277-aa98-ac4f0108990f tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:34.608961 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-65c56f65-35bf-4277-aa98-ac4f0108990f tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:34.613221 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-65c56f65-35bf-4277-aa98-ac4f0108990f tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:34.613960 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-65c56f65-35bf-4277-aa98-ac4f0108990f tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:35.142376 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-c053a921-37af-4f10-a4a7-7f96d790e724 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:55:35.151706 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-c053a921-37af-4f10-a4a7-7f96d790e724 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:55:35.153206 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-c053a921-37af-4f10-a4a7-7f96d790e724 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:55:35.154361 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-c053a921-37af-4f10-a4a7-7f96d790e724 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/bb621205-f7b7-4823-b3b9-fb903ac44b2a" status: 200 len: 1280 microversion: 2.25 time: 1.598076 Sep 14 08:55:35.154984 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 880/1723] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:55:33 2022] GET /compute/v2.1/servers/bb621205-f7b7-4823-b3b9-fb903ac44b2a => generated 1280 bytes in 1599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:55:35.212479 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-5f3eea90-4d86-4484-a1f8-bf51bcaa410f tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:55:35.213395 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-5f3eea90-4d86-4484-a1f8-bf51bcaa410f tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] [instance: 6ada18a6-f9cb-4bc9-800d-e0218adc4866] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:55:35.233546 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5f3eea90-4d86-4484-a1f8-bf51bcaa410f tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:35.234074 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5f3eea90-4d86-4484-a1f8-bf51bcaa410f tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:35.235106 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5f3eea90-4d86-4484-a1f8-bf51bcaa410f tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:35.240034 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5f3eea90-4d86-4484-a1f8-bf51bcaa410f tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:35.240769 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5f3eea90-4d86-4484-a1f8-bf51bcaa410f tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:35.247318 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5f3eea90-4d86-4484-a1f8-bf51bcaa410f tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:35.909806 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-65c56f65-35bf-4277-aa98-ac4f0108990f tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:55:35.926523 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-65c56f65-35bf-4277-aa98-ac4f0108990f tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/2098e0b9-b628-4b9e-979b-960c68830fee" status: 200 len: 1716 microversion: 2.1 time: 1.352797 Sep 14 08:55:35.930725 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 844/1724] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:55:34 2022] GET /compute/v2.1/servers/2098e0b9-b628-4b9e-979b-960c68830fee => generated 1716 bytes in 1358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:55:35.947086 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9d4f3c7d-dc58-47c4-88f7-9e8c6f9c735f tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:55:35.952830 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-9d4f3c7d-dc58-47c4-88f7-9e8c6f9c735f tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] [instance: 0b54f1c2-0d9c-4396-8c79-1e43b612b2ba] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:55:35.976046 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9d4f3c7d-dc58-47c4-88f7-9e8c6f9c735f tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:35.977605 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9d4f3c7d-dc58-47c4-88f7-9e8c6f9c735f tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:35.980527 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9d4f3c7d-dc58-47c4-88f7-9e8c6f9c735f tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:35.986932 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9d4f3c7d-dc58-47c4-88f7-9e8c6f9c735f tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:35.987735 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9d4f3c7d-dc58-47c4-88f7-9e8c6f9c735f tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:35.988377 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9d4f3c7d-dc58-47c4-88f7-9e8c6f9c735f tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:36.058736 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-5f3eea90-4d86-4484-a1f8-bf51bcaa410f tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab2d64c1cb447f9bfd658408aa07e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ecc8c1389847c7bcd9cd5570d990e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:55:36.070314 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-5f3eea90-4d86-4484-a1f8-bf51bcaa410f tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] 10.222.0.60 "GET /compute/v2.1/servers/6ada18a6-f9cb-4bc9-800d-e0218adc4866" status: 200 len: 1464 microversion: 2.1 time: 0.880332 Sep 14 08:55:36.073675 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 881/1725] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:55:35 2022] GET /compute/v2.1/servers/6ada18a6-f9cb-4bc9-800d-e0218adc4866 => generated 1464 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:55:36.110505 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1edb7787-34a2-44ad-b6c9-114b958cfc51 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:55:36.136355 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-1edb7787-34a2-44ad-b6c9-114b958cfc51 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5040fc9212814c4fa9e038116578eebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a963df1b646f1918426fe1a7cb23c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:55:36.137256 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-1edb7787-34a2-44ad-b6c9-114b958cfc51 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Searching by: {'deleted': False, 'project_id': '659a963df1b646f1918426fe1a7cb23c'} {{(pid=128758) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 14 08:55:36.176333 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1edb7787-34a2-44ad-b6c9-114b958cfc51 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:36.177022 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1edb7787-34a2-44ad-b6c9-114b958cfc51 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:36.177273 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1edb7787-34a2-44ad-b6c9-114b958cfc51 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:36.180834 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1edb7787-34a2-44ad-b6c9-114b958cfc51 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:36.181360 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1edb7787-34a2-44ad-b6c9-114b958cfc51 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:36.183636 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1edb7787-34a2-44ad-b6c9-114b958cfc51 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:36.283011 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.multi_cell_list [None req-1edb7787-34a2-44ad-b6c9-114b958cfc51 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128758) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 14 08:55:36.367208 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-1edb7787-34a2-44ad-b6c9-114b958cfc51 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] 10.222.0.60 "GET /compute/v2.1/servers" status: 200 len: 334 microversion: 2.1 time: 0.292668 Sep 14 08:55:36.370071 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 882/1726] 10.222.0.60 () {58 vars in 1125 bytes} [Wed Sep 14 08:55:36 2022] GET /compute/v2.1/servers => generated 334 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:55:36.393685 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-6fda025c-c4a0-4e80-8972-41669197b3c1 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:55:36.395509 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-6fda025c-c4a0-4e80-8972-41669197b3c1 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] [instance: 8dd1623b-312c-411d-8f6c-b334195e573b] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:55:36.408865 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6fda025c-c4a0-4e80-8972-41669197b3c1 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:36.412842 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6fda025c-c4a0-4e80-8972-41669197b3c1 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:36.420541 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6fda025c-c4a0-4e80-8972-41669197b3c1 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:36.424673 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6fda025c-c4a0-4e80-8972-41669197b3c1 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:36.425404 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6fda025c-c4a0-4e80-8972-41669197b3c1 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:36.426022 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6fda025c-c4a0-4e80-8972-41669197b3c1 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:36.840198 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=16 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:55:36.849822 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-9d4f3c7d-dc58-47c4-88f7-9e8c6f9c735f tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e1780ebcf1413fa4f7a9760b761c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77c85f074ae4b8cb5a1457a5183197b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:55:36.863367 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-9d4f3c7d-dc58-47c4-88f7-9e8c6f9c735f tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] 10.222.0.60 "GET /compute/v2.1/servers/0b54f1c2-0d9c-4396-8c79-1e43b612b2ba" status: 200 len: 1371 microversion: 2.1 time: 0.926690 Sep 14 08:55:36.864064 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 845/1727] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:55:35 2022] GET /compute/v2.1/servers/0b54f1c2-0d9c-4396-8c79-1e43b612b2ba => generated 1371 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:55:36.881545 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a94199fa-c9bb-493a-a31c-bcd0ac4adf51 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:55:36.882455 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-a94199fa-c9bb-493a-a31c-bcd0ac4adf51 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: bb621205-f7b7-4823-b3b9-fb903ac44b2a] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:55:36.897926 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a94199fa-c9bb-493a-a31c-bcd0ac4adf51 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:36.901571 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a94199fa-c9bb-493a-a31c-bcd0ac4adf51 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:36.902233 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a94199fa-c9bb-493a-a31c-bcd0ac4adf51 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:36.903173 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a94199fa-c9bb-493a-a31c-bcd0ac4adf51 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:36.907030 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a94199fa-c9bb-493a-a31c-bcd0ac4adf51 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:36.907700 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a94199fa-c9bb-493a-a31c-bcd0ac4adf51 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:37.307095 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-6fda025c-c4a0-4e80-8972-41669197b3c1 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab2d64c1cb447f9bfd658408aa07e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ecc8c1389847c7bcd9cd5570d990e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:55:37.333117 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-6fda025c-c4a0-4e80-8972-41669197b3c1 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] 10.222.0.60 "GET /compute/v2.1/servers/8dd1623b-312c-411d-8f6c-b334195e573b" status: 200 len: 1464 microversion: 2.1 time: 0.961667 Sep 14 08:55:37.374423 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 883/1728] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:55:36 2022] GET /compute/v2.1/servers/8dd1623b-312c-411d-8f6c-b334195e573b => generated 1464 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:55:37.397848 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-872650f4-5a3a-46c3-ab88-1ee7d14e7b28 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:55:37.406291 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-872650f4-5a3a-46c3-ab88-1ee7d14e7b28 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5040fc9212814c4fa9e038116578eebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a963df1b646f1918426fe1a7cb23c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:55:37.407641 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-872650f4-5a3a-46c3-ab88-1ee7d14e7b28 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Searching by: {'deleted': False, 'project_id': '659a963df1b646f1918426fe1a7cb23c'} {{(pid=128758) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 14 08:55:37.415271 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-872650f4-5a3a-46c3-ab88-1ee7d14e7b28 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:37.417363 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-872650f4-5a3a-46c3-ab88-1ee7d14e7b28 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:37.417824 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-872650f4-5a3a-46c3-ab88-1ee7d14e7b28 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:37.418670 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-872650f4-5a3a-46c3-ab88-1ee7d14e7b28 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:37.419168 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-872650f4-5a3a-46c3-ab88-1ee7d14e7b28 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:37.420051 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-872650f4-5a3a-46c3-ab88-1ee7d14e7b28 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:37.466913 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.multi_cell_list [None req-872650f4-5a3a-46c3-ab88-1ee7d14e7b28 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128758) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 14 08:55:37.491343 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-a94199fa-c9bb-493a-a31c-bcd0ac4adf51 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:55:37.509317 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-a94199fa-c9bb-493a-a31c-bcd0ac4adf51 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:55:37.520279 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-a94199fa-c9bb-493a-a31c-bcd0ac4adf51 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:55:37.526468 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a94199fa-c9bb-493a-a31c-bcd0ac4adf51 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/bb621205-f7b7-4823-b3b9-fb903ac44b2a" status: 200 len: 1280 microversion: 2.25 time: 0.656926 Sep 14 08:55:37.530461 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 846/1729] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:55:36 2022] GET /compute/v2.1/servers/bb621205-f7b7-4823-b3b9-fb903ac44b2a => generated 1280 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:55:37.542778 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9d33a428-349e-49df-939e-a9d0dcbc0eb1 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:55:37.545795 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-9d33a428-349e-49df-939e-a9d0dcbc0eb1 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: 2098e0b9-b628-4b9e-979b-960c68830fee] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:55:37.575205 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9d33a428-349e-49df-939e-a9d0dcbc0eb1 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:37.580567 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9d33a428-349e-49df-939e-a9d0dcbc0eb1 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:37.582514 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9d33a428-349e-49df-939e-a9d0dcbc0eb1 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:37.587343 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9d33a428-349e-49df-939e-a9d0dcbc0eb1 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:37.591445 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9d33a428-349e-49df-939e-a9d0dcbc0eb1 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:37.592125 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9d33a428-349e-49df-939e-a9d0dcbc0eb1 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:37.635619 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-872650f4-5a3a-46c3-ab88-1ee7d14e7b28 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5040fc9212814c4fa9e038116578eebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a963df1b646f1918426fe1a7cb23c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:55:37.653077 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-872650f4-5a3a-46c3-ab88-1ee7d14e7b28 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:37.653783 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-872650f4-5a3a-46c3-ab88-1ee7d14e7b28 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:37.654394 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-872650f4-5a3a-46c3-ab88-1ee7d14e7b28 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:37.900798 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-872650f4-5a3a-46c3-ab88-1ee7d14e7b28 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] 10.222.0.60 "GET /compute/v2.1/servers/detail" status: 200 len: 1698 microversion: 2.1 time: 0.523823 Sep 14 08:55:37.901464 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 884/1730] 10.222.0.60 () {58 vars in 1146 bytes} [Wed Sep 14 08:55:37 2022] GET /compute/v2.1/servers/detail => generated 1698 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:55:37.907374 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c63d7655-bc91-4441-a35f-c7dc5d9fab53 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-435558198", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "8dd1623b-312c-411d-8f6c-b334195e573b"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:55:37.980093 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-9d33a428-349e-49df-939e-a9d0dcbc0eb1 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:55:37.997268 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-9d33a428-349e-49df-939e-a9d0dcbc0eb1 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/2098e0b9-b628-4b9e-979b-960c68830fee" status: 200 len: 1716 microversion: 2.1 time: 0.462930 Sep 14 08:55:38.019400 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.network.neutron [None req-c63d7655-bc91-4441-a35f-c7dc5d9fab53 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] validate_networks() for None {{(pid=128758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 08:55:38.020290 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 847/1731] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:55:37 2022] GET /compute/v2.1/servers/2098e0b9-b628-4b9e-979b-960c68830fee => generated 1716 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:55:38.035692 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-7654ca7e-f844-49d8-a2c1-45ba360f10f8 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:55:38.049191 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-7654ca7e-f844-49d8-a2c1-45ba360f10f8 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] [instance: 0b54f1c2-0d9c-4396-8c79-1e43b612b2ba] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:55:38.068292 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7654ca7e-f844-49d8-a2c1-45ba360f10f8 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:38.069078 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7654ca7e-f844-49d8-a2c1-45ba360f10f8 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:38.070446 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7654ca7e-f844-49d8-a2c1-45ba360f10f8 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:38.071432 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7654ca7e-f844-49d8-a2c1-45ba360f10f8 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:38.073521 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7654ca7e-f844-49d8-a2c1-45ba360f10f8 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:38.087560 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7654ca7e-f844-49d8-a2c1-45ba360f10f8 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:39.046604 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-c63d7655-bc91-4441-a35f-c7dc5d9fab53 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Flavor limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 08:55:39.048270 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-c63d7655-bc91-4441-a35f-c7dc5d9fab53 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Image limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 08:55:39.049123 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-c63d7655-bc91-4441-a35f-c7dc5d9fab53 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Flavor pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 08:55:39.049788 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-c63d7655-bc91-4441-a35f-c7dc5d9fab53 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Image pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 08:55:39.050501 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-c63d7655-bc91-4441-a35f-c7dc5d9fab53 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 08:55:39.072458 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c63d7655-bc91-4441-a35f-c7dc5d9fab53 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:39.072947 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c63d7655-bc91-4441-a35f-c7dc5d9fab53 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:39.073678 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c63d7655-bc91-4441-a35f-c7dc5d9fab53 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:39.074586 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c63d7655-bc91-4441-a35f-c7dc5d9fab53 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:39.075285 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c63d7655-bc91-4441-a35f-c7dc5d9fab53 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:39.075927 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c63d7655-bc91-4441-a35f-c7dc5d9fab53 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:39.094770 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-7654ca7e-f844-49d8-a2c1-45ba360f10f8 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e1780ebcf1413fa4f7a9760b761c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77c85f074ae4b8cb5a1457a5183197b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:55:39.111532 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-7654ca7e-f844-49d8-a2c1-45ba360f10f8 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] 10.222.0.60 "GET /compute/v2.1/servers/0b54f1c2-0d9c-4396-8c79-1e43b612b2ba" status: 200 len: 1371 microversion: 2.1 time: 1.087299 Sep 14 08:55:39.124575 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-c63d7655-bc91-4441-a35f-c7dc5d9fab53 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Getting quotas for project 51ecc8c1389847c7bcd9cd5570d990e8. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 08:55:39.132038 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 848/1732] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:55:38 2022] GET /compute/v2.1/servers/0b54f1c2-0d9c-4396-8c79-1e43b612b2ba => generated 1371 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:55:39.139611 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-5df9a08d-2105-4de4-8a1a-04f1eb021d4b tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:55:39.145005 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-c63d7655-bc91-4441-a35f-c7dc5d9fab53 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Getting quotas for user 0ab2d64c1cb447f9bfd658408aa07e06 and project 51ecc8c1389847c7bcd9cd5570d990e8. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 08:55:39.153472 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-5df9a08d-2105-4de4-8a1a-04f1eb021d4b tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] 10.222.0.60 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.018643 Sep 14 08:55:39.154761 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 849/1733] 10.222.0.60 () {58 vars in 1137 bytes} [Wed Sep 14 08:55:39 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:55:39.160711 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-45a1c5ca-6758-4ffe-aa31-bd9cb2070c1e tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:55:39.161673 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-45a1c5ca-6758-4ffe-aa31-bd9cb2070c1e tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: bb621205-f7b7-4823-b3b9-fb903ac44b2a] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:55:39.170147 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=82,nova_api:DELETE=3 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:55:39.172916 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-45a1c5ca-6758-4ffe-aa31-bd9cb2070c1e tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:39.173670 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-45a1c5ca-6758-4ffe-aa31-bd9cb2070c1e tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:39.174438 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-45a1c5ca-6758-4ffe-aa31-bd9cb2070c1e tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:39.175555 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-45a1c5ca-6758-4ffe-aa31-bd9cb2070c1e tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:39.176330 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-45a1c5ca-6758-4ffe-aa31-bd9cb2070c1e tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:39.177162 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-45a1c5ca-6758-4ffe-aa31-bd9cb2070c1e tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:39.184050 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-c63d7655-bc91-4441-a35f-c7dc5d9fab53 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Going to run 1 instances... {{(pid=128758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 08:55:39.186848 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-c63d7655-bc91-4441-a35f-c7dc5d9fab53 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] [instance: e7aa796a-60a2-4d5c-a03c-b4ad0ea73811] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 08:55:39.398849 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-c63d7655-bc91-4441-a35f-c7dc5d9fab53 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.479645 Sep 14 08:55:39.400273 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 885/1734] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 08:55:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1498 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 08:55:39.411255 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-7413c036-e4cd-4ad9-9066-509b36c57b9e tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:55:39.419752 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-7413c036-e4cd-4ad9-9066-509b36c57b9e tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: 2098e0b9-b628-4b9e-979b-960c68830fee] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:55:39.436731 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7413c036-e4cd-4ad9-9066-509b36c57b9e tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:39.442586 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7413c036-e4cd-4ad9-9066-509b36c57b9e tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:39.444168 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7413c036-e4cd-4ad9-9066-509b36c57b9e tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:39.450075 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7413c036-e4cd-4ad9-9066-509b36c57b9e tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:39.458383 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7413c036-e4cd-4ad9-9066-509b36c57b9e tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:39.460022 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7413c036-e4cd-4ad9-9066-509b36c57b9e tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:40.332416 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-45a1c5ca-6758-4ffe-aa31-bd9cb2070c1e tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:55:40.348588 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-45a1c5ca-6758-4ffe-aa31-bd9cb2070c1e tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:55:40.352650 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-45a1c5ca-6758-4ffe-aa31-bd9cb2070c1e tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:55:40.366039 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-45a1c5ca-6758-4ffe-aa31-bd9cb2070c1e tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/bb621205-f7b7-4823-b3b9-fb903ac44b2a" status: 200 len: 1280 microversion: 2.25 time: 1.209947 Sep 14 08:55:40.373497 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 850/1735] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:55:39 2022] GET /compute/v2.1/servers/bb621205-f7b7-4823-b3b9-fb903ac44b2a => generated 1280 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:55:40.396781 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9c64f524-7612-4c13-8253-98873ae5f06e tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:55:40.401209 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-9c64f524-7612-4c13-8253-98873ae5f06e tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] [instance: e7aa796a-60a2-4d5c-a03c-b4ad0ea73811] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:55:42.337422 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-9c64f524-7612-4c13-8253-98873ae5f06e tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab2d64c1cb447f9bfd658408aa07e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ecc8c1389847c7bcd9cd5570d990e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:55:42.358604 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-9c64f524-7612-4c13-8253-98873ae5f06e tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] 10.222.0.60 "GET /compute/v2.1/servers/e7aa796a-60a2-4d5c-a03c-b4ad0ea73811" status: 200 len: 1213 microversion: 2.1 time: 1.982271 Sep 14 08:55:42.365800 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 851/1736] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:55:40 2022] GET /compute/v2.1/servers/e7aa796a-60a2-4d5c-a03c-b4ad0ea73811 => generated 1213 bytes in 1990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:55:42.371099 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9e8bb751-c105-4cea-90e9-4b2ce4adacda tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:55:42.376396 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-9e8bb751-c105-4cea-90e9-4b2ce4adacda tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] [instance: a4474e04-7712-41de-bbf8-a872101a9808] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:55:42.398598 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9e8bb751-c105-4cea-90e9-4b2ce4adacda tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:42.403467 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9e8bb751-c105-4cea-90e9-4b2ce4adacda tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:42.404102 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9e8bb751-c105-4cea-90e9-4b2ce4adacda tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:42.405024 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9e8bb751-c105-4cea-90e9-4b2ce4adacda tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:42.406846 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9e8bb751-c105-4cea-90e9-4b2ce4adacda tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:42.416699 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9e8bb751-c105-4cea-90e9-4b2ce4adacda tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:42.526417 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-9e8bb751-c105-4cea-90e9-4b2ce4adacda tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] [instance: a4474e04-7712-41de-bbf8-a872101a9808] Going to try to terminate instance {{(pid=128759) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 08:55:42.664766 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-7413c036-e4cd-4ad9-9066-509b36c57b9e tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:55:42.698910 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-7413c036-e4cd-4ad9-9066-509b36c57b9e tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/2098e0b9-b628-4b9e-979b-960c68830fee" status: 200 len: 1716 microversion: 2.1 time: 3.295028 Sep 14 08:55:42.699744 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 886/1737] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:55:39 2022] GET /compute/v2.1/servers/2098e0b9-b628-4b9e-979b-960c68830fee => generated 1716 bytes in 3299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:55:42.732116 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-abc3e272-07b9-42a7-a2c4-ec147d1be01a tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:55:42.732751 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-abc3e272-07b9-42a7-a2c4-ec147d1be01a tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] [instance: 0b54f1c2-0d9c-4396-8c79-1e43b612b2ba] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:55:42.782478 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-abc3e272-07b9-42a7-a2c4-ec147d1be01a tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:42.782931 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-abc3e272-07b9-42a7-a2c4-ec147d1be01a tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:42.783595 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-abc3e272-07b9-42a7-a2c4-ec147d1be01a tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:42.784563 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-abc3e272-07b9-42a7-a2c4-ec147d1be01a tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:42.785217 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-abc3e272-07b9-42a7-a2c4-ec147d1be01a tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:42.786158 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-abc3e272-07b9-42a7-a2c4-ec147d1be01a tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:42.861905 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-9e8bb751-c105-4cea-90e9-4b2ce4adacda tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] 10.222.0.60 "DELETE /compute/v2.1/servers/a4474e04-7712-41de-bbf8-a872101a9808" status: 204 len: 0 microversion: 2.1 time: 0.494412 Sep 14 08:55:42.863035 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 852/1738] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 08:55:42 2022] DELETE /compute/v2.1/servers/a4474e04-7712-41de-bbf8-a872101a9808 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 08:55:42.871722 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-32d35753-8d5b-4a6d-8ccd-69688978f915 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:55:42.872746 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-32d35753-8d5b-4a6d-8ccd-69688978f915 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: bb621205-f7b7-4823-b3b9-fb903ac44b2a] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:55:42.881706 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-32d35753-8d5b-4a6d-8ccd-69688978f915 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:42.882508 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-32d35753-8d5b-4a6d-8ccd-69688978f915 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:42.883173 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-32d35753-8d5b-4a6d-8ccd-69688978f915 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:42.884502 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-32d35753-8d5b-4a6d-8ccd-69688978f915 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:42.885315 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-32d35753-8d5b-4a6d-8ccd-69688978f915 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:42.885932 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-32d35753-8d5b-4a6d-8ccd-69688978f915 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:43.876085 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-abc3e272-07b9-42a7-a2c4-ec147d1be01a tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e1780ebcf1413fa4f7a9760b761c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77c85f074ae4b8cb5a1457a5183197b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:55:43.889868 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-abc3e272-07b9-42a7-a2c4-ec147d1be01a tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] 10.222.0.60 "GET /compute/v2.1/servers/0b54f1c2-0d9c-4396-8c79-1e43b612b2ba" status: 200 len: 1371 microversion: 2.1 time: 1.164484 Sep 14 08:55:43.906971 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 887/1739] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:55:42 2022] GET /compute/v2.1/servers/0b54f1c2-0d9c-4396-8c79-1e43b612b2ba => generated 1371 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:55:43.917124 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-89f43c05-3a09-4017-85cf-89822180ff3a tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:55:43.920541 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-89f43c05-3a09-4017-85cf-89822180ff3a tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] [instance: a4474e04-7712-41de-bbf8-a872101a9808] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:55:43.935220 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:55:43.970330 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-89f43c05-3a09-4017-85cf-89822180ff3a tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:43.970905 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-89f43c05-3a09-4017-85cf-89822180ff3a tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:43.986242 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-89f43c05-3a09-4017-85cf-89822180ff3a tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:43.987485 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-89f43c05-3a09-4017-85cf-89822180ff3a tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:43.988260 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-89f43c05-3a09-4017-85cf-89822180ff3a tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:43.988912 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-89f43c05-3a09-4017-85cf-89822180ff3a tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:44.075877 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-32d35753-8d5b-4a6d-8ccd-69688978f915 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:55:44.103051 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-32d35753-8d5b-4a6d-8ccd-69688978f915 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:55:44.104984 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-32d35753-8d5b-4a6d-8ccd-69688978f915 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:55:44.109517 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-32d35753-8d5b-4a6d-8ccd-69688978f915 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/bb621205-f7b7-4823-b3b9-fb903ac44b2a" status: 200 len: 1280 microversion: 2.25 time: 1.244283 Sep 14 08:55:44.117568 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 853/1740] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:55:42 2022] GET /compute/v2.1/servers/bb621205-f7b7-4823-b3b9-fb903ac44b2a => generated 1280 bytes in 1254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:55:44.126260 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c3ef274f-9347-46fd-8d9d-9ca84238d0b4 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:55:44.132588 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-c3ef274f-9347-46fd-8d9d-9ca84238d0b4 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] [instance: e7aa796a-60a2-4d5c-a03c-b4ad0ea73811] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:55:44.161549 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c3ef274f-9347-46fd-8d9d-9ca84238d0b4 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:44.162419 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c3ef274f-9347-46fd-8d9d-9ca84238d0b4 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:44.163178 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c3ef274f-9347-46fd-8d9d-9ca84238d0b4 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:44.164972 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c3ef274f-9347-46fd-8d9d-9ca84238d0b4 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:44.165657 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c3ef274f-9347-46fd-8d9d-9ca84238d0b4 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:44.166292 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c3ef274f-9347-46fd-8d9d-9ca84238d0b4 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:44.240355 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:55:45.039012 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-c3ef274f-9347-46fd-8d9d-9ca84238d0b4 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab2d64c1cb447f9bfd658408aa07e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ecc8c1389847c7bcd9cd5570d990e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:55:45.049157 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-c3ef274f-9347-46fd-8d9d-9ca84238d0b4 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] 10.222.0.60 "GET /compute/v2.1/servers/e7aa796a-60a2-4d5c-a03c-b4ad0ea73811" status: 200 len: 1271 microversion: 2.1 time: 0.929559 Sep 14 08:55:45.053896 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 854/1741] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:55:44 2022] GET /compute/v2.1/servers/e7aa796a-60a2-4d5c-a03c-b4ad0ea73811 => generated 1271 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:55:45.065523 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-40fbb330-4444-4d11-a7ba-63bae7516414 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:55:45.066256 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-40fbb330-4444-4d11-a7ba-63bae7516414 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: 2098e0b9-b628-4b9e-979b-960c68830fee] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:55:45.085779 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-40fbb330-4444-4d11-a7ba-63bae7516414 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:45.087176 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-40fbb330-4444-4d11-a7ba-63bae7516414 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:45.087880 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-40fbb330-4444-4d11-a7ba-63bae7516414 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:45.088849 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-40fbb330-4444-4d11-a7ba-63bae7516414 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:45.089541 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-40fbb330-4444-4d11-a7ba-63bae7516414 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:45.090203 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-40fbb330-4444-4d11-a7ba-63bae7516414 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:45.144266 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-89f43c05-3a09-4017-85cf-89822180ff3a tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5040fc9212814c4fa9e038116578eebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a963df1b646f1918426fe1a7cb23c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:55:45.152360 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-89f43c05-3a09-4017-85cf-89822180ff3a tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] 10.222.0.60 "GET /compute/v2.1/servers/a4474e04-7712-41de-bbf8-a872101a9808" status: 200 len: 1701 microversion: 2.1 time: 1.256103 Sep 14 08:55:45.159537 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 888/1742] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:55:43 2022] GET /compute/v2.1/servers/a4474e04-7712-41de-bbf8-a872101a9808 => generated 1701 bytes in 1264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:55:45.165516 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-ddb79657-28e1-4d9c-961b-dc33d0bd7f5c req-7a322515-cd61-40cd-9862-09d87e21548e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb621205-f7b7-4823-b3b9-fb903ac44b2a", "name": "network-vif-plugged", "status": "completed", "tag": "977f076f-2424-4d11-aa54-073389c5051f"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:55:45.197464 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-ddb79657-28e1-4d9c-961b-dc33d0bd7f5c req-7a322515-cd61-40cd-9862-09d87e21548e service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:45.209587 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-ddb79657-28e1-4d9c-961b-dc33d0bd7f5c req-7a322515-cd61-40cd-9862-09d87e21548e service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:45.210235 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-ddb79657-28e1-4d9c-961b-dc33d0bd7f5c req-7a322515-cd61-40cd-9862-09d87e21548e service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:45.245503 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-ddb79657-28e1-4d9c-961b-dc33d0bd7f5c req-7a322515-cd61-40cd-9862-09d87e21548e service nova] Creating event network-vif-plugged:977f076f-2424-4d11-aa54-073389c5051f for instance bb621205-f7b7-4823-b3b9-fb903ac44b2a on n-h1-836830-18 Sep 14 08:55:45.256791 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-ddb79657-28e1-4d9c-961b-dc33d0bd7f5c req-7a322515-cd61-40cd-9862-09d87e21548e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094707 Sep 14 08:55:45.266230 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 889/1743] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:55:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:55:45.282496 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-7af0d7ce-4c10-4829-92b5-079328835b8d tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:55:45.289180 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-7af0d7ce-4c10-4829-92b5-079328835b8d tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] [instance: 0b54f1c2-0d9c-4396-8c79-1e43b612b2ba] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:55:45.305392 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7af0d7ce-4c10-4829-92b5-079328835b8d tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:45.310288 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7af0d7ce-4c10-4829-92b5-079328835b8d tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:45.310899 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7af0d7ce-4c10-4829-92b5-079328835b8d tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:45.311809 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7af0d7ce-4c10-4829-92b5-079328835b8d tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:45.318966 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7af0d7ce-4c10-4829-92b5-079328835b8d tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:45.319645 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7af0d7ce-4c10-4829-92b5-079328835b8d tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:45.813521 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-40fbb330-4444-4d11-a7ba-63bae7516414 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:55:45.832233 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-40fbb330-4444-4d11-a7ba-63bae7516414 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/2098e0b9-b628-4b9e-979b-960c68830fee" status: 200 len: 1716 microversion: 2.1 time: 0.775792 Sep 14 08:55:45.832830 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 855/1744] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:55:45 2022] GET /compute/v2.1/servers/2098e0b9-b628-4b9e-979b-960c68830fee => generated 1716 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:55:45.854876 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-346de6a2-9b46-4522-9d05-4e6cd89fab60 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:55:45.855748 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-346de6a2-9b46-4522-9d05-4e6cd89fab60 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: bb621205-f7b7-4823-b3b9-fb903ac44b2a] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:55:45.862770 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-346de6a2-9b46-4522-9d05-4e6cd89fab60 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:45.863504 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-346de6a2-9b46-4522-9d05-4e6cd89fab60 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:45.864187 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-346de6a2-9b46-4522-9d05-4e6cd89fab60 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:45.865614 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-346de6a2-9b46-4522-9d05-4e6cd89fab60 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:45.866244 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-346de6a2-9b46-4522-9d05-4e6cd89fab60 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:45.866842 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-346de6a2-9b46-4522-9d05-4e6cd89fab60 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:45.972421 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-7af0d7ce-4c10-4829-92b5-079328835b8d tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e1780ebcf1413fa4f7a9760b761c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77c85f074ae4b8cb5a1457a5183197b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:55:45.998975 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-7af0d7ce-4c10-4829-92b5-079328835b8d tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] 10.222.0.60 "GET /compute/v2.1/servers/0b54f1c2-0d9c-4396-8c79-1e43b612b2ba" status: 200 len: 1371 microversion: 2.1 time: 0.730080 Sep 14 08:55:46.006444 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 890/1745] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:55:45 2022] GET /compute/v2.1/servers/0b54f1c2-0d9c-4396-8c79-1e43b612b2ba => generated 1371 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:55:46.078873 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-feb31558-18b5-42dd-8d5e-5d0afc80a329 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:55:46.079679 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-feb31558-18b5-42dd-8d5e-5d0afc80a329 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] [instance: e7aa796a-60a2-4d5c-a03c-b4ad0ea73811] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:55:46.089666 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-feb31558-18b5-42dd-8d5e-5d0afc80a329 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:46.090320 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-feb31558-18b5-42dd-8d5e-5d0afc80a329 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:46.090925 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-feb31558-18b5-42dd-8d5e-5d0afc80a329 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:46.092953 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-feb31558-18b5-42dd-8d5e-5d0afc80a329 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:46.095070 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-feb31558-18b5-42dd-8d5e-5d0afc80a329 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:46.095625 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-feb31558-18b5-42dd-8d5e-5d0afc80a329 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:46.326756 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-feb31558-18b5-42dd-8d5e-5d0afc80a329 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab2d64c1cb447f9bfd658408aa07e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ecc8c1389847c7bcd9cd5570d990e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:55:46.337401 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-feb31558-18b5-42dd-8d5e-5d0afc80a329 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] 10.222.0.60 "GET /compute/v2.1/servers/e7aa796a-60a2-4d5c-a03c-b4ad0ea73811" status: 200 len: 1271 microversion: 2.1 time: 0.262443 Sep 14 08:55:46.339293 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 891/1746] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:55:46 2022] GET /compute/v2.1/servers/e7aa796a-60a2-4d5c-a03c-b4ad0ea73811 => generated 1271 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:55:46.344349 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-37d56525-24a2-43da-add8-aa3ff27b495f tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:55:46.345231 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-37d56525-24a2-43da-add8-aa3ff27b495f tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] [instance: a4474e04-7712-41de-bbf8-a872101a9808] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:55:46.352115 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-37d56525-24a2-43da-add8-aa3ff27b495f tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:46.353147 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-37d56525-24a2-43da-add8-aa3ff27b495f tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:46.353850 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-37d56525-24a2-43da-add8-aa3ff27b495f tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:46.355171 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-37d56525-24a2-43da-add8-aa3ff27b495f tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:46.355862 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-37d56525-24a2-43da-add8-aa3ff27b495f tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:46.356513 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-37d56525-24a2-43da-add8-aa3ff27b495f tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:46.362782 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=100 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:55:46.566427 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-37d56525-24a2-43da-add8-aa3ff27b495f tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5040fc9212814c4fa9e038116578eebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a963df1b646f1918426fe1a7cb23c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:55:46.580479 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-37d56525-24a2-43da-add8-aa3ff27b495f tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] 10.222.0.60 "GET /compute/v2.1/servers/a4474e04-7712-41de-bbf8-a872101a9808" status: 200 len: 1633 microversion: 2.1 time: 0.239836 Sep 14 08:55:46.581688 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 892/1747] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:55:46 2022] GET /compute/v2.1/servers/a4474e04-7712-41de-bbf8-a872101a9808 => generated 1633 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:55:46.704188 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-346de6a2-9b46-4522-9d05-4e6cd89fab60 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:55:46.715934 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-346de6a2-9b46-4522-9d05-4e6cd89fab60 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:55:46.717455 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-346de6a2-9b46-4522-9d05-4e6cd89fab60 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:55:46.718651 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-346de6a2-9b46-4522-9d05-4e6cd89fab60 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/bb621205-f7b7-4823-b3b9-fb903ac44b2a" status: 200 len: 1280 microversion: 2.25 time: 0.869945 Sep 14 08:55:46.719258 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 856/1748] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:55:45 2022] GET /compute/v2.1/servers/bb621205-f7b7-4823-b3b9-fb903ac44b2a => generated 1280 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:55:46.765366 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-896ffaca-8094-4b4d-beba-66c71b294da1 req-3a5b922e-2eb3-465e-b521-cce1806ecb9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4474e04-7712-41de-bbf8-a872101a9808", "name": "network-vif-deleted", "tag": "9329ba93-e005-46d9-9298-7b803f042b47"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:55:46.799013 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-896ffaca-8094-4b4d-beba-66c71b294da1 req-3a5b922e-2eb3-465e-b521-cce1806ecb9c service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:46.800384 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-896ffaca-8094-4b4d-beba-66c71b294da1 req-3a5b922e-2eb3-465e-b521-cce1806ecb9c service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:46.801711 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-896ffaca-8094-4b4d-beba-66c71b294da1 req-3a5b922e-2eb3-465e-b521-cce1806ecb9c service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:46.818705 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-896ffaca-8094-4b4d-beba-66c71b294da1 req-3a5b922e-2eb3-465e-b521-cce1806ecb9c service nova] Creating event network-vif-deleted:9329ba93-e005-46d9-9298-7b803f042b47 for instance a4474e04-7712-41de-bbf8-a872101a9808 on n-h2-836830-18 Sep 14 08:55:46.825699 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-896ffaca-8094-4b4d-beba-66c71b294da1 req-3a5b922e-2eb3-465e-b521-cce1806ecb9c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066206 Sep 14 08:55:46.826760 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 857/1749] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:55:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:55:46.861273 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-74a00cb3-8b36-4182-8ece-21568e8e30dc tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:55:46.862320 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-74a00cb3-8b36-4182-8ece-21568e8e30dc tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: 2098e0b9-b628-4b9e-979b-960c68830fee] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:55:46.880191 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-74a00cb3-8b36-4182-8ece-21568e8e30dc tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:46.884587 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-74a00cb3-8b36-4182-8ece-21568e8e30dc tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:46.888445 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-74a00cb3-8b36-4182-8ece-21568e8e30dc tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:46.889237 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-74a00cb3-8b36-4182-8ece-21568e8e30dc tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:46.892085 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-74a00cb3-8b36-4182-8ece-21568e8e30dc tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:46.892543 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-74a00cb3-8b36-4182-8ece-21568e8e30dc tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:47.039130 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-19e6a14e-b067-4617-ba09-b97c855709b5 tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Action: 'create', calling method: .version_select at 0x7f7d4882bd30>, body: {"keypair": {"name": "tempest-keypair-849605918", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN4Fhg4m3V5IGJxZN992yueRccWxocsVL85+6KBulJpQPZ+wNsSBAeCE4losGITSqNCEt+RQEKc3BFojqbSN3M8NJKrVFS18u/PKkPUKXG5CAWQj4IHm3ecswyNpyTcACA=="}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:55:47.077864 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-19e6a14e-b067-4617-ba09-b97c855709b5 tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Getting quotas for project cff1b40a79024bc583b13bcfdaa05fda. Resources: {'key_pairs'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 08:55:47.090524 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-19e6a14e-b067-4617-ba09-b97c855709b5 tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Getting quotas for user 1654b8267f4e47bab09acd39386dc502 and project cff1b40a79024bc583b13bcfdaa05fda. Resources: {'key_pairs'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 08:55:47.162535 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-19e6a14e-b067-4617-ba09-b97c855709b5 tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.402681 Sep 14 08:55:47.164256 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 893/1750] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Sep 14 08:55:46 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:55:47.182774 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a6cd8e71-1063-4781-b62e-127995925f05 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:55:47.186438 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-a6cd8e71-1063-4781-b62e-127995925f05 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] [instance: 0b54f1c2-0d9c-4396-8c79-1e43b612b2ba] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:55:47.207349 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a6cd8e71-1063-4781-b62e-127995925f05 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:47.212704 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a6cd8e71-1063-4781-b62e-127995925f05 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:47.213423 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a6cd8e71-1063-4781-b62e-127995925f05 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:47.214561 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a6cd8e71-1063-4781-b62e-127995925f05 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:47.216284 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a6cd8e71-1063-4781-b62e-127995925f05 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:47.216917 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a6cd8e71-1063-4781-b62e-127995925f05 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:48.089113 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-74a00cb3-8b36-4182-8ece-21568e8e30dc tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:55:48.111635 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-74a00cb3-8b36-4182-8ece-21568e8e30dc tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/2098e0b9-b628-4b9e-979b-960c68830fee" status: 200 len: 1716 microversion: 2.1 time: 1.255070 Sep 14 08:55:48.114391 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 858/1751] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:55:46 2022] GET /compute/v2.1/servers/2098e0b9-b628-4b9e-979b-960c68830fee => generated 1716 bytes in 1259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:55:48.121655 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9f13820a-3daf-48eb-a8a6-618b1683d994 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:55:48.129067 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-9f13820a-3daf-48eb-a8a6-618b1683d994 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] [instance: e7aa796a-60a2-4d5c-a03c-b4ad0ea73811] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:55:48.142975 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9f13820a-3daf-48eb-a8a6-618b1683d994 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:48.145702 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9f13820a-3daf-48eb-a8a6-618b1683d994 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:48.146157 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9f13820a-3daf-48eb-a8a6-618b1683d994 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:48.147513 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9f13820a-3daf-48eb-a8a6-618b1683d994 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:48.150119 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9f13820a-3daf-48eb-a8a6-618b1683d994 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:48.151012 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9f13820a-3daf-48eb-a8a6-618b1683d994 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:48.779289 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-a6cd8e71-1063-4781-b62e-127995925f05 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e1780ebcf1413fa4f7a9760b761c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77c85f074ae4b8cb5a1457a5183197b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:55:48.805750 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-a6cd8e71-1063-4781-b62e-127995925f05 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] 10.222.0.60 "GET /compute/v2.1/servers/0b54f1c2-0d9c-4396-8c79-1e43b612b2ba" status: 200 len: 1371 microversion: 2.1 time: 1.639825 Sep 14 08:55:48.828667 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 894/1752] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:55:47 2022] GET /compute/v2.1/servers/0b54f1c2-0d9c-4396-8c79-1e43b612b2ba => generated 1371 bytes in 1663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:55:48.835313 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-0cdc941e-3db5-42a6-8ac2-d5a05a557be2 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:55:48.835951 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-0cdc941e-3db5-42a6-8ac2-d5a05a557be2 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] [instance: a4474e04-7712-41de-bbf8-a872101a9808] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:55:48.849199 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0cdc941e-3db5-42a6-8ac2-d5a05a557be2 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:48.849946 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0cdc941e-3db5-42a6-8ac2-d5a05a557be2 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:48.850618 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0cdc941e-3db5-42a6-8ac2-d5a05a557be2 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:48.852111 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0cdc941e-3db5-42a6-8ac2-d5a05a557be2 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:48.852738 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0cdc941e-3db5-42a6-8ac2-d5a05a557be2 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:48.853346 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0cdc941e-3db5-42a6-8ac2-d5a05a557be2 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:48.874436 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-0cdc941e-3db5-42a6-8ac2-d5a05a557be2 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] HTTP exception thrown: Instance a4474e04-7712-41de-bbf8-a872101a9808 could not be found. Sep 14 08:55:48.878500 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-0cdc941e-3db5-42a6-8ac2-d5a05a557be2 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Request method failure captured: Sep 14 08:55:48.878500 n-d-836830-18 devstack@n-api.service[128758]: request: GET /compute/v2.1/servers/a4474e04-7712-41de-bbf8-a872101a9808 HTTP/1.1 Sep 14 08:55:48.878500 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 08:55:48.878500 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 08:55:48.878500 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 08:55:48.878500 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 08:55:48.878500 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 08:55:48.878500 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 08:55:48.878500 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 08:55:48.878500 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 08:55:48.878500 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZa_bCczCb7ZQS5E-qWU6EvROzW84adFQLW2rwslWXV4ri6lFVSJmyFPQonVpB8tOfY6uAHzVoulsN856pEljdxCsZ2NhL__5swRWZxpJKCtlqCcevg9i69BHthMjRLJqgtLmQvhVtPqDlKHeCxq_rDB3OLDhOxOFmQO81GUM9mdoio Sep 14 08:55:48.878500 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 08:55:48.878500 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 08:55:48.878500 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 08:55:48.878500 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 08:55:48.878500 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 08:55:48.878500 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 08:55:48.878500 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 659a963df1b646f1918426fe1a7cb23c Sep 14 08:55:48.878500 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-ServersTestJSON-666690169 Sep 14 08:55:48.878500 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 08:55:48.878500 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 08:55:48.878500 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/659a963df1b646f1918426fe1a7cb23c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_659a963df1b646f1918426fe1a7cb23c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/659a963df1b646f1918426fe1a7cb23c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/659a963df1b646f1918426fe1a7cb23c"}]}] Sep 14 08:55:48.878500 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-ServersTestJSON-666690169 Sep 14 08:55:48.878500 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 659a963df1b646f1918426fe1a7cb23c Sep 14 08:55:48.878500 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-ServersTestJSON-666690169 Sep 14 08:55:48.878500 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-ServersTestJSON-666690169-project Sep 14 08:55:48.878500 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 08:55:48.878500 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 08:55:48.878500 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 5040fc9212814c4fa9e038116578eebd Sep 14 08:55:48.878500 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-ServersTestJSON-666690169-project Sep 14 08:55:48.878500 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 08:55:48.878500 n-d-836830-18 devstack@n-api.service[128758]: exception: Instance a4474e04-7712-41de-bbf8-a872101a9808 could not be found. Sep 14 08:55:48.878500 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': 'a4474e04-7712-41de-bbf8-a872101a9808'} Sep 14 08:55:48.878500 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:55:48.878500 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:55:48.878500 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 08:55:48.878500 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 08:55:48.878500 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 08:55:48.878500 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 08:55:48.878500 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 08:55:48.878500 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 08:55:48.878500 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 08:55:48.878500 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 08:55:48.878500 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4474e04-7712-41de-bbf8-a872101a9808 could not be found. Sep 14 08:55:48.878500 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:55:48.878500 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:55:48.878500 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:55:48.878500 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:55:48.878500 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:55:48.878500 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:55:48.878500 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:55:48.878500 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:55:48.878500 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:55:48.878500 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:55:48.878500 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 08:55:48.878500 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 08:55:48.878500 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 08:55:48.878500 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 08:55:48.878500 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 08:55:48.878500 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 08:55:48.878500 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4474e04-7712-41de-bbf8-a872101a9808 could not be found. Sep 14 08:55:48.878500 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:55:48.878500 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:55:48.878500 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:55:48.878500 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:55:48.885131 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:55:48.885131 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:55:48.885131 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:55:48.885131 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:55:48.885131 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4474e04-7712-41de-bbf8-a872101a9808 could not be found. Sep 14 08:55:48.885131 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:55:48.887543 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-0cdc941e-3db5-42a6-8ac2-d5a05a557be2 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Returning 404 to user: Instance a4474e04-7712-41de-bbf8-a872101a9808 could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:55:48.889363 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-0cdc941e-3db5-42a6-8ac2-d5a05a557be2 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] 10.222.0.60 "GET /compute/v2.1/servers/a4474e04-7712-41de-bbf8-a872101a9808" status: 404 len: 111 microversion: 2.1 time: 0.059493 Sep 14 08:55:48.890552 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 895/1753] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:55:48 2022] GET /compute/v2.1/servers/a4474e04-7712-41de-bbf8-a872101a9808 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 08:55:48.896531 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1e0e3ed2-aa7f-4ba2-b5df-29c9d62f397f tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:55:48.897527 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-1e0e3ed2-aa7f-4ba2-b5df-29c9d62f397f tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: bb621205-f7b7-4823-b3b9-fb903ac44b2a] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:55:48.910982 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1e0e3ed2-aa7f-4ba2-b5df-29c9d62f397f tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:48.918856 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1e0e3ed2-aa7f-4ba2-b5df-29c9d62f397f tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:48.920059 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1e0e3ed2-aa7f-4ba2-b5df-29c9d62f397f tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:48.921377 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1e0e3ed2-aa7f-4ba2-b5df-29c9d62f397f tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:48.923127 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1e0e3ed2-aa7f-4ba2-b5df-29c9d62f397f tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:48.926475 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1e0e3ed2-aa7f-4ba2-b5df-29c9d62f397f tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:49.085148 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=10 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:55:49.670519 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-9f13820a-3daf-48eb-a8a6-618b1683d994 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab2d64c1cb447f9bfd658408aa07e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ecc8c1389847c7bcd9cd5570d990e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:55:49.683778 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-9f13820a-3daf-48eb-a8a6-618b1683d994 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] 10.222.0.60 "GET /compute/v2.1/servers/e7aa796a-60a2-4d5c-a03c-b4ad0ea73811" status: 200 len: 1313 microversion: 2.1 time: 1.565024 Sep 14 08:55:49.684663 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 859/1754] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:55:48 2022] GET /compute/v2.1/servers/e7aa796a-60a2-4d5c-a03c-b4ad0ea73811 => generated 1313 bytes in 1568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:55:49.689613 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-2a934a1d-db31-4504-af15-621ab1bb94a2 req-5f8a942d-0914-46a5-b854-f8bcc07dd137 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b54f1c2-0d9c-4396-8c79-1e43b612b2ba", "tag": "a2159b48-787c-4c0e-9fc3-ec5a293b0333"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:55:49.728697 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-2a934a1d-db31-4504-af15-621ab1bb94a2 req-5f8a942d-0914-46a5-b854-f8bcc07dd137 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:49.729483 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-2a934a1d-db31-4504-af15-621ab1bb94a2 req-5f8a942d-0914-46a5-b854-f8bcc07dd137 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:49.730068 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-2a934a1d-db31-4504-af15-621ab1bb94a2 req-5f8a942d-0914-46a5-b854-f8bcc07dd137 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:49.763931 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-2a934a1d-db31-4504-af15-621ab1bb94a2 req-5f8a942d-0914-46a5-b854-f8bcc07dd137 service nova] Creating event network-changed:a2159b48-787c-4c0e-9fc3-ec5a293b0333 for instance 0b54f1c2-0d9c-4396-8c79-1e43b612b2ba on n-h1-836830-18 Sep 14 08:55:49.779709 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-2a934a1d-db31-4504-af15-621ab1bb94a2 req-5f8a942d-0914-46a5-b854-f8bcc07dd137 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091705 Sep 14 08:55:49.783164 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 860/1755] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:55:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:55:49.807029 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-4103b216-c858-4511-8613-aa443737a164 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] Calling method '.version_select at 0x7f7d3ff5a160>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:55:49.867484 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-4103b216-c858-4511-8613-aa443737a164 tempest-ServersTestJSON-666690169 tempest-ServersTestJSON-666690169-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-617872715" status: 202 len: 0 microversion: 2.1 time: 0.082594 Sep 14 08:55:49.870524 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 861/1756] 10.222.0.60 () {58 vars in 1218 bytes} [Wed Sep 14 08:55:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-617872715 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 08:55:49.888475 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b3560007-626c-47d2-bb50-dc5dadba537f tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:55:49.891807 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b3560007-626c-47d2-bb50-dc5dadba537f tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: 2098e0b9-b628-4b9e-979b-960c68830fee] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:55:49.914797 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b3560007-626c-47d2-bb50-dc5dadba537f tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:49.918440 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b3560007-626c-47d2-bb50-dc5dadba537f tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:49.919188 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b3560007-626c-47d2-bb50-dc5dadba537f tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:49.925339 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b3560007-626c-47d2-bb50-dc5dadba537f tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:49.927558 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b3560007-626c-47d2-bb50-dc5dadba537f tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:49.928344 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b3560007-626c-47d2-bb50-dc5dadba537f tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:50.460985 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-1e0e3ed2-aa7f-4ba2-b5df-29c9d62f397f tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:55:50.478815 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-1e0e3ed2-aa7f-4ba2-b5df-29c9d62f397f tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:55:50.491240 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-1e0e3ed2-aa7f-4ba2-b5df-29c9d62f397f tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:55:50.502029 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-1e0e3ed2-aa7f-4ba2-b5df-29c9d62f397f tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/bb621205-f7b7-4823-b3b9-fb903ac44b2a" status: 200 len: 1280 microversion: 2.25 time: 1.610007 Sep 14 08:55:50.507591 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 896/1757] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:55:48 2022] GET /compute/v2.1/servers/bb621205-f7b7-4823-b3b9-fb903ac44b2a => generated 1280 bytes in 1614 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:55:50.513114 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d7931d9d-7841-4531-834b-460cb6b6f8f1 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:55:50.519430 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-d7931d9d-7841-4531-834b-460cb6b6f8f1 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] [instance: 0b54f1c2-0d9c-4396-8c79-1e43b612b2ba] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:55:50.534024 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d7931d9d-7841-4531-834b-460cb6b6f8f1 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:50.540007 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d7931d9d-7841-4531-834b-460cb6b6f8f1 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:50.541583 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d7931d9d-7841-4531-834b-460cb6b6f8f1 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:50.543778 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d7931d9d-7841-4531-834b-460cb6b6f8f1 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:50.545463 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d7931d9d-7841-4531-834b-460cb6b6f8f1 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:50.546012 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d7931d9d-7841-4531-834b-460cb6b6f8f1 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:51.018208 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b3560007-626c-47d2-bb50-dc5dadba537f tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:55:51.039048 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b3560007-626c-47d2-bb50-dc5dadba537f tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/2098e0b9-b628-4b9e-979b-960c68830fee" status: 200 len: 1716 microversion: 2.1 time: 1.159672 Sep 14 08:55:51.039942 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 862/1758] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:55:49 2022] GET /compute/v2.1/servers/2098e0b9-b628-4b9e-979b-960c68830fee => generated 1716 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:55:51.060879 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-6f458639-3e9e-48b5-8661-d23f03b9fd17 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:55:51.061944 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-6f458639-3e9e-48b5-8661-d23f03b9fd17 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] [instance: e7aa796a-60a2-4d5c-a03c-b4ad0ea73811] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:55:51.069426 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6f458639-3e9e-48b5-8661-d23f03b9fd17 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:51.070177 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6f458639-3e9e-48b5-8661-d23f03b9fd17 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:51.071437 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6f458639-3e9e-48b5-8661-d23f03b9fd17 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:51.072878 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6f458639-3e9e-48b5-8661-d23f03b9fd17 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:51.073506 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6f458639-3e9e-48b5-8661-d23f03b9fd17 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:51.074112 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6f458639-3e9e-48b5-8661-d23f03b9fd17 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:51.348456 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-d7931d9d-7841-4531-834b-460cb6b6f8f1 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e1780ebcf1413fa4f7a9760b761c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77c85f074ae4b8cb5a1457a5183197b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:55:51.363009 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-d7931d9d-7841-4531-834b-460cb6b6f8f1 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] 10.222.0.60 "GET /compute/v2.1/servers/0b54f1c2-0d9c-4396-8c79-1e43b612b2ba" status: 200 len: 1371 microversion: 2.1 time: 0.852733 Sep 14 08:55:51.363906 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 897/1759] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:55:50 2022] GET /compute/v2.1/servers/0b54f1c2-0d9c-4396-8c79-1e43b612b2ba => generated 1371 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:55:51.376256 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-63faa2eb-c30a-4cdc-a0cd-286e7e937454 tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "fa352526-bf6b-48c7-bfbd-8a9649a350cc"}], "security_groups": [{"name": "tempest-securitygroup--3021111"}], "key_name": "tempest-keypair-849605918", "user_data": "}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:55:51.630173 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-6f458639-3e9e-48b5-8661-d23f03b9fd17 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab2d64c1cb447f9bfd658408aa07e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ecc8c1389847c7bcd9cd5570d990e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:55:51.641767 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-6f458639-3e9e-48b5-8661-d23f03b9fd17 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] 10.222.0.60 "GET /compute/v2.1/servers/e7aa796a-60a2-4d5c-a03c-b4ad0ea73811" status: 200 len: 1313 microversion: 2.1 time: 0.586503 Sep 14 08:55:51.654962 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 863/1760] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:55:51 2022] GET /compute/v2.1/servers/e7aa796a-60a2-4d5c-a03c-b4ad0ea73811 => generated 1313 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:55:51.656419 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-7bbe8f48-77d8-45ec-9510-57749aa9b83b tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:55:51.657051 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-7bbe8f48-77d8-45ec-9510-57749aa9b83b tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: bb621205-f7b7-4823-b3b9-fb903ac44b2a] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:55:51.667542 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7bbe8f48-77d8-45ec-9510-57749aa9b83b tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:51.668036 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7bbe8f48-77d8-45ec-9510-57749aa9b83b tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:51.668473 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7bbe8f48-77d8-45ec-9510-57749aa9b83b tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:51.669759 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7bbe8f48-77d8-45ec-9510-57749aa9b83b tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:51.670507 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7bbe8f48-77d8-45ec-9510-57749aa9b83b tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:51.670964 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7bbe8f48-77d8-45ec-9510-57749aa9b83b tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:51.940291 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.network.neutron [None req-63faa2eb-c30a-4cdc-a0cd-286e7e937454 tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] validate_networks() for [('fa352526-bf6b-48c7-bfbd-8a9649a350cc', None, None, None, None, None)] {{(pid=128758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 08:55:52.240328 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-7bbe8f48-77d8-45ec-9510-57749aa9b83b tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:55:52.262796 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-7bbe8f48-77d8-45ec-9510-57749aa9b83b tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:55:52.272914 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-7bbe8f48-77d8-45ec-9510-57749aa9b83b tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:55:52.274155 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-7bbe8f48-77d8-45ec-9510-57749aa9b83b tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/bb621205-f7b7-4823-b3b9-fb903ac44b2a" status: 200 len: 1475 microversion: 2.25 time: 0.626696 Sep 14 08:55:52.274735 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 864/1761] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:55:51 2022] GET /compute/v2.1/servers/bb621205-f7b7-4823-b3b9-fb903ac44b2a => generated 1475 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:55:52.280165 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-6262e4a4-20a9-4b34-ad45-8bfed161e325 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:55:52.286306 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-6262e4a4-20a9-4b34-ad45-8bfed161e325 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: 2098e0b9-b628-4b9e-979b-960c68830fee] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:55:52.294274 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6262e4a4-20a9-4b34-ad45-8bfed161e325 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:52.299659 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6262e4a4-20a9-4b34-ad45-8bfed161e325 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:52.300123 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6262e4a4-20a9-4b34-ad45-8bfed161e325 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:52.300872 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6262e4a4-20a9-4b34-ad45-8bfed161e325 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:52.301339 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6262e4a4-20a9-4b34-ad45-8bfed161e325 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:52.301768 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6262e4a4-20a9-4b34-ad45-8bfed161e325 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:52.354817 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=2 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:55:53.460955 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-6262e4a4-20a9-4b34-ad45-8bfed161e325 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:55:53.473883 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-6262e4a4-20a9-4b34-ad45-8bfed161e325 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/2098e0b9-b628-4b9e-979b-960c68830fee" status: 200 len: 1716 microversion: 2.1 time: 1.197599 Sep 14 08:55:53.474499 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 865/1762] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:55:52 2022] GET /compute/v2.1/servers/2098e0b9-b628-4b9e-979b-960c68830fee => generated 1716 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:55:53.684699 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-de00f0b6-4618-4461-bfa3-f2b96a27bd0c tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:55:53.685753 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-de00f0b6-4618-4461-bfa3-f2b96a27bd0c tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] [instance: bb621205-f7b7-4823-b3b9-fb903ac44b2a] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:55:53.701653 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-de00f0b6-4618-4461-bfa3-f2b96a27bd0c tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:53.702284 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-de00f0b6-4618-4461-bfa3-f2b96a27bd0c tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:53.703149 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-de00f0b6-4618-4461-bfa3-f2b96a27bd0c tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:53.704115 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-de00f0b6-4618-4461-bfa3-f2b96a27bd0c tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:53.704651 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-de00f0b6-4618-4461-bfa3-f2b96a27bd0c tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:53.707302 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-de00f0b6-4618-4461-bfa3-f2b96a27bd0c tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:54.002869 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-63faa2eb-c30a-4cdc-a0cd-286e7e937454 tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Flavor limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 08:55:54.003499 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-63faa2eb-c30a-4cdc-a0cd-286e7e937454 tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Image limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 08:55:54.007342 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-63faa2eb-c30a-4cdc-a0cd-286e7e937454 tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Flavor pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 08:55:54.007885 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-63faa2eb-c30a-4cdc-a0cd-286e7e937454 tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Image pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 08:55:54.009120 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-63faa2eb-c30a-4cdc-a0cd-286e7e937454 tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 08:55:54.021393 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-63faa2eb-c30a-4cdc-a0cd-286e7e937454 tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:54.022421 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-63faa2eb-c30a-4cdc-a0cd-286e7e937454 tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:54.023075 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-63faa2eb-c30a-4cdc-a0cd-286e7e937454 tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:54.024109 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-63faa2eb-c30a-4cdc-a0cd-286e7e937454 tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:54.024755 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-63faa2eb-c30a-4cdc-a0cd-286e7e937454 tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:54.025379 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-63faa2eb-c30a-4cdc-a0cd-286e7e937454 tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:54.052965 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-63faa2eb-c30a-4cdc-a0cd-286e7e937454 tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Getting quotas for project cff1b40a79024bc583b13bcfdaa05fda. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 08:55:54.063631 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-63faa2eb-c30a-4cdc-a0cd-286e7e937454 tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Getting quotas for user 1654b8267f4e47bab09acd39386dc502 and project cff1b40a79024bc583b13bcfdaa05fda. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 08:55:54.081121 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.objects.instance [None req-de00f0b6-4618-4461-bfa3-f2b96a27bd0c tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Lazy-loading 'services' on Instance uuid bb621205-f7b7-4823-b3b9-fb903ac44b2a {{(pid=128759) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 08:55:54.110841 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-63faa2eb-c30a-4cdc-a0cd-286e7e937454 tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Going to run 1 instances... {{(pid=128758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 08:55:54.113262 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-63faa2eb-c30a-4cdc-a0cd-286e7e937454 tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] [instance: 0b443b50-3413-4a73-80e7-b217776cbcc9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 08:55:54.141516 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-de00f0b6-4618-4461-bfa3-f2b96a27bd0c tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/bb621205-f7b7-4823-b3b9-fb903ac44b2a" status: 200 len: 1969 microversion: 2.25 time: 0.665616 Sep 14 08:55:54.142137 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 866/1763] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:55:53 2022] GET /compute/v2.1/servers/bb621205-f7b7-4823-b3b9-fb903ac44b2a => generated 1969 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:55:54.158248 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-44bf05c6-c455-4bc8-a2fa-640a10abec44 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:55:54.158884 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-44bf05c6-c455-4bc8-a2fa-640a10abec44 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] [instance: 0b54f1c2-0d9c-4396-8c79-1e43b612b2ba] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:55:54.172372 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-44bf05c6-c455-4bc8-a2fa-640a10abec44 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:54.172891 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-44bf05c6-c455-4bc8-a2fa-640a10abec44 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:54.173343 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-44bf05c6-c455-4bc8-a2fa-640a10abec44 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:54.180128 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-44bf05c6-c455-4bc8-a2fa-640a10abec44 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:54.180760 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-44bf05c6-c455-4bc8-a2fa-640a10abec44 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:54.181536 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-44bf05c6-c455-4bc8-a2fa-640a10abec44 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:54.205692 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-63faa2eb-c30a-4cdc-a0cd-286e7e937454 tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.839695 Sep 14 08:55:54.206275 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 898/1764] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 08:55:51 2022] POST /compute/v2.1/servers => generated 406 bytes in 2841 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 08:55:54.216676 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-16b03b27-7f24-44e5-9ef1-c4941128a435 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:55:54.218156 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-16b03b27-7f24-44e5-9ef1-c4941128a435 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] [instance: e7aa796a-60a2-4d5c-a03c-b4ad0ea73811] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:55:54.226982 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-16b03b27-7f24-44e5-9ef1-c4941128a435 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:54.227743 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-16b03b27-7f24-44e5-9ef1-c4941128a435 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:54.228442 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-16b03b27-7f24-44e5-9ef1-c4941128a435 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:54.229361 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-16b03b27-7f24-44e5-9ef1-c4941128a435 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:54.229996 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-16b03b27-7f24-44e5-9ef1-c4941128a435 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:54.232227 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-16b03b27-7f24-44e5-9ef1-c4941128a435 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:54.678549 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-44bf05c6-c455-4bc8-a2fa-640a10abec44 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e1780ebcf1413fa4f7a9760b761c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77c85f074ae4b8cb5a1457a5183197b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:55:54.694869 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-44bf05c6-c455-4bc8-a2fa-640a10abec44 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] 10.222.0.60 "GET /compute/v2.1/servers/0b54f1c2-0d9c-4396-8c79-1e43b612b2ba" status: 200 len: 1371 microversion: 2.1 time: 0.546845 Sep 14 08:55:54.696770 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 867/1765] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:55:54 2022] GET /compute/v2.1/servers/0b54f1c2-0d9c-4396-8c79-1e43b612b2ba => generated 1371 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:55:54.703417 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-166cb7fc-676d-4a10-8ea8-ccea4bea5292 req-0c3085cf-5618-429a-8de3-811ff2c095cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7aa796a-60a2-4d5c-a03c-b4ad0ea73811", "tag": "71dfb3fc-a016-400c-99bc-1b69b34e08e5"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:55:54.724167 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-166cb7fc-676d-4a10-8ea8-ccea4bea5292 req-0c3085cf-5618-429a-8de3-811ff2c095cc service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:54.727614 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-166cb7fc-676d-4a10-8ea8-ccea4bea5292 req-0c3085cf-5618-429a-8de3-811ff2c095cc service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:54.728064 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-166cb7fc-676d-4a10-8ea8-ccea4bea5292 req-0c3085cf-5618-429a-8de3-811ff2c095cc service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:54.747828 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-16b03b27-7f24-44e5-9ef1-c4941128a435 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab2d64c1cb447f9bfd658408aa07e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ecc8c1389847c7bcd9cd5570d990e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:55:54.758898 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-166cb7fc-676d-4a10-8ea8-ccea4bea5292 req-0c3085cf-5618-429a-8de3-811ff2c095cc service nova] Creating event network-changed:71dfb3fc-a016-400c-99bc-1b69b34e08e5 for instance e7aa796a-60a2-4d5c-a03c-b4ad0ea73811 on n-h2-836830-18 Sep 14 08:55:54.765060 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-166cb7fc-676d-4a10-8ea8-ccea4bea5292 req-0c3085cf-5618-429a-8de3-811ff2c095cc service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066582 Sep 14 08:55:54.767856 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-16b03b27-7f24-44e5-9ef1-c4941128a435 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] 10.222.0.60 "GET /compute/v2.1/servers/e7aa796a-60a2-4d5c-a03c-b4ad0ea73811" status: 200 len: 1313 microversion: 2.1 time: 0.555233 Sep 14 08:55:54.770112 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 899/1766] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:55:54 2022] GET /compute/v2.1/servers/e7aa796a-60a2-4d5c-a03c-b4ad0ea73811 => generated 1313 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:55:54.778602 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a41096c7-43d6-48f5-bd1b-393ed7339994 tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:55:54.782530 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-a41096c7-43d6-48f5-bd1b-393ed7339994 tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] [instance: bb621205-f7b7-4823-b3b9-fb903ac44b2a] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:55:54.785674 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 868/1767] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:55:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:55:54.797263 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e05c9eb4-d130-4220-a1a0-28f5cf469c5d tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:55:54.798338 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e05c9eb4-d130-4220-a1a0-28f5cf469c5d tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] [instance: 0b443b50-3413-4a73-80e7-b217776cbcc9] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:55:54.809346 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a41096c7-43d6-48f5-bd1b-393ed7339994 tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:54.809859 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a41096c7-43d6-48f5-bd1b-393ed7339994 tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:54.810299 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a41096c7-43d6-48f5-bd1b-393ed7339994 tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:54.813044 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a41096c7-43d6-48f5-bd1b-393ed7339994 tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:54.820271 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a41096c7-43d6-48f5-bd1b-393ed7339994 tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:54.821009 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a41096c7-43d6-48f5-bd1b-393ed7339994 tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:54.986025 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-e05c9eb4-d130-4220-a1a0-28f5cf469c5d tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1654b8267f4e47bab09acd39386dc502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff1b40a79024bc583b13bcfdaa05fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:55:55.003818 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e05c9eb4-d130-4220-a1a0-28f5cf469c5d tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] 10.222.0.60 "GET /compute/v2.1/servers/0b443b50-3413-4a73-80e7-b217776cbcc9" status: 200 len: 1225 microversion: 2.1 time: 0.217183 Sep 14 08:55:55.008256 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 869/1768] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:55:54 2022] GET /compute/v2.1/servers/0b443b50-3413-4a73-80e7-b217776cbcc9 => generated 1225 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:55:55.020082 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-fb5a4eda-6806-4d04-a7e1-794356df9f08 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:55:55.027461 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-fb5a4eda-6806-4d04-a7e1-794356df9f08 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: 2098e0b9-b628-4b9e-979b-960c68830fee] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:55:55.049310 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fb5a4eda-6806-4d04-a7e1-794356df9f08 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:55.049813 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fb5a4eda-6806-4d04-a7e1-794356df9f08 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:55.050257 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fb5a4eda-6806-4d04-a7e1-794356df9f08 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:55.050996 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fb5a4eda-6806-4d04-a7e1-794356df9f08 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:55.051460 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fb5a4eda-6806-4d04-a7e1-794356df9f08 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:55.051886 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fb5a4eda-6806-4d04-a7e1-794356df9f08 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:55.306354 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.objects.instance [None req-a41096c7-43d6-48f5-bd1b-393ed7339994 tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Lazy-loading 'services' on Instance uuid bb621205-f7b7-4823-b3b9-fb903ac44b2a {{(pid=128758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 08:55:55.344336 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-a41096c7-43d6-48f5-bd1b-393ed7339994 tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/bb621205-f7b7-4823-b3b9-fb903ac44b2a" status: 200 len: 1969 microversion: 2.25 time: 0.572562 Sep 14 08:55:55.344946 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 900/1769] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:55:54 2022] GET /compute/v2.1/servers/bb621205-f7b7-4823-b3b9-fb903ac44b2a => generated 1969 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:55:55.477228 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-27157472-0d69-4a9b-9c22-0e6b961342f8 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-574379727", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "networks": [{"uuid": "238fbc23-0a7b-476b-a552-1a5667de089a"}]}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:55:55.491482 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-fb5a4eda-6806-4d04-a7e1-794356df9f08 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:55:55.512844 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-fb5a4eda-6806-4d04-a7e1-794356df9f08 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/2098e0b9-b628-4b9e-979b-960c68830fee" status: 200 len: 1706 microversion: 2.1 time: 0.498956 Sep 14 08:55:55.516404 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 870/1770] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:55:55 2022] GET /compute/v2.1/servers/2098e0b9-b628-4b9e-979b-960c68830fee => generated 1706 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:55:55.548495 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f66e8036-0ed7-4dcb-9072-d9069cfdee9b tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:55:55.594904 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f66e8036-0ed7-4dcb-9072-d9069cfdee9b tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:55.598444 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f66e8036-0ed7-4dcb-9072-d9069cfdee9b tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:55.600433 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f66e8036-0ed7-4dcb-9072-d9069cfdee9b tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:55.601618 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f66e8036-0ed7-4dcb-9072-d9069cfdee9b tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:55.603530 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f66e8036-0ed7-4dcb-9072-d9069cfdee9b tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:55.604326 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f66e8036-0ed7-4dcb-9072-d9069cfdee9b tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:55.636879 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.network.neutron [None req-27157472-0d69-4a9b-9c22-0e6b961342f8 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] validate_networks() for [('238fbc23-0a7b-476b-a552-1a5667de089a', None, None, None, None, None)] {{(pid=128758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 08:55:55.698351 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f66e8036-0ed7-4dcb-9072-d9069cfdee9b tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.179513 Sep 14 08:55:55.699636 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 871/1771] 10.222.0.60 () {60 vars in 1217 bytes} [Wed Sep 14 08:55:55 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 08:55:55.717176 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-419b5827-5b02-4f3d-9ede-ecbc9e57c514 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Calling method '.version_select at 0x7f7d44096a60>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:55:55.725673 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-419b5827-5b02-4f3d-9ede-ecbc9e57c514 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:55.726522 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-419b5827-5b02-4f3d-9ede-ecbc9e57c514 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:55.727181 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-419b5827-5b02-4f3d-9ede-ecbc9e57c514 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:55.742547 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-419b5827-5b02-4f3d-9ede-ecbc9e57c514 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] 10.222.0.60 "GET /compute/v2.1/os-migrations" status: 200 len: 2343 microversion: 2.1 time: 0.030170 Sep 14 08:55:55.756848 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 872/1772] 10.222.0.60 () {58 vars in 1143 bytes} [Wed Sep 14 08:55:55 2022] GET /compute/v2.1/os-migrations => generated 2343 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:55:55.764367 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-67d77a9a-ba23-418b-ad47-67246a917d20 tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-836830-18", "block_migration": "auto"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:55:55.769169 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-67d77a9a-ba23-418b-ad47-67246a917d20 tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] [instance: bb621205-f7b7-4823-b3b9-fb903ac44b2a] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:55:55.778225 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-67d77a9a-ba23-418b-ad47-67246a917d20 tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:55.779951 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-67d77a9a-ba23-418b-ad47-67246a917d20 tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:55.780609 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-67d77a9a-ba23-418b-ad47-67246a917d20 tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:55.781632 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-67d77a9a-ba23-418b-ad47-67246a917d20 tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:55.782312 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-67d77a9a-ba23-418b-ad47-67246a917d20 tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:55.782964 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-67d77a9a-ba23-418b-ad47-67246a917d20 tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:55.842232 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.objects.instance [None req-67d77a9a-ba23-418b-ad47-67246a917d20 tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Lazy-loading 'flavor' on Instance uuid bb621205-f7b7-4823-b3b9-fb903ac44b2a {{(pid=128759) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 08:55:55.868894 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-67d77a9a-ba23-418b-ad47-67246a917d20 tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] [instance: bb621205-f7b7-4823-b3b9-fb903ac44b2a] Going to try to live migrate instance to n-h2-836830-18 {{(pid=128759) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 14 08:55:56.005027 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:55:56.452830 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-27157472-0d69-4a9b-9c22-0e6b961342f8 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Flavor limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 08:55:56.453441 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-27157472-0d69-4a9b-9c22-0e6b961342f8 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Image limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 08:55:56.454586 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-27157472-0d69-4a9b-9c22-0e6b961342f8 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Flavor pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 08:55:56.455288 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-27157472-0d69-4a9b-9c22-0e6b961342f8 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Image pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 08:55:56.456585 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-27157472-0d69-4a9b-9c22-0e6b961342f8 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 08:55:56.473452 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-27157472-0d69-4a9b-9c22-0e6b961342f8 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:56.475872 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-27157472-0d69-4a9b-9c22-0e6b961342f8 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:56.476827 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-27157472-0d69-4a9b-9c22-0e6b961342f8 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:56.477979 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-27157472-0d69-4a9b-9c22-0e6b961342f8 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:56.478781 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-27157472-0d69-4a9b-9c22-0e6b961342f8 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:56.479530 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-27157472-0d69-4a9b-9c22-0e6b961342f8 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:56.507162 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-27157472-0d69-4a9b-9c22-0e6b961342f8 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Getting quotas for project a46ca7b6c331417199f9dfc5ffa80470. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 08:55:56.515990 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-27157472-0d69-4a9b-9c22-0e6b961342f8 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Getting quotas for user 1473e6771ff1459c831d66311318404d and project a46ca7b6c331417199f9dfc5ffa80470. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 08:55:56.538438 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-27157472-0d69-4a9b-9c22-0e6b961342f8 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Going to run 1 instances... {{(pid=128758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 08:55:56.540854 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-27157472-0d69-4a9b-9c22-0e6b961342f8 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 835d2ec2-e2af-4e09-92bf-37b271626011] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 08:55:56.642829 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-27157472-0d69-4a9b-9c22-0e6b961342f8 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.296542 Sep 14 08:55:56.651179 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 901/1773] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 08:55:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1305 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 08:55:56.665455 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-0df56341-bc00-4554-8434-5b5879dcb766 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:55:56.667237 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-0df56341-bc00-4554-8434-5b5879dcb766 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] [instance: 0b54f1c2-0d9c-4396-8c79-1e43b612b2ba] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:55:56.710828 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0df56341-bc00-4554-8434-5b5879dcb766 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:56.711950 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0df56341-bc00-4554-8434-5b5879dcb766 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:56.714261 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0df56341-bc00-4554-8434-5b5879dcb766 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:56.715130 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0df56341-bc00-4554-8434-5b5879dcb766 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:56.717200 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0df56341-bc00-4554-8434-5b5879dcb766 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:56.719620 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0df56341-bc00-4554-8434-5b5879dcb766 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:57.635590 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-0df56341-bc00-4554-8434-5b5879dcb766 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e1780ebcf1413fa4f7a9760b761c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77c85f074ae4b8cb5a1457a5183197b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:55:57.646982 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-0df56341-bc00-4554-8434-5b5879dcb766 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] 10.222.0.60 "GET /compute/v2.1/servers/0b54f1c2-0d9c-4396-8c79-1e43b612b2ba" status: 200 len: 1371 microversion: 2.1 time: 0.987404 Sep 14 08:55:57.647571 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 902/1774] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:55:56 2022] GET /compute/v2.1/servers/0b54f1c2-0d9c-4396-8c79-1e43b612b2ba => generated 1371 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:55:57.659390 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a1328162-0132-408b-937e-ceceb1f2525d tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:55:57.661780 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-a1328162-0132-408b-937e-ceceb1f2525d tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] [instance: 2098e0b9-b628-4b9e-979b-960c68830fee] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:55:57.682238 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a1328162-0132-408b-937e-ceceb1f2525d tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:57.689119 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a1328162-0132-408b-937e-ceceb1f2525d tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:57.690099 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a1328162-0132-408b-937e-ceceb1f2525d tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:57.690874 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a1328162-0132-408b-937e-ceceb1f2525d tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:57.691476 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a1328162-0132-408b-937e-ceceb1f2525d tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:57.692872 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a1328162-0132-408b-937e-ceceb1f2525d tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:58.129497 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-a1328162-0132-408b-937e-ceceb1f2525d tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/2098e0b9-b628-4b9e-979b-960c68830fee" status: 200 len: 1859 microversion: 2.1 time: 0.473886 Sep 14 08:55:58.130641 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 903/1775] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:55:57 2022] GET /compute/v2.1/servers/2098e0b9-b628-4b9e-979b-960c68830fee => generated 1859 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:55:58.152328 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d1a65b95-8443-4f13-a144-a99c3c6cb63a tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:55:58.153168 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-d1a65b95-8443-4f13-a144-a99c3c6cb63a tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] [instance: e7aa796a-60a2-4d5c-a03c-b4ad0ea73811] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:55:58.164074 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d1a65b95-8443-4f13-a144-a99c3c6cb63a tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:58.166082 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d1a65b95-8443-4f13-a144-a99c3c6cb63a tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:58.166816 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d1a65b95-8443-4f13-a144-a99c3c6cb63a tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:58.170137 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d1a65b95-8443-4f13-a144-a99c3c6cb63a tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:58.172397 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d1a65b95-8443-4f13-a144-a99c3c6cb63a tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:58.173063 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d1a65b95-8443-4f13-a144-a99c3c6cb63a tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:59.054451 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-d1a65b95-8443-4f13-a144-a99c3c6cb63a tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab2d64c1cb447f9bfd658408aa07e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ecc8c1389847c7bcd9cd5570d990e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:55:59.065385 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-d1a65b95-8443-4f13-a144-a99c3c6cb63a tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] 10.222.0.60 "GET /compute/v2.1/servers/e7aa796a-60a2-4d5c-a03c-b4ad0ea73811" status: 200 len: 1313 microversion: 2.1 time: 0.933383 Sep 14 08:55:59.065972 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 904/1776] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:55:58 2022] GET /compute/v2.1/servers/e7aa796a-60a2-4d5c-a03c-b4ad0ea73811 => generated 1313 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:55:59.080282 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ce427e7f-d5d8-4c2d-981b-4ead77b333f6 tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:55:59.086324 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-ce427e7f-d5d8-4c2d-981b-4ead77b333f6 tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] [instance: 0b443b50-3413-4a73-80e7-b217776cbcc9] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:55:59.099390 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ce427e7f-d5d8-4c2d-981b-4ead77b333f6 tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:59.099899 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ce427e7f-d5d8-4c2d-981b-4ead77b333f6 tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:59.103300 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ce427e7f-d5d8-4c2d-981b-4ead77b333f6 tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:59.106252 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ce427e7f-d5d8-4c2d-981b-4ead77b333f6 tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:59.106774 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ce427e7f-d5d8-4c2d-981b-4ead77b333f6 tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:59.107228 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ce427e7f-d5d8-4c2d-981b-4ead77b333f6 tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:59.245996 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-ce427e7f-d5d8-4c2d-981b-4ead77b333f6 tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1654b8267f4e47bab09acd39386dc502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff1b40a79024bc583b13bcfdaa05fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:55:59.259484 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-ce427e7f-d5d8-4c2d-981b-4ead77b333f6 tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] 10.222.0.60 "GET /compute/v2.1/servers/0b443b50-3413-4a73-80e7-b217776cbcc9" status: 200 len: 1283 microversion: 2.1 time: 0.185011 Sep 14 08:55:59.261017 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 905/1777] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:55:59 2022] GET /compute/v2.1/servers/0b443b50-3413-4a73-80e7-b217776cbcc9 => generated 1283 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:55:59.265932 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-59288181-f4ba-466e-adbe-dcdb63250e52 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:55:59.266554 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-59288181-f4ba-466e-adbe-dcdb63250e52 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 835d2ec2-e2af-4e09-92bf-37b271626011] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:55:59.288128 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-59288181-f4ba-466e-adbe-dcdb63250e52 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:59.290363 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-59288181-f4ba-466e-adbe-dcdb63250e52 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:59.291118 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-59288181-f4ba-466e-adbe-dcdb63250e52 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:59.292569 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-59288181-f4ba-466e-adbe-dcdb63250e52 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:59.295058 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-59288181-f4ba-466e-adbe-dcdb63250e52 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:59.295689 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-59288181-f4ba-466e-adbe-dcdb63250e52 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:59.485943 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-59288181-f4ba-466e-adbe-dcdb63250e52 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:55:59.501376 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-59288181-f4ba-466e-adbe-dcdb63250e52 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/835d2ec2-e2af-4e09-92bf-37b271626011" status: 200 len: 1262 microversion: 2.1 time: 0.238142 Sep 14 08:55:59.508076 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 906/1778] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:55:59 2022] GET /compute/v2.1/servers/835d2ec2-e2af-4e09-92bf-37b271626011 => generated 1262 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:55:59.513317 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a5043fed-736a-469f-aa24-d9a5a10edca2 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:55:59.515821 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-a5043fed-736a-469f-aa24-d9a5a10edca2 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] [instance: 2098e0b9-b628-4b9e-979b-960c68830fee] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:55:59.525252 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a5043fed-736a-469f-aa24-d9a5a10edca2 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:59.527232 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a5043fed-736a-469f-aa24-d9a5a10edca2 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:59.529666 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a5043fed-736a-469f-aa24-d9a5a10edca2 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:55:59.536436 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a5043fed-736a-469f-aa24-d9a5a10edca2 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:55:59.537410 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a5043fed-736a-469f-aa24-d9a5a10edca2 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:55:59.538581 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a5043fed-736a-469f-aa24-d9a5a10edca2 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:00.548125 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-67d77a9a-ba23-418b-ad47-67246a917d20 tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/bb621205-f7b7-4823-b3b9-fb903ac44b2a/action" status: 202 len: 0 microversion: 2.25 time: 4.789778 Sep 14 08:56:00.563529 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 873/1779] 10.222.0.60 () {62 vars in 1319 bytes} [Wed Sep 14 08:55:55 2022] POST /compute/v2.1/servers/bb621205-f7b7-4823-b3b9-fb903ac44b2a/action => generated 0 bytes in 4806 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 14 08:56:00.582040 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-f9003297-247e-45fb-bb86-e8d949ca1d1d req-54b56ac1-a9d8-460a-8f6c-e85c8de27f74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b54f1c2-0d9c-4396-8c79-1e43b612b2ba", "name": "network-vif-plugged", "status": "completed", "tag": "a2159b48-787c-4c0e-9fc3-ec5a293b0333"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:56:00.625478 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-f9003297-247e-45fb-bb86-e8d949ca1d1d req-54b56ac1-a9d8-460a-8f6c-e85c8de27f74 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:00.626004 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-f9003297-247e-45fb-bb86-e8d949ca1d1d req-54b56ac1-a9d8-460a-8f6c-e85c8de27f74 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:00.627122 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-f9003297-247e-45fb-bb86-e8d949ca1d1d req-54b56ac1-a9d8-460a-8f6c-e85c8de27f74 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:00.684753 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-f9003297-247e-45fb-bb86-e8d949ca1d1d req-54b56ac1-a9d8-460a-8f6c-e85c8de27f74 service nova] Creating event network-vif-plugged:a2159b48-787c-4c0e-9fc3-ec5a293b0333 for instance 0b54f1c2-0d9c-4396-8c79-1e43b612b2ba on n-h1-836830-18 Sep 14 08:56:00.706561 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-f9003297-247e-45fb-bb86-e8d949ca1d1d req-54b56ac1-a9d8-460a-8f6c-e85c8de27f74 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137781 Sep 14 08:56:00.709943 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 874/1780] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:56:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:56:00.711337 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-a5043fed-736a-469f-aa24-d9a5a10edca2 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/2098e0b9-b628-4b9e-979b-960c68830fee" status: 200 len: 1859 microversion: 2.1 time: 1.201821 Sep 14 08:56:00.719698 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 907/1781] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:55:59 2022] GET /compute/v2.1/servers/2098e0b9-b628-4b9e-979b-960c68830fee => generated 1859 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:56:00.727355 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3d9bd0f0-4cff-4256-9edc-7ecf84b2c304 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:56:00.728078 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-3d9bd0f0-4cff-4256-9edc-7ecf84b2c304 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] [instance: 0b54f1c2-0d9c-4396-8c79-1e43b612b2ba] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:56:00.743308 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d9b4e9f1-d570-4bbf-b231-31ad393289c3 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:56:00.748726 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-d9b4e9f1-d570-4bbf-b231-31ad393289c3 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] [instance: e7aa796a-60a2-4d5c-a03c-b4ad0ea73811] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:56:00.760957 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3d9bd0f0-4cff-4256-9edc-7ecf84b2c304 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:00.761493 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3d9bd0f0-4cff-4256-9edc-7ecf84b2c304 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:00.761936 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3d9bd0f0-4cff-4256-9edc-7ecf84b2c304 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:00.762644 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3d9bd0f0-4cff-4256-9edc-7ecf84b2c304 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:00.773529 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3d9bd0f0-4cff-4256-9edc-7ecf84b2c304 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:00.774057 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3d9bd0f0-4cff-4256-9edc-7ecf84b2c304 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:00.793070 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d9b4e9f1-d570-4bbf-b231-31ad393289c3 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:00.801033 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d9b4e9f1-d570-4bbf-b231-31ad393289c3 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:00.803355 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d9b4e9f1-d570-4bbf-b231-31ad393289c3 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:00.807067 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d9b4e9f1-d570-4bbf-b231-31ad393289c3 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:00.811306 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d9b4e9f1-d570-4bbf-b231-31ad393289c3 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:00.814389 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d9b4e9f1-d570-4bbf-b231-31ad393289c3 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:01.822335 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-3d9bd0f0-4cff-4256-9edc-7ecf84b2c304 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e1780ebcf1413fa4f7a9760b761c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77c85f074ae4b8cb5a1457a5183197b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:01.867188 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-d9b4e9f1-d570-4bbf-b231-31ad393289c3 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab2d64c1cb447f9bfd658408aa07e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ecc8c1389847c7bcd9cd5570d990e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:01.885219 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-d9b4e9f1-d570-4bbf-b231-31ad393289c3 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] 10.222.0.60 "GET /compute/v2.1/servers/e7aa796a-60a2-4d5c-a03c-b4ad0ea73811" status: 200 len: 1313 microversion: 2.1 time: 1.162899 Sep 14 08:56:01.885837 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 908/1782] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:56:00 2022] GET /compute/v2.1/servers/e7aa796a-60a2-4d5c-a03c-b4ad0ea73811 => generated 1313 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:56:01.893664 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-3d9bd0f0-4cff-4256-9edc-7ecf84b2c304 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] 10.222.0.60 "GET /compute/v2.1/servers/0b54f1c2-0d9c-4396-8c79-1e43b612b2ba" status: 200 len: 1371 microversion: 2.1 time: 1.174959 Sep 14 08:56:01.896502 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 875/1783] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:56:00 2022] GET /compute/v2.1/servers/0b54f1c2-0d9c-4396-8c79-1e43b612b2ba => generated 1371 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:56:01.924124 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-4a560af5-0a34-4f4e-beba-c664e35ac27b tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:56:01.925113 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-4a560af5-0a34-4f4e-beba-c664e35ac27b tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] [instance: 0b443b50-3413-4a73-80e7-b217776cbcc9] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:56:01.928693 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f2d291f4-b883-4f95-aa8c-9de27a0dbdc5 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:56:01.930905 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f2d291f4-b883-4f95-aa8c-9de27a0dbdc5 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 835d2ec2-e2af-4e09-92bf-37b271626011] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:56:01.944993 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4a560af5-0a34-4f4e-beba-c664e35ac27b tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:01.947357 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4a560af5-0a34-4f4e-beba-c664e35ac27b tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:01.948204 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4a560af5-0a34-4f4e-beba-c664e35ac27b tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:01.950198 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4a560af5-0a34-4f4e-beba-c664e35ac27b tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:01.951277 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f2d291f4-b883-4f95-aa8c-9de27a0dbdc5 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:01.951926 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4a560af5-0a34-4f4e-beba-c664e35ac27b tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:01.952732 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4a560af5-0a34-4f4e-beba-c664e35ac27b tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:01.953417 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f2d291f4-b883-4f95-aa8c-9de27a0dbdc5 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:01.954831 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f2d291f4-b883-4f95-aa8c-9de27a0dbdc5 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:01.957732 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f2d291f4-b883-4f95-aa8c-9de27a0dbdc5 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:01.958865 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f2d291f4-b883-4f95-aa8c-9de27a0dbdc5 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:01.963760 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f2d291f4-b883-4f95-aa8c-9de27a0dbdc5 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:02.483113 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-4a560af5-0a34-4f4e-beba-c664e35ac27b tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1654b8267f4e47bab09acd39386dc502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff1b40a79024bc583b13bcfdaa05fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:02.491734 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-4a560af5-0a34-4f4e-beba-c664e35ac27b tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] 10.222.0.60 "GET /compute/v2.1/servers/0b443b50-3413-4a73-80e7-b217776cbcc9" status: 200 len: 1348 microversion: 2.1 time: 0.604736 Sep 14 08:56:02.492382 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 909/1784] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:56:01 2022] GET /compute/v2.1/servers/0b443b50-3413-4a73-80e7-b217776cbcc9 => generated 1348 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:56:02.506891 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b938f743-bafa-4909-927c-cc2082b5a6b3 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:56:02.507593 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-b938f743-bafa-4909-927c-cc2082b5a6b3 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: bb621205-f7b7-4823-b3b9-fb903ac44b2a] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:56:02.514691 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b938f743-bafa-4909-927c-cc2082b5a6b3 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:02.518145 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b938f743-bafa-4909-927c-cc2082b5a6b3 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:02.521012 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b938f743-bafa-4909-927c-cc2082b5a6b3 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:02.521985 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b938f743-bafa-4909-927c-cc2082b5a6b3 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:02.524849 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b938f743-bafa-4909-927c-cc2082b5a6b3 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:02.525516 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b938f743-bafa-4909-927c-cc2082b5a6b3 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:02.739062 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f2d291f4-b883-4f95-aa8c-9de27a0dbdc5 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:02.748357 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f2d291f4-b883-4f95-aa8c-9de27a0dbdc5 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/835d2ec2-e2af-4e09-92bf-37b271626011" status: 200 len: 1292 microversion: 2.1 time: 0.835010 Sep 14 08:56:02.766062 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 876/1785] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:56:01 2022] GET /compute/v2.1/servers/835d2ec2-e2af-4e09-92bf-37b271626011 => generated 1292 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:56:02.777648 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8bdf928d-1d37-463e-8455-c79ded436d56 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:56:02.780381 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-8bdf928d-1d37-463e-8455-c79ded436d56 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: 2098e0b9-b628-4b9e-979b-960c68830fee] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:56:02.788303 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8bdf928d-1d37-463e-8455-c79ded436d56 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:02.789235 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8bdf928d-1d37-463e-8455-c79ded436d56 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:02.789682 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8bdf928d-1d37-463e-8455-c79ded436d56 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:02.791636 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8bdf928d-1d37-463e-8455-c79ded436d56 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:02.792112 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8bdf928d-1d37-463e-8455-c79ded436d56 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:02.793019 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8bdf928d-1d37-463e-8455-c79ded436d56 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:02.935312 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.objects.instance [None req-8bdf928d-1d37-463e-8455-c79ded436d56 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lazy-loading 'services' on Instance uuid 2098e0b9-b628-4b9e-979b-960c68830fee {{(pid=128759) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 08:56:03.086715 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-8bdf928d-1d37-463e-8455-c79ded436d56 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "DELETE /compute/v2.1/servers/2098e0b9-b628-4b9e-979b-960c68830fee/os-volume_attachments/99af689c-3be6-447e-80d9-94c8fb226d55" status: 202 len: 0 microversion: 2.1 time: 0.313842 Sep 14 08:56:03.088117 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 877/1786] 10.222.0.60 () {58 vars in 1416 bytes} [Wed Sep 14 08:56:02 2022] DELETE /compute/v2.1/servers/2098e0b9-b628-4b9e-979b-960c68830fee/os-volume_attachments/99af689c-3be6-447e-80d9-94c8fb226d55 => generated 0 bytes in 316 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 08:56:03.116410 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-27fcbb8d-2aa8-4e51-a14e-9d79a4794e10 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:56:03.119411 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-27fcbb8d-2aa8-4e51-a14e-9d79a4794e10 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] [instance: e7aa796a-60a2-4d5c-a03c-b4ad0ea73811] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:56:03.131533 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-27fcbb8d-2aa8-4e51-a14e-9d79a4794e10 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:03.132292 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-27fcbb8d-2aa8-4e51-a14e-9d79a4794e10 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:03.133016 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-27fcbb8d-2aa8-4e51-a14e-9d79a4794e10 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:03.133984 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-27fcbb8d-2aa8-4e51-a14e-9d79a4794e10 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:03.147399 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-27fcbb8d-2aa8-4e51-a14e-9d79a4794e10 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:03.154129 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-27fcbb8d-2aa8-4e51-a14e-9d79a4794e10 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:03.304431 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-b938f743-bafa-4909-927c-cc2082b5a6b3 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:03.321548 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-b938f743-bafa-4909-927c-cc2082b5a6b3 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:03.340596 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-b938f743-bafa-4909-927c-cc2082b5a6b3 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:03.342341 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-b938f743-bafa-4909-927c-cc2082b5a6b3 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/bb621205-f7b7-4823-b3b9-fb903ac44b2a" status: 200 len: 1485 microversion: 2.25 time: 0.848938 Sep 14 08:56:03.347125 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 910/1787] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:56:02 2022] GET /compute/v2.1/servers/bb621205-f7b7-4823-b3b9-fb903ac44b2a => generated 1485 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:56:03.352436 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-53ee57be-7b8d-4f86-b968-1b1f6a4b917b tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:56:03.353119 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-53ee57be-7b8d-4f86-b968-1b1f6a4b917b tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] [instance: 0b54f1c2-0d9c-4396-8c79-1e43b612b2ba] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:56:03.374706 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-53ee57be-7b8d-4f86-b968-1b1f6a4b917b tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:03.375952 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-53ee57be-7b8d-4f86-b968-1b1f6a4b917b tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:03.376561 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-53ee57be-7b8d-4f86-b968-1b1f6a4b917b tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:03.377446 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-53ee57be-7b8d-4f86-b968-1b1f6a4b917b tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:03.378064 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-53ee57be-7b8d-4f86-b968-1b1f6a4b917b tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:03.378684 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-53ee57be-7b8d-4f86-b968-1b1f6a4b917b tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:03.417522 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=100 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:56:03.910487 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-27fcbb8d-2aa8-4e51-a14e-9d79a4794e10 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab2d64c1cb447f9bfd658408aa07e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ecc8c1389847c7bcd9cd5570d990e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:03.921815 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-27fcbb8d-2aa8-4e51-a14e-9d79a4794e10 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] 10.222.0.60 "GET /compute/v2.1/servers/e7aa796a-60a2-4d5c-a03c-b4ad0ea73811" status: 200 len: 1313 microversion: 2.1 time: 0.829204 Sep 14 08:56:03.924883 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 878/1788] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:56:03 2022] GET /compute/v2.1/servers/e7aa796a-60a2-4d5c-a03c-b4ad0ea73811 => generated 1313 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:56:03.930473 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-eae7990e-2e79-4688-a44c-ba097460e098 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:56:03.933655 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-eae7990e-2e79-4688-a44c-ba097460e098 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: 2098e0b9-b628-4b9e-979b-960c68830fee] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:56:03.941473 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-eae7990e-2e79-4688-a44c-ba097460e098 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:03.943488 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-eae7990e-2e79-4688-a44c-ba097460e098 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:03.944164 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-eae7990e-2e79-4688-a44c-ba097460e098 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:03.945252 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-eae7990e-2e79-4688-a44c-ba097460e098 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:03.945911 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-eae7990e-2e79-4688-a44c-ba097460e098 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:03.946687 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-eae7990e-2e79-4688-a44c-ba097460e098 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:04.006436 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-eae7990e-2e79-4688-a44c-ba097460e098 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/2098e0b9-b628-4b9e-979b-960c68830fee/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075431 Sep 14 08:56:04.015610 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 879/1789] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 14 08:56:03 2022] GET /compute/v2.1/servers/2098e0b9-b628-4b9e-979b-960c68830fee/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:56:04.022737 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-054a8f54-8acb-4719-8ab0-5938843a869c tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:56:04.024084 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-054a8f54-8acb-4719-8ab0-5938843a869c tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] [instance: 0b443b50-3413-4a73-80e7-b217776cbcc9] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:56:04.038049 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-53ee57be-7b8d-4f86-b968-1b1f6a4b917b tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e1780ebcf1413fa4f7a9760b761c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77c85f074ae4b8cb5a1457a5183197b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:04.049335 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-53ee57be-7b8d-4f86-b968-1b1f6a4b917b tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] 10.222.0.60 "GET /compute/v2.1/servers/0b54f1c2-0d9c-4396-8c79-1e43b612b2ba" status: 200 len: 1371 microversion: 2.1 time: 0.700841 Sep 14 08:56:04.049953 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 911/1790] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:56:03 2022] GET /compute/v2.1/servers/0b54f1c2-0d9c-4396-8c79-1e43b612b2ba => generated 1371 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:56:04.083028 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-054a8f54-8acb-4719-8ab0-5938843a869c tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:04.085199 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-054a8f54-8acb-4719-8ab0-5938843a869c tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:04.085660 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-054a8f54-8acb-4719-8ab0-5938843a869c tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:04.086396 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-054a8f54-8acb-4719-8ab0-5938843a869c tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:04.100630 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-054a8f54-8acb-4719-8ab0-5938843a869c tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:04.103695 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-054a8f54-8acb-4719-8ab0-5938843a869c tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:04.109036 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-400392e8-9dac-4af2-9a8e-1d2c2dc73ed6 req-ab8b0a35-e2fd-422d-b51b-ce56d36fc3c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "835d2ec2-e2af-4e09-92bf-37b271626011", "tag": "eb3ddc92-9211-4f37-91fb-186549e2b6cd"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:56:04.156515 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-400392e8-9dac-4af2-9a8e-1d2c2dc73ed6 req-ab8b0a35-e2fd-422d-b51b-ce56d36fc3c5 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:04.157050 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-400392e8-9dac-4af2-9a8e-1d2c2dc73ed6 req-ab8b0a35-e2fd-422d-b51b-ce56d36fc3c5 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:04.163318 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-400392e8-9dac-4af2-9a8e-1d2c2dc73ed6 req-ab8b0a35-e2fd-422d-b51b-ce56d36fc3c5 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:04.204164 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-400392e8-9dac-4af2-9a8e-1d2c2dc73ed6 req-ab8b0a35-e2fd-422d-b51b-ce56d36fc3c5 service nova] Creating event network-changed:eb3ddc92-9211-4f37-91fb-186549e2b6cd for instance 835d2ec2-e2af-4e09-92bf-37b271626011 on n-h1-836830-18 Sep 14 08:56:04.225988 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-400392e8-9dac-4af2-9a8e-1d2c2dc73ed6 req-ab8b0a35-e2fd-422d-b51b-ce56d36fc3c5 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.150064 Sep 14 08:56:04.227364 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 912/1791] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:56:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:56:04.239152 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-bfcfa0b0-735d-4cc0-8c94-b610cf1cbcd4 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:56:04.243352 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-bfcfa0b0-735d-4cc0-8c94-b610cf1cbcd4 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 835d2ec2-e2af-4e09-92bf-37b271626011] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:56:04.263043 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bfcfa0b0-735d-4cc0-8c94-b610cf1cbcd4 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:04.266122 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bfcfa0b0-735d-4cc0-8c94-b610cf1cbcd4 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:04.266803 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bfcfa0b0-735d-4cc0-8c94-b610cf1cbcd4 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:04.270815 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bfcfa0b0-735d-4cc0-8c94-b610cf1cbcd4 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:04.272199 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bfcfa0b0-735d-4cc0-8c94-b610cf1cbcd4 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:04.275723 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bfcfa0b0-735d-4cc0-8c94-b610cf1cbcd4 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:04.812843 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-054a8f54-8acb-4719-8ab0-5938843a869c tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1654b8267f4e47bab09acd39386dc502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff1b40a79024bc583b13bcfdaa05fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:04.824672 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-bfcfa0b0-735d-4cc0-8c94-b610cf1cbcd4 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:04.831224 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-054a8f54-8acb-4719-8ab0-5938843a869c tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] 10.222.0.60 "GET /compute/v2.1/servers/0b443b50-3413-4a73-80e7-b217776cbcc9" status: 200 len: 1348 microversion: 2.1 time: 0.813923 Sep 14 08:56:04.832208 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 880/1792] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:56:04 2022] GET /compute/v2.1/servers/0b443b50-3413-4a73-80e7-b217776cbcc9 => generated 1348 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:56:04.838886 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-844c3698-d488-460c-b29b-44d84c574ee3 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:56:04.839723 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-844c3698-d488-460c-b29b-44d84c574ee3 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: bb621205-f7b7-4823-b3b9-fb903ac44b2a] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:56:04.848362 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-844c3698-d488-460c-b29b-44d84c574ee3 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:04.849131 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-844c3698-d488-460c-b29b-44d84c574ee3 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:04.849760 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-844c3698-d488-460c-b29b-44d84c574ee3 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:04.851550 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-bfcfa0b0-735d-4cc0-8c94-b610cf1cbcd4 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/835d2ec2-e2af-4e09-92bf-37b271626011" status: 200 len: 1292 microversion: 2.1 time: 0.621382 Sep 14 08:56:04.853774 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-844c3698-d488-460c-b29b-44d84c574ee3 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:04.856120 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-844c3698-d488-460c-b29b-44d84c574ee3 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:04.856865 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-844c3698-d488-460c-b29b-44d84c574ee3 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:04.868199 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 913/1793] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:56:04 2022] GET /compute/v2.1/servers/835d2ec2-e2af-4e09-92bf-37b271626011 => generated 1292 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:56:04.883086 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-24a3542a-269a-4af8-92e7-c417943a90bd req-1e2d101b-662d-4f23-98c5-f63e1d482bfa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7aa796a-60a2-4d5c-a03c-b4ad0ea73811", "name": "network-vif-plugged", "status": "completed", "tag": "71dfb3fc-a016-400c-99bc-1b69b34e08e5"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:56:04.898758 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-24a3542a-269a-4af8-92e7-c417943a90bd req-1e2d101b-662d-4f23-98c5-f63e1d482bfa service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:04.903553 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-24a3542a-269a-4af8-92e7-c417943a90bd req-1e2d101b-662d-4f23-98c5-f63e1d482bfa service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:04.904254 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-24a3542a-269a-4af8-92e7-c417943a90bd req-1e2d101b-662d-4f23-98c5-f63e1d482bfa service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:04.933110 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-24a3542a-269a-4af8-92e7-c417943a90bd req-1e2d101b-662d-4f23-98c5-f63e1d482bfa service nova] Creating event network-vif-plugged:71dfb3fc-a016-400c-99bc-1b69b34e08e5 for instance e7aa796a-60a2-4d5c-a03c-b4ad0ea73811 on n-h2-836830-18 Sep 14 08:56:04.938927 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-24a3542a-269a-4af8-92e7-c417943a90bd req-1e2d101b-662d-4f23-98c5-f63e1d482bfa service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069456 Sep 14 08:56:04.940771 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 914/1794] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:56:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:56:04.951784 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-2b943e6c-3577-4b7e-99a0-4bad2eea07d6 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:56:04.955783 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-2b943e6c-3577-4b7e-99a0-4bad2eea07d6 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] [instance: e7aa796a-60a2-4d5c-a03c-b4ad0ea73811] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:56:04.966647 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2b943e6c-3577-4b7e-99a0-4bad2eea07d6 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:04.974857 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2b943e6c-3577-4b7e-99a0-4bad2eea07d6 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:04.975955 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2b943e6c-3577-4b7e-99a0-4bad2eea07d6 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:04.976899 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2b943e6c-3577-4b7e-99a0-4bad2eea07d6 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:04.977536 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2b943e6c-3577-4b7e-99a0-4bad2eea07d6 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:04.978286 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2b943e6c-3577-4b7e-99a0-4bad2eea07d6 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:04.991342 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=2 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:56:05.415766 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-2b943e6c-3577-4b7e-99a0-4bad2eea07d6 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab2d64c1cb447f9bfd658408aa07e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ecc8c1389847c7bcd9cd5570d990e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:05.424916 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-844c3698-d488-460c-b29b-44d84c574ee3 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:05.426660 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-2b943e6c-3577-4b7e-99a0-4bad2eea07d6 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] 10.222.0.60 "GET /compute/v2.1/servers/e7aa796a-60a2-4d5c-a03c-b4ad0ea73811" status: 200 len: 1313 microversion: 2.1 time: 0.484492 Sep 14 08:56:05.427757 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 915/1795] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:56:04 2022] GET /compute/v2.1/servers/e7aa796a-60a2-4d5c-a03c-b4ad0ea73811 => generated 1313 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:56:05.436445 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-0c42a477-e212-4778-a8f0-c39cc6ad504f tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:56:05.439181 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-0c42a477-e212-4778-a8f0-c39cc6ad504f tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: 2098e0b9-b628-4b9e-979b-960c68830fee] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:56:05.442219 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-844c3698-d488-460c-b29b-44d84c574ee3 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:05.443843 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-844c3698-d488-460c-b29b-44d84c574ee3 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:05.445023 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-844c3698-d488-460c-b29b-44d84c574ee3 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/bb621205-f7b7-4823-b3b9-fb903ac44b2a" status: 200 len: 1485 microversion: 2.25 time: 0.611687 Sep 14 08:56:05.445725 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 881/1796] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:56:04 2022] GET /compute/v2.1/servers/bb621205-f7b7-4823-b3b9-fb903ac44b2a => generated 1485 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:56:05.446779 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0c42a477-e212-4778-a8f0-c39cc6ad504f tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:05.447475 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0c42a477-e212-4778-a8f0-c39cc6ad504f tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:05.448685 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0c42a477-e212-4778-a8f0-c39cc6ad504f tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:05.449568 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0c42a477-e212-4778-a8f0-c39cc6ad504f tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:05.450031 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0c42a477-e212-4778-a8f0-c39cc6ad504f tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:05.450632 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0c42a477-e212-4778-a8f0-c39cc6ad504f tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:05.452178 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-22c2c84a-407e-4eba-a03f-341b8af21648 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:56:05.459272 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-22c2c84a-407e-4eba-a03f-341b8af21648 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] [instance: 0b54f1c2-0d9c-4396-8c79-1e43b612b2ba] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:56:05.471661 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-22c2c84a-407e-4eba-a03f-341b8af21648 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:05.472167 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-22c2c84a-407e-4eba-a03f-341b8af21648 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:05.472616 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-22c2c84a-407e-4eba-a03f-341b8af21648 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:05.473369 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-22c2c84a-407e-4eba-a03f-341b8af21648 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:05.473828 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-22c2c84a-407e-4eba-a03f-341b8af21648 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:05.474264 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-22c2c84a-407e-4eba-a03f-341b8af21648 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:05.488778 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-0c42a477-e212-4778-a8f0-c39cc6ad504f tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/2098e0b9-b628-4b9e-979b-960c68830fee/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058108 Sep 14 08:56:05.490176 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 916/1797] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 14 08:56:05 2022] GET /compute/v2.1/servers/2098e0b9-b628-4b9e-979b-960c68830fee/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:56:05.495178 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-9809d045-c2db-4dc3-9811-b4c5ccc41b33 req-990d9632-fb44-481c-a676-8bb21ec55f2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b443b50-3413-4a73-80e7-b217776cbcc9", "tag": "da4407a7-d883-49d1-b24d-fdaed2476682"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:56:05.536989 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-9809d045-c2db-4dc3-9811-b4c5ccc41b33 req-990d9632-fb44-481c-a676-8bb21ec55f2d service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:05.537941 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-9809d045-c2db-4dc3-9811-b4c5ccc41b33 req-990d9632-fb44-481c-a676-8bb21ec55f2d service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:05.538564 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-9809d045-c2db-4dc3-9811-b4c5ccc41b33 req-990d9632-fb44-481c-a676-8bb21ec55f2d service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:05.553508 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-9809d045-c2db-4dc3-9811-b4c5ccc41b33 req-990d9632-fb44-481c-a676-8bb21ec55f2d service nova] Creating event network-changed:da4407a7-d883-49d1-b24d-fdaed2476682 for instance 0b443b50-3413-4a73-80e7-b217776cbcc9 on n-h1-836830-18 Sep 14 08:56:05.560119 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-9809d045-c2db-4dc3-9811-b4c5ccc41b33 req-990d9632-fb44-481c-a676-8bb21ec55f2d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068510 Sep 14 08:56:05.561268 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 917/1798] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:56:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:56:05.639026 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=2 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:56:05.680807 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-22c2c84a-407e-4eba-a03f-341b8af21648 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e1780ebcf1413fa4f7a9760b761c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77c85f074ae4b8cb5a1457a5183197b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:05.694823 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-22c2c84a-407e-4eba-a03f-341b8af21648 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] 10.222.0.60 "GET /compute/v2.1/servers/0b54f1c2-0d9c-4396-8c79-1e43b612b2ba" status: 200 len: 1557 microversion: 2.1 time: 0.243184 Sep 14 08:56:05.695512 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 882/1799] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:56:05 2022] GET /compute/v2.1/servers/0b54f1c2-0d9c-4396-8c79-1e43b612b2ba => generated 1557 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:56:05.722684 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-44a3608d-817c-4623-b2b3-d5db1924fd40 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:56:05.723326 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-44a3608d-817c-4623-b2b3-d5db1924fd40 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] [instance: 0b54f1c2-0d9c-4396-8c79-1e43b612b2ba] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:56:05.728414 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:56:05.744158 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-44a3608d-817c-4623-b2b3-d5db1924fd40 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:05.744664 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-44a3608d-817c-4623-b2b3-d5db1924fd40 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:05.745104 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-44a3608d-817c-4623-b2b3-d5db1924fd40 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:05.748239 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-44a3608d-817c-4623-b2b3-d5db1924fd40 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:05.751827 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-44a3608d-817c-4623-b2b3-d5db1924fd40 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:05.756648 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-44a3608d-817c-4623-b2b3-d5db1924fd40 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:05.853764 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a2a92b72-3f9f-4c39-8617-14ff9d28a1db tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:56:05.855338 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-a2a92b72-3f9f-4c39-8617-14ff9d28a1db tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] [instance: 0b443b50-3413-4a73-80e7-b217776cbcc9] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:56:05.870971 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a2a92b72-3f9f-4c39-8617-14ff9d28a1db tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:05.871852 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a2a92b72-3f9f-4c39-8617-14ff9d28a1db tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:05.872509 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a2a92b72-3f9f-4c39-8617-14ff9d28a1db tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:05.873712 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a2a92b72-3f9f-4c39-8617-14ff9d28a1db tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:05.878764 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a2a92b72-3f9f-4c39-8617-14ff9d28a1db tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:05.879949 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a2a92b72-3f9f-4c39-8617-14ff9d28a1db tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:05.942648 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-44a3608d-817c-4623-b2b3-d5db1924fd40 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] 10.222.0.60 "GET /compute/v2.1/servers/0b54f1c2-0d9c-4396-8c79-1e43b612b2ba/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.226244 Sep 14 08:56:05.943287 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 918/1800] 10.222.0.60 () {58 vars in 1275 bytes} [Wed Sep 14 08:56:05 2022] GET /compute/v2.1/servers/0b54f1c2-0d9c-4396-8c79-1e43b612b2ba/os-interface => generated 284 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:56:05.948006 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-beba61ce-2ebd-42a5-9aba-61e2c7233838 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:56:05.948675 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-beba61ce-2ebd-42a5-9aba-61e2c7233838 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 835d2ec2-e2af-4e09-92bf-37b271626011] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:56:05.982271 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-beba61ce-2ebd-42a5-9aba-61e2c7233838 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:05.982782 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-beba61ce-2ebd-42a5-9aba-61e2c7233838 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:05.983258 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-beba61ce-2ebd-42a5-9aba-61e2c7233838 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:05.984512 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-beba61ce-2ebd-42a5-9aba-61e2c7233838 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:05.988432 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-beba61ce-2ebd-42a5-9aba-61e2c7233838 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:05.988889 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-beba61ce-2ebd-42a5-9aba-61e2c7233838 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:06.490994 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=4 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:56:06.529818 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=24 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:56:07.193209 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-a2a92b72-3f9f-4c39-8617-14ff9d28a1db tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1654b8267f4e47bab09acd39386dc502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff1b40a79024bc583b13bcfdaa05fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:07.206325 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-beba61ce-2ebd-42a5-9aba-61e2c7233838 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:07.215234 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a2a92b72-3f9f-4c39-8617-14ff9d28a1db tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] 10.222.0.60 "GET /compute/v2.1/servers/0b443b50-3413-4a73-80e7-b217776cbcc9" status: 200 len: 1348 microversion: 2.1 time: 1.359926 Sep 14 08:56:07.227291 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-beba61ce-2ebd-42a5-9aba-61e2c7233838 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/835d2ec2-e2af-4e09-92bf-37b271626011" status: 200 len: 1292 microversion: 2.1 time: 1.274256 Sep 14 08:56:07.227987 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 883/1801] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:56:05 2022] GET /compute/v2.1/servers/0b443b50-3413-4a73-80e7-b217776cbcc9 => generated 1348 bytes in 1379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:56:07.237480 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 919/1802] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:56:05 2022] GET /compute/v2.1/servers/835d2ec2-e2af-4e09-92bf-37b271626011 => generated 1292 bytes in 1290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:56:07.241036 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-bd868fc9-2101-41d7-ac8f-15e41bac63ec tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:56:07.244629 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-373bd6de-4321-4b4c-a951-53d3b20b12bf tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:56:07.247827 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-bd868fc9-2101-41d7-ac8f-15e41bac63ec tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] [instance: e7aa796a-60a2-4d5c-a03c-b4ad0ea73811] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:56:07.248443 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-373bd6de-4321-4b4c-a951-53d3b20b12bf tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: bb621205-f7b7-4823-b3b9-fb903ac44b2a] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:56:07.264492 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-373bd6de-4321-4b4c-a951-53d3b20b12bf tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:07.265742 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-373bd6de-4321-4b4c-a951-53d3b20b12bf tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:07.266294 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-373bd6de-4321-4b4c-a951-53d3b20b12bf tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:07.267200 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-373bd6de-4321-4b4c-a951-53d3b20b12bf tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:07.269318 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bd868fc9-2101-41d7-ac8f-15e41bac63ec tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:07.270001 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-373bd6de-4321-4b4c-a951-53d3b20b12bf tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:07.270303 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bd868fc9-2101-41d7-ac8f-15e41bac63ec tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:07.270657 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-373bd6de-4321-4b4c-a951-53d3b20b12bf tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:07.271165 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bd868fc9-2101-41d7-ac8f-15e41bac63ec tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:07.272374 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bd868fc9-2101-41d7-ac8f-15e41bac63ec tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:07.275263 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bd868fc9-2101-41d7-ac8f-15e41bac63ec tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:07.278347 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bd868fc9-2101-41d7-ac8f-15e41bac63ec tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:07.913252 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-bd868fc9-2101-41d7-ac8f-15e41bac63ec tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab2d64c1cb447f9bfd658408aa07e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ecc8c1389847c7bcd9cd5570d990e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:07.927604 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-bd868fc9-2101-41d7-ac8f-15e41bac63ec tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] 10.222.0.60 "GET /compute/v2.1/servers/e7aa796a-60a2-4d5c-a03c-b4ad0ea73811" status: 200 len: 1462 microversion: 2.1 time: 0.698261 Sep 14 08:56:07.933328 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 884/1803] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:56:07 2022] GET /compute/v2.1/servers/e7aa796a-60a2-4d5c-a03c-b4ad0ea73811 => generated 1462 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:56:07.939218 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d2ae1336-8cf2-44f5-9a1b-7f4a47a96813 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:56:07.949630 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-d2ae1336-8cf2-44f5-9a1b-7f4a47a96813 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: 2098e0b9-b628-4b9e-979b-960c68830fee] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:56:07.965099 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d2ae1336-8cf2-44f5-9a1b-7f4a47a96813 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:07.968528 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d2ae1336-8cf2-44f5-9a1b-7f4a47a96813 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:07.969297 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d2ae1336-8cf2-44f5-9a1b-7f4a47a96813 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:07.970911 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d2ae1336-8cf2-44f5-9a1b-7f4a47a96813 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:07.971753 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d2ae1336-8cf2-44f5-9a1b-7f4a47a96813 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:07.973883 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d2ae1336-8cf2-44f5-9a1b-7f4a47a96813 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:08.024471 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d2ae1336-8cf2-44f5-9a1b-7f4a47a96813 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/2098e0b9-b628-4b9e-979b-960c68830fee/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089704 Sep 14 08:56:08.025309 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 885/1804] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 14 08:56:07 2022] GET /compute/v2.1/servers/2098e0b9-b628-4b9e-979b-960c68830fee/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:56:08.056781 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-373bd6de-4321-4b4c-a951-53d3b20b12bf tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:08.068980 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-373bd6de-4321-4b4c-a951-53d3b20b12bf tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:08.072053 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-373bd6de-4321-4b4c-a951-53d3b20b12bf tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:08.078812 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-373bd6de-4321-4b4c-a951-53d3b20b12bf tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/bb621205-f7b7-4823-b3b9-fb903ac44b2a" status: 200 len: 1485 microversion: 2.25 time: 0.843295 Sep 14 08:56:08.082234 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 920/1805] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:56:07 2022] GET /compute/v2.1/servers/bb621205-f7b7-4823-b3b9-fb903ac44b2a => generated 1485 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:56:08.248920 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-18b78a5e-0d66-4e2a-a37e-052db6d289e5 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:56:08.251159 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-18b78a5e-0d66-4e2a-a37e-052db6d289e5 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 835d2ec2-e2af-4e09-92bf-37b271626011] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:56:08.269789 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-18b78a5e-0d66-4e2a-a37e-052db6d289e5 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:08.270736 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-18b78a5e-0d66-4e2a-a37e-052db6d289e5 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:08.274365 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-18b78a5e-0d66-4e2a-a37e-052db6d289e5 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:08.277934 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-18b78a5e-0d66-4e2a-a37e-052db6d289e5 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:08.279092 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-18b78a5e-0d66-4e2a-a37e-052db6d289e5 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:08.281573 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-18b78a5e-0d66-4e2a-a37e-052db6d289e5 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:08.634425 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-05e35168-e63f-4395-91a1-9e547a5610be tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:56:08.642865 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-05e35168-e63f-4395-91a1-9e547a5610be tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] Searching by: {'deleted': False, 'project_id': 'c62fac237b454e39830b3af0a93067ae'} {{(pid=128759) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 14 08:56:08.652713 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-05e35168-e63f-4395-91a1-9e547a5610be tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:08.653910 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-05e35168-e63f-4395-91a1-9e547a5610be tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:08.654520 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-05e35168-e63f-4395-91a1-9e547a5610be tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:08.656097 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-05e35168-e63f-4395-91a1-9e547a5610be tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:08.659596 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-05e35168-e63f-4395-91a1-9e547a5610be tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:08.660329 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-05e35168-e63f-4395-91a1-9e547a5610be tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:08.665735 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-18b78a5e-0d66-4e2a-a37e-052db6d289e5 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:08.677067 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-18b78a5e-0d66-4e2a-a37e-052db6d289e5 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/835d2ec2-e2af-4e09-92bf-37b271626011" status: 200 len: 1292 microversion: 2.1 time: 0.434733 Sep 14 08:56:08.697586 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 921/1806] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:56:08 2022] GET /compute/v2.1/servers/835d2ec2-e2af-4e09-92bf-37b271626011 => generated 1292 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:56:08.706261 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-05e35168-e63f-4395-91a1-9e547a5610be tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.679645 Sep 14 08:56:08.707543 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 886/1807] 10.222.0.60 () {58 vars in 1146 bytes} [Wed Sep 14 08:56:08 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 08:56:08.715256 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-37b89921-d548-4a70-a4b3-a4b350bc4bd6 tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:56:08.721465 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-37b89921-d548-4a70-a4b3-a4b350bc4bd6 tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] [instance: 0b443b50-3413-4a73-80e7-b217776cbcc9] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:56:08.733133 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-7e8cdfb1-5226-4063-836d-c495b9f6bee3 tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:56:08.737276 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-37b89921-d548-4a70-a4b3-a4b350bc4bd6 tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:08.738324 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-37b89921-d548-4a70-a4b3-a4b350bc4bd6 tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:08.739517 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-37b89921-d548-4a70-a4b3-a4b350bc4bd6 tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:08.740647 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-37b89921-d548-4a70-a4b3-a4b350bc4bd6 tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:08.741520 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-37b89921-d548-4a70-a4b3-a4b350bc4bd6 tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:08.742278 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-37b89921-d548-4a70-a4b3-a4b350bc4bd6 tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:08.751124 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-7e8cdfb1-5226-4063-836d-c495b9f6bee3 tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] Searching by: {'deleted': False} {{(pid=128759) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 14 08:56:08.766379 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7e8cdfb1-5226-4063-836d-c495b9f6bee3 tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:08.766870 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7e8cdfb1-5226-4063-836d-c495b9f6bee3 tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:08.768549 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7e8cdfb1-5226-4063-836d-c495b9f6bee3 tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:08.770637 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7e8cdfb1-5226-4063-836d-c495b9f6bee3 tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:08.772149 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7e8cdfb1-5226-4063-836d-c495b9f6bee3 tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:08.773613 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7e8cdfb1-5226-4063-836d-c495b9f6bee3 tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:08.970434 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.multi_cell_list [None req-7e8cdfb1-5226-4063-836d-c495b9f6bee3 tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] Listed batch of 13 results from cell out of 1000 limit. Returned 13 total so far. {{(pid=128759) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 14 08:56:09.072709 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-37b89921-d548-4a70-a4b3-a4b350bc4bd6 tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1654b8267f4e47bab09acd39386dc502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff1b40a79024bc583b13bcfdaa05fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:09.086964 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-37b89921-d548-4a70-a4b3-a4b350bc4bd6 tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] 10.222.0.60 "GET /compute/v2.1/servers/0b443b50-3413-4a73-80e7-b217776cbcc9" status: 200 len: 1348 microversion: 2.1 time: 0.382972 Sep 14 08:56:09.092490 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 922/1808] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:56:08 2022] GET /compute/v2.1/servers/0b443b50-3413-4a73-80e7-b217776cbcc9 => generated 1348 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:56:09.109229 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-686650b7-7155-4c8c-a907-5b86dcd130ca tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:56:09.114325 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-686650b7-7155-4c8c-a907-5b86dcd130ca tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: 2098e0b9-b628-4b9e-979b-960c68830fee] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:56:09.135686 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-686650b7-7155-4c8c-a907-5b86dcd130ca tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:09.137244 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-686650b7-7155-4c8c-a907-5b86dcd130ca tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:09.138858 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-686650b7-7155-4c8c-a907-5b86dcd130ca tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:09.141348 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-686650b7-7155-4c8c-a907-5b86dcd130ca tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:09.142913 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-686650b7-7155-4c8c-a907-5b86dcd130ca tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:09.144433 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-686650b7-7155-4c8c-a907-5b86dcd130ca tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:09.197014 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-686650b7-7155-4c8c-a907-5b86dcd130ca tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/2098e0b9-b628-4b9e-979b-960c68830fee/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.102073 Sep 14 08:56:09.200994 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7e8cdfb1-5226-4063-836d-c495b9f6bee3 tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:09.201661 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7e8cdfb1-5226-4063-836d-c495b9f6bee3 tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:09.202100 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7e8cdfb1-5226-4063-836d-c495b9f6bee3 tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:09.204905 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 923/1809] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 14 08:56:09 2022] GET /compute/v2.1/servers/2098e0b9-b628-4b9e-979b-960c68830fee/os-volume_attachments => generated 197 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:56:09.215977 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b36cc3e0-7eaf-4445-8952-7db63b43935c tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:56:09.218148 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-b36cc3e0-7eaf-4445-8952-7db63b43935c tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: bb621205-f7b7-4823-b3b9-fb903ac44b2a] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:56:09.231817 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b36cc3e0-7eaf-4445-8952-7db63b43935c tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:09.232255 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b36cc3e0-7eaf-4445-8952-7db63b43935c tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:09.232701 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b36cc3e0-7eaf-4445-8952-7db63b43935c tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:09.234038 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b36cc3e0-7eaf-4445-8952-7db63b43935c tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:09.234505 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b36cc3e0-7eaf-4445-8952-7db63b43935c tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:09.234953 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b36cc3e0-7eaf-4445-8952-7db63b43935c tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:09.685880 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-b36cc3e0-7eaf-4445-8952-7db63b43935c tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:09.702334 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-b36cc3e0-7eaf-4445-8952-7db63b43935c tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:09.708128 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-b36cc3e0-7eaf-4445-8952-7db63b43935c tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:09.709761 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-b36cc3e0-7eaf-4445-8952-7db63b43935c tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/bb621205-f7b7-4823-b3b9-fb903ac44b2a" status: 200 len: 1485 microversion: 2.25 time: 0.501781 Sep 14 08:56:09.715861 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 924/1810] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:56:09 2022] GET /compute/v2.1/servers/bb621205-f7b7-4823-b3b9-fb903ac44b2a => generated 1485 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:56:09.731516 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-cf8f8e5a-455a-499a-8da0-c8f3b10fcf46 req-ee42d2a0-cac2-4c7e-af71-7e6628c8489a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b54f1c2-0d9c-4396-8c79-1e43b612b2ba", "tag": "a2159b48-787c-4c0e-9fc3-ec5a293b0333"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:56:09.752186 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-cf8f8e5a-455a-499a-8da0-c8f3b10fcf46 req-ee42d2a0-cac2-4c7e-af71-7e6628c8489a service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:09.754441 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-cf8f8e5a-455a-499a-8da0-c8f3b10fcf46 req-ee42d2a0-cac2-4c7e-af71-7e6628c8489a service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:09.755791 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-cf8f8e5a-455a-499a-8da0-c8f3b10fcf46 req-ee42d2a0-cac2-4c7e-af71-7e6628c8489a service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:09.792774 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-cf8f8e5a-455a-499a-8da0-c8f3b10fcf46 req-ee42d2a0-cac2-4c7e-af71-7e6628c8489a service nova] Creating event network-changed:a2159b48-787c-4c0e-9fc3-ec5a293b0333 for instance 0b54f1c2-0d9c-4396-8c79-1e43b612b2ba on n-h1-836830-18 Sep 14 08:56:09.808745 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-cf8f8e5a-455a-499a-8da0-c8f3b10fcf46 req-ee42d2a0-cac2-4c7e-af71-7e6628c8489a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089264 Sep 14 08:56:09.812530 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 925/1811] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:56:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:56:09.830977 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-7b5be287-7fa4-4354-ac89-868fd5c63e04 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:56:09.835105 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-7b5be287-7fa4-4354-ac89-868fd5c63e04 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 835d2ec2-e2af-4e09-92bf-37b271626011] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:56:09.854264 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7b5be287-7fa4-4354-ac89-868fd5c63e04 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:09.855316 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7b5be287-7fa4-4354-ac89-868fd5c63e04 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:09.857314 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7b5be287-7fa4-4354-ac89-868fd5c63e04 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:09.862404 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7b5be287-7fa4-4354-ac89-868fd5c63e04 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:09.864323 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7b5be287-7fa4-4354-ac89-868fd5c63e04 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:09.865889 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7b5be287-7fa4-4354-ac89-868fd5c63e04 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:09.948224 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-7e8cdfb1-5226-4063-836d-c495b9f6bee3 tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 21265 microversion: 2.1 time: 1.218671 Sep 14 08:56:09.949220 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 887/1812] 10.222.0.60 () {58 vars in 1171 bytes} [Wed Sep 14 08:56:08 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 21265 bytes in 1220 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 08:56:09.995537 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3a0fe1f5-8921-4ad7-b863-522a07695df4 tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:56:10.002862 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-3a0fe1f5-8921-4ad7-b863-522a07695df4 tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] Searching by: {'deleted': False, 'project_id': 'c62fac237b454e39830b3af0a93067ae'} {{(pid=128759) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 14 08:56:10.010971 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:56:10.013753 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3a0fe1f5-8921-4ad7-b863-522a07695df4 tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:10.014485 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3a0fe1f5-8921-4ad7-b863-522a07695df4 tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:10.015423 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3a0fe1f5-8921-4ad7-b863-522a07695df4 tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:10.016565 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3a0fe1f5-8921-4ad7-b863-522a07695df4 tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:10.017224 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3a0fe1f5-8921-4ad7-b863-522a07695df4 tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:10.017870 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3a0fe1f5-8921-4ad7-b863-522a07695df4 tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:10.063819 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-3a0fe1f5-8921-4ad7-b863-522a07695df4 tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/detail?tenant_id=51ecc8c1389847c7bcd9cd5570d990e8" status: 200 len: 15 microversion: 2.1 time: 0.071267 Sep 14 08:56:10.081802 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 888/1813] 10.222.0.60 () {58 vars in 1231 bytes} [Wed Sep 14 08:56:09 2022] GET /compute/v2.1/servers/detail?tenant_id=51ecc8c1389847c7bcd9cd5570d990e8 => generated 15 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 14 08:56:10.093541 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f1ad7c7b-2fa0-4932-bc98-ed6ff20f1c47 tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:56:10.101054 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f1ad7c7b-2fa0-4932-bc98-ed6ff20f1c47 tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] Searching by: {'tenant_id': '51ecc8c1389847c7bcd9cd5570d990e8', 'deleted': False} {{(pid=128759) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 14 08:56:10.109774 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f1ad7c7b-2fa0-4932-bc98-ed6ff20f1c47 tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:10.110620 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f1ad7c7b-2fa0-4932-bc98-ed6ff20f1c47 tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:10.111310 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f1ad7c7b-2fa0-4932-bc98-ed6ff20f1c47 tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:10.112609 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f1ad7c7b-2fa0-4932-bc98-ed6ff20f1c47 tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:10.113392 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f1ad7c7b-2fa0-4932-bc98-ed6ff20f1c47 tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:10.114045 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f1ad7c7b-2fa0-4932-bc98-ed6ff20f1c47 tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:10.152922 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.multi_cell_list [None req-f1ad7c7b-2fa0-4932-bc98-ed6ff20f1c47 tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128759) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 14 08:56:10.209421 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f1ad7c7b-2fa0-4932-bc98-ed6ff20f1c47 tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:10.210286 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f1ad7c7b-2fa0-4932-bc98-ed6ff20f1c47 tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:10.211283 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f1ad7c7b-2fa0-4932-bc98-ed6ff20f1c47 tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:10.243839 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-7b5be287-7fa4-4354-ac89-868fd5c63e04 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:10.254052 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-7b5be287-7fa4-4354-ac89-868fd5c63e04 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/835d2ec2-e2af-4e09-92bf-37b271626011" status: 200 len: 1292 microversion: 2.1 time: 0.436939 Sep 14 08:56:10.256011 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 926/1814] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:56:09 2022] GET /compute/v2.1/servers/835d2ec2-e2af-4e09-92bf-37b271626011 => generated 1292 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:56:10.262323 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-86f7c189-6325-4362-88d0-e40b7d158278 tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:56:10.263610 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-86f7c189-6325-4362-88d0-e40b7d158278 tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] [instance: 0b443b50-3413-4a73-80e7-b217776cbcc9] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:56:10.279283 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-86f7c189-6325-4362-88d0-e40b7d158278 tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:10.279790 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-86f7c189-6325-4362-88d0-e40b7d158278 tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:10.281044 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-86f7c189-6325-4362-88d0-e40b7d158278 tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:10.281778 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-86f7c189-6325-4362-88d0-e40b7d158278 tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:10.282234 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-86f7c189-6325-4362-88d0-e40b7d158278 tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:10.282657 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-86f7c189-6325-4362-88d0-e40b7d158278 tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:10.526887 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f1ad7c7b-2fa0-4932-bc98-ed6ff20f1c47 tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=51ecc8c1389847c7bcd9cd5570d990e8" status: 200 len: 4832 microversion: 2.1 time: 0.437856 Sep 14 08:56:10.528081 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 889/1815] 10.222.0.60 () {58 vars in 1257 bytes} [Wed Sep 14 08:56:10 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=51ecc8c1389847c7bcd9cd5570d990e8 => generated 4832 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:56:10.543650 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-935d1a9e-5dc5-4d11-ab8c-fbacd098c512 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:56:10.546059 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-935d1a9e-5dc5-4d11-ab8c-fbacd098c512 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: 2098e0b9-b628-4b9e-979b-960c68830fee] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:56:10.558324 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-935d1a9e-5dc5-4d11-ab8c-fbacd098c512 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:10.559528 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-935d1a9e-5dc5-4d11-ab8c-fbacd098c512 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:10.564018 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-935d1a9e-5dc5-4d11-ab8c-fbacd098c512 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:10.565060 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-935d1a9e-5dc5-4d11-ab8c-fbacd098c512 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:10.565710 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-935d1a9e-5dc5-4d11-ab8c-fbacd098c512 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:10.566580 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-935d1a9e-5dc5-4d11-ab8c-fbacd098c512 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:10.594988 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-86f7c189-6325-4362-88d0-e40b7d158278 tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1654b8267f4e47bab09acd39386dc502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff1b40a79024bc583b13bcfdaa05fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:10.607123 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:56:10.608002 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-86f7c189-6325-4362-88d0-e40b7d158278 tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] 10.222.0.60 "GET /compute/v2.1/servers/0b443b50-3413-4a73-80e7-b217776cbcc9" status: 200 len: 1348 microversion: 2.1 time: 0.348809 Sep 14 08:56:10.610341 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 927/1816] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:56:10 2022] GET /compute/v2.1/servers/0b443b50-3413-4a73-80e7-b217776cbcc9 => generated 1348 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:56:10.616657 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1db02141-aebb-4d65-832f-b5f8a5875bdd tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:56:10.625094 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-1db02141-aebb-4d65-832f-b5f8a5875bdd tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] Searching by: {'tenant_id': 'c62fac237b454e39830b3af0a93067ae', 'deleted': False} {{(pid=128758) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 14 08:56:10.633012 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1db02141-aebb-4d65-832f-b5f8a5875bdd tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:10.633810 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1db02141-aebb-4d65-832f-b5f8a5875bdd tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:10.634472 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1db02141-aebb-4d65-832f-b5f8a5875bdd tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:10.636552 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1db02141-aebb-4d65-832f-b5f8a5875bdd tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:10.637608 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1db02141-aebb-4d65-832f-b5f8a5875bdd tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:10.638262 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1db02141-aebb-4d65-832f-b5f8a5875bdd tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:10.642235 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-935d1a9e-5dc5-4d11-ab8c-fbacd098c512 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/2098e0b9-b628-4b9e-979b-960c68830fee/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.108543 Sep 14 08:56:10.650204 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 890/1817] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 14 08:56:10 2022] GET /compute/v2.1/servers/2098e0b9-b628-4b9e-979b-960c68830fee/os-volume_attachments => generated 197 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:56:10.674825 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-1db02141-aebb-4d65-832f-b5f8a5875bdd tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=c62fac237b454e39830b3af0a93067ae" status: 200 len: 15 microversion: 2.1 time: 0.062914 Sep 14 08:56:10.704843 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 928/1818] 10.222.0.60 () {58 vars in 1257 bytes} [Wed Sep 14 08:56:10 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=c62fac237b454e39830b3af0a93067ae => generated 15 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 08:56:10.713350 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-bc73ba6d-6b55-4a41-a88e-288ccfaa96ed tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:56:10.722403 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-bc73ba6d-6b55-4a41-a88e-288ccfaa96ed tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.017301 Sep 14 08:56:10.729957 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 891/1819] 10.222.0.60 () {58 vars in 1189 bytes} [Wed Sep 14 08:56:10 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 14 08:56:10.759732 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-814d9f76-0e28-474d-b1ce-f1e6785d26a8 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:56:10.760466 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-814d9f76-0e28-474d-b1ce-f1e6785d26a8 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: bb621205-f7b7-4823-b3b9-fb903ac44b2a] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:56:10.760736 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-6dd41670-bd49-4d15-966e-75c8d75cc379 tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:56:10.763127 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-6dd41670-bd49-4d15-966e-75c8d75cc379 tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] [instance: 8dd1623b-312c-411d-8f6c-b334195e573b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:56:10.774334 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6dd41670-bd49-4d15-966e-75c8d75cc379 tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:10.775578 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-814d9f76-0e28-474d-b1ce-f1e6785d26a8 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:10.776840 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6dd41670-bd49-4d15-966e-75c8d75cc379 tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:10.777414 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-814d9f76-0e28-474d-b1ce-f1e6785d26a8 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:10.778271 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-814d9f76-0e28-474d-b1ce-f1e6785d26a8 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:10.778955 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6dd41670-bd49-4d15-966e-75c8d75cc379 tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:10.781941 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6dd41670-bd49-4d15-966e-75c8d75cc379 tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:10.782100 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-814d9f76-0e28-474d-b1ce-f1e6785d26a8 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:10.782686 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-814d9f76-0e28-474d-b1ce-f1e6785d26a8 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:10.782962 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6dd41670-bd49-4d15-966e-75c8d75cc379 tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:10.783419 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6dd41670-bd49-4d15-966e-75c8d75cc379 tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:10.784887 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-814d9f76-0e28-474d-b1ce-f1e6785d26a8 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:11.025895 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-6dd41670-bd49-4d15-966e-75c8d75cc379 tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/8dd1623b-312c-411d-8f6c-b334195e573b/action" status: 202 len: 0 microversion: 2.1 time: 0.269665 Sep 14 08:56:11.030698 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 892/1820] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 08:56:10 2022] POST /compute/v2.1/servers/8dd1623b-312c-411d-8f6c-b334195e573b/action => generated 0 bytes in 275 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 08:56:11.049702 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b4ad6736-3c76-4176-90ff-3ec6cf3c09e7 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:56:11.060139 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b4ad6736-3c76-4176-90ff-3ec6cf3c09e7 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0ab2d64c1cb447f9bfd658408aa07e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ecc8c1389847c7bcd9cd5570d990e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:11.060898 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b4ad6736-3c76-4176-90ff-3ec6cf3c09e7 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': '51ecc8c1389847c7bcd9cd5570d990e8'} {{(pid=128759) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 14 08:56:11.076905 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b4ad6736-3c76-4176-90ff-3ec6cf3c09e7 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:11.077477 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b4ad6736-3c76-4176-90ff-3ec6cf3c09e7 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:11.082590 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b4ad6736-3c76-4176-90ff-3ec6cf3c09e7 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:11.083595 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b4ad6736-3c76-4176-90ff-3ec6cf3c09e7 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:11.084091 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b4ad6736-3c76-4176-90ff-3ec6cf3c09e7 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:11.084535 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b4ad6736-3c76-4176-90ff-3ec6cf3c09e7 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:11.268470 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.multi_cell_list [None req-b4ad6736-3c76-4176-90ff-3ec6cf3c09e7 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128759) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 14 08:56:11.360173 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-814d9f76-0e28-474d-b1ce-f1e6785d26a8 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:11.376537 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-814d9f76-0e28-474d-b1ce-f1e6785d26a8 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:11.379604 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-814d9f76-0e28-474d-b1ce-f1e6785d26a8 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:11.384280 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-814d9f76-0e28-474d-b1ce-f1e6785d26a8 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/bb621205-f7b7-4823-b3b9-fb903ac44b2a" status: 200 len: 1485 microversion: 2.25 time: 0.632226 Sep 14 08:56:11.385081 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 929/1821] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:56:10 2022] GET /compute/v2.1/servers/bb621205-f7b7-4823-b3b9-fb903ac44b2a => generated 1485 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:56:11.404454 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c2a696f8-9170-4255-b1ec-2b60f588405c tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:56:11.406131 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-c2a696f8-9170-4255-b1ec-2b60f588405c tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 835d2ec2-e2af-4e09-92bf-37b271626011] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:56:11.418648 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c2a696f8-9170-4255-b1ec-2b60f588405c tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:11.420210 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c2a696f8-9170-4255-b1ec-2b60f588405c tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:11.423203 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c2a696f8-9170-4255-b1ec-2b60f588405c tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:11.424312 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c2a696f8-9170-4255-b1ec-2b60f588405c tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:11.426811 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c2a696f8-9170-4255-b1ec-2b60f588405c tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:11.427542 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c2a696f8-9170-4255-b1ec-2b60f588405c tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:11.452309 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b4ad6736-3c76-4176-90ff-3ec6cf3c09e7 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] 10.222.0.60 "GET /compute/v2.1/servers?status=error" status: 200 len: 339 microversion: 2.1 time: 0.418397 Sep 14 08:56:11.452905 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 893/1822] 10.222.0.60 () {58 vars in 1150 bytes} [Wed Sep 14 08:56:11 2022] GET /compute/v2.1/servers?status=error => generated 339 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:56:11.478461 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-42be6fcb-5154-43d5-bebe-d183e02a2e4c tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:56:11.480731 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-42be6fcb-5154-43d5-bebe-d183e02a2e4c tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] [instance: 8dd1623b-312c-411d-8f6c-b334195e573b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:56:11.501976 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-42be6fcb-5154-43d5-bebe-d183e02a2e4c tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:11.502473 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-42be6fcb-5154-43d5-bebe-d183e02a2e4c tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:11.502912 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-42be6fcb-5154-43d5-bebe-d183e02a2e4c tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:11.503662 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-42be6fcb-5154-43d5-bebe-d183e02a2e4c tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:11.504112 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-42be6fcb-5154-43d5-bebe-d183e02a2e4c tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:11.504557 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-42be6fcb-5154-43d5-bebe-d183e02a2e4c tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:11.615163 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-c2a696f8-9170-4255-b1ec-2b60f588405c tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:11.626421 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-c2a696f8-9170-4255-b1ec-2b60f588405c tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/835d2ec2-e2af-4e09-92bf-37b271626011" status: 200 len: 1292 microversion: 2.1 time: 0.239606 Sep 14 08:56:11.628101 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 930/1823] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:56:11 2022] GET /compute/v2.1/servers/835d2ec2-e2af-4e09-92bf-37b271626011 => generated 1292 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:56:11.640204 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-290191aa-92b5-4be3-aa1e-3d24d7ffe2ec tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:56:11.641223 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-290191aa-92b5-4be3-aa1e-3d24d7ffe2ec tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] [instance: 0b443b50-3413-4a73-80e7-b217776cbcc9] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:56:11.649252 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-290191aa-92b5-4be3-aa1e-3d24d7ffe2ec tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:11.650539 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-290191aa-92b5-4be3-aa1e-3d24d7ffe2ec tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:11.651365 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-290191aa-92b5-4be3-aa1e-3d24d7ffe2ec tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:11.652565 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-290191aa-92b5-4be3-aa1e-3d24d7ffe2ec tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:11.653215 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-290191aa-92b5-4be3-aa1e-3d24d7ffe2ec tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:11.653879 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-290191aa-92b5-4be3-aa1e-3d24d7ffe2ec tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:11.698286 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-42be6fcb-5154-43d5-bebe-d183e02a2e4c tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/8dd1623b-312c-411d-8f6c-b334195e573b/action" status: 202 len: 0 microversion: 2.1 time: 0.232158 Sep 14 08:56:11.700677 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 894/1824] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 08:56:11 2022] POST /compute/v2.1/servers/8dd1623b-312c-411d-8f6c-b334195e573b/action => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 08:56:11.711268 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8ac6c968-67af-4f6d-ad00-709908b78303 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:56:11.719524 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-8ac6c968-67af-4f6d-ad00-709908b78303 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: 2098e0b9-b628-4b9e-979b-960c68830fee] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:56:11.736841 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8ac6c968-67af-4f6d-ad00-709908b78303 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:11.740270 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8ac6c968-67af-4f6d-ad00-709908b78303 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:11.740984 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8ac6c968-67af-4f6d-ad00-709908b78303 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:11.742637 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8ac6c968-67af-4f6d-ad00-709908b78303 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:11.744077 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8ac6c968-67af-4f6d-ad00-709908b78303 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:11.745858 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8ac6c968-67af-4f6d-ad00-709908b78303 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:11.816189 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-8ac6c968-67af-4f6d-ad00-709908b78303 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/2098e0b9-b628-4b9e-979b-960c68830fee/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.113950 Sep 14 08:56:11.817648 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 895/1825] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 14 08:56:11 2022] GET /compute/v2.1/servers/2098e0b9-b628-4b9e-979b-960c68830fee/os-volume_attachments => generated 25 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 08:56:11.824570 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-6b96db47-a937-4d36-8689-65ea115d9e05 tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:56:11.825804 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-6b96db47-a937-4d36-8689-65ea115d9e05 tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] [instance: 8dd1623b-312c-411d-8f6c-b334195e573b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:56:11.833721 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6b96db47-a937-4d36-8689-65ea115d9e05 tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:11.834615 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6b96db47-a937-4d36-8689-65ea115d9e05 tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:11.835383 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6b96db47-a937-4d36-8689-65ea115d9e05 tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:11.836317 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6b96db47-a937-4d36-8689-65ea115d9e05 tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:11.836955 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6b96db47-a937-4d36-8689-65ea115d9e05 tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:11.837542 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6b96db47-a937-4d36-8689-65ea115d9e05 tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:11.943255 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-290191aa-92b5-4be3-aa1e-3d24d7ffe2ec tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1654b8267f4e47bab09acd39386dc502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff1b40a79024bc583b13bcfdaa05fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:11.954563 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=100 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:56:11.966067 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-290191aa-92b5-4be3-aa1e-3d24d7ffe2ec tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] 10.222.0.60 "GET /compute/v2.1/servers/0b443b50-3413-4a73-80e7-b217776cbcc9" status: 200 len: 1348 microversion: 2.1 time: 0.333209 Sep 14 08:56:11.973082 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 931/1826] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:56:11 2022] GET /compute/v2.1/servers/0b443b50-3413-4a73-80e7-b217776cbcc9 => generated 1348 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:56:11.988596 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-ec273b8d-bffb-4a08-9d67-ebdc8292e83b req-09d5676b-cffb-4c04-b4f1-ca29ace1e817 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "835d2ec2-e2af-4e09-92bf-37b271626011", "name": "network-vif-plugged", "status": "completed", "tag": "eb3ddc92-9211-4f37-91fb-186549e2b6cd"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:56:12.017606 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-ec273b8d-bffb-4a08-9d67-ebdc8292e83b req-09d5676b-cffb-4c04-b4f1-ca29ace1e817 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:12.019568 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-ec273b8d-bffb-4a08-9d67-ebdc8292e83b req-09d5676b-cffb-4c04-b4f1-ca29ace1e817 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:12.020661 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-ec273b8d-bffb-4a08-9d67-ebdc8292e83b req-09d5676b-cffb-4c04-b4f1-ca29ace1e817 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:12.055637 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-ec273b8d-bffb-4a08-9d67-ebdc8292e83b req-09d5676b-cffb-4c04-b4f1-ca29ace1e817 service nova] Creating event network-vif-plugged:eb3ddc92-9211-4f37-91fb-186549e2b6cd for instance 835d2ec2-e2af-4e09-92bf-37b271626011 on n-h1-836830-18 Sep 14 08:56:12.086174 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-ec273b8d-bffb-4a08-9d67-ebdc8292e83b req-09d5676b-cffb-4c04-b4f1-ca29ace1e817 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102555 Sep 14 08:56:12.091917 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 932/1827] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:56:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:56:12.101686 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-6b96db47-a937-4d36-8689-65ea115d9e05 tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/8dd1623b-312c-411d-8f6c-b334195e573b" status: 200 len: 1617 microversion: 2.1 time: 0.282141 Sep 14 08:56:12.106206 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 896/1828] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:56:11 2022] GET /compute/v2.1/servers/8dd1623b-312c-411d-8f6c-b334195e573b => generated 1617 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:56:12.136254 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1363b7f6-0b89-4c41-a83f-61307c06c697 tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:56:12.140421 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-1363b7f6-0b89-4c41-a83f-61307c06c697 tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] [instance: 8dd1623b-312c-411d-8f6c-b334195e573b] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:56:12.153087 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1363b7f6-0b89-4c41-a83f-61307c06c697 tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:12.153753 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1363b7f6-0b89-4c41-a83f-61307c06c697 tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:12.154535 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1363b7f6-0b89-4c41-a83f-61307c06c697 tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:12.156204 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1363b7f6-0b89-4c41-a83f-61307c06c697 tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:12.170849 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1363b7f6-0b89-4c41-a83f-61307c06c697 tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:12.172304 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1363b7f6-0b89-4c41-a83f-61307c06c697 tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:12.420314 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-2e566fb3-f9b8-49aa-b3de-2dc4f26f98a9 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:56:12.422676 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-2e566fb3-f9b8-49aa-b3de-2dc4f26f98a9 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: bb621205-f7b7-4823-b3b9-fb903ac44b2a] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:56:12.434978 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2e566fb3-f9b8-49aa-b3de-2dc4f26f98a9 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:12.437982 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2e566fb3-f9b8-49aa-b3de-2dc4f26f98a9 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:12.439599 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2e566fb3-f9b8-49aa-b3de-2dc4f26f98a9 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:12.443692 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2e566fb3-f9b8-49aa-b3de-2dc4f26f98a9 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:12.447629 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2e566fb3-f9b8-49aa-b3de-2dc4f26f98a9 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:12.448503 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2e566fb3-f9b8-49aa-b3de-2dc4f26f98a9 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:12.674272 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-1363b7f6-0b89-4c41-a83f-61307c06c697 tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/8dd1623b-312c-411d-8f6c-b334195e573b" status: 200 len: 1617 microversion: 2.1 time: 0.543665 Sep 14 08:56:12.674868 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 933/1829] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:56:12 2022] GET /compute/v2.1/servers/8dd1623b-312c-411d-8f6c-b334195e573b => generated 1617 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:56:12.703283 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-2b579a97-4abe-4164-8ea9-81e8a083dd38 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:56:12.709110 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-2b579a97-4abe-4164-8ea9-81e8a083dd38 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 835d2ec2-e2af-4e09-92bf-37b271626011] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:56:12.726642 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2b579a97-4abe-4164-8ea9-81e8a083dd38 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:12.727222 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2b579a97-4abe-4164-8ea9-81e8a083dd38 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:12.727651 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2b579a97-4abe-4164-8ea9-81e8a083dd38 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:12.732046 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2b579a97-4abe-4164-8ea9-81e8a083dd38 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:12.732786 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2b579a97-4abe-4164-8ea9-81e8a083dd38 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:12.733550 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2b579a97-4abe-4164-8ea9-81e8a083dd38 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:13.086843 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-2e566fb3-f9b8-49aa-b3de-2dc4f26f98a9 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:13.111778 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-2e566fb3-f9b8-49aa-b3de-2dc4f26f98a9 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:13.114520 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-2e566fb3-f9b8-49aa-b3de-2dc4f26f98a9 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:13.118643 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-2e566fb3-f9b8-49aa-b3de-2dc4f26f98a9 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/bb621205-f7b7-4823-b3b9-fb903ac44b2a" status: 200 len: 1485 microversion: 2.25 time: 0.704278 Sep 14 08:56:13.121527 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 897/1830] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:56:12 2022] GET /compute/v2.1/servers/bb621205-f7b7-4823-b3b9-fb903ac44b2a => generated 1485 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:56:13.135558 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9d301ee0-9e76-4de0-9b16-f2ccefd04a48 tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:56:13.158445 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-9d301ee0-9e76-4de0-9b16-f2ccefd04a48 tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] Searching by: {'host': 'n-h2-836830-18', 'deleted': False} {{(pid=128759) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 14 08:56:13.172745 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9d301ee0-9e76-4de0-9b16-f2ccefd04a48 tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:13.173246 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9d301ee0-9e76-4de0-9b16-f2ccefd04a48 tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:13.192045 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9d301ee0-9e76-4de0-9b16-f2ccefd04a48 tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:13.193006 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9d301ee0-9e76-4de0-9b16-f2ccefd04a48 tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:13.197804 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9d301ee0-9e76-4de0-9b16-f2ccefd04a48 tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:13.201168 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9d301ee0-9e76-4de0-9b16-f2ccefd04a48 tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:13.208940 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-2b579a97-4abe-4164-8ea9-81e8a083dd38 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:13.219604 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-2b579a97-4abe-4164-8ea9-81e8a083dd38 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/835d2ec2-e2af-4e09-92bf-37b271626011" status: 200 len: 1292 microversion: 2.1 time: 0.538380 Sep 14 08:56:13.250570 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 934/1831] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:56:12 2022] GET /compute/v2.1/servers/835d2ec2-e2af-4e09-92bf-37b271626011 => generated 1292 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:56:13.262427 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-88bafc76-01f0-4f97-a8a6-f2161bd948cf tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:56:13.266039 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-88bafc76-01f0-4f97-a8a6-f2161bd948cf tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] [instance: 0b443b50-3413-4a73-80e7-b217776cbcc9] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:56:13.283660 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-88bafc76-01f0-4f97-a8a6-f2161bd948cf tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:13.284391 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-88bafc76-01f0-4f97-a8a6-f2161bd948cf tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:13.286798 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-88bafc76-01f0-4f97-a8a6-f2161bd948cf tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:13.287815 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-88bafc76-01f0-4f97-a8a6-f2161bd948cf tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:13.290478 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-88bafc76-01f0-4f97-a8a6-f2161bd948cf tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:13.294137 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-88bafc76-01f0-4f97-a8a6-f2161bd948cf tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:13.556268 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.multi_cell_list [None req-9d301ee0-9e76-4de0-9b16-f2ccefd04a48 tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] Listed batch of 7 results from cell out of 1000 limit. Returned 7 total so far. {{(pid=128759) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 14 08:56:13.579218 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-88bafc76-01f0-4f97-a8a6-f2161bd948cf tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1654b8267f4e47bab09acd39386dc502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff1b40a79024bc583b13bcfdaa05fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:13.595284 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-88bafc76-01f0-4f97-a8a6-f2161bd948cf tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] 10.222.0.60 "GET /compute/v2.1/servers/0b443b50-3413-4a73-80e7-b217776cbcc9" status: 200 len: 1348 microversion: 2.1 time: 0.340813 Sep 14 08:56:13.597362 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 935/1832] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:56:13 2022] GET /compute/v2.1/servers/0b443b50-3413-4a73-80e7-b217776cbcc9 => generated 1348 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:56:13.651670 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-9d301ee0-9e76-4de0-9b16-f2ccefd04a48 tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] 10.222.0.60 "GET /compute/v2.1/servers?host=n-h2-836830-18&all_tenants=1" status: 200 len: 2294 microversion: 2.1 time: 0.527895 Sep 14 08:56:13.655721 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 898/1833] 10.222.0.60 () {58 vars in 1192 bytes} [Wed Sep 14 08:56:13 2022] GET /compute/v2.1/servers?host=n-h2-836830-18&all_tenants=1 => generated 2294 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:56:13.666288 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-cb58937a-50be-4a4e-9e13-ea2517f94eac tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:56:13.676050 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-cb58937a-50be-4a4e-9e13-ea2517f94eac tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=128758) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 14 08:56:13.682003 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cb58937a-50be-4a4e-9e13-ea2517f94eac tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:13.682762 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cb58937a-50be-4a4e-9e13-ea2517f94eac tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:13.683411 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cb58937a-50be-4a4e-9e13-ea2517f94eac tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:13.684393 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cb58937a-50be-4a4e-9e13-ea2517f94eac tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:13.685090 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cb58937a-50be-4a4e-9e13-ea2517f94eac tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:13.685699 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cb58937a-50be-4a4e-9e13-ea2517f94eac tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:13.890306 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-cb58937a-50be-4a4e-9e13-ea2517f94eac tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] 10.222.0.60 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.227937 Sep 14 08:56:13.899339 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 936/1834] 10.222.0.60 () {58 vars in 1196 bytes} [Wed Sep 14 08:56:13 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 08:56:13.909923 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-431ba39b-6835-451c-9540-9c78878583a9 tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:56:13.917509 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-431ba39b-6835-451c-9540-9c78878583a9 tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] [instance: 8dd1623b-312c-411d-8f6c-b334195e573b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:56:13.930105 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-431ba39b-6835-451c-9540-9c78878583a9 tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:13.930692 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-431ba39b-6835-451c-9540-9c78878583a9 tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:13.931471 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-431ba39b-6835-451c-9540-9c78878583a9 tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:13.932483 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-431ba39b-6835-451c-9540-9c78878583a9 tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:13.932952 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-431ba39b-6835-451c-9540-9c78878583a9 tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:13.933390 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-431ba39b-6835-451c-9540-9c78878583a9 tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:14.104586 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-431ba39b-6835-451c-9540-9c78878583a9 tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/8dd1623b-312c-411d-8f6c-b334195e573b/action" status: 202 len: 0 microversion: 2.1 time: 0.195253 Sep 14 08:56:14.109642 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 899/1835] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 08:56:13 2022] POST /compute/v2.1/servers/8dd1623b-312c-411d-8f6c-b334195e573b/action => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 08:56:14.117989 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b1377522-92fb-4174-9fd0-4d386e5609d3 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:56:14.121378 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-b1377522-92fb-4174-9fd0-4d386e5609d3 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] [instance: 8dd1623b-312c-411d-8f6c-b334195e573b] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:56:14.133243 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b1377522-92fb-4174-9fd0-4d386e5609d3 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:14.133737 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b1377522-92fb-4174-9fd0-4d386e5609d3 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:14.134188 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b1377522-92fb-4174-9fd0-4d386e5609d3 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:14.134908 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b1377522-92fb-4174-9fd0-4d386e5609d3 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:14.135384 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b1377522-92fb-4174-9fd0-4d386e5609d3 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:14.135999 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b1377522-92fb-4174-9fd0-4d386e5609d3 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:14.157665 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-87f99aa9-93f9-4f00-bd6d-9a90346aee0e tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:56:14.159191 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-87f99aa9-93f9-4f00-bd6d-9a90346aee0e tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: bb621205-f7b7-4823-b3b9-fb903ac44b2a] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:56:14.168645 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-87f99aa9-93f9-4f00-bd6d-9a90346aee0e tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:14.169455 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-87f99aa9-93f9-4f00-bd6d-9a90346aee0e tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:14.170078 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-87f99aa9-93f9-4f00-bd6d-9a90346aee0e tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:14.172018 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-87f99aa9-93f9-4f00-bd6d-9a90346aee0e tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:14.172646 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-87f99aa9-93f9-4f00-bd6d-9a90346aee0e tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:14.173287 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-87f99aa9-93f9-4f00-bd6d-9a90346aee0e tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:14.502978 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-87f99aa9-93f9-4f00-bd6d-9a90346aee0e tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:14.515728 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-87f99aa9-93f9-4f00-bd6d-9a90346aee0e tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:14.518078 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-87f99aa9-93f9-4f00-bd6d-9a90346aee0e tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:14.520051 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-87f99aa9-93f9-4f00-bd6d-9a90346aee0e tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/bb621205-f7b7-4823-b3b9-fb903ac44b2a" status: 200 len: 1485 microversion: 2.25 time: 0.370802 Sep 14 08:56:14.522249 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 900/1836] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:56:14 2022] GET /compute/v2.1/servers/bb621205-f7b7-4823-b3b9-fb903ac44b2a => generated 1485 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:56:14.527873 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f1f0aa1c-9f6c-4c99-b497-4bcd89ec7f3c tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:56:14.528743 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f1f0aa1c-9f6c-4c99-b497-4bcd89ec7f3c tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 835d2ec2-e2af-4e09-92bf-37b271626011] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:56:14.536032 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f1f0aa1c-9f6c-4c99-b497-4bcd89ec7f3c tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:14.537341 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f1f0aa1c-9f6c-4c99-b497-4bcd89ec7f3c tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:14.538079 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f1f0aa1c-9f6c-4c99-b497-4bcd89ec7f3c tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:14.539331 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f1f0aa1c-9f6c-4c99-b497-4bcd89ec7f3c tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:14.540034 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f1f0aa1c-9f6c-4c99-b497-4bcd89ec7f3c tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:14.540762 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f1f0aa1c-9f6c-4c99-b497-4bcd89ec7f3c tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:14.820798 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f1f0aa1c-9f6c-4c99-b497-4bcd89ec7f3c tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:14.839067 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f1f0aa1c-9f6c-4c99-b497-4bcd89ec7f3c tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/835d2ec2-e2af-4e09-92bf-37b271626011" status: 200 len: 1472 microversion: 2.1 time: 0.313748 Sep 14 08:56:14.841234 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 901/1837] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:56:14 2022] GET /compute/v2.1/servers/835d2ec2-e2af-4e09-92bf-37b271626011 => generated 1472 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:56:14.855427 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-832c2ec4-3312-44f0-8b95-5e08f1a25010 tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:56:14.857090 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-832c2ec4-3312-44f0-8b95-5e08f1a25010 tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] [instance: 0b443b50-3413-4a73-80e7-b217776cbcc9] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:56:14.881413 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-832c2ec4-3312-44f0-8b95-5e08f1a25010 tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:14.881924 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-832c2ec4-3312-44f0-8b95-5e08f1a25010 tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:14.883215 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-832c2ec4-3312-44f0-8b95-5e08f1a25010 tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:14.884362 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-832c2ec4-3312-44f0-8b95-5e08f1a25010 tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:14.884864 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-832c2ec4-3312-44f0-8b95-5e08f1a25010 tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:14.885296 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-832c2ec4-3312-44f0-8b95-5e08f1a25010 tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:15.181389 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-832c2ec4-3312-44f0-8b95-5e08f1a25010 tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1654b8267f4e47bab09acd39386dc502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff1b40a79024bc583b13bcfdaa05fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:15.193867 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-832c2ec4-3312-44f0-8b95-5e08f1a25010 tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] 10.222.0.60 "GET /compute/v2.1/servers/0b443b50-3413-4a73-80e7-b217776cbcc9" status: 200 len: 1348 microversion: 2.1 time: 0.349751 Sep 14 08:56:15.195884 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 902/1838] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:56:14 2022] GET /compute/v2.1/servers/0b443b50-3413-4a73-80e7-b217776cbcc9 => generated 1348 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:56:15.207967 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-42c1ac8b-6d64-4ad5-a0dc-d5830bf7ac2f tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1863013910", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:56:19.888968 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.network.neutron [None req-42c1ac8b-6d64-4ad5-a0dc-d5830bf7ac2f tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] validate_networks() for [('238fbc23-0a7b-476b-a552-1a5667de089a', None, None, None, None, None)] {{(pid=128759) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 08:56:19.895175 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-b1377522-92fb-4174-9fd0-4d386e5609d3 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Flavor limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 08:56:19.895707 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-b1377522-92fb-4174-9fd0-4d386e5609d3 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Image limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 08:56:19.896272 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-b1377522-92fb-4174-9fd0-4d386e5609d3 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Flavor pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 08:56:19.896943 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-b1377522-92fb-4174-9fd0-4d386e5609d3 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Image pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 08:56:19.897815 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-b1377522-92fb-4174-9fd0-4d386e5609d3 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 08:56:20.056795 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-b1377522-92fb-4174-9fd0-4d386e5609d3 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] [instance: 8dd1623b-312c-411d-8f6c-b334195e573b] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:56:20.067290 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b1377522-92fb-4174-9fd0-4d386e5609d3 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:20.068044 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b1377522-92fb-4174-9fd0-4d386e5609d3 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:20.069809 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b1377522-92fb-4174-9fd0-4d386e5609d3 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:20.072710 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b1377522-92fb-4174-9fd0-4d386e5609d3 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:20.073397 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b1377522-92fb-4174-9fd0-4d386e5609d3 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:20.074670 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b1377522-92fb-4174-9fd0-4d386e5609d3 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:20.152871 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-b1377522-92fb-4174-9fd0-4d386e5609d3 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] 10.222.0.60 "POST /compute/v2.1/servers/8dd1623b-312c-411d-8f6c-b334195e573b/action" status: 202 len: 1068 microversion: 2.1 time: 6.042627 Sep 14 08:56:20.154972 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 937/1839] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 08:56:14 2022] POST /compute/v2.1/servers/8dd1623b-312c-411d-8f6c-b334195e573b/action => generated 1068 bytes in 6045 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Sep 14 08:56:20.160728 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-9d577937-b7d5-4dc1-a85e-c3ceebca7705 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:56:20.161784 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-9d577937-b7d5-4dc1-a85e-c3ceebca7705 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: bb621205-f7b7-4823-b3b9-fb903ac44b2a] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:56:20.177870 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9d577937-b7d5-4dc1-a85e-c3ceebca7705 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:20.178377 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9d577937-b7d5-4dc1-a85e-c3ceebca7705 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:20.178813 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9d577937-b7d5-4dc1-a85e-c3ceebca7705 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:20.182064 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9d577937-b7d5-4dc1-a85e-c3ceebca7705 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:20.183014 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9d577937-b7d5-4dc1-a85e-c3ceebca7705 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:20.183641 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9d577937-b7d5-4dc1-a85e-c3ceebca7705 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:20.199580 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=4 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:56:20.551513 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-9d577937-b7d5-4dc1-a85e-c3ceebca7705 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:20.572845 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-9d577937-b7d5-4dc1-a85e-c3ceebca7705 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:20.576324 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-9d577937-b7d5-4dc1-a85e-c3ceebca7705 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:20.578198 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-9d577937-b7d5-4dc1-a85e-c3ceebca7705 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/bb621205-f7b7-4823-b3b9-fb903ac44b2a" status: 200 len: 1485 microversion: 2.25 time: 0.421486 Sep 14 08:56:20.597191 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 938/1840] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:56:20 2022] GET /compute/v2.1/servers/bb621205-f7b7-4823-b3b9-fb903ac44b2a => generated 1485 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:56:20.611615 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-17b3b0c3-1913-457c-8745-66031dc2921e req-5412b04d-0629-4626-80de-20708d3ec4f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b443b50-3413-4a73-80e7-b217776cbcc9", "name": "network-vif-plugged", "status": "completed", "tag": "da4407a7-d883-49d1-b24d-fdaed2476682"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:56:20.642045 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-17b3b0c3-1913-457c-8745-66031dc2921e req-5412b04d-0629-4626-80de-20708d3ec4f9 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:20.643385 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-17b3b0c3-1913-457c-8745-66031dc2921e req-5412b04d-0629-4626-80de-20708d3ec4f9 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:20.644202 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-17b3b0c3-1913-457c-8745-66031dc2921e req-5412b04d-0629-4626-80de-20708d3ec4f9 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:20.663922 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-17b3b0c3-1913-457c-8745-66031dc2921e req-5412b04d-0629-4626-80de-20708d3ec4f9 service nova] Creating event network-vif-plugged:da4407a7-d883-49d1-b24d-fdaed2476682 for instance 0b443b50-3413-4a73-80e7-b217776cbcc9 on n-h1-836830-18 Sep 14 08:56:20.673224 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-17b3b0c3-1913-457c-8745-66031dc2921e req-5412b04d-0629-4626-80de-20708d3ec4f9 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069137 Sep 14 08:56:20.674624 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 939/1841] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:56:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:56:20.685229 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d9160259-b0bf-446d-b55e-89ab130c3ea9 tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:56:20.687588 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-d9160259-b0bf-446d-b55e-89ab130c3ea9 tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] [instance: 0b443b50-3413-4a73-80e7-b217776cbcc9] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:56:20.697996 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d9160259-b0bf-446d-b55e-89ab130c3ea9 tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:20.698932 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d9160259-b0bf-446d-b55e-89ab130c3ea9 tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:20.699654 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d9160259-b0bf-446d-b55e-89ab130c3ea9 tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:20.701127 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d9160259-b0bf-446d-b55e-89ab130c3ea9 tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:20.703343 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d9160259-b0bf-446d-b55e-89ab130c3ea9 tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:20.704248 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d9160259-b0bf-446d-b55e-89ab130c3ea9 tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:21.851866 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-d9160259-b0bf-446d-b55e-89ab130c3ea9 tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1654b8267f4e47bab09acd39386dc502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff1b40a79024bc583b13bcfdaa05fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:21.866334 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-d9160259-b0bf-446d-b55e-89ab130c3ea9 tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] 10.222.0.60 "GET /compute/v2.1/servers/0b443b50-3413-4a73-80e7-b217776cbcc9" status: 200 len: 1348 microversion: 2.1 time: 1.189987 Sep 14 08:56:21.870183 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 940/1842] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:56:20 2022] GET /compute/v2.1/servers/0b443b50-3413-4a73-80e7-b217776cbcc9 => generated 1348 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:56:21.876789 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d9245285-ee84-4be9-9ae1-1848adab3ada tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:56:21.877651 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-d9245285-ee84-4be9-9ae1-1848adab3ada tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] [instance: 8dd1623b-312c-411d-8f6c-b334195e573b] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:56:21.897015 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d9245285-ee84-4be9-9ae1-1848adab3ada tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:21.897811 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d9245285-ee84-4be9-9ae1-1848adab3ada tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:21.898494 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d9245285-ee84-4be9-9ae1-1848adab3ada tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:21.900107 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d9245285-ee84-4be9-9ae1-1848adab3ada tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:21.901328 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d9245285-ee84-4be9-9ae1-1848adab3ada tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:21.902791 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d9245285-ee84-4be9-9ae1-1848adab3ada tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:21.949588 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-42c1ac8b-6d64-4ad5-a0dc-d5830bf7ac2f tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Flavor limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 08:56:21.950755 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-42c1ac8b-6d64-4ad5-a0dc-d5830bf7ac2f tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Image limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 08:56:21.951486 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-42c1ac8b-6d64-4ad5-a0dc-d5830bf7ac2f tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Flavor pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 08:56:21.954379 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-42c1ac8b-6d64-4ad5-a0dc-d5830bf7ac2f tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Image pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 08:56:21.957101 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-42c1ac8b-6d64-4ad5-a0dc-d5830bf7ac2f tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 08:56:21.977389 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-42c1ac8b-6d64-4ad5-a0dc-d5830bf7ac2f tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:21.983077 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-42c1ac8b-6d64-4ad5-a0dc-d5830bf7ac2f tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:21.983874 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-42c1ac8b-6d64-4ad5-a0dc-d5830bf7ac2f tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:21.985798 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-42c1ac8b-6d64-4ad5-a0dc-d5830bf7ac2f tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:21.987754 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-42c1ac8b-6d64-4ad5-a0dc-d5830bf7ac2f tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:21.990496 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-42c1ac8b-6d64-4ad5-a0dc-d5830bf7ac2f tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:22.009300 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=3,nova_cell1:UPDATE=6 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:56:22.037145 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-42c1ac8b-6d64-4ad5-a0dc-d5830bf7ac2f tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Getting quotas for project a46ca7b6c331417199f9dfc5ffa80470. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 08:56:22.060917 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-42c1ac8b-6d64-4ad5-a0dc-d5830bf7ac2f tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Getting quotas for user 1473e6771ff1459c831d66311318404d and project a46ca7b6c331417199f9dfc5ffa80470. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 08:56:22.087527 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-42c1ac8b-6d64-4ad5-a0dc-d5830bf7ac2f tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Going to run 1 instances... {{(pid=128759) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 08:56:22.090239 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-42c1ac8b-6d64-4ad5-a0dc-d5830bf7ac2f tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 87bb467f-b214-433c-9df3-3877479de057] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128759) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 08:56:22.168518 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-42c1ac8b-6d64-4ad5-a0dc-d5830bf7ac2f tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.971747 Sep 14 08:56:22.169641 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 903/1843] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 08:56:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 6973 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 08:56:22.177475 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-87ab2227-bbcc-450b-90c5-2eb2987a9097 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:56:22.178343 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-87ab2227-bbcc-450b-90c5-2eb2987a9097 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: bb621205-f7b7-4823-b3b9-fb903ac44b2a] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:56:22.187185 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-87ab2227-bbcc-450b-90c5-2eb2987a9097 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:22.188009 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-87ab2227-bbcc-450b-90c5-2eb2987a9097 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:22.188651 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-87ab2227-bbcc-450b-90c5-2eb2987a9097 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:22.189741 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-87ab2227-bbcc-450b-90c5-2eb2987a9097 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:22.190366 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-87ab2227-bbcc-450b-90c5-2eb2987a9097 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:22.191064 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-87ab2227-bbcc-450b-90c5-2eb2987a9097 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:22.254650 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-d9245285-ee84-4be9-9ae1-1848adab3ada tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab2d64c1cb447f9bfd658408aa07e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ecc8c1389847c7bcd9cd5570d990e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:22.263384 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-d9245285-ee84-4be9-9ae1-1848adab3ada tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] 10.222.0.60 "GET /compute/v2.1/servers/8dd1623b-312c-411d-8f6c-b334195e573b" status: 200 len: 1472 microversion: 2.1 time: 0.391961 Sep 14 08:56:22.271528 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 941/1844] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:56:21 2022] GET /compute/v2.1/servers/8dd1623b-312c-411d-8f6c-b334195e573b => generated 1472 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:56:22.327070 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-9bf9231c-698b-4dce-85a1-6fe15675a25d tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:56:22.327586 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-9bf9231c-698b-4dce-85a1-6fe15675a25d tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 87bb467f-b214-433c-9df3-3877479de057] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:56:22.412007 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-9bf9231c-698b-4dce-85a1-6fe15675a25d tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 87bb467f-b214-433c-9df3-3877479de057] Going to try to terminate instance {{(pid=128758) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 08:56:22.728442 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-87ab2227-bbcc-450b-90c5-2eb2987a9097 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:22.741770 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-87ab2227-bbcc-450b-90c5-2eb2987a9097 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:22.746164 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-87ab2227-bbcc-450b-90c5-2eb2987a9097 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:22.750229 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-87ab2227-bbcc-450b-90c5-2eb2987a9097 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/bb621205-f7b7-4823-b3b9-fb903ac44b2a" status: 200 len: 1485 microversion: 2.25 time: 0.579126 Sep 14 08:56:22.754103 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 904/1845] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:56:22 2022] GET /compute/v2.1/servers/bb621205-f7b7-4823-b3b9-fb903ac44b2a => generated 1485 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:56:22.896350 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-882957af-6bf6-4ce6-8aee-ad0ceb00dd8c tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:56:22.896961 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-882957af-6bf6-4ce6-8aee-ad0ceb00dd8c tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] [instance: 0b443b50-3413-4a73-80e7-b217776cbcc9] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:56:22.915333 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-882957af-6bf6-4ce6-8aee-ad0ceb00dd8c tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:22.915855 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-882957af-6bf6-4ce6-8aee-ad0ceb00dd8c tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:22.916302 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-882957af-6bf6-4ce6-8aee-ad0ceb00dd8c tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:22.924177 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-882957af-6bf6-4ce6-8aee-ad0ceb00dd8c tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:22.927151 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-882957af-6bf6-4ce6-8aee-ad0ceb00dd8c tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:22.929200 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-882957af-6bf6-4ce6-8aee-ad0ceb00dd8c tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:23.090286 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.compute.api [None req-9bf9231c-698b-4dce-85a1-6fe15675a25d tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 87bb467f-b214-433c-9df3-3877479de057] Instance Mapping does not exist while attempting local delete cleanup. Sep 14 08:56:23.091905 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-9bf9231c-698b-4dce-85a1-6fe15675a25d tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "DELETE /compute/v2.1/servers/87bb467f-b214-433c-9df3-3877479de057" status: 204 len: 0 microversion: 2.1 time: 0.817642 Sep 14 08:56:23.093495 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 942/1846] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 08:56:22 2022] DELETE /compute/v2.1/servers/87bb467f-b214-433c-9df3-3877479de057 => generated 0 bytes in 821 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 08:56:23.108532 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-bfffe8fc-e948-4382-adab-51a35535651c tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:56:23.113841 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-bfffe8fc-e948-4382-adab-51a35535651c tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 87bb467f-b214-433c-9df3-3877479de057] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:56:23.140497 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-bfffe8fc-e948-4382-adab-51a35535651c tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] HTTP exception thrown: Instance 87bb467f-b214-433c-9df3-3877479de057 could not be found. Sep 14 08:56:23.149664 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-bfffe8fc-e948-4382-adab-51a35535651c tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Request method failure captured: Sep 14 08:56:23.149664 n-d-836830-18 devstack@n-api.service[128758]: request: GET /compute/v2.1/servers/87bb467f-b214-433c-9df3-3877479de057 HTTP/1.1 Sep 14 08:56:23.149664 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 08:56:23.149664 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 08:56:23.149664 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 08:56:23.149664 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 08:56:23.149664 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 08:56:23.149664 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 08:56:23.149664 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 08:56:23.149664 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 08:56:23.149664 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZcaJwfflKXdBQOzu63TKkiZhpOhYfmFkGJTkIRAE47xWaYCE5owpMd6ZGj3T_7h70-IX-88ov5m9P47-8wvvyB1aoACyyMztTclo7X0AZdOhAhE2WQeLs1dhX-NF72boJ9SoR98XdGx2ROr7Y4PciafvjdUpaADdFYghsgULitlVHs Sep 14 08:56:23.149664 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 08:56:23.149664 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 08:56:23.149664 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 08:56:23.149664 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 08:56:23.149664 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 08:56:23.149664 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 08:56:23.149664 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: a46ca7b6c331417199f9dfc5ffa80470 Sep 14 08:56:23.149664 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-ServersTestJSON-1483820673 Sep 14 08:56:23.149664 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 08:56:23.149664 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 08:56:23.149664 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a46ca7b6c331417199f9dfc5ffa80470"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a46ca7b6c331417199f9dfc5ffa80470"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a46ca7b6c331417199f9dfc5ffa80470"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a46ca7b6c331417199f9dfc5ffa80470"}]}] Sep 14 08:56:23.149664 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-ServersTestJSON-1483820673 Sep 14 08:56:23.149664 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: a46ca7b6c331417199f9dfc5ffa80470 Sep 14 08:56:23.149664 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-ServersTestJSON-1483820673 Sep 14 08:56:23.149664 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-ServersTestJSON-1483820673-project Sep 14 08:56:23.149664 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 08:56:23.149664 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 08:56:23.149664 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 1473e6771ff1459c831d66311318404d Sep 14 08:56:23.149664 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-ServersTestJSON-1483820673-project Sep 14 08:56:23.149664 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 08:56:23.149664 n-d-836830-18 devstack@n-api.service[128758]: exception: Instance 87bb467f-b214-433c-9df3-3877479de057 could not be found. Sep 14 08:56:23.149664 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': '87bb467f-b214-433c-9df3-3877479de057'} Sep 14 08:56:23.149664 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:56:23.149664 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:56:23.149664 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 08:56:23.149664 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 08:56:23.149664 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 08:56:23.149664 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 08:56:23.149664 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 14 08:56:23.149664 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 14 08:56:23.149664 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87bb467f-b214-433c-9df3-3877479de057 could not be found. Sep 14 08:56:23.149664 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:56:23.149664 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:56:23.149664 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:56:23.149664 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:56:23.149664 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:56:23.149664 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:56:23.149664 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:56:23.149664 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:56:23.149664 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:56:23.149664 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:56:23.149664 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 08:56:23.149664 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 08:56:23.149664 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 08:56:23.149664 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 08:56:23.149664 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 08:56:23.149664 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 08:56:23.149664 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87bb467f-b214-433c-9df3-3877479de057 could not be found. Sep 14 08:56:23.149664 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:56:23.149664 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:56:23.149664 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:56:23.149664 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:56:23.149664 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:56:23.161465 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:56:23.161465 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:56:23.161465 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:56:23.161465 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87bb467f-b214-433c-9df3-3877479de057 could not be found. Sep 14 08:56:23.161465 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:56:23.165585 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-bfffe8fc-e948-4382-adab-51a35535651c tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Returning 404 to user: Instance 87bb467f-b214-433c-9df3-3877479de057 could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:56:23.165585 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-bfffe8fc-e948-4382-adab-51a35535651c tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/87bb467f-b214-433c-9df3-3877479de057" status: 404 len: 111 microversion: 2.1 time: 0.065512 Sep 14 08:56:23.165585 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 943/1847] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:56:23 2022] GET /compute/v2.1/servers/87bb467f-b214-433c-9df3-3877479de057 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 08:56:23.301144 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b71c6de1-e3f4-4cbd-8455-ab01dafdef38 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:56:23.302614 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-b71c6de1-e3f4-4cbd-8455-ab01dafdef38 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] [instance: 8dd1623b-312c-411d-8f6c-b334195e573b] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:56:23.327740 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b71c6de1-e3f4-4cbd-8455-ab01dafdef38 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:23.327740 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b71c6de1-e3f4-4cbd-8455-ab01dafdef38 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:23.328096 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b71c6de1-e3f4-4cbd-8455-ab01dafdef38 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:23.338176 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b71c6de1-e3f4-4cbd-8455-ab01dafdef38 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:23.338671 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b71c6de1-e3f4-4cbd-8455-ab01dafdef38 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:23.339163 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b71c6de1-e3f4-4cbd-8455-ab01dafdef38 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:23.503305 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-882957af-6bf6-4ce6-8aee-ad0ceb00dd8c tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1654b8267f4e47bab09acd39386dc502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff1b40a79024bc583b13bcfdaa05fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:23.524292 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-882957af-6bf6-4ce6-8aee-ad0ceb00dd8c tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] 10.222.0.60 "GET /compute/v2.1/servers/0b443b50-3413-4a73-80e7-b217776cbcc9" status: 200 len: 1348 microversion: 2.1 time: 0.631977 Sep 14 08:56:23.542358 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 905/1848] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:56:22 2022] GET /compute/v2.1/servers/0b443b50-3413-4a73-80e7-b217776cbcc9 => generated 1348 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:56:23.576861 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f568c9fd-33c8-403d-89b6-02f0b7eb5cd6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-2033251814", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "238fbc23-0a7b-476b-a552-1a5667de089a"}]}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:56:23.747677 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.network.neutron [None req-f568c9fd-33c8-403d-89b6-02f0b7eb5cd6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] validate_networks() for [('238fbc23-0a7b-476b-a552-1a5667de089a', None, None, None, None, None)] {{(pid=128759) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 08:56:23.764720 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=4 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:56:23.877246 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-b71c6de1-e3f4-4cbd-8455-ab01dafdef38 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab2d64c1cb447f9bfd658408aa07e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ecc8c1389847c7bcd9cd5570d990e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:23.885434 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-b71c6de1-e3f4-4cbd-8455-ab01dafdef38 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] 10.222.0.60 "GET /compute/v2.1/servers/8dd1623b-312c-411d-8f6c-b334195e573b" status: 200 len: 1472 microversion: 2.1 time: 0.590104 Sep 14 08:56:23.886028 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 944/1849] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:56:23 2022] GET /compute/v2.1/servers/8dd1623b-312c-411d-8f6c-b334195e573b => generated 1472 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:56:23.891197 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b00d0db2-7e8f-49e9-b14e-432170df4468 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:56:23.891816 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-b00d0db2-7e8f-49e9-b14e-432170df4468 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: bb621205-f7b7-4823-b3b9-fb903ac44b2a] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:56:23.962506 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b00d0db2-7e8f-49e9-b14e-432170df4468 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:23.970452 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b00d0db2-7e8f-49e9-b14e-432170df4468 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:23.971978 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b00d0db2-7e8f-49e9-b14e-432170df4468 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:23.973192 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b00d0db2-7e8f-49e9-b14e-432170df4468 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:23.973850 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b00d0db2-7e8f-49e9-b14e-432170df4468 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:23.974457 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b00d0db2-7e8f-49e9-b14e-432170df4468 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:24.321443 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-b00d0db2-7e8f-49e9-b14e-432170df4468 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:24.362197 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-b00d0db2-7e8f-49e9-b14e-432170df4468 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:24.372204 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-b00d0db2-7e8f-49e9-b14e-432170df4468 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:24.379345 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-b00d0db2-7e8f-49e9-b14e-432170df4468 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/bb621205-f7b7-4823-b3b9-fb903ac44b2a" status: 200 len: 1485 microversion: 2.25 time: 0.492239 Sep 14 08:56:24.385391 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 945/1850] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:56:23 2022] GET /compute/v2.1/servers/bb621205-f7b7-4823-b3b9-fb903ac44b2a => generated 1485 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:56:24.554092 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1de33493-7538-4065-adf1-3785aab59fcf tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:56:24.555421 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-1de33493-7538-4065-adf1-3785aab59fcf tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] [instance: 0b443b50-3413-4a73-80e7-b217776cbcc9] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:56:24.576860 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1de33493-7538-4065-adf1-3785aab59fcf tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:24.577442 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1de33493-7538-4065-adf1-3785aab59fcf tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:24.577888 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1de33493-7538-4065-adf1-3785aab59fcf tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:24.590028 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1de33493-7538-4065-adf1-3785aab59fcf tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:24.590565 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1de33493-7538-4065-adf1-3785aab59fcf tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:24.591020 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1de33493-7538-4065-adf1-3785aab59fcf tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:24.702197 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-f568c9fd-33c8-403d-89b6-02f0b7eb5cd6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Flavor limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 08:56:24.703398 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-f568c9fd-33c8-403d-89b6-02f0b7eb5cd6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Image limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 08:56:24.704046 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-f568c9fd-33c8-403d-89b6-02f0b7eb5cd6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Flavor pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 08:56:24.704643 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-f568c9fd-33c8-403d-89b6-02f0b7eb5cd6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Image pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 08:56:24.705286 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-f568c9fd-33c8-403d-89b6-02f0b7eb5cd6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 08:56:24.724907 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f568c9fd-33c8-403d-89b6-02f0b7eb5cd6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:24.725414 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f568c9fd-33c8-403d-89b6-02f0b7eb5cd6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:24.725857 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f568c9fd-33c8-403d-89b6-02f0b7eb5cd6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:24.726592 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f568c9fd-33c8-403d-89b6-02f0b7eb5cd6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:24.727091 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f568c9fd-33c8-403d-89b6-02f0b7eb5cd6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:24.727522 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f568c9fd-33c8-403d-89b6-02f0b7eb5cd6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:24.807435 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-f568c9fd-33c8-403d-89b6-02f0b7eb5cd6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Getting quotas for project a46ca7b6c331417199f9dfc5ffa80470. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 08:56:24.826471 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-f568c9fd-33c8-403d-89b6-02f0b7eb5cd6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Getting quotas for user 1473e6771ff1459c831d66311318404d and project a46ca7b6c331417199f9dfc5ffa80470. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 08:56:24.880499 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f568c9fd-33c8-403d-89b6-02f0b7eb5cd6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Going to run 1 instances... {{(pid=128759) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 08:56:24.887729 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f568c9fd-33c8-403d-89b6-02f0b7eb5cd6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 08693908-da78-40e6-ae86-516643c61a3b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128759) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 08:56:24.920057 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-1de33493-7538-4065-adf1-3785aab59fcf tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1654b8267f4e47bab09acd39386dc502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff1b40a79024bc583b13bcfdaa05fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:24.937421 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-1de33493-7538-4065-adf1-3785aab59fcf tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] 10.222.0.60 "GET /compute/v2.1/servers/0b443b50-3413-4a73-80e7-b217776cbcc9" status: 200 len: 1538 microversion: 2.1 time: 0.387064 Sep 14 08:56:24.952324 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 946/1851] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:56:24 2022] GET /compute/v2.1/servers/0b443b50-3413-4a73-80e7-b217776cbcc9 => generated 1538 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:56:24.970271 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-6f9e0086-db9b-4427-8c8b-87fd59d7c1f0 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:56:24.971284 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-6f9e0086-db9b-4427-8c8b-87fd59d7c1f0 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] [instance: 8dd1623b-312c-411d-8f6c-b334195e573b] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:56:24.991204 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6f9e0086-db9b-4427-8c8b-87fd59d7c1f0 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:24.992083 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6f9e0086-db9b-4427-8c8b-87fd59d7c1f0 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:24.992689 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6f9e0086-db9b-4427-8c8b-87fd59d7c1f0 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:24.993581 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6f9e0086-db9b-4427-8c8b-87fd59d7c1f0 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:24.994342 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6f9e0086-db9b-4427-8c8b-87fd59d7c1f0 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:24.994981 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6f9e0086-db9b-4427-8c8b-87fd59d7c1f0 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:25.054006 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f568c9fd-33c8-403d-89b6-02f0b7eb5cd6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.505060 Sep 14 08:56:25.058117 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 906/1852] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 08:56:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1515 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 08:56:25.069474 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9320a80d-4606-4975-9d66-3688547eb869 tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:56:25.076230 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-9320a80d-4606-4975-9d66-3688547eb869 tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] [instance: 0b443b50-3413-4a73-80e7-b217776cbcc9] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:56:25.099419 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9320a80d-4606-4975-9d66-3688547eb869 tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:25.101712 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9320a80d-4606-4975-9d66-3688547eb869 tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:25.104466 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9320a80d-4606-4975-9d66-3688547eb869 tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:25.107094 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9320a80d-4606-4975-9d66-3688547eb869 tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:25.107691 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9320a80d-4606-4975-9d66-3688547eb869 tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:25.109242 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9320a80d-4606-4975-9d66-3688547eb869 tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:25.421990 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-9320a80d-4606-4975-9d66-3688547eb869 tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] 10.222.0.60 "GET /compute/v2.1/servers/0b443b50-3413-4a73-80e7-b217776cbcc9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.362137 Sep 14 08:56:25.431171 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 907/1853] 10.222.0.60 () {58 vars in 1275 bytes} [Wed Sep 14 08:56:25 2022] GET /compute/v2.1/servers/0b443b50-3413-4a73-80e7-b217776cbcc9/os-interface => generated 284 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:56:25.437377 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-50f2526d-988d-4efe-a674-d5e5379ecdca tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:56:25.445424 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-50f2526d-988d-4efe-a674-d5e5379ecdca tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 08693908-da78-40e6-ae86-516643c61a3b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:56:25.596004 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-50f2526d-988d-4efe-a674-d5e5379ecdca tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:25.604440 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-50f2526d-988d-4efe-a674-d5e5379ecdca tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/08693908-da78-40e6-ae86-516643c61a3b" status: 200 len: 1221 microversion: 2.1 time: 0.171939 Sep 14 08:56:25.610697 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 908/1854] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:56:25 2022] GET /compute/v2.1/servers/08693908-da78-40e6-ae86-516643c61a3b => generated 1221 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:56:25.617366 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-18a0e71c-5047-4825-a88e-3192d6c9f668 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:56:25.625924 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-18a0e71c-5047-4825-a88e-3192d6c9f668 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: bb621205-f7b7-4823-b3b9-fb903ac44b2a] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:56:25.637341 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-18a0e71c-5047-4825-a88e-3192d6c9f668 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:25.640229 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-18a0e71c-5047-4825-a88e-3192d6c9f668 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:25.651782 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-18a0e71c-5047-4825-a88e-3192d6c9f668 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:25.654728 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-18a0e71c-5047-4825-a88e-3192d6c9f668 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:25.656947 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-18a0e71c-5047-4825-a88e-3192d6c9f668 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:25.657949 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-18a0e71c-5047-4825-a88e-3192d6c9f668 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:25.807982 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-6f9e0086-db9b-4427-8c8b-87fd59d7c1f0 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab2d64c1cb447f9bfd658408aa07e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ecc8c1389847c7bcd9cd5570d990e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:25.817575 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-6f9e0086-db9b-4427-8c8b-87fd59d7c1f0 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] 10.222.0.60 "GET /compute/v2.1/servers/8dd1623b-312c-411d-8f6c-b334195e573b" status: 200 len: 1472 microversion: 2.1 time: 0.864072 Sep 14 08:56:25.818238 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 947/1855] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:56:24 2022] GET /compute/v2.1/servers/8dd1623b-312c-411d-8f6c-b334195e573b => generated 1472 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:56:26.257223 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-18a0e71c-5047-4825-a88e-3192d6c9f668 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:26.273517 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-18a0e71c-5047-4825-a88e-3192d6c9f668 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:26.275948 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-18a0e71c-5047-4825-a88e-3192d6c9f668 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:26.277177 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-18a0e71c-5047-4825-a88e-3192d6c9f668 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/bb621205-f7b7-4823-b3b9-fb903ac44b2a" status: 200 len: 1485 microversion: 2.25 time: 0.663630 Sep 14 08:56:26.277758 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 909/1856] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:56:25 2022] GET /compute/v2.1/servers/bb621205-f7b7-4823-b3b9-fb903ac44b2a => generated 1485 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:56:26.616715 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-b13df810-6e81-42c8-abd5-0f3a1cfddf52 req-ae5f90d9-2406-4fff-9545-78b2bdfd3f6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb621205-f7b7-4823-b3b9-fb903ac44b2a", "name": "network-vif-unplugged", "status": "completed", "tag": "977f076f-2424-4d11-aa54-073389c5051f"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:56:26.637280 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-7badc71c-0f5b-4be2-a92d-ec67a63b8db6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:56:26.638545 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-7badc71c-0f5b-4be2-a92d-ec67a63b8db6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 08693908-da78-40e6-ae86-516643c61a3b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:56:26.641660 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-b13df810-6e81-42c8-abd5-0f3a1cfddf52 req-ae5f90d9-2406-4fff-9545-78b2bdfd3f6b service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:26.642154 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-b13df810-6e81-42c8-abd5-0f3a1cfddf52 req-ae5f90d9-2406-4fff-9545-78b2bdfd3f6b service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:26.644840 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-b13df810-6e81-42c8-abd5-0f3a1cfddf52 req-ae5f90d9-2406-4fff-9545-78b2bdfd3f6b service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:26.654390 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7badc71c-0f5b-4be2-a92d-ec67a63b8db6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:26.657053 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7badc71c-0f5b-4be2-a92d-ec67a63b8db6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:26.657764 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7badc71c-0f5b-4be2-a92d-ec67a63b8db6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:26.661156 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7badc71c-0f5b-4be2-a92d-ec67a63b8db6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:26.661931 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7badc71c-0f5b-4be2-a92d-ec67a63b8db6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:26.662624 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7badc71c-0f5b-4be2-a92d-ec67a63b8db6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:26.686993 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-b13df810-6e81-42c8-abd5-0f3a1cfddf52 req-ae5f90d9-2406-4fff-9545-78b2bdfd3f6b service nova] Creating event network-vif-unplugged:977f076f-2424-4d11-aa54-073389c5051f for instance bb621205-f7b7-4823-b3b9-fb903ac44b2a on n-h1-836830-18 Sep 14 08:56:26.705233 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-b13df810-6e81-42c8-abd5-0f3a1cfddf52 req-ae5f90d9-2406-4fff-9545-78b2bdfd3f6b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.096460 Sep 14 08:56:26.708658 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 948/1857] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:56:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:56:26.845178 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-79199304-b5a7-43f2-b6f9-fa72d65d6580 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:56:26.846876 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-79199304-b5a7-43f2-b6f9-fa72d65d6580 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] [instance: 8dd1623b-312c-411d-8f6c-b334195e573b] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:56:26.849057 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-7badc71c-0f5b-4be2-a92d-ec67a63b8db6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:26.861670 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-79199304-b5a7-43f2-b6f9-fa72d65d6580 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:26.862488 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-79199304-b5a7-43f2-b6f9-fa72d65d6580 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:26.863469 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-79199304-b5a7-43f2-b6f9-fa72d65d6580 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:26.865652 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-79199304-b5a7-43f2-b6f9-fa72d65d6580 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:26.866302 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-79199304-b5a7-43f2-b6f9-fa72d65d6580 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:26.868840 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-79199304-b5a7-43f2-b6f9-fa72d65d6580 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:26.879530 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-7badc71c-0f5b-4be2-a92d-ec67a63b8db6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/08693908-da78-40e6-ae86-516643c61a3b" status: 200 len: 1217 microversion: 2.1 time: 0.246271 Sep 14 08:56:26.894521 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 910/1858] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:56:26 2022] GET /compute/v2.1/servers/08693908-da78-40e6-ae86-516643c61a3b => generated 1217 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:56:27.313854 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-50a5145d-d66b-4f9e-8317-138d5b1ca6ef tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:56:27.316025 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-50a5145d-d66b-4f9e-8317-138d5b1ca6ef tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: bb621205-f7b7-4823-b3b9-fb903ac44b2a] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:56:27.325513 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-50a5145d-d66b-4f9e-8317-138d5b1ca6ef tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:27.326591 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-50a5145d-d66b-4f9e-8317-138d5b1ca6ef tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:27.327366 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-50a5145d-d66b-4f9e-8317-138d5b1ca6ef tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:27.328473 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-50a5145d-d66b-4f9e-8317-138d5b1ca6ef tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:27.329173 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-50a5145d-d66b-4f9e-8317-138d5b1ca6ef tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:27.330246 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-50a5145d-d66b-4f9e-8317-138d5b1ca6ef tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:27.397259 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-79199304-b5a7-43f2-b6f9-fa72d65d6580 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab2d64c1cb447f9bfd658408aa07e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ecc8c1389847c7bcd9cd5570d990e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:27.413194 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-79199304-b5a7-43f2-b6f9-fa72d65d6580 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] 10.222.0.60 "GET /compute/v2.1/servers/8dd1623b-312c-411d-8f6c-b334195e573b" status: 200 len: 1472 microversion: 2.1 time: 0.566458 Sep 14 08:56:27.415367 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 949/1859] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:56:26 2022] GET /compute/v2.1/servers/8dd1623b-312c-411d-8f6c-b334195e573b => generated 1472 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:56:27.684690 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-50a5145d-d66b-4f9e-8317-138d5b1ca6ef tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:27.728808 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-50a5145d-d66b-4f9e-8317-138d5b1ca6ef tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:27.732669 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-50a5145d-d66b-4f9e-8317-138d5b1ca6ef tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:27.736841 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-50a5145d-d66b-4f9e-8317-138d5b1ca6ef tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/bb621205-f7b7-4823-b3b9-fb903ac44b2a" status: 200 len: 1485 microversion: 2.25 time: 0.432059 Sep 14 08:56:27.738432 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 911/1860] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:56:27 2022] GET /compute/v2.1/servers/bb621205-f7b7-4823-b3b9-fb903ac44b2a => generated 1485 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:56:27.937088 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-4f078cfe-ce56-4878-9916-ab88d9df6805 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:56:27.938908 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-4f078cfe-ce56-4878-9916-ab88d9df6805 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 08693908-da78-40e6-ae86-516643c61a3b] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:56:27.947918 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4f078cfe-ce56-4878-9916-ab88d9df6805 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:27.950043 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4f078cfe-ce56-4878-9916-ab88d9df6805 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:27.950672 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4f078cfe-ce56-4878-9916-ab88d9df6805 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:27.951598 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4f078cfe-ce56-4878-9916-ab88d9df6805 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:27.952260 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4f078cfe-ce56-4878-9916-ab88d9df6805 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:27.953146 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4f078cfe-ce56-4878-9916-ab88d9df6805 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:28.125514 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-4f078cfe-ce56-4878-9916-ab88d9df6805 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:28.142979 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-4f078cfe-ce56-4878-9916-ab88d9df6805 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/08693908-da78-40e6-ae86-516643c61a3b" status: 200 len: 1291 microversion: 2.1 time: 0.220032 Sep 14 08:56:28.153162 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 950/1861] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:56:27 2022] GET /compute/v2.1/servers/08693908-da78-40e6-ae86-516643c61a3b => generated 1291 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:56:28.445894 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3da3d69f-fb14-4e0e-95a5-e5353772250d tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:56:28.446492 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-3da3d69f-fb14-4e0e-95a5-e5353772250d tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] [instance: 8dd1623b-312c-411d-8f6c-b334195e573b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:56:28.460184 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3da3d69f-fb14-4e0e-95a5-e5353772250d tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:28.462701 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3da3d69f-fb14-4e0e-95a5-e5353772250d tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:28.465671 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3da3d69f-fb14-4e0e-95a5-e5353772250d tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:28.466695 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3da3d69f-fb14-4e0e-95a5-e5353772250d tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:28.470569 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3da3d69f-fb14-4e0e-95a5-e5353772250d tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:28.472580 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3da3d69f-fb14-4e0e-95a5-e5353772250d tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:28.770422 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-9250c908-f364-45d5-9ffe-b74837e63380 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:56:28.771369 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-9250c908-f364-45d5-9ffe-b74837e63380 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: bb621205-f7b7-4823-b3b9-fb903ac44b2a] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:56:28.785100 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9250c908-f364-45d5-9ffe-b74837e63380 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:28.785921 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9250c908-f364-45d5-9ffe-b74837e63380 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:28.787979 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9250c908-f364-45d5-9ffe-b74837e63380 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:28.789356 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9250c908-f364-45d5-9ffe-b74837e63380 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:28.791165 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9250c908-f364-45d5-9ffe-b74837e63380 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:28.791824 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9250c908-f364-45d5-9ffe-b74837e63380 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:28.798032 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-3da3d69f-fb14-4e0e-95a5-e5353772250d tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab2d64c1cb447f9bfd658408aa07e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ecc8c1389847c7bcd9cd5570d990e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:28.813192 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-3da3d69f-fb14-4e0e-95a5-e5353772250d tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] 10.222.0.60 "GET /compute/v2.1/servers/8dd1623b-312c-411d-8f6c-b334195e573b" status: 200 len: 1472 microversion: 2.1 time: 0.369205 Sep 14 08:56:28.814397 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 912/1862] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:56:28 2022] GET /compute/v2.1/servers/8dd1623b-312c-411d-8f6c-b334195e573b => generated 1472 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:56:28.817675 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:56:28.825046 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-4ff0d3f2-1fbd-450a-a688-4e36c5017830 req-a7bc7516-e896-427a-8d86-3d12d3da121f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb621205-f7b7-4823-b3b9-fb903ac44b2a", "tag": "977f076f-2424-4d11-aa54-073389c5051f"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:56:28.846496 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-4ff0d3f2-1fbd-450a-a688-4e36c5017830 req-a7bc7516-e896-427a-8d86-3d12d3da121f service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:28.847661 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-4ff0d3f2-1fbd-450a-a688-4e36c5017830 req-a7bc7516-e896-427a-8d86-3d12d3da121f service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:28.848343 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-4ff0d3f2-1fbd-450a-a688-4e36c5017830 req-a7bc7516-e896-427a-8d86-3d12d3da121f service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:28.867256 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-4ff0d3f2-1fbd-450a-a688-4e36c5017830 req-a7bc7516-e896-427a-8d86-3d12d3da121f service nova] Creating event network-changed:977f076f-2424-4d11-aa54-073389c5051f for instance bb621205-f7b7-4823-b3b9-fb903ac44b2a on n-h1-836830-18 Sep 14 08:56:28.878583 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-4ff0d3f2-1fbd-450a-a688-4e36c5017830 req-a7bc7516-e896-427a-8d86-3d12d3da121f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062182 Sep 14 08:56:28.885327 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 913/1863] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:56:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:56:29.065332 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-228abcf0-2ce3-496c-ad34-c5c0b6cf41cb req-bf564f55-a512-410a-8dc7-7faa614504e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b443b50-3413-4a73-80e7-b217776cbcc9", "tag": "da4407a7-d883-49d1-b24d-fdaed2476682"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:56:29.094225 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-228abcf0-2ce3-496c-ad34-c5c0b6cf41cb req-bf564f55-a512-410a-8dc7-7faa614504e7 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:29.095135 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-228abcf0-2ce3-496c-ad34-c5c0b6cf41cb req-bf564f55-a512-410a-8dc7-7faa614504e7 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:29.095820 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-228abcf0-2ce3-496c-ad34-c5c0b6cf41cb req-bf564f55-a512-410a-8dc7-7faa614504e7 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:29.192127 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-228abcf0-2ce3-496c-ad34-c5c0b6cf41cb req-bf564f55-a512-410a-8dc7-7faa614504e7 service nova] Creating event network-changed:da4407a7-d883-49d1-b24d-fdaed2476682 for instance 0b443b50-3413-4a73-80e7-b217776cbcc9 on n-h1-836830-18 Sep 14 08:56:29.220780 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-228abcf0-2ce3-496c-ad34-c5c0b6cf41cb req-bf564f55-a512-410a-8dc7-7faa614504e7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.159299 Sep 14 08:56:29.227972 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 914/1864] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:56:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 08:56:29.250823 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-430f046c-3bae-4a6d-a097-daa11283b902 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:56:29.257580 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-430f046c-3bae-4a6d-a097-daa11283b902 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 08693908-da78-40e6-ae86-516643c61a3b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:56:29.272599 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-430f046c-3bae-4a6d-a097-daa11283b902 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:29.275443 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-430f046c-3bae-4a6d-a097-daa11283b902 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:29.276187 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-430f046c-3bae-4a6d-a097-daa11283b902 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:29.279164 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-430f046c-3bae-4a6d-a097-daa11283b902 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:29.281134 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-430f046c-3bae-4a6d-a097-daa11283b902 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:29.283740 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-430f046c-3bae-4a6d-a097-daa11283b902 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:29.724735 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-9250c908-f364-45d5-9ffe-b74837e63380 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:29.734765 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-9250c908-f364-45d5-9ffe-b74837e63380 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:29.740920 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-9250c908-f364-45d5-9ffe-b74837e63380 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:29.744967 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-9250c908-f364-45d5-9ffe-b74837e63380 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/bb621205-f7b7-4823-b3b9-fb903ac44b2a" status: 200 len: 1485 microversion: 2.25 time: 0.981909 Sep 14 08:56:29.745582 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 951/1865] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:56:28 2022] GET /compute/v2.1/servers/bb621205-f7b7-4823-b3b9-fb903ac44b2a => generated 1485 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 08:56:29.839553 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-80de939a-e14a-4872-a115-1e7629c1f2ee tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:56:29.841060 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-80de939a-e14a-4872-a115-1e7629c1f2ee tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] [instance: 8dd1623b-312c-411d-8f6c-b334195e573b] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:56:29.863559 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-80de939a-e14a-4872-a115-1e7629c1f2ee tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:29.864343 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-80de939a-e14a-4872-a115-1e7629c1f2ee tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:29.865003 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-80de939a-e14a-4872-a115-1e7629c1f2ee tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:29.866197 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-80de939a-e14a-4872-a115-1e7629c1f2ee tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:29.868818 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-80de939a-e14a-4872-a115-1e7629c1f2ee tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:29.870143 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-80de939a-e14a-4872-a115-1e7629c1f2ee tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:30.080503 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-430f046c-3bae-4a6d-a097-daa11283b902 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:30.095654 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-430f046c-3bae-4a6d-a097-daa11283b902 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/08693908-da78-40e6-ae86-516643c61a3b" status: 200 len: 1279 microversion: 2.1 time: 0.863649 Sep 14 08:56:30.111574 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 915/1866] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:56:29 2022] GET /compute/v2.1/servers/08693908-da78-40e6-ae86-516643c61a3b => generated 1279 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:56:30.776263 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e2c4b4bb-ac38-47e6-a659-29fe3f8b7cc5 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:56:30.776893 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e2c4b4bb-ac38-47e6-a659-29fe3f8b7cc5 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: bb621205-f7b7-4823-b3b9-fb903ac44b2a] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:56:30.819444 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e2c4b4bb-ac38-47e6-a659-29fe3f8b7cc5 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:30.826050 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e2c4b4bb-ac38-47e6-a659-29fe3f8b7cc5 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:30.826050 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e2c4b4bb-ac38-47e6-a659-29fe3f8b7cc5 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:30.826050 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e2c4b4bb-ac38-47e6-a659-29fe3f8b7cc5 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:30.826050 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e2c4b4bb-ac38-47e6-a659-29fe3f8b7cc5 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:30.826746 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e2c4b4bb-ac38-47e6-a659-29fe3f8b7cc5 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:31.098706 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-80de939a-e14a-4872-a115-1e7629c1f2ee tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab2d64c1cb447f9bfd658408aa07e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ecc8c1389847c7bcd9cd5570d990e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:31.111772 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-80de939a-e14a-4872-a115-1e7629c1f2ee tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] 10.222.0.60 "GET /compute/v2.1/servers/8dd1623b-312c-411d-8f6c-b334195e573b" status: 200 len: 1472 microversion: 2.1 time: 1.275147 Sep 14 08:56:31.112683 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 952/1867] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:56:29 2022] GET /compute/v2.1/servers/8dd1623b-312c-411d-8f6c-b334195e573b => generated 1472 bytes in 1278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:56:31.144942 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ee7d430c-7d0e-4da7-9960-a846cfcfa448 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:56:31.148331 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-ee7d430c-7d0e-4da7-9960-a846cfcfa448 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 08693908-da78-40e6-ae86-516643c61a3b] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:56:31.178724 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ee7d430c-7d0e-4da7-9960-a846cfcfa448 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:31.180814 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ee7d430c-7d0e-4da7-9960-a846cfcfa448 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:31.192794 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ee7d430c-7d0e-4da7-9960-a846cfcfa448 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:31.201493 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ee7d430c-7d0e-4da7-9960-a846cfcfa448 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:31.204185 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ee7d430c-7d0e-4da7-9960-a846cfcfa448 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:31.231899 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ee7d430c-7d0e-4da7-9960-a846cfcfa448 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:31.634815 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-e2c4b4bb-ac38-47e6-a659-29fe3f8b7cc5 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:31.653728 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-e2c4b4bb-ac38-47e6-a659-29fe3f8b7cc5 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:31.659255 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-e2c4b4bb-ac38-47e6-a659-29fe3f8b7cc5 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:31.665115 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e2c4b4bb-ac38-47e6-a659-29fe3f8b7cc5 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/bb621205-f7b7-4823-b3b9-fb903ac44b2a" status: 200 len: 1485 microversion: 2.25 time: 0.892201 Sep 14 08:56:31.686431 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 916/1868] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:56:30 2022] GET /compute/v2.1/servers/bb621205-f7b7-4823-b3b9-fb903ac44b2a => generated 1485 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:56:32.142370 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e0cd3784-803a-46d2-8d5a-1f4ea11a8af9 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:56:32.144140 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e0cd3784-803a-46d2-8d5a-1f4ea11a8af9 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] [instance: 8dd1623b-312c-411d-8f6c-b334195e573b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:56:32.163001 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e0cd3784-803a-46d2-8d5a-1f4ea11a8af9 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:32.171123 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e0cd3784-803a-46d2-8d5a-1f4ea11a8af9 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:32.174409 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e0cd3784-803a-46d2-8d5a-1f4ea11a8af9 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:32.175447 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e0cd3784-803a-46d2-8d5a-1f4ea11a8af9 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:32.177010 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e0cd3784-803a-46d2-8d5a-1f4ea11a8af9 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:32.177667 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e0cd3784-803a-46d2-8d5a-1f4ea11a8af9 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:32.237017 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-ee7d430c-7d0e-4da7-9960-a846cfcfa448 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:32.257614 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-ee7d430c-7d0e-4da7-9960-a846cfcfa448 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/08693908-da78-40e6-ae86-516643c61a3b" status: 200 len: 1321 microversion: 2.1 time: 1.119901 Sep 14 08:56:32.259318 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 953/1869] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:56:31 2022] GET /compute/v2.1/servers/08693908-da78-40e6-ae86-516643c61a3b => generated 1321 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:56:32.694199 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-fefd5eff-591a-40b5-952e-260a13249051 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:56:32.695231 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-fefd5eff-591a-40b5-952e-260a13249051 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: bb621205-f7b7-4823-b3b9-fb903ac44b2a] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:56:32.708087 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=2 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:56:32.719653 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fefd5eff-591a-40b5-952e-260a13249051 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:32.722773 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fefd5eff-591a-40b5-952e-260a13249051 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:32.723585 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fefd5eff-591a-40b5-952e-260a13249051 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:32.729647 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fefd5eff-591a-40b5-952e-260a13249051 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:32.731856 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fefd5eff-591a-40b5-952e-260a13249051 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:32.735313 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fefd5eff-591a-40b5-952e-260a13249051 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:32.900199 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-e0cd3784-803a-46d2-8d5a-1f4ea11a8af9 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab2d64c1cb447f9bfd658408aa07e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ecc8c1389847c7bcd9cd5570d990e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:32.909424 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e0cd3784-803a-46d2-8d5a-1f4ea11a8af9 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] 10.222.0.60 "GET /compute/v2.1/servers/8dd1623b-312c-411d-8f6c-b334195e573b" status: 200 len: 1472 microversion: 2.1 time: 0.771497 Sep 14 08:56:32.910041 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 917/1870] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:56:32 2022] GET /compute/v2.1/servers/8dd1623b-312c-411d-8f6c-b334195e573b => generated 1472 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:56:33.287744 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-62aa1955-71fd-483e-bf22-f6bc2d7895f6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:56:33.288372 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-62aa1955-71fd-483e-bf22-f6bc2d7895f6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 08693908-da78-40e6-ae86-516643c61a3b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:56:33.314487 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-62aa1955-71fd-483e-bf22-f6bc2d7895f6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:33.315012 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-62aa1955-71fd-483e-bf22-f6bc2d7895f6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:33.315462 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-62aa1955-71fd-483e-bf22-f6bc2d7895f6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:33.316256 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-62aa1955-71fd-483e-bf22-f6bc2d7895f6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:33.316778 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-62aa1955-71fd-483e-bf22-f6bc2d7895f6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:33.329686 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-62aa1955-71fd-483e-bf22-f6bc2d7895f6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:33.711688 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-fefd5eff-591a-40b5-952e-260a13249051 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:33.730193 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-fefd5eff-591a-40b5-952e-260a13249051 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:33.743519 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-fefd5eff-591a-40b5-952e-260a13249051 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:33.743519 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-fefd5eff-591a-40b5-952e-260a13249051 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/bb621205-f7b7-4823-b3b9-fb903ac44b2a" status: 200 len: 1485 microversion: 2.25 time: 1.049952 Sep 14 08:56:33.755555 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 954/1871] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:56:32 2022] GET /compute/v2.1/servers/bb621205-f7b7-4823-b3b9-fb903ac44b2a => generated 1485 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 08:56:33.782357 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-0cdd067d-5363-4282-827d-d2b31b4f40fb req-72f043e2-144b-4196-af00-f3cb2a6b6911 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08693908-da78-40e6-ae86-516643c61a3b", "tag": "25da732a-19d1-4f48-8b4f-33a990976065"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:56:33.834729 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-0cdd067d-5363-4282-827d-d2b31b4f40fb req-72f043e2-144b-4196-af00-f3cb2a6b6911 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:33.843614 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-0cdd067d-5363-4282-827d-d2b31b4f40fb req-72f043e2-144b-4196-af00-f3cb2a6b6911 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:33.844080 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-0cdd067d-5363-4282-827d-d2b31b4f40fb req-72f043e2-144b-4196-af00-f3cb2a6b6911 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:33.923926 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-0cdd067d-5363-4282-827d-d2b31b4f40fb req-72f043e2-144b-4196-af00-f3cb2a6b6911 service nova] Creating event network-changed:25da732a-19d1-4f48-8b4f-33a990976065 for instance 08693908-da78-40e6-ae86-516643c61a3b on n-h1-836830-18 Sep 14 08:56:33.943541 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-0cdd067d-5363-4282-827d-d2b31b4f40fb req-72f043e2-144b-4196-af00-f3cb2a6b6911 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.186305 Sep 14 08:56:33.945544 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 955/1872] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:56:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:56:33.962003 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1c06b480-871c-4498-9269-b3399b141808 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:56:33.966915 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-1c06b480-871c-4498-9269-b3399b141808 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] [instance: 8dd1623b-312c-411d-8f6c-b334195e573b] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:56:33.982243 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1c06b480-871c-4498-9269-b3399b141808 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:33.988011 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1c06b480-871c-4498-9269-b3399b141808 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:33.988809 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1c06b480-871c-4498-9269-b3399b141808 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:33.989821 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1c06b480-871c-4498-9269-b3399b141808 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:33.990771 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1c06b480-871c-4498-9269-b3399b141808 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:33.991471 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1c06b480-871c-4498-9269-b3399b141808 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:34.040951 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-62aa1955-71fd-483e-bf22-f6bc2d7895f6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:34.053843 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-62aa1955-71fd-483e-bf22-f6bc2d7895f6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/08693908-da78-40e6-ae86-516643c61a3b" status: 200 len: 1321 microversion: 2.1 time: 0.771147 Sep 14 08:56:34.075137 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 918/1873] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:56:33 2022] GET /compute/v2.1/servers/08693908-da78-40e6-ae86-516643c61a3b => generated 1321 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:56:34.261816 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-1c06b480-871c-4498-9269-b3399b141808 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab2d64c1cb447f9bfd658408aa07e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ecc8c1389847c7bcd9cd5570d990e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:34.278695 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-1c06b480-871c-4498-9269-b3399b141808 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] 10.222.0.60 "GET /compute/v2.1/servers/8dd1623b-312c-411d-8f6c-b334195e573b" status: 200 len: 1472 microversion: 2.1 time: 0.328175 Sep 14 08:56:34.279654 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 956/1874] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:56:33 2022] GET /compute/v2.1/servers/8dd1623b-312c-411d-8f6c-b334195e573b => generated 1472 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:56:34.776243 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ff864586-5286-4bfb-b4d0-562948328647 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:56:34.776985 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-ff864586-5286-4bfb-b4d0-562948328647 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: bb621205-f7b7-4823-b3b9-fb903ac44b2a] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:56:34.790526 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=16 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:56:34.805678 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ff864586-5286-4bfb-b4d0-562948328647 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:34.807339 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ff864586-5286-4bfb-b4d0-562948328647 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:34.808400 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ff864586-5286-4bfb-b4d0-562948328647 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:34.809685 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ff864586-5286-4bfb-b4d0-562948328647 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:34.811106 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ff864586-5286-4bfb-b4d0-562948328647 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:34.812904 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ff864586-5286-4bfb-b4d0-562948328647 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:35.061609 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-ff864586-5286-4bfb-b4d0-562948328647 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:35.071618 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-ff864586-5286-4bfb-b4d0-562948328647 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:35.073199 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-ff864586-5286-4bfb-b4d0-562948328647 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:35.074867 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-ff864586-5286-4bfb-b4d0-562948328647 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/bb621205-f7b7-4823-b3b9-fb903ac44b2a" status: 200 len: 1485 microversion: 2.25 time: 0.307031 Sep 14 08:56:35.084247 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1b501d34-d1c0-4a6a-9d8c-8d5af81bcd22 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:56:35.085768 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-1b501d34-d1c0-4a6a-9d8c-8d5af81bcd22 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 08693908-da78-40e6-ae86-516643c61a3b] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:56:35.087380 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 919/1875] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:56:34 2022] GET /compute/v2.1/servers/bb621205-f7b7-4823-b3b9-fb903ac44b2a => generated 1485 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:56:35.102103 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1b501d34-d1c0-4a6a-9d8c-8d5af81bcd22 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:35.103673 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1b501d34-d1c0-4a6a-9d8c-8d5af81bcd22 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:35.104126 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1b501d34-d1c0-4a6a-9d8c-8d5af81bcd22 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:35.104919 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1b501d34-d1c0-4a6a-9d8c-8d5af81bcd22 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:35.105622 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1b501d34-d1c0-4a6a-9d8c-8d5af81bcd22 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:35.106112 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1b501d34-d1c0-4a6a-9d8c-8d5af81bcd22 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:35.307575 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-be180567-54d7-4d82-b0d0-d7408a714dff tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:56:35.308893 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-be180567-54d7-4d82-b0d0-d7408a714dff tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] [instance: 8dd1623b-312c-411d-8f6c-b334195e573b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:56:35.329148 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-be180567-54d7-4d82-b0d0-d7408a714dff tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:35.329659 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-be180567-54d7-4d82-b0d0-d7408a714dff tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:35.330110 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-be180567-54d7-4d82-b0d0-d7408a714dff tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:35.330831 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-be180567-54d7-4d82-b0d0-d7408a714dff tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:35.355227 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-be180567-54d7-4d82-b0d0-d7408a714dff tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:35.355714 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-be180567-54d7-4d82-b0d0-d7408a714dff tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:35.585669 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-1b501d34-d1c0-4a6a-9d8c-8d5af81bcd22 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:35.600362 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=14 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:56:35.604696 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-1b501d34-d1c0-4a6a-9d8c-8d5af81bcd22 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/08693908-da78-40e6-ae86-516643c61a3b" status: 200 len: 1321 microversion: 2.1 time: 0.526147 Sep 14 08:56:35.626631 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 957/1876] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:56:35 2022] GET /compute/v2.1/servers/08693908-da78-40e6-ae86-516643c61a3b => generated 1321 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:56:35.702662 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-be180567-54d7-4d82-b0d0-d7408a714dff tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab2d64c1cb447f9bfd658408aa07e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ecc8c1389847c7bcd9cd5570d990e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:35.715076 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-be180567-54d7-4d82-b0d0-d7408a714dff tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] 10.222.0.60 "GET /compute/v2.1/servers/8dd1623b-312c-411d-8f6c-b334195e573b" status: 200 len: 1472 microversion: 2.1 time: 0.411090 Sep 14 08:56:35.727888 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 920/1877] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:56:35 2022] GET /compute/v2.1/servers/8dd1623b-312c-411d-8f6c-b334195e573b => generated 1472 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:56:36.106876 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a5508dda-d871-417d-8eb3-c75e56c8ddb5 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:56:36.108357 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-a5508dda-d871-417d-8eb3-c75e56c8ddb5 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: bb621205-f7b7-4823-b3b9-fb903ac44b2a] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:56:36.126519 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:56:36.131259 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a5508dda-d871-417d-8eb3-c75e56c8ddb5 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:36.134560 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a5508dda-d871-417d-8eb3-c75e56c8ddb5 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:36.135596 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a5508dda-d871-417d-8eb3-c75e56c8ddb5 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:36.137270 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a5508dda-d871-417d-8eb3-c75e56c8ddb5 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:36.138193 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a5508dda-d871-417d-8eb3-c75e56c8ddb5 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:36.138821 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a5508dda-d871-417d-8eb3-c75e56c8ddb5 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:36.335823 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-a5508dda-d871-417d-8eb3-c75e56c8ddb5 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:36.346182 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-a5508dda-d871-417d-8eb3-c75e56c8ddb5 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:36.350544 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-a5508dda-d871-417d-8eb3-c75e56c8ddb5 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:36.351800 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-a5508dda-d871-417d-8eb3-c75e56c8ddb5 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/bb621205-f7b7-4823-b3b9-fb903ac44b2a" status: 200 len: 1485 microversion: 2.25 time: 0.252917 Sep 14 08:56:36.353120 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 958/1878] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:56:36 2022] GET /compute/v2.1/servers/bb621205-f7b7-4823-b3b9-fb903ac44b2a => generated 1485 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:56:36.631595 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-4709dd8f-129d-4a10-9143-0e529842c601 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:56:36.632104 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-4709dd8f-129d-4a10-9143-0e529842c601 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 08693908-da78-40e6-ae86-516643c61a3b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:56:36.640362 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4709dd8f-129d-4a10-9143-0e529842c601 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:36.641320 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4709dd8f-129d-4a10-9143-0e529842c601 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:36.641778 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4709dd8f-129d-4a10-9143-0e529842c601 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:36.644322 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4709dd8f-129d-4a10-9143-0e529842c601 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:36.644808 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4709dd8f-129d-4a10-9143-0e529842c601 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:36.645253 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4709dd8f-129d-4a10-9143-0e529842c601 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:36.750704 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-9f34385b-e856-4f97-80ac-96f78c4d16c4 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:56:36.751405 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-9f34385b-e856-4f97-80ac-96f78c4d16c4 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] [instance: 8dd1623b-312c-411d-8f6c-b334195e573b] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:56:36.767730 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9f34385b-e856-4f97-80ac-96f78c4d16c4 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:36.768176 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9f34385b-e856-4f97-80ac-96f78c4d16c4 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:36.768585 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9f34385b-e856-4f97-80ac-96f78c4d16c4 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:36.769311 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9f34385b-e856-4f97-80ac-96f78c4d16c4 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:36.771793 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9f34385b-e856-4f97-80ac-96f78c4d16c4 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:36.772470 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9f34385b-e856-4f97-80ac-96f78c4d16c4 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:36.841371 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-4709dd8f-129d-4a10-9143-0e529842c601 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:36.854101 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-4709dd8f-129d-4a10-9143-0e529842c601 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/08693908-da78-40e6-ae86-516643c61a3b" status: 200 len: 1321 microversion: 2.1 time: 0.226676 Sep 14 08:56:36.854704 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 921/1879] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:56:36 2022] GET /compute/v2.1/servers/08693908-da78-40e6-ae86-516643c61a3b => generated 1321 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:56:37.151780 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-9f34385b-e856-4f97-80ac-96f78c4d16c4 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab2d64c1cb447f9bfd658408aa07e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ecc8c1389847c7bcd9cd5570d990e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:37.170357 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-9f34385b-e856-4f97-80ac-96f78c4d16c4 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] 10.222.0.60 "GET /compute/v2.1/servers/8dd1623b-312c-411d-8f6c-b334195e573b" status: 200 len: 1472 microversion: 2.1 time: 0.424485 Sep 14 08:56:37.194163 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 959/1880] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:56:36 2022] GET /compute/v2.1/servers/8dd1623b-312c-411d-8f6c-b334195e573b => generated 1472 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:56:37.378515 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b03ad60c-dea8-4641-8811-b0ab7d038a2b tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:56:37.385373 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b03ad60c-dea8-4641-8811-b0ab7d038a2b tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: bb621205-f7b7-4823-b3b9-fb903ac44b2a] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:56:37.393463 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:56:37.427498 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b03ad60c-dea8-4641-8811-b0ab7d038a2b tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:37.428766 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b03ad60c-dea8-4641-8811-b0ab7d038a2b tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:37.429325 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b03ad60c-dea8-4641-8811-b0ab7d038a2b tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:37.432286 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b03ad60c-dea8-4641-8811-b0ab7d038a2b tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:37.432771 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b03ad60c-dea8-4641-8811-b0ab7d038a2b tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:37.433212 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b03ad60c-dea8-4641-8811-b0ab7d038a2b tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:37.877828 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c0984479-12a1-4d58-b9f6-9843d6b1d989 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:56:37.878506 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-c0984479-12a1-4d58-b9f6-9843d6b1d989 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 08693908-da78-40e6-ae86-516643c61a3b] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:56:37.892890 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c0984479-12a1-4d58-b9f6-9843d6b1d989 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:37.897529 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c0984479-12a1-4d58-b9f6-9843d6b1d989 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:37.898151 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c0984479-12a1-4d58-b9f6-9843d6b1d989 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:37.899023 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c0984479-12a1-4d58-b9f6-9843d6b1d989 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:37.899980 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c0984479-12a1-4d58-b9f6-9843d6b1d989 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:37.900475 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c0984479-12a1-4d58-b9f6-9843d6b1d989 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:38.255093 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b03ad60c-dea8-4641-8811-b0ab7d038a2b tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:38.273949 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b03ad60c-dea8-4641-8811-b0ab7d038a2b tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:38.280564 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b03ad60c-dea8-4641-8811-b0ab7d038a2b tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:38.286520 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b03ad60c-dea8-4641-8811-b0ab7d038a2b tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/bb621205-f7b7-4823-b3b9-fb903ac44b2a" status: 200 len: 1485 microversion: 2.25 time: 0.910083 Sep 14 08:56:38.290160 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 922/1881] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:56:37 2022] GET /compute/v2.1/servers/bb621205-f7b7-4823-b3b9-fb903ac44b2a => generated 1485 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:56:38.304016 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-7d020e56-e2f7-418b-ad74-94287d4a4443 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:56:38.308749 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-7d020e56-e2f7-418b-ad74-94287d4a4443 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] [instance: 8dd1623b-312c-411d-8f6c-b334195e573b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:56:38.329504 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7d020e56-e2f7-418b-ad74-94287d4a4443 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:38.330379 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7d020e56-e2f7-418b-ad74-94287d4a4443 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:38.332815 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7d020e56-e2f7-418b-ad74-94287d4a4443 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:38.333732 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7d020e56-e2f7-418b-ad74-94287d4a4443 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:38.336742 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7d020e56-e2f7-418b-ad74-94287d4a4443 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:38.337759 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7d020e56-e2f7-418b-ad74-94287d4a4443 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:38.562719 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-c0984479-12a1-4d58-b9f6-9843d6b1d989 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:38.604604 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-7d020e56-e2f7-418b-ad74-94287d4a4443 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab2d64c1cb447f9bfd658408aa07e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ecc8c1389847c7bcd9cd5570d990e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:38.622519 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=100 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:56:38.630055 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-7d020e56-e2f7-418b-ad74-94287d4a4443 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] 10.222.0.60 "GET /compute/v2.1/servers/8dd1623b-312c-411d-8f6c-b334195e573b" status: 200 len: 1472 microversion: 2.1 time: 0.338593 Sep 14 08:56:38.644395 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-c0984479-12a1-4d58-b9f6-9843d6b1d989 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/08693908-da78-40e6-ae86-516643c61a3b" status: 200 len: 1321 microversion: 2.1 time: 0.770412 Sep 14 08:56:38.659175 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 960/1882] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:56:37 2022] GET /compute/v2.1/servers/08693908-da78-40e6-ae86-516643c61a3b => generated 1321 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:56:38.659983 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 923/1883] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:56:38 2022] GET /compute/v2.1/servers/8dd1623b-312c-411d-8f6c-b334195e573b => generated 1472 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:56:39.318017 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-4252d37d-dc90-414c-83bd-126191844a82 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:56:39.318762 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-4252d37d-dc90-414c-83bd-126191844a82 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: bb621205-f7b7-4823-b3b9-fb903ac44b2a] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:56:39.326845 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4252d37d-dc90-414c-83bd-126191844a82 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:39.327711 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4252d37d-dc90-414c-83bd-126191844a82 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:39.328405 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4252d37d-dc90-414c-83bd-126191844a82 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:39.329690 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4252d37d-dc90-414c-83bd-126191844a82 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:39.330242 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4252d37d-dc90-414c-83bd-126191844a82 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:39.330894 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4252d37d-dc90-414c-83bd-126191844a82 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:39.678921 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-4252d37d-dc90-414c-83bd-126191844a82 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:39.692378 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-6f34210e-68e7-48d2-97c8-d5dd48b0a577 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:56:39.693723 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-6f34210e-68e7-48d2-97c8-d5dd48b0a577 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] [instance: 8dd1623b-312c-411d-8f6c-b334195e573b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:56:39.705633 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-4252d37d-dc90-414c-83bd-126191844a82 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:39.719566 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6f34210e-68e7-48d2-97c8-d5dd48b0a577 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:39.732802 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-4252d37d-dc90-414c-83bd-126191844a82 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:39.735401 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-4252d37d-dc90-414c-83bd-126191844a82 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/bb621205-f7b7-4823-b3b9-fb903ac44b2a" status: 200 len: 1485 microversion: 2.25 time: 0.421474 Sep 14 08:56:39.736233 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6f34210e-68e7-48d2-97c8-d5dd48b0a577 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:39.738823 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6f34210e-68e7-48d2-97c8-d5dd48b0a577 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:39.739905 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6f34210e-68e7-48d2-97c8-d5dd48b0a577 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:39.741303 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6f34210e-68e7-48d2-97c8-d5dd48b0a577 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:39.743885 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 961/1884] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:56:39 2022] GET /compute/v2.1/servers/bb621205-f7b7-4823-b3b9-fb903ac44b2a => generated 1485 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:56:39.745335 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6f34210e-68e7-48d2-97c8-d5dd48b0a577 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:39.759887 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-3f689026-0ff2-4fcd-9440-b30caa1c1f8d tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:56:39.763125 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-3f689026-0ff2-4fcd-9440-b30caa1c1f8d tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 08693908-da78-40e6-ae86-516643c61a3b] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:56:39.786860 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3f689026-0ff2-4fcd-9440-b30caa1c1f8d tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:39.789572 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3f689026-0ff2-4fcd-9440-b30caa1c1f8d tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:39.790280 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3f689026-0ff2-4fcd-9440-b30caa1c1f8d tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:39.791306 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3f689026-0ff2-4fcd-9440-b30caa1c1f8d tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:39.794785 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3f689026-0ff2-4fcd-9440-b30caa1c1f8d tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:39.799536 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3f689026-0ff2-4fcd-9440-b30caa1c1f8d tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:40.317392 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-6f34210e-68e7-48d2-97c8-d5dd48b0a577 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab2d64c1cb447f9bfd658408aa07e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ecc8c1389847c7bcd9cd5570d990e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:40.324701 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-3f689026-0ff2-4fcd-9440-b30caa1c1f8d tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:40.330313 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-6f34210e-68e7-48d2-97c8-d5dd48b0a577 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] 10.222.0.60 "GET /compute/v2.1/servers/8dd1623b-312c-411d-8f6c-b334195e573b" status: 200 len: 1472 microversion: 2.1 time: 0.667717 Sep 14 08:56:40.334078 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 924/1885] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:56:39 2022] GET /compute/v2.1/servers/8dd1623b-312c-411d-8f6c-b334195e573b => generated 1472 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:56:40.352744 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-3f689026-0ff2-4fcd-9440-b30caa1c1f8d tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/08693908-da78-40e6-ae86-516643c61a3b" status: 200 len: 1321 microversion: 2.1 time: 0.606373 Sep 14 08:56:40.367723 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 962/1886] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:56:39 2022] GET /compute/v2.1/servers/08693908-da78-40e6-ae86-516643c61a3b => generated 1321 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:56:40.461591 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-bad1ba83-2f83-4229-9134-47fd0a313a5f req-9bd86dbc-6e8e-40a2-97ca-4d94af73260d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08693908-da78-40e6-ae86-516643c61a3b", "name": "network-vif-plugged", "status": "completed", "tag": "25da732a-19d1-4f48-8b4f-33a990976065"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:56:40.498623 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-bad1ba83-2f83-4229-9134-47fd0a313a5f req-9bd86dbc-6e8e-40a2-97ca-4d94af73260d service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:40.503847 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-bad1ba83-2f83-4229-9134-47fd0a313a5f req-9bd86dbc-6e8e-40a2-97ca-4d94af73260d service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:40.504953 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-bad1ba83-2f83-4229-9134-47fd0a313a5f req-9bd86dbc-6e8e-40a2-97ca-4d94af73260d service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:40.544055 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-bad1ba83-2f83-4229-9134-47fd0a313a5f req-9bd86dbc-6e8e-40a2-97ca-4d94af73260d service nova] Creating event network-vif-plugged:25da732a-19d1-4f48-8b4f-33a990976065 for instance 08693908-da78-40e6-ae86-516643c61a3b on n-h1-836830-18 Sep 14 08:56:40.550796 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-bad1ba83-2f83-4229-9134-47fd0a313a5f req-9bd86dbc-6e8e-40a2-97ca-4d94af73260d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094011 Sep 14 08:56:40.552041 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 925/1887] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:56:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:56:40.768151 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-5af37593-b229-4bfb-b388-85cc245746dd tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:56:40.768846 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-5af37593-b229-4bfb-b388-85cc245746dd tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: bb621205-f7b7-4823-b3b9-fb903ac44b2a] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:56:40.783733 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5af37593-b229-4bfb-b388-85cc245746dd tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:40.784627 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5af37593-b229-4bfb-b388-85cc245746dd tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:40.785325 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5af37593-b229-4bfb-b388-85cc245746dd tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:40.786322 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5af37593-b229-4bfb-b388-85cc245746dd tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:40.787073 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5af37593-b229-4bfb-b388-85cc245746dd tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:40.787736 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5af37593-b229-4bfb-b388-85cc245746dd tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:41.074692 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-5af37593-b229-4bfb-b388-85cc245746dd tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:41.084016 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-5af37593-b229-4bfb-b388-85cc245746dd tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:41.085753 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-5af37593-b229-4bfb-b388-85cc245746dd tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:41.087156 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-5af37593-b229-4bfb-b388-85cc245746dd tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/bb621205-f7b7-4823-b3b9-fb903ac44b2a" status: 200 len: 1485 microversion: 2.25 time: 0.323549 Sep 14 08:56:41.102364 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 963/1888] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:56:40 2022] GET /compute/v2.1/servers/bb621205-f7b7-4823-b3b9-fb903ac44b2a => generated 1485 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:56:41.358486 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-cfe92fb8-a49e-484d-b0f5-698e16d0ea9f tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:56:41.359348 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-cfe92fb8-a49e-484d-b0f5-698e16d0ea9f tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] [instance: 8dd1623b-312c-411d-8f6c-b334195e573b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:56:41.376645 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cfe92fb8-a49e-484d-b0f5-698e16d0ea9f tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:41.377135 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cfe92fb8-a49e-484d-b0f5-698e16d0ea9f tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:41.377543 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-e274c652-ebda-4fbd-8e94-bb1e9eb6843b tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:56:41.377716 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cfe92fb8-a49e-484d-b0f5-698e16d0ea9f tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:41.378253 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cfe92fb8-a49e-484d-b0f5-698e16d0ea9f tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:41.378487 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-e274c652-ebda-4fbd-8e94-bb1e9eb6843b tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 08693908-da78-40e6-ae86-516643c61a3b] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:56:41.378748 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cfe92fb8-a49e-484d-b0f5-698e16d0ea9f tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:41.379200 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cfe92fb8-a49e-484d-b0f5-698e16d0ea9f tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:41.389178 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e274c652-ebda-4fbd-8e94-bb1e9eb6843b tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:41.392546 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e274c652-ebda-4fbd-8e94-bb1e9eb6843b tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:41.393104 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e274c652-ebda-4fbd-8e94-bb1e9eb6843b tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:41.394001 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e274c652-ebda-4fbd-8e94-bb1e9eb6843b tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:41.399556 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e274c652-ebda-4fbd-8e94-bb1e9eb6843b tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:41.400137 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e274c652-ebda-4fbd-8e94-bb1e9eb6843b tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:41.796713 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-e274c652-ebda-4fbd-8e94-bb1e9eb6843b tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:41.832895 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-e274c652-ebda-4fbd-8e94-bb1e9eb6843b tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/08693908-da78-40e6-ae86-516643c61a3b" status: 200 len: 1321 microversion: 2.1 time: 0.459804 Sep 14 08:56:41.835943 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 964/1889] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:56:41 2022] GET /compute/v2.1/servers/08693908-da78-40e6-ae86-516643c61a3b => generated 1321 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:56:41.850926 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-cfe92fb8-a49e-484d-b0f5-698e16d0ea9f tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab2d64c1cb447f9bfd658408aa07e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ecc8c1389847c7bcd9cd5570d990e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:41.860048 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-cfe92fb8-a49e-484d-b0f5-698e16d0ea9f tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] 10.222.0.60 "GET /compute/v2.1/servers/8dd1623b-312c-411d-8f6c-b334195e573b" status: 200 len: 1472 microversion: 2.1 time: 0.506007 Sep 14 08:56:41.875459 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 926/1890] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:56:41 2022] GET /compute/v2.1/servers/8dd1623b-312c-411d-8f6c-b334195e573b => generated 1472 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:56:42.114384 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-abee0e8a-5aa5-44ad-ab56-7ba96e0a560d tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:56:42.115203 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-abee0e8a-5aa5-44ad-ab56-7ba96e0a560d tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: bb621205-f7b7-4823-b3b9-fb903ac44b2a] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:56:42.122991 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-abee0e8a-5aa5-44ad-ab56-7ba96e0a560d tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:42.126125 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-abee0e8a-5aa5-44ad-ab56-7ba96e0a560d tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:42.144230 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-abee0e8a-5aa5-44ad-ab56-7ba96e0a560d tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:42.146052 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-abee0e8a-5aa5-44ad-ab56-7ba96e0a560d tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:42.147702 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-abee0e8a-5aa5-44ad-ab56-7ba96e0a560d tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:42.150017 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-abee0e8a-5aa5-44ad-ab56-7ba96e0a560d tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:42.578396 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-abee0e8a-5aa5-44ad-ab56-7ba96e0a560d tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:42.665565 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-abee0e8a-5aa5-44ad-ab56-7ba96e0a560d tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:42.673816 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-abee0e8a-5aa5-44ad-ab56-7ba96e0a560d tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:42.684389 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-abee0e8a-5aa5-44ad-ab56-7ba96e0a560d tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/bb621205-f7b7-4823-b3b9-fb903ac44b2a" status: 200 len: 1475 microversion: 2.25 time: 0.573916 Sep 14 08:56:42.692604 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 965/1891] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:56:42 2022] GET /compute/v2.1/servers/bb621205-f7b7-4823-b3b9-fb903ac44b2a => generated 1475 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:56:42.709598 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-000708fd-2001-47be-b634-e70eed341b1e tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Calling method '.version_select at 0x7f7d3fc9f8b0>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:56:42.725940 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-000708fd-2001-47be-b634-e70eed341b1e tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:42.726874 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-000708fd-2001-47be-b634-e70eed341b1e tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:42.727516 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-000708fd-2001-47be-b634-e70eed341b1e tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:42.741902 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-000708fd-2001-47be-b634-e70eed341b1e tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] 10.222.0.60 "GET /compute/v2.1/os-migrations" status: 200 len: 3232 microversion: 2.25 time: 0.036278 Sep 14 08:56:42.744541 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 927/1892] 10.222.0.60 () {60 vars in 1184 bytes} [Wed Sep 14 08:56:42 2022] GET /compute/v2.1/os-migrations => generated 3232 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:56:42.763284 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-4ff43c7c-fb71-46be-968a-46558be36f87 tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:56:42.764279 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-4ff43c7c-fb71-46be-968a-46558be36f87 tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] [instance: bb621205-f7b7-4823-b3b9-fb903ac44b2a] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:56:42.773712 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4ff43c7c-fb71-46be-968a-46558be36f87 tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:42.774640 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4ff43c7c-fb71-46be-968a-46558be36f87 tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:42.775462 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4ff43c7c-fb71-46be-968a-46558be36f87 tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:42.778730 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4ff43c7c-fb71-46be-968a-46558be36f87 tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:42.780175 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4ff43c7c-fb71-46be-968a-46558be36f87 tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:42.781356 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4ff43c7c-fb71-46be-968a-46558be36f87 tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:42.863144 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-65e349d3-4c09-425e-af76-c76d1bcf6c6c tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:56:42.863695 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-65e349d3-4c09-425e-af76-c76d1bcf6c6c tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 08693908-da78-40e6-ae86-516643c61a3b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:56:42.875336 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-65e349d3-4c09-425e-af76-c76d1bcf6c6c tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:42.876097 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-65e349d3-4c09-425e-af76-c76d1bcf6c6c tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:42.876706 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-65e349d3-4c09-425e-af76-c76d1bcf6c6c tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:42.877431 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-65e349d3-4c09-425e-af76-c76d1bcf6c6c tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:42.881521 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-65e349d3-4c09-425e-af76-c76d1bcf6c6c tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:42.881975 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-65e349d3-4c09-425e-af76-c76d1bcf6c6c tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:43.231736 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.objects.instance [None req-4ff43c7c-fb71-46be-968a-46558be36f87 tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] Lazy-loading 'services' on Instance uuid bb621205-f7b7-4823-b3b9-fb903ac44b2a {{(pid=128758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 08:56:43.281786 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-4ff43c7c-fb71-46be-968a-46558be36f87 tempest-LiveAutoBlockMigrationV225Test-666817066 tempest-LiveAutoBlockMigrationV225Test-666817066-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/bb621205-f7b7-4823-b3b9-fb903ac44b2a" status: 200 len: 1969 microversion: 2.25 time: 0.522474 Sep 14 08:56:43.286551 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 966/1893] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:56:42 2022] GET /compute/v2.1/servers/bb621205-f7b7-4823-b3b9-fb903ac44b2a => generated 1969 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:56:43.298244 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-daa7a0a2-9d95-4a59-b5df-b499be5ba606 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:56:43.298887 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-daa7a0a2-9d95-4a59-b5df-b499be5ba606 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] [instance: 8dd1623b-312c-411d-8f6c-b334195e573b] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:56:43.313595 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-daa7a0a2-9d95-4a59-b5df-b499be5ba606 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:43.314964 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-daa7a0a2-9d95-4a59-b5df-b499be5ba606 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:43.315738 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-daa7a0a2-9d95-4a59-b5df-b499be5ba606 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:43.316595 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-daa7a0a2-9d95-4a59-b5df-b499be5ba606 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:43.317203 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-daa7a0a2-9d95-4a59-b5df-b499be5ba606 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:43.317855 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-daa7a0a2-9d95-4a59-b5df-b499be5ba606 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:43.364771 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-65e349d3-4c09-425e-af76-c76d1bcf6c6c tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:43.380187 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-65e349d3-4c09-425e-af76-c76d1bcf6c6c tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/08693908-da78-40e6-ae86-516643c61a3b" status: 200 len: 1501 microversion: 2.1 time: 0.520729 Sep 14 08:56:43.380991 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 928/1894] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:56:42 2022] GET /compute/v2.1/servers/08693908-da78-40e6-ae86-516643c61a3b => generated 1501 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:56:43.416519 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-cde0ad9a-3704-4aac-adf7-64ad1a737ebb tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:56:43.427384 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-cde0ad9a-3704-4aac-adf7-64ad1a737ebb tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: bb621205-f7b7-4823-b3b9-fb903ac44b2a] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:56:43.438282 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cde0ad9a-3704-4aac-adf7-64ad1a737ebb tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:43.443654 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cde0ad9a-3704-4aac-adf7-64ad1a737ebb tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:43.444409 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cde0ad9a-3704-4aac-adf7-64ad1a737ebb tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:43.447991 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cde0ad9a-3704-4aac-adf7-64ad1a737ebb tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:43.448708 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cde0ad9a-3704-4aac-adf7-64ad1a737ebb tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:43.449367 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cde0ad9a-3704-4aac-adf7-64ad1a737ebb tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:43.515448 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-cde0ad9a-3704-4aac-adf7-64ad1a737ebb tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: bb621205-f7b7-4823-b3b9-fb903ac44b2a] Going to try to terminate instance {{(pid=128759) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 08:56:43.683232 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-daa7a0a2-9d95-4a59-b5df-b499be5ba606 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab2d64c1cb447f9bfd658408aa07e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ecc8c1389847c7bcd9cd5570d990e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:43.696103 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-daa7a0a2-9d95-4a59-b5df-b499be5ba606 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] 10.222.0.60 "GET /compute/v2.1/servers/8dd1623b-312c-411d-8f6c-b334195e573b" status: 200 len: 1478 microversion: 2.1 time: 0.406962 Sep 14 08:56:43.697257 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 967/1895] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:56:43 2022] GET /compute/v2.1/servers/8dd1623b-312c-411d-8f6c-b334195e573b => generated 1478 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:56:43.710356 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-90826354-4129-48cd-814c-f091b23bf9c6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:56:43.717851 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-90826354-4129-48cd-814c-f091b23bf9c6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 08693908-da78-40e6-ae86-516643c61a3b] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:56:43.739296 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-90826354-4129-48cd-814c-f091b23bf9c6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:43.740639 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-90826354-4129-48cd-814c-f091b23bf9c6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:43.744778 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-cde0ad9a-3704-4aac-adf7-64ad1a737ebb tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "DELETE /compute/v2.1/servers/bb621205-f7b7-4823-b3b9-fb903ac44b2a" status: 204 len: 0 microversion: 2.25 time: 0.351009 Sep 14 08:56:43.745959 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-90826354-4129-48cd-814c-f091b23bf9c6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:43.746927 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-90826354-4129-48cd-814c-f091b23bf9c6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:43.749254 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-90826354-4129-48cd-814c-f091b23bf9c6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:43.750144 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 929/1896] 10.222.0.60 () {60 vars in 1280 bytes} [Wed Sep 14 08:56:43 2022] DELETE /compute/v2.1/servers/bb621205-f7b7-4823-b3b9-fb903ac44b2a => generated 0 bytes in 357 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 14 08:56:43.753394 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-90826354-4129-48cd-814c-f091b23bf9c6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:43.769868 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=100 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:56:43.778299 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-6b6e5417-26f7-4b45-b338-3cf14d096155 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:56:43.780439 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-6b6e5417-26f7-4b45-b338-3cf14d096155 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: bb621205-f7b7-4823-b3b9-fb903ac44b2a] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:56:43.797569 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6b6e5417-26f7-4b45-b338-3cf14d096155 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:43.809401 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6b6e5417-26f7-4b45-b338-3cf14d096155 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:43.814006 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6b6e5417-26f7-4b45-b338-3cf14d096155 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:43.815076 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6b6e5417-26f7-4b45-b338-3cf14d096155 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:43.821278 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6b6e5417-26f7-4b45-b338-3cf14d096155 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:43.822152 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6b6e5417-26f7-4b45-b338-3cf14d096155 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:44.327348 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-90826354-4129-48cd-814c-f091b23bf9c6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:44.346349 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-90826354-4129-48cd-814c-f091b23bf9c6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/08693908-da78-40e6-ae86-516643c61a3b" status: 200 len: 1501 microversion: 2.1 time: 0.639398 Sep 14 08:56:44.364235 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 968/1897] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:56:43 2022] GET /compute/v2.1/servers/08693908-da78-40e6-ae86-516643c61a3b => generated 1501 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:56:44.375875 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-3288db71-4774-4e92-b7bd-efd375403c45 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:56:44.381042 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-3288db71-4774-4e92-b7bd-efd375403c45 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 08693908-da78-40e6-ae86-516643c61a3b] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:56:44.393189 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-6b6e5417-26f7-4b45-b338-3cf14d096155 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:44.414857 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-6b6e5417-26f7-4b45-b338-3cf14d096155 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:44.416646 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3288db71-4774-4e92-b7bd-efd375403c45 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:44.417828 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3288db71-4774-4e92-b7bd-efd375403c45 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:44.418273 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3288db71-4774-4e92-b7bd-efd375403c45 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:44.419008 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3288db71-4774-4e92-b7bd-efd375403c45 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:44.422602 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-6b6e5417-26f7-4b45-b338-3cf14d096155 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:44.423269 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3288db71-4774-4e92-b7bd-efd375403c45 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:44.423886 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3288db71-4774-4e92-b7bd-efd375403c45 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:44.426457 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-6b6e5417-26f7-4b45-b338-3cf14d096155 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/bb621205-f7b7-4823-b3b9-fb903ac44b2a" status: 200 len: 1481 microversion: 2.25 time: 0.668586 Sep 14 08:56:44.427066 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 930/1898] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:56:43 2022] GET /compute/v2.1/servers/bb621205-f7b7-4823-b3b9-fb903ac44b2a => generated 1481 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:56:44.534359 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-3288db71-4774-4e92-b7bd-efd375403c45 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 08693908-da78-40e6-ae86-516643c61a3b] Going to try to terminate instance {{(pid=128758) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 08:56:44.722184 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c3ccd71e-3780-4a5c-85ae-37d726ef305c tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:56:44.722810 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-c3ccd71e-3780-4a5c-85ae-37d726ef305c tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] [instance: 8dd1623b-312c-411d-8f6c-b334195e573b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:56:44.754034 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c3ccd71e-3780-4a5c-85ae-37d726ef305c tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:44.754668 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c3ccd71e-3780-4a5c-85ae-37d726ef305c tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:44.755182 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c3ccd71e-3780-4a5c-85ae-37d726ef305c tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:44.755904 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c3ccd71e-3780-4a5c-85ae-37d726ef305c tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:44.756358 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c3ccd71e-3780-4a5c-85ae-37d726ef305c tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:44.763830 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c3ccd71e-3780-4a5c-85ae-37d726ef305c tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:44.771956 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-3288db71-4774-4e92-b7bd-efd375403c45 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "DELETE /compute/v2.1/servers/08693908-da78-40e6-ae86-516643c61a3b" status: 204 len: 0 microversion: 2.1 time: 0.402903 Sep 14 08:56:44.773169 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 969/1899] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 08:56:44 2022] DELETE /compute/v2.1/servers/08693908-da78-40e6-ae86-516643c61a3b => generated 0 bytes in 406 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 08:56:44.790881 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-da3ffb6c-9165-4d45-aa7a-deaed66c91eb tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:56:44.791669 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-da3ffb6c-9165-4d45-aa7a-deaed66c91eb tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 08693908-da78-40e6-ae86-516643c61a3b] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:56:44.823778 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-da3ffb6c-9165-4d45-aa7a-deaed66c91eb tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:44.827445 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-da3ffb6c-9165-4d45-aa7a-deaed66c91eb tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:44.828106 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-da3ffb6c-9165-4d45-aa7a-deaed66c91eb tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:44.829309 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-da3ffb6c-9165-4d45-aa7a-deaed66c91eb tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:44.829987 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-da3ffb6c-9165-4d45-aa7a-deaed66c91eb tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:44.830868 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-da3ffb6c-9165-4d45-aa7a-deaed66c91eb tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:45.375106 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-c3ccd71e-3780-4a5c-85ae-37d726ef305c tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab2d64c1cb447f9bfd658408aa07e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ecc8c1389847c7bcd9cd5570d990e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:45.389570 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-c3ccd71e-3780-4a5c-85ae-37d726ef305c tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] 10.222.0.60 "GET /compute/v2.1/servers/8dd1623b-312c-411d-8f6c-b334195e573b" status: 200 len: 1478 microversion: 2.1 time: 0.666872 Sep 14 08:56:45.392292 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 931/1900] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:56:44 2022] GET /compute/v2.1/servers/8dd1623b-312c-411d-8f6c-b334195e573b => generated 1478 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:56:45.402292 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-49615496-9b0f-4e7b-92fc-2f22b181973d req-15685318-9209-4123-b170-c0161b15da4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8dd1623b-312c-411d-8f6c-b334195e573b", "name": "network-vif-unplugged", "status": "completed", "tag": "558f9bbb-f694-40cf-b969-31f1db110da5"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:56:45.435750 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-49615496-9b0f-4e7b-92fc-2f22b181973d req-15685318-9209-4123-b170-c0161b15da4e service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:45.436292 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-49615496-9b0f-4e7b-92fc-2f22b181973d req-15685318-9209-4123-b170-c0161b15da4e service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:45.436728 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-49615496-9b0f-4e7b-92fc-2f22b181973d req-15685318-9209-4123-b170-c0161b15da4e service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:45.473114 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-49615496-9b0f-4e7b-92fc-2f22b181973d req-15685318-9209-4123-b170-c0161b15da4e service nova] Creating event network-vif-unplugged:558f9bbb-f694-40cf-b969-31f1db110da5 for instance 8dd1623b-312c-411d-8f6c-b334195e573b on n-h2-836830-18 Sep 14 08:56:45.479203 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-49615496-9b0f-4e7b-92fc-2f22b181973d req-15685318-9209-4123-b170-c0161b15da4e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.082843 Sep 14 08:56:45.485241 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 932/1901] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:56:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:56:45.491582 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a935a0f8-6c06-4ac1-a962-86777e69b24a tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:56:45.492297 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-a935a0f8-6c06-4ac1-a962-86777e69b24a tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: bb621205-f7b7-4823-b3b9-fb903ac44b2a] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:56:45.512053 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a935a0f8-6c06-4ac1-a962-86777e69b24a tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:45.512551 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a935a0f8-6c06-4ac1-a962-86777e69b24a tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:45.512985 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a935a0f8-6c06-4ac1-a962-86777e69b24a tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:45.513722 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a935a0f8-6c06-4ac1-a962-86777e69b24a tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:45.514712 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a935a0f8-6c06-4ac1-a962-86777e69b24a tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:45.523375 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a935a0f8-6c06-4ac1-a962-86777e69b24a tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:45.550810 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-da3ffb6c-9165-4d45-aa7a-deaed66c91eb tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:45.564341 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-da3ffb6c-9165-4d45-aa7a-deaed66c91eb tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/08693908-da78-40e6-ae86-516643c61a3b" status: 200 len: 1507 microversion: 2.1 time: 0.785279 Sep 14 08:56:45.566398 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 970/1902] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:56:44 2022] GET /compute/v2.1/servers/08693908-da78-40e6-ae86-516643c61a3b => generated 1507 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:56:45.966110 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-2a563253-5359-4726-bf4a-d768c48c3b58 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Action: 'create', calling method: .version_select at 0x7f7d44653160>, body: {"keypair": {"name": "tempest-keypair-58789062", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMbdm4X2cCVlTtesMRAs1JNHYPWP5wzmWn+fzIe295gOP0rD7Adq4Rd7MeGVNppmdeedxbXRkbCTs8FvE57bs7ycBSVA2oGO2CzNx467179OaYaqKFg5kAjYrjF4i53R2Q=="}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:56:46.040380 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-2a563253-5359-4726-bf4a-d768c48c3b58 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Getting quotas for project 99ee157fa0b44443b6de7a2d8356599a. Resources: {'key_pairs'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 08:56:46.049460 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-2a563253-5359-4726-bf4a-d768c48c3b58 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Getting quotas for user a6bb565169d0464389de47f7fc1fcf36 and project 99ee157fa0b44443b6de7a2d8356599a. Resources: {'key_pairs'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 08:56:46.101745 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-2a563253-5359-4726-bf4a-d768c48c3b58 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.42 time: 0.143600 Sep 14 08:56:46.102968 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 971/1903] 10.222.0.60 () {62 vars in 1200 bytes} [Wed Sep 14 08:56:45 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 146 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 14 08:56:46.165463 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-67025291-fa48-443b-a9f4-72f98393bba0 req-b9041f8c-cc4e-4581-8c02-f696b5365777 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb621205-f7b7-4823-b3b9-fb903ac44b2a", "name": "network-vif-deleted", "tag": "977f076f-2424-4d11-aa54-073389c5051f"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:56:46.204994 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-a935a0f8-6c06-4ac1-a962-86777e69b24a tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:46.209330 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-67025291-fa48-443b-a9f4-72f98393bba0 req-b9041f8c-cc4e-4581-8c02-f696b5365777 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:46.210839 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-67025291-fa48-443b-a9f4-72f98393bba0 req-b9041f8c-cc4e-4581-8c02-f696b5365777 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:46.212339 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-67025291-fa48-443b-a9f4-72f98393bba0 req-b9041f8c-cc4e-4581-8c02-f696b5365777 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:46.224609 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-a935a0f8-6c06-4ac1-a962-86777e69b24a tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:46.226968 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-a935a0f8-6c06-4ac1-a962-86777e69b24a tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:46.228424 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a935a0f8-6c06-4ac1-a962-86777e69b24a tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/bb621205-f7b7-4823-b3b9-fb903ac44b2a" status: 200 len: 1481 microversion: 2.25 time: 0.741709 Sep 14 08:56:46.241944 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-67025291-fa48-443b-a9f4-72f98393bba0 req-b9041f8c-cc4e-4581-8c02-f696b5365777 service nova] Creating event network-vif-deleted:977f076f-2424-4d11-aa54-073389c5051f for instance bb621205-f7b7-4823-b3b9-fb903ac44b2a on n-h2-836830-18 Sep 14 08:56:46.244978 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 933/1904] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:56:45 2022] GET /compute/v2.1/servers/bb621205-f7b7-4823-b3b9-fb903ac44b2a => generated 1481 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:56:46.252581 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-67025291-fa48-443b-a9f4-72f98393bba0 req-b9041f8c-cc4e-4581-8c02-f696b5365777 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093873 Sep 14 08:56:46.263217 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 972/1905] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:56:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:56:46.422171 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-14b9721b-7e54-4231-bd51-488acf601cfb tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:56:46.423274 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-14b9721b-7e54-4231-bd51-488acf601cfb tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] [instance: 8dd1623b-312c-411d-8f6c-b334195e573b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:56:46.433375 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-14b9721b-7e54-4231-bd51-488acf601cfb tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:46.433893 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-14b9721b-7e54-4231-bd51-488acf601cfb tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:46.438898 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-14b9721b-7e54-4231-bd51-488acf601cfb tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:46.441075 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-14b9721b-7e54-4231-bd51-488acf601cfb tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:46.441579 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-14b9721b-7e54-4231-bd51-488acf601cfb tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:46.443183 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-14b9721b-7e54-4231-bd51-488acf601cfb tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:46.597475 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-46cae274-d08b-4fc8-925b-0e2d8cee2136 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:56:46.600302 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-46cae274-d08b-4fc8-925b-0e2d8cee2136 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 08693908-da78-40e6-ae86-516643c61a3b] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:56:46.619462 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-46cae274-d08b-4fc8-925b-0e2d8cee2136 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:46.624502 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-46cae274-d08b-4fc8-925b-0e2d8cee2136 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:46.625277 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-46cae274-d08b-4fc8-925b-0e2d8cee2136 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:46.627068 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-46cae274-d08b-4fc8-925b-0e2d8cee2136 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:46.629773 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-46cae274-d08b-4fc8-925b-0e2d8cee2136 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:46.631667 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-46cae274-d08b-4fc8-925b-0e2d8cee2136 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:47.256386 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-14b9721b-7e54-4231-bd51-488acf601cfb tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab2d64c1cb447f9bfd658408aa07e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ecc8c1389847c7bcd9cd5570d990e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:47.272610 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-14b9721b-7e54-4231-bd51-488acf601cfb tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] 10.222.0.60 "GET /compute/v2.1/servers/8dd1623b-312c-411d-8f6c-b334195e573b" status: 200 len: 1478 microversion: 2.1 time: 0.856595 Sep 14 08:56:47.273798 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 934/1906] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:56:46 2022] GET /compute/v2.1/servers/8dd1623b-312c-411d-8f6c-b334195e573b => generated 1478 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:56:47.281357 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b2e50458-6649-4bd2-9faf-b67e98312b4f tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:56:47.287219 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b2e50458-6649-4bd2-9faf-b67e98312b4f tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: bb621205-f7b7-4823-b3b9-fb903ac44b2a] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:56:47.303016 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b2e50458-6649-4bd2-9faf-b67e98312b4f tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:47.303785 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b2e50458-6649-4bd2-9faf-b67e98312b4f tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:47.304405 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b2e50458-6649-4bd2-9faf-b67e98312b4f tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:47.312920 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b2e50458-6649-4bd2-9faf-b67e98312b4f tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:47.313608 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b2e50458-6649-4bd2-9faf-b67e98312b4f tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:47.314203 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b2e50458-6649-4bd2-9faf-b67e98312b4f tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:47.315052 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-46cae274-d08b-4fc8-925b-0e2d8cee2136 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:47.345126 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-46cae274-d08b-4fc8-925b-0e2d8cee2136 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/08693908-da78-40e6-ae86-516643c61a3b" status: 200 len: 1507 microversion: 2.1 time: 0.757586 Sep 14 08:56:47.349767 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 973/1907] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:56:46 2022] GET /compute/v2.1/servers/08693908-da78-40e6-ae86-516643c61a3b => generated 1507 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:56:47.550759 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b2e50458-6649-4bd2-9faf-b67e98312b4f tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:47.582920 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b2e50458-6649-4bd2-9faf-b67e98312b4f tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:47.585344 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b2e50458-6649-4bd2-9faf-b67e98312b4f tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:47.602093 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b2e50458-6649-4bd2-9faf-b67e98312b4f tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/bb621205-f7b7-4823-b3b9-fb903ac44b2a" status: 200 len: 1265 microversion: 2.25 time: 0.326977 Sep 14 08:56:47.608568 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 935/1908] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:56:47 2022] GET /compute/v2.1/servers/bb621205-f7b7-4823-b3b9-fb903ac44b2a => generated 1265 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:56:48.276277 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-d9646123-bc14-42c5-a91a-8438de64b7a6 req-40e44cc7-6c3d-4da4-ac51-c5aac3dceab7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08693908-da78-40e6-ae86-516643c61a3b", "name": "network-vif-deleted", "tag": "25da732a-19d1-4f48-8b4f-33a990976065"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:56:48.299383 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ba0dbcf8-788c-404f-8f16-2b3e5d1e3c13 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:56:48.299956 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-ba0dbcf8-788c-404f-8f16-2b3e5d1e3c13 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] [instance: 8dd1623b-312c-411d-8f6c-b334195e573b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:56:48.306231 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-d9646123-bc14-42c5-a91a-8438de64b7a6 req-40e44cc7-6c3d-4da4-ac51-c5aac3dceab7 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:48.307598 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-d9646123-bc14-42c5-a91a-8438de64b7a6 req-40e44cc7-6c3d-4da4-ac51-c5aac3dceab7 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:48.309315 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-d9646123-bc14-42c5-a91a-8438de64b7a6 req-40e44cc7-6c3d-4da4-ac51-c5aac3dceab7 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:48.315168 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ba0dbcf8-788c-404f-8f16-2b3e5d1e3c13 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:48.317004 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ba0dbcf8-788c-404f-8f16-2b3e5d1e3c13 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:48.319504 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ba0dbcf8-788c-404f-8f16-2b3e5d1e3c13 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:48.329684 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ba0dbcf8-788c-404f-8f16-2b3e5d1e3c13 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:48.331473 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ba0dbcf8-788c-404f-8f16-2b3e5d1e3c13 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:48.333414 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ba0dbcf8-788c-404f-8f16-2b3e5d1e3c13 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:48.334048 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-d9646123-bc14-42c5-a91a-8438de64b7a6 req-40e44cc7-6c3d-4da4-ac51-c5aac3dceab7 service nova] Creating event network-vif-deleted:25da732a-19d1-4f48-8b4f-33a990976065 for instance 08693908-da78-40e6-ae86-516643c61a3b on n-h1-836830-18 Sep 14 08:56:48.354572 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-d9646123-bc14-42c5-a91a-8438de64b7a6 req-40e44cc7-6c3d-4da4-ac51-c5aac3dceab7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076926 Sep 14 08:56:48.360330 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 974/1909] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:56:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:56:48.383050 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-2856c478-b8b5-49e2-bbc7-06da25920623 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:56:48.384008 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-2856c478-b8b5-49e2-bbc7-06da25920623 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 08693908-da78-40e6-ae86-516643c61a3b] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:56:48.397783 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2856c478-b8b5-49e2-bbc7-06da25920623 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:48.400343 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2856c478-b8b5-49e2-bbc7-06da25920623 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:48.402867 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2856c478-b8b5-49e2-bbc7-06da25920623 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:48.413271 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2856c478-b8b5-49e2-bbc7-06da25920623 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:48.416074 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2856c478-b8b5-49e2-bbc7-06da25920623 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:48.416569 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2856c478-b8b5-49e2-bbc7-06da25920623 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:48.509369 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2856c478-b8b5-49e2-bbc7-06da25920623 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:48.512519 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2856c478-b8b5-49e2-bbc7-06da25920623 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:48.516245 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2856c478-b8b5-49e2-bbc7-06da25920623 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:48.517788 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.objects.instance [None req-2856c478-b8b5-49e2-bbc7-06da25920623 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lazy-loading 'fault' on Instance uuid 08693908-da78-40e6-ae86-516643c61a3b {{(pid=128758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 08:56:48.602392 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-2856c478-b8b5-49e2-bbc7-06da25920623 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:48.612114 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-2856c478-b8b5-49e2-bbc7-06da25920623 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/08693908-da78-40e6-ae86-516643c61a3b" status: 200 len: 1311 microversion: 2.1 time: 0.234296 Sep 14 08:56:48.623207 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 975/1910] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:56:48 2022] GET /compute/v2.1/servers/08693908-da78-40e6-ae86-516643c61a3b => generated 1311 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:56:48.639605 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-7bb6efc2-24e0-45d0-870d-02ea77ea3d7b tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:56:48.642168 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-7bb6efc2-24e0-45d0-870d-02ea77ea3d7b tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: bb621205-f7b7-4823-b3b9-fb903ac44b2a] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:56:48.664234 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7bb6efc2-24e0-45d0-870d-02ea77ea3d7b tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:48.669775 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7bb6efc2-24e0-45d0-870d-02ea77ea3d7b tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:48.671157 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7bb6efc2-24e0-45d0-870d-02ea77ea3d7b tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:48.672109 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7bb6efc2-24e0-45d0-870d-02ea77ea3d7b tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:48.675533 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7bb6efc2-24e0-45d0-870d-02ea77ea3d7b tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:48.676359 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7bb6efc2-24e0-45d0-870d-02ea77ea3d7b tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:48.690253 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-ba0dbcf8-788c-404f-8f16-2b3e5d1e3c13 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab2d64c1cb447f9bfd658408aa07e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ecc8c1389847c7bcd9cd5570d990e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:48.705796 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-ba0dbcf8-788c-404f-8f16-2b3e5d1e3c13 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] 10.222.0.60 "GET /compute/v2.1/servers/8dd1623b-312c-411d-8f6c-b334195e573b" status: 200 len: 1478 microversion: 2.1 time: 0.408473 Sep 14 08:56:48.706531 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 936/1911] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:56:48 2022] GET /compute/v2.1/servers/8dd1623b-312c-411d-8f6c-b334195e573b => generated 1478 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:56:48.827943 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-7bb6efc2-24e0-45d0-870d-02ea77ea3d7b tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:48.848380 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-7bb6efc2-24e0-45d0-870d-02ea77ea3d7b tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:48.850201 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-7bb6efc2-24e0-45d0-870d-02ea77ea3d7b tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:48.853456 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-7bb6efc2-24e0-45d0-870d-02ea77ea3d7b tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/bb621205-f7b7-4823-b3b9-fb903ac44b2a" status: 200 len: 1265 microversion: 2.25 time: 0.218426 Sep 14 08:56:48.854757 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 976/1912] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:56:48 2022] GET /compute/v2.1/servers/bb621205-f7b7-4823-b3b9-fb903ac44b2a => generated 1265 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 08:56:49.247938 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-dba99374-2477-4d45-8ce1-a1cd3d20544d req-9f443c50-2775-46de-8458-4e9f209d88c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8dd1623b-312c-411d-8f6c-b334195e573b", "name": "network-vif-plugged", "status": "completed", "tag": "558f9bbb-f694-40cf-b969-31f1db110da5"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:56:49.266380 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-dba99374-2477-4d45-8ce1-a1cd3d20544d req-9f443c50-2775-46de-8458-4e9f209d88c7 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:49.267415 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-dba99374-2477-4d45-8ce1-a1cd3d20544d req-9f443c50-2775-46de-8458-4e9f209d88c7 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:49.268050 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-dba99374-2477-4d45-8ce1-a1cd3d20544d req-9f443c50-2775-46de-8458-4e9f209d88c7 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:49.285811 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-dba99374-2477-4d45-8ce1-a1cd3d20544d req-9f443c50-2775-46de-8458-4e9f209d88c7 service nova] Creating event network-vif-plugged:558f9bbb-f694-40cf-b969-31f1db110da5 for instance 8dd1623b-312c-411d-8f6c-b334195e573b on n-h2-836830-18 Sep 14 08:56:49.292587 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-dba99374-2477-4d45-8ce1-a1cd3d20544d req-9f443c50-2775-46de-8458-4e9f209d88c7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049226 Sep 14 08:56:49.293521 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 937/1913] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:56:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:56:49.638846 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d22e1851-e06c-479a-bf37-38ba521ba78a tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:56:49.640163 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-d22e1851-e06c-479a-bf37-38ba521ba78a tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 08693908-da78-40e6-ae86-516643c61a3b] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:56:49.650258 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d22e1851-e06c-479a-bf37-38ba521ba78a tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:49.650752 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d22e1851-e06c-479a-bf37-38ba521ba78a tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:49.651212 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d22e1851-e06c-479a-bf37-38ba521ba78a tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:49.651929 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d22e1851-e06c-479a-bf37-38ba521ba78a tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:49.652385 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d22e1851-e06c-479a-bf37-38ba521ba78a tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:49.652812 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d22e1851-e06c-479a-bf37-38ba521ba78a tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:49.689482 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-d22e1851-e06c-479a-bf37-38ba521ba78a tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] HTTP exception thrown: Instance 08693908-da78-40e6-ae86-516643c61a3b could not be found. Sep 14 08:56:49.691200 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d22e1851-e06c-479a-bf37-38ba521ba78a tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Request method failure captured: Sep 14 08:56:49.691200 n-d-836830-18 devstack@n-api.service[128758]: request: GET /compute/v2.1/servers/08693908-da78-40e6-ae86-516643c61a3b HTTP/1.1 Sep 14 08:56:49.691200 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 08:56:49.691200 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 08:56:49.691200 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 08:56:49.691200 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 08:56:49.691200 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 08:56:49.691200 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 08:56:49.691200 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 08:56:49.691200 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 08:56:49.691200 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZcaJwfflKXdBQOzu63TKkiZhpOhYfmFkGJTkIRAE47xWaYCE5owpMd6ZGj3T_7h70-IX-88ov5m9P47-8wvvyB1aoACyyMztTclo7X0AZdOhAhE2WQeLs1dhX-NF72boJ9SoR98XdGx2ROr7Y4PciafvjdUpaADdFYghsgULitlVHs Sep 14 08:56:49.691200 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 08:56:49.691200 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 08:56:49.691200 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 08:56:49.691200 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 08:56:49.691200 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 08:56:49.691200 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 08:56:49.691200 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: a46ca7b6c331417199f9dfc5ffa80470 Sep 14 08:56:49.691200 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-ServersTestJSON-1483820673 Sep 14 08:56:49.691200 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 08:56:49.691200 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 08:56:49.691200 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a46ca7b6c331417199f9dfc5ffa80470"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a46ca7b6c331417199f9dfc5ffa80470"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a46ca7b6c331417199f9dfc5ffa80470"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a46ca7b6c331417199f9dfc5ffa80470"}]}] Sep 14 08:56:49.691200 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-ServersTestJSON-1483820673 Sep 14 08:56:49.691200 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: a46ca7b6c331417199f9dfc5ffa80470 Sep 14 08:56:49.691200 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-ServersTestJSON-1483820673 Sep 14 08:56:49.691200 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-ServersTestJSON-1483820673-project Sep 14 08:56:49.691200 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 08:56:49.691200 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 08:56:49.691200 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 1473e6771ff1459c831d66311318404d Sep 14 08:56:49.691200 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-ServersTestJSON-1483820673-project Sep 14 08:56:49.691200 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 08:56:49.691200 n-d-836830-18 devstack@n-api.service[128758]: exception: Instance 08693908-da78-40e6-ae86-516643c61a3b could not be found. Sep 14 08:56:49.691200 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': '08693908-da78-40e6-ae86-516643c61a3b'} Sep 14 08:56:49.691200 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:56:49.691200 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:56:49.691200 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 08:56:49.691200 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 08:56:49.691200 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 08:56:49.691200 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 08:56:49.691200 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 08:56:49.691200 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 08:56:49.691200 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 08:56:49.691200 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 08:56:49.691200 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08693908-da78-40e6-ae86-516643c61a3b could not be found. Sep 14 08:56:49.691200 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:56:49.691200 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:56:49.691200 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:56:49.691200 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:56:49.691200 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:56:49.691200 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:56:49.691200 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:56:49.691200 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:56:49.691200 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:56:49.691200 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:56:49.691200 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 08:56:49.691200 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 08:56:49.691200 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 08:56:49.691200 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 08:56:49.691200 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 08:56:49.691200 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 08:56:49.691200 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08693908-da78-40e6-ae86-516643c61a3b could not be found. Sep 14 08:56:49.691200 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:56:49.691200 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:56:49.691200 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:56:49.695149 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:56:49.695149 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:56:49.695149 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:56:49.695149 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:56:49.695149 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:56:49.695149 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08693908-da78-40e6-ae86-516643c61a3b could not be found. Sep 14 08:56:49.695149 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:56:49.695149 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d22e1851-e06c-479a-bf37-38ba521ba78a tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Returning 404 to user: Instance 08693908-da78-40e6-ae86-516643c61a3b could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:56:49.695149 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-d22e1851-e06c-479a-bf37-38ba521ba78a tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/08693908-da78-40e6-ae86-516643c61a3b" status: 404 len: 111 microversion: 2.1 time: 0.057793 Sep 14 08:56:49.709682 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 977/1914] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:56:49 2022] GET /compute/v2.1/servers/08693908-da78-40e6-ae86-516643c61a3b => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 08:56:49.714305 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-69169afd-0cba-4604-b568-ec42b38ab041 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-710549821", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "f20c97e5-1674-4976-8f97-dffbd8e69177"}, {"port": "7212ef16-f39e-431e-be33-ee68692137a8", "tag": "port-1"}, {"port": "8af9859a-c5d7-4d91-96a4-e415d547a0e7", "tag": "port-2"}, {"uuid": "710a8e0e-b8b2-4e41-a53a-e6746ad1798b", "tag": "net-1"}, {"uuid": "710a8e0e-b8b2-4e41-a53a-e6746ad1798b"}, {"uuid": "92316375-fb94-4d74-9021-926ada6d1dcc", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "92316375-fb94-4d74-9021-926ada6d1dcc", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "7595555a-2090-4945-ba09-4cd60b92caf9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "be83f452-5cdf-4730-ab02-b8ecb22eef26", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "337c62cc-fd5e-4c51-aca5-e8ad9f992d04", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1396895029"}], "key_name": "tempest-keypair-58789062", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:56:49.726961 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-acd2e23a-59e3-4b4d-a813-a5f27f275409 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Action: 'create', calling method: .version_select at 0x7f7d44939f70>, body: {"keypair": {"name": "tempest-key-929868005", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKSF/mT21v/rCdp9SktYR28u5d4wcHx3BHW4jv6J64FsxezBFhTisTsTnICk0H+JYgav8xsgv7aKkvmyOi/+vR7RvXtg2nrQI7VudWqNpP73P4wTqKl4RGS1/2/8vnWo4w=="}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:56:49.763239 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-acd2e23a-59e3-4b4d-a813-a5f27f275409 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Getting quotas for project a46ca7b6c331417199f9dfc5ffa80470. Resources: {'key_pairs'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 08:56:49.769239 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-acd2e23a-59e3-4b4d-a813-a5f27f275409 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Getting quotas for user 1473e6771ff1459c831d66311318404d and project a46ca7b6c331417199f9dfc5ffa80470. Resources: {'key_pairs'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 08:56:49.799621 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-acd2e23a-59e3-4b4d-a813-a5f27f275409 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 381 microversion: 2.1 time: 0.087751 Sep 14 08:56:49.808419 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 978/1915] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Sep 14 08:56:49 2022] POST /compute/v2.1/os-keypairs => generated 381 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:56:49.815612 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-aada30a0-49fb-4839-8443-8f707d922dff tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:56:49.818001 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-aada30a0-49fb-4839-8443-8f707d922dff tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] [instance: 8dd1623b-312c-411d-8f6c-b334195e573b] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:56:49.825979 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-aada30a0-49fb-4839-8443-8f707d922dff tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:49.826466 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-aada30a0-49fb-4839-8443-8f707d922dff tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:49.827288 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-aada30a0-49fb-4839-8443-8f707d922dff tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:49.828144 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-aada30a0-49fb-4839-8443-8f707d922dff tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:49.828743 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-aada30a0-49fb-4839-8443-8f707d922dff tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:49.829316 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-aada30a0-49fb-4839-8443-8f707d922dff tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:49.945938 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.network.neutron [None req-69169afd-0cba-4604-b568-ec42b38ab041 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] validate_networks() for [('f20c97e5-1674-4976-8f97-dffbd8e69177', None, None, None, None, None), (None, None, '7212ef16-f39e-431e-be33-ee68692137a8', None, None, None), (None, None, '8af9859a-c5d7-4d91-96a4-e415d547a0e7', None, None, None), ('710a8e0e-b8b2-4e41-a53a-e6746ad1798b', None, None, None, None, None), ('710a8e0e-b8b2-4e41-a53a-e6746ad1798b', None, None, None, None, None), ('92316375-fb94-4d74-9021-926ada6d1dcc', '10.2.2.100', None, None, None, None), ('92316375-fb94-4d74-9021-926ada6d1dcc', '10.2.2.200', None, None, None, None)] {{(pid=128759) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 08:56:50.059317 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-aada30a0-49fb-4839-8443-8f707d922dff tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab2d64c1cb447f9bfd658408aa07e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ecc8c1389847c7bcd9cd5570d990e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:50.067693 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-aada30a0-49fb-4839-8443-8f707d922dff tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] 10.222.0.60 "GET /compute/v2.1/servers/8dd1623b-312c-411d-8f6c-b334195e573b" status: 200 len: 1478 microversion: 2.1 time: 0.257341 Sep 14 08:56:50.068285 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 979/1916] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:56:49 2022] GET /compute/v2.1/servers/8dd1623b-312c-411d-8f6c-b334195e573b => generated 1478 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:56:50.072997 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a3166130-6104-4e89-abc1-cfa88610133c tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '.version_select at 0x7f7d447bfca0>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:56:50.078025 n-d-836830-18 devstack@n-api.service[128758]: WARNING oslo_db.sqlalchemy.utils [None req-a3166130-6104-4e89-abc1-cfa88610133c tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Unique keys not in sort_keys. The sorting order may be unstable. Sep 14 08:56:50.084166 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-a3166130-6104-4e89-abc1-cfa88610133c tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/os-keypairs" status: 200 len: 350 microversion: 2.1 time: 0.014737 Sep 14 08:56:50.084919 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 980/1917] 10.222.0.60 () {58 vars in 1137 bytes} [Wed Sep 14 08:56:50 2022] GET /compute/v2.1/os-keypairs => generated 350 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:56:50.089877 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1269c1cf-0308-4813-a5a1-b3b492c661a4 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:56:50.090492 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-1269c1cf-0308-4813-a5a1-b3b492c661a4 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: bb621205-f7b7-4823-b3b9-fb903ac44b2a] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:56:50.100139 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1269c1cf-0308-4813-a5a1-b3b492c661a4 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:50.100789 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1269c1cf-0308-4813-a5a1-b3b492c661a4 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:50.101396 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1269c1cf-0308-4813-a5a1-b3b492c661a4 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:50.102635 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1269c1cf-0308-4813-a5a1-b3b492c661a4 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:50.103446 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1269c1cf-0308-4813-a5a1-b3b492c661a4 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:50.104040 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1269c1cf-0308-4813-a5a1-b3b492c661a4 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:50.189389 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-1269c1cf-0308-4813-a5a1-b3b492c661a4 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:50.198998 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-1269c1cf-0308-4813-a5a1-b3b492c661a4 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:50.200836 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-1269c1cf-0308-4813-a5a1-b3b492c661a4 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:50.202965 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-1269c1cf-0308-4813-a5a1-b3b492c661a4 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/bb621205-f7b7-4823-b3b9-fb903ac44b2a" status: 200 len: 1265 microversion: 2.25 time: 0.116499 Sep 14 08:56:50.204133 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 981/1918] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:56:50 2022] GET /compute/v2.1/servers/bb621205-f7b7-4823-b3b9-fb903ac44b2a => generated 1265 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:56:50.208820 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-faaa2a56-ac6a-44f7-9020-e449c03e1855 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1267633462", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "key_name": "tempest-key-929868005", "networks": [{"uuid": "238fbc23-0a7b-476b-a552-1a5667de089a"}]}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:56:50.269515 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.network.neutron [None req-faaa2a56-ac6a-44f7-9020-e449c03e1855 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] validate_networks() for [('238fbc23-0a7b-476b-a552-1a5667de089a', None, None, None, None, None)] {{(pid=128758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 08:56:51.083071 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-faaa2a56-ac6a-44f7-9020-e449c03e1855 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Flavor limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 08:56:51.084243 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-faaa2a56-ac6a-44f7-9020-e449c03e1855 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Image limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 08:56:51.086511 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-faaa2a56-ac6a-44f7-9020-e449c03e1855 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Flavor pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 08:56:51.087170 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-faaa2a56-ac6a-44f7-9020-e449c03e1855 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Image pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 08:56:51.088871 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-faaa2a56-ac6a-44f7-9020-e449c03e1855 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 08:56:51.103145 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-faaa2a56-ac6a-44f7-9020-e449c03e1855 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:51.103960 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-faaa2a56-ac6a-44f7-9020-e449c03e1855 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:51.104583 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-faaa2a56-ac6a-44f7-9020-e449c03e1855 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:51.105572 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-faaa2a56-ac6a-44f7-9020-e449c03e1855 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:51.106222 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-faaa2a56-ac6a-44f7-9020-e449c03e1855 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:51.106886 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-faaa2a56-ac6a-44f7-9020-e449c03e1855 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:51.141107 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-faaa2a56-ac6a-44f7-9020-e449c03e1855 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Getting quotas for project a46ca7b6c331417199f9dfc5ffa80470. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 08:56:51.147853 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-faaa2a56-ac6a-44f7-9020-e449c03e1855 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Getting quotas for user 1473e6771ff1459c831d66311318404d and project a46ca7b6c331417199f9dfc5ffa80470. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 08:56:51.164907 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-faaa2a56-ac6a-44f7-9020-e449c03e1855 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Going to run 1 instances... {{(pid=128758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 08:56:51.167913 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-faaa2a56-ac6a-44f7-9020-e449c03e1855 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 8a7e712b-b175-4ebc-9681-42ff2a91867d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 08:56:51.288821 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-faaa2a56-ac6a-44f7-9020-e449c03e1855 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.083352 Sep 14 08:56:51.299243 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 982/1919] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 08:56:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1088 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 08:56:51.302686 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-bbdbfff9-cefe-472d-b390-7f871e68bfe3 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-2065229084", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "3e96754e-5525-4c7d-b9d8-ac1d87e859d5"}], "block_device_mapping_v2": [{"uuid": "bfc1aecd-6336-4c4b-84d4-f6eeb86f4506", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:56:51.414498 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.network.neutron [None req-bbdbfff9-cefe-472d-b390-7f871e68bfe3 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] validate_networks() for [('3e96754e-5525-4c7d-b9d8-ac1d87e859d5', None, None, None, None, None)] {{(pid=128758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 08:56:52.578516 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-bbdbfff9-cefe-472d-b390-7f871e68bfe3 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Flavor limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 08:56:52.579491 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-bbdbfff9-cefe-472d-b390-7f871e68bfe3 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Image limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 08:56:52.580251 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-bbdbfff9-cefe-472d-b390-7f871e68bfe3 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Flavor pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 08:56:52.581161 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-bbdbfff9-cefe-472d-b390-7f871e68bfe3 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Image pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 08:56:52.581600 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-bbdbfff9-cefe-472d-b390-7f871e68bfe3 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 08:56:52.596169 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bbdbfff9-cefe-472d-b390-7f871e68bfe3 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:52.597367 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bbdbfff9-cefe-472d-b390-7f871e68bfe3 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:52.597843 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bbdbfff9-cefe-472d-b390-7f871e68bfe3 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:52.598600 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bbdbfff9-cefe-472d-b390-7f871e68bfe3 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:52.599091 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bbdbfff9-cefe-472d-b390-7f871e68bfe3 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:52.599519 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bbdbfff9-cefe-472d-b390-7f871e68bfe3 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:52.642077 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-bbdbfff9-cefe-472d-b390-7f871e68bfe3 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Getting quotas for project a7342631eeb747ba831f1d8a20fb8bf3. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 08:56:52.652915 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=5 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:56:52.655616 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-bbdbfff9-cefe-472d-b390-7f871e68bfe3 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Getting quotas for user cd713a1c3e7148ef8bfcbe44d1a80a18 and project a7342631eeb747ba831f1d8a20fb8bf3. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 08:56:52.788588 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-bbdbfff9-cefe-472d-b390-7f871e68bfe3 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Going to run 1 instances... {{(pid=128758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 08:56:52.791036 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-bbdbfff9-cefe-472d-b390-7f871e68bfe3 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: ad55193e-b097-4372-9a00-972ed2b486f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='bfc1aecd-6336-4c4b-84d4-f6eeb86f4506',volume_size=None,volume_type=None)] {{(pid=128758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 08:56:52.968468 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-bbdbfff9-cefe-472d-b390-7f871e68bfe3 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.673893 Sep 14 08:56:52.969821 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 983/1920] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 08:56:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1676 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 08:56:52.978103 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-57a8a80d-2362-4376-845b-860c26c42079 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:56:52.979138 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-57a8a80d-2362-4376-845b-860c26c42079 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] [instance: 8dd1623b-312c-411d-8f6c-b334195e573b] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:56:52.988581 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-57a8a80d-2362-4376-845b-860c26c42079 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:52.989309 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-57a8a80d-2362-4376-845b-860c26c42079 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:52.989749 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-57a8a80d-2362-4376-845b-860c26c42079 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:52.990605 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-57a8a80d-2362-4376-845b-860c26c42079 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:52.991303 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-57a8a80d-2362-4376-845b-860c26c42079 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:52.991888 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-57a8a80d-2362-4376-845b-860c26c42079 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:53.414229 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-57a8a80d-2362-4376-845b-860c26c42079 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab2d64c1cb447f9bfd658408aa07e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ecc8c1389847c7bcd9cd5570d990e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:53.427283 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-57a8a80d-2362-4376-845b-860c26c42079 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] 10.222.0.60 "GET /compute/v2.1/servers/8dd1623b-312c-411d-8f6c-b334195e573b" status: 200 len: 1464 microversion: 2.1 time: 0.456026 Sep 14 08:56:53.428028 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 984/1921] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:56:52 2022] GET /compute/v2.1/servers/8dd1623b-312c-411d-8f6c-b334195e573b => generated 1464 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:56:53.443939 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-821403e9-d158-41a5-ac4a-b073c33d5aaa tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:56:53.444844 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-821403e9-d158-41a5-ac4a-b073c33d5aaa tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: bb621205-f7b7-4823-b3b9-fb903ac44b2a] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:56:53.452965 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-821403e9-d158-41a5-ac4a-b073c33d5aaa tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:53.453870 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-821403e9-d158-41a5-ac4a-b073c33d5aaa tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:53.455155 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-821403e9-d158-41a5-ac4a-b073c33d5aaa tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:53.456098 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-821403e9-d158-41a5-ac4a-b073c33d5aaa tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:53.456943 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-821403e9-d158-41a5-ac4a-b073c33d5aaa tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:53.457723 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-821403e9-d158-41a5-ac4a-b073c33d5aaa tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:53.480151 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-821403e9-d158-41a5-ac4a-b073c33d5aaa tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] HTTP exception thrown: Instance bb621205-f7b7-4823-b3b9-fb903ac44b2a could not be found. Sep 14 08:56:53.486554 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-821403e9-d158-41a5-ac4a-b073c33d5aaa tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Request method failure captured: Sep 14 08:56:53.486554 n-d-836830-18 devstack@n-api.service[128758]: request: GET /compute/v2.1/servers/bb621205-f7b7-4823-b3b9-fb903ac44b2a HTTP/1.1 Sep 14 08:56:53.486554 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 08:56:53.486554 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 08:56:53.486554 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 08:56:53.486554 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 08:56:53.486554 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 08:56:53.486554 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 08:56:53.486554 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 08:56:53.486554 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 08:56:53.486554 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZWl4sBr1-d0zWhOP1VypmcD37g65YKSC98adzDQksMynj67ZC5PVg2lSGT7NPp4LurGErQYTxYBVsDHD4XQgru2ajc5ixBy1mw1M3HnxJNE70omFE3tV833Q-dw3mlJAdgpOXexlM7Fuhn3BkTG0VioZq-vGusZTnLGxd-pf99Y8Xw Sep 14 08:56:53.486554 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 08:56:53.486554 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 08:56:53.486554 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 08:56:53.486554 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 08:56:53.486554 n-d-836830-18 devstack@n-api.service[128758]: X-Openstack-Nova-Api-Version: 2.25 Sep 14 08:56:53.486554 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 08:56:53.486554 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 08:56:53.486554 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 3850954316f34104b2a8052dc78a50d7 Sep 14 08:56:53.486554 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1232302418 Sep 14 08:56:53.486554 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 08:56:53.486554 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 08:56:53.486554 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/3850954316f34104b2a8052dc78a50d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_3850954316f34104b2a8052dc78a50d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3850954316f34104b2a8052dc78a50d7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3850954316f34104b2a8052dc78a50d7"}]}] Sep 14 08:56:53.486554 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1232302418 Sep 14 08:56:53.486554 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 3850954316f34104b2a8052dc78a50d7 Sep 14 08:56:53.486554 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1232302418 Sep 14 08:56:53.486554 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-LiveAutoBlockMigrationV225Test-1232302418-project Sep 14 08:56:53.486554 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 08:56:53.486554 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 08:56:53.486554 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: f140347422af48a4875e80337a272e29 Sep 14 08:56:53.486554 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1232302418-project Sep 14 08:56:53.486554 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 08:56:53.486554 n-d-836830-18 devstack@n-api.service[128758]: exception: Instance bb621205-f7b7-4823-b3b9-fb903ac44b2a could not be found. Sep 14 08:56:53.486554 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': 'bb621205-f7b7-4823-b3b9-fb903ac44b2a'} Sep 14 08:56:53.486554 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:56:53.486554 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:56:53.486554 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 08:56:53.486554 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 08:56:53.486554 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 08:56:53.486554 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 08:56:53.486554 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 08:56:53.486554 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 08:56:53.486554 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 08:56:53.486554 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 08:56:53.486554 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb621205-f7b7-4823-b3b9-fb903ac44b2a could not be found. Sep 14 08:56:53.486554 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:56:53.486554 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:56:53.486554 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:56:53.486554 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:56:53.486554 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:56:53.486554 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:56:53.486554 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:56:53.486554 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:56:53.486554 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:56:53.486554 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:56:53.486554 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 08:56:53.486554 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 08:56:53.486554 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 08:56:53.486554 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 08:56:53.486554 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 08:56:53.486554 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 08:56:53.486554 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb621205-f7b7-4823-b3b9-fb903ac44b2a could not be found. Sep 14 08:56:53.486554 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:56:53.489983 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:56:53.489983 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:56:53.489983 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:56:53.489983 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:56:53.489983 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:56:53.489983 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:56:53.489983 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:56:53.489983 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb621205-f7b7-4823-b3b9-fb903ac44b2a could not be found. Sep 14 08:56:53.489983 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:56:53.489983 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-821403e9-d158-41a5-ac4a-b073c33d5aaa tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Returning 404 to user: Instance bb621205-f7b7-4823-b3b9-fb903ac44b2a could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:56:53.489983 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-821403e9-d158-41a5-ac4a-b073c33d5aaa tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/bb621205-f7b7-4823-b3b9-fb903ac44b2a" status: 404 len: 111 microversion: 2.25 time: 0.059920 Sep 14 08:56:53.489983 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 985/1922] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:56:53 2022] GET /compute/v2.1/servers/bb621205-f7b7-4823-b3b9-fb903ac44b2a => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 14 08:56:53.522060 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-2335061f-f900-4c69-8142-09b175892d1e tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:56:53.522696 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-2335061f-f900-4c69-8142-09b175892d1e tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 8a7e712b-b175-4ebc-9681-42ff2a91867d] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:56:53.578819 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2335061f-f900-4c69-8142-09b175892d1e tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:53.585771 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2335061f-f900-4c69-8142-09b175892d1e tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:53.589799 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2335061f-f900-4c69-8142-09b175892d1e tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:53.594862 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2335061f-f900-4c69-8142-09b175892d1e tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:53.618515 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2335061f-f900-4c69-8142-09b175892d1e tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:53.621092 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2335061f-f900-4c69-8142-09b175892d1e tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:53.850276 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-2335061f-f900-4c69-8142-09b175892d1e tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:53.863202 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-2335061f-f900-4c69-8142-09b175892d1e tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/8a7e712b-b175-4ebc-9681-42ff2a91867d" status: 200 len: 1286 microversion: 2.1 time: 0.358831 Sep 14 08:56:53.871193 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 986/1923] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:56:53 2022] GET /compute/v2.1/servers/8a7e712b-b175-4ebc-9681-42ff2a91867d => generated 1286 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:56:53.876669 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d86cc0f5-e55b-4d26-a059-74e6e3a8ad8e tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:56:53.877326 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-d86cc0f5-e55b-4d26-a059-74e6e3a8ad8e tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: ad55193e-b097-4372-9a00-972ed2b486f8] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:56:53.887560 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d86cc0f5-e55b-4d26-a059-74e6e3a8ad8e tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:53.888088 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d86cc0f5-e55b-4d26-a059-74e6e3a8ad8e tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:53.889540 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d86cc0f5-e55b-4d26-a059-74e6e3a8ad8e tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:53.890424 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d86cc0f5-e55b-4d26-a059-74e6e3a8ad8e tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:53.891068 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d86cc0f5-e55b-4d26-a059-74e6e3a8ad8e tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:53.891658 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d86cc0f5-e55b-4d26-a059-74e6e3a8ad8e tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:54.021682 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-d86cc0f5-e55b-4d26-a059-74e6e3a8ad8e tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:54.031393 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-d86cc0f5-e55b-4d26-a059-74e6e3a8ad8e tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/ad55193e-b097-4372-9a00-972ed2b486f8" status: 200 len: 1103 microversion: 2.1 time: 0.158752 Sep 14 08:56:54.033264 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 987/1924] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:56:53 2022] GET /compute/v2.1/servers/ad55193e-b097-4372-9a00-972ed2b486f8 => generated 1103 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:56:54.038562 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ec1e65a5-af84-421a-8828-6db3e582c362 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:56:54.039424 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-ec1e65a5-af84-421a-8828-6db3e582c362 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] [instance: 8dd1623b-312c-411d-8f6c-b334195e573b] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:56:54.046985 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ec1e65a5-af84-421a-8828-6db3e582c362 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:54.047930 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ec1e65a5-af84-421a-8828-6db3e582c362 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:54.048632 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ec1e65a5-af84-421a-8828-6db3e582c362 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:54.049538 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ec1e65a5-af84-421a-8828-6db3e582c362 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:54.050283 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ec1e65a5-af84-421a-8828-6db3e582c362 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:54.050867 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ec1e65a5-af84-421a-8828-6db3e582c362 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:54.393160 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-ec1e65a5-af84-421a-8828-6db3e582c362 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab2d64c1cb447f9bfd658408aa07e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ecc8c1389847c7bcd9cd5570d990e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:54.401202 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-ec1e65a5-af84-421a-8828-6db3e582c362 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] 10.222.0.60 "GET /compute/v2.1/servers/8dd1623b-312c-411d-8f6c-b334195e573b" status: 200 len: 1464 microversion: 2.1 time: 0.366737 Sep 14 08:56:54.401791 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 988/1925] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:56:54 2022] GET /compute/v2.1/servers/8dd1623b-312c-411d-8f6c-b334195e573b => generated 1464 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:56:54.424446 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-78f45c4d-6462-4633-84bd-570e1ff001b0 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:56:54.427563 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-78f45c4d-6462-4633-84bd-570e1ff001b0 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] [instance: 8dd1623b-312c-411d-8f6c-b334195e573b] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:56:54.438030 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-78f45c4d-6462-4633-84bd-570e1ff001b0 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:54.438754 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-78f45c4d-6462-4633-84bd-570e1ff001b0 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:54.439468 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-78f45c4d-6462-4633-84bd-570e1ff001b0 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:54.440357 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-78f45c4d-6462-4633-84bd-570e1ff001b0 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:54.440959 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-78f45c4d-6462-4633-84bd-570e1ff001b0 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:54.441539 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-78f45c4d-6462-4633-84bd-570e1ff001b0 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:54.520224 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:56:54.538707 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-78f45c4d-6462-4633-84bd-570e1ff001b0 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Flavor limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 08:56:54.540310 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-78f45c4d-6462-4633-84bd-570e1ff001b0 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Image limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 08:56:54.540961 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-78f45c4d-6462-4633-84bd-570e1ff001b0 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Flavor pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 08:56:54.541850 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-78f45c4d-6462-4633-84bd-570e1ff001b0 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Image pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 08:56:54.542426 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-78f45c4d-6462-4633-84bd-570e1ff001b0 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 08:56:54.626641 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-78f45c4d-6462-4633-84bd-570e1ff001b0 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] [instance: 8dd1623b-312c-411d-8f6c-b334195e573b] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:56:54.636224 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-78f45c4d-6462-4633-84bd-570e1ff001b0 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:54.637026 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-78f45c4d-6462-4633-84bd-570e1ff001b0 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:54.637697 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-78f45c4d-6462-4633-84bd-570e1ff001b0 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:54.638873 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-78f45c4d-6462-4633-84bd-570e1ff001b0 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:54.640228 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-78f45c4d-6462-4633-84bd-570e1ff001b0 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:54.640948 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-78f45c4d-6462-4633-84bd-570e1ff001b0 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:54.683051 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-78f45c4d-6462-4633-84bd-570e1ff001b0 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] 10.222.0.60 "POST /compute/v2.1/servers/8dd1623b-312c-411d-8f6c-b334195e573b/action" status: 202 len: 1068 microversion: 2.1 time: 0.262939 Sep 14 08:56:54.697965 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 989/1926] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 08:56:54 2022] POST /compute/v2.1/servers/8dd1623b-312c-411d-8f6c-b334195e573b/action => generated 1068 bytes in 277 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Sep 14 08:56:54.720689 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-f6498f3f-c44d-48dc-8c75-9b15c0120cfb tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:56:54.721550 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-f6498f3f-c44d-48dc-8c75-9b15c0120cfb tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] [instance: 8dd1623b-312c-411d-8f6c-b334195e573b] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:56:54.738503 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f6498f3f-c44d-48dc-8c75-9b15c0120cfb tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:54.742187 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f6498f3f-c44d-48dc-8c75-9b15c0120cfb tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:54.744730 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f6498f3f-c44d-48dc-8c75-9b15c0120cfb tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:54.745704 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f6498f3f-c44d-48dc-8c75-9b15c0120cfb tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:54.748562 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f6498f3f-c44d-48dc-8c75-9b15c0120cfb tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:54.750058 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f6498f3f-c44d-48dc-8c75-9b15c0120cfb tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:54.917490 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-69169afd-0cba-4604-b568-ec42b38ab041 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Flavor limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 08:56:54.918673 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-69169afd-0cba-4604-b568-ec42b38ab041 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Image limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 08:56:54.919821 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-69169afd-0cba-4604-b568-ec42b38ab041 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Flavor pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 08:56:54.920569 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-69169afd-0cba-4604-b568-ec42b38ab041 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Image pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 08:56:54.921262 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-69169afd-0cba-4604-b568-ec42b38ab041 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 08:56:54.943253 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-69169afd-0cba-4604-b568-ec42b38ab041 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:54.945978 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-69169afd-0cba-4604-b568-ec42b38ab041 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:54.946680 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-69169afd-0cba-4604-b568-ec42b38ab041 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:54.948781 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-69169afd-0cba-4604-b568-ec42b38ab041 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:54.950755 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-69169afd-0cba-4604-b568-ec42b38ab041 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:54.951424 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-69169afd-0cba-4604-b568-ec42b38ab041 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:54.996833 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-69169afd-0cba-4604-b568-ec42b38ab041 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Getting quotas for project 99ee157fa0b44443b6de7a2d8356599a. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 08:56:55.005635 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-69169afd-0cba-4604-b568-ec42b38ab041 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Getting quotas for user a6bb565169d0464389de47f7fc1fcf36 and project 99ee157fa0b44443b6de7a2d8356599a. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 08:56:55.140959 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-f6498f3f-c44d-48dc-8c75-9b15c0120cfb tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab2d64c1cb447f9bfd658408aa07e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ecc8c1389847c7bcd9cd5570d990e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:55.149317 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-f6498f3f-c44d-48dc-8c75-9b15c0120cfb tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] 10.222.0.60 "GET /compute/v2.1/servers/8dd1623b-312c-411d-8f6c-b334195e573b" status: 200 len: 1473 microversion: 2.1 time: 0.449518 Sep 14 08:56:55.153243 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 990/1927] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:56:54 2022] GET /compute/v2.1/servers/8dd1623b-312c-411d-8f6c-b334195e573b => generated 1473 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:56:55.163132 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-8483c8a7-0752-44a2-a9d3-52e567d07e16 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:56:55.163762 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-8483c8a7-0752-44a2-a9d3-52e567d07e16 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 8a7e712b-b175-4ebc-9681-42ff2a91867d] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:56:55.179355 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8483c8a7-0752-44a2-a9d3-52e567d07e16 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:55.179875 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8483c8a7-0752-44a2-a9d3-52e567d07e16 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:55.180659 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8483c8a7-0752-44a2-a9d3-52e567d07e16 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:55.184741 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8483c8a7-0752-44a2-a9d3-52e567d07e16 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:55.185227 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8483c8a7-0752-44a2-a9d3-52e567d07e16 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:55.185674 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8483c8a7-0752-44a2-a9d3-52e567d07e16 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:55.266294 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-69169afd-0cba-4604-b568-ec42b38ab041 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Going to run 1 instances... {{(pid=128759) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 08:56:55.270461 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-69169afd-0cba-4604-b568-ec42b38ab041 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] [instance: 59f196e8-c202-4073-8663-2ae19358a044] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='7595555a-2090-4945-ba09-4cd60b92caf9',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='be83f452-5cdf-4730-ab02-b8ecb22eef26',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='337c62cc-fd5e-4c51-aca5-e8ad9f992d04',volume_size=None,volume_type=None)] {{(pid=128759) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 08:56:55.740622 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-8483c8a7-0752-44a2-a9d3-52e567d07e16 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:55.752510 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-8483c8a7-0752-44a2-a9d3-52e567d07e16 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/8a7e712b-b175-4ebc-9681-42ff2a91867d" status: 200 len: 1328 microversion: 2.1 time: 0.598043 Sep 14 08:56:55.758824 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 991/1928] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:56:55 2022] GET /compute/v2.1/servers/8a7e712b-b175-4ebc-9681-42ff2a91867d => generated 1328 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:56:55.781736 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-edfbdf3b-9e83-414e-9dd0-d8a39734e112 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:56:55.783524 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-edfbdf3b-9e83-414e-9dd0-d8a39734e112 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: ad55193e-b097-4372-9a00-972ed2b486f8] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:56:55.813443 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-edfbdf3b-9e83-414e-9dd0-d8a39734e112 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:55.822188 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-edfbdf3b-9e83-414e-9dd0-d8a39734e112 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:55.825391 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-edfbdf3b-9e83-414e-9dd0-d8a39734e112 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:55.826339 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-edfbdf3b-9e83-414e-9dd0-d8a39734e112 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:55.828275 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-edfbdf3b-9e83-414e-9dd0-d8a39734e112 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:55.833480 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-edfbdf3b-9e83-414e-9dd0-d8a39734e112 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:55.986782 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-69169afd-0cba-4604-b568-ec42b38ab041 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.42 time: 6.280034 Sep 14 08:56:55.988239 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 938/1929] 10.222.0.60 () {62 vars in 1189 bytes} [Wed Sep 14 08:56:49 2022] POST /compute/v2.1/servers => generated 406 bytes in 6284 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 14 08:56:56.001924 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9384b634-1921-4bc8-ba7a-2fc1fa5b7c96 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:56:56.002903 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-9384b634-1921-4bc8-ba7a-2fc1fa5b7c96 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] [instance: 59f196e8-c202-4073-8663-2ae19358a044] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:56:56.064819 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-edfbdf3b-9e83-414e-9dd0-d8a39734e112 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:56.073496 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-edfbdf3b-9e83-414e-9dd0-d8a39734e112 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/ad55193e-b097-4372-9a00-972ed2b486f8" status: 200 len: 1169 microversion: 2.1 time: 0.313527 Sep 14 08:56:56.083145 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 992/1930] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:56:55 2022] GET /compute/v2.1/servers/ad55193e-b097-4372-9a00-972ed2b486f8 => generated 1169 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:56:56.177473 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-f4bb3519-683a-48b2-89b0-86cd9cfe451f tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:56:56.178491 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-f4bb3519-683a-48b2-89b0-86cd9cfe451f tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] [instance: 8dd1623b-312c-411d-8f6c-b334195e573b] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:56:56.195547 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f4bb3519-683a-48b2-89b0-86cd9cfe451f tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:56.196305 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f4bb3519-683a-48b2-89b0-86cd9cfe451f tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:56.196902 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f4bb3519-683a-48b2-89b0-86cd9cfe451f tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:56.197765 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f4bb3519-683a-48b2-89b0-86cd9cfe451f tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:56.198516 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f4bb3519-683a-48b2-89b0-86cd9cfe451f tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:56.201473 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f4bb3519-683a-48b2-89b0-86cd9cfe451f tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:56.229839 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-9384b634-1921-4bc8-ba7a-2fc1fa5b7c96 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:56.256495 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-9384b634-1921-4bc8-ba7a-2fc1fa5b7c96 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:56.258137 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-9384b634-1921-4bc8-ba7a-2fc1fa5b7c96 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:56.263050 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-9384b634-1921-4bc8-ba7a-2fc1fa5b7c96 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] 10.222.0.60 "GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044" status: 200 len: 1283 microversion: 2.42 time: 0.267425 Sep 14 08:56:56.281710 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 939/1931] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:56:55 2022] GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044 => generated 1283 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 08:56:56.776928 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-74154609-2501-405e-a32b-4427adf96e33 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:56:56.777974 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-74154609-2501-405e-a32b-4427adf96e33 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 8a7e712b-b175-4ebc-9681-42ff2a91867d] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:56:56.792531 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-74154609-2501-405e-a32b-4427adf96e33 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:56.793261 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-74154609-2501-405e-a32b-4427adf96e33 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:56.793878 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-74154609-2501-405e-a32b-4427adf96e33 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:56.794752 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-74154609-2501-405e-a32b-4427adf96e33 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:56.797432 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-74154609-2501-405e-a32b-4427adf96e33 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:56.798788 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-74154609-2501-405e-a32b-4427adf96e33 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:56.897504 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-f4bb3519-683a-48b2-89b0-86cd9cfe451f tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab2d64c1cb447f9bfd658408aa07e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ecc8c1389847c7bcd9cd5570d990e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:56.916121 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-f4bb3519-683a-48b2-89b0-86cd9cfe451f tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] 10.222.0.60 "GET /compute/v2.1/servers/8dd1623b-312c-411d-8f6c-b334195e573b" status: 200 len: 1473 microversion: 2.1 time: 0.742377 Sep 14 08:56:56.921438 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 993/1932] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:56:56 2022] GET /compute/v2.1/servers/8dd1623b-312c-411d-8f6c-b334195e573b => generated 1473 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:56:57.109566 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-26eac44b-b1b9-44e1-ac9e-4c514f55de67 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:56:57.110248 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-26eac44b-b1b9-44e1-ac9e-4c514f55de67 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: ad55193e-b097-4372-9a00-972ed2b486f8] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:56:57.121001 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-26eac44b-b1b9-44e1-ac9e-4c514f55de67 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:57.126579 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-26eac44b-b1b9-44e1-ac9e-4c514f55de67 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:57.128630 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-26eac44b-b1b9-44e1-ac9e-4c514f55de67 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:57.130198 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-26eac44b-b1b9-44e1-ac9e-4c514f55de67 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:57.135250 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-26eac44b-b1b9-44e1-ac9e-4c514f55de67 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:57.135792 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-26eac44b-b1b9-44e1-ac9e-4c514f55de67 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:57.243658 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-74154609-2501-405e-a32b-4427adf96e33 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:57.256187 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-74154609-2501-405e-a32b-4427adf96e33 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/8a7e712b-b175-4ebc-9681-42ff2a91867d" status: 200 len: 1328 microversion: 2.1 time: 0.483410 Sep 14 08:56:57.272281 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 940/1933] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:56:56 2022] GET /compute/v2.1/servers/8a7e712b-b175-4ebc-9681-42ff2a91867d => generated 1328 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:56:57.301267 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-cb3eb9b5-b789-47b0-ac28-a1f6f79c08a1 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:56:57.302178 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-cb3eb9b5-b789-47b0-ac28-a1f6f79c08a1 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] [instance: 59f196e8-c202-4073-8663-2ae19358a044] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:56:57.564948 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-cb3eb9b5-b789-47b0-ac28-a1f6f79c08a1 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:57.573451 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-cb3eb9b5-b789-47b0-ac28-a1f6f79c08a1 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:57.582101 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-cb3eb9b5-b789-47b0-ac28-a1f6f79c08a1 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:57.592420 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-cb3eb9b5-b789-47b0-ac28-a1f6f79c08a1 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] 10.222.0.60 "GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044" status: 200 len: 1283 microversion: 2.42 time: 0.297112 Sep 14 08:56:57.593528 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 941/1934] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:56:57 2022] GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044 => generated 1283 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:56:57.714676 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-26eac44b-b1b9-44e1-ac9e-4c514f55de67 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:57.742852 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-26eac44b-b1b9-44e1-ac9e-4c514f55de67 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/ad55193e-b097-4372-9a00-972ed2b486f8" status: 200 len: 1211 microversion: 2.1 time: 0.637629 Sep 14 08:56:57.755278 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 994/1935] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:56:57 2022] GET /compute/v2.1/servers/ad55193e-b097-4372-9a00-972ed2b486f8 => generated 1211 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:56:57.948092 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-88b75eff-8470-466d-ad7d-5224e724b6c0 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:56:57.949111 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-88b75eff-8470-466d-ad7d-5224e724b6c0 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] [instance: 8dd1623b-312c-411d-8f6c-b334195e573b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:56:57.961874 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-88b75eff-8470-466d-ad7d-5224e724b6c0 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:57.963018 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-88b75eff-8470-466d-ad7d-5224e724b6c0 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:57.963786 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-88b75eff-8470-466d-ad7d-5224e724b6c0 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:57.964666 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-88b75eff-8470-466d-ad7d-5224e724b6c0 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:57.970415 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-88b75eff-8470-466d-ad7d-5224e724b6c0 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:57.971247 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-88b75eff-8470-466d-ad7d-5224e724b6c0 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:58.290011 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b8bb2790-1ef0-4537-aec0-4b42f790bb72 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:56:58.290627 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-b8bb2790-1ef0-4537-aec0-4b42f790bb72 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 8a7e712b-b175-4ebc-9681-42ff2a91867d] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:56:58.310407 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b8bb2790-1ef0-4537-aec0-4b42f790bb72 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:58.311326 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b8bb2790-1ef0-4537-aec0-4b42f790bb72 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:58.317411 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b8bb2790-1ef0-4537-aec0-4b42f790bb72 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:58.318643 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b8bb2790-1ef0-4537-aec0-4b42f790bb72 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:58.319416 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b8bb2790-1ef0-4537-aec0-4b42f790bb72 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:58.324011 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b8bb2790-1ef0-4537-aec0-4b42f790bb72 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:58.437788 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-88b75eff-8470-466d-ad7d-5224e724b6c0 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab2d64c1cb447f9bfd658408aa07e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ecc8c1389847c7bcd9cd5570d990e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:58.449151 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-88b75eff-8470-466d-ad7d-5224e724b6c0 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] 10.222.0.60 "GET /compute/v2.1/servers/8dd1623b-312c-411d-8f6c-b334195e573b" status: 200 len: 1473 microversion: 2.1 time: 0.504851 Sep 14 08:56:58.467183 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 942/1936] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:56:57 2022] GET /compute/v2.1/servers/8dd1623b-312c-411d-8f6c-b334195e573b => generated 1473 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:56:58.611147 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-9104a1f0-d6c3-47d1-a801-91b2d5379854 req-d0d65314-97ca-4014-a2e2-36253cd4e134 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad55193e-b097-4372-9a00-972ed2b486f8", "tag": "86eca38d-0fbc-40dc-8c19-2e0f4d671871"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:56:58.641624 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-9104a1f0-d6c3-47d1-a801-91b2d5379854 req-d0d65314-97ca-4014-a2e2-36253cd4e134 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:58.642161 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-9104a1f0-d6c3-47d1-a801-91b2d5379854 req-d0d65314-97ca-4014-a2e2-36253cd4e134 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:58.648489 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-9104a1f0-d6c3-47d1-a801-91b2d5379854 req-d0d65314-97ca-4014-a2e2-36253cd4e134 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:58.684605 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-9104a1f0-d6c3-47d1-a801-91b2d5379854 req-d0d65314-97ca-4014-a2e2-36253cd4e134 service nova] Creating event network-changed:86eca38d-0fbc-40dc-8c19-2e0f4d671871 for instance ad55193e-b097-4372-9a00-972ed2b486f8 on n-h1-836830-18 Sep 14 08:56:58.716983 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-9104a1f0-d6c3-47d1-a801-91b2d5379854 req-d0d65314-97ca-4014-a2e2-36253cd4e134 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106761 Sep 14 08:56:58.720333 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 943/1937] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:56:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 08:56:58.738130 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-2494a0c9-7c41-4d1a-a6d1-36f598b3f705 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:56:58.738849 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-2494a0c9-7c41-4d1a-a6d1-36f598b3f705 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] [instance: 59f196e8-c202-4073-8663-2ae19358a044] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:56:58.767770 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2494a0c9-7c41-4d1a-a6d1-36f598b3f705 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:58.768272 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2494a0c9-7c41-4d1a-a6d1-36f598b3f705 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:58.772447 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2494a0c9-7c41-4d1a-a6d1-36f598b3f705 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:58.773205 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2494a0c9-7c41-4d1a-a6d1-36f598b3f705 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:58.781459 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2494a0c9-7c41-4d1a-a6d1-36f598b3f705 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:58.783383 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2494a0c9-7c41-4d1a-a6d1-36f598b3f705 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:58.859651 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-b8bb2790-1ef0-4537-aec0-4b42f790bb72 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:58.876824 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-b8bb2790-1ef0-4537-aec0-4b42f790bb72 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/8a7e712b-b175-4ebc-9681-42ff2a91867d" status: 200 len: 1328 microversion: 2.1 time: 0.582973 Sep 14 08:56:58.879571 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 995/1938] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:56:58 2022] GET /compute/v2.1/servers/8a7e712b-b175-4ebc-9681-42ff2a91867d => generated 1328 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:56:58.897405 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-42a9eae9-51bb-4ede-9005-a5a6d1b460af tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:56:58.901897 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-42a9eae9-51bb-4ede-9005-a5a6d1b460af tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: ad55193e-b097-4372-9a00-972ed2b486f8] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:56:58.931934 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-42a9eae9-51bb-4ede-9005-a5a6d1b460af tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:58.932761 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-42a9eae9-51bb-4ede-9005-a5a6d1b460af tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:58.933569 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-42a9eae9-51bb-4ede-9005-a5a6d1b460af tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:58.937184 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-42a9eae9-51bb-4ede-9005-a5a6d1b460af tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:58.940700 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-42a9eae9-51bb-4ede-9005-a5a6d1b460af tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:58.941403 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-42a9eae9-51bb-4ede-9005-a5a6d1b460af tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:59.220700 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-2494a0c9-7c41-4d1a-a6d1-36f598b3f705 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:59.223255 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:56:59.240328 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-2494a0c9-7c41-4d1a-a6d1-36f598b3f705 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:59.256050 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-2494a0c9-7c41-4d1a-a6d1-36f598b3f705 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:59.257950 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-2494a0c9-7c41-4d1a-a6d1-36f598b3f705 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] 10.222.0.60 "GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044" status: 200 len: 1573 microversion: 2.42 time: 0.536435 Sep 14 08:56:59.258776 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 944/1939] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:56:58 2022] GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044 => generated 1573 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:56:59.292682 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-e067c61d-fbe5-4ba7-becb-f3b2d2878d35 req-5ac07082-5a5c-4c52-a8ed-e5516c6a5ea8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a7e712b-b175-4ebc-9681-42ff2a91867d", "tag": "5c5eee18-9716-472b-b5c5-030fbf084ba6"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:56:59.336151 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-e067c61d-fbe5-4ba7-becb-f3b2d2878d35 req-5ac07082-5a5c-4c52-a8ed-e5516c6a5ea8 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:59.338490 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-e067c61d-fbe5-4ba7-becb-f3b2d2878d35 req-5ac07082-5a5c-4c52-a8ed-e5516c6a5ea8 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:59.339090 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-e067c61d-fbe5-4ba7-becb-f3b2d2878d35 req-5ac07082-5a5c-4c52-a8ed-e5516c6a5ea8 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:59.382172 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-e067c61d-fbe5-4ba7-becb-f3b2d2878d35 req-5ac07082-5a5c-4c52-a8ed-e5516c6a5ea8 service nova] Creating event network-changed:5c5eee18-9716-472b-b5c5-030fbf084ba6 for instance 8a7e712b-b175-4ebc-9681-42ff2a91867d on n-h1-836830-18 Sep 14 08:56:59.417247 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-e067c61d-fbe5-4ba7-becb-f3b2d2878d35 req-5ac07082-5a5c-4c52-a8ed-e5516c6a5ea8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.150884 Sep 14 08:56:59.418222 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 945/1940] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:56:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:56:59.489728 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-4b3855f9-38fa-4b44-9da4-3c895c07f7e6 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:56:59.490515 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-4b3855f9-38fa-4b44-9da4-3c895c07f7e6 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] [instance: 8dd1623b-312c-411d-8f6c-b334195e573b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:56:59.506781 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4b3855f9-38fa-4b44-9da4-3c895c07f7e6 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:59.508776 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4b3855f9-38fa-4b44-9da4-3c895c07f7e6 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:59.509334 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4b3855f9-38fa-4b44-9da4-3c895c07f7e6 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:59.516562 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4b3855f9-38fa-4b44-9da4-3c895c07f7e6 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:59.517179 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4b3855f9-38fa-4b44-9da4-3c895c07f7e6 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:59.517793 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4b3855f9-38fa-4b44-9da4-3c895c07f7e6 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:59.614093 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-42a9eae9-51bb-4ede-9005-a5a6d1b460af tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:59.629230 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-42a9eae9-51bb-4ede-9005-a5a6d1b460af tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/ad55193e-b097-4372-9a00-972ed2b486f8" status: 200 len: 1211 microversion: 2.1 time: 0.745875 Sep 14 08:56:59.630209 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 996/1941] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:56:58 2022] GET /compute/v2.1/servers/ad55193e-b097-4372-9a00-972ed2b486f8 => generated 1211 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:56:59.907280 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-559bd086-54ee-4494-88a0-a5036c55ad6e tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:56:59.908349 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-559bd086-54ee-4494-88a0-a5036c55ad6e tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 8a7e712b-b175-4ebc-9681-42ff2a91867d] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:56:59.924037 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-559bd086-54ee-4494-88a0-a5036c55ad6e tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:59.924798 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-559bd086-54ee-4494-88a0-a5036c55ad6e tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:59.927246 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-559bd086-54ee-4494-88a0-a5036c55ad6e tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:59.928153 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-559bd086-54ee-4494-88a0-a5036c55ad6e tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:56:59.931537 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-559bd086-54ee-4494-88a0-a5036c55ad6e tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:56:59.932301 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-559bd086-54ee-4494-88a0-a5036c55ad6e tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:56:59.986545 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-4b3855f9-38fa-4b44-9da4-3c895c07f7e6 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab2d64c1cb447f9bfd658408aa07e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ecc8c1389847c7bcd9cd5570d990e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:56:59.996637 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-4b3855f9-38fa-4b44-9da4-3c895c07f7e6 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] 10.222.0.60 "GET /compute/v2.1/servers/8dd1623b-312c-411d-8f6c-b334195e573b" status: 200 len: 1473 microversion: 2.1 time: 0.517892 Sep 14 08:57:00.019071 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 946/1942] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:56:59 2022] GET /compute/v2.1/servers/8dd1623b-312c-411d-8f6c-b334195e573b => generated 1473 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:57:00.289112 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a6ea68cc-94c4-439e-a9a7-323b8f712ccf tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:00.289956 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-a6ea68cc-94c4-439e-a9a7-323b8f712ccf tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] [instance: 59f196e8-c202-4073-8663-2ae19358a044] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:00.300933 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a6ea68cc-94c4-439e-a9a7-323b8f712ccf tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:00.315867 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a6ea68cc-94c4-439e-a9a7-323b8f712ccf tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:00.318042 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a6ea68cc-94c4-439e-a9a7-323b8f712ccf tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:00.318974 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a6ea68cc-94c4-439e-a9a7-323b8f712ccf tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:00.328488 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a6ea68cc-94c4-439e-a9a7-323b8f712ccf tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:00.334405 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a6ea68cc-94c4-439e-a9a7-323b8f712ccf tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:01.241331 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-559bd086-54ee-4494-88a0-a5036c55ad6e tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:01.253108 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-559bd086-54ee-4494-88a0-a5036c55ad6e tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/8a7e712b-b175-4ebc-9681-42ff2a91867d" status: 200 len: 1328 microversion: 2.1 time: 1.349664 Sep 14 08:57:01.271882 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 997/1943] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:56:59 2022] GET /compute/v2.1/servers/8a7e712b-b175-4ebc-9681-42ff2a91867d => generated 1328 bytes in 1369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:57:01.279345 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-34e65843-3552-4dfe-b6ef-05578cec7eb3 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:01.281039 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-34e65843-3552-4dfe-b6ef-05578cec7eb3 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: ad55193e-b097-4372-9a00-972ed2b486f8] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:01.290529 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-34e65843-3552-4dfe-b6ef-05578cec7eb3 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:01.292321 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-34e65843-3552-4dfe-b6ef-05578cec7eb3 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:01.293125 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-34e65843-3552-4dfe-b6ef-05578cec7eb3 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:01.294130 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-34e65843-3552-4dfe-b6ef-05578cec7eb3 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:01.294847 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-34e65843-3552-4dfe-b6ef-05578cec7eb3 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:01.296106 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-34e65843-3552-4dfe-b6ef-05578cec7eb3 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:01.424616 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-a6ea68cc-94c4-439e-a9a7-323b8f712ccf tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:01.453553 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-a6ea68cc-94c4-439e-a9a7-323b8f712ccf tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:01.456614 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-a6ea68cc-94c4-439e-a9a7-323b8f712ccf tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:01.458107 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a6ea68cc-94c4-439e-a9a7-323b8f712ccf tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] 10.222.0.60 "GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044" status: 200 len: 1591 microversion: 2.42 time: 1.173076 Sep 14 08:57:01.473301 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 947/1944] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:57:00 2022] GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044 => generated 1591 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:57:01.485095 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f1a47fac-201a-41ae-ac84-6fff495fc41a tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:01.486535 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f1a47fac-201a-41ae-ac84-6fff495fc41a tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] [instance: 8dd1623b-312c-411d-8f6c-b334195e573b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:01.502201 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f1a47fac-201a-41ae-ac84-6fff495fc41a tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:01.504459 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f1a47fac-201a-41ae-ac84-6fff495fc41a tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:01.507188 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f1a47fac-201a-41ae-ac84-6fff495fc41a tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:01.508250 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f1a47fac-201a-41ae-ac84-6fff495fc41a tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:01.510851 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f1a47fac-201a-41ae-ac84-6fff495fc41a tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:01.511578 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f1a47fac-201a-41ae-ac84-6fff495fc41a tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:01.745882 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-34e65843-3552-4dfe-b6ef-05578cec7eb3 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:01.762056 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-34e65843-3552-4dfe-b6ef-05578cec7eb3 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/ad55193e-b097-4372-9a00-972ed2b486f8" status: 200 len: 1211 microversion: 2.1 time: 0.488509 Sep 14 08:57:01.763321 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 998/1945] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:57:01 2022] GET /compute/v2.1/servers/ad55193e-b097-4372-9a00-972ed2b486f8 => generated 1211 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:57:01.965431 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f1a47fac-201a-41ae-ac84-6fff495fc41a tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab2d64c1cb447f9bfd658408aa07e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ecc8c1389847c7bcd9cd5570d990e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:01.977790 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f1a47fac-201a-41ae-ac84-6fff495fc41a tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] 10.222.0.60 "GET /compute/v2.1/servers/8dd1623b-312c-411d-8f6c-b334195e573b" status: 200 len: 1473 microversion: 2.1 time: 0.496764 Sep 14 08:57:01.979013 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 948/1946] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:57:01 2022] GET /compute/v2.1/servers/8dd1623b-312c-411d-8f6c-b334195e573b => generated 1473 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:57:02.286807 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-40ded0e5-4419-48e8-8465-62e0777fed5f tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:02.289582 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-40ded0e5-4419-48e8-8465-62e0777fed5f tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 8a7e712b-b175-4ebc-9681-42ff2a91867d] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:02.303016 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-40ded0e5-4419-48e8-8465-62e0777fed5f tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:02.303534 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-40ded0e5-4419-48e8-8465-62e0777fed5f tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:02.304046 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-40ded0e5-4419-48e8-8465-62e0777fed5f tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:02.304880 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-40ded0e5-4419-48e8-8465-62e0777fed5f tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:02.305410 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-40ded0e5-4419-48e8-8465-62e0777fed5f tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:02.306164 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-40ded0e5-4419-48e8-8465-62e0777fed5f tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:02.487305 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d1e217ea-ff5d-4b60-9f78-f8422cd7ea1c tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:02.488021 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-d1e217ea-ff5d-4b60-9f78-f8422cd7ea1c tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] [instance: 59f196e8-c202-4073-8663-2ae19358a044] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:02.501289 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d1e217ea-ff5d-4b60-9f78-f8422cd7ea1c tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:02.501893 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d1e217ea-ff5d-4b60-9f78-f8422cd7ea1c tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:02.502402 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d1e217ea-ff5d-4b60-9f78-f8422cd7ea1c tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:02.503836 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d1e217ea-ff5d-4b60-9f78-f8422cd7ea1c tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:02.504489 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d1e217ea-ff5d-4b60-9f78-f8422cd7ea1c tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:02.505112 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d1e217ea-ff5d-4b60-9f78-f8422cd7ea1c tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:02.590649 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-40ded0e5-4419-48e8-8465-62e0777fed5f tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:02.600600 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-40ded0e5-4419-48e8-8465-62e0777fed5f tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/8a7e712b-b175-4ebc-9681-42ff2a91867d" status: 200 len: 1328 microversion: 2.1 time: 0.319258 Sep 14 08:57:02.611948 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 999/1947] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:57:02 2022] GET /compute/v2.1/servers/8a7e712b-b175-4ebc-9681-42ff2a91867d => generated 1328 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:57:02.625933 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-d1e217ea-ff5d-4b60-9f78-f8422cd7ea1c tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:02.640244 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-d1e217ea-ff5d-4b60-9f78-f8422cd7ea1c tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:02.642739 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-d1e217ea-ff5d-4b60-9f78-f8422cd7ea1c tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:02.644234 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d1e217ea-ff5d-4b60-9f78-f8422cd7ea1c tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] 10.222.0.60 "GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044" status: 200 len: 1591 microversion: 2.42 time: 0.161313 Sep 14 08:57:02.659672 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 949/1948] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:57:02 2022] GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044 => generated 1591 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:57:02.801559 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-5ed28b95-096a-4507-886d-beed918d73b7 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:02.803959 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-5ed28b95-096a-4507-886d-beed918d73b7 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: ad55193e-b097-4372-9a00-972ed2b486f8] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:02.812310 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=4 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:57:02.814182 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=20 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:57:02.816614 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5ed28b95-096a-4507-886d-beed918d73b7 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:02.817587 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5ed28b95-096a-4507-886d-beed918d73b7 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:02.820204 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5ed28b95-096a-4507-886d-beed918d73b7 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:02.821681 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5ed28b95-096a-4507-886d-beed918d73b7 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:02.823262 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5ed28b95-096a-4507-886d-beed918d73b7 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:02.824117 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5ed28b95-096a-4507-886d-beed918d73b7 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:03.005204 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-967065c7-ec2d-44b7-aae8-9f3e03c5f832 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:03.006032 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-967065c7-ec2d-44b7-aae8-9f3e03c5f832 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] [instance: 8dd1623b-312c-411d-8f6c-b334195e573b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:03.040959 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-967065c7-ec2d-44b7-aae8-9f3e03c5f832 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:03.041475 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-967065c7-ec2d-44b7-aae8-9f3e03c5f832 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:03.047139 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-967065c7-ec2d-44b7-aae8-9f3e03c5f832 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:03.047938 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-967065c7-ec2d-44b7-aae8-9f3e03c5f832 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:03.050889 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-967065c7-ec2d-44b7-aae8-9f3e03c5f832 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:03.052820 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-967065c7-ec2d-44b7-aae8-9f3e03c5f832 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:03.187419 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-5ed28b95-096a-4507-886d-beed918d73b7 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:03.200576 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-5ed28b95-096a-4507-886d-beed918d73b7 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/ad55193e-b097-4372-9a00-972ed2b486f8" status: 200 len: 1211 microversion: 2.1 time: 0.411530 Sep 14 08:57:03.215050 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1000/1949] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:57:02 2022] GET /compute/v2.1/servers/ad55193e-b097-4372-9a00-972ed2b486f8 => generated 1211 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:57:03.389873 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-967065c7-ec2d-44b7-aae8-9f3e03c5f832 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab2d64c1cb447f9bfd658408aa07e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ecc8c1389847c7bcd9cd5570d990e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:03.402413 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-967065c7-ec2d-44b7-aae8-9f3e03c5f832 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] 10.222.0.60 "GET /compute/v2.1/servers/8dd1623b-312c-411d-8f6c-b334195e573b" status: 200 len: 1473 microversion: 2.1 time: 0.400882 Sep 14 08:57:03.403901 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 950/1950] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:57:03 2022] GET /compute/v2.1/servers/8dd1623b-312c-411d-8f6c-b334195e573b => generated 1473 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:57:03.627763 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-9b91d461-57e5-453a-9fe3-5c6bc0634fbb tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:03.628995 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-9b91d461-57e5-453a-9fe3-5c6bc0634fbb tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 8a7e712b-b175-4ebc-9681-42ff2a91867d] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:03.648166 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9b91d461-57e5-453a-9fe3-5c6bc0634fbb tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:03.650283 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9b91d461-57e5-453a-9fe3-5c6bc0634fbb tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:03.651028 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9b91d461-57e5-453a-9fe3-5c6bc0634fbb tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:03.656159 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9b91d461-57e5-453a-9fe3-5c6bc0634fbb tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:03.657368 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9b91d461-57e5-453a-9fe3-5c6bc0634fbb tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:03.657885 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9b91d461-57e5-453a-9fe3-5c6bc0634fbb tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:03.675559 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-fe9020bc-0c44-47e6-afe4-4e46be66f29c tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:03.676299 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-fe9020bc-0c44-47e6-afe4-4e46be66f29c tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] [instance: 59f196e8-c202-4073-8663-2ae19358a044] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:03.690001 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fe9020bc-0c44-47e6-afe4-4e46be66f29c tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:03.690522 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fe9020bc-0c44-47e6-afe4-4e46be66f29c tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:03.693877 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fe9020bc-0c44-47e6-afe4-4e46be66f29c tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:03.694902 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fe9020bc-0c44-47e6-afe4-4e46be66f29c tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:03.695438 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fe9020bc-0c44-47e6-afe4-4e46be66f29c tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:03.696960 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fe9020bc-0c44-47e6-afe4-4e46be66f29c tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:04.013764 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-9b91d461-57e5-453a-9fe3-5c6bc0634fbb tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:04.028815 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-9b91d461-57e5-453a-9fe3-5c6bc0634fbb tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/8a7e712b-b175-4ebc-9681-42ff2a91867d" status: 200 len: 1328 microversion: 2.1 time: 0.408015 Sep 14 08:57:04.030015 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1001/1951] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:57:03 2022] GET /compute/v2.1/servers/8a7e712b-b175-4ebc-9681-42ff2a91867d => generated 1328 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:57:04.115802 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-fe9020bc-0c44-47e6-afe4-4e46be66f29c tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:04.126993 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-fe9020bc-0c44-47e6-afe4-4e46be66f29c tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:04.129500 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-fe9020bc-0c44-47e6-afe4-4e46be66f29c tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:04.131119 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-fe9020bc-0c44-47e6-afe4-4e46be66f29c tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] 10.222.0.60 "GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044" status: 200 len: 1706 microversion: 2.42 time: 0.462042 Sep 14 08:57:04.132207 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 951/1952] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:57:03 2022] GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044 => generated 1706 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:57:04.231747 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-062eefca-6d54-4efe-a0a1-78b74df0d7dd tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:04.233633 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-062eefca-6d54-4efe-a0a1-78b74df0d7dd tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: ad55193e-b097-4372-9a00-972ed2b486f8] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:04.243224 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-062eefca-6d54-4efe-a0a1-78b74df0d7dd tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:04.244080 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-062eefca-6d54-4efe-a0a1-78b74df0d7dd tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:04.244521 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-062eefca-6d54-4efe-a0a1-78b74df0d7dd tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:04.245237 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-062eefca-6d54-4efe-a0a1-78b74df0d7dd tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:04.245698 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-062eefca-6d54-4efe-a0a1-78b74df0d7dd tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:04.246279 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-062eefca-6d54-4efe-a0a1-78b74df0d7dd tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:04.429120 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d9480f39-0c3f-4f0d-b040-c507a9cda3d8 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:04.430091 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-d9480f39-0c3f-4f0d-b040-c507a9cda3d8 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] [instance: 8dd1623b-312c-411d-8f6c-b334195e573b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:04.438741 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d9480f39-0c3f-4f0d-b040-c507a9cda3d8 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:04.439548 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d9480f39-0c3f-4f0d-b040-c507a9cda3d8 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:04.440153 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d9480f39-0c3f-4f0d-b040-c507a9cda3d8 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:04.440996 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d9480f39-0c3f-4f0d-b040-c507a9cda3d8 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:04.442187 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d9480f39-0c3f-4f0d-b040-c507a9cda3d8 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:04.442758 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d9480f39-0c3f-4f0d-b040-c507a9cda3d8 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:04.473332 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-062eefca-6d54-4efe-a0a1-78b74df0d7dd tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:04.523526 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-062eefca-6d54-4efe-a0a1-78b74df0d7dd tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/ad55193e-b097-4372-9a00-972ed2b486f8" status: 200 len: 1211 microversion: 2.1 time: 0.290863 Sep 14 08:57:04.528239 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1002/1953] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:57:04 2022] GET /compute/v2.1/servers/ad55193e-b097-4372-9a00-972ed2b486f8 => generated 1211 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:57:04.813341 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-d9480f39-0c3f-4f0d-b040-c507a9cda3d8 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab2d64c1cb447f9bfd658408aa07e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ecc8c1389847c7bcd9cd5570d990e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:04.828392 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d9480f39-0c3f-4f0d-b040-c507a9cda3d8 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] 10.222.0.60 "GET /compute/v2.1/servers/8dd1623b-312c-411d-8f6c-b334195e573b" status: 200 len: 1473 microversion: 2.1 time: 0.405334 Sep 14 08:57:04.855795 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 952/1954] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:57:04 2022] GET /compute/v2.1/servers/8dd1623b-312c-411d-8f6c-b334195e573b => generated 1473 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:57:05.056316 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-86c862b1-d3f1-4293-89bb-166d32f0de3d tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:05.056955 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-86c862b1-d3f1-4293-89bb-166d32f0de3d tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 8a7e712b-b175-4ebc-9681-42ff2a91867d] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:05.070326 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-86c862b1-d3f1-4293-89bb-166d32f0de3d tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:05.071567 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-86c862b1-d3f1-4293-89bb-166d32f0de3d tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:05.072197 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-86c862b1-d3f1-4293-89bb-166d32f0de3d tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:05.073454 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-86c862b1-d3f1-4293-89bb-166d32f0de3d tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:05.073998 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-86c862b1-d3f1-4293-89bb-166d32f0de3d tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:05.074855 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-86c862b1-d3f1-4293-89bb-166d32f0de3d tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:05.157893 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-91c91aa4-3e26-43a4-be0e-0b8cdaca864b tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:05.158524 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-91c91aa4-3e26-43a4-be0e-0b8cdaca864b tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] [instance: 59f196e8-c202-4073-8663-2ae19358a044] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:05.160518 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=2 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:57:05.175088 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-91c91aa4-3e26-43a4-be0e-0b8cdaca864b tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:05.175931 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-91c91aa4-3e26-43a4-be0e-0b8cdaca864b tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:05.176535 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-91c91aa4-3e26-43a4-be0e-0b8cdaca864b tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:05.177611 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-91c91aa4-3e26-43a4-be0e-0b8cdaca864b tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:05.178403 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-91c91aa4-3e26-43a4-be0e-0b8cdaca864b tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:05.179033 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-91c91aa4-3e26-43a4-be0e-0b8cdaca864b tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:05.486015 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-86c862b1-d3f1-4293-89bb-166d32f0de3d tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:05.507134 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-86c862b1-d3f1-4293-89bb-166d32f0de3d tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/8a7e712b-b175-4ebc-9681-42ff2a91867d" status: 200 len: 1328 microversion: 2.1 time: 0.456482 Sep 14 08:57:05.507894 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1003/1955] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:57:05 2022] GET /compute/v2.1/servers/8a7e712b-b175-4ebc-9681-42ff2a91867d => generated 1328 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:57:05.555932 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-eb053c34-0430-4dfd-86dc-0652bd9e5f97 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:05.556803 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-eb053c34-0430-4dfd-86dc-0652bd9e5f97 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: ad55193e-b097-4372-9a00-972ed2b486f8] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:05.566438 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-eb053c34-0430-4dfd-86dc-0652bd9e5f97 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:05.571473 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-eb053c34-0430-4dfd-86dc-0652bd9e5f97 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:05.573272 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-eb053c34-0430-4dfd-86dc-0652bd9e5f97 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:05.576715 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-eb053c34-0430-4dfd-86dc-0652bd9e5f97 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:05.577204 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-eb053c34-0430-4dfd-86dc-0652bd9e5f97 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:05.577643 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-eb053c34-0430-4dfd-86dc-0652bd9e5f97 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:05.592573 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-91c91aa4-3e26-43a4-be0e-0b8cdaca864b tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:05.604795 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-91c91aa4-3e26-43a4-be0e-0b8cdaca864b tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:05.606650 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-91c91aa4-3e26-43a4-be0e-0b8cdaca864b tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:05.608627 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-91c91aa4-3e26-43a4-be0e-0b8cdaca864b tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] 10.222.0.60 "GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044" status: 200 len: 1753 microversion: 2.42 time: 0.454366 Sep 14 08:57:05.609652 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 953/1956] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:57:05 2022] GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044 => generated 1753 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:57:05.611116 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:57:05.821360 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-eb053c34-0430-4dfd-86dc-0652bd9e5f97 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:05.832825 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-eb053c34-0430-4dfd-86dc-0652bd9e5f97 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/ad55193e-b097-4372-9a00-972ed2b486f8" status: 200 len: 1211 microversion: 2.1 time: 0.285584 Sep 14 08:57:05.838476 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1004/1957] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:57:05 2022] GET /compute/v2.1/servers/ad55193e-b097-4372-9a00-972ed2b486f8 => generated 1211 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:57:05.863660 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-66ff5b9f-ebe3-4ce5-a147-3fddc4630530 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:05.864850 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-66ff5b9f-ebe3-4ce5-a147-3fddc4630530 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] [instance: 8dd1623b-312c-411d-8f6c-b334195e573b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:05.871994 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-66ff5b9f-ebe3-4ce5-a147-3fddc4630530 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:05.872725 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-66ff5b9f-ebe3-4ce5-a147-3fddc4630530 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:05.873508 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-66ff5b9f-ebe3-4ce5-a147-3fddc4630530 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:05.874398 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-66ff5b9f-ebe3-4ce5-a147-3fddc4630530 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:05.875130 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-66ff5b9f-ebe3-4ce5-a147-3fddc4630530 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:05.875736 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-66ff5b9f-ebe3-4ce5-a147-3fddc4630530 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:06.160511 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-66ff5b9f-ebe3-4ce5-a147-3fddc4630530 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab2d64c1cb447f9bfd658408aa07e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ecc8c1389847c7bcd9cd5570d990e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:06.173122 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-66ff5b9f-ebe3-4ce5-a147-3fddc4630530 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] 10.222.0.60 "GET /compute/v2.1/servers/8dd1623b-312c-411d-8f6c-b334195e573b" status: 200 len: 1473 microversion: 2.1 time: 0.315140 Sep 14 08:57:06.178479 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 954/1958] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:57:05 2022] GET /compute/v2.1/servers/8dd1623b-312c-411d-8f6c-b334195e573b => generated 1473 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:57:06.530855 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-4619ff76-9ec6-422b-8a19-461fb0e803a0 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:06.531680 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-4619ff76-9ec6-422b-8a19-461fb0e803a0 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 8a7e712b-b175-4ebc-9681-42ff2a91867d] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:06.539419 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4619ff76-9ec6-422b-8a19-461fb0e803a0 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:06.539916 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4619ff76-9ec6-422b-8a19-461fb0e803a0 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:06.540362 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4619ff76-9ec6-422b-8a19-461fb0e803a0 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:06.541103 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4619ff76-9ec6-422b-8a19-461fb0e803a0 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:06.541660 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4619ff76-9ec6-422b-8a19-461fb0e803a0 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:06.542095 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4619ff76-9ec6-422b-8a19-461fb0e803a0 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:06.645336 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-31c2912c-9159-4ff3-b822-4f1c4e705396 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:06.648575 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-31c2912c-9159-4ff3-b822-4f1c4e705396 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] [instance: 59f196e8-c202-4073-8663-2ae19358a044] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:06.663259 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-31c2912c-9159-4ff3-b822-4f1c4e705396 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:06.663770 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-31c2912c-9159-4ff3-b822-4f1c4e705396 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:06.664217 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-31c2912c-9159-4ff3-b822-4f1c4e705396 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:06.664970 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-31c2912c-9159-4ff3-b822-4f1c4e705396 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:06.665433 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-31c2912c-9159-4ff3-b822-4f1c4e705396 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:06.665859 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-31c2912c-9159-4ff3-b822-4f1c4e705396 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:06.864937 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-4619ff76-9ec6-422b-8a19-461fb0e803a0 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:06.875109 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-4619ff76-9ec6-422b-8a19-461fb0e803a0 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/8a7e712b-b175-4ebc-9681-42ff2a91867d" status: 200 len: 1328 microversion: 2.1 time: 0.348824 Sep 14 08:57:06.876975 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1005/1959] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:57:06 2022] GET /compute/v2.1/servers/8a7e712b-b175-4ebc-9681-42ff2a91867d => generated 1328 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:57:06.882489 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-3525b1a4-2a0c-40fa-9021-9bb0ce33d397 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:06.884303 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-3525b1a4-2a0c-40fa-9021-9bb0ce33d397 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: ad55193e-b097-4372-9a00-972ed2b486f8] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:06.892556 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3525b1a4-2a0c-40fa-9021-9bb0ce33d397 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:06.893377 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3525b1a4-2a0c-40fa-9021-9bb0ce33d397 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:06.894052 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3525b1a4-2a0c-40fa-9021-9bb0ce33d397 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:06.894988 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3525b1a4-2a0c-40fa-9021-9bb0ce33d397 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:06.895499 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3525b1a4-2a0c-40fa-9021-9bb0ce33d397 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:06.895921 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3525b1a4-2a0c-40fa-9021-9bb0ce33d397 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:06.941935 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-31c2912c-9159-4ff3-b822-4f1c4e705396 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:06.953081 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-31c2912c-9159-4ff3-b822-4f1c4e705396 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:06.955177 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-31c2912c-9159-4ff3-b822-4f1c4e705396 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:06.956452 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-31c2912c-9159-4ff3-b822-4f1c4e705396 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] 10.222.0.60 "GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044" status: 200 len: 1800 microversion: 2.42 time: 0.323310 Sep 14 08:57:06.957227 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 955/1960] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:57:06 2022] GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044 => generated 1800 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 08:57:07.172909 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-3525b1a4-2a0c-40fa-9021-9bb0ce33d397 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:07.182768 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-3525b1a4-2a0c-40fa-9021-9bb0ce33d397 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/ad55193e-b097-4372-9a00-972ed2b486f8" status: 200 len: 1211 microversion: 2.1 time: 0.304326 Sep 14 08:57:07.184971 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1006/1961] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:57:06 2022] GET /compute/v2.1/servers/ad55193e-b097-4372-9a00-972ed2b486f8 => generated 1211 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:57:07.214833 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9dcd1342-61d4-40b9-91aa-b4f953c4037e tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:07.215617 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-9dcd1342-61d4-40b9-91aa-b4f953c4037e tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] [instance: 8dd1623b-312c-411d-8f6c-b334195e573b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:07.230261 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9dcd1342-61d4-40b9-91aa-b4f953c4037e tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:07.232059 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9dcd1342-61d4-40b9-91aa-b4f953c4037e tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:07.232730 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9dcd1342-61d4-40b9-91aa-b4f953c4037e tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:07.234047 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9dcd1342-61d4-40b9-91aa-b4f953c4037e tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:07.234660 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9dcd1342-61d4-40b9-91aa-b4f953c4037e tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:07.235311 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9dcd1342-61d4-40b9-91aa-b4f953c4037e tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:07.273805 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-affa1150-6f24-4c57-a19f-20507e0f48fd tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:07.274316 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-affa1150-6f24-4c57-a19f-20507e0f48fd tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: 8fce8438-d6ae-408d-8b4f-ee14d4021fdd] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:07.285221 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-affa1150-6f24-4c57-a19f-20507e0f48fd tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:07.287052 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-affa1150-6f24-4c57-a19f-20507e0f48fd tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:07.291888 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-affa1150-6f24-4c57-a19f-20507e0f48fd tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:07.292790 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-affa1150-6f24-4c57-a19f-20507e0f48fd tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:07.293422 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-affa1150-6f24-4c57-a19f-20507e0f48fd tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:07.294110 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-affa1150-6f24-4c57-a19f-20507e0f48fd tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:07.329686 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-affa1150-6f24-4c57-a19f-20507e0f48fd tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: 8fce8438-d6ae-408d-8b4f-ee14d4021fdd] Going to try to terminate instance {{(pid=128758) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 08:57:07.465175 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-affa1150-6f24-4c57-a19f-20507e0f48fd tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "DELETE /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd" status: 204 len: 0 microversion: 2.25 time: 0.195049 Sep 14 08:57:07.470476 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1007/1962] 10.222.0.60 () {60 vars in 1280 bytes} [Wed Sep 14 08:57:07 2022] DELETE /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 14 08:57:07.477363 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-be311ab3-9ccb-49e6-ad0c-01b804236b14 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:07.478284 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-be311ab3-9ccb-49e6-ad0c-01b804236b14 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: 8fce8438-d6ae-408d-8b4f-ee14d4021fdd] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:07.487698 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-be311ab3-9ccb-49e6-ad0c-01b804236b14 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:07.488974 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-be311ab3-9ccb-49e6-ad0c-01b804236b14 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:07.490041 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-be311ab3-9ccb-49e6-ad0c-01b804236b14 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:07.491836 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-be311ab3-9ccb-49e6-ad0c-01b804236b14 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:07.493083 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-be311ab3-9ccb-49e6-ad0c-01b804236b14 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:07.494098 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-be311ab3-9ccb-49e6-ad0c-01b804236b14 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:07.569763 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=10 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:57:07.989576 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-9dcd1342-61d4-40b9-91aa-b4f953c4037e tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab2d64c1cb447f9bfd658408aa07e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ecc8c1389847c7bcd9cd5570d990e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:07.991859 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-be311ab3-9ccb-49e6-ad0c-01b804236b14 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:08.000916 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-be311ab3-9ccb-49e6-ad0c-01b804236b14 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:08.002970 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-9dcd1342-61d4-40b9-91aa-b4f953c4037e tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] 10.222.0.60 "GET /compute/v2.1/servers/8dd1623b-312c-411d-8f6c-b334195e573b" status: 200 len: 1473 microversion: 2.1 time: 0.801449 Sep 14 08:57:08.004429 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 956/1963] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:57:07 2022] GET /compute/v2.1/servers/8dd1623b-312c-411d-8f6c-b334195e573b => generated 1473 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:57:08.013621 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-82074448-aae8-4aa4-b2ef-fdb37fe62730 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:08.015267 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-82074448-aae8-4aa4-b2ef-fdb37fe62730 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 8a7e712b-b175-4ebc-9681-42ff2a91867d] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:08.020967 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-be311ab3-9ccb-49e6-ad0c-01b804236b14 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:08.022215 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-be311ab3-9ccb-49e6-ad0c-01b804236b14 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd" status: 200 len: 1733 microversion: 2.25 time: 0.550035 Sep 14 08:57:08.022802 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1008/1964] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:57:07 2022] GET /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd => generated 1733 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:57:08.023748 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:57:08.025589 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-82074448-aae8-4aa4-b2ef-fdb37fe62730 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:08.026866 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-82074448-aae8-4aa4-b2ef-fdb37fe62730 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:08.027485 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-82074448-aae8-4aa4-b2ef-fdb37fe62730 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:08.028499 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-82074448-aae8-4aa4-b2ef-fdb37fe62730 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:08.029113 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-82074448-aae8-4aa4-b2ef-fdb37fe62730 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:08.030565 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-82074448-aae8-4aa4-b2ef-fdb37fe62730 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:08.049026 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-5043374a-1e19-4a4f-88bf-0184eda09684 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:08.050013 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-5043374a-1e19-4a4f-88bf-0184eda09684 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] [instance: 59f196e8-c202-4073-8663-2ae19358a044] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:08.057487 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5043374a-1e19-4a4f-88bf-0184eda09684 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:08.058211 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5043374a-1e19-4a4f-88bf-0184eda09684 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:08.058888 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5043374a-1e19-4a4f-88bf-0184eda09684 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:08.060503 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5043374a-1e19-4a4f-88bf-0184eda09684 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:08.061852 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5043374a-1e19-4a4f-88bf-0184eda09684 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:08.062492 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5043374a-1e19-4a4f-88bf-0184eda09684 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:08.481769 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-82074448-aae8-4aa4-b2ef-fdb37fe62730 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:08.493326 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-5043374a-1e19-4a4f-88bf-0184eda09684 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:08.501931 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-82074448-aae8-4aa4-b2ef-fdb37fe62730 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/8a7e712b-b175-4ebc-9681-42ff2a91867d" status: 200 len: 1328 microversion: 2.1 time: 0.495230 Sep 14 08:57:08.508873 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-5043374a-1e19-4a4f-88bf-0184eda09684 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:08.510456 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 957/1965] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:57:08 2022] GET /compute/v2.1/servers/8a7e712b-b175-4ebc-9681-42ff2a91867d => generated 1328 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:57:08.515417 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-692979bb-c474-45f3-987c-3286e667f21b tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:08.516099 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-692979bb-c474-45f3-987c-3286e667f21b tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: ad55193e-b097-4372-9a00-972ed2b486f8] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:08.519631 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-5043374a-1e19-4a4f-88bf-0184eda09684 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:08.524353 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-5043374a-1e19-4a4f-88bf-0184eda09684 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] 10.222.0.60 "GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044" status: 200 len: 1847 microversion: 2.42 time: 0.489181 Sep 14 08:57:08.531294 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1009/1966] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:57:08 2022] GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044 => generated 1847 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:57:08.531294 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-35ed1731-00f6-463f-9370-293118a68e82 req-9c28a75a-f284-472d-b759-9ce49fb335bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a7e712b-b175-4ebc-9681-42ff2a91867d", "name": "network-vif-plugged", "status": "completed", "tag": "5c5eee18-9716-472b-b5c5-030fbf084ba6"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:57:08.548648 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-692979bb-c474-45f3-987c-3286e667f21b tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:08.549152 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-692979bb-c474-45f3-987c-3286e667f21b tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:08.549594 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-692979bb-c474-45f3-987c-3286e667f21b tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:08.550312 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-692979bb-c474-45f3-987c-3286e667f21b tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:08.550771 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-692979bb-c474-45f3-987c-3286e667f21b tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:08.551220 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-692979bb-c474-45f3-987c-3286e667f21b tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:08.569292 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-35ed1731-00f6-463f-9370-293118a68e82 req-9c28a75a-f284-472d-b759-9ce49fb335bc service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:08.571993 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-35ed1731-00f6-463f-9370-293118a68e82 req-9c28a75a-f284-472d-b759-9ce49fb335bc service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:08.572588 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-35ed1731-00f6-463f-9370-293118a68e82 req-9c28a75a-f284-472d-b759-9ce49fb335bc service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:08.609902 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-35ed1731-00f6-463f-9370-293118a68e82 req-9c28a75a-f284-472d-b759-9ce49fb335bc service nova] Creating event network-vif-plugged:5c5eee18-9716-472b-b5c5-030fbf084ba6 for instance 8a7e712b-b175-4ebc-9681-42ff2a91867d on n-h1-836830-18 Sep 14 08:57:08.615658 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-35ed1731-00f6-463f-9370-293118a68e82 req-9c28a75a-f284-472d-b759-9ce49fb335bc service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088972 Sep 14 08:57:08.616874 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1010/1967] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:57:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:57:08.819131 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-692979bb-c474-45f3-987c-3286e667f21b tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:08.828668 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-692979bb-c474-45f3-987c-3286e667f21b tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/ad55193e-b097-4372-9a00-972ed2b486f8" status: 200 len: 1199 microversion: 2.1 time: 0.317008 Sep 14 08:57:08.829973 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 958/1968] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:57:08 2022] GET /compute/v2.1/servers/ad55193e-b097-4372-9a00-972ed2b486f8 => generated 1199 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:57:09.051342 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-6e8bf6ba-83d0-486f-98e4-260d4c653734 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:09.052881 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-6e8bf6ba-83d0-486f-98e4-260d4c653734 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] [instance: 8dd1623b-312c-411d-8f6c-b334195e573b] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:09.057791 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-0b524a29-ba41-4749-b9c5-01b0556624fc tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:09.061158 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-0b524a29-ba41-4749-b9c5-01b0556624fc tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: 8fce8438-d6ae-408d-8b4f-ee14d4021fdd] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:09.062623 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6e8bf6ba-83d0-486f-98e4-260d4c653734 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:09.063567 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6e8bf6ba-83d0-486f-98e4-260d4c653734 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:09.064239 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6e8bf6ba-83d0-486f-98e4-260d4c653734 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:09.065207 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6e8bf6ba-83d0-486f-98e4-260d4c653734 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:09.065875 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6e8bf6ba-83d0-486f-98e4-260d4c653734 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:09.066508 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6e8bf6ba-83d0-486f-98e4-260d4c653734 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:09.068437 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0b524a29-ba41-4749-b9c5-01b0556624fc tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:09.068941 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0b524a29-ba41-4749-b9c5-01b0556624fc tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:09.070085 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0b524a29-ba41-4749-b9c5-01b0556624fc tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:09.071121 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0b524a29-ba41-4749-b9c5-01b0556624fc tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:09.072225 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0b524a29-ba41-4749-b9c5-01b0556624fc tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:09.072868 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0b524a29-ba41-4749-b9c5-01b0556624fc tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:09.406283 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-0b524a29-ba41-4749-b9c5-01b0556624fc tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:09.416008 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-0b524a29-ba41-4749-b9c5-01b0556624fc tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:09.417367 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-0b524a29-ba41-4749-b9c5-01b0556624fc tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:09.418848 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-0b524a29-ba41-4749-b9c5-01b0556624fc tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd" status: 200 len: 1733 microversion: 2.25 time: 0.368454 Sep 14 08:57:09.419822 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 959/1969] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:57:09 2022] GET /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd => generated 1733 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:57:09.421956 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-6e8bf6ba-83d0-486f-98e4-260d4c653734 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab2d64c1cb447f9bfd658408aa07e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ecc8c1389847c7bcd9cd5570d990e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:09.430699 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-6e8bf6ba-83d0-486f-98e4-260d4c653734 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] 10.222.0.60 "GET /compute/v2.1/servers/8dd1623b-312c-411d-8f6c-b334195e573b" status: 200 len: 1473 microversion: 2.1 time: 0.385869 Sep 14 08:57:09.440494 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1011/1970] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:57:09 2022] GET /compute/v2.1/servers/8dd1623b-312c-411d-8f6c-b334195e573b => generated 1473 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:57:09.529533 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-0d545582-591b-49ea-84e5-0a14da289617 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:09.530791 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-0d545582-591b-49ea-84e5-0a14da289617 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 8a7e712b-b175-4ebc-9681-42ff2a91867d] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:09.551849 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0d545582-591b-49ea-84e5-0a14da289617 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:09.552674 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0d545582-591b-49ea-84e5-0a14da289617 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:09.563018 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0d545582-591b-49ea-84e5-0a14da289617 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:09.564178 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0d545582-591b-49ea-84e5-0a14da289617 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:09.564852 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0d545582-591b-49ea-84e5-0a14da289617 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:09.568759 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-afa4f72a-8854-4e95-9bf4-512294422456 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:09.569759 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-afa4f72a-8854-4e95-9bf4-512294422456 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] [instance: 59f196e8-c202-4073-8663-2ae19358a044] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:09.574131 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0d545582-591b-49ea-84e5-0a14da289617 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:09.580570 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-afa4f72a-8854-4e95-9bf4-512294422456 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:09.581359 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-afa4f72a-8854-4e95-9bf4-512294422456 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:09.582002 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-afa4f72a-8854-4e95-9bf4-512294422456 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:09.582922 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-afa4f72a-8854-4e95-9bf4-512294422456 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:09.583619 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-afa4f72a-8854-4e95-9bf4-512294422456 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:09.584262 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-afa4f72a-8854-4e95-9bf4-512294422456 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:10.068077 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-afa4f72a-8854-4e95-9bf4-512294422456 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:10.080533 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-afa4f72a-8854-4e95-9bf4-512294422456 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:10.081307 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-0d545582-591b-49ea-84e5-0a14da289617 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:10.082877 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-afa4f72a-8854-4e95-9bf4-512294422456 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:10.084391 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-afa4f72a-8854-4e95-9bf4-512294422456 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] 10.222.0.60 "GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044" status: 200 len: 1847 microversion: 2.42 time: 0.532653 Sep 14 08:57:10.085219 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1012/1971] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:57:09 2022] GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044 => generated 1847 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:57:10.090793 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-37c07669-8bc1-4fc0-9b66-4f5a1856c592 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:10.091589 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-37c07669-8bc1-4fc0-9b66-4f5a1856c592 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: ad55193e-b097-4372-9a00-972ed2b486f8] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:10.110058 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-37c07669-8bc1-4fc0-9b66-4f5a1856c592 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:10.111564 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-37c07669-8bc1-4fc0-9b66-4f5a1856c592 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:10.116901 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-0d545582-591b-49ea-84e5-0a14da289617 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/8a7e712b-b175-4ebc-9681-42ff2a91867d" status: 200 len: 1328 microversion: 2.1 time: 0.589826 Sep 14 08:57:10.118820 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 960/1972] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:57:09 2022] GET /compute/v2.1/servers/8a7e712b-b175-4ebc-9681-42ff2a91867d => generated 1328 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:57:10.131154 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-37c07669-8bc1-4fc0-9b66-4f5a1856c592 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:10.131154 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-37c07669-8bc1-4fc0-9b66-4f5a1856c592 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:10.131154 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-37c07669-8bc1-4fc0-9b66-4f5a1856c592 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:10.131154 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-37c07669-8bc1-4fc0-9b66-4f5a1856c592 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:10.131462 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-5355baee-be89-4081-804d-7d5db0cabee8 req-9fbdefae-4975-4081-b9fc-fe61ed2cb02f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59f196e8-c202-4073-8663-2ae19358a044", "tag": "d8a4da08-c0b3-4a64-8d73-ee5871258250"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:57:10.163108 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-5355baee-be89-4081-804d-7d5db0cabee8 req-9fbdefae-4975-4081-b9fc-fe61ed2cb02f service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:10.163598 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-5355baee-be89-4081-804d-7d5db0cabee8 req-9fbdefae-4975-4081-b9fc-fe61ed2cb02f service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:10.164035 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-5355baee-be89-4081-804d-7d5db0cabee8 req-9fbdefae-4975-4081-b9fc-fe61ed2cb02f service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:10.199641 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-5355baee-be89-4081-804d-7d5db0cabee8 req-9fbdefae-4975-4081-b9fc-fe61ed2cb02f service nova] Creating event network-changed:d8a4da08-c0b3-4a64-8d73-ee5871258250 for instance 59f196e8-c202-4073-8663-2ae19358a044 on n-h2-836830-18 Sep 14 08:57:10.207447 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-5355baee-be89-4081-804d-7d5db0cabee8 req-9fbdefae-4975-4081-b9fc-fe61ed2cb02f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087276 Sep 14 08:57:10.208606 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 961/1973] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:57:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:57:10.445746 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8b53339d-c5c0-4e05-9d39-b7b335f30720 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:10.446550 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-8b53339d-c5c0-4e05-9d39-b7b335f30720 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: 8fce8438-d6ae-408d-8b4f-ee14d4021fdd] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:10.456274 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8b53339d-c5c0-4e05-9d39-b7b335f30720 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:10.457132 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8b53339d-c5c0-4e05-9d39-b7b335f30720 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:10.457781 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8b53339d-c5c0-4e05-9d39-b7b335f30720 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:10.458696 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8b53339d-c5c0-4e05-9d39-b7b335f30720 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:10.459395 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8b53339d-c5c0-4e05-9d39-b7b335f30720 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:10.460068 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8b53339d-c5c0-4e05-9d39-b7b335f30720 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:10.720701 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-37c07669-8bc1-4fc0-9b66-4f5a1856c592 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:10.747383 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-37c07669-8bc1-4fc0-9b66-4f5a1856c592 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/ad55193e-b097-4372-9a00-972ed2b486f8" status: 200 len: 1199 microversion: 2.1 time: 0.658766 Sep 14 08:57:10.749182 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1013/1974] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:57:10 2022] GET /compute/v2.1/servers/ad55193e-b097-4372-9a00-972ed2b486f8 => generated 1199 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:57:10.775330 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c2d73d28-d2b9-4cd4-9286-c3bc3cc89652 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:10.778000 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-c2d73d28-d2b9-4cd4-9286-c3bc3cc89652 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] [instance: 8dd1623b-312c-411d-8f6c-b334195e573b] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:10.788758 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c2d73d28-d2b9-4cd4-9286-c3bc3cc89652 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:10.789506 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c2d73d28-d2b9-4cd4-9286-c3bc3cc89652 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:10.790148 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c2d73d28-d2b9-4cd4-9286-c3bc3cc89652 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:10.791098 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c2d73d28-d2b9-4cd4-9286-c3bc3cc89652 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:10.791715 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c2d73d28-d2b9-4cd4-9286-c3bc3cc89652 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:10.792291 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c2d73d28-d2b9-4cd4-9286-c3bc3cc89652 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:11.189667 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-8b53339d-c5c0-4e05-9d39-b7b335f30720 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:11.192909 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=100 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:57:11.221419 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-8b53339d-c5c0-4e05-9d39-b7b335f30720 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:11.228277 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-8b53339d-c5c0-4e05-9d39-b7b335f30720 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:11.230442 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-8b53339d-c5c0-4e05-9d39-b7b335f30720 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd" status: 200 len: 1733 microversion: 2.25 time: 0.789328 Sep 14 08:57:11.243611 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 962/1975] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:57:10 2022] GET /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd => generated 1733 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:57:11.261013 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d4e5a517-39de-4ff6-8985-5c84c9737027 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:11.261808 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-d4e5a517-39de-4ff6-8985-5c84c9737027 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] [instance: 59f196e8-c202-4073-8663-2ae19358a044] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:11.269272 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d4e5a517-39de-4ff6-8985-5c84c9737027 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:11.270066 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d4e5a517-39de-4ff6-8985-5c84c9737027 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:11.270661 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d4e5a517-39de-4ff6-8985-5c84c9737027 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:11.271723 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d4e5a517-39de-4ff6-8985-5c84c9737027 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:11.272334 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d4e5a517-39de-4ff6-8985-5c84c9737027 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:11.272915 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d4e5a517-39de-4ff6-8985-5c84c9737027 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:11.505401 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-c2d73d28-d2b9-4cd4-9286-c3bc3cc89652 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab2d64c1cb447f9bfd658408aa07e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ecc8c1389847c7bcd9cd5570d990e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:11.515522 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-c2d73d28-d2b9-4cd4-9286-c3bc3cc89652 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] 10.222.0.60 "GET /compute/v2.1/servers/8dd1623b-312c-411d-8f6c-b334195e573b" status: 200 len: 1473 microversion: 2.1 time: 0.763362 Sep 14 08:57:11.531235 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1014/1976] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:57:10 2022] GET /compute/v2.1/servers/8dd1623b-312c-411d-8f6c-b334195e573b => generated 1473 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:57:11.536393 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-9a78a751-e28a-4187-8c74-32718529f327 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:11.537014 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-9a78a751-e28a-4187-8c74-32718529f327 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 8a7e712b-b175-4ebc-9681-42ff2a91867d] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:11.543377 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9a78a751-e28a-4187-8c74-32718529f327 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:11.543864 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9a78a751-e28a-4187-8c74-32718529f327 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:11.544293 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9a78a751-e28a-4187-8c74-32718529f327 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:11.544988 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9a78a751-e28a-4187-8c74-32718529f327 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:11.546127 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9a78a751-e28a-4187-8c74-32718529f327 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:11.546550 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9a78a751-e28a-4187-8c74-32718529f327 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:11.836973 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-d4e5a517-39de-4ff6-8985-5c84c9737027 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:11.848222 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-d4e5a517-39de-4ff6-8985-5c84c9737027 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:11.849845 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-d4e5a517-39de-4ff6-8985-5c84c9737027 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:11.851168 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d4e5a517-39de-4ff6-8985-5c84c9737027 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] 10.222.0.60 "GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044" status: 200 len: 1868 microversion: 2.42 time: 0.606126 Sep 14 08:57:11.851849 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 963/1977] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:57:11 2022] GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044 => generated 1868 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:57:11.857292 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-23798799-685c-41bd-959d-41ab1eabb093 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:11.858845 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-23798799-685c-41bd-959d-41ab1eabb093 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: ad55193e-b097-4372-9a00-972ed2b486f8] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:11.866333 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-23798799-685c-41bd-959d-41ab1eabb093 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:11.867230 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-23798799-685c-41bd-959d-41ab1eabb093 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:11.867877 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-23798799-685c-41bd-959d-41ab1eabb093 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:11.868811 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-23798799-685c-41bd-959d-41ab1eabb093 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:11.869470 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-23798799-685c-41bd-959d-41ab1eabb093 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:11.870096 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-23798799-685c-41bd-959d-41ab1eabb093 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:11.955490 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-9a78a751-e28a-4187-8c74-32718529f327 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:11.963976 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-9a78a751-e28a-4187-8c74-32718529f327 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/8a7e712b-b175-4ebc-9681-42ff2a91867d" status: 200 len: 1509 microversion: 2.1 time: 0.431331 Sep 14 08:57:11.964575 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1015/1978] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:57:11 2022] GET /compute/v2.1/servers/8a7e712b-b175-4ebc-9681-42ff2a91867d => generated 1509 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:57:11.989410 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-959ad1a2-0101-4363-8ee6-06fa55754a28 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:11.990295 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-959ad1a2-0101-4363-8ee6-06fa55754a28 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 8a7e712b-b175-4ebc-9681-42ff2a91867d] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:11.997661 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-959ad1a2-0101-4363-8ee6-06fa55754a28 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:11.997952 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-959ad1a2-0101-4363-8ee6-06fa55754a28 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:11.999428 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-959ad1a2-0101-4363-8ee6-06fa55754a28 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:12.000644 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-959ad1a2-0101-4363-8ee6-06fa55754a28 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:12.001317 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-959ad1a2-0101-4363-8ee6-06fa55754a28 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:12.001923 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-959ad1a2-0101-4363-8ee6-06fa55754a28 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:12.293977 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-23798799-685c-41bd-959d-41ab1eabb093 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:12.303211 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-23798799-685c-41bd-959d-41ab1eabb093 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/ad55193e-b097-4372-9a00-972ed2b486f8" status: 200 len: 1199 microversion: 2.1 time: 0.449940 Sep 14 08:57:12.315725 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 964/1979] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:57:11 2022] GET /compute/v2.1/servers/ad55193e-b097-4372-9a00-972ed2b486f8 => generated 1199 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:57:12.325580 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-1f3d9328-9023-4c05-9051-a6f74f29b33f tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:12.326932 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-1f3d9328-9023-4c05-9051-a6f74f29b33f tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: 8fce8438-d6ae-408d-8b4f-ee14d4021fdd] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:12.333612 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1f3d9328-9023-4c05-9051-a6f74f29b33f tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:12.334417 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1f3d9328-9023-4c05-9051-a6f74f29b33f tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:12.335147 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1f3d9328-9023-4c05-9051-a6f74f29b33f tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:12.336812 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1f3d9328-9023-4c05-9051-a6f74f29b33f tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:12.337516 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1f3d9328-9023-4c05-9051-a6f74f29b33f tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:12.338297 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1f3d9328-9023-4c05-9051-a6f74f29b33f tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:12.360469 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-959ad1a2-0101-4363-8ee6-06fa55754a28 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:12.401950 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-959ad1a2-0101-4363-8ee6-06fa55754a28 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/8a7e712b-b175-4ebc-9681-42ff2a91867d" status: 200 len: 1509 microversion: 2.1 time: 0.412990 Sep 14 08:57:12.421134 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1016/1980] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:57:11 2022] GET /compute/v2.1/servers/8a7e712b-b175-4ebc-9681-42ff2a91867d => generated 1509 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:57:12.439521 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-7b777193-6505-4f3e-a390-72cd3ca2e0a4 req-cf4983ee-7bb7-41ac-a7b5-fbd5dae39338 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59f196e8-c202-4073-8663-2ae19358a044", "tag": "7212ef16-f39e-431e-be33-ee68692137a8"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:57:12.476850 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-7b777193-6505-4f3e-a390-72cd3ca2e0a4 req-cf4983ee-7bb7-41ac-a7b5-fbd5dae39338 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:12.477420 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-7b777193-6505-4f3e-a390-72cd3ca2e0a4 req-cf4983ee-7bb7-41ac-a7b5-fbd5dae39338 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:12.477871 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-7b777193-6505-4f3e-a390-72cd3ca2e0a4 req-cf4983ee-7bb7-41ac-a7b5-fbd5dae39338 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:12.498802 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-7b777193-6505-4f3e-a390-72cd3ca2e0a4 req-cf4983ee-7bb7-41ac-a7b5-fbd5dae39338 service nova] Creating event network-changed:7212ef16-f39e-431e-be33-ee68692137a8 for instance 59f196e8-c202-4073-8663-2ae19358a044 on n-h2-836830-18 Sep 14 08:57:12.504031 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-7b777193-6505-4f3e-a390-72cd3ca2e0a4 req-cf4983ee-7bb7-41ac-a7b5-fbd5dae39338 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081209 Sep 14 08:57:12.504640 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1017/1981] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:57:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:57:12.509796 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-f0ee61e1-b797-4015-ae30-297acfc072fb tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:12.511297 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-f0ee61e1-b797-4015-ae30-297acfc072fb tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 8a7e712b-b175-4ebc-9681-42ff2a91867d] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:12.521349 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f0ee61e1-b797-4015-ae30-297acfc072fb tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:12.522276 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f0ee61e1-b797-4015-ae30-297acfc072fb tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:12.522868 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f0ee61e1-b797-4015-ae30-297acfc072fb tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:12.523755 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f0ee61e1-b797-4015-ae30-297acfc072fb tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:12.524381 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f0ee61e1-b797-4015-ae30-297acfc072fb tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:12.524816 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f0ee61e1-b797-4015-ae30-297acfc072fb tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:12.548587 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-1f3d9328-9023-4c05-9051-a6f74f29b33f tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:12.553957 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-f0ee61e1-b797-4015-ae30-297acfc072fb tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 8a7e712b-b175-4ebc-9681-42ff2a91867d] Going to try to terminate instance {{(pid=128758) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 08:57:12.583894 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-1f3d9328-9023-4c05-9051-a6f74f29b33f tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:12.588496 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-1f3d9328-9023-4c05-9051-a6f74f29b33f tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:12.593116 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-1f3d9328-9023-4c05-9051-a6f74f29b33f tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd" status: 200 len: 1665 microversion: 2.25 time: 0.276053 Sep 14 08:57:12.596948 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 965/1982] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:57:12 2022] GET /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd => generated 1665 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:57:12.619589 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-1c821096-3b29-4ac8-b86d-117bccad47b9 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:12.620674 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-1c821096-3b29-4ac8-b86d-117bccad47b9 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] [instance: 8dd1623b-312c-411d-8f6c-b334195e573b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:12.629885 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1c821096-3b29-4ac8-b86d-117bccad47b9 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:12.630755 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1c821096-3b29-4ac8-b86d-117bccad47b9 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:12.631436 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1c821096-3b29-4ac8-b86d-117bccad47b9 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:12.632384 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1c821096-3b29-4ac8-b86d-117bccad47b9 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:12.633089 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1c821096-3b29-4ac8-b86d-117bccad47b9 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:12.633738 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1c821096-3b29-4ac8-b86d-117bccad47b9 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:12.697324 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-f0ee61e1-b797-4015-ae30-297acfc072fb tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "DELETE /compute/v2.1/servers/8a7e712b-b175-4ebc-9681-42ff2a91867d" status: 204 len: 0 microversion: 2.1 time: 0.190737 Sep 14 08:57:12.699804 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1018/1983] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 08:57:12 2022] DELETE /compute/v2.1/servers/8a7e712b-b175-4ebc-9681-42ff2a91867d => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 08:57:12.714674 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-49be2258-2286-4aa7-b744-599561a6205b tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:12.715451 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-49be2258-2286-4aa7-b744-599561a6205b tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 8a7e712b-b175-4ebc-9681-42ff2a91867d] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:12.731993 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-49be2258-2286-4aa7-b744-599561a6205b tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:12.734677 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-49be2258-2286-4aa7-b744-599561a6205b tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:12.735216 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-49be2258-2286-4aa7-b744-599561a6205b tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:12.735975 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-49be2258-2286-4aa7-b744-599561a6205b tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:12.738595 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-49be2258-2286-4aa7-b744-599561a6205b tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:12.742697 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-49be2258-2286-4aa7-b744-599561a6205b tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:12.752758 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:57:12.922249 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-1c821096-3b29-4ac8-b86d-117bccad47b9 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab2d64c1cb447f9bfd658408aa07e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ecc8c1389847c7bcd9cd5570d990e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:12.931257 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-1c821096-3b29-4ac8-b86d-117bccad47b9 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] 10.222.0.60 "GET /compute/v2.1/servers/8dd1623b-312c-411d-8f6c-b334195e573b" status: 200 len: 1473 microversion: 2.1 time: 0.332559 Sep 14 08:57:12.936015 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 966/1984] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:57:12 2022] GET /compute/v2.1/servers/8dd1623b-312c-411d-8f6c-b334195e573b => generated 1473 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:57:12.943750 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b835b068-9728-46af-9628-869faf10e304 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:12.950661 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b835b068-9728-46af-9628-869faf10e304 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] [instance: 59f196e8-c202-4073-8663-2ae19358a044] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:12.972016 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b835b068-9728-46af-9628-869faf10e304 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:12.972960 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b835b068-9728-46af-9628-869faf10e304 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:12.973629 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b835b068-9728-46af-9628-869faf10e304 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:12.978449 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b835b068-9728-46af-9628-869faf10e304 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:12.979287 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b835b068-9728-46af-9628-869faf10e304 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:12.981007 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b835b068-9728-46af-9628-869faf10e304 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:13.270214 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-49be2258-2286-4aa7-b744-599561a6205b tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:13.284035 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-49be2258-2286-4aa7-b744-599561a6205b tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/8a7e712b-b175-4ebc-9681-42ff2a91867d" status: 200 len: 1515 microversion: 2.1 time: 0.577528 Sep 14 08:57:13.284646 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1019/1985] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:57:12 2022] GET /compute/v2.1/servers/8a7e712b-b175-4ebc-9681-42ff2a91867d => generated 1515 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:57:13.331216 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-74da4e9d-ab9d-4183-8563-45a5e331a31e tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:13.331836 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-74da4e9d-ab9d-4183-8563-45a5e331a31e tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: ad55193e-b097-4372-9a00-972ed2b486f8] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:13.345263 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-74da4e9d-ab9d-4183-8563-45a5e331a31e tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:13.345760 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-74da4e9d-ab9d-4183-8563-45a5e331a31e tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:13.346196 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-74da4e9d-ab9d-4183-8563-45a5e331a31e tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:13.346909 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-74da4e9d-ab9d-4183-8563-45a5e331a31e tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:13.347414 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-74da4e9d-ab9d-4183-8563-45a5e331a31e tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:13.347840 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-74da4e9d-ab9d-4183-8563-45a5e331a31e tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:13.433867 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b835b068-9728-46af-9628-869faf10e304 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:13.449145 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b835b068-9728-46af-9628-869faf10e304 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:13.450592 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b835b068-9728-46af-9628-869faf10e304 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:13.452370 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b835b068-9728-46af-9628-869faf10e304 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] 10.222.0.60 "GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044" status: 200 len: 1868 microversion: 2.42 time: 0.514585 Sep 14 08:57:13.466463 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 967/1986] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:57:12 2022] GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044 => generated 1868 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:57:13.607127 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-74da4e9d-ab9d-4183-8563-45a5e331a31e tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:13.615050 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-74da4e9d-ab9d-4183-8563-45a5e331a31e tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/ad55193e-b097-4372-9a00-972ed2b486f8" status: 200 len: 1199 microversion: 2.1 time: 0.288196 Sep 14 08:57:13.619284 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1020/1987] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:57:13 2022] GET /compute/v2.1/servers/ad55193e-b097-4372-9a00-972ed2b486f8 => generated 1199 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:57:13.656641 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-78fa540f-c1d9-4d0d-a4d8-08ed8ba2dd3c tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:13.657426 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-78fa540f-c1d9-4d0d-a4d8-08ed8ba2dd3c tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: 8fce8438-d6ae-408d-8b4f-ee14d4021fdd] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:13.677072 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-78fa540f-c1d9-4d0d-a4d8-08ed8ba2dd3c tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:13.680598 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-78fa540f-c1d9-4d0d-a4d8-08ed8ba2dd3c tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:13.681715 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-78fa540f-c1d9-4d0d-a4d8-08ed8ba2dd3c tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:13.683485 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-78fa540f-c1d9-4d0d-a4d8-08ed8ba2dd3c tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:13.685265 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-78fa540f-c1d9-4d0d-a4d8-08ed8ba2dd3c tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:13.686705 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-78fa540f-c1d9-4d0d-a4d8-08ed8ba2dd3c tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:13.787833 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-78fa540f-c1d9-4d0d-a4d8-08ed8ba2dd3c tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:13.788858 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-78fa540f-c1d9-4d0d-a4d8-08ed8ba2dd3c tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:13.789555 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-78fa540f-c1d9-4d0d-a4d8-08ed8ba2dd3c tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:13.790228 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.objects.instance [None req-78fa540f-c1d9-4d0d-a4d8-08ed8ba2dd3c tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lazy-loading 'fault' on Instance uuid 8fce8438-d6ae-408d-8b4f-ee14d4021fdd {{(pid=128759) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 08:57:13.886375 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-78fa540f-c1d9-4d0d-a4d8-08ed8ba2dd3c tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:13.906008 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-78fa540f-c1d9-4d0d-a4d8-08ed8ba2dd3c tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:13.910872 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-78fa540f-c1d9-4d0d-a4d8-08ed8ba2dd3c tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:13.914709 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-78fa540f-c1d9-4d0d-a4d8-08ed8ba2dd3c tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd" status: 200 len: 1376 microversion: 2.25 time: 0.280382 Sep 14 08:57:13.915894 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 968/1988] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:57:13 2022] GET /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd => generated 1376 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:57:13.959271 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-47bd032b-53ac-4982-a4e0-1e2a730cf951 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:13.959886 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-47bd032b-53ac-4982-a4e0-1e2a730cf951 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] [instance: 8dd1623b-312c-411d-8f6c-b334195e573b] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:13.961915 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:57:13.970870 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-47bd032b-53ac-4982-a4e0-1e2a730cf951 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:13.971313 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-47bd032b-53ac-4982-a4e0-1e2a730cf951 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:13.983681 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-47bd032b-53ac-4982-a4e0-1e2a730cf951 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:13.984479 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-47bd032b-53ac-4982-a4e0-1e2a730cf951 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:13.984965 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-47bd032b-53ac-4982-a4e0-1e2a730cf951 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:13.985397 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-47bd032b-53ac-4982-a4e0-1e2a730cf951 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:14.243657 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-47bd032b-53ac-4982-a4e0-1e2a730cf951 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab2d64c1cb447f9bfd658408aa07e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ecc8c1389847c7bcd9cd5570d990e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:14.262049 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-47bd032b-53ac-4982-a4e0-1e2a730cf951 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] 10.222.0.60 "GET /compute/v2.1/servers/8dd1623b-312c-411d-8f6c-b334195e573b" status: 200 len: 1473 microversion: 2.1 time: 0.300697 Sep 14 08:57:14.271360 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1021/1989] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:57:13 2022] GET /compute/v2.1/servers/8dd1623b-312c-411d-8f6c-b334195e573b => generated 1473 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:57:14.313957 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-cdce6d4b-26b6-428a-bd80-6657a998a5d8 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:14.314597 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-cdce6d4b-26b6-428a-bd80-6657a998a5d8 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 8a7e712b-b175-4ebc-9681-42ff2a91867d] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:14.325613 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cdce6d4b-26b6-428a-bd80-6657a998a5d8 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:14.327179 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cdce6d4b-26b6-428a-bd80-6657a998a5d8 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:14.331596 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cdce6d4b-26b6-428a-bd80-6657a998a5d8 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:14.348711 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cdce6d4b-26b6-428a-bd80-6657a998a5d8 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:14.351294 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cdce6d4b-26b6-428a-bd80-6657a998a5d8 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:14.353144 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cdce6d4b-26b6-428a-bd80-6657a998a5d8 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:14.480015 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-81ded5f1-37a8-48a4-ad53-63f49a1c71db tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:14.480704 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-81ded5f1-37a8-48a4-ad53-63f49a1c71db tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] [instance: 59f196e8-c202-4073-8663-2ae19358a044] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:14.508023 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-81ded5f1-37a8-48a4-ad53-63f49a1c71db tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:14.508535 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-81ded5f1-37a8-48a4-ad53-63f49a1c71db tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:14.514687 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-81ded5f1-37a8-48a4-ad53-63f49a1c71db tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:14.519117 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-81ded5f1-37a8-48a4-ad53-63f49a1c71db tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:14.521133 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-81ded5f1-37a8-48a4-ad53-63f49a1c71db tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:14.522568 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-81ded5f1-37a8-48a4-ad53-63f49a1c71db tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:15.126589 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-cdce6d4b-26b6-428a-bd80-6657a998a5d8 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:15.135222 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-cdce6d4b-26b6-428a-bd80-6657a998a5d8 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/8a7e712b-b175-4ebc-9681-42ff2a91867d" status: 200 len: 1515 microversion: 2.1 time: 0.826523 Sep 14 08:57:15.135813 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 969/1990] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:57:14 2022] GET /compute/v2.1/servers/8a7e712b-b175-4ebc-9681-42ff2a91867d => generated 1515 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:57:15.145660 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-1a2d4410-16fd-4cd9-b12c-5162a8354212 req-bd74be28-02a9-473c-b9a3-4b39f9524e5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fce8438-d6ae-408d-8b4f-ee14d4021fdd", "name": "network-vif-deleted", "tag": "8a7f2660-c507-4973-b860-0358d6cdd4f1"}, {"name": "network-changed", "server_uuid": "59f196e8-c202-4073-8663-2ae19358a044", "tag": "8af9859a-c5d7-4d91-96a4-e415d547a0e7"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:57:15.159931 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-1a2d4410-16fd-4cd9-b12c-5162a8354212 req-bd74be28-02a9-473c-b9a3-4b39f9524e5c service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:15.160408 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-1a2d4410-16fd-4cd9-b12c-5162a8354212 req-bd74be28-02a9-473c-b9a3-4b39f9524e5c service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:15.160837 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-1a2d4410-16fd-4cd9-b12c-5162a8354212 req-bd74be28-02a9-473c-b9a3-4b39f9524e5c service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:15.195467 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-1a2d4410-16fd-4cd9-b12c-5162a8354212 req-bd74be28-02a9-473c-b9a3-4b39f9524e5c service nova] Creating event network-vif-deleted:8a7f2660-c507-4973-b860-0358d6cdd4f1 for instance 8fce8438-d6ae-408d-8b4f-ee14d4021fdd on n-h1-836830-18 Sep 14 08:57:15.197142 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-1a2d4410-16fd-4cd9-b12c-5162a8354212 req-bd74be28-02a9-473c-b9a3-4b39f9524e5c service nova] Creating event network-changed:8af9859a-c5d7-4d91-96a4-e415d547a0e7 for instance 59f196e8-c202-4073-8663-2ae19358a044 on n-h2-836830-18 Sep 14 08:57:15.215856 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-1a2d4410-16fd-4cd9-b12c-5162a8354212 req-bd74be28-02a9-473c-b9a3-4b39f9524e5c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.076243 Sep 14 08:57:15.217341 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 970/1991] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:57:15 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:57:15.222775 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-474e2a4f-cda5-4729-832d-8862b6d91401 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:15.224027 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-474e2a4f-cda5-4729-832d-8862b6d91401 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: ad55193e-b097-4372-9a00-972ed2b486f8] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:15.230871 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-474e2a4f-cda5-4729-832d-8862b6d91401 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:15.231726 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-474e2a4f-cda5-4729-832d-8862b6d91401 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:15.232324 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-474e2a4f-cda5-4729-832d-8862b6d91401 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:15.234079 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-474e2a4f-cda5-4729-832d-8862b6d91401 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:15.234789 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-474e2a4f-cda5-4729-832d-8862b6d91401 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:15.235391 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-474e2a4f-cda5-4729-832d-8862b6d91401 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:15.306804 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-81ded5f1-37a8-48a4-ad53-63f49a1c71db tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:15.328070 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-81ded5f1-37a8-48a4-ad53-63f49a1c71db tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:15.331312 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-81ded5f1-37a8-48a4-ad53-63f49a1c71db tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:15.337656 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-81ded5f1-37a8-48a4-ad53-63f49a1c71db tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] 10.222.0.60 "GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044" status: 200 len: 1889 microversion: 2.42 time: 0.859535 Sep 14 08:57:15.338812 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1022/1992] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:57:14 2022] GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044 => generated 1889 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 08:57:15.346621 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ac2480c2-545a-4b07-afb7-ac3677606f66 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:15.359563 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-ac2480c2-545a-4b07-afb7-ac3677606f66 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: 8fce8438-d6ae-408d-8b4f-ee14d4021fdd] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:15.365873 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ac2480c2-545a-4b07-afb7-ac3677606f66 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:15.366406 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ac2480c2-545a-4b07-afb7-ac3677606f66 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:15.366846 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ac2480c2-545a-4b07-afb7-ac3677606f66 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:15.367594 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ac2480c2-545a-4b07-afb7-ac3677606f66 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:15.368047 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ac2480c2-545a-4b07-afb7-ac3677606f66 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:15.368474 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ac2480c2-545a-4b07-afb7-ac3677606f66 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:15.441903 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ac2480c2-545a-4b07-afb7-ac3677606f66 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:15.442654 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ac2480c2-545a-4b07-afb7-ac3677606f66 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:15.443292 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ac2480c2-545a-4b07-afb7-ac3677606f66 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:15.443942 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.objects.instance [None req-ac2480c2-545a-4b07-afb7-ac3677606f66 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lazy-loading 'fault' on Instance uuid 8fce8438-d6ae-408d-8b4f-ee14d4021fdd {{(pid=128758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 08:57:15.552982 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-474e2a4f-cda5-4729-832d-8862b6d91401 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:15.569176 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-474e2a4f-cda5-4729-832d-8862b6d91401 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/ad55193e-b097-4372-9a00-972ed2b486f8" status: 200 len: 1199 microversion: 2.1 time: 0.350360 Sep 14 08:57:15.589053 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 971/1993] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:57:15 2022] GET /compute/v2.1/servers/ad55193e-b097-4372-9a00-972ed2b486f8 => generated 1199 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:57:15.599146 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-ac2480c2-545a-4b07-afb7-ac3677606f66 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:15.612811 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-124f96ef-7b11-460f-a378-64821573bc3e tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:15.614586 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-ac2480c2-545a-4b07-afb7-ac3677606f66 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:15.615468 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-124f96ef-7b11-460f-a378-64821573bc3e tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] [instance: 8dd1623b-312c-411d-8f6c-b334195e573b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:15.617257 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-ac2480c2-545a-4b07-afb7-ac3677606f66 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:15.622205 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-ac2480c2-545a-4b07-afb7-ac3677606f66 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd" status: 200 len: 1376 microversion: 2.25 time: 0.280718 Sep 14 08:57:15.624547 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1023/1994] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:57:15 2022] GET /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd => generated 1376 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:57:15.646672 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-124f96ef-7b11-460f-a378-64821573bc3e tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:15.647437 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-124f96ef-7b11-460f-a378-64821573bc3e tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:15.648354 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-124f96ef-7b11-460f-a378-64821573bc3e tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:15.649592 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-124f96ef-7b11-460f-a378-64821573bc3e tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:15.650867 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-124f96ef-7b11-460f-a378-64821573bc3e tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:15.651540 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-124f96ef-7b11-460f-a378-64821573bc3e tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:16.106691 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-124f96ef-7b11-460f-a378-64821573bc3e tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab2d64c1cb447f9bfd658408aa07e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ecc8c1389847c7bcd9cd5570d990e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:16.123946 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-124f96ef-7b11-460f-a378-64821573bc3e tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] 10.222.0.60 "GET /compute/v2.1/servers/8dd1623b-312c-411d-8f6c-b334195e573b" status: 200 len: 1473 microversion: 2.1 time: 0.533623 Sep 14 08:57:16.140817 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 972/1995] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:57:15 2022] GET /compute/v2.1/servers/8dd1623b-312c-411d-8f6c-b334195e573b => generated 1473 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:57:16.161920 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-7aeb8724-831a-4e11-bf95-feb8233eefe4 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:16.162825 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-7aeb8724-831a-4e11-bf95-feb8233eefe4 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 8a7e712b-b175-4ebc-9681-42ff2a91867d] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:16.177670 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7aeb8724-831a-4e11-bf95-feb8233eefe4 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:16.178429 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7aeb8724-831a-4e11-bf95-feb8233eefe4 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:16.179076 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7aeb8724-831a-4e11-bf95-feb8233eefe4 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:16.179963 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7aeb8724-831a-4e11-bf95-feb8233eefe4 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:16.180570 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7aeb8724-831a-4e11-bf95-feb8233eefe4 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:16.181411 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7aeb8724-831a-4e11-bf95-feb8233eefe4 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:16.394842 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e60c336b-c8ba-420b-9498-84cbed525e3b tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:16.395943 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e60c336b-c8ba-420b-9498-84cbed525e3b tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] [instance: 59f196e8-c202-4073-8663-2ae19358a044] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:16.414312 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e60c336b-c8ba-420b-9498-84cbed525e3b tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:16.415105 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e60c336b-c8ba-420b-9498-84cbed525e3b tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:16.415804 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e60c336b-c8ba-420b-9498-84cbed525e3b tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:16.416843 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e60c336b-c8ba-420b-9498-84cbed525e3b tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:16.417453 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e60c336b-c8ba-420b-9498-84cbed525e3b tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:16.418262 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e60c336b-c8ba-420b-9498-84cbed525e3b tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:16.683054 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-7aeb8724-831a-4e11-bf95-feb8233eefe4 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:16.700980 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-7aeb8724-831a-4e11-bf95-feb8233eefe4 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/8a7e712b-b175-4ebc-9681-42ff2a91867d" status: 200 len: 1473 microversion: 2.1 time: 0.542668 Sep 14 08:57:16.701634 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1024/1996] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:57:16 2022] GET /compute/v2.1/servers/8a7e712b-b175-4ebc-9681-42ff2a91867d => generated 1473 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:57:16.711949 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-beab5d11-4fed-4b09-aebf-484e21e43f09 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:16.724195 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-beab5d11-4fed-4b09-aebf-484e21e43f09 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: ad55193e-b097-4372-9a00-972ed2b486f8] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:16.732225 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-beab5d11-4fed-4b09-aebf-484e21e43f09 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:16.733493 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-beab5d11-4fed-4b09-aebf-484e21e43f09 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:16.734089 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-beab5d11-4fed-4b09-aebf-484e21e43f09 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:16.734971 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-beab5d11-4fed-4b09-aebf-484e21e43f09 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:16.735575 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-beab5d11-4fed-4b09-aebf-484e21e43f09 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:16.736146 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-beab5d11-4fed-4b09-aebf-484e21e43f09 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:16.896189 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-e60c336b-c8ba-420b-9498-84cbed525e3b tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:16.914951 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-e60c336b-c8ba-420b-9498-84cbed525e3b tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:16.925857 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-e60c336b-c8ba-420b-9498-84cbed525e3b tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:16.929462 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e60c336b-c8ba-420b-9498-84cbed525e3b tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] 10.222.0.60 "GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044" status: 200 len: 1889 microversion: 2.42 time: 0.566126 Sep 14 08:57:16.930085 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 973/1997] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:57:16 2022] GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044 => generated 1889 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 08:57:16.945194 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-680f3693-a0b2-4fd7-9846-15799f00293a tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:16.946497 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-680f3693-a0b2-4fd7-9846-15799f00293a tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: 8fce8438-d6ae-408d-8b4f-ee14d4021fdd] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:16.963351 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-680f3693-a0b2-4fd7-9846-15799f00293a tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:16.963881 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-680f3693-a0b2-4fd7-9846-15799f00293a tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:16.964341 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-680f3693-a0b2-4fd7-9846-15799f00293a tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:16.965083 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-680f3693-a0b2-4fd7-9846-15799f00293a tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:16.965548 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-680f3693-a0b2-4fd7-9846-15799f00293a tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:16.970360 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-680f3693-a0b2-4fd7-9846-15799f00293a tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:17.014120 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-680f3693-a0b2-4fd7-9846-15799f00293a tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] HTTP exception thrown: Instance 8fce8438-d6ae-408d-8b4f-ee14d4021fdd could not be found. Sep 14 08:57:17.022446 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-680f3693-a0b2-4fd7-9846-15799f00293a tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Request method failure captured: Sep 14 08:57:17.022446 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd HTTP/1.1 Sep 14 08:57:17.022446 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 08:57:17.022446 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 08:57:17.022446 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 08:57:17.022446 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 08:57:17.022446 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 08:57:17.022446 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 08:57:17.022446 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 08:57:17.022446 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 08:57:17.022446 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZWl4sBr1-d0zWhOP1VypmcD37g65YKSC98adzDQksMynj67ZC5PVg2lSGT7NPp4LurGErQYTxYBVsDHD4XQgru2ajc5ixBy1mw1M3HnxJNE70omFE3tV833Q-dw3mlJAdgpOXexlM7Fuhn3BkTG0VioZq-vGusZTnLGxd-pf99Y8Xw Sep 14 08:57:17.022446 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 08:57:17.022446 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 08:57:17.022446 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 08:57:17.022446 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 08:57:17.022446 n-d-836830-18 devstack@n-api.service[128759]: X-Openstack-Nova-Api-Version: 2.25 Sep 14 08:57:17.022446 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 08:57:17.022446 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 08:57:17.022446 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 3850954316f34104b2a8052dc78a50d7 Sep 14 08:57:17.022446 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1232302418 Sep 14 08:57:17.022446 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 08:57:17.022446 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 08:57:17.022446 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/3850954316f34104b2a8052dc78a50d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_3850954316f34104b2a8052dc78a50d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3850954316f34104b2a8052dc78a50d7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3850954316f34104b2a8052dc78a50d7"}]}] Sep 14 08:57:17.022446 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1232302418 Sep 14 08:57:17.022446 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 3850954316f34104b2a8052dc78a50d7 Sep 14 08:57:17.022446 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1232302418 Sep 14 08:57:17.022446 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-LiveAutoBlockMigrationV225Test-1232302418-project Sep 14 08:57:17.022446 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 08:57:17.022446 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 08:57:17.022446 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: f140347422af48a4875e80337a272e29 Sep 14 08:57:17.022446 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1232302418-project Sep 14 08:57:17.022446 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 08:57:17.022446 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance 8fce8438-d6ae-408d-8b4f-ee14d4021fdd could not be found. Sep 14 08:57:17.022446 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '8fce8438-d6ae-408d-8b4f-ee14d4021fdd'} Sep 14 08:57:17.022446 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:57:17.022446 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:57:17.022446 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 08:57:17.022446 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 08:57:17.022446 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 08:57:17.022446 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 08:57:17.022446 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 08:57:17.022446 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 08:57:17.022446 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 08:57:17.022446 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 08:57:17.022446 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8fce8438-d6ae-408d-8b4f-ee14d4021fdd could not be found. Sep 14 08:57:17.022446 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:57:17.022446 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:57:17.022446 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:57:17.022446 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:57:17.022446 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:57:17.022446 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:57:17.022446 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:57:17.022446 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:57:17.022446 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:57:17.022446 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:57:17.022446 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 08:57:17.022446 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 08:57:17.022446 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 08:57:17.022446 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 08:57:17.022446 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 08:57:17.022446 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 08:57:17.022446 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8fce8438-d6ae-408d-8b4f-ee14d4021fdd could not be found. Sep 14 08:57:17.022446 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:57:17.026689 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:57:17.026689 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:57:17.026689 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:57:17.026689 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:57:17.026689 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:57:17.026689 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:57:17.026689 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:57:17.026689 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8fce8438-d6ae-408d-8b4f-ee14d4021fdd could not be found. Sep 14 08:57:17.026689 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:57:17.026689 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-680f3693-a0b2-4fd7-9846-15799f00293a tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Returning 404 to user: Instance 8fce8438-d6ae-408d-8b4f-ee14d4021fdd could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:57:17.026689 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-680f3693-a0b2-4fd7-9846-15799f00293a tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd" status: 404 len: 111 microversion: 2.25 time: 0.092870 Sep 14 08:57:17.026689 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 974/1998] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:57:16 2022] GET /compute/v2.1/servers/8fce8438-d6ae-408d-8b4f-ee14d4021fdd => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 14 08:57:17.039922 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-5c9e51bf-cdf0-4d4c-a992-48e297469d7a tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '.version_select at 0x7f7d3fca7d30>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:17.085806 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-5c9e51bf-cdf0-4d4c-a992-48e297469d7a tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1521095948" status: 204 len: 0 microversion: 2.25 time: 0.049904 Sep 14 08:57:17.086662 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 975/1999] 10.222.0.60 () {60 vars in 1262 bytes} [Wed Sep 14 08:57:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1521095948 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 14 08:57:17.148863 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-28be8bb7-cfed-48a0-a6a3-edf80dd67606 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:17.150211 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-28be8bb7-cfed-48a0-a6a3-edf80dd67606 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] [instance: 8dd1623b-312c-411d-8f6c-b334195e573b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:17.165224 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-28be8bb7-cfed-48a0-a6a3-edf80dd67606 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:17.165979 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-28be8bb7-cfed-48a0-a6a3-edf80dd67606 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:17.171937 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-28be8bb7-cfed-48a0-a6a3-edf80dd67606 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:17.173050 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-28be8bb7-cfed-48a0-a6a3-edf80dd67606 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:17.173678 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-28be8bb7-cfed-48a0-a6a3-edf80dd67606 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:17.174260 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-28be8bb7-cfed-48a0-a6a3-edf80dd67606 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:17.191977 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-beab5d11-4fed-4b09-aebf-484e21e43f09 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:17.205213 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-beab5d11-4fed-4b09-aebf-484e21e43f09 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/ad55193e-b097-4372-9a00-972ed2b486f8" status: 200 len: 1199 microversion: 2.1 time: 0.498361 Sep 14 08:57:17.212832 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1025/2000] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:57:16 2022] GET /compute/v2.1/servers/ad55193e-b097-4372-9a00-972ed2b486f8 => generated 1199 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:57:17.273563 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-2cb1769b-b184-46f4-88aa-557bdf58400d req-269ea537-0807-4fed-a8d5-685951649ee7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a7e712b-b175-4ebc-9681-42ff2a91867d", "name": "network-vif-deleted", "tag": "5c5eee18-9716-472b-b5c5-030fbf084ba6"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:57:17.298813 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-2cb1769b-b184-46f4-88aa-557bdf58400d req-269ea537-0807-4fed-a8d5-685951649ee7 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:17.299693 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-2cb1769b-b184-46f4-88aa-557bdf58400d req-269ea537-0807-4fed-a8d5-685951649ee7 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:17.302070 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-2cb1769b-b184-46f4-88aa-557bdf58400d req-269ea537-0807-4fed-a8d5-685951649ee7 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:17.317230 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-2cb1769b-b184-46f4-88aa-557bdf58400d req-269ea537-0807-4fed-a8d5-685951649ee7 service nova] Creating event network-vif-deleted:5c5eee18-9716-472b-b5c5-030fbf084ba6 for instance 8a7e712b-b175-4ebc-9681-42ff2a91867d on n-h1-836830-18 Sep 14 08:57:17.326221 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-2cb1769b-b184-46f4-88aa-557bdf58400d req-269ea537-0807-4fed-a8d5-685951649ee7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056131 Sep 14 08:57:17.327385 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1026/2001] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:57:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 08:57:17.502264 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-28be8bb7-cfed-48a0-a6a3-edf80dd67606 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab2d64c1cb447f9bfd658408aa07e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ecc8c1389847c7bcd9cd5570d990e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:17.511394 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-28be8bb7-cfed-48a0-a6a3-edf80dd67606 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] 10.222.0.60 "GET /compute/v2.1/servers/8dd1623b-312c-411d-8f6c-b334195e573b" status: 200 len: 1473 microversion: 2.1 time: 0.366273 Sep 14 08:57:17.512262 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 976/2002] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:57:17 2022] GET /compute/v2.1/servers/8dd1623b-312c-411d-8f6c-b334195e573b => generated 1473 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:57:17.730275 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-31a0dae9-fc66-4a89-89b5-1188c4456006 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:17.731013 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-31a0dae9-fc66-4a89-89b5-1188c4456006 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 8a7e712b-b175-4ebc-9681-42ff2a91867d] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:17.745245 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-31a0dae9-fc66-4a89-89b5-1188c4456006 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:17.745735 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-31a0dae9-fc66-4a89-89b5-1188c4456006 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:17.761044 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-31a0dae9-fc66-4a89-89b5-1188c4456006 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:17.762108 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-31a0dae9-fc66-4a89-89b5-1188c4456006 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:17.765877 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-31a0dae9-fc66-4a89-89b5-1188c4456006 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:17.766328 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-31a0dae9-fc66-4a89-89b5-1188c4456006 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:17.863984 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-31a0dae9-fc66-4a89-89b5-1188c4456006 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:17.864468 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-31a0dae9-fc66-4a89-89b5-1188c4456006 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:17.864915 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-31a0dae9-fc66-4a89-89b5-1188c4456006 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:17.865377 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.objects.instance [None req-31a0dae9-fc66-4a89-89b5-1188c4456006 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lazy-loading 'fault' on Instance uuid 8a7e712b-b175-4ebc-9681-42ff2a91867d {{(pid=128758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 08:57:17.971332 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b897813c-ca4f-4bf4-a93a-a5b33413d593 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:17.972101 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b897813c-ca4f-4bf4-a93a-a5b33413d593 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] [instance: 59f196e8-c202-4073-8663-2ae19358a044] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:17.992658 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b897813c-ca4f-4bf4-a93a-a5b33413d593 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:17.993351 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b897813c-ca4f-4bf4-a93a-a5b33413d593 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:17.994462 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b897813c-ca4f-4bf4-a93a-a5b33413d593 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:17.998411 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b897813c-ca4f-4bf4-a93a-a5b33413d593 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:17.999223 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b897813c-ca4f-4bf4-a93a-a5b33413d593 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:17.999822 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b897813c-ca4f-4bf4-a93a-a5b33413d593 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:18.345930 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-31a0dae9-fc66-4a89-89b5-1188c4456006 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:18.353980 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-31a0dae9-fc66-4a89-89b5-1188c4456006 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/8a7e712b-b175-4ebc-9681-42ff2a91867d" status: 200 len: 1318 microversion: 2.1 time: 0.627775 Sep 14 08:57:18.354583 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1027/2003] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:57:17 2022] GET /compute/v2.1/servers/8a7e712b-b175-4ebc-9681-42ff2a91867d => generated 1318 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:57:18.376309 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ee2a6e85-2a8a-40d9-9349-e38a5bcb73bd tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:18.377146 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-ee2a6e85-2a8a-40d9-9349-e38a5bcb73bd tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: ad55193e-b097-4372-9a00-972ed2b486f8] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:18.396717 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ee2a6e85-2a8a-40d9-9349-e38a5bcb73bd tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:18.397258 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ee2a6e85-2a8a-40d9-9349-e38a5bcb73bd tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:18.397663 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ee2a6e85-2a8a-40d9-9349-e38a5bcb73bd tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:18.403322 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ee2a6e85-2a8a-40d9-9349-e38a5bcb73bd tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:18.404039 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ee2a6e85-2a8a-40d9-9349-e38a5bcb73bd tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:18.404677 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ee2a6e85-2a8a-40d9-9349-e38a5bcb73bd tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:18.831805 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b897813c-ca4f-4bf4-a93a-a5b33413d593 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:18.845970 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b897813c-ca4f-4bf4-a93a-a5b33413d593 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:18.852622 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b897813c-ca4f-4bf4-a93a-a5b33413d593 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:18.854278 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b897813c-ca4f-4bf4-a93a-a5b33413d593 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] 10.222.0.60 "GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044" status: 200 len: 1889 microversion: 2.42 time: 0.891173 Sep 14 08:57:18.855339 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 977/2004] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:57:17 2022] GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044 => generated 1889 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:57:18.862723 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d6ea1f00-f263-44b1-82f8-aab150b85179 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:18.863389 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-d6ea1f00-f263-44b1-82f8-aab150b85179 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] [instance: 8dd1623b-312c-411d-8f6c-b334195e573b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:18.885370 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d6ea1f00-f263-44b1-82f8-aab150b85179 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:18.885893 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d6ea1f00-f263-44b1-82f8-aab150b85179 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:18.886349 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d6ea1f00-f263-44b1-82f8-aab150b85179 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:18.887240 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d6ea1f00-f263-44b1-82f8-aab150b85179 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:18.894756 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d6ea1f00-f263-44b1-82f8-aab150b85179 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:18.895372 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d6ea1f00-f263-44b1-82f8-aab150b85179 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:18.945716 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-ee2a6e85-2a8a-40d9-9349-e38a5bcb73bd tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:18.958518 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-ee2a6e85-2a8a-40d9-9349-e38a5bcb73bd tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/ad55193e-b097-4372-9a00-972ed2b486f8" status: 200 len: 1199 microversion: 2.1 time: 0.598659 Sep 14 08:57:18.960897 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1028/2005] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:57:18 2022] GET /compute/v2.1/servers/ad55193e-b097-4372-9a00-972ed2b486f8 => generated 1199 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:57:19.302632 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-d6ea1f00-f263-44b1-82f8-aab150b85179 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab2d64c1cb447f9bfd658408aa07e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ecc8c1389847c7bcd9cd5570d990e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:19.316146 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d6ea1f00-f263-44b1-82f8-aab150b85179 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] 10.222.0.60 "GET /compute/v2.1/servers/8dd1623b-312c-411d-8f6c-b334195e573b" status: 200 len: 1473 microversion: 2.1 time: 0.459605 Sep 14 08:57:19.319305 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 978/2006] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:57:18 2022] GET /compute/v2.1/servers/8dd1623b-312c-411d-8f6c-b334195e573b => generated 1473 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:57:19.388163 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-7aeb5ef8-4d2e-4e7e-9e14-68c29942bf23 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:19.389570 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-7aeb5ef8-4d2e-4e7e-9e14-68c29942bf23 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 8a7e712b-b175-4ebc-9681-42ff2a91867d] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:19.409287 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7aeb5ef8-4d2e-4e7e-9e14-68c29942bf23 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:19.418558 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7aeb5ef8-4d2e-4e7e-9e14-68c29942bf23 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:19.433232 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7aeb5ef8-4d2e-4e7e-9e14-68c29942bf23 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:19.434040 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7aeb5ef8-4d2e-4e7e-9e14-68c29942bf23 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:19.441702 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7aeb5ef8-4d2e-4e7e-9e14-68c29942bf23 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:19.442395 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7aeb5ef8-4d2e-4e7e-9e14-68c29942bf23 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:19.480202 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-7aeb5ef8-4d2e-4e7e-9e14-68c29942bf23 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] HTTP exception thrown: Instance 8a7e712b-b175-4ebc-9681-42ff2a91867d could not be found. Sep 14 08:57:19.482234 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-7aeb5ef8-4d2e-4e7e-9e14-68c29942bf23 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Request method failure captured: Sep 14 08:57:19.482234 n-d-836830-18 devstack@n-api.service[128758]: request: GET /compute/v2.1/servers/8a7e712b-b175-4ebc-9681-42ff2a91867d HTTP/1.1 Sep 14 08:57:19.482234 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 08:57:19.482234 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 08:57:19.482234 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 08:57:19.482234 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 08:57:19.482234 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 08:57:19.482234 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 08:57:19.482234 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 08:57:19.482234 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 08:57:19.482234 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZcaJwfflKXdBQOzu63TKkiZhpOhYfmFkGJTkIRAE47xWaYCE5owpMd6ZGj3T_7h70-IX-88ov5m9P47-8wvvyB1aoACyyMztTclo7X0AZdOhAhE2WQeLs1dhX-NF72boJ9SoR98XdGx2ROr7Y4PciafvjdUpaADdFYghsgULitlVHs Sep 14 08:57:19.482234 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 08:57:19.482234 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 08:57:19.482234 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 08:57:19.482234 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 08:57:19.482234 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 08:57:19.482234 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 08:57:19.482234 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: a46ca7b6c331417199f9dfc5ffa80470 Sep 14 08:57:19.482234 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-ServersTestJSON-1483820673 Sep 14 08:57:19.482234 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 08:57:19.482234 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 08:57:19.482234 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a46ca7b6c331417199f9dfc5ffa80470"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a46ca7b6c331417199f9dfc5ffa80470"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a46ca7b6c331417199f9dfc5ffa80470"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a46ca7b6c331417199f9dfc5ffa80470"}]}] Sep 14 08:57:19.482234 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-ServersTestJSON-1483820673 Sep 14 08:57:19.482234 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: a46ca7b6c331417199f9dfc5ffa80470 Sep 14 08:57:19.482234 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-ServersTestJSON-1483820673 Sep 14 08:57:19.482234 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-ServersTestJSON-1483820673-project Sep 14 08:57:19.482234 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 08:57:19.482234 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 08:57:19.482234 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 1473e6771ff1459c831d66311318404d Sep 14 08:57:19.482234 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-ServersTestJSON-1483820673-project Sep 14 08:57:19.482234 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 08:57:19.482234 n-d-836830-18 devstack@n-api.service[128758]: exception: Instance 8a7e712b-b175-4ebc-9681-42ff2a91867d could not be found. Sep 14 08:57:19.482234 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': '8a7e712b-b175-4ebc-9681-42ff2a91867d'} Sep 14 08:57:19.482234 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:57:19.482234 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:57:19.482234 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 08:57:19.482234 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 08:57:19.482234 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 08:57:19.482234 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 08:57:19.482234 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 08:57:19.482234 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 08:57:19.482234 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 08:57:19.482234 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 08:57:19.482234 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a7e712b-b175-4ebc-9681-42ff2a91867d could not be found. Sep 14 08:57:19.482234 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:57:19.482234 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:57:19.482234 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:57:19.482234 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:57:19.482234 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:57:19.482234 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:57:19.482234 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:57:19.482234 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:57:19.482234 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:57:19.482234 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:57:19.482234 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 08:57:19.482234 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 08:57:19.482234 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 08:57:19.482234 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 08:57:19.482234 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 08:57:19.482234 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 08:57:19.482234 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a7e712b-b175-4ebc-9681-42ff2a91867d could not be found. Sep 14 08:57:19.482234 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:57:19.482234 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:57:19.482234 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:57:19.485812 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:57:19.485812 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:57:19.485812 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:57:19.485812 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:57:19.485812 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:57:19.485812 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a7e712b-b175-4ebc-9681-42ff2a91867d could not be found. Sep 14 08:57:19.485812 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:57:19.488400 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-7aeb5ef8-4d2e-4e7e-9e14-68c29942bf23 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Returning 404 to user: Instance 8a7e712b-b175-4ebc-9681-42ff2a91867d could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:57:19.489924 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-7aeb5ef8-4d2e-4e7e-9e14-68c29942bf23 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/8a7e712b-b175-4ebc-9681-42ff2a91867d" status: 404 len: 111 microversion: 2.1 time: 0.108068 Sep 14 08:57:19.495227 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1029/2007] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:57:19 2022] GET /compute/v2.1/servers/8a7e712b-b175-4ebc-9681-42ff2a91867d => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 08:57:19.504683 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a232cf8a-705a-4e82-a3b6-a8f692bc691d tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '.version_select at 0x7f7d3feaf0d0>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:19.522976 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-f394d7fc-c88d-4120-adfb-76d951c2a743 req-e498e503-c54e-41c6-9aee-d2d83988c28a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59f196e8-c202-4073-8663-2ae19358a044", "tag": "2facbe7c-1fe7-4366-91c7-d589e067102f"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:57:19.556471 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-f394d7fc-c88d-4120-adfb-76d951c2a743 req-e498e503-c54e-41c6-9aee-d2d83988c28a service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:19.557284 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-f394d7fc-c88d-4120-adfb-76d951c2a743 req-e498e503-c54e-41c6-9aee-d2d83988c28a service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:19.558012 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-f394d7fc-c88d-4120-adfb-76d951c2a743 req-e498e503-c54e-41c6-9aee-d2d83988c28a service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:19.575585 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a232cf8a-705a-4e82-a3b6-a8f692bc691d tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-key-929868005" status: 202 len: 0 microversion: 2.1 time: 0.080218 Sep 14 08:57:19.582078 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 979/2008] 10.222.0.60 () {58 vars in 1206 bytes} [Wed Sep 14 08:57:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-929868005 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 14 08:57:19.595512 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-f394d7fc-c88d-4120-adfb-76d951c2a743 req-e498e503-c54e-41c6-9aee-d2d83988c28a service nova] Creating event network-changed:2facbe7c-1fe7-4366-91c7-d589e067102f for instance 59f196e8-c202-4073-8663-2ae19358a044 on n-h2-836830-18 Sep 14 08:57:19.600893 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-f394d7fc-c88d-4120-adfb-76d951c2a743 req-e498e503-c54e-41c6-9aee-d2d83988c28a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084567 Sep 14 08:57:19.603675 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1030/2009] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:57:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:57:19.667209 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-5ba46dff-d229-4fd3-902b-a6156117fe2e tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-438815376", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "networks": [{"uuid": "238fbc23-0a7b-476b-a552-1a5667de089a"}]}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:57:19.763698 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.network.neutron [None req-5ba46dff-d229-4fd3-902b-a6156117fe2e tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] validate_networks() for [('238fbc23-0a7b-476b-a552-1a5667de089a', None, None, None, None, None)] {{(pid=128759) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 08:57:19.830246 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-e9a7a81b-d179-4551-959b-b8aab7a8b15e tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:19.830956 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-e9a7a81b-d179-4551-959b-b8aab7a8b15e tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: bf59291e-0a19-499b-a95b-a76d82b5e307] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:19.839357 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e9a7a81b-d179-4551-959b-b8aab7a8b15e tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:19.840038 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e9a7a81b-d179-4551-959b-b8aab7a8b15e tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:19.840638 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e9a7a81b-d179-4551-959b-b8aab7a8b15e tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:19.849284 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e9a7a81b-d179-4551-959b-b8aab7a8b15e tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:19.858420 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e9a7a81b-d179-4551-959b-b8aab7a8b15e tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:19.859513 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e9a7a81b-d179-4551-959b-b8aab7a8b15e tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:19.898749 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-e9a7a81b-d179-4551-959b-b8aab7a8b15e tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: bf59291e-0a19-499b-a95b-a76d82b5e307] Going to try to terminate instance {{(pid=128758) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 08:57:20.117534 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-e9a7a81b-d179-4551-959b-b8aab7a8b15e tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "DELETE /compute/v2.1/servers/bf59291e-0a19-499b-a95b-a76d82b5e307" status: 204 len: 0 microversion: 2.25 time: 0.292031 Sep 14 08:57:20.119328 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1031/2010] 10.222.0.60 () {60 vars in 1280 bytes} [Wed Sep 14 08:57:19 2022] DELETE /compute/v2.1/servers/bf59291e-0a19-499b-a95b-a76d82b5e307 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 14 08:57:20.128247 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ad600b58-a6f9-4347-b50c-fab1c146f6e9 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Action: 'create', calling method: .version_select at 0x7f7d44cc7700>, body: {"keypair": {"name": "tempest-keypair-1978855505", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLr2WVZIY/yjGKwLMelVDs7QtqFW7l8B15ejdgIDUuyLtBxbON98+bNyJV1x/vdz+cy6ycuUs/zaA3d6K2qw+NuTPOIU9qoCBeUny/u2t/JHjo3vg7rT7IOjBtixz00LHQ=="}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:57:20.168643 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-ad600b58-a6f9-4347-b50c-fab1c146f6e9 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Getting quotas for project 46a1734368204db58d9d7572726d2794. Resources: {'key_pairs'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 08:57:20.179405 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-ad600b58-a6f9-4347-b50c-fab1c146f6e9 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Getting quotas for user 87d4eb547eeb475185d097f03049ccde and project 46a1734368204db58d9d7572726d2794. Resources: {'key_pairs'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 08:57:20.231489 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-ad600b58-a6f9-4347-b50c-fab1c146f6e9 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.32 time: 0.110262 Sep 14 08:57:20.232559 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1032/2011] 10.222.0.60 () {62 vars in 1200 bytes} [Wed Sep 14 08:57:20 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 112 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 14 08:57:20.239483 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-46ed1696-a8ef-4f08-9fa4-73369761b506 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:20.240570 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-46ed1696-a8ef-4f08-9fa4-73369761b506 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] [instance: 59f196e8-c202-4073-8663-2ae19358a044] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:20.252307 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-46ed1696-a8ef-4f08-9fa4-73369761b506 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:20.253024 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-46ed1696-a8ef-4f08-9fa4-73369761b506 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:20.253601 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-46ed1696-a8ef-4f08-9fa4-73369761b506 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:20.255020 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-46ed1696-a8ef-4f08-9fa4-73369761b506 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:20.256124 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-46ed1696-a8ef-4f08-9fa4-73369761b506 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:20.256702 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-46ed1696-a8ef-4f08-9fa4-73369761b506 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:20.730670 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-46ed1696-a8ef-4f08-9fa4-73369761b506 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:20.753807 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-46ed1696-a8ef-4f08-9fa4-73369761b506 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:20.757669 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-46ed1696-a8ef-4f08-9fa4-73369761b506 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:20.758884 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-46ed1696-a8ef-4f08-9fa4-73369761b506 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] 10.222.0.60 "GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044" status: 200 len: 1889 microversion: 2.42 time: 0.524307 Sep 14 08:57:20.765716 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1033/2012] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:57:20 2022] GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044 => generated 1889 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:57:20.770545 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-91eacdd4-51a5-481b-ab49-658793bde00f tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:20.771214 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-91eacdd4-51a5-481b-ab49-658793bde00f tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: ad55193e-b097-4372-9a00-972ed2b486f8] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:20.789479 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-91eacdd4-51a5-481b-ab49-658793bde00f tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:20.792346 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-91eacdd4-51a5-481b-ab49-658793bde00f tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:20.792963 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-91eacdd4-51a5-481b-ab49-658793bde00f tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:20.797036 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-91eacdd4-51a5-481b-ab49-658793bde00f tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:20.797685 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-91eacdd4-51a5-481b-ab49-658793bde00f tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:20.798289 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-91eacdd4-51a5-481b-ab49-658793bde00f tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:21.070988 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-5ba46dff-d229-4fd3-902b-a6156117fe2e tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Flavor limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 08:57:21.071583 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-5ba46dff-d229-4fd3-902b-a6156117fe2e tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Image limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 08:57:21.072375 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-5ba46dff-d229-4fd3-902b-a6156117fe2e tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Flavor pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 08:57:21.072801 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-5ba46dff-d229-4fd3-902b-a6156117fe2e tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Image pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 08:57:21.073271 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-5ba46dff-d229-4fd3-902b-a6156117fe2e tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 08:57:21.083907 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5ba46dff-d229-4fd3-902b-a6156117fe2e tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:21.084946 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5ba46dff-d229-4fd3-902b-a6156117fe2e tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:21.085519 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5ba46dff-d229-4fd3-902b-a6156117fe2e tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:21.086480 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5ba46dff-d229-4fd3-902b-a6156117fe2e tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:21.087207 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5ba46dff-d229-4fd3-902b-a6156117fe2e tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:21.087805 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5ba46dff-d229-4fd3-902b-a6156117fe2e tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:21.115597 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-5ba46dff-d229-4fd3-902b-a6156117fe2e tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Getting quotas for project a46ca7b6c331417199f9dfc5ffa80470. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 08:57:21.121601 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-5ba46dff-d229-4fd3-902b-a6156117fe2e tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Getting quotas for user 1473e6771ff1459c831d66311318404d and project a46ca7b6c331417199f9dfc5ffa80470. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 08:57:21.135508 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-5ba46dff-d229-4fd3-902b-a6156117fe2e tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Going to run 1 instances... {{(pid=128759) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 08:57:21.138148 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-5ba46dff-d229-4fd3-902b-a6156117fe2e tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 2334f491-8233-4171-906f-e0c46d0a3fb2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128759) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 08:57:21.211096 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-5ba46dff-d229-4fd3-902b-a6156117fe2e tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.548708 Sep 14 08:57:21.213894 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 980/2013] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 08:57:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1552 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 08:57:21.229490 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ae35f5cc-d8d0-4d70-8e61-83ccd829b3f5 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:21.231101 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-91eacdd4-51a5-481b-ab49-658793bde00f tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:21.233874 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-ae35f5cc-d8d0-4d70-8e61-83ccd829b3f5 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: bf59291e-0a19-499b-a95b-a76d82b5e307] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:21.241637 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-91eacdd4-51a5-481b-ab49-658793bde00f tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/ad55193e-b097-4372-9a00-972ed2b486f8" status: 200 len: 1199 microversion: 2.1 time: 0.474607 Sep 14 08:57:21.243813 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ae35f5cc-d8d0-4d70-8e61-83ccd829b3f5 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:21.244105 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1034/2014] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:57:20 2022] GET /compute/v2.1/servers/ad55193e-b097-4372-9a00-972ed2b486f8 => generated 1199 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:57:21.244642 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ae35f5cc-d8d0-4d70-8e61-83ccd829b3f5 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:21.245246 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ae35f5cc-d8d0-4d70-8e61-83ccd829b3f5 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:21.246117 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ae35f5cc-d8d0-4d70-8e61-83ccd829b3f5 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:21.247300 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ae35f5cc-d8d0-4d70-8e61-83ccd829b3f5 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:21.247885 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ae35f5cc-d8d0-4d70-8e61-83ccd829b3f5 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:21.250384 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-e10b827a-208a-4fcb-9f45-c6d9297ff08f tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:21.252862 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-e10b827a-208a-4fcb-9f45-c6d9297ff08f tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] [instance: 8dd1623b-312c-411d-8f6c-b334195e573b] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:21.268631 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e10b827a-208a-4fcb-9f45-c6d9297ff08f tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:21.269311 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e10b827a-208a-4fcb-9f45-c6d9297ff08f tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:21.269900 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e10b827a-208a-4fcb-9f45-c6d9297ff08f tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:21.271730 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e10b827a-208a-4fcb-9f45-c6d9297ff08f tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:21.274190 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e10b827a-208a-4fcb-9f45-c6d9297ff08f tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:21.274810 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e10b827a-208a-4fcb-9f45-c6d9297ff08f tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:21.900229 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-e10b827a-208a-4fcb-9f45-c6d9297ff08f tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab2d64c1cb447f9bfd658408aa07e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ecc8c1389847c7bcd9cd5570d990e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:21.913268 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-e10b827a-208a-4fcb-9f45-c6d9297ff08f tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] 10.222.0.60 "GET /compute/v2.1/servers/8dd1623b-312c-411d-8f6c-b334195e573b" status: 200 len: 1473 microversion: 2.1 time: 0.667479 Sep 14 08:57:21.942680 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-ae35f5cc-d8d0-4d70-8e61-83ccd829b3f5 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:21.953975 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1035/2015] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:57:21 2022] GET /compute/v2.1/servers/8dd1623b-312c-411d-8f6c-b334195e573b => generated 1473 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:57:21.966623 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-ae35f5cc-d8d0-4d70-8e61-83ccd829b3f5 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:21.973477 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-573fe6f2-d5df-4105-8859-2dd11748bf5d tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:21.975786 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-573fe6f2-d5df-4105-8859-2dd11748bf5d tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 2334f491-8233-4171-906f-e0c46d0a3fb2] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:21.976502 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-ae35f5cc-d8d0-4d70-8e61-83ccd829b3f5 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:21.978866 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-ae35f5cc-d8d0-4d70-8e61-83ccd829b3f5 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/bf59291e-0a19-499b-a95b-a76d82b5e307" status: 200 len: 1549 microversion: 2.25 time: 0.756091 Sep 14 08:57:21.995048 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 981/2016] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:57:21 2022] GET /compute/v2.1/servers/bf59291e-0a19-499b-a95b-a76d82b5e307 => generated 1549 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:57:22.003500 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-573fe6f2-d5df-4105-8859-2dd11748bf5d tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:22.004013 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-573fe6f2-d5df-4105-8859-2dd11748bf5d tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:22.004459 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-573fe6f2-d5df-4105-8859-2dd11748bf5d tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:22.009551 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-08f5fbd4-3f4f-4e51-83b7-b88c6e7b4110 req-942b3b74-e04c-4813-9de5-876bafeb2dea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59f196e8-c202-4073-8663-2ae19358a044", "tag": "55ecb12c-40d9-41ea-bb56-362fc9dba976"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:57:22.013752 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-573fe6f2-d5df-4105-8859-2dd11748bf5d tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:22.014591 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-573fe6f2-d5df-4105-8859-2dd11748bf5d tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:22.015085 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-573fe6f2-d5df-4105-8859-2dd11748bf5d tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:22.061849 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-08f5fbd4-3f4f-4e51-83b7-b88c6e7b4110 req-942b3b74-e04c-4813-9de5-876bafeb2dea service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:22.063448 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-08f5fbd4-3f4f-4e51-83b7-b88c6e7b4110 req-942b3b74-e04c-4813-9de5-876bafeb2dea service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:22.063939 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-08f5fbd4-3f4f-4e51-83b7-b88c6e7b4110 req-942b3b74-e04c-4813-9de5-876bafeb2dea service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:22.093769 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:57:22.096594 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-08f5fbd4-3f4f-4e51-83b7-b88c6e7b4110 req-942b3b74-e04c-4813-9de5-876bafeb2dea service nova] Creating event network-changed:55ecb12c-40d9-41ea-bb56-362fc9dba976 for instance 59f196e8-c202-4073-8663-2ae19358a044 on n-h2-836830-18 Sep 14 08:57:22.114763 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-08f5fbd4-3f4f-4e51-83b7-b88c6e7b4110 req-942b3b74-e04c-4813-9de5-876bafeb2dea service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129289 Sep 14 08:57:22.116176 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 982/2017] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:57:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:57:22.132295 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-445e55b7-a1b1-45a3-b9bd-179c4566acf8 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:22.136600 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-445e55b7-a1b1-45a3-b9bd-179c4566acf8 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] [instance: 59f196e8-c202-4073-8663-2ae19358a044] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:22.160639 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-445e55b7-a1b1-45a3-b9bd-179c4566acf8 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:22.161242 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-445e55b7-a1b1-45a3-b9bd-179c4566acf8 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:22.161874 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-445e55b7-a1b1-45a3-b9bd-179c4566acf8 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:22.162677 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-445e55b7-a1b1-45a3-b9bd-179c4566acf8 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:22.163269 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-445e55b7-a1b1-45a3-b9bd-179c4566acf8 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:22.163812 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-445e55b7-a1b1-45a3-b9bd-179c4566acf8 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:22.255925 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-573fe6f2-d5df-4105-8859-2dd11748bf5d tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:22.272088 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-573fe6f2-d5df-4105-8859-2dd11748bf5d tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/2334f491-8233-4171-906f-e0c46d0a3fb2" status: 200 len: 1212 microversion: 2.1 time: 0.313701 Sep 14 08:57:22.275162 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1036/2018] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:57:21 2022] GET /compute/v2.1/servers/2334f491-8233-4171-906f-e0c46d0a3fb2 => generated 1212 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:57:22.293524 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a37a3ccc-ba16-4b94-9c1c-ea80cf0aa176 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:22.297147 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-a37a3ccc-ba16-4b94-9c1c-ea80cf0aa176 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: ad55193e-b097-4372-9a00-972ed2b486f8] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:22.307597 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a37a3ccc-ba16-4b94-9c1c-ea80cf0aa176 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:22.308392 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a37a3ccc-ba16-4b94-9c1c-ea80cf0aa176 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:22.309692 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a37a3ccc-ba16-4b94-9c1c-ea80cf0aa176 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:22.310819 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a37a3ccc-ba16-4b94-9c1c-ea80cf0aa176 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:22.311496 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a37a3ccc-ba16-4b94-9c1c-ea80cf0aa176 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:22.312203 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a37a3ccc-ba16-4b94-9c1c-ea80cf0aa176 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:22.773883 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-445e55b7-a1b1-45a3-b9bd-179c4566acf8 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:22.776611 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=100 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:57:22.788868 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-445e55b7-a1b1-45a3-b9bd-179c4566acf8 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:22.790491 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-445e55b7-a1b1-45a3-b9bd-179c4566acf8 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:22.791803 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-445e55b7-a1b1-45a3-b9bd-179c4566acf8 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] 10.222.0.60 "GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044" status: 200 len: 1889 microversion: 2.42 time: 0.669001 Sep 14 08:57:22.803188 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 983/2019] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:57:22 2022] GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044 => generated 1889 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:57:22.803845 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-a37a3ccc-ba16-4b94-9c1c-ea80cf0aa176 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:22.819714 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-e24dc58d-63ce-4462-9ddd-4690ee4baf6f req-68cb972d-2e05-4272-9a55-192d61c28ed9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf59291e-0a19-499b-a95b-a76d82b5e307", "name": "network-vif-deleted", "tag": "f8233fbd-017c-41f3-ac0a-d6c9e916d35e"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:57:22.823018 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-a37a3ccc-ba16-4b94-9c1c-ea80cf0aa176 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/ad55193e-b097-4372-9a00-972ed2b486f8" status: 200 len: 1199 microversion: 2.1 time: 0.545338 Sep 14 08:57:22.834985 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1037/2020] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:57:22 2022] GET /compute/v2.1/servers/ad55193e-b097-4372-9a00-972ed2b486f8 => generated 1199 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:57:22.834985 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-b9636293-3fdd-46b6-b9e3-baafa146d011 req-d4b05dcb-15b3-4866-9e1f-2bc15d82e894 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad55193e-b097-4372-9a00-972ed2b486f8", "name": "network-vif-plugged", "status": "completed", "tag": "86eca38d-0fbc-40dc-8c19-2e0f4d671871"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:57:22.835283 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-e24dc58d-63ce-4462-9ddd-4690ee4baf6f req-68cb972d-2e05-4272-9a55-192d61c28ed9 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:22.835283 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-e24dc58d-63ce-4462-9ddd-4690ee4baf6f req-68cb972d-2e05-4272-9a55-192d61c28ed9 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:22.835283 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-e24dc58d-63ce-4462-9ddd-4690ee4baf6f req-68cb972d-2e05-4272-9a55-192d61c28ed9 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:22.847647 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-b9636293-3fdd-46b6-b9e3-baafa146d011 req-d4b05dcb-15b3-4866-9e1f-2bc15d82e894 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:22.848418 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-b9636293-3fdd-46b6-b9e3-baafa146d011 req-d4b05dcb-15b3-4866-9e1f-2bc15d82e894 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:22.848935 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-b9636293-3fdd-46b6-b9e3-baafa146d011 req-d4b05dcb-15b3-4866-9e1f-2bc15d82e894 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:22.856622 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-e24dc58d-63ce-4462-9ddd-4690ee4baf6f req-68cb972d-2e05-4272-9a55-192d61c28ed9 service nova] Creating event network-vif-deleted:f8233fbd-017c-41f3-ac0a-d6c9e916d35e for instance bf59291e-0a19-499b-a95b-a76d82b5e307 on n-h2-836830-18 Sep 14 08:57:22.867929 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-b9636293-3fdd-46b6-b9e3-baafa146d011 req-d4b05dcb-15b3-4866-9e1f-2bc15d82e894 service nova] Creating event network-vif-plugged:86eca38d-0fbc-40dc-8c19-2e0f4d671871 for instance ad55193e-b097-4372-9a00-972ed2b486f8 on n-h1-836830-18 Sep 14 08:57:22.873119 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-b9636293-3fdd-46b6-b9e3-baafa146d011 req-d4b05dcb-15b3-4866-9e1f-2bc15d82e894 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047914 Sep 14 08:57:22.873848 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1038/2021] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:57:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:57:22.876654 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-e24dc58d-63ce-4462-9ddd-4690ee4baf6f req-68cb972d-2e05-4272-9a55-192d61c28ed9 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072213 Sep 14 08:57:22.879654 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-29d37939-de19-4873-8a93-0ef5d326d218 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-2112095296", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "d1e8aff7-929a-4289-9e80-901dac2057b4"}, {"port": "e80b0ec1-03fe-4258-9fdb-620fff721a58", "tag": "port-1"}, {"port": "0799d62c-8c0b-4879-8555-e787ef1b353f", "tag": "port-2"}, {"uuid": "d8d9f66a-a515-4756-837a-12527d576bf9", "tag": "net-1"}, {"uuid": "d8d9f66a-a515-4756-837a-12527d576bf9"}, {"uuid": "c85bc435-f7e8-4c2a-8f92-afac1d863612", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "c85bc435-f7e8-4c2a-8f92-afac1d863612", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "b696f835-d977-45f1-a8f8-de0f650b4d23", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "88e6b863-9248-4779-80bb-61179e4ab86c", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "35b71245-2621-43eb-8c49-b535226a9f96", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1113982377"}], "key_name": "tempest-keypair-1978855505", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:57:22.881549 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 984/2022] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:57:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:57:22.954347 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f34e9801-4876-4306-aa36-ea83faf1293e tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:22.955302 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f34e9801-4876-4306-aa36-ea83faf1293e tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] [instance: 8dd1623b-312c-411d-8f6c-b334195e573b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:22.981002 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f34e9801-4876-4306-aa36-ea83faf1293e tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:22.981787 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f34e9801-4876-4306-aa36-ea83faf1293e tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:22.985337 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f34e9801-4876-4306-aa36-ea83faf1293e tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:22.988372 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f34e9801-4876-4306-aa36-ea83faf1293e tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:22.989110 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f34e9801-4876-4306-aa36-ea83faf1293e tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:22.990140 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f34e9801-4876-4306-aa36-ea83faf1293e tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:23.035901 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.network.neutron [None req-29d37939-de19-4873-8a93-0ef5d326d218 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] validate_networks() for [('d1e8aff7-929a-4289-9e80-901dac2057b4', None, None, None, None, None), (None, None, 'e80b0ec1-03fe-4258-9fdb-620fff721a58', None, None, None), (None, None, '0799d62c-8c0b-4879-8555-e787ef1b353f', None, None, None), ('d8d9f66a-a515-4756-837a-12527d576bf9', None, None, None, None, None), ('d8d9f66a-a515-4756-837a-12527d576bf9', None, None, None, None, None), ('c85bc435-f7e8-4c2a-8f92-afac1d863612', '10.2.2.100', None, None, None, None), ('c85bc435-f7e8-4c2a-8f92-afac1d863612', '10.2.2.200', None, None, None, None)] {{(pid=128758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 08:57:23.311838 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f34e9801-4876-4306-aa36-ea83faf1293e tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab2d64c1cb447f9bfd658408aa07e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ecc8c1389847c7bcd9cd5570d990e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:23.321549 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f34e9801-4876-4306-aa36-ea83faf1293e tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] 10.222.0.60 "GET /compute/v2.1/servers/8dd1623b-312c-411d-8f6c-b334195e573b" status: 200 len: 1479 microversion: 2.1 time: 0.380831 Sep 14 08:57:23.322155 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 985/2023] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:57:22 2022] GET /compute/v2.1/servers/8dd1623b-312c-411d-8f6c-b334195e573b => generated 1479 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:57:23.354037 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-135f1895-2fb2-4d9c-a142-326e0f817868 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:23.354899 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-135f1895-2fb2-4d9c-a142-326e0f817868 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: bf59291e-0a19-499b-a95b-a76d82b5e307] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:23.374159 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-135f1895-2fb2-4d9c-a142-326e0f817868 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:23.375105 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-135f1895-2fb2-4d9c-a142-326e0f817868 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:23.375714 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-135f1895-2fb2-4d9c-a142-326e0f817868 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:23.376696 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-135f1895-2fb2-4d9c-a142-326e0f817868 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:23.377522 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-135f1895-2fb2-4d9c-a142-326e0f817868 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:23.378128 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-135f1895-2fb2-4d9c-a142-326e0f817868 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:23.445543 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-135f1895-2fb2-4d9c-a142-326e0f817868 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:23.446057 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-135f1895-2fb2-4d9c-a142-326e0f817868 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:23.446493 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-135f1895-2fb2-4d9c-a142-326e0f817868 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:23.449729 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.objects.instance [None req-135f1895-2fb2-4d9c-a142-326e0f817868 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lazy-loading 'fault' on Instance uuid bf59291e-0a19-499b-a95b-a76d82b5e307 {{(pid=128759) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 08:57:23.872194 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-135f1895-2fb2-4d9c-a142-326e0f817868 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:23.886634 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-135f1895-2fb2-4d9c-a142-326e0f817868 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:23.888861 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-135f1895-2fb2-4d9c-a142-326e0f817868 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:23.890780 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-135f1895-2fb2-4d9c-a142-326e0f817868 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/bf59291e-0a19-499b-a95b-a76d82b5e307" status: 200 len: 1352 microversion: 2.25 time: 0.548167 Sep 14 08:57:23.892650 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 986/2024] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:57:23 2022] GET /compute/v2.1/servers/bf59291e-0a19-499b-a95b-a76d82b5e307 => generated 1352 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:57:23.898461 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-97d14f90-24d1-46f4-9536-0aee2c00491f tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:23.899286 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-97d14f90-24d1-46f4-9536-0aee2c00491f tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 2334f491-8233-4171-906f-e0c46d0a3fb2] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:23.908775 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-97d14f90-24d1-46f4-9536-0aee2c00491f tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:23.929845 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-97d14f90-24d1-46f4-9536-0aee2c00491f tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:23.931977 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-97d14f90-24d1-46f4-9536-0aee2c00491f tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:23.935642 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-97d14f90-24d1-46f4-9536-0aee2c00491f tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:23.937437 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-97d14f90-24d1-46f4-9536-0aee2c00491f tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:23.940022 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-97d14f90-24d1-46f4-9536-0aee2c00491f tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:24.171984 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-97d14f90-24d1-46f4-9536-0aee2c00491f tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:24.188453 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-97d14f90-24d1-46f4-9536-0aee2c00491f tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/2334f491-8233-4171-906f-e0c46d0a3fb2" status: 200 len: 1266 microversion: 2.1 time: 0.293884 Sep 14 08:57:24.190814 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 987/2025] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:57:23 2022] GET /compute/v2.1/servers/2334f491-8233-4171-906f-e0c46d0a3fb2 => generated 1266 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:57:24.197779 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-2dcba5b5-bb33-4050-bbe0-42563d0a1d01 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:24.199101 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-2dcba5b5-bb33-4050-bbe0-42563d0a1d01 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] [instance: 59f196e8-c202-4073-8663-2ae19358a044] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:24.208391 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2dcba5b5-bb33-4050-bbe0-42563d0a1d01 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:24.209151 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2dcba5b5-bb33-4050-bbe0-42563d0a1d01 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:24.210648 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2dcba5b5-bb33-4050-bbe0-42563d0a1d01 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:24.211889 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2dcba5b5-bb33-4050-bbe0-42563d0a1d01 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:24.212318 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2dcba5b5-bb33-4050-bbe0-42563d0a1d01 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:24.212927 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2dcba5b5-bb33-4050-bbe0-42563d0a1d01 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:24.628488 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-2dcba5b5-bb33-4050-bbe0-42563d0a1d01 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:24.639084 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-2dcba5b5-bb33-4050-bbe0-42563d0a1d01 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:24.640700 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-2dcba5b5-bb33-4050-bbe0-42563d0a1d01 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:24.641973 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-2dcba5b5-bb33-4050-bbe0-42563d0a1d01 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] 10.222.0.60 "GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044" status: 200 len: 1877 microversion: 2.42 time: 0.449944 Sep 14 08:57:24.642648 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 988/2026] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:57:24 2022] GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044 => generated 1877 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:57:24.647598 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d7857c2a-0fe4-4115-9a61-1b4b5bc77bb7 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:24.648355 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-d7857c2a-0fe4-4115-9a61-1b4b5bc77bb7 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: ad55193e-b097-4372-9a00-972ed2b486f8] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:24.655891 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d7857c2a-0fe4-4115-9a61-1b4b5bc77bb7 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:24.656764 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d7857c2a-0fe4-4115-9a61-1b4b5bc77bb7 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:24.657373 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d7857c2a-0fe4-4115-9a61-1b4b5bc77bb7 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:24.658403 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d7857c2a-0fe4-4115-9a61-1b4b5bc77bb7 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:24.660745 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d7857c2a-0fe4-4115-9a61-1b4b5bc77bb7 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:24.661338 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d7857c2a-0fe4-4115-9a61-1b4b5bc77bb7 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:25.011736 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-d7857c2a-0fe4-4115-9a61-1b4b5bc77bb7 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:25.025378 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d7857c2a-0fe4-4115-9a61-1b4b5bc77bb7 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/ad55193e-b097-4372-9a00-972ed2b486f8" status: 200 len: 1199 microversion: 2.1 time: 0.381266 Sep 14 08:57:25.026712 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 989/2027] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:57:24 2022] GET /compute/v2.1/servers/ad55193e-b097-4372-9a00-972ed2b486f8 => generated 1199 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:57:25.039424 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-9b1d5542-e1ae-42fd-8ea9-4dca277684e1 req-82566c93-0a13-4921-b1cf-2b758db63ff1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59f196e8-c202-4073-8663-2ae19358a044", "tag": "6bc29bf6-117b-4334-9caf-61bc5a58835c"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:57:25.049838 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-9b1d5542-e1ae-42fd-8ea9-4dca277684e1 req-82566c93-0a13-4921-b1cf-2b758db63ff1 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:25.050539 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-9b1d5542-e1ae-42fd-8ea9-4dca277684e1 req-82566c93-0a13-4921-b1cf-2b758db63ff1 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:25.051188 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-9b1d5542-e1ae-42fd-8ea9-4dca277684e1 req-82566c93-0a13-4921-b1cf-2b758db63ff1 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:25.066064 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-9b1d5542-e1ae-42fd-8ea9-4dca277684e1 req-82566c93-0a13-4921-b1cf-2b758db63ff1 service nova] Creating event network-changed:6bc29bf6-117b-4334-9caf-61bc5a58835c for instance 59f196e8-c202-4073-8663-2ae19358a044 on n-h2-836830-18 Sep 14 08:57:25.072433 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-9b1d5542-e1ae-42fd-8ea9-4dca277684e1 req-82566c93-0a13-4921-b1cf-2b758db63ff1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043722 Sep 14 08:57:25.073592 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 990/2028] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:57:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:57:25.079744 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d762970c-c6a8-406a-9c2f-8c3f69ff2505 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:25.080663 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-d762970c-c6a8-406a-9c2f-8c3f69ff2505 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] [instance: 8dd1623b-312c-411d-8f6c-b334195e573b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:25.089465 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d762970c-c6a8-406a-9c2f-8c3f69ff2505 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:25.098600 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d762970c-c6a8-406a-9c2f-8c3f69ff2505 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:25.099354 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d762970c-c6a8-406a-9c2f-8c3f69ff2505 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:25.100251 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d762970c-c6a8-406a-9c2f-8c3f69ff2505 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:25.100871 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d762970c-c6a8-406a-9c2f-8c3f69ff2505 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:25.101452 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d762970c-c6a8-406a-9c2f-8c3f69ff2505 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:25.891919 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-d762970c-c6a8-406a-9c2f-8c3f69ff2505 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab2d64c1cb447f9bfd658408aa07e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ecc8c1389847c7bcd9cd5570d990e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:25.903894 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d762970c-c6a8-406a-9c2f-8c3f69ff2505 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] 10.222.0.60 "GET /compute/v2.1/servers/8dd1623b-312c-411d-8f6c-b334195e573b" status: 200 len: 1479 microversion: 2.1 time: 0.828946 Sep 14 08:57:25.907638 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 991/2029] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:57:25 2022] GET /compute/v2.1/servers/8dd1623b-312c-411d-8f6c-b334195e573b => generated 1479 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:57:25.916053 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f7593eb4-4977-4be0-8a9c-4ae7b8559fe0 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:25.916915 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f7593eb4-4977-4be0-8a9c-4ae7b8559fe0 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: bf59291e-0a19-499b-a95b-a76d82b5e307] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:25.955900 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f7593eb4-4977-4be0-8a9c-4ae7b8559fe0 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:25.957205 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f7593eb4-4977-4be0-8a9c-4ae7b8559fe0 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:25.957860 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f7593eb4-4977-4be0-8a9c-4ae7b8559fe0 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:25.959336 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f7593eb4-4977-4be0-8a9c-4ae7b8559fe0 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:25.959972 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f7593eb4-4977-4be0-8a9c-4ae7b8559fe0 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:25.960575 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f7593eb4-4977-4be0-8a9c-4ae7b8559fe0 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:25.983443 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-f7593eb4-4977-4be0-8a9c-4ae7b8559fe0 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] HTTP exception thrown: Instance bf59291e-0a19-499b-a95b-a76d82b5e307 could not be found. Sep 14 08:57:25.985386 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f7593eb4-4977-4be0-8a9c-4ae7b8559fe0 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Request method failure captured: Sep 14 08:57:25.985386 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/bf59291e-0a19-499b-a95b-a76d82b5e307 HTTP/1.1 Sep 14 08:57:25.985386 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 08:57:25.985386 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 08:57:25.985386 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 08:57:25.985386 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 08:57:25.985386 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 08:57:25.985386 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 08:57:25.985386 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 08:57:25.985386 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 08:57:25.985386 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZWl4sBr1-d0zWhOP1VypmcD37g65YKSC98adzDQksMynj67ZC5PVg2lSGT7NPp4LurGErQYTxYBVsDHD4XQgru2ajc5ixBy1mw1M3HnxJNE70omFE3tV833Q-dw3mlJAdgpOXexlM7Fuhn3BkTG0VioZq-vGusZTnLGxd-pf99Y8Xw Sep 14 08:57:25.985386 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 08:57:25.985386 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 08:57:25.985386 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 08:57:25.985386 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 08:57:25.985386 n-d-836830-18 devstack@n-api.service[128759]: X-Openstack-Nova-Api-Version: 2.25 Sep 14 08:57:25.985386 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 08:57:25.985386 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 08:57:25.985386 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 3850954316f34104b2a8052dc78a50d7 Sep 14 08:57:25.985386 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1232302418 Sep 14 08:57:25.985386 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 08:57:25.985386 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 08:57:25.985386 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/3850954316f34104b2a8052dc78a50d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_3850954316f34104b2a8052dc78a50d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3850954316f34104b2a8052dc78a50d7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3850954316f34104b2a8052dc78a50d7"}]}] Sep 14 08:57:25.985386 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1232302418 Sep 14 08:57:25.985386 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 3850954316f34104b2a8052dc78a50d7 Sep 14 08:57:25.985386 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1232302418 Sep 14 08:57:25.985386 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-LiveAutoBlockMigrationV225Test-1232302418-project Sep 14 08:57:25.985386 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 08:57:25.985386 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 08:57:25.985386 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: f140347422af48a4875e80337a272e29 Sep 14 08:57:25.985386 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1232302418-project Sep 14 08:57:25.985386 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 08:57:25.985386 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance bf59291e-0a19-499b-a95b-a76d82b5e307 could not be found. Sep 14 08:57:25.985386 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': 'bf59291e-0a19-499b-a95b-a76d82b5e307'} Sep 14 08:57:25.985386 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:57:25.985386 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:57:25.985386 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 08:57:25.985386 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 08:57:25.985386 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 08:57:25.985386 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 08:57:25.985386 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 08:57:25.985386 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 08:57:25.985386 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 08:57:25.985386 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 08:57:25.985386 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf59291e-0a19-499b-a95b-a76d82b5e307 could not be found. Sep 14 08:57:25.985386 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:57:25.985386 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:57:25.985386 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:57:25.985386 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:57:25.985386 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:57:25.985386 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:57:25.985386 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:57:25.985386 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:57:25.985386 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:57:25.985386 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:57:25.985386 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 08:57:25.985386 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 08:57:25.985386 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 08:57:25.985386 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 08:57:25.985386 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 08:57:25.985386 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 08:57:25.985386 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf59291e-0a19-499b-a95b-a76d82b5e307 could not be found. Sep 14 08:57:25.985386 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:57:25.988685 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:57:25.988685 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:57:25.988685 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:57:25.988685 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:57:25.988685 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:57:25.988685 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:57:25.988685 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:57:25.988685 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf59291e-0a19-499b-a95b-a76d82b5e307 could not be found. Sep 14 08:57:25.988685 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:57:25.990557 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f7593eb4-4977-4be0-8a9c-4ae7b8559fe0 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Returning 404 to user: Instance bf59291e-0a19-499b-a95b-a76d82b5e307 could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:57:25.991643 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f7593eb4-4977-4be0-8a9c-4ae7b8559fe0 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/bf59291e-0a19-499b-a95b-a76d82b5e307" status: 404 len: 111 microversion: 2.25 time: 0.082864 Sep 14 08:57:25.992393 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 992/2030] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:57:25 2022] GET /compute/v2.1/servers/bf59291e-0a19-499b-a95b-a76d82b5e307 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 14 08:57:26.001272 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-ba5c720f-95aa-4ecc-919f-9dd350dad3e5 req-a9a7c2c9-4285-4e6d-a4f7-d869b43a93e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8dd1623b-312c-411d-8f6c-b334195e573b", "name": "network-vif-unplugged", "status": "completed", "tag": "558f9bbb-f694-40cf-b969-31f1db110da5"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:57:26.012893 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-ba5c720f-95aa-4ecc-919f-9dd350dad3e5 req-a9a7c2c9-4285-4e6d-a4f7-d869b43a93e2 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:26.014473 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-ba5c720f-95aa-4ecc-919f-9dd350dad3e5 req-a9a7c2c9-4285-4e6d-a4f7-d869b43a93e2 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:26.015115 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-ba5c720f-95aa-4ecc-919f-9dd350dad3e5 req-a9a7c2c9-4285-4e6d-a4f7-d869b43a93e2 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:26.028789 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-ba5c720f-95aa-4ecc-919f-9dd350dad3e5 req-a9a7c2c9-4285-4e6d-a4f7-d869b43a93e2 service nova] Creating event network-vif-unplugged:558f9bbb-f694-40cf-b969-31f1db110da5 for instance 8dd1623b-312c-411d-8f6c-b334195e573b on n-h2-836830-18 Sep 14 08:57:26.036323 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-ba5c720f-95aa-4ecc-919f-9dd350dad3e5 req-a9a7c2c9-4285-4e6d-a4f7-d869b43a93e2 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042546 Sep 14 08:57:26.037464 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 993/2031] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:57:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:57:26.042858 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-67d652c1-c279-428f-824c-9a9f9d0bf4ab tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:26.043793 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-67d652c1-c279-428f-824c-9a9f9d0bf4ab tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 2334f491-8233-4171-906f-e0c46d0a3fb2] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:26.050557 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-67d652c1-c279-428f-824c-9a9f9d0bf4ab tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:26.051357 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-67d652c1-c279-428f-824c-9a9f9d0bf4ab tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:26.051947 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-67d652c1-c279-428f-824c-9a9f9d0bf4ab tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:26.053277 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-67d652c1-c279-428f-824c-9a9f9d0bf4ab tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:26.053883 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-67d652c1-c279-428f-824c-9a9f9d0bf4ab tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:26.054455 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-67d652c1-c279-428f-824c-9a9f9d0bf4ab tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:26.377847 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-67d652c1-c279-428f-824c-9a9f9d0bf4ab tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:26.385586 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-67d652c1-c279-428f-824c-9a9f9d0bf4ab tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/2334f491-8233-4171-906f-e0c46d0a3fb2" status: 200 len: 1308 microversion: 2.1 time: 0.346806 Sep 14 08:57:26.386154 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 994/2032] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:57:26 2022] GET /compute/v2.1/servers/2334f491-8233-4171-906f-e0c46d0a3fb2 => generated 1308 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:57:26.391636 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-5e5046dc-b9fd-4ade-a60d-e1ce9a9ddf16 req-378fd6eb-ef17-40e5-97d0-ca4522f55a84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2334f491-8233-4171-906f-e0c46d0a3fb2", "tag": "c3659fbf-543f-406c-a683-9c6642e323fe"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:57:26.400064 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-5e5046dc-b9fd-4ade-a60d-e1ce9a9ddf16 req-378fd6eb-ef17-40e5-97d0-ca4522f55a84 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:26.400542 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-5e5046dc-b9fd-4ade-a60d-e1ce9a9ddf16 req-378fd6eb-ef17-40e5-97d0-ca4522f55a84 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:26.400968 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-5e5046dc-b9fd-4ade-a60d-e1ce9a9ddf16 req-378fd6eb-ef17-40e5-97d0-ca4522f55a84 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:26.412342 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-5e5046dc-b9fd-4ade-a60d-e1ce9a9ddf16 req-378fd6eb-ef17-40e5-97d0-ca4522f55a84 service nova] Creating event network-changed:c3659fbf-543f-406c-a683-9c6642e323fe for instance 2334f491-8233-4171-906f-e0c46d0a3fb2 on n-h1-836830-18 Sep 14 08:57:26.417107 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-5e5046dc-b9fd-4ade-a60d-e1ce9a9ddf16 req-378fd6eb-ef17-40e5-97d0-ca4522f55a84 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029862 Sep 14 08:57:26.417686 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 995/2033] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:57:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:57:26.422690 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ea0d7d72-2438-4ada-a65d-d0b0f8871eec tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:26.423417 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-ea0d7d72-2438-4ada-a65d-d0b0f8871eec tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] [instance: 59f196e8-c202-4073-8663-2ae19358a044] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:26.425286 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:57:26.430641 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ea0d7d72-2438-4ada-a65d-d0b0f8871eec tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:26.431162 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ea0d7d72-2438-4ada-a65d-d0b0f8871eec tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:26.431867 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ea0d7d72-2438-4ada-a65d-d0b0f8871eec tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:26.432759 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ea0d7d72-2438-4ada-a65d-d0b0f8871eec tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:26.433219 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ea0d7d72-2438-4ada-a65d-d0b0f8871eec tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:26.433652 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ea0d7d72-2438-4ada-a65d-d0b0f8871eec tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:26.786043 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-ea0d7d72-2438-4ada-a65d-d0b0f8871eec tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:26.795852 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-ea0d7d72-2438-4ada-a65d-d0b0f8871eec tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:26.797543 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-ea0d7d72-2438-4ada-a65d-d0b0f8871eec tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:26.798847 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-ea0d7d72-2438-4ada-a65d-d0b0f8871eec tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] 10.222.0.60 "GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044" status: 200 len: 1877 microversion: 2.42 time: 0.379981 Sep 14 08:57:26.799438 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 996/2034] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:57:26 2022] GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044 => generated 1877 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:57:26.804430 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a4178e62-6627-4455-ad67-4e7f622223dc tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:26.804929 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-a4178e62-6627-4455-ad67-4e7f622223dc tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: 5059f5d9-6903-4cf4-a999-01d2d2ba0842] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:26.811384 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a4178e62-6627-4455-ad67-4e7f622223dc tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:26.811877 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a4178e62-6627-4455-ad67-4e7f622223dc tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:26.812315 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a4178e62-6627-4455-ad67-4e7f622223dc tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:26.813008 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a4178e62-6627-4455-ad67-4e7f622223dc tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:26.813464 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a4178e62-6627-4455-ad67-4e7f622223dc tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:26.813887 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a4178e62-6627-4455-ad67-4e7f622223dc tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:26.839625 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-a4178e62-6627-4455-ad67-4e7f622223dc tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: 5059f5d9-6903-4cf4-a999-01d2d2ba0842] Going to try to terminate instance {{(pid=128759) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 08:57:26.917882 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a4178e62-6627-4455-ad67-4e7f622223dc tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "DELETE /compute/v2.1/servers/5059f5d9-6903-4cf4-a999-01d2d2ba0842" status: 204 len: 0 microversion: 2.25 time: 0.116723 Sep 14 08:57:26.921728 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 997/2035] 10.222.0.60 () {60 vars in 1280 bytes} [Wed Sep 14 08:57:26 2022] DELETE /compute/v2.1/servers/5059f5d9-6903-4cf4-a999-01d2d2ba0842 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 14 08:57:26.929483 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-4d1a0537-bd66-47fd-98df-2c48e65cb691 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:26.929483 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-4d1a0537-bd66-47fd-98df-2c48e65cb691 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: ad55193e-b097-4372-9a00-972ed2b486f8] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:26.935327 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4d1a0537-bd66-47fd-98df-2c48e65cb691 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:26.935847 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4d1a0537-bd66-47fd-98df-2c48e65cb691 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:26.936290 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4d1a0537-bd66-47fd-98df-2c48e65cb691 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:26.936991 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4d1a0537-bd66-47fd-98df-2c48e65cb691 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:26.937444 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4d1a0537-bd66-47fd-98df-2c48e65cb691 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:26.937872 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4d1a0537-bd66-47fd-98df-2c48e65cb691 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:27.255101 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-4d1a0537-bd66-47fd-98df-2c48e65cb691 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:27.263400 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-4d1a0537-bd66-47fd-98df-2c48e65cb691 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/ad55193e-b097-4372-9a00-972ed2b486f8" status: 200 len: 1383 microversion: 2.1 time: 0.340533 Sep 14 08:57:27.264796 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 998/2036] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:57:26 2022] GET /compute/v2.1/servers/ad55193e-b097-4372-9a00-972ed2b486f8 => generated 1383 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:57:27.269418 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ef0c3f17-db40-4ca8-a2f0-2c82d2c4aa78 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:27.270124 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-ef0c3f17-db40-4ca8-a2f0-2c82d2c4aa78 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: 5059f5d9-6903-4cf4-a999-01d2d2ba0842] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:27.276329 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ef0c3f17-db40-4ca8-a2f0-2c82d2c4aa78 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:27.276907 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ef0c3f17-db40-4ca8-a2f0-2c82d2c4aa78 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:27.277403 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ef0c3f17-db40-4ca8-a2f0-2c82d2c4aa78 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:27.278159 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ef0c3f17-db40-4ca8-a2f0-2c82d2c4aa78 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:27.278832 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ef0c3f17-db40-4ca8-a2f0-2c82d2c4aa78 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:27.279469 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ef0c3f17-db40-4ca8-a2f0-2c82d2c4aa78 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:27.630762 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-ef0c3f17-db40-4ca8-a2f0-2c82d2c4aa78 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:27.638989 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-ef0c3f17-db40-4ca8-a2f0-2c82d2c4aa78 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:27.641023 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-ef0c3f17-db40-4ca8-a2f0-2c82d2c4aa78 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:27.642195 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-ef0c3f17-db40-4ca8-a2f0-2c82d2c4aa78 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/5059f5d9-6903-4cf4-a999-01d2d2ba0842" status: 200 len: 1562 microversion: 2.25 time: 0.376630 Sep 14 08:57:27.642763 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 999/2037] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:57:27 2022] GET /compute/v2.1/servers/5059f5d9-6903-4cf4-a999-01d2d2ba0842 => generated 1562 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:57:27.647309 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e74c3f56-c3da-4539-b1aa-6c765845b41c tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:27.647894 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e74c3f56-c3da-4539-b1aa-6c765845b41c tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] [instance: 8dd1623b-312c-411d-8f6c-b334195e573b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:27.654374 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e74c3f56-c3da-4539-b1aa-6c765845b41c tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:27.654859 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e74c3f56-c3da-4539-b1aa-6c765845b41c tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:27.655339 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e74c3f56-c3da-4539-b1aa-6c765845b41c tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:27.656044 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e74c3f56-c3da-4539-b1aa-6c765845b41c tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:27.656508 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e74c3f56-c3da-4539-b1aa-6c765845b41c tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:27.656942 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e74c3f56-c3da-4539-b1aa-6c765845b41c tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:28.185533 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-e74c3f56-c3da-4539-b1aa-6c765845b41c tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab2d64c1cb447f9bfd658408aa07e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ecc8c1389847c7bcd9cd5570d990e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:28.194905 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e74c3f56-c3da-4539-b1aa-6c765845b41c tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] 10.222.0.60 "GET /compute/v2.1/servers/8dd1623b-312c-411d-8f6c-b334195e573b" status: 200 len: 1479 microversion: 2.1 time: 0.551027 Sep 14 08:57:28.207147 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1000/2038] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:57:27 2022] GET /compute/v2.1/servers/8dd1623b-312c-411d-8f6c-b334195e573b => generated 1479 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:57:28.207147 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-cb0eb133-e630-48d7-a27e-a8e46105d075 req-016a7b55-efaf-4b69-9bcb-31a0533b43af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59f196e8-c202-4073-8663-2ae19358a044", "tag": "b45cf031-1a7e-40d4-99f8-072f0326a8e0"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:57:28.210436 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-cb0eb133-e630-48d7-a27e-a8e46105d075 req-016a7b55-efaf-4b69-9bcb-31a0533b43af service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:28.210914 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-cb0eb133-e630-48d7-a27e-a8e46105d075 req-016a7b55-efaf-4b69-9bcb-31a0533b43af service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:28.211361 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-cb0eb133-e630-48d7-a27e-a8e46105d075 req-016a7b55-efaf-4b69-9bcb-31a0533b43af service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:28.222651 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-cb0eb133-e630-48d7-a27e-a8e46105d075 req-016a7b55-efaf-4b69-9bcb-31a0533b43af service nova] Creating event network-changed:b45cf031-1a7e-40d4-99f8-072f0326a8e0 for instance 59f196e8-c202-4073-8663-2ae19358a044 on n-h2-836830-18 Sep 14 08:57:28.228144 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-cb0eb133-e630-48d7-a27e-a8e46105d075 req-016a7b55-efaf-4b69-9bcb-31a0533b43af service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031036 Sep 14 08:57:28.228745 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1001/2039] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:57:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:57:28.234346 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b6c14c1d-388b-4d5d-bb6c-2563a01d3b2b tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:28.235066 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b6c14c1d-388b-4d5d-bb6c-2563a01d3b2b tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] [instance: ad55193e-b097-4372-9a00-972ed2b486f8] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:28.241647 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b6c14c1d-388b-4d5d-bb6c-2563a01d3b2b tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:28.242132 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b6c14c1d-388b-4d5d-bb6c-2563a01d3b2b tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:28.242567 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b6c14c1d-388b-4d5d-bb6c-2563a01d3b2b tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:28.243284 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b6c14c1d-388b-4d5d-bb6c-2563a01d3b2b tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:28.243735 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b6c14c1d-388b-4d5d-bb6c-2563a01d3b2b tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:28.244189 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b6c14c1d-388b-4d5d-bb6c-2563a01d3b2b tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:28.259170 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:57:28.521891 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b6c14c1d-388b-4d5d-bb6c-2563a01d3b2b tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/ad55193e-b097-4372-9a00-972ed2b486f8" status: 200 len: 1536 microversion: 2.1 time: 0.291980 Sep 14 08:57:28.522471 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1002/2040] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:57:28 2022] GET /compute/v2.1/servers/ad55193e-b097-4372-9a00-972ed2b486f8 => generated 1536 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:57:28.526971 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-00b5e48d-a4b8-4548-b6b2-843092cc15e6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:28.527595 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-00b5e48d-a4b8-4548-b6b2-843092cc15e6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 2334f491-8233-4171-906f-e0c46d0a3fb2] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:28.534227 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-00b5e48d-a4b8-4548-b6b2-843092cc15e6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:28.534722 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-00b5e48d-a4b8-4548-b6b2-843092cc15e6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:28.535200 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-00b5e48d-a4b8-4548-b6b2-843092cc15e6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:28.535908 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-00b5e48d-a4b8-4548-b6b2-843092cc15e6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:28.536366 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-00b5e48d-a4b8-4548-b6b2-843092cc15e6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:28.536799 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-00b5e48d-a4b8-4548-b6b2-843092cc15e6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:28.660365 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-29d37939-de19-4873-8a93-0ef5d326d218 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Flavor limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 08:57:28.660821 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-29d37939-de19-4873-8a93-0ef5d326d218 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Image limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 08:57:28.661267 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-29d37939-de19-4873-8a93-0ef5d326d218 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Flavor pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 08:57:28.661673 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-29d37939-de19-4873-8a93-0ef5d326d218 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Image pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 08:57:28.662081 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-29d37939-de19-4873-8a93-0ef5d326d218 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 08:57:28.672214 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-29d37939-de19-4873-8a93-0ef5d326d218 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:28.672692 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-29d37939-de19-4873-8a93-0ef5d326d218 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:28.673127 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-29d37939-de19-4873-8a93-0ef5d326d218 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:28.673849 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-29d37939-de19-4873-8a93-0ef5d326d218 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:28.674298 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-29d37939-de19-4873-8a93-0ef5d326d218 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:28.674713 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-29d37939-de19-4873-8a93-0ef5d326d218 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:28.692784 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-29d37939-de19-4873-8a93-0ef5d326d218 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Getting quotas for project 46a1734368204db58d9d7572726d2794. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 08:57:28.698084 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-29d37939-de19-4873-8a93-0ef5d326d218 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Getting quotas for user 87d4eb547eeb475185d097f03049ccde and project 46a1734368204db58d9d7572726d2794. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 08:57:28.778438 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-00b5e48d-a4b8-4548-b6b2-843092cc15e6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:28.787776 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-00b5e48d-a4b8-4548-b6b2-843092cc15e6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/2334f491-8233-4171-906f-e0c46d0a3fb2" status: 200 len: 1308 microversion: 2.1 time: 0.264261 Sep 14 08:57:28.795612 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1003/2041] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:57:28 2022] GET /compute/v2.1/servers/2334f491-8233-4171-906f-e0c46d0a3fb2 => generated 1308 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:57:28.799083 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b80bc9bd-faa0-4132-9bb4-3fa7f300da18 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:28.799653 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b80bc9bd-faa0-4132-9bb4-3fa7f300da18 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] [instance: 59f196e8-c202-4073-8663-2ae19358a044] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:28.806044 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b80bc9bd-faa0-4132-9bb4-3fa7f300da18 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:28.806734 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b80bc9bd-faa0-4132-9bb4-3fa7f300da18 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:28.807200 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b80bc9bd-faa0-4132-9bb4-3fa7f300da18 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:28.807897 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b80bc9bd-faa0-4132-9bb4-3fa7f300da18 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:28.808752 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b80bc9bd-faa0-4132-9bb4-3fa7f300da18 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:28.808876 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b80bc9bd-faa0-4132-9bb4-3fa7f300da18 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:28.867549 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-29d37939-de19-4873-8a93-0ef5d326d218 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Going to run 1 instances... {{(pid=128758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 08:57:28.870436 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-29d37939-de19-4873-8a93-0ef5d326d218 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] [instance: 26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='b696f835-d977-45f1-a8f8-de0f650b4d23',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='88e6b863-9248-4779-80bb-61179e4ab86c',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='35b71245-2621-43eb-8c49-b535226a9f96',volume_size=None,volume_type=None)] {{(pid=128758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 08:57:29.101187 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b80bc9bd-faa0-4132-9bb4-3fa7f300da18 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:29.112995 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b80bc9bd-faa0-4132-9bb4-3fa7f300da18 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:29.115000 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b80bc9bd-faa0-4132-9bb4-3fa7f300da18 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:29.116243 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b80bc9bd-faa0-4132-9bb4-3fa7f300da18 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] 10.222.0.60 "GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044" status: 200 len: 1877 microversion: 2.42 time: 0.326775 Sep 14 08:57:29.116807 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1004/2042] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:57:28 2022] GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044 => generated 1877 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:57:29.135638 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-339d7a9d-fa58-4ab2-819f-3b380b10420f req-05e000e5-683a-4413-ae26-727334b4fa1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8dd1623b-312c-411d-8f6c-b334195e573b", "name": "network-vif-plugged", "status": "completed", "tag": "558f9bbb-f694-40cf-b969-31f1db110da5"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:57:29.147014 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-339d7a9d-fa58-4ab2-819f-3b380b10420f req-05e000e5-683a-4413-ae26-727334b4fa1a service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:29.147713 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-339d7a9d-fa58-4ab2-819f-3b380b10420f req-05e000e5-683a-4413-ae26-727334b4fa1a service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:29.148295 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-339d7a9d-fa58-4ab2-819f-3b380b10420f req-05e000e5-683a-4413-ae26-727334b4fa1a service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:29.164781 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-339d7a9d-fa58-4ab2-819f-3b380b10420f req-05e000e5-683a-4413-ae26-727334b4fa1a service nova] Creating event network-vif-plugged:558f9bbb-f694-40cf-b969-31f1db110da5 for instance 8dd1623b-312c-411d-8f6c-b334195e573b on n-h2-836830-18 Sep 14 08:57:29.170920 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-339d7a9d-fa58-4ab2-819f-3b380b10420f req-05e000e5-683a-4413-ae26-727334b4fa1a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052008 Sep 14 08:57:29.171917 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1005/2043] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:57:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:57:29.177078 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f891a303-ee3f-458d-8b1a-83c5aa83ad6a tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:29.177793 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f891a303-ee3f-458d-8b1a-83c5aa83ad6a tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] [instance: ad55193e-b097-4372-9a00-972ed2b486f8] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:29.185493 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f891a303-ee3f-458d-8b1a-83c5aa83ad6a tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:29.186018 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f891a303-ee3f-458d-8b1a-83c5aa83ad6a tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:29.186561 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f891a303-ee3f-458d-8b1a-83c5aa83ad6a tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:29.187174 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f891a303-ee3f-458d-8b1a-83c5aa83ad6a tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:29.187818 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f891a303-ee3f-458d-8b1a-83c5aa83ad6a tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:29.188405 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f891a303-ee3f-458d-8b1a-83c5aa83ad6a tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:29.241692 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-29d37939-de19-4873-8a93-0ef5d326d218 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.32 time: 6.366420 Sep 14 08:57:29.243281 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1039/2044] 10.222.0.60 () {62 vars in 1189 bytes} [Wed Sep 14 08:57:22 2022] POST /compute/v2.1/servers => generated 406 bytes in 6369 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 14 08:57:29.249337 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b83b4105-5333-4e8b-9d96-897dba13012e tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:29.250765 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-b83b4105-5333-4e8b-9d96-897dba13012e tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: 5059f5d9-6903-4cf4-a999-01d2d2ba0842] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:29.258221 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b83b4105-5333-4e8b-9d96-897dba13012e tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:29.259360 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b83b4105-5333-4e8b-9d96-897dba13012e tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:29.259988 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b83b4105-5333-4e8b-9d96-897dba13012e tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:29.261012 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b83b4105-5333-4e8b-9d96-897dba13012e tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:29.263148 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b83b4105-5333-4e8b-9d96-897dba13012e tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:29.263753 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b83b4105-5333-4e8b-9d96-897dba13012e tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:29.429123 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f891a303-ee3f-458d-8b1a-83c5aa83ad6a tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/ad55193e-b097-4372-9a00-972ed2b486f8" status: 200 len: 1536 microversion: 2.1 time: 0.255980 Sep 14 08:57:29.429798 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1006/2045] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:57:29 2022] GET /compute/v2.1/servers/ad55193e-b097-4372-9a00-972ed2b486f8 => generated 1536 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:57:29.435425 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e4a0ca04-19f4-4440-a9eb-6cbe67baf3b3 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:29.436631 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e4a0ca04-19f4-4440-a9eb-6cbe67baf3b3 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] [instance: 8dd1623b-312c-411d-8f6c-b334195e573b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:29.443679 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e4a0ca04-19f4-4440-a9eb-6cbe67baf3b3 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:29.444497 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e4a0ca04-19f4-4440-a9eb-6cbe67baf3b3 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:29.445102 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e4a0ca04-19f4-4440-a9eb-6cbe67baf3b3 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:29.446033 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e4a0ca04-19f4-4440-a9eb-6cbe67baf3b3 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:29.447061 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e4a0ca04-19f4-4440-a9eb-6cbe67baf3b3 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:29.447656 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e4a0ca04-19f4-4440-a9eb-6cbe67baf3b3 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:29.542233 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-b83b4105-5333-4e8b-9d96-897dba13012e tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:29.552514 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-b83b4105-5333-4e8b-9d96-897dba13012e tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:29.554210 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-b83b4105-5333-4e8b-9d96-897dba13012e tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:29.555783 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-b83b4105-5333-4e8b-9d96-897dba13012e tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/5059f5d9-6903-4cf4-a999-01d2d2ba0842" status: 200 len: 1562 microversion: 2.25 time: 0.311403 Sep 14 08:57:29.556983 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1040/2046] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:57:29 2022] GET /compute/v2.1/servers/5059f5d9-6903-4cf4-a999-01d2d2ba0842 => generated 1562 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:57:29.571398 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-17873f5b-3195-425e-8ca6-b8810849f253 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:29.575002 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-17873f5b-3195-425e-8ca6-b8810849f253 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] [instance: 26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:29.631188 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-e4a0ca04-19f4-4440-a9eb-6cbe67baf3b3 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab2d64c1cb447f9bfd658408aa07e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ecc8c1389847c7bcd9cd5570d990e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:29.639563 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e4a0ca04-19f4-4440-a9eb-6cbe67baf3b3 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] 10.222.0.60 "GET /compute/v2.1/servers/8dd1623b-312c-411d-8f6c-b334195e573b" status: 200 len: 1479 microversion: 2.1 time: 0.208077 Sep 14 08:57:29.640188 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1007/2047] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:57:29 2022] GET /compute/v2.1/servers/8dd1623b-312c-411d-8f6c-b334195e573b => generated 1479 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:57:29.655276 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f0cf9479-e097-4234-8b1a-a4794ccd0e14 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:29.655276 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f0cf9479-e097-4234-8b1a-a4794ccd0e14 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:29.655276 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f0cf9479-e097-4234-8b1a-a4794ccd0e14 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:29.655276 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f0cf9479-e097-4234-8b1a-a4794ccd0e14 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:29.655276 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f0cf9479-e097-4234-8b1a-a4794ccd0e14 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:29.655276 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f0cf9479-e097-4234-8b1a-a4794ccd0e14 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:29.655276 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f0cf9479-e097-4234-8b1a-a4794ccd0e14 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:29.656667 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-17873f5b-3195-425e-8ca6-b8810849f253 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:29.671127 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-17873f5b-3195-425e-8ca6-b8810849f253 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:29.675043 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f0cf9479-e097-4234-8b1a-a4794ccd0e14 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.033788 Sep 14 08:57:29.675836 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1008/2048] 10.222.0.60 () {58 vars in 1176 bytes} [Wed Sep 14 08:57:29 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:57:29.682065 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-17873f5b-3195-425e-8ca6-b8810849f253 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:29.686219 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-17873f5b-3195-425e-8ca6-b8810849f253 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] 10.222.0.60 "GET /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0" status: 200 len: 1286 microversion: 2.32 time: 0.118911 Sep 14 08:57:29.688416 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1041/2049] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:57:29 2022] GET /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0 => generated 1286 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:57:29.703109 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-588fa552-e045-4212-9e82-c77cd6118890 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-836830-18", "block_migration": false, "disk_over_commit": false}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:57:29.703109 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-588fa552-e045-4212-9e82-c77cd6118890 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] [instance: ad55193e-b097-4372-9a00-972ed2b486f8] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:29.703109 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-588fa552-e045-4212-9e82-c77cd6118890 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:29.703109 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-588fa552-e045-4212-9e82-c77cd6118890 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:29.703109 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-588fa552-e045-4212-9e82-c77cd6118890 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:29.703109 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-588fa552-e045-4212-9e82-c77cd6118890 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:29.703109 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-588fa552-e045-4212-9e82-c77cd6118890 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:29.703109 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-588fa552-e045-4212-9e82-c77cd6118890 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:29.737058 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.objects.instance [None req-588fa552-e045-4212-9e82-c77cd6118890 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Lazy-loading 'flavor' on Instance uuid ad55193e-b097-4372-9a00-972ed2b486f8 {{(pid=128759) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 08:57:29.753742 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-588fa552-e045-4212-9e82-c77cd6118890 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] [instance: ad55193e-b097-4372-9a00-972ed2b486f8] Going to try to live migrate instance to n-h2-836830-18 {{(pid=128759) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 14 08:57:29.813161 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-74857698-0374-46ea-b09d-eb282c5a0595 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:29.813592 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-74857698-0374-46ea-b09d-eb282c5a0595 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 2334f491-8233-4171-906f-e0c46d0a3fb2] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:29.826380 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-74857698-0374-46ea-b09d-eb282c5a0595 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:29.827047 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-74857698-0374-46ea-b09d-eb282c5a0595 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:29.827574 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-74857698-0374-46ea-b09d-eb282c5a0595 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:29.828374 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-74857698-0374-46ea-b09d-eb282c5a0595 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:29.828826 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-74857698-0374-46ea-b09d-eb282c5a0595 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:29.829424 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-74857698-0374-46ea-b09d-eb282c5a0595 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:30.125732 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-74857698-0374-46ea-b09d-eb282c5a0595 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:30.140920 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-74857698-0374-46ea-b09d-eb282c5a0595 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/2334f491-8233-4171-906f-e0c46d0a3fb2" status: 200 len: 1308 microversion: 2.1 time: 0.333585 Sep 14 08:57:30.141522 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1042/2050] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:57:29 2022] GET /compute/v2.1/servers/2334f491-8233-4171-906f-e0c46d0a3fb2 => generated 1308 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:57:30.150230 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-5342d402-686a-4036-bda4-5f4b27fe3996 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:30.153059 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-5342d402-686a-4036-bda4-5f4b27fe3996 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] [instance: 59f196e8-c202-4073-8663-2ae19358a044] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:30.169997 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5342d402-686a-4036-bda4-5f4b27fe3996 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:30.170739 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5342d402-686a-4036-bda4-5f4b27fe3996 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:30.172032 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5342d402-686a-4036-bda4-5f4b27fe3996 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:30.173704 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5342d402-686a-4036-bda4-5f4b27fe3996 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:30.174112 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5342d402-686a-4036-bda4-5f4b27fe3996 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:30.176748 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5342d402-686a-4036-bda4-5f4b27fe3996 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:30.791131 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-5342d402-686a-4036-bda4-5f4b27fe3996 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:30.801854 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-5342d402-686a-4036-bda4-5f4b27fe3996 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:30.803875 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-5342d402-686a-4036-bda4-5f4b27fe3996 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:30.805328 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-5342d402-686a-4036-bda4-5f4b27fe3996 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] 10.222.0.60 "GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044" status: 200 len: 1877 microversion: 2.42 time: 0.662340 Sep 14 08:57:30.806666 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1043/2051] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:57:30 2022] GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044 => generated 1877 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:57:30.811975 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-00a56921-870a-44ca-8f5a-9892ef2c54b0 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:30.812921 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-00a56921-870a-44ca-8f5a-9892ef2c54b0 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: 5059f5d9-6903-4cf4-a999-01d2d2ba0842] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:30.819804 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-00a56921-870a-44ca-8f5a-9892ef2c54b0 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:30.820741 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-00a56921-870a-44ca-8f5a-9892ef2c54b0 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:30.827495 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-00a56921-870a-44ca-8f5a-9892ef2c54b0 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:30.828848 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-00a56921-870a-44ca-8f5a-9892ef2c54b0 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:30.829601 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-00a56921-870a-44ca-8f5a-9892ef2c54b0 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:30.830254 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-00a56921-870a-44ca-8f5a-9892ef2c54b0 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:30.961810 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-00a56921-870a-44ca-8f5a-9892ef2c54b0 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:30.972650 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-00a56921-870a-44ca-8f5a-9892ef2c54b0 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:30.974054 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-00a56921-870a-44ca-8f5a-9892ef2c54b0 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f140347422af48a4875e80337a272e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3850954316f34104b2a8052dc78a50d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:30.975246 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-00a56921-870a-44ca-8f5a-9892ef2c54b0 tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/5059f5d9-6903-4cf4-a999-01d2d2ba0842" status: 200 len: 1520 microversion: 2.25 time: 0.167317 Sep 14 08:57:30.984352 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1044/2052] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:57:30 2022] GET /compute/v2.1/servers/5059f5d9-6903-4cf4-a999-01d2d2ba0842 => generated 1520 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:57:30.989319 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-16271e12-7ea3-4124-b629-57e7f9257697 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:30.990420 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-16271e12-7ea3-4124-b629-57e7f9257697 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] [instance: 8dd1623b-312c-411d-8f6c-b334195e573b] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:31.010704 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-16271e12-7ea3-4124-b629-57e7f9257697 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:31.011635 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-16271e12-7ea3-4124-b629-57e7f9257697 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:31.012238 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-16271e12-7ea3-4124-b629-57e7f9257697 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:31.013229 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-16271e12-7ea3-4124-b629-57e7f9257697 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:31.013913 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-16271e12-7ea3-4124-b629-57e7f9257697 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:31.014613 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-16271e12-7ea3-4124-b629-57e7f9257697 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:31.130901 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=6 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:57:31.359993 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-16271e12-7ea3-4124-b629-57e7f9257697 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab2d64c1cb447f9bfd658408aa07e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ecc8c1389847c7bcd9cd5570d990e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:31.375316 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-16271e12-7ea3-4124-b629-57e7f9257697 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] 10.222.0.60 "GET /compute/v2.1/servers/8dd1623b-312c-411d-8f6c-b334195e573b" status: 200 len: 1464 microversion: 2.1 time: 0.386948 Sep 14 08:57:31.378250 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1045/2053] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:57:30 2022] GET /compute/v2.1/servers/8dd1623b-312c-411d-8f6c-b334195e573b => generated 1464 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:57:31.393536 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-3fc61b5e-a4ed-4620-ac9d-e600ef049b7d tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:31.398326 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-3fc61b5e-a4ed-4620-ac9d-e600ef049b7d tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] [instance: 26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:31.414479 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3fc61b5e-a4ed-4620-ac9d-e600ef049b7d tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:31.415302 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3fc61b5e-a4ed-4620-ac9d-e600ef049b7d tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:31.416497 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3fc61b5e-a4ed-4620-ac9d-e600ef049b7d tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:31.417575 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3fc61b5e-a4ed-4620-ac9d-e600ef049b7d tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:31.419140 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3fc61b5e-a4ed-4620-ac9d-e600ef049b7d tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:31.420580 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3fc61b5e-a4ed-4620-ac9d-e600ef049b7d tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:31.538310 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-3fc61b5e-a4ed-4620-ac9d-e600ef049b7d tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:31.548807 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-3fc61b5e-a4ed-4620-ac9d-e600ef049b7d tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:31.550549 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-3fc61b5e-a4ed-4620-ac9d-e600ef049b7d tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:31.551961 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-3fc61b5e-a4ed-4620-ac9d-e600ef049b7d tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] 10.222.0.60 "GET /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0" status: 200 len: 1584 microversion: 2.32 time: 0.171654 Sep 14 08:57:31.563090 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1046/2054] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:57:31 2022] GET /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0 => generated 1584 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:57:31.568649 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-289daa4f-ecc5-429b-981f-9e05c6505c2a req-75061316-db22-4989-86ff-e904ec1340e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5059f5d9-6903-4cf4-a999-01d2d2ba0842", "name": "network-vif-deleted", "tag": "0b18a372-58a0-4acd-a4e8-de3db7d03c42"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:57:31.591160 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-289daa4f-ecc5-429b-981f-9e05c6505c2a req-75061316-db22-4989-86ff-e904ec1340e9 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:31.591654 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-289daa4f-ecc5-429b-981f-9e05c6505c2a req-75061316-db22-4989-86ff-e904ec1340e9 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:31.593063 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-289daa4f-ecc5-429b-981f-9e05c6505c2a req-75061316-db22-4989-86ff-e904ec1340e9 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:31.617196 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-289daa4f-ecc5-429b-981f-9e05c6505c2a req-75061316-db22-4989-86ff-e904ec1340e9 service nova] Creating event network-vif-deleted:0b18a372-58a0-4acd-a4e8-de3db7d03c42 for instance 5059f5d9-6903-4cf4-a999-01d2d2ba0842 on n-h1-836830-18 Sep 14 08:57:31.624051 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-289daa4f-ecc5-429b-981f-9e05c6505c2a req-75061316-db22-4989-86ff-e904ec1340e9 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058392 Sep 14 08:57:31.625570 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1047/2055] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:57:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:57:31.634892 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-7029a354-4cc4-4813-ba38-c7571f604529 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:31.636107 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-7029a354-4cc4-4813-ba38-c7571f604529 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 2334f491-8233-4171-906f-e0c46d0a3fb2] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:31.655148 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7029a354-4cc4-4813-ba38-c7571f604529 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:31.656178 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7029a354-4cc4-4813-ba38-c7571f604529 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:31.656783 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7029a354-4cc4-4813-ba38-c7571f604529 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:31.657790 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7029a354-4cc4-4813-ba38-c7571f604529 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:31.658275 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7029a354-4cc4-4813-ba38-c7571f604529 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:31.658771 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7029a354-4cc4-4813-ba38-c7571f604529 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:31.807296 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-7029a354-4cc4-4813-ba38-c7571f604529 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:31.815665 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-7029a354-4cc4-4813-ba38-c7571f604529 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/2334f491-8233-4171-906f-e0c46d0a3fb2" status: 200 len: 1308 microversion: 2.1 time: 0.187518 Sep 14 08:57:31.818980 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1048/2056] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:57:31 2022] GET /compute/v2.1/servers/2334f491-8233-4171-906f-e0c46d0a3fb2 => generated 1308 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:57:31.820610 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-755f529e-0bb0-4339-ab3f-2e3d4d9ab689 tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:57:31.823047 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-755f529e-0bb0-4339-ab3f-2e3d4d9ab689 tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] [instance: 8dd1623b-312c-411d-8f6c-b334195e573b] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:31.835608 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-755f529e-0bb0-4339-ab3f-2e3d4d9ab689 tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:31.836019 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-755f529e-0bb0-4339-ab3f-2e3d4d9ab689 tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:31.836453 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-755f529e-0bb0-4339-ab3f-2e3d4d9ab689 tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:31.837153 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-755f529e-0bb0-4339-ab3f-2e3d4d9ab689 tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:31.837605 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-755f529e-0bb0-4339-ab3f-2e3d4d9ab689 tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:31.838049 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-755f529e-0bb0-4339-ab3f-2e3d4d9ab689 tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:31.914876 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-755f529e-0bb0-4339-ab3f-2e3d4d9ab689 tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/8dd1623b-312c-411d-8f6c-b334195e573b/action" status: 202 len: 0 microversion: 2.1 time: 0.097518 Sep 14 08:57:31.916503 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1049/2057] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 08:57:31 2022] POST /compute/v2.1/servers/8dd1623b-312c-411d-8f6c-b334195e573b/action => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 08:57:31.922157 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-2fe2f94e-c6bc-4b1f-8835-0daf6675a824 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:31.923056 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-2fe2f94e-c6bc-4b1f-8835-0daf6675a824 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] [instance: 59f196e8-c202-4073-8663-2ae19358a044] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:31.929416 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2fe2f94e-c6bc-4b1f-8835-0daf6675a824 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:31.929907 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2fe2f94e-c6bc-4b1f-8835-0daf6675a824 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:31.930337 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2fe2f94e-c6bc-4b1f-8835-0daf6675a824 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:31.931070 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2fe2f94e-c6bc-4b1f-8835-0daf6675a824 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:31.931795 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2fe2f94e-c6bc-4b1f-8835-0daf6675a824 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:31.932221 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2fe2f94e-c6bc-4b1f-8835-0daf6675a824 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:31.986416 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-588fa552-e045-4212-9e82-c77cd6118890 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/ad55193e-b097-4372-9a00-972ed2b486f8/action" status: 202 len: 0 microversion: 2.1 time: 2.301663 Sep 14 08:57:31.990371 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1009/2058] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 08:57:29 2022] POST /compute/v2.1/servers/ad55193e-b097-4372-9a00-972ed2b486f8/action => generated 0 bytes in 2304 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 08:57:31.995156 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a06dff86-614f-440d-891c-ecce0ff440ef tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:31.997544 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-a06dff86-614f-440d-891c-ecce0ff440ef tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] [instance: 8dd1623b-312c-411d-8f6c-b334195e573b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:32.006512 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a06dff86-614f-440d-891c-ecce0ff440ef tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:32.007168 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a06dff86-614f-440d-891c-ecce0ff440ef tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:32.007803 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a06dff86-614f-440d-891c-ecce0ff440ef tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:32.008669 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a06dff86-614f-440d-891c-ecce0ff440ef tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:32.009480 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a06dff86-614f-440d-891c-ecce0ff440ef tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:32.010159 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a06dff86-614f-440d-891c-ecce0ff440ef tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:32.052293 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a06dff86-614f-440d-891c-ecce0ff440ef tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:32.052923 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a06dff86-614f-440d-891c-ecce0ff440ef tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:32.053469 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a06dff86-614f-440d-891c-ecce0ff440ef tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:32.054034 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.objects.instance [None req-a06dff86-614f-440d-891c-ecce0ff440ef tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] Lazy-loading 'fault' on Instance uuid 8dd1623b-312c-411d-8f6c-b334195e573b {{(pid=128759) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 08:57:32.630559 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-2fe2f94e-c6bc-4b1f-8835-0daf6675a824 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:32.640950 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-2fe2f94e-c6bc-4b1f-8835-0daf6675a824 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:32.642648 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-2fe2f94e-c6bc-4b1f-8835-0daf6675a824 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:32.644713 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-2fe2f94e-c6bc-4b1f-8835-0daf6675a824 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] 10.222.0.60 "GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044" status: 200 len: 1877 microversion: 2.42 time: 0.727151 Sep 14 08:57:32.645748 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1050/2059] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:57:31 2022] GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044 => generated 1877 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:57:32.650706 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-e3158c4c-7535-4883-bd94-2ae4eef4be2e tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:32.652275 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-e3158c4c-7535-4883-bd94-2ae4eef4be2e tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: ad55193e-b097-4372-9a00-972ed2b486f8] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:32.658844 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e3158c4c-7535-4883-bd94-2ae4eef4be2e tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:32.659650 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e3158c4c-7535-4883-bd94-2ae4eef4be2e tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:32.660504 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e3158c4c-7535-4883-bd94-2ae4eef4be2e tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:32.662314 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e3158c4c-7535-4883-bd94-2ae4eef4be2e tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:32.663365 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e3158c4c-7535-4883-bd94-2ae4eef4be2e tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:32.664013 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e3158c4c-7535-4883-bd94-2ae4eef4be2e tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:32.675740 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a06dff86-614f-440d-891c-ecce0ff440ef tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/8dd1623b-312c-411d-8f6c-b334195e573b" status: 200 len: 1600 microversion: 2.1 time: 0.685372 Sep 14 08:57:32.676814 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1010/2060] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:57:31 2022] GET /compute/v2.1/servers/8dd1623b-312c-411d-8f6c-b334195e573b => generated 1600 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:57:32.698194 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-37646dac-4566-491e-99f5-34f911010d0b tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:32.702612 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-37646dac-4566-491e-99f5-34f911010d0b tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] [instance: 5059f5d9-6903-4cf4-a999-01d2d2ba0842] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:32.709765 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-37646dac-4566-491e-99f5-34f911010d0b tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:32.710470 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-37646dac-4566-491e-99f5-34f911010d0b tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:32.710912 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-37646dac-4566-491e-99f5-34f911010d0b tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:32.713631 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-37646dac-4566-491e-99f5-34f911010d0b tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:32.714270 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-37646dac-4566-491e-99f5-34f911010d0b tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:32.714854 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-37646dac-4566-491e-99f5-34f911010d0b tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:32.731529 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-37646dac-4566-491e-99f5-34f911010d0b tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] HTTP exception thrown: Instance 5059f5d9-6903-4cf4-a999-01d2d2ba0842 could not be found. Sep 14 08:57:32.734836 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-37646dac-4566-491e-99f5-34f911010d0b tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Request method failure captured: Sep 14 08:57:32.734836 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/5059f5d9-6903-4cf4-a999-01d2d2ba0842 HTTP/1.1 Sep 14 08:57:32.734836 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 08:57:32.734836 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 08:57:32.734836 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 08:57:32.734836 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 08:57:32.734836 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 08:57:32.734836 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 08:57:32.734836 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 08:57:32.734836 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 08:57:32.734836 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZWl4sBr1-d0zWhOP1VypmcD37g65YKSC98adzDQksMynj67ZC5PVg2lSGT7NPp4LurGErQYTxYBVsDHD4XQgru2ajc5ixBy1mw1M3HnxJNE70omFE3tV833Q-dw3mlJAdgpOXexlM7Fuhn3BkTG0VioZq-vGusZTnLGxd-pf99Y8Xw Sep 14 08:57:32.734836 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 08:57:32.734836 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 08:57:32.734836 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 08:57:32.734836 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 08:57:32.734836 n-d-836830-18 devstack@n-api.service[128759]: X-Openstack-Nova-Api-Version: 2.25 Sep 14 08:57:32.734836 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 08:57:32.734836 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 08:57:32.734836 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 3850954316f34104b2a8052dc78a50d7 Sep 14 08:57:32.734836 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1232302418 Sep 14 08:57:32.734836 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 08:57:32.734836 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 08:57:32.734836 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/3850954316f34104b2a8052dc78a50d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_3850954316f34104b2a8052dc78a50d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3850954316f34104b2a8052dc78a50d7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3850954316f34104b2a8052dc78a50d7"}]}] Sep 14 08:57:32.734836 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1232302418 Sep 14 08:57:32.734836 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 3850954316f34104b2a8052dc78a50d7 Sep 14 08:57:32.734836 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1232302418 Sep 14 08:57:32.734836 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-LiveAutoBlockMigrationV225Test-1232302418-project Sep 14 08:57:32.734836 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 08:57:32.734836 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 08:57:32.734836 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: f140347422af48a4875e80337a272e29 Sep 14 08:57:32.734836 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1232302418-project Sep 14 08:57:32.734836 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 08:57:32.734836 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance 5059f5d9-6903-4cf4-a999-01d2d2ba0842 could not be found. Sep 14 08:57:32.734836 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '5059f5d9-6903-4cf4-a999-01d2d2ba0842'} Sep 14 08:57:32.734836 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:57:32.734836 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:57:32.734836 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 08:57:32.734836 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 08:57:32.734836 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 08:57:32.734836 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 08:57:32.734836 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 08:57:32.734836 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 08:57:32.734836 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 08:57:32.734836 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 08:57:32.734836 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5059f5d9-6903-4cf4-a999-01d2d2ba0842 could not be found. Sep 14 08:57:32.734836 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:57:32.734836 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:57:32.734836 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:57:32.734836 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:57:32.734836 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:57:32.734836 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:57:32.734836 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:57:32.734836 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:57:32.734836 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:57:32.734836 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:57:32.734836 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 08:57:32.734836 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 08:57:32.734836 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 08:57:32.734836 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 08:57:32.734836 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 08:57:32.734836 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 08:57:32.734836 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5059f5d9-6903-4cf4-a999-01d2d2ba0842 could not be found. Sep 14 08:57:32.734836 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:57:32.738695 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:57:32.738695 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:57:32.738695 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:57:32.738695 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:57:32.738695 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:57:32.738695 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:57:32.738695 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:57:32.738695 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5059f5d9-6903-4cf4-a999-01d2d2ba0842 could not be found. Sep 14 08:57:32.738695 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:57:32.742706 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-37646dac-4566-491e-99f5-34f911010d0b tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] Returning 404 to user: Instance 5059f5d9-6903-4cf4-a999-01d2d2ba0842 could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:57:32.744442 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-37646dac-4566-491e-99f5-34f911010d0b tempest-LiveAutoBlockMigrationV225Test-1232302418 tempest-LiveAutoBlockMigrationV225Test-1232302418-project] 10.222.0.60 "GET /compute/v2.1/servers/5059f5d9-6903-4cf4-a999-01d2d2ba0842" status: 404 len: 111 microversion: 2.25 time: 0.050509 Sep 14 08:57:32.749472 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1011/2061] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:57:32 2022] GET /compute/v2.1/servers/5059f5d9-6903-4cf4-a999-01d2d2ba0842 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 14 08:57:32.755710 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-835aab66-ff35-4d7e-b112-3cb39c3eca23 req-e0024b8e-561d-453a-8f7c-cdd083efbb77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2334f491-8233-4171-906f-e0c46d0a3fb2", "name": "network-vif-plugged", "status": "completed", "tag": "c3659fbf-543f-406c-a683-9c6642e323fe"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:57:32.767632 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-835aab66-ff35-4d7e-b112-3cb39c3eca23 req-e0024b8e-561d-453a-8f7c-cdd083efbb77 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:32.768320 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-835aab66-ff35-4d7e-b112-3cb39c3eca23 req-e0024b8e-561d-453a-8f7c-cdd083efbb77 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:32.768902 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-835aab66-ff35-4d7e-b112-3cb39c3eca23 req-e0024b8e-561d-453a-8f7c-cdd083efbb77 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:32.787644 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-835aab66-ff35-4d7e-b112-3cb39c3eca23 req-e0024b8e-561d-453a-8f7c-cdd083efbb77 service nova] Creating event network-vif-plugged:c3659fbf-543f-406c-a683-9c6642e323fe for instance 2334f491-8233-4171-906f-e0c46d0a3fb2 on n-h1-836830-18 Sep 14 08:57:32.794174 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-835aab66-ff35-4d7e-b112-3cb39c3eca23 req-e0024b8e-561d-453a-8f7c-cdd083efbb77 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042880 Sep 14 08:57:32.796366 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1012/2062] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:57:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:57:32.802774 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-538059eb-5ebd-4c35-b1d3-ffa40385c5bf tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:32.803523 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-538059eb-5ebd-4c35-b1d3-ffa40385c5bf tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] [instance: 26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:32.812002 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-538059eb-5ebd-4c35-b1d3-ffa40385c5bf tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:32.812724 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-538059eb-5ebd-4c35-b1d3-ffa40385c5bf tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:32.813480 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-538059eb-5ebd-4c35-b1d3-ffa40385c5bf tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:32.814238 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-538059eb-5ebd-4c35-b1d3-ffa40385c5bf tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:32.814857 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-538059eb-5ebd-4c35-b1d3-ffa40385c5bf tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:32.815648 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-538059eb-5ebd-4c35-b1d3-ffa40385c5bf tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:32.974002 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-538059eb-5ebd-4c35-b1d3-ffa40385c5bf tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:32.991283 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-538059eb-5ebd-4c35-b1d3-ffa40385c5bf tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:32.997995 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-538059eb-5ebd-4c35-b1d3-ffa40385c5bf tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:33.001455 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-538059eb-5ebd-4c35-b1d3-ffa40385c5bf tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] 10.222.0.60 "GET /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0" status: 200 len: 1594 microversion: 2.32 time: 0.203736 Sep 14 08:57:33.002043 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1013/2063] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:57:32 2022] GET /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0 => generated 1594 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:57:33.021311 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ccda1137-ad5c-4c75-9df9-7d7e0fbad3e9 tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:57:33.035000 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-ccda1137-ad5c-4c75-9df9-7d7e0fbad3e9 tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] [instance: 8dd1623b-312c-411d-8f6c-b334195e573b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:33.045870 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ccda1137-ad5c-4c75-9df9-7d7e0fbad3e9 tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:33.046164 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-e3158c4c-7535-4883-bd94-2ae4eef4be2e tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:33.047265 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ccda1137-ad5c-4c75-9df9-7d7e0fbad3e9 tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:33.048179 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ccda1137-ad5c-4c75-9df9-7d7e0fbad3e9 tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:33.049180 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ccda1137-ad5c-4c75-9df9-7d7e0fbad3e9 tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:33.049842 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ccda1137-ad5c-4c75-9df9-7d7e0fbad3e9 tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:33.050537 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ccda1137-ad5c-4c75-9df9-7d7e0fbad3e9 tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:33.058496 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-e3158c4c-7535-4883-bd94-2ae4eef4be2e tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/ad55193e-b097-4372-9a00-972ed2b486f8" status: 200 len: 1393 microversion: 2.1 time: 0.411231 Sep 14 08:57:33.059361 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1051/2064] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:57:32 2022] GET /compute/v2.1/servers/ad55193e-b097-4372-9a00-972ed2b486f8 => generated 1393 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:57:33.070840 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1dbb1eac-4610-4a8f-b8bc-f5436887a8b4 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:33.071702 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-1dbb1eac-4610-4a8f-b8bc-f5436887a8b4 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 2334f491-8233-4171-906f-e0c46d0a3fb2] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:33.074823 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:57:33.083209 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1dbb1eac-4610-4a8f-b8bc-f5436887a8b4 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:33.086190 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1dbb1eac-4610-4a8f-b8bc-f5436887a8b4 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:33.086787 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1dbb1eac-4610-4a8f-b8bc-f5436887a8b4 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:33.087793 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1dbb1eac-4610-4a8f-b8bc-f5436887a8b4 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:33.099691 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1dbb1eac-4610-4a8f-b8bc-f5436887a8b4 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:33.100363 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1dbb1eac-4610-4a8f-b8bc-f5436887a8b4 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:33.210425 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-ccda1137-ad5c-4c75-9df9-7d7e0fbad3e9 tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/8dd1623b-312c-411d-8f6c-b334195e573b/action" status: 202 len: 0 microversion: 2.1 time: 0.203417 Sep 14 08:57:33.212867 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1014/2065] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 08:57:33 2022] POST /compute/v2.1/servers/8dd1623b-312c-411d-8f6c-b334195e573b/action => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 08:57:33.227880 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-91488098-74d9-497b-931b-82a8cf17cc4a tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:33.229687 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-91488098-74d9-497b-931b-82a8cf17cc4a tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] [instance: 8dd1623b-312c-411d-8f6c-b334195e573b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:33.245915 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-91488098-74d9-497b-931b-82a8cf17cc4a tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:33.246620 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-91488098-74d9-497b-931b-82a8cf17cc4a tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:33.247129 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-91488098-74d9-497b-931b-82a8cf17cc4a tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:33.248434 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-91488098-74d9-497b-931b-82a8cf17cc4a tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:33.250446 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-91488098-74d9-497b-931b-82a8cf17cc4a tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:33.250898 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-91488098-74d9-497b-931b-82a8cf17cc4a tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:33.467405 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-1dbb1eac-4610-4a8f-b8bc-f5436887a8b4 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:33.475763 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-1dbb1eac-4610-4a8f-b8bc-f5436887a8b4 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/2334f491-8233-4171-906f-e0c46d0a3fb2" status: 200 len: 1308 microversion: 2.1 time: 0.415260 Sep 14 08:57:33.477858 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1052/2066] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:57:33 2022] GET /compute/v2.1/servers/2334f491-8233-4171-906f-e0c46d0a3fb2 => generated 1308 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:57:33.601544 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-91488098-74d9-497b-931b-82a8cf17cc4a tempest-ServersAdminTestJSON-1012526562 tempest-ServersAdminTestJSON-1012526562-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/8dd1623b-312c-411d-8f6c-b334195e573b" status: 200 len: 1617 microversion: 2.1 time: 0.384465 Sep 14 08:57:33.605738 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1015/2067] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:57:33 2022] GET /compute/v2.1/servers/8dd1623b-312c-411d-8f6c-b334195e573b => generated 1617 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:57:33.628721 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-3fe60357-12d4-4b55-9559-91f3a326357d tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:33.629232 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-3fe60357-12d4-4b55-9559-91f3a326357d tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] [instance: e7aa796a-60a2-4d5c-a03c-b4ad0ea73811] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:33.635308 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3fe60357-12d4-4b55-9559-91f3a326357d tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:33.636009 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3fe60357-12d4-4b55-9559-91f3a326357d tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:33.636620 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3fe60357-12d4-4b55-9559-91f3a326357d tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:33.637481 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3fe60357-12d4-4b55-9559-91f3a326357d tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:33.638103 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3fe60357-12d4-4b55-9559-91f3a326357d tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:33.638676 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3fe60357-12d4-4b55-9559-91f3a326357d tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:33.674188 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c1d9a0bc-81df-4d03-bfb9-7b02e9a5b9b4 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:33.675147 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-c1d9a0bc-81df-4d03-bfb9-7b02e9a5b9b4 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] [instance: 59f196e8-c202-4073-8663-2ae19358a044] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:33.676229 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-3fe60357-12d4-4b55-9559-91f3a326357d tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] [instance: e7aa796a-60a2-4d5c-a03c-b4ad0ea73811] Going to try to terminate instance {{(pid=128758) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 08:57:33.683667 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c1d9a0bc-81df-4d03-bfb9-7b02e9a5b9b4 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:33.684166 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c1d9a0bc-81df-4d03-bfb9-7b02e9a5b9b4 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:33.684601 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c1d9a0bc-81df-4d03-bfb9-7b02e9a5b9b4 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:33.685309 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c1d9a0bc-81df-4d03-bfb9-7b02e9a5b9b4 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:33.685813 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c1d9a0bc-81df-4d03-bfb9-7b02e9a5b9b4 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:33.686237 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c1d9a0bc-81df-4d03-bfb9-7b02e9a5b9b4 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:33.757938 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=1,nova_cell1:UPDATE=3 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:57:33.855815 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-3fe60357-12d4-4b55-9559-91f3a326357d tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] 10.222.0.60 "DELETE /compute/v2.1/servers/e7aa796a-60a2-4d5c-a03c-b4ad0ea73811" status: 204 len: 0 microversion: 2.1 time: 0.230673 Sep 14 08:57:33.857000 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1053/2068] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 08:57:33 2022] DELETE /compute/v2.1/servers/e7aa796a-60a2-4d5c-a03c-b4ad0ea73811 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 08:57:33.865886 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-4da2db54-605e-4be3-ac68-5cbdbb55c1f3 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:33.866828 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-4da2db54-605e-4be3-ac68-5cbdbb55c1f3 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] [instance: e7aa796a-60a2-4d5c-a03c-b4ad0ea73811] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:33.876143 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4da2db54-605e-4be3-ac68-5cbdbb55c1f3 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:33.877456 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4da2db54-605e-4be3-ac68-5cbdbb55c1f3 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:33.878052 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4da2db54-605e-4be3-ac68-5cbdbb55c1f3 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:33.878958 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4da2db54-605e-4be3-ac68-5cbdbb55c1f3 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:33.879917 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4da2db54-605e-4be3-ac68-5cbdbb55c1f3 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:33.881835 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4da2db54-605e-4be3-ac68-5cbdbb55c1f3 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:34.284204 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-c1d9a0bc-81df-4d03-bfb9-7b02e9a5b9b4 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:34.306732 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-c1d9a0bc-81df-4d03-bfb9-7b02e9a5b9b4 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:34.310528 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-c1d9a0bc-81df-4d03-bfb9-7b02e9a5b9b4 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:34.313764 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-c1d9a0bc-81df-4d03-bfb9-7b02e9a5b9b4 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] 10.222.0.60 "GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044" status: 200 len: 1877 microversion: 2.42 time: 0.643803 Sep 14 08:57:34.329249 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1016/2069] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:57:33 2022] GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044 => generated 1877 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 08:57:34.330203 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-4da2db54-605e-4be3-ac68-5cbdbb55c1f3 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab2d64c1cb447f9bfd658408aa07e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ecc8c1389847c7bcd9cd5570d990e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:34.342477 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-6e0c96a2-ad21-403f-abd9-02b9b7cc3e1f tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:34.344278 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-6e0c96a2-ad21-403f-abd9-02b9b7cc3e1f tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] [instance: 26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:34.345589 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-4da2db54-605e-4be3-ac68-5cbdbb55c1f3 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] 10.222.0.60 "GET /compute/v2.1/servers/e7aa796a-60a2-4d5c-a03c-b4ad0ea73811" status: 200 len: 1468 microversion: 2.1 time: 0.483673 Sep 14 08:57:34.346746 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1054/2070] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:57:33 2022] GET /compute/v2.1/servers/e7aa796a-60a2-4d5c-a03c-b4ad0ea73811 => generated 1468 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:57:34.353001 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-59a3225b-5422-4d9c-8802-7641c49d931c tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:34.355170 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-59a3225b-5422-4d9c-8802-7641c49d931c tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: ad55193e-b097-4372-9a00-972ed2b486f8] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:34.357276 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6e0c96a2-ad21-403f-abd9-02b9b7cc3e1f tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:34.357827 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6e0c96a2-ad21-403f-abd9-02b9b7cc3e1f tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:34.358283 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6e0c96a2-ad21-403f-abd9-02b9b7cc3e1f tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:34.363574 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6e0c96a2-ad21-403f-abd9-02b9b7cc3e1f tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:34.364186 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-59a3225b-5422-4d9c-8802-7641c49d931c tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:34.364363 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6e0c96a2-ad21-403f-abd9-02b9b7cc3e1f tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:34.364765 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6e0c96a2-ad21-403f-abd9-02b9b7cc3e1f tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:34.366572 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-59a3225b-5422-4d9c-8802-7641c49d931c tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:34.367171 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-59a3225b-5422-4d9c-8802-7641c49d931c tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:34.368665 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-59a3225b-5422-4d9c-8802-7641c49d931c tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:34.369235 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-59a3225b-5422-4d9c-8802-7641c49d931c tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:34.369879 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-59a3225b-5422-4d9c-8802-7641c49d931c tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:34.777486 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-59a3225b-5422-4d9c-8802-7641c49d931c tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:34.792018 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-59a3225b-5422-4d9c-8802-7641c49d931c tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/ad55193e-b097-4372-9a00-972ed2b486f8" status: 200 len: 1393 microversion: 2.1 time: 0.438362 Sep 14 08:57:34.796252 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1055/2071] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:57:34 2022] GET /compute/v2.1/servers/ad55193e-b097-4372-9a00-972ed2b486f8 => generated 1393 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:57:34.805170 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-be288f6f-2b4f-4aaf-a279-8e7683eeabe4 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:34.806229 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-be288f6f-2b4f-4aaf-a279-8e7683eeabe4 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 2334f491-8233-4171-906f-e0c46d0a3fb2] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:34.825304 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-6e0c96a2-ad21-403f-abd9-02b9b7cc3e1f tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:34.829554 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:57:34.831555 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-be288f6f-2b4f-4aaf-a279-8e7683eeabe4 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:34.832432 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-be288f6f-2b4f-4aaf-a279-8e7683eeabe4 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:34.833201 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-be288f6f-2b4f-4aaf-a279-8e7683eeabe4 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:34.834476 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-be288f6f-2b4f-4aaf-a279-8e7683eeabe4 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:34.835763 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-be288f6f-2b4f-4aaf-a279-8e7683eeabe4 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:34.836569 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-be288f6f-2b4f-4aaf-a279-8e7683eeabe4 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:34.854232 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-6e0c96a2-ad21-403f-abd9-02b9b7cc3e1f tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:34.855906 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-6e0c96a2-ad21-403f-abd9-02b9b7cc3e1f tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:34.857140 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-6e0c96a2-ad21-403f-abd9-02b9b7cc3e1f tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] 10.222.0.60 "GET /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0" status: 200 len: 1662 microversion: 2.32 time: 0.526605 Sep 14 08:57:34.877788 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1017/2072] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:57:34 2022] GET /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0 => generated 1662 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:57:35.126607 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-be288f6f-2b4f-4aaf-a279-8e7683eeabe4 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:35.138628 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-be288f6f-2b4f-4aaf-a279-8e7683eeabe4 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/2334f491-8233-4171-906f-e0c46d0a3fb2" status: 200 len: 1488 microversion: 2.1 time: 0.341091 Sep 14 08:57:35.140220 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1056/2073] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:57:34 2022] GET /compute/v2.1/servers/2334f491-8233-4171-906f-e0c46d0a3fb2 => generated 1488 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:57:35.206130 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-4941a9e5-07ec-4f2c-9f7b-e46069d8da09 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-438815376", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "networks": [{"uuid": "238fbc23-0a7b-476b-a552-1a5667de089a"}]}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:57:35.277940 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.network.neutron [None req-4941a9e5-07ec-4f2c-9f7b-e46069d8da09 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] validate_networks() for [('238fbc23-0a7b-476b-a552-1a5667de089a', None, None, None, None, None)] {{(pid=128759) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 08:57:35.345361 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b0e62ce8-6297-45aa-8be5-46060a28c15b tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:35.346021 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-b0e62ce8-6297-45aa-8be5-46060a28c15b tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] [instance: 59f196e8-c202-4073-8663-2ae19358a044] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:35.352424 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b0e62ce8-6297-45aa-8be5-46060a28c15b tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:35.353250 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b0e62ce8-6297-45aa-8be5-46060a28c15b tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:35.353922 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b0e62ce8-6297-45aa-8be5-46060a28c15b tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:35.354841 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b0e62ce8-6297-45aa-8be5-46060a28c15b tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:35.355692 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b0e62ce8-6297-45aa-8be5-46060a28c15b tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:35.356320 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b0e62ce8-6297-45aa-8be5-46060a28c15b tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:36.396659 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-b0e62ce8-6297-45aa-8be5-46060a28c15b tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:36.412492 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-b0e62ce8-6297-45aa-8be5-46060a28c15b tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:36.415698 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-b0e62ce8-6297-45aa-8be5-46060a28c15b tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:36.421702 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-b0e62ce8-6297-45aa-8be5-46060a28c15b tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] 10.222.0.60 "GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044" status: 200 len: 1877 microversion: 2.42 time: 1.080714 Sep 14 08:57:36.422614 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1057/2074] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:57:35 2022] GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044 => generated 1877 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:57:36.431900 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-6ed94241-104c-4ebe-b897-81cf0015c6c6 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:36.432775 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-6ed94241-104c-4ebe-b897-81cf0015c6c6 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] [instance: e7aa796a-60a2-4d5c-a03c-b4ad0ea73811] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:36.457956 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6ed94241-104c-4ebe-b897-81cf0015c6c6 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:36.458455 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6ed94241-104c-4ebe-b897-81cf0015c6c6 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:36.458896 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6ed94241-104c-4ebe-b897-81cf0015c6c6 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:36.459629 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6ed94241-104c-4ebe-b897-81cf0015c6c6 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:36.460085 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6ed94241-104c-4ebe-b897-81cf0015c6c6 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:36.460508 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6ed94241-104c-4ebe-b897-81cf0015c6c6 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:36.647588 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-6ed94241-104c-4ebe-b897-81cf0015c6c6 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab2d64c1cb447f9bfd658408aa07e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ecc8c1389847c7bcd9cd5570d990e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:36.664245 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-6ed94241-104c-4ebe-b897-81cf0015c6c6 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] 10.222.0.60 "GET /compute/v2.1/servers/e7aa796a-60a2-4d5c-a03c-b4ad0ea73811" status: 200 len: 1426 microversion: 2.1 time: 0.240500 Sep 14 08:57:36.665085 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1058/2075] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:57:36 2022] GET /compute/v2.1/servers/e7aa796a-60a2-4d5c-a03c-b4ad0ea73811 => generated 1426 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:57:36.703476 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-78d30363-1341-4f88-81c4-9f81f0afea75 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:36.711255 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-78d30363-1341-4f88-81c4-9f81f0afea75 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: ad55193e-b097-4372-9a00-972ed2b486f8] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:36.724897 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-78d30363-1341-4f88-81c4-9f81f0afea75 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:36.725403 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-78d30363-1341-4f88-81c4-9f81f0afea75 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:36.725844 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-78d30363-1341-4f88-81c4-9f81f0afea75 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:36.726568 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-78d30363-1341-4f88-81c4-9f81f0afea75 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:36.727060 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-78d30363-1341-4f88-81c4-9f81f0afea75 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:36.727491 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-78d30363-1341-4f88-81c4-9f81f0afea75 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:37.161006 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-4941a9e5-07ec-4f2c-9f7b-e46069d8da09 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Flavor limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 08:57:37.162013 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-4941a9e5-07ec-4f2c-9f7b-e46069d8da09 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Image limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 08:57:37.162654 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-4941a9e5-07ec-4f2c-9f7b-e46069d8da09 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Flavor pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 08:57:37.163251 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-4941a9e5-07ec-4f2c-9f7b-e46069d8da09 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Image pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 08:57:37.163836 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-4941a9e5-07ec-4f2c-9f7b-e46069d8da09 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 08:57:37.182983 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4941a9e5-07ec-4f2c-9f7b-e46069d8da09 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:37.183710 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4941a9e5-07ec-4f2c-9f7b-e46069d8da09 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:37.189007 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4941a9e5-07ec-4f2c-9f7b-e46069d8da09 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:37.190087 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4941a9e5-07ec-4f2c-9f7b-e46069d8da09 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:37.190716 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4941a9e5-07ec-4f2c-9f7b-e46069d8da09 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:37.191643 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4941a9e5-07ec-4f2c-9f7b-e46069d8da09 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:37.241512 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-4941a9e5-07ec-4f2c-9f7b-e46069d8da09 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Getting quotas for project a46ca7b6c331417199f9dfc5ffa80470. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 08:57:37.265439 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-4941a9e5-07ec-4f2c-9f7b-e46069d8da09 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Getting quotas for user 1473e6771ff1459c831d66311318404d and project a46ca7b6c331417199f9dfc5ffa80470. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 08:57:37.297504 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-4941a9e5-07ec-4f2c-9f7b-e46069d8da09 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Going to run 1 instances... {{(pid=128759) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 08:57:37.300294 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-4941a9e5-07ec-4f2c-9f7b-e46069d8da09 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 5ee0a6e1-d106-4955-a894-7fe2ac13ffb0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128759) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 08:57:37.305471 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-78d30363-1341-4f88-81c4-9f81f0afea75 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:37.321153 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-78d30363-1341-4f88-81c4-9f81f0afea75 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/ad55193e-b097-4372-9a00-972ed2b486f8" status: 200 len: 1393 microversion: 2.1 time: 0.628617 Sep 14 08:57:37.323825 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1059/2076] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:57:36 2022] GET /compute/v2.1/servers/ad55193e-b097-4372-9a00-972ed2b486f8 => generated 1393 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:57:37.333537 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c6d5a06b-2ddd-4d55-9567-e5d2e77db0e3 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:37.334157 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-c6d5a06b-2ddd-4d55-9567-e5d2e77db0e3 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] [instance: 26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:37.348021 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c6d5a06b-2ddd-4d55-9567-e5d2e77db0e3 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:37.348781 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c6d5a06b-2ddd-4d55-9567-e5d2e77db0e3 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:37.349404 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c6d5a06b-2ddd-4d55-9567-e5d2e77db0e3 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:37.350299 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c6d5a06b-2ddd-4d55-9567-e5d2e77db0e3 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:37.350764 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c6d5a06b-2ddd-4d55-9567-e5d2e77db0e3 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:37.351216 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c6d5a06b-2ddd-4d55-9567-e5d2e77db0e3 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:37.390675 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-4941a9e5-07ec-4f2c-9f7b-e46069d8da09 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.189341 Sep 14 08:57:37.391851 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1018/2077] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 08:57:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 2191 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 08:57:37.398000 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-0700819b-cee4-4d79-b004-7b2382764d78 req-2a02063e-ad94-4967-8d4e-778afd754e48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7aa796a-60a2-4d5c-a03c-b4ad0ea73811", "name": "network-vif-deleted", "tag": "71dfb3fc-a016-400c-99bc-1b69b34e08e5"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:57:37.410177 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-0700819b-cee4-4d79-b004-7b2382764d78 req-2a02063e-ad94-4967-8d4e-778afd754e48 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:37.411022 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-0700819b-cee4-4d79-b004-7b2382764d78 req-2a02063e-ad94-4967-8d4e-778afd754e48 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:37.411666 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-0700819b-cee4-4d79-b004-7b2382764d78 req-2a02063e-ad94-4967-8d4e-778afd754e48 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:37.425072 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-0700819b-cee4-4d79-b004-7b2382764d78 req-2a02063e-ad94-4967-8d4e-778afd754e48 service nova] Creating event network-vif-deleted:71dfb3fc-a016-400c-99bc-1b69b34e08e5 for instance e7aa796a-60a2-4d5c-a03c-b4ad0ea73811 on n-h2-836830-18 Sep 14 08:57:37.432001 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-0700819b-cee4-4d79-b004-7b2382764d78 req-2a02063e-ad94-4967-8d4e-778afd754e48 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038337 Sep 14 08:57:37.434318 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1019/2078] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:57:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:57:37.451692 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-0a1a1f02-495f-49fb-b799-53c8e3abd4c0 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:37.452867 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-0a1a1f02-495f-49fb-b799-53c8e3abd4c0 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 5ee0a6e1-d106-4955-a894-7fe2ac13ffb0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:37.702478 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-0a1a1f02-495f-49fb-b799-53c8e3abd4c0 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:37.712743 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-0a1a1f02-495f-49fb-b799-53c8e3abd4c0 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/5ee0a6e1-d106-4955-a894-7fe2ac13ffb0" status: 200 len: 1208 microversion: 2.1 time: 0.275404 Sep 14 08:57:37.716041 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1020/2079] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:57:37 2022] GET /compute/v2.1/servers/5ee0a6e1-d106-4955-a894-7fe2ac13ffb0 => generated 1208 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:57:37.729659 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-49f1dc17-6307-4431-aa54-8c13fcc0b90f tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:37.730373 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-49f1dc17-6307-4431-aa54-8c13fcc0b90f tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] [instance: 59f196e8-c202-4073-8663-2ae19358a044] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:37.747203 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-49f1dc17-6307-4431-aa54-8c13fcc0b90f tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:37.747778 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-49f1dc17-6307-4431-aa54-8c13fcc0b90f tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:37.748259 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-49f1dc17-6307-4431-aa54-8c13fcc0b90f tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:37.752410 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-49f1dc17-6307-4431-aa54-8c13fcc0b90f tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:37.753796 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-49f1dc17-6307-4431-aa54-8c13fcc0b90f tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:37.756516 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-49f1dc17-6307-4431-aa54-8c13fcc0b90f tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:38.687142 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=2 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:57:38.695142 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-c6d5a06b-2ddd-4d55-9567-e5d2e77db0e3 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:38.727537 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-c6d5a06b-2ddd-4d55-9567-e5d2e77db0e3 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:38.731623 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-c6d5a06b-2ddd-4d55-9567-e5d2e77db0e3 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:38.736222 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-c6d5a06b-2ddd-4d55-9567-e5d2e77db0e3 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] 10.222.0.60 "GET /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0" status: 200 len: 1709 microversion: 2.32 time: 1.408034 Sep 14 08:57:38.737293 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1060/2080] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:57:37 2022] GET /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0 => generated 1709 bytes in 1413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:57:38.755363 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-aeb200cf-a1b3-4ba2-8a3f-6205cebf96b7 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:38.757060 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-aeb200cf-a1b3-4ba2-8a3f-6205cebf96b7 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] [instance: e7aa796a-60a2-4d5c-a03c-b4ad0ea73811] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:38.771691 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-49f1dc17-6307-4431-aa54-8c13fcc0b90f tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:38.784667 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-aeb200cf-a1b3-4ba2-8a3f-6205cebf96b7 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:38.787685 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-49f1dc17-6307-4431-aa54-8c13fcc0b90f tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:38.789548 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-aeb200cf-a1b3-4ba2-8a3f-6205cebf96b7 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:38.790012 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-aeb200cf-a1b3-4ba2-8a3f-6205cebf96b7 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:38.790814 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-aeb200cf-a1b3-4ba2-8a3f-6205cebf96b7 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:38.791310 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-aeb200cf-a1b3-4ba2-8a3f-6205cebf96b7 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:38.791742 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-aeb200cf-a1b3-4ba2-8a3f-6205cebf96b7 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:38.792529 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-49f1dc17-6307-4431-aa54-8c13fcc0b90f tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:38.805229 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-49f1dc17-6307-4431-aa54-8c13fcc0b90f tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] 10.222.0.60 "GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044" status: 200 len: 1877 microversion: 2.42 time: 1.077230 Sep 14 08:57:38.807254 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1021/2081] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:57:37 2022] GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044 => generated 1877 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:57:38.824899 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ab2abdd5-110d-4443-bc2e-6e50b7fbdd86 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:38.825587 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-aeb200cf-a1b3-4ba2-8a3f-6205cebf96b7 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] HTTP exception thrown: Instance e7aa796a-60a2-4d5c-a03c-b4ad0ea73811 could not be found. Sep 14 08:57:38.827331 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-aeb200cf-a1b3-4ba2-8a3f-6205cebf96b7 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Request method failure captured: Sep 14 08:57:38.827331 n-d-836830-18 devstack@n-api.service[128758]: request: GET /compute/v2.1/servers/e7aa796a-60a2-4d5c-a03c-b4ad0ea73811 HTTP/1.1 Sep 14 08:57:38.827331 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 08:57:38.827331 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 08:57:38.827331 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 08:57:38.827331 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 08:57:38.827331 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 08:57:38.827331 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 08:57:38.827331 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 08:57:38.827331 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 08:57:38.827331 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZbiWM1R5WYpSt9euG2PlnA7qDWjrhRqrsnqwPYWGSI_KGZfz48PEOu9D05ddy3lXbM1LJcunJUCyYLoXnIuc1seC2pqCtBLjLte7bsvR0Wco5G9VyKXHUQ1tINDzn6Fiu2VW8mYq4pv8TY2xtpxAWkpsHCE9SOOL_3KL5k14JUhQI8 Sep 14 08:57:38.827331 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 08:57:38.827331 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 08:57:38.827331 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 08:57:38.827331 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 08:57:38.827331 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 08:57:38.827331 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 08:57:38.827331 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 51ecc8c1389847c7bcd9cd5570d990e8 Sep 14 08:57:38.827331 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-ServersAdminTestJSON-1503859587 Sep 14 08:57:38.827331 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 08:57:38.827331 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 08:57:38.827331 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/51ecc8c1389847c7bcd9cd5570d990e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_51ecc8c1389847c7bcd9cd5570d990e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/51ecc8c1389847c7bcd9cd5570d990e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/51ecc8c1389847c7bcd9cd5570d990e8"}]}] Sep 14 08:57:38.827331 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-ServersAdminTestJSON-1503859587 Sep 14 08:57:38.827331 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 51ecc8c1389847c7bcd9cd5570d990e8 Sep 14 08:57:38.827331 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-ServersAdminTestJSON-1503859587 Sep 14 08:57:38.827331 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-ServersAdminTestJSON-1503859587-project Sep 14 08:57:38.827331 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 08:57:38.827331 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 08:57:38.827331 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 0ab2d64c1cb447f9bfd658408aa07e06 Sep 14 08:57:38.827331 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-ServersAdminTestJSON-1503859587-project Sep 14 08:57:38.827331 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 08:57:38.827331 n-d-836830-18 devstack@n-api.service[128758]: exception: Instance e7aa796a-60a2-4d5c-a03c-b4ad0ea73811 could not be found. Sep 14 08:57:38.827331 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': 'e7aa796a-60a2-4d5c-a03c-b4ad0ea73811'} Sep 14 08:57:38.827331 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:57:38.827331 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:57:38.827331 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 08:57:38.827331 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 08:57:38.827331 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 08:57:38.827331 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 08:57:38.827331 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 08:57:38.827331 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 08:57:38.827331 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 08:57:38.827331 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 08:57:38.827331 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7aa796a-60a2-4d5c-a03c-b4ad0ea73811 could not be found. Sep 14 08:57:38.827331 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:57:38.827331 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:57:38.827331 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:57:38.827331 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:57:38.827331 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:57:38.827331 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:57:38.827331 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:57:38.827331 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:57:38.827331 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:57:38.827331 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:57:38.827331 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 08:57:38.827331 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 08:57:38.827331 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 08:57:38.827331 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 08:57:38.827331 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 08:57:38.827331 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 08:57:38.827331 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7aa796a-60a2-4d5c-a03c-b4ad0ea73811 could not be found. Sep 14 08:57:38.827331 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:57:38.827331 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:57:38.827331 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:57:38.830830 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:57:38.830830 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:57:38.830830 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:57:38.830830 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:57:38.830830 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:57:38.830830 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7aa796a-60a2-4d5c-a03c-b4ad0ea73811 could not be found. Sep 14 08:57:38.830830 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:57:38.832148 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-ab2abdd5-110d-4443-bc2e-6e50b7fbdd86 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: ad55193e-b097-4372-9a00-972ed2b486f8] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:38.838381 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-aeb200cf-a1b3-4ba2-8a3f-6205cebf96b7 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Returning 404 to user: Instance e7aa796a-60a2-4d5c-a03c-b4ad0ea73811 could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:57:38.839818 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-aeb200cf-a1b3-4ba2-8a3f-6205cebf96b7 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] 10.222.0.60 "GET /compute/v2.1/servers/e7aa796a-60a2-4d5c-a03c-b4ad0ea73811" status: 404 len: 111 microversion: 2.1 time: 0.101486 Sep 14 08:57:38.844528 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1061/2082] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:57:38 2022] GET /compute/v2.1/servers/e7aa796a-60a2-4d5c-a03c-b4ad0ea73811 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 08:57:38.849580 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-5601eac3-15b1-44da-82c8-c0a6a91b5851 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:38.850323 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ab2abdd5-110d-4443-bc2e-6e50b7fbdd86 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:38.852386 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ab2abdd5-110d-4443-bc2e-6e50b7fbdd86 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:38.853102 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ab2abdd5-110d-4443-bc2e-6e50b7fbdd86 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:38.854655 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ab2abdd5-110d-4443-bc2e-6e50b7fbdd86 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:38.856727 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-5601eac3-15b1-44da-82c8-c0a6a91b5851 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 5ee0a6e1-d106-4955-a894-7fe2ac13ffb0] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:38.857078 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ab2abdd5-110d-4443-bc2e-6e50b7fbdd86 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:38.858583 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ab2abdd5-110d-4443-bc2e-6e50b7fbdd86 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:38.874732 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5601eac3-15b1-44da-82c8-c0a6a91b5851 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:38.875285 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5601eac3-15b1-44da-82c8-c0a6a91b5851 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:38.875733 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5601eac3-15b1-44da-82c8-c0a6a91b5851 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:38.876462 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5601eac3-15b1-44da-82c8-c0a6a91b5851 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:38.876923 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5601eac3-15b1-44da-82c8-c0a6a91b5851 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:38.877381 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5601eac3-15b1-44da-82c8-c0a6a91b5851 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:39.104572 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-5601eac3-15b1-44da-82c8-c0a6a91b5851 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:39.123607 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-5601eac3-15b1-44da-82c8-c0a6a91b5851 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/5ee0a6e1-d106-4955-a894-7fe2ac13ffb0" status: 200 len: 1260 microversion: 2.1 time: 0.277716 Sep 14 08:57:39.140161 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1062/2083] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:57:38 2022] GET /compute/v2.1/servers/5ee0a6e1-d106-4955-a894-7fe2ac13ffb0 => generated 1260 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:57:39.161187 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1956b6ce-d46f-438a-bf13-793e7da8a552 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:39.165550 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-1956b6ce-d46f-438a-bf13-793e7da8a552 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] [instance: 6ada18a6-f9cb-4bc9-800d-e0218adc4866] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:39.175236 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1956b6ce-d46f-438a-bf13-793e7da8a552 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:39.175966 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1956b6ce-d46f-438a-bf13-793e7da8a552 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:39.176793 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1956b6ce-d46f-438a-bf13-793e7da8a552 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:39.177700 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1956b6ce-d46f-438a-bf13-793e7da8a552 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:39.178349 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1956b6ce-d46f-438a-bf13-793e7da8a552 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:39.178987 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1956b6ce-d46f-438a-bf13-793e7da8a552 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:39.251712 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-1956b6ce-d46f-438a-bf13-793e7da8a552 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] [instance: 6ada18a6-f9cb-4bc9-800d-e0218adc4866] Going to try to terminate instance {{(pid=128758) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 08:57:39.300330 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-ab2abdd5-110d-4443-bc2e-6e50b7fbdd86 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:39.310607 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-ab2abdd5-110d-4443-bc2e-6e50b7fbdd86 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/ad55193e-b097-4372-9a00-972ed2b486f8" status: 200 len: 1393 microversion: 2.1 time: 0.501629 Sep 14 08:57:39.315557 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1022/2084] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:57:38 2022] GET /compute/v2.1/servers/ad55193e-b097-4372-9a00-972ed2b486f8 => generated 1393 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:57:39.516276 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-1956b6ce-d46f-438a-bf13-793e7da8a552 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] 10.222.0.60 "DELETE /compute/v2.1/servers/6ada18a6-f9cb-4bc9-800d-e0218adc4866" status: 204 len: 0 microversion: 2.1 time: 0.367444 Sep 14 08:57:39.530257 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-fba1d53a-40b2-4403-b1fa-a9947ebc8dc1 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:39.532049 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-fba1d53a-40b2-4403-b1fa-a9947ebc8dc1 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] [instance: 6ada18a6-f9cb-4bc9-800d-e0218adc4866] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:39.535038 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1063/2085] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 08:57:39 2022] DELETE /compute/v2.1/servers/6ada18a6-f9cb-4bc9-800d-e0218adc4866 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 08:57:39.544329 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fba1d53a-40b2-4403-b1fa-a9947ebc8dc1 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:39.544833 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fba1d53a-40b2-4403-b1fa-a9947ebc8dc1 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:39.545302 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fba1d53a-40b2-4403-b1fa-a9947ebc8dc1 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:39.546009 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fba1d53a-40b2-4403-b1fa-a9947ebc8dc1 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:39.546461 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fba1d53a-40b2-4403-b1fa-a9947ebc8dc1 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:39.547092 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fba1d53a-40b2-4403-b1fa-a9947ebc8dc1 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:39.768369 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a3ca8c0a-2d54-4453-8b9d-1fde7cffa15c tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:39.769651 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-a3ca8c0a-2d54-4453-8b9d-1fde7cffa15c tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] [instance: 26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:39.775357 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=12 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:57:39.777843 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a3ca8c0a-2d54-4453-8b9d-1fde7cffa15c tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:39.779113 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a3ca8c0a-2d54-4453-8b9d-1fde7cffa15c tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:39.779843 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a3ca8c0a-2d54-4453-8b9d-1fde7cffa15c tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:39.781305 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a3ca8c0a-2d54-4453-8b9d-1fde7cffa15c tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:39.781984 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a3ca8c0a-2d54-4453-8b9d-1fde7cffa15c tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:39.783108 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a3ca8c0a-2d54-4453-8b9d-1fde7cffa15c tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:39.792380 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-fba1d53a-40b2-4403-b1fa-a9947ebc8dc1 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab2d64c1cb447f9bfd658408aa07e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ecc8c1389847c7bcd9cd5570d990e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:39.804776 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-fba1d53a-40b2-4403-b1fa-a9947ebc8dc1 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] 10.222.0.60 "GET /compute/v2.1/servers/6ada18a6-f9cb-4bc9-800d-e0218adc4866" status: 200 len: 1470 microversion: 2.1 time: 0.280702 Sep 14 08:57:39.805375 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1023/2086] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:57:39 2022] GET /compute/v2.1/servers/6ada18a6-f9cb-4bc9-800d-e0218adc4866 => generated 1470 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:57:39.837196 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-45ae2c5d-be22-4e01-acb3-3f6608f74d2e tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:39.838325 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-45ae2c5d-be22-4e01-acb3-3f6608f74d2e tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] [instance: 59f196e8-c202-4073-8663-2ae19358a044] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:39.848710 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-45ae2c5d-be22-4e01-acb3-3f6608f74d2e tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:39.849706 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-45ae2c5d-be22-4e01-acb3-3f6608f74d2e tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:39.850616 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-45ae2c5d-be22-4e01-acb3-3f6608f74d2e tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:39.851947 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-45ae2c5d-be22-4e01-acb3-3f6608f74d2e tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:39.852498 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-45ae2c5d-be22-4e01-acb3-3f6608f74d2e tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:39.853049 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-45ae2c5d-be22-4e01-acb3-3f6608f74d2e tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:40.208536 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-a3ca8c0a-2d54-4453-8b9d-1fde7cffa15c tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:40.231504 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-a3ca8c0a-2d54-4453-8b9d-1fde7cffa15c tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:40.233511 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-a3ca8c0a-2d54-4453-8b9d-1fde7cffa15c tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:40.234915 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-a3ca8c0a-2d54-4453-8b9d-1fde7cffa15c tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] 10.222.0.60 "GET /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0" status: 200 len: 1756 microversion: 2.32 time: 0.471463 Sep 14 08:57:40.235680 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1064/2087] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:57:39 2022] GET /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0 => generated 1756 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 08:57:40.247175 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-8abae40f-b972-4b6b-b4c5-67a770dd6946 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:40.248031 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-8abae40f-b972-4b6b-b4c5-67a770dd6946 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 5ee0a6e1-d106-4955-a894-7fe2ac13ffb0] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:40.259949 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8abae40f-b972-4b6b-b4c5-67a770dd6946 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:40.260680 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8abae40f-b972-4b6b-b4c5-67a770dd6946 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:40.261288 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8abae40f-b972-4b6b-b4c5-67a770dd6946 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:40.262152 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8abae40f-b972-4b6b-b4c5-67a770dd6946 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:40.262770 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8abae40f-b972-4b6b-b4c5-67a770dd6946 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:40.263364 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8abae40f-b972-4b6b-b4c5-67a770dd6946 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:40.300957 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-45ae2c5d-be22-4e01-acb3-3f6608f74d2e tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:40.315638 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-45ae2c5d-be22-4e01-acb3-3f6608f74d2e tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:40.317723 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-45ae2c5d-be22-4e01-acb3-3f6608f74d2e tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:40.319438 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-45ae2c5d-be22-4e01-acb3-3f6608f74d2e tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] 10.222.0.60 "GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044" status: 200 len: 1877 microversion: 2.42 time: 0.487097 Sep 14 08:57:40.320518 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1024/2088] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:57:39 2022] GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044 => generated 1877 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:57:40.347118 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-4252478c-065a-48ab-b498-f4294da240b2 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:40.347975 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-4252478c-065a-48ab-b498-f4294da240b2 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: ad55193e-b097-4372-9a00-972ed2b486f8] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:40.364077 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4252478c-065a-48ab-b498-f4294da240b2 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:40.365769 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4252478c-065a-48ab-b498-f4294da240b2 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:40.366382 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4252478c-065a-48ab-b498-f4294da240b2 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:40.367985 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4252478c-065a-48ab-b498-f4294da240b2 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:40.368407 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4252478c-065a-48ab-b498-f4294da240b2 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:40.368841 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4252478c-065a-48ab-b498-f4294da240b2 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:40.376224 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-8abae40f-b972-4b6b-b4c5-67a770dd6946 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:40.384285 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-8abae40f-b972-4b6b-b4c5-67a770dd6946 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/5ee0a6e1-d106-4955-a894-7fe2ac13ffb0" status: 200 len: 1278 microversion: 2.1 time: 0.147381 Sep 14 08:57:40.396389 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1065/2089] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:57:40 2022] GET /compute/v2.1/servers/5ee0a6e1-d106-4955-a894-7fe2ac13ffb0 => generated 1278 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:57:40.771720 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-4252478c-065a-48ab-b498-f4294da240b2 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:40.785482 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-4252478c-065a-48ab-b498-f4294da240b2 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/ad55193e-b097-4372-9a00-972ed2b486f8" status: 200 len: 1393 microversion: 2.1 time: 0.443522 Sep 14 08:57:40.786626 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1025/2090] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:57:40 2022] GET /compute/v2.1/servers/ad55193e-b097-4372-9a00-972ed2b486f8 => generated 1393 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:57:40.830275 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-0c315924-f96d-475a-bd3c-3556598e0d92 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:40.830911 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-0c315924-f96d-475a-bd3c-3556598e0d92 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] [instance: 6ada18a6-f9cb-4bc9-800d-e0218adc4866] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:40.843414 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0c315924-f96d-475a-bd3c-3556598e0d92 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:40.844180 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0c315924-f96d-475a-bd3c-3556598e0d92 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:40.846459 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0c315924-f96d-475a-bd3c-3556598e0d92 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:40.847389 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0c315924-f96d-475a-bd3c-3556598e0d92 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:40.851687 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0c315924-f96d-475a-bd3c-3556598e0d92 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:40.852356 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0c315924-f96d-475a-bd3c-3556598e0d92 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:41.261303 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-0eada845-15fc-493a-94e8-aeb819eb3405 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:41.261929 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-0eada845-15fc-493a-94e8-aeb819eb3405 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] [instance: 26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:41.280437 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0eada845-15fc-493a-94e8-aeb819eb3405 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:41.280941 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0eada845-15fc-493a-94e8-aeb819eb3405 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:41.281380 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0eada845-15fc-493a-94e8-aeb819eb3405 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:41.282100 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0eada845-15fc-493a-94e8-aeb819eb3405 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:41.282557 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0eada845-15fc-493a-94e8-aeb819eb3405 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:41.283002 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0eada845-15fc-493a-94e8-aeb819eb3405 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:41.616732 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-0c315924-f96d-475a-bd3c-3556598e0d92 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab2d64c1cb447f9bfd658408aa07e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ecc8c1389847c7bcd9cd5570d990e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:41.626230 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-0c315924-f96d-475a-bd3c-3556598e0d92 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] 10.222.0.60 "GET /compute/v2.1/servers/6ada18a6-f9cb-4bc9-800d-e0218adc4866" status: 200 len: 1470 microversion: 2.1 time: 0.800646 Sep 14 08:57:41.634120 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1066/2091] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:57:40 2022] GET /compute/v2.1/servers/6ada18a6-f9cb-4bc9-800d-e0218adc4866 => generated 1470 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:57:41.653072 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b47140b2-b937-452e-9d65-c5bf88966a85 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:41.653612 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-b47140b2-b937-452e-9d65-c5bf88966a85 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] [instance: 59f196e8-c202-4073-8663-2ae19358a044] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:41.676845 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b47140b2-b937-452e-9d65-c5bf88966a85 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:41.677355 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b47140b2-b937-452e-9d65-c5bf88966a85 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:41.678147 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b47140b2-b937-452e-9d65-c5bf88966a85 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:41.678878 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b47140b2-b937-452e-9d65-c5bf88966a85 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:41.679363 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b47140b2-b937-452e-9d65-c5bf88966a85 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:41.679796 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b47140b2-b937-452e-9d65-c5bf88966a85 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:42.264832 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-0eada845-15fc-493a-94e8-aeb819eb3405 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:42.281966 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-0eada845-15fc-493a-94e8-aeb819eb3405 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:42.284303 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-0eada845-15fc-493a-94e8-aeb819eb3405 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:42.290025 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-0eada845-15fc-493a-94e8-aeb819eb3405 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] 10.222.0.60 "GET /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0" status: 200 len: 1803 microversion: 2.32 time: 1.031939 Sep 14 08:57:42.292513 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1026/2092] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:57:41 2022] GET /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0 => generated 1803 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 08:57:42.305218 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-669e3988-a0b2-483f-8b3d-b4cbe43c0860 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:42.309182 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-669e3988-a0b2-483f-8b3d-b4cbe43c0860 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 5ee0a6e1-d106-4955-a894-7fe2ac13ffb0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:42.327304 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-669e3988-a0b2-483f-8b3d-b4cbe43c0860 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:42.328607 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-669e3988-a0b2-483f-8b3d-b4cbe43c0860 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:42.329303 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-669e3988-a0b2-483f-8b3d-b4cbe43c0860 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:42.331960 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-669e3988-a0b2-483f-8b3d-b4cbe43c0860 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:42.334788 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-669e3988-a0b2-483f-8b3d-b4cbe43c0860 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:42.335878 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-669e3988-a0b2-483f-8b3d-b4cbe43c0860 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:42.791304 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-b47140b2-b937-452e-9d65-c5bf88966a85 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:42.807745 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-b47140b2-b937-452e-9d65-c5bf88966a85 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:42.811141 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-b47140b2-b937-452e-9d65-c5bf88966a85 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:42.815043 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-b47140b2-b937-452e-9d65-c5bf88966a85 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] 10.222.0.60 "GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044" status: 200 len: 1877 microversion: 2.42 time: 1.165925 Sep 14 08:57:42.835361 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1067/2093] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:57:41 2022] GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044 => generated 1877 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:57:42.840885 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-abc08dea-1e71-40d7-b14f-b46ddf5f1a3d tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:42.842396 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-abc08dea-1e71-40d7-b14f-b46ddf5f1a3d tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: ad55193e-b097-4372-9a00-972ed2b486f8] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:42.850196 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-abc08dea-1e71-40d7-b14f-b46ddf5f1a3d tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:42.851048 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-abc08dea-1e71-40d7-b14f-b46ddf5f1a3d tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:42.851705 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-abc08dea-1e71-40d7-b14f-b46ddf5f1a3d tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:42.852653 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-abc08dea-1e71-40d7-b14f-b46ddf5f1a3d tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:42.853324 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-abc08dea-1e71-40d7-b14f-b46ddf5f1a3d tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:42.853960 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-abc08dea-1e71-40d7-b14f-b46ddf5f1a3d tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:42.926990 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-669e3988-a0b2-483f-8b3d-b4cbe43c0860 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:42.954181 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-669e3988-a0b2-483f-8b3d-b4cbe43c0860 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/5ee0a6e1-d106-4955-a894-7fe2ac13ffb0" status: 200 len: 1308 microversion: 2.1 time: 0.657680 Sep 14 08:57:42.956541 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1027/2094] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:57:42 2022] GET /compute/v2.1/servers/5ee0a6e1-d106-4955-a894-7fe2ac13ffb0 => generated 1308 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:57:42.964360 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-f4539fb9-ad3d-45ef-bd65-605a0bf1c3e6 req-537a2b01-fb90-4930-880e-8231d1d7578b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ada18a6-f9cb-4bc9-800d-e0218adc4866", "name": "network-vif-deleted", "tag": "bc272de6-30ab-4921-8e34-2d8757490726"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:57:42.980088 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-f4539fb9-ad3d-45ef-bd65-605a0bf1c3e6 req-537a2b01-fb90-4930-880e-8231d1d7578b service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:42.981229 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-f4539fb9-ad3d-45ef-bd65-605a0bf1c3e6 req-537a2b01-fb90-4930-880e-8231d1d7578b service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:42.981936 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-f4539fb9-ad3d-45ef-bd65-605a0bf1c3e6 req-537a2b01-fb90-4930-880e-8231d1d7578b service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:42.999439 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-f4539fb9-ad3d-45ef-bd65-605a0bf1c3e6 req-537a2b01-fb90-4930-880e-8231d1d7578b service nova] Creating event network-vif-deleted:bc272de6-30ab-4921-8e34-2d8757490726 for instance 6ada18a6-f9cb-4bc9-800d-e0218adc4866 on n-h2-836830-18 Sep 14 08:57:43.014012 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-f4539fb9-ad3d-45ef-bd65-605a0bf1c3e6 req-537a2b01-fb90-4930-880e-8231d1d7578b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054231 Sep 14 08:57:43.016627 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1028/2095] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:57:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:57:43.023237 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-dcbb0eff-8069-4ce5-92b1-8510c5a5fc38 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:43.025325 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-dcbb0eff-8069-4ce5-92b1-8510c5a5fc38 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] [instance: 6ada18a6-f9cb-4bc9-800d-e0218adc4866] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:43.033186 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dcbb0eff-8069-4ce5-92b1-8510c5a5fc38 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:43.033936 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dcbb0eff-8069-4ce5-92b1-8510c5a5fc38 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:43.034649 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dcbb0eff-8069-4ce5-92b1-8510c5a5fc38 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:43.035581 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dcbb0eff-8069-4ce5-92b1-8510c5a5fc38 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:43.036413 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dcbb0eff-8069-4ce5-92b1-8510c5a5fc38 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:43.037466 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dcbb0eff-8069-4ce5-92b1-8510c5a5fc38 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:43.109396 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dcbb0eff-8069-4ce5-92b1-8510c5a5fc38 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:43.109896 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dcbb0eff-8069-4ce5-92b1-8510c5a5fc38 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:43.110339 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dcbb0eff-8069-4ce5-92b1-8510c5a5fc38 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:43.110797 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.objects.instance [None req-dcbb0eff-8069-4ce5-92b1-8510c5a5fc38 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lazy-loading 'fault' on Instance uuid 6ada18a6-f9cb-4bc9-800d-e0218adc4866 {{(pid=128759) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 08:57:43.247893 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-dcbb0eff-8069-4ce5-92b1-8510c5a5fc38 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab2d64c1cb447f9bfd658408aa07e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ecc8c1389847c7bcd9cd5570d990e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:43.265420 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-dcbb0eff-8069-4ce5-92b1-8510c5a5fc38 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] 10.222.0.60 "GET /compute/v2.1/servers/6ada18a6-f9cb-4bc9-800d-e0218adc4866" status: 200 len: 1304 microversion: 2.1 time: 0.245243 Sep 14 08:57:43.268236 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1029/2096] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:57:43 2022] GET /compute/v2.1/servers/6ada18a6-f9cb-4bc9-800d-e0218adc4866 => generated 1304 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:57:43.323864 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d9635145-74fb-48a2-896d-c2a60602491d tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:43.324546 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-d9635145-74fb-48a2-896d-c2a60602491d tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] [instance: 26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:43.337996 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d9635145-74fb-48a2-896d-c2a60602491d tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:43.339021 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d9635145-74fb-48a2-896d-c2a60602491d tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:43.339716 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d9635145-74fb-48a2-896d-c2a60602491d tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:43.340656 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d9635145-74fb-48a2-896d-c2a60602491d tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:43.343133 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d9635145-74fb-48a2-896d-c2a60602491d tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:43.344213 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d9635145-74fb-48a2-896d-c2a60602491d tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:43.679548 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-abc08dea-1e71-40d7-b14f-b46ddf5f1a3d tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:43.686799 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:57:43.689207 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-abc08dea-1e71-40d7-b14f-b46ddf5f1a3d tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/ad55193e-b097-4372-9a00-972ed2b486f8" status: 200 len: 1393 microversion: 2.1 time: 0.852434 Sep 14 08:57:43.704859 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1068/2097] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:57:42 2022] GET /compute/v2.1/servers/ad55193e-b097-4372-9a00-972ed2b486f8 => generated 1393 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:57:43.846230 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-47f9c71a-b84a-4890-9d40-5944b28b6908 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:43.847818 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-47f9c71a-b84a-4890-9d40-5944b28b6908 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] [instance: 59f196e8-c202-4073-8663-2ae19358a044] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:43.876307 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-47f9c71a-b84a-4890-9d40-5944b28b6908 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:43.878829 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-47f9c71a-b84a-4890-9d40-5944b28b6908 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:43.879497 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-47f9c71a-b84a-4890-9d40-5944b28b6908 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:43.880745 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-47f9c71a-b84a-4890-9d40-5944b28b6908 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:43.884278 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-47f9c71a-b84a-4890-9d40-5944b28b6908 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:43.885361 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-47f9c71a-b84a-4890-9d40-5944b28b6908 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:44.250764 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-d9635145-74fb-48a2-896d-c2a60602491d tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:44.262848 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-d9635145-74fb-48a2-896d-c2a60602491d tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:44.264407 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-d9635145-74fb-48a2-896d-c2a60602491d tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:44.265578 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d9635145-74fb-48a2-896d-c2a60602491d tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] 10.222.0.60 "GET /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0" status: 200 len: 1803 microversion: 2.32 time: 0.946652 Sep 14 08:57:44.279302 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1030/2098] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:57:43 2022] GET /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0 => generated 1803 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:57:44.284847 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-374df885-70d8-4157-a10a-f6d65f47ec6a tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:44.299686 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-374df885-70d8-4157-a10a-f6d65f47ec6a tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 5ee0a6e1-d106-4955-a894-7fe2ac13ffb0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:44.324376 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:57:44.336931 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-374df885-70d8-4157-a10a-f6d65f47ec6a tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:44.337681 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-374df885-70d8-4157-a10a-f6d65f47ec6a tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:44.342994 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-374df885-70d8-4157-a10a-f6d65f47ec6a tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:44.347211 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-374df885-70d8-4157-a10a-f6d65f47ec6a tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:44.347875 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-374df885-70d8-4157-a10a-f6d65f47ec6a tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:44.349210 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-374df885-70d8-4157-a10a-f6d65f47ec6a tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:44.833622 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-47f9c71a-b84a-4890-9d40-5944b28b6908 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:44.851304 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-47f9c71a-b84a-4890-9d40-5944b28b6908 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:44.853648 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-47f9c71a-b84a-4890-9d40-5944b28b6908 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:44.856522 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-47f9c71a-b84a-4890-9d40-5944b28b6908 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] 10.222.0.60 "GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044" status: 200 len: 1877 microversion: 2.42 time: 1.015246 Sep 14 08:57:44.859896 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1069/2099] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:57:43 2022] GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044 => generated 1877 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 08:57:44.866930 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d898b4b1-f887-40fa-bd9b-03cb4c110b5f tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:44.871926 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-d898b4b1-f887-40fa-bd9b-03cb4c110b5f tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] [instance: 6ada18a6-f9cb-4bc9-800d-e0218adc4866] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:44.891757 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d898b4b1-f887-40fa-bd9b-03cb4c110b5f tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:44.892650 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d898b4b1-f887-40fa-bd9b-03cb4c110b5f tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:44.893424 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d898b4b1-f887-40fa-bd9b-03cb4c110b5f tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:44.901406 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d898b4b1-f887-40fa-bd9b-03cb4c110b5f tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:44.905145 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d898b4b1-f887-40fa-bd9b-03cb4c110b5f tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:44.908396 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d898b4b1-f887-40fa-bd9b-03cb4c110b5f tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:44.962066 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-d898b4b1-f887-40fa-bd9b-03cb4c110b5f tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] HTTP exception thrown: Instance 6ada18a6-f9cb-4bc9-800d-e0218adc4866 could not be found. Sep 14 08:57:44.971554 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d898b4b1-f887-40fa-bd9b-03cb4c110b5f tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Request method failure captured: Sep 14 08:57:44.971554 n-d-836830-18 devstack@n-api.service[128758]: request: GET /compute/v2.1/servers/6ada18a6-f9cb-4bc9-800d-e0218adc4866 HTTP/1.1 Sep 14 08:57:44.971554 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 08:57:44.971554 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 08:57:44.971554 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 08:57:44.971554 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 08:57:44.971554 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 08:57:44.971554 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 08:57:44.971554 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 08:57:44.971554 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 08:57:44.971554 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZbiWM1R5WYpSt9euG2PlnA7qDWjrhRqrsnqwPYWGSI_KGZfz48PEOu9D05ddy3lXbM1LJcunJUCyYLoXnIuc1seC2pqCtBLjLte7bsvR0Wco5G9VyKXHUQ1tINDzn6Fiu2VW8mYq4pv8TY2xtpxAWkpsHCE9SOOL_3KL5k14JUhQI8 Sep 14 08:57:44.971554 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 08:57:44.971554 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 08:57:44.971554 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 08:57:44.971554 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 08:57:44.971554 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 08:57:44.971554 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 08:57:44.971554 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 51ecc8c1389847c7bcd9cd5570d990e8 Sep 14 08:57:44.971554 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-ServersAdminTestJSON-1503859587 Sep 14 08:57:44.971554 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 08:57:44.971554 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 08:57:44.971554 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/51ecc8c1389847c7bcd9cd5570d990e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_51ecc8c1389847c7bcd9cd5570d990e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/51ecc8c1389847c7bcd9cd5570d990e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/51ecc8c1389847c7bcd9cd5570d990e8"}]}] Sep 14 08:57:44.971554 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-ServersAdminTestJSON-1503859587 Sep 14 08:57:44.971554 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 51ecc8c1389847c7bcd9cd5570d990e8 Sep 14 08:57:44.971554 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-ServersAdminTestJSON-1503859587 Sep 14 08:57:44.971554 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-ServersAdminTestJSON-1503859587-project Sep 14 08:57:44.971554 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 08:57:44.971554 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 08:57:44.971554 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 0ab2d64c1cb447f9bfd658408aa07e06 Sep 14 08:57:44.971554 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-ServersAdminTestJSON-1503859587-project Sep 14 08:57:44.971554 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 08:57:44.971554 n-d-836830-18 devstack@n-api.service[128758]: exception: Instance 6ada18a6-f9cb-4bc9-800d-e0218adc4866 could not be found. Sep 14 08:57:44.971554 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': '6ada18a6-f9cb-4bc9-800d-e0218adc4866'} Sep 14 08:57:44.971554 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:57:44.971554 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:57:44.971554 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 08:57:44.971554 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 08:57:44.971554 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 08:57:44.971554 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 08:57:44.971554 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 08:57:44.971554 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 08:57:44.971554 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 08:57:44.971554 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 08:57:44.971554 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ada18a6-f9cb-4bc9-800d-e0218adc4866 could not be found. Sep 14 08:57:44.971554 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:57:44.971554 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:57:44.971554 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:57:44.971554 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:57:44.971554 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:57:44.971554 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:57:44.971554 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:57:44.971554 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:57:44.971554 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:57:44.971554 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:57:44.971554 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 08:57:44.971554 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 08:57:44.971554 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 08:57:44.971554 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 08:57:44.971554 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 08:57:44.971554 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 08:57:44.971554 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ada18a6-f9cb-4bc9-800d-e0218adc4866 could not be found. Sep 14 08:57:44.971554 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:57:44.971554 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:57:44.971554 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:57:44.976496 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:57:44.976496 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:57:44.976496 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:57:44.976496 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:57:44.976496 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:57:44.976496 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ada18a6-f9cb-4bc9-800d-e0218adc4866 could not be found. Sep 14 08:57:44.976496 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:57:44.978040 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d898b4b1-f887-40fa-bd9b-03cb4c110b5f tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Returning 404 to user: Instance 6ada18a6-f9cb-4bc9-800d-e0218adc4866 could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:57:44.979458 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-d898b4b1-f887-40fa-bd9b-03cb4c110b5f tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] 10.222.0.60 "GET /compute/v2.1/servers/6ada18a6-f9cb-4bc9-800d-e0218adc4866" status: 404 len: 111 microversion: 2.1 time: 0.117559 Sep 14 08:57:44.981104 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1070/2100] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:57:44 2022] GET /compute/v2.1/servers/6ada18a6-f9cb-4bc9-800d-e0218adc4866 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 08:57:45.005744 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-e8ce305d-d864-4119-b482-c0f241ac8af0 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:45.006430 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-e8ce305d-d864-4119-b482-c0f241ac8af0 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: ad55193e-b097-4372-9a00-972ed2b486f8] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:45.032520 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e8ce305d-d864-4119-b482-c0f241ac8af0 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:45.033023 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e8ce305d-d864-4119-b482-c0f241ac8af0 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:45.033466 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e8ce305d-d864-4119-b482-c0f241ac8af0 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:45.034182 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e8ce305d-d864-4119-b482-c0f241ac8af0 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:45.034641 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e8ce305d-d864-4119-b482-c0f241ac8af0 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:45.035146 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e8ce305d-d864-4119-b482-c0f241ac8af0 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:45.061696 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-374df885-70d8-4157-a10a-f6d65f47ec6a tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:45.073283 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-374df885-70d8-4157-a10a-f6d65f47ec6a tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/5ee0a6e1-d106-4955-a894-7fe2ac13ffb0" status: 200 len: 1308 microversion: 2.1 time: 0.792115 Sep 14 08:57:45.075667 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1031/2101] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:57:44 2022] GET /compute/v2.1/servers/5ee0a6e1-d106-4955-a894-7fe2ac13ffb0 => generated 1308 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:57:45.100806 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-1cda2556-0aee-4c92-91f9-617122e527e7 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:45.101615 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-1cda2556-0aee-4c92-91f9-617122e527e7 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] [instance: 8dd1623b-312c-411d-8f6c-b334195e573b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:45.124887 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1cda2556-0aee-4c92-91f9-617122e527e7 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:45.126081 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1cda2556-0aee-4c92-91f9-617122e527e7 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:45.126870 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1cda2556-0aee-4c92-91f9-617122e527e7 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:45.127883 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1cda2556-0aee-4c92-91f9-617122e527e7 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:45.128572 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1cda2556-0aee-4c92-91f9-617122e527e7 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:45.129220 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1cda2556-0aee-4c92-91f9-617122e527e7 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:45.172958 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-1cda2556-0aee-4c92-91f9-617122e527e7 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] [instance: 8dd1623b-312c-411d-8f6c-b334195e573b] Going to try to terminate instance {{(pid=128759) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 08:57:45.305230 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-1cda2556-0aee-4c92-91f9-617122e527e7 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] 10.222.0.60 "DELETE /compute/v2.1/servers/8dd1623b-312c-411d-8f6c-b334195e573b" status: 204 len: 0 microversion: 2.1 time: 0.212551 Sep 14 08:57:45.307258 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1032/2102] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 08:57:45 2022] DELETE /compute/v2.1/servers/8dd1623b-312c-411d-8f6c-b334195e573b => generated 0 bytes in 216 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 08:57:45.315577 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-fe476d9f-d2a3-49a4-8cce-b71f61131721 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:45.316803 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-fe476d9f-d2a3-49a4-8cce-b71f61131721 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] [instance: 26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:45.323650 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fe476d9f-d2a3-49a4-8cce-b71f61131721 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:45.324357 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fe476d9f-d2a3-49a4-8cce-b71f61131721 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:45.324952 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fe476d9f-d2a3-49a4-8cce-b71f61131721 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:45.325821 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fe476d9f-d2a3-49a4-8cce-b71f61131721 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:45.326456 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fe476d9f-d2a3-49a4-8cce-b71f61131721 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:45.327059 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fe476d9f-d2a3-49a4-8cce-b71f61131721 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:45.538258 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-e8ce305d-d864-4119-b482-c0f241ac8af0 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:45.550377 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-e8ce305d-d864-4119-b482-c0f241ac8af0 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/ad55193e-b097-4372-9a00-972ed2b486f8" status: 200 len: 1393 microversion: 2.1 time: 0.567444 Sep 14 08:57:45.573880 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1071/2103] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:57:44 2022] GET /compute/v2.1/servers/ad55193e-b097-4372-9a00-972ed2b486f8 => generated 1393 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:57:45.597497 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-08c9d3a8-3fe8-407b-a68b-17eefa308858 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:45.599076 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-08c9d3a8-3fe8-407b-a68b-17eefa308858 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] [instance: 8dd1623b-312c-411d-8f6c-b334195e573b] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:45.625981 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-08c9d3a8-3fe8-407b-a68b-17eefa308858 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:45.626583 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-08c9d3a8-3fe8-407b-a68b-17eefa308858 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:45.627181 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-08c9d3a8-3fe8-407b-a68b-17eefa308858 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:45.628496 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-08c9d3a8-3fe8-407b-a68b-17eefa308858 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:45.629757 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-08c9d3a8-3fe8-407b-a68b-17eefa308858 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:45.630263 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-08c9d3a8-3fe8-407b-a68b-17eefa308858 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:45.905268 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-fe476d9f-d2a3-49a4-8cce-b71f61131721 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:45.916026 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-fe476d9f-d2a3-49a4-8cce-b71f61131721 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:45.917794 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-fe476d9f-d2a3-49a4-8cce-b71f61131721 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:45.919283 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-fe476d9f-d2a3-49a4-8cce-b71f61131721 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] 10.222.0.60 "GET /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0" status: 200 len: 1850 microversion: 2.32 time: 0.609775 Sep 14 08:57:45.939259 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1033/2104] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:57:45 2022] GET /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0 => generated 1850 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:57:45.945431 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-519216b2-d3e5-47aa-8f34-a55ded135eea tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "caf4713e-7ff3-4c9e-b74f-5117099bf8b1"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:57:45.949073 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-519216b2-d3e5-47aa-8f34-a55ded135eea tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] [instance: 0b54f1c2-0d9c-4396-8c79-1e43b612b2ba] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:45.955731 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-519216b2-d3e5-47aa-8f34-a55ded135eea tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:45.956477 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-519216b2-d3e5-47aa-8f34-a55ded135eea tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:45.957242 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-519216b2-d3e5-47aa-8f34-a55ded135eea tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:45.958158 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-519216b2-d3e5-47aa-8f34-a55ded135eea tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:45.958766 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-519216b2-d3e5-47aa-8f34-a55ded135eea tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:45.959366 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-519216b2-d3e5-47aa-8f34-a55ded135eea tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:46.240821 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-08c9d3a8-3fe8-407b-a68b-17eefa308858 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab2d64c1cb447f9bfd658408aa07e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ecc8c1389847c7bcd9cd5570d990e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:46.253471 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-08c9d3a8-3fe8-407b-a68b-17eefa308858 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] 10.222.0.60 "GET /compute/v2.1/servers/8dd1623b-312c-411d-8f6c-b334195e573b" status: 200 len: 1470 microversion: 2.1 time: 0.665827 Sep 14 08:57:46.254427 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1072/2105] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:57:45 2022] GET /compute/v2.1/servers/8dd1623b-312c-411d-8f6c-b334195e573b => generated 1470 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:57:46.269219 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b2155d5f-5362-4ba2-aa93-2a1850e95c85 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:46.270053 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-b2155d5f-5362-4ba2-aa93-2a1850e95c85 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] [instance: 59f196e8-c202-4073-8663-2ae19358a044] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:46.285913 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b2155d5f-5362-4ba2-aa93-2a1850e95c85 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:46.286624 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b2155d5f-5362-4ba2-aa93-2a1850e95c85 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:46.287484 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b2155d5f-5362-4ba2-aa93-2a1850e95c85 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:46.288379 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b2155d5f-5362-4ba2-aa93-2a1850e95c85 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:46.289166 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b2155d5f-5362-4ba2-aa93-2a1850e95c85 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:46.289739 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b2155d5f-5362-4ba2-aa93-2a1850e95c85 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:46.354811 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:57:46.381541 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-519216b2-d3e5-47aa-8f34-a55ded135eea tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] 10.222.0.60 "POST /compute/v2.1/servers/0b54f1c2-0d9c-4396-8c79-1e43b612b2ba/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.440659 Sep 14 08:57:46.382551 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1034/2106] 10.222.0.60 () {60 vars in 1323 bytes} [Wed Sep 14 08:57:45 2022] POST /compute/v2.1/servers/0b54f1c2-0d9c-4396-8c79-1e43b612b2ba/os-volume_attachments => generated 194 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:57:46.399654 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-bc052f39-c327-41bb-a535-37701e8b9090 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:46.403297 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-bc052f39-c327-41bb-a535-37701e8b9090 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 5ee0a6e1-d106-4955-a894-7fe2ac13ffb0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:46.415443 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bc052f39-c327-41bb-a535-37701e8b9090 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:46.415867 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bc052f39-c327-41bb-a535-37701e8b9090 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:46.416311 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bc052f39-c327-41bb-a535-37701e8b9090 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:46.417028 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bc052f39-c327-41bb-a535-37701e8b9090 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:46.423895 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bc052f39-c327-41bb-a535-37701e8b9090 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:46.424354 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bc052f39-c327-41bb-a535-37701e8b9090 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:46.846421 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-bc052f39-c327-41bb-a535-37701e8b9090 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:46.854760 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-bc052f39-c327-41bb-a535-37701e8b9090 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/5ee0a6e1-d106-4955-a894-7fe2ac13ffb0" status: 200 len: 1308 microversion: 2.1 time: 0.470872 Sep 14 08:57:46.855387 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1035/2107] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:57:46 2022] GET /compute/v2.1/servers/5ee0a6e1-d106-4955-a894-7fe2ac13ffb0 => generated 1308 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:57:46.870913 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-95c97298-2eef-4131-9dc9-3104c79e3f17 req-3c019af8-e3a7-4cdb-ba43-c7fcbf6adb70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ee0a6e1-d106-4955-a894-7fe2ac13ffb0", "tag": "9fe60e18-05c8-4c91-b9ea-d1e34bad2144"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:57:46.891662 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-95c97298-2eef-4131-9dc9-3104c79e3f17 req-3c019af8-e3a7-4cdb-ba43-c7fcbf6adb70 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:46.892259 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-95c97298-2eef-4131-9dc9-3104c79e3f17 req-3c019af8-e3a7-4cdb-ba43-c7fcbf6adb70 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:46.892700 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-95c97298-2eef-4131-9dc9-3104c79e3f17 req-3c019af8-e3a7-4cdb-ba43-c7fcbf6adb70 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:46.914590 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-95c97298-2eef-4131-9dc9-3104c79e3f17 req-3c019af8-e3a7-4cdb-ba43-c7fcbf6adb70 service nova] Creating event network-changed:9fe60e18-05c8-4c91-b9ea-d1e34bad2144 for instance 5ee0a6e1-d106-4955-a894-7fe2ac13ffb0 on n-h2-836830-18 Sep 14 08:57:46.926173 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-95c97298-2eef-4131-9dc9-3104c79e3f17 req-3c019af8-e3a7-4cdb-ba43-c7fcbf6adb70 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064559 Sep 14 08:57:46.927280 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1036/2108] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:57:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:57:46.946808 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f929eb09-96b4-48c5-9661-60f21e2ffb2e tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:46.946808 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f929eb09-96b4-48c5-9661-60f21e2ffb2e tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: ad55193e-b097-4372-9a00-972ed2b486f8] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:46.957460 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f929eb09-96b4-48c5-9661-60f21e2ffb2e tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:46.957969 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f929eb09-96b4-48c5-9661-60f21e2ffb2e tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:46.958416 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f929eb09-96b4-48c5-9661-60f21e2ffb2e tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:46.959167 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f929eb09-96b4-48c5-9661-60f21e2ffb2e tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:46.959627 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f929eb09-96b4-48c5-9661-60f21e2ffb2e tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:46.960060 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f929eb09-96b4-48c5-9661-60f21e2ffb2e tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:47.148746 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-b2155d5f-5362-4ba2-aa93-2a1850e95c85 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:47.158386 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-b2155d5f-5362-4ba2-aa93-2a1850e95c85 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:47.164642 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-b2155d5f-5362-4ba2-aa93-2a1850e95c85 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:47.168359 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-b2155d5f-5362-4ba2-aa93-2a1850e95c85 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] 10.222.0.60 "GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044" status: 200 len: 1877 microversion: 2.42 time: 0.912691 Sep 14 08:57:47.169151 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1073/2109] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:57:46 2022] GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044 => generated 1877 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:57:47.179575 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-8da25dbc-0775-4e02-90af-1ae1b2119f77 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:47.180651 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-8da25dbc-0775-4e02-90af-1ae1b2119f77 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] [instance: 26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:47.195751 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8da25dbc-0775-4e02-90af-1ae1b2119f77 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:47.200067 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8da25dbc-0775-4e02-90af-1ae1b2119f77 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:47.200747 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8da25dbc-0775-4e02-90af-1ae1b2119f77 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:47.202315 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8da25dbc-0775-4e02-90af-1ae1b2119f77 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:47.203048 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8da25dbc-0775-4e02-90af-1ae1b2119f77 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:47.203709 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8da25dbc-0775-4e02-90af-1ae1b2119f77 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:47.206770 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=6 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:57:47.363723 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f929eb09-96b4-48c5-9661-60f21e2ffb2e tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:47.382457 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f929eb09-96b4-48c5-9661-60f21e2ffb2e tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/ad55193e-b097-4372-9a00-972ed2b486f8" status: 200 len: 1393 microversion: 2.1 time: 0.449779 Sep 14 08:57:47.383455 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1037/2110] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:57:46 2022] GET /compute/v2.1/servers/ad55193e-b097-4372-9a00-972ed2b486f8 => generated 1393 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:57:47.402248 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-bec429c9-e287-4cc6-a6ab-9d51795bd1b0 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:47.403594 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-bec429c9-e287-4cc6-a6ab-9d51795bd1b0 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] [instance: 8dd1623b-312c-411d-8f6c-b334195e573b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:47.412280 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bec429c9-e287-4cc6-a6ab-9d51795bd1b0 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:47.413138 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bec429c9-e287-4cc6-a6ab-9d51795bd1b0 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:47.415517 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bec429c9-e287-4cc6-a6ab-9d51795bd1b0 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:47.416497 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bec429c9-e287-4cc6-a6ab-9d51795bd1b0 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:47.417181 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bec429c9-e287-4cc6-a6ab-9d51795bd1b0 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:47.420606 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bec429c9-e287-4cc6-a6ab-9d51795bd1b0 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:47.707337 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=8 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:57:47.776419 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-8da25dbc-0775-4e02-90af-1ae1b2119f77 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:47.813161 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-8da25dbc-0775-4e02-90af-1ae1b2119f77 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:47.817408 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-8da25dbc-0775-4e02-90af-1ae1b2119f77 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:47.819932 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-8da25dbc-0775-4e02-90af-1ae1b2119f77 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] 10.222.0.60 "GET /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0" status: 200 len: 1850 microversion: 2.32 time: 0.649633 Sep 14 08:57:47.841503 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1074/2111] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:57:47 2022] GET /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0 => generated 1850 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:57:47.849896 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-025dd219-0be1-464a-833c-c8fde3ae8a07 req-ed85af84-0d15-4466-b5d6-7a5a8fd1ea42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8dd1623b-312c-411d-8f6c-b334195e573b", "name": "network-vif-deleted", "tag": "558f9bbb-f694-40cf-b969-31f1db110da5"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:57:47.866388 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-025dd219-0be1-464a-833c-c8fde3ae8a07 req-ed85af84-0d15-4466-b5d6-7a5a8fd1ea42 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:47.867294 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-025dd219-0be1-464a-833c-c8fde3ae8a07 req-ed85af84-0d15-4466-b5d6-7a5a8fd1ea42 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:47.867999 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-025dd219-0be1-464a-833c-c8fde3ae8a07 req-ed85af84-0d15-4466-b5d6-7a5a8fd1ea42 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:47.887217 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-025dd219-0be1-464a-833c-c8fde3ae8a07 req-ed85af84-0d15-4466-b5d6-7a5a8fd1ea42 service nova] Creating event network-vif-deleted:558f9bbb-f694-40cf-b969-31f1db110da5 for instance 8dd1623b-312c-411d-8f6c-b334195e573b on n-h2-836830-18 Sep 14 08:57:47.909248 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-025dd219-0be1-464a-833c-c8fde3ae8a07 req-ed85af84-0d15-4466-b5d6-7a5a8fd1ea42 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065651 Sep 14 08:57:47.910505 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1075/2112] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:57:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:57:47.920003 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-786720d3-3f83-47cc-98bb-d7e3b79724db tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:47.921578 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-786720d3-3f83-47cc-98bb-d7e3b79724db tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 5ee0a6e1-d106-4955-a894-7fe2ac13ffb0] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:47.929803 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-786720d3-3f83-47cc-98bb-d7e3b79724db tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:47.930528 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-786720d3-3f83-47cc-98bb-d7e3b79724db tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:47.931241 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-786720d3-3f83-47cc-98bb-d7e3b79724db tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:47.932588 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-786720d3-3f83-47cc-98bb-d7e3b79724db tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:47.933288 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-786720d3-3f83-47cc-98bb-d7e3b79724db tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:47.934244 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-786720d3-3f83-47cc-98bb-d7e3b79724db tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:47.940767 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-bec429c9-e287-4cc6-a6ab-9d51795bd1b0 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab2d64c1cb447f9bfd658408aa07e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ecc8c1389847c7bcd9cd5570d990e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:47.959747 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-bec429c9-e287-4cc6-a6ab-9d51795bd1b0 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] 10.222.0.60 "GET /compute/v2.1/servers/8dd1623b-312c-411d-8f6c-b334195e573b" status: 200 len: 1470 microversion: 2.1 time: 0.575021 Sep 14 08:57:47.971180 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1038/2113] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:57:47 2022] GET /compute/v2.1/servers/8dd1623b-312c-411d-8f6c-b334195e573b => generated 1470 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:57:48.199539 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-894870db-98cd-4184-8b74-6166bf876a9c tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:48.200338 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-894870db-98cd-4184-8b74-6166bf876a9c tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] [instance: 59f196e8-c202-4073-8663-2ae19358a044] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:48.209522 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-894870db-98cd-4184-8b74-6166bf876a9c tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:48.211128 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-894870db-98cd-4184-8b74-6166bf876a9c tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:48.211583 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-894870db-98cd-4184-8b74-6166bf876a9c tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:48.212300 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-894870db-98cd-4184-8b74-6166bf876a9c tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:48.212759 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-894870db-98cd-4184-8b74-6166bf876a9c tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:48.213185 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-894870db-98cd-4184-8b74-6166bf876a9c tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:48.278909 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-786720d3-3f83-47cc-98bb-d7e3b79724db tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:48.287697 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-786720d3-3f83-47cc-98bb-d7e3b79724db tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/5ee0a6e1-d106-4955-a894-7fe2ac13ffb0" status: 200 len: 1308 microversion: 2.1 time: 0.375451 Sep 14 08:57:48.288217 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1076/2114] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:57:47 2022] GET /compute/v2.1/servers/5ee0a6e1-d106-4955-a894-7fe2ac13ffb0 => generated 1308 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:57:48.411615 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-3799cc51-0e93-4fe8-b5ff-47fac681991c tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:48.412509 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-3799cc51-0e93-4fe8-b5ff-47fac681991c tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: ad55193e-b097-4372-9a00-972ed2b486f8] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:48.428737 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3799cc51-0e93-4fe8-b5ff-47fac681991c tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:48.429300 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3799cc51-0e93-4fe8-b5ff-47fac681991c tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:48.429758 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3799cc51-0e93-4fe8-b5ff-47fac681991c tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:48.430521 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3799cc51-0e93-4fe8-b5ff-47fac681991c tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:48.430999 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3799cc51-0e93-4fe8-b5ff-47fac681991c tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:48.431439 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3799cc51-0e93-4fe8-b5ff-47fac681991c tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:48.917454 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-894870db-98cd-4184-8b74-6166bf876a9c tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:48.929083 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-894870db-98cd-4184-8b74-6166bf876a9c tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:48.931116 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-894870db-98cd-4184-8b74-6166bf876a9c tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:48.932856 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-894870db-98cd-4184-8b74-6166bf876a9c tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] 10.222.0.60 "GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044" status: 200 len: 1877 microversion: 2.42 time: 0.737738 Sep 14 08:57:48.947132 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1039/2115] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:57:48 2022] GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044 => generated 1877 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:57:48.950691 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-3799cc51-0e93-4fe8-b5ff-47fac681991c tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:48.999933 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-3799cc51-0e93-4fe8-b5ff-47fac681991c tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/ad55193e-b097-4372-9a00-972ed2b486f8" status: 200 len: 1393 microversion: 2.1 time: 0.592384 Sep 14 08:57:49.004447 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1077/2116] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:57:48 2022] GET /compute/v2.1/servers/ad55193e-b097-4372-9a00-972ed2b486f8 => generated 1393 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:57:49.018414 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-5c5eeb7e-5ca7-404d-92cf-c9197b8bd173 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:49.021051 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-5c5eeb7e-5ca7-404d-92cf-c9197b8bd173 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] [instance: 26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:49.028243 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5c5eeb7e-5ca7-404d-92cf-c9197b8bd173 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:49.029091 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5c5eeb7e-5ca7-404d-92cf-c9197b8bd173 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:49.030820 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5c5eeb7e-5ca7-404d-92cf-c9197b8bd173 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:49.031673 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5c5eeb7e-5ca7-404d-92cf-c9197b8bd173 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:49.032247 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5c5eeb7e-5ca7-404d-92cf-c9197b8bd173 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:49.032768 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5c5eeb7e-5ca7-404d-92cf-c9197b8bd173 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:49.147662 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-4de4eb5b-69c3-4cda-85af-6d0bcfaf22d9 tempest-QuotasAdminTestV236-2034157212 tempest-QuotasAdminTestV236-2034157212-project-admin] Action: 'update', calling method: .version_select at 0x7f7d3fbd0c10>, body: {"quota_set": {"ram": "5120"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:57:49.219112 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4de4eb5b-69c3-4cda-85af-6d0bcfaf22d9 tempest-QuotasAdminTestV236-2034157212 tempest-QuotasAdminTestV236-2034157212-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:49.219951 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4de4eb5b-69c3-4cda-85af-6d0bcfaf22d9 tempest-QuotasAdminTestV236-2034157212 tempest-QuotasAdminTestV236-2034157212-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:49.220653 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4de4eb5b-69c3-4cda-85af-6d0bcfaf22d9 tempest-QuotasAdminTestV236-2034157212 tempest-QuotasAdminTestV236-2034157212-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:49.221653 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4de4eb5b-69c3-4cda-85af-6d0bcfaf22d9 tempest-QuotasAdminTestV236-2034157212 tempest-QuotasAdminTestV236-2034157212-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:49.222316 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4de4eb5b-69c3-4cda-85af-6d0bcfaf22d9 tempest-QuotasAdminTestV236-2034157212 tempest-QuotasAdminTestV236-2034157212-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:49.222963 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4de4eb5b-69c3-4cda-85af-6d0bcfaf22d9 tempest-QuotasAdminTestV236-2034157212 tempest-QuotasAdminTestV236-2034157212-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:49.281672 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-4de4eb5b-69c3-4cda-85af-6d0bcfaf22d9 tempest-QuotasAdminTestV236-2034157212 tempest-QuotasAdminTestV236-2034157212-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-quota-sets/4566a1ba698b4c3f9318e9f8d1ee67a0" status: 200 len: 240 microversion: 2.36 time: 0.332800 Sep 14 08:57:49.282552 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1040/2117] 10.222.0.60 () {62 vars in 1303 bytes} [Wed Sep 14 08:57:48 2022] PUT /compute/v2.1/os-quota-sets/4566a1ba698b4c3f9318e9f8d1ee67a0 => generated 240 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 08:57:49.289855 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-0dc1d5a7-9c7d-4ef9-ab89-5ae99a7c9a4e req-0c449e15-7e06-4f18-bd5b-bb27334f7808 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0", "tag": "5779091e-0903-4f0d-81c7-8bdda2add09d"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:57:49.300777 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-0dc1d5a7-9c7d-4ef9-ab89-5ae99a7c9a4e req-0c449e15-7e06-4f18-bd5b-bb27334f7808 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:49.301446 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-0dc1d5a7-9c7d-4ef9-ab89-5ae99a7c9a4e req-0c449e15-7e06-4f18-bd5b-bb27334f7808 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:49.302028 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-0dc1d5a7-9c7d-4ef9-ab89-5ae99a7c9a4e req-0c449e15-7e06-4f18-bd5b-bb27334f7808 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:49.311986 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-5c5eeb7e-5ca7-404d-92cf-c9197b8bd173 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:49.316328 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-0dc1d5a7-9c7d-4ef9-ab89-5ae99a7c9a4e req-0c449e15-7e06-4f18-bd5b-bb27334f7808 service nova] Creating event network-changed:5779091e-0903-4f0d-81c7-8bdda2add09d for instance 26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0 on n-h1-836830-18 Sep 14 08:57:49.321662 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-0dc1d5a7-9c7d-4ef9-ab89-5ae99a7c9a4e req-0c449e15-7e06-4f18-bd5b-bb27334f7808 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037651 Sep 14 08:57:49.322618 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1041/2118] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:57:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:57:49.323225 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-5c5eeb7e-5ca7-404d-92cf-c9197b8bd173 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:49.325038 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-5c5eeb7e-5ca7-404d-92cf-c9197b8bd173 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:49.327018 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-5c5eeb7e-5ca7-404d-92cf-c9197b8bd173 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] 10.222.0.60 "GET /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0" status: 200 len: 1850 microversion: 2.32 time: 0.318954 Sep 14 08:57:49.328081 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1078/2119] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:57:49 2022] GET /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0 => generated 1850 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:57:49.328316 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-24a3be42-e168-4e36-85ec-35c27cf03a8c tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:49.329102 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-24a3be42-e168-4e36-85ec-35c27cf03a8c tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] [instance: 8dd1623b-312c-411d-8f6c-b334195e573b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:49.335769 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-24a3be42-e168-4e36-85ec-35c27cf03a8c tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:49.336648 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-24a3be42-e168-4e36-85ec-35c27cf03a8c tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:49.337300 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-24a3be42-e168-4e36-85ec-35c27cf03a8c tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:49.338165 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-24a3be42-e168-4e36-85ec-35c27cf03a8c tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:49.338774 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-24a3be42-e168-4e36-85ec-35c27cf03a8c tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:49.339372 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-24a3be42-e168-4e36-85ec-35c27cf03a8c tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:49.346426 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1349ba66-3f88-4f37-bcf9-00bc978b53d1 tempest-QuotasAdminTestV236-2034157212 tempest-QuotasAdminTestV236-2034157212-project-admin] Calling method '.version_select at 0x7f7d44346310>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:49.414835 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-24a3be42-e168-4e36-85ec-35c27cf03a8c tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:49.415373 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-24a3be42-e168-4e36-85ec-35c27cf03a8c tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:49.416495 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-24a3be42-e168-4e36-85ec-35c27cf03a8c tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:49.416921 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.objects.instance [None req-24a3be42-e168-4e36-85ec-35c27cf03a8c tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lazy-loading 'fault' on Instance uuid 8dd1623b-312c-411d-8f6c-b334195e573b {{(pid=128759) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 08:57:49.442112 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1349ba66-3f88-4f37-bcf9-00bc978b53d1 tempest-QuotasAdminTestV236-2034157212 tempest-QuotasAdminTestV236-2034157212-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:49.442880 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1349ba66-3f88-4f37-bcf9-00bc978b53d1 tempest-QuotasAdminTestV236-2034157212 tempest-QuotasAdminTestV236-2034157212-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:49.446055 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1349ba66-3f88-4f37-bcf9-00bc978b53d1 tempest-QuotasAdminTestV236-2034157212 tempest-QuotasAdminTestV236-2034157212-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:49.446685 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1349ba66-3f88-4f37-bcf9-00bc978b53d1 tempest-QuotasAdminTestV236-2034157212 tempest-QuotasAdminTestV236-2034157212-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:49.447214 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1349ba66-3f88-4f37-bcf9-00bc978b53d1 tempest-QuotasAdminTestV236-2034157212 tempest-QuotasAdminTestV236-2034157212-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:49.451898 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1349ba66-3f88-4f37-bcf9-00bc978b53d1 tempest-QuotasAdminTestV236-2034157212 tempest-QuotasAdminTestV236-2034157212-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:49.479822 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-1349ba66-3f88-4f37-bcf9-00bc978b53d1 tempest-QuotasAdminTestV236-2034157212 tempest-QuotasAdminTestV236-2034157212-project-admin] 10.222.0.60 "GET /compute/v2.1/os-quota-sets/4566a1ba698b4c3f9318e9f8d1ee67a0/detail" status: 200 len: 672 microversion: 2.36 time: 0.149853 Sep 14 08:57:49.480467 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1079/2120] 10.222.0.60 () {60 vars in 1304 bytes} [Wed Sep 14 08:57:49 2022] GET /compute/v2.1/os-quota-sets/4566a1ba698b4c3f9318e9f8d1ee67a0/detail => generated 672 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 08:57:49.485741 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-171e9716-a9ba-4396-8c5c-d026364e01b6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:49.486536 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-171e9716-a9ba-4396-8c5c-d026364e01b6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 5ee0a6e1-d106-4955-a894-7fe2ac13ffb0] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:49.494737 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-171e9716-a9ba-4396-8c5c-d026364e01b6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:49.495441 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-171e9716-a9ba-4396-8c5c-d026364e01b6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:49.495888 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-171e9716-a9ba-4396-8c5c-d026364e01b6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:49.496823 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-171e9716-a9ba-4396-8c5c-d026364e01b6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:49.497428 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-171e9716-a9ba-4396-8c5c-d026364e01b6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:49.497862 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-171e9716-a9ba-4396-8c5c-d026364e01b6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:49.506905 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-24a3be42-e168-4e36-85ec-35c27cf03a8c tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab2d64c1cb447f9bfd658408aa07e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ecc8c1389847c7bcd9cd5570d990e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:49.526293 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-24a3be42-e168-4e36-85ec-35c27cf03a8c tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] 10.222.0.60 "GET /compute/v2.1/servers/8dd1623b-312c-411d-8f6c-b334195e573b" status: 200 len: 1304 microversion: 2.1 time: 0.200697 Sep 14 08:57:49.529154 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1042/2121] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:57:49 2022] GET /compute/v2.1/servers/8dd1623b-312c-411d-8f6c-b334195e573b => generated 1304 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:57:49.684544 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a4621986-585d-4b25-a904-22e998a915ad tempest-QuotasAdminTestV236-2034157212 tempest-QuotasAdminTestV236-2034157212-project-admin] Action: 'update', calling method: .version_select at 0x7f7d3ff963a0>, body: {"quota_set": {"ram": "2048"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:57:49.766524 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a4621986-585d-4b25-a904-22e998a915ad tempest-QuotasAdminTestV236-2034157212 tempest-QuotasAdminTestV236-2034157212-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:49.767610 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a4621986-585d-4b25-a904-22e998a915ad tempest-QuotasAdminTestV236-2034157212 tempest-QuotasAdminTestV236-2034157212-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:49.768225 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a4621986-585d-4b25-a904-22e998a915ad tempest-QuotasAdminTestV236-2034157212 tempest-QuotasAdminTestV236-2034157212-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:49.769224 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a4621986-585d-4b25-a904-22e998a915ad tempest-QuotasAdminTestV236-2034157212 tempest-QuotasAdminTestV236-2034157212-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:49.770093 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a4621986-585d-4b25-a904-22e998a915ad tempest-QuotasAdminTestV236-2034157212 tempest-QuotasAdminTestV236-2034157212-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:49.770769 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a4621986-585d-4b25-a904-22e998a915ad tempest-QuotasAdminTestV236-2034157212 tempest-QuotasAdminTestV236-2034157212-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:49.810501 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a4621986-585d-4b25-a904-22e998a915ad tempest-QuotasAdminTestV236-2034157212 tempest-QuotasAdminTestV236-2034157212-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:49.811982 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a4621986-585d-4b25-a904-22e998a915ad tempest-QuotasAdminTestV236-2034157212 tempest-QuotasAdminTestV236-2034157212-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:49.812686 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a4621986-585d-4b25-a904-22e998a915ad tempest-QuotasAdminTestV236-2034157212 tempest-QuotasAdminTestV236-2034157212-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:49.813606 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a4621986-585d-4b25-a904-22e998a915ad tempest-QuotasAdminTestV236-2034157212 tempest-QuotasAdminTestV236-2034157212-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:49.814222 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a4621986-585d-4b25-a904-22e998a915ad tempest-QuotasAdminTestV236-2034157212 tempest-QuotasAdminTestV236-2034157212-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:49.814808 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a4621986-585d-4b25-a904-22e998a915ad tempest-QuotasAdminTestV236-2034157212 tempest-QuotasAdminTestV236-2034157212-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:49.855990 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-171e9716-a9ba-4396-8c5c-d026364e01b6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:49.867942 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-171e9716-a9ba-4396-8c5c-d026364e01b6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/5ee0a6e1-d106-4955-a894-7fe2ac13ffb0" status: 200 len: 1308 microversion: 2.1 time: 0.386100 Sep 14 08:57:49.870583 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1080/2122] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:57:49 2022] GET /compute/v2.1/servers/5ee0a6e1-d106-4955-a894-7fe2ac13ffb0 => generated 1308 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:57:49.917067 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a4621986-585d-4b25-a904-22e998a915ad tempest-QuotasAdminTestV236-2034157212 tempest-QuotasAdminTestV236-2034157212-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-quota-sets/4566a1ba698b4c3f9318e9f8d1ee67a0?user_id=29bcde2607064f85b24148f894dc4295" status: 200 len: 240 microversion: 2.36 time: 0.236825 Sep 14 08:57:49.924904 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1043/2123] 10.222.0.60 () {62 vars in 1384 bytes} [Wed Sep 14 08:57:49 2022] PUT /compute/v2.1/os-quota-sets/4566a1ba698b4c3f9318e9f8d1ee67a0?user_id=29bcde2607064f85b24148f894dc4295 => generated 240 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 14 08:57:49.929900 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-99a30124-2f58-4663-9365-94045c7dc460 tempest-QuotasAdminTestV236-2034157212 tempest-QuotasAdminTestV236-2034157212-project-admin] Calling method '.version_select at 0x7f7d4866a940>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:49.964525 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b0e6a62b-b169-44d9-8627-82affdf4f1b6 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:49.965147 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b0e6a62b-b169-44d9-8627-82affdf4f1b6 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] [instance: 59f196e8-c202-4073-8663-2ae19358a044] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:49.974121 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b0e6a62b-b169-44d9-8627-82affdf4f1b6 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:49.975213 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b0e6a62b-b169-44d9-8627-82affdf4f1b6 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:49.976155 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b0e6a62b-b169-44d9-8627-82affdf4f1b6 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:49.977221 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b0e6a62b-b169-44d9-8627-82affdf4f1b6 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:49.977985 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b0e6a62b-b169-44d9-8627-82affdf4f1b6 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:49.978734 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b0e6a62b-b169-44d9-8627-82affdf4f1b6 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:50.056718 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-99a30124-2f58-4663-9365-94045c7dc460 tempest-QuotasAdminTestV236-2034157212 tempest-QuotasAdminTestV236-2034157212-project-admin] 10.222.0.60 "GET /compute/v2.1/os-quota-sets/4566a1ba698b4c3f9318e9f8d1ee67a0?user_id=29bcde2607064f85b24148f894dc4295" status: 200 len: 282 microversion: 2.36 time: 0.130328 Sep 14 08:57:50.058576 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1081/2124] 10.222.0.60 () {60 vars in 1364 bytes} [Wed Sep 14 08:57:49 2022] GET /compute/v2.1/os-quota-sets/4566a1ba698b4c3f9318e9f8d1ee67a0?user_id=29bcde2607064f85b24148f894dc4295 => generated 282 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 08:57:50.064078 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ea5fa74e-7f04-4021-98d4-b3d2cc144e2d tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:50.064891 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-ea5fa74e-7f04-4021-98d4-b3d2cc144e2d tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: ad55193e-b097-4372-9a00-972ed2b486f8] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:50.084133 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ea5fa74e-7f04-4021-98d4-b3d2cc144e2d tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:50.084632 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ea5fa74e-7f04-4021-98d4-b3d2cc144e2d tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:50.085090 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ea5fa74e-7f04-4021-98d4-b3d2cc144e2d tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:50.085804 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ea5fa74e-7f04-4021-98d4-b3d2cc144e2d tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:50.086442 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ea5fa74e-7f04-4021-98d4-b3d2cc144e2d tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:50.086873 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ea5fa74e-7f04-4021-98d4-b3d2cc144e2d tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:50.629722 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b0e6a62b-b169-44d9-8627-82affdf4f1b6 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:50.647799 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b0e6a62b-b169-44d9-8627-82affdf4f1b6 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:50.650996 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b0e6a62b-b169-44d9-8627-82affdf4f1b6 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:50.657724 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b0e6a62b-b169-44d9-8627-82affdf4f1b6 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] 10.222.0.60 "GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044" status: 200 len: 1877 microversion: 2.42 time: 0.697235 Sep 14 08:57:50.660982 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1044/2125] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:57:49 2022] GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044 => generated 1877 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:57:50.685532 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-08d2ed21-d3ba-4b0f-b102-df74260a4f98 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:50.688026 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-08d2ed21-d3ba-4b0f-b102-df74260a4f98 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] [instance: 26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:50.696201 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-ea5fa74e-7f04-4021-98d4-b3d2cc144e2d tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:50.697765 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-08d2ed21-d3ba-4b0f-b102-df74260a4f98 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:50.698568 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-08d2ed21-d3ba-4b0f-b102-df74260a4f98 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:50.699287 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-08d2ed21-d3ba-4b0f-b102-df74260a4f98 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:50.700410 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-08d2ed21-d3ba-4b0f-b102-df74260a4f98 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:50.701098 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-08d2ed21-d3ba-4b0f-b102-df74260a4f98 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:50.701773 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-08d2ed21-d3ba-4b0f-b102-df74260a4f98 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:50.711942 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-ea5fa74e-7f04-4021-98d4-b3d2cc144e2d tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/ad55193e-b097-4372-9a00-972ed2b486f8" status: 200 len: 1393 microversion: 2.1 time: 0.652097 Sep 14 08:57:50.723036 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1082/2126] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:57:50 2022] GET /compute/v2.1/servers/ad55193e-b097-4372-9a00-972ed2b486f8 => generated 1393 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:57:50.752439 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-26cab135-7b41-49db-b311-dd9d96444279 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:50.753236 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-26cab135-7b41-49db-b311-dd9d96444279 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] [instance: 8dd1623b-312c-411d-8f6c-b334195e573b] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:50.761963 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-26cab135-7b41-49db-b311-dd9d96444279 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:50.762718 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-26cab135-7b41-49db-b311-dd9d96444279 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:50.763436 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-26cab135-7b41-49db-b311-dd9d96444279 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:50.764221 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-26cab135-7b41-49db-b311-dd9d96444279 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:50.764843 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-26cab135-7b41-49db-b311-dd9d96444279 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:50.765432 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-26cab135-7b41-49db-b311-dd9d96444279 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:50.790976 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-26cab135-7b41-49db-b311-dd9d96444279 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] HTTP exception thrown: Instance 8dd1623b-312c-411d-8f6c-b334195e573b could not be found. Sep 14 08:57:50.793028 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-26cab135-7b41-49db-b311-dd9d96444279 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Request method failure captured: Sep 14 08:57:50.793028 n-d-836830-18 devstack@n-api.service[128758]: request: GET /compute/v2.1/servers/8dd1623b-312c-411d-8f6c-b334195e573b HTTP/1.1 Sep 14 08:57:50.793028 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 08:57:50.793028 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 08:57:50.793028 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 08:57:50.793028 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 08:57:50.793028 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 08:57:50.793028 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 08:57:50.793028 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 08:57:50.793028 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 08:57:50.793028 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZbiWM1R5WYpSt9euG2PlnA7qDWjrhRqrsnqwPYWGSI_KGZfz48PEOu9D05ddy3lXbM1LJcunJUCyYLoXnIuc1seC2pqCtBLjLte7bsvR0Wco5G9VyKXHUQ1tINDzn6Fiu2VW8mYq4pv8TY2xtpxAWkpsHCE9SOOL_3KL5k14JUhQI8 Sep 14 08:57:50.793028 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 08:57:50.793028 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 08:57:50.793028 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 08:57:50.793028 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 08:57:50.793028 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 08:57:50.793028 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 08:57:50.793028 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 51ecc8c1389847c7bcd9cd5570d990e8 Sep 14 08:57:50.793028 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-ServersAdminTestJSON-1503859587 Sep 14 08:57:50.793028 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 08:57:50.793028 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 08:57:50.793028 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/51ecc8c1389847c7bcd9cd5570d990e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_51ecc8c1389847c7bcd9cd5570d990e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/51ecc8c1389847c7bcd9cd5570d990e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/51ecc8c1389847c7bcd9cd5570d990e8"}]}] Sep 14 08:57:50.793028 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-ServersAdminTestJSON-1503859587 Sep 14 08:57:50.793028 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 51ecc8c1389847c7bcd9cd5570d990e8 Sep 14 08:57:50.793028 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-ServersAdminTestJSON-1503859587 Sep 14 08:57:50.793028 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-ServersAdminTestJSON-1503859587-project Sep 14 08:57:50.793028 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 08:57:50.793028 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 08:57:50.793028 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 0ab2d64c1cb447f9bfd658408aa07e06 Sep 14 08:57:50.793028 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-ServersAdminTestJSON-1503859587-project Sep 14 08:57:50.793028 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 08:57:50.793028 n-d-836830-18 devstack@n-api.service[128758]: exception: Instance 8dd1623b-312c-411d-8f6c-b334195e573b could not be found. Sep 14 08:57:50.793028 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': '8dd1623b-312c-411d-8f6c-b334195e573b'} Sep 14 08:57:50.793028 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:57:50.793028 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:57:50.793028 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 08:57:50.793028 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 08:57:50.793028 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 08:57:50.793028 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 08:57:50.793028 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 08:57:50.793028 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 08:57:50.793028 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 08:57:50.793028 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 08:57:50.793028 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8dd1623b-312c-411d-8f6c-b334195e573b could not be found. Sep 14 08:57:50.793028 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:57:50.793028 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:57:50.793028 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:57:50.793028 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:57:50.793028 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:57:50.793028 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:57:50.793028 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:57:50.793028 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:57:50.793028 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:57:50.793028 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:57:50.793028 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 08:57:50.793028 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 08:57:50.793028 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 08:57:50.793028 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 08:57:50.793028 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 08:57:50.793028 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 08:57:50.793028 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8dd1623b-312c-411d-8f6c-b334195e573b could not be found. Sep 14 08:57:50.793028 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:57:50.793028 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:57:50.793028 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:57:50.796707 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:57:50.796707 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:57:50.796707 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:57:50.796707 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:57:50.796707 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:57:50.796707 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8dd1623b-312c-411d-8f6c-b334195e573b could not be found. Sep 14 08:57:50.796707 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:57:50.799250 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-26cab135-7b41-49db-b311-dd9d96444279 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] Returning 404 to user: Instance 8dd1623b-312c-411d-8f6c-b334195e573b could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:57:50.800509 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-26cab135-7b41-49db-b311-dd9d96444279 tempest-ServersAdminTestJSON-1503859587 tempest-ServersAdminTestJSON-1503859587-project] 10.222.0.60 "GET /compute/v2.1/servers/8dd1623b-312c-411d-8f6c-b334195e573b" status: 404 len: 111 microversion: 2.1 time: 0.076420 Sep 14 08:57:50.804785 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1083/2127] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:57:50 2022] GET /compute/v2.1/servers/8dd1623b-312c-411d-8f6c-b334195e573b => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 08:57:50.912294 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a86a3968-23a4-4bf4-b040-a04127699fb6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:50.914325 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-a86a3968-23a4-4bf4-b040-a04127699fb6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 5ee0a6e1-d106-4955-a894-7fe2ac13ffb0] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:50.925894 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a86a3968-23a4-4bf4-b040-a04127699fb6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:50.926667 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a86a3968-23a4-4bf4-b040-a04127699fb6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:50.929560 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a86a3968-23a4-4bf4-b040-a04127699fb6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:50.931267 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a86a3968-23a4-4bf4-b040-a04127699fb6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:50.933068 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a86a3968-23a4-4bf4-b040-a04127699fb6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:50.935062 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a86a3968-23a4-4bf4-b040-a04127699fb6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:51.243551 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-08d2ed21-d3ba-4b0f-b102-df74260a4f98 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:51.258111 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-08d2ed21-d3ba-4b0f-b102-df74260a4f98 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:51.266960 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-08d2ed21-d3ba-4b0f-b102-df74260a4f98 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:51.281379 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-08d2ed21-d3ba-4b0f-b102-df74260a4f98 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] 10.222.0.60 "GET /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0" status: 200 len: 1871 microversion: 2.32 time: 0.614653 Sep 14 08:57:51.282033 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1045/2128] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:57:50 2022] GET /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0 => generated 1871 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:57:51.364874 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-4a52466f-0a07-4408-a80a-88c46288eccc req-4d012eba-1829-4836-814c-1c8842c1a76c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0", "tag": "e80b0ec1-03fe-4258-9fdb-620fff721a58"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:57:51.405925 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-4a52466f-0a07-4408-a80a-88c46288eccc req-4d012eba-1829-4836-814c-1c8842c1a76c service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:51.406681 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-4a52466f-0a07-4408-a80a-88c46288eccc req-4d012eba-1829-4836-814c-1c8842c1a76c service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:51.407694 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-4a52466f-0a07-4408-a80a-88c46288eccc req-4d012eba-1829-4836-814c-1c8842c1a76c service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:51.430838 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-4a52466f-0a07-4408-a80a-88c46288eccc req-4d012eba-1829-4836-814c-1c8842c1a76c service nova] Creating event network-changed:e80b0ec1-03fe-4258-9fdb-620fff721a58 for instance 26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0 on n-h1-836830-18 Sep 14 08:57:51.444575 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-a86a3968-23a4-4bf4-b040-a04127699fb6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:51.445732 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-4a52466f-0a07-4408-a80a-88c46288eccc req-4d012eba-1829-4836-814c-1c8842c1a76c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080029 Sep 14 08:57:51.447095 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1046/2129] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:57:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:57:51.455850 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-a86a3968-23a4-4bf4-b040-a04127699fb6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/5ee0a6e1-d106-4955-a894-7fe2ac13ffb0" status: 200 len: 1308 microversion: 2.1 time: 0.562922 Sep 14 08:57:51.477142 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1084/2130] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:57:50 2022] GET /compute/v2.1/servers/5ee0a6e1-d106-4955-a894-7fe2ac13ffb0 => generated 1308 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:57:51.690793 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d9fba3cd-5d64-45bd-992f-39e685282a20 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:51.691548 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-d9fba3cd-5d64-45bd-992f-39e685282a20 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] [instance: 59f196e8-c202-4073-8663-2ae19358a044] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:51.701937 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d9fba3cd-5d64-45bd-992f-39e685282a20 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:51.702446 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d9fba3cd-5d64-45bd-992f-39e685282a20 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:51.702887 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d9fba3cd-5d64-45bd-992f-39e685282a20 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:51.703639 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d9fba3cd-5d64-45bd-992f-39e685282a20 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:51.704094 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d9fba3cd-5d64-45bd-992f-39e685282a20 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:51.710851 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d9fba3cd-5d64-45bd-992f-39e685282a20 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:51.738700 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-e57c6d67-2121-4668-8c66-20f5bf5d8708 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:51.739614 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-e57c6d67-2121-4668-8c66-20f5bf5d8708 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: ad55193e-b097-4372-9a00-972ed2b486f8] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:51.751470 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e57c6d67-2121-4668-8c66-20f5bf5d8708 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:51.751972 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e57c6d67-2121-4668-8c66-20f5bf5d8708 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:51.752413 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e57c6d67-2121-4668-8c66-20f5bf5d8708 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:51.753128 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e57c6d67-2121-4668-8c66-20f5bf5d8708 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:51.753587 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e57c6d67-2121-4668-8c66-20f5bf5d8708 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:51.754012 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e57c6d67-2121-4668-8c66-20f5bf5d8708 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:52.129392 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-e57c6d67-2121-4668-8c66-20f5bf5d8708 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:52.141139 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-e57c6d67-2121-4668-8c66-20f5bf5d8708 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/ad55193e-b097-4372-9a00-972ed2b486f8" status: 200 len: 1393 microversion: 2.1 time: 0.406434 Sep 14 08:57:52.143329 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1085/2131] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:57:51 2022] GET /compute/v2.1/servers/ad55193e-b097-4372-9a00-972ed2b486f8 => generated 1393 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:57:52.311803 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-fdca785e-0cef-4405-9085-230066b7cc1c tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:52.312424 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-fdca785e-0cef-4405-9085-230066b7cc1c tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] [instance: 26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:52.328827 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fdca785e-0cef-4405-9085-230066b7cc1c tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:52.329340 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fdca785e-0cef-4405-9085-230066b7cc1c tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:52.329779 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fdca785e-0cef-4405-9085-230066b7cc1c tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:52.330498 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fdca785e-0cef-4405-9085-230066b7cc1c tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:52.330979 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fdca785e-0cef-4405-9085-230066b7cc1c tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:52.331408 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fdca785e-0cef-4405-9085-230066b7cc1c tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:52.764708 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-d9fba3cd-5d64-45bd-992f-39e685282a20 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:52.780336 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-d9fba3cd-5d64-45bd-992f-39e685282a20 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:52.786046 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-fdca785e-0cef-4405-9085-230066b7cc1c tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:52.788217 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-d9fba3cd-5d64-45bd-992f-39e685282a20 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:52.792849 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d9fba3cd-5d64-45bd-992f-39e685282a20 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] 10.222.0.60 "GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044" status: 200 len: 1877 microversion: 2.42 time: 1.105794 Sep 14 08:57:52.794282 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1047/2132] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:57:51 2022] GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044 => generated 1877 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:57:52.796955 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-fdca785e-0cef-4405-9085-230066b7cc1c tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:52.798583 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-fdca785e-0cef-4405-9085-230066b7cc1c tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:52.799949 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-fdca785e-0cef-4405-9085-230066b7cc1c tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] 10.222.0.60 "GET /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0" status: 200 len: 1892 microversion: 2.32 time: 0.492160 Sep 14 08:57:52.800695 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1086/2133] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:57:52 2022] GET /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0 => generated 1892 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 08:57:52.811989 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-accf2af5-58c3-4225-85ed-a446c6666dd1 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:52.817271 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-accf2af5-58c3-4225-85ed-a446c6666dd1 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 5ee0a6e1-d106-4955-a894-7fe2ac13ffb0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:52.838642 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-accf2af5-58c3-4225-85ed-a446c6666dd1 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:52.840406 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-accf2af5-58c3-4225-85ed-a446c6666dd1 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:52.842779 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-accf2af5-58c3-4225-85ed-a446c6666dd1 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:52.845039 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-accf2af5-58c3-4225-85ed-a446c6666dd1 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:52.847269 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-accf2af5-58c3-4225-85ed-a446c6666dd1 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:52.849156 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-accf2af5-58c3-4225-85ed-a446c6666dd1 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:53.167471 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-9a1aba18-478d-4227-9556-09be9af62fcf tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:53.168086 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-9a1aba18-478d-4227-9556-09be9af62fcf tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: ad55193e-b097-4372-9a00-972ed2b486f8] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:53.184412 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9a1aba18-478d-4227-9556-09be9af62fcf tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:53.184931 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9a1aba18-478d-4227-9556-09be9af62fcf tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:53.185380 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9a1aba18-478d-4227-9556-09be9af62fcf tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:53.186680 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9a1aba18-478d-4227-9556-09be9af62fcf tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:53.187250 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9a1aba18-478d-4227-9556-09be9af62fcf tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:53.187734 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9a1aba18-478d-4227-9556-09be9af62fcf tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:53.720235 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-accf2af5-58c3-4225-85ed-a446c6666dd1 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:53.733879 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-accf2af5-58c3-4225-85ed-a446c6666dd1 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/5ee0a6e1-d106-4955-a894-7fe2ac13ffb0" status: 200 len: 1308 microversion: 2.1 time: 0.938382 Sep 14 08:57:53.739368 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1048/2134] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:57:52 2022] GET /compute/v2.1/servers/5ee0a6e1-d106-4955-a894-7fe2ac13ffb0 => generated 1308 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:57:53.750090 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-0107d897-30c9-4700-9a95-40a904424e5b req-ff9e49b0-8f6a-403a-bcc3-62452a3e3016 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0", "tag": "0799d62c-8c0b-4879-8555-e787ef1b353f"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:57:53.771929 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-0107d897-30c9-4700-9a95-40a904424e5b req-ff9e49b0-8f6a-403a-bcc3-62452a3e3016 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:53.773199 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-0107d897-30c9-4700-9a95-40a904424e5b req-ff9e49b0-8f6a-403a-bcc3-62452a3e3016 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:53.773790 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-0107d897-30c9-4700-9a95-40a904424e5b req-ff9e49b0-8f6a-403a-bcc3-62452a3e3016 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:53.789744 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-0107d897-30c9-4700-9a95-40a904424e5b req-ff9e49b0-8f6a-403a-bcc3-62452a3e3016 service nova] Creating event network-changed:0799d62c-8c0b-4879-8555-e787ef1b353f for instance 26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0 on n-h1-836830-18 Sep 14 08:57:53.790381 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-9a1aba18-478d-4227-9556-09be9af62fcf tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:53.799261 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-0107d897-30c9-4700-9a95-40a904424e5b req-ff9e49b0-8f6a-403a-bcc3-62452a3e3016 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058035 Sep 14 08:57:53.801582 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1049/2135] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:57:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:57:53.813875 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-9a1aba18-478d-4227-9556-09be9af62fcf tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/ad55193e-b097-4372-9a00-972ed2b486f8" status: 200 len: 1393 microversion: 2.1 time: 0.650513 Sep 14 08:57:53.822273 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1087/2136] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:57:53 2022] GET /compute/v2.1/servers/ad55193e-b097-4372-9a00-972ed2b486f8 => generated 1393 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:57:53.836595 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-89505c32-009b-43fd-81f8-44d7541a2801 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:53.837218 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-89505c32-009b-43fd-81f8-44d7541a2801 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] [instance: 59f196e8-c202-4073-8663-2ae19358a044] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:53.837813 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-2f9a2696-542b-4120-a79c-0212cfbd6607 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:53.846914 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-2f9a2696-542b-4120-a79c-0212cfbd6607 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] [instance: 26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:53.859824 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-89505c32-009b-43fd-81f8-44d7541a2801 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:53.859824 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-89505c32-009b-43fd-81f8-44d7541a2801 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:53.868817 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2f9a2696-542b-4120-a79c-0212cfbd6607 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:53.870107 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-89505c32-009b-43fd-81f8-44d7541a2801 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:53.870887 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-89505c32-009b-43fd-81f8-44d7541a2801 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:53.872544 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2f9a2696-542b-4120-a79c-0212cfbd6607 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:53.873308 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2f9a2696-542b-4120-a79c-0212cfbd6607 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:53.873435 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-89505c32-009b-43fd-81f8-44d7541a2801 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:53.873836 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-89505c32-009b-43fd-81f8-44d7541a2801 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:53.875972 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2f9a2696-542b-4120-a79c-0212cfbd6607 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:53.876699 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2f9a2696-542b-4120-a79c-0212cfbd6607 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:53.878163 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2f9a2696-542b-4120-a79c-0212cfbd6607 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:54.674389 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-2f9a2696-542b-4120-a79c-0212cfbd6607 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:54.689648 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-89505c32-009b-43fd-81f8-44d7541a2801 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:54.698127 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-2f9a2696-542b-4120-a79c-0212cfbd6607 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:54.699643 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-2f9a2696-542b-4120-a79c-0212cfbd6607 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:54.700934 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-2f9a2696-542b-4120-a79c-0212cfbd6607 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] 10.222.0.60 "GET /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0" status: 200 len: 1892 microversion: 2.32 time: 0.868858 Sep 14 08:57:54.703722 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-89505c32-009b-43fd-81f8-44d7541a2801 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:54.713405 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1050/2137] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:57:53 2022] GET /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0 => generated 1892 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:57:54.715238 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-89505c32-009b-43fd-81f8-44d7541a2801 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:54.716494 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-89505c32-009b-43fd-81f8-44d7541a2801 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] 10.222.0.60 "GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044" status: 200 len: 1877 microversion: 2.42 time: 0.883942 Sep 14 08:57:54.717696 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1088/2138] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:57:53 2022] GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044 => generated 1877 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:57:54.767995 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b9c58c50-ea16-4e50-97f2-43e8973a2c04 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:54.769974 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b9c58c50-ea16-4e50-97f2-43e8973a2c04 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 5ee0a6e1-d106-4955-a894-7fe2ac13ffb0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:54.781070 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b9c58c50-ea16-4e50-97f2-43e8973a2c04 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:54.781696 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b9c58c50-ea16-4e50-97f2-43e8973a2c04 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:54.782277 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b9c58c50-ea16-4e50-97f2-43e8973a2c04 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:54.783467 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b9c58c50-ea16-4e50-97f2-43e8973a2c04 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:54.784133 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b9c58c50-ea16-4e50-97f2-43e8973a2c04 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:54.785165 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b9c58c50-ea16-4e50-97f2-43e8973a2c04 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:54.844097 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-348ae925-8c1f-4eea-b309-d000e6445f72 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:54.846278 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-348ae925-8c1f-4eea-b309-d000e6445f72 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: ad55193e-b097-4372-9a00-972ed2b486f8] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:54.857283 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-348ae925-8c1f-4eea-b309-d000e6445f72 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:54.858067 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-348ae925-8c1f-4eea-b309-d000e6445f72 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:54.858826 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-348ae925-8c1f-4eea-b309-d000e6445f72 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:54.859768 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-348ae925-8c1f-4eea-b309-d000e6445f72 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:54.861093 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-348ae925-8c1f-4eea-b309-d000e6445f72 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:54.861789 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-348ae925-8c1f-4eea-b309-d000e6445f72 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:54.869751 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=100 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:57:55.387405 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b9c58c50-ea16-4e50-97f2-43e8973a2c04 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:55.402799 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b9c58c50-ea16-4e50-97f2-43e8973a2c04 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/5ee0a6e1-d106-4955-a894-7fe2ac13ffb0" status: 200 len: 1308 microversion: 2.1 time: 0.640005 Sep 14 08:57:55.408628 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1051/2139] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:57:54 2022] GET /compute/v2.1/servers/5ee0a6e1-d106-4955-a894-7fe2ac13ffb0 => generated 1308 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:57:55.729394 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-daf54f55-4ffe-4c5e-a363-c364c3980b48 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:55.730048 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-daf54f55-4ffe-4c5e-a363-c364c3980b48 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] [instance: 26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:55.732832 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-348ae925-8c1f-4eea-b309-d000e6445f72 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:55.746219 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-daf54f55-4ffe-4c5e-a363-c364c3980b48 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:55.746767 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-daf54f55-4ffe-4c5e-a363-c364c3980b48 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:55.747311 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-daf54f55-4ffe-4c5e-a363-c364c3980b48 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:55.751300 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-348ae925-8c1f-4eea-b309-d000e6445f72 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/ad55193e-b097-4372-9a00-972ed2b486f8" status: 200 len: 1393 microversion: 2.1 time: 0.913882 Sep 14 08:57:55.764834 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-daf54f55-4ffe-4c5e-a363-c364c3980b48 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:55.765174 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1089/2140] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:57:54 2022] GET /compute/v2.1/servers/ad55193e-b097-4372-9a00-972ed2b486f8 => generated 1393 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:57:55.765277 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-daf54f55-4ffe-4c5e-a363-c364c3980b48 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:55.765277 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-daf54f55-4ffe-4c5e-a363-c364c3980b48 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:55.785162 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-716e40ff-78dd-4f31-b82e-79c6faca8df8 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:55.785931 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-716e40ff-78dd-4f31-b82e-79c6faca8df8 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] [instance: 59f196e8-c202-4073-8663-2ae19358a044] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:55.803296 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-716e40ff-78dd-4f31-b82e-79c6faca8df8 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:55.806837 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-716e40ff-78dd-4f31-b82e-79c6faca8df8 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:55.810123 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-716e40ff-78dd-4f31-b82e-79c6faca8df8 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:55.811025 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-716e40ff-78dd-4f31-b82e-79c6faca8df8 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:55.811502 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-716e40ff-78dd-4f31-b82e-79c6faca8df8 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:55.811927 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-716e40ff-78dd-4f31-b82e-79c6faca8df8 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:56.738196 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-716e40ff-78dd-4f31-b82e-79c6faca8df8 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:56.752041 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-716e40ff-78dd-4f31-b82e-79c6faca8df8 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:56.753653 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-716e40ff-78dd-4f31-b82e-79c6faca8df8 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:56.754889 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-716e40ff-78dd-4f31-b82e-79c6faca8df8 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] 10.222.0.60 "GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044" status: 200 len: 1877 microversion: 2.42 time: 0.992769 Sep 14 08:57:56.767405 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1090/2141] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:57:55 2022] GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044 => generated 1877 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:57:56.803654 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-2ec27dd5-1e74-4030-be13-920a3a92f8d8 req-e419955a-9aab-4fc9-9b95-74fc77616b7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0", "tag": "3ef522d5-07e7-4dc1-89cc-6972e61a2d28"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:57:56.831370 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-2ec27dd5-1e74-4030-be13-920a3a92f8d8 req-e419955a-9aab-4fc9-9b95-74fc77616b7b service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:56.831866 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-2ec27dd5-1e74-4030-be13-920a3a92f8d8 req-e419955a-9aab-4fc9-9b95-74fc77616b7b service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:56.832309 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-2ec27dd5-1e74-4030-be13-920a3a92f8d8 req-e419955a-9aab-4fc9-9b95-74fc77616b7b service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:56.866586 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-2ec27dd5-1e74-4030-be13-920a3a92f8d8 req-e419955a-9aab-4fc9-9b95-74fc77616b7b service nova] Creating event network-changed:3ef522d5-07e7-4dc1-89cc-6972e61a2d28 for instance 26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0 on n-h1-836830-18 Sep 14 08:57:56.897032 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-2ec27dd5-1e74-4030-be13-920a3a92f8d8 req-e419955a-9aab-4fc9-9b95-74fc77616b7b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105144 Sep 14 08:57:56.901311 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1091/2142] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:57:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:57:56.907767 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-2000cd58-1041-482f-b32d-9da898ac7d54 tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:56.908723 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-2000cd58-1041-482f-b32d-9da898ac7d54 tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] [instance: 0b443b50-3413-4a73-80e7-b217776cbcc9] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:56.910337 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:57:56.953090 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2000cd58-1041-482f-b32d-9da898ac7d54 tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:56.953891 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2000cd58-1041-482f-b32d-9da898ac7d54 tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:56.957769 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2000cd58-1041-482f-b32d-9da898ac7d54 tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:56.958762 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2000cd58-1041-482f-b32d-9da898ac7d54 tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:56.959572 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2000cd58-1041-482f-b32d-9da898ac7d54 tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:56.960163 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2000cd58-1041-482f-b32d-9da898ac7d54 tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:57.065334 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-2000cd58-1041-482f-b32d-9da898ac7d54 tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] [instance: 0b443b50-3413-4a73-80e7-b217776cbcc9] Going to try to terminate instance {{(pid=128758) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 08:57:57.149319 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-daf54f55-4ffe-4c5e-a363-c364c3980b48 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:57.179024 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-daf54f55-4ffe-4c5e-a363-c364c3980b48 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:57.181649 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-daf54f55-4ffe-4c5e-a363-c364c3980b48 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:57.183496 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-daf54f55-4ffe-4c5e-a363-c364c3980b48 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] 10.222.0.60 "GET /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0" status: 200 len: 1892 microversion: 2.32 time: 1.459687 Sep 14 08:57:57.184291 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1052/2143] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:57:55 2022] GET /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0 => generated 1892 bytes in 1461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 08:57:57.190682 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-55b88374-d09d-4e88-a159-b4e629010b37 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:57.191946 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-55b88374-d09d-4e88-a159-b4e629010b37 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 5ee0a6e1-d106-4955-a894-7fe2ac13ffb0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:57.199497 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-55b88374-d09d-4e88-a159-b4e629010b37 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:57.200365 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-55b88374-d09d-4e88-a159-b4e629010b37 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:57.201676 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-55b88374-d09d-4e88-a159-b4e629010b37 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:57.203281 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-55b88374-d09d-4e88-a159-b4e629010b37 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:57.204058 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-55b88374-d09d-4e88-a159-b4e629010b37 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:57.204700 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-55b88374-d09d-4e88-a159-b4e629010b37 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:57.244992 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-2000cd58-1041-482f-b32d-9da898ac7d54 tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] 10.222.0.60 "DELETE /compute/v2.1/servers/0b443b50-3413-4a73-80e7-b217776cbcc9" status: 204 len: 0 microversion: 2.1 time: 0.341852 Sep 14 08:57:57.245654 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1092/2144] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 08:57:56 2022] DELETE /compute/v2.1/servers/0b443b50-3413-4a73-80e7-b217776cbcc9 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 08:57:57.257932 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-23319a00-2329-4a12-8c27-95e603e904fd tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:57.258706 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-23319a00-2329-4a12-8c27-95e603e904fd tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: ad55193e-b097-4372-9a00-972ed2b486f8] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:57.277043 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-23319a00-2329-4a12-8c27-95e603e904fd tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:57.277043 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-23319a00-2329-4a12-8c27-95e603e904fd tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:57.277330 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-23319a00-2329-4a12-8c27-95e603e904fd tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:57.278278 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-23319a00-2329-4a12-8c27-95e603e904fd tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:57.278974 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-23319a00-2329-4a12-8c27-95e603e904fd tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:57.283589 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-23319a00-2329-4a12-8c27-95e603e904fd tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:57.731110 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-55b88374-d09d-4e88-a159-b4e629010b37 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:57.747641 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-55b88374-d09d-4e88-a159-b4e629010b37 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/5ee0a6e1-d106-4955-a894-7fe2ac13ffb0" status: 200 len: 1308 microversion: 2.1 time: 0.561388 Sep 14 08:57:57.751505 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1053/2145] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:57:57 2022] GET /compute/v2.1/servers/5ee0a6e1-d106-4955-a894-7fe2ac13ffb0 => generated 1308 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:57:57.775930 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-23319a00-2329-4a12-8c27-95e603e904fd tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:57.785338 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-23319a00-2329-4a12-8c27-95e603e904fd tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/ad55193e-b097-4372-9a00-972ed2b486f8" status: 200 len: 1393 microversion: 2.1 time: 0.535331 Sep 14 08:57:57.786176 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1093/2146] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:57:57 2022] GET /compute/v2.1/servers/ad55193e-b097-4372-9a00-972ed2b486f8 => generated 1393 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:57:57.812057 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b1b2577d-48f3-4535-9d81-893919e20d14 tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:57.813149 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-b1b2577d-48f3-4535-9d81-893919e20d14 tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] [instance: 0b443b50-3413-4a73-80e7-b217776cbcc9] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:57.819701 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b1b2577d-48f3-4535-9d81-893919e20d14 tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:57.820703 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b1b2577d-48f3-4535-9d81-893919e20d14 tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:57.821475 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b1b2577d-48f3-4535-9d81-893919e20d14 tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:57.822430 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b1b2577d-48f3-4535-9d81-893919e20d14 tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:57.823162 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b1b2577d-48f3-4535-9d81-893919e20d14 tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:57.823819 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b1b2577d-48f3-4535-9d81-893919e20d14 tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:57.938802 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a37c4461-363f-4375-8c06-13b31c9e6960 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1243350004", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:57:58.088934 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.network.neutron [None req-a37c4461-363f-4375-8c06-13b31c9e6960 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] validate_networks() for None {{(pid=128759) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 08:57:58.514611 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-b1b2577d-48f3-4535-9d81-893919e20d14 tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1654b8267f4e47bab09acd39386dc502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff1b40a79024bc583b13bcfdaa05fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:58.552956 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-b1b2577d-48f3-4535-9d81-893919e20d14 tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] 10.222.0.60 "GET /compute/v2.1/servers/0b443b50-3413-4a73-80e7-b217776cbcc9" status: 200 len: 1662 microversion: 2.1 time: 0.749830 Sep 14 08:57:58.566882 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1094/2147] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:57:57 2022] GET /compute/v2.1/servers/0b443b50-3413-4a73-80e7-b217776cbcc9 => generated 1662 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:57:58.581718 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-80e28b24-22dc-47f0-b292-ca9b971ed3fc tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:58.583867 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-80e28b24-22dc-47f0-b292-ca9b971ed3fc tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] [instance: 59f196e8-c202-4073-8663-2ae19358a044] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:58.601464 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-80e28b24-22dc-47f0-b292-ca9b971ed3fc tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:58.605027 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-80e28b24-22dc-47f0-b292-ca9b971ed3fc tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:58.607211 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-80e28b24-22dc-47f0-b292-ca9b971ed3fc tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:58.609477 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-80e28b24-22dc-47f0-b292-ca9b971ed3fc tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:58.612912 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-80e28b24-22dc-47f0-b292-ca9b971ed3fc tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:58.614913 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-80e28b24-22dc-47f0-b292-ca9b971ed3fc tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:59.038805 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-a37c4461-363f-4375-8c06-13b31c9e6960 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Flavor limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 08:57:59.039905 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-a37c4461-363f-4375-8c06-13b31c9e6960 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Image limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 08:57:59.040600 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-a37c4461-363f-4375-8c06-13b31c9e6960 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Flavor pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 08:57:59.041211 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-a37c4461-363f-4375-8c06-13b31c9e6960 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Image pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 08:57:59.041878 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-a37c4461-363f-4375-8c06-13b31c9e6960 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 08:57:59.053611 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a37c4461-363f-4375-8c06-13b31c9e6960 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:59.054657 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a37c4461-363f-4375-8c06-13b31c9e6960 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:59.056173 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a37c4461-363f-4375-8c06-13b31c9e6960 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:59.058104 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a37c4461-363f-4375-8c06-13b31c9e6960 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:59.059534 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a37c4461-363f-4375-8c06-13b31c9e6960 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:59.060155 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a37c4461-363f-4375-8c06-13b31c9e6960 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:59.070579 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:57:59.089752 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-a37c4461-363f-4375-8c06-13b31c9e6960 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Getting quotas for project bdb6af957c8f45e5a0996c0e4b1f456a. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 08:57:59.099314 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-a37c4461-363f-4375-8c06-13b31c9e6960 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Getting quotas for user f584701398b64fab808e3cbcc4259a32 and project bdb6af957c8f45e5a0996c0e4b1f456a. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 08:57:59.117304 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-a37c4461-363f-4375-8c06-13b31c9e6960 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Going to run 1 instances... {{(pid=128759) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 08:57:59.120400 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-a37c4461-363f-4375-8c06-13b31c9e6960 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] [instance: a88f52fe-95e7-46fc-b7fa-1714b4449e87] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128759) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 08:57:59.145242 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:57:59.194299 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a37c4461-363f-4375-8c06-13b31c9e6960 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.440680 Sep 14 08:57:59.200270 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1054/2148] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 08:57:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1448 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 08:57:59.208886 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-e4897900-792b-435d-9c0e-e1a7e2bd1dfc req-e53ec013-3380-4dc5-8e26-8260b81c5197 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ee0a6e1-d106-4955-a894-7fe2ac13ffb0", "name": "network-vif-plugged", "status": "completed", "tag": "9fe60e18-05c8-4c91-b9ea-d1e34bad2144"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:57:59.222829 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-e4897900-792b-435d-9c0e-e1a7e2bd1dfc req-e53ec013-3380-4dc5-8e26-8260b81c5197 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:59.223560 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-e4897900-792b-435d-9c0e-e1a7e2bd1dfc req-e53ec013-3380-4dc5-8e26-8260b81c5197 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:59.224002 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-e4897900-792b-435d-9c0e-e1a7e2bd1dfc req-e53ec013-3380-4dc5-8e26-8260b81c5197 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:59.258303 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-e4897900-792b-435d-9c0e-e1a7e2bd1dfc req-e53ec013-3380-4dc5-8e26-8260b81c5197 service nova] Creating event network-vif-plugged:9fe60e18-05c8-4c91-b9ea-d1e34bad2144 for instance 5ee0a6e1-d106-4955-a894-7fe2ac13ffb0 on n-h2-836830-18 Sep 14 08:57:59.264323 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-e4897900-792b-435d-9c0e-e1a7e2bd1dfc req-e53ec013-3380-4dc5-8e26-8260b81c5197 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061755 Sep 14 08:57:59.265320 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1055/2149] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:57:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:57:59.272097 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-709e4d97-1a1e-4230-bbc3-b61dc07d7331 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:59.273268 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-709e4d97-1a1e-4230-bbc3-b61dc07d7331 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] [instance: 26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:59.280732 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-709e4d97-1a1e-4230-bbc3-b61dc07d7331 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:59.281516 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-709e4d97-1a1e-4230-bbc3-b61dc07d7331 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:59.282318 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-709e4d97-1a1e-4230-bbc3-b61dc07d7331 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:59.283480 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-709e4d97-1a1e-4230-bbc3-b61dc07d7331 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:59.284111 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-709e4d97-1a1e-4230-bbc3-b61dc07d7331 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:59.284713 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-709e4d97-1a1e-4230-bbc3-b61dc07d7331 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:59.457794 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-80e28b24-22dc-47f0-b292-ca9b971ed3fc tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:59.476241 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=2 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:57:59.479949 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-80e28b24-22dc-47f0-b292-ca9b971ed3fc tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:59.495083 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-80e28b24-22dc-47f0-b292-ca9b971ed3fc tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:57:59.496557 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-80e28b24-22dc-47f0-b292-ca9b971ed3fc tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] 10.222.0.60 "GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044" status: 200 len: 1877 microversion: 2.42 time: 0.929090 Sep 14 08:57:59.500372 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1095/2150] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:57:58 2022] GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044 => generated 1877 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:57:59.531828 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-631aa8e5-81d4-4284-ae75-21e4e50b41d4 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:57:59.532593 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-631aa8e5-81d4-4284-ae75-21e4e50b41d4 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 5ee0a6e1-d106-4955-a894-7fe2ac13ffb0] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:57:59.543880 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-631aa8e5-81d4-4284-ae75-21e4e50b41d4 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:59.551554 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-631aa8e5-81d4-4284-ae75-21e4e50b41d4 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:59.554126 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-631aa8e5-81d4-4284-ae75-21e4e50b41d4 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:57:59.591524 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-631aa8e5-81d4-4284-ae75-21e4e50b41d4 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:57:59.592673 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-631aa8e5-81d4-4284-ae75-21e4e50b41d4 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.037s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:57:59.593189 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-631aa8e5-81d4-4284-ae75-21e4e50b41d4 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:00.048395 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=6 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:58:00.166885 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-709e4d97-1a1e-4230-bbc3-b61dc07d7331 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:00.184642 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-709e4d97-1a1e-4230-bbc3-b61dc07d7331 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:00.186687 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-709e4d97-1a1e-4230-bbc3-b61dc07d7331 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:00.187911 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-709e4d97-1a1e-4230-bbc3-b61dc07d7331 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] 10.222.0.60 "GET /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0" status: 200 len: 1892 microversion: 2.32 time: 0.921302 Sep 14 08:58:00.188499 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1056/2151] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:57:59 2022] GET /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0 => generated 1892 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:58:00.216454 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-631aa8e5-81d4-4284-ae75-21e4e50b41d4 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:00.222835 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-70f3b2e7-a797-4902-bbc4-d517aeb2b781 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:00.224453 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-70f3b2e7-a797-4902-bbc4-d517aeb2b781 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: ad55193e-b097-4372-9a00-972ed2b486f8] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:00.232867 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-631aa8e5-81d4-4284-ae75-21e4e50b41d4 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/5ee0a6e1-d106-4955-a894-7fe2ac13ffb0" status: 200 len: 1308 microversion: 2.1 time: 0.730561 Sep 14 08:58:00.233748 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1096/2152] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:57:59 2022] GET /compute/v2.1/servers/5ee0a6e1-d106-4955-a894-7fe2ac13ffb0 => generated 1308 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:58:00.243194 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-70f3b2e7-a797-4902-bbc4-d517aeb2b781 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:00.243194 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-70f3b2e7-a797-4902-bbc4-d517aeb2b781 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:00.243562 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-70f3b2e7-a797-4902-bbc4-d517aeb2b781 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:00.244297 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-70f3b2e7-a797-4902-bbc4-d517aeb2b781 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:00.244763 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-70f3b2e7-a797-4902-bbc4-d517aeb2b781 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:00.251574 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-70f3b2e7-a797-4902-bbc4-d517aeb2b781 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:00.258794 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-d718b7d7-9158-4727-a6e9-cd084cd1324a req-6434e5ef-9edf-49bd-996d-8ef9820d7dc6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0", "tag": "6e812f35-e0fc-40c0-b4bf-9cf14c6dd2f3"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:58:00.278917 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-d718b7d7-9158-4727-a6e9-cd084cd1324a req-6434e5ef-9edf-49bd-996d-8ef9820d7dc6 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:00.281774 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-d718b7d7-9158-4727-a6e9-cd084cd1324a req-6434e5ef-9edf-49bd-996d-8ef9820d7dc6 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:00.283893 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-d718b7d7-9158-4727-a6e9-cd084cd1324a req-6434e5ef-9edf-49bd-996d-8ef9820d7dc6 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:00.317340 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-d718b7d7-9158-4727-a6e9-cd084cd1324a req-6434e5ef-9edf-49bd-996d-8ef9820d7dc6 service nova] Creating event network-changed:6e812f35-e0fc-40c0-b4bf-9cf14c6dd2f3 for instance 26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0 on n-h1-836830-18 Sep 14 08:58:00.327595 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-d718b7d7-9158-4727-a6e9-cd084cd1324a req-6434e5ef-9edf-49bd-996d-8ef9820d7dc6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079793 Sep 14 08:58:00.329351 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1097/2153] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:58:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:58:00.340838 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-10712653-f31c-4cce-ad49-0ae111c99cd5 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:00.344108 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-10712653-f31c-4cce-ad49-0ae111c99cd5 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] [instance: a88f52fe-95e7-46fc-b7fa-1714b4449e87] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:00.359424 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-10712653-f31c-4cce-ad49-0ae111c99cd5 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:00.361812 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-10712653-f31c-4cce-ad49-0ae111c99cd5 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:00.362487 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-10712653-f31c-4cce-ad49-0ae111c99cd5 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:00.364652 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-10712653-f31c-4cce-ad49-0ae111c99cd5 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:00.366191 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-10712653-f31c-4cce-ad49-0ae111c99cd5 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:00.366803 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-10712653-f31c-4cce-ad49-0ae111c99cd5 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:00.684006 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-10712653-f31c-4cce-ad49-0ae111c99cd5 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f584701398b64fab808e3cbcc4259a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb6af957c8f45e5a0996c0e4b1f456a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:00.695549 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-10712653-f31c-4cce-ad49-0ae111c99cd5 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] 10.222.0.60 "GET /compute/v2.1/servers/a88f52fe-95e7-46fc-b7fa-1714b4449e87" status: 200 len: 1218 microversion: 2.1 time: 0.364687 Sep 14 08:58:00.698504 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1098/2154] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:58:00 2022] GET /compute/v2.1/servers/a88f52fe-95e7-46fc-b7fa-1714b4449e87 => generated 1218 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:58:00.711130 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-eb342439-8c0d-436c-9f91-6949430c7565 tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:00.711989 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-eb342439-8c0d-436c-9f91-6949430c7565 tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] [instance: 0b443b50-3413-4a73-80e7-b217776cbcc9] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:00.721327 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-eb342439-8c0d-436c-9f91-6949430c7565 tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:00.728385 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-eb342439-8c0d-436c-9f91-6949430c7565 tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:00.729117 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-eb342439-8c0d-436c-9f91-6949430c7565 tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:00.729884 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-eb342439-8c0d-436c-9f91-6949430c7565 tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:00.730347 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-eb342439-8c0d-436c-9f91-6949430c7565 tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:00.730785 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-eb342439-8c0d-436c-9f91-6949430c7565 tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:00.909411 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-70f3b2e7-a797-4902-bbc4-d517aeb2b781 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:00.926861 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-70f3b2e7-a797-4902-bbc4-d517aeb2b781 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/ad55193e-b097-4372-9a00-972ed2b486f8" status: 200 len: 1393 microversion: 2.1 time: 0.732012 Sep 14 08:58:00.927500 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1057/2155] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:58:00 2022] GET /compute/v2.1/servers/ad55193e-b097-4372-9a00-972ed2b486f8 => generated 1393 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:58:00.933632 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-920f2fa0-0369-4fc3-b3c5-d92abcbddc40 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:00.934248 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-920f2fa0-0369-4fc3-b3c5-d92abcbddc40 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] [instance: 59f196e8-c202-4073-8663-2ae19358a044] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:00.951719 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-920f2fa0-0369-4fc3-b3c5-d92abcbddc40 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:00.955796 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-920f2fa0-0369-4fc3-b3c5-d92abcbddc40 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:00.957680 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-920f2fa0-0369-4fc3-b3c5-d92abcbddc40 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:00.958430 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-920f2fa0-0369-4fc3-b3c5-d92abcbddc40 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:00.986158 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-920f2fa0-0369-4fc3-b3c5-d92abcbddc40 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:00.987035 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-920f2fa0-0369-4fc3-b3c5-d92abcbddc40 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:01.039597 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-eb342439-8c0d-436c-9f91-6949430c7565 tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1654b8267f4e47bab09acd39386dc502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff1b40a79024bc583b13bcfdaa05fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:01.056019 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-eb342439-8c0d-436c-9f91-6949430c7565 tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] 10.222.0.60 "GET /compute/v2.1/servers/0b443b50-3413-4a73-80e7-b217776cbcc9" status: 200 len: 1597 microversion: 2.1 time: 0.356026 Sep 14 08:58:01.056595 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1099/2156] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:58:00 2022] GET /compute/v2.1/servers/0b443b50-3413-4a73-80e7-b217776cbcc9 => generated 1597 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:58:01.215332 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-35b0c321-a44c-4789-afe3-638a2499d4e5 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:01.216163 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-35b0c321-a44c-4789-afe3-638a2499d4e5 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] [instance: 26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:01.232955 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-35b0c321-a44c-4789-afe3-638a2499d4e5 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:01.232955 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-35b0c321-a44c-4789-afe3-638a2499d4e5 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:01.233288 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-35b0c321-a44c-4789-afe3-638a2499d4e5 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:01.243410 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-35b0c321-a44c-4789-afe3-638a2499d4e5 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:01.251836 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-35b0c321-a44c-4789-afe3-638a2499d4e5 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:01.256150 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-35b0c321-a44c-4789-afe3-638a2499d4e5 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:02.442340 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-920f2fa0-0369-4fc3-b3c5-d92abcbddc40 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:02.471357 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-920f2fa0-0369-4fc3-b3c5-d92abcbddc40 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:02.481558 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-920f2fa0-0369-4fc3-b3c5-d92abcbddc40 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:02.486196 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-920f2fa0-0369-4fc3-b3c5-d92abcbddc40 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] 10.222.0.60 "GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044" status: 200 len: 1877 microversion: 2.42 time: 1.557060 Sep 14 08:58:02.494041 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1058/2157] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:58:00 2022] GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044 => generated 1877 bytes in 1565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:58:02.538229 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d7a7871c-72c4-4087-82c3-d38b2f110f95 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:02.539079 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-d7a7871c-72c4-4087-82c3-d38b2f110f95 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 5ee0a6e1-d106-4955-a894-7fe2ac13ffb0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:02.551264 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d7a7871c-72c4-4087-82c3-d38b2f110f95 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:02.551773 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d7a7871c-72c4-4087-82c3-d38b2f110f95 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:02.552223 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d7a7871c-72c4-4087-82c3-d38b2f110f95 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:02.552941 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d7a7871c-72c4-4087-82c3-d38b2f110f95 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:02.560245 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d7a7871c-72c4-4087-82c3-d38b2f110f95 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:02.561595 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d7a7871c-72c4-4087-82c3-d38b2f110f95 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:03.180679 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-35b0c321-a44c-4789-afe3-638a2499d4e5 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:03.198316 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-35b0c321-a44c-4789-afe3-638a2499d4e5 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:03.205014 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-35b0c321-a44c-4789-afe3-638a2499d4e5 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:03.206345 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-35b0c321-a44c-4789-afe3-638a2499d4e5 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] 10.222.0.60 "GET /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0" status: 200 len: 1892 microversion: 2.32 time: 1.994951 Sep 14 08:58:03.207748 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1100/2158] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:58:01 2022] GET /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0 => generated 1892 bytes in 1997 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 08:58:03.225848 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-72b1adb8-fbe2-4a92-8d83-9685185f565d req-73ac23ae-0838-4dc2-8192-1c1b078767a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59f196e8-c202-4073-8663-2ae19358a044", "name": "network-vif-plugged", "status": "completed", "tag": "7212ef16-f39e-431e-be33-ee68692137a8"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:58:03.256889 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-72b1adb8-fbe2-4a92-8d83-9685185f565d req-73ac23ae-0838-4dc2-8192-1c1b078767a8 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:03.266550 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-72b1adb8-fbe2-4a92-8d83-9685185f565d req-73ac23ae-0838-4dc2-8192-1c1b078767a8 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:03.267272 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-72b1adb8-fbe2-4a92-8d83-9685185f565d req-73ac23ae-0838-4dc2-8192-1c1b078767a8 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:03.307516 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-72b1adb8-fbe2-4a92-8d83-9685185f565d req-73ac23ae-0838-4dc2-8192-1c1b078767a8 service nova] Creating event network-vif-plugged:7212ef16-f39e-431e-be33-ee68692137a8 for instance 59f196e8-c202-4073-8663-2ae19358a044 on n-h2-836830-18 Sep 14 08:58:03.330513 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-72b1adb8-fbe2-4a92-8d83-9685185f565d req-73ac23ae-0838-4dc2-8192-1c1b078767a8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117200 Sep 14 08:58:03.331863 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1101/2159] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:58:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:58:03.342363 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-f20ac5ed-d186-4de7-bd79-a639de5e8ccc req-c08dd189-505d-4a08-9dfa-55e4d9ab2452 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b443b50-3413-4a73-80e7-b217776cbcc9", "name": "network-vif-deleted", "tag": "da4407a7-d883-49d1-b24d-fdaed2476682"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:58:03.365306 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-f20ac5ed-d186-4de7-bd79-a639de5e8ccc req-c08dd189-505d-4a08-9dfa-55e4d9ab2452 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:03.371305 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-f20ac5ed-d186-4de7-bd79-a639de5e8ccc req-c08dd189-505d-4a08-9dfa-55e4d9ab2452 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:03.371985 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-f20ac5ed-d186-4de7-bd79-a639de5e8ccc req-c08dd189-505d-4a08-9dfa-55e4d9ab2452 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:03.397716 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-f20ac5ed-d186-4de7-bd79-a639de5e8ccc req-c08dd189-505d-4a08-9dfa-55e4d9ab2452 service nova] Creating event network-vif-deleted:da4407a7-d883-49d1-b24d-fdaed2476682 for instance 0b443b50-3413-4a73-80e7-b217776cbcc9 on n-h1-836830-18 Sep 14 08:58:03.410217 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-f20ac5ed-d186-4de7-bd79-a639de5e8ccc req-c08dd189-505d-4a08-9dfa-55e4d9ab2452 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076784 Sep 14 08:58:03.415678 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1102/2160] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:58:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:58:03.429812 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-8a2e7705-3e5a-4579-b2a1-1d4d73cfaa61 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:03.430929 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-8a2e7705-3e5a-4579-b2a1-1d4d73cfaa61 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] [instance: a88f52fe-95e7-46fc-b7fa-1714b4449e87] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:03.440878 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8a2e7705-3e5a-4579-b2a1-1d4d73cfaa61 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:03.441770 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8a2e7705-3e5a-4579-b2a1-1d4d73cfaa61 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:03.442361 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8a2e7705-3e5a-4579-b2a1-1d4d73cfaa61 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:03.443269 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8a2e7705-3e5a-4579-b2a1-1d4d73cfaa61 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:03.443871 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8a2e7705-3e5a-4579-b2a1-1d4d73cfaa61 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:03.444453 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8a2e7705-3e5a-4579-b2a1-1d4d73cfaa61 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:03.726339 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-8a2e7705-3e5a-4579-b2a1-1d4d73cfaa61 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f584701398b64fab808e3cbcc4259a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb6af957c8f45e5a0996c0e4b1f456a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:03.731325 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-d7a7871c-72c4-4087-82c3-d38b2f110f95 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:03.735650 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-8a2e7705-3e5a-4579-b2a1-1d4d73cfaa61 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] 10.222.0.60 "GET /compute/v2.1/servers/a88f52fe-95e7-46fc-b7fa-1714b4449e87" status: 200 len: 1280 microversion: 2.1 time: 0.318356 Sep 14 08:58:03.741093 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1103/2161] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:58:03 2022] GET /compute/v2.1/servers/a88f52fe-95e7-46fc-b7fa-1714b4449e87 => generated 1280 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:58:03.747702 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d7a7871c-72c4-4087-82c3-d38b2f110f95 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/5ee0a6e1-d106-4955-a894-7fe2ac13ffb0" status: 200 len: 1488 microversion: 2.1 time: 1.237618 Sep 14 08:58:03.760592 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1059/2162] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:58:02 2022] GET /compute/v2.1/servers/5ee0a6e1-d106-4955-a894-7fe2ac13ffb0 => generated 1488 bytes in 1241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:58:03.760813 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c9e79330-7a4a-461b-87da-32b0d149fced tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:03.760813 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-c9e79330-7a4a-461b-87da-32b0d149fced tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: ad55193e-b097-4372-9a00-972ed2b486f8] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:03.762469 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-82cb9ec1-dc0f-4a0b-8098-4698b305ebfd tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:03.763128 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-82cb9ec1-dc0f-4a0b-8098-4698b305ebfd tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] [instance: 0b443b50-3413-4a73-80e7-b217776cbcc9] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:03.769532 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c9e79330-7a4a-461b-87da-32b0d149fced tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:03.770028 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c9e79330-7a4a-461b-87da-32b0d149fced tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:03.770487 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c9e79330-7a4a-461b-87da-32b0d149fced tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:03.771228 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c9e79330-7a4a-461b-87da-32b0d149fced tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:03.771683 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c9e79330-7a4a-461b-87da-32b0d149fced tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:03.772101 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c9e79330-7a4a-461b-87da-32b0d149fced tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:03.803262 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-82cb9ec1-dc0f-4a0b-8098-4698b305ebfd tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:03.806751 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-82cb9ec1-dc0f-4a0b-8098-4698b305ebfd tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:03.807953 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-82cb9ec1-dc0f-4a0b-8098-4698b305ebfd tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:03.811417 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-82cb9ec1-dc0f-4a0b-8098-4698b305ebfd tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:03.826437 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-82cb9ec1-dc0f-4a0b-8098-4698b305ebfd tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:03.830010 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-82cb9ec1-dc0f-4a0b-8098-4698b305ebfd tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:03.885233 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-82cb9ec1-dc0f-4a0b-8098-4698b305ebfd tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] HTTP exception thrown: Instance 0b443b50-3413-4a73-80e7-b217776cbcc9 could not be found. Sep 14 08:58:03.887288 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-82cb9ec1-dc0f-4a0b-8098-4698b305ebfd tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Request method failure captured: Sep 14 08:58:03.887288 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/0b443b50-3413-4a73-80e7-b217776cbcc9 HTTP/1.1 Sep 14 08:58:03.887288 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 08:58:03.887288 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 08:58:03.887288 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 08:58:03.887288 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 08:58:03.887288 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 08:58:03.887288 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 08:58:03.887288 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 08:58:03.887288 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 08:58:03.887288 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZcSHRcRba4xZfdUeQqTS-nhdeAiguh6dWY0L9L2D-r4BR7FgTJ7pU5RXNscs-qv9cbmNaog8-wXSw2kzk8qDINbXocHkcDFH2ZtZ7ULQjCA2vN-hRogoT4mGmHSsLTsOBOTDmf9MUD3zO1ZmagFOyN6T054umLbeQcnslsdfluHxMo Sep 14 08:58:03.887288 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 08:58:03.887288 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 08:58:03.887288 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 08:58:03.887288 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 08:58:03.887288 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 08:58:03.887288 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 08:58:03.887288 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: cff1b40a79024bc583b13bcfdaa05fda Sep 14 08:58:03.887288 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ServersTestFqdnHostnames-1102039463 Sep 14 08:58:03.887288 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 08:58:03.887288 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 08:58:03.887288 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/cff1b40a79024bc583b13bcfdaa05fda"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_cff1b40a79024bc583b13bcfdaa05fda"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cff1b40a79024bc583b13bcfdaa05fda"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cff1b40a79024bc583b13bcfdaa05fda"}]}] Sep 14 08:58:03.887288 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ServersTestFqdnHostnames-1102039463 Sep 14 08:58:03.887288 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: cff1b40a79024bc583b13bcfdaa05fda Sep 14 08:58:03.887288 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-1102039463 Sep 14 08:58:03.887288 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ServersTestFqdnHostnames-1102039463-project Sep 14 08:58:03.887288 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 08:58:03.887288 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 08:58:03.887288 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 1654b8267f4e47bab09acd39386dc502 Sep 14 08:58:03.887288 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ServersTestFqdnHostnames-1102039463-project Sep 14 08:58:03.887288 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 08:58:03.887288 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance 0b443b50-3413-4a73-80e7-b217776cbcc9 could not be found. Sep 14 08:58:03.887288 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '0b443b50-3413-4a73-80e7-b217776cbcc9'} Sep 14 08:58:03.887288 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:58:03.887288 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:58:03.887288 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 08:58:03.887288 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 08:58:03.887288 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 08:58:03.887288 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 08:58:03.887288 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 08:58:03.887288 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 08:58:03.887288 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 08:58:03.887288 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 08:58:03.887288 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b443b50-3413-4a73-80e7-b217776cbcc9 could not be found. Sep 14 08:58:03.887288 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:58:03.887288 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:58:03.887288 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:58:03.887288 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:58:03.887288 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:58:03.887288 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:58:03.887288 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:58:03.887288 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:58:03.887288 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:58:03.887288 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:58:03.887288 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 08:58:03.887288 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 08:58:03.887288 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 08:58:03.887288 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 08:58:03.887288 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 08:58:03.887288 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 08:58:03.887288 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b443b50-3413-4a73-80e7-b217776cbcc9 could not be found. Sep 14 08:58:03.887288 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:58:03.887288 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:58:03.887288 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:58:03.892732 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:58:03.892732 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:58:03.892732 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:58:03.892732 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:58:03.892732 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:58:03.892732 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b443b50-3413-4a73-80e7-b217776cbcc9 could not be found. Sep 14 08:58:03.892732 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:58:03.892732 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-82cb9ec1-dc0f-4a0b-8098-4698b305ebfd tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Returning 404 to user: Instance 0b443b50-3413-4a73-80e7-b217776cbcc9 could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:58:03.892732 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-82cb9ec1-dc0f-4a0b-8098-4698b305ebfd tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] 10.222.0.60 "GET /compute/v2.1/servers/0b443b50-3413-4a73-80e7-b217776cbcc9" status: 404 len: 111 microversion: 2.1 time: 0.140132 Sep 14 08:58:03.898615 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1060/2163] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:58:03 2022] GET /compute/v2.1/servers/0b443b50-3413-4a73-80e7-b217776cbcc9 => generated 111 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 08:58:03.915366 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9564466f-5e9d-4519-958a-ab388677e499 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:03.917256 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-9564466f-5e9d-4519-958a-ab388677e499 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] [instance: 59f196e8-c202-4073-8663-2ae19358a044] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:03.933584 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9564466f-5e9d-4519-958a-ab388677e499 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:03.934089 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9564466f-5e9d-4519-958a-ab388677e499 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:03.937442 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9564466f-5e9d-4519-958a-ab388677e499 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:03.938226 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9564466f-5e9d-4519-958a-ab388677e499 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:03.939698 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9564466f-5e9d-4519-958a-ab388677e499 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:03.945620 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9564466f-5e9d-4519-958a-ab388677e499 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:04.757263 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-c9e79330-7a4a-461b-87da-32b0d149fced tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:04.769833 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-c9e79330-7a4a-461b-87da-32b0d149fced tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/ad55193e-b097-4372-9a00-972ed2b486f8" status: 200 len: 1393 microversion: 2.1 time: 1.021940 Sep 14 08:58:04.772638 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1104/2164] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:58:03 2022] GET /compute/v2.1/servers/ad55193e-b097-4372-9a00-972ed2b486f8 => generated 1393 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:58:04.790514 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-374782a4-ca15-45ad-8cd7-11c29d2bc9bc req-b67ba55b-3e4b-45ff-b7e2-9b003a301401 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0", "tag": "3de3b6b2-e333-42d2-a891-af01ff3ccfd0"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:58:04.804177 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-374782a4-ca15-45ad-8cd7-11c29d2bc9bc req-b67ba55b-3e4b-45ff-b7e2-9b003a301401 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:04.805036 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-374782a4-ca15-45ad-8cd7-11c29d2bc9bc req-b67ba55b-3e4b-45ff-b7e2-9b003a301401 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:04.805665 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-374782a4-ca15-45ad-8cd7-11c29d2bc9bc req-b67ba55b-3e4b-45ff-b7e2-9b003a301401 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:04.819030 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-374782a4-ca15-45ad-8cd7-11c29d2bc9bc req-b67ba55b-3e4b-45ff-b7e2-9b003a301401 service nova] Creating event network-changed:3de3b6b2-e333-42d2-a891-af01ff3ccfd0 for instance 26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0 on n-h1-836830-18 Sep 14 08:58:04.824270 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-374782a4-ca15-45ad-8cd7-11c29d2bc9bc req-b67ba55b-3e4b-45ff-b7e2-9b003a301401 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050153 Sep 14 08:58:04.825552 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1105/2165] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:58:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:58:04.831890 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-59cc9159-5031-4e4e-84ff-f59326b5e617 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:04.833020 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-59cc9159-5031-4e4e-84ff-f59326b5e617 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 2334f491-8233-4171-906f-e0c46d0a3fb2] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:04.839863 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-59cc9159-5031-4e4e-84ff-f59326b5e617 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:04.840629 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-59cc9159-5031-4e4e-84ff-f59326b5e617 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:04.841312 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-59cc9159-5031-4e4e-84ff-f59326b5e617 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:04.842917 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-59cc9159-5031-4e4e-84ff-f59326b5e617 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:04.844390 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-59cc9159-5031-4e4e-84ff-f59326b5e617 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:04.845037 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-59cc9159-5031-4e4e-84ff-f59326b5e617 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:05.162606 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-9564466f-5e9d-4519-958a-ab388677e499 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:05.181500 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-9564466f-5e9d-4519-958a-ab388677e499 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:05.184012 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-9564466f-5e9d-4519-958a-ab388677e499 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:05.190895 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-9564466f-5e9d-4519-958a-ab388677e499 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] 10.222.0.60 "GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044" status: 200 len: 1877 microversion: 2.42 time: 1.289506 Sep 14 08:58:05.196209 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1061/2166] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:58:03 2022] GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044 => generated 1877 bytes in 1297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:58:05.207073 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-bc1be055-d445-40cd-8755-81314caa61af tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] Calling method '.version_select at 0x7f7d3ffb3310>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:05.292442 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-bc1be055-d445-40cd-8755-81314caa61af tempest-ServersTestFqdnHostnames-1102039463 tempest-ServersTestFqdnHostnames-1102039463-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-849605918" status: 202 len: 0 microversion: 2.1 time: 0.090026 Sep 14 08:58:05.297914 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1062/2167] 10.222.0.60 () {58 vars in 1218 bytes} [Wed Sep 14 08:58:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-849605918 => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 08:58:05.304884 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-69cac018-e6dc-44cb-89e2-56389eb22afe tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:05.305888 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-69cac018-e6dc-44cb-89e2-56389eb22afe tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] [instance: 26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:05.313323 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-69cac018-e6dc-44cb-89e2-56389eb22afe tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:05.314299 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-69cac018-e6dc-44cb-89e2-56389eb22afe tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:05.314979 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-69cac018-e6dc-44cb-89e2-56389eb22afe tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:05.315941 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-69cac018-e6dc-44cb-89e2-56389eb22afe tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:05.316632 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-69cac018-e6dc-44cb-89e2-56389eb22afe tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:05.317281 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-69cac018-e6dc-44cb-89e2-56389eb22afe tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:05.641888 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-59cc9159-5031-4e4e-84ff-f59326b5e617 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:05.656849 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-59cc9159-5031-4e4e-84ff-f59326b5e617 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/2334f491-8233-4171-906f-e0c46d0a3fb2" status: 200 len: 1488 microversion: 2.1 time: 0.823331 Sep 14 08:58:05.659911 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1106/2168] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:58:04 2022] GET /compute/v2.1/servers/2334f491-8233-4171-906f-e0c46d0a3fb2 => generated 1488 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:58:05.666967 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d342bf9b-affa-4b3a-ae34-273f2357be36 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:05.667358 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-d342bf9b-affa-4b3a-ae34-273f2357be36 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] [instance: a88f52fe-95e7-46fc-b7fa-1714b4449e87] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:05.675264 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d342bf9b-affa-4b3a-ae34-273f2357be36 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:05.676439 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d342bf9b-affa-4b3a-ae34-273f2357be36 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:05.677367 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d342bf9b-affa-4b3a-ae34-273f2357be36 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:05.678577 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d342bf9b-affa-4b3a-ae34-273f2357be36 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:05.679648 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d342bf9b-affa-4b3a-ae34-273f2357be36 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:05.680656 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d342bf9b-affa-4b3a-ae34-273f2357be36 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:05.747044 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:58:06.118056 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-69cac018-e6dc-44cb-89e2-56389eb22afe tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:06.128749 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-69cac018-e6dc-44cb-89e2-56389eb22afe tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:06.130456 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-69cac018-e6dc-44cb-89e2-56389eb22afe tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:06.131892 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-69cac018-e6dc-44cb-89e2-56389eb22afe tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] 10.222.0.60 "GET /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0" status: 200 len: 1892 microversion: 2.32 time: 0.833204 Sep 14 08:58:06.143345 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1063/2169] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:58:05 2022] GET /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0 => generated 1892 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:58:06.149832 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-cbd96d31-30c0-4904-a6f6-220b76b9bfc7 req-9c490f02-8306-4015-883a-018cb938a76c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad55193e-b097-4372-9a00-972ed2b486f8", "name": "network-vif-unplugged", "status": "completed", "tag": "86eca38d-0fbc-40dc-8c19-2e0f4d671871"}, {"name": "network-changed", "server_uuid": "ad55193e-b097-4372-9a00-972ed2b486f8", "tag": "86eca38d-0fbc-40dc-8c19-2e0f4d671871"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:58:06.166905 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-cbd96d31-30c0-4904-a6f6-220b76b9bfc7 req-9c490f02-8306-4015-883a-018cb938a76c service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:06.168842 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-cbd96d31-30c0-4904-a6f6-220b76b9bfc7 req-9c490f02-8306-4015-883a-018cb938a76c service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:06.169439 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-cbd96d31-30c0-4904-a6f6-220b76b9bfc7 req-9c490f02-8306-4015-883a-018cb938a76c service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:06.191182 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-cbd96d31-30c0-4904-a6f6-220b76b9bfc7 req-9c490f02-8306-4015-883a-018cb938a76c service nova] Creating event network-vif-unplugged:86eca38d-0fbc-40dc-8c19-2e0f4d671871 for instance ad55193e-b097-4372-9a00-972ed2b486f8 on n-h1-836830-18 Sep 14 08:58:06.192197 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-cbd96d31-30c0-4904-a6f6-220b76b9bfc7 req-9c490f02-8306-4015-883a-018cb938a76c service nova] Creating event network-changed:86eca38d-0fbc-40dc-8c19-2e0f4d671871 for instance ad55193e-b097-4372-9a00-972ed2b486f8 on n-h1-836830-18 Sep 14 08:58:06.199711 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-cbd96d31-30c0-4904-a6f6-220b76b9bfc7 req-9c490f02-8306-4015-883a-018cb938a76c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.053385 Sep 14 08:58:06.203535 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1064/2170] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:58:06 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:58:06.210653 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f0074b39-7c9a-413c-b608-5d42fe1119a8 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:06.214520 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f0074b39-7c9a-413c-b608-5d42fe1119a8 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] [instance: 0b54f1c2-0d9c-4396-8c79-1e43b612b2ba] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:06.224790 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f0074b39-7c9a-413c-b608-5d42fe1119a8 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:06.225612 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f0074b39-7c9a-413c-b608-5d42fe1119a8 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:06.226241 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f0074b39-7c9a-413c-b608-5d42fe1119a8 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:06.227180 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f0074b39-7c9a-413c-b608-5d42fe1119a8 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:06.227810 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f0074b39-7c9a-413c-b608-5d42fe1119a8 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:06.228985 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f0074b39-7c9a-413c-b608-5d42fe1119a8 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:06.274566 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f0074b39-7c9a-413c-b608-5d42fe1119a8 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] 10.222.0.60 "GET /compute/v2.1/servers/0b54f1c2-0d9c-4396-8c79-1e43b612b2ba/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069218 Sep 14 08:58:06.277161 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1065/2171] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 14 08:58:06 2022] GET /compute/v2.1/servers/0b54f1c2-0d9c-4396-8c79-1e43b612b2ba/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:58:06.283973 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b791ac08-0b17-42e0-92e4-56867b15a899 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:06.285086 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b791ac08-0b17-42e0-92e4-56867b15a899 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 5ee0a6e1-d106-4955-a894-7fe2ac13ffb0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:06.298616 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b791ac08-0b17-42e0-92e4-56867b15a899 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:06.299399 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b791ac08-0b17-42e0-92e4-56867b15a899 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:06.300470 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b791ac08-0b17-42e0-92e4-56867b15a899 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:06.302209 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b791ac08-0b17-42e0-92e4-56867b15a899 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:06.303693 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b791ac08-0b17-42e0-92e4-56867b15a899 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:06.304458 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b791ac08-0b17-42e0-92e4-56867b15a899 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:06.371843 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-d342bf9b-affa-4b3a-ae34-273f2357be36 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f584701398b64fab808e3cbcc4259a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb6af957c8f45e5a0996c0e4b1f456a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:06.383928 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-d342bf9b-affa-4b3a-ae34-273f2357be36 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] 10.222.0.60 "GET /compute/v2.1/servers/a88f52fe-95e7-46fc-b7fa-1714b4449e87" status: 200 len: 1322 microversion: 2.1 time: 0.724874 Sep 14 08:58:06.385642 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1107/2172] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:58:05 2022] GET /compute/v2.1/servers/a88f52fe-95e7-46fc-b7fa-1714b4449e87 => generated 1322 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:58:06.391422 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-7bc27147-5c04-4c27-83bc-a7c70e4f1f91 req-1841aac7-688f-40e2-91ef-e5ffcf131626 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59f196e8-c202-4073-8663-2ae19358a044", "name": "network-vif-plugged", "status": "completed", "tag": "8af9859a-c5d7-4d91-96a4-e415d547a0e7"}, {"server_uuid": "59f196e8-c202-4073-8663-2ae19358a044", "name": "network-vif-plugged", "status": "completed", "tag": "6bc29bf6-117b-4334-9caf-61bc5a58835c"}, {"server_uuid": "59f196e8-c202-4073-8663-2ae19358a044", "name": "network-vif-plugged", "status": "completed", "tag": "2facbe7c-1fe7-4366-91c7-d589e067102f"}, {"server_uuid": "59f196e8-c202-4073-8663-2ae19358a044", "name": "network-vif-plugged", "status": "completed", "tag": "d8a4da08-c0b3-4a64-8d73-ee5871258250"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:58:06.404644 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-7bc27147-5c04-4c27-83bc-a7c70e4f1f91 req-1841aac7-688f-40e2-91ef-e5ffcf131626 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:06.405772 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-7bc27147-5c04-4c27-83bc-a7c70e4f1f91 req-1841aac7-688f-40e2-91ef-e5ffcf131626 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:06.406305 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-7bc27147-5c04-4c27-83bc-a7c70e4f1f91 req-1841aac7-688f-40e2-91ef-e5ffcf131626 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:06.690429 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-7bc27147-5c04-4c27-83bc-a7c70e4f1f91 req-1841aac7-688f-40e2-91ef-e5ffcf131626 service nova] Creating event network-vif-plugged:8af9859a-c5d7-4d91-96a4-e415d547a0e7 for instance 59f196e8-c202-4073-8663-2ae19358a044 on n-h2-836830-18 Sep 14 08:58:06.691102 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-7bc27147-5c04-4c27-83bc-a7c70e4f1f91 req-1841aac7-688f-40e2-91ef-e5ffcf131626 service nova] Creating event network-vif-plugged:6bc29bf6-117b-4334-9caf-61bc5a58835c for instance 59f196e8-c202-4073-8663-2ae19358a044 on n-h2-836830-18 Sep 14 08:58:06.691736 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-7bc27147-5c04-4c27-83bc-a7c70e4f1f91 req-1841aac7-688f-40e2-91ef-e5ffcf131626 service nova] Creating event network-vif-plugged:2facbe7c-1fe7-4366-91c7-d589e067102f for instance 59f196e8-c202-4073-8663-2ae19358a044 on n-h2-836830-18 Sep 14 08:58:06.692343 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-7bc27147-5c04-4c27-83bc-a7c70e4f1f91 req-1841aac7-688f-40e2-91ef-e5ffcf131626 service nova] Creating event network-vif-plugged:d8a4da08-c0b3-4a64-8d73-ee5871258250 for instance 59f196e8-c202-4073-8663-2ae19358a044 on n-h2-836830-18 Sep 14 08:58:06.699526 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-7bc27147-5c04-4c27-83bc-a7c70e4f1f91 req-1841aac7-688f-40e2-91ef-e5ffcf131626 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.312373 Sep 14 08:58:06.700931 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1108/2173] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:58:06 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:58:06.707489 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-f803f45a-2d23-464f-ab5b-a11f35528287 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:06.708568 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-f803f45a-2d23-464f-ab5b-a11f35528287 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: ad55193e-b097-4372-9a00-972ed2b486f8] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:06.716339 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f803f45a-2d23-464f-ab5b-a11f35528287 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:06.717914 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f803f45a-2d23-464f-ab5b-a11f35528287 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:06.718577 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f803f45a-2d23-464f-ab5b-a11f35528287 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:06.719575 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f803f45a-2d23-464f-ab5b-a11f35528287 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:06.720256 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f803f45a-2d23-464f-ab5b-a11f35528287 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:06.720902 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f803f45a-2d23-464f-ab5b-a11f35528287 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:07.023539 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b791ac08-0b17-42e0-92e4-56867b15a899 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:07.044586 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b791ac08-0b17-42e0-92e4-56867b15a899 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/5ee0a6e1-d106-4955-a894-7fe2ac13ffb0" status: 200 len: 1488 microversion: 2.1 time: 0.765521 Sep 14 08:58:07.045747 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1066/2174] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:58:06 2022] GET /compute/v2.1/servers/5ee0a6e1-d106-4955-a894-7fe2ac13ffb0 => generated 1488 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:58:07.054456 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d31d6cab-a037-44f8-8484-3d731d463cc3 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:07.055967 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-d31d6cab-a037-44f8-8484-3d731d463cc3 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] [instance: 59f196e8-c202-4073-8663-2ae19358a044] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:07.067638 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d31d6cab-a037-44f8-8484-3d731d463cc3 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:07.068387 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d31d6cab-a037-44f8-8484-3d731d463cc3 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:07.069588 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d31d6cab-a037-44f8-8484-3d731d463cc3 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:07.071072 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d31d6cab-a037-44f8-8484-3d731d463cc3 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:07.072488 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d31d6cab-a037-44f8-8484-3d731d463cc3 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:07.073769 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d31d6cab-a037-44f8-8484-3d731d463cc3 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:07.254648 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-f803f45a-2d23-464f-ab5b-a11f35528287 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:07.268944 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-f803f45a-2d23-464f-ab5b-a11f35528287 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/ad55193e-b097-4372-9a00-972ed2b486f8" status: 200 len: 1393 microversion: 2.1 time: 0.566322 Sep 14 08:58:07.270867 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1109/2175] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:58:06 2022] GET /compute/v2.1/servers/ad55193e-b097-4372-9a00-972ed2b486f8 => generated 1393 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:58:07.291565 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-f36fec8a-ef86-4a5a-a940-2c57f5555d19 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:07.292358 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-f36fec8a-ef86-4a5a-a940-2c57f5555d19 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] [instance: 0b54f1c2-0d9c-4396-8c79-1e43b612b2ba] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:07.304095 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f36fec8a-ef86-4a5a-a940-2c57f5555d19 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:07.304926 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f36fec8a-ef86-4a5a-a940-2c57f5555d19 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:07.305800 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f36fec8a-ef86-4a5a-a940-2c57f5555d19 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:07.306911 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f36fec8a-ef86-4a5a-a940-2c57f5555d19 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:07.307979 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f36fec8a-ef86-4a5a-a940-2c57f5555d19 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:07.308623 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f36fec8a-ef86-4a5a-a940-2c57f5555d19 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:07.507254 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.objects.instance [None req-f36fec8a-ef86-4a5a-a940-2c57f5555d19 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Lazy-loading 'services' on Instance uuid 0b54f1c2-0d9c-4396-8c79-1e43b612b2ba {{(pid=128758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 08:58:07.661997 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-d31d6cab-a037-44f8-8484-3d731d463cc3 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:07.673262 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-f36fec8a-ef86-4a5a-a940-2c57f5555d19 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] 10.222.0.60 "DELETE /compute/v2.1/servers/0b54f1c2-0d9c-4396-8c79-1e43b612b2ba/os-volume_attachments/caf4713e-7ff3-4c9e-b74f-5117099bf8b1" status: 202 len: 0 microversion: 2.1 time: 0.399450 Sep 14 08:58:07.676049 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-d31d6cab-a037-44f8-8484-3d731d463cc3 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:07.677690 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1110/2176] 10.222.0.60 () {58 vars in 1416 bytes} [Wed Sep 14 08:58:07 2022] DELETE /compute/v2.1/servers/0b54f1c2-0d9c-4396-8c79-1e43b612b2ba/os-volume_attachments/caf4713e-7ff3-4c9e-b74f-5117099bf8b1 => generated 0 bytes in 406 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 08:58:07.684340 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-d31d6cab-a037-44f8-8484-3d731d463cc3 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:07.691806 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d31d6cab-a037-44f8-8484-3d731d463cc3 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] 10.222.0.60 "GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044" status: 200 len: 1877 microversion: 2.42 time: 0.643454 Sep 14 08:58:07.706981 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1067/2177] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:58:07 2022] GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044 => generated 1877 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:58:07.706981 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-db43607b-81b4-4890-bb41-9c8d3aa7d7d2 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:07.706981 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-db43607b-81b4-4890-bb41-9c8d3aa7d7d2 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] [instance: 26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:07.707498 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-5f534eee-ad72-4435-be8c-0321b2f5ed29 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:07.707498 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-5f534eee-ad72-4435-be8c-0321b2f5ed29 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 5ee0a6e1-d106-4955-a894-7fe2ac13ffb0] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:07.721722 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-db43607b-81b4-4890-bb41-9c8d3aa7d7d2 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:07.725459 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-db43607b-81b4-4890-bb41-9c8d3aa7d7d2 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:07.728358 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-db43607b-81b4-4890-bb41-9c8d3aa7d7d2 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:07.729263 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-db43607b-81b4-4890-bb41-9c8d3aa7d7d2 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:07.729865 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-db43607b-81b4-4890-bb41-9c8d3aa7d7d2 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:07.733945 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-db43607b-81b4-4890-bb41-9c8d3aa7d7d2 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:07.738874 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5f534eee-ad72-4435-be8c-0321b2f5ed29 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:07.740644 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5f534eee-ad72-4435-be8c-0321b2f5ed29 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:07.743822 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5f534eee-ad72-4435-be8c-0321b2f5ed29 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:07.744638 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5f534eee-ad72-4435-be8c-0321b2f5ed29 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:07.745114 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5f534eee-ad72-4435-be8c-0321b2f5ed29 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:07.749443 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5f534eee-ad72-4435-be8c-0321b2f5ed29 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:07.859400 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-5f534eee-ad72-4435-be8c-0321b2f5ed29 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 5ee0a6e1-d106-4955-a894-7fe2ac13ffb0] Going to try to terminate instance {{(pid=128758) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 08:58:08.021037 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-5f534eee-ad72-4435-be8c-0321b2f5ed29 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "DELETE /compute/v2.1/servers/5ee0a6e1-d106-4955-a894-7fe2ac13ffb0" status: 204 len: 0 microversion: 2.1 time: 0.340879 Sep 14 08:58:08.022094 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1111/2178] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 08:58:07 2022] DELETE /compute/v2.1/servers/5ee0a6e1-d106-4955-a894-7fe2ac13ffb0 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 08:58:08.028357 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-42d6aeac-66e5-4051-98d2-a60ce19a5260 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:08.029337 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-42d6aeac-66e5-4051-98d2-a60ce19a5260 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] [instance: a88f52fe-95e7-46fc-b7fa-1714b4449e87] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:08.035964 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-42d6aeac-66e5-4051-98d2-a60ce19a5260 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:08.036997 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-42d6aeac-66e5-4051-98d2-a60ce19a5260 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:08.037621 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-42d6aeac-66e5-4051-98d2-a60ce19a5260 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:08.038494 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-42d6aeac-66e5-4051-98d2-a60ce19a5260 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:08.039150 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-42d6aeac-66e5-4051-98d2-a60ce19a5260 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:08.041131 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-42d6aeac-66e5-4051-98d2-a60ce19a5260 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:08.308354 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-db43607b-81b4-4890-bb41-9c8d3aa7d7d2 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:08.323019 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-db43607b-81b4-4890-bb41-9c8d3aa7d7d2 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:08.329542 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-db43607b-81b4-4890-bb41-9c8d3aa7d7d2 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:08.330783 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-db43607b-81b4-4890-bb41-9c8d3aa7d7d2 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] 10.222.0.60 "GET /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0" status: 200 len: 1880 microversion: 2.32 time: 0.635428 Sep 14 08:58:08.331409 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1068/2179] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:58:07 2022] GET /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0 => generated 1880 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:58:08.350379 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-67e17fa8-d90a-4262-91c4-4f512569c077 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:08.351283 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-67e17fa8-d90a-4262-91c4-4f512569c077 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 5ee0a6e1-d106-4955-a894-7fe2ac13ffb0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:08.364250 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-67e17fa8-d90a-4262-91c4-4f512569c077 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:08.365002 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-67e17fa8-d90a-4262-91c4-4f512569c077 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:08.365601 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-67e17fa8-d90a-4262-91c4-4f512569c077 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:08.366637 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-67e17fa8-d90a-4262-91c4-4f512569c077 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:08.367276 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-67e17fa8-d90a-4262-91c4-4f512569c077 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:08.367884 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-67e17fa8-d90a-4262-91c4-4f512569c077 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:08.568350 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-42d6aeac-66e5-4051-98d2-a60ce19a5260 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f584701398b64fab808e3cbcc4259a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb6af957c8f45e5a0996c0e4b1f456a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:08.587171 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-42d6aeac-66e5-4051-98d2-a60ce19a5260 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] 10.222.0.60 "GET /compute/v2.1/servers/a88f52fe-95e7-46fc-b7fa-1714b4449e87" status: 200 len: 1322 microversion: 2.1 time: 0.559028 Sep 14 08:58:08.587878 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1112/2180] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:58:08 2022] GET /compute/v2.1/servers/a88f52fe-95e7-46fc-b7fa-1714b4449e87 => generated 1322 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:58:08.593752 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-358fa474-6f4e-4bc8-b944-37ff8b22c9d4 req-e698b1da-ddcd-4b1d-b4e4-94fec786017b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0", "tag": "01fa0eb2-52e8-4cfe-8e35-883e6c82aeb1"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:58:08.625082 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-358fa474-6f4e-4bc8-b944-37ff8b22c9d4 req-e698b1da-ddcd-4b1d-b4e4-94fec786017b service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:08.625594 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-358fa474-6f4e-4bc8-b944-37ff8b22c9d4 req-e698b1da-ddcd-4b1d-b4e4-94fec786017b service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:08.626125 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-358fa474-6f4e-4bc8-b944-37ff8b22c9d4 req-e698b1da-ddcd-4b1d-b4e4-94fec786017b service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:08.646304 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-358fa474-6f4e-4bc8-b944-37ff8b22c9d4 req-e698b1da-ddcd-4b1d-b4e4-94fec786017b service nova] Creating event network-changed:01fa0eb2-52e8-4cfe-8e35-883e6c82aeb1 for instance 26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0 on n-h1-836830-18 Sep 14 08:58:08.660638 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-358fa474-6f4e-4bc8-b944-37ff8b22c9d4 req-e698b1da-ddcd-4b1d-b4e4-94fec786017b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071095 Sep 14 08:58:08.661275 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1113/2181] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:58:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:58:08.680189 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-045443ba-3ecb-4a23-b23b-1fcc146cecff req-3a50ec8a-d23f-4dad-8630-74d3a9eda051 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a88f52fe-95e7-46fc-b7fa-1714b4449e87", "tag": "e6980208-76a5-417f-a7d6-0df07d29b6f2"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:58:08.708850 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-045443ba-3ecb-4a23-b23b-1fcc146cecff req-3a50ec8a-d23f-4dad-8630-74d3a9eda051 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:08.709382 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-045443ba-3ecb-4a23-b23b-1fcc146cecff req-3a50ec8a-d23f-4dad-8630-74d3a9eda051 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:08.709827 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-045443ba-3ecb-4a23-b23b-1fcc146cecff req-3a50ec8a-d23f-4dad-8630-74d3a9eda051 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:08.748441 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-045443ba-3ecb-4a23-b23b-1fcc146cecff req-3a50ec8a-d23f-4dad-8630-74d3a9eda051 service nova] Creating event network-changed:e6980208-76a5-417f-a7d6-0df07d29b6f2 for instance a88f52fe-95e7-46fc-b7fa-1714b4449e87 on n-h2-836830-18 Sep 14 08:58:08.761491 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-045443ba-3ecb-4a23-b23b-1fcc146cecff req-3a50ec8a-d23f-4dad-8630-74d3a9eda051 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095985 Sep 14 08:58:08.762447 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1114/2182] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:58:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:58:08.772446 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c903d6ea-c253-4819-9c19-6532ed2e05ca tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:08.776447 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-c903d6ea-c253-4819-9c19-6532ed2e05ca tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: ad55193e-b097-4372-9a00-972ed2b486f8] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:08.801821 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c903d6ea-c253-4819-9c19-6532ed2e05ca tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:08.802516 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c903d6ea-c253-4819-9c19-6532ed2e05ca tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:08.803167 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c903d6ea-c253-4819-9c19-6532ed2e05ca tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:08.804077 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c903d6ea-c253-4819-9c19-6532ed2e05ca tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:08.804759 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c903d6ea-c253-4819-9c19-6532ed2e05ca tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:08.805410 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c903d6ea-c253-4819-9c19-6532ed2e05ca tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:09.012504 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-67e17fa8-d90a-4262-91c4-4f512569c077 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:09.030729 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-67e17fa8-d90a-4262-91c4-4f512569c077 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/5ee0a6e1-d106-4955-a894-7fe2ac13ffb0" status: 200 len: 1494 microversion: 2.1 time: 0.698184 Sep 14 08:58:09.033084 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1069/2183] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:58:08 2022] GET /compute/v2.1/servers/5ee0a6e1-d106-4955-a894-7fe2ac13ffb0 => generated 1494 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:58:09.045710 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-13020a50-4489-4706-a2fe-772bf4ee1ccc tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:09.047152 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-13020a50-4489-4706-a2fe-772bf4ee1ccc tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] [instance: 59f196e8-c202-4073-8663-2ae19358a044] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:09.083043 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-13020a50-4489-4706-a2fe-772bf4ee1ccc tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:09.083826 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-13020a50-4489-4706-a2fe-772bf4ee1ccc tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:09.084682 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-13020a50-4489-4706-a2fe-772bf4ee1ccc tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:09.087076 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-13020a50-4489-4706-a2fe-772bf4ee1ccc tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:09.088002 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-13020a50-4489-4706-a2fe-772bf4ee1ccc tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:09.089013 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-13020a50-4489-4706-a2fe-772bf4ee1ccc tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:09.090325 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=9 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:58:09.142756 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=26 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:58:09.245867 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-c903d6ea-c253-4819-9c19-6532ed2e05ca tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:09.255544 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-c903d6ea-c253-4819-9c19-6532ed2e05ca tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/ad55193e-b097-4372-9a00-972ed2b486f8" status: 200 len: 1393 microversion: 2.1 time: 0.490658 Sep 14 08:58:09.258479 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1115/2184] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:58:08 2022] GET /compute/v2.1/servers/ad55193e-b097-4372-9a00-972ed2b486f8 => generated 1393 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:58:09.281651 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-11a33027-34dd-41fe-96e8-019125af312c req-d5e44724-40b6-47b4-b3fc-e487371af081 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59f196e8-c202-4073-8663-2ae19358a044", "name": "network-vif-plugged", "status": "completed", "tag": "b45cf031-1a7e-40d4-99f8-072f0326a8e0"}, {"server_uuid": "59f196e8-c202-4073-8663-2ae19358a044", "name": "network-vif-plugged", "status": "completed", "tag": "55ecb12c-40d9-41ea-bb56-362fc9dba976"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:58:09.301617 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-11a33027-34dd-41fe-96e8-019125af312c req-d5e44724-40b6-47b4-b3fc-e487371af081 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:09.314551 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-11a33027-34dd-41fe-96e8-019125af312c req-d5e44724-40b6-47b4-b3fc-e487371af081 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:09.315053 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-11a33027-34dd-41fe-96e8-019125af312c req-d5e44724-40b6-47b4-b3fc-e487371af081 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:09.344743 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-11a33027-34dd-41fe-96e8-019125af312c req-d5e44724-40b6-47b4-b3fc-e487371af081 service nova] Creating event network-vif-plugged:b45cf031-1a7e-40d4-99f8-072f0326a8e0 for instance 59f196e8-c202-4073-8663-2ae19358a044 on n-h2-836830-18 Sep 14 08:58:09.345268 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-11a33027-34dd-41fe-96e8-019125af312c req-d5e44724-40b6-47b4-b3fc-e487371af081 service nova] Creating event network-vif-plugged:55ecb12c-40d9-41ea-bb56-362fc9dba976 for instance 59f196e8-c202-4073-8663-2ae19358a044 on n-h2-836830-18 Sep 14 08:58:09.360651 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-11a33027-34dd-41fe-96e8-019125af312c req-d5e44724-40b6-47b4-b3fc-e487371af081 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.081212 Sep 14 08:58:09.365563 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1116/2185] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:58:09 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:58:09.376045 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-862cfc5d-4b9e-43c4-84ef-c32a75382df3 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:09.377413 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-862cfc5d-4b9e-43c4-84ef-c32a75382df3 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] [instance: 26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:09.386756 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-862cfc5d-4b9e-43c4-84ef-c32a75382df3 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:09.395149 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-862cfc5d-4b9e-43c4-84ef-c32a75382df3 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:09.396284 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-862cfc5d-4b9e-43c4-84ef-c32a75382df3 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:09.397276 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-862cfc5d-4b9e-43c4-84ef-c32a75382df3 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:09.398181 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-862cfc5d-4b9e-43c4-84ef-c32a75382df3 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:09.399333 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-862cfc5d-4b9e-43c4-84ef-c32a75382df3 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:09.794674 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-13020a50-4489-4706-a2fe-772bf4ee1ccc tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:09.804919 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-13020a50-4489-4706-a2fe-772bf4ee1ccc tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:09.813826 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-13020a50-4489-4706-a2fe-772bf4ee1ccc tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:09.815215 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-13020a50-4489-4706-a2fe-772bf4ee1ccc tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] 10.222.0.60 "GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044" status: 200 len: 1877 microversion: 2.42 time: 0.780500 Sep 14 08:58:09.831864 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1070/2186] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:58:09 2022] GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044 => generated 1877 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:58:09.844181 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-7fb29142-b918-4874-aff4-2664f9a2ec9d tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:09.845097 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-7fb29142-b918-4874-aff4-2664f9a2ec9d tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] [instance: a88f52fe-95e7-46fc-b7fa-1714b4449e87] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:09.853253 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7fb29142-b918-4874-aff4-2664f9a2ec9d tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:09.854269 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7fb29142-b918-4874-aff4-2664f9a2ec9d tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:09.854972 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7fb29142-b918-4874-aff4-2664f9a2ec9d tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:09.855968 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7fb29142-b918-4874-aff4-2664f9a2ec9d tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:09.857074 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7fb29142-b918-4874-aff4-2664f9a2ec9d tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:09.858249 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7fb29142-b918-4874-aff4-2664f9a2ec9d tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:10.016831 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-862cfc5d-4b9e-43c4-84ef-c32a75382df3 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:10.034234 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-862cfc5d-4b9e-43c4-84ef-c32a75382df3 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:10.046594 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-862cfc5d-4b9e-43c4-84ef-c32a75382df3 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:10.048547 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-862cfc5d-4b9e-43c4-84ef-c32a75382df3 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] 10.222.0.60 "GET /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0" status: 200 len: 1880 microversion: 2.32 time: 0.679615 Sep 14 08:58:10.059219 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1117/2187] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:58:09 2022] GET /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0 => generated 1880 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:58:10.066546 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-2008bff8-e19c-479c-9bef-61c8e5a558af tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:10.074915 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-2008bff8-e19c-479c-9bef-61c8e5a558af tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 5ee0a6e1-d106-4955-a894-7fe2ac13ffb0] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:10.082979 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2008bff8-e19c-479c-9bef-61c8e5a558af tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:10.093371 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2008bff8-e19c-479c-9bef-61c8e5a558af tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:10.093851 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2008bff8-e19c-479c-9bef-61c8e5a558af tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:10.094618 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2008bff8-e19c-479c-9bef-61c8e5a558af tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:10.095117 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2008bff8-e19c-479c-9bef-61c8e5a558af tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:10.109594 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2008bff8-e19c-479c-9bef-61c8e5a558af tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:10.187216 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-7fb29142-b918-4874-aff4-2664f9a2ec9d tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f584701398b64fab808e3cbcc4259a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb6af957c8f45e5a0996c0e4b1f456a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:10.197341 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-7fb29142-b918-4874-aff4-2664f9a2ec9d tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] 10.222.0.60 "GET /compute/v2.1/servers/a88f52fe-95e7-46fc-b7fa-1714b4449e87" status: 200 len: 1322 microversion: 2.1 time: 0.362529 Sep 14 08:58:10.203476 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1071/2188] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:58:09 2022] GET /compute/v2.1/servers/a88f52fe-95e7-46fc-b7fa-1714b4449e87 => generated 1322 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:58:10.288158 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-82dca0e0-77d2-4ef0-a209-827972876c4a tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:10.288791 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-82dca0e0-77d2-4ef0-a209-827972876c4a tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: ad55193e-b097-4372-9a00-972ed2b486f8] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:10.300087 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-82dca0e0-77d2-4ef0-a209-827972876c4a tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:10.301243 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-82dca0e0-77d2-4ef0-a209-827972876c4a tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:10.302275 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-82dca0e0-77d2-4ef0-a209-827972876c4a tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:10.303554 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-82dca0e0-77d2-4ef0-a209-827972876c4a tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:10.304397 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-82dca0e0-77d2-4ef0-a209-827972876c4a tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:10.305179 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-82dca0e0-77d2-4ef0-a209-827972876c4a tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:10.924851 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-82dca0e0-77d2-4ef0-a209-827972876c4a tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:10.934601 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-82dca0e0-77d2-4ef0-a209-827972876c4a tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/ad55193e-b097-4372-9a00-972ed2b486f8" status: 200 len: 1393 microversion: 2.1 time: 0.650218 Sep 14 08:58:10.953174 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1072/2189] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:58:10 2022] GET /compute/v2.1/servers/ad55193e-b097-4372-9a00-972ed2b486f8 => generated 1393 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:58:10.961484 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ef36c8f3-2856-4eb5-bb78-7bb7b9deea7b tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:10.962733 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-ef36c8f3-2856-4eb5-bb78-7bb7b9deea7b tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] [instance: 59f196e8-c202-4073-8663-2ae19358a044] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:10.972388 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ef36c8f3-2856-4eb5-bb78-7bb7b9deea7b tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:10.974361 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ef36c8f3-2856-4eb5-bb78-7bb7b9deea7b tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:10.975259 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ef36c8f3-2856-4eb5-bb78-7bb7b9deea7b tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:10.976236 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ef36c8f3-2856-4eb5-bb78-7bb7b9deea7b tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:10.976905 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ef36c8f3-2856-4eb5-bb78-7bb7b9deea7b tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:10.977569 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ef36c8f3-2856-4eb5-bb78-7bb7b9deea7b tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:11.328342 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-2008bff8-e19c-479c-9bef-61c8e5a558af tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:11.344231 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-2008bff8-e19c-479c-9bef-61c8e5a558af tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/5ee0a6e1-d106-4955-a894-7fe2ac13ffb0" status: 200 len: 1494 microversion: 2.1 time: 1.275681 Sep 14 08:58:11.345217 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1118/2190] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:58:10 2022] GET /compute/v2.1/servers/5ee0a6e1-d106-4955-a894-7fe2ac13ffb0 => generated 1494 bytes in 1285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:58:11.350731 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-db2285b5-2262-4d16-bf2a-e755cd053a84 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:11.351645 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-db2285b5-2262-4d16-bf2a-e755cd053a84 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] [instance: 26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:11.358320 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-ef36c8f3-2856-4eb5-bb78-7bb7b9deea7b tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:11.359860 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-db2285b5-2262-4d16-bf2a-e755cd053a84 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:11.361733 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-db2285b5-2262-4d16-bf2a-e755cd053a84 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:11.362176 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-db2285b5-2262-4d16-bf2a-e755cd053a84 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:11.362914 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-db2285b5-2262-4d16-bf2a-e755cd053a84 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:11.365461 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-db2285b5-2262-4d16-bf2a-e755cd053a84 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:11.366073 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-db2285b5-2262-4d16-bf2a-e755cd053a84 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:11.375828 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-ef36c8f3-2856-4eb5-bb78-7bb7b9deea7b tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:11.377726 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-ef36c8f3-2856-4eb5-bb78-7bb7b9deea7b tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:11.379236 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-ef36c8f3-2856-4eb5-bb78-7bb7b9deea7b tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] 10.222.0.60 "GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044" status: 200 len: 1877 microversion: 2.42 time: 0.424625 Sep 14 08:58:11.411487 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1073/2191] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:58:10 2022] GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044 => generated 1877 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:58:11.425643 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d0a438dc-976f-4931-83c0-f0366c1b4be9 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:11.426665 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-d0a438dc-976f-4931-83c0-f0366c1b4be9 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] [instance: a88f52fe-95e7-46fc-b7fa-1714b4449e87] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:11.444221 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d0a438dc-976f-4931-83c0-f0366c1b4be9 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:11.448730 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d0a438dc-976f-4931-83c0-f0366c1b4be9 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:11.449556 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d0a438dc-976f-4931-83c0-f0366c1b4be9 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:11.450544 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d0a438dc-976f-4931-83c0-f0366c1b4be9 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:11.453825 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d0a438dc-976f-4931-83c0-f0366c1b4be9 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:11.454510 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d0a438dc-976f-4931-83c0-f0366c1b4be9 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:11.519364 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=100 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:58:12.246219 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-db2285b5-2262-4d16-bf2a-e755cd053a84 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:12.256782 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-db2285b5-2262-4d16-bf2a-e755cd053a84 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:12.258259 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-db2285b5-2262-4d16-bf2a-e755cd053a84 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:12.259463 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-db2285b5-2262-4d16-bf2a-e755cd053a84 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] 10.222.0.60 "GET /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0" status: 200 len: 1880 microversion: 2.32 time: 0.913113 Sep 14 08:58:12.260036 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1119/2192] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:58:11 2022] GET /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0 => generated 1880 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:58:12.277581 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-f515eed9-d2ba-4b5e-be29-8c3c22145aff tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:12.278130 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-f515eed9-d2ba-4b5e-be29-8c3c22145aff tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: ad55193e-b097-4372-9a00-972ed2b486f8] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:12.291463 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f515eed9-d2ba-4b5e-be29-8c3c22145aff tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:12.291965 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f515eed9-d2ba-4b5e-be29-8c3c22145aff tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:12.292465 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f515eed9-d2ba-4b5e-be29-8c3c22145aff tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:12.293189 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f515eed9-d2ba-4b5e-be29-8c3c22145aff tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:12.293652 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f515eed9-d2ba-4b5e-be29-8c3c22145aff tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:12.294084 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f515eed9-d2ba-4b5e-be29-8c3c22145aff tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:12.361861 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-d0a438dc-976f-4931-83c0-f0366c1b4be9 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f584701398b64fab808e3cbcc4259a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb6af957c8f45e5a0996c0e4b1f456a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:12.373167 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d0a438dc-976f-4931-83c0-f0366c1b4be9 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] 10.222.0.60 "GET /compute/v2.1/servers/a88f52fe-95e7-46fc-b7fa-1714b4449e87" status: 200 len: 1322 microversion: 2.1 time: 0.959853 Sep 14 08:58:12.373893 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1074/2193] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:58:11 2022] GET /compute/v2.1/servers/a88f52fe-95e7-46fc-b7fa-1714b4449e87 => generated 1322 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:58:12.379413 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-36b7a7e8-e06f-4eda-8b50-566626a15e6b tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:12.380203 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-36b7a7e8-e06f-4eda-8b50-566626a15e6b tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 5ee0a6e1-d106-4955-a894-7fe2ac13ffb0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:12.386832 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-36b7a7e8-e06f-4eda-8b50-566626a15e6b tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:12.387448 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-36b7a7e8-e06f-4eda-8b50-566626a15e6b tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:12.388115 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-36b7a7e8-e06f-4eda-8b50-566626a15e6b tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:12.389585 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-36b7a7e8-e06f-4eda-8b50-566626a15e6b tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:12.390127 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-36b7a7e8-e06f-4eda-8b50-566626a15e6b tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:12.390655 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-36b7a7e8-e06f-4eda-8b50-566626a15e6b tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:12.663658 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-f515eed9-d2ba-4b5e-be29-8c3c22145aff tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:12.681859 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-f515eed9-d2ba-4b5e-be29-8c3c22145aff tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/ad55193e-b097-4372-9a00-972ed2b486f8" status: 200 len: 1393 microversion: 2.1 time: 0.417739 Sep 14 08:58:12.689045 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1120/2194] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:58:12 2022] GET /compute/v2.1/servers/ad55193e-b097-4372-9a00-972ed2b486f8 => generated 1393 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:58:12.719770 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-5200c0e1-22c0-4597-9eb1-5e6af22e8c69 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:12.720969 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-5200c0e1-22c0-4597-9eb1-5e6af22e8c69 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] [instance: 59f196e8-c202-4073-8663-2ae19358a044] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:12.721218 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-36b7a7e8-e06f-4eda-8b50-566626a15e6b tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:12.733813 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-36b7a7e8-e06f-4eda-8b50-566626a15e6b tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/5ee0a6e1-d106-4955-a894-7fe2ac13ffb0" status: 200 len: 1494 microversion: 2.1 time: 0.358728 Sep 14 08:58:12.739415 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1075/2195] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:58:12 2022] GET /compute/v2.1/servers/5ee0a6e1-d106-4955-a894-7fe2ac13ffb0 => generated 1494 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:58:12.775071 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5200c0e1-22c0-4597-9eb1-5e6af22e8c69 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:12.778506 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5200c0e1-22c0-4597-9eb1-5e6af22e8c69 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:12.782666 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5200c0e1-22c0-4597-9eb1-5e6af22e8c69 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:12.784250 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5200c0e1-22c0-4597-9eb1-5e6af22e8c69 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:12.784950 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5200c0e1-22c0-4597-9eb1-5e6af22e8c69 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:12.785596 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5200c0e1-22c0-4597-9eb1-5e6af22e8c69 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:13.289829 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-92a14382-b3dd-42d8-aca7-2f185263bdeb tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:13.290456 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-92a14382-b3dd-42d8-aca7-2f185263bdeb tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] [instance: 26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:13.300895 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-92a14382-b3dd-42d8-aca7-2f185263bdeb tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:13.301630 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-92a14382-b3dd-42d8-aca7-2f185263bdeb tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:13.302355 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-92a14382-b3dd-42d8-aca7-2f185263bdeb tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:13.303288 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-92a14382-b3dd-42d8-aca7-2f185263bdeb tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:13.320222 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-92a14382-b3dd-42d8-aca7-2f185263bdeb tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:13.322608 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-92a14382-b3dd-42d8-aca7-2f185263bdeb tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:14.168720 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-92a14382-b3dd-42d8-aca7-2f185263bdeb tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:14.189046 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-92a14382-b3dd-42d8-aca7-2f185263bdeb tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:14.200060 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-92a14382-b3dd-42d8-aca7-2f185263bdeb tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:14.205319 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-92a14382-b3dd-42d8-aca7-2f185263bdeb tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] 10.222.0.60 "GET /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0" status: 200 len: 1880 microversion: 2.32 time: 0.916044 Sep 14 08:58:14.213696 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-5200c0e1-22c0-4597-9eb1-5e6af22e8c69 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:14.224367 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1076/2196] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:58:13 2022] GET /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0 => generated 1880 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:58:14.232693 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-5200c0e1-22c0-4597-9eb1-5e6af22e8c69 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:14.232840 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c3076bbe-3f91-4ce7-88d9-ccde4be6a6f1 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:14.233442 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-c3076bbe-3f91-4ce7-88d9-ccde4be6a6f1 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] [instance: a88f52fe-95e7-46fc-b7fa-1714b4449e87] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:14.237078 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-5200c0e1-22c0-4597-9eb1-5e6af22e8c69 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:14.238666 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-5200c0e1-22c0-4597-9eb1-5e6af22e8c69 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] 10.222.0.60 "GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044" status: 200 len: 2836 microversion: 2.42 time: 1.548383 Sep 14 08:58:14.249277 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c3076bbe-3f91-4ce7-88d9-ccde4be6a6f1 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:14.250573 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1121/2197] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:58:12 2022] GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044 => generated 2836 bytes in 1561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:58:14.257013 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c3076bbe-3f91-4ce7-88d9-ccde4be6a6f1 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:14.257587 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c3076bbe-3f91-4ce7-88d9-ccde4be6a6f1 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:14.259826 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-087c2537-c9d3-4fd6-b593-0c4bf415b1f4 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:14.263403 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c3076bbe-3f91-4ce7-88d9-ccde4be6a6f1 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:14.264617 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c3076bbe-3f91-4ce7-88d9-ccde4be6a6f1 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:14.265228 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c3076bbe-3f91-4ce7-88d9-ccde4be6a6f1 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:14.265523 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-087c2537-c9d3-4fd6-b593-0c4bf415b1f4 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: ad55193e-b097-4372-9a00-972ed2b486f8] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:14.290272 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-087c2537-c9d3-4fd6-b593-0c4bf415b1f4 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:14.292008 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-087c2537-c9d3-4fd6-b593-0c4bf415b1f4 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:14.293068 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-087c2537-c9d3-4fd6-b593-0c4bf415b1f4 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:14.293829 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-087c2537-c9d3-4fd6-b593-0c4bf415b1f4 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:14.294374 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-087c2537-c9d3-4fd6-b593-0c4bf415b1f4 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:14.294855 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-087c2537-c9d3-4fd6-b593-0c4bf415b1f4 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:14.608603 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-c3076bbe-3f91-4ce7-88d9-ccde4be6a6f1 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f584701398b64fab808e3cbcc4259a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb6af957c8f45e5a0996c0e4b1f456a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:14.623988 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-c3076bbe-3f91-4ce7-88d9-ccde4be6a6f1 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] 10.222.0.60 "GET /compute/v2.1/servers/a88f52fe-95e7-46fc-b7fa-1714b4449e87" status: 200 len: 1322 microversion: 2.1 time: 0.398396 Sep 14 08:58:14.624895 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1077/2198] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:58:14 2022] GET /compute/v2.1/servers/a88f52fe-95e7-46fc-b7fa-1714b4449e87 => generated 1322 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:58:14.632703 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-c5e97092-b892-4bc8-adad-5c6940a7d459 req-6a2085c1-508a-47aa-91a0-e00e2c7e773a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ee0a6e1-d106-4955-a894-7fe2ac13ffb0", "name": "network-vif-deleted", "tag": "9fe60e18-05c8-4c91-b9ea-d1e34bad2144"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:58:14.667952 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-c5e97092-b892-4bc8-adad-5c6940a7d459 req-6a2085c1-508a-47aa-91a0-e00e2c7e773a service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:14.668687 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-c5e97092-b892-4bc8-adad-5c6940a7d459 req-6a2085c1-508a-47aa-91a0-e00e2c7e773a service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:14.669285 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-c5e97092-b892-4bc8-adad-5c6940a7d459 req-6a2085c1-508a-47aa-91a0-e00e2c7e773a service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:14.693015 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-c5e97092-b892-4bc8-adad-5c6940a7d459 req-6a2085c1-508a-47aa-91a0-e00e2c7e773a service nova] Creating event network-vif-deleted:9fe60e18-05c8-4c91-b9ea-d1e34bad2144 for instance 5ee0a6e1-d106-4955-a894-7fe2ac13ffb0 on n-h2-836830-18 Sep 14 08:58:14.713261 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-c5e97092-b892-4bc8-adad-5c6940a7d459 req-6a2085c1-508a-47aa-91a0-e00e2c7e773a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087022 Sep 14 08:58:14.714867 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1078/2199] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:58:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:58:14.722851 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-93f17a6f-9a80-4a56-a65f-b550f5af3837 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:14.724353 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-93f17a6f-9a80-4a56-a65f-b550f5af3837 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 5ee0a6e1-d106-4955-a894-7fe2ac13ffb0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:14.741207 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-93f17a6f-9a80-4a56-a65f-b550f5af3837 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:14.743910 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-93f17a6f-9a80-4a56-a65f-b550f5af3837 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:14.744625 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-93f17a6f-9a80-4a56-a65f-b550f5af3837 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:14.745764 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-93f17a6f-9a80-4a56-a65f-b550f5af3837 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:14.746854 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-93f17a6f-9a80-4a56-a65f-b550f5af3837 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:14.749815 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-93f17a6f-9a80-4a56-a65f-b550f5af3837 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:14.826802 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-93f17a6f-9a80-4a56-a65f-b550f5af3837 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:14.829937 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-93f17a6f-9a80-4a56-a65f-b550f5af3837 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:14.830630 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-93f17a6f-9a80-4a56-a65f-b550f5af3837 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:14.831363 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.objects.instance [None req-93f17a6f-9a80-4a56-a65f-b550f5af3837 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lazy-loading 'fault' on Instance uuid 5ee0a6e1-d106-4955-a894-7fe2ac13ffb0 {{(pid=128759) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 08:58:14.904046 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-93f17a6f-9a80-4a56-a65f-b550f5af3837 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:14.913495 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-93f17a6f-9a80-4a56-a65f-b550f5af3837 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/5ee0a6e1-d106-4955-a894-7fe2ac13ffb0" status: 200 len: 1298 microversion: 2.1 time: 0.195724 Sep 14 08:58:14.917504 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1079/2200] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:58:14 2022] GET /compute/v2.1/servers/5ee0a6e1-d106-4955-a894-7fe2ac13ffb0 => generated 1298 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:58:14.924862 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-21efad16-6e48-4291-ac21-390714d918f7 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:14.925686 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-21efad16-6e48-4291-ac21-390714d918f7 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] [instance: 59f196e8-c202-4073-8663-2ae19358a044] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:14.932924 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-21efad16-6e48-4291-ac21-390714d918f7 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:14.941353 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-21efad16-6e48-4291-ac21-390714d918f7 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:14.943008 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-21efad16-6e48-4291-ac21-390714d918f7 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:14.944778 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-21efad16-6e48-4291-ac21-390714d918f7 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:14.947129 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-21efad16-6e48-4291-ac21-390714d918f7 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:14.948859 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-21efad16-6e48-4291-ac21-390714d918f7 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:15.304380 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-21efad16-6e48-4291-ac21-390714d918f7 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] 10.222.0.60 "GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044/os-interface" status: 200 len: 1832 microversion: 2.42 time: 0.385385 Sep 14 08:58:15.315975 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1080/2201] 10.222.0.60 () {60 vars in 1316 bytes} [Wed Sep 14 08:58:14 2022] GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044/os-interface => generated 1832 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:58:15.321134 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-19d3df81-c297-4a50-ada8-1fe80c438895 req-adc6541b-56d2-4a76-981c-e80a903b507e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a88f52fe-95e7-46fc-b7fa-1714b4449e87", "name": "network-vif-plugged", "status": "completed", "tag": "e6980208-76a5-417f-a7d6-0df07d29b6f2"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:58:15.345976 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-19d3df81-c297-4a50-ada8-1fe80c438895 req-adc6541b-56d2-4a76-981c-e80a903b507e service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:15.346644 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-19d3df81-c297-4a50-ada8-1fe80c438895 req-adc6541b-56d2-4a76-981c-e80a903b507e service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:15.347674 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-19d3df81-c297-4a50-ada8-1fe80c438895 req-adc6541b-56d2-4a76-981c-e80a903b507e service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:15.371383 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-19d3df81-c297-4a50-ada8-1fe80c438895 req-adc6541b-56d2-4a76-981c-e80a903b507e service nova] Creating event network-vif-plugged:e6980208-76a5-417f-a7d6-0df07d29b6f2 for instance a88f52fe-95e7-46fc-b7fa-1714b4449e87 on n-h2-836830-18 Sep 14 08:58:15.386517 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-19d3df81-c297-4a50-ada8-1fe80c438895 req-adc6541b-56d2-4a76-981c-e80a903b507e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069113 Sep 14 08:58:15.387759 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1081/2202] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:58:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:58:15.393813 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-47b8a572-3faf-4e90-9b7b-a83a0e9a671a tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:15.399035 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-47b8a572-3faf-4e90-9b7b-a83a0e9a671a tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] [instance: 26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:15.414343 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-47b8a572-3faf-4e90-9b7b-a83a0e9a671a tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:15.415228 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-47b8a572-3faf-4e90-9b7b-a83a0e9a671a tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:15.426089 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-47b8a572-3faf-4e90-9b7b-a83a0e9a671a tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:15.427335 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-47b8a572-3faf-4e90-9b7b-a83a0e9a671a tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:15.427964 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-47b8a572-3faf-4e90-9b7b-a83a0e9a671a tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:15.428557 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-47b8a572-3faf-4e90-9b7b-a83a0e9a671a tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:15.684067 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-087c2537-c9d3-4fd6-b593-0c4bf415b1f4 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:15.697283 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-087c2537-c9d3-4fd6-b593-0c4bf415b1f4 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/ad55193e-b097-4372-9a00-972ed2b486f8" status: 200 len: 1393 microversion: 2.1 time: 1.441118 Sep 14 08:58:15.697951 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1122/2203] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:58:14 2022] GET /compute/v2.1/servers/ad55193e-b097-4372-9a00-972ed2b486f8 => generated 1393 bytes in 1447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:58:15.704879 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-be810d62-f6ea-4cf6-8a50-288d543b16b7 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:15.705511 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-be810d62-f6ea-4cf6-8a50-288d543b16b7 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] [instance: a88f52fe-95e7-46fc-b7fa-1714b4449e87] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:15.730582 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-be810d62-f6ea-4cf6-8a50-288d543b16b7 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:15.731742 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-be810d62-f6ea-4cf6-8a50-288d543b16b7 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:15.735293 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-be810d62-f6ea-4cf6-8a50-288d543b16b7 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:15.736957 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-be810d62-f6ea-4cf6-8a50-288d543b16b7 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:15.737761 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-be810d62-f6ea-4cf6-8a50-288d543b16b7 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:15.739730 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-be810d62-f6ea-4cf6-8a50-288d543b16b7 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:16.224626 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-47b8a572-3faf-4e90-9b7b-a83a0e9a671a tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:16.240771 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-47b8a572-3faf-4e90-9b7b-a83a0e9a671a tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:16.242237 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-47b8a572-3faf-4e90-9b7b-a83a0e9a671a tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:16.244346 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-47b8a572-3faf-4e90-9b7b-a83a0e9a671a tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] 10.222.0.60 "GET /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0" status: 200 len: 1880 microversion: 2.32 time: 0.854763 Sep 14 08:58:16.249280 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1082/2204] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:58:15 2022] GET /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0 => generated 1880 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:58:16.254372 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-347dab10-a630-407d-87f6-87be5bfa2a1e tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:16.267291 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-347dab10-a630-407d-87f6-87be5bfa2a1e tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 5ee0a6e1-d106-4955-a894-7fe2ac13ffb0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:16.273180 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-347dab10-a630-407d-87f6-87be5bfa2a1e tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:16.273684 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-347dab10-a630-407d-87f6-87be5bfa2a1e tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:16.274147 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-347dab10-a630-407d-87f6-87be5bfa2a1e tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:16.274832 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-347dab10-a630-407d-87f6-87be5bfa2a1e tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:16.280724 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-347dab10-a630-407d-87f6-87be5bfa2a1e tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:16.281905 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-347dab10-a630-407d-87f6-87be5bfa2a1e tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:16.327277 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-347dab10-a630-407d-87f6-87be5bfa2a1e tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] HTTP exception thrown: Instance 5ee0a6e1-d106-4955-a894-7fe2ac13ffb0 could not be found. Sep 14 08:58:16.331658 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-347dab10-a630-407d-87f6-87be5bfa2a1e tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Request method failure captured: Sep 14 08:58:16.331658 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/5ee0a6e1-d106-4955-a894-7fe2ac13ffb0 HTTP/1.1 Sep 14 08:58:16.331658 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 08:58:16.331658 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 08:58:16.331658 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 08:58:16.331658 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 08:58:16.331658 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 08:58:16.331658 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 08:58:16.331658 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 08:58:16.331658 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 08:58:16.331658 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZcaJwfflKXdBQOzu63TKkiZhpOhYfmFkGJTkIRAE47xWaYCE5owpMd6ZGj3T_7h70-IX-88ov5m9P47-8wvvyB1aoACyyMztTclo7X0AZdOhAhE2WQeLs1dhX-NF72boJ9SoR98XdGx2ROr7Y4PciafvjdUpaADdFYghsgULitlVHs Sep 14 08:58:16.331658 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 08:58:16.331658 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 08:58:16.331658 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 08:58:16.331658 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 08:58:16.331658 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 08:58:16.331658 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 08:58:16.331658 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: a46ca7b6c331417199f9dfc5ffa80470 Sep 14 08:58:16.331658 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ServersTestJSON-1483820673 Sep 14 08:58:16.331658 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 08:58:16.331658 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 08:58:16.331658 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a46ca7b6c331417199f9dfc5ffa80470"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a46ca7b6c331417199f9dfc5ffa80470"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a46ca7b6c331417199f9dfc5ffa80470"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a46ca7b6c331417199f9dfc5ffa80470"}]}] Sep 14 08:58:16.331658 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ServersTestJSON-1483820673 Sep 14 08:58:16.331658 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: a46ca7b6c331417199f9dfc5ffa80470 Sep 14 08:58:16.331658 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ServersTestJSON-1483820673 Sep 14 08:58:16.331658 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ServersTestJSON-1483820673-project Sep 14 08:58:16.331658 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 08:58:16.331658 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 08:58:16.331658 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 1473e6771ff1459c831d66311318404d Sep 14 08:58:16.331658 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ServersTestJSON-1483820673-project Sep 14 08:58:16.331658 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 08:58:16.331658 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance 5ee0a6e1-d106-4955-a894-7fe2ac13ffb0 could not be found. Sep 14 08:58:16.331658 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '5ee0a6e1-d106-4955-a894-7fe2ac13ffb0'} Sep 14 08:58:16.331658 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:58:16.331658 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:58:16.331658 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 08:58:16.331658 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 08:58:16.331658 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 08:58:16.331658 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 08:58:16.331658 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 08:58:16.331658 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 08:58:16.331658 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 08:58:16.331658 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 08:58:16.331658 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ee0a6e1-d106-4955-a894-7fe2ac13ffb0 could not be found. Sep 14 08:58:16.331658 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:58:16.331658 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:58:16.331658 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:58:16.331658 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:58:16.331658 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:58:16.331658 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:58:16.331658 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:58:16.331658 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:58:16.331658 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:58:16.331658 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:58:16.331658 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 08:58:16.331658 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 08:58:16.331658 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 08:58:16.331658 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 08:58:16.331658 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 08:58:16.331658 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 08:58:16.331658 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ee0a6e1-d106-4955-a894-7fe2ac13ffb0 could not be found. Sep 14 08:58:16.331658 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:58:16.331658 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:58:16.331658 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:58:16.339302 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:58:16.339302 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:58:16.339302 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:58:16.339302 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:58:16.339302 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:58:16.339302 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ee0a6e1-d106-4955-a894-7fe2ac13ffb0 could not be found. Sep 14 08:58:16.339302 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:58:16.343571 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-347dab10-a630-407d-87f6-87be5bfa2a1e tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Returning 404 to user: Instance 5ee0a6e1-d106-4955-a894-7fe2ac13ffb0 could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:58:16.344907 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-347dab10-a630-407d-87f6-87be5bfa2a1e tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/5ee0a6e1-d106-4955-a894-7fe2ac13ffb0" status: 404 len: 111 microversion: 2.1 time: 0.094322 Sep 14 08:58:16.349056 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1083/2205] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:58:16 2022] GET /compute/v2.1/servers/5ee0a6e1-d106-4955-a894-7fe2ac13ffb0 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 08:58:16.356590 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3066ab7c-36ec-4f1e-8ad3-f545ba62e782 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:16.357221 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-3066ab7c-36ec-4f1e-8ad3-f545ba62e782 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 2334f491-8233-4171-906f-e0c46d0a3fb2] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:16.368238 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3066ab7c-36ec-4f1e-8ad3-f545ba62e782 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:16.368806 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3066ab7c-36ec-4f1e-8ad3-f545ba62e782 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:16.369308 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3066ab7c-36ec-4f1e-8ad3-f545ba62e782 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:16.382397 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3066ab7c-36ec-4f1e-8ad3-f545ba62e782 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:16.384094 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3066ab7c-36ec-4f1e-8ad3-f545ba62e782 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:16.384713 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3066ab7c-36ec-4f1e-8ad3-f545ba62e782 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:16.419282 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-3066ab7c-36ec-4f1e-8ad3-f545ba62e782 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 2334f491-8233-4171-906f-e0c46d0a3fb2] Going to try to terminate instance {{(pid=128759) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 08:58:16.603588 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-3066ab7c-36ec-4f1e-8ad3-f545ba62e782 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "DELETE /compute/v2.1/servers/2334f491-8233-4171-906f-e0c46d0a3fb2" status: 204 len: 0 microversion: 2.1 time: 0.253123 Sep 14 08:58:16.604755 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1084/2206] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 08:58:16 2022] DELETE /compute/v2.1/servers/2334f491-8233-4171-906f-e0c46d0a3fb2 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 08:58:16.613833 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f9b95b89-ddbd-428e-86d8-3f6d109780c6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:16.616612 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f9b95b89-ddbd-428e-86d8-3f6d109780c6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 2334f491-8233-4171-906f-e0c46d0a3fb2] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:16.632122 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f9b95b89-ddbd-428e-86d8-3f6d109780c6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:16.632354 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-be810d62-f6ea-4cf6-8a50-288d543b16b7 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f584701398b64fab808e3cbcc4259a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb6af957c8f45e5a0996c0e4b1f456a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:16.632628 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f9b95b89-ddbd-428e-86d8-3f6d109780c6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:16.633079 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f9b95b89-ddbd-428e-86d8-3f6d109780c6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:16.633800 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f9b95b89-ddbd-428e-86d8-3f6d109780c6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:16.634267 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f9b95b89-ddbd-428e-86d8-3f6d109780c6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:16.634697 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f9b95b89-ddbd-428e-86d8-3f6d109780c6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:16.644834 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-be810d62-f6ea-4cf6-8a50-288d543b16b7 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] 10.222.0.60 "GET /compute/v2.1/servers/a88f52fe-95e7-46fc-b7fa-1714b4449e87" status: 200 len: 1322 microversion: 2.1 time: 0.945124 Sep 14 08:58:16.645554 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1123/2207] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:58:15 2022] GET /compute/v2.1/servers/a88f52fe-95e7-46fc-b7fa-1714b4449e87 => generated 1322 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:58:16.812144 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-caaa8f67-a140-4e6e-8666-0722af9a5366 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:16.813501 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-caaa8f67-a140-4e6e-8666-0722af9a5366 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: ad55193e-b097-4372-9a00-972ed2b486f8] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:16.834248 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-caaa8f67-a140-4e6e-8666-0722af9a5366 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:16.834764 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-caaa8f67-a140-4e6e-8666-0722af9a5366 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:16.835246 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-caaa8f67-a140-4e6e-8666-0722af9a5366 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:16.835986 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-caaa8f67-a140-4e6e-8666-0722af9a5366 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:16.836457 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-caaa8f67-a140-4e6e-8666-0722af9a5366 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:16.836894 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-caaa8f67-a140-4e6e-8666-0722af9a5366 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:16.892298 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:58:17.776211 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f9b95b89-ddbd-428e-86d8-3f6d109780c6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:17.787900 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f9b95b89-ddbd-428e-86d8-3f6d109780c6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/2334f491-8233-4171-906f-e0c46d0a3fb2" status: 200 len: 1494 microversion: 2.1 time: 1.178119 Sep 14 08:58:17.789633 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-caaa8f67-a140-4e6e-8666-0722af9a5366 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:17.791297 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1085/2208] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:58:16 2022] GET /compute/v2.1/servers/2334f491-8233-4171-906f-e0c46d0a3fb2 => generated 1494 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:58:17.796863 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3ad21b1e-f429-488f-9a51-dc0dfcf6e509 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:17.797666 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-3ad21b1e-f429-488f-9a51-dc0dfcf6e509 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] [instance: 26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:17.804666 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3ad21b1e-f429-488f-9a51-dc0dfcf6e509 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:17.805401 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3ad21b1e-f429-488f-9a51-dc0dfcf6e509 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:17.806153 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3ad21b1e-f429-488f-9a51-dc0dfcf6e509 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:17.807782 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3ad21b1e-f429-488f-9a51-dc0dfcf6e509 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:17.808405 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3ad21b1e-f429-488f-9a51-dc0dfcf6e509 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:17.809069 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3ad21b1e-f429-488f-9a51-dc0dfcf6e509 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:17.830390 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-caaa8f67-a140-4e6e-8666-0722af9a5366 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/ad55193e-b097-4372-9a00-972ed2b486f8" status: 200 len: 1393 microversion: 2.1 time: 1.021646 Sep 14 08:58:17.833027 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1124/2209] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:58:16 2022] GET /compute/v2.1/servers/ad55193e-b097-4372-9a00-972ed2b486f8 => generated 1393 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:58:17.842741 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-29714fa6-c03d-49ac-bca5-12d54b075725 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:17.845778 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-29714fa6-c03d-49ac-bca5-12d54b075725 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] [instance: a88f52fe-95e7-46fc-b7fa-1714b4449e87] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:17.862222 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-29714fa6-c03d-49ac-bca5-12d54b075725 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:17.864557 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-29714fa6-c03d-49ac-bca5-12d54b075725 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:17.866920 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-29714fa6-c03d-49ac-bca5-12d54b075725 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:17.868792 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-29714fa6-c03d-49ac-bca5-12d54b075725 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:17.869267 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-29714fa6-c03d-49ac-bca5-12d54b075725 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:17.869698 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-29714fa6-c03d-49ac-bca5-12d54b075725 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:18.264330 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-3ad21b1e-f429-488f-9a51-dc0dfcf6e509 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:18.276317 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-3ad21b1e-f429-488f-9a51-dc0dfcf6e509 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:18.279756 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-3ad21b1e-f429-488f-9a51-dc0dfcf6e509 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:18.282116 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-3ad21b1e-f429-488f-9a51-dc0dfcf6e509 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] 10.222.0.60 "GET /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0" status: 200 len: 1880 microversion: 2.32 time: 0.489605 Sep 14 08:58:18.304950 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1086/2210] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:58:17 2022] GET /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0 => generated 1880 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:58:18.358768 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-1673b468-3676-41f7-8f0d-fd8b03f9a950 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:18.361641 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-1673b468-3676-41f7-8f0d-fd8b03f9a950 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] [instance: 0b54f1c2-0d9c-4396-8c79-1e43b612b2ba] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:18.371171 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1673b468-3676-41f7-8f0d-fd8b03f9a950 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:18.372058 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1673b468-3676-41f7-8f0d-fd8b03f9a950 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:18.373028 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1673b468-3676-41f7-8f0d-fd8b03f9a950 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:18.374096 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1673b468-3676-41f7-8f0d-fd8b03f9a950 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:18.374785 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1673b468-3676-41f7-8f0d-fd8b03f9a950 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:18.375491 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1673b468-3676-41f7-8f0d-fd8b03f9a950 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:18.376667 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-29714fa6-c03d-49ac-bca5-12d54b075725 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f584701398b64fab808e3cbcc4259a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb6af957c8f45e5a0996c0e4b1f456a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:18.388291 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-29714fa6-c03d-49ac-bca5-12d54b075725 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] 10.222.0.60 "GET /compute/v2.1/servers/a88f52fe-95e7-46fc-b7fa-1714b4449e87" status: 200 len: 1472 microversion: 2.1 time: 0.551308 Sep 14 08:58:18.393439 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1125/2211] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:58:17 2022] GET /compute/v2.1/servers/a88f52fe-95e7-46fc-b7fa-1714b4449e87 => generated 1472 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:58:18.456344 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-1673b468-3676-41f7-8f0d-fd8b03f9a950 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] 10.222.0.60 "GET /compute/v2.1/servers/0b54f1c2-0d9c-4396-8c79-1e43b612b2ba/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.099764 Sep 14 08:58:18.457167 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1087/2212] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 14 08:58:18 2022] GET /compute/v2.1/servers/0b54f1c2-0d9c-4396-8c79-1e43b612b2ba/os-volume_attachments => generated 25 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 14 08:58:18.572196 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ab9485b5-0c6d-43f4-b14b-49ac97531799 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:18.588982 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-ab9485b5-0c6d-43f4-b14b-49ac97531799 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] [instance: 0b54f1c2-0d9c-4396-8c79-1e43b612b2ba] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:18.621429 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ab9485b5-0c6d-43f4-b14b-49ac97531799 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:18.622037 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ab9485b5-0c6d-43f4-b14b-49ac97531799 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:18.622618 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ab9485b5-0c6d-43f4-b14b-49ac97531799 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:18.623986 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ab9485b5-0c6d-43f4-b14b-49ac97531799 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:18.624899 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ab9485b5-0c6d-43f4-b14b-49ac97531799 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:18.625577 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ab9485b5-0c6d-43f4-b14b-49ac97531799 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:18.652065 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ceaa9d28-ff4c-477c-9889-2d0e01c73a91 tempest-ServersAdminNegativeTestJSON-1651638548 tempest-ServersAdminNegativeTestJSON-1651638548-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:58:18.652660 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-ceaa9d28-ff4c-477c-9889-2d0e01c73a91 tempest-ServersAdminNegativeTestJSON-1651638548 tempest-ServersAdminNegativeTestJSON-1651638548-project-admin] [instance: 0850c2a7-bf1f-4bf7-b56f-837d92c31bf6] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:18.661176 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-ceaa9d28-ff4c-477c-9889-2d0e01c73a91 tempest-ServersAdminNegativeTestJSON-1651638548 tempest-ServersAdminNegativeTestJSON-1651638548-project-admin] HTTP exception thrown: Instance 0850c2a7-bf1f-4bf7-b56f-837d92c31bf6 could not be found. Sep 14 08:58:18.663191 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ceaa9d28-ff4c-477c-9889-2d0e01c73a91 tempest-ServersAdminNegativeTestJSON-1651638548 tempest-ServersAdminNegativeTestJSON-1651638548-project-admin] Request method failure captured: Sep 14 08:58:18.663191 n-d-836830-18 devstack@n-api.service[128758]: request: POST /compute/v2.1/servers/0850c2a7-bf1f-4bf7-b56f-837d92c31bf6/action HTTP/1.1 Sep 14 08:58:18.663191 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 08:58:18.663191 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 08:58:18.663191 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 08:58:18.663191 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 15 Sep 14 08:58:18.663191 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 08:58:18.663191 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 08:58:18.663191 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 08:58:18.663191 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 08:58:18.663191 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZeUXkblrqZG_txoKC1lB3zxbqGbA6szxL6_XfeiOajAmjPSNZymadVQAUD3pu5o_NQuJV_MUZNJfaPCOdZKebvsjEQpJjjfC5RKFMi0emoOYUddxH96XEj7zoPHpxfN4xEQlxfmmZ2dI9AqKnSAYZedf2cMO26C0sl09TSJp3vIgI4 Sep 14 08:58:18.663191 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 08:58:18.663191 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 08:58:18.663191 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 08:58:18.663191 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 08:58:18.663191 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 08:58:18.663191 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 08:58:18.663191 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 21b086a22d664c45a9d7801c383e44e8 Sep 14 08:58:18.663191 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1651638548 Sep 14 08:58:18.663191 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member,admin Sep 14 08:58:18.663191 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member,admin Sep 14 08:58:18.663191 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/21b086a22d664c45a9d7801c383e44e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_21b086a22d664c45a9d7801c383e44e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/21b086a22d664c45a9d7801c383e44e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/21b086a22d664c45a9d7801c383e44e8"}]}] Sep 14 08:58:18.663191 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1651638548 Sep 14 08:58:18.663191 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 21b086a22d664c45a9d7801c383e44e8 Sep 14 08:58:18.663191 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1651638548 Sep 14 08:58:18.663191 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-ServersAdminNegativeTestJSON-1651638548-project-admin Sep 14 08:58:18.663191 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 08:58:18.663191 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 08:58:18.663191 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 68408bef8e15486abfb940c9aef80168 Sep 14 08:58:18.663191 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1651638548-project-admin Sep 14 08:58:18.663191 n-d-836830-18 devstack@n-api.service[128758]: Sep 14 08:58:18.663191 n-d-836830-18 devstack@n-api.service[128758]: {"migrate": {}} Sep 14 08:58:18.663191 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 08:58:18.663191 n-d-836830-18 devstack@n-api.service[128758]: exception: Instance 0850c2a7-bf1f-4bf7-b56f-837d92c31bf6 could not be found. Sep 14 08:58:18.663191 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': '0850c2a7-bf1f-4bf7-b56f-837d92c31bf6', 'body': {'migrate': {}}} Sep 14 08:58:18.663191 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:58:18.663191 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:58:18.663191 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 08:58:18.663191 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 08:58:18.663191 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 08:58:18.663191 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 08:58:18.663191 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 14 08:58:18.663191 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 14 08:58:18.663191 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0850c2a7-bf1f-4bf7-b56f-837d92c31bf6 could not be found. Sep 14 08:58:18.663191 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:58:18.663191 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:58:18.663191 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:58:18.663191 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:58:18.663191 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:58:18.663191 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:58:18.663191 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:58:18.663191 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:58:18.663191 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:58:18.663191 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:58:18.663191 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 08:58:18.663191 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 08:58:18.663191 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Sep 14 08:58:18.663191 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Sep 14 08:58:18.663191 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 08:58:18.663191 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 08:58:18.663191 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0850c2a7-bf1f-4bf7-b56f-837d92c31bf6 could not be found. Sep 14 08:58:18.663191 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:58:18.663191 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:58:18.663191 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:58:18.663191 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:58:18.667072 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:58:18.667072 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:58:18.667072 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:58:18.667072 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:58:18.667072 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0850c2a7-bf1f-4bf7-b56f-837d92c31bf6 could not be found. Sep 14 08:58:18.667072 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:58:18.667072 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ceaa9d28-ff4c-477c-9889-2d0e01c73a91 tempest-ServersAdminNegativeTestJSON-1651638548 tempest-ServersAdminNegativeTestJSON-1651638548-project-admin] Returning 404 to user: Instance 0850c2a7-bf1f-4bf7-b56f-837d92c31bf6 could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:58:18.667491 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-ceaa9d28-ff4c-477c-9889-2d0e01c73a91 tempest-ServersAdminNegativeTestJSON-1651638548 tempest-ServersAdminNegativeTestJSON-1651638548-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/0850c2a7-bf1f-4bf7-b56f-837d92c31bf6/action" status: 404 len: 111 microversion: 2.1 time: 0.253478 Sep 14 08:58:18.689486 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1126/2213] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 08:58:18 2022] POST /compute/v2.1/servers/0850c2a7-bf1f-4bf7-b56f-837d92c31bf6/action => generated 111 bytes in 276 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 08:58:18.707255 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-ab9485b5-0c6d-43f4-b14b-49ac97531799 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] 10.222.0.60 "GET /compute/v2.1/servers/0b54f1c2-0d9c-4396-8c79-1e43b612b2ba/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.141266 Sep 14 08:58:18.716671 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1088/2214] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 14 08:58:18 2022] GET /compute/v2.1/servers/0b54f1c2-0d9c-4396-8c79-1e43b612b2ba/os-volume_attachments => generated 25 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 08:58:18.781011 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1e604cd8-5306-4226-a8a0-17947bb8565a tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:18.781536 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-1e604cd8-5306-4226-a8a0-17947bb8565a tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] [instance: 0b54f1c2-0d9c-4396-8c79-1e43b612b2ba] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:18.795023 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1e604cd8-5306-4226-a8a0-17947bb8565a tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:18.795498 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1e604cd8-5306-4226-a8a0-17947bb8565a tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:18.795949 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1e604cd8-5306-4226-a8a0-17947bb8565a tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:18.804482 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-d8f13ee7-4ea7-4309-9f91-cfdad0663262 req-cc2fe94b-490b-492d-8c9b-5d50541a31e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59f196e8-c202-4073-8663-2ae19358a044", "tag": "d8a4da08-c0b3-4a64-8d73-ee5871258250"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:58:18.811514 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1e604cd8-5306-4226-a8a0-17947bb8565a tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:18.811918 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1e604cd8-5306-4226-a8a0-17947bb8565a tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:18.812371 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1e604cd8-5306-4226-a8a0-17947bb8565a tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:18.832461 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-d8f13ee7-4ea7-4309-9f91-cfdad0663262 req-cc2fe94b-490b-492d-8c9b-5d50541a31e5 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:18.835519 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-d8f13ee7-4ea7-4309-9f91-cfdad0663262 req-cc2fe94b-490b-492d-8c9b-5d50541a31e5 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:18.836454 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-d8f13ee7-4ea7-4309-9f91-cfdad0663262 req-cc2fe94b-490b-492d-8c9b-5d50541a31e5 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:18.866021 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-d8f13ee7-4ea7-4309-9f91-cfdad0663262 req-cc2fe94b-490b-492d-8c9b-5d50541a31e5 service nova] Creating event network-changed:d8a4da08-c0b3-4a64-8d73-ee5871258250 for instance 59f196e8-c202-4073-8663-2ae19358a044 on n-h2-836830-18 Sep 14 08:58:18.870898 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-1e604cd8-5306-4226-a8a0-17947bb8565a tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] [instance: 0b54f1c2-0d9c-4396-8c79-1e43b612b2ba] Going to try to terminate instance {{(pid=128758) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 08:58:18.883728 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-d8f13ee7-4ea7-4309-9f91-cfdad0663262 req-cc2fe94b-490b-492d-8c9b-5d50541a31e5 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083491 Sep 14 08:58:18.884675 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1089/2215] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:58:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:58:18.891266 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-826106fb-eef5-4e96-9da4-bc921a38b419 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:18.891991 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-826106fb-eef5-4e96-9da4-bc921a38b419 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 2334f491-8233-4171-906f-e0c46d0a3fb2] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:18.916926 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-826106fb-eef5-4e96-9da4-bc921a38b419 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:18.917440 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-826106fb-eef5-4e96-9da4-bc921a38b419 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:18.918094 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-826106fb-eef5-4e96-9da4-bc921a38b419 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:18.919027 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-826106fb-eef5-4e96-9da4-bc921a38b419 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:18.920312 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-826106fb-eef5-4e96-9da4-bc921a38b419 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:18.920912 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-826106fb-eef5-4e96-9da4-bc921a38b419 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:19.000995 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-1e604cd8-5306-4226-a8a0-17947bb8565a tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] 10.222.0.60 "DELETE /compute/v2.1/servers/0b54f1c2-0d9c-4396-8c79-1e43b612b2ba" status: 204 len: 0 microversion: 2.1 time: 0.219564 Sep 14 08:58:19.001798 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1127/2216] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 08:58:18 2022] DELETE /compute/v2.1/servers/0b54f1c2-0d9c-4396-8c79-1e43b612b2ba => generated 0 bytes in 225 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 08:58:19.013288 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-fe27cc6c-fcbc-43df-af0c-7a4f0de9e6f2 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-2034926651", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:58:19.104251 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.network.neutron [None req-fe27cc6c-fcbc-43df-af0c-7a4f0de9e6f2 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] validate_networks() for None {{(pid=128758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 08:58:19.501794 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-826106fb-eef5-4e96-9da4-bc921a38b419 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:19.511342 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-826106fb-eef5-4e96-9da4-bc921a38b419 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/2334f491-8233-4171-906f-e0c46d0a3fb2" status: 200 len: 1494 microversion: 2.1 time: 0.624830 Sep 14 08:58:19.533662 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1090/2217] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:58:18 2022] GET /compute/v2.1/servers/2334f491-8233-4171-906f-e0c46d0a3fb2 => generated 1494 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:58:19.544755 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9491d84d-44ab-4377-9c79-844b7262c203 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:19.548555 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-9491d84d-44ab-4377-9c79-844b7262c203 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: ad55193e-b097-4372-9a00-972ed2b486f8] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:19.564266 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9491d84d-44ab-4377-9c79-844b7262c203 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:19.564777 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9491d84d-44ab-4377-9c79-844b7262c203 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:19.568512 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9491d84d-44ab-4377-9c79-844b7262c203 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:19.569487 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9491d84d-44ab-4377-9c79-844b7262c203 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:19.570111 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9491d84d-44ab-4377-9c79-844b7262c203 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:19.571473 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9491d84d-44ab-4377-9c79-844b7262c203 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:20.093969 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-fe27cc6c-fcbc-43df-af0c-7a4f0de9e6f2 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Flavor limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 08:58:20.095211 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-fe27cc6c-fcbc-43df-af0c-7a4f0de9e6f2 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Image limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 08:58:20.095986 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-fe27cc6c-fcbc-43df-af0c-7a4f0de9e6f2 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Flavor pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 08:58:20.096557 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-fe27cc6c-fcbc-43df-af0c-7a4f0de9e6f2 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Image pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 08:58:20.097559 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-fe27cc6c-fcbc-43df-af0c-7a4f0de9e6f2 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 08:58:20.109367 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fe27cc6c-fcbc-43df-af0c-7a4f0de9e6f2 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:20.110098 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fe27cc6c-fcbc-43df-af0c-7a4f0de9e6f2 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:20.110746 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fe27cc6c-fcbc-43df-af0c-7a4f0de9e6f2 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:20.121800 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fe27cc6c-fcbc-43df-af0c-7a4f0de9e6f2 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:20.122493 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fe27cc6c-fcbc-43df-af0c-7a4f0de9e6f2 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:20.123654 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fe27cc6c-fcbc-43df-af0c-7a4f0de9e6f2 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:20.147366 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-fe27cc6c-fcbc-43df-af0c-7a4f0de9e6f2 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Getting quotas for project bdb6af957c8f45e5a0996c0e4b1f456a. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 08:58:20.155888 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-fe27cc6c-fcbc-43df-af0c-7a4f0de9e6f2 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Getting quotas for user f584701398b64fab808e3cbcc4259a32 and project bdb6af957c8f45e5a0996c0e4b1f456a. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 08:58:20.176644 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:58:20.178318 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-fe27cc6c-fcbc-43df-af0c-7a4f0de9e6f2 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Going to run 1 instances... {{(pid=128758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 08:58:20.181066 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-fe27cc6c-fcbc-43df-af0c-7a4f0de9e6f2 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] [instance: 5629527b-12f8-4467-85a7-976d17dd267a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 08:58:20.254729 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-fe27cc6c-fcbc-43df-af0c-7a4f0de9e6f2 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.251411 Sep 14 08:58:20.263287 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1128/2218] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 08:58:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1261 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 08:58:20.272717 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-120231fe-c344-4f47-bda9-89f0e0c78030 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:20.274012 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-120231fe-c344-4f47-bda9-89f0e0c78030 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] [instance: 0b54f1c2-0d9c-4396-8c79-1e43b612b2ba] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:20.281652 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-120231fe-c344-4f47-bda9-89f0e0c78030 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:20.282618 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-120231fe-c344-4f47-bda9-89f0e0c78030 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:20.283376 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-120231fe-c344-4f47-bda9-89f0e0c78030 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:20.285261 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-120231fe-c344-4f47-bda9-89f0e0c78030 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:20.285918 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-120231fe-c344-4f47-bda9-89f0e0c78030 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:20.286537 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-120231fe-c344-4f47-bda9-89f0e0c78030 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:20.323260 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-9491d84d-44ab-4377-9c79-844b7262c203 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:20.339123 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-9491d84d-44ab-4377-9c79-844b7262c203 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/ad55193e-b097-4372-9a00-972ed2b486f8" status: 200 len: 1383 microversion: 2.1 time: 0.802029 Sep 14 08:58:20.340416 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1091/2219] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:58:19 2022] GET /compute/v2.1/servers/ad55193e-b097-4372-9a00-972ed2b486f8 => generated 1383 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:58:20.351660 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e9ad210a-2ca5-4ecd-a455-e6c4227d4f85 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:20.353671 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e9ad210a-2ca5-4ecd-a455-e6c4227d4f85 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] [instance: 26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:20.367713 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e9ad210a-2ca5-4ecd-a455-e6c4227d4f85 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:20.368548 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e9ad210a-2ca5-4ecd-a455-e6c4227d4f85 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:20.369266 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e9ad210a-2ca5-4ecd-a455-e6c4227d4f85 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:20.370259 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e9ad210a-2ca5-4ecd-a455-e6c4227d4f85 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:20.370829 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e9ad210a-2ca5-4ecd-a455-e6c4227d4f85 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:20.371403 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e9ad210a-2ca5-4ecd-a455-e6c4227d4f85 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:20.376900 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:58:21.401420 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-120231fe-c344-4f47-bda9-89f0e0c78030 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e1780ebcf1413fa4f7a9760b761c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77c85f074ae4b8cb5a1457a5183197b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:21.410722 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-120231fe-c344-4f47-bda9-89f0e0c78030 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] 10.222.0.60 "GET /compute/v2.1/servers/0b54f1c2-0d9c-4396-8c79-1e43b612b2ba" status: 200 len: 1680 microversion: 2.1 time: 1.144972 Sep 14 08:58:21.413679 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1129/2220] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:58:20 2022] GET /compute/v2.1/servers/0b54f1c2-0d9c-4396-8c79-1e43b612b2ba => generated 1680 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:58:21.418629 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1c262be2-0633-4ed0-bace-2b391ca1cb78 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:21.426247 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-1c262be2-0633-4ed0-bace-2b391ca1cb78 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] [instance: 5629527b-12f8-4467-85a7-976d17dd267a] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:21.430498 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-e9ad210a-2ca5-4ecd-a455-e6c4227d4f85 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:21.444887 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-e9ad210a-2ca5-4ecd-a455-e6c4227d4f85 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:21.448234 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1c262be2-0633-4ed0-bace-2b391ca1cb78 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:21.448414 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-e9ad210a-2ca5-4ecd-a455-e6c4227d4f85 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:21.453130 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e9ad210a-2ca5-4ecd-a455-e6c4227d4f85 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] 10.222.0.60 "GET /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0" status: 200 len: 1880 microversion: 2.32 time: 1.111156 Sep 14 08:58:21.453510 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1092/2221] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:58:20 2022] GET /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0 => generated 1880 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:58:21.455064 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1c262be2-0633-4ed0-bace-2b391ca1cb78 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:21.455523 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1c262be2-0633-4ed0-bace-2b391ca1cb78 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:21.456292 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1c262be2-0633-4ed0-bace-2b391ca1cb78 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:21.456726 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1c262be2-0633-4ed0-bace-2b391ca1cb78 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:21.457155 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1c262be2-0633-4ed0-bace-2b391ca1cb78 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:21.467748 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3487ac26-ed3a-4e89-8f48-85936e097f01 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Calling method '.version_select at 0x7f7d3fff9310>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:21.489070 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3487ac26-ed3a-4e89-8f48-85936e097f01 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:21.489954 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3487ac26-ed3a-4e89-8f48-85936e097f01 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:21.493596 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3487ac26-ed3a-4e89-8f48-85936e097f01 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:21.511450 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-3487ac26-ed3a-4e89-8f48-85936e097f01 tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] 10.222.0.60 "GET /compute/v2.1/os-migrations" status: 200 len: 1568 microversion: 2.1 time: 0.053573 Sep 14 08:58:21.514468 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1093/2222] 10.222.0.60 () {58 vars in 1143 bytes} [Wed Sep 14 08:58:21 2022] GET /compute/v2.1/os-migrations => generated 1568 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:58:21.525514 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ee3c0b1b-aec7-420b-86c9-1ff91b2397dc tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:21.528489 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-ee3c0b1b-aec7-420b-86c9-1ff91b2397dc tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 2334f491-8233-4171-906f-e0c46d0a3fb2] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:21.549227 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ee3c0b1b-aec7-420b-86c9-1ff91b2397dc tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:21.550037 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ee3c0b1b-aec7-420b-86c9-1ff91b2397dc tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:21.550648 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ee3c0b1b-aec7-420b-86c9-1ff91b2397dc tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:21.551560 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ee3c0b1b-aec7-420b-86c9-1ff91b2397dc tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:21.552253 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ee3c0b1b-aec7-420b-86c9-1ff91b2397dc tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:21.552898 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ee3c0b1b-aec7-420b-86c9-1ff91b2397dc tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:21.632586 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-1c262be2-0633-4ed0-bace-2b391ca1cb78 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f584701398b64fab808e3cbcc4259a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb6af957c8f45e5a0996c0e4b1f456a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:21.644080 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-1c262be2-0633-4ed0-bace-2b391ca1cb78 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] 10.222.0.60 "GET /compute/v2.1/servers/5629527b-12f8-4467-85a7-976d17dd267a" status: 200 len: 1226 microversion: 2.1 time: 0.229074 Sep 14 08:58:21.644692 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1130/2223] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:58:21 2022] GET /compute/v2.1/servers/5629527b-12f8-4467-85a7-976d17dd267a => generated 1226 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:58:21.671367 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-6ca4b048-b157-494c-95f1-6861d28544c1 req-6e7d7d64-f110-4233-9bf3-46d6209043b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2334f491-8233-4171-906f-e0c46d0a3fb2", "name": "network-vif-deleted", "tag": "c3659fbf-543f-406c-a683-9c6642e323fe"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:58:21.693974 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-6ca4b048-b157-494c-95f1-6861d28544c1 req-6e7d7d64-f110-4233-9bf3-46d6209043b4 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:21.696086 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-6ca4b048-b157-494c-95f1-6861d28544c1 req-6e7d7d64-f110-4233-9bf3-46d6209043b4 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:21.696543 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-6ca4b048-b157-494c-95f1-6861d28544c1 req-6e7d7d64-f110-4233-9bf3-46d6209043b4 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:21.722433 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-6ca4b048-b157-494c-95f1-6861d28544c1 req-6e7d7d64-f110-4233-9bf3-46d6209043b4 service nova] Creating event network-vif-deleted:c3659fbf-543f-406c-a683-9c6642e323fe for instance 2334f491-8233-4171-906f-e0c46d0a3fb2 on n-h1-836830-18 Sep 14 08:58:21.733797 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-6ca4b048-b157-494c-95f1-6861d28544c1 req-6e7d7d64-f110-4233-9bf3-46d6209043b4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072178 Sep 14 08:58:21.735284 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1131/2224] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:58:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:58:21.740317 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-4fa8e834-e0d8-4c26-8a97-3f1949ea285d tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:21.741109 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-4fa8e834-e0d8-4c26-8a97-3f1949ea285d tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] [instance: ad55193e-b097-4372-9a00-972ed2b486f8] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:21.747812 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4fa8e834-e0d8-4c26-8a97-3f1949ea285d tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:21.748891 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4fa8e834-e0d8-4c26-8a97-3f1949ea285d tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:21.749670 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4fa8e834-e0d8-4c26-8a97-3f1949ea285d tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:21.750535 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4fa8e834-e0d8-4c26-8a97-3f1949ea285d tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:21.751181 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4fa8e834-e0d8-4c26-8a97-3f1949ea285d tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:21.751975 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4fa8e834-e0d8-4c26-8a97-3f1949ea285d tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:21.772330 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-ee3c0b1b-aec7-420b-86c9-1ff91b2397dc tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:21.785005 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-ee3c0b1b-aec7-420b-86c9-1ff91b2397dc tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/2334f491-8233-4171-906f-e0c46d0a3fb2" status: 200 len: 1293 microversion: 2.1 time: 0.267393 Sep 14 08:58:21.790823 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1094/2225] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:58:21 2022] GET /compute/v2.1/servers/2334f491-8233-4171-906f-e0c46d0a3fb2 => generated 1293 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:58:22.381478 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-4fa8e834-e0d8-4c26-8a97-3f1949ea285d tempest-LiveMigrationTest-458037037 tempest-LiveMigrationTest-458037037-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/ad55193e-b097-4372-9a00-972ed2b486f8" status: 200 len: 1536 microversion: 2.1 time: 0.642944 Sep 14 08:58:22.384652 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1132/2226] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:58:21 2022] GET /compute/v2.1/servers/ad55193e-b097-4372-9a00-972ed2b486f8 => generated 1536 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:58:22.438690 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e628dd78-b4a4-4c57-b370-e8c533c9f51f tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:22.444391 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-8a3d6e2c-7ad7-4f24-9dca-b3f66876602c tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:22.445496 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-8a3d6e2c-7ad7-4f24-9dca-b3f66876602c tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] [instance: 0b54f1c2-0d9c-4396-8c79-1e43b612b2ba] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:22.448212 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e628dd78-b4a4-4c57-b370-e8c533c9f51f tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: ad55193e-b097-4372-9a00-972ed2b486f8] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:22.453973 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8a3d6e2c-7ad7-4f24-9dca-b3f66876602c tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:22.454907 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8a3d6e2c-7ad7-4f24-9dca-b3f66876602c tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:22.455711 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8a3d6e2c-7ad7-4f24-9dca-b3f66876602c tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:22.456889 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8a3d6e2c-7ad7-4f24-9dca-b3f66876602c tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:22.457713 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8a3d6e2c-7ad7-4f24-9dca-b3f66876602c tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:22.458244 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e628dd78-b4a4-4c57-b370-e8c533c9f51f tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:22.458728 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8a3d6e2c-7ad7-4f24-9dca-b3f66876602c tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:22.462822 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e628dd78-b4a4-4c57-b370-e8c533c9f51f tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:22.467859 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e628dd78-b4a4-4c57-b370-e8c533c9f51f tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:22.470512 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e628dd78-b4a4-4c57-b370-e8c533c9f51f tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:22.472290 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e628dd78-b4a4-4c57-b370-e8c533c9f51f tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:22.474529 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e628dd78-b4a4-4c57-b370-e8c533c9f51f tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:22.562505 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e628dd78-b4a4-4c57-b370-e8c533c9f51f tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: ad55193e-b097-4372-9a00-972ed2b486f8] Going to try to terminate instance {{(pid=128759) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 08:58:22.735159 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e628dd78-b4a4-4c57-b370-e8c533c9f51f tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "DELETE /compute/v2.1/servers/ad55193e-b097-4372-9a00-972ed2b486f8" status: 204 len: 0 microversion: 2.1 time: 0.299395 Sep 14 08:58:22.736246 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1095/2227] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 08:58:22 2022] DELETE /compute/v2.1/servers/ad55193e-b097-4372-9a00-972ed2b486f8 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 08:58:22.745295 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d9352e8e-53b4-4cf6-ba97-78ab5eec29ce tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:22.746088 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-d9352e8e-53b4-4cf6-ba97-78ab5eec29ce tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] [instance: 26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:22.753620 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=95,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:58:22.757285 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d9352e8e-53b4-4cf6-ba97-78ab5eec29ce tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:22.757999 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d9352e8e-53b4-4cf6-ba97-78ab5eec29ce tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:22.759114 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d9352e8e-53b4-4cf6-ba97-78ab5eec29ce tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:22.760156 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d9352e8e-53b4-4cf6-ba97-78ab5eec29ce tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:22.760621 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d9352e8e-53b4-4cf6-ba97-78ab5eec29ce tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:22.762235 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d9352e8e-53b4-4cf6-ba97-78ab5eec29ce tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:22.799682 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-8a3d6e2c-7ad7-4f24-9dca-b3f66876602c tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e1780ebcf1413fa4f7a9760b761c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77c85f074ae4b8cb5a1457a5183197b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:22.808885 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-8a3d6e2c-7ad7-4f24-9dca-b3f66876602c tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] 10.222.0.60 "GET /compute/v2.1/servers/0b54f1c2-0d9c-4396-8c79-1e43b612b2ba" status: 200 len: 1680 microversion: 2.1 time: 0.368726 Sep 14 08:58:22.809981 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1133/2228] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:58:22 2022] GET /compute/v2.1/servers/0b54f1c2-0d9c-4396-8c79-1e43b612b2ba => generated 1680 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:58:22.828919 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-79fb23bd-7841-4508-ac3b-a839bf856744 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:22.829671 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-79fb23bd-7841-4508-ac3b-a839bf856744 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] [instance: 5629527b-12f8-4467-85a7-976d17dd267a] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:22.837053 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-79fb23bd-7841-4508-ac3b-a839bf856744 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:22.837632 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-79fb23bd-7841-4508-ac3b-a839bf856744 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:22.838135 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-79fb23bd-7841-4508-ac3b-a839bf856744 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:22.839484 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-79fb23bd-7841-4508-ac3b-a839bf856744 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:22.840153 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-79fb23bd-7841-4508-ac3b-a839bf856744 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:22.840801 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-79fb23bd-7841-4508-ac3b-a839bf856744 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:23.008636 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-79fb23bd-7841-4508-ac3b-a839bf856744 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f584701398b64fab808e3cbcc4259a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb6af957c8f45e5a0996c0e4b1f456a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:23.017972 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-79fb23bd-7841-4508-ac3b-a839bf856744 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] 10.222.0.60 "GET /compute/v2.1/servers/5629527b-12f8-4467-85a7-976d17dd267a" status: 200 len: 1282 microversion: 2.1 time: 0.206629 Sep 14 08:58:23.039334 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1134/2229] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:58:22 2022] GET /compute/v2.1/servers/5629527b-12f8-4467-85a7-976d17dd267a => generated 1282 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:58:23.053855 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-876b7224-0836-4981-8751-f946a84e6e7f tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:23.055364 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-876b7224-0836-4981-8751-f946a84e6e7f tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: ad55193e-b097-4372-9a00-972ed2b486f8] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:23.063275 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-876b7224-0836-4981-8751-f946a84e6e7f tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:23.064163 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-876b7224-0836-4981-8751-f946a84e6e7f tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:23.064785 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-876b7224-0836-4981-8751-f946a84e6e7f tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:23.065586 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-876b7224-0836-4981-8751-f946a84e6e7f tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:23.066369 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-876b7224-0836-4981-8751-f946a84e6e7f tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:23.066922 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-876b7224-0836-4981-8751-f946a84e6e7f tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:23.308074 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-d9352e8e-53b4-4cf6-ba97-78ab5eec29ce tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:23.322311 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-d9352e8e-53b4-4cf6-ba97-78ab5eec29ce tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:23.323856 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-d9352e8e-53b4-4cf6-ba97-78ab5eec29ce tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:23.334027 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d9352e8e-53b4-4cf6-ba97-78ab5eec29ce tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] 10.222.0.60 "GET /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0" status: 200 len: 1880 microversion: 2.32 time: 0.594336 Sep 14 08:58:23.334678 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1096/2230] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:58:22 2022] GET /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0 => generated 1880 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:58:23.346682 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a088cae4-5b57-4853-95db-bcbbd88824f7 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:23.348081 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-a088cae4-5b57-4853-95db-bcbbd88824f7 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 2334f491-8233-4171-906f-e0c46d0a3fb2] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:23.370776 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a088cae4-5b57-4853-95db-bcbbd88824f7 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:23.371890 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a088cae4-5b57-4853-95db-bcbbd88824f7 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:23.372943 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a088cae4-5b57-4853-95db-bcbbd88824f7 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:23.374415 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a088cae4-5b57-4853-95db-bcbbd88824f7 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:23.378128 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a088cae4-5b57-4853-95db-bcbbd88824f7 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:23.380819 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a088cae4-5b57-4853-95db-bcbbd88824f7 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:23.440337 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-a088cae4-5b57-4853-95db-bcbbd88824f7 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] HTTP exception thrown: Instance 2334f491-8233-4171-906f-e0c46d0a3fb2 could not be found. Sep 14 08:58:23.455957 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a088cae4-5b57-4853-95db-bcbbd88824f7 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Request method failure captured: Sep 14 08:58:23.455957 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/2334f491-8233-4171-906f-e0c46d0a3fb2 HTTP/1.1 Sep 14 08:58:23.455957 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 08:58:23.455957 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 08:58:23.455957 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 08:58:23.455957 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 08:58:23.455957 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 08:58:23.455957 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 08:58:23.455957 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 08:58:23.455957 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 08:58:23.455957 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZcaJwfflKXdBQOzu63TKkiZhpOhYfmFkGJTkIRAE47xWaYCE5owpMd6ZGj3T_7h70-IX-88ov5m9P47-8wvvyB1aoACyyMztTclo7X0AZdOhAhE2WQeLs1dhX-NF72boJ9SoR98XdGx2ROr7Y4PciafvjdUpaADdFYghsgULitlVHs Sep 14 08:58:23.455957 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 08:58:23.455957 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 08:58:23.455957 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 08:58:23.455957 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 08:58:23.455957 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 08:58:23.455957 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 08:58:23.455957 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: a46ca7b6c331417199f9dfc5ffa80470 Sep 14 08:58:23.455957 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ServersTestJSON-1483820673 Sep 14 08:58:23.455957 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 08:58:23.455957 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 08:58:23.455957 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a46ca7b6c331417199f9dfc5ffa80470"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a46ca7b6c331417199f9dfc5ffa80470"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a46ca7b6c331417199f9dfc5ffa80470"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a46ca7b6c331417199f9dfc5ffa80470"}]}] Sep 14 08:58:23.455957 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ServersTestJSON-1483820673 Sep 14 08:58:23.455957 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: a46ca7b6c331417199f9dfc5ffa80470 Sep 14 08:58:23.455957 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ServersTestJSON-1483820673 Sep 14 08:58:23.455957 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ServersTestJSON-1483820673-project Sep 14 08:58:23.455957 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 08:58:23.455957 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 08:58:23.455957 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 1473e6771ff1459c831d66311318404d Sep 14 08:58:23.455957 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ServersTestJSON-1483820673-project Sep 14 08:58:23.455957 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 08:58:23.455957 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance 2334f491-8233-4171-906f-e0c46d0a3fb2 could not be found. Sep 14 08:58:23.455957 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '2334f491-8233-4171-906f-e0c46d0a3fb2'} Sep 14 08:58:23.455957 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:58:23.455957 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:58:23.455957 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 08:58:23.455957 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 08:58:23.455957 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 08:58:23.455957 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 08:58:23.455957 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 08:58:23.455957 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 08:58:23.455957 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 08:58:23.455957 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 08:58:23.455957 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2334f491-8233-4171-906f-e0c46d0a3fb2 could not be found. Sep 14 08:58:23.455957 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:58:23.455957 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:58:23.455957 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:58:23.455957 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:58:23.455957 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:58:23.455957 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:58:23.455957 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:58:23.455957 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:58:23.455957 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:58:23.455957 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:58:23.455957 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 08:58:23.455957 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 08:58:23.455957 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 08:58:23.455957 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 08:58:23.455957 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 08:58:23.455957 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 08:58:23.455957 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2334f491-8233-4171-906f-e0c46d0a3fb2 could not be found. Sep 14 08:58:23.455957 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:58:23.455957 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:58:23.455957 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:58:23.459671 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:58:23.459671 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:58:23.459671 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:58:23.459671 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:58:23.459671 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:58:23.459671 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2334f491-8233-4171-906f-e0c46d0a3fb2 could not be found. Sep 14 08:58:23.459671 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:58:23.469509 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a088cae4-5b57-4853-95db-bcbbd88824f7 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Returning 404 to user: Instance 2334f491-8233-4171-906f-e0c46d0a3fb2 could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:58:23.479566 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a088cae4-5b57-4853-95db-bcbbd88824f7 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/2334f491-8233-4171-906f-e0c46d0a3fb2" status: 404 len: 111 microversion: 2.1 time: 0.143532 Sep 14 08:58:23.489728 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1097/2231] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:58:23 2022] GET /compute/v2.1/servers/2334f491-8233-4171-906f-e0c46d0a3fb2 => generated 111 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 08:58:23.603000 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-876b7224-0836-4981-8751-f946a84e6e7f tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:23.618038 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-876b7224-0836-4981-8751-f946a84e6e7f tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/ad55193e-b097-4372-9a00-972ed2b486f8" status: 200 len: 1389 microversion: 2.1 time: 0.575390 Sep 14 08:58:23.623592 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1135/2232] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:58:23 2022] GET /compute/v2.1/servers/ad55193e-b097-4372-9a00-972ed2b486f8 => generated 1389 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:58:23.683023 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-6f2e092b-56b9-42e8-a848-c1c0695ebadf tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-776029190", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "networks": [{"uuid": "238fbc23-0a7b-476b-a552-1a5667de089a"}]}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:58:23.790786 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.network.neutron [None req-6f2e092b-56b9-42e8-a848-c1c0695ebadf tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] validate_networks() for [('238fbc23-0a7b-476b-a552-1a5667de089a', None, None, None, None, None)] {{(pid=128759) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 08:58:23.843912 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-624bc241-2877-4c3d-ba48-3c723b8ff04d tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:23.844828 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-624bc241-2877-4c3d-ba48-3c723b8ff04d tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] [instance: 0b54f1c2-0d9c-4396-8c79-1e43b612b2ba] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:23.853941 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-624bc241-2877-4c3d-ba48-3c723b8ff04d tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:23.854777 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-624bc241-2877-4c3d-ba48-3c723b8ff04d tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:23.856082 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-624bc241-2877-4c3d-ba48-3c723b8ff04d tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:23.857701 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-624bc241-2877-4c3d-ba48-3c723b8ff04d tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:23.858598 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-624bc241-2877-4c3d-ba48-3c723b8ff04d tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:23.859421 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-624bc241-2877-4c3d-ba48-3c723b8ff04d tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:24.586799 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-624bc241-2877-4c3d-ba48-3c723b8ff04d tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e1780ebcf1413fa4f7a9760b761c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77c85f074ae4b8cb5a1457a5183197b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:24.603946 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-624bc241-2877-4c3d-ba48-3c723b8ff04d tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] 10.222.0.60 "GET /compute/v2.1/servers/0b54f1c2-0d9c-4396-8c79-1e43b612b2ba" status: 200 len: 1680 microversion: 2.1 time: 0.774040 Sep 14 08:58:24.619401 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1136/2233] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:58:23 2022] GET /compute/v2.1/servers/0b54f1c2-0d9c-4396-8c79-1e43b612b2ba => generated 1680 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:58:24.628811 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-0032eb5e-a13f-4adc-a3c2-805b0addd69b tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:24.629451 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-0032eb5e-a13f-4adc-a3c2-805b0addd69b tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] [instance: 5629527b-12f8-4467-85a7-976d17dd267a] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:24.656823 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0032eb5e-a13f-4adc-a3c2-805b0addd69b tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:24.657631 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0032eb5e-a13f-4adc-a3c2-805b0addd69b tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:24.658254 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0032eb5e-a13f-4adc-a3c2-805b0addd69b tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:24.659277 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0032eb5e-a13f-4adc-a3c2-805b0addd69b tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:24.659742 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0032eb5e-a13f-4adc-a3c2-805b0addd69b tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:24.660338 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0032eb5e-a13f-4adc-a3c2-805b0addd69b tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:24.864558 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-0032eb5e-a13f-4adc-a3c2-805b0addd69b tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f584701398b64fab808e3cbcc4259a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb6af957c8f45e5a0996c0e4b1f456a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:24.878260 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-0032eb5e-a13f-4adc-a3c2-805b0addd69b tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] 10.222.0.60 "GET /compute/v2.1/servers/5629527b-12f8-4467-85a7-976d17dd267a" status: 200 len: 1280 microversion: 2.1 time: 0.257438 Sep 14 08:58:24.879325 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1137/2234] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:58:24 2022] GET /compute/v2.1/servers/5629527b-12f8-4467-85a7-976d17dd267a => generated 1280 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:58:24.888041 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c2eb4b09-6c83-4f92-ab08-1bbb5c419a44 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:24.889930 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-c2eb4b09-6c83-4f92-ab08-1bbb5c419a44 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] [instance: 26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:24.901115 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c2eb4b09-6c83-4f92-ab08-1bbb5c419a44 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:24.901859 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c2eb4b09-6c83-4f92-ab08-1bbb5c419a44 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:24.902475 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c2eb4b09-6c83-4f92-ab08-1bbb5c419a44 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:24.903448 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c2eb4b09-6c83-4f92-ab08-1bbb5c419a44 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:24.904273 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c2eb4b09-6c83-4f92-ab08-1bbb5c419a44 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:24.905048 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c2eb4b09-6c83-4f92-ab08-1bbb5c419a44 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:25.405639 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-c2eb4b09-6c83-4f92-ab08-1bbb5c419a44 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:25.425341 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-c2eb4b09-6c83-4f92-ab08-1bbb5c419a44 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:25.453584 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-c2eb4b09-6c83-4f92-ab08-1bbb5c419a44 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:25.454852 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-c2eb4b09-6c83-4f92-ab08-1bbb5c419a44 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] 10.222.0.60 "GET /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0" status: 200 len: 1880 microversion: 2.32 time: 0.574233 Sep 14 08:58:25.455452 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1138/2235] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:58:24 2022] GET /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0 => generated 1880 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:58:25.489349 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c81b1a51-fdc7-4273-87db-7414a924154b tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:25.503917 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-c81b1a51-fdc7-4273-87db-7414a924154b tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: ad55193e-b097-4372-9a00-972ed2b486f8] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:25.520300 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c81b1a51-fdc7-4273-87db-7414a924154b tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:25.520808 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c81b1a51-fdc7-4273-87db-7414a924154b tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:25.521260 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c81b1a51-fdc7-4273-87db-7414a924154b tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:25.521989 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c81b1a51-fdc7-4273-87db-7414a924154b tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:25.522457 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c81b1a51-fdc7-4273-87db-7414a924154b tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:25.522892 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c81b1a51-fdc7-4273-87db-7414a924154b tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:25.621773 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-6f2e092b-56b9-42e8-a848-c1c0695ebadf tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Flavor limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 08:58:25.622297 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-6f2e092b-56b9-42e8-a848-c1c0695ebadf tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Image limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 08:58:25.622679 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-6f2e092b-56b9-42e8-a848-c1c0695ebadf tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Flavor pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 08:58:25.629068 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-6f2e092b-56b9-42e8-a848-c1c0695ebadf tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Image pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 08:58:25.631219 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-6f2e092b-56b9-42e8-a848-c1c0695ebadf tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 08:58:25.651512 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6f2e092b-56b9-42e8-a848-c1c0695ebadf tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:25.652262 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6f2e092b-56b9-42e8-a848-c1c0695ebadf tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:25.663744 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6f2e092b-56b9-42e8-a848-c1c0695ebadf tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:25.664895 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6f2e092b-56b9-42e8-a848-c1c0695ebadf tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:25.665542 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6f2e092b-56b9-42e8-a848-c1c0695ebadf tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:25.666149 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6f2e092b-56b9-42e8-a848-c1c0695ebadf tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:25.706875 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-6f2e092b-56b9-42e8-a848-c1c0695ebadf tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Getting quotas for project a46ca7b6c331417199f9dfc5ffa80470. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 08:58:25.714601 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-6f2e092b-56b9-42e8-a848-c1c0695ebadf tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Getting quotas for user 1473e6771ff1459c831d66311318404d and project a46ca7b6c331417199f9dfc5ffa80470. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 08:58:25.754697 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-6f2e092b-56b9-42e8-a848-c1c0695ebadf tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Going to run 1 instances... {{(pid=128759) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 08:58:25.765089 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-6f2e092b-56b9-42e8-a848-c1c0695ebadf tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: affb61a7-7e36-4424-bf48-a5a6bd64ae29] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128759) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 08:58:25.884448 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-6f2e092b-56b9-42e8-a848-c1c0695ebadf tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.207449 Sep 14 08:58:25.890903 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-c81b1a51-fdc7-4273-87db-7414a924154b tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:25.901045 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1098/2236] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 08:58:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 2225 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 08:58:25.906678 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-c81b1a51-fdc7-4273-87db-7414a924154b tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/ad55193e-b097-4372-9a00-972ed2b486f8" status: 200 len: 1184 microversion: 2.1 time: 0.421231 Sep 14 08:58:25.911547 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1139/2237] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:58:25 2022] GET /compute/v2.1/servers/ad55193e-b097-4372-9a00-972ed2b486f8 => generated 1184 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:58:25.916537 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-512d810b-a385-48d7-97b6-d7d19df8b15c req-6de9438f-4a4d-4d0f-9381-cb7e3ffb2028 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad55193e-b097-4372-9a00-972ed2b486f8", "name": "network-vif-deleted", "tag": "86eca38d-0fbc-40dc-8c19-2e0f4d671871"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:58:25.927030 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c5024e4d-88d8-46e0-a71b-d7c134ac726b tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:25.932349 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-c5024e4d-88d8-46e0-a71b-d7c134ac726b tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] [instance: 0b54f1c2-0d9c-4396-8c79-1e43b612b2ba] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:25.954787 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c5024e4d-88d8-46e0-a71b-d7c134ac726b tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:25.962413 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c5024e4d-88d8-46e0-a71b-d7c134ac726b tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:25.962964 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c5024e4d-88d8-46e0-a71b-d7c134ac726b tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:25.963742 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c5024e4d-88d8-46e0-a71b-d7c134ac726b tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:25.964232 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c5024e4d-88d8-46e0-a71b-d7c134ac726b tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:25.964667 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c5024e4d-88d8-46e0-a71b-d7c134ac726b tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:25.969378 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-512d810b-a385-48d7-97b6-d7d19df8b15c req-6de9438f-4a4d-4d0f-9381-cb7e3ffb2028 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:25.970052 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-512d810b-a385-48d7-97b6-d7d19df8b15c req-6de9438f-4a4d-4d0f-9381-cb7e3ffb2028 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:25.970508 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-512d810b-a385-48d7-97b6-d7d19df8b15c req-6de9438f-4a4d-4d0f-9381-cb7e3ffb2028 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:26.021600 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-512d810b-a385-48d7-97b6-d7d19df8b15c req-6de9438f-4a4d-4d0f-9381-cb7e3ffb2028 service nova] Creating event network-vif-deleted:86eca38d-0fbc-40dc-8c19-2e0f4d671871 for instance ad55193e-b097-4372-9a00-972ed2b486f8 on n-h2-836830-18 Sep 14 08:58:26.047428 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-512d810b-a385-48d7-97b6-d7d19df8b15c req-6de9438f-4a4d-4d0f-9381-cb7e3ffb2028 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143864 Sep 14 08:58:26.048041 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1099/2238] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:58:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:58:26.093578 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-ac0a3ea3-783d-429e-8c3f-cf1c3aed780c req-087816a1-d054-43db-bc11-c4c67e87a34c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b54f1c2-0d9c-4396-8c79-1e43b612b2ba", "name": "network-vif-deleted", "tag": "a2159b48-787c-4c0e-9fc3-ec5a293b0333"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:58:26.121485 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-ac0a3ea3-783d-429e-8c3f-cf1c3aed780c req-087816a1-d054-43db-bc11-c4c67e87a34c service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:26.121988 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-ac0a3ea3-783d-429e-8c3f-cf1c3aed780c req-087816a1-d054-43db-bc11-c4c67e87a34c service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:26.122429 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-ac0a3ea3-783d-429e-8c3f-cf1c3aed780c req-087816a1-d054-43db-bc11-c4c67e87a34c service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:26.167795 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-ac0a3ea3-783d-429e-8c3f-cf1c3aed780c req-087816a1-d054-43db-bc11-c4c67e87a34c service nova] Creating event network-vif-deleted:a2159b48-787c-4c0e-9fc3-ec5a293b0333 for instance 0b54f1c2-0d9c-4396-8c79-1e43b612b2ba on n-h1-836830-18 Sep 14 08:58:26.183730 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-ac0a3ea3-783d-429e-8c3f-cf1c3aed780c req-087816a1-d054-43db-bc11-c4c67e87a34c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126323 Sep 14 08:58:26.184865 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1100/2239] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:58:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:58:26.198668 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b5054381-f7f2-4527-994c-c4a699693f78 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:26.199653 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b5054381-f7f2-4527-994c-c4a699693f78 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] [instance: 5629527b-12f8-4467-85a7-976d17dd267a] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:26.221351 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b5054381-f7f2-4527-994c-c4a699693f78 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:26.221860 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b5054381-f7f2-4527-994c-c4a699693f78 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:26.222481 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b5054381-f7f2-4527-994c-c4a699693f78 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:26.223615 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b5054381-f7f2-4527-994c-c4a699693f78 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:26.224605 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b5054381-f7f2-4527-994c-c4a699693f78 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:26.225956 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b5054381-f7f2-4527-994c-c4a699693f78 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:26.908206 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-c5024e4d-88d8-46e0-a71b-d7c134ac726b tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e1780ebcf1413fa4f7a9760b761c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77c85f074ae4b8cb5a1457a5183197b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:26.919256 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-c5024e4d-88d8-46e0-a71b-d7c134ac726b tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] 10.222.0.60 "GET /compute/v2.1/servers/0b54f1c2-0d9c-4396-8c79-1e43b612b2ba" status: 200 len: 1326 microversion: 2.1 time: 1.004942 Sep 14 08:58:26.925354 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1140/2240] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:58:25 2022] GET /compute/v2.1/servers/0b54f1c2-0d9c-4396-8c79-1e43b612b2ba => generated 1326 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:58:26.941359 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1dcff759-1459-4c6a-9228-661dfceef881 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:26.942231 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-1dcff759-1459-4c6a-9228-661dfceef881 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: affb61a7-7e36-4424-bf48-a5a6bd64ae29] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:27.051064 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-1dcff759-1459-4c6a-9228-661dfceef881 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:27.064954 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-1dcff759-1459-4c6a-9228-661dfceef881 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/affb61a7-7e36-4424-bf48-a5a6bd64ae29" status: 200 len: 1208 microversion: 2.1 time: 0.136901 Sep 14 08:58:27.066318 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1141/2241] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:58:26 2022] GET /compute/v2.1/servers/affb61a7-7e36-4424-bf48-a5a6bd64ae29 => generated 1208 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:58:27.088163 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-520677c0-88fa-4554-943f-c78a81b07776 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:27.088925 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-520677c0-88fa-4554-943f-c78a81b07776 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] [instance: 26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:27.117455 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-520677c0-88fa-4554-943f-c78a81b07776 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:27.119753 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-520677c0-88fa-4554-943f-c78a81b07776 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:27.121195 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-520677c0-88fa-4554-943f-c78a81b07776 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:27.124978 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-520677c0-88fa-4554-943f-c78a81b07776 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:27.125690 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-520677c0-88fa-4554-943f-c78a81b07776 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:27.128873 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-520677c0-88fa-4554-943f-c78a81b07776 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:27.235375 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b5054381-f7f2-4527-994c-c4a699693f78 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f584701398b64fab808e3cbcc4259a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb6af957c8f45e5a0996c0e4b1f456a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:27.244238 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b5054381-f7f2-4527-994c-c4a699693f78 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] 10.222.0.60 "GET /compute/v2.1/servers/5629527b-12f8-4467-85a7-976d17dd267a" status: 200 len: 1322 microversion: 2.1 time: 1.057471 Sep 14 08:58:27.255933 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1101/2242] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:58:26 2022] GET /compute/v2.1/servers/5629527b-12f8-4467-85a7-976d17dd267a => generated 1322 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:58:27.261021 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d29a91fb-6760-46a2-91b5-13bcc483b2e9 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:27.261925 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-d29a91fb-6760-46a2-91b5-13bcc483b2e9 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: ad55193e-b097-4372-9a00-972ed2b486f8] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:27.274567 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d29a91fb-6760-46a2-91b5-13bcc483b2e9 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:27.275397 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d29a91fb-6760-46a2-91b5-13bcc483b2e9 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:27.276202 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d29a91fb-6760-46a2-91b5-13bcc483b2e9 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:27.280766 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d29a91fb-6760-46a2-91b5-13bcc483b2e9 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:27.281543 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d29a91fb-6760-46a2-91b5-13bcc483b2e9 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:27.282416 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d29a91fb-6760-46a2-91b5-13bcc483b2e9 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:27.621212 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-d29a91fb-6760-46a2-91b5-13bcc483b2e9 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:27.665989 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d29a91fb-6760-46a2-91b5-13bcc483b2e9 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/ad55193e-b097-4372-9a00-972ed2b486f8" status: 200 len: 1184 microversion: 2.1 time: 0.403905 Sep 14 08:58:27.672278 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1102/2243] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:58:27 2022] GET /compute/v2.1/servers/ad55193e-b097-4372-9a00-972ed2b486f8 => generated 1184 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:58:27.753072 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-520677c0-88fa-4554-943f-c78a81b07776 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:27.762125 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:58:27.776961 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-520677c0-88fa-4554-943f-c78a81b07776 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:27.783269 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-520677c0-88fa-4554-943f-c78a81b07776 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:27.789197 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-520677c0-88fa-4554-943f-c78a81b07776 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] 10.222.0.60 "GET /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0" status: 200 len: 1880 microversion: 2.32 time: 0.720181 Sep 14 08:58:27.792692 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1142/2244] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:58:27 2022] GET /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0 => generated 1880 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:58:27.953411 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-dcd4fb0b-9ac1-4077-a1b7-73797d128b9f tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:27.954178 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-dcd4fb0b-9ac1-4077-a1b7-73797d128b9f tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] [instance: 0b54f1c2-0d9c-4396-8c79-1e43b612b2ba] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:27.973757 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dcd4fb0b-9ac1-4077-a1b7-73797d128b9f tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:27.975423 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dcd4fb0b-9ac1-4077-a1b7-73797d128b9f tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:27.975984 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dcd4fb0b-9ac1-4077-a1b7-73797d128b9f tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:27.978310 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dcd4fb0b-9ac1-4077-a1b7-73797d128b9f tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:27.979114 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dcd4fb0b-9ac1-4077-a1b7-73797d128b9f tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:27.980349 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dcd4fb0b-9ac1-4077-a1b7-73797d128b9f tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:28.006661 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-dcd4fb0b-9ac1-4077-a1b7-73797d128b9f tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] HTTP exception thrown: Instance 0b54f1c2-0d9c-4396-8c79-1e43b612b2ba could not be found. Sep 14 08:58:28.009946 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-dcd4fb0b-9ac1-4077-a1b7-73797d128b9f tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Request method failure captured: Sep 14 08:58:28.009946 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/0b54f1c2-0d9c-4396-8c79-1e43b612b2ba HTTP/1.1 Sep 14 08:58:28.009946 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 08:58:28.009946 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 08:58:28.009946 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 08:58:28.009946 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 08:58:28.009946 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 08:58:28.009946 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 08:58:28.009946 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 08:58:28.009946 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 08:58:28.009946 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZa33UCZGQPGGFdnEKy40Bf9yKumjdqBjudRlsEN8P4xQwLQqU7t11praMTuRTYjXF9W5xpncATu9Asflgdxa1jHHEk90rPM23QPYiIhIrdEtxdPdlSJ3WSHd59VxlPFgfCP3TDOFWt0Y7zLGdkKDGRppghDHAK0BfaQiaCZwfTNzFE Sep 14 08:58:28.009946 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 08:58:28.009946 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 08:58:28.009946 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 08:58:28.009946 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 08:58:28.009946 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 08:58:28.009946 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 08:58:28.009946 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: e77c85f074ae4b8cb5a1457a5183197b Sep 14 08:58:28.009946 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1087944038 Sep 14 08:58:28.009946 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 08:58:28.009946 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 08:58:28.009946 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e77c85f074ae4b8cb5a1457a5183197b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e77c85f074ae4b8cb5a1457a5183197b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e77c85f074ae4b8cb5a1457a5183197b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e77c85f074ae4b8cb5a1457a5183197b"}]}] Sep 14 08:58:28.009946 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1087944038 Sep 14 08:58:28.009946 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: e77c85f074ae4b8cb5a1457a5183197b Sep 14 08:58:28.009946 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1087944038 Sep 14 08:58:28.009946 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-AttachSCSIVolumeTestJSON-1087944038-project Sep 14 08:58:28.009946 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 08:58:28.009946 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 08:58:28.009946 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 72e1780ebcf1413fa4f7a9760b761c78 Sep 14 08:58:28.009946 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1087944038-project Sep 14 08:58:28.009946 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 08:58:28.009946 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance 0b54f1c2-0d9c-4396-8c79-1e43b612b2ba could not be found. Sep 14 08:58:28.009946 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '0b54f1c2-0d9c-4396-8c79-1e43b612b2ba'} Sep 14 08:58:28.009946 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:58:28.009946 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:58:28.009946 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 08:58:28.009946 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 08:58:28.009946 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 08:58:28.009946 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 08:58:28.009946 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 08:58:28.009946 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 08:58:28.009946 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 08:58:28.009946 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 08:58:28.009946 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b54f1c2-0d9c-4396-8c79-1e43b612b2ba could not be found. Sep 14 08:58:28.009946 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:58:28.009946 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:58:28.009946 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:58:28.009946 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:58:28.009946 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:58:28.009946 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:58:28.009946 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:58:28.009946 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:58:28.009946 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:58:28.009946 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:58:28.009946 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 08:58:28.009946 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 08:58:28.009946 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 08:58:28.009946 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 08:58:28.009946 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 08:58:28.009946 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 08:58:28.009946 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b54f1c2-0d9c-4396-8c79-1e43b612b2ba could not be found. Sep 14 08:58:28.009946 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:58:28.009946 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:58:28.009946 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:58:28.014238 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:58:28.014238 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:58:28.014238 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:58:28.014238 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:58:28.014238 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:58:28.014238 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b54f1c2-0d9c-4396-8c79-1e43b612b2ba could not be found. Sep 14 08:58:28.014238 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:58:28.018577 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-dcd4fb0b-9ac1-4077-a1b7-73797d128b9f tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Returning 404 to user: Instance 0b54f1c2-0d9c-4396-8c79-1e43b612b2ba could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:58:28.019798 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-dcd4fb0b-9ac1-4077-a1b7-73797d128b9f tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] 10.222.0.60 "GET /compute/v2.1/servers/0b54f1c2-0d9c-4396-8c79-1e43b612b2ba" status: 404 len: 111 microversion: 2.1 time: 0.074876 Sep 14 08:58:28.021923 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1103/2245] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:58:27 2022] GET /compute/v2.1/servers/0b54f1c2-0d9c-4396-8c79-1e43b612b2ba => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 08:58:28.032913 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ae528d63-6dd1-4c39-b88b-25b478939ddb tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Calling method '.version_select at 0x7f7d447fb700>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:28.089986 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-03babc94-c746-4fd9-80e0-4d0ac0ad3639 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:28.090615 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-03babc94-c746-4fd9-80e0-4d0ac0ad3639 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: affb61a7-7e36-4424-bf48-a5a6bd64ae29] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:28.129448 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-ae528d63-6dd1-4c39-b88b-25b478939ddb tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1978685054" status: 202 len: 0 microversion: 2.1 time: 0.102842 Sep 14 08:58:28.131429 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-03babc94-c746-4fd9-80e0-4d0ac0ad3639 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:28.136898 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-03babc94-c746-4fd9-80e0-4d0ac0ad3639 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:28.138452 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-03babc94-c746-4fd9-80e0-4d0ac0ad3639 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:28.138629 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1143/2246] 10.222.0.60 () {58 vars in 1221 bytes} [Wed Sep 14 08:58:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1978685054 => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 08:58:28.142023 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-03babc94-c746-4fd9-80e0-4d0ac0ad3639 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:28.142145 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-03babc94-c746-4fd9-80e0-4d0ac0ad3639 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:28.148163 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-03babc94-c746-4fd9-80e0-4d0ac0ad3639 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:28.288237 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ff589519-2d61-44a3-8c39-80b9a6e7d9d7 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:28.289486 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-ff589519-2d61-44a3-8c39-80b9a6e7d9d7 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] [instance: 5629527b-12f8-4467-85a7-976d17dd267a] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:28.323354 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ff589519-2d61-44a3-8c39-80b9a6e7d9d7 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:28.324215 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ff589519-2d61-44a3-8c39-80b9a6e7d9d7 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:28.325069 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ff589519-2d61-44a3-8c39-80b9a6e7d9d7 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:28.328314 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ff589519-2d61-44a3-8c39-80b9a6e7d9d7 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:28.328984 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ff589519-2d61-44a3-8c39-80b9a6e7d9d7 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:28.330423 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ff589519-2d61-44a3-8c39-80b9a6e7d9d7 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:28.592370 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-03babc94-c746-4fd9-80e0-4d0ac0ad3639 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:28.607363 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-03babc94-c746-4fd9-80e0-4d0ac0ad3639 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/affb61a7-7e36-4424-bf48-a5a6bd64ae29" status: 200 len: 1260 microversion: 2.1 time: 0.517463 Sep 14 08:58:28.618971 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1104/2247] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:58:28 2022] GET /compute/v2.1/servers/affb61a7-7e36-4424-bf48-a5a6bd64ae29 => generated 1260 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:58:28.709077 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e1d05e5b-f87e-415e-b2c6-c30dc7dab023 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:28.715778 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e1d05e5b-f87e-415e-b2c6-c30dc7dab023 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: ad55193e-b097-4372-9a00-972ed2b486f8] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:28.750708 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e1d05e5b-f87e-415e-b2c6-c30dc7dab023 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:28.751372 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e1d05e5b-f87e-415e-b2c6-c30dc7dab023 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:28.751918 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e1d05e5b-f87e-415e-b2c6-c30dc7dab023 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:28.754551 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e1d05e5b-f87e-415e-b2c6-c30dc7dab023 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:28.755427 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e1d05e5b-f87e-415e-b2c6-c30dc7dab023 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:28.758479 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e1d05e5b-f87e-415e-b2c6-c30dc7dab023 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:29.150010 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-e1d05e5b-f87e-415e-b2c6-c30dc7dab023 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:29.159341 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e1d05e5b-f87e-415e-b2c6-c30dc7dab023 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/ad55193e-b097-4372-9a00-972ed2b486f8" status: 200 len: 1184 microversion: 2.1 time: 0.467390 Sep 14 08:58:29.172012 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1105/2248] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:58:28 2022] GET /compute/v2.1/servers/ad55193e-b097-4372-9a00-972ed2b486f8 => generated 1184 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:58:29.177315 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-967c83d2-b555-4a84-bebb-72dd9532b5a8 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:29.178220 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-967c83d2-b555-4a84-bebb-72dd9532b5a8 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] [instance: 26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:29.188826 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-967c83d2-b555-4a84-bebb-72dd9532b5a8 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:29.189834 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-967c83d2-b555-4a84-bebb-72dd9532b5a8 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:29.191515 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-967c83d2-b555-4a84-bebb-72dd9532b5a8 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:29.193799 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-967c83d2-b555-4a84-bebb-72dd9532b5a8 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:29.194856 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-967c83d2-b555-4a84-bebb-72dd9532b5a8 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:29.197711 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-967c83d2-b555-4a84-bebb-72dd9532b5a8 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:30.130723 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=2 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:58:30.220003 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-ff589519-2d61-44a3-8c39-80b9a6e7d9d7 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f584701398b64fab808e3cbcc4259a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb6af957c8f45e5a0996c0e4b1f456a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:30.244065 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-ff589519-2d61-44a3-8c39-80b9a6e7d9d7 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] 10.222.0.60 "GET /compute/v2.1/servers/5629527b-12f8-4467-85a7-976d17dd267a" status: 200 len: 1322 microversion: 2.1 time: 1.963162 Sep 14 08:58:30.245562 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1144/2249] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:58:28 2022] GET /compute/v2.1/servers/5629527b-12f8-4467-85a7-976d17dd267a => generated 1322 bytes in 1965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:58:30.255649 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-d9d0b1a1-644c-4870-a1e2-ddcb117b9944 req-58403835-f825-4081-bd2d-24d5a917caa1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5629527b-12f8-4467-85a7-976d17dd267a", "tag": "78cf3403-7929-473d-b37b-6bb3deefa0cd"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:58:30.296679 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-d9d0b1a1-644c-4870-a1e2-ddcb117b9944 req-58403835-f825-4081-bd2d-24d5a917caa1 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:30.297490 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-d9d0b1a1-644c-4870-a1e2-ddcb117b9944 req-58403835-f825-4081-bd2d-24d5a917caa1 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:30.298390 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-d9d0b1a1-644c-4870-a1e2-ddcb117b9944 req-58403835-f825-4081-bd2d-24d5a917caa1 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:30.333541 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-d9d0b1a1-644c-4870-a1e2-ddcb117b9944 req-58403835-f825-4081-bd2d-24d5a917caa1 service nova] Creating event network-changed:78cf3403-7929-473d-b37b-6bb3deefa0cd for instance 5629527b-12f8-4467-85a7-976d17dd267a on n-h2-836830-18 Sep 14 08:58:30.353661 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-d9d0b1a1-644c-4870-a1e2-ddcb117b9944 req-58403835-f825-4081-bd2d-24d5a917caa1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106086 Sep 14 08:58:30.363744 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1145/2250] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:58:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:58:30.378398 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-eea985bc-71b9-499a-8a76-6a28f547f7a6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:30.383570 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-eea985bc-71b9-499a-8a76-6a28f547f7a6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: affb61a7-7e36-4424-bf48-a5a6bd64ae29] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:30.405581 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-eea985bc-71b9-499a-8a76-6a28f547f7a6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:30.419920 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-eea985bc-71b9-499a-8a76-6a28f547f7a6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:30.421439 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-eea985bc-71b9-499a-8a76-6a28f547f7a6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:30.424232 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-eea985bc-71b9-499a-8a76-6a28f547f7a6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:30.424802 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-eea985bc-71b9-499a-8a76-6a28f547f7a6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:30.425319 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-eea985bc-71b9-499a-8a76-6a28f547f7a6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:30.895106 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-eea985bc-71b9-499a-8a76-6a28f547f7a6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:30.908130 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-eea985bc-71b9-499a-8a76-6a28f547f7a6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/affb61a7-7e36-4424-bf48-a5a6bd64ae29" status: 200 len: 1266 microversion: 2.1 time: 0.542196 Sep 14 08:58:30.909172 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1146/2251] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:58:30 2022] GET /compute/v2.1/servers/affb61a7-7e36-4424-bf48-a5a6bd64ae29 => generated 1266 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:58:30.923134 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-79eb38eb-73ec-4c31-9e6a-75dd9361427d tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:30.923873 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-79eb38eb-73ec-4c31-9e6a-75dd9361427d tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: ad55193e-b097-4372-9a00-972ed2b486f8] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:30.932411 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-79eb38eb-73ec-4c31-9e6a-75dd9361427d tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:30.933945 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-79eb38eb-73ec-4c31-9e6a-75dd9361427d tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:30.937867 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-79eb38eb-73ec-4c31-9e6a-75dd9361427d tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:30.939181 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-79eb38eb-73ec-4c31-9e6a-75dd9361427d tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:30.939855 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-79eb38eb-73ec-4c31-9e6a-75dd9361427d tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:30.940472 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-79eb38eb-73ec-4c31-9e6a-75dd9361427d tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:31.132768 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-79eb38eb-73ec-4c31-9e6a-75dd9361427d tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:31.158757 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-79eb38eb-73ec-4c31-9e6a-75dd9361427d tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/ad55193e-b097-4372-9a00-972ed2b486f8" status: 200 len: 1184 microversion: 2.1 time: 0.234639 Sep 14 08:58:31.165332 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1147/2252] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:58:30 2022] GET /compute/v2.1/servers/ad55193e-b097-4372-9a00-972ed2b486f8 => generated 1184 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:58:31.233708 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-967c83d2-b555-4a84-bebb-72dd9532b5a8 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:31.258849 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-967c83d2-b555-4a84-bebb-72dd9532b5a8 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:31.264052 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-967c83d2-b555-4a84-bebb-72dd9532b5a8 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:31.265641 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-967c83d2-b555-4a84-bebb-72dd9532b5a8 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] 10.222.0.60 "GET /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0" status: 200 len: 1880 microversion: 2.32 time: 2.092316 Sep 14 08:58:31.272320 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a5fa4a4f-42ff-4481-8637-1eba22f2268e tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:31.273140 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-a5fa4a4f-42ff-4481-8637-1eba22f2268e tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] [instance: 5629527b-12f8-4467-85a7-976d17dd267a] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:31.286229 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a5fa4a4f-42ff-4481-8637-1eba22f2268e tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:31.288541 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1106/2253] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:58:29 2022] GET /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0 => generated 1880 bytes in 2108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:58:31.301496 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a5fa4a4f-42ff-4481-8637-1eba22f2268e tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:31.301985 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a5fa4a4f-42ff-4481-8637-1eba22f2268e tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:31.302773 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a5fa4a4f-42ff-4481-8637-1eba22f2268e tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:31.303315 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a5fa4a4f-42ff-4481-8637-1eba22f2268e tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:31.308638 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a5fa4a4f-42ff-4481-8637-1eba22f2268e tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:31.938396 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-2b358bfb-b60a-4d6b-9217-3a3c640db0ec tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:31.939313 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-2b358bfb-b60a-4d6b-9217-3a3c640db0ec tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: affb61a7-7e36-4424-bf48-a5a6bd64ae29] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:31.958661 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2b358bfb-b60a-4d6b-9217-3a3c640db0ec tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:31.962364 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2b358bfb-b60a-4d6b-9217-3a3c640db0ec tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:31.962880 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2b358bfb-b60a-4d6b-9217-3a3c640db0ec tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:31.965672 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2b358bfb-b60a-4d6b-9217-3a3c640db0ec tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:31.969589 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2b358bfb-b60a-4d6b-9217-3a3c640db0ec tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:31.970073 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2b358bfb-b60a-4d6b-9217-3a3c640db0ec tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:32.220733 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-2b358bfb-b60a-4d6b-9217-3a3c640db0ec tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:32.228935 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-2b358bfb-b60a-4d6b-9217-3a3c640db0ec tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/affb61a7-7e36-4424-bf48-a5a6bd64ae29" status: 200 len: 1266 microversion: 2.1 time: 0.296782 Sep 14 08:58:32.240757 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1107/2254] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:58:31 2022] GET /compute/v2.1/servers/affb61a7-7e36-4424-bf48-a5a6bd64ae29 => generated 1266 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:58:32.252697 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ad27e78b-c02c-4e5c-84a0-4019b4cbf791 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:32.253572 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-ad27e78b-c02c-4e5c-84a0-4019b4cbf791 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: ad55193e-b097-4372-9a00-972ed2b486f8] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:32.267913 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ad27e78b-c02c-4e5c-84a0-4019b4cbf791 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:32.268584 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ad27e78b-c02c-4e5c-84a0-4019b4cbf791 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:32.269215 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ad27e78b-c02c-4e5c-84a0-4019b4cbf791 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:32.270591 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ad27e78b-c02c-4e5c-84a0-4019b4cbf791 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:32.271378 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ad27e78b-c02c-4e5c-84a0-4019b4cbf791 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:32.271955 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ad27e78b-c02c-4e5c-84a0-4019b4cbf791 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:32.703309 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-ad27e78b-c02c-4e5c-84a0-4019b4cbf791 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:32.713840 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-ad27e78b-c02c-4e5c-84a0-4019b4cbf791 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/ad55193e-b097-4372-9a00-972ed2b486f8" status: 200 len: 1184 microversion: 2.1 time: 0.471064 Sep 14 08:58:32.741872 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1108/2255] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:58:32 2022] GET /compute/v2.1/servers/ad55193e-b097-4372-9a00-972ed2b486f8 => generated 1184 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:58:32.743535 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-a5fa4a4f-42ff-4481-8637-1eba22f2268e tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f584701398b64fab808e3cbcc4259a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb6af957c8f45e5a0996c0e4b1f456a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:32.755802 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-a5fa4a4f-42ff-4481-8637-1eba22f2268e tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] 10.222.0.60 "GET /compute/v2.1/servers/5629527b-12f8-4467-85a7-976d17dd267a" status: 200 len: 1322 microversion: 2.1 time: 1.487524 Sep 14 08:58:32.757176 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1148/2256] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:58:31 2022] GET /compute/v2.1/servers/5629527b-12f8-4467-85a7-976d17dd267a => generated 1322 bytes in 1489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:58:32.774692 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-023c35db-a4ab-4253-8f18-4121de025166 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:32.775608 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-023c35db-a4ab-4253-8f18-4121de025166 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] [instance: 26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:32.786725 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-023c35db-a4ab-4253-8f18-4121de025166 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:32.795478 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-023c35db-a4ab-4253-8f18-4121de025166 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:32.796008 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-023c35db-a4ab-4253-8f18-4121de025166 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:32.796771 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-023c35db-a4ab-4253-8f18-4121de025166 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:32.797244 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-023c35db-a4ab-4253-8f18-4121de025166 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:32.797675 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-023c35db-a4ab-4253-8f18-4121de025166 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:33.153274 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-023c35db-a4ab-4253-8f18-4121de025166 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:33.176881 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-023c35db-a4ab-4253-8f18-4121de025166 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:33.182203 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-023c35db-a4ab-4253-8f18-4121de025166 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:33.186458 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-023c35db-a4ab-4253-8f18-4121de025166 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] 10.222.0.60 "GET /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0" status: 200 len: 1880 microversion: 2.32 time: 0.441579 Sep 14 08:58:33.188583 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1109/2257] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:58:32 2022] GET /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0 => generated 1880 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:58:33.256965 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-95b6b570-41d0-47c1-b62e-a9aa0f96b606 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:33.258151 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-95b6b570-41d0-47c1-b62e-a9aa0f96b606 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: affb61a7-7e36-4424-bf48-a5a6bd64ae29] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:33.270854 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-95b6b570-41d0-47c1-b62e-a9aa0f96b606 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:33.271712 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-95b6b570-41d0-47c1-b62e-a9aa0f96b606 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:33.272399 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-95b6b570-41d0-47c1-b62e-a9aa0f96b606 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:33.273341 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-95b6b570-41d0-47c1-b62e-a9aa0f96b606 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:33.274042 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-95b6b570-41d0-47c1-b62e-a9aa0f96b606 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:33.274709 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-95b6b570-41d0-47c1-b62e-a9aa0f96b606 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:33.718581 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-95b6b570-41d0-47c1-b62e-a9aa0f96b606 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:33.738450 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-95b6b570-41d0-47c1-b62e-a9aa0f96b606 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/affb61a7-7e36-4424-bf48-a5a6bd64ae29" status: 200 len: 1266 microversion: 2.1 time: 0.478653 Sep 14 08:58:33.742542 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a8b7891e-da6f-46f4-8225-1cff920dff57 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:33.743214 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-a8b7891e-da6f-46f4-8225-1cff920dff57 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: ad55193e-b097-4372-9a00-972ed2b486f8] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:33.750126 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1149/2258] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:58:33 2022] GET /compute/v2.1/servers/affb61a7-7e36-4424-bf48-a5a6bd64ae29 => generated 1266 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:58:33.769605 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a8b7891e-da6f-46f4-8225-1cff920dff57 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:33.770277 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a8b7891e-da6f-46f4-8225-1cff920dff57 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:33.773413 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a8b7891e-da6f-46f4-8225-1cff920dff57 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:33.774338 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a8b7891e-da6f-46f4-8225-1cff920dff57 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:33.775459 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a8b7891e-da6f-46f4-8225-1cff920dff57 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:33.776967 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a8b7891e-da6f-46f4-8225-1cff920dff57 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:33.784336 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1f858e52-bb72-41f7-bcd9-14d05f211a20 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:33.785097 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-1f858e52-bb72-41f7-bcd9-14d05f211a20 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] [instance: 5629527b-12f8-4467-85a7-976d17dd267a] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:33.796642 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1f858e52-bb72-41f7-bcd9-14d05f211a20 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:33.799357 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1f858e52-bb72-41f7-bcd9-14d05f211a20 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:33.799828 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1f858e52-bb72-41f7-bcd9-14d05f211a20 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:33.800742 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1f858e52-bb72-41f7-bcd9-14d05f211a20 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:33.801213 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1f858e52-bb72-41f7-bcd9-14d05f211a20 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:33.804761 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1f858e52-bb72-41f7-bcd9-14d05f211a20 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:33.973146 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-a8b7891e-da6f-46f4-8225-1cff920dff57 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:33.999780 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a8b7891e-da6f-46f4-8225-1cff920dff57 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/ad55193e-b097-4372-9a00-972ed2b486f8" status: 200 len: 1184 microversion: 2.1 time: 0.261464 Sep 14 08:58:34.020331 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1110/2259] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:58:33 2022] GET /compute/v2.1/servers/ad55193e-b097-4372-9a00-972ed2b486f8 => generated 1184 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:58:34.221353 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a5fa8f70-8054-4aca-994a-8e8d4c3036a6 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-86408554", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "networks": [{"uuid": "74ca5aa6-7711-43a3-8680-b63fc6f25063"}]}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:58:34.317053 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.network.neutron [None req-a5fa8f70-8054-4aca-994a-8e8d4c3036a6 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] validate_networks() for [('74ca5aa6-7711-43a3-8680-b63fc6f25063', None, None, None, None, None)] {{(pid=128759) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 08:58:34.355544 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-1f858e52-bb72-41f7-bcd9-14d05f211a20 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f584701398b64fab808e3cbcc4259a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb6af957c8f45e5a0996c0e4b1f456a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:34.369568 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-1f858e52-bb72-41f7-bcd9-14d05f211a20 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] 10.222.0.60 "GET /compute/v2.1/servers/5629527b-12f8-4467-85a7-976d17dd267a" status: 200 len: 1322 microversion: 2.1 time: 0.591530 Sep 14 08:58:34.385852 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1150/2260] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:58:33 2022] GET /compute/v2.1/servers/5629527b-12f8-4467-85a7-976d17dd267a => generated 1322 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:58:34.391776 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-dbc18c0b-1701-44c9-a10a-f724461d3072 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:34.399641 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-dbc18c0b-1701-44c9-a10a-f724461d3072 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] [instance: 26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:34.427814 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dbc18c0b-1701-44c9-a10a-f724461d3072 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:34.428330 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dbc18c0b-1701-44c9-a10a-f724461d3072 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:34.428779 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dbc18c0b-1701-44c9-a10a-f724461d3072 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:34.429530 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dbc18c0b-1701-44c9-a10a-f724461d3072 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:34.429995 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dbc18c0b-1701-44c9-a10a-f724461d3072 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:34.430429 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dbc18c0b-1701-44c9-a10a-f724461d3072 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:35.691813 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=2 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:58:35.750332 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=6 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:58:35.866096 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-dbc18c0b-1701-44c9-a10a-f724461d3072 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:35.884236 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-dbc18c0b-1701-44c9-a10a-f724461d3072 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:35.887241 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-dbc18c0b-1701-44c9-a10a-f724461d3072 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:35.889010 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-dbc18c0b-1701-44c9-a10a-f724461d3072 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] 10.222.0.60 "GET /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0" status: 200 len: 1880 microversion: 2.32 time: 1.501442 Sep 14 08:58:35.894711 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1151/2261] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:58:34 2022] GET /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0 => generated 1880 bytes in 1507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:58:35.905005 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-2ac298fa-4402-467f-8145-45b6a014f5c7 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:35.905626 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-2ac298fa-4402-467f-8145-45b6a014f5c7 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: affb61a7-7e36-4424-bf48-a5a6bd64ae29] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:35.925352 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2ac298fa-4402-467f-8145-45b6a014f5c7 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:35.925855 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2ac298fa-4402-467f-8145-45b6a014f5c7 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:35.928578 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2ac298fa-4402-467f-8145-45b6a014f5c7 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:35.930584 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2ac298fa-4402-467f-8145-45b6a014f5c7 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:35.931961 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2ac298fa-4402-467f-8145-45b6a014f5c7 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:35.932753 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2ac298fa-4402-467f-8145-45b6a014f5c7 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:35.989712 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-a5fa8f70-8054-4aca-994a-8e8d4c3036a6 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Flavor limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 08:58:35.990161 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-a5fa8f70-8054-4aca-994a-8e8d4c3036a6 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Image limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 08:58:35.990651 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-a5fa8f70-8054-4aca-994a-8e8d4c3036a6 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Flavor pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 08:58:35.991101 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-a5fa8f70-8054-4aca-994a-8e8d4c3036a6 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Image pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 08:58:35.991585 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-a5fa8f70-8054-4aca-994a-8e8d4c3036a6 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 08:58:36.011272 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a5fa8f70-8054-4aca-994a-8e8d4c3036a6 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:36.014239 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a5fa8f70-8054-4aca-994a-8e8d4c3036a6 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:36.016403 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a5fa8f70-8054-4aca-994a-8e8d4c3036a6 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:36.017235 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a5fa8f70-8054-4aca-994a-8e8d4c3036a6 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:36.018651 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a5fa8f70-8054-4aca-994a-8e8d4c3036a6 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:36.023094 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a5fa8f70-8054-4aca-994a-8e8d4c3036a6 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:36.044023 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:58:36.065045 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-a5fa8f70-8054-4aca-994a-8e8d4c3036a6 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Getting quotas for project 6ed2295a58f8451993a57ce0a6f9ba29. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 08:58:36.072903 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-a5fa8f70-8054-4aca-994a-8e8d4c3036a6 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Getting quotas for user dc9d40e54481461cba53fedb9a6abdf8 and project 6ed2295a58f8451993a57ce0a6f9ba29. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 08:58:36.109200 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-a5fa8f70-8054-4aca-994a-8e8d4c3036a6 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Going to run 1 instances... {{(pid=128759) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 08:58:36.112485 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-a5fa8f70-8054-4aca-994a-8e8d4c3036a6 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: d0c5547a-1340-4d19-a0f9-3e1eb9fd1932] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128759) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 08:58:36.219592 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-2ac298fa-4402-467f-8145-45b6a014f5c7 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:36.233790 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-2ac298fa-4402-467f-8145-45b6a014f5c7 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/affb61a7-7e36-4424-bf48-a5a6bd64ae29" status: 200 len: 1308 microversion: 2.1 time: 0.337715 Sep 14 08:58:36.235070 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1152/2262] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:58:35 2022] GET /compute/v2.1/servers/affb61a7-7e36-4424-bf48-a5a6bd64ae29 => generated 1308 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:58:36.264575 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a5fa8f70-8054-4aca-994a-8e8d4c3036a6 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.242223 Sep 14 08:58:36.265274 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1111/2263] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 08:58:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 2244 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 08:58:36.285343 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c8f167e6-2fe7-4ddd-8c8b-145c49176ed7 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:36.287830 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-c8f167e6-2fe7-4ddd-8c8b-145c49176ed7 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: ad55193e-b097-4372-9a00-972ed2b486f8] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:36.305539 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c8f167e6-2fe7-4ddd-8c8b-145c49176ed7 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:36.306896 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c8f167e6-2fe7-4ddd-8c8b-145c49176ed7 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:36.309176 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c8f167e6-2fe7-4ddd-8c8b-145c49176ed7 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:36.313151 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c8f167e6-2fe7-4ddd-8c8b-145c49176ed7 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:36.313845 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c8f167e6-2fe7-4ddd-8c8b-145c49176ed7 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:36.315764 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c8f167e6-2fe7-4ddd-8c8b-145c49176ed7 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:36.353915 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-c8f167e6-2fe7-4ddd-8c8b-145c49176ed7 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] HTTP exception thrown: Instance ad55193e-b097-4372-9a00-972ed2b486f8 could not be found. Sep 14 08:58:36.361101 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c8f167e6-2fe7-4ddd-8c8b-145c49176ed7 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Request method failure captured: Sep 14 08:58:36.361101 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/ad55193e-b097-4372-9a00-972ed2b486f8 HTTP/1.1 Sep 14 08:58:36.361101 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 08:58:36.361101 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 08:58:36.361101 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 08:58:36.361101 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 08:58:36.361101 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 08:58:36.361101 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 08:58:36.361101 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 08:58:36.361101 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 08:58:36.361101 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZW95b9fRr0E8bmSYM4S4lx9RiOfMr3cO7rblfxvOYjE7-JF30wAZsjQevo3rJUWAD3qTMdAvcdDZSED6vnvXWkl-NZqWaQ1NpJszbVtZlHL-LyTQfjvCcAn-ta76aZv2KZ5I1yoLILYoyMC8sk6rSQDq_-WLamtcU7SEoA-kKfdsWk Sep 14 08:58:36.361101 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 08:58:36.361101 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 08:58:36.361101 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 08:58:36.361101 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 08:58:36.361101 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 08:58:36.361101 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 08:58:36.361101 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: a7342631eeb747ba831f1d8a20fb8bf3 Sep 14 08:58:36.361101 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-LiveMigrationTest-14808698 Sep 14 08:58:36.361101 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 08:58:36.361101 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 08:58:36.361101 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a7342631eeb747ba831f1d8a20fb8bf3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a7342631eeb747ba831f1d8a20fb8bf3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a7342631eeb747ba831f1d8a20fb8bf3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a7342631eeb747ba831f1d8a20fb8bf3"}]}] Sep 14 08:58:36.361101 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-LiveMigrationTest-14808698 Sep 14 08:58:36.361101 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: a7342631eeb747ba831f1d8a20fb8bf3 Sep 14 08:58:36.361101 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-LiveMigrationTest-14808698 Sep 14 08:58:36.361101 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-LiveMigrationTest-14808698-project Sep 14 08:58:36.361101 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 08:58:36.361101 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 08:58:36.361101 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: cd713a1c3e7148ef8bfcbe44d1a80a18 Sep 14 08:58:36.361101 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-LiveMigrationTest-14808698-project Sep 14 08:58:36.361101 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 08:58:36.361101 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance ad55193e-b097-4372-9a00-972ed2b486f8 could not be found. Sep 14 08:58:36.361101 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': 'ad55193e-b097-4372-9a00-972ed2b486f8'} Sep 14 08:58:36.361101 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:58:36.361101 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:58:36.361101 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 08:58:36.361101 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 08:58:36.361101 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 08:58:36.361101 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 08:58:36.361101 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 08:58:36.361101 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 08:58:36.361101 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 08:58:36.361101 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 08:58:36.361101 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad55193e-b097-4372-9a00-972ed2b486f8 could not be found. Sep 14 08:58:36.361101 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:58:36.361101 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:58:36.361101 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:58:36.361101 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:58:36.361101 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:58:36.361101 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:58:36.361101 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:58:36.361101 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:58:36.361101 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:58:36.361101 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:58:36.361101 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 08:58:36.361101 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 08:58:36.361101 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 08:58:36.361101 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 08:58:36.361101 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 08:58:36.361101 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 08:58:36.361101 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad55193e-b097-4372-9a00-972ed2b486f8 could not be found. Sep 14 08:58:36.361101 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:58:36.361101 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:58:36.361101 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:58:36.365566 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:58:36.365566 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:58:36.365566 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:58:36.365566 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:58:36.365566 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:58:36.365566 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad55193e-b097-4372-9a00-972ed2b486f8 could not be found. Sep 14 08:58:36.365566 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:58:36.368812 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c8f167e6-2fe7-4ddd-8c8b-145c49176ed7 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Returning 404 to user: Instance ad55193e-b097-4372-9a00-972ed2b486f8 could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:58:36.369943 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-c8f167e6-2fe7-4ddd-8c8b-145c49176ed7 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/ad55193e-b097-4372-9a00-972ed2b486f8" status: 404 len: 111 microversion: 2.1 time: 0.100777 Sep 14 08:58:36.373519 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1112/2264] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:58:36 2022] GET /compute/v2.1/servers/ad55193e-b097-4372-9a00-972ed2b486f8 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 08:58:36.413905 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3ad14d14-0321-4bff-93db-2df4c758e6d9 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:36.419072 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-3ad14d14-0321-4bff-93db-2df4c758e6d9 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] [instance: 5629527b-12f8-4467-85a7-976d17dd267a] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:36.444467 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3ad14d14-0321-4bff-93db-2df4c758e6d9 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:36.446044 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3ad14d14-0321-4bff-93db-2df4c758e6d9 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:36.448323 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3ad14d14-0321-4bff-93db-2df4c758e6d9 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:36.452459 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3ad14d14-0321-4bff-93db-2df4c758e6d9 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:36.453252 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3ad14d14-0321-4bff-93db-2df4c758e6d9 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:36.455994 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3ad14d14-0321-4bff-93db-2df4c758e6d9 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:36.648627 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-32ba7223-1ea2-4eb7-97b2-685a9ea27fe7 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Action: 'create', calling method: .version_select at 0x7f7d44d6cd30>, body: {"keypair": {"name": "tempest-keypair-1474730964", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKJsinAviZY93JG4raaVr3anJCfVHuyh/WOSIywynUTLMJu40+jn4SiO05XvhxgS1mv+zPH6epoUPLRMM4yh2NZklVE1msFEhjd7Xhl3AJpppemHN20JMTVz8jrXEUp8DA=="}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:58:36.784979 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-32ba7223-1ea2-4eb7-97b2-685a9ea27fe7 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Getting quotas for project de82b83dadd541dbb4a939f2fc04a163. Resources: {'key_pairs'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 08:58:36.821052 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-32ba7223-1ea2-4eb7-97b2-685a9ea27fe7 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Getting quotas for user 93ab7166e40e4a908eefbfb03b3b8804 and project de82b83dadd541dbb4a939f2fc04a163. Resources: {'key_pairs'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 08:58:36.915236 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-32ba7223-1ea2-4eb7-97b2-685a9ea27fe7 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.678581 Sep 14 08:58:36.921159 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1153/2265] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Sep 14 08:58:36 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:58:36.943841 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-bdf5f2d0-8273-4e14-98f2-9a06134e21a6 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:36.947753 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-bdf5f2d0-8273-4e14-98f2-9a06134e21a6 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: d0c5547a-1340-4d19-a0f9-3e1eb9fd1932] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:37.323031 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-3ad14d14-0321-4bff-93db-2df4c758e6d9 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f584701398b64fab808e3cbcc4259a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb6af957c8f45e5a0996c0e4b1f456a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:37.354780 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-3ad14d14-0321-4bff-93db-2df4c758e6d9 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] 10.222.0.60 "GET /compute/v2.1/servers/5629527b-12f8-4467-85a7-976d17dd267a" status: 200 len: 1322 microversion: 2.1 time: 0.973105 Sep 14 08:58:37.359410 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1113/2266] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:58:36 2022] GET /compute/v2.1/servers/5629527b-12f8-4467-85a7-976d17dd267a => generated 1322 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:58:37.394885 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-10e10a90-0bb7-42c9-b3cc-298cff616efc req-705bc465-3104-45e5-bf9e-ebd544ccd18c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5629527b-12f8-4467-85a7-976d17dd267a", "name": "network-vif-plugged", "status": "completed", "tag": "78cf3403-7929-473d-b37b-6bb3deefa0cd"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:58:37.451927 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-10e10a90-0bb7-42c9-b3cc-298cff616efc req-705bc465-3104-45e5-bf9e-ebd544ccd18c service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:37.452416 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-10e10a90-0bb7-42c9-b3cc-298cff616efc req-705bc465-3104-45e5-bf9e-ebd544ccd18c service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:37.453148 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-10e10a90-0bb7-42c9-b3cc-298cff616efc req-705bc465-3104-45e5-bf9e-ebd544ccd18c service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:37.457067 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-bdf5f2d0-8273-4e14-98f2-9a06134e21a6 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9d40e54481461cba53fedb9a6abdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed2295a58f8451993a57ce0a6f9ba29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:37.472725 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-bdf5f2d0-8273-4e14-98f2-9a06134e21a6 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] 10.222.0.60 "GET /compute/v2.1/servers/d0c5547a-1340-4d19-a0f9-3e1eb9fd1932" status: 200 len: 1216 microversion: 2.1 time: 0.545820 Sep 14 08:58:37.473746 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1154/2267] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:58:36 2022] GET /compute/v2.1/servers/d0c5547a-1340-4d19-a0f9-3e1eb9fd1932 => generated 1216 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:58:37.491584 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1dc5c36a-e76c-48f6-97f0-634366201d71 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:37.493977 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-10e10a90-0bb7-42c9-b3cc-298cff616efc req-705bc465-3104-45e5-bf9e-ebd544ccd18c service nova] Creating event network-vif-plugged:78cf3403-7929-473d-b37b-6bb3deefa0cd for instance 5629527b-12f8-4467-85a7-976d17dd267a on n-h2-836830-18 Sep 14 08:58:37.501604 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-1dc5c36a-e76c-48f6-97f0-634366201d71 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] [instance: 26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:37.515310 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-10e10a90-0bb7-42c9-b3cc-298cff616efc req-705bc465-3104-45e5-bf9e-ebd544ccd18c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150809 Sep 14 08:58:37.519122 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1114/2268] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:58:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:58:37.530079 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1dc5c36a-e76c-48f6-97f0-634366201d71 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:37.530918 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1dc5c36a-e76c-48f6-97f0-634366201d71 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:37.534036 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1dc5c36a-e76c-48f6-97f0-634366201d71 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:37.537198 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1dc5c36a-e76c-48f6-97f0-634366201d71 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:37.540523 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1dc5c36a-e76c-48f6-97f0-634366201d71 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:37.542613 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1dc5c36a-e76c-48f6-97f0-634366201d71 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:37.559246 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-5a72256e-9f53-44cf-a67a-a17649641e42 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:37.570140 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-5a72256e-9f53-44cf-a67a-a17649641e42 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: affb61a7-7e36-4424-bf48-a5a6bd64ae29] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:37.605166 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5a72256e-9f53-44cf-a67a-a17649641e42 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:37.607751 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5a72256e-9f53-44cf-a67a-a17649641e42 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:37.608314 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5a72256e-9f53-44cf-a67a-a17649641e42 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:37.609419 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5a72256e-9f53-44cf-a67a-a17649641e42 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:37.609967 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5a72256e-9f53-44cf-a67a-a17649641e42 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:37.610592 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5a72256e-9f53-44cf-a67a-a17649641e42 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:38.441990 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-1dc5c36a-e76c-48f6-97f0-634366201d71 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:38.489235 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-1dc5c36a-e76c-48f6-97f0-634366201d71 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:38.491283 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-1dc5c36a-e76c-48f6-97f0-634366201d71 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:38.498380 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-1dc5c36a-e76c-48f6-97f0-634366201d71 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] 10.222.0.60 "GET /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0" status: 200 len: 1880 microversion: 2.32 time: 1.021530 Sep 14 08:58:38.500432 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1155/2269] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:58:37 2022] GET /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0 => generated 1880 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:58:38.529405 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-5a72256e-9f53-44cf-a67a-a17649641e42 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:38.541650 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-5a72256e-9f53-44cf-a67a-a17649641e42 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/affb61a7-7e36-4424-bf48-a5a6bd64ae29" status: 200 len: 1308 microversion: 2.1 time: 1.019790 Sep 14 08:58:38.569963 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1115/2270] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:58:37 2022] GET /compute/v2.1/servers/affb61a7-7e36-4424-bf48-a5a6bd64ae29 => generated 1308 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:58:38.574983 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-24f5fe8c-a6f1-4364-9e5c-e0b929771a06 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:38.588432 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-24f5fe8c-a6f1-4364-9e5c-e0b929771a06 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] [instance: 5629527b-12f8-4467-85a7-976d17dd267a] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:38.607726 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-24f5fe8c-a6f1-4364-9e5c-e0b929771a06 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:38.608974 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-24f5fe8c-a6f1-4364-9e5c-e0b929771a06 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:38.610136 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-24f5fe8c-a6f1-4364-9e5c-e0b929771a06 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:38.614464 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-24f5fe8c-a6f1-4364-9e5c-e0b929771a06 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:38.615312 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-24f5fe8c-a6f1-4364-9e5c-e0b929771a06 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:38.616075 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-24f5fe8c-a6f1-4364-9e5c-e0b929771a06 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:38.678647 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-eaa20caa-9c7a-410d-aecb-47c1657e51fc req-3be6c2d7-7d37-432f-b408-e4271a12a883 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "affb61a7-7e36-4424-bf48-a5a6bd64ae29", "tag": "18231b89-f9a1-4386-8a2f-242a6bc12bd6"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:58:38.703413 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-eaa20caa-9c7a-410d-aecb-47c1657e51fc req-3be6c2d7-7d37-432f-b408-e4271a12a883 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:38.704443 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-eaa20caa-9c7a-410d-aecb-47c1657e51fc req-3be6c2d7-7d37-432f-b408-e4271a12a883 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:38.705844 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-eaa20caa-9c7a-410d-aecb-47c1657e51fc req-3be6c2d7-7d37-432f-b408-e4271a12a883 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:38.740546 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-eaa20caa-9c7a-410d-aecb-47c1657e51fc req-3be6c2d7-7d37-432f-b408-e4271a12a883 service nova] Creating event network-changed:18231b89-f9a1-4386-8a2f-242a6bc12bd6 for instance affb61a7-7e36-4424-bf48-a5a6bd64ae29 on n-h1-836830-18 Sep 14 08:58:38.756214 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-eaa20caa-9c7a-410d-aecb-47c1657e51fc req-3be6c2d7-7d37-432f-b408-e4271a12a883 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.254216 Sep 14 08:58:38.760064 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1156/2271] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:58:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:58:38.771946 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-f5b21ccd-a17a-4400-b11a-2ec21de29b30 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:38.779533 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-f5b21ccd-a17a-4400-b11a-2ec21de29b30 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: d0c5547a-1340-4d19-a0f9-3e1eb9fd1932] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:38.821593 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f5b21ccd-a17a-4400-b11a-2ec21de29b30 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:38.823372 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f5b21ccd-a17a-4400-b11a-2ec21de29b30 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:38.826347 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f5b21ccd-a17a-4400-b11a-2ec21de29b30 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:38.827327 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f5b21ccd-a17a-4400-b11a-2ec21de29b30 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:38.831252 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f5b21ccd-a17a-4400-b11a-2ec21de29b30 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:38.833546 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f5b21ccd-a17a-4400-b11a-2ec21de29b30 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:38.906967 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-24f5fe8c-a6f1-4364-9e5c-e0b929771a06 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f584701398b64fab808e3cbcc4259a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb6af957c8f45e5a0996c0e4b1f456a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:38.920653 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-24f5fe8c-a6f1-4364-9e5c-e0b929771a06 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] 10.222.0.60 "GET /compute/v2.1/servers/5629527b-12f8-4467-85a7-976d17dd267a" status: 200 len: 1322 microversion: 2.1 time: 0.349471 Sep 14 08:58:38.923577 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1116/2272] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:58:38 2022] GET /compute/v2.1/servers/5629527b-12f8-4467-85a7-976d17dd267a => generated 1322 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:58:39.030684 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-f5b21ccd-a17a-4400-b11a-2ec21de29b30 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9d40e54481461cba53fedb9a6abdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed2295a58f8451993a57ce0a6f9ba29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:39.058439 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-f5b21ccd-a17a-4400-b11a-2ec21de29b30 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] 10.222.0.60 "GET /compute/v2.1/servers/d0c5547a-1340-4d19-a0f9-3e1eb9fd1932" status: 200 len: 1220 microversion: 2.1 time: 0.291839 Sep 14 08:58:39.060214 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1157/2273] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:58:38 2022] GET /compute/v2.1/servers/d0c5547a-1340-4d19-a0f9-3e1eb9fd1932 => generated 1220 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:58:39.531440 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-5c8d9558-5b6e-49e5-b041-8ce193215e2c tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:39.532395 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-5c8d9558-5b6e-49e5-b041-8ce193215e2c tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] [instance: 26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:39.546276 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5c8d9558-5b6e-49e5-b041-8ce193215e2c tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:39.549019 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5c8d9558-5b6e-49e5-b041-8ce193215e2c tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:39.551559 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5c8d9558-5b6e-49e5-b041-8ce193215e2c tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:39.588378 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5c8d9558-5b6e-49e5-b041-8ce193215e2c tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:39.590482 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5c8d9558-5b6e-49e5-b041-8ce193215e2c tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:39.593317 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5c8d9558-5b6e-49e5-b041-8ce193215e2c tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:39.605276 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-de7da220-c199-43da-a879-12cb49115723 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:39.608374 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-de7da220-c199-43da-a879-12cb49115723 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: affb61a7-7e36-4424-bf48-a5a6bd64ae29] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:39.639806 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-de7da220-c199-43da-a879-12cb49115723 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:39.640776 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-de7da220-c199-43da-a879-12cb49115723 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:39.643811 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-de7da220-c199-43da-a879-12cb49115723 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:39.648643 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-de7da220-c199-43da-a879-12cb49115723 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:39.651721 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-de7da220-c199-43da-a879-12cb49115723 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:39.652543 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-de7da220-c199-43da-a879-12cb49115723 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:40.439072 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-de7da220-c199-43da-a879-12cb49115723 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:40.454320 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-de7da220-c199-43da-a879-12cb49115723 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/affb61a7-7e36-4424-bf48-a5a6bd64ae29" status: 200 len: 1308 microversion: 2.1 time: 0.873516 Sep 14 08:58:40.462837 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1158/2274] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:58:39 2022] GET /compute/v2.1/servers/affb61a7-7e36-4424-bf48-a5a6bd64ae29 => generated 1308 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:58:40.474367 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a27f342f-858a-4dd3-aa5b-cf21334f34a1 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:40.475345 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-a27f342f-858a-4dd3-aa5b-cf21334f34a1 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] [instance: 5629527b-12f8-4467-85a7-976d17dd267a] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:40.491673 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a27f342f-858a-4dd3-aa5b-cf21334f34a1 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:40.494627 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a27f342f-858a-4dd3-aa5b-cf21334f34a1 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:40.495405 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a27f342f-858a-4dd3-aa5b-cf21334f34a1 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:40.496402 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a27f342f-858a-4dd3-aa5b-cf21334f34a1 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:40.501272 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a27f342f-858a-4dd3-aa5b-cf21334f34a1 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:40.502131 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a27f342f-858a-4dd3-aa5b-cf21334f34a1 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:40.951591 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-5c8d9558-5b6e-49e5-b041-8ce193215e2c tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:40.977087 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-5c8d9558-5b6e-49e5-b041-8ce193215e2c tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:40.984089 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-5c8d9558-5b6e-49e5-b041-8ce193215e2c tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:40.988357 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-5c8d9558-5b6e-49e5-b041-8ce193215e2c tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] 10.222.0.60 "GET /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0" status: 200 len: 1880 microversion: 2.32 time: 1.461862 Sep 14 08:58:40.992997 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1117/2275] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:58:39 2022] GET /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0 => generated 1880 bytes in 1467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:58:41.017136 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a15d763d-20db-4e8f-9baf-f857f64674f8 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:41.017946 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-a15d763d-20db-4e8f-9baf-f857f64674f8 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: d0c5547a-1340-4d19-a0f9-3e1eb9fd1932] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:41.053552 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a15d763d-20db-4e8f-9baf-f857f64674f8 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:41.055840 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a15d763d-20db-4e8f-9baf-f857f64674f8 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:41.057658 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a15d763d-20db-4e8f-9baf-f857f64674f8 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:41.059641 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a15d763d-20db-4e8f-9baf-f857f64674f8 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:41.061440 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a15d763d-20db-4e8f-9baf-f857f64674f8 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:41.063185 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a15d763d-20db-4e8f-9baf-f857f64674f8 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:41.340851 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-a15d763d-20db-4e8f-9baf-f857f64674f8 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9d40e54481461cba53fedb9a6abdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed2295a58f8451993a57ce0a6f9ba29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:41.359319 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a15d763d-20db-4e8f-9baf-f857f64674f8 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] 10.222.0.60 "GET /compute/v2.1/servers/d0c5547a-1340-4d19-a0f9-3e1eb9fd1932" status: 200 len: 1276 microversion: 2.1 time: 0.364851 Sep 14 08:58:41.360412 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1118/2276] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:58:40 2022] GET /compute/v2.1/servers/d0c5547a-1340-4d19-a0f9-3e1eb9fd1932 => generated 1276 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:58:41.366138 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-04942db9-706d-4e50-9696-bf19a2e7a8d6 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-545044165", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "networks": [{"uuid": "353cb44b-6e07-4050-8545-17904b39cfe9"}], "security_groups": [{"name": "tempest-securitygroup--502117084"}], "key_name": "tempest-keypair-1474730964", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:58:41.405080 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-a27f342f-858a-4dd3-aa5b-cf21334f34a1 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f584701398b64fab808e3cbcc4259a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb6af957c8f45e5a0996c0e4b1f456a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:41.416757 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-a27f342f-858a-4dd3-aa5b-cf21334f34a1 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] 10.222.0.60 "GET /compute/v2.1/servers/5629527b-12f8-4467-85a7-976d17dd267a" status: 200 len: 1471 microversion: 2.1 time: 0.952485 Sep 14 08:58:41.426258 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1159/2277] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:58:40 2022] GET /compute/v2.1/servers/5629527b-12f8-4467-85a7-976d17dd267a => generated 1471 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:58:41.451240 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-7055db79-89b0-4eaa-97c4-a1eee57bd7d9 tempest-ServersAdminNegativeTestJSON-1651638548 tempest-ServersAdminNegativeTestJSON-1651638548-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:58:41.452072 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-7055db79-89b0-4eaa-97c4-a1eee57bd7d9 tempest-ServersAdminNegativeTestJSON-1651638548 tempest-ServersAdminNegativeTestJSON-1651638548-project-admin] [instance: 5629527b-12f8-4467-85a7-976d17dd267a] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:41.477596 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7055db79-89b0-4eaa-97c4-a1eee57bd7d9 tempest-ServersAdminNegativeTestJSON-1651638548 tempest-ServersAdminNegativeTestJSON-1651638548-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:41.478374 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7055db79-89b0-4eaa-97c4-a1eee57bd7d9 tempest-ServersAdminNegativeTestJSON-1651638548 tempest-ServersAdminNegativeTestJSON-1651638548-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:41.479013 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7055db79-89b0-4eaa-97c4-a1eee57bd7d9 tempest-ServersAdminNegativeTestJSON-1651638548 tempest-ServersAdminNegativeTestJSON-1651638548-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:41.480501 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7055db79-89b0-4eaa-97c4-a1eee57bd7d9 tempest-ServersAdminNegativeTestJSON-1651638548 tempest-ServersAdminNegativeTestJSON-1651638548-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:41.481159 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7055db79-89b0-4eaa-97c4-a1eee57bd7d9 tempest-ServersAdminNegativeTestJSON-1651638548 tempest-ServersAdminNegativeTestJSON-1651638548-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:41.481758 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7055db79-89b0-4eaa-97c4-a1eee57bd7d9 tempest-ServersAdminNegativeTestJSON-1651638548 tempest-ServersAdminNegativeTestJSON-1651638548-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:41.579726 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.objects.instance [None req-7055db79-89b0-4eaa-97c4-a1eee57bd7d9 tempest-ServersAdminNegativeTestJSON-1651638548 tempest-ServersAdminNegativeTestJSON-1651638548-project-admin] Lazy-loading 'flavor' on Instance uuid 5629527b-12f8-4467-85a7-976d17dd267a {{(pid=128758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 08:58:41.643772 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.network.neutron [None req-04942db9-706d-4e50-9696-bf19a2e7a8d6 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] validate_networks() for [('353cb44b-6e07-4050-8545-17904b39cfe9', None, None, None, None, None)] {{(pid=128759) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 08:58:41.799216 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-7055db79-89b0-4eaa-97c4-a1eee57bd7d9 tempest-ServersAdminNegativeTestJSON-1651638548 tempest-ServersAdminNegativeTestJSON-1651638548-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/5629527b-12f8-4467-85a7-976d17dd267a/action" status: 202 len: 0 microversion: 2.1 time: 0.351179 Sep 14 08:58:41.803352 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1160/2278] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 08:58:41 2022] POST /compute/v2.1/servers/5629527b-12f8-4467-85a7-976d17dd267a/action => generated 0 bytes in 358 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 14 08:58:41.834471 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-10b794da-f281-4d48-a688-89b6ee12de85 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:41.836109 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-10b794da-f281-4d48-a688-89b6ee12de85 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: affb61a7-7e36-4424-bf48-a5a6bd64ae29] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:41.859570 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-10b794da-f281-4d48-a688-89b6ee12de85 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:41.860076 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-10b794da-f281-4d48-a688-89b6ee12de85 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:41.868964 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-10b794da-f281-4d48-a688-89b6ee12de85 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:41.869751 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-10b794da-f281-4d48-a688-89b6ee12de85 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:41.870226 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-10b794da-f281-4d48-a688-89b6ee12de85 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:41.870656 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-10b794da-f281-4d48-a688-89b6ee12de85 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:42.593619 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-10b794da-f281-4d48-a688-89b6ee12de85 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:42.604516 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-10b794da-f281-4d48-a688-89b6ee12de85 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/affb61a7-7e36-4424-bf48-a5a6bd64ae29" status: 200 len: 1308 microversion: 2.1 time: 0.799541 Sep 14 08:58:42.611819 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1161/2279] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:58:41 2022] GET /compute/v2.1/servers/affb61a7-7e36-4424-bf48-a5a6bd64ae29 => generated 1308 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:58:42.629226 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d155bc52-f7d6-411c-ac48-32662f28087a tempest-ServersAdminNegativeTestJSON-1651638548 tempest-ServersAdminNegativeTestJSON-1651638548-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:42.636608 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-d155bc52-f7d6-411c-ac48-32662f28087a tempest-ServersAdminNegativeTestJSON-1651638548 tempest-ServersAdminNegativeTestJSON-1651638548-project-admin] [instance: 5629527b-12f8-4467-85a7-976d17dd267a] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:42.656554 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d155bc52-f7d6-411c-ac48-32662f28087a tempest-ServersAdminNegativeTestJSON-1651638548 tempest-ServersAdminNegativeTestJSON-1651638548-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:42.657321 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d155bc52-f7d6-411c-ac48-32662f28087a tempest-ServersAdminNegativeTestJSON-1651638548 tempest-ServersAdminNegativeTestJSON-1651638548-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:42.658664 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d155bc52-f7d6-411c-ac48-32662f28087a tempest-ServersAdminNegativeTestJSON-1651638548 tempest-ServersAdminNegativeTestJSON-1651638548-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:42.659584 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d155bc52-f7d6-411c-ac48-32662f28087a tempest-ServersAdminNegativeTestJSON-1651638548 tempest-ServersAdminNegativeTestJSON-1651638548-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:42.660199 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d155bc52-f7d6-411c-ac48-32662f28087a tempest-ServersAdminNegativeTestJSON-1651638548 tempest-ServersAdminNegativeTestJSON-1651638548-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:42.660776 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d155bc52-f7d6-411c-ac48-32662f28087a tempest-ServersAdminNegativeTestJSON-1651638548 tempest-ServersAdminNegativeTestJSON-1651638548-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:42.666881 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:58:43.438154 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-04942db9-706d-4e50-9696-bf19a2e7a8d6 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Flavor limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 08:58:43.438617 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-04942db9-706d-4e50-9696-bf19a2e7a8d6 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Image limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 08:58:43.439068 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-04942db9-706d-4e50-9696-bf19a2e7a8d6 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Flavor pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 08:58:43.439482 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-04942db9-706d-4e50-9696-bf19a2e7a8d6 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Image pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 08:58:43.439896 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-04942db9-706d-4e50-9696-bf19a2e7a8d6 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 08:58:43.468740 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-d155bc52-f7d6-411c-ac48-32662f28087a tempest-ServersAdminNegativeTestJSON-1651638548 tempest-ServersAdminNegativeTestJSON-1651638548-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/5629527b-12f8-4467-85a7-976d17dd267a" status: 200 len: 1615 microversion: 2.1 time: 0.855623 Sep 14 08:58:43.475285 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1162/2280] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:58:42 2022] GET /compute/v2.1/servers/5629527b-12f8-4467-85a7-976d17dd267a => generated 1615 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:58:43.484632 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-2021dfd9-0607-44a2-a80d-b6be20670882 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:43.490711 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-04942db9-706d-4e50-9696-bf19a2e7a8d6 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:43.491163 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-2021dfd9-0607-44a2-a80d-b6be20670882 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] [instance: 26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:43.491288 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-04942db9-706d-4e50-9696-bf19a2e7a8d6 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:43.491722 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-04942db9-706d-4e50-9696-bf19a2e7a8d6 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:43.502353 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-04942db9-706d-4e50-9696-bf19a2e7a8d6 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:43.502604 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-04942db9-706d-4e50-9696-bf19a2e7a8d6 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:43.503152 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-04942db9-706d-4e50-9696-bf19a2e7a8d6 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:43.509043 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2021dfd9-0607-44a2-a80d-b6be20670882 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:43.509972 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2021dfd9-0607-44a2-a80d-b6be20670882 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:43.511611 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2021dfd9-0607-44a2-a80d-b6be20670882 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:43.513156 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2021dfd9-0607-44a2-a80d-b6be20670882 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:43.514334 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2021dfd9-0607-44a2-a80d-b6be20670882 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:43.516236 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2021dfd9-0607-44a2-a80d-b6be20670882 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:43.572323 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-04942db9-706d-4e50-9696-bf19a2e7a8d6 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Getting quotas for project de82b83dadd541dbb4a939f2fc04a163. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 08:58:43.599979 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-04942db9-706d-4e50-9696-bf19a2e7a8d6 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Getting quotas for user 93ab7166e40e4a908eefbfb03b3b8804 and project de82b83dadd541dbb4a939f2fc04a163. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 08:58:43.639739 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-04942db9-706d-4e50-9696-bf19a2e7a8d6 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Going to run 1 instances... {{(pid=128759) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 08:58:43.653731 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-04942db9-706d-4e50-9696-bf19a2e7a8d6 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] [instance: 885dfd01-8bac-4691-ad0b-f2218e306f2e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128759) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 08:58:43.759193 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-04942db9-706d-4e50-9696-bf19a2e7a8d6 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.394583 Sep 14 08:58:43.768879 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1119/2281] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 08:58:41 2022] POST /compute/v2.1/servers => generated 405 bytes in 2406 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 08:58:43.781689 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a95ebe40-6dca-4bb7-9778-33bbc378fabb tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:43.785181 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-a95ebe40-6dca-4bb7-9778-33bbc378fabb tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: d0c5547a-1340-4d19-a0f9-3e1eb9fd1932] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:43.804313 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a95ebe40-6dca-4bb7-9778-33bbc378fabb tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:43.805232 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a95ebe40-6dca-4bb7-9778-33bbc378fabb tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:43.805980 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a95ebe40-6dca-4bb7-9778-33bbc378fabb tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:43.811026 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a95ebe40-6dca-4bb7-9778-33bbc378fabb tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:43.811670 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a95ebe40-6dca-4bb7-9778-33bbc378fabb tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:43.812331 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a95ebe40-6dca-4bb7-9778-33bbc378fabb tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:44.173736 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-2021dfd9-0607-44a2-a80d-b6be20670882 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:44.186146 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-2021dfd9-0607-44a2-a80d-b6be20670882 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:44.187867 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-2021dfd9-0607-44a2-a80d-b6be20670882 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:44.189300 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-2021dfd9-0607-44a2-a80d-b6be20670882 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] 10.222.0.60 "GET /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0" status: 200 len: 1880 microversion: 2.32 time: 0.712764 Sep 14 08:58:44.190333 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1163/2282] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:58:43 2022] GET /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0 => generated 1880 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:58:44.195988 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-2024a921-d6db-443a-9d8a-9b4d9a93c26c tempest-ServersAdminNegativeTestJSON-1651638548 tempest-ServersAdminNegativeTestJSON-1651638548-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:58:44.196772 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-2024a921-d6db-443a-9d8a-9b4d9a93c26c tempest-ServersAdminNegativeTestJSON-1651638548 tempest-ServersAdminNegativeTestJSON-1651638548-project-admin] [instance: 5629527b-12f8-4467-85a7-976d17dd267a] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:44.205719 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2024a921-d6db-443a-9d8a-9b4d9a93c26c tempest-ServersAdminNegativeTestJSON-1651638548 tempest-ServersAdminNegativeTestJSON-1651638548-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:44.206622 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2024a921-d6db-443a-9d8a-9b4d9a93c26c tempest-ServersAdminNegativeTestJSON-1651638548 tempest-ServersAdminNegativeTestJSON-1651638548-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:44.207924 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2024a921-d6db-443a-9d8a-9b4d9a93c26c tempest-ServersAdminNegativeTestJSON-1651638548 tempest-ServersAdminNegativeTestJSON-1651638548-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:44.208853 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2024a921-d6db-443a-9d8a-9b4d9a93c26c tempest-ServersAdminNegativeTestJSON-1651638548 tempest-ServersAdminNegativeTestJSON-1651638548-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:44.209519 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2024a921-d6db-443a-9d8a-9b4d9a93c26c tempest-ServersAdminNegativeTestJSON-1651638548 tempest-ServersAdminNegativeTestJSON-1651638548-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:44.210103 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2024a921-d6db-443a-9d8a-9b4d9a93c26c tempest-ServersAdminNegativeTestJSON-1651638548 tempest-ServersAdminNegativeTestJSON-1651638548-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:44.215916 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-a95ebe40-6dca-4bb7-9778-33bbc378fabb tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9d40e54481461cba53fedb9a6abdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed2295a58f8451993a57ce0a6f9ba29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:44.231691 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a95ebe40-6dca-4bb7-9778-33bbc378fabb tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] 10.222.0.60 "GET /compute/v2.1/servers/d0c5547a-1340-4d19-a0f9-3e1eb9fd1932" status: 200 len: 1316 microversion: 2.1 time: 0.458192 Sep 14 08:58:44.234760 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1120/2283] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:58:43 2022] GET /compute/v2.1/servers/d0c5547a-1340-4d19-a0f9-3e1eb9fd1932 => generated 1316 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:58:44.253185 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-edd59505-a109-4562-a628-2fe57d9d63ef tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:44.254068 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-edd59505-a109-4562-a628-2fe57d9d63ef tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: affb61a7-7e36-4424-bf48-a5a6bd64ae29] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:44.267588 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-edd59505-a109-4562-a628-2fe57d9d63ef tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:44.268632 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-edd59505-a109-4562-a628-2fe57d9d63ef tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:44.270974 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-edd59505-a109-4562-a628-2fe57d9d63ef tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:44.273441 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-edd59505-a109-4562-a628-2fe57d9d63ef tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:44.275155 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-edd59505-a109-4562-a628-2fe57d9d63ef tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:44.277075 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-edd59505-a109-4562-a628-2fe57d9d63ef tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:44.335411 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-2024a921-d6db-443a-9d8a-9b4d9a93c26c tempest-ServersAdminNegativeTestJSON-1651638548 tempest-ServersAdminNegativeTestJSON-1651638548-project-admin] HTTP exception thrown: Cannot 'migrate' instance 5629527b-12f8-4467-85a7-976d17dd267a while it is in vm_state suspended Sep 14 08:58:44.338624 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-2024a921-d6db-443a-9d8a-9b4d9a93c26c tempest-ServersAdminNegativeTestJSON-1651638548 tempest-ServersAdminNegativeTestJSON-1651638548-project-admin] Request method failure captured: Sep 14 08:58:44.338624 n-d-836830-18 devstack@n-api.service[128758]: request: POST /compute/v2.1/servers/5629527b-12f8-4467-85a7-976d17dd267a/action HTTP/1.1 Sep 14 08:58:44.338624 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 08:58:44.338624 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 08:58:44.338624 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 08:58:44.338624 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 15 Sep 14 08:58:44.338624 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 08:58:44.338624 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 08:58:44.338624 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 08:58:44.338624 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 08:58:44.338624 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZeUXkblrqZG_txoKC1lB3zxbqGbA6szxL6_XfeiOajAmjPSNZymadVQAUD3pu5o_NQuJV_MUZNJfaPCOdZKebvsjEQpJjjfC5RKFMi0emoOYUddxH96XEj7zoPHpxfN4xEQlxfmmZ2dI9AqKnSAYZedf2cMO26C0sl09TSJp3vIgI4 Sep 14 08:58:44.338624 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 08:58:44.338624 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 08:58:44.338624 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 08:58:44.338624 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 08:58:44.338624 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 08:58:44.338624 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 08:58:44.338624 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 21b086a22d664c45a9d7801c383e44e8 Sep 14 08:58:44.338624 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1651638548 Sep 14 08:58:44.338624 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member,admin Sep 14 08:58:44.338624 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member,admin Sep 14 08:58:44.338624 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/21b086a22d664c45a9d7801c383e44e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_21b086a22d664c45a9d7801c383e44e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/21b086a22d664c45a9d7801c383e44e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/21b086a22d664c45a9d7801c383e44e8"}]}] Sep 14 08:58:44.338624 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1651638548 Sep 14 08:58:44.338624 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 21b086a22d664c45a9d7801c383e44e8 Sep 14 08:58:44.338624 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1651638548 Sep 14 08:58:44.338624 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-ServersAdminNegativeTestJSON-1651638548-project-admin Sep 14 08:58:44.338624 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 08:58:44.338624 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 08:58:44.338624 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 68408bef8e15486abfb940c9aef80168 Sep 14 08:58:44.338624 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1651638548-project-admin Sep 14 08:58:44.338624 n-d-836830-18 devstack@n-api.service[128758]: Sep 14 08:58:44.338624 n-d-836830-18 devstack@n-api.service[128758]: {"migrate": {}} Sep 14 08:58:44.338624 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 08:58:44.338624 n-d-836830-18 devstack@n-api.service[128758]: exception: Cannot 'migrate' instance 5629527b-12f8-4467-85a7-976d17dd267a while it is in vm_state suspended Sep 14 08:58:44.338624 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': '5629527b-12f8-4467-85a7-976d17dd267a', 'body': {'migrate': {}}} Sep 14 08:58:44.338624 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:58:44.338624 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:58:44.338624 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Sep 14 08:58:44.338624 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Sep 14 08:58:44.338624 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 14 08:58:44.338624 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 14 08:58:44.338624 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 14 08:58:44.338624 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 14 08:58:44.338624 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 14 08:58:44.338624 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 14 08:58:44.338624 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 14 08:58:44.338624 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 14 08:58:44.338624 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 14 08:58:44.338624 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 14 08:58:44.338624 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5629527b-12f8-4467-85a7-976d17dd267a in vm_state suspended. Cannot resize while the instance is in this state. Sep 14 08:58:44.338624 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:58:44.338624 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:58:44.338624 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:58:44.338624 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:58:44.338624 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:58:44.338624 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:58:44.338624 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:58:44.338624 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:58:44.338624 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:58:44.338624 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:58:44.338624 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 08:58:44.338624 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 08:58:44.338624 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Sep 14 08:58:44.343574 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 14 08:58:44.343574 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 14 08:58:44.343574 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 14 08:58:44.343574 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance 5629527b-12f8-4467-85a7-976d17dd267a while it is in vm_state suspended Sep 14 08:58:44.343574 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:58:44.343574 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:58:44.343574 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:58:44.343574 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:58:44.343574 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:58:44.343574 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:58:44.343574 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:58:44.343574 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:58:44.343574 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance 5629527b-12f8-4467-85a7-976d17dd267a while it is in vm_state suspended Sep 14 08:58:44.343574 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:58:44.347358 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-2024a921-d6db-443a-9d8a-9b4d9a93c26c tempest-ServersAdminNegativeTestJSON-1651638548 tempest-ServersAdminNegativeTestJSON-1651638548-project-admin] Returning 409 to user: Cannot 'migrate' instance 5629527b-12f8-4467-85a7-976d17dd267a while it is in vm_state suspended {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:58:44.348492 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-2024a921-d6db-443a-9d8a-9b4d9a93c26c tempest-ServersAdminNegativeTestJSON-1651638548 tempest-ServersAdminNegativeTestJSON-1651638548-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/5629527b-12f8-4467-85a7-976d17dd267a/action" status: 409 len: 148 microversion: 2.1 time: 0.156972 Sep 14 08:58:44.349569 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1164/2284] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 08:58:44 2022] POST /compute/v2.1/servers/5629527b-12f8-4467-85a7-976d17dd267a/action => generated 148 bytes in 158 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 14 08:58:44.358590 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a94ccdb0-f230-479b-a4ae-c02e7e3dbb87 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:44.359628 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-a94ccdb0-f230-479b-a4ae-c02e7e3dbb87 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] [instance: 0b54f1c2-0d9c-4396-8c79-1e43b612b2ba] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:44.366401 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a94ccdb0-f230-479b-a4ae-c02e7e3dbb87 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:44.367363 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a94ccdb0-f230-479b-a4ae-c02e7e3dbb87 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:44.367988 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a94ccdb0-f230-479b-a4ae-c02e7e3dbb87 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:44.368999 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a94ccdb0-f230-479b-a4ae-c02e7e3dbb87 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:44.369608 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a94ccdb0-f230-479b-a4ae-c02e7e3dbb87 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:44.370176 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a94ccdb0-f230-479b-a4ae-c02e7e3dbb87 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:44.397016 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-a94ccdb0-f230-479b-a4ae-c02e7e3dbb87 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] HTTP exception thrown: Instance 0b54f1c2-0d9c-4396-8c79-1e43b612b2ba could not be found. Sep 14 08:58:44.400981 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a94ccdb0-f230-479b-a4ae-c02e7e3dbb87 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Request method failure captured: Sep 14 08:58:44.400981 n-d-836830-18 devstack@n-api.service[128758]: request: DELETE /compute/v2.1/servers/0b54f1c2-0d9c-4396-8c79-1e43b612b2ba HTTP/1.1 Sep 14 08:58:44.400981 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 08:58:44.400981 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 08:58:44.400981 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 08:58:44.400981 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 08:58:44.400981 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 08:58:44.400981 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 08:58:44.400981 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 08:58:44.400981 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 08:58:44.400981 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZa33UCZGQPGGFdnEKy40Bf9yKumjdqBjudRlsEN8P4xQwLQqU7t11praMTuRTYjXF9W5xpncATu9Asflgdxa1jHHEk90rPM23QPYiIhIrdEtxdPdlSJ3WSHd59VxlPFgfCP3TDOFWt0Y7zLGdkKDGRppghDHAK0BfaQiaCZwfTNzFE Sep 14 08:58:44.400981 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 08:58:44.400981 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 08:58:44.400981 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 08:58:44.400981 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 08:58:44.400981 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 08:58:44.400981 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 08:58:44.400981 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: e77c85f074ae4b8cb5a1457a5183197b Sep 14 08:58:44.400981 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1087944038 Sep 14 08:58:44.400981 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 08:58:44.400981 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 08:58:44.400981 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e77c85f074ae4b8cb5a1457a5183197b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e77c85f074ae4b8cb5a1457a5183197b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e77c85f074ae4b8cb5a1457a5183197b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e77c85f074ae4b8cb5a1457a5183197b"}]}] Sep 14 08:58:44.400981 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1087944038 Sep 14 08:58:44.400981 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: e77c85f074ae4b8cb5a1457a5183197b Sep 14 08:58:44.400981 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1087944038 Sep 14 08:58:44.400981 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-AttachSCSIVolumeTestJSON-1087944038-project Sep 14 08:58:44.400981 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 08:58:44.400981 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 08:58:44.400981 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 72e1780ebcf1413fa4f7a9760b761c78 Sep 14 08:58:44.400981 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1087944038-project Sep 14 08:58:44.400981 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 08:58:44.400981 n-d-836830-18 devstack@n-api.service[128758]: exception: Instance 0b54f1c2-0d9c-4396-8c79-1e43b612b2ba could not be found. Sep 14 08:58:44.400981 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': '0b54f1c2-0d9c-4396-8c79-1e43b612b2ba'} Sep 14 08:58:44.400981 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:58:44.400981 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:58:44.400981 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 08:58:44.400981 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 08:58:44.400981 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 08:58:44.400981 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 08:58:44.400981 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 08:58:44.400981 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 08:58:44.400981 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 08:58:44.400981 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 08:58:44.400981 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b54f1c2-0d9c-4396-8c79-1e43b612b2ba could not be found. Sep 14 08:58:44.400981 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:58:44.400981 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:58:44.400981 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:58:44.400981 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:58:44.400981 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:58:44.400981 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:58:44.400981 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:58:44.400981 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:58:44.400981 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:58:44.400981 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:58:44.400981 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 08:58:44.400981 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 08:58:44.400981 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 08:58:44.400981 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 08:58:44.400981 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 08:58:44.400981 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 08:58:44.400981 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 08:58:44.400981 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 08:58:44.405674 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b54f1c2-0d9c-4396-8c79-1e43b612b2ba could not be found. Sep 14 08:58:44.405674 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:58:44.405674 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:58:44.405674 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:58:44.405674 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:58:44.405674 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:58:44.405674 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:58:44.405674 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:58:44.405674 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:58:44.405674 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b54f1c2-0d9c-4396-8c79-1e43b612b2ba could not be found. Sep 14 08:58:44.405674 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:58:44.408890 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a94ccdb0-f230-479b-a4ae-c02e7e3dbb87 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Returning 404 to user: Instance 0b54f1c2-0d9c-4396-8c79-1e43b612b2ba could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:58:44.410727 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-a94ccdb0-f230-479b-a4ae-c02e7e3dbb87 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] 10.222.0.60 "DELETE /compute/v2.1/servers/0b54f1c2-0d9c-4396-8c79-1e43b612b2ba" status: 404 len: 111 microversion: 2.1 time: 0.060001 Sep 14 08:58:44.412417 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1165/2285] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 08:58:44 2022] DELETE /compute/v2.1/servers/0b54f1c2-0d9c-4396-8c79-1e43b612b2ba => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 08:58:44.421721 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-9a1656a3-48c1-49eb-bd7b-c16a1a1b4cdd tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:44.423658 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-9a1656a3-48c1-49eb-bd7b-c16a1a1b4cdd tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] [instance: 885dfd01-8bac-4691-ad0b-f2218e306f2e] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:44.553521 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-9a1656a3-48c1-49eb-bd7b-c16a1a1b4cdd tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ab7166e40e4a908eefbfb03b3b8804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de82b83dadd541dbb4a939f2fc04a163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:44.564274 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-9a1656a3-48c1-49eb-bd7b-c16a1a1b4cdd tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] 10.222.0.60 "GET /compute/v2.1/servers/885dfd01-8bac-4691-ad0b-f2218e306f2e" status: 200 len: 1241 microversion: 2.1 time: 0.150519 Sep 14 08:58:44.568102 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1166/2286] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:58:44 2022] GET /compute/v2.1/servers/885dfd01-8bac-4691-ad0b-f2218e306f2e => generated 1241 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:58:44.702788 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-369ccfb3-09d0-4edc-b8cf-10c238056a3a req-7d094ccb-c8af-4269-9b0d-27ebc5c719ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0c5547a-1340-4d19-a0f9-3e1eb9fd1932", "tag": "2e224a14-f300-4cfe-a4c3-34a512adfc08"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:58:44.717940 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-edd59505-a109-4562-a628-2fe57d9d63ef tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:44.718695 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:58:44.722258 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-369ccfb3-09d0-4edc-b8cf-10c238056a3a req-7d094ccb-c8af-4269-9b0d-27ebc5c719ed service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:44.723315 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-369ccfb3-09d0-4edc-b8cf-10c238056a3a req-7d094ccb-c8af-4269-9b0d-27ebc5c719ed service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:44.723868 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-369ccfb3-09d0-4edc-b8cf-10c238056a3a req-7d094ccb-c8af-4269-9b0d-27ebc5c719ed service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:44.730160 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-edd59505-a109-4562-a628-2fe57d9d63ef tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/affb61a7-7e36-4424-bf48-a5a6bd64ae29" status: 200 len: 1308 microversion: 2.1 time: 0.493294 Sep 14 08:58:44.734353 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1121/2287] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:58:44 2022] GET /compute/v2.1/servers/affb61a7-7e36-4424-bf48-a5a6bd64ae29 => generated 1308 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:58:44.743180 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-6e229027-3e7f-4b75-aea5-bebc1c5bcf96 tempest-ServersAdminNegativeTestJSON-1651638548 tempest-ServersAdminNegativeTestJSON-1651638548-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:58:44.749616 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-6e229027-3e7f-4b75-aea5-bebc1c5bcf96 tempest-ServersAdminNegativeTestJSON-1651638548 tempest-ServersAdminNegativeTestJSON-1651638548-project-admin] Request method failure captured: Sep 14 08:58:44.749616 n-d-836830-18 devstack@n-api.service[128759]: request: POST /compute/v2.1/servers/a88f52fe-95e7-46fc-b7fa-1714b4449e87/action HTTP/1.1 Sep 14 08:58:44.749616 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 08:58:44.749616 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 08:58:44.749616 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 08:58:44.749616 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 39 Sep 14 08:58:44.749616 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 08:58:44.749616 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 08:58:44.749616 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 08:58:44.749616 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 08:58:44.749616 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZeUXkblrqZG_txoKC1lB3zxbqGbA6szxL6_XfeiOajAmjPSNZymadVQAUD3pu5o_NQuJV_MUZNJfaPCOdZKebvsjEQpJjjfC5RKFMi0emoOYUddxH96XEj7zoPHpxfN4xEQlxfmmZ2dI9AqKnSAYZedf2cMO26C0sl09TSJp3vIgI4 Sep 14 08:58:44.749616 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 08:58:44.749616 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 08:58:44.749616 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 08:58:44.749616 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 08:58:44.749616 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 08:58:44.749616 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 08:58:44.749616 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 21b086a22d664c45a9d7801c383e44e8 Sep 14 08:58:44.749616 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1651638548 Sep 14 08:58:44.749616 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member,admin Sep 14 08:58:44.749616 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member,admin Sep 14 08:58:44.749616 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/21b086a22d664c45a9d7801c383e44e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_21b086a22d664c45a9d7801c383e44e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/21b086a22d664c45a9d7801c383e44e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/21b086a22d664c45a9d7801c383e44e8"}]}] Sep 14 08:58:44.749616 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1651638548 Sep 14 08:58:44.749616 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 21b086a22d664c45a9d7801c383e44e8 Sep 14 08:58:44.749616 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1651638548 Sep 14 08:58:44.749616 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ServersAdminNegativeTestJSON-1651638548-project-admin Sep 14 08:58:44.749616 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 08:58:44.749616 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 08:58:44.749616 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 68408bef8e15486abfb940c9aef80168 Sep 14 08:58:44.749616 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1651638548-project-admin Sep 14 08:58:44.749616 n-d-836830-18 devstack@n-api.service[128759]: Sep 14 08:58:44.749616 n-d-836830-18 devstack@n-api.service[128759]: {"os-resetState": {"state": "invalid"}} Sep 14 08:58:44.749616 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 08:58:44.749616 n-d-836830-18 devstack@n-api.service[128759]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Sep 14 08:58:44.749616 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': 'a88f52fe-95e7-46fc-b7fa-1714b4449e87', 'body': {'os-resetState': {'state': 'invalid'}}} Sep 14 08:58:44.749616 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:58:44.749616 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:58:44.749616 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 14 08:58:44.749616 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 14 08:58:44.749616 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 14 08:58:44.749616 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise error Sep 14 08:58:44.749616 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Sep 14 08:58:44.749616 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:58:44.749616 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Sep 14 08:58:44.749616 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Sep 14 08:58:44.749616 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:58:44.749616 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Sep 14 08:58:44.749616 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi 'invalid' Sep 14 08:58:44.749616 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:58:44.749616 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:58:44.749616 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:58:44.749616 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:58:44.749616 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:58:44.749616 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:58:44.749616 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:58:44.749616 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:58:44.749616 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:58:44.749616 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:58:44.749616 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 14 08:58:44.749616 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 14 08:58:44.749616 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 14 08:58:44.749616 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 14 08:58:44.749616 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 14 08:58:44.749616 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 14 08:58:44.753513 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Sep 14 08:58:44.753513 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:58:44.753513 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:58:44.753513 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:58:44.753513 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:58:44.753513 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:58:44.753513 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:58:44.753513 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 14 08:58:44.753513 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 14 08:58:44.753513 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Sep 14 08:58:44.753513 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:58:44.756181 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-6e229027-3e7f-4b75-aea5-bebc1c5bcf96 tempest-ServersAdminNegativeTestJSON-1651638548 tempest-ServersAdminNegativeTestJSON-1651638548-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:58:44.757116 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-369ccfb3-09d0-4edc-b8cf-10c238056a3a req-7d094ccb-c8af-4269-9b0d-27ebc5c719ed service nova] Creating event network-changed:2e224a14-f300-4cfe-a4c3-34a512adfc08 for instance d0c5547a-1340-4d19-a0f9-3e1eb9fd1932 on n-h1-836830-18 Sep 14 08:58:44.758794 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-6e229027-3e7f-4b75-aea5-bebc1c5bcf96 tempest-ServersAdminNegativeTestJSON-1651638548 tempest-ServersAdminNegativeTestJSON-1651638548-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/a88f52fe-95e7-46fc-b7fa-1714b4449e87/action" status: 400 len: 144 microversion: 2.1 time: 0.023045 Sep 14 08:58:44.759537 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1122/2288] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 08:58:44 2022] POST /compute/v2.1/servers/a88f52fe-95e7-46fc-b7fa-1714b4449e87/action => generated 144 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 14 08:58:44.764073 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-369ccfb3-09d0-4edc-b8cf-10c238056a3a req-7d094ccb-c8af-4269-9b0d-27ebc5c719ed service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.194474 Sep 14 08:58:44.765280 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1167/2289] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:58:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:58:44.768442 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-5287f5b7-f892-4303-be0b-f3dc165660f7 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:44.769116 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-5287f5b7-f892-4303-be0b-f3dc165660f7 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] [instance: 0b54f1c2-0d9c-4396-8c79-1e43b612b2ba] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:44.772382 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a5c1e6d4-79df-468d-aaa0-aad29659d653 tempest-ServersAdminNegativeTestJSON-1651638548 tempest-ServersAdminNegativeTestJSON-1651638548-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:58:44.776237 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a5c1e6d4-79df-468d-aaa0-aad29659d653 tempest-ServersAdminNegativeTestJSON-1651638548 tempest-ServersAdminNegativeTestJSON-1651638548-project-admin] Request method failure captured: Sep 14 08:58:44.776237 n-d-836830-18 devstack@n-api.service[128758]: request: POST /compute/v2.1/servers/a88f52fe-95e7-46fc-b7fa-1714b4449e87/action HTTP/1.1 Sep 14 08:58:44.776237 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 08:58:44.776237 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 08:58:44.776237 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 08:58:44.776237 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 31 Sep 14 08:58:44.776237 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 08:58:44.776237 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 08:58:44.776237 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 08:58:44.776237 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 08:58:44.776237 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZeUXkblrqZG_txoKC1lB3zxbqGbA6szxL6_XfeiOajAmjPSNZymadVQAUD3pu5o_NQuJV_MUZNJfaPCOdZKebvsjEQpJjjfC5RKFMi0emoOYUddxH96XEj7zoPHpxfN4xEQlxfmmZ2dI9AqKnSAYZedf2cMO26C0sl09TSJp3vIgI4 Sep 14 08:58:44.776237 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 08:58:44.776237 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 08:58:44.776237 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 08:58:44.776237 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 08:58:44.776237 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 08:58:44.776237 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 08:58:44.776237 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 21b086a22d664c45a9d7801c383e44e8 Sep 14 08:58:44.776237 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1651638548 Sep 14 08:58:44.776237 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member,admin Sep 14 08:58:44.776237 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member,admin Sep 14 08:58:44.776237 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/21b086a22d664c45a9d7801c383e44e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_21b086a22d664c45a9d7801c383e44e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/21b086a22d664c45a9d7801c383e44e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/21b086a22d664c45a9d7801c383e44e8"}]}] Sep 14 08:58:44.776237 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1651638548 Sep 14 08:58:44.776237 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 21b086a22d664c45a9d7801c383e44e8 Sep 14 08:58:44.776237 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1651638548 Sep 14 08:58:44.776237 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-ServersAdminNegativeTestJSON-1651638548-project-admin Sep 14 08:58:44.776237 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 08:58:44.776237 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 08:58:44.776237 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 68408bef8e15486abfb940c9aef80168 Sep 14 08:58:44.776237 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1651638548-project-admin Sep 14 08:58:44.776237 n-d-836830-18 devstack@n-api.service[128758]: Sep 14 08:58:44.776237 n-d-836830-18 devstack@n-api.service[128758]: {"os-resetState": {"state": 1}} Sep 14 08:58:44.776237 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 08:58:44.776237 n-d-836830-18 devstack@n-api.service[128758]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Sep 14 08:58:44.776237 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': 'a88f52fe-95e7-46fc-b7fa-1714b4449e87', 'body': {'os-resetState': {'state': 1}}} Sep 14 08:58:44.776237 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:58:44.776237 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:58:44.776237 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 14 08:58:44.776237 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 14 08:58:44.776237 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 14 08:58:44.776237 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise error Sep 14 08:58:44.776237 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Sep 14 08:58:44.776237 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:58:44.776237 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Sep 14 08:58:44.776237 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Sep 14 08:58:44.776237 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:58:44.776237 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Sep 14 08:58:44.776237 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi 1 Sep 14 08:58:44.776237 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:58:44.776237 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:58:44.776237 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:58:44.776237 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:58:44.776237 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:58:44.776237 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:58:44.776237 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:58:44.776237 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:58:44.776237 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:58:44.776237 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:58:44.776237 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 14 08:58:44.776237 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 14 08:58:44.776237 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 14 08:58:44.776237 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 14 08:58:44.776237 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 14 08:58:44.776237 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 14 08:58:44.776237 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Sep 14 08:58:44.776237 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:58:44.782336 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:58:44.782336 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:58:44.782336 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:58:44.782336 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:58:44.782336 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:58:44.782336 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 14 08:58:44.782336 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 14 08:58:44.782336 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Sep 14 08:58:44.782336 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:58:44.783205 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5287f5b7-f892-4303-be0b-f3dc165660f7 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:44.783297 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a5c1e6d4-79df-468d-aaa0-aad29659d653 tempest-ServersAdminNegativeTestJSON-1651638548 tempest-ServersAdminNegativeTestJSON-1651638548-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:58:44.783381 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5287f5b7-f892-4303-be0b-f3dc165660f7 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:44.783381 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5287f5b7-f892-4303-be0b-f3dc165660f7 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:44.783513 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-a5c1e6d4-79df-468d-aaa0-aad29659d653 tempest-ServersAdminNegativeTestJSON-1651638548 tempest-ServersAdminNegativeTestJSON-1651638548-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/a88f52fe-95e7-46fc-b7fa-1714b4449e87/action" status: 400 len: 120 microversion: 2.1 time: 0.011089 Sep 14 08:58:44.783593 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5287f5b7-f892-4303-be0b-f3dc165660f7 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:44.783593 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5287f5b7-f892-4303-be0b-f3dc165660f7 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:44.783725 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1168/2290] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 08:58:44 2022] POST /compute/v2.1/servers/a88f52fe-95e7-46fc-b7fa-1714b4449e87/action => generated 120 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 14 08:58:44.785466 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5287f5b7-f892-4303-be0b-f3dc165660f7 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:44.790713 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-0ad9e018-28a0-42d4-a226-b197526ecfc6 tempest-ServersAdminNegativeTestJSON-1651638548 tempest-ServersAdminNegativeTestJSON-1651638548-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:58:44.793037 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-0ad9e018-28a0-42d4-a226-b197526ecfc6 tempest-ServersAdminNegativeTestJSON-1651638548 tempest-ServersAdminNegativeTestJSON-1651638548-project-admin] Failed to fetch instance by id 999 {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 14 08:58:44.793650 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-0ad9e018-28a0-42d4-a226-b197526ecfc6 tempest-ServersAdminNegativeTestJSON-1651638548 tempest-ServersAdminNegativeTestJSON-1651638548-project-admin] HTTP exception thrown: Instance 999 could not be found. Sep 14 08:58:44.802580 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-0ad9e018-28a0-42d4-a226-b197526ecfc6 tempest-ServersAdminNegativeTestJSON-1651638548 tempest-ServersAdminNegativeTestJSON-1651638548-project-admin] Request method failure captured: Sep 14 08:58:44.802580 n-d-836830-18 devstack@n-api.service[128758]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Sep 14 08:58:44.802580 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 08:58:44.802580 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 08:58:44.802580 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 08:58:44.802580 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 37 Sep 14 08:58:44.802580 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 08:58:44.802580 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 08:58:44.802580 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 08:58:44.802580 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 08:58:44.802580 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZeUXkblrqZG_txoKC1lB3zxbqGbA6szxL6_XfeiOajAmjPSNZymadVQAUD3pu5o_NQuJV_MUZNJfaPCOdZKebvsjEQpJjjfC5RKFMi0emoOYUddxH96XEj7zoPHpxfN4xEQlxfmmZ2dI9AqKnSAYZedf2cMO26C0sl09TSJp3vIgI4 Sep 14 08:58:44.802580 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 08:58:44.802580 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 08:58:44.802580 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 08:58:44.802580 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 08:58:44.802580 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 08:58:44.802580 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 08:58:44.802580 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 21b086a22d664c45a9d7801c383e44e8 Sep 14 08:58:44.802580 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1651638548 Sep 14 08:58:44.802580 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member,admin Sep 14 08:58:44.802580 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member,admin Sep 14 08:58:44.802580 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/21b086a22d664c45a9d7801c383e44e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_21b086a22d664c45a9d7801c383e44e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/21b086a22d664c45a9d7801c383e44e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/21b086a22d664c45a9d7801c383e44e8"}]}] Sep 14 08:58:44.802580 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1651638548 Sep 14 08:58:44.802580 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 21b086a22d664c45a9d7801c383e44e8 Sep 14 08:58:44.802580 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1651638548 Sep 14 08:58:44.802580 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-ServersAdminNegativeTestJSON-1651638548-project-admin Sep 14 08:58:44.802580 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 08:58:44.802580 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 08:58:44.802580 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 68408bef8e15486abfb940c9aef80168 Sep 14 08:58:44.802580 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1651638548-project-admin Sep 14 08:58:44.802580 n-d-836830-18 devstack@n-api.service[128758]: Sep 14 08:58:44.802580 n-d-836830-18 devstack@n-api.service[128758]: {"os-resetState": {"state": "error"}} Sep 14 08:58:44.802580 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 08:58:44.802580 n-d-836830-18 devstack@n-api.service[128758]: exception: Instance 999 could not be found. Sep 14 08:58:44.802580 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Sep 14 08:58:44.802580 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:58:44.802580 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:58:44.802580 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 08:58:44.802580 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 08:58:44.802580 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 14 08:58:44.802580 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 14 08:58:44.802580 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Sep 14 08:58:44.802580 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:58:44.802580 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:58:44.802580 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:58:44.802580 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:58:44.802580 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:58:44.802580 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:58:44.802580 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:58:44.802580 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:58:44.802580 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:58:44.802580 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:58:44.802580 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 08:58:44.802580 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 08:58:44.802580 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Sep 14 08:58:44.802580 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 14 08:58:44.802580 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 08:58:44.802580 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 08:58:44.802580 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Sep 14 08:58:44.802580 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:58:44.802580 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:58:44.802580 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:58:44.802580 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:58:44.802580 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:58:44.802580 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:58:44.802580 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:58:44.806503 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:58:44.806503 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Sep 14 08:58:44.806503 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:58:44.806681 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-5287f5b7-f892-4303-be0b-f3dc165660f7 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] HTTP exception thrown: Instance 0b54f1c2-0d9c-4396-8c79-1e43b612b2ba could not be found. Sep 14 08:58:44.806681 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-5287f5b7-f892-4303-be0b-f3dc165660f7 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Request method failure captured: Sep 14 08:58:44.806681 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/0b54f1c2-0d9c-4396-8c79-1e43b612b2ba HTTP/1.1 Sep 14 08:58:44.806681 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 08:58:44.806681 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 08:58:44.806681 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 08:58:44.806681 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 08:58:44.806681 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 08:58:44.806681 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 08:58:44.806681 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 08:58:44.806681 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 08:58:44.806681 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZa33UCZGQPGGFdnEKy40Bf9yKumjdqBjudRlsEN8P4xQwLQqU7t11praMTuRTYjXF9W5xpncATu9Asflgdxa1jHHEk90rPM23QPYiIhIrdEtxdPdlSJ3WSHd59VxlPFgfCP3TDOFWt0Y7zLGdkKDGRppghDHAK0BfaQiaCZwfTNzFE Sep 14 08:58:44.806681 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 08:58:44.806681 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 08:58:44.806681 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 08:58:44.806681 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 08:58:44.806681 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 08:58:44.806681 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 08:58:44.806681 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: e77c85f074ae4b8cb5a1457a5183197b Sep 14 08:58:44.806681 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1087944038 Sep 14 08:58:44.806681 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 08:58:44.806681 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 08:58:44.806681 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e77c85f074ae4b8cb5a1457a5183197b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e77c85f074ae4b8cb5a1457a5183197b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e77c85f074ae4b8cb5a1457a5183197b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e77c85f074ae4b8cb5a1457a5183197b"}]}] Sep 14 08:58:44.806681 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1087944038 Sep 14 08:58:44.806681 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: e77c85f074ae4b8cb5a1457a5183197b Sep 14 08:58:44.806681 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1087944038 Sep 14 08:58:44.806681 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-AttachSCSIVolumeTestJSON-1087944038-project Sep 14 08:58:44.806681 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 08:58:44.806681 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 08:58:44.806681 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 72e1780ebcf1413fa4f7a9760b761c78 Sep 14 08:58:44.806681 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1087944038-project Sep 14 08:58:44.806681 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 08:58:44.806681 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance 0b54f1c2-0d9c-4396-8c79-1e43b612b2ba could not be found. Sep 14 08:58:44.806681 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '0b54f1c2-0d9c-4396-8c79-1e43b612b2ba'} Sep 14 08:58:44.806681 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:58:44.806681 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:58:44.806681 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 08:58:44.806681 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 08:58:44.806681 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 08:58:44.806681 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 08:58:44.806681 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 08:58:44.806681 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 08:58:44.806681 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 08:58:44.806681 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 08:58:44.806681 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b54f1c2-0d9c-4396-8c79-1e43b612b2ba could not be found. Sep 14 08:58:44.806681 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:58:44.806681 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:58:44.806681 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:58:44.806681 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:58:44.806681 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:58:44.806681 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:58:44.806681 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:58:44.806681 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:58:44.806681 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:58:44.806681 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:58:44.806681 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 08:58:44.806681 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 08:58:44.806681 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 08:58:44.806681 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 08:58:44.806681 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 08:58:44.806681 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 08:58:44.813141 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b54f1c2-0d9c-4396-8c79-1e43b612b2ba could not be found. Sep 14 08:58:44.813141 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:58:44.813141 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:58:44.813141 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:58:44.813141 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:58:44.813141 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:58:44.813141 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:58:44.813141 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:58:44.813141 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:58:44.813141 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b54f1c2-0d9c-4396-8c79-1e43b612b2ba could not be found. Sep 14 08:58:44.813141 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:58:44.813141 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-5287f5b7-f892-4303-be0b-f3dc165660f7 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] Returning 404 to user: Instance 0b54f1c2-0d9c-4396-8c79-1e43b612b2ba could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:58:44.813141 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-5287f5b7-f892-4303-be0b-f3dc165660f7 tempest-AttachSCSIVolumeTestJSON-1087944038 tempest-AttachSCSIVolumeTestJSON-1087944038-project] 10.222.0.60 "GET /compute/v2.1/servers/0b54f1c2-0d9c-4396-8c79-1e43b612b2ba" status: 404 len: 111 microversion: 2.1 time: 0.045528 Sep 14 08:58:44.813141 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1123/2291] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:58:44 2022] GET /compute/v2.1/servers/0b54f1c2-0d9c-4396-8c79-1e43b612b2ba => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 08:58:44.814177 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-0ad9e018-28a0-42d4-a226-b197526ecfc6 tempest-ServersAdminNegativeTestJSON-1651638548 tempest-ServersAdminNegativeTestJSON-1651638548-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:58:44.819071 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-0ad9e018-28a0-42d4-a226-b197526ecfc6 tempest-ServersAdminNegativeTestJSON-1651638548 tempest-ServersAdminNegativeTestJSON-1651638548-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.032567 Sep 14 08:58:44.820064 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1169/2292] 10.222.0.60 () {60 vars in 1179 bytes} [Wed Sep 14 08:58:44 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 14 08:58:44.830329 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-bcf3b4f5-a548-4e63-98f1-9a70f955846d tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:44.830831 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-bcf3b4f5-a548-4e63-98f1-9a70f955846d tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] [instance: 5629527b-12f8-4467-85a7-976d17dd267a] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:44.837532 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bcf3b4f5-a548-4e63-98f1-9a70f955846d tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:44.838378 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bcf3b4f5-a548-4e63-98f1-9a70f955846d tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:44.838979 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bcf3b4f5-a548-4e63-98f1-9a70f955846d tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:44.839989 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bcf3b4f5-a548-4e63-98f1-9a70f955846d tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:44.840479 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bcf3b4f5-a548-4e63-98f1-9a70f955846d tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:44.840920 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bcf3b4f5-a548-4e63-98f1-9a70f955846d tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:44.880055 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-bcf3b4f5-a548-4e63-98f1-9a70f955846d tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] [instance: 5629527b-12f8-4467-85a7-976d17dd267a] Going to try to terminate instance {{(pid=128759) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 08:58:44.961609 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:58:44.985365 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-bcf3b4f5-a548-4e63-98f1-9a70f955846d tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] 10.222.0.60 "DELETE /compute/v2.1/servers/5629527b-12f8-4467-85a7-976d17dd267a" status: 204 len: 0 microversion: 2.1 time: 0.158188 Sep 14 08:58:44.986807 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1124/2293] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 08:58:44 2022] DELETE /compute/v2.1/servers/5629527b-12f8-4467-85a7-976d17dd267a => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 08:58:44.996573 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-58e81e5e-0a66-4125-ad3c-bdb87d420f88 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:44.997427 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-58e81e5e-0a66-4125-ad3c-bdb87d420f88 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] [instance: 5629527b-12f8-4467-85a7-976d17dd267a] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:45.007854 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-58e81e5e-0a66-4125-ad3c-bdb87d420f88 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:45.008278 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-58e81e5e-0a66-4125-ad3c-bdb87d420f88 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:45.008728 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-58e81e5e-0a66-4125-ad3c-bdb87d420f88 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:45.009446 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-58e81e5e-0a66-4125-ad3c-bdb87d420f88 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:45.009910 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-58e81e5e-0a66-4125-ad3c-bdb87d420f88 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:45.010359 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-58e81e5e-0a66-4125-ad3c-bdb87d420f88 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:45.225958 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-0d3c5fa7-c1ab-46a1-83a7-87fe0fd14e60 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:45.227396 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-0d3c5fa7-c1ab-46a1-83a7-87fe0fd14e60 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] [instance: 26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:45.236295 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0d3c5fa7-c1ab-46a1-83a7-87fe0fd14e60 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:45.236907 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0d3c5fa7-c1ab-46a1-83a7-87fe0fd14e60 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:45.238064 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0d3c5fa7-c1ab-46a1-83a7-87fe0fd14e60 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:45.238888 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0d3c5fa7-c1ab-46a1-83a7-87fe0fd14e60 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:45.239464 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0d3c5fa7-c1ab-46a1-83a7-87fe0fd14e60 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:45.240657 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0d3c5fa7-c1ab-46a1-83a7-87fe0fd14e60 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:45.681889 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-58e81e5e-0a66-4125-ad3c-bdb87d420f88 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f584701398b64fab808e3cbcc4259a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb6af957c8f45e5a0996c0e4b1f456a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:45.690766 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-58e81e5e-0a66-4125-ad3c-bdb87d420f88 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] 10.222.0.60 "GET /compute/v2.1/servers/5629527b-12f8-4467-85a7-976d17dd267a" status: 200 len: 1468 microversion: 2.1 time: 0.699362 Sep 14 08:58:45.691380 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1170/2294] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:58:44 2022] GET /compute/v2.1/servers/5629527b-12f8-4467-85a7-976d17dd267a => generated 1468 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:58:45.696081 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-4c3b1e25-078c-4ec9-ae7b-09fa647c8022 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:45.697105 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-4c3b1e25-078c-4ec9-ae7b-09fa647c8022 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: d0c5547a-1340-4d19-a0f9-3e1eb9fd1932] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:45.703899 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4c3b1e25-078c-4ec9-ae7b-09fa647c8022 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:45.704868 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4c3b1e25-078c-4ec9-ae7b-09fa647c8022 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:45.705635 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4c3b1e25-078c-4ec9-ae7b-09fa647c8022 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:45.707565 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4c3b1e25-078c-4ec9-ae7b-09fa647c8022 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:45.708261 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4c3b1e25-078c-4ec9-ae7b-09fa647c8022 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:45.708903 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4c3b1e25-078c-4ec9-ae7b-09fa647c8022 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:45.959512 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-0d3c5fa7-c1ab-46a1-83a7-87fe0fd14e60 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:45.974000 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-0d3c5fa7-c1ab-46a1-83a7-87fe0fd14e60 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:45.976015 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-0d3c5fa7-c1ab-46a1-83a7-87fe0fd14e60 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:45.980168 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-0d3c5fa7-c1ab-46a1-83a7-87fe0fd14e60 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] 10.222.0.60 "GET /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0" status: 200 len: 1880 microversion: 2.32 time: 0.765207 Sep 14 08:58:45.982604 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1125/2295] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:58:45 2022] GET /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0 => generated 1880 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 08:58:45.988944 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-6951fe20-568f-4237-a9ba-556c4978c140 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:45.989620 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-6951fe20-568f-4237-a9ba-556c4978c140 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: 2098e0b9-b628-4b9e-979b-960c68830fee] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:45.995967 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6951fe20-568f-4237-a9ba-556c4978c140 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:45.996693 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6951fe20-568f-4237-a9ba-556c4978c140 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:45.997369 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6951fe20-568f-4237-a9ba-556c4978c140 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:45.999402 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6951fe20-568f-4237-a9ba-556c4978c140 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:46.000076 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6951fe20-568f-4237-a9ba-556c4978c140 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:46.000711 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6951fe20-568f-4237-a9ba-556c4978c140 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:46.038538 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-4c3b1e25-078c-4ec9-ae7b-09fa647c8022 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9d40e54481461cba53fedb9a6abdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed2295a58f8451993a57ce0a6f9ba29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:46.048233 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-4c3b1e25-078c-4ec9-ae7b-09fa647c8022 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] 10.222.0.60 "GET /compute/v2.1/servers/d0c5547a-1340-4d19-a0f9-3e1eb9fd1932" status: 200 len: 1316 microversion: 2.1 time: 0.355559 Sep 14 08:58:46.048827 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1171/2296] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:58:45 2022] GET /compute/v2.1/servers/d0c5547a-1340-4d19-a0f9-3e1eb9fd1932 => generated 1316 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:58:46.060204 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-70b1bdd2-b6cf-4654-861b-6aed8a228783 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:46.064800 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-70b1bdd2-b6cf-4654-861b-6aed8a228783 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] [instance: 885dfd01-8bac-4691-ad0b-f2218e306f2e] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:46.075896 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-6951fe20-568f-4237-a9ba-556c4978c140 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: 2098e0b9-b628-4b9e-979b-960c68830fee] Going to try to terminate instance {{(pid=128759) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 08:58:46.082116 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-70b1bdd2-b6cf-4654-861b-6aed8a228783 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:46.082620 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-70b1bdd2-b6cf-4654-861b-6aed8a228783 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:46.083108 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-70b1bdd2-b6cf-4654-861b-6aed8a228783 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:46.086252 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-70b1bdd2-b6cf-4654-861b-6aed8a228783 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:46.086718 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-70b1bdd2-b6cf-4654-861b-6aed8a228783 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:46.087177 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-70b1bdd2-b6cf-4654-861b-6aed8a228783 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:46.200897 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-6951fe20-568f-4237-a9ba-556c4978c140 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "DELETE /compute/v2.1/servers/2098e0b9-b628-4b9e-979b-960c68830fee" status: 204 len: 0 microversion: 2.1 time: 0.216450 Sep 14 08:58:46.202763 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1126/2297] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 08:58:45 2022] DELETE /compute/v2.1/servers/2098e0b9-b628-4b9e-979b-960c68830fee => generated 0 bytes in 219 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 08:58:46.209398 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-2cc32312-1e61-4c80-a084-e1b7d931798d tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:46.211047 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-2cc32312-1e61-4c80-a084-e1b7d931798d tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: affb61a7-7e36-4424-bf48-a5a6bd64ae29] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:46.220041 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2cc32312-1e61-4c80-a084-e1b7d931798d tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:46.220862 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2cc32312-1e61-4c80-a084-e1b7d931798d tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:46.221476 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2cc32312-1e61-4c80-a084-e1b7d931798d tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:46.222598 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2cc32312-1e61-4c80-a084-e1b7d931798d tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:46.223390 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2cc32312-1e61-4c80-a084-e1b7d931798d tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:46.224020 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2cc32312-1e61-4c80-a084-e1b7d931798d tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:46.224494 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-70b1bdd2-b6cf-4654-861b-6aed8a228783 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ab7166e40e4a908eefbfb03b3b8804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de82b83dadd541dbb4a939f2fc04a163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:46.233760 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-70b1bdd2-b6cf-4654-861b-6aed8a228783 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] 10.222.0.60 "GET /compute/v2.1/servers/885dfd01-8bac-4691-ad0b-f2218e306f2e" status: 200 len: 1237 microversion: 2.1 time: 0.177586 Sep 14 08:58:46.242523 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1172/2298] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:58:46 2022] GET /compute/v2.1/servers/885dfd01-8bac-4691-ad0b-f2218e306f2e => generated 1237 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:58:46.260276 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-74a20b56-ee28-4ae8-85f6-8f18d7f09611 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:46.263733 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-74a20b56-ee28-4ae8-85f6-8f18d7f09611 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: 2098e0b9-b628-4b9e-979b-960c68830fee] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:46.277738 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-74a20b56-ee28-4ae8-85f6-8f18d7f09611 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:46.279560 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-74a20b56-ee28-4ae8-85f6-8f18d7f09611 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:46.281986 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-74a20b56-ee28-4ae8-85f6-8f18d7f09611 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:46.283375 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-74a20b56-ee28-4ae8-85f6-8f18d7f09611 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:46.284417 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-74a20b56-ee28-4ae8-85f6-8f18d7f09611 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:46.285688 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-74a20b56-ee28-4ae8-85f6-8f18d7f09611 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:46.615884 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-2cc32312-1e61-4c80-a084-e1b7d931798d tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:46.625167 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-74a20b56-ee28-4ae8-85f6-8f18d7f09611 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:46.636942 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-2cc32312-1e61-4c80-a084-e1b7d931798d tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/affb61a7-7e36-4424-bf48-a5a6bd64ae29" status: 200 len: 1308 microversion: 2.1 time: 0.432563 Sep 14 08:58:46.637253 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-74a20b56-ee28-4ae8-85f6-8f18d7f09611 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/2098e0b9-b628-4b9e-979b-960c68830fee" status: 200 len: 1666 microversion: 2.1 time: 0.388729 Sep 14 08:58:46.638142 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1173/2299] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:58:46 2022] GET /compute/v2.1/servers/2098e0b9-b628-4b9e-979b-960c68830fee => generated 1666 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:58:46.639977 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1127/2300] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:58:46 2022] GET /compute/v2.1/servers/affb61a7-7e36-4424-bf48-a5a6bd64ae29 => generated 1308 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:58:46.717887 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-12e0df25-474a-4592-ab02-8a74245f1d5e tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:46.719234 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-12e0df25-474a-4592-ab02-8a74245f1d5e tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] [instance: 5629527b-12f8-4467-85a7-976d17dd267a] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:46.725939 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-12e0df25-474a-4592-ab02-8a74245f1d5e tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:46.726755 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-12e0df25-474a-4592-ab02-8a74245f1d5e tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:46.727453 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-12e0df25-474a-4592-ab02-8a74245f1d5e tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:46.728640 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-12e0df25-474a-4592-ab02-8a74245f1d5e tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:46.729317 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-12e0df25-474a-4592-ab02-8a74245f1d5e tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:46.729957 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-12e0df25-474a-4592-ab02-8a74245f1d5e tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:47.003327 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-12e0df25-474a-4592-ab02-8a74245f1d5e tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f584701398b64fab808e3cbcc4259a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb6af957c8f45e5a0996c0e4b1f456a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:47.008303 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e571ecd0-6d7d-4b32-8ced-f46791eef507 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:47.009013 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e571ecd0-6d7d-4b32-8ced-f46791eef507 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] [instance: 26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:47.014708 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-12e0df25-474a-4592-ab02-8a74245f1d5e tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] 10.222.0.60 "GET /compute/v2.1/servers/5629527b-12f8-4467-85a7-976d17dd267a" status: 200 len: 1468 microversion: 2.1 time: 0.300993 Sep 14 08:58:47.016357 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e571ecd0-6d7d-4b32-8ced-f46791eef507 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:47.017096 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e571ecd0-6d7d-4b32-8ced-f46791eef507 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:47.017768 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e571ecd0-6d7d-4b32-8ced-f46791eef507 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:47.018749 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e571ecd0-6d7d-4b32-8ced-f46791eef507 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:47.019445 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e571ecd0-6d7d-4b32-8ced-f46791eef507 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:47.020110 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e571ecd0-6d7d-4b32-8ced-f46791eef507 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:47.028967 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1174/2301] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:58:46 2022] GET /compute/v2.1/servers/5629527b-12f8-4467-85a7-976d17dd267a => generated 1468 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:58:47.074257 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-12e218e7-2ab3-44e9-8936-d0ff4a2c27a4 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:47.074889 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-12e218e7-2ab3-44e9-8936-d0ff4a2c27a4 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: d0c5547a-1340-4d19-a0f9-3e1eb9fd1932] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:47.081771 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-12e218e7-2ab3-44e9-8936-d0ff4a2c27a4 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:47.085704 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-12e218e7-2ab3-44e9-8936-d0ff4a2c27a4 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:47.085704 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-12e218e7-2ab3-44e9-8936-d0ff4a2c27a4 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:47.085704 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-12e218e7-2ab3-44e9-8936-d0ff4a2c27a4 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:47.085704 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-12e218e7-2ab3-44e9-8936-d0ff4a2c27a4 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:47.085704 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-12e218e7-2ab3-44e9-8936-d0ff4a2c27a4 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:47.471703 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-12e218e7-2ab3-44e9-8936-d0ff4a2c27a4 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9d40e54481461cba53fedb9a6abdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed2295a58f8451993a57ce0a6f9ba29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:47.483675 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-e571ecd0-6d7d-4b32-8ced-f46791eef507 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:47.485918 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:58:47.491266 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-12e218e7-2ab3-44e9-8936-d0ff4a2c27a4 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] 10.222.0.60 "GET /compute/v2.1/servers/d0c5547a-1340-4d19-a0f9-3e1eb9fd1932" status: 200 len: 1316 microversion: 2.1 time: 0.420611 Sep 14 08:58:47.493867 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1175/2302] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:58:47 2022] GET /compute/v2.1/servers/d0c5547a-1340-4d19-a0f9-3e1eb9fd1932 => generated 1316 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:58:47.500790 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-e571ecd0-6d7d-4b32-8ced-f46791eef507 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:47.502266 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-e571ecd0-6d7d-4b32-8ced-f46791eef507 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:47.503054 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-8ca21cf3-e27d-46a3-a710-dc5e8be4bfe0 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:47.503482 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e571ecd0-6d7d-4b32-8ced-f46791eef507 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] 10.222.0.60 "GET /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0" status: 200 len: 1880 microversion: 2.32 time: 0.499218 Sep 14 08:58:47.504051 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1128/2303] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:58:47 2022] GET /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0 => generated 1880 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 08:58:47.504897 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-8ca21cf3-e27d-46a3-a710-dc5e8be4bfe0 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] [instance: 885dfd01-8bac-4691-ad0b-f2218e306f2e] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:47.513933 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8ca21cf3-e27d-46a3-a710-dc5e8be4bfe0 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:47.514439 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8ca21cf3-e27d-46a3-a710-dc5e8be4bfe0 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:47.515311 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8ca21cf3-e27d-46a3-a710-dc5e8be4bfe0 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:47.516981 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8ca21cf3-e27d-46a3-a710-dc5e8be4bfe0 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:47.517792 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8ca21cf3-e27d-46a3-a710-dc5e8be4bfe0 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:47.518375 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8ca21cf3-e27d-46a3-a710-dc5e8be4bfe0 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:47.614797 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-8ca21cf3-e27d-46a3-a710-dc5e8be4bfe0 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ab7166e40e4a908eefbfb03b3b8804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de82b83dadd541dbb4a939f2fc04a163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:47.622830 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-8ca21cf3-e27d-46a3-a710-dc5e8be4bfe0 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] 10.222.0.60 "GET /compute/v2.1/servers/885dfd01-8bac-4691-ad0b-f2218e306f2e" status: 200 len: 1299 microversion: 2.1 time: 0.126975 Sep 14 08:58:47.635611 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1176/2304] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:58:47 2022] GET /compute/v2.1/servers/885dfd01-8bac-4691-ad0b-f2218e306f2e => generated 1299 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:58:47.663349 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ad008e09-b346-43a3-94f3-f98c12cf4c90 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:47.664219 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-ad008e09-b346-43a3-94f3-f98c12cf4c90 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: affb61a7-7e36-4424-bf48-a5a6bd64ae29] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:47.673959 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ad008e09-b346-43a3-94f3-f98c12cf4c90 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:47.673959 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ad008e09-b346-43a3-94f3-f98c12cf4c90 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:47.678657 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-fd07782e-a5fb-49bc-af53-b0865e46fcc4 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:47.679165 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ad008e09-b346-43a3-94f3-f98c12cf4c90 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:47.680042 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ad008e09-b346-43a3-94f3-f98c12cf4c90 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:47.680924 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ad008e09-b346-43a3-94f3-f98c12cf4c90 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:47.681447 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-fd07782e-a5fb-49bc-af53-b0865e46fcc4 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: 2098e0b9-b628-4b9e-979b-960c68830fee] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:47.681697 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ad008e09-b346-43a3-94f3-f98c12cf4c90 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:47.693240 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fd07782e-a5fb-49bc-af53-b0865e46fcc4 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:47.694916 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fd07782e-a5fb-49bc-af53-b0865e46fcc4 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:47.699483 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fd07782e-a5fb-49bc-af53-b0865e46fcc4 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:47.700358 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fd07782e-a5fb-49bc-af53-b0865e46fcc4 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:47.701081 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fd07782e-a5fb-49bc-af53-b0865e46fcc4 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:47.701626 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fd07782e-a5fb-49bc-af53-b0865e46fcc4 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:48.014354 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-fd07782e-a5fb-49bc-af53-b0865e46fcc4 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:48.017645 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-ad008e09-b346-43a3-94f3-f98c12cf4c90 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:48.033128 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-ad008e09-b346-43a3-94f3-f98c12cf4c90 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/affb61a7-7e36-4424-bf48-a5a6bd64ae29" status: 200 len: 1308 microversion: 2.1 time: 0.370047 Sep 14 08:58:48.034512 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1129/2305] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:58:47 2022] GET /compute/v2.1/servers/affb61a7-7e36-4424-bf48-a5a6bd64ae29 => generated 1308 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:58:48.043009 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-514bded2-5ce3-48e6-92d7-7681ecba7135 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:48.043903 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-514bded2-5ce3-48e6-92d7-7681ecba7135 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] [instance: 5629527b-12f8-4467-85a7-976d17dd267a] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:48.048204 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-fd07782e-a5fb-49bc-af53-b0865e46fcc4 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/2098e0b9-b628-4b9e-979b-960c68830fee" status: 200 len: 1666 microversion: 2.1 time: 0.376996 Sep 14 08:58:48.049523 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1177/2306] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:58:47 2022] GET /compute/v2.1/servers/2098e0b9-b628-4b9e-979b-960c68830fee => generated 1666 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:58:48.059046 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-514bded2-5ce3-48e6-92d7-7681ecba7135 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:48.059827 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-514bded2-5ce3-48e6-92d7-7681ecba7135 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:48.060642 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-514bded2-5ce3-48e6-92d7-7681ecba7135 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:48.061591 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-514bded2-5ce3-48e6-92d7-7681ecba7135 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:48.062151 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-514bded2-5ce3-48e6-92d7-7681ecba7135 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:48.062707 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-514bded2-5ce3-48e6-92d7-7681ecba7135 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:48.523805 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-893a2647-964c-480d-9d09-71f65b981f3f req-445a283b-f99f-49ba-b987-c3c8872155f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5629527b-12f8-4467-85a7-976d17dd267a", "name": "network-vif-deleted", "tag": "78cf3403-7929-473d-b37b-6bb3deefa0cd"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:58:48.547773 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-893a2647-964c-480d-9d09-71f65b981f3f req-445a283b-f99f-49ba-b987-c3c8872155f8 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:48.549502 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-893a2647-964c-480d-9d09-71f65b981f3f req-445a283b-f99f-49ba-b987-c3c8872155f8 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:48.550834 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-893a2647-964c-480d-9d09-71f65b981f3f req-445a283b-f99f-49ba-b987-c3c8872155f8 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:48.589004 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-893a2647-964c-480d-9d09-71f65b981f3f req-445a283b-f99f-49ba-b987-c3c8872155f8 service nova] Creating event network-vif-deleted:78cf3403-7929-473d-b37b-6bb3deefa0cd for instance 5629527b-12f8-4467-85a7-976d17dd267a on n-h2-836830-18 Sep 14 08:58:48.600974 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-893a2647-964c-480d-9d09-71f65b981f3f req-445a283b-f99f-49ba-b987-c3c8872155f8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083693 Sep 14 08:58:48.605419 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1178/2307] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:58:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 08:58:48.628459 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-013dc150-b37f-4bd5-ad17-638961c4466e tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:48.631551 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-013dc150-b37f-4bd5-ad17-638961c4466e tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: d0c5547a-1340-4d19-a0f9-3e1eb9fd1932] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:48.642342 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-013dc150-b37f-4bd5-ad17-638961c4466e tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:48.643078 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-013dc150-b37f-4bd5-ad17-638961c4466e tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:48.643606 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-013dc150-b37f-4bd5-ad17-638961c4466e tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:48.644858 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-013dc150-b37f-4bd5-ad17-638961c4466e tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:48.645614 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-013dc150-b37f-4bd5-ad17-638961c4466e tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:48.646148 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-013dc150-b37f-4bd5-ad17-638961c4466e tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:48.686623 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-514bded2-5ce3-48e6-92d7-7681ecba7135 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f584701398b64fab808e3cbcc4259a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb6af957c8f45e5a0996c0e4b1f456a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:48.715122 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-514bded2-5ce3-48e6-92d7-7681ecba7135 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] 10.222.0.60 "GET /compute/v2.1/servers/5629527b-12f8-4467-85a7-976d17dd267a" status: 200 len: 1468 microversion: 2.1 time: 0.674615 Sep 14 08:58:48.719562 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1130/2308] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:58:48 2022] GET /compute/v2.1/servers/5629527b-12f8-4467-85a7-976d17dd267a => generated 1468 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:58:48.728126 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d18a044a-3c9c-4717-93e7-2d476f0f6ef3 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:48.729024 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-d18a044a-3c9c-4717-93e7-2d476f0f6ef3 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] [instance: 26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:48.744258 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d18a044a-3c9c-4717-93e7-2d476f0f6ef3 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:48.745156 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d18a044a-3c9c-4717-93e7-2d476f0f6ef3 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:48.753938 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d18a044a-3c9c-4717-93e7-2d476f0f6ef3 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:48.754971 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d18a044a-3c9c-4717-93e7-2d476f0f6ef3 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:48.756068 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d18a044a-3c9c-4717-93e7-2d476f0f6ef3 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:48.757082 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d18a044a-3c9c-4717-93e7-2d476f0f6ef3 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:49.220737 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-d18a044a-3c9c-4717-93e7-2d476f0f6ef3 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:49.232018 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-d18a044a-3c9c-4717-93e7-2d476f0f6ef3 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:49.239001 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-d18a044a-3c9c-4717-93e7-2d476f0f6ef3 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:49.244374 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d18a044a-3c9c-4717-93e7-2d476f0f6ef3 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] 10.222.0.60 "GET /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0" status: 200 len: 1880 microversion: 2.32 time: 0.522441 Sep 14 08:58:49.245109 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1131/2309] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:58:48 2022] GET /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0 => generated 1880 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:58:49.258731 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-013dc150-b37f-4bd5-ad17-638961c4466e tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9d40e54481461cba53fedb9a6abdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed2295a58f8451993a57ce0a6f9ba29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:49.263120 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-4e1d1f11-af5d-470a-915e-6c897406347b tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:49.264087 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-4e1d1f11-af5d-470a-915e-6c897406347b tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] [instance: 885dfd01-8bac-4691-ad0b-f2218e306f2e] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:49.267364 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-013dc150-b37f-4bd5-ad17-638961c4466e tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] 10.222.0.60 "GET /compute/v2.1/servers/d0c5547a-1340-4d19-a0f9-3e1eb9fd1932" status: 200 len: 1316 microversion: 2.1 time: 0.654855 Sep 14 08:58:49.280006 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4e1d1f11-af5d-470a-915e-6c897406347b tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:49.286606 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1179/2310] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:58:48 2022] GET /compute/v2.1/servers/d0c5547a-1340-4d19-a0f9-3e1eb9fd1932 => generated 1316 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:58:49.300362 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4e1d1f11-af5d-470a-915e-6c897406347b tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:49.301170 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4e1d1f11-af5d-470a-915e-6c897406347b tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:49.301926 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4e1d1f11-af5d-470a-915e-6c897406347b tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:49.307558 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4e1d1f11-af5d-470a-915e-6c897406347b tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:49.308498 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4e1d1f11-af5d-470a-915e-6c897406347b tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:49.443689 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-6d61d419-e86e-495c-b02e-fcebadc9beed req-7e95528b-2095-48a8-8f9d-a1606b11c153 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0", "name": "network-vif-plugged", "status": "completed", "tag": "5779091e-0903-4f0d-81c7-8bdda2add09d"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:58:49.457892 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-4e1d1f11-af5d-470a-915e-6c897406347b tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ab7166e40e4a908eefbfb03b3b8804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de82b83dadd541dbb4a939f2fc04a163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:49.462919 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-6d61d419-e86e-495c-b02e-fcebadc9beed req-7e95528b-2095-48a8-8f9d-a1606b11c153 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:49.464456 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-6d61d419-e86e-495c-b02e-fcebadc9beed req-7e95528b-2095-48a8-8f9d-a1606b11c153 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:49.465100 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-6d61d419-e86e-495c-b02e-fcebadc9beed req-7e95528b-2095-48a8-8f9d-a1606b11c153 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:49.475308 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-4e1d1f11-af5d-470a-915e-6c897406347b tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] 10.222.0.60 "GET /compute/v2.1/servers/885dfd01-8bac-4691-ad0b-f2218e306f2e" status: 200 len: 1299 microversion: 2.1 time: 0.228784 Sep 14 08:58:49.476262 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1132/2311] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:58:49 2022] GET /compute/v2.1/servers/885dfd01-8bac-4691-ad0b-f2218e306f2e => generated 1299 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:58:49.481169 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-2fa866de-c1d1-437c-ab25-fab413775556 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:49.482590 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-2fa866de-c1d1-437c-ab25-fab413775556 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: affb61a7-7e36-4424-bf48-a5a6bd64ae29] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:49.495897 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2fa866de-c1d1-437c-ab25-fab413775556 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:49.503002 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2fa866de-c1d1-437c-ab25-fab413775556 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:49.503780 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2fa866de-c1d1-437c-ab25-fab413775556 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:49.504744 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2fa866de-c1d1-437c-ab25-fab413775556 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:49.505784 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2fa866de-c1d1-437c-ab25-fab413775556 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:49.508515 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-6d61d419-e86e-495c-b02e-fcebadc9beed req-7e95528b-2095-48a8-8f9d-a1606b11c153 service nova] Creating event network-vif-plugged:5779091e-0903-4f0d-81c7-8bdda2add09d for instance 26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0 on n-h1-836830-18 Sep 14 08:58:49.516713 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2fa866de-c1d1-437c-ab25-fab413775556 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:49.517773 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-6d61d419-e86e-495c-b02e-fcebadc9beed req-7e95528b-2095-48a8-8f9d-a1606b11c153 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.229575 Sep 14 08:58:49.518976 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1180/2312] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:58:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:58:49.525623 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-5ccd85e1-30a3-47d1-8316-4c7997a56de3 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:49.526501 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-5ccd85e1-30a3-47d1-8316-4c7997a56de3 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: 2098e0b9-b628-4b9e-979b-960c68830fee] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:49.533690 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5ccd85e1-30a3-47d1-8316-4c7997a56de3 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:49.534406 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5ccd85e1-30a3-47d1-8316-4c7997a56de3 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:49.535164 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5ccd85e1-30a3-47d1-8316-4c7997a56de3 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:49.536149 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5ccd85e1-30a3-47d1-8316-4c7997a56de3 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:49.536762 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5ccd85e1-30a3-47d1-8316-4c7997a56de3 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:49.537361 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5ccd85e1-30a3-47d1-8316-4c7997a56de3 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:49.596284 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5ccd85e1-30a3-47d1-8316-4c7997a56de3 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:49.596284 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5ccd85e1-30a3-47d1-8316-4c7997a56de3 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:49.596284 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5ccd85e1-30a3-47d1-8316-4c7997a56de3 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:49.597180 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.objects.instance [None req-5ccd85e1-30a3-47d1-8316-4c7997a56de3 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lazy-loading 'fault' on Instance uuid 2098e0b9-b628-4b9e-979b-960c68830fee {{(pid=128758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 08:58:49.725310 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-5ccd85e1-30a3-47d1-8316-4c7997a56de3 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:49.734029 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-5ccd85e1-30a3-47d1-8316-4c7997a56de3 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/2098e0b9-b628-4b9e-979b-960c68830fee" status: 200 len: 1324 microversion: 2.1 time: 0.213692 Sep 14 08:58:49.749357 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1181/2313] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:58:49 2022] GET /compute/v2.1/servers/2098e0b9-b628-4b9e-979b-960c68830fee => generated 1324 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:58:49.756291 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c733fff1-0566-4847-9e44-83ea862dbeb5 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:49.757600 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-c733fff1-0566-4847-9e44-83ea862dbeb5 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] [instance: 5629527b-12f8-4467-85a7-976d17dd267a] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:49.764701 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c733fff1-0566-4847-9e44-83ea862dbeb5 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:49.765430 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c733fff1-0566-4847-9e44-83ea862dbeb5 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:49.766229 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c733fff1-0566-4847-9e44-83ea862dbeb5 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:49.767162 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c733fff1-0566-4847-9e44-83ea862dbeb5 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:49.767769 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c733fff1-0566-4847-9e44-83ea862dbeb5 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:49.768354 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c733fff1-0566-4847-9e44-83ea862dbeb5 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:49.785220 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-c733fff1-0566-4847-9e44-83ea862dbeb5 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] HTTP exception thrown: Instance 5629527b-12f8-4467-85a7-976d17dd267a could not be found. Sep 14 08:58:49.786913 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c733fff1-0566-4847-9e44-83ea862dbeb5 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Request method failure captured: Sep 14 08:58:49.786913 n-d-836830-18 devstack@n-api.service[128758]: request: GET /compute/v2.1/servers/5629527b-12f8-4467-85a7-976d17dd267a HTTP/1.1 Sep 14 08:58:49.786913 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 08:58:49.786913 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 08:58:49.786913 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 08:58:49.786913 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 08:58:49.786913 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 08:58:49.786913 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 08:58:49.786913 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 08:58:49.786913 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 08:58:49.786913 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZeTJinJdQoafkRHiIkmaEV3_D36xrTThn9aAaFe4fPyhOzYFcqEFeKdHxTspH7UL_EirXcZXJwMbKiWZMJlYDfgpcPoA9fFMjeUMT9wAQ7Lg7msNi91tfsdf1NFJHnI9Rz6UqC4sPcmrLrIOgSEgbVX2wrfTsmFowNHfic2-XXfM40 Sep 14 08:58:49.786913 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 08:58:49.786913 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 08:58:49.786913 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 08:58:49.786913 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 08:58:49.786913 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 08:58:49.786913 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 08:58:49.786913 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: bdb6af957c8f45e5a0996c0e4b1f456a Sep 14 08:58:49.786913 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1045298450 Sep 14 08:58:49.786913 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 08:58:49.786913 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 08:58:49.786913 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/bdb6af957c8f45e5a0996c0e4b1f456a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_bdb6af957c8f45e5a0996c0e4b1f456a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/bdb6af957c8f45e5a0996c0e4b1f456a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/bdb6af957c8f45e5a0996c0e4b1f456a"}]}] Sep 14 08:58:49.786913 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1045298450 Sep 14 08:58:49.786913 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: bdb6af957c8f45e5a0996c0e4b1f456a Sep 14 08:58:49.786913 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1045298450 Sep 14 08:58:49.786913 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-ServersAdminNegativeTestJSON-1045298450-project Sep 14 08:58:49.786913 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 08:58:49.786913 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 08:58:49.786913 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: f584701398b64fab808e3cbcc4259a32 Sep 14 08:58:49.786913 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1045298450-project Sep 14 08:58:49.786913 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 08:58:49.786913 n-d-836830-18 devstack@n-api.service[128758]: exception: Instance 5629527b-12f8-4467-85a7-976d17dd267a could not be found. Sep 14 08:58:49.786913 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': '5629527b-12f8-4467-85a7-976d17dd267a'} Sep 14 08:58:49.786913 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:58:49.786913 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:58:49.786913 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 08:58:49.786913 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 08:58:49.786913 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 08:58:49.786913 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 08:58:49.786913 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 08:58:49.786913 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 08:58:49.786913 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 08:58:49.786913 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 08:58:49.786913 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5629527b-12f8-4467-85a7-976d17dd267a could not be found. Sep 14 08:58:49.786913 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:58:49.786913 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:58:49.786913 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:58:49.786913 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:58:49.786913 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:58:49.786913 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:58:49.786913 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:58:49.786913 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:58:49.786913 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:58:49.786913 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:58:49.786913 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 08:58:49.786913 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 08:58:49.786913 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 08:58:49.786913 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 08:58:49.786913 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 08:58:49.786913 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 08:58:49.786913 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5629527b-12f8-4467-85a7-976d17dd267a could not be found. Sep 14 08:58:49.786913 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:58:49.786913 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:58:49.790697 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:58:49.790697 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:58:49.790697 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:58:49.790697 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:58:49.790697 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:58:49.790697 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:58:49.790697 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5629527b-12f8-4467-85a7-976d17dd267a could not be found. Sep 14 08:58:49.790697 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:58:49.790697 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c733fff1-0566-4847-9e44-83ea862dbeb5 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Returning 404 to user: Instance 5629527b-12f8-4467-85a7-976d17dd267a could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:58:49.790697 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-c733fff1-0566-4847-9e44-83ea862dbeb5 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] 10.222.0.60 "GET /compute/v2.1/servers/5629527b-12f8-4467-85a7-976d17dd267a" status: 404 len: 111 microversion: 2.1 time: 0.037819 Sep 14 08:58:49.792543 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1182/2314] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:58:49 2022] GET /compute/v2.1/servers/5629527b-12f8-4467-85a7-976d17dd267a => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 08:58:49.798866 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-dc7ee4f5-003d-40e5-b306-cfc2cd4aed03 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:49.799714 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-dc7ee4f5-003d-40e5-b306-cfc2cd4aed03 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] [instance: a88f52fe-95e7-46fc-b7fa-1714b4449e87] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:49.806971 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dc7ee4f5-003d-40e5-b306-cfc2cd4aed03 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:49.807465 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dc7ee4f5-003d-40e5-b306-cfc2cd4aed03 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:49.807902 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dc7ee4f5-003d-40e5-b306-cfc2cd4aed03 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:49.808884 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dc7ee4f5-003d-40e5-b306-cfc2cd4aed03 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:49.809341 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dc7ee4f5-003d-40e5-b306-cfc2cd4aed03 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:49.811586 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dc7ee4f5-003d-40e5-b306-cfc2cd4aed03 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:49.847134 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-dc7ee4f5-003d-40e5-b306-cfc2cd4aed03 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] [instance: a88f52fe-95e7-46fc-b7fa-1714b4449e87] Going to try to terminate instance {{(pid=128758) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 08:58:49.914414 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-2fa866de-c1d1-437c-ab25-fab413775556 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:49.926513 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-2fa866de-c1d1-437c-ab25-fab413775556 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/affb61a7-7e36-4424-bf48-a5a6bd64ae29" status: 200 len: 1308 microversion: 2.1 time: 0.448921 Sep 14 08:58:49.930632 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1133/2315] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:58:49 2022] GET /compute/v2.1/servers/affb61a7-7e36-4424-bf48-a5a6bd64ae29 => generated 1308 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:58:49.936314 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:58:49.987346 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-dc7ee4f5-003d-40e5-b306-cfc2cd4aed03 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] 10.222.0.60 "DELETE /compute/v2.1/servers/a88f52fe-95e7-46fc-b7fa-1714b4449e87" status: 204 len: 0 microversion: 2.1 time: 0.193200 Sep 14 08:58:49.997255 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-5f6faf22-17e4-4639-ab10-33d930dd0ecd tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:49.998059 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-5f6faf22-17e4-4639-ab10-33d930dd0ecd tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] [instance: a88f52fe-95e7-46fc-b7fa-1714b4449e87] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:50.003086 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1183/2316] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 08:58:49 2022] DELETE /compute/v2.1/servers/a88f52fe-95e7-46fc-b7fa-1714b4449e87 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 08:58:50.005265 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5f6faf22-17e4-4639-ab10-33d930dd0ecd tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:50.006198 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5f6faf22-17e4-4639-ab10-33d930dd0ecd tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:50.008405 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5f6faf22-17e4-4639-ab10-33d930dd0ecd tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:50.009235 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5f6faf22-17e4-4639-ab10-33d930dd0ecd tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:50.012185 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5f6faf22-17e4-4639-ab10-33d930dd0ecd tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:50.012838 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5f6faf22-17e4-4639-ab10-33d930dd0ecd tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:50.277393 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-3e7edfbd-2711-455e-bc12-cbcfe744c0a3 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:50.278677 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-3e7edfbd-2711-455e-bc12-cbcfe744c0a3 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] [instance: 26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:50.287522 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3e7edfbd-2711-455e-bc12-cbcfe744c0a3 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:50.288023 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3e7edfbd-2711-455e-bc12-cbcfe744c0a3 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:50.288772 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3e7edfbd-2711-455e-bc12-cbcfe744c0a3 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:50.290311 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3e7edfbd-2711-455e-bc12-cbcfe744c0a3 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:50.291293 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3e7edfbd-2711-455e-bc12-cbcfe744c0a3 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:50.291780 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3e7edfbd-2711-455e-bc12-cbcfe744c0a3 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:50.528433 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-5f6faf22-17e4-4639-ab10-33d930dd0ecd tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f584701398b64fab808e3cbcc4259a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb6af957c8f45e5a0996c0e4b1f456a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:50.538341 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-5f6faf22-17e4-4639-ab10-33d930dd0ecd tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] 10.222.0.60 "GET /compute/v2.1/servers/a88f52fe-95e7-46fc-b7fa-1714b4449e87" status: 200 len: 1478 microversion: 2.1 time: 0.544699 Sep 14 08:58:50.558036 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1134/2317] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:58:49 2022] GET /compute/v2.1/servers/a88f52fe-95e7-46fc-b7fa-1714b4449e87 => generated 1478 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:58:50.565159 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8f150e95-8bc1-4de1-9513-0d42fe5720a9 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:50.566002 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-8f150e95-8bc1-4de1-9513-0d42fe5720a9 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: d0c5547a-1340-4d19-a0f9-3e1eb9fd1932] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:50.587488 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8f150e95-8bc1-4de1-9513-0d42fe5720a9 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:50.588426 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8f150e95-8bc1-4de1-9513-0d42fe5720a9 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:50.589113 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8f150e95-8bc1-4de1-9513-0d42fe5720a9 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:50.590158 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8f150e95-8bc1-4de1-9513-0d42fe5720a9 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:50.590872 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8f150e95-8bc1-4de1-9513-0d42fe5720a9 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:50.591928 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8f150e95-8bc1-4de1-9513-0d42fe5720a9 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:50.802659 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-3e7edfbd-2711-455e-bc12-cbcfe744c0a3 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:50.813659 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-3e7edfbd-2711-455e-bc12-cbcfe744c0a3 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:50.815205 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-3e7edfbd-2711-455e-bc12-cbcfe744c0a3 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:50.817119 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-3e7edfbd-2711-455e-bc12-cbcfe744c0a3 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] 10.222.0.60 "GET /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0" status: 200 len: 1880 microversion: 2.32 time: 0.544592 Sep 14 08:58:50.817709 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1184/2318] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:58:50 2022] GET /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0 => generated 1880 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:58:50.847946 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-2f987c87-dd5b-455f-8e77-6f7fbdb4aa0d tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:50.849096 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-2f987c87-dd5b-455f-8e77-6f7fbdb4aa0d tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] [instance: 885dfd01-8bac-4691-ad0b-f2218e306f2e] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:50.855729 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2f987c87-dd5b-455f-8e77-6f7fbdb4aa0d tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:50.856835 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2f987c87-dd5b-455f-8e77-6f7fbdb4aa0d tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:50.857948 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2f987c87-dd5b-455f-8e77-6f7fbdb4aa0d tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:50.858780 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2f987c87-dd5b-455f-8e77-6f7fbdb4aa0d tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:50.859418 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2f987c87-dd5b-455f-8e77-6f7fbdb4aa0d tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:50.860304 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2f987c87-dd5b-455f-8e77-6f7fbdb4aa0d tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:51.023162 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-2f987c87-dd5b-455f-8e77-6f7fbdb4aa0d tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ab7166e40e4a908eefbfb03b3b8804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de82b83dadd541dbb4a939f2fc04a163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:51.042045 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-2f987c87-dd5b-455f-8e77-6f7fbdb4aa0d tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] 10.222.0.60 "GET /compute/v2.1/servers/885dfd01-8bac-4691-ad0b-f2218e306f2e" status: 200 len: 1299 microversion: 2.1 time: 0.208174 Sep 14 08:58:51.043258 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1185/2319] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:58:50 2022] GET /compute/v2.1/servers/885dfd01-8bac-4691-ad0b-f2218e306f2e => generated 1299 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:58:51.049299 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-1d5a8342-b6b7-447c-af6a-6c18a4eb3da2 req-32f24e19-3f47-4352-9f62-6a6bab68ba8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2098e0b9-b628-4b9e-979b-960c68830fee", "name": "network-vif-deleted", "tag": "a7cbc77d-b7b8-47d5-a1b4-d36705ecf7a0"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:58:51.070482 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-1d5a8342-b6b7-447c-af6a-6c18a4eb3da2 req-32f24e19-3f47-4352-9f62-6a6bab68ba8a service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:51.071305 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-1d5a8342-b6b7-447c-af6a-6c18a4eb3da2 req-32f24e19-3f47-4352-9f62-6a6bab68ba8a service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:51.071734 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-1d5a8342-b6b7-447c-af6a-6c18a4eb3da2 req-32f24e19-3f47-4352-9f62-6a6bab68ba8a service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:51.083648 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-8f150e95-8bc1-4de1-9513-0d42fe5720a9 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9d40e54481461cba53fedb9a6abdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed2295a58f8451993a57ce0a6f9ba29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:51.090747 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-1d5a8342-b6b7-447c-af6a-6c18a4eb3da2 req-32f24e19-3f47-4352-9f62-6a6bab68ba8a service nova] Creating event network-vif-deleted:a7cbc77d-b7b8-47d5-a1b4-d36705ecf7a0 for instance 2098e0b9-b628-4b9e-979b-960c68830fee on n-h2-836830-18 Sep 14 08:58:51.104042 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-8f150e95-8bc1-4de1-9513-0d42fe5720a9 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] 10.222.0.60 "GET /compute/v2.1/servers/d0c5547a-1340-4d19-a0f9-3e1eb9fd1932" status: 200 len: 1316 microversion: 2.1 time: 0.544061 Sep 14 08:58:51.104418 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-1d5a8342-b6b7-447c-af6a-6c18a4eb3da2 req-32f24e19-3f47-4352-9f62-6a6bab68ba8a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059330 Sep 14 08:58:51.105648 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1186/2321] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:58:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:58:51.105830 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1135/2321] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:58:50 2022] GET /compute/v2.1/servers/d0c5547a-1340-4d19-a0f9-3e1eb9fd1932 => generated 1316 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:58:51.111934 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-fd7f54cd-9683-4e2f-8c44-e962608175b1 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:51.115066 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-fd7f54cd-9683-4e2f-8c44-e962608175b1 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: 2098e0b9-b628-4b9e-979b-960c68830fee] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:51.118262 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-12abdd54-e079-474d-aff0-911fcfe60355 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:51.119403 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-12abdd54-e079-474d-aff0-911fcfe60355 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: affb61a7-7e36-4424-bf48-a5a6bd64ae29] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:51.127922 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-12abdd54-e079-474d-aff0-911fcfe60355 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:51.128742 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-12abdd54-e079-474d-aff0-911fcfe60355 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:51.129493 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-12abdd54-e079-474d-aff0-911fcfe60355 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:51.130426 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fd7f54cd-9683-4e2f-8c44-e962608175b1 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:51.130781 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-12abdd54-e079-474d-aff0-911fcfe60355 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:51.131832 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-12abdd54-e079-474d-aff0-911fcfe60355 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:51.132727 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-12abdd54-e079-474d-aff0-911fcfe60355 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:51.132971 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fd7f54cd-9683-4e2f-8c44-e962608175b1 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:51.138126 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fd7f54cd-9683-4e2f-8c44-e962608175b1 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:51.140414 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fd7f54cd-9683-4e2f-8c44-e962608175b1 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:51.142686 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fd7f54cd-9683-4e2f-8c44-e962608175b1 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:51.143283 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fd7f54cd-9683-4e2f-8c44-e962608175b1 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:51.218574 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fd7f54cd-9683-4e2f-8c44-e962608175b1 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:51.219872 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fd7f54cd-9683-4e2f-8c44-e962608175b1 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:51.220683 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fd7f54cd-9683-4e2f-8c44-e962608175b1 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:51.221518 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.objects.instance [None req-fd7f54cd-9683-4e2f-8c44-e962608175b1 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lazy-loading 'fault' on Instance uuid 2098e0b9-b628-4b9e-979b-960c68830fee {{(pid=128759) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 08:58:51.374504 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-fd7f54cd-9683-4e2f-8c44-e962608175b1 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:51.392461 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-fd7f54cd-9683-4e2f-8c44-e962608175b1 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/2098e0b9-b628-4b9e-979b-960c68830fee" status: 200 len: 1324 microversion: 2.1 time: 0.284154 Sep 14 08:58:51.394083 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1136/2322] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:58:51 2022] GET /compute/v2.1/servers/2098e0b9-b628-4b9e-979b-960c68830fee => generated 1324 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:58:51.495294 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-12abdd54-e079-474d-aff0-911fcfe60355 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:51.515202 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-12abdd54-e079-474d-aff0-911fcfe60355 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/affb61a7-7e36-4424-bf48-a5a6bd64ae29" status: 200 len: 1308 microversion: 2.1 time: 0.407741 Sep 14 08:58:51.516180 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1187/2323] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:58:51 2022] GET /compute/v2.1/servers/affb61a7-7e36-4424-bf48-a5a6bd64ae29 => generated 1308 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:58:51.566551 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-5f6df8bf-ba4c-4dd4-93ac-bdae5d6d7e75 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:51.568444 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-5f6df8bf-ba4c-4dd4-93ac-bdae5d6d7e75 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] [instance: a88f52fe-95e7-46fc-b7fa-1714b4449e87] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:51.583657 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5f6df8bf-ba4c-4dd4-93ac-bdae5d6d7e75 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:51.585251 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5f6df8bf-ba4c-4dd4-93ac-bdae5d6d7e75 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:51.585814 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5f6df8bf-ba4c-4dd4-93ac-bdae5d6d7e75 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:51.588243 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5f6df8bf-ba4c-4dd4-93ac-bdae5d6d7e75 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:51.588920 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5f6df8bf-ba4c-4dd4-93ac-bdae5d6d7e75 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:51.590333 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5f6df8bf-ba4c-4dd4-93ac-bdae5d6d7e75 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:51.609848 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-9b10bd35-1846-4ad9-951b-9c18a8ee3284 req-d83390f0-d78c-4f10-be9d-ff78291c85be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0", "name": "network-vif-plugged", "status": "completed", "tag": "0799d62c-8c0b-4879-8555-e787ef1b353f"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:58:51.638840 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-9b10bd35-1846-4ad9-951b-9c18a8ee3284 req-d83390f0-d78c-4f10-be9d-ff78291c85be service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:51.641230 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-9b10bd35-1846-4ad9-951b-9c18a8ee3284 req-d83390f0-d78c-4f10-be9d-ff78291c85be service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:51.643613 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-9b10bd35-1846-4ad9-951b-9c18a8ee3284 req-d83390f0-d78c-4f10-be9d-ff78291c85be service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:51.682810 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-9b10bd35-1846-4ad9-951b-9c18a8ee3284 req-d83390f0-d78c-4f10-be9d-ff78291c85be service nova] Creating event network-vif-plugged:0799d62c-8c0b-4879-8555-e787ef1b353f for instance 26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0 on n-h1-836830-18 Sep 14 08:58:51.699792 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-9b10bd35-1846-4ad9-951b-9c18a8ee3284 req-d83390f0-d78c-4f10-be9d-ff78291c85be service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098059 Sep 14 08:58:51.701163 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1188/2324] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:58:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:58:51.853143 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-5e032caf-942d-4b86-a95f-6376cb6ae8a0 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:51.854175 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-5e032caf-942d-4b86-a95f-6376cb6ae8a0 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] [instance: 26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:51.864332 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5e032caf-942d-4b86-a95f-6376cb6ae8a0 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:51.867121 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5e032caf-942d-4b86-a95f-6376cb6ae8a0 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:51.867121 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5e032caf-942d-4b86-a95f-6376cb6ae8a0 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:51.867121 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5e032caf-942d-4b86-a95f-6376cb6ae8a0 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:51.867811 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5e032caf-942d-4b86-a95f-6376cb6ae8a0 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:51.868446 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5e032caf-942d-4b86-a95f-6376cb6ae8a0 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:51.984584 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-5f6df8bf-ba4c-4dd4-93ac-bdae5d6d7e75 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f584701398b64fab808e3cbcc4259a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb6af957c8f45e5a0996c0e4b1f456a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:51.999125 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-5f6df8bf-ba4c-4dd4-93ac-bdae5d6d7e75 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] 10.222.0.60 "GET /compute/v2.1/servers/a88f52fe-95e7-46fc-b7fa-1714b4449e87" status: 200 len: 1478 microversion: 2.1 time: 0.436386 Sep 14 08:58:52.011621 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1137/2325] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:58:51 2022] GET /compute/v2.1/servers/a88f52fe-95e7-46fc-b7fa-1714b4449e87 => generated 1478 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:58:52.079304 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-67b2b1e4-9568-45ea-a6f5-b02f6a3b9f69 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:52.080602 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-67b2b1e4-9568-45ea-a6f5-b02f6a3b9f69 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] [instance: 885dfd01-8bac-4691-ad0b-f2218e306f2e] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:52.088485 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-67b2b1e4-9568-45ea-a6f5-b02f6a3b9f69 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:52.089586 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-67b2b1e4-9568-45ea-a6f5-b02f6a3b9f69 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:52.090620 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-67b2b1e4-9568-45ea-a6f5-b02f6a3b9f69 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:52.092231 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-67b2b1e4-9568-45ea-a6f5-b02f6a3b9f69 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:52.092998 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-67b2b1e4-9568-45ea-a6f5-b02f6a3b9f69 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:52.094356 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-67b2b1e4-9568-45ea-a6f5-b02f6a3b9f69 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:52.273930 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-5e032caf-942d-4b86-a95f-6376cb6ae8a0 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:52.285716 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-5e032caf-942d-4b86-a95f-6376cb6ae8a0 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:52.287429 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-5e032caf-942d-4b86-a95f-6376cb6ae8a0 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:52.288837 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-5e032caf-942d-4b86-a95f-6376cb6ae8a0 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] 10.222.0.60 "GET /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0" status: 200 len: 1880 microversion: 2.32 time: 0.444954 Sep 14 08:58:52.304147 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1189/2326] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:58:51 2022] GET /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0 => generated 1880 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 08:58:52.316066 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-02febc2c-bd50-4536-9d35-2d80f57c18c4 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:52.316671 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-02febc2c-bd50-4536-9d35-2d80f57c18c4 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: d0c5547a-1340-4d19-a0f9-3e1eb9fd1932] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:52.328104 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-02febc2c-bd50-4536-9d35-2d80f57c18c4 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:52.332778 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-02febc2c-bd50-4536-9d35-2d80f57c18c4 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:52.333415 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-02febc2c-bd50-4536-9d35-2d80f57c18c4 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:52.334407 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-02febc2c-bd50-4536-9d35-2d80f57c18c4 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:52.335064 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-02febc2c-bd50-4536-9d35-2d80f57c18c4 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:52.335646 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-02febc2c-bd50-4536-9d35-2d80f57c18c4 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:52.447943 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-67b2b1e4-9568-45ea-a6f5-b02f6a3b9f69 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ab7166e40e4a908eefbfb03b3b8804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de82b83dadd541dbb4a939f2fc04a163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:52.461429 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-67b2b1e4-9568-45ea-a6f5-b02f6a3b9f69 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] 10.222.0.60 "GET /compute/v2.1/servers/885dfd01-8bac-4691-ad0b-f2218e306f2e" status: 200 len: 1366 microversion: 2.1 time: 0.390666 Sep 14 08:58:52.467733 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1138/2327] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:58:52 2022] GET /compute/v2.1/servers/885dfd01-8bac-4691-ad0b-f2218e306f2e => generated 1366 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:58:52.477221 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d6f9cb3d-7d0b-4742-a704-448ec36a38c2 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:52.477855 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-d6f9cb3d-7d0b-4742-a704-448ec36a38c2 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: 2098e0b9-b628-4b9e-979b-960c68830fee] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:52.492385 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d6f9cb3d-7d0b-4742-a704-448ec36a38c2 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:52.492897 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d6f9cb3d-7d0b-4742-a704-448ec36a38c2 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:52.493358 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d6f9cb3d-7d0b-4742-a704-448ec36a38c2 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:52.494094 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d6f9cb3d-7d0b-4742-a704-448ec36a38c2 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:52.494561 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d6f9cb3d-7d0b-4742-a704-448ec36a38c2 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:52.500307 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d6f9cb3d-7d0b-4742-a704-448ec36a38c2 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:52.540045 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-d6f9cb3d-7d0b-4742-a704-448ec36a38c2 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] HTTP exception thrown: Instance 2098e0b9-b628-4b9e-979b-960c68830fee could not be found. Sep 14 08:58:52.542231 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d6f9cb3d-7d0b-4742-a704-448ec36a38c2 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Request method failure captured: Sep 14 08:58:52.542231 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/2098e0b9-b628-4b9e-979b-960c68830fee HTTP/1.1 Sep 14 08:58:52.542231 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 08:58:52.542231 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 08:58:52.542231 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 08:58:52.542231 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 08:58:52.542231 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 08:58:52.542231 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 08:58:52.542231 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 08:58:52.542231 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 08:58:52.542231 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZW95b9fRr0E8bmSYM4S4lx9RiOfMr3cO7rblfxvOYjE7-JF30wAZsjQevo3rJUWAD3qTMdAvcdDZSED6vnvXWkl-NZqWaQ1NpJszbVtZlHL-LyTQfjvCcAn-ta76aZv2KZ5I1yoLILYoyMC8sk6rSQDq_-WLamtcU7SEoA-kKfdsWk Sep 14 08:58:52.542231 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 08:58:52.542231 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 08:58:52.542231 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 08:58:52.542231 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 08:58:52.542231 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 08:58:52.542231 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 08:58:52.542231 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: a7342631eeb747ba831f1d8a20fb8bf3 Sep 14 08:58:52.542231 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-LiveMigrationTest-14808698 Sep 14 08:58:52.542231 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 08:58:52.542231 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 08:58:52.542231 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a7342631eeb747ba831f1d8a20fb8bf3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a7342631eeb747ba831f1d8a20fb8bf3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a7342631eeb747ba831f1d8a20fb8bf3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a7342631eeb747ba831f1d8a20fb8bf3"}]}] Sep 14 08:58:52.542231 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-LiveMigrationTest-14808698 Sep 14 08:58:52.542231 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: a7342631eeb747ba831f1d8a20fb8bf3 Sep 14 08:58:52.542231 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-LiveMigrationTest-14808698 Sep 14 08:58:52.542231 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-LiveMigrationTest-14808698-project Sep 14 08:58:52.542231 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 08:58:52.542231 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 08:58:52.542231 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: cd713a1c3e7148ef8bfcbe44d1a80a18 Sep 14 08:58:52.542231 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-LiveMigrationTest-14808698-project Sep 14 08:58:52.542231 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 08:58:52.542231 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance 2098e0b9-b628-4b9e-979b-960c68830fee could not be found. Sep 14 08:58:52.542231 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '2098e0b9-b628-4b9e-979b-960c68830fee'} Sep 14 08:58:52.542231 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:58:52.542231 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:58:52.542231 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 08:58:52.542231 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 08:58:52.542231 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 08:58:52.542231 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 08:58:52.542231 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 08:58:52.542231 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 08:58:52.542231 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 08:58:52.542231 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 08:58:52.542231 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2098e0b9-b628-4b9e-979b-960c68830fee could not be found. Sep 14 08:58:52.542231 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:58:52.542231 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:58:52.542231 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:58:52.542231 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:58:52.542231 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:58:52.542231 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:58:52.542231 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:58:52.542231 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:58:52.542231 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:58:52.542231 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:58:52.542231 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 08:58:52.542231 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 08:58:52.542231 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 08:58:52.542231 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 08:58:52.542231 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 08:58:52.542231 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 08:58:52.542231 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2098e0b9-b628-4b9e-979b-960c68830fee could not be found. Sep 14 08:58:52.542231 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:58:52.542231 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:58:52.542231 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:58:52.548616 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:58:52.548616 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:58:52.548616 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:58:52.548616 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:58:52.548616 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:58:52.548616 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2098e0b9-b628-4b9e-979b-960c68830fee could not be found. Sep 14 08:58:52.548616 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:58:52.551978 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d6f9cb3d-7d0b-4742-a704-448ec36a38c2 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Returning 404 to user: Instance 2098e0b9-b628-4b9e-979b-960c68830fee could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:58:52.562359 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d6f9cb3d-7d0b-4742-a704-448ec36a38c2 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/2098e0b9-b628-4b9e-979b-960c68830fee" status: 404 len: 111 microversion: 2.1 time: 0.091463 Sep 14 08:58:52.584392 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1139/2328] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:58:52 2022] GET /compute/v2.1/servers/2098e0b9-b628-4b9e-979b-960c68830fee => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 08:58:52.601426 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-49580a06-c937-425c-b78a-3d107b0bc158 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:52.607867 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-49580a06-c937-425c-b78a-3d107b0bc158 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: affb61a7-7e36-4424-bf48-a5a6bd64ae29] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:52.618554 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-49580a06-c937-425c-b78a-3d107b0bc158 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:52.619483 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-49580a06-c937-425c-b78a-3d107b0bc158 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:52.621482 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-49580a06-c937-425c-b78a-3d107b0bc158 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:52.630208 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-49580a06-c937-425c-b78a-3d107b0bc158 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:52.632490 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-49580a06-c937-425c-b78a-3d107b0bc158 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:52.635595 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-49580a06-c937-425c-b78a-3d107b0bc158 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:52.798903 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-02febc2c-bd50-4536-9d35-2d80f57c18c4 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9d40e54481461cba53fedb9a6abdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed2295a58f8451993a57ce0a6f9ba29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:52.809892 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-02febc2c-bd50-4536-9d35-2d80f57c18c4 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] 10.222.0.60 "GET /compute/v2.1/servers/d0c5547a-1340-4d19-a0f9-3e1eb9fd1932" status: 200 len: 1316 microversion: 2.1 time: 0.504385 Sep 14 08:58:52.816207 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1190/2329] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:58:52 2022] GET /compute/v2.1/servers/d0c5547a-1340-4d19-a0f9-3e1eb9fd1932 => generated 1316 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:58:52.826911 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-f4f9ced2-78c9-4698-beae-0b1bea5df00c tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '.version_select at 0x7f7d4865c160>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:52.866021 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-f4f9ced2-78c9-4698-beae-0b1bea5df00c tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-384781694" status: 202 len: 0 microversion: 2.1 time: 0.048630 Sep 14 08:58:52.866626 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1191/2330] 10.222.0.60 () {58 vars in 1218 bytes} [Wed Sep 14 08:58:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-384781694 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 08:58:52.997243 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-49580a06-c937-425c-b78a-3d107b0bc158 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:53.017010 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-49580a06-c937-425c-b78a-3d107b0bc158 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/affb61a7-7e36-4424-bf48-a5a6bd64ae29" status: 200 len: 1308 microversion: 2.1 time: 0.430768 Sep 14 08:58:53.017810 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1140/2331] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:58:52 2022] GET /compute/v2.1/servers/affb61a7-7e36-4424-bf48-a5a6bd64ae29 => generated 1308 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:58:53.024210 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ba6322f4-f4f9-4c4d-a2f9-b650d8a37118 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:53.025190 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-ba6322f4-f4f9-4c4d-a2f9-b650d8a37118 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] [instance: a88f52fe-95e7-46fc-b7fa-1714b4449e87] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:53.041384 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ba6322f4-f4f9-4c4d-a2f9-b650d8a37118 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:53.045054 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ba6322f4-f4f9-4c4d-a2f9-b650d8a37118 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:53.047974 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ba6322f4-f4f9-4c4d-a2f9-b650d8a37118 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:53.054368 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ba6322f4-f4f9-4c4d-a2f9-b650d8a37118 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:53.055515 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ba6322f4-f4f9-4c4d-a2f9-b650d8a37118 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:53.057310 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ba6322f4-f4f9-4c4d-a2f9-b650d8a37118 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:53.106775 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ba6322f4-f4f9-4c4d-a2f9-b650d8a37118 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:53.107998 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ba6322f4-f4f9-4c4d-a2f9-b650d8a37118 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:53.108501 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ba6322f4-f4f9-4c4d-a2f9-b650d8a37118 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:53.121251 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.objects.instance [None req-ba6322f4-f4f9-4c4d-a2f9-b650d8a37118 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Lazy-loading 'fault' on Instance uuid a88f52fe-95e7-46fc-b7fa-1714b4449e87 {{(pid=128758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 08:58:53.157988 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-a8bd4414-df0f-453d-ab60-cd49d7add137 req-bb8e7a9e-d7e7-4cbf-9528-ec3e366fcd02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a88f52fe-95e7-46fc-b7fa-1714b4449e87", "name": "network-vif-deleted", "tag": "e6980208-76a5-417f-a7d6-0df07d29b6f2"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:58:53.181196 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-a8bd4414-df0f-453d-ab60-cd49d7add137 req-bb8e7a9e-d7e7-4cbf-9528-ec3e366fcd02 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:53.183770 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-a8bd4414-df0f-453d-ab60-cd49d7add137 req-bb8e7a9e-d7e7-4cbf-9528-ec3e366fcd02 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:53.184294 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-a8bd4414-df0f-453d-ab60-cd49d7add137 req-bb8e7a9e-d7e7-4cbf-9528-ec3e366fcd02 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:53.210655 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-a8bd4414-df0f-453d-ab60-cd49d7add137 req-bb8e7a9e-d7e7-4cbf-9528-ec3e366fcd02 service nova] Creating event network-vif-deleted:e6980208-76a5-417f-a7d6-0df07d29b6f2 for instance a88f52fe-95e7-46fc-b7fa-1714b4449e87 on n-h2-836830-18 Sep 14 08:58:53.216207 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-a8bd4414-df0f-453d-ab60-cd49d7add137 req-bb8e7a9e-d7e7-4cbf-9528-ec3e366fcd02 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062862 Sep 14 08:58:53.216874 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1141/2332] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:58:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 08:58:53.292292 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-ba6322f4-f4f9-4c4d-a2f9-b650d8a37118 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f584701398b64fab808e3cbcc4259a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb6af957c8f45e5a0996c0e4b1f456a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:53.304517 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-ba6322f4-f4f9-4c4d-a2f9-b650d8a37118 tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] 10.222.0.60 "GET /compute/v2.1/servers/a88f52fe-95e7-46fc-b7fa-1714b4449e87" status: 200 len: 1312 microversion: 2.1 time: 0.284301 Sep 14 08:58:53.308639 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1192/2333] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:58:53 2022] GET /compute/v2.1/servers/a88f52fe-95e7-46fc-b7fa-1714b4449e87 => generated 1312 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:58:53.324421 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-1e52fbb2-d737-488c-8120-44f61cd5e6cb tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:53.325269 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-1e52fbb2-d737-488c-8120-44f61cd5e6cb tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] [instance: 26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:53.344709 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-1d9074b5-3469-41f2-934b-382ec0a81e17 req-dc2bda7b-9130-487b-9742-158b8829a7a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "885dfd01-8bac-4691-ad0b-f2218e306f2e", "tag": "7a58cd39-a33e-4a69-ac2a-b45bd18e6b98"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:58:53.346607 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1e52fbb2-d737-488c-8120-44f61cd5e6cb tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:53.348080 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1e52fbb2-d737-488c-8120-44f61cd5e6cb tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:53.348591 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1e52fbb2-d737-488c-8120-44f61cd5e6cb tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:53.349378 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1e52fbb2-d737-488c-8120-44f61cd5e6cb tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:53.349852 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1e52fbb2-d737-488c-8120-44f61cd5e6cb tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:53.350288 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1e52fbb2-d737-488c-8120-44f61cd5e6cb tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:53.361831 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-1d9074b5-3469-41f2-934b-382ec0a81e17 req-dc2bda7b-9130-487b-9742-158b8829a7a9 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:53.362696 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-1d9074b5-3469-41f2-934b-382ec0a81e17 req-dc2bda7b-9130-487b-9742-158b8829a7a9 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:53.364382 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-1d9074b5-3469-41f2-934b-382ec0a81e17 req-dc2bda7b-9130-487b-9742-158b8829a7a9 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:53.383259 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-1d9074b5-3469-41f2-934b-382ec0a81e17 req-dc2bda7b-9130-487b-9742-158b8829a7a9 service nova] Creating event network-changed:7a58cd39-a33e-4a69-ac2a-b45bd18e6b98 for instance 885dfd01-8bac-4691-ad0b-f2218e306f2e on n-h1-836830-18 Sep 14 08:58:53.393986 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-1d9074b5-3469-41f2-934b-382ec0a81e17 req-dc2bda7b-9130-487b-9742-158b8829a7a9 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058596 Sep 14 08:58:53.395569 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1193/2334] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:58:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:58:53.489586 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-91cbc4fd-a183-4d16-8278-f7bb8ce58aba tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:53.491040 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-91cbc4fd-a183-4d16-8278-f7bb8ce58aba tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] [instance: 885dfd01-8bac-4691-ad0b-f2218e306f2e] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:53.499354 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-91cbc4fd-a183-4d16-8278-f7bb8ce58aba tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:53.500300 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-91cbc4fd-a183-4d16-8278-f7bb8ce58aba tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:53.500805 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-91cbc4fd-a183-4d16-8278-f7bb8ce58aba tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:53.501841 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-91cbc4fd-a183-4d16-8278-f7bb8ce58aba tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:53.502290 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-91cbc4fd-a183-4d16-8278-f7bb8ce58aba tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:53.502710 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-91cbc4fd-a183-4d16-8278-f7bb8ce58aba tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:53.538436 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=4 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:58:53.625768 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=12 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:58:54.130303 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-91cbc4fd-a183-4d16-8278-f7bb8ce58aba tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ab7166e40e4a908eefbfb03b3b8804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de82b83dadd541dbb4a939f2fc04a163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:54.139332 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-91cbc4fd-a183-4d16-8278-f7bb8ce58aba tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] 10.222.0.60 "GET /compute/v2.1/servers/885dfd01-8bac-4691-ad0b-f2218e306f2e" status: 200 len: 1366 microversion: 2.1 time: 0.654706 Sep 14 08:58:54.140446 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1194/2335] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:58:53 2022] GET /compute/v2.1/servers/885dfd01-8bac-4691-ad0b-f2218e306f2e => generated 1366 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:58:54.146255 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ab90ab00-5759-4bb8-b345-def820fbe0e5 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:54.147226 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-ab90ab00-5759-4bb8-b345-def820fbe0e5 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: d0c5547a-1340-4d19-a0f9-3e1eb9fd1932] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:54.154122 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-1e52fbb2-d737-488c-8120-44f61cd5e6cb tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:54.162039 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ab90ab00-5759-4bb8-b345-def820fbe0e5 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:54.162832 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ab90ab00-5759-4bb8-b345-def820fbe0e5 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:54.163756 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ab90ab00-5759-4bb8-b345-def820fbe0e5 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:54.164645 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ab90ab00-5759-4bb8-b345-def820fbe0e5 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:54.165106 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ab90ab00-5759-4bb8-b345-def820fbe0e5 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:54.165729 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ab90ab00-5759-4bb8-b345-def820fbe0e5 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:54.165851 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-1e52fbb2-d737-488c-8120-44f61cd5e6cb tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:54.167387 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-1e52fbb2-d737-488c-8120-44f61cd5e6cb tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:54.168685 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-1e52fbb2-d737-488c-8120-44f61cd5e6cb tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] 10.222.0.60 "GET /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0" status: 200 len: 1880 microversion: 2.32 time: 0.851603 Sep 14 08:58:54.169884 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1142/2336] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:58:53 2022] GET /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0 => generated 1880 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:58:54.175736 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-5e0192df-50d6-499e-97eb-f10d7a065ed8 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:54.176336 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-5e0192df-50d6-499e-97eb-f10d7a065ed8 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: 874205eb-5321-4a9a-aa38-3cd83b2ac1a3] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:54.183500 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5e0192df-50d6-499e-97eb-f10d7a065ed8 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:54.184193 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5e0192df-50d6-499e-97eb-f10d7a065ed8 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:54.185011 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5e0192df-50d6-499e-97eb-f10d7a065ed8 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:54.186648 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5e0192df-50d6-499e-97eb-f10d7a065ed8 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:54.187389 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5e0192df-50d6-499e-97eb-f10d7a065ed8 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:54.187955 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5e0192df-50d6-499e-97eb-f10d7a065ed8 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:54.216696 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-5e0192df-50d6-499e-97eb-f10d7a065ed8 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: 874205eb-5321-4a9a-aa38-3cd83b2ac1a3] Going to try to terminate instance {{(pid=128759) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 08:58:54.308008 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-5e0192df-50d6-499e-97eb-f10d7a065ed8 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "DELETE /compute/v2.1/servers/874205eb-5321-4a9a-aa38-3cd83b2ac1a3" status: 204 len: 0 microversion: 2.1 time: 0.134826 Sep 14 08:58:54.312444 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1143/2337] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 08:58:54 2022] DELETE /compute/v2.1/servers/874205eb-5321-4a9a-aa38-3cd83b2ac1a3 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 08:58:54.316249 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d98a783f-c872-4bf9-9727-e811dab2af7a tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:54.317067 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-d98a783f-c872-4bf9-9727-e811dab2af7a tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: affb61a7-7e36-4424-bf48-a5a6bd64ae29] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:54.324593 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d98a783f-c872-4bf9-9727-e811dab2af7a tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:54.326869 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d98a783f-c872-4bf9-9727-e811dab2af7a tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:54.326869 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d98a783f-c872-4bf9-9727-e811dab2af7a tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:54.326869 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d98a783f-c872-4bf9-9727-e811dab2af7a tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:54.327981 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d98a783f-c872-4bf9-9727-e811dab2af7a tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:54.327981 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d98a783f-c872-4bf9-9727-e811dab2af7a tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:54.526569 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-ab90ab00-5759-4bb8-b345-def820fbe0e5 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9d40e54481461cba53fedb9a6abdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed2295a58f8451993a57ce0a6f9ba29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:54.535795 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-ab90ab00-5759-4bb8-b345-def820fbe0e5 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] 10.222.0.60 "GET /compute/v2.1/servers/d0c5547a-1340-4d19-a0f9-3e1eb9fd1932" status: 200 len: 1316 microversion: 2.1 time: 0.393988 Sep 14 08:58:54.536386 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1195/2338] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:58:54 2022] GET /compute/v2.1/servers/d0c5547a-1340-4d19-a0f9-3e1eb9fd1932 => generated 1316 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:58:54.540958 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-70a10395-10a6-482b-99b1-5c6734016783 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:54.541575 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-70a10395-10a6-482b-99b1-5c6734016783 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: 874205eb-5321-4a9a-aa38-3cd83b2ac1a3] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:54.548000 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-70a10395-10a6-482b-99b1-5c6734016783 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:54.548496 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-70a10395-10a6-482b-99b1-5c6734016783 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:54.548997 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-70a10395-10a6-482b-99b1-5c6734016783 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:54.549790 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-70a10395-10a6-482b-99b1-5c6734016783 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:54.550253 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-70a10395-10a6-482b-99b1-5c6734016783 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:54.550689 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-70a10395-10a6-482b-99b1-5c6734016783 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:54.558632 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=16 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:58:54.785853 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-d98a783f-c872-4bf9-9727-e811dab2af7a tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:54.788260 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:58:54.795831 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d98a783f-c872-4bf9-9727-e811dab2af7a tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/affb61a7-7e36-4424-bf48-a5a6bd64ae29" status: 200 len: 1308 microversion: 2.1 time: 0.485295 Sep 14 08:58:54.796410 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1144/2339] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:58:54 2022] GET /compute/v2.1/servers/affb61a7-7e36-4424-bf48-a5a6bd64ae29 => generated 1308 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:58:54.801368 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-64fac6ed-7b55-477b-a6d3-be4942d5ee1e tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:54.802153 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-64fac6ed-7b55-477b-a6d3-be4942d5ee1e tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] [instance: a88f52fe-95e7-46fc-b7fa-1714b4449e87] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:54.809136 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-64fac6ed-7b55-477b-a6d3-be4942d5ee1e tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:54.809815 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-64fac6ed-7b55-477b-a6d3-be4942d5ee1e tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:54.810558 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-64fac6ed-7b55-477b-a6d3-be4942d5ee1e tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:54.811436 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-64fac6ed-7b55-477b-a6d3-be4942d5ee1e tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:54.812048 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-64fac6ed-7b55-477b-a6d3-be4942d5ee1e tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:54.812654 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-64fac6ed-7b55-477b-a6d3-be4942d5ee1e tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:54.836408 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-64fac6ed-7b55-477b-a6d3-be4942d5ee1e tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] HTTP exception thrown: Instance a88f52fe-95e7-46fc-b7fa-1714b4449e87 could not be found. Sep 14 08:58:54.838202 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-64fac6ed-7b55-477b-a6d3-be4942d5ee1e tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Request method failure captured: Sep 14 08:58:54.838202 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/a88f52fe-95e7-46fc-b7fa-1714b4449e87 HTTP/1.1 Sep 14 08:58:54.838202 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 08:58:54.838202 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 08:58:54.838202 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 08:58:54.838202 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 08:58:54.838202 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 08:58:54.838202 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 08:58:54.838202 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 08:58:54.838202 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 08:58:54.838202 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZeTJinJdQoafkRHiIkmaEV3_D36xrTThn9aAaFe4fPyhOzYFcqEFeKdHxTspH7UL_EirXcZXJwMbKiWZMJlYDfgpcPoA9fFMjeUMT9wAQ7Lg7msNi91tfsdf1NFJHnI9Rz6UqC4sPcmrLrIOgSEgbVX2wrfTsmFowNHfic2-XXfM40 Sep 14 08:58:54.838202 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 08:58:54.838202 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 08:58:54.838202 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 08:58:54.838202 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 08:58:54.838202 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 08:58:54.838202 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 08:58:54.838202 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: bdb6af957c8f45e5a0996c0e4b1f456a Sep 14 08:58:54.838202 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1045298450 Sep 14 08:58:54.838202 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 08:58:54.838202 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 08:58:54.838202 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/bdb6af957c8f45e5a0996c0e4b1f456a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_bdb6af957c8f45e5a0996c0e4b1f456a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/bdb6af957c8f45e5a0996c0e4b1f456a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/bdb6af957c8f45e5a0996c0e4b1f456a"}]}] Sep 14 08:58:54.838202 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1045298450 Sep 14 08:58:54.838202 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: bdb6af957c8f45e5a0996c0e4b1f456a Sep 14 08:58:54.838202 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1045298450 Sep 14 08:58:54.838202 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ServersAdminNegativeTestJSON-1045298450-project Sep 14 08:58:54.838202 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 08:58:54.838202 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 08:58:54.838202 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: f584701398b64fab808e3cbcc4259a32 Sep 14 08:58:54.838202 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1045298450-project Sep 14 08:58:54.838202 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 08:58:54.838202 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance a88f52fe-95e7-46fc-b7fa-1714b4449e87 could not be found. Sep 14 08:58:54.838202 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': 'a88f52fe-95e7-46fc-b7fa-1714b4449e87'} Sep 14 08:58:54.838202 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:58:54.838202 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:58:54.838202 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 08:58:54.838202 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 08:58:54.838202 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 08:58:54.838202 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 08:58:54.838202 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 08:58:54.838202 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 08:58:54.838202 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 08:58:54.838202 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 08:58:54.838202 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a88f52fe-95e7-46fc-b7fa-1714b4449e87 could not be found. Sep 14 08:58:54.838202 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:58:54.838202 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:58:54.838202 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:58:54.838202 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:58:54.838202 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:58:54.838202 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:58:54.838202 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:58:54.838202 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:58:54.838202 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:58:54.838202 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:58:54.838202 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 08:58:54.838202 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 08:58:54.838202 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 08:58:54.838202 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 08:58:54.838202 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 08:58:54.838202 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 08:58:54.838202 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a88f52fe-95e7-46fc-b7fa-1714b4449e87 could not be found. Sep 14 08:58:54.838202 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:58:54.838202 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:58:54.843055 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:58:54.843055 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:58:54.843055 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:58:54.843055 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:58:54.843055 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:58:54.843055 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:58:54.843055 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a88f52fe-95e7-46fc-b7fa-1714b4449e87 could not be found. Sep 14 08:58:54.843055 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:58:54.844370 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-64fac6ed-7b55-477b-a6d3-be4942d5ee1e tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] Returning 404 to user: Instance a88f52fe-95e7-46fc-b7fa-1714b4449e87 could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:58:54.845376 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-64fac6ed-7b55-477b-a6d3-be4942d5ee1e tempest-ServersAdminNegativeTestJSON-1045298450 tempest-ServersAdminNegativeTestJSON-1045298450-project] 10.222.0.60 "GET /compute/v2.1/servers/a88f52fe-95e7-46fc-b7fa-1714b4449e87" status: 404 len: 111 microversion: 2.1 time: 0.047866 Sep 14 08:58:54.845949 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1145/2340] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:58:54 2022] GET /compute/v2.1/servers/a88f52fe-95e7-46fc-b7fa-1714b4449e87 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 08:58:54.901961 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-70a10395-10a6-482b-99b1-5c6734016783 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:54.913504 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-70a10395-10a6-482b-99b1-5c6734016783 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/874205eb-5321-4a9a-aa38-3cd83b2ac1a3" status: 200 len: 1484 microversion: 2.1 time: 0.376025 Sep 14 08:58:54.915545 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1196/2341] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:58:54 2022] GET /compute/v2.1/servers/874205eb-5321-4a9a-aa38-3cd83b2ac1a3 => generated 1484 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:58:55.167021 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-357c9eb2-b269-404e-b89b-b01fc53166b8 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:55.168689 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-357c9eb2-b269-404e-b89b-b01fc53166b8 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] [instance: 885dfd01-8bac-4691-ad0b-f2218e306f2e] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:55.180284 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-357c9eb2-b269-404e-b89b-b01fc53166b8 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:55.182232 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-357c9eb2-b269-404e-b89b-b01fc53166b8 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:55.182971 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-357c9eb2-b269-404e-b89b-b01fc53166b8 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:55.183981 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-357c9eb2-b269-404e-b89b-b01fc53166b8 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:55.184598 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-357c9eb2-b269-404e-b89b-b01fc53166b8 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:55.185559 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-357c9eb2-b269-404e-b89b-b01fc53166b8 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:55.203635 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-2cd1657d-7ec0-4725-8606-4664d6a66b12 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:55.204873 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-2cd1657d-7ec0-4725-8606-4664d6a66b12 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] [instance: 26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:55.216572 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2cd1657d-7ec0-4725-8606-4664d6a66b12 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:55.217930 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2cd1657d-7ec0-4725-8606-4664d6a66b12 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:55.218386 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2cd1657d-7ec0-4725-8606-4664d6a66b12 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:55.219146 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2cd1657d-7ec0-4725-8606-4664d6a66b12 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:55.219612 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2cd1657d-7ec0-4725-8606-4664d6a66b12 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:55.220044 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2cd1657d-7ec0-4725-8606-4664d6a66b12 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:55.547015 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-357c9eb2-b269-404e-b89b-b01fc53166b8 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ab7166e40e4a908eefbfb03b3b8804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de82b83dadd541dbb4a939f2fc04a163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:55.558042 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-357c9eb2-b269-404e-b89b-b01fc53166b8 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] 10.222.0.60 "GET /compute/v2.1/servers/885dfd01-8bac-4691-ad0b-f2218e306f2e" status: 200 len: 1366 microversion: 2.1 time: 0.396859 Sep 14 08:58:55.564206 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1146/2342] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:58:55 2022] GET /compute/v2.1/servers/885dfd01-8bac-4691-ad0b-f2218e306f2e => generated 1366 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:58:55.569555 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-9ba5a91e-974e-440d-8a02-6893bae3881e req-28d8c63e-79a5-4f47-ab23-5dd979118752 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "874205eb-5321-4a9a-aa38-3cd83b2ac1a3", "name": "network-vif-deleted", "tag": "629e6ee9-90f6-4562-b850-5f55a39582b9"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:58:55.579858 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-9ba5a91e-974e-440d-8a02-6893bae3881e req-28d8c63e-79a5-4f47-ab23-5dd979118752 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:55.580570 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-9ba5a91e-974e-440d-8a02-6893bae3881e req-28d8c63e-79a5-4f47-ab23-5dd979118752 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:55.581173 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-9ba5a91e-974e-440d-8a02-6893bae3881e req-28d8c63e-79a5-4f47-ab23-5dd979118752 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:55.593367 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-2cd1657d-7ec0-4725-8606-4664d6a66b12 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:55.596774 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-9ba5a91e-974e-440d-8a02-6893bae3881e req-28d8c63e-79a5-4f47-ab23-5dd979118752 service nova] Creating event network-vif-deleted:629e6ee9-90f6-4562-b850-5f55a39582b9 for instance 874205eb-5321-4a9a-aa38-3cd83b2ac1a3 on n-h2-836830-18 Sep 14 08:58:55.601687 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-9ba5a91e-974e-440d-8a02-6893bae3881e req-28d8c63e-79a5-4f47-ab23-5dd979118752 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036094 Sep 14 08:58:55.602960 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1147/2343] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:58:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:58:55.609378 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-19fd13e9-3752-4bf0-b06b-37d5091d1f96 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:55.609727 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-2cd1657d-7ec0-4725-8606-4664d6a66b12 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:55.610548 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-19fd13e9-3752-4bf0-b06b-37d5091d1f96 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: d0c5547a-1340-4d19-a0f9-3e1eb9fd1932] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:55.611250 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-2cd1657d-7ec0-4725-8606-4664d6a66b12 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:55.612381 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-2cd1657d-7ec0-4725-8606-4664d6a66b12 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] 10.222.0.60 "GET /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0" status: 200 len: 1880 microversion: 2.32 time: 0.415667 Sep 14 08:58:55.616819 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1197/2344] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:58:55 2022] GET /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0 => generated 1880 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:58:55.619594 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-19fd13e9-3752-4bf0-b06b-37d5091d1f96 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:55.620337 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-19fd13e9-3752-4bf0-b06b-37d5091d1f96 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:55.621005 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-19fd13e9-3752-4bf0-b06b-37d5091d1f96 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:55.622017 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-19fd13e9-3752-4bf0-b06b-37d5091d1f96 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:55.623297 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-19fd13e9-3752-4bf0-b06b-37d5091d1f96 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:55.624010 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-19fd13e9-3752-4bf0-b06b-37d5091d1f96 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:55.822354 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a5d6a986-783d-4ae1-bd4f-4ecb4bef690e tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:55.823037 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-a5d6a986-783d-4ae1-bd4f-4ecb4bef690e tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: affb61a7-7e36-4424-bf48-a5a6bd64ae29] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:55.831771 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a5d6a986-783d-4ae1-bd4f-4ecb4bef690e tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:55.832611 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a5d6a986-783d-4ae1-bd4f-4ecb4bef690e tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:55.833047 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a5d6a986-783d-4ae1-bd4f-4ecb4bef690e tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:55.834117 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a5d6a986-783d-4ae1-bd4f-4ecb4bef690e tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:55.834737 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a5d6a986-783d-4ae1-bd4f-4ecb4bef690e tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:55.835408 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a5d6a986-783d-4ae1-bd4f-4ecb4bef690e tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:55.975251 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-19fd13e9-3752-4bf0-b06b-37d5091d1f96 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9d40e54481461cba53fedb9a6abdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed2295a58f8451993a57ce0a6f9ba29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:55.992894 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-19fd13e9-3752-4bf0-b06b-37d5091d1f96 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] 10.222.0.60 "GET /compute/v2.1/servers/d0c5547a-1340-4d19-a0f9-3e1eb9fd1932" status: 200 len: 1316 microversion: 2.1 time: 0.388436 Sep 14 08:58:55.994248 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1148/2345] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:58:55 2022] GET /compute/v2.1/servers/d0c5547a-1340-4d19-a0f9-3e1eb9fd1932 => generated 1316 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:58:56.014208 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-5d16a779-e6a9-4349-8e8d-33bbaf8d9367 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:56.014848 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-5d16a779-e6a9-4349-8e8d-33bbaf8d9367 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: 874205eb-5321-4a9a-aa38-3cd83b2ac1a3] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:56.022968 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5d16a779-e6a9-4349-8e8d-33bbaf8d9367 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:56.022968 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5d16a779-e6a9-4349-8e8d-33bbaf8d9367 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:56.022968 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5d16a779-e6a9-4349-8e8d-33bbaf8d9367 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:56.022968 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5d16a779-e6a9-4349-8e8d-33bbaf8d9367 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:56.023329 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5d16a779-e6a9-4349-8e8d-33bbaf8d9367 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:56.023696 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5d16a779-e6a9-4349-8e8d-33bbaf8d9367 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:56.066091 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5d16a779-e6a9-4349-8e8d-33bbaf8d9367 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:56.067495 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5d16a779-e6a9-4349-8e8d-33bbaf8d9367 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:56.068103 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5d16a779-e6a9-4349-8e8d-33bbaf8d9367 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:56.068745 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.objects.instance [None req-5d16a779-e6a9-4349-8e8d-33bbaf8d9367 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lazy-loading 'fault' on Instance uuid 874205eb-5321-4a9a-aa38-3cd83b2ac1a3 {{(pid=128759) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 08:58:56.163688 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-5d16a779-e6a9-4349-8e8d-33bbaf8d9367 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:56.171398 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-5d16a779-e6a9-4349-8e8d-33bbaf8d9367 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/874205eb-5321-4a9a-aa38-3cd83b2ac1a3" status: 200 len: 1300 microversion: 2.1 time: 0.165324 Sep 14 08:58:56.183261 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1149/2346] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:58:55 2022] GET /compute/v2.1/servers/874205eb-5321-4a9a-aa38-3cd83b2ac1a3 => generated 1300 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:58:56.183712 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-a5d6a986-783d-4ae1-bd4f-4ecb4bef690e tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:56.194209 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-a5d6a986-783d-4ae1-bd4f-4ecb4bef690e tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/affb61a7-7e36-4424-bf48-a5a6bd64ae29" status: 200 len: 1308 microversion: 2.1 time: 0.376020 Sep 14 08:58:56.199820 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1198/2347] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:58:55 2022] GET /compute/v2.1/servers/affb61a7-7e36-4424-bf48-a5a6bd64ae29 => generated 1308 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:58:56.585664 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-59680aa0-addc-4690-809a-6abe45e2a63d tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:56.586294 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-59680aa0-addc-4690-809a-6abe45e2a63d tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] [instance: 885dfd01-8bac-4691-ad0b-f2218e306f2e] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:56.593481 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-59680aa0-addc-4690-809a-6abe45e2a63d tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:56.593972 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-59680aa0-addc-4690-809a-6abe45e2a63d tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:56.594591 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-59680aa0-addc-4690-809a-6abe45e2a63d tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:56.595562 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-59680aa0-addc-4690-809a-6abe45e2a63d tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:56.596178 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-59680aa0-addc-4690-809a-6abe45e2a63d tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:56.596877 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-59680aa0-addc-4690-809a-6abe45e2a63d tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:56.645510 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-403dc826-1005-4afc-855b-64d0264fea8f tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:56.649869 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-403dc826-1005-4afc-855b-64d0264fea8f tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] [instance: 26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:56.662286 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-403dc826-1005-4afc-855b-64d0264fea8f tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:56.665494 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-403dc826-1005-4afc-855b-64d0264fea8f tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:56.666227 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-403dc826-1005-4afc-855b-64d0264fea8f tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:56.673844 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-403dc826-1005-4afc-855b-64d0264fea8f tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:56.674719 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-403dc826-1005-4afc-855b-64d0264fea8f tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:56.675630 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-403dc826-1005-4afc-855b-64d0264fea8f tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:57.218912 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-59680aa0-addc-4690-809a-6abe45e2a63d tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ab7166e40e4a908eefbfb03b3b8804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de82b83dadd541dbb4a939f2fc04a163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:57.230030 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-59680aa0-addc-4690-809a-6abe45e2a63d tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] 10.222.0.60 "GET /compute/v2.1/servers/885dfd01-8bac-4691-ad0b-f2218e306f2e" status: 200 len: 1366 microversion: 2.1 time: 0.647982 Sep 14 08:58:57.241651 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1150/2348] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:58:56 2022] GET /compute/v2.1/servers/885dfd01-8bac-4691-ad0b-f2218e306f2e => generated 1366 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:58:57.241651 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c4c384e3-97dc-42e1-8f20-d96c056e5b50 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:57.241651 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-c4c384e3-97dc-42e1-8f20-d96c056e5b50 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: d0c5547a-1340-4d19-a0f9-3e1eb9fd1932] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:57.249316 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c4c384e3-97dc-42e1-8f20-d96c056e5b50 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:57.249316 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c4c384e3-97dc-42e1-8f20-d96c056e5b50 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:57.249960 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c4c384e3-97dc-42e1-8f20-d96c056e5b50 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:57.250898 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c4c384e3-97dc-42e1-8f20-d96c056e5b50 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:57.252067 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c4c384e3-97dc-42e1-8f20-d96c056e5b50 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:57.252660 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c4c384e3-97dc-42e1-8f20-d96c056e5b50 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:57.273422 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-403dc826-1005-4afc-855b-64d0264fea8f tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:57.284987 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-403dc826-1005-4afc-855b-64d0264fea8f tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:57.286515 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-403dc826-1005-4afc-855b-64d0264fea8f tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:57.288755 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-403dc826-1005-4afc-855b-64d0264fea8f tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] 10.222.0.60 "GET /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0" status: 200 len: 1880 microversion: 2.32 time: 0.652212 Sep 14 08:58:57.290339 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1199/2349] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:58:56 2022] GET /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0 => generated 1880 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 08:58:57.449172 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-c4c384e3-97dc-42e1-8f20-d96c056e5b50 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9d40e54481461cba53fedb9a6abdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed2295a58f8451993a57ce0a6f9ba29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:57.457805 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-c4c384e3-97dc-42e1-8f20-d96c056e5b50 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] 10.222.0.60 "GET /compute/v2.1/servers/d0c5547a-1340-4d19-a0f9-3e1eb9fd1932" status: 200 len: 1316 microversion: 2.1 time: 0.225515 Sep 14 08:58:57.468271 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1151/2350] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:58:57 2022] GET /compute/v2.1/servers/d0c5547a-1340-4d19-a0f9-3e1eb9fd1932 => generated 1316 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:58:57.475501 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-4c776db9-9211-4471-84f5-37b0534cf539 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:57.476406 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-4c776db9-9211-4471-84f5-37b0534cf539 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: 874205eb-5321-4a9a-aa38-3cd83b2ac1a3] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:57.490680 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-0a212e29-2545-4bfb-8820-7c7380b5c2ac tempest-FlavorsV2TestJSON-60324210 tempest-FlavorsV2TestJSON-60324210-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:57.506089 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4c776db9-9211-4471-84f5-37b0534cf539 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:57.508908 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4c776db9-9211-4471-84f5-37b0534cf539 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:57.510041 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4c776db9-9211-4471-84f5-37b0534cf539 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:57.510178 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-0a212e29-2545-4bfb-8820-7c7380b5c2ac tempest-FlavorsV2TestJSON-60324210 tempest-FlavorsV2TestJSON-60324210-project] 10.222.0.60 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.217913 Sep 14 08:58:57.511125 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4c776db9-9211-4471-84f5-37b0534cf539 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:57.511717 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1200/2351] 10.222.0.60 () {58 vars in 1137 bytes} [Wed Sep 14 08:58:57 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:58:57.512445 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4c776db9-9211-4471-84f5-37b0534cf539 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:57.513040 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4c776db9-9211-4471-84f5-37b0534cf539 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:57.523381 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-9f6156ba-5016-44e3-85be-c19c1f260b05 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:57.524201 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-9f6156ba-5016-44e3-85be-c19c1f260b05 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: affb61a7-7e36-4424-bf48-a5a6bd64ae29] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:57.530681 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-4c776db9-9211-4471-84f5-37b0534cf539 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] HTTP exception thrown: Instance 874205eb-5321-4a9a-aa38-3cd83b2ac1a3 could not be found. Sep 14 08:58:57.532657 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-4c776db9-9211-4471-84f5-37b0534cf539 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Request method failure captured: Sep 14 08:58:57.532657 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/874205eb-5321-4a9a-aa38-3cd83b2ac1a3 HTTP/1.1 Sep 14 08:58:57.532657 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 08:58:57.532657 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 08:58:57.532657 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 08:58:57.532657 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 08:58:57.532657 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 08:58:57.532657 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 08:58:57.532657 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 08:58:57.532657 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 08:58:57.532657 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZW95b9fRr0E8bmSYM4S4lx9RiOfMr3cO7rblfxvOYjE7-JF30wAZsjQevo3rJUWAD3qTMdAvcdDZSED6vnvXWkl-NZqWaQ1NpJszbVtZlHL-LyTQfjvCcAn-ta76aZv2KZ5I1yoLILYoyMC8sk6rSQDq_-WLamtcU7SEoA-kKfdsWk Sep 14 08:58:57.532657 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 08:58:57.532657 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 08:58:57.532657 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 08:58:57.532657 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 08:58:57.532657 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 08:58:57.532657 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 08:58:57.532657 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: a7342631eeb747ba831f1d8a20fb8bf3 Sep 14 08:58:57.532657 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-LiveMigrationTest-14808698 Sep 14 08:58:57.532657 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 08:58:57.532657 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 08:58:57.532657 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a7342631eeb747ba831f1d8a20fb8bf3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a7342631eeb747ba831f1d8a20fb8bf3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a7342631eeb747ba831f1d8a20fb8bf3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a7342631eeb747ba831f1d8a20fb8bf3"}]}] Sep 14 08:58:57.532657 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-LiveMigrationTest-14808698 Sep 14 08:58:57.532657 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: a7342631eeb747ba831f1d8a20fb8bf3 Sep 14 08:58:57.532657 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-LiveMigrationTest-14808698 Sep 14 08:58:57.532657 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-LiveMigrationTest-14808698-project Sep 14 08:58:57.532657 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 08:58:57.532657 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 08:58:57.532657 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: cd713a1c3e7148ef8bfcbe44d1a80a18 Sep 14 08:58:57.532657 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-LiveMigrationTest-14808698-project Sep 14 08:58:57.532657 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 08:58:57.532657 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance 874205eb-5321-4a9a-aa38-3cd83b2ac1a3 could not be found. Sep 14 08:58:57.532657 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '874205eb-5321-4a9a-aa38-3cd83b2ac1a3'} Sep 14 08:58:57.532657 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:58:57.532657 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:58:57.532657 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 08:58:57.532657 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 08:58:57.532657 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 08:58:57.532657 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 08:58:57.532657 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 08:58:57.532657 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 08:58:57.532657 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 08:58:57.532657 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 08:58:57.532657 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 874205eb-5321-4a9a-aa38-3cd83b2ac1a3 could not be found. Sep 14 08:58:57.532657 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:58:57.532657 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:58:57.532657 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:58:57.532657 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:58:57.532657 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:58:57.532657 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:58:57.532657 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:58:57.532657 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:58:57.532657 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:58:57.532657 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:58:57.532657 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 08:58:57.532657 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 08:58:57.532657 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 08:58:57.532657 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 08:58:57.532657 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 08:58:57.532657 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 08:58:57.532657 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 874205eb-5321-4a9a-aa38-3cd83b2ac1a3 could not be found. Sep 14 08:58:57.532657 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:58:57.532657 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:58:57.532657 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:58:57.537207 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:58:57.537207 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:58:57.537207 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:58:57.537207 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:58:57.537207 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:58:57.537207 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 874205eb-5321-4a9a-aa38-3cd83b2ac1a3 could not be found. Sep 14 08:58:57.537207 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:58:57.539228 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-4c776db9-9211-4471-84f5-37b0534cf539 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Returning 404 to user: Instance 874205eb-5321-4a9a-aa38-3cd83b2ac1a3 could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:58:57.540121 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-4c776db9-9211-4471-84f5-37b0534cf539 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/874205eb-5321-4a9a-aa38-3cd83b2ac1a3" status: 404 len: 111 microversion: 2.1 time: 0.070536 Sep 14 08:58:57.540710 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1152/2352] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:58:57 2022] GET /compute/v2.1/servers/874205eb-5321-4a9a-aa38-3cd83b2ac1a3 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 08:58:57.540828 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9f6156ba-5016-44e3-85be-c19c1f260b05 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:57.545105 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9f6156ba-5016-44e3-85be-c19c1f260b05 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:57.546108 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9f6156ba-5016-44e3-85be-c19c1f260b05 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:57.546871 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9f6156ba-5016-44e3-85be-c19c1f260b05 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:57.547046 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-71799bf1-542e-4025-a997-16192295853f tempest-FlavorsV2TestJSON-60324210 tempest-FlavorsV2TestJSON-60324210-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:57.547438 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9f6156ba-5016-44e3-85be-c19c1f260b05 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:57.548436 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9f6156ba-5016-44e3-85be-c19c1f260b05 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:57.598092 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-71799bf1-542e-4025-a997-16192295853f tempest-FlavorsV2TestJSON-60324210 tempest-FlavorsV2TestJSON-60324210-project] 10.222.0.60 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.055853 Sep 14 08:58:57.599551 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1153/2353] 10.222.0.60 () {58 vars in 1125 bytes} [Wed Sep 14 08:58:57 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:58:57.611907 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-6ce67363-b668-40fe-8677-90e8dc5e0a0e tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:57.612779 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-6ce67363-b668-40fe-8677-90e8dc5e0a0e tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: 87a4e8b8-79db-43f6-be85-b738382e4699] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:57.621570 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6ce67363-b668-40fe-8677-90e8dc5e0a0e tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:57.622398 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6ce67363-b668-40fe-8677-90e8dc5e0a0e tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:57.623716 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6ce67363-b668-40fe-8677-90e8dc5e0a0e tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:57.625046 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6ce67363-b668-40fe-8677-90e8dc5e0a0e tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:57.625522 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6ce67363-b668-40fe-8677-90e8dc5e0a0e tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:57.626515 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6ce67363-b668-40fe-8677-90e8dc5e0a0e tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:57.659890 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-6ce67363-b668-40fe-8677-90e8dc5e0a0e tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: 87a4e8b8-79db-43f6-be85-b738382e4699] Going to try to terminate instance {{(pid=128759) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 08:58:57.748987 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-6ce67363-b668-40fe-8677-90e8dc5e0a0e tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "DELETE /compute/v2.1/servers/87a4e8b8-79db-43f6-be85-b738382e4699" status: 204 len: 0 microversion: 2.1 time: 0.146656 Sep 14 08:58:57.752671 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1154/2354] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 08:58:57 2022] DELETE /compute/v2.1/servers/87a4e8b8-79db-43f6-be85-b738382e4699 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 08:58:57.756357 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-84ba0b7a-500c-4640-bde8-8634102c10c0 tempest-FlavorsV2TestJSON-60324210 tempest-FlavorsV2TestJSON-60324210-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:57.782830 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-84ba0b7a-500c-4640-bde8-8634102c10c0 tempest-FlavorsV2TestJSON-60324210 tempest-FlavorsV2TestJSON-60324210-project] 10.222.0.60 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.030442 Sep 14 08:58:57.784927 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1155/2355] 10.222.0.60 () {58 vars in 1137 bytes} [Wed Sep 14 08:58:57 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:58:57.793727 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-7cc709e4-4845-4547-a30b-87dc6534693f tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:57.795894 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-7cc709e4-4845-4547-a30b-87dc6534693f tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: 87a4e8b8-79db-43f6-be85-b738382e4699] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:57.818737 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7cc709e4-4845-4547-a30b-87dc6534693f tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:57.819937 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7cc709e4-4845-4547-a30b-87dc6534693f tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:57.822329 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7cc709e4-4845-4547-a30b-87dc6534693f tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:57.824876 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7cc709e4-4845-4547-a30b-87dc6534693f tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:57.825936 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7cc709e4-4845-4547-a30b-87dc6534693f tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:57.826173 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7cc709e4-4845-4547-a30b-87dc6534693f tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:57.832728 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-9f6156ba-5016-44e3-85be-c19c1f260b05 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:57.845795 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-9f6156ba-5016-44e3-85be-c19c1f260b05 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/affb61a7-7e36-4424-bf48-a5a6bd64ae29" status: 200 len: 1308 microversion: 2.1 time: 0.332731 Sep 14 08:58:57.847006 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1201/2356] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:58:57 2022] GET /compute/v2.1/servers/affb61a7-7e36-4424-bf48-a5a6bd64ae29 => generated 1308 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:58:57.857850 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ce12a31f-1c78-4f4b-8a82-9943a450f8b8 tempest-FlavorsV2TestJSON-60324210 tempest-FlavorsV2TestJSON-60324210-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:57.878379 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-ce12a31f-1c78-4f4b-8a82-9943a450f8b8 tempest-FlavorsV2TestJSON-60324210 tempest-FlavorsV2TestJSON-60324210-project] 10.222.0.60 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.027367 Sep 14 08:58:57.879012 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1202/2357] 10.222.0.60 () {58 vars in 1137 bytes} [Wed Sep 14 08:58:57 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:58:57.905692 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-895a968d-b046-45fb-acfc-8add8051db26 tempest-FlavorsV2TestJSON-60324210 tempest-FlavorsV2TestJSON-60324210-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:57.937979 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-895a968d-b046-45fb-acfc-8add8051db26 tempest-FlavorsV2TestJSON-60324210 tempest-FlavorsV2TestJSON-60324210-project] 10.222.0.60 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.050352 Sep 14 08:58:57.938995 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1203/2358] 10.222.0.60 () {58 vars in 1165 bytes} [Wed Sep 14 08:58:57 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:58:57.960734 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-fb3d7009-eaf1-4a8f-ba19-143e7b97fd1a tempest-FlavorsV2TestJSON-60324210 tempest-FlavorsV2TestJSON-60324210-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:57.974259 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-fb3d7009-eaf1-4a8f-ba19-143e7b97fd1a tempest-FlavorsV2TestJSON-60324210 tempest-FlavorsV2TestJSON-60324210-project] 10.222.0.60 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.021226 Sep 14 08:58:57.984662 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1204/2359] 10.222.0.60 () {58 vars in 1137 bytes} [Wed Sep 14 08:58:57 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:58:57.991216 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-47781c33-a863-423f-b43c-7763391d8bbb tempest-FlavorsV2TestJSON-60324210 tempest-FlavorsV2TestJSON-60324210-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:58.028323 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-47781c33-a863-423f-b43c-7763391d8bbb tempest-FlavorsV2TestJSON-60324210 tempest-FlavorsV2TestJSON-60324210-project] 10.222.0.60 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.042243 Sep 14 08:58:58.041608 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1205/2360] 10.222.0.60 () {58 vars in 1169 bytes} [Wed Sep 14 08:58:57 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:58:58.047824 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d15d9062-e9d8-4d20-8db2-79324109d84e tempest-FlavorsV2TestJSON-60324210 tempest-FlavorsV2TestJSON-60324210-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:58.087369 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-d15d9062-e9d8-4d20-8db2-79324109d84e tempest-FlavorsV2TestJSON-60324210 tempest-FlavorsV2TestJSON-60324210-project] 10.222.0.60 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.044230 Sep 14 08:58:58.098854 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1206/2361] 10.222.0.60 () {58 vars in 1161 bytes} [Wed Sep 14 08:58:58 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:58:58.104052 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-e6e6564c-23ea-41db-91b8-7cc9f45134ee tempest-FlavorsV2TestJSON-60324210 tempest-FlavorsV2TestJSON-60324210-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:58.112143 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-7cc709e4-4845-4547-a30b-87dc6534693f tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:58.117624 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-e6e6564c-23ea-41db-91b8-7cc9f45134ee tempest-FlavorsV2TestJSON-60324210 tempest-FlavorsV2TestJSON-60324210-project] 10.222.0.60 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.017311 Sep 14 08:58:58.118546 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1207/2362] 10.222.0.60 () {58 vars in 1137 bytes} [Wed Sep 14 08:58:58 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:58:58.129073 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-7cc709e4-4845-4547-a30b-87dc6534693f tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/87a4e8b8-79db-43f6-be85-b738382e4699" status: 200 len: 1500 microversion: 2.1 time: 0.342768 Sep 14 08:58:58.145005 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1156/2363] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:58:57 2022] GET /compute/v2.1/servers/87a4e8b8-79db-43f6-be85-b738382e4699 => generated 1500 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:58:58.149240 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-11c5eb59-5fbe-451d-bbc9-c6f18b7fa6c4 tempest-FlavorsV2TestJSON-60324210 tempest-FlavorsV2TestJSON-60324210-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:58.224883 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-11c5eb59-5fbe-451d-bbc9-c6f18b7fa6c4 tempest-FlavorsV2TestJSON-60324210 tempest-FlavorsV2TestJSON-60324210-project] 10.222.0.60 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.095055 Sep 14 08:58:58.249156 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1208/2364] 10.222.0.60 () {58 vars in 1167 bytes} [Wed Sep 14 08:58:58 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:58:58.266406 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-075e097d-1047-41c0-9494-4fe107fc4291 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:58.271601 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-075e097d-1047-41c0-9494-4fe107fc4291 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] [instance: 885dfd01-8bac-4691-ad0b-f2218e306f2e] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:58.290328 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-075e097d-1047-41c0-9494-4fe107fc4291 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:58.291581 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-075e097d-1047-41c0-9494-4fe107fc4291 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:58.292227 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-7c30694d-597b-46dc-8ce8-77dfb4e0956e tempest-FlavorsV2TestJSON-60324210 tempest-FlavorsV2TestJSON-60324210-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:58.292723 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-075e097d-1047-41c0-9494-4fe107fc4291 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:58.293646 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-075e097d-1047-41c0-9494-4fe107fc4291 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:58.294278 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-075e097d-1047-41c0-9494-4fe107fc4291 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:58.294893 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-075e097d-1047-41c0-9494-4fe107fc4291 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:58.323037 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-7c30694d-597b-46dc-8ce8-77dfb4e0956e tempest-FlavorsV2TestJSON-60324210 tempest-FlavorsV2TestJSON-60324210-project] 10.222.0.60 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.045440 Sep 14 08:58:58.323651 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1209/2365] 10.222.0.60 () {58 vars in 1137 bytes} [Wed Sep 14 08:58:58 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:58:58.334151 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-96e6ac15-3010-42b5-a9b5-783461f82627 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:58.335186 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-96e6ac15-3010-42b5-a9b5-783461f82627 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] [instance: 26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:58.355372 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-96e6ac15-3010-42b5-a9b5-783461f82627 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:58.356569 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-96e6ac15-3010-42b5-a9b5-783461f82627 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:58.357225 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-96e6ac15-3010-42b5-a9b5-783461f82627 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:58.358145 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-96e6ac15-3010-42b5-a9b5-783461f82627 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:58.361280 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-96e6ac15-3010-42b5-a9b5-783461f82627 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:58.361909 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-96e6ac15-3010-42b5-a9b5-783461f82627 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:58.706495 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-96e6ac15-3010-42b5-a9b5-783461f82627 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:58.717854 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-96e6ac15-3010-42b5-a9b5-783461f82627 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:58.719793 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-96e6ac15-3010-42b5-a9b5-783461f82627 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:58.721670 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-96e6ac15-3010-42b5-a9b5-783461f82627 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] 10.222.0.60 "GET /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0" status: 200 len: 1880 microversion: 2.32 time: 0.393733 Sep 14 08:58:58.739964 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-075e097d-1047-41c0-9494-4fe107fc4291 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ab7166e40e4a908eefbfb03b3b8804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de82b83dadd541dbb4a939f2fc04a163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:58.739964 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-075e097d-1047-41c0-9494-4fe107fc4291 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] 10.222.0.60 "GET /compute/v2.1/servers/885dfd01-8bac-4691-ad0b-f2218e306f2e" status: 200 len: 1366 microversion: 2.1 time: 0.481611 Sep 14 08:58:58.740910 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1210/2366] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:58:58 2022] GET /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0 => generated 1880 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:58:58.747027 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-c2f73021-f403-441c-bdce-41fccb884cf1 req-0a32d8d6-4b00-4c93-81ca-666df9ede719 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0", "name": "network-vif-plugged", "status": "completed", "tag": "3ef522d5-07e7-4dc1-89cc-6972e61a2d28"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:58:58.750530 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1157/2367] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:58:58 2022] GET /compute/v2.1/servers/885dfd01-8bac-4691-ad0b-f2218e306f2e => generated 1366 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:58:58.766613 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-4323321f-9002-488f-85f9-c4461b48ede3 tempest-FlavorsV2TestJSON-60324210 tempest-FlavorsV2TestJSON-60324210-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:58.768568 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-c2f73021-f403-441c-bdce-41fccb884cf1 req-0a32d8d6-4b00-4c93-81ca-666df9ede719 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:58.769272 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-c2f73021-f403-441c-bdce-41fccb884cf1 req-0a32d8d6-4b00-4c93-81ca-666df9ede719 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:58.769940 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-c2f73021-f403-441c-bdce-41fccb884cf1 req-0a32d8d6-4b00-4c93-81ca-666df9ede719 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:58.791015 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-c2f73021-f403-441c-bdce-41fccb884cf1 req-0a32d8d6-4b00-4c93-81ca-666df9ede719 service nova] Creating event network-vif-plugged:3ef522d5-07e7-4dc1-89cc-6972e61a2d28 for instance 26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0 on n-h1-836830-18 Sep 14 08:58:58.800255 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-4323321f-9002-488f-85f9-c4461b48ede3 tempest-FlavorsV2TestJSON-60324210 tempest-FlavorsV2TestJSON-60324210-project] 10.222.0.60 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.048457 Sep 14 08:58:58.801266 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1158/2368] 10.222.0.60 () {58 vars in 1144 bytes} [Wed Sep 14 08:58:58 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:58:58.807719 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-1d71ed86-1007-48da-a7eb-280c5eba9841 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:58.808858 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-1d71ed86-1007-48da-a7eb-280c5eba9841 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: d0c5547a-1340-4d19-a0f9-3e1eb9fd1932] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:58.817157 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1d71ed86-1007-48da-a7eb-280c5eba9841 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:58.818208 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1d71ed86-1007-48da-a7eb-280c5eba9841 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:58.818903 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1d71ed86-1007-48da-a7eb-280c5eba9841 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:58.819950 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1d71ed86-1007-48da-a7eb-280c5eba9841 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:58.820617 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1d71ed86-1007-48da-a7eb-280c5eba9841 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:58.821271 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1d71ed86-1007-48da-a7eb-280c5eba9841 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:58.824537 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-c2f73021-f403-441c-bdce-41fccb884cf1 req-0a32d8d6-4b00-4c93-81ca-666df9ede719 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077562 Sep 14 08:58:58.825723 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1211/2369] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:58:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:58:58.836261 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-bd7bfc1e-87a8-4481-a9d3-15d7f809f8dd tempest-FlavorsV2TestJSON-60324210 tempest-FlavorsV2TestJSON-60324210-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:58.850389 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-bd7bfc1e-87a8-4481-a9d3-15d7f809f8dd tempest-FlavorsV2TestJSON-60324210 tempest-FlavorsV2TestJSON-60324210-project] 10.222.0.60 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.020954 Sep 14 08:58:58.851798 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1212/2370] 10.222.0.60 () {58 vars in 1137 bytes} [Wed Sep 14 08:58:58 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:58:58.860951 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:58:58.865474 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-f7178f33-6216-4bab-a39c-d8e2c204a7f8 tempest-FlavorsV2TestJSON-60324210 tempest-FlavorsV2TestJSON-60324210-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:58.891018 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-f7178f33-6216-4bab-a39c-d8e2c204a7f8 tempest-FlavorsV2TestJSON-60324210 tempest-FlavorsV2TestJSON-60324210-project] 10.222.0.60 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.030054 Sep 14 08:58:58.901737 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1213/2371] 10.222.0.60 () {58 vars in 1148 bytes} [Wed Sep 14 08:58:58 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:58:58.907478 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-482cea3b-b32c-4e72-9850-19029423eab7 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:58.909264 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-482cea3b-b32c-4e72-9850-19029423eab7 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: affb61a7-7e36-4424-bf48-a5a6bd64ae29] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:58.917738 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-482cea3b-b32c-4e72-9850-19029423eab7 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:58.918259 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-482cea3b-b32c-4e72-9850-19029423eab7 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:58.918721 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-482cea3b-b32c-4e72-9850-19029423eab7 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:58.920005 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-482cea3b-b32c-4e72-9850-19029423eab7 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:58.920473 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-482cea3b-b32c-4e72-9850-19029423eab7 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:58.920906 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-482cea3b-b32c-4e72-9850-19029423eab7 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:58.942585 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:58:59.045552 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-1d71ed86-1007-48da-a7eb-280c5eba9841 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9d40e54481461cba53fedb9a6abdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed2295a58f8451993a57ce0a6f9ba29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:59.055597 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-1d71ed86-1007-48da-a7eb-280c5eba9841 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] 10.222.0.60 "GET /compute/v2.1/servers/d0c5547a-1340-4d19-a0f9-3e1eb9fd1932" status: 200 len: 1316 microversion: 2.1 time: 0.252262 Sep 14 08:58:59.057070 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1159/2372] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:58:58 2022] GET /compute/v2.1/servers/d0c5547a-1340-4d19-a0f9-3e1eb9fd1932 => generated 1316 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:58:59.063538 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e5e5e435-2bd9-47f4-8a91-aa7ff472a0e2 tempest-FlavorsV2TestJSON-60324210 tempest-FlavorsV2TestJSON-60324210-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:59.077866 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e5e5e435-2bd9-47f4-8a91-aa7ff472a0e2 tempest-FlavorsV2TestJSON-60324210 tempest-FlavorsV2TestJSON-60324210-project] 10.222.0.60 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.019338 Sep 14 08:58:59.078755 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1160/2373] 10.222.0.60 () {58 vars in 1140 bytes} [Wed Sep 14 08:58:59 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:58:59.092308 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-afe1ae87-5536-4e29-9bc4-09151c5adfa5 tempest-FlavorsV2TestJSON-60324210 tempest-FlavorsV2TestJSON-60324210-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:59.104193 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-afe1ae87-5536-4e29-9bc4-09151c5adfa5 tempest-FlavorsV2TestJSON-60324210 tempest-FlavorsV2TestJSON-60324210-project] 10.222.0.60 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015735 Sep 14 08:58:59.113389 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1161/2374] 10.222.0.60 () {58 vars in 1137 bytes} [Wed Sep 14 08:58:59 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:58:59.115191 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-482cea3b-b32c-4e72-9850-19029423eab7 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:59.118632 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b22df00e-d25f-42e5-aa4e-6f146f1ee7c9 tempest-FlavorsV2TestJSON-60324210 tempest-FlavorsV2TestJSON-60324210-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:59.125908 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-482cea3b-b32c-4e72-9850-19029423eab7 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/affb61a7-7e36-4424-bf48-a5a6bd64ae29" status: 200 len: 1308 microversion: 2.1 time: 0.223425 Sep 14 08:58:59.133033 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1214/2375] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:58:58 2022] GET /compute/v2.1/servers/affb61a7-7e36-4424-bf48-a5a6bd64ae29 => generated 1308 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:58:59.143941 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=4 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:58:59.153622 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-2eeeb3e0-a52c-47c6-adcc-4ac91eafc2b0 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:59.154779 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-2eeeb3e0-a52c-47c6-adcc-4ac91eafc2b0 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: 87a4e8b8-79db-43f6-be85-b738382e4699] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:59.161084 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2eeeb3e0-a52c-47c6-adcc-4ac91eafc2b0 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:59.161548 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2eeeb3e0-a52c-47c6-adcc-4ac91eafc2b0 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:59.161976 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2eeeb3e0-a52c-47c6-adcc-4ac91eafc2b0 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:59.162672 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2eeeb3e0-a52c-47c6-adcc-4ac91eafc2b0 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:59.163184 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2eeeb3e0-a52c-47c6-adcc-4ac91eafc2b0 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:59.163887 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2eeeb3e0-a52c-47c6-adcc-4ac91eafc2b0 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:59.182956 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b22df00e-d25f-42e5-aa4e-6f146f1ee7c9 tempest-FlavorsV2TestJSON-60324210 tempest-FlavorsV2TestJSON-60324210-project] 10.222.0.60 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.062911 Sep 14 08:58:59.184068 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1162/2376] 10.222.0.60 () {58 vars in 1146 bytes} [Wed Sep 14 08:58:59 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:58:59.198014 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-bd22506e-7daf-43f3-9324-7bc463a5615b tempest-FlavorsV2TestJSON-60324210 tempest-FlavorsV2TestJSON-60324210-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:59.227339 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-bd22506e-7daf-43f3-9324-7bc463a5615b tempest-FlavorsV2TestJSON-60324210 tempest-FlavorsV2TestJSON-60324210-project] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.033081 Sep 14 08:58:59.246059 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1163/2377] 10.222.0.60 () {58 vars in 1146 bytes} [Wed Sep 14 08:58:59 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:58:59.252714 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-12224eb7-6e3b-43b2-8f72-fab3e3825867 tempest-FlavorsV2TestJSON-60324210 tempest-FlavorsV2TestJSON-60324210-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:59.260913 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-12224eb7-6e3b-43b2-8f72-fab3e3825867 tempest-FlavorsV2TestJSON-60324210 tempest-FlavorsV2TestJSON-60324210-project] 10.222.0.60 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013577 Sep 14 08:58:59.270246 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1164/2378] 10.222.0.60 () {58 vars in 1137 bytes} [Wed Sep 14 08:58:59 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:58:59.361010 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-2eeeb3e0-a52c-47c6-adcc-4ac91eafc2b0 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd713a1c3e7148ef8bfcbe44d1a80a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7342631eeb747ba831f1d8a20fb8bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:58:59.369607 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-2eeeb3e0-a52c-47c6-adcc-4ac91eafc2b0 tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/87a4e8b8-79db-43f6-be85-b738382e4699" status: 200 len: 1500 microversion: 2.1 time: 0.219746 Sep 14 08:58:59.370502 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1215/2379] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:58:59 2022] GET /compute/v2.1/servers/87a4e8b8-79db-43f6-be85-b738382e4699 => generated 1500 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:58:59.550148 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-15451419-b66d-4ebe-a10d-45c23d8868cf req-58b8222d-ad2d-4f11-a873-4cf671e1141d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87a4e8b8-79db-43f6-be85-b738382e4699", "name": "network-vif-deleted", "tag": "94536d67-6c5b-4f6a-b61f-3534a3426e05"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:58:59.592592 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-15451419-b66d-4ebe-a10d-45c23d8868cf req-58b8222d-ad2d-4f11-a873-4cf671e1141d service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:59.593454 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-15451419-b66d-4ebe-a10d-45c23d8868cf req-58b8222d-ad2d-4f11-a873-4cf671e1141d service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:59.594097 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-15451419-b66d-4ebe-a10d-45c23d8868cf req-58b8222d-ad2d-4f11-a873-4cf671e1141d service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:59.608114 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-15451419-b66d-4ebe-a10d-45c23d8868cf req-58b8222d-ad2d-4f11-a873-4cf671e1141d service nova] Creating event network-vif-deleted:94536d67-6c5b-4f6a-b61f-3534a3426e05 for instance 87a4e8b8-79db-43f6-be85-b738382e4699 on n-h2-836830-18 Sep 14 08:58:59.613857 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-15451419-b66d-4ebe-a10d-45c23d8868cf req-58b8222d-ad2d-4f11-a873-4cf671e1141d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067315 Sep 14 08:58:59.615488 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1165/2380] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:58:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:58:59.746547 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-038c75b3-dd3e-4bd3-bb7d-217ce09d2ca8 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:59.747221 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-038c75b3-dd3e-4bd3-bb7d-217ce09d2ca8 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] [instance: 26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:59.756978 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-038c75b3-dd3e-4bd3-bb7d-217ce09d2ca8 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:59.758110 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-038c75b3-dd3e-4bd3-bb7d-217ce09d2ca8 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:59.760349 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-038c75b3-dd3e-4bd3-bb7d-217ce09d2ca8 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:59.762186 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-038c75b3-dd3e-4bd3-bb7d-217ce09d2ca8 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:59.763423 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-038c75b3-dd3e-4bd3-bb7d-217ce09d2ca8 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:59.764234 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-038c75b3-dd3e-4bd3-bb7d-217ce09d2ca8 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:59.764748 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b66f0f80-f9e8-40c6-9914-9edadf3d2b29 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:58:59.765450 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b66f0f80-f9e8-40c6-9914-9edadf3d2b29 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] [instance: 885dfd01-8bac-4691-ad0b-f2218e306f2e] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:58:59.781397 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b66f0f80-f9e8-40c6-9914-9edadf3d2b29 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:59.781907 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b66f0f80-f9e8-40c6-9914-9edadf3d2b29 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:59.782357 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b66f0f80-f9e8-40c6-9914-9edadf3d2b29 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:58:59.783111 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b66f0f80-f9e8-40c6-9914-9edadf3d2b29 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:58:59.783574 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b66f0f80-f9e8-40c6-9914-9edadf3d2b29 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:58:59.784030 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b66f0f80-f9e8-40c6-9914-9edadf3d2b29 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:00.236692 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b66f0f80-f9e8-40c6-9914-9edadf3d2b29 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ab7166e40e4a908eefbfb03b3b8804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de82b83dadd541dbb4a939f2fc04a163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:00.250437 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b66f0f80-f9e8-40c6-9914-9edadf3d2b29 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] 10.222.0.60 "GET /compute/v2.1/servers/885dfd01-8bac-4691-ad0b-f2218e306f2e" status: 200 len: 1366 microversion: 2.1 time: 0.490500 Sep 14 08:59:00.251730 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1166/2381] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:58:59 2022] GET /compute/v2.1/servers/885dfd01-8bac-4691-ad0b-f2218e306f2e => generated 1366 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:59:00.260060 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9a5cc4ad-9640-4eb3-85aa-41a17881bdca tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:00.267500 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-9a5cc4ad-9640-4eb3-85aa-41a17881bdca tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: d0c5547a-1340-4d19-a0f9-3e1eb9fd1932] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:00.276799 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9a5cc4ad-9640-4eb3-85aa-41a17881bdca tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:00.278071 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9a5cc4ad-9640-4eb3-85aa-41a17881bdca tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:00.278882 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9a5cc4ad-9640-4eb3-85aa-41a17881bdca tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:00.279939 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9a5cc4ad-9640-4eb3-85aa-41a17881bdca tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:00.280611 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9a5cc4ad-9640-4eb3-85aa-41a17881bdca tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:00.281251 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9a5cc4ad-9640-4eb3-85aa-41a17881bdca tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:00.327051 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-038c75b3-dd3e-4bd3-bb7d-217ce09d2ca8 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:00.337965 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-038c75b3-dd3e-4bd3-bb7d-217ce09d2ca8 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:00.347712 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-038c75b3-dd3e-4bd3-bb7d-217ce09d2ca8 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:00.349521 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-038c75b3-dd3e-4bd3-bb7d-217ce09d2ca8 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] 10.222.0.60 "GET /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0" status: 200 len: 1880 microversion: 2.32 time: 0.606479 Sep 14 08:59:00.351065 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1216/2382] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:58:59 2022] GET /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0 => generated 1880 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:59:00.361272 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-bfc1c9b3-79d9-4fe8-8869-fb248b20f9c2 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:00.368924 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-bfc1c9b3-79d9-4fe8-8869-fb248b20f9c2 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: affb61a7-7e36-4424-bf48-a5a6bd64ae29] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:00.376879 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bfc1c9b3-79d9-4fe8-8869-fb248b20f9c2 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:00.377817 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bfc1c9b3-79d9-4fe8-8869-fb248b20f9c2 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:00.379663 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bfc1c9b3-79d9-4fe8-8869-fb248b20f9c2 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:00.380768 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bfc1c9b3-79d9-4fe8-8869-fb248b20f9c2 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:00.381455 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bfc1c9b3-79d9-4fe8-8869-fb248b20f9c2 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:00.382107 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bfc1c9b3-79d9-4fe8-8869-fb248b20f9c2 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:00.626126 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-9a5cc4ad-9640-4eb3-85aa-41a17881bdca tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9d40e54481461cba53fedb9a6abdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed2295a58f8451993a57ce0a6f9ba29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:00.637564 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-9a5cc4ad-9640-4eb3-85aa-41a17881bdca tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] 10.222.0.60 "GET /compute/v2.1/servers/d0c5547a-1340-4d19-a0f9-3e1eb9fd1932" status: 200 len: 1316 microversion: 2.1 time: 0.383519 Sep 14 08:59:00.639162 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1167/2383] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:00 2022] GET /compute/v2.1/servers/d0c5547a-1340-4d19-a0f9-3e1eb9fd1932 => generated 1316 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:59:00.644258 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3d12235b-8f19-4eeb-8de7-9c20e4c69abd tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:00.644886 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-3d12235b-8f19-4eeb-8de7-9c20e4c69abd tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] [instance: 87a4e8b8-79db-43f6-be85-b738382e4699] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:00.651558 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3d12235b-8f19-4eeb-8de7-9c20e4c69abd tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:00.652240 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3d12235b-8f19-4eeb-8de7-9c20e4c69abd tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:00.652954 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3d12235b-8f19-4eeb-8de7-9c20e4c69abd tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:00.654262 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3d12235b-8f19-4eeb-8de7-9c20e4c69abd tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:00.654735 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3d12235b-8f19-4eeb-8de7-9c20e4c69abd tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:00.655276 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3d12235b-8f19-4eeb-8de7-9c20e4c69abd tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:00.672948 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-3d12235b-8f19-4eeb-8de7-9c20e4c69abd tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] HTTP exception thrown: Instance 87a4e8b8-79db-43f6-be85-b738382e4699 could not be found. Sep 14 08:59:00.675571 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3d12235b-8f19-4eeb-8de7-9c20e4c69abd tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Request method failure captured: Sep 14 08:59:00.675571 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/87a4e8b8-79db-43f6-be85-b738382e4699 HTTP/1.1 Sep 14 08:59:00.675571 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 08:59:00.675571 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 08:59:00.675571 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 08:59:00.675571 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 08:59:00.675571 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 08:59:00.675571 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 08:59:00.675571 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 08:59:00.675571 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 08:59:00.675571 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZW95b9fRr0E8bmSYM4S4lx9RiOfMr3cO7rblfxvOYjE7-JF30wAZsjQevo3rJUWAD3qTMdAvcdDZSED6vnvXWkl-NZqWaQ1NpJszbVtZlHL-LyTQfjvCcAn-ta76aZv2KZ5I1yoLILYoyMC8sk6rSQDq_-WLamtcU7SEoA-kKfdsWk Sep 14 08:59:00.675571 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 08:59:00.675571 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 08:59:00.675571 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 08:59:00.675571 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 08:59:00.675571 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 08:59:00.675571 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 08:59:00.675571 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: a7342631eeb747ba831f1d8a20fb8bf3 Sep 14 08:59:00.675571 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-LiveMigrationTest-14808698 Sep 14 08:59:00.675571 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 08:59:00.675571 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 08:59:00.675571 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a7342631eeb747ba831f1d8a20fb8bf3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a7342631eeb747ba831f1d8a20fb8bf3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a7342631eeb747ba831f1d8a20fb8bf3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a7342631eeb747ba831f1d8a20fb8bf3"}]}] Sep 14 08:59:00.675571 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-LiveMigrationTest-14808698 Sep 14 08:59:00.675571 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: a7342631eeb747ba831f1d8a20fb8bf3 Sep 14 08:59:00.675571 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-LiveMigrationTest-14808698 Sep 14 08:59:00.675571 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-LiveMigrationTest-14808698-project Sep 14 08:59:00.675571 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 08:59:00.675571 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 08:59:00.675571 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: cd713a1c3e7148ef8bfcbe44d1a80a18 Sep 14 08:59:00.675571 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-LiveMigrationTest-14808698-project Sep 14 08:59:00.675571 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 08:59:00.675571 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance 87a4e8b8-79db-43f6-be85-b738382e4699 could not be found. Sep 14 08:59:00.675571 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '87a4e8b8-79db-43f6-be85-b738382e4699'} Sep 14 08:59:00.675571 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:59:00.675571 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:59:00.675571 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 08:59:00.675571 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 08:59:00.675571 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 08:59:00.675571 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 08:59:00.675571 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 08:59:00.675571 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 08:59:00.675571 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 08:59:00.675571 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 08:59:00.675571 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87a4e8b8-79db-43f6-be85-b738382e4699 could not be found. Sep 14 08:59:00.675571 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:59:00.675571 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:59:00.675571 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:59:00.675571 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:59:00.675571 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:59:00.675571 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:59:00.675571 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:59:00.675571 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:59:00.675571 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:59:00.675571 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:59:00.675571 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 08:59:00.675571 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 08:59:00.675571 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 08:59:00.675571 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 08:59:00.675571 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 08:59:00.675571 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 08:59:00.675571 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87a4e8b8-79db-43f6-be85-b738382e4699 could not be found. Sep 14 08:59:00.675571 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:59:00.675571 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:59:00.675571 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:59:00.680188 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:59:00.680188 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:59:00.680188 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:59:00.680188 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:59:00.680188 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:59:00.680188 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87a4e8b8-79db-43f6-be85-b738382e4699 could not be found. Sep 14 08:59:00.680188 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:59:00.680188 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3d12235b-8f19-4eeb-8de7-9c20e4c69abd tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] Returning 404 to user: Instance 87a4e8b8-79db-43f6-be85-b738382e4699 could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:59:00.680188 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-3d12235b-8f19-4eeb-8de7-9c20e4c69abd tempest-LiveMigrationTest-14808698 tempest-LiveMigrationTest-14808698-project] 10.222.0.60 "GET /compute/v2.1/servers/87a4e8b8-79db-43f6-be85-b738382e4699" status: 404 len: 111 microversion: 2.1 time: 0.037012 Sep 14 08:59:00.685967 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-bfc1c9b3-79d9-4fe8-8869-fb248b20f9c2 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:00.687686 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1168/2384] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:00 2022] GET /compute/v2.1/servers/87a4e8b8-79db-43f6-be85-b738382e4699 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 08:59:00.697268 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-bfc1c9b3-79d9-4fe8-8869-fb248b20f9c2 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/affb61a7-7e36-4424-bf48-a5a6bd64ae29" status: 200 len: 1308 microversion: 2.1 time: 0.345087 Sep 14 08:59:00.699030 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1217/2385] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:00 2022] GET /compute/v2.1/servers/affb61a7-7e36-4424-bf48-a5a6bd64ae29 => generated 1308 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:59:00.876261 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-13f65632-f647-49b3-ab56-deefe44e806f req-b19450b9-3402-457d-bfad-b183b0abef3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0", "name": "network-vif-plugged", "status": "completed", "tag": "6e812f35-e0fc-40c0-b4bf-9cf14c6dd2f3"}, {"server_uuid": "26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0", "name": "network-vif-plugged", "status": "completed", "tag": "3de3b6b2-e333-42d2-a891-af01ff3ccfd0"}, {"server_uuid": "affb61a7-7e36-4424-bf48-a5a6bd64ae29", "name": "network-vif-plugged", "status": "completed", "tag": "18231b89-f9a1-4386-8a2f-242a6bc12bd6"}, {"server_uuid": "26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0", "name": "network-vif-plugged", "status": "completed", "tag": "e80b0ec1-03fe-4258-9fdb-620fff721a58"}, {"server_uuid": "26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0", "name": "network-vif-plugged", "status": "completed", "tag": "01fa0eb2-52e8-4cfe-8e35-883e6c82aeb1"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:59:00.888911 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-13f65632-f647-49b3-ab56-deefe44e806f req-b19450b9-3402-457d-bfad-b183b0abef3c service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:00.889737 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-13f65632-f647-49b3-ab56-deefe44e806f req-b19450b9-3402-457d-bfad-b183b0abef3c service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:00.890389 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-13f65632-f647-49b3-ab56-deefe44e806f req-b19450b9-3402-457d-bfad-b183b0abef3c service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:00.915275 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-13f65632-f647-49b3-ab56-deefe44e806f req-b19450b9-3402-457d-bfad-b183b0abef3c service nova] Creating event network-vif-plugged:6e812f35-e0fc-40c0-b4bf-9cf14c6dd2f3 for instance 26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0 on n-h1-836830-18 Sep 14 08:59:00.915934 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-13f65632-f647-49b3-ab56-deefe44e806f req-b19450b9-3402-457d-bfad-b183b0abef3c service nova] Creating event network-vif-plugged:3de3b6b2-e333-42d2-a891-af01ff3ccfd0 for instance 26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0 on n-h1-836830-18 Sep 14 08:59:00.917281 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-13f65632-f647-49b3-ab56-deefe44e806f req-b19450b9-3402-457d-bfad-b183b0abef3c service nova] Creating event network-vif-plugged:18231b89-f9a1-4386-8a2f-242a6bc12bd6 for instance affb61a7-7e36-4424-bf48-a5a6bd64ae29 on n-h1-836830-18 Sep 14 08:59:00.919472 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-13f65632-f647-49b3-ab56-deefe44e806f req-b19450b9-3402-457d-bfad-b183b0abef3c service nova] Creating event network-vif-plugged:e80b0ec1-03fe-4258-9fdb-620fff721a58 for instance 26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0 on n-h1-836830-18 Sep 14 08:59:00.921284 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-13f65632-f647-49b3-ab56-deefe44e806f req-b19450b9-3402-457d-bfad-b183b0abef3c service nova] Creating event network-vif-plugged:01fa0eb2-52e8-4cfe-8e35-883e6c82aeb1 for instance 26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0 on n-h1-836830-18 Sep 14 08:59:00.936818 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-13f65632-f647-49b3-ab56-deefe44e806f req-b19450b9-3402-457d-bfad-b183b0abef3c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 867 microversion: 2.1 time: 0.064180 Sep 14 08:59:00.938614 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1169/2386] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:59:00 2022] POST /compute/v2.1/os-server-external-events => generated 867 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:59:01.274205 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-12fcd714-4c52-477a-bd1a-0d859d4eca6e tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:01.274829 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-12fcd714-4c52-477a-bd1a-0d859d4eca6e tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] [instance: 885dfd01-8bac-4691-ad0b-f2218e306f2e] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:01.284361 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-12fcd714-4c52-477a-bd1a-0d859d4eca6e tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:01.284865 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-12fcd714-4c52-477a-bd1a-0d859d4eca6e tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:01.285294 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-12fcd714-4c52-477a-bd1a-0d859d4eca6e tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:01.288873 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-12fcd714-4c52-477a-bd1a-0d859d4eca6e tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:01.290064 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-12fcd714-4c52-477a-bd1a-0d859d4eca6e tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:01.291217 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-12fcd714-4c52-477a-bd1a-0d859d4eca6e tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:01.384276 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-60ed0c5b-7c8f-4978-b613-fee3fc1ea833 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:01.385725 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-60ed0c5b-7c8f-4978-b613-fee3fc1ea833 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] [instance: 26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:01.398831 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-60ed0c5b-7c8f-4978-b613-fee3fc1ea833 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:01.399951 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-60ed0c5b-7c8f-4978-b613-fee3fc1ea833 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:01.402659 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-60ed0c5b-7c8f-4978-b613-fee3fc1ea833 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:01.403620 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-60ed0c5b-7c8f-4978-b613-fee3fc1ea833 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:01.404202 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-60ed0c5b-7c8f-4978-b613-fee3fc1ea833 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:01.404648 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-60ed0c5b-7c8f-4978-b613-fee3fc1ea833 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:01.571490 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-12fcd714-4c52-477a-bd1a-0d859d4eca6e tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ab7166e40e4a908eefbfb03b3b8804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de82b83dadd541dbb4a939f2fc04a163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:01.588001 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-12fcd714-4c52-477a-bd1a-0d859d4eca6e tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] 10.222.0.60 "GET /compute/v2.1/servers/885dfd01-8bac-4691-ad0b-f2218e306f2e" status: 200 len: 1366 microversion: 2.1 time: 0.317822 Sep 14 08:59:01.603285 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1218/2387] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:01 2022] GET /compute/v2.1/servers/885dfd01-8bac-4691-ad0b-f2218e306f2e => generated 1366 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:59:01.668666 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c963c72a-9648-4bc7-9e34-316b1121b75b tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:01.669446 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-c963c72a-9648-4bc7-9e34-316b1121b75b tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: d0c5547a-1340-4d19-a0f9-3e1eb9fd1932] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:01.684172 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c963c72a-9648-4bc7-9e34-316b1121b75b tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:01.686495 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c963c72a-9648-4bc7-9e34-316b1121b75b tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:01.690718 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c963c72a-9648-4bc7-9e34-316b1121b75b tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:01.691216 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c963c72a-9648-4bc7-9e34-316b1121b75b tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:01.691939 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c963c72a-9648-4bc7-9e34-316b1121b75b tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:01.692539 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c963c72a-9648-4bc7-9e34-316b1121b75b tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:01.887273 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-60ed0c5b-7c8f-4978-b613-fee3fc1ea833 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:01.904676 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-60ed0c5b-7c8f-4978-b613-fee3fc1ea833 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:01.906705 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-60ed0c5b-7c8f-4978-b613-fee3fc1ea833 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:01.908409 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-60ed0c5b-7c8f-4978-b613-fee3fc1ea833 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] 10.222.0.60 "GET /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0" status: 200 len: 1880 microversion: 2.32 time: 0.529542 Sep 14 08:59:01.909693 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1170/2388] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:59:01 2022] GET /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0 => generated 1880 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:59:01.915760 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f6365f72-9b96-437f-a2c8-3e9d6aae5da0 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:01.916682 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f6365f72-9b96-437f-a2c8-3e9d6aae5da0 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: affb61a7-7e36-4424-bf48-a5a6bd64ae29] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:01.925139 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f6365f72-9b96-437f-a2c8-3e9d6aae5da0 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:01.925982 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f6365f72-9b96-437f-a2c8-3e9d6aae5da0 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:01.926641 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f6365f72-9b96-437f-a2c8-3e9d6aae5da0 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:01.927606 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f6365f72-9b96-437f-a2c8-3e9d6aae5da0 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:01.928457 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f6365f72-9b96-437f-a2c8-3e9d6aae5da0 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:01.928992 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f6365f72-9b96-437f-a2c8-3e9d6aae5da0 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:01.962851 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:59:01.980841 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-c963c72a-9648-4bc7-9e34-316b1121b75b tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9d40e54481461cba53fedb9a6abdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed2295a58f8451993a57ce0a6f9ba29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:01.998499 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-c963c72a-9648-4bc7-9e34-316b1121b75b tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] 10.222.0.60 "GET /compute/v2.1/servers/d0c5547a-1340-4d19-a0f9-3e1eb9fd1932" status: 200 len: 1316 microversion: 2.1 time: 0.335735 Sep 14 08:59:02.005841 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1219/2389] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:01 2022] GET /compute/v2.1/servers/d0c5547a-1340-4d19-a0f9-3e1eb9fd1932 => generated 1316 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:59:02.143483 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f6365f72-9b96-437f-a2c8-3e9d6aae5da0 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:02.152851 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f6365f72-9b96-437f-a2c8-3e9d6aae5da0 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/affb61a7-7e36-4424-bf48-a5a6bd64ae29" status: 200 len: 1308 microversion: 2.1 time: 0.241284 Sep 14 08:59:02.164902 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1171/2390] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:01 2022] GET /compute/v2.1/servers/affb61a7-7e36-4424-bf48-a5a6bd64ae29 => generated 1308 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:59:02.444841 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c9afbdf0-a226-480b-b87e-bc3543cf3dd4 tempest-ImagesMetadataNegativeTestJSON-1789210864 tempest-ImagesMetadataNegativeTestJSON-1789210864-project] Calling method '.version_select at 0x7f7d448ee3a0>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:02.472268 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-c9afbdf0-a226-480b-b87e-bc3543cf3dd4 tempest-ImagesMetadataNegativeTestJSON-1789210864 tempest-ImagesMetadataNegativeTestJSON-1789210864-project] HTTP exception thrown: Image not found. Sep 14 08:59:02.481266 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c9afbdf0-a226-480b-b87e-bc3543cf3dd4 tempest-ImagesMetadataNegativeTestJSON-1789210864 tempest-ImagesMetadataNegativeTestJSON-1789210864-project] Request method failure captured: Sep 14 08:59:02.481266 n-d-836830-18 devstack@n-api.service[128758]: request: DELETE /compute/v2.1/images/016d592d-a497-4b03-bb76-87184787122e/metadata/os_distro HTTP/1.1 Sep 14 08:59:02.481266 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 08:59:02.481266 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 08:59:02.481266 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 08:59:02.481266 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 08:59:02.481266 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 08:59:02.481266 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 08:59:02.481266 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 08:59:02.481266 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 08:59:02.481266 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZfVKC3gRyfX5KhrkBAMXaoOtCQHgHVd8joMJ2weFGVM7VVZgYOGrrD807BWb8s7wif5-Z1tCTGm1IpZfFOF_gtrjFyYXzTBbaQNdO_ocV7v3pc39thHUKAheoft28mmso_5JE4fc1_cT3BrmXPEK5wUa9g3S5UifHAKHfmXaBbVMeE Sep 14 08:59:02.481266 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 08:59:02.481266 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 08:59:02.481266 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 08:59:02.481266 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 08:59:02.481266 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 08:59:02.481266 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 08:59:02.481266 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 609b4e9663444b14a65ccba0ccd99c7e Sep 14 08:59:02.481266 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1789210864 Sep 14 08:59:02.481266 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 08:59:02.481266 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 08:59:02.481266 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/609b4e9663444b14a65ccba0ccd99c7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_609b4e9663444b14a65ccba0ccd99c7e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/609b4e9663444b14a65ccba0ccd99c7e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/609b4e9663444b14a65ccba0ccd99c7e"}]}] Sep 14 08:59:02.481266 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1789210864 Sep 14 08:59:02.481266 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 609b4e9663444b14a65ccba0ccd99c7e Sep 14 08:59:02.481266 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1789210864 Sep 14 08:59:02.481266 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-ImagesMetadataNegativeTestJSON-1789210864-project Sep 14 08:59:02.481266 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 08:59:02.481266 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 08:59:02.481266 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 88593b23e3a64ccc9a5bae82f44a0af9 Sep 14 08:59:02.481266 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1789210864-project Sep 14 08:59:02.481266 n-d-836830-18 devstack@n-api.service[128758]: method: Sep 14 08:59:02.481266 n-d-836830-18 devstack@n-api.service[128758]: exception: Image not found. Sep 14 08:59:02.481266 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'image_id': '016d592d-a497-4b03-bb76-87184787122e', 'id': 'os_distro'} Sep 14 08:59:02.481266 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:59:02.481266 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:59:02.481266 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 14 08:59:02.481266 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 14 08:59:02.481266 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 14 08:59:02.481266 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 14 08:59:02.481266 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 14 08:59:02.481266 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 14 08:59:02.481266 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 14 08:59:02.481266 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 14 08:59:02.481266 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 14 08:59:02.481266 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 14 08:59:02.481266 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 14 08:59:02.481266 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 14 08:59:02.481266 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 14 08:59:02.481266 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 14 08:59:02.481266 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 14 08:59:02.481266 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 14 08:59:02.481266 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 016d592d-a497-4b03-bb76-87184787122e Sep 14 08:59:02.481266 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:59:02.481266 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:59:02.481266 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:59:02.481266 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:59:02.481266 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 14 08:59:02.481266 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 14 08:59:02.481266 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 14 08:59:02.481266 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 14 08:59:02.481266 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 14 08:59:02.481266 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 14 08:59:02.490485 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 14 08:59:02.490485 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 14 08:59:02.490485 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 14 08:59:02.490485 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 14 08:59:02.490485 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 14 08:59:02.490485 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 14 08:59:02.490485 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 14 08:59:02.490485 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 14 08:59:02.490485 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 14 08:59:02.490485 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 14 08:59:02.490485 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 14 08:59:02.490485 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 14 08:59:02.490485 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 14 08:59:02.490485 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 14 08:59:02.490485 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 14 08:59:02.490485 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 14 08:59:02.490485 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 14 08:59:02.490485 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 14 08:59:02.490485 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 016d592d-a497-4b03-bb76-87184787122e could not be found. Sep 14 08:59:02.490485 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:59:02.490485 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:59:02.490485 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:59:02.490485 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:59:02.490485 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:59:02.490485 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:59:02.490485 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:59:02.490485 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:59:02.490485 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 08:59:02.490485 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 08:59:02.490485 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:59:02.490485 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:59:02.490485 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Sep 14 08:59:02.490485 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Sep 14 08:59:02.490485 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 14 08:59:02.490485 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 14 08:59:02.490485 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 14 08:59:02.490485 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:59:02.490485 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:59:02.490485 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:59:02.490485 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:59:02.490485 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:59:02.490485 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:59:02.490485 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:59:02.490485 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:59:02.490485 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 14 08:59:02.490485 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:59:02.490485 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c9afbdf0-a226-480b-b87e-bc3543cf3dd4 tempest-ImagesMetadataNegativeTestJSON-1789210864 tempest-ImagesMetadataNegativeTestJSON-1789210864-project] Returning 404 to user: Image not found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:59:02.490485 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-c9afbdf0-a226-480b-b87e-bc3543cf3dd4 tempest-ImagesMetadataNegativeTestJSON-1789210864 tempest-ImagesMetadataNegativeTestJSON-1789210864-project] 10.222.0.60 "DELETE /compute/v2.1/images/016d592d-a497-4b03-bb76-87184787122e/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.408107 Sep 14 08:59:02.490485 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1220/2391] 10.222.0.60 () {58 vars in 1293 bytes} [Wed Sep 14 08:59:02 2022] DELETE /compute/v2.1/images/016d592d-a497-4b03-bb76-87184787122e/metadata/os_distro => generated 62 bytes in 409 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 14 08:59:02.495097 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ddcd5e0e-6242-4860-9348-51f88255cf04 tempest-ImagesMetadataNegativeTestJSON-1789210864 tempest-ImagesMetadataNegativeTestJSON-1789210864-project] Calling method '.version_select at 0x7f7d44251040>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:02.532050 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-ddcd5e0e-6242-4860-9348-51f88255cf04 tempest-ImagesMetadataNegativeTestJSON-1789210864 tempest-ImagesMetadataNegativeTestJSON-1789210864-project] HTTP exception thrown: Image not found. Sep 14 08:59:02.535346 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ddcd5e0e-6242-4860-9348-51f88255cf04 tempest-ImagesMetadataNegativeTestJSON-1789210864 tempest-ImagesMetadataNegativeTestJSON-1789210864-project] Request method failure captured: Sep 14 08:59:02.535346 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/images/97911aa5-12b9-4465-b942-a442b2b9b841/metadata/os_version HTTP/1.1 Sep 14 08:59:02.535346 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 08:59:02.535346 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 08:59:02.535346 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 08:59:02.535346 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 08:59:02.535346 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 08:59:02.535346 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 08:59:02.535346 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 08:59:02.535346 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 08:59:02.535346 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZfVKC3gRyfX5KhrkBAMXaoOtCQHgHVd8joMJ2weFGVM7VVZgYOGrrD807BWb8s7wif5-Z1tCTGm1IpZfFOF_gtrjFyYXzTBbaQNdO_ocV7v3pc39thHUKAheoft28mmso_5JE4fc1_cT3BrmXPEK5wUa9g3S5UifHAKHfmXaBbVMeE Sep 14 08:59:02.535346 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 08:59:02.535346 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 08:59:02.535346 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 08:59:02.535346 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 08:59:02.535346 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 08:59:02.535346 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 08:59:02.535346 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 609b4e9663444b14a65ccba0ccd99c7e Sep 14 08:59:02.535346 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1789210864 Sep 14 08:59:02.535346 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 08:59:02.535346 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 08:59:02.535346 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/609b4e9663444b14a65ccba0ccd99c7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_609b4e9663444b14a65ccba0ccd99c7e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/609b4e9663444b14a65ccba0ccd99c7e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/609b4e9663444b14a65ccba0ccd99c7e"}]}] Sep 14 08:59:02.535346 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1789210864 Sep 14 08:59:02.535346 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 609b4e9663444b14a65ccba0ccd99c7e Sep 14 08:59:02.535346 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1789210864 Sep 14 08:59:02.535346 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ImagesMetadataNegativeTestJSON-1789210864-project Sep 14 08:59:02.535346 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 08:59:02.535346 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 08:59:02.535346 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 88593b23e3a64ccc9a5bae82f44a0af9 Sep 14 08:59:02.535346 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1789210864-project Sep 14 08:59:02.535346 n-d-836830-18 devstack@n-api.service[128759]: method: Sep 14 08:59:02.535346 n-d-836830-18 devstack@n-api.service[128759]: exception: Image not found. Sep 14 08:59:02.535346 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'image_id': '97911aa5-12b9-4465-b942-a442b2b9b841', 'id': 'os_version'} Sep 14 08:59:02.535346 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:59:02.535346 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:59:02.535346 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 14 08:59:02.535346 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 14 08:59:02.535346 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 14 08:59:02.535346 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 14 08:59:02.535346 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 14 08:59:02.535346 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 14 08:59:02.535346 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 14 08:59:02.535346 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 14 08:59:02.535346 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 14 08:59:02.535346 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 14 08:59:02.535346 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 14 08:59:02.535346 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 14 08:59:02.535346 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 14 08:59:02.535346 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 14 08:59:02.535346 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 14 08:59:02.535346 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 14 08:59:02.535346 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 97911aa5-12b9-4465-b942-a442b2b9b841 Sep 14 08:59:02.535346 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:59:02.535346 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:59:02.535346 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:59:02.535346 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:59:02.535346 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 14 08:59:02.535346 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 14 08:59:02.535346 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 14 08:59:02.535346 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 14 08:59:02.535346 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 14 08:59:02.535346 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 14 08:59:02.539612 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 14 08:59:02.539612 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 14 08:59:02.539612 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 14 08:59:02.539612 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 14 08:59:02.539612 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 14 08:59:02.539612 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 14 08:59:02.539612 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 14 08:59:02.539612 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 14 08:59:02.539612 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 14 08:59:02.539612 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 14 08:59:02.539612 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 14 08:59:02.539612 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 14 08:59:02.539612 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 14 08:59:02.539612 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 14 08:59:02.539612 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 14 08:59:02.539612 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 14 08:59:02.539612 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 14 08:59:02.539612 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 14 08:59:02.539612 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 97911aa5-12b9-4465-b942-a442b2b9b841 could not be found. Sep 14 08:59:02.539612 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:59:02.539612 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:59:02.539612 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:59:02.539612 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:59:02.539612 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:59:02.539612 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:59:02.539612 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:59:02.539612 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:59:02.539612 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 08:59:02.539612 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 08:59:02.539612 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:59:02.539612 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:59:02.539612 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Sep 14 08:59:02.539612 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Sep 14 08:59:02.539612 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 14 08:59:02.539612 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 14 08:59:02.539612 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 14 08:59:02.539612 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:59:02.539612 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:59:02.539612 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:59:02.539612 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:59:02.539612 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:59:02.539612 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:59:02.539612 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:59:02.539612 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:59:02.539612 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 14 08:59:02.539612 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:59:02.539612 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ddcd5e0e-6242-4860-9348-51f88255cf04 tempest-ImagesMetadataNegativeTestJSON-1789210864 tempest-ImagesMetadataNegativeTestJSON-1789210864-project] Returning 404 to user: Image not found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:59:02.539612 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-ddcd5e0e-6242-4860-9348-51f88255cf04 tempest-ImagesMetadataNegativeTestJSON-1789210864 tempest-ImagesMetadataNegativeTestJSON-1789210864-project] 10.222.0.60 "GET /compute/v2.1/images/97911aa5-12b9-4465-b942-a442b2b9b841/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.047397 Sep 14 08:59:02.543963 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1172/2392] 10.222.0.60 () {58 vars in 1293 bytes} [Wed Sep 14 08:59:02 2022] GET /compute/v2.1/images/97911aa5-12b9-4465-b942-a442b2b9b841/metadata/os_version => generated 62 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 14 08:59:02.549100 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-e12f5ed4-b75b-422d-8183-bc744d0bf29d tempest-ImagesMetadataNegativeTestJSON-1789210864 tempest-ImagesMetadataNegativeTestJSON-1789210864-project] Calling method '.version_select at 0x7f7d445e9a60>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:02.581488 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-e12f5ed4-b75b-422d-8183-bc744d0bf29d tempest-ImagesMetadataNegativeTestJSON-1789210864 tempest-ImagesMetadataNegativeTestJSON-1789210864-project] HTTP exception thrown: Image not found. Sep 14 08:59:02.583572 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-e12f5ed4-b75b-422d-8183-bc744d0bf29d tempest-ImagesMetadataNegativeTestJSON-1789210864 tempest-ImagesMetadataNegativeTestJSON-1789210864-project] Request method failure captured: Sep 14 08:59:02.583572 n-d-836830-18 devstack@n-api.service[128758]: request: GET /compute/v2.1/images/20bcc2b5-2ed1-42c6-baab-cbc19b340487/metadata HTTP/1.1 Sep 14 08:59:02.583572 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 08:59:02.583572 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 08:59:02.583572 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 08:59:02.583572 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 08:59:02.583572 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 08:59:02.583572 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 08:59:02.583572 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 08:59:02.583572 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 08:59:02.583572 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZfVKC3gRyfX5KhrkBAMXaoOtCQHgHVd8joMJ2weFGVM7VVZgYOGrrD807BWb8s7wif5-Z1tCTGm1IpZfFOF_gtrjFyYXzTBbaQNdO_ocV7v3pc39thHUKAheoft28mmso_5JE4fc1_cT3BrmXPEK5wUa9g3S5UifHAKHfmXaBbVMeE Sep 14 08:59:02.583572 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 08:59:02.583572 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 08:59:02.583572 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 08:59:02.583572 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 08:59:02.583572 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 08:59:02.583572 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 08:59:02.583572 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 609b4e9663444b14a65ccba0ccd99c7e Sep 14 08:59:02.583572 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1789210864 Sep 14 08:59:02.583572 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 08:59:02.583572 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 08:59:02.583572 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/609b4e9663444b14a65ccba0ccd99c7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_609b4e9663444b14a65ccba0ccd99c7e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/609b4e9663444b14a65ccba0ccd99c7e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/609b4e9663444b14a65ccba0ccd99c7e"}]}] Sep 14 08:59:02.583572 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1789210864 Sep 14 08:59:02.583572 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 609b4e9663444b14a65ccba0ccd99c7e Sep 14 08:59:02.583572 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1789210864 Sep 14 08:59:02.583572 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-ImagesMetadataNegativeTestJSON-1789210864-project Sep 14 08:59:02.583572 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 08:59:02.583572 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 08:59:02.583572 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 88593b23e3a64ccc9a5bae82f44a0af9 Sep 14 08:59:02.583572 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1789210864-project Sep 14 08:59:02.583572 n-d-836830-18 devstack@n-api.service[128758]: method: Sep 14 08:59:02.583572 n-d-836830-18 devstack@n-api.service[128758]: exception: Image not found. Sep 14 08:59:02.583572 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'image_id': '20bcc2b5-2ed1-42c6-baab-cbc19b340487'} Sep 14 08:59:02.583572 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:59:02.583572 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:59:02.583572 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 14 08:59:02.583572 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 14 08:59:02.583572 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 14 08:59:02.583572 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 14 08:59:02.583572 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 14 08:59:02.583572 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 14 08:59:02.583572 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 14 08:59:02.583572 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 14 08:59:02.583572 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 14 08:59:02.583572 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 14 08:59:02.583572 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 14 08:59:02.583572 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 14 08:59:02.583572 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 14 08:59:02.583572 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 14 08:59:02.583572 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 14 08:59:02.583572 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 14 08:59:02.583572 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 20bcc2b5-2ed1-42c6-baab-cbc19b340487 Sep 14 08:59:02.583572 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:59:02.583572 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:59:02.583572 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:59:02.583572 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:59:02.583572 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 14 08:59:02.583572 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 14 08:59:02.583572 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 14 08:59:02.583572 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 14 08:59:02.583572 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 14 08:59:02.583572 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 14 08:59:02.588983 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 14 08:59:02.588983 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 14 08:59:02.588983 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 14 08:59:02.588983 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 14 08:59:02.588983 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 14 08:59:02.588983 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 14 08:59:02.588983 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 14 08:59:02.588983 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 14 08:59:02.588983 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 14 08:59:02.588983 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 14 08:59:02.588983 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 14 08:59:02.588983 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 14 08:59:02.588983 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 14 08:59:02.588983 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 14 08:59:02.588983 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 14 08:59:02.588983 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 14 08:59:02.588983 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 14 08:59:02.588983 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 14 08:59:02.588983 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 20bcc2b5-2ed1-42c6-baab-cbc19b340487 could not be found. Sep 14 08:59:02.588983 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:59:02.588983 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:59:02.588983 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:59:02.588983 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:59:02.588983 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:59:02.588983 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:59:02.588983 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:59:02.588983 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:59:02.588983 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 08:59:02.588983 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 08:59:02.588983 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:59:02.588983 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:59:02.588983 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Sep 14 08:59:02.588983 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Sep 14 08:59:02.588983 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 14 08:59:02.588983 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 14 08:59:02.588983 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 14 08:59:02.588983 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:59:02.588983 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:59:02.588983 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:59:02.588983 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:59:02.588983 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:59:02.588983 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:59:02.588983 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:59:02.588983 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:59:02.588983 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 14 08:59:02.588983 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:59:02.588983 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-e12f5ed4-b75b-422d-8183-bc744d0bf29d tempest-ImagesMetadataNegativeTestJSON-1789210864 tempest-ImagesMetadataNegativeTestJSON-1789210864-project] Returning 404 to user: Image not found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:59:02.588983 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-e12f5ed4-b75b-422d-8183-bc744d0bf29d tempest-ImagesMetadataNegativeTestJSON-1789210864 tempest-ImagesMetadataNegativeTestJSON-1789210864-project] 10.222.0.60 "GET /compute/v2.1/images/20bcc2b5-2ed1-42c6-baab-cbc19b340487/metadata" status: 404 len: 62 microversion: 2.1 time: 0.040106 Sep 14 08:59:02.588983 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1221/2393] 10.222.0.60 () {58 vars in 1260 bytes} [Wed Sep 14 08:59:02 2022] GET /compute/v2.1/images/20bcc2b5-2ed1-42c6-baab-cbc19b340487/metadata => generated 62 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 14 08:59:02.595609 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-902a8f25-353b-48f0-8170-933ccecbd624 tempest-ImagesMetadataNegativeTestJSON-1789210864 tempest-ImagesMetadataNegativeTestJSON-1789210864-project] Action: 'update_all', calling method: .version_select at 0x7f7d4424b820>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:59:02.618004 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-42a00c6d-7730-4b4b-9403-173e3f449df8 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:02.619586 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-42a00c6d-7730-4b4b-9403-173e3f449df8 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] [instance: 885dfd01-8bac-4691-ad0b-f2218e306f2e] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:02.624267 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-902a8f25-353b-48f0-8170-933ccecbd624 tempest-ImagesMetadataNegativeTestJSON-1789210864 tempest-ImagesMetadataNegativeTestJSON-1789210864-project] HTTP exception thrown: Image not found. Sep 14 08:59:02.626535 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-902a8f25-353b-48f0-8170-933ccecbd624 tempest-ImagesMetadataNegativeTestJSON-1789210864 tempest-ImagesMetadataNegativeTestJSON-1789210864-project] Request method failure captured: Sep 14 08:59:02.626535 n-d-836830-18 devstack@n-api.service[128759]: request: PUT /compute/v2.1/images/c3884bf0-a5d6-4634-87d2-7422af9e81c3/metadata HTTP/1.1 Sep 14 08:59:02.626535 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 08:59:02.626535 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 08:59:02.626535 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 08:59:02.626535 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 57 Sep 14 08:59:02.626535 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 08:59:02.626535 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 08:59:02.626535 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 08:59:02.626535 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 08:59:02.626535 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZfVKC3gRyfX5KhrkBAMXaoOtCQHgHVd8joMJ2weFGVM7VVZgYOGrrD807BWb8s7wif5-Z1tCTGm1IpZfFOF_gtrjFyYXzTBbaQNdO_ocV7v3pc39thHUKAheoft28mmso_5JE4fc1_cT3BrmXPEK5wUa9g3S5UifHAKHfmXaBbVMeE Sep 14 08:59:02.626535 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 08:59:02.626535 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 08:59:02.626535 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 08:59:02.626535 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 08:59:02.626535 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 08:59:02.626535 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 08:59:02.626535 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 609b4e9663444b14a65ccba0ccd99c7e Sep 14 08:59:02.626535 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1789210864 Sep 14 08:59:02.626535 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 08:59:02.626535 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 08:59:02.626535 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/609b4e9663444b14a65ccba0ccd99c7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_609b4e9663444b14a65ccba0ccd99c7e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/609b4e9663444b14a65ccba0ccd99c7e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/609b4e9663444b14a65ccba0ccd99c7e"}]}] Sep 14 08:59:02.626535 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1789210864 Sep 14 08:59:02.626535 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 609b4e9663444b14a65ccba0ccd99c7e Sep 14 08:59:02.626535 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1789210864 Sep 14 08:59:02.626535 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ImagesMetadataNegativeTestJSON-1789210864-project Sep 14 08:59:02.626535 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 08:59:02.626535 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 08:59:02.626535 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 88593b23e3a64ccc9a5bae82f44a0af9 Sep 14 08:59:02.626535 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1789210864-project Sep 14 08:59:02.626535 n-d-836830-18 devstack@n-api.service[128759]: Sep 14 08:59:02.626535 n-d-836830-18 devstack@n-api.service[128759]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Sep 14 08:59:02.626535 n-d-836830-18 devstack@n-api.service[128759]: method: Sep 14 08:59:02.626535 n-d-836830-18 devstack@n-api.service[128759]: exception: Image not found. Sep 14 08:59:02.626535 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'image_id': 'c3884bf0-a5d6-4634-87d2-7422af9e81c3', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Sep 14 08:59:02.626535 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:59:02.626535 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:59:02.626535 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 14 08:59:02.626535 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 14 08:59:02.626535 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 14 08:59:02.626535 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 14 08:59:02.626535 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 14 08:59:02.626535 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 14 08:59:02.626535 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 14 08:59:02.626535 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 14 08:59:02.626535 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 14 08:59:02.626535 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 14 08:59:02.626535 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 14 08:59:02.626535 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 14 08:59:02.626535 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 14 08:59:02.626535 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 14 08:59:02.626535 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 14 08:59:02.626535 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 14 08:59:02.626535 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID c3884bf0-a5d6-4634-87d2-7422af9e81c3 Sep 14 08:59:02.626535 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:59:02.626535 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:59:02.626535 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:59:02.626535 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:59:02.626535 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 14 08:59:02.626535 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 14 08:59:02.626535 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 14 08:59:02.626535 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 14 08:59:02.626535 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 14 08:59:02.631134 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 14 08:59:02.631134 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 14 08:59:02.631134 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 14 08:59:02.631134 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 14 08:59:02.631134 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 14 08:59:02.631134 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 14 08:59:02.631134 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 14 08:59:02.631134 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 14 08:59:02.631134 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 14 08:59:02.631134 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 14 08:59:02.631134 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 14 08:59:02.631134 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 14 08:59:02.631134 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 14 08:59:02.631134 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 14 08:59:02.631134 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 14 08:59:02.631134 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 14 08:59:02.631134 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 14 08:59:02.631134 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 14 08:59:02.631134 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 14 08:59:02.631134 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c3884bf0-a5d6-4634-87d2-7422af9e81c3 could not be found. Sep 14 08:59:02.631134 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:59:02.631134 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:59:02.631134 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:59:02.631134 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:59:02.631134 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:59:02.631134 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:59:02.631134 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:59:02.631134 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:59:02.631134 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 08:59:02.631134 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 08:59:02.631134 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:59:02.631134 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:59:02.631134 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 08:59:02.631134 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 08:59:02.631134 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Sep 14 08:59:02.631134 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Sep 14 08:59:02.631134 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 14 08:59:02.631134 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 14 08:59:02.631134 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 14 08:59:02.631134 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:59:02.631134 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:59:02.631134 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:59:02.631134 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:59:02.631134 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:59:02.631134 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:59:02.631134 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:59:02.631134 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:59:02.631134 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 14 08:59:02.631134 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:59:02.634262 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-42a00c6d-7730-4b4b-9403-173e3f449df8 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:02.634262 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-42a00c6d-7730-4b4b-9403-173e3f449df8 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:02.634262 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-42a00c6d-7730-4b4b-9403-173e3f449df8 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:02.634262 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-42a00c6d-7730-4b4b-9403-173e3f449df8 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:02.634262 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-42a00c6d-7730-4b4b-9403-173e3f449df8 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:02.634262 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-42a00c6d-7730-4b4b-9403-173e3f449df8 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:02.634760 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-902a8f25-353b-48f0-8170-933ccecbd624 tempest-ImagesMetadataNegativeTestJSON-1789210864 tempest-ImagesMetadataNegativeTestJSON-1789210864-project] Returning 404 to user: Image not found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:59:02.637369 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-902a8f25-353b-48f0-8170-933ccecbd624 tempest-ImagesMetadataNegativeTestJSON-1789210864 tempest-ImagesMetadataNegativeTestJSON-1789210864-project] 10.222.0.60 "PUT /compute/v2.1/images/c3884bf0-a5d6-4634-87d2-7422af9e81c3/metadata" status: 404 len: 62 microversion: 2.1 time: 0.046337 Sep 14 08:59:02.639306 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1173/2394] 10.222.0.60 () {60 vars in 1280 bytes} [Wed Sep 14 08:59:02 2022] PUT /compute/v2.1/images/c3884bf0-a5d6-4634-87d2-7422af9e81c3/metadata => generated 62 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 14 08:59:02.657822 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-bb54e150-82df-4764-b190-c2f46fb842a8 tempest-ImagesMetadataNegativeTestJSON-1789210864 tempest-ImagesMetadataNegativeTestJSON-1789210864-project] Action: 'update', calling method: .version_select at 0x7f7d3ffa4820>, body: {"meta": {"os_distro": "alt"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:59:02.683417 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-bb54e150-82df-4764-b190-c2f46fb842a8 tempest-ImagesMetadataNegativeTestJSON-1789210864 tempest-ImagesMetadataNegativeTestJSON-1789210864-project] HTTP exception thrown: Image not found. Sep 14 08:59:02.686956 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-bb54e150-82df-4764-b190-c2f46fb842a8 tempest-ImagesMetadataNegativeTestJSON-1789210864 tempest-ImagesMetadataNegativeTestJSON-1789210864-project] Request method failure captured: Sep 14 08:59:02.686956 n-d-836830-18 devstack@n-api.service[128759]: request: PUT /compute/v2.1/images/3ddf4851-e8b5-4eb2-b549-2cfafc6f5ef6/metadata/os_distro HTTP/1.1 Sep 14 08:59:02.686956 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 08:59:02.686956 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 08:59:02.686956 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 08:59:02.686956 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 30 Sep 14 08:59:02.686956 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 08:59:02.686956 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 08:59:02.686956 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 08:59:02.686956 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 08:59:02.686956 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZfVKC3gRyfX5KhrkBAMXaoOtCQHgHVd8joMJ2weFGVM7VVZgYOGrrD807BWb8s7wif5-Z1tCTGm1IpZfFOF_gtrjFyYXzTBbaQNdO_ocV7v3pc39thHUKAheoft28mmso_5JE4fc1_cT3BrmXPEK5wUa9g3S5UifHAKHfmXaBbVMeE Sep 14 08:59:02.686956 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 08:59:02.686956 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 08:59:02.686956 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 08:59:02.686956 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 08:59:02.686956 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 08:59:02.686956 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 08:59:02.686956 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 609b4e9663444b14a65ccba0ccd99c7e Sep 14 08:59:02.686956 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1789210864 Sep 14 08:59:02.686956 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 08:59:02.686956 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 08:59:02.686956 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/609b4e9663444b14a65ccba0ccd99c7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_609b4e9663444b14a65ccba0ccd99c7e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/609b4e9663444b14a65ccba0ccd99c7e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/609b4e9663444b14a65ccba0ccd99c7e"}]}] Sep 14 08:59:02.686956 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1789210864 Sep 14 08:59:02.686956 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 609b4e9663444b14a65ccba0ccd99c7e Sep 14 08:59:02.686956 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1789210864 Sep 14 08:59:02.686956 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ImagesMetadataNegativeTestJSON-1789210864-project Sep 14 08:59:02.686956 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 08:59:02.686956 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 08:59:02.686956 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 88593b23e3a64ccc9a5bae82f44a0af9 Sep 14 08:59:02.686956 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1789210864-project Sep 14 08:59:02.686956 n-d-836830-18 devstack@n-api.service[128759]: Sep 14 08:59:02.686956 n-d-836830-18 devstack@n-api.service[128759]: {"meta": {"os_distro": "alt"}} Sep 14 08:59:02.686956 n-d-836830-18 devstack@n-api.service[128759]: method: Sep 14 08:59:02.686956 n-d-836830-18 devstack@n-api.service[128759]: exception: Image not found. Sep 14 08:59:02.686956 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'image_id': '3ddf4851-e8b5-4eb2-b549-2cfafc6f5ef6', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Sep 14 08:59:02.686956 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:59:02.686956 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:59:02.686956 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 14 08:59:02.686956 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 14 08:59:02.686956 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 14 08:59:02.686956 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 14 08:59:02.686956 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 14 08:59:02.686956 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 14 08:59:02.686956 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 14 08:59:02.686956 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 14 08:59:02.686956 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 14 08:59:02.686956 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 14 08:59:02.686956 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 14 08:59:02.686956 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 14 08:59:02.686956 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 14 08:59:02.686956 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 14 08:59:02.686956 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 14 08:59:02.686956 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 14 08:59:02.686956 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 3ddf4851-e8b5-4eb2-b549-2cfafc6f5ef6 Sep 14 08:59:02.686956 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:59:02.686956 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:59:02.686956 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:59:02.686956 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:59:02.686956 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 14 08:59:02.686956 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 14 08:59:02.686956 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 14 08:59:02.686956 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 14 08:59:02.686956 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 14 08:59:02.686956 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 14 08:59:02.691799 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 14 08:59:02.691799 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 14 08:59:02.691799 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 14 08:59:02.691799 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 14 08:59:02.691799 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 14 08:59:02.691799 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 14 08:59:02.691799 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 14 08:59:02.691799 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 14 08:59:02.691799 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 14 08:59:02.691799 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 14 08:59:02.691799 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 14 08:59:02.691799 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 14 08:59:02.691799 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 14 08:59:02.691799 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 14 08:59:02.691799 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 14 08:59:02.691799 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 14 08:59:02.691799 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 14 08:59:02.691799 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 14 08:59:02.691799 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 3ddf4851-e8b5-4eb2-b549-2cfafc6f5ef6 could not be found. Sep 14 08:59:02.691799 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:59:02.691799 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:59:02.691799 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:59:02.691799 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:59:02.691799 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:59:02.691799 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:59:02.691799 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:59:02.691799 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:59:02.691799 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 08:59:02.691799 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 08:59:02.691799 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:59:02.691799 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:59:02.691799 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 08:59:02.691799 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 08:59:02.691799 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Sep 14 08:59:02.691799 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Sep 14 08:59:02.691799 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 14 08:59:02.691799 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 14 08:59:02.691799 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 14 08:59:02.691799 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:59:02.691799 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:59:02.691799 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:59:02.691799 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:59:02.691799 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:59:02.691799 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:59:02.691799 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:59:02.691799 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:59:02.691799 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 14 08:59:02.691799 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:59:02.696565 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-bb54e150-82df-4764-b190-c2f46fb842a8 tempest-ImagesMetadataNegativeTestJSON-1789210864 tempest-ImagesMetadataNegativeTestJSON-1789210864-project] Returning 404 to user: Image not found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:59:02.697816 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-bb54e150-82df-4764-b190-c2f46fb842a8 tempest-ImagesMetadataNegativeTestJSON-1789210864 tempest-ImagesMetadataNegativeTestJSON-1789210864-project] 10.222.0.60 "PUT /compute/v2.1/images/3ddf4851-e8b5-4eb2-b549-2cfafc6f5ef6/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.052581 Sep 14 08:59:02.699074 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1174/2395] 10.222.0.60 () {60 vars in 1310 bytes} [Wed Sep 14 08:59:02 2022] PUT /compute/v2.1/images/3ddf4851-e8b5-4eb2-b549-2cfafc6f5ef6/metadata/os_distro => generated 62 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 14 08:59:02.711025 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-81fc97a1-e89b-4880-b622-eb56957654c5 tempest-ImagesMetadataNegativeTestJSON-1789210864 tempest-ImagesMetadataNegativeTestJSON-1789210864-project] Action: 'create', calling method: .version_select at 0x7f7d3fff95e0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:59:02.740321 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-81fc97a1-e89b-4880-b622-eb56957654c5 tempest-ImagesMetadataNegativeTestJSON-1789210864 tempest-ImagesMetadataNegativeTestJSON-1789210864-project] HTTP exception thrown: Image not found. Sep 14 08:59:02.743060 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-81fc97a1-e89b-4880-b622-eb56957654c5 tempest-ImagesMetadataNegativeTestJSON-1789210864 tempest-ImagesMetadataNegativeTestJSON-1789210864-project] Request method failure captured: Sep 14 08:59:02.743060 n-d-836830-18 devstack@n-api.service[128759]: request: POST /compute/v2.1/images/bb3abcb1-543d-40ce-a354-c93aa7cd64c4/metadata HTTP/1.1 Sep 14 08:59:02.743060 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 08:59:02.743060 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 08:59:02.743060 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 08:59:02.743060 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 57 Sep 14 08:59:02.743060 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 08:59:02.743060 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 08:59:02.743060 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 08:59:02.743060 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 08:59:02.743060 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZfVKC3gRyfX5KhrkBAMXaoOtCQHgHVd8joMJ2weFGVM7VVZgYOGrrD807BWb8s7wif5-Z1tCTGm1IpZfFOF_gtrjFyYXzTBbaQNdO_ocV7v3pc39thHUKAheoft28mmso_5JE4fc1_cT3BrmXPEK5wUa9g3S5UifHAKHfmXaBbVMeE Sep 14 08:59:02.743060 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 08:59:02.743060 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 08:59:02.743060 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 08:59:02.743060 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 08:59:02.743060 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 08:59:02.743060 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 08:59:02.743060 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 609b4e9663444b14a65ccba0ccd99c7e Sep 14 08:59:02.743060 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1789210864 Sep 14 08:59:02.743060 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 08:59:02.743060 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 08:59:02.743060 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/609b4e9663444b14a65ccba0ccd99c7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_609b4e9663444b14a65ccba0ccd99c7e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/609b4e9663444b14a65ccba0ccd99c7e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/609b4e9663444b14a65ccba0ccd99c7e"}]}] Sep 14 08:59:02.743060 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1789210864 Sep 14 08:59:02.743060 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 609b4e9663444b14a65ccba0ccd99c7e Sep 14 08:59:02.743060 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1789210864 Sep 14 08:59:02.743060 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ImagesMetadataNegativeTestJSON-1789210864-project Sep 14 08:59:02.743060 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 08:59:02.743060 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 08:59:02.743060 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 88593b23e3a64ccc9a5bae82f44a0af9 Sep 14 08:59:02.743060 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1789210864-project Sep 14 08:59:02.743060 n-d-836830-18 devstack@n-api.service[128759]: Sep 14 08:59:02.743060 n-d-836830-18 devstack@n-api.service[128759]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Sep 14 08:59:02.743060 n-d-836830-18 devstack@n-api.service[128759]: method: Sep 14 08:59:02.743060 n-d-836830-18 devstack@n-api.service[128759]: exception: Image not found. Sep 14 08:59:02.743060 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'image_id': 'bb3abcb1-543d-40ce-a354-c93aa7cd64c4', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Sep 14 08:59:02.743060 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:59:02.743060 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:59:02.743060 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 14 08:59:02.743060 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 14 08:59:02.743060 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 14 08:59:02.743060 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 14 08:59:02.743060 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 14 08:59:02.743060 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 14 08:59:02.743060 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 14 08:59:02.743060 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 14 08:59:02.743060 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 14 08:59:02.743060 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 14 08:59:02.743060 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 14 08:59:02.743060 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 14 08:59:02.743060 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 14 08:59:02.743060 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 14 08:59:02.743060 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 14 08:59:02.743060 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 14 08:59:02.743060 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID bb3abcb1-543d-40ce-a354-c93aa7cd64c4 Sep 14 08:59:02.743060 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:59:02.743060 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:59:02.743060 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:59:02.743060 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:59:02.743060 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 14 08:59:02.743060 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 14 08:59:02.743060 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 14 08:59:02.743060 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 14 08:59:02.743060 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 14 08:59:02.748072 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 14 08:59:02.748072 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 14 08:59:02.748072 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 14 08:59:02.748072 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 14 08:59:02.748072 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 14 08:59:02.748072 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 14 08:59:02.748072 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 14 08:59:02.748072 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 14 08:59:02.748072 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 14 08:59:02.748072 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 14 08:59:02.748072 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 14 08:59:02.748072 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 14 08:59:02.748072 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 14 08:59:02.748072 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 14 08:59:02.748072 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 14 08:59:02.748072 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 14 08:59:02.748072 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 14 08:59:02.748072 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 14 08:59:02.748072 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 14 08:59:02.748072 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image bb3abcb1-543d-40ce-a354-c93aa7cd64c4 could not be found. Sep 14 08:59:02.748072 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:59:02.748072 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:59:02.748072 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:59:02.748072 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:59:02.748072 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:59:02.748072 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:59:02.748072 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:59:02.748072 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:59:02.748072 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 08:59:02.748072 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 08:59:02.748072 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:59:02.748072 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:59:02.748072 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 08:59:02.748072 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 08:59:02.748072 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Sep 14 08:59:02.748072 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Sep 14 08:59:02.748072 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 14 08:59:02.748072 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 14 08:59:02.748072 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 14 08:59:02.748072 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:59:02.748072 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:59:02.748072 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:59:02.748072 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:59:02.748072 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:59:02.748072 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:59:02.748072 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:59:02.748072 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:59:02.748072 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 14 08:59:02.748072 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:59:02.754931 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-81fc97a1-e89b-4880-b622-eb56957654c5 tempest-ImagesMetadataNegativeTestJSON-1789210864 tempest-ImagesMetadataNegativeTestJSON-1789210864-project] Returning 404 to user: Image not found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:59:02.754931 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-81fc97a1-e89b-4880-b622-eb56957654c5 tempest-ImagesMetadataNegativeTestJSON-1789210864 tempest-ImagesMetadataNegativeTestJSON-1789210864-project] 10.222.0.60 "POST /compute/v2.1/images/bb3abcb1-543d-40ce-a354-c93aa7cd64c4/metadata" status: 404 len: 62 microversion: 2.1 time: 0.048212 Sep 14 08:59:02.754931 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1175/2396] 10.222.0.60 () {60 vars in 1281 bytes} [Wed Sep 14 08:59:02 2022] POST /compute/v2.1/images/bb3abcb1-543d-40ce-a354-c93aa7cd64c4/metadata => generated 62 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 14 08:59:02.858195 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-42a00c6d-7730-4b4b-9403-173e3f449df8 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ab7166e40e4a908eefbfb03b3b8804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de82b83dadd541dbb4a939f2fc04a163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:02.871212 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-42a00c6d-7730-4b4b-9403-173e3f449df8 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] 10.222.0.60 "GET /compute/v2.1/servers/885dfd01-8bac-4691-ad0b-f2218e306f2e" status: 200 len: 1366 microversion: 2.1 time: 0.257458 Sep 14 08:59:02.873562 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1222/2397] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:02 2022] GET /compute/v2.1/servers/885dfd01-8bac-4691-ad0b-f2218e306f2e => generated 1366 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:59:02.938503 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-bb4e05a4-1c88-4858-81ad-a44dffb5cc85 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:02.942861 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-bb4e05a4-1c88-4858-81ad-a44dffb5cc85 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] [instance: 26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:02.961127 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-5df75766-ee82-4630-9e43-b7a596d326a0 req-83a886a3-9f47-4ab7-9e12-99a6d80222da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0c5547a-1340-4d19-a0f9-3e1eb9fd1932", "name": "network-vif-plugged", "status": "completed", "tag": "2e224a14-f300-4cfe-a4c3-34a512adfc08"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:59:02.977720 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bb4e05a4-1c88-4858-81ad-a44dffb5cc85 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:02.978229 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bb4e05a4-1c88-4858-81ad-a44dffb5cc85 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:02.978678 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bb4e05a4-1c88-4858-81ad-a44dffb5cc85 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:02.979552 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bb4e05a4-1c88-4858-81ad-a44dffb5cc85 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:02.980094 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bb4e05a4-1c88-4858-81ad-a44dffb5cc85 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:02.982631 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bb4e05a4-1c88-4858-81ad-a44dffb5cc85 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:02.987823 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-5df75766-ee82-4630-9e43-b7a596d326a0 req-83a886a3-9f47-4ab7-9e12-99a6d80222da service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:02.988538 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-5df75766-ee82-4630-9e43-b7a596d326a0 req-83a886a3-9f47-4ab7-9e12-99a6d80222da service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:02.989162 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-5df75766-ee82-4630-9e43-b7a596d326a0 req-83a886a3-9f47-4ab7-9e12-99a6d80222da service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:03.011698 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-5df75766-ee82-4630-9e43-b7a596d326a0 req-83a886a3-9f47-4ab7-9e12-99a6d80222da service nova] Creating event network-vif-plugged:2e224a14-f300-4cfe-a4c3-34a512adfc08 for instance d0c5547a-1340-4d19-a0f9-3e1eb9fd1932 on n-h1-836830-18 Sep 14 08:59:03.024795 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-5df75766-ee82-4630-9e43-b7a596d326a0 req-83a886a3-9f47-4ab7-9e12-99a6d80222da service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068550 Sep 14 08:59:03.026042 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1223/2398] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:59:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:59:03.041954 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1991c71d-a9d5-43fd-a82f-74303a3f5276 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:03.042743 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-1991c71d-a9d5-43fd-a82f-74303a3f5276 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: d0c5547a-1340-4d19-a0f9-3e1eb9fd1932] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:03.055532 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1991c71d-a9d5-43fd-a82f-74303a3f5276 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:03.056020 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1991c71d-a9d5-43fd-a82f-74303a3f5276 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:03.056468 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1991c71d-a9d5-43fd-a82f-74303a3f5276 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:03.057379 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1991c71d-a9d5-43fd-a82f-74303a3f5276 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:03.057988 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1991c71d-a9d5-43fd-a82f-74303a3f5276 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:03.058997 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1991c71d-a9d5-43fd-a82f-74303a3f5276 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:03.545215 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-1991c71d-a9d5-43fd-a82f-74303a3f5276 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9d40e54481461cba53fedb9a6abdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed2295a58f8451993a57ce0a6f9ba29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:03.567046 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-1991c71d-a9d5-43fd-a82f-74303a3f5276 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] 10.222.0.60 "GET /compute/v2.1/servers/d0c5547a-1340-4d19-a0f9-3e1eb9fd1932" status: 200 len: 1316 microversion: 2.1 time: 0.536775 Sep 14 08:59:03.572966 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1224/2399] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:03 2022] GET /compute/v2.1/servers/d0c5547a-1340-4d19-a0f9-3e1eb9fd1932 => generated 1316 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:59:03.596048 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c5f65a68-7bee-46ed-a57e-6b9a2fb7ec3e tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:03.597426 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-c5f65a68-7bee-46ed-a57e-6b9a2fb7ec3e tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] [instance: 59f196e8-c202-4073-8663-2ae19358a044] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:03.607930 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c5f65a68-7bee-46ed-a57e-6b9a2fb7ec3e tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:03.608581 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c5f65a68-7bee-46ed-a57e-6b9a2fb7ec3e tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:03.609462 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c5f65a68-7bee-46ed-a57e-6b9a2fb7ec3e tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:03.610816 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c5f65a68-7bee-46ed-a57e-6b9a2fb7ec3e tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:03.611690 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c5f65a68-7bee-46ed-a57e-6b9a2fb7ec3e tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:03.612383 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c5f65a68-7bee-46ed-a57e-6b9a2fb7ec3e tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:03.668541 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-bb4e05a4-1c88-4858-81ad-a44dffb5cc85 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:03.686573 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-bb4e05a4-1c88-4858-81ad-a44dffb5cc85 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:03.688607 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-bb4e05a4-1c88-4858-81ad-a44dffb5cc85 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:03.690282 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-bb4e05a4-1c88-4858-81ad-a44dffb5cc85 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] 10.222.0.60 "GET /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0" status: 200 len: 1880 microversion: 2.32 time: 0.757915 Sep 14 08:59:03.704196 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1176/2400] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:59:02 2022] GET /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0 => generated 1880 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:59:03.717762 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a641120e-4627-48f1-894b-9c8cdb0db807 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:03.718641 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-a641120e-4627-48f1-894b-9c8cdb0db807 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: affb61a7-7e36-4424-bf48-a5a6bd64ae29] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:03.726273 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a641120e-4627-48f1-894b-9c8cdb0db807 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:03.727032 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a641120e-4627-48f1-894b-9c8cdb0db807 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:03.727619 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a641120e-4627-48f1-894b-9c8cdb0db807 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:03.728474 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a641120e-4627-48f1-894b-9c8cdb0db807 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:03.729078 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a641120e-4627-48f1-894b-9c8cdb0db807 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:03.729668 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a641120e-4627-48f1-894b-9c8cdb0db807 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:04.336889 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-c5f65a68-7bee-46ed-a57e-6b9a2fb7ec3e tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:04.352643 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-c5f65a68-7bee-46ed-a57e-6b9a2fb7ec3e tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:04.352960 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-a641120e-4627-48f1-894b-9c8cdb0db807 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:04.360656 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-c5f65a68-7bee-46ed-a57e-6b9a2fb7ec3e tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:04.364675 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-c5f65a68-7bee-46ed-a57e-6b9a2fb7ec3e tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] 10.222.0.60 "GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044" status: 200 len: 2955 microversion: 2.42 time: 0.787978 Sep 14 08:59:04.367730 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1225/2401] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:59:03 2022] GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044 => generated 2955 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:59:04.381313 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-38525040-7ef8-4acc-8663-b9f09a9ebb7e tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:04.382269 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-38525040-7ef8-4acc-8663-b9f09a9ebb7e tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] [instance: 885dfd01-8bac-4691-ad0b-f2218e306f2e] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:04.389238 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a641120e-4627-48f1-894b-9c8cdb0db807 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/affb61a7-7e36-4424-bf48-a5a6bd64ae29" status: 200 len: 1488 microversion: 2.1 time: 0.678309 Sep 14 08:59:04.390344 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1177/2402] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:03 2022] GET /compute/v2.1/servers/affb61a7-7e36-4424-bf48-a5a6bd64ae29 => generated 1488 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:59:04.390552 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-38525040-7ef8-4acc-8663-b9f09a9ebb7e tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:04.405892 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-38525040-7ef8-4acc-8663-b9f09a9ebb7e tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:04.406480 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-38525040-7ef8-4acc-8663-b9f09a9ebb7e tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:04.407385 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-38525040-7ef8-4acc-8663-b9f09a9ebb7e tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:04.407823 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-38525040-7ef8-4acc-8663-b9f09a9ebb7e tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:04.408259 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-38525040-7ef8-4acc-8663-b9f09a9ebb7e tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:04.416578 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-80ff71f0-7ea5-4092-aa3f-54969d4b4674 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:04.417305 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-80ff71f0-7ea5-4092-aa3f-54969d4b4674 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] [instance: 59f196e8-c202-4073-8663-2ae19358a044] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:04.469718 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-80ff71f0-7ea5-4092-aa3f-54969d4b4674 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:04.470403 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-80ff71f0-7ea5-4092-aa3f-54969d4b4674 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:04.473754 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-80ff71f0-7ea5-4092-aa3f-54969d4b4674 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:04.475843 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-80ff71f0-7ea5-4092-aa3f-54969d4b4674 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:04.476360 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-80ff71f0-7ea5-4092-aa3f-54969d4b4674 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:04.476799 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-80ff71f0-7ea5-4092-aa3f-54969d4b4674 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:04.738501 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-80ff71f0-7ea5-4092-aa3f-54969d4b4674 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] 10.222.0.60 "GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044/os-interface" status: 200 len: 1832 microversion: 2.42 time: 0.344132 Sep 14 08:59:04.749542 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1178/2403] 10.222.0.60 () {60 vars in 1316 bytes} [Wed Sep 14 08:59:04 2022] GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044/os-interface => generated 1832 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:59:04.755834 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-268cb830-915a-42c7-84f3-d34b028810b6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:59:04.762292 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-268cb830-915a-42c7-84f3-d34b028810b6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: affb61a7-7e36-4424-bf48-a5a6bd64ae29] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:04.784696 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-268cb830-915a-42c7-84f3-d34b028810b6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:04.785463 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-268cb830-915a-42c7-84f3-d34b028810b6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:04.786125 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-268cb830-915a-42c7-84f3-d34b028810b6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:04.787138 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-268cb830-915a-42c7-84f3-d34b028810b6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:04.787707 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-268cb830-915a-42c7-84f3-d34b028810b6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:04.788300 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-268cb830-915a-42c7-84f3-d34b028810b6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:04.812919 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-38525040-7ef8-4acc-8663-b9f09a9ebb7e tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ab7166e40e4a908eefbfb03b3b8804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de82b83dadd541dbb4a939f2fc04a163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:04.823812 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-38525040-7ef8-4acc-8663-b9f09a9ebb7e tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] 10.222.0.60 "GET /compute/v2.1/servers/885dfd01-8bac-4691-ad0b-f2218e306f2e" status: 200 len: 1366 microversion: 2.1 time: 0.450043 Sep 14 08:59:04.828493 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1226/2404] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:04 2022] GET /compute/v2.1/servers/885dfd01-8bac-4691-ad0b-f2218e306f2e => generated 1366 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:59:04.833870 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-189c1d11-7b46-464f-b571-5e56fde4834b tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:04.834713 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-189c1d11-7b46-464f-b571-5e56fde4834b tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: d0c5547a-1340-4d19-a0f9-3e1eb9fd1932] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:04.843784 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-189c1d11-7b46-464f-b571-5e56fde4834b tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:04.855725 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-189c1d11-7b46-464f-b571-5e56fde4834b tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:04.858753 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-189c1d11-7b46-464f-b571-5e56fde4834b tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:04.859738 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-189c1d11-7b46-464f-b571-5e56fde4834b tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:04.860431 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-189c1d11-7b46-464f-b571-5e56fde4834b tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:04.861676 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-189c1d11-7b46-464f-b571-5e56fde4834b tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:04.931929 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-268cb830-915a-42c7-84f3-d34b028810b6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "PUT /compute/v2.1/servers/affb61a7-7e36-4424-bf48-a5a6bd64ae29" status: 200 len: 1083 microversion: 2.1 time: 0.180917 Sep 14 08:59:04.933296 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1179/2405] 10.222.0.60 () {60 vars in 1256 bytes} [Wed Sep 14 08:59:04 2022] PUT /compute/v2.1/servers/affb61a7-7e36-4424-bf48-a5a6bd64ae29 => generated 1083 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:59:04.952339 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-545ae6c7-99b1-4977-bcbe-0a27b403fff4 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:04.954064 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-545ae6c7-99b1-4977-bcbe-0a27b403fff4 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] [instance: 26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:04.970342 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-545ae6c7-99b1-4977-bcbe-0a27b403fff4 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:04.971619 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-545ae6c7-99b1-4977-bcbe-0a27b403fff4 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:04.972328 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-545ae6c7-99b1-4977-bcbe-0a27b403fff4 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:04.973634 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-545ae6c7-99b1-4977-bcbe-0a27b403fff4 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:04.974479 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-545ae6c7-99b1-4977-bcbe-0a27b403fff4 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:04.975293 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-545ae6c7-99b1-4977-bcbe-0a27b403fff4 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:05.237358 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-189c1d11-7b46-464f-b571-5e56fde4834b tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9d40e54481461cba53fedb9a6abdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed2295a58f8451993a57ce0a6f9ba29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:05.250811 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-189c1d11-7b46-464f-b571-5e56fde4834b tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] 10.222.0.60 "GET /compute/v2.1/servers/d0c5547a-1340-4d19-a0f9-3e1eb9fd1932" status: 200 len: 1316 microversion: 2.1 time: 0.420366 Sep 14 08:59:05.252351 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1227/2406] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:04 2022] GET /compute/v2.1/servers/d0c5547a-1340-4d19-a0f9-3e1eb9fd1932 => generated 1316 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:59:05.447546 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-3316202c-ee3b-4b64-a46a-4691f51b67a4 tempest-ImagesDeleteNegativeTestJSON-1581000774 tempest-ImagesDeleteNegativeTestJSON-1581000774-project] 10.222.0.60 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.193835 Sep 14 08:59:05.449061 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1228/2407] 10.222.0.60 () {58 vars in 1128 bytes} [Wed Sep 14 08:59:05 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 14 08:59:05.453639 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-545ae6c7-99b1-4977-bcbe-0a27b403fff4 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:05.457321 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a0e1d406-84ec-4139-9538-480342761f9d tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:05.459531 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-a0e1d406-84ec-4139-9538-480342761f9d tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: affb61a7-7e36-4424-bf48-a5a6bd64ae29] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:05.469402 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a0e1d406-84ec-4139-9538-480342761f9d tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:05.470648 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a0e1d406-84ec-4139-9538-480342761f9d tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:05.471586 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a0e1d406-84ec-4139-9538-480342761f9d tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:05.472594 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a0e1d406-84ec-4139-9538-480342761f9d tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:05.473387 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a0e1d406-84ec-4139-9538-480342761f9d tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:05.474206 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a0e1d406-84ec-4139-9538-480342761f9d tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:05.479678 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-545ae6c7-99b1-4977-bcbe-0a27b403fff4 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:05.482371 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-545ae6c7-99b1-4977-bcbe-0a27b403fff4 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:05.483933 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-545ae6c7-99b1-4977-bcbe-0a27b403fff4 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] 10.222.0.60 "GET /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0" status: 200 len: 2831 microversion: 2.32 time: 0.549210 Sep 14 08:59:05.484799 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1180/2408] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:59:04 2022] GET /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0 => generated 2831 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:59:05.492369 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-4c9f3daf-3d6f-4d78-beca-6645918676f9 req-eb698914-2bdc-4d01-bc6c-d9bd406af36d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "885dfd01-8bac-4691-ad0b-f2218e306f2e", "name": "network-vif-plugged", "status": "completed", "tag": "7a58cd39-a33e-4a69-ac2a-b45bd18e6b98"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:59:05.506428 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-4c9f3daf-3d6f-4d78-beca-6645918676f9 req-eb698914-2bdc-4d01-bc6c-d9bd406af36d service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:05.512120 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-4c9f3daf-3d6f-4d78-beca-6645918676f9 req-eb698914-2bdc-4d01-bc6c-d9bd406af36d service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:05.512861 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-4c9f3daf-3d6f-4d78-beca-6645918676f9 req-eb698914-2bdc-4d01-bc6c-d9bd406af36d service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:05.528948 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-4c9f3daf-3d6f-4d78-beca-6645918676f9 req-eb698914-2bdc-4d01-bc6c-d9bd406af36d service nova] Creating event network-vif-plugged:7a58cd39-a33e-4a69-ac2a-b45bd18e6b98 for instance 885dfd01-8bac-4691-ad0b-f2218e306f2e on n-h1-836830-18 Sep 14 08:59:05.537070 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-4c9f3daf-3d6f-4d78-beca-6645918676f9 req-eb698914-2bdc-4d01-bc6c-d9bd406af36d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048722 Sep 14 08:59:05.538126 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1181/2409] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:59:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:59:05.550038 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-dd3d9d4c-2b0b-4faa-a89c-d5f0ff4133fe tempest-ImagesDeleteNegativeTestJSON-1581000774 tempest-ImagesDeleteNegativeTestJSON-1581000774-project] Calling method '.version_select at 0x7f7d44176790>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:05.584403 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-dd3d9d4c-2b0b-4faa-a89c-d5f0ff4133fe tempest-ImagesDeleteNegativeTestJSON-1581000774 tempest-ImagesDeleteNegativeTestJSON-1581000774-project] HTTP exception thrown: Image not found. Sep 14 08:59:05.586525 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-dd3d9d4c-2b0b-4faa-a89c-d5f0ff4133fe tempest-ImagesDeleteNegativeTestJSON-1581000774 tempest-ImagesDeleteNegativeTestJSON-1581000774-project] Request method failure captured: Sep 14 08:59:05.586525 n-d-836830-18 devstack@n-api.service[128759]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Sep 14 08:59:05.586525 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 08:59:05.586525 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 08:59:05.586525 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 08:59:05.586525 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 08:59:05.586525 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 08:59:05.586525 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 08:59:05.586525 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 08:59:05.586525 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 08:59:05.586525 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZfYWHUAwuRR9GnzOwL4voQwmNdsEmrHKBL4LVOVwwgo8HG6V8G2A69aOBDtmt2uTkbxwnPr8zXImcmBhV9aN1C1vm8bSmFsojSgyQJS5pdNVzMksIeqgpgYorvo78uRgnaFMxAawUAb0Vs8QZHBQcCh_8QadoCDfqwf_uhYh1ctm3I Sep 14 08:59:05.586525 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 08:59:05.586525 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 08:59:05.586525 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 08:59:05.586525 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 08:59:05.586525 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 08:59:05.586525 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 08:59:05.586525 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 31a8d222010f4b0fb1cdad4fac9d7676 Sep 14 08:59:05.586525 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1581000774 Sep 14 08:59:05.586525 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 08:59:05.586525 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 08:59:05.586525 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/31a8d222010f4b0fb1cdad4fac9d7676"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_31a8d222010f4b0fb1cdad4fac9d7676"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/31a8d222010f4b0fb1cdad4fac9d7676"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/31a8d222010f4b0fb1cdad4fac9d7676"}]}] Sep 14 08:59:05.586525 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1581000774 Sep 14 08:59:05.586525 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 31a8d222010f4b0fb1cdad4fac9d7676 Sep 14 08:59:05.586525 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1581000774 Sep 14 08:59:05.586525 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ImagesDeleteNegativeTestJSON-1581000774-project Sep 14 08:59:05.586525 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 08:59:05.586525 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 08:59:05.586525 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: f28c1794b6c14b8282b4f4afb204480b Sep 14 08:59:05.586525 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1581000774-project Sep 14 08:59:05.586525 n-d-836830-18 devstack@n-api.service[128759]: method: Sep 14 08:59:05.586525 n-d-836830-18 devstack@n-api.service[128759]: exception: Image not found. Sep 14 08:59:05.586525 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '-1'} Sep 14 08:59:05.586525 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:59:05.586525 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:59:05.586525 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 14 08:59:05.586525 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 14 08:59:05.586525 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 14 08:59:05.586525 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 14 08:59:05.586525 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 14 08:59:05.586525 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 14 08:59:05.586525 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 14 08:59:05.586525 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 14 08:59:05.586525 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 14 08:59:05.586525 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 14 08:59:05.586525 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 14 08:59:05.586525 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 14 08:59:05.586525 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 14 08:59:05.586525 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 14 08:59:05.586525 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Sep 14 08:59:05.586525 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:59:05.586525 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:59:05.586525 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:59:05.586525 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:59:05.586525 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 14 08:59:05.586525 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 14 08:59:05.586525 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 14 08:59:05.586525 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 14 08:59:05.586525 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 14 08:59:05.586525 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 14 08:59:05.586525 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Sep 14 08:59:05.586525 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:59:05.586525 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:59:05.586525 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:59:05.586525 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:59:05.591017 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:59:05.591017 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:59:05.591017 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:59:05.591017 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:59:05.591017 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 08:59:05.591017 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 08:59:05.591017 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:59:05.591017 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:59:05.591017 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 14 08:59:05.591017 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 14 08:59:05.591017 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 14 08:59:05.591017 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:59:05.591017 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:59:05.591017 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:59:05.591017 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:59:05.591017 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:59:05.591017 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:59:05.591017 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:59:05.591017 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:59:05.591017 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 14 08:59:05.591017 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:59:05.595132 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-dd3d9d4c-2b0b-4faa-a89c-d5f0ff4133fe tempest-ImagesDeleteNegativeTestJSON-1581000774 tempest-ImagesDeleteNegativeTestJSON-1581000774-project] Returning 404 to user: Image not found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:59:05.596971 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-dd3d9d4c-2b0b-4faa-a89c-d5f0ff4133fe tempest-ImagesDeleteNegativeTestJSON-1581000774 tempest-ImagesDeleteNegativeTestJSON-1581000774-project] 10.222.0.60 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.051119 Sep 14 08:59:05.599724 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1182/2410] 10.222.0.60 () {58 vars in 1134 bytes} [Wed Sep 14 08:59:05 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 14 08:59:05.609257 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-5defa6d9-c637-4b6d-9e21-a4853e9e4512 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:05.609889 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-5defa6d9-c637-4b6d-9e21-a4853e9e4512 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] [instance: 26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:05.624625 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5defa6d9-c637-4b6d-9e21-a4853e9e4512 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:05.625217 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5defa6d9-c637-4b6d-9e21-a4853e9e4512 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:05.626872 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5defa6d9-c637-4b6d-9e21-a4853e9e4512 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:05.627815 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5defa6d9-c637-4b6d-9e21-a4853e9e4512 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:05.628751 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5defa6d9-c637-4b6d-9e21-a4853e9e4512 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:05.629528 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5defa6d9-c637-4b6d-9e21-a4853e9e4512 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:05.882957 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-5defa6d9-c637-4b6d-9e21-a4853e9e4512 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] 10.222.0.60 "GET /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0/os-interface" status: 200 len: 1831 microversion: 2.32 time: 0.278148 Sep 14 08:59:05.883831 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1183/2411] 10.222.0.60 () {60 vars in 1316 bytes} [Wed Sep 14 08:59:05 2022] GET /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0/os-interface => generated 1831 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:59:05.888985 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e2d5c9f8-0283-45b5-89ba-0abb769c755b tempest-ImagesDeleteNegativeTestJSON-1581000774 tempest-ImagesDeleteNegativeTestJSON-1581000774-project] Calling method '.version_select at 0x7f7d44176790>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:05.920431 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-e2d5c9f8-0283-45b5-89ba-0abb769c755b tempest-ImagesDeleteNegativeTestJSON-1581000774 tempest-ImagesDeleteNegativeTestJSON-1581000774-project] HTTP exception thrown: Image not found. Sep 14 08:59:05.923715 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e2d5c9f8-0283-45b5-89ba-0abb769c755b tempest-ImagesDeleteNegativeTestJSON-1581000774 tempest-ImagesDeleteNegativeTestJSON-1581000774-project] Request method failure captured: Sep 14 08:59:05.923715 n-d-836830-18 devstack@n-api.service[128759]: request: DELETE /compute/v2.1/images/55b6e3ff-11b8-4014-8cf9-fca6c43f8dbj HTTP/1.1 Sep 14 08:59:05.923715 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 08:59:05.923715 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 08:59:05.923715 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 08:59:05.923715 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 08:59:05.923715 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 08:59:05.923715 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 08:59:05.923715 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 08:59:05.923715 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 08:59:05.923715 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZfYWHUAwuRR9GnzOwL4voQwmNdsEmrHKBL4LVOVwwgo8HG6V8G2A69aOBDtmt2uTkbxwnPr8zXImcmBhV9aN1C1vm8bSmFsojSgyQJS5pdNVzMksIeqgpgYorvo78uRgnaFMxAawUAb0Vs8QZHBQcCh_8QadoCDfqwf_uhYh1ctm3I Sep 14 08:59:05.923715 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 08:59:05.923715 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 08:59:05.923715 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 08:59:05.923715 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 08:59:05.923715 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 08:59:05.923715 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 08:59:05.923715 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 31a8d222010f4b0fb1cdad4fac9d7676 Sep 14 08:59:05.923715 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1581000774 Sep 14 08:59:05.923715 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 08:59:05.923715 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 08:59:05.923715 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/31a8d222010f4b0fb1cdad4fac9d7676"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_31a8d222010f4b0fb1cdad4fac9d7676"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/31a8d222010f4b0fb1cdad4fac9d7676"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/31a8d222010f4b0fb1cdad4fac9d7676"}]}] Sep 14 08:59:05.923715 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1581000774 Sep 14 08:59:05.923715 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 31a8d222010f4b0fb1cdad4fac9d7676 Sep 14 08:59:05.923715 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1581000774 Sep 14 08:59:05.923715 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ImagesDeleteNegativeTestJSON-1581000774-project Sep 14 08:59:05.923715 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 08:59:05.923715 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 08:59:05.923715 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: f28c1794b6c14b8282b4f4afb204480b Sep 14 08:59:05.923715 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1581000774-project Sep 14 08:59:05.923715 n-d-836830-18 devstack@n-api.service[128759]: method: Sep 14 08:59:05.923715 n-d-836830-18 devstack@n-api.service[128759]: exception: Image not found. Sep 14 08:59:05.923715 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '55b6e3ff-11b8-4014-8cf9-fca6c43f8dbj'} Sep 14 08:59:05.923715 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:59:05.923715 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:59:05.923715 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 14 08:59:05.923715 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 14 08:59:05.923715 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 14 08:59:05.923715 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 14 08:59:05.923715 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 14 08:59:05.923715 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 14 08:59:05.923715 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 14 08:59:05.923715 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 14 08:59:05.923715 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 14 08:59:05.923715 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 14 08:59:05.923715 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 14 08:59:05.923715 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 14 08:59:05.923715 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 14 08:59:05.923715 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 14 08:59:05.923715 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 55b6e3ff-11b8-4014-8cf9-fca6c43f8dbj to delete Sep 14 08:59:05.923715 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:59:05.923715 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:59:05.923715 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:59:05.923715 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:59:05.923715 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 14 08:59:05.923715 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 14 08:59:05.923715 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 14 08:59:05.923715 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 14 08:59:05.923715 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 14 08:59:05.923715 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 14 08:59:05.923715 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 55b6e3ff-11b8-4014-8cf9-fca6c43f8dbj could not be found. Sep 14 08:59:05.923715 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:59:05.923715 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:59:05.923715 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:59:05.929457 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:59:05.929457 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:59:05.929457 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:59:05.929457 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:59:05.929457 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:59:05.929457 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 08:59:05.929457 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 08:59:05.929457 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:59:05.929457 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:59:05.929457 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 14 08:59:05.929457 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 14 08:59:05.929457 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 14 08:59:05.929457 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:59:05.929457 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:59:05.929457 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:59:05.929457 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:59:05.929457 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:59:05.929457 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:59:05.929457 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:59:05.929457 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:59:05.929457 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 14 08:59:05.929457 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:59:05.932149 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e2d5c9f8-0283-45b5-89ba-0abb769c755b tempest-ImagesDeleteNegativeTestJSON-1581000774 tempest-ImagesDeleteNegativeTestJSON-1581000774-project] Returning 404 to user: Image not found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:59:05.933369 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e2d5c9f8-0283-45b5-89ba-0abb769c755b tempest-ImagesDeleteNegativeTestJSON-1581000774 tempest-ImagesDeleteNegativeTestJSON-1581000774-project] 10.222.0.60 "DELETE /compute/v2.1/images/55b6e3ff-11b8-4014-8cf9-fca6c43f8dbj" status: 404 len: 62 microversion: 2.1 time: 0.048399 Sep 14 08:59:05.939594 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1184/2412] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:05 2022] DELETE /compute/v2.1/images/55b6e3ff-11b8-4014-8cf9-fca6c43f8dbj => generated 62 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 14 08:59:05.951733 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-76bcc928-8741-4f75-95db-f2a3f5e23604 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:05.952363 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-76bcc928-8741-4f75-95db-f2a3f5e23604 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] [instance: 885dfd01-8bac-4691-ad0b-f2218e306f2e] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:05.963380 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-76bcc928-8741-4f75-95db-f2a3f5e23604 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:05.964269 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-76bcc928-8741-4f75-95db-f2a3f5e23604 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:05.964891 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-76bcc928-8741-4f75-95db-f2a3f5e23604 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:05.966050 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-76bcc928-8741-4f75-95db-f2a3f5e23604 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:05.967378 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-76bcc928-8741-4f75-95db-f2a3f5e23604 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:05.968007 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-76bcc928-8741-4f75-95db-f2a3f5e23604 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:05.972763 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-a0e1d406-84ec-4139-9538-480342761f9d tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:05.983585 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-a0e1d406-84ec-4139-9538-480342761f9d tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/affb61a7-7e36-4424-bf48-a5a6bd64ae29" status: 200 len: 1509 microversion: 2.1 time: 0.533259 Sep 14 08:59:05.987303 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1229/2413] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:05 2022] GET /compute/v2.1/servers/affb61a7-7e36-4424-bf48-a5a6bd64ae29 => generated 1509 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:59:06.012909 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-4f7feb56-742d-4284-a787-f5881fbf377f tempest-ImagesDeleteNegativeTestJSON-1581000774 tempest-ImagesDeleteNegativeTestJSON-1581000774-project] Calling method '.version_select at 0x7f7d44604670>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:06.037772 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-4f7feb56-742d-4284-a787-f5881fbf377f tempest-ImagesDeleteNegativeTestJSON-1581000774 tempest-ImagesDeleteNegativeTestJSON-1581000774-project] HTTP exception thrown: Image not found. Sep 14 08:59:06.039886 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-4f7feb56-742d-4284-a787-f5881fbf377f tempest-ImagesDeleteNegativeTestJSON-1581000774 tempest-ImagesDeleteNegativeTestJSON-1581000774-project] Request method failure captured: Sep 14 08:59:06.039886 n-d-836830-18 devstack@n-api.service[128758]: request: DELETE /compute/v2.1/images/c1145520-bee3-43aa-a7a5-d92d070bc2bf1 HTTP/1.1 Sep 14 08:59:06.039886 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 08:59:06.039886 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 08:59:06.039886 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 08:59:06.039886 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 08:59:06.039886 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 08:59:06.039886 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 08:59:06.039886 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 08:59:06.039886 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 08:59:06.039886 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZfYWHUAwuRR9GnzOwL4voQwmNdsEmrHKBL4LVOVwwgo8HG6V8G2A69aOBDtmt2uTkbxwnPr8zXImcmBhV9aN1C1vm8bSmFsojSgyQJS5pdNVzMksIeqgpgYorvo78uRgnaFMxAawUAb0Vs8QZHBQcCh_8QadoCDfqwf_uhYh1ctm3I Sep 14 08:59:06.039886 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 08:59:06.039886 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 08:59:06.039886 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 08:59:06.039886 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 08:59:06.039886 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 08:59:06.039886 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 08:59:06.039886 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 31a8d222010f4b0fb1cdad4fac9d7676 Sep 14 08:59:06.039886 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1581000774 Sep 14 08:59:06.039886 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 08:59:06.039886 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 08:59:06.039886 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/31a8d222010f4b0fb1cdad4fac9d7676"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_31a8d222010f4b0fb1cdad4fac9d7676"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/31a8d222010f4b0fb1cdad4fac9d7676"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/31a8d222010f4b0fb1cdad4fac9d7676"}]}] Sep 14 08:59:06.039886 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1581000774 Sep 14 08:59:06.039886 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 31a8d222010f4b0fb1cdad4fac9d7676 Sep 14 08:59:06.039886 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1581000774 Sep 14 08:59:06.039886 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-ImagesDeleteNegativeTestJSON-1581000774-project Sep 14 08:59:06.039886 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 08:59:06.039886 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 08:59:06.039886 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: f28c1794b6c14b8282b4f4afb204480b Sep 14 08:59:06.039886 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1581000774-project Sep 14 08:59:06.039886 n-d-836830-18 devstack@n-api.service[128758]: method: Sep 14 08:59:06.039886 n-d-836830-18 devstack@n-api.service[128758]: exception: Image not found. Sep 14 08:59:06.039886 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': 'c1145520-bee3-43aa-a7a5-d92d070bc2bf1'} Sep 14 08:59:06.039886 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:59:06.039886 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:59:06.039886 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 14 08:59:06.039886 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 14 08:59:06.039886 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 14 08:59:06.039886 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 14 08:59:06.039886 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 14 08:59:06.039886 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 14 08:59:06.039886 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 14 08:59:06.039886 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 14 08:59:06.039886 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 14 08:59:06.039886 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 14 08:59:06.039886 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 14 08:59:06.039886 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 14 08:59:06.039886 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 14 08:59:06.039886 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 14 08:59:06.039886 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image c1145520-bee3-43aa-a7a5-d92d070bc2bf1 to delete Sep 14 08:59:06.039886 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:59:06.039886 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:59:06.039886 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:59:06.039886 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:59:06.039886 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 14 08:59:06.039886 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 14 08:59:06.039886 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 14 08:59:06.039886 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 14 08:59:06.039886 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 14 08:59:06.039886 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 14 08:59:06.039886 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c1145520-bee3-43aa-a7a5-d92d070bc2bf1 could not be found. Sep 14 08:59:06.039886 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:59:06.039886 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:59:06.039886 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:59:06.044363 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:59:06.044363 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:59:06.044363 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:59:06.044363 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:59:06.044363 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:59:06.044363 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 08:59:06.044363 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 08:59:06.044363 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:59:06.044363 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:59:06.044363 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 14 08:59:06.044363 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 14 08:59:06.044363 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 14 08:59:06.044363 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:59:06.044363 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:59:06.044363 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:59:06.044363 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:59:06.044363 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:59:06.044363 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:59:06.044363 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:59:06.044363 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:59:06.044363 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 14 08:59:06.044363 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:59:06.047095 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-4f7feb56-742d-4284-a787-f5881fbf377f tempest-ImagesDeleteNegativeTestJSON-1581000774 tempest-ImagesDeleteNegativeTestJSON-1581000774-project] Returning 404 to user: Image not found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:59:06.048120 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-4f7feb56-742d-4284-a787-f5881fbf377f tempest-ImagesDeleteNegativeTestJSON-1581000774 tempest-ImagesDeleteNegativeTestJSON-1581000774-project] 10.222.0.60 "DELETE /compute/v2.1/images/c1145520-bee3-43aa-a7a5-d92d070bc2bf1" status: 404 len: 62 microversion: 2.1 time: 0.039128 Sep 14 08:59:06.049174 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1230/2414] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 08:59:05 2022] DELETE /compute/v2.1/images/c1145520-bee3-43aa-a7a5-d92d070bc2bf1 => generated 62 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 14 08:59:06.056266 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-47ea7d3c-ce2e-41d1-8561-43d527a1f0c1 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:06.057151 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-47ea7d3c-ce2e-41d1-8561-43d527a1f0c1 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: affb61a7-7e36-4424-bf48-a5a6bd64ae29] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:06.064781 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-47ea7d3c-ce2e-41d1-8561-43d527a1f0c1 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:06.065286 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-47ea7d3c-ce2e-41d1-8561-43d527a1f0c1 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:06.065722 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-47ea7d3c-ce2e-41d1-8561-43d527a1f0c1 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:06.066429 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-47ea7d3c-ce2e-41d1-8561-43d527a1f0c1 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:06.066886 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-47ea7d3c-ce2e-41d1-8561-43d527a1f0c1 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:06.068113 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-47ea7d3c-ce2e-41d1-8561-43d527a1f0c1 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:06.719551 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-76bcc928-8741-4f75-95db-f2a3f5e23604 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ab7166e40e4a908eefbfb03b3b8804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de82b83dadd541dbb4a939f2fc04a163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:06.738265 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-47ea7d3c-ce2e-41d1-8561-43d527a1f0c1 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:06.769124 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-76bcc928-8741-4f75-95db-f2a3f5e23604 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] 10.222.0.60 "GET /compute/v2.1/servers/885dfd01-8bac-4691-ad0b-f2218e306f2e" status: 200 len: 1366 microversion: 2.1 time: 0.820930 Sep 14 08:59:06.769828 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-47ea7d3c-ce2e-41d1-8561-43d527a1f0c1 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/affb61a7-7e36-4424-bf48-a5a6bd64ae29" status: 200 len: 1509 microversion: 2.1 time: 0.717570 Sep 14 08:59:06.771841 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1231/2415] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:06 2022] GET /compute/v2.1/servers/affb61a7-7e36-4424-bf48-a5a6bd64ae29 => generated 1509 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:59:06.774102 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1185/2416] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:05 2022] GET /compute/v2.1/servers/885dfd01-8bac-4691-ad0b-f2218e306f2e => generated 1366 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:59:06.793162 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d0900cb4-3517-430e-b5b4-8fca0657a026 tempest-ImagesDeleteNegativeTestJSON-1581000774 tempest-ImagesDeleteNegativeTestJSON-1581000774-project] Calling method '.version_select at 0x7f7d448eeb80>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:06.794747 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-1d2b2d81-ab58-41a3-9b26-97ea80cb6074 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:06.802537 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-1d2b2d81-ab58-41a3-9b26-97ea80cb6074 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: d0c5547a-1340-4d19-a0f9-3e1eb9fd1932] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:06.818638 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1d2b2d81-ab58-41a3-9b26-97ea80cb6074 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:06.835761 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-d0900cb4-3517-430e-b5b4-8fca0657a026 tempest-ImagesDeleteNegativeTestJSON-1581000774 tempest-ImagesDeleteNegativeTestJSON-1581000774-project] HTTP exception thrown: Image not found. Sep 14 08:59:06.837793 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d0900cb4-3517-430e-b5b4-8fca0657a026 tempest-ImagesDeleteNegativeTestJSON-1581000774 tempest-ImagesDeleteNegativeTestJSON-1581000774-project] Request method failure captured: Sep 14 08:59:06.837793 n-d-836830-18 devstack@n-api.service[128758]: request: DELETE /compute/v2.1/images/tempest-invalid-1610798287 HTTP/1.1 Sep 14 08:59:06.837793 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 08:59:06.837793 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 08:59:06.837793 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 08:59:06.837793 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 08:59:06.837793 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 08:59:06.837793 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 08:59:06.837793 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 08:59:06.837793 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 08:59:06.837793 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZfYWHUAwuRR9GnzOwL4voQwmNdsEmrHKBL4LVOVwwgo8HG6V8G2A69aOBDtmt2uTkbxwnPr8zXImcmBhV9aN1C1vm8bSmFsojSgyQJS5pdNVzMksIeqgpgYorvo78uRgnaFMxAawUAb0Vs8QZHBQcCh_8QadoCDfqwf_uhYh1ctm3I Sep 14 08:59:06.837793 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 08:59:06.837793 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 08:59:06.837793 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 08:59:06.837793 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 08:59:06.837793 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 08:59:06.837793 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 08:59:06.837793 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 31a8d222010f4b0fb1cdad4fac9d7676 Sep 14 08:59:06.837793 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1581000774 Sep 14 08:59:06.837793 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 08:59:06.837793 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 08:59:06.837793 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/31a8d222010f4b0fb1cdad4fac9d7676"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_31a8d222010f4b0fb1cdad4fac9d7676"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/31a8d222010f4b0fb1cdad4fac9d7676"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/31a8d222010f4b0fb1cdad4fac9d7676"}]}] Sep 14 08:59:06.837793 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1581000774 Sep 14 08:59:06.837793 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 31a8d222010f4b0fb1cdad4fac9d7676 Sep 14 08:59:06.837793 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1581000774 Sep 14 08:59:06.837793 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-ImagesDeleteNegativeTestJSON-1581000774-project Sep 14 08:59:06.837793 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 08:59:06.837793 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 08:59:06.837793 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: f28c1794b6c14b8282b4f4afb204480b Sep 14 08:59:06.837793 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1581000774-project Sep 14 08:59:06.837793 n-d-836830-18 devstack@n-api.service[128758]: method: Sep 14 08:59:06.837793 n-d-836830-18 devstack@n-api.service[128758]: exception: Image not found. Sep 14 08:59:06.837793 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': 'tempest-invalid-1610798287'} Sep 14 08:59:06.837793 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:59:06.837793 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:59:06.837793 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 14 08:59:06.837793 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 14 08:59:06.837793 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 14 08:59:06.837793 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 14 08:59:06.837793 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 14 08:59:06.837793 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 14 08:59:06.837793 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 14 08:59:06.837793 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 14 08:59:06.837793 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 14 08:59:06.837793 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 14 08:59:06.837793 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 14 08:59:06.837793 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 14 08:59:06.837793 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 14 08:59:06.837793 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 14 08:59:06.837793 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-1610798287 to delete Sep 14 08:59:06.837793 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:59:06.837793 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:59:06.837793 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:59:06.837793 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:59:06.837793 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 14 08:59:06.837793 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 14 08:59:06.837793 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 14 08:59:06.837793 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 14 08:59:06.837793 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 14 08:59:06.837793 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 14 08:59:06.837793 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-1610798287 could not be found. Sep 14 08:59:06.837793 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:59:06.837793 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:59:06.837793 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:59:06.837793 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:59:06.842983 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:59:06.842983 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:59:06.842983 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:59:06.842983 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:59:06.842983 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 08:59:06.842983 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 08:59:06.842983 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:59:06.842983 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:59:06.842983 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 14 08:59:06.842983 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 14 08:59:06.842983 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 14 08:59:06.842983 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:59:06.842983 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:59:06.842983 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:59:06.842983 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:59:06.842983 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:59:06.842983 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:59:06.842983 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:59:06.842983 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:59:06.842983 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 14 08:59:06.842983 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:59:06.848822 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1d2b2d81-ab58-41a3-9b26-97ea80cb6074 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.030s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:06.849523 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1d2b2d81-ab58-41a3-9b26-97ea80cb6074 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:06.855739 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1d2b2d81-ab58-41a3-9b26-97ea80cb6074 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:06.857439 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d0900cb4-3517-430e-b5b4-8fca0657a026 tempest-ImagesDeleteNegativeTestJSON-1581000774 tempest-ImagesDeleteNegativeTestJSON-1581000774-project] Returning 404 to user: Image not found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:59:06.858995 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1d2b2d81-ab58-41a3-9b26-97ea80cb6074 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:06.862116 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1d2b2d81-ab58-41a3-9b26-97ea80cb6074 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:06.863293 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-d0900cb4-3517-430e-b5b4-8fca0657a026 tempest-ImagesDeleteNegativeTestJSON-1581000774 tempest-ImagesDeleteNegativeTestJSON-1581000774-project] 10.222.0.60 "DELETE /compute/v2.1/images/tempest-invalid-1610798287" status: 404 len: 62 microversion: 2.1 time: 0.085112 Sep 14 08:59:06.871533 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1232/2417] 10.222.0.60 () {58 vars in 1206 bytes} [Wed Sep 14 08:59:06 2022] DELETE /compute/v2.1/images/tempest-invalid-1610798287 => generated 62 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 14 08:59:06.888049 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b6ec3167-0482-4f7f-8bb9-642b5c1f68d8 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:06.894232 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-b6ec3167-0482-4f7f-8bb9-642b5c1f68d8 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: affb61a7-7e36-4424-bf48-a5a6bd64ae29] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:06.910345 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b6ec3167-0482-4f7f-8bb9-642b5c1f68d8 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:06.921338 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b6ec3167-0482-4f7f-8bb9-642b5c1f68d8 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:06.921936 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b6ec3167-0482-4f7f-8bb9-642b5c1f68d8 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:06.922835 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b6ec3167-0482-4f7f-8bb9-642b5c1f68d8 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:06.925254 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b6ec3167-0482-4f7f-8bb9-642b5c1f68d8 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:06.929919 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b6ec3167-0482-4f7f-8bb9-642b5c1f68d8 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:06.991398 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-b6ec3167-0482-4f7f-8bb9-642b5c1f68d8 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: affb61a7-7e36-4424-bf48-a5a6bd64ae29] Going to try to terminate instance {{(pid=128758) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 08:59:07.216997 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-b6ec3167-0482-4f7f-8bb9-642b5c1f68d8 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "DELETE /compute/v2.1/servers/affb61a7-7e36-4424-bf48-a5a6bd64ae29" status: 204 len: 0 microversion: 2.1 time: 0.343050 Sep 14 08:59:07.217842 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1233/2418] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 08:59:06 2022] DELETE /compute/v2.1/servers/affb61a7-7e36-4424-bf48-a5a6bd64ae29 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 08:59:07.225522 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-91cfcb83-a0c2-4d07-91fc-ffbcdd5d0eff tempest-ImagesDeleteNegativeTestJSON-1581000774 tempest-ImagesDeleteNegativeTestJSON-1581000774-project] Calling method '.version_select at 0x7f7d445e9550>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:07.264498 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-91cfcb83-a0c2-4d07-91fc-ffbcdd5d0eff tempest-ImagesDeleteNegativeTestJSON-1581000774 tempest-ImagesDeleteNegativeTestJSON-1581000774-project] HTTP exception thrown: Image not found. Sep 14 08:59:07.266687 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-91cfcb83-a0c2-4d07-91fc-ffbcdd5d0eff tempest-ImagesDeleteNegativeTestJSON-1581000774 tempest-ImagesDeleteNegativeTestJSON-1581000774-project] Request method failure captured: Sep 14 08:59:07.266687 n-d-836830-18 devstack@n-api.service[128758]: request: DELETE /compute/v2.1/images/5108abf1-ebc3-4057-8665-16fb71497ae8 HTTP/1.1 Sep 14 08:59:07.266687 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 08:59:07.266687 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 08:59:07.266687 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 08:59:07.266687 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 08:59:07.266687 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 08:59:07.266687 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 08:59:07.266687 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 08:59:07.266687 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 08:59:07.266687 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZfYWHUAwuRR9GnzOwL4voQwmNdsEmrHKBL4LVOVwwgo8HG6V8G2A69aOBDtmt2uTkbxwnPr8zXImcmBhV9aN1C1vm8bSmFsojSgyQJS5pdNVzMksIeqgpgYorvo78uRgnaFMxAawUAb0Vs8QZHBQcCh_8QadoCDfqwf_uhYh1ctm3I Sep 14 08:59:07.266687 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 08:59:07.266687 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 08:59:07.266687 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 08:59:07.266687 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 08:59:07.266687 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 08:59:07.266687 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 08:59:07.266687 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 31a8d222010f4b0fb1cdad4fac9d7676 Sep 14 08:59:07.266687 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1581000774 Sep 14 08:59:07.266687 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 08:59:07.266687 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 08:59:07.266687 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/31a8d222010f4b0fb1cdad4fac9d7676"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_31a8d222010f4b0fb1cdad4fac9d7676"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/31a8d222010f4b0fb1cdad4fac9d7676"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/31a8d222010f4b0fb1cdad4fac9d7676"}]}] Sep 14 08:59:07.266687 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1581000774 Sep 14 08:59:07.266687 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 31a8d222010f4b0fb1cdad4fac9d7676 Sep 14 08:59:07.266687 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1581000774 Sep 14 08:59:07.266687 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-ImagesDeleteNegativeTestJSON-1581000774-project Sep 14 08:59:07.266687 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 08:59:07.266687 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 08:59:07.266687 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: f28c1794b6c14b8282b4f4afb204480b Sep 14 08:59:07.266687 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1581000774-project Sep 14 08:59:07.266687 n-d-836830-18 devstack@n-api.service[128758]: method: Sep 14 08:59:07.266687 n-d-836830-18 devstack@n-api.service[128758]: exception: Image not found. Sep 14 08:59:07.266687 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': '5108abf1-ebc3-4057-8665-16fb71497ae8'} Sep 14 08:59:07.266687 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:59:07.266687 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:59:07.266687 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 14 08:59:07.266687 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 14 08:59:07.266687 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 14 08:59:07.266687 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 14 08:59:07.266687 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 14 08:59:07.266687 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 14 08:59:07.266687 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 14 08:59:07.266687 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 14 08:59:07.266687 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 14 08:59:07.266687 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 14 08:59:07.266687 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 14 08:59:07.266687 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 14 08:59:07.266687 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 14 08:59:07.266687 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 14 08:59:07.266687 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 5108abf1-ebc3-4057-8665-16fb71497ae8 to delete Sep 14 08:59:07.266687 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:59:07.266687 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:59:07.266687 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:59:07.266687 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:59:07.266687 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 14 08:59:07.266687 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 14 08:59:07.266687 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 14 08:59:07.266687 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 14 08:59:07.266687 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 14 08:59:07.266687 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 14 08:59:07.266687 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 5108abf1-ebc3-4057-8665-16fb71497ae8 could not be found. Sep 14 08:59:07.266687 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:59:07.266687 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:59:07.266687 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:59:07.271488 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:59:07.271488 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:59:07.271488 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:59:07.271488 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:59:07.271488 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:59:07.271488 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 08:59:07.271488 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 08:59:07.271488 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:59:07.271488 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:59:07.271488 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 14 08:59:07.271488 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 14 08:59:07.271488 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 14 08:59:07.271488 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:59:07.271488 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:59:07.271488 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:59:07.271488 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:59:07.271488 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:59:07.271488 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:59:07.271488 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:59:07.271488 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:59:07.271488 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 14 08:59:07.271488 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:59:07.278075 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-91cfcb83-a0c2-4d07-91fc-ffbcdd5d0eff tempest-ImagesDeleteNegativeTestJSON-1581000774 tempest-ImagesDeleteNegativeTestJSON-1581000774-project] Returning 404 to user: Image not found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:59:07.280564 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-91cfcb83-a0c2-4d07-91fc-ffbcdd5d0eff tempest-ImagesDeleteNegativeTestJSON-1581000774 tempest-ImagesDeleteNegativeTestJSON-1581000774-project] 10.222.0.60 "DELETE /compute/v2.1/images/5108abf1-ebc3-4057-8665-16fb71497ae8" status: 404 len: 62 microversion: 2.1 time: 0.061112 Sep 14 08:59:07.281399 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1234/2419] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:07 2022] DELETE /compute/v2.1/images/5108abf1-ebc3-4057-8665-16fb71497ae8 => generated 62 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 14 08:59:07.289444 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b9115e18-7d82-4b69-aec0-2b38aaff898d tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:07.291742 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-b9115e18-7d82-4b69-aec0-2b38aaff898d tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: affb61a7-7e36-4424-bf48-a5a6bd64ae29] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:07.299811 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b9115e18-7d82-4b69-aec0-2b38aaff898d tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:07.300690 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b9115e18-7d82-4b69-aec0-2b38aaff898d tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:07.301427 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b9115e18-7d82-4b69-aec0-2b38aaff898d tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:07.302370 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b9115e18-7d82-4b69-aec0-2b38aaff898d tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:07.303089 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b9115e18-7d82-4b69-aec0-2b38aaff898d tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:07.303770 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b9115e18-7d82-4b69-aec0-2b38aaff898d tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:07.432520 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-1d2b2d81-ab58-41a3-9b26-97ea80cb6074 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9d40e54481461cba53fedb9a6abdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed2295a58f8451993a57ce0a6f9ba29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:07.449293 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-1d2b2d81-ab58-41a3-9b26-97ea80cb6074 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] 10.222.0.60 "GET /compute/v2.1/servers/d0c5547a-1340-4d19-a0f9-3e1eb9fd1932" status: 200 len: 1506 microversion: 2.1 time: 0.673798 Sep 14 08:59:07.473521 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1186/2420] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:06 2022] GET /compute/v2.1/servers/d0c5547a-1340-4d19-a0f9-3e1eb9fd1932 => generated 1506 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:59:07.488652 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-0d62089c-88d3-469b-9baa-8eb058a78e5c tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:07.491041 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-0d62089c-88d3-469b-9baa-8eb058a78e5c tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: d0c5547a-1340-4d19-a0f9-3e1eb9fd1932] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:07.500182 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0d62089c-88d3-469b-9baa-8eb058a78e5c tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:07.501023 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0d62089c-88d3-469b-9baa-8eb058a78e5c tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:07.501734 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0d62089c-88d3-469b-9baa-8eb058a78e5c tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:07.502973 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0d62089c-88d3-469b-9baa-8eb058a78e5c tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:07.503863 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0d62089c-88d3-469b-9baa-8eb058a78e5c tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:07.504928 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0d62089c-88d3-469b-9baa-8eb058a78e5c tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:07.724893 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-b9115e18-7d82-4b69-aec0-2b38aaff898d tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:07.738498 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-b9115e18-7d82-4b69-aec0-2b38aaff898d tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/affb61a7-7e36-4424-bf48-a5a6bd64ae29" status: 200 len: 1515 microversion: 2.1 time: 0.455626 Sep 14 08:59:07.739662 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1235/2421] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:07 2022] GET /compute/v2.1/servers/affb61a7-7e36-4424-bf48-a5a6bd64ae29 => generated 1515 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:59:07.824411 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-afabe344-9c3e-4eb7-80c5-6b98649086d6 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:07.825318 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-afabe344-9c3e-4eb7-80c5-6b98649086d6 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] [instance: 885dfd01-8bac-4691-ad0b-f2218e306f2e] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:07.838828 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-afabe344-9c3e-4eb7-80c5-6b98649086d6 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:07.839696 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-afabe344-9c3e-4eb7-80c5-6b98649086d6 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:07.840296 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-afabe344-9c3e-4eb7-80c5-6b98649086d6 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:07.841302 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-afabe344-9c3e-4eb7-80c5-6b98649086d6 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:07.841922 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-afabe344-9c3e-4eb7-80c5-6b98649086d6 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:07.842581 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-afabe344-9c3e-4eb7-80c5-6b98649086d6 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:07.848049 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:59:07.959593 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-0d62089c-88d3-469b-9baa-8eb058a78e5c tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9d40e54481461cba53fedb9a6abdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed2295a58f8451993a57ce0a6f9ba29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:07.972832 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-0d62089c-88d3-469b-9baa-8eb058a78e5c tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] 10.222.0.60 "GET /compute/v2.1/servers/d0c5547a-1340-4d19-a0f9-3e1eb9fd1932" status: 200 len: 1506 microversion: 2.1 time: 0.489138 Sep 14 08:59:07.973472 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1187/2422] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:07 2022] GET /compute/v2.1/servers/d0c5547a-1340-4d19-a0f9-3e1eb9fd1932 => generated 1506 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:59:08.003025 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a6e6ffeb-7c31-4879-82e6-aabdb27f9244 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "OS-DCF:diskConfig": "AUTO"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:59:08.010616 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-a6e6ffeb-7c31-4879-82e6-aabdb27f9244 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: d0c5547a-1340-4d19-a0f9-3e1eb9fd1932] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:08.023737 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a6e6ffeb-7c31-4879-82e6-aabdb27f9244 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:08.024473 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a6e6ffeb-7c31-4879-82e6-aabdb27f9244 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:08.025088 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a6e6ffeb-7c31-4879-82e6-aabdb27f9244 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:08.026150 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a6e6ffeb-7c31-4879-82e6-aabdb27f9244 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:08.026773 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a6e6ffeb-7c31-4879-82e6-aabdb27f9244 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:08.027399 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a6e6ffeb-7c31-4879-82e6-aabdb27f9244 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:08.144775 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-a6e6ffeb-7c31-4879-82e6-aabdb27f9244 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Flavor limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 08:59:08.145218 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-a6e6ffeb-7c31-4879-82e6-aabdb27f9244 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Image limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 08:59:08.145757 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-a6e6ffeb-7c31-4879-82e6-aabdb27f9244 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Flavor pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 08:59:08.146275 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-a6e6ffeb-7c31-4879-82e6-aabdb27f9244 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Image pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 08:59:08.146593 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-a6e6ffeb-7c31-4879-82e6-aabdb27f9244 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 08:59:08.228889 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-a6e6ffeb-7c31-4879-82e6-aabdb27f9244 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: d0c5547a-1340-4d19-a0f9-3e1eb9fd1932] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:08.242537 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a6e6ffeb-7c31-4879-82e6-aabdb27f9244 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:08.245547 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a6e6ffeb-7c31-4879-82e6-aabdb27f9244 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:08.246227 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a6e6ffeb-7c31-4879-82e6-aabdb27f9244 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:08.247183 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a6e6ffeb-7c31-4879-82e6-aabdb27f9244 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:08.247854 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a6e6ffeb-7c31-4879-82e6-aabdb27f9244 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:08.248448 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a6e6ffeb-7c31-4879-82e6-aabdb27f9244 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:08.249385 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-afabe344-9c3e-4eb7-80c5-6b98649086d6 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ab7166e40e4a908eefbfb03b3b8804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de82b83dadd541dbb4a939f2fc04a163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:08.266281 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-afabe344-9c3e-4eb7-80c5-6b98649086d6 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] 10.222.0.60 "GET /compute/v2.1/servers/885dfd01-8bac-4691-ad0b-f2218e306f2e" status: 200 len: 1366 microversion: 2.1 time: 0.446352 Sep 14 08:59:08.267959 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1236/2423] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:07 2022] GET /compute/v2.1/servers/885dfd01-8bac-4691-ad0b-f2218e306f2e => generated 1366 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:59:08.312172 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a6e6ffeb-7c31-4879-82e6-aabdb27f9244 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] 10.222.0.60 "POST /compute/v2.1/servers/d0c5547a-1340-4d19-a0f9-3e1eb9fd1932/action" status: 202 len: 1108 microversion: 2.1 time: 0.314337 Sep 14 08:59:08.315588 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1188/2424] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 08:59:07 2022] POST /compute/v2.1/servers/d0c5547a-1340-4d19-a0f9-3e1eb9fd1932/action => generated 1108 bytes in 319 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Sep 14 08:59:08.342544 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-f7486a2a-8865-4756-b79a-1d8af7d3da99 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:08.346089 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-f7486a2a-8865-4756-b79a-1d8af7d3da99 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: d0c5547a-1340-4d19-a0f9-3e1eb9fd1932] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:08.362009 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f7486a2a-8865-4756-b79a-1d8af7d3da99 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:08.362680 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f7486a2a-8865-4756-b79a-1d8af7d3da99 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:08.364342 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f7486a2a-8865-4756-b79a-1d8af7d3da99 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:08.365393 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f7486a2a-8865-4756-b79a-1d8af7d3da99 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:08.366115 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f7486a2a-8865-4756-b79a-1d8af7d3da99 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:08.366667 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f7486a2a-8865-4756-b79a-1d8af7d3da99 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:08.765335 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e269c331-e65e-4685-a578-a1bbd3743982 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:08.766527 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e269c331-e65e-4685-a578-a1bbd3743982 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: affb61a7-7e36-4424-bf48-a5a6bd64ae29] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:08.776875 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e269c331-e65e-4685-a578-a1bbd3743982 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:08.779307 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e269c331-e65e-4685-a578-a1bbd3743982 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:08.782771 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e269c331-e65e-4685-a578-a1bbd3743982 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:08.783740 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e269c331-e65e-4685-a578-a1bbd3743982 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:08.784446 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e269c331-e65e-4685-a578-a1bbd3743982 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:08.785039 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e269c331-e65e-4685-a578-a1bbd3743982 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:09.052771 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-f7486a2a-8865-4756-b79a-1d8af7d3da99 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9d40e54481461cba53fedb9a6abdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed2295a58f8451993a57ce0a6f9ba29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:09.069363 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-f7486a2a-8865-4756-b79a-1d8af7d3da99 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] 10.222.0.60 "GET /compute/v2.1/servers/d0c5547a-1340-4d19-a0f9-3e1eb9fd1932" status: 200 len: 1513 microversion: 2.1 time: 0.735072 Sep 14 08:59:09.070914 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1237/2425] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:08 2022] GET /compute/v2.1/servers/d0c5547a-1340-4d19-a0f9-3e1eb9fd1932 => generated 1513 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:59:09.079718 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-9526837c-6fc0-48a1-abb7-049a38839503 req-ce8acb6e-3f13-40a2-87b2-343424794039 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0", "tag": "5779091e-0903-4f0d-81c7-8bdda2add09d"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:59:09.093987 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-9526837c-6fc0-48a1-abb7-049a38839503 req-ce8acb6e-3f13-40a2-87b2-343424794039 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:09.094862 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-9526837c-6fc0-48a1-abb7-049a38839503 req-ce8acb6e-3f13-40a2-87b2-343424794039 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:09.096534 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-9526837c-6fc0-48a1-abb7-049a38839503 req-ce8acb6e-3f13-40a2-87b2-343424794039 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:09.115150 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-9526837c-6fc0-48a1-abb7-049a38839503 req-ce8acb6e-3f13-40a2-87b2-343424794039 service nova] Creating event network-changed:5779091e-0903-4f0d-81c7-8bdda2add09d for instance 26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0 on n-h1-836830-18 Sep 14 08:59:09.121967 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-9526837c-6fc0-48a1-abb7-049a38839503 req-ce8acb6e-3f13-40a2-87b2-343424794039 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048730 Sep 14 08:59:09.123433 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1238/2426] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:59:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:59:09.298363 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-9065e4f9-8902-4f31-94ae-bca0900a531a tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:09.301954 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-9065e4f9-8902-4f31-94ae-bca0900a531a tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] [instance: 885dfd01-8bac-4691-ad0b-f2218e306f2e] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:09.316906 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9065e4f9-8902-4f31-94ae-bca0900a531a tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:09.319576 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9065e4f9-8902-4f31-94ae-bca0900a531a tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:09.321865 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9065e4f9-8902-4f31-94ae-bca0900a531a tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:09.323002 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9065e4f9-8902-4f31-94ae-bca0900a531a tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:09.325268 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9065e4f9-8902-4f31-94ae-bca0900a531a tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:09.328195 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9065e4f9-8902-4f31-94ae-bca0900a531a tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:09.332547 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-e269c331-e65e-4685-a578-a1bbd3743982 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:09.343594 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e269c331-e65e-4685-a578-a1bbd3743982 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/affb61a7-7e36-4424-bf48-a5a6bd64ae29" status: 200 len: 1515 microversion: 2.1 time: 0.582642 Sep 14 08:59:09.346320 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1189/2427] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:08 2022] GET /compute/v2.1/servers/affb61a7-7e36-4424-bf48-a5a6bd64ae29 => generated 1515 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:59:09.849782 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-9065e4f9-8902-4f31-94ae-bca0900a531a tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ab7166e40e4a908eefbfb03b3b8804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de82b83dadd541dbb4a939f2fc04a163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:09.857861 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-9065e4f9-8902-4f31-94ae-bca0900a531a tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] 10.222.0.60 "GET /compute/v2.1/servers/885dfd01-8bac-4691-ad0b-f2218e306f2e" status: 200 len: 1557 microversion: 2.1 time: 0.566932 Sep 14 08:59:09.860855 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1239/2428] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:09 2022] GET /compute/v2.1/servers/885dfd01-8bac-4691-ad0b-f2218e306f2e => generated 1557 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:59:09.890817 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-cd19ba09-ee72-4e98-b724-34a5e793e4f0 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:09.891357 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-cd19ba09-ee72-4e98-b724-34a5e793e4f0 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] [instance: 885dfd01-8bac-4691-ad0b-f2218e306f2e] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:09.918070 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cd19ba09-ee72-4e98-b724-34a5e793e4f0 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:09.918579 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cd19ba09-ee72-4e98-b724-34a5e793e4f0 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:09.919051 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cd19ba09-ee72-4e98-b724-34a5e793e4f0 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:09.919855 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cd19ba09-ee72-4e98-b724-34a5e793e4f0 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:09.920315 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cd19ba09-ee72-4e98-b724-34a5e793e4f0 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:09.920746 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cd19ba09-ee72-4e98-b724-34a5e793e4f0 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:10.096270 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-233b2598-a631-4520-a812-c8e390ef4ed4 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:10.098914 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-233b2598-a631-4520-a812-c8e390ef4ed4 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: d0c5547a-1340-4d19-a0f9-3e1eb9fd1932] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:10.113127 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-233b2598-a631-4520-a812-c8e390ef4ed4 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:10.117504 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-233b2598-a631-4520-a812-c8e390ef4ed4 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:10.118165 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-233b2598-a631-4520-a812-c8e390ef4ed4 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:10.121718 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-233b2598-a631-4520-a812-c8e390ef4ed4 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:10.122448 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-233b2598-a631-4520-a812-c8e390ef4ed4 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:10.123144 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-233b2598-a631-4520-a812-c8e390ef4ed4 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:10.153111 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-cd19ba09-ee72-4e98-b724-34a5e793e4f0 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] 10.222.0.60 "GET /compute/v2.1/servers/885dfd01-8bac-4691-ad0b-f2218e306f2e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.270815 Sep 14 08:59:10.154137 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1190/2429] 10.222.0.60 () {58 vars in 1275 bytes} [Wed Sep 14 08:59:09 2022] GET /compute/v2.1/servers/885dfd01-8bac-4691-ad0b-f2218e306f2e/os-interface => generated 285 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:59:10.373236 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-de61bd60-7a4a-4d9d-b6c4-e81ad9f69506 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:10.373864 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-de61bd60-7a4a-4d9d-b6c4-e81ad9f69506 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: affb61a7-7e36-4424-bf48-a5a6bd64ae29] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:10.385176 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-de61bd60-7a4a-4d9d-b6c4-e81ad9f69506 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:10.389524 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-de61bd60-7a4a-4d9d-b6c4-e81ad9f69506 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:10.390258 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-de61bd60-7a4a-4d9d-b6c4-e81ad9f69506 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:10.392691 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-de61bd60-7a4a-4d9d-b6c4-e81ad9f69506 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:10.395686 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-de61bd60-7a4a-4d9d-b6c4-e81ad9f69506 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:10.396851 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-de61bd60-7a4a-4d9d-b6c4-e81ad9f69506 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:10.643932 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-de61bd60-7a4a-4d9d-b6c4-e81ad9f69506 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:10.656385 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-de61bd60-7a4a-4d9d-b6c4-e81ad9f69506 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/affb61a7-7e36-4424-bf48-a5a6bd64ae29" status: 200 len: 1473 microversion: 2.1 time: 0.287563 Sep 14 08:59:10.656987 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1191/2430] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:10 2022] GET /compute/v2.1/servers/affb61a7-7e36-4424-bf48-a5a6bd64ae29 => generated 1473 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:59:10.701877 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-233b2598-a631-4520-a812-c8e390ef4ed4 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9d40e54481461cba53fedb9a6abdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed2295a58f8451993a57ce0a6f9ba29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:10.717326 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-233b2598-a631-4520-a812-c8e390ef4ed4 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] 10.222.0.60 "GET /compute/v2.1/servers/d0c5547a-1340-4d19-a0f9-3e1eb9fd1932" status: 200 len: 1513 microversion: 2.1 time: 0.621199 Sep 14 08:59:10.729525 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1240/2431] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:10 2022] GET /compute/v2.1/servers/d0c5547a-1340-4d19-a0f9-3e1eb9fd1932 => generated 1513 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:59:11.438159 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-e4806c5f-3eaa-4c8d-9fe7-d6836fd96125 req-92135f7c-ccc4-45ed-99cd-b99976500d65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "affb61a7-7e36-4424-bf48-a5a6bd64ae29", "name": "network-vif-deleted", "tag": "18231b89-f9a1-4386-8a2f-242a6bc12bd6"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:59:11.467036 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-e4806c5f-3eaa-4c8d-9fe7-d6836fd96125 req-92135f7c-ccc4-45ed-99cd-b99976500d65 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:11.467598 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-e4806c5f-3eaa-4c8d-9fe7-d6836fd96125 req-92135f7c-ccc4-45ed-99cd-b99976500d65 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:11.468087 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-e4806c5f-3eaa-4c8d-9fe7-d6836fd96125 req-92135f7c-ccc4-45ed-99cd-b99976500d65 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:11.508053 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-e4806c5f-3eaa-4c8d-9fe7-d6836fd96125 req-92135f7c-ccc4-45ed-99cd-b99976500d65 service nova] Creating event network-vif-deleted:18231b89-f9a1-4386-8a2f-242a6bc12bd6 for instance affb61a7-7e36-4424-bf48-a5a6bd64ae29 on n-h1-836830-18 Sep 14 08:59:11.535463 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-e4806c5f-3eaa-4c8d-9fe7-d6836fd96125 req-92135f7c-ccc4-45ed-99cd-b99976500d65 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103905 Sep 14 08:59:11.537258 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1192/2432] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:59:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:59:11.694268 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-f4dd15e6-e2de-42a1-897d-220ee1be8418 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:11.696854 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-f4dd15e6-e2de-42a1-897d-220ee1be8418 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: affb61a7-7e36-4424-bf48-a5a6bd64ae29] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:11.713841 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f4dd15e6-e2de-42a1-897d-220ee1be8418 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:11.715642 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f4dd15e6-e2de-42a1-897d-220ee1be8418 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:11.716287 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f4dd15e6-e2de-42a1-897d-220ee1be8418 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:11.717179 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f4dd15e6-e2de-42a1-897d-220ee1be8418 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:11.718303 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f4dd15e6-e2de-42a1-897d-220ee1be8418 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:11.723409 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f4dd15e6-e2de-42a1-897d-220ee1be8418 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:11.747058 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-347fc08a-9950-499d-857b-5f4365023cd7 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:11.749140 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-347fc08a-9950-499d-857b-5f4365023cd7 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: d0c5547a-1340-4d19-a0f9-3e1eb9fd1932] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:11.750620 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-f4dd15e6-e2de-42a1-897d-220ee1be8418 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] HTTP exception thrown: Instance affb61a7-7e36-4424-bf48-a5a6bd64ae29 could not be found. Sep 14 08:59:11.752577 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-f4dd15e6-e2de-42a1-897d-220ee1be8418 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Request method failure captured: Sep 14 08:59:11.752577 n-d-836830-18 devstack@n-api.service[128758]: request: GET /compute/v2.1/servers/affb61a7-7e36-4424-bf48-a5a6bd64ae29 HTTP/1.1 Sep 14 08:59:11.752577 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 08:59:11.752577 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 08:59:11.752577 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 08:59:11.752577 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 08:59:11.752577 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 08:59:11.752577 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 08:59:11.752577 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 08:59:11.752577 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 08:59:11.752577 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZcaJwfflKXdBQOzu63TKkiZhpOhYfmFkGJTkIRAE47xWaYCE5owpMd6ZGj3T_7h70-IX-88ov5m9P47-8wvvyB1aoACyyMztTclo7X0AZdOhAhE2WQeLs1dhX-NF72boJ9SoR98XdGx2ROr7Y4PciafvjdUpaADdFYghsgULitlVHs Sep 14 08:59:11.752577 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 08:59:11.752577 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 08:59:11.752577 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 08:59:11.752577 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 08:59:11.752577 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 08:59:11.752577 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 08:59:11.752577 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: a46ca7b6c331417199f9dfc5ffa80470 Sep 14 08:59:11.752577 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-ServersTestJSON-1483820673 Sep 14 08:59:11.752577 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 08:59:11.752577 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 08:59:11.752577 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a46ca7b6c331417199f9dfc5ffa80470"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a46ca7b6c331417199f9dfc5ffa80470"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a46ca7b6c331417199f9dfc5ffa80470"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a46ca7b6c331417199f9dfc5ffa80470"}]}] Sep 14 08:59:11.752577 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-ServersTestJSON-1483820673 Sep 14 08:59:11.752577 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: a46ca7b6c331417199f9dfc5ffa80470 Sep 14 08:59:11.752577 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-ServersTestJSON-1483820673 Sep 14 08:59:11.752577 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-ServersTestJSON-1483820673-project Sep 14 08:59:11.752577 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 08:59:11.752577 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 08:59:11.752577 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 1473e6771ff1459c831d66311318404d Sep 14 08:59:11.752577 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-ServersTestJSON-1483820673-project Sep 14 08:59:11.752577 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 08:59:11.752577 n-d-836830-18 devstack@n-api.service[128758]: exception: Instance affb61a7-7e36-4424-bf48-a5a6bd64ae29 could not be found. Sep 14 08:59:11.752577 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': 'affb61a7-7e36-4424-bf48-a5a6bd64ae29'} Sep 14 08:59:11.752577 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:59:11.752577 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:59:11.752577 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 08:59:11.752577 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 08:59:11.752577 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 08:59:11.752577 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 08:59:11.752577 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 08:59:11.752577 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 08:59:11.752577 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 08:59:11.752577 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 08:59:11.752577 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance affb61a7-7e36-4424-bf48-a5a6bd64ae29 could not be found. Sep 14 08:59:11.752577 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:59:11.752577 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:59:11.752577 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:59:11.752577 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:59:11.752577 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:59:11.752577 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:59:11.752577 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:59:11.752577 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:59:11.752577 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:59:11.752577 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:59:11.752577 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 08:59:11.752577 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 08:59:11.752577 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 08:59:11.752577 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 08:59:11.752577 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 08:59:11.752577 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 08:59:11.752577 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance affb61a7-7e36-4424-bf48-a5a6bd64ae29 could not be found. Sep 14 08:59:11.752577 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:59:11.752577 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:59:11.752577 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:59:11.757650 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:59:11.757650 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:59:11.757650 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:59:11.757650 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:59:11.757650 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:59:11.757650 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance affb61a7-7e36-4424-bf48-a5a6bd64ae29 could not be found. Sep 14 08:59:11.757650 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:59:11.761486 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-f4dd15e6-e2de-42a1-897d-220ee1be8418 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Returning 404 to user: Instance affb61a7-7e36-4424-bf48-a5a6bd64ae29 could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:59:11.762376 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-f4dd15e6-e2de-42a1-897d-220ee1be8418 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/affb61a7-7e36-4424-bf48-a5a6bd64ae29" status: 404 len: 111 microversion: 2.1 time: 0.084256 Sep 14 08:59:11.762605 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-347fc08a-9950-499d-857b-5f4365023cd7 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:11.763013 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1241/2433] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:11 2022] GET /compute/v2.1/servers/affb61a7-7e36-4424-bf48-a5a6bd64ae29 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 08:59:11.765124 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-347fc08a-9950-499d-857b-5f4365023cd7 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:11.765608 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-347fc08a-9950-499d-857b-5f4365023cd7 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:11.766589 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-347fc08a-9950-499d-857b-5f4365023cd7 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:11.767715 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-347fc08a-9950-499d-857b-5f4365023cd7 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:11.768267 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-347fc08a-9950-499d-857b-5f4365023cd7 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:11.974195 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-fe2f9b7c-81ae-4213-9feb-3269218a95dd tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1844369026", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "networks": [{"uuid": "238fbc23-0a7b-476b-a552-1a5667de089a"}]}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:59:12.095933 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.network.neutron [None req-fe2f9b7c-81ae-4213-9feb-3269218a95dd tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] validate_networks() for [('238fbc23-0a7b-476b-a552-1a5667de089a', None, None, None, None, None)] {{(pid=128758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 08:59:12.125609 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-347fc08a-9950-499d-857b-5f4365023cd7 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9d40e54481461cba53fedb9a6abdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed2295a58f8451993a57ce0a6f9ba29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:12.132403 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:59:12.136744 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-347fc08a-9950-499d-857b-5f4365023cd7 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] 10.222.0.60 "GET /compute/v2.1/servers/d0c5547a-1340-4d19-a0f9-3e1eb9fd1932" status: 200 len: 1513 microversion: 2.1 time: 0.395242 Sep 14 08:59:12.137340 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1193/2434] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:11 2022] GET /compute/v2.1/servers/d0c5547a-1340-4d19-a0f9-3e1eb9fd1932 => generated 1513 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:59:13.160371 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e3ff9c1b-48a1-4a27-9bb7-24e8ba9b255f tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:13.161050 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e3ff9c1b-48a1-4a27-9bb7-24e8ba9b255f tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: d0c5547a-1340-4d19-a0f9-3e1eb9fd1932] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:13.181509 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e3ff9c1b-48a1-4a27-9bb7-24e8ba9b255f tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:13.186483 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e3ff9c1b-48a1-4a27-9bb7-24e8ba9b255f tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:13.188241 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e3ff9c1b-48a1-4a27-9bb7-24e8ba9b255f tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:13.191849 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e3ff9c1b-48a1-4a27-9bb7-24e8ba9b255f tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:13.192420 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e3ff9c1b-48a1-4a27-9bb7-24e8ba9b255f tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:13.193707 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e3ff9c1b-48a1-4a27-9bb7-24e8ba9b255f tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:13.392166 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-fe2f9b7c-81ae-4213-9feb-3269218a95dd tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Flavor limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 08:59:13.392730 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-fe2f9b7c-81ae-4213-9feb-3269218a95dd tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Image limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 08:59:13.397537 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-fe2f9b7c-81ae-4213-9feb-3269218a95dd tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Flavor pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 08:59:13.398210 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-fe2f9b7c-81ae-4213-9feb-3269218a95dd tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Image pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 08:59:13.399480 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-fe2f9b7c-81ae-4213-9feb-3269218a95dd tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 08:59:13.418600 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fe2f9b7c-81ae-4213-9feb-3269218a95dd tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:13.419677 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fe2f9b7c-81ae-4213-9feb-3269218a95dd tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:13.421401 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fe2f9b7c-81ae-4213-9feb-3269218a95dd tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:13.430258 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fe2f9b7c-81ae-4213-9feb-3269218a95dd tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:13.430809 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fe2f9b7c-81ae-4213-9feb-3269218a95dd tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:13.431498 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fe2f9b7c-81ae-4213-9feb-3269218a95dd tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:13.496924 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-fe2f9b7c-81ae-4213-9feb-3269218a95dd tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Getting quotas for project a46ca7b6c331417199f9dfc5ffa80470. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 08:59:13.514215 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-fe2f9b7c-81ae-4213-9feb-3269218a95dd tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Getting quotas for user 1473e6771ff1459c831d66311318404d and project a46ca7b6c331417199f9dfc5ffa80470. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 08:59:13.549243 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-fe2f9b7c-81ae-4213-9feb-3269218a95dd tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Going to run 1 instances... {{(pid=128758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 08:59:13.562197 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-fe2f9b7c-81ae-4213-9feb-3269218a95dd tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 39890752-2382-4631-8c4a-f3c6d47c94cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 08:59:13.696701 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-fe2f9b7c-81ae-4213-9feb-3269218a95dd tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.728510 Sep 14 08:59:13.697836 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1242/2435] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 08:59:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1730 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 08:59:13.707466 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-d0b5c70f-5b7c-46d2-a29d-24df6881bd27 req-7a5d59ca-d8d4-4fee-8e5d-bb6cec083a33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "885dfd01-8bac-4691-ad0b-f2218e306f2e", "tag": "7a58cd39-a33e-4a69-ac2a-b45bd18e6b98"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:59:13.735387 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-d0b5c70f-5b7c-46d2-a29d-24df6881bd27 req-7a5d59ca-d8d4-4fee-8e5d-bb6cec083a33 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:13.738195 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-d0b5c70f-5b7c-46d2-a29d-24df6881bd27 req-7a5d59ca-d8d4-4fee-8e5d-bb6cec083a33 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:13.744988 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-e3ff9c1b-48a1-4a27-9bb7-24e8ba9b255f tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9d40e54481461cba53fedb9a6abdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed2295a58f8451993a57ce0a6f9ba29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:13.756501 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-d0b5c70f-5b7c-46d2-a29d-24df6881bd27 req-7a5d59ca-d8d4-4fee-8e5d-bb6cec083a33 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:13.763706 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e3ff9c1b-48a1-4a27-9bb7-24e8ba9b255f tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] 10.222.0.60 "GET /compute/v2.1/servers/d0c5547a-1340-4d19-a0f9-3e1eb9fd1932" status: 200 len: 1513 microversion: 2.1 time: 0.603007 Sep 14 08:59:13.778242 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1194/2436] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:13 2022] GET /compute/v2.1/servers/d0c5547a-1340-4d19-a0f9-3e1eb9fd1932 => generated 1513 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:59:13.820203 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-45b2f2fc-1766-4f73-83b8-b783acf3028b tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:13.821842 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-45b2f2fc-1766-4f73-83b8-b783acf3028b tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 39890752-2382-4631-8c4a-f3c6d47c94cb] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:13.840498 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-d0b5c70f-5b7c-46d2-a29d-24df6881bd27 req-7a5d59ca-d8d4-4fee-8e5d-bb6cec083a33 service nova] Creating event network-changed:7a58cd39-a33e-4a69-ac2a-b45bd18e6b98 for instance 885dfd01-8bac-4691-ad0b-f2218e306f2e on n-h1-836830-18 Sep 14 08:59:13.850302 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-d0b5c70f-5b7c-46d2-a29d-24df6881bd27 req-7a5d59ca-d8d4-4fee-8e5d-bb6cec083a33 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.150974 Sep 14 08:59:13.861131 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1243/2437] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:59:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:59:14.039851 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-45b2f2fc-1766-4f73-83b8-b783acf3028b tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:14.049652 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-45b2f2fc-1766-4f73-83b8-b783acf3028b tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/39890752-2382-4631-8c4a-f3c6d47c94cb" status: 200 len: 1209 microversion: 2.1 time: 0.252114 Sep 14 08:59:14.050749 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1195/2438] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:13 2022] GET /compute/v2.1/servers/39890752-2382-4631-8c4a-f3c6d47c94cb => generated 1209 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:59:14.659602 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-9cc5c7ed-bf55-405d-a218-9f916e083b3d tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1711488961", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "networks": [{"uuid": "bb99f4a1-78ca-499c-bb3f-fa3732e743f4"}]}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:59:14.754618 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.network.neutron [None req-9cc5c7ed-bf55-405d-a218-9f916e083b3d tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] validate_networks() for [('bb99f4a1-78ca-499c-bb3f-fa3732e743f4', None, None, None, None, None)] {{(pid=128758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 08:59:14.806870 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-51b8de93-6d43-41ae-9232-8dc6c75b0059 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:14.808170 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-51b8de93-6d43-41ae-9232-8dc6c75b0059 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: d0c5547a-1340-4d19-a0f9-3e1eb9fd1932] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:14.836141 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-51b8de93-6d43-41ae-9232-8dc6c75b0059 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:14.840507 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-51b8de93-6d43-41ae-9232-8dc6c75b0059 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:14.844754 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-51b8de93-6d43-41ae-9232-8dc6c75b0059 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:14.847794 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-51b8de93-6d43-41ae-9232-8dc6c75b0059 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:14.850879 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-51b8de93-6d43-41ae-9232-8dc6c75b0059 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:14.853027 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-51b8de93-6d43-41ae-9232-8dc6c75b0059 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:15.346331 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-51b8de93-6d43-41ae-9232-8dc6c75b0059 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9d40e54481461cba53fedb9a6abdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed2295a58f8451993a57ce0a6f9ba29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:15.365381 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-51b8de93-6d43-41ae-9232-8dc6c75b0059 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] 10.222.0.60 "GET /compute/v2.1/servers/d0c5547a-1340-4d19-a0f9-3e1eb9fd1932" status: 200 len: 1513 microversion: 2.1 time: 0.558449 Sep 14 08:59:15.366097 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1196/2439] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:14 2022] GET /compute/v2.1/servers/d0c5547a-1340-4d19-a0f9-3e1eb9fd1932 => generated 1513 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:59:15.377853 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9bd4b106-6070-416f-b5b0-6055bc7aca99 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:15.378783 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-9bd4b106-6070-416f-b5b0-6055bc7aca99 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 39890752-2382-4631-8c4a-f3c6d47c94cb] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:15.396616 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9bd4b106-6070-416f-b5b0-6055bc7aca99 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:15.399936 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9bd4b106-6070-416f-b5b0-6055bc7aca99 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:15.400658 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9bd4b106-6070-416f-b5b0-6055bc7aca99 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:15.402868 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9bd4b106-6070-416f-b5b0-6055bc7aca99 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:15.404209 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9bd4b106-6070-416f-b5b0-6055bc7aca99 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:15.404840 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9bd4b106-6070-416f-b5b0-6055bc7aca99 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:15.666120 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-9bd4b106-6070-416f-b5b0-6055bc7aca99 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:15.684980 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-9bd4b106-6070-416f-b5b0-6055bc7aca99 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/39890752-2382-4631-8c4a-f3c6d47c94cb" status: 200 len: 1261 microversion: 2.1 time: 0.317610 Sep 14 08:59:15.687301 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1197/2440] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:15 2022] GET /compute/v2.1/servers/39890752-2382-4631-8c4a-f3c6d47c94cb => generated 1261 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:59:16.208108 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-9cc5c7ed-bf55-405d-a218-9f916e083b3d tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Flavor limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 08:59:16.209325 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-9cc5c7ed-bf55-405d-a218-9f916e083b3d tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Image limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 08:59:16.210673 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-9cc5c7ed-bf55-405d-a218-9f916e083b3d tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Flavor pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 08:59:16.211941 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-9cc5c7ed-bf55-405d-a218-9f916e083b3d tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Image pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 08:59:16.212655 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-9cc5c7ed-bf55-405d-a218-9f916e083b3d tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 08:59:16.265563 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9cc5c7ed-bf55-405d-a218-9f916e083b3d tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:16.266438 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9cc5c7ed-bf55-405d-a218-9f916e083b3d tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:16.268021 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9cc5c7ed-bf55-405d-a218-9f916e083b3d tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:16.269017 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9cc5c7ed-bf55-405d-a218-9f916e083b3d tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:16.270476 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9cc5c7ed-bf55-405d-a218-9f916e083b3d tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:16.272628 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9cc5c7ed-bf55-405d-a218-9f916e083b3d tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:16.325721 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-9cc5c7ed-bf55-405d-a218-9f916e083b3d tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Getting quotas for project d9df06ceaa154f3c80665cc6a27b3598. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 08:59:16.347073 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-9cc5c7ed-bf55-405d-a218-9f916e083b3d tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Getting quotas for user db65c0cfa83f48468d4a1bcef0caff73 and project d9df06ceaa154f3c80665cc6a27b3598. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 08:59:16.390160 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-9cc5c7ed-bf55-405d-a218-9f916e083b3d tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Going to run 1 instances... {{(pid=128758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 08:59:16.398452 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-9cc5c7ed-bf55-405d-a218-9f916e083b3d tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] [instance: 2da88a50-c283-4c91-b3e1-bd4f5eb9e319] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 08:59:16.405020 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-0873527d-3cd6-4581-b152-927dec4e00f7 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:16.407375 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-0873527d-3cd6-4581-b152-927dec4e00f7 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: d0c5547a-1340-4d19-a0f9-3e1eb9fd1932] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:16.435723 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0873527d-3cd6-4581-b152-927dec4e00f7 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:16.437683 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0873527d-3cd6-4581-b152-927dec4e00f7 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:16.438415 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0873527d-3cd6-4581-b152-927dec4e00f7 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:16.441134 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0873527d-3cd6-4581-b152-927dec4e00f7 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:16.443665 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0873527d-3cd6-4581-b152-927dec4e00f7 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:16.446898 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0873527d-3cd6-4581-b152-927dec4e00f7 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:16.527531 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-9cc5c7ed-bf55-405d-a218-9f916e083b3d tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.084831 Sep 14 08:59:16.535540 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1244/2441] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 08:59:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 2090 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 08:59:16.547027 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ca3681b2-c86c-43a7-9803-d8415cd64c6c tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:16.547537 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-ca3681b2-c86c-43a7-9803-d8415cd64c6c tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] [instance: 2da88a50-c283-4c91-b3e1-bd4f5eb9e319] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:17.195196 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-ca3681b2-c86c-43a7-9803-d8415cd64c6c tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db65c0cfa83f48468d4a1bcef0caff73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9df06ceaa154f3c80665cc6a27b3598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:17.203549 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-ca3681b2-c86c-43a7-9803-d8415cd64c6c tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] 10.222.0.60 "GET /compute/v2.1/servers/2da88a50-c283-4c91-b3e1-bd4f5eb9e319" status: 200 len: 1224 microversion: 2.1 time: 0.665901 Sep 14 08:59:17.210284 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1245/2442] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:16 2022] GET /compute/v2.1/servers/2da88a50-c283-4c91-b3e1-bd4f5eb9e319 => generated 1224 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:59:17.216156 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-e235ab53-849f-497f-acda-78508eb15f2d tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:17.223389 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-e235ab53-849f-497f-acda-78508eb15f2d tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 39890752-2382-4631-8c4a-f3c6d47c94cb] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:17.237896 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e235ab53-849f-497f-acda-78508eb15f2d tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:17.238668 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e235ab53-849f-497f-acda-78508eb15f2d tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:17.239301 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e235ab53-849f-497f-acda-78508eb15f2d tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:17.240184 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e235ab53-849f-497f-acda-78508eb15f2d tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:17.240792 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e235ab53-849f-497f-acda-78508eb15f2d tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:17.241369 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e235ab53-849f-497f-acda-78508eb15f2d tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:17.382507 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-0873527d-3cd6-4581-b152-927dec4e00f7 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9d40e54481461cba53fedb9a6abdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed2295a58f8451993a57ce0a6f9ba29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:17.395351 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-0873527d-3cd6-4581-b152-927dec4e00f7 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] 10.222.0.60 "GET /compute/v2.1/servers/d0c5547a-1340-4d19-a0f9-3e1eb9fd1932" status: 200 len: 1513 microversion: 2.1 time: 1.005679 Sep 14 08:59:17.403496 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1198/2443] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:16 2022] GET /compute/v2.1/servers/d0c5547a-1340-4d19-a0f9-3e1eb9fd1932 => generated 1513 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:59:17.508156 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-e235ab53-849f-497f-acda-78508eb15f2d tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:17.553862 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-e235ab53-849f-497f-acda-78508eb15f2d tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/39890752-2382-4631-8c4a-f3c6d47c94cb" status: 200 len: 1267 microversion: 2.1 time: 0.341383 Sep 14 08:59:17.556176 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1246/2444] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:17 2022] GET /compute/v2.1/servers/39890752-2382-4631-8c4a-f3c6d47c94cb => generated 1267 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:59:18.254308 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-115fbc7d-0da2-4a1c-820a-2d1525f7c59b tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:18.258661 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-115fbc7d-0da2-4a1c-820a-2d1525f7c59b tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] [instance: 2da88a50-c283-4c91-b3e1-bd4f5eb9e319] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:18.271472 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-115fbc7d-0da2-4a1c-820a-2d1525f7c59b tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:18.272246 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-115fbc7d-0da2-4a1c-820a-2d1525f7c59b tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:18.272996 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-115fbc7d-0da2-4a1c-820a-2d1525f7c59b tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:18.273587 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-115fbc7d-0da2-4a1c-820a-2d1525f7c59b tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:18.274371 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-115fbc7d-0da2-4a1c-820a-2d1525f7c59b tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:18.274840 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-115fbc7d-0da2-4a1c-820a-2d1525f7c59b tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:18.410227 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-115fbc7d-0da2-4a1c-820a-2d1525f7c59b tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db65c0cfa83f48468d4a1bcef0caff73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9df06ceaa154f3c80665cc6a27b3598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:18.420903 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-115fbc7d-0da2-4a1c-820a-2d1525f7c59b tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] 10.222.0.60 "GET /compute/v2.1/servers/2da88a50-c283-4c91-b3e1-bd4f5eb9e319" status: 200 len: 1276 microversion: 2.1 time: 0.185638 Sep 14 08:59:18.422186 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1199/2445] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:18 2022] GET /compute/v2.1/servers/2da88a50-c283-4c91-b3e1-bd4f5eb9e319 => generated 1276 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:59:18.424686 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-93fdab97-b838-4d3e-a1da-e65846926230 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:18.425316 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-93fdab97-b838-4d3e-a1da-e65846926230 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: d0c5547a-1340-4d19-a0f9-3e1eb9fd1932] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:18.442022 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-93fdab97-b838-4d3e-a1da-e65846926230 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:18.442769 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-93fdab97-b838-4d3e-a1da-e65846926230 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:18.443407 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-93fdab97-b838-4d3e-a1da-e65846926230 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:18.444305 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-93fdab97-b838-4d3e-a1da-e65846926230 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:18.445873 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-93fdab97-b838-4d3e-a1da-e65846926230 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:18.447799 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-93fdab97-b838-4d3e-a1da-e65846926230 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:18.582180 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-2d569fc1-f51c-4e5c-8637-dae6fc0ed844 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:18.582815 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-2d569fc1-f51c-4e5c-8637-dae6fc0ed844 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 39890752-2382-4631-8c4a-f3c6d47c94cb] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:18.604791 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2d569fc1-f51c-4e5c-8637-dae6fc0ed844 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:18.605935 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2d569fc1-f51c-4e5c-8637-dae6fc0ed844 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:18.606995 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2d569fc1-f51c-4e5c-8637-dae6fc0ed844 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:18.611659 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2d569fc1-f51c-4e5c-8637-dae6fc0ed844 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:18.613288 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2d569fc1-f51c-4e5c-8637-dae6fc0ed844 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:18.613725 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2d569fc1-f51c-4e5c-8637-dae6fc0ed844 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:18.977224 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-93fdab97-b838-4d3e-a1da-e65846926230 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9d40e54481461cba53fedb9a6abdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed2295a58f8451993a57ce0a6f9ba29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:19.001744 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-93fdab97-b838-4d3e-a1da-e65846926230 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] 10.222.0.60 "GET /compute/v2.1/servers/d0c5547a-1340-4d19-a0f9-3e1eb9fd1932" status: 200 len: 1513 microversion: 2.1 time: 0.578799 Sep 14 08:59:19.018993 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1247/2446] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:18 2022] GET /compute/v2.1/servers/d0c5547a-1340-4d19-a0f9-3e1eb9fd1932 => generated 1513 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:59:19.072948 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-2d569fc1-f51c-4e5c-8637-dae6fc0ed844 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:19.082258 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-2d569fc1-f51c-4e5c-8637-dae6fc0ed844 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/39890752-2382-4631-8c4a-f3c6d47c94cb" status: 200 len: 1309 microversion: 2.1 time: 0.505289 Sep 14 08:59:19.082857 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1200/2447] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:18 2022] GET /compute/v2.1/servers/39890752-2382-4631-8c4a-f3c6d47c94cb => generated 1309 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:59:19.451729 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-43f01459-2ae0-408f-b027-32d39b541b93 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:19.453889 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-43f01459-2ae0-408f-b027-32d39b541b93 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] [instance: 2da88a50-c283-4c91-b3e1-bd4f5eb9e319] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:19.465106 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-43f01459-2ae0-408f-b027-32d39b541b93 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:19.470022 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-43f01459-2ae0-408f-b027-32d39b541b93 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:19.470641 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-43f01459-2ae0-408f-b027-32d39b541b93 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:19.472054 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-43f01459-2ae0-408f-b027-32d39b541b93 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:19.472939 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-43f01459-2ae0-408f-b027-32d39b541b93 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:19.473916 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-43f01459-2ae0-408f-b027-32d39b541b93 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:19.628020 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-43f01459-2ae0-408f-b027-32d39b541b93 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db65c0cfa83f48468d4a1bcef0caff73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9df06ceaa154f3c80665cc6a27b3598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:19.640192 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-43f01459-2ae0-408f-b027-32d39b541b93 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] 10.222.0.60 "GET /compute/v2.1/servers/2da88a50-c283-4c91-b3e1-bd4f5eb9e319" status: 200 len: 1282 microversion: 2.1 time: 0.195101 Sep 14 08:59:19.643632 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1248/2448] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:19 2022] GET /compute/v2.1/servers/2da88a50-c283-4c91-b3e1-bd4f5eb9e319 => generated 1282 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:59:20.034592 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ea5656f5-7fd2-4bb9-99ea-8f519f16a18d tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:20.036843 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-ea5656f5-7fd2-4bb9-99ea-8f519f16a18d tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: d0c5547a-1340-4d19-a0f9-3e1eb9fd1932] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:20.055600 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ea5656f5-7fd2-4bb9-99ea-8f519f16a18d tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:20.057496 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ea5656f5-7fd2-4bb9-99ea-8f519f16a18d tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:20.061101 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ea5656f5-7fd2-4bb9-99ea-8f519f16a18d tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:20.063446 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ea5656f5-7fd2-4bb9-99ea-8f519f16a18d tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:20.065996 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ea5656f5-7fd2-4bb9-99ea-8f519f16a18d tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:20.067054 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ea5656f5-7fd2-4bb9-99ea-8f519f16a18d tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:20.111186 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-0991a97a-1d90-4ea9-9d47-2f5e925be584 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:20.112124 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-0991a97a-1d90-4ea9-9d47-2f5e925be584 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 39890752-2382-4631-8c4a-f3c6d47c94cb] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:20.125506 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0991a97a-1d90-4ea9-9d47-2f5e925be584 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:20.129475 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0991a97a-1d90-4ea9-9d47-2f5e925be584 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:20.130232 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0991a97a-1d90-4ea9-9d47-2f5e925be584 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:20.133624 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0991a97a-1d90-4ea9-9d47-2f5e925be584 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:20.135011 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0991a97a-1d90-4ea9-9d47-2f5e925be584 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:20.136029 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0991a97a-1d90-4ea9-9d47-2f5e925be584 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:20.435540 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-0991a97a-1d90-4ea9-9d47-2f5e925be584 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:20.445573 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-0991a97a-1d90-4ea9-9d47-2f5e925be584 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/39890752-2382-4631-8c4a-f3c6d47c94cb" status: 200 len: 1309 microversion: 2.1 time: 0.339109 Sep 14 08:59:20.446368 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1249/2449] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:20 2022] GET /compute/v2.1/servers/39890752-2382-4631-8c4a-f3c6d47c94cb => generated 1309 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:59:20.510826 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-ea5656f5-7fd2-4bb9-99ea-8f519f16a18d tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9d40e54481461cba53fedb9a6abdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed2295a58f8451993a57ce0a6f9ba29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:20.519968 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-ea5656f5-7fd2-4bb9-99ea-8f519f16a18d tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] 10.222.0.60 "GET /compute/v2.1/servers/d0c5547a-1340-4d19-a0f9-3e1eb9fd1932" status: 200 len: 1513 microversion: 2.1 time: 0.492761 Sep 14 08:59:20.525511 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1201/2450] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:20 2022] GET /compute/v2.1/servers/d0c5547a-1340-4d19-a0f9-3e1eb9fd1932 => generated 1513 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:59:20.665778 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-0aa829ad-353f-44f2-b4fa-8827ad408e70 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:20.666416 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-0aa829ad-353f-44f2-b4fa-8827ad408e70 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] [instance: 2da88a50-c283-4c91-b3e1-bd4f5eb9e319] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:20.676272 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:59:20.680591 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0aa829ad-353f-44f2-b4fa-8827ad408e70 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:20.681085 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0aa829ad-353f-44f2-b4fa-8827ad408e70 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:20.681520 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0aa829ad-353f-44f2-b4fa-8827ad408e70 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:20.682241 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0aa829ad-353f-44f2-b4fa-8827ad408e70 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:20.682701 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0aa829ad-353f-44f2-b4fa-8827ad408e70 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:20.683161 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0aa829ad-353f-44f2-b4fa-8827ad408e70 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:20.824629 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-0aa829ad-353f-44f2-b4fa-8827ad408e70 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db65c0cfa83f48468d4a1bcef0caff73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9df06ceaa154f3c80665cc6a27b3598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:20.832541 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-0aa829ad-353f-44f2-b4fa-8827ad408e70 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] 10.222.0.60 "GET /compute/v2.1/servers/2da88a50-c283-4c91-b3e1-bd4f5eb9e319" status: 200 len: 1282 microversion: 2.1 time: 0.170767 Sep 14 08:59:20.836015 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1250/2451] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:20 2022] GET /compute/v2.1/servers/2da88a50-c283-4c91-b3e1-bd4f5eb9e319 => generated 1282 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:59:21.471436 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-7f5caef9-1f3a-44e4-8730-123b9a52c9a1 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:21.472071 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-7f5caef9-1f3a-44e4-8730-123b9a52c9a1 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 39890752-2382-4631-8c4a-f3c6d47c94cb] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:21.492997 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7f5caef9-1f3a-44e4-8730-123b9a52c9a1 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:21.492997 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7f5caef9-1f3a-44e4-8730-123b9a52c9a1 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:21.492997 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7f5caef9-1f3a-44e4-8730-123b9a52c9a1 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:21.492997 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7f5caef9-1f3a-44e4-8730-123b9a52c9a1 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:21.492997 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7f5caef9-1f3a-44e4-8730-123b9a52c9a1 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:21.492997 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7f5caef9-1f3a-44e4-8730-123b9a52c9a1 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:21.548597 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c19fc5cb-5f03-468a-b6de-bb237314775d tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:21.549328 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-c19fc5cb-5f03-468a-b6de-bb237314775d tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: d0c5547a-1340-4d19-a0f9-3e1eb9fd1932] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:21.563337 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c19fc5cb-5f03-468a-b6de-bb237314775d tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:21.564102 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c19fc5cb-5f03-468a-b6de-bb237314775d tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:21.564702 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c19fc5cb-5f03-468a-b6de-bb237314775d tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:21.565618 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c19fc5cb-5f03-468a-b6de-bb237314775d tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:21.566263 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c19fc5cb-5f03-468a-b6de-bb237314775d tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:21.566868 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c19fc5cb-5f03-468a-b6de-bb237314775d tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:21.899763 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-7f5caef9-1f3a-44e4-8730-123b9a52c9a1 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:21.914192 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-7f5caef9-1f3a-44e4-8730-123b9a52c9a1 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/39890752-2382-4631-8c4a-f3c6d47c94cb" status: 200 len: 1309 microversion: 2.1 time: 0.445755 Sep 14 08:59:21.916491 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1202/2452] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:21 2022] GET /compute/v2.1/servers/39890752-2382-4631-8c4a-f3c6d47c94cb => generated 1309 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:59:21.938707 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-c19fc5cb-5f03-468a-b6de-bb237314775d tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9d40e54481461cba53fedb9a6abdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed2295a58f8451993a57ce0a6f9ba29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:21.945668 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-e5ba3f28-4954-4fd2-8a85-cb92dc627e54 req-639fa65c-ceb3-4d0a-8e6c-19b07de18ea1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39890752-2382-4631-8c4a-f3c6d47c94cb", "tag": "c75c1874-c724-4f8e-ad23-280fad270390"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:59:21.959095 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-c19fc5cb-5f03-468a-b6de-bb237314775d tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] 10.222.0.60 "GET /compute/v2.1/servers/d0c5547a-1340-4d19-a0f9-3e1eb9fd1932" status: 200 len: 1513 microversion: 2.1 time: 0.413577 Sep 14 08:59:21.961473 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1251/2453] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:21 2022] GET /compute/v2.1/servers/d0c5547a-1340-4d19-a0f9-3e1eb9fd1932 => generated 1513 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:59:21.977701 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-e5ba3f28-4954-4fd2-8a85-cb92dc627e54 req-639fa65c-ceb3-4d0a-8e6c-19b07de18ea1 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:21.993980 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-e5ba3f28-4954-4fd2-8a85-cb92dc627e54 req-639fa65c-ceb3-4d0a-8e6c-19b07de18ea1 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:21.995653 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-e5ba3f28-4954-4fd2-8a85-cb92dc627e54 req-639fa65c-ceb3-4d0a-8e6c-19b07de18ea1 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:22.053874 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-e5ba3f28-4954-4fd2-8a85-cb92dc627e54 req-639fa65c-ceb3-4d0a-8e6c-19b07de18ea1 service nova] Creating event network-changed:c75c1874-c724-4f8e-ad23-280fad270390 for instance 39890752-2382-4631-8c4a-f3c6d47c94cb on n-h2-836830-18 Sep 14 08:59:22.079890 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-e5ba3f28-4954-4fd2-8a85-cb92dc627e54 req-639fa65c-ceb3-4d0a-8e6c-19b07de18ea1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.155697 Sep 14 08:59:22.080630 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1203/2454] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:59:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:59:22.086964 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-298459ab-f9c4-4a0e-b935-d061e67bedcc tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:22.087683 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-298459ab-f9c4-4a0e-b935-d061e67bedcc tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] [instance: 2da88a50-c283-4c91-b3e1-bd4f5eb9e319] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:22.120672 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-298459ab-f9c4-4a0e-b935-d061e67bedcc tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:22.121422 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-298459ab-f9c4-4a0e-b935-d061e67bedcc tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:22.122039 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-298459ab-f9c4-4a0e-b935-d061e67bedcc tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:22.123013 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-298459ab-f9c4-4a0e-b935-d061e67bedcc tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:22.123828 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-298459ab-f9c4-4a0e-b935-d061e67bedcc tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:22.124683 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-298459ab-f9c4-4a0e-b935-d061e67bedcc tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:22.259104 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-adb5b9f4-4947-4482-aeb3-60191db92de8 tempest-QuotasAdminNegativeTest-1087634401 tempest-QuotasAdminNegativeTest-1087634401-project-admin] Calling method '.version_select at 0x7f7d44a40280>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:22.357364 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-adb5b9f4-4947-4482-aeb3-60191db92de8 tempest-QuotasAdminNegativeTest-1087634401 tempest-QuotasAdminNegativeTest-1087634401-project-admin] 10.222.0.60 "GET /compute/v2.1/os-quota-sets/8faddb1f08654d70bb49069583d63847" status: 200 len: 371 microversion: 2.1 time: 0.391471 Sep 14 08:59:22.365099 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1252/2455] 10.222.0.60 () {58 vars in 1242 bytes} [Wed Sep 14 08:59:21 2022] GET /compute/v2.1/os-quota-sets/8faddb1f08654d70bb49069583d63847 => generated 371 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:59:22.370633 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-0540d7d3-5ff9-4e10-b14f-29a9e5f58cab tempest-QuotasAdminNegativeTest-1087634401 tempest-QuotasAdminNegativeTest-1087634401-project-admin] Action: 'update', calling method: .version_select at 0x7f7d44628700>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:59:22.396212 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-298459ab-f9c4-4a0e-b935-d061e67bedcc tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db65c0cfa83f48468d4a1bcef0caff73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9df06ceaa154f3c80665cc6a27b3598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:22.437974 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-298459ab-f9c4-4a0e-b935-d061e67bedcc tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] 10.222.0.60 "GET /compute/v2.1/servers/2da88a50-c283-4c91-b3e1-bd4f5eb9e319" status: 200 len: 1324 microversion: 2.1 time: 0.354808 Sep 14 08:59:22.445670 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1204/2456] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:22 2022] GET /compute/v2.1/servers/2da88a50-c283-4c91-b3e1-bd4f5eb9e319 => generated 1324 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:59:22.490879 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0540d7d3-5ff9-4e10-b14f-29a9e5f58cab tempest-QuotasAdminNegativeTest-1087634401 tempest-QuotasAdminNegativeTest-1087634401-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:22.491778 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0540d7d3-5ff9-4e10-b14f-29a9e5f58cab tempest-QuotasAdminNegativeTest-1087634401 tempest-QuotasAdminNegativeTest-1087634401-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:22.492320 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0540d7d3-5ff9-4e10-b14f-29a9e5f58cab tempest-QuotasAdminNegativeTest-1087634401 tempest-QuotasAdminNegativeTest-1087634401-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:22.493387 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0540d7d3-5ff9-4e10-b14f-29a9e5f58cab tempest-QuotasAdminNegativeTest-1087634401 tempest-QuotasAdminNegativeTest-1087634401-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:22.493796 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0540d7d3-5ff9-4e10-b14f-29a9e5f58cab tempest-QuotasAdminNegativeTest-1087634401 tempest-QuotasAdminNegativeTest-1087634401-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:22.494331 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0540d7d3-5ff9-4e10-b14f-29a9e5f58cab tempest-QuotasAdminNegativeTest-1087634401 tempest-QuotasAdminNegativeTest-1087634401-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:22.547879 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-0540d7d3-5ff9-4e10-b14f-29a9e5f58cab tempest-QuotasAdminNegativeTest-1087634401 tempest-QuotasAdminNegativeTest-1087634401-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-quota-sets/8faddb1f08654d70bb49069583d63847" status: 200 len: 328 microversion: 2.1 time: 0.181337 Sep 14 08:59:22.549288 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1253/2457] 10.222.0.60 () {60 vars in 1262 bytes} [Wed Sep 14 08:59:22 2022] PUT /compute/v2.1/os-quota-sets/8faddb1f08654d70bb49069583d63847 => generated 328 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:59:22.842058 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ad791b40-5b3e-4458-9d03-2a35dd51b15f tempest-QuotasAdminNegativeTest-1122953996 tempest-QuotasAdminNegativeTest-1122953996-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-410439456", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:59:22.942625 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.network.neutron [None req-ad791b40-5b3e-4458-9d03-2a35dd51b15f tempest-QuotasAdminNegativeTest-1122953996 tempest-QuotasAdminNegativeTest-1122953996-project] validate_networks() for None {{(pid=128759) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 08:59:22.943012 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-751c9a16-24a1-4ea4-8d01-f0e60d4e142a tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:22.943809 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-751c9a16-24a1-4ea4-8d01-f0e60d4e142a tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 39890752-2382-4631-8c4a-f3c6d47c94cb] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:22.958653 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-751c9a16-24a1-4ea4-8d01-f0e60d4e142a tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:22.959746 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-751c9a16-24a1-4ea4-8d01-f0e60d4e142a tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:22.961450 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-751c9a16-24a1-4ea4-8d01-f0e60d4e142a tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:22.964092 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-751c9a16-24a1-4ea4-8d01-f0e60d4e142a tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:22.964873 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-751c9a16-24a1-4ea4-8d01-f0e60d4e142a tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:22.967463 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-751c9a16-24a1-4ea4-8d01-f0e60d4e142a tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:23.360747 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-ad791b40-5b3e-4458-9d03-2a35dd51b15f tempest-QuotasAdminNegativeTest-1122953996 tempest-QuotasAdminNegativeTest-1122953996-project] Flavor limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 08:59:23.361188 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-ad791b40-5b3e-4458-9d03-2a35dd51b15f tempest-QuotasAdminNegativeTest-1122953996 tempest-QuotasAdminNegativeTest-1122953996-project] Image limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 08:59:23.361681 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-ad791b40-5b3e-4458-9d03-2a35dd51b15f tempest-QuotasAdminNegativeTest-1122953996 tempest-QuotasAdminNegativeTest-1122953996-project] Flavor pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 08:59:23.362096 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-ad791b40-5b3e-4458-9d03-2a35dd51b15f tempest-QuotasAdminNegativeTest-1122953996 tempest-QuotasAdminNegativeTest-1122953996-project] Image pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 08:59:23.363165 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-ad791b40-5b3e-4458-9d03-2a35dd51b15f tempest-QuotasAdminNegativeTest-1122953996 tempest-QuotasAdminNegativeTest-1122953996-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 08:59:23.374537 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ad791b40-5b3e-4458-9d03-2a35dd51b15f tempest-QuotasAdminNegativeTest-1122953996 tempest-QuotasAdminNegativeTest-1122953996-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:23.375359 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ad791b40-5b3e-4458-9d03-2a35dd51b15f tempest-QuotasAdminNegativeTest-1122953996 tempest-QuotasAdminNegativeTest-1122953996-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:23.375980 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ad791b40-5b3e-4458-9d03-2a35dd51b15f tempest-QuotasAdminNegativeTest-1122953996 tempest-QuotasAdminNegativeTest-1122953996-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:23.377538 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ad791b40-5b3e-4458-9d03-2a35dd51b15f tempest-QuotasAdminNegativeTest-1122953996 tempest-QuotasAdminNegativeTest-1122953996-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:23.378177 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ad791b40-5b3e-4458-9d03-2a35dd51b15f tempest-QuotasAdminNegativeTest-1122953996 tempest-QuotasAdminNegativeTest-1122953996-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:23.378961 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ad791b40-5b3e-4458-9d03-2a35dd51b15f tempest-QuotasAdminNegativeTest-1122953996 tempest-QuotasAdminNegativeTest-1122953996-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:23.380593 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-751c9a16-24a1-4ea4-8d01-f0e60d4e142a tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:23.397614 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-751c9a16-24a1-4ea4-8d01-f0e60d4e142a tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/39890752-2382-4631-8c4a-f3c6d47c94cb" status: 200 len: 1309 microversion: 2.1 time: 0.452663 Sep 14 08:59:23.397614 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1254/2458] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:22 2022] GET /compute/v2.1/servers/39890752-2382-4631-8c4a-f3c6d47c94cb => generated 1309 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:59:23.400064 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-ad791b40-5b3e-4458-9d03-2a35dd51b15f tempest-QuotasAdminNegativeTest-1122953996 tempest-QuotasAdminNegativeTest-1122953996-project] Getting quotas for project 8faddb1f08654d70bb49069583d63847. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 08:59:23.407133 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-751edc85-02f9-4cc8-8846-18212919735b tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:23.407316 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-ad791b40-5b3e-4458-9d03-2a35dd51b15f tempest-QuotasAdminNegativeTest-1122953996 tempest-QuotasAdminNegativeTest-1122953996-project] Getting quotas for user ef84b84c7781491eb3b4e5a4aef00c72 and project 8faddb1f08654d70bb49069583d63847. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 08:59:23.407793 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-751edc85-02f9-4cc8-8846-18212919735b tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: d0c5547a-1340-4d19-a0f9-3e1eb9fd1932] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:23.428804 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.utils [None req-ad791b40-5b3e-4458-9d03-2a35dd51b15f tempest-QuotasAdminNegativeTest-1122953996 tempest-QuotasAdminNegativeTest-1122953996-project] cores quota exceeded for 8faddb1f08654d70bb49069583d63847, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=128759) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Sep 14 08:59:23.429496 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-ad791b40-5b3e-4458-9d03-2a35dd51b15f tempest-QuotasAdminNegativeTest-1122953996 tempest-QuotasAdminNegativeTest-1122953996-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Sep 14 08:59:23.439536 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-751edc85-02f9-4cc8-8846-18212919735b tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:23.440354 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-751edc85-02f9-4cc8-8846-18212919735b tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:23.441082 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-751edc85-02f9-4cc8-8846-18212919735b tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:23.442033 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-751edc85-02f9-4cc8-8846-18212919735b tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:23.442617 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-751edc85-02f9-4cc8-8846-18212919735b tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:23.443390 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-751edc85-02f9-4cc8-8846-18212919735b tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:23.445780 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ad791b40-5b3e-4458-9d03-2a35dd51b15f tempest-QuotasAdminNegativeTest-1122953996 tempest-QuotasAdminNegativeTest-1122953996-project] Request method failure captured: Sep 14 08:59:23.445780 n-d-836830-18 devstack@n-api.service[128759]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 14 08:59:23.445780 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 08:59:23.445780 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 08:59:23.445780 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 08:59:23.445780 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 144 Sep 14 08:59:23.445780 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 08:59:23.445780 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 08:59:23.445780 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 08:59:23.445780 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 08:59:23.445780 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZfoneuVESyMw2VFxG4ywgMHDhp4v6D6Ye6WDAfPC_0i-VQMtbukZrLGgo06VAKKElGn_rKoyYTEgAubTIxJAdGgjLczZAoPhTB5OIbiYAgP0lSx_ERdqhEXcO65v9jC1sVG8p5fYb6IkK1L2N4WEUl7vAxc5Vn85-pq24wQl1F7078 Sep 14 08:59:23.445780 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 08:59:23.445780 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 08:59:23.445780 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 08:59:23.445780 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 08:59:23.445780 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 08:59:23.445780 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 08:59:23.445780 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 8faddb1f08654d70bb49069583d63847 Sep 14 08:59:23.445780 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-QuotasAdminNegativeTest-1122953996 Sep 14 08:59:23.445780 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 08:59:23.445780 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 08:59:23.445780 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/8faddb1f08654d70bb49069583d63847"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_8faddb1f08654d70bb49069583d63847"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8faddb1f08654d70bb49069583d63847"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8faddb1f08654d70bb49069583d63847"}]}] Sep 14 08:59:23.445780 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-QuotasAdminNegativeTest-1122953996 Sep 14 08:59:23.445780 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 8faddb1f08654d70bb49069583d63847 Sep 14 08:59:23.445780 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1122953996 Sep 14 08:59:23.445780 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-QuotasAdminNegativeTest-1122953996-project Sep 14 08:59:23.445780 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 08:59:23.445780 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 08:59:23.445780 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: ef84b84c7781491eb3b4e5a4aef00c72 Sep 14 08:59:23.445780 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-QuotasAdminNegativeTest-1122953996-project Sep 14 08:59:23.445780 n-d-836830-18 devstack@n-api.service[128759]: Sep 14 08:59:23.445780 n-d-836830-18 devstack@n-api.service[128759]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-410439456", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452"}} Sep 14 08:59:23.445780 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 08:59:23.445780 n-d-836830-18 devstack@n-api.service[128759]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Sep 14 08:59:23.445780 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-410439456', 'imageRef': 'bff4ab7f-4846-441f-8940-d96fec4c28e9', 'flavorRef': '452'}}} Sep 14 08:59:23.445780 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:59:23.445780 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:59:23.445780 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Sep 14 08:59:23.445780 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Sep 14 08:59:23.445780 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 14 08:59:23.445780 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 14 08:59:23.445780 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Sep 14 08:59:23.445780 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc Sep 14 08:59:23.445780 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Sep 14 08:59:23.445780 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Sep 14 08:59:23.445780 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 14 08:59:23.445780 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 14 08:59:23.445780 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Sep 14 08:59:23.445780 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Sep 14 08:59:23.445780 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Sep 14 08:59:23.445780 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Sep 14 08:59:23.445780 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Sep 14 08:59:23.445780 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Sep 14 08:59:23.445780 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Sep 14 08:59:23.445780 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:59:23.445780 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:59:23.445780 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:59:23.445780 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:59:23.445780 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 14 08:59:23.445780 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 14 08:59:23.445780 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 14 08:59:23.445780 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 14 08:59:23.445780 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Sep 14 08:59:23.450112 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Sep 14 08:59:23.450112 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Sep 14 08:59:23.450112 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Sep 14 08:59:23.450112 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Sep 14 08:59:23.450112 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Sep 14 08:59:23.450112 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Sep 14 08:59:23.450112 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:59:23.450112 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:59:23.450112 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:59:23.450112 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:59:23.450112 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:59:23.450112 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:59:23.450112 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:59:23.450112 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:59:23.450112 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:59:23.450112 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:59:23.450112 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 08:59:23.450112 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 08:59:23.450112 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 08:59:23.450112 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 08:59:23.450112 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 08:59:23.450112 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 08:59:23.450112 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 14 08:59:23.450112 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Sep 14 08:59:23.450112 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 14 08:59:23.450112 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Sep 14 08:59:23.450112 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:59:23.450112 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:59:23.450112 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:59:23.450112 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:59:23.450112 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:59:23.450112 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:59:23.450112 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:59:23.450112 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:59:23.450112 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Sep 14 08:59:23.450112 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:59:23.454637 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ad791b40-5b3e-4458-9d03-2a35dd51b15f tempest-QuotasAdminNegativeTest-1122953996 tempest-QuotasAdminNegativeTest-1122953996-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:59:23.457447 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-ad791b40-5b3e-4458-9d03-2a35dd51b15f tempest-QuotasAdminNegativeTest-1122953996 tempest-QuotasAdminNegativeTest-1122953996-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 0.734900 Sep 14 08:59:23.461208 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1205/2459] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 08:59:22 2022] POST /compute/v2.1/servers => generated 111 bytes in 736 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 14 08:59:23.517172 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3bad339e-fe0f-484b-8ef0-6c0fda822352 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1172607910", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "networks": [{"uuid": "b9ab2062-a108-4d91-8f37-c911ce062678"}]}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:59:23.573985 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.network.neutron [None req-3bad339e-fe0f-484b-8ef0-6c0fda822352 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] validate_networks() for [('b9ab2062-a108-4d91-8f37-c911ce062678', None, None, None, None, None)] {{(pid=128759) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 08:59:23.658012 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-751edc85-02f9-4cc8-8846-18212919735b tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9d40e54481461cba53fedb9a6abdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed2295a58f8451993a57ce0a6f9ba29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:23.666717 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-751edc85-02f9-4cc8-8846-18212919735b tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] 10.222.0.60 "GET /compute/v2.1/servers/d0c5547a-1340-4d19-a0f9-3e1eb9fd1932" status: 200 len: 1513 microversion: 2.1 time: 0.275120 Sep 14 08:59:23.667381 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1255/2460] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:23 2022] GET /compute/v2.1/servers/d0c5547a-1340-4d19-a0f9-3e1eb9fd1932 => generated 1513 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:59:23.672405 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b84f46de-9988-49b9-92b1-c81cc359cf30 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:23.673017 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-b84f46de-9988-49b9-92b1-c81cc359cf30 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] [instance: 2da88a50-c283-4c91-b3e1-bd4f5eb9e319] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:23.679160 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b84f46de-9988-49b9-92b1-c81cc359cf30 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:23.679657 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b84f46de-9988-49b9-92b1-c81cc359cf30 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:23.680089 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b84f46de-9988-49b9-92b1-c81cc359cf30 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:23.680782 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b84f46de-9988-49b9-92b1-c81cc359cf30 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:23.681268 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b84f46de-9988-49b9-92b1-c81cc359cf30 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:23.681696 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b84f46de-9988-49b9-92b1-c81cc359cf30 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:23.923097 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-b84f46de-9988-49b9-92b1-c81cc359cf30 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db65c0cfa83f48468d4a1bcef0caff73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9df06ceaa154f3c80665cc6a27b3598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:23.949313 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-b84f46de-9988-49b9-92b1-c81cc359cf30 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] 10.222.0.60 "GET /compute/v2.1/servers/2da88a50-c283-4c91-b3e1-bd4f5eb9e319" status: 200 len: 1324 microversion: 2.1 time: 0.279771 Sep 14 08:59:23.952311 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1256/2461] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:23 2022] GET /compute/v2.1/servers/2da88a50-c283-4c91-b3e1-bd4f5eb9e319 => generated 1324 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:59:23.962484 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-448dfca8-b210-4aaa-994f-3d6ae29178e8 tempest-QuotasAdminNegativeTest-1087634401 tempest-QuotasAdminNegativeTest-1087634401-project-admin] Action: 'update', calling method: .version_select at 0x7f7d45040430>, body: {"quota_set": {"cores": 20}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:59:24.037587 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-448dfca8-b210-4aaa-994f-3d6ae29178e8 tempest-QuotasAdminNegativeTest-1087634401 tempest-QuotasAdminNegativeTest-1087634401-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:24.038346 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-448dfca8-b210-4aaa-994f-3d6ae29178e8 tempest-QuotasAdminNegativeTest-1087634401 tempest-QuotasAdminNegativeTest-1087634401-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:24.039154 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-448dfca8-b210-4aaa-994f-3d6ae29178e8 tempest-QuotasAdminNegativeTest-1087634401 tempest-QuotasAdminNegativeTest-1087634401-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:24.040066 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-448dfca8-b210-4aaa-994f-3d6ae29178e8 tempest-QuotasAdminNegativeTest-1087634401 tempest-QuotasAdminNegativeTest-1087634401-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:24.040763 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-448dfca8-b210-4aaa-994f-3d6ae29178e8 tempest-QuotasAdminNegativeTest-1087634401 tempest-QuotasAdminNegativeTest-1087634401-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:24.041349 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-448dfca8-b210-4aaa-994f-3d6ae29178e8 tempest-QuotasAdminNegativeTest-1087634401 tempest-QuotasAdminNegativeTest-1087634401-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:24.101641 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-3bad339e-fe0f-484b-8ef0-6c0fda822352 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Flavor limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 08:59:24.102206 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-3bad339e-fe0f-484b-8ef0-6c0fda822352 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Image limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 08:59:24.102549 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-3bad339e-fe0f-484b-8ef0-6c0fda822352 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Flavor pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 08:59:24.103003 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-3bad339e-fe0f-484b-8ef0-6c0fda822352 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Image pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 08:59:24.103389 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-3bad339e-fe0f-484b-8ef0-6c0fda822352 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 08:59:24.113238 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3bad339e-fe0f-484b-8ef0-6c0fda822352 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:24.114183 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3bad339e-fe0f-484b-8ef0-6c0fda822352 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:24.114902 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3bad339e-fe0f-484b-8ef0-6c0fda822352 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:24.116353 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3bad339e-fe0f-484b-8ef0-6c0fda822352 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:24.117221 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3bad339e-fe0f-484b-8ef0-6c0fda822352 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:24.117816 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3bad339e-fe0f-484b-8ef0-6c0fda822352 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:24.119652 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-448dfca8-b210-4aaa-994f-3d6ae29178e8 tempest-QuotasAdminNegativeTest-1087634401 tempest-QuotasAdminNegativeTest-1087634401-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-quota-sets/8faddb1f08654d70bb49069583d63847" status: 200 len: 329 microversion: 2.1 time: 0.165874 Sep 14 08:59:24.128805 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1257/2462] 10.222.0.60 () {60 vars in 1262 bytes} [Wed Sep 14 08:59:23 2022] PUT /compute/v2.1/os-quota-sets/8faddb1f08654d70bb49069583d63847 => generated 329 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:59:24.134856 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-f9ad75c2-df29-4364-981d-4f0fcc65e52a tempest-QuotasAdminNegativeTest-1087634401 tempest-QuotasAdminNegativeTest-1087634401-project-admin] Calling method '.version_select at 0x7f7d444c8b80>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:24.141973 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-3bad339e-fe0f-484b-8ef0-6c0fda822352 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Getting quotas for project 4d42bf4d573b4bf9a0d8c9e73260af7e. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 08:59:24.145638 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=100 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:59:24.151080 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-3bad339e-fe0f-484b-8ef0-6c0fda822352 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Getting quotas for user 47c95b28481b451bb03fb2c0240d0310 and project 4d42bf4d573b4bf9a0d8c9e73260af7e. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 08:59:24.171119 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-3bad339e-fe0f-484b-8ef0-6c0fda822352 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Going to run 1 instances... {{(pid=128759) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 08:59:24.173927 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-3bad339e-fe0f-484b-8ef0-6c0fda822352 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: 82774725-1b08-411d-b760-4ed6aa3cec68] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128759) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 08:59:24.218417 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-f9ad75c2-df29-4364-981d-4f0fcc65e52a tempest-QuotasAdminNegativeTest-1087634401 tempest-QuotasAdminNegativeTest-1087634401-project-admin] 10.222.0.60 "GET /compute/v2.1/os-quota-sets/8faddb1f08654d70bb49069583d63847" status: 200 len: 371 microversion: 2.1 time: 0.087955 Sep 14 08:59:24.219155 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1258/2463] 10.222.0.60 () {58 vars in 1242 bytes} [Wed Sep 14 08:59:24 2022] GET /compute/v2.1/os-quota-sets/8faddb1f08654d70bb49069583d63847 => generated 371 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:59:24.224209 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-d74237e7-08b3-4c6c-a2a5-6259314712db req-c81b5d6c-7b1c-42d6-b073-834470f417ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2da88a50-c283-4c91-b3e1-bd4f5eb9e319", "tag": "0e0d5077-876f-4296-b015-ba13bb73c465"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:59:24.234919 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-d74237e7-08b3-4c6c-a2a5-6259314712db req-c81b5d6c-7b1c-42d6-b073-834470f417ab service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:24.235423 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-d74237e7-08b3-4c6c-a2a5-6259314712db req-c81b5d6c-7b1c-42d6-b073-834470f417ab service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:24.235848 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-d74237e7-08b3-4c6c-a2a5-6259314712db req-c81b5d6c-7b1c-42d6-b073-834470f417ab service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:24.242305 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-3bad339e-fe0f-484b-8ef0-6c0fda822352 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.783050 Sep 14 08:59:24.250507 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1206/2464] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 08:59:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 792 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 08:59:24.252773 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-d74237e7-08b3-4c6c-a2a5-6259314712db req-c81b5d6c-7b1c-42d6-b073-834470f417ab service nova] Creating event network-changed:0e0d5077-876f-4296-b015-ba13bb73c465 for instance 2da88a50-c283-4c91-b3e1-bd4f5eb9e319 on n-h2-836830-18 Sep 14 08:59:24.256548 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-aab35780-4929-4a2d-843f-8021f4d84051 tempest-QuotasAdminNegativeTest-1087634401 tempest-QuotasAdminNegativeTest-1087634401-project-admin] Action: 'update', calling method: .version_select at 0x7f7d3fbd0c10>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:59:24.262757 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-d74237e7-08b3-4c6c-a2a5-6259314712db req-c81b5d6c-7b1c-42d6-b073-834470f417ab service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042110 Sep 14 08:59:24.265546 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1259/2465] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:59:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:59:24.279760 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-e57fd611-b98f-4c5f-b7aa-60e64b32d2ff tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:24.280551 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-e57fd611-b98f-4c5f-b7aa-60e64b32d2ff tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: 82774725-1b08-411d-b760-4ed6aa3cec68] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:24.347257 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-aab35780-4929-4a2d-843f-8021f4d84051 tempest-QuotasAdminNegativeTest-1087634401 tempest-QuotasAdminNegativeTest-1087634401-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:24.347963 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-aab35780-4929-4a2d-843f-8021f4d84051 tempest-QuotasAdminNegativeTest-1087634401 tempest-QuotasAdminNegativeTest-1087634401-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:24.348843 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-aab35780-4929-4a2d-843f-8021f4d84051 tempest-QuotasAdminNegativeTest-1087634401 tempest-QuotasAdminNegativeTest-1087634401-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:24.349980 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-aab35780-4929-4a2d-843f-8021f4d84051 tempest-QuotasAdminNegativeTest-1087634401 tempest-QuotasAdminNegativeTest-1087634401-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:24.350785 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-aab35780-4929-4a2d-843f-8021f4d84051 tempest-QuotasAdminNegativeTest-1087634401 tempest-QuotasAdminNegativeTest-1087634401-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:24.353760 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-aab35780-4929-4a2d-843f-8021f4d84051 tempest-QuotasAdminNegativeTest-1087634401 tempest-QuotasAdminNegativeTest-1087634401-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:24.379884 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-e57fd611-b98f-4c5f-b7aa-60e64b32d2ff tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:24.393894 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-e57fd611-b98f-4c5f-b7aa-60e64b32d2ff tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/82774725-1b08-411d-b760-4ed6aa3cec68" status: 200 len: 1215 microversion: 2.1 time: 0.127091 Sep 14 08:59:24.394855 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1260/2466] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:24 2022] GET /compute/v2.1/servers/82774725-1b08-411d-b760-4ed6aa3cec68 => generated 1215 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:59:24.421528 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-7fe7fd73-17e4-48b6-9965-db1887c51b7c tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:24.422649 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-7fe7fd73-17e4-48b6-9965-db1887c51b7c tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 39890752-2382-4631-8c4a-f3c6d47c94cb] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:24.432993 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7fe7fd73-17e4-48b6-9965-db1887c51b7c tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:24.439735 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7fe7fd73-17e4-48b6-9965-db1887c51b7c tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:24.440982 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7fe7fd73-17e4-48b6-9965-db1887c51b7c tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:24.442516 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7fe7fd73-17e4-48b6-9965-db1887c51b7c tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:24.443201 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7fe7fd73-17e4-48b6-9965-db1887c51b7c tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:24.443838 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7fe7fd73-17e4-48b6-9965-db1887c51b7c tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:24.463863 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-aab35780-4929-4a2d-843f-8021f4d84051 tempest-QuotasAdminNegativeTest-1087634401 tempest-QuotasAdminNegativeTest-1087634401-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-quota-sets/8faddb1f08654d70bb49069583d63847" status: 200 len: 328 microversion: 2.1 time: 0.211553 Sep 14 08:59:24.465113 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1207/2467] 10.222.0.60 () {60 vars in 1262 bytes} [Wed Sep 14 08:59:24 2022] PUT /compute/v2.1/os-quota-sets/8faddb1f08654d70bb49069583d63847 => generated 328 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:59:24.585254 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d94926b0-205d-47a6-afd0-222942dc37d9 tempest-QuotasAdminNegativeTest-1122953996 tempest-QuotasAdminNegativeTest-1122953996-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1443326137", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:59:24.663849 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.network.neutron [None req-d94926b0-205d-47a6-afd0-222942dc37d9 tempest-QuotasAdminNegativeTest-1122953996 tempest-QuotasAdminNegativeTest-1122953996-project] validate_networks() for None {{(pid=128759) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 08:59:24.718400 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-7fe7fd73-17e4-48b6-9965-db1887c51b7c tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:24.727883 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-7fe7fd73-17e4-48b6-9965-db1887c51b7c tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/39890752-2382-4631-8c4a-f3c6d47c94cb" status: 200 len: 1309 microversion: 2.1 time: 0.310451 Sep 14 08:59:24.744544 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1261/2468] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:24 2022] GET /compute/v2.1/servers/39890752-2382-4631-8c4a-f3c6d47c94cb => generated 1309 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:59:24.753879 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-824639ec-dd43-4d84-ae06-eb513e25ec6e tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:24.754894 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-824639ec-dd43-4d84-ae06-eb513e25ec6e tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: d0c5547a-1340-4d19-a0f9-3e1eb9fd1932] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:24.762798 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-824639ec-dd43-4d84-ae06-eb513e25ec6e tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:24.765604 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-824639ec-dd43-4d84-ae06-eb513e25ec6e tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:24.766268 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-824639ec-dd43-4d84-ae06-eb513e25ec6e tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:24.767346 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-824639ec-dd43-4d84-ae06-eb513e25ec6e tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:24.768048 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-824639ec-dd43-4d84-ae06-eb513e25ec6e tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:24.768757 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-824639ec-dd43-4d84-ae06-eb513e25ec6e tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:24.775076 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=100 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:59:25.053554 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-d94926b0-205d-47a6-afd0-222942dc37d9 tempest-QuotasAdminNegativeTest-1122953996 tempest-QuotasAdminNegativeTest-1122953996-project] Flavor limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 08:59:25.054747 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-d94926b0-205d-47a6-afd0-222942dc37d9 tempest-QuotasAdminNegativeTest-1122953996 tempest-QuotasAdminNegativeTest-1122953996-project] Image limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 08:59:25.055507 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-d94926b0-205d-47a6-afd0-222942dc37d9 tempest-QuotasAdminNegativeTest-1122953996 tempest-QuotasAdminNegativeTest-1122953996-project] Flavor pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 08:59:25.056344 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-d94926b0-205d-47a6-afd0-222942dc37d9 tempest-QuotasAdminNegativeTest-1122953996 tempest-QuotasAdminNegativeTest-1122953996-project] Image pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 08:59:25.057917 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-d94926b0-205d-47a6-afd0-222942dc37d9 tempest-QuotasAdminNegativeTest-1122953996 tempest-QuotasAdminNegativeTest-1122953996-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 08:59:25.081129 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-824639ec-dd43-4d84-ae06-eb513e25ec6e tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9d40e54481461cba53fedb9a6abdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed2295a58f8451993a57ce0a6f9ba29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:25.081677 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d94926b0-205d-47a6-afd0-222942dc37d9 tempest-QuotasAdminNegativeTest-1122953996 tempest-QuotasAdminNegativeTest-1122953996-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:25.082064 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d94926b0-205d-47a6-afd0-222942dc37d9 tempest-QuotasAdminNegativeTest-1122953996 tempest-QuotasAdminNegativeTest-1122953996-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:25.083165 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d94926b0-205d-47a6-afd0-222942dc37d9 tempest-QuotasAdminNegativeTest-1122953996 tempest-QuotasAdminNegativeTest-1122953996-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:25.084452 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d94926b0-205d-47a6-afd0-222942dc37d9 tempest-QuotasAdminNegativeTest-1122953996 tempest-QuotasAdminNegativeTest-1122953996-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:25.085748 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d94926b0-205d-47a6-afd0-222942dc37d9 tempest-QuotasAdminNegativeTest-1122953996 tempest-QuotasAdminNegativeTest-1122953996-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:25.086441 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d94926b0-205d-47a6-afd0-222942dc37d9 tempest-QuotasAdminNegativeTest-1122953996 tempest-QuotasAdminNegativeTest-1122953996-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:25.097112 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-824639ec-dd43-4d84-ae06-eb513e25ec6e tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] 10.222.0.60 "GET /compute/v2.1/servers/d0c5547a-1340-4d19-a0f9-3e1eb9fd1932" status: 200 len: 1513 microversion: 2.1 time: 0.351234 Sep 14 08:59:25.112180 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1262/2469] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:24 2022] GET /compute/v2.1/servers/d0c5547a-1340-4d19-a0f9-3e1eb9fd1932 => generated 1513 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:59:25.115598 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-d94926b0-205d-47a6-afd0-222942dc37d9 tempest-QuotasAdminNegativeTest-1122953996 tempest-QuotasAdminNegativeTest-1122953996-project] Getting quotas for project 8faddb1f08654d70bb49069583d63847. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 08:59:25.119868 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-677c5a0b-6bc8-4e4a-a71b-98bfffdc3a94 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:25.120847 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-677c5a0b-6bc8-4e4a-a71b-98bfffdc3a94 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] [instance: 2da88a50-c283-4c91-b3e1-bd4f5eb9e319] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:25.124223 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-d94926b0-205d-47a6-afd0-222942dc37d9 tempest-QuotasAdminNegativeTest-1122953996 tempest-QuotasAdminNegativeTest-1122953996-project] Getting quotas for user ef84b84c7781491eb3b4e5a4aef00c72 and project 8faddb1f08654d70bb49069583d63847. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 08:59:25.128317 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-677c5a0b-6bc8-4e4a-a71b-98bfffdc3a94 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:25.128823 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-677c5a0b-6bc8-4e4a-a71b-98bfffdc3a94 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:25.129276 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-677c5a0b-6bc8-4e4a-a71b-98bfffdc3a94 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:25.129969 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-677c5a0b-6bc8-4e4a-a71b-98bfffdc3a94 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:25.130426 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-677c5a0b-6bc8-4e4a-a71b-98bfffdc3a94 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:25.130852 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-677c5a0b-6bc8-4e4a-a71b-98bfffdc3a94 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:25.138770 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.utils [None req-d94926b0-205d-47a6-afd0-222942dc37d9 tempest-QuotasAdminNegativeTest-1122953996 tempest-QuotasAdminNegativeTest-1122953996-project] instances quota exceeded for 8faddb1f08654d70bb49069583d63847, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=128759) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Sep 14 08:59:25.139572 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-d94926b0-205d-47a6-afd0-222942dc37d9 tempest-QuotasAdminNegativeTest-1122953996 tempest-QuotasAdminNegativeTest-1122953996-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Sep 14 08:59:25.141896 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d94926b0-205d-47a6-afd0-222942dc37d9 tempest-QuotasAdminNegativeTest-1122953996 tempest-QuotasAdminNegativeTest-1122953996-project] Request method failure captured: Sep 14 08:59:25.141896 n-d-836830-18 devstack@n-api.service[128759]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 14 08:59:25.141896 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 08:59:25.141896 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 08:59:25.141896 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 08:59:25.141896 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 145 Sep 14 08:59:25.141896 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 08:59:25.141896 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 08:59:25.141896 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 08:59:25.141896 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 08:59:25.141896 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZfoneuVESyMw2VFxG4ywgMHDhp4v6D6Ye6WDAfPC_0i-VQMtbukZrLGgo06VAKKElGn_rKoyYTEgAubTIxJAdGgjLczZAoPhTB5OIbiYAgP0lSx_ERdqhEXcO65v9jC1sVG8p5fYb6IkK1L2N4WEUl7vAxc5Vn85-pq24wQl1F7078 Sep 14 08:59:25.141896 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 08:59:25.141896 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 08:59:25.141896 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 08:59:25.141896 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 08:59:25.141896 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 08:59:25.141896 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 08:59:25.141896 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 8faddb1f08654d70bb49069583d63847 Sep 14 08:59:25.141896 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-QuotasAdminNegativeTest-1122953996 Sep 14 08:59:25.141896 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 08:59:25.141896 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 08:59:25.141896 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/8faddb1f08654d70bb49069583d63847"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_8faddb1f08654d70bb49069583d63847"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8faddb1f08654d70bb49069583d63847"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8faddb1f08654d70bb49069583d63847"}]}] Sep 14 08:59:25.141896 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-QuotasAdminNegativeTest-1122953996 Sep 14 08:59:25.141896 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 8faddb1f08654d70bb49069583d63847 Sep 14 08:59:25.141896 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1122953996 Sep 14 08:59:25.141896 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-QuotasAdminNegativeTest-1122953996-project Sep 14 08:59:25.141896 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 08:59:25.141896 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 08:59:25.141896 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: ef84b84c7781491eb3b4e5a4aef00c72 Sep 14 08:59:25.141896 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-QuotasAdminNegativeTest-1122953996-project Sep 14 08:59:25.141896 n-d-836830-18 devstack@n-api.service[128759]: Sep 14 08:59:25.141896 n-d-836830-18 devstack@n-api.service[128759]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1443326137", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452"}} Sep 14 08:59:25.141896 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 08:59:25.141896 n-d-836830-18 devstack@n-api.service[128759]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Sep 14 08:59:25.141896 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1443326137', 'imageRef': 'bff4ab7f-4846-441f-8940-d96fec4c28e9', 'flavorRef': '452'}}} Sep 14 08:59:25.141896 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:59:25.141896 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:59:25.141896 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Sep 14 08:59:25.141896 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Sep 14 08:59:25.141896 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 14 08:59:25.141896 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 14 08:59:25.141896 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Sep 14 08:59:25.141896 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc Sep 14 08:59:25.141896 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Sep 14 08:59:25.141896 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Sep 14 08:59:25.141896 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 14 08:59:25.141896 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 14 08:59:25.141896 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Sep 14 08:59:25.141896 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Sep 14 08:59:25.141896 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Sep 14 08:59:25.141896 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Sep 14 08:59:25.141896 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Sep 14 08:59:25.141896 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Sep 14 08:59:25.141896 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Sep 14 08:59:25.141896 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:59:25.141896 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:59:25.141896 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:59:25.141896 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:59:25.141896 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 14 08:59:25.141896 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 14 08:59:25.141896 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 14 08:59:25.141896 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 14 08:59:25.141896 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Sep 14 08:59:25.145805 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Sep 14 08:59:25.145805 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Sep 14 08:59:25.145805 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Sep 14 08:59:25.145805 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Sep 14 08:59:25.145805 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Sep 14 08:59:25.145805 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Sep 14 08:59:25.145805 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:59:25.145805 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:59:25.145805 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:59:25.145805 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:59:25.145805 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:59:25.145805 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:59:25.145805 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:59:25.145805 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:59:25.145805 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:59:25.145805 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:59:25.145805 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 08:59:25.145805 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 08:59:25.145805 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 08:59:25.145805 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 08:59:25.145805 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 08:59:25.145805 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 08:59:25.145805 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 14 08:59:25.145805 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Sep 14 08:59:25.145805 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 14 08:59:25.145805 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Sep 14 08:59:25.145805 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:59:25.145805 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:59:25.145805 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:59:25.145805 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:59:25.145805 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:59:25.145805 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:59:25.145805 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:59:25.145805 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:59:25.145805 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Sep 14 08:59:25.145805 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:59:25.145805 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d94926b0-205d-47a6-afd0-222942dc37d9 tempest-QuotasAdminNegativeTest-1122953996 tempest-QuotasAdminNegativeTest-1122953996-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:59:25.145805 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d94926b0-205d-47a6-afd0-222942dc37d9 tempest-QuotasAdminNegativeTest-1122953996 tempest-QuotasAdminNegativeTest-1122953996-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 0.565027 Sep 14 08:59:25.153126 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1208/2470] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 08:59:24 2022] POST /compute/v2.1/servers => generated 119 bytes in 573 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Sep 14 08:59:25.153126 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-78346953-09cc-4f21-9ccc-e03c93ac4c16 tempest-QuotasAdminNegativeTest-1087634401 tempest-QuotasAdminNegativeTest-1087634401-project-admin] Action: 'update', calling method: .version_select at 0x7f7d3fff95e0>, body: {"quota_set": {"instances": 10}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:59:25.242128 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-78346953-09cc-4f21-9ccc-e03c93ac4c16 tempest-QuotasAdminNegativeTest-1087634401 tempest-QuotasAdminNegativeTest-1087634401-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:25.242850 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-78346953-09cc-4f21-9ccc-e03c93ac4c16 tempest-QuotasAdminNegativeTest-1087634401 tempest-QuotasAdminNegativeTest-1087634401-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:25.243684 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-78346953-09cc-4f21-9ccc-e03c93ac4c16 tempest-QuotasAdminNegativeTest-1087634401 tempest-QuotasAdminNegativeTest-1087634401-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:25.244639 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-78346953-09cc-4f21-9ccc-e03c93ac4c16 tempest-QuotasAdminNegativeTest-1087634401 tempest-QuotasAdminNegativeTest-1087634401-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:25.245400 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-78346953-09cc-4f21-9ccc-e03c93ac4c16 tempest-QuotasAdminNegativeTest-1087634401 tempest-QuotasAdminNegativeTest-1087634401-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:25.245999 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-78346953-09cc-4f21-9ccc-e03c93ac4c16 tempest-QuotasAdminNegativeTest-1087634401 tempest-QuotasAdminNegativeTest-1087634401-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:25.309325 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-677c5a0b-6bc8-4e4a-a71b-98bfffdc3a94 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db65c0cfa83f48468d4a1bcef0caff73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9df06ceaa154f3c80665cc6a27b3598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:25.314464 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-78346953-09cc-4f21-9ccc-e03c93ac4c16 tempest-QuotasAdminNegativeTest-1087634401 tempest-QuotasAdminNegativeTest-1087634401-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-quota-sets/8faddb1f08654d70bb49069583d63847" status: 200 len: 329 microversion: 2.1 time: 0.165995 Sep 14 08:59:25.315482 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1209/2471] 10.222.0.60 () {60 vars in 1262 bytes} [Wed Sep 14 08:59:25 2022] PUT /compute/v2.1/os-quota-sets/8faddb1f08654d70bb49069583d63847 => generated 329 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:59:25.323399 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-677c5a0b-6bc8-4e4a-a71b-98bfffdc3a94 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] 10.222.0.60 "GET /compute/v2.1/servers/2da88a50-c283-4c91-b3e1-bd4f5eb9e319" status: 200 len: 1324 microversion: 2.1 time: 0.209664 Sep 14 08:59:25.324261 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1263/2472] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:25 2022] GET /compute/v2.1/servers/2da88a50-c283-4c91-b3e1-bd4f5eb9e319 => generated 1324 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:59:25.328412 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-152906de-96c8-4b7a-9a28-6520d25e9041 tempest-QuotasAdminNegativeTest-1087634401 tempest-QuotasAdminNegativeTest-1087634401-project-admin] Calling method '.version_select at 0x7f7d444273a0>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:25.418851 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-152906de-96c8-4b7a-9a28-6520d25e9041 tempest-QuotasAdminNegativeTest-1087634401 tempest-QuotasAdminNegativeTest-1087634401-project-admin] 10.222.0.60 "GET /compute/v2.1/os-quota-sets/8faddb1f08654d70bb49069583d63847" status: 200 len: 371 microversion: 2.1 time: 0.094158 Sep 14 08:59:25.420665 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1210/2473] 10.222.0.60 () {58 vars in 1242 bytes} [Wed Sep 14 08:59:25 2022] GET /compute/v2.1/os-quota-sets/8faddb1f08654d70bb49069583d63847 => generated 371 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:59:25.432659 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-0390bb17-0f38-4c4d-a638-62f152cfb5c1 tempest-QuotasAdminNegativeTest-1087634401 tempest-QuotasAdminNegativeTest-1087634401-project-admin] Action: 'update', calling method: .version_select at 0x7f7d44279040>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:59:25.433260 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-fd16a4d9-b4a6-46ab-a778-670420d8e22c tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:25.433886 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-fd16a4d9-b4a6-46ab-a778-670420d8e22c tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: 82774725-1b08-411d-b760-4ed6aa3cec68] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:25.444688 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fd16a4d9-b4a6-46ab-a778-670420d8e22c tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:25.445291 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fd16a4d9-b4a6-46ab-a778-670420d8e22c tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:25.445820 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fd16a4d9-b4a6-46ab-a778-670420d8e22c tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:25.446541 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fd16a4d9-b4a6-46ab-a778-670420d8e22c tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:25.447027 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fd16a4d9-b4a6-46ab-a778-670420d8e22c tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:25.447636 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fd16a4d9-b4a6-46ab-a778-670420d8e22c tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:25.508101 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0390bb17-0f38-4c4d-a638-62f152cfb5c1 tempest-QuotasAdminNegativeTest-1087634401 tempest-QuotasAdminNegativeTest-1087634401-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:25.508589 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0390bb17-0f38-4c4d-a638-62f152cfb5c1 tempest-QuotasAdminNegativeTest-1087634401 tempest-QuotasAdminNegativeTest-1087634401-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:25.509234 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0390bb17-0f38-4c4d-a638-62f152cfb5c1 tempest-QuotasAdminNegativeTest-1087634401 tempest-QuotasAdminNegativeTest-1087634401-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:25.510317 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0390bb17-0f38-4c4d-a638-62f152cfb5c1 tempest-QuotasAdminNegativeTest-1087634401 tempest-QuotasAdminNegativeTest-1087634401-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:25.510784 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0390bb17-0f38-4c4d-a638-62f152cfb5c1 tempest-QuotasAdminNegativeTest-1087634401 tempest-QuotasAdminNegativeTest-1087634401-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:25.513531 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0390bb17-0f38-4c4d-a638-62f152cfb5c1 tempest-QuotasAdminNegativeTest-1087634401 tempest-QuotasAdminNegativeTest-1087634401-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:25.535957 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-fd16a4d9-b4a6-46ab-a778-670420d8e22c tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:25.546250 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-fd16a4d9-b4a6-46ab-a778-670420d8e22c tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/82774725-1b08-411d-b760-4ed6aa3cec68" status: 200 len: 1267 microversion: 2.1 time: 0.116692 Sep 14 08:59:25.561596 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1264/2474] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:25 2022] GET /compute/v2.1/servers/82774725-1b08-411d-b760-4ed6aa3cec68 => generated 1267 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:59:25.583968 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-0390bb17-0f38-4c4d-a638-62f152cfb5c1 tempest-QuotasAdminNegativeTest-1087634401 tempest-QuotasAdminNegativeTest-1087634401-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-quota-sets/8faddb1f08654d70bb49069583d63847" status: 200 len: 325 microversion: 2.1 time: 0.155381 Sep 14 08:59:25.587019 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1211/2475] 10.222.0.60 () {60 vars in 1262 bytes} [Wed Sep 14 08:59:25 2022] PUT /compute/v2.1/os-quota-sets/8faddb1f08654d70bb49069583d63847 => generated 325 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 08:59:25.639179 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1528e1f0-f66d-43d4-be6c-84c558e43010 tempest-QuotasAdminNegativeTest-1122953996 tempest-QuotasAdminNegativeTest-1122953996-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-739947551", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:59:25.698616 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.network.neutron [None req-1528e1f0-f66d-43d4-be6c-84c558e43010 tempest-QuotasAdminNegativeTest-1122953996 tempest-QuotasAdminNegativeTest-1122953996-project] validate_networks() for None {{(pid=128758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 08:59:25.758186 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e48bb9bd-0829-4f55-b789-66e8ae891574 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:25.758821 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e48bb9bd-0829-4f55-b789-66e8ae891574 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 39890752-2382-4631-8c4a-f3c6d47c94cb] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:25.767695 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e48bb9bd-0829-4f55-b789-66e8ae891574 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:25.768192 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e48bb9bd-0829-4f55-b789-66e8ae891574 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:25.768722 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e48bb9bd-0829-4f55-b789-66e8ae891574 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:25.769770 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e48bb9bd-0829-4f55-b789-66e8ae891574 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:25.770448 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e48bb9bd-0829-4f55-b789-66e8ae891574 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:25.770881 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e48bb9bd-0829-4f55-b789-66e8ae891574 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:26.283454 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-e48bb9bd-0829-4f55-b789-66e8ae891574 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:26.292219 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e48bb9bd-0829-4f55-b789-66e8ae891574 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/39890752-2382-4631-8c4a-f3c6d47c94cb" status: 200 len: 1309 microversion: 2.1 time: 0.538236 Sep 14 08:59:26.307438 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1212/2476] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:25 2022] GET /compute/v2.1/servers/39890752-2382-4631-8c4a-f3c6d47c94cb => generated 1309 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:59:26.316522 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e9621e8a-5680-4103-8a3e-522dceab33a1 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:26.317224 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e9621e8a-5680-4103-8a3e-522dceab33a1 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: d0c5547a-1340-4d19-a0f9-3e1eb9fd1932] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:26.324357 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e9621e8a-5680-4103-8a3e-522dceab33a1 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:26.324983 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e9621e8a-5680-4103-8a3e-522dceab33a1 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:26.325655 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e9621e8a-5680-4103-8a3e-522dceab33a1 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:26.326339 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e9621e8a-5680-4103-8a3e-522dceab33a1 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:26.326898 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e9621e8a-5680-4103-8a3e-522dceab33a1 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:26.327506 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e9621e8a-5680-4103-8a3e-522dceab33a1 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:26.330412 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-1528e1f0-f66d-43d4-be6c-84c558e43010 tempest-QuotasAdminNegativeTest-1122953996 tempest-QuotasAdminNegativeTest-1122953996-project] Flavor limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 08:59:26.331600 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-1528e1f0-f66d-43d4-be6c-84c558e43010 tempest-QuotasAdminNegativeTest-1122953996 tempest-QuotasAdminNegativeTest-1122953996-project] Image limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 08:59:26.334122 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-1528e1f0-f66d-43d4-be6c-84c558e43010 tempest-QuotasAdminNegativeTest-1122953996 tempest-QuotasAdminNegativeTest-1122953996-project] Flavor pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 08:59:26.334774 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-1528e1f0-f66d-43d4-be6c-84c558e43010 tempest-QuotasAdminNegativeTest-1122953996 tempest-QuotasAdminNegativeTest-1122953996-project] Image pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 08:59:26.335611 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-1528e1f0-f66d-43d4-be6c-84c558e43010 tempest-QuotasAdminNegativeTest-1122953996 tempest-QuotasAdminNegativeTest-1122953996-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 08:59:26.351004 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1528e1f0-f66d-43d4-be6c-84c558e43010 tempest-QuotasAdminNegativeTest-1122953996 tempest-QuotasAdminNegativeTest-1122953996-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:26.351586 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1528e1f0-f66d-43d4-be6c-84c558e43010 tempest-QuotasAdminNegativeTest-1122953996 tempest-QuotasAdminNegativeTest-1122953996-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:26.352097 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1528e1f0-f66d-43d4-be6c-84c558e43010 tempest-QuotasAdminNegativeTest-1122953996 tempest-QuotasAdminNegativeTest-1122953996-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:26.353271 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1528e1f0-f66d-43d4-be6c-84c558e43010 tempest-QuotasAdminNegativeTest-1122953996 tempest-QuotasAdminNegativeTest-1122953996-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:26.353793 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1528e1f0-f66d-43d4-be6c-84c558e43010 tempest-QuotasAdminNegativeTest-1122953996 tempest-QuotasAdminNegativeTest-1122953996-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:26.354432 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1528e1f0-f66d-43d4-be6c-84c558e43010 tempest-QuotasAdminNegativeTest-1122953996 tempest-QuotasAdminNegativeTest-1122953996-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:26.389889 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-1528e1f0-f66d-43d4-be6c-84c558e43010 tempest-QuotasAdminNegativeTest-1122953996 tempest-QuotasAdminNegativeTest-1122953996-project] Getting quotas for project 8faddb1f08654d70bb49069583d63847. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 08:59:26.398974 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-1528e1f0-f66d-43d4-be6c-84c558e43010 tempest-QuotasAdminNegativeTest-1122953996 tempest-QuotasAdminNegativeTest-1122953996-project] Getting quotas for user ef84b84c7781491eb3b4e5a4aef00c72 and project 8faddb1f08654d70bb49069583d63847. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 08:59:26.417577 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.utils [None req-1528e1f0-f66d-43d4-be6c-84c558e43010 tempest-QuotasAdminNegativeTest-1122953996 tempest-QuotasAdminNegativeTest-1122953996-project] ram quota exceeded for 8faddb1f08654d70bb49069583d63847, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=128758) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Sep 14 08:59:26.418887 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-1528e1f0-f66d-43d4-be6c-84c558e43010 tempest-QuotasAdminNegativeTest-1122953996 tempest-QuotasAdminNegativeTest-1122953996-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Sep 14 08:59:26.423463 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1528e1f0-f66d-43d4-be6c-84c558e43010 tempest-QuotasAdminNegativeTest-1122953996 tempest-QuotasAdminNegativeTest-1122953996-project] Request method failure captured: Sep 14 08:59:26.423463 n-d-836830-18 devstack@n-api.service[128758]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 14 08:59:26.423463 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 08:59:26.423463 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 08:59:26.423463 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 08:59:26.423463 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 144 Sep 14 08:59:26.423463 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 08:59:26.423463 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 08:59:26.423463 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 08:59:26.423463 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 08:59:26.423463 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZfoneuVESyMw2VFxG4ywgMHDhp4v6D6Ye6WDAfPC_0i-VQMtbukZrLGgo06VAKKElGn_rKoyYTEgAubTIxJAdGgjLczZAoPhTB5OIbiYAgP0lSx_ERdqhEXcO65v9jC1sVG8p5fYb6IkK1L2N4WEUl7vAxc5Vn85-pq24wQl1F7078 Sep 14 08:59:26.423463 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 08:59:26.423463 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 08:59:26.423463 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 08:59:26.423463 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 08:59:26.423463 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 08:59:26.423463 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 08:59:26.423463 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 8faddb1f08654d70bb49069583d63847 Sep 14 08:59:26.423463 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-QuotasAdminNegativeTest-1122953996 Sep 14 08:59:26.423463 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 08:59:26.423463 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 08:59:26.423463 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/8faddb1f08654d70bb49069583d63847"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_8faddb1f08654d70bb49069583d63847"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8faddb1f08654d70bb49069583d63847"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8faddb1f08654d70bb49069583d63847"}]}] Sep 14 08:59:26.423463 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-QuotasAdminNegativeTest-1122953996 Sep 14 08:59:26.423463 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 8faddb1f08654d70bb49069583d63847 Sep 14 08:59:26.423463 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1122953996 Sep 14 08:59:26.423463 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-QuotasAdminNegativeTest-1122953996-project Sep 14 08:59:26.423463 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 08:59:26.423463 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 08:59:26.423463 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: ef84b84c7781491eb3b4e5a4aef00c72 Sep 14 08:59:26.423463 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-QuotasAdminNegativeTest-1122953996-project Sep 14 08:59:26.423463 n-d-836830-18 devstack@n-api.service[128758]: Sep 14 08:59:26.423463 n-d-836830-18 devstack@n-api.service[128758]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-739947551", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452"}} Sep 14 08:59:26.423463 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 08:59:26.423463 n-d-836830-18 devstack@n-api.service[128758]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Sep 14 08:59:26.423463 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-739947551', 'imageRef': 'bff4ab7f-4846-441f-8940-d96fec4c28e9', 'flavorRef': '452'}}} Sep 14 08:59:26.423463 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:59:26.423463 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:59:26.423463 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Sep 14 08:59:26.423463 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Sep 14 08:59:26.423463 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 14 08:59:26.423463 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 14 08:59:26.423463 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Sep 14 08:59:26.423463 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc Sep 14 08:59:26.423463 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Sep 14 08:59:26.423463 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Sep 14 08:59:26.423463 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 14 08:59:26.423463 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 14 08:59:26.423463 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Sep 14 08:59:26.423463 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Sep 14 08:59:26.423463 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Sep 14 08:59:26.423463 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Sep 14 08:59:26.423463 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Sep 14 08:59:26.423463 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Sep 14 08:59:26.423463 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Sep 14 08:59:26.423463 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:59:26.423463 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:59:26.423463 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:59:26.423463 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:59:26.423463 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 14 08:59:26.423463 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 14 08:59:26.423463 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 14 08:59:26.423463 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 14 08:59:26.423463 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Sep 14 08:59:26.427530 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Sep 14 08:59:26.427530 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Sep 14 08:59:26.427530 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Sep 14 08:59:26.427530 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Sep 14 08:59:26.427530 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Sep 14 08:59:26.427530 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Sep 14 08:59:26.427530 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:59:26.427530 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:59:26.427530 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:59:26.427530 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:59:26.427530 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:59:26.427530 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:59:26.427530 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:59:26.427530 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:59:26.427530 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:59:26.427530 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:59:26.427530 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 08:59:26.427530 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 08:59:26.427530 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 08:59:26.427530 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 08:59:26.427530 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 08:59:26.427530 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 08:59:26.427530 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 14 08:59:26.427530 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Sep 14 08:59:26.427530 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 14 08:59:26.427530 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Sep 14 08:59:26.427530 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:59:26.427530 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:59:26.427530 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:59:26.427530 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:59:26.427530 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:59:26.427530 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:59:26.427530 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:59:26.427530 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:59:26.427530 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Sep 14 08:59:26.427530 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 08:59:26.427530 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1528e1f0-f66d-43d4-be6c-84c558e43010 tempest-QuotasAdminNegativeTest-1122953996 tempest-QuotasAdminNegativeTest-1122953996-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:59:26.427530 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-1528e1f0-f66d-43d4-be6c-84c558e43010 tempest-QuotasAdminNegativeTest-1122953996 tempest-QuotasAdminNegativeTest-1122953996-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.789732 Sep 14 08:59:26.430487 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1265/2477] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 08:59:25 2022] POST /compute/v2.1/servers => generated 110 bytes in 796 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 14 08:59:26.436040 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-8417c3b1-6a28-4d7a-8845-7b0480adcc2c tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:26.436907 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-8417c3b1-6a28-4d7a-8845-7b0480adcc2c tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] [instance: 2da88a50-c283-4c91-b3e1-bd4f5eb9e319] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:26.445402 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8417c3b1-6a28-4d7a-8845-7b0480adcc2c tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:26.446138 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8417c3b1-6a28-4d7a-8845-7b0480adcc2c tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:26.446972 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8417c3b1-6a28-4d7a-8845-7b0480adcc2c tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:26.447959 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8417c3b1-6a28-4d7a-8845-7b0480adcc2c tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:26.448571 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8417c3b1-6a28-4d7a-8845-7b0480adcc2c tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:26.449227 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8417c3b1-6a28-4d7a-8845-7b0480adcc2c tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:26.545682 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-e9621e8a-5680-4103-8a3e-522dceab33a1 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9d40e54481461cba53fedb9a6abdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed2295a58f8451993a57ce0a6f9ba29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:26.554367 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e9621e8a-5680-4103-8a3e-522dceab33a1 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] 10.222.0.60 "GET /compute/v2.1/servers/d0c5547a-1340-4d19-a0f9-3e1eb9fd1932" status: 200 len: 1513 microversion: 2.1 time: 0.245714 Sep 14 08:59:26.555681 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1213/2478] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:26 2022] GET /compute/v2.1/servers/d0c5547a-1340-4d19-a0f9-3e1eb9fd1932 => generated 1513 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:59:26.560812 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-6a068651-55d9-4284-93ba-aebeff93bc85 tempest-QuotasAdminNegativeTest-1087634401 tempest-QuotasAdminNegativeTest-1087634401-project-admin] Action: 'update', calling method: .version_select at 0x7f7d3fbcf040>, body: {"quota_set": {"ram": 51200}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:59:26.640953 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6a068651-55d9-4284-93ba-aebeff93bc85 tempest-QuotasAdminNegativeTest-1087634401 tempest-QuotasAdminNegativeTest-1087634401-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:26.641705 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6a068651-55d9-4284-93ba-aebeff93bc85 tempest-QuotasAdminNegativeTest-1087634401 tempest-QuotasAdminNegativeTest-1087634401-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:26.642392 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6a068651-55d9-4284-93ba-aebeff93bc85 tempest-QuotasAdminNegativeTest-1087634401 tempest-QuotasAdminNegativeTest-1087634401-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:26.643489 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6a068651-55d9-4284-93ba-aebeff93bc85 tempest-QuotasAdminNegativeTest-1087634401 tempest-QuotasAdminNegativeTest-1087634401-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:26.644164 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6a068651-55d9-4284-93ba-aebeff93bc85 tempest-QuotasAdminNegativeTest-1087634401 tempest-QuotasAdminNegativeTest-1087634401-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:26.644804 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6a068651-55d9-4284-93ba-aebeff93bc85 tempest-QuotasAdminNegativeTest-1087634401 tempest-QuotasAdminNegativeTest-1087634401-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:26.663701 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-8417c3b1-6a28-4d7a-8845-7b0480adcc2c tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db65c0cfa83f48468d4a1bcef0caff73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9df06ceaa154f3c80665cc6a27b3598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:26.678065 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-8417c3b1-6a28-4d7a-8845-7b0480adcc2c tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] 10.222.0.60 "GET /compute/v2.1/servers/2da88a50-c283-4c91-b3e1-bd4f5eb9e319" status: 200 len: 1324 microversion: 2.1 time: 0.244811 Sep 14 08:59:26.679248 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1266/2479] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:26 2022] GET /compute/v2.1/servers/2da88a50-c283-4c91-b3e1-bd4f5eb9e319 => generated 1324 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:59:26.686877 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b0ad7739-de10-4249-9948-5e9a84ebc921 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:26.688316 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-b0ad7739-de10-4249-9948-5e9a84ebc921 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: 82774725-1b08-411d-b760-4ed6aa3cec68] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:26.721882 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b0ad7739-de10-4249-9948-5e9a84ebc921 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:26.722561 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b0ad7739-de10-4249-9948-5e9a84ebc921 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:26.723573 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b0ad7739-de10-4249-9948-5e9a84ebc921 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:26.725691 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b0ad7739-de10-4249-9948-5e9a84ebc921 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:26.727734 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b0ad7739-de10-4249-9948-5e9a84ebc921 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:26.728272 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b0ad7739-de10-4249-9948-5e9a84ebc921 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:26.749325 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-6a068651-55d9-4284-93ba-aebeff93bc85 tempest-QuotasAdminNegativeTest-1087634401 tempest-QuotasAdminNegativeTest-1087634401-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-quota-sets/8faddb1f08654d70bb49069583d63847" status: 200 len: 329 microversion: 2.1 time: 0.191952 Sep 14 08:59:26.750744 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1214/2480] 10.222.0.60 () {60 vars in 1262 bytes} [Wed Sep 14 08:59:26 2022] PUT /compute/v2.1/os-quota-sets/8faddb1f08654d70bb49069583d63847 => generated 329 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:59:26.765511 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-66880a26-7e5b-4891-af8d-7df05d02deba tempest-QuotasAdminNegativeTest-1122953996 tempest-QuotasAdminNegativeTest-1122953996-project] Action: 'update', calling method: .version_select at 0x7f7d44427790>, body: {"quota_set": {"ram": 0}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:59:26.773104 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-66880a26-7e5b-4891-af8d-7df05d02deba tempest-QuotasAdminNegativeTest-1122953996 tempest-QuotasAdminNegativeTest-1122953996-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': 'ef84b84c7781491eb3b4e5a4aef00c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8faddb1f08654d70bb49069583d63847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:26.776121 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-66880a26-7e5b-4891-af8d-7df05d02deba tempest-QuotasAdminNegativeTest-1122953996 tempest-QuotasAdminNegativeTest-1122953996-project] Request method failure captured: Sep 14 08:59:26.776121 n-d-836830-18 devstack@n-api.service[128759]: request: PUT /compute/v2.1/os-quota-sets/8faddb1f08654d70bb49069583d63847 HTTP/1.1 Sep 14 08:59:26.776121 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 08:59:26.776121 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 08:59:26.776121 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 08:59:26.776121 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 25 Sep 14 08:59:26.776121 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 08:59:26.776121 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 08:59:26.776121 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 08:59:26.776121 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 08:59:26.776121 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZfoneuVESyMw2VFxG4ywgMHDhp4v6D6Ye6WDAfPC_0i-VQMtbukZrLGgo06VAKKElGn_rKoyYTEgAubTIxJAdGgjLczZAoPhTB5OIbiYAgP0lSx_ERdqhEXcO65v9jC1sVG8p5fYb6IkK1L2N4WEUl7vAxc5Vn85-pq24wQl1F7078 Sep 14 08:59:26.776121 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 08:59:26.776121 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 08:59:26.776121 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 08:59:26.776121 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 08:59:26.776121 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 08:59:26.776121 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 08:59:26.776121 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 8faddb1f08654d70bb49069583d63847 Sep 14 08:59:26.776121 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-QuotasAdminNegativeTest-1122953996 Sep 14 08:59:26.776121 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 08:59:26.776121 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 08:59:26.776121 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/8faddb1f08654d70bb49069583d63847"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_8faddb1f08654d70bb49069583d63847"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8faddb1f08654d70bb49069583d63847"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8faddb1f08654d70bb49069583d63847"}]}] Sep 14 08:59:26.776121 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-QuotasAdminNegativeTest-1122953996 Sep 14 08:59:26.776121 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 8faddb1f08654d70bb49069583d63847 Sep 14 08:59:26.776121 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1122953996 Sep 14 08:59:26.776121 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-QuotasAdminNegativeTest-1122953996-project Sep 14 08:59:26.776121 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 08:59:26.776121 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 08:59:26.776121 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: ef84b84c7781491eb3b4e5a4aef00c72 Sep 14 08:59:26.776121 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-QuotasAdminNegativeTest-1122953996-project Sep 14 08:59:26.776121 n-d-836830-18 devstack@n-api.service[128759]: Sep 14 08:59:26.776121 n-d-836830-18 devstack@n-api.service[128759]: {"quota_set": {"ram": 0}} Sep 14 08:59:26.776121 n-d-836830-18 devstack@n-api.service[128759]: method: Sep 14 08:59:26.776121 n-d-836830-18 devstack@n-api.service[128759]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Sep 14 08:59:26.776121 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '8faddb1f08654d70bb49069583d63847', 'body': {'quota_set': {'ram': 0}}} Sep 14 08:59:26.776121 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:59:26.776121 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:59:26.776121 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:59:26.776121 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:59:26.776121 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:59:26.776121 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:59:26.776121 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 08:59:26.776121 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 08:59:26.776121 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:59:26.776121 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:59:26.776121 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 08:59:26.776121 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 08:59:26.776121 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Sep 14 08:59:26.776121 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Sep 14 08:59:26.776121 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 14 08:59:26.776121 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 08:59:26.776121 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 14 08:59:26.776121 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 08:59:26.776121 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Sep 14 08:59:26.776121 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Sep 14 08:59:26.776121 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 14 08:59:26.776121 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 14 08:59:26.776121 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 14 08:59:26.776121 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 14 08:59:26.776121 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 14 08:59:26.776121 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 14 08:59:26.776121 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 14 08:59:26.776121 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise self.value Sep 14 08:59:26.776121 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 14 08:59:26.781113 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 14 08:59:26.781113 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 14 08:59:26.781113 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 14 08:59:26.781113 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 14 08:59:26.781113 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 14 08:59:26.781113 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Sep 14 08:59:26.781113 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:59:26.781113 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:59:26.781113 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:59:26.781113 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:59:26.781113 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:59:26.781113 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:59:26.781113 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 14 08:59:26.781113 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 14 08:59:26.781113 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Sep 14 08:59:26.781113 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:59:26.781113 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-66880a26-7e5b-4891-af8d-7df05d02deba tempest-QuotasAdminNegativeTest-1122953996 tempest-QuotasAdminNegativeTest-1122953996-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:59:26.781113 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-66880a26-7e5b-4891-af8d-7df05d02deba tempest-QuotasAdminNegativeTest-1122953996 tempest-QuotasAdminNegativeTest-1122953996-project] 10.222.0.60 "PUT /compute/v2.1/os-quota-sets/8faddb1f08654d70bb49069583d63847" status: 403 len: 116 microversion: 2.1 time: 0.021083 Sep 14 08:59:26.782203 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1215/2481] 10.222.0.60 () {60 vars in 1262 bytes} [Wed Sep 14 08:59:26 2022] PUT /compute/v2.1/os-quota-sets/8faddb1f08654d70bb49069583d63847 => generated 116 bytes in 23 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 14 08:59:26.827819 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-b0ad7739-de10-4249-9948-5e9a84ebc921 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:26.839040 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-b0ad7739-de10-4249-9948-5e9a84ebc921 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/82774725-1b08-411d-b760-4ed6aa3cec68" status: 200 len: 1273 microversion: 2.1 time: 0.158519 Sep 14 08:59:26.840306 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1267/2482] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:26 2022] GET /compute/v2.1/servers/82774725-1b08-411d-b760-4ed6aa3cec68 => generated 1273 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:59:27.324832 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-5e96601b-5ab4-4651-8c75-2b4954be3c1e tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:27.326354 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-5e96601b-5ab4-4651-8c75-2b4954be3c1e tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 39890752-2382-4631-8c4a-f3c6d47c94cb] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:27.340690 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5e96601b-5ab4-4651-8c75-2b4954be3c1e tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:27.341617 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5e96601b-5ab4-4651-8c75-2b4954be3c1e tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:27.342066 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5e96601b-5ab4-4651-8c75-2b4954be3c1e tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:27.342793 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5e96601b-5ab4-4651-8c75-2b4954be3c1e tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:27.346102 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5e96601b-5ab4-4651-8c75-2b4954be3c1e tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:27.346504 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5e96601b-5ab4-4651-8c75-2b4954be3c1e tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:27.585889 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-7a023fe3-e319-4164-add5-e2de7e6ba3b8 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:27.586502 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-7a023fe3-e319-4164-add5-e2de7e6ba3b8 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: d0c5547a-1340-4d19-a0f9-3e1eb9fd1932] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:27.616725 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-5e96601b-5ab4-4651-8c75-2b4954be3c1e tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:27.626096 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7a023fe3-e319-4164-add5-e2de7e6ba3b8 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:27.628790 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7a023fe3-e319-4164-add5-e2de7e6ba3b8 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:27.630930 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7a023fe3-e319-4164-add5-e2de7e6ba3b8 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:27.631483 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-5e96601b-5ab4-4651-8c75-2b4954be3c1e tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/39890752-2382-4631-8c4a-f3c6d47c94cb" status: 200 len: 1309 microversion: 2.1 time: 0.309864 Sep 14 08:59:27.634040 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1216/2483] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:27 2022] GET /compute/v2.1/servers/39890752-2382-4631-8c4a-f3c6d47c94cb => generated 1309 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:59:27.644631 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7a023fe3-e319-4164-add5-e2de7e6ba3b8 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:27.646279 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7a023fe3-e319-4164-add5-e2de7e6ba3b8 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:27.647140 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7a023fe3-e319-4164-add5-e2de7e6ba3b8 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:27.704772 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-1fecd16f-6e06-4ae2-8dd5-f35da63de61e tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:27.705966 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-1fecd16f-6e06-4ae2-8dd5-f35da63de61e tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] [instance: 2da88a50-c283-4c91-b3e1-bd4f5eb9e319] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:27.719218 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1fecd16f-6e06-4ae2-8dd5-f35da63de61e tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:27.719754 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1fecd16f-6e06-4ae2-8dd5-f35da63de61e tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:27.721291 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1fecd16f-6e06-4ae2-8dd5-f35da63de61e tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:27.723757 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1fecd16f-6e06-4ae2-8dd5-f35da63de61e tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:27.724936 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1fecd16f-6e06-4ae2-8dd5-f35da63de61e tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:27.727109 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1fecd16f-6e06-4ae2-8dd5-f35da63de61e tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:27.971387 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-1fecd16f-6e06-4ae2-8dd5-f35da63de61e tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db65c0cfa83f48468d4a1bcef0caff73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9df06ceaa154f3c80665cc6a27b3598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:27.985116 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-1fecd16f-6e06-4ae2-8dd5-f35da63de61e tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] 10.222.0.60 "GET /compute/v2.1/servers/2da88a50-c283-4c91-b3e1-bd4f5eb9e319" status: 200 len: 1324 microversion: 2.1 time: 0.284770 Sep 14 08:59:27.996466 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-7a023fe3-e319-4164-add5-e2de7e6ba3b8 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9d40e54481461cba53fedb9a6abdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed2295a58f8451993a57ce0a6f9ba29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:28.003245 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1217/2484] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:27 2022] GET /compute/v2.1/servers/2da88a50-c283-4c91-b3e1-bd4f5eb9e319 => generated 1324 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:59:28.006147 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-7a023fe3-e319-4164-add5-e2de7e6ba3b8 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] 10.222.0.60 "GET /compute/v2.1/servers/d0c5547a-1340-4d19-a0f9-3e1eb9fd1932" status: 200 len: 1513 microversion: 2.1 time: 0.426131 Sep 14 08:59:28.007373 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1268/2485] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:27 2022] GET /compute/v2.1/servers/d0c5547a-1340-4d19-a0f9-3e1eb9fd1932 => generated 1513 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:59:28.008827 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-b8b9f432-0300-4c60-84c1-0eca9f264c8e req-3e669ba6-d04e-4f0f-8703-4064ceb19b19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39890752-2382-4631-8c4a-f3c6d47c94cb", "name": "network-vif-plugged", "status": "completed", "tag": "c75c1874-c724-4f8e-ad23-280fad270390"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:59:28.015657 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b99d7f4c-ccdd-4223-bae1-e5efb236e14b tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:28.021903 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-b99d7f4c-ccdd-4223-bae1-e5efb236e14b tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: 82774725-1b08-411d-b760-4ed6aa3cec68] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:28.023344 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-b8b9f432-0300-4c60-84c1-0eca9f264c8e req-3e669ba6-d04e-4f0f-8703-4064ceb19b19 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:28.025263 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-b8b9f432-0300-4c60-84c1-0eca9f264c8e req-3e669ba6-d04e-4f0f-8703-4064ceb19b19 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:28.025713 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-b8b9f432-0300-4c60-84c1-0eca9f264c8e req-3e669ba6-d04e-4f0f-8703-4064ceb19b19 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:28.032199 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b99d7f4c-ccdd-4223-bae1-e5efb236e14b tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:28.033115 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b99d7f4c-ccdd-4223-bae1-e5efb236e14b tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:28.033804 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b99d7f4c-ccdd-4223-bae1-e5efb236e14b tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:28.034828 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b99d7f4c-ccdd-4223-bae1-e5efb236e14b tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:28.035618 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b99d7f4c-ccdd-4223-bae1-e5efb236e14b tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:28.036292 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b99d7f4c-ccdd-4223-bae1-e5efb236e14b tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:28.047769 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-b8b9f432-0300-4c60-84c1-0eca9f264c8e req-3e669ba6-d04e-4f0f-8703-4064ceb19b19 service nova] Creating event network-vif-plugged:c75c1874-c724-4f8e-ad23-280fad270390 for instance 39890752-2382-4631-8c4a-f3c6d47c94cb on n-h2-836830-18 Sep 14 08:59:28.056176 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-b8b9f432-0300-4c60-84c1-0eca9f264c8e req-3e669ba6-d04e-4f0f-8703-4064ceb19b19 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051048 Sep 14 08:59:28.058421 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1218/2486] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:59:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:59:28.205575 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-b99d7f4c-ccdd-4223-bae1-e5efb236e14b tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:28.214517 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-b99d7f4c-ccdd-4223-bae1-e5efb236e14b tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/82774725-1b08-411d-b760-4ed6aa3cec68" status: 200 len: 1315 microversion: 2.1 time: 0.205949 Sep 14 08:59:28.231282 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1269/2487] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:28 2022] GET /compute/v2.1/servers/82774725-1b08-411d-b760-4ed6aa3cec68 => generated 1315 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:59:28.662395 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-64951e83-eb1d-4edb-9d6f-9970174cfdb2 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:28.663816 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-64951e83-eb1d-4edb-9d6f-9970174cfdb2 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 39890752-2382-4631-8c4a-f3c6d47c94cb] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:28.681443 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-64951e83-eb1d-4edb-9d6f-9970174cfdb2 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:28.682099 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-64951e83-eb1d-4edb-9d6f-9970174cfdb2 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:28.682725 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-64951e83-eb1d-4edb-9d6f-9970174cfdb2 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:28.683660 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-64951e83-eb1d-4edb-9d6f-9970174cfdb2 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:28.684635 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-64951e83-eb1d-4edb-9d6f-9970174cfdb2 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:28.685240 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-64951e83-eb1d-4edb-9d6f-9970174cfdb2 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:28.725530 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=100 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:59:28.927481 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-64951e83-eb1d-4edb-9d6f-9970174cfdb2 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:28.945613 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-64951e83-eb1d-4edb-9d6f-9970174cfdb2 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/39890752-2382-4631-8c4a-f3c6d47c94cb" status: 200 len: 1309 microversion: 2.1 time: 0.288692 Sep 14 08:59:28.948284 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1219/2488] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:28 2022] GET /compute/v2.1/servers/39890752-2382-4631-8c4a-f3c6d47c94cb => generated 1309 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:59:29.011721 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c9321b0e-a85e-4c67-81bb-735414f5bd37 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:29.012550 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-c9321b0e-a85e-4c67-81bb-735414f5bd37 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] [instance: 2da88a50-c283-4c91-b3e1-bd4f5eb9e319] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:29.032384 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c9321b0e-a85e-4c67-81bb-735414f5bd37 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:29.034414 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ebd2998e-97fd-47e2-b4ef-0e57c2bbaad7 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:29.035373 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c9321b0e-a85e-4c67-81bb-735414f5bd37 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:29.036070 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-ebd2998e-97fd-47e2-b4ef-0e57c2bbaad7 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: d0c5547a-1340-4d19-a0f9-3e1eb9fd1932] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:29.036219 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c9321b0e-a85e-4c67-81bb-735414f5bd37 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:29.037315 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c9321b0e-a85e-4c67-81bb-735414f5bd37 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:29.037952 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c9321b0e-a85e-4c67-81bb-735414f5bd37 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:29.039517 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c9321b0e-a85e-4c67-81bb-735414f5bd37 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:29.062049 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ebd2998e-97fd-47e2-b4ef-0e57c2bbaad7 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:29.062558 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ebd2998e-97fd-47e2-b4ef-0e57c2bbaad7 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:29.064844 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ebd2998e-97fd-47e2-b4ef-0e57c2bbaad7 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:29.065633 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ebd2998e-97fd-47e2-b4ef-0e57c2bbaad7 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:29.068997 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ebd2998e-97fd-47e2-b4ef-0e57c2bbaad7 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:29.070459 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ebd2998e-97fd-47e2-b4ef-0e57c2bbaad7 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:29.366034 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-c9321b0e-a85e-4c67-81bb-735414f5bd37 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db65c0cfa83f48468d4a1bcef0caff73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9df06ceaa154f3c80665cc6a27b3598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:29.379781 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-ebd2998e-97fd-47e2-b4ef-0e57c2bbaad7 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9d40e54481461cba53fedb9a6abdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed2295a58f8451993a57ce0a6f9ba29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:29.380713 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-c9321b0e-a85e-4c67-81bb-735414f5bd37 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] 10.222.0.60 "GET /compute/v2.1/servers/2da88a50-c283-4c91-b3e1-bd4f5eb9e319" status: 200 len: 1324 microversion: 2.1 time: 0.374538 Sep 14 08:59:29.381556 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1270/2489] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:29 2022] GET /compute/v2.1/servers/2da88a50-c283-4c91-b3e1-bd4f5eb9e319 => generated 1324 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:59:29.391713 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-9b3d9c99-9bbb-4653-b0c2-4fbc61c9b205 req-a2fa72ea-9e92-4aec-8163-fcece4771413 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82774725-1b08-411d-b760-4ed6aa3cec68", "tag": "9bd6c035-8037-408f-9279-b825baab8c1f"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:59:29.392381 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-ebd2998e-97fd-47e2-b4ef-0e57c2bbaad7 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] 10.222.0.60 "GET /compute/v2.1/servers/d0c5547a-1340-4d19-a0f9-3e1eb9fd1932" status: 200 len: 1513 microversion: 2.1 time: 0.364907 Sep 14 08:59:29.394478 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1220/2490] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:29 2022] GET /compute/v2.1/servers/d0c5547a-1340-4d19-a0f9-3e1eb9fd1932 => generated 1513 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:59:29.411972 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e7d23338-4f94-489c-b802-b324401d176e tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:29.412596 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e7d23338-4f94-489c-b802-b324401d176e tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: 82774725-1b08-411d-b760-4ed6aa3cec68] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:29.415063 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=7,nova_api:UPDATE=2 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:59:29.423184 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-9b3d9c99-9bbb-4653-b0c2-4fbc61c9b205 req-a2fa72ea-9e92-4aec-8163-fcece4771413 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:29.423959 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-9b3d9c99-9bbb-4653-b0c2-4fbc61c9b205 req-a2fa72ea-9e92-4aec-8163-fcece4771413 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:29.424583 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e7d23338-4f94-489c-b802-b324401d176e tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:29.424776 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-9b3d9c99-9bbb-4653-b0c2-4fbc61c9b205 req-a2fa72ea-9e92-4aec-8163-fcece4771413 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:29.425085 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e7d23338-4f94-489c-b802-b324401d176e tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:29.426251 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e7d23338-4f94-489c-b802-b324401d176e tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:29.427322 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e7d23338-4f94-489c-b802-b324401d176e tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:29.428132 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e7d23338-4f94-489c-b802-b324401d176e tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:29.428765 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e7d23338-4f94-489c-b802-b324401d176e tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:29.445725 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-9b3d9c99-9bbb-4653-b0c2-4fbc61c9b205 req-a2fa72ea-9e92-4aec-8163-fcece4771413 service nova] Creating event network-changed:9bd6c035-8037-408f-9279-b825baab8c1f for instance 82774725-1b08-411d-b760-4ed6aa3cec68 on n-h1-836830-18 Sep 14 08:59:29.462012 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-9b3d9c99-9bbb-4653-b0c2-4fbc61c9b205 req-a2fa72ea-9e92-4aec-8163-fcece4771413 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078692 Sep 14 08:59:29.463167 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1271/2491] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:59:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:59:29.685935 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-e7d23338-4f94-489c-b802-b324401d176e tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:29.695920 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e7d23338-4f94-489c-b802-b324401d176e tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/82774725-1b08-411d-b760-4ed6aa3cec68" status: 200 len: 1315 microversion: 2.1 time: 0.299813 Sep 14 08:59:29.697287 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1221/2492] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:29 2022] GET /compute/v2.1/servers/82774725-1b08-411d-b760-4ed6aa3cec68 => generated 1315 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:59:29.972513 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d9396eb1-71bd-49c3-9469-45dad75ad9ac tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:29.973342 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-d9396eb1-71bd-49c3-9469-45dad75ad9ac tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 39890752-2382-4631-8c4a-f3c6d47c94cb] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:29.979661 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d9396eb1-71bd-49c3-9469-45dad75ad9ac tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:29.985987 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d9396eb1-71bd-49c3-9469-45dad75ad9ac tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:29.986494 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d9396eb1-71bd-49c3-9469-45dad75ad9ac tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:29.987257 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d9396eb1-71bd-49c3-9469-45dad75ad9ac tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:29.987719 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d9396eb1-71bd-49c3-9469-45dad75ad9ac tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:29.988351 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d9396eb1-71bd-49c3-9469-45dad75ad9ac tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:30.073864 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-98688605-beb4-4def-b2c4-e688b1b5e202 req-90f1a571-a777-40e4-a2af-c55ddc153062 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2da88a50-c283-4c91-b3e1-bd4f5eb9e319", "name": "network-vif-plugged", "status": "completed", "tag": "0e0d5077-876f-4296-b015-ba13bb73c465"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:59:30.084170 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-98688605-beb4-4def-b2c4-e688b1b5e202 req-90f1a571-a777-40e4-a2af-c55ddc153062 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:30.084653 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-98688605-beb4-4def-b2c4-e688b1b5e202 req-90f1a571-a777-40e4-a2af-c55ddc153062 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:30.085081 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-98688605-beb4-4def-b2c4-e688b1b5e202 req-90f1a571-a777-40e4-a2af-c55ddc153062 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:30.097590 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-98688605-beb4-4def-b2c4-e688b1b5e202 req-90f1a571-a777-40e4-a2af-c55ddc153062 service nova] Creating event network-vif-plugged:0e0d5077-876f-4296-b015-ba13bb73c465 for instance 2da88a50-c283-4c91-b3e1-bd4f5eb9e319 on n-h2-836830-18 Sep 14 08:59:30.102475 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-98688605-beb4-4def-b2c4-e688b1b5e202 req-90f1a571-a777-40e4-a2af-c55ddc153062 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032283 Sep 14 08:59:30.103119 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1222/2493] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:59:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 08:59:30.144208 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-d9396eb1-71bd-49c3-9469-45dad75ad9ac tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:30.155039 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-d9396eb1-71bd-49c3-9469-45dad75ad9ac tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/39890752-2382-4631-8c4a-f3c6d47c94cb" status: 200 len: 1489 microversion: 2.1 time: 0.186646 Sep 14 08:59:30.155651 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1272/2494] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:29 2022] GET /compute/v2.1/servers/39890752-2382-4631-8c4a-f3c6d47c94cb => generated 1489 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:59:30.179031 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e3a885f9-d621-4181-8ff7-5079101f6e0d tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1326847856"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:59:30.181923 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e3a885f9-d621-4181-8ff7-5079101f6e0d tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 39890752-2382-4631-8c4a-f3c6d47c94cb] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:30.188502 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e3a885f9-d621-4181-8ff7-5079101f6e0d tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:30.189207 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e3a885f9-d621-4181-8ff7-5079101f6e0d tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:30.189797 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e3a885f9-d621-4181-8ff7-5079101f6e0d tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:30.190643 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e3a885f9-d621-4181-8ff7-5079101f6e0d tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:30.191306 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e3a885f9-d621-4181-8ff7-5079101f6e0d tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:30.191878 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e3a885f9-d621-4181-8ff7-5079101f6e0d tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:30.277280 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e3a885f9-d621-4181-8ff7-5079101f6e0d tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "PUT /compute/v2.1/servers/39890752-2382-4631-8c4a-f3c6d47c94cb" status: 200 len: 1074 microversion: 2.1 time: 0.101907 Sep 14 08:59:30.282981 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1223/2495] 10.222.0.60 () {60 vars in 1256 bytes} [Wed Sep 14 08:59:30 2022] PUT /compute/v2.1/servers/39890752-2382-4631-8c4a-f3c6d47c94cb => generated 1074 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:59:30.298571 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-aea102aa-e514-4905-8e7b-bda11823ed11 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:30.299995 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-aea102aa-e514-4905-8e7b-bda11823ed11 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 39890752-2382-4631-8c4a-f3c6d47c94cb] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:30.307387 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-aea102aa-e514-4905-8e7b-bda11823ed11 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:30.307881 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-aea102aa-e514-4905-8e7b-bda11823ed11 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:30.308320 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-aea102aa-e514-4905-8e7b-bda11823ed11 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:30.309473 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-aea102aa-e514-4905-8e7b-bda11823ed11 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:30.309977 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-aea102aa-e514-4905-8e7b-bda11823ed11 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:30.310540 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-aea102aa-e514-4905-8e7b-bda11823ed11 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:30.409349 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-91d389b7-2126-4b60-8013-d016cb2db5ea tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:30.410304 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-91d389b7-2126-4b60-8013-d016cb2db5ea tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] [instance: 2da88a50-c283-4c91-b3e1-bd4f5eb9e319] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:30.419392 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-91d389b7-2126-4b60-8013-d016cb2db5ea tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:30.419977 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-91d389b7-2126-4b60-8013-d016cb2db5ea tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:30.420497 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-91d389b7-2126-4b60-8013-d016cb2db5ea tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:30.421493 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-91d389b7-2126-4b60-8013-d016cb2db5ea tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:30.422154 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-91d389b7-2126-4b60-8013-d016cb2db5ea tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:30.422736 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-91d389b7-2126-4b60-8013-d016cb2db5ea tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:30.492723 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-aea102aa-e514-4905-8e7b-bda11823ed11 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:30.505725 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-aea102aa-e514-4905-8e7b-bda11823ed11 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/39890752-2382-4631-8c4a-f3c6d47c94cb" status: 200 len: 1500 microversion: 2.1 time: 0.212275 Sep 14 08:59:30.506980 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1273/2496] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:30 2022] GET /compute/v2.1/servers/39890752-2382-4631-8c4a-f3c6d47c94cb => generated 1500 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:59:30.524588 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-9a4ce1b8-79b9-480f-ae07-7bd7cc33a7e3 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:30.525481 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-9a4ce1b8-79b9-480f-ae07-7bd7cc33a7e3 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: d0c5547a-1340-4d19-a0f9-3e1eb9fd1932] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:30.537764 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9a4ce1b8-79b9-480f-ae07-7bd7cc33a7e3 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:30.538711 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9a4ce1b8-79b9-480f-ae07-7bd7cc33a7e3 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:30.539788 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9a4ce1b8-79b9-480f-ae07-7bd7cc33a7e3 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:30.541051 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9a4ce1b8-79b9-480f-ae07-7bd7cc33a7e3 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:30.541511 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9a4ce1b8-79b9-480f-ae07-7bd7cc33a7e3 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:30.542135 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9a4ce1b8-79b9-480f-ae07-7bd7cc33a7e3 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:30.689383 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-91d389b7-2126-4b60-8013-d016cb2db5ea tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db65c0cfa83f48468d4a1bcef0caff73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9df06ceaa154f3c80665cc6a27b3598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:30.699396 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-91d389b7-2126-4b60-8013-d016cb2db5ea tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] 10.222.0.60 "GET /compute/v2.1/servers/2da88a50-c283-4c91-b3e1-bd4f5eb9e319" status: 200 len: 1324 microversion: 2.1 time: 0.294636 Sep 14 08:59:30.716085 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1224/2497] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:30 2022] GET /compute/v2.1/servers/2da88a50-c283-4c91-b3e1-bd4f5eb9e319 => generated 1324 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:59:30.721182 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-642deee7-7cfa-4d65-b591-e25a2bf70055 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:30.722053 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-642deee7-7cfa-4d65-b591-e25a2bf70055 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 39890752-2382-4631-8c4a-f3c6d47c94cb] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:30.733510 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-642deee7-7cfa-4d65-b591-e25a2bf70055 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:30.734046 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-642deee7-7cfa-4d65-b591-e25a2bf70055 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:30.734585 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-642deee7-7cfa-4d65-b591-e25a2bf70055 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:30.735801 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-642deee7-7cfa-4d65-b591-e25a2bf70055 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:30.736589 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-642deee7-7cfa-4d65-b591-e25a2bf70055 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:30.737238 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-642deee7-7cfa-4d65-b591-e25a2bf70055 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:30.757314 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-9a4ce1b8-79b9-480f-ae07-7bd7cc33a7e3 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9d40e54481461cba53fedb9a6abdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed2295a58f8451993a57ce0a6f9ba29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:30.766441 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-9a4ce1b8-79b9-480f-ae07-7bd7cc33a7e3 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] 10.222.0.60 "GET /compute/v2.1/servers/d0c5547a-1340-4d19-a0f9-3e1eb9fd1932" status: 200 len: 1513 microversion: 2.1 time: 0.258007 Sep 14 08:59:30.767084 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1274/2498] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:30 2022] GET /compute/v2.1/servers/d0c5547a-1340-4d19-a0f9-3e1eb9fd1932 => generated 1513 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:59:30.772967 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-2b32b369-4448-4437-b9b0-50f02c2107bf tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:30.774150 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-2b32b369-4448-4437-b9b0-50f02c2107bf tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: 82774725-1b08-411d-b760-4ed6aa3cec68] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:30.785671 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2b32b369-4448-4437-b9b0-50f02c2107bf tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:30.786371 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2b32b369-4448-4437-b9b0-50f02c2107bf tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:30.786825 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2b32b369-4448-4437-b9b0-50f02c2107bf tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:30.787626 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2b32b369-4448-4437-b9b0-50f02c2107bf tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:30.788136 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2b32b369-4448-4437-b9b0-50f02c2107bf tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:30.788738 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2b32b369-4448-4437-b9b0-50f02c2107bf tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:30.988484 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-642deee7-7cfa-4d65-b591-e25a2bf70055 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:30.998785 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-2b32b369-4448-4437-b9b0-50f02c2107bf tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:31.007276 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-2b32b369-4448-4437-b9b0-50f02c2107bf tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/82774725-1b08-411d-b760-4ed6aa3cec68" status: 200 len: 1315 microversion: 2.1 time: 0.238693 Sep 14 08:59:31.007761 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1275/2499] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:30 2022] GET /compute/v2.1/servers/82774725-1b08-411d-b760-4ed6aa3cec68 => generated 1315 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:59:31.014477 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-642deee7-7cfa-4d65-b591-e25a2bf70055 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/39890752-2382-4631-8c4a-f3c6d47c94cb" status: 200 len: 1500 microversion: 2.1 time: 0.297007 Sep 14 08:59:31.015842 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1225/2500] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:30 2022] GET /compute/v2.1/servers/39890752-2382-4631-8c4a-f3c6d47c94cb => generated 1500 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:59:31.040849 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-9892e11f-0a10-4e48-9dcb-6c1c5f6c65ba tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:59:31.049436 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9892e11f-0a10-4e48-9dcb-6c1c5f6c65ba tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:31.049924 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9892e11f-0a10-4e48-9dcb-6c1c5f6c65ba tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:31.050353 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9892e11f-0a10-4e48-9dcb-6c1c5f6c65ba tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:31.116212 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-9892e11f-0a10-4e48-9dcb-6c1c5f6c65ba tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 39890752-2382-4631-8c4a-f3c6d47c94cb] Going to try to stop instance {{(pid=128758) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 14 08:59:31.161022 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-9892e11f-0a10-4e48-9dcb-6c1c5f6c65ba tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "POST /compute/v2.1/servers/39890752-2382-4631-8c4a-f3c6d47c94cb/action" status: 202 len: 0 microversion: 2.1 time: 0.123889 Sep 14 08:59:31.163101 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1276/2501] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 08:59:31 2022] POST /compute/v2.1/servers/39890752-2382-4631-8c4a-f3c6d47c94cb/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 08:59:31.170356 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-330cb2b3-d5e4-421a-9187-cd13f49411ab tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:31.171028 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-330cb2b3-d5e4-421a-9187-cd13f49411ab tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 39890752-2382-4631-8c4a-f3c6d47c94cb] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:31.177471 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-330cb2b3-d5e4-421a-9187-cd13f49411ab tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:31.178223 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-330cb2b3-d5e4-421a-9187-cd13f49411ab tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:31.178856 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-330cb2b3-d5e4-421a-9187-cd13f49411ab tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:31.180135 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-330cb2b3-d5e4-421a-9187-cd13f49411ab tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:31.181517 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-330cb2b3-d5e4-421a-9187-cd13f49411ab tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:31.182162 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-330cb2b3-d5e4-421a-9187-cd13f49411ab tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:31.372825 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-330cb2b3-d5e4-421a-9187-cd13f49411ab tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:31.382328 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-330cb2b3-d5e4-421a-9187-cd13f49411ab tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/39890752-2382-4631-8c4a-f3c6d47c94cb" status: 200 len: 1510 microversion: 2.1 time: 0.216263 Sep 14 08:59:31.383524 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1226/2502] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:31 2022] GET /compute/v2.1/servers/39890752-2382-4631-8c4a-f3c6d47c94cb => generated 1510 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:59:31.652819 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-25ae01df-8c63-4c3e-b862-05272cf8aff8 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-1781353067", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "networks": "none"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:59:31.713907 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-25ae01df-8c63-4c3e-b862-05272cf8aff8 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Flavor limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 08:59:31.714367 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-25ae01df-8c63-4c3e-b862-05272cf8aff8 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Image limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 08:59:31.714871 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-25ae01df-8c63-4c3e-b862-05272cf8aff8 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Flavor pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 08:59:31.715326 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-25ae01df-8c63-4c3e-b862-05272cf8aff8 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Image pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 08:59:31.716707 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-25ae01df-8c63-4c3e-b862-05272cf8aff8 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 08:59:31.722957 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3c9fbd7f-a048-4e8a-86fe-4f871ecc7637 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:31.723607 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-3c9fbd7f-a048-4e8a-86fe-4f871ecc7637 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] [instance: 2da88a50-c283-4c91-b3e1-bd4f5eb9e319] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:31.726394 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-25ae01df-8c63-4c3e-b862-05272cf8aff8 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:31.726968 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-25ae01df-8c63-4c3e-b862-05272cf8aff8 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:31.727418 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-25ae01df-8c63-4c3e-b862-05272cf8aff8 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:31.728149 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-25ae01df-8c63-4c3e-b862-05272cf8aff8 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:31.728683 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-25ae01df-8c63-4c3e-b862-05272cf8aff8 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:31.729140 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-25ae01df-8c63-4c3e-b862-05272cf8aff8 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:31.730318 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3c9fbd7f-a048-4e8a-86fe-4f871ecc7637 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:31.730884 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3c9fbd7f-a048-4e8a-86fe-4f871ecc7637 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:31.731507 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3c9fbd7f-a048-4e8a-86fe-4f871ecc7637 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:31.732857 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3c9fbd7f-a048-4e8a-86fe-4f871ecc7637 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:31.733379 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3c9fbd7f-a048-4e8a-86fe-4f871ecc7637 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:31.733866 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3c9fbd7f-a048-4e8a-86fe-4f871ecc7637 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:31.742680 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=2,nova_api:UPDATE=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:59:31.752003 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-25ae01df-8c63-4c3e-b862-05272cf8aff8 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Getting quotas for project 336d168a11f24eeb861d3451e0c270cc. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 08:59:31.759341 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-25ae01df-8c63-4c3e-b862-05272cf8aff8 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Getting quotas for user fdc9edb486f8481a99778bdac0ef3d6d and project 336d168a11f24eeb861d3451e0c270cc. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 08:59:31.773836 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-25ae01df-8c63-4c3e-b862-05272cf8aff8 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Going to run 1 instances... {{(pid=128758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 08:59:31.776272 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-25ae01df-8c63-4c3e-b862-05272cf8aff8 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] [instance: 9ddb5908-22a9-41c8-909c-39cdf479bdd2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 08:59:31.822769 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-25ae01df-8c63-4c3e-b862-05272cf8aff8 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.296384 Sep 14 08:59:31.823412 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1277/2503] 10.222.0.60 () {62 vars in 1188 bytes} [Wed Sep 14 08:59:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 300 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 14 08:59:31.828422 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-85655e3a-df17-40d8-897f-fa7c37a1dfae tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:31.829035 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-85655e3a-df17-40d8-897f-fa7c37a1dfae tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: d0c5547a-1340-4d19-a0f9-3e1eb9fd1932] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:31.836031 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-85655e3a-df17-40d8-897f-fa7c37a1dfae tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:31.836520 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-85655e3a-df17-40d8-897f-fa7c37a1dfae tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:31.836954 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-85655e3a-df17-40d8-897f-fa7c37a1dfae tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:31.837647 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-85655e3a-df17-40d8-897f-fa7c37a1dfae tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:31.838099 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-85655e3a-df17-40d8-897f-fa7c37a1dfae tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:31.838519 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-85655e3a-df17-40d8-897f-fa7c37a1dfae tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:31.873258 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-3c9fbd7f-a048-4e8a-86fe-4f871ecc7637 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db65c0cfa83f48468d4a1bcef0caff73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9df06ceaa154f3c80665cc6a27b3598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:31.882789 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-3c9fbd7f-a048-4e8a-86fe-4f871ecc7637 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] 10.222.0.60 "GET /compute/v2.1/servers/2da88a50-c283-4c91-b3e1-bd4f5eb9e319" status: 200 len: 1521 microversion: 2.1 time: 0.163630 Sep 14 08:59:31.883529 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1227/2504] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:31 2022] GET /compute/v2.1/servers/2da88a50-c283-4c91-b3e1-bd4f5eb9e319 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:59:31.888974 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-7ea3fea5-34c0-4b22-90cb-a8f5c5a0d608 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:59:31.892062 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-7ea3fea5-34c0-4b22-90cb-a8f5c5a0d608 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] [instance: 9ddb5908-22a9-41c8-909c-39cdf479bdd2] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:31.999308 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-7ea3fea5-34c0-4b22-90cb-a8f5c5a0d608 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc9edb486f8481a99778bdac0ef3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d168a11f24eeb861d3451e0c270cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:32.009417 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-7ea3fea5-34c0-4b22-90cb-a8f5c5a0d608 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fdc9edb486f8481a99778bdac0ef3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d168a11f24eeb861d3451e0c270cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:32.011190 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-7ea3fea5-34c0-4b22-90cb-a8f5c5a0d608 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fdc9edb486f8481a99778bdac0ef3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d168a11f24eeb861d3451e0c270cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:32.016777 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-85655e3a-df17-40d8-897f-fa7c37a1dfae tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9d40e54481461cba53fedb9a6abdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed2295a58f8451993a57ce0a6f9ba29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:32.018708 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-7ea3fea5-34c0-4b22-90cb-a8f5c5a0d608 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] 10.222.0.60 "PUT /compute/v2.1/servers/9ddb5908-22a9-41c8-909c-39cdf479bdd2" status: 200 len: 1359 microversion: 2.75 time: 0.133745 Sep 14 08:59:32.031154 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1228/2505] 10.222.0.60 () {62 vars in 1297 bytes} [Wed Sep 14 08:59:31 2022] PUT /compute/v2.1/servers/9ddb5908-22a9-41c8-909c-39cdf479bdd2 => generated 1359 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:59:32.031261 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-85655e3a-df17-40d8-897f-fa7c37a1dfae tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] 10.222.0.60 "GET /compute/v2.1/servers/d0c5547a-1340-4d19-a0f9-3e1eb9fd1932" status: 200 len: 1513 microversion: 2.1 time: 0.201707 Sep 14 08:59:32.031261 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1278/2506] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:31 2022] GET /compute/v2.1/servers/d0c5547a-1340-4d19-a0f9-3e1eb9fd1932 => generated 1513 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:59:32.038714 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-fc3c73dd-c3b1-470e-a89d-e49208732c5b tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:32.038714 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-fc3c73dd-c3b1-470e-a89d-e49208732c5b tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: 82774725-1b08-411d-b760-4ed6aa3cec68] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:32.046786 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fc3c73dd-c3b1-470e-a89d-e49208732c5b tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:32.047467 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-2c2bff98-39ba-4686-9e89-ec84f4f65a2c tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Action: 'create', calling method: .version_select at 0x7f7d487fff70>, body: {"pool": null} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:59:32.047723 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fc3c73dd-c3b1-470e-a89d-e49208732c5b tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:32.047975 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fc3c73dd-c3b1-470e-a89d-e49208732c5b tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:32.049007 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fc3c73dd-c3b1-470e-a89d-e49208732c5b tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:32.049613 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fc3c73dd-c3b1-470e-a89d-e49208732c5b tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:32.050195 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fc3c73dd-c3b1-470e-a89d-e49208732c5b tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:32.447067 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-fc3c73dd-c3b1-470e-a89d-e49208732c5b tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:32.449176 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:59:32.457314 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-fc3c73dd-c3b1-470e-a89d-e49208732c5b tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/82774725-1b08-411d-b760-4ed6aa3cec68" status: 200 len: 1315 microversion: 2.1 time: 0.425481 Sep 14 08:59:32.457944 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1279/2507] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:32 2022] GET /compute/v2.1/servers/82774725-1b08-411d-b760-4ed6aa3cec68 => generated 1315 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:59:32.475923 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-8289888c-23c9-4d30-bf9b-412325115180 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:32.476852 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-8289888c-23c9-4d30-bf9b-412325115180 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] [instance: 9ddb5908-22a9-41c8-909c-39cdf479bdd2] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:32.485350 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8289888c-23c9-4d30-bf9b-412325115180 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:32.485831 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8289888c-23c9-4d30-bf9b-412325115180 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:32.486317 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8289888c-23c9-4d30-bf9b-412325115180 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:32.487319 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8289888c-23c9-4d30-bf9b-412325115180 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:32.487775 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8289888c-23c9-4d30-bf9b-412325115180 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:32.488250 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8289888c-23c9-4d30-bf9b-412325115180 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:32.640230 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-8289888c-23c9-4d30-bf9b-412325115180 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc9edb486f8481a99778bdac0ef3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d168a11f24eeb861d3451e0c270cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:32.652529 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-8289888c-23c9-4d30-bf9b-412325115180 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fdc9edb486f8481a99778bdac0ef3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d168a11f24eeb861d3451e0c270cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:32.654926 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-8289888c-23c9-4d30-bf9b-412325115180 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fdc9edb486f8481a99778bdac0ef3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d168a11f24eeb861d3451e0c270cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:32.662121 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-8289888c-23c9-4d30-bf9b-412325115180 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] 10.222.0.60 "GET /compute/v2.1/servers/9ddb5908-22a9-41c8-909c-39cdf479bdd2" status: 200 len: 1355 microversion: 2.75 time: 0.203137 Sep 14 08:59:32.662712 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1280/2508] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:59:32 2022] GET /compute/v2.1/servers/9ddb5908-22a9-41c8-909c-39cdf479bdd2 => generated 1355 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:59:32.667965 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-6478fec5-600a-4049-a8cf-3471978c5bf6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:32.668747 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-6478fec5-600a-4049-a8cf-3471978c5bf6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 39890752-2382-4631-8c4a-f3c6d47c94cb] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:32.675494 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6478fec5-600a-4049-a8cf-3471978c5bf6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:32.676214 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6478fec5-600a-4049-a8cf-3471978c5bf6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:32.676792 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6478fec5-600a-4049-a8cf-3471978c5bf6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:32.677776 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6478fec5-600a-4049-a8cf-3471978c5bf6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:32.678611 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6478fec5-600a-4049-a8cf-3471978c5bf6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:32.679232 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6478fec5-600a-4049-a8cf-3471978c5bf6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:32.933896 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-6478fec5-600a-4049-a8cf-3471978c5bf6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:32.942664 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-6478fec5-600a-4049-a8cf-3471978c5bf6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/39890752-2382-4631-8c4a-f3c6d47c94cb" status: 200 len: 1510 microversion: 2.1 time: 0.278767 Sep 14 08:59:32.943484 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1281/2509] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:32 2022] GET /compute/v2.1/servers/39890752-2382-4631-8c4a-f3c6d47c94cb => generated 1510 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:59:33.058003 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-f16c890c-65c8-486e-bb7e-802d48bbce67 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:33.058796 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-f16c890c-65c8-486e-bb7e-802d48bbce67 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: d0c5547a-1340-4d19-a0f9-3e1eb9fd1932] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:33.067786 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f16c890c-65c8-486e-bb7e-802d48bbce67 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:33.068586 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f16c890c-65c8-486e-bb7e-802d48bbce67 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:33.069197 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f16c890c-65c8-486e-bb7e-802d48bbce67 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:33.069924 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f16c890c-65c8-486e-bb7e-802d48bbce67 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:33.070382 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f16c890c-65c8-486e-bb7e-802d48bbce67 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:33.070991 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f16c890c-65c8-486e-bb7e-802d48bbce67 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:33.329585 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-f16c890c-65c8-486e-bb7e-802d48bbce67 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9d40e54481461cba53fedb9a6abdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed2295a58f8451993a57ce0a6f9ba29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:33.337906 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-f16c890c-65c8-486e-bb7e-802d48bbce67 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] 10.222.0.60 "GET /compute/v2.1/servers/d0c5547a-1340-4d19-a0f9-3e1eb9fd1932" status: 200 len: 1513 microversion: 2.1 time: 0.285312 Sep 14 08:59:33.338564 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1282/2510] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:33 2022] GET /compute/v2.1/servers/d0c5547a-1340-4d19-a0f9-3e1eb9fd1932 => generated 1513 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:59:33.482303 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-02e8fb7f-0782-425f-b05e-e915af2bb914 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:33.482968 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-02e8fb7f-0782-425f-b05e-e915af2bb914 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: 82774725-1b08-411d-b760-4ed6aa3cec68] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:33.488839 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-02e8fb7f-0782-425f-b05e-e915af2bb914 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:33.489377 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-02e8fb7f-0782-425f-b05e-e915af2bb914 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:33.489793 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-02e8fb7f-0782-425f-b05e-e915af2bb914 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:33.490481 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-02e8fb7f-0782-425f-b05e-e915af2bb914 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:33.490951 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-02e8fb7f-0782-425f-b05e-e915af2bb914 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:33.491376 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-02e8fb7f-0782-425f-b05e-e915af2bb914 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:33.767500 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-02e8fb7f-0782-425f-b05e-e915af2bb914 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:33.776603 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-02e8fb7f-0782-425f-b05e-e915af2bb914 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/82774725-1b08-411d-b760-4ed6aa3cec68" status: 200 len: 1315 microversion: 2.1 time: 0.298784 Sep 14 08:59:33.777191 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1283/2511] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:33 2022] GET /compute/v2.1/servers/82774725-1b08-411d-b760-4ed6aa3cec68 => generated 1315 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:59:33.782201 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d738c9a9-17e8-44ad-b213-cc0948aa2caf tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:33.783073 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-d738c9a9-17e8-44ad-b213-cc0948aa2caf tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] [instance: 9ddb5908-22a9-41c8-909c-39cdf479bdd2] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:33.789506 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d738c9a9-17e8-44ad-b213-cc0948aa2caf tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:33.790188 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d738c9a9-17e8-44ad-b213-cc0948aa2caf tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:33.790779 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d738c9a9-17e8-44ad-b213-cc0948aa2caf tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:33.791674 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d738c9a9-17e8-44ad-b213-cc0948aa2caf tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:33.792129 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d738c9a9-17e8-44ad-b213-cc0948aa2caf tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:33.792555 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d738c9a9-17e8-44ad-b213-cc0948aa2caf tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:33.824976 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-2c2bff98-39ba-4686-9e89-ec84f4f65a2c tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] 10.222.0.60 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 1.800998 Sep 14 08:59:33.826421 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1229/2512] 10.222.0.60 () {60 vars in 1170 bytes} [Wed Sep 14 08:59:32 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 1803 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:59:33.878201 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-d738c9a9-17e8-44ad-b213-cc0948aa2caf tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc9edb486f8481a99778bdac0ef3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d168a11f24eeb861d3451e0c270cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:33.886983 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-d738c9a9-17e8-44ad-b213-cc0948aa2caf tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fdc9edb486f8481a99778bdac0ef3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d168a11f24eeb861d3451e0c270cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:33.889403 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-d738c9a9-17e8-44ad-b213-cc0948aa2caf tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fdc9edb486f8481a99778bdac0ef3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d168a11f24eeb861d3451e0c270cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:33.895139 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-d738c9a9-17e8-44ad-b213-cc0948aa2caf tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] 10.222.0.60 "GET /compute/v2.1/servers/9ddb5908-22a9-41c8-909c-39cdf479bdd2" status: 200 len: 1417 microversion: 2.75 time: 0.116173 Sep 14 08:59:33.896318 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1284/2513] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:59:33 2022] GET /compute/v2.1/servers/9ddb5908-22a9-41c8-909c-39cdf479bdd2 => generated 1417 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:59:33.939817 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b9320859-7f69-4724-9a7d-c871397ca39e tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1630195812", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "networks": [{"uuid": "bb99f4a1-78ca-499c-bb3f-fa3732e743f4"}]}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:59:33.965637 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-178f8ac7-d862-4438-869f-2f0a99bf6fa4 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:33.966302 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-178f8ac7-d862-4438-869f-2f0a99bf6fa4 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 39890752-2382-4631-8c4a-f3c6d47c94cb] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:33.972353 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-178f8ac7-d862-4438-869f-2f0a99bf6fa4 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:33.972886 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-178f8ac7-d862-4438-869f-2f0a99bf6fa4 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:33.973421 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-178f8ac7-d862-4438-869f-2f0a99bf6fa4 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:33.974117 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-178f8ac7-d862-4438-869f-2f0a99bf6fa4 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:33.974572 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-178f8ac7-d862-4438-869f-2f0a99bf6fa4 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:33.975017 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-178f8ac7-d862-4438-869f-2f0a99bf6fa4 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:33.993734 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.network.neutron [None req-b9320859-7f69-4724-9a7d-c871397ca39e tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] validate_networks() for [('bb99f4a1-78ca-499c-bb3f-fa3732e743f4', None, None, None, None, None)] {{(pid=128759) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 08:59:34.194092 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-178f8ac7-d862-4438-869f-2f0a99bf6fa4 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:34.202503 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-178f8ac7-d862-4438-869f-2f0a99bf6fa4 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/39890752-2382-4631-8c4a-f3c6d47c94cb" status: 200 len: 1510 microversion: 2.1 time: 0.240593 Sep 14 08:59:34.203139 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1285/2514] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:33 2022] GET /compute/v2.1/servers/39890752-2382-4631-8c4a-f3c6d47c94cb => generated 1510 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:59:34.362848 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-41505584-8a59-47c8-8c17-d9f7323b01da tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:34.363506 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-41505584-8a59-47c8-8c17-d9f7323b01da tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: d0c5547a-1340-4d19-a0f9-3e1eb9fd1932] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:34.375058 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-41505584-8a59-47c8-8c17-d9f7323b01da tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:34.375653 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-41505584-8a59-47c8-8c17-d9f7323b01da tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:34.376163 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-41505584-8a59-47c8-8c17-d9f7323b01da tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:34.376989 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-41505584-8a59-47c8-8c17-d9f7323b01da tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:34.377519 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-41505584-8a59-47c8-8c17-d9f7323b01da tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:34.378049 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-41505584-8a59-47c8-8c17-d9f7323b01da tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:34.605554 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-41505584-8a59-47c8-8c17-d9f7323b01da tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9d40e54481461cba53fedb9a6abdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed2295a58f8451993a57ce0a6f9ba29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:34.614050 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-41505584-8a59-47c8-8c17-d9f7323b01da tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] 10.222.0.60 "GET /compute/v2.1/servers/d0c5547a-1340-4d19-a0f9-3e1eb9fd1932" status: 200 len: 1513 microversion: 2.1 time: 0.255270 Sep 14 08:59:34.614745 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1286/2515] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:34 2022] GET /compute/v2.1/servers/d0c5547a-1340-4d19-a0f9-3e1eb9fd1932 => generated 1513 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:59:34.648368 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-b9320859-7f69-4724-9a7d-c871397ca39e tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Flavor limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 08:59:34.648803 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-b9320859-7f69-4724-9a7d-c871397ca39e tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Image limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 08:59:34.649283 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-b9320859-7f69-4724-9a7d-c871397ca39e tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Flavor pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 08:59:34.649697 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-b9320859-7f69-4724-9a7d-c871397ca39e tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Image pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 08:59:34.650114 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-b9320859-7f69-4724-9a7d-c871397ca39e tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 08:59:34.659499 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b9320859-7f69-4724-9a7d-c871397ca39e tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:34.659981 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b9320859-7f69-4724-9a7d-c871397ca39e tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:34.660418 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b9320859-7f69-4724-9a7d-c871397ca39e tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:34.661147 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b9320859-7f69-4724-9a7d-c871397ca39e tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:34.661632 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b9320859-7f69-4724-9a7d-c871397ca39e tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:34.662062 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b9320859-7f69-4724-9a7d-c871397ca39e tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:34.680351 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-b9320859-7f69-4724-9a7d-c871397ca39e tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Getting quotas for project d9df06ceaa154f3c80665cc6a27b3598. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 08:59:34.685893 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-b9320859-7f69-4724-9a7d-c871397ca39e tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Getting quotas for user db65c0cfa83f48468d4a1bcef0caff73 and project d9df06ceaa154f3c80665cc6a27b3598. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 08:59:34.698162 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b9320859-7f69-4724-9a7d-c871397ca39e tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Going to run 1 instances... {{(pid=128759) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 08:59:34.700505 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b9320859-7f69-4724-9a7d-c871397ca39e tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] [instance: eeed9e16-bc5c-4fb1-b4b9-9c9305c8da73] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128759) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 08:59:34.746133 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b9320859-7f69-4724-9a7d-c871397ca39e tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.811262 Sep 14 08:59:34.746974 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1230/2516] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 08:59:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 813 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 08:59:34.758148 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-9794bc7d-3982-4848-9110-038a77020883 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:34.758783 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-9794bc7d-3982-4848-9110-038a77020883 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] [instance: eeed9e16-bc5c-4fb1-b4b9-9c9305c8da73] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:34.800595 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-4800cc70-ab2d-4a42-b579-011cf2ba1239 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:34.801227 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-4800cc70-ab2d-4a42-b579-011cf2ba1239 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: 82774725-1b08-411d-b760-4ed6aa3cec68] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:34.807351 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4800cc70-ab2d-4a42-b579-011cf2ba1239 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:34.808141 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4800cc70-ab2d-4a42-b579-011cf2ba1239 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:34.809388 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4800cc70-ab2d-4a42-b579-011cf2ba1239 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:34.810277 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4800cc70-ab2d-4a42-b579-011cf2ba1239 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:34.811106 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4800cc70-ab2d-4a42-b579-011cf2ba1239 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:34.812538 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4800cc70-ab2d-4a42-b579-011cf2ba1239 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:34.813958 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-9794bc7d-3982-4848-9110-038a77020883 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db65c0cfa83f48468d4a1bcef0caff73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9df06ceaa154f3c80665cc6a27b3598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:34.816368 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=49 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:59:34.823297 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-9794bc7d-3982-4848-9110-038a77020883 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] 10.222.0.60 "GET /compute/v2.1/servers/eeed9e16-bc5c-4fb1-b4b9-9c9305c8da73" status: 200 len: 1224 microversion: 2.1 time: 0.069124 Sep 14 08:59:34.824087 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1287/2517] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:34 2022] GET /compute/v2.1/servers/eeed9e16-bc5c-4fb1-b4b9-9c9305c8da73 => generated 1224 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:59:34.924868 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-383ac3ed-4457-483b-b368-c2d8740da47f tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:34.925488 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-383ac3ed-4457-483b-b368-c2d8740da47f tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] [instance: 9ddb5908-22a9-41c8-909c-39cdf479bdd2] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:34.945313 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-383ac3ed-4457-483b-b368-c2d8740da47f tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:34.945892 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-383ac3ed-4457-483b-b368-c2d8740da47f tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:34.946302 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-383ac3ed-4457-483b-b368-c2d8740da47f tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:34.946989 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-383ac3ed-4457-483b-b368-c2d8740da47f tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:34.947451 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-383ac3ed-4457-483b-b368-c2d8740da47f tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:34.948163 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-383ac3ed-4457-483b-b368-c2d8740da47f tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:34.971324 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-4800cc70-ab2d-4a42-b579-011cf2ba1239 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:34.979834 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-4800cc70-ab2d-4a42-b579-011cf2ba1239 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/82774725-1b08-411d-b760-4ed6aa3cec68" status: 200 len: 1315 microversion: 2.1 time: 0.185086 Sep 14 08:59:34.980583 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1231/2518] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:34 2022] GET /compute/v2.1/servers/82774725-1b08-411d-b760-4ed6aa3cec68 => generated 1315 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:59:35.021767 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-383ac3ed-4457-483b-b368-c2d8740da47f tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc9edb486f8481a99778bdac0ef3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d168a11f24eeb861d3451e0c270cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:35.038977 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-383ac3ed-4457-483b-b368-c2d8740da47f tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fdc9edb486f8481a99778bdac0ef3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d168a11f24eeb861d3451e0c270cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:35.040466 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-383ac3ed-4457-483b-b368-c2d8740da47f tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fdc9edb486f8481a99778bdac0ef3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d168a11f24eeb861d3451e0c270cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:35.046418 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-383ac3ed-4457-483b-b368-c2d8740da47f tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] 10.222.0.60 "GET /compute/v2.1/servers/9ddb5908-22a9-41c8-909c-39cdf479bdd2" status: 200 len: 1417 microversion: 2.75 time: 0.125968 Sep 14 08:59:35.047072 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1288/2519] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:59:34 2022] GET /compute/v2.1/servers/9ddb5908-22a9-41c8-909c-39cdf479bdd2 => generated 1417 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 08:59:35.226886 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9faf138e-09e5-4576-8d0c-1af6bbe31c3a tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:35.227528 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-9faf138e-09e5-4576-8d0c-1af6bbe31c3a tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 39890752-2382-4631-8c4a-f3c6d47c94cb] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:35.233938 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9faf138e-09e5-4576-8d0c-1af6bbe31c3a tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:35.234410 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9faf138e-09e5-4576-8d0c-1af6bbe31c3a tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:35.234847 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9faf138e-09e5-4576-8d0c-1af6bbe31c3a tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:35.235880 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9faf138e-09e5-4576-8d0c-1af6bbe31c3a tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:35.236344 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9faf138e-09e5-4576-8d0c-1af6bbe31c3a tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:35.237485 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9faf138e-09e5-4576-8d0c-1af6bbe31c3a tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:35.373260 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-9faf138e-09e5-4576-8d0c-1af6bbe31c3a tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:35.381051 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-9faf138e-09e5-4576-8d0c-1af6bbe31c3a tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/39890752-2382-4631-8c4a-f3c6d47c94cb" status: 200 len: 1510 microversion: 2.1 time: 0.158716 Sep 14 08:59:35.381652 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1232/2520] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:35 2022] GET /compute/v2.1/servers/39890752-2382-4631-8c4a-f3c6d47c94cb => generated 1510 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:59:35.638305 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-55652419-4271-4292-bdbd-3965bad66dc6 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:35.639059 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-55652419-4271-4292-bdbd-3965bad66dc6 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: d0c5547a-1340-4d19-a0f9-3e1eb9fd1932] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:35.646052 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-55652419-4271-4292-bdbd-3965bad66dc6 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:35.646583 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-55652419-4271-4292-bdbd-3965bad66dc6 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:35.647083 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-55652419-4271-4292-bdbd-3965bad66dc6 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:35.647790 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-55652419-4271-4292-bdbd-3965bad66dc6 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:35.648350 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-55652419-4271-4292-bdbd-3965bad66dc6 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:35.648781 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-55652419-4271-4292-bdbd-3965bad66dc6 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:35.786125 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-55652419-4271-4292-bdbd-3965bad66dc6 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9d40e54481461cba53fedb9a6abdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed2295a58f8451993a57ce0a6f9ba29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:35.794970 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-55652419-4271-4292-bdbd-3965bad66dc6 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] 10.222.0.60 "GET /compute/v2.1/servers/d0c5547a-1340-4d19-a0f9-3e1eb9fd1932" status: 200 len: 1513 microversion: 2.1 time: 0.160579 Sep 14 08:59:35.795559 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1289/2521] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:35 2022] GET /compute/v2.1/servers/d0c5547a-1340-4d19-a0f9-3e1eb9fd1932 => generated 1513 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:59:35.847435 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-fd921b3a-d8e1-457f-8a9a-025ca045234e tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:35.848060 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-fd921b3a-d8e1-457f-8a9a-025ca045234e tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] [instance: eeed9e16-bc5c-4fb1-b4b9-9c9305c8da73] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:35.854495 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fd921b3a-d8e1-457f-8a9a-025ca045234e tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:35.855015 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fd921b3a-d8e1-457f-8a9a-025ca045234e tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:35.855462 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fd921b3a-d8e1-457f-8a9a-025ca045234e tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:35.856154 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fd921b3a-d8e1-457f-8a9a-025ca045234e tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:35.856911 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fd921b3a-d8e1-457f-8a9a-025ca045234e tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:35.857346 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fd921b3a-d8e1-457f-8a9a-025ca045234e tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:35.872010 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-5f0366cb-49f5-471b-ab98-e42e2c42b7ab req-0bf7ae6d-72ae-40f8-a5b9-96dc308e49f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82774725-1b08-411d-b760-4ed6aa3cec68", "name": "network-vif-plugged", "status": "completed", "tag": "9bd6c035-8037-408f-9279-b825baab8c1f"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:59:35.883280 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-5f0366cb-49f5-471b-ab98-e42e2c42b7ab req-0bf7ae6d-72ae-40f8-a5b9-96dc308e49f6 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:35.883875 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-5f0366cb-49f5-471b-ab98-e42e2c42b7ab req-0bf7ae6d-72ae-40f8-a5b9-96dc308e49f6 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:35.884575 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-5f0366cb-49f5-471b-ab98-e42e2c42b7ab req-0bf7ae6d-72ae-40f8-a5b9-96dc308e49f6 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:35.899455 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-5f0366cb-49f5-471b-ab98-e42e2c42b7ab req-0bf7ae6d-72ae-40f8-a5b9-96dc308e49f6 service nova] Creating event network-vif-plugged:9bd6c035-8037-408f-9279-b825baab8c1f for instance 82774725-1b08-411d-b760-4ed6aa3cec68 on n-h1-836830-18 Sep 14 08:59:35.905490 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-5f0366cb-49f5-471b-ab98-e42e2c42b7ab req-0bf7ae6d-72ae-40f8-a5b9-96dc308e49f6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037505 Sep 14 08:59:35.906318 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1290/2522] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:59:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 08:59:35.960015 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-fd921b3a-d8e1-457f-8a9a-025ca045234e tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db65c0cfa83f48468d4a1bcef0caff73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9df06ceaa154f3c80665cc6a27b3598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:35.969338 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-fd921b3a-d8e1-457f-8a9a-025ca045234e tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] 10.222.0.60 "GET /compute/v2.1/servers/eeed9e16-bc5c-4fb1-b4b9-9c9305c8da73" status: 200 len: 1276 microversion: 2.1 time: 0.125779 Sep 14 08:59:35.970772 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1233/2523] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:35 2022] GET /compute/v2.1/servers/eeed9e16-bc5c-4fb1-b4b9-9c9305c8da73 => generated 1276 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:59:36.004697 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-de074524-62dc-4e44-a219-02ca0409b0bc tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:36.005411 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-de074524-62dc-4e44-a219-02ca0409b0bc tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: 82774725-1b08-411d-b760-4ed6aa3cec68] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:36.012180 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-de074524-62dc-4e44-a219-02ca0409b0bc tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:36.012674 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-de074524-62dc-4e44-a219-02ca0409b0bc tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:36.013736 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-de074524-62dc-4e44-a219-02ca0409b0bc tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:36.014433 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-de074524-62dc-4e44-a219-02ca0409b0bc tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:36.014888 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-de074524-62dc-4e44-a219-02ca0409b0bc tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:36.015357 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-de074524-62dc-4e44-a219-02ca0409b0bc tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:36.073719 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-faee525b-baa0-4331-9b24-4106b4e35183 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:36.074350 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-faee525b-baa0-4331-9b24-4106b4e35183 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] [instance: 9ddb5908-22a9-41c8-909c-39cdf479bdd2] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:36.080528 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-faee525b-baa0-4331-9b24-4106b4e35183 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:36.081015 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-faee525b-baa0-4331-9b24-4106b4e35183 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:36.081468 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-faee525b-baa0-4331-9b24-4106b4e35183 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:36.082178 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-faee525b-baa0-4331-9b24-4106b4e35183 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:36.082640 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-faee525b-baa0-4331-9b24-4106b4e35183 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:36.083106 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-faee525b-baa0-4331-9b24-4106b4e35183 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:36.161410 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-de074524-62dc-4e44-a219-02ca0409b0bc tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:36.177133 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-de074524-62dc-4e44-a219-02ca0409b0bc tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/82774725-1b08-411d-b760-4ed6aa3cec68" status: 200 len: 1315 microversion: 2.1 time: 0.176610 Sep 14 08:59:36.187102 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1291/2524] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:35 2022] GET /compute/v2.1/servers/82774725-1b08-411d-b760-4ed6aa3cec68 => generated 1315 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:59:36.240188 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-faee525b-baa0-4331-9b24-4106b4e35183 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc9edb486f8481a99778bdac0ef3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d168a11f24eeb861d3451e0c270cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:36.250254 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-faee525b-baa0-4331-9b24-4106b4e35183 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fdc9edb486f8481a99778bdac0ef3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d168a11f24eeb861d3451e0c270cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:36.251883 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-faee525b-baa0-4331-9b24-4106b4e35183 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fdc9edb486f8481a99778bdac0ef3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d168a11f24eeb861d3451e0c270cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:36.258334 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-faee525b-baa0-4331-9b24-4106b4e35183 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] 10.222.0.60 "GET /compute/v2.1/servers/9ddb5908-22a9-41c8-909c-39cdf479bdd2" status: 200 len: 1438 microversion: 2.75 time: 0.188534 Sep 14 08:59:36.259662 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1234/2525] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:59:36 2022] GET /compute/v2.1/servers/9ddb5908-22a9-41c8-909c-39cdf479bdd2 => generated 1438 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 08:59:36.289989 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-31ed7006-a475-4446-8e31-f989a59a9ba4 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:59:36.293178 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-31ed7006-a475-4446-8e31-f989a59a9ba4 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] [instance: 9ddb5908-22a9-41c8-909c-39cdf479bdd2] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:36.299324 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-31ed7006-a475-4446-8e31-f989a59a9ba4 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:36.300029 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-31ed7006-a475-4446-8e31-f989a59a9ba4 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:36.300474 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-31ed7006-a475-4446-8e31-f989a59a9ba4 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:36.301183 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-31ed7006-a475-4446-8e31-f989a59a9ba4 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:36.301643 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-31ed7006-a475-4446-8e31-f989a59a9ba4 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:36.302088 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-31ed7006-a475-4446-8e31-f989a59a9ba4 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:36.384529 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-31ed7006-a475-4446-8e31-f989a59a9ba4 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Flavor limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 08:59:36.384967 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-31ed7006-a475-4446-8e31-f989a59a9ba4 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Image limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 08:59:36.385440 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-31ed7006-a475-4446-8e31-f989a59a9ba4 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Flavor pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 08:59:36.385850 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-31ed7006-a475-4446-8e31-f989a59a9ba4 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Image pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 08:59:36.386262 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-31ed7006-a475-4446-8e31-f989a59a9ba4 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 08:59:36.406386 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-5fd1cf7d-0155-4a52-8528-cfe67763980a tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:36.406386 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-5fd1cf7d-0155-4a52-8528-cfe67763980a tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 39890752-2382-4631-8c4a-f3c6d47c94cb] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:36.412780 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5fd1cf7d-0155-4a52-8528-cfe67763980a tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:36.413343 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5fd1cf7d-0155-4a52-8528-cfe67763980a tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:36.413848 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5fd1cf7d-0155-4a52-8528-cfe67763980a tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:36.414610 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5fd1cf7d-0155-4a52-8528-cfe67763980a tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:36.415187 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5fd1cf7d-0155-4a52-8528-cfe67763980a tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:36.415679 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5fd1cf7d-0155-4a52-8528-cfe67763980a tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:36.455533 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-31ed7006-a475-4446-8e31-f989a59a9ba4 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] [instance: 9ddb5908-22a9-41c8-909c-39cdf479bdd2] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:36.462430 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-31ed7006-a475-4446-8e31-f989a59a9ba4 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:36.463067 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-31ed7006-a475-4446-8e31-f989a59a9ba4 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:36.463508 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-31ed7006-a475-4446-8e31-f989a59a9ba4 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:36.464214 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-31ed7006-a475-4446-8e31-f989a59a9ba4 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:36.464666 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-31ed7006-a475-4446-8e31-f989a59a9ba4 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:36.465087 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-31ed7006-a475-4446-8e31-f989a59a9ba4 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:36.561759 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-31ed7006-a475-4446-8e31-f989a59a9ba4 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc9edb486f8481a99778bdac0ef3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d168a11f24eeb861d3451e0c270cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:36.575927 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-31ed7006-a475-4446-8e31-f989a59a9ba4 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fdc9edb486f8481a99778bdac0ef3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d168a11f24eeb861d3451e0c270cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:36.579190 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-31ed7006-a475-4446-8e31-f989a59a9ba4 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fdc9edb486f8481a99778bdac0ef3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d168a11f24eeb861d3451e0c270cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:36.591926 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-31ed7006-a475-4446-8e31-f989a59a9ba4 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] 10.222.0.60 "POST /compute/v2.1/servers/9ddb5908-22a9-41c8-909c-39cdf479bdd2/action" status: 202 len: 1495 microversion: 2.75 time: 0.306699 Sep 14 08:59:36.593003 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1292/2526] 10.222.0.60 () {62 vars in 1319 bytes} [Wed Sep 14 08:59:36 2022] POST /compute/v2.1/servers/9ddb5908-22a9-41c8-909c-39cdf479bdd2/action => generated 1495 bytes in 309 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Sep 14 08:59:36.612481 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-5fd1cf7d-0155-4a52-8528-cfe67763980a tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:36.619438 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-f1867440-591e-4742-9cf9-28cda89e933a tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:36.620044 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-f1867440-591e-4742-9cf9-28cda89e933a tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] [instance: 9ddb5908-22a9-41c8-909c-39cdf479bdd2] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:36.624275 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-5fd1cf7d-0155-4a52-8528-cfe67763980a tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/39890752-2382-4631-8c4a-f3c6d47c94cb" status: 200 len: 1510 microversion: 2.1 time: 0.222618 Sep 14 08:59:36.626464 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f1867440-591e-4742-9cf9-28cda89e933a tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:36.626980 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f1867440-591e-4742-9cf9-28cda89e933a tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:36.627460 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f1867440-591e-4742-9cf9-28cda89e933a tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:36.628170 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f1867440-591e-4742-9cf9-28cda89e933a tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:36.628704 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f1867440-591e-4742-9cf9-28cda89e933a tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:36.629815 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f1867440-591e-4742-9cf9-28cda89e933a tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:36.632319 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1235/2527] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:36 2022] GET /compute/v2.1/servers/39890752-2382-4631-8c4a-f3c6d47c94cb => generated 1510 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:59:36.696191 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-f1867440-591e-4742-9cf9-28cda89e933a tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc9edb486f8481a99778bdac0ef3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d168a11f24eeb861d3451e0c270cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:36.705105 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-f1867440-591e-4742-9cf9-28cda89e933a tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fdc9edb486f8481a99778bdac0ef3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d168a11f24eeb861d3451e0c270cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:36.706662 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-f1867440-591e-4742-9cf9-28cda89e933a tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fdc9edb486f8481a99778bdac0ef3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d168a11f24eeb861d3451e0c270cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:36.711661 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-f1867440-591e-4742-9cf9-28cda89e933a tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] 10.222.0.60 "GET /compute/v2.1/servers/9ddb5908-22a9-41c8-909c-39cdf479bdd2" status: 200 len: 1447 microversion: 2.75 time: 0.096109 Sep 14 08:59:36.712245 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1293/2528] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:59:36 2022] GET /compute/v2.1/servers/9ddb5908-22a9-41c8-909c-39cdf479bdd2 => generated 1447 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 08:59:36.826121 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-fb93865b-1fe3-4fbf-a726-800cfe3df7a6 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:36.826995 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-fb93865b-1fe3-4fbf-a726-800cfe3df7a6 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: d0c5547a-1340-4d19-a0f9-3e1eb9fd1932] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:36.838965 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fb93865b-1fe3-4fbf-a726-800cfe3df7a6 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:36.839630 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fb93865b-1fe3-4fbf-a726-800cfe3df7a6 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:36.840155 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fb93865b-1fe3-4fbf-a726-800cfe3df7a6 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:36.841131 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fb93865b-1fe3-4fbf-a726-800cfe3df7a6 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:36.841665 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fb93865b-1fe3-4fbf-a726-800cfe3df7a6 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:36.842185 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fb93865b-1fe3-4fbf-a726-800cfe3df7a6 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:36.994949 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-67afc663-c43c-41df-b6d4-e55a22360fea tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:37.007884 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-67afc663-c43c-41df-b6d4-e55a22360fea tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] [instance: eeed9e16-bc5c-4fb1-b4b9-9c9305c8da73] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:37.019930 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-67afc663-c43c-41df-b6d4-e55a22360fea tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:37.020344 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-67afc663-c43c-41df-b6d4-e55a22360fea tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:37.020788 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-67afc663-c43c-41df-b6d4-e55a22360fea tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:37.021504 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-67afc663-c43c-41df-b6d4-e55a22360fea tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:37.021960 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-67afc663-c43c-41df-b6d4-e55a22360fea tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:37.022676 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-67afc663-c43c-41df-b6d4-e55a22360fea tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:37.037783 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-fb93865b-1fe3-4fbf-a726-800cfe3df7a6 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9d40e54481461cba53fedb9a6abdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed2295a58f8451993a57ce0a6f9ba29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:37.052558 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-fb93865b-1fe3-4fbf-a726-800cfe3df7a6 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] 10.222.0.60 "GET /compute/v2.1/servers/d0c5547a-1340-4d19-a0f9-3e1eb9fd1932" status: 200 len: 1513 microversion: 2.1 time: 0.237454 Sep 14 08:59:37.053288 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1236/2529] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:36 2022] GET /compute/v2.1/servers/d0c5547a-1340-4d19-a0f9-3e1eb9fd1932 => generated 1513 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:59:37.199576 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-67afc663-c43c-41df-b6d4-e55a22360fea tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db65c0cfa83f48468d4a1bcef0caff73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9df06ceaa154f3c80665cc6a27b3598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:37.203126 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-fed0eba7-3221-41c8-ad76-dd1c4553d383 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:37.204305 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-fed0eba7-3221-41c8-ad76-dd1c4553d383 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: 82774725-1b08-411d-b760-4ed6aa3cec68] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:37.209069 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-67afc663-c43c-41df-b6d4-e55a22360fea tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] 10.222.0.60 "GET /compute/v2.1/servers/eeed9e16-bc5c-4fb1-b4b9-9c9305c8da73" status: 200 len: 1324 microversion: 2.1 time: 0.217961 Sep 14 08:59:37.209829 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1294/2530] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:36 2022] GET /compute/v2.1/servers/eeed9e16-bc5c-4fb1-b4b9-9c9305c8da73 => generated 1324 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:59:37.212204 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fed0eba7-3221-41c8-ad76-dd1c4553d383 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:37.212773 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fed0eba7-3221-41c8-ad76-dd1c4553d383 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:37.213213 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fed0eba7-3221-41c8-ad76-dd1c4553d383 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:37.214246 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fed0eba7-3221-41c8-ad76-dd1c4553d383 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:37.214872 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fed0eba7-3221-41c8-ad76-dd1c4553d383 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:37.215323 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fed0eba7-3221-41c8-ad76-dd1c4553d383 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:37.620823 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-fed0eba7-3221-41c8-ad76-dd1c4553d383 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:37.629948 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-fed0eba7-3221-41c8-ad76-dd1c4553d383 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/82774725-1b08-411d-b760-4ed6aa3cec68" status: 200 len: 1315 microversion: 2.1 time: 0.431724 Sep 14 08:59:37.645052 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1237/2531] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:37 2022] GET /compute/v2.1/servers/82774725-1b08-411d-b760-4ed6aa3cec68 => generated 1315 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:59:37.654249 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-12b92d40-f69f-45bb-92ad-56e7ceb8d11e tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:37.654978 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-12b92d40-f69f-45bb-92ad-56e7ceb8d11e tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 39890752-2382-4631-8c4a-f3c6d47c94cb] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:37.661932 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-12b92d40-f69f-45bb-92ad-56e7ceb8d11e tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:37.662426 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-12b92d40-f69f-45bb-92ad-56e7ceb8d11e tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:37.662866 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-12b92d40-f69f-45bb-92ad-56e7ceb8d11e tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:37.664014 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-12b92d40-f69f-45bb-92ad-56e7ceb8d11e tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:37.664476 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-12b92d40-f69f-45bb-92ad-56e7ceb8d11e tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:37.664904 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-12b92d40-f69f-45bb-92ad-56e7ceb8d11e tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:37.740878 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-2e14158e-ddb8-4d41-85c8-3e81fdd524a9 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:37.741527 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-2e14158e-ddb8-4d41-85c8-3e81fdd524a9 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] [instance: 9ddb5908-22a9-41c8-909c-39cdf479bdd2] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:37.748593 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2e14158e-ddb8-4d41-85c8-3e81fdd524a9 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:37.749132 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2e14158e-ddb8-4d41-85c8-3e81fdd524a9 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:37.749581 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2e14158e-ddb8-4d41-85c8-3e81fdd524a9 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:37.750642 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2e14158e-ddb8-4d41-85c8-3e81fdd524a9 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:37.751189 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2e14158e-ddb8-4d41-85c8-3e81fdd524a9 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:37.751622 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2e14158e-ddb8-4d41-85c8-3e81fdd524a9 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:37.840458 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-12b92d40-f69f-45bb-92ad-56e7ceb8d11e tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:37.842971 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:59:37.851044 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-12b92d40-f69f-45bb-92ad-56e7ceb8d11e tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/39890752-2382-4631-8c4a-f3c6d47c94cb" status: 200 len: 1510 microversion: 2.1 time: 0.201130 Sep 14 08:59:37.851642 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1295/2532] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:37 2022] GET /compute/v2.1/servers/39890752-2382-4631-8c4a-f3c6d47c94cb => generated 1510 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:59:37.864890 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-2e14158e-ddb8-4d41-85c8-3e81fdd524a9 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc9edb486f8481a99778bdac0ef3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d168a11f24eeb861d3451e0c270cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:37.869022 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:59:37.875924 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-2e14158e-ddb8-4d41-85c8-3e81fdd524a9 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fdc9edb486f8481a99778bdac0ef3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d168a11f24eeb861d3451e0c270cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:37.878206 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-2e14158e-ddb8-4d41-85c8-3e81fdd524a9 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fdc9edb486f8481a99778bdac0ef3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d168a11f24eeb861d3451e0c270cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:37.884718 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-2e14158e-ddb8-4d41-85c8-3e81fdd524a9 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] 10.222.0.60 "GET /compute/v2.1/servers/9ddb5908-22a9-41c8-909c-39cdf479bdd2" status: 200 len: 1447 microversion: 2.75 time: 0.148404 Sep 14 08:59:37.885444 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1238/2533] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:59:37 2022] GET /compute/v2.1/servers/9ddb5908-22a9-41c8-909c-39cdf479bdd2 => generated 1447 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 08:59:38.005752 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-820eea1d-a1c5-4501-a8b4-65704d1885b2 req-d7eb0197-f288-4247-a2cc-0e2a53462e7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eeed9e16-bc5c-4fb1-b4b9-9c9305c8da73", "tag": "3fe7de0d-da04-49b7-b880-3c36db11b5aa"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:59:38.016517 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-820eea1d-a1c5-4501-a8b4-65704d1885b2 req-d7eb0197-f288-4247-a2cc-0e2a53462e7e service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:38.017130 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-820eea1d-a1c5-4501-a8b4-65704d1885b2 req-d7eb0197-f288-4247-a2cc-0e2a53462e7e service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:38.017625 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-820eea1d-a1c5-4501-a8b4-65704d1885b2 req-d7eb0197-f288-4247-a2cc-0e2a53462e7e service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:38.028945 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-820eea1d-a1c5-4501-a8b4-65704d1885b2 req-d7eb0197-f288-4247-a2cc-0e2a53462e7e service nova] Creating event network-changed:3fe7de0d-da04-49b7-b880-3c36db11b5aa for instance eeed9e16-bc5c-4fb1-b4b9-9c9305c8da73 on n-h1-836830-18 Sep 14 08:59:38.033630 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-820eea1d-a1c5-4501-a8b4-65704d1885b2 req-d7eb0197-f288-4247-a2cc-0e2a53462e7e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031621 Sep 14 08:59:38.034228 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1296/2534] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:59:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:59:38.076985 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-04244d42-2066-4ec6-85fc-4c5b6f743a67 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:38.077706 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-04244d42-2066-4ec6-85fc-4c5b6f743a67 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: d0c5547a-1340-4d19-a0f9-3e1eb9fd1932] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:38.083782 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-04244d42-2066-4ec6-85fc-4c5b6f743a67 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:38.084278 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-04244d42-2066-4ec6-85fc-4c5b6f743a67 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:38.084719 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-04244d42-2066-4ec6-85fc-4c5b6f743a67 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:38.085415 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-04244d42-2066-4ec6-85fc-4c5b6f743a67 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:38.085873 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-04244d42-2066-4ec6-85fc-4c5b6f743a67 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:38.086303 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-04244d42-2066-4ec6-85fc-4c5b6f743a67 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:38.220099 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-04244d42-2066-4ec6-85fc-4c5b6f743a67 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9d40e54481461cba53fedb9a6abdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed2295a58f8451993a57ce0a6f9ba29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:38.227885 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-04244d42-2066-4ec6-85fc-4c5b6f743a67 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] 10.222.0.60 "GET /compute/v2.1/servers/d0c5547a-1340-4d19-a0f9-3e1eb9fd1932" status: 200 len: 1513 microversion: 2.1 time: 0.154867 Sep 14 08:59:38.233776 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-511af69f-1d09-4c6f-9022-45034bbfd5e7 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:38.234635 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-511af69f-1d09-4c6f-9022-45034bbfd5e7 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] [instance: eeed9e16-bc5c-4fb1-b4b9-9c9305c8da73] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:38.238187 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1239/2535] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:38 2022] GET /compute/v2.1/servers/d0c5547a-1340-4d19-a0f9-3e1eb9fd1932 => generated 1513 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:59:38.241481 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-511af69f-1d09-4c6f-9022-45034bbfd5e7 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:38.242082 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-511af69f-1d09-4c6f-9022-45034bbfd5e7 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:38.242630 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-511af69f-1d09-4c6f-9022-45034bbfd5e7 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:38.243464 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-511af69f-1d09-4c6f-9022-45034bbfd5e7 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:38.243929 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-511af69f-1d09-4c6f-9022-45034bbfd5e7 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:38.244357 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-511af69f-1d09-4c6f-9022-45034bbfd5e7 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:38.382502 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-511af69f-1d09-4c6f-9022-45034bbfd5e7 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db65c0cfa83f48468d4a1bcef0caff73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9df06ceaa154f3c80665cc6a27b3598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:38.390433 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-511af69f-1d09-4c6f-9022-45034bbfd5e7 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] 10.222.0.60 "GET /compute/v2.1/servers/eeed9e16-bc5c-4fb1-b4b9-9c9305c8da73" status: 200 len: 1324 microversion: 2.1 time: 0.161374 Sep 14 08:59:38.391353 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1297/2536] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:38 2022] GET /compute/v2.1/servers/eeed9e16-bc5c-4fb1-b4b9-9c9305c8da73 => generated 1324 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:59:38.652741 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-dc45742d-7a8f-4cec-8663-59345ad88bd4 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:38.653981 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-dc45742d-7a8f-4cec-8663-59345ad88bd4 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: 82774725-1b08-411d-b760-4ed6aa3cec68] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:38.661297 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dc45742d-7a8f-4cec-8663-59345ad88bd4 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:38.661786 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dc45742d-7a8f-4cec-8663-59345ad88bd4 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:38.662223 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dc45742d-7a8f-4cec-8663-59345ad88bd4 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:38.662920 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dc45742d-7a8f-4cec-8663-59345ad88bd4 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:38.663407 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dc45742d-7a8f-4cec-8663-59345ad88bd4 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:38.663828 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dc45742d-7a8f-4cec-8663-59345ad88bd4 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:38.794286 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-dc45742d-7a8f-4cec-8663-59345ad88bd4 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:38.802291 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-dc45742d-7a8f-4cec-8663-59345ad88bd4 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/82774725-1b08-411d-b760-4ed6aa3cec68" status: 200 len: 1503 microversion: 2.1 time: 0.153497 Sep 14 08:59:38.803205 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1240/2537] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:38 2022] GET /compute/v2.1/servers/82774725-1b08-411d-b760-4ed6aa3cec68 => generated 1503 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:59:38.825131 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-671bccdd-8cf2-41e2-9797-a1514dfb411c tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:38.826124 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-671bccdd-8cf2-41e2-9797-a1514dfb411c tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: 82774725-1b08-411d-b760-4ed6aa3cec68] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:38.833051 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-671bccdd-8cf2-41e2-9797-a1514dfb411c tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:38.833531 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-671bccdd-8cf2-41e2-9797-a1514dfb411c tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:38.833971 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-671bccdd-8cf2-41e2-9797-a1514dfb411c tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:38.834649 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-671bccdd-8cf2-41e2-9797-a1514dfb411c tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:38.835141 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-671bccdd-8cf2-41e2-9797-a1514dfb411c tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:38.835566 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-671bccdd-8cf2-41e2-9797-a1514dfb411c tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:38.862967 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-671bccdd-8cf2-41e2-9797-a1514dfb411c tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: 82774725-1b08-411d-b760-4ed6aa3cec68] Going to try to terminate instance {{(pid=128758) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 08:59:38.875531 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-6073d7c4-8ea4-415f-afbb-3da5bbd6fa86 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:38.876159 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-6073d7c4-8ea4-415f-afbb-3da5bbd6fa86 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 39890752-2382-4631-8c4a-f3c6d47c94cb] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:38.881977 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6073d7c4-8ea4-415f-afbb-3da5bbd6fa86 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:38.882467 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6073d7c4-8ea4-415f-afbb-3da5bbd6fa86 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:38.882903 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6073d7c4-8ea4-415f-afbb-3da5bbd6fa86 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:38.883639 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6073d7c4-8ea4-415f-afbb-3da5bbd6fa86 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:38.884094 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6073d7c4-8ea4-415f-afbb-3da5bbd6fa86 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:38.884521 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6073d7c4-8ea4-415f-afbb-3da5bbd6fa86 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:38.941475 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-671bccdd-8cf2-41e2-9797-a1514dfb411c tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "DELETE /compute/v2.1/servers/82774725-1b08-411d-b760-4ed6aa3cec68" status: 204 len: 0 microversion: 2.1 time: 0.119854 Sep 14 08:59:38.942073 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1298/2538] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 08:59:38 2022] DELETE /compute/v2.1/servers/82774725-1b08-411d-b760-4ed6aa3cec68 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 08:59:38.947093 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-8a3d8fa5-08b6-4b73-abc9-6665d4a73827 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:38.947792 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-8a3d8fa5-08b6-4b73-abc9-6665d4a73827 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] [instance: 9ddb5908-22a9-41c8-909c-39cdf479bdd2] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:38.955143 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8a3d8fa5-08b6-4b73-abc9-6665d4a73827 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:38.955886 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8a3d8fa5-08b6-4b73-abc9-6665d4a73827 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:38.956247 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8a3d8fa5-08b6-4b73-abc9-6665d4a73827 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:38.956947 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8a3d8fa5-08b6-4b73-abc9-6665d4a73827 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:38.957403 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8a3d8fa5-08b6-4b73-abc9-6665d4a73827 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:38.957824 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8a3d8fa5-08b6-4b73-abc9-6665d4a73827 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:39.029597 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-8a3d8fa5-08b6-4b73-abc9-6665d4a73827 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc9edb486f8481a99778bdac0ef3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d168a11f24eeb861d3451e0c270cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:39.038091 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-8a3d8fa5-08b6-4b73-abc9-6665d4a73827 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fdc9edb486f8481a99778bdac0ef3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d168a11f24eeb861d3451e0c270cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:39.039675 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-8a3d8fa5-08b6-4b73-abc9-6665d4a73827 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fdc9edb486f8481a99778bdac0ef3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d168a11f24eeb861d3451e0c270cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:39.044802 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-6073d7c4-8ea4-415f-afbb-3da5bbd6fa86 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:39.045297 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-8a3d8fa5-08b6-4b73-abc9-6665d4a73827 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] 10.222.0.60 "GET /compute/v2.1/servers/9ddb5908-22a9-41c8-909c-39cdf479bdd2" status: 200 len: 1447 microversion: 2.75 time: 0.102122 Sep 14 08:59:39.045876 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1299/2539] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:59:38 2022] GET /compute/v2.1/servers/9ddb5908-22a9-41c8-909c-39cdf479bdd2 => generated 1447 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:59:39.050398 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-f340fdaf-974e-4f7f-90df-34295d38dbe5 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:39.051037 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-f340fdaf-974e-4f7f-90df-34295d38dbe5 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: 82774725-1b08-411d-b760-4ed6aa3cec68] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:39.053406 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-6073d7c4-8ea4-415f-afbb-3da5bbd6fa86 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/39890752-2382-4631-8c4a-f3c6d47c94cb" status: 200 len: 1510 microversion: 2.1 time: 0.182249 Sep 14 08:59:39.054168 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1241/2540] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:38 2022] GET /compute/v2.1/servers/39890752-2382-4631-8c4a-f3c6d47c94cb => generated 1510 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:59:39.057156 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f340fdaf-974e-4f7f-90df-34295d38dbe5 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:39.057652 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f340fdaf-974e-4f7f-90df-34295d38dbe5 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:39.058080 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f340fdaf-974e-4f7f-90df-34295d38dbe5 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:39.058773 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f340fdaf-974e-4f7f-90df-34295d38dbe5 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:39.059545 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f340fdaf-974e-4f7f-90df-34295d38dbe5 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:39.059949 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f340fdaf-974e-4f7f-90df-34295d38dbe5 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:39.192036 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-f340fdaf-974e-4f7f-90df-34295d38dbe5 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:39.200403 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-f340fdaf-974e-4f7f-90df-34295d38dbe5 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/82774725-1b08-411d-b760-4ed6aa3cec68" status: 200 len: 1509 microversion: 2.1 time: 0.153522 Sep 14 08:59:39.200985 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1300/2541] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:39 2022] GET /compute/v2.1/servers/82774725-1b08-411d-b760-4ed6aa3cec68 => generated 1509 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:59:39.250621 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-83f46620-af8e-43b7-9df4-b473ee2b8b7f tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:39.251385 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-83f46620-af8e-43b7-9df4-b473ee2b8b7f tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: d0c5547a-1340-4d19-a0f9-3e1eb9fd1932] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:39.257527 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-83f46620-af8e-43b7-9df4-b473ee2b8b7f tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:39.258006 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-83f46620-af8e-43b7-9df4-b473ee2b8b7f tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:39.258442 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-83f46620-af8e-43b7-9df4-b473ee2b8b7f tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:39.259162 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-83f46620-af8e-43b7-9df4-b473ee2b8b7f tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:39.259618 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-83f46620-af8e-43b7-9df4-b473ee2b8b7f tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:39.260041 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-83f46620-af8e-43b7-9df4-b473ee2b8b7f tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:39.388885 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-83f46620-af8e-43b7-9df4-b473ee2b8b7f tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9d40e54481461cba53fedb9a6abdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed2295a58f8451993a57ce0a6f9ba29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:39.396719 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-83f46620-af8e-43b7-9df4-b473ee2b8b7f tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] 10.222.0.60 "GET /compute/v2.1/servers/d0c5547a-1340-4d19-a0f9-3e1eb9fd1932" status: 200 len: 1513 microversion: 2.1 time: 0.150713 Sep 14 08:59:39.397310 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1242/2542] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:39 2022] GET /compute/v2.1/servers/d0c5547a-1340-4d19-a0f9-3e1eb9fd1932 => generated 1513 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:59:39.413660 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-6cb0af3e-1fa5-4d9f-86ed-3d08800dbfeb tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:39.414271 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-6cb0af3e-1fa5-4d9f-86ed-3d08800dbfeb tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] [instance: eeed9e16-bc5c-4fb1-b4b9-9c9305c8da73] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:39.420866 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6cb0af3e-1fa5-4d9f-86ed-3d08800dbfeb tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:39.421335 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6cb0af3e-1fa5-4d9f-86ed-3d08800dbfeb tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:39.421760 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6cb0af3e-1fa5-4d9f-86ed-3d08800dbfeb tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:39.422445 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6cb0af3e-1fa5-4d9f-86ed-3d08800dbfeb tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:39.422893 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6cb0af3e-1fa5-4d9f-86ed-3d08800dbfeb tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:39.423338 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6cb0af3e-1fa5-4d9f-86ed-3d08800dbfeb tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:39.552738 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-6cb0af3e-1fa5-4d9f-86ed-3d08800dbfeb tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db65c0cfa83f48468d4a1bcef0caff73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9df06ceaa154f3c80665cc6a27b3598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:39.563197 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-6cb0af3e-1fa5-4d9f-86ed-3d08800dbfeb tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] 10.222.0.60 "GET /compute/v2.1/servers/eeed9e16-bc5c-4fb1-b4b9-9c9305c8da73" status: 200 len: 1324 microversion: 2.1 time: 0.153399 Sep 14 08:59:39.563769 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1301/2543] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:39 2022] GET /compute/v2.1/servers/eeed9e16-bc5c-4fb1-b4b9-9c9305c8da73 => generated 1324 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:59:40.080033 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-5177c4ba-4cf8-4bbb-9416-4e3902a29699 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:40.080648 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-5177c4ba-4cf8-4bbb-9416-4e3902a29699 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 39890752-2382-4631-8c4a-f3c6d47c94cb] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:40.080759 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-66d33caa-76fa-45a6-9c0f-0c66c8fc1bc5 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:40.081328 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-66d33caa-76fa-45a6-9c0f-0c66c8fc1bc5 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] [instance: 9ddb5908-22a9-41c8-909c-39cdf479bdd2] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:40.087522 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5177c4ba-4cf8-4bbb-9416-4e3902a29699 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:40.088005 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5177c4ba-4cf8-4bbb-9416-4e3902a29699 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:40.088163 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-66d33caa-76fa-45a6-9c0f-0c66c8fc1bc5 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:40.088439 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5177c4ba-4cf8-4bbb-9416-4e3902a29699 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:40.088649 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-66d33caa-76fa-45a6-9c0f-0c66c8fc1bc5 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:40.089089 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-66d33caa-76fa-45a6-9c0f-0c66c8fc1bc5 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:40.089214 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5177c4ba-4cf8-4bbb-9416-4e3902a29699 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:40.089558 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5177c4ba-4cf8-4bbb-9416-4e3902a29699 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:40.089781 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-66d33caa-76fa-45a6-9c0f-0c66c8fc1bc5 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:40.089977 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5177c4ba-4cf8-4bbb-9416-4e3902a29699 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:40.090238 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-66d33caa-76fa-45a6-9c0f-0c66c8fc1bc5 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:40.090666 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-66d33caa-76fa-45a6-9c0f-0c66c8fc1bc5 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:40.177018 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-66d33caa-76fa-45a6-9c0f-0c66c8fc1bc5 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc9edb486f8481a99778bdac0ef3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d168a11f24eeb861d3451e0c270cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:40.185469 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-66d33caa-76fa-45a6-9c0f-0c66c8fc1bc5 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fdc9edb486f8481a99778bdac0ef3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d168a11f24eeb861d3451e0c270cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:40.186962 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-66d33caa-76fa-45a6-9c0f-0c66c8fc1bc5 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fdc9edb486f8481a99778bdac0ef3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d168a11f24eeb861d3451e0c270cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:40.191904 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-66d33caa-76fa-45a6-9c0f-0c66c8fc1bc5 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] 10.222.0.60 "GET /compute/v2.1/servers/9ddb5908-22a9-41c8-909c-39cdf479bdd2" status: 200 len: 1447 microversion: 2.75 time: 0.115029 Sep 14 08:59:40.192487 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1302/2544] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:59:40 2022] GET /compute/v2.1/servers/9ddb5908-22a9-41c8-909c-39cdf479bdd2 => generated 1447 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 08:59:40.223429 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-df9ce77f-0480-4956-bc5c-27c55bf60fc1 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:40.224070 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-df9ce77f-0480-4956-bc5c-27c55bf60fc1 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: 82774725-1b08-411d-b760-4ed6aa3cec68] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:40.229959 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-df9ce77f-0480-4956-bc5c-27c55bf60fc1 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:40.230443 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-df9ce77f-0480-4956-bc5c-27c55bf60fc1 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:40.230873 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-df9ce77f-0480-4956-bc5c-27c55bf60fc1 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:40.231596 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-df9ce77f-0480-4956-bc5c-27c55bf60fc1 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:40.232046 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-df9ce77f-0480-4956-bc5c-27c55bf60fc1 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:40.232465 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-df9ce77f-0480-4956-bc5c-27c55bf60fc1 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:40.240498 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-5177c4ba-4cf8-4bbb-9416-4e3902a29699 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:40.248360 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-5177c4ba-4cf8-4bbb-9416-4e3902a29699 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/39890752-2382-4631-8c4a-f3c6d47c94cb" status: 200 len: 1510 microversion: 2.1 time: 0.172209 Sep 14 08:59:40.248945 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1243/2545] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:40 2022] GET /compute/v2.1/servers/39890752-2382-4631-8c4a-f3c6d47c94cb => generated 1510 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:59:40.373629 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-df9ce77f-0480-4956-bc5c-27c55bf60fc1 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:40.381352 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-df9ce77f-0480-4956-bc5c-27c55bf60fc1 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/82774725-1b08-411d-b760-4ed6aa3cec68" status: 200 len: 1509 microversion: 2.1 time: 0.161756 Sep 14 08:59:40.381919 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1303/2546] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:40 2022] GET /compute/v2.1/servers/82774725-1b08-411d-b760-4ed6aa3cec68 => generated 1509 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:59:40.419497 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3e1cda81-56e0-4c44-87ff-ad566aa49b2c tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:40.420114 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-3e1cda81-56e0-4c44-87ff-ad566aa49b2c tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: d0c5547a-1340-4d19-a0f9-3e1eb9fd1932] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:40.426022 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3e1cda81-56e0-4c44-87ff-ad566aa49b2c tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:40.426500 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3e1cda81-56e0-4c44-87ff-ad566aa49b2c tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:40.426932 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3e1cda81-56e0-4c44-87ff-ad566aa49b2c tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:40.427637 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3e1cda81-56e0-4c44-87ff-ad566aa49b2c tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:40.428085 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3e1cda81-56e0-4c44-87ff-ad566aa49b2c tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:40.428533 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3e1cda81-56e0-4c44-87ff-ad566aa49b2c tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:40.556609 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-3e1cda81-56e0-4c44-87ff-ad566aa49b2c tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9d40e54481461cba53fedb9a6abdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed2295a58f8451993a57ce0a6f9ba29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:40.565192 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-3e1cda81-56e0-4c44-87ff-ad566aa49b2c tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] 10.222.0.60 "GET /compute/v2.1/servers/d0c5547a-1340-4d19-a0f9-3e1eb9fd1932" status: 200 len: 1513 microversion: 2.1 time: 0.149566 Sep 14 08:59:40.565771 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1244/2547] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:40 2022] GET /compute/v2.1/servers/d0c5547a-1340-4d19-a0f9-3e1eb9fd1932 => generated 1513 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:59:40.585569 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-fb642e89-1169-4902-9639-e3f56a8d43c6 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:40.586218 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-fb642e89-1169-4902-9639-e3f56a8d43c6 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] [instance: eeed9e16-bc5c-4fb1-b4b9-9c9305c8da73] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:40.593423 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fb642e89-1169-4902-9639-e3f56a8d43c6 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:40.593905 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fb642e89-1169-4902-9639-e3f56a8d43c6 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:40.594339 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fb642e89-1169-4902-9639-e3f56a8d43c6 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:40.595080 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fb642e89-1169-4902-9639-e3f56a8d43c6 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:40.595612 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fb642e89-1169-4902-9639-e3f56a8d43c6 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:40.596204 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fb642e89-1169-4902-9639-e3f56a8d43c6 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:40.743467 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-fb642e89-1169-4902-9639-e3f56a8d43c6 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db65c0cfa83f48468d4a1bcef0caff73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9df06ceaa154f3c80665cc6a27b3598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:40.752656 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-fb642e89-1169-4902-9639-e3f56a8d43c6 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] 10.222.0.60 "GET /compute/v2.1/servers/eeed9e16-bc5c-4fb1-b4b9-9c9305c8da73" status: 200 len: 1324 microversion: 2.1 time: 0.170900 Sep 14 08:59:40.753252 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1304/2548] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:40 2022] GET /compute/v2.1/servers/eeed9e16-bc5c-4fb1-b4b9-9c9305c8da73 => generated 1324 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:59:41.221762 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-19c8f6cb-6a50-44d7-bc72-e398f6dc7a20 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:41.222523 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-19c8f6cb-6a50-44d7-bc72-e398f6dc7a20 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] [instance: 9ddb5908-22a9-41c8-909c-39cdf479bdd2] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:41.231196 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-19c8f6cb-6a50-44d7-bc72-e398f6dc7a20 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:41.232376 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-19c8f6cb-6a50-44d7-bc72-e398f6dc7a20 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:41.232977 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-19c8f6cb-6a50-44d7-bc72-e398f6dc7a20 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:41.233830 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-19c8f6cb-6a50-44d7-bc72-e398f6dc7a20 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:41.234388 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-19c8f6cb-6a50-44d7-bc72-e398f6dc7a20 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:41.234985 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-19c8f6cb-6a50-44d7-bc72-e398f6dc7a20 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:41.272954 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-7336b7c4-fc6e-4d60-a370-fba71c32f3b6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:41.274268 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-7336b7c4-fc6e-4d60-a370-fba71c32f3b6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 39890752-2382-4631-8c4a-f3c6d47c94cb] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:41.282202 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7336b7c4-fc6e-4d60-a370-fba71c32f3b6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:41.282709 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7336b7c4-fc6e-4d60-a370-fba71c32f3b6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:41.283179 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7336b7c4-fc6e-4d60-a370-fba71c32f3b6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:41.283891 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7336b7c4-fc6e-4d60-a370-fba71c32f3b6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:41.284337 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7336b7c4-fc6e-4d60-a370-fba71c32f3b6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:41.284740 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7336b7c4-fc6e-4d60-a370-fba71c32f3b6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:41.312540 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-19c8f6cb-6a50-44d7-bc72-e398f6dc7a20 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc9edb486f8481a99778bdac0ef3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d168a11f24eeb861d3451e0c270cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:41.323173 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-19c8f6cb-6a50-44d7-bc72-e398f6dc7a20 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fdc9edb486f8481a99778bdac0ef3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d168a11f24eeb861d3451e0c270cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:41.324624 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-19c8f6cb-6a50-44d7-bc72-e398f6dc7a20 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fdc9edb486f8481a99778bdac0ef3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d168a11f24eeb861d3451e0c270cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:41.330433 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-19c8f6cb-6a50-44d7-bc72-e398f6dc7a20 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] 10.222.0.60 "GET /compute/v2.1/servers/9ddb5908-22a9-41c8-909c-39cdf479bdd2" status: 200 len: 1447 microversion: 2.75 time: 0.114313 Sep 14 08:59:41.331653 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1245/2549] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:59:41 2022] GET /compute/v2.1/servers/9ddb5908-22a9-41c8-909c-39cdf479bdd2 => generated 1447 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:59:41.405839 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-7657f8ed-c99e-4727-9200-45c66c979039 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:41.406474 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-7657f8ed-c99e-4727-9200-45c66c979039 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: 82774725-1b08-411d-b760-4ed6aa3cec68] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:41.412896 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7657f8ed-c99e-4727-9200-45c66c979039 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:41.413468 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7657f8ed-c99e-4727-9200-45c66c979039 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:41.414012 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7657f8ed-c99e-4727-9200-45c66c979039 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:41.414806 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7657f8ed-c99e-4727-9200-45c66c979039 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:41.415352 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7657f8ed-c99e-4727-9200-45c66c979039 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:41.415780 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7657f8ed-c99e-4727-9200-45c66c979039 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:41.428366 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-7336b7c4-fc6e-4d60-a370-fba71c32f3b6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:41.436908 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-7336b7c4-fc6e-4d60-a370-fba71c32f3b6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/39890752-2382-4631-8c4a-f3c6d47c94cb" status: 200 len: 1510 microversion: 2.1 time: 0.168368 Sep 14 08:59:41.437457 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1305/2550] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:41 2022] GET /compute/v2.1/servers/39890752-2382-4631-8c4a-f3c6d47c94cb => generated 1510 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:59:41.561628 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-7657f8ed-c99e-4727-9200-45c66c979039 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:41.571062 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-7657f8ed-c99e-4727-9200-45c66c979039 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/82774725-1b08-411d-b760-4ed6aa3cec68" status: 200 len: 1509 microversion: 2.1 time: 0.169684 Sep 14 08:59:41.571723 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1246/2551] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:41 2022] GET /compute/v2.1/servers/82774725-1b08-411d-b760-4ed6aa3cec68 => generated 1509 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:59:41.589703 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-8c4a45bd-e735-4e47-a909-3e438f1267fe tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:41.590321 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-8c4a45bd-e735-4e47-a909-3e438f1267fe tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: d0c5547a-1340-4d19-a0f9-3e1eb9fd1932] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:41.597752 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8c4a45bd-e735-4e47-a909-3e438f1267fe tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:41.598302 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8c4a45bd-e735-4e47-a909-3e438f1267fe tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:41.598745 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8c4a45bd-e735-4e47-a909-3e438f1267fe tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:41.599548 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8c4a45bd-e735-4e47-a909-3e438f1267fe tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:41.599997 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8c4a45bd-e735-4e47-a909-3e438f1267fe tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:41.600468 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8c4a45bd-e735-4e47-a909-3e438f1267fe tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:41.738286 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=12 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:59:41.742054 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-8c4a45bd-e735-4e47-a909-3e438f1267fe tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9d40e54481461cba53fedb9a6abdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed2295a58f8451993a57ce0a6f9ba29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:41.750791 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-8c4a45bd-e735-4e47-a909-3e438f1267fe tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] 10.222.0.60 "GET /compute/v2.1/servers/d0c5547a-1340-4d19-a0f9-3e1eb9fd1932" status: 200 len: 1513 microversion: 2.1 time: 0.165513 Sep 14 08:59:41.751571 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1306/2552] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:41 2022] GET /compute/v2.1/servers/d0c5547a-1340-4d19-a0f9-3e1eb9fd1932 => generated 1513 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:59:41.776381 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9ffe22ea-a93e-476d-b952-57254033d771 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:41.777117 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-9ffe22ea-a93e-476d-b952-57254033d771 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] [instance: eeed9e16-bc5c-4fb1-b4b9-9c9305c8da73] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:41.783375 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9ffe22ea-a93e-476d-b952-57254033d771 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:41.783935 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9ffe22ea-a93e-476d-b952-57254033d771 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:41.784378 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9ffe22ea-a93e-476d-b952-57254033d771 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:41.785061 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9ffe22ea-a93e-476d-b952-57254033d771 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:41.785510 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9ffe22ea-a93e-476d-b952-57254033d771 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:41.785937 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9ffe22ea-a93e-476d-b952-57254033d771 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:41.930134 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-9ffe22ea-a93e-476d-b952-57254033d771 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db65c0cfa83f48468d4a1bcef0caff73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9df06ceaa154f3c80665cc6a27b3598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:41.939301 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-9ffe22ea-a93e-476d-b952-57254033d771 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] 10.222.0.60 "GET /compute/v2.1/servers/eeed9e16-bc5c-4fb1-b4b9-9c9305c8da73" status: 200 len: 1324 microversion: 2.1 time: 0.166689 Sep 14 08:59:41.939947 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1247/2553] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:41 2022] GET /compute/v2.1/servers/eeed9e16-bc5c-4fb1-b4b9-9c9305c8da73 => generated 1324 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:59:42.360696 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-aded6b8a-68c9-4656-845b-9f021a6fa028 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:42.361314 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-aded6b8a-68c9-4656-845b-9f021a6fa028 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] [instance: 9ddb5908-22a9-41c8-909c-39cdf479bdd2] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:42.368217 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-aded6b8a-68c9-4656-845b-9f021a6fa028 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:42.368700 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-aded6b8a-68c9-4656-845b-9f021a6fa028 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:42.369135 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-aded6b8a-68c9-4656-845b-9f021a6fa028 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:42.369818 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-aded6b8a-68c9-4656-845b-9f021a6fa028 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:42.370271 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-aded6b8a-68c9-4656-845b-9f021a6fa028 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:42.370868 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-aded6b8a-68c9-4656-845b-9f021a6fa028 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:42.443772 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-aded6b8a-68c9-4656-845b-9f021a6fa028 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc9edb486f8481a99778bdac0ef3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d168a11f24eeb861d3451e0c270cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:42.452035 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-aded6b8a-68c9-4656-845b-9f021a6fa028 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fdc9edb486f8481a99778bdac0ef3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d168a11f24eeb861d3451e0c270cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:42.453502 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-aded6b8a-68c9-4656-845b-9f021a6fa028 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fdc9edb486f8481a99778bdac0ef3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d168a11f24eeb861d3451e0c270cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:42.458696 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-aded6b8a-68c9-4656-845b-9f021a6fa028 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] 10.222.0.60 "GET /compute/v2.1/servers/9ddb5908-22a9-41c8-909c-39cdf479bdd2" status: 200 len: 1447 microversion: 2.75 time: 0.102514 Sep 14 08:59:42.459266 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1307/2554] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:59:42 2022] GET /compute/v2.1/servers/9ddb5908-22a9-41c8-909c-39cdf479bdd2 => generated 1447 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:59:42.461552 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-172aa746-808f-423c-b3ab-d6186c12d09d tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:42.462179 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-172aa746-808f-423c-b3ab-d6186c12d09d tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 39890752-2382-4631-8c4a-f3c6d47c94cb] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:42.469043 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-172aa746-808f-423c-b3ab-d6186c12d09d tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:42.469528 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-172aa746-808f-423c-b3ab-d6186c12d09d tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:42.470419 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-172aa746-808f-423c-b3ab-d6186c12d09d tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:42.471153 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-172aa746-808f-423c-b3ab-d6186c12d09d tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:42.471838 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-172aa746-808f-423c-b3ab-d6186c12d09d tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:42.472332 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-172aa746-808f-423c-b3ab-d6186c12d09d tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:42.596103 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-7ac9722e-6122-4486-816e-ca95d4b0a71d tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:42.596551 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-7ac9722e-6122-4486-816e-ca95d4b0a71d tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: 82774725-1b08-411d-b760-4ed6aa3cec68] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:42.599409 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:59:42.603242 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7ac9722e-6122-4486-816e-ca95d4b0a71d tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:42.603741 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7ac9722e-6122-4486-816e-ca95d4b0a71d tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:42.604181 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7ac9722e-6122-4486-816e-ca95d4b0a71d tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:42.604883 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7ac9722e-6122-4486-816e-ca95d4b0a71d tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:42.605342 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7ac9722e-6122-4486-816e-ca95d4b0a71d tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:42.605770 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7ac9722e-6122-4486-816e-ca95d4b0a71d tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:42.610717 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-172aa746-808f-423c-b3ab-d6186c12d09d tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:42.619857 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-172aa746-808f-423c-b3ab-d6186c12d09d tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/39890752-2382-4631-8c4a-f3c6d47c94cb" status: 200 len: 1510 microversion: 2.1 time: 0.162363 Sep 14 08:59:42.623047 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1248/2555] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:42 2022] GET /compute/v2.1/servers/39890752-2382-4631-8c4a-f3c6d47c94cb => generated 1510 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:59:42.755327 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-7ac9722e-6122-4486-816e-ca95d4b0a71d tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:42.763209 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-7ac9722e-6122-4486-816e-ca95d4b0a71d tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/82774725-1b08-411d-b760-4ed6aa3cec68" status: 200 len: 1509 microversion: 2.1 time: 0.171557 Sep 14 08:59:42.763785 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1308/2556] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:42 2022] GET /compute/v2.1/servers/82774725-1b08-411d-b760-4ed6aa3cec68 => generated 1509 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:59:42.773519 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-0adfaf8b-68d7-49bc-aa30-1d3d65ec29ed tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:42.774133 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-0adfaf8b-68d7-49bc-aa30-1d3d65ec29ed tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: d0c5547a-1340-4d19-a0f9-3e1eb9fd1932] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:42.780679 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0adfaf8b-68d7-49bc-aa30-1d3d65ec29ed tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:42.781158 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0adfaf8b-68d7-49bc-aa30-1d3d65ec29ed tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:42.781595 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0adfaf8b-68d7-49bc-aa30-1d3d65ec29ed tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:42.782267 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0adfaf8b-68d7-49bc-aa30-1d3d65ec29ed tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:42.782715 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0adfaf8b-68d7-49bc-aa30-1d3d65ec29ed tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:42.783177 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0adfaf8b-68d7-49bc-aa30-1d3d65ec29ed tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:42.923147 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-0adfaf8b-68d7-49bc-aa30-1d3d65ec29ed tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9d40e54481461cba53fedb9a6abdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed2295a58f8451993a57ce0a6f9ba29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:42.931103 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-0adfaf8b-68d7-49bc-aa30-1d3d65ec29ed tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] 10.222.0.60 "GET /compute/v2.1/servers/d0c5547a-1340-4d19-a0f9-3e1eb9fd1932" status: 200 len: 1513 microversion: 2.1 time: 0.161397 Sep 14 08:59:42.931641 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1249/2557] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:42 2022] GET /compute/v2.1/servers/d0c5547a-1340-4d19-a0f9-3e1eb9fd1932 => generated 1513 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:59:42.962124 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-7076166f-5835-45a0-a72e-792e5f829f62 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:42.962756 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-7076166f-5835-45a0-a72e-792e5f829f62 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] [instance: eeed9e16-bc5c-4fb1-b4b9-9c9305c8da73] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:42.969718 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7076166f-5835-45a0-a72e-792e5f829f62 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:42.970476 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7076166f-5835-45a0-a72e-792e5f829f62 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:42.970924 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7076166f-5835-45a0-a72e-792e5f829f62 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:42.971743 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7076166f-5835-45a0-a72e-792e5f829f62 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:42.972211 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7076166f-5835-45a0-a72e-792e5f829f62 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:42.972672 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7076166f-5835-45a0-a72e-792e5f829f62 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:43.117879 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-7076166f-5835-45a0-a72e-792e5f829f62 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db65c0cfa83f48468d4a1bcef0caff73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9df06ceaa154f3c80665cc6a27b3598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:43.125735 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-7076166f-5835-45a0-a72e-792e5f829f62 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] 10.222.0.60 "GET /compute/v2.1/servers/eeed9e16-bc5c-4fb1-b4b9-9c9305c8da73" status: 200 len: 1324 microversion: 2.1 time: 0.167527 Sep 14 08:59:43.126317 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1309/2558] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:42 2022] GET /compute/v2.1/servers/eeed9e16-bc5c-4fb1-b4b9-9c9305c8da73 => generated 1324 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:59:43.486241 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-945905b6-7fca-4313-bc0b-fa5bd37ed5ee tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:43.486780 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-945905b6-7fca-4313-bc0b-fa5bd37ed5ee tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] [instance: 9ddb5908-22a9-41c8-909c-39cdf479bdd2] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:43.493611 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-945905b6-7fca-4313-bc0b-fa5bd37ed5ee tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:43.494097 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-945905b6-7fca-4313-bc0b-fa5bd37ed5ee tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:43.494537 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-945905b6-7fca-4313-bc0b-fa5bd37ed5ee tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:43.495257 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-945905b6-7fca-4313-bc0b-fa5bd37ed5ee tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:43.495710 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-945905b6-7fca-4313-bc0b-fa5bd37ed5ee tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:43.496133 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-945905b6-7fca-4313-bc0b-fa5bd37ed5ee tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:43.568625 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-945905b6-7fca-4313-bc0b-fa5bd37ed5ee tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc9edb486f8481a99778bdac0ef3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d168a11f24eeb861d3451e0c270cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:43.578208 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-945905b6-7fca-4313-bc0b-fa5bd37ed5ee tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fdc9edb486f8481a99778bdac0ef3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d168a11f24eeb861d3451e0c270cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:43.579690 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-945905b6-7fca-4313-bc0b-fa5bd37ed5ee tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fdc9edb486f8481a99778bdac0ef3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d168a11f24eeb861d3451e0c270cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:43.585299 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-945905b6-7fca-4313-bc0b-fa5bd37ed5ee tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] 10.222.0.60 "GET /compute/v2.1/servers/9ddb5908-22a9-41c8-909c-39cdf479bdd2" status: 200 len: 1447 microversion: 2.75 time: 0.103093 Sep 14 08:59:43.586402 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1250/2559] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:59:43 2022] GET /compute/v2.1/servers/9ddb5908-22a9-41c8-909c-39cdf479bdd2 => generated 1447 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:59:43.647873 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d1eadf4c-6a42-4a18-942e-cd5028b8f079 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:43.648551 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-d1eadf4c-6a42-4a18-942e-cd5028b8f079 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 39890752-2382-4631-8c4a-f3c6d47c94cb] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:43.656079 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d1eadf4c-6a42-4a18-942e-cd5028b8f079 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:43.656572 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d1eadf4c-6a42-4a18-942e-cd5028b8f079 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:43.657013 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d1eadf4c-6a42-4a18-942e-cd5028b8f079 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:43.657715 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d1eadf4c-6a42-4a18-942e-cd5028b8f079 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:43.658278 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d1eadf4c-6a42-4a18-942e-cd5028b8f079 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:43.658719 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d1eadf4c-6a42-4a18-942e-cd5028b8f079 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:43.787887 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9d679fbc-7dd4-4463-b366-b91d22ad309b tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:43.788557 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-9d679fbc-7dd4-4463-b366-b91d22ad309b tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: 82774725-1b08-411d-b760-4ed6aa3cec68] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:43.795726 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-d1eadf4c-6a42-4a18-942e-cd5028b8f079 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:43.795883 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9d679fbc-7dd4-4463-b366-b91d22ad309b tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:43.796344 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9d679fbc-7dd4-4463-b366-b91d22ad309b tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:43.796852 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9d679fbc-7dd4-4463-b366-b91d22ad309b tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:43.797712 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9d679fbc-7dd4-4463-b366-b91d22ad309b tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:43.798176 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9d679fbc-7dd4-4463-b366-b91d22ad309b tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:43.798762 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9d679fbc-7dd4-4463-b366-b91d22ad309b tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:43.803933 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-d1eadf4c-6a42-4a18-942e-cd5028b8f079 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/39890752-2382-4631-8c4a-f3c6d47c94cb" status: 200 len: 1510 microversion: 2.1 time: 0.160214 Sep 14 08:59:43.804644 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1310/2560] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:43 2022] GET /compute/v2.1/servers/39890752-2382-4631-8c4a-f3c6d47c94cb => generated 1510 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:59:43.946650 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-9d679fbc-7dd4-4463-b366-b91d22ad309b tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:43.954966 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-9d679fbc-7dd4-4463-b366-b91d22ad309b tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/82774725-1b08-411d-b760-4ed6aa3cec68" status: 200 len: 1509 microversion: 2.1 time: 0.171554 Sep 14 08:59:43.955338 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-24aa1a98-1e96-4c65-b7dd-2ae9189c9bf3 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:43.955555 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1251/2561] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:43 2022] GET /compute/v2.1/servers/82774725-1b08-411d-b760-4ed6aa3cec68 => generated 1509 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:59:43.955881 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-24aa1a98-1e96-4c65-b7dd-2ae9189c9bf3 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: d0c5547a-1340-4d19-a0f9-3e1eb9fd1932] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:43.961812 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-24aa1a98-1e96-4c65-b7dd-2ae9189c9bf3 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:43.962292 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-24aa1a98-1e96-4c65-b7dd-2ae9189c9bf3 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:43.962720 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-24aa1a98-1e96-4c65-b7dd-2ae9189c9bf3 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:43.963460 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-24aa1a98-1e96-4c65-b7dd-2ae9189c9bf3 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:43.963912 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-24aa1a98-1e96-4c65-b7dd-2ae9189c9bf3 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:43.964315 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-24aa1a98-1e96-4c65-b7dd-2ae9189c9bf3 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:43.990706 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:59:44.149406 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-24aa1a98-1e96-4c65-b7dd-2ae9189c9bf3 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9d40e54481461cba53fedb9a6abdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed2295a58f8451993a57ce0a6f9ba29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:44.149804 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-0a01a1f0-6a67-48dd-a983-826e22d682c9 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:44.150714 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-0a01a1f0-6a67-48dd-a983-826e22d682c9 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] [instance: eeed9e16-bc5c-4fb1-b4b9-9c9305c8da73] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:44.160230 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-24aa1a98-1e96-4c65-b7dd-2ae9189c9bf3 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] 10.222.0.60 "GET /compute/v2.1/servers/d0c5547a-1340-4d19-a0f9-3e1eb9fd1932" status: 200 len: 1531 microversion: 2.1 time: 0.209034 Sep 14 08:59:44.161308 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0a01a1f0-6a67-48dd-a983-826e22d682c9 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:44.161610 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0a01a1f0-6a67-48dd-a983-826e22d682c9 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:44.162068 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0a01a1f0-6a67-48dd-a983-826e22d682c9 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:44.178963 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1311/2562] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:43 2022] GET /compute/v2.1/servers/d0c5547a-1340-4d19-a0f9-3e1eb9fd1932 => generated 1531 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:59:44.179183 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0a01a1f0-6a67-48dd-a983-826e22d682c9 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:44.179183 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0a01a1f0-6a67-48dd-a983-826e22d682c9 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:44.179183 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0a01a1f0-6a67-48dd-a983-826e22d682c9 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:44.234867 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-8bab8439-d283-4fe1-8fb6-c90727dc5b24 req-31c092e3-ffa2-4b57-9e2a-91a3bc9c64c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eeed9e16-bc5c-4fb1-b4b9-9c9305c8da73", "name": "network-vif-plugged", "status": "completed", "tag": "3fe7de0d-da04-49b7-b880-3c36db11b5aa"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:59:44.247569 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-8bab8439-d283-4fe1-8fb6-c90727dc5b24 req-31c092e3-ffa2-4b57-9e2a-91a3bc9c64c4 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:44.248445 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-8bab8439-d283-4fe1-8fb6-c90727dc5b24 req-31c092e3-ffa2-4b57-9e2a-91a3bc9c64c4 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:44.249755 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-8bab8439-d283-4fe1-8fb6-c90727dc5b24 req-31c092e3-ffa2-4b57-9e2a-91a3bc9c64c4 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:44.268015 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-8bab8439-d283-4fe1-8fb6-c90727dc5b24 req-31c092e3-ffa2-4b57-9e2a-91a3bc9c64c4 service nova] Creating event network-vif-plugged:3fe7de0d-da04-49b7-b880-3c36db11b5aa for instance eeed9e16-bc5c-4fb1-b4b9-9c9305c8da73 on n-h1-836830-18 Sep 14 08:59:44.275392 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-8bab8439-d283-4fe1-8fb6-c90727dc5b24 req-31c092e3-ffa2-4b57-9e2a-91a3bc9c64c4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044479 Sep 14 08:59:44.276451 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1312/2563] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:59:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 08:59:44.509914 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-0a01a1f0-6a67-48dd-a983-826e22d682c9 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db65c0cfa83f48468d4a1bcef0caff73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9df06ceaa154f3c80665cc6a27b3598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:44.519082 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-0a01a1f0-6a67-48dd-a983-826e22d682c9 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] 10.222.0.60 "GET /compute/v2.1/servers/eeed9e16-bc5c-4fb1-b4b9-9c9305c8da73" status: 200 len: 1324 microversion: 2.1 time: 0.373911 Sep 14 08:59:44.519716 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1252/2564] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:44 2022] GET /compute/v2.1/servers/eeed9e16-bc5c-4fb1-b4b9-9c9305c8da73 => generated 1324 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:59:44.613334 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-2aec33a8-704f-4594-9ba6-29593cb48f6a tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:44.614152 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-2aec33a8-704f-4594-9ba6-29593cb48f6a tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] [instance: 9ddb5908-22a9-41c8-909c-39cdf479bdd2] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:44.620316 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2aec33a8-704f-4594-9ba6-29593cb48f6a tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:44.620875 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2aec33a8-704f-4594-9ba6-29593cb48f6a tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:44.621313 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2aec33a8-704f-4594-9ba6-29593cb48f6a tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:44.622001 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2aec33a8-704f-4594-9ba6-29593cb48f6a tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:44.622449 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2aec33a8-704f-4594-9ba6-29593cb48f6a tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:44.622872 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2aec33a8-704f-4594-9ba6-29593cb48f6a tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:44.722224 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-2aec33a8-704f-4594-9ba6-29593cb48f6a tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc9edb486f8481a99778bdac0ef3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d168a11f24eeb861d3451e0c270cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:44.730748 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-2aec33a8-704f-4594-9ba6-29593cb48f6a tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fdc9edb486f8481a99778bdac0ef3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d168a11f24eeb861d3451e0c270cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:44.732247 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-2aec33a8-704f-4594-9ba6-29593cb48f6a tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fdc9edb486f8481a99778bdac0ef3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d168a11f24eeb861d3451e0c270cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:44.737601 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-2aec33a8-704f-4594-9ba6-29593cb48f6a tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] 10.222.0.60 "GET /compute/v2.1/servers/9ddb5908-22a9-41c8-909c-39cdf479bdd2" status: 200 len: 1447 microversion: 2.75 time: 0.128654 Sep 14 08:59:44.738229 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1313/2565] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:59:44 2022] GET /compute/v2.1/servers/9ddb5908-22a9-41c8-909c-39cdf479bdd2 => generated 1447 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:59:44.829451 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-45f63f3d-ad06-4237-b90b-6f033b8746d7 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:44.830111 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-45f63f3d-ad06-4237-b90b-6f033b8746d7 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 39890752-2382-4631-8c4a-f3c6d47c94cb] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:44.839984 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-fb0669b1-fbd3-4a29-bc2c-98bd6d7f44d3 req-f2eb5ca4-cf64-479c-9e13-ab03bfd27496 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82774725-1b08-411d-b760-4ed6aa3cec68", "name": "network-vif-deleted", "tag": "9bd6c035-8037-408f-9279-b825baab8c1f"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:59:44.841895 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=16 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:59:44.843139 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=62 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:59:44.845633 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:59:44.845895 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-45f63f3d-ad06-4237-b90b-6f033b8746d7 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:44.846498 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-45f63f3d-ad06-4237-b90b-6f033b8746d7 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:44.847179 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-45f63f3d-ad06-4237-b90b-6f033b8746d7 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:44.848138 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-45f63f3d-ad06-4237-b90b-6f033b8746d7 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:44.848640 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-45f63f3d-ad06-4237-b90b-6f033b8746d7 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:44.849044 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-45f63f3d-ad06-4237-b90b-6f033b8746d7 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:44.851286 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-fb0669b1-fbd3-4a29-bc2c-98bd6d7f44d3 req-f2eb5ca4-cf64-479c-9e13-ab03bfd27496 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:44.851767 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-fb0669b1-fbd3-4a29-bc2c-98bd6d7f44d3 req-f2eb5ca4-cf64-479c-9e13-ab03bfd27496 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:44.852340 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-fb0669b1-fbd3-4a29-bc2c-98bd6d7f44d3 req-f2eb5ca4-cf64-479c-9e13-ab03bfd27496 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:44.870480 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-fb0669b1-fbd3-4a29-bc2c-98bd6d7f44d3 req-f2eb5ca4-cf64-479c-9e13-ab03bfd27496 service nova] Creating event network-vif-deleted:9bd6c035-8037-408f-9279-b825baab8c1f for instance 82774725-1b08-411d-b760-4ed6aa3cec68 on n-h1-836830-18 Sep 14 08:59:44.876602 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-fb0669b1-fbd3-4a29-bc2c-98bd6d7f44d3 req-f2eb5ca4-cf64-479c-9e13-ab03bfd27496 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040097 Sep 14 08:59:44.880515 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1314/2566] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:59:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:59:44.980982 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a655f7fe-fd6b-43b4-99b5-d569528a5d19 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:44.981904 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-a655f7fe-fd6b-43b4-99b5-d569528a5d19 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: 82774725-1b08-411d-b760-4ed6aa3cec68] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:44.988359 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a655f7fe-fd6b-43b4-99b5-d569528a5d19 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:44.988857 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a655f7fe-fd6b-43b4-99b5-d569528a5d19 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:44.989908 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a655f7fe-fd6b-43b4-99b5-d569528a5d19 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:44.990152 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a655f7fe-fd6b-43b4-99b5-d569528a5d19 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:44.990743 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a655f7fe-fd6b-43b4-99b5-d569528a5d19 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:44.991206 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a655f7fe-fd6b-43b4-99b5-d569528a5d19 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:45.013832 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-45f63f3d-ad06-4237-b90b-6f033b8746d7 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:45.022137 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-45f63f3d-ad06-4237-b90b-6f033b8746d7 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/39890752-2382-4631-8c4a-f3c6d47c94cb" status: 200 len: 1510 microversion: 2.1 time: 0.197146 Sep 14 08:59:45.022730 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1253/2567] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:44 2022] GET /compute/v2.1/servers/39890752-2382-4631-8c4a-f3c6d47c94cb => generated 1510 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:59:45.056868 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-a655f7fe-fd6b-43b4-99b5-d569528a5d19 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:45.065647 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-a655f7fe-fd6b-43b4-99b5-d569528a5d19 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/82774725-1b08-411d-b760-4ed6aa3cec68" status: 200 len: 1467 microversion: 2.1 time: 0.089493 Sep 14 08:59:45.066221 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1315/2568] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:44 2022] GET /compute/v2.1/servers/82774725-1b08-411d-b760-4ed6aa3cec68 => generated 1467 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:59:45.193623 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ad426709-7044-47af-a4c8-2d64791c6f23 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:45.194237 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-ad426709-7044-47af-a4c8-2d64791c6f23 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: d0c5547a-1340-4d19-a0f9-3e1eb9fd1932] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:45.200822 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ad426709-7044-47af-a4c8-2d64791c6f23 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:45.201373 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ad426709-7044-47af-a4c8-2d64791c6f23 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:45.201801 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ad426709-7044-47af-a4c8-2d64791c6f23 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:45.202476 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ad426709-7044-47af-a4c8-2d64791c6f23 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:45.202923 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ad426709-7044-47af-a4c8-2d64791c6f23 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:45.203440 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ad426709-7044-47af-a4c8-2d64791c6f23 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:45.330955 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-ad426709-7044-47af-a4c8-2d64791c6f23 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9d40e54481461cba53fedb9a6abdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed2295a58f8451993a57ce0a6f9ba29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:45.338659 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-ad426709-7044-47af-a4c8-2d64791c6f23 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] 10.222.0.60 "GET /compute/v2.1/servers/d0c5547a-1340-4d19-a0f9-3e1eb9fd1932" status: 200 len: 1519 microversion: 2.1 time: 0.148996 Sep 14 08:59:45.339259 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1254/2569] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:45 2022] GET /compute/v2.1/servers/d0c5547a-1340-4d19-a0f9-3e1eb9fd1932 => generated 1519 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:59:45.543663 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-2c90d265-978a-4046-8858-e4256062b203 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:45.544818 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-2c90d265-978a-4046-8858-e4256062b203 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] [instance: eeed9e16-bc5c-4fb1-b4b9-9c9305c8da73] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:45.550862 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2c90d265-978a-4046-8858-e4256062b203 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:45.551380 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2c90d265-978a-4046-8858-e4256062b203 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:45.551817 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2c90d265-978a-4046-8858-e4256062b203 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:45.552504 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2c90d265-978a-4046-8858-e4256062b203 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:45.552989 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2c90d265-978a-4046-8858-e4256062b203 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:45.553426 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2c90d265-978a-4046-8858-e4256062b203 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:45.685043 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-2c90d265-978a-4046-8858-e4256062b203 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db65c0cfa83f48468d4a1bcef0caff73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9df06ceaa154f3c80665cc6a27b3598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:45.692830 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-2c90d265-978a-4046-8858-e4256062b203 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] 10.222.0.60 "GET /compute/v2.1/servers/eeed9e16-bc5c-4fb1-b4b9-9c9305c8da73" status: 200 len: 1324 microversion: 2.1 time: 0.153058 Sep 14 08:59:45.693411 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1316/2570] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:45 2022] GET /compute/v2.1/servers/eeed9e16-bc5c-4fb1-b4b9-9c9305c8da73 => generated 1324 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:59:45.765541 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8efe5aa6-98cb-4411-9c23-c660e6e67773 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:45.766162 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-8efe5aa6-98cb-4411-9c23-c660e6e67773 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] [instance: 9ddb5908-22a9-41c8-909c-39cdf479bdd2] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:45.772961 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8efe5aa6-98cb-4411-9c23-c660e6e67773 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:45.773449 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8efe5aa6-98cb-4411-9c23-c660e6e67773 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:45.773888 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8efe5aa6-98cb-4411-9c23-c660e6e67773 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:45.774575 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8efe5aa6-98cb-4411-9c23-c660e6e67773 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:45.775066 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8efe5aa6-98cb-4411-9c23-c660e6e67773 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:45.775494 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8efe5aa6-98cb-4411-9c23-c660e6e67773 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:45.791459 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=100 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:59:45.839970 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-8efe5aa6-98cb-4411-9c23-c660e6e67773 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc9edb486f8481a99778bdac0ef3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d168a11f24eeb861d3451e0c270cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:45.848626 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-8efe5aa6-98cb-4411-9c23-c660e6e67773 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fdc9edb486f8481a99778bdac0ef3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d168a11f24eeb861d3451e0c270cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:45.850090 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-8efe5aa6-98cb-4411-9c23-c660e6e67773 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fdc9edb486f8481a99778bdac0ef3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d168a11f24eeb861d3451e0c270cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:45.854820 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-8efe5aa6-98cb-4411-9c23-c660e6e67773 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] 10.222.0.60 "GET /compute/v2.1/servers/9ddb5908-22a9-41c8-909c-39cdf479bdd2" status: 200 len: 1447 microversion: 2.75 time: 0.093293 Sep 14 08:59:45.855453 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1255/2571] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:59:45 2022] GET /compute/v2.1/servers/9ddb5908-22a9-41c8-909c-39cdf479bdd2 => generated 1447 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:59:46.046114 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-6f23932c-a051-4bb3-8dab-75f335c96bb6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:46.046663 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-6f23932c-a051-4bb3-8dab-75f335c96bb6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 39890752-2382-4631-8c4a-f3c6d47c94cb] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:46.052750 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6f23932c-a051-4bb3-8dab-75f335c96bb6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:46.053271 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6f23932c-a051-4bb3-8dab-75f335c96bb6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:46.053712 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6f23932c-a051-4bb3-8dab-75f335c96bb6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:46.054406 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6f23932c-a051-4bb3-8dab-75f335c96bb6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:46.054867 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6f23932c-a051-4bb3-8dab-75f335c96bb6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:46.055323 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6f23932c-a051-4bb3-8dab-75f335c96bb6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:46.089036 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8a7ac97e-41e8-452a-a16c-5577f18a6110 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:46.089659 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-8a7ac97e-41e8-452a-a16c-5577f18a6110 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: 82774725-1b08-411d-b760-4ed6aa3cec68] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:46.092161 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:59:46.097581 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8a7ac97e-41e8-452a-a16c-5577f18a6110 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:46.098080 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8a7ac97e-41e8-452a-a16c-5577f18a6110 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:46.098517 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8a7ac97e-41e8-452a-a16c-5577f18a6110 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:46.099250 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8a7ac97e-41e8-452a-a16c-5577f18a6110 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:46.099709 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8a7ac97e-41e8-452a-a16c-5577f18a6110 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:46.100137 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8a7ac97e-41e8-452a-a16c-5577f18a6110 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:46.177777 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-8a7ac97e-41e8-452a-a16c-5577f18a6110 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:46.186042 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-8a7ac97e-41e8-452a-a16c-5577f18a6110 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/82774725-1b08-411d-b760-4ed6aa3cec68" status: 200 len: 1467 microversion: 2.1 time: 0.100835 Sep 14 08:59:46.186618 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1256/2572] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:46 2022] GET /compute/v2.1/servers/82774725-1b08-411d-b760-4ed6aa3cec68 => generated 1467 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:59:46.207710 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-6f23932c-a051-4bb3-8dab-75f335c96bb6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:46.215374 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-6f23932c-a051-4bb3-8dab-75f335c96bb6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/39890752-2382-4631-8c4a-f3c6d47c94cb" status: 200 len: 1510 microversion: 2.1 time: 0.173203 Sep 14 08:59:46.216564 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1317/2573] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:46 2022] GET /compute/v2.1/servers/39890752-2382-4631-8c4a-f3c6d47c94cb => generated 1510 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:59:46.361664 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-cb70479a-55ca-480c-b080-6321052b6e45 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:46.362292 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-cb70479a-55ca-480c-b080-6321052b6e45 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: d0c5547a-1340-4d19-a0f9-3e1eb9fd1932] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:46.368613 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cb70479a-55ca-480c-b080-6321052b6e45 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:46.369097 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cb70479a-55ca-480c-b080-6321052b6e45 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:46.369530 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cb70479a-55ca-480c-b080-6321052b6e45 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:46.370216 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cb70479a-55ca-480c-b080-6321052b6e45 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:46.370671 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cb70479a-55ca-480c-b080-6321052b6e45 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:46.371132 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cb70479a-55ca-480c-b080-6321052b6e45 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:46.500470 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-cb70479a-55ca-480c-b080-6321052b6e45 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9d40e54481461cba53fedb9a6abdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed2295a58f8451993a57ce0a6f9ba29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:46.508643 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-cb70479a-55ca-480c-b080-6321052b6e45 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] 10.222.0.60 "GET /compute/v2.1/servers/d0c5547a-1340-4d19-a0f9-3e1eb9fd1932" status: 200 len: 1519 microversion: 2.1 time: 0.150848 Sep 14 08:59:46.509230 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1257/2574] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:46 2022] GET /compute/v2.1/servers/d0c5547a-1340-4d19-a0f9-3e1eb9fd1932 => generated 1519 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:59:46.715535 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-9c68312b-e565-415d-baae-3695284258d7 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:46.716281 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-9c68312b-e565-415d-baae-3695284258d7 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] [instance: eeed9e16-bc5c-4fb1-b4b9-9c9305c8da73] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:46.722957 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9c68312b-e565-415d-baae-3695284258d7 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:46.723434 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9c68312b-e565-415d-baae-3695284258d7 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:46.723866 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9c68312b-e565-415d-baae-3695284258d7 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:46.724547 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9c68312b-e565-415d-baae-3695284258d7 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:46.724997 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9c68312b-e565-415d-baae-3695284258d7 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:46.725418 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9c68312b-e565-415d-baae-3695284258d7 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:46.857664 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-9c68312b-e565-415d-baae-3695284258d7 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db65c0cfa83f48468d4a1bcef0caff73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9df06ceaa154f3c80665cc6a27b3598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:46.865421 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-9c68312b-e565-415d-baae-3695284258d7 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] 10.222.0.60 "GET /compute/v2.1/servers/eeed9e16-bc5c-4fb1-b4b9-9c9305c8da73" status: 200 len: 1324 microversion: 2.1 time: 0.153766 Sep 14 08:59:46.866000 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1318/2575] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:46 2022] GET /compute/v2.1/servers/eeed9e16-bc5c-4fb1-b4b9-9c9305c8da73 => generated 1324 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:59:46.881599 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-82813e99-0c74-4d9f-bf23-68cde0144d05 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:46.882211 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-82813e99-0c74-4d9f-bf23-68cde0144d05 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] [instance: 9ddb5908-22a9-41c8-909c-39cdf479bdd2] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:46.889146 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-82813e99-0c74-4d9f-bf23-68cde0144d05 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:46.889579 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-82813e99-0c74-4d9f-bf23-68cde0144d05 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:46.890025 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-82813e99-0c74-4d9f-bf23-68cde0144d05 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:46.890722 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-82813e99-0c74-4d9f-bf23-68cde0144d05 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:46.891213 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-82813e99-0c74-4d9f-bf23-68cde0144d05 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:46.891643 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-82813e99-0c74-4d9f-bf23-68cde0144d05 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:46.958245 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-82813e99-0c74-4d9f-bf23-68cde0144d05 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc9edb486f8481a99778bdac0ef3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d168a11f24eeb861d3451e0c270cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:46.966329 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-82813e99-0c74-4d9f-bf23-68cde0144d05 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fdc9edb486f8481a99778bdac0ef3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d168a11f24eeb861d3451e0c270cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:46.967816 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-82813e99-0c74-4d9f-bf23-68cde0144d05 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fdc9edb486f8481a99778bdac0ef3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d168a11f24eeb861d3451e0c270cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:46.972803 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-82813e99-0c74-4d9f-bf23-68cde0144d05 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] 10.222.0.60 "GET /compute/v2.1/servers/9ddb5908-22a9-41c8-909c-39cdf479bdd2" status: 200 len: 1447 microversion: 2.75 time: 0.095187 Sep 14 08:59:46.973374 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1258/2576] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:59:46 2022] GET /compute/v2.1/servers/9ddb5908-22a9-41c8-909c-39cdf479bdd2 => generated 1447 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:59:47.209887 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-5528e90f-0b18-414d-81f2-21a6fc4c0e95 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:47.210410 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-5528e90f-0b18-414d-81f2-21a6fc4c0e95 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: 82774725-1b08-411d-b760-4ed6aa3cec68] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:47.217019 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5528e90f-0b18-414d-81f2-21a6fc4c0e95 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:47.217508 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5528e90f-0b18-414d-81f2-21a6fc4c0e95 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:47.217952 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5528e90f-0b18-414d-81f2-21a6fc4c0e95 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:47.218641 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5528e90f-0b18-414d-81f2-21a6fc4c0e95 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:47.219198 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5528e90f-0b18-414d-81f2-21a6fc4c0e95 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:47.219628 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5528e90f-0b18-414d-81f2-21a6fc4c0e95 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:47.239140 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-edc8e0c1-97e7-47be-a5d6-3ae1f340a6fa tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:47.239787 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-edc8e0c1-97e7-47be-a5d6-3ae1f340a6fa tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 39890752-2382-4631-8c4a-f3c6d47c94cb] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:47.245711 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-edc8e0c1-97e7-47be-a5d6-3ae1f340a6fa tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:47.246189 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-edc8e0c1-97e7-47be-a5d6-3ae1f340a6fa tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:47.246634 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-edc8e0c1-97e7-47be-a5d6-3ae1f340a6fa tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:47.247365 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-edc8e0c1-97e7-47be-a5d6-3ae1f340a6fa tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:47.247829 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-edc8e0c1-97e7-47be-a5d6-3ae1f340a6fa tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:47.248257 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-edc8e0c1-97e7-47be-a5d6-3ae1f340a6fa tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:47.281680 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-5528e90f-0b18-414d-81f2-21a6fc4c0e95 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:47.289589 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-5528e90f-0b18-414d-81f2-21a6fc4c0e95 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/82774725-1b08-411d-b760-4ed6aa3cec68" status: 200 len: 1467 microversion: 2.1 time: 0.083708 Sep 14 08:59:47.290367 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1319/2577] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:47 2022] GET /compute/v2.1/servers/82774725-1b08-411d-b760-4ed6aa3cec68 => generated 1467 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:59:47.383170 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-edc8e0c1-97e7-47be-a5d6-3ae1f340a6fa tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:47.393203 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-edc8e0c1-97e7-47be-a5d6-3ae1f340a6fa tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/39890752-2382-4631-8c4a-f3c6d47c94cb" status: 200 len: 1510 microversion: 2.1 time: 0.157800 Sep 14 08:59:47.393892 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1259/2578] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:47 2022] GET /compute/v2.1/servers/39890752-2382-4631-8c4a-f3c6d47c94cb => generated 1510 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:59:47.532835 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-edb68039-60b6-429d-aff0-a619256f5bb5 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:47.533396 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-edb68039-60b6-429d-aff0-a619256f5bb5 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: d0c5547a-1340-4d19-a0f9-3e1eb9fd1932] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:47.539292 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-edb68039-60b6-429d-aff0-a619256f5bb5 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:47.539770 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-edb68039-60b6-429d-aff0-a619256f5bb5 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:47.540198 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-edb68039-60b6-429d-aff0-a619256f5bb5 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:47.540872 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-edb68039-60b6-429d-aff0-a619256f5bb5 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:47.541318 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-edb68039-60b6-429d-aff0-a619256f5bb5 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:47.541736 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-edb68039-60b6-429d-aff0-a619256f5bb5 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:47.674402 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-edb68039-60b6-429d-aff0-a619256f5bb5 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9d40e54481461cba53fedb9a6abdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed2295a58f8451993a57ce0a6f9ba29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:47.682059 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-edb68039-60b6-429d-aff0-a619256f5bb5 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] 10.222.0.60 "GET /compute/v2.1/servers/d0c5547a-1340-4d19-a0f9-3e1eb9fd1932" status: 200 len: 1519 microversion: 2.1 time: 0.153238 Sep 14 08:59:47.682631 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1320/2579] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:47 2022] GET /compute/v2.1/servers/d0c5547a-1340-4d19-a0f9-3e1eb9fd1932 => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:59:47.889138 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d08aeaf0-3755-458c-9ebd-0b5b1224c7e2 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:47.889794 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-d08aeaf0-3755-458c-9ebd-0b5b1224c7e2 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] [instance: eeed9e16-bc5c-4fb1-b4b9-9c9305c8da73] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:47.897360 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d08aeaf0-3755-458c-9ebd-0b5b1224c7e2 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:47.897850 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d08aeaf0-3755-458c-9ebd-0b5b1224c7e2 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:47.898291 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d08aeaf0-3755-458c-9ebd-0b5b1224c7e2 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:47.899017 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d08aeaf0-3755-458c-9ebd-0b5b1224c7e2 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:47.899476 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d08aeaf0-3755-458c-9ebd-0b5b1224c7e2 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:47.899928 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d08aeaf0-3755-458c-9ebd-0b5b1224c7e2 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:48.000952 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-06cccb63-7fa2-442f-82b6-bcf50d068b56 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:48.001861 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-06cccb63-7fa2-442f-82b6-bcf50d068b56 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] [instance: 9ddb5908-22a9-41c8-909c-39cdf479bdd2] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:48.009739 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-06cccb63-7fa2-442f-82b6-bcf50d068b56 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:48.010226 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-06cccb63-7fa2-442f-82b6-bcf50d068b56 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:48.010872 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-06cccb63-7fa2-442f-82b6-bcf50d068b56 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:48.011599 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-06cccb63-7fa2-442f-82b6-bcf50d068b56 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:48.012059 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-06cccb63-7fa2-442f-82b6-bcf50d068b56 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:48.012489 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-06cccb63-7fa2-442f-82b6-bcf50d068b56 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:48.035089 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-d08aeaf0-3755-458c-9ebd-0b5b1224c7e2 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db65c0cfa83f48468d4a1bcef0caff73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9df06ceaa154f3c80665cc6a27b3598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:48.043454 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d08aeaf0-3755-458c-9ebd-0b5b1224c7e2 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] 10.222.0.60 "GET /compute/v2.1/servers/eeed9e16-bc5c-4fb1-b4b9-9c9305c8da73" status: 200 len: 1324 microversion: 2.1 time: 0.158259 Sep 14 08:59:48.060642 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1260/2580] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:47 2022] GET /compute/v2.1/servers/eeed9e16-bc5c-4fb1-b4b9-9c9305c8da73 => generated 1324 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:59:48.092398 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-06cccb63-7fa2-442f-82b6-bcf50d068b56 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc9edb486f8481a99778bdac0ef3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d168a11f24eeb861d3451e0c270cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:48.102847 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-06cccb63-7fa2-442f-82b6-bcf50d068b56 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fdc9edb486f8481a99778bdac0ef3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d168a11f24eeb861d3451e0c270cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:48.104671 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-06cccb63-7fa2-442f-82b6-bcf50d068b56 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fdc9edb486f8481a99778bdac0ef3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d168a11f24eeb861d3451e0c270cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:48.111124 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-06cccb63-7fa2-442f-82b6-bcf50d068b56 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] 10.222.0.60 "GET /compute/v2.1/servers/9ddb5908-22a9-41c8-909c-39cdf479bdd2" status: 200 len: 1447 microversion: 2.75 time: 0.113945 Sep 14 08:59:48.111712 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1321/2581] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:59:47 2022] GET /compute/v2.1/servers/9ddb5908-22a9-41c8-909c-39cdf479bdd2 => generated 1447 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 08:59:48.313310 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-538a9a1b-5b61-4018-be3c-e8212a79c612 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:48.314232 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-538a9a1b-5b61-4018-be3c-e8212a79c612 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: 82774725-1b08-411d-b760-4ed6aa3cec68] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:48.320674 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-538a9a1b-5b61-4018-be3c-e8212a79c612 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:48.321102 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-858bbf75-9558-4dee-9abc-f24f365c2cde req-3fa12f0c-9082-4606-93e5-0d1077e20d07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0c5547a-1340-4d19-a0f9-3e1eb9fd1932", "name": "network-vif-unplugged", "status": "completed", "tag": "2e224a14-f300-4cfe-a4c3-34a512adfc08"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:59:48.321608 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-538a9a1b-5b61-4018-be3c-e8212a79c612 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:48.321608 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-538a9a1b-5b61-4018-be3c-e8212a79c612 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:48.322254 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-538a9a1b-5b61-4018-be3c-e8212a79c612 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:48.322877 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-538a9a1b-5b61-4018-be3c-e8212a79c612 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:48.323327 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-538a9a1b-5b61-4018-be3c-e8212a79c612 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:48.333246 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-858bbf75-9558-4dee-9abc-f24f365c2cde req-3fa12f0c-9082-4606-93e5-0d1077e20d07 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:48.334044 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-858bbf75-9558-4dee-9abc-f24f365c2cde req-3fa12f0c-9082-4606-93e5-0d1077e20d07 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:48.334556 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-858bbf75-9558-4dee-9abc-f24f365c2cde req-3fa12f0c-9082-4606-93e5-0d1077e20d07 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:48.353432 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-858bbf75-9558-4dee-9abc-f24f365c2cde req-3fa12f0c-9082-4606-93e5-0d1077e20d07 service nova] Creating event network-vif-unplugged:2e224a14-f300-4cfe-a4c3-34a512adfc08 for instance d0c5547a-1340-4d19-a0f9-3e1eb9fd1932 on n-h1-836830-18 Sep 14 08:59:48.357551 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-538a9a1b-5b61-4018-be3c-e8212a79c612 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:48.358039 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-538a9a1b-5b61-4018-be3c-e8212a79c612 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:48.358475 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-538a9a1b-5b61-4018-be3c-e8212a79c612 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:48.358806 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-858bbf75-9558-4dee-9abc-f24f365c2cde req-3fa12f0c-9082-4606-93e5-0d1077e20d07 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043110 Sep 14 08:59:48.358930 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.objects.instance [None req-538a9a1b-5b61-4018-be3c-e8212a79c612 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lazy-loading 'fault' on Instance uuid 82774725-1b08-411d-b760-4ed6aa3cec68 {{(pid=128759) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 08:59:48.360043 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1322/2582] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:59:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:59:48.401124 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-538a9a1b-5b61-4018-be3c-e8212a79c612 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:48.409805 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-538a9a1b-5b61-4018-be3c-e8212a79c612 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/82774725-1b08-411d-b760-4ed6aa3cec68" status: 200 len: 1305 microversion: 2.1 time: 0.100597 Sep 14 08:59:48.410423 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1261/2583] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:48 2022] GET /compute/v2.1/servers/82774725-1b08-411d-b760-4ed6aa3cec68 => generated 1305 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:59:48.418091 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-bf8b9947-f146-4c7b-9ca9-133be566c60e tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:48.419233 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-bf8b9947-f146-4c7b-9ca9-133be566c60e tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 39890752-2382-4631-8c4a-f3c6d47c94cb] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:48.426000 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bf8b9947-f146-4c7b-9ca9-133be566c60e tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:48.426582 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bf8b9947-f146-4c7b-9ca9-133be566c60e tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:48.427138 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bf8b9947-f146-4c7b-9ca9-133be566c60e tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:48.427921 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bf8b9947-f146-4c7b-9ca9-133be566c60e tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:48.428522 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bf8b9947-f146-4c7b-9ca9-133be566c60e tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:48.429057 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bf8b9947-f146-4c7b-9ca9-133be566c60e tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:48.572971 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-bf8b9947-f146-4c7b-9ca9-133be566c60e tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:48.581324 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-bf8b9947-f146-4c7b-9ca9-133be566c60e tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/39890752-2382-4631-8c4a-f3c6d47c94cb" status: 200 len: 1510 microversion: 2.1 time: 0.167579 Sep 14 08:59:48.581900 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1323/2584] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:48 2022] GET /compute/v2.1/servers/39890752-2382-4631-8c4a-f3c6d47c94cb => generated 1510 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:59:48.707063 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-662c81af-9db1-48d5-a359-a943cef67bca tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:48.707602 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-662c81af-9db1-48d5-a359-a943cef67bca tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: d0c5547a-1340-4d19-a0f9-3e1eb9fd1932] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:48.713515 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-662c81af-9db1-48d5-a359-a943cef67bca tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:48.713992 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-662c81af-9db1-48d5-a359-a943cef67bca tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:48.714427 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-662c81af-9db1-48d5-a359-a943cef67bca tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:48.715130 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-662c81af-9db1-48d5-a359-a943cef67bca tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:48.715700 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-662c81af-9db1-48d5-a359-a943cef67bca tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:48.716164 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-662c81af-9db1-48d5-a359-a943cef67bca tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:48.857348 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-662c81af-9db1-48d5-a359-a943cef67bca tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9d40e54481461cba53fedb9a6abdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed2295a58f8451993a57ce0a6f9ba29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:48.865533 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-662c81af-9db1-48d5-a359-a943cef67bca tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] 10.222.0.60 "GET /compute/v2.1/servers/d0c5547a-1340-4d19-a0f9-3e1eb9fd1932" status: 200 len: 1519 microversion: 2.1 time: 0.163043 Sep 14 08:59:48.866118 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1262/2585] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:48 2022] GET /compute/v2.1/servers/d0c5547a-1340-4d19-a0f9-3e1eb9fd1932 => generated 1519 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:59:49.067422 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a0fc5c2a-2a61-42bf-8c6e-919eb2000dca tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:49.068043 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-a0fc5c2a-2a61-42bf-8c6e-919eb2000dca tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] [instance: eeed9e16-bc5c-4fb1-b4b9-9c9305c8da73] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:49.074882 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a0fc5c2a-2a61-42bf-8c6e-919eb2000dca tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:49.075430 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a0fc5c2a-2a61-42bf-8c6e-919eb2000dca tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:49.075841 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a0fc5c2a-2a61-42bf-8c6e-919eb2000dca tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:49.076536 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a0fc5c2a-2a61-42bf-8c6e-919eb2000dca tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:49.076992 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a0fc5c2a-2a61-42bf-8c6e-919eb2000dca tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:49.077426 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a0fc5c2a-2a61-42bf-8c6e-919eb2000dca tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:49.142896 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-763ab14a-902b-46f5-b3c6-f369891606b8 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:49.143984 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-763ab14a-902b-46f5-b3c6-f369891606b8 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] [instance: 9ddb5908-22a9-41c8-909c-39cdf479bdd2] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:49.151886 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-763ab14a-902b-46f5-b3c6-f369891606b8 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:49.152519 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-763ab14a-902b-46f5-b3c6-f369891606b8 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:49.153063 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-763ab14a-902b-46f5-b3c6-f369891606b8 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:49.154071 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-763ab14a-902b-46f5-b3c6-f369891606b8 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:49.154643 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-763ab14a-902b-46f5-b3c6-f369891606b8 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:49.155213 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-763ab14a-902b-46f5-b3c6-f369891606b8 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:49.231118 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-763ab14a-902b-46f5-b3c6-f369891606b8 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc9edb486f8481a99778bdac0ef3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d168a11f24eeb861d3451e0c270cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:49.239053 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-a0fc5c2a-2a61-42bf-8c6e-919eb2000dca tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db65c0cfa83f48468d4a1bcef0caff73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9df06ceaa154f3c80665cc6a27b3598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:49.240487 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-763ab14a-902b-46f5-b3c6-f369891606b8 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fdc9edb486f8481a99778bdac0ef3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d168a11f24eeb861d3451e0c270cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:49.242037 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-763ab14a-902b-46f5-b3c6-f369891606b8 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fdc9edb486f8481a99778bdac0ef3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d168a11f24eeb861d3451e0c270cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:49.247042 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-a0fc5c2a-2a61-42bf-8c6e-919eb2000dca tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] 10.222.0.60 "GET /compute/v2.1/servers/eeed9e16-bc5c-4fb1-b4b9-9c9305c8da73" status: 200 len: 1520 microversion: 2.1 time: 0.183427 Sep 14 08:59:49.247189 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-763ab14a-902b-46f5-b3c6-f369891606b8 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] 10.222.0.60 "GET /compute/v2.1/servers/9ddb5908-22a9-41c8-909c-39cdf479bdd2" status: 200 len: 1447 microversion: 2.75 time: 0.109374 Sep 14 08:59:49.248254 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1324/2586] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:49 2022] GET /compute/v2.1/servers/eeed9e16-bc5c-4fb1-b4b9-9c9305c8da73 => generated 1520 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:59:49.249435 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1263/2587] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:59:49 2022] GET /compute/v2.1/servers/9ddb5908-22a9-41c8-909c-39cdf479bdd2 => generated 1447 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 08:59:49.269648 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-9c66722a-dbde-44fe-a881-3838ad166cc2 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.9.120"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:59:49.272156 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-9c66722a-dbde-44fe-a881-3838ad166cc2 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] [instance: 2da88a50-c283-4c91-b3e1-bd4f5eb9e319] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:49.278227 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9c66722a-dbde-44fe-a881-3838ad166cc2 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:49.278741 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9c66722a-dbde-44fe-a881-3838ad166cc2 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:49.279239 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9c66722a-dbde-44fe-a881-3838ad166cc2 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:49.279923 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9c66722a-dbde-44fe-a881-3838ad166cc2 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:49.280378 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9c66722a-dbde-44fe-a881-3838ad166cc2 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:49.280894 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9c66722a-dbde-44fe-a881-3838ad166cc2 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:49.306344 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9c66722a-dbde-44fe-a881-3838ad166cc2 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Acquiring lock "refresh_cache-2da88a50-c283-4c91-b3e1-bd4f5eb9e319" {{(pid=128758) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 14 08:59:49.306681 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9c66722a-dbde-44fe-a881-3838ad166cc2 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Acquired lock "refresh_cache-2da88a50-c283-4c91-b3e1-bd4f5eb9e319" {{(pid=128758) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 14 08:59:49.433471 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-609d35f6-882f-4092-b269-4c87e3506548 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:49.434096 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-609d35f6-882f-4092-b269-4c87e3506548 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: 82774725-1b08-411d-b760-4ed6aa3cec68] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:49.440368 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-609d35f6-882f-4092-b269-4c87e3506548 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:49.440863 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-609d35f6-882f-4092-b269-4c87e3506548 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:49.441298 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-609d35f6-882f-4092-b269-4c87e3506548 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:49.441996 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-609d35f6-882f-4092-b269-4c87e3506548 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:49.442453 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-609d35f6-882f-4092-b269-4c87e3506548 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:49.442881 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-609d35f6-882f-4092-b269-4c87e3506548 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:49.456538 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-609d35f6-882f-4092-b269-4c87e3506548 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] HTTP exception thrown: Instance 82774725-1b08-411d-b760-4ed6aa3cec68 could not be found. Sep 14 08:59:49.458324 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-609d35f6-882f-4092-b269-4c87e3506548 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Request method failure captured: Sep 14 08:59:49.458324 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/82774725-1b08-411d-b760-4ed6aa3cec68 HTTP/1.1 Sep 14 08:59:49.458324 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 08:59:49.458324 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 08:59:49.458324 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 08:59:49.458324 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 08:59:49.458324 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 08:59:49.458324 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 08:59:49.458324 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 08:59:49.458324 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 08:59:49.458324 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZfruMTQYBTAiiDSnzM1mYEpmuEj9qljISQOJ4EBe2ad6zsfFzAf8FVBubQCt-Sdr-zCKCq1jxjsj_azLMK_SQWZ09VXr62FV-261vpzTW6inln_93a6hl3DeVdX6cuYwx-Go-beMey4bY4s6iPFtULEKgIbxHUgjvgK1DEFOEvCwSQ Sep 14 08:59:49.458324 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 08:59:49.458324 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 08:59:49.458324 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 08:59:49.458324 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 08:59:49.458324 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 08:59:49.458324 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 08:59:49.458324 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 4d42bf4d573b4bf9a0d8c9e73260af7e Sep 14 08:59:49.458324 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-DeleteServersTestJSON-1669995002 Sep 14 08:59:49.458324 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 08:59:49.458324 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 08:59:49.458324 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/4d42bf4d573b4bf9a0d8c9e73260af7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_4d42bf4d573b4bf9a0d8c9e73260af7e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4d42bf4d573b4bf9a0d8c9e73260af7e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4d42bf4d573b4bf9a0d8c9e73260af7e"}]}] Sep 14 08:59:49.458324 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-DeleteServersTestJSON-1669995002 Sep 14 08:59:49.458324 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 4d42bf4d573b4bf9a0d8c9e73260af7e Sep 14 08:59:49.458324 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-DeleteServersTestJSON-1669995002 Sep 14 08:59:49.458324 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-DeleteServersTestJSON-1669995002-project Sep 14 08:59:49.458324 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 08:59:49.458324 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 08:59:49.458324 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 47c95b28481b451bb03fb2c0240d0310 Sep 14 08:59:49.458324 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-DeleteServersTestJSON-1669995002-project Sep 14 08:59:49.458324 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 08:59:49.458324 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance 82774725-1b08-411d-b760-4ed6aa3cec68 could not be found. Sep 14 08:59:49.458324 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '82774725-1b08-411d-b760-4ed6aa3cec68'} Sep 14 08:59:49.458324 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:59:49.458324 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:59:49.458324 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 08:59:49.458324 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 08:59:49.458324 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 08:59:49.458324 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 08:59:49.458324 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 08:59:49.458324 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 08:59:49.458324 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 08:59:49.458324 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 08:59:49.458324 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82774725-1b08-411d-b760-4ed6aa3cec68 could not be found. Sep 14 08:59:49.458324 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:59:49.458324 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:59:49.458324 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:59:49.458324 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:59:49.458324 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:59:49.458324 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:59:49.458324 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:59:49.458324 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:59:49.458324 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:59:49.458324 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:59:49.458324 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 08:59:49.458324 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 08:59:49.458324 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 08:59:49.458324 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 08:59:49.458324 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 08:59:49.458324 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 08:59:49.458324 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82774725-1b08-411d-b760-4ed6aa3cec68 could not be found. Sep 14 08:59:49.458324 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:59:49.458324 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:59:49.458324 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:59:49.463131 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:59:49.463131 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:59:49.463131 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:59:49.463131 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:59:49.463131 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:59:49.463131 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82774725-1b08-411d-b760-4ed6aa3cec68 could not be found. Sep 14 08:59:49.463131 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:59:49.463131 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-609d35f6-882f-4092-b269-4c87e3506548 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Returning 404 to user: Instance 82774725-1b08-411d-b760-4ed6aa3cec68 could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:59:49.463131 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-609d35f6-882f-4092-b269-4c87e3506548 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/82774725-1b08-411d-b760-4ed6aa3cec68" status: 404 len: 111 microversion: 2.1 time: 0.030235 Sep 14 08:59:49.463131 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1264/2588] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:49 2022] GET /compute/v2.1/servers/82774725-1b08-411d-b760-4ed6aa3cec68 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 14 08:59:49.561850 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-6c4775bd-7856-4a47-8b2d-4b30d4c5446e tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1674087208", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "networks": [{"uuid": "b9ab2062-a108-4d91-8f37-c911ce062678"}]}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:59:49.617177 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.network.neutron [None req-6c4775bd-7856-4a47-8b2d-4b30d4c5446e tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] validate_networks() for [('b9ab2062-a108-4d91-8f37-c911ce062678', None, None, None, None, None)] {{(pid=128759) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 08:59:50.620873 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-6c4775bd-7856-4a47-8b2d-4b30d4c5446e tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Flavor limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 08:59:50.621463 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-6c4775bd-7856-4a47-8b2d-4b30d4c5446e tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Image limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 08:59:50.621929 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-6c4775bd-7856-4a47-8b2d-4b30d4c5446e tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Flavor pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 08:59:50.622918 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-6c4775bd-7856-4a47-8b2d-4b30d4c5446e tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Image pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 08:59:50.623496 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-6c4775bd-7856-4a47-8b2d-4b30d4c5446e tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 08:59:50.632294 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6c4775bd-7856-4a47-8b2d-4b30d4c5446e tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:50.632777 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6c4775bd-7856-4a47-8b2d-4b30d4c5446e tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:50.633249 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6c4775bd-7856-4a47-8b2d-4b30d4c5446e tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:50.633976 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6c4775bd-7856-4a47-8b2d-4b30d4c5446e tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:50.634431 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6c4775bd-7856-4a47-8b2d-4b30d4c5446e tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:50.634853 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6c4775bd-7856-4a47-8b2d-4b30d4c5446e tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:50.651262 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-6c4775bd-7856-4a47-8b2d-4b30d4c5446e tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Getting quotas for project 4d42bf4d573b4bf9a0d8c9e73260af7e. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 08:59:50.657654 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-6c4775bd-7856-4a47-8b2d-4b30d4c5446e tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Getting quotas for user 47c95b28481b451bb03fb2c0240d0310 and project 4d42bf4d573b4bf9a0d8c9e73260af7e. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 08:59:50.670546 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-6c4775bd-7856-4a47-8b2d-4b30d4c5446e tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Going to run 1 instances... {{(pid=128759) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 08:59:50.672766 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-6c4775bd-7856-4a47-8b2d-4b30d4c5446e tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: ef2a3ebb-090f-484c-9749-42c000375ec5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128759) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 08:59:50.722654 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-6c4775bd-7856-4a47-8b2d-4b30d4c5446e tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.167835 Sep 14 08:59:50.723664 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1265/2589] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 08:59:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1169 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 14 08:59:50.728146 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f3de7489-14be-4e97-8e2e-1aef1642c8b6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:50.728764 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f3de7489-14be-4e97-8e2e-1aef1642c8b6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 39890752-2382-4631-8c4a-f3c6d47c94cb] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:50.735655 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f3de7489-14be-4e97-8e2e-1aef1642c8b6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:50.736152 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f3de7489-14be-4e97-8e2e-1aef1642c8b6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:50.736594 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f3de7489-14be-4e97-8e2e-1aef1642c8b6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:50.737295 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f3de7489-14be-4e97-8e2e-1aef1642c8b6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:50.737748 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f3de7489-14be-4e97-8e2e-1aef1642c8b6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:50.738171 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f3de7489-14be-4e97-8e2e-1aef1642c8b6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:50.973956 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f3de7489-14be-4e97-8e2e-1aef1642c8b6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:50.989595 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f3de7489-14be-4e97-8e2e-1aef1642c8b6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/39890752-2382-4631-8c4a-f3c6d47c94cb" status: 200 len: 1510 microversion: 2.1 time: 0.264686 Sep 14 08:59:50.991613 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1266/2590] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:50 2022] GET /compute/v2.1/servers/39890752-2382-4631-8c4a-f3c6d47c94cb => generated 1510 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:59:50.998169 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-18d98d8c-5a79-4146-880d-8c1ddc2e55f0 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:50.999226 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-18d98d8c-5a79-4146-880d-8c1ddc2e55f0 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: d0c5547a-1340-4d19-a0f9-3e1eb9fd1932] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:51.007761 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-18d98d8c-5a79-4146-880d-8c1ddc2e55f0 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:51.008615 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-18d98d8c-5a79-4146-880d-8c1ddc2e55f0 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:51.009388 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-18d98d8c-5a79-4146-880d-8c1ddc2e55f0 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:51.010672 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-18d98d8c-5a79-4146-880d-8c1ddc2e55f0 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:51.011382 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-18d98d8c-5a79-4146-880d-8c1ddc2e55f0 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:51.011975 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-18d98d8c-5a79-4146-880d-8c1ddc2e55f0 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:51.021693 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.network.neutron [None req-9c66722a-dbde-44fe-a881-3838ad166cc2 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] [instance: 2da88a50-c283-4c91-b3e1-bd4f5eb9e319] Building network info cache for instance {{(pid=128758) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 14 08:59:51.302956 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-18d98d8c-5a79-4146-880d-8c1ddc2e55f0 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9d40e54481461cba53fedb9a6abdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed2295a58f8451993a57ce0a6f9ba29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:51.311331 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-18d98d8c-5a79-4146-880d-8c1ddc2e55f0 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] 10.222.0.60 "GET /compute/v2.1/servers/d0c5547a-1340-4d19-a0f9-3e1eb9fd1932" status: 200 len: 1519 microversion: 2.1 time: 0.317721 Sep 14 08:59:51.312226 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1267/2591] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:50 2022] GET /compute/v2.1/servers/d0c5547a-1340-4d19-a0f9-3e1eb9fd1932 => generated 1519 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:59:51.317014 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ac36d2be-5d27-4088-b57a-599162831fb6 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:51.317729 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-ac36d2be-5d27-4088-b57a-599162831fb6 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] [instance: 9ddb5908-22a9-41c8-909c-39cdf479bdd2] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:51.324022 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ac36d2be-5d27-4088-b57a-599162831fb6 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:51.324672 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ac36d2be-5d27-4088-b57a-599162831fb6 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:51.325938 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ac36d2be-5d27-4088-b57a-599162831fb6 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:51.326921 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ac36d2be-5d27-4088-b57a-599162831fb6 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:51.327649 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ac36d2be-5d27-4088-b57a-599162831fb6 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:51.328271 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ac36d2be-5d27-4088-b57a-599162831fb6 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:51.416185 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-ac36d2be-5d27-4088-b57a-599162831fb6 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc9edb486f8481a99778bdac0ef3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d168a11f24eeb861d3451e0c270cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:51.425723 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-ac36d2be-5d27-4088-b57a-599162831fb6 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fdc9edb486f8481a99778bdac0ef3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d168a11f24eeb861d3451e0c270cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:51.427343 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-ac36d2be-5d27-4088-b57a-599162831fb6 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fdc9edb486f8481a99778bdac0ef3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d168a11f24eeb861d3451e0c270cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:51.437081 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-ac36d2be-5d27-4088-b57a-599162831fb6 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] 10.222.0.60 "GET /compute/v2.1/servers/9ddb5908-22a9-41c8-909c-39cdf479bdd2" status: 200 len: 1447 microversion: 2.75 time: 0.123775 Sep 14 08:59:51.438157 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1268/2592] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:59:51 2022] GET /compute/v2.1/servers/9ddb5908-22a9-41c8-909c-39cdf479bdd2 => generated 1447 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:59:51.443559 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-85377993-a236-42ab-82a6-e5db3926be92 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:51.444337 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-85377993-a236-42ab-82a6-e5db3926be92 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: ef2a3ebb-090f-484c-9749-42c000375ec5] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:51.461486 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-85377993-a236-42ab-82a6-e5db3926be92 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:51.462105 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-85377993-a236-42ab-82a6-e5db3926be92 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:51.462600 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-85377993-a236-42ab-82a6-e5db3926be92 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:51.463448 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-85377993-a236-42ab-82a6-e5db3926be92 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:51.464046 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-85377993-a236-42ab-82a6-e5db3926be92 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:51.464570 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-85377993-a236-42ab-82a6-e5db3926be92 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:51.564288 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-85377993-a236-42ab-82a6-e5db3926be92 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:51.578191 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-85377993-a236-42ab-82a6-e5db3926be92 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/ef2a3ebb-090f-484c-9749-42c000375ec5" status: 200 len: 1211 microversion: 2.1 time: 0.137804 Sep 14 08:59:51.579528 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1269/2593] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:51 2022] GET /compute/v2.1/servers/ef2a3ebb-090f-484c-9749-42c000375ec5 => generated 1211 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:59:51.586850 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-3f76ae72-000f-42bb-ae5a-af1222ae1bbb req-30f15c65-5838-47af-98ce-974b1cca353a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2da88a50-c283-4c91-b3e1-bd4f5eb9e319", "tag": "0e0d5077-876f-4296-b015-ba13bb73c465"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:59:51.613058 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-3f76ae72-000f-42bb-ae5a-af1222ae1bbb req-30f15c65-5838-47af-98ce-974b1cca353a service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:51.613836 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-3f76ae72-000f-42bb-ae5a-af1222ae1bbb req-30f15c65-5838-47af-98ce-974b1cca353a service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:51.614502 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-3f76ae72-000f-42bb-ae5a-af1222ae1bbb req-30f15c65-5838-47af-98ce-974b1cca353a service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:51.628513 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-3f76ae72-000f-42bb-ae5a-af1222ae1bbb req-30f15c65-5838-47af-98ce-974b1cca353a service nova] Creating event network-changed:0e0d5077-876f-4296-b015-ba13bb73c465 for instance 2da88a50-c283-4c91-b3e1-bd4f5eb9e319 on n-h2-836830-18 Sep 14 08:59:51.635048 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-3f76ae72-000f-42bb-ae5a-af1222ae1bbb req-30f15c65-5838-47af-98ce-974b1cca353a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053453 Sep 14 08:59:51.635921 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1270/2594] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:59:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:59:51.645650 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-abfbd212-d35a-46be-aae6-4b7ea514d490 req-19af294c-501b-4c48-bc15-1a13c99d3d85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0c5547a-1340-4d19-a0f9-3e1eb9fd1932", "name": "network-vif-plugged", "status": "completed", "tag": "2e224a14-f300-4cfe-a4c3-34a512adfc08"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:59:51.659555 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-abfbd212-d35a-46be-aae6-4b7ea514d490 req-19af294c-501b-4c48-bc15-1a13c99d3d85 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:51.660294 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-abfbd212-d35a-46be-aae6-4b7ea514d490 req-19af294c-501b-4c48-bc15-1a13c99d3d85 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:51.661035 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-abfbd212-d35a-46be-aae6-4b7ea514d490 req-19af294c-501b-4c48-bc15-1a13c99d3d85 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:51.680970 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-abfbd212-d35a-46be-aae6-4b7ea514d490 req-19af294c-501b-4c48-bc15-1a13c99d3d85 service nova] Creating event network-vif-plugged:2e224a14-f300-4cfe-a4c3-34a512adfc08 for instance d0c5547a-1340-4d19-a0f9-3e1eb9fd1932 on n-h1-836830-18 Sep 14 08:59:51.689366 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-abfbd212-d35a-46be-aae6-4b7ea514d490 req-19af294c-501b-4c48-bc15-1a13c99d3d85 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050750 Sep 14 08:59:51.691105 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1271/2595] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:59:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:59:51.706336 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-6d0a2bb0-5c6b-4f9f-8c26-a19ba3991793 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:51.708063 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-6d0a2bb0-5c6b-4f9f-8c26-a19ba3991793 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] [instance: 26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:51.716977 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6d0a2bb0-5c6b-4f9f-8c26-a19ba3991793 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:51.717731 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6d0a2bb0-5c6b-4f9f-8c26-a19ba3991793 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:51.718663 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6d0a2bb0-5c6b-4f9f-8c26-a19ba3991793 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:51.719963 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6d0a2bb0-5c6b-4f9f-8c26-a19ba3991793 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:51.720543 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6d0a2bb0-5c6b-4f9f-8c26-a19ba3991793 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:51.721113 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6d0a2bb0-5c6b-4f9f-8c26-a19ba3991793 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:51.853006 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.network.neutron [None req-9c66722a-dbde-44fe-a881-3838ad166cc2 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] [instance: 2da88a50-c283-4c91-b3e1-bd4f5eb9e319] Updating instance_info_cache with network_info: [{"id": "0e0d5077-876f-4296-b015-ba13bb73c465", "address": "fa:16:3e:c3:7e:b5", "network": {"id": "bb99f4a1-78ca-499c-bb3f-fa3732e743f4", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1051231467-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.9.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "d9df06ceaa154f3c80665cc6a27b3598", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap0e0d5077-87", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128758) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 14 08:59:51.893675 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9c66722a-dbde-44fe-a881-3838ad166cc2 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Releasing lock "refresh_cache-2da88a50-c283-4c91-b3e1-bd4f5eb9e319" {{(pid=128758) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 14 08:59:51.898334 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-9c66722a-dbde-44fe-a881-3838ad166cc2 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] 10.222.0.60 "POST /compute/v2.1/servers/2da88a50-c283-4c91-b3e1-bd4f5eb9e319/action" status: 202 len: 0 microversion: 2.1 time: 2.628865 Sep 14 08:59:51.898334 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1325/2596] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 08:59:49 2022] POST /compute/v2.1/servers/2da88a50-c283-4c91-b3e1-bd4f5eb9e319/action => generated 0 bytes in 2631 msecs (HTTP/1.1 202) 9 headers in 369 bytes (2 switches on core 0) Sep 14 08:59:51.913868 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-facad598-9cab-4aaa-a581-bf1b7864c056 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.9.120"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:59:51.919950 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-facad598-9cab-4aaa-a581-bf1b7864c056 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] [instance: eeed9e16-bc5c-4fb1-b4b9-9c9305c8da73] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:51.933299 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-facad598-9cab-4aaa-a581-bf1b7864c056 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:51.934292 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-facad598-9cab-4aaa-a581-bf1b7864c056 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:51.935755 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-facad598-9cab-4aaa-a581-bf1b7864c056 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:51.937207 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-facad598-9cab-4aaa-a581-bf1b7864c056 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:51.939775 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-facad598-9cab-4aaa-a581-bf1b7864c056 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:51.940793 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-facad598-9cab-4aaa-a581-bf1b7864c056 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:51.981557 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-facad598-9cab-4aaa-a581-bf1b7864c056 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Acquiring lock "refresh_cache-eeed9e16-bc5c-4fb1-b4b9-9c9305c8da73" {{(pid=128758) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 14 08:59:51.982581 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-facad598-9cab-4aaa-a581-bf1b7864c056 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Acquired lock "refresh_cache-eeed9e16-bc5c-4fb1-b4b9-9c9305c8da73" {{(pid=128758) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 14 08:59:52.123454 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-6d0a2bb0-5c6b-4f9f-8c26-a19ba3991793 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:52.135041 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-6d0a2bb0-5c6b-4f9f-8c26-a19ba3991793 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:52.136517 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-6d0a2bb0-5c6b-4f9f-8c26-a19ba3991793 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:52.137825 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-6d0a2bb0-5c6b-4f9f-8c26-a19ba3991793 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] 10.222.0.60 "GET /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0" status: 200 len: 2950 microversion: 2.32 time: 0.444083 Sep 14 08:59:52.138398 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1272/2597] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:59:51 2022] GET /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0 => generated 2950 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:59:52.143845 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-01f5dd76-ef48-4ce4-aa2d-1cd6e87c1b13 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:52.144715 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-01f5dd76-ef48-4ce4-aa2d-1cd6e87c1b13 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 39890752-2382-4631-8c4a-f3c6d47c94cb] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:52.158507 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-01f5dd76-ef48-4ce4-aa2d-1cd6e87c1b13 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:52.159022 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-01f5dd76-ef48-4ce4-aa2d-1cd6e87c1b13 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:52.159900 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-01f5dd76-ef48-4ce4-aa2d-1cd6e87c1b13 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:52.160619 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-01f5dd76-ef48-4ce4-aa2d-1cd6e87c1b13 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:52.161073 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-01f5dd76-ef48-4ce4-aa2d-1cd6e87c1b13 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:52.161497 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-01f5dd76-ef48-4ce4-aa2d-1cd6e87c1b13 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:52.625245 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-01f5dd76-ef48-4ce4-aa2d-1cd6e87c1b13 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:52.634081 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-01f5dd76-ef48-4ce4-aa2d-1cd6e87c1b13 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/39890752-2382-4631-8c4a-f3c6d47c94cb" status: 200 len: 1510 microversion: 2.1 time: 0.494667 Sep 14 08:59:52.636953 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1273/2598] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:52 2022] GET /compute/v2.1/servers/39890752-2382-4631-8c4a-f3c6d47c94cb => generated 1510 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:59:52.642126 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ba364660-5b43-4a35-8883-43440fbf69d2 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:52.642696 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-ba364660-5b43-4a35-8883-43440fbf69d2 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] [instance: 26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:52.649324 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ba364660-5b43-4a35-8883-43440fbf69d2 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:52.650170 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ba364660-5b43-4a35-8883-43440fbf69d2 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:52.650784 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ba364660-5b43-4a35-8883-43440fbf69d2 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:52.651601 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ba364660-5b43-4a35-8883-43440fbf69d2 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:52.652156 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ba364660-5b43-4a35-8883-43440fbf69d2 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:52.652650 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ba364660-5b43-4a35-8883-43440fbf69d2 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:52.668094 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=100 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:59:52.829691 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-ba364660-5b43-4a35-8883-43440fbf69d2 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] 10.222.0.60 "GET /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0/os-interface" status: 200 len: 1831 microversion: 2.32 time: 0.191336 Sep 14 08:59:52.830309 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1274/2599] 10.222.0.60 () {60 vars in 1316 bytes} [Wed Sep 14 08:59:52 2022] GET /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0/os-interface => generated 1831 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:59:52.835338 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f1e8c14e-5a42-4ba3-b2ba-7eb1c518a243 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:52.835952 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f1e8c14e-5a42-4ba3-b2ba-7eb1c518a243 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: d0c5547a-1340-4d19-a0f9-3e1eb9fd1932] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:52.842674 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f1e8c14e-5a42-4ba3-b2ba-7eb1c518a243 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:52.843195 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f1e8c14e-5a42-4ba3-b2ba-7eb1c518a243 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:52.843632 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f1e8c14e-5a42-4ba3-b2ba-7eb1c518a243 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:52.844335 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f1e8c14e-5a42-4ba3-b2ba-7eb1c518a243 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:52.845049 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f1e8c14e-5a42-4ba3-b2ba-7eb1c518a243 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:52.845481 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f1e8c14e-5a42-4ba3-b2ba-7eb1c518a243 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:53.112716 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f1e8c14e-5a42-4ba3-b2ba-7eb1c518a243 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9d40e54481461cba53fedb9a6abdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed2295a58f8451993a57ce0a6f9ba29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:53.120387 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f1e8c14e-5a42-4ba3-b2ba-7eb1c518a243 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] 10.222.0.60 "GET /compute/v2.1/servers/d0c5547a-1340-4d19-a0f9-3e1eb9fd1932" status: 200 len: 1519 microversion: 2.1 time: 0.289121 Sep 14 08:59:53.121090 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1275/2600] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:52 2022] GET /compute/v2.1/servers/d0c5547a-1340-4d19-a0f9-3e1eb9fd1932 => generated 1519 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:59:53.125991 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-00a1f496-fb82-4237-a2cb-0239c63afc7e tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:53.126696 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-00a1f496-fb82-4237-a2cb-0239c63afc7e tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] [instance: 9ddb5908-22a9-41c8-909c-39cdf479bdd2] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:53.132868 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-00a1f496-fb82-4237-a2cb-0239c63afc7e tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:53.133389 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-00a1f496-fb82-4237-a2cb-0239c63afc7e tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:53.133834 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-00a1f496-fb82-4237-a2cb-0239c63afc7e tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:53.134978 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-00a1f496-fb82-4237-a2cb-0239c63afc7e tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:53.135096 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-00a1f496-fb82-4237-a2cb-0239c63afc7e tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:53.135469 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-00a1f496-fb82-4237-a2cb-0239c63afc7e tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:53.224109 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-00a1f496-fb82-4237-a2cb-0239c63afc7e tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc9edb486f8481a99778bdac0ef3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d168a11f24eeb861d3451e0c270cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:53.232308 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-00a1f496-fb82-4237-a2cb-0239c63afc7e tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fdc9edb486f8481a99778bdac0ef3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d168a11f24eeb861d3451e0c270cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:53.233784 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-00a1f496-fb82-4237-a2cb-0239c63afc7e tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fdc9edb486f8481a99778bdac0ef3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d168a11f24eeb861d3451e0c270cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:53.238912 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-00a1f496-fb82-4237-a2cb-0239c63afc7e tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] 10.222.0.60 "GET /compute/v2.1/servers/9ddb5908-22a9-41c8-909c-39cdf479bdd2" status: 200 len: 1447 microversion: 2.75 time: 0.116980 Sep 14 08:59:53.239519 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1276/2601] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:59:53 2022] GET /compute/v2.1/servers/9ddb5908-22a9-41c8-909c-39cdf479bdd2 => generated 1447 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:59:53.244017 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-79b92e44-2076-49e3-9eac-839abc5c63f9 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:53.244638 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-79b92e44-2076-49e3-9eac-839abc5c63f9 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: ef2a3ebb-090f-484c-9749-42c000375ec5] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:53.251478 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-79b92e44-2076-49e3-9eac-839abc5c63f9 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:53.252003 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-79b92e44-2076-49e3-9eac-839abc5c63f9 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:53.252450 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-79b92e44-2076-49e3-9eac-839abc5c63f9 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:53.253166 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-79b92e44-2076-49e3-9eac-839abc5c63f9 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:53.253621 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-79b92e44-2076-49e3-9eac-839abc5c63f9 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:53.254316 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-79b92e44-2076-49e3-9eac-839abc5c63f9 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:53.327021 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-79b92e44-2076-49e3-9eac-839abc5c63f9 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:53.335451 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-79b92e44-2076-49e3-9eac-839abc5c63f9 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/ef2a3ebb-090f-484c-9749-42c000375ec5" status: 200 len: 1273 microversion: 2.1 time: 0.094901 Sep 14 08:59:53.336042 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1277/2602] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:53 2022] GET /compute/v2.1/servers/ef2a3ebb-090f-484c-9749-42c000375ec5 => generated 1273 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:59:53.658734 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d3dd233f-92de-4d40-8e31-a2996214c6af tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:53.660178 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-d3dd233f-92de-4d40-8e31-a2996214c6af tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 39890752-2382-4631-8c4a-f3c6d47c94cb] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:53.667392 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d3dd233f-92de-4d40-8e31-a2996214c6af tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:53.667893 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d3dd233f-92de-4d40-8e31-a2996214c6af tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:53.668332 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d3dd233f-92de-4d40-8e31-a2996214c6af tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:53.669048 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d3dd233f-92de-4d40-8e31-a2996214c6af tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:53.669507 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d3dd233f-92de-4d40-8e31-a2996214c6af tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:53.670583 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d3dd233f-92de-4d40-8e31-a2996214c6af tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:54.214185 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-d3dd233f-92de-4d40-8e31-a2996214c6af tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:54.223324 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d3dd233f-92de-4d40-8e31-a2996214c6af tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/39890752-2382-4631-8c4a-f3c6d47c94cb" status: 200 len: 1510 microversion: 2.1 time: 0.569451 Sep 14 08:59:54.224142 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1278/2603] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:53 2022] GET /compute/v2.1/servers/39890752-2382-4631-8c4a-f3c6d47c94cb => generated 1510 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:59:54.228790 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-163574ca-f5aa-4c6c-b68d-fd975cdcba43 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:54.229523 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-163574ca-f5aa-4c6c-b68d-fd975cdcba43 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: d0c5547a-1340-4d19-a0f9-3e1eb9fd1932] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:54.236827 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-163574ca-f5aa-4c6c-b68d-fd975cdcba43 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:54.237672 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-163574ca-f5aa-4c6c-b68d-fd975cdcba43 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:54.238397 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-163574ca-f5aa-4c6c-b68d-fd975cdcba43 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:54.239228 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-163574ca-f5aa-4c6c-b68d-fd975cdcba43 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:54.240043 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-163574ca-f5aa-4c6c-b68d-fd975cdcba43 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:54.240642 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-163574ca-f5aa-4c6c-b68d-fd975cdcba43 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:54.608851 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-163574ca-f5aa-4c6c-b68d-fd975cdcba43 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9d40e54481461cba53fedb9a6abdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed2295a58f8451993a57ce0a6f9ba29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:54.616799 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-163574ca-f5aa-4c6c-b68d-fd975cdcba43 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] 10.222.0.60 "GET /compute/v2.1/servers/d0c5547a-1340-4d19-a0f9-3e1eb9fd1932" status: 200 len: 1504 microversion: 2.1 time: 0.391561 Sep 14 08:59:54.617383 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1279/2604] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:54 2022] GET /compute/v2.1/servers/d0c5547a-1340-4d19-a0f9-3e1eb9fd1932 => generated 1504 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:59:54.621906 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-0835d6e5-0f7c-4f33-9328-3679bbeb0ce5 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:54.623219 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-0835d6e5-0f7c-4f33-9328-3679bbeb0ce5 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] [instance: 9ddb5908-22a9-41c8-909c-39cdf479bdd2] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:54.629292 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0835d6e5-0f7c-4f33-9328-3679bbeb0ce5 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:54.629764 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0835d6e5-0f7c-4f33-9328-3679bbeb0ce5 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:54.630195 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0835d6e5-0f7c-4f33-9328-3679bbeb0ce5 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:54.630907 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0835d6e5-0f7c-4f33-9328-3679bbeb0ce5 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:54.631388 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0835d6e5-0f7c-4f33-9328-3679bbeb0ce5 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:54.631835 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0835d6e5-0f7c-4f33-9328-3679bbeb0ce5 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:54.756896 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-0835d6e5-0f7c-4f33-9328-3679bbeb0ce5 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc9edb486f8481a99778bdac0ef3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d168a11f24eeb861d3451e0c270cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:54.766328 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-0835d6e5-0f7c-4f33-9328-3679bbeb0ce5 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fdc9edb486f8481a99778bdac0ef3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d168a11f24eeb861d3451e0c270cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:54.768542 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-0835d6e5-0f7c-4f33-9328-3679bbeb0ce5 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fdc9edb486f8481a99778bdac0ef3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d168a11f24eeb861d3451e0c270cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:54.773986 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-0835d6e5-0f7c-4f33-9328-3679bbeb0ce5 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] 10.222.0.60 "GET /compute/v2.1/servers/9ddb5908-22a9-41c8-909c-39cdf479bdd2" status: 200 len: 1447 microversion: 2.75 time: 0.155632 Sep 14 08:59:54.788976 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1280/2605] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:59:54 2022] GET /compute/v2.1/servers/9ddb5908-22a9-41c8-909c-39cdf479bdd2 => generated 1447 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:59:54.788976 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-0383cbfb-75b5-4692-9d75-6e15e35f2b9d tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:54.788976 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-0383cbfb-75b5-4692-9d75-6e15e35f2b9d tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: ef2a3ebb-090f-484c-9749-42c000375ec5] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:54.788976 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0383cbfb-75b5-4692-9d75-6e15e35f2b9d tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:54.788976 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0383cbfb-75b5-4692-9d75-6e15e35f2b9d tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:54.788976 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0383cbfb-75b5-4692-9d75-6e15e35f2b9d tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:54.788976 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0383cbfb-75b5-4692-9d75-6e15e35f2b9d tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:54.788976 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0383cbfb-75b5-4692-9d75-6e15e35f2b9d tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:54.788976 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0383cbfb-75b5-4692-9d75-6e15e35f2b9d tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:55.114048 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-0383cbfb-75b5-4692-9d75-6e15e35f2b9d tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:55.122201 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-0383cbfb-75b5-4692-9d75-6e15e35f2b9d tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/ef2a3ebb-090f-484c-9749-42c000375ec5" status: 200 len: 1315 microversion: 2.1 time: 0.346606 Sep 14 08:59:55.129091 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1281/2606] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:54 2022] GET /compute/v2.1/servers/ef2a3ebb-090f-484c-9749-42c000375ec5 => generated 1315 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:59:55.129091 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b6482828-951a-45ee-9fc8-932a4e18eb04 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:55.129091 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b6482828-951a-45ee-9fc8-932a4e18eb04 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: d0c5547a-1340-4d19-a0f9-3e1eb9fd1932] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:55.135051 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b6482828-951a-45ee-9fc8-932a4e18eb04 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:55.135545 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b6482828-951a-45ee-9fc8-932a4e18eb04 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:55.136010 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b6482828-951a-45ee-9fc8-932a4e18eb04 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:55.136697 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b6482828-951a-45ee-9fc8-932a4e18eb04 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:55.137147 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b6482828-951a-45ee-9fc8-932a4e18eb04 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:55.137565 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b6482828-951a-45ee-9fc8-932a4e18eb04 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:55.501944 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b6482828-951a-45ee-9fc8-932a4e18eb04 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9d40e54481461cba53fedb9a6abdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed2295a58f8451993a57ce0a6f9ba29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:55.511382 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b6482828-951a-45ee-9fc8-932a4e18eb04 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] 10.222.0.60 "GET /compute/v2.1/servers/d0c5547a-1340-4d19-a0f9-3e1eb9fd1932" status: 200 len: 1504 microversion: 2.1 time: 0.387341 Sep 14 08:59:55.512716 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1282/2607] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:55 2022] GET /compute/v2.1/servers/d0c5547a-1340-4d19-a0f9-3e1eb9fd1932 => generated 1504 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:59:55.518799 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-abce77f1-2382-4e49-878c-c22edd2b8645 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:55.519762 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-abce77f1-2382-4e49-878c-c22edd2b8645 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 39890752-2382-4631-8c4a-f3c6d47c94cb] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:55.526583 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-abce77f1-2382-4e49-878c-c22edd2b8645 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:55.527352 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-abce77f1-2382-4e49-878c-c22edd2b8645 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:55.528004 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-abce77f1-2382-4e49-878c-c22edd2b8645 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:55.528881 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-abce77f1-2382-4e49-878c-c22edd2b8645 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:55.529680 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-abce77f1-2382-4e49-878c-c22edd2b8645 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:55.530267 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-abce77f1-2382-4e49-878c-c22edd2b8645 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:55.860687 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-abce77f1-2382-4e49-878c-c22edd2b8645 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:55.868286 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-abce77f1-2382-4e49-878c-c22edd2b8645 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/39890752-2382-4631-8c4a-f3c6d47c94cb" status: 200 len: 1510 microversion: 2.1 time: 0.353707 Sep 14 08:59:55.869219 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1283/2608] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:55 2022] GET /compute/v2.1/servers/39890752-2382-4631-8c4a-f3c6d47c94cb => generated 1510 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:59:55.874462 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-4f9d5c33-9113-458d-a6b5-cc291916cbca tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:55.874974 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-4f9d5c33-9113-458d-a6b5-cc291916cbca tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: d0c5547a-1340-4d19-a0f9-3e1eb9fd1932] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:55.884152 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4f9d5c33-9113-458d-a6b5-cc291916cbca tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:55.884642 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4f9d5c33-9113-458d-a6b5-cc291916cbca tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:55.885078 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4f9d5c33-9113-458d-a6b5-cc291916cbca tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:55.885769 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4f9d5c33-9113-458d-a6b5-cc291916cbca tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:55.886226 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4f9d5c33-9113-458d-a6b5-cc291916cbca tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:55.886649 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4f9d5c33-9113-458d-a6b5-cc291916cbca tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:55.923462 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-4f9d5c33-9113-458d-a6b5-cc291916cbca tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: d0c5547a-1340-4d19-a0f9-3e1eb9fd1932] Going to try to terminate instance {{(pid=128759) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 08:59:56.023165 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-4f9d5c33-9113-458d-a6b5-cc291916cbca tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] 10.222.0.60 "DELETE /compute/v2.1/servers/d0c5547a-1340-4d19-a0f9-3e1eb9fd1932" status: 204 len: 0 microversion: 2.1 time: 0.152154 Sep 14 08:59:56.027371 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1284/2609] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 08:59:55 2022] DELETE /compute/v2.1/servers/d0c5547a-1340-4d19-a0f9-3e1eb9fd1932 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 08:59:56.043228 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a7e1af5a-06ec-4a50-8211-de756b6bf8ab tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:56.043840 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-a7e1af5a-06ec-4a50-8211-de756b6bf8ab tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] [instance: 9ddb5908-22a9-41c8-909c-39cdf479bdd2] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:56.050830 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a7e1af5a-06ec-4a50-8211-de756b6bf8ab tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:56.051453 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a7e1af5a-06ec-4a50-8211-de756b6bf8ab tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:56.051918 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a7e1af5a-06ec-4a50-8211-de756b6bf8ab tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:56.052628 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a7e1af5a-06ec-4a50-8211-de756b6bf8ab tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:56.053086 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a7e1af5a-06ec-4a50-8211-de756b6bf8ab tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:56.053509 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a7e1af5a-06ec-4a50-8211-de756b6bf8ab tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:56.187102 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-a7e1af5a-06ec-4a50-8211-de756b6bf8ab tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc9edb486f8481a99778bdac0ef3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d168a11f24eeb861d3451e0c270cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:56.202144 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-a7e1af5a-06ec-4a50-8211-de756b6bf8ab tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fdc9edb486f8481a99778bdac0ef3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d168a11f24eeb861d3451e0c270cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:56.203891 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-a7e1af5a-06ec-4a50-8211-de756b6bf8ab tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fdc9edb486f8481a99778bdac0ef3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d168a11f24eeb861d3451e0c270cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:56.210777 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a7e1af5a-06ec-4a50-8211-de756b6bf8ab tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] 10.222.0.60 "GET /compute/v2.1/servers/9ddb5908-22a9-41c8-909c-39cdf479bdd2" status: 200 len: 1447 microversion: 2.75 time: 0.184567 Sep 14 08:59:56.221555 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1285/2610] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:59:56 2022] GET /compute/v2.1/servers/9ddb5908-22a9-41c8-909c-39cdf479bdd2 => generated 1447 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:59:56.221555 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-ee82998d-3e80-4e56-b523-5d360c3d7422 req-65a4ce3f-6c7e-4aed-ac40-203cfb2d8639 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef2a3ebb-090f-484c-9749-42c000375ec5", "tag": "5d972936-9553-4b99-bc8e-60cb4949e7d2"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:59:56.232741 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-ee82998d-3e80-4e56-b523-5d360c3d7422 req-65a4ce3f-6c7e-4aed-ac40-203cfb2d8639 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:56.233566 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-ee82998d-3e80-4e56-b523-5d360c3d7422 req-65a4ce3f-6c7e-4aed-ac40-203cfb2d8639 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:56.233996 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-ee82998d-3e80-4e56-b523-5d360c3d7422 req-65a4ce3f-6c7e-4aed-ac40-203cfb2d8639 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:56.245447 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-ee82998d-3e80-4e56-b523-5d360c3d7422 req-65a4ce3f-6c7e-4aed-ac40-203cfb2d8639 service nova] Creating event network-changed:5d972936-9553-4b99-bc8e-60cb4949e7d2 for instance ef2a3ebb-090f-484c-9749-42c000375ec5 on n-h1-836830-18 Sep 14 08:59:56.250396 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-ee82998d-3e80-4e56-b523-5d360c3d7422 req-65a4ce3f-6c7e-4aed-ac40-203cfb2d8639 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036949 Sep 14 08:59:56.250763 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1286/2611] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:59:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:59:56.256181 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-757018c6-1d8d-47c1-8e5e-884466ffeabe tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:56.256757 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-757018c6-1d8d-47c1-8e5e-884466ffeabe tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: ef2a3ebb-090f-484c-9749-42c000375ec5] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:56.262887 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-757018c6-1d8d-47c1-8e5e-884466ffeabe tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:56.263442 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-757018c6-1d8d-47c1-8e5e-884466ffeabe tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:56.263867 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-757018c6-1d8d-47c1-8e5e-884466ffeabe tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:56.264565 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-757018c6-1d8d-47c1-8e5e-884466ffeabe tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:56.265037 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-757018c6-1d8d-47c1-8e5e-884466ffeabe tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:56.268619 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-757018c6-1d8d-47c1-8e5e-884466ffeabe tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:56.805586 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-757018c6-1d8d-47c1-8e5e-884466ffeabe tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:56.820257 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-757018c6-1d8d-47c1-8e5e-884466ffeabe tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/ef2a3ebb-090f-484c-9749-42c000375ec5" status: 200 len: 1315 microversion: 2.1 time: 0.568163 Sep 14 08:59:56.821213 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1287/2612] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:56 2022] GET /compute/v2.1/servers/ef2a3ebb-090f-484c-9749-42c000375ec5 => generated 1315 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:59:56.826835 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-0f65fcfd-ec4e-4ae2-958f-c58a52b7cfc1 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1347230666", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "networks": [{"uuid": "74ca5aa6-7711-43a3-8680-b63fc6f25063"}]}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:59:56.889092 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.network.neutron [None req-facad598-9cab-4aaa-a581-bf1b7864c056 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] [instance: eeed9e16-bc5c-4fb1-b4b9-9c9305c8da73] re-assign floating IP 172.25.9.120 from instance 2da88a50-c283-4c91-b3e1-bd4f5eb9e319 Sep 14 08:59:56.891250 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.network.neutron [None req-0f65fcfd-ec4e-4ae2-958f-c58a52b7cfc1 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] validate_networks() for [('74ca5aa6-7711-43a3-8680-b63fc6f25063', None, None, None, None, None)] {{(pid=128759) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 08:59:56.936919 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.network.neutron [None req-facad598-9cab-4aaa-a581-bf1b7864c056 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] [instance: 2da88a50-c283-4c91-b3e1-bd4f5eb9e319] Building network info cache for instance {{(pid=128758) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 14 08:59:57.643999 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-0f65fcfd-ec4e-4ae2-958f-c58a52b7cfc1 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Flavor limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 08:59:57.644496 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-0f65fcfd-ec4e-4ae2-958f-c58a52b7cfc1 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Image limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 08:59:57.644981 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-0f65fcfd-ec4e-4ae2-958f-c58a52b7cfc1 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Flavor pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 08:59:57.645394 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-0f65fcfd-ec4e-4ae2-958f-c58a52b7cfc1 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Image pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 08:59:57.645926 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-0f65fcfd-ec4e-4ae2-958f-c58a52b7cfc1 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 08:59:57.648037 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:59:57.657525 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0f65fcfd-ec4e-4ae2-958f-c58a52b7cfc1 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:57.658046 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0f65fcfd-ec4e-4ae2-958f-c58a52b7cfc1 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:57.658454 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0f65fcfd-ec4e-4ae2-958f-c58a52b7cfc1 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:57.659209 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0f65fcfd-ec4e-4ae2-958f-c58a52b7cfc1 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:57.659668 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0f65fcfd-ec4e-4ae2-958f-c58a52b7cfc1 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:57.660169 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0f65fcfd-ec4e-4ae2-958f-c58a52b7cfc1 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:57.684404 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-0f65fcfd-ec4e-4ae2-958f-c58a52b7cfc1 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Getting quotas for project 6ed2295a58f8451993a57ce0a6f9ba29. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 08:59:57.691716 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-0f65fcfd-ec4e-4ae2-958f-c58a52b7cfc1 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Getting quotas for user dc9d40e54481461cba53fedb9a6abdf8 and project 6ed2295a58f8451993a57ce0a6f9ba29. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 08:59:57.707146 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-0f65fcfd-ec4e-4ae2-958f-c58a52b7cfc1 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Going to run 1 instances... {{(pid=128759) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 08:59:57.709570 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-0f65fcfd-ec4e-4ae2-958f-c58a52b7cfc1 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: 8f7f80e3-c2f5-4719-a484-29d6bd0d9e91] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128759) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 08:59:57.765059 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-0f65fcfd-ec4e-4ae2-958f-c58a52b7cfc1 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.942965 Sep 14 08:59:57.771928 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1288/2613] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 08:59:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 950 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 08:59:57.778453 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-63e84330-4fc4-4457-8c06-a65cad438ced tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:57.779710 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-63e84330-4fc4-4457-8c06-a65cad438ced tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 39890752-2382-4631-8c4a-f3c6d47c94cb] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:57.785937 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-63e84330-4fc4-4457-8c06-a65cad438ced tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:57.786422 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-63e84330-4fc4-4457-8c06-a65cad438ced tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:57.787466 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-63e84330-4fc4-4457-8c06-a65cad438ced tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:57.787633 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-63e84330-4fc4-4457-8c06-a65cad438ced tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:57.788011 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-63e84330-4fc4-4457-8c06-a65cad438ced tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:57.788431 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-63e84330-4fc4-4457-8c06-a65cad438ced tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:58.164940 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.network.neutron [None req-facad598-9cab-4aaa-a581-bf1b7864c056 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] [instance: 2da88a50-c283-4c91-b3e1-bd4f5eb9e319] Updating instance_info_cache with network_info: [{"id": "0e0d5077-876f-4296-b015-ba13bb73c465", "address": "fa:16:3e:c3:7e:b5", "network": {"id": "bb99f4a1-78ca-499c-bb3f-fa3732e743f4", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1051231467-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "d9df06ceaa154f3c80665cc6a27b3598", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap0e0d5077-87", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128758) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 14 08:59:58.180522 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.network.neutron [None req-facad598-9cab-4aaa-a581-bf1b7864c056 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] [instance: eeed9e16-bc5c-4fb1-b4b9-9c9305c8da73] Building network info cache for instance {{(pid=128758) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 14 08:59:58.305585 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-63e84330-4fc4-4457-8c06-a65cad438ced tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:58.315911 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-63e84330-4fc4-4457-8c06-a65cad438ced tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/39890752-2382-4631-8c4a-f3c6d47c94cb" status: 200 len: 1510 microversion: 2.1 time: 0.542922 Sep 14 08:59:58.316821 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1289/2614] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:57 2022] GET /compute/v2.1/servers/39890752-2382-4631-8c4a-f3c6d47c94cb => generated 1510 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:59:58.322266 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8ed9f031-9106-4a20-9d8c-f74b2e4b48c3 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:58.323104 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-8ed9f031-9106-4a20-9d8c-f74b2e4b48c3 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] [instance: 9ddb5908-22a9-41c8-909c-39cdf479bdd2] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:58.329721 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8ed9f031-9106-4a20-9d8c-f74b2e4b48c3 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:58.330217 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8ed9f031-9106-4a20-9d8c-f74b2e4b48c3 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:58.330658 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8ed9f031-9106-4a20-9d8c-f74b2e4b48c3 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:58.331439 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8ed9f031-9106-4a20-9d8c-f74b2e4b48c3 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:58.331897 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8ed9f031-9106-4a20-9d8c-f74b2e4b48c3 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:58.332506 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8ed9f031-9106-4a20-9d8c-f74b2e4b48c3 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:58.470621 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-8ed9f031-9106-4a20-9d8c-f74b2e4b48c3 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc9edb486f8481a99778bdac0ef3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d168a11f24eeb861d3451e0c270cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:58.489592 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-8ed9f031-9106-4a20-9d8c-f74b2e4b48c3 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fdc9edb486f8481a99778bdac0ef3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d168a11f24eeb861d3451e0c270cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:58.491454 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-8ed9f031-9106-4a20-9d8c-f74b2e4b48c3 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fdc9edb486f8481a99778bdac0ef3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d168a11f24eeb861d3451e0c270cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:58.498359 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-8ed9f031-9106-4a20-9d8c-f74b2e4b48c3 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] 10.222.0.60 "GET /compute/v2.1/servers/9ddb5908-22a9-41c8-909c-39cdf479bdd2" status: 200 len: 1447 microversion: 2.75 time: 0.179741 Sep 14 08:59:58.499210 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1290/2615] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:59:58 2022] GET /compute/v2.1/servers/9ddb5908-22a9-41c8-909c-39cdf479bdd2 => generated 1447 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:59:58.525453 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f4a19cdf-f1ce-48af-94df-6d92f337e932 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:58.526088 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f4a19cdf-f1ce-48af-94df-6d92f337e932 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: 8f7f80e3-c2f5-4719-a484-29d6bd0d9e91] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:58.532785 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f4a19cdf-f1ce-48af-94df-6d92f337e932 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:58.533294 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f4a19cdf-f1ce-48af-94df-6d92f337e932 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:58.533748 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f4a19cdf-f1ce-48af-94df-6d92f337e932 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:58.534453 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f4a19cdf-f1ce-48af-94df-6d92f337e932 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:58.534987 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f4a19cdf-f1ce-48af-94df-6d92f337e932 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:58.535562 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f4a19cdf-f1ce-48af-94df-6d92f337e932 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:58.543013 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:59:58.660670 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f4a19cdf-f1ce-48af-94df-6d92f337e932 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9d40e54481461cba53fedb9a6abdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed2295a58f8451993a57ce0a6f9ba29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:58.669810 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f4a19cdf-f1ce-48af-94df-6d92f337e932 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7f80e3-c2f5-4719-a484-29d6bd0d9e91" status: 200 len: 1270 microversion: 2.1 time: 0.153456 Sep 14 08:59:58.671024 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1291/2616] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:58 2022] GET /compute/v2.1/servers/8f7f80e3-c2f5-4719-a484-29d6bd0d9e91 => generated 1270 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:59:58.675888 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-08f5cab3-d8db-4515-a0f6-656046057727 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:58.676503 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-08f5cab3-d8db-4515-a0f6-656046057727 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: ef2a3ebb-090f-484c-9749-42c000375ec5] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:58.682466 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-08f5cab3-d8db-4515-a0f6-656046057727 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:58.682983 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-08f5cab3-d8db-4515-a0f6-656046057727 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:58.683420 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-08f5cab3-d8db-4515-a0f6-656046057727 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:58.684107 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-08f5cab3-d8db-4515-a0f6-656046057727 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:58.684558 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-08f5cab3-d8db-4515-a0f6-656046057727 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:58.685911 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-08f5cab3-d8db-4515-a0f6-656046057727 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:58.978038 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-08f5cab3-d8db-4515-a0f6-656046057727 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:58.989183 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-08f5cab3-d8db-4515-a0f6-656046057727 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/ef2a3ebb-090f-484c-9749-42c000375ec5" status: 200 len: 1315 microversion: 2.1 time: 0.316787 Sep 14 08:59:58.990328 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1292/2617] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:58 2022] GET /compute/v2.1/servers/ef2a3ebb-090f-484c-9749-42c000375ec5 => generated 1315 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:59:58.995422 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-5b59c078-7c29-4823-a062-20e3cba058b7 req-db58b207-7275-431b-9779-8261765547af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2da88a50-c283-4c91-b3e1-bd4f5eb9e319", "tag": "0e0d5077-876f-4296-b015-ba13bb73c465"}, {"name": "network-changed", "server_uuid": "eeed9e16-bc5c-4fb1-b4b9-9c9305c8da73", "tag": "3fe7de0d-da04-49b7-b880-3c36db11b5aa"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:59:59.008655 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-5b59c078-7c29-4823-a062-20e3cba058b7 req-db58b207-7275-431b-9779-8261765547af service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:59.009145 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-5b59c078-7c29-4823-a062-20e3cba058b7 req-db58b207-7275-431b-9779-8261765547af service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:59.009573 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-5b59c078-7c29-4823-a062-20e3cba058b7 req-db58b207-7275-431b-9779-8261765547af service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:59.024809 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-5b59c078-7c29-4823-a062-20e3cba058b7 req-db58b207-7275-431b-9779-8261765547af service nova] Creating event network-changed:0e0d5077-876f-4296-b015-ba13bb73c465 for instance 2da88a50-c283-4c91-b3e1-bd4f5eb9e319 on n-h2-836830-18 Sep 14 08:59:59.025436 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-5b59c078-7c29-4823-a062-20e3cba058b7 req-db58b207-7275-431b-9779-8261765547af service nova] Creating event network-changed:3fe7de0d-da04-49b7-b880-3c36db11b5aa for instance eeed9e16-bc5c-4fb1-b4b9-9c9305c8da73 on n-h1-836830-18 Sep 14 08:59:59.036731 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-5b59c078-7c29-4823-a062-20e3cba058b7 req-db58b207-7275-431b-9779-8261765547af service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.044895 Sep 14 08:59:59.037682 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1293/2618] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 08:59:58 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 08:59:59.190471 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.network.neutron [None req-facad598-9cab-4aaa-a581-bf1b7864c056 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] [instance: eeed9e16-bc5c-4fb1-b4b9-9c9305c8da73] Updating instance_info_cache with network_info: [{"id": "3fe7de0d-da04-49b7-b880-3c36db11b5aa", "address": "fa:16:3e:bb:57:47", "network": {"id": "bb99f4a1-78ca-499c-bb3f-fa3732e743f4", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1051231467-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.9.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "d9df06ceaa154f3c80665cc6a27b3598", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap3fe7de0d-da", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128758) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 14 08:59:59.200113 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=91,nova_cell1:SAVEPOINT=3,nova_cell1:UPDATE=3,nova_cell1:RELEASE=3 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 08:59:59.208612 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-facad598-9cab-4aaa-a581-bf1b7864c056 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Releasing lock "refresh_cache-eeed9e16-bc5c-4fb1-b4b9-9c9305c8da73" {{(pid=128758) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 14 08:59:59.209690 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-facad598-9cab-4aaa-a581-bf1b7864c056 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] 10.222.0.60 "POST /compute/v2.1/servers/eeed9e16-bc5c-4fb1-b4b9-9c9305c8da73/action" status: 202 len: 0 microversion: 2.1 time: 7.303235 Sep 14 08:59:59.210644 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1326/2619] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 08:59:51 2022] POST /compute/v2.1/servers/eeed9e16-bc5c-4fb1-b4b9-9c9305c8da73/action => generated 0 bytes in 7305 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 14 08:59:59.221680 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-657a9ac7-e9dc-4a54-984a-68000bfba058 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.9.120"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:59:59.343777 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-6ef17456-e9fa-48ca-9013-8266be32de40 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:59.344407 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-6ef17456-e9fa-48ca-9013-8266be32de40 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 39890752-2382-4631-8c4a-f3c6d47c94cb] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:59.352800 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6ef17456-e9fa-48ca-9013-8266be32de40 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:59.353401 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6ef17456-e9fa-48ca-9013-8266be32de40 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:59.353734 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-657a9ac7-e9dc-4a54-984a-68000bfba058 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] [instance: eeed9e16-bc5c-4fb1-b4b9-9c9305c8da73] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:59.354532 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6ef17456-e9fa-48ca-9013-8266be32de40 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:59.355704 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6ef17456-e9fa-48ca-9013-8266be32de40 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:59.356174 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6ef17456-e9fa-48ca-9013-8266be32de40 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:59.356713 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6ef17456-e9fa-48ca-9013-8266be32de40 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:59.363048 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-657a9ac7-e9dc-4a54-984a-68000bfba058 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:59.363801 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-657a9ac7-e9dc-4a54-984a-68000bfba058 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:59.364974 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-657a9ac7-e9dc-4a54-984a-68000bfba058 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:59.365960 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-657a9ac7-e9dc-4a54-984a-68000bfba058 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:59.366426 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-657a9ac7-e9dc-4a54-984a-68000bfba058 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:59.367717 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-657a9ac7-e9dc-4a54-984a-68000bfba058 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:59.595385 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-6ef17456-e9fa-48ca-9013-8266be32de40 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:59.603415 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-6ef17456-e9fa-48ca-9013-8266be32de40 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/39890752-2382-4631-8c4a-f3c6d47c94cb" status: 200 len: 1510 microversion: 2.1 time: 0.264476 Sep 14 08:59:59.604302 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1327/2620] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:59 2022] GET /compute/v2.1/servers/39890752-2382-4631-8c4a-f3c6d47c94cb => generated 1510 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 08:59:59.609205 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a93050e6-f799-4ff4-8e67-32815fee87e4 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:59.609896 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-a93050e6-f799-4ff4-8e67-32815fee87e4 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] [instance: 9ddb5908-22a9-41c8-909c-39cdf479bdd2] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:59.616348 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a93050e6-f799-4ff4-8e67-32815fee87e4 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:59.616952 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a93050e6-f799-4ff4-8e67-32815fee87e4 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:59.617649 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a93050e6-f799-4ff4-8e67-32815fee87e4 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:59.618582 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a93050e6-f799-4ff4-8e67-32815fee87e4 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:59.619288 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a93050e6-f799-4ff4-8e67-32815fee87e4 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:59.620051 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a93050e6-f799-4ff4-8e67-32815fee87e4 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:59.668929 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-657a9ac7-e9dc-4a54-984a-68000bfba058 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] HTTP exception thrown: Floating IP 172.25.9.120 is not associated with instance 2da88a50-c283-4c91-b3e1-bd4f5eb9e319. Sep 14 08:59:59.671552 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-657a9ac7-e9dc-4a54-984a-68000bfba058 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Request method failure captured: Sep 14 08:59:59.671552 n-d-836830-18 devstack@n-api.service[128759]: request: POST /compute/v2.1/servers/2da88a50-c283-4c91-b3e1-bd4f5eb9e319/action HTTP/1.1 Sep 14 08:59:59.671552 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 08:59:59.671552 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 08:59:59.671552 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 08:59:59.671552 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 49 Sep 14 08:59:59.671552 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 08:59:59.671552 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 08:59:59.671552 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 08:59:59.671552 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 08:59:59.671552 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZfiLS4Dd7eH1wltzSbPX84DokZp6CVegujFOyb4EWT2TjTTNUqwjROiHXAC6fhQWjxO3IKN3sTuQg3kPkZqTukAyIteecXLk7I6nAEMGExhj4zko4WfmQUZX-YqQZxk-Lh_HXrlzm3yNQR4KH4lu8yv_rqRCvpzazwcqqm32gFYV5Q Sep 14 08:59:59.671552 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 08:59:59.671552 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 08:59:59.671552 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 08:59:59.671552 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 08:59:59.671552 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 08:59:59.671552 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 08:59:59.671552 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: d9df06ceaa154f3c80665cc6a27b3598 Sep 14 08:59:59.671552 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1544566855 Sep 14 08:59:59.671552 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 08:59:59.671552 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 08:59:59.671552 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/d9df06ceaa154f3c80665cc6a27b3598"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_d9df06ceaa154f3c80665cc6a27b3598"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d9df06ceaa154f3c80665cc6a27b3598"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d9df06ceaa154f3c80665cc6a27b3598"}]}] Sep 14 08:59:59.671552 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1544566855 Sep 14 08:59:59.671552 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: d9df06ceaa154f3c80665cc6a27b3598 Sep 14 08:59:59.671552 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1544566855 Sep 14 08:59:59.671552 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-FloatingIPsAssociationTestJSON-1544566855-project Sep 14 08:59:59.671552 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 08:59:59.671552 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 08:59:59.671552 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: db65c0cfa83f48468d4a1bcef0caff73 Sep 14 08:59:59.671552 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1544566855-project Sep 14 08:59:59.671552 n-d-836830-18 devstack@n-api.service[128759]: Sep 14 08:59:59.671552 n-d-836830-18 devstack@n-api.service[128759]: {"removeFloatingIp": {"address": "172.25.9.120"}} Sep 14 08:59:59.671552 n-d-836830-18 devstack@n-api.service[128759]: method: Sep 14 08:59:59.671552 n-d-836830-18 devstack@n-api.service[128759]: exception: Floating IP 172.25.9.120 is not associated with instance 2da88a50-c283-4c91-b3e1-bd4f5eb9e319. Sep 14 08:59:59.671552 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '2da88a50-c283-4c91-b3e1-bd4f5eb9e319', 'body': {'removeFloatingIp': {'address': '172.25.9.120'}}} Sep 14 08:59:59.671552 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 08:59:59.671552 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:59:59.671552 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:59:59.671552 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:59:59.671552 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 08:59:59.671552 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 08:59:59.671552 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 08:59:59.671552 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 08:59:59.671552 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 08:59:59.671552 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 08:59:59.671552 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 08:59:59.671552 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 08:59:59.671552 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Sep 14 08:59:59.671552 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 14 08:59:59.671552 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.9.120 is not associated with instance 2da88a50-c283-4c91-b3e1-bd4f5eb9e319. Sep 14 08:59:59.671552 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:59:59.671552 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 08:59:59.671552 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:59:59.671552 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 08:59:59.671552 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 08:59:59.671552 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 08:59:59.671552 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 08:59:59.671552 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 08:59:59.671552 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.9.120 is not associated with instance 2da88a50-c283-4c91-b3e1-bd4f5eb9e319. Sep 14 08:59:59.671552 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 08:59:59.677766 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-657a9ac7-e9dc-4a54-984a-68000bfba058 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Returning 409 to user: Floating IP 172.25.9.120 is not associated with instance 2da88a50-c283-4c91-b3e1-bd4f5eb9e319. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 08:59:59.678874 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-657a9ac7-e9dc-4a54-984a-68000bfba058 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] 10.222.0.60 "POST /compute/v2.1/servers/2da88a50-c283-4c91-b3e1-bd4f5eb9e319/action" status: 409 len: 146 microversion: 2.1 time: 0.463402 Sep 14 08:59:59.679760 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1294/2621] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 08:59:59 2022] POST /compute/v2.1/servers/2da88a50-c283-4c91-b3e1-bd4f5eb9e319/action => generated 146 bytes in 465 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 14 08:59:59.689065 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-765f096e-cea1-410e-b2d6-14dedc6a8277 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.9.120"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 08:59:59.711476 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-a93050e6-f799-4ff4-8e67-32815fee87e4 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc9edb486f8481a99778bdac0ef3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d168a11f24eeb861d3451e0c270cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:59.722872 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-a93050e6-f799-4ff4-8e67-32815fee87e4 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fdc9edb486f8481a99778bdac0ef3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d168a11f24eeb861d3451e0c270cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:59.724719 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-a93050e6-f799-4ff4-8e67-32815fee87e4 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fdc9edb486f8481a99778bdac0ef3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d168a11f24eeb861d3451e0c270cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:59.730680 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-a93050e6-f799-4ff4-8e67-32815fee87e4 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] 10.222.0.60 "GET /compute/v2.1/servers/9ddb5908-22a9-41c8-909c-39cdf479bdd2" status: 200 len: 1447 microversion: 2.75 time: 0.125117 Sep 14 08:59:59.731347 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1328/2622] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 08:59:59 2022] GET /compute/v2.1/servers/9ddb5908-22a9-41c8-909c-39cdf479bdd2 => generated 1447 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 08:59:59.738374 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-83266904-ea01-476e-91a0-71f3833aab4f tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 08:59:59.739272 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-83266904-ea01-476e-91a0-71f3833aab4f tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: 8f7f80e3-c2f5-4719-a484-29d6bd0d9e91] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:59.746530 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-83266904-ea01-476e-91a0-71f3833aab4f tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:59.747873 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-83266904-ea01-476e-91a0-71f3833aab4f tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:59.748478 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-83266904-ea01-476e-91a0-71f3833aab4f tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:59.750262 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-83266904-ea01-476e-91a0-71f3833aab4f tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:59.750884 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-83266904-ea01-476e-91a0-71f3833aab4f tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:59.751560 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-83266904-ea01-476e-91a0-71f3833aab4f tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:59.850990 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-83266904-ea01-476e-91a0-71f3833aab4f tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9d40e54481461cba53fedb9a6abdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed2295a58f8451993a57ce0a6f9ba29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 08:59:59.859772 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-83266904-ea01-476e-91a0-71f3833aab4f tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7f80e3-c2f5-4719-a484-29d6bd0d9e91" status: 200 len: 1276 microversion: 2.1 time: 0.125065 Sep 14 08:59:59.860645 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1329/2623] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 08:59:59 2022] GET /compute/v2.1/servers/8f7f80e3-c2f5-4719-a484-29d6bd0d9e91 => generated 1276 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 08:59:59.873424 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-765f096e-cea1-410e-b2d6-14dedc6a8277 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] [instance: eeed9e16-bc5c-4fb1-b4b9-9c9305c8da73] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 08:59:59.887023 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-765f096e-cea1-410e-b2d6-14dedc6a8277 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:59.887516 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-765f096e-cea1-410e-b2d6-14dedc6a8277 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:59.887956 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-765f096e-cea1-410e-b2d6-14dedc6a8277 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 08:59:59.889210 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-765f096e-cea1-410e-b2d6-14dedc6a8277 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 08:59:59.889668 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-765f096e-cea1-410e-b2d6-14dedc6a8277 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 08:59:59.890089 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-765f096e-cea1-410e-b2d6-14dedc6a8277 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:00.012730 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a45b32f5-199a-4e34-9d20-92abaf489a52 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:00.013922 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-a45b32f5-199a-4e34-9d20-92abaf489a52 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: ef2a3ebb-090f-484c-9749-42c000375ec5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:00.020144 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a45b32f5-199a-4e34-9d20-92abaf489a52 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:00.020423 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a45b32f5-199a-4e34-9d20-92abaf489a52 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:00.020856 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a45b32f5-199a-4e34-9d20-92abaf489a52 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:00.021564 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a45b32f5-199a-4e34-9d20-92abaf489a52 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:00.022018 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a45b32f5-199a-4e34-9d20-92abaf489a52 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:00.022568 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a45b32f5-199a-4e34-9d20-92abaf489a52 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:00.466242 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-765f096e-cea1-410e-b2d6-14dedc6a8277 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Acquiring lock "refresh_cache-eeed9e16-bc5c-4fb1-b4b9-9c9305c8da73" {{(pid=128759) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 14 09:00:00.467240 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-765f096e-cea1-410e-b2d6-14dedc6a8277 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Acquired lock "refresh_cache-eeed9e16-bc5c-4fb1-b4b9-9c9305c8da73" {{(pid=128759) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 14 09:00:00.541866 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-a45b32f5-199a-4e34-9d20-92abaf489a52 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:00.552907 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-a45b32f5-199a-4e34-9d20-92abaf489a52 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/ef2a3ebb-090f-484c-9749-42c000375ec5" status: 200 len: 1315 microversion: 2.1 time: 0.543934 Sep 14 09:00:00.553516 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1330/2624] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:00:00 2022] GET /compute/v2.1/servers/ef2a3ebb-090f-484c-9749-42c000375ec5 => generated 1315 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:00:00.630028 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-4762ad78-8c3f-45e2-b96c-ba5a71d8351b tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:00.630565 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-4762ad78-8c3f-45e2-b96c-ba5a71d8351b tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 39890752-2382-4631-8c4a-f3c6d47c94cb] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:00.637657 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4762ad78-8c3f-45e2-b96c-ba5a71d8351b tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:00.638157 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4762ad78-8c3f-45e2-b96c-ba5a71d8351b tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:00.638638 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4762ad78-8c3f-45e2-b96c-ba5a71d8351b tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:00.639376 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4762ad78-8c3f-45e2-b96c-ba5a71d8351b tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:00.639835 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4762ad78-8c3f-45e2-b96c-ba5a71d8351b tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:00.640462 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4762ad78-8c3f-45e2-b96c-ba5a71d8351b tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:01.184876 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-4762ad78-8c3f-45e2-b96c-ba5a71d8351b tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:01.196267 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-4762ad78-8c3f-45e2-b96c-ba5a71d8351b tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/39890752-2382-4631-8c4a-f3c6d47c94cb" status: 200 len: 1510 microversion: 2.1 time: 0.570049 Sep 14 09:00:01.197267 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1331/2625] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:00:00 2022] GET /compute/v2.1/servers/39890752-2382-4631-8c4a-f3c6d47c94cb => generated 1510 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:00:01.203559 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-e64b827d-9177-4995-8e7d-22660bd6486a tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:01.212331 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-e64b827d-9177-4995-8e7d-22660bd6486a tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] [instance: 9ddb5908-22a9-41c8-909c-39cdf479bdd2] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:01.219996 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e64b827d-9177-4995-8e7d-22660bd6486a tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:01.221132 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e64b827d-9177-4995-8e7d-22660bd6486a tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:01.221575 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e64b827d-9177-4995-8e7d-22660bd6486a tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:01.222286 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e64b827d-9177-4995-8e7d-22660bd6486a tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:01.222739 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e64b827d-9177-4995-8e7d-22660bd6486a tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:01.223193 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e64b827d-9177-4995-8e7d-22660bd6486a tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:01.300555 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-e64b827d-9177-4995-8e7d-22660bd6486a tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc9edb486f8481a99778bdac0ef3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d168a11f24eeb861d3451e0c270cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:01.312344 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-e64b827d-9177-4995-8e7d-22660bd6486a tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fdc9edb486f8481a99778bdac0ef3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d168a11f24eeb861d3451e0c270cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:01.313894 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-e64b827d-9177-4995-8e7d-22660bd6486a tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fdc9edb486f8481a99778bdac0ef3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d168a11f24eeb861d3451e0c270cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:01.320132 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-e64b827d-9177-4995-8e7d-22660bd6486a tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] 10.222.0.60 "GET /compute/v2.1/servers/9ddb5908-22a9-41c8-909c-39cdf479bdd2" status: 200 len: 1447 microversion: 2.75 time: 0.121550 Sep 14 09:00:01.320805 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1332/2626] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:00:01 2022] GET /compute/v2.1/servers/9ddb5908-22a9-41c8-909c-39cdf479bdd2 => generated 1447 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:00:01.327194 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a88e1de3-fff7-46a8-bbc6-929064d5e336 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:01.327997 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-a88e1de3-fff7-46a8-bbc6-929064d5e336 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: 8f7f80e3-c2f5-4719-a484-29d6bd0d9e91] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:01.336408 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a88e1de3-fff7-46a8-bbc6-929064d5e336 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:01.337580 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a88e1de3-fff7-46a8-bbc6-929064d5e336 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:01.338194 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a88e1de3-fff7-46a8-bbc6-929064d5e336 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:01.339613 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a88e1de3-fff7-46a8-bbc6-929064d5e336 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:01.340227 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a88e1de3-fff7-46a8-bbc6-929064d5e336 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:01.341297 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a88e1de3-fff7-46a8-bbc6-929064d5e336 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:01.824178 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-a88e1de3-fff7-46a8-bbc6-929064d5e336 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9d40e54481461cba53fedb9a6abdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed2295a58f8451993a57ce0a6f9ba29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:01.836659 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-a88e1de3-fff7-46a8-bbc6-929064d5e336 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7f80e3-c2f5-4719-a484-29d6bd0d9e91" status: 200 len: 1318 microversion: 2.1 time: 0.514468 Sep 14 09:00:01.838574 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1333/2627] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:00:01 2022] GET /compute/v2.1/servers/8f7f80e3-c2f5-4719-a484-29d6bd0d9e91 => generated 1318 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:00:01.848867 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-54297096-1160-4915-8456-f7581008b9d1 req-faec356d-7872-45fa-927c-c742414f14cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0c5547a-1340-4d19-a0f9-3e1eb9fd1932", "name": "network-vif-deleted", "tag": "2e224a14-f300-4cfe-a4c3-34a512adfc08"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:00:01.863181 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-54297096-1160-4915-8456-f7581008b9d1 req-faec356d-7872-45fa-927c-c742414f14cc service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:01.863981 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-54297096-1160-4915-8456-f7581008b9d1 req-faec356d-7872-45fa-927c-c742414f14cc service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:01.864760 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-54297096-1160-4915-8456-f7581008b9d1 req-faec356d-7872-45fa-927c-c742414f14cc service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:01.879821 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-54297096-1160-4915-8456-f7581008b9d1 req-faec356d-7872-45fa-927c-c742414f14cc service nova] Creating event network-vif-deleted:2e224a14-f300-4cfe-a4c3-34a512adfc08 for instance d0c5547a-1340-4d19-a0f9-3e1eb9fd1932 on n-h1-836830-18 Sep 14 09:00:01.887779 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.network.neutron [None req-765f096e-cea1-410e-b2d6-14dedc6a8277 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] [instance: eeed9e16-bc5c-4fb1-b4b9-9c9305c8da73] Building network info cache for instance {{(pid=128759) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 14 09:00:01.900236 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-54297096-1160-4915-8456-f7581008b9d1 req-faec356d-7872-45fa-927c-c742414f14cc service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058767 Sep 14 09:00:01.903564 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1334/2628] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:00:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:00:01.914049 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d193eb48-d747-4bba-9dad-a2d284b1bf2d tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:01.915185 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-d193eb48-d747-4bba-9dad-a2d284b1bf2d tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: ef2a3ebb-090f-484c-9749-42c000375ec5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:01.925477 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d193eb48-d747-4bba-9dad-a2d284b1bf2d tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:01.926342 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d193eb48-d747-4bba-9dad-a2d284b1bf2d tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:01.927180 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d193eb48-d747-4bba-9dad-a2d284b1bf2d tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:01.928061 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d193eb48-d747-4bba-9dad-a2d284b1bf2d tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:01.928689 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d193eb48-d747-4bba-9dad-a2d284b1bf2d tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:01.929562 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d193eb48-d747-4bba-9dad-a2d284b1bf2d tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:02.650700 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-d193eb48-d747-4bba-9dad-a2d284b1bf2d tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:02.660959 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-d193eb48-d747-4bba-9dad-a2d284b1bf2d tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/ef2a3ebb-090f-484c-9749-42c000375ec5" status: 200 len: 1315 microversion: 2.1 time: 0.755864 Sep 14 09:00:02.661893 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1335/2629] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:00:01 2022] GET /compute/v2.1/servers/ef2a3ebb-090f-484c-9749-42c000375ec5 => generated 1315 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:00:02.666674 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-a847206a-ff24-4e9b-addf-4470ec56eae8 req-8ef08c5a-9880-4abf-a931-112c4c0043b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f7f80e3-c2f5-4719-a484-29d6bd0d9e91", "tag": "b19f0267-785e-4700-95e9-c6c0c01d2656"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:00:02.677735 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-a847206a-ff24-4e9b-addf-4470ec56eae8 req-8ef08c5a-9880-4abf-a931-112c4c0043b4 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:02.678251 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-a847206a-ff24-4e9b-addf-4470ec56eae8 req-8ef08c5a-9880-4abf-a931-112c4c0043b4 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:02.678739 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-a847206a-ff24-4e9b-addf-4470ec56eae8 req-8ef08c5a-9880-4abf-a931-112c4c0043b4 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:02.691321 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-a847206a-ff24-4e9b-addf-4470ec56eae8 req-8ef08c5a-9880-4abf-a931-112c4c0043b4 service nova] Creating event network-changed:b19f0267-785e-4700-95e9-c6c0c01d2656 for instance 8f7f80e3-c2f5-4719-a484-29d6bd0d9e91 on n-h2-836830-18 Sep 14 09:00:02.696686 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-a847206a-ff24-4e9b-addf-4470ec56eae8 req-8ef08c5a-9880-4abf-a931-112c4c0043b4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033288 Sep 14 09:00:02.697315 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1336/2630] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:00:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:00:02.707727 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-58dc196d-6501-461a-8d61-7f4cbe5878eb tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:02.708441 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-58dc196d-6501-461a-8d61-7f4cbe5878eb tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 39890752-2382-4631-8c4a-f3c6d47c94cb] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:02.714893 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-58dc196d-6501-461a-8d61-7f4cbe5878eb tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:02.715433 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-58dc196d-6501-461a-8d61-7f4cbe5878eb tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:02.715874 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-58dc196d-6501-461a-8d61-7f4cbe5878eb tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:02.717266 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-58dc196d-6501-461a-8d61-7f4cbe5878eb tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:02.717646 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-58dc196d-6501-461a-8d61-7f4cbe5878eb tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:02.718112 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-58dc196d-6501-461a-8d61-7f4cbe5878eb tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:02.975512 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-58dc196d-6501-461a-8d61-7f4cbe5878eb tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:02.983903 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-58dc196d-6501-461a-8d61-7f4cbe5878eb tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/39890752-2382-4631-8c4a-f3c6d47c94cb" status: 200 len: 1487 microversion: 2.1 time: 0.280302 Sep 14 09:00:02.995515 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1337/2631] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:00:02 2022] GET /compute/v2.1/servers/39890752-2382-4631-8c4a-f3c6d47c94cb => generated 1487 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:00:03.002970 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-4786cd0b-1053-4a01-89a3-63b2d4be86b0 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:03.004076 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-4786cd0b-1053-4a01-89a3-63b2d4be86b0 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] [instance: 9ddb5908-22a9-41c8-909c-39cdf479bdd2] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:03.009433 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4786cd0b-1053-4a01-89a3-63b2d4be86b0 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:03.010132 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4786cd0b-1053-4a01-89a3-63b2d4be86b0 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:03.010728 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4786cd0b-1053-4a01-89a3-63b2d4be86b0 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:03.011638 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4786cd0b-1053-4a01-89a3-63b2d4be86b0 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:03.012271 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4786cd0b-1053-4a01-89a3-63b2d4be86b0 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:03.012852 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4786cd0b-1053-4a01-89a3-63b2d4be86b0 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:03.138212 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-4786cd0b-1053-4a01-89a3-63b2d4be86b0 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc9edb486f8481a99778bdac0ef3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d168a11f24eeb861d3451e0c270cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:03.158076 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-4786cd0b-1053-4a01-89a3-63b2d4be86b0 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fdc9edb486f8481a99778bdac0ef3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d168a11f24eeb861d3451e0c270cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:03.159936 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-4786cd0b-1053-4a01-89a3-63b2d4be86b0 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fdc9edb486f8481a99778bdac0ef3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d168a11f24eeb861d3451e0c270cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:03.174100 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-4786cd0b-1053-4a01-89a3-63b2d4be86b0 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] 10.222.0.60 "GET /compute/v2.1/servers/9ddb5908-22a9-41c8-909c-39cdf479bdd2" status: 200 len: 1447 microversion: 2.75 time: 0.177212 Sep 14 09:00:03.174992 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1338/2632] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:00:02 2022] GET /compute/v2.1/servers/9ddb5908-22a9-41c8-909c-39cdf479bdd2 => generated 1447 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:00:03.179791 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-97eb5ed1-2941-487f-b9f2-de21ad5f9909 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:03.180666 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-97eb5ed1-2941-487f-b9f2-de21ad5f9909 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: 8f7f80e3-c2f5-4719-a484-29d6bd0d9e91] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:03.187503 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.network.neutron [None req-765f096e-cea1-410e-b2d6-14dedc6a8277 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] [instance: eeed9e16-bc5c-4fb1-b4b9-9c9305c8da73] Updating instance_info_cache with network_info: [{"id": "3fe7de0d-da04-49b7-b880-3c36db11b5aa", "address": "fa:16:3e:bb:57:47", "network": {"id": "bb99f4a1-78ca-499c-bb3f-fa3732e743f4", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1051231467-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "d9df06ceaa154f3c80665cc6a27b3598", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap3fe7de0d-da", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128759) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 14 09:00:03.191832 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-97eb5ed1-2941-487f-b9f2-de21ad5f9909 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:03.195699 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-97eb5ed1-2941-487f-b9f2-de21ad5f9909 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:03.196147 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-97eb5ed1-2941-487f-b9f2-de21ad5f9909 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:03.196905 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-97eb5ed1-2941-487f-b9f2-de21ad5f9909 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:03.197354 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-97eb5ed1-2941-487f-b9f2-de21ad5f9909 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:03.197781 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-97eb5ed1-2941-487f-b9f2-de21ad5f9909 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:03.203758 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-765f096e-cea1-410e-b2d6-14dedc6a8277 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Releasing lock "refresh_cache-eeed9e16-bc5c-4fb1-b4b9-9c9305c8da73" {{(pid=128759) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 14 09:00:03.205036 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-765f096e-cea1-410e-b2d6-14dedc6a8277 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] 10.222.0.60 "POST /compute/v2.1/servers/eeed9e16-bc5c-4fb1-b4b9-9c9305c8da73/action" status: 202 len: 0 microversion: 2.1 time: 3.520476 Sep 14 09:00:03.206268 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1295/2633] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 08:59:59 2022] POST /compute/v2.1/servers/eeed9e16-bc5c-4fb1-b4b9-9c9305c8da73/action => generated 0 bytes in 3522 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 14 09:00:03.213308 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-918a769d-a86e-4d52-a76a-02eacc886e46 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-898377352"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:00:03.216369 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-918a769d-a86e-4d52-a76a-02eacc886e46 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 39890752-2382-4631-8c4a-f3c6d47c94cb] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:03.224858 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-918a769d-a86e-4d52-a76a-02eacc886e46 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:03.225741 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-918a769d-a86e-4d52-a76a-02eacc886e46 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:03.226428 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-918a769d-a86e-4d52-a76a-02eacc886e46 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:03.228139 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-918a769d-a86e-4d52-a76a-02eacc886e46 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:03.229209 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-918a769d-a86e-4d52-a76a-02eacc886e46 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:03.229885 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-918a769d-a86e-4d52-a76a-02eacc886e46 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:03.309270 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-918a769d-a86e-4d52-a76a-02eacc886e46 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "PUT /compute/v2.1/servers/39890752-2382-4631-8c4a-f3c6d47c94cb" status: 200 len: 1059 microversion: 2.1 time: 0.101084 Sep 14 09:00:03.319237 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1296/2634] 10.222.0.60 () {60 vars in 1256 bytes} [Wed Sep 14 09:00:03 2022] PUT /compute/v2.1/servers/39890752-2382-4631-8c4a-f3c6d47c94cb => generated 1059 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:00:03.326510 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-15ec8cb7-45ac-4ce7-af64-a858111b4d8d tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:03.327309 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-15ec8cb7-45ac-4ce7-af64-a858111b4d8d tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] [instance: eeed9e16-bc5c-4fb1-b4b9-9c9305c8da73] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:03.334701 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-15ec8cb7-45ac-4ce7-af64-a858111b4d8d tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:03.335504 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-15ec8cb7-45ac-4ce7-af64-a858111b4d8d tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:03.336185 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-15ec8cb7-45ac-4ce7-af64-a858111b4d8d tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:03.337111 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-15ec8cb7-45ac-4ce7-af64-a858111b4d8d tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:03.337776 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-15ec8cb7-45ac-4ce7-af64-a858111b4d8d tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:03.338420 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-15ec8cb7-45ac-4ce7-af64-a858111b4d8d tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:03.371166 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-15ec8cb7-45ac-4ce7-af64-a858111b4d8d tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] [instance: eeed9e16-bc5c-4fb1-b4b9-9c9305c8da73] Going to try to terminate instance {{(pid=128759) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:00:03.393123 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-97eb5ed1-2941-487f-b9f2-de21ad5f9909 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9d40e54481461cba53fedb9a6abdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed2295a58f8451993a57ce0a6f9ba29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:03.402165 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-97eb5ed1-2941-487f-b9f2-de21ad5f9909 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7f80e3-c2f5-4719-a484-29d6bd0d9e91" status: 200 len: 1318 microversion: 2.1 time: 0.225973 Sep 14 09:00:03.403014 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1339/2635] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:00:03 2022] GET /compute/v2.1/servers/8f7f80e3-c2f5-4719-a484-29d6bd0d9e91 => generated 1318 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:00:03.407820 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-f4e81a2e-cf11-4cd3-af35-7b7518a5a215 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:03.408629 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-f4e81a2e-cf11-4cd3-af35-7b7518a5a215 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 39890752-2382-4631-8c4a-f3c6d47c94cb] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:03.414726 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f4e81a2e-cf11-4cd3-af35-7b7518a5a215 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:03.415250 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f4e81a2e-cf11-4cd3-af35-7b7518a5a215 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:03.415688 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f4e81a2e-cf11-4cd3-af35-7b7518a5a215 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:03.416380 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f4e81a2e-cf11-4cd3-af35-7b7518a5a215 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:03.417002 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f4e81a2e-cf11-4cd3-af35-7b7518a5a215 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:03.417432 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f4e81a2e-cf11-4cd3-af35-7b7518a5a215 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:03.464630 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-15ec8cb7-45ac-4ce7-af64-a858111b4d8d tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] 10.222.0.60 "DELETE /compute/v2.1/servers/eeed9e16-bc5c-4fb1-b4b9-9c9305c8da73" status: 204 len: 0 microversion: 2.1 time: 0.143112 Sep 14 09:00:03.467041 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1297/2636] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:00:03 2022] DELETE /compute/v2.1/servers/eeed9e16-bc5c-4fb1-b4b9-9c9305c8da73 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:00:03.476786 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f5fbe878-daab-4eea-be02-6cd555f7cae2 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.9.120"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:00:03.479447 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f5fbe878-daab-4eea-be02-6cd555f7cae2 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] [instance: 2da88a50-c283-4c91-b3e1-bd4f5eb9e319] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:03.485936 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f5fbe878-daab-4eea-be02-6cd555f7cae2 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:03.486436 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f5fbe878-daab-4eea-be02-6cd555f7cae2 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:03.486906 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f5fbe878-daab-4eea-be02-6cd555f7cae2 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:03.487673 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f5fbe878-daab-4eea-be02-6cd555f7cae2 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:03.488131 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f5fbe878-daab-4eea-be02-6cd555f7cae2 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:03.488560 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f5fbe878-daab-4eea-be02-6cd555f7cae2 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:03.514301 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f5fbe878-daab-4eea-be02-6cd555f7cae2 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Acquiring lock "refresh_cache-2da88a50-c283-4c91-b3e1-bd4f5eb9e319" {{(pid=128759) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 14 09:00:03.514710 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f5fbe878-daab-4eea-be02-6cd555f7cae2 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Acquired lock "refresh_cache-2da88a50-c283-4c91-b3e1-bd4f5eb9e319" {{(pid=128759) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 14 09:00:03.599376 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-f4e81a2e-cf11-4cd3-af35-7b7518a5a215 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:03.607977 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-f4e81a2e-cf11-4cd3-af35-7b7518a5a215 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/39890752-2382-4631-8c4a-f3c6d47c94cb" status: 200 len: 1486 microversion: 2.1 time: 0.203791 Sep 14 09:00:03.608649 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1340/2637] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:00:03 2022] GET /compute/v2.1/servers/39890752-2382-4631-8c4a-f3c6d47c94cb => generated 1486 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:00:03.630381 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-94e50ddc-63f8-4971-aab7-35b1c7b31e84 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:03.631016 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-94e50ddc-63f8-4971-aab7-35b1c7b31e84 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 39890752-2382-4631-8c4a-f3c6d47c94cb] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:03.636886 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-94e50ddc-63f8-4971-aab7-35b1c7b31e84 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:03.637368 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-94e50ddc-63f8-4971-aab7-35b1c7b31e84 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:03.637797 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-94e50ddc-63f8-4971-aab7-35b1c7b31e84 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:03.638503 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-94e50ddc-63f8-4971-aab7-35b1c7b31e84 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:03.638971 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-94e50ddc-63f8-4971-aab7-35b1c7b31e84 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:03.639399 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-94e50ddc-63f8-4971-aab7-35b1c7b31e84 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:03.903095 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-94e50ddc-63f8-4971-aab7-35b1c7b31e84 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:03.920725 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-94e50ddc-63f8-4971-aab7-35b1c7b31e84 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/39890752-2382-4631-8c4a-f3c6d47c94cb" status: 200 len: 1486 microversion: 2.1 time: 0.292778 Sep 14 09:00:03.922338 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1341/2638] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:00:03 2022] GET /compute/v2.1/servers/39890752-2382-4631-8c4a-f3c6d47c94cb => generated 1486 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:00:03.927894 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-cf70251d-3611-4a00-be81-b09ab3ea0a63 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:03.928963 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-cf70251d-3611-4a00-be81-b09ab3ea0a63 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: ef2a3ebb-090f-484c-9749-42c000375ec5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:03.937480 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cf70251d-3611-4a00-be81-b09ab3ea0a63 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:03.938169 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cf70251d-3611-4a00-be81-b09ab3ea0a63 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:03.938609 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cf70251d-3611-4a00-be81-b09ab3ea0a63 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:03.939621 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cf70251d-3611-4a00-be81-b09ab3ea0a63 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:03.940076 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cf70251d-3611-4a00-be81-b09ab3ea0a63 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:03.940831 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cf70251d-3611-4a00-be81-b09ab3ea0a63 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:04.198067 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-cf70251d-3611-4a00-be81-b09ab3ea0a63 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:04.208159 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-cf70251d-3611-4a00-be81-b09ab3ea0a63 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/ef2a3ebb-090f-484c-9749-42c000375ec5" status: 200 len: 1315 microversion: 2.1 time: 0.284325 Sep 14 09:00:04.208907 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1342/2639] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:00:03 2022] GET /compute/v2.1/servers/ef2a3ebb-090f-484c-9749-42c000375ec5 => generated 1315 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:00:04.225584 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c628a88f-2076-4f68-bb59-56a4824e2376 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:04.226424 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-c628a88f-2076-4f68-bb59-56a4824e2376 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 39890752-2382-4631-8c4a-f3c6d47c94cb] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:04.234289 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c628a88f-2076-4f68-bb59-56a4824e2376 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:04.235062 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c628a88f-2076-4f68-bb59-56a4824e2376 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:04.235628 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c628a88f-2076-4f68-bb59-56a4824e2376 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:04.236447 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c628a88f-2076-4f68-bb59-56a4824e2376 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:04.237047 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c628a88f-2076-4f68-bb59-56a4824e2376 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:04.237477 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c628a88f-2076-4f68-bb59-56a4824e2376 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:04.265460 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-c628a88f-2076-4f68-bb59-56a4824e2376 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 39890752-2382-4631-8c4a-f3c6d47c94cb] Going to try to terminate instance {{(pid=128758) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:00:04.304179 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:00:04.358756 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-c628a88f-2076-4f68-bb59-56a4824e2376 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "DELETE /compute/v2.1/servers/39890752-2382-4631-8c4a-f3c6d47c94cb" status: 204 len: 0 microversion: 2.1 time: 0.138294 Sep 14 09:00:04.362566 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1343/2640] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:00:04 2022] DELETE /compute/v2.1/servers/39890752-2382-4631-8c4a-f3c6d47c94cb => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:00:04.369797 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-bdfa6a49-aebc-480d-9585-d012279589f9 req-fcef2543-2f1a-4041-9a0a-435dc79bfd11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eeed9e16-bc5c-4fb1-b4b9-9c9305c8da73", "tag": "3fe7de0d-da04-49b7-b880-3c36db11b5aa"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:00:04.380810 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-bdfa6a49-aebc-480d-9585-d012279589f9 req-fcef2543-2f1a-4041-9a0a-435dc79bfd11 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:04.381284 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-bdfa6a49-aebc-480d-9585-d012279589f9 req-fcef2543-2f1a-4041-9a0a-435dc79bfd11 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:04.381719 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-bdfa6a49-aebc-480d-9585-d012279589f9 req-fcef2543-2f1a-4041-9a0a-435dc79bfd11 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:04.394464 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-bdfa6a49-aebc-480d-9585-d012279589f9 req-fcef2543-2f1a-4041-9a0a-435dc79bfd11 service nova] Creating event network-changed:3fe7de0d-da04-49b7-b880-3c36db11b5aa for instance eeed9e16-bc5c-4fb1-b4b9-9c9305c8da73 on n-h1-836830-18 Sep 14 09:00:04.400719 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-bdfa6a49-aebc-480d-9585-d012279589f9 req-fcef2543-2f1a-4041-9a0a-435dc79bfd11 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035523 Sep 14 09:00:04.402278 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1344/2641] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:00:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:00:04.408597 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-0a9b35ea-e242-4496-91e2-c2e07e16aa42 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:04.408810 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-0a9b35ea-e242-4496-91e2-c2e07e16aa42 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] [instance: 9ddb5908-22a9-41c8-909c-39cdf479bdd2] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:04.415427 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0a9b35ea-e242-4496-91e2-c2e07e16aa42 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:04.415944 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0a9b35ea-e242-4496-91e2-c2e07e16aa42 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:04.416413 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0a9b35ea-e242-4496-91e2-c2e07e16aa42 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:04.417106 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0a9b35ea-e242-4496-91e2-c2e07e16aa42 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:04.417562 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0a9b35ea-e242-4496-91e2-c2e07e16aa42 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:04.418339 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0a9b35ea-e242-4496-91e2-c2e07e16aa42 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:04.493798 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-0a9b35ea-e242-4496-91e2-c2e07e16aa42 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc9edb486f8481a99778bdac0ef3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d168a11f24eeb861d3451e0c270cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:04.502169 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-0a9b35ea-e242-4496-91e2-c2e07e16aa42 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fdc9edb486f8481a99778bdac0ef3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d168a11f24eeb861d3451e0c270cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:04.503659 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-0a9b35ea-e242-4496-91e2-c2e07e16aa42 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fdc9edb486f8481a99778bdac0ef3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d168a11f24eeb861d3451e0c270cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:04.508572 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-0a9b35ea-e242-4496-91e2-c2e07e16aa42 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] 10.222.0.60 "GET /compute/v2.1/servers/9ddb5908-22a9-41c8-909c-39cdf479bdd2" status: 200 len: 1447 microversion: 2.75 time: 0.105807 Sep 14 09:00:04.509360 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1345/2642] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:00:04 2022] GET /compute/v2.1/servers/9ddb5908-22a9-41c8-909c-39cdf479bdd2 => generated 1447 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:00:04.513562 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c334d3be-0a76-45a5-86a9-f6be7c2ec048 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:04.514175 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-c334d3be-0a76-45a5-86a9-f6be7c2ec048 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 39890752-2382-4631-8c4a-f3c6d47c94cb] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:04.519788 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c334d3be-0a76-45a5-86a9-f6be7c2ec048 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:04.520276 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c334d3be-0a76-45a5-86a9-f6be7c2ec048 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:04.520714 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c334d3be-0a76-45a5-86a9-f6be7c2ec048 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:04.521410 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c334d3be-0a76-45a5-86a9-f6be7c2ec048 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:04.521865 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c334d3be-0a76-45a5-86a9-f6be7c2ec048 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:04.522294 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c334d3be-0a76-45a5-86a9-f6be7c2ec048 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:04.769667 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-c334d3be-0a76-45a5-86a9-f6be7c2ec048 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:04.780151 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-c334d3be-0a76-45a5-86a9-f6be7c2ec048 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/39890752-2382-4631-8c4a-f3c6d47c94cb" status: 200 len: 1492 microversion: 2.1 time: 0.269963 Sep 14 09:00:04.791872 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1346/2643] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:00:04 2022] GET /compute/v2.1/servers/39890752-2382-4631-8c4a-f3c6d47c94cb => generated 1492 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:00:04.797774 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-997093a6-fc77-40b2-9f79-b46e7a39c7f6 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:04.798486 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-997093a6-fc77-40b2-9f79-b46e7a39c7f6 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: 8f7f80e3-c2f5-4719-a484-29d6bd0d9e91] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:04.804860 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-997093a6-fc77-40b2-9f79-b46e7a39c7f6 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:04.805351 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-997093a6-fc77-40b2-9f79-b46e7a39c7f6 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:04.805792 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-997093a6-fc77-40b2-9f79-b46e7a39c7f6 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:04.806489 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-997093a6-fc77-40b2-9f79-b46e7a39c7f6 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:04.806961 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-997093a6-fc77-40b2-9f79-b46e7a39c7f6 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:04.807397 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-997093a6-fc77-40b2-9f79-b46e7a39c7f6 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:05.112112 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-997093a6-fc77-40b2-9f79-b46e7a39c7f6 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9d40e54481461cba53fedb9a6abdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed2295a58f8451993a57ce0a6f9ba29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:05.114670 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.network.neutron [None req-f5fbe878-daab-4eea-be02-6cd555f7cae2 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] [instance: 2da88a50-c283-4c91-b3e1-bd4f5eb9e319] Building network info cache for instance {{(pid=128759) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 14 09:00:05.121039 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-997093a6-fc77-40b2-9f79-b46e7a39c7f6 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7f80e3-c2f5-4719-a484-29d6bd0d9e91" status: 200 len: 1318 microversion: 2.1 time: 0.327335 Sep 14 09:00:05.121642 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1347/2644] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:00:04 2022] GET /compute/v2.1/servers/8f7f80e3-c2f5-4719-a484-29d6bd0d9e91 => generated 1318 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:00:05.231717 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-18b515c7-bf98-4dcd-9fd5-a64f34abdf4c tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:05.233040 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-18b515c7-bf98-4dcd-9fd5-a64f34abdf4c tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: ef2a3ebb-090f-484c-9749-42c000375ec5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:05.239069 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-18b515c7-bf98-4dcd-9fd5-a64f34abdf4c tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:05.239550 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-18b515c7-bf98-4dcd-9fd5-a64f34abdf4c tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:05.239979 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-18b515c7-bf98-4dcd-9fd5-a64f34abdf4c tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:05.240930 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-18b515c7-bf98-4dcd-9fd5-a64f34abdf4c tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:05.241111 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-18b515c7-bf98-4dcd-9fd5-a64f34abdf4c tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:05.241527 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-18b515c7-bf98-4dcd-9fd5-a64f34abdf4c tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:05.672113 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-18b515c7-bf98-4dcd-9fd5-a64f34abdf4c tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:05.687241 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-18b515c7-bf98-4dcd-9fd5-a64f34abdf4c tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/ef2a3ebb-090f-484c-9749-42c000375ec5" status: 200 len: 1315 microversion: 2.1 time: 0.459239 Sep 14 09:00:05.703667 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1348/2645] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:00:05 2022] GET /compute/v2.1/servers/ef2a3ebb-090f-484c-9749-42c000375ec5 => generated 1315 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:00:05.708927 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-66b46e09-3140-460a-8dba-38ad568cf766 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:05.710084 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-66b46e09-3140-460a-8dba-38ad568cf766 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] [instance: 9ddb5908-22a9-41c8-909c-39cdf479bdd2] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:05.722431 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:00:05.724233 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-66b46e09-3140-460a-8dba-38ad568cf766 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:05.724892 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-66b46e09-3140-460a-8dba-38ad568cf766 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:05.725488 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-66b46e09-3140-460a-8dba-38ad568cf766 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:05.726358 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-66b46e09-3140-460a-8dba-38ad568cf766 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:05.726997 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-66b46e09-3140-460a-8dba-38ad568cf766 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:05.727600 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-66b46e09-3140-460a-8dba-38ad568cf766 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:06.206443 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-66b46e09-3140-460a-8dba-38ad568cf766 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc9edb486f8481a99778bdac0ef3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d168a11f24eeb861d3451e0c270cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:06.217240 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-66b46e09-3140-460a-8dba-38ad568cf766 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fdc9edb486f8481a99778bdac0ef3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d168a11f24eeb861d3451e0c270cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:06.219630 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-66b46e09-3140-460a-8dba-38ad568cf766 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fdc9edb486f8481a99778bdac0ef3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d168a11f24eeb861d3451e0c270cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:06.235366 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-66b46e09-3140-460a-8dba-38ad568cf766 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] 10.222.0.60 "GET /compute/v2.1/servers/9ddb5908-22a9-41c8-909c-39cdf479bdd2" status: 200 len: 1447 microversion: 2.75 time: 0.530152 Sep 14 09:00:06.236693 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1349/2646] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:00:05 2022] GET /compute/v2.1/servers/9ddb5908-22a9-41c8-909c-39cdf479bdd2 => generated 1447 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:00:06.250148 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-9c455642-48dd-4938-867d-f12dbc7e54ff tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:06.251800 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-9c455642-48dd-4938-867d-f12dbc7e54ff tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 39890752-2382-4631-8c4a-f3c6d47c94cb] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:06.268521 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9c455642-48dd-4938-867d-f12dbc7e54ff tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:06.269343 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9c455642-48dd-4938-867d-f12dbc7e54ff tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:06.270354 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9c455642-48dd-4938-867d-f12dbc7e54ff tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:06.271473 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9c455642-48dd-4938-867d-f12dbc7e54ff tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:06.272090 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9c455642-48dd-4938-867d-f12dbc7e54ff tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:06.272895 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9c455642-48dd-4938-867d-f12dbc7e54ff tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:06.885891 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-9c455642-48dd-4938-867d-f12dbc7e54ff tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:06.895344 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-9c455642-48dd-4938-867d-f12dbc7e54ff tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/39890752-2382-4631-8c4a-f3c6d47c94cb" status: 200 len: 1492 microversion: 2.1 time: 0.656017 Sep 14 09:00:06.907713 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1350/2647] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:00:06 2022] GET /compute/v2.1/servers/39890752-2382-4631-8c4a-f3c6d47c94cb => generated 1492 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:00:06.917202 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-ea79088a-8270-47df-b9ed-04c284a8eabb req-d40419bd-a793-43f7-96d3-024eaa9b7d16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef2a3ebb-090f-484c-9749-42c000375ec5", "name": "network-vif-plugged", "status": "completed", "tag": "5d972936-9553-4b99-bc8e-60cb4949e7d2"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:00:06.928129 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-ea79088a-8270-47df-b9ed-04c284a8eabb req-d40419bd-a793-43f7-96d3-024eaa9b7d16 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:06.928612 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-ea79088a-8270-47df-b9ed-04c284a8eabb req-d40419bd-a793-43f7-96d3-024eaa9b7d16 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:06.929244 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-ea79088a-8270-47df-b9ed-04c284a8eabb req-d40419bd-a793-43f7-96d3-024eaa9b7d16 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:06.941217 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-ea79088a-8270-47df-b9ed-04c284a8eabb req-d40419bd-a793-43f7-96d3-024eaa9b7d16 service nova] Creating event network-vif-plugged:5d972936-9553-4b99-bc8e-60cb4949e7d2 for instance ef2a3ebb-090f-484c-9749-42c000375ec5 on n-h1-836830-18 Sep 14 09:00:06.946022 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-ea79088a-8270-47df-b9ed-04c284a8eabb req-d40419bd-a793-43f7-96d3-024eaa9b7d16 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036808 Sep 14 09:00:06.946801 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1351/2648] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:00:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:00:06.952183 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-56fc1daf-458b-470c-8d19-9289cd8dad61 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:06.952896 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-56fc1daf-458b-470c-8d19-9289cd8dad61 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: 8f7f80e3-c2f5-4719-a484-29d6bd0d9e91] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:06.959786 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-56fc1daf-458b-470c-8d19-9289cd8dad61 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:06.960256 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-56fc1daf-458b-470c-8d19-9289cd8dad61 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:06.960941 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-56fc1daf-458b-470c-8d19-9289cd8dad61 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:06.961879 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-56fc1daf-458b-470c-8d19-9289cd8dad61 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:06.962052 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-56fc1daf-458b-470c-8d19-9289cd8dad61 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:06.962454 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-56fc1daf-458b-470c-8d19-9289cd8dad61 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:06.986204 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.network.neutron [None req-f5fbe878-daab-4eea-be02-6cd555f7cae2 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] [instance: 2da88a50-c283-4c91-b3e1-bd4f5eb9e319] Updating instance_info_cache with network_info: [{"id": "0e0d5077-876f-4296-b015-ba13bb73c465", "address": "fa:16:3e:c3:7e:b5", "network": {"id": "bb99f4a1-78ca-499c-bb3f-fa3732e743f4", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1051231467-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.9.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "d9df06ceaa154f3c80665cc6a27b3598", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap0e0d5077-87", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128759) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 14 09:00:07.016019 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f5fbe878-daab-4eea-be02-6cd555f7cae2 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Releasing lock "refresh_cache-2da88a50-c283-4c91-b3e1-bd4f5eb9e319" {{(pid=128759) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 14 09:00:07.016910 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f5fbe878-daab-4eea-be02-6cd555f7cae2 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] 10.222.0.60 "POST /compute/v2.1/servers/2da88a50-c283-4c91-b3e1-bd4f5eb9e319/action" status: 202 len: 0 microversion: 2.1 time: 3.545157 Sep 14 09:00:07.018148 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1298/2649] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:00:03 2022] POST /compute/v2.1/servers/2da88a50-c283-4c91-b3e1-bd4f5eb9e319/action => generated 0 bytes in 3547 msecs (HTTP/1.1 202) 9 headers in 369 bytes (2 switches on core 0) Sep 14 09:00:07.024309 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-acc7d9ed-148f-4bf6-b18e-e95dda20cc05 req-acf8cbb3-944d-4e96-a9c6-e021a79cd171 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2da88a50-c283-4c91-b3e1-bd4f5eb9e319", "tag": "0e0d5077-876f-4296-b015-ba13bb73c465"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:00:07.036562 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-acc7d9ed-148f-4bf6-b18e-e95dda20cc05 req-acf8cbb3-944d-4e96-a9c6-e021a79cd171 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:07.037319 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-acc7d9ed-148f-4bf6-b18e-e95dda20cc05 req-acf8cbb3-944d-4e96-a9c6-e021a79cd171 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:07.037908 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-acc7d9ed-148f-4bf6-b18e-e95dda20cc05 req-acf8cbb3-944d-4e96-a9c6-e021a79cd171 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:07.051578 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-acc7d9ed-148f-4bf6-b18e-e95dda20cc05 req-acf8cbb3-944d-4e96-a9c6-e021a79cd171 service nova] Creating event network-changed:0e0d5077-876f-4296-b015-ba13bb73c465 for instance 2da88a50-c283-4c91-b3e1-bd4f5eb9e319 on n-h2-836830-18 Sep 14 09:00:07.057887 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-acc7d9ed-148f-4bf6-b18e-e95dda20cc05 req-acf8cbb3-944d-4e96-a9c6-e021a79cd171 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037809 Sep 14 09:00:07.058683 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1299/2650] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:00:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:00:07.065206 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a0a99147-6a99-4d44-beb7-e37f703f0fe8 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:07.066006 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-a0a99147-6a99-4d44-beb7-e37f703f0fe8 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: ef2a3ebb-090f-484c-9749-42c000375ec5] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:07.072601 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a0a99147-6a99-4d44-beb7-e37f703f0fe8 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:07.073429 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a0a99147-6a99-4d44-beb7-e37f703f0fe8 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:07.074046 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a0a99147-6a99-4d44-beb7-e37f703f0fe8 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:07.074758 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a0a99147-6a99-4d44-beb7-e37f703f0fe8 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:07.075266 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a0a99147-6a99-4d44-beb7-e37f703f0fe8 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:07.075735 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a0a99147-6a99-4d44-beb7-e37f703f0fe8 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:07.449117 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-56fc1daf-458b-470c-8d19-9289cd8dad61 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9d40e54481461cba53fedb9a6abdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed2295a58f8451993a57ce0a6f9ba29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:07.463702 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-56fc1daf-458b-470c-8d19-9289cd8dad61 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7f80e3-c2f5-4719-a484-29d6bd0d9e91" status: 200 len: 1318 microversion: 2.1 time: 0.515363 Sep 14 09:00:07.464793 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1352/2651] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:00:06 2022] GET /compute/v2.1/servers/8f7f80e3-c2f5-4719-a484-29d6bd0d9e91 => generated 1318 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:00:07.473241 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-26227912-8035-4676-9bc8-0e214e334540 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Calling method '.version_select at 0x7f7d443c6b80>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:07.493216 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-a0a99147-6a99-4d44-beb7-e37f703f0fe8 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:07.507397 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a0a99147-6a99-4d44-beb7-e37f703f0fe8 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/ef2a3ebb-090f-484c-9749-42c000375ec5" status: 200 len: 1315 microversion: 2.1 time: 0.443194 Sep 14 09:00:07.527927 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1300/2652] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:00:07 2022] GET /compute/v2.1/servers/ef2a3ebb-090f-484c-9749-42c000375ec5 => generated 1315 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:00:07.533704 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-cbf949c9-1cfa-429d-a5d9-a399428ca472 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:07.534543 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-cbf949c9-1cfa-429d-a5d9-a399428ca472 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] [instance: 9ddb5908-22a9-41c8-909c-39cdf479bdd2] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:07.540624 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cbf949c9-1cfa-429d-a5d9-a399428ca472 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:07.541471 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cbf949c9-1cfa-429d-a5d9-a399428ca472 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:07.541777 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cbf949c9-1cfa-429d-a5d9-a399428ca472 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:07.542473 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cbf949c9-1cfa-429d-a5d9-a399428ca472 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:07.543040 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cbf949c9-1cfa-429d-a5d9-a399428ca472 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:07.543511 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cbf949c9-1cfa-429d-a5d9-a399428ca472 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:07.672908 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=4 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:00:07.689158 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-cbf949c9-1cfa-429d-a5d9-a399428ca472 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc9edb486f8481a99778bdac0ef3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d168a11f24eeb861d3451e0c270cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:07.698557 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-cbf949c9-1cfa-429d-a5d9-a399428ca472 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fdc9edb486f8481a99778bdac0ef3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d168a11f24eeb861d3451e0c270cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:07.701565 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-cbf949c9-1cfa-429d-a5d9-a399428ca472 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fdc9edb486f8481a99778bdac0ef3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d168a11f24eeb861d3451e0c270cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:07.707322 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=12 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:00:07.709750 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-cbf949c9-1cfa-429d-a5d9-a399428ca472 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] 10.222.0.60 "GET /compute/v2.1/servers/9ddb5908-22a9-41c8-909c-39cdf479bdd2" status: 200 len: 1447 microversion: 2.75 time: 0.179946 Sep 14 09:00:07.710660 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1301/2653] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:00:07 2022] GET /compute/v2.1/servers/9ddb5908-22a9-41c8-909c-39cdf479bdd2 => generated 1447 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:00:07.814237 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-26227912-8035-4676-9bc8-0e214e334540 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] 10.222.0.60 "GET /compute/v2.1/os-floating-ips/af5b3f84-8bec-497a-b9ff-493e185c7cf1" status: 200 len: 185 microversion: 2.1 time: 0.347718 Sep 14 09:00:07.815089 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1353/2654] 10.222.0.60 () {58 vars in 1260 bytes} [Wed Sep 14 09:00:07 2022] GET /compute/v2.1/os-floating-ips/af5b3f84-8bec-497a-b9ff-493e185c7cf1 => generated 185 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:00:07.834118 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-bff18618-7e71-475f-bd5c-f7272c2759d3 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.9.120"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:00:07.922639 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-6c24b66c-e3d3-4197-8728-eb09d72e6666 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:07.923557 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-6c24b66c-e3d3-4197-8728-eb09d72e6666 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 39890752-2382-4631-8c4a-f3c6d47c94cb] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:07.933673 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6c24b66c-e3d3-4197-8728-eb09d72e6666 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:07.934171 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6c24b66c-e3d3-4197-8728-eb09d72e6666 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:07.934605 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6c24b66c-e3d3-4197-8728-eb09d72e6666 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:07.936131 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6c24b66c-e3d3-4197-8728-eb09d72e6666 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:07.936584 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6c24b66c-e3d3-4197-8728-eb09d72e6666 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:07.937005 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6c24b66c-e3d3-4197-8728-eb09d72e6666 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:07.984348 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-bff18618-7e71-475f-bd5c-f7272c2759d3 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] [instance: 2da88a50-c283-4c91-b3e1-bd4f5eb9e319] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:07.991144 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bff18618-7e71-475f-bd5c-f7272c2759d3 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:07.991792 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bff18618-7e71-475f-bd5c-f7272c2759d3 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:07.992387 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bff18618-7e71-475f-bd5c-f7272c2759d3 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:07.993236 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bff18618-7e71-475f-bd5c-f7272c2759d3 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:07.993986 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bff18618-7e71-475f-bd5c-f7272c2759d3 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:07.994743 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bff18618-7e71-475f-bd5c-f7272c2759d3 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:08.015532 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-6c24b66c-e3d3-4197-8728-eb09d72e6666 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:08.026892 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-6c24b66c-e3d3-4197-8728-eb09d72e6666 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/39890752-2382-4631-8c4a-f3c6d47c94cb" status: 200 len: 1450 microversion: 2.1 time: 0.109337 Sep 14 09:00:08.028422 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1354/2655] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:00:07 2022] GET /compute/v2.1/servers/39890752-2382-4631-8c4a-f3c6d47c94cb => generated 1450 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:00:08.244377 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bff18618-7e71-475f-bd5c-f7272c2759d3 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Acquiring lock "refresh_cache-2da88a50-c283-4c91-b3e1-bd4f5eb9e319" {{(pid=128759) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 14 09:00:08.244944 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bff18618-7e71-475f-bd5c-f7272c2759d3 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Acquired lock "refresh_cache-2da88a50-c283-4c91-b3e1-bd4f5eb9e319" {{(pid=128759) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 14 09:00:08.499286 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-0e5b0a2e-8cbb-4014-9a5c-e732e532b81c tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:08.500250 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-0e5b0a2e-8cbb-4014-9a5c-e732e532b81c tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: 8f7f80e3-c2f5-4719-a484-29d6bd0d9e91] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:08.520233 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0e5b0a2e-8cbb-4014-9a5c-e732e532b81c tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:08.521325 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0e5b0a2e-8cbb-4014-9a5c-e732e532b81c tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:08.521917 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0e5b0a2e-8cbb-4014-9a5c-e732e532b81c tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:08.523396 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0e5b0a2e-8cbb-4014-9a5c-e732e532b81c tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:08.524531 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0e5b0a2e-8cbb-4014-9a5c-e732e532b81c tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:08.525138 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0e5b0a2e-8cbb-4014-9a5c-e732e532b81c tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:09.225036 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-0e5b0a2e-8cbb-4014-9a5c-e732e532b81c tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9d40e54481461cba53fedb9a6abdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed2295a58f8451993a57ce0a6f9ba29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:09.235418 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-0e5b0a2e-8cbb-4014-9a5c-e732e532b81c tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7f80e3-c2f5-4719-a484-29d6bd0d9e91" status: 200 len: 1318 microversion: 2.1 time: 0.747562 Sep 14 09:00:09.247447 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1355/2656] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:00:08 2022] GET /compute/v2.1/servers/8f7f80e3-c2f5-4719-a484-29d6bd0d9e91 => generated 1318 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:00:09.257661 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a4f6fedf-e20d-4fec-8377-709a2ec4e10a tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:09.258423 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-a4f6fedf-e20d-4fec-8377-709a2ec4e10a tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: ef2a3ebb-090f-484c-9749-42c000375ec5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:09.265668 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a4f6fedf-e20d-4fec-8377-709a2ec4e10a tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:09.266170 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a4f6fedf-e20d-4fec-8377-709a2ec4e10a tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:09.266705 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a4f6fedf-e20d-4fec-8377-709a2ec4e10a tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:09.267488 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a4f6fedf-e20d-4fec-8377-709a2ec4e10a tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:09.267951 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a4f6fedf-e20d-4fec-8377-709a2ec4e10a tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:09.268382 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a4f6fedf-e20d-4fec-8377-709a2ec4e10a tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:09.464609 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-a4f6fedf-e20d-4fec-8377-709a2ec4e10a tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:09.473140 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-a4f6fedf-e20d-4fec-8377-709a2ec4e10a tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/ef2a3ebb-090f-484c-9749-42c000375ec5" status: 200 len: 1502 microversion: 2.1 time: 0.224672 Sep 14 09:00:09.473709 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1356/2657] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:00:09 2022] GET /compute/v2.1/servers/ef2a3ebb-090f-484c-9749-42c000375ec5 => generated 1502 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:00:09.487199 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-2dc97eaa-7025-4a5a-bbf2-d462f37c7a08 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:09.487199 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-2dc97eaa-7025-4a5a-bbf2-d462f37c7a08 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] [instance: 9ddb5908-22a9-41c8-909c-39cdf479bdd2] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:09.487199 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2dc97eaa-7025-4a5a-bbf2-d462f37c7a08 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:09.487199 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2dc97eaa-7025-4a5a-bbf2-d462f37c7a08 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:09.487199 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2dc97eaa-7025-4a5a-bbf2-d462f37c7a08 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:09.487199 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2dc97eaa-7025-4a5a-bbf2-d462f37c7a08 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:09.487199 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2dc97eaa-7025-4a5a-bbf2-d462f37c7a08 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:09.487199 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2dc97eaa-7025-4a5a-bbf2-d462f37c7a08 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:09.584579 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-2dc97eaa-7025-4a5a-bbf2-d462f37c7a08 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc9edb486f8481a99778bdac0ef3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d168a11f24eeb861d3451e0c270cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:09.593749 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-2dc97eaa-7025-4a5a-bbf2-d462f37c7a08 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fdc9edb486f8481a99778bdac0ef3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d168a11f24eeb861d3451e0c270cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:09.595439 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-2dc97eaa-7025-4a5a-bbf2-d462f37c7a08 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fdc9edb486f8481a99778bdac0ef3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d168a11f24eeb861d3451e0c270cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:09.601513 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-2dc97eaa-7025-4a5a-bbf2-d462f37c7a08 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] 10.222.0.60 "GET /compute/v2.1/servers/9ddb5908-22a9-41c8-909c-39cdf479bdd2" status: 200 len: 1453 microversion: 2.75 time: 0.126808 Sep 14 09:00:09.611452 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1357/2658] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:00:09 2022] GET /compute/v2.1/servers/9ddb5908-22a9-41c8-909c-39cdf479bdd2 => generated 1453 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:00:09.611452 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-fe0f05aa-829b-4c1c-877e-453088e90f60 req-30ea0250-b79e-407a-9b44-d994a6c3c933 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f7f80e3-c2f5-4719-a484-29d6bd0d9e91", "name": "network-vif-plugged", "status": "completed", "tag": "b19f0267-785e-4700-95e9-c6c0c01d2656"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:00:09.616631 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-fe0f05aa-829b-4c1c-877e-453088e90f60 req-30ea0250-b79e-407a-9b44-d994a6c3c933 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:09.617217 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-fe0f05aa-829b-4c1c-877e-453088e90f60 req-30ea0250-b79e-407a-9b44-d994a6c3c933 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:09.617930 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-fe0f05aa-829b-4c1c-877e-453088e90f60 req-30ea0250-b79e-407a-9b44-d994a6c3c933 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:09.631647 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-fe0f05aa-829b-4c1c-877e-453088e90f60 req-30ea0250-b79e-407a-9b44-d994a6c3c933 service nova] Creating event network-vif-plugged:b19f0267-785e-4700-95e9-c6c0c01d2656 for instance 8f7f80e3-c2f5-4719-a484-29d6bd0d9e91 on n-h2-836830-18 Sep 14 09:00:09.636782 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-fe0f05aa-829b-4c1c-877e-453088e90f60 req-30ea0250-b79e-407a-9b44-d994a6c3c933 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033072 Sep 14 09:00:09.637517 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1358/2659] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:00:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:00:09.643907 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-8a0dd9e8-4007-47fc-a5cc-9a00c9b20273 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:09.644861 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-8a0dd9e8-4007-47fc-a5cc-9a00c9b20273 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 39890752-2382-4631-8c4a-f3c6d47c94cb] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:09.650725 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.network.neutron [None req-bff18618-7e71-475f-bd5c-f7272c2759d3 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] [instance: 2da88a50-c283-4c91-b3e1-bd4f5eb9e319] Building network info cache for instance {{(pid=128759) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 14 09:00:09.651898 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8a0dd9e8-4007-47fc-a5cc-9a00c9b20273 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:09.652478 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8a0dd9e8-4007-47fc-a5cc-9a00c9b20273 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:09.653125 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8a0dd9e8-4007-47fc-a5cc-9a00c9b20273 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:09.653941 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8a0dd9e8-4007-47fc-a5cc-9a00c9b20273 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:09.654406 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8a0dd9e8-4007-47fc-a5cc-9a00c9b20273 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:09.654982 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8a0dd9e8-4007-47fc-a5cc-9a00c9b20273 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:09.705871 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8a0dd9e8-4007-47fc-a5cc-9a00c9b20273 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:09.706478 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8a0dd9e8-4007-47fc-a5cc-9a00c9b20273 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:09.707160 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8a0dd9e8-4007-47fc-a5cc-9a00c9b20273 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:09.707696 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.objects.instance [None req-8a0dd9e8-4007-47fc-a5cc-9a00c9b20273 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lazy-loading 'fault' on Instance uuid 39890752-2382-4631-8c4a-f3c6d47c94cb {{(pid=128758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:00:09.811871 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-8a0dd9e8-4007-47fc-a5cc-9a00c9b20273 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:09.828181 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-8a0dd9e8-4007-47fc-a5cc-9a00c9b20273 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/39890752-2382-4631-8c4a-f3c6d47c94cb" status: 200 len: 1309 microversion: 2.1 time: 0.188635 Sep 14 09:00:09.832065 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1359/2660] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:00:09 2022] GET /compute/v2.1/servers/39890752-2382-4631-8c4a-f3c6d47c94cb => generated 1309 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:00:09.839913 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-f52a942a-da49-44ca-8625-c7fbb7f98150 req-9cde2bbb-80ee-43c1-b018-4787b2df828c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eeed9e16-bc5c-4fb1-b4b9-9c9305c8da73", "name": "network-vif-deleted", "tag": "3fe7de0d-da04-49b7-b880-3c36db11b5aa"}, {"server_uuid": "39890752-2382-4631-8c4a-f3c6d47c94cb", "name": "network-vif-deleted", "tag": "c75c1874-c724-4f8e-ad23-280fad270390"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:00:09.862314 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-f52a942a-da49-44ca-8625-c7fbb7f98150 req-9cde2bbb-80ee-43c1-b018-4787b2df828c service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:09.863121 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-f52a942a-da49-44ca-8625-c7fbb7f98150 req-9cde2bbb-80ee-43c1-b018-4787b2df828c service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:09.863713 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-f52a942a-da49-44ca-8625-c7fbb7f98150 req-9cde2bbb-80ee-43c1-b018-4787b2df828c service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:09.879760 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-f52a942a-da49-44ca-8625-c7fbb7f98150 req-9cde2bbb-80ee-43c1-b018-4787b2df828c service nova] Creating event network-vif-deleted:3fe7de0d-da04-49b7-b880-3c36db11b5aa for instance eeed9e16-bc5c-4fb1-b4b9-9c9305c8da73 on n-h1-836830-18 Sep 14 09:00:09.880524 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-f52a942a-da49-44ca-8625-c7fbb7f98150 req-9cde2bbb-80ee-43c1-b018-4787b2df828c service nova] Creating event network-vif-deleted:c75c1874-c724-4f8e-ad23-280fad270390 for instance 39890752-2382-4631-8c4a-f3c6d47c94cb on n-h2-836830-18 Sep 14 09:00:09.893047 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-f52a942a-da49-44ca-8625-c7fbb7f98150 req-9cde2bbb-80ee-43c1-b018-4787b2df828c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.059549 Sep 14 09:00:09.894266 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1360/2661] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:00:09 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:00:10.262549 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ad3de0ef-1155-421c-9ba5-a58862e88b9b tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:10.264105 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-ad3de0ef-1155-421c-9ba5-a58862e88b9b tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: 8f7f80e3-c2f5-4719-a484-29d6bd0d9e91] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:10.271724 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ad3de0ef-1155-421c-9ba5-a58862e88b9b tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:10.272832 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ad3de0ef-1155-421c-9ba5-a58862e88b9b tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:10.273569 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ad3de0ef-1155-421c-9ba5-a58862e88b9b tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:10.275697 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ad3de0ef-1155-421c-9ba5-a58862e88b9b tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:10.276348 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ad3de0ef-1155-421c-9ba5-a58862e88b9b tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:10.276939 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ad3de0ef-1155-421c-9ba5-a58862e88b9b tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:10.646868 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-ad3de0ef-1155-421c-9ba5-a58862e88b9b tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9d40e54481461cba53fedb9a6abdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed2295a58f8451993a57ce0a6f9ba29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:10.663271 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-ad3de0ef-1155-421c-9ba5-a58862e88b9b tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7f80e3-c2f5-4719-a484-29d6bd0d9e91" status: 200 len: 1318 microversion: 2.1 time: 0.405391 Sep 14 09:00:10.678005 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.network.neutron [None req-bff18618-7e71-475f-bd5c-f7272c2759d3 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] [instance: 2da88a50-c283-4c91-b3e1-bd4f5eb9e319] Updating instance_info_cache with network_info: [{"id": "0e0d5077-876f-4296-b015-ba13bb73c465", "address": "fa:16:3e:c3:7e:b5", "network": {"id": "bb99f4a1-78ca-499c-bb3f-fa3732e743f4", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1051231467-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "d9df06ceaa154f3c80665cc6a27b3598", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap0e0d5077-87", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128759) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 14 09:00:10.682233 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1361/2662] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:00:10 2022] GET /compute/v2.1/servers/8f7f80e3-c2f5-4719-a484-29d6bd0d9e91 => generated 1318 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:00:10.693960 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-77fdf7ac-0be2-4429-8be8-0daa28f69791 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:10.696485 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-77fdf7ac-0be2-4429-8be8-0daa28f69791 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] [instance: 9ddb5908-22a9-41c8-909c-39cdf479bdd2] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:10.703644 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bff18618-7e71-475f-bd5c-f7272c2759d3 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Releasing lock "refresh_cache-2da88a50-c283-4c91-b3e1-bd4f5eb9e319" {{(pid=128759) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 14 09:00:10.704685 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-bff18618-7e71-475f-bd5c-f7272c2759d3 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] 10.222.0.60 "POST /compute/v2.1/servers/2da88a50-c283-4c91-b3e1-bd4f5eb9e319/action" status: 202 len: 0 microversion: 2.1 time: 2.874635 Sep 14 09:00:10.705756 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1302/2663] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:00:07 2022] POST /compute/v2.1/servers/2da88a50-c283-4c91-b3e1-bd4f5eb9e319/action => generated 0 bytes in 2876 msecs (HTTP/1.1 202) 9 headers in 369 bytes (2 switches on core 0) Sep 14 09:00:10.706769 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-77fdf7ac-0be2-4429-8be8-0daa28f69791 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:10.707291 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-77fdf7ac-0be2-4429-8be8-0daa28f69791 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:10.707719 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-77fdf7ac-0be2-4429-8be8-0daa28f69791 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:10.708608 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-77fdf7ac-0be2-4429-8be8-0daa28f69791 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:10.709149 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-77fdf7ac-0be2-4429-8be8-0daa28f69791 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:10.709962 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-77fdf7ac-0be2-4429-8be8-0daa28f69791 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:10.738791 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-5d3a1ec7-a978-43f3-8b31-330d3f4c40f2 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:10.757530 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-5d3a1ec7-a978-43f3-8b31-330d3f4c40f2 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] [instance: eeed9e16-bc5c-4fb1-b4b9-9c9305c8da73] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:10.777124 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5d3a1ec7-a978-43f3-8b31-330d3f4c40f2 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:10.780921 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5d3a1ec7-a978-43f3-8b31-330d3f4c40f2 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:10.781595 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5d3a1ec7-a978-43f3-8b31-330d3f4c40f2 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:10.782500 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5d3a1ec7-a978-43f3-8b31-330d3f4c40f2 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:10.786227 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5d3a1ec7-a978-43f3-8b31-330d3f4c40f2 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:10.786869 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5d3a1ec7-a978-43f3-8b31-330d3f4c40f2 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:10.824277 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-5d3a1ec7-a978-43f3-8b31-330d3f4c40f2 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] HTTP exception thrown: Instance eeed9e16-bc5c-4fb1-b4b9-9c9305c8da73 could not be found. Sep 14 09:00:10.828628 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-5d3a1ec7-a978-43f3-8b31-330d3f4c40f2 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Request method failure captured: Sep 14 09:00:10.828628 n-d-836830-18 devstack@n-api.service[128759]: request: DELETE /compute/v2.1/servers/eeed9e16-bc5c-4fb1-b4b9-9c9305c8da73 HTTP/1.1 Sep 14 09:00:10.828628 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:00:10.828628 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:00:10.828628 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:00:10.828628 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:00:10.828628 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:00:10.828628 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:00:10.828628 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:00:10.828628 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:00:10.828628 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZfiLS4Dd7eH1wltzSbPX84DokZp6CVegujFOyb4EWT2TjTTNUqwjROiHXAC6fhQWjxO3IKN3sTuQg3kPkZqTukAyIteecXLk7I6nAEMGExhj4zko4WfmQUZX-YqQZxk-Lh_HXrlzm3yNQR4KH4lu8yv_rqRCvpzazwcqqm32gFYV5Q Sep 14 09:00:10.828628 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:00:10.828628 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:00:10.828628 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:00:10.828628 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:00:10.828628 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:00:10.828628 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:00:10.828628 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: d9df06ceaa154f3c80665cc6a27b3598 Sep 14 09:00:10.828628 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1544566855 Sep 14 09:00:10.828628 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:00:10.828628 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:00:10.828628 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/d9df06ceaa154f3c80665cc6a27b3598"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_d9df06ceaa154f3c80665cc6a27b3598"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d9df06ceaa154f3c80665cc6a27b3598"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d9df06ceaa154f3c80665cc6a27b3598"}]}] Sep 14 09:00:10.828628 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1544566855 Sep 14 09:00:10.828628 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: d9df06ceaa154f3c80665cc6a27b3598 Sep 14 09:00:10.828628 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1544566855 Sep 14 09:00:10.828628 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-FloatingIPsAssociationTestJSON-1544566855-project Sep 14 09:00:10.828628 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:00:10.828628 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:00:10.828628 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: db65c0cfa83f48468d4a1bcef0caff73 Sep 14 09:00:10.828628 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1544566855-project Sep 14 09:00:10.828628 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:00:10.828628 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance eeed9e16-bc5c-4fb1-b4b9-9c9305c8da73 could not be found. Sep 14 09:00:10.828628 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': 'eeed9e16-bc5c-4fb1-b4b9-9c9305c8da73'} Sep 14 09:00:10.828628 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:00:10.828628 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:00:10.828628 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:00:10.828628 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:00:10.828628 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:00:10.828628 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:00:10.828628 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:00:10.828628 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:00:10.828628 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:00:10.828628 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:00:10.828628 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eeed9e16-bc5c-4fb1-b4b9-9c9305c8da73 could not be found. Sep 14 09:00:10.828628 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:00:10.828628 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:00:10.828628 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:00:10.828628 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:00:10.828628 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:00:10.828628 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:00:10.828628 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:00:10.828628 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:00:10.828628 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:00:10.828628 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:00:10.828628 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 09:00:10.828628 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 09:00:10.828628 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 09:00:10.828628 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 09:00:10.828628 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:00:10.828628 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:00:10.828628 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:00:10.828628 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:00:10.832777 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eeed9e16-bc5c-4fb1-b4b9-9c9305c8da73 could not be found. Sep 14 09:00:10.832777 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:00:10.832777 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:00:10.832777 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:00:10.832777 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:00:10.832777 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:00:10.832777 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:00:10.832777 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:00:10.832777 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:00:10.832777 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eeed9e16-bc5c-4fb1-b4b9-9c9305c8da73 could not be found. Sep 14 09:00:10.832777 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:00:10.835270 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-5d3a1ec7-a978-43f3-8b31-330d3f4c40f2 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Returning 404 to user: Instance eeed9e16-bc5c-4fb1-b4b9-9c9305c8da73 could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:00:10.839229 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-5d3a1ec7-a978-43f3-8b31-330d3f4c40f2 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] 10.222.0.60 "DELETE /compute/v2.1/servers/eeed9e16-bc5c-4fb1-b4b9-9c9305c8da73" status: 404 len: 111 microversion: 2.1 time: 0.126864 Sep 14 09:00:10.844579 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1303/2664] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:00:10 2022] DELETE /compute/v2.1/servers/eeed9e16-bc5c-4fb1-b4b9-9c9305c8da73 => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:00:10.854821 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-414ef658-b8fd-4468-b1d7-6a94d4c4461d tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:10.855492 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-414ef658-b8fd-4468-b1d7-6a94d4c4461d tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] [instance: eeed9e16-bc5c-4fb1-b4b9-9c9305c8da73] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:10.862830 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-414ef658-b8fd-4468-b1d7-6a94d4c4461d tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:10.863407 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-414ef658-b8fd-4468-b1d7-6a94d4c4461d tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:10.863869 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-414ef658-b8fd-4468-b1d7-6a94d4c4461d tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:10.864588 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-414ef658-b8fd-4468-b1d7-6a94d4c4461d tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:10.865050 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-414ef658-b8fd-4468-b1d7-6a94d4c4461d tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:10.865483 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-414ef658-b8fd-4468-b1d7-6a94d4c4461d tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:10.883286 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-414ef658-b8fd-4468-b1d7-6a94d4c4461d tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] HTTP exception thrown: Instance eeed9e16-bc5c-4fb1-b4b9-9c9305c8da73 could not be found. Sep 14 09:00:10.885108 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-414ef658-b8fd-4468-b1d7-6a94d4c4461d tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Request method failure captured: Sep 14 09:00:10.885108 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/eeed9e16-bc5c-4fb1-b4b9-9c9305c8da73 HTTP/1.1 Sep 14 09:00:10.885108 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:00:10.885108 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:00:10.885108 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:00:10.885108 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:00:10.885108 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:00:10.885108 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:00:10.885108 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:00:10.885108 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:00:10.885108 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZfiLS4Dd7eH1wltzSbPX84DokZp6CVegujFOyb4EWT2TjTTNUqwjROiHXAC6fhQWjxO3IKN3sTuQg3kPkZqTukAyIteecXLk7I6nAEMGExhj4zko4WfmQUZX-YqQZxk-Lh_HXrlzm3yNQR4KH4lu8yv_rqRCvpzazwcqqm32gFYV5Q Sep 14 09:00:10.885108 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:00:10.885108 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:00:10.885108 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:00:10.885108 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:00:10.885108 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:00:10.885108 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:00:10.885108 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: d9df06ceaa154f3c80665cc6a27b3598 Sep 14 09:00:10.885108 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1544566855 Sep 14 09:00:10.885108 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:00:10.885108 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:00:10.885108 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/d9df06ceaa154f3c80665cc6a27b3598"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_d9df06ceaa154f3c80665cc6a27b3598"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d9df06ceaa154f3c80665cc6a27b3598"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d9df06ceaa154f3c80665cc6a27b3598"}]}] Sep 14 09:00:10.885108 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1544566855 Sep 14 09:00:10.885108 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: d9df06ceaa154f3c80665cc6a27b3598 Sep 14 09:00:10.885108 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1544566855 Sep 14 09:00:10.885108 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-FloatingIPsAssociationTestJSON-1544566855-project Sep 14 09:00:10.885108 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:00:10.885108 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:00:10.885108 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: db65c0cfa83f48468d4a1bcef0caff73 Sep 14 09:00:10.885108 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1544566855-project Sep 14 09:00:10.885108 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:00:10.885108 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance eeed9e16-bc5c-4fb1-b4b9-9c9305c8da73 could not be found. Sep 14 09:00:10.885108 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': 'eeed9e16-bc5c-4fb1-b4b9-9c9305c8da73'} Sep 14 09:00:10.885108 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:00:10.885108 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:00:10.885108 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:00:10.885108 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:00:10.885108 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:00:10.885108 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:00:10.885108 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:00:10.885108 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:00:10.885108 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:00:10.885108 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:00:10.885108 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eeed9e16-bc5c-4fb1-b4b9-9c9305c8da73 could not be found. Sep 14 09:00:10.885108 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:00:10.885108 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:00:10.885108 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:00:10.885108 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:00:10.885108 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:00:10.885108 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:00:10.885108 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:00:10.885108 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:00:10.885108 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:00:10.885108 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:00:10.885108 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:00:10.885108 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:00:10.885108 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:00:10.885108 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:00:10.885108 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:00:10.885108 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:00:10.885108 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eeed9e16-bc5c-4fb1-b4b9-9c9305c8da73 could not be found. Sep 14 09:00:10.885108 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:00:10.885108 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:00:10.890062 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:00:10.890062 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:00:10.890062 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:00:10.890062 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:00:10.890062 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:00:10.890062 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:00:10.890062 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eeed9e16-bc5c-4fb1-b4b9-9c9305c8da73 could not be found. Sep 14 09:00:10.890062 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:00:10.890062 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-414ef658-b8fd-4468-b1d7-6a94d4c4461d tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Returning 404 to user: Instance eeed9e16-bc5c-4fb1-b4b9-9c9305c8da73 could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:00:10.890062 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-414ef658-b8fd-4468-b1d7-6a94d4c4461d tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] 10.222.0.60 "GET /compute/v2.1/servers/eeed9e16-bc5c-4fb1-b4b9-9c9305c8da73" status: 404 len: 111 microversion: 2.1 time: 0.040781 Sep 14 09:00:10.890062 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1304/2665] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:00:10 2022] GET /compute/v2.1/servers/eeed9e16-bc5c-4fb1-b4b9-9c9305c8da73 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:00:10.892655 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-55f2cbbc-de31-4c0c-96f1-29a726c78492 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:10.893286 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-55f2cbbc-de31-4c0c-96f1-29a726c78492 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 39890752-2382-4631-8c4a-f3c6d47c94cb] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:10.899753 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-55f2cbbc-de31-4c0c-96f1-29a726c78492 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:10.900407 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-55f2cbbc-de31-4c0c-96f1-29a726c78492 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:10.900859 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-55f2cbbc-de31-4c0c-96f1-29a726c78492 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:10.901576 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-55f2cbbc-de31-4c0c-96f1-29a726c78492 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:10.902043 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-55f2cbbc-de31-4c0c-96f1-29a726c78492 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:10.902475 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-55f2cbbc-de31-4c0c-96f1-29a726c78492 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:10.925311 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-55f2cbbc-de31-4c0c-96f1-29a726c78492 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] HTTP exception thrown: Instance 39890752-2382-4631-8c4a-f3c6d47c94cb could not be found. Sep 14 09:00:10.932480 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-55f2cbbc-de31-4c0c-96f1-29a726c78492 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Request method failure captured: Sep 14 09:00:10.932480 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/39890752-2382-4631-8c4a-f3c6d47c94cb HTTP/1.1 Sep 14 09:00:10.932480 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:00:10.932480 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:00:10.932480 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:00:10.932480 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:00:10.932480 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:00:10.932480 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:00:10.932480 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:00:10.932480 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:00:10.932480 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZcaJwfflKXdBQOzu63TKkiZhpOhYfmFkGJTkIRAE47xWaYCE5owpMd6ZGj3T_7h70-IX-88ov5m9P47-8wvvyB1aoACyyMztTclo7X0AZdOhAhE2WQeLs1dhX-NF72boJ9SoR98XdGx2ROr7Y4PciafvjdUpaADdFYghsgULitlVHs Sep 14 09:00:10.932480 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:00:10.932480 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:00:10.932480 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:00:10.932480 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:00:10.932480 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:00:10.932480 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:00:10.932480 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: a46ca7b6c331417199f9dfc5ffa80470 Sep 14 09:00:10.932480 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ServersTestJSON-1483820673 Sep 14 09:00:10.932480 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:00:10.932480 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:00:10.932480 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a46ca7b6c331417199f9dfc5ffa80470"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a46ca7b6c331417199f9dfc5ffa80470"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a46ca7b6c331417199f9dfc5ffa80470"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a46ca7b6c331417199f9dfc5ffa80470"}]}] Sep 14 09:00:10.932480 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ServersTestJSON-1483820673 Sep 14 09:00:10.932480 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: a46ca7b6c331417199f9dfc5ffa80470 Sep 14 09:00:10.932480 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ServersTestJSON-1483820673 Sep 14 09:00:10.932480 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ServersTestJSON-1483820673-project Sep 14 09:00:10.932480 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:00:10.932480 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:00:10.932480 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 1473e6771ff1459c831d66311318404d Sep 14 09:00:10.932480 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ServersTestJSON-1483820673-project Sep 14 09:00:10.932480 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:00:10.932480 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance 39890752-2382-4631-8c4a-f3c6d47c94cb could not be found. Sep 14 09:00:10.932480 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '39890752-2382-4631-8c4a-f3c6d47c94cb'} Sep 14 09:00:10.932480 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:00:10.932480 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:00:10.932480 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:00:10.932480 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:00:10.932480 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:00:10.932480 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:00:10.932480 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:00:10.932480 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:00:10.932480 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:00:10.932480 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:00:10.932480 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39890752-2382-4631-8c4a-f3c6d47c94cb could not be found. Sep 14 09:00:10.932480 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:00:10.932480 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:00:10.932480 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:00:10.932480 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:00:10.932480 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:00:10.932480 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:00:10.932480 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:00:10.932480 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:00:10.932480 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:00:10.932480 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:00:10.932480 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:00:10.932480 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:00:10.932480 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:00:10.932480 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:00:10.932480 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:00:10.932480 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:00:10.932480 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39890752-2382-4631-8c4a-f3c6d47c94cb could not be found. Sep 14 09:00:10.932480 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:00:10.932480 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:00:10.932480 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:00:10.937753 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:00:10.937753 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:00:10.937753 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:00:10.937753 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:00:10.937753 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:00:10.937753 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39890752-2382-4631-8c4a-f3c6d47c94cb could not be found. Sep 14 09:00:10.937753 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:00:10.937753 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-55f2cbbc-de31-4c0c-96f1-29a726c78492 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Returning 404 to user: Instance 39890752-2382-4631-8c4a-f3c6d47c94cb could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:00:10.937753 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-55f2cbbc-de31-4c0c-96f1-29a726c78492 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/39890752-2382-4631-8c4a-f3c6d47c94cb" status: 404 len: 111 microversion: 2.1 time: 0.045944 Sep 14 09:00:10.940024 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1305/2666] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:00:10 2022] GET /compute/v2.1/servers/39890752-2382-4631-8c4a-f3c6d47c94cb => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:00:10.945068 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-82c8eee9-b9d0-4187-878a-4c9328840ff7 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Calling method '.version_select at 0x7f7d4879f670>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:10.965912 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-77fdf7ac-0be2-4429-8be8-0daa28f69791 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc9edb486f8481a99778bdac0ef3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d168a11f24eeb861d3451e0c270cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:10.979564 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-77fdf7ac-0be2-4429-8be8-0daa28f69791 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fdc9edb486f8481a99778bdac0ef3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d168a11f24eeb861d3451e0c270cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:10.981979 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-77fdf7ac-0be2-4429-8be8-0daa28f69791 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fdc9edb486f8481a99778bdac0ef3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d168a11f24eeb861d3451e0c270cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:10.995249 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-77fdf7ac-0be2-4429-8be8-0daa28f69791 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] 10.222.0.60 "GET /compute/v2.1/servers/9ddb5908-22a9-41c8-909c-39cdf479bdd2" status: 200 len: 1453 microversion: 2.75 time: 0.303869 Sep 14 09:00:10.995249 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1362/2667] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:00:10 2022] GET /compute/v2.1/servers/9ddb5908-22a9-41c8-909c-39cdf479bdd2 => generated 1453 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:00:10.995249 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-e3d96ecd-3b78-4504-a1cd-9bbaf7dcf765 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:10.995249 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-e3d96ecd-3b78-4504-a1cd-9bbaf7dcf765 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 39890752-2382-4631-8c4a-f3c6d47c94cb] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:11.008618 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e3d96ecd-3b78-4504-a1cd-9bbaf7dcf765 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:11.008618 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e3d96ecd-3b78-4504-a1cd-9bbaf7dcf765 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:11.008618 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e3d96ecd-3b78-4504-a1cd-9bbaf7dcf765 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:11.008618 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e3d96ecd-3b78-4504-a1cd-9bbaf7dcf765 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:11.009549 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e3d96ecd-3b78-4504-a1cd-9bbaf7dcf765 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:11.009866 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e3d96ecd-3b78-4504-a1cd-9bbaf7dcf765 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:11.016344 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:00:11.030531 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-e3d96ecd-3b78-4504-a1cd-9bbaf7dcf765 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] HTTP exception thrown: Instance 39890752-2382-4631-8c4a-f3c6d47c94cb could not be found. Sep 14 09:00:11.033055 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-e3d96ecd-3b78-4504-a1cd-9bbaf7dcf765 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Request method failure captured: Sep 14 09:00:11.033055 n-d-836830-18 devstack@n-api.service[128758]: request: DELETE /compute/v2.1/servers/39890752-2382-4631-8c4a-f3c6d47c94cb HTTP/1.1 Sep 14 09:00:11.033055 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 09:00:11.033055 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 09:00:11.033055 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 09:00:11.033055 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 09:00:11.033055 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 09:00:11.033055 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 09:00:11.033055 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 09:00:11.033055 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 09:00:11.033055 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZcaJwfflKXdBQOzu63TKkiZhpOhYfmFkGJTkIRAE47xWaYCE5owpMd6ZGj3T_7h70-IX-88ov5m9P47-8wvvyB1aoACyyMztTclo7X0AZdOhAhE2WQeLs1dhX-NF72boJ9SoR98XdGx2ROr7Y4PciafvjdUpaADdFYghsgULitlVHs Sep 14 09:00:11.033055 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 09:00:11.033055 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 09:00:11.033055 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 09:00:11.033055 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 09:00:11.033055 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 09:00:11.033055 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 09:00:11.033055 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: a46ca7b6c331417199f9dfc5ffa80470 Sep 14 09:00:11.033055 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-ServersTestJSON-1483820673 Sep 14 09:00:11.033055 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 09:00:11.033055 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 09:00:11.033055 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a46ca7b6c331417199f9dfc5ffa80470"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a46ca7b6c331417199f9dfc5ffa80470"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a46ca7b6c331417199f9dfc5ffa80470"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a46ca7b6c331417199f9dfc5ffa80470"}]}] Sep 14 09:00:11.033055 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-ServersTestJSON-1483820673 Sep 14 09:00:11.033055 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: a46ca7b6c331417199f9dfc5ffa80470 Sep 14 09:00:11.033055 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-ServersTestJSON-1483820673 Sep 14 09:00:11.033055 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-ServersTestJSON-1483820673-project Sep 14 09:00:11.033055 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 09:00:11.033055 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 09:00:11.033055 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 1473e6771ff1459c831d66311318404d Sep 14 09:00:11.033055 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-ServersTestJSON-1483820673-project Sep 14 09:00:11.033055 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 09:00:11.033055 n-d-836830-18 devstack@n-api.service[128758]: exception: Instance 39890752-2382-4631-8c4a-f3c6d47c94cb could not be found. Sep 14 09:00:11.033055 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': '39890752-2382-4631-8c4a-f3c6d47c94cb'} Sep 14 09:00:11.033055 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:00:11.033055 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:00:11.033055 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:00:11.033055 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:00:11.033055 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:00:11.033055 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:00:11.033055 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:00:11.033055 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:00:11.033055 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:00:11.033055 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:00:11.033055 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39890752-2382-4631-8c4a-f3c6d47c94cb could not be found. Sep 14 09:00:11.033055 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:00:11.033055 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:00:11.033055 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:00:11.033055 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:00:11.033055 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:00:11.033055 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:00:11.033055 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:00:11.033055 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:00:11.033055 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:00:11.033055 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:00:11.033055 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 09:00:11.033055 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 09:00:11.033055 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 09:00:11.033055 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 09:00:11.033055 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:00:11.033055 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:00:11.033055 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:00:11.033055 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:00:11.033055 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39890752-2382-4631-8c4a-f3c6d47c94cb could not be found. Sep 14 09:00:11.038532 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:00:11.038532 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:00:11.038532 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:00:11.038532 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:00:11.038532 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:00:11.038532 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:00:11.038532 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:00:11.038532 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:00:11.038532 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39890752-2382-4631-8c4a-f3c6d47c94cb could not be found. Sep 14 09:00:11.038532 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:00:11.038532 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-e3d96ecd-3b78-4504-a1cd-9bbaf7dcf765 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Returning 404 to user: Instance 39890752-2382-4631-8c4a-f3c6d47c94cb could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:00:11.038532 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-e3d96ecd-3b78-4504-a1cd-9bbaf7dcf765 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "DELETE /compute/v2.1/servers/39890752-2382-4631-8c4a-f3c6d47c94cb" status: 404 len: 111 microversion: 2.1 time: 0.044061 Sep 14 09:00:11.039522 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1363/2668] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:00:10 2022] DELETE /compute/v2.1/servers/39890752-2382-4631-8c4a-f3c6d47c94cb => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:00:11.044243 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-dd28517b-594f-4db9-ae15-6604350866df tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "74eeaa52-0643-487d-a8fc-bced49fac641"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:00:11.046782 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-dd28517b-594f-4db9-ae15-6604350866df tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: ef2a3ebb-090f-484c-9749-42c000375ec5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:11.054019 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dd28517b-594f-4db9-ae15-6604350866df tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:11.054506 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dd28517b-594f-4db9-ae15-6604350866df tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:11.054962 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dd28517b-594f-4db9-ae15-6604350866df tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:11.055651 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dd28517b-594f-4db9-ae15-6604350866df tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:11.056098 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dd28517b-594f-4db9-ae15-6604350866df tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:11.056533 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dd28517b-594f-4db9-ae15-6604350866df tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:11.343841 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-dd28517b-594f-4db9-ae15-6604350866df tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "POST /compute/v2.1/servers/ef2a3ebb-090f-484c-9749-42c000375ec5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.303855 Sep 14 09:00:11.344483 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1364/2669] 10.222.0.60 () {60 vars in 1323 bytes} [Wed Sep 14 09:00:11 2022] POST /compute/v2.1/servers/ef2a3ebb-090f-484c-9749-42c000375ec5/os-volume_attachments => generated 194 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:00:11.350907 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-dac83fcf-1601-4953-8b30-4cde51e249d4 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:11.352019 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-dac83fcf-1601-4953-8b30-4cde51e249d4 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 39890752-2382-4631-8c4a-f3c6d47c94cb] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:11.359766 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dac83fcf-1601-4953-8b30-4cde51e249d4 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:11.360433 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dac83fcf-1601-4953-8b30-4cde51e249d4 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:11.361080 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dac83fcf-1601-4953-8b30-4cde51e249d4 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:11.361963 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dac83fcf-1601-4953-8b30-4cde51e249d4 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:11.362636 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dac83fcf-1601-4953-8b30-4cde51e249d4 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:11.363086 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dac83fcf-1601-4953-8b30-4cde51e249d4 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:11.378614 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-dac83fcf-1601-4953-8b30-4cde51e249d4 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] HTTP exception thrown: Instance 39890752-2382-4631-8c4a-f3c6d47c94cb could not be found. Sep 14 09:00:11.380387 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-dac83fcf-1601-4953-8b30-4cde51e249d4 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Request method failure captured: Sep 14 09:00:11.380387 n-d-836830-18 devstack@n-api.service[128758]: request: GET /compute/v2.1/servers/39890752-2382-4631-8c4a-f3c6d47c94cb HTTP/1.1 Sep 14 09:00:11.380387 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 09:00:11.380387 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 09:00:11.380387 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 09:00:11.380387 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 09:00:11.380387 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 09:00:11.380387 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 09:00:11.380387 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 09:00:11.380387 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 09:00:11.380387 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZcaJwfflKXdBQOzu63TKkiZhpOhYfmFkGJTkIRAE47xWaYCE5owpMd6ZGj3T_7h70-IX-88ov5m9P47-8wvvyB1aoACyyMztTclo7X0AZdOhAhE2WQeLs1dhX-NF72boJ9SoR98XdGx2ROr7Y4PciafvjdUpaADdFYghsgULitlVHs Sep 14 09:00:11.380387 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 09:00:11.380387 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 09:00:11.380387 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 09:00:11.380387 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 09:00:11.380387 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 09:00:11.380387 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 09:00:11.380387 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: a46ca7b6c331417199f9dfc5ffa80470 Sep 14 09:00:11.380387 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-ServersTestJSON-1483820673 Sep 14 09:00:11.380387 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 09:00:11.380387 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 09:00:11.380387 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a46ca7b6c331417199f9dfc5ffa80470"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a46ca7b6c331417199f9dfc5ffa80470"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a46ca7b6c331417199f9dfc5ffa80470"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a46ca7b6c331417199f9dfc5ffa80470"}]}] Sep 14 09:00:11.380387 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-ServersTestJSON-1483820673 Sep 14 09:00:11.380387 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: a46ca7b6c331417199f9dfc5ffa80470 Sep 14 09:00:11.380387 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-ServersTestJSON-1483820673 Sep 14 09:00:11.380387 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-ServersTestJSON-1483820673-project Sep 14 09:00:11.380387 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 09:00:11.380387 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 09:00:11.380387 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 1473e6771ff1459c831d66311318404d Sep 14 09:00:11.380387 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-ServersTestJSON-1483820673-project Sep 14 09:00:11.380387 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 09:00:11.380387 n-d-836830-18 devstack@n-api.service[128758]: exception: Instance 39890752-2382-4631-8c4a-f3c6d47c94cb could not be found. Sep 14 09:00:11.380387 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': '39890752-2382-4631-8c4a-f3c6d47c94cb'} Sep 14 09:00:11.380387 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:00:11.380387 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:00:11.380387 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:00:11.380387 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:00:11.380387 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:00:11.380387 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:00:11.380387 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:00:11.380387 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:00:11.380387 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:00:11.380387 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:00:11.380387 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39890752-2382-4631-8c4a-f3c6d47c94cb could not be found. Sep 14 09:00:11.380387 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:00:11.380387 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:00:11.380387 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:00:11.380387 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:00:11.380387 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:00:11.380387 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:00:11.380387 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:00:11.380387 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:00:11.380387 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:00:11.380387 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:00:11.380387 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:00:11.380387 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:00:11.380387 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:00:11.380387 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:00:11.380387 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:00:11.380387 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:00:11.380387 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39890752-2382-4631-8c4a-f3c6d47c94cb could not be found. Sep 14 09:00:11.380387 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:00:11.380387 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:00:11.380387 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:00:11.384534 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:00:11.384534 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:00:11.384534 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:00:11.384534 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:00:11.384534 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:00:11.384534 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39890752-2382-4631-8c4a-f3c6d47c94cb could not be found. Sep 14 09:00:11.384534 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:00:11.384534 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-dac83fcf-1601-4953-8b30-4cde51e249d4 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Returning 404 to user: Instance 39890752-2382-4631-8c4a-f3c6d47c94cb could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:00:11.384534 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-dac83fcf-1601-4953-8b30-4cde51e249d4 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/39890752-2382-4631-8c4a-f3c6d47c94cb" status: 404 len: 111 microversion: 2.1 time: 0.035488 Sep 14 09:00:11.384534 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1365/2670] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:00:11 2022] GET /compute/v2.1/servers/39890752-2382-4631-8c4a-f3c6d47c94cb => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:00:11.391126 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-052c7339-e2f6-4b23-ba67-4a6e6f4d9b10 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:11.391770 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-052c7339-e2f6-4b23-ba67-4a6e6f4d9b10 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: affb61a7-7e36-4424-bf48-a5a6bd64ae29] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:11.398629 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-052c7339-e2f6-4b23-ba67-4a6e6f4d9b10 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:11.400161 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-052c7339-e2f6-4b23-ba67-4a6e6f4d9b10 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:11.400601 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-052c7339-e2f6-4b23-ba67-4a6e6f4d9b10 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:11.401315 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-052c7339-e2f6-4b23-ba67-4a6e6f4d9b10 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:11.401811 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-052c7339-e2f6-4b23-ba67-4a6e6f4d9b10 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:11.402241 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-052c7339-e2f6-4b23-ba67-4a6e6f4d9b10 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:11.421256 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-052c7339-e2f6-4b23-ba67-4a6e6f4d9b10 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] HTTP exception thrown: Instance affb61a7-7e36-4424-bf48-a5a6bd64ae29 could not be found. Sep 14 09:00:11.422813 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-052c7339-e2f6-4b23-ba67-4a6e6f4d9b10 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Request method failure captured: Sep 14 09:00:11.422813 n-d-836830-18 devstack@n-api.service[128758]: request: DELETE /compute/v2.1/servers/affb61a7-7e36-4424-bf48-a5a6bd64ae29 HTTP/1.1 Sep 14 09:00:11.422813 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 09:00:11.422813 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 09:00:11.422813 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 09:00:11.422813 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 09:00:11.422813 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 09:00:11.422813 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 09:00:11.422813 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 09:00:11.422813 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 09:00:11.422813 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZcaJwfflKXdBQOzu63TKkiZhpOhYfmFkGJTkIRAE47xWaYCE5owpMd6ZGj3T_7h70-IX-88ov5m9P47-8wvvyB1aoACyyMztTclo7X0AZdOhAhE2WQeLs1dhX-NF72boJ9SoR98XdGx2ROr7Y4PciafvjdUpaADdFYghsgULitlVHs Sep 14 09:00:11.422813 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 09:00:11.422813 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 09:00:11.422813 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 09:00:11.422813 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 09:00:11.422813 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 09:00:11.422813 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 09:00:11.422813 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: a46ca7b6c331417199f9dfc5ffa80470 Sep 14 09:00:11.422813 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-ServersTestJSON-1483820673 Sep 14 09:00:11.422813 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 09:00:11.422813 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 09:00:11.422813 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a46ca7b6c331417199f9dfc5ffa80470"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a46ca7b6c331417199f9dfc5ffa80470"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a46ca7b6c331417199f9dfc5ffa80470"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a46ca7b6c331417199f9dfc5ffa80470"}]}] Sep 14 09:00:11.422813 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-ServersTestJSON-1483820673 Sep 14 09:00:11.422813 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: a46ca7b6c331417199f9dfc5ffa80470 Sep 14 09:00:11.422813 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-ServersTestJSON-1483820673 Sep 14 09:00:11.422813 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-ServersTestJSON-1483820673-project Sep 14 09:00:11.422813 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 09:00:11.422813 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 09:00:11.422813 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 1473e6771ff1459c831d66311318404d Sep 14 09:00:11.422813 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-ServersTestJSON-1483820673-project Sep 14 09:00:11.422813 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 09:00:11.422813 n-d-836830-18 devstack@n-api.service[128758]: exception: Instance affb61a7-7e36-4424-bf48-a5a6bd64ae29 could not be found. Sep 14 09:00:11.422813 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': 'affb61a7-7e36-4424-bf48-a5a6bd64ae29'} Sep 14 09:00:11.422813 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:00:11.422813 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:00:11.422813 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:00:11.422813 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:00:11.422813 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:00:11.422813 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:00:11.422813 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:00:11.422813 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:00:11.422813 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:00:11.422813 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:00:11.422813 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance affb61a7-7e36-4424-bf48-a5a6bd64ae29 could not be found. Sep 14 09:00:11.422813 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:00:11.422813 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:00:11.422813 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:00:11.422813 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:00:11.422813 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:00:11.422813 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:00:11.422813 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:00:11.422813 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:00:11.422813 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:00:11.422813 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:00:11.422813 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 09:00:11.422813 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 09:00:11.422813 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 09:00:11.422813 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 09:00:11.422813 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:00:11.422813 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:00:11.422813 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:00:11.422813 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:00:11.422813 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance affb61a7-7e36-4424-bf48-a5a6bd64ae29 could not be found. Sep 14 09:00:11.426742 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:00:11.426742 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:00:11.426742 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:00:11.426742 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:00:11.426742 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:00:11.426742 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:00:11.426742 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:00:11.426742 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:00:11.426742 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance affb61a7-7e36-4424-bf48-a5a6bd64ae29 could not be found. Sep 14 09:00:11.426742 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:00:11.426742 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-052c7339-e2f6-4b23-ba67-4a6e6f4d9b10 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Returning 404 to user: Instance affb61a7-7e36-4424-bf48-a5a6bd64ae29 could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:00:11.426742 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-052c7339-e2f6-4b23-ba67-4a6e6f4d9b10 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "DELETE /compute/v2.1/servers/affb61a7-7e36-4424-bf48-a5a6bd64ae29" status: 404 len: 111 microversion: 2.1 time: 0.037527 Sep 14 09:00:11.426742 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1366/2671] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:00:11 2022] DELETE /compute/v2.1/servers/affb61a7-7e36-4424-bf48-a5a6bd64ae29 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:00:11.437835 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d54a7f92-8226-49f6-9b7a-cb659053b8c7 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:11.438463 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-d54a7f92-8226-49f6-9b7a-cb659053b8c7 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: affb61a7-7e36-4424-bf48-a5a6bd64ae29] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:11.446220 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d54a7f92-8226-49f6-9b7a-cb659053b8c7 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:11.447285 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d54a7f92-8226-49f6-9b7a-cb659053b8c7 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:11.447627 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d54a7f92-8226-49f6-9b7a-cb659053b8c7 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:11.448346 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d54a7f92-8226-49f6-9b7a-cb659053b8c7 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:11.448981 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d54a7f92-8226-49f6-9b7a-cb659053b8c7 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:11.449742 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d54a7f92-8226-49f6-9b7a-cb659053b8c7 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:11.467269 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-d54a7f92-8226-49f6-9b7a-cb659053b8c7 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] HTTP exception thrown: Instance affb61a7-7e36-4424-bf48-a5a6bd64ae29 could not be found. Sep 14 09:00:11.470505 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d54a7f92-8226-49f6-9b7a-cb659053b8c7 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Request method failure captured: Sep 14 09:00:11.470505 n-d-836830-18 devstack@n-api.service[128758]: request: GET /compute/v2.1/servers/affb61a7-7e36-4424-bf48-a5a6bd64ae29 HTTP/1.1 Sep 14 09:00:11.470505 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 09:00:11.470505 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 09:00:11.470505 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 09:00:11.470505 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 09:00:11.470505 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 09:00:11.470505 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 09:00:11.470505 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 09:00:11.470505 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 09:00:11.470505 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZcaJwfflKXdBQOzu63TKkiZhpOhYfmFkGJTkIRAE47xWaYCE5owpMd6ZGj3T_7h70-IX-88ov5m9P47-8wvvyB1aoACyyMztTclo7X0AZdOhAhE2WQeLs1dhX-NF72boJ9SoR98XdGx2ROr7Y4PciafvjdUpaADdFYghsgULitlVHs Sep 14 09:00:11.470505 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 09:00:11.470505 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 09:00:11.470505 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 09:00:11.470505 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 09:00:11.470505 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 09:00:11.470505 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 09:00:11.470505 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: a46ca7b6c331417199f9dfc5ffa80470 Sep 14 09:00:11.470505 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-ServersTestJSON-1483820673 Sep 14 09:00:11.470505 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 09:00:11.470505 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 09:00:11.470505 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a46ca7b6c331417199f9dfc5ffa80470"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a46ca7b6c331417199f9dfc5ffa80470"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a46ca7b6c331417199f9dfc5ffa80470"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a46ca7b6c331417199f9dfc5ffa80470"}]}] Sep 14 09:00:11.470505 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-ServersTestJSON-1483820673 Sep 14 09:00:11.470505 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: a46ca7b6c331417199f9dfc5ffa80470 Sep 14 09:00:11.470505 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-ServersTestJSON-1483820673 Sep 14 09:00:11.470505 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-ServersTestJSON-1483820673-project Sep 14 09:00:11.470505 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 09:00:11.470505 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 09:00:11.470505 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 1473e6771ff1459c831d66311318404d Sep 14 09:00:11.470505 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-ServersTestJSON-1483820673-project Sep 14 09:00:11.470505 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 09:00:11.470505 n-d-836830-18 devstack@n-api.service[128758]: exception: Instance affb61a7-7e36-4424-bf48-a5a6bd64ae29 could not be found. Sep 14 09:00:11.470505 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': 'affb61a7-7e36-4424-bf48-a5a6bd64ae29'} Sep 14 09:00:11.470505 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:00:11.470505 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:00:11.470505 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:00:11.470505 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:00:11.470505 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:00:11.470505 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:00:11.470505 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:00:11.470505 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:00:11.470505 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:00:11.470505 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:00:11.470505 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance affb61a7-7e36-4424-bf48-a5a6bd64ae29 could not be found. Sep 14 09:00:11.470505 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:00:11.470505 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:00:11.470505 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:00:11.470505 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:00:11.470505 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:00:11.470505 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:00:11.470505 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:00:11.470505 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:00:11.470505 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:00:11.470505 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:00:11.470505 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:00:11.470505 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:00:11.470505 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:00:11.470505 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:00:11.470505 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:00:11.470505 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:00:11.470505 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance affb61a7-7e36-4424-bf48-a5a6bd64ae29 could not be found. Sep 14 09:00:11.470505 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:00:11.470505 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:00:11.470505 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:00:11.478842 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:00:11.478842 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:00:11.478842 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:00:11.478842 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:00:11.478842 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:00:11.478842 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance affb61a7-7e36-4424-bf48-a5a6bd64ae29 could not be found. Sep 14 09:00:11.478842 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:00:11.478842 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d54a7f92-8226-49f6-9b7a-cb659053b8c7 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Returning 404 to user: Instance affb61a7-7e36-4424-bf48-a5a6bd64ae29 could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:00:11.478842 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-d54a7f92-8226-49f6-9b7a-cb659053b8c7 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/affb61a7-7e36-4424-bf48-a5a6bd64ae29" status: 404 len: 111 microversion: 2.1 time: 0.039972 Sep 14 09:00:11.478842 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1367/2672] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:00:11 2022] GET /compute/v2.1/servers/affb61a7-7e36-4424-bf48-a5a6bd64ae29 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:00:11.483039 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a0cff9f6-6ee4-4a25-9f9f-5f162154984b tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:11.483543 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-a0cff9f6-6ee4-4a25-9f9f-5f162154984b tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 5ee0a6e1-d106-4955-a894-7fe2ac13ffb0] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:11.491208 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a0cff9f6-6ee4-4a25-9f9f-5f162154984b tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:11.491729 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a0cff9f6-6ee4-4a25-9f9f-5f162154984b tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:11.492288 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a0cff9f6-6ee4-4a25-9f9f-5f162154984b tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:11.493302 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a0cff9f6-6ee4-4a25-9f9f-5f162154984b tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:11.493763 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a0cff9f6-6ee4-4a25-9f9f-5f162154984b tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:11.494219 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a0cff9f6-6ee4-4a25-9f9f-5f162154984b tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:11.508514 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-a0cff9f6-6ee4-4a25-9f9f-5f162154984b tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] HTTP exception thrown: Instance 5ee0a6e1-d106-4955-a894-7fe2ac13ffb0 could not be found. Sep 14 09:00:11.510066 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a0cff9f6-6ee4-4a25-9f9f-5f162154984b tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Request method failure captured: Sep 14 09:00:11.510066 n-d-836830-18 devstack@n-api.service[128758]: request: DELETE /compute/v2.1/servers/5ee0a6e1-d106-4955-a894-7fe2ac13ffb0 HTTP/1.1 Sep 14 09:00:11.510066 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 09:00:11.510066 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 09:00:11.510066 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 09:00:11.510066 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 09:00:11.510066 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 09:00:11.510066 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 09:00:11.510066 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 09:00:11.510066 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 09:00:11.510066 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZcaJwfflKXdBQOzu63TKkiZhpOhYfmFkGJTkIRAE47xWaYCE5owpMd6ZGj3T_7h70-IX-88ov5m9P47-8wvvyB1aoACyyMztTclo7X0AZdOhAhE2WQeLs1dhX-NF72boJ9SoR98XdGx2ROr7Y4PciafvjdUpaADdFYghsgULitlVHs Sep 14 09:00:11.510066 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 09:00:11.510066 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 09:00:11.510066 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 09:00:11.510066 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 09:00:11.510066 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 09:00:11.510066 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 09:00:11.510066 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: a46ca7b6c331417199f9dfc5ffa80470 Sep 14 09:00:11.510066 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-ServersTestJSON-1483820673 Sep 14 09:00:11.510066 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 09:00:11.510066 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 09:00:11.510066 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a46ca7b6c331417199f9dfc5ffa80470"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a46ca7b6c331417199f9dfc5ffa80470"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a46ca7b6c331417199f9dfc5ffa80470"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a46ca7b6c331417199f9dfc5ffa80470"}]}] Sep 14 09:00:11.510066 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-ServersTestJSON-1483820673 Sep 14 09:00:11.510066 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: a46ca7b6c331417199f9dfc5ffa80470 Sep 14 09:00:11.510066 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-ServersTestJSON-1483820673 Sep 14 09:00:11.510066 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-ServersTestJSON-1483820673-project Sep 14 09:00:11.510066 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 09:00:11.510066 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 09:00:11.510066 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 1473e6771ff1459c831d66311318404d Sep 14 09:00:11.510066 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-ServersTestJSON-1483820673-project Sep 14 09:00:11.510066 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 09:00:11.510066 n-d-836830-18 devstack@n-api.service[128758]: exception: Instance 5ee0a6e1-d106-4955-a894-7fe2ac13ffb0 could not be found. Sep 14 09:00:11.510066 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': '5ee0a6e1-d106-4955-a894-7fe2ac13ffb0'} Sep 14 09:00:11.510066 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:00:11.510066 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:00:11.510066 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:00:11.510066 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:00:11.510066 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:00:11.510066 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:00:11.510066 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:00:11.510066 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:00:11.510066 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:00:11.510066 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:00:11.510066 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ee0a6e1-d106-4955-a894-7fe2ac13ffb0 could not be found. Sep 14 09:00:11.510066 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:00:11.510066 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:00:11.510066 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:00:11.510066 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:00:11.510066 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:00:11.510066 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:00:11.510066 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:00:11.510066 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:00:11.510066 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:00:11.510066 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:00:11.510066 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 09:00:11.510066 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 09:00:11.510066 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 09:00:11.510066 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 09:00:11.510066 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:00:11.510066 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:00:11.510066 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:00:11.510066 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:00:11.510066 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ee0a6e1-d106-4955-a894-7fe2ac13ffb0 could not be found. Sep 14 09:00:11.514034 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:00:11.514034 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:00:11.514034 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:00:11.514034 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:00:11.514034 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:00:11.514034 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:00:11.514034 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:00:11.514034 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:00:11.514034 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ee0a6e1-d106-4955-a894-7fe2ac13ffb0 could not be found. Sep 14 09:00:11.514034 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:00:11.514034 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a0cff9f6-6ee4-4a25-9f9f-5f162154984b tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Returning 404 to user: Instance 5ee0a6e1-d106-4955-a894-7fe2ac13ffb0 could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:00:11.514034 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-a0cff9f6-6ee4-4a25-9f9f-5f162154984b tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "DELETE /compute/v2.1/servers/5ee0a6e1-d106-4955-a894-7fe2ac13ffb0" status: 404 len: 111 microversion: 2.1 time: 0.034554 Sep 14 09:00:11.514034 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1368/2673] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:00:11 2022] DELETE /compute/v2.1/servers/5ee0a6e1-d106-4955-a894-7fe2ac13ffb0 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:00:11.519791 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-8c31848b-2cf7-41c4-a0ef-6a1b6c402450 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:11.520406 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-8c31848b-2cf7-41c4-a0ef-6a1b6c402450 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 5ee0a6e1-d106-4955-a894-7fe2ac13ffb0] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:11.527046 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8c31848b-2cf7-41c4-a0ef-6a1b6c402450 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:11.527534 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8c31848b-2cf7-41c4-a0ef-6a1b6c402450 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:11.527972 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8c31848b-2cf7-41c4-a0ef-6a1b6c402450 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:11.528668 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8c31848b-2cf7-41c4-a0ef-6a1b6c402450 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:11.529154 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8c31848b-2cf7-41c4-a0ef-6a1b6c402450 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:11.529593 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8c31848b-2cf7-41c4-a0ef-6a1b6c402450 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:11.544236 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-8c31848b-2cf7-41c4-a0ef-6a1b6c402450 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] HTTP exception thrown: Instance 5ee0a6e1-d106-4955-a894-7fe2ac13ffb0 could not be found. Sep 14 09:00:11.546466 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-8c31848b-2cf7-41c4-a0ef-6a1b6c402450 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Request method failure captured: Sep 14 09:00:11.546466 n-d-836830-18 devstack@n-api.service[128758]: request: GET /compute/v2.1/servers/5ee0a6e1-d106-4955-a894-7fe2ac13ffb0 HTTP/1.1 Sep 14 09:00:11.546466 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 09:00:11.546466 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 09:00:11.546466 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 09:00:11.546466 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 09:00:11.546466 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 09:00:11.546466 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 09:00:11.546466 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 09:00:11.546466 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 09:00:11.546466 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZcaJwfflKXdBQOzu63TKkiZhpOhYfmFkGJTkIRAE47xWaYCE5owpMd6ZGj3T_7h70-IX-88ov5m9P47-8wvvyB1aoACyyMztTclo7X0AZdOhAhE2WQeLs1dhX-NF72boJ9SoR98XdGx2ROr7Y4PciafvjdUpaADdFYghsgULitlVHs Sep 14 09:00:11.546466 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 09:00:11.546466 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 09:00:11.546466 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 09:00:11.546466 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 09:00:11.546466 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 09:00:11.546466 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 09:00:11.546466 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: a46ca7b6c331417199f9dfc5ffa80470 Sep 14 09:00:11.546466 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-ServersTestJSON-1483820673 Sep 14 09:00:11.546466 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 09:00:11.546466 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 09:00:11.546466 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a46ca7b6c331417199f9dfc5ffa80470"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a46ca7b6c331417199f9dfc5ffa80470"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a46ca7b6c331417199f9dfc5ffa80470"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a46ca7b6c331417199f9dfc5ffa80470"}]}] Sep 14 09:00:11.546466 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-ServersTestJSON-1483820673 Sep 14 09:00:11.546466 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: a46ca7b6c331417199f9dfc5ffa80470 Sep 14 09:00:11.546466 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-ServersTestJSON-1483820673 Sep 14 09:00:11.546466 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-ServersTestJSON-1483820673-project Sep 14 09:00:11.546466 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 09:00:11.546466 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 09:00:11.546466 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 1473e6771ff1459c831d66311318404d Sep 14 09:00:11.546466 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-ServersTestJSON-1483820673-project Sep 14 09:00:11.546466 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 09:00:11.546466 n-d-836830-18 devstack@n-api.service[128758]: exception: Instance 5ee0a6e1-d106-4955-a894-7fe2ac13ffb0 could not be found. Sep 14 09:00:11.546466 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': '5ee0a6e1-d106-4955-a894-7fe2ac13ffb0'} Sep 14 09:00:11.546466 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:00:11.546466 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:00:11.546466 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:00:11.546466 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:00:11.546466 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:00:11.546466 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:00:11.546466 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:00:11.546466 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:00:11.546466 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:00:11.546466 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:00:11.546466 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ee0a6e1-d106-4955-a894-7fe2ac13ffb0 could not be found. Sep 14 09:00:11.546466 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:00:11.546466 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:00:11.546466 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:00:11.546466 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:00:11.546466 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:00:11.546466 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:00:11.546466 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:00:11.546466 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:00:11.546466 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:00:11.546466 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:00:11.546466 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:00:11.546466 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:00:11.546466 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:00:11.546466 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:00:11.546466 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:00:11.546466 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:00:11.546466 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ee0a6e1-d106-4955-a894-7fe2ac13ffb0 could not be found. Sep 14 09:00:11.546466 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:00:11.546466 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:00:11.546466 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:00:11.551418 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:00:11.551418 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:00:11.551418 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:00:11.551418 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:00:11.551418 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:00:11.551418 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ee0a6e1-d106-4955-a894-7fe2ac13ffb0 could not be found. Sep 14 09:00:11.551418 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:00:11.551418 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-8c31848b-2cf7-41c4-a0ef-6a1b6c402450 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Returning 404 to user: Instance 5ee0a6e1-d106-4955-a894-7fe2ac13ffb0 could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:00:11.551418 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-8c31848b-2cf7-41c4-a0ef-6a1b6c402450 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/5ee0a6e1-d106-4955-a894-7fe2ac13ffb0" status: 404 len: 111 microversion: 2.1 time: 0.031686 Sep 14 09:00:11.551418 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1369/2674] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:00:11 2022] GET /compute/v2.1/servers/5ee0a6e1-d106-4955-a894-7fe2ac13ffb0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 14 09:00:11.559379 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-5eeae019-769f-4433-8ce1-5ba827f0043e tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:11.559379 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-5eeae019-769f-4433-8ce1-5ba827f0043e tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 2334f491-8233-4171-906f-e0c46d0a3fb2] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:11.566010 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5eeae019-769f-4433-8ce1-5ba827f0043e tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:11.566433 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5eeae019-769f-4433-8ce1-5ba827f0043e tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:11.566867 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5eeae019-769f-4433-8ce1-5ba827f0043e tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:11.571117 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5eeae019-769f-4433-8ce1-5ba827f0043e tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:11.571117 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5eeae019-769f-4433-8ce1-5ba827f0043e tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:11.571117 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5eeae019-769f-4433-8ce1-5ba827f0043e tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:11.585687 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-5eeae019-769f-4433-8ce1-5ba827f0043e tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] HTTP exception thrown: Instance 2334f491-8233-4171-906f-e0c46d0a3fb2 could not be found. Sep 14 09:00:11.587293 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-5eeae019-769f-4433-8ce1-5ba827f0043e tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Request method failure captured: Sep 14 09:00:11.587293 n-d-836830-18 devstack@n-api.service[128758]: request: DELETE /compute/v2.1/servers/2334f491-8233-4171-906f-e0c46d0a3fb2 HTTP/1.1 Sep 14 09:00:11.587293 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 09:00:11.587293 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 09:00:11.587293 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 09:00:11.587293 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 09:00:11.587293 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 09:00:11.587293 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 09:00:11.587293 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 09:00:11.587293 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 09:00:11.587293 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZcaJwfflKXdBQOzu63TKkiZhpOhYfmFkGJTkIRAE47xWaYCE5owpMd6ZGj3T_7h70-IX-88ov5m9P47-8wvvyB1aoACyyMztTclo7X0AZdOhAhE2WQeLs1dhX-NF72boJ9SoR98XdGx2ROr7Y4PciafvjdUpaADdFYghsgULitlVHs Sep 14 09:00:11.587293 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 09:00:11.587293 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 09:00:11.587293 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 09:00:11.587293 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 09:00:11.587293 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 09:00:11.587293 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 09:00:11.587293 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: a46ca7b6c331417199f9dfc5ffa80470 Sep 14 09:00:11.587293 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-ServersTestJSON-1483820673 Sep 14 09:00:11.587293 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 09:00:11.587293 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 09:00:11.587293 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a46ca7b6c331417199f9dfc5ffa80470"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a46ca7b6c331417199f9dfc5ffa80470"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a46ca7b6c331417199f9dfc5ffa80470"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a46ca7b6c331417199f9dfc5ffa80470"}]}] Sep 14 09:00:11.587293 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-ServersTestJSON-1483820673 Sep 14 09:00:11.587293 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: a46ca7b6c331417199f9dfc5ffa80470 Sep 14 09:00:11.587293 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-ServersTestJSON-1483820673 Sep 14 09:00:11.587293 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-ServersTestJSON-1483820673-project Sep 14 09:00:11.587293 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 09:00:11.587293 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 09:00:11.587293 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 1473e6771ff1459c831d66311318404d Sep 14 09:00:11.587293 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-ServersTestJSON-1483820673-project Sep 14 09:00:11.587293 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 09:00:11.587293 n-d-836830-18 devstack@n-api.service[128758]: exception: Instance 2334f491-8233-4171-906f-e0c46d0a3fb2 could not be found. Sep 14 09:00:11.587293 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': '2334f491-8233-4171-906f-e0c46d0a3fb2'} Sep 14 09:00:11.587293 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:00:11.587293 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:00:11.587293 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:00:11.587293 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:00:11.587293 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:00:11.587293 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:00:11.587293 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:00:11.587293 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:00:11.587293 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:00:11.587293 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:00:11.587293 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2334f491-8233-4171-906f-e0c46d0a3fb2 could not be found. Sep 14 09:00:11.587293 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:00:11.587293 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:00:11.587293 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:00:11.587293 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:00:11.587293 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:00:11.587293 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:00:11.587293 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:00:11.587293 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:00:11.587293 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:00:11.587293 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:00:11.587293 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 09:00:11.587293 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 09:00:11.587293 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 09:00:11.587293 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 09:00:11.587293 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:00:11.587293 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:00:11.587293 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:00:11.587293 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:00:11.587293 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2334f491-8233-4171-906f-e0c46d0a3fb2 could not be found. Sep 14 09:00:11.592410 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:00:11.592410 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:00:11.592410 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:00:11.592410 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:00:11.592410 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:00:11.592410 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:00:11.592410 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:00:11.592410 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:00:11.592410 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2334f491-8233-4171-906f-e0c46d0a3fb2 could not be found. Sep 14 09:00:11.592410 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:00:11.592410 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-5eeae019-769f-4433-8ce1-5ba827f0043e tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Returning 404 to user: Instance 2334f491-8233-4171-906f-e0c46d0a3fb2 could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:00:11.592410 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-5eeae019-769f-4433-8ce1-5ba827f0043e tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "DELETE /compute/v2.1/servers/2334f491-8233-4171-906f-e0c46d0a3fb2" status: 404 len: 111 microversion: 2.1 time: 0.034389 Sep 14 09:00:11.592410 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1370/2675] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:00:11 2022] DELETE /compute/v2.1/servers/2334f491-8233-4171-906f-e0c46d0a3fb2 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 14 09:00:11.601443 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-28fc5947-33ed-42b2-8f31-c56a4cd73667 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:11.602065 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-28fc5947-33ed-42b2-8f31-c56a4cd73667 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 2334f491-8233-4171-906f-e0c46d0a3fb2] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:11.608966 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-28fc5947-33ed-42b2-8f31-c56a4cd73667 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:11.609458 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-28fc5947-33ed-42b2-8f31-c56a4cd73667 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:11.609892 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-28fc5947-33ed-42b2-8f31-c56a4cd73667 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:11.610594 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-28fc5947-33ed-42b2-8f31-c56a4cd73667 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:11.611084 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-28fc5947-33ed-42b2-8f31-c56a4cd73667 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:11.611507 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-28fc5947-33ed-42b2-8f31-c56a4cd73667 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:11.626774 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-28fc5947-33ed-42b2-8f31-c56a4cd73667 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] HTTP exception thrown: Instance 2334f491-8233-4171-906f-e0c46d0a3fb2 could not be found. Sep 14 09:00:11.628372 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-28fc5947-33ed-42b2-8f31-c56a4cd73667 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Request method failure captured: Sep 14 09:00:11.628372 n-d-836830-18 devstack@n-api.service[128758]: request: GET /compute/v2.1/servers/2334f491-8233-4171-906f-e0c46d0a3fb2 HTTP/1.1 Sep 14 09:00:11.628372 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 09:00:11.628372 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 09:00:11.628372 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 09:00:11.628372 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 09:00:11.628372 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 09:00:11.628372 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 09:00:11.628372 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 09:00:11.628372 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 09:00:11.628372 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZcaJwfflKXdBQOzu63TKkiZhpOhYfmFkGJTkIRAE47xWaYCE5owpMd6ZGj3T_7h70-IX-88ov5m9P47-8wvvyB1aoACyyMztTclo7X0AZdOhAhE2WQeLs1dhX-NF72boJ9SoR98XdGx2ROr7Y4PciafvjdUpaADdFYghsgULitlVHs Sep 14 09:00:11.628372 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 09:00:11.628372 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 09:00:11.628372 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 09:00:11.628372 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 09:00:11.628372 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 09:00:11.628372 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 09:00:11.628372 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: a46ca7b6c331417199f9dfc5ffa80470 Sep 14 09:00:11.628372 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-ServersTestJSON-1483820673 Sep 14 09:00:11.628372 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 09:00:11.628372 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 09:00:11.628372 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a46ca7b6c331417199f9dfc5ffa80470"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a46ca7b6c331417199f9dfc5ffa80470"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a46ca7b6c331417199f9dfc5ffa80470"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a46ca7b6c331417199f9dfc5ffa80470"}]}] Sep 14 09:00:11.628372 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-ServersTestJSON-1483820673 Sep 14 09:00:11.628372 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: a46ca7b6c331417199f9dfc5ffa80470 Sep 14 09:00:11.628372 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-ServersTestJSON-1483820673 Sep 14 09:00:11.628372 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-ServersTestJSON-1483820673-project Sep 14 09:00:11.628372 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 09:00:11.628372 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 09:00:11.628372 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 1473e6771ff1459c831d66311318404d Sep 14 09:00:11.628372 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-ServersTestJSON-1483820673-project Sep 14 09:00:11.628372 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 09:00:11.628372 n-d-836830-18 devstack@n-api.service[128758]: exception: Instance 2334f491-8233-4171-906f-e0c46d0a3fb2 could not be found. Sep 14 09:00:11.628372 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': '2334f491-8233-4171-906f-e0c46d0a3fb2'} Sep 14 09:00:11.628372 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:00:11.628372 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:00:11.628372 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:00:11.628372 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:00:11.628372 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:00:11.628372 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:00:11.628372 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:00:11.628372 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:00:11.628372 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:00:11.628372 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:00:11.628372 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2334f491-8233-4171-906f-e0c46d0a3fb2 could not be found. Sep 14 09:00:11.628372 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:00:11.628372 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:00:11.628372 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:00:11.628372 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:00:11.628372 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:00:11.628372 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:00:11.628372 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:00:11.628372 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:00:11.628372 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:00:11.628372 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:00:11.628372 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:00:11.628372 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:00:11.628372 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:00:11.628372 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:00:11.628372 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:00:11.628372 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:00:11.628372 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2334f491-8233-4171-906f-e0c46d0a3fb2 could not be found. Sep 14 09:00:11.628372 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:00:11.628372 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:00:11.628372 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:00:11.632468 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:00:11.632468 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:00:11.632468 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:00:11.632468 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:00:11.632468 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:00:11.632468 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2334f491-8233-4171-906f-e0c46d0a3fb2 could not be found. Sep 14 09:00:11.632468 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:00:11.632468 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-28fc5947-33ed-42b2-8f31-c56a4cd73667 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Returning 404 to user: Instance 2334f491-8233-4171-906f-e0c46d0a3fb2 could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:00:11.632468 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-28fc5947-33ed-42b2-8f31-c56a4cd73667 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/2334f491-8233-4171-906f-e0c46d0a3fb2" status: 404 len: 111 microversion: 2.1 time: 0.032167 Sep 14 09:00:11.632468 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1371/2676] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:00:11 2022] GET /compute/v2.1/servers/2334f491-8233-4171-906f-e0c46d0a3fb2 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:00:11.638383 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-e4183f6f-fd5f-4bde-b350-1f646ff1b758 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:11.638886 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-e4183f6f-fd5f-4bde-b350-1f646ff1b758 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 8a7e712b-b175-4ebc-9681-42ff2a91867d] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:11.645455 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e4183f6f-fd5f-4bde-b350-1f646ff1b758 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:11.645940 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e4183f6f-fd5f-4bde-b350-1f646ff1b758 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:11.646383 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e4183f6f-fd5f-4bde-b350-1f646ff1b758 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:11.647109 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e4183f6f-fd5f-4bde-b350-1f646ff1b758 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:11.647638 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e4183f6f-fd5f-4bde-b350-1f646ff1b758 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:11.647969 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e4183f6f-fd5f-4bde-b350-1f646ff1b758 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:11.662720 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-e4183f6f-fd5f-4bde-b350-1f646ff1b758 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] HTTP exception thrown: Instance 8a7e712b-b175-4ebc-9681-42ff2a91867d could not be found. Sep 14 09:00:11.664304 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-e4183f6f-fd5f-4bde-b350-1f646ff1b758 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Request method failure captured: Sep 14 09:00:11.664304 n-d-836830-18 devstack@n-api.service[128758]: request: DELETE /compute/v2.1/servers/8a7e712b-b175-4ebc-9681-42ff2a91867d HTTP/1.1 Sep 14 09:00:11.664304 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 09:00:11.664304 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 09:00:11.664304 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 09:00:11.664304 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 09:00:11.664304 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 09:00:11.664304 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 09:00:11.664304 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 09:00:11.664304 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 09:00:11.664304 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZcaJwfflKXdBQOzu63TKkiZhpOhYfmFkGJTkIRAE47xWaYCE5owpMd6ZGj3T_7h70-IX-88ov5m9P47-8wvvyB1aoACyyMztTclo7X0AZdOhAhE2WQeLs1dhX-NF72boJ9SoR98XdGx2ROr7Y4PciafvjdUpaADdFYghsgULitlVHs Sep 14 09:00:11.664304 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 09:00:11.664304 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 09:00:11.664304 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 09:00:11.664304 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 09:00:11.664304 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 09:00:11.664304 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 09:00:11.664304 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: a46ca7b6c331417199f9dfc5ffa80470 Sep 14 09:00:11.664304 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-ServersTestJSON-1483820673 Sep 14 09:00:11.664304 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 09:00:11.664304 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 09:00:11.664304 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a46ca7b6c331417199f9dfc5ffa80470"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a46ca7b6c331417199f9dfc5ffa80470"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a46ca7b6c331417199f9dfc5ffa80470"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a46ca7b6c331417199f9dfc5ffa80470"}]}] Sep 14 09:00:11.664304 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-ServersTestJSON-1483820673 Sep 14 09:00:11.664304 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: a46ca7b6c331417199f9dfc5ffa80470 Sep 14 09:00:11.664304 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-ServersTestJSON-1483820673 Sep 14 09:00:11.664304 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-ServersTestJSON-1483820673-project Sep 14 09:00:11.664304 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 09:00:11.664304 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 09:00:11.664304 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 1473e6771ff1459c831d66311318404d Sep 14 09:00:11.664304 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-ServersTestJSON-1483820673-project Sep 14 09:00:11.664304 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 09:00:11.664304 n-d-836830-18 devstack@n-api.service[128758]: exception: Instance 8a7e712b-b175-4ebc-9681-42ff2a91867d could not be found. Sep 14 09:00:11.664304 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': '8a7e712b-b175-4ebc-9681-42ff2a91867d'} Sep 14 09:00:11.664304 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:00:11.664304 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:00:11.664304 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:00:11.664304 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:00:11.664304 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:00:11.664304 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:00:11.664304 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:00:11.664304 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:00:11.664304 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:00:11.664304 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:00:11.664304 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a7e712b-b175-4ebc-9681-42ff2a91867d could not be found. Sep 14 09:00:11.664304 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:00:11.664304 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:00:11.664304 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:00:11.664304 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:00:11.664304 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:00:11.664304 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:00:11.664304 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:00:11.664304 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:00:11.664304 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:00:11.664304 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:00:11.664304 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 09:00:11.664304 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 09:00:11.664304 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 09:00:11.664304 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 09:00:11.664304 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:00:11.664304 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:00:11.664304 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:00:11.664304 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:00:11.664304 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a7e712b-b175-4ebc-9681-42ff2a91867d could not be found. Sep 14 09:00:11.670319 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:00:11.670319 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:00:11.670319 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:00:11.670319 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:00:11.670319 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:00:11.670319 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:00:11.670319 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:00:11.670319 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:00:11.670319 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a7e712b-b175-4ebc-9681-42ff2a91867d could not be found. Sep 14 09:00:11.670319 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:00:11.670319 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-e4183f6f-fd5f-4bde-b350-1f646ff1b758 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Returning 404 to user: Instance 8a7e712b-b175-4ebc-9681-42ff2a91867d could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:00:11.670319 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-e4183f6f-fd5f-4bde-b350-1f646ff1b758 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "DELETE /compute/v2.1/servers/8a7e712b-b175-4ebc-9681-42ff2a91867d" status: 404 len: 111 microversion: 2.1 time: 0.031232 Sep 14 09:00:11.670319 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1372/2677] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:00:11 2022] DELETE /compute/v2.1/servers/8a7e712b-b175-4ebc-9681-42ff2a91867d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 14 09:00:11.675852 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-0ead57fd-21ea-4f9f-a0c7-a671daf985a7 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:11.676483 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-0ead57fd-21ea-4f9f-a0c7-a671daf985a7 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 8a7e712b-b175-4ebc-9681-42ff2a91867d] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:11.684798 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0ead57fd-21ea-4f9f-a0c7-a671daf985a7 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:11.686364 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0ead57fd-21ea-4f9f-a0c7-a671daf985a7 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:11.687033 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0ead57fd-21ea-4f9f-a0c7-a671daf985a7 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:11.687703 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0ead57fd-21ea-4f9f-a0c7-a671daf985a7 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:11.688305 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0ead57fd-21ea-4f9f-a0c7-a671daf985a7 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:11.688739 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0ead57fd-21ea-4f9f-a0c7-a671daf985a7 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:11.703049 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-0ead57fd-21ea-4f9f-a0c7-a671daf985a7 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] HTTP exception thrown: Instance 8a7e712b-b175-4ebc-9681-42ff2a91867d could not be found. Sep 14 09:00:11.704836 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-0ead57fd-21ea-4f9f-a0c7-a671daf985a7 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Request method failure captured: Sep 14 09:00:11.704836 n-d-836830-18 devstack@n-api.service[128758]: request: GET /compute/v2.1/servers/8a7e712b-b175-4ebc-9681-42ff2a91867d HTTP/1.1 Sep 14 09:00:11.704836 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 09:00:11.704836 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 09:00:11.704836 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 09:00:11.704836 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 09:00:11.704836 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 09:00:11.704836 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 09:00:11.704836 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 09:00:11.704836 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 09:00:11.704836 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZcaJwfflKXdBQOzu63TKkiZhpOhYfmFkGJTkIRAE47xWaYCE5owpMd6ZGj3T_7h70-IX-88ov5m9P47-8wvvyB1aoACyyMztTclo7X0AZdOhAhE2WQeLs1dhX-NF72boJ9SoR98XdGx2ROr7Y4PciafvjdUpaADdFYghsgULitlVHs Sep 14 09:00:11.704836 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 09:00:11.704836 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 09:00:11.704836 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 09:00:11.704836 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 09:00:11.704836 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 09:00:11.704836 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 09:00:11.704836 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: a46ca7b6c331417199f9dfc5ffa80470 Sep 14 09:00:11.704836 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-ServersTestJSON-1483820673 Sep 14 09:00:11.704836 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 09:00:11.704836 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 09:00:11.704836 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a46ca7b6c331417199f9dfc5ffa80470"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a46ca7b6c331417199f9dfc5ffa80470"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a46ca7b6c331417199f9dfc5ffa80470"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a46ca7b6c331417199f9dfc5ffa80470"}]}] Sep 14 09:00:11.704836 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-ServersTestJSON-1483820673 Sep 14 09:00:11.704836 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: a46ca7b6c331417199f9dfc5ffa80470 Sep 14 09:00:11.704836 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-ServersTestJSON-1483820673 Sep 14 09:00:11.704836 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-ServersTestJSON-1483820673-project Sep 14 09:00:11.704836 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 09:00:11.704836 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 09:00:11.704836 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 1473e6771ff1459c831d66311318404d Sep 14 09:00:11.704836 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-ServersTestJSON-1483820673-project Sep 14 09:00:11.704836 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 09:00:11.704836 n-d-836830-18 devstack@n-api.service[128758]: exception: Instance 8a7e712b-b175-4ebc-9681-42ff2a91867d could not be found. Sep 14 09:00:11.704836 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': '8a7e712b-b175-4ebc-9681-42ff2a91867d'} Sep 14 09:00:11.704836 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:00:11.704836 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:00:11.704836 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:00:11.704836 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:00:11.704836 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:00:11.704836 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:00:11.704836 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:00:11.704836 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:00:11.704836 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:00:11.704836 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:00:11.704836 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a7e712b-b175-4ebc-9681-42ff2a91867d could not be found. Sep 14 09:00:11.704836 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:00:11.704836 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:00:11.704836 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:00:11.704836 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:00:11.704836 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:00:11.704836 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:00:11.704836 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:00:11.704836 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:00:11.704836 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:00:11.704836 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:00:11.704836 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:00:11.704836 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:00:11.704836 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:00:11.704836 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:00:11.704836 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:00:11.704836 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:00:11.704836 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a7e712b-b175-4ebc-9681-42ff2a91867d could not be found. Sep 14 09:00:11.704836 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:00:11.704836 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:00:11.704836 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:00:11.711220 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:00:11.711220 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:00:11.711220 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:00:11.711220 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:00:11.711220 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:00:11.711220 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a7e712b-b175-4ebc-9681-42ff2a91867d could not be found. Sep 14 09:00:11.711220 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:00:11.711220 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-0ead57fd-21ea-4f9f-a0c7-a671daf985a7 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Returning 404 to user: Instance 8a7e712b-b175-4ebc-9681-42ff2a91867d could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:00:11.711220 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-0ead57fd-21ea-4f9f-a0c7-a671daf985a7 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/8a7e712b-b175-4ebc-9681-42ff2a91867d" status: 404 len: 111 microversion: 2.1 time: 0.035182 Sep 14 09:00:11.711220 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1373/2678] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:00:11 2022] GET /compute/v2.1/servers/8a7e712b-b175-4ebc-9681-42ff2a91867d => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:00:11.716357 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-8110dcc1-1c6d-40ef-bb53-78341ec5aaf6 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:11.717169 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-8110dcc1-1c6d-40ef-bb53-78341ec5aaf6 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: 8f7f80e3-c2f5-4719-a484-29d6bd0d9e91] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:11.724521 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8110dcc1-1c6d-40ef-bb53-78341ec5aaf6 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:11.725027 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8110dcc1-1c6d-40ef-bb53-78341ec5aaf6 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:11.725452 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8110dcc1-1c6d-40ef-bb53-78341ec5aaf6 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:11.726154 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8110dcc1-1c6d-40ef-bb53-78341ec5aaf6 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:11.726638 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8110dcc1-1c6d-40ef-bb53-78341ec5aaf6 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:11.727097 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8110dcc1-1c6d-40ef-bb53-78341ec5aaf6 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:11.851659 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-82c8eee9-b9d0-4187-878a-4c9328840ff7 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] 10.222.0.60 "DELETE /compute/v2.1/os-floating-ips/af5b3f84-8bec-497a-b9ff-493e185c7cf1" status: 202 len: 0 microversion: 2.1 time: 0.910484 Sep 14 09:00:11.852860 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1306/2679] 10.222.0.60 () {58 vars in 1263 bytes} [Wed Sep 14 09:00:10 2022] DELETE /compute/v2.1/os-floating-ips/af5b3f84-8bec-497a-b9ff-493e185c7cf1 => generated 0 bytes in 912 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:00:11.859274 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8ef19a6e-f82c-4f8e-8419-92be1fa7f985 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:11.860049 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-8ef19a6e-f82c-4f8e-8419-92be1fa7f985 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 08693908-da78-40e6-ae86-516643c61a3b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:11.867345 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8ef19a6e-f82c-4f8e-8419-92be1fa7f985 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:11.868554 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8ef19a6e-f82c-4f8e-8419-92be1fa7f985 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:11.869202 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8ef19a6e-f82c-4f8e-8419-92be1fa7f985 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:11.871243 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8ef19a6e-f82c-4f8e-8419-92be1fa7f985 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:11.871779 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8ef19a6e-f82c-4f8e-8419-92be1fa7f985 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:11.872407 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8ef19a6e-f82c-4f8e-8419-92be1fa7f985 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:11.888179 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-8ef19a6e-f82c-4f8e-8419-92be1fa7f985 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] HTTP exception thrown: Instance 08693908-da78-40e6-ae86-516643c61a3b could not be found. Sep 14 09:00:11.890198 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8ef19a6e-f82c-4f8e-8419-92be1fa7f985 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Request method failure captured: Sep 14 09:00:11.890198 n-d-836830-18 devstack@n-api.service[128759]: request: DELETE /compute/v2.1/servers/08693908-da78-40e6-ae86-516643c61a3b HTTP/1.1 Sep 14 09:00:11.890198 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:00:11.890198 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:00:11.890198 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:00:11.890198 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:00:11.890198 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:00:11.890198 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:00:11.890198 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:00:11.890198 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:00:11.890198 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZcaJwfflKXdBQOzu63TKkiZhpOhYfmFkGJTkIRAE47xWaYCE5owpMd6ZGj3T_7h70-IX-88ov5m9P47-8wvvyB1aoACyyMztTclo7X0AZdOhAhE2WQeLs1dhX-NF72boJ9SoR98XdGx2ROr7Y4PciafvjdUpaADdFYghsgULitlVHs Sep 14 09:00:11.890198 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:00:11.890198 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:00:11.890198 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:00:11.890198 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:00:11.890198 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:00:11.890198 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:00:11.890198 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: a46ca7b6c331417199f9dfc5ffa80470 Sep 14 09:00:11.890198 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ServersTestJSON-1483820673 Sep 14 09:00:11.890198 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:00:11.890198 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:00:11.890198 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a46ca7b6c331417199f9dfc5ffa80470"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a46ca7b6c331417199f9dfc5ffa80470"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a46ca7b6c331417199f9dfc5ffa80470"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a46ca7b6c331417199f9dfc5ffa80470"}]}] Sep 14 09:00:11.890198 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ServersTestJSON-1483820673 Sep 14 09:00:11.890198 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: a46ca7b6c331417199f9dfc5ffa80470 Sep 14 09:00:11.890198 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ServersTestJSON-1483820673 Sep 14 09:00:11.890198 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ServersTestJSON-1483820673-project Sep 14 09:00:11.890198 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:00:11.890198 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:00:11.890198 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 1473e6771ff1459c831d66311318404d Sep 14 09:00:11.890198 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ServersTestJSON-1483820673-project Sep 14 09:00:11.890198 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:00:11.890198 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance 08693908-da78-40e6-ae86-516643c61a3b could not be found. Sep 14 09:00:11.890198 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '08693908-da78-40e6-ae86-516643c61a3b'} Sep 14 09:00:11.890198 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:00:11.890198 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:00:11.890198 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:00:11.890198 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:00:11.890198 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:00:11.890198 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:00:11.890198 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:00:11.890198 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:00:11.890198 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:00:11.890198 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:00:11.890198 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08693908-da78-40e6-ae86-516643c61a3b could not be found. Sep 14 09:00:11.890198 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:00:11.890198 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:00:11.890198 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:00:11.890198 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:00:11.890198 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:00:11.890198 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:00:11.890198 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:00:11.890198 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:00:11.890198 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:00:11.890198 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:00:11.890198 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 09:00:11.890198 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 09:00:11.890198 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 09:00:11.890198 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 09:00:11.890198 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:00:11.890198 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:00:11.890198 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:00:11.890198 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:00:11.890198 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08693908-da78-40e6-ae86-516643c61a3b could not be found. Sep 14 09:00:11.894570 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:00:11.894570 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:00:11.894570 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:00:11.894570 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:00:11.894570 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:00:11.894570 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:00:11.894570 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:00:11.894570 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:00:11.894570 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08693908-da78-40e6-ae86-516643c61a3b could not be found. Sep 14 09:00:11.894570 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:00:11.895962 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8ef19a6e-f82c-4f8e-8419-92be1fa7f985 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Returning 404 to user: Instance 08693908-da78-40e6-ae86-516643c61a3b could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:00:11.897149 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-8ef19a6e-f82c-4f8e-8419-92be1fa7f985 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "DELETE /compute/v2.1/servers/08693908-da78-40e6-ae86-516643c61a3b" status: 404 len: 111 microversion: 2.1 time: 0.043059 Sep 14 09:00:11.897699 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1307/2680] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:00:11 2022] DELETE /compute/v2.1/servers/08693908-da78-40e6-ae86-516643c61a3b => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:00:11.899782 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-8110dcc1-1c6d-40ef-bb53-78341ec5aaf6 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9d40e54481461cba53fedb9a6abdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed2295a58f8451993a57ce0a6f9ba29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:11.903326 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3bb2f04b-6f62-4dc0-96d5-d0bd4c8b73d5 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:11.904571 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-3bb2f04b-6f62-4dc0-96d5-d0bd4c8b73d5 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] [instance: 2da88a50-c283-4c91-b3e1-bd4f5eb9e319] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:11.909157 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-8110dcc1-1c6d-40ef-bb53-78341ec5aaf6 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7f80e3-c2f5-4719-a484-29d6bd0d9e91" status: 200 len: 1318 microversion: 2.1 time: 0.201072 Sep 14 09:00:11.909991 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1374/2681] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:00:11 2022] GET /compute/v2.1/servers/8f7f80e3-c2f5-4719-a484-29d6bd0d9e91 => generated 1318 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:00:11.910612 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3bb2f04b-6f62-4dc0-96d5-d0bd4c8b73d5 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:11.911199 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3bb2f04b-6f62-4dc0-96d5-d0bd4c8b73d5 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:11.911780 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3bb2f04b-6f62-4dc0-96d5-d0bd4c8b73d5 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:11.912464 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3bb2f04b-6f62-4dc0-96d5-d0bd4c8b73d5 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:11.912911 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3bb2f04b-6f62-4dc0-96d5-d0bd4c8b73d5 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:11.913520 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3bb2f04b-6f62-4dc0-96d5-d0bd4c8b73d5 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:11.916586 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-952e8c9e-f4b8-45c8-ad74-ada2f776d1a3 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:11.917628 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-952e8c9e-f4b8-45c8-ad74-ada2f776d1a3 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 08693908-da78-40e6-ae86-516643c61a3b] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:11.931170 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=89,nova_cell1:SAVEPOINT=3,nova_cell1:RELEASE=3,nova_cell1:UPDATE=4,nova_cell1:INSERT=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:00:11.932910 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-952e8c9e-f4b8-45c8-ad74-ada2f776d1a3 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:11.933954 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-952e8c9e-f4b8-45c8-ad74-ada2f776d1a3 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:11.934683 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-952e8c9e-f4b8-45c8-ad74-ada2f776d1a3 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:11.935870 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-952e8c9e-f4b8-45c8-ad74-ada2f776d1a3 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:11.936532 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-952e8c9e-f4b8-45c8-ad74-ada2f776d1a3 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:11.937451 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-952e8c9e-f4b8-45c8-ad74-ada2f776d1a3 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:11.944411 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-3bb2f04b-6f62-4dc0-96d5-d0bd4c8b73d5 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] [instance: 2da88a50-c283-4c91-b3e1-bd4f5eb9e319] Going to try to terminate instance {{(pid=128759) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:00:11.953866 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-952e8c9e-f4b8-45c8-ad74-ada2f776d1a3 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] HTTP exception thrown: Instance 08693908-da78-40e6-ae86-516643c61a3b could not be found. Sep 14 09:00:11.955717 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-952e8c9e-f4b8-45c8-ad74-ada2f776d1a3 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Request method failure captured: Sep 14 09:00:11.955717 n-d-836830-18 devstack@n-api.service[128758]: request: GET /compute/v2.1/servers/08693908-da78-40e6-ae86-516643c61a3b HTTP/1.1 Sep 14 09:00:11.955717 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 09:00:11.955717 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 09:00:11.955717 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 09:00:11.955717 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 09:00:11.955717 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 09:00:11.955717 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 09:00:11.955717 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 09:00:11.955717 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 09:00:11.955717 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZcaJwfflKXdBQOzu63TKkiZhpOhYfmFkGJTkIRAE47xWaYCE5owpMd6ZGj3T_7h70-IX-88ov5m9P47-8wvvyB1aoACyyMztTclo7X0AZdOhAhE2WQeLs1dhX-NF72boJ9SoR98XdGx2ROr7Y4PciafvjdUpaADdFYghsgULitlVHs Sep 14 09:00:11.955717 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 09:00:11.955717 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 09:00:11.955717 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 09:00:11.955717 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 09:00:11.955717 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 09:00:11.955717 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 09:00:11.955717 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: a46ca7b6c331417199f9dfc5ffa80470 Sep 14 09:00:11.955717 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-ServersTestJSON-1483820673 Sep 14 09:00:11.955717 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 09:00:11.955717 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 09:00:11.955717 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a46ca7b6c331417199f9dfc5ffa80470"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a46ca7b6c331417199f9dfc5ffa80470"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a46ca7b6c331417199f9dfc5ffa80470"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a46ca7b6c331417199f9dfc5ffa80470"}]}] Sep 14 09:00:11.955717 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-ServersTestJSON-1483820673 Sep 14 09:00:11.955717 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: a46ca7b6c331417199f9dfc5ffa80470 Sep 14 09:00:11.955717 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-ServersTestJSON-1483820673 Sep 14 09:00:11.955717 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-ServersTestJSON-1483820673-project Sep 14 09:00:11.955717 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 09:00:11.955717 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 09:00:11.955717 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 1473e6771ff1459c831d66311318404d Sep 14 09:00:11.955717 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-ServersTestJSON-1483820673-project Sep 14 09:00:11.955717 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 09:00:11.955717 n-d-836830-18 devstack@n-api.service[128758]: exception: Instance 08693908-da78-40e6-ae86-516643c61a3b could not be found. Sep 14 09:00:11.955717 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': '08693908-da78-40e6-ae86-516643c61a3b'} Sep 14 09:00:11.955717 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:00:11.955717 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:00:11.955717 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:00:11.955717 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:00:11.955717 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:00:11.955717 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:00:11.955717 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:00:11.955717 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:00:11.955717 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:00:11.955717 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:00:11.955717 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08693908-da78-40e6-ae86-516643c61a3b could not be found. Sep 14 09:00:11.955717 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:00:11.955717 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:00:11.955717 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:00:11.955717 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:00:11.955717 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:00:11.955717 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:00:11.955717 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:00:11.955717 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:00:11.955717 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:00:11.955717 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:00:11.955717 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:00:11.955717 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:00:11.955717 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:00:11.955717 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:00:11.955717 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:00:11.955717 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:00:11.955717 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08693908-da78-40e6-ae86-516643c61a3b could not be found. Sep 14 09:00:11.955717 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:00:11.955717 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:00:11.955717 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:00:11.960467 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:00:11.960467 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:00:11.960467 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:00:11.960467 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:00:11.960467 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:00:11.960467 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08693908-da78-40e6-ae86-516643c61a3b could not be found. Sep 14 09:00:11.960467 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:00:11.960467 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-952e8c9e-f4b8-45c8-ad74-ada2f776d1a3 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Returning 404 to user: Instance 08693908-da78-40e6-ae86-516643c61a3b could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:00:11.961668 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-952e8c9e-f4b8-45c8-ad74-ada2f776d1a3 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/08693908-da78-40e6-ae86-516643c61a3b" status: 404 len: 111 microversion: 2.1 time: 0.050261 Sep 14 09:00:11.967125 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1375/2682] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:00:11 2022] GET /compute/v2.1/servers/08693908-da78-40e6-ae86-516643c61a3b => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:00:11.971713 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-daa903ec-935a-4aa9-a3b7-900f9d5fed44 req-f86fc466-6b8a-4709-8add-9f99000f16a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2da88a50-c283-4c91-b3e1-bd4f5eb9e319", "tag": "0e0d5077-876f-4296-b015-ba13bb73c465"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:00:11.983517 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-daa903ec-935a-4aa9-a3b7-900f9d5fed44 req-f86fc466-6b8a-4709-8add-9f99000f16a4 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:11.984088 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-daa903ec-935a-4aa9-a3b7-900f9d5fed44 req-f86fc466-6b8a-4709-8add-9f99000f16a4 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:11.984586 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-daa903ec-935a-4aa9-a3b7-900f9d5fed44 req-f86fc466-6b8a-4709-8add-9f99000f16a4 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:12.001533 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-daa903ec-935a-4aa9-a3b7-900f9d5fed44 req-f86fc466-6b8a-4709-8add-9f99000f16a4 service nova] Creating event network-changed:0e0d5077-876f-4296-b015-ba13bb73c465 for instance 2da88a50-c283-4c91-b3e1-bd4f5eb9e319 on n-h2-836830-18 Sep 14 09:00:12.007425 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-daa903ec-935a-4aa9-a3b7-900f9d5fed44 req-f86fc466-6b8a-4709-8add-9f99000f16a4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039099 Sep 14 09:00:12.008189 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1376/2683] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:00:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:00:12.014554 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-92d9dedd-28f9-449e-bd83-986628df4cce tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:12.015355 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-92d9dedd-28f9-449e-bd83-986628df4cce tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 87bb467f-b214-433c-9df3-3877479de057] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:12.021098 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-92d9dedd-28f9-449e-bd83-986628df4cce tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] HTTP exception thrown: Instance 87bb467f-b214-433c-9df3-3877479de057 could not be found. Sep 14 09:00:12.022768 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-92d9dedd-28f9-449e-bd83-986628df4cce tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Request method failure captured: Sep 14 09:00:12.022768 n-d-836830-18 devstack@n-api.service[128758]: request: DELETE /compute/v2.1/servers/87bb467f-b214-433c-9df3-3877479de057 HTTP/1.1 Sep 14 09:00:12.022768 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 09:00:12.022768 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 09:00:12.022768 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 09:00:12.022768 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 09:00:12.022768 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 09:00:12.022768 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 09:00:12.022768 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 09:00:12.022768 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 09:00:12.022768 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZcaJwfflKXdBQOzu63TKkiZhpOhYfmFkGJTkIRAE47xWaYCE5owpMd6ZGj3T_7h70-IX-88ov5m9P47-8wvvyB1aoACyyMztTclo7X0AZdOhAhE2WQeLs1dhX-NF72boJ9SoR98XdGx2ROr7Y4PciafvjdUpaADdFYghsgULitlVHs Sep 14 09:00:12.022768 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 09:00:12.022768 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 09:00:12.022768 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 09:00:12.022768 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 09:00:12.022768 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 09:00:12.022768 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 09:00:12.022768 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: a46ca7b6c331417199f9dfc5ffa80470 Sep 14 09:00:12.022768 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-ServersTestJSON-1483820673 Sep 14 09:00:12.022768 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 09:00:12.022768 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 09:00:12.022768 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a46ca7b6c331417199f9dfc5ffa80470"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a46ca7b6c331417199f9dfc5ffa80470"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a46ca7b6c331417199f9dfc5ffa80470"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a46ca7b6c331417199f9dfc5ffa80470"}]}] Sep 14 09:00:12.022768 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-ServersTestJSON-1483820673 Sep 14 09:00:12.022768 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: a46ca7b6c331417199f9dfc5ffa80470 Sep 14 09:00:12.022768 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-ServersTestJSON-1483820673 Sep 14 09:00:12.022768 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-ServersTestJSON-1483820673-project Sep 14 09:00:12.022768 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 09:00:12.022768 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 09:00:12.022768 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 1473e6771ff1459c831d66311318404d Sep 14 09:00:12.022768 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-ServersTestJSON-1483820673-project Sep 14 09:00:12.022768 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 09:00:12.022768 n-d-836830-18 devstack@n-api.service[128758]: exception: Instance 87bb467f-b214-433c-9df3-3877479de057 could not be found. Sep 14 09:00:12.022768 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': '87bb467f-b214-433c-9df3-3877479de057'} Sep 14 09:00:12.022768 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:00:12.022768 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:00:12.022768 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:00:12.022768 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:00:12.022768 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:00:12.022768 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:00:12.022768 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 14 09:00:12.022768 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 14 09:00:12.022768 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87bb467f-b214-433c-9df3-3877479de057 could not be found. Sep 14 09:00:12.022768 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:00:12.022768 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:00:12.022768 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:00:12.022768 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:00:12.022768 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:00:12.022768 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:00:12.022768 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:00:12.022768 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:00:12.022768 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:00:12.022768 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:00:12.022768 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 09:00:12.022768 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 09:00:12.022768 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 09:00:12.022768 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 09:00:12.022768 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:00:12.022768 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:00:12.022768 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:00:12.022768 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:00:12.022768 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87bb467f-b214-433c-9df3-3877479de057 could not be found. Sep 14 09:00:12.022768 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:00:12.022768 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:00:12.022768 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:00:12.029524 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:00:12.029524 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:00:12.029524 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:00:12.029524 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:00:12.029524 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:00:12.029524 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87bb467f-b214-433c-9df3-3877479de057 could not be found. Sep 14 09:00:12.029524 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:00:12.029524 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-92d9dedd-28f9-449e-bd83-986628df4cce tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Returning 404 to user: Instance 87bb467f-b214-433c-9df3-3877479de057 could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:00:12.029524 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-92d9dedd-28f9-449e-bd83-986628df4cce tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "DELETE /compute/v2.1/servers/87bb467f-b214-433c-9df3-3877479de057" status: 404 len: 111 microversion: 2.1 time: 0.015285 Sep 14 09:00:12.029524 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1377/2684] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:00:12 2022] DELETE /compute/v2.1/servers/87bb467f-b214-433c-9df3-3877479de057 => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:00:12.031875 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c90759af-ed8b-4710-96f5-efe5bf676fd3 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:12.032509 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-c90759af-ed8b-4710-96f5-efe5bf676fd3 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] [instance: 9ddb5908-22a9-41c8-909c-39cdf479bdd2] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:12.039207 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c90759af-ed8b-4710-96f5-efe5bf676fd3 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:12.039686 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c90759af-ed8b-4710-96f5-efe5bf676fd3 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:12.040119 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c90759af-ed8b-4710-96f5-efe5bf676fd3 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:12.040810 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c90759af-ed8b-4710-96f5-efe5bf676fd3 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:12.041259 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c90759af-ed8b-4710-96f5-efe5bf676fd3 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:12.041678 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c90759af-ed8b-4710-96f5-efe5bf676fd3 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:12.070581 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-3bb2f04b-6f62-4dc0-96d5-d0bd4c8b73d5 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] 10.222.0.60 "DELETE /compute/v2.1/servers/2da88a50-c283-4c91-b3e1-bd4f5eb9e319" status: 204 len: 0 microversion: 2.1 time: 0.171412 Sep 14 09:00:12.071255 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1308/2685] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:00:11 2022] DELETE /compute/v2.1/servers/2da88a50-c283-4c91-b3e1-bd4f5eb9e319 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:00:12.079706 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ec468c8c-9a8b-4a16-b544-f355af9756fb tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:12.080849 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-ec468c8c-9a8b-4a16-b544-f355af9756fb tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 87bb467f-b214-433c-9df3-3877479de057] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:12.103395 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-ec468c8c-9a8b-4a16-b544-f355af9756fb tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] HTTP exception thrown: Instance 87bb467f-b214-433c-9df3-3877479de057 could not be found. Sep 14 09:00:12.105561 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ec468c8c-9a8b-4a16-b544-f355af9756fb tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Request method failure captured: Sep 14 09:00:12.105561 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/87bb467f-b214-433c-9df3-3877479de057 HTTP/1.1 Sep 14 09:00:12.105561 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:00:12.105561 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:00:12.105561 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:00:12.105561 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:00:12.105561 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:00:12.105561 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:00:12.105561 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:00:12.105561 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:00:12.105561 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZcaJwfflKXdBQOzu63TKkiZhpOhYfmFkGJTkIRAE47xWaYCE5owpMd6ZGj3T_7h70-IX-88ov5m9P47-8wvvyB1aoACyyMztTclo7X0AZdOhAhE2WQeLs1dhX-NF72boJ9SoR98XdGx2ROr7Y4PciafvjdUpaADdFYghsgULitlVHs Sep 14 09:00:12.105561 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:00:12.105561 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:00:12.105561 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:00:12.105561 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:00:12.105561 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:00:12.105561 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:00:12.105561 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: a46ca7b6c331417199f9dfc5ffa80470 Sep 14 09:00:12.105561 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ServersTestJSON-1483820673 Sep 14 09:00:12.105561 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:00:12.105561 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:00:12.105561 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a46ca7b6c331417199f9dfc5ffa80470"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a46ca7b6c331417199f9dfc5ffa80470"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a46ca7b6c331417199f9dfc5ffa80470"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a46ca7b6c331417199f9dfc5ffa80470"}]}] Sep 14 09:00:12.105561 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ServersTestJSON-1483820673 Sep 14 09:00:12.105561 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: a46ca7b6c331417199f9dfc5ffa80470 Sep 14 09:00:12.105561 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ServersTestJSON-1483820673 Sep 14 09:00:12.105561 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ServersTestJSON-1483820673-project Sep 14 09:00:12.105561 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:00:12.105561 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:00:12.105561 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 1473e6771ff1459c831d66311318404d Sep 14 09:00:12.105561 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ServersTestJSON-1483820673-project Sep 14 09:00:12.105561 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:00:12.105561 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance 87bb467f-b214-433c-9df3-3877479de057 could not be found. Sep 14 09:00:12.105561 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '87bb467f-b214-433c-9df3-3877479de057'} Sep 14 09:00:12.105561 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:00:12.105561 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:00:12.105561 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:00:12.105561 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:00:12.105561 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:00:12.105561 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:00:12.105561 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 14 09:00:12.105561 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 14 09:00:12.105561 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87bb467f-b214-433c-9df3-3877479de057 could not be found. Sep 14 09:00:12.105561 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:00:12.105561 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:00:12.105561 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:00:12.105561 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:00:12.105561 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:00:12.105561 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:00:12.105561 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:00:12.105561 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:00:12.105561 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:00:12.105561 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:00:12.105561 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:00:12.105561 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:00:12.105561 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:00:12.105561 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:00:12.105561 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:00:12.105561 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:00:12.105561 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87bb467f-b214-433c-9df3-3877479de057 could not be found. Sep 14 09:00:12.105561 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:00:12.105561 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:00:12.105561 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:00:12.105561 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:00:12.105561 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:00:12.110509 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:00:12.110509 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:00:12.110509 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:00:12.110509 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87bb467f-b214-433c-9df3-3877479de057 could not be found. Sep 14 09:00:12.110509 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:00:12.110509 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ec468c8c-9a8b-4a16-b544-f355af9756fb tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Returning 404 to user: Instance 87bb467f-b214-433c-9df3-3877479de057 could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:00:12.111642 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-ec468c8c-9a8b-4a16-b544-f355af9756fb tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/87bb467f-b214-433c-9df3-3877479de057" status: 404 len: 111 microversion: 2.1 time: 0.038709 Sep 14 09:00:12.113013 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1309/2686] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:00:12 2022] GET /compute/v2.1/servers/87bb467f-b214-433c-9df3-3877479de057 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:00:12.120832 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c739d687-b160-4d4b-96cb-44fe43ebf526 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:12.121735 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-c739d687-b160-4d4b-96cb-44fe43ebf526 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] [instance: 2da88a50-c283-4c91-b3e1-bd4f5eb9e319] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:12.131809 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c739d687-b160-4d4b-96cb-44fe43ebf526 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:12.132390 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c739d687-b160-4d4b-96cb-44fe43ebf526 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:12.132904 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c739d687-b160-4d4b-96cb-44fe43ebf526 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:12.133364 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-c90759af-ed8b-4710-96f5-efe5bf676fd3 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc9edb486f8481a99778bdac0ef3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d168a11f24eeb861d3451e0c270cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:12.133777 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c739d687-b160-4d4b-96cb-44fe43ebf526 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:12.134311 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c739d687-b160-4d4b-96cb-44fe43ebf526 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:12.134846 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c739d687-b160-4d4b-96cb-44fe43ebf526 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:12.143963 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-c90759af-ed8b-4710-96f5-efe5bf676fd3 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fdc9edb486f8481a99778bdac0ef3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d168a11f24eeb861d3451e0c270cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:12.146003 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-c90759af-ed8b-4710-96f5-efe5bf676fd3 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fdc9edb486f8481a99778bdac0ef3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d168a11f24eeb861d3451e0c270cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:12.151751 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-c90759af-ed8b-4710-96f5-efe5bf676fd3 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] 10.222.0.60 "GET /compute/v2.1/servers/9ddb5908-22a9-41c8-909c-39cdf479bdd2" status: 200 len: 1438 microversion: 2.75 time: 0.125356 Sep 14 09:00:12.167959 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1378/2687] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:00:12 2022] GET /compute/v2.1/servers/9ddb5908-22a9-41c8-909c-39cdf479bdd2 => generated 1438 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:00:12.172904 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a37da43d-3418-4709-abe3-0c1e325c3fc6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:12.173415 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-a37da43d-3418-4709-abe3-0c1e325c3fc6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 835d2ec2-e2af-4e09-92bf-37b271626011] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:12.180402 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a37da43d-3418-4709-abe3-0c1e325c3fc6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:12.180901 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a37da43d-3418-4709-abe3-0c1e325c3fc6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:12.181409 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a37da43d-3418-4709-abe3-0c1e325c3fc6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:12.182102 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a37da43d-3418-4709-abe3-0c1e325c3fc6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:12.182589 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a37da43d-3418-4709-abe3-0c1e325c3fc6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:12.183120 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a37da43d-3418-4709-abe3-0c1e325c3fc6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:12.210600 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-a37da43d-3418-4709-abe3-0c1e325c3fc6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 835d2ec2-e2af-4e09-92bf-37b271626011] Going to try to terminate instance {{(pid=128758) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:00:12.306778 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-c739d687-b160-4d4b-96cb-44fe43ebf526 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db65c0cfa83f48468d4a1bcef0caff73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9df06ceaa154f3c80665cc6a27b3598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:12.323446 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-a37da43d-3418-4709-abe3-0c1e325c3fc6 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "DELETE /compute/v2.1/servers/835d2ec2-e2af-4e09-92bf-37b271626011" status: 204 len: 0 microversion: 2.1 time: 0.153909 Sep 14 09:00:12.324118 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-c739d687-b160-4d4b-96cb-44fe43ebf526 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] 10.222.0.60 "GET /compute/v2.1/servers/2da88a50-c283-4c91-b3e1-bd4f5eb9e319" status: 200 len: 1646 microversion: 2.1 time: 0.209722 Sep 14 09:00:12.324700 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1310/2689] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:00:12 2022] GET /compute/v2.1/servers/2da88a50-c283-4c91-b3e1-bd4f5eb9e319 => generated 1646 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:00:12.327034 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1379/2689] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:00:12 2022] DELETE /compute/v2.1/servers/835d2ec2-e2af-4e09-92bf-37b271626011 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:00:12.335542 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-2f5fc81a-d40a-45f2-a30d-2137dd7d6d95 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:12.336262 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-2f5fc81a-d40a-45f2-a30d-2137dd7d6d95 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 835d2ec2-e2af-4e09-92bf-37b271626011] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:12.347759 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2f5fc81a-d40a-45f2-a30d-2137dd7d6d95 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:12.348268 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2f5fc81a-d40a-45f2-a30d-2137dd7d6d95 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:12.348707 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2f5fc81a-d40a-45f2-a30d-2137dd7d6d95 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:12.349597 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2f5fc81a-d40a-45f2-a30d-2137dd7d6d95 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:12.350059 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2f5fc81a-d40a-45f2-a30d-2137dd7d6d95 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:12.350630 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2f5fc81a-d40a-45f2-a30d-2137dd7d6d95 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:12.397327 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-40f7ab97-9117-48ab-9836-afd62739065a tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:00:12.400675 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-40f7ab97-9117-48ab-9836-afd62739065a tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] [instance: 9ddb5908-22a9-41c8-909c-39cdf479bdd2] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:12.406854 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-40f7ab97-9117-48ab-9836-afd62739065a tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:12.407400 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-40f7ab97-9117-48ab-9836-afd62739065a tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:12.407844 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-40f7ab97-9117-48ab-9836-afd62739065a tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:12.408584 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-40f7ab97-9117-48ab-9836-afd62739065a tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:12.409043 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-40f7ab97-9117-48ab-9836-afd62739065a tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:12.409475 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-40f7ab97-9117-48ab-9836-afd62739065a tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:12.508930 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-2f5fc81a-d40a-45f2-a30d-2137dd7d6d95 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:12.511595 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-40f7ab97-9117-48ab-9836-afd62739065a tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Flavor limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:00:12.512029 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-40f7ab97-9117-48ab-9836-afd62739065a tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Image limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:00:12.513626 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-40f7ab97-9117-48ab-9836-afd62739065a tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Flavor pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:00:12.514060 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-40f7ab97-9117-48ab-9836-afd62739065a tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Image pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:00:12.514484 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-40f7ab97-9117-48ab-9836-afd62739065a tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:00:12.517603 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-2f5fc81a-d40a-45f2-a30d-2137dd7d6d95 tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/835d2ec2-e2af-4e09-92bf-37b271626011" status: 200 len: 1478 microversion: 2.1 time: 0.186995 Sep 14 09:00:12.518186 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1380/2690] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:00:12 2022] GET /compute/v2.1/servers/835d2ec2-e2af-4e09-92bf-37b271626011 => generated 1478 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:00:12.578573 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-40f7ab97-9117-48ab-9836-afd62739065a tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] [instance: 9ddb5908-22a9-41c8-909c-39cdf479bdd2] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:12.585086 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-40f7ab97-9117-48ab-9836-afd62739065a tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:12.585786 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-40f7ab97-9117-48ab-9836-afd62739065a tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:12.586233 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-40f7ab97-9117-48ab-9836-afd62739065a tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:12.586960 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-40f7ab97-9117-48ab-9836-afd62739065a tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:12.587415 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-40f7ab97-9117-48ab-9836-afd62739065a tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:12.587837 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-40f7ab97-9117-48ab-9836-afd62739065a tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:12.704950 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.objects.instance [None req-40f7ab97-9117-48ab-9836-afd62739065a tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lazy-loading 'services' on Instance uuid 9ddb5908-22a9-41c8-909c-39cdf479bdd2 {{(pid=128759) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:00:12.721474 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-40f7ab97-9117-48ab-9836-afd62739065a tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/9ddb5908-22a9-41c8-909c-39cdf479bdd2/action" status: 202 len: 1944 microversion: 2.75 time: 0.395123 Sep 14 09:00:12.722118 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1311/2691] 10.222.0.60 () {62 vars in 1319 bytes} [Wed Sep 14 09:00:12 2022] POST /compute/v2.1/servers/9ddb5908-22a9-41c8-909c-39cdf479bdd2/action => generated 1944 bytes in 396 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Sep 14 09:00:12.748094 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ecf7e9ee-ef8e-4da9-bd55-ed7926419925 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:12.748881 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-ecf7e9ee-ef8e-4da9-bd55-ed7926419925 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] [instance: 9ddb5908-22a9-41c8-909c-39cdf479bdd2] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:12.756014 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ecf7e9ee-ef8e-4da9-bd55-ed7926419925 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:12.756511 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ecf7e9ee-ef8e-4da9-bd55-ed7926419925 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:12.757012 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ecf7e9ee-ef8e-4da9-bd55-ed7926419925 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:12.757710 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ecf7e9ee-ef8e-4da9-bd55-ed7926419925 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:12.758205 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ecf7e9ee-ef8e-4da9-bd55-ed7926419925 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:12.758650 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ecf7e9ee-ef8e-4da9-bd55-ed7926419925 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:12.880405 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.objects.instance [None req-ecf7e9ee-ef8e-4da9-bd55-ed7926419925 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lazy-loading 'services' on Instance uuid 9ddb5908-22a9-41c8-909c-39cdf479bdd2 {{(pid=128758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:00:12.897673 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-ecf7e9ee-ef8e-4da9-bd55-ed7926419925 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/9ddb5908-22a9-41c8-909c-39cdf479bdd2" status: 200 len: 1931 microversion: 2.75 time: 0.153837 Sep 14 09:00:12.898263 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1381/2692] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:00:12 2022] GET /compute/v2.1/servers/9ddb5908-22a9-41c8-909c-39cdf479bdd2 => generated 1931 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:00:12.933336 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-952b1d2a-6d51-41e7-8fc7-d2da17bc93fb tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:12.933956 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-952b1d2a-6d51-41e7-8fc7-d2da17bc93fb tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: 8f7f80e3-c2f5-4719-a484-29d6bd0d9e91] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:12.940785 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-952b1d2a-6d51-41e7-8fc7-d2da17bc93fb tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:12.941266 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-952b1d2a-6d51-41e7-8fc7-d2da17bc93fb tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:12.941705 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-952b1d2a-6d51-41e7-8fc7-d2da17bc93fb tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:12.942521 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-952b1d2a-6d51-41e7-8fc7-d2da17bc93fb tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:12.943007 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-952b1d2a-6d51-41e7-8fc7-d2da17bc93fb tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:12.943438 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-952b1d2a-6d51-41e7-8fc7-d2da17bc93fb tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:13.080722 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-952b1d2a-6d51-41e7-8fc7-d2da17bc93fb tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9d40e54481461cba53fedb9a6abdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed2295a58f8451993a57ce0a6f9ba29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:13.089059 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-952b1d2a-6d51-41e7-8fc7-d2da17bc93fb tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7f80e3-c2f5-4719-a484-29d6bd0d9e91" status: 200 len: 1508 microversion: 2.1 time: 0.159731 Sep 14 09:00:13.089674 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1312/2693] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:00:12 2022] GET /compute/v2.1/servers/8f7f80e3-c2f5-4719-a484-29d6bd0d9e91 => generated 1508 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:00:13.112960 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-0ea61587-e097-483a-99ec-18a878c8970c tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:13.114822 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-0ea61587-e097-483a-99ec-18a878c8970c tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: 8f7f80e3-c2f5-4719-a484-29d6bd0d9e91] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:13.121293 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0ea61587-e097-483a-99ec-18a878c8970c tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:13.121720 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0ea61587-e097-483a-99ec-18a878c8970c tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:13.122156 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0ea61587-e097-483a-99ec-18a878c8970c tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:13.123434 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0ea61587-e097-483a-99ec-18a878c8970c tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:13.123892 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0ea61587-e097-483a-99ec-18a878c8970c tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:13.124341 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0ea61587-e097-483a-99ec-18a878c8970c tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:13.254390 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-0ea61587-e097-483a-99ec-18a878c8970c tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9d40e54481461cba53fedb9a6abdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed2295a58f8451993a57ce0a6f9ba29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:13.262292 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-0ea61587-e097-483a-99ec-18a878c8970c tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7f80e3-c2f5-4719-a484-29d6bd0d9e91" status: 200 len: 1508 microversion: 2.1 time: 0.153224 Sep 14 09:00:13.262899 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1382/2694] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:00:13 2022] GET /compute/v2.1/servers/8f7f80e3-c2f5-4719-a484-29d6bd0d9e91 => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:00:13.284078 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-7df08375-1026-4b66-a0fa-a7c10f79aef2 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:00:13.286725 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-7df08375-1026-4b66-a0fa-a7c10f79aef2 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: 8f7f80e3-c2f5-4719-a484-29d6bd0d9e91] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:13.292905 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7df08375-1026-4b66-a0fa-a7c10f79aef2 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:13.293397 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7df08375-1026-4b66-a0fa-a7c10f79aef2 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:13.293838 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7df08375-1026-4b66-a0fa-a7c10f79aef2 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:13.295161 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7df08375-1026-4b66-a0fa-a7c10f79aef2 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:13.295624 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7df08375-1026-4b66-a0fa-a7c10f79aef2 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:13.296053 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7df08375-1026-4b66-a0fa-a7c10f79aef2 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:13.349541 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-6212cb88-fa84-4688-b415-c96fe2961eac tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:13.350456 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-6212cb88-fa84-4688-b415-c96fe2961eac tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] [instance: 2da88a50-c283-4c91-b3e1-bd4f5eb9e319] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:13.357783 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6212cb88-fa84-4688-b415-c96fe2961eac tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:13.358554 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6212cb88-fa84-4688-b415-c96fe2961eac tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:13.359082 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6212cb88-fa84-4688-b415-c96fe2961eac tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:13.360364 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6212cb88-fa84-4688-b415-c96fe2961eac tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:13.361108 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6212cb88-fa84-4688-b415-c96fe2961eac tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:13.361679 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6212cb88-fa84-4688-b415-c96fe2961eac tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:13.367502 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-7df08375-1026-4b66-a0fa-a7c10f79aef2 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] 10.222.0.60 "PUT /compute/v2.1/servers/8f7f80e3-c2f5-4719-a484-29d6bd0d9e91" status: 200 len: 1080 microversion: 2.1 time: 0.086903 Sep 14 09:00:13.377942 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1313/2695] 10.222.0.60 () {60 vars in 1256 bytes} [Wed Sep 14 09:00:13 2022] PUT /compute/v2.1/servers/8f7f80e3-c2f5-4719-a484-29d6bd0d9e91 => generated 1080 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:00:13.387131 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e9c6491d-1405-4c9a-86de-6a1b3f9426ac tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:13.387684 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e9c6491d-1405-4c9a-86de-6a1b3f9426ac tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: 8f7f80e3-c2f5-4719-a484-29d6bd0d9e91] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:13.394097 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e9c6491d-1405-4c9a-86de-6a1b3f9426ac tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:13.395894 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e9c6491d-1405-4c9a-86de-6a1b3f9426ac tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:13.396362 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e9c6491d-1405-4c9a-86de-6a1b3f9426ac tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:13.397109 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e9c6491d-1405-4c9a-86de-6a1b3f9426ac tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:13.397578 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e9c6491d-1405-4c9a-86de-6a1b3f9426ac tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:13.398007 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e9c6491d-1405-4c9a-86de-6a1b3f9426ac tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:13.630030 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-6212cb88-fa84-4688-b415-c96fe2961eac tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db65c0cfa83f48468d4a1bcef0caff73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9df06ceaa154f3c80665cc6a27b3598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:13.639909 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-6212cb88-fa84-4688-b415-c96fe2961eac tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] 10.222.0.60 "GET /compute/v2.1/servers/2da88a50-c283-4c91-b3e1-bd4f5eb9e319" status: 200 len: 1646 microversion: 2.1 time: 0.294291 Sep 14 09:00:13.641316 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1383/2696] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:00:13 2022] GET /compute/v2.1/servers/2da88a50-c283-4c91-b3e1-bd4f5eb9e319 => generated 1646 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:00:13.643009 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-e9c6491d-1405-4c9a-86de-6a1b3f9426ac tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9d40e54481461cba53fedb9a6abdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed2295a58f8451993a57ce0a6f9ba29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:13.645852 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a0bb9b2b-6105-4018-8eb4-c506b62f69ae tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:13.646628 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-a0bb9b2b-6105-4018-8eb4-c506b62f69ae tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 835d2ec2-e2af-4e09-92bf-37b271626011] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:13.651568 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e9c6491d-1405-4c9a-86de-6a1b3f9426ac tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7f80e3-c2f5-4719-a484-29d6bd0d9e91" status: 200 len: 1506 microversion: 2.1 time: 0.268314 Sep 14 09:00:13.654661 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a0bb9b2b-6105-4018-8eb4-c506b62f69ae tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:13.655375 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1314/2697] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:00:13 2022] GET /compute/v2.1/servers/8f7f80e3-c2f5-4719-a484-29d6bd0d9e91 => generated 1506 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:00:13.667125 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a0bb9b2b-6105-4018-8eb4-c506b62f69ae tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:13.667125 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a0bb9b2b-6105-4018-8eb4-c506b62f69ae tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:13.667125 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a0bb9b2b-6105-4018-8eb4-c506b62f69ae tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:13.667125 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a0bb9b2b-6105-4018-8eb4-c506b62f69ae tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:13.667125 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a0bb9b2b-6105-4018-8eb4-c506b62f69ae tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:13.678530 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-93bbd04a-07fd-4544-89ef-c1640a71647e tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:13.679503 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-93bbd04a-07fd-4544-89ef-c1640a71647e tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: 8f7f80e3-c2f5-4719-a484-29d6bd0d9e91] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:13.686148 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-93bbd04a-07fd-4544-89ef-c1640a71647e tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:13.686719 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-93bbd04a-07fd-4544-89ef-c1640a71647e tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:13.687288 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-93bbd04a-07fd-4544-89ef-c1640a71647e tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:13.688199 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-93bbd04a-07fd-4544-89ef-c1640a71647e tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:13.688660 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-93bbd04a-07fd-4544-89ef-c1640a71647e tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:13.689088 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-93bbd04a-07fd-4544-89ef-c1640a71647e tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:13.873337 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-a0bb9b2b-6105-4018-8eb4-c506b62f69ae tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:13.882008 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-93bbd04a-07fd-4544-89ef-c1640a71647e tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9d40e54481461cba53fedb9a6abdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed2295a58f8451993a57ce0a6f9ba29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:13.882930 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-a0bb9b2b-6105-4018-8eb4-c506b62f69ae tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/835d2ec2-e2af-4e09-92bf-37b271626011" status: 200 len: 1478 microversion: 2.1 time: 0.240564 Sep 14 09:00:13.883546 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1384/2698] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:00:13 2022] GET /compute/v2.1/servers/835d2ec2-e2af-4e09-92bf-37b271626011 => generated 1478 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:00:13.891396 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-93bbd04a-07fd-4544-89ef-c1640a71647e tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7f80e3-c2f5-4719-a484-29d6bd0d9e91" status: 200 len: 1506 microversion: 2.1 time: 0.216756 Sep 14 09:00:13.892141 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1315/2699] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:00:13 2022] GET /compute/v2.1/servers/8f7f80e3-c2f5-4719-a484-29d6bd0d9e91 => generated 1506 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:00:13.914243 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-fa0fc2c8-a36d-48bd-9788-12a22a478f7b tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:00:13.917227 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-fa0fc2c8-a36d-48bd-9788-12a22a478f7b tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: 8f7f80e3-c2f5-4719-a484-29d6bd0d9e91] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:13.923973 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fa0fc2c8-a36d-48bd-9788-12a22a478f7b tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:13.924751 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fa0fc2c8-a36d-48bd-9788-12a22a478f7b tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:13.925195 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fa0fc2c8-a36d-48bd-9788-12a22a478f7b tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:13.925415 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-eb697be0-40de-461a-be00-ad735926cb3f tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:13.925944 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fa0fc2c8-a36d-48bd-9788-12a22a478f7b tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:13.926342 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-eb697be0-40de-461a-be00-ad735926cb3f tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] [instance: 9ddb5908-22a9-41c8-909c-39cdf479bdd2] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:13.926479 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fa0fc2c8-a36d-48bd-9788-12a22a478f7b tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:13.926827 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fa0fc2c8-a36d-48bd-9788-12a22a478f7b tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:13.934396 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-eb697be0-40de-461a-be00-ad735926cb3f tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:13.936116 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-eb697be0-40de-461a-be00-ad735926cb3f tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:13.936863 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-eb697be0-40de-461a-be00-ad735926cb3f tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:13.937791 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-eb697be0-40de-461a-be00-ad735926cb3f tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:13.938459 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-eb697be0-40de-461a-be00-ad735926cb3f tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:13.939125 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-eb697be0-40de-461a-be00-ad735926cb3f tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:13.947185 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:00:14.040018 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-fa0fc2c8-a36d-48bd-9788-12a22a478f7b tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Flavor limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:00:14.042204 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-fa0fc2c8-a36d-48bd-9788-12a22a478f7b tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Image limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:00:14.042896 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-fa0fc2c8-a36d-48bd-9788-12a22a478f7b tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Flavor pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:00:14.045578 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-fa0fc2c8-a36d-48bd-9788-12a22a478f7b tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Image pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:00:14.046175 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-fa0fc2c8-a36d-48bd-9788-12a22a478f7b tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:00:14.114590 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.objects.instance [None req-eb697be0-40de-461a-be00-ad735926cb3f tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lazy-loading 'services' on Instance uuid 9ddb5908-22a9-41c8-909c-39cdf479bdd2 {{(pid=128759) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:00:14.180382 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-eb697be0-40de-461a-be00-ad735926cb3f tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/9ddb5908-22a9-41c8-909c-39cdf479bdd2" status: 200 len: 1931 microversion: 2.75 time: 0.256924 Sep 14 09:00:14.182437 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1316/2700] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:00:13 2022] GET /compute/v2.1/servers/9ddb5908-22a9-41c8-909c-39cdf479bdd2 => generated 1931 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 09:00:14.183747 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-fa0fc2c8-a36d-48bd-9788-12a22a478f7b tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: 8f7f80e3-c2f5-4719-a484-29d6bd0d9e91] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:14.204605 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fa0fc2c8-a36d-48bd-9788-12a22a478f7b tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:14.205047 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fa0fc2c8-a36d-48bd-9788-12a22a478f7b tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:14.205494 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fa0fc2c8-a36d-48bd-9788-12a22a478f7b tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:14.206227 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fa0fc2c8-a36d-48bd-9788-12a22a478f7b tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:14.206785 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fa0fc2c8-a36d-48bd-9788-12a22a478f7b tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:14.215720 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fa0fc2c8-a36d-48bd-9788-12a22a478f7b tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:14.253071 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-fa0fc2c8-a36d-48bd-9788-12a22a478f7b tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] 10.222.0.60 "POST /compute/v2.1/servers/8f7f80e3-c2f5-4719-a484-29d6bd0d9e91/action" status: 202 len: 1112 microversion: 2.1 time: 0.342746 Sep 14 09:00:14.258398 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1385/2701] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:00:13 2022] POST /compute/v2.1/servers/8f7f80e3-c2f5-4719-a484-29d6bd0d9e91/action => generated 1112 bytes in 349 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Sep 14 09:00:14.272387 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-48d21760-5ba4-497d-b31b-f8b9498f04a6 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:14.274066 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-48d21760-5ba4-497d-b31b-f8b9498f04a6 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: 8f7f80e3-c2f5-4719-a484-29d6bd0d9e91] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:14.282566 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-48d21760-5ba4-497d-b31b-f8b9498f04a6 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:14.298120 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-48d21760-5ba4-497d-b31b-f8b9498f04a6 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:14.302195 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-48d21760-5ba4-497d-b31b-f8b9498f04a6 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:14.303024 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-48d21760-5ba4-497d-b31b-f8b9498f04a6 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:14.303513 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-48d21760-5ba4-497d-b31b-f8b9498f04a6 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:14.306517 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-48d21760-5ba4-497d-b31b-f8b9498f04a6 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:14.664597 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-52e00a33-09e5-4a4b-b676-0d7a19b7a157 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:14.665234 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-52e00a33-09e5-4a4b-b676-0d7a19b7a157 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] [instance: 2da88a50-c283-4c91-b3e1-bd4f5eb9e319] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:14.677379 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-52e00a33-09e5-4a4b-b676-0d7a19b7a157 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:14.677886 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-52e00a33-09e5-4a4b-b676-0d7a19b7a157 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:14.678332 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-52e00a33-09e5-4a4b-b676-0d7a19b7a157 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:14.679275 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-52e00a33-09e5-4a4b-b676-0d7a19b7a157 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:14.679742 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-52e00a33-09e5-4a4b-b676-0d7a19b7a157 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:14.680178 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-52e00a33-09e5-4a4b-b676-0d7a19b7a157 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:14.694014 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-48d21760-5ba4-497d-b31b-f8b9498f04a6 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9d40e54481461cba53fedb9a6abdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed2295a58f8451993a57ce0a6f9ba29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:14.705948 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-48d21760-5ba4-497d-b31b-f8b9498f04a6 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7f80e3-c2f5-4719-a484-29d6bd0d9e91" status: 200 len: 1517 microversion: 2.1 time: 0.437429 Sep 14 09:00:14.706839 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1317/2702] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:00:14 2022] GET /compute/v2.1/servers/8f7f80e3-c2f5-4719-a484-29d6bd0d9e91 => generated 1517 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:00:14.838593 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-ac0653d9-448f-46d4-876f-d8fec37d7ede req-62fca489-72c0-4a3a-b3a7-5fd28415c59d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2da88a50-c283-4c91-b3e1-bd4f5eb9e319", "name": "network-vif-deleted", "tag": "0e0d5077-876f-4296-b015-ba13bb73c465"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:00:14.860639 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-ac0653d9-448f-46d4-876f-d8fec37d7ede req-62fca489-72c0-4a3a-b3a7-5fd28415c59d service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:14.861772 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-ac0653d9-448f-46d4-876f-d8fec37d7ede req-62fca489-72c0-4a3a-b3a7-5fd28415c59d service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:14.862601 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-ac0653d9-448f-46d4-876f-d8fec37d7ede req-62fca489-72c0-4a3a-b3a7-5fd28415c59d service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:14.889980 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-ac0653d9-448f-46d4-876f-d8fec37d7ede req-62fca489-72c0-4a3a-b3a7-5fd28415c59d service nova] Creating event network-vif-deleted:0e0d5077-876f-4296-b015-ba13bb73c465 for instance 2da88a50-c283-4c91-b3e1-bd4f5eb9e319 on n-h2-836830-18 Sep 14 09:00:14.892277 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-52e00a33-09e5-4a4b-b676-0d7a19b7a157 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db65c0cfa83f48468d4a1bcef0caff73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9df06ceaa154f3c80665cc6a27b3598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:14.897271 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-ac0653d9-448f-46d4-876f-d8fec37d7ede req-62fca489-72c0-4a3a-b3a7-5fd28415c59d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066651 Sep 14 09:00:14.898323 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1318/2703] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:00:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:00:14.906013 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-52e00a33-09e5-4a4b-b676-0d7a19b7a157 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] 10.222.0.60 "GET /compute/v2.1/servers/2da88a50-c283-4c91-b3e1-bd4f5eb9e319" status: 200 len: 1604 microversion: 2.1 time: 0.242743 Sep 14 09:00:14.906707 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1386/2704] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:00:14 2022] GET /compute/v2.1/servers/2da88a50-c283-4c91-b3e1-bd4f5eb9e319 => generated 1604 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:00:14.910922 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-4a4b1257-f083-41f2-8c77-566694ae385a tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:14.911702 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-4a4b1257-f083-41f2-8c77-566694ae385a tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 835d2ec2-e2af-4e09-92bf-37b271626011] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:14.924899 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4a4b1257-f083-41f2-8c77-566694ae385a tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:14.930526 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4a4b1257-f083-41f2-8c77-566694ae385a tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:14.931099 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4a4b1257-f083-41f2-8c77-566694ae385a tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:14.931965 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4a4b1257-f083-41f2-8c77-566694ae385a tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:14.932415 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4a4b1257-f083-41f2-8c77-566694ae385a tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:14.933176 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4a4b1257-f083-41f2-8c77-566694ae385a tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:15.225716 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-706d124f-6b20-48ec-a975-a7134a53fba3 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:15.226342 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-706d124f-6b20-48ec-a975-a7134a53fba3 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] [instance: 9ddb5908-22a9-41c8-909c-39cdf479bdd2] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:15.234762 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-706d124f-6b20-48ec-a975-a7134a53fba3 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:15.235297 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-706d124f-6b20-48ec-a975-a7134a53fba3 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:15.235733 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-706d124f-6b20-48ec-a975-a7134a53fba3 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:15.236441 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-706d124f-6b20-48ec-a975-a7134a53fba3 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:15.236892 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-706d124f-6b20-48ec-a975-a7134a53fba3 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:15.237608 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-706d124f-6b20-48ec-a975-a7134a53fba3 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:15.492045 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.objects.instance [None req-706d124f-6b20-48ec-a975-a7134a53fba3 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lazy-loading 'services' on Instance uuid 9ddb5908-22a9-41c8-909c-39cdf479bdd2 {{(pid=128758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:00:15.514647 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-706d124f-6b20-48ec-a975-a7134a53fba3 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/9ddb5908-22a9-41c8-909c-39cdf479bdd2" status: 200 len: 1931 microversion: 2.75 time: 0.293641 Sep 14 09:00:15.515695 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1387/2705] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:00:15 2022] GET /compute/v2.1/servers/9ddb5908-22a9-41c8-909c-39cdf479bdd2 => generated 1931 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:00:15.585994 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-28cc3101-0b7a-40c0-8982-68effa2d4876 req-207e6262-23b5-4b1c-b929-0ed1ea253903 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "835d2ec2-e2af-4e09-92bf-37b271626011", "name": "network-vif-deleted", "tag": "eb3ddc92-9211-4f37-91fb-186549e2b6cd"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:00:15.605735 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:00:15.614388 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-28cc3101-0b7a-40c0-8982-68effa2d4876 req-207e6262-23b5-4b1c-b929-0ed1ea253903 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:15.615013 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-28cc3101-0b7a-40c0-8982-68effa2d4876 req-207e6262-23b5-4b1c-b929-0ed1ea253903 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:15.615517 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-28cc3101-0b7a-40c0-8982-68effa2d4876 req-207e6262-23b5-4b1c-b929-0ed1ea253903 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:15.626582 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-4a4b1257-f083-41f2-8c77-566694ae385a tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1473e6771ff1459c831d66311318404d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46ca7b6c331417199f9dfc5ffa80470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:15.628650 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-28cc3101-0b7a-40c0-8982-68effa2d4876 req-207e6262-23b5-4b1c-b929-0ed1ea253903 service nova] Creating event network-vif-deleted:eb3ddc92-9211-4f37-91fb-186549e2b6cd for instance 835d2ec2-e2af-4e09-92bf-37b271626011 on n-h1-836830-18 Sep 14 09:00:15.633639 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-28cc3101-0b7a-40c0-8982-68effa2d4876 req-207e6262-23b5-4b1c-b929-0ed1ea253903 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052371 Sep 14 09:00:15.634874 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1388/2706] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:00:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:00:15.637306 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-4a4b1257-f083-41f2-8c77-566694ae385a tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/835d2ec2-e2af-4e09-92bf-37b271626011" status: 200 len: 1478 microversion: 2.1 time: 0.733277 Sep 14 09:00:15.637881 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1319/2707] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:00:14 2022] GET /compute/v2.1/servers/835d2ec2-e2af-4e09-92bf-37b271626011 => generated 1478 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:00:15.731248 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-19cf4052-c2ab-4693-ae2d-9607d8ff0571 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:15.732024 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-19cf4052-c2ab-4693-ae2d-9607d8ff0571 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: 8f7f80e3-c2f5-4719-a484-29d6bd0d9e91] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:15.745891 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-19cf4052-c2ab-4693-ae2d-9607d8ff0571 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:15.746377 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-19cf4052-c2ab-4693-ae2d-9607d8ff0571 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:15.749642 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-19cf4052-c2ab-4693-ae2d-9607d8ff0571 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:15.750481 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-19cf4052-c2ab-4693-ae2d-9607d8ff0571 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:15.751018 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-19cf4052-c2ab-4693-ae2d-9607d8ff0571 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:15.755322 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-19cf4052-c2ab-4693-ae2d-9607d8ff0571 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:15.941529 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ca117ebc-f232-4bf9-9590-ec45d74f0bf6 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:15.945240 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-ca117ebc-f232-4bf9-9590-ec45d74f0bf6 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] [instance: 2da88a50-c283-4c91-b3e1-bd4f5eb9e319] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:15.964627 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ca117ebc-f232-4bf9-9590-ec45d74f0bf6 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:15.966786 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ca117ebc-f232-4bf9-9590-ec45d74f0bf6 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:15.971111 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ca117ebc-f232-4bf9-9590-ec45d74f0bf6 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:15.972799 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ca117ebc-f232-4bf9-9590-ec45d74f0bf6 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:15.973646 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ca117ebc-f232-4bf9-9590-ec45d74f0bf6 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:15.974362 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ca117ebc-f232-4bf9-9590-ec45d74f0bf6 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:15.993076 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-ca117ebc-f232-4bf9-9590-ec45d74f0bf6 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] HTTP exception thrown: Instance 2da88a50-c283-4c91-b3e1-bd4f5eb9e319 could not be found. Sep 14 09:00:15.995717 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ca117ebc-f232-4bf9-9590-ec45d74f0bf6 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Request method failure captured: Sep 14 09:00:15.995717 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/2da88a50-c283-4c91-b3e1-bd4f5eb9e319 HTTP/1.1 Sep 14 09:00:15.995717 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:00:15.995717 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:00:15.995717 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:00:15.995717 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:00:15.995717 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:00:15.995717 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:00:15.995717 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:00:15.995717 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:00:15.995717 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZfiLS4Dd7eH1wltzSbPX84DokZp6CVegujFOyb4EWT2TjTTNUqwjROiHXAC6fhQWjxO3IKN3sTuQg3kPkZqTukAyIteecXLk7I6nAEMGExhj4zko4WfmQUZX-YqQZxk-Lh_HXrlzm3yNQR4KH4lu8yv_rqRCvpzazwcqqm32gFYV5Q Sep 14 09:00:15.995717 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:00:15.995717 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:00:15.995717 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:00:15.995717 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:00:15.995717 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:00:15.995717 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:00:15.995717 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: d9df06ceaa154f3c80665cc6a27b3598 Sep 14 09:00:15.995717 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1544566855 Sep 14 09:00:15.995717 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:00:15.995717 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:00:15.995717 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/d9df06ceaa154f3c80665cc6a27b3598"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_d9df06ceaa154f3c80665cc6a27b3598"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d9df06ceaa154f3c80665cc6a27b3598"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d9df06ceaa154f3c80665cc6a27b3598"}]}] Sep 14 09:00:15.995717 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1544566855 Sep 14 09:00:15.995717 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: d9df06ceaa154f3c80665cc6a27b3598 Sep 14 09:00:15.995717 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1544566855 Sep 14 09:00:15.995717 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-FloatingIPsAssociationTestJSON-1544566855-project Sep 14 09:00:15.995717 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:00:15.995717 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:00:15.995717 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: db65c0cfa83f48468d4a1bcef0caff73 Sep 14 09:00:15.995717 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1544566855-project Sep 14 09:00:15.995717 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:00:15.995717 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance 2da88a50-c283-4c91-b3e1-bd4f5eb9e319 could not be found. Sep 14 09:00:15.995717 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '2da88a50-c283-4c91-b3e1-bd4f5eb9e319'} Sep 14 09:00:15.995717 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:00:15.995717 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:00:15.995717 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:00:15.995717 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:00:15.995717 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:00:15.995717 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:00:15.995717 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:00:15.995717 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:00:15.995717 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:00:15.995717 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:00:15.995717 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2da88a50-c283-4c91-b3e1-bd4f5eb9e319 could not be found. Sep 14 09:00:15.995717 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:00:15.995717 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:00:15.995717 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:00:15.995717 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:00:15.995717 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:00:15.995717 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:00:15.995717 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:00:15.995717 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:00:15.995717 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:00:15.995717 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:00:15.995717 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:00:15.995717 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:00:15.995717 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:00:15.995717 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:00:15.995717 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:00:15.995717 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:00:15.995717 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2da88a50-c283-4c91-b3e1-bd4f5eb9e319 could not be found. Sep 14 09:00:15.995717 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:00:15.995717 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:00:16.001750 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:00:16.001750 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:00:16.001750 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:00:16.001750 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:00:16.001750 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:00:16.001750 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:00:16.001750 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2da88a50-c283-4c91-b3e1-bd4f5eb9e319 could not be found. Sep 14 09:00:16.001750 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:00:16.004743 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ca117ebc-f232-4bf9-9590-ec45d74f0bf6 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] Returning 404 to user: Instance 2da88a50-c283-4c91-b3e1-bd4f5eb9e319 could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:00:16.005511 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-ca117ebc-f232-4bf9-9590-ec45d74f0bf6 tempest-FloatingIPsAssociationTestJSON-1544566855 tempest-FloatingIPsAssociationTestJSON-1544566855-project] 10.222.0.60 "GET /compute/v2.1/servers/2da88a50-c283-4c91-b3e1-bd4f5eb9e319" status: 404 len: 111 microversion: 2.1 time: 0.077049 Sep 14 09:00:16.007189 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1320/2708] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:00:15 2022] GET /compute/v2.1/servers/2da88a50-c283-4c91-b3e1-bd4f5eb9e319 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:00:16.027462 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-19cf4052-c2ab-4693-ae2d-9607d8ff0571 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9d40e54481461cba53fedb9a6abdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed2295a58f8451993a57ce0a6f9ba29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:16.035583 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-19cf4052-c2ab-4693-ae2d-9607d8ff0571 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7f80e3-c2f5-4719-a484-29d6bd0d9e91" status: 200 len: 1517 microversion: 2.1 time: 0.309497 Sep 14 09:00:16.036172 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1389/2709] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:00:15 2022] GET /compute/v2.1/servers/8f7f80e3-c2f5-4719-a484-29d6bd0d9e91 => generated 1517 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:00:16.542370 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-63d5d49d-c4c5-4ee7-a1fe-6f9d4c97513a tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:16.543413 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-63d5d49d-c4c5-4ee7-a1fe-6f9d4c97513a tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] [instance: 9ddb5908-22a9-41c8-909c-39cdf479bdd2] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:16.549985 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:00:16.552086 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-63d5d49d-c4c5-4ee7-a1fe-6f9d4c97513a tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:16.552820 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-63d5d49d-c4c5-4ee7-a1fe-6f9d4c97513a tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:16.559619 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-63d5d49d-c4c5-4ee7-a1fe-6f9d4c97513a tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:16.560948 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-63d5d49d-c4c5-4ee7-a1fe-6f9d4c97513a tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:16.561643 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-63d5d49d-c4c5-4ee7-a1fe-6f9d4c97513a tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:16.562276 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-63d5d49d-c4c5-4ee7-a1fe-6f9d4c97513a tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:16.653032 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.objects.instance [None req-63d5d49d-c4c5-4ee7-a1fe-6f9d4c97513a tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lazy-loading 'services' on Instance uuid 9ddb5908-22a9-41c8-909c-39cdf479bdd2 {{(pid=128759) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:00:16.661883 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-5ff638b8-7121-4390-9c00-b19247ffdedc tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:16.662517 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-5ff638b8-7121-4390-9c00-b19247ffdedc tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] [instance: 835d2ec2-e2af-4e09-92bf-37b271626011] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:16.670838 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:00:16.671771 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5ff638b8-7121-4390-9c00-b19247ffdedc tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:16.672351 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5ff638b8-7121-4390-9c00-b19247ffdedc tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:16.672790 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5ff638b8-7121-4390-9c00-b19247ffdedc tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:16.673513 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5ff638b8-7121-4390-9c00-b19247ffdedc tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:16.673972 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5ff638b8-7121-4390-9c00-b19247ffdedc tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:16.674405 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5ff638b8-7121-4390-9c00-b19247ffdedc tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:16.685295 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-63d5d49d-c4c5-4ee7-a1fe-6f9d4c97513a tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/9ddb5908-22a9-41c8-909c-39cdf479bdd2" status: 200 len: 1931 microversion: 2.75 time: 0.146300 Sep 14 09:00:16.686212 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1321/2710] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:00:16 2022] GET /compute/v2.1/servers/9ddb5908-22a9-41c8-909c-39cdf479bdd2 => generated 1931 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:00:16.695984 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-5ff638b8-7121-4390-9c00-b19247ffdedc tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] HTTP exception thrown: Instance 835d2ec2-e2af-4e09-92bf-37b271626011 could not be found. Sep 14 09:00:16.697759 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-5ff638b8-7121-4390-9c00-b19247ffdedc tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Request method failure captured: Sep 14 09:00:16.697759 n-d-836830-18 devstack@n-api.service[128758]: request: GET /compute/v2.1/servers/835d2ec2-e2af-4e09-92bf-37b271626011 HTTP/1.1 Sep 14 09:00:16.697759 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 09:00:16.697759 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 09:00:16.697759 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 09:00:16.697759 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 09:00:16.697759 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 09:00:16.697759 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 09:00:16.697759 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 09:00:16.697759 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 09:00:16.697759 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZcaJwfflKXdBQOzu63TKkiZhpOhYfmFkGJTkIRAE47xWaYCE5owpMd6ZGj3T_7h70-IX-88ov5m9P47-8wvvyB1aoACyyMztTclo7X0AZdOhAhE2WQeLs1dhX-NF72boJ9SoR98XdGx2ROr7Y4PciafvjdUpaADdFYghsgULitlVHs Sep 14 09:00:16.697759 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 09:00:16.697759 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 09:00:16.697759 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 09:00:16.697759 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 09:00:16.697759 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 09:00:16.697759 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 09:00:16.697759 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: a46ca7b6c331417199f9dfc5ffa80470 Sep 14 09:00:16.697759 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-ServersTestJSON-1483820673 Sep 14 09:00:16.697759 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 09:00:16.697759 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 09:00:16.697759 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a46ca7b6c331417199f9dfc5ffa80470"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a46ca7b6c331417199f9dfc5ffa80470"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a46ca7b6c331417199f9dfc5ffa80470"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a46ca7b6c331417199f9dfc5ffa80470"}]}] Sep 14 09:00:16.697759 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-ServersTestJSON-1483820673 Sep 14 09:00:16.697759 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: a46ca7b6c331417199f9dfc5ffa80470 Sep 14 09:00:16.697759 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-ServersTestJSON-1483820673 Sep 14 09:00:16.697759 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-ServersTestJSON-1483820673-project Sep 14 09:00:16.697759 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 09:00:16.697759 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 09:00:16.697759 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 1473e6771ff1459c831d66311318404d Sep 14 09:00:16.697759 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-ServersTestJSON-1483820673-project Sep 14 09:00:16.697759 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 09:00:16.697759 n-d-836830-18 devstack@n-api.service[128758]: exception: Instance 835d2ec2-e2af-4e09-92bf-37b271626011 could not be found. Sep 14 09:00:16.697759 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': '835d2ec2-e2af-4e09-92bf-37b271626011'} Sep 14 09:00:16.697759 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:00:16.697759 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:00:16.697759 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:00:16.697759 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:00:16.697759 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:00:16.697759 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:00:16.697759 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:00:16.697759 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:00:16.697759 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:00:16.697759 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:00:16.697759 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 835d2ec2-e2af-4e09-92bf-37b271626011 could not be found. Sep 14 09:00:16.697759 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:00:16.697759 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:00:16.697759 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:00:16.697759 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:00:16.697759 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:00:16.697759 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:00:16.697759 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:00:16.697759 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:00:16.697759 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:00:16.697759 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:00:16.697759 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:00:16.697759 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:00:16.697759 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:00:16.697759 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:00:16.697759 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:00:16.697759 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:00:16.697759 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 835d2ec2-e2af-4e09-92bf-37b271626011 could not be found. Sep 14 09:00:16.697759 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:00:16.697759 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:00:16.697759 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:00:16.701735 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:00:16.701735 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:00:16.701735 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:00:16.701735 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:00:16.701735 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:00:16.701735 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 835d2ec2-e2af-4e09-92bf-37b271626011 could not be found. Sep 14 09:00:16.701735 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:00:16.701735 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-5ff638b8-7121-4390-9c00-b19247ffdedc tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] Returning 404 to user: Instance 835d2ec2-e2af-4e09-92bf-37b271626011 could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:00:16.701735 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-5ff638b8-7121-4390-9c00-b19247ffdedc tempest-ServersTestJSON-1483820673 tempest-ServersTestJSON-1483820673-project] 10.222.0.60 "GET /compute/v2.1/servers/835d2ec2-e2af-4e09-92bf-37b271626011" status: 404 len: 111 microversion: 2.1 time: 0.041503 Sep 14 09:00:16.704009 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1390/2711] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:00:16 2022] GET /compute/v2.1/servers/835d2ec2-e2af-4e09-92bf-37b271626011 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 14 09:00:17.059600 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-5e3d9f79-063a-4c20-b8e9-389989381c55 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:17.060917 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-5e3d9f79-063a-4c20-b8e9-389989381c55 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: 8f7f80e3-c2f5-4719-a484-29d6bd0d9e91] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:17.068762 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5e3d9f79-063a-4c20-b8e9-389989381c55 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:17.069634 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5e3d9f79-063a-4c20-b8e9-389989381c55 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:17.070322 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5e3d9f79-063a-4c20-b8e9-389989381c55 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:17.071354 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5e3d9f79-063a-4c20-b8e9-389989381c55 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:17.072042 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5e3d9f79-063a-4c20-b8e9-389989381c55 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:17.072696 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5e3d9f79-063a-4c20-b8e9-389989381c55 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:17.415056 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-5e3d9f79-063a-4c20-b8e9-389989381c55 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9d40e54481461cba53fedb9a6abdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed2295a58f8451993a57ce0a6f9ba29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:17.423957 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-5e3d9f79-063a-4c20-b8e9-389989381c55 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7f80e3-c2f5-4719-a484-29d6bd0d9e91" status: 200 len: 1517 microversion: 2.1 time: 0.368128 Sep 14 09:00:17.424888 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1322/2712] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:00:17 2022] GET /compute/v2.1/servers/8f7f80e3-c2f5-4719-a484-29d6bd0d9e91 => generated 1517 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:00:17.717263 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-eee6f2e9-e0a7-49a7-b57b-628ca53b8a68 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:17.718483 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-eee6f2e9-e0a7-49a7-b57b-628ca53b8a68 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] [instance: 9ddb5908-22a9-41c8-909c-39cdf479bdd2] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:17.725485 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-eee6f2e9-e0a7-49a7-b57b-628ca53b8a68 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:17.725968 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-eee6f2e9-e0a7-49a7-b57b-628ca53b8a68 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:17.726395 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-eee6f2e9-e0a7-49a7-b57b-628ca53b8a68 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:17.727143 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-eee6f2e9-e0a7-49a7-b57b-628ca53b8a68 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:17.727591 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-eee6f2e9-e0a7-49a7-b57b-628ca53b8a68 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:17.728010 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-eee6f2e9-e0a7-49a7-b57b-628ca53b8a68 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:17.867565 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.objects.instance [None req-eee6f2e9-e0a7-49a7-b57b-628ca53b8a68 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lazy-loading 'services' on Instance uuid 9ddb5908-22a9-41c8-909c-39cdf479bdd2 {{(pid=128758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:00:17.906602 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-eee6f2e9-e0a7-49a7-b57b-628ca53b8a68 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/9ddb5908-22a9-41c8-909c-39cdf479bdd2" status: 200 len: 1931 microversion: 2.75 time: 0.193635 Sep 14 09:00:17.908114 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1391/2713] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:00:17 2022] GET /compute/v2.1/servers/9ddb5908-22a9-41c8-909c-39cdf479bdd2 => generated 1931 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:00:18.451548 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-fd69b32a-4f65-483d-b619-66822d4fd61d tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:18.452179 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-fd69b32a-4f65-483d-b619-66822d4fd61d tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: 8f7f80e3-c2f5-4719-a484-29d6bd0d9e91] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:18.459652 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fd69b32a-4f65-483d-b619-66822d4fd61d tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:18.460390 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fd69b32a-4f65-483d-b619-66822d4fd61d tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:18.460991 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fd69b32a-4f65-483d-b619-66822d4fd61d tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:18.461871 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fd69b32a-4f65-483d-b619-66822d4fd61d tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:18.462326 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fd69b32a-4f65-483d-b619-66822d4fd61d tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:18.462967 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fd69b32a-4f65-483d-b619-66822d4fd61d tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:18.937474 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c0802b9d-c9ba-49d3-ba97-fa558abcce5f tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:18.938665 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-c0802b9d-c9ba-49d3-ba97-fa558abcce5f tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] [instance: 9ddb5908-22a9-41c8-909c-39cdf479bdd2] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:18.947305 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c0802b9d-c9ba-49d3-ba97-fa558abcce5f tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:18.949213 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c0802b9d-c9ba-49d3-ba97-fa558abcce5f tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:18.949937 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c0802b9d-c9ba-49d3-ba97-fa558abcce5f tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:18.951648 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c0802b9d-c9ba-49d3-ba97-fa558abcce5f tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:18.952371 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c0802b9d-c9ba-49d3-ba97-fa558abcce5f tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:18.952999 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c0802b9d-c9ba-49d3-ba97-fa558abcce5f tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:19.121673 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.objects.instance [None req-c0802b9d-c9ba-49d3-ba97-fa558abcce5f tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lazy-loading 'services' on Instance uuid 9ddb5908-22a9-41c8-909c-39cdf479bdd2 {{(pid=128758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:00:19.145739 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-c0802b9d-c9ba-49d3-ba97-fa558abcce5f tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/9ddb5908-22a9-41c8-909c-39cdf479bdd2" status: 200 len: 1931 microversion: 2.75 time: 0.211907 Sep 14 09:00:19.146667 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1392/2714] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:00:18 2022] GET /compute/v2.1/servers/9ddb5908-22a9-41c8-909c-39cdf479bdd2 => generated 1931 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 09:00:19.189650 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-fd69b32a-4f65-483d-b619-66822d4fd61d tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9d40e54481461cba53fedb9a6abdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed2295a58f8451993a57ce0a6f9ba29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:19.207215 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-fd69b32a-4f65-483d-b619-66822d4fd61d tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7f80e3-c2f5-4719-a484-29d6bd0d9e91" status: 200 len: 1517 microversion: 2.1 time: 0.759409 Sep 14 09:00:19.208472 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1323/2715] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:00:18 2022] GET /compute/v2.1/servers/8f7f80e3-c2f5-4719-a484-29d6bd0d9e91 => generated 1517 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:00:20.174639 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c7df2a20-9011-4e63-be73-672ffa4d5cd1 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:20.176229 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-c7df2a20-9011-4e63-be73-672ffa4d5cd1 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] [instance: 9ddb5908-22a9-41c8-909c-39cdf479bdd2] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:20.184293 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c7df2a20-9011-4e63-be73-672ffa4d5cd1 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:20.185766 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c7df2a20-9011-4e63-be73-672ffa4d5cd1 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:20.186494 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c7df2a20-9011-4e63-be73-672ffa4d5cd1 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:20.187562 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c7df2a20-9011-4e63-be73-672ffa4d5cd1 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:20.188297 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c7df2a20-9011-4e63-be73-672ffa4d5cd1 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:20.189141 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c7df2a20-9011-4e63-be73-672ffa4d5cd1 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:20.231593 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-7fa68c1a-d47b-4574-978f-966cb93e5f4e tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:20.232254 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-7fa68c1a-d47b-4574-978f-966cb93e5f4e tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: 8f7f80e3-c2f5-4719-a484-29d6bd0d9e91] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:20.251940 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7fa68c1a-d47b-4574-978f-966cb93e5f4e tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:20.254516 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7fa68c1a-d47b-4574-978f-966cb93e5f4e tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:20.270444 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7fa68c1a-d47b-4574-978f-966cb93e5f4e tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:20.272337 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7fa68c1a-d47b-4574-978f-966cb93e5f4e tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:20.276331 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7fa68c1a-d47b-4574-978f-966cb93e5f4e tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:20.278599 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7fa68c1a-d47b-4574-978f-966cb93e5f4e tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:20.286522 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.objects.instance [None req-c7df2a20-9011-4e63-be73-672ffa4d5cd1 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lazy-loading 'services' on Instance uuid 9ddb5908-22a9-41c8-909c-39cdf479bdd2 {{(pid=128758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:00:20.332353 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-c7df2a20-9011-4e63-be73-672ffa4d5cd1 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/9ddb5908-22a9-41c8-909c-39cdf479bdd2" status: 200 len: 1931 microversion: 2.75 time: 0.160211 Sep 14 09:00:20.335258 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1393/2716] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:00:20 2022] GET /compute/v2.1/servers/9ddb5908-22a9-41c8-909c-39cdf479bdd2 => generated 1931 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:00:20.577189 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-7fa68c1a-d47b-4574-978f-966cb93e5f4e tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9d40e54481461cba53fedb9a6abdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed2295a58f8451993a57ce0a6f9ba29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:20.590921 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-7fa68c1a-d47b-4574-978f-966cb93e5f4e tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7f80e3-c2f5-4719-a484-29d6bd0d9e91" status: 200 len: 1517 microversion: 2.1 time: 0.365082 Sep 14 09:00:20.606429 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1324/2717] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:00:20 2022] GET /compute/v2.1/servers/8f7f80e3-c2f5-4719-a484-29d6bd0d9e91 => generated 1517 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:00:21.367140 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-96eec2e4-2d8f-4386-8afb-9b9dfd9ce6a7 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:21.368575 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-96eec2e4-2d8f-4386-8afb-9b9dfd9ce6a7 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] [instance: 9ddb5908-22a9-41c8-909c-39cdf479bdd2] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:21.377725 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-96eec2e4-2d8f-4386-8afb-9b9dfd9ce6a7 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:21.378692 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-96eec2e4-2d8f-4386-8afb-9b9dfd9ce6a7 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:21.379545 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-96eec2e4-2d8f-4386-8afb-9b9dfd9ce6a7 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:21.380935 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-96eec2e4-2d8f-4386-8afb-9b9dfd9ce6a7 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:21.381591 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-96eec2e4-2d8f-4386-8afb-9b9dfd9ce6a7 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:21.382215 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-96eec2e4-2d8f-4386-8afb-9b9dfd9ce6a7 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:21.532278 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.objects.instance [None req-96eec2e4-2d8f-4386-8afb-9b9dfd9ce6a7 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lazy-loading 'services' on Instance uuid 9ddb5908-22a9-41c8-909c-39cdf479bdd2 {{(pid=128758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:00:21.551489 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-96eec2e4-2d8f-4386-8afb-9b9dfd9ce6a7 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/9ddb5908-22a9-41c8-909c-39cdf479bdd2" status: 200 len: 1931 microversion: 2.75 time: 0.189774 Sep 14 09:00:21.552602 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1394/2718] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:00:21 2022] GET /compute/v2.1/servers/9ddb5908-22a9-41c8-909c-39cdf479bdd2 => generated 1931 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:00:21.617803 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-110b9fa3-413d-4eb2-a65d-e18285f738c4 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:21.619378 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-110b9fa3-413d-4eb2-a65d-e18285f738c4 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: 8f7f80e3-c2f5-4719-a484-29d6bd0d9e91] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:21.627260 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-110b9fa3-413d-4eb2-a65d-e18285f738c4 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:21.627781 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-110b9fa3-413d-4eb2-a65d-e18285f738c4 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:21.628216 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-110b9fa3-413d-4eb2-a65d-e18285f738c4 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:21.628924 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-110b9fa3-413d-4eb2-a65d-e18285f738c4 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:21.629377 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-110b9fa3-413d-4eb2-a65d-e18285f738c4 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:21.629802 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-110b9fa3-413d-4eb2-a65d-e18285f738c4 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:21.869469 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-110b9fa3-413d-4eb2-a65d-e18285f738c4 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9d40e54481461cba53fedb9a6abdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed2295a58f8451993a57ce0a6f9ba29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:21.877837 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-110b9fa3-413d-4eb2-a65d-e18285f738c4 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7f80e3-c2f5-4719-a484-29d6bd0d9e91" status: 200 len: 1517 microversion: 2.1 time: 0.263994 Sep 14 09:00:21.878896 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1325/2719] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:00:21 2022] GET /compute/v2.1/servers/8f7f80e3-c2f5-4719-a484-29d6bd0d9e91 => generated 1517 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:00:22.582546 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ff89c6d9-7df6-409f-88a7-9db0c26b6ada tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:22.583816 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-ff89c6d9-7df6-409f-88a7-9db0c26b6ada tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] [instance: 9ddb5908-22a9-41c8-909c-39cdf479bdd2] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:22.595301 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ff89c6d9-7df6-409f-88a7-9db0c26b6ada tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:22.595875 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ff89c6d9-7df6-409f-88a7-9db0c26b6ada tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:22.596402 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ff89c6d9-7df6-409f-88a7-9db0c26b6ada tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:22.597208 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ff89c6d9-7df6-409f-88a7-9db0c26b6ada tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:22.597735 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ff89c6d9-7df6-409f-88a7-9db0c26b6ada tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:22.598257 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ff89c6d9-7df6-409f-88a7-9db0c26b6ada tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:22.675292 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.objects.instance [None req-ff89c6d9-7df6-409f-88a7-9db0c26b6ada tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lazy-loading 'services' on Instance uuid 9ddb5908-22a9-41c8-909c-39cdf479bdd2 {{(pid=128758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:00:22.693591 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-ff89c6d9-7df6-409f-88a7-9db0c26b6ada tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/9ddb5908-22a9-41c8-909c-39cdf479bdd2" status: 200 len: 1931 microversion: 2.75 time: 0.116794 Sep 14 09:00:22.694185 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1395/2720] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:00:22 2022] GET /compute/v2.1/servers/9ddb5908-22a9-41c8-909c-39cdf479bdd2 => generated 1931 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:00:22.901891 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e5ffbb33-1d9b-4655-b866-26cad557ba57 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:22.902598 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e5ffbb33-1d9b-4655-b866-26cad557ba57 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: 8f7f80e3-c2f5-4719-a484-29d6bd0d9e91] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:22.910756 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e5ffbb33-1d9b-4655-b866-26cad557ba57 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:22.911517 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e5ffbb33-1d9b-4655-b866-26cad557ba57 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:22.911959 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e5ffbb33-1d9b-4655-b866-26cad557ba57 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:22.912884 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e5ffbb33-1d9b-4655-b866-26cad557ba57 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:22.913346 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e5ffbb33-1d9b-4655-b866-26cad557ba57 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:22.913775 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e5ffbb33-1d9b-4655-b866-26cad557ba57 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:23.099950 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-e5ffbb33-1d9b-4655-b866-26cad557ba57 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9d40e54481461cba53fedb9a6abdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed2295a58f8451993a57ce0a6f9ba29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:23.110142 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e5ffbb33-1d9b-4655-b866-26cad557ba57 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7f80e3-c2f5-4719-a484-29d6bd0d9e91" status: 200 len: 1517 microversion: 2.1 time: 0.211972 Sep 14 09:00:23.111443 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1326/2721] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:00:22 2022] GET /compute/v2.1/servers/8f7f80e3-c2f5-4719-a484-29d6bd0d9e91 => generated 1517 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:00:23.147903 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-9c82525a-6c30-42b1-92e2-85356c05668d tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Calling method '.version_select at 0x7f7d44074700>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:23.192858 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-9c82525a-6c30-42b1-92e2-85356c05668d tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] 10.222.0.60 "GET /compute/v2.1/images/73b52f25-c3a1-4c69-9e8a-b2f01d0e6a08" status: 200 len: 662 microversion: 2.1 time: 0.048715 Sep 14 09:00:23.193435 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1396/2722] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:00:23 2022] GET /compute/v2.1/images/73b52f25-c3a1-4c69-9e8a-b2f01d0e6a08 => generated 662 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:00:23.210927 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8b679150-33c9-4c6d-9ef4-fee538dd49fa tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Calling method '.version_select at 0x7f7d487561f0>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:23.250928 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-8b679150-33c9-4c6d-9ef4-fee538dd49fa tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] 10.222.0.60 "GET /compute/v2.1/images/73b52f25-c3a1-4c69-9e8a-b2f01d0e6a08" status: 200 len: 662 microversion: 2.1 time: 0.046993 Sep 14 09:00:23.251646 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1327/2723] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:00:23 2022] GET /compute/v2.1/images/73b52f25-c3a1-4c69-9e8a-b2f01d0e6a08 => generated 662 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:00:23.332341 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b65b32d9-8f2d-449e-b1ea-ffb55076baff tempest-QuotasTestJSON-2140522196 tempest-QuotasTestJSON-2140522196-project] Calling method '.version_select at 0x7f7d48629820>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:23.385901 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-b65b32d9-8f2d-449e-b1ea-ffb55076baff tempest-QuotasTestJSON-2140522196 tempest-QuotasTestJSON-2140522196-project] 10.222.0.60 "GET /compute/v2.1/os-quota-sets/6d9face250d34f2f8be36f42cb7aae8b/defaults" status: 200 len: 371 microversion: 2.1 time: 0.171255 Sep 14 09:00:23.386486 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1397/2724] 10.222.0.60 () {58 vars in 1269 bytes} [Wed Sep 14 09:00:23 2022] GET /compute/v2.1/os-quota-sets/6d9face250d34f2f8be36f42cb7aae8b/defaults => generated 371 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:00:23.399897 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3ad49959-eeed-4066-8f2a-9a6ac7ce3350 tempest-QuotasTestJSON-2140522196 tempest-QuotasTestJSON-2140522196-project] Calling method '.version_select at 0x7f7d486e8670>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:23.445219 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ff16065e-5820-4e3c-9d4f-044034dac705 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:23.445730 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-ff16065e-5820-4e3c-9d4f-044034dac705 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: ef2a3ebb-090f-484c-9749-42c000375ec5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:23.451727 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ff16065e-5820-4e3c-9d4f-044034dac705 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:23.452214 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ff16065e-5820-4e3c-9d4f-044034dac705 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:23.452647 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ff16065e-5820-4e3c-9d4f-044034dac705 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:23.453336 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ff16065e-5820-4e3c-9d4f-044034dac705 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:23.453791 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ff16065e-5820-4e3c-9d4f-044034dac705 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:23.454210 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ff16065e-5820-4e3c-9d4f-044034dac705 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:23.480015 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-ff16065e-5820-4e3c-9d4f-044034dac705 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: ef2a3ebb-090f-484c-9749-42c000375ec5] Going to try to terminate instance {{(pid=128758) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:00:23.483869 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-3ad49959-eeed-4066-8f2a-9a6ac7ce3350 tempest-QuotasTestJSON-2140522196 tempest-QuotasTestJSON-2140522196-project] 10.222.0.60 "GET /compute/v2.1/os-quota-sets/6d9face250d34f2f8be36f42cb7aae8b" status: 200 len: 371 microversion: 2.1 time: 0.088612 Sep 14 09:00:23.484454 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1328/2725] 10.222.0.60 () {58 vars in 1242 bytes} [Wed Sep 14 09:00:23 2022] GET /compute/v2.1/os-quota-sets/6d9face250d34f2f8be36f42cb7aae8b => generated 371 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:00:23.499140 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-baff88d1-130b-4885-8098-b70634c1c117 tempest-QuotasTestJSON-2140522196 tempest-QuotasTestJSON-2140522196-project] Calling method '.version_select at 0x7f7d486e8a60>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:23.555515 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-baff88d1-130b-4885-8098-b70634c1c117 tempest-QuotasTestJSON-2140522196 tempest-QuotasTestJSON-2140522196-project] 10.222.0.60 "GET /compute/v2.1/os-quota-sets/6d9face250d34f2f8be36f42cb7aae8b/defaults" status: 200 len: 371 microversion: 2.1 time: 0.060040 Sep 14 09:00:23.556697 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1329/2726] 10.222.0.60 () {58 vars in 1269 bytes} [Wed Sep 14 09:00:23 2022] GET /compute/v2.1/os-quota-sets/6d9face250d34f2f8be36f42cb7aae8b/defaults => generated 371 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:00:23.570458 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-16976920-bdfb-4f3e-8fd7-9968bc120147 tempest-QuotasTestJSON-2140522196 tempest-QuotasTestJSON-2140522196-project] Calling method '.version_select at 0x7f7d48756820>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:23.573514 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-ff16065e-5820-4e3c-9d4f-044034dac705 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "DELETE /compute/v2.1/servers/ef2a3ebb-090f-484c-9749-42c000375ec5" status: 204 len: 0 microversion: 2.1 time: 0.132309 Sep 14 09:00:23.577703 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1398/2727] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:00:23 2022] DELETE /compute/v2.1/servers/ef2a3ebb-090f-484c-9749-42c000375ec5 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:00:23.583137 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-3d7405b9-a6b9-4fea-b414-55f5375c1f07 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:23.583845 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-3d7405b9-a6b9-4fea-b414-55f5375c1f07 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: ef2a3ebb-090f-484c-9749-42c000375ec5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:23.591021 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3d7405b9-a6b9-4fea-b414-55f5375c1f07 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:23.592109 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3d7405b9-a6b9-4fea-b414-55f5375c1f07 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:23.592548 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3d7405b9-a6b9-4fea-b414-55f5375c1f07 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:23.593250 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3d7405b9-a6b9-4fea-b414-55f5375c1f07 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:23.593702 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3d7405b9-a6b9-4fea-b414-55f5375c1f07 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:23.594123 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3d7405b9-a6b9-4fea-b414-55f5375c1f07 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:23.636950 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-16976920-bdfb-4f3e-8fd7-9968bc120147 tempest-QuotasTestJSON-2140522196 tempest-QuotasTestJSON-2140522196-project] 10.222.0.60 "GET /compute/v2.1/os-quota-sets/6d9face250d34f2f8be36f42cb7aae8b" status: 200 len: 371 microversion: 2.1 time: 0.070311 Sep 14 09:00:23.637550 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1330/2728] 10.222.0.60 () {58 vars in 1242 bytes} [Wed Sep 14 09:00:23 2022] GET /compute/v2.1/os-quota-sets/6d9face250d34f2f8be36f42cb7aae8b => generated 371 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:00:23.650079 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-7c8599bb-a700-437c-91ba-51093bec0ee1 tempest-QuotasTestJSON-2140522196 tempest-QuotasTestJSON-2140522196-project] Calling method '.version_select at 0x7f7d486cf280>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:23.722333 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-7c8599bb-a700-437c-91ba-51093bec0ee1 tempest-QuotasTestJSON-2140522196 tempest-QuotasTestJSON-2140522196-project] 10.222.0.60 "GET /compute/v2.1/os-quota-sets/6d9face250d34f2f8be36f42cb7aae8b?user_id=eeeeec6393a04fcca1c26da18879bad5" status: 200 len: 371 microversion: 2.1 time: 0.076018 Sep 14 09:00:23.722920 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1331/2729] 10.222.0.60 () {58 vars in 1323 bytes} [Wed Sep 14 09:00:23 2022] GET /compute/v2.1/os-quota-sets/6d9face250d34f2f8be36f42cb7aae8b?user_id=eeeeec6393a04fcca1c26da18879bad5 => generated 371 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:00:23.727409 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e6fb6181-4574-4043-932c-c7ea67b1c3a4 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:23.728023 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e6fb6181-4574-4043-932c-c7ea67b1c3a4 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] [instance: 9ddb5908-22a9-41c8-909c-39cdf479bdd2] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:23.731821 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-3d7405b9-a6b9-4fea-b414-55f5375c1f07 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:23.734269 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e6fb6181-4574-4043-932c-c7ea67b1c3a4 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:23.734758 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e6fb6181-4574-4043-932c-c7ea67b1c3a4 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:23.735459 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e6fb6181-4574-4043-932c-c7ea67b1c3a4 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:23.735688 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:00:23.737055 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e6fb6181-4574-4043-932c-c7ea67b1c3a4 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:23.737752 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e6fb6181-4574-4043-932c-c7ea67b1c3a4 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:23.738190 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e6fb6181-4574-4043-932c-c7ea67b1c3a4 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:23.741431 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-3d7405b9-a6b9-4fea-b414-55f5375c1f07 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/ef2a3ebb-090f-484c-9749-42c000375ec5" status: 200 len: 1554 microversion: 2.1 time: 0.162286 Sep 14 09:00:23.742226 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1399/2730] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:00:23 2022] GET /compute/v2.1/servers/ef2a3ebb-090f-484c-9749-42c000375ec5 => generated 1554 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:00:23.855973 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.objects.instance [None req-e6fb6181-4574-4043-932c-c7ea67b1c3a4 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lazy-loading 'services' on Instance uuid 9ddb5908-22a9-41c8-909c-39cdf479bdd2 {{(pid=128759) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:00:23.873738 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e6fb6181-4574-4043-932c-c7ea67b1c3a4 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/9ddb5908-22a9-41c8-909c-39cdf479bdd2" status: 200 len: 1931 microversion: 2.75 time: 0.149773 Sep 14 09:00:23.874364 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1332/2731] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:00:23 2022] GET /compute/v2.1/servers/9ddb5908-22a9-41c8-909c-39cdf479bdd2 => generated 1931 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:00:24.136481 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-06ff24f3-7471-4c5e-878e-9013f4303065 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:24.137104 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-06ff24f3-7471-4c5e-878e-9013f4303065 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: 8f7f80e3-c2f5-4719-a484-29d6bd0d9e91] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:24.144307 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-06ff24f3-7471-4c5e-878e-9013f4303065 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:24.144803 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-06ff24f3-7471-4c5e-878e-9013f4303065 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:24.145262 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-06ff24f3-7471-4c5e-878e-9013f4303065 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:24.145928 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-06ff24f3-7471-4c5e-878e-9013f4303065 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:24.146379 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-06ff24f3-7471-4c5e-878e-9013f4303065 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:24.146805 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-06ff24f3-7471-4c5e-878e-9013f4303065 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:24.286550 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-06ff24f3-7471-4c5e-878e-9013f4303065 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9d40e54481461cba53fedb9a6abdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed2295a58f8451993a57ce0a6f9ba29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:24.295291 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-06ff24f3-7471-4c5e-878e-9013f4303065 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7f80e3-c2f5-4719-a484-29d6bd0d9e91" status: 200 len: 1517 microversion: 2.1 time: 0.163184 Sep 14 09:00:24.295901 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1400/2732] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:00:24 2022] GET /compute/v2.1/servers/8f7f80e3-c2f5-4719-a484-29d6bd0d9e91 => generated 1517 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:00:24.726244 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-489901f2-0465-43f7-a3a8-facd89a3547e tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Calling method '.version_select at 0x7f7d4867e5e0>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:24.769428 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1241b370-b7af-4980-a7a7-08de3c5f4898 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:24.769428 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-1241b370-b7af-4980-a7a7-08de3c5f4898 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: ef2a3ebb-090f-484c-9749-42c000375ec5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:24.770400 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-489901f2-0465-43f7-a3a8-facd89a3547e tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] 10.222.0.60 "GET /compute/v2.1/images/41130ed6-7ebf-4a39-94eb-9c84307264df" status: 200 len: 661 microversion: 2.1 time: 0.047924 Sep 14 09:00:24.771005 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1333/2733] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:00:24 2022] GET /compute/v2.1/images/41130ed6-7ebf-4a39-94eb-9c84307264df => generated 661 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:00:24.774665 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1241b370-b7af-4980-a7a7-08de3c5f4898 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:24.775243 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1241b370-b7af-4980-a7a7-08de3c5f4898 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:24.775938 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1241b370-b7af-4980-a7a7-08de3c5f4898 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:24.776689 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1241b370-b7af-4980-a7a7-08de3c5f4898 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:24.777335 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1241b370-b7af-4980-a7a7-08de3c5f4898 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:24.777822 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1241b370-b7af-4980-a7a7-08de3c5f4898 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:24.785168 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-7f7a0309-4c18-4f5f-8cca-248791236dd6 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Calling method '.version_select at 0x7f7d487599d0>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:24.831021 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-7f7a0309-4c18-4f5f-8cca-248791236dd6 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] 10.222.0.60 "GET /compute/v2.1/images/41130ed6-7ebf-4a39-94eb-9c84307264df" status: 200 len: 661 microversion: 2.1 time: 0.049476 Sep 14 09:00:24.832147 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1334/2734] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:00:24 2022] GET /compute/v2.1/images/41130ed6-7ebf-4a39-94eb-9c84307264df => generated 661 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:00:24.906275 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-6d558d88-f114-4e35-b1a7-aa5de5240c6f tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:24.906899 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-6d558d88-f114-4e35-b1a7-aa5de5240c6f tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] [instance: 9ddb5908-22a9-41c8-909c-39cdf479bdd2] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:24.917649 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6d558d88-f114-4e35-b1a7-aa5de5240c6f tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:24.918152 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6d558d88-f114-4e35-b1a7-aa5de5240c6f tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:24.918586 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6d558d88-f114-4e35-b1a7-aa5de5240c6f tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:24.919912 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6d558d88-f114-4e35-b1a7-aa5de5240c6f tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:24.920713 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6d558d88-f114-4e35-b1a7-aa5de5240c6f tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:24.920816 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6d558d88-f114-4e35-b1a7-aa5de5240c6f tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:24.942179 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-1241b370-b7af-4980-a7a7-08de3c5f4898 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:24.951038 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-1241b370-b7af-4980-a7a7-08de3c5f4898 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/ef2a3ebb-090f-484c-9749-42c000375ec5" status: 200 len: 1554 microversion: 2.1 time: 0.189522 Sep 14 09:00:24.952111 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1401/2735] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:00:24 2022] GET /compute/v2.1/servers/ef2a3ebb-090f-484c-9749-42c000375ec5 => generated 1554 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:00:25.016072 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.objects.instance [None req-6d558d88-f114-4e35-b1a7-aa5de5240c6f tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lazy-loading 'services' on Instance uuid 9ddb5908-22a9-41c8-909c-39cdf479bdd2 {{(pid=128759) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:00:25.034737 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-6d558d88-f114-4e35-b1a7-aa5de5240c6f tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/9ddb5908-22a9-41c8-909c-39cdf479bdd2" status: 200 len: 1931 microversion: 2.75 time: 0.134409 Sep 14 09:00:25.035458 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1335/2736] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:00:24 2022] GET /compute/v2.1/servers/9ddb5908-22a9-41c8-909c-39cdf479bdd2 => generated 1931 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 09:00:25.318775 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-df60c334-e818-4dd2-85cf-2df6d092d4a4 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:25.319567 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-df60c334-e818-4dd2-85cf-2df6d092d4a4 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: 8f7f80e3-c2f5-4719-a484-29d6bd0d9e91] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:25.326503 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-df60c334-e818-4dd2-85cf-2df6d092d4a4 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:25.327279 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-df60c334-e818-4dd2-85cf-2df6d092d4a4 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:25.327895 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-df60c334-e818-4dd2-85cf-2df6d092d4a4 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:25.328768 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-df60c334-e818-4dd2-85cf-2df6d092d4a4 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:25.329389 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-df60c334-e818-4dd2-85cf-2df6d092d4a4 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:25.329979 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-df60c334-e818-4dd2-85cf-2df6d092d4a4 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:25.480994 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-df60c334-e818-4dd2-85cf-2df6d092d4a4 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9d40e54481461cba53fedb9a6abdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed2295a58f8451993a57ce0a6f9ba29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:25.490821 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-df60c334-e818-4dd2-85cf-2df6d092d4a4 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7f80e3-c2f5-4719-a484-29d6bd0d9e91" status: 200 len: 1517 microversion: 2.1 time: 0.175887 Sep 14 09:00:25.490821 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1402/2737] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:00:25 2022] GET /compute/v2.1/servers/8f7f80e3-c2f5-4719-a484-29d6bd0d9e91 => generated 1517 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:00:25.977251 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f06c9ad8-256f-471c-bd81-70ac55bd781f tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:25.977971 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f06c9ad8-256f-471c-bd81-70ac55bd781f tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: ef2a3ebb-090f-484c-9749-42c000375ec5] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:25.987101 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f06c9ad8-256f-471c-bd81-70ac55bd781f tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:25.987597 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f06c9ad8-256f-471c-bd81-70ac55bd781f tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:25.988167 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f06c9ad8-256f-471c-bd81-70ac55bd781f tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:25.989319 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f06c9ad8-256f-471c-bd81-70ac55bd781f tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:25.989816 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f06c9ad8-256f-471c-bd81-70ac55bd781f tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:25.990244 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f06c9ad8-256f-471c-bd81-70ac55bd781f tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:26.065351 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ca7a493b-9fc7-465b-ae74-c23686f69419 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:26.065978 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-ca7a493b-9fc7-465b-ae74-c23686f69419 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] [instance: 9ddb5908-22a9-41c8-909c-39cdf479bdd2] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:26.079300 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ca7a493b-9fc7-465b-ae74-c23686f69419 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:26.079958 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ca7a493b-9fc7-465b-ae74-c23686f69419 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:26.080673 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ca7a493b-9fc7-465b-ae74-c23686f69419 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:26.081474 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ca7a493b-9fc7-465b-ae74-c23686f69419 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:26.082171 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ca7a493b-9fc7-465b-ae74-c23686f69419 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:26.082997 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ca7a493b-9fc7-465b-ae74-c23686f69419 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:26.140150 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f06c9ad8-256f-471c-bd81-70ac55bd781f tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:26.149925 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f06c9ad8-256f-471c-bd81-70ac55bd781f tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/ef2a3ebb-090f-484c-9749-42c000375ec5" status: 200 len: 1554 microversion: 2.1 time: 0.177545 Sep 14 09:00:26.150800 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1336/2738] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:00:25 2022] GET /compute/v2.1/servers/ef2a3ebb-090f-484c-9749-42c000375ec5 => generated 1554 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:00:26.180542 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.objects.instance [None req-ca7a493b-9fc7-465b-ae74-c23686f69419 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lazy-loading 'services' on Instance uuid 9ddb5908-22a9-41c8-909c-39cdf479bdd2 {{(pid=128758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:00:26.198307 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-ca7a493b-9fc7-465b-ae74-c23686f69419 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/9ddb5908-22a9-41c8-909c-39cdf479bdd2" status: 200 len: 1931 microversion: 2.75 time: 0.139752 Sep 14 09:00:26.198903 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1403/2739] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:00:26 2022] GET /compute/v2.1/servers/9ddb5908-22a9-41c8-909c-39cdf479bdd2 => generated 1931 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 09:00:26.374400 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-95ed5d46-e118-4bc8-a811-6cd927a6d45f tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Calling method '.version_select at 0x7f7d4867e310>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:26.421746 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-95ed5d46-e118-4bc8-a811-6cd927a6d45f tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] 10.222.0.60 "GET /compute/v2.1/images/e3fe84fd-00f6-4d37-bc1c-acfdba8b814d" status: 200 len: 662 microversion: 2.1 time: 0.051156 Sep 14 09:00:26.429616 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1337/2740] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:00:26 2022] GET /compute/v2.1/images/e3fe84fd-00f6-4d37-bc1c-acfdba8b814d => generated 662 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:00:26.437171 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-097b2b76-efec-4ada-8835-c4ae160c24a1 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Calling method '.version_select at 0x7f7d44308a60>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:26.493511 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-097b2b76-efec-4ada-8835-c4ae160c24a1 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] 10.222.0.60 "GET /compute/v2.1/images/e3fe84fd-00f6-4d37-bc1c-acfdba8b814d" status: 200 len: 662 microversion: 2.1 time: 0.061219 Sep 14 09:00:26.494268 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1404/2741] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:00:26 2022] GET /compute/v2.1/images/e3fe84fd-00f6-4d37-bc1c-acfdba8b814d => generated 662 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:00:26.515170 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b51bc646-a1fe-4f76-b70f-c3747213daa5 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:26.516035 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b51bc646-a1fe-4f76-b70f-c3747213daa5 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: 8f7f80e3-c2f5-4719-a484-29d6bd0d9e91] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:26.524129 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b51bc646-a1fe-4f76-b70f-c3747213daa5 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:26.524744 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b51bc646-a1fe-4f76-b70f-c3747213daa5 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:26.525275 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b51bc646-a1fe-4f76-b70f-c3747213daa5 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:26.527991 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b51bc646-a1fe-4f76-b70f-c3747213daa5 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:26.528487 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b51bc646-a1fe-4f76-b70f-c3747213daa5 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:26.529494 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b51bc646-a1fe-4f76-b70f-c3747213daa5 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:26.636532 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-5b0cec0e-1dd7-4fab-b000-31ccf2dd398b tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-541160733", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:00:26.698525 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.network.neutron [None req-5b0cec0e-1dd7-4fab-b000-31ccf2dd398b tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] validate_networks() for None {{(pid=128758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:00:26.755019 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b51bc646-a1fe-4f76-b70f-c3747213daa5 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9d40e54481461cba53fedb9a6abdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed2295a58f8451993a57ce0a6f9ba29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:26.766218 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b51bc646-a1fe-4f76-b70f-c3747213daa5 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7f80e3-c2f5-4719-a484-29d6bd0d9e91" status: 200 len: 1517 microversion: 2.1 time: 0.256459 Sep 14 09:00:26.767171 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1338/2742] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:00:26 2022] GET /compute/v2.1/servers/8f7f80e3-c2f5-4719-a484-29d6bd0d9e91 => generated 1517 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:00:26.851699 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-73d11b7c-0a60-4e78-9163-7847e97a19e7 tempest-VolumesTestJSON-170942237 tempest-VolumesTestJSON-170942237-project] Calling method '.version_select at 0x7f7d486cf3a0>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:26.922752 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-73d11b7c-0a60-4e78-9163-7847e97a19e7 tempest-VolumesTestJSON-170942237 tempest-VolumesTestJSON-170942237-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/9747d11a-c372-40d7-bde4-7ab886c2dbf7" status: 200 len: 350 microversion: 2.1 time: 0.074799 Sep 14 09:00:26.927317 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1339/2743] 10.222.0.60 () {58 vars in 1245 bytes} [Wed Sep 14 09:00:26 2022] GET /compute/v2.1/os-volumes/9747d11a-c372-40d7-bde4-7ab886c2dbf7 => generated 350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:00:27.042086 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-03eede62-3838-46c4-a74c-249764fa58b0 req-89961f77-adc6-49be-bd50-e5c15868355e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef2a3ebb-090f-484c-9749-42c000375ec5", "name": "network-vif-deleted", "tag": "5d972936-9553-4b99-bc8e-60cb4949e7d2"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:00:27.085183 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-03eede62-3838-46c4-a74c-249764fa58b0 req-89961f77-adc6-49be-bd50-e5c15868355e service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:27.091754 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-03eede62-3838-46c4-a74c-249764fa58b0 req-89961f77-adc6-49be-bd50-e5c15868355e service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:27.092557 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-03eede62-3838-46c4-a74c-249764fa58b0 req-89961f77-adc6-49be-bd50-e5c15868355e service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:27.098590 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-5b0cec0e-1dd7-4fab-b000-31ccf2dd398b tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Flavor limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:00:27.099105 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-5b0cec0e-1dd7-4fab-b000-31ccf2dd398b tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Image limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:00:27.099626 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-5b0cec0e-1dd7-4fab-b000-31ccf2dd398b tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Flavor pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:00:27.100060 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-5b0cec0e-1dd7-4fab-b000-31ccf2dd398b tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Image pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:00:27.100654 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-5b0cec0e-1dd7-4fab-b000-31ccf2dd398b tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:00:27.111204 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5b0cec0e-1dd7-4fab-b000-31ccf2dd398b tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:27.111566 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-03eede62-3838-46c4-a74c-249764fa58b0 req-89961f77-adc6-49be-bd50-e5c15868355e service nova] Creating event network-vif-deleted:5d972936-9553-4b99-bc8e-60cb4949e7d2 for instance ef2a3ebb-090f-484c-9749-42c000375ec5 on n-h1-836830-18 Sep 14 09:00:27.111719 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5b0cec0e-1dd7-4fab-b000-31ccf2dd398b tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:27.112146 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5b0cec0e-1dd7-4fab-b000-31ccf2dd398b tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:27.112862 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5b0cec0e-1dd7-4fab-b000-31ccf2dd398b tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:27.113486 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5b0cec0e-1dd7-4fab-b000-31ccf2dd398b tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:27.114214 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5b0cec0e-1dd7-4fab-b000-31ccf2dd398b tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:27.117763 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-03eede62-3838-46c4-a74c-249764fa58b0 req-89961f77-adc6-49be-bd50-e5c15868355e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080909 Sep 14 09:00:27.118508 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1340/2744] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:00:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:00:27.137117 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-5b0cec0e-1dd7-4fab-b000-31ccf2dd398b tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Getting quotas for project 63c6f0c84e964383af6a4025d80fc93d. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:00:27.144518 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-5b0cec0e-1dd7-4fab-b000-31ccf2dd398b tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Getting quotas for user a475c6e2b35f494aa8380aa1783e1779 and project 63c6f0c84e964383af6a4025d80fc93d. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:00:27.165917 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-5b0cec0e-1dd7-4fab-b000-31ccf2dd398b tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Going to run 1 instances... {{(pid=128758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:00:27.175591 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ce2c6d57-a290-45de-9dad-a4452775e8aa tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:27.176887 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-ce2c6d57-a290-45de-9dad-a4452775e8aa tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: ef2a3ebb-090f-484c-9749-42c000375ec5] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:27.179625 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-5b0cec0e-1dd7-4fab-b000-31ccf2dd398b tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] [instance: ebf9bfa9-e941-4d23-8f6c-9867102feff2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:00:27.188801 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ce2c6d57-a290-45de-9dad-a4452775e8aa tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:27.189296 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ce2c6d57-a290-45de-9dad-a4452775e8aa tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:27.189741 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ce2c6d57-a290-45de-9dad-a4452775e8aa tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:27.190452 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ce2c6d57-a290-45de-9dad-a4452775e8aa tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:27.190910 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ce2c6d57-a290-45de-9dad-a4452775e8aa tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:27.191369 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ce2c6d57-a290-45de-9dad-a4452775e8aa tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:27.287259 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-5b0cec0e-1dd7-4fab-b000-31ccf2dd398b tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.656030 Sep 14 09:00:27.287924 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1405/2745] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 09:00:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 658 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:00:27.293765 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-39566470-7095-4a3c-85b7-ca0fc07b5c2f tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:27.295249 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-39566470-7095-4a3c-85b7-ca0fc07b5c2f tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] [instance: 9ddb5908-22a9-41c8-909c-39cdf479bdd2] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:27.304094 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-39566470-7095-4a3c-85b7-ca0fc07b5c2f tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:27.304838 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-39566470-7095-4a3c-85b7-ca0fc07b5c2f tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:27.306218 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-39566470-7095-4a3c-85b7-ca0fc07b5c2f tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:27.307150 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-39566470-7095-4a3c-85b7-ca0fc07b5c2f tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:27.307828 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-39566470-7095-4a3c-85b7-ca0fc07b5c2f tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:27.309086 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-39566470-7095-4a3c-85b7-ca0fc07b5c2f tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:27.336075 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-ce2c6d57-a290-45de-9dad-a4452775e8aa tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:27.360873 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-ce2c6d57-a290-45de-9dad-a4452775e8aa tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/ef2a3ebb-090f-484c-9749-42c000375ec5" status: 200 len: 1346 microversion: 2.1 time: 0.190582 Sep 14 09:00:27.366047 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1341/2746] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:00:27 2022] GET /compute/v2.1/servers/ef2a3ebb-090f-484c-9749-42c000375ec5 => generated 1346 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:00:27.412788 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d12b8c95-08f2-4999-af0d-03c6302d569c tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1455825118", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:00:27.491917 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.objects.instance [None req-39566470-7095-4a3c-85b7-ca0fc07b5c2f tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lazy-loading 'services' on Instance uuid 9ddb5908-22a9-41c8-909c-39cdf479bdd2 {{(pid=128758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:00:27.508335 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.network.neutron [None req-d12b8c95-08f2-4999-af0d-03c6302d569c tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] validate_networks() for None {{(pid=128759) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:00:27.542799 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-39566470-7095-4a3c-85b7-ca0fc07b5c2f tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/9ddb5908-22a9-41c8-909c-39cdf479bdd2" status: 200 len: 1931 microversion: 2.75 time: 0.252892 Sep 14 09:00:27.543684 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1406/2747] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:00:27 2022] GET /compute/v2.1/servers/9ddb5908-22a9-41c8-909c-39cdf479bdd2 => generated 1931 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:00:27.790477 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-8546303c-4fbc-468f-b80e-a402001e09da tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:27.791362 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-8546303c-4fbc-468f-b80e-a402001e09da tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: 8f7f80e3-c2f5-4719-a484-29d6bd0d9e91] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:27.802511 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8546303c-4fbc-468f-b80e-a402001e09da tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:27.805197 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8546303c-4fbc-468f-b80e-a402001e09da tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:27.805671 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8546303c-4fbc-468f-b80e-a402001e09da tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:27.806417 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8546303c-4fbc-468f-b80e-a402001e09da tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:27.809198 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8546303c-4fbc-468f-b80e-a402001e09da tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:27.809689 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8546303c-4fbc-468f-b80e-a402001e09da tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:28.254045 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-d12b8c95-08f2-4999-af0d-03c6302d569c tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Flavor limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:00:28.254613 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-d12b8c95-08f2-4999-af0d-03c6302d569c tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Image limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:00:28.254987 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-d12b8c95-08f2-4999-af0d-03c6302d569c tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Flavor pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:00:28.255392 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-d12b8c95-08f2-4999-af0d-03c6302d569c tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Image pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:00:28.256001 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-d12b8c95-08f2-4999-af0d-03c6302d569c tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:00:28.276248 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d12b8c95-08f2-4999-af0d-03c6302d569c tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:28.276751 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d12b8c95-08f2-4999-af0d-03c6302d569c tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:28.277201 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d12b8c95-08f2-4999-af0d-03c6302d569c tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:28.281804 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d12b8c95-08f2-4999-af0d-03c6302d569c tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:28.286217 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d12b8c95-08f2-4999-af0d-03c6302d569c tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:28.287058 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d12b8c95-08f2-4999-af0d-03c6302d569c tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:28.343408 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-d12b8c95-08f2-4999-af0d-03c6302d569c tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Getting quotas for project 63c6f0c84e964383af6a4025d80fc93d. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:00:28.354732 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-d12b8c95-08f2-4999-af0d-03c6302d569c tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Getting quotas for user a475c6e2b35f494aa8380aa1783e1779 and project 63c6f0c84e964383af6a4025d80fc93d. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:00:28.395057 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-d12b8c95-08f2-4999-af0d-03c6302d569c tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Going to run 1 instances... {{(pid=128759) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:00:28.399090 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-8546303c-4fbc-468f-b80e-a402001e09da tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9d40e54481461cba53fedb9a6abdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed2295a58f8451993a57ce0a6f9ba29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:28.405531 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-d12b8c95-08f2-4999-af0d-03c6302d569c tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] [instance: a4852a58-51c4-4ca0-8c83-19fc8209fd21] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128759) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:00:28.412400 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-8546303c-4fbc-468f-b80e-a402001e09da tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7f80e3-c2f5-4719-a484-29d6bd0d9e91" status: 200 len: 1517 microversion: 2.1 time: 0.625356 Sep 14 09:00:28.423039 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1407/2748] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:00:27 2022] GET /compute/v2.1/servers/8f7f80e3-c2f5-4719-a484-29d6bd0d9e91 => generated 1517 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:00:28.423039 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-930da55e-0a9d-45d2-ac06-f266df0ba2f1 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:28.423039 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-930da55e-0a9d-45d2-ac06-f266df0ba2f1 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: ef2a3ebb-090f-484c-9749-42c000375ec5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:28.433467 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-930da55e-0a9d-45d2-ac06-f266df0ba2f1 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:28.433971 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-930da55e-0a9d-45d2-ac06-f266df0ba2f1 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:28.434417 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-930da55e-0a9d-45d2-ac06-f266df0ba2f1 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:28.436009 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-930da55e-0a9d-45d2-ac06-f266df0ba2f1 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:28.436659 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-930da55e-0a9d-45d2-ac06-f266df0ba2f1 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:28.437471 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-930da55e-0a9d-45d2-ac06-f266df0ba2f1 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:28.490384 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d12b8c95-08f2-4999-af0d-03c6302d569c tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.083230 Sep 14 09:00:28.501740 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1342/2749] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 09:00:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1095 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:00:28.519168 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-407ef2e9-4b05-4365-b610-3984f87dcc16 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:28.519862 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-407ef2e9-4b05-4365-b610-3984f87dcc16 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] [instance: a4852a58-51c4-4ca0-8c83-19fc8209fd21] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:28.566702 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-930da55e-0a9d-45d2-ac06-f266df0ba2f1 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:28.589238 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-930da55e-0a9d-45d2-ac06-f266df0ba2f1 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/ef2a3ebb-090f-484c-9749-42c000375ec5" status: 200 len: 1346 microversion: 2.1 time: 0.174703 Sep 14 09:00:28.590112 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1408/2750] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:00:28 2022] GET /compute/v2.1/servers/ef2a3ebb-090f-484c-9749-42c000375ec5 => generated 1346 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:00:28.595320 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-baff151f-e322-4a51-aaa9-b16a11c87fd9 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:28.596357 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-baff151f-e322-4a51-aaa9-b16a11c87fd9 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] [instance: 9ddb5908-22a9-41c8-909c-39cdf479bdd2] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:28.602881 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-baff151f-e322-4a51-aaa9-b16a11c87fd9 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:28.605506 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-baff151f-e322-4a51-aaa9-b16a11c87fd9 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:28.606338 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-baff151f-e322-4a51-aaa9-b16a11c87fd9 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:28.608099 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-baff151f-e322-4a51-aaa9-b16a11c87fd9 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:28.620213 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-baff151f-e322-4a51-aaa9-b16a11c87fd9 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:28.621117 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-baff151f-e322-4a51-aaa9-b16a11c87fd9 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:28.664706 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-407ef2e9-4b05-4365-b610-3984f87dcc16 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a475c6e2b35f494aa8380aa1783e1779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c6f0c84e964383af6a4025d80fc93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:28.683466 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-407ef2e9-4b05-4365-b610-3984f87dcc16 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] 10.222.0.60 "GET /compute/v2.1/servers/a4852a58-51c4-4ca0-8c83-19fc8209fd21" status: 200 len: 1218 microversion: 2.1 time: 0.180851 Sep 14 09:00:28.685815 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1343/2751] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:00:28 2022] GET /compute/v2.1/servers/a4852a58-51c4-4ca0-8c83-19fc8209fd21 => generated 1218 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:00:28.769823 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.objects.instance [None req-baff151f-e322-4a51-aaa9-b16a11c87fd9 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lazy-loading 'services' on Instance uuid 9ddb5908-22a9-41c8-909c-39cdf479bdd2 {{(pid=128758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:00:28.807654 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-baff151f-e322-4a51-aaa9-b16a11c87fd9 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/9ddb5908-22a9-41c8-909c-39cdf479bdd2" status: 200 len: 1931 microversion: 2.75 time: 0.215989 Sep 14 09:00:28.808563 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1409/2752] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:00:28 2022] GET /compute/v2.1/servers/9ddb5908-22a9-41c8-909c-39cdf479bdd2 => generated 1931 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:00:29.052469 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b3062bff-bb68-4c97-8893-c89fbc6ebe0c tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3813cc0e-28f8-434f-84aa-f1baf0718e15"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:00:29.055062 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b3062bff-bb68-4c97-8893-c89fbc6ebe0c tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] [instance: 885dfd01-8bac-4691-ad0b-f2218e306f2e] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:29.063858 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b3062bff-bb68-4c97-8893-c89fbc6ebe0c tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:29.064345 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b3062bff-bb68-4c97-8893-c89fbc6ebe0c tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:29.064783 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b3062bff-bb68-4c97-8893-c89fbc6ebe0c tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:29.065621 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b3062bff-bb68-4c97-8893-c89fbc6ebe0c tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:29.066075 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b3062bff-bb68-4c97-8893-c89fbc6ebe0c tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:29.066680 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b3062bff-bb68-4c97-8893-c89fbc6ebe0c tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:29.436826 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-aa6c863c-23be-490a-97aa-0430e401b75b tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:29.437754 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-aa6c863c-23be-490a-97aa-0430e401b75b tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: 8f7f80e3-c2f5-4719-a484-29d6bd0d9e91] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:29.452550 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-aa6c863c-23be-490a-97aa-0430e401b75b tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:29.453050 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-aa6c863c-23be-490a-97aa-0430e401b75b tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:29.453485 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-aa6c863c-23be-490a-97aa-0430e401b75b tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:29.454201 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-aa6c863c-23be-490a-97aa-0430e401b75b tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:29.457133 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b3062bff-bb68-4c97-8893-c89fbc6ebe0c tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] 10.222.0.60 "POST /compute/v2.1/servers/885dfd01-8bac-4691-ad0b-f2218e306f2e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.408924 Sep 14 09:00:29.458354 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1344/2753] 10.222.0.60 () {60 vars in 1323 bytes} [Wed Sep 14 09:00:29 2022] POST /compute/v2.1/servers/885dfd01-8bac-4691-ad0b-f2218e306f2e/os-volume_attachments => generated 194 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:00:29.459600 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-aa6c863c-23be-490a-97aa-0430e401b75b tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:29.460395 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-aa6c863c-23be-490a-97aa-0430e401b75b tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:29.618700 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-bf9014cc-bd52-46a2-b2d4-b3d5675cdcbf tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:29.619461 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-bf9014cc-bd52-46a2-b2d4-b3d5675cdcbf tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: ef2a3ebb-090f-484c-9749-42c000375ec5] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:29.632323 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bf9014cc-bd52-46a2-b2d4-b3d5675cdcbf tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:29.632983 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bf9014cc-bd52-46a2-b2d4-b3d5675cdcbf tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:29.633306 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bf9014cc-bd52-46a2-b2d4-b3d5675cdcbf tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:29.642786 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bf9014cc-bd52-46a2-b2d4-b3d5675cdcbf tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:29.643622 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bf9014cc-bd52-46a2-b2d4-b3d5675cdcbf tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:29.644385 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bf9014cc-bd52-46a2-b2d4-b3d5675cdcbf tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:29.713225 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-aa6c863c-23be-490a-97aa-0430e401b75b tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9d40e54481461cba53fedb9a6abdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed2295a58f8451993a57ce0a6f9ba29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:29.721673 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-aa6c863c-23be-490a-97aa-0430e401b75b tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7f80e3-c2f5-4719-a484-29d6bd0d9e91" status: 200 len: 1517 microversion: 2.1 time: 0.289576 Sep 14 09:00:29.723581 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1410/2754] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:00:29 2022] GET /compute/v2.1/servers/8f7f80e3-c2f5-4719-a484-29d6bd0d9e91 => generated 1517 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:00:29.748286 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-0dde14d4-bd89-4494-9431-f153a4d354af tempest-VolumesTestJSON-170942237 tempest-VolumesTestJSON-170942237-project] Calling method '.version_select at 0x7f7d44042ca0>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:29.757995 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-bf9014cc-bd52-46a2-b2d4-b3d5675cdcbf tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:29.771785 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-bf9014cc-bd52-46a2-b2d4-b3d5675cdcbf tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/ef2a3ebb-090f-484c-9749-42c000375ec5" status: 200 len: 1346 microversion: 2.1 time: 0.159206 Sep 14 09:00:29.774911 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1345/2755] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:00:29 2022] GET /compute/v2.1/servers/ef2a3ebb-090f-484c-9749-42c000375ec5 => generated 1346 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:00:29.781364 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-0d75bb70-671e-4097-9823-119e6191ce74 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:29.782151 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-0d75bb70-671e-4097-9823-119e6191ce74 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] [instance: a4852a58-51c4-4ca0-8c83-19fc8209fd21] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:29.790654 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0d75bb70-671e-4097-9823-119e6191ce74 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:29.791480 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0d75bb70-671e-4097-9823-119e6191ce74 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:29.792138 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0d75bb70-671e-4097-9823-119e6191ce74 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:29.793093 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0d75bb70-671e-4097-9823-119e6191ce74 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:29.793905 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0d75bb70-671e-4097-9823-119e6191ce74 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:29.795219 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0d75bb70-671e-4097-9823-119e6191ce74 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:29.959563 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-0d75bb70-671e-4097-9823-119e6191ce74 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a475c6e2b35f494aa8380aa1783e1779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c6f0c84e964383af6a4025d80fc93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:29.969159 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-0d75bb70-671e-4097-9823-119e6191ce74 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] 10.222.0.60 "GET /compute/v2.1/servers/a4852a58-51c4-4ca0-8c83-19fc8209fd21" status: 200 len: 1270 microversion: 2.1 time: 0.193042 Sep 14 09:00:29.969983 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1346/2756] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:00:29 2022] GET /compute/v2.1/servers/a4852a58-51c4-4ca0-8c83-19fc8209fd21 => generated 1270 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:00:29.974759 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-01c102da-1dd5-4cf5-a7d6-27db2abf4d19 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:29.976231 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-01c102da-1dd5-4cf5-a7d6-27db2abf4d19 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] [instance: 9ddb5908-22a9-41c8-909c-39cdf479bdd2] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:29.995581 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-01c102da-1dd5-4cf5-a7d6-27db2abf4d19 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:29.998357 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-01c102da-1dd5-4cf5-a7d6-27db2abf4d19 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:29.999073 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-01c102da-1dd5-4cf5-a7d6-27db2abf4d19 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:30.000440 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-01c102da-1dd5-4cf5-a7d6-27db2abf4d19 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:30.003453 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-01c102da-1dd5-4cf5-a7d6-27db2abf4d19 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:30.004144 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-01c102da-1dd5-4cf5-a7d6-27db2abf4d19 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:30.180220 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:00:30.188477 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.objects.instance [None req-01c102da-1dd5-4cf5-a7d6-27db2abf4d19 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lazy-loading 'services' on Instance uuid 9ddb5908-22a9-41c8-909c-39cdf479bdd2 {{(pid=128759) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:00:30.227299 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-01c102da-1dd5-4cf5-a7d6-27db2abf4d19 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/9ddb5908-22a9-41c8-909c-39cdf479bdd2" status: 200 len: 1931 microversion: 2.75 time: 0.255866 Sep 14 09:00:30.227898 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1347/2757] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:00:29 2022] GET /compute/v2.1/servers/9ddb5908-22a9-41c8-909c-39cdf479bdd2 => generated 1931 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:00:30.759614 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-7851cdae-8331-47ae-9dcc-6feb70d6c987 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:30.764700 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-7851cdae-8331-47ae-9dcc-6feb70d6c987 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: 8f7f80e3-c2f5-4719-a484-29d6bd0d9e91] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:30.780489 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7851cdae-8331-47ae-9dcc-6feb70d6c987 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:30.780985 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7851cdae-8331-47ae-9dcc-6feb70d6c987 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:30.781425 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7851cdae-8331-47ae-9dcc-6feb70d6c987 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:30.782127 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7851cdae-8331-47ae-9dcc-6feb70d6c987 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:30.782582 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7851cdae-8331-47ae-9dcc-6feb70d6c987 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:30.783108 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7851cdae-8331-47ae-9dcc-6feb70d6c987 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:31.104873 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-7851cdae-8331-47ae-9dcc-6feb70d6c987 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9d40e54481461cba53fedb9a6abdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed2295a58f8451993a57ce0a6f9ba29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:31.115189 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-7851cdae-8331-47ae-9dcc-6feb70d6c987 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7f80e3-c2f5-4719-a484-29d6bd0d9e91" status: 200 len: 1517 microversion: 2.1 time: 0.362828 Sep 14 09:00:31.116845 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1348/2758] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:00:30 2022] GET /compute/v2.1/servers/8f7f80e3-c2f5-4719-a484-29d6bd0d9e91 => generated 1517 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:00:31.123345 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-06ae7ba4-994f-4cb8-9f9d-1f32f294bccb tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:31.125054 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-06ae7ba4-994f-4cb8-9f9d-1f32f294bccb tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: ef2a3ebb-090f-484c-9749-42c000375ec5] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:31.137175 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-06ae7ba4-994f-4cb8-9f9d-1f32f294bccb tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:31.138724 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-06ae7ba4-994f-4cb8-9f9d-1f32f294bccb tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:31.139378 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-06ae7ba4-994f-4cb8-9f9d-1f32f294bccb tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:31.140966 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-06ae7ba4-994f-4cb8-9f9d-1f32f294bccb tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:31.142333 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-06ae7ba4-994f-4cb8-9f9d-1f32f294bccb tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:31.143060 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-06ae7ba4-994f-4cb8-9f9d-1f32f294bccb tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:31.281329 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-06ae7ba4-994f-4cb8-9f9d-1f32f294bccb tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:31.295429 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-06ae7ba4-994f-4cb8-9f9d-1f32f294bccb tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/ef2a3ebb-090f-484c-9749-42c000375ec5" status: 200 len: 1346 microversion: 2.1 time: 0.176111 Sep 14 09:00:31.296710 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1349/2759] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:00:31 2022] GET /compute/v2.1/servers/ef2a3ebb-090f-484c-9749-42c000375ec5 => generated 1346 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:00:31.317044 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-04e57e8b-6cef-48cb-818e-a6c9695161cb tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:31.319069 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-04e57e8b-6cef-48cb-818e-a6c9695161cb tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] [instance: a4852a58-51c4-4ca0-8c83-19fc8209fd21] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:31.327198 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-04e57e8b-6cef-48cb-818e-a6c9695161cb tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:31.328317 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-04e57e8b-6cef-48cb-818e-a6c9695161cb tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:31.329062 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-04e57e8b-6cef-48cb-818e-a6c9695161cb tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:31.329943 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-04e57e8b-6cef-48cb-818e-a6c9695161cb tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:31.331226 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-04e57e8b-6cef-48cb-818e-a6c9695161cb tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:31.331825 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-04e57e8b-6cef-48cb-818e-a6c9695161cb tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:31.463143 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-04e57e8b-6cef-48cb-818e-a6c9695161cb tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a475c6e2b35f494aa8380aa1783e1779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c6f0c84e964383af6a4025d80fc93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:31.474203 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-04e57e8b-6cef-48cb-818e-a6c9695161cb tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] 10.222.0.60 "GET /compute/v2.1/servers/a4852a58-51c4-4ca0-8c83-19fc8209fd21" status: 200 len: 1276 microversion: 2.1 time: 0.174830 Sep 14 09:00:31.475197 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1350/2760] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:00:31 2022] GET /compute/v2.1/servers/a4852a58-51c4-4ca0-8c83-19fc8209fd21 => generated 1276 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:00:31.480596 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-94f395eb-f0a1-4dea-9541-b613fef5ac9c tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:31.481198 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-94f395eb-f0a1-4dea-9541-b613fef5ac9c tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] [instance: 9ddb5908-22a9-41c8-909c-39cdf479bdd2] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:31.488419 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-94f395eb-f0a1-4dea-9541-b613fef5ac9c tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:31.489088 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-94f395eb-f0a1-4dea-9541-b613fef5ac9c tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:31.489522 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-94f395eb-f0a1-4dea-9541-b613fef5ac9c tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:31.490246 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-94f395eb-f0a1-4dea-9541-b613fef5ac9c tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:31.490695 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-94f395eb-f0a1-4dea-9541-b613fef5ac9c tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:31.491148 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-94f395eb-f0a1-4dea-9541-b613fef5ac9c tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:31.639766 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.objects.instance [None req-94f395eb-f0a1-4dea-9541-b613fef5ac9c tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lazy-loading 'services' on Instance uuid 9ddb5908-22a9-41c8-909c-39cdf479bdd2 {{(pid=128759) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:00:31.657689 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-94f395eb-f0a1-4dea-9541-b613fef5ac9c tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/9ddb5908-22a9-41c8-909c-39cdf479bdd2" status: 200 len: 1931 microversion: 2.75 time: 0.181356 Sep 14 09:00:31.658530 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1351/2761] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:00:31 2022] GET /compute/v2.1/servers/9ddb5908-22a9-41c8-909c-39cdf479bdd2 => generated 1931 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:00:32.138514 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-6ba10e91-3588-4435-ab37-182d62ebb8d0 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:32.139309 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-6ba10e91-3588-4435-ab37-182d62ebb8d0 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: 8f7f80e3-c2f5-4719-a484-29d6bd0d9e91] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:32.147309 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6ba10e91-3588-4435-ab37-182d62ebb8d0 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:32.147807 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6ba10e91-3588-4435-ab37-182d62ebb8d0 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:32.148248 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6ba10e91-3588-4435-ab37-182d62ebb8d0 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:32.148986 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6ba10e91-3588-4435-ab37-182d62ebb8d0 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:32.149447 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6ba10e91-3588-4435-ab37-182d62ebb8d0 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:32.149904 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6ba10e91-3588-4435-ab37-182d62ebb8d0 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:32.440491 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-6ba10e91-3588-4435-ab37-182d62ebb8d0 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9d40e54481461cba53fedb9a6abdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed2295a58f8451993a57ce0a6f9ba29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:32.451773 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-6ba10e91-3588-4435-ab37-182d62ebb8d0 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7f80e3-c2f5-4719-a484-29d6bd0d9e91" status: 200 len: 1517 microversion: 2.1 time: 0.317782 Sep 14 09:00:32.459415 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1352/2762] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:00:32 2022] GET /compute/v2.1/servers/8f7f80e3-c2f5-4719-a484-29d6bd0d9e91 => generated 1517 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:00:32.459415 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-efa9bd6f-0d37-4871-a074-4169a9d66cfb tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:32.459415 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-efa9bd6f-0d37-4871-a074-4169a9d66cfb tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: ef2a3ebb-090f-484c-9749-42c000375ec5] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:32.465328 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-efa9bd6f-0d37-4871-a074-4169a9d66cfb tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:32.466513 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-efa9bd6f-0d37-4871-a074-4169a9d66cfb tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:32.467235 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-efa9bd6f-0d37-4871-a074-4169a9d66cfb tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:32.468105 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-efa9bd6f-0d37-4871-a074-4169a9d66cfb tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:32.468726 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-efa9bd6f-0d37-4871-a074-4169a9d66cfb tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:32.469881 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-efa9bd6f-0d37-4871-a074-4169a9d66cfb tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:32.577361 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-efa9bd6f-0d37-4871-a074-4169a9d66cfb tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:32.588193 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-efa9bd6f-0d37-4871-a074-4169a9d66cfb tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/ef2a3ebb-090f-484c-9749-42c000375ec5" status: 200 len: 1346 microversion: 2.1 time: 0.134776 Sep 14 09:00:32.589536 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1353/2763] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:00:32 2022] GET /compute/v2.1/servers/ef2a3ebb-090f-484c-9749-42c000375ec5 => generated 1346 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:00:32.597163 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ec8654b2-8d28-4c6c-b269-902039d391cb tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:32.598433 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-ec8654b2-8d28-4c6c-b269-902039d391cb tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] [instance: a4852a58-51c4-4ca0-8c83-19fc8209fd21] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:32.607434 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ec8654b2-8d28-4c6c-b269-902039d391cb tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:32.608071 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ec8654b2-8d28-4c6c-b269-902039d391cb tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:32.608609 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ec8654b2-8d28-4c6c-b269-902039d391cb tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:32.609506 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ec8654b2-8d28-4c6c-b269-902039d391cb tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:32.610179 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ec8654b2-8d28-4c6c-b269-902039d391cb tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:32.610703 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ec8654b2-8d28-4c6c-b269-902039d391cb tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:32.774323 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-0dde14d4-bd89-4494-9431-f153a4d354af tempest-VolumesTestJSON-170942237 tempest-VolumesTestJSON-170942237-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/e98842ae-43e3-4432-89cb-23bcf2130499" status: 200 len: 350 microversion: 2.1 time: 3.049426 Sep 14 09:00:32.774880 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1411/2764] 10.222.0.60 () {58 vars in 1245 bytes} [Wed Sep 14 09:00:29 2022] GET /compute/v2.1/os-volumes/e98842ae-43e3-4432-89cb-23bcf2130499 => generated 350 bytes in 3051 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:00:32.781058 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-3bc3b6a0-dc3e-4c67-adc0-5b15d67e8d0b req-bf6cb8be-a326-413e-95e6-07ac9f259dac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebf9bfa9-e941-4d23-8f6c-9867102feff2", "tag": "a16e0c89-9089-483d-ae3b-f83433826e96"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:00:32.816159 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-3bc3b6a0-dc3e-4c67-adc0-5b15d67e8d0b req-bf6cb8be-a326-413e-95e6-07ac9f259dac service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:32.817909 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-3bc3b6a0-dc3e-4c67-adc0-5b15d67e8d0b req-bf6cb8be-a326-413e-95e6-07ac9f259dac service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:32.818608 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-3bc3b6a0-dc3e-4c67-adc0-5b15d67e8d0b req-bf6cb8be-a326-413e-95e6-07ac9f259dac service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:32.837407 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-3bc3b6a0-dc3e-4c67-adc0-5b15d67e8d0b req-bf6cb8be-a326-413e-95e6-07ac9f259dac service nova] Creating event network-changed:a16e0c89-9089-483d-ae3b-f83433826e96 for instance ebf9bfa9-e941-4d23-8f6c-9867102feff2 on n-h1-836830-18 Sep 14 09:00:32.843814 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-3bc3b6a0-dc3e-4c67-adc0-5b15d67e8d0b req-bf6cb8be-a326-413e-95e6-07ac9f259dac service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067671 Sep 14 09:00:32.845189 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1412/2765] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:00:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:00:32.853019 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-f496ec7f-6223-488e-89a0-6035b26bae7a tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:32.853970 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-f496ec7f-6223-488e-89a0-6035b26bae7a tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] [instance: 9ddb5908-22a9-41c8-909c-39cdf479bdd2] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:32.875179 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f496ec7f-6223-488e-89a0-6035b26bae7a tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:32.875970 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f496ec7f-6223-488e-89a0-6035b26bae7a tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:32.876628 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f496ec7f-6223-488e-89a0-6035b26bae7a tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:32.878716 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f496ec7f-6223-488e-89a0-6035b26bae7a tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:32.879970 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f496ec7f-6223-488e-89a0-6035b26bae7a tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:32.880860 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f496ec7f-6223-488e-89a0-6035b26bae7a tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:33.061181 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-ec8654b2-8d28-4c6c-b269-902039d391cb tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a475c6e2b35f494aa8380aa1783e1779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c6f0c84e964383af6a4025d80fc93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:33.071452 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-ec8654b2-8d28-4c6c-b269-902039d391cb tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] 10.222.0.60 "GET /compute/v2.1/servers/a4852a58-51c4-4ca0-8c83-19fc8209fd21" status: 200 len: 1318 microversion: 2.1 time: 0.480899 Sep 14 09:00:33.072722 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.objects.instance [None req-f496ec7f-6223-488e-89a0-6035b26bae7a tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lazy-loading 'services' on Instance uuid 9ddb5908-22a9-41c8-909c-39cdf479bdd2 {{(pid=128758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:00:33.090986 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1354/2766] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:00:32 2022] GET /compute/v2.1/servers/a4852a58-51c4-4ca0-8c83-19fc8209fd21 => generated 1318 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:00:33.118590 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-f496ec7f-6223-488e-89a0-6035b26bae7a tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/9ddb5908-22a9-41c8-909c-39cdf479bdd2" status: 200 len: 1931 microversion: 2.75 time: 0.271459 Sep 14 09:00:33.120594 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1413/2767] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:00:32 2022] GET /compute/v2.1/servers/9ddb5908-22a9-41c8-909c-39cdf479bdd2 => generated 1931 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:00:33.476262 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-5d64e87d-b77c-490c-ab8e-28832cbe553c tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:33.477847 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-5d64e87d-b77c-490c-ab8e-28832cbe553c tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: 8f7f80e3-c2f5-4719-a484-29d6bd0d9e91] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:33.485819 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5d64e87d-b77c-490c-ab8e-28832cbe553c tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:33.486319 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5d64e87d-b77c-490c-ab8e-28832cbe553c tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:33.486766 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5d64e87d-b77c-490c-ab8e-28832cbe553c tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:33.489596 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5d64e87d-b77c-490c-ab8e-28832cbe553c tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:33.490299 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5d64e87d-b77c-490c-ab8e-28832cbe553c tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:33.491620 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5d64e87d-b77c-490c-ab8e-28832cbe553c tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:33.615409 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-40c8a05e-6a15-466d-a5f1-13c9c02b1135 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:33.616045 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-40c8a05e-6a15-466d-a5f1-13c9c02b1135 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: ef2a3ebb-090f-484c-9749-42c000375ec5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:33.625281 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-40c8a05e-6a15-466d-a5f1-13c9c02b1135 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:33.626218 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-40c8a05e-6a15-466d-a5f1-13c9c02b1135 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:33.626817 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-40c8a05e-6a15-466d-a5f1-13c9c02b1135 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:33.627769 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-40c8a05e-6a15-466d-a5f1-13c9c02b1135 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:33.628535 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-40c8a05e-6a15-466d-a5f1-13c9c02b1135 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:33.629249 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-40c8a05e-6a15-466d-a5f1-13c9c02b1135 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:33.644926 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-40c8a05e-6a15-466d-a5f1-13c9c02b1135 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] HTTP exception thrown: Instance ef2a3ebb-090f-484c-9749-42c000375ec5 could not be found. Sep 14 09:00:33.647765 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-40c8a05e-6a15-466d-a5f1-13c9c02b1135 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Request method failure captured: Sep 14 09:00:33.647765 n-d-836830-18 devstack@n-api.service[128758]: request: GET /compute/v2.1/servers/ef2a3ebb-090f-484c-9749-42c000375ec5 HTTP/1.1 Sep 14 09:00:33.647765 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 09:00:33.647765 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 09:00:33.647765 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 09:00:33.647765 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 09:00:33.647765 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 09:00:33.647765 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 09:00:33.647765 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 09:00:33.647765 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 09:00:33.647765 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZfruMTQYBTAiiDSnzM1mYEpmuEj9qljISQOJ4EBe2ad6zsfFzAf8FVBubQCt-Sdr-zCKCq1jxjsj_azLMK_SQWZ09VXr62FV-261vpzTW6inln_93a6hl3DeVdX6cuYwx-Go-beMey4bY4s6iPFtULEKgIbxHUgjvgK1DEFOEvCwSQ Sep 14 09:00:33.647765 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 09:00:33.647765 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 09:00:33.647765 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 09:00:33.647765 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 09:00:33.647765 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 09:00:33.647765 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 09:00:33.647765 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 4d42bf4d573b4bf9a0d8c9e73260af7e Sep 14 09:00:33.647765 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-DeleteServersTestJSON-1669995002 Sep 14 09:00:33.647765 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 09:00:33.647765 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 09:00:33.647765 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/4d42bf4d573b4bf9a0d8c9e73260af7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_4d42bf4d573b4bf9a0d8c9e73260af7e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4d42bf4d573b4bf9a0d8c9e73260af7e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4d42bf4d573b4bf9a0d8c9e73260af7e"}]}] Sep 14 09:00:33.647765 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-DeleteServersTestJSON-1669995002 Sep 14 09:00:33.647765 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 4d42bf4d573b4bf9a0d8c9e73260af7e Sep 14 09:00:33.647765 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-DeleteServersTestJSON-1669995002 Sep 14 09:00:33.647765 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-DeleteServersTestJSON-1669995002-project Sep 14 09:00:33.647765 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 09:00:33.647765 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 09:00:33.647765 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 47c95b28481b451bb03fb2c0240d0310 Sep 14 09:00:33.647765 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-DeleteServersTestJSON-1669995002-project Sep 14 09:00:33.647765 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 09:00:33.647765 n-d-836830-18 devstack@n-api.service[128758]: exception: Instance ef2a3ebb-090f-484c-9749-42c000375ec5 could not be found. Sep 14 09:00:33.647765 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': 'ef2a3ebb-090f-484c-9749-42c000375ec5'} Sep 14 09:00:33.647765 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:00:33.647765 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:00:33.647765 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:00:33.647765 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:00:33.647765 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:00:33.647765 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:00:33.647765 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:00:33.647765 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:00:33.647765 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:00:33.647765 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:00:33.647765 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef2a3ebb-090f-484c-9749-42c000375ec5 could not be found. Sep 14 09:00:33.647765 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:00:33.647765 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:00:33.647765 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:00:33.647765 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:00:33.647765 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:00:33.647765 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:00:33.647765 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:00:33.647765 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:00:33.647765 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:00:33.647765 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:00:33.647765 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:00:33.647765 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:00:33.647765 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:00:33.647765 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:00:33.647765 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:00:33.647765 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:00:33.647765 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef2a3ebb-090f-484c-9749-42c000375ec5 could not be found. Sep 14 09:00:33.647765 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:00:33.647765 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:00:33.647765 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:00:33.652985 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:00:33.652985 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:00:33.652985 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:00:33.652985 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:00:33.652985 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:00:33.652985 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef2a3ebb-090f-484c-9749-42c000375ec5 could not be found. Sep 14 09:00:33.652985 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:00:33.655995 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-40c8a05e-6a15-466d-a5f1-13c9c02b1135 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Returning 404 to user: Instance ef2a3ebb-090f-484c-9749-42c000375ec5 could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:00:33.657067 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-40c8a05e-6a15-466d-a5f1-13c9c02b1135 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/ef2a3ebb-090f-484c-9749-42c000375ec5" status: 404 len: 111 microversion: 2.1 time: 0.046429 Sep 14 09:00:33.657821 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1414/2768] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:00:33 2022] GET /compute/v2.1/servers/ef2a3ebb-090f-484c-9749-42c000375ec5 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 14 09:00:33.810905 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a5d6e887-f4be-4346-840e-37b7e329ebde tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:33.814113 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-a5d6e887-f4be-4346-840e-37b7e329ebde tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: ef2a3ebb-090f-484c-9749-42c000375ec5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:33.821096 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a5d6e887-f4be-4346-840e-37b7e329ebde tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:33.821886 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a5d6e887-f4be-4346-840e-37b7e329ebde tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:33.823156 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a5d6e887-f4be-4346-840e-37b7e329ebde tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:33.824120 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a5d6e887-f4be-4346-840e-37b7e329ebde tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:33.824803 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a5d6e887-f4be-4346-840e-37b7e329ebde tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:33.826209 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a5d6e887-f4be-4346-840e-37b7e329ebde tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:33.842704 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-a5d6e887-f4be-4346-840e-37b7e329ebde tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] HTTP exception thrown: Instance ef2a3ebb-090f-484c-9749-42c000375ec5 could not be found. Sep 14 09:00:33.859350 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a5d6e887-f4be-4346-840e-37b7e329ebde tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Request method failure captured: Sep 14 09:00:33.859350 n-d-836830-18 devstack@n-api.service[128758]: request: GET /compute/v2.1/servers/ef2a3ebb-090f-484c-9749-42c000375ec5/os-volume_attachments HTTP/1.1 Sep 14 09:00:33.859350 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 09:00:33.859350 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 09:00:33.859350 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 09:00:33.859350 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 09:00:33.859350 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 09:00:33.859350 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 09:00:33.859350 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 09:00:33.859350 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 09:00:33.859350 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZfruMTQYBTAiiDSnzM1mYEpmuEj9qljISQOJ4EBe2ad6zsfFzAf8FVBubQCt-Sdr-zCKCq1jxjsj_azLMK_SQWZ09VXr62FV-261vpzTW6inln_93a6hl3DeVdX6cuYwx-Go-beMey4bY4s6iPFtULEKgIbxHUgjvgK1DEFOEvCwSQ Sep 14 09:00:33.859350 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 09:00:33.859350 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 09:00:33.859350 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 09:00:33.859350 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 09:00:33.859350 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 09:00:33.859350 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 09:00:33.859350 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 4d42bf4d573b4bf9a0d8c9e73260af7e Sep 14 09:00:33.859350 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-DeleteServersTestJSON-1669995002 Sep 14 09:00:33.859350 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 09:00:33.859350 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 09:00:33.859350 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/4d42bf4d573b4bf9a0d8c9e73260af7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_4d42bf4d573b4bf9a0d8c9e73260af7e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4d42bf4d573b4bf9a0d8c9e73260af7e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4d42bf4d573b4bf9a0d8c9e73260af7e"}]}] Sep 14 09:00:33.859350 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-DeleteServersTestJSON-1669995002 Sep 14 09:00:33.859350 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 4d42bf4d573b4bf9a0d8c9e73260af7e Sep 14 09:00:33.859350 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-DeleteServersTestJSON-1669995002 Sep 14 09:00:33.859350 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-DeleteServersTestJSON-1669995002-project Sep 14 09:00:33.859350 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 09:00:33.859350 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 09:00:33.859350 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 47c95b28481b451bb03fb2c0240d0310 Sep 14 09:00:33.859350 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-DeleteServersTestJSON-1669995002-project Sep 14 09:00:33.859350 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 09:00:33.859350 n-d-836830-18 devstack@n-api.service[128758]: exception: Instance ef2a3ebb-090f-484c-9749-42c000375ec5 could not be found. Sep 14 09:00:33.859350 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'server_id': 'ef2a3ebb-090f-484c-9749-42c000375ec5'} Sep 14 09:00:33.859350 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:00:33.859350 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:00:33.859350 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:00:33.859350 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:00:33.859350 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:00:33.859350 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:00:33.859350 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:00:33.859350 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:00:33.859350 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:00:33.859350 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:00:33.859350 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef2a3ebb-090f-484c-9749-42c000375ec5 could not be found. Sep 14 09:00:33.859350 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:00:33.859350 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:00:33.859350 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:00:33.859350 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:00:33.859350 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:00:33.859350 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:00:33.859350 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:00:33.859350 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:00:33.859350 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:00:33.859350 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:00:33.859350 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 14 09:00:33.859350 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:00:33.859350 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 14 09:00:33.859350 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:00:33.859350 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 14 09:00:33.859350 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 14 09:00:33.859350 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:00:33.859350 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:00:33.864729 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef2a3ebb-090f-484c-9749-42c000375ec5 could not be found. Sep 14 09:00:33.864729 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:00:33.864729 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:00:33.864729 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:00:33.864729 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:00:33.864729 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:00:33.864729 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:00:33.864729 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:00:33.864729 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:00:33.864729 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef2a3ebb-090f-484c-9749-42c000375ec5 could not be found. Sep 14 09:00:33.864729 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:00:33.865516 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-5d64e87d-b77c-490c-ab8e-28832cbe553c tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9d40e54481461cba53fedb9a6abdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed2295a58f8451993a57ce0a6f9ba29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:33.869124 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a5d6e887-f4be-4346-840e-37b7e329ebde tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Returning 404 to user: Instance ef2a3ebb-090f-484c-9749-42c000375ec5 could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:00:33.872096 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-5d64e87d-b77c-490c-ab8e-28832cbe553c tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7f80e3-c2f5-4719-a484-29d6bd0d9e91" status: 200 len: 1517 microversion: 2.1 time: 0.400102 Sep 14 09:00:33.872730 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1355/2769] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:00:33 2022] GET /compute/v2.1/servers/8f7f80e3-c2f5-4719-a484-29d6bd0d9e91 => generated 1517 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:00:33.873337 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-a5d6e887-f4be-4346-840e-37b7e329ebde tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/ef2a3ebb-090f-484c-9749-42c000375ec5/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.067657 Sep 14 09:00:33.874139 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1415/2770] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 14 09:00:33 2022] GET /compute/v2.1/servers/ef2a3ebb-090f-484c-9749-42c000375ec5/os-volume_attachments => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 14 09:00:34.095864 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-97d975bb-61c6-4af5-a2ba-77d4246b12dd tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-434681908", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "networks": [{"uuid": "b9ab2062-a108-4d91-8f37-c911ce062678"}]}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:00:34.101384 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-505bdba3-5191-4d59-9f44-90ee9e9fbf48 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:34.102135 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-505bdba3-5191-4d59-9f44-90ee9e9fbf48 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] [instance: a4852a58-51c4-4ca0-8c83-19fc8209fd21] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:34.108897 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-505bdba3-5191-4d59-9f44-90ee9e9fbf48 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:34.109742 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-505bdba3-5191-4d59-9f44-90ee9e9fbf48 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:34.110412 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-505bdba3-5191-4d59-9f44-90ee9e9fbf48 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:34.111758 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-505bdba3-5191-4d59-9f44-90ee9e9fbf48 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:34.112564 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-505bdba3-5191-4d59-9f44-90ee9e9fbf48 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:34.113226 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-505bdba3-5191-4d59-9f44-90ee9e9fbf48 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:34.164598 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.network.neutron [None req-97d975bb-61c6-4af5-a2ba-77d4246b12dd tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] validate_networks() for [('b9ab2062-a108-4d91-8f37-c911ce062678', None, None, None, None, None)] {{(pid=128759) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:00:34.625855 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-505bdba3-5191-4d59-9f44-90ee9e9fbf48 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a475c6e2b35f494aa8380aa1783e1779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c6f0c84e964383af6a4025d80fc93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:34.636057 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-505bdba3-5191-4d59-9f44-90ee9e9fbf48 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] 10.222.0.60 "GET /compute/v2.1/servers/a4852a58-51c4-4ca0-8c83-19fc8209fd21" status: 200 len: 1318 microversion: 2.1 time: 0.538620 Sep 14 09:00:34.636768 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1416/2771] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:00:34 2022] GET /compute/v2.1/servers/a4852a58-51c4-4ca0-8c83-19fc8209fd21 => generated 1318 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:00:34.642110 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a60c621e-eda5-420f-9f4e-838adacd176f tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:34.642755 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-a60c621e-eda5-420f-9f4e-838adacd176f tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] [instance: 9ddb5908-22a9-41c8-909c-39cdf479bdd2] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:34.649248 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a60c621e-eda5-420f-9f4e-838adacd176f tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:34.649248 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a60c621e-eda5-420f-9f4e-838adacd176f tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:34.649640 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a60c621e-eda5-420f-9f4e-838adacd176f tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:34.650505 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a60c621e-eda5-420f-9f4e-838adacd176f tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:34.651324 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a60c621e-eda5-420f-9f4e-838adacd176f tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:34.651894 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a60c621e-eda5-420f-9f4e-838adacd176f tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:34.780870 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.objects.instance [None req-a60c621e-eda5-420f-9f4e-838adacd176f tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lazy-loading 'services' on Instance uuid 9ddb5908-22a9-41c8-909c-39cdf479bdd2 {{(pid=128758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:00:34.800066 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-a60c621e-eda5-420f-9f4e-838adacd176f tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/9ddb5908-22a9-41c8-909c-39cdf479bdd2" status: 200 len: 1931 microversion: 2.75 time: 0.161917 Sep 14 09:00:34.800776 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1417/2772] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:00:34 2022] GET /compute/v2.1/servers/9ddb5908-22a9-41c8-909c-39cdf479bdd2 => generated 1931 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:00:34.866309 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-7a9ffac9-4bce-4f97-bfd8-be32a876cf56 req-bf598347-473e-4a21-a448-e5612dc82de5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4852a58-51c4-4ca0-8c83-19fc8209fd21", "tag": "003dc8e7-2302-41ad-87e7-680ccac43c8f"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:00:34.876778 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-7a9ffac9-4bce-4f97-bfd8-be32a876cf56 req-bf598347-473e-4a21-a448-e5612dc82de5 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:34.877462 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-7a9ffac9-4bce-4f97-bfd8-be32a876cf56 req-bf598347-473e-4a21-a448-e5612dc82de5 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:34.877891 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-7a9ffac9-4bce-4f97-bfd8-be32a876cf56 req-bf598347-473e-4a21-a448-e5612dc82de5 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:34.888697 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-7a9ffac9-4bce-4f97-bfd8-be32a876cf56 req-bf598347-473e-4a21-a448-e5612dc82de5 service nova] Creating event network-changed:003dc8e7-2302-41ad-87e7-680ccac43c8f for instance a4852a58-51c4-4ca0-8c83-19fc8209fd21 on n-h2-836830-18 Sep 14 09:00:34.895158 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-7a9ffac9-4bce-4f97-bfd8-be32a876cf56 req-bf598347-473e-4a21-a448-e5612dc82de5 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031063 Sep 14 09:00:34.895158 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1418/2773] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:00:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:00:34.900416 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-9ba3996e-2e71-444b-8e16-c0dc9a460f40 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:34.901109 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-9ba3996e-2e71-444b-8e16-c0dc9a460f40 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: 8f7f80e3-c2f5-4719-a484-29d6bd0d9e91] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:34.902582 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-97d975bb-61c6-4af5-a2ba-77d4246b12dd tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Flavor limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:00:34.903608 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-97d975bb-61c6-4af5-a2ba-77d4246b12dd tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Image limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:00:34.904216 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-97d975bb-61c6-4af5-a2ba-77d4246b12dd tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Flavor pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:00:34.904847 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-97d975bb-61c6-4af5-a2ba-77d4246b12dd tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Image pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:00:34.905354 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-97d975bb-61c6-4af5-a2ba-77d4246b12dd tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:00:34.907403 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9ba3996e-2e71-444b-8e16-c0dc9a460f40 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:34.907888 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9ba3996e-2e71-444b-8e16-c0dc9a460f40 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:34.908493 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9ba3996e-2e71-444b-8e16-c0dc9a460f40 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:34.909180 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9ba3996e-2e71-444b-8e16-c0dc9a460f40 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:34.909633 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9ba3996e-2e71-444b-8e16-c0dc9a460f40 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:34.910056 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9ba3996e-2e71-444b-8e16-c0dc9a460f40 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:34.915941 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-97d975bb-61c6-4af5-a2ba-77d4246b12dd tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:34.916839 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-97d975bb-61c6-4af5-a2ba-77d4246b12dd tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:34.917612 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-97d975bb-61c6-4af5-a2ba-77d4246b12dd tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:34.918461 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-97d975bb-61c6-4af5-a2ba-77d4246b12dd tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:34.919657 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-97d975bb-61c6-4af5-a2ba-77d4246b12dd tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:34.920347 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-97d975bb-61c6-4af5-a2ba-77d4246b12dd tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:34.939952 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-97d975bb-61c6-4af5-a2ba-77d4246b12dd tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Getting quotas for project 4d42bf4d573b4bf9a0d8c9e73260af7e. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:00:34.942543 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:00:34.948822 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-97d975bb-61c6-4af5-a2ba-77d4246b12dd tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Getting quotas for user 47c95b28481b451bb03fb2c0240d0310 and project 4d42bf4d573b4bf9a0d8c9e73260af7e. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:00:34.963492 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-97d975bb-61c6-4af5-a2ba-77d4246b12dd tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Going to run 1 instances... {{(pid=128759) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:00:34.965806 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-97d975bb-61c6-4af5-a2ba-77d4246b12dd tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: d2c90e75-2618-4803-9865-e324dc5d8d59] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128759) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:00:35.026771 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-97d975bb-61c6-4af5-a2ba-77d4246b12dd tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.935437 Sep 14 09:00:35.028233 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1356/2774] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 09:00:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 938 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:00:35.040260 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-051f1a22-9bb3-4f30-97c4-ac746fe63b17 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:35.040891 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-051f1a22-9bb3-4f30-97c4-ac746fe63b17 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: d2c90e75-2618-4803-9865-e324dc5d8d59] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:35.116084 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-051f1a22-9bb3-4f30-97c4-ac746fe63b17 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:35.120603 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-9ba3996e-2e71-444b-8e16-c0dc9a460f40 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9d40e54481461cba53fedb9a6abdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed2295a58f8451993a57ce0a6f9ba29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:35.135370 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-051f1a22-9bb3-4f30-97c4-ac746fe63b17 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/d2c90e75-2618-4803-9865-e324dc5d8d59" status: 200 len: 1214 microversion: 2.1 time: 0.090420 Sep 14 09:00:35.135466 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-9ba3996e-2e71-444b-8e16-c0dc9a460f40 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7f80e3-c2f5-4719-a484-29d6bd0d9e91" status: 200 len: 1517 microversion: 2.1 time: 0.233137 Sep 14 09:00:35.135466 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1419/2775] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:00:34 2022] GET /compute/v2.1/servers/8f7f80e3-c2f5-4719-a484-29d6bd0d9e91 => generated 1517 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:00:35.140361 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1357/2776] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:00:35 2022] GET /compute/v2.1/servers/d2c90e75-2618-4803-9865-e324dc5d8d59 => generated 1214 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:00:35.147980 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-f29ab834-40a9-44bb-9bca-e63d5b241a0e tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:35.148490 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-f29ab834-40a9-44bb-9bca-e63d5b241a0e tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: d2c90e75-2618-4803-9865-e324dc5d8d59] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:35.158265 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:00:35.166267 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-f29ab834-40a9-44bb-9bca-e63d5b241a0e tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: d2c90e75-2618-4803-9865-e324dc5d8d59] Going to try to terminate instance {{(pid=128758) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:00:35.265556 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-f29ab834-40a9-44bb-9bca-e63d5b241a0e tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "DELETE /compute/v2.1/servers/d2c90e75-2618-4803-9865-e324dc5d8d59" status: 204 len: 0 microversion: 2.1 time: 0.121131 Sep 14 09:00:35.266251 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1420/2777] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:00:35 2022] DELETE /compute/v2.1/servers/d2c90e75-2618-4803-9865-e324dc5d8d59 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:00:35.274737 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ee048c2d-340c-4147-a826-f55c520d0ed1 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:35.275500 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-ee048c2d-340c-4147-a826-f55c520d0ed1 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: d2c90e75-2618-4803-9865-e324dc5d8d59] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:35.290486 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-ee048c2d-340c-4147-a826-f55c520d0ed1 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] HTTP exception thrown: Instance d2c90e75-2618-4803-9865-e324dc5d8d59 could not be found. Sep 14 09:00:35.297164 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ee048c2d-340c-4147-a826-f55c520d0ed1 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Request method failure captured: Sep 14 09:00:35.297164 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/d2c90e75-2618-4803-9865-e324dc5d8d59 HTTP/1.1 Sep 14 09:00:35.297164 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:00:35.297164 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:00:35.297164 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:00:35.297164 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:00:35.297164 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:00:35.297164 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:00:35.297164 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:00:35.297164 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:00:35.297164 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZfruMTQYBTAiiDSnzM1mYEpmuEj9qljISQOJ4EBe2ad6zsfFzAf8FVBubQCt-Sdr-zCKCq1jxjsj_azLMK_SQWZ09VXr62FV-261vpzTW6inln_93a6hl3DeVdX6cuYwx-Go-beMey4bY4s6iPFtULEKgIbxHUgjvgK1DEFOEvCwSQ Sep 14 09:00:35.297164 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:00:35.297164 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:00:35.297164 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:00:35.297164 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:00:35.297164 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:00:35.297164 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:00:35.297164 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 4d42bf4d573b4bf9a0d8c9e73260af7e Sep 14 09:00:35.297164 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-DeleteServersTestJSON-1669995002 Sep 14 09:00:35.297164 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:00:35.297164 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:00:35.297164 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/4d42bf4d573b4bf9a0d8c9e73260af7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_4d42bf4d573b4bf9a0d8c9e73260af7e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4d42bf4d573b4bf9a0d8c9e73260af7e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4d42bf4d573b4bf9a0d8c9e73260af7e"}]}] Sep 14 09:00:35.297164 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-DeleteServersTestJSON-1669995002 Sep 14 09:00:35.297164 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 4d42bf4d573b4bf9a0d8c9e73260af7e Sep 14 09:00:35.297164 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-DeleteServersTestJSON-1669995002 Sep 14 09:00:35.297164 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-DeleteServersTestJSON-1669995002-project Sep 14 09:00:35.297164 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:00:35.297164 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:00:35.297164 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 47c95b28481b451bb03fb2c0240d0310 Sep 14 09:00:35.297164 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-DeleteServersTestJSON-1669995002-project Sep 14 09:00:35.297164 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:00:35.297164 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance d2c90e75-2618-4803-9865-e324dc5d8d59 could not be found. Sep 14 09:00:35.297164 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': 'd2c90e75-2618-4803-9865-e324dc5d8d59'} Sep 14 09:00:35.297164 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:00:35.297164 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:00:35.297164 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2932, in _get_instance Sep 14 09:00:35.297164 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi build_req = objects.BuildRequest.get_by_instance_uuid( Sep 14 09:00:35.297164 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 14 09:00:35.297164 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 14 09:00:35.297164 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 177, in get_by_instance_uuid Sep 14 09:00:35.297164 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi db_req = cls._get_by_instance_uuid_from_db(context, instance_uuid) Sep 14 09:00:35.297164 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 14 09:00:35.297164 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 14 09:00:35.297164 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 172, in _get_by_instance_uuid_from_db Sep 14 09:00:35.297164 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.BuildRequestNotFound(uuid=instance_uuid) Sep 14 09:00:35.297164 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.BuildRequestNotFound: BuildRequest not found for instance d2c90e75-2618-4803-9865-e324dc5d8d59 Sep 14 09:00:35.297164 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:00:35.297164 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:00:35.297164 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:00:35.297164 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:00:35.297164 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:00:35.297164 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:00:35.297164 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:00:35.297164 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:00:35.297164 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2944, in _get_instance Sep 14 09:00:35.297164 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 14 09:00:35.297164 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2c90e75-2618-4803-9865-e324dc5d8d59 could not be found. Sep 14 09:00:35.297164 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:00:35.297164 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:00:35.297164 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:00:35.297164 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:00:35.297164 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:00:35.297164 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:00:35.301446 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:00:35.301446 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:00:35.301446 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:00:35.301446 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:00:35.301446 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:00:35.301446 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:00:35.301446 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:00:35.301446 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:00:35.301446 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:00:35.301446 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:00:35.301446 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2c90e75-2618-4803-9865-e324dc5d8d59 could not be found. Sep 14 09:00:35.301446 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:00:35.301446 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:00:35.301446 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:00:35.301446 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:00:35.301446 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:00:35.301446 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:00:35.301446 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:00:35.301446 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:00:35.301446 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2c90e75-2618-4803-9865-e324dc5d8d59 could not be found. Sep 14 09:00:35.301446 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:00:35.301446 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ee048c2d-340c-4147-a826-f55c520d0ed1 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Returning 404 to user: Instance d2c90e75-2618-4803-9865-e324dc5d8d59 could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:00:35.301446 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-ee048c2d-340c-4147-a826-f55c520d0ed1 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/d2c90e75-2618-4803-9865-e324dc5d8d59" status: 404 len: 111 microversion: 2.1 time: 0.028028 Sep 14 09:00:35.309199 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1358/2778] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:00:35 2022] GET /compute/v2.1/servers/d2c90e75-2618-4803-9865-e324dc5d8d59 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 14 09:00:35.357582 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-3ab8151d-5262-4f2a-94da-48569e3668ed tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-589782106", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "networks": [{"uuid": "b9ab2062-a108-4d91-8f37-c911ce062678"}]}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:00:35.425581 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.network.neutron [None req-3ab8151d-5262-4f2a-94da-48569e3668ed tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] validate_networks() for [('b9ab2062-a108-4d91-8f37-c911ce062678', None, None, None, None, None)] {{(pid=128758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:00:35.443403 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-056d8664-98e5-42e2-b270-b22fd73bfa41 tempest-VolumesTestJSON-170942237 tempest-VolumesTestJSON-170942237-project] Calling method '.version_select at 0x7f7d48692790>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:35.503327 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-056d8664-98e5-42e2-b270-b22fd73bfa41 tempest-VolumesTestJSON-170942237 tempest-VolumesTestJSON-170942237-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/f92e4469-507c-48d5-a0ea-f26b48c267a7" status: 200 len: 350 microversion: 2.1 time: 0.063599 Sep 14 09:00:35.503974 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1359/2779] 10.222.0.60 () {58 vars in 1245 bytes} [Wed Sep 14 09:00:35 2022] GET /compute/v2.1/os-volumes/f92e4469-507c-48d5-a0ea-f26b48c267a7 => generated 350 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:00:35.519205 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-2aaf32d6-c512-4fc0-a342-dfde4f5a8d10 tempest-VolumesTestJSON-170942237 tempest-VolumesTestJSON-170942237-project] Calling method '.version_select at 0x7f7d486e8670>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:35.634748 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-2aaf32d6-c512-4fc0-a342-dfde4f5a8d10 tempest-VolumesTestJSON-170942237 tempest-VolumesTestJSON-170942237-project] 10.222.0.60 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.121124 Sep 14 09:00:35.635446 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1360/2780] 10.222.0.60 () {58 vars in 1134 bytes} [Wed Sep 14 09:00:35 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:00:35.663874 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a34b9f79-768e-4bd4-8c2c-ba5bc2bcf72e tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:35.664764 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-a34b9f79-768e-4bd4-8c2c-ba5bc2bcf72e tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] [instance: a4852a58-51c4-4ca0-8c83-19fc8209fd21] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:35.671715 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a34b9f79-768e-4bd4-8c2c-ba5bc2bcf72e tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:35.672478 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a34b9f79-768e-4bd4-8c2c-ba5bc2bcf72e tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:35.673113 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a34b9f79-768e-4bd4-8c2c-ba5bc2bcf72e tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:35.673839 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a34b9f79-768e-4bd4-8c2c-ba5bc2bcf72e tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:35.674294 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a34b9f79-768e-4bd4-8c2c-ba5bc2bcf72e tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:35.674719 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a34b9f79-768e-4bd4-8c2c-ba5bc2bcf72e tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:35.922373 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-a34b9f79-768e-4bd4-8c2c-ba5bc2bcf72e tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a475c6e2b35f494aa8380aa1783e1779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c6f0c84e964383af6a4025d80fc93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:35.930570 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a34b9f79-768e-4bd4-8c2c-ba5bc2bcf72e tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] 10.222.0.60 "GET /compute/v2.1/servers/a4852a58-51c4-4ca0-8c83-19fc8209fd21" status: 200 len: 1318 microversion: 2.1 time: 0.270221 Sep 14 09:00:35.930885 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1361/2781] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:00:35 2022] GET /compute/v2.1/servers/a4852a58-51c4-4ca0-8c83-19fc8209fd21 => generated 1318 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:00:35.935993 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-81dbcc9a-f07f-4c4b-97b5-3622a7f25cc8 tempest-VolumesTestJSON-170942237 tempest-VolumesTestJSON-170942237-project] Calling method '.version_select at 0x7f7d4867ed30>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:36.048563 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-81dbcc9a-f07f-4c4b-97b5-3622a7f25cc8 tempest-VolumesTestJSON-170942237 tempest-VolumesTestJSON-170942237-project] 10.222.0.60 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.116238 Sep 14 09:00:36.054067 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1362/2782] 10.222.0.60 () {58 vars in 1149 bytes} [Wed Sep 14 09:00:35 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:00:36.061261 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-210156c3-ee14-47ab-b0c7-9da008a573ab tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:36.062140 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-210156c3-ee14-47ab-b0c7-9da008a573ab tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] [instance: 9ddb5908-22a9-41c8-909c-39cdf479bdd2] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:36.068620 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-210156c3-ee14-47ab-b0c7-9da008a573ab tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:36.069104 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-210156c3-ee14-47ab-b0c7-9da008a573ab tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:36.069728 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-210156c3-ee14-47ab-b0c7-9da008a573ab tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:36.070542 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-210156c3-ee14-47ab-b0c7-9da008a573ab tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:36.071021 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-210156c3-ee14-47ab-b0c7-9da008a573ab tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:36.071444 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-210156c3-ee14-47ab-b0c7-9da008a573ab tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:36.195188 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.objects.instance [None req-210156c3-ee14-47ab-b0c7-9da008a573ab tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lazy-loading 'services' on Instance uuid 9ddb5908-22a9-41c8-909c-39cdf479bdd2 {{(pid=128759) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:00:36.212268 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-210156c3-ee14-47ab-b0c7-9da008a573ab tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/9ddb5908-22a9-41c8-909c-39cdf479bdd2" status: 200 len: 1931 microversion: 2.75 time: 0.156876 Sep 14 09:00:36.212845 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1363/2783] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:00:36 2022] GET /compute/v2.1/servers/9ddb5908-22a9-41c8-909c-39cdf479bdd2 => generated 1931 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:00:36.217530 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d8989d33-f749-404c-bd9c-ad01a6cff8b1 tempest-VolumesTestJSON-170942237 tempest-VolumesTestJSON-170942237-project] Calling method '.version_select at 0x7f7d486e8dc0>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:36.249887 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-3ab8151d-5262-4f2a-94da-48569e3668ed tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Flavor limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:00:36.251612 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-3ab8151d-5262-4f2a-94da-48569e3668ed tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Image limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:00:36.252311 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-3ab8151d-5262-4f2a-94da-48569e3668ed tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Flavor pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:00:36.253235 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-3ab8151d-5262-4f2a-94da-48569e3668ed tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Image pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:00:36.254010 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-3ab8151d-5262-4f2a-94da-48569e3668ed tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:00:36.266893 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3ab8151d-5262-4f2a-94da-48569e3668ed tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:36.268162 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3ab8151d-5262-4f2a-94da-48569e3668ed tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:36.268869 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3ab8151d-5262-4f2a-94da-48569e3668ed tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:36.269829 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3ab8151d-5262-4f2a-94da-48569e3668ed tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:36.270585 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3ab8151d-5262-4f2a-94da-48569e3668ed tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:36.271255 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3ab8151d-5262-4f2a-94da-48569e3668ed tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:36.282153 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=100 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:00:36.295387 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-3ab8151d-5262-4f2a-94da-48569e3668ed tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Getting quotas for project 4d42bf4d573b4bf9a0d8c9e73260af7e. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:00:36.303097 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-3ab8151d-5262-4f2a-94da-48569e3668ed tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Getting quotas for user 47c95b28481b451bb03fb2c0240d0310 and project 4d42bf4d573b4bf9a0d8c9e73260af7e. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:00:36.310014 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d8989d33-f749-404c-bd9c-ad01a6cff8b1 tempest-VolumesTestJSON-170942237 tempest-VolumesTestJSON-170942237-project] 10.222.0.60 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.095902 Sep 14 09:00:36.310897 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1364/2784] 10.222.0.60 () {58 vars in 1134 bytes} [Wed Sep 14 09:00:36 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:00:36.321774 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-3ab8151d-5262-4f2a-94da-48569e3668ed tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Going to run 1 instances... {{(pid=128758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:00:36.323253 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-1c3d2195-2451-4ed5-8b05-6fcc6414ef00 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:36.324181 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-1c3d2195-2451-4ed5-8b05-6fcc6414ef00 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: 8f7f80e3-c2f5-4719-a484-29d6bd0d9e91] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:36.324647 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-3ab8151d-5262-4f2a-94da-48569e3668ed tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: e6001579-7f6f-4a6b-ada0-d301a142f96b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:00:36.332384 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1c3d2195-2451-4ed5-8b05-6fcc6414ef00 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:36.333113 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1c3d2195-2451-4ed5-8b05-6fcc6414ef00 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:36.333888 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1c3d2195-2451-4ed5-8b05-6fcc6414ef00 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:36.334756 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1c3d2195-2451-4ed5-8b05-6fcc6414ef00 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:36.335435 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1c3d2195-2451-4ed5-8b05-6fcc6414ef00 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:36.336404 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1c3d2195-2451-4ed5-8b05-6fcc6414ef00 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:36.382765 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-3ab8151d-5262-4f2a-94da-48569e3668ed tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.029856 Sep 14 09:00:36.384527 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1421/2785] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 09:00:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1032 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:00:36.394894 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-039cf9b4-9099-4d8e-8841-9998008773cb tempest-VolumesTestJSON-170942237 tempest-VolumesTestJSON-170942237-project] Calling method '.version_select at 0x7f7d44084af0>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:36.520156 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-039cf9b4-9099-4d8e-8841-9998008773cb tempest-VolumesTestJSON-170942237 tempest-VolumesTestJSON-170942237-project] 10.222.0.60 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.134300 Sep 14 09:00:36.520751 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1422/2786] 10.222.0.60 () {58 vars in 1167 bytes} [Wed Sep 14 09:00:36 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:00:36.526792 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-4590e2c9-c264-48e0-81ff-bce4a3a9c945 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:36.535695 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-4590e2c9-c264-48e0-81ff-bce4a3a9c945 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: e6001579-7f6f-4a6b-ada0-d301a142f96b] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:36.645429 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-4590e2c9-c264-48e0-81ff-bce4a3a9c945 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:36.656542 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-4590e2c9-c264-48e0-81ff-bce4a3a9c945 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/e6001579-7f6f-4a6b-ada0-d301a142f96b" status: 200 len: 1214 microversion: 2.1 time: 0.134729 Sep 14 09:00:36.673103 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1423/2787] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:00:36 2022] GET /compute/v2.1/servers/e6001579-7f6f-4a6b-ada0-d301a142f96b => generated 1214 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:00:36.681677 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-e4063ede-c1f1-44b7-a6a6-71f30d18b10e tempest-VolumesTestJSON-170942237 tempest-VolumesTestJSON-170942237-project] Calling method '.version_select at 0x7f7d443fe940>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:36.771265 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-1c3d2195-2451-4ed5-8b05-6fcc6414ef00 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9d40e54481461cba53fedb9a6abdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed2295a58f8451993a57ce0a6f9ba29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:36.782293 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-1c3d2195-2451-4ed5-8b05-6fcc6414ef00 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7f80e3-c2f5-4719-a484-29d6bd0d9e91" status: 200 len: 1517 microversion: 2.1 time: 0.470230 Sep 14 09:00:36.788810 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1365/2788] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:00:36 2022] GET /compute/v2.1/servers/8f7f80e3-c2f5-4719-a484-29d6bd0d9e91 => generated 1517 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:00:36.832411 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-e4063ede-c1f1-44b7-a6a6-71f30d18b10e tempest-VolumesTestJSON-170942237 tempest-VolumesTestJSON-170942237-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.157337 Sep 14 09:00:36.833605 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1424/2789] 10.222.0.60 () {58 vars in 1170 bytes} [Wed Sep 14 09:00:36 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:00:36.848274 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-6eaeace5-4750-490f-9adc-37262640c2a3 tempest-VolumesTestJSON-170942237 tempest-VolumesTestJSON-170942237-project] Calling method '.version_select at 0x7f7d4867e5e0>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:36.952943 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-3dbcf036-e495-4ffb-a8c8-ff521f7a6c97 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:36.953857 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-3dbcf036-e495-4ffb-a8c8-ff521f7a6c97 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] [instance: a4852a58-51c4-4ca0-8c83-19fc8209fd21] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:36.955607 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-6eaeace5-4750-490f-9adc-37262640c2a3 tempest-VolumesTestJSON-170942237 tempest-VolumesTestJSON-170942237-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.111174 Sep 14 09:00:36.956172 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1366/2790] 10.222.0.60 () {58 vars in 1155 bytes} [Wed Sep 14 09:00:36 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:00:36.963596 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3dbcf036-e495-4ffb-a8c8-ff521f7a6c97 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:36.964325 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3dbcf036-e495-4ffb-a8c8-ff521f7a6c97 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:36.965020 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3dbcf036-e495-4ffb-a8c8-ff521f7a6c97 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:36.967024 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3dbcf036-e495-4ffb-a8c8-ff521f7a6c97 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:36.967651 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3dbcf036-e495-4ffb-a8c8-ff521f7a6c97 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:36.968524 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3dbcf036-e495-4ffb-a8c8-ff521f7a6c97 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:36.972310 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c3a47a93-398b-49e8-89e5-0c9e8974aa82 tempest-VolumesTestJSON-170942237 tempest-VolumesTestJSON-170942237-project] Calling method '.version_select at 0x7f7d4863a430>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:37.084480 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-c3a47a93-398b-49e8-89e5-0c9e8974aa82 tempest-VolumesTestJSON-170942237 tempest-VolumesTestJSON-170942237-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.115882 Sep 14 09:00:37.085060 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1367/2791] 10.222.0.60 () {58 vars in 1188 bytes} [Wed Sep 14 09:00:36 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:00:37.101115 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-2df0bdb4-c944-42f2-a648-c77fce29ccb2 tempest-VolumesTestJSON-170942237 tempest-VolumesTestJSON-170942237-project] Calling method '.version_select at 0x7f7d4863aaf0>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:37.197543 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-2df0bdb4-c944-42f2-a648-c77fce29ccb2 tempest-VolumesTestJSON-170942237 tempest-VolumesTestJSON-170942237-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.102036 Sep 14 09:00:37.198168 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1368/2792] 10.222.0.60 () {58 vars in 1155 bytes} [Wed Sep 14 09:00:37 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:00:37.244733 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-420158cc-d414-4e32-9494-5161a160403a tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:37.245625 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-420158cc-d414-4e32-9494-5161a160403a tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] [instance: 9ddb5908-22a9-41c8-909c-39cdf479bdd2] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:37.260229 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-420158cc-d414-4e32-9494-5161a160403a tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:37.261364 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-420158cc-d414-4e32-9494-5161a160403a tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:37.261881 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-420158cc-d414-4e32-9494-5161a160403a tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:37.263577 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-420158cc-d414-4e32-9494-5161a160403a tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:37.268080 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-420158cc-d414-4e32-9494-5161a160403a tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:37.268555 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-420158cc-d414-4e32-9494-5161a160403a tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:37.359582 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-3dbcf036-e495-4ffb-a8c8-ff521f7a6c97 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a475c6e2b35f494aa8380aa1783e1779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c6f0c84e964383af6a4025d80fc93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:37.381024 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-3dbcf036-e495-4ffb-a8c8-ff521f7a6c97 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] 10.222.0.60 "GET /compute/v2.1/servers/a4852a58-51c4-4ca0-8c83-19fc8209fd21" status: 200 len: 1318 microversion: 2.1 time: 0.431778 Sep 14 09:00:37.387790 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1425/2793] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:00:36 2022] GET /compute/v2.1/servers/a4852a58-51c4-4ca0-8c83-19fc8209fd21 => generated 1318 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:00:37.441198 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.objects.instance [None req-420158cc-d414-4e32-9494-5161a160403a tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lazy-loading 'services' on Instance uuid 9ddb5908-22a9-41c8-909c-39cdf479bdd2 {{(pid=128759) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:00:37.490193 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-420158cc-d414-4e32-9494-5161a160403a tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/9ddb5908-22a9-41c8-909c-39cdf479bdd2" status: 200 len: 1931 microversion: 2.75 time: 0.251553 Sep 14 09:00:37.491058 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1369/2794] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:00:37 2022] GET /compute/v2.1/servers/9ddb5908-22a9-41c8-909c-39cdf479bdd2 => generated 1931 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 09:00:37.679786 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-e4ebaf77-c858-4684-8d80-d26c53f7c553 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:37.680607 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-e4ebaf77-c858-4684-8d80-d26c53f7c553 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: e6001579-7f6f-4a6b-ada0-d301a142f96b] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:37.696252 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e4ebaf77-c858-4684-8d80-d26c53f7c553 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:37.696753 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e4ebaf77-c858-4684-8d80-d26c53f7c553 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:37.697193 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e4ebaf77-c858-4684-8d80-d26c53f7c553 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:37.704068 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e4ebaf77-c858-4684-8d80-d26c53f7c553 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:37.708958 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e4ebaf77-c858-4684-8d80-d26c53f7c553 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:37.709420 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e4ebaf77-c858-4684-8d80-d26c53f7c553 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:37.813261 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-7c466fa4-0c64-41bc-85ab-f3b88c0acc32 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:37.815520 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-7c466fa4-0c64-41bc-85ab-f3b88c0acc32 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: 8f7f80e3-c2f5-4719-a484-29d6bd0d9e91] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:37.828244 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7c466fa4-0c64-41bc-85ab-f3b88c0acc32 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:37.829028 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7c466fa4-0c64-41bc-85ab-f3b88c0acc32 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:37.829920 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7c466fa4-0c64-41bc-85ab-f3b88c0acc32 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:37.830860 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7c466fa4-0c64-41bc-85ab-f3b88c0acc32 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:37.831574 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7c466fa4-0c64-41bc-85ab-f3b88c0acc32 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:37.835201 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7c466fa4-0c64-41bc-85ab-f3b88c0acc32 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:37.893481 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-e4ebaf77-c858-4684-8d80-d26c53f7c553 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:37.910566 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-e4ebaf77-c858-4684-8d80-d26c53f7c553 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/e6001579-7f6f-4a6b-ada0-d301a142f96b" status: 200 len: 1266 microversion: 2.1 time: 0.234586 Sep 14 09:00:37.911602 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1426/2795] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:00:37 2022] GET /compute/v2.1/servers/e6001579-7f6f-4a6b-ada0-d301a142f96b => generated 1266 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:00:38.196372 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-7c466fa4-0c64-41bc-85ab-f3b88c0acc32 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9d40e54481461cba53fedb9a6abdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed2295a58f8451993a57ce0a6f9ba29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:38.207332 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-7c466fa4-0c64-41bc-85ab-f3b88c0acc32 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7f80e3-c2f5-4719-a484-29d6bd0d9e91" status: 200 len: 1517 microversion: 2.1 time: 0.401160 Sep 14 09:00:38.208543 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1370/2796] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:00:37 2022] GET /compute/v2.1/servers/8f7f80e3-c2f5-4719-a484-29d6bd0d9e91 => generated 1517 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:00:38.404438 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-3bc973a4-2081-4f9e-a350-51c70c9d5131 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:38.405725 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-3bc973a4-2081-4f9e-a350-51c70c9d5131 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] [instance: a4852a58-51c4-4ca0-8c83-19fc8209fd21] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:38.419906 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3bc973a4-2081-4f9e-a350-51c70c9d5131 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:38.422272 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3bc973a4-2081-4f9e-a350-51c70c9d5131 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:38.422688 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3bc973a4-2081-4f9e-a350-51c70c9d5131 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:38.427393 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3bc973a4-2081-4f9e-a350-51c70c9d5131 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:38.427899 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3bc973a4-2081-4f9e-a350-51c70c9d5131 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:38.428344 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3bc973a4-2081-4f9e-a350-51c70c9d5131 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:38.518469 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ba52bf63-3d05-4f53-b85b-0114028b235e tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:38.518992 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-ba52bf63-3d05-4f53-b85b-0114028b235e tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] [instance: 9ddb5908-22a9-41c8-909c-39cdf479bdd2] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:38.526971 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ba52bf63-3d05-4f53-b85b-0114028b235e tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:38.527874 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ba52bf63-3d05-4f53-b85b-0114028b235e tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:38.528596 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ba52bf63-3d05-4f53-b85b-0114028b235e tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:38.529580 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ba52bf63-3d05-4f53-b85b-0114028b235e tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:38.530306 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ba52bf63-3d05-4f53-b85b-0114028b235e tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:38.531015 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ba52bf63-3d05-4f53-b85b-0114028b235e tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:38.642514 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.objects.instance [None req-ba52bf63-3d05-4f53-b85b-0114028b235e tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lazy-loading 'services' on Instance uuid 9ddb5908-22a9-41c8-909c-39cdf479bdd2 {{(pid=128759) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:00:38.674687 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-ba52bf63-3d05-4f53-b85b-0114028b235e tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/9ddb5908-22a9-41c8-909c-39cdf479bdd2" status: 200 len: 1931 microversion: 2.75 time: 0.160699 Sep 14 09:00:38.676728 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1371/2797] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:00:38 2022] GET /compute/v2.1/servers/9ddb5908-22a9-41c8-909c-39cdf479bdd2 => generated 1931 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 09:00:38.707134 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-3bc973a4-2081-4f9e-a350-51c70c9d5131 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a475c6e2b35f494aa8380aa1783e1779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c6f0c84e964383af6a4025d80fc93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:38.717287 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-3bc973a4-2081-4f9e-a350-51c70c9d5131 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] 10.222.0.60 "GET /compute/v2.1/servers/a4852a58-51c4-4ca0-8c83-19fc8209fd21" status: 200 len: 1318 microversion: 2.1 time: 0.317426 Sep 14 09:00:38.718816 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1427/2798] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:00:38 2022] GET /compute/v2.1/servers/a4852a58-51c4-4ca0-8c83-19fc8209fd21 => generated 1318 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:00:38.938728 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c40d94d4-3cf8-4c7b-9de7-276716f304aa tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:38.939742 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-c40d94d4-3cf8-4c7b-9de7-276716f304aa tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: e6001579-7f6f-4a6b-ada0-d301a142f96b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:38.948292 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c40d94d4-3cf8-4c7b-9de7-276716f304aa tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:38.948292 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c40d94d4-3cf8-4c7b-9de7-276716f304aa tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:38.948739 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c40d94d4-3cf8-4c7b-9de7-276716f304aa tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:38.949523 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c40d94d4-3cf8-4c7b-9de7-276716f304aa tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:38.949978 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c40d94d4-3cf8-4c7b-9de7-276716f304aa tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:38.950713 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c40d94d4-3cf8-4c7b-9de7-276716f304aa tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:38.968489 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=100 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:00:39.184113 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-c40d94d4-3cf8-4c7b-9de7-276716f304aa tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:39.193025 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-c40d94d4-3cf8-4c7b-9de7-276716f304aa tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/e6001579-7f6f-4a6b-ada0-d301a142f96b" status: 200 len: 1314 microversion: 2.1 time: 0.259619 Sep 14 09:00:39.206962 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1372/2799] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:00:38 2022] GET /compute/v2.1/servers/e6001579-7f6f-4a6b-ada0-d301a142f96b => generated 1314 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:00:39.231293 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b26ffdcd-c7da-401e-a3c4-ee083fd8891f tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:39.232471 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-b26ffdcd-c7da-401e-a3c4-ee083fd8891f tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: 8f7f80e3-c2f5-4719-a484-29d6bd0d9e91] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:39.238660 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b26ffdcd-c7da-401e-a3c4-ee083fd8891f tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:39.239216 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b26ffdcd-c7da-401e-a3c4-ee083fd8891f tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:39.239772 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b26ffdcd-c7da-401e-a3c4-ee083fd8891f tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:39.240502 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b26ffdcd-c7da-401e-a3c4-ee083fd8891f tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:39.240964 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b26ffdcd-c7da-401e-a3c4-ee083fd8891f tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:39.241408 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b26ffdcd-c7da-401e-a3c4-ee083fd8891f tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:39.448887 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-b26ffdcd-c7da-401e-a3c4-ee083fd8891f tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9d40e54481461cba53fedb9a6abdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed2295a58f8451993a57ce0a6f9ba29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:39.462346 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-b26ffdcd-c7da-401e-a3c4-ee083fd8891f tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7f80e3-c2f5-4719-a484-29d6bd0d9e91" status: 200 len: 1517 microversion: 2.1 time: 0.234497 Sep 14 09:00:39.467893 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1428/2800] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:00:39 2022] GET /compute/v2.1/servers/8f7f80e3-c2f5-4719-a484-29d6bd0d9e91 => generated 1517 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:00:39.707148 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a6dac4d6-ba1d-4948-8d8e-e148d83cb3aa tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:39.707835 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-a6dac4d6-ba1d-4948-8d8e-e148d83cb3aa tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] [instance: 9ddb5908-22a9-41c8-909c-39cdf479bdd2] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:39.718776 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a6dac4d6-ba1d-4948-8d8e-e148d83cb3aa tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:39.719313 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a6dac4d6-ba1d-4948-8d8e-e148d83cb3aa tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:39.720012 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a6dac4d6-ba1d-4948-8d8e-e148d83cb3aa tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:39.720906 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a6dac4d6-ba1d-4948-8d8e-e148d83cb3aa tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:39.721522 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a6dac4d6-ba1d-4948-8d8e-e148d83cb3aa tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:39.722356 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a6dac4d6-ba1d-4948-8d8e-e148d83cb3aa tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:39.742732 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-9bb2c90d-6051-4c6e-984c-e8a8a3678e1f tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:39.743567 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-9bb2c90d-6051-4c6e-984c-e8a8a3678e1f tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] [instance: a4852a58-51c4-4ca0-8c83-19fc8209fd21] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:39.752672 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9bb2c90d-6051-4c6e-984c-e8a8a3678e1f tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:39.754609 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9bb2c90d-6051-4c6e-984c-e8a8a3678e1f tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:39.760672 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9bb2c90d-6051-4c6e-984c-e8a8a3678e1f tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:39.763217 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9bb2c90d-6051-4c6e-984c-e8a8a3678e1f tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:39.763217 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9bb2c90d-6051-4c6e-984c-e8a8a3678e1f tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:39.770448 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9bb2c90d-6051-4c6e-984c-e8a8a3678e1f tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:39.873947 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.objects.instance [None req-a6dac4d6-ba1d-4948-8d8e-e148d83cb3aa tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lazy-loading 'services' on Instance uuid 9ddb5908-22a9-41c8-909c-39cdf479bdd2 {{(pid=128759) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:00:39.917997 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a6dac4d6-ba1d-4948-8d8e-e148d83cb3aa tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/9ddb5908-22a9-41c8-909c-39cdf479bdd2" status: 200 len: 1931 microversion: 2.75 time: 0.216143 Sep 14 09:00:39.918621 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1373/2801] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:00:39 2022] GET /compute/v2.1/servers/9ddb5908-22a9-41c8-909c-39cdf479bdd2 => generated 1931 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:00:39.954482 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-adc33842-1f98-4ee5-ac77-50d92496ec32 req-7b895341-b7ac-43a2-bb03-0ed09ee7f595 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6001579-7f6f-4a6b-ada0-d301a142f96b", "tag": "2548545f-5fc0-4e22-abed-f9b40b4396b9"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:00:39.971196 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-adc33842-1f98-4ee5-ac77-50d92496ec32 req-7b895341-b7ac-43a2-bb03-0ed09ee7f595 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:39.971680 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-adc33842-1f98-4ee5-ac77-50d92496ec32 req-7b895341-b7ac-43a2-bb03-0ed09ee7f595 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:39.979592 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-adc33842-1f98-4ee5-ac77-50d92496ec32 req-7b895341-b7ac-43a2-bb03-0ed09ee7f595 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:39.996944 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-adc33842-1f98-4ee5-ac77-50d92496ec32 req-7b895341-b7ac-43a2-bb03-0ed09ee7f595 service nova] Creating event network-changed:2548545f-5fc0-4e22-abed-f9b40b4396b9 for instance e6001579-7f6f-4a6b-ada0-d301a142f96b on n-h1-836830-18 Sep 14 09:00:40.016837 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-adc33842-1f98-4ee5-ac77-50d92496ec32 req-7b895341-b7ac-43a2-bb03-0ed09ee7f595 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065953 Sep 14 09:00:40.018010 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1374/2802] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:00:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:00:40.033772 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-d8d8a729-85eb-442c-a24b-3e279222d0ae req-07152a8d-d539-471f-b6ae-3d46a2d67491 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4852a58-51c4-4ca0-8c83-19fc8209fd21", "name": "network-vif-plugged", "status": "completed", "tag": "003dc8e7-2302-41ad-87e7-680ccac43c8f"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:00:40.053583 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-d8d8a729-85eb-442c-a24b-3e279222d0ae req-07152a8d-d539-471f-b6ae-3d46a2d67491 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:40.054316 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-d8d8a729-85eb-442c-a24b-3e279222d0ae req-07152a8d-d539-471f-b6ae-3d46a2d67491 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:40.055103 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-d8d8a729-85eb-442c-a24b-3e279222d0ae req-07152a8d-d539-471f-b6ae-3d46a2d67491 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:40.079043 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-d8d8a729-85eb-442c-a24b-3e279222d0ae req-07152a8d-d539-471f-b6ae-3d46a2d67491 service nova] Creating event network-vif-plugged:003dc8e7-2302-41ad-87e7-680ccac43c8f for instance a4852a58-51c4-4ca0-8c83-19fc8209fd21 on n-h2-836830-18 Sep 14 09:00:40.089368 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-d8d8a729-85eb-442c-a24b-3e279222d0ae req-07152a8d-d539-471f-b6ae-3d46a2d67491 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058239 Sep 14 09:00:40.090120 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1375/2803] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:00:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:00:40.221054 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-033a2938-dfbc-4346-b59b-ee42cb494592 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:40.222787 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-033a2938-dfbc-4346-b59b-ee42cb494592 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: e6001579-7f6f-4a6b-ada0-d301a142f96b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:40.234846 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-033a2938-dfbc-4346-b59b-ee42cb494592 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:40.235630 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-033a2938-dfbc-4346-b59b-ee42cb494592 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:40.236298 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-033a2938-dfbc-4346-b59b-ee42cb494592 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:40.237214 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-033a2938-dfbc-4346-b59b-ee42cb494592 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:40.237898 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-033a2938-dfbc-4346-b59b-ee42cb494592 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:40.238547 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-033a2938-dfbc-4346-b59b-ee42cb494592 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:40.286200 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-9bb2c90d-6051-4c6e-984c-e8a8a3678e1f tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a475c6e2b35f494aa8380aa1783e1779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c6f0c84e964383af6a4025d80fc93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:40.303726 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-9bb2c90d-6051-4c6e-984c-e8a8a3678e1f tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] 10.222.0.60 "GET /compute/v2.1/servers/a4852a58-51c4-4ca0-8c83-19fc8209fd21" status: 200 len: 1318 microversion: 2.1 time: 0.562109 Sep 14 09:00:40.305506 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1429/2804] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:00:39 2022] GET /compute/v2.1/servers/a4852a58-51c4-4ca0-8c83-19fc8209fd21 => generated 1318 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:00:40.488488 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-87daeb0c-d0d1-49fd-a8bf-652a6e6ba2cb tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:40.489931 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-87daeb0c-d0d1-49fd-a8bf-652a6e6ba2cb tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: 8f7f80e3-c2f5-4719-a484-29d6bd0d9e91] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:40.496635 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-87daeb0c-d0d1-49fd-a8bf-652a6e6ba2cb tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:40.497448 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-87daeb0c-d0d1-49fd-a8bf-652a6e6ba2cb tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:40.498077 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-87daeb0c-d0d1-49fd-a8bf-652a6e6ba2cb tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:40.499072 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-87daeb0c-d0d1-49fd-a8bf-652a6e6ba2cb tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:40.499691 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-87daeb0c-d0d1-49fd-a8bf-652a6e6ba2cb tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:40.500280 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-87daeb0c-d0d1-49fd-a8bf-652a6e6ba2cb tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:40.655782 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-033a2938-dfbc-4346-b59b-ee42cb494592 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:40.670780 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-033a2938-dfbc-4346-b59b-ee42cb494592 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/e6001579-7f6f-4a6b-ada0-d301a142f96b" status: 200 len: 1314 microversion: 2.1 time: 0.456688 Sep 14 09:00:40.671618 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1376/2805] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:00:40 2022] GET /compute/v2.1/servers/e6001579-7f6f-4a6b-ada0-d301a142f96b => generated 1314 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:00:40.768130 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-87daeb0c-d0d1-49fd-a8bf-652a6e6ba2cb tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9d40e54481461cba53fedb9a6abdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed2295a58f8451993a57ce0a6f9ba29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:40.788300 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-87daeb0c-d0d1-49fd-a8bf-652a6e6ba2cb tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7f80e3-c2f5-4719-a484-29d6bd0d9e91" status: 200 len: 1517 microversion: 2.1 time: 0.303527 Sep 14 09:00:40.790266 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1430/2806] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:00:40 2022] GET /compute/v2.1/servers/8f7f80e3-c2f5-4719-a484-29d6bd0d9e91 => generated 1517 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:00:40.949803 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-1ef96d67-061b-4a07-9d84-1f1e7da45538 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:40.951251 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-1ef96d67-061b-4a07-9d84-1f1e7da45538 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] [instance: 9ddb5908-22a9-41c8-909c-39cdf479bdd2] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:40.961993 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1ef96d67-061b-4a07-9d84-1f1e7da45538 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:40.963617 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1ef96d67-061b-4a07-9d84-1f1e7da45538 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:40.964289 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1ef96d67-061b-4a07-9d84-1f1e7da45538 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:40.965168 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1ef96d67-061b-4a07-9d84-1f1e7da45538 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:40.965827 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1ef96d67-061b-4a07-9d84-1f1e7da45538 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:40.966795 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1ef96d67-061b-4a07-9d84-1f1e7da45538 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:41.045038 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.objects.instance [None req-1ef96d67-061b-4a07-9d84-1f1e7da45538 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lazy-loading 'services' on Instance uuid 9ddb5908-22a9-41c8-909c-39cdf479bdd2 {{(pid=128759) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:00:41.063007 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-1ef96d67-061b-4a07-9d84-1f1e7da45538 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/9ddb5908-22a9-41c8-909c-39cdf479bdd2" status: 200 len: 1931 microversion: 2.75 time: 0.117061 Sep 14 09:00:41.063606 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1377/2807] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:00:40 2022] GET /compute/v2.1/servers/9ddb5908-22a9-41c8-909c-39cdf479bdd2 => generated 1931 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:00:41.328752 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-6f1af0f3-af98-4617-9891-18a487decf56 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:41.329289 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-6f1af0f3-af98-4617-9891-18a487decf56 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] [instance: a4852a58-51c4-4ca0-8c83-19fc8209fd21] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:41.335466 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6f1af0f3-af98-4617-9891-18a487decf56 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:41.335951 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6f1af0f3-af98-4617-9891-18a487decf56 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:41.336388 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6f1af0f3-af98-4617-9891-18a487decf56 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:41.337087 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6f1af0f3-af98-4617-9891-18a487decf56 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:41.337544 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6f1af0f3-af98-4617-9891-18a487decf56 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:41.337974 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6f1af0f3-af98-4617-9891-18a487decf56 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:41.695245 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-6e752da8-9419-4c87-983e-35e339d8245a tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:41.696274 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-6e752da8-9419-4c87-983e-35e339d8245a tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: e6001579-7f6f-4a6b-ada0-d301a142f96b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:41.702534 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6e752da8-9419-4c87-983e-35e339d8245a tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:41.703268 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6e752da8-9419-4c87-983e-35e339d8245a tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:41.704090 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6e752da8-9419-4c87-983e-35e339d8245a tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:41.705258 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6e752da8-9419-4c87-983e-35e339d8245a tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:41.706054 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6e752da8-9419-4c87-983e-35e339d8245a tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:41.706585 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6e752da8-9419-4c87-983e-35e339d8245a tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:41.791734 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-6f1af0f3-af98-4617-9891-18a487decf56 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a475c6e2b35f494aa8380aa1783e1779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c6f0c84e964383af6a4025d80fc93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:41.808667 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-6f1af0f3-af98-4617-9891-18a487decf56 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] 10.222.0.60 "GET /compute/v2.1/servers/a4852a58-51c4-4ca0-8c83-19fc8209fd21" status: 200 len: 1318 microversion: 2.1 time: 0.478715 Sep 14 09:00:41.809584 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1431/2808] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:00:41 2022] GET /compute/v2.1/servers/a4852a58-51c4-4ca0-8c83-19fc8209fd21 => generated 1318 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:00:41.821645 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-010c9849-b3cd-40cf-84ed-e6809e275bf5 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:41.821645 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-010c9849-b3cd-40cf-84ed-e6809e275bf5 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: 8f7f80e3-c2f5-4719-a484-29d6bd0d9e91] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:41.827228 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-010c9849-b3cd-40cf-84ed-e6809e275bf5 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:41.827754 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-010c9849-b3cd-40cf-84ed-e6809e275bf5 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:41.828197 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-010c9849-b3cd-40cf-84ed-e6809e275bf5 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:41.829030 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-010c9849-b3cd-40cf-84ed-e6809e275bf5 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:41.829496 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-010c9849-b3cd-40cf-84ed-e6809e275bf5 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:41.829921 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-010c9849-b3cd-40cf-84ed-e6809e275bf5 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:41.874747 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-6e752da8-9419-4c87-983e-35e339d8245a tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:41.882616 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-6e752da8-9419-4c87-983e-35e339d8245a tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/e6001579-7f6f-4a6b-ada0-d301a142f96b" status: 200 len: 1314 microversion: 2.1 time: 0.191804 Sep 14 09:00:41.883451 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1378/2809] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:00:41 2022] GET /compute/v2.1/servers/e6001579-7f6f-4a6b-ada0-d301a142f96b => generated 1314 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:00:41.976774 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-010c9849-b3cd-40cf-84ed-e6809e275bf5 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9d40e54481461cba53fedb9a6abdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed2295a58f8451993a57ce0a6f9ba29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:41.989443 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-010c9849-b3cd-40cf-84ed-e6809e275bf5 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7f80e3-c2f5-4719-a484-29d6bd0d9e91" status: 200 len: 1517 microversion: 2.1 time: 0.175785 Sep 14 09:00:41.990045 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1432/2810] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:00:41 2022] GET /compute/v2.1/servers/8f7f80e3-c2f5-4719-a484-29d6bd0d9e91 => generated 1517 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:00:42.091243 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-869ee1ff-85d8-4e6b-8b33-98bbf9b692be tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:42.092012 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-869ee1ff-85d8-4e6b-8b33-98bbf9b692be tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] [instance: 9ddb5908-22a9-41c8-909c-39cdf479bdd2] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:42.099283 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-869ee1ff-85d8-4e6b-8b33-98bbf9b692be tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:42.099772 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-869ee1ff-85d8-4e6b-8b33-98bbf9b692be tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:42.100208 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-869ee1ff-85d8-4e6b-8b33-98bbf9b692be tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:42.100905 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-869ee1ff-85d8-4e6b-8b33-98bbf9b692be tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:42.101355 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-869ee1ff-85d8-4e6b-8b33-98bbf9b692be tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:42.101773 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-869ee1ff-85d8-4e6b-8b33-98bbf9b692be tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:42.114116 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-16c99bf9-3395-4f23-9ac1-c16bc02d5797 req-8b5492b4-82d6-4d1b-9a7e-4ee3cb72b385 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebf9bfa9-e941-4d23-8f6c-9867102feff2", "name": "network-vif-plugged", "status": "completed", "tag": "a16e0c89-9089-483d-ae3b-f83433826e96"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:00:42.124614 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-16c99bf9-3395-4f23-9ac1-c16bc02d5797 req-8b5492b4-82d6-4d1b-9a7e-4ee3cb72b385 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:42.125152 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-16c99bf9-3395-4f23-9ac1-c16bc02d5797 req-8b5492b4-82d6-4d1b-9a7e-4ee3cb72b385 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:42.125715 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-16c99bf9-3395-4f23-9ac1-c16bc02d5797 req-8b5492b4-82d6-4d1b-9a7e-4ee3cb72b385 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:42.137243 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-16c99bf9-3395-4f23-9ac1-c16bc02d5797 req-8b5492b4-82d6-4d1b-9a7e-4ee3cb72b385 service nova] Creating event network-vif-plugged:a16e0c89-9089-483d-ae3b-f83433826e96 for instance ebf9bfa9-e941-4d23-8f6c-9867102feff2 on n-h1-836830-18 Sep 14 09:00:42.143308 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-16c99bf9-3395-4f23-9ac1-c16bc02d5797 req-8b5492b4-82d6-4d1b-9a7e-4ee3cb72b385 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033100 Sep 14 09:00:42.144229 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1433/2811] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:00:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:00:42.175032 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.objects.instance [None req-869ee1ff-85d8-4e6b-8b33-98bbf9b692be tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lazy-loading 'services' on Instance uuid 9ddb5908-22a9-41c8-909c-39cdf479bdd2 {{(pid=128759) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:00:42.193117 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-869ee1ff-85d8-4e6b-8b33-98bbf9b692be tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/9ddb5908-22a9-41c8-909c-39cdf479bdd2" status: 200 len: 1931 microversion: 2.75 time: 0.105633 Sep 14 09:00:42.193683 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1379/2812] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:00:42 2022] GET /compute/v2.1/servers/9ddb5908-22a9-41c8-909c-39cdf479bdd2 => generated 1931 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:00:42.833276 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-388e8cc4-dd99-45f9-b87a-4f6256738cc6 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:42.834081 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-388e8cc4-dd99-45f9-b87a-4f6256738cc6 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] [instance: a4852a58-51c4-4ca0-8c83-19fc8209fd21] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:42.842196 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-388e8cc4-dd99-45f9-b87a-4f6256738cc6 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:42.842717 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-388e8cc4-dd99-45f9-b87a-4f6256738cc6 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:42.843183 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-388e8cc4-dd99-45f9-b87a-4f6256738cc6 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:42.843911 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-388e8cc4-dd99-45f9-b87a-4f6256738cc6 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:42.844387 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-388e8cc4-dd99-45f9-b87a-4f6256738cc6 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:42.844796 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-388e8cc4-dd99-45f9-b87a-4f6256738cc6 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:42.905896 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-70a31cbd-b805-4303-9ee4-a8596a170d74 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:42.906715 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-70a31cbd-b805-4303-9ee4-a8596a170d74 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: e6001579-7f6f-4a6b-ada0-d301a142f96b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:42.914319 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-70a31cbd-b805-4303-9ee4-a8596a170d74 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:42.915113 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-70a31cbd-b805-4303-9ee4-a8596a170d74 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:42.915749 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-70a31cbd-b805-4303-9ee4-a8596a170d74 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:42.916645 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-70a31cbd-b805-4303-9ee4-a8596a170d74 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:42.917110 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-70a31cbd-b805-4303-9ee4-a8596a170d74 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:42.917532 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-70a31cbd-b805-4303-9ee4-a8596a170d74 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:43.033903 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-388e8cc4-dd99-45f9-b87a-4f6256738cc6 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a475c6e2b35f494aa8380aa1783e1779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c6f0c84e964383af6a4025d80fc93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:43.054320 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-388e8cc4-dd99-45f9-b87a-4f6256738cc6 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] 10.222.0.60 "GET /compute/v2.1/servers/a4852a58-51c4-4ca0-8c83-19fc8209fd21" status: 200 len: 1467 microversion: 2.1 time: 0.225407 Sep 14 09:00:43.070350 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1434/2813] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:00:42 2022] GET /compute/v2.1/servers/a4852a58-51c4-4ca0-8c83-19fc8209fd21 => generated 1467 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:00:43.079189 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-9306ad69-cdc7-4f59-b2ed-3a28995117ee tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:43.080051 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-9306ad69-cdc7-4f59-b2ed-3a28995117ee tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: 8f7f80e3-c2f5-4719-a484-29d6bd0d9e91] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:43.086553 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9306ad69-cdc7-4f59-b2ed-3a28995117ee tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:43.087283 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9306ad69-cdc7-4f59-b2ed-3a28995117ee tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:43.087913 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9306ad69-cdc7-4f59-b2ed-3a28995117ee tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:43.089012 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9306ad69-cdc7-4f59-b2ed-3a28995117ee tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:43.089633 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9306ad69-cdc7-4f59-b2ed-3a28995117ee tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:43.090233 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9306ad69-cdc7-4f59-b2ed-3a28995117ee tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:43.132533 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-70a31cbd-b805-4303-9ee4-a8596a170d74 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:43.162256 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-70a31cbd-b805-4303-9ee4-a8596a170d74 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/e6001579-7f6f-4a6b-ada0-d301a142f96b" status: 200 len: 1314 microversion: 2.1 time: 0.260806 Sep 14 09:00:43.164592 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1380/2814] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:00:42 2022] GET /compute/v2.1/servers/e6001579-7f6f-4a6b-ada0-d301a142f96b => generated 1314 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:00:43.174156 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-926693dd-6d35-4ebe-91cd-6d1d24d7a997 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:43.182107 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-926693dd-6d35-4ebe-91cd-6d1d24d7a997 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] [instance: ebf9bfa9-e941-4d23-8f6c-9867102feff2] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:43.193536 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-926693dd-6d35-4ebe-91cd-6d1d24d7a997 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:43.193713 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-926693dd-6d35-4ebe-91cd-6d1d24d7a997 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:43.197366 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-926693dd-6d35-4ebe-91cd-6d1d24d7a997 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:43.198199 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-926693dd-6d35-4ebe-91cd-6d1d24d7a997 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:43.201108 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-926693dd-6d35-4ebe-91cd-6d1d24d7a997 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:43.201600 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-926693dd-6d35-4ebe-91cd-6d1d24d7a997 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:43.263808 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-9306ad69-cdc7-4f59-b2ed-3a28995117ee tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9d40e54481461cba53fedb9a6abdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed2295a58f8451993a57ce0a6f9ba29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:43.271939 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-9306ad69-cdc7-4f59-b2ed-3a28995117ee tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7f80e3-c2f5-4719-a484-29d6bd0d9e91" status: 200 len: 1517 microversion: 2.1 time: 0.200171 Sep 14 09:00:43.272531 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1435/2815] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:00:43 2022] GET /compute/v2.1/servers/8f7f80e3-c2f5-4719-a484-29d6bd0d9e91 => generated 1517 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:00:43.280122 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-4d5d8545-d241-4cd9-915d-4b1f0cb37041 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:43.280736 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-4d5d8545-d241-4cd9-915d-4b1f0cb37041 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] [instance: 9ddb5908-22a9-41c8-909c-39cdf479bdd2] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:43.286882 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4d5d8545-d241-4cd9-915d-4b1f0cb37041 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:43.289045 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4d5d8545-d241-4cd9-915d-4b1f0cb37041 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:43.289511 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4d5d8545-d241-4cd9-915d-4b1f0cb37041 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:43.290235 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4d5d8545-d241-4cd9-915d-4b1f0cb37041 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:43.291019 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4d5d8545-d241-4cd9-915d-4b1f0cb37041 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:43.295462 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4d5d8545-d241-4cd9-915d-4b1f0cb37041 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:43.404561 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.objects.instance [None req-4d5d8545-d241-4cd9-915d-4b1f0cb37041 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lazy-loading 'services' on Instance uuid 9ddb5908-22a9-41c8-909c-39cdf479bdd2 {{(pid=128758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:00:43.426910 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-4d5d8545-d241-4cd9-915d-4b1f0cb37041 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/9ddb5908-22a9-41c8-909c-39cdf479bdd2" status: 200 len: 1931 microversion: 2.75 time: 0.150620 Sep 14 09:00:43.437162 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-926693dd-6d35-4ebe-91cd-6d1d24d7a997 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a475c6e2b35f494aa8380aa1783e1779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c6f0c84e964383af6a4025d80fc93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:43.443826 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1436/2816] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:00:43 2022] GET /compute/v2.1/servers/9ddb5908-22a9-41c8-909c-39cdf479bdd2 => generated 1931 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:00:43.448567 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-926693dd-6d35-4ebe-91cd-6d1d24d7a997 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] 10.222.0.60 "GET /compute/v2.1/servers/ebf9bfa9-e941-4d23-8f6c-9867102feff2" status: 200 len: 1317 microversion: 2.1 time: 0.281239 Sep 14 09:00:43.449703 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1381/2817] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:00:43 2022] GET /compute/v2.1/servers/ebf9bfa9-e941-4d23-8f6c-9867102feff2 => generated 1317 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:00:44.045091 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ccbebd70-b131-4af4-8e00-ff9f66da383e tempest-VolumesAdminNegativeTest-169244520 tempest-VolumesAdminNegativeTest-169244520-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "1ff086a5-be58-4966-8319-c584690c99e3"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:00:44.048142 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-ccbebd70-b131-4af4-8e00-ff9f66da383e tempest-VolumesAdminNegativeTest-169244520 tempest-VolumesAdminNegativeTest-169244520-project-admin] [instance: 885dfd01-8bac-4691-ad0b-f2218e306f2e] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:44.056858 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ccbebd70-b131-4af4-8e00-ff9f66da383e tempest-VolumesAdminNegativeTest-169244520 tempest-VolumesAdminNegativeTest-169244520-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:44.057355 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ccbebd70-b131-4af4-8e00-ff9f66da383e tempest-VolumesAdminNegativeTest-169244520 tempest-VolumesAdminNegativeTest-169244520-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:44.057801 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ccbebd70-b131-4af4-8e00-ff9f66da383e tempest-VolumesAdminNegativeTest-169244520 tempest-VolumesAdminNegativeTest-169244520-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:44.058560 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ccbebd70-b131-4af4-8e00-ff9f66da383e tempest-VolumesAdminNegativeTest-169244520 tempest-VolumesAdminNegativeTest-169244520-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:44.059441 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ccbebd70-b131-4af4-8e00-ff9f66da383e tempest-VolumesAdminNegativeTest-169244520 tempest-VolumesAdminNegativeTest-169244520-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:44.061085 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ccbebd70-b131-4af4-8e00-ff9f66da383e tempest-VolumesAdminNegativeTest-169244520 tempest-VolumesAdminNegativeTest-169244520-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:44.168011 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-ccbebd70-b131-4af4-8e00-ff9f66da383e tempest-VolumesAdminNegativeTest-169244520 tempest-VolumesAdminNegativeTest-169244520-project-admin] HTTP exception thrown: Volume 1ff086a5-be58-4966-8319-c584690c99e3 could not be found. Sep 14 09:00:44.185206 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-0ccaf2b1-8e86-4e09-9647-73b8c38d499f tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:44.186183 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-0ccaf2b1-8e86-4e09-9647-73b8c38d499f tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: e6001579-7f6f-4a6b-ada0-d301a142f96b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:44.193313 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0ccaf2b1-8e86-4e09-9647-73b8c38d499f tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:44.193888 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0ccaf2b1-8e86-4e09-9647-73b8c38d499f tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:44.194466 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0ccaf2b1-8e86-4e09-9647-73b8c38d499f tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:44.195295 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0ccaf2b1-8e86-4e09-9647-73b8c38d499f tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:44.195850 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0ccaf2b1-8e86-4e09-9647-73b8c38d499f tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:44.196229 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ccbebd70-b131-4af4-8e00-ff9f66da383e tempest-VolumesAdminNegativeTest-169244520 tempest-VolumesAdminNegativeTest-169244520-project-admin] Request method failure captured: Sep 14 09:00:44.196229 n-d-836830-18 devstack@n-api.service[128758]: request: PUT /compute/v2.1/servers/885dfd01-8bac-4691-ad0b-f2218e306f2e/os-volume_attachments/3813cc0e-28f8-434f-84aa-f1baf0718e15 HTTP/1.1 Sep 14 09:00:44.196229 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 09:00:44.196229 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 09:00:44.196229 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 09:00:44.196229 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 74 Sep 14 09:00:44.196229 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 09:00:44.196229 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 09:00:44.196229 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 09:00:44.196229 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 09:00:44.196229 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZe6rSz63BLNoEcQYSBVODLqgL9Dfovqr7O2LIGcI8W6C5XuDskS7XE6mdCGIPxtoe5wcAzh2c6NYq7WhJBD9XEovdeWDVdZB10luSK53LMjDw0qAUoA9v3V6Rtee5iV7CmJugsAoxto6QuOuCiwyYlPz-DlgJgG4Aez6OsLkJCOqF8 Sep 14 09:00:44.196229 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 09:00:44.196229 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 09:00:44.196229 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 09:00:44.196229 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 09:00:44.196229 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 09:00:44.196229 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 09:00:44.196229 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: b05173fd13e24cb393b3b90fa09094b1 Sep 14 09:00:44.196229 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-VolumesAdminNegativeTest-169244520 Sep 14 09:00:44.196229 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member,admin Sep 14 09:00:44.196229 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member,admin Sep 14 09:00:44.196229 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b05173fd13e24cb393b3b90fa09094b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b05173fd13e24cb393b3b90fa09094b1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b05173fd13e24cb393b3b90fa09094b1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b05173fd13e24cb393b3b90fa09094b1"}]}] Sep 14 09:00:44.196229 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-VolumesAdminNegativeTest-169244520 Sep 14 09:00:44.196229 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: b05173fd13e24cb393b3b90fa09094b1 Sep 14 09:00:44.196229 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-169244520 Sep 14 09:00:44.196229 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-VolumesAdminNegativeTest-169244520-project-admin Sep 14 09:00:44.196229 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 09:00:44.196229 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 09:00:44.196229 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 9c49592d3b854ebc91d9478e030af74a Sep 14 09:00:44.196229 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-VolumesAdminNegativeTest-169244520-project-admin Sep 14 09:00:44.196229 n-d-836830-18 devstack@n-api.service[128758]: Sep 14 09:00:44.196229 n-d-836830-18 devstack@n-api.service[128758]: {"volumeAttachment": {"volumeId": "1ff086a5-be58-4966-8319-c584690c99e3"}} Sep 14 09:00:44.196229 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 09:00:44.196229 n-d-836830-18 devstack@n-api.service[128758]: exception: Volume 1ff086a5-be58-4966-8319-c584690c99e3 could not be found. Sep 14 09:00:44.196229 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'server_id': '885dfd01-8bac-4691-ad0b-f2218e306f2e', 'id': '3813cc0e-28f8-434f-84aa-f1baf0718e15', 'body': {'volumeAttachment': {'volumeId': '1ff086a5-be58-4966-8319-c584690c99e3'}}} Sep 14 09:00:44.196229 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:00:44.196229 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:00:44.196229 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 14 09:00:44.196229 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 14 09:00:44.196229 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 14 09:00:44.196229 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 14 09:00:44.196229 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 14 09:00:44.196229 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 14 09:00:44.196229 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 14 09:00:44.196229 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 14 09:00:44.196229 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 14 09:00:44.196229 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 14 09:00:44.196229 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 14 09:00:44.196229 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 14 09:00:44.196229 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 14 09:00:44.196229 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 14 09:00:44.196229 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1ff086a5-be58-4966-8319-c584690c99e3 could not be found. (HTTP 404) (Request-ID: req-7ada7413-976d-489a-bb71-102f22b96f28) Sep 14 09:00:44.196229 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:00:44.196229 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:00:44.196229 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:00:44.196229 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:00:44.196229 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Sep 14 09:00:44.196229 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Sep 14 09:00:44.196229 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 14 09:00:44.196229 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 14 09:00:44.196229 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 14 09:00:44.203423 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 14 09:00:44.203423 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 14 09:00:44.203423 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 14 09:00:44.203423 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 14 09:00:44.203423 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 14 09:00:44.203423 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 14 09:00:44.203423 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 14 09:00:44.203423 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 14 09:00:44.203423 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 14 09:00:44.203423 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 14 09:00:44.203423 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 14 09:00:44.203423 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 14 09:00:44.203423 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 14 09:00:44.203423 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 14 09:00:44.203423 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 14 09:00:44.203423 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 14 09:00:44.203423 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 14 09:00:44.203423 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1ff086a5-be58-4966-8319-c584690c99e3 could not be found. Sep 14 09:00:44.203423 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:00:44.203423 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:00:44.203423 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:00:44.203423 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:00:44.203423 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:00:44.203423 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:00:44.203423 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:00:44.203423 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:00:44.203423 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:00:44.203423 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:00:44.203423 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:00:44.203423 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:00:44.203423 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:00:44.203423 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:00:44.203423 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Sep 14 09:00:44.203423 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Sep 14 09:00:44.203423 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Sep 14 09:00:44.203423 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 14 09:00:44.203423 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 1ff086a5-be58-4966-8319-c584690c99e3 could not be found. Sep 14 09:00:44.203423 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:00:44.203423 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:00:44.203423 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:00:44.203423 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:00:44.203423 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:00:44.203423 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:00:44.203423 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:00:44.203423 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:00:44.203423 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1ff086a5-be58-4966-8319-c584690c99e3 could not be found. Sep 14 09:00:44.203423 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:00:44.206181 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0ccaf2b1-8e86-4e09-9647-73b8c38d499f tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:44.206360 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ccbebd70-b131-4af4-8e00-ff9f66da383e tempest-VolumesAdminNegativeTest-169244520 tempest-VolumesAdminNegativeTest-169244520-project-admin] Returning 400 to user: Volume 1ff086a5-be58-4966-8319-c584690c99e3 could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:00:44.206360 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-ccbebd70-b131-4af4-8e00-ff9f66da383e tempest-VolumesAdminNegativeTest-169244520 tempest-VolumesAdminNegativeTest-169244520-project-admin] 10.222.0.60 "PUT /compute/v2.1/servers/885dfd01-8bac-4691-ad0b-f2218e306f2e/os-volume_attachments/3813cc0e-28f8-434f-84aa-f1baf0718e15" status: 400 len: 107 microversion: 2.1 time: 0.347049 Sep 14 09:00:44.206360 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1437/2818] 10.222.0.60 () {60 vars in 1433 bytes} [Wed Sep 14 09:00:43 2022] PUT /compute/v2.1/servers/885dfd01-8bac-4691-ad0b-f2218e306f2e/os-volume_attachments/3813cc0e-28f8-434f-84aa-f1baf0718e15 => generated 107 bytes in 348 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 14 09:00:44.279625 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-338c56eb-b7ff-465c-8d62-2c58dd966b12 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:44.280124 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-338c56eb-b7ff-465c-8d62-2c58dd966b12 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] [instance: 885dfd01-8bac-4691-ad0b-f2218e306f2e] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:44.286909 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-338c56eb-b7ff-465c-8d62-2c58dd966b12 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:44.287604 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-338c56eb-b7ff-465c-8d62-2c58dd966b12 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:44.288230 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-338c56eb-b7ff-465c-8d62-2c58dd966b12 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:44.288999 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-338c56eb-b7ff-465c-8d62-2c58dd966b12 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:44.289611 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-338c56eb-b7ff-465c-8d62-2c58dd966b12 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:44.290033 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-338c56eb-b7ff-465c-8d62-2c58dd966b12 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:44.365959 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-0ccaf2b1-8e86-4e09-9647-73b8c38d499f tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:44.375166 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-0ccaf2b1-8e86-4e09-9647-73b8c38d499f tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/e6001579-7f6f-4a6b-ada0-d301a142f96b" status: 200 len: 1314 microversion: 2.1 time: 0.193748 Sep 14 09:00:44.375880 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1382/2819] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:00:44 2022] GET /compute/v2.1/servers/e6001579-7f6f-4a6b-ada0-d301a142f96b => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:00:44.378352 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.objects.instance [None req-338c56eb-b7ff-465c-8d62-2c58dd966b12 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lazy-loading 'services' on Instance uuid 885dfd01-8bac-4691-ad0b-f2218e306f2e {{(pid=128758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:00:44.380716 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c896d858-9ad0-488f-b552-3ab31e3fb2b8 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:44.381455 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-c896d858-9ad0-488f-b552-3ab31e3fb2b8 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: 8f7f80e3-c2f5-4719-a484-29d6bd0d9e91] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:44.387720 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c896d858-9ad0-488f-b552-3ab31e3fb2b8 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:44.388490 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c896d858-9ad0-488f-b552-3ab31e3fb2b8 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:44.389145 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c896d858-9ad0-488f-b552-3ab31e3fb2b8 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:44.390075 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c896d858-9ad0-488f-b552-3ab31e3fb2b8 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:44.390747 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c896d858-9ad0-488f-b552-3ab31e3fb2b8 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:44.391446 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c896d858-9ad0-488f-b552-3ab31e3fb2b8 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:44.458063 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-338c56eb-b7ff-465c-8d62-2c58dd966b12 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] 10.222.0.60 "DELETE /compute/v2.1/servers/885dfd01-8bac-4691-ad0b-f2218e306f2e/os-volume_attachments/3813cc0e-28f8-434f-84aa-f1baf0718e15" status: 202 len: 0 microversion: 2.1 time: 0.182586 Sep 14 09:00:44.458923 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1438/2820] 10.222.0.60 () {58 vars in 1416 bytes} [Wed Sep 14 09:00:44 2022] DELETE /compute/v2.1/servers/885dfd01-8bac-4691-ad0b-f2218e306f2e/os-volume_attachments/3813cc0e-28f8-434f-84aa-f1baf0718e15 => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 14 09:00:44.464464 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-510e672e-6017-48ef-b761-9d00154e1ad1 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:44.465497 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-510e672e-6017-48ef-b761-9d00154e1ad1 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] [instance: 9ddb5908-22a9-41c8-909c-39cdf479bdd2] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:44.473093 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-510e672e-6017-48ef-b761-9d00154e1ad1 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:44.473918 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-510e672e-6017-48ef-b761-9d00154e1ad1 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:44.474597 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-510e672e-6017-48ef-b761-9d00154e1ad1 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:44.475602 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-510e672e-6017-48ef-b761-9d00154e1ad1 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:44.476292 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-510e672e-6017-48ef-b761-9d00154e1ad1 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:44.476929 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-510e672e-6017-48ef-b761-9d00154e1ad1 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:44.577087 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.objects.instance [None req-510e672e-6017-48ef-b761-9d00154e1ad1 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lazy-loading 'services' on Instance uuid 9ddb5908-22a9-41c8-909c-39cdf479bdd2 {{(pid=128758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:00:44.588900 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-c896d858-9ad0-488f-b552-3ab31e3fb2b8 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9d40e54481461cba53fedb9a6abdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed2295a58f8451993a57ce0a6f9ba29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:44.598224 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-510e672e-6017-48ef-b761-9d00154e1ad1 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/9ddb5908-22a9-41c8-909c-39cdf479bdd2" status: 200 len: 1931 microversion: 2.75 time: 0.137777 Sep 14 09:00:44.599187 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1439/2821] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:00:44 2022] GET /compute/v2.1/servers/9ddb5908-22a9-41c8-909c-39cdf479bdd2 => generated 1931 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:00:44.599550 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-c896d858-9ad0-488f-b552-3ab31e3fb2b8 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7f80e3-c2f5-4719-a484-29d6bd0d9e91" status: 200 len: 1517 microversion: 2.1 time: 0.222198 Sep 14 09:00:44.600530 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1383/2822] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:00:44 2022] GET /compute/v2.1/servers/8f7f80e3-c2f5-4719-a484-29d6bd0d9e91 => generated 1517 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:00:44.603833 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ce32a504-929f-471c-9252-d8dd8f1706da tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:44.606123 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-ce32a504-929f-471c-9252-d8dd8f1706da tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] [instance: 885dfd01-8bac-4691-ad0b-f2218e306f2e] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:44.607050 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3b94a75c-bfaa-41ed-86fd-9effa266bfe4 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:44.607810 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-3b94a75c-bfaa-41ed-86fd-9effa266bfe4 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] [instance: ebf9bfa9-e941-4d23-8f6c-9867102feff2] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:44.612867 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ce32a504-929f-471c-9252-d8dd8f1706da tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:44.613358 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ce32a504-929f-471c-9252-d8dd8f1706da tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:44.613830 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ce32a504-929f-471c-9252-d8dd8f1706da tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:44.614523 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ce32a504-929f-471c-9252-d8dd8f1706da tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:44.615174 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ce32a504-929f-471c-9252-d8dd8f1706da tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:44.615399 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3b94a75c-bfaa-41ed-86fd-9effa266bfe4 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:44.615758 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ce32a504-929f-471c-9252-d8dd8f1706da tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:44.616437 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3b94a75c-bfaa-41ed-86fd-9effa266bfe4 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:44.617054 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3b94a75c-bfaa-41ed-86fd-9effa266bfe4 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:44.617909 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3b94a75c-bfaa-41ed-86fd-9effa266bfe4 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:44.618815 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3b94a75c-bfaa-41ed-86fd-9effa266bfe4 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:44.619433 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3b94a75c-bfaa-41ed-86fd-9effa266bfe4 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:44.649561 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-ce32a504-929f-471c-9252-d8dd8f1706da tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] 10.222.0.60 "GET /compute/v2.1/servers/885dfd01-8bac-4691-ad0b-f2218e306f2e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048736 Sep 14 09:00:44.653974 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1440/2823] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 14 09:00:44 2022] GET /compute/v2.1/servers/885dfd01-8bac-4691-ad0b-f2218e306f2e/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:00:44.827258 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-3b94a75c-bfaa-41ed-86fd-9effa266bfe4 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a475c6e2b35f494aa8380aa1783e1779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c6f0c84e964383af6a4025d80fc93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:44.837217 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-3b94a75c-bfaa-41ed-86fd-9effa266bfe4 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] 10.222.0.60 "GET /compute/v2.1/servers/ebf9bfa9-e941-4d23-8f6c-9867102feff2" status: 200 len: 1317 microversion: 2.1 time: 0.235377 Sep 14 09:00:44.838980 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1384/2824] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:00:44 2022] GET /compute/v2.1/servers/ebf9bfa9-e941-4d23-8f6c-9867102feff2 => generated 1317 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:00:45.402891 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-2c98b329-d74c-480e-b071-f8c4cf83afbe tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:45.406277 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-2c98b329-d74c-480e-b071-f8c4cf83afbe tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: e6001579-7f6f-4a6b-ada0-d301a142f96b] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:45.416849 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2c98b329-d74c-480e-b071-f8c4cf83afbe tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:45.417680 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2c98b329-d74c-480e-b071-f8c4cf83afbe tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:45.418274 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2c98b329-d74c-480e-b071-f8c4cf83afbe tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:45.419166 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2c98b329-d74c-480e-b071-f8c4cf83afbe tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:45.420426 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2c98b329-d74c-480e-b071-f8c4cf83afbe tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:45.422098 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2c98b329-d74c-480e-b071-f8c4cf83afbe tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:45.428300 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:00:45.600701 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-2c98b329-d74c-480e-b071-f8c4cf83afbe tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:45.611272 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-2c98b329-d74c-480e-b071-f8c4cf83afbe tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/e6001579-7f6f-4a6b-ada0-d301a142f96b" status: 200 len: 1314 microversion: 2.1 time: 0.216925 Sep 14 09:00:45.617747 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1441/2825] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:00:45 2022] GET /compute/v2.1/servers/e6001579-7f6f-4a6b-ada0-d301a142f96b => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:00:45.627669 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a7a11c8f-ded1-4351-b392-a2585951a2d5 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:45.628289 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-a7a11c8f-ded1-4351-b392-a2585951a2d5 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: 8f7f80e3-c2f5-4719-a484-29d6bd0d9e91] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:45.630250 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=4 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:00:45.631111 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=24 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:00:45.641507 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a7a11c8f-ded1-4351-b392-a2585951a2d5 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:45.642315 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a7a11c8f-ded1-4351-b392-a2585951a2d5 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:45.643224 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a7a11c8f-ded1-4351-b392-a2585951a2d5 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:45.644096 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a7a11c8f-ded1-4351-b392-a2585951a2d5 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:45.644777 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a7a11c8f-ded1-4351-b392-a2585951a2d5 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:45.645368 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a7a11c8f-ded1-4351-b392-a2585951a2d5 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:45.678856 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-f83e3112-4cab-4ddf-87a2-e856726ae915 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:45.680151 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-f83e3112-4cab-4ddf-87a2-e856726ae915 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] [instance: 9ddb5908-22a9-41c8-909c-39cdf479bdd2] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:45.691401 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f83e3112-4cab-4ddf-87a2-e856726ae915 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:45.691905 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f83e3112-4cab-4ddf-87a2-e856726ae915 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:45.692345 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f83e3112-4cab-4ddf-87a2-e856726ae915 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:45.693063 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f83e3112-4cab-4ddf-87a2-e856726ae915 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:45.693643 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f83e3112-4cab-4ddf-87a2-e856726ae915 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:45.694744 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f83e3112-4cab-4ddf-87a2-e856726ae915 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:45.888226 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.objects.instance [None req-f83e3112-4cab-4ddf-87a2-e856726ae915 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lazy-loading 'services' on Instance uuid 9ddb5908-22a9-41c8-909c-39cdf479bdd2 {{(pid=128758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:00:45.942225 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-f83e3112-4cab-4ddf-87a2-e856726ae915 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/9ddb5908-22a9-41c8-909c-39cdf479bdd2" status: 200 len: 1931 microversion: 2.75 time: 0.274159 Sep 14 09:00:45.962836 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-a7a11c8f-ded1-4351-b392-a2585951a2d5 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9d40e54481461cba53fedb9a6abdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed2295a58f8451993a57ce0a6f9ba29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:45.971128 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1442/2826] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:00:45 2022] GET /compute/v2.1/servers/9ddb5908-22a9-41c8-909c-39cdf479bdd2 => generated 1931 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:00:45.976647 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a7a11c8f-ded1-4351-b392-a2585951a2d5 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7f80e3-c2f5-4719-a484-29d6bd0d9e91" status: 200 len: 1517 microversion: 2.1 time: 0.352834 Sep 14 09:00:45.980260 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-12780fb8-521f-4a15-9d1e-4241ffe2dbde tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:45.984013 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-12780fb8-521f-4a15-9d1e-4241ffe2dbde tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] [instance: 885dfd01-8bac-4691-ad0b-f2218e306f2e] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:45.991519 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1385/2827] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:00:45 2022] GET /compute/v2.1/servers/8f7f80e3-c2f5-4719-a484-29d6bd0d9e91 => generated 1517 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:00:46.005314 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-12780fb8-521f-4a15-9d1e-4241ffe2dbde tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:46.008615 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-12780fb8-521f-4a15-9d1e-4241ffe2dbde tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:46.009009 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f67c84cd-8944-4a57-b880-0593ab4e03da tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:46.009750 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-12780fb8-521f-4a15-9d1e-4241ffe2dbde tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:46.009996 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f67c84cd-8944-4a57-b880-0593ab4e03da tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] [instance: ebf9bfa9-e941-4d23-8f6c-9867102feff2] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:46.011950 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-12780fb8-521f-4a15-9d1e-4241ffe2dbde tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:46.015326 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-12780fb8-521f-4a15-9d1e-4241ffe2dbde tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:46.017430 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f67c84cd-8944-4a57-b880-0593ab4e03da tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:46.018063 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-12780fb8-521f-4a15-9d1e-4241ffe2dbde tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:46.018258 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f67c84cd-8944-4a57-b880-0593ab4e03da tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:46.018853 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f67c84cd-8944-4a57-b880-0593ab4e03da tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:46.019770 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f67c84cd-8944-4a57-b880-0593ab4e03da tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:46.021142 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f67c84cd-8944-4a57-b880-0593ab4e03da tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:46.021577 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f67c84cd-8944-4a57-b880-0593ab4e03da tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:46.083791 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-12780fb8-521f-4a15-9d1e-4241ffe2dbde tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] 10.222.0.60 "GET /compute/v2.1/servers/885dfd01-8bac-4691-ad0b-f2218e306f2e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.110758 Sep 14 09:00:46.085371 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1443/2828] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 14 09:00:45 2022] GET /compute/v2.1/servers/885dfd01-8bac-4691-ad0b-f2218e306f2e/os-volume_attachments => generated 197 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:00:46.140693 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-8706961a-3c65-485e-ab05-1cbba18bb52d req-5aebbc6f-103e-49cc-bb5f-1a2b13f47150 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6001579-7f6f-4a6b-ada0-d301a142f96b", "name": "network-vif-plugged", "status": "completed", "tag": "2548545f-5fc0-4e22-abed-f9b40b4396b9"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:00:46.159612 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-8706961a-3c65-485e-ab05-1cbba18bb52d req-5aebbc6f-103e-49cc-bb5f-1a2b13f47150 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:46.162767 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-8706961a-3c65-485e-ab05-1cbba18bb52d req-5aebbc6f-103e-49cc-bb5f-1a2b13f47150 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:46.165826 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-8706961a-3c65-485e-ab05-1cbba18bb52d req-5aebbc6f-103e-49cc-bb5f-1a2b13f47150 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:46.194275 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-8706961a-3c65-485e-ab05-1cbba18bb52d req-5aebbc6f-103e-49cc-bb5f-1a2b13f47150 service nova] Creating event network-vif-plugged:2548545f-5fc0-4e22-abed-f9b40b4396b9 for instance e6001579-7f6f-4a6b-ada0-d301a142f96b on n-h1-836830-18 Sep 14 09:00:46.207836 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-8706961a-3c65-485e-ab05-1cbba18bb52d req-5aebbc6f-103e-49cc-bb5f-1a2b13f47150 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071336 Sep 14 09:00:46.208983 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1444/2829] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:00:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:00:46.296254 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f67c84cd-8944-4a57-b880-0593ab4e03da tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a475c6e2b35f494aa8380aa1783e1779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c6f0c84e964383af6a4025d80fc93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:46.311446 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f67c84cd-8944-4a57-b880-0593ab4e03da tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] 10.222.0.60 "GET /compute/v2.1/servers/ebf9bfa9-e941-4d23-8f6c-9867102feff2" status: 200 len: 1466 microversion: 2.1 time: 0.318699 Sep 14 09:00:46.314562 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1386/2830] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:00:45 2022] GET /compute/v2.1/servers/ebf9bfa9-e941-4d23-8f6c-9867102feff2 => generated 1466 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:00:46.337950 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-e8527bc5-44d9-4ea7-9367-75b3cdd874e8 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-572914010"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:00:46.343340 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-e8527bc5-44d9-4ea7-9367-75b3cdd874e8 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] [instance: ebf9bfa9-e941-4d23-8f6c-9867102feff2] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:46.354170 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=4 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:00:46.357170 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e8527bc5-44d9-4ea7-9367-75b3cdd874e8 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:46.358083 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e8527bc5-44d9-4ea7-9367-75b3cdd874e8 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:46.358637 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e8527bc5-44d9-4ea7-9367-75b3cdd874e8 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:46.359576 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e8527bc5-44d9-4ea7-9367-75b3cdd874e8 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:46.360150 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e8527bc5-44d9-4ea7-9367-75b3cdd874e8 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:46.360776 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e8527bc5-44d9-4ea7-9367-75b3cdd874e8 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:46.634732 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3a888322-21ff-44f4-8130-4f4efb183b43 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:46.636046 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-3a888322-21ff-44f4-8130-4f4efb183b43 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: e6001579-7f6f-4a6b-ada0-d301a142f96b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:46.644984 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3a888322-21ff-44f4-8130-4f4efb183b43 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:46.646209 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-e8527bc5-44d9-4ea7-9367-75b3cdd874e8 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] 10.222.0.60 "POST /compute/v2.1/servers/ebf9bfa9-e941-4d23-8f6c-9867102feff2/action" status: 202 len: 0 microversion: 2.1 time: 0.311790 Sep 14 09:00:46.646987 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1445/2831] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:00:46 2022] POST /compute/v2.1/servers/ebf9bfa9-e941-4d23-8f6c-9867102feff2/action => generated 0 bytes in 315 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Sep 14 09:00:46.649089 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3a888322-21ff-44f4-8130-4f4efb183b43 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:46.650203 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3a888322-21ff-44f4-8130-4f4efb183b43 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:46.652865 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3a888322-21ff-44f4-8130-4f4efb183b43 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:46.654042 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3a888322-21ff-44f4-8130-4f4efb183b43 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:46.656389 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3a888322-21ff-44f4-8130-4f4efb183b43 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:46.659590 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-12a2701e-f5a9-4246-aae6-0225f29dd0f4 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Calling method '.version_select at 0x7f7d3facee50>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:46.668315 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=16 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:00:46.714397 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-12a2701e-f5a9-4246-aae6-0225f29dd0f4 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] 10.222.0.60 "GET /compute/v2.1/images/dad3a300-4c39-4706-a163-fe284681c5e2" status: 200 len: 1454 microversion: 2.1 time: 0.060657 Sep 14 09:00:46.723213 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1446/2832] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:00:46 2022] GET /compute/v2.1/images/dad3a300-4c39-4706-a163-fe284681c5e2 => generated 1454 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:00:46.832543 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-3a888322-21ff-44f4-8130-4f4efb183b43 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:46.841944 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-3a888322-21ff-44f4-8130-4f4efb183b43 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/e6001579-7f6f-4a6b-ada0-d301a142f96b" status: 200 len: 1314 microversion: 2.1 time: 0.211341 Sep 14 09:00:46.843137 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1387/2833] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:00:46 2022] GET /compute/v2.1/servers/e6001579-7f6f-4a6b-ada0-d301a142f96b => generated 1314 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:00:46.977714 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-854a13bc-6d35-4a0a-a009-3b8d6685b408 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:46.978448 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-854a13bc-6d35-4a0a-a009-3b8d6685b408 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] [instance: 9ddb5908-22a9-41c8-909c-39cdf479bdd2] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:46.986299 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-854a13bc-6d35-4a0a-a009-3b8d6685b408 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:46.986949 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-854a13bc-6d35-4a0a-a009-3b8d6685b408 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:46.988043 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-854a13bc-6d35-4a0a-a009-3b8d6685b408 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:46.988758 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-854a13bc-6d35-4a0a-a009-3b8d6685b408 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:46.989218 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-854a13bc-6d35-4a0a-a009-3b8d6685b408 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:46.989643 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-854a13bc-6d35-4a0a-a009-3b8d6685b408 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:47.003899 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-04ceb11f-11ae-4612-9ed6-353471bd57c8 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:47.004531 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-04ceb11f-11ae-4612-9ed6-353471bd57c8 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: 8f7f80e3-c2f5-4719-a484-29d6bd0d9e91] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:47.010810 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-04ceb11f-11ae-4612-9ed6-353471bd57c8 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:47.011330 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-04ceb11f-11ae-4612-9ed6-353471bd57c8 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:47.011946 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-04ceb11f-11ae-4612-9ed6-353471bd57c8 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:47.013355 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-04ceb11f-11ae-4612-9ed6-353471bd57c8 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:47.013971 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-04ceb11f-11ae-4612-9ed6-353471bd57c8 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:47.014580 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-04ceb11f-11ae-4612-9ed6-353471bd57c8 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:47.101080 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.objects.instance [None req-854a13bc-6d35-4a0a-a009-3b8d6685b408 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lazy-loading 'services' on Instance uuid 9ddb5908-22a9-41c8-909c-39cdf479bdd2 {{(pid=128758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:00:47.131123 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-854a13bc-6d35-4a0a-a009-3b8d6685b408 tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/9ddb5908-22a9-41c8-909c-39cdf479bdd2" status: 200 len: 1949 microversion: 2.75 time: 0.157039 Sep 14 09:00:47.146973 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1447/2834] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:00:46 2022] GET /compute/v2.1/servers/9ddb5908-22a9-41c8-909c-39cdf479bdd2 => generated 1949 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:00:47.146973 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-92556bbf-600a-439b-b590-f980ab9dbad0 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:47.152647 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-92556bbf-600a-439b-b590-f980ab9dbad0 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] [instance: 885dfd01-8bac-4691-ad0b-f2218e306f2e] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:47.162662 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-92556bbf-600a-439b-b590-f980ab9dbad0 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:47.163430 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-92556bbf-600a-439b-b590-f980ab9dbad0 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:47.163865 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-92556bbf-600a-439b-b590-f980ab9dbad0 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:47.164641 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-92556bbf-600a-439b-b590-f980ab9dbad0 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:47.165090 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-92556bbf-600a-439b-b590-f980ab9dbad0 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:47.165510 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-92556bbf-600a-439b-b590-f980ab9dbad0 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:47.203664 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-92556bbf-600a-439b-b590-f980ab9dbad0 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] 10.222.0.60 "GET /compute/v2.1/servers/885dfd01-8bac-4691-ad0b-f2218e306f2e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070276 Sep 14 09:00:47.204652 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1448/2835] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 14 09:00:47 2022] GET /compute/v2.1/servers/885dfd01-8bac-4691-ad0b-f2218e306f2e/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:00:47.208604 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-04ceb11f-11ae-4612-9ed6-353471bd57c8 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9d40e54481461cba53fedb9a6abdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed2295a58f8451993a57ce0a6f9ba29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:47.217176 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-04ceb11f-11ae-4612-9ed6-353471bd57c8 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7f80e3-c2f5-4719-a484-29d6bd0d9e91" status: 200 len: 1517 microversion: 2.1 time: 0.217090 Sep 14 09:00:47.231878 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1388/2836] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:00:46 2022] GET /compute/v2.1/servers/8f7f80e3-c2f5-4719-a484-29d6bd0d9e91 => generated 1517 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:00:47.729850 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-cf4bfc84-8661-4cb7-912e-07069db2cac1 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Calling method '.version_select at 0x7f7d440960d0>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:47.777420 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-cf4bfc84-8661-4cb7-912e-07069db2cac1 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] 10.222.0.60 "GET /compute/v2.1/images/dad3a300-4c39-4706-a163-fe284681c5e2" status: 200 len: 1454 microversion: 2.1 time: 0.051314 Sep 14 09:00:47.779231 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1449/2837] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:00:47 2022] GET /compute/v2.1/images/dad3a300-4c39-4706-a163-fe284681c5e2 => generated 1454 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:00:47.868537 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f578e23a-ff08-40ad-a6bf-bbb6a73a7bab tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:47.869447 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f578e23a-ff08-40ad-a6bf-bbb6a73a7bab tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: e6001579-7f6f-4a6b-ada0-d301a142f96b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:47.877489 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f578e23a-ff08-40ad-a6bf-bbb6a73a7bab tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:47.877991 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f578e23a-ff08-40ad-a6bf-bbb6a73a7bab tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:47.878429 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f578e23a-ff08-40ad-a6bf-bbb6a73a7bab tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:47.879344 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f578e23a-ff08-40ad-a6bf-bbb6a73a7bab tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:47.879834 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f578e23a-ff08-40ad-a6bf-bbb6a73a7bab tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:47.880428 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f578e23a-ff08-40ad-a6bf-bbb6a73a7bab tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:47.907695 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=100 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:00:48.039940 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f578e23a-ff08-40ad-a6bf-bbb6a73a7bab tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:48.048274 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f578e23a-ff08-40ad-a6bf-bbb6a73a7bab tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/e6001579-7f6f-4a6b-ada0-d301a142f96b" status: 200 len: 1314 microversion: 2.1 time: 0.184390 Sep 14 09:00:48.048842 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1389/2838] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:00:47 2022] GET /compute/v2.1/servers/e6001579-7f6f-4a6b-ada0-d301a142f96b => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:00:48.164321 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1d2ee019-7ca9-4c3a-89c4-529cb8fb335b tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:48.164973 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-1d2ee019-7ca9-4c3a-89c4-529cb8fb335b tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] [instance: 9ddb5908-22a9-41c8-909c-39cdf479bdd2] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:48.177243 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1d2ee019-7ca9-4c3a-89c4-529cb8fb335b tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:48.177683 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1d2ee019-7ca9-4c3a-89c4-529cb8fb335b tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:48.178128 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1d2ee019-7ca9-4c3a-89c4-529cb8fb335b tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:48.178843 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1d2ee019-7ca9-4c3a-89c4-529cb8fb335b tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:48.179429 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1d2ee019-7ca9-4c3a-89c4-529cb8fb335b tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:48.180037 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1d2ee019-7ca9-4c3a-89c4-529cb8fb335b tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:48.217474 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-0468d554-be84-455c-8153-8cb8a617578b tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:48.220159 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-0468d554-be84-455c-8153-8cb8a617578b tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] [instance: 885dfd01-8bac-4691-ad0b-f2218e306f2e] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:48.227461 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0468d554-be84-455c-8153-8cb8a617578b tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:48.228294 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0468d554-be84-455c-8153-8cb8a617578b tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:48.228944 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0468d554-be84-455c-8153-8cb8a617578b tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:48.230185 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0468d554-be84-455c-8153-8cb8a617578b tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:48.230848 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0468d554-be84-455c-8153-8cb8a617578b tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:48.232190 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0468d554-be84-455c-8153-8cb8a617578b tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:48.275540 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-0468d554-be84-455c-8153-8cb8a617578b tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] 10.222.0.60 "GET /compute/v2.1/servers/885dfd01-8bac-4691-ad0b-f2218e306f2e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063247 Sep 14 09:00:48.276483 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1390/2839] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 14 09:00:48 2022] GET /compute/v2.1/servers/885dfd01-8bac-4691-ad0b-f2218e306f2e/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:00:48.289384 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e1905105-f071-4b32-ab30-7c27f86a31b7 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:48.290148 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e1905105-f071-4b32-ab30-7c27f86a31b7 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: 8f7f80e3-c2f5-4719-a484-29d6bd0d9e91] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:48.297614 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e1905105-f071-4b32-ab30-7c27f86a31b7 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:48.298356 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e1905105-f071-4b32-ab30-7c27f86a31b7 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:48.299280 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e1905105-f071-4b32-ab30-7c27f86a31b7 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:48.300789 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e1905105-f071-4b32-ab30-7c27f86a31b7 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:48.301643 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e1905105-f071-4b32-ab30-7c27f86a31b7 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:48.302267 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e1905105-f071-4b32-ab30-7c27f86a31b7 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:48.305546 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.objects.instance [None req-1d2ee019-7ca9-4c3a-89c4-529cb8fb335b tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lazy-loading 'services' on Instance uuid 9ddb5908-22a9-41c8-909c-39cdf479bdd2 {{(pid=128758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:00:48.343453 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-1d2ee019-7ca9-4c3a-89c4-529cb8fb335b tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/9ddb5908-22a9-41c8-909c-39cdf479bdd2" status: 200 len: 1937 microversion: 2.75 time: 0.185798 Sep 14 09:00:48.347071 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1450/2840] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:00:48 2022] GET /compute/v2.1/servers/9ddb5908-22a9-41c8-909c-39cdf479bdd2 => generated 1937 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:00:48.477699 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-e1905105-f071-4b32-ab30-7c27f86a31b7 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9d40e54481461cba53fedb9a6abdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed2295a58f8451993a57ce0a6f9ba29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:48.486850 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e1905105-f071-4b32-ab30-7c27f86a31b7 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7f80e3-c2f5-4719-a484-29d6bd0d9e91" status: 200 len: 1523 microversion: 2.1 time: 0.208938 Sep 14 09:00:48.487740 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1391/2841] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:00:48 2022] GET /compute/v2.1/servers/8f7f80e3-c2f5-4719-a484-29d6bd0d9e91 => generated 1523 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:00:48.793543 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-5a490a9b-66cd-48b3-91f3-4d39c3d1db78 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Calling method '.version_select at 0x7f7d44023700>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:48.847499 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-5a490a9b-66cd-48b3-91f3-4d39c3d1db78 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] 10.222.0.60 "GET /compute/v2.1/images/dad3a300-4c39-4706-a163-fe284681c5e2" status: 200 len: 1454 microversion: 2.1 time: 0.057645 Sep 14 09:00:48.848180 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1451/2842] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:00:48 2022] GET /compute/v2.1/images/dad3a300-4c39-4706-a163-fe284681c5e2 => generated 1454 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:00:49.073129 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f5d43542-6792-46eb-b6ab-18c5feed8b61 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:49.073905 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f5d43542-6792-46eb-b6ab-18c5feed8b61 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: e6001579-7f6f-4a6b-ada0-d301a142f96b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:49.081501 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f5d43542-6792-46eb-b6ab-18c5feed8b61 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:49.082487 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f5d43542-6792-46eb-b6ab-18c5feed8b61 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:49.083097 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f5d43542-6792-46eb-b6ab-18c5feed8b61 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:49.084047 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f5d43542-6792-46eb-b6ab-18c5feed8b61 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:49.084703 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f5d43542-6792-46eb-b6ab-18c5feed8b61 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:49.085334 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f5d43542-6792-46eb-b6ab-18c5feed8b61 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:49.252795 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f5d43542-6792-46eb-b6ab-18c5feed8b61 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:49.261795 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f5d43542-6792-46eb-b6ab-18c5feed8b61 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/e6001579-7f6f-4a6b-ada0-d301a142f96b" status: 200 len: 1501 microversion: 2.1 time: 0.193078 Sep 14 09:00:49.262389 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1392/2843] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:00:49 2022] GET /compute/v2.1/servers/e6001579-7f6f-4a6b-ada0-d301a142f96b => generated 1501 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:00:49.287935 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b7013180-2d2a-43c6-bde3-d2d11e375c43 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:00:49.289411 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-b7013180-2d2a-43c6-bde3-d2d11e375c43 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: e6001579-7f6f-4a6b-ada0-d301a142f96b] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:49.297059 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-22f2c015-b8fa-4496-a3cf-01ad8c9f82ee tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:49.298107 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b7013180-2d2a-43c6-bde3-d2d11e375c43 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:49.298878 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b7013180-2d2a-43c6-bde3-d2d11e375c43 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:49.299534 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b7013180-2d2a-43c6-bde3-d2d11e375c43 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:49.300544 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-22f2c015-b8fa-4496-a3cf-01ad8c9f82ee tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] [instance: 885dfd01-8bac-4691-ad0b-f2218e306f2e] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:49.301046 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b7013180-2d2a-43c6-bde3-d2d11e375c43 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:49.301666 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b7013180-2d2a-43c6-bde3-d2d11e375c43 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:49.302260 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b7013180-2d2a-43c6-bde3-d2d11e375c43 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:49.313581 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-22f2c015-b8fa-4496-a3cf-01ad8c9f82ee tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:49.314345 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-22f2c015-b8fa-4496-a3cf-01ad8c9f82ee tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:49.314986 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-22f2c015-b8fa-4496-a3cf-01ad8c9f82ee tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:49.315882 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-22f2c015-b8fa-4496-a3cf-01ad8c9f82ee tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:49.316594 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-22f2c015-b8fa-4496-a3cf-01ad8c9f82ee tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:49.317198 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-22f2c015-b8fa-4496-a3cf-01ad8c9f82ee tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:49.355853 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-22f2c015-b8fa-4496-a3cf-01ad8c9f82ee tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] 10.222.0.60 "GET /compute/v2.1/servers/885dfd01-8bac-4691-ad0b-f2218e306f2e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072854 Sep 14 09:00:49.365359 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1393/2844] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 14 09:00:49 2022] GET /compute/v2.1/servers/885dfd01-8bac-4691-ad0b-f2218e306f2e/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:00:49.380882 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-7c7d166c-b40d-428d-ba10-8ac1a8004b4e tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:49.383767 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-7c7d166c-b40d-428d-ba10-8ac1a8004b4e tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] [instance: 9ddb5908-22a9-41c8-909c-39cdf479bdd2] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:49.401005 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7c7d166c-b40d-428d-ba10-8ac1a8004b4e tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:49.401667 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7c7d166c-b40d-428d-ba10-8ac1a8004b4e tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:49.402901 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7c7d166c-b40d-428d-ba10-8ac1a8004b4e tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:49.404518 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7c7d166c-b40d-428d-ba10-8ac1a8004b4e tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:49.405596 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7c7d166c-b40d-428d-ba10-8ac1a8004b4e tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:49.406245 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7c7d166c-b40d-428d-ba10-8ac1a8004b4e tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:49.410000 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-b7013180-2d2a-43c6-bde3-d2d11e375c43 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "POST /compute/v2.1/servers/e6001579-7f6f-4a6b-ada0-d301a142f96b/action" status: 202 len: 0 microversion: 2.1 time: 0.128096 Sep 14 09:00:49.417266 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1452/2845] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:00:49 2022] POST /compute/v2.1/servers/e6001579-7f6f-4a6b-ada0-d301a142f96b/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 14 09:00:49.423480 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-bff9ee8c-64ec-44e5-9b87-528e338e6fad tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:49.424487 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-bff9ee8c-64ec-44e5-9b87-528e338e6fad tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: e6001579-7f6f-4a6b-ada0-d301a142f96b] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:49.431502 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bff9ee8c-64ec-44e5-9b87-528e338e6fad tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:49.432338 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bff9ee8c-64ec-44e5-9b87-528e338e6fad tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:49.433053 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bff9ee8c-64ec-44e5-9b87-528e338e6fad tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:49.433993 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bff9ee8c-64ec-44e5-9b87-528e338e6fad tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:49.434722 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bff9ee8c-64ec-44e5-9b87-528e338e6fad tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:49.436404 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bff9ee8c-64ec-44e5-9b87-528e338e6fad tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:49.512802 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.objects.instance [None req-7c7d166c-b40d-428d-ba10-8ac1a8004b4e tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lazy-loading 'services' on Instance uuid 9ddb5908-22a9-41c8-909c-39cdf479bdd2 {{(pid=128759) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:00:49.534168 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-7c7d166c-b40d-428d-ba10-8ac1a8004b4e tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/9ddb5908-22a9-41c8-909c-39cdf479bdd2" status: 200 len: 1937 microversion: 2.75 time: 0.159085 Sep 14 09:00:49.534776 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1394/2846] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:00:49 2022] GET /compute/v2.1/servers/9ddb5908-22a9-41c8-909c-39cdf479bdd2 => generated 1937 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:00:49.539925 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-eaf64af6-93d7-451f-8772-490bd26d2f97 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:49.540801 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-eaf64af6-93d7-451f-8772-490bd26d2f97 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: 8f7f80e3-c2f5-4719-a484-29d6bd0d9e91] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:49.548333 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-eaf64af6-93d7-451f-8772-490bd26d2f97 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:49.549010 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-eaf64af6-93d7-451f-8772-490bd26d2f97 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:49.549860 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-eaf64af6-93d7-451f-8772-490bd26d2f97 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:49.550728 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-eaf64af6-93d7-451f-8772-490bd26d2f97 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:49.551410 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-eaf64af6-93d7-451f-8772-490bd26d2f97 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:49.551989 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-eaf64af6-93d7-451f-8772-490bd26d2f97 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:49.663116 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-bff9ee8c-64ec-44e5-9b87-528e338e6fad tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:49.678221 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-bff9ee8c-64ec-44e5-9b87-528e338e6fad tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/e6001579-7f6f-4a6b-ada0-d301a142f96b" status: 200 len: 1506 microversion: 2.1 time: 0.256901 Sep 14 09:00:49.679350 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1453/2847] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:00:49 2022] GET /compute/v2.1/servers/e6001579-7f6f-4a6b-ada0-d301a142f96b => generated 1506 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:00:49.757111 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-eaf64af6-93d7-451f-8772-490bd26d2f97 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9d40e54481461cba53fedb9a6abdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed2295a58f8451993a57ce0a6f9ba29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:49.765506 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-eaf64af6-93d7-451f-8772-490bd26d2f97 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7f80e3-c2f5-4719-a484-29d6bd0d9e91" status: 200 len: 1523 microversion: 2.1 time: 0.229454 Sep 14 09:00:49.766047 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1395/2848] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:00:49 2022] GET /compute/v2.1/servers/8f7f80e3-c2f5-4719-a484-29d6bd0d9e91 => generated 1523 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:00:49.863341 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-247bcd19-abb8-4232-afc1-8a23989ba696 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Calling method '.version_select at 0x7f7d3faa3700>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:49.916063 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-247bcd19-abb8-4232-afc1-8a23989ba696 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] 10.222.0.60 "GET /compute/v2.1/images/dad3a300-4c39-4706-a163-fe284681c5e2" status: 200 len: 1454 microversion: 2.1 time: 0.056813 Sep 14 09:00:49.917544 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1454/2849] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:00:49 2022] GET /compute/v2.1/images/dad3a300-4c39-4706-a163-fe284681c5e2 => generated 1454 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:00:50.373943 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e1bc3dcd-c0de-499f-877f-27eab1169b3c tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:50.376400 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e1bc3dcd-c0de-499f-877f-27eab1169b3c tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] [instance: 885dfd01-8bac-4691-ad0b-f2218e306f2e] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:50.384107 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e1bc3dcd-c0de-499f-877f-27eab1169b3c tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:50.384915 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e1bc3dcd-c0de-499f-877f-27eab1169b3c tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:50.385374 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e1bc3dcd-c0de-499f-877f-27eab1169b3c tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:50.386102 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e1bc3dcd-c0de-499f-877f-27eab1169b3c tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:50.386557 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e1bc3dcd-c0de-499f-877f-27eab1169b3c tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:50.387123 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e1bc3dcd-c0de-499f-877f-27eab1169b3c tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:50.420296 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e1bc3dcd-c0de-499f-877f-27eab1169b3c tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] 10.222.0.60 "GET /compute/v2.1/servers/885dfd01-8bac-4691-ad0b-f2218e306f2e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051765 Sep 14 09:00:50.422014 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1396/2850] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 14 09:00:50 2022] GET /compute/v2.1/servers/885dfd01-8bac-4691-ad0b-f2218e306f2e/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:00:50.570575 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-48bcc5e8-bfee-4a63-81e7-cc9cf7c2914d tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:50.571872 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-48bcc5e8-bfee-4a63-81e7-cc9cf7c2914d tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] [instance: 9ddb5908-22a9-41c8-909c-39cdf479bdd2] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:50.586151 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-48bcc5e8-bfee-4a63-81e7-cc9cf7c2914d tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:50.586996 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-48bcc5e8-bfee-4a63-81e7-cc9cf7c2914d tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:50.587637 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-48bcc5e8-bfee-4a63-81e7-cc9cf7c2914d tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:50.588602 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-48bcc5e8-bfee-4a63-81e7-cc9cf7c2914d tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:50.589400 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-48bcc5e8-bfee-4a63-81e7-cc9cf7c2914d tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:50.590035 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-48bcc5e8-bfee-4a63-81e7-cc9cf7c2914d tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:50.703366 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-1980432f-4f62-44c1-8614-f00ac9057f98 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:50.704670 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-1980432f-4f62-44c1-8614-f00ac9057f98 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: e6001579-7f6f-4a6b-ada0-d301a142f96b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:50.706645 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.objects.instance [None req-48bcc5e8-bfee-4a63-81e7-cc9cf7c2914d tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] Lazy-loading 'services' on Instance uuid 9ddb5908-22a9-41c8-909c-39cdf479bdd2 {{(pid=128758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:00:50.712165 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1980432f-4f62-44c1-8614-f00ac9057f98 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:50.712954 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1980432f-4f62-44c1-8614-f00ac9057f98 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:50.713609 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1980432f-4f62-44c1-8614-f00ac9057f98 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:50.714526 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1980432f-4f62-44c1-8614-f00ac9057f98 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:50.715201 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1980432f-4f62-44c1-8614-f00ac9057f98 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:50.715884 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1980432f-4f62-44c1-8614-f00ac9057f98 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:50.727735 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-48bcc5e8-bfee-4a63-81e7-cc9cf7c2914d tempest-ServersAdmin275Test-1671476832 tempest-ServersAdmin275Test-1671476832-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/9ddb5908-22a9-41c8-909c-39cdf479bdd2" status: 200 len: 1922 microversion: 2.75 time: 0.162499 Sep 14 09:00:50.728786 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1455/2851] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:00:50 2022] GET /compute/v2.1/servers/9ddb5908-22a9-41c8-909c-39cdf479bdd2 => generated 1922 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:00:50.772923 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-bd158711-548e-44cd-8820-83b87590a4e7 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:50.773440 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-bd158711-548e-44cd-8820-83b87590a4e7 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] [instance: 9ddb5908-22a9-41c8-909c-39cdf479bdd2] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:50.781282 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bd158711-548e-44cd-8820-83b87590a4e7 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:50.782045 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bd158711-548e-44cd-8820-83b87590a4e7 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:50.782656 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bd158711-548e-44cd-8820-83b87590a4e7 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:50.783597 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bd158711-548e-44cd-8820-83b87590a4e7 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:50.784219 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bd158711-548e-44cd-8820-83b87590a4e7 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:50.785133 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bd158711-548e-44cd-8820-83b87590a4e7 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:50.828576 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-bd158711-548e-44cd-8820-83b87590a4e7 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] [instance: 9ddb5908-22a9-41c8-909c-39cdf479bdd2] Going to try to terminate instance {{(pid=128758) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:00:50.900650 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-1980432f-4f62-44c1-8614-f00ac9057f98 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:50.910720 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-1980432f-4f62-44c1-8614-f00ac9057f98 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/e6001579-7f6f-4a6b-ada0-d301a142f96b" status: 200 len: 1486 microversion: 2.1 time: 0.212853 Sep 14 09:00:50.911361 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1397/2852] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:00:50 2022] GET /compute/v2.1/servers/e6001579-7f6f-4a6b-ada0-d301a142f96b => generated 1486 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:00:50.920963 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-fdd7f607-4335-4c77-9d27-9bc31810c06e tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:50.921968 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-fdd7f607-4335-4c77-9d27-9bc31810c06e tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: 8f7f80e3-c2f5-4719-a484-29d6bd0d9e91] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:50.925205 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:00:50.932607 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fdd7f607-4335-4c77-9d27-9bc31810c06e tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:50.933322 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fdd7f607-4335-4c77-9d27-9bc31810c06e tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:50.933949 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fdd7f607-4335-4c77-9d27-9bc31810c06e tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:50.937040 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fdd7f607-4335-4c77-9d27-9bc31810c06e tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:50.937692 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fdd7f607-4335-4c77-9d27-9bc31810c06e tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:50.938619 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fdd7f607-4335-4c77-9d27-9bc31810c06e tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:50.945792 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-bd158711-548e-44cd-8820-83b87590a4e7 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] 10.222.0.60 "DELETE /compute/v2.1/servers/9ddb5908-22a9-41c8-909c-39cdf479bdd2" status: 204 len: 0 microversion: 2.75 time: 0.178227 Sep 14 09:00:50.946454 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1456/2853] 10.222.0.60 () {60 vars in 1280 bytes} [Wed Sep 14 09:00:50 2022] DELETE /compute/v2.1/servers/9ddb5908-22a9-41c8-909c-39cdf479bdd2 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 14 09:00:50.956701 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-5dc0ff1f-1bb2-4601-84f6-5ffc3525d645 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Calling method '.version_select at 0x7f7d3fadf1f0>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:51.008026 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-5dc0ff1f-1bb2-4601-84f6-5ffc3525d645 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] 10.222.0.60 "GET /compute/v2.1/images/dad3a300-4c39-4706-a163-fe284681c5e2" status: 200 len: 1454 microversion: 2.1 time: 0.056627 Sep 14 09:00:51.008883 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1457/2854] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:00:50 2022] GET /compute/v2.1/images/dad3a300-4c39-4706-a163-fe284681c5e2 => generated 1454 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:00:51.014723 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-04402dbd-2a85-4463-ae97-3a83bfd337b1 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:51.015569 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-04402dbd-2a85-4463-ae97-3a83bfd337b1 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: e6001579-7f6f-4a6b-ada0-d301a142f96b] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:51.022763 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-04402dbd-2a85-4463-ae97-3a83bfd337b1 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:51.023499 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-04402dbd-2a85-4463-ae97-3a83bfd337b1 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:51.024141 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-04402dbd-2a85-4463-ae97-3a83bfd337b1 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:51.025030 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-04402dbd-2a85-4463-ae97-3a83bfd337b1 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:51.025668 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-04402dbd-2a85-4463-ae97-3a83bfd337b1 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:51.026278 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-04402dbd-2a85-4463-ae97-3a83bfd337b1 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:51.031272 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:00:51.055764 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-04402dbd-2a85-4463-ae97-3a83bfd337b1 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: e6001579-7f6f-4a6b-ada0-d301a142f96b] Going to try to terminate instance {{(pid=128758) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:00:51.139114 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-04402dbd-2a85-4463-ae97-3a83bfd337b1 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "DELETE /compute/v2.1/servers/e6001579-7f6f-4a6b-ada0-d301a142f96b" status: 204 len: 0 microversion: 2.1 time: 0.128200 Sep 14 09:00:51.140073 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1458/2855] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:00:51 2022] DELETE /compute/v2.1/servers/e6001579-7f6f-4a6b-ada0-d301a142f96b => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:00:51.147721 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ccd70166-ff53-4390-af9b-88ce29e538de tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:51.148474 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-ccd70166-ff53-4390-af9b-88ce29e538de tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] [instance: 9ddb5908-22a9-41c8-909c-39cdf479bdd2] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:51.155576 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ccd70166-ff53-4390-af9b-88ce29e538de tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:51.156125 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ccd70166-ff53-4390-af9b-88ce29e538de tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:51.156552 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ccd70166-ff53-4390-af9b-88ce29e538de tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:51.157286 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ccd70166-ff53-4390-af9b-88ce29e538de tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:51.157741 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ccd70166-ff53-4390-af9b-88ce29e538de tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:51.158155 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ccd70166-ff53-4390-af9b-88ce29e538de tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:51.216228 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-fdd7f607-4335-4c77-9d27-9bc31810c06e tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9d40e54481461cba53fedb9a6abdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed2295a58f8451993a57ce0a6f9ba29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:51.225093 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-fdd7f607-4335-4c77-9d27-9bc31810c06e tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7f80e3-c2f5-4719-a484-29d6bd0d9e91" status: 200 len: 1523 microversion: 2.1 time: 0.311585 Sep 14 09:00:51.225758 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1398/2856] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:00:50 2022] GET /compute/v2.1/servers/8f7f80e3-c2f5-4719-a484-29d6bd0d9e91 => generated 1523 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:00:51.240492 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-19caeac5-25d0-4b3f-a47d-74bf1eb35317 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:51.241837 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-19caeac5-25d0-4b3f-a47d-74bf1eb35317 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: e6001579-7f6f-4a6b-ada0-d301a142f96b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:51.244460 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-ccd70166-ff53-4390-af9b-88ce29e538de tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc9edb486f8481a99778bdac0ef3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d168a11f24eeb861d3451e0c270cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:51.250795 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:00:51.252268 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-19caeac5-25d0-4b3f-a47d-74bf1eb35317 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:51.252846 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-ccd70166-ff53-4390-af9b-88ce29e538de tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fdc9edb486f8481a99778bdac0ef3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d168a11f24eeb861d3451e0c270cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:51.253011 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-19caeac5-25d0-4b3f-a47d-74bf1eb35317 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:51.253351 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-19caeac5-25d0-4b3f-a47d-74bf1eb35317 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:51.254134 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-19caeac5-25d0-4b3f-a47d-74bf1eb35317 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:51.254402 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-ccd70166-ff53-4390-af9b-88ce29e538de tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fdc9edb486f8481a99778bdac0ef3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d168a11f24eeb861d3451e0c270cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:51.254535 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-19caeac5-25d0-4b3f-a47d-74bf1eb35317 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:51.255100 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-19caeac5-25d0-4b3f-a47d-74bf1eb35317 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:51.260716 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-ccd70166-ff53-4390-af9b-88ce29e538de tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] 10.222.0.60 "GET /compute/v2.1/servers/9ddb5908-22a9-41c8-909c-39cdf479bdd2" status: 200 len: 1444 microversion: 2.75 time: 0.117675 Sep 14 09:00:51.261319 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1459/2857] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:00:51 2022] GET /compute/v2.1/servers/9ddb5908-22a9-41c8-909c-39cdf479bdd2 => generated 1444 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:00:51.397138 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-19caeac5-25d0-4b3f-a47d-74bf1eb35317 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:51.409772 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-19caeac5-25d0-4b3f-a47d-74bf1eb35317 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/e6001579-7f6f-4a6b-ada0-d301a142f96b" status: 200 len: 1492 microversion: 2.1 time: 0.182513 Sep 14 09:00:51.410162 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1399/2858] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:00:51 2022] GET /compute/v2.1/servers/e6001579-7f6f-4a6b-ada0-d301a142f96b => generated 1492 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:00:51.431987 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-77c575ab-f982-4600-bf24-275c5c54d2bf tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:51.434230 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-77c575ab-f982-4600-bf24-275c5c54d2bf tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] [instance: 885dfd01-8bac-4691-ad0b-f2218e306f2e] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:51.440568 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-77c575ab-f982-4600-bf24-275c5c54d2bf tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:51.441057 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-77c575ab-f982-4600-bf24-275c5c54d2bf tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:51.441494 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-77c575ab-f982-4600-bf24-275c5c54d2bf tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:51.442195 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-77c575ab-f982-4600-bf24-275c5c54d2bf tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:51.442647 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-77c575ab-f982-4600-bf24-275c5c54d2bf tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:51.443176 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-77c575ab-f982-4600-bf24-275c5c54d2bf tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:51.473719 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-77c575ab-f982-4600-bf24-275c5c54d2bf tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] 10.222.0.60 "GET /compute/v2.1/servers/885dfd01-8bac-4691-ad0b-f2218e306f2e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045335 Sep 14 09:00:51.474791 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1460/2859] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 14 09:00:51 2022] GET /compute/v2.1/servers/885dfd01-8bac-4691-ad0b-f2218e306f2e/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 09:00:51.658039 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e3cfeda0-320c-4caf-b908-0b1f95585bc0 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-2020735156", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "networks": [{"uuid": "353cb44b-6e07-4050-8545-17904b39cfe9"}]}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:00:51.716425 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.network.neutron [None req-e3cfeda0-320c-4caf-b908-0b1f95585bc0 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] validate_networks() for [('353cb44b-6e07-4050-8545-17904b39cfe9', None, None, None, None, None)] {{(pid=128759) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:00:52.024383 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a0360686-02ab-4f97-a9c3-4290346345fc tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Calling method '.version_select at 0x7f7d44072550>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:52.085122 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-a0360686-02ab-4f97-a9c3-4290346345fc tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] 10.222.0.60 "GET /compute/v2.1/images/dad3a300-4c39-4706-a163-fe284681c5e2" status: 200 len: 1454 microversion: 2.1 time: 0.064677 Sep 14 09:00:52.093733 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1461/2860] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:00:52 2022] GET /compute/v2.1/images/dad3a300-4c39-4706-a163-fe284681c5e2 => generated 1454 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:00:52.156007 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-e3cfeda0-320c-4caf-b908-0b1f95585bc0 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Flavor limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:00:52.156810 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-e3cfeda0-320c-4caf-b908-0b1f95585bc0 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Image limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:00:52.157571 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-e3cfeda0-320c-4caf-b908-0b1f95585bc0 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Flavor pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:00:52.157979 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-e3cfeda0-320c-4caf-b908-0b1f95585bc0 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Image pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:00:52.158570 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-e3cfeda0-320c-4caf-b908-0b1f95585bc0 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:00:52.167283 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e3cfeda0-320c-4caf-b908-0b1f95585bc0 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:52.168058 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e3cfeda0-320c-4caf-b908-0b1f95585bc0 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:52.168665 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e3cfeda0-320c-4caf-b908-0b1f95585bc0 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:52.169418 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e3cfeda0-320c-4caf-b908-0b1f95585bc0 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:52.170034 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e3cfeda0-320c-4caf-b908-0b1f95585bc0 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:52.170459 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e3cfeda0-320c-4caf-b908-0b1f95585bc0 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:52.188498 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-e3cfeda0-320c-4caf-b908-0b1f95585bc0 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Getting quotas for project de82b83dadd541dbb4a939f2fc04a163. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:00:52.193902 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-e3cfeda0-320c-4caf-b908-0b1f95585bc0 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Getting quotas for user 93ab7166e40e4a908eefbfb03b3b8804 and project de82b83dadd541dbb4a939f2fc04a163. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:00:52.208518 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e3cfeda0-320c-4caf-b908-0b1f95585bc0 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Going to run 1 instances... {{(pid=128759) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:00:52.210835 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e3cfeda0-320c-4caf-b908-0b1f95585bc0 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] [instance: d5c8ab80-5993-4193-8c83-73345637d5eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128759) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:00:52.220449 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-f7373583-84a5-4aa2-9e26-a876443e9886 req-22e6acec-69eb-4390-b9a2-539d8ce54530 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f7f80e3-c2f5-4719-a484-29d6bd0d9e91", "name": "network-vif-unplugged", "status": "completed", "tag": "b19f0267-785e-4700-95e9-c6c0c01d2656"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:00:52.231791 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-f7373583-84a5-4aa2-9e26-a876443e9886 req-22e6acec-69eb-4390-b9a2-539d8ce54530 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:52.232456 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-f7373583-84a5-4aa2-9e26-a876443e9886 req-22e6acec-69eb-4390-b9a2-539d8ce54530 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:52.233060 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-f7373583-84a5-4aa2-9e26-a876443e9886 req-22e6acec-69eb-4390-b9a2-539d8ce54530 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:52.247625 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-f7373583-84a5-4aa2-9e26-a876443e9886 req-22e6acec-69eb-4390-b9a2-539d8ce54530 service nova] Creating event network-vif-unplugged:b19f0267-785e-4700-95e9-c6c0c01d2656 for instance 8f7f80e3-c2f5-4719-a484-29d6bd0d9e91 on n-h2-836830-18 Sep 14 09:00:52.253358 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-f7373583-84a5-4aa2-9e26-a876443e9886 req-22e6acec-69eb-4390-b9a2-539d8ce54530 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037071 Sep 14 09:00:52.254515 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1462/2861] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:00:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:00:52.260634 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-fe87e84a-86d6-4453-a502-4665af367cb9 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:52.261635 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-fe87e84a-86d6-4453-a502-4665af367cb9 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: 8f7f80e3-c2f5-4719-a484-29d6bd0d9e91] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:52.269092 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fe87e84a-86d6-4453-a502-4665af367cb9 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:52.269499 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fe87e84a-86d6-4453-a502-4665af367cb9 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:52.270120 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fe87e84a-86d6-4453-a502-4665af367cb9 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:52.271314 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fe87e84a-86d6-4453-a502-4665af367cb9 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:52.271950 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fe87e84a-86d6-4453-a502-4665af367cb9 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:52.272531 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fe87e84a-86d6-4453-a502-4665af367cb9 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:52.329130 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e3cfeda0-320c-4caf-b908-0b1f95585bc0 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.674642 Sep 14 09:00:52.331837 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1400/2862] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 09:00:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 678 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:00:52.343571 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-2253e6bc-5951-4038-9d32-4727072622ed tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:52.344537 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-2253e6bc-5951-4038-9d32-4727072622ed tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] [instance: 9ddb5908-22a9-41c8-909c-39cdf479bdd2] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:52.354456 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2253e6bc-5951-4038-9d32-4727072622ed tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:52.356170 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2253e6bc-5951-4038-9d32-4727072622ed tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:52.358214 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2253e6bc-5951-4038-9d32-4727072622ed tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:52.359270 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2253e6bc-5951-4038-9d32-4727072622ed tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:52.360058 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2253e6bc-5951-4038-9d32-4727072622ed tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:52.360504 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2253e6bc-5951-4038-9d32-4727072622ed tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:52.451614 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-2253e6bc-5951-4038-9d32-4727072622ed tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc9edb486f8481a99778bdac0ef3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d168a11f24eeb861d3451e0c270cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:52.459213 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-fe87e84a-86d6-4453-a502-4665af367cb9 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9d40e54481461cba53fedb9a6abdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed2295a58f8451993a57ce0a6f9ba29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:52.469629 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-fe87e84a-86d6-4453-a502-4665af367cb9 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7f80e3-c2f5-4719-a484-29d6bd0d9e91" status: 200 len: 1523 microversion: 2.1 time: 0.213705 Sep 14 09:00:52.484932 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1463/2863] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:00:52 2022] GET /compute/v2.1/servers/8f7f80e3-c2f5-4719-a484-29d6bd0d9e91 => generated 1523 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:00:52.484932 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b09cf6e9-3421-4237-b798-7b0b06b11bb4 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:52.484932 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-b09cf6e9-3421-4237-b798-7b0b06b11bb4 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] [instance: d5c8ab80-5993-4193-8c83-73345637d5eb] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:52.485560 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-2253e6bc-5951-4038-9d32-4727072622ed tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fdc9edb486f8481a99778bdac0ef3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d168a11f24eeb861d3451e0c270cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:52.485560 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-2253e6bc-5951-4038-9d32-4727072622ed tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fdc9edb486f8481a99778bdac0ef3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d168a11f24eeb861d3451e0c270cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:52.506656 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-2253e6bc-5951-4038-9d32-4727072622ed tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] 10.222.0.60 "GET /compute/v2.1/servers/9ddb5908-22a9-41c8-909c-39cdf479bdd2" status: 200 len: 1444 microversion: 2.75 time: 0.158345 Sep 14 09:00:52.507335 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1401/2864] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:00:52 2022] GET /compute/v2.1/servers/9ddb5908-22a9-41c8-909c-39cdf479bdd2 => generated 1444 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:00:52.527043 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-101aeb01-6619-4167-9485-04cae8a1e452 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:52.529643 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-101aeb01-6619-4167-9485-04cae8a1e452 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: e6001579-7f6f-4a6b-ada0-d301a142f96b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:52.551962 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-101aeb01-6619-4167-9485-04cae8a1e452 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:52.562265 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-101aeb01-6619-4167-9485-04cae8a1e452 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:52.563094 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-101aeb01-6619-4167-9485-04cae8a1e452 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:52.564530 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-101aeb01-6619-4167-9485-04cae8a1e452 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:52.566437 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-101aeb01-6619-4167-9485-04cae8a1e452 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:52.568344 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-101aeb01-6619-4167-9485-04cae8a1e452 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:52.600505 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-b09cf6e9-3421-4237-b798-7b0b06b11bb4 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ab7166e40e4a908eefbfb03b3b8804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de82b83dadd541dbb4a939f2fc04a163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:52.608931 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-b09cf6e9-3421-4237-b798-7b0b06b11bb4 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] 10.222.0.60 "GET /compute/v2.1/servers/d5c8ab80-5993-4193-8c83-73345637d5eb" status: 200 len: 1218 microversion: 2.1 time: 0.137293 Sep 14 09:00:52.615558 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1464/2865] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:00:52 2022] GET /compute/v2.1/servers/d5c8ab80-5993-4193-8c83-73345637d5eb => generated 1218 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:00:52.793678 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-101aeb01-6619-4167-9485-04cae8a1e452 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:52.803811 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-101aeb01-6619-4167-9485-04cae8a1e452 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/e6001579-7f6f-4a6b-ada0-d301a142f96b" status: 200 len: 1492 microversion: 2.1 time: 0.295410 Sep 14 09:00:52.805313 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1402/2866] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:00:52 2022] GET /compute/v2.1/servers/e6001579-7f6f-4a6b-ada0-d301a142f96b => generated 1492 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:00:53.100846 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-6e93a0a6-9ea1-4f16-b1e0-8c24edf2303d tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Calling method '.version_select at 0x7f7d3faa3b80>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:53.154568 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-6e93a0a6-9ea1-4f16-b1e0-8c24edf2303d tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] 10.222.0.60 "GET /compute/v2.1/images/dad3a300-4c39-4706-a163-fe284681c5e2" status: 200 len: 1454 microversion: 2.1 time: 0.057301 Sep 14 09:00:53.163288 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1465/2867] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:00:53 2022] GET /compute/v2.1/images/dad3a300-4c39-4706-a163-fe284681c5e2 => generated 1454 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:00:53.502265 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-016138f3-8cb1-489c-99f2-23c4d4c029d1 req-7f4b6d68-c26f-4984-a33f-25da3c354ede service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6001579-7f6f-4a6b-ada0-d301a142f96b", "name": "network-vif-deleted", "tag": "2548545f-5fc0-4e22-abed-f9b40b4396b9"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:00:53.504749 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c4982a39-e790-41f0-ae41-55956c5bd02b tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:53.507303 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-c4982a39-e790-41f0-ae41-55956c5bd02b tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: 8f7f80e3-c2f5-4719-a484-29d6bd0d9e91] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:53.515212 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c4982a39-e790-41f0-ae41-55956c5bd02b tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:53.516319 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c4982a39-e790-41f0-ae41-55956c5bd02b tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:53.516995 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c4982a39-e790-41f0-ae41-55956c5bd02b tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:53.518289 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c4982a39-e790-41f0-ae41-55956c5bd02b tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:53.519422 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c4982a39-e790-41f0-ae41-55956c5bd02b tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:53.520215 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c4982a39-e790-41f0-ae41-55956c5bd02b tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:53.521021 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-016138f3-8cb1-489c-99f2-23c4d4c029d1 req-7f4b6d68-c26f-4984-a33f-25da3c354ede service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:53.521606 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-016138f3-8cb1-489c-99f2-23c4d4c029d1 req-7f4b6d68-c26f-4984-a33f-25da3c354ede service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:53.522048 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-016138f3-8cb1-489c-99f2-23c4d4c029d1 req-7f4b6d68-c26f-4984-a33f-25da3c354ede service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:53.547528 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-016138f3-8cb1-489c-99f2-23c4d4c029d1 req-7f4b6d68-c26f-4984-a33f-25da3c354ede service nova] Creating event network-vif-deleted:2548545f-5fc0-4e22-abed-f9b40b4396b9 for instance e6001579-7f6f-4a6b-ada0-d301a142f96b on n-h1-836830-18 Sep 14 09:00:53.561456 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-016138f3-8cb1-489c-99f2-23c4d4c029d1 req-7f4b6d68-c26f-4984-a33f-25da3c354ede service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064076 Sep 14 09:00:53.562075 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1466/2868] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:00:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:00:53.582084 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-66444793-6a41-4e9c-9580-a564a757d030 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:53.583018 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-66444793-6a41-4e9c-9580-a564a757d030 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] [instance: 9ddb5908-22a9-41c8-909c-39cdf479bdd2] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:53.590505 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-66444793-6a41-4e9c-9580-a564a757d030 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:53.591294 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-66444793-6a41-4e9c-9580-a564a757d030 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:53.591888 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-66444793-6a41-4e9c-9580-a564a757d030 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:53.592829 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-66444793-6a41-4e9c-9580-a564a757d030 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:53.593535 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-66444793-6a41-4e9c-9580-a564a757d030 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:53.594747 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-66444793-6a41-4e9c-9580-a564a757d030 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:53.616957 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-66444793-6a41-4e9c-9580-a564a757d030 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] HTTP exception thrown: Instance 9ddb5908-22a9-41c8-909c-39cdf479bdd2 could not be found. Sep 14 09:00:53.618643 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-66444793-6a41-4e9c-9580-a564a757d030 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Request method failure captured: Sep 14 09:00:53.618643 n-d-836830-18 devstack@n-api.service[128758]: request: GET /compute/v2.1/servers/9ddb5908-22a9-41c8-909c-39cdf479bdd2 HTTP/1.1 Sep 14 09:00:53.618643 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 09:00:53.618643 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 09:00:53.618643 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 09:00:53.618643 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 09:00:53.618643 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 09:00:53.618643 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 09:00:53.618643 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 09:00:53.618643 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 09:00:53.618643 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZfy2wF4g5ddf4F9gHQicGkhbZ8M669Vazs_TtrFDRnQmbVdQ3ji1kWAfSlP0YyAlB5FHnwuAS80hVAkjdj4NQnR2HfstH81YOn0hFPVzPhqOWKqdFtwda0cuttoeIlJK98rdZTrQxQVpRSVhZBtRp0jWyhnTG2gpeH-5kzw75v-NS0 Sep 14 09:00:53.618643 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 09:00:53.618643 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 09:00:53.618643 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 09:00:53.618643 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 09:00:53.618643 n-d-836830-18 devstack@n-api.service[128758]: X-Openstack-Nova-Api-Version: 2.75 Sep 14 09:00:53.618643 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 09:00:53.618643 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 09:00:53.618643 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 336d168a11f24eeb861d3451e0c270cc Sep 14 09:00:53.618643 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-ServersAdmin275Test-79248800 Sep 14 09:00:53.618643 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 09:00:53.618643 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 09:00:53.618643 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/336d168a11f24eeb861d3451e0c270cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_336d168a11f24eeb861d3451e0c270cc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/336d168a11f24eeb861d3451e0c270cc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/336d168a11f24eeb861d3451e0c270cc"}]}] Sep 14 09:00:53.618643 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-ServersAdmin275Test-79248800 Sep 14 09:00:53.618643 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 336d168a11f24eeb861d3451e0c270cc Sep 14 09:00:53.618643 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-ServersAdmin275Test-79248800 Sep 14 09:00:53.618643 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-ServersAdmin275Test-79248800-project Sep 14 09:00:53.618643 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 09:00:53.618643 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 09:00:53.618643 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: fdc9edb486f8481a99778bdac0ef3d6d Sep 14 09:00:53.618643 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-ServersAdmin275Test-79248800-project Sep 14 09:00:53.618643 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 09:00:53.618643 n-d-836830-18 devstack@n-api.service[128758]: exception: Instance 9ddb5908-22a9-41c8-909c-39cdf479bdd2 could not be found. Sep 14 09:00:53.618643 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': '9ddb5908-22a9-41c8-909c-39cdf479bdd2'} Sep 14 09:00:53.618643 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:00:53.618643 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:00:53.618643 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:00:53.618643 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:00:53.618643 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:00:53.618643 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:00:53.618643 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:00:53.618643 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:00:53.618643 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:00:53.618643 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:00:53.618643 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ddb5908-22a9-41c8-909c-39cdf479bdd2 could not be found. Sep 14 09:00:53.618643 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:00:53.618643 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:00:53.618643 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:00:53.618643 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:00:53.618643 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:00:53.618643 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:00:53.618643 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:00:53.618643 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:00:53.618643 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:00:53.618643 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:00:53.618643 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:00:53.618643 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:00:53.618643 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:00:53.618643 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:00:53.618643 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:00:53.618643 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:00:53.618643 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ddb5908-22a9-41c8-909c-39cdf479bdd2 could not be found. Sep 14 09:00:53.618643 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:00:53.618643 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:00:53.618643 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:00:53.624628 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:00:53.624628 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:00:53.624628 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:00:53.624628 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:00:53.624628 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:00:53.624628 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ddb5908-22a9-41c8-909c-39cdf479bdd2 could not be found. Sep 14 09:00:53.624628 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:00:53.624628 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-66444793-6a41-4e9c-9580-a564a757d030 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] Returning 404 to user: Instance 9ddb5908-22a9-41c8-909c-39cdf479bdd2 could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:00:53.624628 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-66444793-6a41-4e9c-9580-a564a757d030 tempest-ServersAdmin275Test-79248800 tempest-ServersAdmin275Test-79248800-project] 10.222.0.60 "GET /compute/v2.1/servers/9ddb5908-22a9-41c8-909c-39cdf479bdd2" status: 404 len: 111 microversion: 2.75 time: 0.045698 Sep 14 09:00:53.625693 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1467/2869] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:00:53 2022] GET /compute/v2.1/servers/9ddb5908-22a9-41c8-909c-39cdf479bdd2 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 14 09:00:53.635638 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-6cb08b58-623f-4225-8e02-5abff12277cb tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:53.636258 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-6cb08b58-623f-4225-8e02-5abff12277cb tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] [instance: d5c8ab80-5993-4193-8c83-73345637d5eb] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:53.658310 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6cb08b58-623f-4225-8e02-5abff12277cb tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:53.661164 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6cb08b58-623f-4225-8e02-5abff12277cb tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:53.662590 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6cb08b58-623f-4225-8e02-5abff12277cb tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:53.663430 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6cb08b58-623f-4225-8e02-5abff12277cb tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:53.663902 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6cb08b58-623f-4225-8e02-5abff12277cb tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:53.666392 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6cb08b58-623f-4225-8e02-5abff12277cb tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:53.890251 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-c4982a39-e790-41f0-ae41-55956c5bd02b tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9d40e54481461cba53fedb9a6abdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed2295a58f8451993a57ce0a6f9ba29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:53.904160 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-c4982a39-e790-41f0-ae41-55956c5bd02b tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7f80e3-c2f5-4719-a484-29d6bd0d9e91" status: 200 len: 1523 microversion: 2.1 time: 0.414716 Sep 14 09:00:53.905276 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1403/2870] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:00:53 2022] GET /compute/v2.1/servers/8f7f80e3-c2f5-4719-a484-29d6bd0d9e91 => generated 1523 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:00:53.916191 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9c70d2b1-0419-444a-b749-14e2755c937b tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:53.917044 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-9c70d2b1-0419-444a-b749-14e2755c937b tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: e6001579-7f6f-4a6b-ada0-d301a142f96b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:53.926231 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9c70d2b1-0419-444a-b749-14e2755c937b tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:53.927779 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9c70d2b1-0419-444a-b749-14e2755c937b tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:53.928458 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9c70d2b1-0419-444a-b749-14e2755c937b tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:53.929304 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9c70d2b1-0419-444a-b749-14e2755c937b tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:53.930094 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9c70d2b1-0419-444a-b749-14e2755c937b tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:53.930657 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9c70d2b1-0419-444a-b749-14e2755c937b tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:53.986810 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9c70d2b1-0419-444a-b749-14e2755c937b tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:53.987973 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9c70d2b1-0419-444a-b749-14e2755c937b tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:53.988688 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9c70d2b1-0419-444a-b749-14e2755c937b tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:53.989389 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.objects.instance [None req-9c70d2b1-0419-444a-b749-14e2755c937b tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lazy-loading 'fault' on Instance uuid e6001579-7f6f-4a6b-ada0-d301a142f96b {{(pid=128759) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:00:54.100540 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-9c70d2b1-0419-444a-b749-14e2755c937b tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:54.114812 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-9c70d2b1-0419-444a-b749-14e2755c937b tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/e6001579-7f6f-4a6b-ada0-d301a142f96b" status: 200 len: 1304 microversion: 2.1 time: 0.202890 Sep 14 09:00:54.117819 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1404/2871] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:00:53 2022] GET /compute/v2.1/servers/e6001579-7f6f-4a6b-ada0-d301a142f96b => generated 1304 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:00:54.154484 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-6cb08b58-623f-4225-8e02-5abff12277cb tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ab7166e40e4a908eefbfb03b3b8804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de82b83dadd541dbb4a939f2fc04a163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:54.163871 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-6cb08b58-623f-4225-8e02-5abff12277cb tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] 10.222.0.60 "GET /compute/v2.1/servers/d5c8ab80-5993-4193-8c83-73345637d5eb" status: 200 len: 1270 microversion: 2.1 time: 0.531428 Sep 14 09:00:54.164678 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1468/2872] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:00:53 2022] GET /compute/v2.1/servers/d5c8ab80-5993-4193-8c83-73345637d5eb => generated 1270 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:00:54.173793 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b8f847a9-b11f-46ca-8899-df027752b9cc tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Calling method '.version_select at 0x7f7d486630d0>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:54.242893 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b8f847a9-b11f-46ca-8899-df027752b9cc tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] 10.222.0.60 "GET /compute/v2.1/images/dad3a300-4c39-4706-a163-fe284681c5e2" status: 200 len: 1454 microversion: 2.1 time: 0.075626 Sep 14 09:00:54.244350 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1405/2873] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:00:54 2022] GET /compute/v2.1/images/dad3a300-4c39-4706-a163-fe284681c5e2 => generated 1454 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:00:54.297769 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-2afa064b-7430-4ce7-afdf-f031300ad9df req-d28ad68f-64a2-4ad0-943f-1b7e92ef7ec9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebf9bfa9-e941-4d23-8f6c-9867102feff2", "name": "network-vif-plugged", "status": "completed", "tag": "a16e0c89-9089-483d-ae3b-f83433826e96"}, {"server_uuid": "8f7f80e3-c2f5-4719-a484-29d6bd0d9e91", "name": "network-vif-plugged", "status": "completed", "tag": "b19f0267-785e-4700-95e9-c6c0c01d2656"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:00:54.329371 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-2afa064b-7430-4ce7-afdf-f031300ad9df req-d28ad68f-64a2-4ad0-943f-1b7e92ef7ec9 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:54.331446 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-2afa064b-7430-4ce7-afdf-f031300ad9df req-d28ad68f-64a2-4ad0-943f-1b7e92ef7ec9 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:54.333949 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-2afa064b-7430-4ce7-afdf-f031300ad9df req-d28ad68f-64a2-4ad0-943f-1b7e92ef7ec9 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:54.394656 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-2afa064b-7430-4ce7-afdf-f031300ad9df req-d28ad68f-64a2-4ad0-943f-1b7e92ef7ec9 service nova] Creating event network-vif-plugged:a16e0c89-9089-483d-ae3b-f83433826e96 for instance ebf9bfa9-e941-4d23-8f6c-9867102feff2 on n-h1-836830-18 Sep 14 09:00:54.396136 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-2afa064b-7430-4ce7-afdf-f031300ad9df req-d28ad68f-64a2-4ad0-943f-1b7e92ef7ec9 service nova] Creating event network-vif-plugged:b19f0267-785e-4700-95e9-c6c0c01d2656 for instance 8f7f80e3-c2f5-4719-a484-29d6bd0d9e91 on n-h2-836830-18 Sep 14 09:00:54.418255 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-2afa064b-7430-4ce7-afdf-f031300ad9df req-d28ad68f-64a2-4ad0-943f-1b7e92ef7ec9 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.120572 Sep 14 09:00:54.419186 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1469/2874] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:00:54 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:00:54.939172 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-4ab04f94-7537-493c-bde4-f6f624671195 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:54.939968 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-4ab04f94-7537-493c-bde4-f6f624671195 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: 8f7f80e3-c2f5-4719-a484-29d6bd0d9e91] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:54.965090 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4ab04f94-7537-493c-bde4-f6f624671195 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:54.965647 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4ab04f94-7537-493c-bde4-f6f624671195 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:54.966105 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4ab04f94-7537-493c-bde4-f6f624671195 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:54.972041 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4ab04f94-7537-493c-bde4-f6f624671195 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:54.972549 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4ab04f94-7537-493c-bde4-f6f624671195 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:54.980058 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4ab04f94-7537-493c-bde4-f6f624671195 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:55.152427 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ee5effaa-0006-49b0-9146-f40db0b71a82 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:55.153716 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-ee5effaa-0006-49b0-9146-f40db0b71a82 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: e6001579-7f6f-4a6b-ada0-d301a142f96b] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:55.180806 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ee5effaa-0006-49b0-9146-f40db0b71a82 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:55.183589 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ee5effaa-0006-49b0-9146-f40db0b71a82 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:55.186546 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ee5effaa-0006-49b0-9146-f40db0b71a82 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:55.198417 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ee5effaa-0006-49b0-9146-f40db0b71a82 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:55.203895 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ee5effaa-0006-49b0-9146-f40db0b71a82 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:55.205824 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ee5effaa-0006-49b0-9146-f40db0b71a82 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:55.290253 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-ee5effaa-0006-49b0-9146-f40db0b71a82 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] HTTP exception thrown: Instance e6001579-7f6f-4a6b-ada0-d301a142f96b could not be found. Sep 14 09:00:55.297976 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ee5effaa-0006-49b0-9146-f40db0b71a82 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Request method failure captured: Sep 14 09:00:55.297976 n-d-836830-18 devstack@n-api.service[128758]: request: GET /compute/v2.1/servers/e6001579-7f6f-4a6b-ada0-d301a142f96b HTTP/1.1 Sep 14 09:00:55.297976 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 09:00:55.297976 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 09:00:55.297976 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 09:00:55.297976 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 09:00:55.297976 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 09:00:55.297976 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 09:00:55.297976 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 09:00:55.297976 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 09:00:55.297976 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZfruMTQYBTAiiDSnzM1mYEpmuEj9qljISQOJ4EBe2ad6zsfFzAf8FVBubQCt-Sdr-zCKCq1jxjsj_azLMK_SQWZ09VXr62FV-261vpzTW6inln_93a6hl3DeVdX6cuYwx-Go-beMey4bY4s6iPFtULEKgIbxHUgjvgK1DEFOEvCwSQ Sep 14 09:00:55.297976 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 09:00:55.297976 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 09:00:55.297976 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 09:00:55.297976 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 09:00:55.297976 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 09:00:55.297976 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 09:00:55.297976 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 4d42bf4d573b4bf9a0d8c9e73260af7e Sep 14 09:00:55.297976 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-DeleteServersTestJSON-1669995002 Sep 14 09:00:55.297976 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 09:00:55.297976 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 09:00:55.297976 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/4d42bf4d573b4bf9a0d8c9e73260af7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_4d42bf4d573b4bf9a0d8c9e73260af7e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4d42bf4d573b4bf9a0d8c9e73260af7e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4d42bf4d573b4bf9a0d8c9e73260af7e"}]}] Sep 14 09:00:55.297976 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-DeleteServersTestJSON-1669995002 Sep 14 09:00:55.297976 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 4d42bf4d573b4bf9a0d8c9e73260af7e Sep 14 09:00:55.297976 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-DeleteServersTestJSON-1669995002 Sep 14 09:00:55.297976 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-DeleteServersTestJSON-1669995002-project Sep 14 09:00:55.297976 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 09:00:55.297976 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 09:00:55.297976 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 47c95b28481b451bb03fb2c0240d0310 Sep 14 09:00:55.297976 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-DeleteServersTestJSON-1669995002-project Sep 14 09:00:55.297976 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 09:00:55.297976 n-d-836830-18 devstack@n-api.service[128758]: exception: Instance e6001579-7f6f-4a6b-ada0-d301a142f96b could not be found. Sep 14 09:00:55.297976 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': 'e6001579-7f6f-4a6b-ada0-d301a142f96b'} Sep 14 09:00:55.297976 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:00:55.297976 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:00:55.297976 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:00:55.297976 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:00:55.297976 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:00:55.297976 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:00:55.297976 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:00:55.297976 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:00:55.297976 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:00:55.297976 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:00:55.297976 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6001579-7f6f-4a6b-ada0-d301a142f96b could not be found. Sep 14 09:00:55.297976 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:00:55.297976 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:00:55.297976 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:00:55.297976 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:00:55.297976 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:00:55.297976 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:00:55.297976 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:00:55.297976 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:00:55.297976 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:00:55.297976 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:00:55.297976 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:00:55.297976 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:00:55.297976 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:00:55.297976 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:00:55.297976 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:00:55.297976 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:00:55.297976 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6001579-7f6f-4a6b-ada0-d301a142f96b could not be found. Sep 14 09:00:55.297976 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:00:55.297976 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:00:55.297976 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:00:55.304221 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:00:55.304221 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:00:55.304221 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:00:55.304221 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:00:55.304221 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:00:55.304221 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6001579-7f6f-4a6b-ada0-d301a142f96b could not be found. Sep 14 09:00:55.304221 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:00:55.304221 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ee5effaa-0006-49b0-9146-f40db0b71a82 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Returning 404 to user: Instance e6001579-7f6f-4a6b-ada0-d301a142f96b could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:00:55.304221 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-ee5effaa-0006-49b0-9146-f40db0b71a82 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/e6001579-7f6f-4a6b-ada0-d301a142f96b" status: 404 len: 111 microversion: 2.1 time: 0.164269 Sep 14 09:00:55.307320 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1470/2875] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:00:55 2022] GET /compute/v2.1/servers/e6001579-7f6f-4a6b-ada0-d301a142f96b => generated 111 bytes in 170 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 14 09:00:55.313090 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-fcf5603c-3113-4327-a2c2-4248c57c1651 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:55.319742 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-fcf5603c-3113-4327-a2c2-4248c57c1651 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] [instance: d5c8ab80-5993-4193-8c83-73345637d5eb] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:55.325182 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-4ab04f94-7537-493c-bde4-f6f624671195 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9d40e54481461cba53fedb9a6abdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed2295a58f8451993a57ce0a6f9ba29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:55.335716 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fcf5603c-3113-4327-a2c2-4248c57c1651 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:55.336903 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fcf5603c-3113-4327-a2c2-4248c57c1651 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:55.338340 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fcf5603c-3113-4327-a2c2-4248c57c1651 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:55.339123 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fcf5603c-3113-4327-a2c2-4248c57c1651 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:55.339889 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fcf5603c-3113-4327-a2c2-4248c57c1651 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:55.341021 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-4ab04f94-7537-493c-bde4-f6f624671195 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7f80e3-c2f5-4719-a484-29d6bd0d9e91" status: 200 len: 1523 microversion: 2.1 time: 0.411611 Sep 14 09:00:55.342039 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fcf5603c-3113-4327-a2c2-4248c57c1651 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:55.342994 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1406/2876] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:00:54 2022] GET /compute/v2.1/servers/8f7f80e3-c2f5-4719-a484-29d6bd0d9e91 => generated 1523 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:00:55.349875 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9cc5a663-c9e6-4e27-ab3a-6c82ae91f189 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Calling method '.version_select at 0x7f7d4863a040>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:55.453166 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-fcf5603c-3113-4327-a2c2-4248c57c1651 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ab7166e40e4a908eefbfb03b3b8804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de82b83dadd541dbb4a939f2fc04a163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:55.475031 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-fcf5603c-3113-4327-a2c2-4248c57c1651 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] 10.222.0.60 "GET /compute/v2.1/servers/d5c8ab80-5993-4193-8c83-73345637d5eb" status: 200 len: 1276 microversion: 2.1 time: 0.162147 Sep 14 09:00:55.477381 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1471/2877] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:00:55 2022] GET /compute/v2.1/servers/d5c8ab80-5993-4193-8c83-73345637d5eb => generated 1276 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:00:55.480520 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-9cc5a663-c9e6-4e27-ab3a-6c82ae91f189 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] 10.222.0.60 "GET /compute/v2.1/images/dad3a300-4c39-4706-a163-fe284681c5e2" status: 200 len: 1454 microversion: 2.1 time: 0.134245 Sep 14 09:00:55.482324 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1407/2878] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:00:55 2022] GET /compute/v2.1/images/dad3a300-4c39-4706-a163-fe284681c5e2 => generated 1454 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:00:55.634913 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-197143d6-709e-4e06-ae82-e6dcd978ed41 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1692804584", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "networks": [{"uuid": "b9ab2062-a108-4d91-8f37-c911ce062678"}]}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:00:55.775177 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.network.neutron [None req-197143d6-709e-4e06-ae82-e6dcd978ed41 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] validate_networks() for [('b9ab2062-a108-4d91-8f37-c911ce062678', None, None, None, None, None)] {{(pid=128758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:00:56.370565 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-523005e8-7f75-4702-a881-b6db95ef5a51 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:56.371915 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-523005e8-7f75-4702-a881-b6db95ef5a51 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: 8f7f80e3-c2f5-4719-a484-29d6bd0d9e91] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:56.390254 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-523005e8-7f75-4702-a881-b6db95ef5a51 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:56.393347 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-523005e8-7f75-4702-a881-b6db95ef5a51 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:56.393848 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-523005e8-7f75-4702-a881-b6db95ef5a51 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:56.396169 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-523005e8-7f75-4702-a881-b6db95ef5a51 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:56.396839 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-523005e8-7f75-4702-a881-b6db95ef5a51 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:56.399980 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-523005e8-7f75-4702-a881-b6db95ef5a51 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:56.414382 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=100 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:00:56.597627 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-197143d6-709e-4e06-ae82-e6dcd978ed41 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Flavor limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:00:56.598093 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-197143d6-709e-4e06-ae82-e6dcd978ed41 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Image limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:00:56.598896 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-197143d6-709e-4e06-ae82-e6dcd978ed41 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Flavor pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:00:56.599351 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-197143d6-709e-4e06-ae82-e6dcd978ed41 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Image pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:00:56.599779 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-197143d6-709e-4e06-ae82-e6dcd978ed41 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:00:56.609958 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-197143d6-709e-4e06-ae82-e6dcd978ed41 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:56.611236 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-197143d6-709e-4e06-ae82-e6dcd978ed41 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:56.611844 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-197143d6-709e-4e06-ae82-e6dcd978ed41 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:56.612822 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-197143d6-709e-4e06-ae82-e6dcd978ed41 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:56.613500 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-197143d6-709e-4e06-ae82-e6dcd978ed41 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:56.614092 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-197143d6-709e-4e06-ae82-e6dcd978ed41 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:56.634508 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-197143d6-709e-4e06-ae82-e6dcd978ed41 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Getting quotas for project 4d42bf4d573b4bf9a0d8c9e73260af7e. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:00:56.641408 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-197143d6-709e-4e06-ae82-e6dcd978ed41 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Getting quotas for user 47c95b28481b451bb03fb2c0240d0310 and project 4d42bf4d573b4bf9a0d8c9e73260af7e. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:00:56.661387 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-197143d6-709e-4e06-ae82-e6dcd978ed41 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Going to run 1 instances... {{(pid=128758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:00:56.665711 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-197143d6-709e-4e06-ae82-e6dcd978ed41 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: 680c3968-8912-45c4-b1c3-634c06ec30c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:00:56.747354 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-197143d6-709e-4e06-ae82-e6dcd978ed41 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.110685 Sep 14 09:00:56.748357 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1472/2879] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 09:00:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1119 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:00:56.758901 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-4b80fe09-8d6d-401e-96c8-475888fb3519 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Calling method '.version_select at 0x7f7d44027310>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:56.818788 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-523005e8-7f75-4702-a881-b6db95ef5a51 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9d40e54481461cba53fedb9a6abdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed2295a58f8451993a57ce0a6f9ba29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:56.828386 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-523005e8-7f75-4702-a881-b6db95ef5a51 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7f80e3-c2f5-4719-a484-29d6bd0d9e91" status: 200 len: 1508 microversion: 2.1 time: 0.466263 Sep 14 09:00:56.844862 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1408/2880] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:00:56 2022] GET /compute/v2.1/servers/8f7f80e3-c2f5-4719-a484-29d6bd0d9e91 => generated 1508 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:00:56.863570 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-daa44922-e102-4c97-bfaf-ce2f892491a5 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:56.864390 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-daa44922-e102-4c97-bfaf-ce2f892491a5 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] [instance: d5c8ab80-5993-4193-8c83-73345637d5eb] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:56.888710 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-daa44922-e102-4c97-bfaf-ce2f892491a5 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:56.892379 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-daa44922-e102-4c97-bfaf-ce2f892491a5 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:56.893748 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-daa44922-e102-4c97-bfaf-ce2f892491a5 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:56.895742 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-daa44922-e102-4c97-bfaf-ce2f892491a5 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:56.897503 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-daa44922-e102-4c97-bfaf-ce2f892491a5 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:56.899393 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-daa44922-e102-4c97-bfaf-ce2f892491a5 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:56.907325 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-4b80fe09-8d6d-401e-96c8-475888fb3519 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] 10.222.0.60 "GET /compute/v2.1/images/dad3a300-4c39-4706-a163-fe284681c5e2" status: 200 len: 1454 microversion: 2.1 time: 0.157347 Sep 14 09:00:56.917922 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1473/2881] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:00:56 2022] GET /compute/v2.1/images/dad3a300-4c39-4706-a163-fe284681c5e2 => generated 1454 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:00:56.945720 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-53d58cc2-5ccb-4fba-8db3-547c5f0dab6f tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:56.949189 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-53d58cc2-5ccb-4fba-8db3-547c5f0dab6f tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: 680c3968-8912-45c4-b1c3-634c06ec30c3] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:57.228191 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-53d58cc2-5ccb-4fba-8db3-547c5f0dab6f tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:57.237108 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-53d58cc2-5ccb-4fba-8db3-547c5f0dab6f tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/680c3968-8912-45c4-b1c3-634c06ec30c3" status: 200 len: 1215 microversion: 2.1 time: 0.318042 Sep 14 09:00:57.246519 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1474/2882] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:00:56 2022] GET /compute/v2.1/servers/680c3968-8912-45c4-b1c3-634c06ec30c3 => generated 1215 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:00:57.260777 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ef64c483-e59b-442c-a070-007b5364b4fe tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:57.261651 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-ef64c483-e59b-442c-a070-007b5364b4fe tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: 8f7f80e3-c2f5-4719-a484-29d6bd0d9e91] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:57.276359 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ef64c483-e59b-442c-a070-007b5364b4fe tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:57.279988 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ef64c483-e59b-442c-a070-007b5364b4fe tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:57.280707 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ef64c483-e59b-442c-a070-007b5364b4fe tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:57.286957 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ef64c483-e59b-442c-a070-007b5364b4fe tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:57.288894 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ef64c483-e59b-442c-a070-007b5364b4fe tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:57.298706 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ef64c483-e59b-442c-a070-007b5364b4fe tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:57.480426 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-daa44922-e102-4c97-bfaf-ce2f892491a5 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ab7166e40e4a908eefbfb03b3b8804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de82b83dadd541dbb4a939f2fc04a163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:57.502608 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-daa44922-e102-4c97-bfaf-ce2f892491a5 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] 10.222.0.60 "GET /compute/v2.1/servers/d5c8ab80-5993-4193-8c83-73345637d5eb" status: 200 len: 1318 microversion: 2.1 time: 0.648437 Sep 14 09:00:57.503435 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1409/2883] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:00:56 2022] GET /compute/v2.1/servers/d5c8ab80-5993-4193-8c83-73345637d5eb => generated 1318 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:00:57.676297 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-ef64c483-e59b-442c-a070-007b5364b4fe tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9d40e54481461cba53fedb9a6abdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed2295a58f8451993a57ce0a6f9ba29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:57.689199 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-ef64c483-e59b-442c-a070-007b5364b4fe tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7f80e3-c2f5-4719-a484-29d6bd0d9e91" status: 200 len: 1508 microversion: 2.1 time: 0.440507 Sep 14 09:00:57.691978 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1475/2884] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:00:57 2022] GET /compute/v2.1/servers/8f7f80e3-c2f5-4719-a484-29d6bd0d9e91 => generated 1508 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:00:57.719319 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-fcf08a6d-bdc4-4228-a163-f88159c7a965 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:57.723155 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-fcf08a6d-bdc4-4228-a163-f88159c7a965 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: 8f7f80e3-c2f5-4719-a484-29d6bd0d9e91] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:57.742530 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fcf08a6d-bdc4-4228-a163-f88159c7a965 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:57.748184 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fcf08a6d-bdc4-4228-a163-f88159c7a965 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:57.750273 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fcf08a6d-bdc4-4228-a163-f88159c7a965 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:57.752544 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fcf08a6d-bdc4-4228-a163-f88159c7a965 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:57.753093 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fcf08a6d-bdc4-4228-a163-f88159c7a965 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:57.753561 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fcf08a6d-bdc4-4228-a163-f88159c7a965 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:57.859889 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-fcf08a6d-bdc4-4228-a163-f88159c7a965 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: 8f7f80e3-c2f5-4719-a484-29d6bd0d9e91] Going to try to terminate instance {{(pid=128759) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:00:57.929151 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-883fbad3-f1ce-4277-8f86-f836cf1cc7d5 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Calling method '.version_select at 0x7f7d440968b0>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:58.063434 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-883fbad3-f1ce-4277-8f86-f836cf1cc7d5 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] 10.222.0.60 "GET /compute/v2.1/images/dad3a300-4c39-4706-a163-fe284681c5e2" status: 200 len: 1454 microversion: 2.1 time: 0.139609 Sep 14 09:00:58.066856 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1476/2885] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:00:57 2022] GET /compute/v2.1/images/dad3a300-4c39-4706-a163-fe284681c5e2 => generated 1454 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:00:58.084746 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-22cc470d-3201-49df-93cc-020c5df582e8 req-58efb656-c9fb-408b-8e1a-81965fa41339 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5c8ab80-5993-4193-8c83-73345637d5eb", "tag": "88822778-5011-41f7-8715-6e0999a5aaee"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:00:58.118149 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-22cc470d-3201-49df-93cc-020c5df582e8 req-58efb656-c9fb-408b-8e1a-81965fa41339 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:58.124732 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-22cc470d-3201-49df-93cc-020c5df582e8 req-58efb656-c9fb-408b-8e1a-81965fa41339 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:58.126603 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-22cc470d-3201-49df-93cc-020c5df582e8 req-58efb656-c9fb-408b-8e1a-81965fa41339 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:58.151693 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-fcf08a6d-bdc4-4228-a163-f88159c7a965 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] 10.222.0.60 "DELETE /compute/v2.1/servers/8f7f80e3-c2f5-4719-a484-29d6bd0d9e91" status: 204 len: 0 microversion: 2.1 time: 0.437286 Sep 14 09:00:58.155682 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1410/2886] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:00:57 2022] DELETE /compute/v2.1/servers/8f7f80e3-c2f5-4719-a484-29d6bd0d9e91 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:00:58.172512 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-22cc470d-3201-49df-93cc-020c5df582e8 req-58efb656-c9fb-408b-8e1a-81965fa41339 service nova] Creating event network-changed:88822778-5011-41f7-8715-6e0999a5aaee for instance d5c8ab80-5993-4193-8c83-73345637d5eb on n-h2-836830-18 Sep 14 09:00:58.178483 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-22cc470d-3201-49df-93cc-020c5df582e8 req-58efb656-c9fb-408b-8e1a-81965fa41339 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109606 Sep 14 09:00:58.179440 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1477/2887] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:00:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:00:58.272109 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-6bbba35e-adfb-4993-9e0b-caa63dc560e2 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:58.273266 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-6bbba35e-adfb-4993-9e0b-caa63dc560e2 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: 680c3968-8912-45c4-b1c3-634c06ec30c3] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:58.291902 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6bbba35e-adfb-4993-9e0b-caa63dc560e2 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:58.292499 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6bbba35e-adfb-4993-9e0b-caa63dc560e2 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:58.293010 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6bbba35e-adfb-4993-9e0b-caa63dc560e2 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:58.294399 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6bbba35e-adfb-4993-9e0b-caa63dc560e2 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:58.294916 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6bbba35e-adfb-4993-9e0b-caa63dc560e2 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:58.295476 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6bbba35e-adfb-4993-9e0b-caa63dc560e2 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:58.345865 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a1642ab1-468d-4bc5-b876-77d263abc39f tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-399474502", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "networks": [{"uuid": "74ca5aa6-7711-43a3-8680-b63fc6f25063"}]}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:00:58.495660 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.network.neutron [None req-a1642ab1-468d-4bc5-b876-77d263abc39f tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] validate_networks() for [('74ca5aa6-7711-43a3-8680-b63fc6f25063', None, None, None, None, None)] {{(pid=128758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:00:58.507420 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-6bbba35e-adfb-4993-9e0b-caa63dc560e2 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:58.518883 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-6bbba35e-adfb-4993-9e0b-caa63dc560e2 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/680c3968-8912-45c4-b1c3-634c06ec30c3" status: 200 len: 1267 microversion: 2.1 time: 0.253148 Sep 14 09:00:58.523606 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1411/2888] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:00:58 2022] GET /compute/v2.1/servers/680c3968-8912-45c4-b1c3-634c06ec30c3 => generated 1267 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:00:58.539219 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-6a18a1ad-b5bc-46b3-8c6f-eb334c4db473 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:00:58.540562 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-6a18a1ad-b5bc-46b3-8c6f-eb334c4db473 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] [instance: d5c8ab80-5993-4193-8c83-73345637d5eb] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:00:58.563673 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6a18a1ad-b5bc-46b3-8c6f-eb334c4db473 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:58.564272 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6a18a1ad-b5bc-46b3-8c6f-eb334c4db473 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:58.577695 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6a18a1ad-b5bc-46b3-8c6f-eb334c4db473 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:58.578595 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6a18a1ad-b5bc-46b3-8c6f-eb334c4db473 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:00:58.579608 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6a18a1ad-b5bc-46b3-8c6f-eb334c4db473 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:00:58.580182 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6a18a1ad-b5bc-46b3-8c6f-eb334c4db473 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:00:59.926172 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-6a18a1ad-b5bc-46b3-8c6f-eb334c4db473 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ab7166e40e4a908eefbfb03b3b8804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de82b83dadd541dbb4a939f2fc04a163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:00:59.938423 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-6a18a1ad-b5bc-46b3-8c6f-eb334c4db473 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] 10.222.0.60 "GET /compute/v2.1/servers/d5c8ab80-5993-4193-8c83-73345637d5eb" status: 200 len: 1318 microversion: 2.1 time: 1.411116 Sep 14 09:00:59.939955 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1412/2889] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:00:58 2022] GET /compute/v2.1/servers/d5c8ab80-5993-4193-8c83-73345637d5eb => generated 1318 bytes in 1416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:00:59.949867 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f25ce447-38b3-46b8-b427-ea0e8968896a tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Calling method '.version_select at 0x7f7d486cfca0>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:00.063453 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f25ce447-38b3-46b8-b427-ea0e8968896a tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] 10.222.0.60 "GET /compute/v2.1/images/dad3a300-4c39-4706-a163-fe284681c5e2" status: 200 len: 1454 microversion: 2.1 time: 0.120018 Sep 14 09:01:00.066569 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1413/2890] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:00:59 2022] GET /compute/v2.1/images/dad3a300-4c39-4706-a163-fe284681c5e2 => generated 1454 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:01:00.081013 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-2c55f5da-2924-4492-b16a-54deb6544c46 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:00.084657 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-2c55f5da-2924-4492-b16a-54deb6544c46 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: 680c3968-8912-45c4-b1c3-634c06ec30c3] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:00.099135 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2c55f5da-2924-4492-b16a-54deb6544c46 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:00.103664 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2c55f5da-2924-4492-b16a-54deb6544c46 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:00.104383 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2c55f5da-2924-4492-b16a-54deb6544c46 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:00.111699 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2c55f5da-2924-4492-b16a-54deb6544c46 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:00.113973 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2c55f5da-2924-4492-b16a-54deb6544c46 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:00.114685 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2c55f5da-2924-4492-b16a-54deb6544c46 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:00.469942 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-2c55f5da-2924-4492-b16a-54deb6544c46 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:00.478709 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-2c55f5da-2924-4492-b16a-54deb6544c46 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/680c3968-8912-45c4-b1c3-634c06ec30c3" status: 200 len: 1273 microversion: 2.1 time: 0.409417 Sep 14 09:01:00.483062 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1414/2891] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:01:00 2022] GET /compute/v2.1/servers/680c3968-8912-45c4-b1c3-634c06ec30c3 => generated 1273 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:01:00.895365 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9233d13d-ddc3-4200-98a4-a4dc6aa5b0ef tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-UnshelveToHostMultiNodesTest-server-690201901", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "networks": "none"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:01:00.919896 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-a1642ab1-468d-4bc5-b876-77d263abc39f tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Flavor limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:01:00.920390 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-a1642ab1-468d-4bc5-b876-77d263abc39f tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Image limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:01:00.921585 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-a1642ab1-468d-4bc5-b876-77d263abc39f tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Flavor pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:01:00.922033 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-a1642ab1-468d-4bc5-b876-77d263abc39f tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Image pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:01:00.922613 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-a1642ab1-468d-4bc5-b876-77d263abc39f tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:01:00.936673 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a1642ab1-468d-4bc5-b876-77d263abc39f tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:00.937154 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a1642ab1-468d-4bc5-b876-77d263abc39f tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:00.937589 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a1642ab1-468d-4bc5-b876-77d263abc39f tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:00.943483 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a1642ab1-468d-4bc5-b876-77d263abc39f tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:00.944176 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a1642ab1-468d-4bc5-b876-77d263abc39f tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:00.944790 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a1642ab1-468d-4bc5-b876-77d263abc39f tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:01.033250 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-9233d13d-ddc3-4200-98a4-a4dc6aa5b0ef tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Flavor limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:01:01.034316 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-9233d13d-ddc3-4200-98a4-a4dc6aa5b0ef tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Image limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:01:01.035055 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-9233d13d-ddc3-4200-98a4-a4dc6aa5b0ef tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Flavor pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:01:01.035647 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-9233d13d-ddc3-4200-98a4-a4dc6aa5b0ef tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Image pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:01:01.036272 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-9233d13d-ddc3-4200-98a4-a4dc6aa5b0ef tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:01:01.047499 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9233d13d-ddc3-4200-98a4-a4dc6aa5b0ef tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:01.048270 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9233d13d-ddc3-4200-98a4-a4dc6aa5b0ef tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:01.049319 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9233d13d-ddc3-4200-98a4-a4dc6aa5b0ef tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:01.049751 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-a1642ab1-468d-4bc5-b876-77d263abc39f tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Getting quotas for project 6ed2295a58f8451993a57ce0a6f9ba29. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:01:01.050476 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9233d13d-ddc3-4200-98a4-a4dc6aa5b0ef tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:01.051376 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9233d13d-ddc3-4200-98a4-a4dc6aa5b0ef tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:01.051993 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9233d13d-ddc3-4200-98a4-a4dc6aa5b0ef tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:01.077672 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-9233d13d-ddc3-4200-98a4-a4dc6aa5b0ef tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Getting quotas for project 6aaac4d23e9f4744a274e7030dcbee68. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:01:01.084971 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-9233d13d-ddc3-4200-98a4-a4dc6aa5b0ef tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Getting quotas for user 7bd1b458a72144f2aa62846c501fcb30 and project 6aaac4d23e9f4744a274e7030dcbee68. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:01:01.107816 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-9233d13d-ddc3-4200-98a4-a4dc6aa5b0ef tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Going to run 1 instances... {{(pid=128759) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:01:01.108170 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-a1642ab1-468d-4bc5-b876-77d263abc39f tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Getting quotas for user dc9d40e54481461cba53fedb9a6abdf8 and project 6ed2295a58f8451993a57ce0a6f9ba29. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:01:01.110427 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-9233d13d-ddc3-4200-98a4-a4dc6aa5b0ef tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] [instance: 0eb40c80-c056-4096-a586-7e957a63f7cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128759) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:01:01.130778 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-a1642ab1-468d-4bc5-b876-77d263abc39f tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Going to run 1 instances... {{(pid=128758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:01:01.140307 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-a1642ab1-468d-4bc5-b876-77d263abc39f tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: 3b592d04-368e-4b8f-bae2-c77aebec4105] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:01:01.222796 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-9233d13d-ddc3-4200-98a4-a4dc6aa5b0ef tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.91 time: 0.722035 Sep 14 09:01:01.223624 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1415/2892] 10.222.0.60 () {62 vars in 1188 bytes} [Wed Sep 14 09:01:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 724 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 14 09:01:01.234303 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-d90d96d0-9e5e-4abf-a0c2-8f2813f760a9 req-19d6b647-d165-4da6-89a6-0fb5f97bfbd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f7f80e3-c2f5-4719-a484-29d6bd0d9e91", "name": "network-vif-deleted", "tag": "b19f0267-785e-4700-95e9-c6c0c01d2656"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:01:01.248273 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-d90d96d0-9e5e-4abf-a0c2-8f2813f760a9 req-19d6b647-d165-4da6-89a6-0fb5f97bfbd8 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:01.248984 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-d90d96d0-9e5e-4abf-a0c2-8f2813f760a9 req-19d6b647-d165-4da6-89a6-0fb5f97bfbd8 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:01.249701 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-d90d96d0-9e5e-4abf-a0c2-8f2813f760a9 req-19d6b647-d165-4da6-89a6-0fb5f97bfbd8 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:01.255671 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-a1642ab1-468d-4bc5-b876-77d263abc39f tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.917422 Sep 14 09:01:01.256355 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1478/2893] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 09:00:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 2920 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 14 09:01:01.265621 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ad0b28bc-6584-4183-ac66-a18bd79c1f21 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:01.266266 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-ad0b28bc-6584-4183-ac66-a18bd79c1f21 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] [instance: d5c8ab80-5993-4193-8c83-73345637d5eb] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:01.272202 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-d90d96d0-9e5e-4abf-a0c2-8f2813f760a9 req-19d6b647-d165-4da6-89a6-0fb5f97bfbd8 service nova] Creating event network-vif-deleted:b19f0267-785e-4700-95e9-c6c0c01d2656 for instance 8f7f80e3-c2f5-4719-a484-29d6bd0d9e91 on n-h2-836830-18 Sep 14 09:01:01.278720 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-d90d96d0-9e5e-4abf-a0c2-8f2813f760a9 req-19d6b647-d165-4da6-89a6-0fb5f97bfbd8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053659 Sep 14 09:01:01.279676 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1416/2894] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:01:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:01:01.286891 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e2ae19d0-a958-404e-bef3-06697ba57dbb tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Calling method '.version_select at 0x7f7d4879a160>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:01.303389 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ad0b28bc-6584-4183-ac66-a18bd79c1f21 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:01.303920 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ad0b28bc-6584-4183-ac66-a18bd79c1f21 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:01.304328 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ad0b28bc-6584-4183-ac66-a18bd79c1f21 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:01.305079 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ad0b28bc-6584-4183-ac66-a18bd79c1f21 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:01.305492 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ad0b28bc-6584-4183-ac66-a18bd79c1f21 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:01.313495 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ad0b28bc-6584-4183-ac66-a18bd79c1f21 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:01.377733 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e2ae19d0-a958-404e-bef3-06697ba57dbb tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] 10.222.0.60 "GET /compute/v2.1/images/dad3a300-4c39-4706-a163-fe284681c5e2" status: 200 len: 1454 microversion: 2.1 time: 0.096568 Sep 14 09:01:01.378742 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1417/2895] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:01:01 2022] GET /compute/v2.1/images/dad3a300-4c39-4706-a163-fe284681c5e2 => generated 1454 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:01:01.386884 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-5ca594b3-aee3-4a4b-a6e9-abbe7a844f42 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:01.388105 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-5ca594b3-aee3-4a4b-a6e9-abbe7a844f42 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] [instance: 0eb40c80-c056-4096-a586-7e957a63f7cf] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:01.673022 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-5ca594b3-aee3-4a4b-a6e9-abbe7a844f42 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:01.691301 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-5ca594b3-aee3-4a4b-a6e9-abbe7a844f42 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:01.714805 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-5ca594b3-aee3-4a4b-a6e9-abbe7a844f42 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:01.731114 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-5ca594b3-aee3-4a4b-a6e9-abbe7a844f42 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] 10.222.0.60 "GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf" status: 200 len: 1452 microversion: 2.91 time: 0.347953 Sep 14 09:01:01.734264 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1418/2896] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:01:01 2022] GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf => generated 1452 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:01:01.761725 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-32c1ad11-daac-407d-a9a7-7d8dad46dff3 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:01.763378 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-32c1ad11-daac-407d-a9a7-7d8dad46dff3 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: 3b592d04-368e-4b8f-bae2-c77aebec4105] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:01.898573 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-32c1ad11-daac-407d-a9a7-7d8dad46dff3 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9d40e54481461cba53fedb9a6abdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed2295a58f8451993a57ce0a6f9ba29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:01.913623 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-32c1ad11-daac-407d-a9a7-7d8dad46dff3 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] 10.222.0.60 "GET /compute/v2.1/servers/3b592d04-368e-4b8f-bae2-c77aebec4105" status: 200 len: 1217 microversion: 2.1 time: 0.167066 Sep 14 09:01:01.920142 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1419/2897] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:01:01 2022] GET /compute/v2.1/servers/3b592d04-368e-4b8f-bae2-c77aebec4105 => generated 1217 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:01:01.932593 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-20f51662-29c2-46fd-98f4-3714e56d4cd7 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:01.933213 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-20f51662-29c2-46fd-98f4-3714e56d4cd7 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: 680c3968-8912-45c4-b1c3-634c06ec30c3] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:01.941638 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-20f51662-29c2-46fd-98f4-3714e56d4cd7 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:01.943755 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-20f51662-29c2-46fd-98f4-3714e56d4cd7 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:01.946595 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-20f51662-29c2-46fd-98f4-3714e56d4cd7 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:01.947593 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-20f51662-29c2-46fd-98f4-3714e56d4cd7 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:01.948323 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-20f51662-29c2-46fd-98f4-3714e56d4cd7 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:01.949285 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-20f51662-29c2-46fd-98f4-3714e56d4cd7 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:01.994413 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-ad0b28bc-6584-4183-ac66-a18bd79c1f21 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ab7166e40e4a908eefbfb03b3b8804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de82b83dadd541dbb4a939f2fc04a163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:02.006448 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-ad0b28bc-6584-4183-ac66-a18bd79c1f21 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] 10.222.0.60 "GET /compute/v2.1/servers/d5c8ab80-5993-4193-8c83-73345637d5eb" status: 200 len: 1318 microversion: 2.1 time: 0.746877 Sep 14 09:01:02.007962 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1479/2898] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:01:01 2022] GET /compute/v2.1/servers/d5c8ab80-5993-4193-8c83-73345637d5eb => generated 1318 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:01:02.397427 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-9f7e7c0f-74f9-4cf2-a267-76b058080a28 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Calling method '.version_select at 0x7f7d44027af0>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:02.574170 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-9f7e7c0f-74f9-4cf2-a267-76b058080a28 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] 10.222.0.60 "GET /compute/v2.1/images/dad3a300-4c39-4706-a163-fe284681c5e2" status: 200 len: 1454 microversion: 2.1 time: 0.180999 Sep 14 09:01:02.575129 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1480/2899] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:01:02 2022] GET /compute/v2.1/images/dad3a300-4c39-4706-a163-fe284681c5e2 => generated 1454 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:01:02.768443 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a6d476fa-d1f7-436c-8743-773835db97ae tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:02.769315 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-a6d476fa-d1f7-436c-8743-773835db97ae tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] [instance: 0eb40c80-c056-4096-a586-7e957a63f7cf] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:02.800474 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a6d476fa-d1f7-436c-8743-773835db97ae tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:02.802355 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a6d476fa-d1f7-436c-8743-773835db97ae tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:02.804376 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a6d476fa-d1f7-436c-8743-773835db97ae tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:02.807965 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a6d476fa-d1f7-436c-8743-773835db97ae tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:02.809284 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a6d476fa-d1f7-436c-8743-773835db97ae tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:02.810700 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a6d476fa-d1f7-436c-8743-773835db97ae tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:03.165311 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-a6d476fa-d1f7-436c-8743-773835db97ae tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:03.182589 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-a6d476fa-d1f7-436c-8743-773835db97ae tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:03.190225 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-a6d476fa-d1f7-436c-8743-773835db97ae tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:03.223899 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-a6d476fa-d1f7-436c-8743-773835db97ae tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] 10.222.0.60 "GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf" status: 200 len: 1504 microversion: 2.91 time: 0.460230 Sep 14 09:01:03.231784 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-20f51662-29c2-46fd-98f4-3714e56d4cd7 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:03.249516 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1481/2900] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:01:02 2022] GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf => generated 1504 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:01:03.256879 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-20f51662-29c2-46fd-98f4-3714e56d4cd7 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/680c3968-8912-45c4-b1c3-634c06ec30c3" status: 200 len: 1315 microversion: 2.1 time: 1.335033 Sep 14 09:01:03.257494 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1420/2901] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:01:01 2022] GET /compute/v2.1/servers/680c3968-8912-45c4-b1c3-634c06ec30c3 => generated 1315 bytes in 1337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:01:03.258749 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-129c703e-437a-4350-b43e-a41e024bb291 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:03.259617 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-129c703e-437a-4350-b43e-a41e024bb291 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: 3b592d04-368e-4b8f-bae2-c77aebec4105] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:03.263204 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-fa952b76-7337-4622-bc1c-8e5c9286de99 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:03.263854 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-fa952b76-7337-4622-bc1c-8e5c9286de99 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] [instance: d5c8ab80-5993-4193-8c83-73345637d5eb] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:03.268178 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-129c703e-437a-4350-b43e-a41e024bb291 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:03.268961 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-129c703e-437a-4350-b43e-a41e024bb291 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:03.269695 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-129c703e-437a-4350-b43e-a41e024bb291 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:03.270720 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-129c703e-437a-4350-b43e-a41e024bb291 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:03.271953 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-129c703e-437a-4350-b43e-a41e024bb291 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:03.272611 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-129c703e-437a-4350-b43e-a41e024bb291 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:03.280795 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fa952b76-7337-4622-bc1c-8e5c9286de99 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:03.281301 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fa952b76-7337-4622-bc1c-8e5c9286de99 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:03.281743 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fa952b76-7337-4622-bc1c-8e5c9286de99 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:03.282459 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fa952b76-7337-4622-bc1c-8e5c9286de99 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:03.283553 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fa952b76-7337-4622-bc1c-8e5c9286de99 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:03.283989 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fa952b76-7337-4622-bc1c-8e5c9286de99 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:03.394656 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-129c703e-437a-4350-b43e-a41e024bb291 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9d40e54481461cba53fedb9a6abdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed2295a58f8451993a57ce0a6f9ba29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:03.407580 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-129c703e-437a-4350-b43e-a41e024bb291 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] 10.222.0.60 "GET /compute/v2.1/servers/3b592d04-368e-4b8f-bae2-c77aebec4105" status: 200 len: 1213 microversion: 2.1 time: 0.155022 Sep 14 09:01:03.419430 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1482/2902] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:01:03 2022] GET /compute/v2.1/servers/3b592d04-368e-4b8f-bae2-c77aebec4105 => generated 1213 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:01:03.590691 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-fecb3a0a-35d9-4610-90e4-989d3163bdd4 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Calling method '.version_select at 0x7f7d44027790>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:03.674403 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-fecb3a0a-35d9-4610-90e4-989d3163bdd4 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] 10.222.0.60 "GET /compute/v2.1/images/dad3a300-4c39-4706-a163-fe284681c5e2" status: 200 len: 1454 microversion: 2.1 time: 0.088308 Sep 14 09:01:03.687545 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1483/2903] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:01:03 2022] GET /compute/v2.1/images/dad3a300-4c39-4706-a163-fe284681c5e2 => generated 1454 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:01:03.695026 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-74dd1e49-8300-42ec-b7db-09be84b0a21a req-02b51560-8e31-4fc0-85f5-0631600cdabb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "680c3968-8912-45c4-b1c3-634c06ec30c3", "tag": "459779a8-3426-4989-910a-1f725b3e69c6"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:01:03.718888 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-74dd1e49-8300-42ec-b7db-09be84b0a21a req-02b51560-8e31-4fc0-85f5-0631600cdabb service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:03.722445 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-74dd1e49-8300-42ec-b7db-09be84b0a21a req-02b51560-8e31-4fc0-85f5-0631600cdabb service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:03.723431 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-74dd1e49-8300-42ec-b7db-09be84b0a21a req-02b51560-8e31-4fc0-85f5-0631600cdabb service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:03.749712 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-74dd1e49-8300-42ec-b7db-09be84b0a21a req-02b51560-8e31-4fc0-85f5-0631600cdabb service nova] Creating event network-changed:459779a8-3426-4989-910a-1f725b3e69c6 for instance 680c3968-8912-45c4-b1c3-634c06ec30c3 on n-h1-836830-18 Sep 14 09:01:03.756389 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-74dd1e49-8300-42ec-b7db-09be84b0a21a req-02b51560-8e31-4fc0-85f5-0631600cdabb service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067440 Sep 14 09:01:03.757654 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1484/2904] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:01:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:01:03.869999 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-fa952b76-7337-4622-bc1c-8e5c9286de99 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ab7166e40e4a908eefbfb03b3b8804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de82b83dadd541dbb4a939f2fc04a163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:03.888715 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-fa952b76-7337-4622-bc1c-8e5c9286de99 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] 10.222.0.60 "GET /compute/v2.1/servers/d5c8ab80-5993-4193-8c83-73345637d5eb" status: 200 len: 1318 microversion: 2.1 time: 0.630132 Sep 14 09:01:03.894557 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1421/2905] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:01:03 2022] GET /compute/v2.1/servers/d5c8ab80-5993-4193-8c83-73345637d5eb => generated 1318 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:01:04.262078 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-0bd1e0b5-83d1-4650-a207-93e56b56bfc7 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:04.263805 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-0bd1e0b5-83d1-4650-a207-93e56b56bfc7 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] [instance: 0eb40c80-c056-4096-a586-7e957a63f7cf] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:04.283568 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-fc9efb04-f997-49af-a98c-7a02b190ef5f tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:04.284931 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-fc9efb04-f997-49af-a98c-7a02b190ef5f tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: 680c3968-8912-45c4-b1c3-634c06ec30c3] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:04.296047 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0bd1e0b5-83d1-4650-a207-93e56b56bfc7 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:04.298003 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fc9efb04-f997-49af-a98c-7a02b190ef5f tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:04.298770 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0bd1e0b5-83d1-4650-a207-93e56b56bfc7 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:04.299599 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fc9efb04-f997-49af-a98c-7a02b190ef5f tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:04.300279 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0bd1e0b5-83d1-4650-a207-93e56b56bfc7 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:04.300953 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fc9efb04-f997-49af-a98c-7a02b190ef5f tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:04.301914 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0bd1e0b5-83d1-4650-a207-93e56b56bfc7 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:04.303341 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fc9efb04-f997-49af-a98c-7a02b190ef5f tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:04.305204 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0bd1e0b5-83d1-4650-a207-93e56b56bfc7 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:04.306084 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fc9efb04-f997-49af-a98c-7a02b190ef5f tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:04.306849 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0bd1e0b5-83d1-4650-a207-93e56b56bfc7 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:04.307710 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fc9efb04-f997-49af-a98c-7a02b190ef5f tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:04.916765 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-0bd1e0b5-83d1-4650-a207-93e56b56bfc7 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:04.927313 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-0bd1e0b5-83d1-4650-a207-93e56b56bfc7 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:04.937959 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-0bd1e0b5-83d1-4650-a207-93e56b56bfc7 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:04.944735 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-0bd1e0b5-83d1-4650-a207-93e56b56bfc7 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] 10.222.0.60 "GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf" status: 200 len: 1510 microversion: 2.91 time: 0.686924 Sep 14 09:01:04.967100 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1485/2906] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:01:04 2022] GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf => generated 1510 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:01:04.977114 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-27e4e4dc-d8ba-43ba-90fb-17fbb37ce243 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:04.977733 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-27e4e4dc-d8ba-43ba-90fb-17fbb37ce243 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: 3b592d04-368e-4b8f-bae2-c77aebec4105] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:04.986757 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-27e4e4dc-d8ba-43ba-90fb-17fbb37ce243 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:04.988739 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-27e4e4dc-d8ba-43ba-90fb-17fbb37ce243 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:04.989187 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-27e4e4dc-d8ba-43ba-90fb-17fbb37ce243 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:04.989902 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-27e4e4dc-d8ba-43ba-90fb-17fbb37ce243 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:04.990416 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-27e4e4dc-d8ba-43ba-90fb-17fbb37ce243 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:04.990848 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-27e4e4dc-d8ba-43ba-90fb-17fbb37ce243 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:05.118607 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-27e4e4dc-d8ba-43ba-90fb-17fbb37ce243 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9d40e54481461cba53fedb9a6abdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed2295a58f8451993a57ce0a6f9ba29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:05.129205 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-27e4e4dc-d8ba-43ba-90fb-17fbb37ce243 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] 10.222.0.60 "GET /compute/v2.1/servers/3b592d04-368e-4b8f-bae2-c77aebec4105" status: 200 len: 1277 microversion: 2.1 time: 0.156914 Sep 14 09:01:05.130736 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1486/2907] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:01:04 2022] GET /compute/v2.1/servers/3b592d04-368e-4b8f-bae2-c77aebec4105 => generated 1277 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:01:05.140863 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-40fe4365-e208-4617-b87b-68cd4f623daf tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Calling method '.version_select at 0x7f7d3fa93a60>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:05.192779 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-fc9efb04-f997-49af-a98c-7a02b190ef5f tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:05.206802 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-fc9efb04-f997-49af-a98c-7a02b190ef5f tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/680c3968-8912-45c4-b1c3-634c06ec30c3" status: 200 len: 1315 microversion: 2.1 time: 0.927065 Sep 14 09:01:05.222980 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1422/2908] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:01:04 2022] GET /compute/v2.1/servers/680c3968-8912-45c4-b1c3-634c06ec30c3 => generated 1315 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:01:05.222980 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-fe14e1c8-2e28-4b94-a278-6e687e85f00b tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:05.222980 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-fe14e1c8-2e28-4b94-a278-6e687e85f00b tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] [instance: d5c8ab80-5993-4193-8c83-73345637d5eb] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:05.238103 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fe14e1c8-2e28-4b94-a278-6e687e85f00b tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:05.238706 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fe14e1c8-2e28-4b94-a278-6e687e85f00b tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:05.239331 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fe14e1c8-2e28-4b94-a278-6e687e85f00b tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:05.241631 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fe14e1c8-2e28-4b94-a278-6e687e85f00b tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:05.242216 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fe14e1c8-2e28-4b94-a278-6e687e85f00b tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:05.243271 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fe14e1c8-2e28-4b94-a278-6e687e85f00b tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:05.266162 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-40fe4365-e208-4617-b87b-68cd4f623daf tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] 10.222.0.60 "GET /compute/v2.1/images/dad3a300-4c39-4706-a163-fe284681c5e2" status: 200 len: 1454 microversion: 2.1 time: 0.132616 Sep 14 09:01:05.276130 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1487/2909] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:01:05 2022] GET /compute/v2.1/images/dad3a300-4c39-4706-a163-fe284681c5e2 => generated 1454 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:01:05.565388 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-fe14e1c8-2e28-4b94-a278-6e687e85f00b tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ab7166e40e4a908eefbfb03b3b8804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de82b83dadd541dbb4a939f2fc04a163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:05.577762 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-fe14e1c8-2e28-4b94-a278-6e687e85f00b tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] 10.222.0.60 "GET /compute/v2.1/servers/d5c8ab80-5993-4193-8c83-73345637d5eb" status: 200 len: 1318 microversion: 2.1 time: 0.366456 Sep 14 09:01:05.578186 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1423/2910] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:01:05 2022] GET /compute/v2.1/servers/d5c8ab80-5993-4193-8c83-73345637d5eb => generated 1318 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:01:05.979364 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-afe0e886-d403-4d0c-8e96-e6a8b6c19fa5 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:05.980171 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-afe0e886-d403-4d0c-8e96-e6a8b6c19fa5 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] [instance: 0eb40c80-c056-4096-a586-7e957a63f7cf] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:05.996172 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-afe0e886-d403-4d0c-8e96-e6a8b6c19fa5 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:05.997962 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-afe0e886-d403-4d0c-8e96-e6a8b6c19fa5 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:05.999192 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-afe0e886-d403-4d0c-8e96-e6a8b6c19fa5 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:06.000849 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-afe0e886-d403-4d0c-8e96-e6a8b6c19fa5 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:06.004164 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-afe0e886-d403-4d0c-8e96-e6a8b6c19fa5 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:06.004905 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-afe0e886-d403-4d0c-8e96-e6a8b6c19fa5 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:06.057744 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:01:06.155429 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-728ff9f0-e653-42c6-a077-329bcd683c12 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:06.156207 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-afe0e886-d403-4d0c-8e96-e6a8b6c19fa5 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:06.156695 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-728ff9f0-e653-42c6-a077-329bcd683c12 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: 3b592d04-368e-4b8f-bae2-c77aebec4105] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:06.167356 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-728ff9f0-e653-42c6-a077-329bcd683c12 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:06.170341 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-728ff9f0-e653-42c6-a077-329bcd683c12 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:06.171065 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-728ff9f0-e653-42c6-a077-329bcd683c12 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:06.171737 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-afe0e886-d403-4d0c-8e96-e6a8b6c19fa5 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:06.173165 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-728ff9f0-e653-42c6-a077-329bcd683c12 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:06.173305 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-afe0e886-d403-4d0c-8e96-e6a8b6c19fa5 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:06.176031 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-728ff9f0-e653-42c6-a077-329bcd683c12 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:06.176732 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-728ff9f0-e653-42c6-a077-329bcd683c12 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:06.193549 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-afe0e886-d403-4d0c-8e96-e6a8b6c19fa5 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] 10.222.0.60 "GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf" status: 200 len: 1510 microversion: 2.91 time: 0.220304 Sep 14 09:01:06.194555 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1488/2911] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:01:05 2022] GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf => generated 1510 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:01:06.220100 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-884beb08-11d3-4563-8773-cea01dd4f733 req-f3422cb4-dfc5-45ee-97f1-0e6b914a09ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5c8ab80-5993-4193-8c83-73345637d5eb", "name": "network-vif-plugged", "status": "completed", "tag": "88822778-5011-41f7-8715-6e0999a5aaee"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:01:06.234519 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:01:06.236443 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-884beb08-11d3-4563-8773-cea01dd4f733 req-f3422cb4-dfc5-45ee-97f1-0e6b914a09ea service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:06.236927 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-884beb08-11d3-4563-8773-cea01dd4f733 req-f3422cb4-dfc5-45ee-97f1-0e6b914a09ea service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:06.243736 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-884beb08-11d3-4563-8773-cea01dd4f733 req-f3422cb4-dfc5-45ee-97f1-0e6b914a09ea service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:06.281245 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-884beb08-11d3-4563-8773-cea01dd4f733 req-f3422cb4-dfc5-45ee-97f1-0e6b914a09ea service nova] Creating event network-vif-plugged:88822778-5011-41f7-8715-6e0999a5aaee for instance d5c8ab80-5993-4193-8c83-73345637d5eb on n-h2-836830-18 Sep 14 09:01:06.287413 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-884beb08-11d3-4563-8773-cea01dd4f733 req-f3422cb4-dfc5-45ee-97f1-0e6b914a09ea service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091425 Sep 14 09:01:06.289202 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1489/2912] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:01:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:01:06.298508 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-8d5f148c-3dc9-4832-ad68-a47dfc579ab3 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:06.299552 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-8d5f148c-3dc9-4832-ad68-a47dfc579ab3 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: 680c3968-8912-45c4-b1c3-634c06ec30c3] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:06.311197 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-728ff9f0-e653-42c6-a077-329bcd683c12 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9d40e54481461cba53fedb9a6abdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed2295a58f8451993a57ce0a6f9ba29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:06.316663 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8d5f148c-3dc9-4832-ad68-a47dfc579ab3 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:06.317210 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8d5f148c-3dc9-4832-ad68-a47dfc579ab3 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:06.317836 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8d5f148c-3dc9-4832-ad68-a47dfc579ab3 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:06.319305 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8d5f148c-3dc9-4832-ad68-a47dfc579ab3 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:06.319791 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8d5f148c-3dc9-4832-ad68-a47dfc579ab3 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:06.320436 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8d5f148c-3dc9-4832-ad68-a47dfc579ab3 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:06.350775 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-728ff9f0-e653-42c6-a077-329bcd683c12 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] 10.222.0.60 "GET /compute/v2.1/servers/3b592d04-368e-4b8f-bae2-c77aebec4105" status: 200 len: 1275 microversion: 2.1 time: 0.197314 Sep 14 09:01:06.355332 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1424/2913] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:01:06 2022] GET /compute/v2.1/servers/3b592d04-368e-4b8f-bae2-c77aebec4105 => generated 1275 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:01:06.370902 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3ffebb62-b752-4f94-9d29-7e6006655671 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Calling method '.version_select at 0x7f7d48665160>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:06.540904 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-3ffebb62-b752-4f94-9d29-7e6006655671 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] 10.222.0.60 "GET /compute/v2.1/images/dad3a300-4c39-4706-a163-fe284681c5e2" status: 200 len: 1454 microversion: 2.1 time: 0.183196 Sep 14 09:01:06.544003 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1425/2914] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:01:06 2022] GET /compute/v2.1/images/dad3a300-4c39-4706-a163-fe284681c5e2 => generated 1454 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:01:06.557610 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-8d5f148c-3dc9-4832-ad68-a47dfc579ab3 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:06.577839 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-8d5f148c-3dc9-4832-ad68-a47dfc579ab3 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/680c3968-8912-45c4-b1c3-634c06ec30c3" status: 200 len: 1315 microversion: 2.1 time: 0.284631 Sep 14 09:01:06.579732 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1490/2915] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:01:06 2022] GET /compute/v2.1/servers/680c3968-8912-45c4-b1c3-634c06ec30c3 => generated 1315 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:01:06.607925 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-6cccc756-880b-4990-9f68-b17381ef69b3 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:06.611033 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-6cccc756-880b-4990-9f68-b17381ef69b3 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] [instance: d5c8ab80-5993-4193-8c83-73345637d5eb] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:06.627123 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6cccc756-880b-4990-9f68-b17381ef69b3 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:06.627642 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6cccc756-880b-4990-9f68-b17381ef69b3 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:06.628101 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6cccc756-880b-4990-9f68-b17381ef69b3 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:06.628834 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6cccc756-880b-4990-9f68-b17381ef69b3 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:06.629301 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6cccc756-880b-4990-9f68-b17381ef69b3 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:06.629737 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6cccc756-880b-4990-9f68-b17381ef69b3 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:07.075894 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-6cccc756-880b-4990-9f68-b17381ef69b3 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ab7166e40e4a908eefbfb03b3b8804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de82b83dadd541dbb4a939f2fc04a163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:07.093984 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-6cccc756-880b-4990-9f68-b17381ef69b3 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] 10.222.0.60 "GET /compute/v2.1/servers/d5c8ab80-5993-4193-8c83-73345637d5eb" status: 200 len: 1318 microversion: 2.1 time: 0.494862 Sep 14 09:01:07.095622 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1426/2916] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:01:06 2022] GET /compute/v2.1/servers/d5c8ab80-5993-4193-8c83-73345637d5eb => generated 1318 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:01:07.233382 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-dd0b85d3-612f-408b-9205-bbf64e54120c tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:07.233999 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-dd0b85d3-612f-408b-9205-bbf64e54120c tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] [instance: 0eb40c80-c056-4096-a586-7e957a63f7cf] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:07.243532 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dd0b85d3-612f-408b-9205-bbf64e54120c tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:07.244528 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dd0b85d3-612f-408b-9205-bbf64e54120c tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:07.244967 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dd0b85d3-612f-408b-9205-bbf64e54120c tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:07.246179 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dd0b85d3-612f-408b-9205-bbf64e54120c tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:07.246650 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dd0b85d3-612f-408b-9205-bbf64e54120c tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:07.247660 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dd0b85d3-612f-408b-9205-bbf64e54120c tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:07.354472 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-dd0b85d3-612f-408b-9205-bbf64e54120c tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:07.372545 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-dd0b85d3-612f-408b-9205-bbf64e54120c tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:07.377117 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-dd0b85d3-612f-408b-9205-bbf64e54120c tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:07.378193 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a407e9b2-4171-4451-92f0-b9864978bb0c tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:07.379035 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-a407e9b2-4171-4451-92f0-b9864978bb0c tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: 3b592d04-368e-4b8f-bae2-c77aebec4105] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:07.390596 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a407e9b2-4171-4451-92f0-b9864978bb0c tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:07.393178 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a407e9b2-4171-4451-92f0-b9864978bb0c tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:07.393870 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a407e9b2-4171-4451-92f0-b9864978bb0c tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:07.396088 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a407e9b2-4171-4451-92f0-b9864978bb0c tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:07.398687 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a407e9b2-4171-4451-92f0-b9864978bb0c tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:07.399926 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a407e9b2-4171-4451-92f0-b9864978bb0c tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:07.403979 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-dd0b85d3-612f-408b-9205-bbf64e54120c tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] 10.222.0.60 "GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf" status: 200 len: 1531 microversion: 2.91 time: 0.174076 Sep 14 09:01:07.405418 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1491/2917] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:01:07 2022] GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf => generated 1531 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:01:07.686331 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b5d4023c-dba5-42b6-ba58-6e14625670ab tempest-UnshelveToHostMultiNodesTest-151498122 tempest-UnshelveToHostMultiNodesTest-151498122-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:07.687103 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-b5d4023c-dba5-42b6-ba58-6e14625670ab tempest-UnshelveToHostMultiNodesTest-151498122 tempest-UnshelveToHostMultiNodesTest-151498122-project-admin] [instance: 0eb40c80-c056-4096-a586-7e957a63f7cf] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:07.696437 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b5d4023c-dba5-42b6-ba58-6e14625670ab tempest-UnshelveToHostMultiNodesTest-151498122 tempest-UnshelveToHostMultiNodesTest-151498122-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:07.701277 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b5d4023c-dba5-42b6-ba58-6e14625670ab tempest-UnshelveToHostMultiNodesTest-151498122 tempest-UnshelveToHostMultiNodesTest-151498122-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:07.704614 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b5d4023c-dba5-42b6-ba58-6e14625670ab tempest-UnshelveToHostMultiNodesTest-151498122 tempest-UnshelveToHostMultiNodesTest-151498122-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:07.707645 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b5d4023c-dba5-42b6-ba58-6e14625670ab tempest-UnshelveToHostMultiNodesTest-151498122 tempest-UnshelveToHostMultiNodesTest-151498122-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:07.708420 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b5d4023c-dba5-42b6-ba58-6e14625670ab tempest-UnshelveToHostMultiNodesTest-151498122 tempest-UnshelveToHostMultiNodesTest-151498122-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:07.711608 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b5d4023c-dba5-42b6-ba58-6e14625670ab tempest-UnshelveToHostMultiNodesTest-151498122 tempest-UnshelveToHostMultiNodesTest-151498122-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:07.714761 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-a407e9b2-4171-4451-92f0-b9864978bb0c tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9d40e54481461cba53fedb9a6abdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed2295a58f8451993a57ce0a6f9ba29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:07.726304 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a407e9b2-4171-4451-92f0-b9864978bb0c tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] 10.222.0.60 "GET /compute/v2.1/servers/3b592d04-368e-4b8f-bae2-c77aebec4105" status: 200 len: 1317 microversion: 2.1 time: 0.352095 Sep 14 09:01:07.727726 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1427/2918] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:01:07 2022] GET /compute/v2.1/servers/3b592d04-368e-4b8f-bae2-c77aebec4105 => generated 1317 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:01:07.733942 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-7a3ba6d4-49f9-414f-aac2-b80917102b02 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Calling method '.version_select at 0x7f7d4863ae50>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:07.827019 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-7a3ba6d4-49f9-414f-aac2-b80917102b02 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] 10.222.0.60 "GET /compute/v2.1/images/dad3a300-4c39-4706-a163-fe284681c5e2" status: 200 len: 1454 microversion: 2.1 time: 0.097696 Sep 14 09:01:07.836830 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1428/2919] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:01:07 2022] GET /compute/v2.1/images/dad3a300-4c39-4706-a163-fe284681c5e2 => generated 1454 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:01:07.846553 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c5107750-4221-4026-8798-5dfa81e7c08e tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:07.847355 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-c5107750-4221-4026-8798-5dfa81e7c08e tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: 680c3968-8912-45c4-b1c3-634c06ec30c3] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:07.860279 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c5107750-4221-4026-8798-5dfa81e7c08e tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:07.860979 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c5107750-4221-4026-8798-5dfa81e7c08e tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:07.861581 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c5107750-4221-4026-8798-5dfa81e7c08e tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:07.862659 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c5107750-4221-4026-8798-5dfa81e7c08e tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:07.863306 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c5107750-4221-4026-8798-5dfa81e7c08e tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:07.864455 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c5107750-4221-4026-8798-5dfa81e7c08e tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:07.869854 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.objects.instance [None req-b5d4023c-dba5-42b6-ba58-6e14625670ab tempest-UnshelveToHostMultiNodesTest-151498122 tempest-UnshelveToHostMultiNodesTest-151498122-project-admin] Lazy-loading 'services' on Instance uuid 0eb40c80-c056-4096-a586-7e957a63f7cf {{(pid=128758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:01:07.890470 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-b5d4023c-dba5-42b6-ba58-6e14625670ab tempest-UnshelveToHostMultiNodesTest-151498122 tempest-UnshelveToHostMultiNodesTest-151498122-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf" status: 200 len: 1938 microversion: 2.91 time: 0.456692 Sep 14 09:01:07.920361 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1492/2920] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:01:07 2022] GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf => generated 1938 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:01:07.954299 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-05c89435-799f-4dff-b86b-076f29306065 req-89655313-8629-4a44-b3b9-2fd27a890beb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b592d04-368e-4b8f-bae2-c77aebec4105", "tag": "64b11033-eadd-4f21-bfc9-3708641d46a2"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:01:07.980904 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-05c89435-799f-4dff-b86b-076f29306065 req-89655313-8629-4a44-b3b9-2fd27a890beb service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:07.981747 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-05c89435-799f-4dff-b86b-076f29306065 req-89655313-8629-4a44-b3b9-2fd27a890beb service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:07.982364 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-05c89435-799f-4dff-b86b-076f29306065 req-89655313-8629-4a44-b3b9-2fd27a890beb service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:08.010975 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-05c89435-799f-4dff-b86b-076f29306065 req-89655313-8629-4a44-b3b9-2fd27a890beb service nova] Creating event network-changed:64b11033-eadd-4f21-bfc9-3708641d46a2 for instance 3b592d04-368e-4b8f-bae2-c77aebec4105 on n-h2-836830-18 Sep 14 09:01:08.018023 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-05c89435-799f-4dff-b86b-076f29306065 req-89655313-8629-4a44-b3b9-2fd27a890beb service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095051 Sep 14 09:01:08.018892 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1493/2921] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:01:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:01:08.025160 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a447936d-ee5b-4ef9-a83f-7df79040493e tempest-UnshelveToHostMultiNodesTest-151498122 tempest-UnshelveToHostMultiNodesTest-151498122-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:08.026142 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-a447936d-ee5b-4ef9-a83f-7df79040493e tempest-UnshelveToHostMultiNodesTest-151498122 tempest-UnshelveToHostMultiNodesTest-151498122-project-admin] [instance: 0eb40c80-c056-4096-a586-7e957a63f7cf] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:08.036375 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a447936d-ee5b-4ef9-a83f-7df79040493e tempest-UnshelveToHostMultiNodesTest-151498122 tempest-UnshelveToHostMultiNodesTest-151498122-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:08.037174 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a447936d-ee5b-4ef9-a83f-7df79040493e tempest-UnshelveToHostMultiNodesTest-151498122 tempest-UnshelveToHostMultiNodesTest-151498122-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:08.037970 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a447936d-ee5b-4ef9-a83f-7df79040493e tempest-UnshelveToHostMultiNodesTest-151498122 tempest-UnshelveToHostMultiNodesTest-151498122-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:08.039029 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a447936d-ee5b-4ef9-a83f-7df79040493e tempest-UnshelveToHostMultiNodesTest-151498122 tempest-UnshelveToHostMultiNodesTest-151498122-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:08.040343 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a447936d-ee5b-4ef9-a83f-7df79040493e tempest-UnshelveToHostMultiNodesTest-151498122 tempest-UnshelveToHostMultiNodesTest-151498122-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:08.041866 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a447936d-ee5b-4ef9-a83f-7df79040493e tempest-UnshelveToHostMultiNodesTest-151498122 tempest-UnshelveToHostMultiNodesTest-151498122-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:08.209701 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.objects.instance [None req-a447936d-ee5b-4ef9-a83f-7df79040493e tempest-UnshelveToHostMultiNodesTest-151498122 tempest-UnshelveToHostMultiNodesTest-151498122-project-admin] Lazy-loading 'services' on Instance uuid 0eb40c80-c056-4096-a586-7e957a63f7cf {{(pid=128758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:01:08.239718 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-a447936d-ee5b-4ef9-a83f-7df79040493e tempest-UnshelveToHostMultiNodesTest-151498122 tempest-UnshelveToHostMultiNodesTest-151498122-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf" status: 200 len: 1938 microversion: 2.91 time: 0.219380 Sep 14 09:01:08.260797 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1494/2922] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:01:08 2022] GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf => generated 1938 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:01:08.272272 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-09aebf2e-346d-4324-9ab5-eada491d97c5 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:08.273292 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-09aebf2e-346d-4324-9ab5-eada491d97c5 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] [instance: d5c8ab80-5993-4193-8c83-73345637d5eb] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:08.290705 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-09aebf2e-346d-4324-9ab5-eada491d97c5 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:08.292112 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-09aebf2e-346d-4324-9ab5-eada491d97c5 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:08.292806 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-09aebf2e-346d-4324-9ab5-eada491d97c5 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:08.293883 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-09aebf2e-346d-4324-9ab5-eada491d97c5 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:08.295121 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-09aebf2e-346d-4324-9ab5-eada491d97c5 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:08.295796 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-09aebf2e-346d-4324-9ab5-eada491d97c5 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:08.346872 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-c5107750-4221-4026-8798-5dfa81e7c08e tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:08.368453 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-c5107750-4221-4026-8798-5dfa81e7c08e tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/680c3968-8912-45c4-b1c3-634c06ec30c3" status: 200 len: 1315 microversion: 2.1 time: 0.527288 Sep 14 09:01:08.385032 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1429/2923] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:01:07 2022] GET /compute/v2.1/servers/680c3968-8912-45c4-b1c3-634c06ec30c3 => generated 1315 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:01:08.401414 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-14eefe11-5c1e-43fa-9fb7-e34b459ac511 tempest-UnshelveToHostMultiNodesTest-151498122 tempest-UnshelveToHostMultiNodesTest-151498122-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:08.414298 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-14eefe11-5c1e-43fa-9fb7-e34b459ac511 tempest-UnshelveToHostMultiNodesTest-151498122 tempest-UnshelveToHostMultiNodesTest-151498122-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:08.418511 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-14eefe11-5c1e-43fa-9fb7-e34b459ac511 tempest-UnshelveToHostMultiNodesTest-151498122 tempest-UnshelveToHostMultiNodesTest-151498122-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:08.419355 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-14eefe11-5c1e-43fa-9fb7-e34b459ac511 tempest-UnshelveToHostMultiNodesTest-151498122 tempest-UnshelveToHostMultiNodesTest-151498122-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:08.421104 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-14eefe11-5c1e-43fa-9fb7-e34b459ac511 tempest-UnshelveToHostMultiNodesTest-151498122 tempest-UnshelveToHostMultiNodesTest-151498122-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:08.421821 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-14eefe11-5c1e-43fa-9fb7-e34b459ac511 tempest-UnshelveToHostMultiNodesTest-151498122 tempest-UnshelveToHostMultiNodesTest-151498122-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:08.423490 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-14eefe11-5c1e-43fa-9fb7-e34b459ac511 tempest-UnshelveToHostMultiNodesTest-151498122 tempest-UnshelveToHostMultiNodesTest-151498122-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:08.488258 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-14eefe11-5c1e-43fa-9fb7-e34b459ac511 tempest-UnshelveToHostMultiNodesTest-151498122 tempest-UnshelveToHostMultiNodesTest-151498122-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 500 microversion: 2.91 time: 0.101960 Sep 14 09:01:08.501169 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1430/2924] 10.222.0.60 () {60 vars in 1217 bytes} [Wed Sep 14 09:01:08 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 500 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 09:01:08.507271 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c43e5b45-893a-4689-8896-cac195676246 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:01:08.508182 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-c43e5b45-893a-4689-8896-cac195676246 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] [instance: 0eb40c80-c056-4096-a586-7e957a63f7cf] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:08.526142 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-09aebf2e-346d-4324-9ab5-eada491d97c5 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ab7166e40e4a908eefbfb03b3b8804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de82b83dadd541dbb4a939f2fc04a163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:08.534823 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c43e5b45-893a-4689-8896-cac195676246 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:08.535864 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c43e5b45-893a-4689-8896-cac195676246 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:08.538442 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c43e5b45-893a-4689-8896-cac195676246 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:08.539918 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c43e5b45-893a-4689-8896-cac195676246 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:08.540652 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c43e5b45-893a-4689-8896-cac195676246 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:08.541636 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-09aebf2e-346d-4324-9ab5-eada491d97c5 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] 10.222.0.60 "GET /compute/v2.1/servers/d5c8ab80-5993-4193-8c83-73345637d5eb" status: 200 len: 1318 microversion: 2.1 time: 0.279285 Sep 14 09:01:08.544462 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c43e5b45-893a-4689-8896-cac195676246 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:08.544627 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1495/2925] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:01:08 2022] GET /compute/v2.1/servers/d5c8ab80-5993-4193-8c83-73345637d5eb => generated 1318 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:01:08.572603 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:01:08.581287 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.objects.instance [None req-c43e5b45-893a-4689-8896-cac195676246 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lazy-loading 'flavor' on Instance uuid 0eb40c80-c056-4096-a586-7e957a63f7cf {{(pid=128759) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:01:08.750309 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-2ca83bbd-56f2-4b00-ba73-bd21529478e7 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:08.750961 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-2ca83bbd-56f2-4b00-ba73-bd21529478e7 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: 3b592d04-368e-4b8f-bae2-c77aebec4105] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:08.760294 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2ca83bbd-56f2-4b00-ba73-bd21529478e7 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:08.760812 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2ca83bbd-56f2-4b00-ba73-bd21529478e7 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:08.761242 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2ca83bbd-56f2-4b00-ba73-bd21529478e7 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:08.761962 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2ca83bbd-56f2-4b00-ba73-bd21529478e7 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:08.763466 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2ca83bbd-56f2-4b00-ba73-bd21529478e7 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:08.763930 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2ca83bbd-56f2-4b00-ba73-bd21529478e7 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:08.989495 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-c43e5b45-893a-4689-8896-cac195676246 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] 10.222.0.60 "POST /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf/action" status: 202 len: 0 microversion: 2.91 time: 0.486568 Sep 14 09:01:08.993395 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1431/2926] 10.222.0.60 () {62 vars in 1319 bytes} [Wed Sep 14 09:01:08 2022] POST /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf/action => generated 0 bytes in 488 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:01:09.000756 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-7f7e7f1f-d71f-496d-8a66-856282d2a381 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Calling method '.version_select at 0x7f7d48658f70>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:09.079122 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-7f7e7f1f-d71f-496d-8a66-856282d2a381 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] 10.222.0.60 "GET /compute/v2.1/images/dad3a300-4c39-4706-a163-fe284681c5e2" status: 200 len: 1454 microversion: 2.1 time: 0.087503 Sep 14 09:01:09.080947 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1432/2927] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:01:08 2022] GET /compute/v2.1/images/dad3a300-4c39-4706-a163-fe284681c5e2 => generated 1454 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:01:09.088551 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b58a4882-5b88-4b55-9734-c9a586fc326c tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:09.089292 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b58a4882-5b88-4b55-9734-c9a586fc326c tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] [instance: 0eb40c80-c056-4096-a586-7e957a63f7cf] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:09.105766 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:01:09.107675 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b58a4882-5b88-4b55-9734-c9a586fc326c tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:09.108180 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b58a4882-5b88-4b55-9734-c9a586fc326c tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:09.108621 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b58a4882-5b88-4b55-9734-c9a586fc326c tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:09.109338 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b58a4882-5b88-4b55-9734-c9a586fc326c tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:09.109810 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b58a4882-5b88-4b55-9734-c9a586fc326c tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:09.110227 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b58a4882-5b88-4b55-9734-c9a586fc326c tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:09.179745 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-2ca83bbd-56f2-4b00-ba73-bd21529478e7 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9d40e54481461cba53fedb9a6abdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed2295a58f8451993a57ce0a6f9ba29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:09.192780 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-2ca83bbd-56f2-4b00-ba73-bd21529478e7 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] 10.222.0.60 "GET /compute/v2.1/servers/3b592d04-368e-4b8f-bae2-c77aebec4105" status: 200 len: 1317 microversion: 2.1 time: 0.446620 Sep 14 09:01:09.193944 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1496/2928] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:01:08 2022] GET /compute/v2.1/servers/3b592d04-368e-4b8f-bae2-c77aebec4105 => generated 1317 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:01:09.360446 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b58a4882-5b88-4b55-9734-c9a586fc326c tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:09.370777 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b58a4882-5b88-4b55-9734-c9a586fc326c tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:09.377980 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b58a4882-5b88-4b55-9734-c9a586fc326c tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:09.385571 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b58a4882-5b88-4b55-9734-c9a586fc326c tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] 10.222.0.60 "GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf" status: 200 len: 1537 microversion: 2.91 time: 0.302094 Sep 14 09:01:09.386164 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1433/2929] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:01:09 2022] GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf => generated 1537 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:01:09.407737 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-f8e549bb-1e0e-43a3-b109-2b65abebfd31 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:09.408370 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-f8e549bb-1e0e-43a3-b109-2b65abebfd31 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: 680c3968-8912-45c4-b1c3-634c06ec30c3] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:09.415582 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f8e549bb-1e0e-43a3-b109-2b65abebfd31 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:09.416064 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f8e549bb-1e0e-43a3-b109-2b65abebfd31 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:09.416506 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f8e549bb-1e0e-43a3-b109-2b65abebfd31 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:09.417223 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f8e549bb-1e0e-43a3-b109-2b65abebfd31 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:09.417685 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f8e549bb-1e0e-43a3-b109-2b65abebfd31 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:09.418117 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f8e549bb-1e0e-43a3-b109-2b65abebfd31 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:09.573182 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8bbfb530-be5b-4272-aae7-f0e22d028405 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:09.574026 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-8bbfb530-be5b-4272-aae7-f0e22d028405 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] [instance: d5c8ab80-5993-4193-8c83-73345637d5eb] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:09.584156 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8bbfb530-be5b-4272-aae7-f0e22d028405 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:09.584991 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8bbfb530-be5b-4272-aae7-f0e22d028405 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:09.588653 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8bbfb530-be5b-4272-aae7-f0e22d028405 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:09.589633 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8bbfb530-be5b-4272-aae7-f0e22d028405 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:09.590330 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8bbfb530-be5b-4272-aae7-f0e22d028405 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:09.591515 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8bbfb530-be5b-4272-aae7-f0e22d028405 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:09.598858 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-f8e549bb-1e0e-43a3-b109-2b65abebfd31 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:09.606928 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-f8e549bb-1e0e-43a3-b109-2b65abebfd31 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/680c3968-8912-45c4-b1c3-634c06ec30c3" status: 200 len: 1315 microversion: 2.1 time: 0.212403 Sep 14 09:01:09.607532 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1497/2930] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:01:09 2022] GET /compute/v2.1/servers/680c3968-8912-45c4-b1c3-634c06ec30c3 => generated 1315 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:01:09.774918 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-8bbfb530-be5b-4272-aae7-f0e22d028405 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ab7166e40e4a908eefbfb03b3b8804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de82b83dadd541dbb4a939f2fc04a163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:09.789532 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-8bbfb530-be5b-4272-aae7-f0e22d028405 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] 10.222.0.60 "GET /compute/v2.1/servers/d5c8ab80-5993-4193-8c83-73345637d5eb" status: 200 len: 1509 microversion: 2.1 time: 0.221942 Sep 14 09:01:09.791035 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1434/2931] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:01:09 2022] GET /compute/v2.1/servers/d5c8ab80-5993-4193-8c83-73345637d5eb => generated 1509 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:01:10.097071 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-10933349-1501-4f70-8a6e-c24cd01b0a6d tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Calling method '.version_select at 0x7f7d48665820>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:10.120847 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-3d9cbcee-1743-49c5-8273-f32a55fc4c2e tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:10.121680 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-3d9cbcee-1743-49c5-8273-f32a55fc4c2e tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] [instance: 59f196e8-c202-4073-8663-2ae19358a044] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:10.131494 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3d9cbcee-1743-49c5-8273-f32a55fc4c2e tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:10.132219 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3d9cbcee-1743-49c5-8273-f32a55fc4c2e tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:10.133323 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3d9cbcee-1743-49c5-8273-f32a55fc4c2e tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:10.134515 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3d9cbcee-1743-49c5-8273-f32a55fc4c2e tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:10.135782 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3d9cbcee-1743-49c5-8273-f32a55fc4c2e tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:10.136422 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3d9cbcee-1743-49c5-8273-f32a55fc4c2e tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:10.170430 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-3d9cbcee-1743-49c5-8273-f32a55fc4c2e tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] [instance: 59f196e8-c202-4073-8663-2ae19358a044] Going to try to terminate instance {{(pid=128758) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:01:10.186250 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-10933349-1501-4f70-8a6e-c24cd01b0a6d tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] 10.222.0.60 "GET /compute/v2.1/images/dad3a300-4c39-4706-a163-fe284681c5e2" status: 200 len: 1454 microversion: 2.1 time: 0.093195 Sep 14 09:01:10.186845 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1435/2932] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:01:10 2022] GET /compute/v2.1/images/dad3a300-4c39-4706-a163-fe284681c5e2 => generated 1454 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:01:10.224360 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-008f5a84-891b-4a97-aa60-f2fd4f0d8e53 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:10.225078 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-008f5a84-891b-4a97-aa60-f2fd4f0d8e53 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: 3b592d04-368e-4b8f-bae2-c77aebec4105] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:10.240014 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-008f5a84-891b-4a97-aa60-f2fd4f0d8e53 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:10.242754 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-008f5a84-891b-4a97-aa60-f2fd4f0d8e53 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:10.243958 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-008f5a84-891b-4a97-aa60-f2fd4f0d8e53 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:10.244094 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-008f5a84-891b-4a97-aa60-f2fd4f0d8e53 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:10.245765 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-008f5a84-891b-4a97-aa60-f2fd4f0d8e53 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:10.246486 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-008f5a84-891b-4a97-aa60-f2fd4f0d8e53 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:10.343020 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-3d9cbcee-1743-49c5-8273-f32a55fc4c2e tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] 10.222.0.60 "DELETE /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044" status: 204 len: 0 microversion: 2.42 time: 0.542158 Sep 14 09:01:10.348012 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1498/2933] 10.222.0.60 () {60 vars in 1280 bytes} [Wed Sep 14 09:01:09 2022] DELETE /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 14 09:01:10.362254 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-9d1c73e6-e2c7-4cd1-9e30-64dcc47a0c75 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:10.363107 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-9d1c73e6-e2c7-4cd1-9e30-64dcc47a0c75 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] [instance: 59f196e8-c202-4073-8663-2ae19358a044] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:10.377199 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9d1c73e6-e2c7-4cd1-9e30-64dcc47a0c75 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:10.377925 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9d1c73e6-e2c7-4cd1-9e30-64dcc47a0c75 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:10.379038 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9d1c73e6-e2c7-4cd1-9e30-64dcc47a0c75 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:10.380721 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9d1c73e6-e2c7-4cd1-9e30-64dcc47a0c75 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:10.382491 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9d1c73e6-e2c7-4cd1-9e30-64dcc47a0c75 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:10.383927 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9d1c73e6-e2c7-4cd1-9e30-64dcc47a0c75 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:10.477728 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-008f5a84-891b-4a97-aa60-f2fd4f0d8e53 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9d40e54481461cba53fedb9a6abdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed2295a58f8451993a57ce0a6f9ba29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:10.487536 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-008f5a84-891b-4a97-aa60-f2fd4f0d8e53 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] 10.222.0.60 "GET /compute/v2.1/servers/3b592d04-368e-4b8f-bae2-c77aebec4105" status: 200 len: 1317 microversion: 2.1 time: 0.267757 Sep 14 09:01:10.488128 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1436/2934] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:01:10 2022] GET /compute/v2.1/servers/3b592d04-368e-4b8f-bae2-c77aebec4105 => generated 1317 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:01:10.507813 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-87bdbbbd-18b9-4a59-9d8c-e7dc6024b6fa tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:10.508527 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-87bdbbbd-18b9-4a59-9d8c-e7dc6024b6fa tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] [instance: 0eb40c80-c056-4096-a586-7e957a63f7cf] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:10.520153 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-87bdbbbd-18b9-4a59-9d8c-e7dc6024b6fa tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:10.520653 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-87bdbbbd-18b9-4a59-9d8c-e7dc6024b6fa tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:10.521097 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-87bdbbbd-18b9-4a59-9d8c-e7dc6024b6fa tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:10.521808 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-87bdbbbd-18b9-4a59-9d8c-e7dc6024b6fa tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:10.522272 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-87bdbbbd-18b9-4a59-9d8c-e7dc6024b6fa tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:10.522846 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-87bdbbbd-18b9-4a59-9d8c-e7dc6024b6fa tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:10.621610 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-87bdbbbd-18b9-4a59-9d8c-e7dc6024b6fa tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:10.636527 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-87bdbbbd-18b9-4a59-9d8c-e7dc6024b6fa tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:10.641854 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-87bdbbbd-18b9-4a59-9d8c-e7dc6024b6fa tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:10.651092 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-87bdbbbd-18b9-4a59-9d8c-e7dc6024b6fa tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] 10.222.0.60 "GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf" status: 200 len: 1537 microversion: 2.91 time: 0.157368 Sep 14 09:01:10.652381 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1437/2935] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:01:10 2022] GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf => generated 1537 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:01:10.657887 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-dc1b3ca0-f0c8-4564-bba2-6c89b9b56cac tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:10.659085 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-dc1b3ca0-f0c8-4564-bba2-6c89b9b56cac tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: 680c3968-8912-45c4-b1c3-634c06ec30c3] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:10.665485 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dc1b3ca0-f0c8-4564-bba2-6c89b9b56cac tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:10.666258 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dc1b3ca0-f0c8-4564-bba2-6c89b9b56cac tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:10.666931 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dc1b3ca0-f0c8-4564-bba2-6c89b9b56cac tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:10.667990 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dc1b3ca0-f0c8-4564-bba2-6c89b9b56cac tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:10.669455 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dc1b3ca0-f0c8-4564-bba2-6c89b9b56cac tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:10.670092 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dc1b3ca0-f0c8-4564-bba2-6c89b9b56cac tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:10.781173 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-9d1c73e6-e2c7-4cd1-9e30-64dcc47a0c75 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:10.812392 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-9d1c73e6-e2c7-4cd1-9e30-64dcc47a0c75 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:10.820095 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-9d1c73e6-e2c7-4cd1-9e30-64dcc47a0c75 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:10.821479 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-9d1c73e6-e2c7-4cd1-9e30-64dcc47a0c75 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] 10.222.0.60 "GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044" status: 200 len: 2961 microversion: 2.42 time: 0.472205 Sep 14 09:01:10.822381 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1499/2936] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:01:10 2022] GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044 => generated 2961 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:01:10.879078 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-dc1b3ca0-f0c8-4564-bba2-6c89b9b56cac tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:10.889741 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-dc1b3ca0-f0c8-4564-bba2-6c89b9b56cac tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/680c3968-8912-45c4-b1c3-634c06ec30c3" status: 200 len: 1315 microversion: 2.1 time: 0.235472 Sep 14 09:01:10.889967 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-6f6a041f-e277-4f2a-be9c-2082dae1c569 req-af3ee11a-4461-43f7-af5a-1f7b65a9d2c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "680c3968-8912-45c4-b1c3-634c06ec30c3", "name": "network-vif-plugged", "status": "completed", "tag": "459779a8-3426-4989-910a-1f725b3e69c6"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:01:10.906968 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1438/2937] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:01:10 2022] GET /compute/v2.1/servers/680c3968-8912-45c4-b1c3-634c06ec30c3 => generated 1315 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:01:10.910806 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-6f6a041f-e277-4f2a-be9c-2082dae1c569 req-af3ee11a-4461-43f7-af5a-1f7b65a9d2c5 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:10.911616 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-6f6a041f-e277-4f2a-be9c-2082dae1c569 req-af3ee11a-4461-43f7-af5a-1f7b65a9d2c5 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:10.912063 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-6f6a041f-e277-4f2a-be9c-2082dae1c569 req-af3ee11a-4461-43f7-af5a-1f7b65a9d2c5 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:10.943804 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-6f6a041f-e277-4f2a-be9c-2082dae1c569 req-af3ee11a-4461-43f7-af5a-1f7b65a9d2c5 service nova] Creating event network-vif-plugged:459779a8-3426-4989-910a-1f725b3e69c6 for instance 680c3968-8912-45c4-b1c3-634c06ec30c3 on n-h1-836830-18 Sep 14 09:01:10.949648 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-6f6a041f-e277-4f2a-be9c-2082dae1c569 req-af3ee11a-4461-43f7-af5a-1f7b65a9d2c5 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063853 Sep 14 09:01:10.950796 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1500/2938] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:01:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:01:11.204760 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-1d0a20bb-8198-4376-adcb-b15a55c448c6 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Calling method '.version_select at 0x7f7d486cfca0>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:11.311877 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-1d0a20bb-8198-4376-adcb-b15a55c448c6 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] 10.222.0.60 "GET /compute/v2.1/images/dad3a300-4c39-4706-a163-fe284681c5e2" status: 200 len: 1454 microversion: 2.1 time: 0.113479 Sep 14 09:01:11.321069 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1439/2939] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:01:11 2022] GET /compute/v2.1/images/dad3a300-4c39-4706-a163-fe284681c5e2 => generated 1454 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:01:11.507079 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=4 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:01:11.518757 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=16 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:01:11.518757 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-85852a01-9426-4189-96a1-5ee6f9b64c47 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:11.518757 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-85852a01-9426-4189-96a1-5ee6f9b64c47 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: 3b592d04-368e-4b8f-bae2-c77aebec4105] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:11.520552 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-85852a01-9426-4189-96a1-5ee6f9b64c47 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:11.521054 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-85852a01-9426-4189-96a1-5ee6f9b64c47 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:11.521502 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-85852a01-9426-4189-96a1-5ee6f9b64c47 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:11.522217 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-85852a01-9426-4189-96a1-5ee6f9b64c47 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:11.522683 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-85852a01-9426-4189-96a1-5ee6f9b64c47 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:11.523175 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-85852a01-9426-4189-96a1-5ee6f9b64c47 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:11.668858 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-85852a01-9426-4189-96a1-5ee6f9b64c47 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9d40e54481461cba53fedb9a6abdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed2295a58f8451993a57ce0a6f9ba29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:11.677256 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-85852a01-9426-4189-96a1-5ee6f9b64c47 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] 10.222.0.60 "GET /compute/v2.1/servers/3b592d04-368e-4b8f-bae2-c77aebec4105" status: 200 len: 1317 microversion: 2.1 time: 0.171047 Sep 14 09:01:11.677909 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1501/2940] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:01:11 2022] GET /compute/v2.1/servers/3b592d04-368e-4b8f-bae2-c77aebec4105 => generated 1317 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:01:11.686691 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-2f8f7b8c-fe81-47a4-aeb7-b8d2386623fb tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:11.687342 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-2f8f7b8c-fe81-47a4-aeb7-b8d2386623fb tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] [instance: 0eb40c80-c056-4096-a586-7e957a63f7cf] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:11.694058 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2f8f7b8c-fe81-47a4-aeb7-b8d2386623fb tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:11.694553 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2f8f7b8c-fe81-47a4-aeb7-b8d2386623fb tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:11.695032 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2f8f7b8c-fe81-47a4-aeb7-b8d2386623fb tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:11.696986 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2f8f7b8c-fe81-47a4-aeb7-b8d2386623fb tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:11.697555 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2f8f7b8c-fe81-47a4-aeb7-b8d2386623fb tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:11.698323 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2f8f7b8c-fe81-47a4-aeb7-b8d2386623fb tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:11.769970 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-2f8f7b8c-fe81-47a4-aeb7-b8d2386623fb tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:11.779696 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-2f8f7b8c-fe81-47a4-aeb7-b8d2386623fb tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:11.781622 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-2f8f7b8c-fe81-47a4-aeb7-b8d2386623fb tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:11.786874 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-2f8f7b8c-fe81-47a4-aeb7-b8d2386623fb tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] 10.222.0.60 "GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf" status: 200 len: 1537 microversion: 2.91 time: 0.105891 Sep 14 09:01:11.802464 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1440/2941] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:01:11 2022] GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf => generated 1537 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:01:11.849820 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-40004086-b807-4168-8b1a-76b002711844 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:11.850467 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-40004086-b807-4168-8b1a-76b002711844 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] [instance: 59f196e8-c202-4073-8663-2ae19358a044] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:11.856861 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-40004086-b807-4168-8b1a-76b002711844 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:11.857610 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-40004086-b807-4168-8b1a-76b002711844 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:11.858237 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-40004086-b807-4168-8b1a-76b002711844 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:11.859219 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-40004086-b807-4168-8b1a-76b002711844 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:11.859831 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-40004086-b807-4168-8b1a-76b002711844 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:11.860545 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-40004086-b807-4168-8b1a-76b002711844 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:11.913314 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=16 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:01:11.919222 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-78240564-64b2-4b6e-8647-e67a2488d841 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:11.919926 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-78240564-64b2-4b6e-8647-e67a2488d841 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: 680c3968-8912-45c4-b1c3-634c06ec30c3] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:11.931894 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-78240564-64b2-4b6e-8647-e67a2488d841 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:11.932553 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-78240564-64b2-4b6e-8647-e67a2488d841 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:11.934907 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-78240564-64b2-4b6e-8647-e67a2488d841 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:11.935765 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-78240564-64b2-4b6e-8647-e67a2488d841 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:11.938631 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-78240564-64b2-4b6e-8647-e67a2488d841 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:11.939222 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-78240564-64b2-4b6e-8647-e67a2488d841 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:12.129040 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-40004086-b807-4168-8b1a-76b002711844 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:12.143476 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-40004086-b807-4168-8b1a-76b002711844 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:12.147474 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-78240564-64b2-4b6e-8647-e67a2488d841 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:12.155252 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-78240564-64b2-4b6e-8647-e67a2488d841 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/680c3968-8912-45c4-b1c3-634c06ec30c3" status: 200 len: 1315 microversion: 2.1 time: 0.242962 Sep 14 09:01:12.156060 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1441/2942] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:01:11 2022] GET /compute/v2.1/servers/680c3968-8912-45c4-b1c3-634c06ec30c3 => generated 1315 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:01:12.156587 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-40004086-b807-4168-8b1a-76b002711844 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:12.157916 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-40004086-b807-4168-8b1a-76b002711844 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] 10.222.0.60 "GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044" status: 200 len: 2961 microversion: 2.42 time: 0.312079 Sep 14 09:01:12.158996 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1502/2943] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:01:11 2022] GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044 => generated 2961 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:01:12.328676 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-7843f8c6-b882-47cb-8ab1-902de3174451 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Calling method '.version_select at 0x7f7d48658f70>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:12.373786 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-7843f8c6-b882-47cb-8ab1-902de3174451 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] 10.222.0.60 "GET /compute/v2.1/images/dad3a300-4c39-4706-a163-fe284681c5e2" status: 200 len: 1463 microversion: 2.1 time: 0.049342 Sep 14 09:01:12.374379 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1442/2944] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:01:12 2022] GET /compute/v2.1/images/dad3a300-4c39-4706-a163-fe284681c5e2 => generated 1463 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:01:12.387865 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ddfa8006-5e28-4781-ba84-f1b3b8a01df8 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Calling method '.version_select at 0x7f7d447bfa60>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:12.405306 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-19c68aee-d4c1-4217-9c32-fe794f9b2231 tempest-VolumesAdminNegativeTest-169244520 tempest-VolumesAdminNegativeTest-169244520-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "de0aec83-c88c-4b66-8d07-a3f540b57b2a"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:01:12.407728 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-19c68aee-d4c1-4217-9c32-fe794f9b2231 tempest-VolumesAdminNegativeTest-169244520 tempest-VolumesAdminNegativeTest-169244520-project-admin] [instance: d5c8ab80-5993-4193-8c83-73345637d5eb] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:12.413657 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-19c68aee-d4c1-4217-9c32-fe794f9b2231 tempest-VolumesAdminNegativeTest-169244520 tempest-VolumesAdminNegativeTest-169244520-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:12.414147 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-19c68aee-d4c1-4217-9c32-fe794f9b2231 tempest-VolumesAdminNegativeTest-169244520 tempest-VolumesAdminNegativeTest-169244520-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:12.414588 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-19c68aee-d4c1-4217-9c32-fe794f9b2231 tempest-VolumesAdminNegativeTest-169244520 tempest-VolumesAdminNegativeTest-169244520-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:12.415462 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-19c68aee-d4c1-4217-9c32-fe794f9b2231 tempest-VolumesAdminNegativeTest-169244520 tempest-VolumesAdminNegativeTest-169244520-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:12.415761 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-19c68aee-d4c1-4217-9c32-fe794f9b2231 tempest-VolumesAdminNegativeTest-169244520 tempest-VolumesAdminNegativeTest-169244520-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:12.416199 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-19c68aee-d4c1-4217-9c32-fe794f9b2231 tempest-VolumesAdminNegativeTest-169244520 tempest-VolumesAdminNegativeTest-169244520-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:12.435266 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-ddfa8006-5e28-4781-ba84-f1b3b8a01df8 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] 10.222.0.60 "GET /compute/v2.1/images/dad3a300-4c39-4706-a163-fe284681c5e2" status: 200 len: 1463 microversion: 2.1 time: 0.050521 Sep 14 09:01:12.436176 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1503/2945] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:01:12 2022] GET /compute/v2.1/images/dad3a300-4c39-4706-a163-fe284681c5e2 => generated 1463 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:01:12.449967 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-6b3776a5-16cb-4d97-8116-8fac4a48f875 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:12.450665 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-6b3776a5-16cb-4d97-8116-8fac4a48f875 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] [instance: ebf9bfa9-e941-4d23-8f6c-9867102feff2] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:12.457166 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6b3776a5-16cb-4d97-8116-8fac4a48f875 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:12.457738 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6b3776a5-16cb-4d97-8116-8fac4a48f875 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:12.458282 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6b3776a5-16cb-4d97-8116-8fac4a48f875 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:12.459094 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6b3776a5-16cb-4d97-8116-8fac4a48f875 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:12.459633 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6b3776a5-16cb-4d97-8116-8fac4a48f875 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:12.460142 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6b3776a5-16cb-4d97-8116-8fac4a48f875 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:12.466243 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-19c68aee-d4c1-4217-9c32-fe794f9b2231 tempest-VolumesAdminNegativeTest-169244520 tempest-VolumesAdminNegativeTest-169244520-project-admin] HTTP exception thrown: Volume 30246e68-72f1-46d5-8c9a-5ff45a91cf6a could not be found. Sep 14 09:01:12.470033 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-19c68aee-d4c1-4217-9c32-fe794f9b2231 tempest-VolumesAdminNegativeTest-169244520 tempest-VolumesAdminNegativeTest-169244520-project-admin] Request method failure captured: Sep 14 09:01:12.470033 n-d-836830-18 devstack@n-api.service[128759]: request: PUT /compute/v2.1/servers/d5c8ab80-5993-4193-8c83-73345637d5eb/os-volume_attachments/30246e68-72f1-46d5-8c9a-5ff45a91cf6a HTTP/1.1 Sep 14 09:01:12.470033 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:01:12.470033 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:01:12.470033 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:01:12.470033 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 74 Sep 14 09:01:12.470033 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:01:12.470033 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:01:12.470033 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:01:12.470033 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:01:12.470033 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZe6rSz63BLNoEcQYSBVODLqgL9Dfovqr7O2LIGcI8W6C5XuDskS7XE6mdCGIPxtoe5wcAzh2c6NYq7WhJBD9XEovdeWDVdZB10luSK53LMjDw0qAUoA9v3V6Rtee5iV7CmJugsAoxto6QuOuCiwyYlPz-DlgJgG4Aez6OsLkJCOqF8 Sep 14 09:01:12.470033 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:01:12.470033 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:01:12.470033 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:01:12.470033 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:01:12.470033 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:01:12.470033 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:01:12.470033 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: b05173fd13e24cb393b3b90fa09094b1 Sep 14 09:01:12.470033 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-VolumesAdminNegativeTest-169244520 Sep 14 09:01:12.470033 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member,admin Sep 14 09:01:12.470033 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member,admin Sep 14 09:01:12.470033 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b05173fd13e24cb393b3b90fa09094b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b05173fd13e24cb393b3b90fa09094b1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b05173fd13e24cb393b3b90fa09094b1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b05173fd13e24cb393b3b90fa09094b1"}]}] Sep 14 09:01:12.470033 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-VolumesAdminNegativeTest-169244520 Sep 14 09:01:12.470033 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: b05173fd13e24cb393b3b90fa09094b1 Sep 14 09:01:12.470033 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-169244520 Sep 14 09:01:12.470033 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-VolumesAdminNegativeTest-169244520-project-admin Sep 14 09:01:12.470033 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:01:12.470033 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:01:12.470033 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 9c49592d3b854ebc91d9478e030af74a Sep 14 09:01:12.470033 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-VolumesAdminNegativeTest-169244520-project-admin Sep 14 09:01:12.470033 n-d-836830-18 devstack@n-api.service[128759]: Sep 14 09:01:12.470033 n-d-836830-18 devstack@n-api.service[128759]: {"volumeAttachment": {"volumeId": "de0aec83-c88c-4b66-8d07-a3f540b57b2a"}} Sep 14 09:01:12.470033 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:01:12.470033 n-d-836830-18 devstack@n-api.service[128759]: exception: Volume 30246e68-72f1-46d5-8c9a-5ff45a91cf6a could not be found. Sep 14 09:01:12.470033 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'server_id': 'd5c8ab80-5993-4193-8c83-73345637d5eb', 'id': '30246e68-72f1-46d5-8c9a-5ff45a91cf6a', 'body': {'volumeAttachment': {'volumeId': 'de0aec83-c88c-4b66-8d07-a3f540b57b2a'}}} Sep 14 09:01:12.470033 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:01:12.470033 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:01:12.470033 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 14 09:01:12.470033 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 14 09:01:12.470033 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 14 09:01:12.470033 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 14 09:01:12.470033 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 14 09:01:12.470033 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 14 09:01:12.470033 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 14 09:01:12.470033 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 14 09:01:12.470033 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 14 09:01:12.470033 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 14 09:01:12.470033 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 14 09:01:12.470033 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 14 09:01:12.470033 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 14 09:01:12.470033 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 14 09:01:12.470033 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 30246e68-72f1-46d5-8c9a-5ff45a91cf6a could not be found. (HTTP 404) (Request-ID: req-b76b111c-4b0b-41a6-86d5-a079312976f2) Sep 14 09:01:12.470033 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:01:12.470033 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:01:12.470033 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:01:12.470033 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:01:12.470033 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Sep 14 09:01:12.470033 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Sep 14 09:01:12.470033 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 14 09:01:12.470033 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 14 09:01:12.470033 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 14 09:01:12.474624 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 14 09:01:12.474624 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 14 09:01:12.474624 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 14 09:01:12.474624 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 14 09:01:12.474624 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 14 09:01:12.474624 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 14 09:01:12.474624 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 14 09:01:12.474624 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 14 09:01:12.474624 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 14 09:01:12.474624 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 14 09:01:12.474624 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 14 09:01:12.474624 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 14 09:01:12.474624 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 14 09:01:12.474624 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 14 09:01:12.474624 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 14 09:01:12.474624 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 14 09:01:12.474624 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 14 09:01:12.474624 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 30246e68-72f1-46d5-8c9a-5ff45a91cf6a could not be found. Sep 14 09:01:12.474624 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:01:12.474624 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:01:12.474624 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:01:12.474624 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:01:12.474624 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:01:12.474624 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:01:12.474624 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:01:12.474624 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:01:12.474624 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:01:12.474624 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:01:12.474624 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:01:12.474624 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:01:12.474624 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:01:12.474624 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:01:12.474624 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Sep 14 09:01:12.474624 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Sep 14 09:01:12.474624 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Sep 14 09:01:12.474624 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:01:12.474624 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 30246e68-72f1-46d5-8c9a-5ff45a91cf6a could not be found. Sep 14 09:01:12.474624 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:01:12.474624 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:01:12.474624 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:01:12.474624 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:01:12.474624 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:01:12.474624 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:01:12.474624 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:01:12.474624 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:01:12.474624 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 30246e68-72f1-46d5-8c9a-5ff45a91cf6a could not be found. Sep 14 09:01:12.474624 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:01:12.474624 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-19c68aee-d4c1-4217-9c32-fe794f9b2231 tempest-VolumesAdminNegativeTest-169244520 tempest-VolumesAdminNegativeTest-169244520-project-admin] Returning 404 to user: Volume 30246e68-72f1-46d5-8c9a-5ff45a91cf6a could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:01:12.474624 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-19c68aee-d4c1-4217-9c32-fe794f9b2231 tempest-VolumesAdminNegativeTest-169244520 tempest-VolumesAdminNegativeTest-169244520-project-admin] 10.222.0.60 "PUT /compute/v2.1/servers/d5c8ab80-5993-4193-8c83-73345637d5eb/os-volume_attachments/30246e68-72f1-46d5-8c9a-5ff45a91cf6a" status: 404 len: 109 microversion: 2.1 time: 0.070240 Sep 14 09:01:12.482087 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1443/2946] 10.222.0.60 () {60 vars in 1433 bytes} [Wed Sep 14 09:01:12 2022] PUT /compute/v2.1/servers/d5c8ab80-5993-4193-8c83-73345637d5eb/os-volume_attachments/30246e68-72f1-46d5-8c9a-5ff45a91cf6a => generated 109 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:01:12.684062 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-6b3776a5-16cb-4d97-8116-8fac4a48f875 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a475c6e2b35f494aa8380aa1783e1779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c6f0c84e964383af6a4025d80fc93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:12.693599 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-6b3776a5-16cb-4d97-8116-8fac4a48f875 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] 10.222.0.60 "GET /compute/v2.1/servers/ebf9bfa9-e941-4d23-8f6c-9867102feff2" status: 200 len: 1479 microversion: 2.1 time: 0.247273 Sep 14 09:01:12.697457 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1504/2947] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:01:12 2022] GET /compute/v2.1/servers/ebf9bfa9-e941-4d23-8f6c-9867102feff2 => generated 1479 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:01:12.702367 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b911a092-3adc-4826-b403-fcd8eefd2c67 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:12.705183 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b911a092-3adc-4826-b403-fcd8eefd2c67 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: 3b592d04-368e-4b8f-bae2-c77aebec4105] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:12.724205 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b911a092-3adc-4826-b403-fcd8eefd2c67 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:12.724759 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b911a092-3adc-4826-b403-fcd8eefd2c67 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:12.725200 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b911a092-3adc-4826-b403-fcd8eefd2c67 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:12.725908 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b911a092-3adc-4826-b403-fcd8eefd2c67 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:12.726366 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b911a092-3adc-4826-b403-fcd8eefd2c67 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:12.727396 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b911a092-3adc-4826-b403-fcd8eefd2c67 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:12.817831 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-bdaa4e18-1c34-4821-b199-7847fa6962ee tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:12.818769 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-bdaa4e18-1c34-4821-b199-7847fa6962ee tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] [instance: 0eb40c80-c056-4096-a586-7e957a63f7cf] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:12.826466 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bdaa4e18-1c34-4821-b199-7847fa6962ee tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:12.827305 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bdaa4e18-1c34-4821-b199-7847fa6962ee tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:12.828007 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bdaa4e18-1c34-4821-b199-7847fa6962ee tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:12.828806 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bdaa4e18-1c34-4821-b199-7847fa6962ee tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:12.829471 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bdaa4e18-1c34-4821-b199-7847fa6962ee tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:12.830610 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bdaa4e18-1c34-4821-b199-7847fa6962ee tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:12.854375 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:01:12.924843 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-bdaa4e18-1c34-4821-b199-7847fa6962ee tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:12.942295 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-bdaa4e18-1c34-4821-b199-7847fa6962ee tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:12.943722 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b911a092-3adc-4826-b403-fcd8eefd2c67 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9d40e54481461cba53fedb9a6abdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed2295a58f8451993a57ce0a6f9ba29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:12.943888 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-bdaa4e18-1c34-4821-b199-7847fa6962ee tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:12.951470 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-bdaa4e18-1c34-4821-b199-7847fa6962ee tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] 10.222.0.60 "GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf" status: 200 len: 1537 microversion: 2.91 time: 0.138918 Sep 14 09:01:12.952901 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1505/2948] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:01:12 2022] GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf => generated 1537 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 09:01:12.956509 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b911a092-3adc-4826-b403-fcd8eefd2c67 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] 10.222.0.60 "GET /compute/v2.1/servers/3b592d04-368e-4b8f-bae2-c77aebec4105" status: 200 len: 1317 microversion: 2.1 time: 0.259642 Sep 14 09:01:12.957807 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1444/2949] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:01:12 2022] GET /compute/v2.1/servers/3b592d04-368e-4b8f-bae2-c77aebec4105 => generated 1317 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:01:13.178322 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-bf801283-ab4f-4dc7-af44-f14cc41634e8 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:13.178988 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-bf801283-ab4f-4dc7-af44-f14cc41634e8 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: 680c3968-8912-45c4-b1c3-634c06ec30c3] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:13.186163 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bf801283-ab4f-4dc7-af44-f14cc41634e8 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:13.186343 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-112a8122-46f5-4e77-986f-7e4ec43c58b8 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:13.186804 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bf801283-ab4f-4dc7-af44-f14cc41634e8 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:13.187154 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-112a8122-46f5-4e77-986f-7e4ec43c58b8 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] [instance: 59f196e8-c202-4073-8663-2ae19358a044] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:13.187264 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bf801283-ab4f-4dc7-af44-f14cc41634e8 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:13.187975 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bf801283-ab4f-4dc7-af44-f14cc41634e8 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:13.188440 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bf801283-ab4f-4dc7-af44-f14cc41634e8 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:13.188869 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bf801283-ab4f-4dc7-af44-f14cc41634e8 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:13.193457 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-112a8122-46f5-4e77-986f-7e4ec43c58b8 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:13.193947 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-112a8122-46f5-4e77-986f-7e4ec43c58b8 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:13.194381 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-112a8122-46f5-4e77-986f-7e4ec43c58b8 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:13.195343 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-112a8122-46f5-4e77-986f-7e4ec43c58b8 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:13.196141 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-112a8122-46f5-4e77-986f-7e4ec43c58b8 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:13.196637 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-112a8122-46f5-4e77-986f-7e4ec43c58b8 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:13.430177 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-bf801283-ab4f-4dc7-af44-f14cc41634e8 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:13.439268 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-bf801283-ab4f-4dc7-af44-f14cc41634e8 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/680c3968-8912-45c4-b1c3-634c06ec30c3" status: 200 len: 1502 microversion: 2.1 time: 0.264844 Sep 14 09:01:13.439845 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1506/2950] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:01:13 2022] GET /compute/v2.1/servers/680c3968-8912-45c4-b1c3-634c06ec30c3 => generated 1502 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:01:13.444955 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-112a8122-46f5-4e77-986f-7e4ec43c58b8 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:13.454129 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-112a8122-46f5-4e77-986f-7e4ec43c58b8 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:13.455611 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-112a8122-46f5-4e77-986f-7e4ec43c58b8 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:13.457184 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-112a8122-46f5-4e77-986f-7e4ec43c58b8 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] 10.222.0.60 "GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044" status: 200 len: 2961 microversion: 2.42 time: 0.275202 Sep 14 09:01:13.458070 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1445/2951] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:01:13 2022] GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044 => generated 2961 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 09:01:13.463442 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-3bd99525-4838-4daa-969a-a8c7cd43e49a tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:01:13.464190 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-3bd99525-4838-4daa-969a-a8c7cd43e49a tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: 680c3968-8912-45c4-b1c3-634c06ec30c3] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:13.471067 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3bd99525-4838-4daa-969a-a8c7cd43e49a tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:13.472402 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3bd99525-4838-4daa-969a-a8c7cd43e49a tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:13.473006 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3bd99525-4838-4daa-969a-a8c7cd43e49a tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:13.473871 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3bd99525-4838-4daa-969a-a8c7cd43e49a tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:13.474479 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3bd99525-4838-4daa-969a-a8c7cd43e49a tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:13.482062 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3bd99525-4838-4daa-969a-a8c7cd43e49a tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:13.509737 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.objects.instance [None req-3bd99525-4838-4daa-969a-a8c7cd43e49a tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lazy-loading 'flavor' on Instance uuid 680c3968-8912-45c4-b1c3-634c06ec30c3 {{(pid=128758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:01:13.725001 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b04d9344-76f1-41b9-9671-8671a1e145a0 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:13.725826 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b04d9344-76f1-41b9-9671-8671a1e145a0 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] [instance: ebf9bfa9-e941-4d23-8f6c-9867102feff2] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:13.739101 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b04d9344-76f1-41b9-9671-8671a1e145a0 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:13.741048 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b04d9344-76f1-41b9-9671-8671a1e145a0 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:13.743706 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b04d9344-76f1-41b9-9671-8671a1e145a0 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:13.745194 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b04d9344-76f1-41b9-9671-8671a1e145a0 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:13.747693 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b04d9344-76f1-41b9-9671-8671a1e145a0 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:13.748309 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b04d9344-76f1-41b9-9671-8671a1e145a0 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:13.787681 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-3bd99525-4838-4daa-969a-a8c7cd43e49a tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "POST /compute/v2.1/servers/680c3968-8912-45c4-b1c3-634c06ec30c3/action" status: 202 len: 0 microversion: 2.1 time: 0.328497 Sep 14 09:01:13.792125 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1507/2952] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:01:13 2022] POST /compute/v2.1/servers/680c3968-8912-45c4-b1c3-634c06ec30c3/action => generated 0 bytes in 334 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 14 09:01:13.808085 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-afcb74a0-506d-4340-bab4-85bf4028deca tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:13.809043 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-afcb74a0-506d-4340-bab4-85bf4028deca tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: 680c3968-8912-45c4-b1c3-634c06ec30c3] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:13.820975 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-afcb74a0-506d-4340-bab4-85bf4028deca tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:13.821854 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-afcb74a0-506d-4340-bab4-85bf4028deca tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:13.824521 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-afcb74a0-506d-4340-bab4-85bf4028deca tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:13.826118 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-afcb74a0-506d-4340-bab4-85bf4028deca tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:13.826676 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-afcb74a0-506d-4340-bab4-85bf4028deca tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:13.827440 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-afcb74a0-506d-4340-bab4-85bf4028deca tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:13.997822 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b04d9344-76f1-41b9-9671-8671a1e145a0 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a475c6e2b35f494aa8380aa1783e1779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c6f0c84e964383af6a4025d80fc93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:14.009990 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b04d9344-76f1-41b9-9671-8671a1e145a0 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] 10.222.0.60 "GET /compute/v2.1/servers/ebf9bfa9-e941-4d23-8f6c-9867102feff2" status: 200 len: 1466 microversion: 2.1 time: 0.289322 Sep 14 09:01:14.010580 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1446/2953] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:01:13 2022] GET /compute/v2.1/servers/ebf9bfa9-e941-4d23-8f6c-9867102feff2 => generated 1466 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:01:14.016311 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-2a16f210-71cf-42ca-a848-c6cf90e62aa6 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:14.019742 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-2a16f210-71cf-42ca-a848-c6cf90e62aa6 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: 3b592d04-368e-4b8f-bae2-c77aebec4105] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:14.033926 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2a16f210-71cf-42ca-a848-c6cf90e62aa6 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:14.034428 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2a16f210-71cf-42ca-a848-c6cf90e62aa6 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:14.034874 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2a16f210-71cf-42ca-a848-c6cf90e62aa6 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:14.035663 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2a16f210-71cf-42ca-a848-c6cf90e62aa6 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:14.036126 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2a16f210-71cf-42ca-a848-c6cf90e62aa6 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:14.036561 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2a16f210-71cf-42ca-a848-c6cf90e62aa6 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:14.214616 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-afcb74a0-506d-4340-bab4-85bf4028deca tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:14.232355 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-afcb74a0-506d-4340-bab4-85bf4028deca tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/680c3968-8912-45c4-b1c3-634c06ec30c3" status: 200 len: 1508 microversion: 2.1 time: 0.438920 Sep 14 09:01:14.233395 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1508/2954] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:01:13 2022] GET /compute/v2.1/servers/680c3968-8912-45c4-b1c3-634c06ec30c3 => generated 1508 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:01:14.238334 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-59dadf13-51b4-4d1c-8f8d-6e187b88756b tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:14.238971 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-59dadf13-51b4-4d1c-8f8d-6e187b88756b tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] [instance: 0eb40c80-c056-4096-a586-7e957a63f7cf] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:14.256693 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-59dadf13-51b4-4d1c-8f8d-6e187b88756b tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:14.257324 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-59dadf13-51b4-4d1c-8f8d-6e187b88756b tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:14.258745 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-59dadf13-51b4-4d1c-8f8d-6e187b88756b tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:14.259400 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-59dadf13-51b4-4d1c-8f8d-6e187b88756b tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:14.259918 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-59dadf13-51b4-4d1c-8f8d-6e187b88756b tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:14.260366 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-59dadf13-51b4-4d1c-8f8d-6e187b88756b tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:14.352666 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-59dadf13-51b4-4d1c-8f8d-6e187b88756b tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:14.362422 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-59dadf13-51b4-4d1c-8f8d-6e187b88756b tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:14.364117 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-59dadf13-51b4-4d1c-8f8d-6e187b88756b tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:14.370045 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-59dadf13-51b4-4d1c-8f8d-6e187b88756b tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] 10.222.0.60 "GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf" status: 200 len: 1537 microversion: 2.91 time: 0.135287 Sep 14 09:01:14.370838 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1509/2955] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:01:14 2022] GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf => generated 1537 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:01:14.375529 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-7945bead-46e3-4166-be5d-4395883d2fc2 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-69968508"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:01:14.377848 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-7945bead-46e3-4166-be5d-4395883d2fc2 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] [instance: a4852a58-51c4-4ca0-8c83-19fc8209fd21] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:14.383132 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-2a16f210-71cf-42ca-a848-c6cf90e62aa6 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9d40e54481461cba53fedb9a6abdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed2295a58f8451993a57ce0a6f9ba29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:14.383939 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7945bead-46e3-4166-be5d-4395883d2fc2 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:14.384427 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7945bead-46e3-4166-be5d-4395883d2fc2 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:14.384860 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7945bead-46e3-4166-be5d-4395883d2fc2 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:14.385557 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7945bead-46e3-4166-be5d-4395883d2fc2 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:14.386008 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7945bead-46e3-4166-be5d-4395883d2fc2 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:14.386957 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7945bead-46e3-4166-be5d-4395883d2fc2 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:14.397358 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-2a16f210-71cf-42ca-a848-c6cf90e62aa6 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] 10.222.0.60 "GET /compute/v2.1/servers/3b592d04-368e-4b8f-bae2-c77aebec4105" status: 200 len: 1317 microversion: 2.1 time: 0.384845 Sep 14 09:01:14.398246 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1447/2956] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:01:14 2022] GET /compute/v2.1/servers/3b592d04-368e-4b8f-bae2-c77aebec4105 => generated 1317 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:01:14.417097 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-39ce154d-bb95-402e-8333-b21eb6746f31 req-365f2360-52ef-44b6-8c58-01709f5c8089 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b592d04-368e-4b8f-bae2-c77aebec4105", "name": "network-vif-plugged", "status": "completed", "tag": "64b11033-eadd-4f21-bfc9-3708641d46a2"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:01:14.429570 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-39ce154d-bb95-402e-8333-b21eb6746f31 req-365f2360-52ef-44b6-8c58-01709f5c8089 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:14.430711 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-39ce154d-bb95-402e-8333-b21eb6746f31 req-365f2360-52ef-44b6-8c58-01709f5c8089 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:14.431370 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-39ce154d-bb95-402e-8333-b21eb6746f31 req-365f2360-52ef-44b6-8c58-01709f5c8089 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:14.444002 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-39ce154d-bb95-402e-8333-b21eb6746f31 req-365f2360-52ef-44b6-8c58-01709f5c8089 service nova] Creating event network-vif-plugged:64b11033-eadd-4f21-bfc9-3708641d46a2 for instance 3b592d04-368e-4b8f-bae2-c77aebec4105 on n-h2-836830-18 Sep 14 09:01:14.449188 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-39ce154d-bb95-402e-8333-b21eb6746f31 req-365f2360-52ef-44b6-8c58-01709f5c8089 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049352 Sep 14 09:01:14.453193 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1448/2957] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:01:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:01:14.497078 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ae32a12b-e8c5-4693-a693-9307e6a87cbc tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:14.498831 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-ae32a12b-e8c5-4693-a693-9307e6a87cbc tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] [instance: 59f196e8-c202-4073-8663-2ae19358a044] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:14.507351 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ae32a12b-e8c5-4693-a693-9307e6a87cbc tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:14.508632 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ae32a12b-e8c5-4693-a693-9307e6a87cbc tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:14.509367 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ae32a12b-e8c5-4693-a693-9307e6a87cbc tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:14.510303 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ae32a12b-e8c5-4693-a693-9307e6a87cbc tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:14.511170 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ae32a12b-e8c5-4693-a693-9307e6a87cbc tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:14.511985 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ae32a12b-e8c5-4693-a693-9307e6a87cbc tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:14.654653 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-7945bead-46e3-4166-be5d-4395883d2fc2 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] 10.222.0.60 "POST /compute/v2.1/servers/a4852a58-51c4-4ca0-8c83-19fc8209fd21/action" status: 202 len: 0 microversion: 2.1 time: 0.282637 Sep 14 09:01:14.655566 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1510/2958] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:01:14 2022] POST /compute/v2.1/servers/a4852a58-51c4-4ca0-8c83-19fc8209fd21/action => generated 0 bytes in 284 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 14 09:01:14.667931 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-0b11820e-f85d-4675-b725-77f3cf50438b tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Calling method '.version_select at 0x7f7d44560280>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:14.743642 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-0b11820e-f85d-4675-b725-77f3cf50438b tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] 10.222.0.60 "GET /compute/v2.1/images/be62d386-20a6-4610-9cf3-1a1a7817aac8" status: 200 len: 1453 microversion: 2.1 time: 0.081004 Sep 14 09:01:14.751786 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1511/2959] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:01:14 2022] GET /compute/v2.1/images/be62d386-20a6-4610-9cf3-1a1a7817aac8 => generated 1453 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:01:14.841260 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-ae32a12b-e8c5-4693-a693-9307e6a87cbc tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:14.855734 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-ae32a12b-e8c5-4693-a693-9307e6a87cbc tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:14.859454 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-ae32a12b-e8c5-4693-a693-9307e6a87cbc tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:14.861324 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-ae32a12b-e8c5-4693-a693-9307e6a87cbc tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] 10.222.0.60 "GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044" status: 200 len: 2961 microversion: 2.42 time: 0.374087 Sep 14 09:01:14.862118 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1449/2960] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:01:14 2022] GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044 => generated 2961 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:01:15.257093 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-7551b577-bce1-496c-9007-0e4cd4b1c423 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:15.257945 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-7551b577-bce1-496c-9007-0e4cd4b1c423 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: 680c3968-8912-45c4-b1c3-634c06ec30c3] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:15.265761 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7551b577-bce1-496c-9007-0e4cd4b1c423 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:15.266247 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7551b577-bce1-496c-9007-0e4cd4b1c423 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:15.266681 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7551b577-bce1-496c-9007-0e4cd4b1c423 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:15.267401 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7551b577-bce1-496c-9007-0e4cd4b1c423 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:15.267943 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7551b577-bce1-496c-9007-0e4cd4b1c423 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:15.268311 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7551b577-bce1-496c-9007-0e4cd4b1c423 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:15.402159 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-7551b577-bce1-496c-9007-0e4cd4b1c423 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:15.402623 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a74f35ac-6f13-4ffc-a92e-4c1bebb46161 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:15.403892 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-a74f35ac-6f13-4ffc-a92e-4c1bebb46161 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] [instance: 0eb40c80-c056-4096-a586-7e957a63f7cf] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:15.409899 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a74f35ac-6f13-4ffc-a92e-4c1bebb46161 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:15.410481 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a74f35ac-6f13-4ffc-a92e-4c1bebb46161 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:15.411090 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a74f35ac-6f13-4ffc-a92e-4c1bebb46161 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:15.411543 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-7551b577-bce1-496c-9007-0e4cd4b1c423 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/680c3968-8912-45c4-b1c3-634c06ec30c3" status: 200 len: 1508 microversion: 2.1 time: 0.158432 Sep 14 09:01:15.411944 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a74f35ac-6f13-4ffc-a92e-4c1bebb46161 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:15.412473 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1512/2961] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:01:15 2022] GET /compute/v2.1/servers/680c3968-8912-45c4-b1c3-634c06ec30c3 => generated 1508 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:01:15.417106 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a74f35ac-6f13-4ffc-a92e-4c1bebb46161 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:15.417822 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a74f35ac-6f13-4ffc-a92e-4c1bebb46161 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:15.420252 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d490ec94-984a-44d3-be91-236d1e5711a3 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:15.420886 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-d490ec94-984a-44d3-be91-236d1e5711a3 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: 3b592d04-368e-4b8f-bae2-c77aebec4105] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:15.427196 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d490ec94-984a-44d3-be91-236d1e5711a3 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:15.427694 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d490ec94-984a-44d3-be91-236d1e5711a3 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:15.428139 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d490ec94-984a-44d3-be91-236d1e5711a3 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:15.428974 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d490ec94-984a-44d3-be91-236d1e5711a3 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:15.429445 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d490ec94-984a-44d3-be91-236d1e5711a3 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:15.429907 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d490ec94-984a-44d3-be91-236d1e5711a3 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:15.514040 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-a74f35ac-6f13-4ffc-a92e-4c1bebb46161 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:15.515977 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:01:15.524585 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-a74f35ac-6f13-4ffc-a92e-4c1bebb46161 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:15.526083 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-a74f35ac-6f13-4ffc-a92e-4c1bebb46161 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:15.534205 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a74f35ac-6f13-4ffc-a92e-4c1bebb46161 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] 10.222.0.60 "GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf" status: 200 len: 1537 microversion: 2.91 time: 0.136631 Sep 14 09:01:15.534980 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1450/2962] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:01:15 2022] GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf => generated 1537 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 09:01:15.596343 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-d490ec94-984a-44d3-be91-236d1e5711a3 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9d40e54481461cba53fedb9a6abdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed2295a58f8451993a57ce0a6f9ba29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:15.604230 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-d490ec94-984a-44d3-be91-236d1e5711a3 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] 10.222.0.60 "GET /compute/v2.1/servers/3b592d04-368e-4b8f-bae2-c77aebec4105" status: 200 len: 1317 microversion: 2.1 time: 0.188302 Sep 14 09:01:15.604826 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1513/2963] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:01:15 2022] GET /compute/v2.1/servers/3b592d04-368e-4b8f-bae2-c77aebec4105 => generated 1317 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:01:15.759709 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-bc9c6104-f837-4125-9069-b43aa0cd170e tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Calling method '.version_select at 0x7f7d486cf9d0>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:15.815950 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-bc9c6104-f837-4125-9069-b43aa0cd170e tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] 10.222.0.60 "GET /compute/v2.1/images/be62d386-20a6-4610-9cf3-1a1a7817aac8" status: 200 len: 1453 microversion: 2.1 time: 0.060258 Sep 14 09:01:15.817463 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-4a2e1267-c7aa-4d5f-a7f2-da445211ec3c tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:15.818362 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-4a2e1267-c7aa-4d5f-a7f2-da445211ec3c tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] [instance: d5c8ab80-5993-4193-8c83-73345637d5eb] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:15.824448 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1451/2964] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:01:15 2022] GET /compute/v2.1/images/be62d386-20a6-4610-9cf3-1a1a7817aac8 => generated 1453 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:01:15.826103 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4a2e1267-c7aa-4d5f-a7f2-da445211ec3c tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:15.826786 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4a2e1267-c7aa-4d5f-a7f2-da445211ec3c tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:15.827999 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4a2e1267-c7aa-4d5f-a7f2-da445211ec3c tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:15.828903 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4a2e1267-c7aa-4d5f-a7f2-da445211ec3c tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:15.829728 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4a2e1267-c7aa-4d5f-a7f2-da445211ec3c tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:15.830259 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4a2e1267-c7aa-4d5f-a7f2-da445211ec3c tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:15.857772 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-4a2e1267-c7aa-4d5f-a7f2-da445211ec3c tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] [instance: d5c8ab80-5993-4193-8c83-73345637d5eb] Going to try to terminate instance {{(pid=128758) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:01:15.897288 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-2c528059-c834-42d8-97be-bcf6a7da2bb1 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:15.898396 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-2c528059-c834-42d8-97be-bcf6a7da2bb1 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] [instance: 59f196e8-c202-4073-8663-2ae19358a044] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:15.908069 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2c528059-c834-42d8-97be-bcf6a7da2bb1 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:15.908934 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2c528059-c834-42d8-97be-bcf6a7da2bb1 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:15.909818 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2c528059-c834-42d8-97be-bcf6a7da2bb1 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:15.910686 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2c528059-c834-42d8-97be-bcf6a7da2bb1 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:15.911389 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2c528059-c834-42d8-97be-bcf6a7da2bb1 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:15.912030 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2c528059-c834-42d8-97be-bcf6a7da2bb1 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:15.955655 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-4a2e1267-c7aa-4d5f-a7f2-da445211ec3c tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] 10.222.0.60 "DELETE /compute/v2.1/servers/d5c8ab80-5993-4193-8c83-73345637d5eb" status: 204 len: 0 microversion: 2.1 time: 0.142347 Sep 14 09:01:15.959913 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1514/2965] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:01:15 2022] DELETE /compute/v2.1/servers/d5c8ab80-5993-4193-8c83-73345637d5eb => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 14 09:01:15.967646 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d2079815-e5fc-4df3-86ee-1ad3bce4047e tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:15.969316 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-d2079815-e5fc-4df3-86ee-1ad3bce4047e tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] [instance: d5c8ab80-5993-4193-8c83-73345637d5eb] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:15.977497 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d2079815-e5fc-4df3-86ee-1ad3bce4047e tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:15.978021 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d2079815-e5fc-4df3-86ee-1ad3bce4047e tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:15.978578 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d2079815-e5fc-4df3-86ee-1ad3bce4047e tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:15.979329 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d2079815-e5fc-4df3-86ee-1ad3bce4047e tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:15.979901 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d2079815-e5fc-4df3-86ee-1ad3bce4047e tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:15.980319 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d2079815-e5fc-4df3-86ee-1ad3bce4047e tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:16.331743 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-2c528059-c834-42d8-97be-bcf6a7da2bb1 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:16.338889 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-d2079815-e5fc-4df3-86ee-1ad3bce4047e tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ab7166e40e4a908eefbfb03b3b8804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de82b83dadd541dbb4a939f2fc04a163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:16.341747 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-2c528059-c834-42d8-97be-bcf6a7da2bb1 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:16.343292 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-2c528059-c834-42d8-97be-bcf6a7da2bb1 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:16.344536 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-2c528059-c834-42d8-97be-bcf6a7da2bb1 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] 10.222.0.60 "GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044" status: 200 len: 2940 microversion: 2.42 time: 0.453885 Sep 14 09:01:16.345112 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1452/2966] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:01:15 2022] GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044 => generated 2940 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:01:16.347113 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-d2079815-e5fc-4df3-86ee-1ad3bce4047e tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] 10.222.0.60 "GET /compute/v2.1/servers/d5c8ab80-5993-4193-8c83-73345637d5eb" status: 200 len: 1515 microversion: 2.1 time: 0.385528 Sep 14 09:01:16.347685 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1515/2967] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:01:15 2022] GET /compute/v2.1/servers/d5c8ab80-5993-4193-8c83-73345637d5eb => generated 1515 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:01:16.433924 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-4f92dd8e-95e4-4832-b93c-a970170236de tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:16.434598 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-4f92dd8e-95e4-4832-b93c-a970170236de tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: 680c3968-8912-45c4-b1c3-634c06ec30c3] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:16.441173 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4f92dd8e-95e4-4832-b93c-a970170236de tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:16.441682 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4f92dd8e-95e4-4832-b93c-a970170236de tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:16.442122 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4f92dd8e-95e4-4832-b93c-a970170236de tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:16.442835 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4f92dd8e-95e4-4832-b93c-a970170236de tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:16.443327 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4f92dd8e-95e4-4832-b93c-a970170236de tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:16.443760 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4f92dd8e-95e4-4832-b93c-a970170236de tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:16.565202 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-6d104727-1500-45d7-b91e-d68fffe77aea tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:16.565828 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-6d104727-1500-45d7-b91e-d68fffe77aea tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] [instance: 0eb40c80-c056-4096-a586-7e957a63f7cf] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:16.578586 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6d104727-1500-45d7-b91e-d68fffe77aea tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:16.579057 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6d104727-1500-45d7-b91e-d68fffe77aea tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:16.579498 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6d104727-1500-45d7-b91e-d68fffe77aea tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:16.580214 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6d104727-1500-45d7-b91e-d68fffe77aea tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:16.583066 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6d104727-1500-45d7-b91e-d68fffe77aea tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:16.583679 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6d104727-1500-45d7-b91e-d68fffe77aea tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:16.666286 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-4f92dd8e-95e4-4832-b93c-a970170236de tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:16.675383 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-4f92dd8e-95e4-4832-b93c-a970170236de tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/680c3968-8912-45c4-b1c3-634c06ec30c3" status: 200 len: 1508 microversion: 2.1 time: 0.245214 Sep 14 09:01:16.676282 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1453/2968] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:01:16 2022] GET /compute/v2.1/servers/680c3968-8912-45c4-b1c3-634c06ec30c3 => generated 1508 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:01:16.680981 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-437a7a17-2e4e-4188-9cb4-75a0779ccf64 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:16.681608 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-437a7a17-2e4e-4188-9cb4-75a0779ccf64 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: 3b592d04-368e-4b8f-bae2-c77aebec4105] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:16.688033 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-437a7a17-2e4e-4188-9cb4-75a0779ccf64 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:16.688530 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-437a7a17-2e4e-4188-9cb4-75a0779ccf64 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:16.689220 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-437a7a17-2e4e-4188-9cb4-75a0779ccf64 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:16.689978 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-437a7a17-2e4e-4188-9cb4-75a0779ccf64 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:16.690436 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-437a7a17-2e4e-4188-9cb4-75a0779ccf64 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:16.690873 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-437a7a17-2e4e-4188-9cb4-75a0779ccf64 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:16.692514 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-6d104727-1500-45d7-b91e-d68fffe77aea tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:16.703099 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-6d104727-1500-45d7-b91e-d68fffe77aea tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:16.704939 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-6d104727-1500-45d7-b91e-d68fffe77aea tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:16.711430 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-6d104727-1500-45d7-b91e-d68fffe77aea tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] 10.222.0.60 "GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf" status: 200 len: 1537 microversion: 2.91 time: 0.150999 Sep 14 09:01:16.712710 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1516/2969] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:01:16 2022] GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf => generated 1537 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 09:01:16.760917 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-111d05ab-d32b-4bd0-8a73-df04ad92f230 req-2607facb-8c97-453a-a12e-66a9c40118e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebf9bfa9-e941-4d23-8f6c-9867102feff2", "name": "network-vif-unplugged", "status": "completed", "tag": "a16e0c89-9089-483d-ae3b-f83433826e96"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:01:16.773204 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-111d05ab-d32b-4bd0-8a73-df04ad92f230 req-2607facb-8c97-453a-a12e-66a9c40118e0 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:16.774114 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-111d05ab-d32b-4bd0-8a73-df04ad92f230 req-2607facb-8c97-453a-a12e-66a9c40118e0 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:16.774554 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-111d05ab-d32b-4bd0-8a73-df04ad92f230 req-2607facb-8c97-453a-a12e-66a9c40118e0 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:16.787551 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-111d05ab-d32b-4bd0-8a73-df04ad92f230 req-2607facb-8c97-453a-a12e-66a9c40118e0 service nova] Creating event network-vif-unplugged:a16e0c89-9089-483d-ae3b-f83433826e96 for instance ebf9bfa9-e941-4d23-8f6c-9867102feff2 on n-h1-836830-18 Sep 14 09:01:16.793139 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-111d05ab-d32b-4bd0-8a73-df04ad92f230 req-2607facb-8c97-453a-a12e-66a9c40118e0 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036501 Sep 14 09:01:16.794299 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1517/2970] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:01:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:01:16.832413 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ead07b10-b41a-473d-b347-1aba143cb6a0 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Calling method '.version_select at 0x7f7d44096670>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:16.877628 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-ead07b10-b41a-473d-b347-1aba143cb6a0 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] 10.222.0.60 "GET /compute/v2.1/images/be62d386-20a6-4610-9cf3-1a1a7817aac8" status: 200 len: 1453 microversion: 2.1 time: 0.049800 Sep 14 09:01:16.878221 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1518/2971] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:01:16 2022] GET /compute/v2.1/images/be62d386-20a6-4610-9cf3-1a1a7817aac8 => generated 1453 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:01:16.889069 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-437a7a17-2e4e-4188-9cb4-75a0779ccf64 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9d40e54481461cba53fedb9a6abdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed2295a58f8451993a57ce0a6f9ba29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:16.897640 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-437a7a17-2e4e-4188-9cb4-75a0779ccf64 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] 10.222.0.60 "GET /compute/v2.1/servers/3b592d04-368e-4b8f-bae2-c77aebec4105" status: 200 len: 1317 microversion: 2.1 time: 0.220567 Sep 14 09:01:16.898304 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1454/2972] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:01:16 2022] GET /compute/v2.1/servers/3b592d04-368e-4b8f-bae2-c77aebec4105 => generated 1317 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:01:17.374027 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-34e01afb-16a6-49fc-a76d-541aca64da24 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:17.374326 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-50f33919-4f2c-489e-8f20-7eb3adf18f42 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:17.375545 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-34e01afb-16a6-49fc-a76d-541aca64da24 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] [instance: d5c8ab80-5993-4193-8c83-73345637d5eb] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:17.375664 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-50f33919-4f2c-489e-8f20-7eb3adf18f42 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] [instance: 59f196e8-c202-4073-8663-2ae19358a044] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:17.382887 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-34e01afb-16a6-49fc-a76d-541aca64da24 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:17.383877 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-34e01afb-16a6-49fc-a76d-541aca64da24 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:17.385002 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-34e01afb-16a6-49fc-a76d-541aca64da24 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:17.386128 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-34e01afb-16a6-49fc-a76d-541aca64da24 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:17.386898 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-34e01afb-16a6-49fc-a76d-541aca64da24 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:17.388290 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-34e01afb-16a6-49fc-a76d-541aca64da24 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:17.391640 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-50f33919-4f2c-489e-8f20-7eb3adf18f42 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:17.392422 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-50f33919-4f2c-489e-8f20-7eb3adf18f42 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:17.393059 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-50f33919-4f2c-489e-8f20-7eb3adf18f42 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:17.396106 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-50f33919-4f2c-489e-8f20-7eb3adf18f42 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:17.396679 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-50f33919-4f2c-489e-8f20-7eb3adf18f42 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:17.397371 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-50f33919-4f2c-489e-8f20-7eb3adf18f42 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:17.794848 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-50f33919-4f2c-489e-8f20-7eb3adf18f42 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:17.798841 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:01:17.806254 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-50f33919-4f2c-489e-8f20-7eb3adf18f42 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:17.806554 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-34e01afb-16a6-49fc-a76d-541aca64da24 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ab7166e40e4a908eefbfb03b3b8804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de82b83dadd541dbb4a939f2fc04a163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:17.808217 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-50f33919-4f2c-489e-8f20-7eb3adf18f42 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:17.810560 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-50f33919-4f2c-489e-8f20-7eb3adf18f42 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] 10.222.0.60 "GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044" status: 200 len: 2919 microversion: 2.42 time: 0.440875 Sep 14 09:01:17.820419 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1519/2973] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:01:17 2022] GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044 => generated 2919 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:01:17.831943 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ececc33d-f8a4-4dd5-836d-7a30ef03e788 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:17.832141 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-34e01afb-16a6-49fc-a76d-541aca64da24 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] 10.222.0.60 "GET /compute/v2.1/servers/d5c8ab80-5993-4193-8c83-73345637d5eb" status: 200 len: 1515 microversion: 2.1 time: 0.462753 Sep 14 09:01:17.832578 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-ececc33d-f8a4-4dd5-836d-7a30ef03e788 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: 680c3968-8912-45c4-b1c3-634c06ec30c3] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:17.832897 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1455/2974] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:01:17 2022] GET /compute/v2.1/servers/d5c8ab80-5993-4193-8c83-73345637d5eb => generated 1515 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:01:17.837942 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c8fab2db-0a18-4609-ae47-7c9082095ff3 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:17.838782 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-c8fab2db-0a18-4609-ae47-7c9082095ff3 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] [instance: 0eb40c80-c056-4096-a586-7e957a63f7cf] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:17.839255 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ececc33d-f8a4-4dd5-836d-7a30ef03e788 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:17.839813 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ececc33d-f8a4-4dd5-836d-7a30ef03e788 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:17.840260 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ececc33d-f8a4-4dd5-836d-7a30ef03e788 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:17.840999 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ececc33d-f8a4-4dd5-836d-7a30ef03e788 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:17.841572 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ececc33d-f8a4-4dd5-836d-7a30ef03e788 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:17.841882 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ececc33d-f8a4-4dd5-836d-7a30ef03e788 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:17.848331 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c8fab2db-0a18-4609-ae47-7c9082095ff3 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:17.849183 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c8fab2db-0a18-4609-ae47-7c9082095ff3 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:17.849933 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c8fab2db-0a18-4609-ae47-7c9082095ff3 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:17.851067 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c8fab2db-0a18-4609-ae47-7c9082095ff3 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:17.851783 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c8fab2db-0a18-4609-ae47-7c9082095ff3 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:17.852688 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c8fab2db-0a18-4609-ae47-7c9082095ff3 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:18.131792 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-ececc33d-f8a4-4dd5-836d-7a30ef03e788 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:18.141608 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-ececc33d-f8a4-4dd5-836d-7a30ef03e788 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/680c3968-8912-45c4-b1c3-634c06ec30c3" status: 200 len: 1508 microversion: 2.1 time: 0.319797 Sep 14 09:01:18.142563 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1520/2975] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:01:17 2022] GET /compute/v2.1/servers/680c3968-8912-45c4-b1c3-634c06ec30c3 => generated 1508 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:01:18.147154 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-fea0932e-2438-43b0-8ab5-d7411623b806 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Calling method '.version_select at 0x7f7d44bf85e0>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:18.202522 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-c8fab2db-0a18-4609-ae47-7c9082095ff3 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:18.215656 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-c8fab2db-0a18-4609-ae47-7c9082095ff3 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:18.217129 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-c8fab2db-0a18-4609-ae47-7c9082095ff3 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:18.217644 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-fea0932e-2438-43b0-8ab5-d7411623b806 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] 10.222.0.60 "GET /compute/v2.1/images/be62d386-20a6-4610-9cf3-1a1a7817aac8" status: 200 len: 1453 microversion: 2.1 time: 0.069026 Sep 14 09:01:18.228402 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1521/2976] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:01:18 2022] GET /compute/v2.1/images/be62d386-20a6-4610-9cf3-1a1a7817aac8 => generated 1453 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:01:18.234691 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a62158a0-495d-4de4-904c-b2f6c91ba0ac tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:18.238238 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-a62158a0-495d-4de4-904c-b2f6c91ba0ac tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: 3b592d04-368e-4b8f-bae2-c77aebec4105] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:18.241131 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-c8fab2db-0a18-4609-ae47-7c9082095ff3 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] 10.222.0.60 "GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf" status: 200 len: 1537 microversion: 2.91 time: 0.406996 Sep 14 09:01:18.242315 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1456/2977] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:01:17 2022] GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf => generated 1537 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:01:18.250608 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a62158a0-495d-4de4-904c-b2f6c91ba0ac tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:18.251154 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a62158a0-495d-4de4-904c-b2f6c91ba0ac tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:18.251757 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a62158a0-495d-4de4-904c-b2f6c91ba0ac tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:18.252645 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a62158a0-495d-4de4-904c-b2f6c91ba0ac tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:18.253274 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a62158a0-495d-4de4-904c-b2f6c91ba0ac tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:18.253869 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a62158a0-495d-4de4-904c-b2f6c91ba0ac tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:18.332497 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-07e00e36-ab20-4a04-83ae-7dc5eaf3c407 req-913edb25-eb31-4aa4-ae44-f57b2c402ca5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5c8ab80-5993-4193-8c83-73345637d5eb", "name": "network-vif-deleted", "tag": "88822778-5011-41f7-8715-6e0999a5aaee"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:01:18.343748 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-07e00e36-ab20-4a04-83ae-7dc5eaf3c407 req-913edb25-eb31-4aa4-ae44-f57b2c402ca5 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:18.344239 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-07e00e36-ab20-4a04-83ae-7dc5eaf3c407 req-913edb25-eb31-4aa4-ae44-f57b2c402ca5 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:18.344885 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-07e00e36-ab20-4a04-83ae-7dc5eaf3c407 req-913edb25-eb31-4aa4-ae44-f57b2c402ca5 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:18.370623 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-07e00e36-ab20-4a04-83ae-7dc5eaf3c407 req-913edb25-eb31-4aa4-ae44-f57b2c402ca5 service nova] Creating event network-vif-deleted:88822778-5011-41f7-8715-6e0999a5aaee for instance d5c8ab80-5993-4193-8c83-73345637d5eb on n-h2-836830-18 Sep 14 09:01:18.377499 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-07e00e36-ab20-4a04-83ae-7dc5eaf3c407 req-913edb25-eb31-4aa4-ae44-f57b2c402ca5 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049004 Sep 14 09:01:18.378905 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1457/2978] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:01:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:01:18.572236 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-a62158a0-495d-4de4-904c-b2f6c91ba0ac tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9d40e54481461cba53fedb9a6abdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed2295a58f8451993a57ce0a6f9ba29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:18.581022 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-a62158a0-495d-4de4-904c-b2f6c91ba0ac tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] 10.222.0.60 "GET /compute/v2.1/servers/3b592d04-368e-4b8f-bae2-c77aebec4105" status: 200 len: 1507 microversion: 2.1 time: 0.350718 Sep 14 09:01:18.582047 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1522/2979] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:01:18 2022] GET /compute/v2.1/servers/3b592d04-368e-4b8f-bae2-c77aebec4105 => generated 1507 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:01:18.605268 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-55d6d90a-bc26-40b2-bb59-4604cd3a11f3 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:18.605518 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-55d6d90a-bc26-40b2-bb59-4604cd3a11f3 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: 3b592d04-368e-4b8f-bae2-c77aebec4105] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:18.608830 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=6 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:01:18.614174 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-55d6d90a-bc26-40b2-bb59-4604cd3a11f3 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:18.614877 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-55d6d90a-bc26-40b2-bb59-4604cd3a11f3 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:18.615598 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-55d6d90a-bc26-40b2-bb59-4604cd3a11f3 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:18.616471 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-55d6d90a-bc26-40b2-bb59-4604cd3a11f3 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:18.617096 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-55d6d90a-bc26-40b2-bb59-4604cd3a11f3 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:18.617861 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-55d6d90a-bc26-40b2-bb59-4604cd3a11f3 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:18.821803 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-15c58f08-c0a8-4bc3-b3d4-44c89ff7f099 req-2d8456a3-1873-47a4-ab98-87e678bcaf10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59f196e8-c202-4073-8663-2ae19358a044", "name": "network-vif-unplugged", "status": "completed", "tag": "6bc29bf6-117b-4334-9caf-61bc5a58835c"}, {"server_uuid": "59f196e8-c202-4073-8663-2ae19358a044", "name": "network-vif-unplugged", "status": "completed", "tag": "2facbe7c-1fe7-4366-91c7-d589e067102f"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:01:18.834881 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-15c58f08-c0a8-4bc3-b3d4-44c89ff7f099 req-2d8456a3-1873-47a4-ab98-87e678bcaf10 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:18.835627 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-15c58f08-c0a8-4bc3-b3d4-44c89ff7f099 req-2d8456a3-1873-47a4-ab98-87e678bcaf10 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:18.836791 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-15c58f08-c0a8-4bc3-b3d4-44c89ff7f099 req-2d8456a3-1873-47a4-ab98-87e678bcaf10 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:18.848268 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-55d6d90a-bc26-40b2-bb59-4604cd3a11f3 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9d40e54481461cba53fedb9a6abdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed2295a58f8451993a57ce0a6f9ba29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:18.858396 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-15c58f08-c0a8-4bc3-b3d4-44c89ff7f099 req-2d8456a3-1873-47a4-ab98-87e678bcaf10 service nova] Creating event network-vif-unplugged:6bc29bf6-117b-4334-9caf-61bc5a58835c for instance 59f196e8-c202-4073-8663-2ae19358a044 on n-h2-836830-18 Sep 14 09:01:18.858962 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-15c58f08-c0a8-4bc3-b3d4-44c89ff7f099 req-2d8456a3-1873-47a4-ab98-87e678bcaf10 service nova] Creating event network-vif-unplugged:2facbe7c-1fe7-4366-91c7-d589e067102f for instance 59f196e8-c202-4073-8663-2ae19358a044 on n-h2-836830-18 Sep 14 09:01:18.861060 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-55d6d90a-bc26-40b2-bb59-4604cd3a11f3 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] 10.222.0.60 "GET /compute/v2.1/servers/3b592d04-368e-4b8f-bae2-c77aebec4105" status: 200 len: 1507 microversion: 2.1 time: 0.260310 Sep 14 09:01:18.862187 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1458/2980] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:01:18 2022] GET /compute/v2.1/servers/3b592d04-368e-4b8f-bae2-c77aebec4105 => generated 1507 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:01:18.865230 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-15c58f08-c0a8-4bc3-b3d4-44c89ff7f099 req-2d8456a3-1873-47a4-ab98-87e678bcaf10 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.047920 Sep 14 09:01:18.866117 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1523/2981] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:01:18 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:01:18.871357 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c350cc7f-f2a4-4017-a9d4-5b166146ed3f tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:18.872665 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-c350cc7f-f2a4-4017-a9d4-5b166146ed3f tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] [instance: 59f196e8-c202-4073-8663-2ae19358a044] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:18.874192 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d11fb301-f004-4e26-9813-5c2337e4d707 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:18.875171 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-d11fb301-f004-4e26-9813-5c2337e4d707 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] [instance: d5c8ab80-5993-4193-8c83-73345637d5eb] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:18.881783 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c350cc7f-f2a4-4017-a9d4-5b166146ed3f tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:18.882625 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c350cc7f-f2a4-4017-a9d4-5b166146ed3f tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:18.885106 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c350cc7f-f2a4-4017-a9d4-5b166146ed3f tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:18.885542 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d11fb301-f004-4e26-9813-5c2337e4d707 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:18.886165 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d11fb301-f004-4e26-9813-5c2337e4d707 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:18.886638 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d11fb301-f004-4e26-9813-5c2337e4d707 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:18.888154 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d11fb301-f004-4e26-9813-5c2337e4d707 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:18.888690 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d11fb301-f004-4e26-9813-5c2337e4d707 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:18.889118 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d11fb301-f004-4e26-9813-5c2337e4d707 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:18.890115 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c350cc7f-f2a4-4017-a9d4-5b166146ed3f tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:18.899456 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c350cc7f-f2a4-4017-a9d4-5b166146ed3f tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:18.899969 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c350cc7f-f2a4-4017-a9d4-5b166146ed3f tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:18.953410 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d11fb301-f004-4e26-9813-5c2337e4d707 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:18.955731 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d11fb301-f004-4e26-9813-5c2337e4d707 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:18.958425 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d11fb301-f004-4e26-9813-5c2337e4d707 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:18.959239 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.objects.instance [None req-d11fb301-f004-4e26-9813-5c2337e4d707 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lazy-loading 'fault' on Instance uuid d5c8ab80-5993-4193-8c83-73345637d5eb {{(pid=128758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:01:19.115590 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-d11fb301-f004-4e26-9813-5c2337e4d707 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ab7166e40e4a908eefbfb03b3b8804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de82b83dadd541dbb4a939f2fc04a163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:19.131884 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-d11fb301-f004-4e26-9813-5c2337e4d707 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] 10.222.0.60 "GET /compute/v2.1/servers/d5c8ab80-5993-4193-8c83-73345637d5eb" status: 200 len: 1308 microversion: 2.1 time: 0.264375 Sep 14 09:01:19.146987 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1524/2982] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:01:18 2022] GET /compute/v2.1/servers/d5c8ab80-5993-4193-8c83-73345637d5eb => generated 1308 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:01:19.146987 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-058c7364-d64b-4cb4-b379-02dff3e8af43 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:01:19.146987 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-058c7364-d64b-4cb4-b379-02dff3e8af43 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: 3b592d04-368e-4b8f-bae2-c77aebec4105] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:19.162828 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-058c7364-d64b-4cb4-b379-02dff3e8af43 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:19.163412 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-058c7364-d64b-4cb4-b379-02dff3e8af43 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:19.163866 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-058c7364-d64b-4cb4-b379-02dff3e8af43 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:19.164666 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-058c7364-d64b-4cb4-b379-02dff3e8af43 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:19.165578 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-058c7364-d64b-4cb4-b379-02dff3e8af43 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:19.165972 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-058c7364-d64b-4cb4-b379-02dff3e8af43 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:19.243894 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-058c7364-d64b-4cb4-b379-02dff3e8af43 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] 10.222.0.60 "PUT /compute/v2.1/servers/3b592d04-368e-4b8f-bae2-c77aebec4105" status: 200 len: 1079 microversion: 2.1 time: 0.106635 Sep 14 09:01:19.244887 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1525/2983] 10.222.0.60 () {60 vars in 1256 bytes} [Wed Sep 14 09:01:19 2022] PUT /compute/v2.1/servers/3b592d04-368e-4b8f-bae2-c77aebec4105 => generated 1079 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:01:19.249783 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-e6c1de1c-25fd-4d37-80da-71740c7f1172 req-4ceac49d-f76b-4624-99e6-c01f710f24ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59f196e8-c202-4073-8663-2ae19358a044", "name": "network-vif-deleted", "tag": "d8a4da08-c0b3-4a64-8d73-ee5871258250"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:01:19.259574 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-e6c1de1c-25fd-4d37-80da-71740c7f1172 req-4ceac49d-f76b-4624-99e6-c01f710f24ee service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:19.260263 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-e6c1de1c-25fd-4d37-80da-71740c7f1172 req-4ceac49d-f76b-4624-99e6-c01f710f24ee service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:19.260895 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-e6c1de1c-25fd-4d37-80da-71740c7f1172 req-4ceac49d-f76b-4624-99e6-c01f710f24ee service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:19.273506 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-e6c1de1c-25fd-4d37-80da-71740c7f1172 req-4ceac49d-f76b-4624-99e6-c01f710f24ee service nova] Creating event network-vif-deleted:d8a4da08-c0b3-4a64-8d73-ee5871258250 for instance 59f196e8-c202-4073-8663-2ae19358a044 on n-h2-836830-18 Sep 14 09:01:19.278902 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-e6c1de1c-25fd-4d37-80da-71740c7f1172 req-4ceac49d-f76b-4624-99e6-c01f710f24ee service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032549 Sep 14 09:01:19.280085 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1526/2984] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:01:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:01:19.281874 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-c350cc7f-f2a4-4017-a9d4-5b166146ed3f tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:19.285102 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-558f64e9-4258-4f2a-a847-d09e77b65d5a tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:19.285987 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-558f64e9-4258-4f2a-a847-d09e77b65d5a tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: 680c3968-8912-45c4-b1c3-634c06ec30c3] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:19.291527 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-c350cc7f-f2a4-4017-a9d4-5b166146ed3f tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:19.292447 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-558f64e9-4258-4f2a-a847-d09e77b65d5a tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:19.292939 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-558f64e9-4258-4f2a-a847-d09e77b65d5a tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:19.293383 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-558f64e9-4258-4f2a-a847-d09e77b65d5a tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:19.294567 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-c350cc7f-f2a4-4017-a9d4-5b166146ed3f tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:19.294694 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-558f64e9-4258-4f2a-a847-d09e77b65d5a tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:19.295098 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-558f64e9-4258-4f2a-a847-d09e77b65d5a tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:19.295522 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-558f64e9-4258-4f2a-a847-d09e77b65d5a tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:19.296672 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-c350cc7f-f2a4-4017-a9d4-5b166146ed3f tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] 10.222.0.60 "GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044" status: 200 len: 2872 microversion: 2.42 time: 0.431448 Sep 14 09:01:19.297443 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1459/2985] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:01:18 2022] GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044 => generated 2872 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:01:19.325264 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-11b8a8ee-7c8e-4c7a-abbb-e4467ef26ec3 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Calling method '.version_select at 0x7f7d3f601ee0>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:19.379305 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-11b8a8ee-7c8e-4c7a-abbb-e4467ef26ec3 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] 10.222.0.60 "GET /compute/v2.1/images/be62d386-20a6-4610-9cf3-1a1a7817aac8" status: 200 len: 1453 microversion: 2.1 time: 0.066111 Sep 14 09:01:19.379892 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1460/2986] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:01:19 2022] GET /compute/v2.1/images/be62d386-20a6-4610-9cf3-1a1a7817aac8 => generated 1453 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:01:19.384658 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-0b84f604-a7ba-4e74-b7cf-d4b8c7844956 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:19.385287 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-0b84f604-a7ba-4e74-b7cf-d4b8c7844956 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: 3b592d04-368e-4b8f-bae2-c77aebec4105] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:19.392622 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0b84f604-a7ba-4e74-b7cf-d4b8c7844956 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:19.392622 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0b84f604-a7ba-4e74-b7cf-d4b8c7844956 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:19.392622 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0b84f604-a7ba-4e74-b7cf-d4b8c7844956 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:19.393254 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0b84f604-a7ba-4e74-b7cf-d4b8c7844956 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:19.393721 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0b84f604-a7ba-4e74-b7cf-d4b8c7844956 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:19.394153 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0b84f604-a7ba-4e74-b7cf-d4b8c7844956 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:19.598830 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-558f64e9-4258-4f2a-a847-d09e77b65d5a tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:19.610060 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-558f64e9-4258-4f2a-a847-d09e77b65d5a tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/680c3968-8912-45c4-b1c3-634c06ec30c3" status: 200 len: 1508 microversion: 2.1 time: 0.328683 Sep 14 09:01:19.610597 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1527/2987] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:01:19 2022] GET /compute/v2.1/servers/680c3968-8912-45c4-b1c3-634c06ec30c3 => generated 1508 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:01:19.617313 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-6c677476-dd80-47a7-9fb4-0e6ae1218a4a tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:19.617931 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-6c677476-dd80-47a7-9fb4-0e6ae1218a4a tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] [instance: 0eb40c80-c056-4096-a586-7e957a63f7cf] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:19.630998 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6c677476-dd80-47a7-9fb4-0e6ae1218a4a tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:19.631515 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6c677476-dd80-47a7-9fb4-0e6ae1218a4a tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:19.631956 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6c677476-dd80-47a7-9fb4-0e6ae1218a4a tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:19.632683 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6c677476-dd80-47a7-9fb4-0e6ae1218a4a tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:19.633137 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6c677476-dd80-47a7-9fb4-0e6ae1218a4a tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:19.633559 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6c677476-dd80-47a7-9fb4-0e6ae1218a4a tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:19.750322 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-0b84f604-a7ba-4e74-b7cf-d4b8c7844956 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9d40e54481461cba53fedb9a6abdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed2295a58f8451993a57ce0a6f9ba29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:19.753640 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-6c677476-dd80-47a7-9fb4-0e6ae1218a4a tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:19.763143 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-0b84f604-a7ba-4e74-b7cf-d4b8c7844956 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] 10.222.0.60 "GET /compute/v2.1/servers/3b592d04-368e-4b8f-bae2-c77aebec4105" status: 200 len: 1505 microversion: 2.1 time: 0.382116 Sep 14 09:01:19.764453 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1461/2988] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:01:19 2022] GET /compute/v2.1/servers/3b592d04-368e-4b8f-bae2-c77aebec4105 => generated 1505 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:01:19.764691 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-6c677476-dd80-47a7-9fb4-0e6ae1218a4a tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:19.768531 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-6c677476-dd80-47a7-9fb4-0e6ae1218a4a tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:19.785510 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-6c677476-dd80-47a7-9fb4-0e6ae1218a4a tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] 10.222.0.60 "GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf" status: 200 len: 1537 microversion: 2.91 time: 0.173516 Sep 14 09:01:19.785948 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1528/2989] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:01:19 2022] GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf => generated 1537 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:01:19.797084 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-5538acc8-2a0a-4670-9202-f37c6a75f919 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:19.799211 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-5538acc8-2a0a-4670-9202-f37c6a75f919 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: 3b592d04-368e-4b8f-bae2-c77aebec4105] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:19.813184 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5538acc8-2a0a-4670-9202-f37c6a75f919 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:19.813971 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5538acc8-2a0a-4670-9202-f37c6a75f919 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:19.814520 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5538acc8-2a0a-4670-9202-f37c6a75f919 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:19.815396 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5538acc8-2a0a-4670-9202-f37c6a75f919 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:19.815867 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5538acc8-2a0a-4670-9202-f37c6a75f919 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:19.816357 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5538acc8-2a0a-4670-9202-f37c6a75f919 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:20.139569 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-5538acc8-2a0a-4670-9202-f37c6a75f919 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9d40e54481461cba53fedb9a6abdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed2295a58f8451993a57ce0a6f9ba29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:20.150018 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-5538acc8-2a0a-4670-9202-f37c6a75f919 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] 10.222.0.60 "GET /compute/v2.1/servers/3b592d04-368e-4b8f-bae2-c77aebec4105" status: 200 len: 1505 microversion: 2.1 time: 0.361870 Sep 14 09:01:20.150594 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1462/2990] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:01:19 2022] GET /compute/v2.1/servers/3b592d04-368e-4b8f-bae2-c77aebec4105 => generated 1505 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:01:20.167531 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-692e3d7f-332e-498d-9e09-99a45a95929e tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:20.167531 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-692e3d7f-332e-498d-9e09-99a45a95929e tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] [instance: d5c8ab80-5993-4193-8c83-73345637d5eb] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:20.170439 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:01:20.175273 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a56ed6b6-d022-4a82-a371-8a481a1607ab tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:01:20.178297 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-a56ed6b6-d022-4a82-a371-8a481a1607ab tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: 3b592d04-368e-4b8f-bae2-c77aebec4105] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:20.179648 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-692e3d7f-332e-498d-9e09-99a45a95929e tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:20.180510 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-692e3d7f-332e-498d-9e09-99a45a95929e tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:20.180869 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-692e3d7f-332e-498d-9e09-99a45a95929e tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:20.181590 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-692e3d7f-332e-498d-9e09-99a45a95929e tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:20.186836 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a56ed6b6-d022-4a82-a371-8a481a1607ab tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:20.187606 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a56ed6b6-d022-4a82-a371-8a481a1607ab tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:20.188442 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a56ed6b6-d022-4a82-a371-8a481a1607ab tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:20.189042 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-692e3d7f-332e-498d-9e09-99a45a95929e tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:20.189592 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-692e3d7f-332e-498d-9e09-99a45a95929e tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:20.189798 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a56ed6b6-d022-4a82-a371-8a481a1607ab tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:20.190505 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a56ed6b6-d022-4a82-a371-8a481a1607ab tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:20.191153 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a56ed6b6-d022-4a82-a371-8a481a1607ab tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:20.206969 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-692e3d7f-332e-498d-9e09-99a45a95929e tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] HTTP exception thrown: Instance d5c8ab80-5993-4193-8c83-73345637d5eb could not be found. Sep 14 09:01:20.221144 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-692e3d7f-332e-498d-9e09-99a45a95929e tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Request method failure captured: Sep 14 09:01:20.221144 n-d-836830-18 devstack@n-api.service[128758]: request: GET /compute/v2.1/servers/d5c8ab80-5993-4193-8c83-73345637d5eb HTTP/1.1 Sep 14 09:01:20.221144 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 09:01:20.221144 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 09:01:20.221144 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 09:01:20.221144 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 09:01:20.221144 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 09:01:20.221144 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 09:01:20.221144 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 09:01:20.221144 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 09:01:20.221144 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZekVbrtTCxL8KnTZmK9ZKFf6nUDFZO1zszEyl6k0IKZmICsv51WS6EiH7r4ARtcipTF7VD1WyEbUm0J1Prk5N83y_ZIrsxG_Z7HuBRIpZlzFOomZKRVbY8MALc9EunD-F2FdXNCLv5rlqjmwYcCHaEIh54nCJT_zAvCnYZkJmnrwW0 Sep 14 09:01:20.221144 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 09:01:20.221144 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 09:01:20.221144 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 09:01:20.221144 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 09:01:20.221144 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 09:01:20.221144 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 09:01:20.221144 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: de82b83dadd541dbb4a939f2fc04a163 Sep 14 09:01:20.221144 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-VolumesAdminNegativeTest-1796847268 Sep 14 09:01:20.221144 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 09:01:20.221144 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 09:01:20.221144 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/de82b83dadd541dbb4a939f2fc04a163"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_de82b83dadd541dbb4a939f2fc04a163"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/de82b83dadd541dbb4a939f2fc04a163"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/de82b83dadd541dbb4a939f2fc04a163"}]}] Sep 14 09:01:20.221144 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-VolumesAdminNegativeTest-1796847268 Sep 14 09:01:20.221144 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: de82b83dadd541dbb4a939f2fc04a163 Sep 14 09:01:20.221144 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1796847268 Sep 14 09:01:20.221144 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-VolumesAdminNegativeTest-1796847268-project Sep 14 09:01:20.221144 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 09:01:20.221144 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 09:01:20.221144 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 93ab7166e40e4a908eefbfb03b3b8804 Sep 14 09:01:20.221144 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-VolumesAdminNegativeTest-1796847268-project Sep 14 09:01:20.221144 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 09:01:20.221144 n-d-836830-18 devstack@n-api.service[128758]: exception: Instance d5c8ab80-5993-4193-8c83-73345637d5eb could not be found. Sep 14 09:01:20.221144 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': 'd5c8ab80-5993-4193-8c83-73345637d5eb'} Sep 14 09:01:20.221144 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:01:20.221144 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:01:20.221144 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:01:20.221144 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:01:20.221144 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:01:20.221144 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:01:20.221144 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:01:20.221144 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:01:20.221144 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:01:20.221144 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:01:20.221144 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5c8ab80-5993-4193-8c83-73345637d5eb could not be found. Sep 14 09:01:20.221144 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:01:20.221144 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:01:20.221144 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:01:20.221144 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:01:20.221144 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:01:20.221144 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:01:20.221144 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:01:20.221144 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:01:20.221144 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:01:20.221144 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:01:20.221144 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:01:20.221144 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:01:20.221144 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:01:20.221144 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:01:20.221144 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:01:20.221144 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:01:20.221144 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5c8ab80-5993-4193-8c83-73345637d5eb could not be found. Sep 14 09:01:20.221144 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:01:20.221144 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:01:20.221144 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:01:20.226757 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:01:20.226757 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:01:20.226757 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:01:20.226757 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:01:20.226757 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:01:20.226757 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5c8ab80-5993-4193-8c83-73345637d5eb could not be found. Sep 14 09:01:20.226757 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:01:20.226757 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-692e3d7f-332e-498d-9e09-99a45a95929e tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Returning 404 to user: Instance d5c8ab80-5993-4193-8c83-73345637d5eb could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:01:20.226757 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-692e3d7f-332e-498d-9e09-99a45a95929e tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] 10.222.0.60 "GET /compute/v2.1/servers/d5c8ab80-5993-4193-8c83-73345637d5eb" status: 404 len: 111 microversion: 2.1 time: 0.064844 Sep 14 09:01:20.226757 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1529/2991] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:01:20 2022] GET /compute/v2.1/servers/d5c8ab80-5993-4193-8c83-73345637d5eb => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 14 09:01:20.284262 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a56ed6b6-d022-4a82-a371-8a481a1607ab tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] 10.222.0.60 "PUT /compute/v2.1/servers/3b592d04-368e-4b8f-bae2-c77aebec4105" status: 200 len: 1081 microversion: 2.1 time: 0.112814 Sep 14 09:01:20.295016 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1463/2992] 10.222.0.60 () {60 vars in 1256 bytes} [Wed Sep 14 09:01:20 2022] PUT /compute/v2.1/servers/3b592d04-368e-4b8f-bae2-c77aebec4105 => generated 1081 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:01:20.306067 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-5c5925d9-6eb7-4693-996b-ca040beba3f3 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:20.306992 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-5c5925d9-6eb7-4693-996b-ca040beba3f3 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: 3b592d04-368e-4b8f-bae2-c77aebec4105] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:20.317843 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5c5925d9-6eb7-4693-996b-ca040beba3f3 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:20.321468 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5c5925d9-6eb7-4693-996b-ca040beba3f3 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:20.333888 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f788fa2a-5d99-4ac0-8f2f-45046fa2d00a tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:20.334920 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5c5925d9-6eb7-4693-996b-ca040beba3f3 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:20.335951 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5c5925d9-6eb7-4693-996b-ca040beba3f3 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:20.336448 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5c5925d9-6eb7-4693-996b-ca040beba3f3 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:20.336899 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5c5925d9-6eb7-4693-996b-ca040beba3f3 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:20.343068 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f788fa2a-5d99-4ac0-8f2f-45046fa2d00a tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] [instance: 59f196e8-c202-4073-8663-2ae19358a044] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:20.400690 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f788fa2a-5d99-4ac0-8f2f-45046fa2d00a tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:20.401206 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f788fa2a-5d99-4ac0-8f2f-45046fa2d00a tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:20.401655 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f788fa2a-5d99-4ac0-8f2f-45046fa2d00a tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:20.408359 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f788fa2a-5d99-4ac0-8f2f-45046fa2d00a tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:20.408852 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f788fa2a-5d99-4ac0-8f2f-45046fa2d00a tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:20.409301 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f788fa2a-5d99-4ac0-8f2f-45046fa2d00a tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:20.898265 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f788fa2a-5d99-4ac0-8f2f-45046fa2d00a tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:20.908692 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f788fa2a-5d99-4ac0-8f2f-45046fa2d00a tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:20.910650 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f788fa2a-5d99-4ac0-8f2f-45046fa2d00a tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:20.912263 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f788fa2a-5d99-4ac0-8f2f-45046fa2d00a tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] 10.222.0.60 "GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044" status: 200 len: 2532 microversion: 2.42 time: 0.585853 Sep 14 09:01:20.913094 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1464/2993] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:01:20 2022] GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044 => generated 2532 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:01:20.916828 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-5c5925d9-6eb7-4693-996b-ca040beba3f3 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9d40e54481461cba53fedb9a6abdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed2295a58f8451993a57ce0a6f9ba29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:20.919843 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-cb2d7a55-1550-4725-b497-b1e47317ed1f tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Calling method '.version_select at 0x7f7d48692550>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:20.925098 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-5c5925d9-6eb7-4693-996b-ca040beba3f3 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] 10.222.0.60 "GET /compute/v2.1/servers/3b592d04-368e-4b8f-bae2-c77aebec4105" status: 200 len: 1507 microversion: 2.1 time: 0.623126 Sep 14 09:01:20.942467 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1530/2994] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:01:20 2022] GET /compute/v2.1/servers/3b592d04-368e-4b8f-bae2-c77aebec4105 => generated 1507 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:01:20.956057 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-df0fc339-1e63-4e13-a135-38d69af3dfc1 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:20.956881 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-df0fc339-1e63-4e13-a135-38d69af3dfc1 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: 680c3968-8912-45c4-b1c3-634c06ec30c3] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:20.963351 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-df0fc339-1e63-4e13-a135-38d69af3dfc1 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:20.964072 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-df0fc339-1e63-4e13-a135-38d69af3dfc1 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:20.964689 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-df0fc339-1e63-4e13-a135-38d69af3dfc1 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:20.965672 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-df0fc339-1e63-4e13-a135-38d69af3dfc1 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:20.966295 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-df0fc339-1e63-4e13-a135-38d69af3dfc1 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:20.966889 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-df0fc339-1e63-4e13-a135-38d69af3dfc1 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:21.007725 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-cb2d7a55-1550-4725-b497-b1e47317ed1f tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] 10.222.0.60 "GET /compute/v2.1/images/be62d386-20a6-4610-9cf3-1a1a7817aac8" status: 200 len: 1453 microversion: 2.1 time: 0.093362 Sep 14 09:01:21.009580 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1465/2995] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:01:20 2022] GET /compute/v2.1/images/be62d386-20a6-4610-9cf3-1a1a7817aac8 => generated 1453 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:01:21.024131 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8cc08a58-c663-433f-a4ad-f05027bb42cb tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:21.024771 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-8cc08a58-c663-433f-a4ad-f05027bb42cb tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] [instance: 0eb40c80-c056-4096-a586-7e957a63f7cf] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:21.036244 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8cc08a58-c663-433f-a4ad-f05027bb42cb tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:21.036756 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8cc08a58-c663-433f-a4ad-f05027bb42cb tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:21.037203 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8cc08a58-c663-433f-a4ad-f05027bb42cb tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:21.038113 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8cc08a58-c663-433f-a4ad-f05027bb42cb tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:21.038760 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8cc08a58-c663-433f-a4ad-f05027bb42cb tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:21.039384 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8cc08a58-c663-433f-a4ad-f05027bb42cb tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:21.207998 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-8cc08a58-c663-433f-a4ad-f05027bb42cb tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:21.226350 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-8cc08a58-c663-433f-a4ad-f05027bb42cb tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:21.229044 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-8cc08a58-c663-433f-a4ad-f05027bb42cb tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:21.250098 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-8cc08a58-c663-433f-a4ad-f05027bb42cb tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] 10.222.0.60 "GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf" status: 200 len: 1537 microversion: 2.91 time: 0.239008 Sep 14 09:01:21.262972 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1466/2996] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:01:21 2022] GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf => generated 1537 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:01:21.262972 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a754532b-bd0e-4769-82a7-f623f2775bcd tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:21.262972 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-a754532b-bd0e-4769-82a7-f623f2775bcd tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: 3b592d04-368e-4b8f-bae2-c77aebec4105] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:21.264226 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a754532b-bd0e-4769-82a7-f623f2775bcd tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:21.264854 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a754532b-bd0e-4769-82a7-f623f2775bcd tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:21.273063 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a754532b-bd0e-4769-82a7-f623f2775bcd tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:21.273063 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a754532b-bd0e-4769-82a7-f623f2775bcd tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:21.273063 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a754532b-bd0e-4769-82a7-f623f2775bcd tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:21.273063 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a754532b-bd0e-4769-82a7-f623f2775bcd tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:21.411710 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-df0fc339-1e63-4e13-a135-38d69af3dfc1 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:21.432491 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-df0fc339-1e63-4e13-a135-38d69af3dfc1 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/680c3968-8912-45c4-b1c3-634c06ec30c3" status: 200 len: 1508 microversion: 2.1 time: 0.488781 Sep 14 09:01:21.433378 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1531/2997] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:01:20 2022] GET /compute/v2.1/servers/680c3968-8912-45c4-b1c3-634c06ec30c3 => generated 1508 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:01:21.443153 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-c1a77314-b3bf-4c8e-9096-fa5b01c61b70 req-882a8f2d-9696-4732-8ca1-23da3a3a500c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59f196e8-c202-4073-8663-2ae19358a044", "name": "network-vif-unplugged", "status": "completed", "tag": "b45cf031-1a7e-40d4-99f8-072f0326a8e0"}, {"server_uuid": "59f196e8-c202-4073-8663-2ae19358a044", "name": "network-vif-unplugged", "status": "completed", "tag": "55ecb12c-40d9-41ea-bb56-362fc9dba976"}, {"server_uuid": "a4852a58-51c4-4ca0-8c83-19fc8209fd21", "name": "network-vif-plugged", "status": "completed", "tag": "003dc8e7-2302-41ad-87e7-680ccac43c8f"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:01:21.467655 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-c1a77314-b3bf-4c8e-9096-fa5b01c61b70 req-882a8f2d-9696-4732-8ca1-23da3a3a500c service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:21.468142 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-c1a77314-b3bf-4c8e-9096-fa5b01c61b70 req-882a8f2d-9696-4732-8ca1-23da3a3a500c service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:21.468579 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-c1a77314-b3bf-4c8e-9096-fa5b01c61b70 req-882a8f2d-9696-4732-8ca1-23da3a3a500c service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:21.501717 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-c1a77314-b3bf-4c8e-9096-fa5b01c61b70 req-882a8f2d-9696-4732-8ca1-23da3a3a500c service nova] Creating event network-vif-unplugged:b45cf031-1a7e-40d4-99f8-072f0326a8e0 for instance 59f196e8-c202-4073-8663-2ae19358a044 on n-h2-836830-18 Sep 14 09:01:21.502826 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-c1a77314-b3bf-4c8e-9096-fa5b01c61b70 req-882a8f2d-9696-4732-8ca1-23da3a3a500c service nova] Creating event network-vif-unplugged:55ecb12c-40d9-41ea-bb56-362fc9dba976 for instance 59f196e8-c202-4073-8663-2ae19358a044 on n-h2-836830-18 Sep 14 09:01:21.503533 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-c1a77314-b3bf-4c8e-9096-fa5b01c61b70 req-882a8f2d-9696-4732-8ca1-23da3a3a500c service nova] Creating event network-vif-plugged:003dc8e7-2302-41ad-87e7-680ccac43c8f for instance a4852a58-51c4-4ca0-8c83-19fc8209fd21 on n-h2-836830-18 Sep 14 09:01:21.519470 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-c1a77314-b3bf-4c8e-9096-fa5b01c61b70 req-882a8f2d-9696-4732-8ca1-23da3a3a500c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 529 microversion: 2.1 time: 0.081675 Sep 14 09:01:21.527208 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1532/2998] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:01:21 2022] POST /compute/v2.1/os-server-external-events => generated 529 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:01:21.533685 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-2fad929f-53d5-4915-bee2-8061e2b0e4c6 req-3bcd8638-fa55-4dcb-b6ca-3a5fe2752a89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59f196e8-c202-4073-8663-2ae19358a044", "name": "network-vif-deleted", "tag": "b45cf031-1a7e-40d4-99f8-072f0326a8e0"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:01:21.549603 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-2fad929f-53d5-4915-bee2-8061e2b0e4c6 req-3bcd8638-fa55-4dcb-b6ca-3a5fe2752a89 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:21.550359 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-2fad929f-53d5-4915-bee2-8061e2b0e4c6 req-3bcd8638-fa55-4dcb-b6ca-3a5fe2752a89 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:21.551004 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-2fad929f-53d5-4915-bee2-8061e2b0e4c6 req-3bcd8638-fa55-4dcb-b6ca-3a5fe2752a89 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:21.553833 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-a754532b-bd0e-4769-82a7-f623f2775bcd tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9d40e54481461cba53fedb9a6abdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed2295a58f8451993a57ce0a6f9ba29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:21.562648 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a754532b-bd0e-4769-82a7-f623f2775bcd tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] 10.222.0.60 "GET /compute/v2.1/servers/3b592d04-368e-4b8f-bae2-c77aebec4105" status: 200 len: 1507 microversion: 2.1 time: 0.309865 Sep 14 09:01:21.566510 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-2fad929f-53d5-4915-bee2-8061e2b0e4c6 req-3bcd8638-fa55-4dcb-b6ca-3a5fe2752a89 service nova] Creating event network-vif-deleted:b45cf031-1a7e-40d4-99f8-072f0326a8e0 for instance 59f196e8-c202-4073-8663-2ae19358a044 on n-h2-836830-18 Sep 14 09:01:21.573095 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-2fad929f-53d5-4915-bee2-8061e2b0e4c6 req-3bcd8638-fa55-4dcb-b6ca-3a5fe2752a89 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043905 Sep 14 09:01:21.574958 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1533/2999] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:01:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:01:21.582337 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1467/3000] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:01:21 2022] GET /compute/v2.1/servers/3b592d04-368e-4b8f-bae2-c77aebec4105 => generated 1507 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:01:21.592357 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-6d3add2b-b06b-412f-a18a-82a8ceb7f80d tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:21.593084 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-6d3add2b-b06b-412f-a18a-82a8ceb7f80d tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: 3b592d04-368e-4b8f-bae2-c77aebec4105] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:21.599726 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6d3add2b-b06b-412f-a18a-82a8ceb7f80d tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:21.600574 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6d3add2b-b06b-412f-a18a-82a8ceb7f80d tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:21.601268 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6d3add2b-b06b-412f-a18a-82a8ceb7f80d tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:21.602250 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6d3add2b-b06b-412f-a18a-82a8ceb7f80d tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:21.602980 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6d3add2b-b06b-412f-a18a-82a8ceb7f80d tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:21.603636 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6d3add2b-b06b-412f-a18a-82a8ceb7f80d tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:21.636862 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-6d3add2b-b06b-412f-a18a-82a8ceb7f80d tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: 3b592d04-368e-4b8f-bae2-c77aebec4105] Going to try to terminate instance {{(pid=128758) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:01:21.778415 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-6d3add2b-b06b-412f-a18a-82a8ceb7f80d tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] 10.222.0.60 "DELETE /compute/v2.1/servers/3b592d04-368e-4b8f-bae2-c77aebec4105" status: 204 len: 0 microversion: 2.1 time: 0.189417 Sep 14 09:01:21.781991 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1534/3001] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:01:21 2022] DELETE /compute/v2.1/servers/3b592d04-368e-4b8f-bae2-c77aebec4105 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:01:21.793047 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-973e0bf5-c72c-40af-9326-09ed7eb4a243 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:21.794274 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-973e0bf5-c72c-40af-9326-09ed7eb4a243 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: 3b592d04-368e-4b8f-bae2-c77aebec4105] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:21.809944 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-973e0bf5-c72c-40af-9326-09ed7eb4a243 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:21.809944 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-973e0bf5-c72c-40af-9326-09ed7eb4a243 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:21.810304 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-973e0bf5-c72c-40af-9326-09ed7eb4a243 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:21.814100 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-973e0bf5-c72c-40af-9326-09ed7eb4a243 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:21.815570 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-973e0bf5-c72c-40af-9326-09ed7eb4a243 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:21.816799 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-973e0bf5-c72c-40af-9326-09ed7eb4a243 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:21.867736 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-973e0bf5-c72c-40af-9326-09ed7eb4a243 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: 3b592d04-368e-4b8f-bae2-c77aebec4105] Going to try to terminate instance {{(pid=128759) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:01:21.946915 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-fcb17e43-a034-4066-8e16-70874d3cf5a4 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:21.947656 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-fcb17e43-a034-4066-8e16-70874d3cf5a4 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] [instance: 59f196e8-c202-4073-8663-2ae19358a044] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:21.977083 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fcb17e43-a034-4066-8e16-70874d3cf5a4 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:21.979628 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.compute.api [None req-973e0bf5-c72c-40af-9326-09ed7eb4a243 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: 3b592d04-368e-4b8f-bae2-c77aebec4105] Instance is already in deleting state, ignoring this request Sep 14 09:01:21.980815 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-973e0bf5-c72c-40af-9326-09ed7eb4a243 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] 10.222.0.60 "DELETE /compute/v2.1/servers/3b592d04-368e-4b8f-bae2-c77aebec4105" status: 204 len: 0 microversion: 2.1 time: 0.193343 Sep 14 09:01:21.982266 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1468/3002] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:01:21 2022] DELETE /compute/v2.1/servers/3b592d04-368e-4b8f-bae2-c77aebec4105 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:01:21.984072 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fcb17e43-a034-4066-8e16-70874d3cf5a4 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:21.984609 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fcb17e43-a034-4066-8e16-70874d3cf5a4 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:21.985354 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fcb17e43-a034-4066-8e16-70874d3cf5a4 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:21.986874 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fcb17e43-a034-4066-8e16-70874d3cf5a4 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:21.989614 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fcb17e43-a034-4066-8e16-70874d3cf5a4 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:21.993531 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-36ec0c87-87fb-49b2-aa80-944071f1a1aa tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:21.994170 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-36ec0c87-87fb-49b2-aa80-944071f1a1aa tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: 3b592d04-368e-4b8f-bae2-c77aebec4105] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:22.019217 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-36ec0c87-87fb-49b2-aa80-944071f1a1aa tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:22.021110 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-36ec0c87-87fb-49b2-aa80-944071f1a1aa tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:22.021876 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-36ec0c87-87fb-49b2-aa80-944071f1a1aa tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:22.023000 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-36ec0c87-87fb-49b2-aa80-944071f1a1aa tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:22.024415 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-36ec0c87-87fb-49b2-aa80-944071f1a1aa tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:22.026233 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-36ec0c87-87fb-49b2-aa80-944071f1a1aa tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:22.033092 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:01:22.389460 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-fcb17e43-a034-4066-8e16-70874d3cf5a4 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:22.405815 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-fcb17e43-a034-4066-8e16-70874d3cf5a4 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:22.412564 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-fcb17e43-a034-4066-8e16-70874d3cf5a4 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:22.412758 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-36ec0c87-87fb-49b2-aa80-944071f1a1aa tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9d40e54481461cba53fedb9a6abdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed2295a58f8451993a57ce0a6f9ba29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:22.415684 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-fcb17e43-a034-4066-8e16-70874d3cf5a4 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] 10.222.0.60 "GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044" status: 200 len: 2371 microversion: 2.42 time: 0.473224 Sep 14 09:01:22.416817 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1535/3003] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:01:21 2022] GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044 => generated 2371 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 09:01:22.426283 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-cde5ec30-e29c-4489-a899-4a598df2ab71 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Calling method '.version_select at 0x7f7d443fc1f0>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:22.440916 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-36ec0c87-87fb-49b2-aa80-944071f1a1aa tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] 10.222.0.60 "GET /compute/v2.1/servers/3b592d04-368e-4b8f-bae2-c77aebec4105" status: 200 len: 1513 microversion: 2.1 time: 0.454517 Sep 14 09:01:22.455616 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1469/3004] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:01:21 2022] GET /compute/v2.1/servers/3b592d04-368e-4b8f-bae2-c77aebec4105 => generated 1513 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:01:22.460631 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c9a95a4d-ec22-49bb-baa2-fd121586dfa4 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:22.461372 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-c9a95a4d-ec22-49bb-baa2-fd121586dfa4 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] [instance: 0eb40c80-c056-4096-a586-7e957a63f7cf] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:22.476813 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c9a95a4d-ec22-49bb-baa2-fd121586dfa4 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:22.477411 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c9a95a4d-ec22-49bb-baa2-fd121586dfa4 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:22.477948 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c9a95a4d-ec22-49bb-baa2-fd121586dfa4 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:22.485942 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c9a95a4d-ec22-49bb-baa2-fd121586dfa4 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:22.486797 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c9a95a4d-ec22-49bb-baa2-fd121586dfa4 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:22.487399 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c9a95a4d-ec22-49bb-baa2-fd121586dfa4 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:22.499199 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-cde5ec30-e29c-4489-a899-4a598df2ab71 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] 10.222.0.60 "GET /compute/v2.1/images/be62d386-20a6-4610-9cf3-1a1a7817aac8" status: 200 len: 1453 microversion: 2.1 time: 0.081020 Sep 14 09:01:22.500109 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1536/3005] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:01:22 2022] GET /compute/v2.1/images/be62d386-20a6-4610-9cf3-1a1a7817aac8 => generated 1453 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:01:22.506553 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-af01e034-ec6b-482f-9689-5082edbaa7a5 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:22.507241 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-af01e034-ec6b-482f-9689-5082edbaa7a5 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: 680c3968-8912-45c4-b1c3-634c06ec30c3] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:22.517830 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-af01e034-ec6b-482f-9689-5082edbaa7a5 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:22.518845 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-af01e034-ec6b-482f-9689-5082edbaa7a5 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:22.520135 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-af01e034-ec6b-482f-9689-5082edbaa7a5 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:22.521562 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-af01e034-ec6b-482f-9689-5082edbaa7a5 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:22.522071 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-af01e034-ec6b-482f-9689-5082edbaa7a5 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:22.522981 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-af01e034-ec6b-482f-9689-5082edbaa7a5 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:22.666324 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-c9a95a4d-ec22-49bb-baa2-fd121586dfa4 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:22.680583 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-c9a95a4d-ec22-49bb-baa2-fd121586dfa4 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:22.682051 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-c9a95a4d-ec22-49bb-baa2-fd121586dfa4 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:22.700680 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-c9a95a4d-ec22-49bb-baa2-fd121586dfa4 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] 10.222.0.60 "GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf" status: 200 len: 1537 microversion: 2.91 time: 0.243739 Sep 14 09:01:22.715999 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1470/3006] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:01:22 2022] GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf => generated 1537 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:01:22.809470 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-af01e034-ec6b-482f-9689-5082edbaa7a5 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:22.819631 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-af01e034-ec6b-482f-9689-5082edbaa7a5 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/680c3968-8912-45c4-b1c3-634c06ec30c3" status: 200 len: 1508 microversion: 2.1 time: 0.318317 Sep 14 09:01:22.835708 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1537/3007] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:01:22 2022] GET /compute/v2.1/servers/680c3968-8912-45c4-b1c3-634c06ec30c3 => generated 1508 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:01:23.446213 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-6e3da9dd-35dc-4eaa-b94f-bf50c8f985c0 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:23.446885 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-6e3da9dd-35dc-4eaa-b94f-bf50c8f985c0 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] [instance: 59f196e8-c202-4073-8663-2ae19358a044] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:23.462983 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6e3da9dd-35dc-4eaa-b94f-bf50c8f985c0 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:23.463814 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6e3da9dd-35dc-4eaa-b94f-bf50c8f985c0 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:23.464475 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6e3da9dd-35dc-4eaa-b94f-bf50c8f985c0 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:23.465557 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6e3da9dd-35dc-4eaa-b94f-bf50c8f985c0 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:23.466205 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6e3da9dd-35dc-4eaa-b94f-bf50c8f985c0 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:23.466817 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6e3da9dd-35dc-4eaa-b94f-bf50c8f985c0 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:23.470078 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-29bd865c-f502-4b2f-a82a-f6fe00f40d74 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:23.470705 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-29bd865c-f502-4b2f-a82a-f6fe00f40d74 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: 3b592d04-368e-4b8f-bae2-c77aebec4105] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:23.488631 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-29bd865c-f502-4b2f-a82a-f6fe00f40d74 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:23.489172 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-29bd865c-f502-4b2f-a82a-f6fe00f40d74 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:23.491271 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-29bd865c-f502-4b2f-a82a-f6fe00f40d74 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:23.493791 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-29bd865c-f502-4b2f-a82a-f6fe00f40d74 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:23.494379 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-29bd865c-f502-4b2f-a82a-f6fe00f40d74 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:23.495121 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-29bd865c-f502-4b2f-a82a-f6fe00f40d74 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:23.621176 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-6e3da9dd-35dc-4eaa-b94f-bf50c8f985c0 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:23.632864 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-6e3da9dd-35dc-4eaa-b94f-bf50c8f985c0 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:23.634624 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-6e3da9dd-35dc-4eaa-b94f-bf50c8f985c0 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:23.640244 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-6e3da9dd-35dc-4eaa-b94f-bf50c8f985c0 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] 10.222.0.60 "GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044" status: 200 len: 2256 microversion: 2.42 time: 0.198184 Sep 14 09:01:23.665560 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1471/3008] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:01:23 2022] GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044 => generated 2256 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:01:23.672445 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d640c713-da48-4312-ab04-8167ba65701c tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Calling method '.version_select at 0x7f7d4863a430>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:23.756292 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d640c713-da48-4312-ab04-8167ba65701c tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] 10.222.0.60 "GET /compute/v2.1/images/be62d386-20a6-4610-9cf3-1a1a7817aac8" status: 200 len: 1453 microversion: 2.1 time: 0.089398 Sep 14 09:01:23.761489 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1472/3009] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:01:23 2022] GET /compute/v2.1/images/be62d386-20a6-4610-9cf3-1a1a7817aac8 => generated 1453 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:01:23.781091 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-6c689a06-b055-4486-87e0-e04b25e1cc67 req-0d9a04b9-e560-48ca-abd0-5a75c687031e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59f196e8-c202-4073-8663-2ae19358a044", "name": "network-vif-deleted", "tag": "55ecb12c-40d9-41ea-bb56-362fc9dba976"}, {"server_uuid": "59f196e8-c202-4073-8663-2ae19358a044", "name": "network-vif-deleted", "tag": "6bc29bf6-117b-4334-9caf-61bc5a58835c"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:01:23.803335 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-6c689a06-b055-4486-87e0-e04b25e1cc67 req-0d9a04b9-e560-48ca-abd0-5a75c687031e service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:23.804698 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-6c689a06-b055-4486-87e0-e04b25e1cc67 req-0d9a04b9-e560-48ca-abd0-5a75c687031e service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:23.805399 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-6c689a06-b055-4486-87e0-e04b25e1cc67 req-0d9a04b9-e560-48ca-abd0-5a75c687031e service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:23.827994 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-6c689a06-b055-4486-87e0-e04b25e1cc67 req-0d9a04b9-e560-48ca-abd0-5a75c687031e service nova] Creating event network-vif-deleted:55ecb12c-40d9-41ea-bb56-362fc9dba976 for instance 59f196e8-c202-4073-8663-2ae19358a044 on n-h2-836830-18 Sep 14 09:01:23.828513 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-6c689a06-b055-4486-87e0-e04b25e1cc67 req-0d9a04b9-e560-48ca-abd0-5a75c687031e service nova] Creating event network-vif-deleted:6bc29bf6-117b-4334-9caf-61bc5a58835c for instance 59f196e8-c202-4073-8663-2ae19358a044 on n-h2-836830-18 Sep 14 09:01:23.844794 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-6c689a06-b055-4486-87e0-e04b25e1cc67 req-0d9a04b9-e560-48ca-abd0-5a75c687031e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.080670 Sep 14 09:01:23.845716 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1473/3010] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:01:23 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:01:23.856644 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-33189e65-1eb6-480d-ab77-a3bf6f22a37e tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:23.857356 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-33189e65-1eb6-480d-ab77-a3bf6f22a37e tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] [instance: 0eb40c80-c056-4096-a586-7e957a63f7cf] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:23.877103 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-33189e65-1eb6-480d-ab77-a3bf6f22a37e tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:23.877749 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-33189e65-1eb6-480d-ab77-a3bf6f22a37e tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:23.878046 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-33189e65-1eb6-480d-ab77-a3bf6f22a37e tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:23.878765 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-33189e65-1eb6-480d-ab77-a3bf6f22a37e tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:23.883434 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-33189e65-1eb6-480d-ab77-a3bf6f22a37e tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:23.883933 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-33189e65-1eb6-480d-ab77-a3bf6f22a37e tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:23.885650 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-29bd865c-f502-4b2f-a82a-f6fe00f40d74 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9d40e54481461cba53fedb9a6abdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed2295a58f8451993a57ce0a6f9ba29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:23.899185 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-29bd865c-f502-4b2f-a82a-f6fe00f40d74 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] 10.222.0.60 "GET /compute/v2.1/servers/3b592d04-368e-4b8f-bae2-c77aebec4105" status: 200 len: 1513 microversion: 2.1 time: 0.433230 Sep 14 09:01:23.913345 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1538/3011] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:01:23 2022] GET /compute/v2.1/servers/3b592d04-368e-4b8f-bae2-c77aebec4105 => generated 1513 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:01:23.930161 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d7461c2a-4927-4c59-8d58-db3d0ab1dbf3 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:23.933746 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-d7461c2a-4927-4c59-8d58-db3d0ab1dbf3 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: 680c3968-8912-45c4-b1c3-634c06ec30c3] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:23.947866 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d7461c2a-4927-4c59-8d58-db3d0ab1dbf3 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:23.948713 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d7461c2a-4927-4c59-8d58-db3d0ab1dbf3 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:23.949353 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d7461c2a-4927-4c59-8d58-db3d0ab1dbf3 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:23.950760 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d7461c2a-4927-4c59-8d58-db3d0ab1dbf3 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:23.951931 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d7461c2a-4927-4c59-8d58-db3d0ab1dbf3 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:23.952588 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d7461c2a-4927-4c59-8d58-db3d0ab1dbf3 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:23.958315 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:01:24.083259 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-33189e65-1eb6-480d-ab77-a3bf6f22a37e tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:24.096030 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-33189e65-1eb6-480d-ab77-a3bf6f22a37e tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:24.097526 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-33189e65-1eb6-480d-ab77-a3bf6f22a37e tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:24.103337 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-33189e65-1eb6-480d-ab77-a3bf6f22a37e tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] 10.222.0.60 "GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf" status: 200 len: 1537 microversion: 2.91 time: 0.256366 Sep 14 09:01:24.124592 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1474/3012] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:01:23 2022] GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf => generated 1537 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:01:24.222983 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-d7461c2a-4927-4c59-8d58-db3d0ab1dbf3 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:24.234967 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-d7461c2a-4927-4c59-8d58-db3d0ab1dbf3 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/680c3968-8912-45c4-b1c3-634c06ec30c3" status: 200 len: 1508 microversion: 2.1 time: 0.319633 Sep 14 09:01:24.236389 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1539/3013] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:01:23 2022] GET /compute/v2.1/servers/680c3968-8912-45c4-b1c3-634c06ec30c3 => generated 1508 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:01:24.459288 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-adaf1ad0-149f-476d-a991-7aad4d1f5037 req-58250006-47a4-4305-b0d0-338ac4d732e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b592d04-368e-4b8f-bae2-c77aebec4105", "name": "network-vif-deleted", "tag": "64b11033-eadd-4f21-bfc9-3708641d46a2"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:01:24.492677 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-adaf1ad0-149f-476d-a991-7aad4d1f5037 req-58250006-47a4-4305-b0d0-338ac4d732e3 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:24.493538 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-adaf1ad0-149f-476d-a991-7aad4d1f5037 req-58250006-47a4-4305-b0d0-338ac4d732e3 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:24.494129 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-adaf1ad0-149f-476d-a991-7aad4d1f5037 req-58250006-47a4-4305-b0d0-338ac4d732e3 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:24.544721 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-adaf1ad0-149f-476d-a991-7aad4d1f5037 req-58250006-47a4-4305-b0d0-338ac4d732e3 service nova] Creating event network-vif-deleted:64b11033-eadd-4f21-bfc9-3708641d46a2 for instance 3b592d04-368e-4b8f-bae2-c77aebec4105 on n-h2-836830-18 Sep 14 09:01:24.557401 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-adaf1ad0-149f-476d-a991-7aad4d1f5037 req-58250006-47a4-4305-b0d0-338ac4d732e3 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103959 Sep 14 09:01:24.560528 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1475/3014] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:01:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:01:24.673480 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-8b5c210f-dd5d-4165-b88a-1a9fc0bdc01d tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:24.674748 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-8b5c210f-dd5d-4165-b88a-1a9fc0bdc01d tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] [instance: 59f196e8-c202-4073-8663-2ae19358a044] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:24.683769 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8b5c210f-dd5d-4165-b88a-1a9fc0bdc01d tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:24.685062 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8b5c210f-dd5d-4165-b88a-1a9fc0bdc01d tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:24.686403 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8b5c210f-dd5d-4165-b88a-1a9fc0bdc01d tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:24.687337 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8b5c210f-dd5d-4165-b88a-1a9fc0bdc01d tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:24.687957 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8b5c210f-dd5d-4165-b88a-1a9fc0bdc01d tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:24.689126 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8b5c210f-dd5d-4165-b88a-1a9fc0bdc01d tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:24.778133 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-01839989-bbb6-4263-8e16-2c9eda832a7e tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Calling method '.version_select at 0x7f7d4860dca0>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:24.861813 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-8b5c210f-dd5d-4165-b88a-1a9fc0bdc01d tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:24.882006 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-8b5c210f-dd5d-4165-b88a-1a9fc0bdc01d tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:24.884271 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-8b5c210f-dd5d-4165-b88a-1a9fc0bdc01d tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:24.892204 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-8b5c210f-dd5d-4165-b88a-1a9fc0bdc01d tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] 10.222.0.60 "GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044" status: 200 len: 1602 microversion: 2.42 time: 0.222631 Sep 14 09:01:24.907450 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1540/3015] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:01:24 2022] GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044 => generated 1602 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:01:24.923818 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-bc10f720-7bb5-47eb-ae4e-08a7559aabe0 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:24.924979 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-bc10f720-7bb5-47eb-ae4e-08a7559aabe0 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] [instance: 885dfd01-8bac-4691-ad0b-f2218e306f2e] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:24.930048 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-01839989-bbb6-4263-8e16-2c9eda832a7e tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] 10.222.0.60 "GET /compute/v2.1/images/be62d386-20a6-4610-9cf3-1a1a7817aac8" status: 200 len: 1453 microversion: 2.1 time: 0.156282 Sep 14 09:01:24.930747 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1476/3016] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:01:24 2022] GET /compute/v2.1/images/be62d386-20a6-4610-9cf3-1a1a7817aac8 => generated 1453 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:01:24.942526 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-5f50525c-3bfc-4d4d-9a5e-af6165fc9e69 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:24.943500 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-5f50525c-3bfc-4d4d-9a5e-af6165fc9e69 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: 3b592d04-368e-4b8f-bae2-c77aebec4105] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:24.944235 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bc10f720-7bb5-47eb-ae4e-08a7559aabe0 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:24.944940 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bc10f720-7bb5-47eb-ae4e-08a7559aabe0 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:24.945563 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bc10f720-7bb5-47eb-ae4e-08a7559aabe0 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:24.946465 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bc10f720-7bb5-47eb-ae4e-08a7559aabe0 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:24.947160 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bc10f720-7bb5-47eb-ae4e-08a7559aabe0 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:24.947957 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bc10f720-7bb5-47eb-ae4e-08a7559aabe0 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:24.953927 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5f50525c-3bfc-4d4d-9a5e-af6165fc9e69 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:24.954462 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5f50525c-3bfc-4d4d-9a5e-af6165fc9e69 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:24.954991 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5f50525c-3bfc-4d4d-9a5e-af6165fc9e69 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:24.955718 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5f50525c-3bfc-4d4d-9a5e-af6165fc9e69 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:24.956186 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5f50525c-3bfc-4d4d-9a5e-af6165fc9e69 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:24.956621 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5f50525c-3bfc-4d4d-9a5e-af6165fc9e69 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:24.980209 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-bc10f720-7bb5-47eb-ae4e-08a7559aabe0 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] [instance: 885dfd01-8bac-4691-ad0b-f2218e306f2e] Going to try to terminate instance {{(pid=128758) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:01:24.994736 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5f50525c-3bfc-4d4d-9a5e-af6165fc9e69 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:24.995326 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5f50525c-3bfc-4d4d-9a5e-af6165fc9e69 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:24.998788 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5f50525c-3bfc-4d4d-9a5e-af6165fc9e69 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:24.999415 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.objects.instance [None req-5f50525c-3bfc-4d4d-9a5e-af6165fc9e69 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lazy-loading 'fault' on Instance uuid 3b592d04-368e-4b8f-bae2-c77aebec4105 {{(pid=128759) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:01:25.056919 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-5f50525c-3bfc-4d4d-9a5e-af6165fc9e69 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc9d40e54481461cba53fedb9a6abdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed2295a58f8451993a57ce0a6f9ba29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:25.076182 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-5f50525c-3bfc-4d4d-9a5e-af6165fc9e69 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] 10.222.0.60 "GET /compute/v2.1/servers/3b592d04-368e-4b8f-bae2-c77aebec4105" status: 200 len: 1307 microversion: 2.1 time: 0.143695 Sep 14 09:01:25.078128 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1477/3017] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:01:24 2022] GET /compute/v2.1/servers/3b592d04-368e-4b8f-bae2-c77aebec4105 => generated 1307 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:01:25.133443 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-6909e05e-8ccc-4b8f-b038-f84dee434574 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:25.133900 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-6909e05e-8ccc-4b8f-b038-f84dee434574 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] [instance: 0eb40c80-c056-4096-a586-7e957a63f7cf] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:25.142982 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6909e05e-8ccc-4b8f-b038-f84dee434574 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:25.143459 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6909e05e-8ccc-4b8f-b038-f84dee434574 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:25.143891 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6909e05e-8ccc-4b8f-b038-f84dee434574 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:25.153600 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6909e05e-8ccc-4b8f-b038-f84dee434574 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:25.154430 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6909e05e-8ccc-4b8f-b038-f84dee434574 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:25.155087 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6909e05e-8ccc-4b8f-b038-f84dee434574 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:25.166429 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-bc10f720-7bb5-47eb-ae4e-08a7559aabe0 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] 10.222.0.60 "DELETE /compute/v2.1/servers/885dfd01-8bac-4691-ad0b-f2218e306f2e" status: 204 len: 0 microversion: 2.1 time: 0.255131 Sep 14 09:01:25.173043 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1541/3018] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:01:24 2022] DELETE /compute/v2.1/servers/885dfd01-8bac-4691-ad0b-f2218e306f2e => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:01:25.185144 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-9efefc4f-299c-429b-95bc-1e6db43760d8 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:25.187111 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-9efefc4f-299c-429b-95bc-1e6db43760d8 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] [instance: 885dfd01-8bac-4691-ad0b-f2218e306f2e] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:25.201097 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9efefc4f-299c-429b-95bc-1e6db43760d8 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:25.202434 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9efefc4f-299c-429b-95bc-1e6db43760d8 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:25.203073 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9efefc4f-299c-429b-95bc-1e6db43760d8 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:25.204163 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9efefc4f-299c-429b-95bc-1e6db43760d8 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:25.205056 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9efefc4f-299c-429b-95bc-1e6db43760d8 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:25.205646 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9efefc4f-299c-429b-95bc-1e6db43760d8 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:25.295660 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-6909e05e-8ccc-4b8f-b038-f84dee434574 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:25.309775 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-6909e05e-8ccc-4b8f-b038-f84dee434574 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:25.311415 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-6909e05e-8ccc-4b8f-b038-f84dee434574 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:25.331148 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-6909e05e-8ccc-4b8f-b038-f84dee434574 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] 10.222.0.60 "GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf" status: 200 len: 1537 microversion: 2.91 time: 0.201811 Sep 14 09:01:25.332359 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1478/3019] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:01:25 2022] GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf => generated 1537 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:01:25.337235 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-04fd775d-5e74-45d7-a6e1-882963a992d0 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:25.347751 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-04fd775d-5e74-45d7-a6e1-882963a992d0 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: 680c3968-8912-45c4-b1c3-634c06ec30c3] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:25.354115 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-04fd775d-5e74-45d7-a6e1-882963a992d0 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:25.354891 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-04fd775d-5e74-45d7-a6e1-882963a992d0 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:25.356082 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-04fd775d-5e74-45d7-a6e1-882963a992d0 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:25.356681 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-04fd775d-5e74-45d7-a6e1-882963a992d0 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:25.357686 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-04fd775d-5e74-45d7-a6e1-882963a992d0 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:25.359513 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-04fd775d-5e74-45d7-a6e1-882963a992d0 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:25.632392 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-04fd775d-5e74-45d7-a6e1-882963a992d0 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:25.644101 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-9efefc4f-299c-429b-95bc-1e6db43760d8 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ab7166e40e4a908eefbfb03b3b8804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de82b83dadd541dbb4a939f2fc04a163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:25.650750 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-04fd775d-5e74-45d7-a6e1-882963a992d0 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/680c3968-8912-45c4-b1c3-634c06ec30c3" status: 200 len: 1508 microversion: 2.1 time: 0.316987 Sep 14 09:01:25.651922 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1479/3020] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:01:25 2022] GET /compute/v2.1/servers/680c3968-8912-45c4-b1c3-634c06ec30c3 => generated 1508 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:01:25.652121 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-9efefc4f-299c-429b-95bc-1e6db43760d8 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] 10.222.0.60 "GET /compute/v2.1/servers/885dfd01-8bac-4691-ad0b-f2218e306f2e" status: 200 len: 1682 microversion: 2.1 time: 0.475087 Sep 14 09:01:25.663201 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1542/3021] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:01:25 2022] GET /compute/v2.1/servers/885dfd01-8bac-4691-ad0b-f2218e306f2e => generated 1682 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:01:25.881391 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-5ba8ddbf-2115-4e31-904d-ed85a3888711 req-334d8b7e-4c2b-4984-b7a1-f6db0736b658 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59f196e8-c202-4073-8663-2ae19358a044", "name": "network-vif-deleted", "tag": "2facbe7c-1fe7-4366-91c7-d589e067102f"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:01:25.902319 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-5ba8ddbf-2115-4e31-904d-ed85a3888711 req-334d8b7e-4c2b-4984-b7a1-f6db0736b658 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:25.903300 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-5ba8ddbf-2115-4e31-904d-ed85a3888711 req-334d8b7e-4c2b-4984-b7a1-f6db0736b658 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:25.903901 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-5ba8ddbf-2115-4e31-904d-ed85a3888711 req-334d8b7e-4c2b-4984-b7a1-f6db0736b658 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:25.925645 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-fb22a414-1932-4983-b87d-7df945c323c3 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:25.927048 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-fb22a414-1932-4983-b87d-7df945c323c3 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] [instance: 59f196e8-c202-4073-8663-2ae19358a044] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:25.932220 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-5ba8ddbf-2115-4e31-904d-ed85a3888711 req-334d8b7e-4c2b-4984-b7a1-f6db0736b658 service nova] Creating event network-vif-deleted:2facbe7c-1fe7-4366-91c7-d589e067102f for instance 59f196e8-c202-4073-8663-2ae19358a044 on n-h2-836830-18 Sep 14 09:01:25.938816 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-5ba8ddbf-2115-4e31-904d-ed85a3888711 req-334d8b7e-4c2b-4984-b7a1-f6db0736b658 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061081 Sep 14 09:01:25.940081 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1480/3022] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:01:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:01:25.944354 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fb22a414-1932-4983-b87d-7df945c323c3 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:25.946686 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fb22a414-1932-4983-b87d-7df945c323c3 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:25.947330 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fb22a414-1932-4983-b87d-7df945c323c3 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:25.950478 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-2b87a32b-6aed-4a46-bc25-27a7b2e6344f tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Calling method '.version_select at 0x7f7d3f6015e0>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:25.951253 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fb22a414-1932-4983-b87d-7df945c323c3 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:25.952182 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fb22a414-1932-4983-b87d-7df945c323c3 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:25.953066 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fb22a414-1932-4983-b87d-7df945c323c3 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:26.010536 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-2b87a32b-6aed-4a46-bc25-27a7b2e6344f tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] 10.222.0.60 "GET /compute/v2.1/images/be62d386-20a6-4610-9cf3-1a1a7817aac8" status: 200 len: 1453 microversion: 2.1 time: 0.065425 Sep 14 09:01:26.012089 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1481/3023] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:01:25 2022] GET /compute/v2.1/images/be62d386-20a6-4610-9cf3-1a1a7817aac8 => generated 1453 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:01:26.068826 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-fb22a414-1932-4983-b87d-7df945c323c3 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:26.079607 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-fb22a414-1932-4983-b87d-7df945c323c3 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:26.081278 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-fb22a414-1932-4983-b87d-7df945c323c3 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:26.082649 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-fb22a414-1932-4983-b87d-7df945c323c3 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] 10.222.0.60 "GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044" status: 200 len: 1602 microversion: 2.42 time: 0.162603 Sep 14 09:01:26.084361 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1543/3024] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:01:25 2022] GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044 => generated 1602 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:01:26.101709 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f80b05c8-b7b8-4921-aed4-730114deece8 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:26.102459 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f80b05c8-b7b8-4921-aed4-730114deece8 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: 3b592d04-368e-4b8f-bae2-c77aebec4105] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:26.111574 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=100 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:01:26.116323 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f80b05c8-b7b8-4921-aed4-730114deece8 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:26.116826 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f80b05c8-b7b8-4921-aed4-730114deece8 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:26.117276 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f80b05c8-b7b8-4921-aed4-730114deece8 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:26.118067 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f80b05c8-b7b8-4921-aed4-730114deece8 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:26.118531 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f80b05c8-b7b8-4921-aed4-730114deece8 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:26.118977 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f80b05c8-b7b8-4921-aed4-730114deece8 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:26.138332 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-f80b05c8-b7b8-4921-aed4-730114deece8 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] HTTP exception thrown: Instance 3b592d04-368e-4b8f-bae2-c77aebec4105 could not be found. Sep 14 09:01:26.139964 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f80b05c8-b7b8-4921-aed4-730114deece8 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Request method failure captured: Sep 14 09:01:26.139964 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/3b592d04-368e-4b8f-bae2-c77aebec4105 HTTP/1.1 Sep 14 09:01:26.139964 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:01:26.139964 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:01:26.139964 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:01:26.139964 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:01:26.139964 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:01:26.139964 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:01:26.139964 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:01:26.139964 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:01:26.139964 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZe5AsAh1luinYQkmP4XNea6-A3seq0Ow-Xnx9sBn4d7vYmv6a1FquoMtPgc45IowhphdGhR--RFQTcHwvRjcZQ8emNtaP8vz4RUJxKj3CaT0PyvAl3BS4ydPyuCrv2Xn5jT8sL8yQKEJebneHcjm2fWmImOROsjrIZ_FaJDI-Cr_Yk Sep 14 09:01:26.139964 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:01:26.139964 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:01:26.139964 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:01:26.139964 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:01:26.139964 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:01:26.139964 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:01:26.139964 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 6ed2295a58f8451993a57ce0a6f9ba29 Sep 14 09:01:26.139964 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1682105394 Sep 14 09:01:26.139964 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:01:26.139964 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:01:26.139964 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6ed2295a58f8451993a57ce0a6f9ba29"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6ed2295a58f8451993a57ce0a6f9ba29"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6ed2295a58f8451993a57ce0a6f9ba29"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6ed2295a58f8451993a57ce0a6f9ba29"}]}] Sep 14 09:01:26.139964 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ServerDiskConfigTestJSON-1682105394 Sep 14 09:01:26.139964 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 6ed2295a58f8451993a57ce0a6f9ba29 Sep 14 09:01:26.139964 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1682105394 Sep 14 09:01:26.139964 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ServerDiskConfigTestJSON-1682105394-project Sep 14 09:01:26.139964 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:01:26.139964 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:01:26.139964 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: dc9d40e54481461cba53fedb9a6abdf8 Sep 14 09:01:26.139964 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ServerDiskConfigTestJSON-1682105394-project Sep 14 09:01:26.139964 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:01:26.139964 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance 3b592d04-368e-4b8f-bae2-c77aebec4105 could not be found. Sep 14 09:01:26.139964 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '3b592d04-368e-4b8f-bae2-c77aebec4105'} Sep 14 09:01:26.139964 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:01:26.139964 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:01:26.139964 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:01:26.139964 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:01:26.139964 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:01:26.139964 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:01:26.139964 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:01:26.139964 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:01:26.139964 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:01:26.139964 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:01:26.139964 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b592d04-368e-4b8f-bae2-c77aebec4105 could not be found. Sep 14 09:01:26.139964 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:01:26.139964 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:01:26.139964 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:01:26.139964 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:01:26.139964 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:01:26.139964 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:01:26.139964 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:01:26.139964 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:01:26.139964 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:01:26.139964 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:01:26.139964 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:01:26.139964 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:01:26.139964 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:01:26.139964 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:01:26.139964 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:01:26.139964 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:01:26.139964 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b592d04-368e-4b8f-bae2-c77aebec4105 could not be found. Sep 14 09:01:26.139964 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:01:26.139964 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:01:26.139964 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:01:26.144060 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:01:26.144060 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:01:26.144060 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:01:26.144060 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:01:26.144060 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:01:26.144060 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b592d04-368e-4b8f-bae2-c77aebec4105 could not be found. Sep 14 09:01:26.144060 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:01:26.144060 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f80b05c8-b7b8-4921-aed4-730114deece8 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Returning 404 to user: Instance 3b592d04-368e-4b8f-bae2-c77aebec4105 could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:01:26.144060 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f80b05c8-b7b8-4921-aed4-730114deece8 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] 10.222.0.60 "GET /compute/v2.1/servers/3b592d04-368e-4b8f-bae2-c77aebec4105" status: 404 len: 111 microversion: 2.1 time: 0.044437 Sep 14 09:01:26.144060 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1482/3025] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:01:26 2022] GET /compute/v2.1/servers/3b592d04-368e-4b8f-bae2-c77aebec4105 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:01:26.151036 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-11a0f2b7-7c51-455d-ac46-254db48602d3 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:26.151844 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-11a0f2b7-7c51-455d-ac46-254db48602d3 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: 8f7f80e3-c2f5-4719-a484-29d6bd0d9e91] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:26.159830 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-11a0f2b7-7c51-455d-ac46-254db48602d3 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:26.160610 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-11a0f2b7-7c51-455d-ac46-254db48602d3 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:26.161259 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-11a0f2b7-7c51-455d-ac46-254db48602d3 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:26.162192 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-11a0f2b7-7c51-455d-ac46-254db48602d3 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:26.162858 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-11a0f2b7-7c51-455d-ac46-254db48602d3 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:26.163523 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-11a0f2b7-7c51-455d-ac46-254db48602d3 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:26.184363 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-11a0f2b7-7c51-455d-ac46-254db48602d3 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] HTTP exception thrown: Instance 8f7f80e3-c2f5-4719-a484-29d6bd0d9e91 could not be found. Sep 14 09:01:26.186838 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-11a0f2b7-7c51-455d-ac46-254db48602d3 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Request method failure captured: Sep 14 09:01:26.186838 n-d-836830-18 devstack@n-api.service[128758]: request: DELETE /compute/v2.1/servers/8f7f80e3-c2f5-4719-a484-29d6bd0d9e91 HTTP/1.1 Sep 14 09:01:26.186838 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 09:01:26.186838 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 09:01:26.186838 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 09:01:26.186838 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 09:01:26.186838 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 09:01:26.186838 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 09:01:26.186838 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 09:01:26.186838 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 09:01:26.186838 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZe5AsAh1luinYQkmP4XNea6-A3seq0Ow-Xnx9sBn4d7vYmv6a1FquoMtPgc45IowhphdGhR--RFQTcHwvRjcZQ8emNtaP8vz4RUJxKj3CaT0PyvAl3BS4ydPyuCrv2Xn5jT8sL8yQKEJebneHcjm2fWmImOROsjrIZ_FaJDI-Cr_Yk Sep 14 09:01:26.186838 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 09:01:26.186838 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 09:01:26.186838 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 09:01:26.186838 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 09:01:26.186838 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 09:01:26.186838 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 09:01:26.186838 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 6ed2295a58f8451993a57ce0a6f9ba29 Sep 14 09:01:26.186838 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1682105394 Sep 14 09:01:26.186838 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 09:01:26.186838 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 09:01:26.186838 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6ed2295a58f8451993a57ce0a6f9ba29"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6ed2295a58f8451993a57ce0a6f9ba29"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6ed2295a58f8451993a57ce0a6f9ba29"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6ed2295a58f8451993a57ce0a6f9ba29"}]}] Sep 14 09:01:26.186838 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-ServerDiskConfigTestJSON-1682105394 Sep 14 09:01:26.186838 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 6ed2295a58f8451993a57ce0a6f9ba29 Sep 14 09:01:26.186838 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1682105394 Sep 14 09:01:26.186838 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-ServerDiskConfigTestJSON-1682105394-project Sep 14 09:01:26.186838 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 09:01:26.186838 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 09:01:26.186838 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: dc9d40e54481461cba53fedb9a6abdf8 Sep 14 09:01:26.186838 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-ServerDiskConfigTestJSON-1682105394-project Sep 14 09:01:26.186838 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 09:01:26.186838 n-d-836830-18 devstack@n-api.service[128758]: exception: Instance 8f7f80e3-c2f5-4719-a484-29d6bd0d9e91 could not be found. Sep 14 09:01:26.186838 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': '8f7f80e3-c2f5-4719-a484-29d6bd0d9e91'} Sep 14 09:01:26.186838 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:01:26.186838 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:01:26.186838 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:01:26.186838 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:01:26.186838 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:01:26.186838 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:01:26.186838 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:01:26.186838 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:01:26.186838 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:01:26.186838 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:01:26.186838 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f7f80e3-c2f5-4719-a484-29d6bd0d9e91 could not be found. Sep 14 09:01:26.186838 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:01:26.186838 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:01:26.186838 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:01:26.186838 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:01:26.186838 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:01:26.186838 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:01:26.186838 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:01:26.186838 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:01:26.186838 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:01:26.186838 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:01:26.186838 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 09:01:26.186838 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 09:01:26.186838 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 09:01:26.186838 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 09:01:26.186838 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:01:26.186838 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:01:26.186838 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:01:26.186838 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:01:26.190729 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f7f80e3-c2f5-4719-a484-29d6bd0d9e91 could not be found. Sep 14 09:01:26.190729 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:01:26.190729 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:01:26.190729 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:01:26.190729 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:01:26.190729 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:01:26.190729 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:01:26.190729 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:01:26.190729 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:01:26.190729 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f7f80e3-c2f5-4719-a484-29d6bd0d9e91 could not be found. Sep 14 09:01:26.190729 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:01:26.192816 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-11a0f2b7-7c51-455d-ac46-254db48602d3 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Returning 404 to user: Instance 8f7f80e3-c2f5-4719-a484-29d6bd0d9e91 could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:01:26.194471 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-11a0f2b7-7c51-455d-ac46-254db48602d3 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] 10.222.0.60 "DELETE /compute/v2.1/servers/8f7f80e3-c2f5-4719-a484-29d6bd0d9e91" status: 404 len: 111 microversion: 2.1 time: 0.047344 Sep 14 09:01:26.195610 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1544/3026] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:01:26 2022] DELETE /compute/v2.1/servers/8f7f80e3-c2f5-4719-a484-29d6bd0d9e91 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:01:26.206771 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e2cfde45-8bee-401c-bc96-546fca135822 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:26.207415 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e2cfde45-8bee-401c-bc96-546fca135822 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: 8f7f80e3-c2f5-4719-a484-29d6bd0d9e91] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:26.214079 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e2cfde45-8bee-401c-bc96-546fca135822 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:26.215843 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e2cfde45-8bee-401c-bc96-546fca135822 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:26.216436 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e2cfde45-8bee-401c-bc96-546fca135822 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:26.217147 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e2cfde45-8bee-401c-bc96-546fca135822 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:26.217614 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e2cfde45-8bee-401c-bc96-546fca135822 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:26.218049 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e2cfde45-8bee-401c-bc96-546fca135822 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:26.240786 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-e2cfde45-8bee-401c-bc96-546fca135822 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] HTTP exception thrown: Instance 8f7f80e3-c2f5-4719-a484-29d6bd0d9e91 could not be found. Sep 14 09:01:26.246007 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e2cfde45-8bee-401c-bc96-546fca135822 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Request method failure captured: Sep 14 09:01:26.246007 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/8f7f80e3-c2f5-4719-a484-29d6bd0d9e91 HTTP/1.1 Sep 14 09:01:26.246007 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:01:26.246007 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:01:26.246007 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:01:26.246007 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:01:26.246007 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:01:26.246007 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:01:26.246007 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:01:26.246007 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:01:26.246007 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZe5AsAh1luinYQkmP4XNea6-A3seq0Ow-Xnx9sBn4d7vYmv6a1FquoMtPgc45IowhphdGhR--RFQTcHwvRjcZQ8emNtaP8vz4RUJxKj3CaT0PyvAl3BS4ydPyuCrv2Xn5jT8sL8yQKEJebneHcjm2fWmImOROsjrIZ_FaJDI-Cr_Yk Sep 14 09:01:26.246007 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:01:26.246007 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:01:26.246007 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:01:26.246007 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:01:26.246007 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:01:26.246007 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:01:26.246007 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 6ed2295a58f8451993a57ce0a6f9ba29 Sep 14 09:01:26.246007 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1682105394 Sep 14 09:01:26.246007 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:01:26.246007 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:01:26.246007 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6ed2295a58f8451993a57ce0a6f9ba29"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6ed2295a58f8451993a57ce0a6f9ba29"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6ed2295a58f8451993a57ce0a6f9ba29"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6ed2295a58f8451993a57ce0a6f9ba29"}]}] Sep 14 09:01:26.246007 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ServerDiskConfigTestJSON-1682105394 Sep 14 09:01:26.246007 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 6ed2295a58f8451993a57ce0a6f9ba29 Sep 14 09:01:26.246007 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1682105394 Sep 14 09:01:26.246007 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ServerDiskConfigTestJSON-1682105394-project Sep 14 09:01:26.246007 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:01:26.246007 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:01:26.246007 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: dc9d40e54481461cba53fedb9a6abdf8 Sep 14 09:01:26.246007 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ServerDiskConfigTestJSON-1682105394-project Sep 14 09:01:26.246007 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:01:26.246007 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance 8f7f80e3-c2f5-4719-a484-29d6bd0d9e91 could not be found. Sep 14 09:01:26.246007 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '8f7f80e3-c2f5-4719-a484-29d6bd0d9e91'} Sep 14 09:01:26.246007 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:01:26.246007 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:01:26.246007 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:01:26.246007 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:01:26.246007 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:01:26.246007 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:01:26.246007 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:01:26.246007 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:01:26.246007 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:01:26.246007 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:01:26.246007 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f7f80e3-c2f5-4719-a484-29d6bd0d9e91 could not be found. Sep 14 09:01:26.246007 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:01:26.246007 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:01:26.246007 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:01:26.246007 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:01:26.246007 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:01:26.246007 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:01:26.246007 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:01:26.246007 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:01:26.246007 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:01:26.246007 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:01:26.246007 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:01:26.246007 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:01:26.246007 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:01:26.246007 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:01:26.246007 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:01:26.246007 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:01:26.246007 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f7f80e3-c2f5-4719-a484-29d6bd0d9e91 could not be found. Sep 14 09:01:26.246007 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:01:26.246007 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:01:26.246007 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:01:26.250606 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:01:26.250606 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:01:26.250606 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:01:26.250606 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:01:26.250606 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:01:26.250606 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f7f80e3-c2f5-4719-a484-29d6bd0d9e91 could not be found. Sep 14 09:01:26.250606 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:01:26.250606 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e2cfde45-8bee-401c-bc96-546fca135822 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Returning 404 to user: Instance 8f7f80e3-c2f5-4719-a484-29d6bd0d9e91 could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:01:26.250606 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e2cfde45-8bee-401c-bc96-546fca135822 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] 10.222.0.60 "GET /compute/v2.1/servers/8f7f80e3-c2f5-4719-a484-29d6bd0d9e91" status: 404 len: 111 microversion: 2.1 time: 0.047471 Sep 14 09:01:26.250606 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1483/3027] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:01:26 2022] GET /compute/v2.1/servers/8f7f80e3-c2f5-4719-a484-29d6bd0d9e91 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:01:26.257134 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ccd19a03-ea7c-4cd7-8c2d-67143af995c2 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:26.258419 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-ccd19a03-ea7c-4cd7-8c2d-67143af995c2 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: d0c5547a-1340-4d19-a0f9-3e1eb9fd1932] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:26.270617 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ccd19a03-ea7c-4cd7-8c2d-67143af995c2 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:26.271459 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ccd19a03-ea7c-4cd7-8c2d-67143af995c2 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:26.272879 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ccd19a03-ea7c-4cd7-8c2d-67143af995c2 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:26.275578 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ccd19a03-ea7c-4cd7-8c2d-67143af995c2 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:26.276315 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ccd19a03-ea7c-4cd7-8c2d-67143af995c2 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:26.276947 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ccd19a03-ea7c-4cd7-8c2d-67143af995c2 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:26.296388 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-ccd19a03-ea7c-4cd7-8c2d-67143af995c2 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] HTTP exception thrown: Instance d0c5547a-1340-4d19-a0f9-3e1eb9fd1932 could not be found. Sep 14 09:01:26.300790 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ccd19a03-ea7c-4cd7-8c2d-67143af995c2 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Request method failure captured: Sep 14 09:01:26.300790 n-d-836830-18 devstack@n-api.service[128758]: request: DELETE /compute/v2.1/servers/d0c5547a-1340-4d19-a0f9-3e1eb9fd1932 HTTP/1.1 Sep 14 09:01:26.300790 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 09:01:26.300790 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 09:01:26.300790 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 09:01:26.300790 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 09:01:26.300790 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 09:01:26.300790 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 09:01:26.300790 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 09:01:26.300790 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 09:01:26.300790 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZe5AsAh1luinYQkmP4XNea6-A3seq0Ow-Xnx9sBn4d7vYmv6a1FquoMtPgc45IowhphdGhR--RFQTcHwvRjcZQ8emNtaP8vz4RUJxKj3CaT0PyvAl3BS4ydPyuCrv2Xn5jT8sL8yQKEJebneHcjm2fWmImOROsjrIZ_FaJDI-Cr_Yk Sep 14 09:01:26.300790 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 09:01:26.300790 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 09:01:26.300790 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 09:01:26.300790 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 09:01:26.300790 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 09:01:26.300790 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 09:01:26.300790 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 6ed2295a58f8451993a57ce0a6f9ba29 Sep 14 09:01:26.300790 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1682105394 Sep 14 09:01:26.300790 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 09:01:26.300790 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 09:01:26.300790 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6ed2295a58f8451993a57ce0a6f9ba29"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6ed2295a58f8451993a57ce0a6f9ba29"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6ed2295a58f8451993a57ce0a6f9ba29"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6ed2295a58f8451993a57ce0a6f9ba29"}]}] Sep 14 09:01:26.300790 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-ServerDiskConfigTestJSON-1682105394 Sep 14 09:01:26.300790 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 6ed2295a58f8451993a57ce0a6f9ba29 Sep 14 09:01:26.300790 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1682105394 Sep 14 09:01:26.300790 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-ServerDiskConfigTestJSON-1682105394-project Sep 14 09:01:26.300790 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 09:01:26.300790 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 09:01:26.300790 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: dc9d40e54481461cba53fedb9a6abdf8 Sep 14 09:01:26.300790 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-ServerDiskConfigTestJSON-1682105394-project Sep 14 09:01:26.300790 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 09:01:26.300790 n-d-836830-18 devstack@n-api.service[128758]: exception: Instance d0c5547a-1340-4d19-a0f9-3e1eb9fd1932 could not be found. Sep 14 09:01:26.300790 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': 'd0c5547a-1340-4d19-a0f9-3e1eb9fd1932'} Sep 14 09:01:26.300790 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:01:26.300790 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:01:26.300790 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:01:26.300790 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:01:26.300790 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:01:26.300790 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:01:26.300790 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:01:26.300790 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:01:26.300790 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:01:26.300790 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:01:26.300790 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0c5547a-1340-4d19-a0f9-3e1eb9fd1932 could not be found. Sep 14 09:01:26.300790 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:01:26.300790 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:01:26.300790 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:01:26.300790 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:01:26.300790 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:01:26.300790 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:01:26.300790 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:01:26.300790 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:01:26.300790 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:01:26.300790 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:01:26.300790 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 09:01:26.300790 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 09:01:26.300790 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 09:01:26.300790 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 09:01:26.300790 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:01:26.300790 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:01:26.300790 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:01:26.300790 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:01:26.306652 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0c5547a-1340-4d19-a0f9-3e1eb9fd1932 could not be found. Sep 14 09:01:26.306652 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:01:26.306652 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:01:26.306652 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:01:26.306652 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:01:26.306652 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:01:26.306652 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:01:26.306652 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:01:26.306652 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:01:26.306652 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0c5547a-1340-4d19-a0f9-3e1eb9fd1932 could not be found. Sep 14 09:01:26.306652 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:01:26.309600 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ccd19a03-ea7c-4cd7-8c2d-67143af995c2 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Returning 404 to user: Instance d0c5547a-1340-4d19-a0f9-3e1eb9fd1932 could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:01:26.310645 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-ccd19a03-ea7c-4cd7-8c2d-67143af995c2 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] 10.222.0.60 "DELETE /compute/v2.1/servers/d0c5547a-1340-4d19-a0f9-3e1eb9fd1932" status: 404 len: 111 microversion: 2.1 time: 0.057327 Sep 14 09:01:26.314270 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1545/3028] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:01:26 2022] DELETE /compute/v2.1/servers/d0c5547a-1340-4d19-a0f9-3e1eb9fd1932 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:01:26.322743 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-2b173eef-b567-4725-a61a-d92c5f51dd88 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:26.323576 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-2b173eef-b567-4725-a61a-d92c5f51dd88 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] [instance: d0c5547a-1340-4d19-a0f9-3e1eb9fd1932] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:26.336799 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2b173eef-b567-4725-a61a-d92c5f51dd88 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:26.337310 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2b173eef-b567-4725-a61a-d92c5f51dd88 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:26.337993 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2b173eef-b567-4725-a61a-d92c5f51dd88 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:26.338717 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2b173eef-b567-4725-a61a-d92c5f51dd88 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:26.341338 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2b173eef-b567-4725-a61a-d92c5f51dd88 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:26.341892 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2b173eef-b567-4725-a61a-d92c5f51dd88 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:26.366772 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-07f0e7d5-fd75-43ae-84ed-76ac9c0c17dd tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:26.367926 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-07f0e7d5-fd75-43ae-84ed-76ac9c0c17dd tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] [instance: 0eb40c80-c056-4096-a586-7e957a63f7cf] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:26.368402 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-2b173eef-b567-4725-a61a-d92c5f51dd88 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] HTTP exception thrown: Instance d0c5547a-1340-4d19-a0f9-3e1eb9fd1932 could not be found. Sep 14 09:01:26.370233 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-2b173eef-b567-4725-a61a-d92c5f51dd88 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Request method failure captured: Sep 14 09:01:26.370233 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/d0c5547a-1340-4d19-a0f9-3e1eb9fd1932 HTTP/1.1 Sep 14 09:01:26.370233 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:01:26.370233 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:01:26.370233 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:01:26.370233 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:01:26.370233 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:01:26.370233 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:01:26.370233 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:01:26.370233 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:01:26.370233 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZe5AsAh1luinYQkmP4XNea6-A3seq0Ow-Xnx9sBn4d7vYmv6a1FquoMtPgc45IowhphdGhR--RFQTcHwvRjcZQ8emNtaP8vz4RUJxKj3CaT0PyvAl3BS4ydPyuCrv2Xn5jT8sL8yQKEJebneHcjm2fWmImOROsjrIZ_FaJDI-Cr_Yk Sep 14 09:01:26.370233 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:01:26.370233 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:01:26.370233 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:01:26.370233 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:01:26.370233 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:01:26.370233 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:01:26.370233 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 6ed2295a58f8451993a57ce0a6f9ba29 Sep 14 09:01:26.370233 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1682105394 Sep 14 09:01:26.370233 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:01:26.370233 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:01:26.370233 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6ed2295a58f8451993a57ce0a6f9ba29"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6ed2295a58f8451993a57ce0a6f9ba29"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6ed2295a58f8451993a57ce0a6f9ba29"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6ed2295a58f8451993a57ce0a6f9ba29"}]}] Sep 14 09:01:26.370233 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ServerDiskConfigTestJSON-1682105394 Sep 14 09:01:26.370233 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 6ed2295a58f8451993a57ce0a6f9ba29 Sep 14 09:01:26.370233 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1682105394 Sep 14 09:01:26.370233 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ServerDiskConfigTestJSON-1682105394-project Sep 14 09:01:26.370233 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:01:26.370233 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:01:26.370233 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: dc9d40e54481461cba53fedb9a6abdf8 Sep 14 09:01:26.370233 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ServerDiskConfigTestJSON-1682105394-project Sep 14 09:01:26.370233 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:01:26.370233 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance d0c5547a-1340-4d19-a0f9-3e1eb9fd1932 could not be found. Sep 14 09:01:26.370233 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': 'd0c5547a-1340-4d19-a0f9-3e1eb9fd1932'} Sep 14 09:01:26.370233 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:01:26.370233 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:01:26.370233 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:01:26.370233 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:01:26.370233 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:01:26.370233 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:01:26.370233 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:01:26.370233 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:01:26.370233 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:01:26.370233 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:01:26.370233 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0c5547a-1340-4d19-a0f9-3e1eb9fd1932 could not be found. Sep 14 09:01:26.370233 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:01:26.370233 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:01:26.370233 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:01:26.370233 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:01:26.370233 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:01:26.370233 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:01:26.370233 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:01:26.370233 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:01:26.370233 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:01:26.370233 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:01:26.370233 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:01:26.370233 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:01:26.370233 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:01:26.370233 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:01:26.370233 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:01:26.370233 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:01:26.370233 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0c5547a-1340-4d19-a0f9-3e1eb9fd1932 could not be found. Sep 14 09:01:26.370233 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:01:26.370233 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:01:26.370233 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:01:26.375405 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:01:26.375405 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:01:26.375405 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:01:26.375405 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:01:26.375405 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:01:26.375405 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0c5547a-1340-4d19-a0f9-3e1eb9fd1932 could not be found. Sep 14 09:01:26.375405 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:01:26.375405 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-2b173eef-b567-4725-a61a-d92c5f51dd88 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] Returning 404 to user: Instance d0c5547a-1340-4d19-a0f9-3e1eb9fd1932 could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:01:26.375405 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-2b173eef-b567-4725-a61a-d92c5f51dd88 tempest-ServerDiskConfigTestJSON-1682105394 tempest-ServerDiskConfigTestJSON-1682105394-project] 10.222.0.60 "GET /compute/v2.1/servers/d0c5547a-1340-4d19-a0f9-3e1eb9fd1932" status: 404 len: 111 microversion: 2.1 time: 0.053914 Sep 14 09:01:26.375405 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1484/3029] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:01:26 2022] GET /compute/v2.1/servers/d0c5547a-1340-4d19-a0f9-3e1eb9fd1932 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:01:26.383692 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-07f0e7d5-fd75-43ae-84ed-76ac9c0c17dd tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:26.384439 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-07f0e7d5-fd75-43ae-84ed-76ac9c0c17dd tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:26.385389 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-07f0e7d5-fd75-43ae-84ed-76ac9c0c17dd tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:26.388312 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-07f0e7d5-fd75-43ae-84ed-76ac9c0c17dd tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:26.389043 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-07f0e7d5-fd75-43ae-84ed-76ac9c0c17dd tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:26.389666 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-07f0e7d5-fd75-43ae-84ed-76ac9c0c17dd tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:26.551030 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-07f0e7d5-fd75-43ae-84ed-76ac9c0c17dd tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:26.567151 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-07f0e7d5-fd75-43ae-84ed-76ac9c0c17dd tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:26.568646 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-07f0e7d5-fd75-43ae-84ed-76ac9c0c17dd tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:26.580246 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-07f0e7d5-fd75-43ae-84ed-76ac9c0c17dd tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] 10.222.0.60 "GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf" status: 200 len: 1537 microversion: 2.91 time: 0.218209 Sep 14 09:01:26.580877 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1546/3030] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:01:26 2022] GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf => generated 1537 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 09:01:26.675841 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-6bba029d-d9a7-4eea-8be7-2c58f42d262c tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:26.680147 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-6bba029d-d9a7-4eea-8be7-2c58f42d262c tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: 680c3968-8912-45c4-b1c3-634c06ec30c3] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:26.693869 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6bba029d-d9a7-4eea-8be7-2c58f42d262c tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:26.698313 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6bba029d-d9a7-4eea-8be7-2c58f42d262c tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:26.699271 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6bba029d-d9a7-4eea-8be7-2c58f42d262c tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:26.700785 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6bba029d-d9a7-4eea-8be7-2c58f42d262c tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:26.701496 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6bba029d-d9a7-4eea-8be7-2c58f42d262c tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:26.702290 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6bba029d-d9a7-4eea-8be7-2c58f42d262c tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:26.741235 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-f1a67f6c-3829-42f4-8279-a6d3c346e303 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:26.741853 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-f1a67f6c-3829-42f4-8279-a6d3c346e303 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] [instance: 885dfd01-8bac-4691-ad0b-f2218e306f2e] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:26.752935 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f1a67f6c-3829-42f4-8279-a6d3c346e303 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:26.753440 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f1a67f6c-3829-42f4-8279-a6d3c346e303 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:26.754893 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f1a67f6c-3829-42f4-8279-a6d3c346e303 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:26.754893 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f1a67f6c-3829-42f4-8279-a6d3c346e303 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:26.755686 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f1a67f6c-3829-42f4-8279-a6d3c346e303 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:26.755686 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f1a67f6c-3829-42f4-8279-a6d3c346e303 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:27.301228 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-6bba029d-d9a7-4eea-8be7-2c58f42d262c tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:27.310630 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-6bba029d-d9a7-4eea-8be7-2c58f42d262c tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/680c3968-8912-45c4-b1c3-634c06ec30c3" status: 200 len: 1508 microversion: 2.1 time: 0.640592 Sep 14 09:01:27.331035 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1485/3031] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:01:26 2022] GET /compute/v2.1/servers/680c3968-8912-45c4-b1c3-634c06ec30c3 => generated 1508 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:01:27.341265 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3923f251-6f11-496f-a353-c75f4efe46fa tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Calling method '.version_select at 0x7f7d486cde50>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:27.393637 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-f1a67f6c-3829-42f4-8279-a6d3c346e303 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ab7166e40e4a908eefbfb03b3b8804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de82b83dadd541dbb4a939f2fc04a163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:27.409234 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-f1a67f6c-3829-42f4-8279-a6d3c346e303 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] 10.222.0.60 "GET /compute/v2.1/servers/885dfd01-8bac-4691-ad0b-f2218e306f2e" status: 200 len: 1682 microversion: 2.1 time: 0.671698 Sep 14 09:01:27.435101 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1547/3032] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:01:26 2022] GET /compute/v2.1/servers/885dfd01-8bac-4691-ad0b-f2218e306f2e => generated 1682 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:01:27.440544 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-3923f251-6f11-496f-a353-c75f4efe46fa tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] 10.222.0.60 "GET /compute/v2.1/images/be62d386-20a6-4610-9cf3-1a1a7817aac8" status: 200 len: 1453 microversion: 2.1 time: 0.108062 Sep 14 09:01:27.441132 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1486/3033] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:01:27 2022] GET /compute/v2.1/images/be62d386-20a6-4610-9cf3-1a1a7817aac8 => generated 1453 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:01:27.448592 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-70a370a3-7a23-4724-9645-b5c09e90cf70 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:27.449226 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-70a370a3-7a23-4724-9645-b5c09e90cf70 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] [instance: 59f196e8-c202-4073-8663-2ae19358a044] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:27.457576 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-70a370a3-7a23-4724-9645-b5c09e90cf70 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:27.458076 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-70a370a3-7a23-4724-9645-b5c09e90cf70 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:27.459125 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-70a370a3-7a23-4724-9645-b5c09e90cf70 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:27.459916 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-70a370a3-7a23-4724-9645-b5c09e90cf70 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:27.460385 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-70a370a3-7a23-4724-9645-b5c09e90cf70 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:27.460820 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-70a370a3-7a23-4724-9645-b5c09e90cf70 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:27.588112 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-70a370a3-7a23-4724-9645-b5c09e90cf70 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:27.601262 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-70a370a3-7a23-4724-9645-b5c09e90cf70 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:27.602748 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-70a370a3-7a23-4724-9645-b5c09e90cf70 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:27.604088 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-70a370a3-7a23-4724-9645-b5c09e90cf70 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] 10.222.0.60 "GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044" status: 200 len: 1602 microversion: 2.42 time: 0.167667 Sep 14 09:01:27.604802 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1548/3034] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:01:27 2022] GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044 => generated 1602 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:01:27.612303 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-0eb801e8-1bee-4e9d-9c51-ffc06f1462c0 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:27.613124 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-0eb801e8-1bee-4e9d-9c51-ffc06f1462c0 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] [instance: 0eb40c80-c056-4096-a586-7e957a63f7cf] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:27.625536 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0eb801e8-1bee-4e9d-9c51-ffc06f1462c0 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:27.626044 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0eb801e8-1bee-4e9d-9c51-ffc06f1462c0 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:27.626488 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0eb801e8-1bee-4e9d-9c51-ffc06f1462c0 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:27.627247 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0eb801e8-1bee-4e9d-9c51-ffc06f1462c0 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:27.629202 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0eb801e8-1bee-4e9d-9c51-ffc06f1462c0 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:27.629642 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0eb801e8-1bee-4e9d-9c51-ffc06f1462c0 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:27.738391 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-0eb801e8-1bee-4e9d-9c51-ffc06f1462c0 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:27.751693 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-0eb801e8-1bee-4e9d-9c51-ffc06f1462c0 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:27.760182 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-0eb801e8-1bee-4e9d-9c51-ffc06f1462c0 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:27.778477 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-0eb801e8-1bee-4e9d-9c51-ffc06f1462c0 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] 10.222.0.60 "GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf" status: 200 len: 1537 microversion: 2.91 time: 0.169564 Sep 14 09:01:27.779646 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1487/3035] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:01:27 2022] GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf => generated 1537 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:01:28.338080 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-57c23dc6-38da-4704-9abe-4b6d6d6499d1 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:28.338805 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-57c23dc6-38da-4704-9abe-4b6d6d6499d1 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: 680c3968-8912-45c4-b1c3-634c06ec30c3] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:28.357373 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-57c23dc6-38da-4704-9abe-4b6d6d6499d1 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:28.358186 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-57c23dc6-38da-4704-9abe-4b6d6d6499d1 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:28.358775 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-57c23dc6-38da-4704-9abe-4b6d6d6499d1 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:28.359771 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-57c23dc6-38da-4704-9abe-4b6d6d6499d1 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:28.360382 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-57c23dc6-38da-4704-9abe-4b6d6d6499d1 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:28.360996 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-57c23dc6-38da-4704-9abe-4b6d6d6499d1 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:28.435875 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c989634d-0c8d-4827-9f97-7b3e1fd031bf tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:28.436755 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-c989634d-0c8d-4827-9f97-7b3e1fd031bf tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] [instance: 885dfd01-8bac-4691-ad0b-f2218e306f2e] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:28.451576 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c989634d-0c8d-4827-9f97-7b3e1fd031bf tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:28.452317 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c989634d-0c8d-4827-9f97-7b3e1fd031bf tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:28.454733 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c989634d-0c8d-4827-9f97-7b3e1fd031bf tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:28.455678 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c989634d-0c8d-4827-9f97-7b3e1fd031bf tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:28.457687 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c989634d-0c8d-4827-9f97-7b3e1fd031bf tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:28.458288 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c989634d-0c8d-4827-9f97-7b3e1fd031bf tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:28.878855 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-c989634d-0c8d-4827-9f97-7b3e1fd031bf tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ab7166e40e4a908eefbfb03b3b8804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de82b83dadd541dbb4a939f2fc04a163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:28.891325 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-c989634d-0c8d-4827-9f97-7b3e1fd031bf tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] 10.222.0.60 "GET /compute/v2.1/servers/885dfd01-8bac-4691-ad0b-f2218e306f2e" status: 200 len: 1682 microversion: 2.1 time: 0.460029 Sep 14 09:01:28.903307 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1488/3036] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:01:28 2022] GET /compute/v2.1/servers/885dfd01-8bac-4691-ad0b-f2218e306f2e => generated 1682 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:01:28.909152 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-32881c79-e770-40f1-952a-0a4eef35f5f5 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Calling method '.version_select at 0x7f7d48756040>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:28.973025 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-32881c79-e770-40f1-952a-0a4eef35f5f5 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] 10.222.0.60 "GET /compute/v2.1/images/be62d386-20a6-4610-9cf3-1a1a7817aac8" status: 200 len: 1453 microversion: 2.1 time: 0.068216 Sep 14 09:01:28.976572 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1489/3037] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:01:28 2022] GET /compute/v2.1/images/be62d386-20a6-4610-9cf3-1a1a7817aac8 => generated 1453 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:01:28.987189 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f5988fcb-75df-4397-b918-9420dd7cce9e tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:28.989016 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f5988fcb-75df-4397-b918-9420dd7cce9e tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] [instance: 59f196e8-c202-4073-8663-2ae19358a044] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:28.999457 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f5988fcb-75df-4397-b918-9420dd7cce9e tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:29.000941 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f5988fcb-75df-4397-b918-9420dd7cce9e tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:29.002165 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f5988fcb-75df-4397-b918-9420dd7cce9e tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:29.003136 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f5988fcb-75df-4397-b918-9420dd7cce9e tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:29.004341 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f5988fcb-75df-4397-b918-9420dd7cce9e tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:29.005618 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f5988fcb-75df-4397-b918-9420dd7cce9e tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:29.129435 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-57c23dc6-38da-4704-9abe-4b6d6d6499d1 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:29.148209 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-57c23dc6-38da-4704-9abe-4b6d6d6499d1 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/680c3968-8912-45c4-b1c3-634c06ec30c3" status: 200 len: 1508 microversion: 2.1 time: 0.814204 Sep 14 09:01:29.149437 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1549/3038] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:01:28 2022] GET /compute/v2.1/servers/680c3968-8912-45c4-b1c3-634c06ec30c3 => generated 1508 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:01:29.154812 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-018fe47f-e21c-4f4b-aa64-a37429ecacee tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:29.158865 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-018fe47f-e21c-4f4b-aa64-a37429ecacee tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] [instance: 0eb40c80-c056-4096-a586-7e957a63f7cf] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:29.169174 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f5988fcb-75df-4397-b918-9420dd7cce9e tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:29.175862 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-018fe47f-e21c-4f4b-aa64-a37429ecacee tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:29.176640 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-018fe47f-e21c-4f4b-aa64-a37429ecacee tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:29.177287 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-018fe47f-e21c-4f4b-aa64-a37429ecacee tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:29.178032 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-018fe47f-e21c-4f4b-aa64-a37429ecacee tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:29.178663 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-018fe47f-e21c-4f4b-aa64-a37429ecacee tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:29.179306 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-018fe47f-e21c-4f4b-aa64-a37429ecacee tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:29.183450 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f5988fcb-75df-4397-b918-9420dd7cce9e tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:29.187849 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f5988fcb-75df-4397-b918-9420dd7cce9e tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:29.195443 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f5988fcb-75df-4397-b918-9420dd7cce9e tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] 10.222.0.60 "GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044" status: 200 len: 1602 microversion: 2.42 time: 0.217758 Sep 14 09:01:29.196590 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1490/3039] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:01:28 2022] GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044 => generated 1602 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:01:29.344820 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-018fe47f-e21c-4f4b-aa64-a37429ecacee tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:29.358438 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-018fe47f-e21c-4f4b-aa64-a37429ecacee tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:29.362756 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-018fe47f-e21c-4f4b-aa64-a37429ecacee tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:29.370126 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-018fe47f-e21c-4f4b-aa64-a37429ecacee tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] 10.222.0.60 "GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf" status: 200 len: 1537 microversion: 2.91 time: 0.219429 Sep 14 09:01:29.371710 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1550/3040] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:01:29 2022] GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf => generated 1537 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:01:29.792409 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-4dea758c-7a95-491e-8e97-72b0464ea367 req-c3c83eec-e082-4159-9b5e-3fa78f29c89f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "885dfd01-8bac-4691-ad0b-f2218e306f2e", "name": "network-vif-deleted", "tag": "7a58cd39-a33e-4a69-ac2a-b45bd18e6b98"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:01:29.818014 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-4dea758c-7a95-491e-8e97-72b0464ea367 req-c3c83eec-e082-4159-9b5e-3fa78f29c89f service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:29.818488 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-4dea758c-7a95-491e-8e97-72b0464ea367 req-c3c83eec-e082-4159-9b5e-3fa78f29c89f service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:29.818921 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-4dea758c-7a95-491e-8e97-72b0464ea367 req-c3c83eec-e082-4159-9b5e-3fa78f29c89f service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:29.845489 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-4dea758c-7a95-491e-8e97-72b0464ea367 req-c3c83eec-e082-4159-9b5e-3fa78f29c89f service nova] Creating event network-vif-deleted:7a58cd39-a33e-4a69-ac2a-b45bd18e6b98 for instance 885dfd01-8bac-4691-ad0b-f2218e306f2e on n-h1-836830-18 Sep 14 09:01:29.876897 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-4dea758c-7a95-491e-8e97-72b0464ea367 req-c3c83eec-e082-4159-9b5e-3fa78f29c89f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088169 Sep 14 09:01:29.881596 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1491/3041] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:01:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:01:29.921249 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-e6c4f633-a54a-487d-940b-9a963198be9f tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:29.921893 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-e6c4f633-a54a-487d-940b-9a963198be9f tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] [instance: 885dfd01-8bac-4691-ad0b-f2218e306f2e] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:29.942380 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e6c4f633-a54a-487d-940b-9a963198be9f tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:29.944985 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e6c4f633-a54a-487d-940b-9a963198be9f tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:29.950319 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e6c4f633-a54a-487d-940b-9a963198be9f tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:29.952326 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e6c4f633-a54a-487d-940b-9a963198be9f tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:29.952827 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e6c4f633-a54a-487d-940b-9a963198be9f tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:29.953275 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e6c4f633-a54a-487d-940b-9a963198be9f tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:29.991991 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8731df7e-9a1e-4fc1-929a-06dedeb10e0f tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Calling method '.version_select at 0x7f7d487743a0>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:30.116234 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-8731df7e-9a1e-4fc1-929a-06dedeb10e0f tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] 10.222.0.60 "GET /compute/v2.1/images/be62d386-20a6-4610-9cf3-1a1a7817aac8" status: 200 len: 1453 microversion: 2.1 time: 0.128536 Sep 14 09:01:30.116834 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1492/3042] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:01:29 2022] GET /compute/v2.1/images/be62d386-20a6-4610-9cf3-1a1a7817aac8 => generated 1453 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:01:30.152146 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e6c4f633-a54a-487d-940b-9a963198be9f tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:30.160238 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e6c4f633-a54a-487d-940b-9a963198be9f tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:30.165669 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e6c4f633-a54a-487d-940b-9a963198be9f tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:30.177739 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e21efad5-5f61-4937-93e6-618d61f20323 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:30.178787 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e21efad5-5f61-4937-93e6-618d61f20323 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: 680c3968-8912-45c4-b1c3-634c06ec30c3] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:30.179664 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.objects.instance [None req-e6c4f633-a54a-487d-940b-9a963198be9f tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lazy-loading 'fault' on Instance uuid 885dfd01-8bac-4691-ad0b-f2218e306f2e {{(pid=128758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:01:30.187608 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e21efad5-5f61-4937-93e6-618d61f20323 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:30.188103 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e21efad5-5f61-4937-93e6-618d61f20323 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:30.188550 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e21efad5-5f61-4937-93e6-618d61f20323 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:30.189266 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e21efad5-5f61-4937-93e6-618d61f20323 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:30.189725 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e21efad5-5f61-4937-93e6-618d61f20323 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:30.190163 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e21efad5-5f61-4937-93e6-618d61f20323 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:30.260217 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-e6c4f633-a54a-487d-940b-9a963198be9f tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ab7166e40e4a908eefbfb03b3b8804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de82b83dadd541dbb4a939f2fc04a163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:30.278364 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-e6c4f633-a54a-487d-940b-9a963198be9f tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] 10.222.0.60 "GET /compute/v2.1/servers/885dfd01-8bac-4691-ad0b-f2218e306f2e" status: 200 len: 1331 microversion: 2.1 time: 0.363147 Sep 14 09:01:30.278998 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1551/3043] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:01:29 2022] GET /compute/v2.1/servers/885dfd01-8bac-4691-ad0b-f2218e306f2e => generated 1331 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:01:30.300159 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-3ef97c05-9ecd-4d27-aafc-d99d32a9f9fa tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:30.300884 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-3ef97c05-9ecd-4d27-aafc-d99d32a9f9fa tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] [instance: 59f196e8-c202-4073-8663-2ae19358a044] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:30.314834 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3ef97c05-9ecd-4d27-aafc-d99d32a9f9fa tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:30.315643 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3ef97c05-9ecd-4d27-aafc-d99d32a9f9fa tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:30.316271 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3ef97c05-9ecd-4d27-aafc-d99d32a9f9fa tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:30.318312 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3ef97c05-9ecd-4d27-aafc-d99d32a9f9fa tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:30.318537 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3ef97c05-9ecd-4d27-aafc-d99d32a9f9fa tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:30.320741 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3ef97c05-9ecd-4d27-aafc-d99d32a9f9fa tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:30.976279 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-3ef97c05-9ecd-4d27-aafc-d99d32a9f9fa tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:30.992080 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-3ef97c05-9ecd-4d27-aafc-d99d32a9f9fa tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:30.994479 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-3ef97c05-9ecd-4d27-aafc-d99d32a9f9fa tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:30.995760 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-3ef97c05-9ecd-4d27-aafc-d99d32a9f9fa tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] 10.222.0.60 "GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044" status: 200 len: 1602 microversion: 2.42 time: 0.715803 Sep 14 09:01:31.013865 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1552/3044] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:01:30 2022] GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044 => generated 1602 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:01:31.027062 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1b6d0141-f901-4e91-80d7-030a873d7894 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:31.028363 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-1b6d0141-f901-4e91-80d7-030a873d7894 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] [instance: 0eb40c80-c056-4096-a586-7e957a63f7cf] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:31.036725 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1b6d0141-f901-4e91-80d7-030a873d7894 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:31.037241 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1b6d0141-f901-4e91-80d7-030a873d7894 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:31.037685 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1b6d0141-f901-4e91-80d7-030a873d7894 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:31.038427 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1b6d0141-f901-4e91-80d7-030a873d7894 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:31.038926 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1b6d0141-f901-4e91-80d7-030a873d7894 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:31.039339 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1b6d0141-f901-4e91-80d7-030a873d7894 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:31.042611 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-e21efad5-5f61-4937-93e6-618d61f20323 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:31.052808 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e21efad5-5f61-4937-93e6-618d61f20323 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/680c3968-8912-45c4-b1c3-634c06ec30c3" status: 200 len: 1508 microversion: 2.1 time: 0.879480 Sep 14 09:01:31.054127 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1493/3045] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:01:30 2022] GET /compute/v2.1/servers/680c3968-8912-45c4-b1c3-634c06ec30c3 => generated 1508 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:01:31.133424 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-41f40b56-0776-4b3f-8581-7d51ecb26f55 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Calling method '.version_select at 0x7f7d486cdb80>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:31.263431 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-41f40b56-0776-4b3f-8581-7d51ecb26f55 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] 10.222.0.60 "GET /compute/v2.1/images/be62d386-20a6-4610-9cf3-1a1a7817aac8" status: 200 len: 1453 microversion: 2.1 time: 0.134547 Sep 14 09:01:31.264365 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1494/3046] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:01:31 2022] GET /compute/v2.1/images/be62d386-20a6-4610-9cf3-1a1a7817aac8 => generated 1453 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:01:31.299991 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-1b6d0141-f901-4e91-80d7-030a873d7894 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:31.301924 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b547925b-fe26-499c-bfbb-f8bb3dd9ed1c tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:31.303105 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b547925b-fe26-499c-bfbb-f8bb3dd9ed1c tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] [instance: 885dfd01-8bac-4691-ad0b-f2218e306f2e] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:31.318290 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b547925b-fe26-499c-bfbb-f8bb3dd9ed1c tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:31.319164 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b547925b-fe26-499c-bfbb-f8bb3dd9ed1c tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:31.319876 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b547925b-fe26-499c-bfbb-f8bb3dd9ed1c tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:31.320408 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-1b6d0141-f901-4e91-80d7-030a873d7894 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:31.321420 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b547925b-fe26-499c-bfbb-f8bb3dd9ed1c tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:31.322846 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b547925b-fe26-499c-bfbb-f8bb3dd9ed1c tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:31.324027 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b547925b-fe26-499c-bfbb-f8bb3dd9ed1c tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:31.326756 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-1b6d0141-f901-4e91-80d7-030a873d7894 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:31.337532 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-1b6d0141-f901-4e91-80d7-030a873d7894 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] 10.222.0.60 "GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf" status: 200 len: 1537 microversion: 2.91 time: 0.316499 Sep 14 09:01:31.376407 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1553/3047] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:01:31 2022] GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf => generated 1537 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:01:31.397629 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-b547925b-fe26-499c-bfbb-f8bb3dd9ed1c tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] HTTP exception thrown: Instance 885dfd01-8bac-4691-ad0b-f2218e306f2e could not be found. Sep 14 09:01:31.399817 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b547925b-fe26-499c-bfbb-f8bb3dd9ed1c tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Request method failure captured: Sep 14 09:01:31.399817 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/885dfd01-8bac-4691-ad0b-f2218e306f2e HTTP/1.1 Sep 14 09:01:31.399817 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:01:31.399817 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:01:31.399817 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:01:31.399817 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:01:31.399817 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:01:31.399817 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:01:31.399817 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:01:31.399817 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:01:31.399817 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZekVbrtTCxL8KnTZmK9ZKFf6nUDFZO1zszEyl6k0IKZmICsv51WS6EiH7r4ARtcipTF7VD1WyEbUm0J1Prk5N83y_ZIrsxG_Z7HuBRIpZlzFOomZKRVbY8MALc9EunD-F2FdXNCLv5rlqjmwYcCHaEIh54nCJT_zAvCnYZkJmnrwW0 Sep 14 09:01:31.399817 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:01:31.399817 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:01:31.399817 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:01:31.399817 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:01:31.399817 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:01:31.399817 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:01:31.399817 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: de82b83dadd541dbb4a939f2fc04a163 Sep 14 09:01:31.399817 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-VolumesAdminNegativeTest-1796847268 Sep 14 09:01:31.399817 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:01:31.399817 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:01:31.399817 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/de82b83dadd541dbb4a939f2fc04a163"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_de82b83dadd541dbb4a939f2fc04a163"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/de82b83dadd541dbb4a939f2fc04a163"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/de82b83dadd541dbb4a939f2fc04a163"}]}] Sep 14 09:01:31.399817 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-VolumesAdminNegativeTest-1796847268 Sep 14 09:01:31.399817 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: de82b83dadd541dbb4a939f2fc04a163 Sep 14 09:01:31.399817 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1796847268 Sep 14 09:01:31.399817 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-VolumesAdminNegativeTest-1796847268-project Sep 14 09:01:31.399817 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:01:31.399817 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:01:31.399817 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 93ab7166e40e4a908eefbfb03b3b8804 Sep 14 09:01:31.399817 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-VolumesAdminNegativeTest-1796847268-project Sep 14 09:01:31.399817 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:01:31.399817 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance 885dfd01-8bac-4691-ad0b-f2218e306f2e could not be found. Sep 14 09:01:31.399817 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '885dfd01-8bac-4691-ad0b-f2218e306f2e'} Sep 14 09:01:31.399817 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:01:31.399817 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:01:31.399817 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:01:31.399817 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:01:31.399817 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:01:31.399817 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:01:31.399817 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:01:31.399817 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:01:31.399817 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:01:31.399817 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:01:31.399817 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 885dfd01-8bac-4691-ad0b-f2218e306f2e could not be found. Sep 14 09:01:31.399817 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:01:31.399817 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:01:31.399817 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:01:31.399817 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:01:31.399817 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:01:31.399817 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:01:31.399817 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:01:31.399817 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:01:31.399817 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:01:31.399817 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:01:31.399817 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:01:31.399817 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:01:31.399817 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:01:31.399817 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:01:31.399817 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:01:31.399817 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:01:31.399817 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 885dfd01-8bac-4691-ad0b-f2218e306f2e could not be found. Sep 14 09:01:31.399817 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:01:31.399817 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:01:31.399817 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:01:31.404148 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:01:31.404148 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:01:31.404148 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:01:31.404148 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:01:31.404148 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:01:31.404148 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 885dfd01-8bac-4691-ad0b-f2218e306f2e could not be found. Sep 14 09:01:31.404148 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:01:31.404148 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b547925b-fe26-499c-bfbb-f8bb3dd9ed1c tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Returning 404 to user: Instance 885dfd01-8bac-4691-ad0b-f2218e306f2e could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:01:31.408596 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b547925b-fe26-499c-bfbb-f8bb3dd9ed1c tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] 10.222.0.60 "GET /compute/v2.1/servers/885dfd01-8bac-4691-ad0b-f2218e306f2e" status: 404 len: 111 microversion: 2.1 time: 0.103455 Sep 14 09:01:31.409244 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1495/3048] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:01:31 2022] GET /compute/v2.1/servers/885dfd01-8bac-4691-ad0b-f2218e306f2e => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 14 09:01:31.417594 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-71099409-9189-45f4-9b34-d448306658a3 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] Calling method '.version_select at 0x7f7d44509d30>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:31.440205 n-d-836830-18 devstack@n-api.service[128758]: ERROR oslo.messaging._drivers.impl_rabbit [None req-71099409-9189-45f4-9b34-d448306658a3 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] [9c307738-a09e-46fc-a558-c2b092a37ed4] AMQP server on 10.222.0.60:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 14 09:01:32.027473 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a813a7be-205e-4b0d-9ee5-4eaf7b305113 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:32.028294 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-a813a7be-205e-4b0d-9ee5-4eaf7b305113 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] [instance: 59f196e8-c202-4073-8663-2ae19358a044] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:32.041811 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a813a7be-205e-4b0d-9ee5-4eaf7b305113 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:32.048042 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a813a7be-205e-4b0d-9ee5-4eaf7b305113 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:32.048661 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a813a7be-205e-4b0d-9ee5-4eaf7b305113 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:32.050653 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a813a7be-205e-4b0d-9ee5-4eaf7b305113 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:32.051221 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a813a7be-205e-4b0d-9ee5-4eaf7b305113 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:32.053003 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a813a7be-205e-4b0d-9ee5-4eaf7b305113 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:32.233381 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-a813a7be-205e-4b0d-9ee5-4eaf7b305113 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:32.267025 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-a813a7be-205e-4b0d-9ee5-4eaf7b305113 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:32.268598 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-a813a7be-205e-4b0d-9ee5-4eaf7b305113 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:32.270753 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a813a7be-205e-4b0d-9ee5-4eaf7b305113 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] 10.222.0.60 "GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044" status: 200 len: 1602 microversion: 2.42 time: 0.247545 Sep 14 09:01:32.285265 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1496/3049] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:01:32 2022] GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044 => generated 1602 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 09:01:32.300576 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b2bd9762-c601-4b87-909e-b91be136cc23 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:32.301480 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b2bd9762-c601-4b87-909e-b91be136cc23 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: 680c3968-8912-45c4-b1c3-634c06ec30c3] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:32.309781 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b2bd9762-c601-4b87-909e-b91be136cc23 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:32.310284 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b2bd9762-c601-4b87-909e-b91be136cc23 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:32.310728 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b2bd9762-c601-4b87-909e-b91be136cc23 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:32.311766 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b2bd9762-c601-4b87-909e-b91be136cc23 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:32.312229 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b2bd9762-c601-4b87-909e-b91be136cc23 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:32.312662 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b2bd9762-c601-4b87-909e-b91be136cc23 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:32.490422 n-d-836830-18 devstack@n-api.service[128758]: INFO oslo.messaging._drivers.impl_rabbit [None req-71099409-9189-45f4-9b34-d448306658a3 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] [9c307738-a09e-46fc-a558-c2b092a37ed4] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 56892. Sep 14 09:01:32.506824 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b2bd9762-c601-4b87-909e-b91be136cc23 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:32.509790 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=100 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:01:32.519499 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b2bd9762-c601-4b87-909e-b91be136cc23 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/680c3968-8912-45c4-b1c3-634c06ec30c3" status: 200 len: 1508 microversion: 2.1 time: 0.232876 Sep 14 09:01:32.521274 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1497/3050] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:01:32 2022] GET /compute/v2.1/servers/680c3968-8912-45c4-b1c3-634c06ec30c3 => generated 1508 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:01:32.527038 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-613905d7-34e4-484f-b0c7-4bc76ec6246f tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Calling method '.version_select at 0x7f7d48766940>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:32.583684 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-71099409-9189-45f4-9b34-d448306658a3 tempest-VolumesAdminNegativeTest-1796847268 tempest-VolumesAdminNegativeTest-1796847268-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1474730964" status: 202 len: 0 microversion: 2.1 time: 1.169838 Sep 14 09:01:32.585886 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1554/3051] 10.222.0.60 () {58 vars in 1221 bytes} [Wed Sep 14 09:01:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1474730964 => generated 0 bytes in 1173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 14 09:01:32.592987 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d566465b-c2a9-4045-a4a4-b13173c2aac8 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:32.593835 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-d566465b-c2a9-4045-a4a4-b13173c2aac8 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] [instance: 0eb40c80-c056-4096-a586-7e957a63f7cf] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:32.603666 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d566465b-c2a9-4045-a4a4-b13173c2aac8 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:32.605573 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d566465b-c2a9-4045-a4a4-b13173c2aac8 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:32.606265 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d566465b-c2a9-4045-a4a4-b13173c2aac8 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:32.607752 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d566465b-c2a9-4045-a4a4-b13173c2aac8 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:32.608454 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d566465b-c2a9-4045-a4a4-b13173c2aac8 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:32.609054 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d566465b-c2a9-4045-a4a4-b13173c2aac8 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:32.660883 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-613905d7-34e4-484f-b0c7-4bc76ec6246f tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] 10.222.0.60 "GET /compute/v2.1/images/be62d386-20a6-4610-9cf3-1a1a7817aac8" status: 200 len: 1453 microversion: 2.1 time: 0.138011 Sep 14 09:01:32.661962 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1498/3052] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:01:32 2022] GET /compute/v2.1/images/be62d386-20a6-4610-9cf3-1a1a7817aac8 => generated 1453 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:01:32.721693 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-d566465b-c2a9-4045-a4a4-b13173c2aac8 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:32.731715 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-d566465b-c2a9-4045-a4a4-b13173c2aac8 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:32.735690 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-d566465b-c2a9-4045-a4a4-b13173c2aac8 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:32.750738 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-d566465b-c2a9-4045-a4a4-b13173c2aac8 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] 10.222.0.60 "GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf" status: 200 len: 1537 microversion: 2.91 time: 0.162502 Sep 14 09:01:32.751955 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1555/3053] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:01:32 2022] GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf => generated 1537 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:01:33.304158 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8886ceb3-1051-4df3-ac6c-acb637b5d05c tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:33.304958 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-8886ceb3-1051-4df3-ac6c-acb637b5d05c tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] [instance: 59f196e8-c202-4073-8663-2ae19358a044] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:33.321328 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8886ceb3-1051-4df3-ac6c-acb637b5d05c tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:33.321893 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8886ceb3-1051-4df3-ac6c-acb637b5d05c tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:33.322350 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8886ceb3-1051-4df3-ac6c-acb637b5d05c tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:33.323424 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8886ceb3-1051-4df3-ac6c-acb637b5d05c tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:33.324134 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8886ceb3-1051-4df3-ac6c-acb637b5d05c tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:33.327882 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8886ceb3-1051-4df3-ac6c-acb637b5d05c tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:33.507949 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-8886ceb3-1051-4df3-ac6c-acb637b5d05c tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:33.518121 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-8886ceb3-1051-4df3-ac6c-acb637b5d05c tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:33.520268 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-8886ceb3-1051-4df3-ac6c-acb637b5d05c tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:33.522213 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-8886ceb3-1051-4df3-ac6c-acb637b5d05c tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] 10.222.0.60 "GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044" status: 200 len: 1602 microversion: 2.42 time: 0.223405 Sep 14 09:01:33.522794 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1499/3054] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:01:33 2022] GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044 => generated 1602 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:01:33.558522 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-4d1e7bb9-b102-474b-b55e-145c18542c81 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:33.562270 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-4d1e7bb9-b102-474b-b55e-145c18542c81 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: 680c3968-8912-45c4-b1c3-634c06ec30c3] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:33.572564 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4d1e7bb9-b102-474b-b55e-145c18542c81 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:33.573342 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4d1e7bb9-b102-474b-b55e-145c18542c81 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:33.582587 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4d1e7bb9-b102-474b-b55e-145c18542c81 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:33.583920 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4d1e7bb9-b102-474b-b55e-145c18542c81 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:33.585960 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4d1e7bb9-b102-474b-b55e-145c18542c81 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:33.588013 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4d1e7bb9-b102-474b-b55e-145c18542c81 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:33.599982 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:01:33.689209 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b798d558-c8fd-4be4-b38b-defc9f3667c1 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Calling method '.version_select at 0x7f7d487669d0>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:33.819194 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b798d558-c8fd-4be4-b38b-defc9f3667c1 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] 10.222.0.60 "GET /compute/v2.1/images/be62d386-20a6-4610-9cf3-1a1a7817aac8" status: 200 len: 1453 microversion: 2.1 time: 0.145787 Sep 14 09:01:33.820139 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1500/3055] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:01:33 2022] GET /compute/v2.1/images/be62d386-20a6-4610-9cf3-1a1a7817aac8 => generated 1453 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:01:33.851568 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-143d40d4-b295-4cbb-bae4-d3d0c555f4d2 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:33.852811 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-143d40d4-b295-4cbb-bae4-d3d0c555f4d2 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] [instance: 0eb40c80-c056-4096-a586-7e957a63f7cf] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:33.861826 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-143d40d4-b295-4cbb-bae4-d3d0c555f4d2 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:33.863472 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-143d40d4-b295-4cbb-bae4-d3d0c555f4d2 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:33.864202 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-143d40d4-b295-4cbb-bae4-d3d0c555f4d2 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:33.865345 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-143d40d4-b295-4cbb-bae4-d3d0c555f4d2 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:33.866469 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-143d40d4-b295-4cbb-bae4-d3d0c555f4d2 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:33.867328 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-143d40d4-b295-4cbb-bae4-d3d0c555f4d2 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:34.144340 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-4d1e7bb9-b102-474b-b55e-145c18542c81 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:34.167443 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-4d1e7bb9-b102-474b-b55e-145c18542c81 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/680c3968-8912-45c4-b1c3-634c06ec30c3" status: 200 len: 1508 microversion: 2.1 time: 0.605271 Sep 14 09:01:34.170173 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1556/3056] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:01:33 2022] GET /compute/v2.1/servers/680c3968-8912-45c4-b1c3-634c06ec30c3 => generated 1508 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:01:34.175038 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-143d40d4-b295-4cbb-bae4-d3d0c555f4d2 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:34.187636 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-143d40d4-b295-4cbb-bae4-d3d0c555f4d2 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:34.191288 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-143d40d4-b295-4cbb-bae4-d3d0c555f4d2 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:34.204660 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-143d40d4-b295-4cbb-bae4-d3d0c555f4d2 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] 10.222.0.60 "GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf" status: 200 len: 1537 microversion: 2.91 time: 0.382374 Sep 14 09:01:34.208028 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1501/3057] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:01:33 2022] GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf => generated 1537 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:01:34.558114 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d5da24d5-759e-4099-ae65-0c918850be72 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:34.559343 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-d5da24d5-759e-4099-ae65-0c918850be72 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] [instance: 59f196e8-c202-4073-8663-2ae19358a044] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:34.569327 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d5da24d5-759e-4099-ae65-0c918850be72 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:34.569825 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d5da24d5-759e-4099-ae65-0c918850be72 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:34.570262 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d5da24d5-759e-4099-ae65-0c918850be72 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:34.571011 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d5da24d5-759e-4099-ae65-0c918850be72 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:34.571506 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d5da24d5-759e-4099-ae65-0c918850be72 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:34.571935 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d5da24d5-759e-4099-ae65-0c918850be72 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:34.736634 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-d5da24d5-759e-4099-ae65-0c918850be72 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:34.750775 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-d5da24d5-759e-4099-ae65-0c918850be72 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:34.757545 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-d5da24d5-759e-4099-ae65-0c918850be72 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:34.763832 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-d5da24d5-759e-4099-ae65-0c918850be72 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] 10.222.0.60 "GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044" status: 200 len: 1602 microversion: 2.42 time: 0.215453 Sep 14 09:01:34.771102 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1557/3058] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:01:34 2022] GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044 => generated 1602 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:01:34.835619 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-da080bdb-60bb-42d3-9b70-d9565536d929 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Calling method '.version_select at 0x7f7d487f2430>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:34.955944 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-da080bdb-60bb-42d3-9b70-d9565536d929 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] 10.222.0.60 "GET /compute/v2.1/images/be62d386-20a6-4610-9cf3-1a1a7817aac8" status: 200 len: 1453 microversion: 2.1 time: 0.124286 Sep 14 09:01:34.956528 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1502/3059] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:01:34 2022] GET /compute/v2.1/images/be62d386-20a6-4610-9cf3-1a1a7817aac8 => generated 1453 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:01:35.197989 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-7336378b-a4ee-4cd7-80dd-be932f6722ca tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:35.198894 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-7336378b-a4ee-4cd7-80dd-be932f6722ca tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: 680c3968-8912-45c4-b1c3-634c06ec30c3] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:35.218381 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7336378b-a4ee-4cd7-80dd-be932f6722ca tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:35.219576 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7336378b-a4ee-4cd7-80dd-be932f6722ca tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:35.225392 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7336378b-a4ee-4cd7-80dd-be932f6722ca tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:35.227646 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7336378b-a4ee-4cd7-80dd-be932f6722ca tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:35.230191 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7336378b-a4ee-4cd7-80dd-be932f6722ca tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:35.234966 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7336378b-a4ee-4cd7-80dd-be932f6722ca tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:35.240697 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-99c7b823-4996-4487-ad1b-279b353a1a7d tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:35.241320 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-99c7b823-4996-4487-ad1b-279b353a1a7d tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] [instance: 0eb40c80-c056-4096-a586-7e957a63f7cf] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:35.255861 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-99c7b823-4996-4487-ad1b-279b353a1a7d tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:35.255861 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-99c7b823-4996-4487-ad1b-279b353a1a7d tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:35.255861 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-99c7b823-4996-4487-ad1b-279b353a1a7d tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:35.256630 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-99c7b823-4996-4487-ad1b-279b353a1a7d tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:35.257103 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-99c7b823-4996-4487-ad1b-279b353a1a7d tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:35.257539 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-99c7b823-4996-4487-ad1b-279b353a1a7d tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:35.385056 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-99c7b823-4996-4487-ad1b-279b353a1a7d tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:35.395555 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-99c7b823-4996-4487-ad1b-279b353a1a7d tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:35.397483 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-99c7b823-4996-4487-ad1b-279b353a1a7d tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:35.404676 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-99c7b823-4996-4487-ad1b-279b353a1a7d tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] 10.222.0.60 "GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf" status: 200 len: 1537 microversion: 2.91 time: 0.167793 Sep 14 09:01:35.415386 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1503/3060] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:01:35 2022] GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf => generated 1537 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:01:35.799022 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-858c57e4-e0da-4f1f-a718-ef35081d43ce tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:35.803553 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-858c57e4-e0da-4f1f-a718-ef35081d43ce tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] [instance: 59f196e8-c202-4073-8663-2ae19358a044] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:35.815988 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-7336378b-a4ee-4cd7-80dd-be932f6722ca tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:35.818434 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-858c57e4-e0da-4f1f-a718-ef35081d43ce tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:35.820639 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-858c57e4-e0da-4f1f-a718-ef35081d43ce tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:35.821358 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-858c57e4-e0da-4f1f-a718-ef35081d43ce tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:35.822302 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-858c57e4-e0da-4f1f-a718-ef35081d43ce tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:35.823849 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-858c57e4-e0da-4f1f-a718-ef35081d43ce tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:35.825298 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-858c57e4-e0da-4f1f-a718-ef35081d43ce tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:35.830026 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-7336378b-a4ee-4cd7-80dd-be932f6722ca tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/680c3968-8912-45c4-b1c3-634c06ec30c3" status: 200 len: 1508 microversion: 2.1 time: 0.636464 Sep 14 09:01:35.847780 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1558/3061] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:01:35 2022] GET /compute/v2.1/servers/680c3968-8912-45c4-b1c3-634c06ec30c3 => generated 1508 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:01:35.972481 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-05014d4f-2956-4ac0-b4fe-b8812219c062 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Calling method '.version_select at 0x7f7d445d9c10>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:36.015990 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-858c57e4-e0da-4f1f-a718-ef35081d43ce tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:36.035217 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-858c57e4-e0da-4f1f-a718-ef35081d43ce tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:36.039405 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-858c57e4-e0da-4f1f-a718-ef35081d43ce tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:36.041243 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-858c57e4-e0da-4f1f-a718-ef35081d43ce tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] 10.222.0.60 "GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044" status: 200 len: 1602 microversion: 2.42 time: 0.246246 Sep 14 09:01:36.041813 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1504/3062] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:01:35 2022] GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044 => generated 1602 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:01:36.107326 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-05014d4f-2956-4ac0-b4fe-b8812219c062 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] 10.222.0.60 "GET /compute/v2.1/images/be62d386-20a6-4610-9cf3-1a1a7817aac8" status: 200 len: 1453 microversion: 2.1 time: 0.139174 Sep 14 09:01:36.117120 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1559/3063] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:01:35 2022] GET /compute/v2.1/images/be62d386-20a6-4610-9cf3-1a1a7817aac8 => generated 1453 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:01:36.435514 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-5309fd6a-d75e-4e6d-b965-e009a0ed7a52 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:36.436626 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-5309fd6a-d75e-4e6d-b965-e009a0ed7a52 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] [instance: 0eb40c80-c056-4096-a586-7e957a63f7cf] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:36.448778 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5309fd6a-d75e-4e6d-b965-e009a0ed7a52 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:36.449708 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5309fd6a-d75e-4e6d-b965-e009a0ed7a52 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:36.450430 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5309fd6a-d75e-4e6d-b965-e009a0ed7a52 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:36.451724 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5309fd6a-d75e-4e6d-b965-e009a0ed7a52 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:36.453962 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5309fd6a-d75e-4e6d-b965-e009a0ed7a52 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:36.455253 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5309fd6a-d75e-4e6d-b965-e009a0ed7a52 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:36.797617 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-5309fd6a-d75e-4e6d-b965-e009a0ed7a52 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:36.814664 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-5309fd6a-d75e-4e6d-b965-e009a0ed7a52 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:36.816409 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-5309fd6a-d75e-4e6d-b965-e009a0ed7a52 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:36.831684 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-5309fd6a-d75e-4e6d-b965-e009a0ed7a52 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] 10.222.0.60 "GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf" status: 200 len: 1537 microversion: 2.91 time: 0.401111 Sep 14 09:01:36.849920 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1505/3064] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:01:36 2022] GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf => generated 1537 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:01:36.857042 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-285b3629-b24a-49d7-b500-8206643c1f54 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:36.858369 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-285b3629-b24a-49d7-b500-8206643c1f54 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: 680c3968-8912-45c4-b1c3-634c06ec30c3] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:36.878108 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-285b3629-b24a-49d7-b500-8206643c1f54 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:36.880880 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-285b3629-b24a-49d7-b500-8206643c1f54 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:36.883047 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-285b3629-b24a-49d7-b500-8206643c1f54 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:36.887955 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-285b3629-b24a-49d7-b500-8206643c1f54 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:36.889559 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-285b3629-b24a-49d7-b500-8206643c1f54 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:36.890791 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-285b3629-b24a-49d7-b500-8206643c1f54 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:37.069822 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a50ecc9d-e4d3-412b-81a5-09a3e38cf877 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:37.071397 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-a50ecc9d-e4d3-412b-81a5-09a3e38cf877 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] [instance: 59f196e8-c202-4073-8663-2ae19358a044] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:37.083575 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a50ecc9d-e4d3-412b-81a5-09a3e38cf877 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:37.102462 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a50ecc9d-e4d3-412b-81a5-09a3e38cf877 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:37.103879 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a50ecc9d-e4d3-412b-81a5-09a3e38cf877 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:37.107477 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a50ecc9d-e4d3-412b-81a5-09a3e38cf877 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:37.109258 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a50ecc9d-e4d3-412b-81a5-09a3e38cf877 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:37.113418 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a50ecc9d-e4d3-412b-81a5-09a3e38cf877 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:37.273233 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-285b3629-b24a-49d7-b500-8206643c1f54 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:37.283484 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-285b3629-b24a-49d7-b500-8206643c1f54 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/680c3968-8912-45c4-b1c3-634c06ec30c3" status: 200 len: 1508 microversion: 2.1 time: 0.430951 Sep 14 09:01:37.299122 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1560/3065] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:01:36 2022] GET /compute/v2.1/servers/680c3968-8912-45c4-b1c3-634c06ec30c3 => generated 1508 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:01:37.305642 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b00f8d23-03e8-499d-91b1-e56884522f5f tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Calling method '.version_select at 0x7f7d445aaa60>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:37.306073 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-a50ecc9d-e4d3-412b-81a5-09a3e38cf877 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:37.337461 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-a50ecc9d-e4d3-412b-81a5-09a3e38cf877 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:37.339371 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-a50ecc9d-e4d3-412b-81a5-09a3e38cf877 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:37.348939 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a50ecc9d-e4d3-412b-81a5-09a3e38cf877 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] 10.222.0.60 "GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044" status: 200 len: 1602 microversion: 2.42 time: 0.283035 Sep 14 09:01:37.354996 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1506/3066] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:01:37 2022] GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044 => generated 1602 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 09:01:37.420360 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-b00f8d23-03e8-499d-91b1-e56884522f5f tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] 10.222.0.60 "GET /compute/v2.1/images/be62d386-20a6-4610-9cf3-1a1a7817aac8" status: 200 len: 1453 microversion: 2.1 time: 0.131935 Sep 14 09:01:37.434148 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1561/3067] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:01:37 2022] GET /compute/v2.1/images/be62d386-20a6-4610-9cf3-1a1a7817aac8 => generated 1453 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:01:37.870720 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-0fb4a33f-d6d9-4876-9591-32043ffb7aaf tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:37.871582 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-0fb4a33f-d6d9-4876-9591-32043ffb7aaf tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] [instance: 0eb40c80-c056-4096-a586-7e957a63f7cf] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:37.884869 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0fb4a33f-d6d9-4876-9591-32043ffb7aaf tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:37.885587 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0fb4a33f-d6d9-4876-9591-32043ffb7aaf tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:37.886221 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0fb4a33f-d6d9-4876-9591-32043ffb7aaf tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:37.887805 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0fb4a33f-d6d9-4876-9591-32043ffb7aaf tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:37.888429 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0fb4a33f-d6d9-4876-9591-32043ffb7aaf tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:37.889206 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0fb4a33f-d6d9-4876-9591-32043ffb7aaf tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:38.249597 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-0fb4a33f-d6d9-4876-9591-32043ffb7aaf tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:38.266768 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-0fb4a33f-d6d9-4876-9591-32043ffb7aaf tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:38.277163 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-0fb4a33f-d6d9-4876-9591-32043ffb7aaf tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:38.303139 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-0fb4a33f-d6d9-4876-9591-32043ffb7aaf tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] 10.222.0.60 "GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf" status: 200 len: 1537 microversion: 2.91 time: 0.437061 Sep 14 09:01:38.323999 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1507/3068] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:01:37 2022] GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf => generated 1537 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:01:38.327668 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-62e1fbb4-9c97-4901-8e97-6a7baec65aa3 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:38.328883 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-62e1fbb4-9c97-4901-8e97-6a7baec65aa3 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: 680c3968-8912-45c4-b1c3-634c06ec30c3] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:38.341885 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-62e1fbb4-9c97-4901-8e97-6a7baec65aa3 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:38.342663 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-62e1fbb4-9c97-4901-8e97-6a7baec65aa3 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:38.343343 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-62e1fbb4-9c97-4901-8e97-6a7baec65aa3 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:38.344252 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-62e1fbb4-9c97-4901-8e97-6a7baec65aa3 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:38.346754 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-62e1fbb4-9c97-4901-8e97-6a7baec65aa3 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:38.347431 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-62e1fbb4-9c97-4901-8e97-6a7baec65aa3 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:38.382351 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3ab6e175-4f60-4b4e-94c3-f8b37c16af99 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:38.383118 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-3ab6e175-4f60-4b4e-94c3-f8b37c16af99 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] [instance: 59f196e8-c202-4073-8663-2ae19358a044] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:38.398926 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3ab6e175-4f60-4b4e-94c3-f8b37c16af99 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:38.400469 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3ab6e175-4f60-4b4e-94c3-f8b37c16af99 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:38.400931 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3ab6e175-4f60-4b4e-94c3-f8b37c16af99 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:38.401690 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3ab6e175-4f60-4b4e-94c3-f8b37c16af99 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:38.402162 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3ab6e175-4f60-4b4e-94c3-f8b37c16af99 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:38.403251 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3ab6e175-4f60-4b4e-94c3-f8b37c16af99 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:38.645963 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-3ab6e175-4f60-4b4e-94c3-f8b37c16af99 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:38.665477 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-3ab6e175-4f60-4b4e-94c3-f8b37c16af99 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:38.667409 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-3ab6e175-4f60-4b4e-94c3-f8b37c16af99 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:38.669419 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-3ab6e175-4f60-4b4e-94c3-f8b37c16af99 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] 10.222.0.60 "GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044" status: 200 len: 1602 microversion: 2.42 time: 0.291211 Sep 14 09:01:38.692285 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1508/3069] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:01:38 2022] GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044 => generated 1602 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:01:38.695208 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-62e1fbb4-9c97-4901-8e97-6a7baec65aa3 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:38.707842 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-62e1fbb4-9c97-4901-8e97-6a7baec65aa3 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/680c3968-8912-45c4-b1c3-634c06ec30c3" status: 200 len: 1508 microversion: 2.1 time: 0.394597 Sep 14 09:01:38.723046 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-bb4b9fee-2567-42f7-9988-365400cf329a tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Calling method '.version_select at 0x7f7d4879f1f0>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:38.724681 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1562/3070] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:01:38 2022] GET /compute/v2.1/servers/680c3968-8912-45c4-b1c3-634c06ec30c3 => generated 1508 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:01:39.348483 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-fe156e02-ce60-4085-be3f-42723aa85059 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:39.349638 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-fe156e02-ce60-4085-be3f-42723aa85059 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] [instance: 0eb40c80-c056-4096-a586-7e957a63f7cf] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:39.373588 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fe156e02-ce60-4085-be3f-42723aa85059 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:39.375250 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-bb4b9fee-2567-42f7-9988-365400cf329a tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] 10.222.0.60 "GET /compute/v2.1/images/be62d386-20a6-4610-9cf3-1a1a7817aac8" status: 200 len: 1453 microversion: 2.1 time: 0.685954 Sep 14 09:01:39.376531 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fe156e02-ce60-4085-be3f-42723aa85059 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:39.377318 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1509/3071] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:01:38 2022] GET /compute/v2.1/images/be62d386-20a6-4610-9cf3-1a1a7817aac8 => generated 1453 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:01:39.377800 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fe156e02-ce60-4085-be3f-42723aa85059 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:39.381550 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fe156e02-ce60-4085-be3f-42723aa85059 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:39.382086 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fe156e02-ce60-4085-be3f-42723aa85059 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:39.382544 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fe156e02-ce60-4085-be3f-42723aa85059 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:39.700418 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-7fbf9363-66e1-4ddb-a2dc-d2cb92fdd8ec tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:39.701653 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-7fbf9363-66e1-4ddb-a2dc-d2cb92fdd8ec tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] [instance: 59f196e8-c202-4073-8663-2ae19358a044] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:39.712811 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7fbf9363-66e1-4ddb-a2dc-d2cb92fdd8ec tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:39.715927 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7fbf9363-66e1-4ddb-a2dc-d2cb92fdd8ec tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:39.717301 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7fbf9363-66e1-4ddb-a2dc-d2cb92fdd8ec tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:39.718332 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7fbf9363-66e1-4ddb-a2dc-d2cb92fdd8ec tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:39.719197 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7fbf9363-66e1-4ddb-a2dc-d2cb92fdd8ec tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:39.719914 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7fbf9363-66e1-4ddb-a2dc-d2cb92fdd8ec tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:39.761495 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-fe156e02-ce60-4085-be3f-42723aa85059 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:39.778382 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-fe156e02-ce60-4085-be3f-42723aa85059 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:39.782426 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-fe156e02-ce60-4085-be3f-42723aa85059 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:39.800989 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-fe156e02-ce60-4085-be3f-42723aa85059 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] 10.222.0.60 "GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf" status: 200 len: 1537 microversion: 2.91 time: 0.461494 Sep 14 09:01:39.803138 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1563/3072] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:01:39 2022] GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf => generated 1537 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:01:39.820266 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-8135ea1b-7269-4c97-a376-500c63074464 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:39.821196 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-8135ea1b-7269-4c97-a376-500c63074464 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: 680c3968-8912-45c4-b1c3-634c06ec30c3] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:39.834024 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8135ea1b-7269-4c97-a376-500c63074464 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:39.835072 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8135ea1b-7269-4c97-a376-500c63074464 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:39.835853 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8135ea1b-7269-4c97-a376-500c63074464 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:39.836886 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8135ea1b-7269-4c97-a376-500c63074464 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:39.841271 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8135ea1b-7269-4c97-a376-500c63074464 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:39.841957 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8135ea1b-7269-4c97-a376-500c63074464 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:39.878269 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-7fbf9363-66e1-4ddb-a2dc-d2cb92fdd8ec tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:39.895177 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-7fbf9363-66e1-4ddb-a2dc-d2cb92fdd8ec tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:39.897078 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-7fbf9363-66e1-4ddb-a2dc-d2cb92fdd8ec tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:39.898621 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-7fbf9363-66e1-4ddb-a2dc-d2cb92fdd8ec tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] 10.222.0.60 "GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044" status: 200 len: 1602 microversion: 2.42 time: 0.203375 Sep 14 09:01:39.900540 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1510/3073] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:01:39 2022] GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044 => generated 1602 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:01:40.267987 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-8135ea1b-7269-4c97-a376-500c63074464 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:40.284073 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-8135ea1b-7269-4c97-a376-500c63074464 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/680c3968-8912-45c4-b1c3-634c06ec30c3" status: 200 len: 1508 microversion: 2.1 time: 0.479628 Sep 14 09:01:40.291775 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1564/3074] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:01:39 2022] GET /compute/v2.1/servers/680c3968-8912-45c4-b1c3-634c06ec30c3 => generated 1508 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:01:40.395822 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-5b3f6dd3-690c-49a8-92ef-5baecd96b273 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Calling method '.version_select at 0x7f7d4860d940>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:40.536123 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-5b3f6dd3-690c-49a8-92ef-5baecd96b273 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] 10.222.0.60 "GET /compute/v2.1/images/be62d386-20a6-4610-9cf3-1a1a7817aac8" status: 200 len: 1453 microversion: 2.1 time: 0.146546 Sep 14 09:01:40.536720 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1511/3075] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:01:40 2022] GET /compute/v2.1/images/be62d386-20a6-4610-9cf3-1a1a7817aac8 => generated 1453 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:01:40.832251 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-20a32f57-9e4c-49f0-8437-e7e7431b67ae tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:40.834825 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-20a32f57-9e4c-49f0-8437-e7e7431b67ae tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] [instance: 0eb40c80-c056-4096-a586-7e957a63f7cf] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:40.868641 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-20a32f57-9e4c-49f0-8437-e7e7431b67ae tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:40.869162 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-20a32f57-9e4c-49f0-8437-e7e7431b67ae tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:40.888280 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-20a32f57-9e4c-49f0-8437-e7e7431b67ae tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:40.891336 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-20a32f57-9e4c-49f0-8437-e7e7431b67ae tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:40.892700 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-20a32f57-9e4c-49f0-8437-e7e7431b67ae tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:40.895796 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-20a32f57-9e4c-49f0-8437-e7e7431b67ae tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:41.108045 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-20a32f57-9e4c-49f0-8437-e7e7431b67ae tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:41.116765 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-20a32f57-9e4c-49f0-8437-e7e7431b67ae tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:41.118251 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-20a32f57-9e4c-49f0-8437-e7e7431b67ae tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:41.148432 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-20a32f57-9e4c-49f0-8437-e7e7431b67ae tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] 10.222.0.60 "GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf" status: 200 len: 1558 microversion: 2.91 time: 0.319820 Sep 14 09:01:41.148432 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1512/3076] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:01:40 2022] GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf => generated 1558 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:01:41.158740 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d94809c9-42f1-4546-af7a-8b7e3015f3ba tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:41.162223 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-d94809c9-42f1-4546-af7a-8b7e3015f3ba tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] [instance: 59f196e8-c202-4073-8663-2ae19358a044] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:41.188497 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d94809c9-42f1-4546-af7a-8b7e3015f3ba tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:41.191419 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d94809c9-42f1-4546-af7a-8b7e3015f3ba tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:41.191877 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d94809c9-42f1-4546-af7a-8b7e3015f3ba tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:41.192627 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d94809c9-42f1-4546-af7a-8b7e3015f3ba tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:41.193153 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d94809c9-42f1-4546-af7a-8b7e3015f3ba tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:41.193516 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d94809c9-42f1-4546-af7a-8b7e3015f3ba tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:41.313303 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-d94809c9-42f1-4546-af7a-8b7e3015f3ba tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:41.343144 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-d94809c9-42f1-4546-af7a-8b7e3015f3ba tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:41.345107 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-d94809c9-42f1-4546-af7a-8b7e3015f3ba tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:41.350345 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d94809c9-42f1-4546-af7a-8b7e3015f3ba tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] 10.222.0.60 "GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044" status: 200 len: 1602 microversion: 2.42 time: 0.195505 Sep 14 09:01:41.355339 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1513/3077] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:01:41 2022] GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044 => generated 1602 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:01:41.369683 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e6f89d37-6e39-4fd7-9902-25fad9fc6f6c tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:41.370702 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e6f89d37-6e39-4fd7-9902-25fad9fc6f6c tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: 680c3968-8912-45c4-b1c3-634c06ec30c3] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:41.387501 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e6f89d37-6e39-4fd7-9902-25fad9fc6f6c tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:41.388959 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e6f89d37-6e39-4fd7-9902-25fad9fc6f6c tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:41.390530 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e6f89d37-6e39-4fd7-9902-25fad9fc6f6c tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:41.392299 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e6f89d37-6e39-4fd7-9902-25fad9fc6f6c tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:41.394635 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e6f89d37-6e39-4fd7-9902-25fad9fc6f6c tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:41.395328 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e6f89d37-6e39-4fd7-9902-25fad9fc6f6c tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:41.401314 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-60501d41-4f1c-42ad-93ca-abd032a19650 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-567326605", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "networks": [{"uuid": "bb0229c6-6acc-45b6-88a8-a12c2ded5084"}]}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:01:41.521479 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.network.neutron [None req-60501d41-4f1c-42ad-93ca-abd032a19650 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] validate_networks() for [('bb0229c6-6acc-45b6-88a8-a12c2ded5084', None, None, None, None, None)] {{(pid=128758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:01:42.856993 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-e6f89d37-6e39-4fd7-9902-25fad9fc6f6c tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:42.912585 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e6f89d37-6e39-4fd7-9902-25fad9fc6f6c tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/680c3968-8912-45c4-b1c3-634c06ec30c3" status: 200 len: 1508 microversion: 2.1 time: 1.526497 Sep 14 09:01:42.913321 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1514/3078] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:01:41 2022] GET /compute/v2.1/servers/680c3968-8912-45c4-b1c3-634c06ec30c3 => generated 1508 bytes in 1557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:01:42.939975 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e7c5a8a1-889b-4b0c-9a93-5d8d983e2482 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Calling method '.version_select at 0x7f7d48756b80>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:43.036414 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e7c5a8a1-889b-4b0c-9a93-5d8d983e2482 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] 10.222.0.60 "GET /compute/v2.1/images/be62d386-20a6-4610-9cf3-1a1a7817aac8" status: 200 len: 1462 microversion: 2.1 time: 0.121966 Sep 14 09:01:43.037402 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1515/3079] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:01:42 2022] GET /compute/v2.1/images/be62d386-20a6-4610-9cf3-1a1a7817aac8 => generated 1462 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:01:43.058092 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-dd0dd020-ec90-4afa-be16-d7ff5a65fe79 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:43.058776 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-dd0dd020-ec90-4afa-be16-d7ff5a65fe79 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] [instance: 0eb40c80-c056-4096-a586-7e957a63f7cf] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:43.073944 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dd0dd020-ec90-4afa-be16-d7ff5a65fe79 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:43.074480 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dd0dd020-ec90-4afa-be16-d7ff5a65fe79 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:43.075894 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dd0dd020-ec90-4afa-be16-d7ff5a65fe79 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:43.076626 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dd0dd020-ec90-4afa-be16-d7ff5a65fe79 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:43.077086 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dd0dd020-ec90-4afa-be16-d7ff5a65fe79 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:43.077518 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dd0dd020-ec90-4afa-be16-d7ff5a65fe79 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:43.190715 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-dd0dd020-ec90-4afa-be16-d7ff5a65fe79 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:43.208992 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-dd0dd020-ec90-4afa-be16-d7ff5a65fe79 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:43.214723 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-dd0dd020-ec90-4afa-be16-d7ff5a65fe79 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:43.227657 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-dd0dd020-ec90-4afa-be16-d7ff5a65fe79 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] 10.222.0.60 "GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf" status: 200 len: 1553 microversion: 2.91 time: 0.188982 Sep 14 09:01:43.229382 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1516/3080] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:01:43 2022] GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf => generated 1553 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:01:43.235751 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c822794e-cc14-4892-90b5-00a9f0c05b66 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:43.236707 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-c822794e-cc14-4892-90b5-00a9f0c05b66 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] [instance: 59f196e8-c202-4073-8663-2ae19358a044] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:43.243665 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c822794e-cc14-4892-90b5-00a9f0c05b66 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:43.244675 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c822794e-cc14-4892-90b5-00a9f0c05b66 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:43.245330 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c822794e-cc14-4892-90b5-00a9f0c05b66 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:43.246442 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c822794e-cc14-4892-90b5-00a9f0c05b66 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:43.247257 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c822794e-cc14-4892-90b5-00a9f0c05b66 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:43.247945 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c822794e-cc14-4892-90b5-00a9f0c05b66 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:43.407273 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-c822794e-cc14-4892-90b5-00a9f0c05b66 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:43.420215 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-c822794e-cc14-4892-90b5-00a9f0c05b66 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:43.424960 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-c822794e-cc14-4892-90b5-00a9f0c05b66 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:43.426410 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-c822794e-cc14-4892-90b5-00a9f0c05b66 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] 10.222.0.60 "GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044" status: 200 len: 1602 microversion: 2.42 time: 0.195794 Sep 14 09:01:43.431263 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1517/3081] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:01:43 2022] GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044 => generated 1602 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:01:43.436298 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b4f402fd-e695-4907-8830-a94407bb3f30 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Calling method '.version_select at 0x7f7d48759940>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:43.515484 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b4f402fd-e695-4907-8830-a94407bb3f30 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] 10.222.0.60 "GET /compute/v2.1/images/be62d386-20a6-4610-9cf3-1a1a7817aac8" status: 200 len: 1462 microversion: 2.1 time: 0.082783 Sep 14 09:01:43.528265 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1518/3082] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:01:43 2022] GET /compute/v2.1/images/be62d386-20a6-4610-9cf3-1a1a7817aac8 => generated 1462 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:01:43.541997 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f17b4956-d283-479b-8fb5-317eb901e423 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:43.542634 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f17b4956-d283-479b-8fb5-317eb901e423 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] [instance: a4852a58-51c4-4ca0-8c83-19fc8209fd21] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:43.554997 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f17b4956-d283-479b-8fb5-317eb901e423 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:43.555602 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f17b4956-d283-479b-8fb5-317eb901e423 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:43.556073 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f17b4956-d283-479b-8fb5-317eb901e423 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:43.557365 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f17b4956-d283-479b-8fb5-317eb901e423 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:43.557837 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f17b4956-d283-479b-8fb5-317eb901e423 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:43.558286 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f17b4956-d283-479b-8fb5-317eb901e423 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:43.584381 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-60501d41-4f1c-42ad-93ca-abd032a19650 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Flavor limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:01:43.585394 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-60501d41-4f1c-42ad-93ca-abd032a19650 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Image limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:01:43.586085 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-60501d41-4f1c-42ad-93ca-abd032a19650 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Flavor pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:01:43.586726 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-60501d41-4f1c-42ad-93ca-abd032a19650 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Image pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:01:43.587497 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-60501d41-4f1c-42ad-93ca-abd032a19650 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:01:43.604407 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-60501d41-4f1c-42ad-93ca-abd032a19650 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:43.606575 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-60501d41-4f1c-42ad-93ca-abd032a19650 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:43.607868 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-60501d41-4f1c-42ad-93ca-abd032a19650 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:43.609985 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-60501d41-4f1c-42ad-93ca-abd032a19650 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:43.611908 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-60501d41-4f1c-42ad-93ca-abd032a19650 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:43.612648 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-60501d41-4f1c-42ad-93ca-abd032a19650 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:43.655739 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-60501d41-4f1c-42ad-93ca-abd032a19650 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Getting quotas for project e712ce30eb9c4128aa0ec1d425e9ab79. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:01:43.663421 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-60501d41-4f1c-42ad-93ca-abd032a19650 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Getting quotas for user d6e7ddc7c037439aad2f98277eef199e and project e712ce30eb9c4128aa0ec1d425e9ab79. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:01:43.675260 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:01:43.711162 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-60501d41-4f1c-42ad-93ca-abd032a19650 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Going to run 1 instances... {{(pid=128758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:01:43.713533 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-60501d41-4f1c-42ad-93ca-abd032a19650 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] [instance: 3d29c068-39c8-4851-82cf-b7639f689f24] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:01:43.829138 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-60501d41-4f1c-42ad-93ca-abd032a19650 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.056856 Sep 14 09:01:43.844833 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1565/3083] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 09:01:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 3074 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:01:43.873797 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f17b4956-d283-479b-8fb5-317eb901e423 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a475c6e2b35f494aa8380aa1783e1779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c6f0c84e964383af6a4025d80fc93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:43.902651 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f17b4956-d283-479b-8fb5-317eb901e423 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] 10.222.0.60 "GET /compute/v2.1/servers/a4852a58-51c4-4ca0-8c83-19fc8209fd21" status: 200 len: 1467 microversion: 2.1 time: 0.373124 Sep 14 09:01:43.903819 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1519/3084] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:01:43 2022] GET /compute/v2.1/servers/a4852a58-51c4-4ca0-8c83-19fc8209fd21 => generated 1467 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:01:43.930241 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-dfc72bc6-59b8-449b-b6c1-5dc6483a1315 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-867417347"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:01:43.932778 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-dfc72bc6-59b8-449b-b6c1-5dc6483a1315 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] [instance: ebf9bfa9-e941-4d23-8f6c-9867102feff2] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:43.941243 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-5582fa83-0b7e-4e24-bdf4-679bd9d34bb9 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:43.941867 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-5582fa83-0b7e-4e24-bdf4-679bd9d34bb9 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: 680c3968-8912-45c4-b1c3-634c06ec30c3] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:43.949484 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dfc72bc6-59b8-449b-b6c1-5dc6483a1315 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:43.950744 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dfc72bc6-59b8-449b-b6c1-5dc6483a1315 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:43.952785 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dfc72bc6-59b8-449b-b6c1-5dc6483a1315 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:43.953819 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5582fa83-0b7e-4e24-bdf4-679bd9d34bb9 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:43.954318 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5582fa83-0b7e-4e24-bdf4-679bd9d34bb9 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:43.954774 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5582fa83-0b7e-4e24-bdf4-679bd9d34bb9 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:43.959987 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dfc72bc6-59b8-449b-b6c1-5dc6483a1315 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:43.961041 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dfc72bc6-59b8-449b-b6c1-5dc6483a1315 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:43.962547 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dfc72bc6-59b8-449b-b6c1-5dc6483a1315 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:43.973415 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5582fa83-0b7e-4e24-bdf4-679bd9d34bb9 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:43.973924 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5582fa83-0b7e-4e24-bdf4-679bd9d34bb9 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:43.974378 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5582fa83-0b7e-4e24-bdf4-679bd9d34bb9 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:44.500828 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-5582fa83-0b7e-4e24-bdf4-679bd9d34bb9 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:44.516286 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-5582fa83-0b7e-4e24-bdf4-679bd9d34bb9 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/680c3968-8912-45c4-b1c3-634c06ec30c3" status: 200 len: 1508 microversion: 2.1 time: 0.578786 Sep 14 09:01:44.517477 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1520/3085] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:01:43 2022] GET /compute/v2.1/servers/680c3968-8912-45c4-b1c3-634c06ec30c3 => generated 1508 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:01:44.535478 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d1be95b3-f134-41f7-81dd-b0af3b10a634 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1258482001", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "networks": [{"uuid": "bb0229c6-6acc-45b6-88a8-a12c2ded5084"}]}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:01:44.645989 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.network.neutron [None req-d1be95b3-f134-41f7-81dd-b0af3b10a634 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] validate_networks() for [('bb0229c6-6acc-45b6-88a8-a12c2ded5084', None, None, None, None, None)] {{(pid=128759) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:01:44.684104 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-dfc72bc6-59b8-449b-b6c1-5dc6483a1315 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] 10.222.0.60 "POST /compute/v2.1/servers/ebf9bfa9-e941-4d23-8f6c-9867102feff2/action" status: 202 len: 0 microversion: 2.1 time: 0.754451 Sep 14 09:01:44.693085 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1566/3086] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:01:43 2022] POST /compute/v2.1/servers/ebf9bfa9-e941-4d23-8f6c-9867102feff2/action => generated 0 bytes in 768 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 14 09:01:44.722232 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-66ef1003-0627-4319-9b5f-02551678a17f tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:44.726169 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-66ef1003-0627-4319-9b5f-02551678a17f tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] [instance: 0eb40c80-c056-4096-a586-7e957a63f7cf] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:44.750435 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-66ef1003-0627-4319-9b5f-02551678a17f tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:44.751891 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-66ef1003-0627-4319-9b5f-02551678a17f tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:44.753325 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-66ef1003-0627-4319-9b5f-02551678a17f tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:44.758324 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-66ef1003-0627-4319-9b5f-02551678a17f tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:44.759530 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-66ef1003-0627-4319-9b5f-02551678a17f tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:44.761350 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-66ef1003-0627-4319-9b5f-02551678a17f tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:45.110373 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-66ef1003-0627-4319-9b5f-02551678a17f tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:45.133058 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-66ef1003-0627-4319-9b5f-02551678a17f tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:45.136075 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-66ef1003-0627-4319-9b5f-02551678a17f tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:45.152836 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-66ef1003-0627-4319-9b5f-02551678a17f tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] 10.222.0.60 "GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf" status: 200 len: 1553 microversion: 2.91 time: 0.452968 Sep 14 09:01:45.154701 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1567/3087] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:01:44 2022] GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf => generated 1553 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:01:45.169423 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-f3e8be15-8866-44f5-ab32-d06876dc4ded tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:45.170725 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-f3e8be15-8866-44f5-ab32-d06876dc4ded tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] [instance: 59f196e8-c202-4073-8663-2ae19358a044] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:45.187855 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f3e8be15-8866-44f5-ab32-d06876dc4ded tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:45.188727 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f3e8be15-8866-44f5-ab32-d06876dc4ded tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:45.192009 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f3e8be15-8866-44f5-ab32-d06876dc4ded tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:45.194641 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f3e8be15-8866-44f5-ab32-d06876dc4ded tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:45.196502 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f3e8be15-8866-44f5-ab32-d06876dc4ded tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:45.197135 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f3e8be15-8866-44f5-ab32-d06876dc4ded tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:45.447600 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-f3e8be15-8866-44f5-ab32-d06876dc4ded tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:45.490630 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-f3e8be15-8866-44f5-ab32-d06876dc4ded tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:45.492754 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-f3e8be15-8866-44f5-ab32-d06876dc4ded tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:45.498152 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-f3e8be15-8866-44f5-ab32-d06876dc4ded tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] 10.222.0.60 "GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044" status: 200 len: 1602 microversion: 2.42 time: 0.341655 Sep 14 09:01:45.519127 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1568/3088] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:01:45 2022] GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044 => generated 1602 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:01:45.535085 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c55a5c36-e8b8-4d45-81fb-66134da7de29 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Calling method '.version_select at 0x7f7d44628ee0>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:45.640998 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-c55a5c36-e8b8-4d45-81fb-66134da7de29 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] 10.222.0.60 "GET /compute/v2.1/images/81e97ec9-8086-403e-b25e-9cf16f6eb89d" status: 200 len: 1454 microversion: 2.1 time: 0.116872 Sep 14 09:01:45.641592 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1569/3089] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:01:45 2022] GET /compute/v2.1/images/81e97ec9-8086-403e-b25e-9cf16f6eb89d => generated 1454 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:01:45.651358 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a08ceb37-af2e-45fc-a4de-4ea783b80566 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:45.653536 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-a08ceb37-af2e-45fc-a4de-4ea783b80566 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: 680c3968-8912-45c4-b1c3-634c06ec30c3] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:45.696865 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a08ceb37-af2e-45fc-a4de-4ea783b80566 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:45.697472 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a08ceb37-af2e-45fc-a4de-4ea783b80566 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:45.697790 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a08ceb37-af2e-45fc-a4de-4ea783b80566 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:45.710958 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a08ceb37-af2e-45fc-a4de-4ea783b80566 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:45.711552 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a08ceb37-af2e-45fc-a4de-4ea783b80566 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:45.712023 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a08ceb37-af2e-45fc-a4de-4ea783b80566 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:46.351180 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-a08ceb37-af2e-45fc-a4de-4ea783b80566 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:46.373657 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-a08ceb37-af2e-45fc-a4de-4ea783b80566 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/680c3968-8912-45c4-b1c3-634c06ec30c3" status: 200 len: 1529 microversion: 2.1 time: 0.727926 Sep 14 09:01:46.376690 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1570/3090] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:01:45 2022] GET /compute/v2.1/servers/680c3968-8912-45c4-b1c3-634c06ec30c3 => generated 1529 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:01:46.388558 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-24a6b776-2f09-4266-9ce3-ccb2671c759c tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:46.404277 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-24a6b776-2f09-4266-9ce3-ccb2671c759c tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] [instance: 0eb40c80-c056-4096-a586-7e957a63f7cf] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:46.429332 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-24a6b776-2f09-4266-9ce3-ccb2671c759c tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:46.437361 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-d1be95b3-f134-41f7-81dd-b0af3b10a634 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Flavor limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:01:46.438740 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-d1be95b3-f134-41f7-81dd-b0af3b10a634 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Image limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:01:46.440134 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-d1be95b3-f134-41f7-81dd-b0af3b10a634 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Flavor pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:01:46.440856 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-d1be95b3-f134-41f7-81dd-b0af3b10a634 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Image pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:01:46.441537 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-d1be95b3-f134-41f7-81dd-b0af3b10a634 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:01:46.446568 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-24a6b776-2f09-4266-9ce3-ccb2671c759c tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:46.450970 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-24a6b776-2f09-4266-9ce3-ccb2671c759c tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:46.452787 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-24a6b776-2f09-4266-9ce3-ccb2671c759c tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:46.458517 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-24a6b776-2f09-4266-9ce3-ccb2671c759c tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:46.459630 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-24a6b776-2f09-4266-9ce3-ccb2671c759c tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:46.472021 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d1be95b3-f134-41f7-81dd-b0af3b10a634 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:46.481789 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d1be95b3-f134-41f7-81dd-b0af3b10a634 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:46.487480 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d1be95b3-f134-41f7-81dd-b0af3b10a634 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:46.488934 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d1be95b3-f134-41f7-81dd-b0af3b10a634 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:46.490617 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d1be95b3-f134-41f7-81dd-b0af3b10a634 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:46.493797 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d1be95b3-f134-41f7-81dd-b0af3b10a634 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:46.583076 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-d1be95b3-f134-41f7-81dd-b0af3b10a634 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Getting quotas for project e712ce30eb9c4128aa0ec1d425e9ab79. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:01:46.596321 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-d1be95b3-f134-41f7-81dd-b0af3b10a634 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Getting quotas for user d6e7ddc7c037439aad2f98277eef199e and project e712ce30eb9c4128aa0ec1d425e9ab79. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:01:46.628948 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-d1be95b3-f134-41f7-81dd-b0af3b10a634 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Going to run 1 instances... {{(pid=128759) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:01:46.629258 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-24a6b776-2f09-4266-9ce3-ccb2671c759c tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:46.636489 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-d1be95b3-f134-41f7-81dd-b0af3b10a634 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] [instance: 36253bc6-1737-4654-a878-c1eaeb797c8e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128759) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:01:46.641936 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-24a6b776-2f09-4266-9ce3-ccb2671c759c tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:46.644705 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-24a6b776-2f09-4266-9ce3-ccb2671c759c tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:46.655192 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-24a6b776-2f09-4266-9ce3-ccb2671c759c tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] 10.222.0.60 "GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf" status: 200 len: 1553 microversion: 2.91 time: 0.275774 Sep 14 09:01:46.663166 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1571/3091] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:01:46 2022] GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf => generated 1553 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:01:46.673401 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-6a38665b-0143-4636-8444-17ccf7a6f994 req-dfdc9c1b-66de-449c-a360-ac52e8d593f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4852a58-51c4-4ca0-8c83-19fc8209fd21", "name": "network-vif-unplugged", "status": "completed", "tag": "003dc8e7-2302-41ad-87e7-680ccac43c8f"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:01:46.693728 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-6a38665b-0143-4636-8444-17ccf7a6f994 req-dfdc9c1b-66de-449c-a360-ac52e8d593f9 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:46.694622 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-6a38665b-0143-4636-8444-17ccf7a6f994 req-dfdc9c1b-66de-449c-a360-ac52e8d593f9 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:46.695584 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-6a38665b-0143-4636-8444-17ccf7a6f994 req-dfdc9c1b-66de-449c-a360-ac52e8d593f9 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:46.712070 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-6a38665b-0143-4636-8444-17ccf7a6f994 req-dfdc9c1b-66de-449c-a360-ac52e8d593f9 service nova] Creating event network-vif-unplugged:003dc8e7-2302-41ad-87e7-680ccac43c8f for instance a4852a58-51c4-4ca0-8c83-19fc8209fd21 on n-h2-836830-18 Sep 14 09:01:46.721322 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-6a38665b-0143-4636-8444-17ccf7a6f994 req-dfdc9c1b-66de-449c-a360-ac52e8d593f9 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.056612 Sep 14 09:01:46.723786 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1572/3092] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:01:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:01:46.732287 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-6a63439e-a78e-442b-828c-28b339885ee4 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:46.733366 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-6a63439e-a78e-442b-828c-28b339885ee4 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] [instance: 59f196e8-c202-4073-8663-2ae19358a044] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:46.744582 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6a63439e-a78e-442b-828c-28b339885ee4 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:46.745462 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6a63439e-a78e-442b-828c-28b339885ee4 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:46.746227 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6a63439e-a78e-442b-828c-28b339885ee4 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:46.748152 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6a63439e-a78e-442b-828c-28b339885ee4 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:46.749824 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6a63439e-a78e-442b-828c-28b339885ee4 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:46.750900 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6a63439e-a78e-442b-828c-28b339885ee4 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:46.752392 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d1be95b3-f134-41f7-81dd-b0af3b10a634 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.233650 Sep 14 09:01:46.763406 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1521/3093] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 09:01:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 2245 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:01:46.775155 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-4b551d20-25d5-47b6-9d9a-f9345cc77124 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Calling method '.version_select at 0x7f7d48759430>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:46.872672 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-4b551d20-25d5-47b6-9d9a-f9345cc77124 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] 10.222.0.60 "GET /compute/v2.1/images/81e97ec9-8086-403e-b25e-9cf16f6eb89d" status: 200 len: 1454 microversion: 2.1 time: 0.107017 Sep 14 09:01:46.881173 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1522/3094] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:01:46 2022] GET /compute/v2.1/images/81e97ec9-8086-403e-b25e-9cf16f6eb89d => generated 1454 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:01:46.921894 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-6a63439e-a78e-442b-828c-28b339885ee4 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:46.942996 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-6a63439e-a78e-442b-828c-28b339885ee4 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:46.947426 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-6a63439e-a78e-442b-828c-28b339885ee4 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6bb565169d0464389de47f7fc1fcf36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99ee157fa0b44443b6de7a2d8356599a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:46.951515 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-6a63439e-a78e-442b-828c-28b339885ee4 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] 10.222.0.60 "GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044" status: 200 len: 1602 microversion: 2.42 time: 0.225777 Sep 14 09:01:46.974330 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1573/3095] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:01:46 2022] GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044 => generated 1602 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:01:47.100651 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-353c225b-6563-40c3-84f0-b397d9385de9 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1410982381", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "451", "networks": [{"uuid": "bb0229c6-6acc-45b6-88a8-a12c2ded5084"}]}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:01:47.224067 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.network.neutron [None req-353c225b-6563-40c3-84f0-b397d9385de9 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] validate_networks() for [('bb0229c6-6acc-45b6-88a8-a12c2ded5084', None, None, None, None, None)] {{(pid=128759) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:01:47.412861 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-5aaacf36-cb27-44cc-933e-2c6262bbd6f6 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:47.422063 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-5aaacf36-cb27-44cc-933e-2c6262bbd6f6 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: 680c3968-8912-45c4-b1c3-634c06ec30c3] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:47.445547 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5aaacf36-cb27-44cc-933e-2c6262bbd6f6 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:47.446282 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5aaacf36-cb27-44cc-933e-2c6262bbd6f6 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:47.446739 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5aaacf36-cb27-44cc-933e-2c6262bbd6f6 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:47.449060 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5aaacf36-cb27-44cc-933e-2c6262bbd6f6 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:47.463741 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5aaacf36-cb27-44cc-933e-2c6262bbd6f6 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:47.464487 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5aaacf36-cb27-44cc-933e-2c6262bbd6f6 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:48.068178 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-5aaacf36-cb27-44cc-933e-2c6262bbd6f6 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:48.077328 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-5aaacf36-cb27-44cc-933e-2c6262bbd6f6 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/680c3968-8912-45c4-b1c3-634c06ec30c3" status: 200 len: 1529 microversion: 2.1 time: 0.678401 Sep 14 09:01:48.084102 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1574/3096] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:01:47 2022] GET /compute/v2.1/servers/680c3968-8912-45c4-b1c3-634c06ec30c3 => generated 1529 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:01:48.092103 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-005fef93-8c3a-4a2a-88f0-1adfa1e8edb0 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:48.095204 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-005fef93-8c3a-4a2a-88f0-1adfa1e8edb0 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] [instance: 0eb40c80-c056-4096-a586-7e957a63f7cf] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:48.111085 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-005fef93-8c3a-4a2a-88f0-1adfa1e8edb0 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:48.113365 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-005fef93-8c3a-4a2a-88f0-1adfa1e8edb0 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:48.114910 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-005fef93-8c3a-4a2a-88f0-1adfa1e8edb0 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:48.115862 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-005fef93-8c3a-4a2a-88f0-1adfa1e8edb0 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:48.123100 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-005fef93-8c3a-4a2a-88f0-1adfa1e8edb0 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:48.124424 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-005fef93-8c3a-4a2a-88f0-1adfa1e8edb0 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:48.301194 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-353c225b-6563-40c3-84f0-b397d9385de9 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Flavor limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:01:48.302274 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-353c225b-6563-40c3-84f0-b397d9385de9 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Image limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:01:48.302929 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-353c225b-6563-40c3-84f0-b397d9385de9 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Flavor pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:01:48.303532 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-353c225b-6563-40c3-84f0-b397d9385de9 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Image pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:01:48.304197 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-353c225b-6563-40c3-84f0-b397d9385de9 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:01:48.326904 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-353c225b-6563-40c3-84f0-b397d9385de9 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:48.328567 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-353c225b-6563-40c3-84f0-b397d9385de9 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:48.330028 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-353c225b-6563-40c3-84f0-b397d9385de9 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:48.331211 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-353c225b-6563-40c3-84f0-b397d9385de9 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:48.335391 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-353c225b-6563-40c3-84f0-b397d9385de9 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:48.339396 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-353c225b-6563-40c3-84f0-b397d9385de9 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:48.347271 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-005fef93-8c3a-4a2a-88f0-1adfa1e8edb0 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:48.354845 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:01:48.361378 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-005fef93-8c3a-4a2a-88f0-1adfa1e8edb0 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:48.363476 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-005fef93-8c3a-4a2a-88f0-1adfa1e8edb0 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:48.369602 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=100 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:01:48.371026 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-005fef93-8c3a-4a2a-88f0-1adfa1e8edb0 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] 10.222.0.60 "GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf" status: 200 len: 1553 microversion: 2.91 time: 0.285265 Sep 14 09:01:48.372232 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1575/3097] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:01:48 2022] GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf => generated 1553 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:01:48.407261 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-aceddcf8-ba1e-4abd-88e0-ec8df2eb9b8b tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Calling method '.version_select at 0x7f7d44c3f790>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:48.425239 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-353c225b-6563-40c3-84f0-b397d9385de9 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Getting quotas for project e712ce30eb9c4128aa0ec1d425e9ab79. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:01:48.438715 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-353c225b-6563-40c3-84f0-b397d9385de9 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Getting quotas for user d6e7ddc7c037439aad2f98277eef199e and project e712ce30eb9c4128aa0ec1d425e9ab79. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:01:48.458598 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-353c225b-6563-40c3-84f0-b397d9385de9 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Going to run 1 instances... {{(pid=128759) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:01:48.461253 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-353c225b-6563-40c3-84f0-b397d9385de9 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] [instance: 4e25180a-b979-44d1-a7d1-19dd30eee7a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128759) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:01:48.510210 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:01:48.566249 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-353c225b-6563-40c3-84f0-b397d9385de9 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.470245 Sep 14 09:01:48.573937 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1523/3098] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 09:01:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1473 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:01:48.586210 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3a706f15-15bf-4cd3-a4ca-51c3b24d0574 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:48.589150 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-3a706f15-15bf-4cd3-a4ca-51c3b24d0574 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] [instance: 59f196e8-c202-4073-8663-2ae19358a044] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:48.608809 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3a706f15-15bf-4cd3-a4ca-51c3b24d0574 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:48.610301 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3a706f15-15bf-4cd3-a4ca-51c3b24d0574 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:48.613855 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3a706f15-15bf-4cd3-a4ca-51c3b24d0574 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:48.616684 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3a706f15-15bf-4cd3-a4ca-51c3b24d0574 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:48.617679 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3a706f15-15bf-4cd3-a4ca-51c3b24d0574 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:48.619186 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3a706f15-15bf-4cd3-a4ca-51c3b24d0574 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:48.649222 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-aceddcf8-ba1e-4abd-88e0-ec8df2eb9b8b tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] 10.222.0.60 "GET /compute/v2.1/images/81e97ec9-8086-403e-b25e-9cf16f6eb89d" status: 200 len: 1454 microversion: 2.1 time: 0.267266 Sep 14 09:01:48.650295 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1576/3099] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:01:48 2022] GET /compute/v2.1/images/81e97ec9-8086-403e-b25e-9cf16f6eb89d => generated 1454 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:01:48.660540 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-bcf9b024-06a5-4cf8-b9d3-f1f764383995 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:48.661654 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-bcf9b024-06a5-4cf8-b9d3-f1f764383995 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] [instance: 4e25180a-b979-44d1-a7d1-19dd30eee7a4] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:48.675776 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-3a706f15-15bf-4cd3-a4ca-51c3b24d0574 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] HTTP exception thrown: Instance 59f196e8-c202-4073-8663-2ae19358a044 could not be found. Sep 14 09:01:48.680945 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3a706f15-15bf-4cd3-a4ca-51c3b24d0574 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Request method failure captured: Sep 14 09:01:48.680945 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044 HTTP/1.1 Sep 14 09:01:48.680945 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:01:48.680945 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:01:48.680945 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:01:48.680945 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:01:48.680945 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:01:48.680945 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:01:48.680945 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:01:48.680945 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:01:48.680945 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZcBOdoPNAKMiYjytlB9oSU_E679WLSRQLuDek0eIsPy0HCz6BJRuENO4KbZgw1xIeA_Ct0gCxgQNQQzDiD89yNdaS7F4QAY-ZamDJsUlQn08n3t3KoHGZUv6eFG2eieqxUGG4KRiIC3I1bPd07muUMq-HL8a8svgKBDai-uP-Kw3gY Sep 14 09:01:48.680945 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:01:48.680945 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:01:48.680945 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:01:48.680945 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:01:48.680945 n-d-836830-18 devstack@n-api.service[128759]: X-Openstack-Nova-Api-Version: 2.42 Sep 14 09:01:48.680945 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:01:48.680945 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:01:48.680945 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 99ee157fa0b44443b6de7a2d8356599a Sep 14 09:01:48.680945 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-2027662800 Sep 14 09:01:48.680945 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:01:48.680945 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:01:48.680945 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/99ee157fa0b44443b6de7a2d8356599a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_99ee157fa0b44443b6de7a2d8356599a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/99ee157fa0b44443b6de7a2d8356599a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/99ee157fa0b44443b6de7a2d8356599a"}]}] Sep 14 09:01:48.680945 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-TaggedBootDevicesTest_v242-2027662800 Sep 14 09:01:48.680945 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 99ee157fa0b44443b6de7a2d8356599a Sep 14 09:01:48.680945 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-2027662800 Sep 14 09:01:48.680945 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-TaggedBootDevicesTest_v242-2027662800-project Sep 14 09:01:48.680945 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:01:48.680945 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:01:48.680945 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: a6bb565169d0464389de47f7fc1fcf36 Sep 14 09:01:48.680945 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-TaggedBootDevicesTest_v242-2027662800-project Sep 14 09:01:48.680945 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:01:48.680945 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance 59f196e8-c202-4073-8663-2ae19358a044 could not be found. Sep 14 09:01:48.680945 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '59f196e8-c202-4073-8663-2ae19358a044'} Sep 14 09:01:48.680945 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:01:48.680945 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:01:48.680945 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:01:48.680945 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:01:48.680945 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:01:48.680945 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:01:48.680945 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:01:48.680945 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:01:48.680945 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:01:48.680945 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:01:48.680945 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59f196e8-c202-4073-8663-2ae19358a044 could not be found. Sep 14 09:01:48.680945 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:01:48.680945 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:01:48.680945 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:01:48.680945 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:01:48.680945 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:01:48.680945 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:01:48.680945 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:01:48.680945 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:01:48.680945 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:01:48.680945 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:01:48.680945 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:01:48.680945 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:01:48.680945 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:01:48.680945 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:01:48.680945 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:01:48.680945 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:01:48.680945 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59f196e8-c202-4073-8663-2ae19358a044 could not be found. Sep 14 09:01:48.680945 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:01:48.680945 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:01:48.686880 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:01:48.686880 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:01:48.686880 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:01:48.686880 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:01:48.686880 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:01:48.686880 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:01:48.686880 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59f196e8-c202-4073-8663-2ae19358a044 could not be found. Sep 14 09:01:48.686880 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:01:48.686880 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3a706f15-15bf-4cd3-a4ca-51c3b24d0574 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Returning 404 to user: Instance 59f196e8-c202-4073-8663-2ae19358a044 could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:01:48.687909 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-3a706f15-15bf-4cd3-a4ca-51c3b24d0574 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] 10.222.0.60 "GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044" status: 404 len: 111 microversion: 2.42 time: 0.112999 Sep 14 09:01:48.692039 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1524/3100] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:01:48 2022] GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044 => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 14 09:01:48.723769 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-5186f668-2f53-4b2f-9f6b-77e3fe7ffd8d tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Calling method '.version_select at 0x7f7d4877baf0>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:48.738591 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-bcf9b024-06a5-4cf8-b9d3-f1f764383995 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e7ddc7c037439aad2f98277eef199e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e712ce30eb9c4128aa0ec1d425e9ab79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:48.749738 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-bcf9b024-06a5-4cf8-b9d3-f1f764383995 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] 10.222.0.60 "GET /compute/v2.1/servers/4e25180a-b979-44d1-a7d1-19dd30eee7a4" status: 200 len: 1221 microversion: 2.1 time: 0.096897 Sep 14 09:01:48.751347 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1577/3101] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:01:48 2022] GET /compute/v2.1/servers/4e25180a-b979-44d1-a7d1-19dd30eee7a4 => generated 1221 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:01:48.775063 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-5186f668-2f53-4b2f-9f6b-77e3fe7ffd8d tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-58789062" status: 204 len: 0 microversion: 2.42 time: 0.079446 Sep 14 09:01:48.777044 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1525/3102] 10.222.0.60 () {60 vars in 1256 bytes} [Wed Sep 14 09:01:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-58789062 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 14 09:01:49.109154 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-e3a0aa95-5d80-4de4-bade-04065b01474f tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:49.112610 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-e3a0aa95-5d80-4de4-bade-04065b01474f tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: 680c3968-8912-45c4-b1c3-634c06ec30c3] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:49.127285 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e3a0aa95-5d80-4de4-bade-04065b01474f tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:49.129466 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e3a0aa95-5d80-4de4-bade-04065b01474f tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:49.130240 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e3a0aa95-5d80-4de4-bade-04065b01474f tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:49.133013 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e3a0aa95-5d80-4de4-bade-04065b01474f tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:49.136200 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e3a0aa95-5d80-4de4-bade-04065b01474f tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:49.137058 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e3a0aa95-5d80-4de4-bade-04065b01474f tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:49.408562 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e4c7488f-6bdb-40b3-896d-0351453dbefe tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:49.410867 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e4c7488f-6bdb-40b3-896d-0351453dbefe tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] [instance: 0eb40c80-c056-4096-a586-7e957a63f7cf] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:49.449469 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e4c7488f-6bdb-40b3-896d-0351453dbefe tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:49.451360 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e4c7488f-6bdb-40b3-896d-0351453dbefe tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:49.454401 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e4c7488f-6bdb-40b3-896d-0351453dbefe tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:49.456799 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e4c7488f-6bdb-40b3-896d-0351453dbefe tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:49.457778 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e4c7488f-6bdb-40b3-896d-0351453dbefe tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:49.458514 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e4c7488f-6bdb-40b3-896d-0351453dbefe tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:49.717835 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-e4c7488f-6bdb-40b3-896d-0351453dbefe tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:49.751339 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-e4c7488f-6bdb-40b3-896d-0351453dbefe tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:49.756525 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-e4c7488f-6bdb-40b3-896d-0351453dbefe tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:49.794651 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e4c7488f-6bdb-40b3-896d-0351453dbefe tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] 10.222.0.60 "GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf" status: 200 len: 1553 microversion: 2.91 time: 0.397108 Sep 14 09:01:49.808743 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1526/3103] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:01:49 2022] GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf => generated 1553 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 09:01:49.826281 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-5e979e9a-bbfa-48f6-b85c-b78b965d6b30 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Calling method '.version_select at 0x7f7d4877bd30>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:50.067952 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-e3a0aa95-5d80-4de4-bade-04065b01474f tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:50.084292 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-e3a0aa95-5d80-4de4-bade-04065b01474f tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/680c3968-8912-45c4-b1c3-634c06ec30c3" status: 200 len: 1529 microversion: 2.1 time: 0.979574 Sep 14 09:01:50.087594 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1578/3104] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:01:49 2022] GET /compute/v2.1/servers/680c3968-8912-45c4-b1c3-634c06ec30c3 => generated 1529 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:01:50.133113 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-5e979e9a-bbfa-48f6-b85c-b78b965d6b30 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] 10.222.0.60 "GET /compute/v2.1/images/81e97ec9-8086-403e-b25e-9cf16f6eb89d" status: 200 len: 1454 microversion: 2.1 time: 0.323008 Sep 14 09:01:50.134022 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1527/3105] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:01:49 2022] GET /compute/v2.1/images/81e97ec9-8086-403e-b25e-9cf16f6eb89d => generated 1454 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:01:50.156487 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-04ef5aeb-621d-4b4c-9fdc-cfcffc4f6585 req-b26bb5d0-d1ca-4eb9-a639-694875c1f3e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "680c3968-8912-45c4-b1c3-634c06ec30c3", "name": "network-vif-plugged", "status": "completed", "tag": "459779a8-3426-4989-910a-1f725b3e69c6"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:01:50.167077 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-23fc9694-de31-4cb2-89a4-17716f88ff03 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:50.167712 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-23fc9694-de31-4cb2-89a4-17716f88ff03 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] [instance: 4e25180a-b979-44d1-a7d1-19dd30eee7a4] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:50.221706 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-23fc9694-de31-4cb2-89a4-17716f88ff03 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:50.222229 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-23fc9694-de31-4cb2-89a4-17716f88ff03 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:50.222679 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-23fc9694-de31-4cb2-89a4-17716f88ff03 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:50.226559 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-04ef5aeb-621d-4b4c-9fdc-cfcffc4f6585 req-b26bb5d0-d1ca-4eb9-a639-694875c1f3e6 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:50.230169 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-04ef5aeb-621d-4b4c-9fdc-cfcffc4f6585 req-b26bb5d0-d1ca-4eb9-a639-694875c1f3e6 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:50.234219 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-04ef5aeb-621d-4b4c-9fdc-cfcffc4f6585 req-b26bb5d0-d1ca-4eb9-a639-694875c1f3e6 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:50.242773 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-23fc9694-de31-4cb2-89a4-17716f88ff03 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:50.245980 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-23fc9694-de31-4cb2-89a4-17716f88ff03 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:50.251716 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-23fc9694-de31-4cb2-89a4-17716f88ff03 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:50.274457 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-04ef5aeb-621d-4b4c-9fdc-cfcffc4f6585 req-b26bb5d0-d1ca-4eb9-a639-694875c1f3e6 service nova] Creating event network-vif-plugged:459779a8-3426-4989-910a-1f725b3e69c6 for instance 680c3968-8912-45c4-b1c3-634c06ec30c3 on n-h1-836830-18 Sep 14 09:01:50.288335 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-04ef5aeb-621d-4b4c-9fdc-cfcffc4f6585 req-b26bb5d0-d1ca-4eb9-a639-694875c1f3e6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147340 Sep 14 09:01:50.291614 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1528/3106] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:01:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:01:50.502640 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-23fc9694-de31-4cb2-89a4-17716f88ff03 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e7ddc7c037439aad2f98277eef199e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e712ce30eb9c4128aa0ec1d425e9ab79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:50.521218 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-23fc9694-de31-4cb2-89a4-17716f88ff03 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] 10.222.0.60 "GET /compute/v2.1/servers/4e25180a-b979-44d1-a7d1-19dd30eee7a4" status: 200 len: 1217 microversion: 2.1 time: 0.398892 Sep 14 09:01:50.521859 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1579/3107] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:01:50 2022] GET /compute/v2.1/servers/4e25180a-b979-44d1-a7d1-19dd30eee7a4 => generated 1217 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:01:50.827390 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3ea39cc8-425a-414a-a3ed-fa8eb4cf5496 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:50.829713 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-3ea39cc8-425a-414a-a3ed-fa8eb4cf5496 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] [instance: 0eb40c80-c056-4096-a586-7e957a63f7cf] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:50.841427 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3ea39cc8-425a-414a-a3ed-fa8eb4cf5496 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:50.846090 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3ea39cc8-425a-414a-a3ed-fa8eb4cf5496 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:50.849700 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3ea39cc8-425a-414a-a3ed-fa8eb4cf5496 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:50.853177 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3ea39cc8-425a-414a-a3ed-fa8eb4cf5496 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:50.856629 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3ea39cc8-425a-414a-a3ed-fa8eb4cf5496 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:50.857094 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3ea39cc8-425a-414a-a3ed-fa8eb4cf5496 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:51.068574 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-3ea39cc8-425a-414a-a3ed-fa8eb4cf5496 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:51.088748 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-3ea39cc8-425a-414a-a3ed-fa8eb4cf5496 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:51.093085 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-3ea39cc8-425a-414a-a3ed-fa8eb4cf5496 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:51.112282 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-3ea39cc8-425a-414a-a3ed-fa8eb4cf5496 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] 10.222.0.60 "GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf" status: 200 len: 1553 microversion: 2.91 time: 0.289124 Sep 14 09:01:51.112908 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-9b847b98-c1e0-4d5f-9e44-e416cbee2b64 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:51.113547 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-9b847b98-c1e0-4d5f-9e44-e416cbee2b64 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: 680c3968-8912-45c4-b1c3-634c06ec30c3] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:51.132514 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1529/3108] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:01:50 2022] GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf => generated 1553 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:01:51.133218 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9b847b98-c1e0-4d5f-9e44-e416cbee2b64 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:51.133614 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9b847b98-c1e0-4d5f-9e44-e416cbee2b64 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:51.136440 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9b847b98-c1e0-4d5f-9e44-e416cbee2b64 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:51.137697 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9b847b98-c1e0-4d5f-9e44-e416cbee2b64 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:51.141499 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9b847b98-c1e0-4d5f-9e44-e416cbee2b64 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:51.144785 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9b847b98-c1e0-4d5f-9e44-e416cbee2b64 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:51.154686 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-7042e5a3-dfb2-49c3-b0df-5278ad66dc8b tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Calling method '.version_select at 0x7f7d48671310>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:51.332825 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-7042e5a3-dfb2-49c3-b0df-5278ad66dc8b tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] 10.222.0.60 "GET /compute/v2.1/images/81e97ec9-8086-403e-b25e-9cf16f6eb89d" status: 200 len: 1454 microversion: 2.1 time: 0.187115 Sep 14 09:01:51.336016 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1530/3109] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:01:51 2022] GET /compute/v2.1/images/81e97ec9-8086-403e-b25e-9cf16f6eb89d => generated 1454 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:01:51.558263 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-46a0bdc1-47f0-4811-aec3-67d9e9d01531 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:51.563616 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-46a0bdc1-47f0-4811-aec3-67d9e9d01531 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] [instance: 4e25180a-b979-44d1-a7d1-19dd30eee7a4] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:51.572344 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-46a0bdc1-47f0-4811-aec3-67d9e9d01531 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:51.573798 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-46a0bdc1-47f0-4811-aec3-67d9e9d01531 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:51.574447 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-46a0bdc1-47f0-4811-aec3-67d9e9d01531 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:51.578504 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-46a0bdc1-47f0-4811-aec3-67d9e9d01531 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:51.579416 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-46a0bdc1-47f0-4811-aec3-67d9e9d01531 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:51.580015 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-46a0bdc1-47f0-4811-aec3-67d9e9d01531 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:53.097839 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-46a0bdc1-47f0-4811-aec3-67d9e9d01531 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e7ddc7c037439aad2f98277eef199e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e712ce30eb9c4128aa0ec1d425e9ab79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:53.107828 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-46a0bdc1-47f0-4811-aec3-67d9e9d01531 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] 10.222.0.60 "GET /compute/v2.1/servers/4e25180a-b979-44d1-a7d1-19dd30eee7a4" status: 200 len: 1281 microversion: 2.1 time: 1.560121 Sep 14 09:01:53.119827 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1531/3110] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:01:51 2022] GET /compute/v2.1/servers/4e25180a-b979-44d1-a7d1-19dd30eee7a4 => generated 1281 bytes in 1577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:01:53.143095 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-bc5b091a-e9d6-4acf-bfd4-d1667fa9c048 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:53.145097 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-bc5b091a-e9d6-4acf-bfd4-d1667fa9c048 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] [instance: 0eb40c80-c056-4096-a586-7e957a63f7cf] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:53.172256 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bc5b091a-e9d6-4acf-bfd4-d1667fa9c048 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:53.175951 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bc5b091a-e9d6-4acf-bfd4-d1667fa9c048 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:53.176609 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bc5b091a-e9d6-4acf-bfd4-d1667fa9c048 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:53.182301 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bc5b091a-e9d6-4acf-bfd4-d1667fa9c048 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:53.184993 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bc5b091a-e9d6-4acf-bfd4-d1667fa9c048 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:53.188249 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bc5b091a-e9d6-4acf-bfd4-d1667fa9c048 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:53.629068 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=2 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:01:53.988691 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-bc5b091a-e9d6-4acf-bfd4-d1667fa9c048 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:54.019716 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-bc5b091a-e9d6-4acf-bfd4-d1667fa9c048 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:54.025113 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-bc5b091a-e9d6-4acf-bfd4-d1667fa9c048 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:54.039928 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-bc5b091a-e9d6-4acf-bfd4-d1667fa9c048 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] 10.222.0.60 "GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf" status: 200 len: 1553 microversion: 2.91 time: 0.916016 Sep 14 09:01:54.040549 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1532/3111] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:01:53 2022] GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf => generated 1553 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:01:54.089205 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d10002b9-3d0d-426b-8d9a-9dfe7c571803 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Calling method '.version_select at 0x7f7d4860d940>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:54.162502 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-9b847b98-c1e0-4d5f-9e44-e416cbee2b64 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:54.189383 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-9b847b98-c1e0-4d5f-9e44-e416cbee2b64 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/680c3968-8912-45c4-b1c3-634c06ec30c3" status: 200 len: 1529 microversion: 2.1 time: 3.062905 Sep 14 09:01:54.216473 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1580/3112] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:01:51 2022] GET /compute/v2.1/servers/680c3968-8912-45c4-b1c3-634c06ec30c3 => generated 1529 bytes in 3108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:01:54.226803 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-3de917c5-f14f-45cb-96e6-d2b46d300768 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:54.242599 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-3de917c5-f14f-45cb-96e6-d2b46d300768 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] [instance: 4e25180a-b979-44d1-a7d1-19dd30eee7a4] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:54.257133 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3de917c5-f14f-45cb-96e6-d2b46d300768 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:54.259045 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3de917c5-f14f-45cb-96e6-d2b46d300768 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:54.259793 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3de917c5-f14f-45cb-96e6-d2b46d300768 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:54.262487 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3de917c5-f14f-45cb-96e6-d2b46d300768 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:54.267188 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3de917c5-f14f-45cb-96e6-d2b46d300768 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:54.268986 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3de917c5-f14f-45cb-96e6-d2b46d300768 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:54.579401 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-3de917c5-f14f-45cb-96e6-d2b46d300768 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e7ddc7c037439aad2f98277eef199e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e712ce30eb9c4128aa0ec1d425e9ab79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:54.591313 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-3de917c5-f14f-45cb-96e6-d2b46d300768 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] 10.222.0.60 "GET /compute/v2.1/servers/4e25180a-b979-44d1-a7d1-19dd30eee7a4" status: 200 len: 1279 microversion: 2.1 time: 0.369067 Sep 14 09:01:54.592486 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1581/3113] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:01:54 2022] GET /compute/v2.1/servers/4e25180a-b979-44d1-a7d1-19dd30eee7a4 => generated 1279 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:01:55.080619 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-abf31794-0379-4f49-9032-d155211fb8e2 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:55.081376 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-abf31794-0379-4f49-9032-d155211fb8e2 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] [instance: 0eb40c80-c056-4096-a586-7e957a63f7cf] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:55.091295 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-abf31794-0379-4f49-9032-d155211fb8e2 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:55.097016 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-abf31794-0379-4f49-9032-d155211fb8e2 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:55.097664 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-abf31794-0379-4f49-9032-d155211fb8e2 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:55.099377 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-abf31794-0379-4f49-9032-d155211fb8e2 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:55.101525 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-abf31794-0379-4f49-9032-d155211fb8e2 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:55.102072 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-abf31794-0379-4f49-9032-d155211fb8e2 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:55.481742 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-abf31794-0379-4f49-9032-d155211fb8e2 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:55.496181 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-abf31794-0379-4f49-9032-d155211fb8e2 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:55.503765 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-abf31794-0379-4f49-9032-d155211fb8e2 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:55.527368 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-abf31794-0379-4f49-9032-d155211fb8e2 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] 10.222.0.60 "GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf" status: 200 len: 1553 microversion: 2.91 time: 0.452052 Sep 14 09:01:55.538149 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1582/3114] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:01:55 2022] GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf => generated 1553 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:01:55.550243 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-28e7448f-f24c-4ca1-9f8a-441cb0fff28b tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:55.565291 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-28e7448f-f24c-4ca1-9f8a-441cb0fff28b tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: 680c3968-8912-45c4-b1c3-634c06ec30c3] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:55.609159 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-28e7448f-f24c-4ca1-9f8a-441cb0fff28b tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:55.615858 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-28e7448f-f24c-4ca1-9f8a-441cb0fff28b tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:55.616674 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-28e7448f-f24c-4ca1-9f8a-441cb0fff28b tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:55.621895 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-28e7448f-f24c-4ca1-9f8a-441cb0fff28b tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:55.623846 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-28e7448f-f24c-4ca1-9f8a-441cb0fff28b tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:55.631027 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-28e7448f-f24c-4ca1-9f8a-441cb0fff28b tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:55.977539 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-28e7448f-f24c-4ca1-9f8a-441cb0fff28b tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:55.990790 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-28e7448f-f24c-4ca1-9f8a-441cb0fff28b tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/680c3968-8912-45c4-b1c3-634c06ec30c3" status: 200 len: 1524 microversion: 2.1 time: 0.449003 Sep 14 09:01:56.004400 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1583/3115] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:01:55 2022] GET /compute/v2.1/servers/680c3968-8912-45c4-b1c3-634c06ec30c3 => generated 1524 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:01:56.020582 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-01537dc8-5148-443a-bd4f-3db4d90cf6e9 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:56.021215 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-01537dc8-5148-443a-bd4f-3db4d90cf6e9 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] [instance: 4e25180a-b979-44d1-a7d1-19dd30eee7a4] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:56.039117 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-01537dc8-5148-443a-bd4f-3db4d90cf6e9 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:56.039656 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-01537dc8-5148-443a-bd4f-3db4d90cf6e9 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:56.040112 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-01537dc8-5148-443a-bd4f-3db4d90cf6e9 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:56.040849 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-01537dc8-5148-443a-bd4f-3db4d90cf6e9 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:56.041309 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-01537dc8-5148-443a-bd4f-3db4d90cf6e9 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:56.045361 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-01537dc8-5148-443a-bd4f-3db4d90cf6e9 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:56.249041 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-01537dc8-5148-443a-bd4f-3db4d90cf6e9 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e7ddc7c037439aad2f98277eef199e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e712ce30eb9c4128aa0ec1d425e9ab79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:56.264013 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-01537dc8-5148-443a-bd4f-3db4d90cf6e9 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] 10.222.0.60 "GET /compute/v2.1/servers/4e25180a-b979-44d1-a7d1-19dd30eee7a4" status: 200 len: 1279 microversion: 2.1 time: 0.256862 Sep 14 09:01:56.266249 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1584/3116] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:01:56 2022] GET /compute/v2.1/servers/4e25180a-b979-44d1-a7d1-19dd30eee7a4 => generated 1279 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:01:56.296588 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-aee98ad1-3ed7-4b87-a2ec-e90b537b54b2 req-6ceef6ed-82a9-4928-86ef-d7c36363d940 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebf9bfa9-e941-4d23-8f6c-9867102feff2", "name": "network-vif-plugged", "status": "completed", "tag": "a16e0c89-9089-483d-ae3b-f83433826e96"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:01:56.327859 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-aee98ad1-3ed7-4b87-a2ec-e90b537b54b2 req-6ceef6ed-82a9-4928-86ef-d7c36363d940 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:56.346356 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-aee98ad1-3ed7-4b87-a2ec-e90b537b54b2 req-6ceef6ed-82a9-4928-86ef-d7c36363d940 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:56.349109 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-aee98ad1-3ed7-4b87-a2ec-e90b537b54b2 req-6ceef6ed-82a9-4928-86ef-d7c36363d940 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:56.397350 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-aee98ad1-3ed7-4b87-a2ec-e90b537b54b2 req-6ceef6ed-82a9-4928-86ef-d7c36363d940 service nova] Creating event network-vif-plugged:a16e0c89-9089-483d-ae3b-f83433826e96 for instance ebf9bfa9-e941-4d23-8f6c-9867102feff2 on n-h1-836830-18 Sep 14 09:01:56.408900 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-aee98ad1-3ed7-4b87-a2ec-e90b537b54b2 req-6ceef6ed-82a9-4928-86ef-d7c36363d940 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119802 Sep 14 09:01:56.416164 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1585/3117] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:01:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:01:56.578564 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-f15041d7-828e-4f63-bcdc-6ae7a3368fa3 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:56.579377 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-f15041d7-828e-4f63-bcdc-6ae7a3368fa3 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] [instance: 0eb40c80-c056-4096-a586-7e957a63f7cf] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:56.593661 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f15041d7-828e-4f63-bcdc-6ae7a3368fa3 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:56.599046 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f15041d7-828e-4f63-bcdc-6ae7a3368fa3 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:56.605126 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f15041d7-828e-4f63-bcdc-6ae7a3368fa3 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:56.607774 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f15041d7-828e-4f63-bcdc-6ae7a3368fa3 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:56.611009 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f15041d7-828e-4f63-bcdc-6ae7a3368fa3 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:56.612785 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f15041d7-828e-4f63-bcdc-6ae7a3368fa3 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:56.785571 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-f15041d7-828e-4f63-bcdc-6ae7a3368fa3 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:56.797809 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-f15041d7-828e-4f63-bcdc-6ae7a3368fa3 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:56.804396 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-f15041d7-828e-4f63-bcdc-6ae7a3368fa3 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:56.816142 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-f15041d7-828e-4f63-bcdc-6ae7a3368fa3 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] 10.222.0.60 "GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf" status: 200 len: 1553 microversion: 2.91 time: 0.249380 Sep 14 09:01:56.818259 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1586/3118] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:01:56 2022] GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf => generated 1553 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:01:57.020337 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-55163fc2-0119-42d3-a70b-6de119a2b8a6 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:57.021240 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-55163fc2-0119-42d3-a70b-6de119a2b8a6 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: 680c3968-8912-45c4-b1c3-634c06ec30c3] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:57.028410 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-55163fc2-0119-42d3-a70b-6de119a2b8a6 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:57.034188 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-55163fc2-0119-42d3-a70b-6de119a2b8a6 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:57.034957 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-55163fc2-0119-42d3-a70b-6de119a2b8a6 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:57.036040 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-55163fc2-0119-42d3-a70b-6de119a2b8a6 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:57.036676 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-55163fc2-0119-42d3-a70b-6de119a2b8a6 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:57.037388 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-55163fc2-0119-42d3-a70b-6de119a2b8a6 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:57.348717 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-55163fc2-0119-42d3-a70b-6de119a2b8a6 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:57.368944 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-55163fc2-0119-42d3-a70b-6de119a2b8a6 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/680c3968-8912-45c4-b1c3-634c06ec30c3" status: 200 len: 1524 microversion: 2.1 time: 0.353994 Sep 14 09:01:57.371204 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1587/3119] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:01:57 2022] GET /compute/v2.1/servers/680c3968-8912-45c4-b1c3-634c06ec30c3 => generated 1524 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:01:57.400270 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-4286187a-e7ae-4529-a8a1-0527268cc709 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:57.401294 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-4286187a-e7ae-4529-a8a1-0527268cc709 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] [instance: 4e25180a-b979-44d1-a7d1-19dd30eee7a4] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:57.425878 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4286187a-e7ae-4529-a8a1-0527268cc709 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:57.426855 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4286187a-e7ae-4529-a8a1-0527268cc709 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:57.430034 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4286187a-e7ae-4529-a8a1-0527268cc709 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:57.433298 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4286187a-e7ae-4529-a8a1-0527268cc709 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:57.436146 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4286187a-e7ae-4529-a8a1-0527268cc709 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:57.437954 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4286187a-e7ae-4529-a8a1-0527268cc709 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:58.373963 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=4 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:01:58.450497 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=12 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:01:58.659032 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-4286187a-e7ae-4529-a8a1-0527268cc709 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e7ddc7c037439aad2f98277eef199e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e712ce30eb9c4128aa0ec1d425e9ab79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:01:58.678692 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-4286187a-e7ae-4529-a8a1-0527268cc709 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] 10.222.0.60 "GET /compute/v2.1/servers/4e25180a-b979-44d1-a7d1-19dd30eee7a4" status: 200 len: 1321 microversion: 2.1 time: 1.305066 Sep 14 09:01:58.699960 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1588/3120] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:01:57 2022] GET /compute/v2.1/servers/4e25180a-b979-44d1-a7d1-19dd30eee7a4 => generated 1321 bytes in 1328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:01:58.750107 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=8 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:01:59.830155 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-6f9b8e2d-7032-44c6-af29-2eb98ffea034 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:01:59.830826 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-6f9b8e2d-7032-44c6-af29-2eb98ffea034 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] [instance: 26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:01:59.868460 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6f9b8e2d-7032-44c6-af29-2eb98ffea034 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:59.868975 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6f9b8e2d-7032-44c6-af29-2eb98ffea034 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:59.878347 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6f9b8e2d-7032-44c6-af29-2eb98ffea034 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:01:59.884484 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6f9b8e2d-7032-44c6-af29-2eb98ffea034 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:01:59.885073 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6f9b8e2d-7032-44c6-af29-2eb98ffea034 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:01:59.885536 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6f9b8e2d-7032-44c6-af29-2eb98ffea034 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:00.087272 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-6f9b8e2d-7032-44c6-af29-2eb98ffea034 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] [instance: 26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0] Going to try to terminate instance {{(pid=128758) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:02:00.348979 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-6f9b8e2d-7032-44c6-af29-2eb98ffea034 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] 10.222.0.60 "DELETE /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0" status: 204 len: 0 microversion: 2.32 time: 1.647182 Sep 14 09:02:00.350920 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1589/3121] 10.222.0.60 () {60 vars in 1280 bytes} [Wed Sep 14 09:01:58 2022] DELETE /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0 => generated 0 bytes in 1650 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 14 09:02:00.363616 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-8ccdc557-1ba3-4df6-83c4-75b912bac3f4 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:00.364329 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-8ccdc557-1ba3-4df6-83c4-75b912bac3f4 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] [instance: 0eb40c80-c056-4096-a586-7e957a63f7cf] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:02:00.394213 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8ccdc557-1ba3-4df6-83c4-75b912bac3f4 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:00.394873 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8ccdc557-1ba3-4df6-83c4-75b912bac3f4 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:00.395396 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8ccdc557-1ba3-4df6-83c4-75b912bac3f4 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:00.396164 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8ccdc557-1ba3-4df6-83c4-75b912bac3f4 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:00.396632 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8ccdc557-1ba3-4df6-83c4-75b912bac3f4 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:00.397069 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8ccdc557-1ba3-4df6-83c4-75b912bac3f4 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:00.750012 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-8ccdc557-1ba3-4df6-83c4-75b912bac3f4 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:00.767749 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-8ccdc557-1ba3-4df6-83c4-75b912bac3f4 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:00.778437 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-8ccdc557-1ba3-4df6-83c4-75b912bac3f4 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:00.808683 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-8ccdc557-1ba3-4df6-83c4-75b912bac3f4 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] 10.222.0.60 "GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf" status: 200 len: 1553 microversion: 2.91 time: 0.454493 Sep 14 09:02:00.842028 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1590/3122] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:02:00 2022] GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf => generated 1553 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:02:00.869189 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-2d2903b7-910c-4f9a-ad34-ea824fadc8e8 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:00.871796 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-2d2903b7-910c-4f9a-ad34-ea824fadc8e8 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: 680c3968-8912-45c4-b1c3-634c06ec30c3] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:02:00.889657 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2d2903b7-910c-4f9a-ad34-ea824fadc8e8 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:00.890074 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2d2903b7-910c-4f9a-ad34-ea824fadc8e8 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:00.890517 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2d2903b7-910c-4f9a-ad34-ea824fadc8e8 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:00.895109 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2d2903b7-910c-4f9a-ad34-ea824fadc8e8 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:00.897396 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2d2903b7-910c-4f9a-ad34-ea824fadc8e8 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:00.900316 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2d2903b7-910c-4f9a-ad34-ea824fadc8e8 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:01.631926 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-2d2903b7-910c-4f9a-ad34-ea824fadc8e8 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:01.641580 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-2d2903b7-910c-4f9a-ad34-ea824fadc8e8 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/680c3968-8912-45c4-b1c3-634c06ec30c3" status: 200 len: 1524 microversion: 2.1 time: 0.795722 Sep 14 09:02:01.654044 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1591/3123] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:02:00 2022] GET /compute/v2.1/servers/680c3968-8912-45c4-b1c3-634c06ec30c3 => generated 1524 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:02:01.659269 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-bc1c0bee-87e8-40d7-b67d-c4ffefd3ba45 req-5b9b436b-fc0e-425e-8820-1d113b6f9668 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d29c068-39c8-4851-82cf-b7639f689f24", "tag": "b81d4959-4718-4edd-a5de-ff251f0c1dab"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:02:01.693309 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-bc1c0bee-87e8-40d7-b67d-c4ffefd3ba45 req-5b9b436b-fc0e-425e-8820-1d113b6f9668 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:01.694218 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-bc1c0bee-87e8-40d7-b67d-c4ffefd3ba45 req-5b9b436b-fc0e-425e-8820-1d113b6f9668 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:01.694889 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-bc1c0bee-87e8-40d7-b67d-c4ffefd3ba45 req-5b9b436b-fc0e-425e-8820-1d113b6f9668 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:01.721023 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-bc1c0bee-87e8-40d7-b67d-c4ffefd3ba45 req-5b9b436b-fc0e-425e-8820-1d113b6f9668 service nova] Creating event network-changed:b81d4959-4718-4edd-a5de-ff251f0c1dab for instance 3d29c068-39c8-4851-82cf-b7639f689f24 on n-h2-836830-18 Sep 14 09:02:01.734079 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-bc1c0bee-87e8-40d7-b67d-c4ffefd3ba45 req-5b9b436b-fc0e-425e-8820-1d113b6f9668 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077884 Sep 14 09:02:01.735530 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1592/3124] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:02:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:02:01.748940 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ffd8254f-8f6f-47c7-abdc-3202099492f9 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:01.752282 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-ffd8254f-8f6f-47c7-abdc-3202099492f9 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] [instance: 4e25180a-b979-44d1-a7d1-19dd30eee7a4] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:02:01.774336 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ffd8254f-8f6f-47c7-abdc-3202099492f9 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:01.778910 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ffd8254f-8f6f-47c7-abdc-3202099492f9 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:01.778910 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ffd8254f-8f6f-47c7-abdc-3202099492f9 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:01.778910 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ffd8254f-8f6f-47c7-abdc-3202099492f9 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:01.789467 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ffd8254f-8f6f-47c7-abdc-3202099492f9 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:01.791339 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ffd8254f-8f6f-47c7-abdc-3202099492f9 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:02.442151 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-ffd8254f-8f6f-47c7-abdc-3202099492f9 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e7ddc7c037439aad2f98277eef199e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e712ce30eb9c4128aa0ec1d425e9ab79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:02.458023 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-ffd8254f-8f6f-47c7-abdc-3202099492f9 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] 10.222.0.60 "GET /compute/v2.1/servers/4e25180a-b979-44d1-a7d1-19dd30eee7a4" status: 200 len: 1321 microversion: 2.1 time: 0.720862 Sep 14 09:02:02.458670 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1593/3125] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:02:01 2022] GET /compute/v2.1/servers/4e25180a-b979-44d1-a7d1-19dd30eee7a4 => generated 1321 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:02:02.478164 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-0e4eb7fc-0255-497b-b92a-f3dcfe6b74db tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:02.484240 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-0e4eb7fc-0255-497b-b92a-f3dcfe6b74db tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] [instance: 26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:02:02.498908 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0e4eb7fc-0255-497b-b92a-f3dcfe6b74db tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:02.502398 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0e4eb7fc-0255-497b-b92a-f3dcfe6b74db tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:02.504115 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0e4eb7fc-0255-497b-b92a-f3dcfe6b74db tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:02.506215 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0e4eb7fc-0255-497b-b92a-f3dcfe6b74db tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:02.506880 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0e4eb7fc-0255-497b-b92a-f3dcfe6b74db tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:02.507348 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0e4eb7fc-0255-497b-b92a-f3dcfe6b74db tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:02.628307 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:02:03.412453 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-0e4eb7fc-0255-497b-b92a-f3dcfe6b74db tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:03.427765 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-0e4eb7fc-0255-497b-b92a-f3dcfe6b74db tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:03.429719 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-0e4eb7fc-0255-497b-b92a-f3dcfe6b74db tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:03.431239 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-0e4eb7fc-0255-497b-b92a-f3dcfe6b74db tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] 10.222.0.60 "GET /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0" status: 200 len: 2956 microversion: 2.32 time: 0.971547 Sep 14 09:02:03.432477 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1594/3126] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:02:02 2022] GET /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0 => generated 2956 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:02:03.725671 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ec1c2bd8-b2e3-4afc-9ff2-3e2f67493015 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-1565416714", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:02:03.996488 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=29 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:02:04.033916 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=21,nova_api:DELETE=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:02:06.750006 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d10002b9-3d0d-426b-8d9a-9dfe7c571803 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] 10.222.0.60 "GET /compute/v2.1/images/81e97ec9-8086-403e-b25e-9cf16f6eb89d" status: 200 len: 1454 microversion: 2.1 time: 12.673287 Sep 14 09:02:06.750689 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1533/3127] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:01:54 2022] GET /compute/v2.1/images/81e97ec9-8086-403e-b25e-9cf16f6eb89d => generated 1454 bytes in 12709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:02:06.756122 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-6c28b7e8-a16a-4004-a77e-57be93cc8790 req-6ff0a67d-8fd8-4bf1-a9bb-041c7ee7060a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36253bc6-1737-4654-a878-c1eaeb797c8e", "tag": "76ca3f3a-6da0-4186-a61f-54617a2436fa"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:02:06.758415 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.network.neutron [None req-ec1c2bd8-b2e3-4afc-9ff2-3e2f67493015 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] validate_networks() for None {{(pid=128758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:02:06.767536 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-6c28b7e8-a16a-4004-a77e-57be93cc8790 req-6ff0a67d-8fd8-4bf1-a9bb-041c7ee7060a service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:06.768034 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-6c28b7e8-a16a-4004-a77e-57be93cc8790 req-6ff0a67d-8fd8-4bf1-a9bb-041c7ee7060a service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:06.768478 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-6c28b7e8-a16a-4004-a77e-57be93cc8790 req-6ff0a67d-8fd8-4bf1-a9bb-041c7ee7060a service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:06.780172 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-6c28b7e8-a16a-4004-a77e-57be93cc8790 req-6ff0a67d-8fd8-4bf1-a9bb-041c7ee7060a service nova] Creating event network-changed:76ca3f3a-6da0-4186-a61f-54617a2436fa for instance 36253bc6-1737-4654-a878-c1eaeb797c8e on n-h1-836830-18 Sep 14 09:02:06.785185 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-6c28b7e8-a16a-4004-a77e-57be93cc8790 req-6ff0a67d-8fd8-4bf1-a9bb-041c7ee7060a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033450 Sep 14 09:02:06.786066 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1534/3128] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:02:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:02:06.791431 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ab4f1325-e1a2-494a-9f18-fdd1e219a000 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:06.792304 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-ab4f1325-e1a2-494a-9f18-fdd1e219a000 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] [instance: 59f196e8-c202-4073-8663-2ae19358a044] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:02:06.799041 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ab4f1325-e1a2-494a-9f18-fdd1e219a000 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:06.799765 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ab4f1325-e1a2-494a-9f18-fdd1e219a000 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:06.800398 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ab4f1325-e1a2-494a-9f18-fdd1e219a000 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:06.801287 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ab4f1325-e1a2-494a-9f18-fdd1e219a000 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:06.801935 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ab4f1325-e1a2-494a-9f18-fdd1e219a000 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:06.802528 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ab4f1325-e1a2-494a-9f18-fdd1e219a000 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:06.827778 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-ab4f1325-e1a2-494a-9f18-fdd1e219a000 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] HTTP exception thrown: Instance 59f196e8-c202-4073-8663-2ae19358a044 could not be found. Sep 14 09:02:06.829504 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ab4f1325-e1a2-494a-9f18-fdd1e219a000 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Request method failure captured: Sep 14 09:02:06.829504 n-d-836830-18 devstack@n-api.service[128759]: request: DELETE /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044 HTTP/1.1 Sep 14 09:02:06.829504 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:02:06.829504 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:02:06.829504 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:02:06.829504 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:02:06.829504 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:02:06.829504 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:02:06.829504 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:02:06.829504 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:02:06.829504 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZcBOdoPNAKMiYjytlB9oSU_E679WLSRQLuDek0eIsPy0HCz6BJRuENO4KbZgw1xIeA_Ct0gCxgQNQQzDiD89yNdaS7F4QAY-ZamDJsUlQn08n3t3KoHGZUv6eFG2eieqxUGG4KRiIC3I1bPd07muUMq-HL8a8svgKBDai-uP-Kw3gY Sep 14 09:02:06.829504 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:02:06.829504 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:02:06.829504 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:02:06.829504 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:02:06.829504 n-d-836830-18 devstack@n-api.service[128759]: X-Openstack-Nova-Api-Version: 2.42 Sep 14 09:02:06.829504 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:02:06.829504 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:02:06.829504 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 99ee157fa0b44443b6de7a2d8356599a Sep 14 09:02:06.829504 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-2027662800 Sep 14 09:02:06.829504 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:02:06.829504 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:02:06.829504 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/99ee157fa0b44443b6de7a2d8356599a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_99ee157fa0b44443b6de7a2d8356599a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/99ee157fa0b44443b6de7a2d8356599a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/99ee157fa0b44443b6de7a2d8356599a"}]}] Sep 14 09:02:06.829504 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-TaggedBootDevicesTest_v242-2027662800 Sep 14 09:02:06.829504 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 99ee157fa0b44443b6de7a2d8356599a Sep 14 09:02:06.829504 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-2027662800 Sep 14 09:02:06.829504 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-TaggedBootDevicesTest_v242-2027662800-project Sep 14 09:02:06.829504 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:02:06.829504 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:02:06.829504 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: a6bb565169d0464389de47f7fc1fcf36 Sep 14 09:02:06.829504 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-TaggedBootDevicesTest_v242-2027662800-project Sep 14 09:02:06.829504 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:02:06.829504 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance 59f196e8-c202-4073-8663-2ae19358a044 could not be found. Sep 14 09:02:06.829504 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '59f196e8-c202-4073-8663-2ae19358a044'} Sep 14 09:02:06.829504 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:02:06.829504 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:02:06.829504 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:02:06.829504 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:02:06.829504 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:02:06.829504 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:02:06.829504 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:02:06.829504 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:02:06.829504 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:02:06.829504 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:02:06.829504 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59f196e8-c202-4073-8663-2ae19358a044 could not be found. Sep 14 09:02:06.829504 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:02:06.829504 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:02:06.829504 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:02:06.829504 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:02:06.829504 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:02:06.829504 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:02:06.829504 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:02:06.829504 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:02:06.829504 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:02:06.829504 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:02:06.829504 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 09:02:06.829504 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 09:02:06.829504 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 09:02:06.829504 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 09:02:06.829504 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:02:06.829504 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:02:06.829504 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:02:06.829504 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:02:06.836198 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59f196e8-c202-4073-8663-2ae19358a044 could not be found. Sep 14 09:02:06.836198 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:02:06.836198 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:02:06.836198 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:02:06.836198 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:02:06.836198 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:02:06.836198 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:02:06.836198 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:02:06.836198 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:02:06.836198 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59f196e8-c202-4073-8663-2ae19358a044 could not be found. Sep 14 09:02:06.836198 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:02:06.836198 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ab4f1325-e1a2-494a-9f18-fdd1e219a000 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Returning 404 to user: Instance 59f196e8-c202-4073-8663-2ae19358a044 could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:02:06.836198 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-ab4f1325-e1a2-494a-9f18-fdd1e219a000 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] 10.222.0.60 "DELETE /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044" status: 404 len: 111 microversion: 2.42 time: 0.043615 Sep 14 09:02:06.838230 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1535/3129] 10.222.0.60 () {60 vars in 1280 bytes} [Wed Sep 14 09:02:06 2022] DELETE /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 14 09:02:06.844314 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ac76af71-8b9b-4aab-9d1c-e5f942023b81 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:06.845480 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-ac76af71-8b9b-4aab-9d1c-e5f942023b81 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] [instance: 0eb40c80-c056-4096-a586-7e957a63f7cf] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:02:06.852748 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ac76af71-8b9b-4aab-9d1c-e5f942023b81 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:06.853259 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ac76af71-8b9b-4aab-9d1c-e5f942023b81 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:06.853709 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ac76af71-8b9b-4aab-9d1c-e5f942023b81 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:06.854419 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ac76af71-8b9b-4aab-9d1c-e5f942023b81 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:06.855233 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ac76af71-8b9b-4aab-9d1c-e5f942023b81 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:06.855878 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ac76af71-8b9b-4aab-9d1c-e5f942023b81 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:06.961969 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-ac76af71-8b9b-4aab-9d1c-e5f942023b81 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:06.974693 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-ac76af71-8b9b-4aab-9d1c-e5f942023b81 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:06.976242 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-ac76af71-8b9b-4aab-9d1c-e5f942023b81 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:06.991476 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-ac76af71-8b9b-4aab-9d1c-e5f942023b81 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] 10.222.0.60 "GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf" status: 200 len: 1553 microversion: 2.91 time: 0.152130 Sep 14 09:02:06.992095 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1536/3130] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:02:06 2022] GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf => generated 1553 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:02:07.000798 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9ca1d199-2227-4e82-a895-732d1bf01a88 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:07.001452 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-9ca1d199-2227-4e82-a895-732d1bf01a88 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: 680c3968-8912-45c4-b1c3-634c06ec30c3] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:02:07.016909 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9ca1d199-2227-4e82-a895-732d1bf01a88 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:07.017452 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9ca1d199-2227-4e82-a895-732d1bf01a88 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:07.017907 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9ca1d199-2227-4e82-a895-732d1bf01a88 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:07.018637 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9ca1d199-2227-4e82-a895-732d1bf01a88 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:07.019141 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9ca1d199-2227-4e82-a895-732d1bf01a88 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:07.019583 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9ca1d199-2227-4e82-a895-732d1bf01a88 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:07.170971 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-ec1c2bd8-b2e3-4afc-9ff2-3e2f67493015 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Flavor limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:02:07.171685 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-ec1c2bd8-b2e3-4afc-9ff2-3e2f67493015 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Image limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:02:07.172894 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-ec1c2bd8-b2e3-4afc-9ff2-3e2f67493015 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Flavor pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:02:07.173474 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-ec1c2bd8-b2e3-4afc-9ff2-3e2f67493015 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Image pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:02:07.174057 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-ec1c2bd8-b2e3-4afc-9ff2-3e2f67493015 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:02:07.185620 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ec1c2bd8-b2e3-4afc-9ff2-3e2f67493015 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:07.186400 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ec1c2bd8-b2e3-4afc-9ff2-3e2f67493015 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:07.187290 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ec1c2bd8-b2e3-4afc-9ff2-3e2f67493015 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:07.188221 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ec1c2bd8-b2e3-4afc-9ff2-3e2f67493015 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:07.189232 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ec1c2bd8-b2e3-4afc-9ff2-3e2f67493015 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:07.189843 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ec1c2bd8-b2e3-4afc-9ff2-3e2f67493015 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:07.213958 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-ec1c2bd8-b2e3-4afc-9ff2-3e2f67493015 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Getting quotas for project 9051111ca00649c591b6485d58bbc265. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:02:07.221971 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-ec1c2bd8-b2e3-4afc-9ff2-3e2f67493015 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Getting quotas for user 2b847ccce0654f2fa9df8367320a3218 and project 9051111ca00649c591b6485d58bbc265. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:02:07.236960 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-ec1c2bd8-b2e3-4afc-9ff2-3e2f67493015 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Going to run 1 instances... {{(pid=128758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:02:07.239627 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-ec1c2bd8-b2e3-4afc-9ff2-3e2f67493015 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] [instance: 7558efb0-7f2d-42d5-9b6d-e442008b1c88] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:02:07.251680 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-9ca1d199-2227-4e82-a895-732d1bf01a88 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:07.261844 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-9ca1d199-2227-4e82-a895-732d1bf01a88 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/680c3968-8912-45c4-b1c3-634c06ec30c3" status: 200 len: 1524 microversion: 2.1 time: 0.268398 Sep 14 09:02:07.263303 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1537/3131] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:02:06 2022] GET /compute/v2.1/servers/680c3968-8912-45c4-b1c3-634c06ec30c3 => generated 1524 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:02:07.268900 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e5f26b55-8c7a-47f4-8d12-03799ff20c7c tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:07.270129 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e5f26b55-8c7a-47f4-8d12-03799ff20c7c tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] [instance: 4e25180a-b979-44d1-a7d1-19dd30eee7a4] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:02:07.280749 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e5f26b55-8c7a-47f4-8d12-03799ff20c7c tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:07.281692 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e5f26b55-8c7a-47f4-8d12-03799ff20c7c tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:07.282404 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e5f26b55-8c7a-47f4-8d12-03799ff20c7c tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:07.283728 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e5f26b55-8c7a-47f4-8d12-03799ff20c7c tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:07.284437 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e5f26b55-8c7a-47f4-8d12-03799ff20c7c tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:07.285273 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e5f26b55-8c7a-47f4-8d12-03799ff20c7c tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:07.307949 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-ec1c2bd8-b2e3-4afc-9ff2-3e2f67493015 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.874225 Sep 14 09:02:07.308655 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1595/3132] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 09:02:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 3875 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:02:07.322240 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-87a14702-c8c2-499f-9169-dd5b3e12eeed req-a6d78bcd-c35a-4c63-8f1c-7ef0917cca9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d29c068-39c8-4851-82cf-b7639f689f24", "name": "network-vif-plugged", "status": "completed", "tag": "b81d4959-4718-4edd-a5de-ff251f0c1dab"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:02:07.334810 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-87a14702-c8c2-499f-9169-dd5b3e12eeed req-a6d78bcd-c35a-4c63-8f1c-7ef0917cca9e service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:07.335391 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-87a14702-c8c2-499f-9169-dd5b3e12eeed req-a6d78bcd-c35a-4c63-8f1c-7ef0917cca9e service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:07.335826 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-87a14702-c8c2-499f-9169-dd5b3e12eeed req-a6d78bcd-c35a-4c63-8f1c-7ef0917cca9e service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:07.349357 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-87a14702-c8c2-499f-9169-dd5b3e12eeed req-a6d78bcd-c35a-4c63-8f1c-7ef0917cca9e service nova] Creating event network-vif-plugged:b81d4959-4718-4edd-a5de-ff251f0c1dab for instance 3d29c068-39c8-4851-82cf-b7639f689f24 on n-h2-836830-18 Sep 14 09:02:07.356969 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-87a14702-c8c2-499f-9169-dd5b3e12eeed req-a6d78bcd-c35a-4c63-8f1c-7ef0917cca9e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039229 Sep 14 09:02:07.358788 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1596/3133] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:02:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:02:07.381335 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c7ba8dfc-f848-4987-b22e-722a8da148d5 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:07.384796 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-c7ba8dfc-f848-4987-b22e-722a8da148d5 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] [instance: 26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:02:07.396625 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:02:07.417724 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c7ba8dfc-f848-4987-b22e-722a8da148d5 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:07.419721 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c7ba8dfc-f848-4987-b22e-722a8da148d5 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:07.421225 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c7ba8dfc-f848-4987-b22e-722a8da148d5 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:07.423860 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c7ba8dfc-f848-4987-b22e-722a8da148d5 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:07.424518 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c7ba8dfc-f848-4987-b22e-722a8da148d5 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:07.426036 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c7ba8dfc-f848-4987-b22e-722a8da148d5 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:07.553695 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-e5f26b55-8c7a-47f4-8d12-03799ff20c7c tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e7ddc7c037439aad2f98277eef199e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e712ce30eb9c4128aa0ec1d425e9ab79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:07.586734 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e5f26b55-8c7a-47f4-8d12-03799ff20c7c tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] 10.222.0.60 "GET /compute/v2.1/servers/4e25180a-b979-44d1-a7d1-19dd30eee7a4" status: 200 len: 1321 microversion: 2.1 time: 0.305673 Sep 14 09:02:07.588899 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1538/3134] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:02:07 2022] GET /compute/v2.1/servers/4e25180a-b979-44d1-a7d1-19dd30eee7a4 => generated 1321 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:02:07.608894 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-6d5459a2-7fe6-4512-bfcb-8a8960710699 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:07.609786 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-6d5459a2-7fe6-4512-bfcb-8a8960710699 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] [instance: 59f196e8-c202-4073-8663-2ae19358a044] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:02:07.635425 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6d5459a2-7fe6-4512-bfcb-8a8960710699 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:07.636006 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6d5459a2-7fe6-4512-bfcb-8a8960710699 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:07.643431 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6d5459a2-7fe6-4512-bfcb-8a8960710699 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:07.644411 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6d5459a2-7fe6-4512-bfcb-8a8960710699 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:07.644992 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6d5459a2-7fe6-4512-bfcb-8a8960710699 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:07.645345 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6d5459a2-7fe6-4512-bfcb-8a8960710699 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:07.688590 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-6d5459a2-7fe6-4512-bfcb-8a8960710699 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] HTTP exception thrown: Instance 59f196e8-c202-4073-8663-2ae19358a044 could not be found. Sep 14 09:02:07.690167 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-6d5459a2-7fe6-4512-bfcb-8a8960710699 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Request method failure captured: Sep 14 09:02:07.690167 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044 HTTP/1.1 Sep 14 09:02:07.690167 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:02:07.690167 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:02:07.690167 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:02:07.690167 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:02:07.690167 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:02:07.690167 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:02:07.690167 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:02:07.690167 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:02:07.690167 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZcBOdoPNAKMiYjytlB9oSU_E679WLSRQLuDek0eIsPy0HCz6BJRuENO4KbZgw1xIeA_Ct0gCxgQNQQzDiD89yNdaS7F4QAY-ZamDJsUlQn08n3t3KoHGZUv6eFG2eieqxUGG4KRiIC3I1bPd07muUMq-HL8a8svgKBDai-uP-Kw3gY Sep 14 09:02:07.690167 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:02:07.690167 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:02:07.690167 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:02:07.690167 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:02:07.690167 n-d-836830-18 devstack@n-api.service[128759]: X-Openstack-Nova-Api-Version: 2.42 Sep 14 09:02:07.690167 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:02:07.690167 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:02:07.690167 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 99ee157fa0b44443b6de7a2d8356599a Sep 14 09:02:07.690167 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-2027662800 Sep 14 09:02:07.690167 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:02:07.690167 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:02:07.690167 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/99ee157fa0b44443b6de7a2d8356599a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_99ee157fa0b44443b6de7a2d8356599a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/99ee157fa0b44443b6de7a2d8356599a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/99ee157fa0b44443b6de7a2d8356599a"}]}] Sep 14 09:02:07.690167 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-TaggedBootDevicesTest_v242-2027662800 Sep 14 09:02:07.690167 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 99ee157fa0b44443b6de7a2d8356599a Sep 14 09:02:07.690167 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-2027662800 Sep 14 09:02:07.690167 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-TaggedBootDevicesTest_v242-2027662800-project Sep 14 09:02:07.690167 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:02:07.690167 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:02:07.690167 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: a6bb565169d0464389de47f7fc1fcf36 Sep 14 09:02:07.690167 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-TaggedBootDevicesTest_v242-2027662800-project Sep 14 09:02:07.690167 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:02:07.690167 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance 59f196e8-c202-4073-8663-2ae19358a044 could not be found. Sep 14 09:02:07.690167 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '59f196e8-c202-4073-8663-2ae19358a044'} Sep 14 09:02:07.690167 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:02:07.690167 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:02:07.690167 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:02:07.690167 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:02:07.690167 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:02:07.690167 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:02:07.690167 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:02:07.690167 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:02:07.690167 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:02:07.690167 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:02:07.690167 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59f196e8-c202-4073-8663-2ae19358a044 could not be found. Sep 14 09:02:07.690167 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:02:07.690167 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:02:07.690167 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:02:07.690167 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:02:07.690167 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:02:07.690167 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:02:07.690167 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:02:07.690167 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:02:07.690167 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:02:07.690167 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:02:07.690167 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:02:07.690167 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:02:07.690167 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:02:07.690167 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:02:07.690167 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:02:07.690167 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:02:07.690167 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59f196e8-c202-4073-8663-2ae19358a044 could not be found. Sep 14 09:02:07.690167 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:02:07.690167 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:02:07.695278 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:02:07.695278 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:02:07.695278 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:02:07.695278 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:02:07.695278 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:02:07.695278 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:02:07.695278 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59f196e8-c202-4073-8663-2ae19358a044 could not be found. Sep 14 09:02:07.695278 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:02:07.695278 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-6d5459a2-7fe6-4512-bfcb-8a8960710699 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] Returning 404 to user: Instance 59f196e8-c202-4073-8663-2ae19358a044 could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:02:07.708043 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-6d5459a2-7fe6-4512-bfcb-8a8960710699 tempest-TaggedBootDevicesTest_v242-2027662800 tempest-TaggedBootDevicesTest_v242-2027662800-project] 10.222.0.60 "GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044" status: 404 len: 111 microversion: 2.42 time: 0.114696 Sep 14 09:02:07.708643 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1539/3135] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:02:07 2022] GET /compute/v2.1/servers/59f196e8-c202-4073-8663-2ae19358a044 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 14 09:02:07.717935 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a1ed6918-9d93-4768-828e-9e28f7c2cfae tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:07.718563 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-a1ed6918-9d93-4768-828e-9e28f7c2cfae tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] [instance: 7558efb0-7f2d-42d5-9b6d-e442008b1c88] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:02:08.102715 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-a1ed6918-9d93-4768-828e-9e28f7c2cfae tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b847ccce0654f2fa9df8367320a3218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9051111ca00649c591b6485d58bbc265', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:08.125519 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a1ed6918-9d93-4768-828e-9e28f7c2cfae tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] 10.222.0.60 "GET /compute/v2.1/servers/7558efb0-7f2d-42d5-9b6d-e442008b1c88" status: 200 len: 1217 microversion: 2.1 time: 0.411759 Sep 14 09:02:08.128637 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1540/3136] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:02:07 2022] GET /compute/v2.1/servers/7558efb0-7f2d-42d5-9b6d-e442008b1c88 => generated 1217 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:02:08.134274 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8a4f8eb4-dc62-483d-b7b6-b4584d1ae295 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Calling method '.version_select at 0x7f7d4880f0d0>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:08.228150 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-8a4f8eb4-dc62-483d-b7b6-b4584d1ae295 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] 10.222.0.60 "GET /compute/v2.1/images/81e97ec9-8086-403e-b25e-9cf16f6eb89d" status: 200 len: 1454 microversion: 2.1 time: 0.098226 Sep 14 09:02:08.233666 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1541/3137] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:02:08 2022] GET /compute/v2.1/images/81e97ec9-8086-403e-b25e-9cf16f6eb89d => generated 1454 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:02:08.238830 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d1edd88a-3e54-40d3-b7fb-55002087f906 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:08.255721 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-d1edd88a-3e54-40d3-b7fb-55002087f906 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] [instance: 0eb40c80-c056-4096-a586-7e957a63f7cf] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:02:08.289913 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-c7ba8dfc-f848-4987-b22e-722a8da148d5 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:08.301985 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d1edd88a-3e54-40d3-b7fb-55002087f906 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:08.302508 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d1edd88a-3e54-40d3-b7fb-55002087f906 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:08.303792 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-c7ba8dfc-f848-4987-b22e-722a8da148d5 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:08.305935 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-c7ba8dfc-f848-4987-b22e-722a8da148d5 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:08.310231 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d1edd88a-3e54-40d3-b7fb-55002087f906 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:08.311107 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d1edd88a-3e54-40d3-b7fb-55002087f906 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:08.311233 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-c7ba8dfc-f848-4987-b22e-722a8da148d5 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] 10.222.0.60 "GET /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0" status: 200 len: 2956 microversion: 2.32 time: 0.934108 Sep 14 09:02:08.311605 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d1edd88a-3e54-40d3-b7fb-55002087f906 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:08.312317 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d1edd88a-3e54-40d3-b7fb-55002087f906 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:08.313216 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1597/3138] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:02:07 2022] GET /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0 => generated 2956 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:02:08.318637 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-12836d56-e6d4-4bd4-b330-c31d1a46bada tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:08.320737 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-12836d56-e6d4-4bd4-b330-c31d1a46bada tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: 680c3968-8912-45c4-b1c3-634c06ec30c3] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:02:08.336675 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-12836d56-e6d4-4bd4-b330-c31d1a46bada tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:08.338390 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-12836d56-e6d4-4bd4-b330-c31d1a46bada tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:08.339588 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-12836d56-e6d4-4bd4-b330-c31d1a46bada tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:08.340728 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-12836d56-e6d4-4bd4-b330-c31d1a46bada tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:08.341825 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-12836d56-e6d4-4bd4-b330-c31d1a46bada tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:08.343047 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-12836d56-e6d4-4bd4-b330-c31d1a46bada tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:08.532920 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-d1edd88a-3e54-40d3-b7fb-55002087f906 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:08.542518 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-d1edd88a-3e54-40d3-b7fb-55002087f906 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:08.549117 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-d1edd88a-3e54-40d3-b7fb-55002087f906 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:08.565027 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d1edd88a-3e54-40d3-b7fb-55002087f906 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] 10.222.0.60 "GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf" status: 200 len: 1535 microversion: 2.91 time: 0.329918 Sep 14 09:02:08.579963 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1542/3139] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:02:08 2022] GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf => generated 1535 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:02:08.614250 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-12836d56-e6d4-4bd4-b330-c31d1a46bada tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:08.620481 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-1ff73d9d-9931-44ee-b3b0-020725d6430f tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:08.622683 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-1ff73d9d-9931-44ee-b3b0-020725d6430f tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] [instance: 4e25180a-b979-44d1-a7d1-19dd30eee7a4] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:02:08.624399 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-12836d56-e6d4-4bd4-b330-c31d1a46bada tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/680c3968-8912-45c4-b1c3-634c06ec30c3" status: 200 len: 1524 microversion: 2.1 time: 0.308906 Sep 14 09:02:08.641113 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1598/3140] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:02:08 2022] GET /compute/v2.1/servers/680c3968-8912-45c4-b1c3-634c06ec30c3 => generated 1524 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:02:08.641654 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1ff73d9d-9931-44ee-b3b0-020725d6430f tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:08.645506 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1ff73d9d-9931-44ee-b3b0-020725d6430f tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:08.646277 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1ff73d9d-9931-44ee-b3b0-020725d6430f tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:08.650229 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1ff73d9d-9931-44ee-b3b0-020725d6430f tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:08.651974 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1ff73d9d-9931-44ee-b3b0-020725d6430f tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:08.654461 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1ff73d9d-9931-44ee-b3b0-020725d6430f tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:08.878285 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-fb26dbb5-1a61-4f54-ba51-70b1b669ee9e req-fab49267-0042-423a-b642-06c78b0f69d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e25180a-b979-44d1-a7d1-19dd30eee7a4", "tag": "b2d31d14-f64b-4833-b560-3b60af91131f"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:02:08.911885 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-fb26dbb5-1a61-4f54-ba51-70b1b669ee9e req-fab49267-0042-423a-b642-06c78b0f69d4 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:08.912368 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-fb26dbb5-1a61-4f54-ba51-70b1b669ee9e req-fab49267-0042-423a-b642-06c78b0f69d4 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:08.912812 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-fb26dbb5-1a61-4f54-ba51-70b1b669ee9e req-fab49267-0042-423a-b642-06c78b0f69d4 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:08.990440 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-fb26dbb5-1a61-4f54-ba51-70b1b669ee9e req-fab49267-0042-423a-b642-06c78b0f69d4 service nova] Creating event network-changed:b2d31d14-f64b-4833-b560-3b60af91131f for instance 4e25180a-b979-44d1-a7d1-19dd30eee7a4 on n-h1-836830-18 Sep 14 09:02:09.029612 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-fb26dbb5-1a61-4f54-ba51-70b1b669ee9e req-fab49267-0042-423a-b642-06c78b0f69d4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.152243 Sep 14 09:02:09.031159 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1599/3141] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:02:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:02:09.154976 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-9399ed69-22df-48e8-addd-a91b583c1421 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:09.155599 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-9399ed69-22df-48e8-addd-a91b583c1421 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] [instance: 7558efb0-7f2d-42d5-9b6d-e442008b1c88] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:02:09.176948 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9399ed69-22df-48e8-addd-a91b583c1421 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:09.177550 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9399ed69-22df-48e8-addd-a91b583c1421 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:09.177899 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9399ed69-22df-48e8-addd-a91b583c1421 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:09.181496 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9399ed69-22df-48e8-addd-a91b583c1421 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:09.186181 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9399ed69-22df-48e8-addd-a91b583c1421 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:09.189907 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9399ed69-22df-48e8-addd-a91b583c1421 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:09.322589 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-1ff73d9d-9931-44ee-b3b0-020725d6430f tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e7ddc7c037439aad2f98277eef199e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e712ce30eb9c4128aa0ec1d425e9ab79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:09.349130 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-1ff73d9d-9931-44ee-b3b0-020725d6430f tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] 10.222.0.60 "GET /compute/v2.1/servers/4e25180a-b979-44d1-a7d1-19dd30eee7a4" status: 200 len: 1321 microversion: 2.1 time: 0.735027 Sep 14 09:02:09.352457 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1543/3142] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:02:08 2022] GET /compute/v2.1/servers/4e25180a-b979-44d1-a7d1-19dd30eee7a4 => generated 1321 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:02:09.366799 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-54c23e17-ae6a-4cf2-b55e-606b481e1b51 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Calling method '.version_select at 0x7f7d487f2430>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:09.421964 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-9399ed69-22df-48e8-addd-a91b583c1421 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b847ccce0654f2fa9df8367320a3218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9051111ca00649c591b6485d58bbc265', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:09.434172 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-9399ed69-22df-48e8-addd-a91b583c1421 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] 10.222.0.60 "GET /compute/v2.1/servers/7558efb0-7f2d-42d5-9b6d-e442008b1c88" status: 200 len: 1221 microversion: 2.1 time: 0.285619 Sep 14 09:02:09.434786 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1600/3143] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:02:09 2022] GET /compute/v2.1/servers/7558efb0-7f2d-42d5-9b6d-e442008b1c88 => generated 1221 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:02:09.449627 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b4c663a6-40e7-486c-9bc5-7b11fc3b1f9a tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:09.450541 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-b4c663a6-40e7-486c-9bc5-7b11fc3b1f9a tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] [instance: 26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:02:09.467939 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b4c663a6-40e7-486c-9bc5-7b11fc3b1f9a tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:09.468737 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b4c663a6-40e7-486c-9bc5-7b11fc3b1f9a tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:09.469524 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b4c663a6-40e7-486c-9bc5-7b11fc3b1f9a tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:09.470716 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b4c663a6-40e7-486c-9bc5-7b11fc3b1f9a tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:09.471445 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b4c663a6-40e7-486c-9bc5-7b11fc3b1f9a tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:09.472041 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b4c663a6-40e7-486c-9bc5-7b11fc3b1f9a tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:09.691447 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-54c23e17-ae6a-4cf2-b55e-606b481e1b51 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] 10.222.0.60 "GET /compute/v2.1/images/81e97ec9-8086-403e-b25e-9cf16f6eb89d" status: 200 len: 1454 microversion: 2.1 time: 0.337233 Sep 14 09:02:09.701073 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1544/3144] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:02:09 2022] GET /compute/v2.1/images/81e97ec9-8086-403e-b25e-9cf16f6eb89d => generated 1454 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:02:09.709424 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-baa20c13-c216-4ca2-8c82-a458ec24f63b req-92a93c67-2583-42c8-bb64-fc0f1eef0c36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0", "name": "network-vif-unplugged", "status": "completed", "tag": "5779091e-0903-4f0d-81c7-8bdda2add09d"}, {"server_uuid": "26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0", "name": "network-vif-unplugged", "status": "completed", "tag": "3ef522d5-07e7-4dc1-89cc-6972e61a2d28"}, {"server_uuid": "26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0", "name": "network-vif-unplugged", "status": "completed", "tag": "0799d62c-8c0b-4879-8555-e787ef1b353f"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:02:09.748006 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-baa20c13-c216-4ca2-8c82-a458ec24f63b req-92a93c67-2583-42c8-bb64-fc0f1eef0c36 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:09.748992 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-baa20c13-c216-4ca2-8c82-a458ec24f63b req-92a93c67-2583-42c8-bb64-fc0f1eef0c36 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:09.750149 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-baa20c13-c216-4ca2-8c82-a458ec24f63b req-92a93c67-2583-42c8-bb64-fc0f1eef0c36 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:09.810692 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-baa20c13-c216-4ca2-8c82-a458ec24f63b req-92a93c67-2583-42c8-bb64-fc0f1eef0c36 service nova] Creating event network-vif-unplugged:5779091e-0903-4f0d-81c7-8bdda2add09d for instance 26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0 on n-h1-836830-18 Sep 14 09:02:09.811780 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-baa20c13-c216-4ca2-8c82-a458ec24f63b req-92a93c67-2583-42c8-bb64-fc0f1eef0c36 service nova] Creating event network-vif-unplugged:3ef522d5-07e7-4dc1-89cc-6972e61a2d28 for instance 26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0 on n-h1-836830-18 Sep 14 09:02:09.813843 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-baa20c13-c216-4ca2-8c82-a458ec24f63b req-92a93c67-2583-42c8-bb64-fc0f1eef0c36 service nova] Creating event network-vif-unplugged:0799d62c-8c0b-4879-8555-e787ef1b353f for instance 26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0 on n-h1-836830-18 Sep 14 09:02:09.836087 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-baa20c13-c216-4ca2-8c82-a458ec24f63b req-92a93c67-2583-42c8-bb64-fc0f1eef0c36 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 531 microversion: 2.1 time: 0.133400 Sep 14 09:02:09.839857 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1545/3145] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:02:09 2022] POST /compute/v2.1/os-server-external-events => generated 531 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:02:09.852205 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-44cbb116-f5ac-4fce-b2d6-7409ba8435d4 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:09.855699 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-b4c663a6-40e7-486c-9bc5-7b11fc3b1f9a tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:09.856406 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-44cbb116-f5ac-4fce-b2d6-7409ba8435d4 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] [instance: 0eb40c80-c056-4096-a586-7e957a63f7cf] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:02:09.872355 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-b4c663a6-40e7-486c-9bc5-7b11fc3b1f9a tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:09.876153 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-b4c663a6-40e7-486c-9bc5-7b11fc3b1f9a tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:09.877601 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-44cbb116-f5ac-4fce-b2d6-7409ba8435d4 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:09.878222 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-44cbb116-f5ac-4fce-b2d6-7409ba8435d4 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:09.878691 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-44cbb116-f5ac-4fce-b2d6-7409ba8435d4 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:09.879473 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-44cbb116-f5ac-4fce-b2d6-7409ba8435d4 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:09.879814 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-b4c663a6-40e7-486c-9bc5-7b11fc3b1f9a tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] 10.222.0.60 "GET /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0" status: 200 len: 2956 microversion: 2.32 time: 0.432118 Sep 14 09:02:09.879986 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-44cbb116-f5ac-4fce-b2d6-7409ba8435d4 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:09.881419 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-44cbb116-f5ac-4fce-b2d6-7409ba8435d4 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:09.895968 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1601/3146] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:02:09 2022] GET /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0 => generated 2956 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:02:09.923415 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-92d83e72-d4c9-45e6-a112-4ed4e0823999 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:09.925062 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-92d83e72-d4c9-45e6-a112-4ed4e0823999 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: 680c3968-8912-45c4-b1c3-634c06ec30c3] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:02:09.944215 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-92d83e72-d4c9-45e6-a112-4ed4e0823999 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:09.945714 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-92d83e72-d4c9-45e6-a112-4ed4e0823999 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:09.947804 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-92d83e72-d4c9-45e6-a112-4ed4e0823999 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:09.949119 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-92d83e72-d4c9-45e6-a112-4ed4e0823999 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:09.951040 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-92d83e72-d4c9-45e6-a112-4ed4e0823999 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:09.953229 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-92d83e72-d4c9-45e6-a112-4ed4e0823999 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:10.352735 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-44cbb116-f5ac-4fce-b2d6-7409ba8435d4 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:10.376616 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-44cbb116-f5ac-4fce-b2d6-7409ba8435d4 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:10.379412 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-44cbb116-f5ac-4fce-b2d6-7409ba8435d4 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:10.400872 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-44cbb116-f5ac-4fce-b2d6-7409ba8435d4 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] 10.222.0.60 "GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf" status: 200 len: 1538 microversion: 2.91 time: 0.559102 Sep 14 09:02:10.401758 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1546/3147] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:02:09 2022] GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf => generated 1538 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:02:10.408912 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-65feb529-d55c-4ef4-8650-d3ab292c1955 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:10.409844 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-65feb529-d55c-4ef4-8650-d3ab292c1955 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] [instance: 4e25180a-b979-44d1-a7d1-19dd30eee7a4] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:02:10.420693 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-65feb529-d55c-4ef4-8650-d3ab292c1955 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:10.422146 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-65feb529-d55c-4ef4-8650-d3ab292c1955 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:10.422883 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-65feb529-d55c-4ef4-8650-d3ab292c1955 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:10.424318 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-65feb529-d55c-4ef4-8650-d3ab292c1955 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:10.425110 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-65feb529-d55c-4ef4-8650-d3ab292c1955 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:10.425835 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-65feb529-d55c-4ef4-8650-d3ab292c1955 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:11.977604 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-92d83e72-d4c9-45e6-a112-4ed4e0823999 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:11.990692 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-92d83e72-d4c9-45e6-a112-4ed4e0823999 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/680c3968-8912-45c4-b1c3-634c06ec30c3" status: 200 len: 1524 microversion: 2.1 time: 2.086373 Sep 14 09:02:12.012559 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1602/3148] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:02:09 2022] GET /compute/v2.1/servers/680c3968-8912-45c4-b1c3-634c06ec30c3 => generated 1524 bytes in 2111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:02:12.024568 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-21146d1b-68d2-4e3f-ae33-2441d803d957 tempest-UnshelveToHostMultiNodesTest-151498122 tempest-UnshelveToHostMultiNodesTest-151498122-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h2-836830-18"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:02:12.035146 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-21146d1b-68d2-4e3f-ae33-2441d803d957 tempest-UnshelveToHostMultiNodesTest-151498122 tempest-UnshelveToHostMultiNodesTest-151498122-project-admin] [instance: 0eb40c80-c056-4096-a586-7e957a63f7cf] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:02:12.047955 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-21146d1b-68d2-4e3f-ae33-2441d803d957 tempest-UnshelveToHostMultiNodesTest-151498122 tempest-UnshelveToHostMultiNodesTest-151498122-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:12.048868 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-21146d1b-68d2-4e3f-ae33-2441d803d957 tempest-UnshelveToHostMultiNodesTest-151498122 tempest-UnshelveToHostMultiNodesTest-151498122-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:12.049552 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-21146d1b-68d2-4e3f-ae33-2441d803d957 tempest-UnshelveToHostMultiNodesTest-151498122 tempest-UnshelveToHostMultiNodesTest-151498122-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:12.050831 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-21146d1b-68d2-4e3f-ae33-2441d803d957 tempest-UnshelveToHostMultiNodesTest-151498122 tempest-UnshelveToHostMultiNodesTest-151498122-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:12.051570 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-21146d1b-68d2-4e3f-ae33-2441d803d957 tempest-UnshelveToHostMultiNodesTest-151498122 tempest-UnshelveToHostMultiNodesTest-151498122-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:12.056550 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-21146d1b-68d2-4e3f-ae33-2441d803d957 tempest-UnshelveToHostMultiNodesTest-151498122 tempest-UnshelveToHostMultiNodesTest-151498122-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:12.122044 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-65feb529-d55c-4ef4-8650-d3ab292c1955 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e7ddc7c037439aad2f98277eef199e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e712ce30eb9c4128aa0ec1d425e9ab79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:12.136276 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-65feb529-d55c-4ef4-8650-d3ab292c1955 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] 10.222.0.60 "GET /compute/v2.1/servers/4e25180a-b979-44d1-a7d1-19dd30eee7a4" status: 200 len: 1321 microversion: 2.1 time: 1.732435 Sep 14 09:02:12.139916 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1547/3149] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:02:10 2022] GET /compute/v2.1/servers/4e25180a-b979-44d1-a7d1-19dd30eee7a4 => generated 1321 bytes in 1737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:02:12.187817 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-2db848b9-c0c4-4dfc-86ff-563b20428c51 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:12.188925 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-2db848b9-c0c4-4dfc-86ff-563b20428c51 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] [instance: 7558efb0-7f2d-42d5-9b6d-e442008b1c88] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:02:12.210612 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2db848b9-c0c4-4dfc-86ff-563b20428c51 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:12.220016 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2db848b9-c0c4-4dfc-86ff-563b20428c51 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:12.220867 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2db848b9-c0c4-4dfc-86ff-563b20428c51 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:12.221879 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2db848b9-c0c4-4dfc-86ff-563b20428c51 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:12.222581 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2db848b9-c0c4-4dfc-86ff-563b20428c51 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:12.223303 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2db848b9-c0c4-4dfc-86ff-563b20428c51 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:12.417215 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-21146d1b-68d2-4e3f-ae33-2441d803d957 tempest-UnshelveToHostMultiNodesTest-151498122 tempest-UnshelveToHostMultiNodesTest-151498122-project-admin] [instance: 0eb40c80-c056-4096-a586-7e957a63f7cf] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h2-836830-18". {{(pid=128758) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 14 09:02:12.555709 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-2db848b9-c0c4-4dfc-86ff-563b20428c51 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b847ccce0654f2fa9df8367320a3218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9051111ca00649c591b6485d58bbc265', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:12.587623 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-2db848b9-c0c4-4dfc-86ff-563b20428c51 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] 10.222.0.60 "GET /compute/v2.1/servers/7558efb0-7f2d-42d5-9b6d-e442008b1c88" status: 200 len: 1275 microversion: 2.1 time: 0.445560 Sep 14 09:02:12.612074 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1548/3150] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:02:12 2022] GET /compute/v2.1/servers/7558efb0-7f2d-42d5-9b6d-e442008b1c88 => generated 1275 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:02:12.627595 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e5c577f5-cc5c-43cc-bf8a-106dadded218 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Calling method '.version_select at 0x7f7d4880f550>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:12.660909 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-21146d1b-68d2-4e3f-ae33-2441d803d957 tempest-UnshelveToHostMultiNodesTest-151498122 tempest-UnshelveToHostMultiNodesTest-151498122-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf/action" status: 202 len: 0 microversion: 2.91 time: 0.647073 Sep 14 09:02:12.665171 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1603/3151] 10.222.0.60 () {62 vars in 1319 bytes} [Wed Sep 14 09:02:12 2022] POST /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf/action => generated 0 bytes in 652 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:02:12.681531 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-f852c305-14af-4b81-b483-bef066de99c0 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:12.686190 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-f852c305-14af-4b81-b483-bef066de99c0 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] [instance: 26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:02:12.710618 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f852c305-14af-4b81-b483-bef066de99c0 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:12.719609 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f852c305-14af-4b81-b483-bef066de99c0 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:12.723617 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f852c305-14af-4b81-b483-bef066de99c0 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:12.724775 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f852c305-14af-4b81-b483-bef066de99c0 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:12.725476 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f852c305-14af-4b81-b483-bef066de99c0 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:12.726423 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f852c305-14af-4b81-b483-bef066de99c0 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:13.623515 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-f852c305-14af-4b81-b483-bef066de99c0 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:13.644360 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-f852c305-14af-4b81-b483-bef066de99c0 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:13.645837 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-f852c305-14af-4b81-b483-bef066de99c0 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:13.686444 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-f852c305-14af-4b81-b483-bef066de99c0 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] 10.222.0.60 "GET /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0" status: 200 len: 2914 microversion: 2.32 time: 1.019729 Sep 14 09:02:13.719113 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1604/3152] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:02:12 2022] GET /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0 => generated 2914 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:02:13.738070 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-70552e69-fe8c-49da-996e-51fc6c972d80 req-390aba92-6207-47ec-be86-cf6d39f16565 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0", "name": "network-vif-unplugged", "status": "completed", "tag": "6e812f35-e0fc-40c0-b4bf-9cf14c6dd2f3"}, {"server_uuid": "26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0", "name": "network-vif-unplugged", "status": "completed", "tag": "3de3b6b2-e333-42d2-a891-af01ff3ccfd0"}, {"server_uuid": "26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0", "name": "network-vif-unplugged", "status": "completed", "tag": "e80b0ec1-03fe-4258-9fdb-620fff721a58"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:02:13.786762 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-70552e69-fe8c-49da-996e-51fc6c972d80 req-390aba92-6207-47ec-be86-cf6d39f16565 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:13.787278 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-70552e69-fe8c-49da-996e-51fc6c972d80 req-390aba92-6207-47ec-be86-cf6d39f16565 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:13.788593 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-70552e69-fe8c-49da-996e-51fc6c972d80 req-390aba92-6207-47ec-be86-cf6d39f16565 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:13.835848 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-70552e69-fe8c-49da-996e-51fc6c972d80 req-390aba92-6207-47ec-be86-cf6d39f16565 service nova] Creating event network-vif-unplugged:6e812f35-e0fc-40c0-b4bf-9cf14c6dd2f3 for instance 26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0 on n-h1-836830-18 Sep 14 09:02:13.836601 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-70552e69-fe8c-49da-996e-51fc6c972d80 req-390aba92-6207-47ec-be86-cf6d39f16565 service nova] Creating event network-vif-unplugged:3de3b6b2-e333-42d2-a891-af01ff3ccfd0 for instance 26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0 on n-h1-836830-18 Sep 14 09:02:13.837592 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-70552e69-fe8c-49da-996e-51fc6c972d80 req-390aba92-6207-47ec-be86-cf6d39f16565 service nova] Creating event network-vif-unplugged:e80b0ec1-03fe-4258-9fdb-620fff721a58 for instance 26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0 on n-h1-836830-18 Sep 14 09:02:13.852586 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-70552e69-fe8c-49da-996e-51fc6c972d80 req-390aba92-6207-47ec-be86-cf6d39f16565 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 531 microversion: 2.1 time: 0.139132 Sep 14 09:02:13.855010 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1605/3153] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:02:13 2022] POST /compute/v2.1/os-server-external-events => generated 531 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:02:13.868836 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c3bc720f-db65-47b6-b526-6f679b8742eb tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:13.871708 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-c3bc720f-db65-47b6-b526-6f679b8742eb tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] [instance: 0eb40c80-c056-4096-a586-7e957a63f7cf] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:02:13.888352 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c3bc720f-db65-47b6-b526-6f679b8742eb tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:13.889121 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c3bc720f-db65-47b6-b526-6f679b8742eb tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:13.891217 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c3bc720f-db65-47b6-b526-6f679b8742eb tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:13.893448 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c3bc720f-db65-47b6-b526-6f679b8742eb tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:13.895252 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c3bc720f-db65-47b6-b526-6f679b8742eb tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:13.895958 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c3bc720f-db65-47b6-b526-6f679b8742eb tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:14.031507 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e5c577f5-cc5c-43cc-bf8a-106dadded218 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] 10.222.0.60 "GET /compute/v2.1/images/81e97ec9-8086-403e-b25e-9cf16f6eb89d" status: 200 len: 1454 microversion: 2.1 time: 1.416308 Sep 14 09:02:14.045327 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1549/3154] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:02:12 2022] GET /compute/v2.1/images/81e97ec9-8086-403e-b25e-9cf16f6eb89d => generated 1454 bytes in 1432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:02:14.075918 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a0499132-8a5d-40e6-b5ac-d0e555ce24bf tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:14.077641 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-a0499132-8a5d-40e6-b5ac-d0e555ce24bf tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: 680c3968-8912-45c4-b1c3-634c06ec30c3] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:02:14.117990 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a0499132-8a5d-40e6-b5ac-d0e555ce24bf tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:14.123667 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a0499132-8a5d-40e6-b5ac-d0e555ce24bf tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:14.124364 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a0499132-8a5d-40e6-b5ac-d0e555ce24bf tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:14.126979 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a0499132-8a5d-40e6-b5ac-d0e555ce24bf tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:14.129604 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a0499132-8a5d-40e6-b5ac-d0e555ce24bf tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:14.130191 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a0499132-8a5d-40e6-b5ac-d0e555ce24bf tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:14.203553 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-c3bc720f-db65-47b6-b526-6f679b8742eb tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:14.213226 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-c3bc720f-db65-47b6-b526-6f679b8742eb tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:14.214729 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-c3bc720f-db65-47b6-b526-6f679b8742eb tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:14.231437 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-c3bc720f-db65-47b6-b526-6f679b8742eb tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] 10.222.0.60 "GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf" status: 200 len: 1486 microversion: 2.91 time: 0.374827 Sep 14 09:02:14.232608 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1606/3155] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:02:13 2022] GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf => generated 1486 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:02:14.238248 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-eab3098a-3a16-4c31-82ec-5e5854b38757 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:14.242925 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-eab3098a-3a16-4c31-82ec-5e5854b38757 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] [instance: 4e25180a-b979-44d1-a7d1-19dd30eee7a4] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:02:14.254011 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-eab3098a-3a16-4c31-82ec-5e5854b38757 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:14.255858 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-eab3098a-3a16-4c31-82ec-5e5854b38757 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:14.258831 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-eab3098a-3a16-4c31-82ec-5e5854b38757 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:14.259870 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-eab3098a-3a16-4c31-82ec-5e5854b38757 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:14.260581 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-eab3098a-3a16-4c31-82ec-5e5854b38757 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:14.264258 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-eab3098a-3a16-4c31-82ec-5e5854b38757 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:14.922836 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-a0499132-8a5d-40e6-b5ac-d0e555ce24bf tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:14.932997 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a0499132-8a5d-40e6-b5ac-d0e555ce24bf tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/680c3968-8912-45c4-b1c3-634c06ec30c3" status: 200 len: 1524 microversion: 2.1 time: 0.886156 Sep 14 09:02:14.951777 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1550/3156] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:02:14 2022] GET /compute/v2.1/servers/680c3968-8912-45c4-b1c3-634c06ec30c3 => generated 1524 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:02:14.976266 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-612380a4-37a7-47b8-8dd7-aae5138dd1d3 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:14.976903 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-612380a4-37a7-47b8-8dd7-aae5138dd1d3 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] [instance: 7558efb0-7f2d-42d5-9b6d-e442008b1c88] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:02:14.994749 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-612380a4-37a7-47b8-8dd7-aae5138dd1d3 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:14.995320 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-612380a4-37a7-47b8-8dd7-aae5138dd1d3 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:14.996444 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-612380a4-37a7-47b8-8dd7-aae5138dd1d3 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:14.997585 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-612380a4-37a7-47b8-8dd7-aae5138dd1d3 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:14.998011 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-612380a4-37a7-47b8-8dd7-aae5138dd1d3 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:14.998646 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-612380a4-37a7-47b8-8dd7-aae5138dd1d3 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:15.273021 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-eab3098a-3a16-4c31-82ec-5e5854b38757 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e7ddc7c037439aad2f98277eef199e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e712ce30eb9c4128aa0ec1d425e9ab79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:15.295074 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-eab3098a-3a16-4c31-82ec-5e5854b38757 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] 10.222.0.60 "GET /compute/v2.1/servers/4e25180a-b979-44d1-a7d1-19dd30eee7a4" status: 200 len: 1321 microversion: 2.1 time: 1.061111 Sep 14 09:02:15.300974 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1607/3157] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:02:14 2022] GET /compute/v2.1/servers/4e25180a-b979-44d1-a7d1-19dd30eee7a4 => generated 1321 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:02:15.319640 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-1a5db389-d652-45ee-bd1d-7da8800f5df7 req-ae296563-e636-46ee-ad04-c24ea4e74e3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0", "name": "network-vif-deleted", "tag": "6e812f35-e0fc-40c0-b4bf-9cf14c6dd2f3"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:02:15.326601 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-612380a4-37a7-47b8-8dd7-aae5138dd1d3 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b847ccce0654f2fa9df8367320a3218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9051111ca00649c591b6485d58bbc265', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:15.338073 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-612380a4-37a7-47b8-8dd7-aae5138dd1d3 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] 10.222.0.60 "GET /compute/v2.1/servers/7558efb0-7f2d-42d5-9b6d-e442008b1c88" status: 200 len: 1275 microversion: 2.1 time: 0.366617 Sep 14 09:02:15.359293 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1551/3158] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:02:14 2022] GET /compute/v2.1/servers/7558efb0-7f2d-42d5-9b6d-e442008b1c88 => generated 1275 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:02:15.378682 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-7c487195-ef15-42a0-974b-0477aed0e121 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:15.379358 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-7c487195-ef15-42a0-974b-0477aed0e121 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] [instance: 26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:02:15.398092 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-1a5db389-d652-45ee-bd1d-7da8800f5df7 req-ae296563-e636-46ee-ad04-c24ea4e74e3c service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:15.398665 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-1a5db389-d652-45ee-bd1d-7da8800f5df7 req-ae296563-e636-46ee-ad04-c24ea4e74e3c service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:15.399135 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-1a5db389-d652-45ee-bd1d-7da8800f5df7 req-ae296563-e636-46ee-ad04-c24ea4e74e3c service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:15.407974 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7c487195-ef15-42a0-974b-0477aed0e121 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:15.408473 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7c487195-ef15-42a0-974b-0477aed0e121 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:15.409109 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7c487195-ef15-42a0-974b-0477aed0e121 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:15.410082 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7c487195-ef15-42a0-974b-0477aed0e121 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:15.410713 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7c487195-ef15-42a0-974b-0477aed0e121 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:15.411387 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7c487195-ef15-42a0-974b-0477aed0e121 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:15.490060 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-1a5db389-d652-45ee-bd1d-7da8800f5df7 req-ae296563-e636-46ee-ad04-c24ea4e74e3c service nova] Creating event network-vif-deleted:6e812f35-e0fc-40c0-b4bf-9cf14c6dd2f3 for instance 26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0 on n-h1-836830-18 Sep 14 09:02:15.524895 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-1a5db389-d652-45ee-bd1d-7da8800f5df7 req-ae296563-e636-46ee-ad04-c24ea4e74e3c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.217052 Sep 14 09:02:15.525580 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1608/3159] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:02:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:02:15.567921 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-79dc055c-147f-43a4-a2d7-0332b58e35e5 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Calling method '.version_select at 0x7f7d44540820>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:15.666415 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-79dc055c-147f-43a4-a2d7-0332b58e35e5 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] 10.222.0.60 "GET /compute/v2.1/images/81e97ec9-8086-403e-b25e-9cf16f6eb89d" status: 200 len: 1454 microversion: 2.1 time: 0.136131 Sep 14 09:02:15.672070 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1609/3160] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:02:15 2022] GET /compute/v2.1/images/81e97ec9-8086-403e-b25e-9cf16f6eb89d => generated 1454 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:02:15.701255 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b52278d6-f743-45da-870d-d45d1228de09 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:15.702702 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-b52278d6-f743-45da-870d-d45d1228de09 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] [instance: 0eb40c80-c056-4096-a586-7e957a63f7cf] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:02:15.724814 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b52278d6-f743-45da-870d-d45d1228de09 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:15.725666 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b52278d6-f743-45da-870d-d45d1228de09 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:15.726363 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b52278d6-f743-45da-870d-d45d1228de09 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:15.727881 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b52278d6-f743-45da-870d-d45d1228de09 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:15.728637 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b52278d6-f743-45da-870d-d45d1228de09 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:15.729246 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b52278d6-f743-45da-870d-d45d1228de09 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:16.223875 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-b52278d6-f743-45da-870d-d45d1228de09 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:16.229448 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-7c487195-ef15-42a0-974b-0477aed0e121 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:16.245486 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-7c487195-ef15-42a0-974b-0477aed0e121 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:16.247951 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-7c487195-ef15-42a0-974b-0477aed0e121 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:16.250411 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-b52278d6-f743-45da-870d-d45d1228de09 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:16.253634 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-b52278d6-f743-45da-870d-d45d1228de09 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:16.253919 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-7c487195-ef15-42a0-974b-0477aed0e121 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] 10.222.0.60 "GET /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0" status: 200 len: 2820 microversion: 2.32 time: 0.889937 Sep 14 09:02:16.255268 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1552/3161] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:02:15 2022] GET /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0 => generated 2820 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:02:16.264455 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-b8731629-57ec-4dd0-aeb1-00bdbf467943 req-a781dc1b-3c7a-4ad9-b125-b048856cfdd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0", "name": "network-vif-unplugged", "status": "completed", "tag": "01fa0eb2-52e8-4cfe-8e35-883e6c82aeb1"}, {"server_uuid": "4e25180a-b979-44d1-a7d1-19dd30eee7a4", "name": "network-vif-plugged", "status": "completed", "tag": "b2d31d14-f64b-4833-b560-3b60af91131f"}, {"server_uuid": "36253bc6-1737-4654-a878-c1eaeb797c8e", "name": "network-vif-plugged", "status": "completed", "tag": "76ca3f3a-6da0-4186-a61f-54617a2436fa"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:02:16.273176 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-b52278d6-f743-45da-870d-d45d1228de09 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] 10.222.0.60 "GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf" status: 200 len: 1486 microversion: 2.91 time: 0.590285 Sep 14 09:02:16.277391 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1610/3162] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:02:15 2022] GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf => generated 1486 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:02:16.291238 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-7f72a7f6-ca89-4756-acf3-432c5ed550e7 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:16.291238 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-7f72a7f6-ca89-4756-acf3-432c5ed550e7 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: 680c3968-8912-45c4-b1c3-634c06ec30c3] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:02:16.309234 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7f72a7f6-ca89-4756-acf3-432c5ed550e7 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:16.310270 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7f72a7f6-ca89-4756-acf3-432c5ed550e7 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:16.310405 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-b8731629-57ec-4dd0-aeb1-00bdbf467943 req-a781dc1b-3c7a-4ad9-b125-b048856cfdd8 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:16.310821 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-b8731629-57ec-4dd0-aeb1-00bdbf467943 req-a781dc1b-3c7a-4ad9-b125-b048856cfdd8 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:16.311290 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-b8731629-57ec-4dd0-aeb1-00bdbf467943 req-a781dc1b-3c7a-4ad9-b125-b048856cfdd8 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:16.312469 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7f72a7f6-ca89-4756-acf3-432c5ed550e7 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:16.315641 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7f72a7f6-ca89-4756-acf3-432c5ed550e7 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:16.316334 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7f72a7f6-ca89-4756-acf3-432c5ed550e7 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:16.318990 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7f72a7f6-ca89-4756-acf3-432c5ed550e7 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:16.351114 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-b8731629-57ec-4dd0-aeb1-00bdbf467943 req-a781dc1b-3c7a-4ad9-b125-b048856cfdd8 service nova] Creating event network-vif-unplugged:01fa0eb2-52e8-4cfe-8e35-883e6c82aeb1 for instance 26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0 on n-h1-836830-18 Sep 14 09:02:16.351821 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-b8731629-57ec-4dd0-aeb1-00bdbf467943 req-a781dc1b-3c7a-4ad9-b125-b048856cfdd8 service nova] Creating event network-vif-plugged:b2d31d14-f64b-4833-b560-3b60af91131f for instance 4e25180a-b979-44d1-a7d1-19dd30eee7a4 on n-h1-836830-18 Sep 14 09:02:16.352529 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-b8731629-57ec-4dd0-aeb1-00bdbf467943 req-a781dc1b-3c7a-4ad9-b125-b048856cfdd8 service nova] Creating event network-vif-plugged:76ca3f3a-6da0-4186-a61f-54617a2436fa for instance 36253bc6-1737-4654-a878-c1eaeb797c8e on n-h1-836830-18 Sep 14 09:02:16.376114 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-b8731629-57ec-4dd0-aeb1-00bdbf467943 req-a781dc1b-3c7a-4ad9-b125-b048856cfdd8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.118869 Sep 14 09:02:16.380446 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1553/3163] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:02:16 2022] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:02:16.392087 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-873e5d4c-c046-4a10-a789-475374072eb7 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:16.395866 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-873e5d4c-c046-4a10-a789-475374072eb7 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] [instance: 4e25180a-b979-44d1-a7d1-19dd30eee7a4] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:02:16.411527 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-873e5d4c-c046-4a10-a789-475374072eb7 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:16.413281 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-873e5d4c-c046-4a10-a789-475374072eb7 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:16.413904 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-873e5d4c-c046-4a10-a789-475374072eb7 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:16.425275 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-873e5d4c-c046-4a10-a789-475374072eb7 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:16.425774 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-873e5d4c-c046-4a10-a789-475374072eb7 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:16.426220 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-873e5d4c-c046-4a10-a789-475374072eb7 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:17.204807 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=2 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:02:17.232528 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=6 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:02:18.025228 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-873e5d4c-c046-4a10-a789-475374072eb7 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e7ddc7c037439aad2f98277eef199e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e712ce30eb9c4128aa0ec1d425e9ab79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:18.037707 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-873e5d4c-c046-4a10-a789-475374072eb7 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] 10.222.0.60 "GET /compute/v2.1/servers/4e25180a-b979-44d1-a7d1-19dd30eee7a4" status: 200 len: 1321 microversion: 2.1 time: 1.655663 Sep 14 09:02:18.038730 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1554/3164] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:02:16 2022] GET /compute/v2.1/servers/4e25180a-b979-44d1-a7d1-19dd30eee7a4 => generated 1321 bytes in 1657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:02:18.043764 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-66498087-ac53-4c94-b772-af794ddff2c2 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:18.053547 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-66498087-ac53-4c94-b772-af794ddff2c2 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] [instance: 7558efb0-7f2d-42d5-9b6d-e442008b1c88] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:02:18.065277 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-66498087-ac53-4c94-b772-af794ddff2c2 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:18.066082 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-66498087-ac53-4c94-b772-af794ddff2c2 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:18.066702 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-66498087-ac53-4c94-b772-af794ddff2c2 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:18.067621 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-66498087-ac53-4c94-b772-af794ddff2c2 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:18.068255 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-66498087-ac53-4c94-b772-af794ddff2c2 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:18.075736 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-66498087-ac53-4c94-b772-af794ddff2c2 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:18.123848 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=2 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:02:19.532930 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-66498087-ac53-4c94-b772-af794ddff2c2 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b847ccce0654f2fa9df8367320a3218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9051111ca00649c591b6485d58bbc265', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:19.610371 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-66498087-ac53-4c94-b772-af794ddff2c2 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] 10.222.0.60 "GET /compute/v2.1/servers/7558efb0-7f2d-42d5-9b6d-e442008b1c88" status: 200 len: 1317 microversion: 2.1 time: 1.562119 Sep 14 09:02:19.616077 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1555/3165] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:02:18 2022] GET /compute/v2.1/servers/7558efb0-7f2d-42d5-9b6d-e442008b1c88 => generated 1317 bytes in 1577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:02:19.640621 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-492056f1-6ccd-4bda-a34d-cc4630e1ed30 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Calling method '.version_select at 0x7f7d487f1a60>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:19.690293 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-7f72a7f6-ca89-4756-acf3-432c5ed550e7 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:19.729786 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-7f72a7f6-ca89-4756-acf3-432c5ed550e7 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/680c3968-8912-45c4-b1c3-634c06ec30c3" status: 200 len: 1506 microversion: 2.1 time: 3.448847 Sep 14 09:02:19.733827 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1611/3166] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:02:16 2022] GET /compute/v2.1/servers/680c3968-8912-45c4-b1c3-634c06ec30c3 => generated 1506 bytes in 3456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:02:19.751438 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-f8bcb79c-9457-45c9-9da0-3be2f648e610 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:19.757194 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-f8bcb79c-9457-45c9-9da0-3be2f648e610 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] [instance: 26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:02:19.785666 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f8bcb79c-9457-45c9-9da0-3be2f648e610 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:19.786150 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f8bcb79c-9457-45c9-9da0-3be2f648e610 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:19.802973 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f8bcb79c-9457-45c9-9da0-3be2f648e610 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:19.804484 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f8bcb79c-9457-45c9-9da0-3be2f648e610 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:19.806707 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f8bcb79c-9457-45c9-9da0-3be2f648e610 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:19.808801 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f8bcb79c-9457-45c9-9da0-3be2f648e610 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:20.518423 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-f8bcb79c-9457-45c9-9da0-3be2f648e610 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:20.541427 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-f8bcb79c-9457-45c9-9da0-3be2f648e610 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:20.547053 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-f8bcb79c-9457-45c9-9da0-3be2f648e610 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:20.557618 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-f8bcb79c-9457-45c9-9da0-3be2f648e610 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] 10.222.0.60 "GET /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0" status: 200 len: 2613 microversion: 2.32 time: 0.815181 Sep 14 09:02:20.559158 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1612/3167] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:02:19 2022] GET /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0 => generated 2613 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:02:20.598504 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-64bc3dba-a782-4048-b2c1-70769f9b51e0 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:20.599179 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-64bc3dba-a782-4048-b2c1-70769f9b51e0 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] [instance: 0eb40c80-c056-4096-a586-7e957a63f7cf] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:02:20.624835 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-64bc3dba-a782-4048-b2c1-70769f9b51e0 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:20.625341 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-64bc3dba-a782-4048-b2c1-70769f9b51e0 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:20.631108 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-64bc3dba-a782-4048-b2c1-70769f9b51e0 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:20.637067 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-64bc3dba-a782-4048-b2c1-70769f9b51e0 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:20.640114 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-64bc3dba-a782-4048-b2c1-70769f9b51e0 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:20.647730 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-64bc3dba-a782-4048-b2c1-70769f9b51e0 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:20.848467 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-64bc3dba-a782-4048-b2c1-70769f9b51e0 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:20.853076 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:02:20.865804 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-64bc3dba-a782-4048-b2c1-70769f9b51e0 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:20.883956 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-64bc3dba-a782-4048-b2c1-70769f9b51e0 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:20.890988 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-64bc3dba-a782-4048-b2c1-70769f9b51e0 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] 10.222.0.60 "GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf" status: 200 len: 1544 microversion: 2.91 time: 0.303677 Sep 14 09:02:20.905459 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1613/3168] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:02:20 2022] GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf => generated 1544 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:02:20.919172 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-9377128f-9ba5-4210-befd-36f4abb89d24 req-dc0313bb-e704-4837-96bb-caa098740998 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0", "name": "network-vif-deleted", "tag": "01fa0eb2-52e8-4cfe-8e35-883e6c82aeb1"}, {"server_uuid": "26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0", "name": "network-vif-deleted", "tag": "5779091e-0903-4f0d-81c7-8bdda2add09d"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:02:20.958822 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-9377128f-9ba5-4210-befd-36f4abb89d24 req-dc0313bb-e704-4837-96bb-caa098740998 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:20.961230 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-9377128f-9ba5-4210-befd-36f4abb89d24 req-dc0313bb-e704-4837-96bb-caa098740998 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:20.964933 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-9377128f-9ba5-4210-befd-36f4abb89d24 req-dc0313bb-e704-4837-96bb-caa098740998 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:20.993438 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-9377128f-9ba5-4210-befd-36f4abb89d24 req-dc0313bb-e704-4837-96bb-caa098740998 service nova] Creating event network-vif-deleted:01fa0eb2-52e8-4cfe-8e35-883e6c82aeb1 for instance 26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0 on n-h1-836830-18 Sep 14 09:02:20.993965 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-9377128f-9ba5-4210-befd-36f4abb89d24 req-dc0313bb-e704-4837-96bb-caa098740998 service nova] Creating event network-vif-deleted:5779091e-0903-4f0d-81c7-8bdda2add09d for instance 26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0 on n-h1-836830-18 Sep 14 09:02:21.015462 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-9377128f-9ba5-4210-befd-36f4abb89d24 req-dc0313bb-e704-4837-96bb-caa098740998 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.103152 Sep 14 09:02:21.020174 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1614/3169] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:02:20 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:02:21.026201 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-4f8f2356-a94d-4066-993a-a1aaaf1ddab9 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:21.026953 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-4f8f2356-a94d-4066-993a-a1aaaf1ddab9 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] [instance: 4e25180a-b979-44d1-a7d1-19dd30eee7a4] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:02:21.069486 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4f8f2356-a94d-4066-993a-a1aaaf1ddab9 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:21.077102 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4f8f2356-a94d-4066-993a-a1aaaf1ddab9 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:21.083136 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4f8f2356-a94d-4066-993a-a1aaaf1ddab9 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:21.084117 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4f8f2356-a94d-4066-993a-a1aaaf1ddab9 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:21.084762 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4f8f2356-a94d-4066-993a-a1aaaf1ddab9 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:21.088425 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4f8f2356-a94d-4066-993a-a1aaaf1ddab9 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:21.648342 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-4f8f2356-a94d-4066-993a-a1aaaf1ddab9 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e7ddc7c037439aad2f98277eef199e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e712ce30eb9c4128aa0ec1d425e9ab79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:21.667145 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-4f8f2356-a94d-4066-993a-a1aaaf1ddab9 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] 10.222.0.60 "GET /compute/v2.1/servers/4e25180a-b979-44d1-a7d1-19dd30eee7a4" status: 200 len: 1512 microversion: 2.1 time: 0.645361 Sep 14 09:02:21.692499 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1615/3170] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:02:21 2022] GET /compute/v2.1/servers/4e25180a-b979-44d1-a7d1-19dd30eee7a4 => generated 1512 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:02:21.722838 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-3c5f6c93-a652-484f-a245-42c9f530f612 req-7ba81c99-6940-42eb-984c-fef44cc3bdb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "680c3968-8912-45c4-b1c3-634c06ec30c3", "name": "network-vif-unplugged", "status": "completed", "tag": "459779a8-3426-4989-910a-1f725b3e69c6"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:02:21.754814 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-3c5f6c93-a652-484f-a245-42c9f530f612 req-7ba81c99-6940-42eb-984c-fef44cc3bdb1 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:21.755688 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-3c5f6c93-a652-484f-a245-42c9f530f612 req-7ba81c99-6940-42eb-984c-fef44cc3bdb1 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:21.757009 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-3c5f6c93-a652-484f-a245-42c9f530f612 req-7ba81c99-6940-42eb-984c-fef44cc3bdb1 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:21.832635 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-3c5f6c93-a652-484f-a245-42c9f530f612 req-7ba81c99-6940-42eb-984c-fef44cc3bdb1 service nova] Creating event network-vif-unplugged:459779a8-3426-4989-910a-1f725b3e69c6 for instance 680c3968-8912-45c4-b1c3-634c06ec30c3 on n-h1-836830-18 Sep 14 09:02:21.861528 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-3c5f6c93-a652-484f-a245-42c9f530f612 req-7ba81c99-6940-42eb-984c-fef44cc3bdb1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.157138 Sep 14 09:02:21.874130 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1616/3171] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:02:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:02:21.889859 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-4df76ad2-9398-4fb3-b7a8-c2e5f8b7552f tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:21.905484 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-4df76ad2-9398-4fb3-b7a8-c2e5f8b7552f tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] [instance: 7558efb0-7f2d-42d5-9b6d-e442008b1c88] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:02:21.936686 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4df76ad2-9398-4fb3-b7a8-c2e5f8b7552f tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:21.937962 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4df76ad2-9398-4fb3-b7a8-c2e5f8b7552f tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:21.938657 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4df76ad2-9398-4fb3-b7a8-c2e5f8b7552f tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:21.939659 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4df76ad2-9398-4fb3-b7a8-c2e5f8b7552f tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:21.943381 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4df76ad2-9398-4fb3-b7a8-c2e5f8b7552f tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:21.944139 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4df76ad2-9398-4fb3-b7a8-c2e5f8b7552f tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:22.565022 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-4df76ad2-9398-4fb3-b7a8-c2e5f8b7552f tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b847ccce0654f2fa9df8367320a3218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9051111ca00649c591b6485d58bbc265', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:22.575517 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-4df76ad2-9398-4fb3-b7a8-c2e5f8b7552f tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] 10.222.0.60 "GET /compute/v2.1/servers/7558efb0-7f2d-42d5-9b6d-e442008b1c88" status: 200 len: 1317 microversion: 2.1 time: 0.699943 Sep 14 09:02:22.579262 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1617/3172] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:02:21 2022] GET /compute/v2.1/servers/7558efb0-7f2d-42d5-9b6d-e442008b1c88 => generated 1317 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:02:22.584476 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-888b3325-928f-43fa-abaa-84996d95a096 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:22.602265 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-888b3325-928f-43fa-abaa-84996d95a096 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: 680c3968-8912-45c4-b1c3-634c06ec30c3] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:02:22.617681 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-888b3325-928f-43fa-abaa-84996d95a096 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:22.627752 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-888b3325-928f-43fa-abaa-84996d95a096 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:22.628593 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-888b3325-928f-43fa-abaa-84996d95a096 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:22.629804 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-888b3325-928f-43fa-abaa-84996d95a096 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:22.632967 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-888b3325-928f-43fa-abaa-84996d95a096 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:22.633841 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-888b3325-928f-43fa-abaa-84996d95a096 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:23.282340 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-888b3325-928f-43fa-abaa-84996d95a096 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:23.293593 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-888b3325-928f-43fa-abaa-84996d95a096 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/680c3968-8912-45c4-b1c3-634c06ec30c3" status: 200 len: 1449 microversion: 2.1 time: 0.712896 Sep 14 09:02:23.301904 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1618/3173] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:02:22 2022] GET /compute/v2.1/servers/680c3968-8912-45c4-b1c3-634c06ec30c3 => generated 1449 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:02:23.316914 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-24ce02b0-c274-4c0a-92be-24df23fef9b8 req-cad499b3-dcb9-480e-9c1b-5b52c3b36be6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7558efb0-7f2d-42d5-9b6d-e442008b1c88", "tag": "84b61202-de19-4a04-b9dd-3a01a864606e"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:02:23.336100 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-24ce02b0-c274-4c0a-92be-24df23fef9b8 req-cad499b3-dcb9-480e-9c1b-5b52c3b36be6 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:23.339725 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-24ce02b0-c274-4c0a-92be-24df23fef9b8 req-cad499b3-dcb9-480e-9c1b-5b52c3b36be6 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:23.340398 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-24ce02b0-c274-4c0a-92be-24df23fef9b8 req-cad499b3-dcb9-480e-9c1b-5b52c3b36be6 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:23.359716 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-24ce02b0-c274-4c0a-92be-24df23fef9b8 req-cad499b3-dcb9-480e-9c1b-5b52c3b36be6 service nova] Creating event network-changed:84b61202-de19-4a04-b9dd-3a01a864606e for instance 7558efb0-7f2d-42d5-9b6d-e442008b1c88 on n-h2-836830-18 Sep 14 09:02:23.381052 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-24ce02b0-c274-4c0a-92be-24df23fef9b8 req-cad499b3-dcb9-480e-9c1b-5b52c3b36be6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076113 Sep 14 09:02:23.389247 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1619/3174] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:02:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:02:23.403993 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-fbc1ee53-cc08-406e-bc63-c24a828b22aa tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:23.413040 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-fbc1ee53-cc08-406e-bc63-c24a828b22aa tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] [instance: 26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:02:23.424601 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fbc1ee53-cc08-406e-bc63-c24a828b22aa tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:23.426668 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fbc1ee53-cc08-406e-bc63-c24a828b22aa tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:23.427177 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fbc1ee53-cc08-406e-bc63-c24a828b22aa tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:23.428094 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fbc1ee53-cc08-406e-bc63-c24a828b22aa tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:23.428726 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fbc1ee53-cc08-406e-bc63-c24a828b22aa tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:23.429308 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fbc1ee53-cc08-406e-bc63-c24a828b22aa tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:23.651323 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-fbc1ee53-cc08-406e-bc63-c24a828b22aa tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:23.688694 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-fbc1ee53-cc08-406e-bc63-c24a828b22aa tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:23.700995 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-fbc1ee53-cc08-406e-bc63-c24a828b22aa tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:23.703321 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-fbc1ee53-cc08-406e-bc63-c24a828b22aa tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] 10.222.0.60 "GET /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0" status: 200 len: 2144 microversion: 2.32 time: 0.310322 Sep 14 09:02:23.716480 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1620/3175] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:02:23 2022] GET /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0 => generated 2144 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:02:23.743379 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-140e91a0-3762-4648-8e3e-aa957623784c tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:23.743967 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-140e91a0-3762-4648-8e3e-aa957623784c tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] [instance: 3d29c068-39c8-4851-82cf-b7639f689f24] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:02:23.760823 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-140e91a0-3762-4648-8e3e-aa957623784c tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:23.762343 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-140e91a0-3762-4648-8e3e-aa957623784c tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:23.763572 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-140e91a0-3762-4648-8e3e-aa957623784c tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:23.765974 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-140e91a0-3762-4648-8e3e-aa957623784c tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:23.767276 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-140e91a0-3762-4648-8e3e-aa957623784c tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:23.768663 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-140e91a0-3762-4648-8e3e-aa957623784c tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:24.100369 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-140e91a0-3762-4648-8e3e-aa957623784c tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e7ddc7c037439aad2f98277eef199e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e712ce30eb9c4128aa0ec1d425e9ab79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:24.115207 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-140e91a0-3762-4648-8e3e-aa957623784c tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] 10.222.0.60 "GET /compute/v2.1/servers/3d29c068-39c8-4851-82cf-b7639f689f24" status: 200 len: 1510 microversion: 2.1 time: 0.384728 Sep 14 09:02:24.118711 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1621/3176] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:02:23 2022] GET /compute/v2.1/servers/3d29c068-39c8-4851-82cf-b7639f689f24 => generated 1510 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:02:24.130282 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-e89c1063-a589-4fb9-94d2-4c7193602790 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:24.131160 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-e89c1063-a589-4fb9-94d2-4c7193602790 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] [instance: 0eb40c80-c056-4096-a586-7e957a63f7cf] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:02:24.142400 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e89c1063-a589-4fb9-94d2-4c7193602790 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:24.143152 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e89c1063-a589-4fb9-94d2-4c7193602790 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:24.148378 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e89c1063-a589-4fb9-94d2-4c7193602790 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:24.149451 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e89c1063-a589-4fb9-94d2-4c7193602790 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:24.152027 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e89c1063-a589-4fb9-94d2-4c7193602790 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:24.152788 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e89c1063-a589-4fb9-94d2-4c7193602790 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:24.292313 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-e89c1063-a589-4fb9-94d2-4c7193602790 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:24.310970 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-e89c1063-a589-4fb9-94d2-4c7193602790 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:24.315649 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-e89c1063-a589-4fb9-94d2-4c7193602790 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:24.330680 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-e89c1063-a589-4fb9-94d2-4c7193602790 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] 10.222.0.60 "GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf" status: 200 len: 1544 microversion: 2.91 time: 0.209708 Sep 14 09:02:24.346963 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1622/3177] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:02:24 2022] GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf => generated 1544 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:02:24.355568 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-fb5e182e-98eb-4eb9-9508-e1db292c61ea req-528cd31f-2068-4958-beb2-241567115f26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0", "name": "network-vif-deleted", "tag": "3ef522d5-07e7-4dc1-89cc-6972e61a2d28"}, {"server_uuid": "26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0", "name": "network-vif-deleted", "tag": "3de3b6b2-e333-42d2-a891-af01ff3ccfd0"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:02:24.378851 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-fb5e182e-98eb-4eb9-9508-e1db292c61ea req-528cd31f-2068-4958-beb2-241567115f26 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:24.378851 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-fb5e182e-98eb-4eb9-9508-e1db292c61ea req-528cd31f-2068-4958-beb2-241567115f26 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:24.378851 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-fb5e182e-98eb-4eb9-9508-e1db292c61ea req-528cd31f-2068-4958-beb2-241567115f26 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:24.403134 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-fb5e182e-98eb-4eb9-9508-e1db292c61ea req-528cd31f-2068-4958-beb2-241567115f26 service nova] Creating event network-vif-deleted:3ef522d5-07e7-4dc1-89cc-6972e61a2d28 for instance 26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0 on n-h1-836830-18 Sep 14 09:02:24.403665 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-fb5e182e-98eb-4eb9-9508-e1db292c61ea req-528cd31f-2068-4958-beb2-241567115f26 service nova] Creating event network-vif-deleted:3de3b6b2-e333-42d2-a891-af01ff3ccfd0 for instance 26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0 on n-h1-836830-18 Sep 14 09:02:24.422517 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-fb5e182e-98eb-4eb9-9508-e1db292c61ea req-528cd31f-2068-4958-beb2-241567115f26 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.087410 Sep 14 09:02:24.424898 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1623/3178] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:02:24 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:02:24.439158 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-4a928372-6802-42d8-bb93-6271c0d71aa7 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:24.439968 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-4a928372-6802-42d8-bb93-6271c0d71aa7 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: 680c3968-8912-45c4-b1c3-634c06ec30c3] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:02:24.454435 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4a928372-6802-42d8-bb93-6271c0d71aa7 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:24.454992 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4a928372-6802-42d8-bb93-6271c0d71aa7 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:24.455412 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4a928372-6802-42d8-bb93-6271c0d71aa7 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:24.456146 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4a928372-6802-42d8-bb93-6271c0d71aa7 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:24.461755 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4a928372-6802-42d8-bb93-6271c0d71aa7 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:24.462159 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4a928372-6802-42d8-bb93-6271c0d71aa7 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:24.550851 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-4a928372-6802-42d8-bb93-6271c0d71aa7 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: 680c3968-8912-45c4-b1c3-634c06ec30c3] Going to try to terminate instance {{(pid=128758) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:02:24.564041 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.compute.api [None req-4a928372-6802-42d8-bb93-6271c0d71aa7 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: 680c3968-8912-45c4-b1c3-634c06ec30c3] Working on deleting snapshot 1143d6e0-1e01-4356-84ae-46adf7de2622 from shelved instance... Sep 14 09:02:28.057449 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=46 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:02:29.591584 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=88 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:02:34.454131 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:02:34.564071 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=50 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:02:34.605272 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-492056f1-6ccd-4bda-a34d-cc4630e1ed30 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] 10.222.0.60 "GET /compute/v2.1/images/81e97ec9-8086-403e-b25e-9cf16f6eb89d" status: 200 len: 1463 microversion: 2.1 time: 14.984031 Sep 14 09:02:34.605869 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1556/3179] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:02:19 2022] GET /compute/v2.1/images/81e97ec9-8086-403e-b25e-9cf16f6eb89d => generated 1463 bytes in 14989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:02:34.628644 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-0fc52b06-aa50-4402-a33d-faebb0890921 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:34.629272 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-0fc52b06-aa50-4402-a33d-faebb0890921 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] [instance: 7558efb0-7f2d-42d5-9b6d-e442008b1c88] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:02:34.648200 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0fc52b06-aa50-4402-a33d-faebb0890921 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:34.648699 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0fc52b06-aa50-4402-a33d-faebb0890921 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:34.649139 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0fc52b06-aa50-4402-a33d-faebb0890921 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:34.649852 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0fc52b06-aa50-4402-a33d-faebb0890921 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:34.650305 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0fc52b06-aa50-4402-a33d-faebb0890921 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:34.650735 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0fc52b06-aa50-4402-a33d-faebb0890921 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:34.819462 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-0fc52b06-aa50-4402-a33d-faebb0890921 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b847ccce0654f2fa9df8367320a3218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9051111ca00649c591b6485d58bbc265', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:34.829383 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-0fc52b06-aa50-4402-a33d-faebb0890921 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] 10.222.0.60 "GET /compute/v2.1/servers/7558efb0-7f2d-42d5-9b6d-e442008b1c88" status: 200 len: 1317 microversion: 2.1 time: 0.221487 Sep 14 09:02:34.830332 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1557/3180] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:02:34 2022] GET /compute/v2.1/servers/7558efb0-7f2d-42d5-9b6d-e442008b1c88 => generated 1317 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:02:34.836091 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9e29f764-6c10-41ff-9126-6ebb8e8059b6 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:34.837168 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-9e29f764-6c10-41ff-9126-6ebb8e8059b6 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] [instance: 36253bc6-1737-4654-a878-c1eaeb797c8e] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:02:34.844426 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9e29f764-6c10-41ff-9126-6ebb8e8059b6 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:34.845194 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9e29f764-6c10-41ff-9126-6ebb8e8059b6 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:34.845896 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9e29f764-6c10-41ff-9126-6ebb8e8059b6 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:34.846840 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9e29f764-6c10-41ff-9126-6ebb8e8059b6 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:34.847538 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9e29f764-6c10-41ff-9126-6ebb8e8059b6 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:34.848178 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9e29f764-6c10-41ff-9126-6ebb8e8059b6 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:35.138446 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-4a928372-6802-42d8-bb93-6271c0d71aa7 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: 680c3968-8912-45c4-b1c3-634c06ec30c3] Doing local delete in cell 0a35f87f-19b7-4b11-98e6-8bcd07b0466f(cell1) {{(pid=128758) _delete /opt/stack/nova/nova/compute/api.py:2546}} Sep 14 09:02:35.139212 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4a928372-6802-42d8-bb93-6271c0d71aa7 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:35.139702 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4a928372-6802-42d8-bb93-6271c0d71aa7 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:35.140143 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4a928372-6802-42d8-bb93-6271c0d71aa7 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:35.143636 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.compute.api [None req-4a928372-6802-42d8-bb93-6271c0d71aa7 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: 680c3968-8912-45c4-b1c3-634c06ec30c3] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Sep 14 09:02:35.146075 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-9e29f764-6c10-41ff-9126-6ebb8e8059b6 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e7ddc7c037439aad2f98277eef199e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e712ce30eb9c4128aa0ec1d425e9ab79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:35.147536 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.network.neutron [None req-4a928372-6802-42d8-bb93-6271c0d71aa7 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: 680c3968-8912-45c4-b1c3-634c06ec30c3] deallocate_for_instance() {{(pid=128758) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Sep 14 09:02:35.157402 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-9e29f764-6c10-41ff-9126-6ebb8e8059b6 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] 10.222.0.60 "GET /compute/v2.1/servers/36253bc6-1737-4654-a878-c1eaeb797c8e" status: 200 len: 1511 microversion: 2.1 time: 0.325512 Sep 14 09:02:35.161121 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1558/3181] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:02:34 2022] GET /compute/v2.1/servers/36253bc6-1737-4654-a878-c1eaeb797c8e => generated 1511 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:02:35.173146 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-819a456d-56e4-41a3-bd3b-0258e8ea0ca5 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:35.174101 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-819a456d-56e4-41a3-bd3b-0258e8ea0ca5 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] [instance: 26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:02:35.191838 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-819a456d-56e4-41a3-bd3b-0258e8ea0ca5 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:35.194325 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-819a456d-56e4-41a3-bd3b-0258e8ea0ca5 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:35.195096 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-819a456d-56e4-41a3-bd3b-0258e8ea0ca5 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:35.197071 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-819a456d-56e4-41a3-bd3b-0258e8ea0ca5 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:35.198128 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-819a456d-56e4-41a3-bd3b-0258e8ea0ca5 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:35.199884 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-819a456d-56e4-41a3-bd3b-0258e8ea0ca5 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:35.344063 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-819a456d-56e4-41a3-bd3b-0258e8ea0ca5 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:35.356283 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-819a456d-56e4-41a3-bd3b-0258e8ea0ca5 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:35.358069 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-819a456d-56e4-41a3-bd3b-0258e8ea0ca5 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:35.360056 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-819a456d-56e4-41a3-bd3b-0258e8ea0ca5 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] 10.222.0.60 "GET /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0" status: 200 len: 1874 microversion: 2.32 time: 0.197784 Sep 14 09:02:35.376360 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1559/3182] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:02:35 2022] GET /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0 => generated 1874 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:02:35.386432 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-6e5aa096-d295-4ff1-934d-06b780f8d2cd tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:35.387984 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-6e5aa096-d295-4ff1-934d-06b780f8d2cd tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] [instance: 0eb40c80-c056-4096-a586-7e957a63f7cf] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:02:35.394368 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6e5aa096-d295-4ff1-934d-06b780f8d2cd tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:35.395206 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6e5aa096-d295-4ff1-934d-06b780f8d2cd tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:35.395823 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6e5aa096-d295-4ff1-934d-06b780f8d2cd tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:35.396716 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6e5aa096-d295-4ff1-934d-06b780f8d2cd tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:35.397860 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6e5aa096-d295-4ff1-934d-06b780f8d2cd tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:35.398448 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6e5aa096-d295-4ff1-934d-06b780f8d2cd tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:35.538371 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-6e5aa096-d295-4ff1-934d-06b780f8d2cd tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:35.549985 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-6e5aa096-d295-4ff1-934d-06b780f8d2cd tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:35.554756 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-6e5aa096-d295-4ff1-934d-06b780f8d2cd tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:35.567843 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-6e5aa096-d295-4ff1-934d-06b780f8d2cd tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] 10.222.0.60 "GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf" status: 200 len: 1544 microversion: 2.91 time: 0.189977 Sep 14 09:02:35.571559 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1560/3183] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:02:35 2022] GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf => generated 1544 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:02:35.581221 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-b65bec6e-03d8-4344-acd6-65a0ceb21a57 req-58aec45a-f1f7-40f9-ab2a-896f1396180e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7558efb0-7f2d-42d5-9b6d-e442008b1c88", "name": "network-vif-plugged", "status": "completed", "tag": "84b61202-de19-4a04-b9dd-3a01a864606e"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:02:35.600044 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-b65bec6e-03d8-4344-acd6-65a0ceb21a57 req-58aec45a-f1f7-40f9-ab2a-896f1396180e service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:35.601036 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-b65bec6e-03d8-4344-acd6-65a0ceb21a57 req-58aec45a-f1f7-40f9-ab2a-896f1396180e service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:35.601733 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-b65bec6e-03d8-4344-acd6-65a0ceb21a57 req-58aec45a-f1f7-40f9-ab2a-896f1396180e service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:35.640230 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-b65bec6e-03d8-4344-acd6-65a0ceb21a57 req-58aec45a-f1f7-40f9-ab2a-896f1396180e service nova] Creating event network-vif-plugged:84b61202-de19-4a04-b9dd-3a01a864606e for instance 7558efb0-7f2d-42d5-9b6d-e442008b1c88 on n-h2-836830-18 Sep 14 09:02:35.650034 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-b65bec6e-03d8-4344-acd6-65a0ceb21a57 req-58aec45a-f1f7-40f9-ab2a-896f1396180e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076972 Sep 14 09:02:35.653645 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1561/3184] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:02:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:02:35.662152 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9e43a636-6e59-4e07-b101-258217281230 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Calling method '.version_select at 0x7f7d4860d940>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:35.765040 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-9e43a636-6e59-4e07-b101-258217281230 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] 10.222.0.60 "GET /compute/v2.1/images/81e97ec9-8086-403e-b25e-9cf16f6eb89d" status: 200 len: 1463 microversion: 2.1 time: 0.108531 Sep 14 09:02:35.780173 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1562/3185] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:02:35 2022] GET /compute/v2.1/images/81e97ec9-8086-403e-b25e-9cf16f6eb89d => generated 1463 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:02:35.795672 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-22870459-893e-4b68-8728-cc4465883055 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:35.815146 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-22870459-893e-4b68-8728-cc4465883055 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd6e7ddc7c037439aad2f98277eef199e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e712ce30eb9c4128aa0ec1d425e9ab79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:35.817207 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-22870459-893e-4b68-8728-cc4465883055 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'e712ce30eb9c4128aa0ec1d425e9ab79'} {{(pid=128759) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 14 09:02:35.847887 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-22870459-893e-4b68-8728-cc4465883055 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:35.849238 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-22870459-893e-4b68-8728-cc4465883055 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:35.849845 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-22870459-893e-4b68-8728-cc4465883055 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:35.850769 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-22870459-893e-4b68-8728-cc4465883055 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:35.852085 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-22870459-893e-4b68-8728-cc4465883055 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:35.864227 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-22870459-893e-4b68-8728-cc4465883055 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:36.015721 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.multi_cell_list [None req-22870459-893e-4b68-8728-cc4465883055 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128759) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 14 09:02:36.096869 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-22870459-893e-4b68-8728-cc4465883055 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e7ddc7c037439aad2f98277eef199e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e712ce30eb9c4128aa0ec1d425e9ab79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:36.108039 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-22870459-893e-4b68-8728-cc4465883055 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:36.108535 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-22870459-893e-4b68-8728-cc4465883055 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:36.109489 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-22870459-893e-4b68-8728-cc4465883055 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:36.263071 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.network.neutron [None req-4a928372-6802-42d8-bb93-6271c0d71aa7 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: 680c3968-8912-45c4-b1c3-634c06ec30c3] Updating instance_info_cache with network_info: [] {{(pid=128758) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 14 09:02:36.361875 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-22870459-893e-4b68-8728-cc4465883055 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] 10.222.0.60 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1515 microversion: 2.1 time: 0.579056 Sep 14 09:02:36.362406 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1563/3186] 10.222.0.60 () {58 vars in 1167 bytes} [Wed Sep 14 09:02:35 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1515 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:02:36.383659 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-728b7df4-3553-411a-bb2e-637ce5306d03 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:36.384684 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-728b7df4-3553-411a-bb2e-637ce5306d03 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] [instance: ebf9bfa9-e941-4d23-8f6c-9867102feff2] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:02:36.400436 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-728b7df4-3553-411a-bb2e-637ce5306d03 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:36.401363 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-728b7df4-3553-411a-bb2e-637ce5306d03 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:36.402081 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-728b7df4-3553-411a-bb2e-637ce5306d03 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:36.403118 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-728b7df4-3553-411a-bb2e-637ce5306d03 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:36.403824 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-728b7df4-3553-411a-bb2e-637ce5306d03 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:36.404481 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-728b7df4-3553-411a-bb2e-637ce5306d03 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:36.787600 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-4a928372-6802-42d8-bb93-6271c0d71aa7 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "DELETE /compute/v2.1/servers/680c3968-8912-45c4-b1c3-634c06ec30c3" status: 204 len: 0 microversion: 2.1 time: 12.360439 Sep 14 09:02:36.790364 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1624/3187] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:02:24 2022] DELETE /compute/v2.1/servers/680c3968-8912-45c4-b1c3-634c06ec30c3 => generated 0 bytes in 12365 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:02:36.802328 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d53085fd-0a68-4b9a-8cac-a3e0112c5f74 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:36.803540 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-d53085fd-0a68-4b9a-8cac-a3e0112c5f74 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] [instance: 7558efb0-7f2d-42d5-9b6d-e442008b1c88] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:02:36.817754 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d53085fd-0a68-4b9a-8cac-a3e0112c5f74 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:36.819115 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d53085fd-0a68-4b9a-8cac-a3e0112c5f74 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:36.819932 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d53085fd-0a68-4b9a-8cac-a3e0112c5f74 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:36.822467 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d53085fd-0a68-4b9a-8cac-a3e0112c5f74 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:36.824077 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d53085fd-0a68-4b9a-8cac-a3e0112c5f74 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:36.824703 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d53085fd-0a68-4b9a-8cac-a3e0112c5f74 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:37.044375 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-728b7df4-3553-411a-bb2e-637ce5306d03 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a475c6e2b35f494aa8380aa1783e1779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c6f0c84e964383af6a4025d80fc93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:37.052875 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-728b7df4-3553-411a-bb2e-637ce5306d03 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] 10.222.0.60 "GET /compute/v2.1/servers/ebf9bfa9-e941-4d23-8f6c-9867102feff2" status: 200 len: 1466 microversion: 2.1 time: 0.689188 Sep 14 09:02:37.053466 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1564/3188] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:02:36 2022] GET /compute/v2.1/servers/ebf9bfa9-e941-4d23-8f6c-9867102feff2 => generated 1466 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:02:37.061365 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-d53085fd-0a68-4b9a-8cac-a3e0112c5f74 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b847ccce0654f2fa9df8367320a3218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9051111ca00649c591b6485d58bbc265', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:37.076639 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-599d372e-cdb6-4ec7-8d86-f5c8a093ddb3 req-b965aba8-258e-488b-b965-edb5c9cfd53e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "680c3968-8912-45c4-b1c3-634c06ec30c3", "name": "network-vif-deleted", "tag": "459779a8-3426-4989-910a-1f725b3e69c6"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:02:37.078630 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-d53085fd-0a68-4b9a-8cac-a3e0112c5f74 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] 10.222.0.60 "GET /compute/v2.1/servers/7558efb0-7f2d-42d5-9b6d-e442008b1c88" status: 200 len: 1317 microversion: 2.1 time: 0.285296 Sep 14 09:02:37.079475 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1625/3189] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:02:36 2022] GET /compute/v2.1/servers/7558efb0-7f2d-42d5-9b6d-e442008b1c88 => generated 1317 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:02:37.086763 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-599d372e-cdb6-4ec7-8d86-f5c8a093ddb3 req-b965aba8-258e-488b-b965-edb5c9cfd53e service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:37.087280 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-599d372e-cdb6-4ec7-8d86-f5c8a093ddb3 req-b965aba8-258e-488b-b965-edb5c9cfd53e service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:37.087722 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-599d372e-cdb6-4ec7-8d86-f5c8a093ddb3 req-b965aba8-258e-488b-b965-edb5c9cfd53e service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:37.100521 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.compute.server_external_events [req-599d372e-cdb6-4ec7-8d86-f5c8a093ddb3 req-b965aba8-258e-488b-b965-edb5c9cfd53e service nova] Unable to find a host for instance 680c3968-8912-45c4-b1c3-634c06ec30c3. Dropping event network-vif-deleted {{(pid=128759) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 14 09:02:37.101432 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-599d372e-cdb6-4ec7-8d86-f5c8a093ddb3 req-b965aba8-258e-488b-b965-edb5c9cfd53e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.047033 Sep 14 09:02:37.103825 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c426f337-694a-45a2-98bd-ec8102e18b80 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:37.105778 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1565/3190] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:02:37 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 52 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 14 09:02:37.109606 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-c426f337-694a-45a2-98bd-ec8102e18b80 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd6e7ddc7c037439aad2f98277eef199e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e712ce30eb9c4128aa0ec1d425e9ab79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:37.110613 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-c426f337-694a-45a2-98bd-ec8102e18b80 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-567326605', 'deleted': False, 'project_id': 'e712ce30eb9c4128aa0ec1d425e9ab79'} {{(pid=128758) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 14 09:02:37.110766 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-753fcfaf-b91b-4df8-9e38-69bbc93c88ab tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:37.111274 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-753fcfaf-b91b-4df8-9e38-69bbc93c88ab tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] [instance: 26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:02:37.118121 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-753fcfaf-b91b-4df8-9e38-69bbc93c88ab tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:37.118863 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-753fcfaf-b91b-4df8-9e38-69bbc93c88ab tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:37.119538 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-753fcfaf-b91b-4df8-9e38-69bbc93c88ab tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:37.121172 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-753fcfaf-b91b-4df8-9e38-69bbc93c88ab tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:37.121805 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-753fcfaf-b91b-4df8-9e38-69bbc93c88ab tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:37.122239 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-753fcfaf-b91b-4df8-9e38-69bbc93c88ab tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:37.126951 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c426f337-694a-45a2-98bd-ec8102e18b80 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:37.127455 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c426f337-694a-45a2-98bd-ec8102e18b80 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:37.127880 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c426f337-694a-45a2-98bd-ec8102e18b80 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:37.128609 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c426f337-694a-45a2-98bd-ec8102e18b80 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:37.129060 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c426f337-694a-45a2-98bd-ec8102e18b80 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:37.129482 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c426f337-694a-45a2-98bd-ec8102e18b80 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:37.241849 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-753fcfaf-b91b-4df8-9e38-69bbc93c88ab tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:37.259862 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-753fcfaf-b91b-4df8-9e38-69bbc93c88ab tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:37.261936 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-753fcfaf-b91b-4df8-9e38-69bbc93c88ab tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:37.267290 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-753fcfaf-b91b-4df8-9e38-69bbc93c88ab tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] 10.222.0.60 "GET /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0" status: 200 len: 1874 microversion: 2.32 time: 0.156447 Sep 14 09:02:37.269571 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1566/3191] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:02:37 2022] GET /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0 => generated 1874 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:02:37.280453 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b367e33b-dd3b-4594-9e05-1f2d6aac77c8 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:37.283701 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b367e33b-dd3b-4594-9e05-1f2d6aac77c8 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] [instance: 0eb40c80-c056-4096-a586-7e957a63f7cf] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:02:37.287812 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.multi_cell_list [None req-c426f337-694a-45a2-98bd-ec8102e18b80 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128758) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 14 09:02:37.302697 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b367e33b-dd3b-4594-9e05-1f2d6aac77c8 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:37.303553 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b367e33b-dd3b-4594-9e05-1f2d6aac77c8 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:37.305391 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b367e33b-dd3b-4594-9e05-1f2d6aac77c8 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:37.307692 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b367e33b-dd3b-4594-9e05-1f2d6aac77c8 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:37.308993 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b367e33b-dd3b-4594-9e05-1f2d6aac77c8 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:37.310291 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b367e33b-dd3b-4594-9e05-1f2d6aac77c8 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:37.379216 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-c426f337-694a-45a2-98bd-ec8102e18b80 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e7ddc7c037439aad2f98277eef199e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e712ce30eb9c4128aa0ec1d425e9ab79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:37.388835 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c426f337-694a-45a2-98bd-ec8102e18b80 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:37.389337 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c426f337-694a-45a2-98bd-ec8102e18b80 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:37.389774 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c426f337-694a-45a2-98bd-ec8102e18b80 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:37.454192 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b367e33b-dd3b-4594-9e05-1f2d6aac77c8 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:37.468867 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b367e33b-dd3b-4594-9e05-1f2d6aac77c8 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:37.473588 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b367e33b-dd3b-4594-9e05-1f2d6aac77c8 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:37.486975 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b367e33b-dd3b-4594-9e05-1f2d6aac77c8 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] 10.222.0.60 "GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf" status: 200 len: 1544 microversion: 2.91 time: 0.215986 Sep 14 09:02:37.500588 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1567/3192] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:02:37 2022] GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf => generated 1544 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:02:37.519520 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-0d8d5ca9-a53f-4d7f-98c9-795db5d7ca03 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:37.520574 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-0d8d5ca9-a53f-4d7f-98c9-795db5d7ca03 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: 680c3968-8912-45c4-b1c3-634c06ec30c3] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:02:37.529634 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0d8d5ca9-a53f-4d7f-98c9-795db5d7ca03 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:37.530619 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0d8d5ca9-a53f-4d7f-98c9-795db5d7ca03 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:37.531362 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0d8d5ca9-a53f-4d7f-98c9-795db5d7ca03 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:37.532621 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0d8d5ca9-a53f-4d7f-98c9-795db5d7ca03 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:37.533587 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0d8d5ca9-a53f-4d7f-98c9-795db5d7ca03 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:37.535130 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0d8d5ca9-a53f-4d7f-98c9-795db5d7ca03 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:37.558762 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-0d8d5ca9-a53f-4d7f-98c9-795db5d7ca03 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] HTTP exception thrown: Instance 680c3968-8912-45c4-b1c3-634c06ec30c3 could not be found. Sep 14 09:02:37.561055 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-0d8d5ca9-a53f-4d7f-98c9-795db5d7ca03 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Request method failure captured: Sep 14 09:02:37.561055 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/680c3968-8912-45c4-b1c3-634c06ec30c3 HTTP/1.1 Sep 14 09:02:37.561055 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:02:37.561055 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:02:37.561055 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:02:37.561055 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:02:37.561055 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:02:37.561055 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:02:37.561055 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:02:37.561055 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:02:37.561055 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZfruMTQYBTAiiDSnzM1mYEpmuEj9qljISQOJ4EBe2ad6zsfFzAf8FVBubQCt-Sdr-zCKCq1jxjsj_azLMK_SQWZ09VXr62FV-261vpzTW6inln_93a6hl3DeVdX6cuYwx-Go-beMey4bY4s6iPFtULEKgIbxHUgjvgK1DEFOEvCwSQ Sep 14 09:02:37.561055 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:02:37.561055 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:02:37.561055 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:02:37.561055 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:02:37.561055 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:02:37.561055 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:02:37.561055 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 4d42bf4d573b4bf9a0d8c9e73260af7e Sep 14 09:02:37.561055 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-DeleteServersTestJSON-1669995002 Sep 14 09:02:37.561055 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:02:37.561055 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:02:37.561055 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/4d42bf4d573b4bf9a0d8c9e73260af7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_4d42bf4d573b4bf9a0d8c9e73260af7e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4d42bf4d573b4bf9a0d8c9e73260af7e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4d42bf4d573b4bf9a0d8c9e73260af7e"}]}] Sep 14 09:02:37.561055 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-DeleteServersTestJSON-1669995002 Sep 14 09:02:37.561055 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 4d42bf4d573b4bf9a0d8c9e73260af7e Sep 14 09:02:37.561055 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-DeleteServersTestJSON-1669995002 Sep 14 09:02:37.561055 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-DeleteServersTestJSON-1669995002-project Sep 14 09:02:37.561055 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:02:37.561055 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:02:37.561055 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 47c95b28481b451bb03fb2c0240d0310 Sep 14 09:02:37.561055 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-DeleteServersTestJSON-1669995002-project Sep 14 09:02:37.561055 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:02:37.561055 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance 680c3968-8912-45c4-b1c3-634c06ec30c3 could not be found. Sep 14 09:02:37.561055 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '680c3968-8912-45c4-b1c3-634c06ec30c3'} Sep 14 09:02:37.561055 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:02:37.561055 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:02:37.561055 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:02:37.561055 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:02:37.561055 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:02:37.561055 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:02:37.561055 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:02:37.561055 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:02:37.561055 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:02:37.561055 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:02:37.561055 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 680c3968-8912-45c4-b1c3-634c06ec30c3 could not be found. Sep 14 09:02:37.561055 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:02:37.561055 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:02:37.561055 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:02:37.561055 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:02:37.561055 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:02:37.561055 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:02:37.561055 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:02:37.561055 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:02:37.561055 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:02:37.561055 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:02:37.561055 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:02:37.561055 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:02:37.561055 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:02:37.561055 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:02:37.561055 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:02:37.561055 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:02:37.561055 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 680c3968-8912-45c4-b1c3-634c06ec30c3 could not be found. Sep 14 09:02:37.561055 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:02:37.561055 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:02:37.561055 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:02:37.565851 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:02:37.565851 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:02:37.565851 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:02:37.565851 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:02:37.565851 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:02:37.565851 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 680c3968-8912-45c4-b1c3-634c06ec30c3 could not be found. Sep 14 09:02:37.565851 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:02:37.570966 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-0d8d5ca9-a53f-4d7f-98c9-795db5d7ca03 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Returning 404 to user: Instance 680c3968-8912-45c4-b1c3-634c06ec30c3 could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:02:37.572915 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-0d8d5ca9-a53f-4d7f-98c9-795db5d7ca03 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/680c3968-8912-45c4-b1c3-634c06ec30c3" status: 404 len: 111 microversion: 2.1 time: 0.070756 Sep 14 09:02:37.579568 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1568/3193] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:02:37 2022] GET /compute/v2.1/servers/680c3968-8912-45c4-b1c3-634c06ec30c3 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:02:37.600223 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-97783275-be4c-4c94-b482-cdf4ebca731c tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Calling method '.version_select at 0x7f7d487f2ca0>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:37.772775 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-c426f337-694a-45a2-98bd-ec8102e18b80 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] 10.222.0.60 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-567326605" status: 200 len: 1513 microversion: 2.1 time: 0.682470 Sep 14 09:02:37.773220 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1626/3194] 10.222.0.60 () {58 vars in 1261 bytes} [Wed Sep 14 09:02:37 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-567326605 => generated 1513 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:02:37.801210 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c25d4b47-9410-4395-9730-3efc9646735e tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:37.806361 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-c25d4b47-9410-4395-9730-3efc9646735e tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd6e7ddc7c037439aad2f98277eef199e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e712ce30eb9c4128aa0ec1d425e9ab79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:37.808540 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-c25d4b47-9410-4395-9730-3efc9646735e tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'e712ce30eb9c4128aa0ec1d425e9ab79'} {{(pid=128758) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 14 09:02:37.825512 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c25d4b47-9410-4395-9730-3efc9646735e tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:37.833134 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c25d4b47-9410-4395-9730-3efc9646735e tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:37.833606 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c25d4b47-9410-4395-9730-3efc9646735e tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:37.834380 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c25d4b47-9410-4395-9730-3efc9646735e tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:37.834841 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c25d4b47-9410-4395-9730-3efc9646735e tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:37.835292 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c25d4b47-9410-4395-9730-3efc9646735e tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:37.889190 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-97783275-be4c-4c94-b482-cdf4ebca731c tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] 10.222.0.60 "GET /compute/v2.1/images?changes-since=2022-09-14T09%3A00%3A25Z" status: 200 len: 2372 microversion: 2.1 time: 0.306413 Sep 14 09:02:37.894600 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1569/3195] 10.222.0.60 () {58 vars in 1199 bytes} [Wed Sep 14 09:02:37 2022] GET /compute/v2.1/images?changes-since=2022-09-14T09%3A00%3A25Z => generated 2372 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:02:37.904071 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-4b958c13-5992-4119-adfc-ff3d61c07441 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-228329402", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "networks": [{"uuid": "b9ab2062-a108-4d91-8f37-c911ce062678"}]}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:02:37.971437 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.network.neutron [None req-4b958c13-5992-4119-adfc-ff3d61c07441 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] validate_networks() for [('b9ab2062-a108-4d91-8f37-c911ce062678', None, None, None, None, None)] {{(pid=128759) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:02:38.073839 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.multi_cell_list [None req-c25d4b47-9410-4395-9730-3efc9646735e tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128758) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 14 09:02:38.264341 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-c25d4b47-9410-4395-9730-3efc9646735e tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e7ddc7c037439aad2f98277eef199e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e712ce30eb9c4128aa0ec1d425e9ab79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:38.282108 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c25d4b47-9410-4395-9730-3efc9646735e tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:38.285065 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c25d4b47-9410-4395-9730-3efc9646735e tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:38.293007 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c25d4b47-9410-4395-9730-3efc9646735e tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:38.532561 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-c25d4b47-9410-4395-9730-3efc9646735e tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] 10.222.0.60 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4516 microversion: 2.1 time: 0.735450 Sep 14 09:02:38.533858 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1627/3196] 10.222.0.60 () {58 vars in 1173 bytes} [Wed Sep 14 09:02:37 2022] GET /compute/v2.1/servers/detail?status=active => generated 4516 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:02:38.548913 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-e579ae99-17f9-4891-a38b-47f9c7b735de tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Calling method '.version_select at 0x7f7d443aec10>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:38.709082 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-e579ae99-17f9-4891-a38b-47f9c7b735de tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] 10.222.0.60 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1560389248" status: 200 len: 485 microversion: 2.1 time: 0.173955 Sep 14 09:02:38.718917 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1628/3197] 10.222.0.60 () {58 vars in 1231 bytes} [Wed Sep 14 09:02:38 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1560389248 => generated 485 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:02:38.725872 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-7f199ef7-244b-491d-ba7c-07b2d4646afe tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:38.726745 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-7f199ef7-244b-491d-ba7c-07b2d4646afe tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] [instance: 7558efb0-7f2d-42d5-9b6d-e442008b1c88] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:02:38.734869 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7f199ef7-244b-491d-ba7c-07b2d4646afe tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:38.735649 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7f199ef7-244b-491d-ba7c-07b2d4646afe tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:38.736242 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7f199ef7-244b-491d-ba7c-07b2d4646afe tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:38.737148 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7f199ef7-244b-491d-ba7c-07b2d4646afe tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:38.737762 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7f199ef7-244b-491d-ba7c-07b2d4646afe tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:38.738421 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7f199ef7-244b-491d-ba7c-07b2d4646afe tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:39.010355 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-4b958c13-5992-4119-adfc-ff3d61c07441 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Flavor limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:02:39.012290 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-4b958c13-5992-4119-adfc-ff3d61c07441 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Image limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:02:39.012422 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-7f199ef7-244b-491d-ba7c-07b2d4646afe tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b847ccce0654f2fa9df8367320a3218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9051111ca00649c591b6485d58bbc265', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:39.013167 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-4b958c13-5992-4119-adfc-ff3d61c07441 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Flavor pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:02:39.013831 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-4b958c13-5992-4119-adfc-ff3d61c07441 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Image pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:02:39.015137 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-4b958c13-5992-4119-adfc-ff3d61c07441 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:02:39.020098 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-7f199ef7-244b-491d-ba7c-07b2d4646afe tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] 10.222.0.60 "GET /compute/v2.1/servers/7558efb0-7f2d-42d5-9b6d-e442008b1c88" status: 200 len: 1467 microversion: 2.1 time: 0.299206 Sep 14 09:02:39.021219 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1629/3198] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:02:38 2022] GET /compute/v2.1/servers/7558efb0-7f2d-42d5-9b6d-e442008b1c88 => generated 1467 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:02:39.028474 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4b958c13-5992-4119-adfc-ff3d61c07441 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:39.029516 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4b958c13-5992-4119-adfc-ff3d61c07441 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:39.030589 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4b958c13-5992-4119-adfc-ff3d61c07441 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:39.031633 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4b958c13-5992-4119-adfc-ff3d61c07441 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:39.032421 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4b958c13-5992-4119-adfc-ff3d61c07441 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:39.033092 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4b958c13-5992-4119-adfc-ff3d61c07441 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:39.038860 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ba4c3a92-a624-4b0e-93ab-5ba3ad9c2e47 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:39.039742 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-ba4c3a92-a624-4b0e-93ab-5ba3ad9c2e47 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] [instance: 26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:02:39.054457 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ba4c3a92-a624-4b0e-93ab-5ba3ad9c2e47 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:39.054978 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ba4c3a92-a624-4b0e-93ab-5ba3ad9c2e47 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:39.055411 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ba4c3a92-a624-4b0e-93ab-5ba3ad9c2e47 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:39.056302 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ba4c3a92-a624-4b0e-93ab-5ba3ad9c2e47 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:39.056914 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ba4c3a92-a624-4b0e-93ab-5ba3ad9c2e47 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:39.057496 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ba4c3a92-a624-4b0e-93ab-5ba3ad9c2e47 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:39.069221 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-4b958c13-5992-4119-adfc-ff3d61c07441 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Getting quotas for project 4d42bf4d573b4bf9a0d8c9e73260af7e. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:02:39.076267 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-4b958c13-5992-4119-adfc-ff3d61c07441 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Getting quotas for user 47c95b28481b451bb03fb2c0240d0310 and project 4d42bf4d573b4bf9a0d8c9e73260af7e. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:02:39.092636 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-4b958c13-5992-4119-adfc-ff3d61c07441 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Going to run 1 instances... {{(pid=128759) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:02:39.095769 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-4b958c13-5992-4119-adfc-ff3d61c07441 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: 56742f27-4436-4fc3-b7a5-9d337395b7d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128759) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:02:39.137532 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-ba4c3a92-a624-4b0e-93ab-5ba3ad9c2e47 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:39.150400 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-ba4c3a92-a624-4b0e-93ab-5ba3ad9c2e47 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:39.153181 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-ba4c3a92-a624-4b0e-93ab-5ba3ad9c2e47 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:39.154601 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-ba4c3a92-a624-4b0e-93ab-5ba3ad9c2e47 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] 10.222.0.60 "GET /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0" status: 200 len: 1874 microversion: 2.32 time: 0.132198 Sep 14 09:02:39.155695 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1630/3199] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:02:39 2022] GET /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0 => generated 1874 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:02:39.171465 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-78e5221f-4dfb-4778-a53a-38580704af4b tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:39.172770 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-78e5221f-4dfb-4778-a53a-38580704af4b tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] [instance: 0eb40c80-c056-4096-a586-7e957a63f7cf] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:02:39.177385 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-4b958c13-5992-4119-adfc-ff3d61c07441 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.281312 Sep 14 09:02:39.179590 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1570/3200] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 09:02:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1284 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:02:39.187862 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-78e5221f-4dfb-4778-a53a-38580704af4b tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:39.188639 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-78e5221f-4dfb-4778-a53a-38580704af4b tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:39.189258 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-78e5221f-4dfb-4778-a53a-38580704af4b tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:39.190192 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-78e5221f-4dfb-4778-a53a-38580704af4b tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:39.190811 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-78e5221f-4dfb-4778-a53a-38580704af4b tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:39.191419 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-78e5221f-4dfb-4778-a53a-38580704af4b tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:39.204612 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-62078742-b472-44d9-9a29-41f883033bff tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:39.216716 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-62078742-b472-44d9-9a29-41f883033bff tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd6e7ddc7c037439aad2f98277eef199e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e712ce30eb9c4128aa0ec1d425e9ab79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:39.217330 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.compute.servers [None req-62078742-b472-44d9-9a29-41f883033bff tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Removing options 'limit' from query {{(pid=128759) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Sep 14 09:02:39.218241 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-62078742-b472-44d9-9a29-41f883033bff tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Searching by: {'deleted': False, 'project_id': 'e712ce30eb9c4128aa0ec1d425e9ab79'} {{(pid=128759) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 14 09:02:39.225091 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-62078742-b472-44d9-9a29-41f883033bff tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:39.226161 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-62078742-b472-44d9-9a29-41f883033bff tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:39.226852 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-62078742-b472-44d9-9a29-41f883033bff tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:39.227908 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-62078742-b472-44d9-9a29-41f883033bff tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:39.228704 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-62078742-b472-44d9-9a29-41f883033bff tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:39.230021 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-62078742-b472-44d9-9a29-41f883033bff tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:39.272418 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-78e5221f-4dfb-4778-a53a-38580704af4b tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:39.285483 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-78e5221f-4dfb-4778-a53a-38580704af4b tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:39.288442 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-78e5221f-4dfb-4778-a53a-38580704af4b tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:39.301049 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-78e5221f-4dfb-4778-a53a-38580704af4b tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] 10.222.0.60 "GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf" status: 200 len: 1531 microversion: 2.91 time: 0.143477 Sep 14 09:02:39.303789 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1631/3201] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:02:39 2022] GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf => generated 1531 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:02:39.328051 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-62078742-b472-44d9-9a29-41f883033bff tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e7ddc7c037439aad2f98277eef199e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e712ce30eb9c4128aa0ec1d425e9ab79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:39.342396 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-2071fd39-8853-4ce8-95aa-af6e10c4bb4a tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Calling method '.version_select at 0x7f7d4865cca0>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:39.347316 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-62078742-b472-44d9-9a29-41f883033bff tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:39.349023 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-62078742-b472-44d9-9a29-41f883033bff tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:39.350782 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-62078742-b472-44d9-9a29-41f883033bff tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:39.500338 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-2071fd39-8853-4ce8-95aa-af6e10c4bb4a tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] 10.222.0.60 "GET /compute/v2.1/images?server=ebf9bfa9-e941-4d23-8f6c-9867102feff2" status: 200 len: 956 microversion: 2.1 time: 0.181939 Sep 14 09:02:39.501419 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1632/3202] 10.222.0.60 () {58 vars in 1209 bytes} [Wed Sep 14 09:02:39 2022] GET /compute/v2.1/images?server=ebf9bfa9-e941-4d23-8f6c-9867102feff2 => generated 956 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:02:39.509460 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-5f18c0d7-8f06-4521-9d01-c3f87337f76a tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-64135914", "metadata": {"image_type": "test"}}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:02:39.512527 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-5f18c0d7-8f06-4521-9d01-c3f87337f76a tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] [instance: 7558efb0-7f2d-42d5-9b6d-e442008b1c88] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:02:39.520839 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5f18c0d7-8f06-4521-9d01-c3f87337f76a tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:39.521551 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5f18c0d7-8f06-4521-9d01-c3f87337f76a tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:39.522151 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5f18c0d7-8f06-4521-9d01-c3f87337f76a tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:39.524485 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5f18c0d7-8f06-4521-9d01-c3f87337f76a tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:39.525155 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5f18c0d7-8f06-4521-9d01-c3f87337f76a tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:39.525746 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5f18c0d7-8f06-4521-9d01-c3f87337f76a tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:39.544725 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-62078742-b472-44d9-9a29-41f883033bff tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] 10.222.0.60 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1661 microversion: 2.1 time: 0.362645 Sep 14 09:02:39.545329 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1571/3203] 10.222.0.60 () {58 vars in 1161 bytes} [Wed Sep 14 09:02:39 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1661 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:02:39.560698 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-2db4a0fa-a1cf-4c85-9be8-d41701f16ade tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:39.561602 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-2db4a0fa-a1cf-4c85-9be8-d41701f16ade tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: 56742f27-4436-4fc3-b7a5-9d337395b7d3] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:02:39.608967 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-5f18c0d7-8f06-4521-9d01-c3f87337f76a tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Getting quotas for project 9051111ca00649c591b6485d58bbc265. Resources: dict_keys(['metadata_items']) {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:02:39.617106 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-5f18c0d7-8f06-4521-9d01-c3f87337f76a tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Getting quotas for user 2b847ccce0654f2fa9df8367320a3218 and project 9051111ca00649c591b6485d58bbc265. Resources: dict_keys(['metadata_items']) {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:02:39.694353 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-2db4a0fa-a1cf-4c85-9be8-d41701f16ade tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:39.702265 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-2db4a0fa-a1cf-4c85-9be8-d41701f16ade tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/56742f27-4436-4fc3-b7a5-9d337395b7d3" status: 200 len: 1214 microversion: 2.1 time: 0.155700 Sep 14 09:02:39.702857 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1572/3204] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:02:39 2022] GET /compute/v2.1/servers/56742f27-4436-4fc3-b7a5-9d337395b7d3 => generated 1214 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:02:39.721465 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-398366f3-eb37-43d9-be6f-d41f0525c877 tempest-UnshelveToHostMultiNodesTest-151498122 tempest-UnshelveToHostMultiNodesTest-151498122-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:39.722095 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-398366f3-eb37-43d9-be6f-d41f0525c877 tempest-UnshelveToHostMultiNodesTest-151498122 tempest-UnshelveToHostMultiNodesTest-151498122-project-admin] [instance: 0eb40c80-c056-4096-a586-7e957a63f7cf] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:02:39.748864 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-398366f3-eb37-43d9-be6f-d41f0525c877 tempest-UnshelveToHostMultiNodesTest-151498122 tempest-UnshelveToHostMultiNodesTest-151498122-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:39.749359 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-398366f3-eb37-43d9-be6f-d41f0525c877 tempest-UnshelveToHostMultiNodesTest-151498122 tempest-UnshelveToHostMultiNodesTest-151498122-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:39.755216 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-398366f3-eb37-43d9-be6f-d41f0525c877 tempest-UnshelveToHostMultiNodesTest-151498122 tempest-UnshelveToHostMultiNodesTest-151498122-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:39.756427 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-398366f3-eb37-43d9-be6f-d41f0525c877 tempest-UnshelveToHostMultiNodesTest-151498122 tempest-UnshelveToHostMultiNodesTest-151498122-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:39.757143 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-398366f3-eb37-43d9-be6f-d41f0525c877 tempest-UnshelveToHostMultiNodesTest-151498122 tempest-UnshelveToHostMultiNodesTest-151498122-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:39.761607 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-398366f3-eb37-43d9-be6f-d41f0525c877 tempest-UnshelveToHostMultiNodesTest-151498122 tempest-UnshelveToHostMultiNodesTest-151498122-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:39.958684 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.objects.instance [None req-398366f3-eb37-43d9-be6f-d41f0525c877 tempest-UnshelveToHostMultiNodesTest-151498122 tempest-UnshelveToHostMultiNodesTest-151498122-project-admin] Lazy-loading 'services' on Instance uuid 0eb40c80-c056-4096-a586-7e957a63f7cf {{(pid=128759) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:02:40.037545 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-398366f3-eb37-43d9-be6f-d41f0525c877 tempest-UnshelveToHostMultiNodesTest-151498122 tempest-UnshelveToHostMultiNodesTest-151498122-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf" status: 200 len: 1938 microversion: 2.91 time: 0.333579 Sep 14 09:02:40.041183 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1573/3205] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:02:39 2022] GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf => generated 1938 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:02:40.043557 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=17,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:02:40.048348 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-cf2dcd93-9326-4329-bc3d-811a94ca6148 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Calling method '.version_select at 0x7f7d48756a60>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:40.076166 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-5f18c0d7-8f06-4521-9d01-c3f87337f76a tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] 10.222.0.60 "POST /compute/v2.1/servers/7558efb0-7f2d-42d5-9b6d-e442008b1c88/action" status: 202 len: 0 microversion: 2.1 time: 0.572709 Sep 14 09:02:40.077963 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1633/3206] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:02:39 2022] POST /compute/v2.1/servers/7558efb0-7f2d-42d5-9b6d-e442008b1c88/action => generated 0 bytes in 576 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 14 09:02:40.088448 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-7804dc25-dada-4ff5-97b9-f257ce0c74ea tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:40.095848 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-7804dc25-dada-4ff5-97b9-f257ce0c74ea tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd6e7ddc7c037439aad2f98277eef199e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e712ce30eb9c4128aa0ec1d425e9ab79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:40.099482 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-7804dc25-dada-4ff5-97b9-f257ce0c74ea tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'e712ce30eb9c4128aa0ec1d425e9ab79'} {{(pid=128758) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 14 09:02:40.108263 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7804dc25-dada-4ff5-97b9-f257ce0c74ea tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:40.108799 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7804dc25-dada-4ff5-97b9-f257ce0c74ea tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:40.109258 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7804dc25-dada-4ff5-97b9-f257ce0c74ea tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:40.110003 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7804dc25-dada-4ff5-97b9-f257ce0c74ea tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:40.110676 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7804dc25-dada-4ff5-97b9-f257ce0c74ea tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:40.111131 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7804dc25-dada-4ff5-97b9-f257ce0c74ea tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:40.122654 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-cf2dcd93-9326-4329-bc3d-811a94ca6148 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] 10.222.0.60 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.60%2Fcompute%2Fv2.1%2Fservers%2Fa4852a58-51c4-4ca0-8c83-19fc8209fd21" status: 200 len: 483 microversion: 2.1 time: 0.079990 Sep 14 09:02:40.124119 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1574/3207] 10.222.0.60 () {58 vars in 1317 bytes} [Wed Sep 14 09:02:40 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.60%2Fcompute%2Fv2.1%2Fservers%2Fa4852a58-51c4-4ca0-8c83-19fc8209fd21 => generated 483 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:02:40.129673 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-8f64b9ac-64c2-46b7-81d7-683b20aa1265 req-f017b9f3-d445-427f-899b-60e935bb19d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebf9bfa9-e941-4d23-8f6c-9867102feff2", "name": "network-vif-unplugged", "status": "completed", "tag": "a16e0c89-9089-483d-ae3b-f83433826e96"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:02:40.144875 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-8f64b9ac-64c2-46b7-81d7-683b20aa1265 req-f017b9f3-d445-427f-899b-60e935bb19d0 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:40.165160 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-8f64b9ac-64c2-46b7-81d7-683b20aa1265 req-f017b9f3-d445-427f-899b-60e935bb19d0 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:40.166651 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-8f64b9ac-64c2-46b7-81d7-683b20aa1265 req-f017b9f3-d445-427f-899b-60e935bb19d0 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:40.198797 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-8f64b9ac-64c2-46b7-81d7-683b20aa1265 req-f017b9f3-d445-427f-899b-60e935bb19d0 service nova] Creating event network-vif-unplugged:a16e0c89-9089-483d-ae3b-f83433826e96 for instance ebf9bfa9-e941-4d23-8f6c-9867102feff2 on n-h1-836830-18 Sep 14 09:02:40.215463 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-8f64b9ac-64c2-46b7-81d7-683b20aa1265 req-f017b9f3-d445-427f-899b-60e935bb19d0 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.082815 Sep 14 09:02:40.216192 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1575/3208] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:02:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:02:40.227859 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f8674442-93a2-455e-bbde-3e0794e9d4c8 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:02:40.228506 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f8674442-93a2-455e-bbde-3e0794e9d4c8 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] [instance: 0eb40c80-c056-4096-a586-7e957a63f7cf] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:02:40.235573 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f8674442-93a2-455e-bbde-3e0794e9d4c8 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:40.236181 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f8674442-93a2-455e-bbde-3e0794e9d4c8 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:40.236799 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f8674442-93a2-455e-bbde-3e0794e9d4c8 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:40.238127 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f8674442-93a2-455e-bbde-3e0794e9d4c8 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:40.238258 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.multi_cell_list [None req-7804dc25-dada-4ff5-97b9-f257ce0c74ea tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128758) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 14 09:02:40.238864 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f8674442-93a2-455e-bbde-3e0794e9d4c8 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:40.239567 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f8674442-93a2-455e-bbde-3e0794e9d4c8 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:40.268272 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.objects.instance [None req-f8674442-93a2-455e-bbde-3e0794e9d4c8 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lazy-loading 'flavor' on Instance uuid 0eb40c80-c056-4096-a586-7e957a63f7cf {{(pid=128759) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:02:40.304417 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-7804dc25-dada-4ff5-97b9-f257ce0c74ea tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] 10.222.0.60 "GET /compute/v2.1/servers?status=active" status: 200 len: 1011 microversion: 2.1 time: 0.224952 Sep 14 09:02:40.305599 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1634/3209] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Sep 14 09:02:40 2022] GET /compute/v2.1/servers?status=active => generated 1011 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:02:40.312147 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-462e188d-519c-4a7e-8413-a2e13e5c0610 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Calling method '.version_select at 0x7f7d44789550>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:40.380349 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-462e188d-519c-4a7e-8413-a2e13e5c0610 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] 10.222.0.60 "GET /compute/v2.1/images/165c831f-0a00-4eac-be4f-8a4c39096827" status: 200 len: 1420 microversion: 2.1 time: 0.073399 Sep 14 09:02:40.391787 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1635/3210] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:02:40 2022] GET /compute/v2.1/images/165c831f-0a00-4eac-be4f-8a4c39096827 => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:02:40.400164 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-e39bf17f-6bd8-46c7-bc0a-c5fa424a65b5 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Calling method '.version_select at 0x7f7d44319f70>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:40.524392 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-e39bf17f-6bd8-46c7-bc0a-c5fa424a65b5 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] 10.222.0.60 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.60%2Fcompute%2Fservers%2Fa4852a58-51c4-4ca0-8c83-19fc8209fd21" status: 200 len: 483 microversion: 2.1 time: 0.130033 Sep 14 09:02:40.526275 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1636/3211] 10.222.0.60 () {58 vars in 1303 bytes} [Wed Sep 14 09:02:40 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.60%2Fcompute%2Fservers%2Fa4852a58-51c4-4ca0-8c83-19fc8209fd21 => generated 483 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:02:40.533776 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a789cd46-5af5-45b6-904b-875ac3585905 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:40.535394 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-a789cd46-5af5-45b6-904b-875ac3585905 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] [instance: 26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:02:40.544449 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a789cd46-5af5-45b6-904b-875ac3585905 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:40.545491 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a789cd46-5af5-45b6-904b-875ac3585905 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:40.546634 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a789cd46-5af5-45b6-904b-875ac3585905 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:40.547871 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a789cd46-5af5-45b6-904b-875ac3585905 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:40.548577 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a789cd46-5af5-45b6-904b-875ac3585905 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:40.549328 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a789cd46-5af5-45b6-904b-875ac3585905 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:40.592460 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f8674442-93a2-455e-bbde-3e0794e9d4c8 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] 10.222.0.60 "POST /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf/action" status: 202 len: 0 microversion: 2.91 time: 0.370486 Sep 14 09:02:40.607622 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1576/3212] 10.222.0.60 () {62 vars in 1319 bytes} [Wed Sep 14 09:02:40 2022] POST /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf/action => generated 0 bytes in 391 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:02:40.623631 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-6e784f5a-903f-43e2-a0c0-f6ab803c8d20 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:40.639105 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-6e784f5a-903f-43e2-a0c0-f6ab803c8d20 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd6e7ddc7c037439aad2f98277eef199e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e712ce30eb9c4128aa0ec1d425e9ab79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:40.641232 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.compute.servers [None req-6e784f5a-903f-43e2-a0c0-f6ab803c8d20 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Removing options 'limit' from query {{(pid=128759) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Sep 14 09:02:40.643244 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-6e784f5a-903f-43e2-a0c0-f6ab803c8d20 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Searching by: {'deleted': False, 'project_id': 'e712ce30eb9c4128aa0ec1d425e9ab79'} {{(pid=128759) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 14 09:02:40.661875 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6e784f5a-903f-43e2-a0c0-f6ab803c8d20 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:40.662407 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6e784f5a-903f-43e2-a0c0-f6ab803c8d20 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:40.662862 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6e784f5a-903f-43e2-a0c0-f6ab803c8d20 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:40.663647 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6e784f5a-903f-43e2-a0c0-f6ab803c8d20 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:40.668320 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6e784f5a-903f-43e2-a0c0-f6ab803c8d20 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:40.668775 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6e784f5a-903f-43e2-a0c0-f6ab803c8d20 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:40.679402 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-a789cd46-5af5-45b6-904b-875ac3585905 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:40.695199 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-a789cd46-5af5-45b6-904b-875ac3585905 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:40.696685 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-a789cd46-5af5-45b6-904b-875ac3585905 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:40.697986 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-a789cd46-5af5-45b6-904b-875ac3585905 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] 10.222.0.60 "GET /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0" status: 200 len: 1874 microversion: 2.32 time: 0.169832 Sep 14 09:02:40.714776 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.multi_cell_list [None req-6e784f5a-903f-43e2-a0c0-f6ab803c8d20 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128759) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 14 09:02:40.716239 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1637/3213] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:02:40 2022] GET /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0 => generated 1874 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:02:40.721622 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-3143a61f-6c40-4966-855a-a702b49a3449 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Calling method '.version_select at 0x7f7d448083a0>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:40.789502 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:02:40.810051 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-6e784f5a-903f-43e2-a0c0-f6ab803c8d20 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] 10.222.0.60 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1011 microversion: 2.1 time: 0.200562 Sep 14 09:02:40.811250 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1577/3214] 10.222.0.60 () {58 vars in 1150 bytes} [Wed Sep 14 09:02:40 2022] GET /compute/v2.1/servers?limit=100000 => generated 1011 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:02:40.816998 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-21088ff1-9478-4cc7-bba0-a20ca2c9b5b9 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:40.818035 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-21088ff1-9478-4cc7-bba0-a20ca2c9b5b9 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] [instance: 0eb40c80-c056-4096-a586-7e957a63f7cf] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:02:40.827593 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-21088ff1-9478-4cc7-bba0-a20ca2c9b5b9 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:40.828379 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-21088ff1-9478-4cc7-bba0-a20ca2c9b5b9 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:40.828993 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-21088ff1-9478-4cc7-bba0-a20ca2c9b5b9 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:40.830487 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-21088ff1-9478-4cc7-bba0-a20ca2c9b5b9 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:40.831164 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-21088ff1-9478-4cc7-bba0-a20ca2c9b5b9 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:40.831808 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-21088ff1-9478-4cc7-bba0-a20ca2c9b5b9 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:40.998691 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-3143a61f-6c40-4966-855a-a702b49a3449 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] 10.222.0.60 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3278 microversion: 2.1 time: 0.281269 Sep 14 09:02:41.007022 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1638/3215] 10.222.0.60 () {58 vars in 1149 bytes} [Wed Sep 14 09:02:40 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3278 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:02:41.017287 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-2de136aa-7286-4205-8a6e-ed3765325731 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:41.018572 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-2de136aa-7286-4205-8a6e-ed3765325731 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: 56742f27-4436-4fc3-b7a5-9d337395b7d3] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:02:41.031378 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2de136aa-7286-4205-8a6e-ed3765325731 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:41.032070 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2de136aa-7286-4205-8a6e-ed3765325731 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:41.034360 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2de136aa-7286-4205-8a6e-ed3765325731 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:41.035305 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2de136aa-7286-4205-8a6e-ed3765325731 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:41.036042 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2de136aa-7286-4205-8a6e-ed3765325731 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:41.036838 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2de136aa-7286-4205-8a6e-ed3765325731 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:41.054891 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-21088ff1-9478-4cc7-bba0-a20ca2c9b5b9 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:41.071091 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-21088ff1-9478-4cc7-bba0-a20ca2c9b5b9 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:41.092697 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-21088ff1-9478-4cc7-bba0-a20ca2c9b5b9 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:41.109966 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-21088ff1-9478-4cc7-bba0-a20ca2c9b5b9 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] 10.222.0.60 "GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf" status: 200 len: 1537 microversion: 2.91 time: 0.297372 Sep 14 09:02:41.111773 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1578/3216] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:02:40 2022] GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf => generated 1537 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:02:41.127862 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-201d1bad-24d4-49db-9c6c-6b69df9b21fe tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:41.136971 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-201d1bad-24d4-49db-9c6c-6b69df9b21fe tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd6e7ddc7c037439aad2f98277eef199e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e712ce30eb9c4128aa0ec1d425e9ab79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:41.141692 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-201d1bad-24d4-49db-9c6c-6b69df9b21fe tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Searching by: {'deleted': False, 'project_id': 'e712ce30eb9c4128aa0ec1d425e9ab79'} {{(pid=128759) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 14 09:02:41.159935 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-201d1bad-24d4-49db-9c6c-6b69df9b21fe tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:41.163632 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-201d1bad-24d4-49db-9c6c-6b69df9b21fe tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:41.164562 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-201d1bad-24d4-49db-9c6c-6b69df9b21fe tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:41.166969 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-201d1bad-24d4-49db-9c6c-6b69df9b21fe tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:41.169665 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-201d1bad-24d4-49db-9c6c-6b69df9b21fe tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:41.170335 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-201d1bad-24d4-49db-9c6c-6b69df9b21fe tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:41.218471 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.multi_cell_list [None req-201d1bad-24d4-49db-9c6c-6b69df9b21fe tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128759) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 14 09:02:41.225102 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-2de136aa-7286-4205-8a6e-ed3765325731 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:41.243018 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-2de136aa-7286-4205-8a6e-ed3765325731 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/56742f27-4436-4fc3-b7a5-9d337395b7d3" status: 200 len: 1266 microversion: 2.1 time: 0.232345 Sep 14 09:02:41.244334 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1639/3217] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:02:41 2022] GET /compute/v2.1/servers/56742f27-4436-4fc3-b7a5-9d337395b7d3 => generated 1266 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:02:41.260914 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-541113e1-30fb-442b-93ca-176ec9027543 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Calling method '.version_select at 0x7f7d44789a60>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:41.283751 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-201d1bad-24d4-49db-9c6c-6b69df9b21fe tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] 10.222.0.60 "GET /compute/v2.1/servers" status: 200 len: 1011 microversion: 2.1 time: 0.170453 Sep 14 09:02:41.284979 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1579/3218] 10.222.0.60 () {58 vars in 1125 bytes} [Wed Sep 14 09:02:41 2022] GET /compute/v2.1/servers => generated 1011 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:02:41.315102 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9fbe3540-6353-498c-b72e-d1c0fc11d1cf tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:41.333734 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-9fbe3540-6353-498c-b72e-d1c0fc11d1cf tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd6e7ddc7c037439aad2f98277eef199e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e712ce30eb9c4128aa0ec1d425e9ab79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:41.334844 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-9fbe3540-6353-498c-b72e-d1c0fc11d1cf tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'e712ce30eb9c4128aa0ec1d425e9ab79'} {{(pid=128759) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 14 09:02:41.352405 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9fbe3540-6353-498c-b72e-d1c0fc11d1cf tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:41.353217 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9fbe3540-6353-498c-b72e-d1c0fc11d1cf tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:41.353840 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9fbe3540-6353-498c-b72e-d1c0fc11d1cf tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:41.355556 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9fbe3540-6353-498c-b72e-d1c0fc11d1cf tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:41.356283 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9fbe3540-6353-498c-b72e-d1c0fc11d1cf tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:41.356988 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9fbe3540-6353-498c-b72e-d1c0fc11d1cf tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:41.416177 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-541113e1-30fb-442b-93ca-176ec9027543 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] 10.222.0.60 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1427 microversion: 2.1 time: 0.154817 Sep 14 09:02:41.417013 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1640/3219] 10.222.0.60 () {58 vars in 1149 bytes} [Wed Sep 14 09:02:41 2022] GET /compute/v2.1/images?type=snapshot => generated 1427 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:02:41.427698 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-75a49bd8-9beb-488a-a14d-b4cb62bbefca tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Calling method '.version_select at 0x7f7d448085e0>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:41.490041 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.multi_cell_list [None req-9fbe3540-6353-498c-b72e-d1c0fc11d1cf tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128759) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 14 09:02:41.514283 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-75a49bd8-9beb-488a-a14d-b4cb62bbefca tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] 10.222.0.60 "GET /compute/v2.1/images/165c831f-0a00-4eac-be4f-8a4c39096827" status: 200 len: 1420 microversion: 2.1 time: 0.083903 Sep 14 09:02:41.517046 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1641/3220] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:02:41 2022] GET /compute/v2.1/images/165c831f-0a00-4eac-be4f-8a4c39096827 => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:02:41.522081 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-29812546-e5f7-4db8-96a5-425bae7ef97e tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Calling method '.version_select at 0x7f7d44939dc0>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:41.586324 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-9fbe3540-6353-498c-b72e-d1c0fc11d1cf tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] 10.222.0.60 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 346 microversion: 2.1 time: 0.279730 Sep 14 09:02:41.586929 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1580/3221] 10.222.0.60 () {58 vars in 1146 bytes} [Wed Sep 14 09:02:41 2022] GET /compute/v2.1/servers?flavor=451 => generated 346 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:02:41.609449 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-5973446d-47a9-423d-b6f3-cc5c8d2b87e1 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:41.619407 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-5973446d-47a9-423d-b6f3-cc5c8d2b87e1 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd6e7ddc7c037439aad2f98277eef199e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e712ce30eb9c4128aa0ec1d425e9ab79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:41.621568 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.compute.servers [None req-5973446d-47a9-423d-b6f3-cc5c8d2b87e1 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Removing options 'limit' from query {{(pid=128759) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Sep 14 09:02:41.623774 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-5973446d-47a9-423d-b6f3-cc5c8d2b87e1 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Searching by: {'deleted': False, 'project_id': 'e712ce30eb9c4128aa0ec1d425e9ab79'} {{(pid=128759) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 14 09:02:41.637151 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5973446d-47a9-423d-b6f3-cc5c8d2b87e1 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:41.637668 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5973446d-47a9-423d-b6f3-cc5c8d2b87e1 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:41.639446 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5973446d-47a9-423d-b6f3-cc5c8d2b87e1 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:41.641706 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5973446d-47a9-423d-b6f3-cc5c8d2b87e1 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:41.643389 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5973446d-47a9-423d-b6f3-cc5c8d2b87e1 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:41.643848 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5973446d-47a9-423d-b6f3-cc5c8d2b87e1 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:41.662139 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-29812546-e5f7-4db8-96a5-425bae7ef97e tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] 10.222.0.60 "GET /compute/v2.1/images?limit=1" status: 200 len: 621 microversion: 2.1 time: 0.143737 Sep 14 09:02:41.663590 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1642/3222] 10.222.0.60 () {58 vars in 1137 bytes} [Wed Sep 14 09:02:41 2022] GET /compute/v2.1/images?limit=1 => generated 621 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:02:41.691473 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-f5b06eef-5d52-473c-ae50-24b2cd8e914c tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Calling method '.version_select at 0x7f7d44d941f0>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:41.699852 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-5973446d-47a9-423d-b6f3-cc5c8d2b87e1 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] 10.222.0.60 "GET /compute/v2.1/servers?limit=1" status: 200 len: 485 microversion: 2.1 time: 0.096240 Sep 14 09:02:41.709006 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1581/3223] 10.222.0.60 () {58 vars in 1140 bytes} [Wed Sep 14 09:02:41 2022] GET /compute/v2.1/servers?limit=1 => generated 485 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:02:41.714511 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b6408783-364c-423f-8952-c354b9a3d28c tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:41.728543 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b6408783-364c-423f-8952-c354b9a3d28c tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd6e7ddc7c037439aad2f98277eef199e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e712ce30eb9c4128aa0ec1d425e9ab79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:41.729246 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b6408783-364c-423f-8952-c354b9a3d28c tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-567326605', 'deleted': False, 'project_id': 'e712ce30eb9c4128aa0ec1d425e9ab79'} {{(pid=128759) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 14 09:02:41.735405 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b6408783-364c-423f-8952-c354b9a3d28c tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:41.735895 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b6408783-364c-423f-8952-c354b9a3d28c tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:41.736591 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b6408783-364c-423f-8952-c354b9a3d28c tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:41.737447 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b6408783-364c-423f-8952-c354b9a3d28c tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:41.737909 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b6408783-364c-423f-8952-c354b9a3d28c tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:41.738366 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b6408783-364c-423f-8952-c354b9a3d28c tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:41.843560 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.multi_cell_list [None req-b6408783-364c-423f-8952-c354b9a3d28c tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128759) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 14 09:02:41.847249 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-f5b06eef-5d52-473c-ae50-24b2cd8e914c tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] 10.222.0.60 "GET /compute/v2.1/images/detail?changes-since=2022-09-14T09%3A00%3A21Z" status: 200 len: 6331 microversion: 2.1 time: 0.167157 Sep 14 09:02:41.848340 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1643/3224] 10.222.0.60 () {58 vars in 1220 bytes} [Wed Sep 14 09:02:41 2022] GET /compute/v2.1/images/detail?changes-since=2022-09-14T09%3A00%3A21Z => generated 6331 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:02:41.862291 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-5aff7b9a-c209-4171-a2aa-fa3f64f257bb tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:41.862291 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-5aff7b9a-c209-4171-a2aa-fa3f64f257bb tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] [instance: 26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:02:41.875955 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5aff7b9a-c209-4171-a2aa-fa3f64f257bb tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:41.876568 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5aff7b9a-c209-4171-a2aa-fa3f64f257bb tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:41.877108 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5aff7b9a-c209-4171-a2aa-fa3f64f257bb tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:41.878552 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5aff7b9a-c209-4171-a2aa-fa3f64f257bb tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:41.878552 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5aff7b9a-c209-4171-a2aa-fa3f64f257bb tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:41.879021 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5aff7b9a-c209-4171-a2aa-fa3f64f257bb tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:41.928963 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b6408783-364c-423f-8952-c354b9a3d28c tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] 10.222.0.60 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-567326605" status: 200 len: 345 microversion: 2.1 time: 0.218568 Sep 14 09:02:41.930148 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1582/3225] 10.222.0.60 () {58 vars in 1240 bytes} [Wed Sep 14 09:02:41 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-567326605 => generated 345 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:02:41.935039 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e9035bb3-9b3d-4d1d-9c5f-d4b4cca6c9c1 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Calling method '.version_select at 0x7f7d4879f160>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:41.995444 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e9035bb3-9b3d-4d1d-9c5f-d4b4cca6c9c1 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] 10.222.0.60 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1560389248" status: 200 len: 665 microversion: 2.1 time: 0.063671 Sep 14 09:02:42.011853 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1583/3226] 10.222.0.60 () {58 vars in 1252 bytes} [Wed Sep 14 09:02:41 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1560389248 => generated 665 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:02:42.017932 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c18e788e-4fcc-4b81-8246-b8886974bb2c tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:02:42.025706 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c18e788e-4fcc-4b81-8246-b8886974bb2c tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:42.027157 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c18e788e-4fcc-4b81-8246-b8886974bb2c tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:42.027762 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c18e788e-4fcc-4b81-8246-b8886974bb2c tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:42.082593 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-5aff7b9a-c209-4171-a2aa-fa3f64f257bb tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:42.096031 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-5aff7b9a-c209-4171-a2aa-fa3f64f257bb tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:42.098815 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-5aff7b9a-c209-4171-a2aa-fa3f64f257bb tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:42.099602 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-c18e788e-4fcc-4b81-8246-b8886974bb2c tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] [instance: 3d29c068-39c8-4851-82cf-b7639f689f24] Going to try to stop instance {{(pid=128759) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 14 09:02:42.101097 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-5aff7b9a-c209-4171-a2aa-fa3f64f257bb tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] 10.222.0.60 "GET /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0" status: 200 len: 1874 microversion: 2.32 time: 0.251644 Sep 14 09:02:42.101929 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1644/3227] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:02:41 2022] GET /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0 => generated 1874 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:02:42.132897 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-10740e89-8bb9-4489-89c1-84fb2cee8e93 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Calling method '.version_select at 0x7f7d44376d30>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:42.170680 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-c18e788e-4fcc-4b81-8246-b8886974bb2c tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] 10.222.0.60 "POST /compute/v2.1/servers/3d29c068-39c8-4851-82cf-b7639f689f24/action" status: 202 len: 0 microversion: 2.1 time: 0.156983 Sep 14 09:02:42.171681 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1584/3228] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:02:42 2022] POST /compute/v2.1/servers/3d29c068-39c8-4851-82cf-b7639f689f24/action => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:02:42.181809 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-faefb798-607f-43db-973c-6693f4db7b2a tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:42.186722 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-faefb798-607f-43db-973c-6693f4db7b2a tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] [instance: 0eb40c80-c056-4096-a586-7e957a63f7cf] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:02:42.234293 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-faefb798-607f-43db-973c-6693f4db7b2a tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:42.234793 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-faefb798-607f-43db-973c-6693f4db7b2a tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:42.235257 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-faefb798-607f-43db-973c-6693f4db7b2a tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:42.236286 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-10740e89-8bb9-4489-89c1-84fb2cee8e93 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] 10.222.0.60 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.60%2Fcompute%2Fv2.1%2Fservers%2Fa4852a58-51c4-4ca0-8c83-19fc8209fd21" status: 200 len: 1465 microversion: 2.1 time: 0.115033 Sep 14 09:02:42.237277 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1645/3229] 10.222.0.60 () {58 vars in 1338 bytes} [Wed Sep 14 09:02:42 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.60%2Fcompute%2Fv2.1%2Fservers%2Fa4852a58-51c4-4ca0-8c83-19fc8209fd21 => generated 1465 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:02:42.238038 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-faefb798-607f-43db-973c-6693f4db7b2a tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:42.238496 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-faefb798-607f-43db-973c-6693f4db7b2a tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:42.238956 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-faefb798-607f-43db-973c-6693f4db7b2a tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:42.243794 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ea388aa4-1b8f-42bf-8cd2-428ec84c2fdd tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:42.244787 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-ea388aa4-1b8f-42bf-8cd2-428ec84c2fdd tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] [instance: 3d29c068-39c8-4851-82cf-b7639f689f24] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:02:42.255340 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ea388aa4-1b8f-42bf-8cd2-428ec84c2fdd tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:42.258085 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ea388aa4-1b8f-42bf-8cd2-428ec84c2fdd tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:42.258807 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ea388aa4-1b8f-42bf-8cd2-428ec84c2fdd tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:42.259775 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ea388aa4-1b8f-42bf-8cd2-428ec84c2fdd tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:42.260720 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ea388aa4-1b8f-42bf-8cd2-428ec84c2fdd tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:42.261797 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ea388aa4-1b8f-42bf-8cd2-428ec84c2fdd tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:42.465288 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-faefb798-607f-43db-973c-6693f4db7b2a tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:42.480469 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-faefb798-607f-43db-973c-6693f4db7b2a tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:42.482259 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-faefb798-607f-43db-973c-6693f4db7b2a tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:42.496918 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-faefb798-607f-43db-973c-6693f4db7b2a tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] 10.222.0.60 "GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf" status: 200 len: 1537 microversion: 2.91 time: 0.323905 Sep 14 09:02:42.503408 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1585/3230] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:02:42 2022] GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf => generated 1537 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:02:42.509405 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-805e2c77-ca1d-4420-a65c-ce8a249e385c tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Calling method '.version_select at 0x7f7d3fb83ee0>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:42.595590 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-805e2c77-ca1d-4420-a65c-ce8a249e385c tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] 10.222.0.60 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.60%2Fcompute%2Fservers%2Fa4852a58-51c4-4ca0-8c83-19fc8209fd21" status: 200 len: 1465 microversion: 2.1 time: 0.090950 Sep 14 09:02:42.596666 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1586/3231] 10.222.0.60 () {58 vars in 1324 bytes} [Wed Sep 14 09:02:42 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.60%2Fcompute%2Fservers%2Fa4852a58-51c4-4ca0-8c83-19fc8209fd21 => generated 1465 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:02:42.614266 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-1eaa4fc3-a2ff-4e9a-a707-bc0997dc3548 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:42.614968 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-1eaa4fc3-a2ff-4e9a-a707-bc0997dc3548 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: 56742f27-4436-4fc3-b7a5-9d337395b7d3] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:02:42.621958 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1eaa4fc3-a2ff-4e9a-a707-bc0997dc3548 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:42.622920 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1eaa4fc3-a2ff-4e9a-a707-bc0997dc3548 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:42.623064 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1eaa4fc3-a2ff-4e9a-a707-bc0997dc3548 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:42.623778 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1eaa4fc3-a2ff-4e9a-a707-bc0997dc3548 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:42.624301 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1eaa4fc3-a2ff-4e9a-a707-bc0997dc3548 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:42.624791 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1eaa4fc3-a2ff-4e9a-a707-bc0997dc3548 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:42.648376 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-ea388aa4-1b8f-42bf-8cd2-428ec84c2fdd tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e7ddc7c037439aad2f98277eef199e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e712ce30eb9c4128aa0ec1d425e9ab79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:42.671256 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-ea388aa4-1b8f-42bf-8cd2-428ec84c2fdd tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] 10.222.0.60 "GET /compute/v2.1/servers/3d29c068-39c8-4851-82cf-b7639f689f24" status: 200 len: 1520 microversion: 2.1 time: 0.432261 Sep 14 09:02:42.673362 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1646/3232] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:02:42 2022] GET /compute/v2.1/servers/3d29c068-39c8-4851-82cf-b7639f689f24 => generated 1520 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:02:42.679540 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-e7131802-5630-4d33-b47b-9fa3c5700e09 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Calling method '.version_select at 0x7f7d485b90d0>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:42.744778 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-e7131802-5630-4d33-b47b-9fa3c5700e09 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] 10.222.0.60 "GET /compute/v2.1/images/165c831f-0a00-4eac-be4f-8a4c39096827" status: 200 len: 1420 microversion: 2.1 time: 0.067560 Sep 14 09:02:42.748059 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1647/3233] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:02:42 2022] GET /compute/v2.1/images/165c831f-0a00-4eac-be4f-8a4c39096827 => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:02:42.763191 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-053395fc-e210-4868-9eaa-66d574ac0296 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Calling method '.version_select at 0x7f7d44376dc0>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:42.868185 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-1eaa4fc3-a2ff-4e9a-a707-bc0997dc3548 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:42.877539 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-1eaa4fc3-a2ff-4e9a-a707-bc0997dc3548 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/56742f27-4436-4fc3-b7a5-9d337395b7d3" status: 200 len: 1272 microversion: 2.1 time: 0.267208 Sep 14 09:02:42.881311 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1587/3234] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:02:42 2022] GET /compute/v2.1/servers/56742f27-4436-4fc3-b7a5-9d337395b7d3 => generated 1272 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:02:42.974538 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-053395fc-e210-4868-9eaa-66d574ac0296 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] 10.222.0.60 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7106 microversion: 2.1 time: 0.219304 Sep 14 09:02:42.975440 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1648/3235] 10.222.0.60 () {58 vars in 1170 bytes} [Wed Sep 14 09:02:42 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7106 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:02:43.002277 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d7e4a451-175e-4974-adec-70d8b0513425 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Calling method '.version_select at 0x7f7d48766ca0>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:43.134192 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-4f83b01a-cf2a-4c7b-b0b2-b1121a6c83b2 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:43.135801 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-4f83b01a-cf2a-4c7b-b0b2-b1121a6c83b2 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] [instance: 26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:02:43.139449 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d7e4a451-175e-4974-adec-70d8b0513425 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] 10.222.0.60 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4373 microversion: 2.1 time: 0.140999 Sep 14 09:02:43.144785 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4f83b01a-cf2a-4c7b-b0b2-b1121a6c83b2 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:43.145572 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4f83b01a-cf2a-4c7b-b0b2-b1121a6c83b2 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:43.146199 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4f83b01a-cf2a-4c7b-b0b2-b1121a6c83b2 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:43.147418 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4f83b01a-cf2a-4c7b-b0b2-b1121a6c83b2 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:43.148042 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4f83b01a-cf2a-4c7b-b0b2-b1121a6c83b2 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:43.148641 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4f83b01a-cf2a-4c7b-b0b2-b1121a6c83b2 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:43.154176 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1588/3236] 10.222.0.60 () {58 vars in 1170 bytes} [Wed Sep 14 09:02:42 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4373 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:02:43.159282 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9e785b1c-98cf-4858-8aa9-7d98373e9fdd tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Calling method '.version_select at 0x7f7d3fcb4af0>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:43.215831 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-9e785b1c-98cf-4858-8aa9-7d98373e9fdd tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] 10.222.0.60 "GET /compute/v2.1/images/bff4ab7f-4846-441f-8940-d96fec4c28e9" status: 200 len: 784 microversion: 2.1 time: 0.059612 Sep 14 09:02:43.229048 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1589/3237] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:02:43 2022] GET /compute/v2.1/images/bff4ab7f-4846-441f-8940-d96fec4c28e9 => generated 784 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:02:43.241045 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ca2da406-e041-46b8-b376-98b031a2d522 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Calling method '.version_select at 0x7f7d486cdf70>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:43.318191 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-ca2da406-e041-46b8-b376-98b031a2d522 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] 10.222.0.60 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1610 microversion: 2.1 time: 0.087105 Sep 14 09:02:43.318782 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1590/3238] 10.222.0.60 () {58 vars in 1158 bytes} [Wed Sep 14 09:02:43 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1610 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:02:43.338619 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-2914aca0-7866-415a-b23e-01806ae2d011 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Calling method '.version_select at 0x7f7d3fcb43a0>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:43.340893 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-4f83b01a-cf2a-4c7b-b0b2-b1121a6c83b2 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:43.362151 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-4f83b01a-cf2a-4c7b-b0b2-b1121a6c83b2 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:43.363659 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-4f83b01a-cf2a-4c7b-b0b2-b1121a6c83b2 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:43.364897 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-4f83b01a-cf2a-4c7b-b0b2-b1121a6c83b2 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] 10.222.0.60 "GET /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0" status: 200 len: 1874 microversion: 2.32 time: 0.235052 Sep 14 09:02:43.407107 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1649/3239] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:02:43 2022] GET /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0 => generated 1874 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 09:02:43.528115 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-edf76dc1-3412-4425-92db-cf3a4495abdc tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:43.529405 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-edf76dc1-3412-4425-92db-cf3a4495abdc tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] [instance: 0eb40c80-c056-4096-a586-7e957a63f7cf] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:02:43.547862 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-edf76dc1-3412-4425-92db-cf3a4495abdc tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:43.555742 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-edf76dc1-3412-4425-92db-cf3a4495abdc tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:43.556293 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-edf76dc1-3412-4425-92db-cf3a4495abdc tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:43.557046 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-edf76dc1-3412-4425-92db-cf3a4495abdc tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:43.557517 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-edf76dc1-3412-4425-92db-cf3a4495abdc tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:43.566146 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-edf76dc1-3412-4425-92db-cf3a4495abdc tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:43.736050 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-edf76dc1-3412-4425-92db-cf3a4495abdc tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:43.748770 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-edf76dc1-3412-4425-92db-cf3a4495abdc tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:43.751278 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-edf76dc1-3412-4425-92db-cf3a4495abdc tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:43.765593 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-edf76dc1-3412-4425-92db-cf3a4495abdc tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] 10.222.0.60 "GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf" status: 200 len: 1537 microversion: 2.91 time: 0.241760 Sep 14 09:02:43.795792 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1650/3240] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:02:43 2022] GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf => generated 1537 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:02:43.827374 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ad681e7e-d8b6-45f4-9cb4-b9633be69817 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:43.834821 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-ad681e7e-d8b6-45f4-9cb4-b9633be69817 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] [instance: 3d29c068-39c8-4851-82cf-b7639f689f24] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:02:43.848986 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ad681e7e-d8b6-45f4-9cb4-b9633be69817 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:43.856625 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ad681e7e-d8b6-45f4-9cb4-b9633be69817 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:43.857266 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ad681e7e-d8b6-45f4-9cb4-b9633be69817 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:43.859200 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ad681e7e-d8b6-45f4-9cb4-b9633be69817 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:43.860309 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ad681e7e-d8b6-45f4-9cb4-b9633be69817 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:43.861347 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ad681e7e-d8b6-45f4-9cb4-b9633be69817 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:44.117836 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-2914aca0-7866-415a-b23e-01806ae2d011 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] 10.222.0.60 "DELETE /compute/v2.1/images/81e97ec9-8086-403e-b25e-9cf16f6eb89d" status: 204 len: 0 microversion: 2.1 time: 0.782957 Sep 14 09:02:44.118702 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1591/3241] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:02:43 2022] DELETE /compute/v2.1/images/81e97ec9-8086-403e-b25e-9cf16f6eb89d => generated 0 bytes in 785 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:02:44.124467 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-7e689137-99d9-48f4-a18c-7aab982e2ba2 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Calling method '.version_select at 0x7f7d44279b80>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:44.227098 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-7e689137-99d9-48f4-a18c-7aab982e2ba2 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] 10.222.0.60 "GET /compute/v2.1/images/165c831f-0a00-4eac-be4f-8a4c39096827" status: 200 len: 1420 microversion: 2.1 time: 0.106870 Sep 14 09:02:44.231114 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1592/3242] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:02:44 2022] GET /compute/v2.1/images/165c831f-0a00-4eac-be4f-8a4c39096827 => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:02:44.239830 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-42bcd79d-a7a7-4d87-9213-2cfccdd5f05f tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:44.246072 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-42bcd79d-a7a7-4d87-9213-2cfccdd5f05f tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: 56742f27-4436-4fc3-b7a5-9d337395b7d3] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:02:44.259897 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-42bcd79d-a7a7-4d87-9213-2cfccdd5f05f tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:44.263662 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-42bcd79d-a7a7-4d87-9213-2cfccdd5f05f tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:44.264350 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-42bcd79d-a7a7-4d87-9213-2cfccdd5f05f tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:44.265263 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-42bcd79d-a7a7-4d87-9213-2cfccdd5f05f tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:44.267505 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-42bcd79d-a7a7-4d87-9213-2cfccdd5f05f tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:44.268127 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-42bcd79d-a7a7-4d87-9213-2cfccdd5f05f tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:44.618478 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-42bcd79d-a7a7-4d87-9213-2cfccdd5f05f tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:44.628046 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-42bcd79d-a7a7-4d87-9213-2cfccdd5f05f tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/56742f27-4436-4fc3-b7a5-9d337395b7d3" status: 200 len: 1314 microversion: 2.1 time: 0.395620 Sep 14 09:02:44.628638 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1593/3243] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:02:44 2022] GET /compute/v2.1/servers/56742f27-4436-4fc3-b7a5-9d337395b7d3 => generated 1314 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:02:44.650213 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8047f04c-56bc-4d62-ba0a-01df3e77c1e6 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Calling method '.version_select at 0x7f7d487594c0>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:44.872948 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-ad681e7e-d8b6-45f4-9cb4-b9633be69817 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e7ddc7c037439aad2f98277eef199e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e712ce30eb9c4128aa0ec1d425e9ab79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:44.892413 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-ad681e7e-d8b6-45f4-9cb4-b9633be69817 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] 10.222.0.60 "GET /compute/v2.1/servers/3d29c068-39c8-4851-82cf-b7639f689f24" status: 200 len: 1520 microversion: 2.1 time: 1.094768 Sep 14 09:02:44.915432 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1651/3244] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:02:43 2022] GET /compute/v2.1/servers/3d29c068-39c8-4851-82cf-b7639f689f24 => generated 1520 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:02:44.925399 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-4288cfd9-3047-491f-885d-34e5a74a5e5c tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:44.926038 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-4288cfd9-3047-491f-885d-34e5a74a5e5c tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] [instance: 26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:02:44.958310 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4288cfd9-3047-491f-885d-34e5a74a5e5c tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:44.958825 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4288cfd9-3047-491f-885d-34e5a74a5e5c tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:44.959460 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4288cfd9-3047-491f-885d-34e5a74a5e5c tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:44.960435 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4288cfd9-3047-491f-885d-34e5a74a5e5c tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:44.961205 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4288cfd9-3047-491f-885d-34e5a74a5e5c tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:44.961804 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4288cfd9-3047-491f-885d-34e5a74a5e5c tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:45.331191 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-4288cfd9-3047-491f-885d-34e5a74a5e5c tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:45.355629 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-4288cfd9-3047-491f-885d-34e5a74a5e5c tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:45.357094 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-4288cfd9-3047-491f-885d-34e5a74a5e5c tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:45.365632 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-4288cfd9-3047-491f-885d-34e5a74a5e5c tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] 10.222.0.60 "GET /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0" status: 200 len: 1874 microversion: 2.32 time: 0.448148 Sep 14 09:02:45.366634 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1652/3245] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:02:44 2022] GET /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0 => generated 1874 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:02:45.374964 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-25a2b4c7-98e6-4315-9d97-71df555ec963 req-1354fe78-84e2-4918-aa6f-95522dc61798 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7558efb0-7f2d-42d5-9b6d-e442008b1c88", "name": "network-vif-plugged", "status": "completed", "tag": "84b61202-de19-4a04-b9dd-3a01a864606e"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:02:45.408097 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-25a2b4c7-98e6-4315-9d97-71df555ec963 req-1354fe78-84e2-4918-aa6f-95522dc61798 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:45.408885 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-25a2b4c7-98e6-4315-9d97-71df555ec963 req-1354fe78-84e2-4918-aa6f-95522dc61798 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:45.409372 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-25a2b4c7-98e6-4315-9d97-71df555ec963 req-1354fe78-84e2-4918-aa6f-95522dc61798 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:45.452214 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-25a2b4c7-98e6-4315-9d97-71df555ec963 req-1354fe78-84e2-4918-aa6f-95522dc61798 service nova] Creating event network-vif-plugged:84b61202-de19-4a04-b9dd-3a01a864606e for instance 7558efb0-7f2d-42d5-9b6d-e442008b1c88 on n-h2-836830-18 Sep 14 09:02:45.462000 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-25a2b4c7-98e6-4315-9d97-71df555ec963 req-1354fe78-84e2-4918-aa6f-95522dc61798 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093814 Sep 14 09:02:45.465563 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1653/3246] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:02:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:02:45.480319 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-5679c204-64c9-40dd-9cc4-bfe5e85f0bc5 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:45.481298 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-5679c204-64c9-40dd-9cc4-bfe5e85f0bc5 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] [instance: 0eb40c80-c056-4096-a586-7e957a63f7cf] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:02:45.497145 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5679c204-64c9-40dd-9cc4-bfe5e85f0bc5 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:45.497649 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5679c204-64c9-40dd-9cc4-bfe5e85f0bc5 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:45.498087 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5679c204-64c9-40dd-9cc4-bfe5e85f0bc5 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:45.498812 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5679c204-64c9-40dd-9cc4-bfe5e85f0bc5 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:45.503453 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5679c204-64c9-40dd-9cc4-bfe5e85f0bc5 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:45.503957 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5679c204-64c9-40dd-9cc4-bfe5e85f0bc5 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:45.691463 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-8047f04c-56bc-4d62-ba0a-01df3e77c1e6 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] 10.222.0.60 "DELETE /compute/v2.1/images/be62d386-20a6-4610-9cf3-1a1a7817aac8" status: 204 len: 0 microversion: 2.1 time: 1.057828 Sep 14 09:02:45.692188 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1594/3247] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:02:44 2022] DELETE /compute/v2.1/images/be62d386-20a6-4610-9cf3-1a1a7817aac8 => generated 0 bytes in 1059 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:02:45.698719 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-254de9b7-51aa-4bea-b756-ea0162f50cf3 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Calling method '.version_select at 0x7f7d3fcb4c10>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:45.771283 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-254de9b7-51aa-4bea-b756-ea0162f50cf3 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] 10.222.0.60 "GET /compute/v2.1/images/165c831f-0a00-4eac-be4f-8a4c39096827" status: 200 len: 1420 microversion: 2.1 time: 0.077173 Sep 14 09:02:45.773010 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1595/3248] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:02:45 2022] GET /compute/v2.1/images/165c831f-0a00-4eac-be4f-8a4c39096827 => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:02:45.780243 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-92736819-52b7-4a25-89e0-aebee321dd21 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:45.781553 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-92736819-52b7-4a25-89e0-aebee321dd21 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: 56742f27-4436-4fc3-b7a5-9d337395b7d3] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:02:45.791980 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-92736819-52b7-4a25-89e0-aebee321dd21 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:45.794123 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-92736819-52b7-4a25-89e0-aebee321dd21 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:45.794765 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-92736819-52b7-4a25-89e0-aebee321dd21 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:45.795751 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-92736819-52b7-4a25-89e0-aebee321dd21 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:45.796409 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-92736819-52b7-4a25-89e0-aebee321dd21 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:45.797077 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-92736819-52b7-4a25-89e0-aebee321dd21 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:45.951307 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-5679c204-64c9-40dd-9cc4-bfe5e85f0bc5 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:45.966412 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-5679c204-64c9-40dd-9cc4-bfe5e85f0bc5 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:45.967993 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-5679c204-64c9-40dd-9cc4-bfe5e85f0bc5 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:45.979363 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-5679c204-64c9-40dd-9cc4-bfe5e85f0bc5 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] 10.222.0.60 "GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf" status: 200 len: 1537 microversion: 2.91 time: 0.512397 Sep 14 09:02:45.997848 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1654/3249] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:02:45 2022] GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf => generated 1537 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:02:46.007709 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-dd9cabad-df67-44cc-bcb8-5704043f850f tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Calling method '.version_select at 0x7f7d44346940>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:46.893195 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-92736819-52b7-4a25-89e0-aebee321dd21 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:46.903575 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-92736819-52b7-4a25-89e0-aebee321dd21 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/56742f27-4436-4fc3-b7a5-9d337395b7d3" status: 200 len: 1314 microversion: 2.1 time: 1.128995 Sep 14 09:02:46.907256 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1596/3250] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:02:45 2022] GET /compute/v2.1/servers/56742f27-4436-4fc3-b7a5-9d337395b7d3 => generated 1314 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:02:46.927195 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-49d966d8-06ca-429d-84ee-eb6db0c57baf req-9d133d63-a40e-44c7-a82d-734c601e0b01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56742f27-4436-4fc3-b7a5-9d337395b7d3", "tag": "e92ed0eb-9d91-4524-8cc5-74fa8171574d"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:02:46.941810 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-49d966d8-06ca-429d-84ee-eb6db0c57baf req-9d133d63-a40e-44c7-a82d-734c601e0b01 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:46.942305 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-49d966d8-06ca-429d-84ee-eb6db0c57baf req-9d133d63-a40e-44c7-a82d-734c601e0b01 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:46.942752 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-49d966d8-06ca-429d-84ee-eb6db0c57baf req-9d133d63-a40e-44c7-a82d-734c601e0b01 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:46.970535 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-49d966d8-06ca-429d-84ee-eb6db0c57baf req-9d133d63-a40e-44c7-a82d-734c601e0b01 service nova] Creating event network-changed:e92ed0eb-9d91-4524-8cc5-74fa8171574d for instance 56742f27-4436-4fc3-b7a5-9d337395b7d3 on n-h1-836830-18 Sep 14 09:02:46.974979 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-dd9cabad-df67-44cc-bcb8-5704043f850f tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] 10.222.0.60 "DELETE /compute/v2.1/images/dad3a300-4c39-4706-a163-fe284681c5e2" status: 204 len: 0 microversion: 2.1 time: 0.975884 Sep 14 09:02:46.978829 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1655/3251] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:02:45 2022] DELETE /compute/v2.1/images/dad3a300-4c39-4706-a163-fe284681c5e2 => generated 0 bytes in 977 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:02:46.980642 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-49d966d8-06ca-429d-84ee-eb6db0c57baf req-9d133d63-a40e-44c7-a82d-734c601e0b01 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072134 Sep 14 09:02:46.981381 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1597/3252] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:02:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:02:46.981711 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-09ff5185-148b-47f7-b90b-632bbbcaa33d tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:46.982397 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-09ff5185-148b-47f7-b90b-632bbbcaa33d tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] [instance: 3d29c068-39c8-4851-82cf-b7639f689f24] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:02:46.991182 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c3c2e719-15d1-4ac4-b6c1-de8ad335bd32 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:46.992795 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-c3c2e719-15d1-4ac4-b6c1-de8ad335bd32 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] [instance: 26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:02:46.998371 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-09ff5185-148b-47f7-b90b-632bbbcaa33d tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:46.998931 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-09ff5185-148b-47f7-b90b-632bbbcaa33d tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:46.999401 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-09ff5185-148b-47f7-b90b-632bbbcaa33d tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:47.001986 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c3c2e719-15d1-4ac4-b6c1-de8ad335bd32 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:47.002376 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-09ff5185-148b-47f7-b90b-632bbbcaa33d tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:47.002857 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-09ff5185-148b-47f7-b90b-632bbbcaa33d tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:47.003253 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c3c2e719-15d1-4ac4-b6c1-de8ad335bd32 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:47.003372 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-09ff5185-148b-47f7-b90b-632bbbcaa33d tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:47.004018 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c3c2e719-15d1-4ac4-b6c1-de8ad335bd32 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:47.005072 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c3c2e719-15d1-4ac4-b6c1-de8ad335bd32 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:47.005741 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c3c2e719-15d1-4ac4-b6c1-de8ad335bd32 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:47.006775 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c3c2e719-15d1-4ac4-b6c1-de8ad335bd32 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:47.213015 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-c3c2e719-15d1-4ac4-b6c1-de8ad335bd32 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:47.223210 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-c3c2e719-15d1-4ac4-b6c1-de8ad335bd32 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:47.230173 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-c3c2e719-15d1-4ac4-b6c1-de8ad335bd32 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:47.233103 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-c3c2e719-15d1-4ac4-b6c1-de8ad335bd32 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] 10.222.0.60 "GET /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0" status: 200 len: 1874 microversion: 2.32 time: 0.250675 Sep 14 09:02:47.234052 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1598/3253] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:02:46 2022] GET /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0 => generated 1874 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:02:47.253201 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-eaed68bf-53c6-49c8-83f3-053fa4131105 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Calling method '.version_select at 0x7f7d44279af0>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:47.334138 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-eaed68bf-53c6-49c8-83f3-053fa4131105 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] 10.222.0.60 "GET /compute/v2.1/images/165c831f-0a00-4eac-be4f-8a4c39096827" status: 200 len: 1420 microversion: 2.1 time: 0.098769 Sep 14 09:02:47.334739 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1599/3254] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:02:47 2022] GET /compute/v2.1/images/165c831f-0a00-4eac-be4f-8a4c39096827 => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:02:47.346461 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-beb23731-d978-42a6-b8c6-7326da8c5238 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:47.349813 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-beb23731-d978-42a6-b8c6-7326da8c5238 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] [instance: a4852a58-51c4-4ca0-8c83-19fc8209fd21] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:02:47.361177 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-beb23731-d978-42a6-b8c6-7326da8c5238 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:47.363026 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-beb23731-d978-42a6-b8c6-7326da8c5238 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:47.363919 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-beb23731-d978-42a6-b8c6-7326da8c5238 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:47.364798 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-beb23731-d978-42a6-b8c6-7326da8c5238 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:47.365395 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-beb23731-d978-42a6-b8c6-7326da8c5238 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:47.365834 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-beb23731-d978-42a6-b8c6-7326da8c5238 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:47.419446 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-beb23731-d978-42a6-b8c6-7326da8c5238 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] [instance: a4852a58-51c4-4ca0-8c83-19fc8209fd21] Going to try to terminate instance {{(pid=128759) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:02:47.524316 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-09ff5185-148b-47f7-b90b-632bbbcaa33d tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e7ddc7c037439aad2f98277eef199e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e712ce30eb9c4128aa0ec1d425e9ab79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:47.537969 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-09ff5185-148b-47f7-b90b-632bbbcaa33d tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] 10.222.0.60 "GET /compute/v2.1/servers/3d29c068-39c8-4851-82cf-b7639f689f24" status: 200 len: 1520 microversion: 2.1 time: 0.560376 Sep 14 09:02:47.539674 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1656/3255] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:02:46 2022] GET /compute/v2.1/servers/3d29c068-39c8-4851-82cf-b7639f689f24 => generated 1520 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:02:47.561282 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:02:47.566378 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-553968a4-f65d-4733-a59f-85b155c35c70 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:47.567539 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-553968a4-f65d-4733-a59f-85b155c35c70 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] [instance: 0eb40c80-c056-4096-a586-7e957a63f7cf] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:02:47.570032 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-beb23731-d978-42a6-b8c6-7326da8c5238 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] 10.222.0.60 "DELETE /compute/v2.1/servers/a4852a58-51c4-4ca0-8c83-19fc8209fd21" status: 204 len: 0 microversion: 2.1 time: 0.234037 Sep 14 09:02:47.571265 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1600/3256] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:02:47 2022] DELETE /compute/v2.1/servers/a4852a58-51c4-4ca0-8c83-19fc8209fd21 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:02:47.580062 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-553968a4-f65d-4733-a59f-85b155c35c70 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:47.580782 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-553968a4-f65d-4733-a59f-85b155c35c70 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:47.581431 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-553968a4-f65d-4733-a59f-85b155c35c70 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:47.582442 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-553968a4-f65d-4733-a59f-85b155c35c70 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:47.583154 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-553968a4-f65d-4733-a59f-85b155c35c70 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:47.583799 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-553968a4-f65d-4733-a59f-85b155c35c70 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:47.584963 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e2145ad3-947a-4265-ac52-e2f682293bf2 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:47.585754 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e2145ad3-947a-4265-ac52-e2f682293bf2 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] [instance: a4852a58-51c4-4ca0-8c83-19fc8209fd21] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:02:47.596239 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e2145ad3-947a-4265-ac52-e2f682293bf2 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:47.596970 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e2145ad3-947a-4265-ac52-e2f682293bf2 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:47.597487 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e2145ad3-947a-4265-ac52-e2f682293bf2 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:47.598274 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e2145ad3-947a-4265-ac52-e2f682293bf2 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:47.598925 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e2145ad3-947a-4265-ac52-e2f682293bf2 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:47.599380 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e2145ad3-947a-4265-ac52-e2f682293bf2 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:47.721383 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-553968a4-f65d-4733-a59f-85b155c35c70 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:47.735398 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-553968a4-f65d-4733-a59f-85b155c35c70 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:47.738164 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-553968a4-f65d-4733-a59f-85b155c35c70 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:47.744366 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-553968a4-f65d-4733-a59f-85b155c35c70 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] 10.222.0.60 "GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf" status: 200 len: 1537 microversion: 2.91 time: 0.200090 Sep 14 09:02:47.745724 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1657/3257] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:02:47 2022] GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf => generated 1537 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:02:47.930455 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-2b438e28-a4d4-4eb6-8988-13a0326306ca tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:47.931664 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-2b438e28-a4d4-4eb6-8988-13a0326306ca tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: 56742f27-4436-4fc3-b7a5-9d337395b7d3] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:02:47.938981 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2b438e28-a4d4-4eb6-8988-13a0326306ca tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:47.940009 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2b438e28-a4d4-4eb6-8988-13a0326306ca tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:47.940500 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2b438e28-a4d4-4eb6-8988-13a0326306ca tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:47.941734 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2b438e28-a4d4-4eb6-8988-13a0326306ca tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:47.942289 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2b438e28-a4d4-4eb6-8988-13a0326306ca tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:47.942808 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2b438e28-a4d4-4eb6-8988-13a0326306ca tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:48.017476 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-e2145ad3-947a-4265-ac52-e2f682293bf2 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a475c6e2b35f494aa8380aa1783e1779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c6f0c84e964383af6a4025d80fc93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:48.021248 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:02:48.027378 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e2145ad3-947a-4265-ac52-e2f682293bf2 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] 10.222.0.60 "GET /compute/v2.1/servers/a4852a58-51c4-4ca0-8c83-19fc8209fd21" status: 200 len: 1473 microversion: 2.1 time: 0.446304 Sep 14 09:02:48.039725 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1601/3258] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:02:47 2022] GET /compute/v2.1/servers/a4852a58-51c4-4ca0-8c83-19fc8209fd21 => generated 1473 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:02:48.263594 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=4 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:02:48.269062 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b4cd00c4-a286-4dd6-8d4a-2475d4a16019 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:48.270070 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b4cd00c4-a286-4dd6-8d4a-2475d4a16019 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] [instance: 26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:02:48.286922 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b4cd00c4-a286-4dd6-8d4a-2475d4a16019 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:48.287964 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b4cd00c4-a286-4dd6-8d4a-2475d4a16019 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:48.288785 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b4cd00c4-a286-4dd6-8d4a-2475d4a16019 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:48.289973 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b4cd00c4-a286-4dd6-8d4a-2475d4a16019 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:48.290597 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b4cd00c4-a286-4dd6-8d4a-2475d4a16019 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:48.291217 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b4cd00c4-a286-4dd6-8d4a-2475d4a16019 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:48.344003 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-2b438e28-a4d4-4eb6-8988-13a0326306ca tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:48.358063 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-2b438e28-a4d4-4eb6-8988-13a0326306ca tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/56742f27-4436-4fc3-b7a5-9d337395b7d3" status: 200 len: 1314 microversion: 2.1 time: 0.432159 Sep 14 09:02:48.362628 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1658/3259] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:02:47 2022] GET /compute/v2.1/servers/56742f27-4436-4fc3-b7a5-9d337395b7d3 => generated 1314 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:02:48.368573 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d3c64485-5ff3-4f47-80d3-5c5c5595fd52 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Calling method '.version_select at 0x7f7d48629b80>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:48.429352 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-d3c64485-5ff3-4f47-80d3-5c5c5595fd52 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] 10.222.0.60 "GET /compute/v2.1/images/165c831f-0a00-4eac-be4f-8a4c39096827" status: 200 len: 1420 microversion: 2.1 time: 0.065241 Sep 14 09:02:48.430487 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1659/3260] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:02:48 2022] GET /compute/v2.1/images/165c831f-0a00-4eac-be4f-8a4c39096827 => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:02:48.434332 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b4cd00c4-a286-4dd6-8d4a-2475d4a16019 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:48.446703 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b4cd00c4-a286-4dd6-8d4a-2475d4a16019 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:48.448489 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b4cd00c4-a286-4dd6-8d4a-2475d4a16019 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87d4eb547eeb475185d097f03049ccde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a1734368204db58d9d7572726d2794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:48.449872 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b4cd00c4-a286-4dd6-8d4a-2475d4a16019 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] 10.222.0.60 "GET /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0" status: 200 len: 1874 microversion: 2.32 time: 0.189884 Sep 14 09:02:48.464422 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1602/3261] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:02:48 2022] GET /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0 => generated 1874 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 09:02:48.593439 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-efbb18eb-c21d-4f38-81fc-29c57cdbc128 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:48.594490 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-efbb18eb-c21d-4f38-81fc-29c57cdbc128 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] [instance: 3d29c068-39c8-4851-82cf-b7639f689f24] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:02:48.606402 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-efbb18eb-c21d-4f38-81fc-29c57cdbc128 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:48.607730 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-efbb18eb-c21d-4f38-81fc-29c57cdbc128 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:48.608389 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-efbb18eb-c21d-4f38-81fc-29c57cdbc128 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:48.609279 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-efbb18eb-c21d-4f38-81fc-29c57cdbc128 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:48.609958 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-efbb18eb-c21d-4f38-81fc-29c57cdbc128 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:48.610558 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-efbb18eb-c21d-4f38-81fc-29c57cdbc128 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:48.775220 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-67d5426f-9dd5-4dc7-a23a-a1cb8877dff3 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:48.776161 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-67d5426f-9dd5-4dc7-a23a-a1cb8877dff3 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] [instance: 0eb40c80-c056-4096-a586-7e957a63f7cf] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:02:48.784170 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-67d5426f-9dd5-4dc7-a23a-a1cb8877dff3 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:48.784776 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-67d5426f-9dd5-4dc7-a23a-a1cb8877dff3 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:48.785864 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-67d5426f-9dd5-4dc7-a23a-a1cb8877dff3 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:48.786669 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-67d5426f-9dd5-4dc7-a23a-a1cb8877dff3 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:48.787223 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-67d5426f-9dd5-4dc7-a23a-a1cb8877dff3 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:48.787719 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-67d5426f-9dd5-4dc7-a23a-a1cb8877dff3 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:48.926101 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-67d5426f-9dd5-4dc7-a23a-a1cb8877dff3 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:48.935990 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-67d5426f-9dd5-4dc7-a23a-a1cb8877dff3 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:48.937869 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-67d5426f-9dd5-4dc7-a23a-a1cb8877dff3 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:48.944042 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-67d5426f-9dd5-4dc7-a23a-a1cb8877dff3 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] 10.222.0.60 "GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf" status: 200 len: 1537 microversion: 2.91 time: 0.174986 Sep 14 09:02:48.958975 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1603/3262] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:02:48 2022] GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf => generated 1537 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:02:49.048226 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-efbb18eb-c21d-4f38-81fc-29c57cdbc128 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e7ddc7c037439aad2f98277eef199e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e712ce30eb9c4128aa0ec1d425e9ab79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:49.051178 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-90807532-beac-40d8-91d7-437f91ebb514 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:49.051803 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-90807532-beac-40d8-91d7-437f91ebb514 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] [instance: a4852a58-51c4-4ca0-8c83-19fc8209fd21] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:02:49.061586 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-efbb18eb-c21d-4f38-81fc-29c57cdbc128 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] 10.222.0.60 "GET /compute/v2.1/servers/3d29c068-39c8-4851-82cf-b7639f689f24" status: 200 len: 1520 microversion: 2.1 time: 0.473366 Sep 14 09:02:49.063684 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1660/3263] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:02:48 2022] GET /compute/v2.1/servers/3d29c068-39c8-4851-82cf-b7639f689f24 => generated 1520 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:02:49.080791 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-90807532-beac-40d8-91d7-437f91ebb514 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:49.081450 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-90807532-beac-40d8-91d7-437f91ebb514 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:49.082118 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-90807532-beac-40d8-91d7-437f91ebb514 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:49.082563 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-90807532-beac-40d8-91d7-437f91ebb514 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:49.083047 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-90807532-beac-40d8-91d7-437f91ebb514 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:49.083473 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-90807532-beac-40d8-91d7-437f91ebb514 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:49.390997 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-2732a635-67da-4fae-8244-25b59679d9fe tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:49.391619 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-2732a635-67da-4fae-8244-25b59679d9fe tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: 56742f27-4436-4fc3-b7a5-9d337395b7d3] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:02:49.404036 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2732a635-67da-4fae-8244-25b59679d9fe tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:49.404752 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2732a635-67da-4fae-8244-25b59679d9fe tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:49.405360 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2732a635-67da-4fae-8244-25b59679d9fe tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:49.406602 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2732a635-67da-4fae-8244-25b59679d9fe tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:49.407568 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2732a635-67da-4fae-8244-25b59679d9fe tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:49.408434 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2732a635-67da-4fae-8244-25b59679d9fe tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:49.698618 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=12 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:02:50.161162 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=6 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:02:50.168954 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-90807532-beac-40d8-91d7-437f91ebb514 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a475c6e2b35f494aa8380aa1783e1779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c6f0c84e964383af6a4025d80fc93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:50.178365 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-90807532-beac-40d8-91d7-437f91ebb514 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] 10.222.0.60 "GET /compute/v2.1/servers/a4852a58-51c4-4ca0-8c83-19fc8209fd21" status: 200 len: 1473 microversion: 2.1 time: 1.131058 Sep 14 09:02:50.179358 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1604/3264] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:02:49 2022] GET /compute/v2.1/servers/a4852a58-51c4-4ca0-8c83-19fc8209fd21 => generated 1473 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:02:50.197375 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-36405c36-2cc4-4b59-9e59-6fca7f518888 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Calling method '.version_select at 0x7f7d4445bdc0>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:50.278277 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-36405c36-2cc4-4b59-9e59-6fca7f518888 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] 10.222.0.60 "GET /compute/v2.1/images/165c831f-0a00-4eac-be4f-8a4c39096827" status: 200 len: 1420 microversion: 2.1 time: 0.085878 Sep 14 09:02:50.279227 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1605/3265] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:02:50 2022] GET /compute/v2.1/images/165c831f-0a00-4eac-be4f-8a4c39096827 => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:02:50.288113 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-fb2ccabc-17e0-444a-baa5-18d037f9a3c4 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:50.288734 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-fb2ccabc-17e0-444a-baa5-18d037f9a3c4 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] [instance: 26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:02:50.296450 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fb2ccabc-17e0-444a-baa5-18d037f9a3c4 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:50.296960 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fb2ccabc-17e0-444a-baa5-18d037f9a3c4 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:50.297410 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fb2ccabc-17e0-444a-baa5-18d037f9a3c4 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:50.298131 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fb2ccabc-17e0-444a-baa5-18d037f9a3c4 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:50.298583 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fb2ccabc-17e0-444a-baa5-18d037f9a3c4 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:50.299246 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fb2ccabc-17e0-444a-baa5-18d037f9a3c4 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:50.315659 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-fb2ccabc-17e0-444a-baa5-18d037f9a3c4 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] HTTP exception thrown: Instance 26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0 could not be found. Sep 14 09:02:50.318003 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-fb2ccabc-17e0-444a-baa5-18d037f9a3c4 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Request method failure captured: Sep 14 09:02:50.318003 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0 HTTP/1.1 Sep 14 09:02:50.318003 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:02:50.318003 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:02:50.318003 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:02:50.318003 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:02:50.318003 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:02:50.318003 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:02:50.318003 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:02:50.318003 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:02:50.318003 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZcy2NW6FmNx4UiFej-96GaD7A9OycLxwLvU2PLweazpCYur5bRpXVEWXh7x_e4F4z7Za42fgtNOXsDOh2Ao1_s9gT874tZ76KGA1HkmpzmZ9cs03DlpBI5JWdZKgCDgU9oxwQAoJmFi8sfgPG4VGiXa5sd1kQKcOX4EtqXZCu0_NqU Sep 14 09:02:50.318003 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:02:50.318003 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:02:50.318003 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:02:50.318003 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:02:50.318003 n-d-836830-18 devstack@n-api.service[128759]: X-Openstack-Nova-Api-Version: 2.32 Sep 14 09:02:50.318003 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:02:50.318003 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:02:50.318003 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 46a1734368204db58d9d7572726d2794 Sep 14 09:02:50.318003 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-TaggedBootDevicesTest-970937063 Sep 14 09:02:50.318003 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:02:50.318003 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:02:50.318003 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/46a1734368204db58d9d7572726d2794"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_46a1734368204db58d9d7572726d2794"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/46a1734368204db58d9d7572726d2794"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/46a1734368204db58d9d7572726d2794"}]}] Sep 14 09:02:50.318003 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-TaggedBootDevicesTest-970937063 Sep 14 09:02:50.318003 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 46a1734368204db58d9d7572726d2794 Sep 14 09:02:50.318003 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-TaggedBootDevicesTest-970937063 Sep 14 09:02:50.318003 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-TaggedBootDevicesTest-970937063-project Sep 14 09:02:50.318003 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:02:50.318003 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:02:50.318003 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 87d4eb547eeb475185d097f03049ccde Sep 14 09:02:50.318003 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-TaggedBootDevicesTest-970937063-project Sep 14 09:02:50.318003 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:02:50.318003 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance 26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0 could not be found. Sep 14 09:02:50.318003 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0'} Sep 14 09:02:50.318003 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:02:50.318003 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:02:50.318003 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:02:50.318003 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:02:50.318003 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:02:50.318003 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:02:50.318003 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:02:50.318003 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:02:50.318003 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:02:50.318003 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:02:50.318003 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0 could not be found. Sep 14 09:02:50.318003 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:02:50.318003 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:02:50.318003 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:02:50.318003 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:02:50.318003 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:02:50.318003 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:02:50.318003 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:02:50.318003 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:02:50.318003 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:02:50.318003 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:02:50.318003 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:02:50.318003 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:02:50.318003 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:02:50.318003 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:02:50.318003 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:02:50.318003 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:02:50.318003 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0 could not be found. Sep 14 09:02:50.318003 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:02:50.318003 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:02:50.318003 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:02:50.323902 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:02:50.323902 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:02:50.323902 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:02:50.323902 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:02:50.323902 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:02:50.323902 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0 could not be found. Sep 14 09:02:50.323902 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:02:50.325115 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-fb2ccabc-17e0-444a-baa5-18d037f9a3c4 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Returning 404 to user: Instance 26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0 could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:02:50.326150 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-fb2ccabc-17e0-444a-baa5-18d037f9a3c4 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] 10.222.0.60 "GET /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0" status: 404 len: 111 microversion: 2.32 time: 0.042940 Sep 14 09:02:50.327037 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1606/3266] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:02:50 2022] GET /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 14 09:02:50.337237 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-228ee144-96a4-43bd-a5bc-270d79baf159 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:50.338152 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-228ee144-96a4-43bd-a5bc-270d79baf159 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] [instance: 0eb40c80-c056-4096-a586-7e957a63f7cf] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:02:50.346216 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-228ee144-96a4-43bd-a5bc-270d79baf159 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:50.346981 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-228ee144-96a4-43bd-a5bc-270d79baf159 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:50.347485 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-228ee144-96a4-43bd-a5bc-270d79baf159 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:50.348185 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-228ee144-96a4-43bd-a5bc-270d79baf159 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:50.348649 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-228ee144-96a4-43bd-a5bc-270d79baf159 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:50.349556 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-228ee144-96a4-43bd-a5bc-270d79baf159 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:50.532989 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-228ee144-96a4-43bd-a5bc-270d79baf159 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:50.552826 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-228ee144-96a4-43bd-a5bc-270d79baf159 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:50.555768 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-228ee144-96a4-43bd-a5bc-270d79baf159 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:50.573921 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-228ee144-96a4-43bd-a5bc-270d79baf159 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] 10.222.0.60 "GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf" status: 200 len: 1537 microversion: 2.91 time: 0.239363 Sep 14 09:02:50.576239 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1607/3267] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:02:50 2022] GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf => generated 1537 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:02:50.584184 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-03b8419a-7ef5-43c2-9a18-f661c9991a6f tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:50.588608 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-03b8419a-7ef5-43c2-9a18-f661c9991a6f tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] [instance: 3d29c068-39c8-4851-82cf-b7639f689f24] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:02:50.597036 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-03b8419a-7ef5-43c2-9a18-f661c9991a6f tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:50.598682 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-03b8419a-7ef5-43c2-9a18-f661c9991a6f tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:50.599476 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-03b8419a-7ef5-43c2-9a18-f661c9991a6f tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:50.600371 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-03b8419a-7ef5-43c2-9a18-f661c9991a6f tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:50.601157 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-03b8419a-7ef5-43c2-9a18-f661c9991a6f tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:50.601838 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-03b8419a-7ef5-43c2-9a18-f661c9991a6f tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:50.639878 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-2732a635-67da-4fae-8244-25b59679d9fe tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:50.651580 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-2732a635-67da-4fae-8244-25b59679d9fe tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/56742f27-4436-4fc3-b7a5-9d337395b7d3" status: 200 len: 1314 microversion: 2.1 time: 1.266889 Sep 14 09:02:50.657144 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1661/3268] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:02:49 2022] GET /compute/v2.1/servers/56742f27-4436-4fc3-b7a5-9d337395b7d3 => generated 1314 bytes in 1273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:02:50.663076 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-24873019-ea21-4e19-a7cc-eda43ab04056 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Calling method '.version_select at 0x7f7d44d6caf0>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:50.701815 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-24873019-ea21-4e19-a7cc-eda43ab04056 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1978855505" status: 204 len: 0 microversion: 2.32 time: 0.043274 Sep 14 09:02:50.706625 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1662/3269] 10.222.0.60 () {60 vars in 1262 bytes} [Wed Sep 14 09:02:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1978855505 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 14 09:02:51.081015 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-03b8419a-7ef5-43c2-9a18-f661c9991a6f tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e7ddc7c037439aad2f98277eef199e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e712ce30eb9c4128aa0ec1d425e9ab79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:51.089027 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-03b8419a-7ef5-43c2-9a18-f661c9991a6f tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] 10.222.0.60 "GET /compute/v2.1/servers/3d29c068-39c8-4851-82cf-b7639f689f24" status: 200 len: 1520 microversion: 2.1 time: 0.510474 Sep 14 09:02:51.089910 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1608/3270] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:02:50 2022] GET /compute/v2.1/servers/3d29c068-39c8-4851-82cf-b7639f689f24 => generated 1520 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:02:51.209053 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c77a8da9-8351-4b46-8266-134e5bbdc0fa tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:51.209053 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-c77a8da9-8351-4b46-8266-134e5bbdc0fa tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] [instance: a4852a58-51c4-4ca0-8c83-19fc8209fd21] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:02:51.231985 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c77a8da9-8351-4b46-8266-134e5bbdc0fa tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:51.232374 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c77a8da9-8351-4b46-8266-134e5bbdc0fa tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:51.232815 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c77a8da9-8351-4b46-8266-134e5bbdc0fa tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:51.233546 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c77a8da9-8351-4b46-8266-134e5bbdc0fa tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:51.234001 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c77a8da9-8351-4b46-8266-134e5bbdc0fa tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:51.239631 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c77a8da9-8351-4b46-8266-134e5bbdc0fa tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:51.295977 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-885771fe-da8f-4416-8969-608d317c6ba2 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Calling method '.version_select at 0x7f7d486cd820>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:51.383390 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-885771fe-da8f-4416-8969-608d317c6ba2 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] 10.222.0.60 "GET /compute/v2.1/images/165c831f-0a00-4eac-be4f-8a4c39096827" status: 200 len: 1420 microversion: 2.1 time: 0.091454 Sep 14 09:02:51.386660 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1609/3271] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:02:51 2022] GET /compute/v2.1/images/165c831f-0a00-4eac-be4f-8a4c39096827 => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:02:51.483412 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-c77a8da9-8351-4b46-8266-134e5bbdc0fa tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a475c6e2b35f494aa8380aa1783e1779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c6f0c84e964383af6a4025d80fc93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:51.487151 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=100 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:02:51.493703 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-c77a8da9-8351-4b46-8266-134e5bbdc0fa tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] 10.222.0.60 "GET /compute/v2.1/servers/a4852a58-51c4-4ca0-8c83-19fc8209fd21" status: 200 len: 1431 microversion: 2.1 time: 0.292626 Sep 14 09:02:51.515471 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1663/3272] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:02:51 2022] GET /compute/v2.1/servers/a4852a58-51c4-4ca0-8c83-19fc8209fd21 => generated 1431 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:02:51.605206 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-cd117569-f782-4df4-a969-6b5627740ab1 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:51.606283 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-cd117569-f782-4df4-a969-6b5627740ab1 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] [instance: 0eb40c80-c056-4096-a586-7e957a63f7cf] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:02:51.617573 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cd117569-f782-4df4-a969-6b5627740ab1 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:51.622738 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cd117569-f782-4df4-a969-6b5627740ab1 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:51.623593 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cd117569-f782-4df4-a969-6b5627740ab1 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:51.625615 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cd117569-f782-4df4-a969-6b5627740ab1 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:51.628882 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cd117569-f782-4df4-a969-6b5627740ab1 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:51.629669 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cd117569-f782-4df4-a969-6b5627740ab1 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:51.681989 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-8a0b79ee-a9c4-456f-a742-2a9dfd468ab7 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:51.683240 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-8a0b79ee-a9c4-456f-a742-2a9dfd468ab7 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: 56742f27-4436-4fc3-b7a5-9d337395b7d3] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:02:51.695210 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8a0b79ee-a9c4-456f-a742-2a9dfd468ab7 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:51.703996 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8a0b79ee-a9c4-456f-a742-2a9dfd468ab7 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:51.704462 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8a0b79ee-a9c4-456f-a742-2a9dfd468ab7 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:51.705213 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8a0b79ee-a9c4-456f-a742-2a9dfd468ab7 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:51.708460 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8a0b79ee-a9c4-456f-a742-2a9dfd468ab7 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:51.709592 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8a0b79ee-a9c4-456f-a742-2a9dfd468ab7 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:51.765240 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=16 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:02:52.446440 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-cd117569-f782-4df4-a969-6b5627740ab1 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:52.458179 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-cd117569-f782-4df4-a969-6b5627740ab1 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:52.475595 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-cd117569-f782-4df4-a969-6b5627740ab1 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:52.498769 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-cd117569-f782-4df4-a969-6b5627740ab1 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] 10.222.0.60 "GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf" status: 200 len: 1537 microversion: 2.91 time: 0.897846 Sep 14 09:02:52.500073 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1610/3273] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:02:51 2022] GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf => generated 1537 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:02:52.516197 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c1773bcd-71b2-4220-bed2-27e1f3a39238 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:52.521655 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-c1773bcd-71b2-4220-bed2-27e1f3a39238 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] [instance: 3d29c068-39c8-4851-82cf-b7639f689f24] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:02:52.538782 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c1773bcd-71b2-4220-bed2-27e1f3a39238 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:52.543614 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c1773bcd-71b2-4220-bed2-27e1f3a39238 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:52.545496 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c1773bcd-71b2-4220-bed2-27e1f3a39238 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:52.546472 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c1773bcd-71b2-4220-bed2-27e1f3a39238 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:52.556760 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c1773bcd-71b2-4220-bed2-27e1f3a39238 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:52.557458 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c1773bcd-71b2-4220-bed2-27e1f3a39238 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:52.652409 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-8a0b79ee-a9c4-456f-a742-2a9dfd468ab7 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:52.662790 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-8a0b79ee-a9c4-456f-a742-2a9dfd468ab7 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/56742f27-4436-4fc3-b7a5-9d337395b7d3" status: 200 len: 1314 microversion: 2.1 time: 0.987338 Sep 14 09:02:52.681237 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1664/3274] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:02:51 2022] GET /compute/v2.1/servers/56742f27-4436-4fc3-b7a5-9d337395b7d3 => generated 1314 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:02:52.698398 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-77cc5384-f62b-4a8c-9443-727584fe5a86 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Calling method '.version_select at 0x7f7d44413430>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:52.794068 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-77cc5384-f62b-4a8c-9443-727584fe5a86 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] 10.222.0.60 "GET /compute/v2.1/images/165c831f-0a00-4eac-be4f-8a4c39096827" status: 200 len: 1420 microversion: 2.1 time: 0.105482 Sep 14 09:02:52.794673 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1665/3275] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:02:52 2022] GET /compute/v2.1/images/165c831f-0a00-4eac-be4f-8a4c39096827 => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:02:52.801280 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-4a853181-8955-4025-9c3c-6456676ae203 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:52.806841 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-4a853181-8955-4025-9c3c-6456676ae203 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] [instance: a4852a58-51c4-4ca0-8c83-19fc8209fd21] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:02:52.821931 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4a853181-8955-4025-9c3c-6456676ae203 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:52.822709 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4a853181-8955-4025-9c3c-6456676ae203 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:52.823408 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4a853181-8955-4025-9c3c-6456676ae203 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:52.826690 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4a853181-8955-4025-9c3c-6456676ae203 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:52.827437 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4a853181-8955-4025-9c3c-6456676ae203 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:52.829586 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4a853181-8955-4025-9c3c-6456676ae203 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:53.081748 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-4a853181-8955-4025-9c3c-6456676ae203 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a475c6e2b35f494aa8380aa1783e1779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c6f0c84e964383af6a4025d80fc93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:53.101827 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-4a853181-8955-4025-9c3c-6456676ae203 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] 10.222.0.60 "GET /compute/v2.1/servers/a4852a58-51c4-4ca0-8c83-19fc8209fd21" status: 200 len: 1431 microversion: 2.1 time: 0.305519 Sep 14 09:02:53.103203 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1666/3276] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:02:52 2022] GET /compute/v2.1/servers/a4852a58-51c4-4ca0-8c83-19fc8209fd21 => generated 1431 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:02:53.108942 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-22769dca-9f17-4b67-9de8-092b4d4f1766 req-8d7c2a43-dcae-4c02-b8ff-bc6a5717e35a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56742f27-4436-4fc3-b7a5-9d337395b7d3", "name": "network-vif-plugged", "status": "completed", "tag": "e92ed0eb-9d91-4524-8cc5-74fa8171574d"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:02:53.145493 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-22769dca-9f17-4b67-9de8-092b4d4f1766 req-8d7c2a43-dcae-4c02-b8ff-bc6a5717e35a service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:53.146403 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-22769dca-9f17-4b67-9de8-092b4d4f1766 req-8d7c2a43-dcae-4c02-b8ff-bc6a5717e35a service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:53.147087 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-22769dca-9f17-4b67-9de8-092b4d4f1766 req-8d7c2a43-dcae-4c02-b8ff-bc6a5717e35a service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:53.179811 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-c1773bcd-71b2-4220-bed2-27e1f3a39238 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e7ddc7c037439aad2f98277eef199e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e712ce30eb9c4128aa0ec1d425e9ab79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:53.184910 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-22769dca-9f17-4b67-9de8-092b4d4f1766 req-8d7c2a43-dcae-4c02-b8ff-bc6a5717e35a service nova] Creating event network-vif-plugged:e92ed0eb-9d91-4524-8cc5-74fa8171574d for instance 56742f27-4436-4fc3-b7a5-9d337395b7d3 on n-h1-836830-18 Sep 14 09:02:53.188564 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-c1773bcd-71b2-4220-bed2-27e1f3a39238 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] 10.222.0.60 "GET /compute/v2.1/servers/3d29c068-39c8-4851-82cf-b7639f689f24" status: 200 len: 1520 microversion: 2.1 time: 0.686835 Sep 14 09:02:53.194161 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1611/3277] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:02:52 2022] GET /compute/v2.1/servers/3d29c068-39c8-4851-82cf-b7639f689f24 => generated 1520 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:02:53.206231 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-635552eb-2de8-460e-9217-eec333ed1e17 req-bc884bd3-7b85-4e88-be1a-51753dd20784 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4852a58-51c4-4ca0-8c83-19fc8209fd21", "name": "network-vif-deleted", "tag": "003dc8e7-2302-41ad-87e7-680ccac43c8f"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:02:53.212551 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-22769dca-9f17-4b67-9de8-092b4d4f1766 req-8d7c2a43-dcae-4c02-b8ff-bc6a5717e35a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107690 Sep 14 09:02:53.221375 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1667/3278] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:02:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:02:53.230530 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-635552eb-2de8-460e-9217-eec333ed1e17 req-bc884bd3-7b85-4e88-be1a-51753dd20784 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:53.233437 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-635552eb-2de8-460e-9217-eec333ed1e17 req-bc884bd3-7b85-4e88-be1a-51753dd20784 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:53.235625 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-635552eb-2de8-460e-9217-eec333ed1e17 req-bc884bd3-7b85-4e88-be1a-51753dd20784 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:53.258472 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-635552eb-2de8-460e-9217-eec333ed1e17 req-bc884bd3-7b85-4e88-be1a-51753dd20784 service nova] Creating event network-vif-deleted:003dc8e7-2302-41ad-87e7-680ccac43c8f for instance a4852a58-51c4-4ca0-8c83-19fc8209fd21 on n-h2-836830-18 Sep 14 09:02:53.270194 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-635552eb-2de8-460e-9217-eec333ed1e17 req-bc884bd3-7b85-4e88-be1a-51753dd20784 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072772 Sep 14 09:02:53.275953 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1612/3279] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:02:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:02:53.533795 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-acec948b-8bd3-4f02-9661-93ef7e9ffa58 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:53.535398 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-acec948b-8bd3-4f02-9661-93ef7e9ffa58 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] [instance: 0eb40c80-c056-4096-a586-7e957a63f7cf] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:02:53.556249 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-acec948b-8bd3-4f02-9661-93ef7e9ffa58 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:53.557155 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-acec948b-8bd3-4f02-9661-93ef7e9ffa58 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:53.558332 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-acec948b-8bd3-4f02-9661-93ef7e9ffa58 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:53.559512 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-acec948b-8bd3-4f02-9661-93ef7e9ffa58 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:53.560150 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-acec948b-8bd3-4f02-9661-93ef7e9ffa58 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:53.560735 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-acec948b-8bd3-4f02-9661-93ef7e9ffa58 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:53.696864 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8d2cbe69-63d6-4b47-9b93-e42e5e4a1384 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:53.697801 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-8d2cbe69-63d6-4b47-9b93-e42e5e4a1384 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: 56742f27-4436-4fc3-b7a5-9d337395b7d3] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:02:53.716091 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8d2cbe69-63d6-4b47-9b93-e42e5e4a1384 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:53.727933 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8d2cbe69-63d6-4b47-9b93-e42e5e4a1384 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:53.729626 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8d2cbe69-63d6-4b47-9b93-e42e5e4a1384 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:53.732431 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8d2cbe69-63d6-4b47-9b93-e42e5e4a1384 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:53.734883 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8d2cbe69-63d6-4b47-9b93-e42e5e4a1384 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:53.737760 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8d2cbe69-63d6-4b47-9b93-e42e5e4a1384 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:53.767216 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-acec948b-8bd3-4f02-9661-93ef7e9ffa58 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:53.791455 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-acec948b-8bd3-4f02-9661-93ef7e9ffa58 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:53.799553 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-acec948b-8bd3-4f02-9661-93ef7e9ffa58 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:53.819052 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-acec948b-8bd3-4f02-9661-93ef7e9ffa58 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] 10.222.0.60 "GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf" status: 200 len: 1537 microversion: 2.91 time: 0.290454 Sep 14 09:02:53.824538 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1668/3280] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:02:53 2022] GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf => generated 1537 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:02:53.841839 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-5296ff38-0500-4a18-ae71-d816aec16dd2 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Calling method '.version_select at 0x7f7d443761f0>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:53.940864 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-5296ff38-0500-4a18-ae71-d816aec16dd2 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] 10.222.0.60 "GET /compute/v2.1/images/165c831f-0a00-4eac-be4f-8a4c39096827" status: 200 len: 1420 microversion: 2.1 time: 0.114493 Sep 14 09:02:53.952224 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1669/3281] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:02:53 2022] GET /compute/v2.1/images/165c831f-0a00-4eac-be4f-8a4c39096827 => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:02:54.133685 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-92683a96-9467-4b07-8b9b-d8045b338d2e tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:54.134510 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-92683a96-9467-4b07-8b9b-d8045b338d2e tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] [instance: a4852a58-51c4-4ca0-8c83-19fc8209fd21] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:02:54.146149 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-92683a96-9467-4b07-8b9b-d8045b338d2e tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:54.148272 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-92683a96-9467-4b07-8b9b-d8045b338d2e tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:54.148904 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-92683a96-9467-4b07-8b9b-d8045b338d2e tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:54.150802 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-92683a96-9467-4b07-8b9b-d8045b338d2e tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:54.152163 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-92683a96-9467-4b07-8b9b-d8045b338d2e tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:54.152912 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-92683a96-9467-4b07-8b9b-d8045b338d2e tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:54.187998 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-92683a96-9467-4b07-8b9b-d8045b338d2e tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] HTTP exception thrown: Instance a4852a58-51c4-4ca0-8c83-19fc8209fd21 could not be found. Sep 14 09:02:54.191693 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-92683a96-9467-4b07-8b9b-d8045b338d2e tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Request method failure captured: Sep 14 09:02:54.191693 n-d-836830-18 devstack@n-api.service[128758]: request: GET /compute/v2.1/servers/a4852a58-51c4-4ca0-8c83-19fc8209fd21 HTTP/1.1 Sep 14 09:02:54.191693 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 09:02:54.191693 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 09:02:54.191693 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 09:02:54.191693 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 09:02:54.191693 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 09:02:54.191693 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 09:02:54.191693 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 09:02:54.191693 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 09:02:54.191693 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZgl_ZWb0FNcWaOmNNHYtWqIb3azMQtrys8dVpICEyzpDSjE79Mljx-HsEVHmqhDCVQUq3W7dajRIX2CH3vVThJj4tt218fvqyKrkymGHJvKGnAz4G5XVvm7y9CEC6kYfc3KOzfwDbSWaM3cKGxW8zxkPRnEzFqNa8Xpr9D_caPmuxI Sep 14 09:02:54.191693 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 09:02:54.191693 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 09:02:54.191693 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 09:02:54.191693 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 09:02:54.191693 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 09:02:54.191693 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 09:02:54.191693 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 63c6f0c84e964383af6a4025d80fc93d Sep 14 09:02:54.191693 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-ListImageFiltersTestJSON-1411140694 Sep 14 09:02:54.191693 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 09:02:54.191693 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 09:02:54.191693 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/63c6f0c84e964383af6a4025d80fc93d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_63c6f0c84e964383af6a4025d80fc93d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/63c6f0c84e964383af6a4025d80fc93d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/63c6f0c84e964383af6a4025d80fc93d"}]}] Sep 14 09:02:54.191693 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-ListImageFiltersTestJSON-1411140694 Sep 14 09:02:54.191693 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 63c6f0c84e964383af6a4025d80fc93d Sep 14 09:02:54.191693 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1411140694 Sep 14 09:02:54.191693 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-ListImageFiltersTestJSON-1411140694-project Sep 14 09:02:54.191693 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 09:02:54.191693 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 09:02:54.191693 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: a475c6e2b35f494aa8380aa1783e1779 Sep 14 09:02:54.191693 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-ListImageFiltersTestJSON-1411140694-project Sep 14 09:02:54.191693 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 09:02:54.191693 n-d-836830-18 devstack@n-api.service[128758]: exception: Instance a4852a58-51c4-4ca0-8c83-19fc8209fd21 could not be found. Sep 14 09:02:54.191693 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': 'a4852a58-51c4-4ca0-8c83-19fc8209fd21'} Sep 14 09:02:54.191693 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:02:54.191693 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:02:54.191693 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:02:54.191693 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:02:54.191693 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:02:54.191693 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:02:54.191693 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:02:54.191693 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:02:54.191693 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:02:54.191693 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:02:54.191693 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4852a58-51c4-4ca0-8c83-19fc8209fd21 could not be found. Sep 14 09:02:54.191693 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:02:54.191693 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:02:54.191693 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:02:54.191693 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:02:54.191693 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:02:54.191693 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:02:54.191693 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:02:54.191693 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:02:54.191693 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:02:54.191693 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:02:54.191693 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:02:54.191693 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:02:54.191693 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:02:54.191693 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:02:54.191693 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:02:54.191693 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:02:54.191693 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4852a58-51c4-4ca0-8c83-19fc8209fd21 could not be found. Sep 14 09:02:54.191693 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:02:54.191693 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:02:54.191693 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:02:54.197888 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:02:54.197888 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:02:54.197888 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:02:54.197888 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:02:54.197888 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:02:54.197888 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4852a58-51c4-4ca0-8c83-19fc8209fd21 could not be found. Sep 14 09:02:54.197888 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:02:54.200869 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-92683a96-9467-4b07-8b9b-d8045b338d2e tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Returning 404 to user: Instance a4852a58-51c4-4ca0-8c83-19fc8209fd21 could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:02:54.201913 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-92683a96-9467-4b07-8b9b-d8045b338d2e tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] 10.222.0.60 "GET /compute/v2.1/servers/a4852a58-51c4-4ca0-8c83-19fc8209fd21" status: 404 len: 111 microversion: 2.1 time: 0.072889 Sep 14 09:02:54.206278 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1670/3282] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:02:54 2022] GET /compute/v2.1/servers/a4852a58-51c4-4ca0-8c83-19fc8209fd21 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 14 09:02:54.214555 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d6f204c9-10e4-44db-92fd-3cf9f71b26ec tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:54.215149 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-d6f204c9-10e4-44db-92fd-3cf9f71b26ec tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] [instance: ebf9bfa9-e941-4d23-8f6c-9867102feff2] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:02:54.222761 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d6f204c9-10e4-44db-92fd-3cf9f71b26ec tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:54.223503 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d6f204c9-10e4-44db-92fd-3cf9f71b26ec tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:54.224130 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d6f204c9-10e4-44db-92fd-3cf9f71b26ec tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:54.225072 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d6f204c9-10e4-44db-92fd-3cf9f71b26ec tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:54.225678 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d6f204c9-10e4-44db-92fd-3cf9f71b26ec tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:54.226258 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d6f204c9-10e4-44db-92fd-3cf9f71b26ec tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:54.275398 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-d6f204c9-10e4-44db-92fd-3cf9f71b26ec tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] [instance: ebf9bfa9-e941-4d23-8f6c-9867102feff2] Going to try to terminate instance {{(pid=128758) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:02:54.497650 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:02:54.515041 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-d6f204c9-10e4-44db-92fd-3cf9f71b26ec tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] 10.222.0.60 "DELETE /compute/v2.1/servers/ebf9bfa9-e941-4d23-8f6c-9867102feff2" status: 204 len: 0 microversion: 2.1 time: 0.307111 Sep 14 09:02:54.519380 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1671/3283] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:02:54 2022] DELETE /compute/v2.1/servers/ebf9bfa9-e941-4d23-8f6c-9867102feff2 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:02:54.525507 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-5c9e27f1-de48-4845-89c0-abdd0ab21b7a tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:54.527286 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-5c9e27f1-de48-4845-89c0-abdd0ab21b7a tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] [instance: 3d29c068-39c8-4851-82cf-b7639f689f24] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:02:54.540113 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5c9e27f1-de48-4845-89c0-abdd0ab21b7a tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:54.540609 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5c9e27f1-de48-4845-89c0-abdd0ab21b7a tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:54.541258 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5c9e27f1-de48-4845-89c0-abdd0ab21b7a tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:54.541761 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5c9e27f1-de48-4845-89c0-abdd0ab21b7a tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:54.542791 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5c9e27f1-de48-4845-89c0-abdd0ab21b7a tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:54.543248 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5c9e27f1-de48-4845-89c0-abdd0ab21b7a tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:54.965377 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-8d2cbe69-63d6-4b47-9b93-e42e5e4a1384 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:54.983352 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-8d2cbe69-63d6-4b47-9b93-e42e5e4a1384 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/56742f27-4436-4fc3-b7a5-9d337395b7d3" status: 200 len: 1314 microversion: 2.1 time: 1.284050 Sep 14 09:02:54.987122 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1613/3284] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:02:53 2022] GET /compute/v2.1/servers/56742f27-4436-4fc3-b7a5-9d337395b7d3 => generated 1314 bytes in 1294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:02:55.000624 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-aec55ef8-d12e-4a3f-87eb-5f66c3d4c4ff tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:55.004595 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-aec55ef8-d12e-4a3f-87eb-5f66c3d4c4ff tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] [instance: ebf9bfa9-e941-4d23-8f6c-9867102feff2] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:02:55.021410 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-aec55ef8-d12e-4a3f-87eb-5f66c3d4c4ff tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:55.023019 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-aec55ef8-d12e-4a3f-87eb-5f66c3d4c4ff tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:55.024838 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-aec55ef8-d12e-4a3f-87eb-5f66c3d4c4ff tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:55.028866 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-aec55ef8-d12e-4a3f-87eb-5f66c3d4c4ff tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:55.029533 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-aec55ef8-d12e-4a3f-87eb-5f66c3d4c4ff tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:55.030164 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-aec55ef8-d12e-4a3f-87eb-5f66c3d4c4ff tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:56.147079 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-5c9e27f1-de48-4845-89c0-abdd0ab21b7a tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e7ddc7c037439aad2f98277eef199e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e712ce30eb9c4128aa0ec1d425e9ab79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:56.163327 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-5c9e27f1-de48-4845-89c0-abdd0ab21b7a tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] 10.222.0.60 "GET /compute/v2.1/servers/3d29c068-39c8-4851-82cf-b7639f689f24" status: 200 len: 1520 microversion: 2.1 time: 1.642542 Sep 14 09:02:56.168737 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1672/3285] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:02:54 2022] GET /compute/v2.1/servers/3d29c068-39c8-4851-82cf-b7639f689f24 => generated 1520 bytes in 1649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:02:56.180583 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-3cadfc44-dcd4-4b1e-a085-0330cb1ee534 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:56.186608 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-3cadfc44-dcd4-4b1e-a085-0330cb1ee534 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] [instance: 0eb40c80-c056-4096-a586-7e957a63f7cf] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:02:56.200151 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3cadfc44-dcd4-4b1e-a085-0330cb1ee534 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:56.206377 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3cadfc44-dcd4-4b1e-a085-0330cb1ee534 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:56.207152 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3cadfc44-dcd4-4b1e-a085-0330cb1ee534 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:56.208093 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3cadfc44-dcd4-4b1e-a085-0330cb1ee534 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:56.208738 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3cadfc44-dcd4-4b1e-a085-0330cb1ee534 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:56.209334 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3cadfc44-dcd4-4b1e-a085-0330cb1ee534 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:56.366567 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-aec55ef8-d12e-4a3f-87eb-5f66c3d4c4ff tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a475c6e2b35f494aa8380aa1783e1779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c6f0c84e964383af6a4025d80fc93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:56.384316 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-aec55ef8-d12e-4a3f-87eb-5f66c3d4c4ff tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] 10.222.0.60 "GET /compute/v2.1/servers/ebf9bfa9-e941-4d23-8f6c-9867102feff2" status: 200 len: 1472 microversion: 2.1 time: 1.393892 Sep 14 09:02:56.409015 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1614/3286] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:02:54 2022] GET /compute/v2.1/servers/ebf9bfa9-e941-4d23-8f6c-9867102feff2 => generated 1472 bytes in 1424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:02:56.429113 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-7e06d6cf-f81c-4676-99df-f4af395eb5ba tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Calling method '.version_select at 0x7f7d44206ee0>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:56.446087 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-3cadfc44-dcd4-4b1e-a085-0330cb1ee534 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:56.473584 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-3cadfc44-dcd4-4b1e-a085-0330cb1ee534 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:56.482549 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-3cadfc44-dcd4-4b1e-a085-0330cb1ee534 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:56.506732 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-3cadfc44-dcd4-4b1e-a085-0330cb1ee534 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] 10.222.0.60 "GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf" status: 200 len: 1537 microversion: 2.91 time: 0.335649 Sep 14 09:02:56.508975 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1673/3287] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:02:56 2022] GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf => generated 1537 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:02:56.520439 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-4612f893-265d-4d65-b6cc-cc1c3bd45040 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:56.521265 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-4612f893-265d-4d65-b6cc-cc1c3bd45040 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: 56742f27-4436-4fc3-b7a5-9d337395b7d3] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:02:56.533035 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-7e06d6cf-f81c-4676-99df-f4af395eb5ba tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] 10.222.0.60 "GET /compute/v2.1/images/165c831f-0a00-4eac-be4f-8a4c39096827" status: 200 len: 1420 microversion: 2.1 time: 0.122638 Sep 14 09:02:56.533619 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1615/3288] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:02:56 2022] GET /compute/v2.1/images/165c831f-0a00-4eac-be4f-8a4c39096827 => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:02:56.545036 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4612f893-265d-4d65-b6cc-cc1c3bd45040 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:56.545880 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4612f893-265d-4d65-b6cc-cc1c3bd45040 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:56.546520 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4612f893-265d-4d65-b6cc-cc1c3bd45040 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:56.547496 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4612f893-265d-4d65-b6cc-cc1c3bd45040 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:56.548154 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4612f893-265d-4d65-b6cc-cc1c3bd45040 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:56.548778 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4612f893-265d-4d65-b6cc-cc1c3bd45040 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:57.043041 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-4612f893-265d-4d65-b6cc-cc1c3bd45040 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:57.058088 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-4612f893-265d-4d65-b6cc-cc1c3bd45040 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/56742f27-4436-4fc3-b7a5-9d337395b7d3" status: 200 len: 1314 microversion: 2.1 time: 0.547839 Sep 14 09:02:57.085132 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1674/3289] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:02:56 2022] GET /compute/v2.1/servers/56742f27-4436-4fc3-b7a5-9d337395b7d3 => generated 1314 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:02:57.194789 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b7b03ebe-6e3e-48be-bc2c-cda2c8c7d145 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:57.195980 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b7b03ebe-6e3e-48be-bc2c-cda2c8c7d145 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] [instance: 3d29c068-39c8-4851-82cf-b7639f689f24] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:02:57.205978 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b7b03ebe-6e3e-48be-bc2c-cda2c8c7d145 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:57.207084 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b7b03ebe-6e3e-48be-bc2c-cda2c8c7d145 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:57.208046 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b7b03ebe-6e3e-48be-bc2c-cda2c8c7d145 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:57.209331 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b7b03ebe-6e3e-48be-bc2c-cda2c8c7d145 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:57.209986 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b7b03ebe-6e3e-48be-bc2c-cda2c8c7d145 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:57.210669 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b7b03ebe-6e3e-48be-bc2c-cda2c8c7d145 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:57.419265 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1fc94c74-9b4a-4660-a31d-71fdcf4db1be tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:57.421317 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-1fc94c74-9b4a-4660-a31d-71fdcf4db1be tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] [instance: ebf9bfa9-e941-4d23-8f6c-9867102feff2] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:02:57.438673 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1fc94c74-9b4a-4660-a31d-71fdcf4db1be tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:57.440503 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1fc94c74-9b4a-4660-a31d-71fdcf4db1be tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:57.441576 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1fc94c74-9b4a-4660-a31d-71fdcf4db1be tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:57.443817 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1fc94c74-9b4a-4660-a31d-71fdcf4db1be tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:57.451887 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1fc94c74-9b4a-4660-a31d-71fdcf4db1be tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:57.452892 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1fc94c74-9b4a-4660-a31d-71fdcf4db1be tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:57.591005 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b7b03ebe-6e3e-48be-bc2c-cda2c8c7d145 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e7ddc7c037439aad2f98277eef199e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e712ce30eb9c4128aa0ec1d425e9ab79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:57.619392 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b7b03ebe-6e3e-48be-bc2c-cda2c8c7d145 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] 10.222.0.60 "GET /compute/v2.1/servers/3d29c068-39c8-4851-82cf-b7639f689f24" status: 200 len: 1520 microversion: 2.1 time: 0.428150 Sep 14 09:02:57.629227 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1616/3290] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:02:57 2022] GET /compute/v2.1/servers/3d29c068-39c8-4851-82cf-b7639f689f24 => generated 1520 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:02:57.657654 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-eb497f47-3653-4fef-9e84-8269599498cc tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:57.676602 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-eb497f47-3653-4fef-9e84-8269599498cc tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] [instance: 0eb40c80-c056-4096-a586-7e957a63f7cf] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:02:57.712587 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-eb497f47-3653-4fef-9e84-8269599498cc tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:57.720414 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-eb497f47-3653-4fef-9e84-8269599498cc tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:57.721284 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-eb497f47-3653-4fef-9e84-8269599498cc tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:57.725614 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-eb497f47-3653-4fef-9e84-8269599498cc tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:57.730505 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-eb497f47-3653-4fef-9e84-8269599498cc tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:57.732713 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-eb497f47-3653-4fef-9e84-8269599498cc tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:57.995928 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-eb497f47-3653-4fef-9e84-8269599498cc tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:58.006017 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-eb497f47-3653-4fef-9e84-8269599498cc tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:58.013101 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-eb497f47-3653-4fef-9e84-8269599498cc tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:58.039665 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-eb497f47-3653-4fef-9e84-8269599498cc tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] 10.222.0.60 "GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf" status: 200 len: 1537 microversion: 2.91 time: 0.404897 Sep 14 09:02:58.041528 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1617/3291] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:02:57 2022] GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf => generated 1537 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:02:58.062114 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f5902d29-eaa4-4ca2-8598-d1ef49ea8d3e tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Calling method '.version_select at 0x7f7d44297820>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:58.151099 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f5902d29-eaa4-4ca2-8598-d1ef49ea8d3e tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] 10.222.0.60 "GET /compute/v2.1/images/165c831f-0a00-4eac-be4f-8a4c39096827" status: 200 len: 1420 microversion: 2.1 time: 0.105290 Sep 14 09:02:58.161161 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1618/3292] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:02:58 2022] GET /compute/v2.1/images/165c831f-0a00-4eac-be4f-8a4c39096827 => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:02:58.171622 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-22e756fa-4074-43b0-9dc0-70465a9afeb9 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:58.173406 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-22e756fa-4074-43b0-9dc0-70465a9afeb9 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: 56742f27-4436-4fc3-b7a5-9d337395b7d3] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:02:58.189281 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-22e756fa-4074-43b0-9dc0-70465a9afeb9 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:58.189805 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-22e756fa-4074-43b0-9dc0-70465a9afeb9 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:58.190846 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-22e756fa-4074-43b0-9dc0-70465a9afeb9 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:58.193421 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-22e756fa-4074-43b0-9dc0-70465a9afeb9 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:58.194048 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-22e756fa-4074-43b0-9dc0-70465a9afeb9 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:58.195164 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-22e756fa-4074-43b0-9dc0-70465a9afeb9 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:58.203071 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-1fc94c74-9b4a-4660-a31d-71fdcf4db1be tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a475c6e2b35f494aa8380aa1783e1779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c6f0c84e964383af6a4025d80fc93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:58.238411 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-1fc94c74-9b4a-4660-a31d-71fdcf4db1be tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] 10.222.0.60 "GET /compute/v2.1/servers/ebf9bfa9-e941-4d23-8f6c-9867102feff2" status: 200 len: 1472 microversion: 2.1 time: 0.825023 Sep 14 09:02:58.247588 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1675/3293] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:02:57 2022] GET /compute/v2.1/servers/ebf9bfa9-e941-4d23-8f6c-9867102feff2 => generated 1472 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:02:58.265806 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-25a4d45f-ff38-4b69-80b4-f77092ccd0c9 req-e2ebae32-a1e9-47b8-bc07-932854322a1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebf9bfa9-e941-4d23-8f6c-9867102feff2", "name": "network-vif-deleted", "tag": "a16e0c89-9089-483d-ae3b-f83433826e96"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:02:58.297790 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-25a4d45f-ff38-4b69-80b4-f77092ccd0c9 req-e2ebae32-a1e9-47b8-bc07-932854322a1e service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:58.298297 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-25a4d45f-ff38-4b69-80b4-f77092ccd0c9 req-e2ebae32-a1e9-47b8-bc07-932854322a1e service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:58.303551 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-25a4d45f-ff38-4b69-80b4-f77092ccd0c9 req-e2ebae32-a1e9-47b8-bc07-932854322a1e service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:58.335165 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-25a4d45f-ff38-4b69-80b4-f77092ccd0c9 req-e2ebae32-a1e9-47b8-bc07-932854322a1e service nova] Creating event network-vif-deleted:a16e0c89-9089-483d-ae3b-f83433826e96 for instance ebf9bfa9-e941-4d23-8f6c-9867102feff2 on n-h1-836830-18 Sep 14 09:02:58.341402 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-25a4d45f-ff38-4b69-80b4-f77092ccd0c9 req-e2ebae32-a1e9-47b8-bc07-932854322a1e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092183 Sep 14 09:02:58.343297 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1676/3294] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:02:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:02:58.661096 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1fef76c6-3f8f-4b07-94f6-c916b2bba930 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:58.661717 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-1fef76c6-3f8f-4b07-94f6-c916b2bba930 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] [instance: 3d29c068-39c8-4851-82cf-b7639f689f24] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:02:58.686886 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1fef76c6-3f8f-4b07-94f6-c916b2bba930 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:58.687418 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1fef76c6-3f8f-4b07-94f6-c916b2bba930 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:58.688131 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1fef76c6-3f8f-4b07-94f6-c916b2bba930 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:58.688844 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1fef76c6-3f8f-4b07-94f6-c916b2bba930 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:58.695601 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1fef76c6-3f8f-4b07-94f6-c916b2bba930 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:58.695972 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1fef76c6-3f8f-4b07-94f6-c916b2bba930 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:58.916773 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-22e756fa-4074-43b0-9dc0-70465a9afeb9 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:58.928351 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-22e756fa-4074-43b0-9dc0-70465a9afeb9 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/56742f27-4436-4fc3-b7a5-9d337395b7d3" status: 200 len: 1501 microversion: 2.1 time: 0.766011 Sep 14 09:02:58.935149 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1619/3295] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:02:58 2022] GET /compute/v2.1/servers/56742f27-4436-4fc3-b7a5-9d337395b7d3 => generated 1501 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:02:58.962921 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b35265cd-b833-44fa-ad3b-6b270336a1bc tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:02:58.976107 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b35265cd-b833-44fa-ad3b-6b270336a1bc tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:58.984147 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b35265cd-b833-44fa-ad3b-6b270336a1bc tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:58.985635 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b35265cd-b833-44fa-ad3b-6b270336a1bc tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:59.059582 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b35265cd-b833-44fa-ad3b-6b270336a1bc tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: 56742f27-4436-4fc3-b7a5-9d337395b7d3] Going to try to stop instance {{(pid=128759) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 14 09:02:59.124788 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-1fef76c6-3f8f-4b07-94f6-c916b2bba930 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e7ddc7c037439aad2f98277eef199e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e712ce30eb9c4128aa0ec1d425e9ab79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:59.133140 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-1fef76c6-3f8f-4b07-94f6-c916b2bba930 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] 10.222.0.60 "GET /compute/v2.1/servers/3d29c068-39c8-4851-82cf-b7639f689f24" status: 200 len: 1497 microversion: 2.1 time: 0.479054 Sep 14 09:02:59.137891 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1677/3296] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:02:58 2022] GET /compute/v2.1/servers/3d29c068-39c8-4851-82cf-b7639f689f24 => generated 1497 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:02:59.148877 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-e7c218c5-3205-42b6-99d0-3bb27578a459 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:59.151538 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-e7c218c5-3205-42b6-99d0-3bb27578a459 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] [instance: 0eb40c80-c056-4096-a586-7e957a63f7cf] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:02:59.166332 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e7c218c5-3205-42b6-99d0-3bb27578a459 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:59.169198 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e7c218c5-3205-42b6-99d0-3bb27578a459 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:59.169905 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e7c218c5-3205-42b6-99d0-3bb27578a459 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:59.171785 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e7c218c5-3205-42b6-99d0-3bb27578a459 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:59.179723 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e7c218c5-3205-42b6-99d0-3bb27578a459 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:59.180489 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e7c218c5-3205-42b6-99d0-3bb27578a459 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:59.243982 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b35265cd-b833-44fa-ad3b-6b270336a1bc tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "POST /compute/v2.1/servers/56742f27-4436-4fc3-b7a5-9d337395b7d3/action" status: 202 len: 0 microversion: 2.1 time: 0.282779 Sep 14 09:02:59.267798 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1620/3297] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:02:58 2022] POST /compute/v2.1/servers/56742f27-4436-4fc3-b7a5-9d337395b7d3/action => generated 0 bytes in 310 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 14 09:02:59.281605 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d9c110fe-b530-4032-b3ca-fb95f3732114 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:59.294593 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-d9c110fe-b530-4032-b3ca-fb95f3732114 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd6e7ddc7c037439aad2f98277eef199e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e712ce30eb9c4128aa0ec1d425e9ab79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:59.297266 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-d9c110fe-b530-4032-b3ca-fb95f3732114 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': 'e712ce30eb9c4128aa0ec1d425e9ab79'} {{(pid=128759) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 14 09:02:59.304306 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d9c110fe-b530-4032-b3ca-fb95f3732114 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:59.304791 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d9c110fe-b530-4032-b3ca-fb95f3732114 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:59.305544 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d9c110fe-b530-4032-b3ca-fb95f3732114 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:59.306489 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d9c110fe-b530-4032-b3ca-fb95f3732114 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:59.306986 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d9c110fe-b530-4032-b3ca-fb95f3732114 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:59.307727 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d9c110fe-b530-4032-b3ca-fb95f3732114 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:59.347639 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-e7c218c5-3205-42b6-99d0-3bb27578a459 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:59.357781 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-e7c218c5-3205-42b6-99d0-3bb27578a459 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:59.361724 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-e7c218c5-3205-42b6-99d0-3bb27578a459 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:02:59.364153 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.multi_cell_list [None req-d9c110fe-b530-4032-b3ca-fb95f3732114 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128759) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 14 09:02:59.375682 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-e7c218c5-3205-42b6-99d0-3bb27578a459 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] 10.222.0.60 "GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf" status: 200 len: 1537 microversion: 2.91 time: 0.236261 Sep 14 09:02:59.379994 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1678/3298] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:02:59 2022] GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf => generated 1537 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:02:59.393197 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-423b7a8d-08fb-4f29-9e2c-d18ea9d8a30c tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Calling method '.version_select at 0x7f7d48611f70>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:59.453410 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d9c110fe-b530-4032-b3ca-fb95f3732114 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] 10.222.0.60 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 345 microversion: 2.1 time: 0.181334 Sep 14 09:02:59.454257 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1621/3299] 10.222.0.60 () {58 vars in 1154 bytes} [Wed Sep 14 09:02:59 2022] GET /compute/v2.1/servers?status=shutoff => generated 345 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:02:59.475332 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-1d2ea29d-9ac9-4b32-87f1-f695ddce2468 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:59.475856 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-1d2ea29d-9ac9-4b32-87f1-f695ddce2468 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] [instance: ebf9bfa9-e941-4d23-8f6c-9867102feff2] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:02:59.504790 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1d2ea29d-9ac9-4b32-87f1-f695ddce2468 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:59.505287 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1d2ea29d-9ac9-4b32-87f1-f695ddce2468 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:59.505730 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1d2ea29d-9ac9-4b32-87f1-f695ddce2468 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:59.506392 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-423b7a8d-08fb-4f29-9e2c-d18ea9d8a30c tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] 10.222.0.60 "GET /compute/v2.1/images/165c831f-0a00-4eac-be4f-8a4c39096827" status: 200 len: 1420 microversion: 2.1 time: 0.124915 Sep 14 09:02:59.506535 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1d2ea29d-9ac9-4b32-87f1-f695ddce2468 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:59.506880 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1d2ea29d-9ac9-4b32-87f1-f695ddce2468 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:59.507143 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1679/3300] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:02:59 2022] GET /compute/v2.1/images/165c831f-0a00-4eac-be4f-8a4c39096827 => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:02:59.515654 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1d2ea29d-9ac9-4b32-87f1-f695ddce2468 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:59.525201 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ec5b190d-c6e2-4e87-81e6-abc9199d89b5 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:02:59.526236 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-ec5b190d-c6e2-4e87-81e6-abc9199d89b5 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: 56742f27-4436-4fc3-b7a5-9d337395b7d3] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:02:59.540424 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-1d2ea29d-9ac9-4b32-87f1-f695ddce2468 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] HTTP exception thrown: Instance ebf9bfa9-e941-4d23-8f6c-9867102feff2 could not be found. Sep 14 09:02:59.542807 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-1d2ea29d-9ac9-4b32-87f1-f695ddce2468 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Request method failure captured: Sep 14 09:02:59.542807 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/ebf9bfa9-e941-4d23-8f6c-9867102feff2 HTTP/1.1 Sep 14 09:02:59.542807 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:02:59.542807 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:02:59.542807 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:02:59.542807 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:02:59.542807 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:02:59.542807 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:02:59.542807 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:02:59.542807 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:02:59.542807 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZgl_ZWb0FNcWaOmNNHYtWqIb3azMQtrys8dVpICEyzpDSjE79Mljx-HsEVHmqhDCVQUq3W7dajRIX2CH3vVThJj4tt218fvqyKrkymGHJvKGnAz4G5XVvm7y9CEC6kYfc3KOzfwDbSWaM3cKGxW8zxkPRnEzFqNa8Xpr9D_caPmuxI Sep 14 09:02:59.542807 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:02:59.542807 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:02:59.542807 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:02:59.542807 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:02:59.542807 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:02:59.542807 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:02:59.542807 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 63c6f0c84e964383af6a4025d80fc93d Sep 14 09:02:59.542807 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ListImageFiltersTestJSON-1411140694 Sep 14 09:02:59.542807 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:02:59.542807 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:02:59.542807 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/63c6f0c84e964383af6a4025d80fc93d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_63c6f0c84e964383af6a4025d80fc93d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/63c6f0c84e964383af6a4025d80fc93d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/63c6f0c84e964383af6a4025d80fc93d"}]}] Sep 14 09:02:59.542807 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ListImageFiltersTestJSON-1411140694 Sep 14 09:02:59.542807 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 63c6f0c84e964383af6a4025d80fc93d Sep 14 09:02:59.542807 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1411140694 Sep 14 09:02:59.542807 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ListImageFiltersTestJSON-1411140694-project Sep 14 09:02:59.542807 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:02:59.542807 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:02:59.542807 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: a475c6e2b35f494aa8380aa1783e1779 Sep 14 09:02:59.542807 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ListImageFiltersTestJSON-1411140694-project Sep 14 09:02:59.542807 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:02:59.542807 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance ebf9bfa9-e941-4d23-8f6c-9867102feff2 could not be found. Sep 14 09:02:59.542807 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': 'ebf9bfa9-e941-4d23-8f6c-9867102feff2'} Sep 14 09:02:59.542807 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:02:59.542807 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:02:59.542807 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:02:59.542807 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:02:59.542807 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:02:59.542807 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:02:59.542807 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:02:59.542807 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:02:59.542807 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:02:59.542807 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:02:59.542807 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ebf9bfa9-e941-4d23-8f6c-9867102feff2 could not be found. Sep 14 09:02:59.542807 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:02:59.542807 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:02:59.542807 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:02:59.542807 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:02:59.542807 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:02:59.542807 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:02:59.542807 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:02:59.542807 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:02:59.542807 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:02:59.542807 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:02:59.542807 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:02:59.542807 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:02:59.542807 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:02:59.542807 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:02:59.542807 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:02:59.542807 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:02:59.542807 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ebf9bfa9-e941-4d23-8f6c-9867102feff2 could not be found. Sep 14 09:02:59.542807 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:02:59.542807 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:02:59.542807 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:02:59.547224 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:02:59.547224 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:02:59.547224 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:02:59.547224 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:02:59.547224 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:02:59.547224 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ebf9bfa9-e941-4d23-8f6c-9867102feff2 could not be found. Sep 14 09:02:59.547224 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:02:59.547224 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-1d2ea29d-9ac9-4b32-87f1-f695ddce2468 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Returning 404 to user: Instance ebf9bfa9-e941-4d23-8f6c-9867102feff2 could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:02:59.548008 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ec5b190d-c6e2-4e87-81e6-abc9199d89b5 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:59.548008 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ec5b190d-c6e2-4e87-81e6-abc9199d89b5 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:59.548457 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ec5b190d-c6e2-4e87-81e6-abc9199d89b5 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:59.552698 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ec5b190d-c6e2-4e87-81e6-abc9199d89b5 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:59.553186 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-1d2ea29d-9ac9-4b32-87f1-f695ddce2468 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] 10.222.0.60 "GET /compute/v2.1/servers/ebf9bfa9-e941-4d23-8f6c-9867102feff2" status: 404 len: 111 microversion: 2.1 time: 0.084203 Sep 14 09:02:59.556640 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1622/3301] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:02:59 2022] GET /compute/v2.1/servers/ebf9bfa9-e941-4d23-8f6c-9867102feff2 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:02:59.556808 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ec5b190d-c6e2-4e87-81e6-abc9199d89b5 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:59.556808 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ec5b190d-c6e2-4e87-81e6-abc9199d89b5 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:59.559458 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-7e118fa3-9459-437c-a8b4-b959d85f18bb tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:02:59.582592 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7e118fa3-9459-437c-a8b4-b959d85f18bb tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:02:59.583145 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7e118fa3-9459-437c-a8b4-b959d85f18bb tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:02:59.583579 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7e118fa3-9459-437c-a8b4-b959d85f18bb tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:02:59.606168 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:02:59.677652 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-7e118fa3-9459-437c-a8b4-b959d85f18bb tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] [instance: 3d29c068-39c8-4851-82cf-b7639f689f24] Going to try to start instance {{(pid=128759) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 14 09:02:59.810079 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-7e118fa3-9459-437c-a8b4-b959d85f18bb tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] 10.222.0.60 "POST /compute/v2.1/servers/3d29c068-39c8-4851-82cf-b7639f689f24/action" status: 202 len: 0 microversion: 2.1 time: 0.243893 Sep 14 09:02:59.810079 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1623/3302] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:02:59 2022] POST /compute/v2.1/servers/3d29c068-39c8-4851-82cf-b7639f689f24/action => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:02:59.826457 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d7e38845-0674-4555-84b3-5271c3a77103 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Calling method '.version_select at 0x7f7d445cfca0>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:00.351063 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-ec5b190d-c6e2-4e87-81e6-abc9199d89b5 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:00.367916 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-ec5b190d-c6e2-4e87-81e6-abc9199d89b5 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/56742f27-4436-4fc3-b7a5-9d337395b7d3" status: 200 len: 1511 microversion: 2.1 time: 0.851331 Sep 14 09:03:00.372968 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1680/3303] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:02:59 2022] GET /compute/v2.1/servers/56742f27-4436-4fc3-b7a5-9d337395b7d3 => generated 1511 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:03:00.406387 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-4b7156ed-f587-4f61-945c-18b982afb28c tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:00.409079 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-4b7156ed-f587-4f61-945c-18b982afb28c tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] [instance: 3d29c068-39c8-4851-82cf-b7639f689f24] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:03:00.422857 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4b7156ed-f587-4f61-945c-18b982afb28c tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:00.440829 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4b7156ed-f587-4f61-945c-18b982afb28c tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:00.441296 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4b7156ed-f587-4f61-945c-18b982afb28c tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:00.443991 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4b7156ed-f587-4f61-945c-18b982afb28c tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:00.444475 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4b7156ed-f587-4f61-945c-18b982afb28c tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:00.445366 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4b7156ed-f587-4f61-945c-18b982afb28c tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:00.991364 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d7e38845-0674-4555-84b3-5271c3a77103 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] 10.222.0.60 "DELETE /compute/v2.1/images/e3fe84fd-00f6-4d37-bc1c-acfdba8b814d" status: 204 len: 0 microversion: 2.1 time: 1.185130 Sep 14 09:03:00.996333 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1624/3304] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:02:59 2022] DELETE /compute/v2.1/images/e3fe84fd-00f6-4d37-bc1c-acfdba8b814d => generated 0 bytes in 1187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:03:01.003921 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c3d11b29-720b-41e2-8b58-c915b91118c8 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:01.004857 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-c3d11b29-720b-41e2-8b58-c915b91118c8 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] [instance: 0eb40c80-c056-4096-a586-7e957a63f7cf] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:03:01.024382 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c3d11b29-720b-41e2-8b58-c915b91118c8 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:01.028071 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c3d11b29-720b-41e2-8b58-c915b91118c8 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:01.028754 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c3d11b29-720b-41e2-8b58-c915b91118c8 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:01.031843 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c3d11b29-720b-41e2-8b58-c915b91118c8 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:01.032576 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c3d11b29-720b-41e2-8b58-c915b91118c8 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:01.033196 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c3d11b29-720b-41e2-8b58-c915b91118c8 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:01.071139 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-4b7156ed-f587-4f61-945c-18b982afb28c tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e7ddc7c037439aad2f98277eef199e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e712ce30eb9c4128aa0ec1d425e9ab79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:01.082103 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-4b7156ed-f587-4f61-945c-18b982afb28c tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] 10.222.0.60 "GET /compute/v2.1/servers/3d29c068-39c8-4851-82cf-b7639f689f24" status: 200 len: 1506 microversion: 2.1 time: 0.694625 Sep 14 09:03:01.087565 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1681/3305] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:03:00 2022] GET /compute/v2.1/servers/3d29c068-39c8-4851-82cf-b7639f689f24 => generated 1506 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:03:01.094193 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1db92bbf-7ead-467f-844e-b3ec476d6765 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Calling method '.version_select at 0x7f7d4430c1f0>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:01.233162 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-1db92bbf-7ead-467f-844e-b3ec476d6765 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] 10.222.0.60 "GET /compute/v2.1/images/165c831f-0a00-4eac-be4f-8a4c39096827" status: 200 len: 1420 microversion: 2.1 time: 0.144374 Sep 14 09:03:01.241255 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1682/3306] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:03:01 2022] GET /compute/v2.1/images/165c831f-0a00-4eac-be4f-8a4c39096827 => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:03:01.243181 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b6f0baa0-cb9b-4e75-b4bc-d703c577b83f tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Calling method '.version_select at 0x7f7d3f81d280>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:01.748744 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-c3d11b29-720b-41e2-8b58-c915b91118c8 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:01.757856 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-c3d11b29-720b-41e2-8b58-c915b91118c8 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:01.759490 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-c3d11b29-720b-41e2-8b58-c915b91118c8 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:01.765885 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-c3d11b29-720b-41e2-8b58-c915b91118c8 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] 10.222.0.60 "GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf" status: 200 len: 1537 microversion: 2.91 time: 0.767825 Sep 14 09:03:01.779820 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1625/3307] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:03:00 2022] GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf => generated 1537 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:03:01.793033 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-98a1229e-1af7-4904-bb27-b7ccb86691dd tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:01.793657 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-98a1229e-1af7-4904-bb27-b7ccb86691dd tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: 56742f27-4436-4fc3-b7a5-9d337395b7d3] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:03:01.802634 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-98a1229e-1af7-4904-bb27-b7ccb86691dd tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:01.803185 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-98a1229e-1af7-4904-bb27-b7ccb86691dd tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:01.803648 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-98a1229e-1af7-4904-bb27-b7ccb86691dd tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:01.805101 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-98a1229e-1af7-4904-bb27-b7ccb86691dd tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:01.805616 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-98a1229e-1af7-4904-bb27-b7ccb86691dd tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:01.809196 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-98a1229e-1af7-4904-bb27-b7ccb86691dd tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:02.125101 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-b6f0baa0-cb9b-4e75-b4bc-d703c577b83f tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] 10.222.0.60 "DELETE /compute/v2.1/images/41130ed6-7ebf-4a39-94eb-9c84307264df" status: 204 len: 0 microversion: 2.1 time: 0.889603 Sep 14 09:03:02.125685 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1683/3308] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:03:01 2022] DELETE /compute/v2.1/images/41130ed6-7ebf-4a39-94eb-9c84307264df => generated 0 bytes in 891 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:03:02.131619 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-dc2245f7-a10b-41f1-a367-fd7dc5e00ca6 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:02.133230 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-dc2245f7-a10b-41f1-a367-fd7dc5e00ca6 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] [instance: 26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:03:02.140679 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dc2245f7-a10b-41f1-a367-fd7dc5e00ca6 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:02.141929 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dc2245f7-a10b-41f1-a367-fd7dc5e00ca6 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:02.142557 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dc2245f7-a10b-41f1-a367-fd7dc5e00ca6 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:02.144822 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dc2245f7-a10b-41f1-a367-fd7dc5e00ca6 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:02.146637 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dc2245f7-a10b-41f1-a367-fd7dc5e00ca6 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:02.149027 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dc2245f7-a10b-41f1-a367-fd7dc5e00ca6 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:02.167294 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-dc2245f7-a10b-41f1-a367-fd7dc5e00ca6 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] HTTP exception thrown: Instance 26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0 could not be found. Sep 14 09:03:02.169887 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-dc2245f7-a10b-41f1-a367-fd7dc5e00ca6 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Request method failure captured: Sep 14 09:03:02.169887 n-d-836830-18 devstack@n-api.service[128758]: request: DELETE /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0 HTTP/1.1 Sep 14 09:03:02.169887 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 09:03:02.169887 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 09:03:02.169887 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 09:03:02.169887 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 09:03:02.169887 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 09:03:02.169887 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 09:03:02.169887 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 09:03:02.169887 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 09:03:02.169887 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZcy2NW6FmNx4UiFej-96GaD7A9OycLxwLvU2PLweazpCYur5bRpXVEWXh7x_e4F4z7Za42fgtNOXsDOh2Ao1_s9gT874tZ76KGA1HkmpzmZ9cs03DlpBI5JWdZKgCDgU9oxwQAoJmFi8sfgPG4VGiXa5sd1kQKcOX4EtqXZCu0_NqU Sep 14 09:03:02.169887 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 09:03:02.169887 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 09:03:02.169887 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 09:03:02.169887 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 09:03:02.169887 n-d-836830-18 devstack@n-api.service[128758]: X-Openstack-Nova-Api-Version: 2.32 Sep 14 09:03:02.169887 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 09:03:02.169887 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 09:03:02.169887 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 46a1734368204db58d9d7572726d2794 Sep 14 09:03:02.169887 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-TaggedBootDevicesTest-970937063 Sep 14 09:03:02.169887 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 09:03:02.169887 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 09:03:02.169887 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/46a1734368204db58d9d7572726d2794"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_46a1734368204db58d9d7572726d2794"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/46a1734368204db58d9d7572726d2794"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/46a1734368204db58d9d7572726d2794"}]}] Sep 14 09:03:02.169887 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-TaggedBootDevicesTest-970937063 Sep 14 09:03:02.169887 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 46a1734368204db58d9d7572726d2794 Sep 14 09:03:02.169887 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-TaggedBootDevicesTest-970937063 Sep 14 09:03:02.169887 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-TaggedBootDevicesTest-970937063-project Sep 14 09:03:02.169887 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 09:03:02.169887 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 09:03:02.169887 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 87d4eb547eeb475185d097f03049ccde Sep 14 09:03:02.169887 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-TaggedBootDevicesTest-970937063-project Sep 14 09:03:02.169887 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 09:03:02.169887 n-d-836830-18 devstack@n-api.service[128758]: exception: Instance 26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0 could not be found. Sep 14 09:03:02.169887 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': '26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0'} Sep 14 09:03:02.169887 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:03:02.169887 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:03:02.169887 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:03:02.169887 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:03:02.169887 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:03:02.169887 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:03:02.169887 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:03:02.169887 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:03:02.169887 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:03:02.169887 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:03:02.169887 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0 could not be found. Sep 14 09:03:02.169887 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:03:02.169887 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:03:02.169887 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:03:02.169887 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:03:02.169887 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:03:02.169887 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:03:02.169887 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:03:02.169887 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:03:02.169887 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:03:02.169887 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:03:02.169887 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 09:03:02.169887 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 09:03:02.169887 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 09:03:02.169887 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 09:03:02.169887 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:03:02.169887 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:03:02.169887 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:03:02.169887 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:03:02.177034 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0 could not be found. Sep 14 09:03:02.177034 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:03:02.177034 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:03:02.177034 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:03:02.177034 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:03:02.177034 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:03:02.177034 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:03:02.177034 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:03:02.177034 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:03:02.177034 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0 could not be found. Sep 14 09:03:02.177034 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:03:02.179604 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-dc2245f7-a10b-41f1-a367-fd7dc5e00ca6 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Returning 404 to user: Instance 26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0 could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:03:02.180868 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-dc2245f7-a10b-41f1-a367-fd7dc5e00ca6 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] 10.222.0.60 "DELETE /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0" status: 404 len: 111 microversion: 2.32 time: 0.053909 Sep 14 09:03:02.185864 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1684/3309] 10.222.0.60 () {60 vars in 1280 bytes} [Wed Sep 14 09:03:02 2022] DELETE /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 14 09:03:02.192904 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-70c71f83-94ec-4c04-99b7-21983a451d93 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:02.194250 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-70c71f83-94ec-4c04-99b7-21983a451d93 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] [instance: 3d29c068-39c8-4851-82cf-b7639f689f24] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:03:02.203253 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-70c71f83-94ec-4c04-99b7-21983a451d93 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:02.204110 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-70c71f83-94ec-4c04-99b7-21983a451d93 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:02.204755 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-70c71f83-94ec-4c04-99b7-21983a451d93 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:02.205937 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-70c71f83-94ec-4c04-99b7-21983a451d93 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:02.206862 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-70c71f83-94ec-4c04-99b7-21983a451d93 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:02.207411 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-70c71f83-94ec-4c04-99b7-21983a451d93 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:02.288200 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-98a1229e-1af7-4904-bb27-b7ccb86691dd tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:02.301781 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-98a1229e-1af7-4904-bb27-b7ccb86691dd tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/56742f27-4436-4fc3-b7a5-9d337395b7d3" status: 200 len: 1511 microversion: 2.1 time: 0.519567 Sep 14 09:03:02.305174 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1626/3310] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:03:01 2022] GET /compute/v2.1/servers/56742f27-4436-4fc3-b7a5-9d337395b7d3 => generated 1511 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:03:02.315095 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f736c664-9eba-4dd2-8b79-933c96b6a365 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] Calling method '.version_select at 0x7f7d445d4280>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:02.523488 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-70c71f83-94ec-4c04-99b7-21983a451d93 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e7ddc7c037439aad2f98277eef199e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e712ce30eb9c4128aa0ec1d425e9ab79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:02.534387 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-70c71f83-94ec-4c04-99b7-21983a451d93 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] 10.222.0.60 "GET /compute/v2.1/servers/3d29c068-39c8-4851-82cf-b7639f689f24" status: 200 len: 1506 microversion: 2.1 time: 0.347066 Sep 14 09:03:02.535005 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1685/3311] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:03:02 2022] GET /compute/v2.1/servers/3d29c068-39c8-4851-82cf-b7639f689f24 => generated 1506 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:03:02.551284 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-58fb89b1-ebb3-4edf-9778-29260270d8d1 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:02.552045 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-58fb89b1-ebb3-4edf-9778-29260270d8d1 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] [instance: 26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:03:02.593842 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-58fb89b1-ebb3-4edf-9778-29260270d8d1 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:02.597060 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-58fb89b1-ebb3-4edf-9778-29260270d8d1 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:02.598826 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-58fb89b1-ebb3-4edf-9778-29260270d8d1 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:02.602669 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-58fb89b1-ebb3-4edf-9778-29260270d8d1 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:02.605170 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-58fb89b1-ebb3-4edf-9778-29260270d8d1 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:02.609133 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-58fb89b1-ebb3-4edf-9778-29260270d8d1 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:02.640203 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-58fb89b1-ebb3-4edf-9778-29260270d8d1 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] HTTP exception thrown: Instance 26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0 could not be found. Sep 14 09:03:02.652184 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-58fb89b1-ebb3-4edf-9778-29260270d8d1 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Request method failure captured: Sep 14 09:03:02.652184 n-d-836830-18 devstack@n-api.service[128758]: request: GET /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0 HTTP/1.1 Sep 14 09:03:02.652184 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 09:03:02.652184 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 09:03:02.652184 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 09:03:02.652184 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 09:03:02.652184 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 09:03:02.652184 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 09:03:02.652184 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 09:03:02.652184 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 09:03:02.652184 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZcy2NW6FmNx4UiFej-96GaD7A9OycLxwLvU2PLweazpCYur5bRpXVEWXh7x_e4F4z7Za42fgtNOXsDOh2Ao1_s9gT874tZ76KGA1HkmpzmZ9cs03DlpBI5JWdZKgCDgU9oxwQAoJmFi8sfgPG4VGiXa5sd1kQKcOX4EtqXZCu0_NqU Sep 14 09:03:02.652184 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 09:03:02.652184 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 09:03:02.652184 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 09:03:02.652184 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 09:03:02.652184 n-d-836830-18 devstack@n-api.service[128758]: X-Openstack-Nova-Api-Version: 2.32 Sep 14 09:03:02.652184 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 09:03:02.652184 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 09:03:02.652184 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 46a1734368204db58d9d7572726d2794 Sep 14 09:03:02.652184 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-TaggedBootDevicesTest-970937063 Sep 14 09:03:02.652184 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 09:03:02.652184 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 09:03:02.652184 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/46a1734368204db58d9d7572726d2794"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_46a1734368204db58d9d7572726d2794"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/46a1734368204db58d9d7572726d2794"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/46a1734368204db58d9d7572726d2794"}]}] Sep 14 09:03:02.652184 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-TaggedBootDevicesTest-970937063 Sep 14 09:03:02.652184 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 46a1734368204db58d9d7572726d2794 Sep 14 09:03:02.652184 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-TaggedBootDevicesTest-970937063 Sep 14 09:03:02.652184 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-TaggedBootDevicesTest-970937063-project Sep 14 09:03:02.652184 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 09:03:02.652184 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 09:03:02.652184 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 87d4eb547eeb475185d097f03049ccde Sep 14 09:03:02.652184 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-TaggedBootDevicesTest-970937063-project Sep 14 09:03:02.652184 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 09:03:02.652184 n-d-836830-18 devstack@n-api.service[128758]: exception: Instance 26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0 could not be found. Sep 14 09:03:02.652184 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': '26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0'} Sep 14 09:03:02.652184 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:03:02.652184 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:03:02.652184 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:03:02.652184 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:03:02.652184 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:03:02.652184 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:03:02.652184 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:03:02.652184 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:03:02.652184 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:03:02.652184 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:03:02.652184 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0 could not be found. Sep 14 09:03:02.652184 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:03:02.652184 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:03:02.652184 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:03:02.652184 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:03:02.652184 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:03:02.652184 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:03:02.652184 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:03:02.652184 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:03:02.652184 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:03:02.652184 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:03:02.652184 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:03:02.652184 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:03:02.652184 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:03:02.652184 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:03:02.652184 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:03:02.652184 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:03:02.652184 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0 could not be found. Sep 14 09:03:02.652184 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:03:02.652184 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:03:02.652184 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:03:02.657937 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:03:02.657937 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:03:02.657937 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:03:02.657937 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:03:02.657937 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:03:02.657937 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0 could not be found. Sep 14 09:03:02.657937 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:03:02.661679 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-58fb89b1-ebb3-4edf-9778-29260270d8d1 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] Returning 404 to user: Instance 26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0 could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:03:02.662889 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-58fb89b1-ebb3-4edf-9778-29260270d8d1 tempest-TaggedBootDevicesTest-970937063 tempest-TaggedBootDevicesTest-970937063-project] 10.222.0.60 "GET /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0" status: 404 len: 111 microversion: 2.32 time: 0.125077 Sep 14 09:03:02.664186 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1686/3312] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:03:02 2022] GET /compute/v2.1/servers/26e7e55d-4bbf-42e2-bf9c-7250cf4af2b0 => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 14 09:03:02.683419 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-f576362d-0775-4acb-9a36-052afaf05e8b tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Calling method '.version_select at 0x7f7d44346dc0>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:02.801104 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f736c664-9eba-4dd2-8b79-933c96b6a365 tempest-ListImageFiltersTestJSON-1411140694 tempest-ListImageFiltersTestJSON-1411140694-project] 10.222.0.60 "DELETE /compute/v2.1/images/73b52f25-c3a1-4c69-9e8a-b2f01d0e6a08" status: 204 len: 0 microversion: 2.1 time: 0.492352 Sep 14 09:03:02.801923 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1627/3313] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:03:02 2022] DELETE /compute/v2.1/images/73b52f25-c3a1-4c69-9e8a-b2f01d0e6a08 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:03:02.811449 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8471e93a-9106-4e49-889f-ada12e4fef5e tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:02.841496 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-8471e93a-9106-4e49-889f-ada12e4fef5e tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] [instance: 0eb40c80-c056-4096-a586-7e957a63f7cf] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:03:02.852991 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-f576362d-0775-4acb-9a36-052afaf05e8b tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] 10.222.0.60 "GET /compute/v2.1/images/165c831f-0a00-4eac-be4f-8a4c39096827" status: 200 len: 1420 microversion: 2.1 time: 0.187563 Sep 14 09:03:02.861966 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1687/3314] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:03:02 2022] GET /compute/v2.1/images/165c831f-0a00-4eac-be4f-8a4c39096827 => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:03:02.862640 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8471e93a-9106-4e49-889f-ada12e4fef5e tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:02.863141 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8471e93a-9106-4e49-889f-ada12e4fef5e tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:02.863567 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8471e93a-9106-4e49-889f-ada12e4fef5e tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:02.864263 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8471e93a-9106-4e49-889f-ada12e4fef5e tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:02.864722 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8471e93a-9106-4e49-889f-ada12e4fef5e tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:02.865144 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8471e93a-9106-4e49-889f-ada12e4fef5e tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:03.054505 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-8471e93a-9106-4e49-889f-ada12e4fef5e tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:03.087047 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-8471e93a-9106-4e49-889f-ada12e4fef5e tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:03.093114 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-8471e93a-9106-4e49-889f-ada12e4fef5e tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:03.102330 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-8471e93a-9106-4e49-889f-ada12e4fef5e tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] 10.222.0.60 "GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf" status: 200 len: 1537 microversion: 2.91 time: 0.298671 Sep 14 09:03:03.105363 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1628/3315] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:03:02 2022] GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf => generated 1537 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:03:03.337267 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-9dcd3b5f-2cf0-48de-9520-3ce58a64e456 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:03.343947 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-9dcd3b5f-2cf0-48de-9520-3ce58a64e456 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: 56742f27-4436-4fc3-b7a5-9d337395b7d3] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:03:03.372305 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9dcd3b5f-2cf0-48de-9520-3ce58a64e456 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:03.374858 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9dcd3b5f-2cf0-48de-9520-3ce58a64e456 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:03.376643 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9dcd3b5f-2cf0-48de-9520-3ce58a64e456 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:03.377567 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9dcd3b5f-2cf0-48de-9520-3ce58a64e456 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:03.379955 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9dcd3b5f-2cf0-48de-9520-3ce58a64e456 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:03.381613 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9dcd3b5f-2cf0-48de-9520-3ce58a64e456 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:03.420373 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:03:03.572988 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ff3e2151-eae2-43b4-91c4-0b67e2fe7373 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:03.574803 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-ff3e2151-eae2-43b4-91c4-0b67e2fe7373 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] [instance: 3d29c068-39c8-4851-82cf-b7639f689f24] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:03:03.586846 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ff3e2151-eae2-43b4-91c4-0b67e2fe7373 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:03.588058 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ff3e2151-eae2-43b4-91c4-0b67e2fe7373 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:03.588508 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ff3e2151-eae2-43b4-91c4-0b67e2fe7373 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:03.589959 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ff3e2151-eae2-43b4-91c4-0b67e2fe7373 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:03.590442 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ff3e2151-eae2-43b4-91c4-0b67e2fe7373 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:03.590855 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ff3e2151-eae2-43b4-91c4-0b67e2fe7373 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:03.988154 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-9dcd3b5f-2cf0-48de-9520-3ce58a64e456 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:04.000375 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-9dcd3b5f-2cf0-48de-9520-3ce58a64e456 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/56742f27-4436-4fc3-b7a5-9d337395b7d3" status: 200 len: 1511 microversion: 2.1 time: 0.677996 Sep 14 09:03:04.011294 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1688/3316] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:03:03 2022] GET /compute/v2.1/servers/56742f27-4436-4fc3-b7a5-9d337395b7d3 => generated 1511 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:03:04.021732 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-5e81145f-ea4a-4ede-a0d3-66e7bf6a9242 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Calling method '.version_select at 0x7f7d44319dc0>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:04.083301 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-ff3e2151-eae2-43b4-91c4-0b67e2fe7373 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e7ddc7c037439aad2f98277eef199e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e712ce30eb9c4128aa0ec1d425e9ab79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:04.089508 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-5e81145f-ea4a-4ede-a0d3-66e7bf6a9242 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] 10.222.0.60 "GET /compute/v2.1/images/165c831f-0a00-4eac-be4f-8a4c39096827" status: 200 len: 1429 microversion: 2.1 time: 0.086244 Sep 14 09:03:04.092016 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-ff3e2151-eae2-43b4-91c4-0b67e2fe7373 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] 10.222.0.60 "GET /compute/v2.1/servers/3d29c068-39c8-4851-82cf-b7639f689f24" status: 200 len: 1510 microversion: 2.1 time: 0.536247 Sep 14 09:03:04.097542 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1629/3317] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:03:03 2022] GET /compute/v2.1/servers/3d29c068-39c8-4851-82cf-b7639f689f24 => generated 1510 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:03:04.100901 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1689/3318] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:03:04 2022] GET /compute/v2.1/images/165c831f-0a00-4eac-be4f-8a4c39096827 => generated 1429 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:03:04.106737 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-0604bea2-ddfb-4d72-a391-dda59325cab1 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Calling method '.version_select at 0x7f7d44206160>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:04.124299 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-2a5d1ba7-321b-4d72-98fa-461a3b16f745 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:04.133599 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-2a5d1ba7-321b-4d72-98fa-461a3b16f745 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd6e7ddc7c037439aad2f98277eef199e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e712ce30eb9c4128aa0ec1d425e9ab79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:04.135503 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.compute.servers [None req-2a5d1ba7-321b-4d72-98fa-461a3b16f745 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Removing options 'limit' from query {{(pid=128758) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Sep 14 09:03:04.137594 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-2a5d1ba7-321b-4d72-98fa-461a3b16f745 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Searching by: {'deleted': False, 'project_id': 'e712ce30eb9c4128aa0ec1d425e9ab79'} {{(pid=128758) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 14 09:03:04.142465 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2a5d1ba7-321b-4d72-98fa-461a3b16f745 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:04.143303 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2a5d1ba7-321b-4d72-98fa-461a3b16f745 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:04.144862 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2a5d1ba7-321b-4d72-98fa-461a3b16f745 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:04.147426 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2a5d1ba7-321b-4d72-98fa-461a3b16f745 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:04.148223 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2a5d1ba7-321b-4d72-98fa-461a3b16f745 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:04.149164 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2a5d1ba7-321b-4d72-98fa-461a3b16f745 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:04.153697 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-2a5d1ba7-321b-4d72-98fa-461a3b16f745 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] 10.222.0.60 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.034848 Sep 14 09:03:04.157867 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1690/3319] 10.222.0.60 () {58 vars in 1140 bytes} [Wed Sep 14 09:03:04 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 14 09:03:04.172979 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-670d45d7-0728-43e1-a9ce-a8e1101ea5e2 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:04.173735 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-670d45d7-0728-43e1-a9ce-a8e1101ea5e2 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] [instance: 0eb40c80-c056-4096-a586-7e957a63f7cf] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:03:04.176637 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-0604bea2-ddfb-4d72-a391-dda59325cab1 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] 10.222.0.60 "GET /compute/v2.1/images/165c831f-0a00-4eac-be4f-8a4c39096827" status: 200 len: 1429 microversion: 2.1 time: 0.074153 Sep 14 09:03:04.177359 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1630/3320] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:03:04 2022] GET /compute/v2.1/images/165c831f-0a00-4eac-be4f-8a4c39096827 => generated 1429 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:03:04.193890 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-6909c2e9-1bb9-4c11-b6a4-34ee3d8cb970 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:04.194965 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-6909c2e9-1bb9-4c11-b6a4-34ee3d8cb970 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] [instance: 3d29c068-39c8-4851-82cf-b7639f689f24] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:03:04.201454 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-670d45d7-0728-43e1-a9ce-a8e1101ea5e2 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:04.201950 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-670d45d7-0728-43e1-a9ce-a8e1101ea5e2 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:04.202390 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-670d45d7-0728-43e1-a9ce-a8e1101ea5e2 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:04.203296 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-670d45d7-0728-43e1-a9ce-a8e1101ea5e2 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:04.206698 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6909c2e9-1bb9-4c11-b6a4-34ee3d8cb970 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:04.208419 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-670d45d7-0728-43e1-a9ce-a8e1101ea5e2 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:04.209543 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-670d45d7-0728-43e1-a9ce-a8e1101ea5e2 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:04.209810 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6909c2e9-1bb9-4c11-b6a4-34ee3d8cb970 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:04.210275 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6909c2e9-1bb9-4c11-b6a4-34ee3d8cb970 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:04.211049 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6909c2e9-1bb9-4c11-b6a4-34ee3d8cb970 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:04.211520 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6909c2e9-1bb9-4c11-b6a4-34ee3d8cb970 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:04.211958 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6909c2e9-1bb9-4c11-b6a4-34ee3d8cb970 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:04.418427 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-670d45d7-0728-43e1-a9ce-a8e1101ea5e2 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:04.431966 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-670d45d7-0728-43e1-a9ce-a8e1101ea5e2 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:04.435779 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-670d45d7-0728-43e1-a9ce-a8e1101ea5e2 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:04.442433 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-670d45d7-0728-43e1-a9ce-a8e1101ea5e2 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] 10.222.0.60 "GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf" status: 200 len: 1537 microversion: 2.91 time: 0.283250 Sep 14 09:03:04.443501 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1691/3321] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:03:04 2022] GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf => generated 1537 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:03:04.460594 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b0bb092a-e09a-4f72-98ce-353ce7850f70 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:04.461890 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-b0bb092a-e09a-4f72-98ce-353ce7850f70 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] [instance: 7558efb0-7f2d-42d5-9b6d-e442008b1c88] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:03:04.472776 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b0bb092a-e09a-4f72-98ce-353ce7850f70 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:04.473657 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b0bb092a-e09a-4f72-98ce-353ce7850f70 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:04.475676 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b0bb092a-e09a-4f72-98ce-353ce7850f70 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:04.476600 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b0bb092a-e09a-4f72-98ce-353ce7850f70 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:04.482183 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b0bb092a-e09a-4f72-98ce-353ce7850f70 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:04.482645 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b0bb092a-e09a-4f72-98ce-353ce7850f70 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:04.724210 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-6909c2e9-1bb9-4c11-b6a4-34ee3d8cb970 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e7ddc7c037439aad2f98277eef199e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e712ce30eb9c4128aa0ec1d425e9ab79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:04.734064 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-6909c2e9-1bb9-4c11-b6a4-34ee3d8cb970 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] 10.222.0.60 "GET /compute/v2.1/servers/3d29c068-39c8-4851-82cf-b7639f689f24" status: 200 len: 1510 microversion: 2.1 time: 0.555884 Sep 14 09:03:04.738328 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1631/3322] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:03:04 2022] GET /compute/v2.1/servers/3d29c068-39c8-4851-82cf-b7639f689f24 => generated 1510 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:03:04.764660 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-0816f42c-79fb-486f-aca8-8113854e144c tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:04.765580 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-0816f42c-79fb-486f-aca8-8113854e144c tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] [instance: 36253bc6-1737-4654-a878-c1eaeb797c8e] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:03:04.774478 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0816f42c-79fb-486f-aca8-8113854e144c tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:04.775223 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0816f42c-79fb-486f-aca8-8113854e144c tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:04.775849 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0816f42c-79fb-486f-aca8-8113854e144c tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:04.776787 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0816f42c-79fb-486f-aca8-8113854e144c tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:04.777423 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0816f42c-79fb-486f-aca8-8113854e144c tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:04.777849 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0816f42c-79fb-486f-aca8-8113854e144c tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:04.817527 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-b0bb092a-e09a-4f72-98ce-353ce7850f70 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b847ccce0654f2fa9df8367320a3218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9051111ca00649c591b6485d58bbc265', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:04.827219 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-b0bb092a-e09a-4f72-98ce-353ce7850f70 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] 10.222.0.60 "GET /compute/v2.1/servers/7558efb0-7f2d-42d5-9b6d-e442008b1c88" status: 200 len: 1467 microversion: 2.1 time: 0.382031 Sep 14 09:03:04.827995 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1692/3323] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:03:04 2022] GET /compute/v2.1/servers/7558efb0-7f2d-42d5-9b6d-e442008b1c88 => generated 1467 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:03:04.858092 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b7d73a6e-bd57-4e7e-8248-f8b3cb0c1172 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Calling method '.version_select at 0x7f7d4865c940>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:04.925564 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-b7d73a6e-bd57-4e7e-8248-f8b3cb0c1172 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] 10.222.0.60 "GET /compute/v2.1/images/bff4ab7f-4846-441f-8940-d96fec4c28e9" status: 200 len: 784 microversion: 2.1 time: 0.073291 Sep 14 09:03:04.930332 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1693/3324] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:03:04 2022] GET /compute/v2.1/images/bff4ab7f-4846-441f-8940-d96fec4c28e9 => generated 784 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:03:04.944330 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-de448776-5b2c-4674-ab8e-40cc665637ec tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:04.999545 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-de448776-5b2c-4674-ab8e-40cc665637ec tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] 10.222.0.60 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.058223 Sep 14 09:03:05.000442 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1694/3325] 10.222.0.60 () {58 vars in 1137 bytes} [Wed Sep 14 09:03:04 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:03:05.025579 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-63a7a100-7dcd-4587-8176-51f02985a0df tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Calling method '.version_select at 0x7f7d4865c670>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:05.147451 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-0816f42c-79fb-486f-aca8-8113854e144c tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e7ddc7c037439aad2f98277eef199e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e712ce30eb9c4128aa0ec1d425e9ab79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:05.161302 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-0816f42c-79fb-486f-aca8-8113854e144c tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] 10.222.0.60 "GET /compute/v2.1/servers/36253bc6-1737-4654-a878-c1eaeb797c8e" status: 200 len: 1511 microversion: 2.1 time: 0.402025 Sep 14 09:03:05.165194 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1632/3326] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:03:04 2022] GET /compute/v2.1/servers/36253bc6-1737-4654-a878-c1eaeb797c8e => generated 1511 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:03:05.179931 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8ebac2d0-223a-423d-9af4-b698565f59eb tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:05.181013 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-8ebac2d0-223a-423d-9af4-b698565f59eb tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: 56742f27-4436-4fc3-b7a5-9d337395b7d3] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:03:05.195621 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8ebac2d0-223a-423d-9af4-b698565f59eb tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:05.196911 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8ebac2d0-223a-423d-9af4-b698565f59eb tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:05.200273 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8ebac2d0-223a-423d-9af4-b698565f59eb tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:05.201294 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8ebac2d0-223a-423d-9af4-b698565f59eb tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:05.201996 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8ebac2d0-223a-423d-9af4-b698565f59eb tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:05.202809 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8ebac2d0-223a-423d-9af4-b698565f59eb tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:05.522680 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-8ebac2d0-223a-423d-9af4-b698565f59eb tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:05.538906 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-8ebac2d0-223a-423d-9af4-b698565f59eb tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/56742f27-4436-4fc3-b7a5-9d337395b7d3" status: 200 len: 1511 microversion: 2.1 time: 0.372180 Sep 14 09:03:05.543666 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1633/3327] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:03:05 2022] GET /compute/v2.1/servers/56742f27-4436-4fc3-b7a5-9d337395b7d3 => generated 1511 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:03:05.549136 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-310a6a2c-8870-4d8e-8650-255cf81bc110 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:05.550023 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-310a6a2c-8870-4d8e-8650-255cf81bc110 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] [instance: 4e25180a-b979-44d1-a7d1-19dd30eee7a4] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:03:05.589932 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-310a6a2c-8870-4d8e-8650-255cf81bc110 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:05.592754 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-310a6a2c-8870-4d8e-8650-255cf81bc110 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:05.593986 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-310a6a2c-8870-4d8e-8650-255cf81bc110 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:05.595946 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-310a6a2c-8870-4d8e-8650-255cf81bc110 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:05.598205 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-310a6a2c-8870-4d8e-8650-255cf81bc110 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:05.598917 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-310a6a2c-8870-4d8e-8650-255cf81bc110 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:05.944296 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-310a6a2c-8870-4d8e-8650-255cf81bc110 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e7ddc7c037439aad2f98277eef199e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e712ce30eb9c4128aa0ec1d425e9ab79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:05.956671 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-310a6a2c-8870-4d8e-8650-255cf81bc110 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] 10.222.0.60 "GET /compute/v2.1/servers/4e25180a-b979-44d1-a7d1-19dd30eee7a4" status: 200 len: 1512 microversion: 2.1 time: 0.411621 Sep 14 09:03:05.962495 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1634/3328] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:03:05 2022] GET /compute/v2.1/servers/4e25180a-b979-44d1-a7d1-19dd30eee7a4 => generated 1512 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:03:05.996994 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-fa98a075-698e-41df-9e73-0ca57d5a1fc1 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:06.002110 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-fa98a075-698e-41df-9e73-0ca57d5a1fc1 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] [instance: 0eb40c80-c056-4096-a586-7e957a63f7cf] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:03:06.014715 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fa98a075-698e-41df-9e73-0ca57d5a1fc1 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:06.015252 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fa98a075-698e-41df-9e73-0ca57d5a1fc1 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:06.016249 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fa98a075-698e-41df-9e73-0ca57d5a1fc1 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:06.016982 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fa98a075-698e-41df-9e73-0ca57d5a1fc1 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:06.017449 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fa98a075-698e-41df-9e73-0ca57d5a1fc1 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:06.021444 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fa98a075-698e-41df-9e73-0ca57d5a1fc1 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:06.400673 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-63a7a100-7dcd-4587-8176-51f02985a0df tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] 10.222.0.60 "DELETE /compute/v2.1/images/165c831f-0a00-4eac-be4f-8a4c39096827" status: 204 len: 0 microversion: 2.1 time: 1.391686 Sep 14 09:03:06.405858 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1695/3329] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:03:05 2022] DELETE /compute/v2.1/images/165c831f-0a00-4eac-be4f-8a4c39096827 => generated 0 bytes in 1394 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:03:06.586683 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-fdba0579-2073-42b5-89fe-4c53099fbbf6 tempest-ListImageFiltersNegativeTestJSON-73242584 tempest-ListImageFiltersNegativeTestJSON-73242584-project] Calling method '.version_select at 0x7f7d3f830a60>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:06.619388 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-fdba0579-2073-42b5-89fe-4c53099fbbf6 tempest-ListImageFiltersNegativeTestJSON-73242584 tempest-ListImageFiltersNegativeTestJSON-73242584-project] HTTP exception thrown: Image not found. Sep 14 09:03:06.622037 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-fdba0579-2073-42b5-89fe-4c53099fbbf6 tempest-ListImageFiltersNegativeTestJSON-73242584 tempest-ListImageFiltersNegativeTestJSON-73242584-project] Request method failure captured: Sep 14 09:03:06.622037 n-d-836830-18 devstack@n-api.service[128758]: request: GET /compute/v2.1/images/ff9399f3-9166-4029-9498-a251fcb9ec51 HTTP/1.1 Sep 14 09:03:06.622037 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 09:03:06.622037 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 09:03:06.622037 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 09:03:06.622037 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 09:03:06.622037 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 09:03:06.622037 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 09:03:06.622037 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 09:03:06.622037 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 09:03:06.622037 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZjJ41dfXYx0MUMPh7l8H-nTQ2xnwaSgf1oCN2p3W4u-ILviDoM3mLpaxmUZMZ_WUhwtXrC0IcDSeG9nwG_jInQN5tGCQ63vWFSDwPqqufIwNVbJ8dyE0wxS0w1NFgJ04wNm_VJ4eD5U9l652ux0Zfud7lOGtPpO1hxowUEFvTPhZdM Sep 14 09:03:06.622037 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 09:03:06.622037 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 09:03:06.622037 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 09:03:06.622037 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 09:03:06.622037 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 09:03:06.622037 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 09:03:06.622037 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 819452361575434dadcb72b5597afdcb Sep 14 09:03:06.622037 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-73242584 Sep 14 09:03:06.622037 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 09:03:06.622037 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 09:03:06.622037 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/819452361575434dadcb72b5597afdcb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_819452361575434dadcb72b5597afdcb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/819452361575434dadcb72b5597afdcb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/819452361575434dadcb72b5597afdcb"}]}] Sep 14 09:03:06.622037 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-73242584 Sep 14 09:03:06.622037 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 819452361575434dadcb72b5597afdcb Sep 14 09:03:06.622037 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-73242584 Sep 14 09:03:06.622037 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-ListImageFiltersNegativeTestJSON-73242584-project Sep 14 09:03:06.622037 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 09:03:06.622037 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 09:03:06.622037 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 96f4b8c20d3f4e4c82b118ea92057dd2 Sep 14 09:03:06.622037 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-73242584-project Sep 14 09:03:06.622037 n-d-836830-18 devstack@n-api.service[128758]: method: Sep 14 09:03:06.622037 n-d-836830-18 devstack@n-api.service[128758]: exception: Image not found. Sep 14 09:03:06.622037 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': 'ff9399f3-9166-4029-9498-a251fcb9ec51'} Sep 14 09:03:06.622037 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:03:06.622037 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:03:06.622037 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 14 09:03:06.622037 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 14 09:03:06.622037 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 14 09:03:06.622037 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 14 09:03:06.622037 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 14 09:03:06.622037 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 14 09:03:06.622037 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 14 09:03:06.622037 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 14 09:03:06.622037 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 14 09:03:06.622037 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 14 09:03:06.622037 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 14 09:03:06.622037 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 14 09:03:06.622037 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 14 09:03:06.622037 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 14 09:03:06.622037 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 14 09:03:06.622037 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 14 09:03:06.622037 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID ff9399f3-9166-4029-9498-a251fcb9ec51 Sep 14 09:03:06.622037 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:03:06.622037 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:03:06.622037 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:03:06.622037 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:03:06.622037 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Sep 14 09:03:06.622037 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Sep 14 09:03:06.622037 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 14 09:03:06.622037 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 14 09:03:06.622037 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 14 09:03:06.622037 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 14 09:03:06.622037 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 14 09:03:06.628634 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 14 09:03:06.628634 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 14 09:03:06.628634 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 14 09:03:06.628634 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 14 09:03:06.628634 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 14 09:03:06.628634 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 14 09:03:06.628634 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 14 09:03:06.628634 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 14 09:03:06.628634 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 14 09:03:06.628634 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 14 09:03:06.628634 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 14 09:03:06.628634 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 14 09:03:06.628634 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 14 09:03:06.628634 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 14 09:03:06.628634 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 14 09:03:06.628634 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 14 09:03:06.628634 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 14 09:03:06.628634 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ff9399f3-9166-4029-9498-a251fcb9ec51 could not be found. Sep 14 09:03:06.628634 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:03:06.628634 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:03:06.628634 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:03:06.628634 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:03:06.628634 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:03:06.628634 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:03:06.628634 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:03:06.628634 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:03:06.628634 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:03:06.628634 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:03:06.628634 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:03:06.628634 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:03:06.628634 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Sep 14 09:03:06.628634 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 14 09:03:06.628634 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 14 09:03:06.628634 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:03:06.628634 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:03:06.628634 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:03:06.628634 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:03:06.628634 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:03:06.628634 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:03:06.628634 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:03:06.628634 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:03:06.628634 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 14 09:03:06.628634 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:03:06.628634 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-fdba0579-2073-42b5-89fe-4c53099fbbf6 tempest-ListImageFiltersNegativeTestJSON-73242584 tempest-ListImageFiltersNegativeTestJSON-73242584-project] Returning 404 to user: Image not found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:03:06.628634 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-fdba0579-2073-42b5-89fe-4c53099fbbf6 tempest-ListImageFiltersNegativeTestJSON-73242584 tempest-ListImageFiltersNegativeTestJSON-73242584-project] 10.222.0.60 "GET /compute/v2.1/images/ff9399f3-9166-4029-9498-a251fcb9ec51" status: 404 len: 62 microversion: 2.1 time: 0.216494 Sep 14 09:03:06.628634 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1696/3330] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:03:06 2022] GET /compute/v2.1/images/ff9399f3-9166-4029-9498-a251fcb9ec51 => generated 62 bytes in 218 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 14 09:03:06.635024 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-5e19e803-bf7f-4d3c-a93f-3a275b145b1b tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:06.660423 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-5e19e803-bf7f-4d3c-a93f-3a275b145b1b tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd6e7ddc7c037439aad2f98277eef199e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e712ce30eb9c4128aa0ec1d425e9ab79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:06.661026 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-5e19e803-bf7f-4d3c-a93f-3a275b145b1b tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Searching by: {'ip': '172.20.0.11', 'deleted': False, 'project_id': 'e712ce30eb9c4128aa0ec1d425e9ab79'} {{(pid=128758) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 14 09:03:06.666267 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-fa98a075-698e-41df-9e73-0ca57d5a1fc1 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:06.678736 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-fa98a075-698e-41df-9e73-0ca57d5a1fc1 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:06.680253 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-fa98a075-698e-41df-9e73-0ca57d5a1fc1 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:06.698216 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-fa98a075-698e-41df-9e73-0ca57d5a1fc1 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] 10.222.0.60 "GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf" status: 200 len: 1537 microversion: 2.91 time: 0.733222 Sep 14 09:03:06.699225 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1635/3331] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:03:05 2022] GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf => generated 1537 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:03:06.703860 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e702689e-5de0-4094-a6b4-24529b0d74a8 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Calling method '.version_select at 0x7f7d4443a040>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:06.746499 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-e702689e-5de0-4094-a6b4-24529b0d74a8 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] HTTP exception thrown: Image not found. Sep 14 09:03:06.750445 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e702689e-5de0-4094-a6b4-24529b0d74a8 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Request method failure captured: Sep 14 09:03:06.750445 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/images/165c831f-0a00-4eac-be4f-8a4c39096827 HTTP/1.1 Sep 14 09:03:06.750445 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:03:06.750445 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:03:06.750445 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:03:06.750445 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:03:06.750445 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:03:06.750445 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:03:06.750445 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:03:06.750445 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:03:06.750445 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZiI-AkucMBaroluh1OyKtWIJyIdpyMdoktsRW_FiZsmRsli3WLei89jIV561123NfLfmQ7r3NcWskpXIOkKdUGeV-Df7F1xHrD8jZvuF1pJg1uUAwA0q4Gbsk7G-GLeYjCbSLXbRcD9cwaMyw349Js3YHSxw5JqRoOVRMDSSC2mNqU Sep 14 09:03:06.750445 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:03:06.750445 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:03:06.750445 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:03:06.750445 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:03:06.750445 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:03:06.750445 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:03:06.750445 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 9051111ca00649c591b6485d58bbc265 Sep 14 09:03:06.750445 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ImagesOneServerTestJSON-148298783 Sep 14 09:03:06.750445 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:03:06.750445 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:03:06.750445 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/9051111ca00649c591b6485d58bbc265"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_9051111ca00649c591b6485d58bbc265"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9051111ca00649c591b6485d58bbc265"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9051111ca00649c591b6485d58bbc265"}]}] Sep 14 09:03:06.750445 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ImagesOneServerTestJSON-148298783 Sep 14 09:03:06.750445 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 9051111ca00649c591b6485d58bbc265 Sep 14 09:03:06.750445 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-148298783 Sep 14 09:03:06.750445 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ImagesOneServerTestJSON-148298783-project Sep 14 09:03:06.750445 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:03:06.750445 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:03:06.750445 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 2b847ccce0654f2fa9df8367320a3218 Sep 14 09:03:06.750445 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ImagesOneServerTestJSON-148298783-project Sep 14 09:03:06.750445 n-d-836830-18 devstack@n-api.service[128759]: method: Sep 14 09:03:06.750445 n-d-836830-18 devstack@n-api.service[128759]: exception: Image not found. Sep 14 09:03:06.750445 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '165c831f-0a00-4eac-be4f-8a4c39096827'} Sep 14 09:03:06.750445 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:03:06.750445 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:03:06.750445 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 14 09:03:06.750445 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 14 09:03:06.750445 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 14 09:03:06.750445 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 14 09:03:06.750445 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 14 09:03:06.750445 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 14 09:03:06.750445 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 14 09:03:06.750445 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 14 09:03:06.750445 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 14 09:03:06.750445 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 14 09:03:06.750445 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 14 09:03:06.750445 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 14 09:03:06.750445 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 14 09:03:06.750445 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 14 09:03:06.750445 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 14 09:03:06.750445 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 14 09:03:06.750445 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 165c831f-0a00-4eac-be4f-8a4c39096827 Sep 14 09:03:06.750445 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:03:06.750445 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:03:06.750445 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:03:06.750445 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:03:06.750445 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Sep 14 09:03:06.750445 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Sep 14 09:03:06.750445 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 14 09:03:06.750445 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 14 09:03:06.750445 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 14 09:03:06.750445 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 14 09:03:06.750445 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 14 09:03:06.755291 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 14 09:03:06.755291 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 14 09:03:06.755291 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 14 09:03:06.755291 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 14 09:03:06.755291 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 14 09:03:06.755291 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 14 09:03:06.755291 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 14 09:03:06.755291 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 14 09:03:06.755291 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 14 09:03:06.755291 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 14 09:03:06.755291 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 14 09:03:06.755291 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 14 09:03:06.755291 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 14 09:03:06.755291 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 14 09:03:06.755291 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 14 09:03:06.755291 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 14 09:03:06.755291 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 14 09:03:06.755291 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 165c831f-0a00-4eac-be4f-8a4c39096827 could not be found. Sep 14 09:03:06.755291 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:03:06.755291 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:03:06.755291 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:03:06.755291 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:03:06.755291 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:03:06.755291 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:03:06.755291 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:03:06.755291 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:03:06.755291 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:03:06.755291 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:03:06.755291 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:03:06.755291 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:03:06.755291 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Sep 14 09:03:06.755291 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 14 09:03:06.755291 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 14 09:03:06.755291 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:03:06.755291 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:03:06.755291 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:03:06.755291 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:03:06.755291 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:03:06.755291 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:03:06.755291 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:03:06.755291 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:03:06.755291 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 14 09:03:06.755291 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:03:06.761328 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e702689e-5de0-4094-a6b4-24529b0d74a8 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Returning 404 to user: Image not found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:03:06.762426 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e702689e-5de0-4094-a6b4-24529b0d74a8 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] 10.222.0.60 "GET /compute/v2.1/images/165c831f-0a00-4eac-be4f-8a4c39096827" status: 404 len: 62 microversion: 2.1 time: 0.062119 Sep 14 09:03:06.765334 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1636/3332] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:03:06 2022] GET /compute/v2.1/images/165c831f-0a00-4eac-be4f-8a4c39096827 => generated 62 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 14 09:03:06.780300 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c6b364b5-0348-4313-bc09-e7bce996483c tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:06.781639 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-c6b364b5-0348-4313-bc09-e7bce996483c tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: 56742f27-4436-4fc3-b7a5-9d337395b7d3] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:03:06.790231 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c6b364b5-0348-4313-bc09-e7bce996483c tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:06.791614 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c6b364b5-0348-4313-bc09-e7bce996483c tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:06.792808 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c6b364b5-0348-4313-bc09-e7bce996483c tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:06.794066 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c6b364b5-0348-4313-bc09-e7bce996483c tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:06.794770 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c6b364b5-0348-4313-bc09-e7bce996483c tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:06.796466 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c6b364b5-0348-4313-bc09-e7bce996483c tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:07.063118 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5e19e803-bf7f-4d3c-a93f-3a275b145b1b tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:07.063945 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5e19e803-bf7f-4d3c-a93f-3a275b145b1b tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:07.064752 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5e19e803-bf7f-4d3c-a93f-3a275b145b1b tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:07.065679 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5e19e803-bf7f-4d3c-a93f-3a275b145b1b tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:07.066333 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5e19e803-bf7f-4d3c-a93f-3a275b145b1b tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:07.066980 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5e19e803-bf7f-4d3c-a93f-3a275b145b1b tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:07.446113 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.multi_cell_list [None req-5e19e803-bf7f-4d3c-a93f-3a275b145b1b tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128758) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 14 09:03:07.604556 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-5e19e803-bf7f-4d3c-a93f-3a275b145b1b tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] 10.222.0.60 "GET /compute/v2.1/servers?ip=172.20.0.11" status: 200 len: 346 microversion: 2.1 time: 0.979021 Sep 14 09:03:07.605433 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1697/3333] 10.222.0.60 () {58 vars in 1154 bytes} [Wed Sep 14 09:03:06 2022] GET /compute/v2.1/servers?ip=172.20.0.11 => generated 346 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:03:07.610370 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-34bf880b-a38c-4ec1-9eb9-fa5b3a64d8c1 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-475189304"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:03:07.624315 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-34bf880b-a38c-4ec1-9eb9-fa5b3a64d8c1 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] [instance: 7558efb0-7f2d-42d5-9b6d-e442008b1c88] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:03:07.640672 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-34bf880b-a38c-4ec1-9eb9-fa5b3a64d8c1 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:07.642515 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-34bf880b-a38c-4ec1-9eb9-fa5b3a64d8c1 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:07.646372 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-34bf880b-a38c-4ec1-9eb9-fa5b3a64d8c1 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:07.647412 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-34bf880b-a38c-4ec1-9eb9-fa5b3a64d8c1 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:07.648114 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-34bf880b-a38c-4ec1-9eb9-fa5b3a64d8c1 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:07.648785 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-34bf880b-a38c-4ec1-9eb9-fa5b3a64d8c1 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:07.736590 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-c6b364b5-0348-4313-bc09-e7bce996483c tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:07.745759 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-c6b364b5-0348-4313-bc09-e7bce996483c tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/56742f27-4436-4fc3-b7a5-9d337395b7d3" status: 200 len: 1511 microversion: 2.1 time: 0.978281 Sep 14 09:03:07.758093 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1637/3334] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:03:06 2022] GET /compute/v2.1/servers/56742f27-4436-4fc3-b7a5-9d337395b7d3 => generated 1511 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:03:07.779763 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-4e5e4221-410a-4ea5-99e2-d8b55aa52a96 req-4228f9c2-baf4-4e63-83cc-add407dd10cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7558efb0-7f2d-42d5-9b6d-e442008b1c88", "name": "network-vif-unplugged", "status": "completed", "tag": "84b61202-de19-4a04-b9dd-3a01a864606e"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:03:07.820896 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-4e5e4221-410a-4ea5-99e2-d8b55aa52a96 req-4228f9c2-baf4-4e63-83cc-add407dd10cc service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:07.821680 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-4e5e4221-410a-4ea5-99e2-d8b55aa52a96 req-4228f9c2-baf4-4e63-83cc-add407dd10cc service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:07.824560 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-4e5e4221-410a-4ea5-99e2-d8b55aa52a96 req-4228f9c2-baf4-4e63-83cc-add407dd10cc service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:07.847994 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-4e5e4221-410a-4ea5-99e2-d8b55aa52a96 req-4228f9c2-baf4-4e63-83cc-add407dd10cc service nova] Creating event network-vif-unplugged:84b61202-de19-4a04-b9dd-3a01a864606e for instance 7558efb0-7f2d-42d5-9b6d-e442008b1c88 on n-h2-836830-18 Sep 14 09:03:07.882815 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-4e5e4221-410a-4ea5-99e2-d8b55aa52a96 req-4228f9c2-baf4-4e63-83cc-add407dd10cc service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.113620 Sep 14 09:03:07.884049 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1638/3335] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:03:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:03:07.903437 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9a6e56c4-b8e6-4456-b014-0543df3d3161 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:07.904716 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-9a6e56c4-b8e6-4456-b014-0543df3d3161 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] [instance: 3d29c068-39c8-4851-82cf-b7639f689f24] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:03:07.911608 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9a6e56c4-b8e6-4456-b014-0543df3d3161 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:07.919654 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9a6e56c4-b8e6-4456-b014-0543df3d3161 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:07.920354 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9a6e56c4-b8e6-4456-b014-0543df3d3161 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:07.923867 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9a6e56c4-b8e6-4456-b014-0543df3d3161 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:07.926745 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9a6e56c4-b8e6-4456-b014-0543df3d3161 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:07.927398 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9a6e56c4-b8e6-4456-b014-0543df3d3161 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:08.158359 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-34bf880b-a38c-4ec1-9eb9-fa5b3a64d8c1 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] 10.222.0.60 "POST /compute/v2.1/servers/7558efb0-7f2d-42d5-9b6d-e442008b1c88/action" status: 202 len: 0 microversion: 2.1 time: 0.551443 Sep 14 09:03:08.165644 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1698/3336] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:03:07 2022] POST /compute/v2.1/servers/7558efb0-7f2d-42d5-9b6d-e442008b1c88/action => generated 0 bytes in 559 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 14 09:03:08.172515 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a9501ada-5f5d-4f2d-b8bf-bf75593404c9 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:08.173793 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-a9501ada-5f5d-4f2d-b8bf-bf75593404c9 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] [instance: 0eb40c80-c056-4096-a586-7e957a63f7cf] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:03:08.181726 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a9501ada-5f5d-4f2d-b8bf-bf75593404c9 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:08.182866 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a9501ada-5f5d-4f2d-b8bf-bf75593404c9 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:08.183881 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a9501ada-5f5d-4f2d-b8bf-bf75593404c9 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:08.184818 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a9501ada-5f5d-4f2d-b8bf-bf75593404c9 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:08.185694 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a9501ada-5f5d-4f2d-b8bf-bf75593404c9 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:08.186301 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a9501ada-5f5d-4f2d-b8bf-bf75593404c9 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:08.394537 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-a9501ada-5f5d-4f2d-b8bf-bf75593404c9 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:08.408607 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-a9501ada-5f5d-4f2d-b8bf-bf75593404c9 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:08.412587 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-a9501ada-5f5d-4f2d-b8bf-bf75593404c9 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:08.426998 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-a9501ada-5f5d-4f2d-b8bf-bf75593404c9 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] 10.222.0.60 "GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf" status: 200 len: 1537 microversion: 2.91 time: 0.259033 Sep 14 09:03:08.446966 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1699/3337] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:03:08 2022] GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf => generated 1537 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:03:08.447726 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-9a6e56c4-b8e6-4456-b014-0543df3d3161 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e7ddc7c037439aad2f98277eef199e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e712ce30eb9c4128aa0ec1d425e9ab79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:08.447860 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-0cb21ad5-6736-4ec0-b62c-fa2f401f9c88 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Calling method '.version_select at 0x7f7d443765e0>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:08.447984 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-9a6e56c4-b8e6-4456-b014-0543df3d3161 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] 10.222.0.60 "GET /compute/v2.1/servers/3d29c068-39c8-4851-82cf-b7639f689f24" status: 200 len: 1510 microversion: 2.1 time: 0.558679 Sep 14 09:03:08.447984 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1639/3338] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:03:07 2022] GET /compute/v2.1/servers/3d29c068-39c8-4851-82cf-b7639f689f24 => generated 1510 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:03:08.475737 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ce1eedca-ab16-4bba-9661-9ac6f88a14d8 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:08.478410 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-ce1eedca-ab16-4bba-9661-9ac6f88a14d8 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] [instance: 36253bc6-1737-4654-a878-c1eaeb797c8e] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:03:08.504723 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ce1eedca-ab16-4bba-9661-9ac6f88a14d8 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:08.506251 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ce1eedca-ab16-4bba-9661-9ac6f88a14d8 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:08.508684 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ce1eedca-ab16-4bba-9661-9ac6f88a14d8 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:08.509930 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ce1eedca-ab16-4bba-9661-9ac6f88a14d8 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:08.515905 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ce1eedca-ab16-4bba-9661-9ac6f88a14d8 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:08.516513 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ce1eedca-ab16-4bba-9661-9ac6f88a14d8 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:08.547045 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-0cb21ad5-6736-4ec0-b62c-fa2f401f9c88 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] 10.222.0.60 "GET /compute/v2.1/images/00fba841-876f-4e1c-a591-d7bb4cbf6263" status: 200 len: 1426 microversion: 2.1 time: 0.116267 Sep 14 09:03:08.548990 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1700/3339] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:03:08 2022] GET /compute/v2.1/images/00fba841-876f-4e1c-a591-d7bb4cbf6263 => generated 1426 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:03:08.790168 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-299ca284-cc7b-4132-b9c7-ef9a809fd545 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:08.791093 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-299ca284-cc7b-4132-b9c7-ef9a809fd545 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: 56742f27-4436-4fc3-b7a5-9d337395b7d3] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:03:08.805802 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-299ca284-cc7b-4132-b9c7-ef9a809fd545 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:08.806612 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-299ca284-cc7b-4132-b9c7-ef9a809fd545 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:08.811641 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-299ca284-cc7b-4132-b9c7-ef9a809fd545 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:08.812684 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-299ca284-cc7b-4132-b9c7-ef9a809fd545 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:08.813584 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-299ca284-cc7b-4132-b9c7-ef9a809fd545 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:08.814189 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-299ca284-cc7b-4132-b9c7-ef9a809fd545 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:08.957493 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-ce1eedca-ab16-4bba-9661-9ac6f88a14d8 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e7ddc7c037439aad2f98277eef199e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e712ce30eb9c4128aa0ec1d425e9ab79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:08.981210 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-ce1eedca-ab16-4bba-9661-9ac6f88a14d8 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] 10.222.0.60 "GET /compute/v2.1/servers/36253bc6-1737-4654-a878-c1eaeb797c8e" status: 200 len: 1511 microversion: 2.1 time: 0.509229 Sep 14 09:03:08.982364 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1640/3340] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:03:08 2022] GET /compute/v2.1/servers/36253bc6-1737-4654-a878-c1eaeb797c8e => generated 1511 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:03:09.012161 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e6e320bf-1fee-4568-b047-3270f0cf1a06 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:09.014166 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e6e320bf-1fee-4568-b047-3270f0cf1a06 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] [instance: 4e25180a-b979-44d1-a7d1-19dd30eee7a4] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:03:09.041061 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e6e320bf-1fee-4568-b047-3270f0cf1a06 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:09.042567 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e6e320bf-1fee-4568-b047-3270f0cf1a06 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:09.043465 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e6e320bf-1fee-4568-b047-3270f0cf1a06 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:09.046370 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e6e320bf-1fee-4568-b047-3270f0cf1a06 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:09.050926 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e6e320bf-1fee-4568-b047-3270f0cf1a06 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:09.052682 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e6e320bf-1fee-4568-b047-3270f0cf1a06 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:09.317658 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=2 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:03:09.588784 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-299ca284-cc7b-4132-b9c7-ef9a809fd545 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:09.606641 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-299ca284-cc7b-4132-b9c7-ef9a809fd545 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/56742f27-4436-4fc3-b7a5-9d337395b7d3" status: 200 len: 1511 microversion: 2.1 time: 0.821483 Sep 14 09:03:09.613117 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1701/3341] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:03:08 2022] GET /compute/v2.1/servers/56742f27-4436-4fc3-b7a5-9d337395b7d3 => generated 1511 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:03:09.633190 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-e9916762-d273-434c-ab9d-416d137d044d tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:09.635460 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-e9916762-d273-434c-ab9d-416d137d044d tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] [instance: 0eb40c80-c056-4096-a586-7e957a63f7cf] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:03:09.653145 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-e6e320bf-1fee-4568-b047-3270f0cf1a06 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e7ddc7c037439aad2f98277eef199e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e712ce30eb9c4128aa0ec1d425e9ab79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:09.662735 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e9916762-d273-434c-ab9d-416d137d044d tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:09.663276 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e9916762-d273-434c-ab9d-416d137d044d tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:09.663764 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e9916762-d273-434c-ab9d-416d137d044d tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:09.664538 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e9916762-d273-434c-ab9d-416d137d044d tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:09.668094 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e9916762-d273-434c-ab9d-416d137d044d tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:09.668552 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e9916762-d273-434c-ab9d-416d137d044d tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:09.669150 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e6e320bf-1fee-4568-b047-3270f0cf1a06 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] 10.222.0.60 "GET /compute/v2.1/servers/4e25180a-b979-44d1-a7d1-19dd30eee7a4" status: 200 len: 1512 microversion: 2.1 time: 0.665710 Sep 14 09:03:09.670287 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1641/3342] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:03:09 2022] GET /compute/v2.1/servers/4e25180a-b979-44d1-a7d1-19dd30eee7a4 => generated 1512 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:03:09.681982 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b70b32ca-7a76-41a7-be4e-6a60c4d9c4a7 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Calling method '.version_select at 0x7f7d442519d0>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:09.827577 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b70b32ca-7a76-41a7-be4e-6a60c4d9c4a7 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] 10.222.0.60 "GET /compute/v2.1/images/00fba841-876f-4e1c-a591-d7bb4cbf6263" status: 200 len: 1426 microversion: 2.1 time: 0.155884 Sep 14 09:03:09.831246 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1642/3343] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:03:09 2022] GET /compute/v2.1/images/00fba841-876f-4e1c-a591-d7bb4cbf6263 => generated 1426 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:03:09.840942 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ade1d1fc-d869-47fc-9947-a976274fac6e tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:09.853271 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-ade1d1fc-d869-47fc-9947-a976274fac6e tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd6e7ddc7c037439aad2f98277eef199e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e712ce30eb9c4128aa0ec1d425e9ab79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:09.856035 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-ade1d1fc-d869-47fc-9947-a976274fac6e tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Searching by: {'deleted': False, 'project_id': 'e712ce30eb9c4128aa0ec1d425e9ab79'} {{(pid=128759) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 14 09:03:09.868232 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ade1d1fc-d869-47fc-9947-a976274fac6e tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:09.869089 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ade1d1fc-d869-47fc-9947-a976274fac6e tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:09.871834 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ade1d1fc-d869-47fc-9947-a976274fac6e tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:09.873687 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ade1d1fc-d869-47fc-9947-a976274fac6e tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:09.878032 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ade1d1fc-d869-47fc-9947-a976274fac6e tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:09.878789 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ade1d1fc-d869-47fc-9947-a976274fac6e tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:09.913498 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.multi_cell_list [None req-ade1d1fc-d869-47fc-9947-a976274fac6e tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128759) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 14 09:03:09.928422 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-e9916762-d273-434c-ab9d-416d137d044d tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:09.940555 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-e9916762-d273-434c-ab9d-416d137d044d tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:09.944741 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-e9916762-d273-434c-ab9d-416d137d044d tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:09.958640 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-e9916762-d273-434c-ab9d-416d137d044d tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] 10.222.0.60 "GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf" status: 200 len: 1537 microversion: 2.91 time: 0.342497 Sep 14 09:03:09.962523 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1702/3344] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:03:09 2022] GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf => generated 1537 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:03:10.000241 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-ade1d1fc-d869-47fc-9947-a976274fac6e tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e7ddc7c037439aad2f98277eef199e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e712ce30eb9c4128aa0ec1d425e9ab79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:10.010244 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ade1d1fc-d869-47fc-9947-a976274fac6e tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:10.011721 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ade1d1fc-d869-47fc-9947-a976274fac6e tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:10.012447 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ade1d1fc-d869-47fc-9947-a976274fac6e tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:10.017339 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:03:10.537822 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-ade1d1fc-d869-47fc-9947-a976274fac6e tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] 10.222.0.60 "GET /compute/v2.1/servers/detail" status: 200 len: 4516 microversion: 2.1 time: 0.705127 Sep 14 09:03:10.539051 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1643/3345] 10.222.0.60 () {58 vars in 1146 bytes} [Wed Sep 14 09:03:09 2022] GET /compute/v2.1/servers/detail => generated 4516 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:03:10.576474 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-0588516c-b29c-4ca4-a37e-fa45e9a9bf0d tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:10.581793 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-0588516c-b29c-4ca4-a37e-fa45e9a9bf0d tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd6e7ddc7c037439aad2f98277eef199e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e712ce30eb9c4128aa0ec1d425e9ab79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:10.582476 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-0588516c-b29c-4ca4-a37e-fa45e9a9bf0d tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': 'e712ce30eb9c4128aa0ec1d425e9ab79'} {{(pid=128759) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 14 09:03:10.716893 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-77a5dd70-6184-47df-8128-8cdd0f4bc51c tempest-ListImagesTestJSON-1866220690 tempest-ListImagesTestJSON-1866220690-project] Calling method '.version_select at 0x7f7d3f830dc0>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:10.790127 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-77a5dd70-6184-47df-8128-8cdd0f4bc51c tempest-ListImagesTestJSON-1866220690 tempest-ListImagesTestJSON-1866220690-project] 10.222.0.60 "GET /compute/v2.1/images/bff4ab7f-4846-441f-8940-d96fec4c28e9" status: 200 len: 784 microversion: 2.1 time: 0.393199 Sep 14 09:03:10.811035 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1703/3346] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:03:10 2022] GET /compute/v2.1/images/bff4ab7f-4846-441f-8940-d96fec4c28e9 => generated 784 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:03:10.833097 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-8ecbea68-ccfd-4b48-b976-0258d3e4e007 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:10.836059 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-8ecbea68-ccfd-4b48-b976-0258d3e4e007 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: 56742f27-4436-4fc3-b7a5-9d337395b7d3] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:03:10.856433 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8ecbea68-ccfd-4b48-b976-0258d3e4e007 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:10.859429 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8ecbea68-ccfd-4b48-b976-0258d3e4e007 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:10.860677 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8ecbea68-ccfd-4b48-b976-0258d3e4e007 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:10.861917 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8ecbea68-ccfd-4b48-b976-0258d3e4e007 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:10.863486 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8ecbea68-ccfd-4b48-b976-0258d3e4e007 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:10.864521 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8ecbea68-ccfd-4b48-b976-0258d3e4e007 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:11.317849 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0588516c-b29c-4ca4-a37e-fa45e9a9bf0d tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:11.318344 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0588516c-b29c-4ca4-a37e-fa45e9a9bf0d tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:11.319326 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0588516c-b29c-4ca4-a37e-fa45e9a9bf0d tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:11.320078 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0588516c-b29c-4ca4-a37e-fa45e9a9bf0d tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:11.321003 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0588516c-b29c-4ca4-a37e-fa45e9a9bf0d tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:11.321641 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0588516c-b29c-4ca4-a37e-fa45e9a9bf0d tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:11.445047 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-8ecbea68-ccfd-4b48-b976-0258d3e4e007 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:11.456206 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-8ecbea68-ccfd-4b48-b976-0258d3e4e007 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/56742f27-4436-4fc3-b7a5-9d337395b7d3" status: 200 len: 1511 microversion: 2.1 time: 0.641257 Sep 14 09:03:11.457077 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1704/3347] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:03:10 2022] GET /compute/v2.1/servers/56742f27-4436-4fc3-b7a5-9d337395b7d3 => generated 1511 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:03:11.489226 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-eefaad38-68e4-4544-bbfa-8c191c3a2845 tempest-ListImagesTestJSON-1866220690 tempest-ListImagesTestJSON-1866220690-project] Calling method '.version_select at 0x7f7d44d95ee0>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:11.506852 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.multi_cell_list [None req-0588516c-b29c-4ca4-a37e-fa45e9a9bf0d tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128759) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 14 09:03:11.588947 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-eefaad38-68e4-4544-bbfa-8c191c3a2845 tempest-ListImagesTestJSON-1866220690 tempest-ListImagesTestJSON-1866220690-project] 10.222.0.60 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.130594 Sep 14 09:03:11.589863 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1705/3348] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 14 09:03:11 2022] GET /compute/v2.1/images => generated 445 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:03:11.600855 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-0588516c-b29c-4ca4-a37e-fa45e9a9bf0d tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] 10.222.0.60 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1011 microversion: 2.1 time: 1.034945 Sep 14 09:03:11.601445 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-07bcc576-9d15-45f4-81f9-86467a556c0c tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Calling method '.version_select at 0x7f7d3faa3ee0>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:11.601804 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1644/3349] 10.222.0.60 () {58 vars in 1150 bytes} [Wed Sep 14 09:03:10 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1011 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:03:11.614187 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-1f04fa6c-5f8b-42ba-b72b-4855f1dfb1da tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:11.615141 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-1f04fa6c-5f8b-42ba-b72b-4855f1dfb1da tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] [instance: 0eb40c80-c056-4096-a586-7e957a63f7cf] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:03:11.631860 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1f04fa6c-5f8b-42ba-b72b-4855f1dfb1da tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:11.632666 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1f04fa6c-5f8b-42ba-b72b-4855f1dfb1da tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:11.632809 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1f04fa6c-5f8b-42ba-b72b-4855f1dfb1da tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:11.633506 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1f04fa6c-5f8b-42ba-b72b-4855f1dfb1da tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:11.636620 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1f04fa6c-5f8b-42ba-b72b-4855f1dfb1da tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:11.642329 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1f04fa6c-5f8b-42ba-b72b-4855f1dfb1da tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:11.675339 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-07bcc576-9d15-45f4-81f9-86467a556c0c tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] 10.222.0.60 "GET /compute/v2.1/images/00fba841-876f-4e1c-a591-d7bb4cbf6263" status: 200 len: 1426 microversion: 2.1 time: 0.084391 Sep 14 09:03:11.676048 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1706/3350] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:03:11 2022] GET /compute/v2.1/images/00fba841-876f-4e1c-a591-d7bb4cbf6263 => generated 1426 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:03:11.742578 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-1f04fa6c-5f8b-42ba-b72b-4855f1dfb1da tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:11.752009 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-1f04fa6c-5f8b-42ba-b72b-4855f1dfb1da tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:11.757102 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-1f04fa6c-5f8b-42ba-b72b-4855f1dfb1da tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:11.770621 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-1f04fa6c-5f8b-42ba-b72b-4855f1dfb1da tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] 10.222.0.60 "GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf" status: 200 len: 1558 microversion: 2.91 time: 0.167606 Sep 14 09:03:11.771773 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1645/3351] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:03:11 2022] GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf => generated 1558 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:03:11.773537 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c08518ae-fe6c-4e1d-acbc-fad4176a4ba8 tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-776143226", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "networks": [{"uuid": "68ded427-868d-47b7-a4e6-fe33a6d71e96"}]}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:03:11.777467 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b593b821-ac08-42c6-8518-c9341ac2c1b0 tempest-ListImagesTestJSON-1866220690 tempest-ListImagesTestJSON-1866220690-project] Calling method '.version_select at 0x7f7d4445b160>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:11.840051 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b593b821-ac08-42c6-8518-c9341ac2c1b0 tempest-ListImagesTestJSON-1866220690 tempest-ListImagesTestJSON-1866220690-project] 10.222.0.60 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.066920 Sep 14 09:03:11.840843 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1646/3352] 10.222.0.60 () {58 vars in 1143 bytes} [Wed Sep 14 09:03:11 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:03:11.845718 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3d463fbb-d322-4e0c-9429-3196e75b478a tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:11.858645 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-3d463fbb-d322-4e0c-9429-3196e75b478a tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd6e7ddc7c037439aad2f98277eef199e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e712ce30eb9c4128aa0ec1d425e9ab79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:11.859359 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-3d463fbb-d322-4e0c-9429-3196e75b478a tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': 'e712ce30eb9c4128aa0ec1d425e9ab79'} {{(pid=128759) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 14 09:03:11.869191 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3d463fbb-d322-4e0c-9429-3196e75b478a tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:11.870465 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3d463fbb-d322-4e0c-9429-3196e75b478a tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:11.871175 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3d463fbb-d322-4e0c-9429-3196e75b478a tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:11.876722 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.network.neutron [None req-c08518ae-fe6c-4e1d-acbc-fad4176a4ba8 tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] validate_networks() for [('68ded427-868d-47b7-a4e6-fe33a6d71e96', None, None, None, None, None)] {{(pid=128758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:03:11.886676 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3d463fbb-d322-4e0c-9429-3196e75b478a tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:11.887188 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3d463fbb-d322-4e0c-9429-3196e75b478a tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:11.887936 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3d463fbb-d322-4e0c-9429-3196e75b478a tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:12.118806 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.multi_cell_list [None req-3d463fbb-d322-4e0c-9429-3196e75b478a tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128759) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 14 09:03:12.234893 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-3d463fbb-d322-4e0c-9429-3196e75b478a tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] 10.222.0.60 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1011 microversion: 2.1 time: 0.392465 Sep 14 09:03:12.235745 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1647/3353] 10.222.0.60 () {58 vars in 1212 bytes} [Wed Sep 14 09:03:11 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1011 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:03:12.255841 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-66489713-98ee-4e53-9d15-af8ea33af169 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:12.261887 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-66489713-98ee-4e53-9d15-af8ea33af169 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd6e7ddc7c037439aad2f98277eef199e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e712ce30eb9c4128aa0ec1d425e9ab79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:12.262776 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-66489713-98ee-4e53-9d15-af8ea33af169 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': 'e712ce30eb9c4128aa0ec1d425e9ab79'} {{(pid=128759) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 14 09:03:12.269165 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-66489713-98ee-4e53-9d15-af8ea33af169 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:12.270032 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-66489713-98ee-4e53-9d15-af8ea33af169 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:12.270583 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-66489713-98ee-4e53-9d15-af8ea33af169 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:12.273272 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-66489713-98ee-4e53-9d15-af8ea33af169 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:12.273987 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-66489713-98ee-4e53-9d15-af8ea33af169 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:12.286544 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-66489713-98ee-4e53-9d15-af8ea33af169 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:12.404900 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.multi_cell_list [None req-66489713-98ee-4e53-9d15-af8ea33af169 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128759) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 14 09:03:12.487067 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-66489713-98ee-4e53-9d15-af8ea33af169 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] 10.222.0.60 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1011 microversion: 2.1 time: 0.239490 Sep 14 09:03:12.490705 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1648/3354] 10.222.0.60 () {58 vars in 1196 bytes} [Wed Sep 14 09:03:12 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1011 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:03:12.498655 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-6d632425-3a61-4598-877d-c39f0f08a5e9 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:12.500448 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-6d632425-3a61-4598-877d-c39f0f08a5e9 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: 56742f27-4436-4fc3-b7a5-9d337395b7d3] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:03:12.508724 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6d632425-3a61-4598-877d-c39f0f08a5e9 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:12.509518 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6d632425-3a61-4598-877d-c39f0f08a5e9 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:12.510358 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6d632425-3a61-4598-877d-c39f0f08a5e9 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:12.511304 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6d632425-3a61-4598-877d-c39f0f08a5e9 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:12.511978 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6d632425-3a61-4598-877d-c39f0f08a5e9 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:12.512463 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6d632425-3a61-4598-877d-c39f0f08a5e9 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:12.925704 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-6d632425-3a61-4598-877d-c39f0f08a5e9 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:12.935574 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-6d632425-3a61-4598-877d-c39f0f08a5e9 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/56742f27-4436-4fc3-b7a5-9d337395b7d3" status: 200 len: 1511 microversion: 2.1 time: 0.442462 Sep 14 09:03:12.937161 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1649/3355] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:03:12 2022] GET /compute/v2.1/servers/56742f27-4436-4fc3-b7a5-9d337395b7d3 => generated 1511 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:03:12.956380 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f744c156-b19a-49d2-8879-b825dd704c8e tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:12.966876 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f744c156-b19a-49d2-8879-b825dd704c8e tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd6e7ddc7c037439aad2f98277eef199e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e712ce30eb9c4128aa0ec1d425e9ab79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:12.967704 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f744c156-b19a-49d2-8879-b825dd704c8e tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Searching by: {'name': '-567326605', 'deleted': False, 'project_id': 'e712ce30eb9c4128aa0ec1d425e9ab79'} {{(pid=128759) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 14 09:03:12.985852 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f744c156-b19a-49d2-8879-b825dd704c8e tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:12.987610 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f744c156-b19a-49d2-8879-b825dd704c8e tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:12.988072 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f744c156-b19a-49d2-8879-b825dd704c8e tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:12.988828 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f744c156-b19a-49d2-8879-b825dd704c8e tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:12.989285 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f744c156-b19a-49d2-8879-b825dd704c8e tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:12.989707 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f744c156-b19a-49d2-8879-b825dd704c8e tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:13.242647 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.multi_cell_list [None req-f744c156-b19a-49d2-8879-b825dd704c8e tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128759) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 14 09:03:13.428295 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-c08518ae-fe6c-4e1d-acbc-fad4176a4ba8 tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Flavor limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:03:13.428779 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-c08518ae-fe6c-4e1d-acbc-fad4176a4ba8 tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Image limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:03:13.430254 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-c08518ae-fe6c-4e1d-acbc-fad4176a4ba8 tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Flavor pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:03:13.430713 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-c08518ae-fe6c-4e1d-acbc-fad4176a4ba8 tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Image pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:03:13.431219 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-c08518ae-fe6c-4e1d-acbc-fad4176a4ba8 tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:03:13.440837 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f744c156-b19a-49d2-8879-b825dd704c8e tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] 10.222.0.60 "GET /compute/v2.1/servers?name=-567326605" status: 200 len: 345 microversion: 2.1 time: 0.499756 Sep 14 09:03:13.446874 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1650/3356] 10.222.0.60 () {58 vars in 1156 bytes} [Wed Sep 14 09:03:12 2022] GET /compute/v2.1/servers?name=-567326605 => generated 345 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:03:13.461361 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c08518ae-fe6c-4e1d-acbc-fad4176a4ba8 tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:13.466270 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-de5e7612-b575-46bf-99f7-4358f7d8622e tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Calling method '.version_select at 0x7f7d44431670>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:13.473726 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c08518ae-fe6c-4e1d-acbc-fad4176a4ba8 tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:13.474270 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c08518ae-fe6c-4e1d-acbc-fad4176a4ba8 tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:13.475140 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c08518ae-fe6c-4e1d-acbc-fad4176a4ba8 tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:13.480059 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c08518ae-fe6c-4e1d-acbc-fad4176a4ba8 tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:13.484289 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c08518ae-fe6c-4e1d-acbc-fad4176a4ba8 tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:13.563365 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-de5e7612-b575-46bf-99f7-4358f7d8622e tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] 10.222.0.60 "GET /compute/v2.1/images/00fba841-876f-4e1c-a591-d7bb4cbf6263" status: 200 len: 1426 microversion: 2.1 time: 0.116779 Sep 14 09:03:13.571190 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1651/3357] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:03:13 2022] GET /compute/v2.1/images/00fba841-876f-4e1c-a591-d7bb4cbf6263 => generated 1426 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:03:13.581593 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-c08518ae-fe6c-4e1d-acbc-fad4176a4ba8 tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Getting quotas for project 17461d862f104a3284ffa025efb619e4. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:03:13.585806 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8d589006-0688-4218-85ae-99ddf9d47b75 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:13.588205 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-8d589006-0688-4218-85ae-99ddf9d47b75 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] [instance: 0eb40c80-c056-4096-a586-7e957a63f7cf] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:03:13.598134 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:UPDATE=1,nova_api:SELECT=99 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:03:13.599830 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8d589006-0688-4218-85ae-99ddf9d47b75 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:13.600438 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8d589006-0688-4218-85ae-99ddf9d47b75 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:13.600995 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8d589006-0688-4218-85ae-99ddf9d47b75 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:13.601882 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8d589006-0688-4218-85ae-99ddf9d47b75 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:13.602449 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8d589006-0688-4218-85ae-99ddf9d47b75 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:13.603319 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8d589006-0688-4218-85ae-99ddf9d47b75 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:13.609890 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-c08518ae-fe6c-4e1d-acbc-fad4176a4ba8 tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Getting quotas for user c12ca200f5b7468dac6b0164faa0c171 and project 17461d862f104a3284ffa025efb619e4. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:03:13.676239 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-c08518ae-fe6c-4e1d-acbc-fad4176a4ba8 tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Going to run 1 instances... {{(pid=128758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:03:13.679191 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-c08518ae-fe6c-4e1d-acbc-fad4176a4ba8 tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] [instance: d9ab57a3-b59b-4a19-99cc-d8f8383d10a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:03:13.761595 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-8d589006-0688-4218-85ae-99ddf9d47b75 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:13.785362 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-8d589006-0688-4218-85ae-99ddf9d47b75 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:13.793832 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-8d589006-0688-4218-85ae-99ddf9d47b75 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:13.809930 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-8d589006-0688-4218-85ae-99ddf9d47b75 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] 10.222.0.60 "GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf" status: 200 len: 1558 microversion: 2.91 time: 0.243919 Sep 14 09:03:13.814928 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1652/3358] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:03:13 2022] GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf => generated 1558 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:03:13.854893 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-ea3c4eed-1d9f-4dfa-8140-20a71883dd92 req-3d61dfea-5409-4b42-88c5-66a208609c77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7558efb0-7f2d-42d5-9b6d-e442008b1c88", "name": "network-vif-plugged", "status": "completed", "tag": "84b61202-de19-4a04-b9dd-3a01a864606e"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:03:13.867707 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-c08518ae-fe6c-4e1d-acbc-fad4176a4ba8 tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.190355 Sep 14 09:03:13.874349 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1707/3359] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 09:03:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 2197 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:03:13.882806 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d70c49db-ef77-4688-a4ce-60baaf2f5f35 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:13.891195 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-ea3c4eed-1d9f-4dfa-8140-20a71883dd92 req-3d61dfea-5409-4b42-88c5-66a208609c77 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:13.898764 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-ea3c4eed-1d9f-4dfa-8140-20a71883dd92 req-3d61dfea-5409-4b42-88c5-66a208609c77 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:13.899556 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-ea3c4eed-1d9f-4dfa-8140-20a71883dd92 req-3d61dfea-5409-4b42-88c5-66a208609c77 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:13.912171 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-d70c49db-ef77-4688-a4ce-60baaf2f5f35 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd6e7ddc7c037439aad2f98277eef199e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e712ce30eb9c4128aa0ec1d425e9ab79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:13.920964 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-d70c49db-ef77-4688-a4ce-60baaf2f5f35 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': 'e712ce30eb9c4128aa0ec1d425e9ab79'} {{(pid=128758) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 14 09:03:13.940707 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d70c49db-ef77-4688-a4ce-60baaf2f5f35 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:13.944262 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d70c49db-ef77-4688-a4ce-60baaf2f5f35 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:13.945603 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d70c49db-ef77-4688-a4ce-60baaf2f5f35 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:13.949864 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d70c49db-ef77-4688-a4ce-60baaf2f5f35 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:13.955837 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-ea3c4eed-1d9f-4dfa-8140-20a71883dd92 req-3d61dfea-5409-4b42-88c5-66a208609c77 service nova] Creating event network-vif-plugged:84b61202-de19-4a04-b9dd-3a01a864606e for instance 7558efb0-7f2d-42d5-9b6d-e442008b1c88 on n-h2-836830-18 Sep 14 09:03:13.956803 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d70c49db-ef77-4688-a4ce-60baaf2f5f35 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:13.957496 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d70c49db-ef77-4688-a4ce-60baaf2f5f35 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:13.969994 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-ea3c4eed-1d9f-4dfa-8140-20a71883dd92 req-3d61dfea-5409-4b42-88c5-66a208609c77 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130161 Sep 14 09:03:13.985059 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1653/3360] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:03:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:03:13.993953 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9aad8931-87bf-42d9-908b-b43caab37dad tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:14.001058 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-9aad8931-87bf-42d9-908b-b43caab37dad tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] [instance: d9ab57a3-b59b-4a19-99cc-d8f8383d10a8] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:03:14.184371 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-9aad8931-87bf-42d9-908b-b43caab37dad tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12ca200f5b7468dac6b0164faa0c171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17461d862f104a3284ffa025efb619e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:14.195042 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-9aad8931-87bf-42d9-908b-b43caab37dad tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] 10.222.0.60 "GET /compute/v2.1/servers/d9ab57a3-b59b-4a19-99cc-d8f8383d10a8" status: 200 len: 1216 microversion: 2.1 time: 0.205973 Sep 14 09:03:14.196608 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1654/3361] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:03:13 2022] GET /compute/v2.1/servers/d9ab57a3-b59b-4a19-99cc-d8f8383d10a8 => generated 1216 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:03:14.206630 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-cb29127c-393d-49ab-b403-f381c409e4a8 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:14.209352 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-cb29127c-393d-49ab-b403-f381c409e4a8 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: 56742f27-4436-4fc3-b7a5-9d337395b7d3] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:03:14.222102 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cb29127c-393d-49ab-b403-f381c409e4a8 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:14.223304 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cb29127c-393d-49ab-b403-f381c409e4a8 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:14.227165 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cb29127c-393d-49ab-b403-f381c409e4a8 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:14.229188 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cb29127c-393d-49ab-b403-f381c409e4a8 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:14.229969 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cb29127c-393d-49ab-b403-f381c409e4a8 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:14.232930 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cb29127c-393d-49ab-b403-f381c409e4a8 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:14.296505 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.multi_cell_list [None req-d70c49db-ef77-4688-a4ce-60baaf2f5f35 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128758) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 14 09:03:14.520005 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-d70c49db-ef77-4688-a4ce-60baaf2f5f35 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] 10.222.0.60 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1011 microversion: 2.1 time: 0.643947 Sep 14 09:03:14.520605 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1708/3362] 10.222.0.60 () {58 vars in 1154 bytes} [Wed Sep 14 09:03:13 2022] GET /compute/v2.1/servers?name=-instance => generated 1011 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:03:14.538639 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-3f1df955-f43c-44a4-8227-955eccb7ee8d tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:14.544311 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-3f1df955-f43c-44a4-8227-955eccb7ee8d tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd6e7ddc7c037439aad2f98277eef199e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e712ce30eb9c4128aa0ec1d425e9ab79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:14.544978 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-3f1df955-f43c-44a4-8227-955eccb7ee8d tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-56732660', 'deleted': False, 'project_id': 'e712ce30eb9c4128aa0ec1d425e9ab79'} {{(pid=128758) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 14 09:03:14.551443 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3f1df955-f43c-44a4-8227-955eccb7ee8d tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:14.551920 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3f1df955-f43c-44a4-8227-955eccb7ee8d tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:14.552658 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3f1df955-f43c-44a4-8227-955eccb7ee8d tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:14.554190 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3f1df955-f43c-44a4-8227-955eccb7ee8d tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:14.554799 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3f1df955-f43c-44a4-8227-955eccb7ee8d tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:14.555394 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3f1df955-f43c-44a4-8227-955eccb7ee8d tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:14.642334 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-cb29127c-393d-49ab-b403-f381c409e4a8 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:14.660144 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-cb29127c-393d-49ab-b403-f381c409e4a8 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/56742f27-4436-4fc3-b7a5-9d337395b7d3" status: 200 len: 1511 microversion: 2.1 time: 0.459652 Sep 14 09:03:14.672363 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1655/3363] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:03:14 2022] GET /compute/v2.1/servers/56742f27-4436-4fc3-b7a5-9d337395b7d3 => generated 1511 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:03:14.695440 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d856bc1c-2887-4128-881c-4f13d2f53fcd tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Calling method '.version_select at 0x7f7d3ffc53a0>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:14.753175 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.multi_cell_list [None req-3f1df955-f43c-44a4-8227-955eccb7ee8d tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128758) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 14 09:03:14.831695 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d856bc1c-2887-4128-881c-4f13d2f53fcd tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] 10.222.0.60 "GET /compute/v2.1/images/00fba841-876f-4e1c-a591-d7bb4cbf6263" status: 200 len: 1426 microversion: 2.1 time: 0.156357 Sep 14 09:03:14.835615 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1656/3364] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:03:14 2022] GET /compute/v2.1/images/00fba841-876f-4e1c-a591-d7bb4cbf6263 => generated 1426 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:03:14.865843 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-20f22960-633d-40f9-88d6-709428c9161f tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:14.876987 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-20f22960-633d-40f9-88d6-709428c9161f tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] [instance: 0eb40c80-c056-4096-a586-7e957a63f7cf] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:03:14.926129 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-20f22960-633d-40f9-88d6-709428c9161f tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:14.941045 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-20f22960-633d-40f9-88d6-709428c9161f tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:14.943072 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-20f22960-633d-40f9-88d6-709428c9161f tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:14.945976 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-20f22960-633d-40f9-88d6-709428c9161f tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:14.946466 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-20f22960-633d-40f9-88d6-709428c9161f tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:14.946924 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-20f22960-633d-40f9-88d6-709428c9161f tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:15.012061 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-3f1df955-f43c-44a4-8227-955eccb7ee8d tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] 10.222.0.60 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-56732660" status: 200 len: 345 microversion: 2.1 time: 0.477137 Sep 14 09:03:15.021766 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1709/3365] 10.222.0.60 () {58 vars in 1226 bytes} [Wed Sep 14 09:03:14 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-56732660 => generated 345 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:03:15.039225 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-e89408f5-7fb8-4b79-9961-3d5a6b1e6d9b tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:15.043296 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-e89408f5-7fb8-4b79-9961-3d5a6b1e6d9b tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] [instance: 4e25180a-b979-44d1-a7d1-19dd30eee7a4] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:03:15.059124 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e89408f5-7fb8-4b79-9961-3d5a6b1e6d9b tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:15.059607 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e89408f5-7fb8-4b79-9961-3d5a6b1e6d9b tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:15.060049 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e89408f5-7fb8-4b79-9961-3d5a6b1e6d9b tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:15.067824 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e89408f5-7fb8-4b79-9961-3d5a6b1e6d9b tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:15.068321 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e89408f5-7fb8-4b79-9961-3d5a6b1e6d9b tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:15.068757 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e89408f5-7fb8-4b79-9961-3d5a6b1e6d9b tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:15.190498 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-e89408f5-7fb8-4b79-9961-3d5a6b1e6d9b tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] [instance: 4e25180a-b979-44d1-a7d1-19dd30eee7a4] Going to try to terminate instance {{(pid=128758) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:03:15.200392 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-20f22960-633d-40f9-88d6-709428c9161f tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:15.218178 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-20f22960-633d-40f9-88d6-709428c9161f tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:15.219781 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-20f22960-633d-40f9-88d6-709428c9161f tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:15.258971 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-20f22960-633d-40f9-88d6-709428c9161f tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] 10.222.0.60 "GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf" status: 200 len: 1553 microversion: 2.91 time: 0.409430 Sep 14 09:03:15.270302 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1657/3366] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:03:14 2022] GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf => generated 1553 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:03:15.275578 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3dba2a21-67a4-40f6-ae0e-225c5ff82eba tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:15.295224 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-3dba2a21-67a4-40f6-ae0e-225c5ff82eba tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] [instance: d9ab57a3-b59b-4a19-99cc-d8f8383d10a8] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:03:15.320875 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3dba2a21-67a4-40f6-ae0e-225c5ff82eba tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:15.322523 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3dba2a21-67a4-40f6-ae0e-225c5ff82eba tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:15.323047 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3dba2a21-67a4-40f6-ae0e-225c5ff82eba tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:15.323812 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3dba2a21-67a4-40f6-ae0e-225c5ff82eba tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:15.324269 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3dba2a21-67a4-40f6-ae0e-225c5ff82eba tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:15.324702 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3dba2a21-67a4-40f6-ae0e-225c5ff82eba tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:15.482658 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-e89408f5-7fb8-4b79-9961-3d5a6b1e6d9b tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] 10.222.0.60 "DELETE /compute/v2.1/servers/4e25180a-b979-44d1-a7d1-19dd30eee7a4" status: 204 len: 0 microversion: 2.1 time: 0.459493 Sep 14 09:03:15.483857 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1710/3367] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:03:15 2022] DELETE /compute/v2.1/servers/4e25180a-b979-44d1-a7d1-19dd30eee7a4 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:03:15.496522 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-735acb82-74e3-4378-adb6-1eca504ecf11 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:15.500068 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-735acb82-74e3-4378-adb6-1eca504ecf11 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] [instance: 4e25180a-b979-44d1-a7d1-19dd30eee7a4] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:03:15.511191 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-735acb82-74e3-4378-adb6-1eca504ecf11 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:15.525401 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-735acb82-74e3-4378-adb6-1eca504ecf11 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:15.528426 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-735acb82-74e3-4378-adb6-1eca504ecf11 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:15.529462 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-3dba2a21-67a4-40f6-ae0e-225c5ff82eba tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12ca200f5b7468dac6b0164faa0c171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17461d862f104a3284ffa025efb619e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:15.533555 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-735acb82-74e3-4378-adb6-1eca504ecf11 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:15.535566 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-735acb82-74e3-4378-adb6-1eca504ecf11 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:15.538263 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-735acb82-74e3-4378-adb6-1eca504ecf11 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:15.544281 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-3dba2a21-67a4-40f6-ae0e-225c5ff82eba tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] 10.222.0.60 "GET /compute/v2.1/servers/d9ab57a3-b59b-4a19-99cc-d8f8383d10a8" status: 200 len: 1220 microversion: 2.1 time: 0.271633 Sep 14 09:03:15.548039 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1658/3368] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:03:15 2022] GET /compute/v2.1/servers/d9ab57a3-b59b-4a19-99cc-d8f8383d10a8 => generated 1220 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:03:15.614907 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:03:15.688480 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-7675e15c-25fb-4ba2-b237-38effda60f69 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:15.689473 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-7675e15c-25fb-4ba2-b237-38effda60f69 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: 56742f27-4436-4fc3-b7a5-9d337395b7d3] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:03:15.706302 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7675e15c-25fb-4ba2-b237-38effda60f69 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:15.709107 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7675e15c-25fb-4ba2-b237-38effda60f69 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:15.709934 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7675e15c-25fb-4ba2-b237-38effda60f69 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:15.713275 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7675e15c-25fb-4ba2-b237-38effda60f69 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:15.721023 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7675e15c-25fb-4ba2-b237-38effda60f69 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:15.722769 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7675e15c-25fb-4ba2-b237-38effda60f69 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:16.264867 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-7675e15c-25fb-4ba2-b237-38effda60f69 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:16.273145 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-7675e15c-25fb-4ba2-b237-38effda60f69 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/56742f27-4436-4fc3-b7a5-9d337395b7d3" status: 200 len: 1511 microversion: 2.1 time: 0.588794 Sep 14 09:03:16.282843 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1659/3369] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:03:15 2022] GET /compute/v2.1/servers/56742f27-4436-4fc3-b7a5-9d337395b7d3 => generated 1511 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:03:16.317099 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f8bf01fd-4ea4-4fb1-9ec3-9a24f6eeb3a9 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Calling method '.version_select at 0x7f7d3ff96430>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:17.113227 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-735acb82-74e3-4378-adb6-1eca504ecf11 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e7ddc7c037439aad2f98277eef199e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e712ce30eb9c4128aa0ec1d425e9ab79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:17.126115 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-735acb82-74e3-4378-adb6-1eca504ecf11 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] 10.222.0.60 "GET /compute/v2.1/servers/4e25180a-b979-44d1-a7d1-19dd30eee7a4" status: 200 len: 1518 microversion: 2.1 time: 1.638013 Sep 14 09:03:17.128432 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1711/3370] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:03:15 2022] GET /compute/v2.1/servers/4e25180a-b979-44d1-a7d1-19dd30eee7a4 => generated 1518 bytes in 1641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:03:17.133337 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1403da2c-9065-461f-9833-c977632c5391 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:17.134247 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-1403da2c-9065-461f-9833-c977632c5391 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] [instance: 0eb40c80-c056-4096-a586-7e957a63f7cf] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:03:17.142154 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1403da2c-9065-461f-9833-c977632c5391 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:17.143046 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1403da2c-9065-461f-9833-c977632c5391 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:17.143705 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1403da2c-9065-461f-9833-c977632c5391 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:17.144663 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1403da2c-9065-461f-9833-c977632c5391 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:17.145338 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1403da2c-9065-461f-9833-c977632c5391 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:17.145979 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1403da2c-9065-461f-9833-c977632c5391 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:17.414716 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-1403da2c-9065-461f-9833-c977632c5391 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:17.430886 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-1403da2c-9065-461f-9833-c977632c5391 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:17.437705 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-1403da2c-9065-461f-9833-c977632c5391 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:17.459005 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-1403da2c-9065-461f-9833-c977632c5391 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] 10.222.0.60 "GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf" status: 200 len: 1553 microversion: 2.91 time: 0.329175 Sep 14 09:03:17.470741 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1712/3371] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:03:17 2022] GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf => generated 1553 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:03:17.616597 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d079df58-2d13-4d7f-b93f-dbf90ae25205 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-413070907", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "networks": "none"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:03:23.117315 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=10 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:03:23.646393 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=6 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:03:24.193120 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=4 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:03:24.612940 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=8 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:03:25.705292 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=18 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:03:26.283133 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=76 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:03:27.421233 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=8 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:03:27.639961 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:03:32.696013 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f8bf01fd-4ea4-4fb1-9ec3-9a24f6eeb3a9 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] 10.222.0.60 "GET /compute/v2.1/images/00fba841-876f-4e1c-a591-d7bb4cbf6263" status: 200 len: 1435 microversion: 2.1 time: 16.411822 Sep 14 09:03:32.699019 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1660/3372] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:03:16 2022] GET /compute/v2.1/images/00fba841-876f-4e1c-a591-d7bb4cbf6263 => generated 1435 bytes in 16414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:03:32.709180 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a8beb914-a829-4d1a-87b8-306535ae3c87 tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:32.711773 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-a8beb914-a829-4d1a-87b8-306535ae3c87 tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] [instance: d9ab57a3-b59b-4a19-99cc-d8f8383d10a8] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:03:32.722227 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-d079df58-2d13-4d7f-b93f-dbf90ae25205 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Flavor limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:03:32.722780 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-d079df58-2d13-4d7f-b93f-dbf90ae25205 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Image limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:03:32.723148 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-d079df58-2d13-4d7f-b93f-dbf90ae25205 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Flavor pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:03:32.723561 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-d079df58-2d13-4d7f-b93f-dbf90ae25205 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Image pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:03:32.724122 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-d079df58-2d13-4d7f-b93f-dbf90ae25205 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:03:32.734515 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a8beb914-a829-4d1a-87b8-306535ae3c87 tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:32.735459 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a8beb914-a829-4d1a-87b8-306535ae3c87 tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:32.737808 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a8beb914-a829-4d1a-87b8-306535ae3c87 tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:32.745490 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a8beb914-a829-4d1a-87b8-306535ae3c87 tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:32.747013 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a8beb914-a829-4d1a-87b8-306535ae3c87 tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:32.748338 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a8beb914-a829-4d1a-87b8-306535ae3c87 tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:32.766010 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d079df58-2d13-4d7f-b93f-dbf90ae25205 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:32.768981 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d079df58-2d13-4d7f-b93f-dbf90ae25205 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:32.769783 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d079df58-2d13-4d7f-b93f-dbf90ae25205 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:32.770796 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d079df58-2d13-4d7f-b93f-dbf90ae25205 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:32.772790 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d079df58-2d13-4d7f-b93f-dbf90ae25205 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:32.773452 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d079df58-2d13-4d7f-b93f-dbf90ae25205 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:32.829944 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-d079df58-2d13-4d7f-b93f-dbf90ae25205 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Getting quotas for project 730a90781147416fa5db6b8922209058. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:03:32.841256 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-d079df58-2d13-4d7f-b93f-dbf90ae25205 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Getting quotas for user 84afbf1d30574a7aa1186a481687c50c and project 730a90781147416fa5db6b8922209058. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:03:32.857333 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-d079df58-2d13-4d7f-b93f-dbf90ae25205 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Going to run 1 instances... {{(pid=128758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:03:32.860183 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-d079df58-2d13-4d7f-b93f-dbf90ae25205 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] [instance: 900c4e61-76fe-472f-bba7-0c83895f62cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:03:32.982668 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-d079df58-2d13-4d7f-b93f-dbf90ae25205 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 15.503325 Sep 14 09:03:32.991124 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1713/3373] 10.222.0.60 () {62 vars in 1188 bytes} [Wed Sep 14 09:03:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 15513 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 14 09:03:32.999023 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-607dc3a6-4fc9-4717-b567-69706b9cfcbb tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:32.999896 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-607dc3a6-4fc9-4717-b567-69706b9cfcbb tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: 56742f27-4436-4fc3-b7a5-9d337395b7d3] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:03:33.012335 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-607dc3a6-4fc9-4717-b567-69706b9cfcbb tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:33.014417 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-607dc3a6-4fc9-4717-b567-69706b9cfcbb tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:33.016430 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-607dc3a6-4fc9-4717-b567-69706b9cfcbb tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:33.017515 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-607dc3a6-4fc9-4717-b567-69706b9cfcbb tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:33.019314 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-607dc3a6-4fc9-4717-b567-69706b9cfcbb tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:33.020442 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-607dc3a6-4fc9-4717-b567-69706b9cfcbb tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:33.158959 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-a8beb914-a829-4d1a-87b8-306535ae3c87 tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12ca200f5b7468dac6b0164faa0c171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17461d862f104a3284ffa025efb619e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:33.167421 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a8beb914-a829-4d1a-87b8-306535ae3c87 tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] 10.222.0.60 "GET /compute/v2.1/servers/d9ab57a3-b59b-4a19-99cc-d8f8383d10a8" status: 200 len: 1316 microversion: 2.1 time: 0.467106 Sep 14 09:03:33.176471 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1661/3374] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:03:32 2022] GET /compute/v2.1/servers/d9ab57a3-b59b-4a19-99cc-d8f8383d10a8 => generated 1316 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:03:33.187787 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-1dc13a2e-f779-4f68-be9f-10d4ae20008b tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:33.203459 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-1dc13a2e-f779-4f68-be9f-10d4ae20008b tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] [instance: 4e25180a-b979-44d1-a7d1-19dd30eee7a4] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:03:33.210508 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1dc13a2e-f779-4f68-be9f-10d4ae20008b tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:33.211347 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1dc13a2e-f779-4f68-be9f-10d4ae20008b tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:33.211970 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1dc13a2e-f779-4f68-be9f-10d4ae20008b tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:33.212849 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1dc13a2e-f779-4f68-be9f-10d4ae20008b tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:33.214685 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1dc13a2e-f779-4f68-be9f-10d4ae20008b tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:33.215324 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1dc13a2e-f779-4f68-be9f-10d4ae20008b tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:33.236229 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-1dc13a2e-f779-4f68-be9f-10d4ae20008b tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] HTTP exception thrown: Instance 4e25180a-b979-44d1-a7d1-19dd30eee7a4 could not be found. Sep 14 09:03:33.239141 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-1dc13a2e-f779-4f68-be9f-10d4ae20008b tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Request method failure captured: Sep 14 09:03:33.239141 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/4e25180a-b979-44d1-a7d1-19dd30eee7a4 HTTP/1.1 Sep 14 09:03:33.239141 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:03:33.239141 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:03:33.239141 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:03:33.239141 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:03:33.239141 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:03:33.239141 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:03:33.239141 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:03:33.239141 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:03:33.239141 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZh0fLmNlp5hM0yWlDvW36KfrrIHpOuRZfGcuRs23sCF5zFlyoDT5R6s-UM4kUmBphXR7aDKVnqY4sfmazOIoQz_DvkvU2elb7vE0xZ33w8smpF6vXAriaEIuoW1oy3enxLQN5ygpfF9oHqNJqQQfVkLPc7KoLj47ZAjltTE-E5bVuE Sep 14 09:03:33.239141 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:03:33.239141 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:03:33.239141 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:03:33.239141 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:03:33.239141 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:03:33.239141 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:03:33.239141 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: e712ce30eb9c4128aa0ec1d425e9ab79 Sep 14 09:03:33.239141 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ListServerFiltersTestJSON-1717892064 Sep 14 09:03:33.239141 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:03:33.239141 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:03:33.239141 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e712ce30eb9c4128aa0ec1d425e9ab79"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e712ce30eb9c4128aa0ec1d425e9ab79"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e712ce30eb9c4128aa0ec1d425e9ab79"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e712ce30eb9c4128aa0ec1d425e9ab79"}]}] Sep 14 09:03:33.239141 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ListServerFiltersTestJSON-1717892064 Sep 14 09:03:33.239141 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: e712ce30eb9c4128aa0ec1d425e9ab79 Sep 14 09:03:33.239141 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1717892064 Sep 14 09:03:33.239141 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ListServerFiltersTestJSON-1717892064-project Sep 14 09:03:33.239141 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:03:33.239141 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:03:33.239141 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: d6e7ddc7c037439aad2f98277eef199e Sep 14 09:03:33.239141 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ListServerFiltersTestJSON-1717892064-project Sep 14 09:03:33.239141 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:03:33.239141 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance 4e25180a-b979-44d1-a7d1-19dd30eee7a4 could not be found. Sep 14 09:03:33.239141 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '4e25180a-b979-44d1-a7d1-19dd30eee7a4'} Sep 14 09:03:33.239141 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:03:33.239141 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:03:33.239141 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:03:33.239141 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:03:33.239141 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:03:33.239141 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:03:33.239141 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:03:33.239141 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:03:33.239141 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:03:33.239141 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:03:33.239141 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e25180a-b979-44d1-a7d1-19dd30eee7a4 could not be found. Sep 14 09:03:33.239141 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:03:33.239141 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:03:33.239141 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:03:33.239141 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:03:33.239141 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:03:33.239141 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:03:33.239141 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:03:33.239141 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:03:33.239141 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:03:33.239141 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:03:33.239141 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:03:33.239141 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:03:33.239141 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:03:33.239141 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:03:33.239141 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:03:33.239141 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:03:33.239141 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e25180a-b979-44d1-a7d1-19dd30eee7a4 could not be found. Sep 14 09:03:33.239141 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:03:33.239141 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:03:33.239141 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:03:33.244135 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:03:33.244135 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:03:33.244135 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:03:33.244135 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:03:33.244135 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:03:33.244135 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e25180a-b979-44d1-a7d1-19dd30eee7a4 could not be found. Sep 14 09:03:33.244135 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:03:33.247309 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-1dc13a2e-f779-4f68-be9f-10d4ae20008b tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Returning 404 to user: Instance 4e25180a-b979-44d1-a7d1-19dd30eee7a4 could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:03:33.249230 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-1dc13a2e-f779-4f68-be9f-10d4ae20008b tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] 10.222.0.60 "GET /compute/v2.1/servers/4e25180a-b979-44d1-a7d1-19dd30eee7a4" status: 404 len: 111 microversion: 2.1 time: 0.068895 Sep 14 09:03:33.250294 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1662/3375] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:03:33 2022] GET /compute/v2.1/servers/4e25180a-b979-44d1-a7d1-19dd30eee7a4 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:03:33.255181 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-697ee7cc-e328-494b-acd2-aff908cc2a09 req-bb65adc7-6a00-4eff-81ed-d00dff16652f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e25180a-b979-44d1-a7d1-19dd30eee7a4", "name": "network-vif-deleted", "tag": "b2d31d14-f64b-4833-b560-3b60af91131f"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:03:33.267319 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-697ee7cc-e328-494b-acd2-aff908cc2a09 req-bb65adc7-6a00-4eff-81ed-d00dff16652f service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:33.268087 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-697ee7cc-e328-494b-acd2-aff908cc2a09 req-bb65adc7-6a00-4eff-81ed-d00dff16652f service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:33.268692 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-697ee7cc-e328-494b-acd2-aff908cc2a09 req-bb65adc7-6a00-4eff-81ed-d00dff16652f service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:33.282127 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-697ee7cc-e328-494b-acd2-aff908cc2a09 req-bb65adc7-6a00-4eff-81ed-d00dff16652f service nova] Creating event network-vif-deleted:b2d31d14-f64b-4833-b560-3b60af91131f for instance 4e25180a-b979-44d1-a7d1-19dd30eee7a4 on n-h1-836830-18 Sep 14 09:03:33.288529 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-697ee7cc-e328-494b-acd2-aff908cc2a09 req-bb65adc7-6a00-4eff-81ed-d00dff16652f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036779 Sep 14 09:03:33.289688 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1663/3376] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:03:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:03:33.295959 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-4c138aeb-d5a9-4189-9ab2-d9e043fecfe8 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:33.297036 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-4c138aeb-d5a9-4189-9ab2-d9e043fecfe8 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] [instance: 0eb40c80-c056-4096-a586-7e957a63f7cf] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:03:33.304801 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4c138aeb-d5a9-4189-9ab2-d9e043fecfe8 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:33.305615 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4c138aeb-d5a9-4189-9ab2-d9e043fecfe8 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:33.306233 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4c138aeb-d5a9-4189-9ab2-d9e043fecfe8 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:33.307800 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4c138aeb-d5a9-4189-9ab2-d9e043fecfe8 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:33.308467 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4c138aeb-d5a9-4189-9ab2-d9e043fecfe8 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:33.309099 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4c138aeb-d5a9-4189-9ab2-d9e043fecfe8 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:33.429519 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-607dc3a6-4fc9-4717-b567-69706b9cfcbb tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:33.445913 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-607dc3a6-4fc9-4717-b567-69706b9cfcbb tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/56742f27-4436-4fc3-b7a5-9d337395b7d3" status: 200 len: 1488 microversion: 2.1 time: 0.451081 Sep 14 09:03:33.446499 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1714/3377] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:03:32 2022] GET /compute/v2.1/servers/56742f27-4436-4fc3-b7a5-9d337395b7d3 => generated 1488 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:03:33.452046 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-6052d536-d2bc-431b-bd6a-6de2f90b736c req-4c036c29-dd91-471d-9b28-84b36baf279e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9ab57a3-b59b-4a19-99cc-d8f8383d10a8", "tag": "3d1b81be-15c8-448c-a538-83a8d2630c75"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:03:33.462454 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-6052d536-d2bc-431b-bd6a-6de2f90b736c req-4c036c29-dd91-471d-9b28-84b36baf279e service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:33.463518 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-6052d536-d2bc-431b-bd6a-6de2f90b736c req-4c036c29-dd91-471d-9b28-84b36baf279e service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:33.464127 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-6052d536-d2bc-431b-bd6a-6de2f90b736c req-4c036c29-dd91-471d-9b28-84b36baf279e service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:33.481160 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-6052d536-d2bc-431b-bd6a-6de2f90b736c req-4c036c29-dd91-471d-9b28-84b36baf279e service nova] Creating event network-changed:3d1b81be-15c8-448c-a538-83a8d2630c75 for instance d9ab57a3-b59b-4a19-99cc-d8f8383d10a8 on n-h2-836830-18 Sep 14 09:03:33.486697 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-6052d536-d2bc-431b-bd6a-6de2f90b736c req-4c036c29-dd91-471d-9b28-84b36baf279e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038776 Sep 14 09:03:33.487889 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1715/3378] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:03:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:03:33.494116 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-66505c89-fd67-455b-ade6-42aff78715ac req-5612f8af-9bdf-406c-8d66-cbbfdc0471a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9ab57a3-b59b-4a19-99cc-d8f8383d10a8", "name": "network-vif-plugged", "status": "completed", "tag": "3d1b81be-15c8-448c-a538-83a8d2630c75"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:03:33.524620 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-4c138aeb-d5a9-4189-9ab2-d9e043fecfe8 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:33.529689 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-66505c89-fd67-455b-ade6-42aff78715ac req-5612f8af-9bdf-406c-8d66-cbbfdc0471a1 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:33.554860 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-4c138aeb-d5a9-4189-9ab2-d9e043fecfe8 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:33.555593 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-66505c89-fd67-455b-ade6-42aff78715ac req-5612f8af-9bdf-406c-8d66-cbbfdc0471a1 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:33.556114 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-66505c89-fd67-455b-ade6-42aff78715ac req-5612f8af-9bdf-406c-8d66-cbbfdc0471a1 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:33.575824 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-4c138aeb-d5a9-4189-9ab2-d9e043fecfe8 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:33.581839 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-4c138aeb-d5a9-4189-9ab2-d9e043fecfe8 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] 10.222.0.60 "GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf" status: 200 len: 1553 microversion: 2.91 time: 0.290458 Sep 14 09:03:33.582449 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1664/3379] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:03:33 2022] GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf => generated 1553 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:03:33.597923 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-66505c89-fd67-455b-ade6-42aff78715ac req-5612f8af-9bdf-406c-8d66-cbbfdc0471a1 service nova] Creating event network-vif-plugged:3d1b81be-15c8-448c-a538-83a8d2630c75 for instance d9ab57a3-b59b-4a19-99cc-d8f8383d10a8 on n-h2-836830-18 Sep 14 09:03:33.607776 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-30e43a40-565b-46d8-a46c-ed215dab4e91 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Calling method '.version_select at 0x7f7d3fbe4f70>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:33.613219 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-66505c89-fd67-455b-ade6-42aff78715ac req-5612f8af-9bdf-406c-8d66-cbbfdc0471a1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123725 Sep 14 09:03:33.614135 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1716/3380] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:03:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:03:33.619853 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-2d4df95f-b852-4a5e-87c4-cafff5c003eb tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:33.620641 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-2d4df95f-b852-4a5e-87c4-cafff5c003eb tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] [instance: 900c4e61-76fe-472f-bba7-0c83895f62cf] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:03:33.686771 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-30e43a40-565b-46d8-a46c-ed215dab4e91 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] 10.222.0.60 "GET /compute/v2.1/images/00fba841-876f-4e1c-a591-d7bb4cbf6263" status: 200 len: 1435 microversion: 2.1 time: 0.090004 Sep 14 09:03:33.687553 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1665/3381] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:03:33 2022] GET /compute/v2.1/images/00fba841-876f-4e1c-a591-d7bb4cbf6263 => generated 1435 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:03:33.703385 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-55e5f869-d2f9-4cce-b5dd-e2ea974f1d20 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:33.705078 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-55e5f869-d2f9-4cce-b5dd-e2ea974f1d20 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] [instance: 36253bc6-1737-4654-a878-c1eaeb797c8e] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:03:33.716380 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-55e5f869-d2f9-4cce-b5dd-e2ea974f1d20 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:33.717202 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-55e5f869-d2f9-4cce-b5dd-e2ea974f1d20 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:33.718242 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-55e5f869-d2f9-4cce-b5dd-e2ea974f1d20 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:33.719203 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-55e5f869-d2f9-4cce-b5dd-e2ea974f1d20 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:33.719848 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-55e5f869-d2f9-4cce-b5dd-e2ea974f1d20 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:33.720828 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-55e5f869-d2f9-4cce-b5dd-e2ea974f1d20 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:33.782528 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-55e5f869-d2f9-4cce-b5dd-e2ea974f1d20 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] [instance: 36253bc6-1737-4654-a878-c1eaeb797c8e] Going to try to terminate instance {{(pid=128759) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:03:33.820020 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-2d4df95f-b852-4a5e-87c4-cafff5c003eb tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84afbf1d30574a7aa1186a481687c50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a90781147416fa5db6b8922209058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:33.830578 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-2d4df95f-b852-4a5e-87c4-cafff5c003eb tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84afbf1d30574a7aa1186a481687c50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a90781147416fa5db6b8922209058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:33.834362 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-2d4df95f-b852-4a5e-87c4-cafff5c003eb tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84afbf1d30574a7aa1186a481687c50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a90781147416fa5db6b8922209058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:33.839001 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-2d4df95f-b852-4a5e-87c4-cafff5c003eb tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] 10.222.0.60 "GET /compute/v2.1/servers/900c4e61-76fe-472f-bba7-0c83895f62cf" status: 200 len: 1277 microversion: 2.54 time: 0.223646 Sep 14 09:03:33.839836 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1717/3382] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:03:33 2022] GET /compute/v2.1/servers/900c4e61-76fe-472f-bba7-0c83895f62cf => generated 1277 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:03:33.854206 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-f206bff0-30b6-4da2-91c4-f14bfbddceb0 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:33.855309 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-f206bff0-30b6-4da2-91c4-f14bfbddceb0 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: 56742f27-4436-4fc3-b7a5-9d337395b7d3] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:03:33.874886 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f206bff0-30b6-4da2-91c4-f14bfbddceb0 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:33.875927 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f206bff0-30b6-4da2-91c4-f14bfbddceb0 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:33.876774 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f206bff0-30b6-4da2-91c4-f14bfbddceb0 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:33.877733 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f206bff0-30b6-4da2-91c4-f14bfbddceb0 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:33.878383 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f206bff0-30b6-4da2-91c4-f14bfbddceb0 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:33.879019 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f206bff0-30b6-4da2-91c4-f14bfbddceb0 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:33.956148 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-f206bff0-30b6-4da2-91c4-f14bfbddceb0 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: 56742f27-4436-4fc3-b7a5-9d337395b7d3] Going to try to terminate instance {{(pid=128758) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:03:33.977967 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-55e5f869-d2f9-4cce-b5dd-e2ea974f1d20 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] 10.222.0.60 "DELETE /compute/v2.1/servers/36253bc6-1737-4654-a878-c1eaeb797c8e" status: 204 len: 0 microversion: 2.1 time: 0.287229 Sep 14 09:03:33.984346 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1666/3383] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:03:33 2022] DELETE /compute/v2.1/servers/36253bc6-1737-4654-a878-c1eaeb797c8e => generated 0 bytes in 291 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:03:33.992539 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-bffe0a1f-5c6f-43ad-b486-514d0485be47 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:33.993594 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-bffe0a1f-5c6f-43ad-b486-514d0485be47 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] [instance: 7558efb0-7f2d-42d5-9b6d-e442008b1c88] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:03:34.001531 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bffe0a1f-5c6f-43ad-b486-514d0485be47 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:34.002261 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bffe0a1f-5c6f-43ad-b486-514d0485be47 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:34.003169 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bffe0a1f-5c6f-43ad-b486-514d0485be47 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:34.004179 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bffe0a1f-5c6f-43ad-b486-514d0485be47 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:34.004795 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bffe0a1f-5c6f-43ad-b486-514d0485be47 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:34.005378 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bffe0a1f-5c6f-43ad-b486-514d0485be47 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:34.148254 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-f206bff0-30b6-4da2-91c4-f14bfbddceb0 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "DELETE /compute/v2.1/servers/56742f27-4436-4fc3-b7a5-9d337395b7d3" status: 204 len: 0 microversion: 2.1 time: 0.304854 Sep 14 09:03:34.152639 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1718/3384] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:03:33 2022] DELETE /compute/v2.1/servers/56742f27-4436-4fc3-b7a5-9d337395b7d3 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:03:34.163366 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-6b3cf053-c394-4bae-a13d-1d535daf20fa tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:34.164437 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-6b3cf053-c394-4bae-a13d-1d535daf20fa tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] [instance: 36253bc6-1737-4654-a878-c1eaeb797c8e] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:03:34.177254 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6b3cf053-c394-4bae-a13d-1d535daf20fa tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:34.177875 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6b3cf053-c394-4bae-a13d-1d535daf20fa tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:34.179385 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6b3cf053-c394-4bae-a13d-1d535daf20fa tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:34.180929 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6b3cf053-c394-4bae-a13d-1d535daf20fa tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:34.182603 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6b3cf053-c394-4bae-a13d-1d535daf20fa tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:34.183874 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6b3cf053-c394-4bae-a13d-1d535daf20fa tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:34.515742 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-bffe0a1f-5c6f-43ad-b486-514d0485be47 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b847ccce0654f2fa9df8367320a3218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9051111ca00649c591b6485d58bbc265', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:34.528024 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-bffe0a1f-5c6f-43ad-b486-514d0485be47 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] 10.222.0.60 "GET /compute/v2.1/servers/7558efb0-7f2d-42d5-9b6d-e442008b1c88" status: 200 len: 1467 microversion: 2.1 time: 0.539212 Sep 14 09:03:34.545626 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1667/3385] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:03:33 2022] GET /compute/v2.1/servers/7558efb0-7f2d-42d5-9b6d-e442008b1c88 => generated 1467 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:03:34.545626 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-6e0cc61c-6146-47b7-b30d-a2eeabfd1eb2 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:34.545626 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-6e0cc61c-6146-47b7-b30d-a2eeabfd1eb2 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: 56742f27-4436-4fc3-b7a5-9d337395b7d3] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:03:34.553417 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6e0cc61c-6146-47b7-b30d-a2eeabfd1eb2 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:34.555447 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6e0cc61c-6146-47b7-b30d-a2eeabfd1eb2 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:34.555906 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6e0cc61c-6146-47b7-b30d-a2eeabfd1eb2 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:34.556640 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6e0cc61c-6146-47b7-b30d-a2eeabfd1eb2 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:34.557132 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6e0cc61c-6146-47b7-b30d-a2eeabfd1eb2 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:34.557556 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6e0cc61c-6146-47b7-b30d-a2eeabfd1eb2 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:34.595138 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-6b3cf053-c394-4bae-a13d-1d535daf20fa tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e7ddc7c037439aad2f98277eef199e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e712ce30eb9c4128aa0ec1d425e9ab79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:34.608297 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-6b3cf053-c394-4bae-a13d-1d535daf20fa tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] 10.222.0.60 "GET /compute/v2.1/servers/36253bc6-1737-4654-a878-c1eaeb797c8e" status: 200 len: 1517 microversion: 2.1 time: 0.457610 Sep 14 09:03:34.609104 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1719/3386] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:03:34 2022] GET /compute/v2.1/servers/36253bc6-1737-4654-a878-c1eaeb797c8e => generated 1517 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:03:34.642896 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-5369f095-7d54-49c8-89f7-1135ed212738 tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:34.644465 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-5369f095-7d54-49c8-89f7-1135ed212738 tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] [instance: d9ab57a3-b59b-4a19-99cc-d8f8383d10a8] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:03:34.651830 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5369f095-7d54-49c8-89f7-1135ed212738 tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:34.652617 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5369f095-7d54-49c8-89f7-1135ed212738 tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:34.653286 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5369f095-7d54-49c8-89f7-1135ed212738 tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:34.654829 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5369f095-7d54-49c8-89f7-1135ed212738 tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:34.655537 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5369f095-7d54-49c8-89f7-1135ed212738 tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:34.656223 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5369f095-7d54-49c8-89f7-1135ed212738 tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:34.901472 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-6e0cc61c-6146-47b7-b30d-a2eeabfd1eb2 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:34.913186 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-6e0cc61c-6146-47b7-b30d-a2eeabfd1eb2 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/56742f27-4436-4fc3-b7a5-9d337395b7d3" status: 200 len: 1494 microversion: 2.1 time: 0.382966 Sep 14 09:03:34.914323 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1668/3387] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:03:34 2022] GET /compute/v2.1/servers/56742f27-4436-4fc3-b7a5-9d337395b7d3 => generated 1494 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:03:34.943947 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3ed0ac31-e889-4ac3-a0ac-d78036b238d6 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Calling method '.version_select at 0x7f7d3ffb7af0>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:34.969825 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-5369f095-7d54-49c8-89f7-1135ed212738 tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12ca200f5b7468dac6b0164faa0c171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17461d862f104a3284ffa025efb619e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:34.981868 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-5369f095-7d54-49c8-89f7-1135ed212738 tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] 10.222.0.60 "GET /compute/v2.1/servers/d9ab57a3-b59b-4a19-99cc-d8f8383d10a8" status: 200 len: 1316 microversion: 2.1 time: 0.356858 Sep 14 09:03:34.984669 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1720/3388] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:03:34 2022] GET /compute/v2.1/servers/d9ab57a3-b59b-4a19-99cc-d8f8383d10a8 => generated 1316 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:03:34.992626 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a7f43708-710c-4e99-a234-5b3e9675b72d tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:34.993405 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-a7f43708-710c-4e99-a234-5b3e9675b72d tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] [instance: 0eb40c80-c056-4096-a586-7e957a63f7cf] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:03:35.005804 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a7f43708-710c-4e99-a234-5b3e9675b72d tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:35.006382 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a7f43708-710c-4e99-a234-5b3e9675b72d tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:35.006835 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a7f43708-710c-4e99-a234-5b3e9675b72d tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:35.007591 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a7f43708-710c-4e99-a234-5b3e9675b72d tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:35.008049 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a7f43708-710c-4e99-a234-5b3e9675b72d tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:35.008663 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a7f43708-710c-4e99-a234-5b3e9675b72d tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:35.098706 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-a7f43708-710c-4e99-a234-5b3e9675b72d tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:35.115210 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-a7f43708-710c-4e99-a234-5b3e9675b72d tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:35.116956 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-a7f43708-710c-4e99-a234-5b3e9675b72d tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:35.159393 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-a7f43708-710c-4e99-a234-5b3e9675b72d tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] 10.222.0.60 "GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf" status: 200 len: 1553 microversion: 2.91 time: 0.170614 Sep 14 09:03:35.161073 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1721/3389] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:03:34 2022] GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf => generated 1553 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:03:35.171417 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c85ff5c8-d00e-4181-947a-5c352ac4ea50 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:35.172451 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-c85ff5c8-d00e-4181-947a-5c352ac4ea50 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] [instance: 900c4e61-76fe-472f-bba7-0c83895f62cf] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:03:35.197270 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c85ff5c8-d00e-4181-947a-5c352ac4ea50 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:35.197701 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c85ff5c8-d00e-4181-947a-5c352ac4ea50 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:35.198161 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c85ff5c8-d00e-4181-947a-5c352ac4ea50 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:35.198887 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c85ff5c8-d00e-4181-947a-5c352ac4ea50 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:35.199372 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c85ff5c8-d00e-4181-947a-5c352ac4ea50 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:35.207578 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c85ff5c8-d00e-4181-947a-5c352ac4ea50 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:35.366607 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-c85ff5c8-d00e-4181-947a-5c352ac4ea50 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84afbf1d30574a7aa1186a481687c50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a90781147416fa5db6b8922209058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:35.383310 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-c85ff5c8-d00e-4181-947a-5c352ac4ea50 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84afbf1d30574a7aa1186a481687c50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a90781147416fa5db6b8922209058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:35.389626 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-c85ff5c8-d00e-4181-947a-5c352ac4ea50 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84afbf1d30574a7aa1186a481687c50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a90781147416fa5db6b8922209058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:35.390770 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-c85ff5c8-d00e-4181-947a-5c352ac4ea50 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] 10.222.0.60 "GET /compute/v2.1/servers/900c4e61-76fe-472f-bba7-0c83895f62cf" status: 200 len: 1281 microversion: 2.54 time: 0.227708 Sep 14 09:03:35.391828 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1722/3390] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:03:35 2022] GET /compute/v2.1/servers/900c4e61-76fe-472f-bba7-0c83895f62cf => generated 1281 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:03:35.632465 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-f8f31e09-b6a2-46d4-bb62-99645371e7a2 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:35.633179 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-f8f31e09-b6a2-46d4-bb62-99645371e7a2 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] [instance: 36253bc6-1737-4654-a878-c1eaeb797c8e] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:03:35.640591 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f8f31e09-b6a2-46d4-bb62-99645371e7a2 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:35.641212 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f8f31e09-b6a2-46d4-bb62-99645371e7a2 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:35.641774 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f8f31e09-b6a2-46d4-bb62-99645371e7a2 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:35.643064 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f8f31e09-b6a2-46d4-bb62-99645371e7a2 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:35.644412 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f8f31e09-b6a2-46d4-bb62-99645371e7a2 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:35.645091 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f8f31e09-b6a2-46d4-bb62-99645371e7a2 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:35.685900 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-3ed0ac31-e889-4ac3-a0ac-d78036b238d6 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] 10.222.0.60 "DELETE /compute/v2.1/images/00fba841-876f-4e1c-a591-d7bb4cbf6263" status: 204 len: 0 microversion: 2.1 time: 0.754961 Sep 14 09:03:35.686482 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1669/3391] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:03:34 2022] DELETE /compute/v2.1/images/00fba841-876f-4e1c-a591-d7bb4cbf6263 => generated 0 bytes in 757 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:03:35.696561 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-09441c33-68bd-44da-bd17-f7d269e67473 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Calling method '.version_select at 0x7f7d3feaf550>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:35.744994 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-09441c33-68bd-44da-bd17-f7d269e67473 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] HTTP exception thrown: Image not found. Sep 14 09:03:35.747767 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-09441c33-68bd-44da-bd17-f7d269e67473 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Request method failure captured: Sep 14 09:03:35.747767 n-d-836830-18 devstack@n-api.service[128759]: request: DELETE /compute/v2.1/images/165c831f-0a00-4eac-be4f-8a4c39096827 HTTP/1.1 Sep 14 09:03:35.747767 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:03:35.747767 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:03:35.747767 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:03:35.747767 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:03:35.747767 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:03:35.747767 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:03:35.747767 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:03:35.747767 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:03:35.747767 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZiI-AkucMBaroluh1OyKtWIJyIdpyMdoktsRW_FiZsmRsli3WLei89jIV561123NfLfmQ7r3NcWskpXIOkKdUGeV-Df7F1xHrD8jZvuF1pJg1uUAwA0q4Gbsk7G-GLeYjCbSLXbRcD9cwaMyw349Js3YHSxw5JqRoOVRMDSSC2mNqU Sep 14 09:03:35.747767 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:03:35.747767 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:03:35.747767 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:03:35.747767 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:03:35.747767 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:03:35.747767 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:03:35.747767 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 9051111ca00649c591b6485d58bbc265 Sep 14 09:03:35.747767 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ImagesOneServerTestJSON-148298783 Sep 14 09:03:35.747767 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:03:35.747767 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:03:35.747767 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/9051111ca00649c591b6485d58bbc265"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_9051111ca00649c591b6485d58bbc265"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9051111ca00649c591b6485d58bbc265"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9051111ca00649c591b6485d58bbc265"}]}] Sep 14 09:03:35.747767 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ImagesOneServerTestJSON-148298783 Sep 14 09:03:35.747767 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 9051111ca00649c591b6485d58bbc265 Sep 14 09:03:35.747767 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-148298783 Sep 14 09:03:35.747767 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ImagesOneServerTestJSON-148298783-project Sep 14 09:03:35.747767 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:03:35.747767 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:03:35.747767 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 2b847ccce0654f2fa9df8367320a3218 Sep 14 09:03:35.747767 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ImagesOneServerTestJSON-148298783-project Sep 14 09:03:35.747767 n-d-836830-18 devstack@n-api.service[128759]: method: Sep 14 09:03:35.747767 n-d-836830-18 devstack@n-api.service[128759]: exception: Image not found. Sep 14 09:03:35.747767 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '165c831f-0a00-4eac-be4f-8a4c39096827'} Sep 14 09:03:35.747767 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:03:35.747767 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:03:35.747767 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 14 09:03:35.747767 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 14 09:03:35.747767 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 14 09:03:35.747767 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 14 09:03:35.747767 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 14 09:03:35.747767 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 14 09:03:35.747767 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 14 09:03:35.747767 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 14 09:03:35.747767 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 14 09:03:35.747767 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 14 09:03:35.747767 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 14 09:03:35.747767 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 14 09:03:35.747767 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 14 09:03:35.747767 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 14 09:03:35.747767 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 165c831f-0a00-4eac-be4f-8a4c39096827 to delete Sep 14 09:03:35.747767 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:03:35.747767 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:03:35.747767 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:03:35.747767 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:03:35.747767 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 14 09:03:35.747767 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 14 09:03:35.747767 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 14 09:03:35.747767 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 14 09:03:35.747767 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 14 09:03:35.747767 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 14 09:03:35.747767 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 165c831f-0a00-4eac-be4f-8a4c39096827 could not be found. Sep 14 09:03:35.747767 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:03:35.747767 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:03:35.747767 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:03:35.747767 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:03:35.753889 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:03:35.753889 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:03:35.753889 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:03:35.753889 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:03:35.753889 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:03:35.753889 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:03:35.753889 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:03:35.753889 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:03:35.753889 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 14 09:03:35.753889 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 14 09:03:35.753889 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 14 09:03:35.753889 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:03:35.753889 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:03:35.753889 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:03:35.753889 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:03:35.753889 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:03:35.753889 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:03:35.753889 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:03:35.753889 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:03:35.753889 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 14 09:03:35.753889 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:03:35.753889 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-09441c33-68bd-44da-bd17-f7d269e67473 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Returning 404 to user: Image not found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:03:35.753889 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-09441c33-68bd-44da-bd17-f7d269e67473 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] 10.222.0.60 "DELETE /compute/v2.1/images/165c831f-0a00-4eac-be4f-8a4c39096827" status: 404 len: 62 microversion: 2.1 time: 0.056868 Sep 14 09:03:35.753889 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1670/3392] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:03:35 2022] DELETE /compute/v2.1/images/165c831f-0a00-4eac-be4f-8a4c39096827 => generated 62 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 14 09:03:35.761781 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-5f5200df-95b9-429a-a667-bb368c833bf1 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:35.762295 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-5f5200df-95b9-429a-a667-bb368c833bf1 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] [instance: 7558efb0-7f2d-42d5-9b6d-e442008b1c88] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:03:35.774432 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5f5200df-95b9-429a-a667-bb368c833bf1 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:35.774948 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5f5200df-95b9-429a-a667-bb368c833bf1 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:35.776703 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5f5200df-95b9-429a-a667-bb368c833bf1 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:35.778619 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5f5200df-95b9-429a-a667-bb368c833bf1 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:35.779137 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5f5200df-95b9-429a-a667-bb368c833bf1 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:35.779759 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5f5200df-95b9-429a-a667-bb368c833bf1 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:35.818750 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-5f5200df-95b9-429a-a667-bb368c833bf1 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] [instance: 7558efb0-7f2d-42d5-9b6d-e442008b1c88] Going to try to terminate instance {{(pid=128759) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:03:35.927796 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-5f5200df-95b9-429a-a667-bb368c833bf1 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] 10.222.0.60 "DELETE /compute/v2.1/servers/7558efb0-7f2d-42d5-9b6d-e442008b1c88" status: 204 len: 0 microversion: 2.1 time: 0.169086 Sep 14 09:03:35.928507 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1671/3393] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:03:35 2022] DELETE /compute/v2.1/servers/7558efb0-7f2d-42d5-9b6d-e442008b1c88 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:03:35.939367 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b539f2eb-f729-4ecd-9612-16b466e99987 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:35.940200 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b539f2eb-f729-4ecd-9612-16b466e99987 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] [instance: 7558efb0-7f2d-42d5-9b6d-e442008b1c88] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:03:35.946549 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b539f2eb-f729-4ecd-9612-16b466e99987 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:35.947152 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b539f2eb-f729-4ecd-9612-16b466e99987 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:35.948382 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b539f2eb-f729-4ecd-9612-16b466e99987 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:35.949166 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b539f2eb-f729-4ecd-9612-16b466e99987 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:35.949800 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b539f2eb-f729-4ecd-9612-16b466e99987 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:35.950392 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b539f2eb-f729-4ecd-9612-16b466e99987 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:36.076723 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-f8f31e09-b6a2-46d4-bb62-99645371e7a2 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e7ddc7c037439aad2f98277eef199e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e712ce30eb9c4128aa0ec1d425e9ab79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:36.087562 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-f8f31e09-b6a2-46d4-bb62-99645371e7a2 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] 10.222.0.60 "GET /compute/v2.1/servers/36253bc6-1737-4654-a878-c1eaeb797c8e" status: 200 len: 1517 microversion: 2.1 time: 0.459420 Sep 14 09:03:36.089163 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1723/3394] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:03:35 2022] GET /compute/v2.1/servers/36253bc6-1737-4654-a878-c1eaeb797c8e => generated 1517 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:03:36.095703 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-5e3e31b3-2ae1-4a0e-9b13-743141b1d496 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:36.096585 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-5e3e31b3-2ae1-4a0e-9b13-743141b1d496 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: 56742f27-4436-4fc3-b7a5-9d337395b7d3] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:03:36.104664 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5e3e31b3-2ae1-4a0e-9b13-743141b1d496 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:36.105492 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5e3e31b3-2ae1-4a0e-9b13-743141b1d496 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:36.106158 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5e3e31b3-2ae1-4a0e-9b13-743141b1d496 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:36.107157 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5e3e31b3-2ae1-4a0e-9b13-743141b1d496 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:36.107771 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5e3e31b3-2ae1-4a0e-9b13-743141b1d496 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:36.108223 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5e3e31b3-2ae1-4a0e-9b13-743141b1d496 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:36.293048 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b539f2eb-f729-4ecd-9612-16b466e99987 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b847ccce0654f2fa9df8367320a3218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9051111ca00649c591b6485d58bbc265', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:36.301617 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b539f2eb-f729-4ecd-9612-16b466e99987 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] 10.222.0.60 "GET /compute/v2.1/servers/7558efb0-7f2d-42d5-9b6d-e442008b1c88" status: 200 len: 1473 microversion: 2.1 time: 0.368693 Sep 14 09:03:36.302291 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1672/3395] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:03:35 2022] GET /compute/v2.1/servers/7558efb0-7f2d-42d5-9b6d-e442008b1c88 => generated 1473 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:03:36.308564 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-5cba7543-6ed2-4866-827f-ae7e09ccf2ac tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:36.309260 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-5cba7543-6ed2-4866-827f-ae7e09ccf2ac tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] [instance: d9ab57a3-b59b-4a19-99cc-d8f8383d10a8] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:03:36.315830 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5cba7543-6ed2-4866-827f-ae7e09ccf2ac tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:36.316836 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5cba7543-6ed2-4866-827f-ae7e09ccf2ac tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:36.317503 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5cba7543-6ed2-4866-827f-ae7e09ccf2ac tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:36.318460 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5cba7543-6ed2-4866-827f-ae7e09ccf2ac tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:36.319118 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5cba7543-6ed2-4866-827f-ae7e09ccf2ac tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:36.319710 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5cba7543-6ed2-4866-827f-ae7e09ccf2ac tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:36.425034 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-5e3e31b3-2ae1-4a0e-9b13-743141b1d496 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:36.440120 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-5e3e31b3-2ae1-4a0e-9b13-743141b1d496 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/56742f27-4436-4fc3-b7a5-9d337395b7d3" status: 200 len: 1494 microversion: 2.1 time: 0.349575 Sep 14 09:03:36.456272 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1724/3396] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:03:36 2022] GET /compute/v2.1/servers/56742f27-4436-4fc3-b7a5-9d337395b7d3 => generated 1494 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:03:36.465513 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-49fcc258-d068-45de-aa4c-6c5832a41d2c tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:36.466261 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-49fcc258-d068-45de-aa4c-6c5832a41d2c tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] [instance: 0eb40c80-c056-4096-a586-7e957a63f7cf] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:03:36.477427 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-49fcc258-d068-45de-aa4c-6c5832a41d2c tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:36.479411 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-49fcc258-d068-45de-aa4c-6c5832a41d2c tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:36.480098 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-49fcc258-d068-45de-aa4c-6c5832a41d2c tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:36.481598 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-49fcc258-d068-45de-aa4c-6c5832a41d2c tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:36.482451 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-49fcc258-d068-45de-aa4c-6c5832a41d2c tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:36.483111 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-49fcc258-d068-45de-aa4c-6c5832a41d2c tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:36.580551 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-49fcc258-d068-45de-aa4c-6c5832a41d2c tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:36.590554 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-49fcc258-d068-45de-aa4c-6c5832a41d2c tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:36.592457 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-49fcc258-d068-45de-aa4c-6c5832a41d2c tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:36.599347 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-49fcc258-d068-45de-aa4c-6c5832a41d2c tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] 10.222.0.60 "GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf" status: 200 len: 1535 microversion: 2.91 time: 0.141063 Sep 14 09:03:36.612150 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-5cba7543-6ed2-4866-827f-ae7e09ccf2ac tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12ca200f5b7468dac6b0164faa0c171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17461d862f104a3284ffa025efb619e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:36.616675 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1725/3397] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:03:36 2022] GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf => generated 1535 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:03:36.622883 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-659cce16-392e-4cce-926f-58469acb5e65 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:36.627213 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-5cba7543-6ed2-4866-827f-ae7e09ccf2ac tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] 10.222.0.60 "GET /compute/v2.1/servers/d9ab57a3-b59b-4a19-99cc-d8f8383d10a8" status: 200 len: 1504 microversion: 2.1 time: 0.317581 Sep 14 09:03:36.628172 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1673/3398] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:03:36 2022] GET /compute/v2.1/servers/d9ab57a3-b59b-4a19-99cc-d8f8383d10a8 => generated 1504 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:03:36.629706 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-659cce16-392e-4cce-926f-58469acb5e65 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] [instance: 900c4e61-76fe-472f-bba7-0c83895f62cf] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:03:36.636862 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-659cce16-392e-4cce-926f-58469acb5e65 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:36.637480 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-659cce16-392e-4cce-926f-58469acb5e65 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:36.637989 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-659cce16-392e-4cce-926f-58469acb5e65 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:36.638840 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-659cce16-392e-4cce-926f-58469acb5e65 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:36.639557 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-659cce16-392e-4cce-926f-58469acb5e65 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:36.640053 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-659cce16-392e-4cce-926f-58469acb5e65 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:36.651998 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a2c588f6-56d1-40ed-a3f4-8cfe91aa2a60 tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:36.652799 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-a2c588f6-56d1-40ed-a3f4-8cfe91aa2a60 tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] [instance: d9ab57a3-b59b-4a19-99cc-d8f8383d10a8] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:03:36.660929 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a2c588f6-56d1-40ed-a3f4-8cfe91aa2a60 tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:36.661642 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a2c588f6-56d1-40ed-a3f4-8cfe91aa2a60 tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:36.662519 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a2c588f6-56d1-40ed-a3f4-8cfe91aa2a60 tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:36.663971 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a2c588f6-56d1-40ed-a3f4-8cfe91aa2a60 tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:36.665258 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a2c588f6-56d1-40ed-a3f4-8cfe91aa2a60 tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:36.668629 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a2c588f6-56d1-40ed-a3f4-8cfe91aa2a60 tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:36.713167 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-a2c588f6-56d1-40ed-a3f4-8cfe91aa2a60 tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': 'c12ca200f5b7468dac6b0164faa0c171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17461d862f104a3284ffa025efb619e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:36.714191 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a2c588f6-56d1-40ed-a3f4-8cfe91aa2a60 tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] 10.222.0.60 "GET /compute/v2.1/servers/d9ab57a3-b59b-4a19-99cc-d8f8383d10a8/os-instance-actions/req-c08518ae-fe6c-4e1d-acbc-fad4176a4ba8" status: 200 len: 313 microversion: 2.1 time: 0.066881 Sep 14 09:03:36.715225 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1674/3399] 10.222.0.60 () {58 vars in 1419 bytes} [Wed Sep 14 09:03:36 2022] GET /compute/v2.1/servers/d9ab57a3-b59b-4a19-99cc-d8f8383d10a8/os-instance-actions/req-c08518ae-fe6c-4e1d-acbc-fad4176a4ba8 => generated 313 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:03:36.733833 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-2c47550f-fed9-4b37-b3be-d81f080e1584 tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:03:36.737274 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-2c47550f-fed9-4b37-b3be-d81f080e1584 tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] [instance: d9ab57a3-b59b-4a19-99cc-d8f8383d10a8] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:03:36.745171 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2c47550f-fed9-4b37-b3be-d81f080e1584 tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:36.746019 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2c47550f-fed9-4b37-b3be-d81f080e1584 tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:36.746716 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2c47550f-fed9-4b37-b3be-d81f080e1584 tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:36.748504 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2c47550f-fed9-4b37-b3be-d81f080e1584 tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:36.749218 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2c47550f-fed9-4b37-b3be-d81f080e1584 tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:36.749918 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2c47550f-fed9-4b37-b3be-d81f080e1584 tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:36.862695 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-2c47550f-fed9-4b37-b3be-d81f080e1584 tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] 10.222.0.60 "POST /compute/v2.1/servers/d9ab57a3-b59b-4a19-99cc-d8f8383d10a8/action" status: 202 len: 0 microversion: 2.1 time: 0.136073 Sep 14 09:03:36.864130 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1675/3400] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:03:36 2022] POST /compute/v2.1/servers/d9ab57a3-b59b-4a19-99cc-d8f8383d10a8/action => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:03:36.877547 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-64843bf4-9806-440d-b085-3581abec8ba5 tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:36.878986 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-64843bf4-9806-440d-b085-3581abec8ba5 tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] [instance: d9ab57a3-b59b-4a19-99cc-d8f8383d10a8] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:03:36.887093 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-64843bf4-9806-440d-b085-3581abec8ba5 tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:36.887966 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-64843bf4-9806-440d-b085-3581abec8ba5 tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:36.888952 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-64843bf4-9806-440d-b085-3581abec8ba5 tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:36.890196 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-64843bf4-9806-440d-b085-3581abec8ba5 tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:36.890897 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-64843bf4-9806-440d-b085-3581abec8ba5 tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:36.891610 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-64843bf4-9806-440d-b085-3581abec8ba5 tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:36.931567 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-659cce16-392e-4cce-926f-58469acb5e65 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84afbf1d30574a7aa1186a481687c50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a90781147416fa5db6b8922209058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:36.949408 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-659cce16-392e-4cce-926f-58469acb5e65 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84afbf1d30574a7aa1186a481687c50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a90781147416fa5db6b8922209058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:36.955056 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-659cce16-392e-4cce-926f-58469acb5e65 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84afbf1d30574a7aa1186a481687c50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a90781147416fa5db6b8922209058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:36.960836 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-659cce16-392e-4cce-926f-58469acb5e65 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] 10.222.0.60 "GET /compute/v2.1/servers/900c4e61-76fe-472f-bba7-0c83895f62cf" status: 200 len: 1273 microversion: 2.54 time: 0.341305 Sep 14 09:03:36.962517 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1726/3401] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:03:36 2022] GET /compute/v2.1/servers/900c4e61-76fe-472f-bba7-0c83895f62cf => generated 1273 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:03:36.986275 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-905ebd78-bc27-4810-8bbe-c14f55b02c7b req-546e4a00-1f8e-4954-9f7e-ebfabeca79a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7558efb0-7f2d-42d5-9b6d-e442008b1c88", "name": "network-vif-unplugged", "status": "completed", "tag": "84b61202-de19-4a04-b9dd-3a01a864606e"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:03:37.023396 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-905ebd78-bc27-4810-8bbe-c14f55b02c7b req-546e4a00-1f8e-4954-9f7e-ebfabeca79a5 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:37.025149 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-905ebd78-bc27-4810-8bbe-c14f55b02c7b req-546e4a00-1f8e-4954-9f7e-ebfabeca79a5 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:37.025149 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-905ebd78-bc27-4810-8bbe-c14f55b02c7b req-546e4a00-1f8e-4954-9f7e-ebfabeca79a5 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:37.064945 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-905ebd78-bc27-4810-8bbe-c14f55b02c7b req-546e4a00-1f8e-4954-9f7e-ebfabeca79a5 service nova] Creating event network-vif-unplugged:84b61202-de19-4a04-b9dd-3a01a864606e for instance 7558efb0-7f2d-42d5-9b6d-e442008b1c88 on n-h2-836830-18 Sep 14 09:03:37.071814 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-905ebd78-bc27-4810-8bbe-c14f55b02c7b req-546e4a00-1f8e-4954-9f7e-ebfabeca79a5 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.105557 Sep 14 09:03:37.073328 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1727/3402] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:03:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:03:37.139296 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-5d2fcb56-fca3-45ab-b714-085eff8af6df tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:37.140028 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-5d2fcb56-fca3-45ab-b714-085eff8af6df tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] [instance: 36253bc6-1737-4654-a878-c1eaeb797c8e] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:03:37.149654 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5d2fcb56-fca3-45ab-b714-085eff8af6df tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:37.150044 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5d2fcb56-fca3-45ab-b714-085eff8af6df tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:37.151035 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5d2fcb56-fca3-45ab-b714-085eff8af6df tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:37.151772 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5d2fcb56-fca3-45ab-b714-085eff8af6df tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:37.152236 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5d2fcb56-fca3-45ab-b714-085eff8af6df tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:37.152673 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5d2fcb56-fca3-45ab-b714-085eff8af6df tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:37.317390 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-64843bf4-9806-440d-b085-3581abec8ba5 tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12ca200f5b7468dac6b0164faa0c171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17461d862f104a3284ffa025efb619e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:37.328602 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-64843bf4-9806-440d-b085-3581abec8ba5 tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] 10.222.0.60 "GET /compute/v2.1/servers/d9ab57a3-b59b-4a19-99cc-d8f8383d10a8" status: 200 len: 1506 microversion: 2.1 time: 0.459322 Sep 14 09:03:37.329600 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1676/3403] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:03:36 2022] GET /compute/v2.1/servers/d9ab57a3-b59b-4a19-99cc-d8f8383d10a8 => generated 1506 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:03:37.337649 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ab005e3f-29d5-45b1-b8a9-d210377e0b6c tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:37.340024 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-ab005e3f-29d5-45b1-b8a9-d210377e0b6c tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] [instance: 7558efb0-7f2d-42d5-9b6d-e442008b1c88] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:03:37.348406 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ab005e3f-29d5-45b1-b8a9-d210377e0b6c tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:37.350033 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ab005e3f-29d5-45b1-b8a9-d210377e0b6c tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:37.351111 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ab005e3f-29d5-45b1-b8a9-d210377e0b6c tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:37.352057 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ab005e3f-29d5-45b1-b8a9-d210377e0b6c tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:37.352698 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ab005e3f-29d5-45b1-b8a9-d210377e0b6c tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:37.353135 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ab005e3f-29d5-45b1-b8a9-d210377e0b6c tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:37.379811 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:03:37.706369 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-5d2fcb56-fca3-45ab-b714-085eff8af6df tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e7ddc7c037439aad2f98277eef199e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e712ce30eb9c4128aa0ec1d425e9ab79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:37.716272 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-5d2fcb56-fca3-45ab-b714-085eff8af6df tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] 10.222.0.60 "GET /compute/v2.1/servers/36253bc6-1737-4654-a878-c1eaeb797c8e" status: 200 len: 1517 microversion: 2.1 time: 0.583695 Sep 14 09:03:37.717435 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1728/3404] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:03:37 2022] GET /compute/v2.1/servers/36253bc6-1737-4654-a878-c1eaeb797c8e => generated 1517 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:03:37.722416 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-7611ba54-1025-4801-b04c-a89ee0c60fb2 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:37.723305 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-7611ba54-1025-4801-b04c-a89ee0c60fb2 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: 56742f27-4436-4fc3-b7a5-9d337395b7d3] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:03:37.729899 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7611ba54-1025-4801-b04c-a89ee0c60fb2 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:37.730605 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7611ba54-1025-4801-b04c-a89ee0c60fb2 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:37.731280 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7611ba54-1025-4801-b04c-a89ee0c60fb2 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:37.732264 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7611ba54-1025-4801-b04c-a89ee0c60fb2 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:37.732799 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7611ba54-1025-4801-b04c-a89ee0c60fb2 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:37.733283 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7611ba54-1025-4801-b04c-a89ee0c60fb2 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:38.219382 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-7611ba54-1025-4801-b04c-a89ee0c60fb2 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:38.227101 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-7611ba54-1025-4801-b04c-a89ee0c60fb2 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/56742f27-4436-4fc3-b7a5-9d337395b7d3" status: 200 len: 1452 microversion: 2.1 time: 0.508351 Sep 14 09:03:38.227673 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1729/3405] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:03:37 2022] GET /compute/v2.1/servers/56742f27-4436-4fc3-b7a5-9d337395b7d3 => generated 1452 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:03:38.232570 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-03e91b54-8f5d-4ea3-9930-645f09404be3 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:38.233175 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-03e91b54-8f5d-4ea3-9930-645f09404be3 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] [instance: 0eb40c80-c056-4096-a586-7e957a63f7cf] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:03:38.238714 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-03e91b54-8f5d-4ea3-9930-645f09404be3 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:38.239229 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-03e91b54-8f5d-4ea3-9930-645f09404be3 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:38.239652 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-03e91b54-8f5d-4ea3-9930-645f09404be3 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:38.240384 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-03e91b54-8f5d-4ea3-9930-645f09404be3 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:38.240838 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-03e91b54-8f5d-4ea3-9930-645f09404be3 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:38.241251 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-03e91b54-8f5d-4ea3-9930-645f09404be3 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:38.285002 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-ab005e3f-29d5-45b1-b8a9-d210377e0b6c tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b847ccce0654f2fa9df8367320a3218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9051111ca00649c591b6485d58bbc265', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:38.293798 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-ab005e3f-29d5-45b1-b8a9-d210377e0b6c tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] 10.222.0.60 "GET /compute/v2.1/servers/7558efb0-7f2d-42d5-9b6d-e442008b1c88" status: 200 len: 1473 microversion: 2.1 time: 0.962669 Sep 14 09:03:38.294407 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1677/3406] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:03:37 2022] GET /compute/v2.1/servers/7558efb0-7f2d-42d5-9b6d-e442008b1c88 => generated 1473 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:03:38.298898 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-4c205c58-a803-4232-a9e1-62f717dc2624 req-90daea4d-4cb4-4cc0-af55-88fc9e788560 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56742f27-4436-4fc3-b7a5-9d337395b7d3", "name": "network-vif-deleted", "tag": "e92ed0eb-9d91-4524-8cc5-74fa8171574d"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:03:38.309531 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-4c205c58-a803-4232-a9e1-62f717dc2624 req-90daea4d-4cb4-4cc0-af55-88fc9e788560 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:38.309992 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-4c205c58-a803-4232-a9e1-62f717dc2624 req-90daea4d-4cb4-4cc0-af55-88fc9e788560 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:38.310459 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-4c205c58-a803-4232-a9e1-62f717dc2624 req-90daea4d-4cb4-4cc0-af55-88fc9e788560 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:38.322850 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-4c205c58-a803-4232-a9e1-62f717dc2624 req-90daea4d-4cb4-4cc0-af55-88fc9e788560 service nova] Creating event network-vif-deleted:e92ed0eb-9d91-4524-8cc5-74fa8171574d for instance 56742f27-4436-4fc3-b7a5-9d337395b7d3 on n-h1-836830-18 Sep 14 09:03:38.327639 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-4c205c58-a803-4232-a9e1-62f717dc2624 req-90daea4d-4cb4-4cc0-af55-88fc9e788560 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032010 Sep 14 09:03:38.328243 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1678/3407] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:03:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:03:38.334329 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-4ac75c09-523c-4282-bda3-5448d1ce2d99 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:38.335056 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-4ac75c09-523c-4282-bda3-5448d1ce2d99 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] [instance: 900c4e61-76fe-472f-bba7-0c83895f62cf] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:03:38.341361 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4ac75c09-523c-4282-bda3-5448d1ce2d99 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:38.341852 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4ac75c09-523c-4282-bda3-5448d1ce2d99 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:38.342290 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4ac75c09-523c-4282-bda3-5448d1ce2d99 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:38.343046 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4ac75c09-523c-4282-bda3-5448d1ce2d99 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:38.343592 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4ac75c09-523c-4282-bda3-5448d1ce2d99 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:38.346744 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4ac75c09-523c-4282-bda3-5448d1ce2d99 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:38.358527 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-03e91b54-8f5d-4ea3-9930-645f09404be3 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:38.371690 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-03e91b54-8f5d-4ea3-9930-645f09404be3 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:38.373337 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-03e91b54-8f5d-4ea3-9930-645f09404be3 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:38.380162 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-03e91b54-8f5d-4ea3-9930-645f09404be3 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] 10.222.0.60 "GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf" status: 200 len: 1535 microversion: 2.91 time: 0.151351 Sep 14 09:03:38.381432 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1730/3408] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:03:38 2022] GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf => generated 1535 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:03:38.385959 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-74a76b3c-3ebb-4ee6-ba17-bc5f8ea8deec tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:38.386822 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-74a76b3c-3ebb-4ee6-ba17-bc5f8ea8deec tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] [instance: d9ab57a3-b59b-4a19-99cc-d8f8383d10a8] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:03:38.395787 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-74a76b3c-3ebb-4ee6-ba17-bc5f8ea8deec tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:38.396347 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-74a76b3c-3ebb-4ee6-ba17-bc5f8ea8deec tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:38.397025 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-74a76b3c-3ebb-4ee6-ba17-bc5f8ea8deec tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:38.398213 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-74a76b3c-3ebb-4ee6-ba17-bc5f8ea8deec tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:38.399070 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-74a76b3c-3ebb-4ee6-ba17-bc5f8ea8deec tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:38.399837 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-74a76b3c-3ebb-4ee6-ba17-bc5f8ea8deec tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:38.432994 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:03:38.488839 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-4ac75c09-523c-4282-bda3-5448d1ce2d99 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84afbf1d30574a7aa1186a481687c50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a90781147416fa5db6b8922209058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:38.502048 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-4ac75c09-523c-4282-bda3-5448d1ce2d99 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84afbf1d30574a7aa1186a481687c50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a90781147416fa5db6b8922209058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:38.503717 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-4ac75c09-523c-4282-bda3-5448d1ce2d99 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84afbf1d30574a7aa1186a481687c50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a90781147416fa5db6b8922209058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:38.504946 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-4ac75c09-523c-4282-bda3-5448d1ce2d99 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] 10.222.0.60 "GET /compute/v2.1/servers/900c4e61-76fe-472f-bba7-0c83895f62cf" status: 200 len: 1335 microversion: 2.54 time: 0.175382 Sep 14 09:03:38.506529 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1679/3409] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:03:38 2022] GET /compute/v2.1/servers/900c4e61-76fe-472f-bba7-0c83895f62cf => generated 1335 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:03:38.715222 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-74a76b3c-3ebb-4ee6-ba17-bc5f8ea8deec tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12ca200f5b7468dac6b0164faa0c171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17461d862f104a3284ffa025efb619e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:38.728331 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-74a76b3c-3ebb-4ee6-ba17-bc5f8ea8deec tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] 10.222.0.60 "GET /compute/v2.1/servers/d9ab57a3-b59b-4a19-99cc-d8f8383d10a8" status: 200 len: 1506 microversion: 2.1 time: 0.345701 Sep 14 09:03:38.729553 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1731/3410] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:03:38 2022] GET /compute/v2.1/servers/d9ab57a3-b59b-4a19-99cc-d8f8383d10a8 => generated 1506 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:03:38.738932 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-40724521-5a71-469b-88db-0a97ed198399 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:38.739655 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-40724521-5a71-469b-88db-0a97ed198399 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] [instance: 36253bc6-1737-4654-a878-c1eaeb797c8e] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:03:38.746403 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-40724521-5a71-469b-88db-0a97ed198399 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:38.746923 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-40724521-5a71-469b-88db-0a97ed198399 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:38.755042 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-40724521-5a71-469b-88db-0a97ed198399 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:38.755861 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-40724521-5a71-469b-88db-0a97ed198399 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:38.756435 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-40724521-5a71-469b-88db-0a97ed198399 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:38.756870 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-40724521-5a71-469b-88db-0a97ed198399 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:38.897584 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-40724521-5a71-469b-88db-0a97ed198399 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e7ddc7c037439aad2f98277eef199e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e712ce30eb9c4128aa0ec1d425e9ab79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:38.907195 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-40724521-5a71-469b-88db-0a97ed198399 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] 10.222.0.60 "GET /compute/v2.1/servers/36253bc6-1737-4654-a878-c1eaeb797c8e" status: 200 len: 1475 microversion: 2.1 time: 0.172030 Sep 14 09:03:38.924151 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1680/3411] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:03:38 2022] GET /compute/v2.1/servers/36253bc6-1737-4654-a878-c1eaeb797c8e => generated 1475 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:03:39.253745 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-dc1a288c-1b60-4a6d-87f5-5efaef16bca3 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:39.254368 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-dc1a288c-1b60-4a6d-87f5-5efaef16bca3 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: 56742f27-4436-4fc3-b7a5-9d337395b7d3] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:03:39.268594 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dc1a288c-1b60-4a6d-87f5-5efaef16bca3 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:39.269092 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dc1a288c-1b60-4a6d-87f5-5efaef16bca3 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:39.269531 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dc1a288c-1b60-4a6d-87f5-5efaef16bca3 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:39.270241 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dc1a288c-1b60-4a6d-87f5-5efaef16bca3 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:39.270696 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dc1a288c-1b60-4a6d-87f5-5efaef16bca3 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:39.285020 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dc1a288c-1b60-4a6d-87f5-5efaef16bca3 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:39.296303 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-6d9c53a2-8095-4f16-b4e6-1d7e00dfbce9 req-6cde2c28-7360-4656-9848-13a6044a5b08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36253bc6-1737-4654-a878-c1eaeb797c8e", "name": "network-vif-deleted", "tag": "76ca3f3a-6da0-4186-a61f-54617a2436fa"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:03:39.331060 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-6d9c53a2-8095-4f16-b4e6-1d7e00dfbce9 req-6cde2c28-7360-4656-9848-13a6044a5b08 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:39.331813 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-6d9c53a2-8095-4f16-b4e6-1d7e00dfbce9 req-6cde2c28-7360-4656-9848-13a6044a5b08 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:39.332416 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-6d9c53a2-8095-4f16-b4e6-1d7e00dfbce9 req-6cde2c28-7360-4656-9848-13a6044a5b08 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:39.362135 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dc1a288c-1b60-4a6d-87f5-5efaef16bca3 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:39.362673 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dc1a288c-1b60-4a6d-87f5-5efaef16bca3 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:39.363071 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dc1a288c-1b60-4a6d-87f5-5efaef16bca3 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:39.363711 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.objects.instance [None req-dc1a288c-1b60-4a6d-87f5-5efaef16bca3 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lazy-loading 'fault' on Instance uuid 56742f27-4436-4fc3-b7a5-9d337395b7d3 {{(pid=128759) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:03:39.375890 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-6d9c53a2-8095-4f16-b4e6-1d7e00dfbce9 req-6cde2c28-7360-4656-9848-13a6044a5b08 service nova] Creating event network-vif-deleted:76ca3f3a-6da0-4186-a61f-54617a2436fa for instance 36253bc6-1737-4654-a878-c1eaeb797c8e on n-h1-836830-18 Sep 14 09:03:39.383628 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-6d9c53a2-8095-4f16-b4e6-1d7e00dfbce9 req-6cde2c28-7360-4656-9848-13a6044a5b08 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.470907 Sep 14 09:03:39.385015 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1732/3412] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:03:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:03:39.393350 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-2a3ca346-0f9e-4583-b202-5e8ef7bed738 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:39.394573 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-2a3ca346-0f9e-4583-b202-5e8ef7bed738 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] [instance: 7558efb0-7f2d-42d5-9b6d-e442008b1c88] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:03:39.419113 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2a3ca346-0f9e-4583-b202-5e8ef7bed738 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:39.420354 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2a3ca346-0f9e-4583-b202-5e8ef7bed738 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:39.423144 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2a3ca346-0f9e-4583-b202-5e8ef7bed738 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:39.424394 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2a3ca346-0f9e-4583-b202-5e8ef7bed738 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:39.425498 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2a3ca346-0f9e-4583-b202-5e8ef7bed738 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:39.426341 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2a3ca346-0f9e-4583-b202-5e8ef7bed738 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:39.482880 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-dc1a288c-1b60-4a6d-87f5-5efaef16bca3 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:39.494241 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-dc1a288c-1b60-4a6d-87f5-5efaef16bca3 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/56742f27-4436-4fc3-b7a5-9d337395b7d3" status: 200 len: 1304 microversion: 2.1 time: 0.244639 Sep 14 09:03:39.495533 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1681/3413] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:03:39 2022] GET /compute/v2.1/servers/56742f27-4436-4fc3-b7a5-9d337395b7d3 => generated 1304 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:03:39.502511 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-94a09798-ebac-4fb1-97d6-e468e8548f9e tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:39.503482 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-94a09798-ebac-4fb1-97d6-e468e8548f9e tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] [instance: 0eb40c80-c056-4096-a586-7e957a63f7cf] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:03:39.510419 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-94a09798-ebac-4fb1-97d6-e468e8548f9e tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:39.512005 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-94a09798-ebac-4fb1-97d6-e468e8548f9e tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:39.512452 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-94a09798-ebac-4fb1-97d6-e468e8548f9e tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:39.513289 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-94a09798-ebac-4fb1-97d6-e468e8548f9e tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:39.513871 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-94a09798-ebac-4fb1-97d6-e468e8548f9e tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:39.514591 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-94a09798-ebac-4fb1-97d6-e468e8548f9e tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:39.672269 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-94a09798-ebac-4fb1-97d6-e468e8548f9e tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:39.681391 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-94a09798-ebac-4fb1-97d6-e468e8548f9e tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:39.683203 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-94a09798-ebac-4fb1-97d6-e468e8548f9e tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:39.689842 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-94a09798-ebac-4fb1-97d6-e468e8548f9e tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] 10.222.0.60 "GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf" status: 200 len: 1538 microversion: 2.91 time: 0.193105 Sep 14 09:03:39.690853 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1682/3414] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:03:39 2022] GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf => generated 1538 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:03:39.695885 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-0158f1bf-4784-4c3a-b43c-3ea0fce4ded6 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:39.697933 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-0158f1bf-4784-4c3a-b43c-3ea0fce4ded6 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] [instance: 900c4e61-76fe-472f-bba7-0c83895f62cf] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:03:39.703976 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0158f1bf-4784-4c3a-b43c-3ea0fce4ded6 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:39.704733 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0158f1bf-4784-4c3a-b43c-3ea0fce4ded6 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:39.705382 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0158f1bf-4784-4c3a-b43c-3ea0fce4ded6 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:39.706293 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0158f1bf-4784-4c3a-b43c-3ea0fce4ded6 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:39.707149 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0158f1bf-4784-4c3a-b43c-3ea0fce4ded6 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:39.707790 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0158f1bf-4784-4c3a-b43c-3ea0fce4ded6 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:39.825297 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-0158f1bf-4784-4c3a-b43c-3ea0fce4ded6 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84afbf1d30574a7aa1186a481687c50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a90781147416fa5db6b8922209058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:39.841381 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-0158f1bf-4784-4c3a-b43c-3ea0fce4ded6 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84afbf1d30574a7aa1186a481687c50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a90781147416fa5db6b8922209058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:39.843564 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-0158f1bf-4784-4c3a-b43c-3ea0fce4ded6 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84afbf1d30574a7aa1186a481687c50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a90781147416fa5db6b8922209058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:39.844919 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-0158f1bf-4784-4c3a-b43c-3ea0fce4ded6 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] 10.222.0.60 "GET /compute/v2.1/servers/900c4e61-76fe-472f-bba7-0c83895f62cf" status: 200 len: 1335 microversion: 2.54 time: 0.152820 Sep 14 09:03:39.845793 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1683/3415] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:03:39 2022] GET /compute/v2.1/servers/900c4e61-76fe-472f-bba7-0c83895f62cf => generated 1335 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:03:39.853208 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-1824f1bf-20c0-4ac2-a631-fef4b25dbf4e tempest-UnshelveToHostMultiNodesTest-151498122 tempest-UnshelveToHostMultiNodesTest-151498122-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h1-836830-18"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:03:39.883820 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-1824f1bf-20c0-4ac2-a631-fef4b25dbf4e tempest-UnshelveToHostMultiNodesTest-151498122 tempest-UnshelveToHostMultiNodesTest-151498122-project-admin] [instance: 0eb40c80-c056-4096-a586-7e957a63f7cf] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:03:39.913485 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-2a3ca346-0f9e-4583-b202-5e8ef7bed738 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b847ccce0654f2fa9df8367320a3218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9051111ca00649c591b6485d58bbc265', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:39.924093 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1824f1bf-20c0-4ac2-a631-fef4b25dbf4e tempest-UnshelveToHostMultiNodesTest-151498122 tempest-UnshelveToHostMultiNodesTest-151498122-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:39.924572 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-2a3ca346-0f9e-4583-b202-5e8ef7bed738 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] 10.222.0.60 "GET /compute/v2.1/servers/7558efb0-7f2d-42d5-9b6d-e442008b1c88" status: 200 len: 1473 microversion: 2.1 time: 0.537691 Sep 14 09:03:39.935868 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1824f1bf-20c0-4ac2-a631-fef4b25dbf4e tempest-UnshelveToHostMultiNodesTest-151498122 tempest-UnshelveToHostMultiNodesTest-151498122-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:39.940218 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1824f1bf-20c0-4ac2-a631-fef4b25dbf4e tempest-UnshelveToHostMultiNodesTest-151498122 tempest-UnshelveToHostMultiNodesTest-151498122-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:39.944535 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1824f1bf-20c0-4ac2-a631-fef4b25dbf4e tempest-UnshelveToHostMultiNodesTest-151498122 tempest-UnshelveToHostMultiNodesTest-151498122-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:39.945242 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1824f1bf-20c0-4ac2-a631-fef4b25dbf4e tempest-UnshelveToHostMultiNodesTest-151498122 tempest-UnshelveToHostMultiNodesTest-151498122-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:39.951379 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1733/3416] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:03:39 2022] GET /compute/v2.1/servers/7558efb0-7f2d-42d5-9b6d-e442008b1c88 => generated 1473 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:03:39.954333 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1824f1bf-20c0-4ac2-a631-fef4b25dbf4e tempest-UnshelveToHostMultiNodesTest-151498122 tempest-UnshelveToHostMultiNodesTest-151498122-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:39.956960 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-38f3d430-cd1b-4840-90ad-be5bb3c5b310 tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:39.957614 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-38f3d430-cd1b-4840-90ad-be5bb3c5b310 tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] [instance: d9ab57a3-b59b-4a19-99cc-d8f8383d10a8] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:03:39.969334 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-38f3d430-cd1b-4840-90ad-be5bb3c5b310 tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:39.970789 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-38f3d430-cd1b-4840-90ad-be5bb3c5b310 tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:39.971740 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-38f3d430-cd1b-4840-90ad-be5bb3c5b310 tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:39.972873 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-38f3d430-cd1b-4840-90ad-be5bb3c5b310 tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:39.975025 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-38f3d430-cd1b-4840-90ad-be5bb3c5b310 tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:39.975719 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-38f3d430-cd1b-4840-90ad-be5bb3c5b310 tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:40.085972 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-1824f1bf-20c0-4ac2-a631-fef4b25dbf4e tempest-UnshelveToHostMultiNodesTest-151498122 tempest-UnshelveToHostMultiNodesTest-151498122-project-admin] [instance: 0eb40c80-c056-4096-a586-7e957a63f7cf] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h1-836830-18". {{(pid=128759) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 14 09:03:40.201793 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-1824f1bf-20c0-4ac2-a631-fef4b25dbf4e tempest-UnshelveToHostMultiNodesTest-151498122 tempest-UnshelveToHostMultiNodesTest-151498122-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf/action" status: 202 len: 0 microversion: 2.91 time: 0.353444 Sep 14 09:03:40.202535 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1684/3417] 10.222.0.60 () {62 vars in 1319 bytes} [Wed Sep 14 09:03:39 2022] POST /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf/action => generated 0 bytes in 356 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:03:40.220231 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-792f84f2-7207-4c08-89b5-d7f4b71c3707 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:40.222262 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-792f84f2-7207-4c08-89b5-d7f4b71c3707 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] [instance: 36253bc6-1737-4654-a878-c1eaeb797c8e] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:03:40.248072 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-792f84f2-7207-4c08-89b5-d7f4b71c3707 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:40.252748 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-792f84f2-7207-4c08-89b5-d7f4b71c3707 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:40.253473 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-792f84f2-7207-4c08-89b5-d7f4b71c3707 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:40.254590 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-792f84f2-7207-4c08-89b5-d7f4b71c3707 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:40.255257 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-792f84f2-7207-4c08-89b5-d7f4b71c3707 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:40.255849 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-792f84f2-7207-4c08-89b5-d7f4b71c3707 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:40.405967 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-38f3d430-cd1b-4840-90ad-be5bb3c5b310 tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12ca200f5b7468dac6b0164faa0c171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17461d862f104a3284ffa025efb619e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:40.415674 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-38f3d430-cd1b-4840-90ad-be5bb3c5b310 tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] 10.222.0.60 "GET /compute/v2.1/servers/d9ab57a3-b59b-4a19-99cc-d8f8383d10a8" status: 200 len: 1506 microversion: 2.1 time: 0.462922 Sep 14 09:03:40.423324 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1734/3418] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:03:39 2022] GET /compute/v2.1/servers/d9ab57a3-b59b-4a19-99cc-d8f8383d10a8 => generated 1506 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:03:40.433196 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-9acec2fb-2115-42cf-859b-46af861a866c tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:40.447331 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-9acec2fb-2115-42cf-859b-46af861a866c tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] [instance: 0eb40c80-c056-4096-a586-7e957a63f7cf] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:03:40.457234 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9acec2fb-2115-42cf-859b-46af861a866c tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:40.471854 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9acec2fb-2115-42cf-859b-46af861a866c tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:40.476991 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9acec2fb-2115-42cf-859b-46af861a866c tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:40.478060 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9acec2fb-2115-42cf-859b-46af861a866c tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:40.479374 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9acec2fb-2115-42cf-859b-46af861a866c tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:40.486499 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9acec2fb-2115-42cf-859b-46af861a866c tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:40.530378 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-792f84f2-7207-4c08-89b5-d7f4b71c3707 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e7ddc7c037439aad2f98277eef199e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e712ce30eb9c4128aa0ec1d425e9ab79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:40.549507 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-792f84f2-7207-4c08-89b5-d7f4b71c3707 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] 10.222.0.60 "GET /compute/v2.1/servers/36253bc6-1737-4654-a878-c1eaeb797c8e" status: 200 len: 1306 microversion: 2.1 time: 0.345693 Sep 14 09:03:40.555623 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1685/3419] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:03:40 2022] GET /compute/v2.1/servers/36253bc6-1737-4654-a878-c1eaeb797c8e => generated 1306 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:03:40.573817 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-c6c5e695-7946-4230-af2a-aceecf1db317 req-997185f4-9aad-4f0b-b48e-028ccd7fa809 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7558efb0-7f2d-42d5-9b6d-e442008b1c88", "name": "network-vif-deleted", "tag": "84b61202-de19-4a04-b9dd-3a01a864606e"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:03:40.612054 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-c6c5e695-7946-4230-af2a-aceecf1db317 req-997185f4-9aad-4f0b-b48e-028ccd7fa809 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:40.614455 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-c6c5e695-7946-4230-af2a-aceecf1db317 req-997185f4-9aad-4f0b-b48e-028ccd7fa809 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:40.620146 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-c6c5e695-7946-4230-af2a-aceecf1db317 req-997185f4-9aad-4f0b-b48e-028ccd7fa809 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:40.665570 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-c6c5e695-7946-4230-af2a-aceecf1db317 req-997185f4-9aad-4f0b-b48e-028ccd7fa809 service nova] Creating event network-vif-deleted:84b61202-de19-4a04-b9dd-3a01a864606e for instance 7558efb0-7f2d-42d5-9b6d-e442008b1c88 on n-h2-836830-18 Sep 14 09:03:40.680143 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-c6c5e695-7946-4230-af2a-aceecf1db317 req-997185f4-9aad-4f0b-b48e-028ccd7fa809 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122945 Sep 14 09:03:40.681457 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1686/3420] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:03:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:03:40.687287 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9c63b0af-ac52-4287-ac8b-09e3b4f63a5b tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:40.690768 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-9c63b0af-ac52-4287-ac8b-09e3b4f63a5b tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: 56742f27-4436-4fc3-b7a5-9d337395b7d3] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:03:40.705730 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9c63b0af-ac52-4287-ac8b-09e3b4f63a5b tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:40.708710 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9c63b0af-ac52-4287-ac8b-09e3b4f63a5b tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:40.709507 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9c63b0af-ac52-4287-ac8b-09e3b4f63a5b tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:40.710773 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9c63b0af-ac52-4287-ac8b-09e3b4f63a5b tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:40.711423 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9c63b0af-ac52-4287-ac8b-09e3b4f63a5b tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:40.712037 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9c63b0af-ac52-4287-ac8b-09e3b4f63a5b tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:40.728488 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-9c63b0af-ac52-4287-ac8b-09e3b4f63a5b tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] HTTP exception thrown: Instance 56742f27-4436-4fc3-b7a5-9d337395b7d3 could not be found. Sep 14 09:03:40.730851 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9c63b0af-ac52-4287-ac8b-09e3b4f63a5b tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Request method failure captured: Sep 14 09:03:40.730851 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/56742f27-4436-4fc3-b7a5-9d337395b7d3 HTTP/1.1 Sep 14 09:03:40.730851 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:03:40.730851 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:03:40.730851 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:03:40.730851 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:03:40.730851 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:03:40.730851 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:03:40.730851 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:03:40.730851 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:03:40.730851 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZfruMTQYBTAiiDSnzM1mYEpmuEj9qljISQOJ4EBe2ad6zsfFzAf8FVBubQCt-Sdr-zCKCq1jxjsj_azLMK_SQWZ09VXr62FV-261vpzTW6inln_93a6hl3DeVdX6cuYwx-Go-beMey4bY4s6iPFtULEKgIbxHUgjvgK1DEFOEvCwSQ Sep 14 09:03:40.730851 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:03:40.730851 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:03:40.730851 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:03:40.730851 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:03:40.730851 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:03:40.730851 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:03:40.730851 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 4d42bf4d573b4bf9a0d8c9e73260af7e Sep 14 09:03:40.730851 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-DeleteServersTestJSON-1669995002 Sep 14 09:03:40.730851 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:03:40.730851 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:03:40.730851 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/4d42bf4d573b4bf9a0d8c9e73260af7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_4d42bf4d573b4bf9a0d8c9e73260af7e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4d42bf4d573b4bf9a0d8c9e73260af7e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4d42bf4d573b4bf9a0d8c9e73260af7e"}]}] Sep 14 09:03:40.730851 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-DeleteServersTestJSON-1669995002 Sep 14 09:03:40.730851 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 4d42bf4d573b4bf9a0d8c9e73260af7e Sep 14 09:03:40.730851 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-DeleteServersTestJSON-1669995002 Sep 14 09:03:40.730851 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-DeleteServersTestJSON-1669995002-project Sep 14 09:03:40.730851 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:03:40.730851 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:03:40.730851 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 47c95b28481b451bb03fb2c0240d0310 Sep 14 09:03:40.730851 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-DeleteServersTestJSON-1669995002-project Sep 14 09:03:40.730851 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:03:40.730851 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance 56742f27-4436-4fc3-b7a5-9d337395b7d3 could not be found. Sep 14 09:03:40.730851 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '56742f27-4436-4fc3-b7a5-9d337395b7d3'} Sep 14 09:03:40.730851 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:03:40.730851 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:03:40.730851 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:03:40.730851 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:03:40.730851 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:03:40.730851 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:03:40.730851 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:03:40.730851 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:03:40.730851 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:03:40.730851 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:03:40.730851 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56742f27-4436-4fc3-b7a5-9d337395b7d3 could not be found. Sep 14 09:03:40.730851 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:03:40.730851 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:03:40.730851 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:03:40.730851 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:03:40.730851 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:03:40.730851 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:03:40.730851 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:03:40.730851 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:03:40.730851 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:03:40.730851 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:03:40.730851 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:03:40.730851 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:03:40.730851 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:03:40.730851 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:03:40.730851 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:03:40.730851 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:03:40.730851 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56742f27-4436-4fc3-b7a5-9d337395b7d3 could not be found. Sep 14 09:03:40.730851 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:03:40.730851 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:03:40.730851 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:03:40.737183 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:03:40.737183 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:03:40.737183 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:03:40.737183 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:03:40.737183 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:03:40.737183 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56742f27-4436-4fc3-b7a5-9d337395b7d3 could not be found. Sep 14 09:03:40.737183 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:03:40.740231 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9c63b0af-ac52-4287-ac8b-09e3b4f63a5b tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Returning 404 to user: Instance 56742f27-4436-4fc3-b7a5-9d337395b7d3 could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:03:40.745854 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-9c63b0af-ac52-4287-ac8b-09e3b4f63a5b tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/56742f27-4436-4fc3-b7a5-9d337395b7d3" status: 404 len: 111 microversion: 2.1 time: 0.062742 Sep 14 09:03:40.746894 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1687/3421] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:03:40 2022] GET /compute/v2.1/servers/56742f27-4436-4fc3-b7a5-9d337395b7d3 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:03:40.875445 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-47e143df-a04c-4625-8980-cd526469b806 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:40.876072 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-47e143df-a04c-4625-8980-cd526469b806 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] [instance: 900c4e61-76fe-472f-bba7-0c83895f62cf] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:03:40.883266 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-47e143df-a04c-4625-8980-cd526469b806 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:40.886498 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-47e143df-a04c-4625-8980-cd526469b806 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:40.887175 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-47e143df-a04c-4625-8980-cd526469b806 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:40.888781 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-47e143df-a04c-4625-8980-cd526469b806 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:40.889239 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-47e143df-a04c-4625-8980-cd526469b806 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:40.891152 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-47e143df-a04c-4625-8980-cd526469b806 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:40.941903 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-9acec2fb-2115-42cf-859b-46af861a866c tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:40.957029 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-9acec2fb-2115-42cf-859b-46af861a866c tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:40.958576 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-9acec2fb-2115-42cf-859b-46af861a866c tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:40.965949 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-9acec2fb-2115-42cf-859b-46af861a866c tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] 10.222.0.60 "GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf" status: 200 len: 1486 microversion: 2.91 time: 0.541133 Sep 14 09:03:40.967024 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1735/3422] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:03:40 2022] GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf => generated 1486 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:03:40.971886 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-bcdc6f41-3653-426c-bb88-62b16877d60d tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1288188578", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "networks": [{"uuid": "b9ab2062-a108-4d91-8f37-c911ce062678"}]}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:03:41.040659 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-47e143df-a04c-4625-8980-cd526469b806 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84afbf1d30574a7aa1186a481687c50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a90781147416fa5db6b8922209058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:41.055587 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-47e143df-a04c-4625-8980-cd526469b806 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84afbf1d30574a7aa1186a481687c50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a90781147416fa5db6b8922209058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:41.061136 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-47e143df-a04c-4625-8980-cd526469b806 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84afbf1d30574a7aa1186a481687c50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a90781147416fa5db6b8922209058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:41.062340 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-47e143df-a04c-4625-8980-cd526469b806 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] 10.222.0.60 "GET /compute/v2.1/servers/900c4e61-76fe-472f-bba7-0c83895f62cf" status: 200 len: 1335 microversion: 2.54 time: 0.191242 Sep 14 09:03:41.086148 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1688/3423] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:03:40 2022] GET /compute/v2.1/servers/900c4e61-76fe-472f-bba7-0c83895f62cf => generated 1335 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 09:03:41.091961 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a9e63fae-6c5c-420a-b057-8f74f70edb31 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:41.092846 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-a9e63fae-6c5c-420a-b057-8f74f70edb31 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] [instance: 7558efb0-7f2d-42d5-9b6d-e442008b1c88] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:03:41.100019 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a9e63fae-6c5c-420a-b057-8f74f70edb31 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:41.100728 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a9e63fae-6c5c-420a-b057-8f74f70edb31 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:41.101167 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a9e63fae-6c5c-420a-b057-8f74f70edb31 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:41.102157 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a9e63fae-6c5c-420a-b057-8f74f70edb31 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:41.102789 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a9e63fae-6c5c-420a-b057-8f74f70edb31 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:41.103445 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a9e63fae-6c5c-420a-b057-8f74f70edb31 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:41.139453 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.network.neutron [None req-bcdc6f41-3653-426c-bb88-62b16877d60d tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] validate_networks() for [('b9ab2062-a108-4d91-8f37-c911ce062678', None, None, None, None, None)] {{(pid=128758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:03:41.160793 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a9e63fae-6c5c-420a-b057-8f74f70edb31 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:41.161628 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a9e63fae-6c5c-420a-b057-8f74f70edb31 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:41.162313 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a9e63fae-6c5c-420a-b057-8f74f70edb31 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:41.163023 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.objects.instance [None req-a9e63fae-6c5c-420a-b057-8f74f70edb31 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Lazy-loading 'fault' on Instance uuid 7558efb0-7f2d-42d5-9b6d-e442008b1c88 {{(pid=128759) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:03:41.301755 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-a9e63fae-6c5c-420a-b057-8f74f70edb31 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b847ccce0654f2fa9df8367320a3218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9051111ca00649c591b6485d58bbc265', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:41.312166 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a9e63fae-6c5c-420a-b057-8f74f70edb31 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] 10.222.0.60 "GET /compute/v2.1/servers/7558efb0-7f2d-42d5-9b6d-e442008b1c88" status: 200 len: 1307 microversion: 2.1 time: 0.224838 Sep 14 09:03:41.328857 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1689/3424] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:03:41 2022] GET /compute/v2.1/servers/7558efb0-7f2d-42d5-9b6d-e442008b1c88 => generated 1307 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:03:41.445796 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-536be3d9-cd46-4c0c-b576-ffa20d469c8c tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:41.446500 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-536be3d9-cd46-4c0c-b576-ffa20d469c8c tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] [instance: d9ab57a3-b59b-4a19-99cc-d8f8383d10a8] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:03:41.453456 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-536be3d9-cd46-4c0c-b576-ffa20d469c8c tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:41.453954 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-536be3d9-cd46-4c0c-b576-ffa20d469c8c tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:41.454389 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-536be3d9-cd46-4c0c-b576-ffa20d469c8c tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:41.455339 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-536be3d9-cd46-4c0c-b576-ffa20d469c8c tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:41.455810 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-536be3d9-cd46-4c0c-b576-ffa20d469c8c tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:41.456298 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-536be3d9-cd46-4c0c-b576-ffa20d469c8c tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:41.710020 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-536be3d9-cd46-4c0c-b576-ffa20d469c8c tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12ca200f5b7468dac6b0164faa0c171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17461d862f104a3284ffa025efb619e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:41.719322 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-536be3d9-cd46-4c0c-b576-ffa20d469c8c tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] 10.222.0.60 "GET /compute/v2.1/servers/d9ab57a3-b59b-4a19-99cc-d8f8383d10a8" status: 200 len: 1511 microversion: 2.1 time: 0.277876 Sep 14 09:03:41.720220 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1690/3425] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:03:41 2022] GET /compute/v2.1/servers/d9ab57a3-b59b-4a19-99cc-d8f8383d10a8 => generated 1511 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:03:41.725777 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c0c8df6f-b9dc-4c5d-a1ed-86397a435b13 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:41.726042 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-c0c8df6f-b9dc-4c5d-a1ed-86397a435b13 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] [instance: 36253bc6-1737-4654-a878-c1eaeb797c8e] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:03:41.733501 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c0c8df6f-b9dc-4c5d-a1ed-86397a435b13 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:41.734463 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c0c8df6f-b9dc-4c5d-a1ed-86397a435b13 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:41.735402 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c0c8df6f-b9dc-4c5d-a1ed-86397a435b13 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:41.737243 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c0c8df6f-b9dc-4c5d-a1ed-86397a435b13 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:41.737865 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c0c8df6f-b9dc-4c5d-a1ed-86397a435b13 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:41.739176 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c0c8df6f-b9dc-4c5d-a1ed-86397a435b13 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:41.775171 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c0c8df6f-b9dc-4c5d-a1ed-86397a435b13 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:41.776571 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c0c8df6f-b9dc-4c5d-a1ed-86397a435b13 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:41.777195 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c0c8df6f-b9dc-4c5d-a1ed-86397a435b13 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:41.777809 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.objects.instance [None req-c0c8df6f-b9dc-4c5d-a1ed-86397a435b13 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lazy-loading 'fault' on Instance uuid 36253bc6-1737-4654-a878-c1eaeb797c8e {{(pid=128759) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:03:41.841692 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-c0c8df6f-b9dc-4c5d-a1ed-86397a435b13 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e7ddc7c037439aad2f98277eef199e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e712ce30eb9c4128aa0ec1d425e9ab79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:41.843937 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-bcdc6f41-3653-426c-bb88-62b16877d60d tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Flavor limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:03:41.844416 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-bcdc6f41-3653-426c-bb88-62b16877d60d tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Image limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:03:41.846208 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-bcdc6f41-3653-426c-bb88-62b16877d60d tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Flavor pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:03:41.846650 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-bcdc6f41-3653-426c-bb88-62b16877d60d tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Image pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:03:41.847113 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-bcdc6f41-3653-426c-bb88-62b16877d60d tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:03:41.858537 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-c0c8df6f-b9dc-4c5d-a1ed-86397a435b13 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] 10.222.0.60 "GET /compute/v2.1/servers/36253bc6-1737-4654-a878-c1eaeb797c8e" status: 200 len: 1311 microversion: 2.1 time: 0.137167 Sep 14 09:03:41.858757 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bcdc6f41-3653-426c-bb88-62b16877d60d tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:41.859164 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bcdc6f41-3653-426c-bb88-62b16877d60d tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:41.859502 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1691/3426] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:03:41 2022] GET /compute/v2.1/servers/36253bc6-1737-4654-a878-c1eaeb797c8e => generated 1311 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:03:41.859709 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bcdc6f41-3653-426c-bb88-62b16877d60d tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:41.860550 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bcdc6f41-3653-426c-bb88-62b16877d60d tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:41.861008 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bcdc6f41-3653-426c-bb88-62b16877d60d tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:41.861455 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bcdc6f41-3653-426c-bb88-62b16877d60d tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:41.883139 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-bcdc6f41-3653-426c-bb88-62b16877d60d tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Getting quotas for project 4d42bf4d573b4bf9a0d8c9e73260af7e. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:03:41.889292 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-bcdc6f41-3653-426c-bb88-62b16877d60d tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Getting quotas for user 47c95b28481b451bb03fb2c0240d0310 and project 4d42bf4d573b4bf9a0d8c9e73260af7e. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:03:41.906520 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-bcdc6f41-3653-426c-bb88-62b16877d60d tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Going to run 1 instances... {{(pid=128758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:03:41.909763 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-bcdc6f41-3653-426c-bb88-62b16877d60d tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: d9d9afd3-aeba-4429-a474-7c70a960d4e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:03:41.993425 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-bcdc6f41-3653-426c-bb88-62b16877d60d tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.025076 Sep 14 09:03:41.995198 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1736/3427] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 09:03:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1027 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:03:42.005428 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-71cf1123-e9d7-474a-9fcf-477497dc04a1 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:42.006346 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-71cf1123-e9d7-474a-9fcf-477497dc04a1 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] [instance: 0eb40c80-c056-4096-a586-7e957a63f7cf] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:03:42.013641 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-71cf1123-e9d7-474a-9fcf-477497dc04a1 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:42.014139 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-71cf1123-e9d7-474a-9fcf-477497dc04a1 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:42.014571 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-71cf1123-e9d7-474a-9fcf-477497dc04a1 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:42.020963 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-08e0cc8c-33c0-4af2-9123-a6f5fe562eb2 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:42.021664 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-08e0cc8c-33c0-4af2-9123-a6f5fe562eb2 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: d9d9afd3-aeba-4429-a474-7c70a960d4e0] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:03:42.028360 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-71cf1123-e9d7-474a-9fcf-477497dc04a1 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:42.029263 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-71cf1123-e9d7-474a-9fcf-477497dc04a1 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:42.033618 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-71cf1123-e9d7-474a-9fcf-477497dc04a1 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:42.110695 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-08e0cc8c-33c0-4af2-9123-a6f5fe562eb2 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:42.124545 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-08e0cc8c-33c0-4af2-9123-a6f5fe562eb2 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/d9d9afd3-aeba-4429-a474-7c70a960d4e0" status: 200 len: 1215 microversion: 2.1 time: 0.117665 Sep 14 09:03:42.133175 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1737/3428] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:03:42 2022] GET /compute/v2.1/servers/d9d9afd3-aeba-4429-a474-7c70a960d4e0 => generated 1215 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:03:42.151902 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-70524718-72da-4158-bfaa-d9e04b3b1b2f tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:42.152742 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-70524718-72da-4158-bfaa-d9e04b3b1b2f tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] [instance: 900c4e61-76fe-472f-bba7-0c83895f62cf] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:03:42.155443 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-71cf1123-e9d7-474a-9fcf-477497dc04a1 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:42.158865 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-70524718-72da-4158-bfaa-d9e04b3b1b2f tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:42.159358 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-70524718-72da-4158-bfaa-d9e04b3b1b2f tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:42.159795 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-70524718-72da-4158-bfaa-d9e04b3b1b2f tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:42.160494 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-70524718-72da-4158-bfaa-d9e04b3b1b2f tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:42.161169 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-70524718-72da-4158-bfaa-d9e04b3b1b2f tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:42.161841 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-70524718-72da-4158-bfaa-d9e04b3b1b2f tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:42.166523 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-71cf1123-e9d7-474a-9fcf-477497dc04a1 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:42.168851 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-71cf1123-e9d7-474a-9fcf-477497dc04a1 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:42.175631 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-71cf1123-e9d7-474a-9fcf-477497dc04a1 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] 10.222.0.60 "GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf" status: 200 len: 1488 microversion: 2.91 time: 0.176684 Sep 14 09:03:42.176881 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1692/3429] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:03:41 2022] GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf => generated 1488 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:03:42.234634 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-70524718-72da-4158-bfaa-d9e04b3b1b2f tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84afbf1d30574a7aa1186a481687c50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a90781147416fa5db6b8922209058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:42.252589 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-70524718-72da-4158-bfaa-d9e04b3b1b2f tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84afbf1d30574a7aa1186a481687c50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a90781147416fa5db6b8922209058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:42.256614 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-70524718-72da-4158-bfaa-d9e04b3b1b2f tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84afbf1d30574a7aa1186a481687c50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a90781147416fa5db6b8922209058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:42.258568 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-70524718-72da-4158-bfaa-d9e04b3b1b2f tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] 10.222.0.60 "GET /compute/v2.1/servers/900c4e61-76fe-472f-bba7-0c83895f62cf" status: 200 len: 1356 microversion: 2.54 time: 0.123988 Sep 14 09:03:42.259404 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1738/3430] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:03:42 2022] GET /compute/v2.1/servers/900c4e61-76fe-472f-bba7-0c83895f62cf => generated 1356 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:03:42.292297 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-dad970a7-fc7d-47b9-aa9c-0424b8e49e4d tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Action: 'create', calling method: .version_select at 0x7f7d3fbe4700>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-323069994", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFsh00LRJ+i2mqJ9RU7PcmD2vr5JFbk1SvpexZcDuphiD8PPcZy0xDi1sFIlDTJP0WZEh1e9mesESzwJ8Agg9KG1pRX9hfskE5xfzdB1jhTtGgRx/HTAXJMutSWeeoEG4w=="}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:03:42.316638 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-dad970a7-fc7d-47b9-aa9c-0424b8e49e4d tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Getting quotas for project 730a90781147416fa5db6b8922209058. Resources: {'key_pairs'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:03:42.324611 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-dad970a7-fc7d-47b9-aa9c-0424b8e49e4d tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Getting quotas for user 84afbf1d30574a7aa1186a481687c50c and project 730a90781147416fa5db6b8922209058. Resources: {'key_pairs'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:03:42.337092 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1473e205-16be-4092-b542-4b17456fa531 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:42.338183 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-1473e205-16be-4092-b542-4b17456fa531 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] [instance: 7558efb0-7f2d-42d5-9b6d-e442008b1c88] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:03:42.350037 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1473e205-16be-4092-b542-4b17456fa531 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:42.350840 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1473e205-16be-4092-b542-4b17456fa531 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:42.351472 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1473e205-16be-4092-b542-4b17456fa531 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:42.352497 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1473e205-16be-4092-b542-4b17456fa531 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:42.354435 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1473e205-16be-4092-b542-4b17456fa531 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:42.359641 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1473e205-16be-4092-b542-4b17456fa531 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:42.400050 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-1473e205-16be-4092-b542-4b17456fa531 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] HTTP exception thrown: Instance 7558efb0-7f2d-42d5-9b6d-e442008b1c88 could not be found. Sep 14 09:03:42.401754 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1473e205-16be-4092-b542-4b17456fa531 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Request method failure captured: Sep 14 09:03:42.401754 n-d-836830-18 devstack@n-api.service[128758]: request: GET /compute/v2.1/servers/7558efb0-7f2d-42d5-9b6d-e442008b1c88 HTTP/1.1 Sep 14 09:03:42.401754 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 09:03:42.401754 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 09:03:42.401754 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 09:03:42.401754 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 09:03:42.401754 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 09:03:42.401754 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 09:03:42.401754 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 09:03:42.401754 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 09:03:42.401754 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZiI-AkucMBaroluh1OyKtWIJyIdpyMdoktsRW_FiZsmRsli3WLei89jIV561123NfLfmQ7r3NcWskpXIOkKdUGeV-Df7F1xHrD8jZvuF1pJg1uUAwA0q4Gbsk7G-GLeYjCbSLXbRcD9cwaMyw349Js3YHSxw5JqRoOVRMDSSC2mNqU Sep 14 09:03:42.401754 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 09:03:42.401754 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 09:03:42.401754 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 09:03:42.401754 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 09:03:42.401754 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 09:03:42.401754 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 09:03:42.401754 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 9051111ca00649c591b6485d58bbc265 Sep 14 09:03:42.401754 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-ImagesOneServerTestJSON-148298783 Sep 14 09:03:42.401754 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 09:03:42.401754 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 09:03:42.401754 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/9051111ca00649c591b6485d58bbc265"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_9051111ca00649c591b6485d58bbc265"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9051111ca00649c591b6485d58bbc265"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9051111ca00649c591b6485d58bbc265"}]}] Sep 14 09:03:42.401754 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-ImagesOneServerTestJSON-148298783 Sep 14 09:03:42.401754 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 9051111ca00649c591b6485d58bbc265 Sep 14 09:03:42.401754 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-148298783 Sep 14 09:03:42.401754 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-ImagesOneServerTestJSON-148298783-project Sep 14 09:03:42.401754 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 09:03:42.401754 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 09:03:42.401754 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 2b847ccce0654f2fa9df8367320a3218 Sep 14 09:03:42.401754 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-ImagesOneServerTestJSON-148298783-project Sep 14 09:03:42.401754 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 09:03:42.401754 n-d-836830-18 devstack@n-api.service[128758]: exception: Instance 7558efb0-7f2d-42d5-9b6d-e442008b1c88 could not be found. Sep 14 09:03:42.401754 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': '7558efb0-7f2d-42d5-9b6d-e442008b1c88'} Sep 14 09:03:42.401754 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:03:42.401754 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:03:42.401754 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:03:42.401754 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:03:42.401754 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:03:42.401754 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:03:42.401754 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:03:42.401754 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:03:42.401754 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:03:42.401754 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:03:42.401754 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7558efb0-7f2d-42d5-9b6d-e442008b1c88 could not be found. Sep 14 09:03:42.401754 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:03:42.401754 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:03:42.401754 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:03:42.401754 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:03:42.401754 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:03:42.401754 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:03:42.401754 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:03:42.401754 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:03:42.401754 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:03:42.401754 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:03:42.401754 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:03:42.401754 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:03:42.401754 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:03:42.401754 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:03:42.401754 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:03:42.401754 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:03:42.401754 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7558efb0-7f2d-42d5-9b6d-e442008b1c88 could not be found. Sep 14 09:03:42.401754 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:03:42.401754 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:03:42.401754 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:03:42.406071 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:03:42.406071 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:03:42.406071 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:03:42.406071 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:03:42.406071 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:03:42.406071 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7558efb0-7f2d-42d5-9b6d-e442008b1c88 could not be found. Sep 14 09:03:42.406071 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:03:42.407561 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1473e205-16be-4092-b542-4b17456fa531 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] Returning 404 to user: Instance 7558efb0-7f2d-42d5-9b6d-e442008b1c88 could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:03:42.407710 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-dad970a7-fc7d-47b9-aa9c-0424b8e49e4d tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 201 len: 419 microversion: 2.54 time: 0.121062 Sep 14 09:03:42.408314 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1693/3431] 10.222.0.60 () {62 vars in 1200 bytes} [Wed Sep 14 09:03:42 2022] POST /compute/v2.1/os-keypairs => generated 419 bytes in 124 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 14 09:03:42.408997 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-1473e205-16be-4092-b542-4b17456fa531 tempest-ImagesOneServerTestJSON-148298783 tempest-ImagesOneServerTestJSON-148298783-project] 10.222.0.60 "GET /compute/v2.1/servers/7558efb0-7f2d-42d5-9b6d-e442008b1c88" status: 404 len: 111 microversion: 2.1 time: 0.076293 Sep 14 09:03:42.413102 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1739/3432] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:03:42 2022] GET /compute/v2.1/servers/7558efb0-7f2d-42d5-9b6d-e442008b1c88 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 14 09:03:42.433804 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-bc54cdfe-83c6-43b2-94bf-0d77af6a9446 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-323069994", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:03:42.444924 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-bc54cdfe-83c6-43b2-94bf-0d77af6a9446 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] [instance: 900c4e61-76fe-472f-bba7-0c83895f62cf] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:03:42.454630 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:03:42.461460 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bc54cdfe-83c6-43b2-94bf-0d77af6a9446 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:42.462131 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bc54cdfe-83c6-43b2-94bf-0d77af6a9446 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:42.462587 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bc54cdfe-83c6-43b2-94bf-0d77af6a9446 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:42.463672 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bc54cdfe-83c6-43b2-94bf-0d77af6a9446 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:42.464722 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bc54cdfe-83c6-43b2-94bf-0d77af6a9446 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:42.465709 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bc54cdfe-83c6-43b2-94bf-0d77af6a9446 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:42.582263 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:03:42.606431 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-bc54cdfe-83c6-43b2-94bf-0d77af6a9446 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Flavor limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:03:42.606874 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-bc54cdfe-83c6-43b2-94bf-0d77af6a9446 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Image limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:03:42.607388 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-bc54cdfe-83c6-43b2-94bf-0d77af6a9446 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Flavor pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:03:42.607810 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-bc54cdfe-83c6-43b2-94bf-0d77af6a9446 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Image pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:03:42.608250 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-bc54cdfe-83c6-43b2-94bf-0d77af6a9446 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:03:42.737441 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-bc54cdfe-83c6-43b2-94bf-0d77af6a9446 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] [instance: 900c4e61-76fe-472f-bba7-0c83895f62cf] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:03:42.745260 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bc54cdfe-83c6-43b2-94bf-0d77af6a9446 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:42.745753 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bc54cdfe-83c6-43b2-94bf-0d77af6a9446 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:42.746274 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bc54cdfe-83c6-43b2-94bf-0d77af6a9446 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:42.746888 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bc54cdfe-83c6-43b2-94bf-0d77af6a9446 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:42.747373 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bc54cdfe-83c6-43b2-94bf-0d77af6a9446 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:42.747794 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bc54cdfe-83c6-43b2-94bf-0d77af6a9446 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:42.750067 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d70565c3-15a9-414b-8f4d-14ac55819b63 tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:42.751790 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-d70565c3-15a9-414b-8f4d-14ac55819b63 tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] [instance: d9ab57a3-b59b-4a19-99cc-d8f8383d10a8] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:03:42.762306 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:03:42.764512 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d70565c3-15a9-414b-8f4d-14ac55819b63 tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:42.765400 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d70565c3-15a9-414b-8f4d-14ac55819b63 tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:42.770202 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d70565c3-15a9-414b-8f4d-14ac55819b63 tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:42.770202 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d70565c3-15a9-414b-8f4d-14ac55819b63 tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:42.770202 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d70565c3-15a9-414b-8f4d-14ac55819b63 tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:42.770202 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d70565c3-15a9-414b-8f4d-14ac55819b63 tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:42.796223 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-bc54cdfe-83c6-43b2-94bf-0d77af6a9446 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] 10.222.0.60 "POST /compute/v2.1/servers/900c4e61-76fe-472f-bba7-0c83895f62cf/action" status: 202 len: 1138 microversion: 2.54 time: 0.379191 Sep 14 09:03:42.797179 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1694/3433] 10.222.0.60 () {62 vars in 1320 bytes} [Wed Sep 14 09:03:42 2022] POST /compute/v2.1/servers/900c4e61-76fe-472f-bba7-0c83895f62cf/action => generated 1138 bytes in 382 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Sep 14 09:03:42.828988 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-93e92e84-88de-44ef-a1d7-745501d55bda tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:42.830013 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-93e92e84-88de-44ef-a1d7-745501d55bda tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] [instance: 900c4e61-76fe-472f-bba7-0c83895f62cf] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:03:42.836949 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-93e92e84-88de-44ef-a1d7-745501d55bda tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:42.837607 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-93e92e84-88de-44ef-a1d7-745501d55bda tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:42.838105 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-93e92e84-88de-44ef-a1d7-745501d55bda tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:42.839006 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-93e92e84-88de-44ef-a1d7-745501d55bda tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:42.839791 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-93e92e84-88de-44ef-a1d7-745501d55bda tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:42.840227 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-93e92e84-88de-44ef-a1d7-745501d55bda tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:43.021537 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-93e92e84-88de-44ef-a1d7-745501d55bda tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84afbf1d30574a7aa1186a481687c50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a90781147416fa5db6b8922209058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:43.042750 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-93e92e84-88de-44ef-a1d7-745501d55bda tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84afbf1d30574a7aa1186a481687c50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a90781147416fa5db6b8922209058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:43.053520 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-93e92e84-88de-44ef-a1d7-745501d55bda tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84afbf1d30574a7aa1186a481687c50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a90781147416fa5db6b8922209058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:43.055142 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-93e92e84-88de-44ef-a1d7-745501d55bda tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] 10.222.0.60 "GET /compute/v2.1/servers/900c4e61-76fe-472f-bba7-0c83895f62cf" status: 200 len: 1407 microversion: 2.54 time: 0.235063 Sep 14 09:03:43.056248 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1695/3434] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:03:42 2022] GET /compute/v2.1/servers/900c4e61-76fe-472f-bba7-0c83895f62cf => generated 1407 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:03:43.075915 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-0e5fdf26-7560-4d12-b904-4183b0a6f809 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:43.076912 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-0e5fdf26-7560-4d12-b904-4183b0a6f809 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] [instance: 36253bc6-1737-4654-a878-c1eaeb797c8e] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:03:43.084564 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0e5fdf26-7560-4d12-b904-4183b0a6f809 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:43.085156 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0e5fdf26-7560-4d12-b904-4183b0a6f809 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:43.085693 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0e5fdf26-7560-4d12-b904-4183b0a6f809 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:43.086490 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0e5fdf26-7560-4d12-b904-4183b0a6f809 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:43.087084 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0e5fdf26-7560-4d12-b904-4183b0a6f809 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:43.087743 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0e5fdf26-7560-4d12-b904-4183b0a6f809 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:43.118812 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-0e5fdf26-7560-4d12-b904-4183b0a6f809 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] HTTP exception thrown: Instance 36253bc6-1737-4654-a878-c1eaeb797c8e could not be found. Sep 14 09:03:43.124150 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-0e5fdf26-7560-4d12-b904-4183b0a6f809 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Request method failure captured: Sep 14 09:03:43.124150 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/36253bc6-1737-4654-a878-c1eaeb797c8e HTTP/1.1 Sep 14 09:03:43.124150 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:03:43.124150 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:03:43.124150 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:03:43.124150 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:03:43.124150 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:03:43.124150 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:03:43.124150 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:03:43.124150 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:03:43.124150 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZh0fLmNlp5hM0yWlDvW36KfrrIHpOuRZfGcuRs23sCF5zFlyoDT5R6s-UM4kUmBphXR7aDKVnqY4sfmazOIoQz_DvkvU2elb7vE0xZ33w8smpF6vXAriaEIuoW1oy3enxLQN5ygpfF9oHqNJqQQfVkLPc7KoLj47ZAjltTE-E5bVuE Sep 14 09:03:43.124150 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:03:43.124150 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:03:43.124150 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:03:43.124150 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:03:43.124150 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:03:43.124150 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:03:43.124150 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: e712ce30eb9c4128aa0ec1d425e9ab79 Sep 14 09:03:43.124150 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ListServerFiltersTestJSON-1717892064 Sep 14 09:03:43.124150 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:03:43.124150 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:03:43.124150 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e712ce30eb9c4128aa0ec1d425e9ab79"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e712ce30eb9c4128aa0ec1d425e9ab79"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e712ce30eb9c4128aa0ec1d425e9ab79"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e712ce30eb9c4128aa0ec1d425e9ab79"}]}] Sep 14 09:03:43.124150 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ListServerFiltersTestJSON-1717892064 Sep 14 09:03:43.124150 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: e712ce30eb9c4128aa0ec1d425e9ab79 Sep 14 09:03:43.124150 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1717892064 Sep 14 09:03:43.124150 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ListServerFiltersTestJSON-1717892064-project Sep 14 09:03:43.124150 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:03:43.124150 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:03:43.124150 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: d6e7ddc7c037439aad2f98277eef199e Sep 14 09:03:43.124150 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ListServerFiltersTestJSON-1717892064-project Sep 14 09:03:43.124150 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:03:43.124150 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance 36253bc6-1737-4654-a878-c1eaeb797c8e could not be found. Sep 14 09:03:43.124150 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '36253bc6-1737-4654-a878-c1eaeb797c8e'} Sep 14 09:03:43.124150 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:03:43.124150 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:03:43.124150 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:03:43.124150 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:03:43.124150 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:03:43.124150 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:03:43.124150 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:03:43.124150 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:03:43.124150 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:03:43.124150 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:03:43.124150 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36253bc6-1737-4654-a878-c1eaeb797c8e could not be found. Sep 14 09:03:43.124150 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:03:43.124150 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:03:43.124150 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:03:43.124150 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:03:43.124150 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:03:43.124150 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:03:43.124150 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:03:43.124150 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:03:43.124150 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:03:43.124150 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:03:43.124150 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:03:43.124150 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:03:43.124150 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:03:43.124150 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:03:43.124150 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:03:43.124150 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:03:43.124150 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36253bc6-1737-4654-a878-c1eaeb797c8e could not be found. Sep 14 09:03:43.124150 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:03:43.124150 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:03:43.124150 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:03:43.132401 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:03:43.132401 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:03:43.132401 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:03:43.132401 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:03:43.132401 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:03:43.132401 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36253bc6-1737-4654-a878-c1eaeb797c8e could not be found. Sep 14 09:03:43.132401 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:03:43.132401 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-0e5fdf26-7560-4d12-b904-4183b0a6f809 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Returning 404 to user: Instance 36253bc6-1737-4654-a878-c1eaeb797c8e could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:03:43.132401 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-0e5fdf26-7560-4d12-b904-4183b0a6f809 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] 10.222.0.60 "GET /compute/v2.1/servers/36253bc6-1737-4654-a878-c1eaeb797c8e" status: 404 len: 111 microversion: 2.1 time: 0.070465 Sep 14 09:03:43.134710 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1696/3435] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:03:43 2022] GET /compute/v2.1/servers/36253bc6-1737-4654-a878-c1eaeb797c8e => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:03:43.141702 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-681713f8-61c9-4d92-9853-aaaf88253d4f tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:43.144852 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-681713f8-61c9-4d92-9853-aaaf88253d4f tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] [instance: 3d29c068-39c8-4851-82cf-b7639f689f24] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:03:43.161622 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-681713f8-61c9-4d92-9853-aaaf88253d4f tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:43.162406 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-681713f8-61c9-4d92-9853-aaaf88253d4f tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:43.163050 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-681713f8-61c9-4d92-9853-aaaf88253d4f tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:43.164360 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-d70565c3-15a9-414b-8f4d-14ac55819b63 tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12ca200f5b7468dac6b0164faa0c171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17461d862f104a3284ffa025efb619e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:43.165682 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-681713f8-61c9-4d92-9853-aaaf88253d4f tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:43.167508 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-681713f8-61c9-4d92-9853-aaaf88253d4f tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:43.168297 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-681713f8-61c9-4d92-9853-aaaf88253d4f tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:43.179643 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-d70565c3-15a9-414b-8f4d-14ac55819b63 tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] 10.222.0.60 "GET /compute/v2.1/servers/d9ab57a3-b59b-4a19-99cc-d8f8383d10a8" status: 200 len: 1504 microversion: 2.1 time: 0.434311 Sep 14 09:03:43.180612 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1740/3436] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:03:42 2022] GET /compute/v2.1/servers/d9ab57a3-b59b-4a19-99cc-d8f8383d10a8 => generated 1504 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:03:43.193406 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1cdd2ec0-bc19-4a50-9a77-ea3412d24f44 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:43.195176 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-1cdd2ec0-bc19-4a50-9a77-ea3412d24f44 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: d9d9afd3-aeba-4429-a474-7c70a960d4e0] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:03:43.214748 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1cdd2ec0-bc19-4a50-9a77-ea3412d24f44 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:43.219271 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-681713f8-61c9-4d92-9853-aaaf88253d4f tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] [instance: 3d29c068-39c8-4851-82cf-b7639f689f24] Going to try to terminate instance {{(pid=128759) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:03:43.221507 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1cdd2ec0-bc19-4a50-9a77-ea3412d24f44 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:43.222724 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1cdd2ec0-bc19-4a50-9a77-ea3412d24f44 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:43.223705 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1cdd2ec0-bc19-4a50-9a77-ea3412d24f44 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:43.226516 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1cdd2ec0-bc19-4a50-9a77-ea3412d24f44 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:43.227237 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1cdd2ec0-bc19-4a50-9a77-ea3412d24f44 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:43.360047 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-1cdd2ec0-bc19-4a50-9a77-ea3412d24f44 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:43.368718 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-681713f8-61c9-4d92-9853-aaaf88253d4f tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] 10.222.0.60 "DELETE /compute/v2.1/servers/3d29c068-39c8-4851-82cf-b7639f689f24" status: 204 len: 0 microversion: 2.1 time: 0.231263 Sep 14 09:03:43.370037 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-1cdd2ec0-bc19-4a50-9a77-ea3412d24f44 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/d9d9afd3-aeba-4429-a474-7c70a960d4e0" status: 200 len: 1267 microversion: 2.1 time: 0.188335 Sep 14 09:03:43.372968 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1697/3437] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:03:43 2022] DELETE /compute/v2.1/servers/3d29c068-39c8-4851-82cf-b7639f689f24 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:03:43.377093 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1741/3438] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:03:43 2022] GET /compute/v2.1/servers/d9d9afd3-aeba-4429-a474-7c70a960d4e0 => generated 1267 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:03:43.379751 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-76f3eb04-cb1d-4bbe-a253-5ee0c4d0279e tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Calling method '.version_select at 0x7f7d3ff96940>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:43.380812 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-76f3eb04-cb1d-4bbe-a253-5ee0c4d0279e tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] [instance: d9ab57a3-b59b-4a19-99cc-d8f8383d10a8] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:03:43.389476 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-76f3eb04-cb1d-4bbe-a253-5ee0c4d0279e tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:43.390235 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-76f3eb04-cb1d-4bbe-a253-5ee0c4d0279e tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:43.392336 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-76f3eb04-cb1d-4bbe-a253-5ee0c4d0279e tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:43.393540 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-76f3eb04-cb1d-4bbe-a253-5ee0c4d0279e tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:43.394422 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-bc00ef61-171f-4973-93f4-c231620c8f33 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:43.394551 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-76f3eb04-cb1d-4bbe-a253-5ee0c4d0279e tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:43.395121 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-bc00ef61-171f-4973-93f4-c231620c8f33 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] [instance: 0eb40c80-c056-4096-a586-7e957a63f7cf] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:03:43.395462 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-76f3eb04-cb1d-4bbe-a253-5ee0c4d0279e tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:43.405174 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bc00ef61-171f-4973-93f4-c231620c8f33 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:43.405675 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bc00ef61-171f-4973-93f4-c231620c8f33 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:43.406112 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bc00ef61-171f-4973-93f4-c231620c8f33 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:43.406814 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bc00ef61-171f-4973-93f4-c231620c8f33 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:43.407307 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bc00ef61-171f-4973-93f4-c231620c8f33 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:43.407919 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bc00ef61-171f-4973-93f4-c231620c8f33 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:43.464151 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-76f3eb04-cb1d-4bbe-a253-5ee0c4d0279e tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] 10.222.0.60 "GET /compute/v2.1/servers/d9ab57a3-b59b-4a19-99cc-d8f8383d10a8/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.087275 Sep 14 09:03:43.464759 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1698/3439] 10.222.0.60 () {58 vars in 1296 bytes} [Wed Sep 14 09:03:43 2022] GET /compute/v2.1/servers/d9ab57a3-b59b-4a19-99cc-d8f8383d10a8/os-instance-actions => generated 611 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:03:43.485261 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-0cd86c84-934e-4f7b-a1ac-116788729843 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:43.485983 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-0cd86c84-934e-4f7b-a1ac-116788729843 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] [instance: 3d29c068-39c8-4851-82cf-b7639f689f24] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:03:43.494644 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0cd86c84-934e-4f7b-a1ac-116788729843 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:43.495480 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0cd86c84-934e-4f7b-a1ac-116788729843 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:43.496075 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0cd86c84-934e-4f7b-a1ac-116788729843 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:43.496976 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0cd86c84-934e-4f7b-a1ac-116788729843 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:43.497600 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0cd86c84-934e-4f7b-a1ac-116788729843 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:43.498198 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0cd86c84-934e-4f7b-a1ac-116788729843 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:43.588754 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-bc00ef61-171f-4973-93f4-c231620c8f33 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:43.599014 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-bc00ef61-171f-4973-93f4-c231620c8f33 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:43.601394 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-bc00ef61-171f-4973-93f4-c231620c8f33 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:43.607402 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-bc00ef61-171f-4973-93f4-c231620c8f33 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] 10.222.0.60 "GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf" status: 200 len: 1544 microversion: 2.91 time: 0.229102 Sep 14 09:03:43.619670 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1742/3440] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:03:43 2022] GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf => generated 1544 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:03:43.634379 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-dde9279d-76f9-49d4-8976-35d9288d3483 tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:43.635772 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-dde9279d-76f9-49d4-8976-35d9288d3483 tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] [instance: d9ab57a3-b59b-4a19-99cc-d8f8383d10a8] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:03:43.642277 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dde9279d-76f9-49d4-8976-35d9288d3483 tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:43.643672 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dde9279d-76f9-49d4-8976-35d9288d3483 tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:43.644427 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dde9279d-76f9-49d4-8976-35d9288d3483 tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:43.645880 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dde9279d-76f9-49d4-8976-35d9288d3483 tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:43.648132 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dde9279d-76f9-49d4-8976-35d9288d3483 tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:43.648794 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dde9279d-76f9-49d4-8976-35d9288d3483 tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:43.696491 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-dde9279d-76f9-49d4-8976-35d9288d3483 tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] [instance: d9ab57a3-b59b-4a19-99cc-d8f8383d10a8] Going to try to terminate instance {{(pid=128758) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:03:43.796283 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-0cd86c84-934e-4f7b-a1ac-116788729843 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e7ddc7c037439aad2f98277eef199e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e712ce30eb9c4128aa0ec1d425e9ab79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:43.806182 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-0cd86c84-934e-4f7b-a1ac-116788729843 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] 10.222.0.60 "GET /compute/v2.1/servers/3d29c068-39c8-4851-82cf-b7639f689f24" status: 200 len: 1516 microversion: 2.1 time: 0.330378 Sep 14 09:03:43.823408 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1699/3441] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:03:43 2022] GET /compute/v2.1/servers/3d29c068-39c8-4851-82cf-b7639f689f24 => generated 1516 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:03:43.856688 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-dde9279d-76f9-49d4-8976-35d9288d3483 tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] 10.222.0.60 "DELETE /compute/v2.1/servers/d9ab57a3-b59b-4a19-99cc-d8f8383d10a8" status: 204 len: 0 microversion: 2.1 time: 0.235349 Sep 14 09:03:43.857639 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1743/3442] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:03:43 2022] DELETE /compute/v2.1/servers/d9ab57a3-b59b-4a19-99cc-d8f8383d10a8 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:03:43.865999 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-36ac988f-ddf4-4b63-b1f7-ffff5ca42420 tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:43.866687 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-36ac988f-ddf4-4b63-b1f7-ffff5ca42420 tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] [instance: d9ab57a3-b59b-4a19-99cc-d8f8383d10a8] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:03:43.876226 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-36ac988f-ddf4-4b63-b1f7-ffff5ca42420 tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:43.876226 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-36ac988f-ddf4-4b63-b1f7-ffff5ca42420 tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:43.876226 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-36ac988f-ddf4-4b63-b1f7-ffff5ca42420 tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:43.876634 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-36ac988f-ddf4-4b63-b1f7-ffff5ca42420 tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:43.876958 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-36ac988f-ddf4-4b63-b1f7-ffff5ca42420 tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:43.877672 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-36ac988f-ddf4-4b63-b1f7-ffff5ca42420 tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:44.090015 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b00adb61-c600-4d4e-8f0b-73618aab16b1 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:44.093444 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-b00adb61-c600-4d4e-8f0b-73618aab16b1 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] [instance: 900c4e61-76fe-472f-bba7-0c83895f62cf] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:03:44.105070 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b00adb61-c600-4d4e-8f0b-73618aab16b1 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:44.107562 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b00adb61-c600-4d4e-8f0b-73618aab16b1 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:44.108238 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b00adb61-c600-4d4e-8f0b-73618aab16b1 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:44.109472 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b00adb61-c600-4d4e-8f0b-73618aab16b1 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:44.115719 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b00adb61-c600-4d4e-8f0b-73618aab16b1 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:44.116438 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b00adb61-c600-4d4e-8f0b-73618aab16b1 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:44.299292 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-b00adb61-c600-4d4e-8f0b-73618aab16b1 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84afbf1d30574a7aa1186a481687c50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a90781147416fa5db6b8922209058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:44.312877 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-b00adb61-c600-4d4e-8f0b-73618aab16b1 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84afbf1d30574a7aa1186a481687c50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a90781147416fa5db6b8922209058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:44.316716 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-b00adb61-c600-4d4e-8f0b-73618aab16b1 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84afbf1d30574a7aa1186a481687c50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a90781147416fa5db6b8922209058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:44.317836 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-b00adb61-c600-4d4e-8f0b-73618aab16b1 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] 10.222.0.60 "GET /compute/v2.1/servers/900c4e61-76fe-472f-bba7-0c83895f62cf" status: 200 len: 1407 microversion: 2.54 time: 0.233393 Sep 14 09:03:44.318541 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1744/3443] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:03:44 2022] GET /compute/v2.1/servers/900c4e61-76fe-472f-bba7-0c83895f62cf => generated 1407 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:03:44.391752 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-36ac988f-ddf4-4b63-b1f7-ffff5ca42420 tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12ca200f5b7468dac6b0164faa0c171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17461d862f104a3284ffa025efb619e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:44.404208 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d0f01e40-8ebc-48c4-8b08-982662498b0e tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:44.404846 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-d0f01e40-8ebc-48c4-8b08-982662498b0e tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: d9d9afd3-aeba-4429-a474-7c70a960d4e0] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:03:44.418167 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d0f01e40-8ebc-48c4-8b08-982662498b0e tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:44.418664 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d0f01e40-8ebc-48c4-8b08-982662498b0e tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:44.419149 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d0f01e40-8ebc-48c4-8b08-982662498b0e tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:44.419870 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d0f01e40-8ebc-48c4-8b08-982662498b0e tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:44.420331 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d0f01e40-8ebc-48c4-8b08-982662498b0e tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:44.420756 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d0f01e40-8ebc-48c4-8b08-982662498b0e tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:44.423516 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-36ac988f-ddf4-4b63-b1f7-ffff5ca42420 tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] 10.222.0.60 "GET /compute/v2.1/servers/d9ab57a3-b59b-4a19-99cc-d8f8383d10a8" status: 200 len: 1510 microversion: 2.1 time: 0.553797 Sep 14 09:03:44.424534 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1700/3444] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:03:43 2022] GET /compute/v2.1/servers/d9ab57a3-b59b-4a19-99cc-d8f8383d10a8 => generated 1510 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:03:44.545049 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-d0f01e40-8ebc-48c4-8b08-982662498b0e tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:44.561109 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-d0f01e40-8ebc-48c4-8b08-982662498b0e tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/d9d9afd3-aeba-4429-a474-7c70a960d4e0" status: 200 len: 1273 microversion: 2.1 time: 0.160659 Sep 14 09:03:44.592267 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1745/3445] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:03:44 2022] GET /compute/v2.1/servers/d9d9afd3-aeba-4429-a474-7c70a960d4e0 => generated 1273 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:03:44.638772 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ab688bf0-e31b-4549-a93e-b45fc1701614 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:44.639644 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-ab688bf0-e31b-4549-a93e-b45fc1701614 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] [instance: 0eb40c80-c056-4096-a586-7e957a63f7cf] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:03:44.656269 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ab688bf0-e31b-4549-a93e-b45fc1701614 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:44.657229 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ab688bf0-e31b-4549-a93e-b45fc1701614 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:44.657229 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ab688bf0-e31b-4549-a93e-b45fc1701614 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:44.657915 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ab688bf0-e31b-4549-a93e-b45fc1701614 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:44.658377 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ab688bf0-e31b-4549-a93e-b45fc1701614 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:44.658808 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ab688bf0-e31b-4549-a93e-b45fc1701614 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:44.836430 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-8e3db00c-c884-4187-9286-8a5a7206f31c tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:44.837319 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-8e3db00c-c884-4187-9286-8a5a7206f31c tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] [instance: 3d29c068-39c8-4851-82cf-b7639f689f24] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:03:44.851942 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8e3db00c-c884-4187-9286-8a5a7206f31c tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:44.853031 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8e3db00c-c884-4187-9286-8a5a7206f31c tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:44.857748 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8e3db00c-c884-4187-9286-8a5a7206f31c tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:44.859312 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8e3db00c-c884-4187-9286-8a5a7206f31c tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:44.861562 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8e3db00c-c884-4187-9286-8a5a7206f31c tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:44.862363 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8e3db00c-c884-4187-9286-8a5a7206f31c tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:45.032733 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-ab688bf0-e31b-4549-a93e-b45fc1701614 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:45.043258 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-ab688bf0-e31b-4549-a93e-b45fc1701614 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:45.048007 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-ab688bf0-e31b-4549-a93e-b45fc1701614 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:45.063727 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-ab688bf0-e31b-4549-a93e-b45fc1701614 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] 10.222.0.60 "GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf" status: 200 len: 1544 microversion: 2.91 time: 0.428525 Sep 14 09:03:45.064957 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1701/3446] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:03:44 2022] GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf => generated 1544 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:03:45.346657 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b95f37c2-1d6b-44b2-b0ff-4c43ffbebd66 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:45.347482 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b95f37c2-1d6b-44b2-b0ff-4c43ffbebd66 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] [instance: 900c4e61-76fe-472f-bba7-0c83895f62cf] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:03:45.366843 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b95f37c2-1d6b-44b2-b0ff-4c43ffbebd66 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:45.367790 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b95f37c2-1d6b-44b2-b0ff-4c43ffbebd66 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:45.368736 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b95f37c2-1d6b-44b2-b0ff-4c43ffbebd66 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:45.373262 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b95f37c2-1d6b-44b2-b0ff-4c43ffbebd66 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:45.376202 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b95f37c2-1d6b-44b2-b0ff-4c43ffbebd66 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:45.376971 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b95f37c2-1d6b-44b2-b0ff-4c43ffbebd66 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:45.797687 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b95f37c2-1d6b-44b2-b0ff-4c43ffbebd66 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84afbf1d30574a7aa1186a481687c50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a90781147416fa5db6b8922209058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:45.806867 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b95f37c2-1d6b-44b2-b0ff-4c43ffbebd66 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84afbf1d30574a7aa1186a481687c50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a90781147416fa5db6b8922209058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:45.812806 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b95f37c2-1d6b-44b2-b0ff-4c43ffbebd66 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84afbf1d30574a7aa1186a481687c50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a90781147416fa5db6b8922209058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:45.815307 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b95f37c2-1d6b-44b2-b0ff-4c43ffbebd66 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] 10.222.0.60 "GET /compute/v2.1/servers/900c4e61-76fe-472f-bba7-0c83895f62cf" status: 200 len: 1407 microversion: 2.54 time: 0.473449 Sep 14 09:03:45.818524 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1702/3447] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:03:45 2022] GET /compute/v2.1/servers/900c4e61-76fe-472f-bba7-0c83895f62cf => generated 1407 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:03:45.824012 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8fbf04da-7f44-4f94-8031-9c90a3c2540b tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:45.833295 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-8fbf04da-7f44-4f94-8031-9c90a3c2540b tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] [instance: d9ab57a3-b59b-4a19-99cc-d8f8383d10a8] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:03:45.852201 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8fbf04da-7f44-4f94-8031-9c90a3c2540b tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:45.853136 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8fbf04da-7f44-4f94-8031-9c90a3c2540b tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:45.854521 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8fbf04da-7f44-4f94-8031-9c90a3c2540b tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:45.855534 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8fbf04da-7f44-4f94-8031-9c90a3c2540b tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:45.856250 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8fbf04da-7f44-4f94-8031-9c90a3c2540b tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:45.856916 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8fbf04da-7f44-4f94-8031-9c90a3c2540b tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:46.065785 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-8e3db00c-c884-4187-9286-8a5a7206f31c tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e7ddc7c037439aad2f98277eef199e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e712ce30eb9c4128aa0ec1d425e9ab79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:46.077613 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-8e3db00c-c884-4187-9286-8a5a7206f31c tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] 10.222.0.60 "GET /compute/v2.1/servers/3d29c068-39c8-4851-82cf-b7639f689f24" status: 200 len: 1516 microversion: 2.1 time: 1.245388 Sep 14 09:03:46.081439 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1746/3448] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:03:44 2022] GET /compute/v2.1/servers/3d29c068-39c8-4851-82cf-b7639f689f24 => generated 1516 bytes in 1250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:03:46.412424 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c7b9493b-e482-4e92-9cea-245e0029ccc4 tempest-KeyPairsNegativeTestJSON-2139255772 tempest-KeyPairsNegativeTestJSON-2139255772-project] Action: 'create', calling method: .version_select at 0x7f7d3f591ca0>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMcMZIwZbUT5ofsPhFCHLYNgfm8HpU83Ym/xLUKShc8iJ1Ki/f984l+lBhS9Ez/whmS9+9yZSPBDc8939oCQP3su48vmULk9t/3NuXUjSY8lec+x2mYEz/nr8T2E2xGvNg=="}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:03:46.417795 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c7b9493b-e482-4e92-9cea-245e0029ccc4 tempest-KeyPairsNegativeTestJSON-2139255772 tempest-KeyPairsNegativeTestJSON-2139255772-project] Request method failure captured: Sep 14 09:03:46.417795 n-d-836830-18 devstack@n-api.service[128758]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 14 09:03:46.417795 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 09:03:46.417795 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 09:03:46.417795 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 09:03:46.417795 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 257 Sep 14 09:03:46.417795 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 09:03:46.417795 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 09:03:46.417795 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 09:03:46.417795 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 09:03:46.417795 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZjxXrOXsc7gynby1Zm-lG6NZtdnG0Sze-MaTtQtn5LzS5GhDlS3BoDJQNzQi-FP8Z-BrIV4cxd_aU_Lux4LwWaU9UDNwoc9PgJHQrkUfXVYPHupCXdlLW8K4fo5BqqjLNG3lqk1ZKsM6nWPH0LHh06x5XPD3-YKOtqp0fEBJZuvk9g Sep 14 09:03:46.417795 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 09:03:46.417795 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 09:03:46.417795 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 09:03:46.417795 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 09:03:46.417795 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 09:03:46.417795 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 09:03:46.417795 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: f074b1f139e644c8943d5c46e2056d55 Sep 14 09:03:46.417795 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2139255772 Sep 14 09:03:46.417795 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 09:03:46.417795 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 09:03:46.417795 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f074b1f139e644c8943d5c46e2056d55"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f074b1f139e644c8943d5c46e2056d55"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f074b1f139e644c8943d5c46e2056d55"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f074b1f139e644c8943d5c46e2056d55"}]}] Sep 14 09:03:46.417795 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2139255772 Sep 14 09:03:46.417795 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: f074b1f139e644c8943d5c46e2056d55 Sep 14 09:03:46.417795 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2139255772 Sep 14 09:03:46.417795 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-KeyPairsNegativeTestJSON-2139255772-project Sep 14 09:03:46.417795 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 09:03:46.417795 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 09:03:46.417795 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 58436cb9c7434a51b36db8c860e6d737 Sep 14 09:03:46.417795 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2139255772-project Sep 14 09:03:46.417795 n-d-836830-18 devstack@n-api.service[128758]: Sep 14 09:03:46.417795 n-d-836830-18 devstack@n-api.service[128758]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMcMZIwZbUT5ofsPhFCHLYNgfm8HpU83Ym/xLUKShc8iJ1Ki/f984l+lBhS9Ez/whmS9+9yZSPBDc8939oCQP3su48vmULk9t/3NuXUjSY8lec+x2mYEz/nr8T2E2xGvNg=="}} Sep 14 09:03:46.417795 n-d-836830-18 devstack@n-api.service[128758]: method: Sep 14 09:03:46.417795 n-d-836830-18 devstack@n-api.service[128758]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Sep 14 09:03:46.417795 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMcMZIwZbUT5ofsPhFCHLYNgfm8HpU83Ym/xLUKShc8iJ1Ki/f984l+lBhS9Ez/whmS9+9yZSPBDc8939oCQP3su48vmULk9t/3NuXUjSY8lec+x2mYEz/nr8T2E2xGvNg=='}}} Sep 14 09:03:46.417795 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:03:46.417795 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:03:46.417795 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Sep 14 09:03:46.417795 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi result = func(instance) Sep 14 09:03:46.417795 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Sep 14 09:03:46.417795 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Sep 14 09:03:46.417795 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Sep 14 09:03:46.417795 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Sep 14 09:03:46.417795 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Sep 14 09:03:46.417795 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:03:46.417795 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 14 09:03:46.417795 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:03:46.417795 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:03:46.417795 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 14 09:03:46.417795 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 14 09:03:46.417795 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 14 09:03:46.417795 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise error Sep 14 09:03:46.417795 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Sep 14 09:03:46.417795 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:03:46.417795 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Sep 14 09:03:46.417795 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Sep 14 09:03:46.417795 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Sep 14 09:03:46.417795 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi 'minLength': 1, Sep 14 09:03:46.417795 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi 'type': 'string'} Sep 14 09:03:46.417795 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:03:46.417795 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Sep 14 09:03:46.417795 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Sep 14 09:03:46.417795 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:03:46.422411 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:03:46.422411 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:03:46.422411 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:03:46.422411 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:03:46.422411 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:03:46.422411 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:03:46.422411 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:03:46.422411 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:03:46.422411 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:03:46.422411 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:03:46.422411 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:03:46.422411 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:03:46.422411 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:03:46.422411 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 14 09:03:46.422411 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 14 09:03:46.422411 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 14 09:03:46.422411 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 14 09:03:46.422411 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 14 09:03:46.422411 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 14 09:03:46.422411 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Sep 14 09:03:46.422411 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:03:46.422411 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:03:46.422411 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:03:46.422411 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:03:46.422411 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:03:46.422411 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:03:46.422411 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 14 09:03:46.422411 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 14 09:03:46.422411 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Sep 14 09:03:46.422411 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:03:46.428008 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c7b9493b-e482-4e92-9cea-245e0029ccc4 tempest-KeyPairsNegativeTestJSON-2139255772 tempest-KeyPairsNegativeTestJSON-2139255772-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:03:46.440020 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-c7b9493b-e482-4e92-9cea-245e0029ccc4 tempest-KeyPairsNegativeTestJSON-2139255772 tempest-KeyPairsNegativeTestJSON-2139255772-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.355932 Sep 14 09:03:46.447168 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1747/3449] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Sep 14 09:03:46 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 365 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 14 09:03:46.465311 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ab21fc64-c441-4097-9a63-81b0526522bc tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:46.466230 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-ab21fc64-c441-4097-9a63-81b0526522bc tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: d9d9afd3-aeba-4429-a474-7c70a960d4e0] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:03:46.471291 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-8fbf04da-7f44-4f94-8031-9c90a3c2540b tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12ca200f5b7468dac6b0164faa0c171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17461d862f104a3284ffa025efb619e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:46.485005 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-8fbf04da-7f44-4f94-8031-9c90a3c2540b tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] 10.222.0.60 "GET /compute/v2.1/servers/d9ab57a3-b59b-4a19-99cc-d8f8383d10a8" status: 200 len: 1510 microversion: 2.1 time: 0.665092 Sep 14 09:03:46.486151 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1703/3450] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:03:45 2022] GET /compute/v2.1/servers/d9ab57a3-b59b-4a19-99cc-d8f8383d10a8 => generated 1510 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:03:46.494741 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d40341d8-9e9d-425e-bc2b-1ae64208b658 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:46.497037 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ab21fc64-c441-4097-9a63-81b0526522bc tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:46.497741 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ab21fc64-c441-4097-9a63-81b0526522bc tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:46.498539 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-d40341d8-9e9d-425e-bc2b-1ae64208b658 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] [instance: 0eb40c80-c056-4096-a586-7e957a63f7cf] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:03:46.499172 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ab21fc64-c441-4097-9a63-81b0526522bc tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:46.503295 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ab21fc64-c441-4097-9a63-81b0526522bc tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:46.505861 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ab21fc64-c441-4097-9a63-81b0526522bc tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:46.506512 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ab21fc64-c441-4097-9a63-81b0526522bc tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:46.529551 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d40341d8-9e9d-425e-bc2b-1ae64208b658 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:46.541511 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d40341d8-9e9d-425e-bc2b-1ae64208b658 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:46.542124 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d40341d8-9e9d-425e-bc2b-1ae64208b658 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:46.542978 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d40341d8-9e9d-425e-bc2b-1ae64208b658 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:46.543509 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d40341d8-9e9d-425e-bc2b-1ae64208b658 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:46.544100 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d40341d8-9e9d-425e-bc2b-1ae64208b658 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:47.111605 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-d40341d8-9e9d-425e-bc2b-1ae64208b658 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:47.132637 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-d40341d8-9e9d-425e-bc2b-1ae64208b658 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:47.143976 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-d40341d8-9e9d-425e-bc2b-1ae64208b658 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:47.163471 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d40341d8-9e9d-425e-bc2b-1ae64208b658 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] 10.222.0.60 "GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf" status: 200 len: 1544 microversion: 2.91 time: 0.669989 Sep 14 09:03:47.167214 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1704/3451] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:03:46 2022] GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf => generated 1544 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:03:47.193788 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-efbb49c0-4a9d-4f67-bb3a-df4179cc6570 tempest-KeyPairsNegativeTestJSON-2139255772 tempest-KeyPairsNegativeTestJSON-2139255772-project] Action: 'create', calling method: .version_select at 0x7f7d3fdffe50>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-2082154551", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:03:47.273298 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-efbb49c0-4a9d-4f67-bb3a-df4179cc6570 tempest-KeyPairsNegativeTestJSON-2139255772 tempest-KeyPairsNegativeTestJSON-2139255772-project] Getting quotas for project f074b1f139e644c8943d5c46e2056d55. Resources: {'key_pairs'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:03:47.289699 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-efbb49c0-4a9d-4f67-bb3a-df4179cc6570 tempest-KeyPairsNegativeTestJSON-2139255772 tempest-KeyPairsNegativeTestJSON-2139255772-project] Getting quotas for user 58436cb9c7434a51b36db8c860e6d737 and project f074b1f139e644c8943d5c46e2056d55. Resources: {'key_pairs'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:03:47.326721 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-efbb49c0-4a9d-4f67-bb3a-df4179cc6570 tempest-KeyPairsNegativeTestJSON-2139255772 tempest-KeyPairsNegativeTestJSON-2139255772-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Sep 14 09:03:47.350510 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-efbb49c0-4a9d-4f67-bb3a-df4179cc6570 tempest-KeyPairsNegativeTestJSON-2139255772 tempest-KeyPairsNegativeTestJSON-2139255772-project] Request method failure captured: Sep 14 09:03:47.350510 n-d-836830-18 devstack@n-api.service[128759]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 14 09:03:47.350510 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:03:47.350510 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:03:47.350510 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:03:47.350510 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 2167 Sep 14 09:03:47.350510 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:03:47.350510 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:03:47.350510 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:03:47.350510 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:03:47.350510 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZjxXrOXsc7gynby1Zm-lG6NZtdnG0Sze-MaTtQtn5LzS5GhDlS3BoDJQNzQi-FP8Z-BrIV4cxd_aU_Lux4LwWaU9UDNwoc9PgJHQrkUfXVYPHupCXdlLW8K4fo5BqqjLNG3lqk1ZKsM6nWPH0LHh06x5XPD3-YKOtqp0fEBJZuvk9g Sep 14 09:03:47.350510 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:03:47.350510 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:03:47.350510 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:03:47.350510 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:03:47.350510 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:03:47.350510 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:03:47.350510 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: f074b1f139e644c8943d5c46e2056d55 Sep 14 09:03:47.350510 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2139255772 Sep 14 09:03:47.350510 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:03:47.350510 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:03:47.350510 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f074b1f139e644c8943d5c46e2056d55"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f074b1f139e644c8943d5c46e2056d55"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f074b1f139e644c8943d5c46e2056d55"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f074b1f139e644c8943d5c46e2056d55"}]}] Sep 14 09:03:47.350510 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2139255772 Sep 14 09:03:47.350510 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: f074b1f139e644c8943d5c46e2056d55 Sep 14 09:03:47.350510 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2139255772 Sep 14 09:03:47.350510 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-KeyPairsNegativeTestJSON-2139255772-project Sep 14 09:03:47.350510 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:03:47.350510 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:03:47.350510 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 58436cb9c7434a51b36db8c860e6d737 Sep 14 09:03:47.350510 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2139255772-project Sep 14 09:03:47.350510 n-d-836830-18 devstack@n-api.service[128759]: Sep 14 09:03:47.350510 n-d-836830-18 devstack@n-api.service[128759]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-2082154551", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Sep 14 09:03:47.350510 n-d-836830-18 devstack@n-api.service[128759]: method: Sep 14 09:03:47.350510 n-d-836830-18 devstack@n-api.service[128759]: exception: Keypair data is invalid: failed to generate fingerprint Sep 14 09:03:47.352917 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-2082154551', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Sep 14 09:03:47.352917 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:03:47.352917 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:03:47.352917 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Sep 14 09:03:47.352917 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Sep 14 09:03:47.352917 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Sep 14 09:03:47.352917 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Sep 14 09:03:47.352917 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Sep 14 09:03:47.352917 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:03:47.352917 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:03:47.352917 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:03:47.352917 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:03:47.352917 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Sep 14 09:03:47.352917 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Sep 14 09:03:47.352917 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 14 09:03:47.352917 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 14 09:03:47.352917 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 14 09:03:47.352917 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 14 09:03:47.352917 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 14 09:03:47.352917 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise self.value Sep 14 09:03:47.352917 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 14 09:03:47.352917 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 14 09:03:47.352917 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Sep 14 09:03:47.352917 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Sep 14 09:03:47.352917 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Sep 14 09:03:47.352917 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Sep 14 09:03:47.352917 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Sep 14 09:03:47.352917 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Sep 14 09:03:47.352917 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Sep 14 09:03:47.352917 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:03:47.352917 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:03:47.352917 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:03:47.352917 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:03:47.352917 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:03:47.352917 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:03:47.352917 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:03:47.352917 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:03:47.352917 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:03:47.352917 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:03:47.352917 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:03:47.352917 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:03:47.356313 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:03:47.356313 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:03:47.356313 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:03:47.356313 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:03:47.356313 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Sep 14 09:03:47.356313 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self._create(req, body) Sep 14 09:03:47.356313 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Sep 14 09:03:47.356313 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Sep 14 09:03:47.356313 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Sep 14 09:03:47.356313 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:03:47.356313 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:03:47.356313 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:03:47.356313 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:03:47.356313 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:03:47.356313 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:03:47.356313 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:03:47.356313 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:03:47.356313 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Sep 14 09:03:47.356313 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:03:47.362103 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-efbb49c0-4a9d-4f67-bb3a-df4179cc6570 tempest-KeyPairsNegativeTestJSON-2139255772 tempest-KeyPairsNegativeTestJSON-2139255772-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:03:47.363321 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-efbb49c0-4a9d-4f67-bb3a-df4179cc6570 tempest-KeyPairsNegativeTestJSON-2139255772 tempest-KeyPairsNegativeTestJSON-2139255772-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.194832 Sep 14 09:03:47.364790 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1705/3452] 10.222.0.60 () {60 vars in 1160 bytes} [Wed Sep 14 09:03:47 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 197 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 14 09:03:47.377658 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b336ede9-3d3e-411e-bcab-b3b800e626d4 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:47.378854 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b336ede9-3d3e-411e-bcab-b3b800e626d4 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] [instance: 900c4e61-76fe-472f-bba7-0c83895f62cf] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:03:47.399954 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b336ede9-3d3e-411e-bcab-b3b800e626d4 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:47.401495 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b336ede9-3d3e-411e-bcab-b3b800e626d4 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:47.404430 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b336ede9-3d3e-411e-bcab-b3b800e626d4 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:47.405568 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b336ede9-3d3e-411e-bcab-b3b800e626d4 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:47.406313 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b336ede9-3d3e-411e-bcab-b3b800e626d4 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:47.407153 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b336ede9-3d3e-411e-bcab-b3b800e626d4 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:47.737920 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b336ede9-3d3e-411e-bcab-b3b800e626d4 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84afbf1d30574a7aa1186a481687c50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a90781147416fa5db6b8922209058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:47.753157 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b336ede9-3d3e-411e-bcab-b3b800e626d4 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84afbf1d30574a7aa1186a481687c50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a90781147416fa5db6b8922209058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:47.760832 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b336ede9-3d3e-411e-bcab-b3b800e626d4 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84afbf1d30574a7aa1186a481687c50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a90781147416fa5db6b8922209058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:47.762384 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b336ede9-3d3e-411e-bcab-b3b800e626d4 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] 10.222.0.60 "GET /compute/v2.1/servers/900c4e61-76fe-472f-bba7-0c83895f62cf" status: 200 len: 1407 microversion: 2.54 time: 0.396267 Sep 14 09:03:47.763559 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1706/3453] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:03:47 2022] GET /compute/v2.1/servers/900c4e61-76fe-472f-bba7-0c83895f62cf => generated 1407 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:03:47.768952 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-328bea62-9098-4550-81c0-4f369999c407 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:47.769615 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-328bea62-9098-4550-81c0-4f369999c407 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] [instance: 3d29c068-39c8-4851-82cf-b7639f689f24] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:03:47.778847 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-ab21fc64-c441-4097-9a63-81b0526522bc tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:47.796405 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-ab21fc64-c441-4097-9a63-81b0526522bc tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/d9d9afd3-aeba-4429-a474-7c70a960d4e0" status: 200 len: 1315 microversion: 2.1 time: 1.336399 Sep 14 09:03:47.799391 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1748/3454] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:03:46 2022] GET /compute/v2.1/servers/d9d9afd3-aeba-4429-a474-7c70a960d4e0 => generated 1315 bytes in 1340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:03:47.804737 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-328bea62-9098-4550-81c0-4f369999c407 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:47.805459 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-328bea62-9098-4550-81c0-4f369999c407 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:47.806090 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-328bea62-9098-4550-81c0-4f369999c407 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:47.807226 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-328bea62-9098-4550-81c0-4f369999c407 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:47.809874 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-328bea62-9098-4550-81c0-4f369999c407 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:47.810492 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-328bea62-9098-4550-81c0-4f369999c407 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:47.819775 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-de66b2dc-64b5-4b23-9e95-9d2c0b4148d9 tempest-KeyPairsNegativeTestJSON-2139255772 tempest-KeyPairsNegativeTestJSON-2139255772-project] Action: 'create', calling method: .version_select at 0x7f7d3f762700>, body: {"keypair": {"name": "tempest-keypair-1058022254", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNpRH90gvBUriMiCDzPlAW+NfekQDrvF1bk9BWaUuBRJcn/bBdKCllQrCY5w8/deApJGRs/rsoPXdRoslxdoC5I1jFGxnPuWtxnH+5LKDgEzfdfhFX4Bcr9bW9yQHctOBw=="}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:03:47.880922 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-de66b2dc-64b5-4b23-9e95-9d2c0b4148d9 tempest-KeyPairsNegativeTestJSON-2139255772 tempest-KeyPairsNegativeTestJSON-2139255772-project] Getting quotas for project f074b1f139e644c8943d5c46e2056d55. Resources: {'key_pairs'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:03:47.903790 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-de66b2dc-64b5-4b23-9e95-9d2c0b4148d9 tempest-KeyPairsNegativeTestJSON-2139255772 tempest-KeyPairsNegativeTestJSON-2139255772-project] Getting quotas for user 58436cb9c7434a51b36db8c860e6d737 and project f074b1f139e644c8943d5c46e2056d55. Resources: {'key_pairs'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:03:47.950669 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-de66b2dc-64b5-4b23-9e95-9d2c0b4148d9 tempest-KeyPairsNegativeTestJSON-2139255772 tempest-KeyPairsNegativeTestJSON-2139255772-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.146310 Sep 14 09:03:47.953007 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1749/3455] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Sep 14 09:03:47 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:03:47.959606 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-81f0e494-9dfb-49b1-ba37-c0f243cbed15 tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:47.960621 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-81f0e494-9dfb-49b1-ba37-c0f243cbed15 tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] [instance: d9ab57a3-b59b-4a19-99cc-d8f8383d10a8] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:03:47.969080 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-81f0e494-9dfb-49b1-ba37-c0f243cbed15 tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:47.969873 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-81f0e494-9dfb-49b1-ba37-c0f243cbed15 tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:47.970617 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-81f0e494-9dfb-49b1-ba37-c0f243cbed15 tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:47.971606 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-81f0e494-9dfb-49b1-ba37-c0f243cbed15 tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:47.973251 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-81f0e494-9dfb-49b1-ba37-c0f243cbed15 tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:47.973929 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-81f0e494-9dfb-49b1-ba37-c0f243cbed15 tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:48.429921 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-328bea62-9098-4550-81c0-4f369999c407 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e7ddc7c037439aad2f98277eef199e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e712ce30eb9c4128aa0ec1d425e9ab79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:48.447007 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-328bea62-9098-4550-81c0-4f369999c407 tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] 10.222.0.60 "GET /compute/v2.1/servers/3d29c068-39c8-4851-82cf-b7639f689f24" status: 200 len: 1516 microversion: 2.1 time: 0.682070 Sep 14 09:03:48.450818 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1707/3456] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:03:47 2022] GET /compute/v2.1/servers/3d29c068-39c8-4851-82cf-b7639f689f24 => generated 1516 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:03:48.462385 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-70198635-59ba-4eda-b2ca-97acd47a7710 tempest-KeyPairsNegativeTestJSON-2139255772 tempest-KeyPairsNegativeTestJSON-2139255772-project] Action: 'create', calling method: .version_select at 0x7f7d3fbd0790>, body: {"keypair": {"name": "tempest-keypair-1058022254", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLvdVQdxRoZJr2FoDhXWxAxK6VJ5DvzFK4k+ecdlesvbF4JITTIINmhnYBzwf4mRtHSvf9JbfRwDWY8FfpxHuE1XjbhR7TmeqdESMHEH/2YuiPBBDLtqa1EdqFOLyUtZ+w=="}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:03:48.506334 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-70198635-59ba-4eda-b2ca-97acd47a7710 tempest-KeyPairsNegativeTestJSON-2139255772 tempest-KeyPairsNegativeTestJSON-2139255772-project] Getting quotas for project f074b1f139e644c8943d5c46e2056d55. Resources: {'key_pairs'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:03:48.518541 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-70198635-59ba-4eda-b2ca-97acd47a7710 tempest-KeyPairsNegativeTestJSON-2139255772 tempest-KeyPairsNegativeTestJSON-2139255772-project] Getting quotas for user 58436cb9c7434a51b36db8c860e6d737 and project f074b1f139e644c8943d5c46e2056d55. Resources: {'key_pairs'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:03:48.602549 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-70198635-59ba-4eda-b2ca-97acd47a7710 tempest-KeyPairsNegativeTestJSON-2139255772 tempest-KeyPairsNegativeTestJSON-2139255772-project] HTTP exception thrown: Key pair 'tempest-keypair-1058022254' already exists. Sep 14 09:03:48.613880 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-70198635-59ba-4eda-b2ca-97acd47a7710 tempest-KeyPairsNegativeTestJSON-2139255772 tempest-KeyPairsNegativeTestJSON-2139255772-project] Request method failure captured: Sep 14 09:03:48.613880 n-d-836830-18 devstack@n-api.service[128759]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 14 09:03:48.613880 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:03:48.613880 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:03:48.613880 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:03:48.613880 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 273 Sep 14 09:03:48.613880 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:03:48.613880 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:03:48.613880 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:03:48.613880 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:03:48.613880 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZjxXrOXsc7gynby1Zm-lG6NZtdnG0Sze-MaTtQtn5LzS5GhDlS3BoDJQNzQi-FP8Z-BrIV4cxd_aU_Lux4LwWaU9UDNwoc9PgJHQrkUfXVYPHupCXdlLW8K4fo5BqqjLNG3lqk1ZKsM6nWPH0LHh06x5XPD3-YKOtqp0fEBJZuvk9g Sep 14 09:03:48.613880 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:03:48.613880 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:03:48.613880 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:03:48.613880 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:03:48.613880 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:03:48.613880 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:03:48.613880 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: f074b1f139e644c8943d5c46e2056d55 Sep 14 09:03:48.613880 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2139255772 Sep 14 09:03:48.613880 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:03:48.613880 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:03:48.613880 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f074b1f139e644c8943d5c46e2056d55"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f074b1f139e644c8943d5c46e2056d55"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f074b1f139e644c8943d5c46e2056d55"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f074b1f139e644c8943d5c46e2056d55"}]}] Sep 14 09:03:48.613880 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2139255772 Sep 14 09:03:48.613880 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: f074b1f139e644c8943d5c46e2056d55 Sep 14 09:03:48.613880 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2139255772 Sep 14 09:03:48.613880 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-KeyPairsNegativeTestJSON-2139255772-project Sep 14 09:03:48.613880 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:03:48.613880 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:03:48.613880 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 58436cb9c7434a51b36db8c860e6d737 Sep 14 09:03:48.613880 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2139255772-project Sep 14 09:03:48.613880 n-d-836830-18 devstack@n-api.service[128759]: Sep 14 09:03:48.613880 n-d-836830-18 devstack@n-api.service[128759]: {"keypair": {"name": "tempest-keypair-1058022254", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLvdVQdxRoZJr2FoDhXWxAxK6VJ5DvzFK4k+ecdlesvbF4JITTIINmhnYBzwf4mRtHSvf9JbfRwDWY8FfpxHuE1XjbhR7TmeqdESMHEH/2YuiPBBDLtqa1EdqFOLyUtZ+w=="}} Sep 14 09:03:48.613880 n-d-836830-18 devstack@n-api.service[128759]: method: Sep 14 09:03:48.613880 n-d-836830-18 devstack@n-api.service[128759]: exception: Key pair 'tempest-keypair-1058022254' already exists. Sep 14 09:03:48.613880 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-1058022254', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLvdVQdxRoZJr2FoDhXWxAxK6VJ5DvzFK4k+ecdlesvbF4JITTIINmhnYBzwf4mRtHSvf9JbfRwDWY8FfpxHuE1XjbhR7TmeqdESMHEH/2YuiPBBDLtqa1EdqFOLyUtZ+w=='}}} Sep 14 09:03:48.613880 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:03:48.613880 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:03:48.613880 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 14 09:03:48.613880 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 14 09:03:48.613880 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 14 09:03:48.613880 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 14 09:03:48.613880 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 14 09:03:48.613880 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 14 09:03:48.613880 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 14 09:03:48.613880 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 14 09:03:48.613880 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 14 09:03:48.613880 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 14 09:03:48.613880 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 14 09:03:48.613880 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi result.read() Sep 14 09:03:48.613880 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 14 09:03:48.613880 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 14 09:03:48.613880 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 14 09:03:48.613880 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 14 09:03:48.613880 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 14 09:03:48.613880 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 14 09:03:48.613880 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 14 09:03:48.613880 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 14 09:03:48.613880 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '58436cb9c7434a51b36db8c860e6d737-tempest-keypair-1058022254' for key 'key_pairs.uniq_key_pairs0user_id0name'") Sep 14 09:03:48.613880 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:03:48.620117 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 14 09:03:48.620117 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:03:48.620117 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:03:48.620117 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Sep 14 09:03:48.620117 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi kp.save(context.session) Sep 14 09:03:48.620117 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Sep 14 09:03:48.620117 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi session.flush() Sep 14 09:03:48.620117 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 14 09:03:48.620117 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self._flush(objects) Sep 14 09:03:48.620117 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 14 09:03:48.620117 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Sep 14 09:03:48.620117 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 14 09:03:48.620117 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi compat.raise_( Sep 14 09:03:48.620117 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 14 09:03:48.620117 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception Sep 14 09:03:48.620117 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 14 09:03:48.620117 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi flush_context.execute() Sep 14 09:03:48.620117 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 14 09:03:48.620117 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi rec.execute(self) Sep 14 09:03:48.620117 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 14 09:03:48.620117 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Sep 14 09:03:48.620117 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 14 09:03:48.620117 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Sep 14 09:03:48.620117 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 14 09:03:48.620117 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Sep 14 09:03:48.620117 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 14 09:03:48.620117 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Sep 14 09:03:48.620117 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 14 09:03:48.620117 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Sep 14 09:03:48.620117 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 14 09:03:48.620117 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Sep 14 09:03:48.620117 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 14 09:03:48.620117 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Sep 14 09:03:48.620117 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 14 09:03:48.620117 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 14 09:03:48.620117 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 14 09:03:48.620117 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception Sep 14 09:03:48.620117 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 14 09:03:48.620117 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 14 09:03:48.620117 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 14 09:03:48.620117 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 14 09:03:48.620117 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 14 09:03:48.620117 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 14 09:03:48.620117 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 14 09:03:48.620117 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 14 09:03:48.620117 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 14 09:03:48.620117 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 14 09:03:48.620117 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 14 09:03:48.620117 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi result.read() Sep 14 09:03:48.620117 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 14 09:03:48.620117 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 14 09:03:48.620117 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 14 09:03:48.620117 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 14 09:03:48.620117 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 14 09:03:48.620117 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 14 09:03:48.620117 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 14 09:03:48.629868 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 14 09:03:48.629868 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '58436cb9c7434a51b36db8c860e6d737-tempest-keypair-1058022254' for key 'key_pairs.uniq_key_pairs0user_id0name'") Sep 14 09:03:48.629868 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Sep 14 09:03:48.629868 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 9, 14, 9, 3, 48, 577668), 'updated_at': None, 'name': 'tempest-keypair-1058022254', 'user_id': '58436cb9c7434a51b36db8c860e6d737', 'fingerprint': '83:f2:97:67:e6:9c:9e:36:0a:67:1b:71:f9:8a:b9:6e', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLvdVQdxRoZJr2FoDhXWxAxK6VJ5DvzFK4k+ecdlesvbF4JITTIINmhnYBzwf4mRtHSvf9JbfRwDWY8FfpxHuE1XjbhR7TmeqdESMHEH/2YuiPBBDLtqa1EdqFOLyUtZ+w==', 'type': 'ssh'}] Sep 14 09:03:48.629868 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 14 09:03:48.629868 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:03:48.629868 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:03:48.629868 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:03:48.629868 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:03:48.629868 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Sep 14 09:03:48.629868 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Sep 14 09:03:48.629868 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 14 09:03:48.629868 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 14 09:03:48.629868 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 14 09:03:48.629868 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 14 09:03:48.629868 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 14 09:03:48.629868 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise self.value Sep 14 09:03:48.629868 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 14 09:03:48.629868 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 14 09:03:48.629868 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6777, in import_key_pair Sep 14 09:03:48.629868 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi keypair.create() Sep 14 09:03:48.629868 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 14 09:03:48.629868 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 14 09:03:48.629868 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Sep 14 09:03:48.629868 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self._create() Sep 14 09:03:48.629868 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Sep 14 09:03:48.629868 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Sep 14 09:03:48.629868 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Sep 14 09:03:48.629868 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Sep 14 09:03:48.629868 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 14 09:03:48.629868 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 14 09:03:48.629868 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Sep 14 09:03:48.629868 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Sep 14 09:03:48.629868 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-1058022254' already exists. Sep 14 09:03:48.629868 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:03:48.629868 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:03:48.629868 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:03:48.629868 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:03:48.629868 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:03:48.629868 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:03:48.629868 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:03:48.629868 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:03:48.629868 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:03:48.629868 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:03:48.629868 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:03:48.629868 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:03:48.629868 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:03:48.629868 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:03:48.629868 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:03:48.629868 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:03:48.629868 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Sep 14 09:03:48.629868 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self._create(req, body) Sep 14 09:03:48.629868 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Sep 14 09:03:48.629868 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Sep 14 09:03:48.629868 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-1058022254' already exists. Sep 14 09:03:48.635938 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:03:48.635938 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:03:48.635938 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:03:48.635938 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:03:48.635938 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:03:48.635938 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:03:48.635938 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:03:48.635938 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:03:48.635938 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-1058022254' already exists. Sep 14 09:03:48.635938 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:03:48.638964 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-70198635-59ba-4eda-b2ca-97acd47a7710 tempest-KeyPairsNegativeTestJSON-2139255772 tempest-KeyPairsNegativeTestJSON-2139255772-project] Returning 409 to user: Key pair 'tempest-keypair-1058022254' already exists. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:03:48.639263 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-70198635-59ba-4eda-b2ca-97acd47a7710 tempest-KeyPairsNegativeTestJSON-2139255772 tempest-KeyPairsNegativeTestJSON-2139255772-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 409 len: 105 microversion: 2.1 time: 0.186653 Sep 14 09:03:48.640465 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1708/3457] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Sep 14 09:03:48 2022] POST /compute/v2.1/os-keypairs => generated 105 bytes in 189 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 14 09:03:48.665042 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8e49a3e8-36a0-4b6f-9711-c83020e11ece tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:48.673184 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-8e49a3e8-36a0-4b6f-9711-c83020e11ece tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] [instance: 0eb40c80-c056-4096-a586-7e957a63f7cf] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:03:48.686811 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8e49a3e8-36a0-4b6f-9711-c83020e11ece tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:48.687349 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8e49a3e8-36a0-4b6f-9711-c83020e11ece tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:48.687846 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8e49a3e8-36a0-4b6f-9711-c83020e11ece tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:48.693619 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8e49a3e8-36a0-4b6f-9711-c83020e11ece tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:48.694453 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8e49a3e8-36a0-4b6f-9711-c83020e11ece tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:48.695262 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8e49a3e8-36a0-4b6f-9711-c83020e11ece tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:48.902665 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-81f0e494-9dfb-49b1-ba37-c0f243cbed15 tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12ca200f5b7468dac6b0164faa0c171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17461d862f104a3284ffa025efb619e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:48.942674 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-81f0e494-9dfb-49b1-ba37-c0f243cbed15 tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] 10.222.0.60 "GET /compute/v2.1/servers/d9ab57a3-b59b-4a19-99cc-d8f8383d10a8" status: 200 len: 1510 microversion: 2.1 time: 0.985596 Sep 14 09:03:48.943353 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1750/3458] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:03:47 2022] GET /compute/v2.1/servers/d9ab57a3-b59b-4a19-99cc-d8f8383d10a8 => generated 1510 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:03:48.979758 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-3a6c5b06-0d53-4806-b68c-18de54e62353 tempest-KeyPairsNegativeTestJSON-2139255772 tempest-KeyPairsNegativeTestJSON-2139255772-project] Calling method '.version_select at 0x7f7d44346160>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:48.984946 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-8e49a3e8-36a0-4b6f-9711-c83020e11ece tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:49.010369 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-8e49a3e8-36a0-4b6f-9711-c83020e11ece tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:49.019651 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-8e49a3e8-36a0-4b6f-9711-c83020e11ece tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:49.040796 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-8e49a3e8-36a0-4b6f-9711-c83020e11ece tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] 10.222.0.60 "GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf" status: 200 len: 1544 microversion: 2.91 time: 0.398951 Sep 14 09:03:49.059933 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1709/3459] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:03:48 2022] GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf => generated 1544 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:03:49.095955 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-92e97848-7db8-4999-965e-81a86d0454ae tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:49.098388 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-92e97848-7db8-4999-965e-81a86d0454ae tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] [instance: 900c4e61-76fe-472f-bba7-0c83895f62cf] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:03:49.102212 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-3a6c5b06-0d53-4806-b68c-18de54e62353 tempest-KeyPairsNegativeTestJSON-2139255772 tempest-KeyPairsNegativeTestJSON-2139255772-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1058022254" status: 202 len: 0 microversion: 2.1 time: 0.157700 Sep 14 09:03:49.104159 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1751/3460] 10.222.0.60 () {58 vars in 1221 bytes} [Wed Sep 14 09:03:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1058022254 => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:03:49.115677 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-fe135e0e-205c-444c-abf5-285c3bcba07e tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:49.118780 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-92e97848-7db8-4999-965e-81a86d0454ae tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:49.119213 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-fe135e0e-205c-444c-abf5-285c3bcba07e tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: d9d9afd3-aeba-4429-a474-7c70a960d4e0] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:03:49.119443 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-92e97848-7db8-4999-965e-81a86d0454ae tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:49.123166 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-92e97848-7db8-4999-965e-81a86d0454ae tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:49.125144 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-92e97848-7db8-4999-965e-81a86d0454ae tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:49.126136 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-92e97848-7db8-4999-965e-81a86d0454ae tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:49.128671 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-92e97848-7db8-4999-965e-81a86d0454ae tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:49.134057 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fe135e0e-205c-444c-abf5-285c3bcba07e tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:49.135636 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fe135e0e-205c-444c-abf5-285c3bcba07e tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:49.136120 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fe135e0e-205c-444c-abf5-285c3bcba07e tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:49.138372 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fe135e0e-205c-444c-abf5-285c3bcba07e tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:49.139589 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fe135e0e-205c-444c-abf5-285c3bcba07e tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:49.141044 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fe135e0e-205c-444c-abf5-285c3bcba07e tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:49.166875 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:03:49.216029 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:03:49.395178 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-92e97848-7db8-4999-965e-81a86d0454ae tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84afbf1d30574a7aa1186a481687c50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a90781147416fa5db6b8922209058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:49.406020 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-92e97848-7db8-4999-965e-81a86d0454ae tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84afbf1d30574a7aa1186a481687c50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a90781147416fa5db6b8922209058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:49.412738 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-92e97848-7db8-4999-965e-81a86d0454ae tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84afbf1d30574a7aa1186a481687c50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a90781147416fa5db6b8922209058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:49.414415 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-92e97848-7db8-4999-965e-81a86d0454ae tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] 10.222.0.60 "GET /compute/v2.1/servers/900c4e61-76fe-472f-bba7-0c83895f62cf" status: 200 len: 1407 microversion: 2.54 time: 0.353086 Sep 14 09:03:49.415862 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1710/3461] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:03:49 2022] GET /compute/v2.1/servers/900c4e61-76fe-472f-bba7-0c83895f62cf => generated 1407 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:03:49.440417 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-a1db94d0-973a-4ad5-865b-96886c0672cf req-bd035b70-0a23-44e7-a98f-f04cf74173c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d29c068-39c8-4851-82cf-b7639f689f24", "name": "network-vif-deleted", "tag": "b81d4959-4718-4edd-a5de-ff251f0c1dab"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:03:49.455181 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-a1db94d0-973a-4ad5-865b-96886c0672cf req-bd035b70-0a23-44e7-a98f-f04cf74173c0 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:49.456586 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-a1db94d0-973a-4ad5-865b-96886c0672cf req-bd035b70-0a23-44e7-a98f-f04cf74173c0 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:49.457276 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-a1db94d0-973a-4ad5-865b-96886c0672cf req-bd035b70-0a23-44e7-a98f-f04cf74173c0 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:49.475932 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-a1db94d0-973a-4ad5-865b-96886c0672cf req-bd035b70-0a23-44e7-a98f-f04cf74173c0 service nova] Creating event network-vif-deleted:b81d4959-4718-4edd-a5de-ff251f0c1dab for instance 3d29c068-39c8-4851-82cf-b7639f689f24 on n-h2-836830-18 Sep 14 09:03:49.484392 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-a1db94d0-973a-4ad5-865b-96886c0672cf req-bd035b70-0a23-44e7-a98f-f04cf74173c0 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051180 Sep 14 09:03:49.485718 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1711/3462] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:03:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:03:49.496844 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ae03cfed-a79e-4c34-be66-147a3819de26 tempest-KeyPairsNegativeTestJSON-2139255772 tempest-KeyPairsNegativeTestJSON-2139255772-project] Action: 'create', calling method: .version_select at 0x7f7d3fceeee0>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCP65nVQsUASAgv3zxV/Zt3Ot5UKKwHYaiftlGdAWHXvWNSxYwwQyqz2BsxPKcj5S+WqJLOTmr584kU289O/zb1mbDib7dxUjF5SLhaBgJMpes1ETiSJFbBIQBWE9d3qiQ=="}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:03:49.502519 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ae03cfed-a79e-4c34-be66-147a3819de26 tempest-KeyPairsNegativeTestJSON-2139255772 tempest-KeyPairsNegativeTestJSON-2139255772-project] Request method failure captured: Sep 14 09:03:49.502519 n-d-836830-18 devstack@n-api.service[128759]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 14 09:03:49.502519 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:03:49.502519 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:03:49.502519 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:03:49.502519 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 247 Sep 14 09:03:49.502519 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:03:49.502519 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:03:49.502519 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:03:49.502519 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:03:49.502519 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZjxXrOXsc7gynby1Zm-lG6NZtdnG0Sze-MaTtQtn5LzS5GhDlS3BoDJQNzQi-FP8Z-BrIV4cxd_aU_Lux4LwWaU9UDNwoc9PgJHQrkUfXVYPHupCXdlLW8K4fo5BqqjLNG3lqk1ZKsM6nWPH0LHh06x5XPD3-YKOtqp0fEBJZuvk9g Sep 14 09:03:49.502519 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:03:49.502519 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:03:49.502519 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:03:49.502519 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:03:49.502519 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:03:49.502519 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:03:49.502519 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: f074b1f139e644c8943d5c46e2056d55 Sep 14 09:03:49.502519 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2139255772 Sep 14 09:03:49.502519 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:03:49.502519 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:03:49.502519 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f074b1f139e644c8943d5c46e2056d55"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f074b1f139e644c8943d5c46e2056d55"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f074b1f139e644c8943d5c46e2056d55"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f074b1f139e644c8943d5c46e2056d55"}]}] Sep 14 09:03:49.502519 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2139255772 Sep 14 09:03:49.502519 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: f074b1f139e644c8943d5c46e2056d55 Sep 14 09:03:49.502519 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2139255772 Sep 14 09:03:49.502519 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-KeyPairsNegativeTestJSON-2139255772-project Sep 14 09:03:49.502519 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:03:49.502519 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:03:49.502519 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 58436cb9c7434a51b36db8c860e6d737 Sep 14 09:03:49.502519 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2139255772-project Sep 14 09:03:49.502519 n-d-836830-18 devstack@n-api.service[128759]: Sep 14 09:03:49.502519 n-d-836830-18 devstack@n-api.service[128759]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCP65nVQsUASAgv3zxV/Zt3Ot5UKKwHYaiftlGdAWHXvWNSxYwwQyqz2BsxPKcj5S+WqJLOTmr584kU289O/zb1mbDib7dxUjF5SLhaBgJMpes1ETiSJFbBIQBWE9d3qiQ=="}} Sep 14 09:03:49.502519 n-d-836830-18 devstack@n-api.service[128759]: method: Sep 14 09:03:49.502519 n-d-836830-18 devstack@n-api.service[128759]: exception: Invalid input for field/attribute name. Value: . '' is too short Sep 14 09:03:49.502519 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCP65nVQsUASAgv3zxV/Zt3Ot5UKKwHYaiftlGdAWHXvWNSxYwwQyqz2BsxPKcj5S+WqJLOTmr584kU289O/zb1mbDib7dxUjF5SLhaBgJMpes1ETiSJFbBIQBWE9d3qiQ=='}}} Sep 14 09:03:49.502519 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:03:49.502519 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:03:49.502519 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 14 09:03:49.502519 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 14 09:03:49.502519 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 14 09:03:49.502519 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise error Sep 14 09:03:49.502519 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Sep 14 09:03:49.502519 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:03:49.502519 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Sep 14 09:03:49.502519 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 14 09:03:49.502519 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:03:49.502519 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi On instance['keypair']: Sep 14 09:03:49.502519 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi '' Sep 14 09:03:49.502519 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:03:49.502519 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:03:49.502519 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:03:49.502519 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:03:49.502519 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:03:49.502519 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:03:49.502519 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:03:49.502519 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:03:49.502519 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:03:49.502519 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:03:49.502519 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:03:49.502519 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:03:49.502519 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:03:49.502519 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:03:49.502519 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 14 09:03:49.502519 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 14 09:03:49.510899 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 14 09:03:49.510899 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 14 09:03:49.510899 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 14 09:03:49.510899 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 14 09:03:49.510899 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Sep 14 09:03:49.510899 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:03:49.510899 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:03:49.510899 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:03:49.510899 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:03:49.510899 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:03:49.510899 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:03:49.510899 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 14 09:03:49.510899 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 14 09:03:49.510899 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Sep 14 09:03:49.510899 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:03:49.515133 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ae03cfed-a79e-4c34-be66-147a3819de26 tempest-KeyPairsNegativeTestJSON-2139255772 tempest-KeyPairsNegativeTestJSON-2139255772-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:03:49.517044 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-ae03cfed-a79e-4c34-be66-147a3819de26 tempest-KeyPairsNegativeTestJSON-2139255772 tempest-KeyPairsNegativeTestJSON-2139255772-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.029201 Sep 14 09:03:49.518308 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1712/3463] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Sep 14 09:03:49 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 14 09:03:49.531408 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8dab6924-bc44-41c0-982c-63a773631bfa tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:49.536399 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-8dab6924-bc44-41c0-982c-63a773631bfa tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] [instance: 3d29c068-39c8-4851-82cf-b7639f689f24] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:03:49.593608 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8dab6924-bc44-41c0-982c-63a773631bfa tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:49.594573 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8dab6924-bc44-41c0-982c-63a773631bfa tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:49.597862 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8dab6924-bc44-41c0-982c-63a773631bfa tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:49.598970 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8dab6924-bc44-41c0-982c-63a773631bfa tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:49.602081 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8dab6924-bc44-41c0-982c-63a773631bfa tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:49.602857 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8dab6924-bc44-41c0-982c-63a773631bfa tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:49.703716 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8dab6924-bc44-41c0-982c-63a773631bfa tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:49.704869 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8dab6924-bc44-41c0-982c-63a773631bfa tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:49.705610 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8dab6924-bc44-41c0-982c-63a773631bfa tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:49.707552 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.objects.instance [None req-8dab6924-bc44-41c0-982c-63a773631bfa tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lazy-loading 'fault' on Instance uuid 3d29c068-39c8-4851-82cf-b7639f689f24 {{(pid=128759) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:03:49.918445 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-8dab6924-bc44-41c0-982c-63a773631bfa tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e7ddc7c037439aad2f98277eef199e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e712ce30eb9c4128aa0ec1d425e9ab79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:49.934915 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-8dab6924-bc44-41c0-982c-63a773631bfa tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] 10.222.0.60 "GET /compute/v2.1/servers/3d29c068-39c8-4851-82cf-b7639f689f24" status: 200 len: 1310 microversion: 2.1 time: 0.414562 Sep 14 09:03:49.957389 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1713/3464] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:03:49 2022] GET /compute/v2.1/servers/3d29c068-39c8-4851-82cf-b7639f689f24 => generated 1310 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:03:49.973648 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-631e2229-87ce-4e5f-a365-0a78dc526a61 tempest-KeyPairsNegativeTestJSON-2139255772 tempest-KeyPairsNegativeTestJSON-2139255772-project] Action: 'create', calling method: .version_select at 0x7f7d3fd933a0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1672429211", "public_key": " "}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:03:50.014278 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-631e2229-87ce-4e5f-a365-0a78dc526a61 tempest-KeyPairsNegativeTestJSON-2139255772 tempest-KeyPairsNegativeTestJSON-2139255772-project] Getting quotas for project f074b1f139e644c8943d5c46e2056d55. Resources: {'key_pairs'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:03:50.023339 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-631e2229-87ce-4e5f-a365-0a78dc526a61 tempest-KeyPairsNegativeTestJSON-2139255772 tempest-KeyPairsNegativeTestJSON-2139255772-project] Getting quotas for user 58436cb9c7434a51b36db8c860e6d737 and project f074b1f139e644c8943d5c46e2056d55. Resources: {'key_pairs'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:03:50.092598 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-631e2229-87ce-4e5f-a365-0a78dc526a61 tempest-KeyPairsNegativeTestJSON-2139255772 tempest-KeyPairsNegativeTestJSON-2139255772-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Sep 14 09:03:50.095963 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-631e2229-87ce-4e5f-a365-0a78dc526a61 tempest-KeyPairsNegativeTestJSON-2139255772 tempest-KeyPairsNegativeTestJSON-2139255772-project] Request method failure captured: Sep 14 09:03:50.095963 n-d-836830-18 devstack@n-api.service[128759]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 14 09:03:50.095963 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:03:50.095963 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:03:50.095963 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:03:50.095963 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 95 Sep 14 09:03:50.095963 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:03:50.095963 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:03:50.095963 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:03:50.095963 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:03:50.095963 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZjxXrOXsc7gynby1Zm-lG6NZtdnG0Sze-MaTtQtn5LzS5GhDlS3BoDJQNzQi-FP8Z-BrIV4cxd_aU_Lux4LwWaU9UDNwoc9PgJHQrkUfXVYPHupCXdlLW8K4fo5BqqjLNG3lqk1ZKsM6nWPH0LHh06x5XPD3-YKOtqp0fEBJZuvk9g Sep 14 09:03:50.095963 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:03:50.095963 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:03:50.095963 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:03:50.095963 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:03:50.095963 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:03:50.095963 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:03:50.095963 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: f074b1f139e644c8943d5c46e2056d55 Sep 14 09:03:50.095963 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2139255772 Sep 14 09:03:50.095963 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:03:50.095963 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:03:50.095963 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f074b1f139e644c8943d5c46e2056d55"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f074b1f139e644c8943d5c46e2056d55"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f074b1f139e644c8943d5c46e2056d55"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f074b1f139e644c8943d5c46e2056d55"}]}] Sep 14 09:03:50.095963 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2139255772 Sep 14 09:03:50.095963 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: f074b1f139e644c8943d5c46e2056d55 Sep 14 09:03:50.095963 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2139255772 Sep 14 09:03:50.095963 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-KeyPairsNegativeTestJSON-2139255772-project Sep 14 09:03:50.095963 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:03:50.095963 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:03:50.095963 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 58436cb9c7434a51b36db8c860e6d737 Sep 14 09:03:50.095963 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2139255772-project Sep 14 09:03:50.095963 n-d-836830-18 devstack@n-api.service[128759]: Sep 14 09:03:50.095963 n-d-836830-18 devstack@n-api.service[128759]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1672429211", "public_key": " "}} Sep 14 09:03:50.095963 n-d-836830-18 devstack@n-api.service[128759]: method: Sep 14 09:03:50.095963 n-d-836830-18 devstack@n-api.service[128759]: exception: Keypair data is invalid: failed to generate fingerprint Sep 14 09:03:50.095963 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1672429211', 'public_key': ' '}}} Sep 14 09:03:50.095963 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:03:50.095963 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:03:50.095963 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Sep 14 09:03:50.095963 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Sep 14 09:03:50.095963 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Sep 14 09:03:50.095963 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Sep 14 09:03:50.095963 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Sep 14 09:03:50.095963 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:03:50.095963 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:03:50.095963 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:03:50.095963 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:03:50.095963 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Sep 14 09:03:50.095963 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Sep 14 09:03:50.095963 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 14 09:03:50.095963 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 14 09:03:50.095963 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 14 09:03:50.095963 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 14 09:03:50.095963 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 14 09:03:50.095963 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise self.value Sep 14 09:03:50.095963 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 14 09:03:50.095963 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 14 09:03:50.095963 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Sep 14 09:03:50.095963 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Sep 14 09:03:50.095963 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Sep 14 09:03:50.095963 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Sep 14 09:03:50.095963 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Sep 14 09:03:50.095963 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Sep 14 09:03:50.095963 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Sep 14 09:03:50.095963 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:03:50.095963 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:03:50.095963 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:03:50.101211 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:03:50.101211 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:03:50.101211 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:03:50.101211 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:03:50.101211 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:03:50.101211 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:03:50.101211 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:03:50.101211 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:03:50.101211 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:03:50.101211 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:03:50.101211 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:03:50.101211 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:03:50.101211 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:03:50.101211 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Sep 14 09:03:50.101211 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self._create(req, body) Sep 14 09:03:50.101211 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Sep 14 09:03:50.101211 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Sep 14 09:03:50.101211 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Sep 14 09:03:50.101211 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:03:50.101211 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:03:50.101211 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:03:50.101211 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:03:50.101211 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:03:50.101211 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:03:50.101211 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:03:50.101211 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:03:50.101211 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Sep 14 09:03:50.101211 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:03:50.107821 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-631e2229-87ce-4e5f-a365-0a78dc526a61 tempest-KeyPairsNegativeTestJSON-2139255772 tempest-KeyPairsNegativeTestJSON-2139255772-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:03:50.108927 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-631e2229-87ce-4e5f-a365-0a78dc526a61 tempest-KeyPairsNegativeTestJSON-2139255772 tempest-KeyPairsNegativeTestJSON-2139255772-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.149285 Sep 14 09:03:50.111052 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1714/3465] 10.222.0.60 () {60 vars in 1158 bytes} [Wed Sep 14 09:03:49 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 153 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 14 09:03:50.246566 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-f80a3a8e-b6c8-4894-a64b-37480316250e req-8c958d92-e652-4bdd-92b8-6fbb7eab7778 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9ab57a3-b59b-4a19-99cc-d8f8383d10a8", "name": "network-vif-deleted", "tag": "3d1b81be-15c8-448c-a538-83a8d2630c75"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:03:50.265836 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-fe135e0e-205c-444c-abf5-285c3bcba07e tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:50.277444 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-fe135e0e-205c-444c-abf5-285c3bcba07e tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/d9d9afd3-aeba-4429-a474-7c70a960d4e0" status: 200 len: 1315 microversion: 2.1 time: 1.171791 Sep 14 09:03:50.278695 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1752/3466] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:03:49 2022] GET /compute/v2.1/servers/d9d9afd3-aeba-4429-a474-7c70a960d4e0 => generated 1315 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:03:50.285813 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-14f0fd59-b00d-45c4-aec6-e078e9adc7ac tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:50.290748 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-f80a3a8e-b6c8-4894-a64b-37480316250e req-8c958d92-e652-4bdd-92b8-6fbb7eab7778 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:50.292226 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-14f0fd59-b00d-45c4-aec6-e078e9adc7ac tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] [instance: d9ab57a3-b59b-4a19-99cc-d8f8383d10a8] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:03:50.299165 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-f80a3a8e-b6c8-4894-a64b-37480316250e req-8c958d92-e652-4bdd-92b8-6fbb7eab7778 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:50.299998 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-f80a3a8e-b6c8-4894-a64b-37480316250e req-8c958d92-e652-4bdd-92b8-6fbb7eab7778 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:50.311925 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-14f0fd59-b00d-45c4-aec6-e078e9adc7ac tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:50.312755 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-14f0fd59-b00d-45c4-aec6-e078e9adc7ac tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:50.313669 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-14f0fd59-b00d-45c4-aec6-e078e9adc7ac tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:50.324038 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-14f0fd59-b00d-45c4-aec6-e078e9adc7ac tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:50.324843 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-14f0fd59-b00d-45c4-aec6-e078e9adc7ac tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:50.336038 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-f80a3a8e-b6c8-4894-a64b-37480316250e req-8c958d92-e652-4bdd-92b8-6fbb7eab7778 service nova] Creating event network-vif-deleted:3d1b81be-15c8-448c-a538-83a8d2630c75 for instance d9ab57a3-b59b-4a19-99cc-d8f8383d10a8 on n-h2-836830-18 Sep 14 09:03:50.337023 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-14f0fd59-b00d-45c4-aec6-e078e9adc7ac tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:50.356387 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-f80a3a8e-b6c8-4894-a64b-37480316250e req-8c958d92-e652-4bdd-92b8-6fbb7eab7778 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.240848 Sep 14 09:03:50.373294 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1715/3467] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:03:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:03:50.397764 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-12a392e9-bd04-4d32-be90-aa620b2b4b2d tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:50.400576 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-12a392e9-bd04-4d32-be90-aa620b2b4b2d tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] [instance: 0eb40c80-c056-4096-a586-7e957a63f7cf] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:03:50.440947 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-12a392e9-bd04-4d32-be90-aa620b2b4b2d tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:50.444969 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-12a392e9-bd04-4d32-be90-aa620b2b4b2d tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:50.446870 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-12a392e9-bd04-4d32-be90-aa620b2b4b2d tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:50.449265 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-12a392e9-bd04-4d32-be90-aa620b2b4b2d tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:50.453053 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-12a392e9-bd04-4d32-be90-aa620b2b4b2d tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:50.453746 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-12a392e9-bd04-4d32-be90-aa620b2b4b2d tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:50.468989 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-14f0fd59-b00d-45c4-aec6-e078e9adc7ac tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:50.471556 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-14f0fd59-b00d-45c4-aec6-e078e9adc7ac tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:50.472279 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-14f0fd59-b00d-45c4-aec6-e078e9adc7ac tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:50.473000 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.objects.instance [None req-14f0fd59-b00d-45c4-aec6-e078e9adc7ac tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Lazy-loading 'fault' on Instance uuid d9ab57a3-b59b-4a19-99cc-d8f8383d10a8 {{(pid=128758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:03:50.690372 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-12a392e9-bd04-4d32-be90-aa620b2b4b2d tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:50.704684 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-12a392e9-bd04-4d32-be90-aa620b2b4b2d tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:50.710110 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-12a392e9-bd04-4d32-be90-aa620b2b4b2d tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:50.725200 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-12a392e9-bd04-4d32-be90-aa620b2b4b2d tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] 10.222.0.60 "GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf" status: 200 len: 1544 microversion: 2.91 time: 0.343508 Sep 14 09:03:50.726770 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1716/3468] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:03:50 2022] GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf => generated 1544 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:03:50.746909 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-37af8c61-f25e-4df0-bd2e-9f6f8ac90df7 tempest-KeyPairsNegativeTestJSON-2139255772 tempest-KeyPairsNegativeTestJSON-2139255772-project] Action: 'create', calling method: .version_select at 0x7f7d4406a550>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNZogfi/CxW0T1Bw8j/HHKCN9w2eLb4JWFMsI+g3jQEnyPw+lWMT7OD97kbCHIhxZ6m0PPhNpRzefizvTN7AvjtlGzRyR5hxsFTli67azT3LfJqoFKWW1rH6s/ufGAWyIw=="}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:03:50.756048 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-37af8c61-f25e-4df0-bd2e-9f6f8ac90df7 tempest-KeyPairsNegativeTestJSON-2139255772 tempest-KeyPairsNegativeTestJSON-2139255772-project] Request method failure captured: Sep 14 09:03:50.756048 n-d-836830-18 devstack@n-api.service[128759]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 14 09:03:50.756048 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:03:50.756048 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:03:50.756048 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:03:50.756048 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 507 Sep 14 09:03:50.756048 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:03:50.756048 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:03:50.756048 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:03:50.756048 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:03:50.756048 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZjxXrOXsc7gynby1Zm-lG6NZtdnG0Sze-MaTtQtn5LzS5GhDlS3BoDJQNzQi-FP8Z-BrIV4cxd_aU_Lux4LwWaU9UDNwoc9PgJHQrkUfXVYPHupCXdlLW8K4fo5BqqjLNG3lqk1ZKsM6nWPH0LHh06x5XPD3-YKOtqp0fEBJZuvk9g Sep 14 09:03:50.756048 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:03:50.756048 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:03:50.756048 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:03:50.756048 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:03:50.756048 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:03:50.756048 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:03:50.756048 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: f074b1f139e644c8943d5c46e2056d55 Sep 14 09:03:50.756048 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2139255772 Sep 14 09:03:50.756048 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:03:50.756048 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:03:50.756048 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f074b1f139e644c8943d5c46e2056d55"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f074b1f139e644c8943d5c46e2056d55"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f074b1f139e644c8943d5c46e2056d55"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f074b1f139e644c8943d5c46e2056d55"}]}] Sep 14 09:03:50.756048 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2139255772 Sep 14 09:03:50.756048 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: f074b1f139e644c8943d5c46e2056d55 Sep 14 09:03:50.756048 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2139255772 Sep 14 09:03:50.756048 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-KeyPairsNegativeTestJSON-2139255772-project Sep 14 09:03:50.756048 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:03:50.756048 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:03:50.756048 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 58436cb9c7434a51b36db8c860e6d737 Sep 14 09:03:50.756048 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2139255772-project Sep 14 09:03:50.756048 n-d-836830-18 devstack@n-api.service[128759]: Sep 14 09:03:50.756048 n-d-836830-18 devstack@n-api.service[128759]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNZogfi/CxW0T1Bw8j/HHKCN9w2eLb4JWFMsI+g3jQEnyPw+lWMT7OD97kbCHIhxZ6m0PPhNpRzefizvTN7AvjtlGzRyR5hxsFTli67azT3LfJqoFKWW1rH6s/ufGAWyIw=="}} Sep 14 09:03:50.756048 n-d-836830-18 devstack@n-api.service[128759]: method: Sep 14 09:03:50.756048 n-d-836830-18 devstack@n-api.service[128759]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Sep 14 09:03:50.756048 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNZogfi/CxW0T1Bw8j/HHKCN9w2eLb4JWFMsI+g3jQEnyPw+lWMT7OD97kbCHIhxZ6m0PPhNpRzefizvTN7AvjtlGzRyR5hxsFTli67azT3LfJqoFKWW1rH6s/ufGAWyIw=='}}} Sep 14 09:03:50.756048 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:03:50.756048 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:03:50.756048 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 14 09:03:50.756048 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 14 09:03:50.756048 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 14 09:03:50.756048 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise error Sep 14 09:03:50.756048 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Sep 14 09:03:50.756048 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:03:50.756048 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Sep 14 09:03:50.756048 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 14 09:03:50.756048 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:03:50.756048 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi On instance['keypair']: Sep 14 09:03:50.756048 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Sep 14 09:03:50.759495 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:03:50.759495 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:03:50.759495 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:03:50.759495 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:03:50.759495 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:03:50.759495 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:03:50.759495 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:03:50.759495 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:03:50.759495 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:03:50.759495 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:03:50.759495 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:03:50.759495 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:03:50.759495 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:03:50.759495 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:03:50.759495 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 14 09:03:50.759495 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 14 09:03:50.759495 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 14 09:03:50.759495 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 14 09:03:50.759495 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 14 09:03:50.759495 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 14 09:03:50.759495 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Sep 14 09:03:50.759495 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:03:50.759495 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:03:50.759495 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:03:50.759495 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:03:50.759495 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:03:50.759495 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:03:50.759495 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 14 09:03:50.759495 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 14 09:03:50.759495 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Sep 14 09:03:50.759495 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:03:50.767387 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-37af8c61-f25e-4df0-bd2e-9f6f8ac90df7 tempest-KeyPairsNegativeTestJSON-2139255772 tempest-KeyPairsNegativeTestJSON-2139255772-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:03:50.769100 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-37af8c61-f25e-4df0-bd2e-9f6f8ac90df7 tempest-KeyPairsNegativeTestJSON-2139255772 tempest-KeyPairsNegativeTestJSON-2139255772-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.039306 Sep 14 09:03:50.773230 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1717/3469] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Sep 14 09:03:50 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 44 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 14 09:03:50.788714 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8402b57d-59b3-4368-ac69-d9113ae1496f tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:50.791679 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-8402b57d-59b3-4368-ac69-d9113ae1496f tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] [instance: 900c4e61-76fe-472f-bba7-0c83895f62cf] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:03:50.818477 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8402b57d-59b3-4368-ac69-d9113ae1496f tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:50.820309 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8402b57d-59b3-4368-ac69-d9113ae1496f tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:50.821402 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8402b57d-59b3-4368-ac69-d9113ae1496f tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:50.824068 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8402b57d-59b3-4368-ac69-d9113ae1496f tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:50.826267 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8402b57d-59b3-4368-ac69-d9113ae1496f tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:50.827912 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8402b57d-59b3-4368-ac69-d9113ae1496f tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:50.828190 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-14f0fd59-b00d-45c4-aec6-e078e9adc7ac tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12ca200f5b7468dac6b0164faa0c171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17461d862f104a3284ffa025efb619e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:50.840245 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-14f0fd59-b00d-45c4-aec6-e078e9adc7ac tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] 10.222.0.60 "GET /compute/v2.1/servers/d9ab57a3-b59b-4a19-99cc-d8f8383d10a8" status: 200 len: 1306 microversion: 2.1 time: 0.556428 Sep 14 09:03:50.840910 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1753/3470] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:03:50 2022] GET /compute/v2.1/servers/d9ab57a3-b59b-4a19-99cc-d8f8383d10a8 => generated 1306 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:03:50.867040 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-28b836b4-8af6-40cd-837e-e8a506cbf8f8 tempest-KeyPairsNegativeTestJSON-2139255772 tempest-KeyPairsNegativeTestJSON-2139255772-project] Action: 'create', calling method: .version_select at 0x7f7d3f5a0790>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-2104348655", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:03:50.910967 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-28b836b4-8af6-40cd-837e-e8a506cbf8f8 tempest-KeyPairsNegativeTestJSON-2139255772 tempest-KeyPairsNegativeTestJSON-2139255772-project] Getting quotas for project f074b1f139e644c8943d5c46e2056d55. Resources: {'key_pairs'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:03:50.930129 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-28b836b4-8af6-40cd-837e-e8a506cbf8f8 tempest-KeyPairsNegativeTestJSON-2139255772 tempest-KeyPairsNegativeTestJSON-2139255772-project] Getting quotas for user 58436cb9c7434a51b36db8c860e6d737 and project f074b1f139e644c8943d5c46e2056d55. Resources: {'key_pairs'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:03:50.962599 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-28b836b4-8af6-40cd-837e-e8a506cbf8f8 tempest-KeyPairsNegativeTestJSON-2139255772 tempest-KeyPairsNegativeTestJSON-2139255772-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Sep 14 09:03:50.965840 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-28b836b4-8af6-40cd-837e-e8a506cbf8f8 tempest-KeyPairsNegativeTestJSON-2139255772 tempest-KeyPairsNegativeTestJSON-2139255772-project] Request method failure captured: Sep 14 09:03:50.965840 n-d-836830-18 devstack@n-api.service[128758]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 14 09:03:50.965840 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 09:03:50.965840 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 09:03:50.965840 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 09:03:50.965840 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 118 Sep 14 09:03:50.965840 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 09:03:50.965840 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 09:03:50.965840 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 09:03:50.965840 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 09:03:50.965840 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZjxXrOXsc7gynby1Zm-lG6NZtdnG0Sze-MaTtQtn5LzS5GhDlS3BoDJQNzQi-FP8Z-BrIV4cxd_aU_Lux4LwWaU9UDNwoc9PgJHQrkUfXVYPHupCXdlLW8K4fo5BqqjLNG3lqk1ZKsM6nWPH0LHh06x5XPD3-YKOtqp0fEBJZuvk9g Sep 14 09:03:50.965840 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 09:03:50.965840 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 09:03:50.965840 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 09:03:50.965840 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 09:03:50.965840 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 09:03:50.965840 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 09:03:50.965840 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: f074b1f139e644c8943d5c46e2056d55 Sep 14 09:03:50.965840 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2139255772 Sep 14 09:03:50.965840 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 09:03:50.965840 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 09:03:50.965840 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f074b1f139e644c8943d5c46e2056d55"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f074b1f139e644c8943d5c46e2056d55"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f074b1f139e644c8943d5c46e2056d55"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f074b1f139e644c8943d5c46e2056d55"}]}] Sep 14 09:03:50.965840 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2139255772 Sep 14 09:03:50.965840 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: f074b1f139e644c8943d5c46e2056d55 Sep 14 09:03:50.965840 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2139255772 Sep 14 09:03:50.965840 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-KeyPairsNegativeTestJSON-2139255772-project Sep 14 09:03:50.965840 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 09:03:50.965840 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 09:03:50.965840 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 58436cb9c7434a51b36db8c860e6d737 Sep 14 09:03:50.965840 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2139255772-project Sep 14 09:03:50.965840 n-d-836830-18 devstack@n-api.service[128758]: Sep 14 09:03:50.965840 n-d-836830-18 devstack@n-api.service[128758]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-2104348655", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Sep 14 09:03:50.965840 n-d-836830-18 devstack@n-api.service[128758]: method: Sep 14 09:03:50.965840 n-d-836830-18 devstack@n-api.service[128758]: exception: Keypair data is invalid: failed to generate fingerprint Sep 14 09:03:50.965840 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-2104348655', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Sep 14 09:03:50.965840 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:03:50.965840 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:03:50.965840 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Sep 14 09:03:50.965840 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Sep 14 09:03:50.965840 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Sep 14 09:03:50.965840 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Sep 14 09:03:50.965840 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Sep 14 09:03:50.965840 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Sep 14 09:03:50.965840 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Sep 14 09:03:50.965840 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Sep 14 09:03:50.965840 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Sep 14 09:03:50.965840 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:03:50.965840 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:03:50.965840 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:03:50.965840 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:03:50.965840 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Sep 14 09:03:50.965840 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Sep 14 09:03:50.965840 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 14 09:03:50.965840 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 14 09:03:50.965840 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 14 09:03:50.965840 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 14 09:03:50.965840 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 14 09:03:50.965840 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise self.value Sep 14 09:03:50.965840 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 14 09:03:50.965840 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 14 09:03:50.965840 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Sep 14 09:03:50.965840 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Sep 14 09:03:50.965840 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Sep 14 09:03:50.965840 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Sep 14 09:03:50.970468 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Sep 14 09:03:50.970468 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Sep 14 09:03:50.970468 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Sep 14 09:03:50.970468 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:03:50.970468 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:03:50.970468 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:03:50.970468 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:03:50.970468 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:03:50.970468 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:03:50.970468 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:03:50.970468 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:03:50.970468 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:03:50.970468 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:03:50.970468 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:03:50.970468 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:03:50.970468 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:03:50.970468 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:03:50.970468 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:03:50.970468 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:03:50.970468 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Sep 14 09:03:50.970468 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self._create(req, body) Sep 14 09:03:50.970468 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Sep 14 09:03:50.970468 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Sep 14 09:03:50.970468 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Sep 14 09:03:50.970468 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:03:50.970468 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:03:50.970468 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:03:50.970468 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:03:50.970468 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:03:50.970468 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:03:50.970468 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:03:50.970468 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:03:50.970468 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Sep 14 09:03:50.970468 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:03:50.970468 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-28b836b4-8af6-40cd-837e-e8a506cbf8f8 tempest-KeyPairsNegativeTestJSON-2139255772 tempest-KeyPairsNegativeTestJSON-2139255772-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:03:50.984512 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-28b836b4-8af6-40cd-837e-e8a506cbf8f8 tempest-KeyPairsNegativeTestJSON-2139255772 tempest-KeyPairsNegativeTestJSON-2139255772-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.104876 Sep 14 09:03:50.988534 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1754/3471] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Sep 14 09:03:50 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 133 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 14 09:03:50.994213 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-dc6d0621-f036-44be-81b8-7c99a354717d tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:50.995649 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-dc6d0621-f036-44be-81b8-7c99a354717d tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] [instance: 3d29c068-39c8-4851-82cf-b7639f689f24] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:03:51.023974 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dc6d0621-f036-44be-81b8-7c99a354717d tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:51.024470 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dc6d0621-f036-44be-81b8-7c99a354717d tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:51.024909 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dc6d0621-f036-44be-81b8-7c99a354717d tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:51.026254 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dc6d0621-f036-44be-81b8-7c99a354717d tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:51.026710 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dc6d0621-f036-44be-81b8-7c99a354717d tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:51.033364 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dc6d0621-f036-44be-81b8-7c99a354717d tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:51.080809 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-dc6d0621-f036-44be-81b8-7c99a354717d tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] HTTP exception thrown: Instance 3d29c068-39c8-4851-82cf-b7639f689f24 could not be found. Sep 14 09:03:51.082646 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-dc6d0621-f036-44be-81b8-7c99a354717d tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Request method failure captured: Sep 14 09:03:51.082646 n-d-836830-18 devstack@n-api.service[128758]: request: GET /compute/v2.1/servers/3d29c068-39c8-4851-82cf-b7639f689f24 HTTP/1.1 Sep 14 09:03:51.082646 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 09:03:51.082646 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 09:03:51.082646 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 09:03:51.082646 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 09:03:51.082646 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 09:03:51.082646 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 09:03:51.082646 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 09:03:51.082646 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 09:03:51.082646 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZh0fLmNlp5hM0yWlDvW36KfrrIHpOuRZfGcuRs23sCF5zFlyoDT5R6s-UM4kUmBphXR7aDKVnqY4sfmazOIoQz_DvkvU2elb7vE0xZ33w8smpF6vXAriaEIuoW1oy3enxLQN5ygpfF9oHqNJqQQfVkLPc7KoLj47ZAjltTE-E5bVuE Sep 14 09:03:51.082646 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 09:03:51.082646 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 09:03:51.082646 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 09:03:51.082646 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 09:03:51.082646 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 09:03:51.082646 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 09:03:51.082646 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: e712ce30eb9c4128aa0ec1d425e9ab79 Sep 14 09:03:51.082646 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-ListServerFiltersTestJSON-1717892064 Sep 14 09:03:51.082646 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 09:03:51.082646 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 09:03:51.082646 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e712ce30eb9c4128aa0ec1d425e9ab79"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e712ce30eb9c4128aa0ec1d425e9ab79"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e712ce30eb9c4128aa0ec1d425e9ab79"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e712ce30eb9c4128aa0ec1d425e9ab79"}]}] Sep 14 09:03:51.082646 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-ListServerFiltersTestJSON-1717892064 Sep 14 09:03:51.082646 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: e712ce30eb9c4128aa0ec1d425e9ab79 Sep 14 09:03:51.082646 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1717892064 Sep 14 09:03:51.082646 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-ListServerFiltersTestJSON-1717892064-project Sep 14 09:03:51.082646 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 09:03:51.082646 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 09:03:51.082646 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: d6e7ddc7c037439aad2f98277eef199e Sep 14 09:03:51.082646 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-ListServerFiltersTestJSON-1717892064-project Sep 14 09:03:51.082646 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 09:03:51.082646 n-d-836830-18 devstack@n-api.service[128758]: exception: Instance 3d29c068-39c8-4851-82cf-b7639f689f24 could not be found. Sep 14 09:03:51.082646 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': '3d29c068-39c8-4851-82cf-b7639f689f24'} Sep 14 09:03:51.082646 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:03:51.082646 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:03:51.082646 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:03:51.082646 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:03:51.082646 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:03:51.082646 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:03:51.082646 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:03:51.082646 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:03:51.082646 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:03:51.082646 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:03:51.082646 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d29c068-39c8-4851-82cf-b7639f689f24 could not be found. Sep 14 09:03:51.082646 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:03:51.082646 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:03:51.082646 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:03:51.082646 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:03:51.082646 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:03:51.082646 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:03:51.082646 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:03:51.082646 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:03:51.082646 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:03:51.082646 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:03:51.082646 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:03:51.082646 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:03:51.082646 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:03:51.082646 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:03:51.082646 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:03:51.082646 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:03:51.082646 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d29c068-39c8-4851-82cf-b7639f689f24 could not be found. Sep 14 09:03:51.082646 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:03:51.082646 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:03:51.082646 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:03:51.087724 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:03:51.087724 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:03:51.087724 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:03:51.087724 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:03:51.087724 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:03:51.087724 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d29c068-39c8-4851-82cf-b7639f689f24 could not be found. Sep 14 09:03:51.087724 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:03:51.089894 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-dc6d0621-f036-44be-81b8-7c99a354717d tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] Returning 404 to user: Instance 3d29c068-39c8-4851-82cf-b7639f689f24 could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:03:51.091035 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-dc6d0621-f036-44be-81b8-7c99a354717d tempest-ListServerFiltersTestJSON-1717892064 tempest-ListServerFiltersTestJSON-1717892064-project] 10.222.0.60 "GET /compute/v2.1/servers/3d29c068-39c8-4851-82cf-b7639f689f24" status: 404 len: 111 microversion: 2.1 time: 0.101373 Sep 14 09:03:51.092103 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1755/3472] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:03:50 2022] GET /compute/v2.1/servers/3d29c068-39c8-4851-82cf-b7639f689f24 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:03:51.100454 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-8402b57d-59b3-4368-ac69-d9113ae1496f tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84afbf1d30574a7aa1186a481687c50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a90781147416fa5db6b8922209058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:51.109690 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-8402b57d-59b3-4368-ac69-d9113ae1496f tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84afbf1d30574a7aa1186a481687c50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a90781147416fa5db6b8922209058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:51.109927 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-262160bf-72ca-4fb5-bb6f-627259c61847 tempest-KeyPairsNegativeTestJSON-2139255772 tempest-KeyPairsNegativeTestJSON-2139255772-project] Calling method '.version_select at 0x7f7d3f59faf0>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:51.119178 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-8402b57d-59b3-4368-ac69-d9113ae1496f tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84afbf1d30574a7aa1186a481687c50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a90781147416fa5db6b8922209058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:51.120752 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-8402b57d-59b3-4368-ac69-d9113ae1496f tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] 10.222.0.60 "GET /compute/v2.1/servers/900c4e61-76fe-472f-bba7-0c83895f62cf" status: 200 len: 1407 microversion: 2.54 time: 0.343067 Sep 14 09:03:51.121823 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1718/3473] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:03:50 2022] GET /compute/v2.1/servers/900c4e61-76fe-472f-bba7-0c83895f62cf => generated 1407 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:03:51.154477 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-262160bf-72ca-4fb5-bb6f-627259c61847 tempest-KeyPairsNegativeTestJSON-2139255772 tempest-KeyPairsNegativeTestJSON-2139255772-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-1375803197 not found for user 58436cb9c7434a51b36db8c860e6d737 Sep 14 09:03:51.156914 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-262160bf-72ca-4fb5-bb6f-627259c61847 tempest-KeyPairsNegativeTestJSON-2139255772 tempest-KeyPairsNegativeTestJSON-2139255772-project] Request method failure captured: Sep 14 09:03:51.156914 n-d-836830-18 devstack@n-api.service[128758]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1375803197 HTTP/1.1 Sep 14 09:03:51.156914 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 09:03:51.156914 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 09:03:51.156914 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 09:03:51.156914 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 09:03:51.156914 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 09:03:51.156914 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 09:03:51.156914 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 09:03:51.156914 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 09:03:51.156914 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZjxXrOXsc7gynby1Zm-lG6NZtdnG0Sze-MaTtQtn5LzS5GhDlS3BoDJQNzQi-FP8Z-BrIV4cxd_aU_Lux4LwWaU9UDNwoc9PgJHQrkUfXVYPHupCXdlLW8K4fo5BqqjLNG3lqk1ZKsM6nWPH0LHh06x5XPD3-YKOtqp0fEBJZuvk9g Sep 14 09:03:51.156914 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 09:03:51.156914 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 09:03:51.156914 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 09:03:51.156914 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 09:03:51.156914 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 09:03:51.156914 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 09:03:51.156914 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: f074b1f139e644c8943d5c46e2056d55 Sep 14 09:03:51.156914 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2139255772 Sep 14 09:03:51.156914 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 09:03:51.156914 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 09:03:51.156914 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f074b1f139e644c8943d5c46e2056d55"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f074b1f139e644c8943d5c46e2056d55"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f074b1f139e644c8943d5c46e2056d55"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f074b1f139e644c8943d5c46e2056d55"}]}] Sep 14 09:03:51.156914 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2139255772 Sep 14 09:03:51.156914 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: f074b1f139e644c8943d5c46e2056d55 Sep 14 09:03:51.156914 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2139255772 Sep 14 09:03:51.156914 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-KeyPairsNegativeTestJSON-2139255772-project Sep 14 09:03:51.156914 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 09:03:51.156914 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 09:03:51.156914 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 58436cb9c7434a51b36db8c860e6d737 Sep 14 09:03:51.156914 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2139255772-project Sep 14 09:03:51.156914 n-d-836830-18 devstack@n-api.service[128758]: method: Sep 14 09:03:51.156914 n-d-836830-18 devstack@n-api.service[128758]: exception: Keypair tempest-keypair-non-existent-1375803197 not found for user 58436cb9c7434a51b36db8c860e6d737 Sep 14 09:03:51.156914 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': 'tempest-keypair-non-existent-1375803197'} Sep 14 09:03:51.156914 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:03:51.156914 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:03:51.156914 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Sep 14 09:03:51.156914 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Sep 14 09:03:51.156914 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 14 09:03:51.156914 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 14 09:03:51.156914 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 14 09:03:51.156914 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 14 09:03:51.156914 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 14 09:03:51.156914 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise self.value Sep 14 09:03:51.156914 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 14 09:03:51.156914 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 14 09:03:51.156914 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6861, in delete_key_pair Sep 14 09:03:51.156914 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Sep 14 09:03:51.156914 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6882, in get_key_pair Sep 14 09:03:51.156914 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Sep 14 09:03:51.156914 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 14 09:03:51.156914 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 14 09:03:51.156914 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Sep 14 09:03:51.156914 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Sep 14 09:03:51.156914 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Sep 14 09:03:51.156914 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Sep 14 09:03:51.156914 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 14 09:03:51.156914 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 14 09:03:51.156914 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Sep 14 09:03:51.156914 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Sep 14 09:03:51.156914 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-1375803197 not found for user 58436cb9c7434a51b36db8c860e6d737 Sep 14 09:03:51.156914 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:03:51.156914 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:03:51.161253 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:03:51.161253 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:03:51.161253 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:03:51.161253 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:03:51.161253 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:03:51.161253 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:03:51.161253 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:03:51.161253 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:03:51.161253 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 14 09:03:51.161253 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:03:51.161253 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:03:51.161253 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:03:51.161253 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Sep 14 09:03:51.161253 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi self._delete(req, id) Sep 14 09:03:51.161253 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Sep 14 09:03:51.161253 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Sep 14 09:03:51.161253 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-1375803197 not found for user 58436cb9c7434a51b36db8c860e6d737 Sep 14 09:03:51.161253 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:03:51.161253 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:03:51.161253 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:03:51.161253 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:03:51.161253 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:03:51.161253 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:03:51.161253 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:03:51.161253 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:03:51.161253 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-1375803197 not found for user 58436cb9c7434a51b36db8c860e6d737 Sep 14 09:03:51.161253 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:03:51.161253 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-262160bf-72ca-4fb5-bb6f-627259c61847 tempest-KeyPairsNegativeTestJSON-2139255772 tempest-KeyPairsNegativeTestJSON-2139255772-project] Returning 404 to user: Keypair tempest-keypair-non-existent-1375803197 not found for user 58436cb9c7434a51b36db8c860e6d737 {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:03:51.161253 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-262160bf-72ca-4fb5-bb6f-627259c61847 tempest-KeyPairsNegativeTestJSON-2139255772 tempest-KeyPairsNegativeTestJSON-2139255772-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1375803197" status: 404 len: 145 microversion: 2.1 time: 0.065113 Sep 14 09:03:51.165425 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1756/3474] 10.222.0.60 () {58 vars in 1260 bytes} [Wed Sep 14 09:03:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1375803197 => generated 145 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:03:51.308232 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-09cba515-3555-45c4-afbc-a80dc0a0154e tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:51.308867 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-09cba515-3555-45c4-afbc-a80dc0a0154e tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: d9d9afd3-aeba-4429-a474-7c70a960d4e0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:03:51.327785 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-09cba515-3555-45c4-afbc-a80dc0a0154e tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:51.332533 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-09cba515-3555-45c4-afbc-a80dc0a0154e tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:51.333045 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-09cba515-3555-45c4-afbc-a80dc0a0154e tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:51.337032 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-09cba515-3555-45c4-afbc-a80dc0a0154e tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:51.337538 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-09cba515-3555-45c4-afbc-a80dc0a0154e tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:51.338011 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-09cba515-3555-45c4-afbc-a80dc0a0154e tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:51.763785 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-35ec8d5d-398b-4dc0-a9b6-852bf79296e4 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:51.765454 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-35ec8d5d-398b-4dc0-a9b6-852bf79296e4 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] [instance: 0eb40c80-c056-4096-a586-7e957a63f7cf] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:03:51.774197 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-35ec8d5d-398b-4dc0-a9b6-852bf79296e4 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:51.775375 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-35ec8d5d-398b-4dc0-a9b6-852bf79296e4 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:51.776806 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-35ec8d5d-398b-4dc0-a9b6-852bf79296e4 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:51.777817 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-35ec8d5d-398b-4dc0-a9b6-852bf79296e4 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:51.778667 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-35ec8d5d-398b-4dc0-a9b6-852bf79296e4 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:51.788904 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-35ec8d5d-398b-4dc0-a9b6-852bf79296e4 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:51.873634 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=4 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:03:51.894044 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-09cba515-3555-45c4-afbc-a80dc0a0154e tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:51.904981 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-09cba515-3555-45c4-afbc-a80dc0a0154e tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/d9d9afd3-aeba-4429-a474-7c70a960d4e0" status: 200 len: 1315 microversion: 2.1 time: 0.601952 Sep 14 09:03:51.905582 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1719/3475] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:03:51 2022] GET /compute/v2.1/servers/d9d9afd3-aeba-4429-a474-7c70a960d4e0 => generated 1315 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:03:51.921217 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-329cbfd8-98f8-4c0b-9efa-4525de142ec5 tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:51.929684 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-329cbfd8-98f8-4c0b-9efa-4525de142ec5 tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] [instance: d9ab57a3-b59b-4a19-99cc-d8f8383d10a8] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:03:51.946022 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-329cbfd8-98f8-4c0b-9efa-4525de142ec5 tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:51.946826 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-329cbfd8-98f8-4c0b-9efa-4525de142ec5 tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:51.950111 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-329cbfd8-98f8-4c0b-9efa-4525de142ec5 tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:51.951145 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-329cbfd8-98f8-4c0b-9efa-4525de142ec5 tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:51.952924 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-329cbfd8-98f8-4c0b-9efa-4525de142ec5 tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:51.954046 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-329cbfd8-98f8-4c0b-9efa-4525de142ec5 tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:52.008969 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-329cbfd8-98f8-4c0b-9efa-4525de142ec5 tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] HTTP exception thrown: Instance d9ab57a3-b59b-4a19-99cc-d8f8383d10a8 could not be found. Sep 14 09:03:52.013361 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-329cbfd8-98f8-4c0b-9efa-4525de142ec5 tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Request method failure captured: Sep 14 09:03:52.013361 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/d9ab57a3-b59b-4a19-99cc-d8f8383d10a8 HTTP/1.1 Sep 14 09:03:52.013361 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:03:52.013361 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:03:52.013361 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:03:52.013361 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:03:52.013361 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:03:52.013361 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:03:52.013361 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:03:52.013361 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:03:52.013361 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZjPNJsrUJ22w9qtjProMjUEJIToCxSamQ7EaGukcwiimi2aLRAwEbKZ1WEmhgLd3ZUPBBzabHj4F0KSb2ySOeqBArCbhDXpN1xwz0cDpS49eJ2UNhmnyfdFeQw9tpZQ5Khh9O1ftmTBP6CUI-K7dI-uICh0DwYGNVmy4IZml_tBDsg Sep 14 09:03:52.013361 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:03:52.013361 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:03:52.013361 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:03:52.013361 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:03:52.013361 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:03:52.013361 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:03:52.013361 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 17461d862f104a3284ffa025efb619e4 Sep 14 09:03:52.013361 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-InstanceActionsTestJSON-1376322679 Sep 14 09:03:52.013361 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:03:52.013361 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:03:52.013361 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/17461d862f104a3284ffa025efb619e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_17461d862f104a3284ffa025efb619e4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/17461d862f104a3284ffa025efb619e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/17461d862f104a3284ffa025efb619e4"}]}] Sep 14 09:03:52.013361 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-InstanceActionsTestJSON-1376322679 Sep 14 09:03:52.013361 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 17461d862f104a3284ffa025efb619e4 Sep 14 09:03:52.013361 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-InstanceActionsTestJSON-1376322679 Sep 14 09:03:52.013361 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-InstanceActionsTestJSON-1376322679-project Sep 14 09:03:52.013361 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:03:52.013361 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:03:52.013361 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: c12ca200f5b7468dac6b0164faa0c171 Sep 14 09:03:52.013361 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-InstanceActionsTestJSON-1376322679-project Sep 14 09:03:52.013361 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:03:52.013361 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance d9ab57a3-b59b-4a19-99cc-d8f8383d10a8 could not be found. Sep 14 09:03:52.013361 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': 'd9ab57a3-b59b-4a19-99cc-d8f8383d10a8'} Sep 14 09:03:52.013361 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:03:52.013361 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:03:52.013361 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:03:52.013361 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:03:52.013361 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:03:52.013361 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:03:52.013361 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:03:52.013361 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:03:52.013361 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:03:52.013361 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:03:52.013361 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9ab57a3-b59b-4a19-99cc-d8f8383d10a8 could not be found. Sep 14 09:03:52.013361 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:03:52.013361 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:03:52.013361 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:03:52.013361 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:03:52.013361 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:03:52.013361 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:03:52.013361 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:03:52.013361 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:03:52.013361 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:03:52.013361 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:03:52.013361 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:03:52.013361 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:03:52.013361 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:03:52.013361 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:03:52.013361 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:03:52.013361 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:03:52.013361 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9ab57a3-b59b-4a19-99cc-d8f8383d10a8 could not be found. Sep 14 09:03:52.013361 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:03:52.013361 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:03:52.013361 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:03:52.019589 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:03:52.019589 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:03:52.019589 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:03:52.019589 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:03:52.019589 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:03:52.019589 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9ab57a3-b59b-4a19-99cc-d8f8383d10a8 could not be found. Sep 14 09:03:52.019589 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:03:52.029985 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-329cbfd8-98f8-4c0b-9efa-4525de142ec5 tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] Returning 404 to user: Instance d9ab57a3-b59b-4a19-99cc-d8f8383d10a8 could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:03:52.035354 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-329cbfd8-98f8-4c0b-9efa-4525de142ec5 tempest-InstanceActionsTestJSON-1376322679 tempest-InstanceActionsTestJSON-1376322679-project] 10.222.0.60 "GET /compute/v2.1/servers/d9ab57a3-b59b-4a19-99cc-d8f8383d10a8" status: 404 len: 111 microversion: 2.1 time: 0.122526 Sep 14 09:03:52.036423 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1720/3476] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:03:51 2022] GET /compute/v2.1/servers/d9ab57a3-b59b-4a19-99cc-d8f8383d10a8 => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:03:52.061807 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-35ec8d5d-398b-4dc0-a9b6-852bf79296e4 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:52.075351 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-35ec8d5d-398b-4dc0-a9b6-852bf79296e4 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:52.079301 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-35ec8d5d-398b-4dc0-a9b6-852bf79296e4 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:52.101852 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-35ec8d5d-398b-4dc0-a9b6-852bf79296e4 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] 10.222.0.60 "GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf" status: 200 len: 1544 microversion: 2.91 time: 0.345741 Sep 14 09:03:52.127110 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1757/3477] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:03:51 2022] GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf => generated 1544 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 09:03:52.156596 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d5c9c062-d27f-4a01-a4bb-02b2b0372a5b tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:52.157240 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-d5c9c062-d27f-4a01-a4bb-02b2b0372a5b tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] [instance: 900c4e61-76fe-472f-bba7-0c83895f62cf] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:03:52.168271 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d5c9c062-d27f-4a01-a4bb-02b2b0372a5b tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:52.168770 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d5c9c062-d27f-4a01-a4bb-02b2b0372a5b tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:52.169212 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d5c9c062-d27f-4a01-a4bb-02b2b0372a5b tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:52.170082 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d5c9c062-d27f-4a01-a4bb-02b2b0372a5b tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:52.180063 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d5c9c062-d27f-4a01-a4bb-02b2b0372a5b tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:52.181659 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d5c9c062-d27f-4a01-a4bb-02b2b0372a5b tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:52.372684 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-62b3c0e5-a06d-4820-80e8-c5cc09cb1116 req-62ad443e-7c06-4031-96f8-6ff06405406d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9d9afd3-aeba-4429-a474-7c70a960d4e0", "tag": "f8440eec-c0f1-49c8-b0e1-c14bd38590a8"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:03:52.402856 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-62b3c0e5-a06d-4820-80e8-c5cc09cb1116 req-62ad443e-7c06-4031-96f8-6ff06405406d service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:52.403508 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-62b3c0e5-a06d-4820-80e8-c5cc09cb1116 req-62ad443e-7c06-4031-96f8-6ff06405406d service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:52.406692 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-62b3c0e5-a06d-4820-80e8-c5cc09cb1116 req-62ad443e-7c06-4031-96f8-6ff06405406d service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:52.410834 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-d5c9c062-d27f-4a01-a4bb-02b2b0372a5b tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84afbf1d30574a7aa1186a481687c50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a90781147416fa5db6b8922209058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:52.435469 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-d5c9c062-d27f-4a01-a4bb-02b2b0372a5b tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84afbf1d30574a7aa1186a481687c50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a90781147416fa5db6b8922209058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:52.439950 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-d5c9c062-d27f-4a01-a4bb-02b2b0372a5b tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84afbf1d30574a7aa1186a481687c50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a90781147416fa5db6b8922209058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:52.441566 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d5c9c062-d27f-4a01-a4bb-02b2b0372a5b tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] 10.222.0.60 "GET /compute/v2.1/servers/900c4e61-76fe-472f-bba7-0c83895f62cf" status: 200 len: 1407 microversion: 2.54 time: 0.288965 Sep 14 09:03:52.445237 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1721/3478] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:03:52 2022] GET /compute/v2.1/servers/900c4e61-76fe-472f-bba7-0c83895f62cf => generated 1407 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:03:52.478181 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-62b3c0e5-a06d-4820-80e8-c5cc09cb1116 req-62ad443e-7c06-4031-96f8-6ff06405406d service nova] Creating event network-changed:f8440eec-c0f1-49c8-b0e1-c14bd38590a8 for instance d9d9afd3-aeba-4429-a474-7c70a960d4e0 on n-h1-836830-18 Sep 14 09:03:52.498839 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-62b3c0e5-a06d-4820-80e8-c5cc09cb1116 req-62ad443e-7c06-4031-96f8-6ff06405406d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129737 Sep 14 09:03:52.499502 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1758/3479] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:03:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:03:52.934802 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d57aa445-fce9-4107-8803-b1ea0507485b tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:52.935481 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-d57aa445-fce9-4107-8803-b1ea0507485b tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: d9d9afd3-aeba-4429-a474-7c70a960d4e0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:03:52.945618 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:03:52.950406 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d57aa445-fce9-4107-8803-b1ea0507485b tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:52.952714 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d57aa445-fce9-4107-8803-b1ea0507485b tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:52.953627 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d57aa445-fce9-4107-8803-b1ea0507485b tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:52.954388 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d57aa445-fce9-4107-8803-b1ea0507485b tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:52.954865 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d57aa445-fce9-4107-8803-b1ea0507485b tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:52.960782 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d57aa445-fce9-4107-8803-b1ea0507485b tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:53.145245 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-e2f235a5-cba1-4a26-8228-03c50174803c tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:53.145245 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-e2f235a5-cba1-4a26-8228-03c50174803c tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] [instance: 0eb40c80-c056-4096-a586-7e957a63f7cf] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:03:53.155625 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e2f235a5-cba1-4a26-8228-03c50174803c tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:53.156121 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e2f235a5-cba1-4a26-8228-03c50174803c tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:53.156563 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e2f235a5-cba1-4a26-8228-03c50174803c tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:53.159529 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e2f235a5-cba1-4a26-8228-03c50174803c tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:53.164023 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e2f235a5-cba1-4a26-8228-03c50174803c tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:53.164713 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e2f235a5-cba1-4a26-8228-03c50174803c tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:53.475927 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-d57aa445-fce9-4107-8803-b1ea0507485b tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:53.485900 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d57aa445-fce9-4107-8803-b1ea0507485b tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/d9d9afd3-aeba-4429-a474-7c70a960d4e0" status: 200 len: 1315 microversion: 2.1 time: 0.555886 Sep 14 09:03:53.495832 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1722/3480] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:03:52 2022] GET /compute/v2.1/servers/d9d9afd3-aeba-4429-a474-7c70a960d4e0 => generated 1315 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:03:53.525023 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-46962c8f-9345-4f9f-8779-763d0b92a70f tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:53.531704 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-46962c8f-9345-4f9f-8779-763d0b92a70f tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] [instance: 900c4e61-76fe-472f-bba7-0c83895f62cf] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:03:53.551778 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-e2f235a5-cba1-4a26-8228-03c50174803c tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:53.559637 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-46962c8f-9345-4f9f-8779-763d0b92a70f tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:53.564906 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-e2f235a5-cba1-4a26-8228-03c50174803c tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:53.566327 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-46962c8f-9345-4f9f-8779-763d0b92a70f tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:53.571436 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-46962c8f-9345-4f9f-8779-763d0b92a70f tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:53.573087 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-46962c8f-9345-4f9f-8779-763d0b92a70f tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:53.580712 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-46962c8f-9345-4f9f-8779-763d0b92a70f tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:53.581413 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-46962c8f-9345-4f9f-8779-763d0b92a70f tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:53.594849 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-e2f235a5-cba1-4a26-8228-03c50174803c tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:53.615122 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-e2f235a5-cba1-4a26-8228-03c50174803c tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] 10.222.0.60 "GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf" status: 200 len: 1544 microversion: 2.91 time: 0.471920 Sep 14 09:03:53.615891 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1759/3481] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:03:53 2022] GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf => generated 1544 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:03:53.799812 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-46962c8f-9345-4f9f-8779-763d0b92a70f tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84afbf1d30574a7aa1186a481687c50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a90781147416fa5db6b8922209058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:53.824840 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-46962c8f-9345-4f9f-8779-763d0b92a70f tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84afbf1d30574a7aa1186a481687c50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a90781147416fa5db6b8922209058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:53.831571 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-46962c8f-9345-4f9f-8779-763d0b92a70f tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84afbf1d30574a7aa1186a481687c50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a90781147416fa5db6b8922209058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:53.837043 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-46962c8f-9345-4f9f-8779-763d0b92a70f tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] 10.222.0.60 "GET /compute/v2.1/servers/900c4e61-76fe-472f-bba7-0c83895f62cf" status: 200 len: 1407 microversion: 2.54 time: 0.339601 Sep 14 09:03:53.843629 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1723/3482] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:03:53 2022] GET /compute/v2.1/servers/900c4e61-76fe-472f-bba7-0c83895f62cf => generated 1407 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:03:54.523571 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-93b89383-d835-49ec-b15c-d7c73a49c7c1 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:54.524188 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-93b89383-d835-49ec-b15c-d7c73a49c7c1 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: d9d9afd3-aeba-4429-a474-7c70a960d4e0] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:03:54.534450 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-93b89383-d835-49ec-b15c-d7c73a49c7c1 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:54.535537 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-93b89383-d835-49ec-b15c-d7c73a49c7c1 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:54.536268 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-93b89383-d835-49ec-b15c-d7c73a49c7c1 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:54.548399 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-93b89383-d835-49ec-b15c-d7c73a49c7c1 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:54.548399 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-93b89383-d835-49ec-b15c-d7c73a49c7c1 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:54.548399 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-93b89383-d835-49ec-b15c-d7c73a49c7c1 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:54.660408 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-2f866b5b-e741-4ff3-8894-dc567034153b tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:54.661042 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-2f866b5b-e741-4ff3-8894-dc567034153b tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] [instance: 0eb40c80-c056-4096-a586-7e957a63f7cf] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:03:54.671950 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2f866b5b-e741-4ff3-8894-dc567034153b tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:54.677936 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2f866b5b-e741-4ff3-8894-dc567034153b tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:54.678447 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2f866b5b-e741-4ff3-8894-dc567034153b tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:54.679222 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2f866b5b-e741-4ff3-8894-dc567034153b tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:54.680129 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2f866b5b-e741-4ff3-8894-dc567034153b tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:54.681621 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2f866b5b-e741-4ff3-8894-dc567034153b tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:54.761226 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-93b89383-d835-49ec-b15c-d7c73a49c7c1 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:54.775358 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-93b89383-d835-49ec-b15c-d7c73a49c7c1 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/d9d9afd3-aeba-4429-a474-7c70a960d4e0" status: 200 len: 1315 microversion: 2.1 time: 0.255637 Sep 14 09:03:54.779110 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1760/3483] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:03:54 2022] GET /compute/v2.1/servers/d9d9afd3-aeba-4429-a474-7c70a960d4e0 => generated 1315 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:03:54.818186 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-2f866b5b-e741-4ff3-8894-dc567034153b tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:54.829272 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-2f866b5b-e741-4ff3-8894-dc567034153b tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:54.831277 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-2f866b5b-e741-4ff3-8894-dc567034153b tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:54.837808 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-2f866b5b-e741-4ff3-8894-dc567034153b tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] 10.222.0.60 "GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf" status: 200 len: 1544 microversion: 2.91 time: 0.193628 Sep 14 09:03:54.846092 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1724/3484] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:03:54 2022] GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf => generated 1544 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:03:54.870801 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-5fdfd0d7-c6af-4875-99e3-c84d341a1a28 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:54.871721 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-5fdfd0d7-c6af-4875-99e3-c84d341a1a28 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] [instance: 900c4e61-76fe-472f-bba7-0c83895f62cf] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:03:54.879090 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5fdfd0d7-c6af-4875-99e3-c84d341a1a28 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:54.879751 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5fdfd0d7-c6af-4875-99e3-c84d341a1a28 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:54.880301 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5fdfd0d7-c6af-4875-99e3-c84d341a1a28 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:54.881143 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5fdfd0d7-c6af-4875-99e3-c84d341a1a28 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:54.882095 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5fdfd0d7-c6af-4875-99e3-c84d341a1a28 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:54.882793 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5fdfd0d7-c6af-4875-99e3-c84d341a1a28 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:55.024502 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-5fdfd0d7-c6af-4875-99e3-c84d341a1a28 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84afbf1d30574a7aa1186a481687c50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a90781147416fa5db6b8922209058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:55.039156 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-5fdfd0d7-c6af-4875-99e3-c84d341a1a28 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84afbf1d30574a7aa1186a481687c50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a90781147416fa5db6b8922209058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:55.040655 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-5fdfd0d7-c6af-4875-99e3-c84d341a1a28 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84afbf1d30574a7aa1186a481687c50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a90781147416fa5db6b8922209058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:55.046850 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-5fdfd0d7-c6af-4875-99e3-c84d341a1a28 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] 10.222.0.60 "GET /compute/v2.1/servers/900c4e61-76fe-472f-bba7-0c83895f62cf" status: 200 len: 1407 microversion: 2.54 time: 0.179273 Sep 14 09:03:55.048114 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1761/3485] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:03:54 2022] GET /compute/v2.1/servers/900c4e61-76fe-472f-bba7-0c83895f62cf => generated 1407 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:03:55.799832 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f83a2db8-e98d-4893-b22e-04eb7a7e5972 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:55.800616 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f83a2db8-e98d-4893-b22e-04eb7a7e5972 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: d9d9afd3-aeba-4429-a474-7c70a960d4e0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:03:55.812831 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f83a2db8-e98d-4893-b22e-04eb7a7e5972 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:55.813951 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f83a2db8-e98d-4893-b22e-04eb7a7e5972 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:55.815161 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f83a2db8-e98d-4893-b22e-04eb7a7e5972 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:55.816127 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f83a2db8-e98d-4893-b22e-04eb7a7e5972 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:55.816731 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f83a2db8-e98d-4893-b22e-04eb7a7e5972 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:55.817298 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f83a2db8-e98d-4893-b22e-04eb7a7e5972 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:55.866012 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-49fe2fb6-ac18-494e-97ab-77d7ef521f9a tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:55.866814 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-49fe2fb6-ac18-494e-97ab-77d7ef521f9a tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] [instance: 0eb40c80-c056-4096-a586-7e957a63f7cf] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:03:55.881548 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-49fe2fb6-ac18-494e-97ab-77d7ef521f9a tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:55.893913 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-49fe2fb6-ac18-494e-97ab-77d7ef521f9a tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:55.894570 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-49fe2fb6-ac18-494e-97ab-77d7ef521f9a tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:55.895454 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-49fe2fb6-ac18-494e-97ab-77d7ef521f9a tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:55.896071 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-49fe2fb6-ac18-494e-97ab-77d7ef521f9a tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:55.896598 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-49fe2fb6-ac18-494e-97ab-77d7ef521f9a tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:56.912630 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-49fe2fb6-ac18-494e-97ab-77d7ef521f9a tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:56.923095 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-49fe2fb6-ac18-494e-97ab-77d7ef521f9a tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:56.930027 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-49fe2fb6-ac18-494e-97ab-77d7ef521f9a tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:56.963676 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-49fe2fb6-ac18-494e-97ab-77d7ef521f9a tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] 10.222.0.60 "GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf" status: 200 len: 1544 microversion: 2.91 time: 1.093879 Sep 14 09:03:56.967353 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1762/3486] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:03:55 2022] GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf => generated 1544 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:03:56.982824 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-35c63db7-e5cc-4bfd-a71c-914569748123 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:56.996528 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-35c63db7-e5cc-4bfd-a71c-914569748123 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] [instance: 900c4e61-76fe-472f-bba7-0c83895f62cf] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:03:57.043329 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-35c63db7-e5cc-4bfd-a71c-914569748123 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:57.043868 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-35c63db7-e5cc-4bfd-a71c-914569748123 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:57.044321 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-35c63db7-e5cc-4bfd-a71c-914569748123 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:57.045083 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-35c63db7-e5cc-4bfd-a71c-914569748123 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:57.045550 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-35c63db7-e5cc-4bfd-a71c-914569748123 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:57.045986 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-35c63db7-e5cc-4bfd-a71c-914569748123 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:57.281919 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f83a2db8-e98d-4893-b22e-04eb7a7e5972 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:57.311813 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f83a2db8-e98d-4893-b22e-04eb7a7e5972 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/d9d9afd3-aeba-4429-a474-7c70a960d4e0" status: 200 len: 1315 microversion: 2.1 time: 1.517953 Sep 14 09:03:57.323745 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1725/3487] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:03:55 2022] GET /compute/v2.1/servers/d9d9afd3-aeba-4429-a474-7c70a960d4e0 => generated 1315 bytes in 1530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:03:57.698181 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-35c63db7-e5cc-4bfd-a71c-914569748123 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84afbf1d30574a7aa1186a481687c50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a90781147416fa5db6b8922209058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:57.730707 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-35c63db7-e5cc-4bfd-a71c-914569748123 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84afbf1d30574a7aa1186a481687c50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a90781147416fa5db6b8922209058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:57.736359 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-35c63db7-e5cc-4bfd-a71c-914569748123 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84afbf1d30574a7aa1186a481687c50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a90781147416fa5db6b8922209058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:57.738327 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-35c63db7-e5cc-4bfd-a71c-914569748123 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] 10.222.0.60 "GET /compute/v2.1/servers/900c4e61-76fe-472f-bba7-0c83895f62cf" status: 200 len: 1407 microversion: 2.54 time: 0.768698 Sep 14 09:03:57.746008 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1763/3488] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:03:56 2022] GET /compute/v2.1/servers/900c4e61-76fe-472f-bba7-0c83895f62cf => generated 1407 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:03:57.950571 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3248a9f9-76fa-4fdd-8410-6b12cedd35b8 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-2025113445", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "2c78c45c-3b97-40bb-98a8-71b09cd0e9f7"}]}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:03:58.000436 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-6305df86-a79a-43ce-ad08-8b9eea8db956 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:58.001117 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-6305df86-a79a-43ce-ad08-8b9eea8db956 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] [instance: 0eb40c80-c056-4096-a586-7e957a63f7cf] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:03:58.021503 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6305df86-a79a-43ce-ad08-8b9eea8db956 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:58.023546 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6305df86-a79a-43ce-ad08-8b9eea8db956 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:58.031002 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6305df86-a79a-43ce-ad08-8b9eea8db956 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:58.032078 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6305df86-a79a-43ce-ad08-8b9eea8db956 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:58.036714 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6305df86-a79a-43ce-ad08-8b9eea8db956 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:58.037378 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6305df86-a79a-43ce-ad08-8b9eea8db956 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:58.065632 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.network.neutron [None req-3248a9f9-76fa-4fdd-8410-6b12cedd35b8 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] validate_networks() for [('2c78c45c-3b97-40bb-98a8-71b09cd0e9f7', None, None, None, None, None)] {{(pid=128759) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:03:58.892037 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-6305df86-a79a-43ce-ad08-8b9eea8db956 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:58.908597 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-6305df86-a79a-43ce-ad08-8b9eea8db956 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:58.914013 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-6305df86-a79a-43ce-ad08-8b9eea8db956 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:58.926417 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-6305df86-a79a-43ce-ad08-8b9eea8db956 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] 10.222.0.60 "GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf" status: 200 len: 1544 microversion: 2.91 time: 0.929729 Sep 14 09:03:58.929993 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1764/3489] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:03:57 2022] GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf => generated 1544 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:03:58.939961 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-258ecd9c-0089-4285-b485-7c5c93edfe29 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:58.940891 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-258ecd9c-0089-4285-b485-7c5c93edfe29 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: d9d9afd3-aeba-4429-a474-7c70a960d4e0] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:03:58.968868 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-258ecd9c-0089-4285-b485-7c5c93edfe29 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:58.968868 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-258ecd9c-0089-4285-b485-7c5c93edfe29 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:58.968868 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-258ecd9c-0089-4285-b485-7c5c93edfe29 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:58.968868 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-258ecd9c-0089-4285-b485-7c5c93edfe29 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:58.968868 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-258ecd9c-0089-4285-b485-7c5c93edfe29 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:58.968868 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-258ecd9c-0089-4285-b485-7c5c93edfe29 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:59.696835 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-258ecd9c-0089-4285-b485-7c5c93edfe29 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:59.712045 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-258ecd9c-0089-4285-b485-7c5c93edfe29 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/d9d9afd3-aeba-4429-a474-7c70a960d4e0" status: 200 len: 1315 microversion: 2.1 time: 0.774431 Sep 14 09:03:59.713184 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1765/3490] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:03:58 2022] GET /compute/v2.1/servers/d9d9afd3-aeba-4429-a474-7c70a960d4e0 => generated 1315 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:03:59.718111 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-278d7762-ed1b-45d1-9f7e-c9fd09c0be69 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:59.723966 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-278d7762-ed1b-45d1-9f7e-c9fd09c0be69 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] [instance: 900c4e61-76fe-472f-bba7-0c83895f62cf] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:03:59.737211 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-278d7762-ed1b-45d1-9f7e-c9fd09c0be69 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:59.737817 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-278d7762-ed1b-45d1-9f7e-c9fd09c0be69 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:59.738357 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-278d7762-ed1b-45d1-9f7e-c9fd09c0be69 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:59.739203 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-278d7762-ed1b-45d1-9f7e-c9fd09c0be69 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:59.739923 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-278d7762-ed1b-45d1-9f7e-c9fd09c0be69 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:59.741029 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-278d7762-ed1b-45d1-9f7e-c9fd09c0be69 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:59.849901 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-3248a9f9-76fa-4fdd-8410-6b12cedd35b8 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Flavor limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:03:59.850883 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-3248a9f9-76fa-4fdd-8410-6b12cedd35b8 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Image limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:03:59.851414 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-3248a9f9-76fa-4fdd-8410-6b12cedd35b8 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Flavor pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:03:59.851835 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-3248a9f9-76fa-4fdd-8410-6b12cedd35b8 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Image pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:03:59.852532 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-3248a9f9-76fa-4fdd-8410-6b12cedd35b8 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:03:59.875972 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3248a9f9-76fa-4fdd-8410-6b12cedd35b8 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:59.877034 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3248a9f9-76fa-4fdd-8410-6b12cedd35b8 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:59.877717 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3248a9f9-76fa-4fdd-8410-6b12cedd35b8 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:59.878774 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3248a9f9-76fa-4fdd-8410-6b12cedd35b8 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:59.879705 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3248a9f9-76fa-4fdd-8410-6b12cedd35b8 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:59.880368 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3248a9f9-76fa-4fdd-8410-6b12cedd35b8 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:59.909342 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-278d7762-ed1b-45d1-9f7e-c9fd09c0be69 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84afbf1d30574a7aa1186a481687c50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a90781147416fa5db6b8922209058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:59.928297 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-278d7762-ed1b-45d1-9f7e-c9fd09c0be69 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84afbf1d30574a7aa1186a481687c50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a90781147416fa5db6b8922209058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:59.937253 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-278d7762-ed1b-45d1-9f7e-c9fd09c0be69 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84afbf1d30574a7aa1186a481687c50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a90781147416fa5db6b8922209058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:03:59.941778 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-278d7762-ed1b-45d1-9f7e-c9fd09c0be69 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] 10.222.0.60 "GET /compute/v2.1/servers/900c4e61-76fe-472f-bba7-0c83895f62cf" status: 200 len: 1407 microversion: 2.54 time: 0.227349 Sep 14 09:03:59.944707 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1766/3491] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:03:59 2022] GET /compute/v2.1/servers/900c4e61-76fe-472f-bba7-0c83895f62cf => generated 1407 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:03:59.952290 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-3248a9f9-76fa-4fdd-8410-6b12cedd35b8 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Getting quotas for project bd19911fb94d47ab92893a3ec449fbbe. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:03:59.962178 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a5d60d9d-d470-49bf-96a8-48483fb70574 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:03:59.962835 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-a5d60d9d-d470-49bf-96a8-48483fb70574 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] [instance: 0eb40c80-c056-4096-a586-7e957a63f7cf] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:03:59.976340 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-3248a9f9-76fa-4fdd-8410-6b12cedd35b8 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Getting quotas for user 504ea33de5724b518bcdf28076d6361e and project bd19911fb94d47ab92893a3ec449fbbe. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:03:59.988751 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a5d60d9d-d470-49bf-96a8-48483fb70574 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:59.989278 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a5d60d9d-d470-49bf-96a8-48483fb70574 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:59.989729 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a5d60d9d-d470-49bf-96a8-48483fb70574 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:03:59.990465 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a5d60d9d-d470-49bf-96a8-48483fb70574 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:03:59.991014 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a5d60d9d-d470-49bf-96a8-48483fb70574 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:03:59.991390 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a5d60d9d-d470-49bf-96a8-48483fb70574 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:00.022644 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-3248a9f9-76fa-4fdd-8410-6b12cedd35b8 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Going to run 2 instances... {{(pid=128759) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:04:00.027077 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-3248a9f9-76fa-4fdd-8410-6b12cedd35b8 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] [instance: d98ba025-ba7a-40fa-8fd2-44eeef653b6a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128759) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:04:00.102532 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-3248a9f9-76fa-4fdd-8410-6b12cedd35b8 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] [instance: 2aefa743-500a-4cd6-b3d9-d1cf138ee1da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=d98ba025-ba7a-40fa-8fd2-44eeef653b6a,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128759) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:04:00.204736 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-a5d60d9d-d470-49bf-96a8-48483fb70574 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:00.223399 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-a5d60d9d-d470-49bf-96a8-48483fb70574 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:00.239219 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-a5d60d9d-d470-49bf-96a8-48483fb70574 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:00.242233 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-3248a9f9-76fa-4fdd-8410-6b12cedd35b8 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.915281 Sep 14 09:04:00.245208 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1726/3492] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 09:03:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 2921 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:04:00.259201 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-7d1f48f5-2339-42a3-940e-479c71e31273 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:00.274524 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-a5d60d9d-d470-49bf-96a8-48483fb70574 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] 10.222.0.60 "GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf" status: 200 len: 1544 microversion: 2.91 time: 0.311302 Sep 14 09:04:00.299327 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1767/3493] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:03:59 2022] GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf => generated 1544 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:04:00.299485 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-7d1f48f5-2339-42a3-940e-479c71e31273 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '504ea33de5724b518bcdf28076d6361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd19911fb94d47ab92893a3ec449fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:00.299485 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-7d1f48f5-2339-42a3-940e-479c71e31273 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Searching by: {'deleted': False, 'project_id': 'bd19911fb94d47ab92893a3ec449fbbe'} {{(pid=128759) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 14 09:04:00.323905 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7d1f48f5-2339-42a3-940e-479c71e31273 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:00.324614 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7d1f48f5-2339-42a3-940e-479c71e31273 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:00.325121 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7d1f48f5-2339-42a3-940e-479c71e31273 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:00.325970 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7d1f48f5-2339-42a3-940e-479c71e31273 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:00.326529 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7d1f48f5-2339-42a3-940e-479c71e31273 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:00.327233 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7d1f48f5-2339-42a3-940e-479c71e31273 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:00.369767 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-7d1f48f5-2339-42a3-940e-479c71e31273 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] 10.222.0.60 "GET /compute/v2.1/servers" status: 200 len: 677 microversion: 2.1 time: 0.116867 Sep 14 09:04:00.379377 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1727/3494] 10.222.0.60 () {58 vars in 1125 bytes} [Wed Sep 14 09:04:00 2022] GET /compute/v2.1/servers => generated 677 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:04:00.399977 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-195c237a-8e68-4887-980d-5857743c3e10 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:00.401639 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-195c237a-8e68-4887-980d-5857743c3e10 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] [instance: 2aefa743-500a-4cd6-b3d9-d1cf138ee1da] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:00.646791 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-195c237a-8e68-4887-980d-5857743c3e10 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504ea33de5724b518bcdf28076d6361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd19911fb94d47ab92893a3ec449fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:00.649390 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=25 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:04:00.661283 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-195c237a-8e68-4887-980d-5857743c3e10 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] 10.222.0.60 "GET /compute/v2.1/servers/2aefa743-500a-4cd6-b3d9-d1cf138ee1da" status: 200 len: 1220 microversion: 2.1 time: 0.272101 Sep 14 09:04:00.681139 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1768/3495] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:04:00 2022] GET /compute/v2.1/servers/2aefa743-500a-4cd6-b3d9-d1cf138ee1da => generated 1220 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:04:00.740739 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c0c83a3a-1d21-40c1-949f-9147dcb40c9b tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:00.741973 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-c0c83a3a-1d21-40c1-949f-9147dcb40c9b tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: d9d9afd3-aeba-4429-a474-7c70a960d4e0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:00.756729 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c0c83a3a-1d21-40c1-949f-9147dcb40c9b tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:00.759078 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c0c83a3a-1d21-40c1-949f-9147dcb40c9b tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:00.759977 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c0c83a3a-1d21-40c1-949f-9147dcb40c9b tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:00.771567 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c0c83a3a-1d21-40c1-949f-9147dcb40c9b tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:00.772096 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c0c83a3a-1d21-40c1-949f-9147dcb40c9b tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:00.774701 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c0c83a3a-1d21-40c1-949f-9147dcb40c9b tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:00.984054 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-0ac7bdd1-6c3b-47a5-aa35-12ca15d96553 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:00.988013 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-0ac7bdd1-6c3b-47a5-aa35-12ca15d96553 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] [instance: 900c4e61-76fe-472f-bba7-0c83895f62cf] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:01.003728 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0ac7bdd1-6c3b-47a5-aa35-12ca15d96553 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:01.008022 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0ac7bdd1-6c3b-47a5-aa35-12ca15d96553 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:01.008801 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0ac7bdd1-6c3b-47a5-aa35-12ca15d96553 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:01.017192 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0ac7bdd1-6c3b-47a5-aa35-12ca15d96553 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:01.018163 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0ac7bdd1-6c3b-47a5-aa35-12ca15d96553 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:01.020350 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0ac7bdd1-6c3b-47a5-aa35-12ca15d96553 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:01.487489 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-0ac7bdd1-6c3b-47a5-aa35-12ca15d96553 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84afbf1d30574a7aa1186a481687c50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a90781147416fa5db6b8922209058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:01.503806 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-0ac7bdd1-6c3b-47a5-aa35-12ca15d96553 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84afbf1d30574a7aa1186a481687c50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a90781147416fa5db6b8922209058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:01.506308 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-0ac7bdd1-6c3b-47a5-aa35-12ca15d96553 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84afbf1d30574a7aa1186a481687c50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a90781147416fa5db6b8922209058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:01.510644 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-0ac7bdd1-6c3b-47a5-aa35-12ca15d96553 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] 10.222.0.60 "GET /compute/v2.1/servers/900c4e61-76fe-472f-bba7-0c83895f62cf" status: 200 len: 1407 microversion: 2.54 time: 0.536119 Sep 14 09:04:01.529109 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1769/3496] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:04:00 2022] GET /compute/v2.1/servers/900c4e61-76fe-472f-bba7-0c83895f62cf => generated 1407 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:04:01.534197 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-abfa0301-5acb-46a0-9824-51993e50d3a4 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:01.534835 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-abfa0301-5acb-46a0-9824-51993e50d3a4 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] [instance: 0eb40c80-c056-4096-a586-7e957a63f7cf] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:01.550920 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:04:01.562723 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-abfa0301-5acb-46a0-9824-51993e50d3a4 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:01.565151 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-abfa0301-5acb-46a0-9824-51993e50d3a4 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:01.565837 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-abfa0301-5acb-46a0-9824-51993e50d3a4 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:01.566902 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-abfa0301-5acb-46a0-9824-51993e50d3a4 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:01.569360 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-abfa0301-5acb-46a0-9824-51993e50d3a4 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:01.570161 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-abfa0301-5acb-46a0-9824-51993e50d3a4 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:01.656202 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-c0c83a3a-1d21-40c1-949f-9147dcb40c9b tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:01.664469 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-c0c83a3a-1d21-40c1-949f-9147dcb40c9b tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/d9d9afd3-aeba-4429-a474-7c70a960d4e0" status: 200 len: 1315 microversion: 2.1 time: 0.927728 Sep 14 09:04:01.669300 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1728/3497] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:04:00 2022] GET /compute/v2.1/servers/d9d9afd3-aeba-4429-a474-7c70a960d4e0 => generated 1315 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:04:01.827988 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-abfa0301-5acb-46a0-9824-51993e50d3a4 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:01.846413 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-abfa0301-5acb-46a0-9824-51993e50d3a4 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:01.847920 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-abfa0301-5acb-46a0-9824-51993e50d3a4 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:01.867864 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-abfa0301-5acb-46a0-9824-51993e50d3a4 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] 10.222.0.60 "GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf" status: 200 len: 1544 microversion: 2.91 time: 0.337538 Sep 14 09:04:01.868461 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1770/3498] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:04:01 2022] GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf => generated 1544 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:04:01.888369 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-46d62513-6b04-4e90-b68a-601cfa4b5ec7 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:01.888994 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-46d62513-6b04-4e90-b68a-601cfa4b5ec7 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] [instance: 2aefa743-500a-4cd6-b3d9-d1cf138ee1da] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:02.012455 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-46d62513-6b04-4e90-b68a-601cfa4b5ec7 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504ea33de5724b518bcdf28076d6361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd19911fb94d47ab92893a3ec449fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:02.017554 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-0a85b0ef-689e-4a9e-9273-b5b9d4c7f9f7 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-1792971798", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "networks": "none"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:04:02.020363 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-46d62513-6b04-4e90-b68a-601cfa4b5ec7 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] 10.222.0.60 "GET /compute/v2.1/servers/2aefa743-500a-4cd6-b3d9-d1cf138ee1da" status: 200 len: 1220 microversion: 2.1 time: 0.150790 Sep 14 09:04:02.020977 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1771/3499] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:04:01 2022] GET /compute/v2.1/servers/2aefa743-500a-4cd6-b3d9-d1cf138ee1da => generated 1220 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:04:02.138218 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-0a85b0ef-689e-4a9e-9273-b5b9d4c7f9f7 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Flavor limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:04:02.138645 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-0a85b0ef-689e-4a9e-9273-b5b9d4c7f9f7 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Image limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:04:02.139146 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-0a85b0ef-689e-4a9e-9273-b5b9d4c7f9f7 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Flavor pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:04:02.140169 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-0a85b0ef-689e-4a9e-9273-b5b9d4c7f9f7 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Image pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:04:02.140954 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-0a85b0ef-689e-4a9e-9273-b5b9d4c7f9f7 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:04:02.155623 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0a85b0ef-689e-4a9e-9273-b5b9d4c7f9f7 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:02.157187 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0a85b0ef-689e-4a9e-9273-b5b9d4c7f9f7 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:02.157187 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0a85b0ef-689e-4a9e-9273-b5b9d4c7f9f7 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:02.158084 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0a85b0ef-689e-4a9e-9273-b5b9d4c7f9f7 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:02.159432 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0a85b0ef-689e-4a9e-9273-b5b9d4c7f9f7 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:02.161245 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0a85b0ef-689e-4a9e-9273-b5b9d4c7f9f7 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:02.206965 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-0a85b0ef-689e-4a9e-9273-b5b9d4c7f9f7 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Getting quotas for project b304cd14b65640dab95dc8926eb90818. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:04:02.214163 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-0a85b0ef-689e-4a9e-9273-b5b9d4c7f9f7 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Getting quotas for user 1e6b965ba7c340f190f9cafc69e46748 and project b304cd14b65640dab95dc8926eb90818. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:04:02.247785 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-0a85b0ef-689e-4a9e-9273-b5b9d4c7f9f7 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Going to run 1 instances... {{(pid=128759) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:04:02.268056 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-0a85b0ef-689e-4a9e-9273-b5b9d4c7f9f7 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] [instance: fcc183e1-b880-4005-bb3e-90ab91ed7911] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128759) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:04:02.412334 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-0a85b0ef-689e-4a9e-9273-b5b9d4c7f9f7 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.741564 Sep 14 09:04:02.413481 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1729/3500] 10.222.0.60 () {62 vars in 1188 bytes} [Wed Sep 14 09:04:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 743 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 14 09:04:02.424682 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-8b75c1c2-b4c9-4b1a-9cba-5c9c585a125d tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:02.425679 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-8b75c1c2-b4c9-4b1a-9cba-5c9c585a125d tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] [instance: fcc183e1-b880-4005-bb3e-90ab91ed7911] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:02.548059 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9494c1d5-374b-4510-b5ea-8a5daac63e82 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:02.549359 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-9494c1d5-374b-4510-b5ea-8a5daac63e82 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] [instance: 900c4e61-76fe-472f-bba7-0c83895f62cf] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:02.561099 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9494c1d5-374b-4510-b5ea-8a5daac63e82 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:02.580952 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9494c1d5-374b-4510-b5ea-8a5daac63e82 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:02.582210 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9494c1d5-374b-4510-b5ea-8a5daac63e82 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:02.586890 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9494c1d5-374b-4510-b5ea-8a5daac63e82 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:02.588076 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9494c1d5-374b-4510-b5ea-8a5daac63e82 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:02.590628 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9494c1d5-374b-4510-b5ea-8a5daac63e82 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:02.663762 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-8b75c1c2-b4c9-4b1a-9cba-5c9c585a125d tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6b965ba7c340f190f9cafc69e46748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b304cd14b65640dab95dc8926eb90818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:02.673205 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-8b75c1c2-b4c9-4b1a-9cba-5c9c585a125d tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6b965ba7c340f190f9cafc69e46748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b304cd14b65640dab95dc8926eb90818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:02.681044 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-8b75c1c2-b4c9-4b1a-9cba-5c9c585a125d tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6b965ba7c340f190f9cafc69e46748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b304cd14b65640dab95dc8926eb90818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:02.687199 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-8b75c1c2-b4c9-4b1a-9cba-5c9c585a125d tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] 10.222.0.60 "GET /compute/v2.1/servers/fcc183e1-b880-4005-bb3e-90ab91ed7911" status: 200 len: 1278 microversion: 2.57 time: 0.262226 Sep 14 09:04:02.689386 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1772/3501] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:04:02 2022] GET /compute/v2.1/servers/fcc183e1-b880-4005-bb3e-90ab91ed7911 => generated 1278 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:04:02.707239 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a9a92baa-1e97-45fa-b106-938e955d3a9b tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:02.708721 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-a9a92baa-1e97-45fa-b106-938e955d3a9b tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: d9d9afd3-aeba-4429-a474-7c70a960d4e0] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:02.720761 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a9a92baa-1e97-45fa-b106-938e955d3a9b tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:02.722373 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a9a92baa-1e97-45fa-b106-938e955d3a9b tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:02.723834 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a9a92baa-1e97-45fa-b106-938e955d3a9b tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:02.725411 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-9494c1d5-374b-4510-b5ea-8a5daac63e82 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84afbf1d30574a7aa1186a481687c50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a90781147416fa5db6b8922209058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:02.726137 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a9a92baa-1e97-45fa-b106-938e955d3a9b tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:02.726756 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a9a92baa-1e97-45fa-b106-938e955d3a9b tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:02.728789 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a9a92baa-1e97-45fa-b106-938e955d3a9b tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:02.737366 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-9494c1d5-374b-4510-b5ea-8a5daac63e82 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84afbf1d30574a7aa1186a481687c50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a90781147416fa5db6b8922209058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:02.738852 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-9494c1d5-374b-4510-b5ea-8a5daac63e82 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84afbf1d30574a7aa1186a481687c50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a90781147416fa5db6b8922209058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:02.748914 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-9494c1d5-374b-4510-b5ea-8a5daac63e82 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] 10.222.0.60 "GET /compute/v2.1/servers/900c4e61-76fe-472f-bba7-0c83895f62cf" status: 200 len: 1407 microversion: 2.54 time: 0.207587 Sep 14 09:04:02.771333 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1730/3502] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:04:02 2022] GET /compute/v2.1/servers/900c4e61-76fe-472f-bba7-0c83895f62cf => generated 1407 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:04:02.903034 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-da1cf34b-52af-470f-b69e-b7f46827d0eb tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:02.904063 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-da1cf34b-52af-470f-b69e-b7f46827d0eb tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] [instance: 0eb40c80-c056-4096-a586-7e957a63f7cf] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:02.926007 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-da1cf34b-52af-470f-b69e-b7f46827d0eb tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:02.926519 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-da1cf34b-52af-470f-b69e-b7f46827d0eb tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:02.929379 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-da1cf34b-52af-470f-b69e-b7f46827d0eb tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:02.930196 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-da1cf34b-52af-470f-b69e-b7f46827d0eb tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:02.933873 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-da1cf34b-52af-470f-b69e-b7f46827d0eb tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:02.934381 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-da1cf34b-52af-470f-b69e-b7f46827d0eb tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:03.086513 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-da1cf34b-52af-470f-b69e-b7f46827d0eb tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:03.099383 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-da1cf34b-52af-470f-b69e-b7f46827d0eb tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:03.102742 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-da1cf34b-52af-470f-b69e-b7f46827d0eb tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:03.121360 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-da1cf34b-52af-470f-b69e-b7f46827d0eb tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] 10.222.0.60 "GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf" status: 200 len: 1544 microversion: 2.91 time: 0.224157 Sep 14 09:04:03.125153 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1731/3503] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:04:02 2022] GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf => generated 1544 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:04:03.138765 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-38623348-5d84-4ff3-b11a-e43a452ce216 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:03.140941 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-38623348-5d84-4ff3-b11a-e43a452ce216 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] [instance: 2aefa743-500a-4cd6-b3d9-d1cf138ee1da] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:03.155564 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-38623348-5d84-4ff3-b11a-e43a452ce216 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:03.156086 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-38623348-5d84-4ff3-b11a-e43a452ce216 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:03.156545 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-38623348-5d84-4ff3-b11a-e43a452ce216 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:03.160605 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-38623348-5d84-4ff3-b11a-e43a452ce216 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:03.161182 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-38623348-5d84-4ff3-b11a-e43a452ce216 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:03.162848 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-38623348-5d84-4ff3-b11a-e43a452ce216 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:03.293956 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-a9a92baa-1e97-45fa-b106-938e955d3a9b tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:03.310821 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-a9a92baa-1e97-45fa-b106-938e955d3a9b tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/d9d9afd3-aeba-4429-a474-7c70a960d4e0" status: 200 len: 1315 microversion: 2.1 time: 0.614890 Sep 14 09:04:03.311818 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1773/3504] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:04:02 2022] GET /compute/v2.1/servers/d9d9afd3-aeba-4429-a474-7c70a960d4e0 => generated 1315 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:04:03.466097 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-38623348-5d84-4ff3-b11a-e43a452ce216 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504ea33de5724b518bcdf28076d6361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd19911fb94d47ab92893a3ec449fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:03.484741 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-38623348-5d84-4ff3-b11a-e43a452ce216 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] 10.222.0.60 "GET /compute/v2.1/servers/2aefa743-500a-4cd6-b3d9-d1cf138ee1da" status: 200 len: 1272 microversion: 2.1 time: 0.355729 Sep 14 09:04:03.501639 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1732/3505] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:04:03 2022] GET /compute/v2.1/servers/2aefa743-500a-4cd6-b3d9-d1cf138ee1da => generated 1272 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:04:03.720042 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-fe3aa9e9-5e25-4276-ac2f-c434c9f95a06 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:03.720668 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-fe3aa9e9-5e25-4276-ac2f-c434c9f95a06 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] [instance: fcc183e1-b880-4005-bb3e-90ab91ed7911] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:03.740399 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fe3aa9e9-5e25-4276-ac2f-c434c9f95a06 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:03.745436 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fe3aa9e9-5e25-4276-ac2f-c434c9f95a06 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:03.746096 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fe3aa9e9-5e25-4276-ac2f-c434c9f95a06 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:03.746872 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fe3aa9e9-5e25-4276-ac2f-c434c9f95a06 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:03.747381 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fe3aa9e9-5e25-4276-ac2f-c434c9f95a06 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:03.747814 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fe3aa9e9-5e25-4276-ac2f-c434c9f95a06 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:03.778986 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-6c6a9bce-3b40-4bff-bc18-732a5a4005ed tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:03.779610 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-6c6a9bce-3b40-4bff-bc18-732a5a4005ed tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] [instance: 900c4e61-76fe-472f-bba7-0c83895f62cf] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:03.792998 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6c6a9bce-3b40-4bff-bc18-732a5a4005ed tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:03.795030 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6c6a9bce-3b40-4bff-bc18-732a5a4005ed tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:03.797348 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6c6a9bce-3b40-4bff-bc18-732a5a4005ed tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:03.799603 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6c6a9bce-3b40-4bff-bc18-732a5a4005ed tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:03.804327 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6c6a9bce-3b40-4bff-bc18-732a5a4005ed tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:03.806091 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6c6a9bce-3b40-4bff-bc18-732a5a4005ed tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:03.871570 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=100 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:04:04.214791 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-6c6a9bce-3b40-4bff-bc18-732a5a4005ed tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84afbf1d30574a7aa1186a481687c50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a90781147416fa5db6b8922209058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:04.224464 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-6c6a9bce-3b40-4bff-bc18-732a5a4005ed tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84afbf1d30574a7aa1186a481687c50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a90781147416fa5db6b8922209058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:04.231124 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-6c6a9bce-3b40-4bff-bc18-732a5a4005ed tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84afbf1d30574a7aa1186a481687c50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a90781147416fa5db6b8922209058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:04.236718 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-6c6a9bce-3b40-4bff-bc18-732a5a4005ed tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] 10.222.0.60 "GET /compute/v2.1/servers/900c4e61-76fe-472f-bba7-0c83895f62cf" status: 200 len: 1407 microversion: 2.54 time: 0.457804 Sep 14 09:04:04.237688 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1733/3506] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:04:03 2022] GET /compute/v2.1/servers/900c4e61-76fe-472f-bba7-0c83895f62cf => generated 1407 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 09:04:04.341997 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-fe3aa9e9-5e25-4276-ac2f-c434c9f95a06 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6b965ba7c340f190f9cafc69e46748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b304cd14b65640dab95dc8926eb90818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:04.351010 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-8829294d-9a73-488c-b233-4cdfe4ae7f57 req-ade49493-7c3b-4efc-9b6c-2d7b8c9e5b4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9d9afd3-aeba-4429-a474-7c70a960d4e0", "name": "network-vif-plugged", "status": "completed", "tag": "f8440eec-c0f1-49c8-b0e1-c14bd38590a8"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:04:04.352897 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-fe3aa9e9-5e25-4276-ac2f-c434c9f95a06 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6b965ba7c340f190f9cafc69e46748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b304cd14b65640dab95dc8926eb90818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:04.358719 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-fe3aa9e9-5e25-4276-ac2f-c434c9f95a06 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6b965ba7c340f190f9cafc69e46748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b304cd14b65640dab95dc8926eb90818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:04.363254 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-fe3aa9e9-5e25-4276-ac2f-c434c9f95a06 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] 10.222.0.60 "GET /compute/v2.1/servers/fcc183e1-b880-4005-bb3e-90ab91ed7911" status: 200 len: 1282 microversion: 2.57 time: 0.647727 Sep 14 09:04:04.364530 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1774/3507] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:04:03 2022] GET /compute/v2.1/servers/fcc183e1-b880-4005-bb3e-90ab91ed7911 => generated 1282 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:04:04.386826 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-8829294d-9a73-488c-b233-4cdfe4ae7f57 req-ade49493-7c3b-4efc-9b6c-2d7b8c9e5b4a service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:04.387237 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-8829294d-9a73-488c-b233-4cdfe4ae7f57 req-ade49493-7c3b-4efc-9b6c-2d7b8c9e5b4a service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:04.388711 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-0c77cc5e-caf1-4550-a212-fc9c5042c5a1 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:04.389492 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-0c77cc5e-caf1-4550-a212-fc9c5042c5a1 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] [instance: 0eb40c80-c056-4096-a586-7e957a63f7cf] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:04.395046 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-8829294d-9a73-488c-b233-4cdfe4ae7f57 req-ade49493-7c3b-4efc-9b6c-2d7b8c9e5b4a service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:04.399049 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0c77cc5e-caf1-4550-a212-fc9c5042c5a1 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:04.401105 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0c77cc5e-caf1-4550-a212-fc9c5042c5a1 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:04.405664 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0c77cc5e-caf1-4550-a212-fc9c5042c5a1 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:04.406659 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0c77cc5e-caf1-4550-a212-fc9c5042c5a1 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:04.415821 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0c77cc5e-caf1-4550-a212-fc9c5042c5a1 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:04.416455 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0c77cc5e-caf1-4550-a212-fc9c5042c5a1 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:04.421601 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-8829294d-9a73-488c-b233-4cdfe4ae7f57 req-ade49493-7c3b-4efc-9b6c-2d7b8c9e5b4a service nova] Creating event network-vif-plugged:f8440eec-c0f1-49c8-b0e1-c14bd38590a8 for instance d9d9afd3-aeba-4429-a474-7c70a960d4e0 on n-h1-836830-18 Sep 14 09:04:04.429679 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=100 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:04:04.433862 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-8829294d-9a73-488c-b233-4cdfe4ae7f57 req-ade49493-7c3b-4efc-9b6c-2d7b8c9e5b4a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.194669 Sep 14 09:04:04.434658 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1734/3508] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:04:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:04:04.459675 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-1260c2e3-3af4-4056-9970-3e499095e9a2 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:04.460410 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-1260c2e3-3af4-4056-9970-3e499095e9a2 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: d9d9afd3-aeba-4429-a474-7c70a960d4e0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:04.471948 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1260c2e3-3af4-4056-9970-3e499095e9a2 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:04.472733 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1260c2e3-3af4-4056-9970-3e499095e9a2 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:04.473386 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1260c2e3-3af4-4056-9970-3e499095e9a2 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:04.474283 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1260c2e3-3af4-4056-9970-3e499095e9a2 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:04.474967 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1260c2e3-3af4-4056-9970-3e499095e9a2 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:04.475417 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1260c2e3-3af4-4056-9970-3e499095e9a2 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:04.779599 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-0c77cc5e-caf1-4550-a212-fc9c5042c5a1 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:04.794444 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-0c77cc5e-caf1-4550-a212-fc9c5042c5a1 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:04.797522 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-0c77cc5e-caf1-4550-a212-fc9c5042c5a1 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:04.810097 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-0c77cc5e-caf1-4550-a212-fc9c5042c5a1 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] 10.222.0.60 "GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf" status: 200 len: 1544 microversion: 2.91 time: 0.442982 Sep 14 09:04:04.813290 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1775/3509] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:04:04 2022] GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf => generated 1544 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:04:04.831031 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-60a4373d-868d-425c-b4ae-868fa18540fe tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:04.832019 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-60a4373d-868d-425c-b4ae-868fa18540fe tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] [instance: 2aefa743-500a-4cd6-b3d9-d1cf138ee1da] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:04.843775 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-60a4373d-868d-425c-b4ae-868fa18540fe tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:04.844606 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-60a4373d-868d-425c-b4ae-868fa18540fe tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:04.846260 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-60a4373d-868d-425c-b4ae-868fa18540fe tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:04.848172 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-60a4373d-868d-425c-b4ae-868fa18540fe tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:04.850313 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-60a4373d-868d-425c-b4ae-868fa18540fe tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:04.853166 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-60a4373d-868d-425c-b4ae-868fa18540fe tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:04.880817 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-1260c2e3-3af4-4056-9970-3e499095e9a2 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:04.893956 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-1260c2e3-3af4-4056-9970-3e499095e9a2 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/d9d9afd3-aeba-4429-a474-7c70a960d4e0" status: 200 len: 1315 microversion: 2.1 time: 0.447665 Sep 14 09:04:04.898620 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1735/3510] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:04:04 2022] GET /compute/v2.1/servers/d9d9afd3-aeba-4429-a474-7c70a960d4e0 => generated 1315 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:04:05.017618 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-60a4373d-868d-425c-b4ae-868fa18540fe tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504ea33de5724b518bcdf28076d6361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd19911fb94d47ab92893a3ec449fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:05.028624 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-60a4373d-868d-425c-b4ae-868fa18540fe tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] 10.222.0.60 "GET /compute/v2.1/servers/2aefa743-500a-4cd6-b3d9-d1cf138ee1da" status: 200 len: 1278 microversion: 2.1 time: 0.213690 Sep 14 09:04:05.039791 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1776/3511] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:04:04 2022] GET /compute/v2.1/servers/2aefa743-500a-4cd6-b3d9-d1cf138ee1da => generated 1278 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:04:05.272169 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-044ef1db-351e-4f5f-9c39-cfa79a1e7876 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:05.273228 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-044ef1db-351e-4f5f-9c39-cfa79a1e7876 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] [instance: 900c4e61-76fe-472f-bba7-0c83895f62cf] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:05.286458 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-044ef1db-351e-4f5f-9c39-cfa79a1e7876 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:05.287376 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-044ef1db-351e-4f5f-9c39-cfa79a1e7876 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:05.287985 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-044ef1db-351e-4f5f-9c39-cfa79a1e7876 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:05.289402 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-044ef1db-351e-4f5f-9c39-cfa79a1e7876 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:05.290024 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-044ef1db-351e-4f5f-9c39-cfa79a1e7876 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:05.291679 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-044ef1db-351e-4f5f-9c39-cfa79a1e7876 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:05.394645 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ffcb6005-94dd-42f4-b9ee-eedae33913f0 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:05.395570 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-ffcb6005-94dd-42f4-b9ee-eedae33913f0 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] [instance: fcc183e1-b880-4005-bb3e-90ab91ed7911] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:05.410328 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ffcb6005-94dd-42f4-b9ee-eedae33913f0 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:05.411054 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ffcb6005-94dd-42f4-b9ee-eedae33913f0 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:05.411988 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ffcb6005-94dd-42f4-b9ee-eedae33913f0 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:05.413919 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ffcb6005-94dd-42f4-b9ee-eedae33913f0 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:05.414703 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ffcb6005-94dd-42f4-b9ee-eedae33913f0 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:05.418005 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ffcb6005-94dd-42f4-b9ee-eedae33913f0 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:05.454921 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-044ef1db-351e-4f5f-9c39-cfa79a1e7876 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84afbf1d30574a7aa1186a481687c50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a90781147416fa5db6b8922209058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:05.467659 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-044ef1db-351e-4f5f-9c39-cfa79a1e7876 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84afbf1d30574a7aa1186a481687c50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a90781147416fa5db6b8922209058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:05.473910 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-044ef1db-351e-4f5f-9c39-cfa79a1e7876 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84afbf1d30574a7aa1186a481687c50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a90781147416fa5db6b8922209058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:05.475204 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-044ef1db-351e-4f5f-9c39-cfa79a1e7876 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] 10.222.0.60 "GET /compute/v2.1/servers/900c4e61-76fe-472f-bba7-0c83895f62cf" status: 200 len: 1407 microversion: 2.54 time: 0.209572 Sep 14 09:04:05.487117 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1736/3512] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:04:05 2022] GET /compute/v2.1/servers/900c4e61-76fe-472f-bba7-0c83895f62cf => generated 1407 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:04:05.762017 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-ffcb6005-94dd-42f4-b9ee-eedae33913f0 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6b965ba7c340f190f9cafc69e46748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b304cd14b65640dab95dc8926eb90818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:05.790257 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-ffcb6005-94dd-42f4-b9ee-eedae33913f0 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6b965ba7c340f190f9cafc69e46748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b304cd14b65640dab95dc8926eb90818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:05.791989 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-ffcb6005-94dd-42f4-b9ee-eedae33913f0 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6b965ba7c340f190f9cafc69e46748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b304cd14b65640dab95dc8926eb90818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:05.800243 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-ffcb6005-94dd-42f4-b9ee-eedae33913f0 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] 10.222.0.60 "GET /compute/v2.1/servers/fcc183e1-b880-4005-bb3e-90ab91ed7911" status: 200 len: 1336 microversion: 2.57 time: 0.413531 Sep 14 09:04:05.804338 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1777/3513] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:04:05 2022] GET /compute/v2.1/servers/fcc183e1-b880-4005-bb3e-90ab91ed7911 => generated 1336 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 09:04:05.848486 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-453a2145-5672-4695-8e2d-bfda4cee59a7 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:05.849192 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-453a2145-5672-4695-8e2d-bfda4cee59a7 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] [instance: 0eb40c80-c056-4096-a586-7e957a63f7cf] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:05.860760 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-453a2145-5672-4695-8e2d-bfda4cee59a7 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:05.861416 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-453a2145-5672-4695-8e2d-bfda4cee59a7 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:05.861925 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-453a2145-5672-4695-8e2d-bfda4cee59a7 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:05.864255 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-453a2145-5672-4695-8e2d-bfda4cee59a7 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:05.864841 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-453a2145-5672-4695-8e2d-bfda4cee59a7 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:05.866449 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-453a2145-5672-4695-8e2d-bfda4cee59a7 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:05.930572 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-5cd1e5b0-4aed-40d1-b457-42a0c62c8b1f tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:05.932120 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-5cd1e5b0-4aed-40d1-b457-42a0c62c8b1f tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: d9d9afd3-aeba-4429-a474-7c70a960d4e0] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:05.960224 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5cd1e5b0-4aed-40d1-b457-42a0c62c8b1f tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:05.968747 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5cd1e5b0-4aed-40d1-b457-42a0c62c8b1f tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:05.970676 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5cd1e5b0-4aed-40d1-b457-42a0c62c8b1f tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:05.971676 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5cd1e5b0-4aed-40d1-b457-42a0c62c8b1f tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:05.973807 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5cd1e5b0-4aed-40d1-b457-42a0c62c8b1f tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:05.974582 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5cd1e5b0-4aed-40d1-b457-42a0c62c8b1f tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:06.026578 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-453a2145-5672-4695-8e2d-bfda4cee59a7 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:06.042617 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-453a2145-5672-4695-8e2d-bfda4cee59a7 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:06.050867 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-453a2145-5672-4695-8e2d-bfda4cee59a7 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:06.071404 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-453a2145-5672-4695-8e2d-bfda4cee59a7 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] 10.222.0.60 "GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf" status: 200 len: 1544 microversion: 2.91 time: 0.230741 Sep 14 09:04:06.087148 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1737/3514] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:04:05 2022] GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf => generated 1544 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:04:06.099453 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-2b5ccd34-4b72-4adb-bc91-9ffb8ff58a61 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:06.100654 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-2b5ccd34-4b72-4adb-bc91-9ffb8ff58a61 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] [instance: 2aefa743-500a-4cd6-b3d9-d1cf138ee1da] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:06.108285 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2b5ccd34-4b72-4adb-bc91-9ffb8ff58a61 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:06.109046 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2b5ccd34-4b72-4adb-bc91-9ffb8ff58a61 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:06.109547 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2b5ccd34-4b72-4adb-bc91-9ffb8ff58a61 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:06.110274 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2b5ccd34-4b72-4adb-bc91-9ffb8ff58a61 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:06.110737 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2b5ccd34-4b72-4adb-bc91-9ffb8ff58a61 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:06.111194 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2b5ccd34-4b72-4adb-bc91-9ffb8ff58a61 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:06.296910 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-2b5ccd34-4b72-4adb-bc91-9ffb8ff58a61 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504ea33de5724b518bcdf28076d6361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd19911fb94d47ab92893a3ec449fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:06.311657 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-2b5ccd34-4b72-4adb-bc91-9ffb8ff58a61 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] 10.222.0.60 "GET /compute/v2.1/servers/2aefa743-500a-4cd6-b3d9-d1cf138ee1da" status: 200 len: 1278 microversion: 2.1 time: 0.222846 Sep 14 09:04:06.312258 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1738/3515] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:04:06 2022] GET /compute/v2.1/servers/2aefa743-500a-4cd6-b3d9-d1cf138ee1da => generated 1278 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:04:06.502567 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-68e6da93-c637-4a45-937e-684a69280a56 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:06.503764 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-68e6da93-c637-4a45-937e-684a69280a56 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] [instance: 900c4e61-76fe-472f-bba7-0c83895f62cf] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:06.515036 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-68e6da93-c637-4a45-937e-684a69280a56 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:06.515812 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-68e6da93-c637-4a45-937e-684a69280a56 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:06.523795 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-68e6da93-c637-4a45-937e-684a69280a56 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:06.524610 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-68e6da93-c637-4a45-937e-684a69280a56 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:06.525570 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-68e6da93-c637-4a45-937e-684a69280a56 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:06.526281 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-68e6da93-c637-4a45-937e-684a69280a56 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:06.855080 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-68e6da93-c637-4a45-937e-684a69280a56 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84afbf1d30574a7aa1186a481687c50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a90781147416fa5db6b8922209058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:06.868075 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-68e6da93-c637-4a45-937e-684a69280a56 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84afbf1d30574a7aa1186a481687c50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a90781147416fa5db6b8922209058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:06.870814 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-68e6da93-c637-4a45-937e-684a69280a56 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84afbf1d30574a7aa1186a481687c50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a90781147416fa5db6b8922209058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:06.872808 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-68e6da93-c637-4a45-937e-684a69280a56 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] 10.222.0.60 "GET /compute/v2.1/servers/900c4e61-76fe-472f-bba7-0c83895f62cf" status: 200 len: 1407 microversion: 2.54 time: 0.374137 Sep 14 09:04:06.874103 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1739/3516] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:04:06 2022] GET /compute/v2.1/servers/900c4e61-76fe-472f-bba7-0c83895f62cf => generated 1407 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 09:04:06.879240 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-19e57595-9350-4051-8c09-5d2e4cbc39b5 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:06.880438 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-19e57595-9350-4051-8c09-5d2e4cbc39b5 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] [instance: fcc183e1-b880-4005-bb3e-90ab91ed7911] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:06.887204 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-19e57595-9350-4051-8c09-5d2e4cbc39b5 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:06.887830 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-19e57595-9350-4051-8c09-5d2e4cbc39b5 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:06.888435 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-19e57595-9350-4051-8c09-5d2e4cbc39b5 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:06.889244 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-19e57595-9350-4051-8c09-5d2e4cbc39b5 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:06.889804 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-19e57595-9350-4051-8c09-5d2e4cbc39b5 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:06.890461 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-19e57595-9350-4051-8c09-5d2e4cbc39b5 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:06.919896 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-5cd1e5b0-4aed-40d1-b457-42a0c62c8b1f tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:06.931746 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-5cd1e5b0-4aed-40d1-b457-42a0c62c8b1f tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/d9d9afd3-aeba-4429-a474-7c70a960d4e0" status: 200 len: 1315 microversion: 2.1 time: 1.009895 Sep 14 09:04:06.932663 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1778/3517] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:04:05 2022] GET /compute/v2.1/servers/d9d9afd3-aeba-4429-a474-7c70a960d4e0 => generated 1315 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:04:07.044866 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-19e57595-9350-4051-8c09-5d2e4cbc39b5 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6b965ba7c340f190f9cafc69e46748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b304cd14b65640dab95dc8926eb90818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:07.060772 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-19e57595-9350-4051-8c09-5d2e4cbc39b5 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6b965ba7c340f190f9cafc69e46748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b304cd14b65640dab95dc8926eb90818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:07.066474 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-19e57595-9350-4051-8c09-5d2e4cbc39b5 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6b965ba7c340f190f9cafc69e46748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b304cd14b65640dab95dc8926eb90818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:07.068151 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-19e57595-9350-4051-8c09-5d2e4cbc39b5 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] 10.222.0.60 "GET /compute/v2.1/servers/fcc183e1-b880-4005-bb3e-90ab91ed7911" status: 200 len: 1336 microversion: 2.57 time: 0.192708 Sep 14 09:04:07.069303 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1740/3518] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:04:06 2022] GET /compute/v2.1/servers/fcc183e1-b880-4005-bb3e-90ab91ed7911 => generated 1336 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:04:07.101851 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-e0b3cd88-b1e9-4d87-9c55-e0d68d44c663 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:07.102797 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-e0b3cd88-b1e9-4d87-9c55-e0d68d44c663 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] [instance: 0eb40c80-c056-4096-a586-7e957a63f7cf] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:07.111811 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e0b3cd88-b1e9-4d87-9c55-e0d68d44c663 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:07.112378 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e0b3cd88-b1e9-4d87-9c55-e0d68d44c663 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:07.112898 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e0b3cd88-b1e9-4d87-9c55-e0d68d44c663 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:07.113680 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e0b3cd88-b1e9-4d87-9c55-e0d68d44c663 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:07.114271 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e0b3cd88-b1e9-4d87-9c55-e0d68d44c663 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:07.114771 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e0b3cd88-b1e9-4d87-9c55-e0d68d44c663 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:07.341072 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-4e235223-faa8-4b91-aa63-f46a8fefe837 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:07.342206 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-4e235223-faa8-4b91-aa63-f46a8fefe837 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] [instance: 2aefa743-500a-4cd6-b3d9-d1cf138ee1da] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:07.352552 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4e235223-faa8-4b91-aa63-f46a8fefe837 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:07.353820 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4e235223-faa8-4b91-aa63-f46a8fefe837 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:07.354478 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4e235223-faa8-4b91-aa63-f46a8fefe837 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:07.355365 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4e235223-faa8-4b91-aa63-f46a8fefe837 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:07.356132 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4e235223-faa8-4b91-aa63-f46a8fefe837 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:07.356802 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4e235223-faa8-4b91-aa63-f46a8fefe837 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:07.367438 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-e0b3cd88-b1e9-4d87-9c55-e0d68d44c663 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:07.385303 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-e0b3cd88-b1e9-4d87-9c55-e0d68d44c663 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:07.386867 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-e0b3cd88-b1e9-4d87-9c55-e0d68d44c663 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:07.404791 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-e0b3cd88-b1e9-4d87-9c55-e0d68d44c663 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] 10.222.0.60 "GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf" status: 200 len: 1531 microversion: 2.91 time: 0.305032 Sep 14 09:04:07.405434 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1779/3519] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:04:07 2022] GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf => generated 1531 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:04:07.435727 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d9953b80-235f-4965-b057-85f5756911f3 tempest-UnshelveToHostMultiNodesTest-151498122 tempest-UnshelveToHostMultiNodesTest-151498122-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:07.436399 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-d9953b80-235f-4965-b057-85f5756911f3 tempest-UnshelveToHostMultiNodesTest-151498122 tempest-UnshelveToHostMultiNodesTest-151498122-project-admin] [instance: 0eb40c80-c056-4096-a586-7e957a63f7cf] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:07.460390 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d9953b80-235f-4965-b057-85f5756911f3 tempest-UnshelveToHostMultiNodesTest-151498122 tempest-UnshelveToHostMultiNodesTest-151498122-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:07.460933 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d9953b80-235f-4965-b057-85f5756911f3 tempest-UnshelveToHostMultiNodesTest-151498122 tempest-UnshelveToHostMultiNodesTest-151498122-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:07.461382 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d9953b80-235f-4965-b057-85f5756911f3 tempest-UnshelveToHostMultiNodesTest-151498122 tempest-UnshelveToHostMultiNodesTest-151498122-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:07.462125 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d9953b80-235f-4965-b057-85f5756911f3 tempest-UnshelveToHostMultiNodesTest-151498122 tempest-UnshelveToHostMultiNodesTest-151498122-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:07.467536 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d9953b80-235f-4965-b057-85f5756911f3 tempest-UnshelveToHostMultiNodesTest-151498122 tempest-UnshelveToHostMultiNodesTest-151498122-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:07.468033 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d9953b80-235f-4965-b057-85f5756911f3 tempest-UnshelveToHostMultiNodesTest-151498122 tempest-UnshelveToHostMultiNodesTest-151498122-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:07.702052 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.objects.instance [None req-d9953b80-235f-4965-b057-85f5756911f3 tempest-UnshelveToHostMultiNodesTest-151498122 tempest-UnshelveToHostMultiNodesTest-151498122-project-admin] Lazy-loading 'services' on Instance uuid 0eb40c80-c056-4096-a586-7e957a63f7cf {{(pid=128758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:04:07.736987 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-d9953b80-235f-4965-b057-85f5756911f3 tempest-UnshelveToHostMultiNodesTest-151498122 tempest-UnshelveToHostMultiNodesTest-151498122-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf" status: 200 len: 1938 microversion: 2.91 time: 0.304871 Sep 14 09:04:07.751407 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1780/3520] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:04:07 2022] GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf => generated 1938 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:04:07.787418 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-3751adae-bbd7-47e2-a193-9157d42d69c1 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:07.787921 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-3751adae-bbd7-47e2-a193-9157d42d69c1 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] [instance: 0eb40c80-c056-4096-a586-7e957a63f7cf] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:07.795599 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3751adae-bbd7-47e2-a193-9157d42d69c1 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:07.796465 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3751adae-bbd7-47e2-a193-9157d42d69c1 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:07.797107 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3751adae-bbd7-47e2-a193-9157d42d69c1 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:07.798036 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3751adae-bbd7-47e2-a193-9157d42d69c1 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:07.798678 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3751adae-bbd7-47e2-a193-9157d42d69c1 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:07.799377 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3751adae-bbd7-47e2-a193-9157d42d69c1 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:07.842290 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-3751adae-bbd7-47e2-a193-9157d42d69c1 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] [instance: 0eb40c80-c056-4096-a586-7e957a63f7cf] Going to try to terminate instance {{(pid=128758) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:04:07.962967 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-3751adae-bbd7-47e2-a193-9157d42d69c1 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] 10.222.0.60 "DELETE /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf" status: 204 len: 0 microversion: 2.91 time: 0.179140 Sep 14 09:04:07.970696 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1781/3521] 10.222.0.60 () {60 vars in 1280 bytes} [Wed Sep 14 09:04:07 2022] DELETE /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 14 09:04:07.985386 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ff21f540-b820-41b2-874a-211146a53b63 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:07.987463 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-ff21f540-b820-41b2-874a-211146a53b63 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] [instance: 900c4e61-76fe-472f-bba7-0c83895f62cf] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:08.002467 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ff21f540-b820-41b2-874a-211146a53b63 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:08.007557 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ff21f540-b820-41b2-874a-211146a53b63 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:08.008231 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ff21f540-b820-41b2-874a-211146a53b63 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:08.009409 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ff21f540-b820-41b2-874a-211146a53b63 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:08.010673 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ff21f540-b820-41b2-874a-211146a53b63 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:08.011394 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ff21f540-b820-41b2-874a-211146a53b63 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:08.279573 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-ff21f540-b820-41b2-874a-211146a53b63 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84afbf1d30574a7aa1186a481687c50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a90781147416fa5db6b8922209058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:08.292845 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-ff21f540-b820-41b2-874a-211146a53b63 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84afbf1d30574a7aa1186a481687c50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a90781147416fa5db6b8922209058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:08.300460 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-ff21f540-b820-41b2-874a-211146a53b63 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84afbf1d30574a7aa1186a481687c50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a90781147416fa5db6b8922209058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:08.302107 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-ff21f540-b820-41b2-874a-211146a53b63 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] 10.222.0.60 "GET /compute/v2.1/servers/900c4e61-76fe-472f-bba7-0c83895f62cf" status: 200 len: 1407 microversion: 2.54 time: 0.329537 Sep 14 09:04:08.302820 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1782/3522] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:04:07 2022] GET /compute/v2.1/servers/900c4e61-76fe-472f-bba7-0c83895f62cf => generated 1407 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:04:08.308469 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-dfc528ab-b5b6-49de-a36a-6df1d84416e3 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:08.309642 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-dfc528ab-b5b6-49de-a36a-6df1d84416e3 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: d9d9afd3-aeba-4429-a474-7c70a960d4e0] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:08.316994 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dfc528ab-b5b6-49de-a36a-6df1d84416e3 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:08.317884 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dfc528ab-b5b6-49de-a36a-6df1d84416e3 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:08.321067 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dfc528ab-b5b6-49de-a36a-6df1d84416e3 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:08.322424 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dfc528ab-b5b6-49de-a36a-6df1d84416e3 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:08.325047 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dfc528ab-b5b6-49de-a36a-6df1d84416e3 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:08.325909 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dfc528ab-b5b6-49de-a36a-6df1d84416e3 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:08.466372 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-4e235223-faa8-4b91-aa63-f46a8fefe837 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504ea33de5724b518bcdf28076d6361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd19911fb94d47ab92893a3ec449fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:08.485249 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-4e235223-faa8-4b91-aa63-f46a8fefe837 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] 10.222.0.60 "GET /compute/v2.1/servers/2aefa743-500a-4cd6-b3d9-d1cf138ee1da" status: 200 len: 1320 microversion: 2.1 time: 1.149134 Sep 14 09:04:08.488369 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1741/3523] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:04:07 2022] GET /compute/v2.1/servers/2aefa743-500a-4cd6-b3d9-d1cf138ee1da => generated 1320 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:04:08.495423 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-0eb69939-4019-41e4-8e3c-1c2430408059 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:08.496304 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-0eb69939-4019-41e4-8e3c-1c2430408059 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] [instance: 0eb40c80-c056-4096-a586-7e957a63f7cf] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:08.504282 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0eb69939-4019-41e4-8e3c-1c2430408059 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:08.504917 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0eb69939-4019-41e4-8e3c-1c2430408059 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:08.505460 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0eb69939-4019-41e4-8e3c-1c2430408059 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:08.507038 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0eb69939-4019-41e4-8e3c-1c2430408059 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:08.507579 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0eb69939-4019-41e4-8e3c-1c2430408059 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:08.508129 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0eb69939-4019-41e4-8e3c-1c2430408059 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:08.714713 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-0eb69939-4019-41e4-8e3c-1c2430408059 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:08.733510 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-0eb69939-4019-41e4-8e3c-1c2430408059 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:08.736530 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-0eb69939-4019-41e4-8e3c-1c2430408059 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:08.746124 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-0eb69939-4019-41e4-8e3c-1c2430408059 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] 10.222.0.60 "GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf" status: 200 len: 1537 microversion: 2.91 time: 0.256457 Sep 14 09:04:08.747217 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1742/3524] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:04:08 2022] GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf => generated 1537 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:04:08.767018 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c27a1aa0-0118-4103-b6f3-ccd3a28e798e tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:08.771667 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-c27a1aa0-0118-4103-b6f3-ccd3a28e798e tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] [instance: fcc183e1-b880-4005-bb3e-90ab91ed7911] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:08.779992 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c27a1aa0-0118-4103-b6f3-ccd3a28e798e tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:08.780822 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c27a1aa0-0118-4103-b6f3-ccd3a28e798e tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:08.781733 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c27a1aa0-0118-4103-b6f3-ccd3a28e798e tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:08.782660 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c27a1aa0-0118-4103-b6f3-ccd3a28e798e tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:08.783319 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c27a1aa0-0118-4103-b6f3-ccd3a28e798e tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:08.783759 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c27a1aa0-0118-4103-b6f3-ccd3a28e798e tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:08.936926 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-dfc528ab-b5b6-49de-a36a-6df1d84416e3 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:08.947297 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-dfc528ab-b5b6-49de-a36a-6df1d84416e3 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/d9d9afd3-aeba-4429-a474-7c70a960d4e0" status: 200 len: 1503 microversion: 2.1 time: 0.643023 Sep 14 09:04:08.948348 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1783/3525] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:04:08 2022] GET /compute/v2.1/servers/d9d9afd3-aeba-4429-a474-7c70a960d4e0 => generated 1503 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:04:08.958050 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-3f6d327a-0857-423e-b613-caeef6319561 req-f3f17b87-3f7a-4caf-9e02-6caa0d0e262d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d98ba025-ba7a-40fa-8fd2-44eeef653b6a", "tag": "3a5171fd-1fb3-45a5-96ab-d18a838c87da"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:04:08.972068 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-3f6d327a-0857-423e-b613-caeef6319561 req-f3f17b87-3f7a-4caf-9e02-6caa0d0e262d service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:08.973429 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-3f6d327a-0857-423e-b613-caeef6319561 req-f3f17b87-3f7a-4caf-9e02-6caa0d0e262d service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:08.974084 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-3f6d327a-0857-423e-b613-caeef6319561 req-f3f17b87-3f7a-4caf-9e02-6caa0d0e262d service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:08.991364 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-3f6d327a-0857-423e-b613-caeef6319561 req-f3f17b87-3f7a-4caf-9e02-6caa0d0e262d service nova] Creating event network-changed:3a5171fd-1fb3-45a5-96ab-d18a838c87da for instance d98ba025-ba7a-40fa-8fd2-44eeef653b6a on n-h2-836830-18 Sep 14 09:04:08.992371 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-c27a1aa0-0118-4103-b6f3-ccd3a28e798e tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6b965ba7c340f190f9cafc69e46748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b304cd14b65640dab95dc8926eb90818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:09.006061 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-3f6d327a-0857-423e-b613-caeef6319561 req-f3f17b87-3f7a-4caf-9e02-6caa0d0e262d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056189 Sep 14 09:04:09.006740 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1784/3526] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:04:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:04:09.018629 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-c27a1aa0-0118-4103-b6f3-ccd3a28e798e tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6b965ba7c340f190f9cafc69e46748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b304cd14b65640dab95dc8926eb90818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:09.020738 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-c27a1aa0-0118-4103-b6f3-ccd3a28e798e tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6b965ba7c340f190f9cafc69e46748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b304cd14b65640dab95dc8926eb90818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:09.022350 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b4ead549-10fa-4851-a912-5ea9149b8345 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:04:09.023100 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-b4ead549-10fa-4851-a912-5ea9149b8345 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: d9d9afd3-aeba-4429-a474-7c70a960d4e0] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:09.026240 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-c27a1aa0-0118-4103-b6f3-ccd3a28e798e tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] 10.222.0.60 "GET /compute/v2.1/servers/fcc183e1-b880-4005-bb3e-90ab91ed7911" status: 200 len: 1357 microversion: 2.57 time: 0.264990 Sep 14 09:04:09.027671 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1743/3527] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:04:08 2022] GET /compute/v2.1/servers/fcc183e1-b880-4005-bb3e-90ab91ed7911 => generated 1357 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:04:09.033792 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b4ead549-10fa-4851-a912-5ea9149b8345 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:09.034296 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b4ead549-10fa-4851-a912-5ea9149b8345 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:09.034744 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b4ead549-10fa-4851-a912-5ea9149b8345 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:09.035496 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b4ead549-10fa-4851-a912-5ea9149b8345 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:09.036128 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b4ead549-10fa-4851-a912-5ea9149b8345 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:09.036573 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b4ead549-10fa-4851-a912-5ea9149b8345 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:09.059960 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-404148be-4c29-469a-9560-bf5c02e87c91 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:04:09.064032 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.objects.instance [None req-b4ead549-10fa-4851-a912-5ea9149b8345 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lazy-loading 'flavor' on Instance uuid d9d9afd3-aeba-4429-a474-7c70a960d4e0 {{(pid=128758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:04:09.074433 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-404148be-4c29-469a-9560-bf5c02e87c91 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] [instance: fcc183e1-b880-4005-bb3e-90ab91ed7911] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:09.083610 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-404148be-4c29-469a-9560-bf5c02e87c91 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:09.084345 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-404148be-4c29-469a-9560-bf5c02e87c91 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:09.085056 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-404148be-4c29-469a-9560-bf5c02e87c91 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:09.085984 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-404148be-4c29-469a-9560-bf5c02e87c91 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:09.087366 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-404148be-4c29-469a-9560-bf5c02e87c91 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:09.088071 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-404148be-4c29-469a-9560-bf5c02e87c91 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:09.201463 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-b4ead549-10fa-4851-a912-5ea9149b8345 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "POST /compute/v2.1/servers/d9d9afd3-aeba-4429-a474-7c70a960d4e0/action" status: 202 len: 0 microversion: 2.1 time: 0.189961 Sep 14 09:04:09.203896 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1785/3528] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:04:09 2022] POST /compute/v2.1/servers/d9d9afd3-aeba-4429-a474-7c70a960d4e0/action => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:04:09.216774 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b8594d09-a657-4baa-ad91-dc23b470758d tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:09.218754 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-b8594d09-a657-4baa-ad91-dc23b470758d tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: d9d9afd3-aeba-4429-a474-7c70a960d4e0] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:09.233366 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b8594d09-a657-4baa-ad91-dc23b470758d tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:09.234439 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b8594d09-a657-4baa-ad91-dc23b470758d tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:09.235215 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b8594d09-a657-4baa-ad91-dc23b470758d tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:09.236411 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b8594d09-a657-4baa-ad91-dc23b470758d tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:09.237275 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b8594d09-a657-4baa-ad91-dc23b470758d tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:09.238617 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b8594d09-a657-4baa-ad91-dc23b470758d tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:09.250381 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-404148be-4c29-469a-9560-bf5c02e87c91 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Flavor limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:04:09.257531 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-404148be-4c29-469a-9560-bf5c02e87c91 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Image limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:04:09.260228 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-404148be-4c29-469a-9560-bf5c02e87c91 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Flavor pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:04:09.261045 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-404148be-4c29-469a-9560-bf5c02e87c91 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Image pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:04:09.261488 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-404148be-4c29-469a-9560-bf5c02e87c91 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:04:09.359258 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-404148be-4c29-469a-9560-bf5c02e87c91 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] [instance: fcc183e1-b880-4005-bb3e-90ab91ed7911] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:09.367752 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-404148be-4c29-469a-9560-bf5c02e87c91 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:09.368425 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-404148be-4c29-469a-9560-bf5c02e87c91 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:09.369145 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-404148be-4c29-469a-9560-bf5c02e87c91 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:09.370535 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-404148be-4c29-469a-9560-bf5c02e87c91 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:09.372243 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-404148be-4c29-469a-9560-bf5c02e87c91 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:09.372935 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-404148be-4c29-469a-9560-bf5c02e87c91 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:09.411642 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-404148be-4c29-469a-9560-bf5c02e87c91 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] 10.222.0.60 "POST /compute/v2.1/servers/fcc183e1-b880-4005-bb3e-90ab91ed7911/action" status: 202 len: 1138 microversion: 2.57 time: 0.361114 Sep 14 09:04:09.412961 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1744/3529] 10.222.0.60 () {62 vars in 1320 bytes} [Wed Sep 14 09:04:09 2022] POST /compute/v2.1/servers/fcc183e1-b880-4005-bb3e-90ab91ed7911/action => generated 1138 bytes in 363 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Sep 14 09:04:09.418508 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8cf52baf-ac6c-45ad-baca-a41eca117d8a tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:09.419185 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-8cf52baf-ac6c-45ad-baca-a41eca117d8a tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] [instance: 900c4e61-76fe-472f-bba7-0c83895f62cf] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:09.436764 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8cf52baf-ac6c-45ad-baca-a41eca117d8a tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:09.437693 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8cf52baf-ac6c-45ad-baca-a41eca117d8a tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:09.438365 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8cf52baf-ac6c-45ad-baca-a41eca117d8a tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:09.439591 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8cf52baf-ac6c-45ad-baca-a41eca117d8a tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:09.443524 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8cf52baf-ac6c-45ad-baca-a41eca117d8a tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:09.443972 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8cf52baf-ac6c-45ad-baca-a41eca117d8a tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:09.607005 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-8cf52baf-ac6c-45ad-baca-a41eca117d8a tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84afbf1d30574a7aa1186a481687c50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a90781147416fa5db6b8922209058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:09.624201 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-8cf52baf-ac6c-45ad-baca-a41eca117d8a tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84afbf1d30574a7aa1186a481687c50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a90781147416fa5db6b8922209058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:09.626610 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-8cf52baf-ac6c-45ad-baca-a41eca117d8a tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84afbf1d30574a7aa1186a481687c50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a90781147416fa5db6b8922209058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:09.628171 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-8cf52baf-ac6c-45ad-baca-a41eca117d8a tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] 10.222.0.60 "GET /compute/v2.1/servers/900c4e61-76fe-472f-bba7-0c83895f62cf" status: 200 len: 1407 microversion: 2.54 time: 0.214116 Sep 14 09:04:09.629142 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1745/3530] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:04:09 2022] GET /compute/v2.1/servers/900c4e61-76fe-472f-bba7-0c83895f62cf => generated 1407 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:04:09.637878 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-32e505e1-4eee-453b-8ed2-ebe7a515f43c tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:09.639414 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-32e505e1-4eee-453b-8ed2-ebe7a515f43c tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] [instance: fcc183e1-b880-4005-bb3e-90ab91ed7911] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:09.649859 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-32e505e1-4eee-453b-8ed2-ebe7a515f43c tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:09.651758 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-b8594d09-a657-4baa-ad91-dc23b470758d tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:09.651918 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-32e505e1-4eee-453b-8ed2-ebe7a515f43c tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:09.652735 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-32e505e1-4eee-453b-8ed2-ebe7a515f43c tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:09.653664 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-32e505e1-4eee-453b-8ed2-ebe7a515f43c tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:09.655027 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-32e505e1-4eee-453b-8ed2-ebe7a515f43c tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:09.656546 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-32e505e1-4eee-453b-8ed2-ebe7a515f43c tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:09.659739 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-b8594d09-a657-4baa-ad91-dc23b470758d tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/d9d9afd3-aeba-4429-a474-7c70a960d4e0" status: 200 len: 1511 microversion: 2.1 time: 0.450407 Sep 14 09:04:09.668654 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1786/3531] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:04:09 2022] GET /compute/v2.1/servers/d9d9afd3-aeba-4429-a474-7c70a960d4e0 => generated 1511 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:04:09.674096 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-0fa0b195-4339-4116-877d-84fd38544c03 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:09.674927 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-0fa0b195-4339-4116-877d-84fd38544c03 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] [instance: 2aefa743-500a-4cd6-b3d9-d1cf138ee1da] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:09.687235 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0fa0b195-4339-4116-877d-84fd38544c03 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:09.692547 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0fa0b195-4339-4116-877d-84fd38544c03 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:09.693206 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0fa0b195-4339-4116-877d-84fd38544c03 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:09.694124 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0fa0b195-4339-4116-877d-84fd38544c03 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:09.694846 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0fa0b195-4339-4116-877d-84fd38544c03 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:09.695490 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0fa0b195-4339-4116-877d-84fd38544c03 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:09.819464 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-32e505e1-4eee-453b-8ed2-ebe7a515f43c tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6b965ba7c340f190f9cafc69e46748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b304cd14b65640dab95dc8926eb90818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:09.831863 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-32e505e1-4eee-453b-8ed2-ebe7a515f43c tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6b965ba7c340f190f9cafc69e46748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b304cd14b65640dab95dc8926eb90818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:09.833431 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-32e505e1-4eee-453b-8ed2-ebe7a515f43c tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6b965ba7c340f190f9cafc69e46748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b304cd14b65640dab95dc8926eb90818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:09.835749 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-32e505e1-4eee-453b-8ed2-ebe7a515f43c tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] 10.222.0.60 "GET /compute/v2.1/servers/fcc183e1-b880-4005-bb3e-90ab91ed7911" status: 200 len: 1366 microversion: 2.57 time: 0.205048 Sep 14 09:04:09.842212 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1746/3532] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:04:09 2022] GET /compute/v2.1/servers/fcc183e1-b880-4005-bb3e-90ab91ed7911 => generated 1366 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:04:09.857040 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8e433e48-5871-4569-af45-dc7e35cc5316 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:09.857664 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-8e433e48-5871-4569-af45-dc7e35cc5316 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] [instance: 0eb40c80-c056-4096-a586-7e957a63f7cf] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:09.864736 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8e433e48-5871-4569-af45-dc7e35cc5316 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:09.865229 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8e433e48-5871-4569-af45-dc7e35cc5316 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:09.865660 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8e433e48-5871-4569-af45-dc7e35cc5316 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:09.866359 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8e433e48-5871-4569-af45-dc7e35cc5316 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:09.866803 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8e433e48-5871-4569-af45-dc7e35cc5316 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:09.867426 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8e433e48-5871-4569-af45-dc7e35cc5316 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:10.107642 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-0fa0b195-4339-4116-877d-84fd38544c03 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504ea33de5724b518bcdf28076d6361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd19911fb94d47ab92893a3ec449fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:10.117779 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-0fa0b195-4339-4116-877d-84fd38544c03 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] 10.222.0.60 "GET /compute/v2.1/servers/2aefa743-500a-4cd6-b3d9-d1cf138ee1da" status: 200 len: 1320 microversion: 2.1 time: 0.447921 Sep 14 09:04:10.139707 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1787/3533] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:04:09 2022] GET /compute/v2.1/servers/2aefa743-500a-4cd6-b3d9-d1cf138ee1da => generated 1320 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:04:10.460776 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-8e433e48-5871-4569-af45-dc7e35cc5316 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:10.473978 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-8e433e48-5871-4569-af45-dc7e35cc5316 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:10.477518 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-8e433e48-5871-4569-af45-dc7e35cc5316 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bd1b458a72144f2aa62846c501fcb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aaac4d23e9f4744a274e7030dcbee68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:10.482863 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-8e433e48-5871-4569-af45-dc7e35cc5316 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] 10.222.0.60 "GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf" status: 200 len: 1537 microversion: 2.91 time: 0.638751 Sep 14 09:04:10.493137 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1747/3534] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:04:09 2022] GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf => generated 1537 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:04:10.661373 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-67dcf568-6956-4b52-8518-60d947f7ec2b tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:10.662010 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-67dcf568-6956-4b52-8518-60d947f7ec2b tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] [instance: 900c4e61-76fe-472f-bba7-0c83895f62cf] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:10.671023 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-67dcf568-6956-4b52-8518-60d947f7ec2b tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:10.674218 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-67dcf568-6956-4b52-8518-60d947f7ec2b tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:10.674687 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-67dcf568-6956-4b52-8518-60d947f7ec2b tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:10.675477 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-67dcf568-6956-4b52-8518-60d947f7ec2b tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:10.675949 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-67dcf568-6956-4b52-8518-60d947f7ec2b tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:10.676391 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-67dcf568-6956-4b52-8518-60d947f7ec2b tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:10.687164 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-2393f978-2d89-4f16-9904-19e075be1eb2 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:10.689108 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-2393f978-2d89-4f16-9904-19e075be1eb2 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: d9d9afd3-aeba-4429-a474-7c70a960d4e0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:10.698791 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2393f978-2d89-4f16-9904-19e075be1eb2 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:10.699761 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2393f978-2d89-4f16-9904-19e075be1eb2 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:10.702774 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2393f978-2d89-4f16-9904-19e075be1eb2 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:10.703978 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2393f978-2d89-4f16-9904-19e075be1eb2 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:10.704627 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2393f978-2d89-4f16-9904-19e075be1eb2 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:10.705320 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2393f978-2d89-4f16-9904-19e075be1eb2 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:11.026543 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-67dcf568-6956-4b52-8518-60d947f7ec2b tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84afbf1d30574a7aa1186a481687c50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a90781147416fa5db6b8922209058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:11.031453 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:04:11.038778 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-67dcf568-6956-4b52-8518-60d947f7ec2b tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84afbf1d30574a7aa1186a481687c50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a90781147416fa5db6b8922209058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:11.047683 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-67dcf568-6956-4b52-8518-60d947f7ec2b tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84afbf1d30574a7aa1186a481687c50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a90781147416fa5db6b8922209058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:11.051308 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-67dcf568-6956-4b52-8518-60d947f7ec2b tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] 10.222.0.60 "GET /compute/v2.1/servers/900c4e61-76fe-472f-bba7-0c83895f62cf" status: 200 len: 1407 microversion: 2.54 time: 0.395395 Sep 14 09:04:11.075413 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1788/3535] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:04:10 2022] GET /compute/v2.1/servers/900c4e61-76fe-472f-bba7-0c83895f62cf => generated 1407 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:04:11.086382 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c599fb36-4584-41cb-a0a9-0f71d89d5bc4 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:11.092128 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-c599fb36-4584-41cb-a0a9-0f71d89d5bc4 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] [instance: fcc183e1-b880-4005-bb3e-90ab91ed7911] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:11.100018 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c599fb36-4584-41cb-a0a9-0f71d89d5bc4 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:11.100519 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c599fb36-4584-41cb-a0a9-0f71d89d5bc4 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:11.100962 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c599fb36-4584-41cb-a0a9-0f71d89d5bc4 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:11.101673 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c599fb36-4584-41cb-a0a9-0f71d89d5bc4 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:11.102131 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c599fb36-4584-41cb-a0a9-0f71d89d5bc4 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:11.117059 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c599fb36-4584-41cb-a0a9-0f71d89d5bc4 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:11.284240 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-c599fb36-4584-41cb-a0a9-0f71d89d5bc4 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6b965ba7c340f190f9cafc69e46748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b304cd14b65640dab95dc8926eb90818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:11.301405 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-c599fb36-4584-41cb-a0a9-0f71d89d5bc4 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6b965ba7c340f190f9cafc69e46748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b304cd14b65640dab95dc8926eb90818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:11.303815 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-c599fb36-4584-41cb-a0a9-0f71d89d5bc4 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6b965ba7c340f190f9cafc69e46748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b304cd14b65640dab95dc8926eb90818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:11.309726 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-c599fb36-4584-41cb-a0a9-0f71d89d5bc4 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] 10.222.0.60 "GET /compute/v2.1/servers/fcc183e1-b880-4005-bb3e-90ab91ed7911" status: 200 len: 1366 microversion: 2.57 time: 0.232826 Sep 14 09:04:11.310496 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1789/3536] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:04:11 2022] GET /compute/v2.1/servers/fcc183e1-b880-4005-bb3e-90ab91ed7911 => generated 1366 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:04:11.337583 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-4337fbb6-0aeb-4543-84e5-18642297718a tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:11.338614 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-4337fbb6-0aeb-4543-84e5-18642297718a tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] [instance: 2aefa743-500a-4cd6-b3d9-d1cf138ee1da] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:11.353917 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4337fbb6-0aeb-4543-84e5-18642297718a tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:11.358569 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4337fbb6-0aeb-4543-84e5-18642297718a tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:11.359820 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4337fbb6-0aeb-4543-84e5-18642297718a tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:11.360749 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4337fbb6-0aeb-4543-84e5-18642297718a tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:11.361694 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4337fbb6-0aeb-4543-84e5-18642297718a tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:11.363161 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4337fbb6-0aeb-4543-84e5-18642297718a tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:11.550981 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-2393f978-2d89-4f16-9904-19e075be1eb2 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:11.555565 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:04:11.570058 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-2393f978-2d89-4f16-9904-19e075be1eb2 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/d9d9afd3-aeba-4429-a474-7c70a960d4e0" status: 200 len: 1511 microversion: 2.1 time: 0.888213 Sep 14 09:04:11.571912 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1748/3537] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:04:10 2022] GET /compute/v2.1/servers/d9d9afd3-aeba-4429-a474-7c70a960d4e0 => generated 1511 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:04:11.588462 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-737c0ccb-89d3-48ce-bd39-dcb76bfa5b40 req-565bc38d-a53b-4d1b-aad0-ba2df1a683a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2aefa743-500a-4cd6-b3d9-d1cf138ee1da", "tag": "9a1b9324-7bb5-4a21-a7e8-7e091b71bdaf"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:04:11.609192 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:04:11.614988 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-737c0ccb-89d3-48ce-bd39-dcb76bfa5b40 req-565bc38d-a53b-4d1b-aad0-ba2df1a683a5 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:11.617394 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-737c0ccb-89d3-48ce-bd39-dcb76bfa5b40 req-565bc38d-a53b-4d1b-aad0-ba2df1a683a5 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:11.619246 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-737c0ccb-89d3-48ce-bd39-dcb76bfa5b40 req-565bc38d-a53b-4d1b-aad0-ba2df1a683a5 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:11.655437 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-737c0ccb-89d3-48ce-bd39-dcb76bfa5b40 req-565bc38d-a53b-4d1b-aad0-ba2df1a683a5 service nova] Creating event network-changed:9a1b9324-7bb5-4a21-a7e8-7e091b71bdaf for instance 2aefa743-500a-4cd6-b3d9-d1cf138ee1da on n-h2-836830-18 Sep 14 09:04:11.671829 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-737c0ccb-89d3-48ce-bd39-dcb76bfa5b40 req-565bc38d-a53b-4d1b-aad0-ba2df1a683a5 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098244 Sep 14 09:04:11.675051 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1749/3538] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:04:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:04:11.691030 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-4e3c440c-bc65-4740-9ef5-56fde3b218d7 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:11.694465 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-4e3c440c-bc65-4740-9ef5-56fde3b218d7 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] [instance: 0eb40c80-c056-4096-a586-7e957a63f7cf] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:11.713913 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4e3c440c-bc65-4740-9ef5-56fde3b218d7 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:11.714726 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4e3c440c-bc65-4740-9ef5-56fde3b218d7 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:11.715503 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4e3c440c-bc65-4740-9ef5-56fde3b218d7 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:11.716482 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4e3c440c-bc65-4740-9ef5-56fde3b218d7 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:11.718094 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4e3c440c-bc65-4740-9ef5-56fde3b218d7 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:11.719267 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4e3c440c-bc65-4740-9ef5-56fde3b218d7 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:11.762760 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-4e3c440c-bc65-4740-9ef5-56fde3b218d7 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] HTTP exception thrown: Instance 0eb40c80-c056-4096-a586-7e957a63f7cf could not be found. Sep 14 09:04:11.764571 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-4e3c440c-bc65-4740-9ef5-56fde3b218d7 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Request method failure captured: Sep 14 09:04:11.764571 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf HTTP/1.1 Sep 14 09:04:11.764571 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:04:11.764571 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:04:11.764571 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:04:11.764571 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:04:11.764571 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:04:11.764571 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:04:11.764571 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:04:11.764571 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:04:11.764571 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZhKNeYM6r-BXA6tKyhv_BVqhQ1ShuMlY1pJZGDbxE1jTTj7c2YRmDtiMyMF2fX2AeAWTKw89E5oLpxh2SPOq9obWxBmkhxhFHzB1V_Wu5JRw-lcxja3_uagMKOTcFJ0SNW1WgxFUAXZP4gge3Kk5198R8Zixo2VD6yaFV3y166-cZs Sep 14 09:04:11.764571 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:04:11.764571 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:04:11.764571 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:04:11.764571 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:04:11.764571 n-d-836830-18 devstack@n-api.service[128759]: X-Openstack-Nova-Api-Version: 2.91 Sep 14 09:04:11.764571 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:04:11.764571 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:04:11.764571 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 6aaac4d23e9f4744a274e7030dcbee68 Sep 14 09:04:11.764571 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-UnshelveToHostMultiNodesTest-54118290 Sep 14 09:04:11.764571 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:04:11.764571 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:04:11.764571 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6aaac4d23e9f4744a274e7030dcbee68"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6aaac4d23e9f4744a274e7030dcbee68"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6aaac4d23e9f4744a274e7030dcbee68"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6aaac4d23e9f4744a274e7030dcbee68"}]}] Sep 14 09:04:11.764571 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-UnshelveToHostMultiNodesTest-54118290 Sep 14 09:04:11.764571 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 6aaac4d23e9f4744a274e7030dcbee68 Sep 14 09:04:11.764571 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-UnshelveToHostMultiNodesTest-54118290 Sep 14 09:04:11.764571 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-UnshelveToHostMultiNodesTest-54118290-project Sep 14 09:04:11.764571 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:04:11.764571 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:04:11.764571 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 7bd1b458a72144f2aa62846c501fcb30 Sep 14 09:04:11.764571 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-UnshelveToHostMultiNodesTest-54118290-project Sep 14 09:04:11.764571 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:04:11.764571 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance 0eb40c80-c056-4096-a586-7e957a63f7cf could not be found. Sep 14 09:04:11.764571 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '0eb40c80-c056-4096-a586-7e957a63f7cf'} Sep 14 09:04:11.764571 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:04:11.764571 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:04:11.764571 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:04:11.764571 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:04:11.764571 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:04:11.764571 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:04:11.764571 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:04:11.764571 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:04:11.764571 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:04:11.764571 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:04:11.764571 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0eb40c80-c056-4096-a586-7e957a63f7cf could not be found. Sep 14 09:04:11.764571 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:04:11.764571 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:04:11.764571 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:04:11.764571 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:04:11.764571 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:04:11.764571 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:04:11.764571 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:04:11.764571 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:04:11.764571 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:04:11.764571 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:04:11.764571 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:04:11.764571 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:04:11.764571 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:04:11.764571 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:04:11.764571 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:04:11.764571 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:04:11.764571 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0eb40c80-c056-4096-a586-7e957a63f7cf could not be found. Sep 14 09:04:11.764571 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:04:11.764571 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:04:11.770591 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:04:11.770591 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:04:11.770591 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:04:11.770591 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:04:11.770591 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:04:11.770591 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:04:11.770591 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0eb40c80-c056-4096-a586-7e957a63f7cf could not be found. Sep 14 09:04:11.770591 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:04:11.770591 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-4e3c440c-bc65-4740-9ef5-56fde3b218d7 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] Returning 404 to user: Instance 0eb40c80-c056-4096-a586-7e957a63f7cf could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:04:11.770591 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-4e3c440c-bc65-4740-9ef5-56fde3b218d7 tempest-UnshelveToHostMultiNodesTest-54118290 tempest-UnshelveToHostMultiNodesTest-54118290-project] 10.222.0.60 "GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf" status: 404 len: 111 microversion: 2.91 time: 0.089567 Sep 14 09:04:11.770591 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1750/3539] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:04:11 2022] GET /compute/v2.1/servers/0eb40c80-c056-4096-a586-7e957a63f7cf => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 14 09:04:12.082544 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-495e548c-7847-4749-a336-5ac37a567ec0 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:12.084407 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-495e548c-7847-4749-a336-5ac37a567ec0 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] [instance: 900c4e61-76fe-472f-bba7-0c83895f62cf] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:12.104463 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-495e548c-7847-4749-a336-5ac37a567ec0 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:12.107521 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-495e548c-7847-4749-a336-5ac37a567ec0 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:12.108030 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-495e548c-7847-4749-a336-5ac37a567ec0 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:12.110582 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-495e548c-7847-4749-a336-5ac37a567ec0 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:12.111180 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-495e548c-7847-4749-a336-5ac37a567ec0 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:12.115589 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-495e548c-7847-4749-a336-5ac37a567ec0 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:12.209374 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=6 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:04:12.235111 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=28 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:04:12.384470 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-495e548c-7847-4749-a336-5ac37a567ec0 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84afbf1d30574a7aa1186a481687c50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a90781147416fa5db6b8922209058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:12.395144 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-495e548c-7847-4749-a336-5ac37a567ec0 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84afbf1d30574a7aa1186a481687c50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a90781147416fa5db6b8922209058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:12.403261 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-495e548c-7847-4749-a336-5ac37a567ec0 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84afbf1d30574a7aa1186a481687c50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a90781147416fa5db6b8922209058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:12.404726 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-495e548c-7847-4749-a336-5ac37a567ec0 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] 10.222.0.60 "GET /compute/v2.1/servers/900c4e61-76fe-472f-bba7-0c83895f62cf" status: 200 len: 1407 microversion: 2.54 time: 0.326899 Sep 14 09:04:12.405293 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1751/3540] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:04:12 2022] GET /compute/v2.1/servers/900c4e61-76fe-472f-bba7-0c83895f62cf => generated 1407 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 09:04:12.410195 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8a6367f3-3e64-4da1-a101-c0e3294ee945 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:12.411066 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-8a6367f3-3e64-4da1-a101-c0e3294ee945 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] [instance: fcc183e1-b880-4005-bb3e-90ab91ed7911] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:12.418231 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8a6367f3-3e64-4da1-a101-c0e3294ee945 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:12.418998 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8a6367f3-3e64-4da1-a101-c0e3294ee945 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:12.419640 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8a6367f3-3e64-4da1-a101-c0e3294ee945 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:12.421003 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8a6367f3-3e64-4da1-a101-c0e3294ee945 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:12.422082 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8a6367f3-3e64-4da1-a101-c0e3294ee945 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:12.422685 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8a6367f3-3e64-4da1-a101-c0e3294ee945 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:12.633021 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-8a6367f3-3e64-4da1-a101-c0e3294ee945 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6b965ba7c340f190f9cafc69e46748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b304cd14b65640dab95dc8926eb90818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:12.642344 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-8a6367f3-3e64-4da1-a101-c0e3294ee945 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6b965ba7c340f190f9cafc69e46748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b304cd14b65640dab95dc8926eb90818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:12.643849 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-8a6367f3-3e64-4da1-a101-c0e3294ee945 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6b965ba7c340f190f9cafc69e46748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b304cd14b65640dab95dc8926eb90818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:12.645077 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-8a6367f3-3e64-4da1-a101-c0e3294ee945 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] 10.222.0.60 "GET /compute/v2.1/servers/fcc183e1-b880-4005-bb3e-90ab91ed7911" status: 200 len: 1366 microversion: 2.57 time: 0.238661 Sep 14 09:04:12.651587 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1752/3541] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:04:12 2022] GET /compute/v2.1/servers/fcc183e1-b880-4005-bb3e-90ab91ed7911 => generated 1366 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:04:12.664643 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-1495ce5c-20d4-475d-8c97-15aaaac6dd3a tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:12.665356 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-1495ce5c-20d4-475d-8c97-15aaaac6dd3a tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: d9d9afd3-aeba-4429-a474-7c70a960d4e0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:12.672574 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=5 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:04:12.674212 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1495ce5c-20d4-475d-8c97-15aaaac6dd3a tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:12.675158 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1495ce5c-20d4-475d-8c97-15aaaac6dd3a tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:12.675346 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1495ce5c-20d4-475d-8c97-15aaaac6dd3a tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:12.676115 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1495ce5c-20d4-475d-8c97-15aaaac6dd3a tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:12.676814 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1495ce5c-20d4-475d-8c97-15aaaac6dd3a tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:12.677573 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1495ce5c-20d4-475d-8c97-15aaaac6dd3a tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:12.693062 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-4337fbb6-0aeb-4543-84e5-18642297718a tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504ea33de5724b518bcdf28076d6361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd19911fb94d47ab92893a3ec449fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:12.702194 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-4337fbb6-0aeb-4543-84e5-18642297718a tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] 10.222.0.60 "GET /compute/v2.1/servers/2aefa743-500a-4cd6-b3d9-d1cf138ee1da" status: 200 len: 1320 microversion: 2.1 time: 1.390401 Sep 14 09:04:12.702795 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1790/3542] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:04:11 2022] GET /compute/v2.1/servers/2aefa743-500a-4cd6-b3d9-d1cf138ee1da => generated 1320 bytes in 1392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:04:13.094196 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-cc3ec871-9e5d-4b9b-9ad8-a8e3d0471784 tempest-SecurityGroupsNegativeTestJSON-535687066 tempest-SecurityGroupsNegativeTestJSON-535687066-project] Calling method '.version_select at 0x7f7d3f8303a0>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:13.194917 n-d-836830-18 devstack@n-api.service[128758]: DEBUG neutronclient.v2_0.client [None req-cc3ec871-9e5d-4b9b-9ad8-a8e3d0471784 tempest-SecurityGroupsNegativeTestJSON-535687066 tempest-SecurityGroupsNegativeTestJSON-535687066-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 6bf097a8-32f3-42f1-8049-c5dd2fe544c1 does not exist", "detail": ""}} {{(pid=128758) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 14 09:04:13.196348 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.network.security_group_api [None req-cc3ec871-9e5d-4b9b-9ad8-a8e3d0471784 tempest-SecurityGroupsNegativeTestJSON-535687066 tempest-SecurityGroupsNegativeTestJSON-535687066-project] Neutron security group 6bf097a8-32f3-42f1-8049-c5dd2fe544c1 not found {{(pid=128758) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 14 09:04:13.197463 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-cc3ec871-9e5d-4b9b-9ad8-a8e3d0471784 tempest-SecurityGroupsNegativeTestJSON-535687066 tempest-SecurityGroupsNegativeTestJSON-535687066-project] HTTP exception thrown: Security group 6bf097a8-32f3-42f1-8049-c5dd2fe544c1 does not exist Sep 14 09:04:13.197463 n-d-836830-18 devstack@n-api.service[128758]: Neutron server returns request_ids: ['req-7e2a1ada-3713-44a4-b53c-ba4462a87321'] Sep 14 09:04:13.200811 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-cc3ec871-9e5d-4b9b-9ad8-a8e3d0471784 tempest-SecurityGroupsNegativeTestJSON-535687066 tempest-SecurityGroupsNegativeTestJSON-535687066-project] Request method failure captured: Sep 14 09:04:13.200811 n-d-836830-18 devstack@n-api.service[128758]: request: DELETE /compute/v2.1/os-security-groups/6bf097a8-32f3-42f1-8049-c5dd2fe544c1 HTTP/1.1 Sep 14 09:04:13.200811 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 09:04:13.200811 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 09:04:13.200811 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 09:04:13.200811 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 09:04:13.200811 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 09:04:13.200811 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 09:04:13.200811 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 09:04:13.200811 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 09:04:13.200811 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZkMDdnCZg-plyi25j7fyii1vXOfXdT4ztDkp7u735pSLTvDmjEerzUU3BL-dxPDunNNLva36OSfddsyoUmxj6bnbOxq2T8JjTSIOu-p3Ke0bIg8orXAcs9jdYkupjVie0jNj3kh0vbvwUOI0-eu-911aMEXtjX3lylbnGZ8A6eSvFQ Sep 14 09:04:13.200811 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 09:04:13.200811 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 09:04:13.200811 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 09:04:13.200811 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 09:04:13.200811 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 09:04:13.200811 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 09:04:13.200811 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 0463d90a130b4462a0386b213515f8fb Sep 14 09:04:13.200811 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-535687066 Sep 14 09:04:13.200811 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 09:04:13.200811 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 09:04:13.200811 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0463d90a130b4462a0386b213515f8fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0463d90a130b4462a0386b213515f8fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0463d90a130b4462a0386b213515f8fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0463d90a130b4462a0386b213515f8fb"}]}] Sep 14 09:04:13.200811 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-535687066 Sep 14 09:04:13.200811 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 0463d90a130b4462a0386b213515f8fb Sep 14 09:04:13.200811 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-535687066 Sep 14 09:04:13.200811 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-SecurityGroupsNegativeTestJSON-535687066-project Sep 14 09:04:13.200811 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 09:04:13.200811 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 09:04:13.200811 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 68eae440b4e94c1d901152d9d5af7a7e Sep 14 09:04:13.200811 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-535687066-project Sep 14 09:04:13.200811 n-d-836830-18 devstack@n-api.service[128758]: method: Sep 14 09:04:13.200811 n-d-836830-18 devstack@n-api.service[128758]: exception: Security group 6bf097a8-32f3-42f1-8049-c5dd2fe544c1 does not exist Sep 14 09:04:13.200811 n-d-836830-18 devstack@n-api.service[128758]: Neutron server returns request_ids: ['req-7e2a1ada-3713-44a4-b53c-ba4462a87321'] Sep 14 09:04:13.200811 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': '6bf097a8-32f3-42f1-8049-c5dd2fe544c1'} Sep 14 09:04:13.200811 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:04:13.200811 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:04:13.200811 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 14 09:04:13.200811 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 14 09:04:13.200811 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:04:13.200811 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:04:13.200811 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 14 09:04:13.200811 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 14 09:04:13.200811 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:04:13.200811 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:04:13.200811 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 14 09:04:13.200811 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 14 09:04:13.200811 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:04:13.200811 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:04:13.200811 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 14 09:04:13.200811 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 14 09:04:13.200811 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:04:13.200811 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:04:13.200811 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 14 09:04:13.200811 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 14 09:04:13.200811 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:04:13.200811 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:04:13.200811 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 14 09:04:13.200811 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 14 09:04:13.200811 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 14 09:04:13.200811 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 14 09:04:13.200811 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 6bf097a8-32f3-42f1-8049-c5dd2fe544c1 does not exist Sep 14 09:04:13.207180 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7e2a1ada-3713-44a4-b53c-ba4462a87321'] Sep 14 09:04:13.207180 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:04:13.207180 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:04:13.207180 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:04:13.207180 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:04:13.207180 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 14 09:04:13.207180 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 14 09:04:13.207180 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 14 09:04:13.207180 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 14 09:04:13.207180 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 6bf097a8-32f3-42f1-8049-c5dd2fe544c1 does not exist Sep 14 09:04:13.207180 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7e2a1ada-3713-44a4-b53c-ba4462a87321'] Sep 14 09:04:13.207180 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:04:13.207180 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:04:13.207180 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:04:13.207180 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:04:13.207180 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:04:13.207180 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:04:13.207180 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:04:13.207180 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:04:13.207180 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:04:13.207180 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:04:13.207180 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:04:13.207180 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:04:13.207180 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 14 09:04:13.207180 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 14 09:04:13.207180 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 6bf097a8-32f3-42f1-8049-c5dd2fe544c1 does not exist Sep 14 09:04:13.207180 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7e2a1ada-3713-44a4-b53c-ba4462a87321'] Sep 14 09:04:13.207180 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:04:13.207180 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:04:13.207180 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:04:13.207180 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:04:13.207180 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:04:13.207180 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:04:13.207180 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:04:13.207180 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:04:13.207180 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 6bf097a8-32f3-42f1-8049-c5dd2fe544c1 does not exist Sep 14 09:04:13.207180 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7e2a1ada-3713-44a4-b53c-ba4462a87321'] Sep 14 09:04:13.207180 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:04:13.213048 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-cc3ec871-9e5d-4b9b-9ad8-a8e3d0471784 tempest-SecurityGroupsNegativeTestJSON-535687066 tempest-SecurityGroupsNegativeTestJSON-535687066-project] Returning 404 to user: Security group 6bf097a8-32f3-42f1-8049-c5dd2fe544c1 does not exist Sep 14 09:04:13.213048 n-d-836830-18 devstack@n-api.service[128758]: Neutron server returns request_ids: ['req-7e2a1ada-3713-44a4-b53c-ba4462a87321'] {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:04:13.214248 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-cc3ec871-9e5d-4b9b-9ad8-a8e3d0471784 tempest-SecurityGroupsNegativeTestJSON-535687066 tempest-SecurityGroupsNegativeTestJSON-535687066-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/6bf097a8-32f3-42f1-8049-c5dd2fe544c1" status: 404 len: 194 microversion: 2.1 time: 0.358481 Sep 14 09:04:13.215344 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1791/3543] 10.222.0.60 () {58 vars in 1272 bytes} [Wed Sep 14 09:04:12 2022] DELETE /compute/v2.1/os-security-groups/6bf097a8-32f3-42f1-8049-c5dd2fe544c1 => generated 194 bytes in 360 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 14 09:04:13.223600 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-1495ce5c-20d4-475d-8c97-15aaaac6dd3a tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:13.227106 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-da21ba4a-7a64-4f4b-9574-7a4c0bab7fdc tempest-SecurityGroupsNegativeTestJSON-535687066 tempest-SecurityGroupsNegativeTestJSON-535687066-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.006405 Sep 14 09:04:13.228225 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1792/3544] 10.222.0.60 () {58 vars in 1164 bytes} [Wed Sep 14 09:04:13 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 14 09:04:13.235056 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-1495ce5c-20d4-475d-8c97-15aaaac6dd3a tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/d9d9afd3-aeba-4429-a474-7c70a960d4e0" status: 200 len: 1494 microversion: 2.1 time: 0.581186 Sep 14 09:04:13.236129 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1753/3545] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:04:12 2022] GET /compute/v2.1/servers/d9d9afd3-aeba-4429-a474-7c70a960d4e0 => generated 1494 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:04:13.238488 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-81bf2262-63a4-49bf-8cb3-57bf2398a187 tempest-SecurityGroupsNegativeTestJSON-535687066 tempest-SecurityGroupsNegativeTestJSON-535687066-project] Calling method '.version_select at 0x7f7d44308160>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:13.263600 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-22713a14-f73d-4dfd-a5c3-16b1f1a79ff1 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:13.264526 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-22713a14-f73d-4dfd-a5c3-16b1f1a79ff1 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: d9d9afd3-aeba-4429-a474-7c70a960d4e0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:13.271281 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-22713a14-f73d-4dfd-a5c3-16b1f1a79ff1 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:13.272305 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-22713a14-f73d-4dfd-a5c3-16b1f1a79ff1 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:13.272992 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-22713a14-f73d-4dfd-a5c3-16b1f1a79ff1 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:13.274219 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-22713a14-f73d-4dfd-a5c3-16b1f1a79ff1 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:13.275001 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-22713a14-f73d-4dfd-a5c3-16b1f1a79ff1 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:13.275670 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-22713a14-f73d-4dfd-a5c3-16b1f1a79ff1 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:13.311623 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-22713a14-f73d-4dfd-a5c3-16b1f1a79ff1 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: d9d9afd3-aeba-4429-a474-7c70a960d4e0] Going to try to terminate instance {{(pid=128759) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:04:13.482867 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-22713a14-f73d-4dfd-a5c3-16b1f1a79ff1 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "DELETE /compute/v2.1/servers/d9d9afd3-aeba-4429-a474-7c70a960d4e0" status: 204 len: 0 microversion: 2.1 time: 0.223805 Sep 14 09:04:13.483516 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1754/3546] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:04:13 2022] DELETE /compute/v2.1/servers/d9d9afd3-aeba-4429-a474-7c70a960d4e0 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:04:13.490769 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ad2cdd85-382b-4b29-97f3-1ace70f6b5f2 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:13.491912 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-ad2cdd85-382b-4b29-97f3-1ace70f6b5f2 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] [instance: 900c4e61-76fe-472f-bba7-0c83895f62cf] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:13.503983 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ad2cdd85-382b-4b29-97f3-1ace70f6b5f2 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:13.504483 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ad2cdd85-382b-4b29-97f3-1ace70f6b5f2 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:13.507209 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ad2cdd85-382b-4b29-97f3-1ace70f6b5f2 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:13.510165 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ad2cdd85-382b-4b29-97f3-1ace70f6b5f2 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:13.510663 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ad2cdd85-382b-4b29-97f3-1ace70f6b5f2 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:13.511148 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ad2cdd85-382b-4b29-97f3-1ace70f6b5f2 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:13.704778 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-ad2cdd85-382b-4b29-97f3-1ace70f6b5f2 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84afbf1d30574a7aa1186a481687c50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a90781147416fa5db6b8922209058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:13.753297 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-ad2cdd85-382b-4b29-97f3-1ace70f6b5f2 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84afbf1d30574a7aa1186a481687c50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a90781147416fa5db6b8922209058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:13.755790 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-ad2cdd85-382b-4b29-97f3-1ace70f6b5f2 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84afbf1d30574a7aa1186a481687c50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a90781147416fa5db6b8922209058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:13.757445 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-ad2cdd85-382b-4b29-97f3-1ace70f6b5f2 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] 10.222.0.60 "GET /compute/v2.1/servers/900c4e61-76fe-472f-bba7-0c83895f62cf" status: 200 len: 1407 microversion: 2.54 time: 0.272388 Sep 14 09:04:13.768220 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1755/3547] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:04:13 2022] GET /compute/v2.1/servers/900c4e61-76fe-472f-bba7-0c83895f62cf => generated 1407 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:04:13.781623 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-74d58680-3bfc-47df-8c21-a0d48c7430f1 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:13.783912 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-74d58680-3bfc-47df-8c21-a0d48c7430f1 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: d9d9afd3-aeba-4429-a474-7c70a960d4e0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:13.796169 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-74d58680-3bfc-47df-8c21-a0d48c7430f1 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:13.797567 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-74d58680-3bfc-47df-8c21-a0d48c7430f1 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:13.798682 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-74d58680-3bfc-47df-8c21-a0d48c7430f1 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:13.805277 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-74d58680-3bfc-47df-8c21-a0d48c7430f1 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:13.807269 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-74d58680-3bfc-47df-8c21-a0d48c7430f1 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:13.808016 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-74d58680-3bfc-47df-8c21-a0d48c7430f1 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:13.975274 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-81bf2262-63a4-49bf-8cb3-57bf2398a187 tempest-SecurityGroupsNegativeTestJSON-535687066 tempest-SecurityGroupsNegativeTestJSON-535687066-project] 10.222.0.60 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.741045 Sep 14 09:04:13.977676 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1793/3548] 10.222.0.60 () {58 vars in 1158 bytes} [Wed Sep 14 09:04:13 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:04:13.983856 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-80042d1f-6e14-46f2-8e00-550466da3aac tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:13.984744 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-80042d1f-6e14-46f2-8e00-550466da3aac tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] [instance: fcc183e1-b880-4005-bb3e-90ab91ed7911] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:13.999014 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-80042d1f-6e14-46f2-8e00-550466da3aac tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:14.003254 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-80042d1f-6e14-46f2-8e00-550466da3aac tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:14.003885 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-80042d1f-6e14-46f2-8e00-550466da3aac tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:14.005820 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-80042d1f-6e14-46f2-8e00-550466da3aac tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:14.006304 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-80042d1f-6e14-46f2-8e00-550466da3aac tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:14.006749 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-80042d1f-6e14-46f2-8e00-550466da3aac tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:14.224552 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-80042d1f-6e14-46f2-8e00-550466da3aac tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6b965ba7c340f190f9cafc69e46748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b304cd14b65640dab95dc8926eb90818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:14.234664 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-74d58680-3bfc-47df-8c21-a0d48c7430f1 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:14.237654 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-80042d1f-6e14-46f2-8e00-550466da3aac tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6b965ba7c340f190f9cafc69e46748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b304cd14b65640dab95dc8926eb90818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:14.239374 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-80042d1f-6e14-46f2-8e00-550466da3aac tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6b965ba7c340f190f9cafc69e46748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b304cd14b65640dab95dc8926eb90818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:14.241883 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-80042d1f-6e14-46f2-8e00-550466da3aac tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] 10.222.0.60 "GET /compute/v2.1/servers/fcc183e1-b880-4005-bb3e-90ab91ed7911" status: 200 len: 1366 microversion: 2.57 time: 0.262792 Sep 14 09:04:14.244950 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1794/3549] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:04:13 2022] GET /compute/v2.1/servers/fcc183e1-b880-4005-bb3e-90ab91ed7911 => generated 1366 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:04:14.247902 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-74d58680-3bfc-47df-8c21-a0d48c7430f1 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/d9d9afd3-aeba-4429-a474-7c70a960d4e0" status: 200 len: 1500 microversion: 2.1 time: 0.477253 Sep 14 09:04:14.250854 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1756/3550] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:04:13 2022] GET /compute/v2.1/servers/d9d9afd3-aeba-4429-a474-7c70a960d4e0 => generated 1500 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:04:14.257019 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-de3ef832-d144-4394-8107-5776c1daf9ca tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:14.257846 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-de3ef832-d144-4394-8107-5776c1daf9ca tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] [instance: 2aefa743-500a-4cd6-b3d9-d1cf138ee1da] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:14.263346 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-06d6a5e3-97d5-4432-b6b8-7285fb376506 req-c656d530-9b0a-4d5e-ae33-f2670ccd544b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d98ba025-ba7a-40fa-8fd2-44eeef653b6a", "name": "network-vif-plugged", "status": "completed", "tag": "3a5171fd-1fb3-45a5-96ab-d18a838c87da"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:04:14.280344 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-de3ef832-d144-4394-8107-5776c1daf9ca tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:14.281086 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-de3ef832-d144-4394-8107-5776c1daf9ca tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:14.281727 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-de3ef832-d144-4394-8107-5776c1daf9ca tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:14.282622 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-de3ef832-d144-4394-8107-5776c1daf9ca tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:14.283360 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-de3ef832-d144-4394-8107-5776c1daf9ca tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:14.285719 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-06d6a5e3-97d5-4432-b6b8-7285fb376506 req-c656d530-9b0a-4d5e-ae33-f2670ccd544b service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:14.286464 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-06d6a5e3-97d5-4432-b6b8-7285fb376506 req-c656d530-9b0a-4d5e-ae33-f2670ccd544b service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:14.287131 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-06d6a5e3-97d5-4432-b6b8-7285fb376506 req-c656d530-9b0a-4d5e-ae33-f2670ccd544b service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:14.293919 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-de3ef832-d144-4394-8107-5776c1daf9ca tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:14.310510 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-06d6a5e3-97d5-4432-b6b8-7285fb376506 req-c656d530-9b0a-4d5e-ae33-f2670ccd544b service nova] Creating event network-vif-plugged:3a5171fd-1fb3-45a5-96ab-d18a838c87da for instance d98ba025-ba7a-40fa-8fd2-44eeef653b6a on n-h2-836830-18 Sep 14 09:04:14.321293 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-06d6a5e3-97d5-4432-b6b8-7285fb376506 req-c656d530-9b0a-4d5e-ae33-f2670ccd544b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068977 Sep 14 09:04:14.321945 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1757/3551] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:04:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:04:14.337874 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-36d99f40-4837-4059-932d-0a6b19e8fc7b tempest-SecurityGroupsNegativeTestJSON-535687066 tempest-SecurityGroupsNegativeTestJSON-535687066-project] Calling method '.version_select at 0x7f7d3f179040>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:14.726077 n-d-836830-18 devstack@n-api.service[128759]: DEBUG neutronclient.v2_0.client [None req-36d99f40-4837-4059-932d-0a6b19e8fc7b tempest-SecurityGroupsNegativeTestJSON-535687066 tempest-SecurityGroupsNegativeTestJSON-535687066-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=128759) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 14 09:04:14.726912 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-36d99f40-4837-4059-932d-0a6b19e8fc7b tempest-SecurityGroupsNegativeTestJSON-535687066 tempest-SecurityGroupsNegativeTestJSON-535687066-project] HTTP exception thrown: Insufficient rights for removing default security group. Sep 14 09:04:14.726912 n-d-836830-18 devstack@n-api.service[128759]: Neutron server returns request_ids: ['req-012aa412-01f0-4710-8491-58bb97635861'] Sep 14 09:04:14.730931 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-36d99f40-4837-4059-932d-0a6b19e8fc7b tempest-SecurityGroupsNegativeTestJSON-535687066 tempest-SecurityGroupsNegativeTestJSON-535687066-project] Request method failure captured: Sep 14 09:04:14.730931 n-d-836830-18 devstack@n-api.service[128759]: request: DELETE /compute/v2.1/os-security-groups/9adb16e6-d485-4609-a34f-0116c22e53e3 HTTP/1.1 Sep 14 09:04:14.730931 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:04:14.730931 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:04:14.730931 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:04:14.730931 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:04:14.730931 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:04:14.730931 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:04:14.730931 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:04:14.730931 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:04:14.730931 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZkMDdnCZg-plyi25j7fyii1vXOfXdT4ztDkp7u735pSLTvDmjEerzUU3BL-dxPDunNNLva36OSfddsyoUmxj6bnbOxq2T8JjTSIOu-p3Ke0bIg8orXAcs9jdYkupjVie0jNj3kh0vbvwUOI0-eu-911aMEXtjX3lylbnGZ8A6eSvFQ Sep 14 09:04:14.730931 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:04:14.730931 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:04:14.730931 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:04:14.730931 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:04:14.730931 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:04:14.730931 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:04:14.730931 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 0463d90a130b4462a0386b213515f8fb Sep 14 09:04:14.730931 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-535687066 Sep 14 09:04:14.730931 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:04:14.730931 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:04:14.730931 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0463d90a130b4462a0386b213515f8fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0463d90a130b4462a0386b213515f8fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0463d90a130b4462a0386b213515f8fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0463d90a130b4462a0386b213515f8fb"}]}] Sep 14 09:04:14.730931 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-535687066 Sep 14 09:04:14.730931 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 0463d90a130b4462a0386b213515f8fb Sep 14 09:04:14.730931 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-535687066 Sep 14 09:04:14.730931 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-SecurityGroupsNegativeTestJSON-535687066-project Sep 14 09:04:14.730931 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:04:14.730931 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:04:14.730931 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 68eae440b4e94c1d901152d9d5af7a7e Sep 14 09:04:14.730931 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-535687066-project Sep 14 09:04:14.730931 n-d-836830-18 devstack@n-api.service[128759]: method: Sep 14 09:04:14.730931 n-d-836830-18 devstack@n-api.service[128759]: exception: Insufficient rights for removing default security group. Sep 14 09:04:14.730931 n-d-836830-18 devstack@n-api.service[128759]: Neutron server returns request_ids: ['req-012aa412-01f0-4710-8491-58bb97635861'] Sep 14 09:04:14.730931 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '9adb16e6-d485-4609-a34f-0116c22e53e3'} Sep 14 09:04:14.730931 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:04:14.730931 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:04:14.730931 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Sep 14 09:04:14.730931 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Sep 14 09:04:14.730931 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:04:14.730931 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:04:14.730931 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Sep 14 09:04:14.730931 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Sep 14 09:04:14.730931 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:04:14.730931 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:04:14.730931 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Sep 14 09:04:14.730931 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Sep 14 09:04:14.730931 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:04:14.730931 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:04:14.730931 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 14 09:04:14.730931 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 14 09:04:14.730931 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:04:14.730931 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:04:14.730931 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 14 09:04:14.730931 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 14 09:04:14.730931 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:04:14.730931 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:04:14.730931 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 14 09:04:14.730931 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 14 09:04:14.730931 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 14 09:04:14.730931 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 14 09:04:14.730931 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Sep 14 09:04:14.736687 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-012aa412-01f0-4710-8491-58bb97635861'] Sep 14 09:04:14.736687 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:04:14.736687 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:04:14.736687 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:04:14.736687 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:04:14.736687 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Sep 14 09:04:14.736687 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Sep 14 09:04:14.736687 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Sep 14 09:04:14.736687 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Sep 14 09:04:14.736687 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Sep 14 09:04:14.736687 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-012aa412-01f0-4710-8491-58bb97635861'] Sep 14 09:04:14.736687 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:04:14.736687 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:04:14.736687 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:04:14.736687 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:04:14.736687 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:04:14.736687 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:04:14.736687 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:04:14.736687 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:04:14.736687 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:04:14.736687 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:04:14.736687 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:04:14.736687 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:04:14.736687 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Sep 14 09:04:14.736687 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 14 09:04:14.736687 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Sep 14 09:04:14.736687 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-012aa412-01f0-4710-8491-58bb97635861'] Sep 14 09:04:14.736687 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:04:14.736687 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:04:14.736687 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:04:14.736687 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:04:14.736687 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:04:14.736687 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:04:14.736687 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:04:14.736687 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:04:14.736687 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Sep 14 09:04:14.736687 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-012aa412-01f0-4710-8491-58bb97635861'] Sep 14 09:04:14.736687 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:04:14.736687 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-36d99f40-4837-4059-932d-0a6b19e8fc7b tempest-SecurityGroupsNegativeTestJSON-535687066 tempest-SecurityGroupsNegativeTestJSON-535687066-project] Returning 400 to user: Insufficient rights for removing default security group. Sep 14 09:04:14.736687 n-d-836830-18 devstack@n-api.service[128759]: Neutron server returns request_ids: ['req-012aa412-01f0-4710-8491-58bb97635861'] {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:04:14.743146 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-36d99f40-4837-4059-932d-0a6b19e8fc7b tempest-SecurityGroupsNegativeTestJSON-535687066 tempest-SecurityGroupsNegativeTestJSON-535687066-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/9adb16e6-d485-4609-a34f-0116c22e53e3" status: 400 len: 182 microversion: 2.1 time: 0.412204 Sep 14 09:04:14.748313 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1758/3552] 10.222.0.60 () {58 vars in 1272 bytes} [Wed Sep 14 09:04:14 2022] DELETE /compute/v2.1/os-security-groups/9adb16e6-d485-4609-a34f-0116c22e53e3 => generated 182 bytes in 424 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 14 09:04:14.760390 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-7229672c-4ffd-4627-9b41-cd7a0b701cbb tempest-SecurityGroupsNegativeTestJSON-535687066 tempest-SecurityGroupsNegativeTestJSON-535687066-project] Calling method '.version_select at 0x7f7d3fce4c10>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:14.803081 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-de3ef832-d144-4394-8107-5776c1daf9ca tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504ea33de5724b518bcdf28076d6361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd19911fb94d47ab92893a3ec449fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:14.828062 n-d-836830-18 devstack@n-api.service[128759]: DEBUG neutronclient.v2_0.client [None req-7229672c-4ffd-4627-9b41-cd7a0b701cbb tempest-SecurityGroupsNegativeTestJSON-535687066 tempest-SecurityGroupsNegativeTestJSON-535687066-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 861b8ad8-485d-4efa-82f1-95233aa6e596 does not exist", "detail": ""}} {{(pid=128759) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 14 09:04:14.829462 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.network.security_group_api [None req-7229672c-4ffd-4627-9b41-cd7a0b701cbb tempest-SecurityGroupsNegativeTestJSON-535687066 tempest-SecurityGroupsNegativeTestJSON-535687066-project] Neutron security group 861b8ad8-485d-4efa-82f1-95233aa6e596 not found {{(pid=128759) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 14 09:04:14.830584 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-7229672c-4ffd-4627-9b41-cd7a0b701cbb tempest-SecurityGroupsNegativeTestJSON-535687066 tempest-SecurityGroupsNegativeTestJSON-535687066-project] HTTP exception thrown: Security group 861b8ad8-485d-4efa-82f1-95233aa6e596 does not exist Sep 14 09:04:14.830584 n-d-836830-18 devstack@n-api.service[128759]: Neutron server returns request_ids: ['req-7ddedf7a-3732-440f-82b7-47975ffe51f2'] Sep 14 09:04:14.834282 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-7229672c-4ffd-4627-9b41-cd7a0b701cbb tempest-SecurityGroupsNegativeTestJSON-535687066 tempest-SecurityGroupsNegativeTestJSON-535687066-project] Request method failure captured: Sep 14 09:04:14.834282 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/os-security-groups/861b8ad8-485d-4efa-82f1-95233aa6e596 HTTP/1.1 Sep 14 09:04:14.834282 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:04:14.834282 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:04:14.834282 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:04:14.834282 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:04:14.834282 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:04:14.834282 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:04:14.834282 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:04:14.834282 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:04:14.834282 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZkMDdnCZg-plyi25j7fyii1vXOfXdT4ztDkp7u735pSLTvDmjEerzUU3BL-dxPDunNNLva36OSfddsyoUmxj6bnbOxq2T8JjTSIOu-p3Ke0bIg8orXAcs9jdYkupjVie0jNj3kh0vbvwUOI0-eu-911aMEXtjX3lylbnGZ8A6eSvFQ Sep 14 09:04:14.834282 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:04:14.834282 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:04:14.834282 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:04:14.834282 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:04:14.834282 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:04:14.834282 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:04:14.834282 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 0463d90a130b4462a0386b213515f8fb Sep 14 09:04:14.834282 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-535687066 Sep 14 09:04:14.834282 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:04:14.834282 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:04:14.834282 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0463d90a130b4462a0386b213515f8fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0463d90a130b4462a0386b213515f8fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0463d90a130b4462a0386b213515f8fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0463d90a130b4462a0386b213515f8fb"}]}] Sep 14 09:04:14.834282 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-535687066 Sep 14 09:04:14.834282 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 0463d90a130b4462a0386b213515f8fb Sep 14 09:04:14.834282 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-535687066 Sep 14 09:04:14.834282 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-SecurityGroupsNegativeTestJSON-535687066-project Sep 14 09:04:14.834282 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:04:14.834282 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:04:14.834282 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 68eae440b4e94c1d901152d9d5af7a7e Sep 14 09:04:14.834282 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-535687066-project Sep 14 09:04:14.834282 n-d-836830-18 devstack@n-api.service[128759]: method: Sep 14 09:04:14.834282 n-d-836830-18 devstack@n-api.service[128759]: exception: Security group 861b8ad8-485d-4efa-82f1-95233aa6e596 does not exist Sep 14 09:04:14.834282 n-d-836830-18 devstack@n-api.service[128759]: Neutron server returns request_ids: ['req-7ddedf7a-3732-440f-82b7-47975ffe51f2'] Sep 14 09:04:14.834282 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '861b8ad8-485d-4efa-82f1-95233aa6e596'} Sep 14 09:04:14.834282 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:04:14.834282 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:04:14.834282 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 14 09:04:14.834282 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 14 09:04:14.834282 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:04:14.834282 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:04:14.834282 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 14 09:04:14.834282 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 14 09:04:14.834282 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:04:14.834282 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:04:14.834282 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 14 09:04:14.834282 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 14 09:04:14.834282 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:04:14.834282 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:04:14.834282 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 14 09:04:14.834282 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 14 09:04:14.834282 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:04:14.834282 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:04:14.834282 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 14 09:04:14.834282 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 14 09:04:14.834282 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:04:14.834282 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:04:14.834282 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 14 09:04:14.834282 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 14 09:04:14.834282 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 14 09:04:14.834282 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 14 09:04:14.834282 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 861b8ad8-485d-4efa-82f1-95233aa6e596 does not exist Sep 14 09:04:14.840384 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7ddedf7a-3732-440f-82b7-47975ffe51f2'] Sep 14 09:04:14.840384 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:04:14.840384 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:04:14.840384 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:04:14.840384 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:04:14.840384 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Sep 14 09:04:14.840384 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 14 09:04:14.840384 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 14 09:04:14.840384 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 14 09:04:14.840384 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 861b8ad8-485d-4efa-82f1-95233aa6e596 does not exist Sep 14 09:04:14.840384 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7ddedf7a-3732-440f-82b7-47975ffe51f2'] Sep 14 09:04:14.840384 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:04:14.840384 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:04:14.840384 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:04:14.840384 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:04:14.840384 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:04:14.840384 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:04:14.840384 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:04:14.840384 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:04:14.840384 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:04:14.840384 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:04:14.840384 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:04:14.840384 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:04:14.840384 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Sep 14 09:04:14.840384 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 14 09:04:14.840384 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 861b8ad8-485d-4efa-82f1-95233aa6e596 does not exist Sep 14 09:04:14.840384 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7ddedf7a-3732-440f-82b7-47975ffe51f2'] Sep 14 09:04:14.840384 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:04:14.840384 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:04:14.840384 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:04:14.840384 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:04:14.840384 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:04:14.840384 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:04:14.840384 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:04:14.840384 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:04:14.840384 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 861b8ad8-485d-4efa-82f1-95233aa6e596 does not exist Sep 14 09:04:14.840384 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7ddedf7a-3732-440f-82b7-47975ffe51f2'] Sep 14 09:04:14.840384 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:04:14.851248 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-7229672c-4ffd-4627-9b41-cd7a0b701cbb tempest-SecurityGroupsNegativeTestJSON-535687066 tempest-SecurityGroupsNegativeTestJSON-535687066-project] Returning 404 to user: Security group 861b8ad8-485d-4efa-82f1-95233aa6e596 does not exist Sep 14 09:04:14.851248 n-d-836830-18 devstack@n-api.service[128759]: Neutron server returns request_ids: ['req-7ddedf7a-3732-440f-82b7-47975ffe51f2'] {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:04:14.851248 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-7229672c-4ffd-4627-9b41-cd7a0b701cbb tempest-SecurityGroupsNegativeTestJSON-535687066 tempest-SecurityGroupsNegativeTestJSON-535687066-project] 10.222.0.60 "GET /compute/v2.1/os-security-groups/861b8ad8-485d-4efa-82f1-95233aa6e596" status: 404 len: 194 microversion: 2.1 time: 0.095475 Sep 14 09:04:14.851248 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1759/3553] 10.222.0.60 () {58 vars in 1269 bytes} [Wed Sep 14 09:04:14 2022] GET /compute/v2.1/os-security-groups/861b8ad8-485d-4efa-82f1-95233aa6e596 => generated 194 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:04:14.856108 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e386c935-0129-4995-97cb-ea5af6122bc1 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:14.856513 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-de3ef832-d144-4394-8107-5776c1daf9ca tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] 10.222.0.60 "GET /compute/v2.1/servers/2aefa743-500a-4cd6-b3d9-d1cf138ee1da" status: 200 len: 1320 microversion: 2.1 time: 0.609577 Sep 14 09:04:14.858788 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e386c935-0129-4995-97cb-ea5af6122bc1 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] [instance: 900c4e61-76fe-472f-bba7-0c83895f62cf] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:14.862767 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1795/3554] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:04:14 2022] GET /compute/v2.1/servers/2aefa743-500a-4cd6-b3d9-d1cf138ee1da => generated 1320 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:04:14.872802 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e386c935-0129-4995-97cb-ea5af6122bc1 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:14.873317 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e386c935-0129-4995-97cb-ea5af6122bc1 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:14.873769 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e386c935-0129-4995-97cb-ea5af6122bc1 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:14.875927 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-debf2155-1c51-4d0d-8f08-34ade6bb42cd tempest-SecurityGroupsNegativeTestJSON-535687066 tempest-SecurityGroupsNegativeTestJSON-535687066-project] Action: 'update', calling method: .version_select at 0x7f7d3f58e820>, body: {"security_group": {"name": "tempest-sg-474921481", "description": "tempest-description-28327493"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:04:14.880858 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e386c935-0129-4995-97cb-ea5af6122bc1 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:14.881358 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e386c935-0129-4995-97cb-ea5af6122bc1 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:14.882207 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e386c935-0129-4995-97cb-ea5af6122bc1 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:15.105693 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-e386c935-0129-4995-97cb-ea5af6122bc1 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84afbf1d30574a7aa1186a481687c50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a90781147416fa5db6b8922209058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:15.116752 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-e386c935-0129-4995-97cb-ea5af6122bc1 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84afbf1d30574a7aa1186a481687c50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a90781147416fa5db6b8922209058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:15.118240 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-e386c935-0129-4995-97cb-ea5af6122bc1 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84afbf1d30574a7aa1186a481687c50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a90781147416fa5db6b8922209058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:15.125072 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e386c935-0129-4995-97cb-ea5af6122bc1 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] 10.222.0.60 "GET /compute/v2.1/servers/900c4e61-76fe-472f-bba7-0c83895f62cf" status: 200 len: 1407 microversion: 2.54 time: 0.278561 Sep 14 09:04:15.125674 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1760/3555] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:04:14 2022] GET /compute/v2.1/servers/900c4e61-76fe-472f-bba7-0c83895f62cf => generated 1407 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:04:15.131836 n-d-836830-18 devstack@n-api.service[128758]: DEBUG neutronclient.v2_0.client [None req-debf2155-1c51-4d0d-8f08-34ade6bb42cd tempest-SecurityGroupsNegativeTestJSON-535687066 tempest-SecurityGroupsNegativeTestJSON-535687066-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group ec72c348-279c-4d3e-8f15-f3e024d481db does not exist", "detail": ""}} {{(pid=128758) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 14 09:04:15.133111 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.network.security_group_api [None req-debf2155-1c51-4d0d-8f08-34ade6bb42cd tempest-SecurityGroupsNegativeTestJSON-535687066 tempest-SecurityGroupsNegativeTestJSON-535687066-project] Neutron security group ec72c348-279c-4d3e-8f15-f3e024d481db not found {{(pid=128758) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 14 09:04:15.133893 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-debf2155-1c51-4d0d-8f08-34ade6bb42cd tempest-SecurityGroupsNegativeTestJSON-535687066 tempest-SecurityGroupsNegativeTestJSON-535687066-project] HTTP exception thrown: Security group ec72c348-279c-4d3e-8f15-f3e024d481db does not exist Sep 14 09:04:15.133893 n-d-836830-18 devstack@n-api.service[128758]: Neutron server returns request_ids: ['req-2a37a5a0-a0b2-41e9-a6a4-aac238676f36'] Sep 14 09:04:15.136210 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-debf2155-1c51-4d0d-8f08-34ade6bb42cd tempest-SecurityGroupsNegativeTestJSON-535687066 tempest-SecurityGroupsNegativeTestJSON-535687066-project] Request method failure captured: Sep 14 09:04:15.136210 n-d-836830-18 devstack@n-api.service[128758]: request: PUT /compute/v2.1/os-security-groups/ec72c348-279c-4d3e-8f15-f3e024d481db HTTP/1.1 Sep 14 09:04:15.136210 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 09:04:15.136210 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 09:04:15.136210 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 09:04:15.136210 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 99 Sep 14 09:04:15.136210 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 09:04:15.136210 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 09:04:15.136210 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 09:04:15.136210 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 09:04:15.136210 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZkMDdnCZg-plyi25j7fyii1vXOfXdT4ztDkp7u735pSLTvDmjEerzUU3BL-dxPDunNNLva36OSfddsyoUmxj6bnbOxq2T8JjTSIOu-p3Ke0bIg8orXAcs9jdYkupjVie0jNj3kh0vbvwUOI0-eu-911aMEXtjX3lylbnGZ8A6eSvFQ Sep 14 09:04:15.136210 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 09:04:15.136210 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 09:04:15.136210 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 09:04:15.136210 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 09:04:15.136210 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 09:04:15.136210 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 09:04:15.136210 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 0463d90a130b4462a0386b213515f8fb Sep 14 09:04:15.136210 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-535687066 Sep 14 09:04:15.136210 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 09:04:15.136210 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 09:04:15.136210 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0463d90a130b4462a0386b213515f8fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0463d90a130b4462a0386b213515f8fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0463d90a130b4462a0386b213515f8fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0463d90a130b4462a0386b213515f8fb"}]}] Sep 14 09:04:15.136210 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-535687066 Sep 14 09:04:15.136210 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 0463d90a130b4462a0386b213515f8fb Sep 14 09:04:15.136210 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-535687066 Sep 14 09:04:15.136210 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-SecurityGroupsNegativeTestJSON-535687066-project Sep 14 09:04:15.136210 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 09:04:15.136210 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 09:04:15.136210 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 68eae440b4e94c1d901152d9d5af7a7e Sep 14 09:04:15.136210 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-535687066-project Sep 14 09:04:15.136210 n-d-836830-18 devstack@n-api.service[128758]: Sep 14 09:04:15.136210 n-d-836830-18 devstack@n-api.service[128758]: {"security_group": {"name": "tempest-sg-474921481", "description": "tempest-description-28327493"}} Sep 14 09:04:15.136210 n-d-836830-18 devstack@n-api.service[128758]: method: Sep 14 09:04:15.136210 n-d-836830-18 devstack@n-api.service[128758]: exception: Security group ec72c348-279c-4d3e-8f15-f3e024d481db does not exist Sep 14 09:04:15.136210 n-d-836830-18 devstack@n-api.service[128758]: Neutron server returns request_ids: ['req-2a37a5a0-a0b2-41e9-a6a4-aac238676f36'] Sep 14 09:04:15.136210 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': 'ec72c348-279c-4d3e-8f15-f3e024d481db', 'body': {'security_group': {'name': 'tempest-sg-474921481', 'description': 'tempest-description-28327493'}}} Sep 14 09:04:15.136210 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:04:15.136210 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:04:15.136210 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 14 09:04:15.136210 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 14 09:04:15.136210 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:04:15.136210 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:04:15.136210 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 14 09:04:15.136210 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 14 09:04:15.136210 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:04:15.136210 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:04:15.136210 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 14 09:04:15.136210 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 14 09:04:15.136210 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:04:15.136210 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:04:15.136210 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 14 09:04:15.136210 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 14 09:04:15.136210 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:04:15.136210 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:04:15.136210 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 14 09:04:15.136210 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 14 09:04:15.136210 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:04:15.136210 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:04:15.136210 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 14 09:04:15.136210 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 14 09:04:15.136210 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 14 09:04:15.140515 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 14 09:04:15.140515 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group ec72c348-279c-4d3e-8f15-f3e024d481db does not exist Sep 14 09:04:15.140515 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2a37a5a0-a0b2-41e9-a6a4-aac238676f36'] Sep 14 09:04:15.140515 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:04:15.140515 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:04:15.140515 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:04:15.140515 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:04:15.140515 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Sep 14 09:04:15.140515 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 14 09:04:15.140515 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 14 09:04:15.140515 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 14 09:04:15.140515 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group ec72c348-279c-4d3e-8f15-f3e024d481db does not exist Sep 14 09:04:15.140515 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2a37a5a0-a0b2-41e9-a6a4-aac238676f36'] Sep 14 09:04:15.140515 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:04:15.140515 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:04:15.140515 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:04:15.140515 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:04:15.140515 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:04:15.140515 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:04:15.140515 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:04:15.140515 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:04:15.140515 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:04:15.140515 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:04:15.140515 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:04:15.140515 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:04:15.140515 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Sep 14 09:04:15.140515 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 14 09:04:15.140515 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group ec72c348-279c-4d3e-8f15-f3e024d481db does not exist Sep 14 09:04:15.140515 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2a37a5a0-a0b2-41e9-a6a4-aac238676f36'] Sep 14 09:04:15.140515 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:04:15.140515 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:04:15.140515 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:04:15.140515 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:04:15.140515 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:04:15.140515 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:04:15.140515 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:04:15.140515 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:04:15.140515 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group ec72c348-279c-4d3e-8f15-f3e024d481db does not exist Sep 14 09:04:15.140515 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2a37a5a0-a0b2-41e9-a6a4-aac238676f36'] Sep 14 09:04:15.140515 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:04:15.152757 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-debf2155-1c51-4d0d-8f08-34ade6bb42cd tempest-SecurityGroupsNegativeTestJSON-535687066 tempest-SecurityGroupsNegativeTestJSON-535687066-project] Returning 404 to user: Security group ec72c348-279c-4d3e-8f15-f3e024d481db does not exist Sep 14 09:04:15.152757 n-d-836830-18 devstack@n-api.service[128758]: Neutron server returns request_ids: ['req-2a37a5a0-a0b2-41e9-a6a4-aac238676f36'] {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:04:15.154380 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-debf2155-1c51-4d0d-8f08-34ade6bb42cd tempest-SecurityGroupsNegativeTestJSON-535687066 tempest-SecurityGroupsNegativeTestJSON-535687066-project] 10.222.0.60 "PUT /compute/v2.1/os-security-groups/ec72c348-279c-4d3e-8f15-f3e024d481db" status: 404 len: 194 microversion: 2.1 time: 0.290345 Sep 14 09:04:15.155445 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1796/3556] 10.222.0.60 () {60 vars in 1289 bytes} [Wed Sep 14 09:04:14 2022] PUT /compute/v2.1/os-security-groups/ec72c348-279c-4d3e-8f15-f3e024d481db => generated 194 bytes in 292 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:04:15.271949 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-1ae77cb5-ae5d-40b6-8663-7ae2c619b91c tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:15.272587 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-1ae77cb5-ae5d-40b6-8663-7ae2c619b91c tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] [instance: fcc183e1-b880-4005-bb3e-90ab91ed7911] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:15.278297 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-8cae7010-f938-42f5-a6d8-043de623142c tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:15.283444 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-8cae7010-f938-42f5-a6d8-043de623142c tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: d9d9afd3-aeba-4429-a474-7c70a960d4e0] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:15.295571 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1ae77cb5-ae5d-40b6-8663-7ae2c619b91c tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:15.296081 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1ae77cb5-ae5d-40b6-8663-7ae2c619b91c tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:15.296525 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1ae77cb5-ae5d-40b6-8663-7ae2c619b91c tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:15.297251 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1ae77cb5-ae5d-40b6-8663-7ae2c619b91c tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:15.297717 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1ae77cb5-ae5d-40b6-8663-7ae2c619b91c tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:15.298145 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1ae77cb5-ae5d-40b6-8663-7ae2c619b91c tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:15.305426 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8cae7010-f938-42f5-a6d8-043de623142c tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:15.305946 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8cae7010-f938-42f5-a6d8-043de623142c tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:15.306435 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8cae7010-f938-42f5-a6d8-043de623142c tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:15.307331 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8cae7010-f938-42f5-a6d8-043de623142c tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:15.307990 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8cae7010-f938-42f5-a6d8-043de623142c tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:15.314575 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8cae7010-f938-42f5-a6d8-043de623142c tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:15.562111 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-1ae77cb5-ae5d-40b6-8663-7ae2c619b91c tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6b965ba7c340f190f9cafc69e46748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b304cd14b65640dab95dc8926eb90818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:15.576877 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-1ae77cb5-ae5d-40b6-8663-7ae2c619b91c tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6b965ba7c340f190f9cafc69e46748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b304cd14b65640dab95dc8926eb90818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:15.581380 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-1ae77cb5-ae5d-40b6-8663-7ae2c619b91c tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6b965ba7c340f190f9cafc69e46748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b304cd14b65640dab95dc8926eb90818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:15.585573 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-1ae77cb5-ae5d-40b6-8663-7ae2c619b91c tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] 10.222.0.60 "GET /compute/v2.1/servers/fcc183e1-b880-4005-bb3e-90ab91ed7911" status: 200 len: 1366 microversion: 2.57 time: 0.317681 Sep 14 09:04:15.585573 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1761/3557] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:04:15 2022] GET /compute/v2.1/servers/fcc183e1-b880-4005-bb3e-90ab91ed7911 => generated 1366 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:04:15.886266 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b0003ff7-f9ab-42d7-96d6-3bb5c2dd3a4e tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:15.886988 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b0003ff7-f9ab-42d7-96d6-3bb5c2dd3a4e tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] [instance: 2aefa743-500a-4cd6-b3d9-d1cf138ee1da] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:15.902186 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b0003ff7-f9ab-42d7-96d6-3bb5c2dd3a4e tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:15.903982 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b0003ff7-f9ab-42d7-96d6-3bb5c2dd3a4e tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:15.905633 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b0003ff7-f9ab-42d7-96d6-3bb5c2dd3a4e tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:15.906773 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b0003ff7-f9ab-42d7-96d6-3bb5c2dd3a4e tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:15.910087 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b0003ff7-f9ab-42d7-96d6-3bb5c2dd3a4e tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:15.910931 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b0003ff7-f9ab-42d7-96d6-3bb5c2dd3a4e tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:15.982379 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-8cae7010-f938-42f5-a6d8-043de623142c tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:16.011736 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-8cae7010-f938-42f5-a6d8-043de623142c tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/d9d9afd3-aeba-4429-a474-7c70a960d4e0" status: 200 len: 1500 microversion: 2.1 time: 0.737775 Sep 14 09:04:16.017566 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1797/3558] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:04:15 2022] GET /compute/v2.1/servers/d9d9afd3-aeba-4429-a474-7c70a960d4e0 => generated 1500 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:04:16.156001 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-e7c63b53-25ea-4b67-80e4-5f5d61c41f36 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:16.156687 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-e7c63b53-25ea-4b67-80e4-5f5d61c41f36 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] [instance: 900c4e61-76fe-472f-bba7-0c83895f62cf] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:16.177489 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e7c63b53-25ea-4b67-80e4-5f5d61c41f36 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:16.178011 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e7c63b53-25ea-4b67-80e4-5f5d61c41f36 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:16.178467 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e7c63b53-25ea-4b67-80e4-5f5d61c41f36 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:16.179247 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e7c63b53-25ea-4b67-80e4-5f5d61c41f36 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:16.179840 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e7c63b53-25ea-4b67-80e4-5f5d61c41f36 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:16.180272 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e7c63b53-25ea-4b67-80e4-5f5d61c41f36 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:16.735639 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-e7c63b53-25ea-4b67-80e4-5f5d61c41f36 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84afbf1d30574a7aa1186a481687c50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a90781147416fa5db6b8922209058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:16.747003 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-e7c63b53-25ea-4b67-80e4-5f5d61c41f36 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84afbf1d30574a7aa1186a481687c50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a90781147416fa5db6b8922209058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:16.748951 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-e7c63b53-25ea-4b67-80e4-5f5d61c41f36 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84afbf1d30574a7aa1186a481687c50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a90781147416fa5db6b8922209058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:16.752588 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-e7c63b53-25ea-4b67-80e4-5f5d61c41f36 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] 10.222.0.60 "GET /compute/v2.1/servers/900c4e61-76fe-472f-bba7-0c83895f62cf" status: 200 len: 1413 microversion: 2.54 time: 0.600505 Sep 14 09:04:16.755417 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1798/3559] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:04:16 2022] GET /compute/v2.1/servers/900c4e61-76fe-472f-bba7-0c83895f62cf => generated 1413 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 09:04:16.762825 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a68d28f4-976f-4168-8e25-b9afbc9a759f tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:16.763798 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-a68d28f4-976f-4168-8e25-b9afbc9a759f tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] [instance: fcc183e1-b880-4005-bb3e-90ab91ed7911] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:16.774621 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a68d28f4-976f-4168-8e25-b9afbc9a759f tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:16.775507 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a68d28f4-976f-4168-8e25-b9afbc9a759f tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:16.776997 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a68d28f4-976f-4168-8e25-b9afbc9a759f tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:16.777966 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a68d28f4-976f-4168-8e25-b9afbc9a759f tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:16.779207 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a68d28f4-976f-4168-8e25-b9afbc9a759f tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:16.779955 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a68d28f4-976f-4168-8e25-b9afbc9a759f tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:16.907062 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-a68d28f4-976f-4168-8e25-b9afbc9a759f tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6b965ba7c340f190f9cafc69e46748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b304cd14b65640dab95dc8926eb90818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:16.919132 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b0003ff7-f9ab-42d7-96d6-3bb5c2dd3a4e tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504ea33de5724b518bcdf28076d6361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd19911fb94d47ab92893a3ec449fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:16.935647 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b0003ff7-f9ab-42d7-96d6-3bb5c2dd3a4e tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] 10.222.0.60 "GET /compute/v2.1/servers/2aefa743-500a-4cd6-b3d9-d1cf138ee1da" status: 200 len: 1320 microversion: 2.1 time: 1.053841 Sep 14 09:04:16.955468 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-a68d28f4-976f-4168-8e25-b9afbc9a759f tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6b965ba7c340f190f9cafc69e46748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b304cd14b65640dab95dc8926eb90818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:16.961017 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1762/3560] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:04:15 2022] GET /compute/v2.1/servers/2aefa743-500a-4cd6-b3d9-d1cf138ee1da => generated 1320 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:04:16.963967 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-a68d28f4-976f-4168-8e25-b9afbc9a759f tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6b965ba7c340f190f9cafc69e46748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b304cd14b65640dab95dc8926eb90818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:16.967014 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-a68d28f4-976f-4168-8e25-b9afbc9a759f tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] 10.222.0.60 "GET /compute/v2.1/servers/fcc183e1-b880-4005-bb3e-90ab91ed7911" status: 200 len: 1366 microversion: 2.57 time: 0.210198 Sep 14 09:04:16.969856 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1799/3561] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:04:16 2022] GET /compute/v2.1/servers/fcc183e1-b880-4005-bb3e-90ab91ed7911 => generated 1366 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:04:17.040971 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d5031ff6-3fd6-40f9-b2c5-943bb94da66d tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:17.041604 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-d5031ff6-3fd6-40f9-b2c5-943bb94da66d tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: d9d9afd3-aeba-4429-a474-7c70a960d4e0] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:17.052816 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d5031ff6-3fd6-40f9-b2c5-943bb94da66d tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:17.054462 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d5031ff6-3fd6-40f9-b2c5-943bb94da66d tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:17.054917 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d5031ff6-3fd6-40f9-b2c5-943bb94da66d tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:17.057357 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d5031ff6-3fd6-40f9-b2c5-943bb94da66d tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:17.057838 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d5031ff6-3fd6-40f9-b2c5-943bb94da66d tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:17.061446 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d5031ff6-3fd6-40f9-b2c5-943bb94da66d tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:17.316244 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-046ffbae-4640-4888-b76c-98045afb6fb0 tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-1754662751", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "networks": [{"uuid": "33bdb63e-7b8b-4f3b-8dd2-4989c3f36ba6"}]}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:04:17.408111 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.network.neutron [None req-046ffbae-4640-4888-b76c-98045afb6fb0 tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] validate_networks() for [('33bdb63e-7b8b-4f3b-8dd2-4989c3f36ba6', None, None, None, None, None)] {{(pid=128759) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:04:17.782752 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-d5031ff6-3fd6-40f9-b2c5-943bb94da66d tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:17.791929 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-d5031ff6-3fd6-40f9-b2c5-943bb94da66d tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/d9d9afd3-aeba-4429-a474-7c70a960d4e0" status: 200 len: 1500 microversion: 2.1 time: 0.756005 Sep 14 09:04:17.811090 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1800/3562] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:04:17 2022] GET /compute/v2.1/servers/d9d9afd3-aeba-4429-a474-7c70a960d4e0 => generated 1500 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:04:17.845812 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-09ed1411-87cd-42d2-966a-113755124b80 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:17.849090 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-09ed1411-87cd-42d2-966a-113755124b80 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] [instance: 900c4e61-76fe-472f-bba7-0c83895f62cf] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:17.882144 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-09ed1411-87cd-42d2-966a-113755124b80 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:17.885821 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-09ed1411-87cd-42d2-966a-113755124b80 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:17.886446 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-09ed1411-87cd-42d2-966a-113755124b80 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:17.889092 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-09ed1411-87cd-42d2-966a-113755124b80 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:17.889615 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-09ed1411-87cd-42d2-966a-113755124b80 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:17.890115 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-09ed1411-87cd-42d2-966a-113755124b80 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:18.513107 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-09ed1411-87cd-42d2-966a-113755124b80 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84afbf1d30574a7aa1186a481687c50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a90781147416fa5db6b8922209058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:18.525566 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-09ed1411-87cd-42d2-966a-113755124b80 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84afbf1d30574a7aa1186a481687c50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a90781147416fa5db6b8922209058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:18.528843 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-09ed1411-87cd-42d2-966a-113755124b80 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84afbf1d30574a7aa1186a481687c50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a90781147416fa5db6b8922209058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:18.532430 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-09ed1411-87cd-42d2-966a-113755124b80 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] 10.222.0.60 "GET /compute/v2.1/servers/900c4e61-76fe-472f-bba7-0c83895f62cf" status: 200 len: 1413 microversion: 2.54 time: 0.718771 Sep 14 09:04:18.551305 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1801/3563] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:04:17 2022] GET /compute/v2.1/servers/900c4e61-76fe-472f-bba7-0c83895f62cf => generated 1413 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:04:18.558151 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-3261c4f7-5576-425f-8d25-8ef6a9fa9d7d tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:18.559028 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-3261c4f7-5576-425f-8d25-8ef6a9fa9d7d tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] [instance: 2aefa743-500a-4cd6-b3d9-d1cf138ee1da] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:18.566329 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3261c4f7-5576-425f-8d25-8ef6a9fa9d7d tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:18.567115 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3261c4f7-5576-425f-8d25-8ef6a9fa9d7d tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:18.567759 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3261c4f7-5576-425f-8d25-8ef6a9fa9d7d tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:18.568653 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3261c4f7-5576-425f-8d25-8ef6a9fa9d7d tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:18.569283 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3261c4f7-5576-425f-8d25-8ef6a9fa9d7d tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:18.569877 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3261c4f7-5576-425f-8d25-8ef6a9fa9d7d tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:19.238639 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-3261c4f7-5576-425f-8d25-8ef6a9fa9d7d tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504ea33de5724b518bcdf28076d6361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd19911fb94d47ab92893a3ec449fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:19.251206 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-3261c4f7-5576-425f-8d25-8ef6a9fa9d7d tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] 10.222.0.60 "GET /compute/v2.1/servers/2aefa743-500a-4cd6-b3d9-d1cf138ee1da" status: 200 len: 1320 microversion: 2.1 time: 0.698576 Sep 14 09:04:19.253363 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1802/3564] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:04:18 2022] GET /compute/v2.1/servers/2aefa743-500a-4cd6-b3d9-d1cf138ee1da => generated 1320 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:04:19.267679 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-17072560-0829-4b95-866c-dd1be970bc4a tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:19.269940 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-17072560-0829-4b95-866c-dd1be970bc4a tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] [instance: fcc183e1-b880-4005-bb3e-90ab91ed7911] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:19.293579 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-17072560-0829-4b95-866c-dd1be970bc4a tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:19.296273 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-17072560-0829-4b95-866c-dd1be970bc4a tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:19.296814 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-17072560-0829-4b95-866c-dd1be970bc4a tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:19.297644 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-17072560-0829-4b95-866c-dd1be970bc4a tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:19.298808 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-17072560-0829-4b95-866c-dd1be970bc4a tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:19.301482 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-17072560-0829-4b95-866c-dd1be970bc4a tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:19.342471 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-046ffbae-4640-4888-b76c-98045afb6fb0 tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Flavor limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:04:19.342992 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-046ffbae-4640-4888-b76c-98045afb6fb0 tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Image limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:04:19.343450 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-046ffbae-4640-4888-b76c-98045afb6fb0 tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Flavor pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:04:19.344056 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-046ffbae-4640-4888-b76c-98045afb6fb0 tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Image pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:04:19.344684 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-046ffbae-4640-4888-b76c-98045afb6fb0 tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:04:19.364861 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-046ffbae-4640-4888-b76c-98045afb6fb0 tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:19.365354 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-046ffbae-4640-4888-b76c-98045afb6fb0 tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:19.380294 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-046ffbae-4640-4888-b76c-98045afb6fb0 tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:19.382496 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-046ffbae-4640-4888-b76c-98045afb6fb0 tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:19.383380 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-046ffbae-4640-4888-b76c-98045afb6fb0 tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:19.385155 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-046ffbae-4640-4888-b76c-98045afb6fb0 tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:19.481042 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-046ffbae-4640-4888-b76c-98045afb6fb0 tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Getting quotas for project a49345e5148f4d7aae1488e735c76590. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:04:19.486814 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-17072560-0829-4b95-866c-dd1be970bc4a tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6b965ba7c340f190f9cafc69e46748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b304cd14b65640dab95dc8926eb90818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:19.493924 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-046ffbae-4640-4888-b76c-98045afb6fb0 tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Getting quotas for user 0ebe0be597a44e0bad22fbcf5c9249d4 and project a49345e5148f4d7aae1488e735c76590. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:04:19.512550 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-17072560-0829-4b95-866c-dd1be970bc4a tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6b965ba7c340f190f9cafc69e46748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b304cd14b65640dab95dc8926eb90818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:19.522198 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-046ffbae-4640-4888-b76c-98045afb6fb0 tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Going to run 1 instances... {{(pid=128759) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:04:19.523416 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-17072560-0829-4b95-866c-dd1be970bc4a tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6b965ba7c340f190f9cafc69e46748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b304cd14b65640dab95dc8926eb90818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:19.526565 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-046ffbae-4640-4888-b76c-98045afb6fb0 tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] [instance: adbd193b-b0ae-40c1-97b5-7fbb9077942b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128759) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:04:19.528383 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-17072560-0829-4b95-866c-dd1be970bc4a tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] 10.222.0.60 "GET /compute/v2.1/servers/fcc183e1-b880-4005-bb3e-90ab91ed7911" status: 200 len: 1366 microversion: 2.57 time: 0.271937 Sep 14 09:04:19.530819 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1803/3565] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:04:19 2022] GET /compute/v2.1/servers/fcc183e1-b880-4005-bb3e-90ab91ed7911 => generated 1366 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:04:19.538733 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-8aec692b-d787-4135-8009-a4c6a8421c2b tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:19.539675 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-8aec692b-d787-4135-8009-a4c6a8421c2b tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: d9d9afd3-aeba-4429-a474-7c70a960d4e0] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:19.552734 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8aec692b-d787-4135-8009-a4c6a8421c2b tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:19.553495 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8aec692b-d787-4135-8009-a4c6a8421c2b tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:19.554168 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8aec692b-d787-4135-8009-a4c6a8421c2b tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:19.555461 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8aec692b-d787-4135-8009-a4c6a8421c2b tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:19.557326 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8aec692b-d787-4135-8009-a4c6a8421c2b tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:19.558066 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8aec692b-d787-4135-8009-a4c6a8421c2b tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:19.684949 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-046ffbae-4640-4888-b76c-98045afb6fb0 tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.689905 Sep 14 09:04:19.699970 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1763/3566] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 09:04:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 2705 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:04:19.957340 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-74e09458-2eeb-4f25-a30b-f003a6d611e1 tempest-ServicesAdminNegativeTestJSON-385006232 tempest-ServicesAdminNegativeTestJSON-385006232-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:19.961812 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-74e09458-2eeb-4f25-a30b-f003a6d611e1 tempest-ServicesAdminNegativeTestJSON-385006232 tempest-ServicesAdminNegativeTestJSON-385006232-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:19.963937 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-74e09458-2eeb-4f25-a30b-f003a6d611e1 tempest-ServicesAdminNegativeTestJSON-385006232 tempest-ServicesAdminNegativeTestJSON-385006232-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:19.965083 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-74e09458-2eeb-4f25-a30b-f003a6d611e1 tempest-ServicesAdminNegativeTestJSON-385006232 tempest-ServicesAdminNegativeTestJSON-385006232-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:19.967291 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-74e09458-2eeb-4f25-a30b-f003a6d611e1 tempest-ServicesAdminNegativeTestJSON-385006232 tempest-ServicesAdminNegativeTestJSON-385006232-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:19.969275 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-74e09458-2eeb-4f25-a30b-f003a6d611e1 tempest-ServicesAdminNegativeTestJSON-385006232 tempest-ServicesAdminNegativeTestJSON-385006232-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:19.970269 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-74e09458-2eeb-4f25-a30b-f003a6d611e1 tempest-ServicesAdminNegativeTestJSON-385006232 tempest-ServicesAdminNegativeTestJSON-385006232-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:20.008197 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-74e09458-2eeb-4f25-a30b-f003a6d611e1 tempest-ServicesAdminNegativeTestJSON-385006232 tempest-ServicesAdminNegativeTestJSON-385006232-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.306983 Sep 14 09:04:20.018223 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1764/3567] 10.222.0.60 () {58 vars in 1137 bytes} [Wed Sep 14 09:04:19 2022] GET /compute/v2.1/os-services => generated 949 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:04:20.024303 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d41f5aab-e837-4c91-8aed-bd8757698740 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:20.025986 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-d41f5aab-e837-4c91-8aed-bd8757698740 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] [instance: 900c4e61-76fe-472f-bba7-0c83895f62cf] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:20.037994 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d41f5aab-e837-4c91-8aed-bd8757698740 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:20.039170 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d41f5aab-e837-4c91-8aed-bd8757698740 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:20.039721 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d41f5aab-e837-4c91-8aed-bd8757698740 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:20.040790 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d41f5aab-e837-4c91-8aed-bd8757698740 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:20.041786 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d41f5aab-e837-4c91-8aed-bd8757698740 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:20.042783 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d41f5aab-e837-4c91-8aed-bd8757698740 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:20.240932 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-8aec692b-d787-4135-8009-a4c6a8421c2b tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:20.252748 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-8aec692b-d787-4135-8009-a4c6a8421c2b tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/d9d9afd3-aeba-4429-a474-7c70a960d4e0" status: 200 len: 1500 microversion: 2.1 time: 0.720059 Sep 14 09:04:20.256122 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1804/3568] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:04:19 2022] GET /compute/v2.1/servers/d9d9afd3-aeba-4429-a474-7c70a960d4e0 => generated 1500 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:04:20.259234 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-d41f5aab-e837-4c91-8aed-bd8757698740 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84afbf1d30574a7aa1186a481687c50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a90781147416fa5db6b8922209058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:20.265458 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-23a2aa71-5a21-4ccb-a2de-f3f0638071b9 tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:20.266092 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-23a2aa71-5a21-4ccb-a2de-f3f0638071b9 tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] [instance: adbd193b-b0ae-40c1-97b5-7fbb9077942b] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:20.281623 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-d41f5aab-e837-4c91-8aed-bd8757698740 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84afbf1d30574a7aa1186a481687c50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a90781147416fa5db6b8922209058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:20.283459 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-d41f5aab-e837-4c91-8aed-bd8757698740 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84afbf1d30574a7aa1186a481687c50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a90781147416fa5db6b8922209058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:20.284872 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d41f5aab-e837-4c91-8aed-bd8757698740 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] 10.222.0.60 "GET /compute/v2.1/servers/900c4e61-76fe-472f-bba7-0c83895f62cf" status: 200 len: 1413 microversion: 2.54 time: 0.264979 Sep 14 09:04:20.289081 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1765/3569] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:04:20 2022] GET /compute/v2.1/servers/900c4e61-76fe-472f-bba7-0c83895f62cf => generated 1413 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:04:20.303030 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e4ac42be-24fa-4568-ab5f-2db7a131827d tempest-ServicesAdminNegativeTestJSON-385006232 tempest-ServicesAdminNegativeTestJSON-385006232-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:20.315787 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e4ac42be-24fa-4568-ab5f-2db7a131827d tempest-ServicesAdminNegativeTestJSON-385006232 tempest-ServicesAdminNegativeTestJSON-385006232-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:20.317196 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e4ac42be-24fa-4568-ab5f-2db7a131827d tempest-ServicesAdminNegativeTestJSON-385006232 tempest-ServicesAdminNegativeTestJSON-385006232-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:20.317889 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e4ac42be-24fa-4568-ab5f-2db7a131827d tempest-ServicesAdminNegativeTestJSON-385006232 tempest-ServicesAdminNegativeTestJSON-385006232-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:20.319499 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e4ac42be-24fa-4568-ab5f-2db7a131827d tempest-ServicesAdminNegativeTestJSON-385006232 tempest-ServicesAdminNegativeTestJSON-385006232-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:20.320158 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e4ac42be-24fa-4568-ab5f-2db7a131827d tempest-ServicesAdminNegativeTestJSON-385006232 tempest-ServicesAdminNegativeTestJSON-385006232-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:20.322520 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e4ac42be-24fa-4568-ab5f-2db7a131827d tempest-ServicesAdminNegativeTestJSON-385006232 tempest-ServicesAdminNegativeTestJSON-385006232-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:20.375405 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e4ac42be-24fa-4568-ab5f-2db7a131827d tempest-ServicesAdminNegativeTestJSON-385006232 tempest-ServicesAdminNegativeTestJSON-385006232-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.084899 Sep 14 09:04:20.390684 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1766/3570] 10.222.0.60 () {58 vars in 1170 bytes} [Wed Sep 14 09:04:20 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 949 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:04:20.398335 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3f3c53c9-3b4e-47a3-9f5e-46cb7f06b26c tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:20.399377 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-3f3c53c9-3b4e-47a3-9f5e-46cb7f06b26c tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] [instance: 2aefa743-500a-4cd6-b3d9-d1cf138ee1da] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:20.418075 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3f3c53c9-3b4e-47a3-9f5e-46cb7f06b26c tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:20.418869 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3f3c53c9-3b4e-47a3-9f5e-46cb7f06b26c tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:20.421981 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3f3c53c9-3b4e-47a3-9f5e-46cb7f06b26c tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:20.423657 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3f3c53c9-3b4e-47a3-9f5e-46cb7f06b26c tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:20.424571 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3f3c53c9-3b4e-47a3-9f5e-46cb7f06b26c tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:20.425269 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3f3c53c9-3b4e-47a3-9f5e-46cb7f06b26c tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:20.475180 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-23a2aa71-5a21-4ccb-a2de-f3f0638071b9 tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebe0be597a44e0bad22fbcf5c9249d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49345e5148f4d7aae1488e735c76590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:20.487809 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-23a2aa71-5a21-4ccb-a2de-f3f0638071b9 tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] 10.222.0.60 "GET /compute/v2.1/servers/adbd193b-b0ae-40c1-97b5-7fbb9077942b" status: 200 len: 1225 microversion: 2.1 time: 0.228790 Sep 14 09:04:20.490149 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1805/3571] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:04:20 2022] GET /compute/v2.1/servers/adbd193b-b0ae-40c1-97b5-7fbb9077942b => generated 1225 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:04:20.501028 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-45b605f5-4028-44ee-84b9-e7ad7b0a6ec6 tempest-ServicesAdminNegativeTestJSON-385006232 tempest-ServicesAdminNegativeTestJSON-385006232-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:20.507780 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-45b605f5-4028-44ee-84b9-e7ad7b0a6ec6 tempest-ServicesAdminNegativeTestJSON-385006232 tempest-ServicesAdminNegativeTestJSON-385006232-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:20.512185 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-45b605f5-4028-44ee-84b9-e7ad7b0a6ec6 tempest-ServicesAdminNegativeTestJSON-385006232 tempest-ServicesAdminNegativeTestJSON-385006232-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:20.513940 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-45b605f5-4028-44ee-84b9-e7ad7b0a6ec6 tempest-ServicesAdminNegativeTestJSON-385006232 tempest-ServicesAdminNegativeTestJSON-385006232-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:20.515630 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-45b605f5-4028-44ee-84b9-e7ad7b0a6ec6 tempest-ServicesAdminNegativeTestJSON-385006232 tempest-ServicesAdminNegativeTestJSON-385006232-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:20.519063 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-45b605f5-4028-44ee-84b9-e7ad7b0a6ec6 tempest-ServicesAdminNegativeTestJSON-385006232 tempest-ServicesAdminNegativeTestJSON-385006232-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:20.520525 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-45b605f5-4028-44ee-84b9-e7ad7b0a6ec6 tempest-ServicesAdminNegativeTestJSON-385006232 tempest-ServicesAdminNegativeTestJSON-385006232-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:20.601812 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-45b605f5-4028-44ee-84b9-e7ad7b0a6ec6 tempest-ServicesAdminNegativeTestJSON-385006232 tempest-ServicesAdminNegativeTestJSON-385006232-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.110107 Sep 14 09:04:20.610672 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1806/3572] 10.222.0.60 () {58 vars in 1137 bytes} [Wed Sep 14 09:04:20 2022] GET /compute/v2.1/os-services => generated 949 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:04:20.615842 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-30f142a8-fb6a-4e84-a1fa-fda7588a2bb6 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:20.616724 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-30f142a8-fb6a-4e84-a1fa-fda7588a2bb6 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] [instance: fcc183e1-b880-4005-bb3e-90ab91ed7911] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:20.632414 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-30f142a8-fb6a-4e84-a1fa-fda7588a2bb6 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:20.634024 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-30f142a8-fb6a-4e84-a1fa-fda7588a2bb6 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:20.636806 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-30f142a8-fb6a-4e84-a1fa-fda7588a2bb6 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:20.638244 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-30f142a8-fb6a-4e84-a1fa-fda7588a2bb6 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:20.640063 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-30f142a8-fb6a-4e84-a1fa-fda7588a2bb6 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:20.642468 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-30f142a8-fb6a-4e84-a1fa-fda7588a2bb6 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:20.797648 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-30f142a8-fb6a-4e84-a1fa-fda7588a2bb6 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6b965ba7c340f190f9cafc69e46748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b304cd14b65640dab95dc8926eb90818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:20.811860 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-30f142a8-fb6a-4e84-a1fa-fda7588a2bb6 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6b965ba7c340f190f9cafc69e46748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b304cd14b65640dab95dc8926eb90818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:20.817401 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-30f142a8-fb6a-4e84-a1fa-fda7588a2bb6 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6b965ba7c340f190f9cafc69e46748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b304cd14b65640dab95dc8926eb90818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:20.820537 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-30f142a8-fb6a-4e84-a1fa-fda7588a2bb6 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] 10.222.0.60 "GET /compute/v2.1/servers/fcc183e1-b880-4005-bb3e-90ab91ed7911" status: 200 len: 1366 microversion: 2.57 time: 0.215343 Sep 14 09:04:20.831162 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1807/3573] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:04:20 2022] GET /compute/v2.1/servers/fcc183e1-b880-4005-bb3e-90ab91ed7911 => generated 1366 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:04:20.846846 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d9fa2a4f-877d-418f-a08d-f0b9714b9034 tempest-ServicesAdminNegativeTestJSON-385006232 tempest-ServicesAdminNegativeTestJSON-385006232-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:20.857488 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d9fa2a4f-877d-418f-a08d-f0b9714b9034 tempest-ServicesAdminNegativeTestJSON-385006232 tempest-ServicesAdminNegativeTestJSON-385006232-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:20.858355 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d9fa2a4f-877d-418f-a08d-f0b9714b9034 tempest-ServicesAdminNegativeTestJSON-385006232 tempest-ServicesAdminNegativeTestJSON-385006232-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:20.859091 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d9fa2a4f-877d-418f-a08d-f0b9714b9034 tempest-ServicesAdminNegativeTestJSON-385006232 tempest-ServicesAdminNegativeTestJSON-385006232-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:20.860574 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d9fa2a4f-877d-418f-a08d-f0b9714b9034 tempest-ServicesAdminNegativeTestJSON-385006232 tempest-ServicesAdminNegativeTestJSON-385006232-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:20.861281 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d9fa2a4f-877d-418f-a08d-f0b9714b9034 tempest-ServicesAdminNegativeTestJSON-385006232 tempest-ServicesAdminNegativeTestJSON-385006232-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:20.861953 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d9fa2a4f-877d-418f-a08d-f0b9714b9034 tempest-ServicesAdminNegativeTestJSON-385006232 tempest-ServicesAdminNegativeTestJSON-385006232-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:20.892413 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-d9fa2a4f-877d-418f-a08d-f0b9714b9034 tempest-ServicesAdminNegativeTestJSON-385006232 tempest-ServicesAdminNegativeTestJSON-385006232-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services?host=n-d-836830-18&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.059426 Sep 14 09:04:20.893742 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1808/3574] 10.222.0.60 () {58 vars in 1196 bytes} [Wed Sep 14 09:04:20 2022] GET /compute/v2.1/os-services?host=n-d-836830-18&binary=xxx => generated 16 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 09:04:20.900521 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-1acbbd01-4e23-4fae-8384-cf90e70597f0 req-038089e0-64ab-4ad5-a534-371495b71e19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9d9afd3-aeba-4429-a474-7c70a960d4e0", "name": "network-vif-deleted", "tag": "f8440eec-c0f1-49c8-b0e1-c14bd38590a8"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:04:20.911860 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-1acbbd01-4e23-4fae-8384-cf90e70597f0 req-038089e0-64ab-4ad5-a534-371495b71e19 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:20.914058 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-1acbbd01-4e23-4fae-8384-cf90e70597f0 req-038089e0-64ab-4ad5-a534-371495b71e19 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:20.915138 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-1acbbd01-4e23-4fae-8384-cf90e70597f0 req-038089e0-64ab-4ad5-a534-371495b71e19 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:20.930868 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-1acbbd01-4e23-4fae-8384-cf90e70597f0 req-038089e0-64ab-4ad5-a534-371495b71e19 service nova] Creating event network-vif-deleted:f8440eec-c0f1-49c8-b0e1-c14bd38590a8 for instance d9d9afd3-aeba-4429-a474-7c70a960d4e0 on n-h1-836830-18 Sep 14 09:04:20.937481 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-1acbbd01-4e23-4fae-8384-cf90e70597f0 req-038089e0-64ab-4ad5-a534-371495b71e19 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042125 Sep 14 09:04:20.938490 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1809/3575] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:04:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:04:20.944677 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-e334838b-46a7-43ab-8989-0bd819984940 tempest-ServicesAdminNegativeTestJSON-385006232 tempest-ServicesAdminNegativeTestJSON-385006232-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:20.951321 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e334838b-46a7-43ab-8989-0bd819984940 tempest-ServicesAdminNegativeTestJSON-385006232 tempest-ServicesAdminNegativeTestJSON-385006232-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:20.952838 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e334838b-46a7-43ab-8989-0bd819984940 tempest-ServicesAdminNegativeTestJSON-385006232 tempest-ServicesAdminNegativeTestJSON-385006232-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:20.953558 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e334838b-46a7-43ab-8989-0bd819984940 tempest-ServicesAdminNegativeTestJSON-385006232 tempest-ServicesAdminNegativeTestJSON-385006232-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:20.954575 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e334838b-46a7-43ab-8989-0bd819984940 tempest-ServicesAdminNegativeTestJSON-385006232 tempest-ServicesAdminNegativeTestJSON-385006232-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:20.955412 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e334838b-46a7-43ab-8989-0bd819984940 tempest-ServicesAdminNegativeTestJSON-385006232 tempest-ServicesAdminNegativeTestJSON-385006232-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:20.956633 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e334838b-46a7-43ab-8989-0bd819984940 tempest-ServicesAdminNegativeTestJSON-385006232 tempest-ServicesAdminNegativeTestJSON-385006232-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:20.987186 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-3f3c53c9-3b4e-47a3-9f5e-46cb7f06b26c tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504ea33de5724b518bcdf28076d6361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd19911fb94d47ab92893a3ec449fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:20.999013 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-3f3c53c9-3b4e-47a3-9f5e-46cb7f06b26c tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] 10.222.0.60 "GET /compute/v2.1/servers/2aefa743-500a-4cd6-b3d9-d1cf138ee1da" status: 200 len: 1320 microversion: 2.1 time: 0.606578 Sep 14 09:04:20.999907 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1767/3576] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:04:20 2022] GET /compute/v2.1/servers/2aefa743-500a-4cd6-b3d9-d1cf138ee1da => generated 1320 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:04:21.028454 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-e334838b-46a7-43ab-8989-0bd819984940 tempest-ServicesAdminNegativeTestJSON-385006232 tempest-ServicesAdminNegativeTestJSON-385006232-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.088072 Sep 14 09:04:21.033572 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1810/3577] 10.222.0.60 () {58 vars in 1137 bytes} [Wed Sep 14 09:04:20 2022] GET /compute/v2.1/os-services => generated 949 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:04:21.046491 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-dc2613cf-175c-4264-ae08-1ed733c12130 tempest-ServicesAdminNegativeTestJSON-385006232 tempest-ServicesAdminNegativeTestJSON-385006232-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:21.052258 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dc2613cf-175c-4264-ae08-1ed733c12130 tempest-ServicesAdminNegativeTestJSON-385006232 tempest-ServicesAdminNegativeTestJSON-385006232-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:21.053029 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dc2613cf-175c-4264-ae08-1ed733c12130 tempest-ServicesAdminNegativeTestJSON-385006232 tempest-ServicesAdminNegativeTestJSON-385006232-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:21.053819 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dc2613cf-175c-4264-ae08-1ed733c12130 tempest-ServicesAdminNegativeTestJSON-385006232 tempest-ServicesAdminNegativeTestJSON-385006232-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:21.054803 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dc2613cf-175c-4264-ae08-1ed733c12130 tempest-ServicesAdminNegativeTestJSON-385006232 tempest-ServicesAdminNegativeTestJSON-385006232-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:21.055726 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dc2613cf-175c-4264-ae08-1ed733c12130 tempest-ServicesAdminNegativeTestJSON-385006232 tempest-ServicesAdminNegativeTestJSON-385006232-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:21.056955 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dc2613cf-175c-4264-ae08-1ed733c12130 tempest-ServicesAdminNegativeTestJSON-385006232 tempest-ServicesAdminNegativeTestJSON-385006232-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:21.090348 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-dc2613cf-175c-4264-ae08-1ed733c12130 tempest-ServicesAdminNegativeTestJSON-385006232 tempest-ServicesAdminNegativeTestJSON-385006232-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.048268 Sep 14 09:04:21.106808 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1768/3578] 10.222.0.60 () {58 vars in 1198 bytes} [Wed Sep 14 09:04:21 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 09:04:21.158316 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-a7826080-07a7-4690-b250-f64b8039db4b req-9d1d908b-55ef-4091-8058-b1c718f501a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2aefa743-500a-4cd6-b3d9-d1cf138ee1da", "name": "network-vif-plugged", "status": "completed", "tag": "9a1b9324-7bb5-4a21-a7e8-7e091b71bdaf"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:04:21.171987 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-a7826080-07a7-4690-b250-f64b8039db4b req-9d1d908b-55ef-4091-8058-b1c718f501a3 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:21.172737 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-a7826080-07a7-4690-b250-f64b8039db4b req-9d1d908b-55ef-4091-8058-b1c718f501a3 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:21.173667 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-a7826080-07a7-4690-b250-f64b8039db4b req-9d1d908b-55ef-4091-8058-b1c718f501a3 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:21.189340 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-a7826080-07a7-4690-b250-f64b8039db4b req-9d1d908b-55ef-4091-8058-b1c718f501a3 service nova] Creating event network-vif-plugged:9a1b9324-7bb5-4a21-a7e8-7e091b71bdaf for instance 2aefa743-500a-4cd6-b3d9-d1cf138ee1da on n-h2-836830-18 Sep 14 09:04:21.196176 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-a7826080-07a7-4690-b250-f64b8039db4b req-9d1d908b-55ef-4091-8058-b1c718f501a3 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042311 Sep 14 09:04:21.198041 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1769/3579] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:04:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:04:21.287822 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-59c428d0-e60c-4d65-9704-7a7818b4031a tempest-ServicesAdminNegativeTestJSON-573298624 tempest-ServicesAdminNegativeTestJSON-573298624-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:21.289128 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-423aa62d-1d55-4e24-b4c9-3477123cda3e tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:21.293432 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-59c428d0-e60c-4d65-9704-7a7818b4031a tempest-ServicesAdminNegativeTestJSON-573298624 tempest-ServicesAdminNegativeTestJSON-573298624-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'c0cdbeb66bfa4d9a9dec531789dfa2f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b409637e47014ae8b4db14b7e127821b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:21.294452 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-423aa62d-1d55-4e24-b4c9-3477123cda3e tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: d9d9afd3-aeba-4429-a474-7c70a960d4e0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:21.302501 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-59c428d0-e60c-4d65-9704-7a7818b4031a tempest-ServicesAdminNegativeTestJSON-573298624 tempest-ServicesAdminNegativeTestJSON-573298624-project] Request method failure captured: Sep 14 09:04:21.302501 n-d-836830-18 devstack@n-api.service[128758]: request: GET /compute/v2.1/os-services HTTP/1.1 Sep 14 09:04:21.302501 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 09:04:21.302501 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 09:04:21.302501 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 09:04:21.302501 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 09:04:21.302501 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 09:04:21.302501 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 09:04:21.302501 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 09:04:21.302501 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 09:04:21.302501 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZkRUjP-llH6k8lJRiZ2Ji0pdnzYIBbUw-3zaOvILpFHjx8w73ve45DovwZQVl1041XwN2uzhFbF__OtH7gDEUgJLWG3uXP6rDlDuYt34ATtJnEuokbahgCNm6Phupvj6mZ9c8FXGmA96-AhdDUr12QGvmjUPr8F8iwcu0Eg4h25Ujw Sep 14 09:04:21.302501 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 09:04:21.302501 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 09:04:21.302501 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 09:04:21.302501 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 09:04:21.302501 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 09:04:21.302501 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 09:04:21.302501 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: b409637e47014ae8b4db14b7e127821b Sep 14 09:04:21.302501 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-573298624 Sep 14 09:04:21.302501 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 09:04:21.302501 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 09:04:21.302501 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b409637e47014ae8b4db14b7e127821b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b409637e47014ae8b4db14b7e127821b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b409637e47014ae8b4db14b7e127821b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b409637e47014ae8b4db14b7e127821b"}]}] Sep 14 09:04:21.302501 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-573298624 Sep 14 09:04:21.302501 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: b409637e47014ae8b4db14b7e127821b Sep 14 09:04:21.302501 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-573298624 Sep 14 09:04:21.302501 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-ServicesAdminNegativeTestJSON-573298624-project Sep 14 09:04:21.302501 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 09:04:21.302501 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 09:04:21.302501 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: c0cdbeb66bfa4d9a9dec531789dfa2f5 Sep 14 09:04:21.302501 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-573298624-project Sep 14 09:04:21.302501 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 09:04:21.302501 n-d-836830-18 devstack@n-api.service[128758]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 14 09:04:21.302501 n-d-836830-18 devstack@n-api.service[128758]: action_args: {} Sep 14 09:04:21.302501 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:04:21.302501 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:04:21.302501 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:04:21.302501 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:04:21.302501 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:04:21.302501 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:04:21.302501 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 14 09:04:21.302501 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:04:21.302501 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 14 09:04:21.302501 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:04:21.302501 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:04:21.302501 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:04:21.302501 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Sep 14 09:04:21.302501 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Sep 14 09:04:21.302501 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 14 09:04:21.302501 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 14 09:04:21.302501 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 14 09:04:21.302501 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 14 09:04:21.302501 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 14 09:04:21.302501 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 14 09:04:21.302501 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 14 09:04:21.302501 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise self.value Sep 14 09:04:21.302501 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 14 09:04:21.302501 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 14 09:04:21.302501 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 14 09:04:21.302501 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 14 09:04:21.302501 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 14 09:04:21.302501 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 14 09:04:21.302501 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 14 09:04:21.302501 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:04:21.309085 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:04:21.309085 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:04:21.309085 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:04:21.309085 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:04:21.309085 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:04:21.309085 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 14 09:04:21.309085 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 14 09:04:21.309085 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 14 09:04:21.309085 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:04:21.315375 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-59c428d0-e60c-4d65-9704-7a7818b4031a tempest-ServicesAdminNegativeTestJSON-573298624 tempest-ServicesAdminNegativeTestJSON-573298624-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:04:21.315375 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-59c428d0-e60c-4d65-9704-7a7818b4031a tempest-ServicesAdminNegativeTestJSON-573298624 tempest-ServicesAdminNegativeTestJSON-573298624-project] 10.222.0.60 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.215018 Sep 14 09:04:21.317580 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1811/3580] 10.222.0.60 () {58 vars in 1137 bytes} [Wed Sep 14 09:04:21 2022] GET /compute/v2.1/os-services => generated 112 bytes in 218 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:04:21.329979 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-423aa62d-1d55-4e24-b4c9-3477123cda3e tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:21.333328 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-423aa62d-1d55-4e24-b4c9-3477123cda3e tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:21.341065 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-423aa62d-1d55-4e24-b4c9-3477123cda3e tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:21.343981 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-423aa62d-1d55-4e24-b4c9-3477123cda3e tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:21.345036 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-423aa62d-1d55-4e24-b4c9-3477123cda3e tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:21.345724 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-423aa62d-1d55-4e24-b4c9-3477123cda3e tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:21.354507 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-2d0197ef-564e-4c9d-bc46-a49d3674eaa7 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:21.355533 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-2d0197ef-564e-4c9d-bc46-a49d3674eaa7 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] [instance: 900c4e61-76fe-472f-bba7-0c83895f62cf] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:21.371408 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:04:21.376042 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2d0197ef-564e-4c9d-bc46-a49d3674eaa7 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:21.379307 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2d0197ef-564e-4c9d-bc46-a49d3674eaa7 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:21.380038 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2d0197ef-564e-4c9d-bc46-a49d3674eaa7 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:21.383560 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2d0197ef-564e-4c9d-bc46-a49d3674eaa7 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:21.384325 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2d0197ef-564e-4c9d-bc46-a49d3674eaa7 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:21.385858 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2d0197ef-564e-4c9d-bc46-a49d3674eaa7 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:21.430895 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-423aa62d-1d55-4e24-b4c9-3477123cda3e tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:21.432546 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-423aa62d-1d55-4e24-b4c9-3477123cda3e tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:21.434858 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-423aa62d-1d55-4e24-b4c9-3477123cda3e tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:21.436673 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.objects.instance [None req-423aa62d-1d55-4e24-b4c9-3477123cda3e tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lazy-loading 'fault' on Instance uuid d9d9afd3-aeba-4429-a474-7c70a960d4e0 {{(pid=128759) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:04:21.676904 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-423aa62d-1d55-4e24-b4c9-3477123cda3e tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c95b28481b451bb03fb2c0240d0310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d42bf4d573b4bf9a0d8c9e73260af7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:21.682246 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:04:21.691709 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-423aa62d-1d55-4e24-b4c9-3477123cda3e tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/d9d9afd3-aeba-4429-a474-7c70a960d4e0" status: 200 len: 1305 microversion: 2.1 time: 0.414965 Sep 14 09:04:21.693409 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1770/3581] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:04:21 2022] GET /compute/v2.1/servers/d9d9afd3-aeba-4429-a474-7c70a960d4e0 => generated 1305 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:04:21.700549 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b0987443-3cd3-4fda-802b-c219af96e546 tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:21.702042 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b0987443-3cd3-4fda-802b-c219af96e546 tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] [instance: adbd193b-b0ae-40c1-97b5-7fbb9077942b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:21.711784 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b0987443-3cd3-4fda-802b-c219af96e546 tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:21.719919 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b0987443-3cd3-4fda-802b-c219af96e546 tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:21.720618 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b0987443-3cd3-4fda-802b-c219af96e546 tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:21.721548 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b0987443-3cd3-4fda-802b-c219af96e546 tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:21.722504 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b0987443-3cd3-4fda-802b-c219af96e546 tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:21.723170 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b0987443-3cd3-4fda-802b-c219af96e546 tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:21.756781 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-2d0197ef-564e-4c9d-bc46-a49d3674eaa7 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84afbf1d30574a7aa1186a481687c50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a90781147416fa5db6b8922209058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:21.770265 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-2d0197ef-564e-4c9d-bc46-a49d3674eaa7 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84afbf1d30574a7aa1186a481687c50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a90781147416fa5db6b8922209058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:21.773077 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-2d0197ef-564e-4c9d-bc46-a49d3674eaa7 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84afbf1d30574a7aa1186a481687c50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a90781147416fa5db6b8922209058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:21.774299 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-2d0197ef-564e-4c9d-bc46-a49d3674eaa7 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] 10.222.0.60 "GET /compute/v2.1/servers/900c4e61-76fe-472f-bba7-0c83895f62cf" status: 200 len: 1398 microversion: 2.54 time: 0.438070 Sep 14 09:04:21.775228 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1812/3582] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:04:21 2022] GET /compute/v2.1/servers/900c4e61-76fe-472f-bba7-0c83895f62cf => generated 1398 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:04:21.807448 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-4eb7ac61-d7db-4ad9-a56f-73ab56dc7037 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Calling method '.version_select at 0x7f7d485b98b0>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:21.852514 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-4eb7ac61-d7db-4ad9-a56f-73ab56dc7037 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-323069994" status: 204 len: 0 microversion: 2.54 time: 0.051216 Sep 14 09:04:21.853876 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1813/3583] 10.222.0.60 () {60 vars in 1316 bytes} [Wed Sep 14 09:04:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-323069994 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 14 09:04:21.870794 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-119f988a-f1a9-46d1-89cc-b49873a53973 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:21.871472 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-119f988a-f1a9-46d1-89cc-b49873a53973 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] [instance: fcc183e1-b880-4005-bb3e-90ab91ed7911] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:21.887512 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-119f988a-f1a9-46d1-89cc-b49873a53973 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:21.888012 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-119f988a-f1a9-46d1-89cc-b49873a53973 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:21.892889 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-119f988a-f1a9-46d1-89cc-b49873a53973 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:21.893667 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-119f988a-f1a9-46d1-89cc-b49873a53973 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:21.894149 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-119f988a-f1a9-46d1-89cc-b49873a53973 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:21.895049 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-119f988a-f1a9-46d1-89cc-b49873a53973 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:21.908908 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b0987443-3cd3-4fda-802b-c219af96e546 tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebe0be597a44e0bad22fbcf5c9249d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49345e5148f4d7aae1488e735c76590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:21.918486 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b0987443-3cd3-4fda-802b-c219af96e546 tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] 10.222.0.60 "GET /compute/v2.1/servers/adbd193b-b0ae-40c1-97b5-7fbb9077942b" status: 200 len: 1277 microversion: 2.1 time: 0.223704 Sep 14 09:04:21.925572 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1771/3584] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:04:21 2022] GET /compute/v2.1/servers/adbd193b-b0ae-40c1-97b5-7fbb9077942b => generated 1277 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:04:21.935085 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-fdaf0601-4afe-4118-b072-64e45d147603 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:21.935859 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-fdaf0601-4afe-4118-b072-64e45d147603 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] [instance: 900c4e61-76fe-472f-bba7-0c83895f62cf] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:21.951784 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fdaf0601-4afe-4118-b072-64e45d147603 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:21.952687 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fdaf0601-4afe-4118-b072-64e45d147603 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:21.955522 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fdaf0601-4afe-4118-b072-64e45d147603 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:21.956605 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fdaf0601-4afe-4118-b072-64e45d147603 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:21.957241 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fdaf0601-4afe-4118-b072-64e45d147603 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:21.957840 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fdaf0601-4afe-4118-b072-64e45d147603 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:22.017294 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-fdaf0601-4afe-4118-b072-64e45d147603 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] [instance: 900c4e61-76fe-472f-bba7-0c83895f62cf] Going to try to terminate instance {{(pid=128759) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:04:22.070561 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-119f988a-f1a9-46d1-89cc-b49873a53973 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6b965ba7c340f190f9cafc69e46748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b304cd14b65640dab95dc8926eb90818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:22.091500 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-119f988a-f1a9-46d1-89cc-b49873a53973 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6b965ba7c340f190f9cafc69e46748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b304cd14b65640dab95dc8926eb90818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:22.097787 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-119f988a-f1a9-46d1-89cc-b49873a53973 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6b965ba7c340f190f9cafc69e46748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b304cd14b65640dab95dc8926eb90818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:22.105041 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-119f988a-f1a9-46d1-89cc-b49873a53973 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] 10.222.0.60 "GET /compute/v2.1/servers/fcc183e1-b880-4005-bb3e-90ab91ed7911" status: 200 len: 1366 microversion: 2.57 time: 0.245664 Sep 14 09:04:22.106652 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1814/3585] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:04:21 2022] GET /compute/v2.1/servers/fcc183e1-b880-4005-bb3e-90ab91ed7911 => generated 1366 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:04:22.127033 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-962761ca-cfb4-44c6-8c05-878de1e719a8 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:22.127699 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-962761ca-cfb4-44c6-8c05-878de1e719a8 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] [instance: 2aefa743-500a-4cd6-b3d9-d1cf138ee1da] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:22.144296 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-962761ca-cfb4-44c6-8c05-878de1e719a8 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:22.145071 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-962761ca-cfb4-44c6-8c05-878de1e719a8 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:22.146871 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-962761ca-cfb4-44c6-8c05-878de1e719a8 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:22.147879 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-962761ca-cfb4-44c6-8c05-878de1e719a8 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:22.163176 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-962761ca-cfb4-44c6-8c05-878de1e719a8 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:22.164881 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-962761ca-cfb4-44c6-8c05-878de1e719a8 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:22.173848 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=100 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:04:22.222440 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-fdaf0601-4afe-4118-b072-64e45d147603 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] 10.222.0.60 "DELETE /compute/v2.1/servers/900c4e61-76fe-472f-bba7-0c83895f62cf" status: 204 len: 0 microversion: 2.54 time: 0.295360 Sep 14 09:04:22.223667 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1772/3586] 10.222.0.60 () {60 vars in 1280 bytes} [Wed Sep 14 09:04:21 2022] DELETE /compute/v2.1/servers/900c4e61-76fe-472f-bba7-0c83895f62cf => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 14 09:04:22.233031 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-41a030c3-b43d-4042-8206-49e0a44d194e tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:22.234618 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-41a030c3-b43d-4042-8206-49e0a44d194e tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] [instance: 900c4e61-76fe-472f-bba7-0c83895f62cf] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:22.248395 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-41a030c3-b43d-4042-8206-49e0a44d194e tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:22.250892 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-41a030c3-b43d-4042-8206-49e0a44d194e tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:22.251452 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-41a030c3-b43d-4042-8206-49e0a44d194e tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:22.252191 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-41a030c3-b43d-4042-8206-49e0a44d194e tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:22.252667 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-41a030c3-b43d-4042-8206-49e0a44d194e tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:22.253103 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-41a030c3-b43d-4042-8206-49e0a44d194e tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:22.585412 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-41a030c3-b43d-4042-8206-49e0a44d194e tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84afbf1d30574a7aa1186a481687c50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a90781147416fa5db6b8922209058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:22.596529 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-41a030c3-b43d-4042-8206-49e0a44d194e tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84afbf1d30574a7aa1186a481687c50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a90781147416fa5db6b8922209058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:22.598446 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-41a030c3-b43d-4042-8206-49e0a44d194e tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84afbf1d30574a7aa1186a481687c50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a90781147416fa5db6b8922209058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:22.600017 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-41a030c3-b43d-4042-8206-49e0a44d194e tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] 10.222.0.60 "GET /compute/v2.1/servers/900c4e61-76fe-472f-bba7-0c83895f62cf" status: 200 len: 1404 microversion: 2.54 time: 0.371929 Sep 14 09:04:22.600789 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1773/3587] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:04:22 2022] GET /compute/v2.1/servers/900c4e61-76fe-472f-bba7-0c83895f62cf => generated 1404 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:04:22.738908 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f1b1cc00-40c9-42ac-8eeb-8c157cc3493a tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:22.757175 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f1b1cc00-40c9-42ac-8eeb-8c157cc3493a tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: d9d9afd3-aeba-4429-a474-7c70a960d4e0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:22.783517 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f1b1cc00-40c9-42ac-8eeb-8c157cc3493a tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:22.788985 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f1b1cc00-40c9-42ac-8eeb-8c157cc3493a tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:22.791406 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f1b1cc00-40c9-42ac-8eeb-8c157cc3493a tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:22.793402 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f1b1cc00-40c9-42ac-8eeb-8c157cc3493a tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:22.796014 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f1b1cc00-40c9-42ac-8eeb-8c157cc3493a tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:22.796743 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f1b1cc00-40c9-42ac-8eeb-8c157cc3493a tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:22.812654 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-962761ca-cfb4-44c6-8c05-878de1e719a8 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504ea33de5724b518bcdf28076d6361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd19911fb94d47ab92893a3ec449fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:22.828908 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-962761ca-cfb4-44c6-8c05-878de1e719a8 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] 10.222.0.60 "GET /compute/v2.1/servers/2aefa743-500a-4cd6-b3d9-d1cf138ee1da" status: 200 len: 1320 microversion: 2.1 time: 0.718613 Sep 14 09:04:22.832176 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1815/3588] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:04:22 2022] GET /compute/v2.1/servers/2aefa743-500a-4cd6-b3d9-d1cf138ee1da => generated 1320 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:04:22.861067 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-f1b1cc00-40c9-42ac-8eeb-8c157cc3493a tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] HTTP exception thrown: Instance d9d9afd3-aeba-4429-a474-7c70a960d4e0 could not be found. Sep 14 09:04:22.870649 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f1b1cc00-40c9-42ac-8eeb-8c157cc3493a tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Request method failure captured: Sep 14 09:04:22.870649 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/d9d9afd3-aeba-4429-a474-7c70a960d4e0 HTTP/1.1 Sep 14 09:04:22.870649 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:04:22.870649 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:04:22.870649 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:04:22.870649 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:04:22.870649 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:04:22.870649 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:04:22.870649 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:04:22.870649 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:04:22.870649 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZfruMTQYBTAiiDSnzM1mYEpmuEj9qljISQOJ4EBe2ad6zsfFzAf8FVBubQCt-Sdr-zCKCq1jxjsj_azLMK_SQWZ09VXr62FV-261vpzTW6inln_93a6hl3DeVdX6cuYwx-Go-beMey4bY4s6iPFtULEKgIbxHUgjvgK1DEFOEvCwSQ Sep 14 09:04:22.870649 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:04:22.870649 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:04:22.870649 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:04:22.870649 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:04:22.870649 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:04:22.870649 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:04:22.870649 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 4d42bf4d573b4bf9a0d8c9e73260af7e Sep 14 09:04:22.870649 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-DeleteServersTestJSON-1669995002 Sep 14 09:04:22.870649 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:04:22.870649 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:04:22.870649 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/4d42bf4d573b4bf9a0d8c9e73260af7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_4d42bf4d573b4bf9a0d8c9e73260af7e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4d42bf4d573b4bf9a0d8c9e73260af7e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4d42bf4d573b4bf9a0d8c9e73260af7e"}]}] Sep 14 09:04:22.870649 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-DeleteServersTestJSON-1669995002 Sep 14 09:04:22.870649 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 4d42bf4d573b4bf9a0d8c9e73260af7e Sep 14 09:04:22.870649 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-DeleteServersTestJSON-1669995002 Sep 14 09:04:22.870649 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-DeleteServersTestJSON-1669995002-project Sep 14 09:04:22.870649 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:04:22.870649 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:04:22.870649 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 47c95b28481b451bb03fb2c0240d0310 Sep 14 09:04:22.870649 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-DeleteServersTestJSON-1669995002-project Sep 14 09:04:22.870649 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:04:22.870649 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance d9d9afd3-aeba-4429-a474-7c70a960d4e0 could not be found. Sep 14 09:04:22.870649 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': 'd9d9afd3-aeba-4429-a474-7c70a960d4e0'} Sep 14 09:04:22.870649 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:04:22.870649 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:04:22.870649 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:04:22.870649 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:04:22.870649 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:04:22.870649 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:04:22.870649 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:04:22.870649 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:04:22.870649 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:04:22.870649 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:04:22.870649 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9d9afd3-aeba-4429-a474-7c70a960d4e0 could not be found. Sep 14 09:04:22.870649 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:04:22.870649 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:04:22.870649 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:04:22.870649 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:04:22.870649 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:04:22.870649 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:04:22.870649 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:04:22.870649 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:04:22.870649 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:04:22.870649 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:04:22.870649 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:04:22.870649 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:04:22.870649 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:04:22.870649 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:04:22.870649 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:04:22.870649 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:04:22.870649 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9d9afd3-aeba-4429-a474-7c70a960d4e0 could not be found. Sep 14 09:04:22.870649 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:04:22.870649 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:04:22.870649 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:04:22.876296 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:04:22.876296 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:04:22.876296 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:04:22.876296 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:04:22.876296 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:04:22.876296 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9d9afd3-aeba-4429-a474-7c70a960d4e0 could not be found. Sep 14 09:04:22.876296 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:04:22.876296 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f1b1cc00-40c9-42ac-8eeb-8c157cc3493a tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Returning 404 to user: Instance d9d9afd3-aeba-4429-a474-7c70a960d4e0 could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:04:22.876296 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f1b1cc00-40c9-42ac-8eeb-8c157cc3493a tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/d9d9afd3-aeba-4429-a474-7c70a960d4e0" status: 404 len: 111 microversion: 2.1 time: 0.155144 Sep 14 09:04:22.885197 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1774/3589] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:04:22 2022] GET /compute/v2.1/servers/d9d9afd3-aeba-4429-a474-7c70a960d4e0 => generated 111 bytes in 170 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:04:22.888648 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-5b8f5914-4faf-4d98-a811-fce0ae296e47 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:22.889390 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-5b8f5914-4faf-4d98-a811-fce0ae296e47 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: d9d9afd3-aeba-4429-a474-7c70a960d4e0] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:22.905541 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5b8f5914-4faf-4d98-a811-fce0ae296e47 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:22.906385 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5b8f5914-4faf-4d98-a811-fce0ae296e47 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:22.908196 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5b8f5914-4faf-4d98-a811-fce0ae296e47 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:22.909322 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5b8f5914-4faf-4d98-a811-fce0ae296e47 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:22.910287 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5b8f5914-4faf-4d98-a811-fce0ae296e47 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:22.912967 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5b8f5914-4faf-4d98-a811-fce0ae296e47 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:22.952786 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-5b8f5914-4faf-4d98-a811-fce0ae296e47 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] HTTP exception thrown: Instance d9d9afd3-aeba-4429-a474-7c70a960d4e0 could not be found. Sep 14 09:04:22.956195 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-5b8f5914-4faf-4d98-a811-fce0ae296e47 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Request method failure captured: Sep 14 09:04:22.956195 n-d-836830-18 devstack@n-api.service[128758]: request: DELETE /compute/v2.1/servers/d9d9afd3-aeba-4429-a474-7c70a960d4e0 HTTP/1.1 Sep 14 09:04:22.956195 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 09:04:22.956195 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 09:04:22.956195 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 09:04:22.956195 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 09:04:22.956195 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 09:04:22.956195 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 09:04:22.956195 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 09:04:22.956195 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 09:04:22.956195 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZfruMTQYBTAiiDSnzM1mYEpmuEj9qljISQOJ4EBe2ad6zsfFzAf8FVBubQCt-Sdr-zCKCq1jxjsj_azLMK_SQWZ09VXr62FV-261vpzTW6inln_93a6hl3DeVdX6cuYwx-Go-beMey4bY4s6iPFtULEKgIbxHUgjvgK1DEFOEvCwSQ Sep 14 09:04:22.956195 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 09:04:22.956195 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 09:04:22.956195 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 09:04:22.956195 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 09:04:22.956195 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 09:04:22.956195 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 09:04:22.956195 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 4d42bf4d573b4bf9a0d8c9e73260af7e Sep 14 09:04:22.956195 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-DeleteServersTestJSON-1669995002 Sep 14 09:04:22.956195 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 09:04:22.956195 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 09:04:22.956195 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/4d42bf4d573b4bf9a0d8c9e73260af7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_4d42bf4d573b4bf9a0d8c9e73260af7e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4d42bf4d573b4bf9a0d8c9e73260af7e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4d42bf4d573b4bf9a0d8c9e73260af7e"}]}] Sep 14 09:04:22.956195 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-DeleteServersTestJSON-1669995002 Sep 14 09:04:22.956195 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 4d42bf4d573b4bf9a0d8c9e73260af7e Sep 14 09:04:22.956195 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-DeleteServersTestJSON-1669995002 Sep 14 09:04:22.956195 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-DeleteServersTestJSON-1669995002-project Sep 14 09:04:22.956195 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 09:04:22.956195 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 09:04:22.956195 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 47c95b28481b451bb03fb2c0240d0310 Sep 14 09:04:22.956195 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-DeleteServersTestJSON-1669995002-project Sep 14 09:04:22.956195 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 09:04:22.956195 n-d-836830-18 devstack@n-api.service[128758]: exception: Instance d9d9afd3-aeba-4429-a474-7c70a960d4e0 could not be found. Sep 14 09:04:22.956195 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': 'd9d9afd3-aeba-4429-a474-7c70a960d4e0'} Sep 14 09:04:22.956195 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:04:22.956195 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:04:22.956195 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:04:22.956195 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:04:22.956195 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:04:22.956195 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:04:22.956195 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:04:22.956195 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:04:22.956195 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:04:22.956195 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:04:22.956195 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9d9afd3-aeba-4429-a474-7c70a960d4e0 could not be found. Sep 14 09:04:22.956195 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:04:22.956195 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:04:22.956195 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:04:22.956195 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:04:22.956195 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:04:22.956195 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:04:22.956195 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:04:22.956195 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:04:22.956195 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:04:22.956195 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:04:22.956195 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 09:04:22.956195 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 09:04:22.956195 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 09:04:22.956195 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 09:04:22.956195 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:04:22.956195 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:04:22.956195 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:04:22.956195 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:04:22.961600 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9d9afd3-aeba-4429-a474-7c70a960d4e0 could not be found. Sep 14 09:04:22.961600 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:04:22.961600 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:04:22.961600 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:04:22.961600 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:04:22.961600 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:04:22.961600 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:04:22.961600 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:04:22.961600 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:04:22.961600 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9d9afd3-aeba-4429-a474-7c70a960d4e0 could not be found. Sep 14 09:04:22.961600 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:04:22.961600 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-5b8f5914-4faf-4d98-a811-fce0ae296e47 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Returning 404 to user: Instance d9d9afd3-aeba-4429-a474-7c70a960d4e0 could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:04:22.963246 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b7e266fb-b188-419e-a752-c0f6a5a59772 tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:22.963246 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b7e266fb-b188-419e-a752-c0f6a5a59772 tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] [instance: adbd193b-b0ae-40c1-97b5-7fbb9077942b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:22.963456 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-5b8f5914-4faf-4d98-a811-fce0ae296e47 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "DELETE /compute/v2.1/servers/d9d9afd3-aeba-4429-a474-7c70a960d4e0" status: 404 len: 111 microversion: 2.1 time: 0.075498 Sep 14 09:04:22.963456 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1816/3590] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:04:22 2022] DELETE /compute/v2.1/servers/d9d9afd3-aeba-4429-a474-7c70a960d4e0 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 14 09:04:22.978732 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b7e266fb-b188-419e-a752-c0f6a5a59772 tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:22.979877 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b7e266fb-b188-419e-a752-c0f6a5a59772 tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:22.980112 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-eae5e9e0-25fd-4276-a88b-77ddb02187d7 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:22.980344 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b7e266fb-b188-419e-a752-c0f6a5a59772 tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:22.981324 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b7e266fb-b188-419e-a752-c0f6a5a59772 tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:22.981797 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b7e266fb-b188-419e-a752-c0f6a5a59772 tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:22.982272 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-eae5e9e0-25fd-4276-a88b-77ddb02187d7 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: d9d9afd3-aeba-4429-a474-7c70a960d4e0] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:22.982585 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b7e266fb-b188-419e-a752-c0f6a5a59772 tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:23.001774 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-eae5e9e0-25fd-4276-a88b-77ddb02187d7 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:23.004676 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-eae5e9e0-25fd-4276-a88b-77ddb02187d7 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:23.005183 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-eae5e9e0-25fd-4276-a88b-77ddb02187d7 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:23.005994 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-eae5e9e0-25fd-4276-a88b-77ddb02187d7 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:23.006396 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-eae5e9e0-25fd-4276-a88b-77ddb02187d7 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:23.006848 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-eae5e9e0-25fd-4276-a88b-77ddb02187d7 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:23.043129 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-eae5e9e0-25fd-4276-a88b-77ddb02187d7 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] HTTP exception thrown: Instance d9d9afd3-aeba-4429-a474-7c70a960d4e0 could not be found. Sep 14 09:04:23.046005 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-eae5e9e0-25fd-4276-a88b-77ddb02187d7 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Request method failure captured: Sep 14 09:04:23.046005 n-d-836830-18 devstack@n-api.service[128758]: request: GET /compute/v2.1/servers/d9d9afd3-aeba-4429-a474-7c70a960d4e0 HTTP/1.1 Sep 14 09:04:23.046005 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 09:04:23.046005 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 09:04:23.046005 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 09:04:23.046005 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 09:04:23.046005 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 09:04:23.046005 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 09:04:23.046005 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 09:04:23.046005 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 09:04:23.046005 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZfruMTQYBTAiiDSnzM1mYEpmuEj9qljISQOJ4EBe2ad6zsfFzAf8FVBubQCt-Sdr-zCKCq1jxjsj_azLMK_SQWZ09VXr62FV-261vpzTW6inln_93a6hl3DeVdX6cuYwx-Go-beMey4bY4s6iPFtULEKgIbxHUgjvgK1DEFOEvCwSQ Sep 14 09:04:23.046005 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 09:04:23.046005 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 09:04:23.046005 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 09:04:23.046005 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 09:04:23.046005 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 09:04:23.046005 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 09:04:23.046005 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 4d42bf4d573b4bf9a0d8c9e73260af7e Sep 14 09:04:23.046005 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-DeleteServersTestJSON-1669995002 Sep 14 09:04:23.046005 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 09:04:23.046005 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 09:04:23.046005 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/4d42bf4d573b4bf9a0d8c9e73260af7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_4d42bf4d573b4bf9a0d8c9e73260af7e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4d42bf4d573b4bf9a0d8c9e73260af7e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4d42bf4d573b4bf9a0d8c9e73260af7e"}]}] Sep 14 09:04:23.046005 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-DeleteServersTestJSON-1669995002 Sep 14 09:04:23.046005 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 4d42bf4d573b4bf9a0d8c9e73260af7e Sep 14 09:04:23.046005 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-DeleteServersTestJSON-1669995002 Sep 14 09:04:23.046005 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-DeleteServersTestJSON-1669995002-project Sep 14 09:04:23.046005 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 09:04:23.046005 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 09:04:23.046005 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 47c95b28481b451bb03fb2c0240d0310 Sep 14 09:04:23.046005 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-DeleteServersTestJSON-1669995002-project Sep 14 09:04:23.046005 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 09:04:23.046005 n-d-836830-18 devstack@n-api.service[128758]: exception: Instance d9d9afd3-aeba-4429-a474-7c70a960d4e0 could not be found. Sep 14 09:04:23.046005 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': 'd9d9afd3-aeba-4429-a474-7c70a960d4e0'} Sep 14 09:04:23.046005 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:04:23.046005 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:04:23.046005 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:04:23.046005 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:04:23.046005 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:04:23.046005 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:04:23.046005 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:04:23.046005 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:04:23.046005 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:04:23.046005 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:04:23.046005 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9d9afd3-aeba-4429-a474-7c70a960d4e0 could not be found. Sep 14 09:04:23.046005 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:04:23.046005 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:04:23.046005 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:04:23.046005 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:04:23.046005 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:04:23.046005 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:04:23.046005 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:04:23.046005 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:04:23.046005 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:04:23.046005 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:04:23.046005 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:04:23.046005 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:04:23.046005 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:04:23.046005 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:04:23.046005 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:04:23.046005 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:04:23.046005 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9d9afd3-aeba-4429-a474-7c70a960d4e0 could not be found. Sep 14 09:04:23.046005 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:04:23.046005 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:04:23.046005 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:04:23.051256 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:04:23.051256 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:04:23.051256 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:04:23.051256 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:04:23.051256 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:04:23.051256 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9d9afd3-aeba-4429-a474-7c70a960d4e0 could not be found. Sep 14 09:04:23.051256 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:04:23.051256 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-eae5e9e0-25fd-4276-a88b-77ddb02187d7 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Returning 404 to user: Instance d9d9afd3-aeba-4429-a474-7c70a960d4e0 could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:04:23.051256 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-eae5e9e0-25fd-4276-a88b-77ddb02187d7 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/d9d9afd3-aeba-4429-a474-7c70a960d4e0" status: 404 len: 111 microversion: 2.1 time: 0.082560 Sep 14 09:04:23.051256 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1817/3591] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:04:22 2022] GET /compute/v2.1/servers/d9d9afd3-aeba-4429-a474-7c70a960d4e0 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:04:23.058720 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-dd94de73-c434-410e-9c9c-9790f9d6ceb1 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:23.059354 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-dd94de73-c434-410e-9c9c-9790f9d6ceb1 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: 56742f27-4436-4fc3-b7a5-9d337395b7d3] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:23.069680 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dd94de73-c434-410e-9c9c-9790f9d6ceb1 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:23.070315 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dd94de73-c434-410e-9c9c-9790f9d6ceb1 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:23.070871 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dd94de73-c434-410e-9c9c-9790f9d6ceb1 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:23.071840 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dd94de73-c434-410e-9c9c-9790f9d6ceb1 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:23.072571 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dd94de73-c434-410e-9c9c-9790f9d6ceb1 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:23.073326 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dd94de73-c434-410e-9c9c-9790f9d6ceb1 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:23.118025 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-dd94de73-c434-410e-9c9c-9790f9d6ceb1 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] HTTP exception thrown: Instance 56742f27-4436-4fc3-b7a5-9d337395b7d3 could not be found. Sep 14 09:04:23.121546 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-dd94de73-c434-410e-9c9c-9790f9d6ceb1 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Request method failure captured: Sep 14 09:04:23.121546 n-d-836830-18 devstack@n-api.service[128758]: request: DELETE /compute/v2.1/servers/56742f27-4436-4fc3-b7a5-9d337395b7d3 HTTP/1.1 Sep 14 09:04:23.121546 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 09:04:23.121546 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 09:04:23.121546 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 09:04:23.121546 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 09:04:23.121546 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 09:04:23.121546 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 09:04:23.121546 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 09:04:23.121546 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 09:04:23.121546 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZfruMTQYBTAiiDSnzM1mYEpmuEj9qljISQOJ4EBe2ad6zsfFzAf8FVBubQCt-Sdr-zCKCq1jxjsj_azLMK_SQWZ09VXr62FV-261vpzTW6inln_93a6hl3DeVdX6cuYwx-Go-beMey4bY4s6iPFtULEKgIbxHUgjvgK1DEFOEvCwSQ Sep 14 09:04:23.121546 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 09:04:23.121546 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 09:04:23.121546 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 09:04:23.121546 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 09:04:23.121546 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 09:04:23.121546 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 09:04:23.121546 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 4d42bf4d573b4bf9a0d8c9e73260af7e Sep 14 09:04:23.121546 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-DeleteServersTestJSON-1669995002 Sep 14 09:04:23.121546 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 09:04:23.121546 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 09:04:23.121546 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/4d42bf4d573b4bf9a0d8c9e73260af7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_4d42bf4d573b4bf9a0d8c9e73260af7e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4d42bf4d573b4bf9a0d8c9e73260af7e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4d42bf4d573b4bf9a0d8c9e73260af7e"}]}] Sep 14 09:04:23.121546 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-DeleteServersTestJSON-1669995002 Sep 14 09:04:23.121546 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 4d42bf4d573b4bf9a0d8c9e73260af7e Sep 14 09:04:23.121546 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-DeleteServersTestJSON-1669995002 Sep 14 09:04:23.121546 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-DeleteServersTestJSON-1669995002-project Sep 14 09:04:23.121546 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 09:04:23.121546 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 09:04:23.121546 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 47c95b28481b451bb03fb2c0240d0310 Sep 14 09:04:23.121546 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-DeleteServersTestJSON-1669995002-project Sep 14 09:04:23.121546 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 09:04:23.121546 n-d-836830-18 devstack@n-api.service[128758]: exception: Instance 56742f27-4436-4fc3-b7a5-9d337395b7d3 could not be found. Sep 14 09:04:23.121546 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': '56742f27-4436-4fc3-b7a5-9d337395b7d3'} Sep 14 09:04:23.121546 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:04:23.121546 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:04:23.121546 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:04:23.121546 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:04:23.121546 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:04:23.121546 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:04:23.121546 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:04:23.121546 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:04:23.121546 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:04:23.121546 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:04:23.121546 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56742f27-4436-4fc3-b7a5-9d337395b7d3 could not be found. Sep 14 09:04:23.121546 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:04:23.121546 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:04:23.121546 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:04:23.121546 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:04:23.121546 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:04:23.121546 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:04:23.121546 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:04:23.121546 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:04:23.121546 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:04:23.121546 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:04:23.121546 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 09:04:23.121546 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 09:04:23.121546 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 09:04:23.121546 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 09:04:23.121546 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:04:23.121546 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:04:23.121546 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:04:23.121546 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:04:23.127097 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56742f27-4436-4fc3-b7a5-9d337395b7d3 could not be found. Sep 14 09:04:23.127097 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:04:23.127097 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:04:23.127097 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:04:23.127097 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:04:23.127097 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:04:23.127097 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:04:23.127097 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:04:23.127097 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:04:23.127097 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56742f27-4436-4fc3-b7a5-9d337395b7d3 could not be found. Sep 14 09:04:23.127097 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:04:23.136283 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-dd94de73-c434-410e-9c9c-9790f9d6ceb1 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Returning 404 to user: Instance 56742f27-4436-4fc3-b7a5-9d337395b7d3 could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:04:23.143961 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-dd94de73-c434-410e-9c9c-9790f9d6ceb1 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "DELETE /compute/v2.1/servers/56742f27-4436-4fc3-b7a5-9d337395b7d3" status: 404 len: 111 microversion: 2.1 time: 0.089585 Sep 14 09:04:23.150784 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1818/3592] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:04:23 2022] DELETE /compute/v2.1/servers/56742f27-4436-4fc3-b7a5-9d337395b7d3 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:04:23.161302 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-dbb46c6d-adae-48ad-a12b-db5217c2d52a tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:23.162052 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-dbb46c6d-adae-48ad-a12b-db5217c2d52a tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] [instance: fcc183e1-b880-4005-bb3e-90ab91ed7911] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:23.170600 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dbb46c6d-adae-48ad-a12b-db5217c2d52a tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:23.171413 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dbb46c6d-adae-48ad-a12b-db5217c2d52a tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:23.171871 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dbb46c6d-adae-48ad-a12b-db5217c2d52a tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:23.172892 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dbb46c6d-adae-48ad-a12b-db5217c2d52a tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:23.173702 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dbb46c6d-adae-48ad-a12b-db5217c2d52a tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:23.174156 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dbb46c6d-adae-48ad-a12b-db5217c2d52a tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:23.796082 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b7e266fb-b188-419e-a752-c0f6a5a59772 tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebe0be597a44e0bad22fbcf5c9249d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49345e5148f4d7aae1488e735c76590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:23.808848 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b7e266fb-b188-419e-a752-c0f6a5a59772 tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] 10.222.0.60 "GET /compute/v2.1/servers/adbd193b-b0ae-40c1-97b5-7fbb9077942b" status: 200 len: 1283 microversion: 2.1 time: 0.860532 Sep 14 09:04:23.809457 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1775/3593] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:04:22 2022] GET /compute/v2.1/servers/adbd193b-b0ae-40c1-97b5-7fbb9077942b => generated 1283 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:04:24.084413 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-dbb46c6d-adae-48ad-a12b-db5217c2d52a tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6b965ba7c340f190f9cafc69e46748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b304cd14b65640dab95dc8926eb90818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:24.098385 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-dbb46c6d-adae-48ad-a12b-db5217c2d52a tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6b965ba7c340f190f9cafc69e46748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b304cd14b65640dab95dc8926eb90818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:24.105172 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-dbb46c6d-adae-48ad-a12b-db5217c2d52a tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6b965ba7c340f190f9cafc69e46748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b304cd14b65640dab95dc8926eb90818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:24.108631 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-dbb46c6d-adae-48ad-a12b-db5217c2d52a tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] 10.222.0.60 "GET /compute/v2.1/servers/fcc183e1-b880-4005-bb3e-90ab91ed7911" status: 200 len: 1366 microversion: 2.57 time: 0.954685 Sep 14 09:04:24.112425 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1819/3594] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:04:23 2022] GET /compute/v2.1/servers/fcc183e1-b880-4005-bb3e-90ab91ed7911 => generated 1366 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:04:24.122726 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-cd290067-7463-41a6-a101-05f954b1549d tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:24.123397 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-cd290067-7463-41a6-a101-05f954b1549d tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] [instance: 900c4e61-76fe-472f-bba7-0c83895f62cf] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:24.143541 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cd290067-7463-41a6-a101-05f954b1549d tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:24.144070 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cd290067-7463-41a6-a101-05f954b1549d tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:24.144801 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cd290067-7463-41a6-a101-05f954b1549d tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:24.146858 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cd290067-7463-41a6-a101-05f954b1549d tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:24.148295 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cd290067-7463-41a6-a101-05f954b1549d tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:24.149164 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cd290067-7463-41a6-a101-05f954b1549d tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:24.367143 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b8c720d7-45dd-4403-8ad3-a106876a397e tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:24.367973 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b8c720d7-45dd-4403-8ad3-a106876a397e tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: 56742f27-4436-4fc3-b7a5-9d337395b7d3] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:24.382260 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b8c720d7-45dd-4403-8ad3-a106876a397e tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:24.383299 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b8c720d7-45dd-4403-8ad3-a106876a397e tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:24.384709 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b8c720d7-45dd-4403-8ad3-a106876a397e tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:24.386298 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b8c720d7-45dd-4403-8ad3-a106876a397e tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:24.388225 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b8c720d7-45dd-4403-8ad3-a106876a397e tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:24.388975 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b8c720d7-45dd-4403-8ad3-a106876a397e tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:24.401113 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-cd290067-7463-41a6-a101-05f954b1549d tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84afbf1d30574a7aa1186a481687c50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a90781147416fa5db6b8922209058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:24.420943 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-cd290067-7463-41a6-a101-05f954b1549d tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84afbf1d30574a7aa1186a481687c50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a90781147416fa5db6b8922209058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:24.423754 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-cd290067-7463-41a6-a101-05f954b1549d tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84afbf1d30574a7aa1186a481687c50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a90781147416fa5db6b8922209058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:24.426332 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-cd290067-7463-41a6-a101-05f954b1549d tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] 10.222.0.60 "GET /compute/v2.1/servers/900c4e61-76fe-472f-bba7-0c83895f62cf" status: 200 len: 1404 microversion: 2.54 time: 0.312621 Sep 14 09:04:24.428663 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1820/3595] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:04:24 2022] GET /compute/v2.1/servers/900c4e61-76fe-472f-bba7-0c83895f62cf => generated 1404 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:04:24.434828 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-be637527-1930-49bf-99ab-fb1fe1f49eaf tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:24.435606 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-be637527-1930-49bf-99ab-fb1fe1f49eaf tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] [instance: 2aefa743-500a-4cd6-b3d9-d1cf138ee1da] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:24.452245 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-be637527-1930-49bf-99ab-fb1fe1f49eaf tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:24.453887 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-be637527-1930-49bf-99ab-fb1fe1f49eaf tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:24.456295 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-be637527-1930-49bf-99ab-fb1fe1f49eaf tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:24.456734 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-b8c720d7-45dd-4403-8ad3-a106876a397e tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] HTTP exception thrown: Instance 56742f27-4436-4fc3-b7a5-9d337395b7d3 could not be found. Sep 14 09:04:24.457619 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-be637527-1930-49bf-99ab-fb1fe1f49eaf tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:24.459048 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-be637527-1930-49bf-99ab-fb1fe1f49eaf tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:24.462880 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-be637527-1930-49bf-99ab-fb1fe1f49eaf tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:24.474493 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b8c720d7-45dd-4403-8ad3-a106876a397e tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Request method failure captured: Sep 14 09:04:24.474493 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/56742f27-4436-4fc3-b7a5-9d337395b7d3 HTTP/1.1 Sep 14 09:04:24.474493 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:04:24.474493 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:04:24.474493 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:04:24.474493 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:04:24.474493 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:04:24.474493 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:04:24.474493 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:04:24.474493 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:04:24.474493 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZfruMTQYBTAiiDSnzM1mYEpmuEj9qljISQOJ4EBe2ad6zsfFzAf8FVBubQCt-Sdr-zCKCq1jxjsj_azLMK_SQWZ09VXr62FV-261vpzTW6inln_93a6hl3DeVdX6cuYwx-Go-beMey4bY4s6iPFtULEKgIbxHUgjvgK1DEFOEvCwSQ Sep 14 09:04:24.474493 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:04:24.474493 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:04:24.474493 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:04:24.474493 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:04:24.474493 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:04:24.474493 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:04:24.474493 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 4d42bf4d573b4bf9a0d8c9e73260af7e Sep 14 09:04:24.474493 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-DeleteServersTestJSON-1669995002 Sep 14 09:04:24.474493 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:04:24.474493 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:04:24.474493 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/4d42bf4d573b4bf9a0d8c9e73260af7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_4d42bf4d573b4bf9a0d8c9e73260af7e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4d42bf4d573b4bf9a0d8c9e73260af7e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4d42bf4d573b4bf9a0d8c9e73260af7e"}]}] Sep 14 09:04:24.474493 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-DeleteServersTestJSON-1669995002 Sep 14 09:04:24.474493 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 4d42bf4d573b4bf9a0d8c9e73260af7e Sep 14 09:04:24.474493 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-DeleteServersTestJSON-1669995002 Sep 14 09:04:24.474493 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-DeleteServersTestJSON-1669995002-project Sep 14 09:04:24.474493 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:04:24.474493 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:04:24.474493 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 47c95b28481b451bb03fb2c0240d0310 Sep 14 09:04:24.474493 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-DeleteServersTestJSON-1669995002-project Sep 14 09:04:24.474493 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:04:24.474493 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance 56742f27-4436-4fc3-b7a5-9d337395b7d3 could not be found. Sep 14 09:04:24.474493 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '56742f27-4436-4fc3-b7a5-9d337395b7d3'} Sep 14 09:04:24.474493 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:04:24.474493 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:04:24.474493 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:04:24.474493 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:04:24.474493 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:04:24.474493 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:04:24.474493 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:04:24.474493 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:04:24.474493 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:04:24.474493 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:04:24.474493 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56742f27-4436-4fc3-b7a5-9d337395b7d3 could not be found. Sep 14 09:04:24.474493 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:04:24.474493 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:04:24.474493 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:04:24.474493 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:04:24.474493 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:04:24.474493 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:04:24.474493 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:04:24.474493 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:04:24.474493 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:04:24.474493 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:04:24.474493 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:04:24.474493 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:04:24.474493 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:04:24.474493 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:04:24.474493 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:04:24.474493 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:04:24.474493 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56742f27-4436-4fc3-b7a5-9d337395b7d3 could not be found. Sep 14 09:04:24.474493 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:04:24.474493 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:04:24.474493 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:04:24.484884 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:04:24.484884 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:04:24.484884 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:04:24.484884 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:04:24.484884 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:04:24.484884 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56742f27-4436-4fc3-b7a5-9d337395b7d3 could not be found. Sep 14 09:04:24.484884 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:04:24.484884 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b8c720d7-45dd-4403-8ad3-a106876a397e tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Returning 404 to user: Instance 56742f27-4436-4fc3-b7a5-9d337395b7d3 could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:04:24.484884 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b8c720d7-45dd-4403-8ad3-a106876a397e tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/56742f27-4436-4fc3-b7a5-9d337395b7d3" status: 404 len: 111 microversion: 2.1 time: 0.663741 Sep 14 09:04:24.486851 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1776/3596] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:04:23 2022] GET /compute/v2.1/servers/56742f27-4436-4fc3-b7a5-9d337395b7d3 => generated 111 bytes in 674 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:04:24.501662 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-571d4858-9f92-40cb-8f28-89f9719f9c43 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:24.502424 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-571d4858-9f92-40cb-8f28-89f9719f9c43 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: 680c3968-8912-45c4-b1c3-634c06ec30c3] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:24.520189 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-571d4858-9f92-40cb-8f28-89f9719f9c43 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:24.520785 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-571d4858-9f92-40cb-8f28-89f9719f9c43 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:24.521301 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-571d4858-9f92-40cb-8f28-89f9719f9c43 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:24.522082 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-571d4858-9f92-40cb-8f28-89f9719f9c43 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:24.522632 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-571d4858-9f92-40cb-8f28-89f9719f9c43 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:24.523173 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-571d4858-9f92-40cb-8f28-89f9719f9c43 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:24.541729 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-571d4858-9f92-40cb-8f28-89f9719f9c43 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] HTTP exception thrown: Instance 680c3968-8912-45c4-b1c3-634c06ec30c3 could not be found. Sep 14 09:04:24.543696 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-571d4858-9f92-40cb-8f28-89f9719f9c43 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Request method failure captured: Sep 14 09:04:24.543696 n-d-836830-18 devstack@n-api.service[128759]: request: DELETE /compute/v2.1/servers/680c3968-8912-45c4-b1c3-634c06ec30c3 HTTP/1.1 Sep 14 09:04:24.543696 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:04:24.543696 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:04:24.543696 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:04:24.543696 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:04:24.543696 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:04:24.543696 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:04:24.543696 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:04:24.543696 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:04:24.543696 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZfruMTQYBTAiiDSnzM1mYEpmuEj9qljISQOJ4EBe2ad6zsfFzAf8FVBubQCt-Sdr-zCKCq1jxjsj_azLMK_SQWZ09VXr62FV-261vpzTW6inln_93a6hl3DeVdX6cuYwx-Go-beMey4bY4s6iPFtULEKgIbxHUgjvgK1DEFOEvCwSQ Sep 14 09:04:24.543696 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:04:24.543696 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:04:24.543696 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:04:24.543696 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:04:24.543696 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:04:24.543696 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:04:24.543696 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 4d42bf4d573b4bf9a0d8c9e73260af7e Sep 14 09:04:24.543696 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-DeleteServersTestJSON-1669995002 Sep 14 09:04:24.543696 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:04:24.543696 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:04:24.543696 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/4d42bf4d573b4bf9a0d8c9e73260af7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_4d42bf4d573b4bf9a0d8c9e73260af7e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4d42bf4d573b4bf9a0d8c9e73260af7e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4d42bf4d573b4bf9a0d8c9e73260af7e"}]}] Sep 14 09:04:24.543696 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-DeleteServersTestJSON-1669995002 Sep 14 09:04:24.543696 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 4d42bf4d573b4bf9a0d8c9e73260af7e Sep 14 09:04:24.543696 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-DeleteServersTestJSON-1669995002 Sep 14 09:04:24.543696 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-DeleteServersTestJSON-1669995002-project Sep 14 09:04:24.543696 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:04:24.543696 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:04:24.543696 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 47c95b28481b451bb03fb2c0240d0310 Sep 14 09:04:24.543696 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-DeleteServersTestJSON-1669995002-project Sep 14 09:04:24.543696 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:04:24.543696 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance 680c3968-8912-45c4-b1c3-634c06ec30c3 could not be found. Sep 14 09:04:24.543696 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '680c3968-8912-45c4-b1c3-634c06ec30c3'} Sep 14 09:04:24.543696 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:04:24.543696 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:04:24.543696 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:04:24.543696 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:04:24.543696 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:04:24.543696 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:04:24.543696 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:04:24.543696 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:04:24.543696 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:04:24.543696 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:04:24.543696 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 680c3968-8912-45c4-b1c3-634c06ec30c3 could not be found. Sep 14 09:04:24.543696 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:04:24.543696 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:04:24.543696 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:04:24.543696 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:04:24.543696 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:04:24.543696 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:04:24.543696 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:04:24.543696 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:04:24.543696 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:04:24.543696 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:04:24.543696 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 09:04:24.543696 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 09:04:24.543696 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 09:04:24.543696 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 09:04:24.543696 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:04:24.543696 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:04:24.543696 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:04:24.543696 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:04:24.549640 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 680c3968-8912-45c4-b1c3-634c06ec30c3 could not be found. Sep 14 09:04:24.549640 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:04:24.549640 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:04:24.549640 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:04:24.549640 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:04:24.549640 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:04:24.549640 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:04:24.549640 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:04:24.549640 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:04:24.549640 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 680c3968-8912-45c4-b1c3-634c06ec30c3 could not be found. Sep 14 09:04:24.549640 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:04:24.549640 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-571d4858-9f92-40cb-8f28-89f9719f9c43 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Returning 404 to user: Instance 680c3968-8912-45c4-b1c3-634c06ec30c3 could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:04:24.549640 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-571d4858-9f92-40cb-8f28-89f9719f9c43 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "DELETE /compute/v2.1/servers/680c3968-8912-45c4-b1c3-634c06ec30c3" status: 404 len: 111 microversion: 2.1 time: 0.056225 Sep 14 09:04:24.549640 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1777/3597] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:04:24 2022] DELETE /compute/v2.1/servers/680c3968-8912-45c4-b1c3-634c06ec30c3 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:04:24.584794 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d4e44635-78b6-442c-b144-7625a3f3c7c0 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:24.589731 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-d4e44635-78b6-442c-b144-7625a3f3c7c0 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: 680c3968-8912-45c4-b1c3-634c06ec30c3] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:24.600682 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d4e44635-78b6-442c-b144-7625a3f3c7c0 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:24.601640 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d4e44635-78b6-442c-b144-7625a3f3c7c0 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:24.602323 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d4e44635-78b6-442c-b144-7625a3f3c7c0 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:24.604203 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d4e44635-78b6-442c-b144-7625a3f3c7c0 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:24.605097 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d4e44635-78b6-442c-b144-7625a3f3c7c0 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:24.605797 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d4e44635-78b6-442c-b144-7625a3f3c7c0 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:24.627292 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-d4e44635-78b6-442c-b144-7625a3f3c7c0 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] HTTP exception thrown: Instance 680c3968-8912-45c4-b1c3-634c06ec30c3 could not be found. Sep 14 09:04:24.629536 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d4e44635-78b6-442c-b144-7625a3f3c7c0 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Request method failure captured: Sep 14 09:04:24.629536 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/680c3968-8912-45c4-b1c3-634c06ec30c3 HTTP/1.1 Sep 14 09:04:24.629536 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:04:24.629536 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:04:24.629536 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:04:24.629536 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:04:24.629536 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:04:24.629536 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:04:24.629536 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:04:24.629536 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:04:24.629536 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZfruMTQYBTAiiDSnzM1mYEpmuEj9qljISQOJ4EBe2ad6zsfFzAf8FVBubQCt-Sdr-zCKCq1jxjsj_azLMK_SQWZ09VXr62FV-261vpzTW6inln_93a6hl3DeVdX6cuYwx-Go-beMey4bY4s6iPFtULEKgIbxHUgjvgK1DEFOEvCwSQ Sep 14 09:04:24.629536 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:04:24.629536 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:04:24.629536 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:04:24.629536 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:04:24.629536 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:04:24.629536 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:04:24.629536 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 4d42bf4d573b4bf9a0d8c9e73260af7e Sep 14 09:04:24.629536 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-DeleteServersTestJSON-1669995002 Sep 14 09:04:24.629536 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:04:24.629536 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:04:24.629536 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/4d42bf4d573b4bf9a0d8c9e73260af7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_4d42bf4d573b4bf9a0d8c9e73260af7e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4d42bf4d573b4bf9a0d8c9e73260af7e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4d42bf4d573b4bf9a0d8c9e73260af7e"}]}] Sep 14 09:04:24.629536 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-DeleteServersTestJSON-1669995002 Sep 14 09:04:24.629536 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 4d42bf4d573b4bf9a0d8c9e73260af7e Sep 14 09:04:24.629536 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-DeleteServersTestJSON-1669995002 Sep 14 09:04:24.629536 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-DeleteServersTestJSON-1669995002-project Sep 14 09:04:24.629536 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:04:24.629536 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:04:24.629536 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 47c95b28481b451bb03fb2c0240d0310 Sep 14 09:04:24.629536 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-DeleteServersTestJSON-1669995002-project Sep 14 09:04:24.629536 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:04:24.629536 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance 680c3968-8912-45c4-b1c3-634c06ec30c3 could not be found. Sep 14 09:04:24.629536 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '680c3968-8912-45c4-b1c3-634c06ec30c3'} Sep 14 09:04:24.629536 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:04:24.629536 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:04:24.629536 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:04:24.629536 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:04:24.629536 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:04:24.629536 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:04:24.629536 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:04:24.629536 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:04:24.629536 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:04:24.629536 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:04:24.629536 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 680c3968-8912-45c4-b1c3-634c06ec30c3 could not be found. Sep 14 09:04:24.629536 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:04:24.629536 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:04:24.629536 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:04:24.629536 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:04:24.629536 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:04:24.629536 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:04:24.629536 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:04:24.629536 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:04:24.629536 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:04:24.629536 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:04:24.629536 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:04:24.629536 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:04:24.629536 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:04:24.629536 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:04:24.629536 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:04:24.629536 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:04:24.629536 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 680c3968-8912-45c4-b1c3-634c06ec30c3 could not be found. Sep 14 09:04:24.629536 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:04:24.629536 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:04:24.629536 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:04:24.634671 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:04:24.634671 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:04:24.634671 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:04:24.634671 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:04:24.634671 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:04:24.634671 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 680c3968-8912-45c4-b1c3-634c06ec30c3 could not be found. Sep 14 09:04:24.634671 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:04:24.636745 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d4e44635-78b6-442c-b144-7625a3f3c7c0 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Returning 404 to user: Instance 680c3968-8912-45c4-b1c3-634c06ec30c3 could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:04:24.637914 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d4e44635-78b6-442c-b144-7625a3f3c7c0 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/680c3968-8912-45c4-b1c3-634c06ec30c3" status: 404 len: 111 microversion: 2.1 time: 0.085976 Sep 14 09:04:24.642595 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1778/3598] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:04:24 2022] GET /compute/v2.1/servers/680c3968-8912-45c4-b1c3-634c06ec30c3 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:04:24.647895 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9769d1da-a48b-4e2e-9fae-89b974b46b04 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:24.648963 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-9769d1da-a48b-4e2e-9fae-89b974b46b04 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: e6001579-7f6f-4a6b-ada0-d301a142f96b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:24.656873 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9769d1da-a48b-4e2e-9fae-89b974b46b04 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:24.657874 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9769d1da-a48b-4e2e-9fae-89b974b46b04 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:24.658741 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9769d1da-a48b-4e2e-9fae-89b974b46b04 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:24.660023 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9769d1da-a48b-4e2e-9fae-89b974b46b04 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:24.661211 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9769d1da-a48b-4e2e-9fae-89b974b46b04 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:24.661918 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9769d1da-a48b-4e2e-9fae-89b974b46b04 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:24.722752 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-9769d1da-a48b-4e2e-9fae-89b974b46b04 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] HTTP exception thrown: Instance e6001579-7f6f-4a6b-ada0-d301a142f96b could not be found. Sep 14 09:04:24.727657 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9769d1da-a48b-4e2e-9fae-89b974b46b04 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Request method failure captured: Sep 14 09:04:24.727657 n-d-836830-18 devstack@n-api.service[128759]: request: DELETE /compute/v2.1/servers/e6001579-7f6f-4a6b-ada0-d301a142f96b HTTP/1.1 Sep 14 09:04:24.727657 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:04:24.727657 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:04:24.727657 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:04:24.727657 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:04:24.727657 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:04:24.727657 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:04:24.727657 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:04:24.727657 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:04:24.727657 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZfruMTQYBTAiiDSnzM1mYEpmuEj9qljISQOJ4EBe2ad6zsfFzAf8FVBubQCt-Sdr-zCKCq1jxjsj_azLMK_SQWZ09VXr62FV-261vpzTW6inln_93a6hl3DeVdX6cuYwx-Go-beMey4bY4s6iPFtULEKgIbxHUgjvgK1DEFOEvCwSQ Sep 14 09:04:24.727657 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:04:24.727657 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:04:24.727657 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:04:24.727657 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:04:24.727657 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:04:24.727657 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:04:24.727657 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 4d42bf4d573b4bf9a0d8c9e73260af7e Sep 14 09:04:24.727657 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-DeleteServersTestJSON-1669995002 Sep 14 09:04:24.727657 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:04:24.727657 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:04:24.727657 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/4d42bf4d573b4bf9a0d8c9e73260af7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_4d42bf4d573b4bf9a0d8c9e73260af7e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4d42bf4d573b4bf9a0d8c9e73260af7e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4d42bf4d573b4bf9a0d8c9e73260af7e"}]}] Sep 14 09:04:24.727657 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-DeleteServersTestJSON-1669995002 Sep 14 09:04:24.727657 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 4d42bf4d573b4bf9a0d8c9e73260af7e Sep 14 09:04:24.727657 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-DeleteServersTestJSON-1669995002 Sep 14 09:04:24.727657 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-DeleteServersTestJSON-1669995002-project Sep 14 09:04:24.727657 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:04:24.727657 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:04:24.727657 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 47c95b28481b451bb03fb2c0240d0310 Sep 14 09:04:24.727657 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-DeleteServersTestJSON-1669995002-project Sep 14 09:04:24.727657 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:04:24.727657 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance e6001579-7f6f-4a6b-ada0-d301a142f96b could not be found. Sep 14 09:04:24.727657 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': 'e6001579-7f6f-4a6b-ada0-d301a142f96b'} Sep 14 09:04:24.727657 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:04:24.727657 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:04:24.727657 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:04:24.727657 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:04:24.727657 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:04:24.727657 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:04:24.727657 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:04:24.727657 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:04:24.727657 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:04:24.727657 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:04:24.727657 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6001579-7f6f-4a6b-ada0-d301a142f96b could not be found. Sep 14 09:04:24.727657 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:04:24.727657 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:04:24.727657 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:04:24.727657 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:04:24.727657 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:04:24.727657 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:04:24.727657 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:04:24.727657 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:04:24.727657 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:04:24.727657 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:04:24.727657 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 09:04:24.727657 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 09:04:24.727657 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 09:04:24.727657 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 09:04:24.727657 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:04:24.727657 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:04:24.727657 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:04:24.727657 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:04:24.733571 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6001579-7f6f-4a6b-ada0-d301a142f96b could not be found. Sep 14 09:04:24.733571 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:04:24.733571 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:04:24.733571 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:04:24.733571 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:04:24.733571 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:04:24.733571 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:04:24.733571 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:04:24.733571 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:04:24.733571 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6001579-7f6f-4a6b-ada0-d301a142f96b could not be found. Sep 14 09:04:24.733571 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:04:24.751937 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9769d1da-a48b-4e2e-9fae-89b974b46b04 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Returning 404 to user: Instance e6001579-7f6f-4a6b-ada0-d301a142f96b could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:04:24.755374 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-9769d1da-a48b-4e2e-9fae-89b974b46b04 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "DELETE /compute/v2.1/servers/e6001579-7f6f-4a6b-ada0-d301a142f96b" status: 404 len: 111 microversion: 2.1 time: 0.109013 Sep 14 09:04:24.761256 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1779/3599] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:04:24 2022] DELETE /compute/v2.1/servers/e6001579-7f6f-4a6b-ada0-d301a142f96b => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:04:24.768899 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f23b60c9-5bfd-4131-99ba-33fdcc399f18 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:24.775670 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f23b60c9-5bfd-4131-99ba-33fdcc399f18 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: e6001579-7f6f-4a6b-ada0-d301a142f96b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:24.791509 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f23b60c9-5bfd-4131-99ba-33fdcc399f18 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:24.792014 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f23b60c9-5bfd-4131-99ba-33fdcc399f18 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:24.792459 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f23b60c9-5bfd-4131-99ba-33fdcc399f18 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:24.793177 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f23b60c9-5bfd-4131-99ba-33fdcc399f18 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:24.793634 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f23b60c9-5bfd-4131-99ba-33fdcc399f18 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:24.796568 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f23b60c9-5bfd-4131-99ba-33fdcc399f18 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:24.839626 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-f23b60c9-5bfd-4131-99ba-33fdcc399f18 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] HTTP exception thrown: Instance e6001579-7f6f-4a6b-ada0-d301a142f96b could not be found. Sep 14 09:04:24.842806 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f23b60c9-5bfd-4131-99ba-33fdcc399f18 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Request method failure captured: Sep 14 09:04:24.842806 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/e6001579-7f6f-4a6b-ada0-d301a142f96b HTTP/1.1 Sep 14 09:04:24.842806 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:04:24.842806 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:04:24.842806 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:04:24.842806 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:04:24.842806 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:04:24.842806 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:04:24.842806 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:04:24.842806 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:04:24.842806 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZfruMTQYBTAiiDSnzM1mYEpmuEj9qljISQOJ4EBe2ad6zsfFzAf8FVBubQCt-Sdr-zCKCq1jxjsj_azLMK_SQWZ09VXr62FV-261vpzTW6inln_93a6hl3DeVdX6cuYwx-Go-beMey4bY4s6iPFtULEKgIbxHUgjvgK1DEFOEvCwSQ Sep 14 09:04:24.842806 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:04:24.842806 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:04:24.842806 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:04:24.842806 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:04:24.842806 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:04:24.842806 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:04:24.842806 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 4d42bf4d573b4bf9a0d8c9e73260af7e Sep 14 09:04:24.842806 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-DeleteServersTestJSON-1669995002 Sep 14 09:04:24.842806 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:04:24.842806 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:04:24.842806 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/4d42bf4d573b4bf9a0d8c9e73260af7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_4d42bf4d573b4bf9a0d8c9e73260af7e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4d42bf4d573b4bf9a0d8c9e73260af7e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4d42bf4d573b4bf9a0d8c9e73260af7e"}]}] Sep 14 09:04:24.842806 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-DeleteServersTestJSON-1669995002 Sep 14 09:04:24.842806 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 4d42bf4d573b4bf9a0d8c9e73260af7e Sep 14 09:04:24.842806 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-DeleteServersTestJSON-1669995002 Sep 14 09:04:24.842806 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-DeleteServersTestJSON-1669995002-project Sep 14 09:04:24.842806 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:04:24.842806 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:04:24.842806 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 47c95b28481b451bb03fb2c0240d0310 Sep 14 09:04:24.842806 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-DeleteServersTestJSON-1669995002-project Sep 14 09:04:24.842806 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:04:24.842806 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance e6001579-7f6f-4a6b-ada0-d301a142f96b could not be found. Sep 14 09:04:24.842806 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': 'e6001579-7f6f-4a6b-ada0-d301a142f96b'} Sep 14 09:04:24.842806 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:04:24.842806 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:04:24.842806 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:04:24.842806 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:04:24.842806 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:04:24.842806 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:04:24.842806 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:04:24.842806 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:04:24.842806 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:04:24.842806 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:04:24.842806 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6001579-7f6f-4a6b-ada0-d301a142f96b could not be found. Sep 14 09:04:24.842806 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:04:24.842806 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:04:24.842806 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:04:24.842806 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:04:24.842806 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:04:24.842806 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:04:24.842806 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:04:24.842806 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:04:24.842806 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:04:24.842806 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:04:24.842806 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:04:24.842806 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:04:24.842806 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:04:24.842806 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:04:24.842806 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:04:24.842806 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:04:24.842806 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6001579-7f6f-4a6b-ada0-d301a142f96b could not be found. Sep 14 09:04:24.842806 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:04:24.842806 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:04:24.842806 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:04:24.849682 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:04:24.849682 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:04:24.849682 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:04:24.849682 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:04:24.849682 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:04:24.849682 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6001579-7f6f-4a6b-ada0-d301a142f96b could not be found. Sep 14 09:04:24.849682 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:04:24.853801 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f23b60c9-5bfd-4131-99ba-33fdcc399f18 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Returning 404 to user: Instance e6001579-7f6f-4a6b-ada0-d301a142f96b could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:04:24.855211 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f23b60c9-5bfd-4131-99ba-33fdcc399f18 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/e6001579-7f6f-4a6b-ada0-d301a142f96b" status: 404 len: 111 microversion: 2.1 time: 0.092862 Sep 14 09:04:24.859532 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1780/3600] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:04:24 2022] GET /compute/v2.1/servers/e6001579-7f6f-4a6b-ada0-d301a142f96b => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:04:24.877374 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-dc594e98-96fe-4d6d-afc4-031db4321338 tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:24.878263 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-dc594e98-96fe-4d6d-afc4-031db4321338 tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] [instance: adbd193b-b0ae-40c1-97b5-7fbb9077942b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:24.905382 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dc594e98-96fe-4d6d-afc4-031db4321338 tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:24.906737 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dc594e98-96fe-4d6d-afc4-031db4321338 tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:24.907089 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dc594e98-96fe-4d6d-afc4-031db4321338 tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:24.910488 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dc594e98-96fe-4d6d-afc4-031db4321338 tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:24.911176 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dc594e98-96fe-4d6d-afc4-031db4321338 tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:24.911632 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dc594e98-96fe-4d6d-afc4-031db4321338 tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:25.160013 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-be637527-1930-49bf-99ab-fb1fe1f49eaf tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504ea33de5724b518bcdf28076d6361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd19911fb94d47ab92893a3ec449fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:25.171747 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-be637527-1930-49bf-99ab-fb1fe1f49eaf tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] 10.222.0.60 "GET /compute/v2.1/servers/2aefa743-500a-4cd6-b3d9-d1cf138ee1da" status: 200 len: 1507 microversion: 2.1 time: 0.741851 Sep 14 09:04:25.172343 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1821/3601] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:04:24 2022] GET /compute/v2.1/servers/2aefa743-500a-4cd6-b3d9-d1cf138ee1da => generated 1507 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:04:25.189306 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-051e34f8-d135-4a77-93a1-de13512fee25 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:25.190182 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-051e34f8-d135-4a77-93a1-de13512fee25 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: d2c90e75-2618-4803-9865-e324dc5d8d59] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:25.207441 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-051e34f8-d135-4a77-93a1-de13512fee25 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] HTTP exception thrown: Instance d2c90e75-2618-4803-9865-e324dc5d8d59 could not be found. Sep 14 09:04:25.209453 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-051e34f8-d135-4a77-93a1-de13512fee25 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Request method failure captured: Sep 14 09:04:25.209453 n-d-836830-18 devstack@n-api.service[128758]: request: DELETE /compute/v2.1/servers/d2c90e75-2618-4803-9865-e324dc5d8d59 HTTP/1.1 Sep 14 09:04:25.209453 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 09:04:25.209453 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 09:04:25.209453 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 09:04:25.209453 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 09:04:25.209453 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 09:04:25.209453 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 09:04:25.209453 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 09:04:25.209453 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 09:04:25.209453 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZfruMTQYBTAiiDSnzM1mYEpmuEj9qljISQOJ4EBe2ad6zsfFzAf8FVBubQCt-Sdr-zCKCq1jxjsj_azLMK_SQWZ09VXr62FV-261vpzTW6inln_93a6hl3DeVdX6cuYwx-Go-beMey4bY4s6iPFtULEKgIbxHUgjvgK1DEFOEvCwSQ Sep 14 09:04:25.209453 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 09:04:25.209453 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 09:04:25.209453 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 09:04:25.209453 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 09:04:25.209453 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 09:04:25.209453 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 09:04:25.209453 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 4d42bf4d573b4bf9a0d8c9e73260af7e Sep 14 09:04:25.209453 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-DeleteServersTestJSON-1669995002 Sep 14 09:04:25.209453 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 09:04:25.209453 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 09:04:25.209453 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/4d42bf4d573b4bf9a0d8c9e73260af7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_4d42bf4d573b4bf9a0d8c9e73260af7e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4d42bf4d573b4bf9a0d8c9e73260af7e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4d42bf4d573b4bf9a0d8c9e73260af7e"}]}] Sep 14 09:04:25.209453 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-DeleteServersTestJSON-1669995002 Sep 14 09:04:25.209453 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 4d42bf4d573b4bf9a0d8c9e73260af7e Sep 14 09:04:25.209453 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-DeleteServersTestJSON-1669995002 Sep 14 09:04:25.209453 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-DeleteServersTestJSON-1669995002-project Sep 14 09:04:25.209453 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 09:04:25.209453 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 09:04:25.209453 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 47c95b28481b451bb03fb2c0240d0310 Sep 14 09:04:25.209453 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-DeleteServersTestJSON-1669995002-project Sep 14 09:04:25.209453 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 09:04:25.209453 n-d-836830-18 devstack@n-api.service[128758]: exception: Instance d2c90e75-2618-4803-9865-e324dc5d8d59 could not be found. Sep 14 09:04:25.209453 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': 'd2c90e75-2618-4803-9865-e324dc5d8d59'} Sep 14 09:04:25.209453 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:04:25.209453 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:04:25.209453 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:04:25.209453 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:04:25.209453 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:04:25.209453 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:04:25.209453 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 14 09:04:25.209453 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 14 09:04:25.209453 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2c90e75-2618-4803-9865-e324dc5d8d59 could not be found. Sep 14 09:04:25.209453 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:04:25.209453 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:04:25.209453 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:04:25.209453 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:04:25.209453 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:04:25.209453 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:04:25.209453 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:04:25.209453 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:04:25.209453 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:04:25.209453 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:04:25.209453 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 09:04:25.209453 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 09:04:25.209453 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 09:04:25.209453 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 09:04:25.209453 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:04:25.209453 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:04:25.209453 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:04:25.209453 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:04:25.209453 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2c90e75-2618-4803-9865-e324dc5d8d59 could not be found. Sep 14 09:04:25.209453 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:04:25.209453 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:04:25.214751 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:04:25.214751 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:04:25.214751 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:04:25.214751 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:04:25.214751 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:04:25.214751 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:04:25.214751 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2c90e75-2618-4803-9865-e324dc5d8d59 could not be found. Sep 14 09:04:25.214751 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:04:25.216373 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-051e34f8-d135-4a77-93a1-de13512fee25 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Returning 404 to user: Instance d2c90e75-2618-4803-9865-e324dc5d8d59 could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:04:25.219584 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-051e34f8-d135-4a77-93a1-de13512fee25 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "DELETE /compute/v2.1/servers/d2c90e75-2618-4803-9865-e324dc5d8d59" status: 404 len: 111 microversion: 2.1 time: 0.044004 Sep 14 09:04:25.221632 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1822/3602] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:04:25 2022] DELETE /compute/v2.1/servers/d2c90e75-2618-4803-9865-e324dc5d8d59 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:04:25.233283 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-14f83f9a-abe7-40c9-8242-f45ea8716c3b tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:25.239996 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-14f83f9a-abe7-40c9-8242-f45ea8716c3b tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] [instance: fcc183e1-b880-4005-bb3e-90ab91ed7911] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:25.250374 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-dc594e98-96fe-4d6d-afc4-031db4321338 tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebe0be597a44e0bad22fbcf5c9249d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49345e5148f4d7aae1488e735c76590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:25.252285 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-14f83f9a-abe7-40c9-8242-f45ea8716c3b tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:25.252847 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-14f83f9a-abe7-40c9-8242-f45ea8716c3b tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:25.253550 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-14f83f9a-abe7-40c9-8242-f45ea8716c3b tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:25.258595 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-14f83f9a-abe7-40c9-8242-f45ea8716c3b tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:25.259842 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-14f83f9a-abe7-40c9-8242-f45ea8716c3b tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:25.261731 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-14f83f9a-abe7-40c9-8242-f45ea8716c3b tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:25.266624 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-dc594e98-96fe-4d6d-afc4-031db4321338 tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] 10.222.0.60 "GET /compute/v2.1/servers/adbd193b-b0ae-40c1-97b5-7fbb9077942b" status: 200 len: 1283 microversion: 2.1 time: 0.405894 Sep 14 09:04:25.292927 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1781/3603] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:04:24 2022] GET /compute/v2.1/servers/adbd193b-b0ae-40c1-97b5-7fbb9077942b => generated 1283 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:04:25.305742 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-406b3bb9-0a79-4738-b0ea-cb1a1ba1b00e tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:25.309643 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-406b3bb9-0a79-4738-b0ea-cb1a1ba1b00e tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] [instance: d98ba025-ba7a-40fa-8fd2-44eeef653b6a] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:25.344173 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-406b3bb9-0a79-4738-b0ea-cb1a1ba1b00e tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:25.349359 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-406b3bb9-0a79-4738-b0ea-cb1a1ba1b00e tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:25.349895 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-406b3bb9-0a79-4738-b0ea-cb1a1ba1b00e tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:25.350658 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-406b3bb9-0a79-4738-b0ea-cb1a1ba1b00e tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:25.351178 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-406b3bb9-0a79-4738-b0ea-cb1a1ba1b00e tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:25.361221 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-406b3bb9-0a79-4738-b0ea-cb1a1ba1b00e tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:25.718465 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-14f83f9a-abe7-40c9-8242-f45ea8716c3b tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6b965ba7c340f190f9cafc69e46748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b304cd14b65640dab95dc8926eb90818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:25.746146 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-14f83f9a-abe7-40c9-8242-f45ea8716c3b tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6b965ba7c340f190f9cafc69e46748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b304cd14b65640dab95dc8926eb90818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:25.750492 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-14f83f9a-abe7-40c9-8242-f45ea8716c3b tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6b965ba7c340f190f9cafc69e46748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b304cd14b65640dab95dc8926eb90818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:25.754054 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-14f83f9a-abe7-40c9-8242-f45ea8716c3b tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] 10.222.0.60 "GET /compute/v2.1/servers/fcc183e1-b880-4005-bb3e-90ab91ed7911" status: 200 len: 1366 microversion: 2.57 time: 0.531169 Sep 14 09:04:25.765408 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1823/3604] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:04:25 2022] GET /compute/v2.1/servers/fcc183e1-b880-4005-bb3e-90ab91ed7911 => generated 1366 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:04:25.775376 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-9ff43a60-57eb-4682-bd25-908b2675205a tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:25.776235 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-9ff43a60-57eb-4682-bd25-908b2675205a tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: d2c90e75-2618-4803-9865-e324dc5d8d59] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:25.798772 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-9ff43a60-57eb-4682-bd25-908b2675205a tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] HTTP exception thrown: Instance d2c90e75-2618-4803-9865-e324dc5d8d59 could not be found. Sep 14 09:04:25.800867 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-9ff43a60-57eb-4682-bd25-908b2675205a tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Request method failure captured: Sep 14 09:04:25.800867 n-d-836830-18 devstack@n-api.service[128758]: request: GET /compute/v2.1/servers/d2c90e75-2618-4803-9865-e324dc5d8d59 HTTP/1.1 Sep 14 09:04:25.800867 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 09:04:25.800867 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 09:04:25.800867 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 09:04:25.800867 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 09:04:25.800867 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 09:04:25.800867 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 09:04:25.800867 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 09:04:25.800867 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 09:04:25.800867 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZfruMTQYBTAiiDSnzM1mYEpmuEj9qljISQOJ4EBe2ad6zsfFzAf8FVBubQCt-Sdr-zCKCq1jxjsj_azLMK_SQWZ09VXr62FV-261vpzTW6inln_93a6hl3DeVdX6cuYwx-Go-beMey4bY4s6iPFtULEKgIbxHUgjvgK1DEFOEvCwSQ Sep 14 09:04:25.800867 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 09:04:25.800867 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 09:04:25.800867 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 09:04:25.800867 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 09:04:25.800867 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 09:04:25.800867 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 09:04:25.800867 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 4d42bf4d573b4bf9a0d8c9e73260af7e Sep 14 09:04:25.800867 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-DeleteServersTestJSON-1669995002 Sep 14 09:04:25.800867 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 09:04:25.800867 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 09:04:25.800867 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/4d42bf4d573b4bf9a0d8c9e73260af7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_4d42bf4d573b4bf9a0d8c9e73260af7e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4d42bf4d573b4bf9a0d8c9e73260af7e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4d42bf4d573b4bf9a0d8c9e73260af7e"}]}] Sep 14 09:04:25.800867 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-DeleteServersTestJSON-1669995002 Sep 14 09:04:25.800867 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 4d42bf4d573b4bf9a0d8c9e73260af7e Sep 14 09:04:25.800867 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-DeleteServersTestJSON-1669995002 Sep 14 09:04:25.800867 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-DeleteServersTestJSON-1669995002-project Sep 14 09:04:25.800867 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 09:04:25.800867 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 09:04:25.800867 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 47c95b28481b451bb03fb2c0240d0310 Sep 14 09:04:25.800867 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-DeleteServersTestJSON-1669995002-project Sep 14 09:04:25.800867 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 09:04:25.800867 n-d-836830-18 devstack@n-api.service[128758]: exception: Instance d2c90e75-2618-4803-9865-e324dc5d8d59 could not be found. Sep 14 09:04:25.800867 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': 'd2c90e75-2618-4803-9865-e324dc5d8d59'} Sep 14 09:04:25.800867 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:04:25.800867 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:04:25.800867 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:04:25.800867 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:04:25.800867 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:04:25.800867 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:04:25.800867 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 14 09:04:25.800867 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 14 09:04:25.800867 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2c90e75-2618-4803-9865-e324dc5d8d59 could not be found. Sep 14 09:04:25.800867 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:04:25.800867 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:04:25.800867 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:04:25.800867 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:04:25.800867 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:04:25.800867 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:04:25.800867 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:04:25.800867 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:04:25.800867 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:04:25.800867 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:04:25.800867 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:04:25.800867 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:04:25.800867 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:04:25.800867 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:04:25.800867 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:04:25.800867 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:04:25.800867 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2c90e75-2618-4803-9865-e324dc5d8d59 could not be found. Sep 14 09:04:25.800867 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:04:25.800867 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:04:25.800867 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:04:25.800867 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:04:25.800867 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:04:25.805422 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:04:25.805422 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:04:25.805422 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:04:25.805422 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2c90e75-2618-4803-9865-e324dc5d8d59 could not be found. Sep 14 09:04:25.805422 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:04:25.814558 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-9ff43a60-57eb-4682-bd25-908b2675205a tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Returning 404 to user: Instance d2c90e75-2618-4803-9865-e324dc5d8d59 could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:04:25.815823 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-9ff43a60-57eb-4682-bd25-908b2675205a tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/d2c90e75-2618-4803-9865-e324dc5d8d59" status: 404 len: 111 microversion: 2.1 time: 0.049205 Sep 14 09:04:25.816636 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1824/3605] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:04:25 2022] GET /compute/v2.1/servers/d2c90e75-2618-4803-9865-e324dc5d8d59 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:04:25.827875 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-65666c92-a69e-446e-bb8e-221ad1d57436 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:25.828514 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-65666c92-a69e-446e-bb8e-221ad1d57436 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] [instance: 900c4e61-76fe-472f-bba7-0c83895f62cf] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:25.846608 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-65666c92-a69e-446e-bb8e-221ad1d57436 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:25.846608 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-65666c92-a69e-446e-bb8e-221ad1d57436 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:25.846608 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-65666c92-a69e-446e-bb8e-221ad1d57436 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:25.847177 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-65666c92-a69e-446e-bb8e-221ad1d57436 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:25.847715 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-65666c92-a69e-446e-bb8e-221ad1d57436 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:25.848130 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-65666c92-a69e-446e-bb8e-221ad1d57436 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:25.866407 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-65666c92-a69e-446e-bb8e-221ad1d57436 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] HTTP exception thrown: Instance 900c4e61-76fe-472f-bba7-0c83895f62cf could not be found. Sep 14 09:04:25.868054 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-65666c92-a69e-446e-bb8e-221ad1d57436 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Request method failure captured: Sep 14 09:04:25.868054 n-d-836830-18 devstack@n-api.service[128758]: request: GET /compute/v2.1/servers/900c4e61-76fe-472f-bba7-0c83895f62cf HTTP/1.1 Sep 14 09:04:25.868054 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 09:04:25.868054 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 09:04:25.868054 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 09:04:25.868054 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 09:04:25.868054 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 09:04:25.868054 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 09:04:25.868054 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 09:04:25.868054 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 09:04:25.868054 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZjTP5-kMHINqLnSCfguw32N2KysqKXMhlDeZun8rjaAzz1G6AkbILVcYO_wjZ1aFNieJMdDgNZWIaW77SJboU9dbrxNg0xu_Bagc-9QkFBReOF9rjU2lhVW-Ogh1Ndm9CU3eDe81z6pua2OvRgPX6e1lI9SVUs2-24QLfS0Z4mOTTE Sep 14 09:04:25.868054 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 09:04:25.868054 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 09:04:25.868054 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 09:04:25.868054 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 09:04:25.868054 n-d-836830-18 devstack@n-api.service[128758]: X-Openstack-Nova-Api-Version: 2.54 Sep 14 09:04:25.868054 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 09:04:25.868054 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 09:04:25.868054 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 730a90781147416fa5db6b8922209058 Sep 14 09:04:25.868054 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-ServerShowV254Test-1675366117 Sep 14 09:04:25.868054 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 09:04:25.868054 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 09:04:25.868054 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/730a90781147416fa5db6b8922209058"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_730a90781147416fa5db6b8922209058"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/730a90781147416fa5db6b8922209058"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/730a90781147416fa5db6b8922209058"}]}] Sep 14 09:04:25.868054 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-ServerShowV254Test-1675366117 Sep 14 09:04:25.868054 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 730a90781147416fa5db6b8922209058 Sep 14 09:04:25.868054 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-ServerShowV254Test-1675366117 Sep 14 09:04:25.868054 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-ServerShowV254Test-1675366117-project Sep 14 09:04:25.868054 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 09:04:25.868054 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 09:04:25.868054 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 84afbf1d30574a7aa1186a481687c50c Sep 14 09:04:25.868054 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-ServerShowV254Test-1675366117-project Sep 14 09:04:25.868054 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 09:04:25.868054 n-d-836830-18 devstack@n-api.service[128758]: exception: Instance 900c4e61-76fe-472f-bba7-0c83895f62cf could not be found. Sep 14 09:04:25.868054 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': '900c4e61-76fe-472f-bba7-0c83895f62cf'} Sep 14 09:04:25.868054 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:04:25.868054 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:04:25.868054 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:04:25.868054 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:04:25.868054 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:04:25.868054 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:04:25.868054 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:04:25.868054 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:04:25.868054 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:04:25.868054 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:04:25.868054 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 900c4e61-76fe-472f-bba7-0c83895f62cf could not be found. Sep 14 09:04:25.868054 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:04:25.868054 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:04:25.868054 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:04:25.868054 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:04:25.868054 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:04:25.868054 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:04:25.868054 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:04:25.868054 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:04:25.868054 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:04:25.868054 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:04:25.868054 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:04:25.868054 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:04:25.868054 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:04:25.868054 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:04:25.868054 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:04:25.868054 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:04:25.868054 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 900c4e61-76fe-472f-bba7-0c83895f62cf could not be found. Sep 14 09:04:25.868054 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:04:25.868054 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:04:25.868054 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:04:25.873451 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:04:25.873451 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:04:25.873451 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:04:25.873451 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:04:25.873451 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:04:25.873451 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 900c4e61-76fe-472f-bba7-0c83895f62cf could not be found. Sep 14 09:04:25.873451 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:04:25.873451 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-65666c92-a69e-446e-bb8e-221ad1d57436 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] Returning 404 to user: Instance 900c4e61-76fe-472f-bba7-0c83895f62cf could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:04:25.873451 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-65666c92-a69e-446e-bb8e-221ad1d57436 tempest-ServerShowV254Test-1675366117 tempest-ServerShowV254Test-1675366117-project] 10.222.0.60 "GET /compute/v2.1/servers/900c4e61-76fe-472f-bba7-0c83895f62cf" status: 404 len: 111 microversion: 2.54 time: 0.049258 Sep 14 09:04:25.873451 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1825/3606] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:04:25 2022] GET /compute/v2.1/servers/900c4e61-76fe-472f-bba7-0c83895f62cf => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 14 09:04:26.314584 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-58cc0d15-43ef-4fd3-90af-8097bb6c8fb6 tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:26.315809 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-58cc0d15-43ef-4fd3-90af-8097bb6c8fb6 tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] [instance: adbd193b-b0ae-40c1-97b5-7fbb9077942b] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:26.327742 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-58cc0d15-43ef-4fd3-90af-8097bb6c8fb6 tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:26.327742 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-58cc0d15-43ef-4fd3-90af-8097bb6c8fb6 tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:26.336699 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-58cc0d15-43ef-4fd3-90af-8097bb6c8fb6 tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:26.338091 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-58cc0d15-43ef-4fd3-90af-8097bb6c8fb6 tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:26.353341 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-58cc0d15-43ef-4fd3-90af-8097bb6c8fb6 tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:26.357984 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-58cc0d15-43ef-4fd3-90af-8097bb6c8fb6 tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:26.365194 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-406b3bb9-0a79-4738-b0ea-cb1a1ba1b00e tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504ea33de5724b518bcdf28076d6361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd19911fb94d47ab92893a3ec449fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:26.382165 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-406b3bb9-0a79-4738-b0ea-cb1a1ba1b00e tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] 10.222.0.60 "GET /compute/v2.1/servers/d98ba025-ba7a-40fa-8fd2-44eeef653b6a" status: 200 len: 1508 microversion: 2.1 time: 1.082721 Sep 14 09:04:26.386729 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1782/3607] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:04:25 2022] GET /compute/v2.1/servers/d98ba025-ba7a-40fa-8fd2-44eeef653b6a => generated 1508 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:04:26.418304 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3c357172-82e0-4a44-878d-b231105bd1db tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:26.419717 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-3c357172-82e0-4a44-878d-b231105bd1db tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] [instance: d98ba025-ba7a-40fa-8fd2-44eeef653b6a] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:26.442304 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3c357172-82e0-4a44-878d-b231105bd1db tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:26.445904 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3c357172-82e0-4a44-878d-b231105bd1db tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:26.447291 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3c357172-82e0-4a44-878d-b231105bd1db tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:26.450430 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3c357172-82e0-4a44-878d-b231105bd1db tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:26.455256 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3c357172-82e0-4a44-878d-b231105bd1db tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:26.456023 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3c357172-82e0-4a44-878d-b231105bd1db tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:26.553898 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-3c357172-82e0-4a44-878d-b231105bd1db tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] [instance: d98ba025-ba7a-40fa-8fd2-44eeef653b6a] Going to try to terminate instance {{(pid=128759) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:04:26.736317 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:04:26.788523 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-3c357172-82e0-4a44-878d-b231105bd1db tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] 10.222.0.60 "DELETE /compute/v2.1/servers/d98ba025-ba7a-40fa-8fd2-44eeef653b6a" status: 204 len: 0 microversion: 2.1 time: 0.378394 Sep 14 09:04:26.790011 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1783/3608] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:04:26 2022] DELETE /compute/v2.1/servers/d98ba025-ba7a-40fa-8fd2-44eeef653b6a => generated 0 bytes in 382 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:04:26.799453 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-dbf26ed4-7499-4840-89fd-514bf72a0636 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:26.801351 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-dbf26ed4-7499-4840-89fd-514bf72a0636 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] [instance: fcc183e1-b880-4005-bb3e-90ab91ed7911] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:26.810145 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dbf26ed4-7499-4840-89fd-514bf72a0636 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:26.810907 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dbf26ed4-7499-4840-89fd-514bf72a0636 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:26.812752 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dbf26ed4-7499-4840-89fd-514bf72a0636 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:26.813687 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dbf26ed4-7499-4840-89fd-514bf72a0636 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:26.815599 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dbf26ed4-7499-4840-89fd-514bf72a0636 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:26.816456 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dbf26ed4-7499-4840-89fd-514bf72a0636 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:27.014994 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-dbf26ed4-7499-4840-89fd-514bf72a0636 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6b965ba7c340f190f9cafc69e46748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b304cd14b65640dab95dc8926eb90818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:27.023993 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-dbf26ed4-7499-4840-89fd-514bf72a0636 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6b965ba7c340f190f9cafc69e46748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b304cd14b65640dab95dc8926eb90818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:27.026600 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-dbf26ed4-7499-4840-89fd-514bf72a0636 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6b965ba7c340f190f9cafc69e46748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b304cd14b65640dab95dc8926eb90818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:27.028185 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-dbf26ed4-7499-4840-89fd-514bf72a0636 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] 10.222.0.60 "GET /compute/v2.1/servers/fcc183e1-b880-4005-bb3e-90ab91ed7911" status: 200 len: 1366 microversion: 2.57 time: 0.235065 Sep 14 09:04:27.031624 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1784/3609] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:04:26 2022] GET /compute/v2.1/servers/fcc183e1-b880-4005-bb3e-90ab91ed7911 => generated 1366 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:04:27.047699 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9c2a9f8b-18a1-4b8a-a678-616392ea3705 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:27.048459 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-9c2a9f8b-18a1-4b8a-a678-616392ea3705 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] [instance: 2aefa743-500a-4cd6-b3d9-d1cf138ee1da] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:27.062844 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9c2a9f8b-18a1-4b8a-a678-616392ea3705 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:27.063626 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9c2a9f8b-18a1-4b8a-a678-616392ea3705 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:27.064558 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9c2a9f8b-18a1-4b8a-a678-616392ea3705 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:27.065688 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9c2a9f8b-18a1-4b8a-a678-616392ea3705 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:27.066619 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9c2a9f8b-18a1-4b8a-a678-616392ea3705 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:27.067357 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9c2a9f8b-18a1-4b8a-a678-616392ea3705 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:27.125554 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-9c2a9f8b-18a1-4b8a-a678-616392ea3705 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] [instance: 2aefa743-500a-4cd6-b3d9-d1cf138ee1da] Going to try to terminate instance {{(pid=128759) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:04:27.203890 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-58cc0d15-43ef-4fd3-90af-8097bb6c8fb6 tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebe0be597a44e0bad22fbcf5c9249d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49345e5148f4d7aae1488e735c76590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:27.215778 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-58cc0d15-43ef-4fd3-90af-8097bb6c8fb6 tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] 10.222.0.60 "GET /compute/v2.1/servers/adbd193b-b0ae-40c1-97b5-7fbb9077942b" status: 200 len: 1325 microversion: 2.1 time: 0.905246 Sep 14 09:04:27.216681 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1826/3610] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:04:26 2022] GET /compute/v2.1/servers/adbd193b-b0ae-40c1-97b5-7fbb9077942b => generated 1325 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:04:27.260276 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-9c2a9f8b-18a1-4b8a-a678-616392ea3705 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] 10.222.0.60 "DELETE /compute/v2.1/servers/2aefa743-500a-4cd6-b3d9-d1cf138ee1da" status: 204 len: 0 microversion: 2.1 time: 0.226425 Sep 14 09:04:27.261134 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1785/3611] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:04:27 2022] DELETE /compute/v2.1/servers/2aefa743-500a-4cd6-b3d9-d1cf138ee1da => generated 0 bytes in 229 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:04:27.513539 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-41c39805-9373-4fe8-bb4f-95d3824c0dba tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-1289752784", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "2c78c45c-3b97-40bb-98a8-71b09cd0e9f7"}]}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:04:27.628564 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.network.neutron [None req-41c39805-9373-4fe8-bb4f-95d3824c0dba tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] validate_networks() for [('2c78c45c-3b97-40bb-98a8-71b09cd0e9f7', None, None, None, None, None)] {{(pid=128758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:04:28.065977 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-42aa10d6-6b75-41ed-af18-b114501d503f tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:28.077390 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-42aa10d6-6b75-41ed-af18-b114501d503f tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] [instance: fcc183e1-b880-4005-bb3e-90ab91ed7911] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:28.129864 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-42aa10d6-6b75-41ed-af18-b114501d503f tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:28.130630 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-42aa10d6-6b75-41ed-af18-b114501d503f tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:28.131178 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-42aa10d6-6b75-41ed-af18-b114501d503f tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:28.137772 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-42aa10d6-6b75-41ed-af18-b114501d503f tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:28.140667 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-42aa10d6-6b75-41ed-af18-b114501d503f tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:28.142712 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-42aa10d6-6b75-41ed-af18-b114501d503f tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:28.227365 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:04:28.721319 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-42aa10d6-6b75-41ed-af18-b114501d503f tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6b965ba7c340f190f9cafc69e46748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b304cd14b65640dab95dc8926eb90818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:28.736541 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-42aa10d6-6b75-41ed-af18-b114501d503f tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6b965ba7c340f190f9cafc69e46748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b304cd14b65640dab95dc8926eb90818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:28.745674 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-42aa10d6-6b75-41ed-af18-b114501d503f tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6b965ba7c340f190f9cafc69e46748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b304cd14b65640dab95dc8926eb90818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:28.747119 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-42aa10d6-6b75-41ed-af18-b114501d503f tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] 10.222.0.60 "GET /compute/v2.1/servers/fcc183e1-b880-4005-bb3e-90ab91ed7911" status: 200 len: 1366 microversion: 2.57 time: 0.689326 Sep 14 09:04:28.752026 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1786/3612] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:04:28 2022] GET /compute/v2.1/servers/fcc183e1-b880-4005-bb3e-90ab91ed7911 => generated 1366 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:04:28.757745 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-7b3c1b11-46fd-4540-a4ad-2646b76af56f tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:28.763265 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-7b3c1b11-46fd-4540-a4ad-2646b76af56f tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] [instance: adbd193b-b0ae-40c1-97b5-7fbb9077942b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:28.782451 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7b3c1b11-46fd-4540-a4ad-2646b76af56f tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:28.783036 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7b3c1b11-46fd-4540-a4ad-2646b76af56f tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:28.789668 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7b3c1b11-46fd-4540-a4ad-2646b76af56f tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:28.791109 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7b3c1b11-46fd-4540-a4ad-2646b76af56f tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:28.791589 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7b3c1b11-46fd-4540-a4ad-2646b76af56f tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:28.792021 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7b3c1b11-46fd-4540-a4ad-2646b76af56f tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:29.510878 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=6 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:04:29.668001 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-7b3c1b11-46fd-4540-a4ad-2646b76af56f tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebe0be597a44e0bad22fbcf5c9249d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49345e5148f4d7aae1488e735c76590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:29.685073 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-7b3c1b11-46fd-4540-a4ad-2646b76af56f tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] 10.222.0.60 "GET /compute/v2.1/servers/adbd193b-b0ae-40c1-97b5-7fbb9077942b" status: 200 len: 1325 microversion: 2.1 time: 0.931500 Sep 14 09:04:29.686436 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1787/3613] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:04:28 2022] GET /compute/v2.1/servers/adbd193b-b0ae-40c1-97b5-7fbb9077942b => generated 1325 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:04:29.781157 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b373b55f-8766-4af6-8031-52f96a1d8a5d tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:29.782126 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b373b55f-8766-4af6-8031-52f96a1d8a5d tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] [instance: fcc183e1-b880-4005-bb3e-90ab91ed7911] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:29.797818 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b373b55f-8766-4af6-8031-52f96a1d8a5d tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:29.803467 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b373b55f-8766-4af6-8031-52f96a1d8a5d tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:29.809663 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b373b55f-8766-4af6-8031-52f96a1d8a5d tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:29.812695 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b373b55f-8766-4af6-8031-52f96a1d8a5d tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:29.815444 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b373b55f-8766-4af6-8031-52f96a1d8a5d tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:29.820604 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b373b55f-8766-4af6-8031-52f96a1d8a5d tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:30.060822 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b373b55f-8766-4af6-8031-52f96a1d8a5d tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6b965ba7c340f190f9cafc69e46748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b304cd14b65640dab95dc8926eb90818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:30.077638 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b373b55f-8766-4af6-8031-52f96a1d8a5d tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6b965ba7c340f190f9cafc69e46748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b304cd14b65640dab95dc8926eb90818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:30.081113 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b373b55f-8766-4af6-8031-52f96a1d8a5d tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6b965ba7c340f190f9cafc69e46748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b304cd14b65640dab95dc8926eb90818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:30.084276 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b373b55f-8766-4af6-8031-52f96a1d8a5d tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] 10.222.0.60 "GET /compute/v2.1/servers/fcc183e1-b880-4005-bb3e-90ab91ed7911" status: 200 len: 1366 microversion: 2.57 time: 0.310407 Sep 14 09:04:30.089836 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1788/3614] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:04:29 2022] GET /compute/v2.1/servers/fcc183e1-b880-4005-bb3e-90ab91ed7911 => generated 1366 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:04:30.378921 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-38c6f0aa-9b4a-4e1e-a5a9-af125ce0563e req-f66dc444-6541-4c56-aa96-788b60a8faf6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "adbd193b-b0ae-40c1-97b5-7fbb9077942b", "tag": "8e578434-355e-459f-b84c-6b6643c69d40"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:04:30.422712 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-38c6f0aa-9b4a-4e1e-a5a9-af125ce0563e req-f66dc444-6541-4c56-aa96-788b60a8faf6 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:30.425994 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-38c6f0aa-9b4a-4e1e-a5a9-af125ce0563e req-f66dc444-6541-4c56-aa96-788b60a8faf6 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:30.426568 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-38c6f0aa-9b4a-4e1e-a5a9-af125ce0563e req-f66dc444-6541-4c56-aa96-788b60a8faf6 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:30.475261 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-38c6f0aa-9b4a-4e1e-a5a9-af125ce0563e req-f66dc444-6541-4c56-aa96-788b60a8faf6 service nova] Creating event network-changed:8e578434-355e-459f-b84c-6b6643c69d40 for instance adbd193b-b0ae-40c1-97b5-7fbb9077942b on n-h1-836830-18 Sep 14 09:04:30.485482 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=2 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:04:30.488616 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-38c6f0aa-9b4a-4e1e-a5a9-af125ce0563e req-f66dc444-6541-4c56-aa96-788b60a8faf6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119144 Sep 14 09:04:30.492126 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1789/3615] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:04:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:04:30.679184 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-41c39805-9373-4fe8-bb4f-95d3824c0dba tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Flavor limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:04:30.680063 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-41c39805-9373-4fe8-bb4f-95d3824c0dba tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Image limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:04:30.680901 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-41c39805-9373-4fe8-bb4f-95d3824c0dba tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Flavor pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:04:30.682161 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-41c39805-9373-4fe8-bb4f-95d3824c0dba tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Image pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:04:30.683779 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-41c39805-9373-4fe8-bb4f-95d3824c0dba tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:04:30.711776 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-89fa8b8a-01ee-4843-b774-fe5a78de9fe5 tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:30.714126 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-89fa8b8a-01ee-4843-b774-fe5a78de9fe5 tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] [instance: adbd193b-b0ae-40c1-97b5-7fbb9077942b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:30.732077 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-41c39805-9373-4fe8-bb4f-95d3824c0dba tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:30.739054 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-89fa8b8a-01ee-4843-b774-fe5a78de9fe5 tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:30.739376 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-41c39805-9373-4fe8-bb4f-95d3824c0dba tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:30.740916 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-41c39805-9373-4fe8-bb4f-95d3824c0dba tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:30.741298 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-89fa8b8a-01ee-4843-b774-fe5a78de9fe5 tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:30.742835 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-89fa8b8a-01ee-4843-b774-fe5a78de9fe5 tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:30.747156 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-41c39805-9373-4fe8-bb4f-95d3824c0dba tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:30.748124 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-41c39805-9373-4fe8-bb4f-95d3824c0dba tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:30.752307 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-41c39805-9373-4fe8-bb4f-95d3824c0dba tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:30.752678 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-89fa8b8a-01ee-4843-b774-fe5a78de9fe5 tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:30.753891 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-89fa8b8a-01ee-4843-b774-fe5a78de9fe5 tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:30.755458 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-89fa8b8a-01ee-4843-b774-fe5a78de9fe5 tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:30.878274 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-41c39805-9373-4fe8-bb4f-95d3824c0dba tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Getting quotas for project bd19911fb94d47ab92893a3ec449fbbe. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:04:30.907959 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-41c39805-9373-4fe8-bb4f-95d3824c0dba tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Getting quotas for user 504ea33de5724b518bcdf28076d6361e and project bd19911fb94d47ab92893a3ec449fbbe. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:04:30.969810 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-41c39805-9373-4fe8-bb4f-95d3824c0dba tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Going to run 2 instances... {{(pid=128758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:04:30.974024 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-41c39805-9373-4fe8-bb4f-95d3824c0dba tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] [instance: 6888685e-f6c3-4fbb-898a-f3a35bc1af6d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:04:31.069092 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=8 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:04:31.086971 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-41c39805-9373-4fe8-bb4f-95d3824c0dba tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] [instance: c78e1261-6476-4835-882e-3e59b1d1083e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=6888685e-f6c3-4fbb-898a-f3a35bc1af6d,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:04:31.201342 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-41c39805-9373-4fe8-bb4f-95d3824c0dba tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 3.693597 Sep 14 09:04:31.202929 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1827/3616] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 09:04:27 2022] POST /compute/v2.1/servers => generated 32 bytes in 3696 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Sep 14 09:04:31.211545 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-bb16d2c4-cc94-4928-b0ac-38a9b8a68e6d tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:31.213395 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-bb16d2c4-cc94-4928-b0ac-38a9b8a68e6d tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] [instance: fcc183e1-b880-4005-bb3e-90ab91ed7911] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:31.221573 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bb16d2c4-cc94-4928-b0ac-38a9b8a68e6d tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:31.222444 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bb16d2c4-cc94-4928-b0ac-38a9b8a68e6d tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:31.223372 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bb16d2c4-cc94-4928-b0ac-38a9b8a68e6d tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:31.224930 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bb16d2c4-cc94-4928-b0ac-38a9b8a68e6d tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:31.225714 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bb16d2c4-cc94-4928-b0ac-38a9b8a68e6d tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:31.226651 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bb16d2c4-cc94-4928-b0ac-38a9b8a68e6d tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:31.457380 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-bb16d2c4-cc94-4928-b0ac-38a9b8a68e6d tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6b965ba7c340f190f9cafc69e46748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b304cd14b65640dab95dc8926eb90818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:31.476819 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-bb16d2c4-cc94-4928-b0ac-38a9b8a68e6d tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6b965ba7c340f190f9cafc69e46748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b304cd14b65640dab95dc8926eb90818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:31.478889 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-bb16d2c4-cc94-4928-b0ac-38a9b8a68e6d tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6b965ba7c340f190f9cafc69e46748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b304cd14b65640dab95dc8926eb90818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:31.491294 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-bb16d2c4-cc94-4928-b0ac-38a9b8a68e6d tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] 10.222.0.60 "GET /compute/v2.1/servers/fcc183e1-b880-4005-bb3e-90ab91ed7911" status: 200 len: 1366 microversion: 2.57 time: 0.284802 Sep 14 09:04:31.491294 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1828/3617] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:04:31 2022] GET /compute/v2.1/servers/fcc183e1-b880-4005-bb3e-90ab91ed7911 => generated 1366 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:04:31.527797 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-463a8ac8-bef2-496c-8a30-fd3e628307de tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:31.538602 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-463a8ac8-bef2-496c-8a30-fd3e628307de tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '504ea33de5724b518bcdf28076d6361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd19911fb94d47ab92893a3ec449fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:31.548534 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-463a8ac8-bef2-496c-8a30-fd3e628307de tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Searching by: {'deleted': False, 'project_id': 'bd19911fb94d47ab92893a3ec449fbbe'} {{(pid=128758) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 14 09:04:31.629908 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-463a8ac8-bef2-496c-8a30-fd3e628307de tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:31.630416 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-463a8ac8-bef2-496c-8a30-fd3e628307de tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:31.630862 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-463a8ac8-bef2-496c-8a30-fd3e628307de tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:31.631640 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-463a8ac8-bef2-496c-8a30-fd3e628307de tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:31.632105 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-463a8ac8-bef2-496c-8a30-fd3e628307de tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:31.632535 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-463a8ac8-bef2-496c-8a30-fd3e628307de tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:31.753755 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.multi_cell_list [None req-463a8ac8-bef2-496c-8a30-fd3e628307de tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=128758) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 14 09:04:31.823257 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-89fa8b8a-01ee-4843-b774-fe5a78de9fe5 tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebe0be597a44e0bad22fbcf5c9249d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49345e5148f4d7aae1488e735c76590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:31.832961 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-89fa8b8a-01ee-4843-b774-fe5a78de9fe5 tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] 10.222.0.60 "GET /compute/v2.1/servers/adbd193b-b0ae-40c1-97b5-7fbb9077942b" status: 200 len: 1325 microversion: 2.1 time: 1.126900 Sep 14 09:04:31.835615 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1790/3618] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:04:30 2022] GET /compute/v2.1/servers/adbd193b-b0ae-40c1-97b5-7fbb9077942b => generated 1325 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:04:31.878220 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-463a8ac8-bef2-496c-8a30-fd3e628307de tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] 10.222.0.60 "GET /compute/v2.1/servers" status: 200 len: 1337 microversion: 2.1 time: 0.387380 Sep 14 09:04:31.884768 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1829/3619] 10.222.0.60 () {58 vars in 1125 bytes} [Wed Sep 14 09:04:31 2022] GET /compute/v2.1/servers => generated 1337 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:04:31.897667 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-628a3ad5-a877-4d5e-be02-cbd725fbc2e5 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:31.898511 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-628a3ad5-a877-4d5e-be02-cbd725fbc2e5 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] [instance: c78e1261-6476-4835-882e-3e59b1d1083e] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:32.176124 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-628a3ad5-a877-4d5e-be02-cbd725fbc2e5 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504ea33de5724b518bcdf28076d6361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd19911fb94d47ab92893a3ec449fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:32.192110 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-628a3ad5-a877-4d5e-be02-cbd725fbc2e5 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] 10.222.0.60 "GET /compute/v2.1/servers/c78e1261-6476-4835-882e-3e59b1d1083e" status: 200 len: 1218 microversion: 2.1 time: 0.298599 Sep 14 09:04:32.193241 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1791/3620] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:04:31 2022] GET /compute/v2.1/servers/c78e1261-6476-4835-882e-3e59b1d1083e => generated 1218 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:04:32.528771 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-964c18b8-8abe-4f1d-ab9f-42005e62d50f tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:32.529310 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-964c18b8-8abe-4f1d-ab9f-42005e62d50f tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] [instance: fcc183e1-b880-4005-bb3e-90ab91ed7911] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:32.541195 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-964c18b8-8abe-4f1d-ab9f-42005e62d50f tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:32.543788 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-964c18b8-8abe-4f1d-ab9f-42005e62d50f tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:32.543788 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-964c18b8-8abe-4f1d-ab9f-42005e62d50f tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:32.543788 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-964c18b8-8abe-4f1d-ab9f-42005e62d50f tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:32.548052 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-964c18b8-8abe-4f1d-ab9f-42005e62d50f tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:32.550847 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-964c18b8-8abe-4f1d-ab9f-42005e62d50f tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:32.830488 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-964c18b8-8abe-4f1d-ab9f-42005e62d50f tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6b965ba7c340f190f9cafc69e46748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b304cd14b65640dab95dc8926eb90818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:32.847926 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-964c18b8-8abe-4f1d-ab9f-42005e62d50f tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6b965ba7c340f190f9cafc69e46748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b304cd14b65640dab95dc8926eb90818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:32.854539 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-964c18b8-8abe-4f1d-ab9f-42005e62d50f tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6b965ba7c340f190f9cafc69e46748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b304cd14b65640dab95dc8926eb90818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:32.857592 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-964c18b8-8abe-4f1d-ab9f-42005e62d50f tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] 10.222.0.60 "GET /compute/v2.1/servers/fcc183e1-b880-4005-bb3e-90ab91ed7911" status: 200 len: 1366 microversion: 2.57 time: 0.332655 Sep 14 09:04:32.858239 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f0a3c5b2-55c1-4099-8d23-cc9e7a252d1f tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:32.858875 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f0a3c5b2-55c1-4099-8d23-cc9e7a252d1f tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] [instance: adbd193b-b0ae-40c1-97b5-7fbb9077942b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:32.861526 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1830/3621] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:04:32 2022] GET /compute/v2.1/servers/fcc183e1-b880-4005-bb3e-90ab91ed7911 => generated 1366 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:04:32.873904 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f0a3c5b2-55c1-4099-8d23-cc9e7a252d1f tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:32.874400 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f0a3c5b2-55c1-4099-8d23-cc9e7a252d1f tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:32.901829 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f0a3c5b2-55c1-4099-8d23-cc9e7a252d1f tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:32.902626 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f0a3c5b2-55c1-4099-8d23-cc9e7a252d1f tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:32.903149 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f0a3c5b2-55c1-4099-8d23-cc9e7a252d1f tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:32.903591 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f0a3c5b2-55c1-4099-8d23-cc9e7a252d1f tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:32.972970 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-7c5c3e41-6d01-46e5-ad31-c6daee6bff70 req-55815884-2842-48ef-a4c9-d3e95df13d86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2aefa743-500a-4cd6-b3d9-d1cf138ee1da", "name": "network-vif-deleted", "tag": "9a1b9324-7bb5-4a21-a7e8-7e091b71bdaf"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:04:33.018513 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-7c5c3e41-6d01-46e5-ad31-c6daee6bff70 req-55815884-2842-48ef-a4c9-d3e95df13d86 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:33.019785 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-7c5c3e41-6d01-46e5-ad31-c6daee6bff70 req-55815884-2842-48ef-a4c9-d3e95df13d86 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:33.024040 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-7c5c3e41-6d01-46e5-ad31-c6daee6bff70 req-55815884-2842-48ef-a4c9-d3e95df13d86 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:33.098547 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-7c5c3e41-6d01-46e5-ad31-c6daee6bff70 req-55815884-2842-48ef-a4c9-d3e95df13d86 service nova] Creating event network-vif-deleted:9a1b9324-7bb5-4a21-a7e8-7e091b71bdaf for instance 2aefa743-500a-4cd6-b3d9-d1cf138ee1da on n-h2-836830-18 Sep 14 09:04:33.113333 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-7c5c3e41-6d01-46e5-ad31-c6daee6bff70 req-55815884-2842-48ef-a4c9-d3e95df13d86 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144075 Sep 14 09:04:33.114892 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1831/3622] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:04:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:04:33.219216 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-51bdbc7f-c153-4ac7-b9bc-d0c1cbf7dde1 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:33.220003 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-51bdbc7f-c153-4ac7-b9bc-d0c1cbf7dde1 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] [instance: c78e1261-6476-4835-882e-3e59b1d1083e] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:33.232784 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-51bdbc7f-c153-4ac7-b9bc-d0c1cbf7dde1 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:33.233294 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-51bdbc7f-c153-4ac7-b9bc-d0c1cbf7dde1 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:33.233720 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-51bdbc7f-c153-4ac7-b9bc-d0c1cbf7dde1 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:33.239856 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-51bdbc7f-c153-4ac7-b9bc-d0c1cbf7dde1 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:33.240352 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-51bdbc7f-c153-4ac7-b9bc-d0c1cbf7dde1 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:33.240806 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-51bdbc7f-c153-4ac7-b9bc-d0c1cbf7dde1 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:33.633762 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-51bdbc7f-c153-4ac7-b9bc-d0c1cbf7dde1 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504ea33de5724b518bcdf28076d6361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd19911fb94d47ab92893a3ec449fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:33.641171 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f0a3c5b2-55c1-4099-8d23-cc9e7a252d1f tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebe0be597a44e0bad22fbcf5c9249d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49345e5148f4d7aae1488e735c76590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:33.653073 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f0a3c5b2-55c1-4099-8d23-cc9e7a252d1f tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] 10.222.0.60 "GET /compute/v2.1/servers/adbd193b-b0ae-40c1-97b5-7fbb9077942b" status: 200 len: 1325 microversion: 2.1 time: 0.798630 Sep 14 09:04:33.654201 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1792/3623] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:04:32 2022] GET /compute/v2.1/servers/adbd193b-b0ae-40c1-97b5-7fbb9077942b => generated 1325 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:04:33.676287 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-51bdbc7f-c153-4ac7-b9bc-d0c1cbf7dde1 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] 10.222.0.60 "GET /compute/v2.1/servers/c78e1261-6476-4835-882e-3e59b1d1083e" status: 200 len: 1222 microversion: 2.1 time: 0.460074 Sep 14 09:04:33.691051 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1832/3624] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:04:33 2022] GET /compute/v2.1/servers/c78e1261-6476-4835-882e-3e59b1d1083e => generated 1222 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:04:33.697906 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-faba4172-c405-4016-b235-3810efc77dd9 req-01d45fa9-ac1a-4df1-afa6-799377bf3348 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d98ba025-ba7a-40fa-8fd2-44eeef653b6a", "name": "network-vif-deleted", "tag": "3a5171fd-1fb3-45a5-96ab-d18a838c87da"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:04:33.709954 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-faba4172-c405-4016-b235-3810efc77dd9 req-01d45fa9-ac1a-4df1-afa6-799377bf3348 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:33.710658 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-faba4172-c405-4016-b235-3810efc77dd9 req-01d45fa9-ac1a-4df1-afa6-799377bf3348 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:33.711308 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-faba4172-c405-4016-b235-3810efc77dd9 req-01d45fa9-ac1a-4df1-afa6-799377bf3348 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:33.739914 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-faba4172-c405-4016-b235-3810efc77dd9 req-01d45fa9-ac1a-4df1-afa6-799377bf3348 service nova] Creating event network-vif-deleted:3a5171fd-1fb3-45a5-96ab-d18a838c87da for instance d98ba025-ba7a-40fa-8fd2-44eeef653b6a on n-h2-836830-18 Sep 14 09:04:33.751856 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-faba4172-c405-4016-b235-3810efc77dd9 req-01d45fa9-ac1a-4df1-afa6-799377bf3348 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096214 Sep 14 09:04:33.755591 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1793/3625] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:04:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:04:33.889058 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-426b5699-233d-42d8-9444-d35adb1e99aa tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:33.890728 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-426b5699-233d-42d8-9444-d35adb1e99aa tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] [instance: fcc183e1-b880-4005-bb3e-90ab91ed7911] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:33.906819 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-426b5699-233d-42d8-9444-d35adb1e99aa tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:33.907401 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-426b5699-233d-42d8-9444-d35adb1e99aa tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:33.907874 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-426b5699-233d-42d8-9444-d35adb1e99aa tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:33.908817 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-426b5699-233d-42d8-9444-d35adb1e99aa tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:33.909331 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-426b5699-233d-42d8-9444-d35adb1e99aa tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:33.910014 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-426b5699-233d-42d8-9444-d35adb1e99aa tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:34.065415 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-15833f7e-7408-41d9-9659-7fccd9eba0e9 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:34.066600 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-15833f7e-7408-41d9-9659-7fccd9eba0e9 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: ef2a3ebb-090f-484c-9749-42c000375ec5] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:34.075651 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-15833f7e-7408-41d9-9659-7fccd9eba0e9 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:34.088367 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-15833f7e-7408-41d9-9659-7fccd9eba0e9 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:34.088816 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-15833f7e-7408-41d9-9659-7fccd9eba0e9 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:34.089562 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-15833f7e-7408-41d9-9659-7fccd9eba0e9 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:34.090022 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-15833f7e-7408-41d9-9659-7fccd9eba0e9 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:34.090448 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-15833f7e-7408-41d9-9659-7fccd9eba0e9 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:34.122797 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-15833f7e-7408-41d9-9659-7fccd9eba0e9 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] HTTP exception thrown: Instance ef2a3ebb-090f-484c-9749-42c000375ec5 could not be found. Sep 14 09:04:34.124551 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-15833f7e-7408-41d9-9659-7fccd9eba0e9 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Request method failure captured: Sep 14 09:04:34.124551 n-d-836830-18 devstack@n-api.service[128759]: request: DELETE /compute/v2.1/servers/ef2a3ebb-090f-484c-9749-42c000375ec5 HTTP/1.1 Sep 14 09:04:34.124551 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:04:34.124551 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:04:34.124551 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:04:34.124551 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:04:34.124551 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:04:34.124551 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:04:34.124551 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:04:34.124551 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:04:34.124551 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZfruMTQYBTAiiDSnzM1mYEpmuEj9qljISQOJ4EBe2ad6zsfFzAf8FVBubQCt-Sdr-zCKCq1jxjsj_azLMK_SQWZ09VXr62FV-261vpzTW6inln_93a6hl3DeVdX6cuYwx-Go-beMey4bY4s6iPFtULEKgIbxHUgjvgK1DEFOEvCwSQ Sep 14 09:04:34.124551 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:04:34.124551 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:04:34.124551 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:04:34.124551 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:04:34.124551 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:04:34.124551 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:04:34.124551 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 4d42bf4d573b4bf9a0d8c9e73260af7e Sep 14 09:04:34.124551 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-DeleteServersTestJSON-1669995002 Sep 14 09:04:34.124551 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:04:34.124551 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:04:34.124551 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/4d42bf4d573b4bf9a0d8c9e73260af7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_4d42bf4d573b4bf9a0d8c9e73260af7e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4d42bf4d573b4bf9a0d8c9e73260af7e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4d42bf4d573b4bf9a0d8c9e73260af7e"}]}] Sep 14 09:04:34.124551 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-DeleteServersTestJSON-1669995002 Sep 14 09:04:34.124551 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 4d42bf4d573b4bf9a0d8c9e73260af7e Sep 14 09:04:34.124551 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-DeleteServersTestJSON-1669995002 Sep 14 09:04:34.124551 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-DeleteServersTestJSON-1669995002-project Sep 14 09:04:34.124551 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:04:34.124551 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:04:34.124551 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 47c95b28481b451bb03fb2c0240d0310 Sep 14 09:04:34.124551 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-DeleteServersTestJSON-1669995002-project Sep 14 09:04:34.124551 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:04:34.124551 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance ef2a3ebb-090f-484c-9749-42c000375ec5 could not be found. Sep 14 09:04:34.124551 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': 'ef2a3ebb-090f-484c-9749-42c000375ec5'} Sep 14 09:04:34.124551 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:04:34.124551 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:04:34.124551 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:04:34.124551 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:04:34.124551 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:04:34.124551 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:04:34.124551 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:04:34.124551 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:04:34.124551 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:04:34.124551 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:04:34.124551 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef2a3ebb-090f-484c-9749-42c000375ec5 could not be found. Sep 14 09:04:34.124551 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:04:34.124551 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:04:34.124551 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:04:34.124551 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:04:34.124551 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:04:34.124551 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:04:34.124551 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:04:34.124551 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:04:34.124551 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:04:34.124551 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:04:34.124551 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 09:04:34.124551 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 09:04:34.124551 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 09:04:34.124551 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 09:04:34.124551 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:04:34.124551 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:04:34.124551 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:04:34.124551 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:04:34.129381 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef2a3ebb-090f-484c-9749-42c000375ec5 could not be found. Sep 14 09:04:34.129381 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:04:34.129381 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:04:34.129381 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:04:34.129381 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:04:34.129381 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:04:34.129381 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:04:34.129381 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:04:34.129381 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:04:34.129381 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef2a3ebb-090f-484c-9749-42c000375ec5 could not be found. Sep 14 09:04:34.129381 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:04:34.129381 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-15833f7e-7408-41d9-9659-7fccd9eba0e9 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Returning 404 to user: Instance ef2a3ebb-090f-484c-9749-42c000375ec5 could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:04:34.129381 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-15833f7e-7408-41d9-9659-7fccd9eba0e9 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "DELETE /compute/v2.1/servers/ef2a3ebb-090f-484c-9749-42c000375ec5" status: 404 len: 111 microversion: 2.1 time: 0.071150 Sep 14 09:04:34.129381 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1794/3626] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:04:34 2022] DELETE /compute/v2.1/servers/ef2a3ebb-090f-484c-9749-42c000375ec5 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 14 09:04:34.139629 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c21b15fa-3738-40f5-97f0-a8746bed7790 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:34.140254 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-c21b15fa-3738-40f5-97f0-a8746bed7790 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: ef2a3ebb-090f-484c-9749-42c000375ec5] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:34.155829 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c21b15fa-3738-40f5-97f0-a8746bed7790 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:34.156324 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c21b15fa-3738-40f5-97f0-a8746bed7790 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:34.156763 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c21b15fa-3738-40f5-97f0-a8746bed7790 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:34.157474 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c21b15fa-3738-40f5-97f0-a8746bed7790 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:34.157922 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c21b15fa-3738-40f5-97f0-a8746bed7790 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:34.158198 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-426b5699-233d-42d8-9444-d35adb1e99aa tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6b965ba7c340f190f9cafc69e46748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b304cd14b65640dab95dc8926eb90818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:34.158350 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c21b15fa-3738-40f5-97f0-a8746bed7790 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:34.177953 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-426b5699-233d-42d8-9444-d35adb1e99aa tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6b965ba7c340f190f9cafc69e46748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b304cd14b65640dab95dc8926eb90818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:34.185221 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-426b5699-233d-42d8-9444-d35adb1e99aa tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6b965ba7c340f190f9cafc69e46748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b304cd14b65640dab95dc8926eb90818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:34.190703 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-c21b15fa-3738-40f5-97f0-a8746bed7790 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] HTTP exception thrown: Instance ef2a3ebb-090f-484c-9749-42c000375ec5 could not be found. Sep 14 09:04:34.190986 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-426b5699-233d-42d8-9444-d35adb1e99aa tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] 10.222.0.60 "GET /compute/v2.1/servers/fcc183e1-b880-4005-bb3e-90ab91ed7911" status: 200 len: 1366 microversion: 2.57 time: 0.305527 Sep 14 09:04:34.192348 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c21b15fa-3738-40f5-97f0-a8746bed7790 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Request method failure captured: Sep 14 09:04:34.192348 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/ef2a3ebb-090f-484c-9749-42c000375ec5 HTTP/1.1 Sep 14 09:04:34.192348 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:04:34.192348 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:04:34.192348 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:04:34.192348 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:04:34.192348 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:04:34.192348 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:04:34.192348 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:04:34.192348 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:04:34.192348 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZfruMTQYBTAiiDSnzM1mYEpmuEj9qljISQOJ4EBe2ad6zsfFzAf8FVBubQCt-Sdr-zCKCq1jxjsj_azLMK_SQWZ09VXr62FV-261vpzTW6inln_93a6hl3DeVdX6cuYwx-Go-beMey4bY4s6iPFtULEKgIbxHUgjvgK1DEFOEvCwSQ Sep 14 09:04:34.192348 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:04:34.192348 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:04:34.192348 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:04:34.192348 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:04:34.192348 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:04:34.192348 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:04:34.192348 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 4d42bf4d573b4bf9a0d8c9e73260af7e Sep 14 09:04:34.192348 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-DeleteServersTestJSON-1669995002 Sep 14 09:04:34.192348 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:04:34.192348 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:04:34.192348 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/4d42bf4d573b4bf9a0d8c9e73260af7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_4d42bf4d573b4bf9a0d8c9e73260af7e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4d42bf4d573b4bf9a0d8c9e73260af7e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4d42bf4d573b4bf9a0d8c9e73260af7e"}]}] Sep 14 09:04:34.192348 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-DeleteServersTestJSON-1669995002 Sep 14 09:04:34.192348 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 4d42bf4d573b4bf9a0d8c9e73260af7e Sep 14 09:04:34.192348 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-DeleteServersTestJSON-1669995002 Sep 14 09:04:34.192348 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-DeleteServersTestJSON-1669995002-project Sep 14 09:04:34.192348 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:04:34.192348 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:04:34.192348 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 47c95b28481b451bb03fb2c0240d0310 Sep 14 09:04:34.192348 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-DeleteServersTestJSON-1669995002-project Sep 14 09:04:34.192348 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:04:34.192348 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance ef2a3ebb-090f-484c-9749-42c000375ec5 could not be found. Sep 14 09:04:34.192348 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': 'ef2a3ebb-090f-484c-9749-42c000375ec5'} Sep 14 09:04:34.192348 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:04:34.192348 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:04:34.192348 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:04:34.192348 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:04:34.192348 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:04:34.192348 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:04:34.192348 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:04:34.192348 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:04:34.192348 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:04:34.192348 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:04:34.192348 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef2a3ebb-090f-484c-9749-42c000375ec5 could not be found. Sep 14 09:04:34.192348 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:04:34.192348 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:04:34.192348 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:04:34.192348 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:04:34.192348 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:04:34.192348 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:04:34.192348 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:04:34.192348 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:04:34.192348 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:04:34.192348 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:04:34.192348 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:04:34.192348 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:04:34.192348 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:04:34.192348 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:04:34.192348 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:04:34.192348 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:04:34.192348 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef2a3ebb-090f-484c-9749-42c000375ec5 could not be found. Sep 14 09:04:34.192348 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:04:34.192348 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:04:34.192348 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:04:34.196986 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:04:34.196986 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:04:34.196986 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:04:34.196986 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:04:34.196986 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:04:34.196986 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef2a3ebb-090f-484c-9749-42c000375ec5 could not be found. Sep 14 09:04:34.196986 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:04:34.196986 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c21b15fa-3738-40f5-97f0-a8746bed7790 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Returning 404 to user: Instance ef2a3ebb-090f-484c-9749-42c000375ec5 could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:04:34.196986 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-c21b15fa-3738-40f5-97f0-a8746bed7790 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/ef2a3ebb-090f-484c-9749-42c000375ec5" status: 404 len: 111 microversion: 2.1 time: 0.058103 Sep 14 09:04:34.203099 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1833/3628] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:04:33 2022] GET /compute/v2.1/servers/fcc183e1-b880-4005-bb3e-90ab91ed7911 => generated 1366 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:04:34.203294 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1795/3628] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:04:34 2022] GET /compute/v2.1/servers/ef2a3ebb-090f-484c-9749-42c000375ec5 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 14 09:04:34.215636 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a6a5df8a-3b4e-4fce-9441-3a377d223bfb tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:34.216142 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-a6a5df8a-3b4e-4fce-9441-3a377d223bfb tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: 82774725-1b08-411d-b760-4ed6aa3cec68] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:34.222813 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a6a5df8a-3b4e-4fce-9441-3a377d223bfb tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:34.223359 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a6a5df8a-3b4e-4fce-9441-3a377d223bfb tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:34.223797 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a6a5df8a-3b4e-4fce-9441-3a377d223bfb tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:34.224506 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a6a5df8a-3b4e-4fce-9441-3a377d223bfb tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:34.225141 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a6a5df8a-3b4e-4fce-9441-3a377d223bfb tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:34.225773 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a6a5df8a-3b4e-4fce-9441-3a377d223bfb tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:34.244857 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-a6a5df8a-3b4e-4fce-9441-3a377d223bfb tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] HTTP exception thrown: Instance 82774725-1b08-411d-b760-4ed6aa3cec68 could not be found. Sep 14 09:04:34.247519 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a6a5df8a-3b4e-4fce-9441-3a377d223bfb tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Request method failure captured: Sep 14 09:04:34.247519 n-d-836830-18 devstack@n-api.service[128759]: request: DELETE /compute/v2.1/servers/82774725-1b08-411d-b760-4ed6aa3cec68 HTTP/1.1 Sep 14 09:04:34.247519 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:04:34.247519 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:04:34.247519 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:04:34.247519 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:04:34.247519 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:04:34.247519 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:04:34.247519 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:04:34.247519 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:04:34.247519 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZfruMTQYBTAiiDSnzM1mYEpmuEj9qljISQOJ4EBe2ad6zsfFzAf8FVBubQCt-Sdr-zCKCq1jxjsj_azLMK_SQWZ09VXr62FV-261vpzTW6inln_93a6hl3DeVdX6cuYwx-Go-beMey4bY4s6iPFtULEKgIbxHUgjvgK1DEFOEvCwSQ Sep 14 09:04:34.247519 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:04:34.247519 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:04:34.247519 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:04:34.247519 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:04:34.247519 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:04:34.247519 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:04:34.247519 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 4d42bf4d573b4bf9a0d8c9e73260af7e Sep 14 09:04:34.247519 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-DeleteServersTestJSON-1669995002 Sep 14 09:04:34.247519 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:04:34.247519 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:04:34.247519 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/4d42bf4d573b4bf9a0d8c9e73260af7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_4d42bf4d573b4bf9a0d8c9e73260af7e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4d42bf4d573b4bf9a0d8c9e73260af7e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4d42bf4d573b4bf9a0d8c9e73260af7e"}]}] Sep 14 09:04:34.247519 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-DeleteServersTestJSON-1669995002 Sep 14 09:04:34.247519 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 4d42bf4d573b4bf9a0d8c9e73260af7e Sep 14 09:04:34.247519 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-DeleteServersTestJSON-1669995002 Sep 14 09:04:34.247519 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-DeleteServersTestJSON-1669995002-project Sep 14 09:04:34.247519 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:04:34.247519 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:04:34.247519 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 47c95b28481b451bb03fb2c0240d0310 Sep 14 09:04:34.247519 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-DeleteServersTestJSON-1669995002-project Sep 14 09:04:34.247519 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:04:34.247519 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance 82774725-1b08-411d-b760-4ed6aa3cec68 could not be found. Sep 14 09:04:34.247519 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '82774725-1b08-411d-b760-4ed6aa3cec68'} Sep 14 09:04:34.247519 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:04:34.247519 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:04:34.247519 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:04:34.247519 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:04:34.247519 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:04:34.247519 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:04:34.247519 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:04:34.247519 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:04:34.247519 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:04:34.247519 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:04:34.247519 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82774725-1b08-411d-b760-4ed6aa3cec68 could not be found. Sep 14 09:04:34.247519 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:04:34.247519 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:04:34.247519 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:04:34.247519 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:04:34.247519 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:04:34.247519 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:04:34.247519 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:04:34.247519 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:04:34.247519 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:04:34.247519 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:04:34.247519 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 09:04:34.247519 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 09:04:34.247519 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 09:04:34.247519 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 09:04:34.247519 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:04:34.247519 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:04:34.247519 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:04:34.247519 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:04:34.252208 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82774725-1b08-411d-b760-4ed6aa3cec68 could not be found. Sep 14 09:04:34.252208 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:04:34.252208 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:04:34.252208 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:04:34.252208 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:04:34.252208 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:04:34.252208 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:04:34.252208 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:04:34.252208 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:04:34.252208 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82774725-1b08-411d-b760-4ed6aa3cec68 could not be found. Sep 14 09:04:34.252208 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:04:34.254285 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a6a5df8a-3b4e-4fce-9441-3a377d223bfb tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Returning 404 to user: Instance 82774725-1b08-411d-b760-4ed6aa3cec68 could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:04:34.254714 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a6a5df8a-3b4e-4fce-9441-3a377d223bfb tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "DELETE /compute/v2.1/servers/82774725-1b08-411d-b760-4ed6aa3cec68" status: 404 len: 111 microversion: 2.1 time: 0.044184 Sep 14 09:04:34.255655 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1796/3629] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:04:34 2022] DELETE /compute/v2.1/servers/82774725-1b08-411d-b760-4ed6aa3cec68 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:04:34.263757 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-77c5a9b0-4a9c-4447-85c3-1e8cd6b53d45 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:34.264818 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-77c5a9b0-4a9c-4447-85c3-1e8cd6b53d45 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] [instance: 82774725-1b08-411d-b760-4ed6aa3cec68] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:34.282076 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-77c5a9b0-4a9c-4447-85c3-1e8cd6b53d45 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:34.286198 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-77c5a9b0-4a9c-4447-85c3-1e8cd6b53d45 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:34.287763 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-77c5a9b0-4a9c-4447-85c3-1e8cd6b53d45 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:34.290778 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-77c5a9b0-4a9c-4447-85c3-1e8cd6b53d45 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:34.291576 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-77c5a9b0-4a9c-4447-85c3-1e8cd6b53d45 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:34.293459 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-77c5a9b0-4a9c-4447-85c3-1e8cd6b53d45 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:34.330497 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-77c5a9b0-4a9c-4447-85c3-1e8cd6b53d45 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] HTTP exception thrown: Instance 82774725-1b08-411d-b760-4ed6aa3cec68 could not be found. Sep 14 09:04:34.333315 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-77c5a9b0-4a9c-4447-85c3-1e8cd6b53d45 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Request method failure captured: Sep 14 09:04:34.333315 n-d-836830-18 devstack@n-api.service[128758]: request: GET /compute/v2.1/servers/82774725-1b08-411d-b760-4ed6aa3cec68 HTTP/1.1 Sep 14 09:04:34.333315 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 09:04:34.333315 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 09:04:34.333315 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 09:04:34.333315 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 09:04:34.333315 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 09:04:34.333315 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 09:04:34.333315 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 09:04:34.333315 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 09:04:34.333315 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZfruMTQYBTAiiDSnzM1mYEpmuEj9qljISQOJ4EBe2ad6zsfFzAf8FVBubQCt-Sdr-zCKCq1jxjsj_azLMK_SQWZ09VXr62FV-261vpzTW6inln_93a6hl3DeVdX6cuYwx-Go-beMey4bY4s6iPFtULEKgIbxHUgjvgK1DEFOEvCwSQ Sep 14 09:04:34.333315 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 09:04:34.333315 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 09:04:34.333315 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 09:04:34.333315 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 09:04:34.333315 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 09:04:34.333315 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 09:04:34.333315 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 4d42bf4d573b4bf9a0d8c9e73260af7e Sep 14 09:04:34.333315 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-DeleteServersTestJSON-1669995002 Sep 14 09:04:34.333315 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 09:04:34.333315 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 09:04:34.333315 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/4d42bf4d573b4bf9a0d8c9e73260af7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_4d42bf4d573b4bf9a0d8c9e73260af7e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4d42bf4d573b4bf9a0d8c9e73260af7e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4d42bf4d573b4bf9a0d8c9e73260af7e"}]}] Sep 14 09:04:34.333315 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-DeleteServersTestJSON-1669995002 Sep 14 09:04:34.333315 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 4d42bf4d573b4bf9a0d8c9e73260af7e Sep 14 09:04:34.333315 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-DeleteServersTestJSON-1669995002 Sep 14 09:04:34.333315 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-DeleteServersTestJSON-1669995002-project Sep 14 09:04:34.333315 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 09:04:34.333315 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 09:04:34.333315 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 47c95b28481b451bb03fb2c0240d0310 Sep 14 09:04:34.333315 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-DeleteServersTestJSON-1669995002-project Sep 14 09:04:34.333315 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 09:04:34.333315 n-d-836830-18 devstack@n-api.service[128758]: exception: Instance 82774725-1b08-411d-b760-4ed6aa3cec68 could not be found. Sep 14 09:04:34.333315 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': '82774725-1b08-411d-b760-4ed6aa3cec68'} Sep 14 09:04:34.333315 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:04:34.333315 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:04:34.333315 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:04:34.333315 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:04:34.333315 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:04:34.333315 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:04:34.333315 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:04:34.333315 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:04:34.333315 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:04:34.333315 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:04:34.333315 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82774725-1b08-411d-b760-4ed6aa3cec68 could not be found. Sep 14 09:04:34.333315 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:04:34.333315 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:04:34.333315 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:04:34.333315 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:04:34.333315 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:04:34.333315 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:04:34.333315 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:04:34.333315 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:04:34.333315 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:04:34.333315 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:04:34.333315 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:04:34.333315 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:04:34.333315 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:04:34.333315 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:04:34.333315 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:04:34.333315 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:04:34.333315 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82774725-1b08-411d-b760-4ed6aa3cec68 could not be found. Sep 14 09:04:34.333315 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:04:34.333315 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:04:34.333315 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:04:34.338434 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:04:34.338434 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:04:34.338434 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:04:34.338434 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:04:34.338434 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:04:34.338434 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82774725-1b08-411d-b760-4ed6aa3cec68 could not be found. Sep 14 09:04:34.338434 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:04:34.342042 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-77c5a9b0-4a9c-4447-85c3-1e8cd6b53d45 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] Returning 404 to user: Instance 82774725-1b08-411d-b760-4ed6aa3cec68 could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:04:34.343357 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-77c5a9b0-4a9c-4447-85c3-1e8cd6b53d45 tempest-DeleteServersTestJSON-1669995002 tempest-DeleteServersTestJSON-1669995002-project] 10.222.0.60 "GET /compute/v2.1/servers/82774725-1b08-411d-b760-4ed6aa3cec68" status: 404 len: 111 microversion: 2.1 time: 0.083554 Sep 14 09:04:34.355464 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1834/3630] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:04:34 2022] GET /compute/v2.1/servers/82774725-1b08-411d-b760-4ed6aa3cec68 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:04:34.680566 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-bae05c61-afcb-4d56-b92a-ee4f42db9919 tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:34.681450 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-bae05c61-afcb-4d56-b92a-ee4f42db9919 tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] [instance: adbd193b-b0ae-40c1-97b5-7fbb9077942b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:34.691969 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bae05c61-afcb-4d56-b92a-ee4f42db9919 tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:34.694083 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bae05c61-afcb-4d56-b92a-ee4f42db9919 tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:34.695074 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bae05c61-afcb-4d56-b92a-ee4f42db9919 tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:34.697593 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bae05c61-afcb-4d56-b92a-ee4f42db9919 tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:34.698368 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bae05c61-afcb-4d56-b92a-ee4f42db9919 tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:34.704375 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-da2fb9bb-7079-4b6d-996b-4bbc2bf59da3 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:34.705611 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-da2fb9bb-7079-4b6d-996b-4bbc2bf59da3 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] [instance: c78e1261-6476-4835-882e-3e59b1d1083e] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:34.712897 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bae05c61-afcb-4d56-b92a-ee4f42db9919 tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:34.721014 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-da2fb9bb-7079-4b6d-996b-4bbc2bf59da3 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:34.723262 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-da2fb9bb-7079-4b6d-996b-4bbc2bf59da3 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:34.723900 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-da2fb9bb-7079-4b6d-996b-4bbc2bf59da3 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:34.728449 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-da2fb9bb-7079-4b6d-996b-4bbc2bf59da3 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:34.729581 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-da2fb9bb-7079-4b6d-996b-4bbc2bf59da3 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:34.730292 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-da2fb9bb-7079-4b6d-996b-4bbc2bf59da3 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:34.875749 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-da2fb9bb-7079-4b6d-996b-4bbc2bf59da3 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504ea33de5724b518bcdf28076d6361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd19911fb94d47ab92893a3ec449fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:34.892087 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-da2fb9bb-7079-4b6d-996b-4bbc2bf59da3 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] 10.222.0.60 "GET /compute/v2.1/servers/c78e1261-6476-4835-882e-3e59b1d1083e" status: 200 len: 1222 microversion: 2.1 time: 0.190315 Sep 14 09:04:34.892729 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1835/3631] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:04:34 2022] GET /compute/v2.1/servers/c78e1261-6476-4835-882e-3e59b1d1083e => generated 1222 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:04:35.020344 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-bae05c61-afcb-4d56-b92a-ee4f42db9919 tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebe0be597a44e0bad22fbcf5c9249d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49345e5148f4d7aae1488e735c76590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:35.029465 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-bae05c61-afcb-4d56-b92a-ee4f42db9919 tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] 10.222.0.60 "GET /compute/v2.1/servers/adbd193b-b0ae-40c1-97b5-7fbb9077942b" status: 200 len: 1325 microversion: 2.1 time: 0.355688 Sep 14 09:04:35.030050 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1797/3632] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:04:34 2022] GET /compute/v2.1/servers/adbd193b-b0ae-40c1-97b5-7fbb9077942b => generated 1325 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:04:35.229553 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-0469bf5b-da7b-49d6-bb62-ae28d6b0f714 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:35.230184 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-0469bf5b-da7b-49d6-bb62-ae28d6b0f714 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] [instance: fcc183e1-b880-4005-bb3e-90ab91ed7911] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:35.243088 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0469bf5b-da7b-49d6-bb62-ae28d6b0f714 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:35.244170 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0469bf5b-da7b-49d6-bb62-ae28d6b0f714 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:35.244622 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0469bf5b-da7b-49d6-bb62-ae28d6b0f714 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:35.245341 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0469bf5b-da7b-49d6-bb62-ae28d6b0f714 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:35.245801 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0469bf5b-da7b-49d6-bb62-ae28d6b0f714 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:35.246229 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0469bf5b-da7b-49d6-bb62-ae28d6b0f714 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:35.500186 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-0469bf5b-da7b-49d6-bb62-ae28d6b0f714 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6b965ba7c340f190f9cafc69e46748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b304cd14b65640dab95dc8926eb90818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:35.512312 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-0469bf5b-da7b-49d6-bb62-ae28d6b0f714 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6b965ba7c340f190f9cafc69e46748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b304cd14b65640dab95dc8926eb90818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:35.514214 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-0469bf5b-da7b-49d6-bb62-ae28d6b0f714 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6b965ba7c340f190f9cafc69e46748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b304cd14b65640dab95dc8926eb90818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:35.519648 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-0469bf5b-da7b-49d6-bb62-ae28d6b0f714 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] 10.222.0.60 "GET /compute/v2.1/servers/fcc183e1-b880-4005-bb3e-90ab91ed7911" status: 200 len: 1366 microversion: 2.57 time: 0.295550 Sep 14 09:04:35.520565 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1836/3633] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:04:35 2022] GET /compute/v2.1/servers/fcc183e1-b880-4005-bb3e-90ab91ed7911 => generated 1366 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:04:35.917993 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-49b1d624-dc20-49e3-b710-e5656c1010d4 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:35.918568 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-49b1d624-dc20-49e3-b710-e5656c1010d4 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] [instance: c78e1261-6476-4835-882e-3e59b1d1083e] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:35.925488 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-49b1d624-dc20-49e3-b710-e5656c1010d4 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:35.926091 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-49b1d624-dc20-49e3-b710-e5656c1010d4 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:35.926539 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-49b1d624-dc20-49e3-b710-e5656c1010d4 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:35.927278 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-49b1d624-dc20-49e3-b710-e5656c1010d4 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:35.927742 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-49b1d624-dc20-49e3-b710-e5656c1010d4 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:35.928193 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-49b1d624-dc20-49e3-b710-e5656c1010d4 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:36.035212 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-49b1d624-dc20-49e3-b710-e5656c1010d4 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504ea33de5724b518bcdf28076d6361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd19911fb94d47ab92893a3ec449fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:36.052246 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-49b1d624-dc20-49e3-b710-e5656c1010d4 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] 10.222.0.60 "GET /compute/v2.1/servers/c78e1261-6476-4835-882e-3e59b1d1083e" status: 200 len: 1214 microversion: 2.1 time: 0.138286 Sep 14 09:04:36.060060 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-9e15f630-2d4f-4aa4-a021-f75ab6f6a6eb tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:36.061124 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-9e15f630-2d4f-4aa4-a021-f75ab6f6a6eb tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] [instance: adbd193b-b0ae-40c1-97b5-7fbb9077942b] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:36.070174 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1798/3634] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:04:35 2022] GET /compute/v2.1/servers/c78e1261-6476-4835-882e-3e59b1d1083e => generated 1214 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:04:36.082350 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9e15f630-2d4f-4aa4-a021-f75ab6f6a6eb tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:36.083554 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9e15f630-2d4f-4aa4-a021-f75ab6f6a6eb tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:36.084069 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9e15f630-2d4f-4aa4-a021-f75ab6f6a6eb tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:36.085018 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9e15f630-2d4f-4aa4-a021-f75ab6f6a6eb tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:36.093281 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9e15f630-2d4f-4aa4-a021-f75ab6f6a6eb tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:36.094596 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9e15f630-2d4f-4aa4-a021-f75ab6f6a6eb tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:36.360839 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-9e15f630-2d4f-4aa4-a021-f75ab6f6a6eb tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebe0be597a44e0bad22fbcf5c9249d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49345e5148f4d7aae1488e735c76590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:36.378278 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-9e15f630-2d4f-4aa4-a021-f75ab6f6a6eb tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] 10.222.0.60 "GET /compute/v2.1/servers/adbd193b-b0ae-40c1-97b5-7fbb9077942b" status: 200 len: 1325 microversion: 2.1 time: 0.328758 Sep 14 09:04:36.397014 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1837/3635] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:04:36 2022] GET /compute/v2.1/servers/adbd193b-b0ae-40c1-97b5-7fbb9077942b => generated 1325 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:04:36.549592 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-6affdd6b-0c5d-4668-9e8c-a7e52735192f tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:36.551241 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-6affdd6b-0c5d-4668-9e8c-a7e52735192f tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] [instance: fcc183e1-b880-4005-bb3e-90ab91ed7911] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:36.561615 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6affdd6b-0c5d-4668-9e8c-a7e52735192f tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:36.562717 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6affdd6b-0c5d-4668-9e8c-a7e52735192f tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:36.563519 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6affdd6b-0c5d-4668-9e8c-a7e52735192f tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:36.564895 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6affdd6b-0c5d-4668-9e8c-a7e52735192f tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:36.565595 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6affdd6b-0c5d-4668-9e8c-a7e52735192f tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:36.566310 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6affdd6b-0c5d-4668-9e8c-a7e52735192f tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:36.658266 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-6affdd6b-0c5d-4668-9e8c-a7e52735192f tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6b965ba7c340f190f9cafc69e46748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b304cd14b65640dab95dc8926eb90818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:36.668615 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-6affdd6b-0c5d-4668-9e8c-a7e52735192f tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6b965ba7c340f190f9cafc69e46748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b304cd14b65640dab95dc8926eb90818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:36.671616 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-6affdd6b-0c5d-4668-9e8c-a7e52735192f tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6b965ba7c340f190f9cafc69e46748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b304cd14b65640dab95dc8926eb90818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:36.673971 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-6affdd6b-0c5d-4668-9e8c-a7e52735192f tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] 10.222.0.60 "GET /compute/v2.1/servers/fcc183e1-b880-4005-bb3e-90ab91ed7911" status: 200 len: 1366 microversion: 2.57 time: 0.128824 Sep 14 09:04:36.674958 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1799/3636] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:04:36 2022] GET /compute/v2.1/servers/fcc183e1-b880-4005-bb3e-90ab91ed7911 => generated 1366 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:04:37.078486 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-e2e07e46-38ab-4de3-af0b-b8e01190e415 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:37.079889 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-e2e07e46-38ab-4de3-af0b-b8e01190e415 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] [instance: c78e1261-6476-4835-882e-3e59b1d1083e] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:37.093793 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e2e07e46-38ab-4de3-af0b-b8e01190e415 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:37.095573 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e2e07e46-38ab-4de3-af0b-b8e01190e415 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:37.097716 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e2e07e46-38ab-4de3-af0b-b8e01190e415 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:37.101109 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e2e07e46-38ab-4de3-af0b-b8e01190e415 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:37.101959 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e2e07e46-38ab-4de3-af0b-b8e01190e415 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:37.110184 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e2e07e46-38ab-4de3-af0b-b8e01190e415 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:37.121284 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=100 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:04:37.336307 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-e2e07e46-38ab-4de3-af0b-b8e01190e415 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504ea33de5724b518bcdf28076d6361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd19911fb94d47ab92893a3ec449fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:37.358243 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-e2e07e46-38ab-4de3-af0b-b8e01190e415 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] 10.222.0.60 "GET /compute/v2.1/servers/c78e1261-6476-4835-882e-3e59b1d1083e" status: 200 len: 1276 microversion: 2.1 time: 0.282486 Sep 14 09:04:37.358991 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1838/3637] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:04:37 2022] GET /compute/v2.1/servers/c78e1261-6476-4835-882e-3e59b1d1083e => generated 1276 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:04:37.409653 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-53c71554-9737-4387-97d0-c04350ec8f4d tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:37.413522 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-53c71554-9737-4387-97d0-c04350ec8f4d tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] [instance: adbd193b-b0ae-40c1-97b5-7fbb9077942b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:37.420981 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-53c71554-9737-4387-97d0-c04350ec8f4d tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:37.421740 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-53c71554-9737-4387-97d0-c04350ec8f4d tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:37.422387 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-53c71554-9737-4387-97d0-c04350ec8f4d tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:37.423309 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-53c71554-9737-4387-97d0-c04350ec8f4d tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:37.423952 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-53c71554-9737-4387-97d0-c04350ec8f4d tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:37.424559 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-53c71554-9737-4387-97d0-c04350ec8f4d tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:37.707935 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-32ade030-1c07-4202-99ac-84f37208d5e3 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:37.709548 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-32ade030-1c07-4202-99ac-84f37208d5e3 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] [instance: fcc183e1-b880-4005-bb3e-90ab91ed7911] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:37.719132 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-32ade030-1c07-4202-99ac-84f37208d5e3 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:37.719986 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-32ade030-1c07-4202-99ac-84f37208d5e3 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:37.720615 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-32ade030-1c07-4202-99ac-84f37208d5e3 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:37.721869 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-32ade030-1c07-4202-99ac-84f37208d5e3 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:37.723182 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-32ade030-1c07-4202-99ac-84f37208d5e3 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:37.723854 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-32ade030-1c07-4202-99ac-84f37208d5e3 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:37.781377 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-53c71554-9737-4387-97d0-c04350ec8f4d tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebe0be597a44e0bad22fbcf5c9249d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49345e5148f4d7aae1488e735c76590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:37.790040 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-53c71554-9737-4387-97d0-c04350ec8f4d tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] 10.222.0.60 "GET /compute/v2.1/servers/adbd193b-b0ae-40c1-97b5-7fbb9077942b" status: 200 len: 1325 microversion: 2.1 time: 0.389949 Sep 14 09:04:37.791132 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1800/3638] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:04:37 2022] GET /compute/v2.1/servers/adbd193b-b0ae-40c1-97b5-7fbb9077942b => generated 1325 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:04:37.874804 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-32ade030-1c07-4202-99ac-84f37208d5e3 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6b965ba7c340f190f9cafc69e46748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b304cd14b65640dab95dc8926eb90818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:37.890751 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-32ade030-1c07-4202-99ac-84f37208d5e3 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6b965ba7c340f190f9cafc69e46748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b304cd14b65640dab95dc8926eb90818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:37.894966 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-32ade030-1c07-4202-99ac-84f37208d5e3 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6b965ba7c340f190f9cafc69e46748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b304cd14b65640dab95dc8926eb90818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:37.896293 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-32ade030-1c07-4202-99ac-84f37208d5e3 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] 10.222.0.60 "GET /compute/v2.1/servers/fcc183e1-b880-4005-bb3e-90ab91ed7911" status: 200 len: 1372 microversion: 2.57 time: 0.196259 Sep 14 09:04:37.901908 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1839/3639] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:04:37 2022] GET /compute/v2.1/servers/fcc183e1-b880-4005-bb3e-90ab91ed7911 => generated 1372 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:04:38.382340 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-68fcf3c5-f4ba-4854-8fe2-d7b41f65c3e7 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:38.383309 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-68fcf3c5-f4ba-4854-8fe2-d7b41f65c3e7 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] [instance: c78e1261-6476-4835-882e-3e59b1d1083e] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:38.394980 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-68fcf3c5-f4ba-4854-8fe2-d7b41f65c3e7 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:38.400402 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-68fcf3c5-f4ba-4854-8fe2-d7b41f65c3e7 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:38.401096 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-68fcf3c5-f4ba-4854-8fe2-d7b41f65c3e7 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:38.402020 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-68fcf3c5-f4ba-4854-8fe2-d7b41f65c3e7 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:38.402682 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-68fcf3c5-f4ba-4854-8fe2-d7b41f65c3e7 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:38.403321 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-68fcf3c5-f4ba-4854-8fe2-d7b41f65c3e7 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:38.539923 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-68fcf3c5-f4ba-4854-8fe2-d7b41f65c3e7 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504ea33de5724b518bcdf28076d6361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd19911fb94d47ab92893a3ec449fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:38.566344 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-68fcf3c5-f4ba-4854-8fe2-d7b41f65c3e7 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] 10.222.0.60 "GET /compute/v2.1/servers/c78e1261-6476-4835-882e-3e59b1d1083e" status: 200 len: 1276 microversion: 2.1 time: 0.188254 Sep 14 09:04:38.568901 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1801/3640] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:04:38 2022] GET /compute/v2.1/servers/c78e1261-6476-4835-882e-3e59b1d1083e => generated 1276 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:04:38.822217 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a60c370d-be12-4fdd-a31b-fde475237b2e tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:38.825494 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-a60c370d-be12-4fdd-a31b-fde475237b2e tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] [instance: adbd193b-b0ae-40c1-97b5-7fbb9077942b] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:38.849011 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a60c370d-be12-4fdd-a31b-fde475237b2e tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:38.849622 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a60c370d-be12-4fdd-a31b-fde475237b2e tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:38.850372 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a60c370d-be12-4fdd-a31b-fde475237b2e tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:38.852361 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a60c370d-be12-4fdd-a31b-fde475237b2e tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:38.853195 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a60c370d-be12-4fdd-a31b-fde475237b2e tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:38.855080 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a60c370d-be12-4fdd-a31b-fde475237b2e tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:38.932048 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-6ae5ccdc-bc84-445c-8377-0f66335d02d1 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:38.932894 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-6ae5ccdc-bc84-445c-8377-0f66335d02d1 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] [instance: fcc183e1-b880-4005-bb3e-90ab91ed7911] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:38.940847 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6ae5ccdc-bc84-445c-8377-0f66335d02d1 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:38.941173 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6ae5ccdc-bc84-445c-8377-0f66335d02d1 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:38.946145 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6ae5ccdc-bc84-445c-8377-0f66335d02d1 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:38.947220 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6ae5ccdc-bc84-445c-8377-0f66335d02d1 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:38.950390 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6ae5ccdc-bc84-445c-8377-0f66335d02d1 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:38.951297 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6ae5ccdc-bc84-445c-8377-0f66335d02d1 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:39.652691 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-6ae5ccdc-bc84-445c-8377-0f66335d02d1 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6b965ba7c340f190f9cafc69e46748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b304cd14b65640dab95dc8926eb90818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:39.669612 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-6ae5ccdc-bc84-445c-8377-0f66335d02d1 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6b965ba7c340f190f9cafc69e46748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b304cd14b65640dab95dc8926eb90818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:39.689260 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-6ae5ccdc-bc84-445c-8377-0f66335d02d1 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6b965ba7c340f190f9cafc69e46748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b304cd14b65640dab95dc8926eb90818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:39.693813 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-a60c370d-be12-4fdd-a31b-fde475237b2e tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebe0be597a44e0bad22fbcf5c9249d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49345e5148f4d7aae1488e735c76590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:39.695855 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-6ae5ccdc-bc84-445c-8377-0f66335d02d1 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] 10.222.0.60 "GET /compute/v2.1/servers/fcc183e1-b880-4005-bb3e-90ab91ed7911" status: 200 len: 1372 microversion: 2.57 time: 0.768601 Sep 14 09:04:39.698564 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1802/3641] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:04:38 2022] GET /compute/v2.1/servers/fcc183e1-b880-4005-bb3e-90ab91ed7911 => generated 1372 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:04:39.705836 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-a60c370d-be12-4fdd-a31b-fde475237b2e tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] 10.222.0.60 "GET /compute/v2.1/servers/adbd193b-b0ae-40c1-97b5-7fbb9077942b" status: 200 len: 1325 microversion: 2.1 time: 0.893336 Sep 14 09:04:39.707350 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1840/3642] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:04:38 2022] GET /compute/v2.1/servers/adbd193b-b0ae-40c1-97b5-7fbb9077942b => generated 1325 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:04:39.711726 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-4cc0aa98-1721-40c2-897e-7a036d036f00 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:39.722449 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-4cc0aa98-1721-40c2-897e-7a036d036f00 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] [instance: c78e1261-6476-4835-882e-3e59b1d1083e] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:39.739874 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4cc0aa98-1721-40c2-897e-7a036d036f00 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:39.740655 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4cc0aa98-1721-40c2-897e-7a036d036f00 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:39.760513 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4cc0aa98-1721-40c2-897e-7a036d036f00 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:39.766563 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4cc0aa98-1721-40c2-897e-7a036d036f00 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:39.767252 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4cc0aa98-1721-40c2-897e-7a036d036f00 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:39.767811 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4cc0aa98-1721-40c2-897e-7a036d036f00 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:40.349370 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-4cc0aa98-1721-40c2-897e-7a036d036f00 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504ea33de5724b518bcdf28076d6361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd19911fb94d47ab92893a3ec449fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:40.369861 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-4cc0aa98-1721-40c2-897e-7a036d036f00 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] 10.222.0.60 "GET /compute/v2.1/servers/c78e1261-6476-4835-882e-3e59b1d1083e" status: 200 len: 1318 microversion: 2.1 time: 0.666068 Sep 14 09:04:40.370472 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1803/3643] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:04:39 2022] GET /compute/v2.1/servers/c78e1261-6476-4835-882e-3e59b1d1083e => generated 1318 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:04:40.728674 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-abb6ae1c-f0ac-4f40-88b2-dd48e27b8a34 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:40.730154 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-abb6ae1c-f0ac-4f40-88b2-dd48e27b8a34 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] [instance: fcc183e1-b880-4005-bb3e-90ab91ed7911] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:40.732329 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8f0d0b04-1427-40ef-a5a4-30200a4dbe13 tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:40.734388 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-8f0d0b04-1427-40ef-a5a4-30200a4dbe13 tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] [instance: adbd193b-b0ae-40c1-97b5-7fbb9077942b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:40.746430 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-abb6ae1c-f0ac-4f40-88b2-dd48e27b8a34 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:40.746949 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-abb6ae1c-f0ac-4f40-88b2-dd48e27b8a34 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:40.747395 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-abb6ae1c-f0ac-4f40-88b2-dd48e27b8a34 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:40.748121 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-abb6ae1c-f0ac-4f40-88b2-dd48e27b8a34 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:40.748581 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-abb6ae1c-f0ac-4f40-88b2-dd48e27b8a34 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:40.749155 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8f0d0b04-1427-40ef-a5a4-30200a4dbe13 tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:40.750516 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8f0d0b04-1427-40ef-a5a4-30200a4dbe13 tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:40.751246 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8f0d0b04-1427-40ef-a5a4-30200a4dbe13 tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:40.764064 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8f0d0b04-1427-40ef-a5a4-30200a4dbe13 tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:40.764571 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-abb6ae1c-f0ac-4f40-88b2-dd48e27b8a34 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:40.765194 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8f0d0b04-1427-40ef-a5a4-30200a4dbe13 tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:40.765886 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8f0d0b04-1427-40ef-a5a4-30200a4dbe13 tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:40.949313 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=6 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:04:41.206641 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-abb6ae1c-f0ac-4f40-88b2-dd48e27b8a34 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6b965ba7c340f190f9cafc69e46748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b304cd14b65640dab95dc8926eb90818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:41.216318 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-abb6ae1c-f0ac-4f40-88b2-dd48e27b8a34 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6b965ba7c340f190f9cafc69e46748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b304cd14b65640dab95dc8926eb90818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:41.218020 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-abb6ae1c-f0ac-4f40-88b2-dd48e27b8a34 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6b965ba7c340f190f9cafc69e46748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b304cd14b65640dab95dc8926eb90818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:41.219282 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-abb6ae1c-f0ac-4f40-88b2-dd48e27b8a34 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] 10.222.0.60 "GET /compute/v2.1/servers/fcc183e1-b880-4005-bb3e-90ab91ed7911" status: 200 len: 1357 microversion: 2.57 time: 0.497257 Sep 14 09:04:41.219852 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1841/3644] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:04:40 2022] GET /compute/v2.1/servers/fcc183e1-b880-4005-bb3e-90ab91ed7911 => generated 1357 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:04:41.232217 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-7d2b39ce-25ad-4c10-88bb-45b8531a7774 req-354cdb54-fffa-449f-b773-9d6b819be9f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "adbd193b-b0ae-40c1-97b5-7fbb9077942b", "name": "network-vif-plugged", "status": "completed", "tag": "8e578434-355e-459f-b84c-6b6643c69d40"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:04:41.267828 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-7d2b39ce-25ad-4c10-88bb-45b8531a7774 req-354cdb54-fffa-449f-b773-9d6b819be9f7 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:41.268844 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-7d2b39ce-25ad-4c10-88bb-45b8531a7774 req-354cdb54-fffa-449f-b773-9d6b819be9f7 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:41.269623 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-7d2b39ce-25ad-4c10-88bb-45b8531a7774 req-354cdb54-fffa-449f-b773-9d6b819be9f7 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:41.299667 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-7d2b39ce-25ad-4c10-88bb-45b8531a7774 req-354cdb54-fffa-449f-b773-9d6b819be9f7 service nova] Creating event network-vif-plugged:8e578434-355e-459f-b84c-6b6643c69d40 for instance adbd193b-b0ae-40c1-97b5-7fbb9077942b on n-h1-836830-18 Sep 14 09:04:41.306512 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-7d2b39ce-25ad-4c10-88bb-45b8531a7774 req-354cdb54-fffa-449f-b773-9d6b819be9f7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082421 Sep 14 09:04:41.307899 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1842/3645] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:04:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:04:41.314244 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-50d7c92d-caca-4ed4-bbf0-ce33aa9481d2 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:41.316030 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-50d7c92d-caca-4ed4-bbf0-ce33aa9481d2 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] [instance: fcc183e1-b880-4005-bb3e-90ab91ed7911] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:41.324704 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-50d7c92d-caca-4ed4-bbf0-ce33aa9481d2 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:41.325528 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-50d7c92d-caca-4ed4-bbf0-ce33aa9481d2 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:41.326315 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-50d7c92d-caca-4ed4-bbf0-ce33aa9481d2 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:41.327499 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-50d7c92d-caca-4ed4-bbf0-ce33aa9481d2 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:41.328144 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-50d7c92d-caca-4ed4-bbf0-ce33aa9481d2 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:41.328913 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-50d7c92d-caca-4ed4-bbf0-ce33aa9481d2 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:41.366338 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-50d7c92d-caca-4ed4-bbf0-ce33aa9481d2 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] [instance: fcc183e1-b880-4005-bb3e-90ab91ed7911] Going to try to terminate instance {{(pid=128758) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:04:41.562274 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-50d7c92d-caca-4ed4-bbf0-ce33aa9481d2 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] 10.222.0.60 "DELETE /compute/v2.1/servers/fcc183e1-b880-4005-bb3e-90ab91ed7911" status: 204 len: 0 microversion: 2.57 time: 0.252687 Sep 14 09:04:41.563389 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1843/3646] 10.222.0.60 () {60 vars in 1280 bytes} [Wed Sep 14 09:04:41 2022] DELETE /compute/v2.1/servers/fcc183e1-b880-4005-bb3e-90ab91ed7911 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 14 09:04:41.578928 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a135b602-0a7b-4cb4-9a0c-6248db90f02b tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:41.579699 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-a135b602-0a7b-4cb4-9a0c-6248db90f02b tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] [instance: c78e1261-6476-4835-882e-3e59b1d1083e] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:41.586056 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a135b602-0a7b-4cb4-9a0c-6248db90f02b tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:41.586549 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a135b602-0a7b-4cb4-9a0c-6248db90f02b tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:41.587568 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a135b602-0a7b-4cb4-9a0c-6248db90f02b tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:41.588298 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a135b602-0a7b-4cb4-9a0c-6248db90f02b tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:41.588755 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a135b602-0a7b-4cb4-9a0c-6248db90f02b tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:41.589182 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a135b602-0a7b-4cb4-9a0c-6248db90f02b tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:41.660698 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=10 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:04:42.121838 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-8f0d0b04-1427-40ef-a5a4-30200a4dbe13 tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebe0be597a44e0bad22fbcf5c9249d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49345e5148f4d7aae1488e735c76590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:42.130642 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-8f0d0b04-1427-40ef-a5a4-30200a4dbe13 tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] 10.222.0.60 "GET /compute/v2.1/servers/adbd193b-b0ae-40c1-97b5-7fbb9077942b" status: 200 len: 1325 microversion: 2.1 time: 1.402976 Sep 14 09:04:42.131349 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1804/3647] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:04:40 2022] GET /compute/v2.1/servers/adbd193b-b0ae-40c1-97b5-7fbb9077942b => generated 1325 bytes in 1404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:04:42.136783 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-11183ed8-f322-42d2-ace3-1668e0d38b32 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:42.137590 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-11183ed8-f322-42d2-ace3-1668e0d38b32 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] [instance: fcc183e1-b880-4005-bb3e-90ab91ed7911] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:42.144010 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-11183ed8-f322-42d2-ace3-1668e0d38b32 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:42.144693 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-11183ed8-f322-42d2-ace3-1668e0d38b32 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:42.145293 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-11183ed8-f322-42d2-ace3-1668e0d38b32 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:42.146171 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-11183ed8-f322-42d2-ace3-1668e0d38b32 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:42.146789 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-11183ed8-f322-42d2-ace3-1668e0d38b32 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:42.147407 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-11183ed8-f322-42d2-ace3-1668e0d38b32 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:42.183273 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=2 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:04:42.323331 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-11183ed8-f322-42d2-ace3-1668e0d38b32 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6b965ba7c340f190f9cafc69e46748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b304cd14b65640dab95dc8926eb90818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:42.340821 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-a135b602-0a7b-4cb4-9a0c-6248db90f02b tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504ea33de5724b518bcdf28076d6361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd19911fb94d47ab92893a3ec449fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:42.343555 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-11183ed8-f322-42d2-ace3-1668e0d38b32 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6b965ba7c340f190f9cafc69e46748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b304cd14b65640dab95dc8926eb90818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:42.346558 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-11183ed8-f322-42d2-ace3-1668e0d38b32 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6b965ba7c340f190f9cafc69e46748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b304cd14b65640dab95dc8926eb90818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:42.348506 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-11183ed8-f322-42d2-ace3-1668e0d38b32 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] 10.222.0.60 "GET /compute/v2.1/servers/fcc183e1-b880-4005-bb3e-90ab91ed7911" status: 200 len: 1363 microversion: 2.57 time: 0.215900 Sep 14 09:04:42.349312 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1805/3648] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:04:42 2022] GET /compute/v2.1/servers/fcc183e1-b880-4005-bb3e-90ab91ed7911 => generated 1363 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:04:42.363732 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-a135b602-0a7b-4cb4-9a0c-6248db90f02b tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] 10.222.0.60 "GET /compute/v2.1/servers/c78e1261-6476-4835-882e-3e59b1d1083e" status: 200 len: 1318 microversion: 2.1 time: 0.798822 Sep 14 09:04:42.365407 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1844/3649] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:04:41 2022] GET /compute/v2.1/servers/c78e1261-6476-4835-882e-3e59b1d1083e => generated 1318 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:04:43.107753 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-364944b0-dffd-4b79-b3be-94ce4486e82c req-74e23d74-0939-4b8d-baf4-8652b95d8d56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c78e1261-6476-4835-882e-3e59b1d1083e", "tag": "7debce22-c5b6-4069-99bd-15bf692616ab"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:04:43.118719 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-364944b0-dffd-4b79-b3be-94ce4486e82c req-74e23d74-0939-4b8d-baf4-8652b95d8d56 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:43.119478 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-364944b0-dffd-4b79-b3be-94ce4486e82c req-74e23d74-0939-4b8d-baf4-8652b95d8d56 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:43.120075 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-364944b0-dffd-4b79-b3be-94ce4486e82c req-74e23d74-0939-4b8d-baf4-8652b95d8d56 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:43.132855 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-364944b0-dffd-4b79-b3be-94ce4486e82c req-74e23d74-0939-4b8d-baf4-8652b95d8d56 service nova] Creating event network-changed:7debce22-c5b6-4069-99bd-15bf692616ab for instance c78e1261-6476-4835-882e-3e59b1d1083e on n-h1-836830-18 Sep 14 09:04:43.138692 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-364944b0-dffd-4b79-b3be-94ce4486e82c req-74e23d74-0939-4b8d-baf4-8652b95d8d56 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034609 Sep 14 09:04:43.140166 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1806/3650] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:04:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:04:43.156516 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-0e7ac807-f57e-4c2f-b6bc-c673c7dee351 tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:43.157446 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-0e7ac807-f57e-4c2f-b6bc-c673c7dee351 tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] [instance: adbd193b-b0ae-40c1-97b5-7fbb9077942b] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:43.166465 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0e7ac807-f57e-4c2f-b6bc-c673c7dee351 tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:43.167224 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0e7ac807-f57e-4c2f-b6bc-c673c7dee351 tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:43.167654 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0e7ac807-f57e-4c2f-b6bc-c673c7dee351 tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:43.169027 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0e7ac807-f57e-4c2f-b6bc-c673c7dee351 tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:43.169659 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0e7ac807-f57e-4c2f-b6bc-c673c7dee351 tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:43.170278 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0e7ac807-f57e-4c2f-b6bc-c673c7dee351 tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:43.393698 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-5743710c-77a1-44bd-bda9-234d12a39afd tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:43.394402 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-5743710c-77a1-44bd-bda9-234d12a39afd tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] [instance: fcc183e1-b880-4005-bb3e-90ab91ed7911] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:43.401566 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5743710c-77a1-44bd-bda9-234d12a39afd tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:43.402487 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5743710c-77a1-44bd-bda9-234d12a39afd tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:43.403155 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5743710c-77a1-44bd-bda9-234d12a39afd tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:43.404139 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5743710c-77a1-44bd-bda9-234d12a39afd tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:43.404828 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5743710c-77a1-44bd-bda9-234d12a39afd tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:43.405480 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5743710c-77a1-44bd-bda9-234d12a39afd tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:43.495514 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-5743710c-77a1-44bd-bda9-234d12a39afd tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6b965ba7c340f190f9cafc69e46748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b304cd14b65640dab95dc8926eb90818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:43.507231 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-5743710c-77a1-44bd-bda9-234d12a39afd tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6b965ba7c340f190f9cafc69e46748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b304cd14b65640dab95dc8926eb90818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:43.510105 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-5743710c-77a1-44bd-bda9-234d12a39afd tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6b965ba7c340f190f9cafc69e46748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b304cd14b65640dab95dc8926eb90818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:43.511687 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-5743710c-77a1-44bd-bda9-234d12a39afd tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] 10.222.0.60 "GET /compute/v2.1/servers/fcc183e1-b880-4005-bb3e-90ab91ed7911" status: 200 len: 1363 microversion: 2.57 time: 0.122534 Sep 14 09:04:43.525032 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1807/3651] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:04:43 2022] GET /compute/v2.1/servers/fcc183e1-b880-4005-bb3e-90ab91ed7911 => generated 1363 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:04:43.539885 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-edcc7680-acbf-4a74-9db6-f6e377a41284 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:43.542137 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-edcc7680-acbf-4a74-9db6-f6e377a41284 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] [instance: c78e1261-6476-4835-882e-3e59b1d1083e] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:43.577922 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-edcc7680-acbf-4a74-9db6-f6e377a41284 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:43.578572 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-edcc7680-acbf-4a74-9db6-f6e377a41284 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:43.579076 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-edcc7680-acbf-4a74-9db6-f6e377a41284 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:43.579829 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-edcc7680-acbf-4a74-9db6-f6e377a41284 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:43.580796 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-edcc7680-acbf-4a74-9db6-f6e377a41284 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:43.581397 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-edcc7680-acbf-4a74-9db6-f6e377a41284 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:43.591491 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-0e7ac807-f57e-4c2f-b6bc-c673c7dee351 tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebe0be597a44e0bad22fbcf5c9249d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49345e5148f4d7aae1488e735c76590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:43.600810 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=100 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:04:43.603222 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-0e7ac807-f57e-4c2f-b6bc-c673c7dee351 tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] 10.222.0.60 "GET /compute/v2.1/servers/adbd193b-b0ae-40c1-97b5-7fbb9077942b" status: 200 len: 1325 microversion: 2.1 time: 0.452527 Sep 14 09:04:43.623062 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1845/3652] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:04:43 2022] GET /compute/v2.1/servers/adbd193b-b0ae-40c1-97b5-7fbb9077942b => generated 1325 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:04:44.033802 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-edcc7680-acbf-4a74-9db6-f6e377a41284 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504ea33de5724b518bcdf28076d6361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd19911fb94d47ab92893a3ec449fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:44.044094 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-edcc7680-acbf-4a74-9db6-f6e377a41284 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] 10.222.0.60 "GET /compute/v2.1/servers/c78e1261-6476-4835-882e-3e59b1d1083e" status: 200 len: 1318 microversion: 2.1 time: 0.508970 Sep 14 09:04:44.047778 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1808/3653] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:04:43 2022] GET /compute/v2.1/servers/c78e1261-6476-4835-882e-3e59b1d1083e => generated 1318 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:04:44.543217 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-74f38f57-ea43-42ba-9a6d-5c5fb89cc496 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:44.544225 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-74f38f57-ea43-42ba-9a6d-5c5fb89cc496 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] [instance: fcc183e1-b880-4005-bb3e-90ab91ed7911] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:44.556369 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-74f38f57-ea43-42ba-9a6d-5c5fb89cc496 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:44.561031 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-74f38f57-ea43-42ba-9a6d-5c5fb89cc496 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:44.561555 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-74f38f57-ea43-42ba-9a6d-5c5fb89cc496 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:44.562325 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-74f38f57-ea43-42ba-9a6d-5c5fb89cc496 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:44.562800 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-74f38f57-ea43-42ba-9a6d-5c5fb89cc496 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:44.572048 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-74f38f57-ea43-42ba-9a6d-5c5fb89cc496 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:44.599102 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-74f38f57-ea43-42ba-9a6d-5c5fb89cc496 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] HTTP exception thrown: Instance fcc183e1-b880-4005-bb3e-90ab91ed7911 could not be found. Sep 14 09:04:44.600828 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-74f38f57-ea43-42ba-9a6d-5c5fb89cc496 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Request method failure captured: Sep 14 09:04:44.600828 n-d-836830-18 devstack@n-api.service[128758]: request: GET /compute/v2.1/servers/fcc183e1-b880-4005-bb3e-90ab91ed7911 HTTP/1.1 Sep 14 09:04:44.600828 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 09:04:44.600828 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 09:04:44.600828 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 09:04:44.600828 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 09:04:44.600828 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 09:04:44.600828 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 09:04:44.600828 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 09:04:44.600828 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 09:04:44.600828 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZkAIvf63MBwKbtT9T44BQ8zV2Ge6cIH-43AtKRRYucs9zn3741XRP7eJmRXVGZZwJuw82JrvvhjPeHVE4UfTRaYZyC9I44im04itPIg7TiCAF4ZUO2voP9YkDFVTd2rM6YliTAlMmPFpKcOFtJ3TGax7yN7XYpeQc6bfZ8wWZatpW0 Sep 14 09:04:44.600828 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 09:04:44.600828 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 09:04:44.600828 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 09:04:44.600828 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 09:04:44.600828 n-d-836830-18 devstack@n-api.service[128758]: X-Openstack-Nova-Api-Version: 2.57 Sep 14 09:04:44.600828 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 09:04:44.600828 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 09:04:44.600828 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: b304cd14b65640dab95dc8926eb90818 Sep 14 09:04:44.600828 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-ServerShowV257Test-1470620529 Sep 14 09:04:44.600828 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 09:04:44.600828 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 09:04:44.600828 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b304cd14b65640dab95dc8926eb90818"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b304cd14b65640dab95dc8926eb90818"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b304cd14b65640dab95dc8926eb90818"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b304cd14b65640dab95dc8926eb90818"}]}] Sep 14 09:04:44.600828 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-ServerShowV257Test-1470620529 Sep 14 09:04:44.600828 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: b304cd14b65640dab95dc8926eb90818 Sep 14 09:04:44.600828 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-ServerShowV257Test-1470620529 Sep 14 09:04:44.600828 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-ServerShowV257Test-1470620529-project Sep 14 09:04:44.600828 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 09:04:44.600828 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 09:04:44.600828 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 1e6b965ba7c340f190f9cafc69e46748 Sep 14 09:04:44.600828 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-ServerShowV257Test-1470620529-project Sep 14 09:04:44.600828 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 09:04:44.600828 n-d-836830-18 devstack@n-api.service[128758]: exception: Instance fcc183e1-b880-4005-bb3e-90ab91ed7911 could not be found. Sep 14 09:04:44.600828 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': 'fcc183e1-b880-4005-bb3e-90ab91ed7911'} Sep 14 09:04:44.600828 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:04:44.600828 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:04:44.600828 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:04:44.600828 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:04:44.600828 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:04:44.600828 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:04:44.600828 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:04:44.600828 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:04:44.600828 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:04:44.600828 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:04:44.600828 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fcc183e1-b880-4005-bb3e-90ab91ed7911 could not be found. Sep 14 09:04:44.600828 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:04:44.600828 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:04:44.600828 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:04:44.600828 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:04:44.600828 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:04:44.600828 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:04:44.600828 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:04:44.600828 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:04:44.600828 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:04:44.600828 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:04:44.600828 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:04:44.600828 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:04:44.600828 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:04:44.600828 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:04:44.600828 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:04:44.600828 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:04:44.600828 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fcc183e1-b880-4005-bb3e-90ab91ed7911 could not be found. Sep 14 09:04:44.600828 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:04:44.600828 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:04:44.600828 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:04:44.605572 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:04:44.605572 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:04:44.605572 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:04:44.605572 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:04:44.605572 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:04:44.605572 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fcc183e1-b880-4005-bb3e-90ab91ed7911 could not be found. Sep 14 09:04:44.605572 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:04:44.605572 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-74f38f57-ea43-42ba-9a6d-5c5fb89cc496 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] Returning 404 to user: Instance fcc183e1-b880-4005-bb3e-90ab91ed7911 could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:04:44.605572 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-74f38f57-ea43-42ba-9a6d-5c5fb89cc496 tempest-ServerShowV257Test-1470620529 tempest-ServerShowV257Test-1470620529-project] 10.222.0.60 "GET /compute/v2.1/servers/fcc183e1-b880-4005-bb3e-90ab91ed7911" status: 404 len: 111 microversion: 2.57 time: 0.064074 Sep 14 09:04:44.609989 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1846/3654] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:04:44 2022] GET /compute/v2.1/servers/fcc183e1-b880-4005-bb3e-90ab91ed7911 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 14 09:04:44.632016 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8f711f8d-4898-4756-9e1c-3b3e9ce55748 tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:44.632652 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-8f711f8d-4898-4756-9e1c-3b3e9ce55748 tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] [instance: adbd193b-b0ae-40c1-97b5-7fbb9077942b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:44.646914 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8f711f8d-4898-4756-9e1c-3b3e9ce55748 tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:44.647688 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8f711f8d-4898-4756-9e1c-3b3e9ce55748 tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:44.648516 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8f711f8d-4898-4756-9e1c-3b3e9ce55748 tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:44.649921 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8f711f8d-4898-4756-9e1c-3b3e9ce55748 tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:44.651343 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8f711f8d-4898-4756-9e1c-3b3e9ce55748 tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:44.656954 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8f711f8d-4898-4756-9e1c-3b3e9ce55748 tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:45.074433 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-74b1e455-e9e0-4403-9a72-925411729762 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:45.075095 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-74b1e455-e9e0-4403-9a72-925411729762 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] [instance: c78e1261-6476-4835-882e-3e59b1d1083e] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:45.087388 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-74b1e455-e9e0-4403-9a72-925411729762 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:45.087981 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-74b1e455-e9e0-4403-9a72-925411729762 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:45.088433 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-74b1e455-e9e0-4403-9a72-925411729762 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:45.089168 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-74b1e455-e9e0-4403-9a72-925411729762 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:45.089636 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-74b1e455-e9e0-4403-9a72-925411729762 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:45.090073 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-74b1e455-e9e0-4403-9a72-925411729762 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:45.330301 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-8f711f8d-4898-4756-9e1c-3b3e9ce55748 tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebe0be597a44e0bad22fbcf5c9249d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49345e5148f4d7aae1488e735c76590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:45.340629 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-8f711f8d-4898-4756-9e1c-3b3e9ce55748 tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] 10.222.0.60 "GET /compute/v2.1/servers/adbd193b-b0ae-40c1-97b5-7fbb9077942b" status: 200 len: 1521 microversion: 2.1 time: 0.713257 Sep 14 09:04:45.341241 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1809/3655] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:04:44 2022] GET /compute/v2.1/servers/adbd193b-b0ae-40c1-97b5-7fbb9077942b => generated 1521 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:04:45.371433 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-2dad7720-064c-48dc-8e47-e37ef1971ebe tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:45.372452 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-2dad7720-064c-48dc-8e47-e37ef1971ebe tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] [instance: adbd193b-b0ae-40c1-97b5-7fbb9077942b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:45.383750 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2dad7720-064c-48dc-8e47-e37ef1971ebe tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:45.385509 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2dad7720-064c-48dc-8e47-e37ef1971ebe tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:45.386183 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2dad7720-064c-48dc-8e47-e37ef1971ebe tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:45.387611 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2dad7720-064c-48dc-8e47-e37ef1971ebe tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:45.388967 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2dad7720-064c-48dc-8e47-e37ef1971ebe tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:45.389661 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2dad7720-064c-48dc-8e47-e37ef1971ebe tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:45.423852 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-2dad7720-064c-48dc-8e47-e37ef1971ebe tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] HTTP exception thrown: Action 999 not found Sep 14 09:04:45.436628 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-2dad7720-064c-48dc-8e47-e37ef1971ebe tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Request method failure captured: Sep 14 09:04:45.436628 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/adbd193b-b0ae-40c1-97b5-7fbb9077942b/os-instance-actions/999 HTTP/1.1 Sep 14 09:04:45.436628 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:04:45.436628 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:04:45.436628 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:04:45.436628 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:04:45.436628 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:04:45.436628 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:04:45.436628 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:04:45.436628 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:04:45.436628 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZkQWCxLP8AhwVLHiCiG_ernEgy2HqC2yq_PNPKvFQP1LXEKBBt7RUFaMn46P_nAkw2fiotSMdRubJUclYz5J8JNB7lY5ZwuLpr4QFKJXNHzKiHXqiOr4ATwMcgvlnsg6VwI_KlvXDqwJXC9HUj3muv_ClDt45lHsAf0ZysWIZW_O7U Sep 14 09:04:45.436628 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:04:45.436628 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:04:45.436628 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:04:45.436628 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:04:45.436628 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:04:45.436628 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:04:45.436628 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: a49345e5148f4d7aae1488e735c76590 Sep 14 09:04:45.436628 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1811880301 Sep 14 09:04:45.436628 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:04:45.436628 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:04:45.436628 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a49345e5148f4d7aae1488e735c76590"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a49345e5148f4d7aae1488e735c76590"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a49345e5148f4d7aae1488e735c76590"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a49345e5148f4d7aae1488e735c76590"}]}] Sep 14 09:04:45.436628 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1811880301 Sep 14 09:04:45.436628 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: a49345e5148f4d7aae1488e735c76590 Sep 14 09:04:45.436628 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1811880301 Sep 14 09:04:45.436628 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-InstanceActionsNegativeTestJSON-1811880301-project Sep 14 09:04:45.436628 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:04:45.436628 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:04:45.436628 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 0ebe0be597a44e0bad22fbcf5c9249d4 Sep 14 09:04:45.436628 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1811880301-project Sep 14 09:04:45.436628 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:04:45.436628 n-d-836830-18 devstack@n-api.service[128759]: exception: Action 999 not found Sep 14 09:04:45.436628 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'server_id': 'adbd193b-b0ae-40c1-97b5-7fbb9077942b', 'id': '999'} Sep 14 09:04:45.436628 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:04:45.436628 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:04:45.436628 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:04:45.436628 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:04:45.436628 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:04:45.436628 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:04:45.436628 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:04:45.436628 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:04:45.436628 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Sep 14 09:04:45.436628 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 14 09:04:45.436628 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Sep 14 09:04:45.436628 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:04:45.436628 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:04:45.436628 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:04:45.436628 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:04:45.436628 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:04:45.436628 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:04:45.436628 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:04:45.436628 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:04:45.436628 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Sep 14 09:04:45.436628 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:04:45.441746 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-2dad7720-064c-48dc-8e47-e37ef1971ebe tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Returning 404 to user: Action 999 not found {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:04:45.441746 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-2dad7720-064c-48dc-8e47-e37ef1971ebe tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] 10.222.0.60 "GET /compute/v2.1/servers/adbd193b-b0ae-40c1-97b5-7fbb9077942b/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.074737 Sep 14 09:04:45.441746 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1810/3656] 10.222.0.60 () {58 vars in 1308 bytes} [Wed Sep 14 09:04:45 2022] GET /compute/v2.1/servers/adbd193b-b0ae-40c1-97b5-7fbb9077942b/os-instance-actions/999 => generated 66 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 14 09:04:45.451917 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-0f4610e6-6ba8-44b3-ad98-556ce171ed07 tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Calling method '.version_select at 0x7f7d44096ca0>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:45.452507 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-0f4610e6-6ba8-44b3-ad98-556ce171ed07 tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] [instance: 8a8e3f7e-4f8d-449c-92bc-f96e8b94880b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:45.470770 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-0f4610e6-6ba8-44b3-ad98-556ce171ed07 tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] HTTP exception thrown: Instance 8a8e3f7e-4f8d-449c-92bc-f96e8b94880b could not be found. Sep 14 09:04:45.472428 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-0f4610e6-6ba8-44b3-ad98-556ce171ed07 tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Request method failure captured: Sep 14 09:04:45.472428 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/8a8e3f7e-4f8d-449c-92bc-f96e8b94880b/os-instance-actions HTTP/1.1 Sep 14 09:04:45.472428 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:04:45.472428 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:04:45.472428 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:04:45.472428 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:04:45.472428 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:04:45.472428 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:04:45.472428 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:04:45.472428 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:04:45.472428 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZkQWCxLP8AhwVLHiCiG_ernEgy2HqC2yq_PNPKvFQP1LXEKBBt7RUFaMn46P_nAkw2fiotSMdRubJUclYz5J8JNB7lY5ZwuLpr4QFKJXNHzKiHXqiOr4ATwMcgvlnsg6VwI_KlvXDqwJXC9HUj3muv_ClDt45lHsAf0ZysWIZW_O7U Sep 14 09:04:45.472428 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:04:45.472428 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:04:45.472428 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:04:45.472428 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:04:45.472428 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:04:45.472428 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:04:45.472428 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: a49345e5148f4d7aae1488e735c76590 Sep 14 09:04:45.472428 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1811880301 Sep 14 09:04:45.472428 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:04:45.472428 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:04:45.472428 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a49345e5148f4d7aae1488e735c76590"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a49345e5148f4d7aae1488e735c76590"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a49345e5148f4d7aae1488e735c76590"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a49345e5148f4d7aae1488e735c76590"}]}] Sep 14 09:04:45.472428 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1811880301 Sep 14 09:04:45.472428 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: a49345e5148f4d7aae1488e735c76590 Sep 14 09:04:45.472428 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1811880301 Sep 14 09:04:45.472428 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-InstanceActionsNegativeTestJSON-1811880301-project Sep 14 09:04:45.472428 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:04:45.472428 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:04:45.472428 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 0ebe0be597a44e0bad22fbcf5c9249d4 Sep 14 09:04:45.472428 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1811880301-project Sep 14 09:04:45.472428 n-d-836830-18 devstack@n-api.service[128759]: method: Sep 14 09:04:45.472428 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance 8a8e3f7e-4f8d-449c-92bc-f96e8b94880b could not be found. Sep 14 09:04:45.472428 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'server_id': '8a8e3f7e-4f8d-449c-92bc-f96e8b94880b'} Sep 14 09:04:45.472428 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:04:45.472428 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:04:45.472428 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:04:45.472428 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:04:45.472428 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:04:45.472428 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:04:45.472428 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 14 09:04:45.472428 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 14 09:04:45.472428 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a8e3f7e-4f8d-449c-92bc-f96e8b94880b could not be found. Sep 14 09:04:45.472428 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:04:45.472428 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:04:45.472428 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:04:45.472428 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:04:45.472428 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:04:45.472428 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:04:45.472428 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:04:45.472428 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:04:45.472428 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:04:45.472428 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:04:45.472428 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:04:45.472428 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:04:45.472428 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Sep 14 09:04:45.472428 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Sep 14 09:04:45.472428 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:04:45.472428 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:04:45.472428 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Sep 14 09:04:45.472428 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Sep 14 09:04:45.472428 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:04:45.472428 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:04:45.477117 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a8e3f7e-4f8d-449c-92bc-f96e8b94880b could not be found. Sep 14 09:04:45.477117 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:04:45.477117 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:04:45.477117 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:04:45.477117 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:04:45.477117 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:04:45.477117 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:04:45.477117 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:04:45.477117 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:04:45.477117 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a8e3f7e-4f8d-449c-92bc-f96e8b94880b could not be found. Sep 14 09:04:45.477117 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:04:45.477117 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-0f4610e6-6ba8-44b3-ad98-556ce171ed07 tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Returning 404 to user: Instance 8a8e3f7e-4f8d-449c-92bc-f96e8b94880b could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:04:45.477117 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-0f4610e6-6ba8-44b3-ad98-556ce171ed07 tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] 10.222.0.60 "GET /compute/v2.1/servers/8a8e3f7e-4f8d-449c-92bc-f96e8b94880b/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.028221 Sep 14 09:04:45.477117 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1811/3657] 10.222.0.60 () {58 vars in 1296 bytes} [Wed Sep 14 09:04:45 2022] GET /compute/v2.1/servers/8a8e3f7e-4f8d-449c-92bc-f96e8b94880b/os-instance-actions => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 14 09:04:45.487905 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-461bbbbd-32dc-4a4d-acbc-d292e26e603f tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:45.488424 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-461bbbbd-32dc-4a4d-acbc-d292e26e603f tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] [instance: adbd193b-b0ae-40c1-97b5-7fbb9077942b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:45.496286 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-461bbbbd-32dc-4a4d-acbc-d292e26e603f tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:45.496793 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-461bbbbd-32dc-4a4d-acbc-d292e26e603f tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:45.497482 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-461bbbbd-32dc-4a4d-acbc-d292e26e603f tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:45.498594 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-461bbbbd-32dc-4a4d-acbc-d292e26e603f tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:45.499118 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-461bbbbd-32dc-4a4d-acbc-d292e26e603f tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:45.499562 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-461bbbbd-32dc-4a4d-acbc-d292e26e603f tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:45.542329 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-461bbbbd-32dc-4a4d-acbc-d292e26e603f tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] [instance: adbd193b-b0ae-40c1-97b5-7fbb9077942b] Going to try to terminate instance {{(pid=128759) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:04:45.701638 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-461bbbbd-32dc-4a4d-acbc-d292e26e603f tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] 10.222.0.60 "DELETE /compute/v2.1/servers/adbd193b-b0ae-40c1-97b5-7fbb9077942b" status: 204 len: 0 microversion: 2.1 time: 0.218665 Sep 14 09:04:45.703649 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1812/3658] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:04:45 2022] DELETE /compute/v2.1/servers/adbd193b-b0ae-40c1-97b5-7fbb9077942b => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 14 09:04:45.719792 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-aa855fe9-ff5c-4dbd-8a43-41b50139d95a tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:45.720917 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-aa855fe9-ff5c-4dbd-8a43-41b50139d95a tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] [instance: adbd193b-b0ae-40c1-97b5-7fbb9077942b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:45.730440 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-aa855fe9-ff5c-4dbd-8a43-41b50139d95a tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:45.731343 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-aa855fe9-ff5c-4dbd-8a43-41b50139d95a tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:45.732643 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-aa855fe9-ff5c-4dbd-8a43-41b50139d95a tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:45.737379 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-aa855fe9-ff5c-4dbd-8a43-41b50139d95a tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:45.737939 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-aa855fe9-ff5c-4dbd-8a43-41b50139d95a tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:45.739047 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-aa855fe9-ff5c-4dbd-8a43-41b50139d95a tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:46.246797 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-74b1e455-e9e0-4403-9a72-925411729762 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504ea33de5724b518bcdf28076d6361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd19911fb94d47ab92893a3ec449fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:46.262483 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-74b1e455-e9e0-4403-9a72-925411729762 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] 10.222.0.60 "GET /compute/v2.1/servers/c78e1261-6476-4835-882e-3e59b1d1083e" status: 200 len: 1318 microversion: 2.1 time: 1.191895 Sep 14 09:04:46.263743 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1847/3659] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:04:45 2022] GET /compute/v2.1/servers/c78e1261-6476-4835-882e-3e59b1d1083e => generated 1318 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:04:46.277832 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-aa855fe9-ff5c-4dbd-8a43-41b50139d95a tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebe0be597a44e0bad22fbcf5c9249d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49345e5148f4d7aae1488e735c76590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:46.292361 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-aa855fe9-ff5c-4dbd-8a43-41b50139d95a tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] 10.222.0.60 "GET /compute/v2.1/servers/adbd193b-b0ae-40c1-97b5-7fbb9077942b" status: 200 len: 1527 microversion: 2.1 time: 0.582109 Sep 14 09:04:46.307808 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1813/3660] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:04:45 2022] GET /compute/v2.1/servers/adbd193b-b0ae-40c1-97b5-7fbb9077942b => generated 1527 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:04:47.287360 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-6dbdba08-ef4d-46c0-b073-2983caffd8e2 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:47.288435 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-6dbdba08-ef4d-46c0-b073-2983caffd8e2 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] [instance: c78e1261-6476-4835-882e-3e59b1d1083e] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:47.302041 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6dbdba08-ef4d-46c0-b073-2983caffd8e2 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:47.306539 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6dbdba08-ef4d-46c0-b073-2983caffd8e2 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:47.307234 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6dbdba08-ef4d-46c0-b073-2983caffd8e2 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:47.308079 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6dbdba08-ef4d-46c0-b073-2983caffd8e2 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:47.309782 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6dbdba08-ef4d-46c0-b073-2983caffd8e2 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:47.310754 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6dbdba08-ef4d-46c0-b073-2983caffd8e2 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:47.318843 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-0aacb6c9-ae26-4cc5-b35a-14a112e8edb0 tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:47.320327 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-0aacb6c9-ae26-4cc5-b35a-14a112e8edb0 tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] [instance: adbd193b-b0ae-40c1-97b5-7fbb9077942b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:47.332717 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0aacb6c9-ae26-4cc5-b35a-14a112e8edb0 tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:47.335702 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0aacb6c9-ae26-4cc5-b35a-14a112e8edb0 tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:47.336566 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0aacb6c9-ae26-4cc5-b35a-14a112e8edb0 tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:47.338871 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0aacb6c9-ae26-4cc5-b35a-14a112e8edb0 tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:47.340724 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0aacb6c9-ae26-4cc5-b35a-14a112e8edb0 tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:47.341429 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0aacb6c9-ae26-4cc5-b35a-14a112e8edb0 tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:48.182000 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-6dbdba08-ef4d-46c0-b073-2983caffd8e2 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504ea33de5724b518bcdf28076d6361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd19911fb94d47ab92893a3ec449fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:48.203025 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-6dbdba08-ef4d-46c0-b073-2983caffd8e2 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] 10.222.0.60 "GET /compute/v2.1/servers/c78e1261-6476-4835-882e-3e59b1d1083e" status: 200 len: 1318 microversion: 2.1 time: 0.912176 Sep 14 09:04:48.204350 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1848/3661] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:04:47 2022] GET /compute/v2.1/servers/c78e1261-6476-4835-882e-3e59b1d1083e => generated 1318 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:04:48.225813 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-b45fa46f-000b-48ad-9a9f-6494e02135bf req-3f90fa42-1570-4595-b197-c415192e954f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6888685e-f6c3-4fbb-898a-f3a35bc1af6d", "tag": "5f68c034-228c-4cbb-aadb-a1217376e000"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:04:48.239924 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=1,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:04:48.247690 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-b45fa46f-000b-48ad-9a9f-6494e02135bf req-3f90fa42-1570-4595-b197-c415192e954f service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:48.251066 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-b45fa46f-000b-48ad-9a9f-6494e02135bf req-3f90fa42-1570-4595-b197-c415192e954f service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:48.251816 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-b45fa46f-000b-48ad-9a9f-6494e02135bf req-3f90fa42-1570-4595-b197-c415192e954f service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:48.276963 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-b45fa46f-000b-48ad-9a9f-6494e02135bf req-3f90fa42-1570-4595-b197-c415192e954f service nova] Creating event network-changed:5f68c034-228c-4cbb-aadb-a1217376e000 for instance 6888685e-f6c3-4fbb-898a-f3a35bc1af6d on n-h1-836830-18 Sep 14 09:04:48.297931 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-b45fa46f-000b-48ad-9a9f-6494e02135bf req-3f90fa42-1570-4595-b197-c415192e954f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091651 Sep 14 09:04:48.299766 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1849/3662] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:04:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:04:48.357632 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-0aacb6c9-ae26-4cc5-b35a-14a112e8edb0 tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebe0be597a44e0bad22fbcf5c9249d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49345e5148f4d7aae1488e735c76590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:48.372808 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-0aacb6c9-ae26-4cc5-b35a-14a112e8edb0 tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] 10.222.0.60 "GET /compute/v2.1/servers/adbd193b-b0ae-40c1-97b5-7fbb9077942b" status: 200 len: 1527 microversion: 2.1 time: 1.058718 Sep 14 09:04:48.386965 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1814/3663] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:04:47 2022] GET /compute/v2.1/servers/adbd193b-b0ae-40c1-97b5-7fbb9077942b => generated 1527 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:04:48.567045 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-b45fa46f-000b-48ad-9a9f-6494e02135bf req-3f90fa42-1570-4595-b197-c415192e954f service nova] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:48.568224 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-b45fa46f-000b-48ad-9a9f-6494e02135bf req-3f90fa42-1570-4595-b197-c415192e954f service nova] 10.222.0.60 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001718 Sep 14 09:04:48.569265 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1850/3664] 10.222.0.60 () {56 vars in 886 bytes} [Wed Sep 14 09:04:48 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Sep 14 09:04:49.261840 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-373088b9-6573-45d4-abf7-79a62c4468ae tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:49.263577 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-373088b9-6573-45d4-abf7-79a62c4468ae tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] [instance: c78e1261-6476-4835-882e-3e59b1d1083e] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:49.283738 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-373088b9-6573-45d4-abf7-79a62c4468ae tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:49.284269 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-373088b9-6573-45d4-abf7-79a62c4468ae tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:49.284725 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-373088b9-6573-45d4-abf7-79a62c4468ae tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:49.285456 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-373088b9-6573-45d4-abf7-79a62c4468ae tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:49.293542 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-373088b9-6573-45d4-abf7-79a62c4468ae tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:49.297510 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-373088b9-6573-45d4-abf7-79a62c4468ae tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:49.405791 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ade4af9c-26a7-4b1b-8631-eb247544489f tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:49.406890 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-ade4af9c-26a7-4b1b-8631-eb247544489f tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] [instance: adbd193b-b0ae-40c1-97b5-7fbb9077942b] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:49.443892 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ade4af9c-26a7-4b1b-8631-eb247544489f tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:49.444786 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ade4af9c-26a7-4b1b-8631-eb247544489f tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:49.447897 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ade4af9c-26a7-4b1b-8631-eb247544489f tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:49.448902 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ade4af9c-26a7-4b1b-8631-eb247544489f tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:49.454805 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ade4af9c-26a7-4b1b-8631-eb247544489f tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:49.455820 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ade4af9c-26a7-4b1b-8631-eb247544489f tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:49.991133 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-373088b9-6573-45d4-abf7-79a62c4468ae tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504ea33de5724b518bcdf28076d6361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd19911fb94d47ab92893a3ec449fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:49.999929 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-373088b9-6573-45d4-abf7-79a62c4468ae tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] 10.222.0.60 "GET /compute/v2.1/servers/c78e1261-6476-4835-882e-3e59b1d1083e" status: 200 len: 1318 microversion: 2.1 time: 0.766789 Sep 14 09:04:50.000529 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1815/3665] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:04:49 2022] GET /compute/v2.1/servers/c78e1261-6476-4835-882e-3e59b1d1083e => generated 1318 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:04:50.122325 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-ade4af9c-26a7-4b1b-8631-eb247544489f tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebe0be597a44e0bad22fbcf5c9249d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49345e5148f4d7aae1488e735c76590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:50.156365 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-ade4af9c-26a7-4b1b-8631-eb247544489f tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] 10.222.0.60 "GET /compute/v2.1/servers/adbd193b-b0ae-40c1-97b5-7fbb9077942b" status: 200 len: 1527 microversion: 2.1 time: 0.759457 Sep 14 09:04:50.159563 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1851/3666] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:04:49 2022] GET /compute/v2.1/servers/adbd193b-b0ae-40c1-97b5-7fbb9077942b => generated 1527 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:04:51.028238 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-96ad0574-9077-487c-b718-f85baede2417 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:51.030424 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-96ad0574-9077-487c-b718-f85baede2417 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] [instance: c78e1261-6476-4835-882e-3e59b1d1083e] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:51.066559 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-96ad0574-9077-487c-b718-f85baede2417 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:51.070424 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-96ad0574-9077-487c-b718-f85baede2417 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:51.072918 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-96ad0574-9077-487c-b718-f85baede2417 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:51.076298 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-96ad0574-9077-487c-b718-f85baede2417 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:51.077870 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-96ad0574-9077-487c-b718-f85baede2417 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:51.083584 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-96ad0574-9077-487c-b718-f85baede2417 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:51.190695 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-36d5e6da-4634-48c2-aac3-6a28fc717a5c tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:51.193758 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-36d5e6da-4634-48c2-aac3-6a28fc717a5c tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] [instance: adbd193b-b0ae-40c1-97b5-7fbb9077942b] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:51.205911 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-36d5e6da-4634-48c2-aac3-6a28fc717a5c tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:51.206430 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-36d5e6da-4634-48c2-aac3-6a28fc717a5c tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:51.206917 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-36d5e6da-4634-48c2-aac3-6a28fc717a5c tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:51.218681 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-36d5e6da-4634-48c2-aac3-6a28fc717a5c tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:51.219341 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-36d5e6da-4634-48c2-aac3-6a28fc717a5c tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:51.219803 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-36d5e6da-4634-48c2-aac3-6a28fc717a5c tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:51.779430 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-36d5e6da-4634-48c2-aac3-6a28fc717a5c tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebe0be597a44e0bad22fbcf5c9249d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49345e5148f4d7aae1488e735c76590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:51.793924 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-36d5e6da-4634-48c2-aac3-6a28fc717a5c tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] 10.222.0.60 "GET /compute/v2.1/servers/adbd193b-b0ae-40c1-97b5-7fbb9077942b" status: 200 len: 1485 microversion: 2.1 time: 0.613656 Sep 14 09:04:51.795843 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1852/3667] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:04:51 2022] GET /compute/v2.1/servers/adbd193b-b0ae-40c1-97b5-7fbb9077942b => generated 1485 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:04:51.870141 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-25c1356b-33af-4e9a-945c-50eb8d145f57 req-39a17389-ce28-434b-8995-80cf5ca23199 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "adbd193b-b0ae-40c1-97b5-7fbb9077942b", "name": "network-vif-deleted", "tag": "8e578434-355e-459f-b84c-6b6643c69d40"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:04:51.892768 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-25c1356b-33af-4e9a-945c-50eb8d145f57 req-39a17389-ce28-434b-8995-80cf5ca23199 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:51.893367 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-25c1356b-33af-4e9a-945c-50eb8d145f57 req-39a17389-ce28-434b-8995-80cf5ca23199 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:51.906256 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-25c1356b-33af-4e9a-945c-50eb8d145f57 req-39a17389-ce28-434b-8995-80cf5ca23199 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:51.916211 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-96ad0574-9077-487c-b718-f85baede2417 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504ea33de5724b518bcdf28076d6361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd19911fb94d47ab92893a3ec449fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:51.928628 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-25c1356b-33af-4e9a-945c-50eb8d145f57 req-39a17389-ce28-434b-8995-80cf5ca23199 service nova] Creating event network-vif-deleted:8e578434-355e-459f-b84c-6b6643c69d40 for instance adbd193b-b0ae-40c1-97b5-7fbb9077942b on n-h1-836830-18 Sep 14 09:04:51.932914 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-96ad0574-9077-487c-b718-f85baede2417 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] 10.222.0.60 "GET /compute/v2.1/servers/c78e1261-6476-4835-882e-3e59b1d1083e" status: 200 len: 1318 microversion: 2.1 time: 0.909747 Sep 14 09:04:51.935122 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1816/3668] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:04:51 2022] GET /compute/v2.1/servers/c78e1261-6476-4835-882e-3e59b1d1083e => generated 1318 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:04:51.938349 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-25c1356b-33af-4e9a-945c-50eb8d145f57 req-39a17389-ce28-434b-8995-80cf5ca23199 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075946 Sep 14 09:04:51.941645 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1853/3669] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:04:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:04:52.832894 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3ad4e793-4705-4957-9c5f-81b90bc0187b tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:52.834265 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-3ad4e793-4705-4957-9c5f-81b90bc0187b tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] [instance: adbd193b-b0ae-40c1-97b5-7fbb9077942b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:52.856909 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3ad4e793-4705-4957-9c5f-81b90bc0187b tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:52.857911 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3ad4e793-4705-4957-9c5f-81b90bc0187b tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:52.859426 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3ad4e793-4705-4957-9c5f-81b90bc0187b tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:52.861815 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3ad4e793-4705-4957-9c5f-81b90bc0187b tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:52.862770 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3ad4e793-4705-4957-9c5f-81b90bc0187b tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:52.864663 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3ad4e793-4705-4957-9c5f-81b90bc0187b tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:52.892775 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-3ad4e793-4705-4957-9c5f-81b90bc0187b tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] HTTP exception thrown: Instance adbd193b-b0ae-40c1-97b5-7fbb9077942b could not be found. Sep 14 09:04:52.904800 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3ad4e793-4705-4957-9c5f-81b90bc0187b tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Request method failure captured: Sep 14 09:04:52.904800 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/adbd193b-b0ae-40c1-97b5-7fbb9077942b HTTP/1.1 Sep 14 09:04:52.904800 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:04:52.904800 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:04:52.904800 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:04:52.904800 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:04:52.904800 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:04:52.904800 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:04:52.904800 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:04:52.904800 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:04:52.904800 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZkQWCxLP8AhwVLHiCiG_ernEgy2HqC2yq_PNPKvFQP1LXEKBBt7RUFaMn46P_nAkw2fiotSMdRubJUclYz5J8JNB7lY5ZwuLpr4QFKJXNHzKiHXqiOr4ATwMcgvlnsg6VwI_KlvXDqwJXC9HUj3muv_ClDt45lHsAf0ZysWIZW_O7U Sep 14 09:04:52.904800 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:04:52.904800 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:04:52.904800 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:04:52.904800 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:04:52.904800 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:04:52.904800 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:04:52.904800 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: a49345e5148f4d7aae1488e735c76590 Sep 14 09:04:52.904800 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1811880301 Sep 14 09:04:52.904800 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:04:52.904800 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:04:52.904800 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a49345e5148f4d7aae1488e735c76590"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a49345e5148f4d7aae1488e735c76590"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a49345e5148f4d7aae1488e735c76590"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a49345e5148f4d7aae1488e735c76590"}]}] Sep 14 09:04:52.904800 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1811880301 Sep 14 09:04:52.904800 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: a49345e5148f4d7aae1488e735c76590 Sep 14 09:04:52.904800 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1811880301 Sep 14 09:04:52.904800 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-InstanceActionsNegativeTestJSON-1811880301-project Sep 14 09:04:52.904800 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:04:52.904800 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:04:52.904800 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 0ebe0be597a44e0bad22fbcf5c9249d4 Sep 14 09:04:52.904800 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1811880301-project Sep 14 09:04:52.904800 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:04:52.904800 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance adbd193b-b0ae-40c1-97b5-7fbb9077942b could not be found. Sep 14 09:04:52.904800 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': 'adbd193b-b0ae-40c1-97b5-7fbb9077942b'} Sep 14 09:04:52.904800 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:04:52.904800 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:04:52.904800 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:04:52.904800 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:04:52.904800 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:04:52.904800 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:04:52.904800 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:04:52.904800 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:04:52.904800 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:04:52.904800 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:04:52.904800 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance adbd193b-b0ae-40c1-97b5-7fbb9077942b could not be found. Sep 14 09:04:52.904800 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:04:52.904800 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:04:52.904800 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:04:52.904800 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:04:52.904800 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:04:52.904800 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:04:52.904800 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:04:52.904800 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:04:52.904800 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:04:52.904800 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:04:52.904800 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:04:52.904800 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:04:52.904800 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:04:52.904800 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:04:52.904800 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:04:52.904800 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:04:52.904800 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance adbd193b-b0ae-40c1-97b5-7fbb9077942b could not be found. Sep 14 09:04:52.904800 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:04:52.904800 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:04:52.909677 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:04:52.909677 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:04:52.909677 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:04:52.909677 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:04:52.909677 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:04:52.909677 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:04:52.909677 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance adbd193b-b0ae-40c1-97b5-7fbb9077942b could not be found. Sep 14 09:04:52.909677 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:04:52.909677 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3ad4e793-4705-4957-9c5f-81b90bc0187b tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] Returning 404 to user: Instance adbd193b-b0ae-40c1-97b5-7fbb9077942b could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:04:52.909677 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-3ad4e793-4705-4957-9c5f-81b90bc0187b tempest-InstanceActionsNegativeTestJSON-1811880301 tempest-InstanceActionsNegativeTestJSON-1811880301-project] 10.222.0.60 "GET /compute/v2.1/servers/adbd193b-b0ae-40c1-97b5-7fbb9077942b" status: 404 len: 111 microversion: 2.1 time: 0.087866 Sep 14 09:04:52.909677 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1817/3670] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:04:52 2022] GET /compute/v2.1/servers/adbd193b-b0ae-40c1-97b5-7fbb9077942b => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:04:52.961462 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-67797c13-409a-44b5-88a7-b00afec32601 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:52.964482 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-67797c13-409a-44b5-88a7-b00afec32601 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] [instance: c78e1261-6476-4835-882e-3e59b1d1083e] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:52.980457 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-67797c13-409a-44b5-88a7-b00afec32601 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:52.981675 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-67797c13-409a-44b5-88a7-b00afec32601 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:52.982302 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-67797c13-409a-44b5-88a7-b00afec32601 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:52.983247 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-67797c13-409a-44b5-88a7-b00afec32601 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:52.983880 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-67797c13-409a-44b5-88a7-b00afec32601 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:52.984755 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-67797c13-409a-44b5-88a7-b00afec32601 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:54.021670 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-67797c13-409a-44b5-88a7-b00afec32601 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504ea33de5724b518bcdf28076d6361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd19911fb94d47ab92893a3ec449fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:54.037807 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-67797c13-409a-44b5-88a7-b00afec32601 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] 10.222.0.60 "GET /compute/v2.1/servers/c78e1261-6476-4835-882e-3e59b1d1083e" status: 200 len: 1318 microversion: 2.1 time: 1.081403 Sep 14 09:04:54.042621 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1854/3671] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:04:52 2022] GET /compute/v2.1/servers/c78e1261-6476-4835-882e-3e59b1d1083e => generated 1318 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:04:54.152176 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-22d0a471-9294-4178-8384-5590a2af00f3 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-2040922950", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "networks": [{"uuid": "25039276-e7b2-497e-8f28-ebadf4eb94bc"}]}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:04:54.271617 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-435a37d7-cc50-45da-bfda-4b40d2561fac tempest-VolumesGetTestJSON-253488975 tempest-VolumesGetTestJSON-253488975-project] Action: 'create', calling method: .version_select at 0x7f7d3f77a670>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-6758081", "metadata": {"Type": "work"}}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:04:54.274808 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.network.neutron [None req-22d0a471-9294-4178-8384-5590a2af00f3 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] validate_networks() for [('25039276-e7b2-497e-8f28-ebadf4eb94bc', None, None, None, None, None)] {{(pid=128759) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:04:54.919902 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-435a37d7-cc50-45da-bfda-4b40d2561fac tempest-VolumesGetTestJSON-253488975 tempest-VolumesGetTestJSON-253488975-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 200 len: 350 microversion: 2.1 time: 0.875796 Sep 14 09:04:54.921017 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1855/3672] 10.222.0.60 () {60 vars in 1156 bytes} [Wed Sep 14 09:04:54 2022] POST /compute/v2.1/os-volumes => generated 350 bytes in 878 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 14 09:04:55.164611 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-20ff8734-bdad-44f6-b1cd-8df519ad80ab tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1114216960", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "networks": [{"uuid": "2616a0b0-fea1-46f8-bf23-608a226da1ef"}]}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:04:55.306108 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.network.neutron [None req-20ff8734-bdad-44f6-b1cd-8df519ad80ab tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] validate_networks() for [('2616a0b0-fea1-46f8-bf23-608a226da1ef', None, None, None, None, None)] {{(pid=128758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:04:56.505879 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-22d0a471-9294-4178-8384-5590a2af00f3 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Flavor limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:04:56.519097 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-22d0a471-9294-4178-8384-5590a2af00f3 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Image limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:04:56.523791 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-22d0a471-9294-4178-8384-5590a2af00f3 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Flavor pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:04:56.525488 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-22d0a471-9294-4178-8384-5590a2af00f3 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Image pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:04:56.526144 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-22d0a471-9294-4178-8384-5590a2af00f3 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:04:56.576188 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-22d0a471-9294-4178-8384-5590a2af00f3 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:56.577700 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-22d0a471-9294-4178-8384-5590a2af00f3 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:56.578398 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-22d0a471-9294-4178-8384-5590a2af00f3 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:56.579448 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-22d0a471-9294-4178-8384-5590a2af00f3 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:56.580158 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-22d0a471-9294-4178-8384-5590a2af00f3 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:56.581477 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-22d0a471-9294-4178-8384-5590a2af00f3 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:56.620546 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-22d0a471-9294-4178-8384-5590a2af00f3 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Getting quotas for project 62a597fc389b4805bbd3a53ecd17c5b2. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:04:56.628502 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-22d0a471-9294-4178-8384-5590a2af00f3 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Getting quotas for user 5165b8fc101c47c7a4370f9007bc5a58 and project 62a597fc389b4805bbd3a53ecd17c5b2. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:04:56.657981 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-22d0a471-9294-4178-8384-5590a2af00f3 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Going to run 1 instances... {{(pid=128759) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:04:56.663521 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-22d0a471-9294-4178-8384-5590a2af00f3 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] [instance: 70b0fcd2-6fc4-4445-96bb-165dccf6c81c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128759) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:04:56.698715 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:INSERT=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:04:56.837195 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-22d0a471-9294-4178-8384-5590a2af00f3 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.329440 Sep 14 09:04:56.845720 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1818/3673] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 09:04:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 3339 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 14 09:04:56.864226 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-58791bb7-0548-4dfd-afc7-c77de55a5a26 tempest-VolumesGetTestJSON-253488975 tempest-VolumesGetTestJSON-253488975-project] Calling method '.version_select at 0x7f7d3ff96040>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:56.953185 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-58791bb7-0548-4dfd-afc7-c77de55a5a26 tempest-VolumesGetTestJSON-253488975 tempest-VolumesGetTestJSON-253488975-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/b1b08876-efbc-4863-8f0d-6a647477efbc" status: 200 len: 351 microversion: 2.1 time: 0.104749 Sep 14 09:04:56.954997 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1819/3674] 10.222.0.60 () {58 vars in 1245 bytes} [Wed Sep 14 09:04:56 2022] GET /compute/v2.1/os-volumes/b1b08876-efbc-4863-8f0d-6a647477efbc => generated 351 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:04:56.960319 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a5d9ac2f-5f4f-44b1-b258-4aab3f9ad8a5 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:56.960918 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-a5d9ac2f-5f4f-44b1-b258-4aab3f9ad8a5 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] [instance: c78e1261-6476-4835-882e-3e59b1d1083e] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:56.972121 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a5d9ac2f-5f4f-44b1-b258-4aab3f9ad8a5 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:56.973049 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a5d9ac2f-5f4f-44b1-b258-4aab3f9ad8a5 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:56.974040 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a5d9ac2f-5f4f-44b1-b258-4aab3f9ad8a5 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:56.976644 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a5d9ac2f-5f4f-44b1-b258-4aab3f9ad8a5 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:56.977589 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a5d9ac2f-5f4f-44b1-b258-4aab3f9ad8a5 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:56.978208 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a5d9ac2f-5f4f-44b1-b258-4aab3f9ad8a5 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:57.023964 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-20ff8734-bdad-44f6-b1cd-8df519ad80ab tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Flavor limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:04:57.025567 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-20ff8734-bdad-44f6-b1cd-8df519ad80ab tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Image limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:04:57.026505 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-20ff8734-bdad-44f6-b1cd-8df519ad80ab tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Flavor pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:04:57.027139 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-20ff8734-bdad-44f6-b1cd-8df519ad80ab tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Image pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:04:57.027746 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-20ff8734-bdad-44f6-b1cd-8df519ad80ab tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:04:57.039412 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-20ff8734-bdad-44f6-b1cd-8df519ad80ab tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:57.040238 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-20ff8734-bdad-44f6-b1cd-8df519ad80ab tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:57.040876 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-20ff8734-bdad-44f6-b1cd-8df519ad80ab tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:57.041802 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-20ff8734-bdad-44f6-b1cd-8df519ad80ab tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:57.042740 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-20ff8734-bdad-44f6-b1cd-8df519ad80ab tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:57.043419 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-20ff8734-bdad-44f6-b1cd-8df519ad80ab tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:57.124401 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-20ff8734-bdad-44f6-b1cd-8df519ad80ab tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Getting quotas for project 6907b82c9d5c4a23a63bbeec31c3c365. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:04:57.132636 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-20ff8734-bdad-44f6-b1cd-8df519ad80ab tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Getting quotas for user 79583c4e80a04f138927f09eb4e170f4 and project 6907b82c9d5c4a23a63bbeec31c3c365. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:04:57.175523 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-20ff8734-bdad-44f6-b1cd-8df519ad80ab tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Going to run 1 instances... {{(pid=128758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:04:57.189465 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-20ff8734-bdad-44f6-b1cd-8df519ad80ab tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:04:57.336073 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-a5d9ac2f-5f4f-44b1-b258-4aab3f9ad8a5 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504ea33de5724b518bcdf28076d6361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd19911fb94d47ab92893a3ec449fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:57.341885 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-20ff8734-bdad-44f6-b1cd-8df519ad80ab tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.419533 Sep 14 09:04:57.346522 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1856/3675] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 09:04:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 2425 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:04:57.359501 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a5d9ac2f-5f4f-44b1-b258-4aab3f9ad8a5 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] 10.222.0.60 "GET /compute/v2.1/servers/c78e1261-6476-4835-882e-3e59b1d1083e" status: 200 len: 1318 microversion: 2.1 time: 0.404003 Sep 14 09:04:57.361482 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1820/3676] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:04:56 2022] GET /compute/v2.1/servers/c78e1261-6476-4835-882e-3e59b1d1083e => generated 1318 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:04:57.361668 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-8f07b8ec-53b7-4584-9699-0e5d3af72d82 req-a39e7060-6071-4281-afe8-7aad4696445b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c78e1261-6476-4835-882e-3e59b1d1083e", "name": "network-vif-plugged", "status": "completed", "tag": "7debce22-c5b6-4069-99bd-15bf692616ab"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:04:57.366910 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-0a41ff53-4b52-45cb-9d6a-12487e3bd357 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:57.367791 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-0a41ff53-4b52-45cb-9d6a-12487e3bd357 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] [instance: 70b0fcd2-6fc4-4445-96bb-165dccf6c81c] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:57.386014 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-8f07b8ec-53b7-4584-9699-0e5d3af72d82 req-a39e7060-6071-4281-afe8-7aad4696445b service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:57.386514 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-8f07b8ec-53b7-4584-9699-0e5d3af72d82 req-a39e7060-6071-4281-afe8-7aad4696445b service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:57.388673 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-8f07b8ec-53b7-4584-9699-0e5d3af72d82 req-a39e7060-6071-4281-afe8-7aad4696445b service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:57.450598 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-8f07b8ec-53b7-4584-9699-0e5d3af72d82 req-a39e7060-6071-4281-afe8-7aad4696445b service nova] Creating event network-vif-plugged:7debce22-c5b6-4069-99bd-15bf692616ab for instance c78e1261-6476-4835-882e-3e59b1d1083e on n-h1-836830-18 Sep 14 09:04:57.465598 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-8f07b8ec-53b7-4584-9699-0e5d3af72d82 req-a39e7060-6071-4281-afe8-7aad4696445b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116881 Sep 14 09:04:57.468003 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1857/3677] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:04:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:04:57.481926 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-83fa9d4a-4f01-4b88-b522-563537694320 tempest-VolumesGetTestJSON-253488975 tempest-VolumesGetTestJSON-253488975-project] Calling method '.version_select at 0x7f7d443fe310>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:57.554345 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-0a41ff53-4b52-45cb-9d6a-12487e3bd357 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5165b8fc101c47c7a4370f9007bc5a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a597fc389b4805bbd3a53ecd17c5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:57.586417 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-0a41ff53-4b52-45cb-9d6a-12487e3bd357 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute/v2.1/servers/70b0fcd2-6fc4-4445-96bb-165dccf6c81c" status: 200 len: 1208 microversion: 2.1 time: 0.223497 Sep 14 09:04:57.598977 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1821/3678] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:04:57 2022] GET /compute/v2.1/servers/70b0fcd2-6fc4-4445-96bb-165dccf6c81c => generated 1208 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:04:57.598977 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-daea9abd-9d04-4683-98a0-536ccfe42e88 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:57.598977 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-daea9abd-9d04-4683-98a0-536ccfe42e88 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:57.630151 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-83fa9d4a-4f01-4b88-b522-563537694320 tempest-VolumesGetTestJSON-253488975 tempest-VolumesGetTestJSON-253488975-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/b1b08876-efbc-4863-8f0d-6a647477efbc" status: 200 len: 351 microversion: 2.1 time: 0.160695 Sep 14 09:04:57.631377 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1858/3679] 10.222.0.60 () {58 vars in 1245 bytes} [Wed Sep 14 09:04:57 2022] GET /compute/v2.1/os-volumes/b1b08876-efbc-4863-8f0d-6a647477efbc => generated 351 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:04:57.646397 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-e9325e1a-1d34-45c2-9990-577c884f4218 tempest-VolumesGetTestJSON-253488975 tempest-VolumesGetTestJSON-253488975-project] Calling method '.version_select at 0x7f7d3f77aa60>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:57.779532 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-daea9abd-9d04-4683-98a0-536ccfe42e88 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:57.799901 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-daea9abd-9d04-4683-98a0-536ccfe42e88 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1217 microversion: 2.1 time: 0.209955 Sep 14 09:04:57.800785 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1822/3680] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:04:57 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1217 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:04:57.886798 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-e9325e1a-1d34-45c2-9990-577c884f4218 tempest-VolumesGetTestJSON-253488975 tempest-VolumesGetTestJSON-253488975-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/b1b08876-efbc-4863-8f0d-6a647477efbc" status: 202 len: 0 microversion: 2.1 time: 0.244857 Sep 14 09:04:57.890128 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1859/3681] 10.222.0.60 () {58 vars in 1248 bytes} [Wed Sep 14 09:04:57 2022] DELETE /compute/v2.1/os-volumes/b1b08876-efbc-4863-8f0d-6a647477efbc => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:04:57.906150 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b79827a2-2fa9-45c5-94af-4ad737c0c6c6 tempest-VolumesGetTestJSON-253488975 tempest-VolumesGetTestJSON-253488975-project] Calling method '.version_select at 0x7f7d44f9ac10>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:58.081984 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-b79827a2-2fa9-45c5-94af-4ad737c0c6c6 tempest-VolumesGetTestJSON-253488975 tempest-VolumesGetTestJSON-253488975-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/b1b08876-efbc-4863-8f0d-6a647477efbc" status: 200 len: 350 microversion: 2.1 time: 0.183375 Sep 14 09:04:58.083239 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1860/3682] 10.222.0.60 () {58 vars in 1245 bytes} [Wed Sep 14 09:04:57 2022] GET /compute/v2.1/os-volumes/b1b08876-efbc-4863-8f0d-6a647477efbc => generated 350 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:04:58.391443 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-2c2bd97a-d9b0-4f45-8c8a-c31e16c5e2cd tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:58.393977 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-2c2bd97a-d9b0-4f45-8c8a-c31e16c5e2cd tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] [instance: c78e1261-6476-4835-882e-3e59b1d1083e] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:58.410366 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2c2bd97a-d9b0-4f45-8c8a-c31e16c5e2cd tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:58.411575 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2c2bd97a-d9b0-4f45-8c8a-c31e16c5e2cd tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:58.414285 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2c2bd97a-d9b0-4f45-8c8a-c31e16c5e2cd tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:58.417607 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2c2bd97a-d9b0-4f45-8c8a-c31e16c5e2cd tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:58.419081 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2c2bd97a-d9b0-4f45-8c8a-c31e16c5e2cd tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:58.421437 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2c2bd97a-d9b0-4f45-8c8a-c31e16c5e2cd tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:58.595418 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-16acd7ca-a1cd-431d-af6a-b2ea2534b335 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-808632698", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "f397c02a-e752-45ee-8af5-d7e444770691"}]}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:04:58.750996 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.network.neutron [None req-16acd7ca-a1cd-431d-af6a-b2ea2534b335 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] validate_networks() for [('f397c02a-e752-45ee-8af5-d7e444770691', None, None, None, None, None)] {{(pid=128759) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:04:59.151266 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-2c2bd97a-d9b0-4f45-8c8a-c31e16c5e2cd tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504ea33de5724b518bcdf28076d6361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd19911fb94d47ab92893a3ec449fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:59.161314 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-2c2bd97a-d9b0-4f45-8c8a-c31e16c5e2cd tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] 10.222.0.60 "GET /compute/v2.1/servers/c78e1261-6476-4835-882e-3e59b1d1083e" status: 200 len: 1318 microversion: 2.1 time: 0.778415 Sep 14 09:04:59.166152 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1861/3683] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:04:58 2022] GET /compute/v2.1/servers/c78e1261-6476-4835-882e-3e59b1d1083e => generated 1318 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:04:59.176411 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-07abe9e7-e867-41d5-ba4a-068b912d4dcf tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:59.179579 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-07abe9e7-e867-41d5-ba4a-068b912d4dcf tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] [instance: 70b0fcd2-6fc4-4445-96bb-165dccf6c81c] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:59.204062 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-07abe9e7-e867-41d5-ba4a-068b912d4dcf tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:59.204936 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-07abe9e7-e867-41d5-ba4a-068b912d4dcf tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:59.207588 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-07abe9e7-e867-41d5-ba4a-068b912d4dcf tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:59.208929 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-07abe9e7-e867-41d5-ba4a-068b912d4dcf tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:59.210338 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-07abe9e7-e867-41d5-ba4a-068b912d4dcf tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:59.214559 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-07abe9e7-e867-41d5-ba4a-068b912d4dcf tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:59.225753 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:04:59.386599 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-07abe9e7-e867-41d5-ba4a-068b912d4dcf tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5165b8fc101c47c7a4370f9007bc5a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a597fc389b4805bbd3a53ecd17c5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:04:59.397486 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-07abe9e7-e867-41d5-ba4a-068b912d4dcf tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute/v2.1/servers/70b0fcd2-6fc4-4445-96bb-165dccf6c81c" status: 200 len: 1260 microversion: 2.1 time: 0.225155 Sep 14 09:04:59.402347 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1862/3684] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:04:59 2022] GET /compute/v2.1/servers/70b0fcd2-6fc4-4445-96bb-165dccf6c81c => generated 1260 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:04:59.409478 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-0077d73d-e798-4635-a84d-9237b7b24f50 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:59.410381 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-0077d73d-e798-4635-a84d-9237b7b24f50 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:04:59.419363 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0077d73d-e798-4635-a84d-9237b7b24f50 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:59.420213 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0077d73d-e798-4635-a84d-9237b7b24f50 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:59.420947 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0077d73d-e798-4635-a84d-9237b7b24f50 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:59.421918 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0077d73d-e798-4635-a84d-9237b7b24f50 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:59.422634 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0077d73d-e798-4635-a84d-9237b7b24f50 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:59.423330 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0077d73d-e798-4635-a84d-9237b7b24f50 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:00.394390 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-0077d73d-e798-4635-a84d-9237b7b24f50 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:00.410036 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-0077d73d-e798-4635-a84d-9237b7b24f50 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1213 microversion: 2.1 time: 0.999496 Sep 14 09:05:00.426200 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1863/3685] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:04:59 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1213 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:05:00.426200 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-687e05fa-a22c-46a9-ae4e-f5f7ef5ea974 tempest-VolumesGetTestJSON-253488975 tempest-VolumesGetTestJSON-253488975-project] Calling method '.version_select at 0x7f7d44610280>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:00.534563 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-687e05fa-a22c-46a9-ae4e-f5f7ef5ea974 tempest-VolumesGetTestJSON-253488975 tempest-VolumesGetTestJSON-253488975-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/b1b08876-efbc-4863-8f0d-6a647477efbc" status: 200 len: 350 microversion: 2.1 time: 0.122030 Sep 14 09:05:00.535268 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1864/3686] 10.222.0.60 () {58 vars in 1245 bytes} [Wed Sep 14 09:05:00 2022] GET /compute/v2.1/os-volumes/b1b08876-efbc-4863-8f0d-6a647477efbc => generated 350 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:05:00.545799 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-bf030893-c26d-4e44-8dad-8c27a468b119 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:00.546516 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-bf030893-c26d-4e44-8dad-8c27a468b119 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] [instance: c78e1261-6476-4835-882e-3e59b1d1083e] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:05:00.582435 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bf030893-c26d-4e44-8dad-8c27a468b119 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:00.585176 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bf030893-c26d-4e44-8dad-8c27a468b119 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:00.585680 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bf030893-c26d-4e44-8dad-8c27a468b119 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:00.591786 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bf030893-c26d-4e44-8dad-8c27a468b119 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:00.593460 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bf030893-c26d-4e44-8dad-8c27a468b119 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:00.593943 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bf030893-c26d-4e44-8dad-8c27a468b119 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:01.324612 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-bf030893-c26d-4e44-8dad-8c27a468b119 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504ea33de5724b518bcdf28076d6361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd19911fb94d47ab92893a3ec449fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:01.348138 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-bf030893-c26d-4e44-8dad-8c27a468b119 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] 10.222.0.60 "GET /compute/v2.1/servers/c78e1261-6476-4835-882e-3e59b1d1083e" status: 200 len: 1505 microversion: 2.1 time: 0.802082 Sep 14 09:05:01.348873 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1865/3687] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:05:00 2022] GET /compute/v2.1/servers/c78e1261-6476-4835-882e-3e59b1d1083e => generated 1505 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:05:01.353998 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c2b4dbb5-9f61-4fc1-8865-8f43e8f33c04 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:01.354619 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-c2b4dbb5-9f61-4fc1-8865-8f43e8f33c04 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] [instance: 70b0fcd2-6fc4-4445-96bb-165dccf6c81c] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:05:01.376996 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c2b4dbb5-9f61-4fc1-8865-8f43e8f33c04 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:01.377716 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c2b4dbb5-9f61-4fc1-8865-8f43e8f33c04 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:01.383246 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c2b4dbb5-9f61-4fc1-8865-8f43e8f33c04 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:01.384569 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c2b4dbb5-9f61-4fc1-8865-8f43e8f33c04 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:01.385039 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c2b4dbb5-9f61-4fc1-8865-8f43e8f33c04 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:01.388659 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c2b4dbb5-9f61-4fc1-8865-8f43e8f33c04 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:01.641066 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-16acd7ca-a1cd-431d-af6a-b2ea2534b335 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Flavor limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:05:01.641614 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-16acd7ca-a1cd-431d-af6a-b2ea2534b335 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Image limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:05:01.642827 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-16acd7ca-a1cd-431d-af6a-b2ea2534b335 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Flavor pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:05:01.643521 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-16acd7ca-a1cd-431d-af6a-b2ea2534b335 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Image pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:05:01.644163 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-16acd7ca-a1cd-431d-af6a-b2ea2534b335 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:05:01.671724 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-16acd7ca-a1cd-431d-af6a-b2ea2534b335 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:01.676107 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-16acd7ca-a1cd-431d-af6a-b2ea2534b335 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:01.677386 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-16acd7ca-a1cd-431d-af6a-b2ea2534b335 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:01.684219 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-16acd7ca-a1cd-431d-af6a-b2ea2534b335 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:01.685002 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-16acd7ca-a1cd-431d-af6a-b2ea2534b335 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:01.686905 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-16acd7ca-a1cd-431d-af6a-b2ea2534b335 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:01.722334 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-c2b4dbb5-9f61-4fc1-8865-8f43e8f33c04 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5165b8fc101c47c7a4370f9007bc5a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a597fc389b4805bbd3a53ecd17c5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:01.731109 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-c2b4dbb5-9f61-4fc1-8865-8f43e8f33c04 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute/v2.1/servers/70b0fcd2-6fc4-4445-96bb-165dccf6c81c" status: 200 len: 1266 microversion: 2.1 time: 0.380915 Sep 14 09:05:01.731708 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1866/3688] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:05:01 2022] GET /compute/v2.1/servers/70b0fcd2-6fc4-4445-96bb-165dccf6c81c => generated 1266 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:05:01.763316 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-161ebd6d-df81-4862-86fd-77a477f43344 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:01.768814 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-161ebd6d-df81-4862-86fd-77a477f43344 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] [instance: 6888685e-f6c3-4fbb-898a-f3a35bc1af6d] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:05:01.794012 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-16acd7ca-a1cd-431d-af6a-b2ea2534b335 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Getting quotas for project a358bdeb8c10424a8b70cc7b6c94e726. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:05:01.795436 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-161ebd6d-df81-4862-86fd-77a477f43344 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:01.801675 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-161ebd6d-df81-4862-86fd-77a477f43344 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:01.804817 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-161ebd6d-df81-4862-86fd-77a477f43344 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:01.809857 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-161ebd6d-df81-4862-86fd-77a477f43344 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:01.819303 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-161ebd6d-df81-4862-86fd-77a477f43344 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:01.822108 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-161ebd6d-df81-4862-86fd-77a477f43344 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:01.831851 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-16acd7ca-a1cd-431d-af6a-b2ea2534b335 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Getting quotas for user 02330887b6814bea8312e01103b0d2e9 and project a358bdeb8c10424a8b70cc7b6c94e726. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:05:01.887406 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-16acd7ca-a1cd-431d-af6a-b2ea2534b335 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Going to run 3 instances... {{(pid=128759) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:05:01.896903 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-16acd7ca-a1cd-431d-af6a-b2ea2534b335 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] [instance: 1435eb10-e290-4e5c-9e16-4bbcc2cba6db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128759) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:05:02.021899 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-16acd7ca-a1cd-431d-af6a-b2ea2534b335 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] [instance: 136e2cad-31c9-4c0a-93ae-b6de98a41f8b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=1435eb10-e290-4e5c-9e16-4bbcc2cba6db,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128759) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:05:02.098047 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-16acd7ca-a1cd-431d-af6a-b2ea2534b335 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] [instance: 05cc41b4-ace4-4d14-90ed-ad19af43e268] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=136e2cad-31c9-4c0a-93ae-b6de98a41f8b,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128759) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:05:02.253498 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-16acd7ca-a1cd-431d-af6a-b2ea2534b335 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.451075 Sep 14 09:05:02.260308 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1823/3689] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 09:04:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 4453 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:05:02.260308 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-bbcbf358-a979-44c1-826d-9e301e1fc093 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:02.260308 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-bbcbf358-a979-44c1-826d-9e301e1fc093 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:05:02.275765 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bbcbf358-a979-44c1-826d-9e301e1fc093 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:02.277318 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bbcbf358-a979-44c1-826d-9e301e1fc093 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:02.279608 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bbcbf358-a979-44c1-826d-9e301e1fc093 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:02.281030 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bbcbf358-a979-44c1-826d-9e301e1fc093 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:02.284179 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bbcbf358-a979-44c1-826d-9e301e1fc093 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:02.284956 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bbcbf358-a979-44c1-826d-9e301e1fc093 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:02.982656 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-bbcbf358-a979-44c1-826d-9e301e1fc093 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:03.014117 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-bbcbf358-a979-44c1-826d-9e301e1fc093 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1275 microversion: 2.1 time: 0.748277 Sep 14 09:05:03.021484 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1824/3690] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:05:02 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1275 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:05:03.044551 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-4c915d56-14c0-4fa2-8df6-5151b0727058 tempest-VolumesGetTestJSON-253488975 tempest-VolumesGetTestJSON-253488975-project] Calling method '.version_select at 0x7f7d3fbe4ee0>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:03.195525 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-161ebd6d-df81-4862-86fd-77a477f43344 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504ea33de5724b518bcdf28076d6361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd19911fb94d47ab92893a3ec449fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:03.228331 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-161ebd6d-df81-4862-86fd-77a477f43344 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] 10.222.0.60 "GET /compute/v2.1/servers/6888685e-f6c3-4fbb-898a-f3a35bc1af6d" status: 200 len: 1318 microversion: 2.1 time: 1.490252 Sep 14 09:05:03.229005 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1867/3691] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:05:01 2022] GET /compute/v2.1/servers/6888685e-f6c3-4fbb-898a-f3a35bc1af6d => generated 1318 bytes in 1497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:05:03.247800 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c8f59cea-ee8c-4ec0-9c95-beac2a184ea9 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:03.265767 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-c8f59cea-ee8c-4ec0-9c95-beac2a184ea9 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '02330887b6814bea8312e01103b0d2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a358bdeb8c10424a8b70cc7b6c94e726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:03.268623 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-c8f59cea-ee8c-4ec0-9c95-beac2a184ea9 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Searching by: {'deleted': False, 'project_id': 'a358bdeb8c10424a8b70cc7b6c94e726'} {{(pid=128758) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 14 09:05:03.284055 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-4c915d56-14c0-4fa2-8df6-5151b0727058 tempest-VolumesGetTestJSON-253488975 tempest-VolumesGetTestJSON-253488975-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/b1b08876-efbc-4863-8f0d-6a647477efbc" status: 200 len: 350 microversion: 2.1 time: 0.256258 Sep 14 09:05:03.285109 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1825/3692] 10.222.0.60 () {58 vars in 1245 bytes} [Wed Sep 14 09:05:03 2022] GET /compute/v2.1/os-volumes/b1b08876-efbc-4863-8f0d-6a647477efbc => generated 350 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:05:03.299789 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-4dab5f52-5ceb-4e35-a69a-ad03349d4f0c tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:03.302835 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-4dab5f52-5ceb-4e35-a69a-ad03349d4f0c tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] [instance: 70b0fcd2-6fc4-4445-96bb-165dccf6c81c] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:05:03.328030 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4dab5f52-5ceb-4e35-a69a-ad03349d4f0c tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:03.346143 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4dab5f52-5ceb-4e35-a69a-ad03349d4f0c tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:03.346653 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4dab5f52-5ceb-4e35-a69a-ad03349d4f0c tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:03.354581 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4dab5f52-5ceb-4e35-a69a-ad03349d4f0c tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:03.355122 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4dab5f52-5ceb-4e35-a69a-ad03349d4f0c tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:03.355564 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4dab5f52-5ceb-4e35-a69a-ad03349d4f0c tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:03.400690 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c8f59cea-ee8c-4ec0-9c95-beac2a184ea9 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:03.404710 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c8f59cea-ee8c-4ec0-9c95-beac2a184ea9 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:03.405184 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c8f59cea-ee8c-4ec0-9c95-beac2a184ea9 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:03.422360 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c8f59cea-ee8c-4ec0-9c95-beac2a184ea9 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:03.423034 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c8f59cea-ee8c-4ec0-9c95-beac2a184ea9 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:03.423489 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c8f59cea-ee8c-4ec0-9c95-beac2a184ea9 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:03.531206 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-c8f59cea-ee8c-4ec0-9c95-beac2a184ea9 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] 10.222.0.60 "GET /compute/v2.1/servers" status: 200 len: 1015 microversion: 2.1 time: 0.296189 Sep 14 09:05:03.539041 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1868/3693] 10.222.0.60 () {58 vars in 1125 bytes} [Wed Sep 14 09:05:03 2022] GET /compute/v2.1/servers => generated 1015 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:05:03.575219 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-09fbd400-2619-4e0e-a554-c326c72c8584 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:03.576017 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-09fbd400-2619-4e0e-a554-c326c72c8584 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] [instance: 05cc41b4-ace4-4d14-90ed-ad19af43e268] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:05:03.744755 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-09fbd400-2619-4e0e-a554-c326c72c8584 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02330887b6814bea8312e01103b0d2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a358bdeb8c10424a8b70cc7b6c94e726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:03.761859 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-09fbd400-2619-4e0e-a554-c326c72c8584 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] 10.222.0.60 "GET /compute/v2.1/servers/05cc41b4-ace4-4d14-90ed-ad19af43e268" status: 200 len: 1222 microversion: 2.1 time: 0.215209 Sep 14 09:05:03.775337 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1869/3694] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:05:03 2022] GET /compute/v2.1/servers/05cc41b4-ace4-4d14-90ed-ad19af43e268 => generated 1222 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:05:03.973767 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-4dab5f52-5ceb-4e35-a69a-ad03349d4f0c tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5165b8fc101c47c7a4370f9007bc5a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a597fc389b4805bbd3a53ecd17c5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:03.989949 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-4dab5f52-5ceb-4e35-a69a-ad03349d4f0c tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute/v2.1/servers/70b0fcd2-6fc4-4445-96bb-165dccf6c81c" status: 200 len: 1308 microversion: 2.1 time: 0.696033 Sep 14 09:05:03.990588 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1826/3695] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:05:03 2022] GET /compute/v2.1/servers/70b0fcd2-6fc4-4445-96bb-165dccf6c81c => generated 1308 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:05:04.050919 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-fec53e16-47b1-4904-98b7-c86ce12bff88 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:04.051689 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-fec53e16-47b1-4904-98b7-c86ce12bff88 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:05:04.069654 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fec53e16-47b1-4904-98b7-c86ce12bff88 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:04.071844 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fec53e16-47b1-4904-98b7-c86ce12bff88 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:04.076016 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fec53e16-47b1-4904-98b7-c86ce12bff88 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:04.077159 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fec53e16-47b1-4904-98b7-c86ce12bff88 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:04.077656 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fec53e16-47b1-4904-98b7-c86ce12bff88 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:04.080304 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fec53e16-47b1-4904-98b7-c86ce12bff88 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:04.276678 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e559c6b3-e737-41b2-954b-2f02bf68685c tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:04.279967 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e559c6b3-e737-41b2-954b-2f02bf68685c tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] [instance: 6888685e-f6c3-4fbb-898a-f3a35bc1af6d] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:05:04.335646 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e559c6b3-e737-41b2-954b-2f02bf68685c tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:04.336164 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e559c6b3-e737-41b2-954b-2f02bf68685c tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:04.336620 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e559c6b3-e737-41b2-954b-2f02bf68685c tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:04.346048 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e559c6b3-e737-41b2-954b-2f02bf68685c tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:04.350013 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e559c6b3-e737-41b2-954b-2f02bf68685c tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:04.350530 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e559c6b3-e737-41b2-954b-2f02bf68685c tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:05.125629 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-fec53e16-47b1-4904-98b7-c86ce12bff88 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:05.141974 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-fec53e16-47b1-4904-98b7-c86ce12bff88 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1317 microversion: 2.1 time: 1.089630 Sep 14 09:05:05.143327 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1870/3696] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:05:04 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1317 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:05:05.158117 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-8840bd65-5489-4c18-a548-cbd6f896b090 tempest-VolumesGetTestJSON-253488975 tempest-VolumesGetTestJSON-253488975-project] Calling method '.version_select at 0x7f7d44d3f280>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:05.233974 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-8840bd65-5489-4c18-a548-cbd6f896b090 tempest-VolumesGetTestJSON-253488975 tempest-VolumesGetTestJSON-253488975-project] HTTP exception thrown: Volume b1b08876-efbc-4863-8f0d-6a647477efbc could not be found. Sep 14 09:05:05.237854 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-8840bd65-5489-4c18-a548-cbd6f896b090 tempest-VolumesGetTestJSON-253488975 tempest-VolumesGetTestJSON-253488975-project] Request method failure captured: Sep 14 09:05:05.237854 n-d-836830-18 devstack@n-api.service[128758]: request: GET /compute/v2.1/os-volumes/b1b08876-efbc-4863-8f0d-6a647477efbc HTTP/1.1 Sep 14 09:05:05.237854 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 09:05:05.237854 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 09:05:05.237854 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 09:05:05.237854 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 09:05:05.237854 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 09:05:05.237854 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 09:05:05.237854 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 09:05:05.237854 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 09:05:05.237854 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZk19UMmNa6jAuRw64BHGWlQJ9yy3S13ah0uCouIKrh94qnnS-xKTmmpDxsnSVb64FPCqEruEMYm6_JEvqG1QDM6a2BGGW1Ff2nMBFT3lVcqUUhWLWeL6DJf7VKwkCkud6X3vQNulTX5ffrrUw9aleHy4Pl5Kza8yksTT-Ps5bvaOM4 Sep 14 09:05:05.237854 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 09:05:05.237854 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 09:05:05.237854 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 09:05:05.237854 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 09:05:05.237854 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 09:05:05.237854 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 09:05:05.237854 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 586175df0df14676b4e6c81192c377d6 Sep 14 09:05:05.237854 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-VolumesGetTestJSON-253488975 Sep 14 09:05:05.237854 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 09:05:05.237854 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 09:05:05.237854 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/586175df0df14676b4e6c81192c377d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_586175df0df14676b4e6c81192c377d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/586175df0df14676b4e6c81192c377d6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/586175df0df14676b4e6c81192c377d6"}]}] Sep 14 09:05:05.237854 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-VolumesGetTestJSON-253488975 Sep 14 09:05:05.237854 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 586175df0df14676b4e6c81192c377d6 Sep 14 09:05:05.237854 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-VolumesGetTestJSON-253488975 Sep 14 09:05:05.237854 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-VolumesGetTestJSON-253488975-project Sep 14 09:05:05.237854 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 09:05:05.237854 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 09:05:05.237854 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 213dcc1515c04e74898b970b7442e121 Sep 14 09:05:05.237854 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-VolumesGetTestJSON-253488975-project Sep 14 09:05:05.237854 n-d-836830-18 devstack@n-api.service[128758]: method: Sep 14 09:05:05.237854 n-d-836830-18 devstack@n-api.service[128758]: exception: Volume b1b08876-efbc-4863-8f0d-6a647477efbc could not be found. Sep 14 09:05:05.237854 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': 'b1b08876-efbc-4863-8f0d-6a647477efbc'} Sep 14 09:05:05.237854 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:05:05.237854 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:05:05.237854 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 14 09:05:05.237854 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 14 09:05:05.237854 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 14 09:05:05.237854 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 14 09:05:05.237854 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 14 09:05:05.237854 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 14 09:05:05.237854 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 14 09:05:05.237854 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 14 09:05:05.237854 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 14 09:05:05.237854 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 14 09:05:05.237854 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 14 09:05:05.237854 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 14 09:05:05.237854 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 14 09:05:05.237854 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 14 09:05:05.237854 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b1b08876-efbc-4863-8f0d-6a647477efbc could not be found. (HTTP 404) (Request-ID: req-41def065-0a9d-483f-a49a-defa00128b48) Sep 14 09:05:05.237854 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:05:05.237854 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:05:05.237854 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:05:05.237854 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:05:05.237854 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 14 09:05:05.237854 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 14 09:05:05.237854 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 14 09:05:05.237854 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 14 09:05:05.237854 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 14 09:05:05.237854 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 14 09:05:05.237854 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 14 09:05:05.237854 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 14 09:05:05.237854 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 14 09:05:05.243469 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 14 09:05:05.243469 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 14 09:05:05.243469 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 14 09:05:05.243469 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 14 09:05:05.243469 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 14 09:05:05.243469 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 14 09:05:05.243469 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 14 09:05:05.243469 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 14 09:05:05.243469 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 14 09:05:05.243469 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 14 09:05:05.243469 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 14 09:05:05.243469 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 14 09:05:05.243469 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 14 09:05:05.243469 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b1b08876-efbc-4863-8f0d-6a647477efbc could not be found. Sep 14 09:05:05.243469 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:05:05.243469 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:05:05.243469 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:05:05.243469 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:05:05.243469 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:05:05.243469 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:05:05.243469 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:05:05.243469 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:05:05.243469 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:05:05.243469 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:05:05.243469 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:05:05.243469 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:05:05.243469 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 14 09:05:05.243469 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:05:05.243469 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b1b08876-efbc-4863-8f0d-6a647477efbc could not be found. Sep 14 09:05:05.243469 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:05:05.243469 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:05:05.243469 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:05:05.243469 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:05:05.243469 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:05:05.243469 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:05:05.243469 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:05:05.243469 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:05:05.243469 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b1b08876-efbc-4863-8f0d-6a647477efbc could not be found. Sep 14 09:05:05.243469 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:05:05.249440 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-8840bd65-5489-4c18-a548-cbd6f896b090 tempest-VolumesGetTestJSON-253488975 tempest-VolumesGetTestJSON-253488975-project] Returning 404 to user: Volume b1b08876-efbc-4863-8f0d-6a647477efbc could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:05:05.249440 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-8840bd65-5489-4c18-a548-cbd6f896b090 tempest-VolumesGetTestJSON-253488975 tempest-VolumesGetTestJSON-253488975-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/b1b08876-efbc-4863-8f0d-6a647477efbc" status: 404 len: 109 microversion: 2.1 time: 0.103969 Sep 14 09:05:05.249440 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1871/3697] 10.222.0.60 () {58 vars in 1245 bytes} [Wed Sep 14 09:05:05 2022] GET /compute/v2.1/os-volumes/b1b08876-efbc-4863-8f0d-6a647477efbc => generated 109 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:05:05.273025 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-0314fcf3-b72f-4a54-82d7-b33ff05b581e tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:05.279646 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-0314fcf3-b72f-4a54-82d7-b33ff05b581e tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] [instance: 05cc41b4-ace4-4d14-90ed-ad19af43e268] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:05:05.296911 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0314fcf3-b72f-4a54-82d7-b33ff05b581e tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:05.303283 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0314fcf3-b72f-4a54-82d7-b33ff05b581e tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:05.304041 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0314fcf3-b72f-4a54-82d7-b33ff05b581e tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:05.305239 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0314fcf3-b72f-4a54-82d7-b33ff05b581e tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:05.305966 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0314fcf3-b72f-4a54-82d7-b33ff05b581e tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:05.309745 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0314fcf3-b72f-4a54-82d7-b33ff05b581e tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:05.636179 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-0314fcf3-b72f-4a54-82d7-b33ff05b581e tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02330887b6814bea8312e01103b0d2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a358bdeb8c10424a8b70cc7b6c94e726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:05.651786 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-0314fcf3-b72f-4a54-82d7-b33ff05b581e tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] 10.222.0.60 "GET /compute/v2.1/servers/05cc41b4-ace4-4d14-90ed-ad19af43e268" status: 200 len: 1218 microversion: 2.1 time: 0.400964 Sep 14 09:05:05.652934 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1872/3698] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:05:05 2022] GET /compute/v2.1/servers/05cc41b4-ace4-4d14-90ed-ad19af43e268 => generated 1218 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:05:05.667884 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ad057884-3b5d-4d06-a6e0-bd45633205a7 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:05.668914 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-ad057884-3b5d-4d06-a6e0-bd45633205a7 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] [instance: 70b0fcd2-6fc4-4445-96bb-165dccf6c81c] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:05:05.679535 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ad057884-3b5d-4d06-a6e0-bd45633205a7 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:05.680458 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ad057884-3b5d-4d06-a6e0-bd45633205a7 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:05.681164 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ad057884-3b5d-4d06-a6e0-bd45633205a7 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:05.682143 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ad057884-3b5d-4d06-a6e0-bd45633205a7 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:05.688342 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ad057884-3b5d-4d06-a6e0-bd45633205a7 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:05.689450 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ad057884-3b5d-4d06-a6e0-bd45633205a7 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:05.745801 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-e559c6b3-e737-41b2-954b-2f02bf68685c tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504ea33de5724b518bcdf28076d6361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd19911fb94d47ab92893a3ec449fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:05.759883 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e559c6b3-e737-41b2-954b-2f02bf68685c tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] 10.222.0.60 "GET /compute/v2.1/servers/6888685e-f6c3-4fbb-898a-f3a35bc1af6d" status: 200 len: 1318 microversion: 2.1 time: 1.501790 Sep 14 09:05:05.768109 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1827/3699] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:05:04 2022] GET /compute/v2.1/servers/6888685e-f6c3-4fbb-898a-f3a35bc1af6d => generated 1318 bytes in 1507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:05:06.169151 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e85b4d6b-cce9-4558-ad21-91adfecdfd97 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:06.169780 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e85b4d6b-cce9-4558-ad21-91adfecdfd97 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:05:06.177323 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e85b4d6b-cce9-4558-ad21-91adfecdfd97 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:06.177816 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e85b4d6b-cce9-4558-ad21-91adfecdfd97 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:06.178252 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e85b4d6b-cce9-4558-ad21-91adfecdfd97 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:06.178973 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e85b4d6b-cce9-4558-ad21-91adfecdfd97 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:06.179431 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e85b4d6b-cce9-4558-ad21-91adfecdfd97 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:06.179860 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e85b4d6b-cce9-4558-ad21-91adfecdfd97 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:06.700465 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-ad057884-3b5d-4d06-a6e0-bd45633205a7 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5165b8fc101c47c7a4370f9007bc5a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a597fc389b4805bbd3a53ecd17c5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:06.712874 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-ad057884-3b5d-4d06-a6e0-bd45633205a7 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute/v2.1/servers/70b0fcd2-6fc4-4445-96bb-165dccf6c81c" status: 200 len: 1308 microversion: 2.1 time: 1.058688 Sep 14 09:05:06.719129 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1873/3700] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:05:05 2022] GET /compute/v2.1/servers/70b0fcd2-6fc4-4445-96bb-165dccf6c81c => generated 1308 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:05:06.729971 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1d10ba05-c41b-4132-bff2-ac64016d6acb tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:06.734188 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-1d10ba05-c41b-4132-bff2-ac64016d6acb tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] [instance: 05cc41b4-ace4-4d14-90ed-ad19af43e268] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:05:06.754603 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1d10ba05-c41b-4132-bff2-ac64016d6acb tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:06.758540 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1d10ba05-c41b-4132-bff2-ac64016d6acb tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:06.760083 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1d10ba05-c41b-4132-bff2-ac64016d6acb tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:06.761985 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1d10ba05-c41b-4132-bff2-ac64016d6acb tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:06.764045 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1d10ba05-c41b-4132-bff2-ac64016d6acb tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:06.764760 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1d10ba05-c41b-4132-bff2-ac64016d6acb tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:07.079529 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-1d10ba05-c41b-4132-bff2-ac64016d6acb tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02330887b6814bea8312e01103b0d2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a358bdeb8c10424a8b70cc7b6c94e726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:07.090304 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-1d10ba05-c41b-4132-bff2-ac64016d6acb tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] 10.222.0.60 "GET /compute/v2.1/servers/05cc41b4-ace4-4d14-90ed-ad19af43e268" status: 200 len: 1292 microversion: 2.1 time: 0.367300 Sep 14 09:05:07.097140 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1874/3701] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:05:06 2022] GET /compute/v2.1/servers/05cc41b4-ace4-4d14-90ed-ad19af43e268 => generated 1292 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:05:07.106789 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-72ff23cf-516a-4b1a-b868-aa97af84e12c tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:07.107454 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-72ff23cf-516a-4b1a-b868-aa97af84e12c tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] [instance: 6888685e-f6c3-4fbb-898a-f3a35bc1af6d] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:05:07.130443 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-72ff23cf-516a-4b1a-b868-aa97af84e12c tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:07.131025 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-72ff23cf-516a-4b1a-b868-aa97af84e12c tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:07.131465 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-72ff23cf-516a-4b1a-b868-aa97af84e12c tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:07.132270 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-72ff23cf-516a-4b1a-b868-aa97af84e12c tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:07.132832 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-72ff23cf-516a-4b1a-b868-aa97af84e12c tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:07.133850 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-72ff23cf-516a-4b1a-b868-aa97af84e12c tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:07.186467 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-e85b4d6b-cce9-4558-ad21-91adfecdfd97 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:07.201143 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e85b4d6b-cce9-4558-ad21-91adfecdfd97 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1317 microversion: 2.1 time: 1.035791 Sep 14 09:05:07.202523 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1828/3702] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:05:06 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1317 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:05:07.251372 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-f06b2720-6dea-47b9-8f72-2816494232db req-a2e9a884-65a8-48dc-b47b-287418d9e531 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6888685e-f6c3-4fbb-898a-f3a35bc1af6d", "name": "network-vif-plugged", "status": "completed", "tag": "5f68c034-228c-4cbb-aadb-a1217376e000"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:05:07.270349 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-f06b2720-6dea-47b9-8f72-2816494232db req-a2e9a884-65a8-48dc-b47b-287418d9e531 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:07.271275 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-f06b2720-6dea-47b9-8f72-2816494232db req-a2e9a884-65a8-48dc-b47b-287418d9e531 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:07.280837 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-f06b2720-6dea-47b9-8f72-2816494232db req-a2e9a884-65a8-48dc-b47b-287418d9e531 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:07.344870 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-f06b2720-6dea-47b9-8f72-2816494232db req-a2e9a884-65a8-48dc-b47b-287418d9e531 service nova] Creating event network-vif-plugged:5f68c034-228c-4cbb-aadb-a1217376e000 for instance 6888685e-f6c3-4fbb-898a-f3a35bc1af6d on n-h1-836830-18 Sep 14 09:05:07.365792 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-f06b2720-6dea-47b9-8f72-2816494232db req-a2e9a884-65a8-48dc-b47b-287418d9e531 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121467 Sep 14 09:05:07.367090 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1829/3703] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:05:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:05:07.747505 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f04f85a7-c671-42eb-b326-1823b498368e tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:07.747690 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f04f85a7-c671-42eb-b326-1823b498368e tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] [instance: 70b0fcd2-6fc4-4445-96bb-165dccf6c81c] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:05:07.764300 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f04f85a7-c671-42eb-b326-1823b498368e tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:07.764815 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f04f85a7-c671-42eb-b326-1823b498368e tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:07.765271 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f04f85a7-c671-42eb-b326-1823b498368e tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:07.766002 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f04f85a7-c671-42eb-b326-1823b498368e tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:07.766469 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f04f85a7-c671-42eb-b326-1823b498368e tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:07.766906 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f04f85a7-c671-42eb-b326-1823b498368e tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:08.820267 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f04f85a7-c671-42eb-b326-1823b498368e tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5165b8fc101c47c7a4370f9007bc5a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a597fc389b4805bbd3a53ecd17c5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:08.834729 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:05:08.838082 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f04f85a7-c671-42eb-b326-1823b498368e tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute/v2.1/servers/70b0fcd2-6fc4-4445-96bb-165dccf6c81c" status: 200 len: 1308 microversion: 2.1 time: 1.096629 Sep 14 09:05:08.839491 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1830/3704] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:05:07 2022] GET /compute/v2.1/servers/70b0fcd2-6fc4-4445-96bb-165dccf6c81c => generated 1308 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:05:08.845794 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-376caf77-868c-4415-b614-0862bcbf7c39 req-a127cc41-2263-4f73-b248-eebe44a9eae2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70b0fcd2-6fc4-4445-96bb-165dccf6c81c", "tag": "03d9d813-028b-4c20-8b8f-dff576919005"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:05:08.858971 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-376caf77-868c-4415-b614-0862bcbf7c39 req-a127cc41-2263-4f73-b248-eebe44a9eae2 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:08.859549 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-376caf77-868c-4415-b614-0862bcbf7c39 req-a127cc41-2263-4f73-b248-eebe44a9eae2 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:08.860003 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-376caf77-868c-4415-b614-0862bcbf7c39 req-a127cc41-2263-4f73-b248-eebe44a9eae2 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:08.879577 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-376caf77-868c-4415-b614-0862bcbf7c39 req-a127cc41-2263-4f73-b248-eebe44a9eae2 service nova] Creating event network-changed:03d9d813-028b-4c20-8b8f-dff576919005 for instance 70b0fcd2-6fc4-4445-96bb-165dccf6c81c on n-h2-836830-18 Sep 14 09:05:08.889299 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-376caf77-868c-4415-b614-0862bcbf7c39 req-a127cc41-2263-4f73-b248-eebe44a9eae2 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047408 Sep 14 09:05:08.890425 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1831/3705] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:05:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:05:08.892354 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-72ff23cf-516a-4b1a-b868-aa97af84e12c tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504ea33de5724b518bcdf28076d6361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd19911fb94d47ab92893a3ec449fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:08.898916 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-564b4b23-04e4-497f-bc88-8f0678f42f7d tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:08.900225 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-564b4b23-04e4-497f-bc88-8f0678f42f7d tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] [instance: 05cc41b4-ace4-4d14-90ed-ad19af43e268] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:05:08.900737 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-72ff23cf-516a-4b1a-b868-aa97af84e12c tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] 10.222.0.60 "GET /compute/v2.1/servers/6888685e-f6c3-4fbb-898a-f3a35bc1af6d" status: 200 len: 1318 microversion: 2.1 time: 1.802550 Sep 14 09:05:08.904864 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1875/3706] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:05:07 2022] GET /compute/v2.1/servers/6888685e-f6c3-4fbb-898a-f3a35bc1af6d => generated 1318 bytes in 1807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:05:08.909048 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-564b4b23-04e4-497f-bc88-8f0678f42f7d tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:08.909826 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b33ca5b1-5eb4-4e07-b364-ca0e8b778a84 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:08.910182 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-564b4b23-04e4-497f-bc88-8f0678f42f7d tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:08.910435 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-b33ca5b1-5eb4-4e07-b364-ca0e8b778a84 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:05:08.911047 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-564b4b23-04e4-497f-bc88-8f0678f42f7d tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:08.912397 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-564b4b23-04e4-497f-bc88-8f0678f42f7d tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:08.913521 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-564b4b23-04e4-497f-bc88-8f0678f42f7d tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:08.915162 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-564b4b23-04e4-497f-bc88-8f0678f42f7d tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:08.930127 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b33ca5b1-5eb4-4e07-b364-ca0e8b778a84 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:08.931515 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b33ca5b1-5eb4-4e07-b364-ca0e8b778a84 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:08.932013 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b33ca5b1-5eb4-4e07-b364-ca0e8b778a84 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:08.932739 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b33ca5b1-5eb4-4e07-b364-ca0e8b778a84 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:08.933206 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b33ca5b1-5eb4-4e07-b364-ca0e8b778a84 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:08.933635 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b33ca5b1-5eb4-4e07-b364-ca0e8b778a84 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:09.335668 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-564b4b23-04e4-497f-bc88-8f0678f42f7d tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02330887b6814bea8312e01103b0d2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a358bdeb8c10424a8b70cc7b6c94e726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:09.348759 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-564b4b23-04e4-497f-bc88-8f0678f42f7d tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] 10.222.0.60 "GET /compute/v2.1/servers/05cc41b4-ace4-4d14-90ed-ad19af43e268" status: 200 len: 1280 microversion: 2.1 time: 0.456260 Sep 14 09:05:09.352536 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1832/3707] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:05:08 2022] GET /compute/v2.1/servers/05cc41b4-ace4-4d14-90ed-ad19af43e268 => generated 1280 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:05:09.363197 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-cb5c24ec-083c-4b3e-86ea-80f966228c74 req-ca949b1d-45d6-492f-94c2-ed54adf21485 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae344b98-a354-4df8-83ba-3c5a786694f4", "tag": "61e7783e-94c8-44e3-8a64-73b1fe49a7cd"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:05:09.393568 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-cb5c24ec-083c-4b3e-86ea-80f966228c74 req-ca949b1d-45d6-492f-94c2-ed54adf21485 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:09.394483 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-cb5c24ec-083c-4b3e-86ea-80f966228c74 req-ca949b1d-45d6-492f-94c2-ed54adf21485 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:09.395395 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-cb5c24ec-083c-4b3e-86ea-80f966228c74 req-ca949b1d-45d6-492f-94c2-ed54adf21485 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:09.437256 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-cb5c24ec-083c-4b3e-86ea-80f966228c74 req-ca949b1d-45d6-492f-94c2-ed54adf21485 service nova] Creating event network-changed:61e7783e-94c8-44e3-8a64-73b1fe49a7cd for instance ae344b98-a354-4df8-83ba-3c5a786694f4 on n-h2-836830-18 Sep 14 09:05:09.445239 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-cb5c24ec-083c-4b3e-86ea-80f966228c74 req-ca949b1d-45d6-492f-94c2-ed54adf21485 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090135 Sep 14 09:05:09.447405 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1833/3708] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:05:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:05:09.560621 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-b33ca5b1-5eb4-4e07-b364-ca0e8b778a84 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:09.612327 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-b33ca5b1-5eb4-4e07-b364-ca0e8b778a84 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1317 microversion: 2.1 time: 0.705616 Sep 14 09:05:09.615036 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1876/3709] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:05:08 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1317 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:05:09.864029 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-73aa3791-6416-4b88-b14a-13843c35541c tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:09.864923 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-73aa3791-6416-4b88-b14a-13843c35541c tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] [instance: 70b0fcd2-6fc4-4445-96bb-165dccf6c81c] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:05:09.871973 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-73aa3791-6416-4b88-b14a-13843c35541c tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:09.872724 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-73aa3791-6416-4b88-b14a-13843c35541c tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:09.873161 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-73aa3791-6416-4b88-b14a-13843c35541c tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:09.874038 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-73aa3791-6416-4b88-b14a-13843c35541c tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:09.874665 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-73aa3791-6416-4b88-b14a-13843c35541c tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:09.875291 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-73aa3791-6416-4b88-b14a-13843c35541c tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:09.928631 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-19455ee8-972c-4514-bfa5-87c46517c77a tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:09.932563 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-19455ee8-972c-4514-bfa5-87c46517c77a tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] [instance: 6888685e-f6c3-4fbb-898a-f3a35bc1af6d] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:05:09.951387 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-19455ee8-972c-4514-bfa5-87c46517c77a tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:09.952085 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-19455ee8-972c-4514-bfa5-87c46517c77a tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:09.953476 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-19455ee8-972c-4514-bfa5-87c46517c77a tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:09.955573 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-19455ee8-972c-4514-bfa5-87c46517c77a tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:09.956050 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-19455ee8-972c-4514-bfa5-87c46517c77a tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:09.956489 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-19455ee8-972c-4514-bfa5-87c46517c77a tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:10.393401 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-73aa3791-6416-4b88-b14a-13843c35541c tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5165b8fc101c47c7a4370f9007bc5a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a597fc389b4805bbd3a53ecd17c5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:10.406319 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-73aa3791-6416-4b88-b14a-13843c35541c tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute/v2.1/servers/70b0fcd2-6fc4-4445-96bb-165dccf6c81c" status: 200 len: 1308 microversion: 2.1 time: 0.546848 Sep 14 09:05:10.419714 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1834/3710] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:05:09 2022] GET /compute/v2.1/servers/70b0fcd2-6fc4-4445-96bb-165dccf6c81c => generated 1308 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:05:10.435492 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-bc992599-bed0-4add-afb0-b55907a82dc6 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:10.440177 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-bc992599-bed0-4add-afb0-b55907a82dc6 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] [instance: 05cc41b4-ace4-4d14-90ed-ad19af43e268] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:05:10.449105 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-19455ee8-972c-4514-bfa5-87c46517c77a tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504ea33de5724b518bcdf28076d6361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd19911fb94d47ab92893a3ec449fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:10.455858 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bc992599-bed0-4add-afb0-b55907a82dc6 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:10.457990 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bc992599-bed0-4add-afb0-b55907a82dc6 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:10.459418 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bc992599-bed0-4add-afb0-b55907a82dc6 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:10.464281 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bc992599-bed0-4add-afb0-b55907a82dc6 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:10.464906 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bc992599-bed0-4add-afb0-b55907a82dc6 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:10.466123 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bc992599-bed0-4add-afb0-b55907a82dc6 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:10.479202 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-19455ee8-972c-4514-bfa5-87c46517c77a tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] 10.222.0.60 "GET /compute/v2.1/servers/6888685e-f6c3-4fbb-898a-f3a35bc1af6d" status: 200 len: 1318 microversion: 2.1 time: 0.552814 Sep 14 09:05:10.482413 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1877/3711] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:05:09 2022] GET /compute/v2.1/servers/6888685e-f6c3-4fbb-898a-f3a35bc1af6d => generated 1318 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:05:10.604610 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-bc992599-bed0-4add-afb0-b55907a82dc6 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02330887b6814bea8312e01103b0d2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a358bdeb8c10424a8b70cc7b6c94e726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:10.612791 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-bc992599-bed0-4add-afb0-b55907a82dc6 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] 10.222.0.60 "GET /compute/v2.1/servers/05cc41b4-ace4-4d14-90ed-ad19af43e268" status: 200 len: 1280 microversion: 2.1 time: 0.191844 Sep 14 09:05:10.631219 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1835/3712] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:05:10 2022] GET /compute/v2.1/servers/05cc41b4-ace4-4d14-90ed-ad19af43e268 => generated 1280 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:05:10.640917 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-8ae5812f-2928-46c5-9122-8d42f3ca3d10 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:10.641904 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-8ae5812f-2928-46c5-9122-8d42f3ca3d10 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:05:10.649761 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8ae5812f-2928-46c5-9122-8d42f3ca3d10 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:10.650585 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8ae5812f-2928-46c5-9122-8d42f3ca3d10 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:10.651506 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8ae5812f-2928-46c5-9122-8d42f3ca3d10 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:10.652382 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8ae5812f-2928-46c5-9122-8d42f3ca3d10 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:10.653080 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8ae5812f-2928-46c5-9122-8d42f3ca3d10 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:10.654716 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8ae5812f-2928-46c5-9122-8d42f3ca3d10 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:11.000886 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-8ae5812f-2928-46c5-9122-8d42f3ca3d10 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:11.021429 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-8ae5812f-2928-46c5-9122-8d42f3ca3d10 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1317 microversion: 2.1 time: 0.386522 Sep 14 09:05:11.022731 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1878/3713] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:05:10 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1317 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:05:11.434239 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-6d028201-968a-49c4-a4a3-4d6b4393e3f1 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:11.434867 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-6d028201-968a-49c4-a4a3-4d6b4393e3f1 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] [instance: 70b0fcd2-6fc4-4445-96bb-165dccf6c81c] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:05:11.454808 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6d028201-968a-49c4-a4a3-4d6b4393e3f1 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:11.459755 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6d028201-968a-49c4-a4a3-4d6b4393e3f1 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:11.460613 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6d028201-968a-49c4-a4a3-4d6b4393e3f1 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:11.463856 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6d028201-968a-49c4-a4a3-4d6b4393e3f1 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:11.465664 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6d028201-968a-49c4-a4a3-4d6b4393e3f1 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:11.466320 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6d028201-968a-49c4-a4a3-4d6b4393e3f1 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:11.512042 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-03461dee-59ba-43a0-8b1b-7ae5ab8800a1 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:11.513093 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-03461dee-59ba-43a0-8b1b-7ae5ab8800a1 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] [instance: 6888685e-f6c3-4fbb-898a-f3a35bc1af6d] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:05:11.521640 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-03461dee-59ba-43a0-8b1b-7ae5ab8800a1 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:11.522327 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-03461dee-59ba-43a0-8b1b-7ae5ab8800a1 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:11.523035 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-03461dee-59ba-43a0-8b1b-7ae5ab8800a1 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:11.523959 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-03461dee-59ba-43a0-8b1b-7ae5ab8800a1 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:11.524586 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-03461dee-59ba-43a0-8b1b-7ae5ab8800a1 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:11.525184 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-03461dee-59ba-43a0-8b1b-7ae5ab8800a1 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:11.712248 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=4 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:05:11.862182 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=16 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:05:12.084100 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-6d028201-968a-49c4-a4a3-4d6b4393e3f1 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5165b8fc101c47c7a4370f9007bc5a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a597fc389b4805bbd3a53ecd17c5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:12.092516 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-6d028201-968a-49c4-a4a3-4d6b4393e3f1 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute/v2.1/servers/70b0fcd2-6fc4-4445-96bb-165dccf6c81c" status: 200 len: 1308 microversion: 2.1 time: 0.662887 Sep 14 09:05:12.093035 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1836/3714] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:05:11 2022] GET /compute/v2.1/servers/70b0fcd2-6fc4-4445-96bb-165dccf6c81c => generated 1308 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:05:12.133831 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-1bc8eb07-9699-4980-b1f4-6a52dfb95728 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:12.134453 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-1bc8eb07-9699-4980-b1f4-6a52dfb95728 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] [instance: 05cc41b4-ace4-4d14-90ed-ad19af43e268] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:05:12.154982 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1bc8eb07-9699-4980-b1f4-6a52dfb95728 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:12.156687 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1bc8eb07-9699-4980-b1f4-6a52dfb95728 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:12.157324 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1bc8eb07-9699-4980-b1f4-6a52dfb95728 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:12.159002 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1bc8eb07-9699-4980-b1f4-6a52dfb95728 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:12.159866 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1bc8eb07-9699-4980-b1f4-6a52dfb95728 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:12.161893 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1bc8eb07-9699-4980-b1f4-6a52dfb95728 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:12.393992 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-03461dee-59ba-43a0-8b1b-7ae5ab8800a1 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504ea33de5724b518bcdf28076d6361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd19911fb94d47ab92893a3ec449fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:12.408226 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-03461dee-59ba-43a0-8b1b-7ae5ab8800a1 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] 10.222.0.60 "GET /compute/v2.1/servers/6888685e-f6c3-4fbb-898a-f3a35bc1af6d" status: 200 len: 1506 microversion: 2.1 time: 0.905339 Sep 14 09:05:12.420328 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1879/3715] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:05:11 2022] GET /compute/v2.1/servers/6888685e-f6c3-4fbb-898a-f3a35bc1af6d => generated 1506 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:05:12.440431 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-7c36fff1-077a-420d-96a1-5964d2447ce1 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:12.441891 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-7c36fff1-077a-420d-96a1-5964d2447ce1 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:05:12.457771 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7c36fff1-077a-420d-96a1-5964d2447ce1 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:12.463854 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7c36fff1-077a-420d-96a1-5964d2447ce1 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:12.464323 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7c36fff1-077a-420d-96a1-5964d2447ce1 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:12.465274 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7c36fff1-077a-420d-96a1-5964d2447ce1 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:12.465908 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7c36fff1-077a-420d-96a1-5964d2447ce1 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:12.466539 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7c36fff1-077a-420d-96a1-5964d2447ce1 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:12.480636 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-1bc8eb07-9699-4980-b1f4-6a52dfb95728 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02330887b6814bea8312e01103b0d2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a358bdeb8c10424a8b70cc7b6c94e726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:12.497696 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-1bc8eb07-9699-4980-b1f4-6a52dfb95728 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] 10.222.0.60 "GET /compute/v2.1/servers/05cc41b4-ace4-4d14-90ed-ad19af43e268" status: 200 len: 1280 microversion: 2.1 time: 0.382092 Sep 14 09:05:12.511558 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1837/3716] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:05:12 2022] GET /compute/v2.1/servers/05cc41b4-ace4-4d14-90ed-ad19af43e268 => generated 1280 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:05:12.524396 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a3dace99-47fb-4590-8c40-1f58539aa566 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:12.525173 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-a3dace99-47fb-4590-8c40-1f58539aa566 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] [instance: 6888685e-f6c3-4fbb-898a-f3a35bc1af6d] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:05:12.542772 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a3dace99-47fb-4590-8c40-1f58539aa566 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:12.543585 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a3dace99-47fb-4590-8c40-1f58539aa566 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:12.544205 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a3dace99-47fb-4590-8c40-1f58539aa566 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:12.545418 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a3dace99-47fb-4590-8c40-1f58539aa566 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:12.554767 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a3dace99-47fb-4590-8c40-1f58539aa566 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:12.557844 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a3dace99-47fb-4590-8c40-1f58539aa566 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:12.624889 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-a3dace99-47fb-4590-8c40-1f58539aa566 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] [instance: 6888685e-f6c3-4fbb-898a-f3a35bc1af6d] Going to try to terminate instance {{(pid=128759) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:05:12.795029 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a3dace99-47fb-4590-8c40-1f58539aa566 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] 10.222.0.60 "DELETE /compute/v2.1/servers/6888685e-f6c3-4fbb-898a-f3a35bc1af6d" status: 204 len: 0 microversion: 2.1 time: 0.281894 Sep 14 09:05:12.795962 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1838/3717] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:05:12 2022] DELETE /compute/v2.1/servers/6888685e-f6c3-4fbb-898a-f3a35bc1af6d => generated 0 bytes in 284 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:05:12.807525 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-187c08cf-bdda-4924-91f6-4a388209e537 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:12.808689 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-187c08cf-bdda-4924-91f6-4a388209e537 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] [instance: c78e1261-6476-4835-882e-3e59b1d1083e] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:05:12.817588 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-187c08cf-bdda-4924-91f6-4a388209e537 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:12.818636 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-187c08cf-bdda-4924-91f6-4a388209e537 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:12.819328 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-187c08cf-bdda-4924-91f6-4a388209e537 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:12.820377 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-187c08cf-bdda-4924-91f6-4a388209e537 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:12.821613 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-187c08cf-bdda-4924-91f6-4a388209e537 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:12.822265 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-187c08cf-bdda-4924-91f6-4a388209e537 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:12.871389 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-187c08cf-bdda-4924-91f6-4a388209e537 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] [instance: c78e1261-6476-4835-882e-3e59b1d1083e] Going to try to terminate instance {{(pid=128759) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:05:12.877486 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-7c36fff1-077a-420d-96a1-5964d2447ce1 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:12.886888 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-7c36fff1-077a-420d-96a1-5964d2447ce1 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1317 microversion: 2.1 time: 0.464821 Sep 14 09:05:12.892554 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1880/3718] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:05:12 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1317 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:05:13.052958 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-187c08cf-bdda-4924-91f6-4a388209e537 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] 10.222.0.60 "DELETE /compute/v2.1/servers/c78e1261-6476-4835-882e-3e59b1d1083e" status: 204 len: 0 microversion: 2.1 time: 0.251356 Sep 14 09:05:13.055871 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1839/3719] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:05:12 2022] DELETE /compute/v2.1/servers/c78e1261-6476-4835-882e-3e59b1d1083e => generated 0 bytes in 256 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:05:13.063869 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-2d0c152e-62b4-425d-a5d7-5cb791400336 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:13.064755 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-2d0c152e-62b4-425d-a5d7-5cb791400336 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] [instance: 6888685e-f6c3-4fbb-898a-f3a35bc1af6d] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:05:13.077991 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2d0c152e-62b4-425d-a5d7-5cb791400336 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:13.078491 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2d0c152e-62b4-425d-a5d7-5cb791400336 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:13.078931 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2d0c152e-62b4-425d-a5d7-5cb791400336 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:13.079665 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2d0c152e-62b4-425d-a5d7-5cb791400336 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:13.080130 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2d0c152e-62b4-425d-a5d7-5cb791400336 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:13.080552 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2d0c152e-62b4-425d-a5d7-5cb791400336 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:13.118579 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9e6b5fdb-1b88-4096-9f3e-0700c8533e62 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:13.119714 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-9e6b5fdb-1b88-4096-9f3e-0700c8533e62 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] [instance: 70b0fcd2-6fc4-4445-96bb-165dccf6c81c] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:05:13.131437 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9e6b5fdb-1b88-4096-9f3e-0700c8533e62 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:13.132246 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9e6b5fdb-1b88-4096-9f3e-0700c8533e62 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:13.133643 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9e6b5fdb-1b88-4096-9f3e-0700c8533e62 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:13.138357 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9e6b5fdb-1b88-4096-9f3e-0700c8533e62 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:13.139118 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9e6b5fdb-1b88-4096-9f3e-0700c8533e62 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:13.141190 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9e6b5fdb-1b88-4096-9f3e-0700c8533e62 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:13.461589 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=4 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:05:13.757660 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=8 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:05:14.296274 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-9e6b5fdb-1b88-4096-9f3e-0700c8533e62 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5165b8fc101c47c7a4370f9007bc5a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a597fc389b4805bbd3a53ecd17c5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:14.308389 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-2d0c152e-62b4-425d-a5d7-5cb791400336 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504ea33de5724b518bcdf28076d6361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd19911fb94d47ab92893a3ec449fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:14.324314 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-2d0c152e-62b4-425d-a5d7-5cb791400336 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] 10.222.0.60 "GET /compute/v2.1/servers/6888685e-f6c3-4fbb-898a-f3a35bc1af6d" status: 200 len: 1512 microversion: 2.1 time: 1.264270 Sep 14 09:05:14.324909 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1881/3720] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:05:13 2022] GET /compute/v2.1/servers/6888685e-f6c3-4fbb-898a-f3a35bc1af6d => generated 1512 bytes in 1266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:05:14.344459 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-9e6b5fdb-1b88-4096-9f3e-0700c8533e62 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute/v2.1/servers/70b0fcd2-6fc4-4445-96bb-165dccf6c81c" status: 200 len: 1308 microversion: 2.1 time: 1.230031 Sep 14 09:05:14.345076 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1840/3721] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:05:13 2022] GET /compute/v2.1/servers/70b0fcd2-6fc4-4445-96bb-165dccf6c81c => generated 1308 bytes in 1232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:05:14.345580 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-fbed2a8b-3462-4b3f-b178-14796e3ac52c tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:14.346445 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-fbed2a8b-3462-4b3f-b178-14796e3ac52c tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] [instance: 05cc41b4-ace4-4d14-90ed-ad19af43e268] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:05:14.353612 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fbed2a8b-3462-4b3f-b178-14796e3ac52c tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:14.361774 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fbed2a8b-3462-4b3f-b178-14796e3ac52c tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:14.362595 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fbed2a8b-3462-4b3f-b178-14796e3ac52c tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:14.363618 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fbed2a8b-3462-4b3f-b178-14796e3ac52c tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:14.364304 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fbed2a8b-3462-4b3f-b178-14796e3ac52c tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:14.365007 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fbed2a8b-3462-4b3f-b178-14796e3ac52c tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:14.386698 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-566b6d59-32e4-4c73-ba64-a509d47eff20 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:14.401022 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-566b6d59-32e4-4c73-ba64-a509d47eff20 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:05:14.404911 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=100 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:05:14.431462 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-566b6d59-32e4-4c73-ba64-a509d47eff20 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:14.433898 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-566b6d59-32e4-4c73-ba64-a509d47eff20 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:14.434373 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-566b6d59-32e4-4c73-ba64-a509d47eff20 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:14.435140 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-566b6d59-32e4-4c73-ba64-a509d47eff20 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:14.437813 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-566b6d59-32e4-4c73-ba64-a509d47eff20 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:14.438320 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-566b6d59-32e4-4c73-ba64-a509d47eff20 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:14.824909 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-fbed2a8b-3462-4b3f-b178-14796e3ac52c tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02330887b6814bea8312e01103b0d2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a358bdeb8c10424a8b70cc7b6c94e726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:14.833408 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-fbed2a8b-3462-4b3f-b178-14796e3ac52c tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] 10.222.0.60 "GET /compute/v2.1/servers/05cc41b4-ace4-4d14-90ed-ad19af43e268" status: 200 len: 1322 microversion: 2.1 time: 0.507178 Sep 14 09:05:14.834622 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1882/3722] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:05:14 2022] GET /compute/v2.1/servers/05cc41b4-ace4-4d14-90ed-ad19af43e268 => generated 1322 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:05:15.170899 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-566b6d59-32e4-4c73-ba64-a509d47eff20 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:15.188887 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-566b6d59-32e4-4c73-ba64-a509d47eff20 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1317 microversion: 2.1 time: 0.835177 Sep 14 09:05:15.224172 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1841/3723] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:05:14 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1317 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:05:15.310004 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-e1eb3f61-e7d0-4998-b02c-86c699989c89 req-b5124954-9a35-4660-9c54-ce009e364f21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70b0fcd2-6fc4-4445-96bb-165dccf6c81c", "name": "network-vif-plugged", "status": "completed", "tag": "03d9d813-028b-4c20-8b8f-dff576919005"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:05:15.345026 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-e1eb3f61-e7d0-4998-b02c-86c699989c89 req-b5124954-9a35-4660-9c54-ce009e364f21 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:15.346968 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-e1eb3f61-e7d0-4998-b02c-86c699989c89 req-b5124954-9a35-4660-9c54-ce009e364f21 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:15.348068 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-e1eb3f61-e7d0-4998-b02c-86c699989c89 req-b5124954-9a35-4660-9c54-ce009e364f21 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:15.349072 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d67001c1-3b87-4e5d-b600-e451543b219e tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:15.349711 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-d67001c1-3b87-4e5d-b600-e451543b219e tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] [instance: 6888685e-f6c3-4fbb-898a-f3a35bc1af6d] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:05:15.360727 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d67001c1-3b87-4e5d-b600-e451543b219e tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:15.363849 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d67001c1-3b87-4e5d-b600-e451543b219e tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:15.366869 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d67001c1-3b87-4e5d-b600-e451543b219e tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:15.368868 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d67001c1-3b87-4e5d-b600-e451543b219e tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:15.371299 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d67001c1-3b87-4e5d-b600-e451543b219e tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:15.373910 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d67001c1-3b87-4e5d-b600-e451543b219e tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:15.379835 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-e1eb3f61-e7d0-4998-b02c-86c699989c89 req-b5124954-9a35-4660-9c54-ce009e364f21 service nova] Creating event network-vif-plugged:03d9d813-028b-4c20-8b8f-dff576919005 for instance 70b0fcd2-6fc4-4445-96bb-165dccf6c81c on n-h2-836830-18 Sep 14 09:05:15.393420 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-e1eb3f61-e7d0-4998-b02c-86c699989c89 req-b5124954-9a35-4660-9c54-ce009e364f21 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087329 Sep 14 09:05:15.395094 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1883/3724] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:05:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:05:15.415214 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-4cb750c2-31b4-49c4-a7a9-7d7a524ff034 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:15.416509 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-4cb750c2-31b4-49c4-a7a9-7d7a524ff034 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] [instance: 70b0fcd2-6fc4-4445-96bb-165dccf6c81c] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:05:15.426152 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4cb750c2-31b4-49c4-a7a9-7d7a524ff034 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:15.427166 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4cb750c2-31b4-49c4-a7a9-7d7a524ff034 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:15.427817 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4cb750c2-31b4-49c4-a7a9-7d7a524ff034 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:15.428802 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4cb750c2-31b4-49c4-a7a9-7d7a524ff034 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:15.432650 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4cb750c2-31b4-49c4-a7a9-7d7a524ff034 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:15.433386 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4cb750c2-31b4-49c4-a7a9-7d7a524ff034 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:16.216713 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-d67001c1-3b87-4e5d-b600-e451543b219e tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504ea33de5724b518bcdf28076d6361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd19911fb94d47ab92893a3ec449fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:16.228785 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d67001c1-3b87-4e5d-b600-e451543b219e tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] 10.222.0.60 "GET /compute/v2.1/servers/6888685e-f6c3-4fbb-898a-f3a35bc1af6d" status: 200 len: 1512 microversion: 2.1 time: 0.883375 Sep 14 09:05:16.229640 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1842/3725] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:05:15 2022] GET /compute/v2.1/servers/6888685e-f6c3-4fbb-898a-f3a35bc1af6d => generated 1512 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:05:16.248512 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-4cb750c2-31b4-49c4-a7a9-7d7a524ff034 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5165b8fc101c47c7a4370f9007bc5a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a597fc389b4805bbd3a53ecd17c5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:16.261883 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-4cb750c2-31b4-49c4-a7a9-7d7a524ff034 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute/v2.1/servers/70b0fcd2-6fc4-4445-96bb-165dccf6c81c" status: 200 len: 1308 microversion: 2.1 time: 0.865338 Sep 14 09:05:16.262792 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1884/3726] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:05:15 2022] GET /compute/v2.1/servers/70b0fcd2-6fc4-4445-96bb-165dccf6c81c => generated 1308 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:05:16.269032 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ba6d2cc6-9aa5-47a4-977a-75864c40d359 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:16.270402 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-ba6d2cc6-9aa5-47a4-977a-75864c40d359 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] [instance: 05cc41b4-ace4-4d14-90ed-ad19af43e268] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:05:16.271331 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-100f4b8b-2e48-42b3-85e2-e31c96bf0aaf req-91ac8ff0-f0f6-4258-9d94-41293afefc27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1435eb10-e290-4e5c-9e16-4bbcc2cba6db", "tag": "330d89cb-bba9-4c9b-aa73-5b27d08980b0"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:05:16.279278 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ba6d2cc6-9aa5-47a4-977a-75864c40d359 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:16.280465 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ba6d2cc6-9aa5-47a4-977a-75864c40d359 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:16.282748 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ba6d2cc6-9aa5-47a4-977a-75864c40d359 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:16.288558 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ba6d2cc6-9aa5-47a4-977a-75864c40d359 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:16.290363 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ba6d2cc6-9aa5-47a4-977a-75864c40d359 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:16.291270 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ba6d2cc6-9aa5-47a4-977a-75864c40d359 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:16.312218 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-100f4b8b-2e48-42b3-85e2-e31c96bf0aaf req-91ac8ff0-f0f6-4258-9d94-41293afefc27 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:16.315184 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-100f4b8b-2e48-42b3-85e2-e31c96bf0aaf req-91ac8ff0-f0f6-4258-9d94-41293afefc27 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:16.316240 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-100f4b8b-2e48-42b3-85e2-e31c96bf0aaf req-91ac8ff0-f0f6-4258-9d94-41293afefc27 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:16.362271 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-100f4b8b-2e48-42b3-85e2-e31c96bf0aaf req-91ac8ff0-f0f6-4258-9d94-41293afefc27 service nova] Creating event network-changed:330d89cb-bba9-4c9b-aa73-5b27d08980b0 for instance 1435eb10-e290-4e5c-9e16-4bbcc2cba6db on n-h1-836830-18 Sep 14 09:05:16.389655 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-100f4b8b-2e48-42b3-85e2-e31c96bf0aaf req-91ac8ff0-f0f6-4258-9d94-41293afefc27 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.157488 Sep 14 09:05:16.390821 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1843/3727] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:05:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:05:16.403710 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d174a0ff-a49b-4500-b07f-6256fdefa9d4 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:16.404746 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-d174a0ff-a49b-4500-b07f-6256fdefa9d4 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:05:16.415810 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d174a0ff-a49b-4500-b07f-6256fdefa9d4 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:16.417569 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d174a0ff-a49b-4500-b07f-6256fdefa9d4 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:16.418191 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d174a0ff-a49b-4500-b07f-6256fdefa9d4 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:16.421029 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d174a0ff-a49b-4500-b07f-6256fdefa9d4 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:16.425402 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d174a0ff-a49b-4500-b07f-6256fdefa9d4 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:16.426136 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d174a0ff-a49b-4500-b07f-6256fdefa9d4 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:16.895452 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-ba6d2cc6-9aa5-47a4-977a-75864c40d359 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02330887b6814bea8312e01103b0d2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a358bdeb8c10424a8b70cc7b6c94e726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:16.963660 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-ba6d2cc6-9aa5-47a4-977a-75864c40d359 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] 10.222.0.60 "GET /compute/v2.1/servers/05cc41b4-ace4-4d14-90ed-ad19af43e268" status: 200 len: 1322 microversion: 2.1 time: 0.697971 Sep 14 09:05:16.965415 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1885/3728] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:05:16 2022] GET /compute/v2.1/servers/05cc41b4-ace4-4d14-90ed-ad19af43e268 => generated 1322 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:05:17.006909 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-d174a0ff-a49b-4500-b07f-6256fdefa9d4 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:17.022158 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d174a0ff-a49b-4500-b07f-6256fdefa9d4 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1317 microversion: 2.1 time: 0.626810 Sep 14 09:05:17.023406 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1844/3729] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:05:16 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1317 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:05:17.159650 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-cbce8b4b-aae5-414c-8b4b-b73b154fda5b req-917b3c3a-22b8-4861-b086-f8ca2135057b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05cc41b4-ace4-4d14-90ed-ad19af43e268", "tag": "95399de6-926b-4e21-b4ae-2cdbd4f773e4"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:05:17.187622 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-cbce8b4b-aae5-414c-8b4b-b73b154fda5b req-917b3c3a-22b8-4861-b086-f8ca2135057b service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:17.190237 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-cbce8b4b-aae5-414c-8b4b-b73b154fda5b req-917b3c3a-22b8-4861-b086-f8ca2135057b service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:17.192791 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-cbce8b4b-aae5-414c-8b4b-b73b154fda5b req-917b3c3a-22b8-4861-b086-f8ca2135057b service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:17.232537 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-cbce8b4b-aae5-414c-8b4b-b73b154fda5b req-917b3c3a-22b8-4861-b086-f8ca2135057b service nova] Creating event network-changed:95399de6-926b-4e21-b4ae-2cdbd4f773e4 for instance 05cc41b4-ace4-4d14-90ed-ad19af43e268 on n-h1-836830-18 Sep 14 09:05:17.256078 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-807da0d4-8833-43e9-834b-0696d34a3063 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:17.256997 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-807da0d4-8833-43e9-834b-0696d34a3063 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] [instance: 6888685e-f6c3-4fbb-898a-f3a35bc1af6d] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:05:17.274525 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-807da0d4-8833-43e9-834b-0696d34a3063 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:17.275152 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-807da0d4-8833-43e9-834b-0696d34a3063 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:17.278921 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-cbce8b4b-aae5-414c-8b4b-b73b154fda5b req-917b3c3a-22b8-4861-b086-f8ca2135057b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122516 Sep 14 09:05:17.281215 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-807da0d4-8833-43e9-834b-0696d34a3063 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:17.282059 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-807da0d4-8833-43e9-834b-0696d34a3063 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:17.284498 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1886/3730] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:05:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:05:17.284620 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-807da0d4-8833-43e9-834b-0696d34a3063 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:17.290078 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-807da0d4-8833-43e9-834b-0696d34a3063 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:17.312444 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b72482c5-c094-4e5e-bf30-138403f1662a tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:17.313781 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-b72482c5-c094-4e5e-bf30-138403f1662a tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] [instance: 70b0fcd2-6fc4-4445-96bb-165dccf6c81c] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:05:17.340691 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b72482c5-c094-4e5e-bf30-138403f1662a tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:17.341211 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b72482c5-c094-4e5e-bf30-138403f1662a tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:17.344689 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b72482c5-c094-4e5e-bf30-138403f1662a tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:17.345664 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b72482c5-c094-4e5e-bf30-138403f1662a tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:17.347237 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b72482c5-c094-4e5e-bf30-138403f1662a tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:17.348168 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b72482c5-c094-4e5e-bf30-138403f1662a tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:17.723882 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-807da0d4-8833-43e9-834b-0696d34a3063 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504ea33de5724b518bcdf28076d6361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd19911fb94d47ab92893a3ec449fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:17.745826 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-807da0d4-8833-43e9-834b-0696d34a3063 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] 10.222.0.60 "GET /compute/v2.1/servers/6888685e-f6c3-4fbb-898a-f3a35bc1af6d" status: 200 len: 1470 microversion: 2.1 time: 0.482436 Sep 14 09:05:17.746678 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1845/3731] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:05:17 2022] GET /compute/v2.1/servers/6888685e-f6c3-4fbb-898a-f3a35bc1af6d => generated 1470 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:05:17.751600 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-6ce3f3bc-b4c1-49b3-85df-85335be08003 req-80d0926f-c4af-4fbe-abe2-65e926a4d080 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae344b98-a354-4df8-83ba-3c5a786694f4", "name": "network-vif-plugged", "status": "completed", "tag": "61e7783e-94c8-44e3-8a64-73b1fe49a7cd"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:05:17.770300 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-6ce3f3bc-b4c1-49b3-85df-85335be08003 req-80d0926f-c4af-4fbe-abe2-65e926a4d080 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:17.770889 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-6ce3f3bc-b4c1-49b3-85df-85335be08003 req-80d0926f-c4af-4fbe-abe2-65e926a4d080 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:17.771476 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-6ce3f3bc-b4c1-49b3-85df-85335be08003 req-80d0926f-c4af-4fbe-abe2-65e926a4d080 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:17.780423 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:05:17.788937 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-6ce3f3bc-b4c1-49b3-85df-85335be08003 req-80d0926f-c4af-4fbe-abe2-65e926a4d080 service nova] Creating event network-vif-plugged:61e7783e-94c8-44e3-8a64-73b1fe49a7cd for instance ae344b98-a354-4df8-83ba-3c5a786694f4 on n-h2-836830-18 Sep 14 09:05:17.797287 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-6ce3f3bc-b4c1-49b3-85df-85335be08003 req-80d0926f-c4af-4fbe-abe2-65e926a4d080 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048446 Sep 14 09:05:17.798609 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1846/3732] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:05:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:05:17.993029 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-df5bfd47-7d5a-458d-9bad-b35b0550686b tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:17.994259 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-df5bfd47-7d5a-458d-9bad-b35b0550686b tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] [instance: 05cc41b4-ace4-4d14-90ed-ad19af43e268] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:05:18.001668 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-df5bfd47-7d5a-458d-9bad-b35b0550686b tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:18.002330 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-df5bfd47-7d5a-458d-9bad-b35b0550686b tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:18.002882 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-df5bfd47-7d5a-458d-9bad-b35b0550686b tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:18.004417 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-df5bfd47-7d5a-458d-9bad-b35b0550686b tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:18.007196 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-df5bfd47-7d5a-458d-9bad-b35b0550686b tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:18.007741 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-df5bfd47-7d5a-458d-9bad-b35b0550686b tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:18.218578 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-b72482c5-c094-4e5e-bf30-138403f1662a tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5165b8fc101c47c7a4370f9007bc5a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a597fc389b4805bbd3a53ecd17c5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:18.241067 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-b72482c5-c094-4e5e-bf30-138403f1662a tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute/v2.1/servers/70b0fcd2-6fc4-4445-96bb-165dccf6c81c" status: 200 len: 1308 microversion: 2.1 time: 0.953705 Sep 14 09:05:18.242023 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1887/3733] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:05:17 2022] GET /compute/v2.1/servers/70b0fcd2-6fc4-4445-96bb-165dccf6c81c => generated 1308 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:05:18.251654 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-2153ebad-7321-4192-9be4-c08047fe6e5d tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:18.252836 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-2153ebad-7321-4192-9be4-c08047fe6e5d tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:05:18.271161 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2153ebad-7321-4192-9be4-c08047fe6e5d tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:18.272394 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2153ebad-7321-4192-9be4-c08047fe6e5d tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:18.274570 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2153ebad-7321-4192-9be4-c08047fe6e5d tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:18.276284 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2153ebad-7321-4192-9be4-c08047fe6e5d tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:18.277843 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2153ebad-7321-4192-9be4-c08047fe6e5d tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:18.278880 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2153ebad-7321-4192-9be4-c08047fe6e5d tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:18.539688 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-df5bfd47-7d5a-458d-9bad-b35b0550686b tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02330887b6814bea8312e01103b0d2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a358bdeb8c10424a8b70cc7b6c94e726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:18.551993 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-df5bfd47-7d5a-458d-9bad-b35b0550686b tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] 10.222.0.60 "GET /compute/v2.1/servers/05cc41b4-ace4-4d14-90ed-ad19af43e268" status: 200 len: 1322 microversion: 2.1 time: 0.563305 Sep 14 09:05:18.554894 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1847/3734] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:05:17 2022] GET /compute/v2.1/servers/05cc41b4-ace4-4d14-90ed-ad19af43e268 => generated 1322 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:05:18.565884 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-835dae30-cf68-4667-b3bd-4bea638b5b51 req-b0fdbf4b-89c6-409c-a619-9a6a85bd023b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "136e2cad-31c9-4c0a-93ae-b6de98a41f8b", "tag": "22809180-f268-43df-8a33-bcce72f1b6ab"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:05:18.593534 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-835dae30-cf68-4667-b3bd-4bea638b5b51 req-b0fdbf4b-89c6-409c-a619-9a6a85bd023b service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:18.595434 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-835dae30-cf68-4667-b3bd-4bea638b5b51 req-b0fdbf4b-89c6-409c-a619-9a6a85bd023b service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:18.596037 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-835dae30-cf68-4667-b3bd-4bea638b5b51 req-b0fdbf4b-89c6-409c-a619-9a6a85bd023b service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:18.630069 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-835dae30-cf68-4667-b3bd-4bea638b5b51 req-b0fdbf4b-89c6-409c-a619-9a6a85bd023b service nova] Creating event network-changed:22809180-f268-43df-8a33-bcce72f1b6ab for instance 136e2cad-31c9-4c0a-93ae-b6de98a41f8b on n-h2-836830-18 Sep 14 09:05:18.642471 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-835dae30-cf68-4667-b3bd-4bea638b5b51 req-b0fdbf4b-89c6-409c-a619-9a6a85bd023b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085956 Sep 14 09:05:18.643241 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1848/3735] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:05:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:05:18.725207 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-2153ebad-7321-4192-9be4-c08047fe6e5d tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:18.748214 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-2153ebad-7321-4192-9be4-c08047fe6e5d tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1317 microversion: 2.1 time: 0.503137 Sep 14 09:05:18.749485 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1888/3736] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:05:18 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1317 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:05:18.774522 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b9d61c18-f910-4a22-9823-c2469bdf0d75 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:18.775995 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b9d61c18-f910-4a22-9823-c2469bdf0d75 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] [instance: 6888685e-f6c3-4fbb-898a-f3a35bc1af6d] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:05:18.787171 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b9d61c18-f910-4a22-9823-c2469bdf0d75 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:18.787998 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b9d61c18-f910-4a22-9823-c2469bdf0d75 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:18.788672 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b9d61c18-f910-4a22-9823-c2469bdf0d75 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:18.791302 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b9d61c18-f910-4a22-9823-c2469bdf0d75 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:18.792239 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b9d61c18-f910-4a22-9823-c2469bdf0d75 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:18.792908 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b9d61c18-f910-4a22-9823-c2469bdf0d75 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:18.834557 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:INSERT=11,nova_api:SELECT=87,nova_api:UPDATE=2 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:05:18.837368 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b9d61c18-f910-4a22-9823-c2469bdf0d75 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:18.838174 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b9d61c18-f910-4a22-9823-c2469bdf0d75 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:18.838900 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b9d61c18-f910-4a22-9823-c2469bdf0d75 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:18.839677 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.objects.instance [None req-b9d61c18-f910-4a22-9823-c2469bdf0d75 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lazy-loading 'fault' on Instance uuid 6888685e-f6c3-4fbb-898a-f3a35bc1af6d {{(pid=128759) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:05:18.917702 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b9d61c18-f910-4a22-9823-c2469bdf0d75 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504ea33de5724b518bcdf28076d6361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd19911fb94d47ab92893a3ec449fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:18.936725 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b9d61c18-f910-4a22-9823-c2469bdf0d75 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] 10.222.0.60 "GET /compute/v2.1/servers/6888685e-f6c3-4fbb-898a-f3a35bc1af6d" status: 200 len: 1308 microversion: 2.1 time: 0.167944 Sep 14 09:05:18.939074 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1849/3737] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:05:18 2022] GET /compute/v2.1/servers/6888685e-f6c3-4fbb-898a-f3a35bc1af6d => generated 1308 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:05:19.267428 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-046e8d82-2dde-481d-9f73-e4ffce1690be tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:19.268040 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-046e8d82-2dde-481d-9f73-e4ffce1690be tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] [instance: 70b0fcd2-6fc4-4445-96bb-165dccf6c81c] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:05:19.275177 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-046e8d82-2dde-481d-9f73-e4ffce1690be tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:19.281949 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-2d80114d-26de-43cd-aaba-b2e1707fb410 tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-1665428776", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "networks": [{"uuid": "43d52445-2253-4bc7-a9ba-472f9e41f197"}]}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:05:19.288326 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-046e8d82-2dde-481d-9f73-e4ffce1690be tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:19.288821 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-046e8d82-2dde-481d-9f73-e4ffce1690be tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:19.289646 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-046e8d82-2dde-481d-9f73-e4ffce1690be tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:19.290141 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-046e8d82-2dde-481d-9f73-e4ffce1690be tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:19.290530 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-046e8d82-2dde-481d-9f73-e4ffce1690be tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:19.362460 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.network.neutron [None req-2d80114d-26de-43cd-aaba-b2e1707fb410 tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] validate_networks() for [('43d52445-2253-4bc7-a9ba-472f9e41f197', None, None, None, None, None)] {{(pid=128758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:05:19.817607 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-046e8d82-2dde-481d-9f73-e4ffce1690be tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5165b8fc101c47c7a4370f9007bc5a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a597fc389b4805bbd3a53ecd17c5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:19.837312 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-046e8d82-2dde-481d-9f73-e4ffce1690be tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute/v2.1/servers/70b0fcd2-6fc4-4445-96bb-165dccf6c81c" status: 200 len: 1488 microversion: 2.1 time: 0.573910 Sep 14 09:05:19.841625 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1850/3738] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:05:19 2022] GET /compute/v2.1/servers/70b0fcd2-6fc4-4445-96bb-165dccf6c81c => generated 1488 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:05:19.853811 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-111a1dfb-8ad5-46c7-967a-92439fc3c050 req-2d2f56de-4a0e-461d-93ce-a7fbc8d75a66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6888685e-f6c3-4fbb-898a-f3a35bc1af6d", "name": "network-vif-deleted", "tag": "5f68c034-228c-4cbb-aadb-a1217376e000"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:05:19.890217 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-111a1dfb-8ad5-46c7-967a-92439fc3c050 req-2d2f56de-4a0e-461d-93ce-a7fbc8d75a66 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:19.890720 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-111a1dfb-8ad5-46c7-967a-92439fc3c050 req-2d2f56de-4a0e-461d-93ce-a7fbc8d75a66 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:19.895328 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-111a1dfb-8ad5-46c7-967a-92439fc3c050 req-2d2f56de-4a0e-461d-93ce-a7fbc8d75a66 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:19.928847 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-111a1dfb-8ad5-46c7-967a-92439fc3c050 req-2d2f56de-4a0e-461d-93ce-a7fbc8d75a66 service nova] Creating event network-vif-deleted:5f68c034-228c-4cbb-aadb-a1217376e000 for instance 6888685e-f6c3-4fbb-898a-f3a35bc1af6d on n-h1-836830-18 Sep 14 09:05:19.942881 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-111a1dfb-8ad5-46c7-967a-92439fc3c050 req-2d2f56de-4a0e-461d-93ce-a7fbc8d75a66 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100151 Sep 14 09:05:19.946730 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1851/3739] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:05:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:05:19.952374 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-34010dc2-ee9e-4860-b6fa-9f71521601d2 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:19.958848 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-34010dc2-ee9e-4860-b6fa-9f71521601d2 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] [instance: 05cc41b4-ace4-4d14-90ed-ad19af43e268] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:05:19.979603 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-34010dc2-ee9e-4860-b6fa-9f71521601d2 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:19.980394 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-34010dc2-ee9e-4860-b6fa-9f71521601d2 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:19.983236 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-34010dc2-ee9e-4860-b6fa-9f71521601d2 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:19.985689 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-34010dc2-ee9e-4860-b6fa-9f71521601d2 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:19.986489 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-34010dc2-ee9e-4860-b6fa-9f71521601d2 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:19.987829 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-34010dc2-ee9e-4860-b6fa-9f71521601d2 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:20.749660 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-34010dc2-ee9e-4860-b6fa-9f71521601d2 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02330887b6814bea8312e01103b0d2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a358bdeb8c10424a8b70cc7b6c94e726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:20.767891 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-34010dc2-ee9e-4860-b6fa-9f71521601d2 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] 10.222.0.60 "GET /compute/v2.1/servers/05cc41b4-ace4-4d14-90ed-ad19af43e268" status: 200 len: 1322 microversion: 2.1 time: 0.819556 Sep 14 09:05:20.769812 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1852/3740] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:05:19 2022] GET /compute/v2.1/servers/05cc41b4-ace4-4d14-90ed-ad19af43e268 => generated 1322 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:05:20.816052 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-4aaa9578-067c-463f-a0e5-6deb17910971 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:20.817432 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-4aaa9578-067c-463f-a0e5-6deb17910971 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:05:20.871340 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4aaa9578-067c-463f-a0e5-6deb17910971 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:20.878966 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-2d80114d-26de-43cd-aaba-b2e1707fb410 tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Flavor limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:05:20.880052 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-2d80114d-26de-43cd-aaba-b2e1707fb410 tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Image limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:05:20.880837 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-2d80114d-26de-43cd-aaba-b2e1707fb410 tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Flavor pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:05:20.881456 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-2d80114d-26de-43cd-aaba-b2e1707fb410 tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Image pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:05:20.882054 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-2d80114d-26de-43cd-aaba-b2e1707fb410 tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:05:20.892317 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4aaa9578-067c-463f-a0e5-6deb17910971 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:20.895535 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4aaa9578-067c-463f-a0e5-6deb17910971 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:20.896468 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=3 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:05:20.904511 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4aaa9578-067c-463f-a0e5-6deb17910971 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:20.907913 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4aaa9578-067c-463f-a0e5-6deb17910971 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:20.908383 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4aaa9578-067c-463f-a0e5-6deb17910971 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:20.932680 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2d80114d-26de-43cd-aaba-b2e1707fb410 tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:20.934514 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2d80114d-26de-43cd-aaba-b2e1707fb410 tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:20.936822 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2d80114d-26de-43cd-aaba-b2e1707fb410 tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:20.939074 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2d80114d-26de-43cd-aaba-b2e1707fb410 tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:20.941540 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2d80114d-26de-43cd-aaba-b2e1707fb410 tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:20.943997 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2d80114d-26de-43cd-aaba-b2e1707fb410 tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:21.023054 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-2d80114d-26de-43cd-aaba-b2e1707fb410 tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Getting quotas for project 32ab4c57f9f64f629c6b60663855766d. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:05:21.066420 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-2d80114d-26de-43cd-aaba-b2e1707fb410 tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Getting quotas for user dbdd3cee870d4fff8ddc3f215ea5a7cf and project 32ab4c57f9f64f629c6b60663855766d. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:05:21.128587 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-2d80114d-26de-43cd-aaba-b2e1707fb410 tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Going to run 1 instances... {{(pid=128758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:05:21.135594 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-2d80114d-26de-43cd-aaba-b2e1707fb410 tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] [instance: c45b2464-2a80-4ae9-a8f8-04687ff7acf7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:05:21.306510 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-2d80114d-26de-43cd-aaba-b2e1707fb410 tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 2.304738 Sep 14 09:05:21.308667 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1889/3741] 10.222.0.60 () {62 vars in 1188 bytes} [Wed Sep 14 09:05:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 2308 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 14 09:05:21.327942 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1f26a72e-f06d-4005-9cba-131549adfa73 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:05:21.329002 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-1f26a72e-f06d-4005-9cba-131549adfa73 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] [instance: 70b0fcd2-6fc4-4445-96bb-165dccf6c81c] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:05:21.335932 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-4aaa9578-067c-463f-a0e5-6deb17910971 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:21.346447 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-4aaa9578-067c-463f-a0e5-6deb17910971 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1506 microversion: 2.1 time: 0.565718 Sep 14 09:05:21.347063 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1853/3742] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:05:20 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1506 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:05:21.353163 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1f26a72e-f06d-4005-9cba-131549adfa73 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:21.354054 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1f26a72e-f06d-4005-9cba-131549adfa73 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:21.357541 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1f26a72e-f06d-4005-9cba-131549adfa73 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:21.358542 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1f26a72e-f06d-4005-9cba-131549adfa73 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:21.361595 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1f26a72e-f06d-4005-9cba-131549adfa73 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:21.361696 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1f26a72e-f06d-4005-9cba-131549adfa73 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:21.391851 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-17135f65-3b07-4f7e-97df-b674c3c85638 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:21.392846 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-17135f65-3b07-4f7e-97df-b674c3c85638 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] [instance: 6888685e-f6c3-4fbb-898a-f3a35bc1af6d] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:05:21.405182 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-17135f65-3b07-4f7e-97df-b674c3c85638 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:21.405827 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-17135f65-3b07-4f7e-97df-b674c3c85638 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:21.407641 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-17135f65-3b07-4f7e-97df-b674c3c85638 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:21.409375 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-17135f65-3b07-4f7e-97df-b674c3c85638 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:21.411019 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-17135f65-3b07-4f7e-97df-b674c3c85638 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:21.411707 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-17135f65-3b07-4f7e-97df-b674c3c85638 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:21.470494 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-17135f65-3b07-4f7e-97df-b674c3c85638 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:21.471312 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-17135f65-3b07-4f7e-97df-b674c3c85638 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:21.472117 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-17135f65-3b07-4f7e-97df-b674c3c85638 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:21.476898 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.objects.instance [None req-17135f65-3b07-4f7e-97df-b674c3c85638 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lazy-loading 'fault' on Instance uuid 6888685e-f6c3-4fbb-898a-f3a35bc1af6d {{(pid=128759) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:05:21.636239 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-17135f65-3b07-4f7e-97df-b674c3c85638 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504ea33de5724b518bcdf28076d6361e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd19911fb94d47ab92893a3ec449fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:21.651571 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-17135f65-3b07-4f7e-97df-b674c3c85638 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] 10.222.0.60 "GET /compute/v2.1/servers/6888685e-f6c3-4fbb-898a-f3a35bc1af6d" status: 200 len: 1308 microversion: 2.1 time: 0.270677 Sep 14 09:05:21.662671 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-1f26a72e-f06d-4005-9cba-131549adfa73 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "POST /compute/v2.1/servers/70b0fcd2-6fc4-4445-96bb-165dccf6c81c/action" status: 202 len: 0 microversion: 2.1 time: 0.352501 Sep 14 09:05:21.664235 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1890/3743] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:05:21 2022] POST /compute/v2.1/servers/70b0fcd2-6fc4-4445-96bb-165dccf6c81c/action => generated 0 bytes in 355 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:05:21.666476 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1854/3744] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:05:21 2022] GET /compute/v2.1/servers/6888685e-f6c3-4fbb-898a-f3a35bc1af6d => generated 1308 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:05:21.697995 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-c0f4918a-26c6-4099-a3be-b9d6e8507550 req-9ac91b87-1cc8-4c0c-a4b3-ff6cfb5adba8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c78e1261-6476-4835-882e-3e59b1d1083e", "name": "network-vif-deleted", "tag": "7debce22-c5b6-4069-99bd-15bf692616ab"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:05:21.712398 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-82169c47-e08a-4d4b-9bc1-d6123eb3c1ab tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:21.714265 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-82169c47-e08a-4d4b-9bc1-d6123eb3c1ab tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] [instance: c45b2464-2a80-4ae9-a8f8-04687ff7acf7] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:05:21.751689 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-c0f4918a-26c6-4099-a3be-b9d6e8507550 req-9ac91b87-1cc8-4c0c-a4b3-ff6cfb5adba8 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:21.770646 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-c0f4918a-26c6-4099-a3be-b9d6e8507550 req-9ac91b87-1cc8-4c0c-a4b3-ff6cfb5adba8 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:21.771200 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-c0f4918a-26c6-4099-a3be-b9d6e8507550 req-9ac91b87-1cc8-4c0c-a4b3-ff6cfb5adba8 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:21.811938 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-c0f4918a-26c6-4099-a3be-b9d6e8507550 req-9ac91b87-1cc8-4c0c-a4b3-ff6cfb5adba8 service nova] Creating event network-vif-deleted:7debce22-c5b6-4069-99bd-15bf692616ab for instance c78e1261-6476-4835-882e-3e59b1d1083e on n-h1-836830-18 Sep 14 09:05:21.818195 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-c0f4918a-26c6-4099-a3be-b9d6e8507550 req-9ac91b87-1cc8-4c0c-a4b3-ff6cfb5adba8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151458 Sep 14 09:05:21.819151 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1891/3745] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:05:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:05:21.825502 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-fa6f27ea-4ccb-4f28-8c96-b7f6b421e75d tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:21.826697 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-fa6f27ea-4ccb-4f28-8c96-b7f6b421e75d tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] [instance: 70b0fcd2-6fc4-4445-96bb-165dccf6c81c] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:05:21.835498 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fa6f27ea-4ccb-4f28-8c96-b7f6b421e75d tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:21.836744 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fa6f27ea-4ccb-4f28-8c96-b7f6b421e75d tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:21.837387 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fa6f27ea-4ccb-4f28-8c96-b7f6b421e75d tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:21.838283 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fa6f27ea-4ccb-4f28-8c96-b7f6b421e75d tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:21.838925 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fa6f27ea-4ccb-4f28-8c96-b7f6b421e75d tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:21.839566 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fa6f27ea-4ccb-4f28-8c96-b7f6b421e75d tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:21.880808 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-82169c47-e08a-4d4b-9bc1-d6123eb3c1ab tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbdd3cee870d4fff8ddc3f215ea5a7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ab4c57f9f64f629c6b60663855766d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:21.892244 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-82169c47-e08a-4d4b-9bc1-d6123eb3c1ab tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbdd3cee870d4fff8ddc3f215ea5a7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ab4c57f9f64f629c6b60663855766d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:21.896360 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-82169c47-e08a-4d4b-9bc1-d6123eb3c1ab tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbdd3cee870d4fff8ddc3f215ea5a7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ab4c57f9f64f629c6b60663855766d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:21.903104 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-82169c47-e08a-4d4b-9bc1-d6123eb3c1ab tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] 10.222.0.60 "GET /compute/v2.1/servers/c45b2464-2a80-4ae9-a8f8-04687ff7acf7" status: 200 len: 1259 microversion: 2.21 time: 0.227273 Sep 14 09:05:21.914966 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1855/3746] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:05:21 2022] GET /compute/v2.1/servers/c45b2464-2a80-4ae9-a8f8-04687ff7acf7 => generated 1259 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:05:21.928717 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-edb53b1a-3e2e-43a4-8b07-128f15b29dd2 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-552110879", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "networks": [{"uuid": "2616a0b0-fea1-46f8-bf23-608a226da1ef"}]}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:05:22.045266 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.network.neutron [None req-edb53b1a-3e2e-43a4-8b07-128f15b29dd2 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] validate_networks() for [('2616a0b0-fea1-46f8-bf23-608a226da1ef', None, None, None, None, None)] {{(pid=128759) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:05:22.296346 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-fa6f27ea-4ccb-4f28-8c96-b7f6b421e75d tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5165b8fc101c47c7a4370f9007bc5a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a597fc389b4805bbd3a53ecd17c5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:22.316402 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-fa6f27ea-4ccb-4f28-8c96-b7f6b421e75d tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute/v2.1/servers/70b0fcd2-6fc4-4445-96bb-165dccf6c81c" status: 200 len: 1493 microversion: 2.1 time: 0.495177 Sep 14 09:05:22.316848 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1892/3747] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:05:21 2022] GET /compute/v2.1/servers/70b0fcd2-6fc4-4445-96bb-165dccf6c81c => generated 1493 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:05:22.322518 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-9b58f958-e666-4c71-b49b-40a11b20b4a1 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:22.323513 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-9b58f958-e666-4c71-b49b-40a11b20b4a1 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] [instance: 05cc41b4-ace4-4d14-90ed-ad19af43e268] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:05:22.337430 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9b58f958-e666-4c71-b49b-40a11b20b4a1 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:22.337935 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9b58f958-e666-4c71-b49b-40a11b20b4a1 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:22.338602 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9b58f958-e666-4c71-b49b-40a11b20b4a1 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:22.340235 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9b58f958-e666-4c71-b49b-40a11b20b4a1 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:22.340884 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9b58f958-e666-4c71-b49b-40a11b20b4a1 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:22.344600 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9b58f958-e666-4c71-b49b-40a11b20b4a1 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:23.442656 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-9b58f958-e666-4c71-b49b-40a11b20b4a1 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02330887b6814bea8312e01103b0d2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a358bdeb8c10424a8b70cc7b6c94e726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:23.481701 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-9b58f958-e666-4c71-b49b-40a11b20b4a1 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] 10.222.0.60 "GET /compute/v2.1/servers/05cc41b4-ace4-4d14-90ed-ad19af43e268" status: 200 len: 1322 microversion: 2.1 time: 1.162317 Sep 14 09:05:23.484126 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1893/3748] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:05:22 2022] GET /compute/v2.1/servers/05cc41b4-ace4-4d14-90ed-ad19af43e268 => generated 1322 bytes in 1167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:05:23.505348 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-0dbe2db5-5686-4370-9d35-b519f342bde6 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:23.509905 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-0dbe2db5-5686-4370-9d35-b519f342bde6 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] [instance: 6888685e-f6c3-4fbb-898a-f3a35bc1af6d] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:05:23.535564 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0dbe2db5-5686-4370-9d35-b519f342bde6 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:23.544819 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0dbe2db5-5686-4370-9d35-b519f342bde6 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:23.545517 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0dbe2db5-5686-4370-9d35-b519f342bde6 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:23.551815 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0dbe2db5-5686-4370-9d35-b519f342bde6 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:23.556822 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0dbe2db5-5686-4370-9d35-b519f342bde6 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:23.557612 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0dbe2db5-5686-4370-9d35-b519f342bde6 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:23.618011 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-0dbe2db5-5686-4370-9d35-b519f342bde6 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] HTTP exception thrown: Instance 6888685e-f6c3-4fbb-898a-f3a35bc1af6d could not be found. Sep 14 09:05:23.620784 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-0dbe2db5-5686-4370-9d35-b519f342bde6 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Request method failure captured: Sep 14 09:05:23.620784 n-d-836830-18 devstack@n-api.service[128758]: request: GET /compute/v2.1/servers/6888685e-f6c3-4fbb-898a-f3a35bc1af6d HTTP/1.1 Sep 14 09:05:23.620784 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 09:05:23.620784 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 09:05:23.620784 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 09:05:23.620784 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 09:05:23.620784 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 09:05:23.620784 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 09:05:23.620784 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 09:05:23.620784 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 09:05:23.620784 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZj8k12U4DG12RxBcJVQ8HRaPm2_pJjfyPZwe1N4dX8LJGi_v4sSU3P3HOycPkNICHi_sEVWu-VjkyDOMcnpyPXpqIaTIucWF3GATtJ5HUp2jk75nBF93UAuKYb0Fko822AqPLaY7VxaAhJSIcPS5PtLcoMv8yaMgnBcAsxYGcCwqzU Sep 14 09:05:23.620784 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 09:05:23.620784 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 09:05:23.620784 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 09:05:23.620784 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 09:05:23.620784 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 09:05:23.620784 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 09:05:23.620784 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: bd19911fb94d47ab92893a3ec449fbbe Sep 14 09:05:23.620784 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-MultipleCreateTestJSON-1696071205 Sep 14 09:05:23.620784 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 09:05:23.620784 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 09:05:23.620784 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/bd19911fb94d47ab92893a3ec449fbbe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_bd19911fb94d47ab92893a3ec449fbbe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/bd19911fb94d47ab92893a3ec449fbbe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/bd19911fb94d47ab92893a3ec449fbbe"}]}] Sep 14 09:05:23.620784 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-MultipleCreateTestJSON-1696071205 Sep 14 09:05:23.620784 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: bd19911fb94d47ab92893a3ec449fbbe Sep 14 09:05:23.620784 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1696071205 Sep 14 09:05:23.620784 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-MultipleCreateTestJSON-1696071205-project Sep 14 09:05:23.620784 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 09:05:23.620784 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 09:05:23.620784 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 504ea33de5724b518bcdf28076d6361e Sep 14 09:05:23.620784 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-MultipleCreateTestJSON-1696071205-project Sep 14 09:05:23.620784 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 09:05:23.620784 n-d-836830-18 devstack@n-api.service[128758]: exception: Instance 6888685e-f6c3-4fbb-898a-f3a35bc1af6d could not be found. Sep 14 09:05:23.620784 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': '6888685e-f6c3-4fbb-898a-f3a35bc1af6d'} Sep 14 09:05:23.620784 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:05:23.620784 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:05:23.620784 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:05:23.620784 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:05:23.620784 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:05:23.620784 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:05:23.620784 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:05:23.620784 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:05:23.620784 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:05:23.620784 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:05:23.620784 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6888685e-f6c3-4fbb-898a-f3a35bc1af6d could not be found. Sep 14 09:05:23.620784 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:05:23.620784 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:05:23.620784 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:05:23.620784 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:05:23.620784 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:05:23.620784 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:05:23.620784 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:05:23.620784 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:05:23.620784 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:05:23.620784 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:05:23.620784 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:05:23.620784 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:05:23.620784 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:05:23.620784 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:05:23.620784 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:05:23.620784 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:05:23.620784 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6888685e-f6c3-4fbb-898a-f3a35bc1af6d could not be found. Sep 14 09:05:23.620784 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:05:23.620784 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:05:23.620784 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:05:23.627514 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:05:23.627514 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:05:23.627514 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:05:23.627514 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:05:23.627514 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:05:23.627514 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6888685e-f6c3-4fbb-898a-f3a35bc1af6d could not be found. Sep 14 09:05:23.627514 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:05:23.633166 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-0dbe2db5-5686-4370-9d35-b519f342bde6 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Returning 404 to user: Instance 6888685e-f6c3-4fbb-898a-f3a35bc1af6d could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:05:23.634078 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-0dbe2db5-5686-4370-9d35-b519f342bde6 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] 10.222.0.60 "GET /compute/v2.1/servers/6888685e-f6c3-4fbb-898a-f3a35bc1af6d" status: 404 len: 111 microversion: 2.1 time: 0.145622 Sep 14 09:05:23.638459 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1894/3749] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:05:23 2022] GET /compute/v2.1/servers/6888685e-f6c3-4fbb-898a-f3a35bc1af6d => generated 111 bytes in 154 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:05:23.652842 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-48030ef6-8b06-463b-b960-9c7122edc492 tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:23.654083 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-48030ef6-8b06-463b-b960-9c7122edc492 tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] [instance: c45b2464-2a80-4ae9-a8f8-04687ff7acf7] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:05:23.674296 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-48030ef6-8b06-463b-b960-9c7122edc492 tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:23.681647 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-48030ef6-8b06-463b-b960-9c7122edc492 tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:23.683087 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-48030ef6-8b06-463b-b960-9c7122edc492 tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:23.684623 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-48030ef6-8b06-463b-b960-9c7122edc492 tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:23.687102 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-48030ef6-8b06-463b-b960-9c7122edc492 tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:23.687872 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-48030ef6-8b06-463b-b960-9c7122edc492 tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:23.900197 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-48030ef6-8b06-463b-b960-9c7122edc492 tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbdd3cee870d4fff8ddc3f215ea5a7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ab4c57f9f64f629c6b60663855766d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:23.909932 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-48030ef6-8b06-463b-b960-9c7122edc492 tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbdd3cee870d4fff8ddc3f215ea5a7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ab4c57f9f64f629c6b60663855766d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:23.916740 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-48030ef6-8b06-463b-b960-9c7122edc492 tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbdd3cee870d4fff8ddc3f215ea5a7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ab4c57f9f64f629c6b60663855766d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:23.919773 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-48030ef6-8b06-463b-b960-9c7122edc492 tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] 10.222.0.60 "GET /compute/v2.1/servers/c45b2464-2a80-4ae9-a8f8-04687ff7acf7" status: 200 len: 1311 microversion: 2.21 time: 0.279531 Sep 14 09:05:23.923484 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1895/3750] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:05:23 2022] GET /compute/v2.1/servers/c45b2464-2a80-4ae9-a8f8-04687ff7acf7 => generated 1311 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:05:23.941185 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-3c77abe9-e8bb-47e8-998f-36106bdba88a tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:23.942269 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-3c77abe9-e8bb-47e8-998f-36106bdba88a tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] [instance: 70b0fcd2-6fc4-4445-96bb-165dccf6c81c] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:05:23.955958 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3c77abe9-e8bb-47e8-998f-36106bdba88a tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:23.960077 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3c77abe9-e8bb-47e8-998f-36106bdba88a tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:23.960790 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3c77abe9-e8bb-47e8-998f-36106bdba88a tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:23.962337 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3c77abe9-e8bb-47e8-998f-36106bdba88a tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:23.963239 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3c77abe9-e8bb-47e8-998f-36106bdba88a tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:23.973685 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3c77abe9-e8bb-47e8-998f-36106bdba88a tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:24.149003 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-edb53b1a-3e2e-43a4-8b07-128f15b29dd2 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Flavor limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:05:24.149567 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-edb53b1a-3e2e-43a4-8b07-128f15b29dd2 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Image limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:05:24.149903 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-edb53b1a-3e2e-43a4-8b07-128f15b29dd2 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Flavor pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:05:24.150314 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-edb53b1a-3e2e-43a4-8b07-128f15b29dd2 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Image pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:05:24.150907 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-edb53b1a-3e2e-43a4-8b07-128f15b29dd2 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:05:24.162742 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-edb53b1a-3e2e-43a4-8b07-128f15b29dd2 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:24.163335 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-edb53b1a-3e2e-43a4-8b07-128f15b29dd2 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:24.163953 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-edb53b1a-3e2e-43a4-8b07-128f15b29dd2 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:24.164907 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-edb53b1a-3e2e-43a4-8b07-128f15b29dd2 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:24.165439 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-edb53b1a-3e2e-43a4-8b07-128f15b29dd2 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:24.166030 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-edb53b1a-3e2e-43a4-8b07-128f15b29dd2 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:24.204659 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-edb53b1a-3e2e-43a4-8b07-128f15b29dd2 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Getting quotas for project 6907b82c9d5c4a23a63bbeec31c3c365. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:05:24.220695 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-edb53b1a-3e2e-43a4-8b07-128f15b29dd2 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Getting quotas for user 79583c4e80a04f138927f09eb4e170f4 and project 6907b82c9d5c4a23a63bbeec31c3c365. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:05:24.255152 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-edb53b1a-3e2e-43a4-8b07-128f15b29dd2 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Going to run 1 instances... {{(pid=128759) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:05:24.258254 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-edb53b1a-3e2e-43a4-8b07-128f15b29dd2 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: 8e670908-5bb6-49ad-92f3-dad1b4df1b5a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128759) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:05:24.340694 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-edb53b1a-3e2e-43a4-8b07-128f15b29dd2 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.435323 Sep 14 09:05:24.341344 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1856/3751] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 09:05:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 2437 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:05:24.353064 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-2c0ff466-3340-4170-8ae5-d20f34f57203 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:24.353692 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-2c0ff466-3340-4170-8ae5-d20f34f57203 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] [instance: c78e1261-6476-4835-882e-3e59b1d1083e] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:05:24.361120 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2c0ff466-3340-4170-8ae5-d20f34f57203 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:24.361725 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2c0ff466-3340-4170-8ae5-d20f34f57203 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:24.362116 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2c0ff466-3340-4170-8ae5-d20f34f57203 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:24.362828 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2c0ff466-3340-4170-8ae5-d20f34f57203 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:24.363728 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2c0ff466-3340-4170-8ae5-d20f34f57203 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:24.364423 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2c0ff466-3340-4170-8ae5-d20f34f57203 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:24.385416 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-2c0ff466-3340-4170-8ae5-d20f34f57203 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] HTTP exception thrown: Instance c78e1261-6476-4835-882e-3e59b1d1083e could not be found. Sep 14 09:05:24.387393 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-2c0ff466-3340-4170-8ae5-d20f34f57203 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Request method failure captured: Sep 14 09:05:24.387393 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/c78e1261-6476-4835-882e-3e59b1d1083e HTTP/1.1 Sep 14 09:05:24.387393 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:05:24.387393 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:05:24.387393 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:05:24.387393 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:05:24.387393 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:05:24.387393 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:05:24.387393 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:05:24.387393 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:05:24.387393 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZj8k12U4DG12RxBcJVQ8HRaPm2_pJjfyPZwe1N4dX8LJGi_v4sSU3P3HOycPkNICHi_sEVWu-VjkyDOMcnpyPXpqIaTIucWF3GATtJ5HUp2jk75nBF93UAuKYb0Fko822AqPLaY7VxaAhJSIcPS5PtLcoMv8yaMgnBcAsxYGcCwqzU Sep 14 09:05:24.387393 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:05:24.387393 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:05:24.387393 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:05:24.387393 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:05:24.387393 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:05:24.387393 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:05:24.387393 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: bd19911fb94d47ab92893a3ec449fbbe Sep 14 09:05:24.387393 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-MultipleCreateTestJSON-1696071205 Sep 14 09:05:24.387393 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:05:24.387393 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:05:24.387393 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/bd19911fb94d47ab92893a3ec449fbbe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_bd19911fb94d47ab92893a3ec449fbbe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/bd19911fb94d47ab92893a3ec449fbbe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/bd19911fb94d47ab92893a3ec449fbbe"}]}] Sep 14 09:05:24.387393 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-MultipleCreateTestJSON-1696071205 Sep 14 09:05:24.387393 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: bd19911fb94d47ab92893a3ec449fbbe Sep 14 09:05:24.387393 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1696071205 Sep 14 09:05:24.387393 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-MultipleCreateTestJSON-1696071205-project Sep 14 09:05:24.387393 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:05:24.387393 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:05:24.387393 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 504ea33de5724b518bcdf28076d6361e Sep 14 09:05:24.387393 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-MultipleCreateTestJSON-1696071205-project Sep 14 09:05:24.387393 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:05:24.387393 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance c78e1261-6476-4835-882e-3e59b1d1083e could not be found. Sep 14 09:05:24.387393 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': 'c78e1261-6476-4835-882e-3e59b1d1083e'} Sep 14 09:05:24.387393 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:05:24.387393 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:05:24.387393 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:05:24.387393 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:05:24.387393 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:05:24.387393 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:05:24.387393 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:05:24.387393 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:05:24.387393 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:05:24.387393 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:05:24.387393 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c78e1261-6476-4835-882e-3e59b1d1083e could not be found. Sep 14 09:05:24.387393 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:05:24.387393 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:05:24.387393 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:05:24.387393 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:05:24.387393 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:05:24.387393 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:05:24.387393 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:05:24.387393 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:05:24.387393 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:05:24.387393 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:05:24.387393 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:05:24.387393 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:05:24.387393 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:05:24.387393 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:05:24.387393 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:05:24.387393 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:05:24.387393 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c78e1261-6476-4835-882e-3e59b1d1083e could not be found. Sep 14 09:05:24.387393 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:05:24.387393 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:05:24.387393 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:05:24.394806 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:05:24.394806 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:05:24.394806 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:05:24.394806 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:05:24.394806 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:05:24.394806 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c78e1261-6476-4835-882e-3e59b1d1083e could not be found. Sep 14 09:05:24.394806 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:05:24.394806 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-2c0ff466-3340-4170-8ae5-d20f34f57203 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] Returning 404 to user: Instance c78e1261-6476-4835-882e-3e59b1d1083e could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:05:24.394806 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-2c0ff466-3340-4170-8ae5-d20f34f57203 tempest-MultipleCreateTestJSON-1696071205 tempest-MultipleCreateTestJSON-1696071205-project] 10.222.0.60 "GET /compute/v2.1/servers/c78e1261-6476-4835-882e-3e59b1d1083e" status: 404 len: 111 microversion: 2.1 time: 0.042695 Sep 14 09:05:24.394806 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1857/3752] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:05:24 2022] GET /compute/v2.1/servers/c78e1261-6476-4835-882e-3e59b1d1083e => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:05:24.399475 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-510efbaf-f397-43b1-b5ec-fef98cfabddc req-eac04758-a2ad-40cf-b3fc-75fd5826ea4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "136e2cad-31c9-4c0a-93ae-b6de98a41f8b", "name": "network-vif-plugged", "status": "completed", "tag": "22809180-f268-43df-8a33-bcce72f1b6ab"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:05:24.410728 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-510efbaf-f397-43b1-b5ec-fef98cfabddc req-eac04758-a2ad-40cf-b3fc-75fd5826ea4f service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:24.411647 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-510efbaf-f397-43b1-b5ec-fef98cfabddc req-eac04758-a2ad-40cf-b3fc-75fd5826ea4f service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:24.412327 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-510efbaf-f397-43b1-b5ec-fef98cfabddc req-eac04758-a2ad-40cf-b3fc-75fd5826ea4f service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:24.441552 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-510efbaf-f397-43b1-b5ec-fef98cfabddc req-eac04758-a2ad-40cf-b3fc-75fd5826ea4f service nova] Creating event network-vif-plugged:22809180-f268-43df-8a33-bcce72f1b6ab for instance 136e2cad-31c9-4c0a-93ae-b6de98a41f8b on n-h2-836830-18 Sep 14 09:05:24.449395 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-510efbaf-f397-43b1-b5ec-fef98cfabddc req-eac04758-a2ad-40cf-b3fc-75fd5826ea4f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054216 Sep 14 09:05:24.450082 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1858/3753] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:05:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:05:24.458917 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-46cd2c8c-0de9-4a5a-aa94-463377eecb03 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:24.459711 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-46cd2c8c-0de9-4a5a-aa94-463377eecb03 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: 8e670908-5bb6-49ad-92f3-dad1b4df1b5a] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:05:24.699660 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-46cd2c8c-0de9-4a5a-aa94-463377eecb03 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:24.712539 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-46cd2c8c-0de9-4a5a-aa94-463377eecb03 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/8e670908-5bb6-49ad-92f3-dad1b4df1b5a" status: 200 len: 1216 microversion: 2.1 time: 0.261052 Sep 14 09:05:24.727919 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1859/3754] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:05:24 2022] GET /compute/v2.1/servers/8e670908-5bb6-49ad-92f3-dad1b4df1b5a => generated 1216 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:05:24.747541 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-3c77abe9-e8bb-47e8-998f-36106bdba88a tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5165b8fc101c47c7a4370f9007bc5a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a597fc389b4805bbd3a53ecd17c5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:24.757428 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b9d0c5d5-0cf8-438b-9c2a-dd288358f819 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:24.760354 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b9d0c5d5-0cf8-438b-9c2a-dd288358f819 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] [instance: 05cc41b4-ace4-4d14-90ed-ad19af43e268] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:05:24.762592 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-3c77abe9-e8bb-47e8-998f-36106bdba88a tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute/v2.1/servers/70b0fcd2-6fc4-4445-96bb-165dccf6c81c" status: 200 len: 1473 microversion: 2.1 time: 0.837671 Sep 14 09:05:24.763255 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1896/3755] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:05:23 2022] GET /compute/v2.1/servers/70b0fcd2-6fc4-4445-96bb-165dccf6c81c => generated 1473 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:05:24.785374 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b9d0c5d5-0cf8-438b-9c2a-dd288358f819 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:24.785861 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b9d0c5d5-0cf8-438b-9c2a-dd288358f819 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:24.786574 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b9d0c5d5-0cf8-438b-9c2a-dd288358f819 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:24.787700 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b9d0c5d5-0cf8-438b-9c2a-dd288358f819 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:24.796648 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-8d5aa8e6-9a46-4bed-8d32-33632b0e9d53 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1420566791"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:05:24.799520 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-8d5aa8e6-9a46-4bed-8d32-33632b0e9d53 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] [instance: 70b0fcd2-6fc4-4445-96bb-165dccf6c81c] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:05:24.801584 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b9d0c5d5-0cf8-438b-9c2a-dd288358f819 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:24.802303 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b9d0c5d5-0cf8-438b-9c2a-dd288358f819 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:24.826494 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8d5aa8e6-9a46-4bed-8d32-33632b0e9d53 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:24.827050 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8d5aa8e6-9a46-4bed-8d32-33632b0e9d53 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:24.827502 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8d5aa8e6-9a46-4bed-8d32-33632b0e9d53 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:24.828242 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8d5aa8e6-9a46-4bed-8d32-33632b0e9d53 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:24.830991 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8d5aa8e6-9a46-4bed-8d32-33632b0e9d53 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:24.831450 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8d5aa8e6-9a46-4bed-8d32-33632b0e9d53 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:25.281517 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-8d5aa8e6-9a46-4bed-8d32-33632b0e9d53 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "POST /compute/v2.1/servers/70b0fcd2-6fc4-4445-96bb-165dccf6c81c/action" status: 202 len: 0 microversion: 2.1 time: 0.488968 Sep 14 09:05:25.282616 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1897/3756] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:05:24 2022] POST /compute/v2.1/servers/70b0fcd2-6fc4-4445-96bb-165dccf6c81c/action => generated 0 bytes in 493 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Sep 14 09:05:25.293967 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-dafef4b5-382e-4be4-b523-392e27eaa74e tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:25.295282 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-dafef4b5-382e-4be4-b523-392e27eaa74e tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] [instance: c45b2464-2a80-4ae9-a8f8-04687ff7acf7] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:05:25.328062 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dafef4b5-382e-4be4-b523-392e27eaa74e tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:25.329470 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dafef4b5-382e-4be4-b523-392e27eaa74e tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:25.332772 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dafef4b5-382e-4be4-b523-392e27eaa74e tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:25.334014 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dafef4b5-382e-4be4-b523-392e27eaa74e tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:25.335715 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dafef4b5-382e-4be4-b523-392e27eaa74e tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:25.337067 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dafef4b5-382e-4be4-b523-392e27eaa74e tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:25.484226 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b9d0c5d5-0cf8-438b-9c2a-dd288358f819 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02330887b6814bea8312e01103b0d2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a358bdeb8c10424a8b70cc7b6c94e726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:25.500185 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b9d0c5d5-0cf8-438b-9c2a-dd288358f819 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] 10.222.0.60 "GET /compute/v2.1/servers/05cc41b4-ace4-4d14-90ed-ad19af43e268" status: 200 len: 1322 microversion: 2.1 time: 0.764574 Sep 14 09:05:25.517480 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1860/3757] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:05:24 2022] GET /compute/v2.1/servers/05cc41b4-ace4-4d14-90ed-ad19af43e268 => generated 1322 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:05:25.525176 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-926ee8c4-fe08-4a70-b889-e8dfe34d6fc9 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '.version_select at 0x7f7d3ff5aa60>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:25.601909 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-926ee8c4-fe08-4a70-b889-e8dfe34d6fc9 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute/v2.1/images/a62c47ed-e003-4adc-bdf0-222dc0068fa9" status: 200 len: 1414 microversion: 2.1 time: 0.082933 Sep 14 09:05:25.610793 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1861/3758] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:05:25 2022] GET /compute/v2.1/images/a62c47ed-e003-4adc-bdf0-222dc0068fa9 => generated 1414 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:05:25.642649 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-dafef4b5-382e-4be4-b523-392e27eaa74e tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbdd3cee870d4fff8ddc3f215ea5a7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ab4c57f9f64f629c6b60663855766d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:25.656106 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-dafef4b5-382e-4be4-b523-392e27eaa74e tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbdd3cee870d4fff8ddc3f215ea5a7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ab4c57f9f64f629c6b60663855766d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:25.657595 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-dafef4b5-382e-4be4-b523-392e27eaa74e tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbdd3cee870d4fff8ddc3f215ea5a7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ab4c57f9f64f629c6b60663855766d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:25.658751 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-dafef4b5-382e-4be4-b523-392e27eaa74e tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] 10.222.0.60 "GET /compute/v2.1/servers/c45b2464-2a80-4ae9-a8f8-04687ff7acf7" status: 200 len: 1317 microversion: 2.21 time: 0.373888 Sep 14 09:05:25.667837 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1898/3759] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:05:25 2022] GET /compute/v2.1/servers/c45b2464-2a80-4ae9-a8f8-04687ff7acf7 => generated 1317 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:05:25.741730 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-86a3d635-5bbe-4ae7-bf50-77ca94993a87 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:25.743440 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-86a3d635-5bbe-4ae7-bf50-77ca94993a87 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: 8e670908-5bb6-49ad-92f3-dad1b4df1b5a] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:05:25.761122 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-86a3d635-5bbe-4ae7-bf50-77ca94993a87 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:25.761641 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-86a3d635-5bbe-4ae7-bf50-77ca94993a87 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:25.762084 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-86a3d635-5bbe-4ae7-bf50-77ca94993a87 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:25.764283 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-86a3d635-5bbe-4ae7-bf50-77ca94993a87 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:25.767970 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-86a3d635-5bbe-4ae7-bf50-77ca94993a87 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:25.771218 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-86a3d635-5bbe-4ae7-bf50-77ca94993a87 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:25.939302 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-86a3d635-5bbe-4ae7-bf50-77ca94993a87 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:25.951614 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-86a3d635-5bbe-4ae7-bf50-77ca94993a87 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/8e670908-5bb6-49ad-92f3-dad1b4df1b5a" status: 200 len: 1212 microversion: 2.1 time: 0.214174 Sep 14 09:05:25.953080 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1862/3760] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:05:25 2022] GET /compute/v2.1/servers/8e670908-5bb6-49ad-92f3-dad1b4df1b5a => generated 1212 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:05:26.501178 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-f06bed2b-8484-4ae6-8f52-61656caf0632 req-0968aad5-7991-44e9-b5be-2ede45bb5ab7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1435eb10-e290-4e5c-9e16-4bbcc2cba6db", "name": "network-vif-plugged", "status": "completed", "tag": "330d89cb-bba9-4c9b-aa73-5b27d08980b0"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:05:26.527875 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ea34c6ac-3648-4c19-a827-6614163c8cf5 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:26.529182 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-ea34c6ac-3648-4c19-a827-6614163c8cf5 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] [instance: 05cc41b4-ace4-4d14-90ed-ad19af43e268] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:05:26.529895 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-f06bed2b-8484-4ae6-8f52-61656caf0632 req-0968aad5-7991-44e9-b5be-2ede45bb5ab7 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:26.530496 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-f06bed2b-8484-4ae6-8f52-61656caf0632 req-0968aad5-7991-44e9-b5be-2ede45bb5ab7 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:26.531073 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-f06bed2b-8484-4ae6-8f52-61656caf0632 req-0968aad5-7991-44e9-b5be-2ede45bb5ab7 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:26.547137 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ea34c6ac-3648-4c19-a827-6614163c8cf5 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:26.548682 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ea34c6ac-3648-4c19-a827-6614163c8cf5 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:26.549345 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ea34c6ac-3648-4c19-a827-6614163c8cf5 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:26.550423 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ea34c6ac-3648-4c19-a827-6614163c8cf5 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:26.551726 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ea34c6ac-3648-4c19-a827-6614163c8cf5 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:26.557579 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-f06bed2b-8484-4ae6-8f52-61656caf0632 req-0968aad5-7991-44e9-b5be-2ede45bb5ab7 service nova] Creating event network-vif-plugged:330d89cb-bba9-4c9b-aa73-5b27d08980b0 for instance 1435eb10-e290-4e5c-9e16-4bbcc2cba6db on n-h1-836830-18 Sep 14 09:05:26.562881 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ea34c6ac-3648-4c19-a827-6614163c8cf5 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:26.566599 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-f06bed2b-8484-4ae6-8f52-61656caf0632 req-0968aad5-7991-44e9-b5be-2ede45bb5ab7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068988 Sep 14 09:05:26.579091 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1899/3761] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:05:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:05:26.620770 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-45e95f77-06a8-437c-9b7f-e62f4a82f2b5 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '.version_select at 0x7f7d48611ca0>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:26.715419 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-45e95f77-06a8-437c-9b7f-e62f4a82f2b5 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute/v2.1/images/a62c47ed-e003-4adc-bdf0-222dc0068fa9" status: 200 len: 1414 microversion: 2.1 time: 0.100647 Sep 14 09:05:26.716195 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1900/3762] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:05:26 2022] GET /compute/v2.1/images/a62c47ed-e003-4adc-bdf0-222dc0068fa9 => generated 1414 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:05:26.730439 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-bfd0ab6b-6a51-4dad-a65c-1a36f066ad8d tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:26.731474 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-bfd0ab6b-6a51-4dad-a65c-1a36f066ad8d tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] [instance: c45b2464-2a80-4ae9-a8f8-04687ff7acf7] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:05:26.739473 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bfd0ab6b-6a51-4dad-a65c-1a36f066ad8d tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:26.744704 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bfd0ab6b-6a51-4dad-a65c-1a36f066ad8d tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:26.746551 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bfd0ab6b-6a51-4dad-a65c-1a36f066ad8d tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:26.747737 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bfd0ab6b-6a51-4dad-a65c-1a36f066ad8d tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:26.748475 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bfd0ab6b-6a51-4dad-a65c-1a36f066ad8d tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:26.749162 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bfd0ab6b-6a51-4dad-a65c-1a36f066ad8d tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:27.266377 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-ea34c6ac-3648-4c19-a827-6614163c8cf5 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02330887b6814bea8312e01103b0d2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a358bdeb8c10424a8b70cc7b6c94e726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:27.278402 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-ea34c6ac-3648-4c19-a827-6614163c8cf5 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] 10.222.0.60 "GET /compute/v2.1/servers/05cc41b4-ace4-4d14-90ed-ad19af43e268" status: 200 len: 1322 microversion: 2.1 time: 0.757841 Sep 14 09:05:27.279445 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1863/3763] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:05:26 2022] GET /compute/v2.1/servers/05cc41b4-ace4-4d14-90ed-ad19af43e268 => generated 1322 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:05:27.303631 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-5d0531c3-690c-4b5e-9d08-3524e01604ef tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:27.305396 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-5d0531c3-690c-4b5e-9d08-3524e01604ef tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: 8e670908-5bb6-49ad-92f3-dad1b4df1b5a] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:05:27.323626 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5d0531c3-690c-4b5e-9d08-3524e01604ef tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:27.325243 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5d0531c3-690c-4b5e-9d08-3524e01604ef tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:27.328974 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5d0531c3-690c-4b5e-9d08-3524e01604ef tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:27.330006 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5d0531c3-690c-4b5e-9d08-3524e01604ef tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:27.331367 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5d0531c3-690c-4b5e-9d08-3524e01604ef tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:27.333723 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5d0531c3-690c-4b5e-9d08-3524e01604ef tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:27.336179 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-bfd0ab6b-6a51-4dad-a65c-1a36f066ad8d tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbdd3cee870d4fff8ddc3f215ea5a7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ab4c57f9f64f629c6b60663855766d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:27.341119 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:05:27.353271 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-bfd0ab6b-6a51-4dad-a65c-1a36f066ad8d tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbdd3cee870d4fff8ddc3f215ea5a7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ab4c57f9f64f629c6b60663855766d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:27.358894 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-bfd0ab6b-6a51-4dad-a65c-1a36f066ad8d tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbdd3cee870d4fff8ddc3f215ea5a7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ab4c57f9f64f629c6b60663855766d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:27.362574 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-bfd0ab6b-6a51-4dad-a65c-1a36f066ad8d tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] 10.222.0.60 "GET /compute/v2.1/servers/c45b2464-2a80-4ae9-a8f8-04687ff7acf7" status: 200 len: 1359 microversion: 2.21 time: 0.645129 Sep 14 09:05:27.363223 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1901/3764] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:05:26 2022] GET /compute/v2.1/servers/c45b2464-2a80-4ae9-a8f8-04687ff7acf7 => generated 1359 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:05:27.585514 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-5d0531c3-690c-4b5e-9d08-3524e01604ef tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:27.602159 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-5d0531c3-690c-4b5e-9d08-3524e01604ef tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/8e670908-5bb6-49ad-92f3-dad1b4df1b5a" status: 200 len: 1274 microversion: 2.1 time: 0.311826 Sep 14 09:05:27.604963 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1864/3765] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:05:27 2022] GET /compute/v2.1/servers/8e670908-5bb6-49ad-92f3-dad1b4df1b5a => generated 1274 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:05:27.732745 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ede23f95-9990-42e1-8afe-9523032661eb tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '.version_select at 0x7f7d446285e0>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:27.812122 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-ede23f95-9990-42e1-8afe-9523032661eb tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute/v2.1/images/a62c47ed-e003-4adc-bdf0-222dc0068fa9" status: 200 len: 1414 microversion: 2.1 time: 0.081158 Sep 14 09:05:27.813400 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1902/3766] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:05:27 2022] GET /compute/v2.1/images/a62c47ed-e003-4adc-bdf0-222dc0068fa9 => generated 1414 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:05:28.310849 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-374f6963-3d03-4daa-9096-75fee733a176 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:28.311433 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-374f6963-3d03-4daa-9096-75fee733a176 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] [instance: 05cc41b4-ace4-4d14-90ed-ad19af43e268] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:05:28.319243 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-374f6963-3d03-4daa-9096-75fee733a176 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:28.319751 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-374f6963-3d03-4daa-9096-75fee733a176 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:28.320202 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-374f6963-3d03-4daa-9096-75fee733a176 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:28.321476 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-374f6963-3d03-4daa-9096-75fee733a176 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:28.321943 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-374f6963-3d03-4daa-9096-75fee733a176 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:28.322379 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-374f6963-3d03-4daa-9096-75fee733a176 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:28.392756 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a596a2ec-6c79-49bf-8e6d-fb4fc55b021b tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:28.393101 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-a596a2ec-6c79-49bf-8e6d-fb4fc55b021b tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] [instance: c45b2464-2a80-4ae9-a8f8-04687ff7acf7] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:05:28.410748 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a596a2ec-6c79-49bf-8e6d-fb4fc55b021b tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:28.414776 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a596a2ec-6c79-49bf-8e6d-fb4fc55b021b tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:28.415277 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a596a2ec-6c79-49bf-8e6d-fb4fc55b021b tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:28.417202 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a596a2ec-6c79-49bf-8e6d-fb4fc55b021b tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:28.421806 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a596a2ec-6c79-49bf-8e6d-fb4fc55b021b tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:28.424348 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a596a2ec-6c79-49bf-8e6d-fb4fc55b021b tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:29.699907 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-374f6963-3d03-4daa-9096-75fee733a176 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02330887b6814bea8312e01103b0d2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a358bdeb8c10424a8b70cc7b6c94e726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:29.702864 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-a596a2ec-6c79-49bf-8e6d-fb4fc55b021b tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbdd3cee870d4fff8ddc3f215ea5a7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ab4c57f9f64f629c6b60663855766d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:29.717261 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-374f6963-3d03-4daa-9096-75fee733a176 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] 10.222.0.60 "GET /compute/v2.1/servers/05cc41b4-ace4-4d14-90ed-ad19af43e268" status: 200 len: 1322 microversion: 2.1 time: 1.409775 Sep 14 09:05:29.721603 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1865/3767] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:05:28 2022] GET /compute/v2.1/servers/05cc41b4-ace4-4d14-90ed-ad19af43e268 => generated 1322 bytes in 1416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:05:29.735178 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-a596a2ec-6c79-49bf-8e6d-fb4fc55b021b tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbdd3cee870d4fff8ddc3f215ea5a7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ab4c57f9f64f629c6b60663855766d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:29.735178 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-a596a2ec-6c79-49bf-8e6d-fb4fc55b021b tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbdd3cee870d4fff8ddc3f215ea5a7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ab4c57f9f64f629c6b60663855766d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:29.735178 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-a596a2ec-6c79-49bf-8e6d-fb4fc55b021b tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] 10.222.0.60 "GET /compute/v2.1/servers/c45b2464-2a80-4ae9-a8f8-04687ff7acf7" status: 200 len: 1359 microversion: 2.21 time: 1.345128 Sep 14 09:05:29.735178 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1903/3768] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:05:28 2022] GET /compute/v2.1/servers/c45b2464-2a80-4ae9-a8f8-04687ff7acf7 => generated 1359 bytes in 1346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 09:05:29.760139 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-18585e04-4f0f-43b4-97c4-8ef7abb8fd10 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:29.760853 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-18585e04-4f0f-43b4-97c4-8ef7abb8fd10 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: 8e670908-5bb6-49ad-92f3-dad1b4df1b5a] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:05:29.769151 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-419f1882-76ec-412a-83f6-e6ded528a9e0 req-df79875a-8592-4fc0-890f-052f2aaabc46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05cc41b4-ace4-4d14-90ed-ad19af43e268", "name": "network-vif-plugged", "status": "completed", "tag": "95399de6-926b-4e21-b4ae-2cdbd4f773e4"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:05:29.790901 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-18585e04-4f0f-43b4-97c4-8ef7abb8fd10 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:29.793247 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-18585e04-4f0f-43b4-97c4-8ef7abb8fd10 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:29.793764 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-18585e04-4f0f-43b4-97c4-8ef7abb8fd10 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:29.794512 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-18585e04-4f0f-43b4-97c4-8ef7abb8fd10 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:29.795061 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-18585e04-4f0f-43b4-97c4-8ef7abb8fd10 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:29.798006 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-18585e04-4f0f-43b4-97c4-8ef7abb8fd10 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:29.818533 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-419f1882-76ec-412a-83f6-e6ded528a9e0 req-df79875a-8592-4fc0-890f-052f2aaabc46 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:29.819306 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-419f1882-76ec-412a-83f6-e6ded528a9e0 req-df79875a-8592-4fc0-890f-052f2aaabc46 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:29.819909 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-419f1882-76ec-412a-83f6-e6ded528a9e0 req-df79875a-8592-4fc0-890f-052f2aaabc46 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:29.849568 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-419f1882-76ec-412a-83f6-e6ded528a9e0 req-df79875a-8592-4fc0-890f-052f2aaabc46 service nova] Creating event network-vif-plugged:95399de6-926b-4e21-b4ae-2cdbd4f773e4 for instance 05cc41b4-ace4-4d14-90ed-ad19af43e268 on n-h1-836830-18 Sep 14 09:05:29.861086 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-419f1882-76ec-412a-83f6-e6ded528a9e0 req-df79875a-8592-4fc0-890f-052f2aaabc46 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126250 Sep 14 09:05:29.864352 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1904/3769] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:05:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:05:29.880767 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1118574d-a8bc-4777-814d-bc7cb935b910 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '.version_select at 0x7f7d44de9430>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:30.049774 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-1118574d-a8bc-4777-814d-bc7cb935b910 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute/v2.1/images/a62c47ed-e003-4adc-bdf0-222dc0068fa9" status: 200 len: 1414 microversion: 2.1 time: 0.183775 Sep 14 09:05:30.058421 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1905/3770] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:05:29 2022] GET /compute/v2.1/images/a62c47ed-e003-4adc-bdf0-222dc0068fa9 => generated 1414 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:05:30.347030 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-18585e04-4f0f-43b4-97c4-8ef7abb8fd10 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:30.356489 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-18585e04-4f0f-43b4-97c4-8ef7abb8fd10 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/8e670908-5bb6-49ad-92f3-dad1b4df1b5a" status: 200 len: 1316 microversion: 2.1 time: 0.613966 Sep 14 09:05:30.361807 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1866/3771] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:05:29 2022] GET /compute/v2.1/servers/8e670908-5bb6-49ad-92f3-dad1b4df1b5a => generated 1316 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:05:30.749195 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-53460704-b9df-4768-ac9d-55025b1ce10f tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:30.749948 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-53460704-b9df-4768-ac9d-55025b1ce10f tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] [instance: 05cc41b4-ace4-4d14-90ed-ad19af43e268] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:05:30.754711 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-c927afa3-a37c-49e4-9d9d-cb84060224b3 req-d14d6d64-e6b4-4079-8b3c-65c60da46bdf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c45b2464-2a80-4ae9-a8f8-04687ff7acf7", "tag": "5373aeda-0911-463b-ac42-79834c452c1d"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:05:30.766843 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-53460704-b9df-4768-ac9d-55025b1ce10f tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:30.767373 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-53460704-b9df-4768-ac9d-55025b1ce10f tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:30.767812 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-53460704-b9df-4768-ac9d-55025b1ce10f tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:30.768530 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-53460704-b9df-4768-ac9d-55025b1ce10f tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:30.768989 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-53460704-b9df-4768-ac9d-55025b1ce10f tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:30.769418 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-53460704-b9df-4768-ac9d-55025b1ce10f tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:30.785460 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-c927afa3-a37c-49e4-9d9d-cb84060224b3 req-d14d6d64-e6b4-4079-8b3c-65c60da46bdf service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:30.786325 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-c927afa3-a37c-49e4-9d9d-cb84060224b3 req-d14d6d64-e6b4-4079-8b3c-65c60da46bdf service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:30.790035 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-c927afa3-a37c-49e4-9d9d-cb84060224b3 req-d14d6d64-e6b4-4079-8b3c-65c60da46bdf service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:30.821560 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-c927afa3-a37c-49e4-9d9d-cb84060224b3 req-d14d6d64-e6b4-4079-8b3c-65c60da46bdf service nova] Creating event network-changed:5373aeda-0911-463b-ac42-79834c452c1d for instance c45b2464-2a80-4ae9-a8f8-04687ff7acf7 on n-h2-836830-18 Sep 14 09:05:30.834377 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-c927afa3-a37c-49e4-9d9d-cb84060224b3 req-d14d6d64-e6b4-4079-8b3c-65c60da46bdf service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086094 Sep 14 09:05:30.836851 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1867/3772] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:05:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:05:30.856251 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-1aa6a09b-160b-414c-9527-7dcf33a5b8f6 tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:30.857272 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-1aa6a09b-160b-414c-9527-7dcf33a5b8f6 tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] [instance: c45b2464-2a80-4ae9-a8f8-04687ff7acf7] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:05:30.863856 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1aa6a09b-160b-414c-9527-7dcf33a5b8f6 tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:30.864566 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1aa6a09b-160b-414c-9527-7dcf33a5b8f6 tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:30.865314 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1aa6a09b-160b-414c-9527-7dcf33a5b8f6 tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:30.869224 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1aa6a09b-160b-414c-9527-7dcf33a5b8f6 tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:30.869893 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1aa6a09b-160b-414c-9527-7dcf33a5b8f6 tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:30.870512 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1aa6a09b-160b-414c-9527-7dcf33a5b8f6 tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:30.972404 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=2 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:05:31.084845 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=6 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:05:31.468560 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-53460704-b9df-4768-ac9d-55025b1ce10f tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02330887b6814bea8312e01103b0d2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a358bdeb8c10424a8b70cc7b6c94e726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:31.504894 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-53460704-b9df-4768-ac9d-55025b1ce10f tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] 10.222.0.60 "GET /compute/v2.1/servers/05cc41b4-ace4-4d14-90ed-ad19af43e268" status: 200 len: 1322 microversion: 2.1 time: 0.757073 Sep 14 09:05:31.506555 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1906/3773] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:05:30 2022] GET /compute/v2.1/servers/05cc41b4-ace4-4d14-90ed-ad19af43e268 => generated 1322 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:05:31.531472 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-8c49e98e-576a-4d25-a599-2d7ee3735dd6 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '.version_select at 0x7f7d44de9430>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:31.644886 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-8c49e98e-576a-4d25-a599-2d7ee3735dd6 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute/v2.1/images/a62c47ed-e003-4adc-bdf0-222dc0068fa9" status: 200 len: 1414 microversion: 2.1 time: 0.137187 Sep 14 09:05:31.655313 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1907/3774] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:05:31 2022] GET /compute/v2.1/images/a62c47ed-e003-4adc-bdf0-222dc0068fa9 => generated 1414 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:05:31.659213 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-1aa6a09b-160b-414c-9527-7dcf33a5b8f6 tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbdd3cee870d4fff8ddc3f215ea5a7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ab4c57f9f64f629c6b60663855766d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:31.668233 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-9a6e0409-54ce-48d3-92fd-15e6c60ce3a0 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:31.669182 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-9a6e0409-54ce-48d3-92fd-15e6c60ce3a0 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: 8e670908-5bb6-49ad-92f3-dad1b4df1b5a] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:05:31.678516 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-1aa6a09b-160b-414c-9527-7dcf33a5b8f6 tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbdd3cee870d4fff8ddc3f215ea5a7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ab4c57f9f64f629c6b60663855766d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:31.684247 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9a6e0409-54ce-48d3-92fd-15e6c60ce3a0 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:31.685225 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9a6e0409-54ce-48d3-92fd-15e6c60ce3a0 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:31.686176 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-1aa6a09b-160b-414c-9527-7dcf33a5b8f6 tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbdd3cee870d4fff8ddc3f215ea5a7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ab4c57f9f64f629c6b60663855766d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:31.686861 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9a6e0409-54ce-48d3-92fd-15e6c60ce3a0 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:31.688215 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9a6e0409-54ce-48d3-92fd-15e6c60ce3a0 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:31.689440 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-1aa6a09b-160b-414c-9527-7dcf33a5b8f6 tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] 10.222.0.60 "GET /compute/v2.1/servers/c45b2464-2a80-4ae9-a8f8-04687ff7acf7" status: 200 len: 1359 microversion: 2.21 time: 0.851141 Sep 14 09:05:31.690400 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9a6e0409-54ce-48d3-92fd-15e6c60ce3a0 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:31.694080 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9a6e0409-54ce-48d3-92fd-15e6c60ce3a0 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:31.694907 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1868/3775] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:05:30 2022] GET /compute/v2.1/servers/c45b2464-2a80-4ae9-a8f8-04687ff7acf7 => generated 1359 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:05:32.312190 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-7d8a7015-1add-42f6-8573-e09199326247 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Action: 'create', calling method: .version_select at 0x7f7d44582f70>, body: {"keypair": {"name": "tempest-keypair-1803326428", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGZp5QdwuMd3tKtZXQfJCpvzVoWexzWphwq7YE6JJ4cGRhOw4ZsU0iyny9hEhHMo7eXfO327UFpbZJGj+HtmS7nVgd2ge2WVx9DQtXgpCK5VBminLNaKG3XzAU+NJQodow=="}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:05:32.369868 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-7d8a7015-1add-42f6-8573-e09199326247 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Getting quotas for project 2f075a2c6aa4489abb3428e0a4ac5738. Resources: {'key_pairs'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:05:32.401072 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-7d8a7015-1add-42f6-8573-e09199326247 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Getting quotas for user 950da33830ae4ae1a5511dd146e4e3be and project 2f075a2c6aa4489abb3428e0a4ac5738. Resources: {'key_pairs'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:05:32.474434 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-7d8a7015-1add-42f6-8573-e09199326247 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.773232 Sep 14 09:05:32.478128 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1869/3776] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Sep 14 09:05:31 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:05:32.488078 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-e677a2a7-17f6-4af9-9c40-253567baa4ac req-86f4196e-9359-4546-9c97-3d3d3b482d82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70b0fcd2-6fc4-4445-96bb-165dccf6c81c", "name": "network-vif-plugged", "status": "completed", "tag": "03d9d813-028b-4c20-8b8f-dff576919005"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:05:32.532904 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-e677a2a7-17f6-4af9-9c40-253567baa4ac req-86f4196e-9359-4546-9c97-3d3d3b482d82 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:32.533883 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-e677a2a7-17f6-4af9-9c40-253567baa4ac req-86f4196e-9359-4546-9c97-3d3d3b482d82 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:32.534841 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-e677a2a7-17f6-4af9-9c40-253567baa4ac req-86f4196e-9359-4546-9c97-3d3d3b482d82 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:32.579004 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-e677a2a7-17f6-4af9-9c40-253567baa4ac req-86f4196e-9359-4546-9c97-3d3d3b482d82 service nova] Creating event network-vif-plugged:03d9d813-028b-4c20-8b8f-dff576919005 for instance 70b0fcd2-6fc4-4445-96bb-165dccf6c81c on n-h2-836830-18 Sep 14 09:05:32.584551 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-e677a2a7-17f6-4af9-9c40-253567baa4ac req-86f4196e-9359-4546-9c97-3d3d3b482d82 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104910 Sep 14 09:05:32.591987 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1870/3777] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:05:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:05:32.612275 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3e49c199-69d7-47a5-9cba-6ee7fc31bad5 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:32.615235 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-3e49c199-69d7-47a5-9cba-6ee7fc31bad5 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] [instance: 05cc41b4-ace4-4d14-90ed-ad19af43e268] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:05:32.643512 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3e49c199-69d7-47a5-9cba-6ee7fc31bad5 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:32.646858 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3e49c199-69d7-47a5-9cba-6ee7fc31bad5 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:32.647414 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3e49c199-69d7-47a5-9cba-6ee7fc31bad5 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:32.649947 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3e49c199-69d7-47a5-9cba-6ee7fc31bad5 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:32.650433 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3e49c199-69d7-47a5-9cba-6ee7fc31bad5 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:32.651636 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3e49c199-69d7-47a5-9cba-6ee7fc31bad5 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:32.712817 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=100 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:05:33.300851 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-9a6e0409-54ce-48d3-92fd-15e6c60ce3a0 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:33.317212 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-3e49c199-69d7-47a5-9cba-6ee7fc31bad5 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02330887b6814bea8312e01103b0d2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a358bdeb8c10424a8b70cc7b6c94e726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:33.328748 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-9a6e0409-54ce-48d3-92fd-15e6c60ce3a0 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/8e670908-5bb6-49ad-92f3-dad1b4df1b5a" status: 200 len: 1316 microversion: 2.1 time: 1.671766 Sep 14 09:05:33.349787 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1908/3778] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:05:31 2022] GET /compute/v2.1/servers/8e670908-5bb6-49ad-92f3-dad1b4df1b5a => generated 1316 bytes in 1693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:05:33.354151 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-3e49c199-69d7-47a5-9cba-6ee7fc31bad5 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] 10.222.0.60 "GET /compute/v2.1/servers/05cc41b4-ace4-4d14-90ed-ad19af43e268" status: 200 len: 1514 microversion: 2.1 time: 0.760316 Sep 14 09:05:33.356039 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1871/3779] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:05:32 2022] GET /compute/v2.1/servers/05cc41b4-ace4-4d14-90ed-ad19af43e268 => generated 1514 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:05:33.377910 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-906671ab-15eb-4ec2-91e5-d29cbc07c941 tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:33.384539 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-906671ab-15eb-4ec2-91e5-d29cbc07c941 tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] [instance: c45b2464-2a80-4ae9-a8f8-04687ff7acf7] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:05:33.387185 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-00933bc4-aa93-4868-b409-39f65d51fd04 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '.version_select at 0x7f7d3f8300d0>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:33.408329 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-906671ab-15eb-4ec2-91e5-d29cbc07c941 tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:33.416055 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-906671ab-15eb-4ec2-91e5-d29cbc07c941 tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:33.419233 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-906671ab-15eb-4ec2-91e5-d29cbc07c941 tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:33.423995 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-906671ab-15eb-4ec2-91e5-d29cbc07c941 tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:33.425064 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-906671ab-15eb-4ec2-91e5-d29cbc07c941 tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:33.427993 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-906671ab-15eb-4ec2-91e5-d29cbc07c941 tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:33.495162 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-00933bc4-aa93-4868-b409-39f65d51fd04 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute/v2.1/images/a62c47ed-e003-4adc-bdf0-222dc0068fa9" status: 200 len: 1414 microversion: 2.1 time: 0.143799 Sep 14 09:05:33.504805 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1909/3780] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:05:33 2022] GET /compute/v2.1/images/a62c47ed-e003-4adc-bdf0-222dc0068fa9 => generated 1414 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:05:33.518298 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-bc829ce6-2f0a-4b15-9e6e-e432dde8604d tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:33.519607 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-bc829ce6-2f0a-4b15-9e6e-e432dde8604d tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] [instance: 136e2cad-31c9-4c0a-93ae-b6de98a41f8b] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:05:33.529344 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bc829ce6-2f0a-4b15-9e6e-e432dde8604d tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:33.530310 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bc829ce6-2f0a-4b15-9e6e-e432dde8604d tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:33.531106 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bc829ce6-2f0a-4b15-9e6e-e432dde8604d tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:33.532048 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bc829ce6-2f0a-4b15-9e6e-e432dde8604d tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:33.532705 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bc829ce6-2f0a-4b15-9e6e-e432dde8604d tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:33.533799 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bc829ce6-2f0a-4b15-9e6e-e432dde8604d tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:34.177331 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=2 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:05:34.897265 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-bc829ce6-2f0a-4b15-9e6e-e432dde8604d tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02330887b6814bea8312e01103b0d2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a358bdeb8c10424a8b70cc7b6c94e726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:34.918248 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-906671ab-15eb-4ec2-91e5-d29cbc07c941 tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbdd3cee870d4fff8ddc3f215ea5a7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ab4c57f9f64f629c6b60663855766d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:34.933126 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-906671ab-15eb-4ec2-91e5-d29cbc07c941 tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbdd3cee870d4fff8ddc3f215ea5a7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ab4c57f9f64f629c6b60663855766d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:34.937634 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-906671ab-15eb-4ec2-91e5-d29cbc07c941 tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbdd3cee870d4fff8ddc3f215ea5a7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ab4c57f9f64f629c6b60663855766d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:34.943380 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-906671ab-15eb-4ec2-91e5-d29cbc07c941 tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] 10.222.0.60 "GET /compute/v2.1/servers/c45b2464-2a80-4ae9-a8f8-04687ff7acf7" status: 200 len: 1359 microversion: 2.21 time: 1.584767 Sep 14 09:05:34.944588 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1872/3781] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:05:33 2022] GET /compute/v2.1/servers/c45b2464-2a80-4ae9-a8f8-04687ff7acf7 => generated 1359 bytes in 1588 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:05:34.950494 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b75ff198-e3fd-4c8c-9b16-a1f6f39faba8 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:34.951735 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b75ff198-e3fd-4c8c-9b16-a1f6f39faba8 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: 8e670908-5bb6-49ad-92f3-dad1b4df1b5a] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:05:34.972027 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-bc829ce6-2f0a-4b15-9e6e-e432dde8604d tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] 10.222.0.60 "GET /compute/v2.1/servers/136e2cad-31c9-4c0a-93ae-b6de98a41f8b" status: 200 len: 1514 microversion: 2.1 time: 1.465372 Sep 14 09:05:34.972643 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1910/3782] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:05:33 2022] GET /compute/v2.1/servers/136e2cad-31c9-4c0a-93ae-b6de98a41f8b => generated 1514 bytes in 1467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:05:34.999656 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-4cd04b1a-1f06-432e-b5cc-e48bd6112250 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '.version_select at 0x7f7d44de9940>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:35.003799 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b75ff198-e3fd-4c8c-9b16-a1f6f39faba8 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:35.004308 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b75ff198-e3fd-4c8c-9b16-a1f6f39faba8 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:35.004757 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b75ff198-e3fd-4c8c-9b16-a1f6f39faba8 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:35.005659 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b75ff198-e3fd-4c8c-9b16-a1f6f39faba8 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:35.018609 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b75ff198-e3fd-4c8c-9b16-a1f6f39faba8 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:35.023056 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b75ff198-e3fd-4c8c-9b16-a1f6f39faba8 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:35.112149 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-4cd04b1a-1f06-432e-b5cc-e48bd6112250 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute/v2.1/images/a62c47ed-e003-4adc-bdf0-222dc0068fa9" status: 200 len: 1414 microversion: 2.1 time: 0.138258 Sep 14 09:05:35.114901 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1911/3783] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:05:34 2022] GET /compute/v2.1/images/a62c47ed-e003-4adc-bdf0-222dc0068fa9 => generated 1414 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:05:35.129799 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c4fac52c-e938-42fc-8650-a6da4c0f0619 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:35.137285 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-c4fac52c-e938-42fc-8650-a6da4c0f0619 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] [instance: 1435eb10-e290-4e5c-9e16-4bbcc2cba6db] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:05:35.163372 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c4fac52c-e938-42fc-8650-a6da4c0f0619 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:35.171619 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c4fac52c-e938-42fc-8650-a6da4c0f0619 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:35.172318 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c4fac52c-e938-42fc-8650-a6da4c0f0619 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:35.178816 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c4fac52c-e938-42fc-8650-a6da4c0f0619 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:35.181917 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c4fac52c-e938-42fc-8650-a6da4c0f0619 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:35.183070 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c4fac52c-e938-42fc-8650-a6da4c0f0619 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:36.597184 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b75ff198-e3fd-4c8c-9b16-a1f6f39faba8 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:36.610879 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b75ff198-e3fd-4c8c-9b16-a1f6f39faba8 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/8e670908-5bb6-49ad-92f3-dad1b4df1b5a" status: 200 len: 1316 microversion: 2.1 time: 1.662399 Sep 14 09:05:36.624969 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1873/3784] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:05:34 2022] GET /compute/v2.1/servers/8e670908-5bb6-49ad-92f3-dad1b4df1b5a => generated 1316 bytes in 1679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:05:36.642278 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d5a9d17e-e23c-4219-9d47-8920591d8ffa tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:36.650352 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-d5a9d17e-e23c-4219-9d47-8920591d8ffa tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] [instance: c45b2464-2a80-4ae9-a8f8-04687ff7acf7] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:05:36.669142 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d5a9d17e-e23c-4219-9d47-8920591d8ffa tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:36.669987 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d5a9d17e-e23c-4219-9d47-8920591d8ffa tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:36.670623 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d5a9d17e-e23c-4219-9d47-8920591d8ffa tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:36.672358 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d5a9d17e-e23c-4219-9d47-8920591d8ffa tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:36.672989 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d5a9d17e-e23c-4219-9d47-8920591d8ffa tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:36.673588 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d5a9d17e-e23c-4219-9d47-8920591d8ffa tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:37.011277 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-c4fac52c-e938-42fc-8650-a6da4c0f0619 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02330887b6814bea8312e01103b0d2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a358bdeb8c10424a8b70cc7b6c94e726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:37.020096 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-c4fac52c-e938-42fc-8650-a6da4c0f0619 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] 10.222.0.60 "GET /compute/v2.1/servers/1435eb10-e290-4e5c-9e16-4bbcc2cba6db" status: 200 len: 1514 microversion: 2.1 time: 1.899905 Sep 14 09:05:37.020700 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1912/3785] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:05:35 2022] GET /compute/v2.1/servers/1435eb10-e290-4e5c-9e16-4bbcc2cba6db => generated 1514 bytes in 1905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:05:37.054180 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-3269e4fb-0849-4694-b908-7a02fc345af5 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '.version_select at 0x7f7d48611940>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:37.111381 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-d5a9d17e-e23c-4219-9d47-8920591d8ffa tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbdd3cee870d4fff8ddc3f215ea5a7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ab4c57f9f64f629c6b60663855766d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:37.123952 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-d5a9d17e-e23c-4219-9d47-8920591d8ffa tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbdd3cee870d4fff8ddc3f215ea5a7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ab4c57f9f64f629c6b60663855766d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:37.126106 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-d5a9d17e-e23c-4219-9d47-8920591d8ffa tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbdd3cee870d4fff8ddc3f215ea5a7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ab4c57f9f64f629c6b60663855766d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:37.127775 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d5a9d17e-e23c-4219-9d47-8920591d8ffa tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] 10.222.0.60 "GET /compute/v2.1/servers/c45b2464-2a80-4ae9-a8f8-04687ff7acf7" status: 200 len: 1359 microversion: 2.21 time: 0.501558 Sep 14 09:05:37.129558 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1874/3786] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:05:36 2022] GET /compute/v2.1/servers/c45b2464-2a80-4ae9-a8f8-04687ff7acf7 => generated 1359 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:05:37.156206 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-8c233cda-e911-464e-9540-119151eeffb1 req-850168fe-72a4-424f-9315-eab5b499128f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e670908-5bb6-49ad-92f3-dad1b4df1b5a", "tag": "9c0d24b4-f3c7-444b-9f46-dff7b9217185"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:05:37.176711 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-3269e4fb-0849-4694-b908-7a02fc345af5 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute/v2.1/images/a62c47ed-e003-4adc-bdf0-222dc0068fa9" status: 200 len: 1414 microversion: 2.1 time: 0.126315 Sep 14 09:05:37.177328 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1913/3787] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:05:37 2022] GET /compute/v2.1/images/a62c47ed-e003-4adc-bdf0-222dc0068fa9 => generated 1414 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:05:37.196718 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-af48a485-c897-4b03-b4df-bb6f8de2ab15 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:37.197244 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-af48a485-c897-4b03-b4df-bb6f8de2ab15 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] [instance: 1435eb10-e290-4e5c-9e16-4bbcc2cba6db] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:05:37.209781 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-8c233cda-e911-464e-9540-119151eeffb1 req-850168fe-72a4-424f-9315-eab5b499128f service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:37.210262 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-8c233cda-e911-464e-9540-119151eeffb1 req-850168fe-72a4-424f-9315-eab5b499128f service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:37.210764 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-8c233cda-e911-464e-9540-119151eeffb1 req-850168fe-72a4-424f-9315-eab5b499128f service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:37.230369 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-af48a485-c897-4b03-b4df-bb6f8de2ab15 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:37.236146 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-af48a485-c897-4b03-b4df-bb6f8de2ab15 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:37.236607 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-af48a485-c897-4b03-b4df-bb6f8de2ab15 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:37.237377 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-af48a485-c897-4b03-b4df-bb6f8de2ab15 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:37.237856 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-af48a485-c897-4b03-b4df-bb6f8de2ab15 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:37.243342 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-af48a485-c897-4b03-b4df-bb6f8de2ab15 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:37.263872 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-8c233cda-e911-464e-9540-119151eeffb1 req-850168fe-72a4-424f-9315-eab5b499128f service nova] Creating event network-changed:9c0d24b4-f3c7-444b-9f46-dff7b9217185 for instance 8e670908-5bb6-49ad-92f3-dad1b4df1b5a on n-h1-836830-18 Sep 14 09:05:37.301011 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-8c233cda-e911-464e-9540-119151eeffb1 req-850168fe-72a4-424f-9315-eab5b499128f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.165209 Sep 14 09:05:37.302968 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1875/3788] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:05:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:05:37.310850 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-af48a485-c897-4b03-b4df-bb6f8de2ab15 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] [instance: 1435eb10-e290-4e5c-9e16-4bbcc2cba6db] Going to try to terminate instance {{(pid=128758) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:05:37.549818 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-af48a485-c897-4b03-b4df-bb6f8de2ab15 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] 10.222.0.60 "DELETE /compute/v2.1/servers/1435eb10-e290-4e5c-9e16-4bbcc2cba6db" status: 204 len: 0 microversion: 2.1 time: 0.343324 Sep 14 09:05:37.550990 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1914/3789] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:05:37 2022] DELETE /compute/v2.1/servers/1435eb10-e290-4e5c-9e16-4bbcc2cba6db => generated 0 bytes in 373 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:05:37.561384 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-81215edc-4124-4a73-8b08-e8ce7b267b08 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:37.562187 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-81215edc-4124-4a73-8b08-e8ce7b267b08 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] [instance: 1435eb10-e290-4e5c-9e16-4bbcc2cba6db] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:05:37.588546 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-81215edc-4124-4a73-8b08-e8ce7b267b08 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:37.589072 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-81215edc-4124-4a73-8b08-e8ce7b267b08 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:37.589530 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-81215edc-4124-4a73-8b08-e8ce7b267b08 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:37.590279 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-81215edc-4124-4a73-8b08-e8ce7b267b08 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:37.590726 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-81215edc-4124-4a73-8b08-e8ce7b267b08 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:37.591245 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-81215edc-4124-4a73-8b08-e8ce7b267b08 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:37.641576 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-7e5d272d-926a-41ec-823b-9d20a7a4ac6a tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:37.652678 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-7e5d272d-926a-41ec-823b-9d20a7a4ac6a tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: 8e670908-5bb6-49ad-92f3-dad1b4df1b5a] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:05:37.666425 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7e5d272d-926a-41ec-823b-9d20a7a4ac6a tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:37.669965 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7e5d272d-926a-41ec-823b-9d20a7a4ac6a tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:37.670460 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7e5d272d-926a-41ec-823b-9d20a7a4ac6a tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:37.671453 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7e5d272d-926a-41ec-823b-9d20a7a4ac6a tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:37.672131 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7e5d272d-926a-41ec-823b-9d20a7a4ac6a tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:37.673938 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7e5d272d-926a-41ec-823b-9d20a7a4ac6a tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:38.093775 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-81215edc-4124-4a73-8b08-e8ce7b267b08 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02330887b6814bea8312e01103b0d2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a358bdeb8c10424a8b70cc7b6c94e726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:38.108213 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-81215edc-4124-4a73-8b08-e8ce7b267b08 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] 10.222.0.60 "GET /compute/v2.1/servers/1435eb10-e290-4e5c-9e16-4bbcc2cba6db" status: 200 len: 1520 microversion: 2.1 time: 0.552494 Sep 14 09:05:38.111278 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1876/3790] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:05:37 2022] GET /compute/v2.1/servers/1435eb10-e290-4e5c-9e16-4bbcc2cba6db => generated 1520 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:05:38.161997 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-441cb46a-1884-4238-9e7d-f9ca1d1e32c0 tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:38.162806 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-441cb46a-1884-4238-9e7d-f9ca1d1e32c0 tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] [instance: c45b2464-2a80-4ae9-a8f8-04687ff7acf7] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:05:38.174308 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-441cb46a-1884-4238-9e7d-f9ca1d1e32c0 tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:38.183419 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-441cb46a-1884-4238-9e7d-f9ca1d1e32c0 tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:38.185565 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-441cb46a-1884-4238-9e7d-f9ca1d1e32c0 tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:38.186524 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-441cb46a-1884-4238-9e7d-f9ca1d1e32c0 tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:38.190347 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-441cb46a-1884-4238-9e7d-f9ca1d1e32c0 tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:38.195634 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-7e5d272d-926a-41ec-823b-9d20a7a4ac6a tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:38.205906 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-7e5d272d-926a-41ec-823b-9d20a7a4ac6a tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/8e670908-5bb6-49ad-92f3-dad1b4df1b5a" status: 200 len: 1316 microversion: 2.1 time: 0.571858 Sep 14 09:05:38.206473 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-441cb46a-1884-4238-9e7d-f9ca1d1e32c0 tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:38.214918 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1915/3791] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:05:37 2022] GET /compute/v2.1/servers/8e670908-5bb6-49ad-92f3-dad1b4df1b5a => generated 1316 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:05:38.235062 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ef018d6f-04fe-4cde-8beb-9508f5f8f9c4 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '.version_select at 0x7f7d4493f820>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:38.380015 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-ef018d6f-04fe-4cde-8beb-9508f5f8f9c4 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute/v2.1/images/a62c47ed-e003-4adc-bdf0-222dc0068fa9" status: 200 len: 1414 microversion: 2.1 time: 0.161732 Sep 14 09:05:38.382222 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1916/3792] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:05:38 2022] GET /compute/v2.1/images/a62c47ed-e003-4adc-bdf0-222dc0068fa9 => generated 1414 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:05:38.448095 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-8b3d09eb-6ea4-4e6b-a06a-b79877511bdc tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2034120210", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "63df5062-0947-41ef-8d8c-a8d82a21791b"}], "security_groups": [{"name": "tempest-securitygroup--446642194"}], "key_name": "tempest-keypair-1803326428", "user_data": "}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:05:38.804601 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-441cb46a-1884-4238-9e7d-f9ca1d1e32c0 tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbdd3cee870d4fff8ddc3f215ea5a7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ab4c57f9f64f629c6b60663855766d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:38.831100 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-441cb46a-1884-4238-9e7d-f9ca1d1e32c0 tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbdd3cee870d4fff8ddc3f215ea5a7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ab4c57f9f64f629c6b60663855766d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:38.836827 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-441cb46a-1884-4238-9e7d-f9ca1d1e32c0 tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbdd3cee870d4fff8ddc3f215ea5a7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ab4c57f9f64f629c6b60663855766d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:38.839931 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-441cb46a-1884-4238-9e7d-f9ca1d1e32c0 tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] 10.222.0.60 "GET /compute/v2.1/servers/c45b2464-2a80-4ae9-a8f8-04687ff7acf7" status: 200 len: 1359 microversion: 2.21 time: 0.682270 Sep 14 09:05:38.864805 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1877/3793] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:05:38 2022] GET /compute/v2.1/servers/c45b2464-2a80-4ae9-a8f8-04687ff7acf7 => generated 1359 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:05:38.870346 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-e7f35a4a-6636-4e41-a06d-446ea1bc0cc4 req-21d02e1c-99ed-469a-b1d9-ba8e96a16358 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c45b2464-2a80-4ae9-a8f8-04687ff7acf7", "name": "network-vif-plugged", "status": "completed", "tag": "5373aeda-0911-463b-ac42-79834c452c1d"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:05:38.899948 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-e7f35a4a-6636-4e41-a06d-446ea1bc0cc4 req-21d02e1c-99ed-469a-b1d9-ba8e96a16358 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:38.900470 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-e7f35a4a-6636-4e41-a06d-446ea1bc0cc4 req-21d02e1c-99ed-469a-b1d9-ba8e96a16358 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:38.900918 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-e7f35a4a-6636-4e41-a06d-446ea1bc0cc4 req-21d02e1c-99ed-469a-b1d9-ba8e96a16358 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:38.927972 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-e7f35a4a-6636-4e41-a06d-446ea1bc0cc4 req-21d02e1c-99ed-469a-b1d9-ba8e96a16358 service nova] Creating event network-vif-plugged:5373aeda-0911-463b-ac42-79834c452c1d for instance c45b2464-2a80-4ae9-a8f8-04687ff7acf7 on n-h2-836830-18 Sep 14 09:05:38.936601 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-e7f35a4a-6636-4e41-a06d-446ea1bc0cc4 req-21d02e1c-99ed-469a-b1d9-ba8e96a16358 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070605 Sep 14 09:05:38.937484 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1878/3794] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:05:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:05:38.956315 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.network.neutron [None req-8b3d09eb-6ea4-4e6b-a06a-b79877511bdc tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] validate_networks() for [('63df5062-0947-41ef-8d8c-a8d82a21791b', None, None, None, None, None)] {{(pid=128758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:05:39.138268 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-7c7b3848-4fd5-40b7-abae-398c1628aeaa tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:39.139679 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-7c7b3848-4fd5-40b7-abae-398c1628aeaa tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] [instance: 1435eb10-e290-4e5c-9e16-4bbcc2cba6db] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:05:39.153569 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7c7b3848-4fd5-40b7-abae-398c1628aeaa tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:39.156569 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7c7b3848-4fd5-40b7-abae-398c1628aeaa tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:39.157634 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7c7b3848-4fd5-40b7-abae-398c1628aeaa tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:39.159761 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7c7b3848-4fd5-40b7-abae-398c1628aeaa tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:39.161530 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7c7b3848-4fd5-40b7-abae-398c1628aeaa tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:39.162189 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7c7b3848-4fd5-40b7-abae-398c1628aeaa tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:40.119719 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-7c7b3848-4fd5-40b7-abae-398c1628aeaa tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02330887b6814bea8312e01103b0d2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a358bdeb8c10424a8b70cc7b6c94e726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:40.129728 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-7c7b3848-4fd5-40b7-abae-398c1628aeaa tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] 10.222.0.60 "GET /compute/v2.1/servers/1435eb10-e290-4e5c-9e16-4bbcc2cba6db" status: 200 len: 1520 microversion: 2.1 time: 0.997218 Sep 14 09:05:40.130993 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1879/3795] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:05:39 2022] GET /compute/v2.1/servers/1435eb10-e290-4e5c-9e16-4bbcc2cba6db => generated 1520 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:05:40.147418 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d8236bc5-0659-4f42-b7b0-daa548801f8f tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:40.150468 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-d8236bc5-0659-4f42-b7b0-daa548801f8f tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: 8e670908-5bb6-49ad-92f3-dad1b4df1b5a] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:05:40.166037 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d8236bc5-0659-4f42-b7b0-daa548801f8f tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:40.168554 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d8236bc5-0659-4f42-b7b0-daa548801f8f tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:40.170552 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d8236bc5-0659-4f42-b7b0-daa548801f8f tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:40.191375 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d8236bc5-0659-4f42-b7b0-daa548801f8f tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:40.191375 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d8236bc5-0659-4f42-b7b0-daa548801f8f tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:40.191375 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d8236bc5-0659-4f42-b7b0-daa548801f8f tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:40.632382 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-d8236bc5-0659-4f42-b7b0-daa548801f8f tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:40.644082 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d8236bc5-0659-4f42-b7b0-daa548801f8f tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/8e670908-5bb6-49ad-92f3-dad1b4df1b5a" status: 200 len: 1316 microversion: 2.1 time: 0.511516 Sep 14 09:05:40.663060 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1880/3796] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:05:40 2022] GET /compute/v2.1/servers/8e670908-5bb6-49ad-92f3-dad1b4df1b5a => generated 1316 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:05:40.670224 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ef457e2e-7d44-4de5-80d3-88155f6a64d7 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '.version_select at 0x7f7d44a69670>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:40.768621 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-ef457e2e-7d44-4de5-80d3-88155f6a64d7 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute/v2.1/images/a62c47ed-e003-4adc-bdf0-222dc0068fa9" status: 200 len: 1414 microversion: 2.1 time: 0.116506 Sep 14 09:05:40.769646 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1881/3797] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:05:40 2022] GET /compute/v2.1/images/a62c47ed-e003-4adc-bdf0-222dc0068fa9 => generated 1414 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:05:40.781604 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-321a2273-b348-4742-b78c-1e672e9cc52b tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:40.782643 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-321a2273-b348-4742-b78c-1e672e9cc52b tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] [instance: c45b2464-2a80-4ae9-a8f8-04687ff7acf7] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:05:40.797864 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-321a2273-b348-4742-b78c-1e672e9cc52b tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:40.800821 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-321a2273-b348-4742-b78c-1e672e9cc52b tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:40.801669 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-321a2273-b348-4742-b78c-1e672e9cc52b tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:40.802754 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-321a2273-b348-4742-b78c-1e672e9cc52b tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:40.803549 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-321a2273-b348-4742-b78c-1e672e9cc52b tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:40.804264 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-321a2273-b348-4742-b78c-1e672e9cc52b tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:41.223088 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-321a2273-b348-4742-b78c-1e672e9cc52b tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbdd3cee870d4fff8ddc3f215ea5a7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ab4c57f9f64f629c6b60663855766d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:41.238674 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-321a2273-b348-4742-b78c-1e672e9cc52b tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbdd3cee870d4fff8ddc3f215ea5a7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ab4c57f9f64f629c6b60663855766d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:41.241338 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-321a2273-b348-4742-b78c-1e672e9cc52b tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbdd3cee870d4fff8ddc3f215ea5a7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ab4c57f9f64f629c6b60663855766d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:41.247136 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-321a2273-b348-4742-b78c-1e672e9cc52b tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] 10.222.0.60 "GET /compute/v2.1/servers/c45b2464-2a80-4ae9-a8f8-04687ff7acf7" status: 200 len: 1359 microversion: 2.21 time: 0.471653 Sep 14 09:05:41.249467 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1882/3798] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:05:40 2022] GET /compute/v2.1/servers/c45b2464-2a80-4ae9-a8f8-04687ff7acf7 => generated 1359 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:05:41.258845 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-9fb74a24-3096-40b7-bd3c-93b7f3a46bf0 req-63ad682e-dd4c-484f-a386-a19e86523c71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1435eb10-e290-4e5c-9e16-4bbcc2cba6db", "name": "network-vif-deleted", "tag": "330d89cb-bba9-4c9b-aa73-5b27d08980b0"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:05:41.295364 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-9fb74a24-3096-40b7-bd3c-93b7f3a46bf0 req-63ad682e-dd4c-484f-a386-a19e86523c71 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:41.295856 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-9fb74a24-3096-40b7-bd3c-93b7f3a46bf0 req-63ad682e-dd4c-484f-a386-a19e86523c71 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:41.296294 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-9fb74a24-3096-40b7-bd3c-93b7f3a46bf0 req-63ad682e-dd4c-484f-a386-a19e86523c71 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:41.350919 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-9fb74a24-3096-40b7-bd3c-93b7f3a46bf0 req-63ad682e-dd4c-484f-a386-a19e86523c71 service nova] Creating event network-vif-deleted:330d89cb-bba9-4c9b-aa73-5b27d08980b0 for instance 1435eb10-e290-4e5c-9e16-4bbcc2cba6db on n-h1-836830-18 Sep 14 09:05:41.375182 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-9fb74a24-3096-40b7-bd3c-93b7f3a46bf0 req-63ad682e-dd4c-484f-a386-a19e86523c71 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124380 Sep 14 09:05:41.381473 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1883/3799] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:05:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:05:41.400014 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9b06f05f-3fe0-4cb2-9703-162e7717fa8e tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:41.400913 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-9b06f05f-3fe0-4cb2-9703-162e7717fa8e tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] [instance: 1435eb10-e290-4e5c-9e16-4bbcc2cba6db] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:05:41.414421 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-8b3d09eb-6ea4-4e6b-a06a-b79877511bdc tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Flavor limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:05:41.414988 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-8b3d09eb-6ea4-4e6b-a06a-b79877511bdc tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Image limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:05:41.415378 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-8b3d09eb-6ea4-4e6b-a06a-b79877511bdc tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Flavor pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:05:41.416035 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-8b3d09eb-6ea4-4e6b-a06a-b79877511bdc tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Image pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:05:41.416509 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-8b3d09eb-6ea4-4e6b-a06a-b79877511bdc tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:05:41.433146 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9b06f05f-3fe0-4cb2-9703-162e7717fa8e tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:41.434959 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8b3d09eb-6ea4-4e6b-a06a-b79877511bdc tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:41.435735 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9b06f05f-3fe0-4cb2-9703-162e7717fa8e tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:41.436726 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8b3d09eb-6ea4-4e6b-a06a-b79877511bdc tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:41.437132 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9b06f05f-3fe0-4cb2-9703-162e7717fa8e tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:41.438078 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9b06f05f-3fe0-4cb2-9703-162e7717fa8e tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:41.439213 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8b3d09eb-6ea4-4e6b-a06a-b79877511bdc tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:41.441153 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9b06f05f-3fe0-4cb2-9703-162e7717fa8e tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:41.442285 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9b06f05f-3fe0-4cb2-9703-162e7717fa8e tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:41.442516 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8b3d09eb-6ea4-4e6b-a06a-b79877511bdc tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:41.443861 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8b3d09eb-6ea4-4e6b-a06a-b79877511bdc tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:41.445616 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8b3d09eb-6ea4-4e6b-a06a-b79877511bdc tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:41.500197 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-8b3d09eb-6ea4-4e6b-a06a-b79877511bdc tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Getting quotas for project 2f075a2c6aa4489abb3428e0a4ac5738. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:05:41.514497 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-8b3d09eb-6ea4-4e6b-a06a-b79877511bdc tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Getting quotas for user 950da33830ae4ae1a5511dd146e4e3be and project 2f075a2c6aa4489abb3428e0a4ac5738. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:05:41.559544 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-8b3d09eb-6ea4-4e6b-a06a-b79877511bdc tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Going to run 1 instances... {{(pid=128758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:05:41.565209 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-8b3d09eb-6ea4-4e6b-a06a-b79877511bdc tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:05:41.592347 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-9b06f05f-3fe0-4cb2-9703-162e7717fa8e tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02330887b6814bea8312e01103b0d2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a358bdeb8c10424a8b70cc7b6c94e726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:41.605779 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-9b06f05f-3fe0-4cb2-9703-162e7717fa8e tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] 10.222.0.60 "GET /compute/v2.1/servers/1435eb10-e290-4e5c-9e16-4bbcc2cba6db" status: 200 len: 1478 microversion: 2.1 time: 0.220474 Sep 14 09:05:41.608185 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1884/3800] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:05:41 2022] GET /compute/v2.1/servers/1435eb10-e290-4e5c-9e16-4bbcc2cba6db => generated 1478 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:05:41.658560 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-8b3d09eb-6ea4-4e6b-a06a-b79877511bdc tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 3.217587 Sep 14 09:05:41.671489 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ce2cc6e9-ff86-4970-8373-992747f4be09 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:41.672685 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-ce2cc6e9-ff86-4970-8373-992747f4be09 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:05:41.675989 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1917/3801] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 09:05:38 2022] POST /compute/v2.1/servers => generated 408 bytes in 3236 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:05:41.692836 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:05:41.700516 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-8da38152-e26b-47f0-9199-ae4dfa54af06 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:41.736916 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-8da38152-e26b-47f0-9199-ae4dfa54af06 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: 8e670908-5bb6-49ad-92f3-dad1b4df1b5a] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:05:41.756900 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8da38152-e26b-47f0-9199-ae4dfa54af06 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:41.765588 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8da38152-e26b-47f0-9199-ae4dfa54af06 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:41.767501 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8da38152-e26b-47f0-9199-ae4dfa54af06 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:41.773957 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8da38152-e26b-47f0-9199-ae4dfa54af06 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:41.774932 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8da38152-e26b-47f0-9199-ae4dfa54af06 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:41.776212 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8da38152-e26b-47f0-9199-ae4dfa54af06 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:41.817947 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-ce2cc6e9-ff86-4970-8373-992747f4be09 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:41.832400 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-ce2cc6e9-ff86-4970-8373-992747f4be09 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105" status: 200 len: 1239 microversion: 2.1 time: 0.164602 Sep 14 09:05:41.835347 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1885/3802] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:05:41 2022] GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105 => generated 1239 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:05:41.847764 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-68c7910a-d409-4a65-990c-0a3e1be807b9 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '.version_select at 0x7f7d3fcb4430>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:41.983956 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-68c7910a-d409-4a65-990c-0a3e1be807b9 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute/v2.1/images/a62c47ed-e003-4adc-bdf0-222dc0068fa9" status: 200 len: 1414 microversion: 2.1 time: 0.145530 Sep 14 09:05:41.994919 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1886/3803] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:05:41 2022] GET /compute/v2.1/images/a62c47ed-e003-4adc-bdf0-222dc0068fa9 => generated 1414 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:05:42.085657 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-8da38152-e26b-47f0-9199-ae4dfa54af06 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:42.096433 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-8da38152-e26b-47f0-9199-ae4dfa54af06 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/8e670908-5bb6-49ad-92f3-dad1b4df1b5a" status: 200 len: 1316 microversion: 2.1 time: 0.418227 Sep 14 09:05:42.097479 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1918/3804] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:05:41 2022] GET /compute/v2.1/servers/8e670908-5bb6-49ad-92f3-dad1b4df1b5a => generated 1316 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:05:42.283348 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-00a14fbb-474b-415c-81f0-89cb44753fb8 tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:42.284997 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-00a14fbb-474b-415c-81f0-89cb44753fb8 tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] [instance: c45b2464-2a80-4ae9-a8f8-04687ff7acf7] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:05:42.305700 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-00a14fbb-474b-415c-81f0-89cb44753fb8 tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:42.306819 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-00a14fbb-474b-415c-81f0-89cb44753fb8 tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:42.309346 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-00a14fbb-474b-415c-81f0-89cb44753fb8 tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:42.311104 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-00a14fbb-474b-415c-81f0-89cb44753fb8 tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:42.312756 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-00a14fbb-474b-415c-81f0-89cb44753fb8 tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:42.314327 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-00a14fbb-474b-415c-81f0-89cb44753fb8 tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:42.633747 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d1a1fe99-45eb-4fd9-a230-208ebbe83952 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:42.634654 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-d1a1fe99-45eb-4fd9-a230-208ebbe83952 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] [instance: 1435eb10-e290-4e5c-9e16-4bbcc2cba6db] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:05:42.659038 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d1a1fe99-45eb-4fd9-a230-208ebbe83952 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:42.659819 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d1a1fe99-45eb-4fd9-a230-208ebbe83952 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:42.665928 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d1a1fe99-45eb-4fd9-a230-208ebbe83952 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:42.669450 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d1a1fe99-45eb-4fd9-a230-208ebbe83952 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:42.672359 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d1a1fe99-45eb-4fd9-a230-208ebbe83952 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:42.673148 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d1a1fe99-45eb-4fd9-a230-208ebbe83952 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:42.738735 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d1a1fe99-45eb-4fd9-a230-208ebbe83952 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:42.739483 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d1a1fe99-45eb-4fd9-a230-208ebbe83952 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:42.740288 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d1a1fe99-45eb-4fd9-a230-208ebbe83952 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:42.742602 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.objects.instance [None req-d1a1fe99-45eb-4fd9-a230-208ebbe83952 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lazy-loading 'fault' on Instance uuid 1435eb10-e290-4e5c-9e16-4bbcc2cba6db {{(pid=128758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:05:42.876077 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-d1a1fe99-45eb-4fd9-a230-208ebbe83952 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02330887b6814bea8312e01103b0d2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a358bdeb8c10424a8b70cc7b6c94e726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:42.897964 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-d1a1fe99-45eb-4fd9-a230-208ebbe83952 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] 10.222.0.60 "GET /compute/v2.1/servers/1435eb10-e290-4e5c-9e16-4bbcc2cba6db" status: 200 len: 1312 microversion: 2.1 time: 0.268894 Sep 14 09:05:42.902330 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1919/3805] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:05:42 2022] GET /compute/v2.1/servers/1435eb10-e290-4e5c-9e16-4bbcc2cba6db => generated 1312 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:05:42.926879 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-82ee6bf1-a137-4222-9f3d-8a63da78c54b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:42.928122 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-82ee6bf1-a137-4222-9f3d-8a63da78c54b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:05:42.939335 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-82ee6bf1-a137-4222-9f3d-8a63da78c54b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:42.940528 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-82ee6bf1-a137-4222-9f3d-8a63da78c54b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:42.941721 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-82ee6bf1-a137-4222-9f3d-8a63da78c54b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:42.943197 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-82ee6bf1-a137-4222-9f3d-8a63da78c54b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:42.944583 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-82ee6bf1-a137-4222-9f3d-8a63da78c54b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:42.945281 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-82ee6bf1-a137-4222-9f3d-8a63da78c54b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:42.963993 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-00a14fbb-474b-415c-81f0-89cb44753fb8 tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbdd3cee870d4fff8ddc3f215ea5a7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ab4c57f9f64f629c6b60663855766d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:42.974331 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-00a14fbb-474b-415c-81f0-89cb44753fb8 tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbdd3cee870d4fff8ddc3f215ea5a7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ab4c57f9f64f629c6b60663855766d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:42.979633 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-00a14fbb-474b-415c-81f0-89cb44753fb8 tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbdd3cee870d4fff8ddc3f215ea5a7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ab4c57f9f64f629c6b60663855766d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:42.981353 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-00a14fbb-474b-415c-81f0-89cb44753fb8 tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] 10.222.0.60 "GET /compute/v2.1/servers/c45b2464-2a80-4ae9-a8f8-04687ff7acf7" status: 200 len: 1552 microversion: 2.21 time: 0.710849 Sep 14 09:05:42.981947 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1887/3806] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:05:42 2022] GET /compute/v2.1/servers/c45b2464-2a80-4ae9-a8f8-04687ff7acf7 => generated 1552 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:05:43.000096 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-dd7eb347-fbf8-4438-a528-fc691dbbad1b tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '.version_select at 0x7f7d3fcb4d30>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:43.076946 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-dd7eb347-fbf8-4438-a528-fc691dbbad1b tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute/v2.1/images/a62c47ed-e003-4adc-bdf0-222dc0068fa9" status: 200 len: 1414 microversion: 2.1 time: 0.080321 Sep 14 09:05:43.079897 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1888/3807] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:05:42 2022] GET /compute/v2.1/images/a62c47ed-e003-4adc-bdf0-222dc0068fa9 => generated 1414 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:05:43.087341 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-7db9907e-cfe3-45ff-a024-14a92b6ed7a9 tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:43.088230 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-7db9907e-cfe3-45ff-a024-14a92b6ed7a9 tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] [instance: c45b2464-2a80-4ae9-a8f8-04687ff7acf7] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:05:43.114987 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7db9907e-cfe3-45ff-a024-14a92b6ed7a9 tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:43.118052 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-82ee6bf1-a137-4222-9f3d-8a63da78c54b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:43.118993 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7db9907e-cfe3-45ff-a024-14a92b6ed7a9 tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:43.119793 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7db9907e-cfe3-45ff-a024-14a92b6ed7a9 tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:43.121977 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7db9907e-cfe3-45ff-a024-14a92b6ed7a9 tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:43.122754 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7db9907e-cfe3-45ff-a024-14a92b6ed7a9 tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:43.123536 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7db9907e-cfe3-45ff-a024-14a92b6ed7a9 tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:43.138273 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-82ee6bf1-a137-4222-9f3d-8a63da78c54b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105" status: 200 len: 1235 microversion: 2.1 time: 0.230972 Sep 14 09:05:43.140056 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1920/3808] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:05:42 2022] GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105 => generated 1235 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:05:43.219072 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-7db9907e-cfe3-45ff-a024-14a92b6ed7a9 tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] [instance: c45b2464-2a80-4ae9-a8f8-04687ff7acf7] Going to try to terminate instance {{(pid=128759) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:05:43.403766 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-7db9907e-cfe3-45ff-a024-14a92b6ed7a9 tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] 10.222.0.60 "DELETE /compute/v2.1/servers/c45b2464-2a80-4ae9-a8f8-04687ff7acf7" status: 204 len: 0 microversion: 2.21 time: 0.321140 Sep 14 09:05:43.410336 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1889/3809] 10.222.0.60 () {60 vars in 1280 bytes} [Wed Sep 14 09:05:43 2022] DELETE /compute/v2.1/servers/c45b2464-2a80-4ae9-a8f8-04687ff7acf7 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 14 09:05:43.422280 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-0763734f-5201-4bcc-8a78-fc6cf34a814d tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:43.427375 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-0763734f-5201-4bcc-8a78-fc6cf34a814d tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: 8e670908-5bb6-49ad-92f3-dad1b4df1b5a] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:05:43.450974 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0763734f-5201-4bcc-8a78-fc6cf34a814d tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:43.452637 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0763734f-5201-4bcc-8a78-fc6cf34a814d tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:43.454414 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0763734f-5201-4bcc-8a78-fc6cf34a814d tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:43.456504 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0763734f-5201-4bcc-8a78-fc6cf34a814d tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:43.458059 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0763734f-5201-4bcc-8a78-fc6cf34a814d tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:43.461961 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0763734f-5201-4bcc-8a78-fc6cf34a814d tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:43.520792 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-98ec23e8-2c12-4ebd-9852-36aaf67f79d7 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-816843942", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "networks": "none"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:05:43.668379 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-98ec23e8-2c12-4ebd-9852-36aaf67f79d7 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Flavor limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:05:43.672535 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-98ec23e8-2c12-4ebd-9852-36aaf67f79d7 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Image limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:05:43.673067 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-98ec23e8-2c12-4ebd-9852-36aaf67f79d7 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Flavor pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:05:43.673786 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-98ec23e8-2c12-4ebd-9852-36aaf67f79d7 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Image pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:05:43.676832 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-98ec23e8-2c12-4ebd-9852-36aaf67f79d7 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:05:43.701284 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-98ec23e8-2c12-4ebd-9852-36aaf67f79d7 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:43.702164 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-98ec23e8-2c12-4ebd-9852-36aaf67f79d7 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:43.704107 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-98ec23e8-2c12-4ebd-9852-36aaf67f79d7 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:43.707516 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-98ec23e8-2c12-4ebd-9852-36aaf67f79d7 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:43.709008 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-98ec23e8-2c12-4ebd-9852-36aaf67f79d7 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:43.709973 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-98ec23e8-2c12-4ebd-9852-36aaf67f79d7 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:43.763340 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-98ec23e8-2c12-4ebd-9852-36aaf67f79d7 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Getting quotas for project e21195f8ae7b4267a128e890025c0b51. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:05:43.779033 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-98ec23e8-2c12-4ebd-9852-36aaf67f79d7 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Getting quotas for user 55bda029c9974af09e83631e04459d3f and project e21195f8ae7b4267a128e890025c0b51. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:05:43.804958 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-98ec23e8-2c12-4ebd-9852-36aaf67f79d7 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Going to run 1 instances... {{(pid=128758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:05:43.807719 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-98ec23e8-2c12-4ebd-9852-36aaf67f79d7 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] [instance: bb353760-fa41-4b09-a8c2-63b39e7d3639] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:05:43.877582 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-98ec23e8-2c12-4ebd-9852-36aaf67f79d7 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.736010 Sep 14 09:05:43.878257 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1921/3810] 10.222.0.60 () {62 vars in 1188 bytes} [Wed Sep 14 09:05:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 737 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 14 09:05:43.893087 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-10015527-e265-49ea-a03d-2ad4fe5955bb tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:43.895528 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-10015527-e265-49ea-a03d-2ad4fe5955bb tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] [instance: c45b2464-2a80-4ae9-a8f8-04687ff7acf7] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:05:43.902475 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:05:43.920477 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-10015527-e265-49ea-a03d-2ad4fe5955bb tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:43.920477 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-10015527-e265-49ea-a03d-2ad4fe5955bb tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:43.920477 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-10015527-e265-49ea-a03d-2ad4fe5955bb tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:43.925358 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-10015527-e265-49ea-a03d-2ad4fe5955bb tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:43.925953 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-10015527-e265-49ea-a03d-2ad4fe5955bb tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:43.926449 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-10015527-e265-49ea-a03d-2ad4fe5955bb tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:43.989605 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-0763734f-5201-4bcc-8a78-fc6cf34a814d tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:44.011658 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-0763734f-5201-4bcc-8a78-fc6cf34a814d tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/8e670908-5bb6-49ad-92f3-dad1b4df1b5a" status: 200 len: 1316 microversion: 2.1 time: 0.600793 Sep 14 09:05:44.015859 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1890/3811] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:05:43 2022] GET /compute/v2.1/servers/8e670908-5bb6-49ad-92f3-dad1b4df1b5a => generated 1316 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:05:44.032724 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e0ca9d46-4dd0-473a-8853-75cb1145e5e8 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:44.040260 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e0ca9d46-4dd0-473a-8853-75cb1145e5e8 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] [instance: bb353760-fa41-4b09-a8c2-63b39e7d3639] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:05:44.149587 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-e0ca9d46-4dd0-473a-8853-75cb1145e5e8 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bda029c9974af09e83631e04459d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21195f8ae7b4267a128e890025c0b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:44.164768 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-e0ca9d46-4dd0-473a-8853-75cb1145e5e8 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55bda029c9974af09e83631e04459d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21195f8ae7b4267a128e890025c0b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:44.165726 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-e0ca9d46-4dd0-473a-8853-75cb1145e5e8 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55bda029c9974af09e83631e04459d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21195f8ae7b4267a128e890025c0b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:44.169949 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e0ca9d46-4dd0-473a-8853-75cb1145e5e8 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] 10.222.0.60 "GET /compute/v2.1/servers/bb353760-fa41-4b09-a8c2-63b39e7d3639" status: 200 len: 1280 microversion: 2.47 time: 0.145941 Sep 14 09:05:44.183094 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1891/3812] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:05:44 2022] GET /compute/v2.1/servers/bb353760-fa41-4b09-a8c2-63b39e7d3639 => generated 1280 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:05:44.214606 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d98f5b72-f66f-4305-80d4-26f5bdb2edd2 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:44.215260 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-d98f5b72-f66f-4305-80d4-26f5bdb2edd2 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] [instance: 1435eb10-e290-4e5c-9e16-4bbcc2cba6db] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:05:44.242041 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d98f5b72-f66f-4305-80d4-26f5bdb2edd2 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:44.242543 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d98f5b72-f66f-4305-80d4-26f5bdb2edd2 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:44.255860 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d98f5b72-f66f-4305-80d4-26f5bdb2edd2 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:44.258254 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d98f5b72-f66f-4305-80d4-26f5bdb2edd2 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:44.259245 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d98f5b72-f66f-4305-80d4-26f5bdb2edd2 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:44.259245 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d98f5b72-f66f-4305-80d4-26f5bdb2edd2 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:44.316002 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-d98f5b72-f66f-4305-80d4-26f5bdb2edd2 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] HTTP exception thrown: Instance 1435eb10-e290-4e5c-9e16-4bbcc2cba6db could not be found. Sep 14 09:05:44.318634 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d98f5b72-f66f-4305-80d4-26f5bdb2edd2 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Request method failure captured: Sep 14 09:05:44.318634 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/1435eb10-e290-4e5c-9e16-4bbcc2cba6db HTTP/1.1 Sep 14 09:05:44.318634 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:05:44.318634 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:05:44.318634 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:05:44.318634 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:05:44.318634 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:05:44.318634 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:05:44.318634 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:05:44.318634 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:05:44.318634 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZk5CcryJadxQNjGyTAJiFOJEcjuYnbHt_jebtn_mXakmWm_3QGD_sWy8UNE6zabfmn7bEY5bGgE6_SyNfMRsOLo301zILYv7E-dTA0iBIVflEnBP6EkqCVMYsrHF24azi19lfesNgYMyCLdIxpNRONa3k6TyfOvyp689qsv_zyjOlA Sep 14 09:05:44.318634 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:05:44.318634 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:05:44.318634 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:05:44.318634 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:05:44.318634 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:05:44.318634 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:05:44.318634 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: a358bdeb8c10424a8b70cc7b6c94e726 Sep 14 09:05:44.318634 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ListServersNegativeTestJSON-370517883 Sep 14 09:05:44.318634 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:05:44.318634 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:05:44.318634 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a358bdeb8c10424a8b70cc7b6c94e726"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a358bdeb8c10424a8b70cc7b6c94e726"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a358bdeb8c10424a8b70cc7b6c94e726"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a358bdeb8c10424a8b70cc7b6c94e726"}]}] Sep 14 09:05:44.318634 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ListServersNegativeTestJSON-370517883 Sep 14 09:05:44.318634 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: a358bdeb8c10424a8b70cc7b6c94e726 Sep 14 09:05:44.318634 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-370517883 Sep 14 09:05:44.318634 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ListServersNegativeTestJSON-370517883-project Sep 14 09:05:44.318634 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:05:44.318634 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:05:44.318634 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 02330887b6814bea8312e01103b0d2e9 Sep 14 09:05:44.318634 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ListServersNegativeTestJSON-370517883-project Sep 14 09:05:44.318634 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:05:44.318634 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance 1435eb10-e290-4e5c-9e16-4bbcc2cba6db could not be found. Sep 14 09:05:44.318634 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '1435eb10-e290-4e5c-9e16-4bbcc2cba6db'} Sep 14 09:05:44.318634 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:05:44.318634 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:05:44.318634 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:05:44.318634 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:05:44.318634 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:05:44.318634 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:05:44.318634 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:05:44.318634 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:05:44.318634 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:05:44.318634 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:05:44.318634 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1435eb10-e290-4e5c-9e16-4bbcc2cba6db could not be found. Sep 14 09:05:44.318634 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:05:44.318634 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:05:44.318634 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:05:44.318634 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:05:44.318634 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:05:44.318634 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:05:44.318634 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:05:44.318634 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:05:44.318634 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:05:44.318634 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:05:44.318634 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:05:44.318634 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:05:44.318634 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:05:44.318634 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:05:44.318634 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:05:44.318634 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:05:44.318634 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1435eb10-e290-4e5c-9e16-4bbcc2cba6db could not be found. Sep 14 09:05:44.318634 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:05:44.318634 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:05:44.328998 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:05:44.328998 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:05:44.328998 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:05:44.328998 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:05:44.328998 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:05:44.328998 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:05:44.328998 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1435eb10-e290-4e5c-9e16-4bbcc2cba6db could not be found. Sep 14 09:05:44.328998 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:05:44.328998 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d98f5b72-f66f-4305-80d4-26f5bdb2edd2 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Returning 404 to user: Instance 1435eb10-e290-4e5c-9e16-4bbcc2cba6db could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:05:44.328998 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d98f5b72-f66f-4305-80d4-26f5bdb2edd2 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] 10.222.0.60 "GET /compute/v2.1/servers/1435eb10-e290-4e5c-9e16-4bbcc2cba6db" status: 404 len: 111 microversion: 2.1 time: 0.148532 Sep 14 09:05:44.330657 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1892/3813] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:05:44 2022] GET /compute/v2.1/servers/1435eb10-e290-4e5c-9e16-4bbcc2cba6db => generated 111 bytes in 156 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:05:44.334455 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-2f2aece3-51ce-4cc2-844b-14a84fe40e5a tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '.version_select at 0x7f7d3ffb39d0>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:44.415043 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-10015527-e265-49ea-a03d-2ad4fe5955bb tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbdd3cee870d4fff8ddc3f215ea5a7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ab4c57f9f64f629c6b60663855766d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:44.424839 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-10015527-e265-49ea-a03d-2ad4fe5955bb tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbdd3cee870d4fff8ddc3f215ea5a7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ab4c57f9f64f629c6b60663855766d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:44.428129 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-10015527-e265-49ea-a03d-2ad4fe5955bb tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbdd3cee870d4fff8ddc3f215ea5a7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ab4c57f9f64f629c6b60663855766d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:44.433098 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-10015527-e265-49ea-a03d-2ad4fe5955bb tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] 10.222.0.60 "GET /compute/v2.1/servers/c45b2464-2a80-4ae9-a8f8-04687ff7acf7" status: 200 len: 1558 microversion: 2.21 time: 0.553298 Sep 14 09:05:44.438977 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1922/3814] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:05:43 2022] GET /compute/v2.1/servers/c45b2464-2a80-4ae9-a8f8-04687ff7acf7 => generated 1558 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:05:44.452465 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-af5ce427-0fb1-4546-8360-fbe347ab6847 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:44.453615 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-af5ce427-0fb1-4546-8360-fbe347ab6847 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:05:44.473416 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-2f2aece3-51ce-4cc2-844b-14a84fe40e5a tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute/v2.1/images/a62c47ed-e003-4adc-bdf0-222dc0068fa9" status: 200 len: 1414 microversion: 2.1 time: 0.142739 Sep 14 09:05:44.474137 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1893/3815] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:05:44 2022] GET /compute/v2.1/images/a62c47ed-e003-4adc-bdf0-222dc0068fa9 => generated 1414 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:05:44.479715 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8764041f-fda7-424c-a6ee-0bee23b65e6d tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:44.496735 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-af5ce427-0fb1-4546-8360-fbe347ab6847 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:44.497661 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-af5ce427-0fb1-4546-8360-fbe347ab6847 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:44.500098 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-af5ce427-0fb1-4546-8360-fbe347ab6847 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:44.500972 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-af5ce427-0fb1-4546-8360-fbe347ab6847 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:44.503227 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-af5ce427-0fb1-4546-8360-fbe347ab6847 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:44.508804 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-af5ce427-0fb1-4546-8360-fbe347ab6847 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:44.514618 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-8764041f-fda7-424c-a6ee-0bee23b65e6d tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '02330887b6814bea8312e01103b0d2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a358bdeb8c10424a8b70cc7b6c94e726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:44.532048 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-8764041f-fda7-424c-a6ee-0bee23b65e6d tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': 'a358bdeb8c10424a8b70cc7b6c94e726'} {{(pid=128759) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 14 09:05:44.570674 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8764041f-fda7-424c-a6ee-0bee23b65e6d tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:44.572747 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8764041f-fda7-424c-a6ee-0bee23b65e6d tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:44.574211 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8764041f-fda7-424c-a6ee-0bee23b65e6d tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:44.575535 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8764041f-fda7-424c-a6ee-0bee23b65e6d tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:44.581769 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8764041f-fda7-424c-a6ee-0bee23b65e6d tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:44.584881 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8764041f-fda7-424c-a6ee-0bee23b65e6d tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:44.728990 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-af5ce427-0fb1-4546-8360-fbe347ab6847 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:44.742502 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-af5ce427-0fb1-4546-8360-fbe347ab6847 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105" status: 200 len: 1309 microversion: 2.1 time: 0.299641 Sep 14 09:05:44.743400 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1923/3816] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:05:44 2022] GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105 => generated 1309 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:05:44.880249 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-8764041f-fda7-424c-a6ee-0bee23b65e6d tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] 10.222.0.60 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.404654 Sep 14 09:05:44.890367 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1894/3817] 10.222.0.60 () {58 vars in 1230 bytes} [Wed Sep 14 09:05:44 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 09:05:44.898805 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-036db3ba-c2fa-4af1-a68f-9217d0a8c131 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:44.903692 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-036db3ba-c2fa-4af1-a68f-9217d0a8c131 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Request method failure captured: Sep 14 09:05:44.903692 n-d-836830-18 devstack@n-api.service[128758]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Sep 14 09:05:44.903692 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 09:05:44.903692 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 09:05:44.903692 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 09:05:44.903692 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 09:05:44.903692 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 09:05:44.903692 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 09:05:44.903692 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 09:05:44.903692 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 09:05:44.903692 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZk5CcryJadxQNjGyTAJiFOJEcjuYnbHt_jebtn_mXakmWm_3QGD_sWy8UNE6zabfmn7bEY5bGgE6_SyNfMRsOLo301zILYv7E-dTA0iBIVflEnBP6EkqCVMYsrHF24azi19lfesNgYMyCLdIxpNRONa3k6TyfOvyp689qsv_zyjOlA Sep 14 09:05:44.903692 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 09:05:44.903692 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 09:05:44.903692 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 09:05:44.903692 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 09:05:44.903692 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 09:05:44.903692 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 09:05:44.903692 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: a358bdeb8c10424a8b70cc7b6c94e726 Sep 14 09:05:44.903692 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-ListServersNegativeTestJSON-370517883 Sep 14 09:05:44.903692 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 09:05:44.903692 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 09:05:44.903692 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a358bdeb8c10424a8b70cc7b6c94e726"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a358bdeb8c10424a8b70cc7b6c94e726"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a358bdeb8c10424a8b70cc7b6c94e726"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a358bdeb8c10424a8b70cc7b6c94e726"}]}] Sep 14 09:05:44.903692 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-ListServersNegativeTestJSON-370517883 Sep 14 09:05:44.903692 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: a358bdeb8c10424a8b70cc7b6c94e726 Sep 14 09:05:44.903692 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-370517883 Sep 14 09:05:44.903692 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-ListServersNegativeTestJSON-370517883-project Sep 14 09:05:44.903692 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 09:05:44.903692 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 09:05:44.903692 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 02330887b6814bea8312e01103b0d2e9 Sep 14 09:05:44.903692 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-ListServersNegativeTestJSON-370517883-project Sep 14 09:05:44.903692 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 09:05:44.903692 n-d-836830-18 devstack@n-api.service[128758]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Sep 14 09:05:44.903692 n-d-836830-18 devstack@n-api.service[128758]: action_args: {} Sep 14 09:05:44.903692 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:05:44.903692 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:05:44.903692 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 14 09:05:44.903692 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 14 09:05:44.903692 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 14 09:05:44.903692 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise error Sep 14 09:05:44.903692 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Sep 14 09:05:44.903692 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:05:44.903692 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Sep 14 09:05:44.903692 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Sep 14 09:05:44.903692 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:05:44.903692 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi On instance[0]: Sep 14 09:05:44.903692 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi '2011/01/01' Sep 14 09:05:44.903692 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:05:44.903692 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:05:44.903692 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:05:44.903692 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:05:44.903692 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:05:44.903692 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:05:44.903692 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:05:44.903692 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:05:44.903692 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:05:44.903692 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:05:44.903692 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 14 09:05:44.903692 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:05:44.903692 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 14 09:05:44.903692 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:05:44.903692 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 14 09:05:44.903692 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:05:44.903692 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 14 09:05:44.903692 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Sep 14 09:05:44.903692 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Sep 14 09:05:44.903692 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 14 09:05:44.909731 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 14 09:05:44.909731 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 14 09:05:44.909731 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 14 09:05:44.909731 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Sep 14 09:05:44.909731 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:05:44.909731 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:05:44.909731 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:05:44.909731 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:05:44.909731 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:05:44.909731 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:05:44.909731 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 14 09:05:44.909731 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 14 09:05:44.909731 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Sep 14 09:05:44.909731 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:05:44.909731 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-036db3ba-c2fa-4af1-a68f-9217d0a8c131 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:05:44.909731 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-036db3ba-c2fa-4af1-a68f-9217d0a8c131 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] 10.222.0.60 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.014008 Sep 14 09:05:44.916538 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1924/3818] 10.222.0.60 () {58 vars in 1182 bytes} [Wed Sep 14 09:05:44 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 14 09:05:44.926911 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8086b80d-3017-47ce-9151-68b4a085fe54 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:44.936242 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-8086b80d-3017-47ce-9151-68b4a085fe54 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '02330887b6814bea8312e01103b0d2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a358bdeb8c10424a8b70cc7b6c94e726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:44.937325 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-8086b80d-3017-47ce-9151-68b4a085fe54 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Searching by: {'deleted': False, 'project_id': 'a358bdeb8c10424a8b70cc7b6c94e726'} {{(pid=128759) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 14 09:05:44.947976 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8086b80d-3017-47ce-9151-68b4a085fe54 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:44.950970 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8086b80d-3017-47ce-9151-68b4a085fe54 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:44.955968 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8086b80d-3017-47ce-9151-68b4a085fe54 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:44.957101 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8086b80d-3017-47ce-9151-68b4a085fe54 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:44.962725 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8086b80d-3017-47ce-9151-68b4a085fe54 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:44.963299 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8086b80d-3017-47ce-9151-68b4a085fe54 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:45.105320 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-13f34f22-669e-40e4-8170-49ca70031b6d tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:45.110559 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-13f34f22-669e-40e4-8170-49ca70031b6d tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: 8e670908-5bb6-49ad-92f3-dad1b4df1b5a] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:05:45.170705 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-13f34f22-669e-40e4-8170-49ca70031b6d tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:45.172081 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-13f34f22-669e-40e4-8170-49ca70031b6d tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:45.178292 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-13f34f22-669e-40e4-8170-49ca70031b6d tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:45.182163 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-13f34f22-669e-40e4-8170-49ca70031b6d tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:45.182669 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-13f34f22-669e-40e4-8170-49ca70031b6d tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:45.198788 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-13f34f22-669e-40e4-8170-49ca70031b6d tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:45.247366 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.multi_cell_list [None req-8086b80d-3017-47ce-9151-68b4a085fe54 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128759) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 14 09:05:45.268263 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:05:45.290211 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-8086b80d-3017-47ce-9151-68b4a085fe54 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] 10.222.0.60 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.366838 Sep 14 09:05:45.307045 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1895/3819] 10.222.0.60 () {58 vars in 1125 bytes} [Wed Sep 14 09:05:44 2022] GET /compute/v2.1/servers => generated 681 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:05:45.321756 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-38300bd0-fdc3-473e-850d-643e90f11dd7 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:45.328377 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-38300bd0-fdc3-473e-850d-643e90f11dd7 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] [instance: bb353760-fa41-4b09-a8c2-63b39e7d3639] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:05:45.347975 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-38300bd0-fdc3-473e-850d-643e90f11dd7 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:45.348849 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-38300bd0-fdc3-473e-850d-643e90f11dd7 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:45.351696 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-38300bd0-fdc3-473e-850d-643e90f11dd7 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:45.352696 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-38300bd0-fdc3-473e-850d-643e90f11dd7 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:45.354284 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-38300bd0-fdc3-473e-850d-643e90f11dd7 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:45.356321 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-38300bd0-fdc3-473e-850d-643e90f11dd7 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:45.552503 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-38300bd0-fdc3-473e-850d-643e90f11dd7 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bda029c9974af09e83631e04459d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21195f8ae7b4267a128e890025c0b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:45.565117 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-38300bd0-fdc3-473e-850d-643e90f11dd7 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55bda029c9974af09e83631e04459d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21195f8ae7b4267a128e890025c0b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:45.566588 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-38300bd0-fdc3-473e-850d-643e90f11dd7 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55bda029c9974af09e83631e04459d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21195f8ae7b4267a128e890025c0b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:45.576296 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-38300bd0-fdc3-473e-850d-643e90f11dd7 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] 10.222.0.60 "GET /compute/v2.1/servers/bb353760-fa41-4b09-a8c2-63b39e7d3639" status: 200 len: 1276 microversion: 2.47 time: 0.264821 Sep 14 09:05:45.578308 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1896/3820] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:05:45 2022] GET /compute/v2.1/servers/bb353760-fa41-4b09-a8c2-63b39e7d3639 => generated 1276 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:05:45.632871 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-6dab018a-f815-4551-9ebd-b8cfaaee1348 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:45.646414 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-6dab018a-f815-4551-9ebd-b8cfaaee1348 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '02330887b6814bea8312e01103b0d2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a358bdeb8c10424a8b70cc7b6c94e726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:45.648850 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.compute.servers [None req-6dab018a-f815-4551-9ebd-b8cfaaee1348 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Removing options 'limit' from query {{(pid=128759) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Sep 14 09:05:45.650494 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-6dab018a-f815-4551-9ebd-b8cfaaee1348 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Searching by: {'deleted': False, 'project_id': 'a358bdeb8c10424a8b70cc7b6c94e726'} {{(pid=128759) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 14 09:05:45.660392 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6dab018a-f815-4551-9ebd-b8cfaaee1348 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:45.661257 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6dab018a-f815-4551-9ebd-b8cfaaee1348 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:45.662389 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6dab018a-f815-4551-9ebd-b8cfaaee1348 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:45.663454 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6dab018a-f815-4551-9ebd-b8cfaaee1348 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:45.664850 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6dab018a-f815-4551-9ebd-b8cfaaee1348 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:45.665504 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6dab018a-f815-4551-9ebd-b8cfaaee1348 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:45.698162 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.multi_cell_list [None req-6dab018a-f815-4551-9ebd-b8cfaaee1348 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=128759) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 14 09:05:45.700296 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-13f34f22-669e-40e4-8170-49ca70031b6d tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:45.721798 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-13f34f22-669e-40e4-8170-49ca70031b6d tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/8e670908-5bb6-49ad-92f3-dad1b4df1b5a" status: 200 len: 1316 microversion: 2.1 time: 0.680201 Sep 14 09:05:45.731111 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1925/3821] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:05:45 2022] GET /compute/v2.1/servers/8e670908-5bb6-49ad-92f3-dad1b4df1b5a => generated 1316 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:05:45.733641 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-35648b54-4546-42d6-8e8e-2cee4d6b5cff tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:45.736287 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-35648b54-4546-42d6-8e8e-2cee4d6b5cff tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] [instance: c45b2464-2a80-4ae9-a8f8-04687ff7acf7] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:05:45.752256 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-35648b54-4546-42d6-8e8e-2cee4d6b5cff tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:45.754052 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-35648b54-4546-42d6-8e8e-2cee4d6b5cff tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:45.755554 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-35648b54-4546-42d6-8e8e-2cee4d6b5cff tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:45.758379 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-35648b54-4546-42d6-8e8e-2cee4d6b5cff tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:45.759424 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-35648b54-4546-42d6-8e8e-2cee4d6b5cff tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:45.761196 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-35648b54-4546-42d6-8e8e-2cee4d6b5cff tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:45.763428 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-6dab018a-f815-4551-9ebd-b8cfaaee1348 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] 10.222.0.60 "GET /compute/v2.1/servers?limit=102" status: 200 len: 681 microversion: 2.1 time: 0.182492 Sep 14 09:05:45.765282 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1897/3822] 10.222.0.60 () {58 vars in 1144 bytes} [Wed Sep 14 09:05:45 2022] GET /compute/v2.1/servers?limit=102 => generated 681 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:05:45.770447 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a89a575c-46a8-4f49-9320-ec0aad511311 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '.version_select at 0x7f7d445cb4c0>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:45.795402 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:05:45.843165 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a89a575c-46a8-4f49-9320-ec0aad511311 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute/v2.1/images/a62c47ed-e003-4adc-bdf0-222dc0068fa9" status: 200 len: 1414 microversion: 2.1 time: 0.076581 Sep 14 09:05:45.844190 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1898/3823] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:05:45 2022] GET /compute/v2.1/images/a62c47ed-e003-4adc-bdf0-222dc0068fa9 => generated 1414 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:05:45.852998 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-c6a60def-ed0a-495a-9b73-e8a86cf89fc1 req-0036d8bd-9725-43c0-9b01-db2d2fb9bd8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e670908-5bb6-49ad-92f3-dad1b4df1b5a", "name": "network-vif-plugged", "status": "completed", "tag": "9c0d24b4-f3c7-444b-9f46-dff7b9217185"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:05:45.893038 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-c6a60def-ed0a-495a-9b73-e8a86cf89fc1 req-0036d8bd-9725-43c0-9b01-db2d2fb9bd8a service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:45.894389 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-c6a60def-ed0a-495a-9b73-e8a86cf89fc1 req-0036d8bd-9725-43c0-9b01-db2d2fb9bd8a service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:45.895073 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-c6a60def-ed0a-495a-9b73-e8a86cf89fc1 req-0036d8bd-9725-43c0-9b01-db2d2fb9bd8a service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:45.917156 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-c6a60def-ed0a-495a-9b73-e8a86cf89fc1 req-0036d8bd-9725-43c0-9b01-db2d2fb9bd8a service nova] Creating event network-vif-plugged:9c0d24b4-f3c7-444b-9f46-dff7b9217185 for instance 8e670908-5bb6-49ad-92f3-dad1b4df1b5a on n-h1-836830-18 Sep 14 09:05:45.940530 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-35648b54-4546-42d6-8e8e-2cee4d6b5cff tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbdd3cee870d4fff8ddc3f215ea5a7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ab4c57f9f64f629c6b60663855766d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:45.953123 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-35648b54-4546-42d6-8e8e-2cee4d6b5cff tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbdd3cee870d4fff8ddc3f215ea5a7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ab4c57f9f64f629c6b60663855766d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:45.954352 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-c6a60def-ed0a-495a-9b73-e8a86cf89fc1 req-0036d8bd-9725-43c0-9b01-db2d2fb9bd8a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108870 Sep 14 09:05:45.955343 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-35648b54-4546-42d6-8e8e-2cee4d6b5cff tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbdd3cee870d4fff8ddc3f215ea5a7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ab4c57f9f64f629c6b60663855766d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:45.955897 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1899/3824] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:05:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:05:45.958094 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-35648b54-4546-42d6-8e8e-2cee4d6b5cff tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] 10.222.0.60 "GET /compute/v2.1/servers/c45b2464-2a80-4ae9-a8f8-04687ff7acf7" status: 200 len: 1558 microversion: 2.21 time: 0.233913 Sep 14 09:05:45.959341 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1926/3825] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:05:45 2022] GET /compute/v2.1/servers/c45b2464-2a80-4ae9-a8f8-04687ff7acf7 => generated 1558 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:05:45.980526 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-57e250f0-fbc5-4784-945a-f6cd2e25b15e tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:45.981465 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ca792e29-e2ae-4fdb-98c2-59a91f514519 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:45.985590 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-57e250f0-fbc5-4784-945a-f6cd2e25b15e tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Request method failure captured: Sep 14 09:05:45.985590 n-d-836830-18 devstack@n-api.service[128758]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Sep 14 09:05:45.985590 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 09:05:45.985590 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 09:05:45.985590 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 09:05:45.985590 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 09:05:45.985590 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 09:05:45.985590 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 09:05:45.985590 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 09:05:45.985590 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 09:05:45.985590 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZk5CcryJadxQNjGyTAJiFOJEcjuYnbHt_jebtn_mXakmWm_3QGD_sWy8UNE6zabfmn7bEY5bGgE6_SyNfMRsOLo301zILYv7E-dTA0iBIVflEnBP6EkqCVMYsrHF24azi19lfesNgYMyCLdIxpNRONa3k6TyfOvyp689qsv_zyjOlA Sep 14 09:05:45.985590 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 09:05:45.985590 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 09:05:45.985590 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 09:05:45.985590 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 09:05:45.985590 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 09:05:45.985590 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 09:05:45.985590 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: a358bdeb8c10424a8b70cc7b6c94e726 Sep 14 09:05:45.985590 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-ListServersNegativeTestJSON-370517883 Sep 14 09:05:45.985590 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 09:05:45.985590 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 09:05:45.985590 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a358bdeb8c10424a8b70cc7b6c94e726"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a358bdeb8c10424a8b70cc7b6c94e726"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a358bdeb8c10424a8b70cc7b6c94e726"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a358bdeb8c10424a8b70cc7b6c94e726"}]}] Sep 14 09:05:45.985590 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-ListServersNegativeTestJSON-370517883 Sep 14 09:05:45.985590 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: a358bdeb8c10424a8b70cc7b6c94e726 Sep 14 09:05:45.985590 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-370517883 Sep 14 09:05:45.985590 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-ListServersNegativeTestJSON-370517883-project Sep 14 09:05:45.985590 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 09:05:45.985590 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 09:05:45.985590 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 02330887b6814bea8312e01103b0d2e9 Sep 14 09:05:45.985590 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-ListServersNegativeTestJSON-370517883-project Sep 14 09:05:45.985590 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 09:05:45.985590 n-d-836830-18 devstack@n-api.service[128758]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Sep 14 09:05:45.985590 n-d-836830-18 devstack@n-api.service[128758]: action_args: {} Sep 14 09:05:45.985590 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:05:45.985590 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:05:45.985590 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 14 09:05:45.985590 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 14 09:05:45.985590 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 14 09:05:45.985590 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise error Sep 14 09:05:45.985590 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Sep 14 09:05:45.985590 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:05:45.985590 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Sep 14 09:05:45.985590 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi {'minLength': 1, Sep 14 09:05:45.985590 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi 'minimum': 0, Sep 14 09:05:45.985590 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Sep 14 09:05:45.985590 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Sep 14 09:05:45.985590 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:05:45.985590 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi On instance[0]: Sep 14 09:05:45.985590 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi '-1' Sep 14 09:05:45.985590 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:05:45.985590 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:05:45.985590 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:05:45.985590 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:05:45.985590 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:05:45.985590 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:05:45.985590 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:05:45.985590 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:05:45.985590 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:05:45.985590 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:05:45.985590 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 14 09:05:45.985590 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:05:45.985590 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 14 09:05:45.985590 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:05:45.985590 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 14 09:05:45.985590 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:05:45.985590 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 14 09:05:45.985590 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Sep 14 09:05:45.985590 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Sep 14 09:05:45.990761 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 14 09:05:45.990761 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 14 09:05:45.990761 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 14 09:05:45.990761 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 14 09:05:45.990761 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Sep 14 09:05:45.990761 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:05:45.990761 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:05:45.990761 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:05:45.990761 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:05:45.990761 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:05:45.990761 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:05:45.990761 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 14 09:05:45.990761 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 14 09:05:45.990761 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Sep 14 09:05:45.990761 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:05:45.995225 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-57e250f0-fbc5-4784-945a-f6cd2e25b15e tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:05:45.996306 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-57e250f0-fbc5-4784-945a-f6cd2e25b15e tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] 10.222.0.60 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.035734 Sep 14 09:05:45.997225 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1927/3826] 10.222.0.60 () {58 vars in 1142 bytes} [Wed Sep 14 09:05:45 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 14 09:05:46.000096 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-ca792e29-e2ae-4fdb-98c2-59a91f514519 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:05:46.012592 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1b90a7bc-d818-4952-9895-5323b8e26a12 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:46.014948 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ca792e29-e2ae-4fdb-98c2-59a91f514519 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:46.015911 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ca792e29-e2ae-4fdb-98c2-59a91f514519 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:46.020128 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1b90a7bc-d818-4952-9895-5323b8e26a12 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Request method failure captured: Sep 14 09:05:46.020128 n-d-836830-18 devstack@n-api.service[128758]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Sep 14 09:05:46.020128 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 09:05:46.020128 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 09:05:46.020128 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 09:05:46.020128 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 09:05:46.020128 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 09:05:46.020128 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 09:05:46.020128 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 09:05:46.020128 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 09:05:46.020128 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZk5CcryJadxQNjGyTAJiFOJEcjuYnbHt_jebtn_mXakmWm_3QGD_sWy8UNE6zabfmn7bEY5bGgE6_SyNfMRsOLo301zILYv7E-dTA0iBIVflEnBP6EkqCVMYsrHF24azi19lfesNgYMyCLdIxpNRONa3k6TyfOvyp689qsv_zyjOlA Sep 14 09:05:46.020128 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 09:05:46.020128 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 09:05:46.020128 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 09:05:46.020128 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 09:05:46.020128 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 09:05:46.020128 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 09:05:46.020128 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: a358bdeb8c10424a8b70cc7b6c94e726 Sep 14 09:05:46.020128 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-ListServersNegativeTestJSON-370517883 Sep 14 09:05:46.020128 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 09:05:46.020128 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 09:05:46.020128 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a358bdeb8c10424a8b70cc7b6c94e726"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a358bdeb8c10424a8b70cc7b6c94e726"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a358bdeb8c10424a8b70cc7b6c94e726"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a358bdeb8c10424a8b70cc7b6c94e726"}]}] Sep 14 09:05:46.020128 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-ListServersNegativeTestJSON-370517883 Sep 14 09:05:46.020128 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: a358bdeb8c10424a8b70cc7b6c94e726 Sep 14 09:05:46.020128 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-370517883 Sep 14 09:05:46.020128 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-ListServersNegativeTestJSON-370517883-project Sep 14 09:05:46.020128 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 09:05:46.020128 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 09:05:46.020128 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 02330887b6814bea8312e01103b0d2e9 Sep 14 09:05:46.020128 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-ListServersNegativeTestJSON-370517883-project Sep 14 09:05:46.020128 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 09:05:46.020128 n-d-836830-18 devstack@n-api.service[128758]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Sep 14 09:05:46.020128 n-d-836830-18 devstack@n-api.service[128758]: action_args: {} Sep 14 09:05:46.020128 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:05:46.020128 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:05:46.020128 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 14 09:05:46.020128 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 14 09:05:46.020128 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 14 09:05:46.020128 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise error Sep 14 09:05:46.020128 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Sep 14 09:05:46.020128 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:05:46.020128 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Sep 14 09:05:46.020128 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi {'minLength': 1, Sep 14 09:05:46.020128 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi 'minimum': 0, Sep 14 09:05:46.020128 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Sep 14 09:05:46.020128 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Sep 14 09:05:46.020128 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:05:46.020128 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi On instance[0]: Sep 14 09:05:46.020128 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi 'testing' Sep 14 09:05:46.020128 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:05:46.020128 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:05:46.020128 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:05:46.020128 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:05:46.020128 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:05:46.020128 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:05:46.020128 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:05:46.020128 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:05:46.020128 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:05:46.020128 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:05:46.020128 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 14 09:05:46.020128 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:05:46.020128 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 14 09:05:46.020128 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:05:46.020128 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 14 09:05:46.020128 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:05:46.020128 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 14 09:05:46.020128 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Sep 14 09:05:46.020128 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Sep 14 09:05:46.027263 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 14 09:05:46.027263 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 14 09:05:46.027263 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 14 09:05:46.027263 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 14 09:05:46.027263 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Sep 14 09:05:46.027263 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:05:46.027263 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:05:46.027263 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:05:46.027263 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:05:46.027263 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:05:46.027263 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:05:46.027263 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 14 09:05:46.027263 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 14 09:05:46.027263 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Sep 14 09:05:46.027263 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:05:46.027263 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1b90a7bc-d818-4952-9895-5323b8e26a12 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:05:46.027263 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-1b90a7bc-d818-4952-9895-5323b8e26a12 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] 10.222.0.60 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.016594 Sep 14 09:05:46.029082 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1928/3827] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Sep 14 09:05:46 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 14 09:05:46.032492 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ca792e29-e2ae-4fdb-98c2-59a91f514519 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:46.039853 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ca792e29-e2ae-4fdb-98c2-59a91f514519 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:46.040264 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-2e589fa0-de73-4586-abf9-b8b85c1cbfe0 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:46.040876 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ca792e29-e2ae-4fdb-98c2-59a91f514519 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:46.041537 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ca792e29-e2ae-4fdb-98c2-59a91f514519 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:46.078171 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-2e589fa0-de73-4586-abf9-b8b85c1cbfe0 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '02330887b6814bea8312e01103b0d2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a358bdeb8c10424a8b70cc7b6c94e726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:46.083632 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-2e589fa0-de73-4586-abf9-b8b85c1cbfe0 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': 'a358bdeb8c10424a8b70cc7b6c94e726'} {{(pid=128758) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 14 09:05:46.095950 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.compute.servers [None req-2e589fa0-de73-4586-abf9-b8b85c1cbfe0 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Flavor 'non_existing_flavor' could not be found {{(pid=128758) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Sep 14 09:05:46.097364 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-2e589fa0-de73-4586-abf9-b8b85c1cbfe0 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] 10.222.0.60 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.066112 Sep 14 09:05:46.100591 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1929/3828] 10.222.0.60 () {58 vars in 1178 bytes} [Wed Sep 14 09:05:46 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 09:05:46.119605 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-831daa14-a655-470b-b8a1-0ab0ac87e7b3 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:46.124938 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-831daa14-a655-470b-b8a1-0ab0ac87e7b3 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '02330887b6814bea8312e01103b0d2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a358bdeb8c10424a8b70cc7b6c94e726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:46.125604 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-831daa14-a655-470b-b8a1-0ab0ac87e7b3 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': 'a358bdeb8c10424a8b70cc7b6c94e726'} {{(pid=128758) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 14 09:05:46.160926 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-831daa14-a655-470b-b8a1-0ab0ac87e7b3 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:46.161423 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-831daa14-a655-470b-b8a1-0ab0ac87e7b3 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:46.161869 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-831daa14-a655-470b-b8a1-0ab0ac87e7b3 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:46.162608 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-831daa14-a655-470b-b8a1-0ab0ac87e7b3 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:46.177766 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-831daa14-a655-470b-b8a1-0ab0ac87e7b3 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:46.179170 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-831daa14-a655-470b-b8a1-0ab0ac87e7b3 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:46.235451 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-ca792e29-e2ae-4fdb-98c2-59a91f514519 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:46.248232 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-ca792e29-e2ae-4fdb-98c2-59a91f514519 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105" status: 200 len: 1297 microversion: 2.1 time: 0.283175 Sep 14 09:05:46.248846 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1900/3829] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:05:45 2022] GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105 => generated 1297 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:05:46.484932 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-831daa14-a655-470b-b8a1-0ab0ac87e7b3 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] 10.222.0.60 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.373419 Sep 14 09:05:46.492440 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1930/3830] 10.222.0.60 () {58 vars in 1174 bytes} [Wed Sep 14 09:05:46 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 09:05:46.508192 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-cae948f8-0b27-4aa4-add8-c46fd31713e7 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:46.518020 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-cae948f8-0b27-4aa4-add8-c46fd31713e7 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '02330887b6814bea8312e01103b0d2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a358bdeb8c10424a8b70cc7b6c94e726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:46.520218 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-cae948f8-0b27-4aa4-add8-c46fd31713e7 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': 'a358bdeb8c10424a8b70cc7b6c94e726'} {{(pid=128759) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 14 09:05:46.546091 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cae948f8-0b27-4aa4-add8-c46fd31713e7 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:46.546611 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cae948f8-0b27-4aa4-add8-c46fd31713e7 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:46.550516 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cae948f8-0b27-4aa4-add8-c46fd31713e7 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:46.552344 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cae948f8-0b27-4aa4-add8-c46fd31713e7 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:46.581691 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cae948f8-0b27-4aa4-add8-c46fd31713e7 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:46.582351 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cae948f8-0b27-4aa4-add8-c46fd31713e7 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:46.608939 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-436f3536-3bcf-4bbc-90b1-60872348e0b0 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:46.609573 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-436f3536-3bcf-4bbc-90b1-60872348e0b0 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] [instance: bb353760-fa41-4b09-a8c2-63b39e7d3639] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:05:46.618761 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-436f3536-3bcf-4bbc-90b1-60872348e0b0 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:46.624781 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-436f3536-3bcf-4bbc-90b1-60872348e0b0 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:46.625242 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-436f3536-3bcf-4bbc-90b1-60872348e0b0 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:46.625991 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-436f3536-3bcf-4bbc-90b1-60872348e0b0 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:46.626465 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-436f3536-3bcf-4bbc-90b1-60872348e0b0 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:46.626903 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-436f3536-3bcf-4bbc-90b1-60872348e0b0 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:46.691968 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-cae948f8-0b27-4aa4-add8-c46fd31713e7 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] 10.222.0.60 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.189459 Sep 14 09:05:46.692577 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1901/3831] 10.222.0.60 () {58 vars in 1184 bytes} [Wed Sep 14 09:05:46 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 09:05:46.714699 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-aa6dcb7a-a4ed-4e69-bb5a-27846c92ea93 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:46.726653 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-aa6dcb7a-a4ed-4e69-bb5a-27846c92ea93 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '02330887b6814bea8312e01103b0d2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a358bdeb8c10424a8b70cc7b6c94e726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:46.729625 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-aa6dcb7a-a4ed-4e69-bb5a-27846c92ea93 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Searching by: {'deleted': False, 'project_id': 'a358bdeb8c10424a8b70cc7b6c94e726'} {{(pid=128759) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 14 09:05:46.742694 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-aa6dcb7a-a4ed-4e69-bb5a-27846c92ea93 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:46.745258 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-aa6dcb7a-a4ed-4e69-bb5a-27846c92ea93 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:46.745712 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-aa6dcb7a-a4ed-4e69-bb5a-27846c92ea93 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:46.748807 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-aa6dcb7a-a4ed-4e69-bb5a-27846c92ea93 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:46.752273 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-aa6dcb7a-a4ed-4e69-bb5a-27846c92ea93 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:46.752812 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-aa6dcb7a-a4ed-4e69-bb5a-27846c92ea93 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:46.802364 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-436f3536-3bcf-4bbc-90b1-60872348e0b0 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bda029c9974af09e83631e04459d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21195f8ae7b4267a128e890025c0b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:46.813591 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-436f3536-3bcf-4bbc-90b1-60872348e0b0 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55bda029c9974af09e83631e04459d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21195f8ae7b4267a128e890025c0b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:46.816111 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-436f3536-3bcf-4bbc-90b1-60872348e0b0 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55bda029c9974af09e83631e04459d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21195f8ae7b4267a128e890025c0b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:46.817542 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-436f3536-3bcf-4bbc-90b1-60872348e0b0 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] 10.222.0.60 "GET /compute/v2.1/servers/bb353760-fa41-4b09-a8c2-63b39e7d3639" status: 200 len: 1338 microversion: 2.47 time: 0.213514 Sep 14 09:05:46.818591 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1931/3832] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:05:46 2022] GET /compute/v2.1/servers/bb353760-fa41-4b09-a8c2-63b39e7d3639 => generated 1338 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 09:05:46.824496 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-051841f8-c6d2-41a4-96eb-562d9d059e55 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:46.825607 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-051841f8-c6d2-41a4-96eb-562d9d059e55 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: 8e670908-5bb6-49ad-92f3-dad1b4df1b5a] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:05:46.832692 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-051841f8-c6d2-41a4-96eb-562d9d059e55 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:46.833462 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-051841f8-c6d2-41a4-96eb-562d9d059e55 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:46.834323 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-051841f8-c6d2-41a4-96eb-562d9d059e55 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:46.835370 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-051841f8-c6d2-41a4-96eb-562d9d059e55 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:46.836210 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-051841f8-c6d2-41a4-96eb-562d9d059e55 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:46.837065 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-051841f8-c6d2-41a4-96eb-562d9d059e55 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:46.856483 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.multi_cell_list [None req-aa6dcb7a-a4ed-4e69-bb5a-27846c92ea93 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128759) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 14 09:05:47.025486 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-aa6dcb7a-a4ed-4e69-bb5a-27846c92ea93 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02330887b6814bea8312e01103b0d2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a358bdeb8c10424a8b70cc7b6c94e726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:47.064934 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-aa6dcb7a-a4ed-4e69-bb5a-27846c92ea93 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:47.068391 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-aa6dcb7a-a4ed-4e69-bb5a-27846c92ea93 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:47.069727 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-aa6dcb7a-a4ed-4e69-bb5a-27846c92ea93 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:47.124815 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-051841f8-c6d2-41a4-96eb-562d9d059e55 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:47.143243 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-051841f8-c6d2-41a4-96eb-562d9d059e55 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/8e670908-5bb6-49ad-92f3-dad1b4df1b5a" status: 200 len: 1316 microversion: 2.1 time: 0.323276 Sep 14 09:05:47.160663 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1932/3833] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:05:46 2022] GET /compute/v2.1/servers/8e670908-5bb6-49ad-92f3-dad1b4df1b5a => generated 1316 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:05:47.183292 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a461a3cc-5564-4bed-9907-8e07b15c814f tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '.version_select at 0x7f7d44610160>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:47.291634 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-a461a3cc-5564-4bed-9907-8e07b15c814f tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute/v2.1/images/a62c47ed-e003-4adc-bdf0-222dc0068fa9" status: 200 len: 1414 microversion: 2.1 time: 0.126471 Sep 14 09:05:47.292618 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1933/3834] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:05:47 2022] GET /compute/v2.1/images/a62c47ed-e003-4adc-bdf0-222dc0068fa9 => generated 1414 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:05:47.316522 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1147d9a9-ba3e-4206-b3f4-05dc9e5a0085 tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:47.317429 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-1147d9a9-ba3e-4206-b3f4-05dc9e5a0085 tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] [instance: c45b2464-2a80-4ae9-a8f8-04687ff7acf7] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:05:47.348176 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1147d9a9-ba3e-4206-b3f4-05dc9e5a0085 tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:47.359167 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1147d9a9-ba3e-4206-b3f4-05dc9e5a0085 tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:47.360191 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1147d9a9-ba3e-4206-b3f4-05dc9e5a0085 tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:47.363414 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1147d9a9-ba3e-4206-b3f4-05dc9e5a0085 tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:47.364173 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1147d9a9-ba3e-4206-b3f4-05dc9e5a0085 tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:47.364872 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1147d9a9-ba3e-4206-b3f4-05dc9e5a0085 tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:47.466289 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1147d9a9-ba3e-4206-b3f4-05dc9e5a0085 tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:47.466977 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1147d9a9-ba3e-4206-b3f4-05dc9e5a0085 tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:47.470820 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1147d9a9-ba3e-4206-b3f4-05dc9e5a0085 tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:47.471363 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.objects.instance [None req-1147d9a9-ba3e-4206-b3f4-05dc9e5a0085 tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Lazy-loading 'fault' on Instance uuid c45b2464-2a80-4ae9-a8f8-04687ff7acf7 {{(pid=128758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:05:47.551013 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-aa6dcb7a-a4ed-4e69-bb5a-27846c92ea93 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] 10.222.0.60 "GET /compute/v2.1/servers/detail" status: 200 len: 3021 microversion: 2.1 time: 0.847061 Sep 14 09:05:47.552354 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1902/3835] 10.222.0.60 () {58 vars in 1146 bytes} [Wed Sep 14 09:05:46 2022] GET /compute/v2.1/servers/detail => generated 3021 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:05:47.577474 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-abc087d1-5717-45b4-a77f-de402e4e87c8 req-00eb1a85-8a40-4b66-9137-a35d889f2f4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c45b2464-2a80-4ae9-a8f8-04687ff7acf7", "name": "network-vif-deleted", "tag": "5373aeda-0911-463b-ac42-79834c452c1d"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:05:47.606187 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-abc087d1-5717-45b4-a77f-de402e4e87c8 req-00eb1a85-8a40-4b66-9137-a35d889f2f4d service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:47.606774 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-abc087d1-5717-45b4-a77f-de402e4e87c8 req-00eb1a85-8a40-4b66-9137-a35d889f2f4d service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:47.607143 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-abc087d1-5717-45b4-a77f-de402e4e87c8 req-00eb1a85-8a40-4b66-9137-a35d889f2f4d service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:47.679884 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-1147d9a9-ba3e-4206-b3f4-05dc9e5a0085 tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbdd3cee870d4fff8ddc3f215ea5a7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ab4c57f9f64f629c6b60663855766d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:47.686800 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-abc087d1-5717-45b4-a77f-de402e4e87c8 req-00eb1a85-8a40-4b66-9137-a35d889f2f4d service nova] Creating event network-vif-deleted:5373aeda-0911-463b-ac42-79834c452c1d for instance c45b2464-2a80-4ae9-a8f8-04687ff7acf7 on n-h2-836830-18 Sep 14 09:05:47.692311 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-1147d9a9-ba3e-4206-b3f4-05dc9e5a0085 tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbdd3cee870d4fff8ddc3f215ea5a7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ab4c57f9f64f629c6b60663855766d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:47.693791 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-1147d9a9-ba3e-4206-b3f4-05dc9e5a0085 tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbdd3cee870d4fff8ddc3f215ea5a7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ab4c57f9f64f629c6b60663855766d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:47.711823 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-1147d9a9-ba3e-4206-b3f4-05dc9e5a0085 tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] 10.222.0.60 "GET /compute/v2.1/servers/c45b2464-2a80-4ae9-a8f8-04687ff7acf7" status: 200 len: 1349 microversion: 2.21 time: 0.407274 Sep 14 09:05:47.716351 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1934/3836] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:05:47 2022] GET /compute/v2.1/servers/c45b2464-2a80-4ae9-a8f8-04687ff7acf7 => generated 1349 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:05:47.726774 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-abc087d1-5717-45b4-a77f-de402e4e87c8 req-00eb1a85-8a40-4b66-9137-a35d889f2f4d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.170250 Sep 14 09:05:47.728136 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-df15562d-12cc-44d7-b293-ba14e273d08e tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:47.730677 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1903/3837] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:05:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:05:47.731606 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-df15562d-12cc-44d7-b293-ba14e273d08e tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:05:47.746622 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-df15562d-12cc-44d7-b293-ba14e273d08e tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:47.748925 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-df15562d-12cc-44d7-b293-ba14e273d08e tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:47.749571 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-df15562d-12cc-44d7-b293-ba14e273d08e tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:47.752486 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-df15562d-12cc-44d7-b293-ba14e273d08e tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:47.753160 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-df15562d-12cc-44d7-b293-ba14e273d08e tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:47.753850 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-df15562d-12cc-44d7-b293-ba14e273d08e tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:47.755992 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a21665fe-c580-4334-86b9-95a31f5c91cb tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:47.767994 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-a21665fe-c580-4334-86b9-95a31f5c91cb tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '02330887b6814bea8312e01103b0d2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a358bdeb8c10424a8b70cc7b6c94e726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:47.769495 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a21665fe-c580-4334-86b9-95a31f5c91cb tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] 10.222.0.60 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.032777 Sep 14 09:05:47.770803 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1904/3838] 10.222.0.60 () {58 vars in 1178 bytes} [Wed Sep 14 09:05:47 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 09:05:47.793048 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b636ccdb-5869-4095-a425-71476d527fc5 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:47.805119 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b636ccdb-5869-4095-a425-71476d527fc5 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '02330887b6814bea8312e01103b0d2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a358bdeb8c10424a8b70cc7b6c94e726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:47.809684 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b636ccdb-5869-4095-a425-71476d527fc5 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Searching by: {'deleted': False, 'project_id': 'a358bdeb8c10424a8b70cc7b6c94e726'} {{(pid=128759) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 14 09:05:47.826666 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b636ccdb-5869-4095-a425-71476d527fc5 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:47.828133 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b636ccdb-5869-4095-a425-71476d527fc5 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:47.832502 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b636ccdb-5869-4095-a425-71476d527fc5 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:47.833991 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b636ccdb-5869-4095-a425-71476d527fc5 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:47.837580 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b636ccdb-5869-4095-a425-71476d527fc5 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:47.838392 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b636ccdb-5869-4095-a425-71476d527fc5 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:47.923179 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.multi_cell_list [None req-b636ccdb-5869-4095-a425-71476d527fc5 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128759) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 14 09:05:47.969370 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-df15562d-12cc-44d7-b293-ba14e273d08e tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:47.980098 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-df15562d-12cc-44d7-b293-ba14e273d08e tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105" status: 200 len: 1364 microversion: 2.1 time: 0.261613 Sep 14 09:05:47.981444 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1935/3839] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:05:47 2022] GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105 => generated 1364 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:05:47.988844 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b636ccdb-5869-4095-a425-71476d527fc5 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] 10.222.0.60 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.208404 Sep 14 09:05:47.990262 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1905/3840] 10.222.0.60 () {58 vars in 1125 bytes} [Wed Sep 14 09:05:47 2022] GET /compute/v2.1/servers => generated 681 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:05:47.998894 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-6eb9cd42-1ed6-438c-8a47-21a70e5c5a31 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:47.999580 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-6eb9cd42-1ed6-438c-8a47-21a70e5c5a31 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] [instance: bb353760-fa41-4b09-a8c2-63b39e7d3639] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:05:48.019704 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6eb9cd42-1ed6-438c-8a47-21a70e5c5a31 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:48.020180 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6eb9cd42-1ed6-438c-8a47-21a70e5c5a31 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:48.020912 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6eb9cd42-1ed6-438c-8a47-21a70e5c5a31 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:48.021867 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6eb9cd42-1ed6-438c-8a47-21a70e5c5a31 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:48.022501 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6eb9cd42-1ed6-438c-8a47-21a70e5c5a31 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:48.024483 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6eb9cd42-1ed6-438c-8a47-21a70e5c5a31 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:48.024679 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-085d99ae-3d39-4354-a7f4-f3900f271db4 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:48.026870 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-085d99ae-3d39-4354-a7f4-f3900f271db4 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] [instance: 1435eb10-e290-4e5c-9e16-4bbcc2cba6db] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:05:48.036560 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-085d99ae-3d39-4354-a7f4-f3900f271db4 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:48.038649 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-085d99ae-3d39-4354-a7f4-f3900f271db4 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:48.040036 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-085d99ae-3d39-4354-a7f4-f3900f271db4 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:48.041151 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-085d99ae-3d39-4354-a7f4-f3900f271db4 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:48.041935 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-085d99ae-3d39-4354-a7f4-f3900f271db4 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:48.042610 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-085d99ae-3d39-4354-a7f4-f3900f271db4 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:48.098279 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-085d99ae-3d39-4354-a7f4-f3900f271db4 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] HTTP exception thrown: Instance 1435eb10-e290-4e5c-9e16-4bbcc2cba6db could not be found. Sep 14 09:05:48.105151 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-085d99ae-3d39-4354-a7f4-f3900f271db4 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Request method failure captured: Sep 14 09:05:48.105151 n-d-836830-18 devstack@n-api.service[128759]: request: DELETE /compute/v2.1/servers/1435eb10-e290-4e5c-9e16-4bbcc2cba6db HTTP/1.1 Sep 14 09:05:48.105151 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:05:48.105151 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:05:48.105151 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:05:48.105151 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:05:48.105151 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:05:48.105151 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:05:48.105151 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:05:48.105151 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:05:48.105151 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZk5CcryJadxQNjGyTAJiFOJEcjuYnbHt_jebtn_mXakmWm_3QGD_sWy8UNE6zabfmn7bEY5bGgE6_SyNfMRsOLo301zILYv7E-dTA0iBIVflEnBP6EkqCVMYsrHF24azi19lfesNgYMyCLdIxpNRONa3k6TyfOvyp689qsv_zyjOlA Sep 14 09:05:48.105151 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:05:48.105151 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:05:48.105151 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:05:48.105151 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:05:48.105151 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:05:48.105151 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:05:48.105151 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: a358bdeb8c10424a8b70cc7b6c94e726 Sep 14 09:05:48.105151 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ListServersNegativeTestJSON-370517883 Sep 14 09:05:48.105151 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:05:48.105151 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:05:48.105151 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a358bdeb8c10424a8b70cc7b6c94e726"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a358bdeb8c10424a8b70cc7b6c94e726"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a358bdeb8c10424a8b70cc7b6c94e726"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a358bdeb8c10424a8b70cc7b6c94e726"}]}] Sep 14 09:05:48.105151 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ListServersNegativeTestJSON-370517883 Sep 14 09:05:48.105151 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: a358bdeb8c10424a8b70cc7b6c94e726 Sep 14 09:05:48.105151 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-370517883 Sep 14 09:05:48.105151 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ListServersNegativeTestJSON-370517883-project Sep 14 09:05:48.105151 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:05:48.105151 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:05:48.105151 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 02330887b6814bea8312e01103b0d2e9 Sep 14 09:05:48.105151 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ListServersNegativeTestJSON-370517883-project Sep 14 09:05:48.105151 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:05:48.105151 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance 1435eb10-e290-4e5c-9e16-4bbcc2cba6db could not be found. Sep 14 09:05:48.105151 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '1435eb10-e290-4e5c-9e16-4bbcc2cba6db'} Sep 14 09:05:48.105151 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:05:48.105151 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:05:48.105151 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:05:48.105151 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:05:48.105151 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:05:48.105151 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:05:48.105151 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:05:48.105151 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:05:48.105151 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:05:48.105151 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:05:48.105151 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1435eb10-e290-4e5c-9e16-4bbcc2cba6db could not be found. Sep 14 09:05:48.105151 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:05:48.105151 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:05:48.105151 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:05:48.105151 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:05:48.105151 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:05:48.105151 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:05:48.105151 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:05:48.105151 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:05:48.105151 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:05:48.105151 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:05:48.105151 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 09:05:48.105151 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 09:05:48.105151 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 09:05:48.105151 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 09:05:48.105151 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:05:48.105151 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:05:48.105151 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:05:48.105151 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:05:48.109912 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1435eb10-e290-4e5c-9e16-4bbcc2cba6db could not be found. Sep 14 09:05:48.109912 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:05:48.109912 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:05:48.109912 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:05:48.109912 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:05:48.109912 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:05:48.109912 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:05:48.109912 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:05:48.109912 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:05:48.109912 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1435eb10-e290-4e5c-9e16-4bbcc2cba6db could not be found. Sep 14 09:05:48.109912 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:05:48.115359 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-085d99ae-3d39-4354-a7f4-f3900f271db4 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Returning 404 to user: Instance 1435eb10-e290-4e5c-9e16-4bbcc2cba6db could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:05:48.118450 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-085d99ae-3d39-4354-a7f4-f3900f271db4 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] 10.222.0.60 "DELETE /compute/v2.1/servers/1435eb10-e290-4e5c-9e16-4bbcc2cba6db" status: 404 len: 111 microversion: 2.1 time: 0.106582 Sep 14 09:05:48.126400 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1906/3841] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:05:48 2022] DELETE /compute/v2.1/servers/1435eb10-e290-4e5c-9e16-4bbcc2cba6db => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 14 09:05:48.138463 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a8e4bd0d-1fd7-4b88-9d4f-3bf2577e7cb1 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:48.140598 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-a8e4bd0d-1fd7-4b88-9d4f-3bf2577e7cb1 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] [instance: 136e2cad-31c9-4c0a-93ae-b6de98a41f8b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:05:48.159506 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a8e4bd0d-1fd7-4b88-9d4f-3bf2577e7cb1 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:48.161892 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a8e4bd0d-1fd7-4b88-9d4f-3bf2577e7cb1 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:48.166523 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a8e4bd0d-1fd7-4b88-9d4f-3bf2577e7cb1 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:48.167835 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a8e4bd0d-1fd7-4b88-9d4f-3bf2577e7cb1 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:48.168619 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a8e4bd0d-1fd7-4b88-9d4f-3bf2577e7cb1 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:48.169438 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a8e4bd0d-1fd7-4b88-9d4f-3bf2577e7cb1 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:48.193503 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-6eb9cd42-1ed6-438c-8a47-21a70e5c5a31 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bda029c9974af09e83631e04459d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21195f8ae7b4267a128e890025c0b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:48.204206 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-6eb9cd42-1ed6-438c-8a47-21a70e5c5a31 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55bda029c9974af09e83631e04459d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21195f8ae7b4267a128e890025c0b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:48.223779 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-a8e4bd0d-1fd7-4b88-9d4f-3bf2577e7cb1 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] [instance: 136e2cad-31c9-4c0a-93ae-b6de98a41f8b] Going to try to terminate instance {{(pid=128759) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:05:48.233107 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-6eb9cd42-1ed6-438c-8a47-21a70e5c5a31 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55bda029c9974af09e83631e04459d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21195f8ae7b4267a128e890025c0b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:48.237538 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-6eb9cd42-1ed6-438c-8a47-21a70e5c5a31 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] 10.222.0.60 "GET /compute/v2.1/servers/bb353760-fa41-4b09-a8c2-63b39e7d3639" status: 200 len: 1338 microversion: 2.47 time: 0.253778 Sep 14 09:05:48.240451 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1936/3842] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:05:47 2022] GET /compute/v2.1/servers/bb353760-fa41-4b09-a8c2-63b39e7d3639 => generated 1338 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:05:48.256401 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-9222a286-f4bd-4c71-8cfe-1b5e1d17a660 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:48.258180 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-9222a286-f4bd-4c71-8cfe-1b5e1d17a660 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: 8e670908-5bb6-49ad-92f3-dad1b4df1b5a] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:05:48.277934 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9222a286-f4bd-4c71-8cfe-1b5e1d17a660 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:48.278526 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9222a286-f4bd-4c71-8cfe-1b5e1d17a660 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:48.281330 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9222a286-f4bd-4c71-8cfe-1b5e1d17a660 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:48.282432 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9222a286-f4bd-4c71-8cfe-1b5e1d17a660 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:48.284335 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9222a286-f4bd-4c71-8cfe-1b5e1d17a660 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:48.285532 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9222a286-f4bd-4c71-8cfe-1b5e1d17a660 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:48.379232 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a8e4bd0d-1fd7-4b88-9d4f-3bf2577e7cb1 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] 10.222.0.60 "DELETE /compute/v2.1/servers/136e2cad-31c9-4c0a-93ae-b6de98a41f8b" status: 204 len: 0 microversion: 2.1 time: 0.249926 Sep 14 09:05:48.380494 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1907/3843] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:05:48 2022] DELETE /compute/v2.1/servers/136e2cad-31c9-4c0a-93ae-b6de98a41f8b => generated 0 bytes in 253 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:05:48.396835 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b70dcb6d-6eb5-4a34-bb56-4a8ca5f62155 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '.version_select at 0x7f7d44a69b80>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:48.502373 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b70dcb6d-6eb5-4a34-bb56-4a8ca5f62155 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute/v2.1/images/a62c47ed-e003-4adc-bdf0-222dc0068fa9" status: 200 len: 1414 microversion: 2.1 time: 0.120469 Sep 14 09:05:48.503913 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1908/3844] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:05:48 2022] GET /compute/v2.1/images/a62c47ed-e003-4adc-bdf0-222dc0068fa9 => generated 1414 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:05:48.514378 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3656049e-46d1-43f6-b291-616799aba70f tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:48.518253 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-3656049e-46d1-43f6-b291-616799aba70f tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] [instance: 05cc41b4-ace4-4d14-90ed-ad19af43e268] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:05:48.537899 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3656049e-46d1-43f6-b291-616799aba70f tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:48.544960 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3656049e-46d1-43f6-b291-616799aba70f tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:48.547446 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3656049e-46d1-43f6-b291-616799aba70f tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:48.548906 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3656049e-46d1-43f6-b291-616799aba70f tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:48.551548 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3656049e-46d1-43f6-b291-616799aba70f tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:48.552554 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3656049e-46d1-43f6-b291-616799aba70f tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:48.568639 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-9222a286-f4bd-4c71-8cfe-1b5e1d17a660 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:48.579499 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-9222a286-f4bd-4c71-8cfe-1b5e1d17a660 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/8e670908-5bb6-49ad-92f3-dad1b4df1b5a" status: 200 len: 1506 microversion: 2.1 time: 0.336187 Sep 14 09:05:48.595538 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1937/3845] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:05:48 2022] GET /compute/v2.1/servers/8e670908-5bb6-49ad-92f3-dad1b4df1b5a => generated 1506 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:05:48.603947 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-fca766fd-7819-4de8-90e5-80988987c744 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:48.604747 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-fca766fd-7819-4de8-90e5-80988987c744 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: 8e670908-5bb6-49ad-92f3-dad1b4df1b5a] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:05:48.611485 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fca766fd-7819-4de8-90e5-80988987c744 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:48.612209 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fca766fd-7819-4de8-90e5-80988987c744 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:48.612938 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fca766fd-7819-4de8-90e5-80988987c744 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:48.613823 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fca766fd-7819-4de8-90e5-80988987c744 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:48.614485 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fca766fd-7819-4de8-90e5-80988987c744 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:48.615201 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fca766fd-7819-4de8-90e5-80988987c744 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:48.663454 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-fca766fd-7819-4de8-90e5-80988987c744 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: 8e670908-5bb6-49ad-92f3-dad1b4df1b5a] Going to try to terminate instance {{(pid=128758) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:05:48.672664 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-3656049e-46d1-43f6-b291-616799aba70f tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] [instance: 05cc41b4-ace4-4d14-90ed-ad19af43e268] Going to try to terminate instance {{(pid=128759) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:05:48.842505 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-3656049e-46d1-43f6-b291-616799aba70f tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] 10.222.0.60 "DELETE /compute/v2.1/servers/05cc41b4-ace4-4d14-90ed-ad19af43e268" status: 204 len: 0 microversion: 2.1 time: 0.336767 Sep 14 09:05:48.842760 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-fca766fd-7819-4de8-90e5-80988987c744 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "DELETE /compute/v2.1/servers/8e670908-5bb6-49ad-92f3-dad1b4df1b5a" status: 204 len: 0 microversion: 2.1 time: 0.227774 Sep 14 09:05:48.843412 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1938/3846] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:05:48 2022] DELETE /compute/v2.1/servers/8e670908-5bb6-49ad-92f3-dad1b4df1b5a => generated 0 bytes in 244 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 14 09:05:48.847457 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1909/3847] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:05:48 2022] DELETE /compute/v2.1/servers/05cc41b4-ace4-4d14-90ed-ad19af43e268 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:05:48.864803 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-127d21c4-7467-4afa-89c4-2dad704c0dd2 tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:48.865446 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-127d21c4-7467-4afa-89c4-2dad704c0dd2 tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] [instance: c45b2464-2a80-4ae9-a8f8-04687ff7acf7] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:05:48.866600 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-6a08919a-93ae-4041-9fcd-da03b866d323 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:48.868126 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-6a08919a-93ae-4041-9fcd-da03b866d323 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: 8e670908-5bb6-49ad-92f3-dad1b4df1b5a] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:05:48.876658 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6a08919a-93ae-4041-9fcd-da03b866d323 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:48.880829 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-127d21c4-7467-4afa-89c4-2dad704c0dd2 tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:48.881338 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-127d21c4-7467-4afa-89c4-2dad704c0dd2 tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:48.881876 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-127d21c4-7467-4afa-89c4-2dad704c0dd2 tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:48.882535 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-127d21c4-7467-4afa-89c4-2dad704c0dd2 tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:48.883310 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-127d21c4-7467-4afa-89c4-2dad704c0dd2 tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:48.884328 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-127d21c4-7467-4afa-89c4-2dad704c0dd2 tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:48.889611 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6a08919a-93ae-4041-9fcd-da03b866d323 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:48.890486 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6a08919a-93ae-4041-9fcd-da03b866d323 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:48.892455 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6a08919a-93ae-4041-9fcd-da03b866d323 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:48.893449 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6a08919a-93ae-4041-9fcd-da03b866d323 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:48.894161 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6a08919a-93ae-4041-9fcd-da03b866d323 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:48.916454 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-127d21c4-7467-4afa-89c4-2dad704c0dd2 tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] HTTP exception thrown: Instance c45b2464-2a80-4ae9-a8f8-04687ff7acf7 could not be found. Sep 14 09:05:48.928848 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-127d21c4-7467-4afa-89c4-2dad704c0dd2 tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Request method failure captured: Sep 14 09:05:48.928848 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/c45b2464-2a80-4ae9-a8f8-04687ff7acf7 HTTP/1.1 Sep 14 09:05:48.928848 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:05:48.928848 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:05:48.928848 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:05:48.928848 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:05:48.928848 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:05:48.928848 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:05:48.928848 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:05:48.928848 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:05:48.928848 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZlO0OtKE265rwYkmlqoHdVKTw_I2c0rRwx7J01SYPQCT_8Rta_p4i0TMXDI_C1mu0Qt90eR_TtPPN0pCTsgRtY3yPFn9CZy23cYSXXZtCQMOOSqlkwGCEsuehdWeIt9cKjoVdkQFjlUeYE9u8vE6IZM1U5-IODHcB2TOgDNR7psfe4 Sep 14 09:05:48.928848 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:05:48.928848 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:05:48.928848 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:05:48.928848 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:05:48.928848 n-d-836830-18 devstack@n-api.service[128759]: X-Openstack-Nova-Api-Version: 2.21 Sep 14 09:05:48.928848 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:05:48.928848 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:05:48.928848 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 32ab4c57f9f64f629c6b60663855766d Sep 14 09:05:48.928848 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1770363541 Sep 14 09:05:48.928848 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:05:48.928848 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:05:48.928848 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/32ab4c57f9f64f629c6b60663855766d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_32ab4c57f9f64f629c6b60663855766d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/32ab4c57f9f64f629c6b60663855766d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/32ab4c57f9f64f629c6b60663855766d"}]}] Sep 14 09:05:48.928848 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-InstanceActionsV221TestJSON-1770363541 Sep 14 09:05:48.928848 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 32ab4c57f9f64f629c6b60663855766d Sep 14 09:05:48.928848 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1770363541 Sep 14 09:05:48.928848 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-InstanceActionsV221TestJSON-1770363541-project Sep 14 09:05:48.928848 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:05:48.928848 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:05:48.928848 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: dbdd3cee870d4fff8ddc3f215ea5a7cf Sep 14 09:05:48.928848 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-InstanceActionsV221TestJSON-1770363541-project Sep 14 09:05:48.928848 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:05:48.928848 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance c45b2464-2a80-4ae9-a8f8-04687ff7acf7 could not be found. Sep 14 09:05:48.928848 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': 'c45b2464-2a80-4ae9-a8f8-04687ff7acf7'} Sep 14 09:05:48.928848 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:05:48.928848 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:05:48.928848 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:05:48.928848 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:05:48.928848 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:05:48.928848 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:05:48.928848 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:05:48.928848 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:05:48.928848 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:05:48.928848 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:05:48.928848 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c45b2464-2a80-4ae9-a8f8-04687ff7acf7 could not be found. Sep 14 09:05:48.928848 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:05:48.928848 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:05:48.928848 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:05:48.928848 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:05:48.928848 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:05:48.928848 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:05:48.928848 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:05:48.928848 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:05:48.928848 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:05:48.928848 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:05:48.928848 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:05:48.928848 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:05:48.928848 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:05:48.928848 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:05:48.928848 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:05:48.928848 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:05:48.928848 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c45b2464-2a80-4ae9-a8f8-04687ff7acf7 could not be found. Sep 14 09:05:48.928848 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:05:48.928848 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:05:48.935482 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:05:48.935482 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:05:48.935482 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:05:48.935482 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:05:48.935482 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:05:48.935482 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:05:48.935482 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c45b2464-2a80-4ae9-a8f8-04687ff7acf7 could not be found. Sep 14 09:05:48.935482 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:05:48.939919 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-127d21c4-7467-4afa-89c4-2dad704c0dd2 tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Returning 404 to user: Instance c45b2464-2a80-4ae9-a8f8-04687ff7acf7 could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:05:48.943985 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-127d21c4-7467-4afa-89c4-2dad704c0dd2 tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] 10.222.0.60 "GET /compute/v2.1/servers/c45b2464-2a80-4ae9-a8f8-04687ff7acf7" status: 404 len: 111 microversion: 2.21 time: 0.095125 Sep 14 09:05:48.944836 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1910/3848] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:05:48 2022] GET /compute/v2.1/servers/c45b2464-2a80-4ae9-a8f8-04687ff7acf7 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 14 09:05:48.952921 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-47262291-3003-4aeb-8efb-e1b9b393b4f4 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:48.956187 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-47262291-3003-4aeb-8efb-e1b9b393b4f4 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] [instance: 1435eb10-e290-4e5c-9e16-4bbcc2cba6db] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:05:48.967796 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-47262291-3003-4aeb-8efb-e1b9b393b4f4 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:48.973711 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-47262291-3003-4aeb-8efb-e1b9b393b4f4 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:48.975367 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-47262291-3003-4aeb-8efb-e1b9b393b4f4 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:48.977119 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-47262291-3003-4aeb-8efb-e1b9b393b4f4 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:48.980071 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-47262291-3003-4aeb-8efb-e1b9b393b4f4 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:48.980788 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-47262291-3003-4aeb-8efb-e1b9b393b4f4 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:49.017492 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-47262291-3003-4aeb-8efb-e1b9b393b4f4 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] HTTP exception thrown: Instance 1435eb10-e290-4e5c-9e16-4bbcc2cba6db could not be found. Sep 14 09:05:49.019138 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-47262291-3003-4aeb-8efb-e1b9b393b4f4 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Request method failure captured: Sep 14 09:05:49.019138 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/1435eb10-e290-4e5c-9e16-4bbcc2cba6db HTTP/1.1 Sep 14 09:05:49.019138 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:05:49.019138 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:05:49.019138 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:05:49.019138 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:05:49.019138 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:05:49.019138 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:05:49.019138 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:05:49.019138 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:05:49.019138 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZk5CcryJadxQNjGyTAJiFOJEcjuYnbHt_jebtn_mXakmWm_3QGD_sWy8UNE6zabfmn7bEY5bGgE6_SyNfMRsOLo301zILYv7E-dTA0iBIVflEnBP6EkqCVMYsrHF24azi19lfesNgYMyCLdIxpNRONa3k6TyfOvyp689qsv_zyjOlA Sep 14 09:05:49.019138 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:05:49.019138 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:05:49.019138 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:05:49.019138 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:05:49.019138 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:05:49.019138 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:05:49.019138 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: a358bdeb8c10424a8b70cc7b6c94e726 Sep 14 09:05:49.019138 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ListServersNegativeTestJSON-370517883 Sep 14 09:05:49.019138 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:05:49.019138 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:05:49.019138 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a358bdeb8c10424a8b70cc7b6c94e726"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a358bdeb8c10424a8b70cc7b6c94e726"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a358bdeb8c10424a8b70cc7b6c94e726"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a358bdeb8c10424a8b70cc7b6c94e726"}]}] Sep 14 09:05:49.019138 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ListServersNegativeTestJSON-370517883 Sep 14 09:05:49.019138 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: a358bdeb8c10424a8b70cc7b6c94e726 Sep 14 09:05:49.019138 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-370517883 Sep 14 09:05:49.019138 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ListServersNegativeTestJSON-370517883-project Sep 14 09:05:49.019138 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:05:49.019138 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:05:49.019138 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 02330887b6814bea8312e01103b0d2e9 Sep 14 09:05:49.019138 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ListServersNegativeTestJSON-370517883-project Sep 14 09:05:49.019138 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:05:49.019138 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance 1435eb10-e290-4e5c-9e16-4bbcc2cba6db could not be found. Sep 14 09:05:49.019138 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '1435eb10-e290-4e5c-9e16-4bbcc2cba6db'} Sep 14 09:05:49.019138 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:05:49.019138 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:05:49.019138 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:05:49.019138 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:05:49.019138 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:05:49.019138 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:05:49.019138 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:05:49.019138 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:05:49.019138 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:05:49.019138 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:05:49.019138 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1435eb10-e290-4e5c-9e16-4bbcc2cba6db could not be found. Sep 14 09:05:49.019138 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:05:49.019138 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:05:49.019138 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:05:49.019138 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:05:49.019138 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:05:49.019138 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:05:49.019138 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:05:49.019138 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:05:49.019138 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:05:49.019138 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:05:49.019138 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:05:49.019138 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:05:49.019138 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:05:49.019138 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:05:49.019138 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:05:49.019138 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:05:49.019138 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1435eb10-e290-4e5c-9e16-4bbcc2cba6db could not be found. Sep 14 09:05:49.019138 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:05:49.019138 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:05:49.025562 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:05:49.025562 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:05:49.025562 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:05:49.025562 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:05:49.025562 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:05:49.025562 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:05:49.025562 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1435eb10-e290-4e5c-9e16-4bbcc2cba6db could not be found. Sep 14 09:05:49.025562 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:05:49.025562 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-47262291-3003-4aeb-8efb-e1b9b393b4f4 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Returning 404 to user: Instance 1435eb10-e290-4e5c-9e16-4bbcc2cba6db could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:05:49.025562 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-47262291-3003-4aeb-8efb-e1b9b393b4f4 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] 10.222.0.60 "GET /compute/v2.1/servers/1435eb10-e290-4e5c-9e16-4bbcc2cba6db" status: 404 len: 111 microversion: 2.1 time: 0.071922 Sep 14 09:05:49.038968 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1911/3849] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:05:48 2022] GET /compute/v2.1/servers/1435eb10-e290-4e5c-9e16-4bbcc2cba6db => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:05:49.050751 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a10dfd38-9c9d-4036-805e-18eee615d290 tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Calling method '.version_select at 0x7f7d3ffc50d0>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:49.051375 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-a10dfd38-9c9d-4036-805e-18eee615d290 tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] [instance: c45b2464-2a80-4ae9-a8f8-04687ff7acf7] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:05:49.068343 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a10dfd38-9c9d-4036-805e-18eee615d290 tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:49.069214 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a10dfd38-9c9d-4036-805e-18eee615d290 tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:49.070650 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a10dfd38-9c9d-4036-805e-18eee615d290 tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:49.071589 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a10dfd38-9c9d-4036-805e-18eee615d290 tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:49.072363 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a10dfd38-9c9d-4036-805e-18eee615d290 tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:49.072970 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a10dfd38-9c9d-4036-805e-18eee615d290 tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:49.096556 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-6a08919a-93ae-4041-9fcd-da03b866d323 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:49.107345 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-6a08919a-93ae-4041-9fcd-da03b866d323 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/8e670908-5bb6-49ad-92f3-dad1b4df1b5a" status: 200 len: 1512 microversion: 2.1 time: 0.250880 Sep 14 09:05:49.113918 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1939/3850] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:05:48 2022] GET /compute/v2.1/servers/8e670908-5bb6-49ad-92f3-dad1b4df1b5a => generated 1512 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:05:49.141499 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-82078c9b-5bad-4116-b26b-f8bce5fc492d tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:49.144448 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-82078c9b-5bad-4116-b26b-f8bce5fc492d tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:05:49.166650 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-82078c9b-5bad-4116-b26b-f8bce5fc492d tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:49.167346 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-82078c9b-5bad-4116-b26b-f8bce5fc492d tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:49.168699 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-82078c9b-5bad-4116-b26b-f8bce5fc492d tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:49.171175 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-82078c9b-5bad-4116-b26b-f8bce5fc492d tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:49.172322 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-82078c9b-5bad-4116-b26b-f8bce5fc492d tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:49.175501 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-82078c9b-5bad-4116-b26b-f8bce5fc492d tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:49.190579 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a10dfd38-9c9d-4036-805e-18eee615d290 tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] 10.222.0.60 "GET /compute/v2.1/servers/c45b2464-2a80-4ae9-a8f8-04687ff7acf7/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.150380 Sep 14 09:05:49.199367 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1912/3851] 10.222.0.60 () {60 vars in 1337 bytes} [Wed Sep 14 09:05:49 2022] GET /compute/v2.1/servers/c45b2464-2a80-4ae9-a8f8-04687ff7acf7/os-instance-actions => generated 611 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 09:05:49.211356 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-554b6eb2-c123-4a7d-9570-6607da2d5bf0 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:49.212004 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-554b6eb2-c123-4a7d-9570-6607da2d5bf0 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] [instance: 136e2cad-31c9-4c0a-93ae-b6de98a41f8b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:05:49.235948 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-554b6eb2-c123-4a7d-9570-6607da2d5bf0 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:49.236511 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-554b6eb2-c123-4a7d-9570-6607da2d5bf0 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:49.239158 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-554b6eb2-c123-4a7d-9570-6607da2d5bf0 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:49.241174 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-554b6eb2-c123-4a7d-9570-6607da2d5bf0 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:49.247296 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-554b6eb2-c123-4a7d-9570-6607da2d5bf0 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:49.247296 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-554b6eb2-c123-4a7d-9570-6607da2d5bf0 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:49.644567 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-82078c9b-5bad-4116-b26b-f8bce5fc492d tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:49.659543 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-82078c9b-5bad-4116-b26b-f8bce5fc492d tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105" status: 200 len: 1364 microversion: 2.1 time: 0.530093 Sep 14 09:05:49.674235 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1940/3852] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:05:49 2022] GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105 => generated 1364 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:05:49.681526 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-554b6eb2-c123-4a7d-9570-6607da2d5bf0 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02330887b6814bea8312e01103b0d2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a358bdeb8c10424a8b70cc7b6c94e726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:49.684450 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-4000bd35-3247-4636-9e28-c7257f837d24 tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:49.686547 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-4000bd35-3247-4636-9e28-c7257f837d24 tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] [instance: c45b2464-2a80-4ae9-a8f8-04687ff7acf7] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:05:49.690284 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-554b6eb2-c123-4a7d-9570-6607da2d5bf0 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] 10.222.0.60 "GET /compute/v2.1/servers/136e2cad-31c9-4c0a-93ae-b6de98a41f8b" status: 200 len: 1520 microversion: 2.1 time: 0.489410 Sep 14 09:05:49.695408 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4000bd35-3247-4636-9e28-c7257f837d24 tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:49.695921 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4000bd35-3247-4636-9e28-c7257f837d24 tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:49.696430 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4000bd35-3247-4636-9e28-c7257f837d24 tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:49.697291 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4000bd35-3247-4636-9e28-c7257f837d24 tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:49.698388 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4000bd35-3247-4636-9e28-c7257f837d24 tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:49.699111 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4000bd35-3247-4636-9e28-c7257f837d24 tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:49.699570 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1913/3853] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:05:49 2022] GET /compute/v2.1/servers/136e2cad-31c9-4c0a-93ae-b6de98a41f8b => generated 1520 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:05:49.720518 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-51022a78-9e95-461f-b6f4-e311b842122a tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:49.721468 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-51022a78-9e95-461f-b6f4-e311b842122a tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] [instance: bb353760-fa41-4b09-a8c2-63b39e7d3639] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:05:49.721790 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-4000bd35-3247-4636-9e28-c7257f837d24 tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] HTTP exception thrown: Instance c45b2464-2a80-4ae9-a8f8-04687ff7acf7 could not be found. Sep 14 09:05:49.730542 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-4000bd35-3247-4636-9e28-c7257f837d24 tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Request method failure captured: Sep 14 09:05:49.730542 n-d-836830-18 devstack@n-api.service[128758]: request: DELETE /compute/v2.1/servers/c45b2464-2a80-4ae9-a8f8-04687ff7acf7 HTTP/1.1 Sep 14 09:05:49.730542 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 09:05:49.730542 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 09:05:49.730542 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 09:05:49.730542 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 09:05:49.730542 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 09:05:49.730542 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 09:05:49.730542 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 09:05:49.730542 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 09:05:49.730542 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZlO0OtKE265rwYkmlqoHdVKTw_I2c0rRwx7J01SYPQCT_8Rta_p4i0TMXDI_C1mu0Qt90eR_TtPPN0pCTsgRtY3yPFn9CZy23cYSXXZtCQMOOSqlkwGCEsuehdWeIt9cKjoVdkQFjlUeYE9u8vE6IZM1U5-IODHcB2TOgDNR7psfe4 Sep 14 09:05:49.730542 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 09:05:49.730542 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 09:05:49.730542 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 09:05:49.730542 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 09:05:49.730542 n-d-836830-18 devstack@n-api.service[128758]: X-Openstack-Nova-Api-Version: 2.21 Sep 14 09:05:49.730542 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 09:05:49.730542 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 09:05:49.730542 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 32ab4c57f9f64f629c6b60663855766d Sep 14 09:05:49.730542 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1770363541 Sep 14 09:05:49.730542 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 09:05:49.730542 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 09:05:49.730542 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/32ab4c57f9f64f629c6b60663855766d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_32ab4c57f9f64f629c6b60663855766d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/32ab4c57f9f64f629c6b60663855766d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/32ab4c57f9f64f629c6b60663855766d"}]}] Sep 14 09:05:49.730542 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-InstanceActionsV221TestJSON-1770363541 Sep 14 09:05:49.730542 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 32ab4c57f9f64f629c6b60663855766d Sep 14 09:05:49.730542 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1770363541 Sep 14 09:05:49.730542 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-InstanceActionsV221TestJSON-1770363541-project Sep 14 09:05:49.730542 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 09:05:49.730542 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 09:05:49.730542 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: dbdd3cee870d4fff8ddc3f215ea5a7cf Sep 14 09:05:49.730542 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-InstanceActionsV221TestJSON-1770363541-project Sep 14 09:05:49.730542 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 09:05:49.730542 n-d-836830-18 devstack@n-api.service[128758]: exception: Instance c45b2464-2a80-4ae9-a8f8-04687ff7acf7 could not be found. Sep 14 09:05:49.730542 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': 'c45b2464-2a80-4ae9-a8f8-04687ff7acf7'} Sep 14 09:05:49.730542 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:05:49.730542 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:05:49.730542 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:05:49.730542 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:05:49.730542 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:05:49.730542 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:05:49.730542 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:05:49.730542 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:05:49.730542 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:05:49.730542 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:05:49.730542 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c45b2464-2a80-4ae9-a8f8-04687ff7acf7 could not be found. Sep 14 09:05:49.730542 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:05:49.730542 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:05:49.730542 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:05:49.730542 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:05:49.730542 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:05:49.730542 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:05:49.730542 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:05:49.730542 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:05:49.730542 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:05:49.730542 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:05:49.730542 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 09:05:49.730542 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 09:05:49.730542 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 09:05:49.730542 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 09:05:49.730542 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:05:49.730542 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:05:49.730542 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:05:49.730542 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:05:49.735517 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c45b2464-2a80-4ae9-a8f8-04687ff7acf7 could not be found. Sep 14 09:05:49.735517 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:05:49.735517 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:05:49.735517 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:05:49.735517 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:05:49.735517 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:05:49.735517 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:05:49.735517 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:05:49.735517 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:05:49.735517 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c45b2464-2a80-4ae9-a8f8-04687ff7acf7 could not be found. Sep 14 09:05:49.735517 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:05:49.736462 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-4000bd35-3247-4636-9e28-c7257f837d24 tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Returning 404 to user: Instance c45b2464-2a80-4ae9-a8f8-04687ff7acf7 could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:05:49.736790 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-4000bd35-3247-4636-9e28-c7257f837d24 tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] 10.222.0.60 "DELETE /compute/v2.1/servers/c45b2464-2a80-4ae9-a8f8-04687ff7acf7" status: 404 len: 111 microversion: 2.21 time: 0.060280 Sep 14 09:05:49.737954 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1941/3854] 10.222.0.60 () {60 vars in 1280 bytes} [Wed Sep 14 09:05:49 2022] DELETE /compute/v2.1/servers/c45b2464-2a80-4ae9-a8f8-04687ff7acf7 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 14 09:05:49.748778 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-51022a78-9e95-461f-b6f4-e311b842122a tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:49.749873 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-51022a78-9e95-461f-b6f4-e311b842122a tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:49.752079 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-44d1885e-b866-4ce5-baca-f68beda5b8af tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '.version_select at 0x7f7d443ae310>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:49.752360 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-51022a78-9e95-461f-b6f4-e311b842122a tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:49.753291 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-51022a78-9e95-461f-b6f4-e311b842122a tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:49.755541 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-51022a78-9e95-461f-b6f4-e311b842122a tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:49.756145 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-51022a78-9e95-461f-b6f4-e311b842122a tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:49.821471 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:05:49.827420 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-44d1885e-b866-4ce5-baca-f68beda5b8af tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute/v2.1/images/a62c47ed-e003-4adc-bdf0-222dc0068fa9" status: 200 len: 1414 microversion: 2.1 time: 0.081848 Sep 14 09:05:49.829459 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1942/3855] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:05:49 2022] GET /compute/v2.1/images/a62c47ed-e003-4adc-bdf0-222dc0068fa9 => generated 1414 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:05:49.845160 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1ef08bf5-0319-461c-909c-46e7dc5b86fa tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:49.847812 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-1ef08bf5-0319-461c-909c-46e7dc5b86fa tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] [instance: c45b2464-2a80-4ae9-a8f8-04687ff7acf7] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:05:49.871042 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1ef08bf5-0319-461c-909c-46e7dc5b86fa tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:49.882235 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1ef08bf5-0319-461c-909c-46e7dc5b86fa tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:49.883411 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1ef08bf5-0319-461c-909c-46e7dc5b86fa tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:49.884280 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1ef08bf5-0319-461c-909c-46e7dc5b86fa tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:49.884854 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1ef08bf5-0319-461c-909c-46e7dc5b86fa tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:49.885450 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1ef08bf5-0319-461c-909c-46e7dc5b86fa tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:49.893450 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-51022a78-9e95-461f-b6f4-e311b842122a tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bda029c9974af09e83631e04459d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21195f8ae7b4267a128e890025c0b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:49.905816 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-51022a78-9e95-461f-b6f4-e311b842122a tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55bda029c9974af09e83631e04459d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21195f8ae7b4267a128e890025c0b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:49.907340 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-51022a78-9e95-461f-b6f4-e311b842122a tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55bda029c9974af09e83631e04459d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21195f8ae7b4267a128e890025c0b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:49.909178 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-51022a78-9e95-461f-b6f4-e311b842122a tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] 10.222.0.60 "GET /compute/v2.1/servers/bb353760-fa41-4b09-a8c2-63b39e7d3639" status: 200 len: 1338 microversion: 2.47 time: 0.207509 Sep 14 09:05:49.910679 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1914/3856] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:05:49 2022] GET /compute/v2.1/servers/bb353760-fa41-4b09-a8c2-63b39e7d3639 => generated 1338 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:05:49.911827 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-1ef08bf5-0319-461c-909c-46e7dc5b86fa tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] HTTP exception thrown: Instance c45b2464-2a80-4ae9-a8f8-04687ff7acf7 could not be found. Sep 14 09:05:49.915863 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1ef08bf5-0319-461c-909c-46e7dc5b86fa tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Request method failure captured: Sep 14 09:05:49.915863 n-d-836830-18 devstack@n-api.service[128758]: request: GET /compute/v2.1/servers/c45b2464-2a80-4ae9-a8f8-04687ff7acf7 HTTP/1.1 Sep 14 09:05:49.915863 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 09:05:49.915863 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 09:05:49.915863 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 09:05:49.915863 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 09:05:49.915863 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 09:05:49.915863 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 09:05:49.915863 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 09:05:49.915863 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 09:05:49.915863 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZlO0OtKE265rwYkmlqoHdVKTw_I2c0rRwx7J01SYPQCT_8Rta_p4i0TMXDI_C1mu0Qt90eR_TtPPN0pCTsgRtY3yPFn9CZy23cYSXXZtCQMOOSqlkwGCEsuehdWeIt9cKjoVdkQFjlUeYE9u8vE6IZM1U5-IODHcB2TOgDNR7psfe4 Sep 14 09:05:49.915863 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 09:05:49.915863 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 09:05:49.915863 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 09:05:49.915863 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 09:05:49.915863 n-d-836830-18 devstack@n-api.service[128758]: X-Openstack-Nova-Api-Version: 2.21 Sep 14 09:05:49.915863 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 09:05:49.915863 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 09:05:49.915863 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 32ab4c57f9f64f629c6b60663855766d Sep 14 09:05:49.915863 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1770363541 Sep 14 09:05:49.915863 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 09:05:49.915863 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 09:05:49.915863 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/32ab4c57f9f64f629c6b60663855766d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_32ab4c57f9f64f629c6b60663855766d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/32ab4c57f9f64f629c6b60663855766d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/32ab4c57f9f64f629c6b60663855766d"}]}] Sep 14 09:05:49.915863 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-InstanceActionsV221TestJSON-1770363541 Sep 14 09:05:49.915863 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 32ab4c57f9f64f629c6b60663855766d Sep 14 09:05:49.915863 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1770363541 Sep 14 09:05:49.915863 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-InstanceActionsV221TestJSON-1770363541-project Sep 14 09:05:49.915863 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 09:05:49.915863 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 09:05:49.915863 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: dbdd3cee870d4fff8ddc3f215ea5a7cf Sep 14 09:05:49.915863 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-InstanceActionsV221TestJSON-1770363541-project Sep 14 09:05:49.915863 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 09:05:49.915863 n-d-836830-18 devstack@n-api.service[128758]: exception: Instance c45b2464-2a80-4ae9-a8f8-04687ff7acf7 could not be found. Sep 14 09:05:49.915863 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': 'c45b2464-2a80-4ae9-a8f8-04687ff7acf7'} Sep 14 09:05:49.915863 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:05:49.915863 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:05:49.915863 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:05:49.915863 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:05:49.915863 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:05:49.915863 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:05:49.915863 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:05:49.915863 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:05:49.915863 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:05:49.915863 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:05:49.915863 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c45b2464-2a80-4ae9-a8f8-04687ff7acf7 could not be found. Sep 14 09:05:49.915863 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:05:49.915863 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:05:49.915863 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:05:49.915863 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:05:49.915863 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:05:49.915863 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:05:49.915863 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:05:49.915863 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:05:49.915863 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:05:49.915863 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:05:49.915863 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:05:49.915863 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:05:49.915863 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:05:49.915863 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:05:49.915863 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:05:49.915863 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:05:49.915863 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c45b2464-2a80-4ae9-a8f8-04687ff7acf7 could not be found. Sep 14 09:05:49.915863 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:05:49.915863 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:05:49.923680 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:05:49.923680 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:05:49.923680 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:05:49.923680 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:05:49.923680 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:05:49.923680 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:05:49.923680 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c45b2464-2a80-4ae9-a8f8-04687ff7acf7 could not be found. Sep 14 09:05:49.923680 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:05:49.925359 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1ef08bf5-0319-461c-909c-46e7dc5b86fa tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] Returning 404 to user: Instance c45b2464-2a80-4ae9-a8f8-04687ff7acf7 could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:05:49.927435 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-1ef08bf5-0319-461c-909c-46e7dc5b86fa tempest-InstanceActionsV221TestJSON-1770363541 tempest-InstanceActionsV221TestJSON-1770363541-project] 10.222.0.60 "GET /compute/v2.1/servers/c45b2464-2a80-4ae9-a8f8-04687ff7acf7" status: 404 len: 111 microversion: 2.21 time: 0.095699 Sep 14 09:05:49.932643 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1943/3857] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:05:49 2022] GET /compute/v2.1/servers/c45b2464-2a80-4ae9-a8f8-04687ff7acf7 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 14 09:05:49.939029 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-67ab4e37-8051-410a-8dc8-4b9aa54d21e0 req-440196c2-0b7b-4983-9c17-161e09c5dde3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8450d385-d5d9-4c86-9ece-b3bbf9ed1105", "tag": "eb873b1a-8b40-4eb4-a329-cf733d9ed342"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:05:49.953075 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-67ab4e37-8051-410a-8dc8-4b9aa54d21e0 req-440196c2-0b7b-4983-9c17-161e09c5dde3 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:49.954841 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-67ab4e37-8051-410a-8dc8-4b9aa54d21e0 req-440196c2-0b7b-4983-9c17-161e09c5dde3 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:49.955373 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-67ab4e37-8051-410a-8dc8-4b9aa54d21e0 req-440196c2-0b7b-4983-9c17-161e09c5dde3 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:49.972266 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-67ab4e37-8051-410a-8dc8-4b9aa54d21e0 req-440196c2-0b7b-4983-9c17-161e09c5dde3 service nova] Creating event network-changed:eb873b1a-8b40-4eb4-a329-cf733d9ed342 for instance 8450d385-d5d9-4c86-9ece-b3bbf9ed1105 on n-h1-836830-18 Sep 14 09:05:49.978219 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-67ab4e37-8051-410a-8dc8-4b9aa54d21e0 req-440196c2-0b7b-4983-9c17-161e09c5dde3 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066118 Sep 14 09:05:49.978845 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1915/3858] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:05:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:05:50.144924 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-e124f48a-14b7-48c0-b1e1-2a5f881e1435 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:50.145554 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-e124f48a-14b7-48c0-b1e1-2a5f881e1435 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: 8e670908-5bb6-49ad-92f3-dad1b4df1b5a] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:05:50.161586 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e124f48a-14b7-48c0-b1e1-2a5f881e1435 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:50.166437 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e124f48a-14b7-48c0-b1e1-2a5f881e1435 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:50.166954 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e124f48a-14b7-48c0-b1e1-2a5f881e1435 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:50.169109 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e124f48a-14b7-48c0-b1e1-2a5f881e1435 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:50.172442 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e124f48a-14b7-48c0-b1e1-2a5f881e1435 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:50.174586 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e124f48a-14b7-48c0-b1e1-2a5f881e1435 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:50.539670 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-e124f48a-14b7-48c0-b1e1-2a5f881e1435 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:50.551271 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-e124f48a-14b7-48c0-b1e1-2a5f881e1435 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/8e670908-5bb6-49ad-92f3-dad1b4df1b5a" status: 200 len: 1512 microversion: 2.1 time: 0.410877 Sep 14 09:05:50.579565 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1944/3859] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:05:50 2022] GET /compute/v2.1/servers/8e670908-5bb6-49ad-92f3-dad1b4df1b5a => generated 1512 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:05:50.700075 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-4f94b9f8-dc5a-4230-9aa7-c3a73832be49 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:50.701598 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-4f94b9f8-dc5a-4230-9aa7-c3a73832be49 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:05:50.710728 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4f94b9f8-dc5a-4230-9aa7-c3a73832be49 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:50.711540 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4f94b9f8-dc5a-4230-9aa7-c3a73832be49 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:50.712565 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4f94b9f8-dc5a-4230-9aa7-c3a73832be49 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:50.713479 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4f94b9f8-dc5a-4230-9aa7-c3a73832be49 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:50.714110 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4f94b9f8-dc5a-4230-9aa7-c3a73832be49 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:50.714249 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-5fc930ec-194b-43eb-a6e2-81f6e03d9527 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:50.714846 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4f94b9f8-dc5a-4230-9aa7-c3a73832be49 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:50.715121 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-5fc930ec-194b-43eb-a6e2-81f6e03d9527 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] [instance: 136e2cad-31c9-4c0a-93ae-b6de98a41f8b] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:05:50.731346 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5fc930ec-194b-43eb-a6e2-81f6e03d9527 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:50.732846 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5fc930ec-194b-43eb-a6e2-81f6e03d9527 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:50.740253 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5fc930ec-194b-43eb-a6e2-81f6e03d9527 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:50.741217 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5fc930ec-194b-43eb-a6e2-81f6e03d9527 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:50.748171 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5fc930ec-194b-43eb-a6e2-81f6e03d9527 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:50.748807 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5fc930ec-194b-43eb-a6e2-81f6e03d9527 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:51.172520 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-5fc930ec-194b-43eb-a6e2-81f6e03d9527 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02330887b6814bea8312e01103b0d2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a358bdeb8c10424a8b70cc7b6c94e726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:51.188150 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-5fc930ec-194b-43eb-a6e2-81f6e03d9527 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] 10.222.0.60 "GET /compute/v2.1/servers/136e2cad-31c9-4c0a-93ae-b6de98a41f8b" status: 200 len: 1307 microversion: 2.1 time: 0.478328 Sep 14 09:05:51.189057 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1945/3860] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:05:50 2022] GET /compute/v2.1/servers/136e2cad-31c9-4c0a-93ae-b6de98a41f8b => generated 1307 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:05:51.193877 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d7d266a9-2a2f-439c-9bc4-59c33dac2a87 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '.version_select at 0x7f7d44478e50>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:51.297832 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-d7d266a9-2a2f-439c-9bc4-59c33dac2a87 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute/v2.1/images/a62c47ed-e003-4adc-bdf0-222dc0068fa9" status: 200 len: 1414 microversion: 2.1 time: 0.104201 Sep 14 09:05:51.303178 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1946/3861] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:05:51 2022] GET /compute/v2.1/images/a62c47ed-e003-4adc-bdf0-222dc0068fa9 => generated 1414 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:05:51.310053 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-6a82969d-5b91-4128-a33d-7c54734e484e tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:51.324588 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-6a82969d-5b91-4128-a33d-7c54734e484e tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] [instance: bb353760-fa41-4b09-a8c2-63b39e7d3639] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:05:51.347937 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6a82969d-5b91-4128-a33d-7c54734e484e tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:51.348972 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6a82969d-5b91-4128-a33d-7c54734e484e tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:51.352286 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6a82969d-5b91-4128-a33d-7c54734e484e tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:51.355895 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6a82969d-5b91-4128-a33d-7c54734e484e tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:51.356670 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6a82969d-5b91-4128-a33d-7c54734e484e tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:51.357357 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6a82969d-5b91-4128-a33d-7c54734e484e tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:51.397044 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-4f94b9f8-dc5a-4230-9aa7-c3a73832be49 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:51.409762 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-4f94b9f8-dc5a-4230-9aa7-c3a73832be49 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105" status: 200 len: 1364 microversion: 2.1 time: 0.716467 Sep 14 09:05:51.410375 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1916/3862] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:05:50 2022] GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105 => generated 1364 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:05:51.582729 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3d19a343-96d0-4cbd-992d-28945ee09af1 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:51.583383 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-3d19a343-96d0-4cbd-992d-28945ee09af1 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: 8e670908-5bb6-49ad-92f3-dad1b4df1b5a] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:05:51.584472 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-6a82969d-5b91-4128-a33d-7c54734e484e tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bda029c9974af09e83631e04459d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21195f8ae7b4267a128e890025c0b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:51.598341 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3d19a343-96d0-4cbd-992d-28945ee09af1 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:51.601448 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3d19a343-96d0-4cbd-992d-28945ee09af1 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:51.602131 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-6a82969d-5b91-4128-a33d-7c54734e484e tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55bda029c9974af09e83631e04459d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21195f8ae7b4267a128e890025c0b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:51.604515 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-6a82969d-5b91-4128-a33d-7c54734e484e tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55bda029c9974af09e83631e04459d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21195f8ae7b4267a128e890025c0b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:51.604704 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3d19a343-96d0-4cbd-992d-28945ee09af1 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:51.607840 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-6a82969d-5b91-4128-a33d-7c54734e484e tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] 10.222.0.60 "GET /compute/v2.1/servers/bb353760-fa41-4b09-a8c2-63b39e7d3639" status: 200 len: 1338 microversion: 2.47 time: 0.301080 Sep 14 09:05:51.608014 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3d19a343-96d0-4cbd-992d-28945ee09af1 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:51.608507 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3d19a343-96d0-4cbd-992d-28945ee09af1 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:51.608958 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3d19a343-96d0-4cbd-992d-28945ee09af1 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:51.610541 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1947/3863] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:05:51 2022] GET /compute/v2.1/servers/bb353760-fa41-4b09-a8c2-63b39e7d3639 => generated 1338 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:05:52.002005 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-c046907b-3903-435d-b143-cea35d0bb231 req-4ff08690-571c-42fc-97f0-b7aa0ed31dd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "136e2cad-31c9-4c0a-93ae-b6de98a41f8b", "name": "network-vif-deleted", "tag": "22809180-f268-43df-8a33-bcce72f1b6ab"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:05:52.017358 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-c046907b-3903-435d-b143-cea35d0bb231 req-4ff08690-571c-42fc-97f0-b7aa0ed31dd1 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:52.018237 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-c046907b-3903-435d-b143-cea35d0bb231 req-4ff08690-571c-42fc-97f0-b7aa0ed31dd1 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:52.019499 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-c046907b-3903-435d-b143-cea35d0bb231 req-4ff08690-571c-42fc-97f0-b7aa0ed31dd1 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:52.042525 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-3d19a343-96d0-4cbd-992d-28945ee09af1 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:52.048206 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-c046907b-3903-435d-b143-cea35d0bb231 req-4ff08690-571c-42fc-97f0-b7aa0ed31dd1 service nova] Creating event network-vif-deleted:22809180-f268-43df-8a33-bcce72f1b6ab for instance 136e2cad-31c9-4c0a-93ae-b6de98a41f8b on n-h2-836830-18 Sep 14 09:05:52.053709 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-c046907b-3903-435d-b143-cea35d0bb231 req-4ff08690-571c-42fc-97f0-b7aa0ed31dd1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055569 Sep 14 09:05:52.061989 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1948/3864] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:05:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:05:52.067428 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-3d19a343-96d0-4cbd-992d-28945ee09af1 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/8e670908-5bb6-49ad-92f3-dad1b4df1b5a" status: 200 len: 1512 microversion: 2.1 time: 0.489250 Sep 14 09:05:52.071349 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1917/3865] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:05:51 2022] GET /compute/v2.1/servers/8e670908-5bb6-49ad-92f3-dad1b4df1b5a => generated 1512 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:05:52.215335 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-941fff03-c5ab-4f9c-95ff-49d40d599008 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:52.216699 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-941fff03-c5ab-4f9c-95ff-49d40d599008 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] [instance: 136e2cad-31c9-4c0a-93ae-b6de98a41f8b] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:05:52.228209 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-941fff03-c5ab-4f9c-95ff-49d40d599008 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:52.230900 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-941fff03-c5ab-4f9c-95ff-49d40d599008 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:52.231577 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-941fff03-c5ab-4f9c-95ff-49d40d599008 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:52.233457 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-941fff03-c5ab-4f9c-95ff-49d40d599008 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:52.234635 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-941fff03-c5ab-4f9c-95ff-49d40d599008 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:52.236998 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-941fff03-c5ab-4f9c-95ff-49d40d599008 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:52.281897 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-941fff03-c5ab-4f9c-95ff-49d40d599008 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] HTTP exception thrown: Instance 136e2cad-31c9-4c0a-93ae-b6de98a41f8b could not be found. Sep 14 09:05:52.297857 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-941fff03-c5ab-4f9c-95ff-49d40d599008 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Request method failure captured: Sep 14 09:05:52.297857 n-d-836830-18 devstack@n-api.service[128758]: request: GET /compute/v2.1/servers/136e2cad-31c9-4c0a-93ae-b6de98a41f8b HTTP/1.1 Sep 14 09:05:52.297857 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 09:05:52.297857 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 09:05:52.297857 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 09:05:52.297857 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 09:05:52.297857 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 09:05:52.297857 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 09:05:52.297857 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 09:05:52.297857 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 09:05:52.297857 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZk5CcryJadxQNjGyTAJiFOJEcjuYnbHt_jebtn_mXakmWm_3QGD_sWy8UNE6zabfmn7bEY5bGgE6_SyNfMRsOLo301zILYv7E-dTA0iBIVflEnBP6EkqCVMYsrHF24azi19lfesNgYMyCLdIxpNRONa3k6TyfOvyp689qsv_zyjOlA Sep 14 09:05:52.297857 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 09:05:52.297857 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 09:05:52.297857 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 09:05:52.297857 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 09:05:52.297857 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 09:05:52.297857 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 09:05:52.297857 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: a358bdeb8c10424a8b70cc7b6c94e726 Sep 14 09:05:52.297857 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-ListServersNegativeTestJSON-370517883 Sep 14 09:05:52.297857 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 09:05:52.297857 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 09:05:52.297857 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a358bdeb8c10424a8b70cc7b6c94e726"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a358bdeb8c10424a8b70cc7b6c94e726"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a358bdeb8c10424a8b70cc7b6c94e726"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a358bdeb8c10424a8b70cc7b6c94e726"}]}] Sep 14 09:05:52.297857 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-ListServersNegativeTestJSON-370517883 Sep 14 09:05:52.297857 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: a358bdeb8c10424a8b70cc7b6c94e726 Sep 14 09:05:52.297857 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-370517883 Sep 14 09:05:52.297857 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-ListServersNegativeTestJSON-370517883-project Sep 14 09:05:52.297857 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 09:05:52.297857 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 09:05:52.297857 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 02330887b6814bea8312e01103b0d2e9 Sep 14 09:05:52.297857 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-ListServersNegativeTestJSON-370517883-project Sep 14 09:05:52.297857 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 09:05:52.297857 n-d-836830-18 devstack@n-api.service[128758]: exception: Instance 136e2cad-31c9-4c0a-93ae-b6de98a41f8b could not be found. Sep 14 09:05:52.297857 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': '136e2cad-31c9-4c0a-93ae-b6de98a41f8b'} Sep 14 09:05:52.297857 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:05:52.297857 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:05:52.297857 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:05:52.297857 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:05:52.297857 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:05:52.297857 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:05:52.297857 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:05:52.297857 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:05:52.297857 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:05:52.297857 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:05:52.297857 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 136e2cad-31c9-4c0a-93ae-b6de98a41f8b could not be found. Sep 14 09:05:52.297857 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:05:52.297857 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:05:52.297857 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:05:52.297857 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:05:52.297857 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:05:52.297857 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:05:52.297857 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:05:52.297857 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:05:52.297857 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:05:52.297857 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:05:52.297857 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:05:52.297857 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:05:52.297857 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:05:52.297857 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:05:52.297857 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:05:52.297857 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:05:52.297857 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 136e2cad-31c9-4c0a-93ae-b6de98a41f8b could not be found. Sep 14 09:05:52.297857 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:05:52.297857 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:05:52.302898 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:05:52.302898 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:05:52.302898 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:05:52.302898 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:05:52.302898 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:05:52.302898 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:05:52.302898 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 136e2cad-31c9-4c0a-93ae-b6de98a41f8b could not be found. Sep 14 09:05:52.302898 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:05:52.308208 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-941fff03-c5ab-4f9c-95ff-49d40d599008 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Returning 404 to user: Instance 136e2cad-31c9-4c0a-93ae-b6de98a41f8b could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:05:52.309475 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-941fff03-c5ab-4f9c-95ff-49d40d599008 tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] 10.222.0.60 "GET /compute/v2.1/servers/136e2cad-31c9-4c0a-93ae-b6de98a41f8b" status: 404 len: 111 microversion: 2.1 time: 0.099052 Sep 14 09:05:52.317263 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1949/3866] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:05:52 2022] GET /compute/v2.1/servers/136e2cad-31c9-4c0a-93ae-b6de98a41f8b => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:05:52.318383 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-10a78835-ef54-4147-867b-1e0fdfd80c03 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '.version_select at 0x7f7d4880f310>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:52.325294 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-22b3e5ae-9f4f-41e5-abde-d517bb0cc9ca tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:52.326126 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-22b3e5ae-9f4f-41e5-abde-d517bb0cc9ca tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] [instance: 05cc41b4-ace4-4d14-90ed-ad19af43e268] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:05:52.334139 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-22b3e5ae-9f4f-41e5-abde-d517bb0cc9ca tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:52.335307 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-22b3e5ae-9f4f-41e5-abde-d517bb0cc9ca tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:52.336478 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-22b3e5ae-9f4f-41e5-abde-d517bb0cc9ca tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:52.338042 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-22b3e5ae-9f4f-41e5-abde-d517bb0cc9ca tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:52.338665 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-22b3e5ae-9f4f-41e5-abde-d517bb0cc9ca tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:52.339556 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-22b3e5ae-9f4f-41e5-abde-d517bb0cc9ca tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:52.365978 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:05:52.410704 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-10a78835-ef54-4147-867b-1e0fdfd80c03 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute/v2.1/images/a62c47ed-e003-4adc-bdf0-222dc0068fa9" status: 200 len: 1414 microversion: 2.1 time: 0.096669 Sep 14 09:05:52.416395 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1918/3867] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:05:52 2022] GET /compute/v2.1/images/a62c47ed-e003-4adc-bdf0-222dc0068fa9 => generated 1414 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:05:52.433117 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-6d26d15d-c6bd-4ed0-963e-86bd92b40f76 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:52.434195 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-6d26d15d-c6bd-4ed0-963e-86bd92b40f76 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:05:52.445513 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6d26d15d-c6bd-4ed0-963e-86bd92b40f76 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:52.446580 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6d26d15d-c6bd-4ed0-963e-86bd92b40f76 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:52.448068 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6d26d15d-c6bd-4ed0-963e-86bd92b40f76 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:52.450039 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6d26d15d-c6bd-4ed0-963e-86bd92b40f76 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:52.451105 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6d26d15d-c6bd-4ed0-963e-86bd92b40f76 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:52.452326 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6d26d15d-c6bd-4ed0-963e-86bd92b40f76 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:52.921335 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-6d26d15d-c6bd-4ed0-963e-86bd92b40f76 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:52.932981 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-6d26d15d-c6bd-4ed0-963e-86bd92b40f76 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105" status: 200 len: 1364 microversion: 2.1 time: 0.503711 Sep 14 09:05:52.941039 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-22b3e5ae-9f4f-41e5-abde-d517bb0cc9ca tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02330887b6814bea8312e01103b0d2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a358bdeb8c10424a8b70cc7b6c94e726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:52.946471 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1919/3868] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:05:52 2022] GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105 => generated 1364 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:05:52.957890 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-22b3e5ae-9f4f-41e5-abde-d517bb0cc9ca tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] 10.222.0.60 "GET /compute/v2.1/servers/05cc41b4-ace4-4d14-90ed-ad19af43e268" status: 200 len: 1520 microversion: 2.1 time: 0.639104 Sep 14 09:05:52.960081 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1950/3869] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:05:52 2022] GET /compute/v2.1/servers/05cc41b4-ace4-4d14-90ed-ad19af43e268 => generated 1520 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:05:52.962137 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-71fddd8e-8aaf-4b2f-9780-915872808065 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:52.963640 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-71fddd8e-8aaf-4b2f-9780-915872808065 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] [instance: bb353760-fa41-4b09-a8c2-63b39e7d3639] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:05:52.977691 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-71fddd8e-8aaf-4b2f-9780-915872808065 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:52.979357 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-71fddd8e-8aaf-4b2f-9780-915872808065 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:52.980387 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-71fddd8e-8aaf-4b2f-9780-915872808065 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:52.984723 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-71fddd8e-8aaf-4b2f-9780-915872808065 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:52.987084 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-71fddd8e-8aaf-4b2f-9780-915872808065 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:52.987611 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-71fddd8e-8aaf-4b2f-9780-915872808065 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:53.095992 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a107d14c-ec67-418a-a412-68a9992b5af3 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:53.097894 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-a107d14c-ec67-418a-a412-68a9992b5af3 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: 8e670908-5bb6-49ad-92f3-dad1b4df1b5a] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:05:53.113765 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a107d14c-ec67-418a-a412-68a9992b5af3 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:53.115888 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a107d14c-ec67-418a-a412-68a9992b5af3 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:53.117508 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a107d14c-ec67-418a-a412-68a9992b5af3 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:53.120334 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a107d14c-ec67-418a-a412-68a9992b5af3 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:53.122150 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a107d14c-ec67-418a-a412-68a9992b5af3 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:53.122290 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-71fddd8e-8aaf-4b2f-9780-915872808065 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bda029c9974af09e83631e04459d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21195f8ae7b4267a128e890025c0b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:53.123943 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a107d14c-ec67-418a-a412-68a9992b5af3 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:53.130915 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-71fddd8e-8aaf-4b2f-9780-915872808065 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55bda029c9974af09e83631e04459d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21195f8ae7b4267a128e890025c0b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:53.132431 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-71fddd8e-8aaf-4b2f-9780-915872808065 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55bda029c9974af09e83631e04459d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21195f8ae7b4267a128e890025c0b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:53.138759 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-71fddd8e-8aaf-4b2f-9780-915872808065 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] 10.222.0.60 "GET /compute/v2.1/servers/bb353760-fa41-4b09-a8c2-63b39e7d3639" status: 200 len: 1338 microversion: 2.47 time: 0.188421 Sep 14 09:05:53.141530 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1920/3870] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:05:52 2022] GET /compute/v2.1/servers/bb353760-fa41-4b09-a8c2-63b39e7d3639 => generated 1338 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:05:53.427658 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-008b89c6-fdd8-41cf-be60-85660686fb8e tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '.version_select at 0x7f7d3fb83b80>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:53.548557 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-008b89c6-fdd8-41cf-be60-85660686fb8e tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute/v2.1/images/a62c47ed-e003-4adc-bdf0-222dc0068fa9" status: 200 len: 1414 microversion: 2.1 time: 0.123886 Sep 14 09:05:53.549847 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1921/3871] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:05:53 2022] GET /compute/v2.1/images/a62c47ed-e003-4adc-bdf0-222dc0068fa9 => generated 1414 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:05:53.798002 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=12 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:05:53.989909 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3e9e7b4d-43bb-434b-b60a-a75fba15daeb tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:53.990542 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-3e9e7b4d-43bb-434b-b60a-a75fba15daeb tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:05:54.013857 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3e9e7b4d-43bb-434b-b60a-a75fba15daeb tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:54.014370 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3e9e7b4d-43bb-434b-b60a-a75fba15daeb tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:54.022551 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3e9e7b4d-43bb-434b-b60a-a75fba15daeb tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:54.031466 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3e9e7b4d-43bb-434b-b60a-a75fba15daeb tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:54.035654 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3e9e7b4d-43bb-434b-b60a-a75fba15daeb tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:54.042931 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3e9e7b4d-43bb-434b-b60a-a75fba15daeb tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:54.326873 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-a107d14c-ec67-418a-a412-68a9992b5af3 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:54.338994 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-a107d14c-ec67-418a-a412-68a9992b5af3 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/8e670908-5bb6-49ad-92f3-dad1b4df1b5a" status: 200 len: 1512 microversion: 2.1 time: 1.248722 Sep 14 09:05:54.341896 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1951/3872] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:05:53 2022] GET /compute/v2.1/servers/8e670908-5bb6-49ad-92f3-dad1b4df1b5a => generated 1512 bytes in 1252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:05:54.365067 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-08e39346-e95b-4366-882e-7fae2457f2ca tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:54.366688 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-08e39346-e95b-4366-882e-7fae2457f2ca tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] [instance: 05cc41b4-ace4-4d14-90ed-ad19af43e268] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:05:54.382733 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-08e39346-e95b-4366-882e-7fae2457f2ca tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:54.385613 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-08e39346-e95b-4366-882e-7fae2457f2ca tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:54.386034 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-08e39346-e95b-4366-882e-7fae2457f2ca tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:54.386787 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-08e39346-e95b-4366-882e-7fae2457f2ca tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:54.392151 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-08e39346-e95b-4366-882e-7fae2457f2ca tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:54.392632 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-08e39346-e95b-4366-882e-7fae2457f2ca tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:54.687626 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-08e39346-e95b-4366-882e-7fae2457f2ca tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02330887b6814bea8312e01103b0d2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a358bdeb8c10424a8b70cc7b6c94e726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:54.704509 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-08e39346-e95b-4366-882e-7fae2457f2ca tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] 10.222.0.60 "GET /compute/v2.1/servers/05cc41b4-ace4-4d14-90ed-ad19af43e268" status: 200 len: 1478 microversion: 2.1 time: 0.360383 Sep 14 09:05:54.707020 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1952/3873] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:05:54 2022] GET /compute/v2.1/servers/05cc41b4-ace4-4d14-90ed-ad19af43e268 => generated 1478 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:05:54.727838 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-74d0247a-a25c-4ac2-8fd5-a26d640fdf32 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:54.728499 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-74d0247a-a25c-4ac2-8fd5-a26d640fdf32 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] [instance: bb353760-fa41-4b09-a8c2-63b39e7d3639] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:05:54.754172 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-74d0247a-a25c-4ac2-8fd5-a26d640fdf32 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:54.756904 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-74d0247a-a25c-4ac2-8fd5-a26d640fdf32 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:54.758363 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-74d0247a-a25c-4ac2-8fd5-a26d640fdf32 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:54.760792 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-74d0247a-a25c-4ac2-8fd5-a26d640fdf32 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:54.761507 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-74d0247a-a25c-4ac2-8fd5-a26d640fdf32 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:54.762974 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-74d0247a-a25c-4ac2-8fd5-a26d640fdf32 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:54.910155 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-3e9e7b4d-43bb-434b-b60a-a75fba15daeb tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:54.927720 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-3e9e7b4d-43bb-434b-b60a-a75fba15daeb tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105" status: 200 len: 1364 microversion: 2.1 time: 0.947561 Sep 14 09:05:54.943507 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1922/3874] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:05:53 2022] GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105 => generated 1364 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:05:54.959745 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-248a46e1-69bd-47ba-afc5-111fba7806cf tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '.version_select at 0x7f7d3fb83790>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:55.041675 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-74d0247a-a25c-4ac2-8fd5-a26d640fdf32 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bda029c9974af09e83631e04459d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21195f8ae7b4267a128e890025c0b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:55.051792 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-74d0247a-a25c-4ac2-8fd5-a26d640fdf32 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55bda029c9974af09e83631e04459d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21195f8ae7b4267a128e890025c0b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:55.053269 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-74d0247a-a25c-4ac2-8fd5-a26d640fdf32 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55bda029c9974af09e83631e04459d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21195f8ae7b4267a128e890025c0b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:55.054536 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-74d0247a-a25c-4ac2-8fd5-a26d640fdf32 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] 10.222.0.60 "GET /compute/v2.1/servers/bb353760-fa41-4b09-a8c2-63b39e7d3639" status: 200 len: 1359 microversion: 2.47 time: 0.346281 Sep 14 09:05:55.072706 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-248a46e1-69bd-47ba-afc5-111fba7806cf tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute/v2.1/images/a62c47ed-e003-4adc-bdf0-222dc0068fa9" status: 200 len: 1414 microversion: 2.1 time: 0.127744 Sep 14 09:05:55.078402 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1923/3875] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:05:54 2022] GET /compute/v2.1/images/a62c47ed-e003-4adc-bdf0-222dc0068fa9 => generated 1414 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:05:55.078871 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1953/3876] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:05:54 2022] GET /compute/v2.1/servers/bb353760-fa41-4b09-a8c2-63b39e7d3639 => generated 1359 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:05:55.109701 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-eb186344-9ad9-49ec-ba96-55d37060129f tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-348345983"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:05:55.112802 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-eb186344-9ad9-49ec-ba96-55d37060129f tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] [instance: bb353760-fa41-4b09-a8c2-63b39e7d3639] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:05:55.127461 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-eb186344-9ad9-49ec-ba96-55d37060129f tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:55.134267 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-eb186344-9ad9-49ec-ba96-55d37060129f tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:55.135051 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-eb186344-9ad9-49ec-ba96-55d37060129f tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:55.137576 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-eb186344-9ad9-49ec-ba96-55d37060129f tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:55.138270 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-eb186344-9ad9-49ec-ba96-55d37060129f tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:55.140440 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-eb186344-9ad9-49ec-ba96-55d37060129f tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:55.370694 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a0f9df95-d64e-44a7-835d-829329de3438 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:55.371869 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-a0f9df95-d64e-44a7-835d-829329de3438 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: 8e670908-5bb6-49ad-92f3-dad1b4df1b5a] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:05:55.391262 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a0f9df95-d64e-44a7-835d-829329de3438 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:55.392617 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a0f9df95-d64e-44a7-835d-829329de3438 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:55.393790 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a0f9df95-d64e-44a7-835d-829329de3438 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:55.399945 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a0f9df95-d64e-44a7-835d-829329de3438 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:55.401837 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a0f9df95-d64e-44a7-835d-829329de3438 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:55.405563 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a0f9df95-d64e-44a7-835d-829329de3438 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:55.539964 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-eb186344-9ad9-49ec-ba96-55d37060129f tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] 10.222.0.60 "POST /compute/v2.1/servers/bb353760-fa41-4b09-a8c2-63b39e7d3639/action" status: 202 len: 52 microversion: 2.47 time: 0.434631 Sep 14 09:05:55.555042 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1924/3877] 10.222.0.60 () {62 vars in 1319 bytes} [Wed Sep 14 09:05:55 2022] POST /compute/v2.1/servers/bb353760-fa41-4b09-a8c2-63b39e7d3639/action => generated 52 bytes in 451 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Sep 14 09:05:55.574682 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-856ea380-796c-4eda-9cd3-0d55ddb39528 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:55.582040 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-856ea380-796c-4eda-9cd3-0d55ddb39528 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] [instance: bb353760-fa41-4b09-a8c2-63b39e7d3639] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:05:55.618987 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-856ea380-796c-4eda-9cd3-0d55ddb39528 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:55.619697 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-856ea380-796c-4eda-9cd3-0d55ddb39528 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:55.620162 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-856ea380-796c-4eda-9cd3-0d55ddb39528 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:55.620931 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-856ea380-796c-4eda-9cd3-0d55ddb39528 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:55.621393 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-856ea380-796c-4eda-9cd3-0d55ddb39528 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:55.621891 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-856ea380-796c-4eda-9cd3-0d55ddb39528 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:55.705597 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-856ea380-796c-4eda-9cd3-0d55ddb39528 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] [instance: bb353760-fa41-4b09-a8c2-63b39e7d3639] Going to try to terminate instance {{(pid=128759) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:05:55.947877 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-856ea380-796c-4eda-9cd3-0d55ddb39528 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] 10.222.0.60 "DELETE /compute/v2.1/servers/bb353760-fa41-4b09-a8c2-63b39e7d3639" status: 204 len: 0 microversion: 2.47 time: 0.380030 Sep 14 09:05:55.948460 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1925/3878] 10.222.0.60 () {60 vars in 1280 bytes} [Wed Sep 14 09:05:55 2022] DELETE /compute/v2.1/servers/bb353760-fa41-4b09-a8c2-63b39e7d3639 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 14 09:05:55.974510 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-077cd179-fc5b-4638-8b80-b6d6c0595ef0 req-fe618344-1677-44a4-89bb-f2f1e601649d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05cc41b4-ace4-4d14-90ed-ad19af43e268", "name": "network-vif-deleted", "tag": "95399de6-926b-4e21-b4ae-2cdbd4f773e4"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:05:56.015883 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-077cd179-fc5b-4638-8b80-b6d6c0595ef0 req-fe618344-1677-44a4-89bb-f2f1e601649d service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:56.016387 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-077cd179-fc5b-4638-8b80-b6d6c0595ef0 req-fe618344-1677-44a4-89bb-f2f1e601649d service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:56.016835 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-077cd179-fc5b-4638-8b80-b6d6c0595ef0 req-fe618344-1677-44a4-89bb-f2f1e601649d service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:56.060383 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-077cd179-fc5b-4638-8b80-b6d6c0595ef0 req-fe618344-1677-44a4-89bb-f2f1e601649d service nova] Creating event network-vif-deleted:95399de6-926b-4e21-b4ae-2cdbd4f773e4 for instance 05cc41b4-ace4-4d14-90ed-ad19af43e268 on n-h1-836830-18 Sep 14 09:05:56.075182 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-077cd179-fc5b-4638-8b80-b6d6c0595ef0 req-fe618344-1677-44a4-89bb-f2f1e601649d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119712 Sep 14 09:05:56.077533 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1926/3879] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:05:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:05:56.085438 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-2e8442be-f505-4e55-a434-74eaf065174b tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:56.086518 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-2e8442be-f505-4e55-a434-74eaf065174b tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] [instance: 05cc41b4-ace4-4d14-90ed-ad19af43e268] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:05:56.095243 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2e8442be-f505-4e55-a434-74eaf065174b tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:56.096356 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2e8442be-f505-4e55-a434-74eaf065174b tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:56.097216 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2e8442be-f505-4e55-a434-74eaf065174b tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:56.099186 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2e8442be-f505-4e55-a434-74eaf065174b tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:56.099959 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2e8442be-f505-4e55-a434-74eaf065174b tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:56.100785 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2e8442be-f505-4e55-a434-74eaf065174b tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:56.122617 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-2e8442be-f505-4e55-a434-74eaf065174b tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] HTTP exception thrown: Instance 05cc41b4-ace4-4d14-90ed-ad19af43e268 could not be found. Sep 14 09:05:56.124851 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-2e8442be-f505-4e55-a434-74eaf065174b tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Request method failure captured: Sep 14 09:05:56.124851 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/05cc41b4-ace4-4d14-90ed-ad19af43e268 HTTP/1.1 Sep 14 09:05:56.124851 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:05:56.124851 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:05:56.124851 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:05:56.124851 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:05:56.124851 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:05:56.124851 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:05:56.124851 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:05:56.124851 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:05:56.124851 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZk5CcryJadxQNjGyTAJiFOJEcjuYnbHt_jebtn_mXakmWm_3QGD_sWy8UNE6zabfmn7bEY5bGgE6_SyNfMRsOLo301zILYv7E-dTA0iBIVflEnBP6EkqCVMYsrHF24azi19lfesNgYMyCLdIxpNRONa3k6TyfOvyp689qsv_zyjOlA Sep 14 09:05:56.124851 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:05:56.124851 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:05:56.124851 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:05:56.124851 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:05:56.124851 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:05:56.124851 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:05:56.124851 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: a358bdeb8c10424a8b70cc7b6c94e726 Sep 14 09:05:56.124851 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ListServersNegativeTestJSON-370517883 Sep 14 09:05:56.124851 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:05:56.124851 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:05:56.124851 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a358bdeb8c10424a8b70cc7b6c94e726"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a358bdeb8c10424a8b70cc7b6c94e726"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a358bdeb8c10424a8b70cc7b6c94e726"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a358bdeb8c10424a8b70cc7b6c94e726"}]}] Sep 14 09:05:56.124851 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ListServersNegativeTestJSON-370517883 Sep 14 09:05:56.124851 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: a358bdeb8c10424a8b70cc7b6c94e726 Sep 14 09:05:56.124851 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-370517883 Sep 14 09:05:56.124851 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ListServersNegativeTestJSON-370517883-project Sep 14 09:05:56.124851 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:05:56.124851 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:05:56.124851 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 02330887b6814bea8312e01103b0d2e9 Sep 14 09:05:56.124851 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ListServersNegativeTestJSON-370517883-project Sep 14 09:05:56.124851 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:05:56.124851 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance 05cc41b4-ace4-4d14-90ed-ad19af43e268 could not be found. Sep 14 09:05:56.124851 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '05cc41b4-ace4-4d14-90ed-ad19af43e268'} Sep 14 09:05:56.124851 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:05:56.124851 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:05:56.124851 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:05:56.124851 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:05:56.124851 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:05:56.124851 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:05:56.124851 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:05:56.124851 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:05:56.124851 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:05:56.124851 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:05:56.124851 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05cc41b4-ace4-4d14-90ed-ad19af43e268 could not be found. Sep 14 09:05:56.124851 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:05:56.124851 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:05:56.124851 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:05:56.124851 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:05:56.124851 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:05:56.124851 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:05:56.124851 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:05:56.124851 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:05:56.124851 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:05:56.124851 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:05:56.124851 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:05:56.124851 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:05:56.124851 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:05:56.124851 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:05:56.124851 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:05:56.124851 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:05:56.124851 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05cc41b4-ace4-4d14-90ed-ad19af43e268 could not be found. Sep 14 09:05:56.124851 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:05:56.124851 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:05:56.133014 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:05:56.133014 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:05:56.133014 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:05:56.133014 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:05:56.133014 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:05:56.133014 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:05:56.133014 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05cc41b4-ace4-4d14-90ed-ad19af43e268 could not be found. Sep 14 09:05:56.133014 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:05:56.137071 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-2e8442be-f505-4e55-a434-74eaf065174b tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] Returning 404 to user: Instance 05cc41b4-ace4-4d14-90ed-ad19af43e268 could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:05:56.138266 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-2e8442be-f505-4e55-a434-74eaf065174b tempest-ListServersNegativeTestJSON-370517883 tempest-ListServersNegativeTestJSON-370517883-project] 10.222.0.60 "GET /compute/v2.1/servers/05cc41b4-ace4-4d14-90ed-ad19af43e268" status: 404 len: 111 microversion: 2.1 time: 0.058621 Sep 14 09:05:56.142901 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1927/3880] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:05:56 2022] GET /compute/v2.1/servers/05cc41b4-ace4-4d14-90ed-ad19af43e268 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:05:56.149047 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-0221ba0b-0e88-48ba-b173-8a74deb50ded tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:56.150162 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-0221ba0b-0e88-48ba-b173-8a74deb50ded tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] [instance: bb353760-fa41-4b09-a8c2-63b39e7d3639] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:05:56.158014 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0221ba0b-0e88-48ba-b173-8a74deb50ded tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:56.159163 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0221ba0b-0e88-48ba-b173-8a74deb50ded tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:56.159838 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0221ba0b-0e88-48ba-b173-8a74deb50ded tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:56.160940 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0221ba0b-0e88-48ba-b173-8a74deb50ded tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:56.161633 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0221ba0b-0e88-48ba-b173-8a74deb50ded tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:56.162292 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0221ba0b-0e88-48ba-b173-8a74deb50ded tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:56.306634 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-0221ba0b-0e88-48ba-b173-8a74deb50ded tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bda029c9974af09e83631e04459d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21195f8ae7b4267a128e890025c0b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:56.316602 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-0221ba0b-0e88-48ba-b173-8a74deb50ded tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55bda029c9974af09e83631e04459d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21195f8ae7b4267a128e890025c0b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:56.324342 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-0221ba0b-0e88-48ba-b173-8a74deb50ded tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55bda029c9974af09e83631e04459d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21195f8ae7b4267a128e890025c0b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:56.326533 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-0221ba0b-0e88-48ba-b173-8a74deb50ded tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] 10.222.0.60 "GET /compute/v2.1/servers/bb353760-fa41-4b09-a8c2-63b39e7d3639" status: 200 len: 1365 microversion: 2.47 time: 0.181829 Sep 14 09:05:56.342056 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=6 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:05:56.355066 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1928/3881] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:05:56 2022] GET /compute/v2.1/servers/bb353760-fa41-4b09-a8c2-63b39e7d3639 => generated 1365 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:05:56.373638 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e36c13d3-a589-409d-810b-ed166902439c tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:56.381934 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e36c13d3-a589-409d-810b-ed166902439c tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:05:56.437025 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e36c13d3-a589-409d-810b-ed166902439c tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:56.440067 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e36c13d3-a589-409d-810b-ed166902439c tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:56.440486 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e36c13d3-a589-409d-810b-ed166902439c tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:56.441198 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e36c13d3-a589-409d-810b-ed166902439c tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:56.441678 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e36c13d3-a589-409d-810b-ed166902439c tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:56.442118 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e36c13d3-a589-409d-810b-ed166902439c tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:56.487298 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-a0f9df95-d64e-44a7-835d-829329de3438 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:56.503677 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-a0f9df95-d64e-44a7-835d-829329de3438 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/8e670908-5bb6-49ad-92f3-dad1b4df1b5a" status: 200 len: 1512 microversion: 2.1 time: 1.136443 Sep 14 09:05:56.522466 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1954/3882] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:05:55 2022] GET /compute/v2.1/servers/8e670908-5bb6-49ad-92f3-dad1b4df1b5a => generated 1512 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:05:56.525231 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-4473cc07-98e6-4cc4-b7ba-ea61b6432bb1 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '.version_select at 0x7f7d3f830c10>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:56.608986 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-4473cc07-98e6-4cc4-b7ba-ea61b6432bb1 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute/v2.1/images/a62c47ed-e003-4adc-bdf0-222dc0068fa9" status: 200 len: 1414 microversion: 2.1 time: 0.099228 Sep 14 09:05:56.610980 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1955/3883] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:05:56 2022] GET /compute/v2.1/images/a62c47ed-e003-4adc-bdf0-222dc0068fa9 => generated 1414 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:05:56.848453 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-e36c13d3-a589-409d-810b-ed166902439c tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:56.861974 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e36c13d3-a589-409d-810b-ed166902439c tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105" status: 200 len: 1364 microversion: 2.1 time: 0.499084 Sep 14 09:05:56.877893 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1929/3884] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:05:56 2022] GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105 => generated 1364 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:05:57.367438 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-6c73790c-1534-4bb6-8af4-a0d9ea3cf0ca tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:57.368746 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-6c73790c-1534-4bb6-8af4-a0d9ea3cf0ca tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] [instance: bb353760-fa41-4b09-a8c2-63b39e7d3639] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:05:57.389458 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6c73790c-1534-4bb6-8af4-a0d9ea3cf0ca tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:57.394232 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6c73790c-1534-4bb6-8af4-a0d9ea3cf0ca tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:57.399940 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6c73790c-1534-4bb6-8af4-a0d9ea3cf0ca tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:57.403863 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6c73790c-1534-4bb6-8af4-a0d9ea3cf0ca tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:57.407549 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6c73790c-1534-4bb6-8af4-a0d9ea3cf0ca tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:57.410006 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6c73790c-1534-4bb6-8af4-a0d9ea3cf0ca tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:57.531941 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9248d110-9cfb-4887-a999-90d95d652b9b tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:57.536409 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-9248d110-9cfb-4887-a999-90d95d652b9b tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: 8e670908-5bb6-49ad-92f3-dad1b4df1b5a] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:05:57.540996 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=20 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:05:57.550180 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=4 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:05:57.567533 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9248d110-9cfb-4887-a999-90d95d652b9b tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:57.568052 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9248d110-9cfb-4887-a999-90d95d652b9b tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:57.576388 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9248d110-9cfb-4887-a999-90d95d652b9b tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:57.577261 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9248d110-9cfb-4887-a999-90d95d652b9b tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:57.577760 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9248d110-9cfb-4887-a999-90d95d652b9b tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:57.578204 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9248d110-9cfb-4887-a999-90d95d652b9b tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:57.784836 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-6c73790c-1534-4bb6-8af4-a0d9ea3cf0ca tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bda029c9974af09e83631e04459d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21195f8ae7b4267a128e890025c0b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:57.801090 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-6c73790c-1534-4bb6-8af4-a0d9ea3cf0ca tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55bda029c9974af09e83631e04459d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21195f8ae7b4267a128e890025c0b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:57.802598 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-6c73790c-1534-4bb6-8af4-a0d9ea3cf0ca tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55bda029c9974af09e83631e04459d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21195f8ae7b4267a128e890025c0b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:57.808212 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-6c73790c-1534-4bb6-8af4-a0d9ea3cf0ca tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] 10.222.0.60 "GET /compute/v2.1/servers/bb353760-fa41-4b09-a8c2-63b39e7d3639" status: 200 len: 1365 microversion: 2.47 time: 0.450496 Sep 14 09:05:57.809593 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1956/3885] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:05:57 2022] GET /compute/v2.1/servers/bb353760-fa41-4b09-a8c2-63b39e7d3639 => generated 1365 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:05:57.815516 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c545b6f0-7e83-4eec-95c2-17884d72ad0a tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '.version_select at 0x7f7d445d91f0>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:57.865106 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=12 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:05:57.910791 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-9248d110-9cfb-4887-a999-90d95d652b9b tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:57.913162 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-c545b6f0-7e83-4eec-95c2-17884d72ad0a tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute/v2.1/images/a62c47ed-e003-4adc-bdf0-222dc0068fa9" status: 200 len: 1414 microversion: 2.1 time: 0.102148 Sep 14 09:05:57.923131 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1957/3886] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:05:57 2022] GET /compute/v2.1/images/a62c47ed-e003-4adc-bdf0-222dc0068fa9 => generated 1414 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:05:57.928476 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-9363a692-d054-43c0-a39d-4ddbbb4dbc02 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:57.929369 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-9248d110-9cfb-4887-a999-90d95d652b9b tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/8e670908-5bb6-49ad-92f3-dad1b4df1b5a" status: 200 len: 1470 microversion: 2.1 time: 0.402310 Sep 14 09:05:57.929702 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-9363a692-d054-43c0-a39d-4ddbbb4dbc02 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:05:57.950229 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1930/3887] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:05:57 2022] GET /compute/v2.1/servers/8e670908-5bb6-49ad-92f3-dad1b4df1b5a => generated 1470 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:05:57.962603 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9363a692-d054-43c0-a39d-4ddbbb4dbc02 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:57.999961 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9363a692-d054-43c0-a39d-4ddbbb4dbc02 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.037s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:58.003998 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9363a692-d054-43c0-a39d-4ddbbb4dbc02 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:58.009345 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9363a692-d054-43c0-a39d-4ddbbb4dbc02 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:58.014535 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9363a692-d054-43c0-a39d-4ddbbb4dbc02 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:58.015042 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9363a692-d054-43c0-a39d-4ddbbb4dbc02 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:58.253493 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-c9cc336b-0d1c-4de6-b5dc-e3ade970bc4e req-d6384ee9-8517-417d-8367-6d2ad1824955 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e670908-5bb6-49ad-92f3-dad1b4df1b5a", "name": "network-vif-deleted", "tag": "9c0d24b4-f3c7-444b-9f46-dff7b9217185"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:05:58.267788 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-c9cc336b-0d1c-4de6-b5dc-e3ade970bc4e req-d6384ee9-8517-417d-8367-6d2ad1824955 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:58.268780 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-c9cc336b-0d1c-4de6-b5dc-e3ade970bc4e req-d6384ee9-8517-417d-8367-6d2ad1824955 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:58.269558 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-c9cc336b-0d1c-4de6-b5dc-e3ade970bc4e req-d6384ee9-8517-417d-8367-6d2ad1824955 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:58.284458 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-c9cc336b-0d1c-4de6-b5dc-e3ade970bc4e req-d6384ee9-8517-417d-8367-6d2ad1824955 service nova] Creating event network-vif-deleted:9c0d24b4-f3c7-444b-9f46-dff7b9217185 for instance 8e670908-5bb6-49ad-92f3-dad1b4df1b5a on n-h1-836830-18 Sep 14 09:05:58.296840 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-c9cc336b-0d1c-4de6-b5dc-e3ade970bc4e req-d6384ee9-8517-417d-8367-6d2ad1824955 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045077 Sep 14 09:05:58.301485 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1931/3888] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:05:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:05:58.395149 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-9363a692-d054-43c0-a39d-4ddbbb4dbc02 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:58.407653 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-9363a692-d054-43c0-a39d-4ddbbb4dbc02 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105" status: 200 len: 1364 microversion: 2.1 time: 0.483132 Sep 14 09:05:58.408895 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1958/3889] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:05:57 2022] GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105 => generated 1364 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:05:58.851023 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-01555dfc-c2a9-4e82-903f-431cf58b37c2 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:58.855745 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-01555dfc-c2a9-4e82-903f-431cf58b37c2 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] [instance: bb353760-fa41-4b09-a8c2-63b39e7d3639] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:05:58.873094 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-01555dfc-c2a9-4e82-903f-431cf58b37c2 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:58.873925 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-01555dfc-c2a9-4e82-903f-431cf58b37c2 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:58.877458 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-01555dfc-c2a9-4e82-903f-431cf58b37c2 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:58.880467 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-01555dfc-c2a9-4e82-903f-431cf58b37c2 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:58.881423 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-01555dfc-c2a9-4e82-903f-431cf58b37c2 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:58.883403 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-01555dfc-c2a9-4e82-903f-431cf58b37c2 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:58.929682 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a0af59a9-a5d7-4bb5-91a1-0ef355f49f9d tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '.version_select at 0x7f7d443ae0d0>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:59.350979 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-01555dfc-c2a9-4e82-903f-431cf58b37c2 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bda029c9974af09e83631e04459d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21195f8ae7b4267a128e890025c0b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:59.352754 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-a0af59a9-a5d7-4bb5-91a1-0ef355f49f9d tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute/v2.1/images/a62c47ed-e003-4adc-bdf0-222dc0068fa9" status: 200 len: 1414 microversion: 2.1 time: 0.426469 Sep 14 09:05:59.355685 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1959/3890] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:05:58 2022] GET /compute/v2.1/images/a62c47ed-e003-4adc-bdf0-222dc0068fa9 => generated 1414 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:05:59.382172 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-01555dfc-c2a9-4e82-903f-431cf58b37c2 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55bda029c9974af09e83631e04459d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21195f8ae7b4267a128e890025c0b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:59.388372 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-4c67c24b-4b7b-4039-b75d-96717cd48495 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:59.389071 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-4c67c24b-4b7b-4039-b75d-96717cd48495 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: 8e670908-5bb6-49ad-92f3-dad1b4df1b5a] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:05:59.389490 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-01555dfc-c2a9-4e82-903f-431cf58b37c2 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55bda029c9974af09e83631e04459d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21195f8ae7b4267a128e890025c0b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:59.393872 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-01555dfc-c2a9-4e82-903f-431cf58b37c2 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] 10.222.0.60 "GET /compute/v2.1/servers/bb353760-fa41-4b09-a8c2-63b39e7d3639" status: 200 len: 1365 microversion: 2.47 time: 0.555895 Sep 14 09:05:59.413912 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1932/3891] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:05:58 2022] GET /compute/v2.1/servers/bb353760-fa41-4b09-a8c2-63b39e7d3639 => generated 1365 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:05:59.435241 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e817a754-e7d7-4bb1-8bf3-264a0c751784 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:05:59.436461 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e817a754-e7d7-4bb1-8bf3-264a0c751784 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:05:59.449146 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e817a754-e7d7-4bb1-8bf3-264a0c751784 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:59.450339 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e817a754-e7d7-4bb1-8bf3-264a0c751784 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:59.451129 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e817a754-e7d7-4bb1-8bf3-264a0c751784 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:59.452183 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e817a754-e7d7-4bb1-8bf3-264a0c751784 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:59.455885 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e817a754-e7d7-4bb1-8bf3-264a0c751784 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:59.456640 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e817a754-e7d7-4bb1-8bf3-264a0c751784 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:59.474242 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4c67c24b-4b7b-4039-b75d-96717cd48495 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:59.482291 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4c67c24b-4b7b-4039-b75d-96717cd48495 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:59.483156 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4c67c24b-4b7b-4039-b75d-96717cd48495 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:59.484136 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4c67c24b-4b7b-4039-b75d-96717cd48495 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:59.492470 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4c67c24b-4b7b-4039-b75d-96717cd48495 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:59.493214 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4c67c24b-4b7b-4039-b75d-96717cd48495 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:59.697085 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4c67c24b-4b7b-4039-b75d-96717cd48495 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:05:59.697505 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4c67c24b-4b7b-4039-b75d-96717cd48495 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:05:59.697956 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4c67c24b-4b7b-4039-b75d-96717cd48495 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:05:59.698428 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.objects.instance [None req-4c67c24b-4b7b-4039-b75d-96717cd48495 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lazy-loading 'fault' on Instance uuid 8e670908-5bb6-49ad-92f3-dad1b4df1b5a {{(pid=128758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:05:59.908684 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-4c67c24b-4b7b-4039-b75d-96717cd48495 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:05:59.921977 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-4c67c24b-4b7b-4039-b75d-96717cd48495 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/8e670908-5bb6-49ad-92f3-dad1b4df1b5a" status: 200 len: 1306 microversion: 2.1 time: 0.562691 Sep 14 09:05:59.922635 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1960/3892] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:05:59 2022] GET /compute/v2.1/servers/8e670908-5bb6-49ad-92f3-dad1b4df1b5a => generated 1306 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:06:00.065779 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-e817a754-e7d7-4bb1-8bf3-264a0c751784 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:06:00.087562 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:06:00.095186 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e817a754-e7d7-4bb1-8bf3-264a0c751784 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105" status: 200 len: 1364 microversion: 2.1 time: 0.663931 Sep 14 09:06:00.096605 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1933/3893] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:05:59 2022] GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105 => generated 1364 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:06:00.372133 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-8522478b-e659-48f0-abaa-6fa7bc4ab54f tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '.version_select at 0x7f7d443fc040>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:00.430572 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d5e64734-5eab-4c5e-8441-30f5ca02d37d tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:00.431266 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-d5e64734-5eab-4c5e-8441-30f5ca02d37d tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] [instance: bb353760-fa41-4b09-a8c2-63b39e7d3639] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:00.454534 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d5e64734-5eab-4c5e-8441-30f5ca02d37d tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:00.454990 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d5e64734-5eab-4c5e-8441-30f5ca02d37d tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:00.455641 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d5e64734-5eab-4c5e-8441-30f5ca02d37d tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:00.456572 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d5e64734-5eab-4c5e-8441-30f5ca02d37d tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:00.458143 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d5e64734-5eab-4c5e-8441-30f5ca02d37d tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:00.459590 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-8522478b-e659-48f0-abaa-6fa7bc4ab54f tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute/v2.1/images/a62c47ed-e003-4adc-bdf0-222dc0068fa9" status: 200 len: 1423 microversion: 2.1 time: 0.091949 Sep 14 09:06:00.460339 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d5e64734-5eab-4c5e-8441-30f5ca02d37d tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:00.473154 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1961/3894] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:06:00 2022] GET /compute/v2.1/images/a62c47ed-e003-4adc-bdf0-222dc0068fa9 => generated 1423 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:06:00.491082 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-09627c1f-14b4-4234-8dc3-0c2aa69e688e tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '.version_select at 0x7f7d443c65e0>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:00.570200 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-09627c1f-14b4-4234-8dc3-0c2aa69e688e tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute/v2.1/images/a62c47ed-e003-4adc-bdf0-222dc0068fa9" status: 200 len: 1423 microversion: 2.1 time: 0.084497 Sep 14 09:06:00.571413 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1962/3895] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:06:00 2022] GET /compute/v2.1/images/a62c47ed-e003-4adc-bdf0-222dc0068fa9 => generated 1423 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:06:00.589744 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-d5e64734-5eab-4c5e-8441-30f5ca02d37d tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bda029c9974af09e83631e04459d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21195f8ae7b4267a128e890025c0b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:06:00.592941 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-4be62231-2b01-470e-b45b-e2c1def77b64 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '.version_select at 0x7f7d443c6700>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:00.602696 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-d5e64734-5eab-4c5e-8441-30f5ca02d37d tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55bda029c9974af09e83631e04459d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21195f8ae7b4267a128e890025c0b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:06:00.604837 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-d5e64734-5eab-4c5e-8441-30f5ca02d37d tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55bda029c9974af09e83631e04459d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21195f8ae7b4267a128e890025c0b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:06:00.606283 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d5e64734-5eab-4c5e-8441-30f5ca02d37d tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] 10.222.0.60 "GET /compute/v2.1/servers/bb353760-fa41-4b09-a8c2-63b39e7d3639" status: 200 len: 1365 microversion: 2.47 time: 0.184407 Sep 14 09:06:00.623493 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1934/3896] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:06:00 2022] GET /compute/v2.1/servers/bb353760-fa41-4b09-a8c2-63b39e7d3639 => generated 1365 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:06:00.950326 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f81e0ee8-c50f-4761-8f35-39135c28da8d tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:00.951276 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f81e0ee8-c50f-4761-8f35-39135c28da8d tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: 8e670908-5bb6-49ad-92f3-dad1b4df1b5a] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:00.971383 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f81e0ee8-c50f-4761-8f35-39135c28da8d tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:00.973289 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f81e0ee8-c50f-4761-8f35-39135c28da8d tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:00.976661 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f81e0ee8-c50f-4761-8f35-39135c28da8d tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:00.977645 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f81e0ee8-c50f-4761-8f35-39135c28da8d tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:00.982277 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f81e0ee8-c50f-4761-8f35-39135c28da8d tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:00.984956 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f81e0ee8-c50f-4761-8f35-39135c28da8d tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:01.010144 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-f81e0ee8-c50f-4761-8f35-39135c28da8d tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] HTTP exception thrown: Instance 8e670908-5bb6-49ad-92f3-dad1b4df1b5a could not be found. Sep 14 09:06:01.012569 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f81e0ee8-c50f-4761-8f35-39135c28da8d tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Request method failure captured: Sep 14 09:06:01.012569 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/8e670908-5bb6-49ad-92f3-dad1b4df1b5a HTTP/1.1 Sep 14 09:06:01.012569 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:06:01.012569 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:06:01.012569 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:06:01.012569 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:06:01.012569 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:06:01.012569 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:06:01.012569 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:06:01.012569 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:06:01.012569 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZk2EvHIWQyXATvY4f6phbqF3DzIIyaJjJFCE11LxTKbrsndvuk5zoyyEUR0VXx32_kFjD0I6jBROuj0ZPSHQav7u9FFvOPFGrPkf9qZrgXY9k3zAUFrOVfwLECoLZOolubyCPUAGSEOi_HvFIP_Dd_DCbUCKDEGGLtdnAzy2tLCxHs Sep 14 09:06:01.012569 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:06:01.012569 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:06:01.012569 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:06:01.012569 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:06:01.012569 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:06:01.012569 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:06:01.012569 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 6907b82c9d5c4a23a63bbeec31c3c365 Sep 14 09:06:01.012569 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ServersNegativeTestJSON-1654813540 Sep 14 09:06:01.012569 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:06:01.012569 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:06:01.012569 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6907b82c9d5c4a23a63bbeec31c3c365"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6907b82c9d5c4a23a63bbeec31c3c365"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6907b82c9d5c4a23a63bbeec31c3c365"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6907b82c9d5c4a23a63bbeec31c3c365"}]}] Sep 14 09:06:01.012569 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ServersNegativeTestJSON-1654813540 Sep 14 09:06:01.012569 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 6907b82c9d5c4a23a63bbeec31c3c365 Sep 14 09:06:01.012569 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1654813540 Sep 14 09:06:01.012569 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ServersNegativeTestJSON-1654813540-project Sep 14 09:06:01.012569 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:06:01.012569 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:06:01.012569 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 79583c4e80a04f138927f09eb4e170f4 Sep 14 09:06:01.012569 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ServersNegativeTestJSON-1654813540-project Sep 14 09:06:01.012569 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:06:01.012569 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance 8e670908-5bb6-49ad-92f3-dad1b4df1b5a could not be found. Sep 14 09:06:01.012569 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '8e670908-5bb6-49ad-92f3-dad1b4df1b5a'} Sep 14 09:06:01.012569 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:06:01.012569 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:06:01.012569 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:06:01.012569 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:06:01.012569 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:06:01.012569 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:06:01.012569 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:06:01.012569 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:06:01.012569 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:06:01.012569 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:06:01.012569 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e670908-5bb6-49ad-92f3-dad1b4df1b5a could not be found. Sep 14 09:06:01.012569 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:01.012569 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:06:01.012569 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:01.012569 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:06:01.012569 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:06:01.012569 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:06:01.012569 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:06:01.012569 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:06:01.012569 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:06:01.012569 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:06:01.012569 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:06:01.012569 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:06:01.012569 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:06:01.012569 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:06:01.012569 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:06:01.012569 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:06:01.012569 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e670908-5bb6-49ad-92f3-dad1b4df1b5a could not be found. Sep 14 09:06:01.012569 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:01.012569 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:06:01.012569 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:01.017414 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:06:01.017414 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:06:01.017414 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:06:01.017414 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:06:01.017414 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:06:01.017414 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e670908-5bb6-49ad-92f3-dad1b4df1b5a could not be found. Sep 14 09:06:01.017414 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:01.017414 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f81e0ee8-c50f-4761-8f35-39135c28da8d tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Returning 404 to user: Instance 8e670908-5bb6-49ad-92f3-dad1b4df1b5a could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:06:01.017414 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f81e0ee8-c50f-4761-8f35-39135c28da8d tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/8e670908-5bb6-49ad-92f3-dad1b4df1b5a" status: 404 len: 111 microversion: 2.1 time: 0.069063 Sep 14 09:06:01.019283 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1935/3897] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:06:00 2022] GET /compute/v2.1/servers/8e670908-5bb6-49ad-92f3-dad1b4df1b5a => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 14 09:06:01.027017 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-55c3e8d4-daac-481c-adc6-d2991b4529e6 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:01.027657 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-55c3e8d4-daac-481c-adc6-d2991b4529e6 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:01.039963 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-55c3e8d4-daac-481c-adc6-d2991b4529e6 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:01.040472 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-55c3e8d4-daac-481c-adc6-d2991b4529e6 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:01.040922 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-55c3e8d4-daac-481c-adc6-d2991b4529e6 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:01.041639 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-55c3e8d4-daac-481c-adc6-d2991b4529e6 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:01.042296 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-55c3e8d4-daac-481c-adc6-d2991b4529e6 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:01.042906 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-55c3e8d4-daac-481c-adc6-d2991b4529e6 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:01.563797 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-55c3e8d4-daac-481c-adc6-d2991b4529e6 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:06:01.578860 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-55c3e8d4-daac-481c-adc6-d2991b4529e6 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1506 microversion: 2.1 time: 0.558262 Sep 14 09:06:01.580186 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1936/3898] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:06:01 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1506 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:06:01.586137 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-72b6a6b2-7aee-415b-b9c5-c807d0a81d4d tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:01.587281 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-72b6a6b2-7aee-415b-b9c5-c807d0a81d4d tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:01.594846 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-72b6a6b2-7aee-415b-b9c5-c807d0a81d4d tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:01.595669 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-72b6a6b2-7aee-415b-b9c5-c807d0a81d4d tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:01.596311 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-72b6a6b2-7aee-415b-b9c5-c807d0a81d4d tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:01.597555 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-72b6a6b2-7aee-415b-b9c5-c807d0a81d4d tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:01.598727 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-72b6a6b2-7aee-415b-b9c5-c807d0a81d4d tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:01.599547 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-72b6a6b2-7aee-415b-b9c5-c807d0a81d4d tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:01.639816 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-4be62231-2b01-470e-b45b-e2c1def77b64 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "DELETE /compute/v2.1/images/a62c47ed-e003-4adc-bdf0-222dc0068fa9" status: 204 len: 0 microversion: 2.1 time: 1.057596 Sep 14 09:06:01.640781 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1963/3899] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:06:00 2022] DELETE /compute/v2.1/images/a62c47ed-e003-4adc-bdf0-222dc0068fa9 => generated 0 bytes in 1059 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:06:01.648422 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-52c78376-acfd-4474-b15a-fbb5e99f81bf tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:01.649250 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-52c78376-acfd-4474-b15a-fbb5e99f81bf tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] [instance: bb353760-fa41-4b09-a8c2-63b39e7d3639] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:01.662481 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-52c78376-acfd-4474-b15a-fbb5e99f81bf tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:01.665631 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-52c78376-acfd-4474-b15a-fbb5e99f81bf tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:01.667373 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-52c78376-acfd-4474-b15a-fbb5e99f81bf tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:01.669267 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-52c78376-acfd-4474-b15a-fbb5e99f81bf tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:01.670093 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-52c78376-acfd-4474-b15a-fbb5e99f81bf tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:01.672341 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-52c78376-acfd-4474-b15a-fbb5e99f81bf tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:01.861354 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-52c78376-acfd-4474-b15a-fbb5e99f81bf tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bda029c9974af09e83631e04459d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21195f8ae7b4267a128e890025c0b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:06:01.881822 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-52c78376-acfd-4474-b15a-fbb5e99f81bf tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55bda029c9974af09e83631e04459d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21195f8ae7b4267a128e890025c0b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:06:01.888000 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-52c78376-acfd-4474-b15a-fbb5e99f81bf tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55bda029c9974af09e83631e04459d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21195f8ae7b4267a128e890025c0b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:06:01.889550 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-52c78376-acfd-4474-b15a-fbb5e99f81bf tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] 10.222.0.60 "GET /compute/v2.1/servers/bb353760-fa41-4b09-a8c2-63b39e7d3639" status: 200 len: 1365 microversion: 2.47 time: 0.247614 Sep 14 09:06:01.891752 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1964/3900] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:06:01 2022] GET /compute/v2.1/servers/bb353760-fa41-4b09-a8c2-63b39e7d3639 => generated 1365 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:06:01.909540 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-cbc86e51-ebd3-47d9-8925-98c43f57c6b8 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:01.910295 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-cbc86e51-ebd3-47d9-8925-98c43f57c6b8 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] [instance: 70b0fcd2-6fc4-4445-96bb-165dccf6c81c] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:01.918891 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cbc86e51-ebd3-47d9-8925-98c43f57c6b8 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:01.922709 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cbc86e51-ebd3-47d9-8925-98c43f57c6b8 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:01.923433 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cbc86e51-ebd3-47d9-8925-98c43f57c6b8 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:01.925152 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cbc86e51-ebd3-47d9-8925-98c43f57c6b8 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:01.927290 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cbc86e51-ebd3-47d9-8925-98c43f57c6b8 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:01.928343 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cbc86e51-ebd3-47d9-8925-98c43f57c6b8 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:01.980193 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-cbc86e51-ebd3-47d9-8925-98c43f57c6b8 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] [instance: 70b0fcd2-6fc4-4445-96bb-165dccf6c81c] Going to try to terminate instance {{(pid=128758) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:06:02.038181 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-72b6a6b2-7aee-415b-b9c5-c807d0a81d4d tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:06:02.051440 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-72b6a6b2-7aee-415b-b9c5-c807d0a81d4d tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105" status: 200 len: 1364 microversion: 2.1 time: 0.467221 Sep 14 09:06:02.062963 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1937/3901] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:06:01 2022] GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105 => generated 1364 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:06:02.062963 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-489b0433-6fbe-4924-a912-463412d74367 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "networks": [{"uuid": "2616a0b0-fea1-46f8-bf23-608a226da1ef"}]}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:06:02.071220 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-489b0433-6fbe-4924-a912-463412d74367 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Request method failure captured: Sep 14 09:06:02.071220 n-d-836830-18 devstack@n-api.service[128759]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 14 09:06:02.071220 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:06:02.071220 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:06:02.071220 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:06:02.071220 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 163 Sep 14 09:06:02.071220 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:06:02.071220 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:06:02.071220 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:06:02.071220 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:06:02.071220 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZk2EvHIWQyXATvY4f6phbqF3DzIIyaJjJFCE11LxTKbrsndvuk5zoyyEUR0VXx32_kFjD0I6jBROuj0ZPSHQav7u9FFvOPFGrPkf9qZrgXY9k3zAUFrOVfwLECoLZOolubyCPUAGSEOi_HvFIP_Dd_DCbUCKDEGGLtdnAzy2tLCxHs Sep 14 09:06:02.071220 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:06:02.071220 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:06:02.071220 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:06:02.071220 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:06:02.071220 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:06:02.071220 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:06:02.071220 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 6907b82c9d5c4a23a63bbeec31c3c365 Sep 14 09:06:02.071220 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ServersNegativeTestJSON-1654813540 Sep 14 09:06:02.071220 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:06:02.071220 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:06:02.071220 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6907b82c9d5c4a23a63bbeec31c3c365"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6907b82c9d5c4a23a63bbeec31c3c365"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6907b82c9d5c4a23a63bbeec31c3c365"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6907b82c9d5c4a23a63bbeec31c3c365"}]}] Sep 14 09:06:02.071220 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ServersNegativeTestJSON-1654813540 Sep 14 09:06:02.071220 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 6907b82c9d5c4a23a63bbeec31c3c365 Sep 14 09:06:02.071220 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1654813540 Sep 14 09:06:02.071220 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ServersNegativeTestJSON-1654813540-project Sep 14 09:06:02.071220 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:06:02.071220 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:06:02.071220 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 79583c4e80a04f138927f09eb4e170f4 Sep 14 09:06:02.071220 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ServersNegativeTestJSON-1654813540-project Sep 14 09:06:02.071220 n-d-836830-18 devstack@n-api.service[128759]: Sep 14 09:06:02.071220 n-d-836830-18 devstack@n-api.service[128759]: {"server": {"name": 12345, "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "networks": [{"uuid": "2616a0b0-fea1-46f8-bf23-608a226da1ef"}]}} Sep 14 09:06:02.071220 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:06:02.071220 n-d-836830-18 devstack@n-api.service[128759]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Sep 14 09:06:02.071220 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'body': {'server': {'name': 12345, 'imageRef': 'bff4ab7f-4846-441f-8940-d96fec4c28e9', 'flavorRef': '452', 'networks': [{'uuid': '2616a0b0-fea1-46f8-bf23-608a226da1ef'}]}}} Sep 14 09:06:02.071220 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:06:02.071220 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:06:02.071220 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 14 09:06:02.071220 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 14 09:06:02.071220 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 14 09:06:02.071220 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise error Sep 14 09:06:02.071220 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Sep 14 09:06:02.071220 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:02.071220 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Sep 14 09:06:02.071220 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 14 09:06:02.071220 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:02.071220 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 14 09:06:02.071220 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi 12345 Sep 14 09:06:02.071220 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:02.071220 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:06:02.071220 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:02.071220 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:06:02.071220 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:06:02.071220 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:06:02.071220 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:06:02.071220 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:06:02.071220 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:06:02.071220 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:06:02.071220 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:06:02.071220 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:06:02.071220 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 14 09:06:02.071220 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 14 09:06:02.071220 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 14 09:06:02.071220 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 14 09:06:02.071220 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 14 09:06:02.074176 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 14 09:06:02.074176 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Sep 14 09:06:02.074176 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:02.074176 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:06:02.074176 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:02.074176 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:06:02.074176 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:06:02.074176 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:06:02.074176 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 14 09:06:02.074176 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 14 09:06:02.074176 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Sep 14 09:06:02.074176 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:02.074176 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-489b0433-6fbe-4924-a912-463412d74367 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:06:02.075554 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-489b0433-6fbe-4924-a912-463412d74367 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.019352 Sep 14 09:06:02.078915 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1938/3902] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 09:06:02 2022] POST /compute/v2.1/servers => generated 127 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 14 09:06:02.086332 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-417ad68f-b2e8-4633-80a4-90245e114832 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:02.091202 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-417ad68f-b2e8-4633-80a4-90245e114832 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:02.111306 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-417ad68f-b2e8-4633-80a4-90245e114832 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:02.113698 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-417ad68f-b2e8-4633-80a4-90245e114832 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:02.115830 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-417ad68f-b2e8-4633-80a4-90245e114832 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:02.119263 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-417ad68f-b2e8-4633-80a4-90245e114832 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:02.122902 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-417ad68f-b2e8-4633-80a4-90245e114832 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:02.123399 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-417ad68f-b2e8-4633-80a4-90245e114832 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:02.167772 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-cbc86e51-ebd3-47d9-8925-98c43f57c6b8 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "DELETE /compute/v2.1/servers/70b0fcd2-6fc4-4445-96bb-165dccf6c81c" status: 204 len: 0 microversion: 2.1 time: 0.274399 Sep 14 09:06:02.169030 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1965/3903] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:06:01 2022] DELETE /compute/v2.1/servers/70b0fcd2-6fc4-4445-96bb-165dccf6c81c => generated 0 bytes in 277 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:06:02.192524 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-2dfd646e-d55e-4eb6-8562-850bdd855e2e req-385f034b-a465-46e9-b45b-362e9c2c292d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8450d385-d5d9-4c86-9ece-b3bbf9ed1105", "name": "network-vif-plugged", "status": "completed", "tag": "eb873b1a-8b40-4eb4-a329-cf733d9ed342"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:06:02.205613 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-2dfd646e-d55e-4eb6-8562-850bdd855e2e req-385f034b-a465-46e9-b45b-362e9c2c292d service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:02.206172 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-2dfd646e-d55e-4eb6-8562-850bdd855e2e req-385f034b-a465-46e9-b45b-362e9c2c292d service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:02.206611 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-2dfd646e-d55e-4eb6-8562-850bdd855e2e req-385f034b-a465-46e9-b45b-362e9c2c292d service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:02.221597 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-2dfd646e-d55e-4eb6-8562-850bdd855e2e req-385f034b-a465-46e9-b45b-362e9c2c292d service nova] Creating event network-vif-plugged:eb873b1a-8b40-4eb4-a329-cf733d9ed342 for instance 8450d385-d5d9-4c86-9ece-b3bbf9ed1105 on n-h1-836830-18 Sep 14 09:06:02.226992 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-2dfd646e-d55e-4eb6-8562-850bdd855e2e req-385f034b-a465-46e9-b45b-362e9c2c292d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050123 Sep 14 09:06:02.227857 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1966/3904] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:06:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:06:02.465696 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-417ad68f-b2e8-4633-80a4-90245e114832 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:06:02.475328 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-417ad68f-b2e8-4633-80a4-90245e114832 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1506 microversion: 2.1 time: 0.395255 Sep 14 09:06:02.487397 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1939/3905] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:06:02 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1506 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:06:02.500606 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-65d1c211-ae9e-491b-8d68-c5d6f1ab8d75 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:02.501547 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-65d1c211-ae9e-491b-8d68-c5d6f1ab8d75 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:02.508982 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-65d1c211-ae9e-491b-8d68-c5d6f1ab8d75 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:02.509432 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-65d1c211-ae9e-491b-8d68-c5d6f1ab8d75 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:02.510231 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-65d1c211-ae9e-491b-8d68-c5d6f1ab8d75 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:02.511210 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-65d1c211-ae9e-491b-8d68-c5d6f1ab8d75 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:02.511831 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-65d1c211-ae9e-491b-8d68-c5d6f1ab8d75 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:02.512401 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-65d1c211-ae9e-491b-8d68-c5d6f1ab8d75 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:02.552604 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-7f2535f7-9997-4c31-a356-8f54b9862621 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1019677431", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "networks": [{"uuid": "25039276-e7b2-497e-8f28-ebadf4eb94bc"}]}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:06:02.638435 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.network.neutron [None req-7f2535f7-9997-4c31-a356-8f54b9862621 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] validate_networks() for [('25039276-e7b2-497e-8f28-ebadf4eb94bc', None, None, None, None, None)] {{(pid=128759) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:06:02.885186 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-65d1c211-ae9e-491b-8d68-c5d6f1ab8d75 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:06:02.904871 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-65d1c211-ae9e-491b-8d68-c5d6f1ab8d75 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1506 microversion: 2.1 time: 0.408605 Sep 14 09:06:02.907757 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1967/3906] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:06:02 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1506 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:06:02.921408 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-dbfcdea3-b972-4078-90c7-c504c88ab946 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:02.922360 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-dbfcdea3-b972-4078-90c7-c504c88ab946 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] [instance: bb353760-fa41-4b09-a8c2-63b39e7d3639] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:02.964375 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dbfcdea3-b972-4078-90c7-c504c88ab946 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:02.965170 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dbfcdea3-b972-4078-90c7-c504c88ab946 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:02.965746 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dbfcdea3-b972-4078-90c7-c504c88ab946 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:02.966948 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dbfcdea3-b972-4078-90c7-c504c88ab946 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:02.967597 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dbfcdea3-b972-4078-90c7-c504c88ab946 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:02.968018 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dbfcdea3-b972-4078-90c7-c504c88ab946 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:03.040619 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dbfcdea3-b972-4078-90c7-c504c88ab946 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:03.042568 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dbfcdea3-b972-4078-90c7-c504c88ab946 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:03.043046 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dbfcdea3-b972-4078-90c7-c504c88ab946 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:03.043518 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.objects.instance [None req-dbfcdea3-b972-4078-90c7-c504c88ab946 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Lazy-loading 'fault' on Instance uuid bb353760-fa41-4b09-a8c2-63b39e7d3639 {{(pid=128758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:06:03.199243 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-dbfcdea3-b972-4078-90c7-c504c88ab946 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bda029c9974af09e83631e04459d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21195f8ae7b4267a128e890025c0b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:06:03.212062 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-dbfcdea3-b972-4078-90c7-c504c88ab946 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55bda029c9974af09e83631e04459d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21195f8ae7b4267a128e890025c0b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:06:03.213812 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-dbfcdea3-b972-4078-90c7-c504c88ab946 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55bda029c9974af09e83631e04459d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21195f8ae7b4267a128e890025c0b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:06:03.215571 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-dbfcdea3-b972-4078-90c7-c504c88ab946 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] 10.222.0.60 "GET /compute/v2.1/servers/bb353760-fa41-4b09-a8c2-63b39e7d3639" status: 200 len: 1370 microversion: 2.47 time: 0.298895 Sep 14 09:06:03.216780 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1968/3907] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:06:02 2022] GET /compute/v2.1/servers/bb353760-fa41-4b09-a8c2-63b39e7d3639 => generated 1370 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:06:03.221824 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-2c6d5754-eac3-4317-90bc-c004d2519925 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:03.222707 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-2c6d5754-eac3-4317-90bc-c004d2519925 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:03.230128 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2c6d5754-eac3-4317-90bc-c004d2519925 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:03.230923 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2c6d5754-eac3-4317-90bc-c004d2519925 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:03.231624 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2c6d5754-eac3-4317-90bc-c004d2519925 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:03.233004 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2c6d5754-eac3-4317-90bc-c004d2519925 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:03.234666 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2c6d5754-eac3-4317-90bc-c004d2519925 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:03.236109 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2c6d5754-eac3-4317-90bc-c004d2519925 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:03.793887 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-7f2535f7-9997-4c31-a356-8f54b9862621 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Flavor limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:06:03.794953 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-7f2535f7-9997-4c31-a356-8f54b9862621 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Image limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:06:03.795580 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-7f2535f7-9997-4c31-a356-8f54b9862621 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Flavor pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:06:03.796144 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-7f2535f7-9997-4c31-a356-8f54b9862621 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Image pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:06:03.796709 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-7f2535f7-9997-4c31-a356-8f54b9862621 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:06:03.812781 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7f2535f7-9997-4c31-a356-8f54b9862621 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:03.813544 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7f2535f7-9997-4c31-a356-8f54b9862621 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:03.818781 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7f2535f7-9997-4c31-a356-8f54b9862621 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:03.819916 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7f2535f7-9997-4c31-a356-8f54b9862621 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:03.820633 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7f2535f7-9997-4c31-a356-8f54b9862621 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:03.821294 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7f2535f7-9997-4c31-a356-8f54b9862621 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:03.842124 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-2c6d5754-eac3-4317-90bc-c004d2519925 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:06:03.852687 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-7f2535f7-9997-4c31-a356-8f54b9862621 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Getting quotas for project 62a597fc389b4805bbd3a53ecd17c5b2. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:06:03.863886 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-2c6d5754-eac3-4317-90bc-c004d2519925 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105" status: 200 len: 1364 microversion: 2.1 time: 0.642081 Sep 14 09:06:03.871388 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1969/3908] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:06:03 2022] GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105 => generated 1364 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:06:03.875830 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-7f2535f7-9997-4c31-a356-8f54b9862621 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Getting quotas for user 5165b8fc101c47c7a4370f9007bc5a58 and project 62a597fc389b4805bbd3a53ecd17c5b2. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:06:03.913231 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-7f2535f7-9997-4c31-a356-8f54b9862621 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Going to run 1 instances... {{(pid=128759) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:06:03.919457 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-7f2535f7-9997-4c31-a356-8f54b9862621 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] [instance: ed6976ad-867b-4570-a547-758efc8f622f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128759) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:06:04.050422 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-7f2535f7-9997-4c31-a356-8f54b9862621 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.501875 Sep 14 09:06:04.054404 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1940/3909] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 09:06:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1506 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 14 09:06:04.078409 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c45b0818-7800-4192-94ba-4b1d0da72b15 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:04.079687 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-c45b0818-7800-4192-94ba-4b1d0da72b15 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] [instance: ed6976ad-867b-4570-a547-758efc8f622f] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:04.296146 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-c45b0818-7800-4192-94ba-4b1d0da72b15 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5165b8fc101c47c7a4370f9007bc5a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a597fc389b4805bbd3a53ecd17c5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:06:04.306347 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-c45b0818-7800-4192-94ba-4b1d0da72b15 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute/v2.1/servers/ed6976ad-867b-4570-a547-758efc8f622f" status: 200 len: 1208 microversion: 2.1 time: 0.238916 Sep 14 09:06:04.311182 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1970/3910] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:06:04 2022] GET /compute/v2.1/servers/ed6976ad-867b-4570-a547-758efc8f622f => generated 1208 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:06:04.329396 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c6992e0e-5c50-48b4-b3a0-cbd0f3ad3876 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:04.333110 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-c6992e0e-5c50-48b4-b3a0-cbd0f3ad3876 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] [instance: bb353760-fa41-4b09-a8c2-63b39e7d3639] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:04.354909 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c6992e0e-5c50-48b4-b3a0-cbd0f3ad3876 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:04.367434 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c6992e0e-5c50-48b4-b3a0-cbd0f3ad3876 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:04.368409 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c6992e0e-5c50-48b4-b3a0-cbd0f3ad3876 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:04.373814 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c6992e0e-5c50-48b4-b3a0-cbd0f3ad3876 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:04.376634 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c6992e0e-5c50-48b4-b3a0-cbd0f3ad3876 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:04.378962 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c6992e0e-5c50-48b4-b3a0-cbd0f3ad3876 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:04.493741 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c6992e0e-5c50-48b4-b3a0-cbd0f3ad3876 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:04.494193 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c6992e0e-5c50-48b4-b3a0-cbd0f3ad3876 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:04.500975 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c6992e0e-5c50-48b4-b3a0-cbd0f3ad3876 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:04.501498 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.objects.instance [None req-c6992e0e-5c50-48b4-b3a0-cbd0f3ad3876 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Lazy-loading 'fault' on Instance uuid bb353760-fa41-4b09-a8c2-63b39e7d3639 {{(pid=128758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:06:04.607646 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e0c728e0-318d-48db-b104-2e1cd17d1232 tempest-MultipleCreateNegativeTestJSON-143794353 tempest-MultipleCreateNegativeTestJSON-143794353-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1551513377", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:06:04.611561 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-e0c728e0-318d-48db-b104-2e1cd17d1232 tempest-MultipleCreateNegativeTestJSON-143794353 tempest-MultipleCreateNegativeTestJSON-143794353-project] HTTP exception thrown: min_count must be <= max_count Sep 14 09:06:04.621789 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e0c728e0-318d-48db-b104-2e1cd17d1232 tempest-MultipleCreateNegativeTestJSON-143794353 tempest-MultipleCreateNegativeTestJSON-143794353-project] Request method failure captured: Sep 14 09:06:04.621789 n-d-836830-18 devstack@n-api.service[128759]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 14 09:06:04.621789 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:06:04.621789 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:06:04.621789 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:06:04.621789 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 184 Sep 14 09:06:04.621789 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:06:04.621789 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:06:04.621789 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:06:04.621789 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:06:04.621789 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZl7xNGdOQHQWTGfNVCy2q7p43Y-Ko-XQSV42BitZXDslNbP8F7jLwYWtOKozaT0xGJwTAyspz4yJIiBYHLzj14gX-tgjnWROvYgV0icLJmxnRlh2tj2roeBhlK7qlfsM9W14R9ddXiwjRmRfzSu7sdIjl_okQ1SOKQJ-vFmNzlM3dI Sep 14 09:06:04.621789 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:06:04.621789 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:06:04.621789 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:06:04.621789 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:06:04.621789 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:06:04.621789 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:06:04.621789 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 43d434ddd9234957807891694e53b1c6 Sep 14 09:06:04.621789 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-143794353 Sep 14 09:06:04.621789 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:06:04.621789 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:06:04.621789 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/43d434ddd9234957807891694e53b1c6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_43d434ddd9234957807891694e53b1c6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/43d434ddd9234957807891694e53b1c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/43d434ddd9234957807891694e53b1c6"}]}] Sep 14 09:06:04.621789 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-143794353 Sep 14 09:06:04.621789 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 43d434ddd9234957807891694e53b1c6 Sep 14 09:06:04.621789 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-143794353 Sep 14 09:06:04.621789 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-MultipleCreateNegativeTestJSON-143794353-project Sep 14 09:06:04.621789 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:06:04.621789 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:06:04.621789 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 6b0d22a74d2349a3ae3b3d03545b26ac Sep 14 09:06:04.621789 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-143794353-project Sep 14 09:06:04.621789 n-d-836830-18 devstack@n-api.service[128759]: Sep 14 09:06:04.621789 n-d-836830-18 devstack@n-api.service[128759]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1551513377", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "min_count": 3, "max_count": 2}} Sep 14 09:06:04.621789 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:06:04.621789 n-d-836830-18 devstack@n-api.service[128759]: exception: min_count must be <= max_count Sep 14 09:06:04.621789 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1551513377', 'imageRef': 'bff4ab7f-4846-441f-8940-d96fec4c28e9', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Sep 14 09:06:04.621789 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:06:04.621789 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:06:04.621789 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:06:04.621789 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:06:04.621789 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:06:04.621789 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:06:04.621789 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:06:04.621789 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:06:04.621789 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:06:04.621789 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:06:04.621789 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:06:04.621789 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:06:04.621789 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:06:04.621789 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:06:04.621789 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 14 09:06:04.621789 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Sep 14 09:06:04.621789 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Sep 14 09:06:04.621789 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Sep 14 09:06:04.621789 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:04.621789 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:06:04.621789 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:04.621789 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:06:04.621789 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:06:04.621789 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:06:04.621789 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:06:04.621789 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:06:04.621789 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Sep 14 09:06:04.621789 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:04.625361 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e0c728e0-318d-48db-b104-2e1cd17d1232 tempest-MultipleCreateNegativeTestJSON-143794353 tempest-MultipleCreateNegativeTestJSON-143794353-project] Returning 400 to user: min_count must be <= max_count {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:06:04.625361 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e0c728e0-318d-48db-b104-2e1cd17d1232 tempest-MultipleCreateNegativeTestJSON-143794353 tempest-MultipleCreateNegativeTestJSON-143794353-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.394335 Sep 14 09:06:04.631493 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1941/3911] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 09:06:04 2022] POST /compute/v2.1/servers => generated 74 bytes in 401 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 14 09:06:04.655158 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-c6992e0e-5c50-48b4-b3a0-cbd0f3ad3876 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bda029c9974af09e83631e04459d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21195f8ae7b4267a128e890025c0b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:06:04.655385 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-969dbab2-9cfe-42a2-a5ca-9e253b2336c9 req-b80d7089-94be-433b-87cc-b25554783493 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70b0fcd2-6fc4-4445-96bb-165dccf6c81c", "name": "network-vif-unplugged", "status": "completed", "tag": "03d9d813-028b-4c20-8b8f-dff576919005"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:06:04.682323 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-c6992e0e-5c50-48b4-b3a0-cbd0f3ad3876 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55bda029c9974af09e83631e04459d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21195f8ae7b4267a128e890025c0b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:06:04.683851 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-c6992e0e-5c50-48b4-b3a0-cbd0f3ad3876 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55bda029c9974af09e83631e04459d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21195f8ae7b4267a128e890025c0b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:06:04.685107 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-c6992e0e-5c50-48b4-b3a0-cbd0f3ad3876 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] 10.222.0.60 "GET /compute/v2.1/servers/bb353760-fa41-4b09-a8c2-63b39e7d3639" status: 200 len: 1370 microversion: 2.47 time: 0.372097 Sep 14 09:06:04.690424 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-969dbab2-9cfe-42a2-a5ca-9e253b2336c9 req-b80d7089-94be-433b-87cc-b25554783493 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:04.691976 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-969dbab2-9cfe-42a2-a5ca-9e253b2336c9 req-b80d7089-94be-433b-87cc-b25554783493 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:04.692545 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-969dbab2-9cfe-42a2-a5ca-9e253b2336c9 req-b80d7089-94be-433b-87cc-b25554783493 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:04.703379 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1971/3912] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:06:04 2022] GET /compute/v2.1/servers/bb353760-fa41-4b09-a8c2-63b39e7d3639 => generated 1370 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:06:04.717653 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-969dbab2-9cfe-42a2-a5ca-9e253b2336c9 req-b80d7089-94be-433b-87cc-b25554783493 service nova] Creating event network-vif-unplugged:03d9d813-028b-4c20-8b8f-dff576919005 for instance 70b0fcd2-6fc4-4445-96bb-165dccf6c81c on n-h2-836830-18 Sep 14 09:06:04.724405 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-969dbab2-9cfe-42a2-a5ca-9e253b2336c9 req-b80d7089-94be-433b-87cc-b25554783493 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.090326 Sep 14 09:06:04.725518 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1942/3913] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:06:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:06:04.890031 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a4e4bc2d-b103-42c8-aafd-433abc541f52 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:04.890871 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-a4e4bc2d-b103-42c8-aafd-433abc541f52 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:04.903702 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a4e4bc2d-b103-42c8-aafd-433abc541f52 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:04.906458 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a4e4bc2d-b103-42c8-aafd-433abc541f52 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:04.907104 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a4e4bc2d-b103-42c8-aafd-433abc541f52 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:04.908020 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a4e4bc2d-b103-42c8-aafd-433abc541f52 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:04.910612 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a4e4bc2d-b103-42c8-aafd-433abc541f52 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:04.917912 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a4e4bc2d-b103-42c8-aafd-433abc541f52 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:04.925586 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:06:05.077094 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-fab6cec3-43df-471d-83d2-d123e1ef5f27 tempest-MultipleCreateNegativeTestJSON-143794353 tempest-MultipleCreateNegativeTestJSON-143794353-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-545955928", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "max_count": 0}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:06:05.087659 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-fab6cec3-43df-471d-83d2-d123e1ef5f27 tempest-MultipleCreateNegativeTestJSON-143794353 tempest-MultipleCreateNegativeTestJSON-143794353-project] Request method failure captured: Sep 14 09:06:05.087659 n-d-836830-18 devstack@n-api.service[128759]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 14 09:06:05.087659 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:06:05.087659 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:06:05.087659 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:06:05.087659 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 167 Sep 14 09:06:05.087659 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:06:05.087659 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:06:05.087659 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:06:05.087659 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:06:05.087659 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZl7xNGdOQHQWTGfNVCy2q7p43Y-Ko-XQSV42BitZXDslNbP8F7jLwYWtOKozaT0xGJwTAyspz4yJIiBYHLzj14gX-tgjnWROvYgV0icLJmxnRlh2tj2roeBhlK7qlfsM9W14R9ddXiwjRmRfzSu7sdIjl_okQ1SOKQJ-vFmNzlM3dI Sep 14 09:06:05.087659 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:06:05.087659 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:06:05.087659 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:06:05.087659 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:06:05.087659 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:06:05.087659 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:06:05.087659 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 43d434ddd9234957807891694e53b1c6 Sep 14 09:06:05.087659 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-143794353 Sep 14 09:06:05.087659 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:06:05.087659 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:06:05.087659 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/43d434ddd9234957807891694e53b1c6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_43d434ddd9234957807891694e53b1c6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/43d434ddd9234957807891694e53b1c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/43d434ddd9234957807891694e53b1c6"}]}] Sep 14 09:06:05.087659 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-143794353 Sep 14 09:06:05.087659 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 43d434ddd9234957807891694e53b1c6 Sep 14 09:06:05.087659 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-143794353 Sep 14 09:06:05.087659 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-MultipleCreateNegativeTestJSON-143794353-project Sep 14 09:06:05.087659 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:06:05.087659 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:06:05.087659 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 6b0d22a74d2349a3ae3b3d03545b26ac Sep 14 09:06:05.087659 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-143794353-project Sep 14 09:06:05.087659 n-d-836830-18 devstack@n-api.service[128759]: Sep 14 09:06:05.087659 n-d-836830-18 devstack@n-api.service[128759]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-545955928", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "max_count": 0}} Sep 14 09:06:05.087659 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:06:05.087659 n-d-836830-18 devstack@n-api.service[128759]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Sep 14 09:06:05.087659 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-545955928', 'imageRef': 'bff4ab7f-4846-441f-8940-d96fec4c28e9', 'flavorRef': '452', 'max_count': 0}}} Sep 14 09:06:05.087659 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:06:05.087659 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:06:05.087659 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 14 09:06:05.087659 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 14 09:06:05.087659 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 14 09:06:05.087659 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise error Sep 14 09:06:05.087659 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 14 09:06:05.087659 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:05.087659 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Sep 14 09:06:05.087659 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi {'minLength': 1, Sep 14 09:06:05.087659 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi 'minimum': 1, Sep 14 09:06:05.087659 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Sep 14 09:06:05.087659 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Sep 14 09:06:05.087659 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:05.087659 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 14 09:06:05.087659 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi 0 Sep 14 09:06:05.087659 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:05.087659 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:06:05.087659 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:05.087659 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:06:05.087659 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:06:05.087659 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:06:05.087659 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:06:05.087659 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:06:05.087659 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:06:05.087659 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:06:05.087659 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:06:05.087659 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:06:05.087659 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 14 09:06:05.087659 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 14 09:06:05.091927 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 14 09:06:05.091927 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 14 09:06:05.091927 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 14 09:06:05.091927 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 14 09:06:05.091927 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Sep 14 09:06:05.091927 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:05.091927 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:06:05.091927 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:05.091927 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:06:05.091927 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:06:05.091927 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:06:05.091927 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 14 09:06:05.091927 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 14 09:06:05.091927 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Sep 14 09:06:05.091927 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:05.098158 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-fab6cec3-43df-471d-83d2-d123e1ef5f27 tempest-MultipleCreateNegativeTestJSON-143794353 tempest-MultipleCreateNegativeTestJSON-143794353-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:06:05.102272 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-fab6cec3-43df-471d-83d2-d123e1ef5f27 tempest-MultipleCreateNegativeTestJSON-143794353 tempest-MultipleCreateNegativeTestJSON-143794353-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.029072 Sep 14 09:06:05.104337 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1943/3914] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 09:06:05 2022] POST /compute/v2.1/servers => generated 130 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 14 09:06:05.188201 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-90160df0-d4ec-49e5-8111-7e64090dcce3 tempest-MultipleCreateNegativeTestJSON-143794353 tempest-MultipleCreateNegativeTestJSON-143794353-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1764388117", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "max_count": 2.5}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:06:05.196205 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-90160df0-d4ec-49e5-8111-7e64090dcce3 tempest-MultipleCreateNegativeTestJSON-143794353 tempest-MultipleCreateNegativeTestJSON-143794353-project] Request method failure captured: Sep 14 09:06:05.196205 n-d-836830-18 devstack@n-api.service[128759]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 14 09:06:05.196205 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:06:05.196205 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:06:05.196205 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:06:05.196205 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 170 Sep 14 09:06:05.196205 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:06:05.196205 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:06:05.196205 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:06:05.196205 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:06:05.196205 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZl7xNGdOQHQWTGfNVCy2q7p43Y-Ko-XQSV42BitZXDslNbP8F7jLwYWtOKozaT0xGJwTAyspz4yJIiBYHLzj14gX-tgjnWROvYgV0icLJmxnRlh2tj2roeBhlK7qlfsM9W14R9ddXiwjRmRfzSu7sdIjl_okQ1SOKQJ-vFmNzlM3dI Sep 14 09:06:05.196205 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:06:05.196205 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:06:05.196205 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:06:05.196205 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:06:05.196205 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:06:05.196205 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:06:05.196205 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 43d434ddd9234957807891694e53b1c6 Sep 14 09:06:05.196205 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-143794353 Sep 14 09:06:05.196205 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:06:05.196205 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:06:05.196205 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/43d434ddd9234957807891694e53b1c6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_43d434ddd9234957807891694e53b1c6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/43d434ddd9234957807891694e53b1c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/43d434ddd9234957807891694e53b1c6"}]}] Sep 14 09:06:05.196205 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-143794353 Sep 14 09:06:05.196205 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 43d434ddd9234957807891694e53b1c6 Sep 14 09:06:05.196205 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-143794353 Sep 14 09:06:05.196205 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-MultipleCreateNegativeTestJSON-143794353-project Sep 14 09:06:05.196205 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:06:05.196205 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:06:05.196205 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 6b0d22a74d2349a3ae3b3d03545b26ac Sep 14 09:06:05.196205 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-143794353-project Sep 14 09:06:05.196205 n-d-836830-18 devstack@n-api.service[128759]: Sep 14 09:06:05.196205 n-d-836830-18 devstack@n-api.service[128759]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1764388117", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "max_count": 2.5}} Sep 14 09:06:05.196205 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:06:05.196205 n-d-836830-18 devstack@n-api.service[128759]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Sep 14 09:06:05.196205 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1764388117', 'imageRef': 'bff4ab7f-4846-441f-8940-d96fec4c28e9', 'flavorRef': '452', 'max_count': 2.5}}} Sep 14 09:06:05.196205 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:06:05.196205 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:06:05.196205 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 14 09:06:05.196205 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 14 09:06:05.196205 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 14 09:06:05.196205 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise error Sep 14 09:06:05.196205 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Sep 14 09:06:05.196205 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:05.196205 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Sep 14 09:06:05.196205 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi {'minLength': 1, Sep 14 09:06:05.196205 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi 'minimum': 1, Sep 14 09:06:05.196205 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Sep 14 09:06:05.196205 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Sep 14 09:06:05.196205 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:05.196205 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 14 09:06:05.196205 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi 2.5 Sep 14 09:06:05.196205 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:05.196205 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:06:05.196205 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:05.196205 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:06:05.196205 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:06:05.196205 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:06:05.196205 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:06:05.196205 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:06:05.196205 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:06:05.196205 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:06:05.196205 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:06:05.196205 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:06:05.196205 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 14 09:06:05.196205 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 14 09:06:05.200248 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 14 09:06:05.200248 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 14 09:06:05.200248 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 14 09:06:05.200248 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 14 09:06:05.200248 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Sep 14 09:06:05.200248 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:05.200248 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:06:05.200248 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:05.200248 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:06:05.200248 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:06:05.200248 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:06:05.200248 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 14 09:06:05.200248 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 14 09:06:05.200248 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Sep 14 09:06:05.200248 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:05.211565 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-90160df0-d4ec-49e5-8111-7e64090dcce3 tempest-MultipleCreateNegativeTestJSON-143794353 tempest-MultipleCreateNegativeTestJSON-143794353-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:06:05.216263 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-90160df0-d4ec-49e5-8111-7e64090dcce3 tempest-MultipleCreateNegativeTestJSON-143794353 tempest-MultipleCreateNegativeTestJSON-143794353-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.029928 Sep 14 09:06:05.218171 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1944/3915] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 09:06:05 2022] POST /compute/v2.1/servers => generated 139 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 14 09:06:05.318494 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-2b013850-9ed9-4ac0-a3d3-dbf8f5097bbd tempest-MultipleCreateNegativeTestJSON-143794353 tempest-MultipleCreateNegativeTestJSON-143794353-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-671407824", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "min_count": 0}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:06:05.327921 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-2b013850-9ed9-4ac0-a3d3-dbf8f5097bbd tempest-MultipleCreateNegativeTestJSON-143794353 tempest-MultipleCreateNegativeTestJSON-143794353-project] Request method failure captured: Sep 14 09:06:05.327921 n-d-836830-18 devstack@n-api.service[128759]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 14 09:06:05.327921 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:06:05.327921 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:06:05.327921 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:06:05.327921 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 167 Sep 14 09:06:05.327921 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:06:05.327921 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:06:05.327921 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:06:05.327921 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:06:05.327921 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZl7xNGdOQHQWTGfNVCy2q7p43Y-Ko-XQSV42BitZXDslNbP8F7jLwYWtOKozaT0xGJwTAyspz4yJIiBYHLzj14gX-tgjnWROvYgV0icLJmxnRlh2tj2roeBhlK7qlfsM9W14R9ddXiwjRmRfzSu7sdIjl_okQ1SOKQJ-vFmNzlM3dI Sep 14 09:06:05.327921 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:06:05.327921 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:06:05.327921 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:06:05.327921 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:06:05.327921 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:06:05.327921 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:06:05.327921 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 43d434ddd9234957807891694e53b1c6 Sep 14 09:06:05.327921 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-143794353 Sep 14 09:06:05.327921 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:06:05.327921 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:06:05.327921 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/43d434ddd9234957807891694e53b1c6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_43d434ddd9234957807891694e53b1c6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/43d434ddd9234957807891694e53b1c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/43d434ddd9234957807891694e53b1c6"}]}] Sep 14 09:06:05.327921 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-143794353 Sep 14 09:06:05.327921 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 43d434ddd9234957807891694e53b1c6 Sep 14 09:06:05.327921 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-143794353 Sep 14 09:06:05.327921 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-MultipleCreateNegativeTestJSON-143794353-project Sep 14 09:06:05.327921 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:06:05.327921 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:06:05.327921 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 6b0d22a74d2349a3ae3b3d03545b26ac Sep 14 09:06:05.327921 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-143794353-project Sep 14 09:06:05.327921 n-d-836830-18 devstack@n-api.service[128759]: Sep 14 09:06:05.327921 n-d-836830-18 devstack@n-api.service[128759]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-671407824", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "min_count": 0}} Sep 14 09:06:05.327921 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:06:05.327921 n-d-836830-18 devstack@n-api.service[128759]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Sep 14 09:06:05.327921 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-671407824', 'imageRef': 'bff4ab7f-4846-441f-8940-d96fec4c28e9', 'flavorRef': '452', 'min_count': 0}}} Sep 14 09:06:05.327921 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:06:05.327921 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:06:05.327921 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 14 09:06:05.327921 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 14 09:06:05.327921 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 14 09:06:05.327921 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise error Sep 14 09:06:05.327921 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 14 09:06:05.327921 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:05.327921 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Sep 14 09:06:05.327921 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi {'minLength': 1, Sep 14 09:06:05.327921 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi 'minimum': 1, Sep 14 09:06:05.327921 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Sep 14 09:06:05.327921 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Sep 14 09:06:05.327921 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:05.327921 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 14 09:06:05.327921 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi 0 Sep 14 09:06:05.327921 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:05.327921 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:06:05.327921 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:05.327921 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:06:05.327921 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:06:05.327921 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:06:05.327921 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:06:05.327921 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:06:05.327921 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:06:05.327921 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:06:05.327921 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:06:05.327921 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:06:05.327921 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 14 09:06:05.327921 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 14 09:06:05.333061 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 14 09:06:05.333061 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 14 09:06:05.333061 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 14 09:06:05.333061 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 14 09:06:05.333061 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Sep 14 09:06:05.333061 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:05.333061 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:06:05.333061 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:05.333061 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:06:05.333061 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:06:05.333061 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:06:05.333061 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 14 09:06:05.333061 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 14 09:06:05.333061 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Sep 14 09:06:05.333061 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:05.337208 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-2b013850-9ed9-4ac0-a3d3-dbf8f5097bbd tempest-MultipleCreateNegativeTestJSON-143794353 tempest-MultipleCreateNegativeTestJSON-143794353-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:06:05.341729 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-2b013850-9ed9-4ac0-a3d3-dbf8f5097bbd tempest-MultipleCreateNegativeTestJSON-143794353 tempest-MultipleCreateNegativeTestJSON-143794353-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.030449 Sep 14 09:06:05.343944 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1945/3916] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 09:06:05 2022] POST /compute/v2.1/servers => generated 130 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 14 09:06:05.367916 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3902b99e-304a-48dd-a876-49ad258530f5 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:05.368641 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-3902b99e-304a-48dd-a876-49ad258530f5 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] [instance: ed6976ad-867b-4570-a547-758efc8f622f] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:05.379183 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3902b99e-304a-48dd-a876-49ad258530f5 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:05.379904 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3902b99e-304a-48dd-a876-49ad258530f5 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:05.381162 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3902b99e-304a-48dd-a876-49ad258530f5 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:05.382868 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3902b99e-304a-48dd-a876-49ad258530f5 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:05.383851 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3902b99e-304a-48dd-a876-49ad258530f5 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:05.384659 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3902b99e-304a-48dd-a876-49ad258530f5 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:05.540450 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-a4e4bc2d-b103-42c8-aafd-433abc541f52 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:06:05.549957 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-a4e4bc2d-b103-42c8-aafd-433abc541f52 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105" status: 200 len: 1550 microversion: 2.1 time: 0.665291 Sep 14 09:06:05.550908 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1972/3917] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:06:04 2022] GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105 => generated 1550 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:06:05.558760 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-687e8e10-acce-477c-a194-60b3a85e8ca9 tempest-MultipleCreateNegativeTestJSON-143794353 tempest-MultipleCreateNegativeTestJSON-143794353-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-723038245", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "min_count": 2.5}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:06:05.565456 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-687e8e10-acce-477c-a194-60b3a85e8ca9 tempest-MultipleCreateNegativeTestJSON-143794353 tempest-MultipleCreateNegativeTestJSON-143794353-project] Request method failure captured: Sep 14 09:06:05.565456 n-d-836830-18 devstack@n-api.service[128758]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 14 09:06:05.565456 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 09:06:05.565456 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 09:06:05.565456 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 09:06:05.565456 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 169 Sep 14 09:06:05.565456 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 09:06:05.565456 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 09:06:05.565456 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 09:06:05.565456 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 09:06:05.565456 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZl7xNGdOQHQWTGfNVCy2q7p43Y-Ko-XQSV42BitZXDslNbP8F7jLwYWtOKozaT0xGJwTAyspz4yJIiBYHLzj14gX-tgjnWROvYgV0icLJmxnRlh2tj2roeBhlK7qlfsM9W14R9ddXiwjRmRfzSu7sdIjl_okQ1SOKQJ-vFmNzlM3dI Sep 14 09:06:05.565456 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 09:06:05.565456 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 09:06:05.565456 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 09:06:05.565456 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 09:06:05.565456 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 09:06:05.565456 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 09:06:05.565456 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 43d434ddd9234957807891694e53b1c6 Sep 14 09:06:05.565456 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-143794353 Sep 14 09:06:05.565456 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 09:06:05.565456 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 09:06:05.565456 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/43d434ddd9234957807891694e53b1c6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_43d434ddd9234957807891694e53b1c6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/43d434ddd9234957807891694e53b1c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/43d434ddd9234957807891694e53b1c6"}]}] Sep 14 09:06:05.565456 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-143794353 Sep 14 09:06:05.565456 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 43d434ddd9234957807891694e53b1c6 Sep 14 09:06:05.565456 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-143794353 Sep 14 09:06:05.565456 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-MultipleCreateNegativeTestJSON-143794353-project Sep 14 09:06:05.565456 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 09:06:05.565456 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 09:06:05.565456 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 6b0d22a74d2349a3ae3b3d03545b26ac Sep 14 09:06:05.565456 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-143794353-project Sep 14 09:06:05.565456 n-d-836830-18 devstack@n-api.service[128758]: Sep 14 09:06:05.565456 n-d-836830-18 devstack@n-api.service[128758]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-723038245", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "min_count": 2.5}} Sep 14 09:06:05.565456 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 09:06:05.565456 n-d-836830-18 devstack@n-api.service[128758]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Sep 14 09:06:05.565456 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-723038245', 'imageRef': 'bff4ab7f-4846-441f-8940-d96fec4c28e9', 'flavorRef': '452', 'min_count': 2.5}}} Sep 14 09:06:05.565456 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:06:05.565456 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:06:05.565456 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 14 09:06:05.565456 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 14 09:06:05.565456 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 14 09:06:05.565456 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise error Sep 14 09:06:05.565456 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Sep 14 09:06:05.565456 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:06:05.565456 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Sep 14 09:06:05.565456 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi {'minLength': 1, Sep 14 09:06:05.565456 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi 'minimum': 1, Sep 14 09:06:05.565456 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Sep 14 09:06:05.565456 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Sep 14 09:06:05.565456 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:06:05.565456 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 14 09:06:05.565456 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi 2.5 Sep 14 09:06:05.565456 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:06:05.565456 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:06:05.565456 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:06:05.565456 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:06:05.565456 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:06:05.565456 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:06:05.565456 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:06:05.565456 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:06:05.565456 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:06:05.565456 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:06:05.565456 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:06:05.565456 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:06:05.565456 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 14 09:06:05.565456 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 14 09:06:05.569223 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 14 09:06:05.569223 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 14 09:06:05.569223 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 14 09:06:05.569223 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 14 09:06:05.569223 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Sep 14 09:06:05.569223 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:06:05.569223 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:06:05.569223 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:06:05.569223 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:06:05.569223 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:06:05.569223 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:06:05.569223 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 14 09:06:05.569223 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 14 09:06:05.569223 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Sep 14 09:06:05.569223 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:06:05.571795 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-687e8e10-acce-477c-a194-60b3a85e8ca9 tempest-MultipleCreateNegativeTestJSON-143794353 tempest-MultipleCreateNegativeTestJSON-143794353-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:06:05.573717 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-687e8e10-acce-477c-a194-60b3a85e8ca9 tempest-MultipleCreateNegativeTestJSON-143794353 tempest-MultipleCreateNegativeTestJSON-143794353-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.021145 Sep 14 09:06:05.581348 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1973/3918] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 09:06:05 2022] POST /compute/v2.1/servers => generated 139 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 14 09:06:05.589233 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-f32ec7ed-93a3-42e1-b2fe-00ea06452c72 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:05.590057 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-f32ec7ed-93a3-42e1-b2fe-00ea06452c72 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:05.602856 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:06:05.605125 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f32ec7ed-93a3-42e1-b2fe-00ea06452c72 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:05.605893 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f32ec7ed-93a3-42e1-b2fe-00ea06452c72 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:05.607883 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f32ec7ed-93a3-42e1-b2fe-00ea06452c72 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:05.608859 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f32ec7ed-93a3-42e1-b2fe-00ea06452c72 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:05.609628 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f32ec7ed-93a3-42e1-b2fe-00ea06452c72 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:05.613327 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f32ec7ed-93a3-42e1-b2fe-00ea06452c72 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:06.103472 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-3902b99e-304a-48dd-a876-49ad258530f5 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5165b8fc101c47c7a4370f9007bc5a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a597fc389b4805bbd3a53ecd17c5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:06:06.116001 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-3902b99e-304a-48dd-a876-49ad258530f5 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute/v2.1/servers/ed6976ad-867b-4570-a547-758efc8f622f" status: 200 len: 1204 microversion: 2.1 time: 0.770686 Sep 14 09:06:06.131841 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1946/3919] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:06:05 2022] GET /compute/v2.1/servers/ed6976ad-867b-4570-a547-758efc8f622f => generated 1204 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:06:06.138143 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c9e15a10-3deb-420d-bcfc-417d7d1373b8 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:06.139104 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-c9e15a10-3deb-420d-bcfc-417d7d1373b8 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] [instance: bb353760-fa41-4b09-a8c2-63b39e7d3639] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:06.146728 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c9e15a10-3deb-420d-bcfc-417d7d1373b8 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:06.147402 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c9e15a10-3deb-420d-bcfc-417d7d1373b8 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:06.148527 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c9e15a10-3deb-420d-bcfc-417d7d1373b8 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:06.149570 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c9e15a10-3deb-420d-bcfc-417d7d1373b8 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:06.150167 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c9e15a10-3deb-420d-bcfc-417d7d1373b8 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:06.150791 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c9e15a10-3deb-420d-bcfc-417d7d1373b8 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:06.169735 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-c9e15a10-3deb-420d-bcfc-417d7d1373b8 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] HTTP exception thrown: Instance bb353760-fa41-4b09-a8c2-63b39e7d3639 could not be found. Sep 14 09:06:06.172117 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c9e15a10-3deb-420d-bcfc-417d7d1373b8 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Request method failure captured: Sep 14 09:06:06.172117 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/bb353760-fa41-4b09-a8c2-63b39e7d3639 HTTP/1.1 Sep 14 09:06:06.172117 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:06:06.172117 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:06:06.172117 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:06:06.172117 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:06:06.172117 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:06:06.172117 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:06:06.172117 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:06:06.172117 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:06:06.172117 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZlmPCUBcUM5a2Mw65SD-eHNkXbeLqwFI4ELa_F0AVciroohDmiSVubKAP519oS1HdFaDF0vr0ZVmzePYwWNoyOcb3moVry_UHeb_h_xsHatsmxgd40tyaksurJSgiYjQfDIPW5rqg-XrcW_18MDCYziXM3TIJxzXNunb0vyrQs29j8 Sep 14 09:06:06.172117 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:06:06.172117 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:06:06.172117 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:06:06.172117 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:06:06.172117 n-d-836830-18 devstack@n-api.service[128759]: X-Openstack-Nova-Api-Version: 2.47 Sep 14 09:06:06.172117 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:06:06.172117 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:06:06.172117 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: e21195f8ae7b4267a128e890025c0b51 Sep 14 09:06:06.172117 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ServersAaction247Test-824282243 Sep 14 09:06:06.172117 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:06:06.172117 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:06:06.172117 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e21195f8ae7b4267a128e890025c0b51"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e21195f8ae7b4267a128e890025c0b51"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e21195f8ae7b4267a128e890025c0b51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e21195f8ae7b4267a128e890025c0b51"}]}] Sep 14 09:06:06.172117 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ServersAaction247Test-824282243 Sep 14 09:06:06.172117 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: e21195f8ae7b4267a128e890025c0b51 Sep 14 09:06:06.172117 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ServersAaction247Test-824282243 Sep 14 09:06:06.172117 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ServersAaction247Test-824282243-project Sep 14 09:06:06.172117 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:06:06.172117 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:06:06.172117 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 55bda029c9974af09e83631e04459d3f Sep 14 09:06:06.172117 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ServersAaction247Test-824282243-project Sep 14 09:06:06.172117 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:06:06.172117 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance bb353760-fa41-4b09-a8c2-63b39e7d3639 could not be found. Sep 14 09:06:06.172117 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': 'bb353760-fa41-4b09-a8c2-63b39e7d3639'} Sep 14 09:06:06.172117 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:06:06.172117 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:06:06.172117 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:06:06.172117 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:06:06.172117 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:06:06.172117 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:06:06.172117 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:06:06.172117 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:06:06.172117 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:06:06.172117 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:06:06.172117 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb353760-fa41-4b09-a8c2-63b39e7d3639 could not be found. Sep 14 09:06:06.172117 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:06.172117 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:06:06.172117 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:06.172117 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:06:06.172117 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:06:06.172117 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:06:06.172117 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:06:06.172117 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:06:06.172117 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:06:06.172117 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:06:06.172117 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:06:06.172117 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:06:06.172117 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:06:06.172117 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:06:06.172117 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:06:06.172117 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:06:06.172117 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb353760-fa41-4b09-a8c2-63b39e7d3639 could not be found. Sep 14 09:06:06.172117 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:06.172117 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:06:06.172117 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:06.175984 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:06:06.175984 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:06:06.175984 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:06:06.175984 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:06:06.175984 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:06:06.175984 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb353760-fa41-4b09-a8c2-63b39e7d3639 could not be found. Sep 14 09:06:06.175984 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:06.177735 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c9e15a10-3deb-420d-bcfc-417d7d1373b8 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] Returning 404 to user: Instance bb353760-fa41-4b09-a8c2-63b39e7d3639 could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:06:06.178727 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-c9e15a10-3deb-420d-bcfc-417d7d1373b8 tempest-ServersAaction247Test-824282243 tempest-ServersAaction247Test-824282243-project] 10.222.0.60 "GET /compute/v2.1/servers/bb353760-fa41-4b09-a8c2-63b39e7d3639" status: 404 len: 111 microversion: 2.47 time: 0.045827 Sep 14 09:06:06.179885 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1947/3920] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:06:06 2022] GET /compute/v2.1/servers/bb353760-fa41-4b09-a8c2-63b39e7d3639 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 14 09:06:06.184994 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-829b73a9-ab78-4155-b47a-57c614f2385c req-c5a76ea6-e874-43fd-b52e-6d39939ddae2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70b0fcd2-6fc4-4445-96bb-165dccf6c81c", "name": "network-vif-deleted", "tag": "03d9d813-028b-4c20-8b8f-dff576919005"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:06:06.196325 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-829b73a9-ab78-4155-b47a-57c614f2385c req-c5a76ea6-e874-43fd-b52e-6d39939ddae2 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:06.197587 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-829b73a9-ab78-4155-b47a-57c614f2385c req-c5a76ea6-e874-43fd-b52e-6d39939ddae2 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:06.198214 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-829b73a9-ab78-4155-b47a-57c614f2385c req-c5a76ea6-e874-43fd-b52e-6d39939ddae2 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:06.223794 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-829b73a9-ab78-4155-b47a-57c614f2385c req-c5a76ea6-e874-43fd-b52e-6d39939ddae2 service nova] Creating event network-vif-deleted:03d9d813-028b-4c20-8b8f-dff576919005 for instance 70b0fcd2-6fc4-4445-96bb-165dccf6c81c on n-h2-836830-18 Sep 14 09:06:06.236088 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-829b73a9-ab78-4155-b47a-57c614f2385c req-c5a76ea6-e874-43fd-b52e-6d39939ddae2 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054769 Sep 14 09:06:06.236734 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1948/3921] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:06:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:06:06.291638 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-0467a860-e357-44eb-8bc5-728cf563f7c1 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1768641001", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "ed9e19ac-8b95-4f8e-954b-e7db6d6a083d", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "2616a0b0-fea1-46f8-bf23-608a226da1ef"}]}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:06:06.365016 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-f32ec7ed-93a3-42e1-b2fe-00ea06452c72 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.782069 Sep 14 09:06:06.366119 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1974/3922] 10.222.0.60 () {58 vars in 1275 bytes} [Wed Sep 14 09:06:05 2022] GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105/os-interface => generated 284 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:06:06.472869 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-0467a860-e357-44eb-8bc5-728cf563f7c1 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] HTTP exception thrown: Block Device ed9e19ac-8b95-4f8e-954b-e7db6d6a083d is not bootable. Sep 14 09:06:06.480141 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-0467a860-e357-44eb-8bc5-728cf563f7c1 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Request method failure captured: Sep 14 09:06:06.480141 n-d-836830-18 devstack@n-api.service[128759]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 14 09:06:06.480141 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:06:06.480141 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:06:06.480141 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:06:06.480141 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 358 Sep 14 09:06:06.480141 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:06:06.480141 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:06:06.480141 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:06:06.480141 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:06:06.480141 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZk2EvHIWQyXATvY4f6phbqF3DzIIyaJjJFCE11LxTKbrsndvuk5zoyyEUR0VXx32_kFjD0I6jBROuj0ZPSHQav7u9FFvOPFGrPkf9qZrgXY9k3zAUFrOVfwLECoLZOolubyCPUAGSEOi_HvFIP_Dd_DCbUCKDEGGLtdnAzy2tLCxHs Sep 14 09:06:06.480141 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:06:06.480141 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:06:06.480141 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:06:06.480141 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:06:06.480141 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:06:06.480141 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:06:06.480141 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 6907b82c9d5c4a23a63bbeec31c3c365 Sep 14 09:06:06.480141 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ServersNegativeTestJSON-1654813540 Sep 14 09:06:06.480141 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:06:06.480141 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:06:06.480141 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6907b82c9d5c4a23a63bbeec31c3c365"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6907b82c9d5c4a23a63bbeec31c3c365"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6907b82c9d5c4a23a63bbeec31c3c365"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6907b82c9d5c4a23a63bbeec31c3c365"}]}] Sep 14 09:06:06.480141 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ServersNegativeTestJSON-1654813540 Sep 14 09:06:06.480141 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 6907b82c9d5c4a23a63bbeec31c3c365 Sep 14 09:06:06.480141 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1654813540 Sep 14 09:06:06.480141 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ServersNegativeTestJSON-1654813540-project Sep 14 09:06:06.480141 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:06:06.480141 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:06:06.480141 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 79583c4e80a04f138927f09eb4e170f4 Sep 14 09:06:06.480141 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ServersNegativeTestJSON-1654813540-project Sep 14 09:06:06.480141 n-d-836830-18 devstack@n-api.service[128759]: Sep 14 09:06:06.480141 n-d-836830-18 devstack@n-api.service[128759]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1768641001", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "ed9e19ac-8b95-4f8e-954b-e7db6d6a083d", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "2616a0b0-fea1-46f8-bf23-608a226da1ef"}]}} Sep 14 09:06:06.480141 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:06:06.480141 n-d-836830-18 devstack@n-api.service[128759]: exception: Block Device ed9e19ac-8b95-4f8e-954b-e7db6d6a083d is not bootable. Sep 14 09:06:06.480141 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1768641001', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': 'ed9e19ac-8b95-4f8e-954b-e7db6d6a083d'}], 'networks': [{'uuid': '2616a0b0-fea1-46f8-bf23-608a226da1ef'}]}}} Sep 14 09:06:06.480141 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:06:06.480141 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:06:06.480141 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 14 09:06:06.480141 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 14 09:06:06.480141 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 14 09:06:06.480141 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 14 09:06:06.480141 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Sep 14 09:06:06.480141 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Sep 14 09:06:06.480141 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Sep 14 09:06:06.480141 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Sep 14 09:06:06.480141 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device ed9e19ac-8b95-4f8e-954b-e7db6d6a083d is not bootable. Sep 14 09:06:06.480141 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:06.480141 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:06:06.480141 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:06.480141 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:06:06.480141 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:06:06.480141 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:06:06.480141 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:06:06.480141 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:06:06.480141 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:06:06.480141 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:06:06.480141 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:06:06.480141 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:06:06.480141 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:06:06.483745 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:06:06.483745 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:06:06.483745 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:06:06.483745 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 14 09:06:06.483745 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Sep 14 09:06:06.483745 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Sep 14 09:06:06.483745 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device ed9e19ac-8b95-4f8e-954b-e7db6d6a083d is not bootable. Sep 14 09:06:06.483745 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:06.483745 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:06:06.483745 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:06.483745 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:06:06.483745 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:06:06.483745 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:06:06.483745 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:06:06.483745 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:06:06.483745 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device ed9e19ac-8b95-4f8e-954b-e7db6d6a083d is not bootable. Sep 14 09:06:06.483745 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:06.483745 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-0467a860-e357-44eb-8bc5-728cf563f7c1 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Returning 400 to user: Block Device ed9e19ac-8b95-4f8e-954b-e7db6d6a083d is not bootable. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:06:06.484817 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-0467a860-e357-44eb-8bc5-728cf563f7c1 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.198006 Sep 14 09:06:06.489518 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1949/3923] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 09:06:06 2022] POST /compute/v2.1/servers => generated 110 bytes in 201 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 14 09:06:06.495897 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-56569a84-606b-4316-bdb3-b2dfbe885c1f tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:06.496791 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-56569a84-606b-4316-bdb3-b2dfbe885c1f tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:06.506886 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-56569a84-606b-4316-bdb3-b2dfbe885c1f tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:06.519700 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-56569a84-606b-4316-bdb3-b2dfbe885c1f tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:06.523368 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-56569a84-606b-4316-bdb3-b2dfbe885c1f tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:06.524356 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-56569a84-606b-4316-bdb3-b2dfbe885c1f tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:06.527730 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-56569a84-606b-4316-bdb3-b2dfbe885c1f tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:06.528346 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-56569a84-606b-4316-bdb3-b2dfbe885c1f tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:07.141862 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e4213764-737d-485d-a9a7-2b72d55c9b00 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:07.142689 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e4213764-737d-485d-a9a7-2b72d55c9b00 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] [instance: ed6976ad-867b-4570-a547-758efc8f622f] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:07.154372 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e4213764-737d-485d-a9a7-2b72d55c9b00 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:07.157242 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e4213764-737d-485d-a9a7-2b72d55c9b00 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:07.158264 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e4213764-737d-485d-a9a7-2b72d55c9b00 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:07.159554 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e4213764-737d-485d-a9a7-2b72d55c9b00 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:07.160251 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e4213764-737d-485d-a9a7-2b72d55c9b00 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:07.161633 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e4213764-737d-485d-a9a7-2b72d55c9b00 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:07.333442 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-56569a84-606b-4316-bdb3-b2dfbe885c1f tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:06:07.350141 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-56569a84-606b-4316-bdb3-b2dfbe885c1f tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1506 microversion: 2.1 time: 0.859245 Sep 14 09:06:07.370142 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1975/3924] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:06:06 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1506 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:06:07.380742 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-eadb6d2a-4347-4b0e-b29f-d6e9cf40ac3d tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:07.381710 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-eadb6d2a-4347-4b0e-b29f-d6e9cf40ac3d tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:07.391496 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-eadb6d2a-4347-4b0e-b29f-d6e9cf40ac3d tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:07.392050 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-eadb6d2a-4347-4b0e-b29f-d6e9cf40ac3d tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:07.392637 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-eadb6d2a-4347-4b0e-b29f-d6e9cf40ac3d tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:07.393416 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-eadb6d2a-4347-4b0e-b29f-d6e9cf40ac3d tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:07.394520 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-eadb6d2a-4347-4b0e-b29f-d6e9cf40ac3d tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:07.395789 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-eadb6d2a-4347-4b0e-b29f-d6e9cf40ac3d tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:07.416241 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-e4213764-737d-485d-a9a7-2b72d55c9b00 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5165b8fc101c47c7a4370f9007bc5a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a597fc389b4805bbd3a53ecd17c5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:06:07.428619 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e4213764-737d-485d-a9a7-2b72d55c9b00 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute/v2.1/servers/ed6976ad-867b-4570-a547-758efc8f622f" status: 200 len: 1266 microversion: 2.1 time: 0.290948 Sep 14 09:06:07.438988 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1950/3925] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:06:07 2022] GET /compute/v2.1/servers/ed6976ad-867b-4570-a547-758efc8f622f => generated 1266 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:06:07.841277 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-eadb6d2a-4347-4b0e-b29f-d6e9cf40ac3d tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:06:07.859743 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-eadb6d2a-4347-4b0e-b29f-d6e9cf40ac3d tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1506 microversion: 2.1 time: 0.488418 Sep 14 09:06:07.875784 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1976/3926] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:06:07 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1506 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:06:08.457409 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-316b1e21-f3da-4d34-8323-1975d93737e7 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:08.458158 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-316b1e21-f3da-4d34-8323-1975d93737e7 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] [instance: ed6976ad-867b-4570-a547-758efc8f622f] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:08.505985 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-316b1e21-f3da-4d34-8323-1975d93737e7 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:08.512234 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-316b1e21-f3da-4d34-8323-1975d93737e7 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:08.530717 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-316b1e21-f3da-4d34-8323-1975d93737e7 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:08.537279 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-316b1e21-f3da-4d34-8323-1975d93737e7 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:08.540056 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-316b1e21-f3da-4d34-8323-1975d93737e7 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:08.540524 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-316b1e21-f3da-4d34-8323-1975d93737e7 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:09.056589 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-316b1e21-f3da-4d34-8323-1975d93737e7 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5165b8fc101c47c7a4370f9007bc5a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a597fc389b4805bbd3a53ecd17c5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:06:09.070736 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-316b1e21-f3da-4d34-8323-1975d93737e7 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute/v2.1/servers/ed6976ad-867b-4570-a547-758efc8f622f" status: 200 len: 1308 microversion: 2.1 time: 0.620707 Sep 14 09:06:09.095354 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1951/3927] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:06:08 2022] GET /compute/v2.1/servers/ed6976ad-867b-4570-a547-758efc8f622f => generated 1308 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:06:09.116205 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-5ae1d2b8-9c52-4b98-85bb-f96f21bc82c1 req-88263537-e760-421a-90ff-bf27db56d2c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8450d385-d5d9-4c86-9ece-b3bbf9ed1105", "tag": "eb873b1a-8b40-4eb4-a329-cf733d9ed342"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:06:09.141114 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-5ae1d2b8-9c52-4b98-85bb-f96f21bc82c1 req-88263537-e760-421a-90ff-bf27db56d2c1 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:09.149730 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-5ae1d2b8-9c52-4b98-85bb-f96f21bc82c1 req-88263537-e760-421a-90ff-bf27db56d2c1 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:09.161268 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-5ae1d2b8-9c52-4b98-85bb-f96f21bc82c1 req-88263537-e760-421a-90ff-bf27db56d2c1 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:09.211460 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-5ae1d2b8-9c52-4b98-85bb-f96f21bc82c1 req-88263537-e760-421a-90ff-bf27db56d2c1 service nova] Creating event network-changed:eb873b1a-8b40-4eb4-a329-cf733d9ed342 for instance 8450d385-d5d9-4c86-9ece-b3bbf9ed1105 on n-h1-836830-18 Sep 14 09:06:09.236304 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-5ae1d2b8-9c52-4b98-85bb-f96f21bc82c1 req-88263537-e760-421a-90ff-bf27db56d2c1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112976 Sep 14 09:06:09.239190 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1977/3928] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:06:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:06:10.093623 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d750d5d0-765a-426c-8520-34195bcfda4f tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:10.095130 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-d750d5d0-765a-426c-8520-34195bcfda4f tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] [instance: ed6976ad-867b-4570-a547-758efc8f622f] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:10.106864 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d750d5d0-765a-426c-8520-34195bcfda4f tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:10.110655 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d750d5d0-765a-426c-8520-34195bcfda4f tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:10.117509 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d750d5d0-765a-426c-8520-34195bcfda4f tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:10.120062 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d750d5d0-765a-426c-8520-34195bcfda4f tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:10.121796 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d750d5d0-765a-426c-8520-34195bcfda4f tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:10.122911 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d750d5d0-765a-426c-8520-34195bcfda4f tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:10.675709 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-d750d5d0-765a-426c-8520-34195bcfda4f tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5165b8fc101c47c7a4370f9007bc5a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a597fc389b4805bbd3a53ecd17c5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:06:10.686003 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d750d5d0-765a-426c-8520-34195bcfda4f tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute/v2.1/servers/ed6976ad-867b-4570-a547-758efc8f622f" status: 200 len: 1308 microversion: 2.1 time: 0.596127 Sep 14 09:06:10.704152 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1952/3929] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:06:10 2022] GET /compute/v2.1/servers/ed6976ad-867b-4570-a547-758efc8f622f => generated 1308 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:06:10.872026 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-494d1079-5235-42fe-878d-fbd56037c981 req-817cae4a-f830-459c-af72-c46cd05010c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed6976ad-867b-4570-a547-758efc8f622f", "tag": "5445fa77-c239-4d3c-8132-f14f545198cd"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:06:10.893948 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-494d1079-5235-42fe-878d-fbd56037c981 req-817cae4a-f830-459c-af72-c46cd05010c1 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:10.895622 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-494d1079-5235-42fe-878d-fbd56037c981 req-817cae4a-f830-459c-af72-c46cd05010c1 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:10.896840 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-494d1079-5235-42fe-878d-fbd56037c981 req-817cae4a-f830-459c-af72-c46cd05010c1 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:10.923345 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-494d1079-5235-42fe-878d-fbd56037c981 req-817cae4a-f830-459c-af72-c46cd05010c1 service nova] Creating event network-changed:5445fa77-c239-4d3c-8132-f14f545198cd for instance ed6976ad-867b-4570-a547-758efc8f622f on n-h1-836830-18 Sep 14 09:06:10.933262 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-494d1079-5235-42fe-878d-fbd56037c981 req-817cae4a-f830-459c-af72-c46cd05010c1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067758 Sep 14 09:06:10.934898 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1978/3930] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:06:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:06:11.130582 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f32b1796-de21-4e1b-b9f6-0df0ee82e6bb tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-211249898", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "destination_type": "local"}, {"source_type": "volume", "uuid": "fd2238f4-dc30-4545-8ccd-67026e3128c7", "destination_type": "invalid"}], "networks": [{"uuid": "2616a0b0-fea1-46f8-bf23-608a226da1ef"}]}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:06:11.138526 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f32b1796-de21-4e1b-b9f6-0df0ee82e6bb tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Request method failure captured: Sep 14 09:06:11.138526 n-d-836830-18 devstack@n-api.service[128759]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 14 09:06:11.138526 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:06:11.138526 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:06:11.138526 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:06:11.138526 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 494 Sep 14 09:06:11.138526 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:06:11.138526 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:06:11.138526 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:06:11.138526 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:06:11.138526 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZk2EvHIWQyXATvY4f6phbqF3DzIIyaJjJFCE11LxTKbrsndvuk5zoyyEUR0VXx32_kFjD0I6jBROuj0ZPSHQav7u9FFvOPFGrPkf9qZrgXY9k3zAUFrOVfwLECoLZOolubyCPUAGSEOi_HvFIP_Dd_DCbUCKDEGGLtdnAzy2tLCxHs Sep 14 09:06:11.138526 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:06:11.138526 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:06:11.138526 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:06:11.138526 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:06:11.138526 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:06:11.138526 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:06:11.138526 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 6907b82c9d5c4a23a63bbeec31c3c365 Sep 14 09:06:11.138526 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ServersNegativeTestJSON-1654813540 Sep 14 09:06:11.138526 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:06:11.138526 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:06:11.138526 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6907b82c9d5c4a23a63bbeec31c3c365"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6907b82c9d5c4a23a63bbeec31c3c365"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6907b82c9d5c4a23a63bbeec31c3c365"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6907b82c9d5c4a23a63bbeec31c3c365"}]}] Sep 14 09:06:11.138526 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ServersNegativeTestJSON-1654813540 Sep 14 09:06:11.138526 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 6907b82c9d5c4a23a63bbeec31c3c365 Sep 14 09:06:11.138526 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1654813540 Sep 14 09:06:11.138526 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ServersNegativeTestJSON-1654813540-project Sep 14 09:06:11.138526 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:06:11.138526 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:06:11.138526 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 79583c4e80a04f138927f09eb4e170f4 Sep 14 09:06:11.138526 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ServersNegativeTestJSON-1654813540-project Sep 14 09:06:11.138526 n-d-836830-18 devstack@n-api.service[128759]: Sep 14 09:06:11.138526 n-d-836830-18 devstack@n-api.service[128759]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-211249898", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "destination_type": "local"}, {"source_type": "volume", "uuid": "fd2238f4-dc30-4545-8ccd-67026e3128c7", "destination_type": "invalid"}], "networks": [{"uuid": "2616a0b0-fea1-46f8-bf23-608a226da1ef"}]}} Sep 14 09:06:11.138526 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:06:11.138526 n-d-836830-18 devstack@n-api.service[128759]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Sep 14 09:06:11.138526 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-211249898', 'imageRef': 'bff4ab7f-4846-441f-8940-d96fec4c28e9', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': 'bff4ab7f-4846-441f-8940-d96fec4c28e9', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': 'fd2238f4-dc30-4545-8ccd-67026e3128c7', 'destination_type': 'invalid'}], 'networks': [{'uuid': '2616a0b0-fea1-46f8-bf23-608a226da1ef'}]}}} Sep 14 09:06:11.138526 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:06:11.138526 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:06:11.138526 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 14 09:06:11.138526 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 14 09:06:11.138526 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 14 09:06:11.138526 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise error Sep 14 09:06:11.138526 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Sep 14 09:06:11.138526 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:11.138526 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Sep 14 09:06:11.138526 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Sep 14 09:06:11.138526 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:11.138526 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Sep 14 09:06:11.138526 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi 'invalid' Sep 14 09:06:11.138526 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:11.138526 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:06:11.138526 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:11.138526 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:06:11.138526 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:06:11.138526 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:06:11.138526 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:06:11.138526 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:06:11.138526 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:06:11.145525 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:06:11.145525 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:06:11.145525 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:06:11.145525 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 14 09:06:11.145525 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 14 09:06:11.145525 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 14 09:06:11.145525 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 14 09:06:11.145525 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 14 09:06:11.145525 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 14 09:06:11.145525 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Sep 14 09:06:11.145525 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:11.145525 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:06:11.145525 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:11.145525 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:06:11.145525 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:06:11.145525 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:06:11.145525 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 14 09:06:11.145525 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 14 09:06:11.145525 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Sep 14 09:06:11.145525 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:11.145525 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f32b1796-de21-4e1b-b9f6-0df0ee82e6bb tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:06:11.145525 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f32b1796-de21-4e1b-b9f6-0df0ee82e6bb tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.018194 Sep 14 09:06:11.145525 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1953/3931] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 09:06:11 2022] POST /compute/v2.1/servers => generated 155 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 14 09:06:11.152038 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-022adf50-c627-48f5-8162-e9f264ff3abb tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:11.152772 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-022adf50-c627-48f5-8162-e9f264ff3abb tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:11.175580 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-022adf50-c627-48f5-8162-e9f264ff3abb tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:11.177337 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-022adf50-c627-48f5-8162-e9f264ff3abb tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:11.179997 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-022adf50-c627-48f5-8162-e9f264ff3abb tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:11.181892 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-022adf50-c627-48f5-8162-e9f264ff3abb tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:11.182383 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-022adf50-c627-48f5-8162-e9f264ff3abb tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:11.183122 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-022adf50-c627-48f5-8162-e9f264ff3abb tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:11.484710 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-022adf50-c627-48f5-8162-e9f264ff3abb tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:06:11.492861 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-022adf50-c627-48f5-8162-e9f264ff3abb tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1506 microversion: 2.1 time: 0.346812 Sep 14 09:06:11.494209 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1979/3932] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:06:11 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1506 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:06:11.519567 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3022629b-c59a-4ad7-96cd-c9016bda00b7 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:11.520510 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-3022629b-c59a-4ad7-96cd-c9016bda00b7 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:11.530722 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3022629b-c59a-4ad7-96cd-c9016bda00b7 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:11.531481 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3022629b-c59a-4ad7-96cd-c9016bda00b7 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:11.532203 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3022629b-c59a-4ad7-96cd-c9016bda00b7 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:11.533131 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3022629b-c59a-4ad7-96cd-c9016bda00b7 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:11.533955 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3022629b-c59a-4ad7-96cd-c9016bda00b7 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:11.535243 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3022629b-c59a-4ad7-96cd-c9016bda00b7 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:11.716812 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-3022629b-c59a-4ad7-96cd-c9016bda00b7 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:06:11.718229 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-907bb92e-42a2-4988-9b5b-4650b7b29407 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:11.719302 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-907bb92e-42a2-4988-9b5b-4650b7b29407 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] [instance: ed6976ad-867b-4570-a547-758efc8f622f] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:11.726480 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-3022629b-c59a-4ad7-96cd-c9016bda00b7 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1506 microversion: 2.1 time: 0.210539 Sep 14 09:06:11.727405 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1954/3933] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:06:11 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1506 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:06:11.734280 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-907bb92e-42a2-4988-9b5b-4650b7b29407 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:11.735483 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-907bb92e-42a2-4988-9b5b-4650b7b29407 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:11.736440 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-907bb92e-42a2-4988-9b5b-4650b7b29407 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:11.737862 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-907bb92e-42a2-4988-9b5b-4650b7b29407 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:11.738640 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-907bb92e-42a2-4988-9b5b-4650b7b29407 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:11.739114 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-907bb92e-42a2-4988-9b5b-4650b7b29407 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:11.894600 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-907bb92e-42a2-4988-9b5b-4650b7b29407 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5165b8fc101c47c7a4370f9007bc5a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a597fc389b4805bbd3a53ecd17c5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:06:11.903451 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-907bb92e-42a2-4988-9b5b-4650b7b29407 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute/v2.1/servers/ed6976ad-867b-4570-a547-758efc8f622f" status: 200 len: 1308 microversion: 2.1 time: 0.190833 Sep 14 09:06:11.904354 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1980/3934] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:06:11 2022] GET /compute/v2.1/servers/ed6976ad-867b-4570-a547-758efc8f622f => generated 1308 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:06:12.014185 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-06771bde-a417-466b-8e3e-a0c996f59146 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-509055081", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "2616a0b0-fea1-46f8-bf23-608a226da1ef"}]}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:06:12.018560 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-06771bde-a417-466b-8e3e-a0c996f59146 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Request method failure captured: Sep 14 09:06:12.018560 n-d-836830-18 devstack@n-api.service[128759]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 14 09:06:12.018560 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:06:12.018560 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:06:12.018560 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:06:12.018560 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 491 Sep 14 09:06:12.018560 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:06:12.018560 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:06:12.018560 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:06:12.018560 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:06:12.018560 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZk2EvHIWQyXATvY4f6phbqF3DzIIyaJjJFCE11LxTKbrsndvuk5zoyyEUR0VXx32_kFjD0I6jBROuj0ZPSHQav7u9FFvOPFGrPkf9qZrgXY9k3zAUFrOVfwLECoLZOolubyCPUAGSEOi_HvFIP_Dd_DCbUCKDEGGLtdnAzy2tLCxHs Sep 14 09:06:12.018560 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:06:12.018560 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:06:12.018560 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:06:12.018560 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:06:12.018560 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:06:12.018560 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:06:12.018560 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 6907b82c9d5c4a23a63bbeec31c3c365 Sep 14 09:06:12.018560 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ServersNegativeTestJSON-1654813540 Sep 14 09:06:12.018560 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:06:12.018560 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:06:12.018560 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6907b82c9d5c4a23a63bbeec31c3c365"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6907b82c9d5c4a23a63bbeec31c3c365"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6907b82c9d5c4a23a63bbeec31c3c365"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6907b82c9d5c4a23a63bbeec31c3c365"}]}] Sep 14 09:06:12.018560 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ServersNegativeTestJSON-1654813540 Sep 14 09:06:12.018560 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 6907b82c9d5c4a23a63bbeec31c3c365 Sep 14 09:06:12.018560 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1654813540 Sep 14 09:06:12.018560 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ServersNegativeTestJSON-1654813540-project Sep 14 09:06:12.018560 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:06:12.018560 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:06:12.018560 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 79583c4e80a04f138927f09eb4e170f4 Sep 14 09:06:12.018560 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ServersNegativeTestJSON-1654813540-project Sep 14 09:06:12.018560 n-d-836830-18 devstack@n-api.service[128759]: Sep 14 09:06:12.018560 n-d-836830-18 devstack@n-api.service[128759]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-509055081", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "2616a0b0-fea1-46f8-bf23-608a226da1ef"}]}} Sep 14 09:06:12.018560 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:06:12.018560 n-d-836830-18 devstack@n-api.service[128759]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Sep 14 09:06:12.018560 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-509055081', 'imageRef': 'bff4ab7f-4846-441f-8940-d96fec4c28e9', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': '2616a0b0-fea1-46f8-bf23-608a226da1ef'}]}}} Sep 14 09:06:12.018560 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:06:12.018560 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:06:12.018560 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 14 09:06:12.018560 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 14 09:06:12.018560 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 14 09:06:12.018560 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise error Sep 14 09:06:12.018560 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Sep 14 09:06:12.018560 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:12.018560 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Sep 14 09:06:12.018560 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Sep 14 09:06:12.018560 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:12.018560 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Sep 14 09:06:12.021381 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Sep 14 09:06:12.021381 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:12.021381 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:06:12.021381 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:12.021381 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:06:12.021381 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:06:12.021381 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:06:12.021381 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:06:12.021381 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:06:12.021381 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:06:12.021381 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:06:12.021381 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:06:12.021381 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:06:12.021381 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 14 09:06:12.021381 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 14 09:06:12.021381 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 14 09:06:12.021381 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 14 09:06:12.021381 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 14 09:06:12.021381 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 14 09:06:12.021381 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Sep 14 09:06:12.021381 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:12.021381 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:06:12.021381 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:12.021381 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:06:12.021381 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:06:12.021381 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:06:12.021381 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 14 09:06:12.021381 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 14 09:06:12.021381 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Sep 14 09:06:12.021381 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:12.021381 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-06771bde-a417-466b-8e3e-a0c996f59146 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:06:12.021381 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-06771bde-a417-466b-8e3e-a0c996f59146 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.010214 Sep 14 09:06:12.023209 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1955/3935] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 09:06:12 2022] POST /compute/v2.1/servers => generated 624 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 14 09:06:12.029252 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-4a39e597-6948-4c8b-bf92-c8df06ac248c tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:12.029878 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-4a39e597-6948-4c8b-bf92-c8df06ac248c tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:12.038203 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4a39e597-6948-4c8b-bf92-c8df06ac248c tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:12.038704 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4a39e597-6948-4c8b-bf92-c8df06ac248c tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:12.039193 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4a39e597-6948-4c8b-bf92-c8df06ac248c tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:12.039913 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4a39e597-6948-4c8b-bf92-c8df06ac248c tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:12.040379 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4a39e597-6948-4c8b-bf92-c8df06ac248c tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:12.040809 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4a39e597-6948-4c8b-bf92-c8df06ac248c tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:12.309292 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-4a39e597-6948-4c8b-bf92-c8df06ac248c tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:06:12.326964 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-4a39e597-6948-4c8b-bf92-c8df06ac248c tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1506 microversion: 2.1 time: 0.300436 Sep 14 09:06:12.350369 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1981/3936] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:06:12 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1506 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:06:12.358479 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-2639be68-246b-49da-94e5-6350b9ca2763 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:12.359601 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-2639be68-246b-49da-94e5-6350b9ca2763 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:12.372072 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2639be68-246b-49da-94e5-6350b9ca2763 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:12.374640 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2639be68-246b-49da-94e5-6350b9ca2763 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:12.377661 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2639be68-246b-49da-94e5-6350b9ca2763 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:12.378525 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2639be68-246b-49da-94e5-6350b9ca2763 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:12.379292 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2639be68-246b-49da-94e5-6350b9ca2763 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:12.383968 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2639be68-246b-49da-94e5-6350b9ca2763 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:12.627136 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-2639be68-246b-49da-94e5-6350b9ca2763 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:06:12.635074 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-2639be68-246b-49da-94e5-6350b9ca2763 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1506 microversion: 2.1 time: 0.281290 Sep 14 09:06:12.635713 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1956/3937] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:06:12 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1506 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:06:12.866442 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d78c8c3c-82ed-4f44-bbc0-70dc0d6d2ff7 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "networks": [{"uuid": "2616a0b0-fea1-46f8-bf23-608a226da1ef"}]}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:06:12.870324 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d78c8c3c-82ed-4f44-bbc0-70dc0d6d2ff7 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Request method failure captured: Sep 14 09:06:12.870324 n-d-836830-18 devstack@n-api.service[128758]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 14 09:06:12.870324 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 09:06:12.870324 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 09:06:12.870324 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 09:06:12.870324 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 416 Sep 14 09:06:12.870324 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 09:06:12.870324 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 09:06:12.870324 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 09:06:12.870324 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 09:06:12.870324 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZk2EvHIWQyXATvY4f6phbqF3DzIIyaJjJFCE11LxTKbrsndvuk5zoyyEUR0VXx32_kFjD0I6jBROuj0ZPSHQav7u9FFvOPFGrPkf9qZrgXY9k3zAUFrOVfwLECoLZOolubyCPUAGSEOi_HvFIP_Dd_DCbUCKDEGGLtdnAzy2tLCxHs Sep 14 09:06:12.870324 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 09:06:12.870324 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 09:06:12.870324 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 09:06:12.870324 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 09:06:12.870324 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 09:06:12.870324 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 09:06:12.870324 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 6907b82c9d5c4a23a63bbeec31c3c365 Sep 14 09:06:12.870324 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-ServersNegativeTestJSON-1654813540 Sep 14 09:06:12.870324 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 09:06:12.870324 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 09:06:12.870324 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6907b82c9d5c4a23a63bbeec31c3c365"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6907b82c9d5c4a23a63bbeec31c3c365"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6907b82c9d5c4a23a63bbeec31c3c365"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6907b82c9d5c4a23a63bbeec31c3c365"}]}] Sep 14 09:06:12.870324 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-ServersNegativeTestJSON-1654813540 Sep 14 09:06:12.870324 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 6907b82c9d5c4a23a63bbeec31c3c365 Sep 14 09:06:12.870324 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1654813540 Sep 14 09:06:12.870324 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-ServersNegativeTestJSON-1654813540-project Sep 14 09:06:12.870324 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 09:06:12.870324 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 09:06:12.870324 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 79583c4e80a04f138927f09eb4e170f4 Sep 14 09:06:12.870324 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-ServersNegativeTestJSON-1654813540-project Sep 14 09:06:12.870324 n-d-836830-18 devstack@n-api.service[128758]: Sep 14 09:06:12.870324 n-d-836830-18 devstack@n-api.service[128758]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "networks": [{"uuid": "2616a0b0-fea1-46f8-bf23-608a226da1ef"}]}} Sep 14 09:06:12.870324 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 09:06:12.870324 n-d-836830-18 devstack@n-api.service[128758]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 14 09:06:12.870324 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': 'bff4ab7f-4846-441f-8940-d96fec4c28e9', 'flavorRef': '452', 'networks': [{'uuid': '2616a0b0-fea1-46f8-bf23-608a226da1ef'}]}}} Sep 14 09:06:12.870324 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:06:12.870324 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:06:12.870324 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 14 09:06:12.870324 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 14 09:06:12.870324 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 14 09:06:12.870324 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise error Sep 14 09:06:12.870324 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 14 09:06:12.870324 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:06:12.870324 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Sep 14 09:06:12.870324 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 14 09:06:12.870324 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:06:12.870324 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 14 09:06:12.870324 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Sep 14 09:06:12.870324 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:06:12.870324 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:06:12.872918 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:06:12.872918 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:06:12.872918 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:06:12.872918 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:06:12.872918 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:06:12.872918 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:06:12.872918 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:06:12.872918 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:06:12.872918 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:06:12.872918 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:06:12.872918 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 14 09:06:12.872918 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 14 09:06:12.872918 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 14 09:06:12.872918 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 14 09:06:12.872918 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 14 09:06:12.872918 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 14 09:06:12.872918 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 14 09:06:12.872918 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:06:12.872918 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:06:12.872918 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:06:12.872918 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:06:12.872918 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:06:12.872918 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:06:12.872918 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 14 09:06:12.872918 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 14 09:06:12.872918 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 14 09:06:12.872918 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:06:12.876489 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d78c8c3c-82ed-4f44-bbc0-70dc0d6d2ff7 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:06:12.877694 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-d78c8c3c-82ed-4f44-bbc0-70dc0d6d2ff7 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.015321 Sep 14 09:06:12.878835 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1982/3938] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 09:06:12 2022] POST /compute/v2.1/servers => generated 619 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 14 09:06:12.886737 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-0683f5b7-901f-4689-88aa-c9bbf460787f tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:12.887755 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-0683f5b7-901f-4689-88aa-c9bbf460787f tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:12.894148 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0683f5b7-901f-4689-88aa-c9bbf460787f tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:12.894967 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0683f5b7-901f-4689-88aa-c9bbf460787f tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:12.895641 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0683f5b7-901f-4689-88aa-c9bbf460787f tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:12.896552 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0683f5b7-901f-4689-88aa-c9bbf460787f tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:12.897209 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0683f5b7-901f-4689-88aa-c9bbf460787f tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:12.898373 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0683f5b7-901f-4689-88aa-c9bbf460787f tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:12.927161 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-4d2d8eb8-5a47-4534-87ab-4c1df1e7d987 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:12.928498 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-4d2d8eb8-5a47-4534-87ab-4c1df1e7d987 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] [instance: ed6976ad-867b-4570-a547-758efc8f622f] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:12.941834 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4d2d8eb8-5a47-4534-87ab-4c1df1e7d987 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:12.945087 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4d2d8eb8-5a47-4534-87ab-4c1df1e7d987 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:12.948270 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4d2d8eb8-5a47-4534-87ab-4c1df1e7d987 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:12.949260 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4d2d8eb8-5a47-4534-87ab-4c1df1e7d987 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:12.950736 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4d2d8eb8-5a47-4534-87ab-4c1df1e7d987 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:12.951415 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4d2d8eb8-5a47-4534-87ab-4c1df1e7d987 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:13.251275 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-0683f5b7-901f-4689-88aa-c9bbf460787f tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:06:13.283354 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-0683f5b7-901f-4689-88aa-c9bbf460787f tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1506 microversion: 2.1 time: 0.393725 Sep 14 09:06:13.291232 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1957/3939] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:06:12 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1506 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:06:13.313883 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-4d2d8eb8-5a47-4534-87ab-4c1df1e7d987 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5165b8fc101c47c7a4370f9007bc5a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a597fc389b4805bbd3a53ecd17c5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:06:13.321386 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f416a6f9-3203-4256-ab30-8d97f7d1bd05 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:13.322844 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f416a6f9-3203-4256-ab30-8d97f7d1bd05 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:13.333109 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-4d2d8eb8-5a47-4534-87ab-4c1df1e7d987 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute/v2.1/servers/ed6976ad-867b-4570-a547-758efc8f622f" status: 200 len: 1308 microversion: 2.1 time: 0.410076 Sep 14 09:06:13.340219 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f416a6f9-3203-4256-ab30-8d97f7d1bd05 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:13.356307 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f416a6f9-3203-4256-ab30-8d97f7d1bd05 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:13.356945 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1983/3940] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:06:12 2022] GET /compute/v2.1/servers/ed6976ad-867b-4570-a547-758efc8f622f => generated 1308 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:06:13.357709 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f416a6f9-3203-4256-ab30-8d97f7d1bd05 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:13.358575 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f416a6f9-3203-4256-ab30-8d97f7d1bd05 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:13.359342 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f416a6f9-3203-4256-ab30-8d97f7d1bd05 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:13.359977 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f416a6f9-3203-4256-ab30-8d97f7d1bd05 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:13.530670 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f416a6f9-3203-4256-ab30-8d97f7d1bd05 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:06:13.540652 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f416a6f9-3203-4256-ab30-8d97f7d1bd05 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1506 microversion: 2.1 time: 0.233220 Sep 14 09:06:13.552634 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1958/3941] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:06:13 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1506 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:06:13.754985 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1176cdc2-fa38-4332-885e-75529a806e03 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1405337979", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": -1, "networks": [{"uuid": "2616a0b0-fea1-46f8-bf23-608a226da1ef"}]}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:06:13.792085 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-1176cdc2-fa38-4332-885e-75529a806e03 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] HTTP exception thrown: Flavor -1 could not be found. Sep 14 09:06:13.796539 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1176cdc2-fa38-4332-885e-75529a806e03 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Request method failure captured: Sep 14 09:06:13.796539 n-d-836830-18 devstack@n-api.service[128758]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 14 09:06:13.796539 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 09:06:13.796539 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 09:06:13.796539 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 09:06:13.796539 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 206 Sep 14 09:06:13.796539 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 09:06:13.796539 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 09:06:13.796539 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 09:06:13.796539 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 09:06:13.796539 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZk2EvHIWQyXATvY4f6phbqF3DzIIyaJjJFCE11LxTKbrsndvuk5zoyyEUR0VXx32_kFjD0I6jBROuj0ZPSHQav7u9FFvOPFGrPkf9qZrgXY9k3zAUFrOVfwLECoLZOolubyCPUAGSEOi_HvFIP_Dd_DCbUCKDEGGLtdnAzy2tLCxHs Sep 14 09:06:13.796539 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 09:06:13.796539 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 09:06:13.796539 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 09:06:13.796539 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 09:06:13.796539 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 09:06:13.796539 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 09:06:13.796539 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 6907b82c9d5c4a23a63bbeec31c3c365 Sep 14 09:06:13.796539 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-ServersNegativeTestJSON-1654813540 Sep 14 09:06:13.796539 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 09:06:13.796539 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 09:06:13.796539 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6907b82c9d5c4a23a63bbeec31c3c365"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6907b82c9d5c4a23a63bbeec31c3c365"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6907b82c9d5c4a23a63bbeec31c3c365"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6907b82c9d5c4a23a63bbeec31c3c365"}]}] Sep 14 09:06:13.796539 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-ServersNegativeTestJSON-1654813540 Sep 14 09:06:13.796539 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 6907b82c9d5c4a23a63bbeec31c3c365 Sep 14 09:06:13.796539 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1654813540 Sep 14 09:06:13.796539 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-ServersNegativeTestJSON-1654813540-project Sep 14 09:06:13.796539 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 09:06:13.796539 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 09:06:13.796539 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 79583c4e80a04f138927f09eb4e170f4 Sep 14 09:06:13.796539 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-ServersNegativeTestJSON-1654813540-project Sep 14 09:06:13.796539 n-d-836830-18 devstack@n-api.service[128758]: Sep 14 09:06:13.796539 n-d-836830-18 devstack@n-api.service[128758]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1405337979", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": -1, "networks": [{"uuid": "2616a0b0-fea1-46f8-bf23-608a226da1ef"}]}} Sep 14 09:06:13.796539 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 09:06:13.796539 n-d-836830-18 devstack@n-api.service[128758]: exception: Flavor -1 could not be found. Sep 14 09:06:13.796539 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1405337979', 'imageRef': 'bff4ab7f-4846-441f-8940-d96fec4c28e9', 'flavorRef': -1, 'networks': [{'uuid': '2616a0b0-fea1-46f8-bf23-608a226da1ef'}]}}} Sep 14 09:06:13.796539 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:06:13.796539 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:06:13.796539 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Sep 14 09:06:13.796539 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Sep 14 09:06:13.796539 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 14 09:06:13.796539 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 14 09:06:13.796539 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 14 09:06:13.796539 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 14 09:06:13.796539 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 14 09:06:13.796539 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 14 09:06:13.796539 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 14 09:06:13.796539 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:06:13.796539 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 14 09:06:13.796539 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 14 09:06:13.796539 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Sep 14 09:06:13.796539 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:06:13.796539 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:06:13.796539 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:06:13.796539 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:06:13.796539 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:06:13.796539 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:06:13.796539 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:06:13.796539 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:06:13.796539 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:06:13.796539 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:06:13.796539 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:06:13.796539 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:06:13.800141 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:06:13.800141 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:06:13.800141 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:06:13.800141 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:06:13.800141 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 14 09:06:13.800141 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Sep 14 09:06:13.800141 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Sep 14 09:06:13.800141 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Sep 14 09:06:13.800141 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:06:13.800141 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:06:13.800141 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:06:13.800141 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:06:13.800141 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:06:13.800141 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:06:13.800141 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:06:13.800141 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:06:13.800141 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Sep 14 09:06:13.800141 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:06:13.802973 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1176cdc2-fa38-4332-885e-75529a806e03 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:06:13.805430 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-1176cdc2-fa38-4332-885e-75529a806e03 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.055561 Sep 14 09:06:13.810322 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1984/3942] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 09:06:13 2022] POST /compute/v2.1/servers => generated 73 bytes in 62 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 14 09:06:13.815464 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a0cad4bf-7f37-4cb6-a5b9-a1e2a0f1299b tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:13.816090 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-a0cad4bf-7f37-4cb6-a5b9-a1e2a0f1299b tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:13.836039 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a0cad4bf-7f37-4cb6-a5b9-a1e2a0f1299b tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:13.840437 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a0cad4bf-7f37-4cb6-a5b9-a1e2a0f1299b tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:13.840967 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a0cad4bf-7f37-4cb6-a5b9-a1e2a0f1299b tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:13.841718 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a0cad4bf-7f37-4cb6-a5b9-a1e2a0f1299b tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:13.842190 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a0cad4bf-7f37-4cb6-a5b9-a1e2a0f1299b tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:13.845519 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a0cad4bf-7f37-4cb6-a5b9-a1e2a0f1299b tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:13.847898 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=2 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:06:13.901486 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=6 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:06:14.370458 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=2 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:06:14.375157 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b626937f-250e-4b9a-a24d-d9df55b2a330 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:14.375785 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-b626937f-250e-4b9a-a24d-d9df55b2a330 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] [instance: ed6976ad-867b-4570-a547-758efc8f622f] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:14.401417 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b626937f-250e-4b9a-a24d-d9df55b2a330 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:14.402026 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b626937f-250e-4b9a-a24d-d9df55b2a330 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:14.402555 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b626937f-250e-4b9a-a24d-d9df55b2a330 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:14.406885 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b626937f-250e-4b9a-a24d-d9df55b2a330 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:14.407449 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b626937f-250e-4b9a-a24d-d9df55b2a330 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:14.410030 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b626937f-250e-4b9a-a24d-d9df55b2a330 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:14.672441 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-a0cad4bf-7f37-4cb6-a5b9-a1e2a0f1299b tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:06:14.687788 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a0cad4bf-7f37-4cb6-a5b9-a1e2a0f1299b tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1506 microversion: 2.1 time: 0.873585 Sep 14 09:06:14.691094 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1959/3943] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:06:13 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1506 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:06:14.718068 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-7075290c-5877-449c-8a1c-9a5c5e255754 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:14.719482 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-7075290c-5877-449c-8a1c-9a5c5e255754 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:14.738298 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7075290c-5877-449c-8a1c-9a5c5e255754 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:14.743558 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7075290c-5877-449c-8a1c-9a5c5e255754 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:14.744410 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7075290c-5877-449c-8a1c-9a5c5e255754 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:14.748638 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7075290c-5877-449c-8a1c-9a5c5e255754 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:14.749359 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7075290c-5877-449c-8a1c-9a5c5e255754 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:14.749949 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7075290c-5877-449c-8a1c-9a5c5e255754 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:14.807342 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-b626937f-250e-4b9a-a24d-d9df55b2a330 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5165b8fc101c47c7a4370f9007bc5a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a597fc389b4805bbd3a53ecd17c5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:06:14.821450 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-b626937f-250e-4b9a-a24d-d9df55b2a330 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute/v2.1/servers/ed6976ad-867b-4570-a547-758efc8f622f" status: 200 len: 1308 microversion: 2.1 time: 0.454872 Sep 14 09:06:14.823290 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1985/3944] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:06:14 2022] GET /compute/v2.1/servers/ed6976ad-867b-4570-a547-758efc8f622f => generated 1308 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:06:15.109354 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-7075290c-5877-449c-8a1c-9a5c5e255754 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:06:15.120724 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-7075290c-5877-449c-8a1c-9a5c5e255754 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1506 microversion: 2.1 time: 0.407253 Sep 14 09:06:15.121327 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1960/3945] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:06:14 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1506 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:06:15.291077 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-5ae770a6-8d42-4c6e-96ad-db761e7f9870 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1291127156", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "2616a0b0-fea1-46f8-bf23-608a226da1ef"}]}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:06:15.303331 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-5ae770a6-8d42-4c6e-96ad-db761e7f9870 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Request method failure captured: Sep 14 09:06:15.303331 n-d-836830-18 devstack@n-api.service[128758]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 14 09:06:15.303331 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 09:06:15.303331 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 09:06:15.303331 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 09:06:15.303331 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 173 Sep 14 09:06:15.303331 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 09:06:15.303331 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 09:06:15.303331 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 09:06:15.303331 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 09:06:15.303331 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZk2EvHIWQyXATvY4f6phbqF3DzIIyaJjJFCE11LxTKbrsndvuk5zoyyEUR0VXx32_kFjD0I6jBROuj0ZPSHQav7u9FFvOPFGrPkf9qZrgXY9k3zAUFrOVfwLECoLZOolubyCPUAGSEOi_HvFIP_Dd_DCbUCKDEGGLtdnAzy2tLCxHs Sep 14 09:06:15.303331 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 09:06:15.303331 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 09:06:15.303331 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 09:06:15.303331 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 09:06:15.303331 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 09:06:15.303331 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 09:06:15.303331 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 6907b82c9d5c4a23a63bbeec31c3c365 Sep 14 09:06:15.303331 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-ServersNegativeTestJSON-1654813540 Sep 14 09:06:15.303331 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 09:06:15.303331 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 09:06:15.303331 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6907b82c9d5c4a23a63bbeec31c3c365"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6907b82c9d5c4a23a63bbeec31c3c365"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6907b82c9d5c4a23a63bbeec31c3c365"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6907b82c9d5c4a23a63bbeec31c3c365"}]}] Sep 14 09:06:15.303331 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-ServersNegativeTestJSON-1654813540 Sep 14 09:06:15.303331 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 6907b82c9d5c4a23a63bbeec31c3c365 Sep 14 09:06:15.303331 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1654813540 Sep 14 09:06:15.303331 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-ServersNegativeTestJSON-1654813540-project Sep 14 09:06:15.303331 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 09:06:15.303331 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 09:06:15.303331 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 79583c4e80a04f138927f09eb4e170f4 Sep 14 09:06:15.303331 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-ServersNegativeTestJSON-1654813540-project Sep 14 09:06:15.303331 n-d-836830-18 devstack@n-api.service[128758]: Sep 14 09:06:15.303331 n-d-836830-18 devstack@n-api.service[128758]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1291127156", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "2616a0b0-fea1-46f8-bf23-608a226da1ef"}]}} Sep 14 09:06:15.303331 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 09:06:15.303331 n-d-836830-18 devstack@n-api.service[128758]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Sep 14 09:06:15.303331 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1291127156', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': '2616a0b0-fea1-46f8-bf23-608a226da1ef'}]}}} Sep 14 09:06:15.303331 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:06:15.303331 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:06:15.303331 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 14 09:06:15.303331 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 14 09:06:15.303331 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 14 09:06:15.303331 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise error Sep 14 09:06:15.303331 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Sep 14 09:06:15.303331 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:06:15.303331 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Sep 14 09:06:15.303331 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Sep 14 09:06:15.303331 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Sep 14 09:06:15.303331 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:06:15.303331 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 14 09:06:15.303331 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi -1 Sep 14 09:06:15.303331 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:06:15.303331 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:06:15.303331 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:06:15.303331 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:06:15.303331 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:06:15.303331 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:06:15.303331 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:06:15.303331 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:06:15.303331 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:06:15.303331 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:06:15.303331 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:06:15.303331 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:06:15.303331 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 14 09:06:15.303331 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 14 09:06:15.303331 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 14 09:06:15.308629 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 14 09:06:15.308629 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 14 09:06:15.308629 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 14 09:06:15.308629 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Sep 14 09:06:15.308629 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:06:15.308629 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:06:15.308629 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:06:15.308629 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:06:15.308629 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:06:15.308629 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:06:15.308629 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 14 09:06:15.308629 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 14 09:06:15.308629 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Sep 14 09:06:15.308629 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:06:15.308629 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-5ae770a6-8d42-4c6e-96ad-db761e7f9870 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:06:15.308629 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-5ae770a6-8d42-4c6e-96ad-db761e7f9870 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.018981 Sep 14 09:06:15.314920 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9d04b48a-1205-452a-8f24-accc8597bc96 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:15.315914 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-9d04b48a-1205-452a-8f24-accc8597bc96 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:15.318987 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1986/3946] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 09:06:15 2022] POST /compute/v2.1/servers => generated 145 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 14 09:06:15.323096 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9d04b48a-1205-452a-8f24-accc8597bc96 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:15.325090 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9d04b48a-1205-452a-8f24-accc8597bc96 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:15.325545 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9d04b48a-1205-452a-8f24-accc8597bc96 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:15.326281 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9d04b48a-1205-452a-8f24-accc8597bc96 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:15.326744 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9d04b48a-1205-452a-8f24-accc8597bc96 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:15.327215 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9d04b48a-1205-452a-8f24-accc8597bc96 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:15.693919 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-9d04b48a-1205-452a-8f24-accc8597bc96 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:06:15.699821 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=100 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:06:15.720736 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-9d04b48a-1205-452a-8f24-accc8597bc96 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1506 microversion: 2.1 time: 0.409676 Sep 14 09:06:15.721675 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1961/3947] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:06:15 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1506 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:06:15.746931 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-70978fbd-753d-4e33-bc29-04e8bc44efd1 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:15.748108 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-70978fbd-753d-4e33-bc29-04e8bc44efd1 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:15.758402 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-70978fbd-753d-4e33-bc29-04e8bc44efd1 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:15.759327 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-70978fbd-753d-4e33-bc29-04e8bc44efd1 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:15.760073 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-70978fbd-753d-4e33-bc29-04e8bc44efd1 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:15.761197 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-70978fbd-753d-4e33-bc29-04e8bc44efd1 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:15.761880 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-70978fbd-753d-4e33-bc29-04e8bc44efd1 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:15.762543 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-70978fbd-753d-4e33-bc29-04e8bc44efd1 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:15.850623 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-495381a5-d9e9-4964-9a22-856b0a270066 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:15.852039 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-495381a5-d9e9-4964-9a22-856b0a270066 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] [instance: ed6976ad-867b-4570-a547-758efc8f622f] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:15.861334 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-495381a5-d9e9-4964-9a22-856b0a270066 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:15.862185 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-495381a5-d9e9-4964-9a22-856b0a270066 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:15.863103 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-495381a5-d9e9-4964-9a22-856b0a270066 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:15.864356 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-495381a5-d9e9-4964-9a22-856b0a270066 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:15.865091 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-495381a5-d9e9-4964-9a22-856b0a270066 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:15.865675 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-495381a5-d9e9-4964-9a22-856b0a270066 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:16.767544 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-70978fbd-753d-4e33-bc29-04e8bc44efd1 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:06:16.777333 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-495381a5-d9e9-4964-9a22-856b0a270066 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5165b8fc101c47c7a4370f9007bc5a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a597fc389b4805bbd3a53ecd17c5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:06:16.781509 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-70978fbd-753d-4e33-bc29-04e8bc44efd1 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1506 microversion: 2.1 time: 1.038866 Sep 14 09:06:16.786177 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-495381a5-d9e9-4964-9a22-856b0a270066 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute/v2.1/servers/ed6976ad-867b-4570-a547-758efc8f622f" status: 200 len: 1308 microversion: 2.1 time: 0.940972 Sep 14 09:06:16.791529 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1962/3948] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:06:15 2022] GET /compute/v2.1/servers/ed6976ad-867b-4570-a547-758efc8f622f => generated 1308 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:06:16.805723 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1987/3949] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:06:15 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1506 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:06:16.960590 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-46530512-1514-4228-bbd6-b8fceb6892d2 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1249574030", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:06:16.971928 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-46530512-1514-4228-bbd6-b8fceb6892d2 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Sep 14 09:06:16.979254 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-46530512-1514-4228-bbd6-b8fceb6892d2 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Request method failure captured: Sep 14 09:06:16.979254 n-d-836830-18 devstack@n-api.service[128759]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 14 09:06:16.979254 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:06:16.979254 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:06:16.979254 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:06:16.979254 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 216 Sep 14 09:06:16.979254 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:06:16.979254 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:06:16.979254 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:06:16.979254 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:06:16.979254 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZk2EvHIWQyXATvY4f6phbqF3DzIIyaJjJFCE11LxTKbrsndvuk5zoyyEUR0VXx32_kFjD0I6jBROuj0ZPSHQav7u9FFvOPFGrPkf9qZrgXY9k3zAUFrOVfwLECoLZOolubyCPUAGSEOi_HvFIP_Dd_DCbUCKDEGGLtdnAzy2tLCxHs Sep 14 09:06:16.979254 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:06:16.979254 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:06:16.979254 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:06:16.979254 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:06:16.979254 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:06:16.979254 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:06:16.979254 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 6907b82c9d5c4a23a63bbeec31c3c365 Sep 14 09:06:16.979254 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ServersNegativeTestJSON-1654813540 Sep 14 09:06:16.979254 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:06:16.979254 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:06:16.979254 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6907b82c9d5c4a23a63bbeec31c3c365"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6907b82c9d5c4a23a63bbeec31c3c365"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6907b82c9d5c4a23a63bbeec31c3c365"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6907b82c9d5c4a23a63bbeec31c3c365"}]}] Sep 14 09:06:16.979254 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ServersNegativeTestJSON-1654813540 Sep 14 09:06:16.979254 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 6907b82c9d5c4a23a63bbeec31c3c365 Sep 14 09:06:16.979254 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1654813540 Sep 14 09:06:16.979254 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ServersNegativeTestJSON-1654813540-project Sep 14 09:06:16.979254 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:06:16.979254 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:06:16.979254 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 79583c4e80a04f138927f09eb4e170f4 Sep 14 09:06:16.979254 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ServersNegativeTestJSON-1654813540-project Sep 14 09:06:16.979254 n-d-836830-18 devstack@n-api.service[128759]: Sep 14 09:06:16.979254 n-d-836830-18 devstack@n-api.service[128759]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1249574030", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Sep 14 09:06:16.979254 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:06:16.979254 n-d-836830-18 devstack@n-api.service[128759]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Sep 14 09:06:16.979254 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1249574030', 'imageRef': 'bff4ab7f-4846-441f-8940-d96fec4c28e9', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Sep 14 09:06:16.979254 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:06:16.979254 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:06:16.979254 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:06:16.979254 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:06:16.979254 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:06:16.979254 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:06:16.979254 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:06:16.979254 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:06:16.979254 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:06:16.979254 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:06:16.979254 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:06:16.979254 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:06:16.979254 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:06:16.979254 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:06:16.979254 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 14 09:06:16.979254 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Sep 14 09:06:16.979254 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Sep 14 09:06:16.979254 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Sep 14 09:06:16.979254 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Sep 14 09:06:16.979254 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Sep 14 09:06:16.979254 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self._validate_network_id( Sep 14 09:06:16.979254 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Sep 14 09:06:16.979254 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Sep 14 09:06:16.979254 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Sep 14 09:06:16.979254 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:16.979254 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:06:16.982608 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:16.982608 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:06:16.982608 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:06:16.982608 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:06:16.982608 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:06:16.982608 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:06:16.982608 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Sep 14 09:06:16.982608 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:16.986667 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-46530512-1514-4228-bbd6-b8fceb6892d2 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:06:16.989678 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-46530512-1514-4228-bbd6-b8fceb6892d2 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.034203 Sep 14 09:06:16.990815 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1963/3950] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 09:06:16 2022] POST /compute/v2.1/servers => generated 123 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 14 09:06:17.015690 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-bb02a76d-7293-4bb3-b677-9d55ecebbe5f tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:17.016512 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-bb02a76d-7293-4bb3-b677-9d55ecebbe5f tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:17.030745 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bb02a76d-7293-4bb3-b677-9d55ecebbe5f tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:17.031463 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bb02a76d-7293-4bb3-b677-9d55ecebbe5f tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:17.032041 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bb02a76d-7293-4bb3-b677-9d55ecebbe5f tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:17.032944 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bb02a76d-7293-4bb3-b677-9d55ecebbe5f tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:17.033552 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bb02a76d-7293-4bb3-b677-9d55ecebbe5f tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:17.034314 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bb02a76d-7293-4bb3-b677-9d55ecebbe5f tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:17.801663 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-bb02a76d-7293-4bb3-b677-9d55ecebbe5f tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:06:17.814540 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-bb02a76d-7293-4bb3-b677-9d55ecebbe5f tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1506 microversion: 2.1 time: 0.817954 Sep 14 09:06:17.816360 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1988/3951] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:06:16 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1506 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:06:17.818364 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-cfb23f18-a425-46fa-9b55-35780c7bd67c tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:17.819036 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-cfb23f18-a425-46fa-9b55-35780c7bd67c tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] [instance: ed6976ad-867b-4570-a547-758efc8f622f] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:17.842251 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-47a83a54-ef6e-43ec-afd6-0a2768d9e8da tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:17.843261 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-47a83a54-ef6e-43ec-afd6-0a2768d9e8da tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:17.847411 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cfb23f18-a425-46fa-9b55-35780c7bd67c tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:17.847953 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cfb23f18-a425-46fa-9b55-35780c7bd67c tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:17.857289 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cfb23f18-a425-46fa-9b55-35780c7bd67c tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:17.858854 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cfb23f18-a425-46fa-9b55-35780c7bd67c tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:17.858997 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-47a83a54-ef6e-43ec-afd6-0a2768d9e8da tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:17.859603 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-47a83a54-ef6e-43ec-afd6-0a2768d9e8da tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:17.861233 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cfb23f18-a425-46fa-9b55-35780c7bd67c tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:17.861462 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-47a83a54-ef6e-43ec-afd6-0a2768d9e8da tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:17.861860 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cfb23f18-a425-46fa-9b55-35780c7bd67c tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:17.863722 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-47a83a54-ef6e-43ec-afd6-0a2768d9e8da tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:17.865497 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-47a83a54-ef6e-43ec-afd6-0a2768d9e8da tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:17.867491 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-47a83a54-ef6e-43ec-afd6-0a2768d9e8da tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:18.263052 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-47a83a54-ef6e-43ec-afd6-0a2768d9e8da tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:06:18.281109 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-47a83a54-ef6e-43ec-afd6-0a2768d9e8da tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1506 microversion: 2.1 time: 0.443420 Sep 14 09:06:18.284090 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1989/3952] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:06:17 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1506 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:06:18.298639 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-cfb23f18-a425-46fa-9b55-35780c7bd67c tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5165b8fc101c47c7a4370f9007bc5a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a597fc389b4805bbd3a53ecd17c5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:06:18.319004 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-cfb23f18-a425-46fa-9b55-35780c7bd67c tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute/v2.1/servers/ed6976ad-867b-4570-a547-758efc8f622f" status: 200 len: 1308 microversion: 2.1 time: 0.508941 Sep 14 09:06:18.323560 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1964/3953] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:06:17 2022] GET /compute/v2.1/servers/ed6976ad-867b-4570-a547-758efc8f622f => generated 1308 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:06:18.509871 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c2838fd9-1c80-47b0-a90f-8aa00ecaa69e tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-650486242", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "key_name": "tempest-key-1088811024", "networks": [{"uuid": "2616a0b0-fea1-46f8-bf23-608a226da1ef"}]}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:06:18.635556 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.network.neutron [None req-c2838fd9-1c80-47b0-a90f-8aa00ecaa69e tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] validate_networks() for [('2616a0b0-fea1-46f8-bf23-608a226da1ef', None, None, None, None, None)] {{(pid=128758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:06:19.347354 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-be0f4725-affc-4988-af2c-7a264f61b492 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:19.355313 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-be0f4725-affc-4988-af2c-7a264f61b492 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] [instance: ed6976ad-867b-4570-a547-758efc8f622f] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:19.371352 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-be0f4725-affc-4988-af2c-7a264f61b492 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:19.372044 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-be0f4725-affc-4988-af2c-7a264f61b492 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:19.372504 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-be0f4725-affc-4988-af2c-7a264f61b492 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:19.373248 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-be0f4725-affc-4988-af2c-7a264f61b492 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:19.373709 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-be0f4725-affc-4988-af2c-7a264f61b492 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:19.374140 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-be0f4725-affc-4988-af2c-7a264f61b492 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:19.703164 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-c2838fd9-1c80-47b0-a90f-8aa00ecaa69e tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] HTTP exception thrown: Invalid key_name provided. Sep 14 09:06:19.705168 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c2838fd9-1c80-47b0-a90f-8aa00ecaa69e tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Request method failure captured: Sep 14 09:06:19.705168 n-d-836830-18 devstack@n-api.service[128758]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 14 09:06:19.705168 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 09:06:19.705168 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 09:06:19.705168 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 09:06:19.705168 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 246 Sep 14 09:06:19.705168 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 09:06:19.705168 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 09:06:19.705168 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 09:06:19.705168 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 09:06:19.705168 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZk2EvHIWQyXATvY4f6phbqF3DzIIyaJjJFCE11LxTKbrsndvuk5zoyyEUR0VXx32_kFjD0I6jBROuj0ZPSHQav7u9FFvOPFGrPkf9qZrgXY9k3zAUFrOVfwLECoLZOolubyCPUAGSEOi_HvFIP_Dd_DCbUCKDEGGLtdnAzy2tLCxHs Sep 14 09:06:19.705168 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 09:06:19.705168 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 09:06:19.705168 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 09:06:19.705168 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 09:06:19.705168 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 09:06:19.705168 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 09:06:19.705168 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 6907b82c9d5c4a23a63bbeec31c3c365 Sep 14 09:06:19.705168 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-ServersNegativeTestJSON-1654813540 Sep 14 09:06:19.705168 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 09:06:19.705168 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 09:06:19.705168 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6907b82c9d5c4a23a63bbeec31c3c365"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6907b82c9d5c4a23a63bbeec31c3c365"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6907b82c9d5c4a23a63bbeec31c3c365"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6907b82c9d5c4a23a63bbeec31c3c365"}]}] Sep 14 09:06:19.705168 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-ServersNegativeTestJSON-1654813540 Sep 14 09:06:19.705168 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 6907b82c9d5c4a23a63bbeec31c3c365 Sep 14 09:06:19.705168 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1654813540 Sep 14 09:06:19.705168 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-ServersNegativeTestJSON-1654813540-project Sep 14 09:06:19.705168 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 09:06:19.705168 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 09:06:19.705168 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 79583c4e80a04f138927f09eb4e170f4 Sep 14 09:06:19.705168 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-ServersNegativeTestJSON-1654813540-project Sep 14 09:06:19.705168 n-d-836830-18 devstack@n-api.service[128758]: Sep 14 09:06:19.705168 n-d-836830-18 devstack@n-api.service[128758]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-650486242", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "key_name": "tempest-key-1088811024", "networks": [{"uuid": "2616a0b0-fea1-46f8-bf23-608a226da1ef"}]}} Sep 14 09:06:19.705168 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 09:06:19.705168 n-d-836830-18 devstack@n-api.service[128758]: exception: Invalid key_name provided. Sep 14 09:06:19.705168 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-650486242', 'imageRef': 'bff4ab7f-4846-441f-8940-d96fec4c28e9', 'flavorRef': '452', 'key_name': 'tempest-key-1088811024', 'networks': [{'uuid': '2616a0b0-fea1-46f8-bf23-608a226da1ef'}]}}} Sep 14 09:06:19.705168 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:06:19.705168 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:06:19.705168 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 14 09:06:19.705168 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 14 09:06:19.705168 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 14 09:06:19.705168 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 14 09:06:19.705168 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Sep 14 09:06:19.705168 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Sep 14 09:06:19.705168 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1089, in _validate_and_build_base_options Sep 14 09:06:19.705168 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Sep 14 09:06:19.705168 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 14 09:06:19.705168 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 14 09:06:19.705168 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Sep 14 09:06:19.705168 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Sep 14 09:06:19.705168 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Sep 14 09:06:19.705168 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Sep 14 09:06:19.705168 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 14 09:06:19.705168 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 14 09:06:19.705168 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Sep 14 09:06:19.705168 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Sep 14 09:06:19.705168 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-1088811024 not found for user 79583c4e80a04f138927f09eb4e170f4 Sep 14 09:06:19.705168 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:06:19.705168 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:06:19.705168 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:06:19.705168 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:06:19.705168 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:06:19.708738 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:06:19.708738 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:06:19.708738 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:06:19.708738 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:06:19.708738 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:06:19.708738 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:06:19.708738 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:06:19.708738 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:06:19.708738 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:06:19.708738 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:06:19.708738 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:06:19.708738 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 14 09:06:19.708738 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Sep 14 09:06:19.708738 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Sep 14 09:06:19.708738 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Sep 14 09:06:19.708738 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:06:19.708738 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:06:19.708738 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:06:19.708738 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:06:19.708738 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:06:19.708738 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:06:19.708738 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:06:19.708738 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:06:19.708738 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Sep 14 09:06:19.708738 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:06:19.708738 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c2838fd9-1c80-47b0-a90f-8aa00ecaa69e tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Returning 400 to user: Invalid key_name provided. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:06:19.708738 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-c2838fd9-1c80-47b0-a90f-8aa00ecaa69e tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 1.207736 Sep 14 09:06:19.716455 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1990/3954] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 09:06:18 2022] POST /compute/v2.1/servers => generated 70 bytes in 1217 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 14 09:06:19.722774 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-aac4a147-3daa-433a-a4c9-437c0c30b478 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:19.723441 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-aac4a147-3daa-433a-a4c9-437c0c30b478 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:19.745611 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-aac4a147-3daa-433a-a4c9-437c0c30b478 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:19.745850 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-aac4a147-3daa-433a-a4c9-437c0c30b478 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:19.746294 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-aac4a147-3daa-433a-a4c9-437c0c30b478 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:19.751062 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-aac4a147-3daa-433a-a4c9-437c0c30b478 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:19.751564 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-aac4a147-3daa-433a-a4c9-437c0c30b478 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:19.752068 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-aac4a147-3daa-433a-a4c9-437c0c30b478 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:20.834132 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-aac4a147-3daa-433a-a4c9-437c0c30b478 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:06:20.851415 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-aac4a147-3daa-433a-a4c9-437c0c30b478 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1506 microversion: 2.1 time: 1.132529 Sep 14 09:06:20.852973 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1991/3955] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:06:19 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1506 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:06:20.880137 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-e84c6457-c9dc-49ac-bdfe-9c48490803a4 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:20.881358 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-e84c6457-c9dc-49ac-bdfe-9c48490803a4 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:20.893285 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e84c6457-c9dc-49ac-bdfe-9c48490803a4 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:20.894891 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e84c6457-c9dc-49ac-bdfe-9c48490803a4 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:20.896498 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e84c6457-c9dc-49ac-bdfe-9c48490803a4 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:20.900334 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e84c6457-c9dc-49ac-bdfe-9c48490803a4 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:20.903735 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e84c6457-c9dc-49ac-bdfe-9c48490803a4 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:20.904510 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e84c6457-c9dc-49ac-bdfe-9c48490803a4 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:21.993010 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-be0f4725-affc-4988-af2c-7a264f61b492 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5165b8fc101c47c7a4370f9007bc5a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a597fc389b4805bbd3a53ecd17c5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:06:22.009259 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-be0f4725-affc-4988-af2c-7a264f61b492 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute/v2.1/servers/ed6976ad-867b-4570-a547-758efc8f622f" status: 200 len: 1308 microversion: 2.1 time: 2.664872 Sep 14 09:06:22.011712 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1965/3956] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:06:19 2022] GET /compute/v2.1/servers/ed6976ad-867b-4570-a547-758efc8f622f => generated 1308 bytes in 2669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:06:22.033083 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-347c64f8-e16b-473e-8764-af83ff75a089 req-30f6aad6-15cf-4c81-8fc0-70e386138618 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed6976ad-867b-4570-a547-758efc8f622f", "name": "network-vif-plugged", "status": "completed", "tag": "5445fa77-c239-4d3c-8132-f14f545198cd"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:06:22.048075 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-347c64f8-e16b-473e-8764-af83ff75a089 req-30f6aad6-15cf-4c81-8fc0-70e386138618 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:22.049161 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-347c64f8-e16b-473e-8764-af83ff75a089 req-30f6aad6-15cf-4c81-8fc0-70e386138618 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:22.049751 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-347c64f8-e16b-473e-8764-af83ff75a089 req-30f6aad6-15cf-4c81-8fc0-70e386138618 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:22.073515 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-347c64f8-e16b-473e-8764-af83ff75a089 req-30f6aad6-15cf-4c81-8fc0-70e386138618 service nova] Creating event network-vif-plugged:5445fa77-c239-4d3c-8132-f14f545198cd for instance ed6976ad-867b-4570-a547-758efc8f622f on n-h1-836830-18 Sep 14 09:06:22.088003 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-347c64f8-e16b-473e-8764-af83ff75a089 req-30f6aad6-15cf-4c81-8fc0-70e386138618 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067343 Sep 14 09:06:22.104845 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1966/3957] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:06:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:06:22.441519 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b3ec4afa-dc4e-4fed-87ec-a5904b4c04a3 tempest-ServerGroup264TestJSON-2137584931 tempest-ServerGroup264TestJSON-2137584931-project] Action: 'create', calling method: .version_select at 0x7f7d48665ca0>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:06:22.492646 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-b3ec4afa-dc4e-4fed-87ec-a5904b4c04a3 tempest-ServerGroup264TestJSON-2137584931 tempest-ServerGroup264TestJSON-2137584931-project] Getting quotas for project 73af5c5e175146f9bbc10abd2b1f53fe. Resources: {'server_groups'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:06:22.504646 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-b3ec4afa-dc4e-4fed-87ec-a5904b4c04a3 tempest-ServerGroup264TestJSON-2137584931 tempest-ServerGroup264TestJSON-2137584931-project] Getting quotas for user e56548ed0e4243fe9110e455bbc6f101 and project 73af5c5e175146f9bbc10abd2b1f53fe. Resources: {'server_groups'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:06:22.590422 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-b3ec4afa-dc4e-4fed-87ec-a5904b4c04a3 tempest-ServerGroup264TestJSON-2137584931 tempest-ServerGroup264TestJSON-2137584931-project] Getting quotas for project 73af5c5e175146f9bbc10abd2b1f53fe. Resources: {'server_groups'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:06:22.612161 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-b3ec4afa-dc4e-4fed-87ec-a5904b4c04a3 tempest-ServerGroup264TestJSON-2137584931 tempest-ServerGroup264TestJSON-2137584931-project] Getting quotas for user e56548ed0e4243fe9110e455bbc6f101 and project 73af5c5e175146f9bbc10abd2b1f53fe. Resources: {'server_groups'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:06:22.647043 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b3ec4afa-dc4e-4fed-87ec-a5904b4c04a3 tempest-ServerGroup264TestJSON-2137584931 tempest-ServerGroup264TestJSON-2137584931-project] 10.222.0.60 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.447329 Sep 14 09:06:22.648566 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1967/3958] 10.222.0.60 () {62 vars in 1214 bytes} [Wed Sep 14 09:06:22 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 14 09:06:22.660216 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e1b72412-13dd-4402-a57f-ab2887dbaa0c tempest-ServerGroup264TestJSON-2137584931 tempest-ServerGroup264TestJSON-2137584931-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:22.680234 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-e84c6457-c9dc-49ac-bdfe-9c48490803a4 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:06:22.702862 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e1b72412-13dd-4402-a57f-ab2887dbaa0c tempest-ServerGroup264TestJSON-2137584931 tempest-ServerGroup264TestJSON-2137584931-project] 10.222.0.60 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.046369 Sep 14 09:06:22.717895 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-e84c6457-c9dc-49ac-bdfe-9c48490803a4 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1506 microversion: 2.1 time: 1.828726 Sep 14 09:06:22.718570 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1992/3959] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:06:20 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1506 bytes in 1844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:06:22.720603 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1968/3960] 10.222.0.60 () {60 vars in 1193 bytes} [Wed Sep 14 09:06:22 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 09:06:22.761488 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-bead9249-ff4b-4944-9fd5-08f03921951d tempest-ServerGroup264TestJSON-2137584931 tempest-ServerGroup264TestJSON-2137584931-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:22.775980 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:06:22.796204 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-bead9249-ff4b-4944-9fd5-08f03921951d tempest-ServerGroup264TestJSON-2137584931 tempest-ServerGroup264TestJSON-2137584931-project] 10.222.0.60 "GET /compute/v2.1/os-server-groups/45698cf2-154e-42be-a98b-ebe7d7e3c976" status: 200 len: 235 microversion: 2.64 time: 0.040193 Sep 14 09:06:22.797166 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1969/3961] 10.222.0.60 () {60 vars in 1304 bytes} [Wed Sep 14 09:06:22 2022] GET /compute/v2.1/os-server-groups/45698cf2-154e-42be-a98b-ebe7d7e3c976 => generated 235 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 09:06:22.809910 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-283f637c-dff3-4a01-bac2-04f4f2a2f3d1 tempest-ServerGroup264TestJSON-2137584931 tempest-ServerGroup264TestJSON-2137584931-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:22.867231 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-283f637c-dff3-4a01-bac2-04f4f2a2f3d1 tempest-ServerGroup264TestJSON-2137584931 tempest-ServerGroup264TestJSON-2137584931-project] 10.222.0.60 "DELETE /compute/v2.1/os-server-groups/45698cf2-154e-42be-a98b-ebe7d7e3c976" status: 204 len: 0 microversion: 2.64 time: 0.061582 Sep 14 09:06:22.877280 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1993/3962] 10.222.0.60 () {60 vars in 1307 bytes} [Wed Sep 14 09:06:22 2022] DELETE /compute/v2.1/os-server-groups/45698cf2-154e-42be-a98b-ebe7d7e3c976 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 14 09:06:22.887687 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-da27d773-97d1-4716-8a4c-b9a8ce8651b8 tempest-ServerGroup264TestJSON-2137584931 tempest-ServerGroup264TestJSON-2137584931-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:22.903730 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-da27d773-97d1-4716-8a4c-b9a8ce8651b8 tempest-ServerGroup264TestJSON-2137584931 tempest-ServerGroup264TestJSON-2137584931-project] HTTP exception thrown: Instance group 45698cf2-154e-42be-a98b-ebe7d7e3c976 could not be found. Sep 14 09:06:22.905632 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-da27d773-97d1-4716-8a4c-b9a8ce8651b8 tempest-ServerGroup264TestJSON-2137584931 tempest-ServerGroup264TestJSON-2137584931-project] Request method failure captured: Sep 14 09:06:22.905632 n-d-836830-18 devstack@n-api.service[128759]: request: DELETE /compute/v2.1/os-server-groups/45698cf2-154e-42be-a98b-ebe7d7e3c976 HTTP/1.1 Sep 14 09:06:22.905632 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:06:22.905632 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:06:22.905632 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:06:22.905632 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:06:22.905632 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:06:22.905632 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:06:22.905632 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:06:22.905632 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:06:22.905632 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZmNJmllIU58TVtV3ivAiDvSjjO4A-KGovw7s0hfTtp_51LshNuFq6oiq2fuILIEpa3o1_QQQCzVtHokUdGW-ESIkoW1sW64htSuGOc3IGQgsCb4mg8kmzawrItNfPc4CjIclbtMqVaZgkhZSbF8O83CV1gIueUNimVNzGCb53N9AuI Sep 14 09:06:22.905632 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:06:22.905632 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:06:22.905632 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:06:22.905632 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:06:22.905632 n-d-836830-18 devstack@n-api.service[128759]: X-Openstack-Nova-Api-Version: 2.64 Sep 14 09:06:22.905632 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:06:22.905632 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:06:22.905632 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 73af5c5e175146f9bbc10abd2b1f53fe Sep 14 09:06:22.905632 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ServerGroup264TestJSON-2137584931 Sep 14 09:06:22.905632 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:06:22.905632 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:06:22.905632 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/73af5c5e175146f9bbc10abd2b1f53fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_73af5c5e175146f9bbc10abd2b1f53fe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/73af5c5e175146f9bbc10abd2b1f53fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/73af5c5e175146f9bbc10abd2b1f53fe"}]}] Sep 14 09:06:22.905632 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ServerGroup264TestJSON-2137584931 Sep 14 09:06:22.905632 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 73af5c5e175146f9bbc10abd2b1f53fe Sep 14 09:06:22.905632 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ServerGroup264TestJSON-2137584931 Sep 14 09:06:22.905632 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ServerGroup264TestJSON-2137584931-project Sep 14 09:06:22.905632 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:06:22.905632 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:06:22.905632 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: e56548ed0e4243fe9110e455bbc6f101 Sep 14 09:06:22.905632 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ServerGroup264TestJSON-2137584931-project Sep 14 09:06:22.905632 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:06:22.905632 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance group 45698cf2-154e-42be-a98b-ebe7d7e3c976 could not be found. Sep 14 09:06:22.905632 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '45698cf2-154e-42be-a98b-ebe7d7e3c976'} Sep 14 09:06:22.905632 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:06:22.905632 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:06:22.905632 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Sep 14 09:06:22.905632 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Sep 14 09:06:22.905632 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 14 09:06:22.905632 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 14 09:06:22.905632 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Sep 14 09:06:22.905632 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Sep 14 09:06:22.905632 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 14 09:06:22.905632 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 14 09:06:22.905632 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Sep 14 09:06:22.905632 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Sep 14 09:06:22.905632 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 45698cf2-154e-42be-a98b-ebe7d7e3c976 could not be found. Sep 14 09:06:22.905632 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:22.905632 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:06:22.905632 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:22.905632 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:06:22.905632 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:06:22.905632 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:06:22.905632 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:06:22.905632 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:06:22.905632 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:06:22.905632 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:06:22.905632 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Sep 14 09:06:22.905632 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:06:22.905632 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 45698cf2-154e-42be-a98b-ebe7d7e3c976 could not be found. Sep 14 09:06:22.905632 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:22.905632 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:06:22.905632 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:22.905632 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:06:22.909176 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:06:22.909176 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:06:22.909176 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:06:22.909176 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:06:22.909176 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 45698cf2-154e-42be-a98b-ebe7d7e3c976 could not be found. Sep 14 09:06:22.909176 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:22.909176 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-da27d773-97d1-4716-8a4c-b9a8ce8651b8 tempest-ServerGroup264TestJSON-2137584931 tempest-ServerGroup264TestJSON-2137584931-project] Returning 404 to user: Instance group 45698cf2-154e-42be-a98b-ebe7d7e3c976 could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:06:22.909176 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-da27d773-97d1-4716-8a4c-b9a8ce8651b8 tempest-ServerGroup264TestJSON-2137584931 tempest-ServerGroup264TestJSON-2137584931-project] 10.222.0.60 "DELETE /compute/v2.1/os-server-groups/45698cf2-154e-42be-a98b-ebe7d7e3c976" status: 404 len: 117 microversion: 2.64 time: 0.025943 Sep 14 09:06:22.916464 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1970/3963] 10.222.0.60 () {60 vars in 1307 bytes} [Wed Sep 14 09:06:22 2022] DELETE /compute/v2.1/os-server-groups/45698cf2-154e-42be-a98b-ebe7d7e3c976 => generated 117 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 14 09:06:22.960290 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-25748cf3-a667-4e49-b65c-82b6ac9367c5 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1756771208", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "2616a0b0-fea1-46f8-bf23-608a226da1ef"}]}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:06:23.040317 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8af281c9-124e-4b88-8b69-e1c9cd93799d tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:23.041606 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-8af281c9-124e-4b88-8b69-e1c9cd93799d tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] [instance: ed6976ad-867b-4570-a547-758efc8f622f] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:23.054876 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8af281c9-124e-4b88-8b69-e1c9cd93799d tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:23.080362 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8af281c9-124e-4b88-8b69-e1c9cd93799d tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:23.084328 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8af281c9-124e-4b88-8b69-e1c9cd93799d tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:23.085346 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8af281c9-124e-4b88-8b69-e1c9cd93799d tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:23.086723 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8af281c9-124e-4b88-8b69-e1c9cd93799d tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:23.087407 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8af281c9-124e-4b88-8b69-e1c9cd93799d tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:23.473409 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.network.security_group_api [None req-25748cf3-a667-4e49-b65c-82b6ac9367c5 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Neutron security group does_not_exist not found {{(pid=128758) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Sep 14 09:06:23.474768 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-25748cf3-a667-4e49-b65c-82b6ac9367c5 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Sep 14 09:06:23.489475 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-25748cf3-a667-4e49-b65c-82b6ac9367c5 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Request method failure captured: Sep 14 09:06:23.489475 n-d-836830-18 devstack@n-api.service[128758]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 14 09:06:23.489475 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 09:06:23.489475 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 09:06:23.489475 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 09:06:23.489475 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 258 Sep 14 09:06:23.489475 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 09:06:23.489475 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 09:06:23.489475 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 09:06:23.489475 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 09:06:23.489475 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZk2EvHIWQyXATvY4f6phbqF3DzIIyaJjJFCE11LxTKbrsndvuk5zoyyEUR0VXx32_kFjD0I6jBROuj0ZPSHQav7u9FFvOPFGrPkf9qZrgXY9k3zAUFrOVfwLECoLZOolubyCPUAGSEOi_HvFIP_Dd_DCbUCKDEGGLtdnAzy2tLCxHs Sep 14 09:06:23.489475 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 09:06:23.489475 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 09:06:23.489475 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 09:06:23.489475 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 09:06:23.489475 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 09:06:23.489475 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 09:06:23.489475 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 6907b82c9d5c4a23a63bbeec31c3c365 Sep 14 09:06:23.489475 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-ServersNegativeTestJSON-1654813540 Sep 14 09:06:23.489475 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 09:06:23.489475 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 09:06:23.489475 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6907b82c9d5c4a23a63bbeec31c3c365"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6907b82c9d5c4a23a63bbeec31c3c365"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6907b82c9d5c4a23a63bbeec31c3c365"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6907b82c9d5c4a23a63bbeec31c3c365"}]}] Sep 14 09:06:23.489475 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-ServersNegativeTestJSON-1654813540 Sep 14 09:06:23.489475 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 6907b82c9d5c4a23a63bbeec31c3c365 Sep 14 09:06:23.489475 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1654813540 Sep 14 09:06:23.489475 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-ServersNegativeTestJSON-1654813540-project Sep 14 09:06:23.489475 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 09:06:23.489475 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 09:06:23.489475 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 79583c4e80a04f138927f09eb4e170f4 Sep 14 09:06:23.489475 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-ServersNegativeTestJSON-1654813540-project Sep 14 09:06:23.489475 n-d-836830-18 devstack@n-api.service[128758]: Sep 14 09:06:23.489475 n-d-836830-18 devstack@n-api.service[128758]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1756771208", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "2616a0b0-fea1-46f8-bf23-608a226da1ef"}]}} Sep 14 09:06:23.489475 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 09:06:23.489475 n-d-836830-18 devstack@n-api.service[128758]: exception: Unable to find security_group with name or id 'does_not_exist' Sep 14 09:06:23.489475 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1756771208', 'imageRef': 'bff4ab7f-4846-441f-8940-d96fec4c28e9', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': '2616a0b0-fea1-46f8-bf23-608a226da1ef'}]}}} Sep 14 09:06:23.489475 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:06:23.489475 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:06:23.489475 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Sep 14 09:06:23.489475 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Sep 14 09:06:23.489475 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:06:23.489475 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:06:23.489475 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Sep 14 09:06:23.489475 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Sep 14 09:06:23.489475 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Sep 14 09:06:23.489475 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:06:23.489475 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:06:23.489475 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:06:23.489475 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:06:23.489475 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Sep 14 09:06:23.489475 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Sep 14 09:06:23.489475 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:06:23.489475 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:06:23.489475 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Sep 14 09:06:23.489475 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Sep 14 09:06:23.489475 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Sep 14 09:06:23.489475 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:06:23.489475 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:06:23.489475 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:06:23.489475 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:06:23.489475 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Sep 14 09:06:23.489475 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Sep 14 09:06:23.493898 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Sep 14 09:06:23.493898 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Sep 14 09:06:23.493898 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Sep 14 09:06:23.493898 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Sep 14 09:06:23.493898 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:06:23.493898 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:06:23.493898 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Sep 14 09:06:23.493898 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Sep 14 09:06:23.493898 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Sep 14 09:06:23.493898 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:06:23.493898 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:06:23.493898 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:06:23.493898 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:06:23.493898 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 14 09:06:23.493898 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 14 09:06:23.493898 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 14 09:06:23.493898 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 14 09:06:23.493898 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Sep 14 09:06:23.493898 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Sep 14 09:06:23.493898 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1074, in _validate_and_build_base_options Sep 14 09:06:23.493898 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Sep 14 09:06:23.493898 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 521, in _check_requested_secgroups Sep 14 09:06:23.493898 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Sep 14 09:06:23.493898 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Sep 14 09:06:23.493898 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 14 09:06:23.493898 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Sep 14 09:06:23.493898 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:06:23.493898 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:06:23.493898 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:06:23.493898 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:06:23.493898 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:06:23.493898 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:06:23.493898 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:06:23.493898 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:06:23.493898 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:06:23.493898 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:06:23.493898 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:06:23.493898 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:06:23.493898 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:06:23.493898 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:06:23.493898 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:06:23.493898 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:06:23.493898 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 14 09:06:23.493898 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Sep 14 09:06:23.493898 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Sep 14 09:06:23.493898 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Sep 14 09:06:23.493898 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:06:23.493898 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:06:23.493898 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:06:23.493898 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:06:23.493898 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:06:23.493898 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:06:23.493898 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:06:23.493898 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:06:23.493898 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Sep 14 09:06:23.493898 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:06:23.500662 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-25748cf3-a667-4e49-b65c-82b6ac9367c5 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:06:23.500662 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-25748cf3-a667-4e49-b65c-82b6ac9367c5 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.539657 Sep 14 09:06:23.500662 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1994/3964] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 09:06:22 2022] POST /compute/v2.1/servers => generated 106 bytes in 541 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 14 09:06:23.505551 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c6f4d109-293c-479c-a887-6738ee534b5c tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:23.506187 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-c6f4d109-293c-479c-a887-6738ee534b5c tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:23.521674 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c6f4d109-293c-479c-a887-6738ee534b5c tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:23.522882 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c6f4d109-293c-479c-a887-6738ee534b5c tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:23.526834 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c6f4d109-293c-479c-a887-6738ee534b5c tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:23.527726 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c6f4d109-293c-479c-a887-6738ee534b5c tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:23.529401 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c6f4d109-293c-479c-a887-6738ee534b5c tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:23.529837 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c6f4d109-293c-479c-a887-6738ee534b5c tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:23.620872 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-8af281c9-124e-4b88-8b69-e1c9cd93799d tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5165b8fc101c47c7a4370f9007bc5a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a597fc389b4805bbd3a53ecd17c5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:06:23.631705 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-8af281c9-124e-4b88-8b69-e1c9cd93799d tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute/v2.1/servers/ed6976ad-867b-4570-a547-758efc8f622f" status: 200 len: 1308 microversion: 2.1 time: 0.600867 Sep 14 09:06:23.651871 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1971/3965] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:06:23 2022] GET /compute/v2.1/servers/ed6976ad-867b-4570-a547-758efc8f622f => generated 1308 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:06:23.966020 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-c6f4d109-293c-479c-a887-6738ee534b5c tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:06:23.974075 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-c6f4d109-293c-479c-a887-6738ee534b5c tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1506 microversion: 2.1 time: 0.473117 Sep 14 09:06:23.980910 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1995/3966] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:06:23 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1506 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:06:23.999479 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-5e387a95-deaf-4066-94d1-0d650f0fd29c tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:24.000338 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-5e387a95-deaf-4066-94d1-0d650f0fd29c tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:24.010165 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5e387a95-deaf-4066-94d1-0d650f0fd29c tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:24.017313 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5e387a95-deaf-4066-94d1-0d650f0fd29c tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:24.017771 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5e387a95-deaf-4066-94d1-0d650f0fd29c tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:24.018524 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5e387a95-deaf-4066-94d1-0d650f0fd29c tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:24.020961 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5e387a95-deaf-4066-94d1-0d650f0fd29c tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:24.021404 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5e387a95-deaf-4066-94d1-0d650f0fd29c tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:24.371731 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-5e387a95-deaf-4066-94d1-0d650f0fd29c tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:06:24.386837 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-5e387a95-deaf-4066-94d1-0d650f0fd29c tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1506 microversion: 2.1 time: 0.391333 Sep 14 09:06:24.390048 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1972/3967] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:06:23 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1506 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:06:24.419667 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-338d2ac9-8dde-4f32-84a9-5ab330722ff8 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:24.420982 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-338d2ac9-8dde-4f32-84a9-5ab330722ff8 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: 9607085c-225f-406f-aa32-ee0e0b298076] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:24.434257 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-338d2ac9-8dde-4f32-84a9-5ab330722ff8 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] HTTP exception thrown: Instance 9607085c-225f-406f-aa32-ee0e0b298076 could not be found. Sep 14 09:06:24.438347 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-338d2ac9-8dde-4f32-84a9-5ab330722ff8 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Request method failure captured: Sep 14 09:06:24.438347 n-d-836830-18 devstack@n-api.service[128758]: request: DELETE /compute/v2.1/servers/9607085c-225f-406f-aa32-ee0e0b298076 HTTP/1.1 Sep 14 09:06:24.438347 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 09:06:24.438347 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 09:06:24.438347 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 09:06:24.438347 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 09:06:24.438347 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 09:06:24.438347 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 09:06:24.438347 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 09:06:24.438347 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 09:06:24.438347 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZk2EvHIWQyXATvY4f6phbqF3DzIIyaJjJFCE11LxTKbrsndvuk5zoyyEUR0VXx32_kFjD0I6jBROuj0ZPSHQav7u9FFvOPFGrPkf9qZrgXY9k3zAUFrOVfwLECoLZOolubyCPUAGSEOi_HvFIP_Dd_DCbUCKDEGGLtdnAzy2tLCxHs Sep 14 09:06:24.438347 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 09:06:24.438347 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 09:06:24.438347 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 09:06:24.438347 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 09:06:24.438347 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 09:06:24.438347 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 09:06:24.438347 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 6907b82c9d5c4a23a63bbeec31c3c365 Sep 14 09:06:24.438347 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-ServersNegativeTestJSON-1654813540 Sep 14 09:06:24.438347 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 09:06:24.438347 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 09:06:24.438347 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6907b82c9d5c4a23a63bbeec31c3c365"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6907b82c9d5c4a23a63bbeec31c3c365"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6907b82c9d5c4a23a63bbeec31c3c365"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6907b82c9d5c4a23a63bbeec31c3c365"}]}] Sep 14 09:06:24.438347 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-ServersNegativeTestJSON-1654813540 Sep 14 09:06:24.438347 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 6907b82c9d5c4a23a63bbeec31c3c365 Sep 14 09:06:24.438347 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1654813540 Sep 14 09:06:24.438347 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-ServersNegativeTestJSON-1654813540-project Sep 14 09:06:24.438347 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 09:06:24.438347 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 09:06:24.438347 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 79583c4e80a04f138927f09eb4e170f4 Sep 14 09:06:24.438347 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-ServersNegativeTestJSON-1654813540-project Sep 14 09:06:24.438347 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 09:06:24.438347 n-d-836830-18 devstack@n-api.service[128758]: exception: Instance 9607085c-225f-406f-aa32-ee0e0b298076 could not be found. Sep 14 09:06:24.438347 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': '9607085c-225f-406f-aa32-ee0e0b298076'} Sep 14 09:06:24.438347 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:06:24.438347 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:06:24.438347 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:06:24.438347 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:06:24.438347 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:06:24.438347 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:06:24.438347 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 14 09:06:24.438347 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 14 09:06:24.438347 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9607085c-225f-406f-aa32-ee0e0b298076 could not be found. Sep 14 09:06:24.438347 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:06:24.438347 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:06:24.438347 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:06:24.438347 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:06:24.438347 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:06:24.438347 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:06:24.438347 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:06:24.438347 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:06:24.438347 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:06:24.438347 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:06:24.438347 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 09:06:24.438347 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 09:06:24.438347 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 09:06:24.438347 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 09:06:24.438347 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:06:24.438347 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:06:24.438347 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:06:24.438347 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:06:24.438347 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9607085c-225f-406f-aa32-ee0e0b298076 could not be found. Sep 14 09:06:24.438347 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:06:24.438347 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:06:24.442490 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:06:24.442490 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:06:24.442490 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:06:24.442490 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:06:24.442490 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:06:24.442490 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:06:24.442490 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9607085c-225f-406f-aa32-ee0e0b298076 could not be found. Sep 14 09:06:24.442490 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:06:24.473635 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-338d2ac9-8dde-4f32-84a9-5ab330722ff8 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Returning 404 to user: Instance 9607085c-225f-406f-aa32-ee0e0b298076 could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:06:24.480776 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-338d2ac9-8dde-4f32-84a9-5ab330722ff8 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "DELETE /compute/v2.1/servers/9607085c-225f-406f-aa32-ee0e0b298076" status: 404 len: 111 microversion: 2.1 time: 0.065833 Sep 14 09:06:24.485556 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1996/3968] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:06:24 2022] DELETE /compute/v2.1/servers/9607085c-225f-406f-aa32-ee0e0b298076 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:06:24.494688 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-fbd11108-c68a-4b29-9c44-ac70a58fec88 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:24.495628 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-fbd11108-c68a-4b29-9c44-ac70a58fec88 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:24.510251 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fbd11108-c68a-4b29-9c44-ac70a58fec88 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:24.513007 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fbd11108-c68a-4b29-9c44-ac70a58fec88 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:24.513846 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fbd11108-c68a-4b29-9c44-ac70a58fec88 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:24.515914 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fbd11108-c68a-4b29-9c44-ac70a58fec88 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:24.517771 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fbd11108-c68a-4b29-9c44-ac70a58fec88 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:24.519945 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fbd11108-c68a-4b29-9c44-ac70a58fec88 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:24.655941 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a23050a4-e90d-4166-861b-fecf14e56ba4 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:24.657085 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-a23050a4-e90d-4166-861b-fecf14e56ba4 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] [instance: ed6976ad-867b-4570-a547-758efc8f622f] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:24.673800 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a23050a4-e90d-4166-861b-fecf14e56ba4 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:24.674597 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a23050a4-e90d-4166-861b-fecf14e56ba4 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:24.675445 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a23050a4-e90d-4166-861b-fecf14e56ba4 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:24.678291 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a23050a4-e90d-4166-861b-fecf14e56ba4 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:24.680993 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a23050a4-e90d-4166-861b-fecf14e56ba4 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:24.681607 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a23050a4-e90d-4166-861b-fecf14e56ba4 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:25.010843 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-fbd11108-c68a-4b29-9c44-ac70a58fec88 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:06:25.028434 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-fbd11108-c68a-4b29-9c44-ac70a58fec88 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1506 microversion: 2.1 time: 0.539259 Sep 14 09:06:25.030904 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1973/3969] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:06:24 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1506 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:06:25.060641 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c6bac200-2f0e-485c-bd77-e9cf4260f6cc tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:25.062546 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-c6bac200-2f0e-485c-bd77-e9cf4260f6cc tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:25.080701 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c6bac200-2f0e-485c-bd77-e9cf4260f6cc tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:25.084378 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c6bac200-2f0e-485c-bd77-e9cf4260f6cc tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:25.090080 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c6bac200-2f0e-485c-bd77-e9cf4260f6cc tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:25.091376 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c6bac200-2f0e-485c-bd77-e9cf4260f6cc tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:25.094574 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c6bac200-2f0e-485c-bd77-e9cf4260f6cc tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:25.096471 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c6bac200-2f0e-485c-bd77-e9cf4260f6cc tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:25.145850 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-a23050a4-e90d-4166-861b-fecf14e56ba4 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5165b8fc101c47c7a4370f9007bc5a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a597fc389b4805bbd3a53ecd17c5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:06:25.160295 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-a23050a4-e90d-4166-861b-fecf14e56ba4 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute/v2.1/servers/ed6976ad-867b-4570-a547-758efc8f622f" status: 200 len: 1487 microversion: 2.1 time: 0.508828 Sep 14 09:06:25.195149 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1997/3970] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:06:24 2022] GET /compute/v2.1/servers/ed6976ad-867b-4570-a547-758efc8f622f => generated 1487 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:06:25.207935 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-bb37fb86-e009-4b65-a59b-13a2e35f56d5 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:06:25.227348 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bb37fb86-e009-4b65-a59b-13a2e35f56d5 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:25.228196 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bb37fb86-e009-4b65-a59b-13a2e35f56d5 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:25.229771 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bb37fb86-e009-4b65-a59b-13a2e35f56d5 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:25.303445 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=100 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:06:25.320025 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-bb37fb86-e009-4b65-a59b-13a2e35f56d5 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] [instance: ed6976ad-867b-4570-a547-758efc8f622f] Going to try to stop instance {{(pid=128758) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 14 09:06:25.449540 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-bb37fb86-e009-4b65-a59b-13a2e35f56d5 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "POST /compute/v2.1/servers/ed6976ad-867b-4570-a547-758efc8f622f/action" status: 202 len: 0 microversion: 2.1 time: 0.251908 Sep 14 09:06:25.456016 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-c6bac200-2f0e-485c-bd77-e9cf4260f6cc tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:06:25.465228 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1998/3971] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:06:25 2022] POST /compute/v2.1/servers/ed6976ad-867b-4570-a547-758efc8f622f/action => generated 0 bytes in 269 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:06:25.468675 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-c6bac200-2f0e-485c-bd77-e9cf4260f6cc tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1506 microversion: 2.1 time: 0.411968 Sep 14 09:06:25.486454 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a7b0b2e0-cc01-4f0f-bfab-ffe60cf22fea tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:25.488085 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1974/3972] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:06:25 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1506 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:06:25.489782 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-a7b0b2e0-cc01-4f0f-bfab-ffe60cf22fea tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] [instance: ed6976ad-867b-4570-a547-758efc8f622f] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:25.506475 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-68cca9b3-d329-4ef2-ab58-a7cebed94d5f tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:25.507981 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-68cca9b3-d329-4ef2-ab58-a7cebed94d5f tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Failed to fetch instance by id 9223372036854775808 {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 14 09:06:25.510321 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-68cca9b3-d329-4ef2-ab58-a7cebed94d5f tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Sep 14 09:06:25.514494 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-68cca9b3-d329-4ef2-ab58-a7cebed94d5f tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Request method failure captured: Sep 14 09:06:25.514494 n-d-836830-18 devstack@n-api.service[128759]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Sep 14 09:06:25.514494 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:06:25.514494 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:06:25.514494 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:06:25.514494 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:06:25.514494 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:06:25.514494 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:06:25.514494 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:06:25.514494 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:06:25.514494 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZk2EvHIWQyXATvY4f6phbqF3DzIIyaJjJFCE11LxTKbrsndvuk5zoyyEUR0VXx32_kFjD0I6jBROuj0ZPSHQav7u9FFvOPFGrPkf9qZrgXY9k3zAUFrOVfwLECoLZOolubyCPUAGSEOi_HvFIP_Dd_DCbUCKDEGGLtdnAzy2tLCxHs Sep 14 09:06:25.514494 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:06:25.514494 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:06:25.514494 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:06:25.514494 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:06:25.514494 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:06:25.514494 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:06:25.514494 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 6907b82c9d5c4a23a63bbeec31c3c365 Sep 14 09:06:25.514494 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ServersNegativeTestJSON-1654813540 Sep 14 09:06:25.514494 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:06:25.514494 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:06:25.514494 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6907b82c9d5c4a23a63bbeec31c3c365"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6907b82c9d5c4a23a63bbeec31c3c365"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6907b82c9d5c4a23a63bbeec31c3c365"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6907b82c9d5c4a23a63bbeec31c3c365"}]}] Sep 14 09:06:25.514494 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ServersNegativeTestJSON-1654813540 Sep 14 09:06:25.514494 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 6907b82c9d5c4a23a63bbeec31c3c365 Sep 14 09:06:25.514494 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1654813540 Sep 14 09:06:25.514494 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ServersNegativeTestJSON-1654813540-project Sep 14 09:06:25.514494 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:06:25.514494 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:06:25.514494 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 79583c4e80a04f138927f09eb4e170f4 Sep 14 09:06:25.514494 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ServersNegativeTestJSON-1654813540-project Sep 14 09:06:25.514494 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:06:25.514494 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance 9223372036854775808 could not be found. Sep 14 09:06:25.514494 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '9223372036854775808'} Sep 14 09:06:25.514494 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:06:25.514494 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:06:25.514494 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:06:25.514494 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:06:25.514494 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 14 09:06:25.514494 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 14 09:06:25.514494 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Sep 14 09:06:25.514494 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:25.514494 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:06:25.514494 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:25.514494 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:06:25.514494 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:06:25.514494 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:06:25.514494 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:06:25.514494 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:06:25.514494 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:06:25.514494 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:06:25.514494 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 09:06:25.514494 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 09:06:25.514494 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 09:06:25.514494 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 09:06:25.514494 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:06:25.514494 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:06:25.514494 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:06:25.514494 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:06:25.514494 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Sep 14 09:06:25.514494 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:25.514494 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:06:25.514494 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:25.514494 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:06:25.514494 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:06:25.518032 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:06:25.518032 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:06:25.518032 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:06:25.518032 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Sep 14 09:06:25.518032 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:25.518305 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a7b0b2e0-cc01-4f0f-bfab-ffe60cf22fea tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:25.518305 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a7b0b2e0-cc01-4f0f-bfab-ffe60cf22fea tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:25.518474 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a7b0b2e0-cc01-4f0f-bfab-ffe60cf22fea tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:25.519491 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a7b0b2e0-cc01-4f0f-bfab-ffe60cf22fea tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:25.519706 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-68cca9b3-d329-4ef2-ab58-a7cebed94d5f tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:06:25.519962 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a7b0b2e0-cc01-4f0f-bfab-ffe60cf22fea tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:25.520402 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a7b0b2e0-cc01-4f0f-bfab-ffe60cf22fea tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:25.527102 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-68cca9b3-d329-4ef2-ab58-a7cebed94d5f tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.025304 Sep 14 09:06:25.528293 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1975/3973] 10.222.0.60 () {58 vars in 1188 bytes} [Wed Sep 14 09:06:25 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 14 09:06:25.538971 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d69cd80c-3db0-47bc-a50d-f8372e68ee1d tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:25.541420 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-d69cd80c-3db0-47bc-a50d-f8372e68ee1d tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:25.581367 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d69cd80c-3db0-47bc-a50d-f8372e68ee1d tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:25.581868 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d69cd80c-3db0-47bc-a50d-f8372e68ee1d tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:25.582309 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d69cd80c-3db0-47bc-a50d-f8372e68ee1d tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:25.587118 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d69cd80c-3db0-47bc-a50d-f8372e68ee1d tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:25.589674 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d69cd80c-3db0-47bc-a50d-f8372e68ee1d tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:25.590131 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d69cd80c-3db0-47bc-a50d-f8372e68ee1d tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:25.997617 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-a7b0b2e0-cc01-4f0f-bfab-ffe60cf22fea tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5165b8fc101c47c7a4370f9007bc5a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a597fc389b4805bbd3a53ecd17c5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:06:26.012220 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-a7b0b2e0-cc01-4f0f-bfab-ffe60cf22fea tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute/v2.1/servers/ed6976ad-867b-4570-a547-758efc8f622f" status: 200 len: 1497 microversion: 2.1 time: 0.542006 Sep 14 09:06:26.020620 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-d69cd80c-3db0-47bc-a50d-f8372e68ee1d tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:06:26.030345 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 1999/3974] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:06:25 2022] GET /compute/v2.1/servers/ed6976ad-867b-4570-a547-758efc8f622f => generated 1497 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:06:26.030814 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d69cd80c-3db0-47bc-a50d-f8372e68ee1d tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1506 microversion: 2.1 time: 0.498011 Sep 14 09:06:26.033736 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1976/3975] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:06:25 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1506 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:06:26.062850 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-30b8b6be-b7c3-4648-bbfa-56d837332754 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:26.064175 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-30b8b6be-b7c3-4648-bbfa-56d837332754 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:26.080314 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-30b8b6be-b7c3-4648-bbfa-56d837332754 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:26.080953 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-30b8b6be-b7c3-4648-bbfa-56d837332754 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:26.081459 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-30b8b6be-b7c3-4648-bbfa-56d837332754 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:26.082186 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-30b8b6be-b7c3-4648-bbfa-56d837332754 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:26.082645 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-30b8b6be-b7c3-4648-bbfa-56d837332754 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:26.086591 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-30b8b6be-b7c3-4648-bbfa-56d837332754 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:26.383456 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-30b8b6be-b7c3-4648-bbfa-56d837332754 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:06:26.394898 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-30b8b6be-b7c3-4648-bbfa-56d837332754 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1506 microversion: 2.1 time: 0.337608 Sep 14 09:06:26.418826 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2000/3976] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:06:26 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1506 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:06:26.429913 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-dc9cc1a5-88e0-4098-b800-efa5f9238de8 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:26.430401 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-dc9cc1a5-88e0-4098-b800-efa5f9238de8 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Failed to fetch instance by id -1 {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 14 09:06:26.430990 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-dc9cc1a5-88e0-4098-b800-efa5f9238de8 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] HTTP exception thrown: Instance -1 could not be found. Sep 14 09:06:26.432629 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-dc9cc1a5-88e0-4098-b800-efa5f9238de8 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Request method failure captured: Sep 14 09:06:26.432629 n-d-836830-18 devstack@n-api.service[128759]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Sep 14 09:06:26.432629 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:06:26.432629 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:06:26.432629 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:06:26.432629 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:06:26.432629 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:06:26.432629 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:06:26.432629 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:06:26.432629 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:06:26.432629 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZk2EvHIWQyXATvY4f6phbqF3DzIIyaJjJFCE11LxTKbrsndvuk5zoyyEUR0VXx32_kFjD0I6jBROuj0ZPSHQav7u9FFvOPFGrPkf9qZrgXY9k3zAUFrOVfwLECoLZOolubyCPUAGSEOi_HvFIP_Dd_DCbUCKDEGGLtdnAzy2tLCxHs Sep 14 09:06:26.432629 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:06:26.432629 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:06:26.432629 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:06:26.432629 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:06:26.432629 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:06:26.432629 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:06:26.432629 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 6907b82c9d5c4a23a63bbeec31c3c365 Sep 14 09:06:26.432629 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ServersNegativeTestJSON-1654813540 Sep 14 09:06:26.432629 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:06:26.432629 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:06:26.432629 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6907b82c9d5c4a23a63bbeec31c3c365"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6907b82c9d5c4a23a63bbeec31c3c365"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6907b82c9d5c4a23a63bbeec31c3c365"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6907b82c9d5c4a23a63bbeec31c3c365"}]}] Sep 14 09:06:26.432629 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ServersNegativeTestJSON-1654813540 Sep 14 09:06:26.432629 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 6907b82c9d5c4a23a63bbeec31c3c365 Sep 14 09:06:26.432629 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1654813540 Sep 14 09:06:26.432629 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ServersNegativeTestJSON-1654813540-project Sep 14 09:06:26.432629 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:06:26.432629 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:06:26.432629 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 79583c4e80a04f138927f09eb4e170f4 Sep 14 09:06:26.432629 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ServersNegativeTestJSON-1654813540-project Sep 14 09:06:26.432629 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:06:26.432629 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance -1 could not be found. Sep 14 09:06:26.432629 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '-1'} Sep 14 09:06:26.432629 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:06:26.432629 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:06:26.432629 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:06:26.432629 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:06:26.432629 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 14 09:06:26.432629 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 14 09:06:26.432629 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Sep 14 09:06:26.432629 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:26.432629 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:06:26.432629 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:26.432629 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:06:26.432629 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:06:26.432629 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:06:26.432629 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:06:26.432629 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:06:26.432629 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:06:26.432629 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:06:26.432629 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 09:06:26.432629 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 09:06:26.432629 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 09:06:26.432629 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 09:06:26.432629 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:06:26.432629 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:06:26.432629 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:06:26.432629 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:06:26.432629 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Sep 14 09:06:26.432629 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:26.432629 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:06:26.432629 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:26.432629 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:06:26.432629 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:06:26.432629 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:06:26.436071 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:06:26.436071 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:06:26.436071 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Sep 14 09:06:26.436071 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:26.436071 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-dc9cc1a5-88e0-4098-b800-efa5f9238de8 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Returning 404 to user: Instance -1 could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:06:26.436071 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-dc9cc1a5-88e0-4098-b800-efa5f9238de8 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.010468 Sep 14 09:06:26.443973 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1977/3977] 10.222.0.60 () {58 vars in 1137 bytes} [Wed Sep 14 09:06:26 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 14 09:06:26.445487 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-44549857-b22d-46e8-ade4-7db369b5ee39 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:26.446173 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-44549857-b22d-46e8-ade4-7db369b5ee39 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:26.452653 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-44549857-b22d-46e8-ade4-7db369b5ee39 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:26.454358 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-44549857-b22d-46e8-ade4-7db369b5ee39 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:26.456303 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-44549857-b22d-46e8-ade4-7db369b5ee39 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:26.457080 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-44549857-b22d-46e8-ade4-7db369b5ee39 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:26.457598 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-44549857-b22d-46e8-ade4-7db369b5ee39 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:26.458040 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-44549857-b22d-46e8-ade4-7db369b5ee39 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:26.752917 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-44549857-b22d-46e8-ade4-7db369b5ee39 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:06:26.762108 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-44549857-b22d-46e8-ade4-7db369b5ee39 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1506 microversion: 2.1 time: 0.321975 Sep 14 09:06:26.781896 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2001/3978] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:06:26 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1506 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:06:26.800268 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-906070fa-7a08-4178-a17d-7874b97cf921 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:26.800942 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-906070fa-7a08-4178-a17d-7874b97cf921 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:26.814786 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-906070fa-7a08-4178-a17d-7874b97cf921 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:26.815603 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-906070fa-7a08-4178-a17d-7874b97cf921 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:26.816072 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-906070fa-7a08-4178-a17d-7874b97cf921 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:26.816789 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-906070fa-7a08-4178-a17d-7874b97cf921 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:26.817282 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-906070fa-7a08-4178-a17d-7874b97cf921 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:26.818871 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-906070fa-7a08-4178-a17d-7874b97cf921 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:27.042009 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-3732ab61-d943-45d4-8027-e9f6ed92538b tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:27.042503 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-3732ab61-d943-45d4-8027-e9f6ed92538b tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] [instance: ed6976ad-867b-4570-a547-758efc8f622f] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:27.055800 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3732ab61-d943-45d4-8027-e9f6ed92538b tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:27.061992 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3732ab61-d943-45d4-8027-e9f6ed92538b tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:27.062532 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3732ab61-d943-45d4-8027-e9f6ed92538b tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:27.063324 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3732ab61-d943-45d4-8027-e9f6ed92538b tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:27.071776 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3732ab61-d943-45d4-8027-e9f6ed92538b tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:27.072249 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3732ab61-d943-45d4-8027-e9f6ed92538b tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:27.299533 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-906070fa-7a08-4178-a17d-7874b97cf921 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:06:27.326372 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-906070fa-7a08-4178-a17d-7874b97cf921 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1506 microversion: 2.1 time: 0.519591 Sep 14 09:06:27.329413 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1978/3979] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:06:26 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1506 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:06:27.355642 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-6d31058d-53f7-4d8a-b849-54b5579e4f06 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:06:27.357127 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-6d31058d-53f7-4d8a-b849-54b5579e4f06 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: 6bc010f1-7279-4fcd-b8bb-fa5a74061851] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:27.358782 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-3732ab61-d943-45d4-8027-e9f6ed92538b tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5165b8fc101c47c7a4370f9007bc5a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a597fc389b4805bbd3a53ecd17c5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:06:27.367092 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-3732ab61-d943-45d4-8027-e9f6ed92538b tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute/v2.1/servers/ed6976ad-867b-4570-a547-758efc8f622f" status: 200 len: 1497 microversion: 2.1 time: 0.332158 Sep 14 09:06:27.370141 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-6d31058d-53f7-4d8a-b849-54b5579e4f06 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] HTTP exception thrown: Instance 6bc010f1-7279-4fcd-b8bb-fa5a74061851 could not be found. Sep 14 09:06:27.388847 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-6d31058d-53f7-4d8a-b849-54b5579e4f06 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Request method failure captured: Sep 14 09:06:27.388847 n-d-836830-18 devstack@n-api.service[128759]: request: POST /compute/v2.1/servers/6bc010f1-7279-4fcd-b8bb-fa5a74061851/action HTTP/1.1 Sep 14 09:06:27.388847 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:06:27.388847 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:06:27.388847 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:06:27.388847 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 19 Sep 14 09:06:27.388847 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:06:27.388847 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:06:27.388847 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:06:27.388847 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:06:27.388847 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZk2EvHIWQyXATvY4f6phbqF3DzIIyaJjJFCE11LxTKbrsndvuk5zoyyEUR0VXx32_kFjD0I6jBROuj0ZPSHQav7u9FFvOPFGrPkf9qZrgXY9k3zAUFrOVfwLECoLZOolubyCPUAGSEOi_HvFIP_Dd_DCbUCKDEGGLtdnAzy2tLCxHs Sep 14 09:06:27.388847 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:06:27.388847 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:06:27.388847 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:06:27.388847 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:06:27.388847 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:06:27.388847 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:06:27.388847 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 6907b82c9d5c4a23a63bbeec31c3c365 Sep 14 09:06:27.388847 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ServersNegativeTestJSON-1654813540 Sep 14 09:06:27.388847 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:06:27.388847 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:06:27.388847 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6907b82c9d5c4a23a63bbeec31c3c365"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6907b82c9d5c4a23a63bbeec31c3c365"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6907b82c9d5c4a23a63bbeec31c3c365"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6907b82c9d5c4a23a63bbeec31c3c365"}]}] Sep 14 09:06:27.388847 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ServersNegativeTestJSON-1654813540 Sep 14 09:06:27.388847 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 6907b82c9d5c4a23a63bbeec31c3c365 Sep 14 09:06:27.388847 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1654813540 Sep 14 09:06:27.388847 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ServersNegativeTestJSON-1654813540-project Sep 14 09:06:27.388847 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:06:27.388847 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:06:27.388847 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 79583c4e80a04f138927f09eb4e170f4 Sep 14 09:06:27.388847 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ServersNegativeTestJSON-1654813540-project Sep 14 09:06:27.388847 n-d-836830-18 devstack@n-api.service[128759]: Sep 14 09:06:27.388847 n-d-836830-18 devstack@n-api.service[128759]: {"forceDelete": {}} Sep 14 09:06:27.388847 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:06:27.388847 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance 6bc010f1-7279-4fcd-b8bb-fa5a74061851 could not be found. Sep 14 09:06:27.388847 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '6bc010f1-7279-4fcd-b8bb-fa5a74061851', 'body': {'forceDelete': {}}} Sep 14 09:06:27.388847 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:06:27.388847 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:06:27.388847 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:06:27.388847 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:06:27.388847 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:06:27.388847 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:06:27.388847 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 14 09:06:27.388847 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 14 09:06:27.388847 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6bc010f1-7279-4fcd-b8bb-fa5a74061851 could not be found. Sep 14 09:06:27.388847 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:27.388847 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:06:27.388847 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:27.388847 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:06:27.388847 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:06:27.388847 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:06:27.388847 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:06:27.388847 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:06:27.388847 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:06:27.388847 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:06:27.388847 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Sep 14 09:06:27.388847 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 14 09:06:27.388847 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:06:27.388847 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:06:27.388847 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6bc010f1-7279-4fcd-b8bb-fa5a74061851 could not be found. Sep 14 09:06:27.388847 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:27.388847 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:06:27.388847 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:27.388847 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:06:27.388847 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:06:27.388847 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:06:27.392830 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:06:27.392830 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:06:27.392830 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6bc010f1-7279-4fcd-b8bb-fa5a74061851 could not be found. Sep 14 09:06:27.392830 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:27.393668 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2002/3980] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:06:27 2022] GET /compute/v2.1/servers/ed6976ad-867b-4570-a547-758efc8f622f => generated 1497 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:06:27.398675 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-6d31058d-53f7-4d8a-b849-54b5579e4f06 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Returning 404 to user: Instance 6bc010f1-7279-4fcd-b8bb-fa5a74061851 could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:06:27.401042 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-6d31058d-53f7-4d8a-b849-54b5579e4f06 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "POST /compute/v2.1/servers/6bc010f1-7279-4fcd-b8bb-fa5a74061851/action" status: 404 len: 111 microversion: 2.1 time: 0.051364 Sep 14 09:06:27.401985 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1979/3981] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:06:27 2022] POST /compute/v2.1/servers/6bc010f1-7279-4fcd-b8bb-fa5a74061851/action => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 14 09:06:27.430195 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-86b6240e-47df-4b9b-aee9-0384a6af6862 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:27.430837 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-86b6240e-47df-4b9b-aee9-0384a6af6862 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:27.463466 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-86b6240e-47df-4b9b-aee9-0384a6af6862 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:27.467754 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-86b6240e-47df-4b9b-aee9-0384a6af6862 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:27.468458 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-86b6240e-47df-4b9b-aee9-0384a6af6862 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:27.469436 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-86b6240e-47df-4b9b-aee9-0384a6af6862 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:27.471949 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-86b6240e-47df-4b9b-aee9-0384a6af6862 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:27.472633 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-86b6240e-47df-4b9b-aee9-0384a6af6862 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:27.760212 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-86b6240e-47df-4b9b-aee9-0384a6af6862 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:06:27.772289 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-86b6240e-47df-4b9b-aee9-0384a6af6862 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1506 microversion: 2.1 time: 0.345996 Sep 14 09:06:27.772903 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2003/3982] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:06:27 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1506 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:06:27.799677 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3c31ec38-eda6-438d-9ad3-542b76822cad tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:27.801030 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-3c31ec38-eda6-438d-9ad3-542b76822cad tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:27.824908 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3c31ec38-eda6-438d-9ad3-542b76822cad tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:27.825417 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3c31ec38-eda6-438d-9ad3-542b76822cad tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:27.825858 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3c31ec38-eda6-438d-9ad3-542b76822cad tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:27.826581 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3c31ec38-eda6-438d-9ad3-542b76822cad tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:27.830970 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3c31ec38-eda6-438d-9ad3-542b76822cad tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:27.831633 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3c31ec38-eda6-438d-9ad3-542b76822cad tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:28.406960 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-9e45fa6d-886b-4d5b-abe7-c31dbb7af929 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:28.408341 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-9e45fa6d-886b-4d5b-abe7-c31dbb7af929 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] [instance: ed6976ad-867b-4570-a547-758efc8f622f] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:28.420183 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9e45fa6d-886b-4d5b-abe7-c31dbb7af929 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:28.425872 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9e45fa6d-886b-4d5b-abe7-c31dbb7af929 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:28.431693 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9e45fa6d-886b-4d5b-abe7-c31dbb7af929 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:28.437763 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9e45fa6d-886b-4d5b-abe7-c31dbb7af929 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:28.448991 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9e45fa6d-886b-4d5b-abe7-c31dbb7af929 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:28.452073 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9e45fa6d-886b-4d5b-abe7-c31dbb7af929 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:28.457112 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-3c31ec38-eda6-438d-9ad3-542b76822cad tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:06:28.470538 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-3c31ec38-eda6-438d-9ad3-542b76822cad tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1506 microversion: 2.1 time: 0.675159 Sep 14 09:06:28.477320 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1980/3983] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:06:27 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1506 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:06:28.503989 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b895cd59-11c0-41b3-8fca-8876dadaca93 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:06:28.507259 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b895cd59-11c0-41b3-8fca-8876dadaca93 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: be33aba3-e9b3-4ea7-b025-45cf8f1df0ef] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:28.524816 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-b895cd59-11c0-41b3-8fca-8876dadaca93 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] HTTP exception thrown: Instance be33aba3-e9b3-4ea7-b025-45cf8f1df0ef could not be found. Sep 14 09:06:28.535617 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b895cd59-11c0-41b3-8fca-8876dadaca93 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Request method failure captured: Sep 14 09:06:28.535617 n-d-836830-18 devstack@n-api.service[128759]: request: POST /compute/v2.1/servers/be33aba3-e9b3-4ea7-b025-45cf8f1df0ef/action HTTP/1.1 Sep 14 09:06:28.535617 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:06:28.535617 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:06:28.535617 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:06:28.535617 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 39 Sep 14 09:06:28.535617 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:06:28.535617 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:06:28.535617 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:06:28.535617 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:06:28.535617 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZk2EvHIWQyXATvY4f6phbqF3DzIIyaJjJFCE11LxTKbrsndvuk5zoyyEUR0VXx32_kFjD0I6jBROuj0ZPSHQav7u9FFvOPFGrPkf9qZrgXY9k3zAUFrOVfwLECoLZOolubyCPUAGSEOi_HvFIP_Dd_DCbUCKDEGGLtdnAzy2tLCxHs Sep 14 09:06:28.535617 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:06:28.535617 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:06:28.535617 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:06:28.535617 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:06:28.535617 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:06:28.535617 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:06:28.535617 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 6907b82c9d5c4a23a63bbeec31c3c365 Sep 14 09:06:28.535617 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ServersNegativeTestJSON-1654813540 Sep 14 09:06:28.535617 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:06:28.535617 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:06:28.535617 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6907b82c9d5c4a23a63bbeec31c3c365"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6907b82c9d5c4a23a63bbeec31c3c365"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6907b82c9d5c4a23a63bbeec31c3c365"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6907b82c9d5c4a23a63bbeec31c3c365"}]}] Sep 14 09:06:28.535617 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ServersNegativeTestJSON-1654813540 Sep 14 09:06:28.535617 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 6907b82c9d5c4a23a63bbeec31c3c365 Sep 14 09:06:28.535617 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1654813540 Sep 14 09:06:28.535617 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ServersNegativeTestJSON-1654813540-project Sep 14 09:06:28.535617 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:06:28.535617 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:06:28.535617 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 79583c4e80a04f138927f09eb4e170f4 Sep 14 09:06:28.535617 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ServersNegativeTestJSON-1654813540-project Sep 14 09:06:28.535617 n-d-836830-18 devstack@n-api.service[128759]: Sep 14 09:06:28.535617 n-d-836830-18 devstack@n-api.service[128759]: {"os-getConsoleOutput": {"length": 10}} Sep 14 09:06:28.535617 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:06:28.535617 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance be33aba3-e9b3-4ea7-b025-45cf8f1df0ef could not be found. Sep 14 09:06:28.535617 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': 'be33aba3-e9b3-4ea7-b025-45cf8f1df0ef', 'body': {'os-getConsoleOutput': {'length': 10}}} Sep 14 09:06:28.535617 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:06:28.535617 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:06:28.535617 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:06:28.535617 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:06:28.535617 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:06:28.535617 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:06:28.535617 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 14 09:06:28.535617 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 14 09:06:28.535617 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be33aba3-e9b3-4ea7-b025-45cf8f1df0ef could not be found. Sep 14 09:06:28.535617 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:28.535617 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:06:28.535617 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:28.535617 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:06:28.535617 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:06:28.535617 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:06:28.535617 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:06:28.535617 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:06:28.535617 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:06:28.535617 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:06:28.535617 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:06:28.535617 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:06:28.535617 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Sep 14 09:06:28.535617 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 14 09:06:28.535617 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:06:28.535617 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:06:28.535617 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be33aba3-e9b3-4ea7-b025-45cf8f1df0ef could not be found. Sep 14 09:06:28.535617 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:28.535617 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:06:28.535617 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:28.535617 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:06:28.547261 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:06:28.547261 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:06:28.547261 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:06:28.547261 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:06:28.547261 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be33aba3-e9b3-4ea7-b025-45cf8f1df0ef could not be found. Sep 14 09:06:28.547261 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:28.547261 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b895cd59-11c0-41b3-8fca-8876dadaca93 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Returning 404 to user: Instance be33aba3-e9b3-4ea7-b025-45cf8f1df0ef could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:06:28.547261 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b895cd59-11c0-41b3-8fca-8876dadaca93 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "POST /compute/v2.1/servers/be33aba3-e9b3-4ea7-b025-45cf8f1df0ef/action" status: 404 len: 111 microversion: 2.1 time: 0.039125 Sep 14 09:06:28.547261 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1981/3984] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:06:28 2022] POST /compute/v2.1/servers/be33aba3-e9b3-4ea7-b025-45cf8f1df0ef/action => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 14 09:06:28.547261 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-6107da73-7c46-4d9e-bec1-0721ca2f4c02 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:28.562495 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-6107da73-7c46-4d9e-bec1-0721ca2f4c02 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:28.597294 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6107da73-7c46-4d9e-bec1-0721ca2f4c02 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:28.597815 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6107da73-7c46-4d9e-bec1-0721ca2f4c02 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:28.598299 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6107da73-7c46-4d9e-bec1-0721ca2f4c02 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:28.599101 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6107da73-7c46-4d9e-bec1-0721ca2f4c02 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:28.599567 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6107da73-7c46-4d9e-bec1-0721ca2f4c02 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:28.599992 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6107da73-7c46-4d9e-bec1-0721ca2f4c02 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:28.755694 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-9e45fa6d-886b-4d5b-abe7-c31dbb7af929 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5165b8fc101c47c7a4370f9007bc5a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a597fc389b4805bbd3a53ecd17c5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:06:28.770538 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-9e45fa6d-886b-4d5b-abe7-c31dbb7af929 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute/v2.1/servers/ed6976ad-867b-4570-a547-758efc8f622f" status: 200 len: 1497 microversion: 2.1 time: 0.367780 Sep 14 09:06:28.771438 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2004/3985] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:06:28 2022] GET /compute/v2.1/servers/ed6976ad-867b-4570-a547-758efc8f622f => generated 1497 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:06:28.992713 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-6107da73-7c46-4d9e-bec1-0721ca2f4c02 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:06:29.007530 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-6107da73-7c46-4d9e-bec1-0721ca2f4c02 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1506 microversion: 2.1 time: 0.462416 Sep 14 09:06:29.008149 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1982/3986] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:06:28 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1506 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:06:29.039587 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c20d82fa-a96c-4ee2-a648-f0682e3ae0ec tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:29.040442 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-c20d82fa-a96c-4ee2-a648-f0682e3ae0ec tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:29.056276 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c20d82fa-a96c-4ee2-a648-f0682e3ae0ec tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:29.057549 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c20d82fa-a96c-4ee2-a648-f0682e3ae0ec tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:29.058959 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c20d82fa-a96c-4ee2-a648-f0682e3ae0ec tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:29.063042 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c20d82fa-a96c-4ee2-a648-f0682e3ae0ec tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:29.064175 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c20d82fa-a96c-4ee2-a648-f0682e3ae0ec tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:29.065579 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c20d82fa-a96c-4ee2-a648-f0682e3ae0ec tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:29.685370 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-c20d82fa-a96c-4ee2-a648-f0682e3ae0ec tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:06:29.697164 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-c20d82fa-a96c-4ee2-a648-f0682e3ae0ec tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1506 microversion: 2.1 time: 0.662265 Sep 14 09:06:29.704413 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2005/3987] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:06:29 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1506 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:06:29.727838 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8e30e825-cb67-4b15-90e0-5a2d5a82f92a tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:29.728220 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-8e30e825-cb67-4b15-90e0-5a2d5a82f92a tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: b67d537f-0f9d-48d9-98e1-8de2ef14ce2c] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:29.740614 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-8e30e825-cb67-4b15-90e0-5a2d5a82f92a tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] HTTP exception thrown: Instance b67d537f-0f9d-48d9-98e1-8de2ef14ce2c could not be found. Sep 14 09:06:29.746089 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8e30e825-cb67-4b15-90e0-5a2d5a82f92a tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Request method failure captured: Sep 14 09:06:29.746089 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/b67d537f-0f9d-48d9-98e1-8de2ef14ce2c HTTP/1.1 Sep 14 09:06:29.746089 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:06:29.746089 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:06:29.746089 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:06:29.746089 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:06:29.746089 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:06:29.746089 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:06:29.746089 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:06:29.746089 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:06:29.746089 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZk2EvHIWQyXATvY4f6phbqF3DzIIyaJjJFCE11LxTKbrsndvuk5zoyyEUR0VXx32_kFjD0I6jBROuj0ZPSHQav7u9FFvOPFGrPkf9qZrgXY9k3zAUFrOVfwLECoLZOolubyCPUAGSEOi_HvFIP_Dd_DCbUCKDEGGLtdnAzy2tLCxHs Sep 14 09:06:29.746089 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:06:29.746089 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:06:29.746089 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:06:29.746089 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:06:29.746089 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:06:29.746089 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:06:29.746089 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 6907b82c9d5c4a23a63bbeec31c3c365 Sep 14 09:06:29.746089 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ServersNegativeTestJSON-1654813540 Sep 14 09:06:29.746089 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:06:29.746089 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:06:29.746089 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6907b82c9d5c4a23a63bbeec31c3c365"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6907b82c9d5c4a23a63bbeec31c3c365"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6907b82c9d5c4a23a63bbeec31c3c365"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6907b82c9d5c4a23a63bbeec31c3c365"}]}] Sep 14 09:06:29.746089 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ServersNegativeTestJSON-1654813540 Sep 14 09:06:29.746089 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 6907b82c9d5c4a23a63bbeec31c3c365 Sep 14 09:06:29.746089 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1654813540 Sep 14 09:06:29.746089 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ServersNegativeTestJSON-1654813540-project Sep 14 09:06:29.746089 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:06:29.746089 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:06:29.746089 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 79583c4e80a04f138927f09eb4e170f4 Sep 14 09:06:29.746089 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ServersNegativeTestJSON-1654813540-project Sep 14 09:06:29.746089 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:06:29.746089 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance b67d537f-0f9d-48d9-98e1-8de2ef14ce2c could not be found. Sep 14 09:06:29.746089 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': 'b67d537f-0f9d-48d9-98e1-8de2ef14ce2c'} Sep 14 09:06:29.746089 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:06:29.746089 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:06:29.746089 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:06:29.746089 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:06:29.746089 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:06:29.746089 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:06:29.746089 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 14 09:06:29.746089 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 14 09:06:29.746089 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b67d537f-0f9d-48d9-98e1-8de2ef14ce2c could not be found. Sep 14 09:06:29.746089 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:29.746089 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:06:29.746089 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:29.746089 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:06:29.746089 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:06:29.746089 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:06:29.746089 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:06:29.746089 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:06:29.746089 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:06:29.746089 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:06:29.746089 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:06:29.746089 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:06:29.746089 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:06:29.746089 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:06:29.746089 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:06:29.746089 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:06:29.746089 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b67d537f-0f9d-48d9-98e1-8de2ef14ce2c could not be found. Sep 14 09:06:29.746089 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:29.746089 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:06:29.746089 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:29.746089 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:06:29.746089 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:06:29.749998 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:06:29.749998 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:06:29.749998 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:06:29.749998 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b67d537f-0f9d-48d9-98e1-8de2ef14ce2c could not be found. Sep 14 09:06:29.749998 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:29.755287 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8e30e825-cb67-4b15-90e0-5a2d5a82f92a tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Returning 404 to user: Instance b67d537f-0f9d-48d9-98e1-8de2ef14ce2c could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:06:29.761747 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-8e30e825-cb67-4b15-90e0-5a2d5a82f92a tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/b67d537f-0f9d-48d9-98e1-8de2ef14ce2c" status: 404 len: 111 microversion: 2.1 time: 0.037000 Sep 14 09:06:29.767246 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1983/3988] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:06:29 2022] GET /compute/v2.1/servers/b67d537f-0f9d-48d9-98e1-8de2ef14ce2c => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:06:29.772605 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b9ba50ef-15c9-429f-a47d-899c30e77e85 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:29.774048 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-b9ba50ef-15c9-429f-a47d-899c30e77e85 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:29.784630 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b9ba50ef-15c9-429f-a47d-899c30e77e85 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:29.794033 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-5ba85bd3-93dd-43b5-b0b4-c17b3a4fdc46 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:29.794657 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-5ba85bd3-93dd-43b5-b0b4-c17b3a4fdc46 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] [instance: ed6976ad-867b-4570-a547-758efc8f622f] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:29.798042 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b9ba50ef-15c9-429f-a47d-899c30e77e85 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:29.806402 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b9ba50ef-15c9-429f-a47d-899c30e77e85 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:29.807287 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b9ba50ef-15c9-429f-a47d-899c30e77e85 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:29.807774 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b9ba50ef-15c9-429f-a47d-899c30e77e85 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:29.808216 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b9ba50ef-15c9-429f-a47d-899c30e77e85 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:29.818628 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5ba85bd3-93dd-43b5-b0b4-c17b3a4fdc46 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:29.823839 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5ba85bd3-93dd-43b5-b0b4-c17b3a4fdc46 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:29.824607 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5ba85bd3-93dd-43b5-b0b4-c17b3a4fdc46 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:29.828049 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5ba85bd3-93dd-43b5-b0b4-c17b3a4fdc46 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:29.828541 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5ba85bd3-93dd-43b5-b0b4-c17b3a4fdc46 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:29.828992 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5ba85bd3-93dd-43b5-b0b4-c17b3a4fdc46 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:30.892530 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-b9ba50ef-15c9-429f-a47d-899c30e77e85 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:06:30.912737 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-b9ba50ef-15c9-429f-a47d-899c30e77e85 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1506 microversion: 2.1 time: 1.145376 Sep 14 09:06:30.921347 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2006/3989] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:06:29 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1506 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:06:30.950405 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-35e13946-4c9b-4ec5-9873-15c1a963559c tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:30.951279 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-35e13946-4c9b-4ec5-9873-15c1a963559c tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:30.957766 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-5ba85bd3-93dd-43b5-b0b4-c17b3a4fdc46 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5165b8fc101c47c7a4370f9007bc5a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a597fc389b4805bbd3a53ecd17c5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:06:30.976363 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-5ba85bd3-93dd-43b5-b0b4-c17b3a4fdc46 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute/v2.1/servers/ed6976ad-867b-4570-a547-758efc8f622f" status: 200 len: 1497 microversion: 2.1 time: 1.179238 Sep 14 09:06:30.978991 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-35e13946-4c9b-4ec5-9873-15c1a963559c tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:30.979728 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1984/3990] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:06:29 2022] GET /compute/v2.1/servers/ed6976ad-867b-4570-a547-758efc8f622f => generated 1497 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:06:30.980457 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-35e13946-4c9b-4ec5-9873-15c1a963559c tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:30.981087 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-35e13946-4c9b-4ec5-9873-15c1a963559c tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:30.981967 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-35e13946-4c9b-4ec5-9873-15c1a963559c tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:30.983449 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-35e13946-4c9b-4ec5-9873-15c1a963559c tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:30.984038 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-35e13946-4c9b-4ec5-9873-15c1a963559c tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:31.221906 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-35e13946-4c9b-4ec5-9873-15c1a963559c tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:06:31.230617 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-35e13946-4c9b-4ec5-9873-15c1a963559c tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1506 microversion: 2.1 time: 0.285483 Sep 14 09:06:31.231770 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2007/3991] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:06:30 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1506 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:06:31.456977 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-76f2d7a7-dbb6-4b7e-8066-5b4fc3f76e51 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-947442365", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "2616a0b0-fea1-46f8-bf23-608a226da1ef"}]}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:06:31.475482 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-76f2d7a7-dbb6-4b7e-8066-5b4fc3f76e51 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Request method failure captured: Sep 14 09:06:31.475482 n-d-836830-18 devstack@n-api.service[128759]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 14 09:06:31.475482 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:06:31.475482 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:06:31.475482 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:06:31.475482 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 237 Sep 14 09:06:31.475482 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:06:31.475482 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:06:31.475482 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:06:31.475482 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:06:31.475482 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZk2EvHIWQyXATvY4f6phbqF3DzIIyaJjJFCE11LxTKbrsndvuk5zoyyEUR0VXx32_kFjD0I6jBROuj0ZPSHQav7u9FFvOPFGrPkf9qZrgXY9k3zAUFrOVfwLECoLZOolubyCPUAGSEOi_HvFIP_Dd_DCbUCKDEGGLtdnAzy2tLCxHs Sep 14 09:06:31.475482 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:06:31.475482 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:06:31.475482 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:06:31.475482 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:06:31.475482 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:06:31.475482 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:06:31.475482 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 6907b82c9d5c4a23a63bbeec31c3c365 Sep 14 09:06:31.475482 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ServersNegativeTestJSON-1654813540 Sep 14 09:06:31.475482 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:06:31.475482 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:06:31.475482 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6907b82c9d5c4a23a63bbeec31c3c365"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6907b82c9d5c4a23a63bbeec31c3c365"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6907b82c9d5c4a23a63bbeec31c3c365"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6907b82c9d5c4a23a63bbeec31c3c365"}]}] Sep 14 09:06:31.475482 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ServersNegativeTestJSON-1654813540 Sep 14 09:06:31.475482 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 6907b82c9d5c4a23a63bbeec31c3c365 Sep 14 09:06:31.475482 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1654813540 Sep 14 09:06:31.475482 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ServersNegativeTestJSON-1654813540-project Sep 14 09:06:31.475482 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:06:31.475482 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:06:31.475482 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 79583c4e80a04f138927f09eb4e170f4 Sep 14 09:06:31.475482 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ServersNegativeTestJSON-1654813540-project Sep 14 09:06:31.475482 n-d-836830-18 devstack@n-api.service[128759]: Sep 14 09:06:31.475482 n-d-836830-18 devstack@n-api.service[128759]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-947442365", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "2616a0b0-fea1-46f8-bf23-608a226da1ef"}]}} Sep 14 09:06:31.475482 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:06:31.475482 n-d-836830-18 devstack@n-api.service[128759]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Sep 14 09:06:31.475482 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-947442365', 'imageRef': 'bff4ab7f-4846-441f-8940-d96fec4c28e9', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': '2616a0b0-fea1-46f8-bf23-608a226da1ef'}]}}} Sep 14 09:06:31.475482 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:06:31.475482 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:06:31.475482 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Sep 14 09:06:31.475482 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi result = func(instance) Sep 14 09:06:31.475482 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 253, in is_ipv4 Sep 14 09:06:31.475482 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Sep 14 09:06:31.475482 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Sep 14 09:06:31.475482 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Sep 14 09:06:31.475482 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Sep 14 09:06:31.475482 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Sep 14 09:06:31.475482 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Sep 14 09:06:31.475482 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:31.475482 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 14 09:06:31.475482 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:31.475482 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:06:31.475482 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 14 09:06:31.475482 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 14 09:06:31.475482 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 14 09:06:31.475482 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise error Sep 14 09:06:31.475482 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Sep 14 09:06:31.475482 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:31.475482 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Sep 14 09:06:31.475482 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Sep 14 09:06:31.475482 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:31.475482 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 14 09:06:31.475482 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Sep 14 09:06:31.475482 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:31.475482 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:06:31.475482 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:31.475482 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:06:31.478957 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:06:31.478957 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:06:31.478957 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:06:31.478957 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:06:31.478957 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:06:31.478957 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:06:31.478957 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:06:31.478957 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:06:31.478957 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 14 09:06:31.478957 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 14 09:06:31.478957 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 14 09:06:31.478957 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 14 09:06:31.478957 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 14 09:06:31.478957 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 14 09:06:31.478957 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Sep 14 09:06:31.478957 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:31.478957 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:06:31.478957 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:31.478957 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:06:31.478957 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:06:31.478957 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:06:31.478957 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 14 09:06:31.478957 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 14 09:06:31.478957 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Sep 14 09:06:31.478957 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:31.482295 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-76f2d7a7-dbb6-4b7e-8066-5b4fc3f76e51 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:06:31.483421 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-76f2d7a7-dbb6-4b7e-8066-5b4fc3f76e51 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.030366 Sep 14 09:06:31.484611 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1985/3992] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 09:06:31 2022] POST /compute/v2.1/servers => generated 139 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 14 09:06:31.493740 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a599118e-d4a6-49b2-877e-9ec358284974 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:31.494377 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-a599118e-d4a6-49b2-877e-9ec358284974 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:31.507190 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a599118e-d4a6-49b2-877e-9ec358284974 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:31.507716 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a599118e-d4a6-49b2-877e-9ec358284974 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:31.509887 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a599118e-d4a6-49b2-877e-9ec358284974 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:31.510787 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a599118e-d4a6-49b2-877e-9ec358284974 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:31.516936 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a599118e-d4a6-49b2-877e-9ec358284974 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:31.517585 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a599118e-d4a6-49b2-877e-9ec358284974 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:31.956048 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-a599118e-d4a6-49b2-877e-9ec358284974 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:06:32.003042 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-a599118e-d4a6-49b2-877e-9ec358284974 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1506 microversion: 2.1 time: 0.512536 Sep 14 09:06:32.009262 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2008/3993] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:06:31 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1506 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:06:32.009923 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-944e57a8-e615-49bd-bb44-dd7c1313a614 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:32.015179 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-944e57a8-e615-49bd-bb44-dd7c1313a614 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] [instance: ed6976ad-867b-4570-a547-758efc8f622f] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:32.046519 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-febaa60d-a7cc-4785-a2e5-2c882c8b780d tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:32.048906 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-febaa60d-a7cc-4785-a2e5-2c882c8b780d tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:32.078365 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-944e57a8-e615-49bd-bb44-dd7c1313a614 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:32.078875 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-944e57a8-e615-49bd-bb44-dd7c1313a614 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:32.095553 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-febaa60d-a7cc-4785-a2e5-2c882c8b780d tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:32.098172 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-944e57a8-e615-49bd-bb44-dd7c1313a614 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:32.100838 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-944e57a8-e615-49bd-bb44-dd7c1313a614 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:32.101440 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-febaa60d-a7cc-4785-a2e5-2c882c8b780d tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:32.102950 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-944e57a8-e615-49bd-bb44-dd7c1313a614 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:32.103361 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-febaa60d-a7cc-4785-a2e5-2c882c8b780d tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:32.104985 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-febaa60d-a7cc-4785-a2e5-2c882c8b780d tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:32.105458 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-944e57a8-e615-49bd-bb44-dd7c1313a614 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:32.109674 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-febaa60d-a7cc-4785-a2e5-2c882c8b780d tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:32.110799 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-febaa60d-a7cc-4785-a2e5-2c882c8b780d tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:32.633231 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=8 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:06:32.813012 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-febaa60d-a7cc-4785-a2e5-2c882c8b780d tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:06:32.837128 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-944e57a8-e615-49bd-bb44-dd7c1313a614 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5165b8fc101c47c7a4370f9007bc5a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a597fc389b4805bbd3a53ecd17c5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:06:32.850329 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-944e57a8-e615-49bd-bb44-dd7c1313a614 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute/v2.1/servers/ed6976ad-867b-4570-a547-758efc8f622f" status: 200 len: 1497 microversion: 2.1 time: 0.849459 Sep 14 09:06:32.855364 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1986/3994] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:06:31 2022] GET /compute/v2.1/servers/ed6976ad-867b-4570-a547-758efc8f622f => generated 1497 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:06:32.876903 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-febaa60d-a7cc-4785-a2e5-2c882c8b780d tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1506 microversion: 2.1 time: 0.813581 Sep 14 09:06:32.877564 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2009/3995] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:06:32 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1506 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:06:33.183660 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-fd53b308-bf88-47af-abff-2d13cea642e0 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1624242040", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "2616a0b0-fea1-46f8-bf23-608a226da1ef"}]}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:06:33.187864 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-fd53b308-bf88-47af-abff-2d13cea642e0 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Request method failure captured: Sep 14 09:06:33.187864 n-d-836830-18 devstack@n-api.service[128759]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 14 09:06:33.187864 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:06:33.187864 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:06:33.187864 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:06:33.187864 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 235 Sep 14 09:06:33.187864 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:06:33.187864 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:06:33.187864 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:06:33.187864 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:06:33.187864 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZk2EvHIWQyXATvY4f6phbqF3DzIIyaJjJFCE11LxTKbrsndvuk5zoyyEUR0VXx32_kFjD0I6jBROuj0ZPSHQav7u9FFvOPFGrPkf9qZrgXY9k3zAUFrOVfwLECoLZOolubyCPUAGSEOi_HvFIP_Dd_DCbUCKDEGGLtdnAzy2tLCxHs Sep 14 09:06:33.187864 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:06:33.187864 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:06:33.187864 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:06:33.187864 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:06:33.187864 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:06:33.187864 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:06:33.187864 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 6907b82c9d5c4a23a63bbeec31c3c365 Sep 14 09:06:33.187864 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ServersNegativeTestJSON-1654813540 Sep 14 09:06:33.187864 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:06:33.187864 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:06:33.187864 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6907b82c9d5c4a23a63bbeec31c3c365"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6907b82c9d5c4a23a63bbeec31c3c365"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6907b82c9d5c4a23a63bbeec31c3c365"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6907b82c9d5c4a23a63bbeec31c3c365"}]}] Sep 14 09:06:33.187864 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ServersNegativeTestJSON-1654813540 Sep 14 09:06:33.187864 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 6907b82c9d5c4a23a63bbeec31c3c365 Sep 14 09:06:33.187864 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1654813540 Sep 14 09:06:33.187864 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ServersNegativeTestJSON-1654813540-project Sep 14 09:06:33.187864 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:06:33.187864 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:06:33.187864 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 79583c4e80a04f138927f09eb4e170f4 Sep 14 09:06:33.187864 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ServersNegativeTestJSON-1654813540-project Sep 14 09:06:33.187864 n-d-836830-18 devstack@n-api.service[128759]: Sep 14 09:06:33.187864 n-d-836830-18 devstack@n-api.service[128759]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1624242040", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "2616a0b0-fea1-46f8-bf23-608a226da1ef"}]}} Sep 14 09:06:33.187864 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:06:33.187864 n-d-836830-18 devstack@n-api.service[128759]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Sep 14 09:06:33.187864 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1624242040', 'imageRef': 'bff4ab7f-4846-441f-8940-d96fec4c28e9', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': '2616a0b0-fea1-46f8-bf23-608a226da1ef'}]}}} Sep 14 09:06:33.187864 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:06:33.187864 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:06:33.187864 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Sep 14 09:06:33.187864 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi result = func(instance) Sep 14 09:06:33.187864 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 260, in is_ipv6 Sep 14 09:06:33.187864 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Sep 14 09:06:33.187864 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Sep 14 09:06:33.187864 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Sep 14 09:06:33.187864 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Sep 14 09:06:33.187864 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Sep 14 09:06:33.187864 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Sep 14 09:06:33.187864 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:33.187864 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 14 09:06:33.187864 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:33.187864 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:06:33.187864 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 14 09:06:33.187864 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 14 09:06:33.187864 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 14 09:06:33.187864 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise error Sep 14 09:06:33.187864 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Sep 14 09:06:33.187864 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:33.187864 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Sep 14 09:06:33.187864 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Sep 14 09:06:33.187864 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:33.187864 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 14 09:06:33.187864 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi 'notvalid' Sep 14 09:06:33.187864 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:33.187864 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:06:33.187864 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:33.187864 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:06:33.196848 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:06:33.196848 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:06:33.196848 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:06:33.196848 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:06:33.196848 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:06:33.196848 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:06:33.196848 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:06:33.196848 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:06:33.196848 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 14 09:06:33.196848 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 14 09:06:33.196848 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 14 09:06:33.196848 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 14 09:06:33.196848 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 14 09:06:33.196848 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 14 09:06:33.196848 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Sep 14 09:06:33.196848 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:33.196848 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:06:33.196848 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:33.196848 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:06:33.196848 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:06:33.196848 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:06:33.196848 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 14 09:06:33.196848 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 14 09:06:33.196848 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Sep 14 09:06:33.196848 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:33.199922 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-fd53b308-bf88-47af-abff-2d13cea642e0 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:06:33.201462 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-fd53b308-bf88-47af-abff-2d13cea642e0 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.020402 Sep 14 09:06:33.201462 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1987/3996] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 09:06:33 2022] POST /compute/v2.1/servers => generated 133 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 14 09:06:33.208952 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a74a7c32-7b28-44fe-9ebf-5ac767f2c7a6 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:33.209724 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-a74a7c32-7b28-44fe-9ebf-5ac767f2c7a6 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:33.228239 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a74a7c32-7b28-44fe-9ebf-5ac767f2c7a6 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:33.228590 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a74a7c32-7b28-44fe-9ebf-5ac767f2c7a6 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:33.229237 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a74a7c32-7b28-44fe-9ebf-5ac767f2c7a6 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:33.229730 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a74a7c32-7b28-44fe-9ebf-5ac767f2c7a6 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:33.230185 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a74a7c32-7b28-44fe-9ebf-5ac767f2c7a6 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:33.230640 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a74a7c32-7b28-44fe-9ebf-5ac767f2c7a6 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:33.611660 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-a74a7c32-7b28-44fe-9ebf-5ac767f2c7a6 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:06:33.628217 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-a74a7c32-7b28-44fe-9ebf-5ac767f2c7a6 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1506 microversion: 2.1 time: 0.422593 Sep 14 09:06:33.630032 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2010/3997] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:06:33 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1506 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:06:33.670810 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-4be34dbe-fa1c-433b-8081-5a96e8a085a2 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:33.672015 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-4be34dbe-fa1c-433b-8081-5a96e8a085a2 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:33.691850 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4be34dbe-fa1c-433b-8081-5a96e8a085a2 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:33.692699 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4be34dbe-fa1c-433b-8081-5a96e8a085a2 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:33.693508 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4be34dbe-fa1c-433b-8081-5a96e8a085a2 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:33.700122 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4be34dbe-fa1c-433b-8081-5a96e8a085a2 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:33.701130 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4be34dbe-fa1c-433b-8081-5a96e8a085a2 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:33.701984 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4be34dbe-fa1c-433b-8081-5a96e8a085a2 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:33.902781 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c70f9625-31e4-445b-82e2-ee0c046294ab tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:33.912368 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-c70f9625-31e4-445b-82e2-ee0c046294ab tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] [instance: ed6976ad-867b-4570-a547-758efc8f622f] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:33.957807 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c70f9625-31e4-445b-82e2-ee0c046294ab tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:33.963563 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c70f9625-31e4-445b-82e2-ee0c046294ab tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:33.964865 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c70f9625-31e4-445b-82e2-ee0c046294ab tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:33.969816 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c70f9625-31e4-445b-82e2-ee0c046294ab tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:33.972215 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c70f9625-31e4-445b-82e2-ee0c046294ab tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:33.973735 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c70f9625-31e4-445b-82e2-ee0c046294ab tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:34.196179 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-4be34dbe-fa1c-433b-8081-5a96e8a085a2 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:06:34.208193 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-4be34dbe-fa1c-433b-8081-5a96e8a085a2 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1506 microversion: 2.1 time: 0.552759 Sep 14 09:06:34.222399 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1988/3998] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:06:33 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1506 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:06:34.244596 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ed0e7b45-4647-4cc8-8f43-36f26dcde862 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:06:34.245194 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-ed0e7b45-4647-4cc8-8f43-36f26dcde862 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: 574d348c-868f-4fa6-a99c-07f50fd60ce5] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:34.270725 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-ed0e7b45-4647-4cc8-8f43-36f26dcde862 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] HTTP exception thrown: Instance 574d348c-868f-4fa6-a99c-07f50fd60ce5 could not be found. Sep 14 09:06:34.279745 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ed0e7b45-4647-4cc8-8f43-36f26dcde862 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Request method failure captured: Sep 14 09:06:34.279745 n-d-836830-18 devstack@n-api.service[128759]: request: POST /compute/v2.1/servers/574d348c-868f-4fa6-a99c-07f50fd60ce5/action HTTP/1.1 Sep 14 09:06:34.279745 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:06:34.279745 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:06:34.279745 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:06:34.279745 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 13 Sep 14 09:06:34.279745 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:06:34.279745 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:06:34.279745 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:06:34.279745 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:06:34.279745 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZk2EvHIWQyXATvY4f6phbqF3DzIIyaJjJFCE11LxTKbrsndvuk5zoyyEUR0VXx32_kFjD0I6jBROuj0ZPSHQav7u9FFvOPFGrPkf9qZrgXY9k3zAUFrOVfwLECoLZOolubyCPUAGSEOi_HvFIP_Dd_DCbUCKDEGGLtdnAzy2tLCxHs Sep 14 09:06:34.279745 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:06:34.279745 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:06:34.279745 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:06:34.279745 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:06:34.279745 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:06:34.279745 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:06:34.279745 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 6907b82c9d5c4a23a63bbeec31c3c365 Sep 14 09:06:34.279745 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ServersNegativeTestJSON-1654813540 Sep 14 09:06:34.279745 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:06:34.279745 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:06:34.279745 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6907b82c9d5c4a23a63bbeec31c3c365"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6907b82c9d5c4a23a63bbeec31c3c365"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6907b82c9d5c4a23a63bbeec31c3c365"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6907b82c9d5c4a23a63bbeec31c3c365"}]}] Sep 14 09:06:34.279745 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ServersNegativeTestJSON-1654813540 Sep 14 09:06:34.279745 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 6907b82c9d5c4a23a63bbeec31c3c365 Sep 14 09:06:34.279745 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1654813540 Sep 14 09:06:34.279745 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ServersNegativeTestJSON-1654813540-project Sep 14 09:06:34.279745 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:06:34.279745 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:06:34.279745 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 79583c4e80a04f138927f09eb4e170f4 Sep 14 09:06:34.279745 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ServersNegativeTestJSON-1654813540-project Sep 14 09:06:34.279745 n-d-836830-18 devstack@n-api.service[128759]: Sep 14 09:06:34.279745 n-d-836830-18 devstack@n-api.service[128759]: {"pause": {}} Sep 14 09:06:34.279745 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:06:34.279745 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance 574d348c-868f-4fa6-a99c-07f50fd60ce5 could not be found. Sep 14 09:06:34.279745 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '574d348c-868f-4fa6-a99c-07f50fd60ce5', 'body': {'pause': {}}} Sep 14 09:06:34.279745 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:06:34.279745 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:06:34.279745 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:06:34.279745 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:06:34.279745 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:06:34.279745 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:06:34.279745 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 14 09:06:34.279745 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 14 09:06:34.279745 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 574d348c-868f-4fa6-a99c-07f50fd60ce5 could not be found. Sep 14 09:06:34.279745 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:34.279745 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:06:34.279745 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:34.279745 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:06:34.279745 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:06:34.279745 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:06:34.279745 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:06:34.279745 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:06:34.279745 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:06:34.279745 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:06:34.279745 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Sep 14 09:06:34.279745 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Sep 14 09:06:34.279745 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:06:34.279745 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:06:34.279745 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 574d348c-868f-4fa6-a99c-07f50fd60ce5 could not be found. Sep 14 09:06:34.279745 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:34.279745 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:06:34.279745 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:34.279745 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:06:34.279745 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:06:34.279745 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:06:34.283499 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:06:34.283499 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:06:34.283499 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 574d348c-868f-4fa6-a99c-07f50fd60ce5 could not be found. Sep 14 09:06:34.283499 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:34.284880 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ed0e7b45-4647-4cc8-8f43-36f26dcde862 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Returning 404 to user: Instance 574d348c-868f-4fa6-a99c-07f50fd60ce5 could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:06:34.286113 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-ed0e7b45-4647-4cc8-8f43-36f26dcde862 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "POST /compute/v2.1/servers/574d348c-868f-4fa6-a99c-07f50fd60ce5/action" status: 404 len: 111 microversion: 2.1 time: 0.053880 Sep 14 09:06:34.287229 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1989/3999] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:06:34 2022] POST /compute/v2.1/servers/574d348c-868f-4fa6-a99c-07f50fd60ce5/action => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:06:34.298553 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c7aa5b25-2ac4-4098-97e1-6d8448db569e tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:34.299521 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-c7aa5b25-2ac4-4098-97e1-6d8448db569e tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:34.319414 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c7aa5b25-2ac4-4098-97e1-6d8448db569e tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:34.320222 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c7aa5b25-2ac4-4098-97e1-6d8448db569e tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:34.321321 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c7aa5b25-2ac4-4098-97e1-6d8448db569e tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:34.323747 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c7aa5b25-2ac4-4098-97e1-6d8448db569e tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:34.324358 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c7aa5b25-2ac4-4098-97e1-6d8448db569e tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:34.325468 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c7aa5b25-2ac4-4098-97e1-6d8448db569e tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:34.617883 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-c70f9625-31e4-445b-82e2-ee0c046294ab tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5165b8fc101c47c7a4370f9007bc5a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a597fc389b4805bbd3a53ecd17c5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:06:34.630039 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-c70f9625-31e4-445b-82e2-ee0c046294ab tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute/v2.1/servers/ed6976ad-867b-4570-a547-758efc8f622f" status: 200 len: 1497 microversion: 2.1 time: 0.733552 Sep 14 09:06:34.632721 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2011/4000] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:06:33 2022] GET /compute/v2.1/servers/ed6976ad-867b-4570-a547-758efc8f622f => generated 1497 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:06:35.604569 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ced5c892-b8a8-46db-8582-08805654be9e tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-63424684", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "networks": [{"uuid": "68aae547-793e-4c78-a581-5cf176ee1e6c"}]}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:06:35.667125 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=77,nova_api:DELETE=3 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:06:35.774167 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.network.neutron [None req-ced5c892-b8a8-46db-8582-08805654be9e tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] validate_networks() for [('68aae547-793e-4c78-a581-5cf176ee1e6c', None, None, None, None, None)] {{(pid=128758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:06:36.300532 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-c7aa5b25-2ac4-4098-97e1-6d8448db569e tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:06:36.314782 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-c7aa5b25-2ac4-4098-97e1-6d8448db569e tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1506 microversion: 2.1 time: 2.020364 Sep 14 09:06:36.315512 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1990/4001] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:06:34 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1506 bytes in 2023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:06:36.328383 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-36122733-3f4f-469c-b91d-b783871e87d2 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:36.329277 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-36122733-3f4f-469c-b91d-b783871e87d2 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] [instance: ed6976ad-867b-4570-a547-758efc8f622f] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:36.340735 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-36122733-3f4f-469c-b91d-b783871e87d2 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:36.341814 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-36122733-3f4f-469c-b91d-b783871e87d2 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:36.342729 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-36122733-3f4f-469c-b91d-b783871e87d2 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:36.344042 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-36122733-3f4f-469c-b91d-b783871e87d2 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:36.344690 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-36122733-3f4f-469c-b91d-b783871e87d2 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:36.345529 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-36122733-3f4f-469c-b91d-b783871e87d2 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:36.981758 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-36122733-3f4f-469c-b91d-b783871e87d2 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5165b8fc101c47c7a4370f9007bc5a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a597fc389b4805bbd3a53ecd17c5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:06:36.991342 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-36122733-3f4f-469c-b91d-b783871e87d2 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute/v2.1/servers/ed6976ad-867b-4570-a547-758efc8f622f" status: 200 len: 1497 microversion: 2.1 time: 0.673801 Sep 14 09:06:36.997482 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1991/4002] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:06:36 2022] GET /compute/v2.1/servers/ed6976ad-867b-4570-a547-758efc8f622f => generated 1497 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:06:37.005463 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-32525c22-d693-447f-a27c-3a157724af81 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:37.006026 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-32525c22-d693-447f-a27c-3a157724af81 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:37.024631 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-32525c22-d693-447f-a27c-3a157724af81 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:37.025938 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-32525c22-d693-447f-a27c-3a157724af81 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:37.026408 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-32525c22-d693-447f-a27c-3a157724af81 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:37.032442 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-32525c22-d693-447f-a27c-3a157724af81 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:37.032997 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-32525c22-d693-447f-a27c-3a157724af81 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:37.033460 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-32525c22-d693-447f-a27c-3a157724af81 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:37.042607 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=100 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:06:37.660329 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-32525c22-d693-447f-a27c-3a157724af81 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:06:37.673612 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-32525c22-d693-447f-a27c-3a157724af81 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1506 microversion: 2.1 time: 0.680082 Sep 14 09:06:37.694319 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1992/4003] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:06:36 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1506 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:06:37.705261 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-cc6ed36c-aec8-4cdf-ac7d-cc2e44a2c4e1 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:06:37.712297 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-cc6ed36c-aec8-4cdf-ac7d-cc2e44a2c4e1 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:37.721618 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cc6ed36c-aec8-4cdf-ac7d-cc2e44a2c4e1 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:37.722410 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cc6ed36c-aec8-4cdf-ac7d-cc2e44a2c4e1 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:37.723098 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cc6ed36c-aec8-4cdf-ac7d-cc2e44a2c4e1 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:37.728389 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cc6ed36c-aec8-4cdf-ac7d-cc2e44a2c4e1 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:37.729294 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cc6ed36c-aec8-4cdf-ac7d-cc2e44a2c4e1 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:37.729937 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cc6ed36c-aec8-4cdf-ac7d-cc2e44a2c4e1 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:37.844023 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-cc6ed36c-aec8-4cdf-ac7d-cc2e44a2c4e1 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "POST /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4/action" status: 202 len: 0 microversion: 2.1 time: 0.142927 Sep 14 09:06:37.848516 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1993/4004] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:06:37 2022] POST /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4/action => generated 0 bytes in 148 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 14 09:06:37.858626 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-ced5c892-b8a8-46db-8582-08805654be9e tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Flavor limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:06:37.859288 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-ced5c892-b8a8-46db-8582-08805654be9e tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Image limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:06:37.859596 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-ced5c892-b8a8-46db-8582-08805654be9e tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Flavor pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:06:37.860014 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-ced5c892-b8a8-46db-8582-08805654be9e tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Image pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:06:37.860430 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-ced5c892-b8a8-46db-8582-08805654be9e tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:06:37.864496 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-829183c1-5608-4bc4-bbbf-e0a60f0ad27f tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:37.866994 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-829183c1-5608-4bc4-bbbf-e0a60f0ad27f tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:37.888873 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ced5c892-b8a8-46db-8582-08805654be9e tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:37.890182 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ced5c892-b8a8-46db-8582-08805654be9e tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:37.890851 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ced5c892-b8a8-46db-8582-08805654be9e tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:37.891856 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ced5c892-b8a8-46db-8582-08805654be9e tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:37.892818 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ced5c892-b8a8-46db-8582-08805654be9e tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:37.893418 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ced5c892-b8a8-46db-8582-08805654be9e tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:37.916307 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-829183c1-5608-4bc4-bbbf-e0a60f0ad27f tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:37.916822 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-829183c1-5608-4bc4-bbbf-e0a60f0ad27f tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:37.917269 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-829183c1-5608-4bc4-bbbf-e0a60f0ad27f tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:37.917980 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-829183c1-5608-4bc4-bbbf-e0a60f0ad27f tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:37.928924 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-829183c1-5608-4bc4-bbbf-e0a60f0ad27f tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:37.933274 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-829183c1-5608-4bc4-bbbf-e0a60f0ad27f tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:37.948324 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-ced5c892-b8a8-46db-8582-08805654be9e tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Getting quotas for project a23348c10cb84b6194d31c299dd8394a. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:06:37.982630 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-ced5c892-b8a8-46db-8582-08805654be9e tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Getting quotas for user 09f1bd1c415841ee98182783de5ef3fe and project a23348c10cb84b6194d31c299dd8394a. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:06:38.035862 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-ced5c892-b8a8-46db-8582-08805654be9e tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Going to run 1 instances... {{(pid=128758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:06:38.040963 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-ced5c892-b8a8-46db-8582-08805654be9e tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] [instance: fb0ed293-ad31-4733-9318-c38b86e7bf45] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:06:38.167749 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-ced5c892-b8a8-46db-8582-08805654be9e tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.856623 Sep 14 09:06:38.174610 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2012/4005] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 09:06:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 2859 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:06:38.175274 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c7f1493c-0b51-4c4c-811b-577423e6ffc1 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:38.176066 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-c7f1493c-0b51-4c4c-811b-577423e6ffc1 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] [instance: ed6976ad-867b-4570-a547-758efc8f622f] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:38.184490 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c7f1493c-0b51-4c4c-811b-577423e6ffc1 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:38.185267 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c7f1493c-0b51-4c4c-811b-577423e6ffc1 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:38.185767 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c7f1493c-0b51-4c4c-811b-577423e6ffc1 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:38.186746 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c7f1493c-0b51-4c4c-811b-577423e6ffc1 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:38.187490 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c7f1493c-0b51-4c4c-811b-577423e6ffc1 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:38.188009 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c7f1493c-0b51-4c4c-811b-577423e6ffc1 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:38.268717 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-829183c1-5608-4bc4-bbbf-e0a60f0ad27f tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:06:38.279224 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-829183c1-5608-4bc4-bbbf-e0a60f0ad27f tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1511 microversion: 2.1 time: 0.422926 Sep 14 09:06:38.292811 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1994/4006] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:06:37 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1511 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:06:38.307057 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f7c568bf-9875-424b-9df5-1aff3f4085d4 tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:38.308003 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f7c568bf-9875-424b-9df5-1aff3f4085d4 tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] [instance: fb0ed293-ad31-4733-9318-c38b86e7bf45] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:38.406289 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f7c568bf-9875-424b-9df5-1aff3f4085d4 tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f1bd1c415841ee98182783de5ef3fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23348c10cb84b6194d31c299dd8394a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:06:38.415490 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f7c568bf-9875-424b-9df5-1aff3f4085d4 tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] 10.222.0.60 "GET /compute/v2.1/servers/fb0ed293-ad31-4733-9318-c38b86e7bf45" status: 200 len: 1214 microversion: 2.1 time: 0.114499 Sep 14 09:06:38.416085 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1995/4007] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:06:38 2022] GET /compute/v2.1/servers/fb0ed293-ad31-4733-9318-c38b86e7bf45 => generated 1214 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:06:38.728965 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-c7f1493c-0b51-4c4c-811b-577423e6ffc1 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5165b8fc101c47c7a4370f9007bc5a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a597fc389b4805bbd3a53ecd17c5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:06:38.738661 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-c7f1493c-0b51-4c4c-811b-577423e6ffc1 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute/v2.1/servers/ed6976ad-867b-4570-a547-758efc8f622f" status: 200 len: 1497 microversion: 2.1 time: 0.568514 Sep 14 09:06:38.739538 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2013/4008] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:06:38 2022] GET /compute/v2.1/servers/ed6976ad-867b-4570-a547-758efc8f622f => generated 1497 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:06:39.307618 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-860cc447-c82c-4103-b3cf-a0fc4c8c25fd tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:39.308250 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-860cc447-c82c-4103-b3cf-a0fc4c8c25fd tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:39.321395 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-860cc447-c82c-4103-b3cf-a0fc4c8c25fd tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:39.322700 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-860cc447-c82c-4103-b3cf-a0fc4c8c25fd tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:39.329278 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-860cc447-c82c-4103-b3cf-a0fc4c8c25fd tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:39.330642 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-860cc447-c82c-4103-b3cf-a0fc4c8c25fd tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:39.333097 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-860cc447-c82c-4103-b3cf-a0fc4c8c25fd tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:39.333731 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-860cc447-c82c-4103-b3cf-a0fc4c8c25fd tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:39.438424 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-f9823d4f-dfdc-4715-bdb9-f4c22422e63d tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:39.439767 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-f9823d4f-dfdc-4715-bdb9-f4c22422e63d tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] [instance: fb0ed293-ad31-4733-9318-c38b86e7bf45] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:39.460635 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f9823d4f-dfdc-4715-bdb9-f4c22422e63d tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:39.461183 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f9823d4f-dfdc-4715-bdb9-f4c22422e63d tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:39.461648 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f9823d4f-dfdc-4715-bdb9-f4c22422e63d tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:39.465271 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f9823d4f-dfdc-4715-bdb9-f4c22422e63d tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:39.465759 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f9823d4f-dfdc-4715-bdb9-f4c22422e63d tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:39.469257 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f9823d4f-dfdc-4715-bdb9-f4c22422e63d tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:39.722255 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-f9823d4f-dfdc-4715-bdb9-f4c22422e63d tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f1bd1c415841ee98182783de5ef3fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23348c10cb84b6194d31c299dd8394a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:06:39.727676 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:06:39.734206 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-f9823d4f-dfdc-4715-bdb9-f4c22422e63d tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] 10.222.0.60 "GET /compute/v2.1/servers/fb0ed293-ad31-4733-9318-c38b86e7bf45" status: 200 len: 1210 microversion: 2.1 time: 0.299693 Sep 14 09:06:39.738225 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2014/4009] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:06:39 2022] GET /compute/v2.1/servers/fb0ed293-ad31-4733-9318-c38b86e7bf45 => generated 1210 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:06:39.767440 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-5fc7a87f-6f91-4fef-a41d-da53e6be732c tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:39.770112 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-5fc7a87f-6f91-4fef-a41d-da53e6be732c tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] [instance: ed6976ad-867b-4570-a547-758efc8f622f] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:39.781778 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5fc7a87f-6f91-4fef-a41d-da53e6be732c tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:39.786570 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5fc7a87f-6f91-4fef-a41d-da53e6be732c tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:39.787215 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5fc7a87f-6f91-4fef-a41d-da53e6be732c tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:39.788755 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5fc7a87f-6f91-4fef-a41d-da53e6be732c tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:39.789469 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5fc7a87f-6f91-4fef-a41d-da53e6be732c tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:39.791474 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5fc7a87f-6f91-4fef-a41d-da53e6be732c tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:40.004520 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-860cc447-c82c-4103-b3cf-a0fc4c8c25fd tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:06:40.021529 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-860cc447-c82c-4103-b3cf-a0fc4c8c25fd tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1491 microversion: 2.1 time: 0.716361 Sep 14 09:06:40.035023 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1996/4010] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:06:39 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1491 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:06:40.054330 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d17e4029-8569-475c-9a59-e1a40d747972 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:06:40.054923 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-d17e4029-8569-475c-9a59-e1a40d747972 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:40.062230 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d17e4029-8569-475c-9a59-e1a40d747972 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:40.062731 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d17e4029-8569-475c-9a59-e1a40d747972 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:40.063221 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d17e4029-8569-475c-9a59-e1a40d747972 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:40.063931 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d17e4029-8569-475c-9a59-e1a40d747972 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:40.076395 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d17e4029-8569-475c-9a59-e1a40d747972 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:40.077239 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d17e4029-8569-475c-9a59-e1a40d747972 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:40.132709 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-d17e4029-8569-475c-9a59-e1a40d747972 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] HTTP exception thrown: Cannot 'pause' instance ae344b98-a354-4df8-83ba-3c5a786694f4 while it is in vm_state paused Sep 14 09:06:40.134393 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d17e4029-8569-475c-9a59-e1a40d747972 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Request method failure captured: Sep 14 09:06:40.134393 n-d-836830-18 devstack@n-api.service[128759]: request: POST /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4/action HTTP/1.1 Sep 14 09:06:40.134393 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:06:40.134393 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:06:40.134393 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:06:40.134393 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 13 Sep 14 09:06:40.134393 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:06:40.134393 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:06:40.134393 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:06:40.134393 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:06:40.134393 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZk2EvHIWQyXATvY4f6phbqF3DzIIyaJjJFCE11LxTKbrsndvuk5zoyyEUR0VXx32_kFjD0I6jBROuj0ZPSHQav7u9FFvOPFGrPkf9qZrgXY9k3zAUFrOVfwLECoLZOolubyCPUAGSEOi_HvFIP_Dd_DCbUCKDEGGLtdnAzy2tLCxHs Sep 14 09:06:40.134393 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:06:40.134393 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:06:40.134393 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:06:40.134393 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:06:40.134393 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:06:40.134393 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:06:40.134393 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 6907b82c9d5c4a23a63bbeec31c3c365 Sep 14 09:06:40.134393 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ServersNegativeTestJSON-1654813540 Sep 14 09:06:40.134393 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:06:40.134393 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:06:40.134393 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6907b82c9d5c4a23a63bbeec31c3c365"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6907b82c9d5c4a23a63bbeec31c3c365"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6907b82c9d5c4a23a63bbeec31c3c365"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6907b82c9d5c4a23a63bbeec31c3c365"}]}] Sep 14 09:06:40.134393 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ServersNegativeTestJSON-1654813540 Sep 14 09:06:40.134393 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 6907b82c9d5c4a23a63bbeec31c3c365 Sep 14 09:06:40.134393 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1654813540 Sep 14 09:06:40.134393 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ServersNegativeTestJSON-1654813540-project Sep 14 09:06:40.134393 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:06:40.134393 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:06:40.134393 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 79583c4e80a04f138927f09eb4e170f4 Sep 14 09:06:40.134393 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ServersNegativeTestJSON-1654813540-project Sep 14 09:06:40.134393 n-d-836830-18 devstack@n-api.service[128759]: Sep 14 09:06:40.134393 n-d-836830-18 devstack@n-api.service[128759]: {"pause": {}} Sep 14 09:06:40.134393 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:06:40.134393 n-d-836830-18 devstack@n-api.service[128759]: exception: Cannot 'pause' instance ae344b98-a354-4df8-83ba-3c5a786694f4 while it is in vm_state paused Sep 14 09:06:40.134393 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': 'ae344b98-a354-4df8-83ba-3c5a786694f4', 'body': {'pause': {}}} Sep 14 09:06:40.134393 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:06:40.134393 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:06:40.134393 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Sep 14 09:06:40.134393 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Sep 14 09:06:40.134393 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 14 09:06:40.134393 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 14 09:06:40.134393 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 14 09:06:40.134393 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 14 09:06:40.134393 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ae344b98-a354-4df8-83ba-3c5a786694f4 in vm_state paused. Cannot pause while the instance is in this state. Sep 14 09:06:40.134393 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:40.134393 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:06:40.134393 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:40.134393 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:06:40.134393 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:06:40.134393 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:06:40.134393 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:06:40.134393 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:06:40.134393 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:06:40.134393 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:06:40.134393 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Sep 14 09:06:40.134393 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 14 09:06:40.134393 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 14 09:06:40.134393 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 14 09:06:40.134393 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance ae344b98-a354-4df8-83ba-3c5a786694f4 while it is in vm_state paused Sep 14 09:06:40.134393 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:40.134393 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:06:40.134393 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:40.134393 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:06:40.134393 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:06:40.137898 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:06:40.137898 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:06:40.137898 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:06:40.137898 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance ae344b98-a354-4df8-83ba-3c5a786694f4 while it is in vm_state paused Sep 14 09:06:40.137898 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:40.142989 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d17e4029-8569-475c-9a59-e1a40d747972 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Returning 409 to user: Cannot 'pause' instance ae344b98-a354-4df8-83ba-3c5a786694f4 while it is in vm_state paused {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:06:40.144062 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d17e4029-8569-475c-9a59-e1a40d747972 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "POST /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4/action" status: 409 len: 143 microversion: 2.1 time: 0.094530 Sep 14 09:06:40.146760 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1997/4011] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:06:40 2022] POST /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4/action => generated 143 bytes in 98 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Sep 14 09:06:40.153760 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-667704ce-af12-493a-8b37-75f13682fb7c tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:06:40.154473 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-667704ce-af12-493a-8b37-75f13682fb7c tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:40.172453 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-667704ce-af12-493a-8b37-75f13682fb7c tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:40.173446 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-667704ce-af12-493a-8b37-75f13682fb7c tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:40.173904 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-667704ce-af12-493a-8b37-75f13682fb7c tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:40.174627 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-667704ce-af12-493a-8b37-75f13682fb7c tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:40.175119 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-667704ce-af12-493a-8b37-75f13682fb7c tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:40.175549 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-667704ce-af12-493a-8b37-75f13682fb7c tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:40.284056 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-667704ce-af12-493a-8b37-75f13682fb7c tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "POST /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4/action" status: 202 len: 0 microversion: 2.1 time: 0.133773 Sep 14 09:06:40.285587 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1998/4012] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:06:40 2022] POST /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4/action => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:06:40.301395 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-769b30bb-2300-445c-b743-e7efd23071d2 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:40.304555 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-769b30bb-2300-445c-b743-e7efd23071d2 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:40.310966 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-5fc7a87f-6f91-4fef-a41d-da53e6be732c tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5165b8fc101c47c7a4370f9007bc5a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a597fc389b4805bbd3a53ecd17c5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:06:40.324428 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-5fc7a87f-6f91-4fef-a41d-da53e6be732c tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute/v2.1/servers/ed6976ad-867b-4570-a547-758efc8f622f" status: 200 len: 1497 microversion: 2.1 time: 0.559801 Sep 14 09:06:40.325093 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-769b30bb-2300-445c-b743-e7efd23071d2 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:40.325602 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-769b30bb-2300-445c-b743-e7efd23071d2 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:40.326348 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2015/4013] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:06:39 2022] GET /compute/v2.1/servers/ed6976ad-867b-4570-a547-758efc8f622f => generated 1497 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:06:40.329307 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-769b30bb-2300-445c-b743-e7efd23071d2 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:40.330321 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-769b30bb-2300-445c-b743-e7efd23071d2 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:40.330802 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-769b30bb-2300-445c-b743-e7efd23071d2 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:40.331690 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-769b30bb-2300-445c-b743-e7efd23071d2 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:40.762412 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-507f49bd-51e2-4c25-848e-1776121b7c7b tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:40.765595 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-507f49bd-51e2-4c25-848e-1776121b7c7b tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] [instance: fb0ed293-ad31-4733-9318-c38b86e7bf45] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:40.770557 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-507f49bd-51e2-4c25-848e-1776121b7c7b tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:40.779886 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-507f49bd-51e2-4c25-848e-1776121b7c7b tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:40.783605 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-507f49bd-51e2-4c25-848e-1776121b7c7b tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:40.785609 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-507f49bd-51e2-4c25-848e-1776121b7c7b tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:40.787033 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-507f49bd-51e2-4c25-848e-1776121b7c7b tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:40.788336 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-507f49bd-51e2-4c25-848e-1776121b7c7b tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:41.086396 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-507f49bd-51e2-4c25-848e-1776121b7c7b tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f1bd1c415841ee98182783de5ef3fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23348c10cb84b6194d31c299dd8394a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:06:41.105970 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-507f49bd-51e2-4c25-848e-1776121b7c7b tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] 10.222.0.60 "GET /compute/v2.1/servers/fb0ed293-ad31-4733-9318-c38b86e7bf45" status: 200 len: 1272 microversion: 2.1 time: 0.346969 Sep 14 09:06:41.127166 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2016/4014] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:06:40 2022] GET /compute/v2.1/servers/fb0ed293-ad31-4733-9318-c38b86e7bf45 => generated 1272 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:06:41.151121 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-769b30bb-2300-445c-b743-e7efd23071d2 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:06:41.161563 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-769b30bb-2300-445c-b743-e7efd23071d2 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1498 microversion: 2.1 time: 0.871129 Sep 14 09:06:41.184433 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 1999/4015] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:06:40 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1498 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:06:41.352146 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-755635bb-5cc7-4f89-8003-719f36b3bc28 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:41.352772 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-755635bb-5cc7-4f89-8003-719f36b3bc28 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] [instance: ed6976ad-867b-4570-a547-758efc8f622f] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:41.367199 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-755635bb-5cc7-4f89-8003-719f36b3bc28 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:41.367699 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-755635bb-5cc7-4f89-8003-719f36b3bc28 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:41.368137 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-755635bb-5cc7-4f89-8003-719f36b3bc28 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:41.377769 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-755635bb-5cc7-4f89-8003-719f36b3bc28 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:41.378273 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-755635bb-5cc7-4f89-8003-719f36b3bc28 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:41.378717 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-755635bb-5cc7-4f89-8003-719f36b3bc28 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:42.135184 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-05f6113a-30b6-48fc-8aa2-5efb118c2741 tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:42.135822 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-05f6113a-30b6-48fc-8aa2-5efb118c2741 tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] [instance: fb0ed293-ad31-4733-9318-c38b86e7bf45] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:42.152690 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-05f6113a-30b6-48fc-8aa2-5efb118c2741 tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:42.153201 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-05f6113a-30b6-48fc-8aa2-5efb118c2741 tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:42.153640 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-05f6113a-30b6-48fc-8aa2-5efb118c2741 tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:42.156940 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-05f6113a-30b6-48fc-8aa2-5efb118c2741 tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:42.159190 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-05f6113a-30b6-48fc-8aa2-5efb118c2741 tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:42.159805 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-05f6113a-30b6-48fc-8aa2-5efb118c2741 tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:42.311167 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-755635bb-5cc7-4f89-8003-719f36b3bc28 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5165b8fc101c47c7a4370f9007bc5a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a597fc389b4805bbd3a53ecd17c5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:06:42.320085 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-755635bb-5cc7-4f89-8003-719f36b3bc28 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute/v2.1/servers/ed6976ad-867b-4570-a547-758efc8f622f" status: 200 len: 1497 microversion: 2.1 time: 0.972631 Sep 14 09:06:42.320696 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2017/4016] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:06:41 2022] GET /compute/v2.1/servers/ed6976ad-867b-4570-a547-758efc8f622f => generated 1497 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:06:42.335697 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d3616d76-22ec-4432-8d91-0725ed49cc45 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:42.336557 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-d3616d76-22ec-4432-8d91-0725ed49cc45 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:42.350628 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d3616d76-22ec-4432-8d91-0725ed49cc45 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:42.355883 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d3616d76-22ec-4432-8d91-0725ed49cc45 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:42.359675 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d3616d76-22ec-4432-8d91-0725ed49cc45 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:42.360667 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d3616d76-22ec-4432-8d91-0725ed49cc45 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:42.361306 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d3616d76-22ec-4432-8d91-0725ed49cc45 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:42.361893 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d3616d76-22ec-4432-8d91-0725ed49cc45 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:42.642055 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-05f6113a-30b6-48fc-8aa2-5efb118c2741 tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f1bd1c415841ee98182783de5ef3fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23348c10cb84b6194d31c299dd8394a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:06:42.651904 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-05f6113a-30b6-48fc-8aa2-5efb118c2741 tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] 10.222.0.60 "GET /compute/v2.1/servers/fb0ed293-ad31-4733-9318-c38b86e7bf45" status: 200 len: 1314 microversion: 2.1 time: 0.522033 Sep 14 09:06:42.672040 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2000/4017] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:06:42 2022] GET /compute/v2.1/servers/fb0ed293-ad31-4733-9318-c38b86e7bf45 => generated 1314 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:06:43.011402 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-d3616d76-22ec-4432-8d91-0725ed49cc45 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:06:43.021247 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-d3616d76-22ec-4432-8d91-0725ed49cc45 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1506 microversion: 2.1 time: 0.689953 Sep 14 09:06:43.023409 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2018/4018] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:06:42 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1506 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:06:43.055728 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ce674df8-b66d-4992-aad6-119cd9e0147c tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:43.056741 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-ce674df8-b66d-4992-aad6-119cd9e0147c tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:43.067099 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ce674df8-b66d-4992-aad6-119cd9e0147c tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:43.067996 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ce674df8-b66d-4992-aad6-119cd9e0147c tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:43.068657 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ce674df8-b66d-4992-aad6-119cd9e0147c tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:43.072632 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ce674df8-b66d-4992-aad6-119cd9e0147c tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:43.073454 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ce674df8-b66d-4992-aad6-119cd9e0147c tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:43.074350 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ce674df8-b66d-4992-aad6-119cd9e0147c tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:43.346128 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-dcb914d8-b6a3-4794-9f5f-41553850b523 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:43.346865 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-dcb914d8-b6a3-4794-9f5f-41553850b523 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] [instance: ed6976ad-867b-4570-a547-758efc8f622f] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:43.357536 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dcb914d8-b6a3-4794-9f5f-41553850b523 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:43.371635 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dcb914d8-b6a3-4794-9f5f-41553850b523 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:43.372512 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dcb914d8-b6a3-4794-9f5f-41553850b523 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:43.373514 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dcb914d8-b6a3-4794-9f5f-41553850b523 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:43.374197 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dcb914d8-b6a3-4794-9f5f-41553850b523 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:43.374838 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dcb914d8-b6a3-4794-9f5f-41553850b523 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:44.141407 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-dcb914d8-b6a3-4794-9f5f-41553850b523 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5165b8fc101c47c7a4370f9007bc5a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a597fc389b4805bbd3a53ecd17c5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:06:44.152297 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-ce674df8-b66d-4992-aad6-119cd9e0147c tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:06:44.158229 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-dcb914d8-b6a3-4794-9f5f-41553850b523 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute/v2.1/servers/ed6976ad-867b-4570-a547-758efc8f622f" status: 200 len: 1497 microversion: 2.1 time: 0.818384 Sep 14 09:06:44.158842 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2019/4019] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:06:43 2022] GET /compute/v2.1/servers/ed6976ad-867b-4570-a547-758efc8f622f => generated 1497 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:06:44.177329 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-90ec1f62-27b7-42a0-af32-d63dc354de92 tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:44.178374 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-90ec1f62-27b7-42a0-af32-d63dc354de92 tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] [instance: fb0ed293-ad31-4733-9318-c38b86e7bf45] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:44.179575 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-ce674df8-b66d-4992-aad6-119cd9e0147c tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1506 microversion: 2.1 time: 1.128366 Sep 14 09:06:44.180412 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2001/4020] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:06:43 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1506 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:06:44.204855 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-920d0428-4c12-4e35-9add-2a79297db629 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:06:44.207495 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-920d0428-4c12-4e35-9add-2a79297db629 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: 8e670908-5bb6-49ad-92f3-dad1b4df1b5a] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:44.208841 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-90ec1f62-27b7-42a0-af32-d63dc354de92 tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:44.212264 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-90ec1f62-27b7-42a0-af32-d63dc354de92 tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:44.213512 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-90ec1f62-27b7-42a0-af32-d63dc354de92 tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:44.215838 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-920d0428-4c12-4e35-9add-2a79297db629 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:44.215974 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-90ec1f62-27b7-42a0-af32-d63dc354de92 tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:44.216819 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-90ec1f62-27b7-42a0-af32-d63dc354de92 tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:44.217993 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-90ec1f62-27b7-42a0-af32-d63dc354de92 tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:44.219909 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-920d0428-4c12-4e35-9add-2a79297db629 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:44.220373 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-920d0428-4c12-4e35-9add-2a79297db629 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:44.221164 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-920d0428-4c12-4e35-9add-2a79297db629 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:44.221640 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-920d0428-4c12-4e35-9add-2a79297db629 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:44.222102 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-920d0428-4c12-4e35-9add-2a79297db629 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:44.270348 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-920d0428-4c12-4e35-9add-2a79297db629 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] HTTP exception thrown: Instance 8e670908-5bb6-49ad-92f3-dad1b4df1b5a could not be found. Sep 14 09:06:44.279954 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-920d0428-4c12-4e35-9add-2a79297db629 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Request method failure captured: Sep 14 09:06:44.279954 n-d-836830-18 devstack@n-api.service[128759]: request: POST /compute/v2.1/servers/8e670908-5bb6-49ad-92f3-dad1b4df1b5a/action HTTP/1.1 Sep 14 09:06:44.279954 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:06:44.279954 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:06:44.279954 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:06:44.279954 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 28 Sep 14 09:06:44.279954 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:06:44.279954 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:06:44.279954 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:06:44.279954 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:06:44.279954 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZk2EvHIWQyXATvY4f6phbqF3DzIIyaJjJFCE11LxTKbrsndvuk5zoyyEUR0VXx32_kFjD0I6jBROuj0ZPSHQav7u9FFvOPFGrPkf9qZrgXY9k3zAUFrOVfwLECoLZOolubyCPUAGSEOi_HvFIP_Dd_DCbUCKDEGGLtdnAzy2tLCxHs Sep 14 09:06:44.279954 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:06:44.279954 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:06:44.279954 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:06:44.279954 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:06:44.279954 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:06:44.279954 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:06:44.279954 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 6907b82c9d5c4a23a63bbeec31c3c365 Sep 14 09:06:44.279954 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ServersNegativeTestJSON-1654813540 Sep 14 09:06:44.279954 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:06:44.279954 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:06:44.279954 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6907b82c9d5c4a23a63bbeec31c3c365"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6907b82c9d5c4a23a63bbeec31c3c365"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6907b82c9d5c4a23a63bbeec31c3c365"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6907b82c9d5c4a23a63bbeec31c3c365"}]}] Sep 14 09:06:44.279954 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ServersNegativeTestJSON-1654813540 Sep 14 09:06:44.279954 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 6907b82c9d5c4a23a63bbeec31c3c365 Sep 14 09:06:44.279954 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1654813540 Sep 14 09:06:44.279954 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ServersNegativeTestJSON-1654813540-project Sep 14 09:06:44.279954 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:06:44.279954 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:06:44.279954 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 79583c4e80a04f138927f09eb4e170f4 Sep 14 09:06:44.279954 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ServersNegativeTestJSON-1654813540-project Sep 14 09:06:44.279954 n-d-836830-18 devstack@n-api.service[128759]: Sep 14 09:06:44.279954 n-d-836830-18 devstack@n-api.service[128759]: {"reboot": {"type": "SOFT"}} Sep 14 09:06:44.279954 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:06:44.279954 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance 8e670908-5bb6-49ad-92f3-dad1b4df1b5a could not be found. Sep 14 09:06:44.279954 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '8e670908-5bb6-49ad-92f3-dad1b4df1b5a', 'body': {'reboot': {'type': 'SOFT'}}} Sep 14 09:06:44.279954 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:06:44.279954 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:06:44.279954 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:06:44.279954 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:06:44.279954 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:06:44.279954 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:06:44.279954 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:06:44.279954 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:06:44.279954 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:06:44.279954 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:06:44.279954 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e670908-5bb6-49ad-92f3-dad1b4df1b5a could not be found. Sep 14 09:06:44.279954 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:44.279954 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:06:44.279954 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:44.279954 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:06:44.279954 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:06:44.279954 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:06:44.279954 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:06:44.279954 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:06:44.279954 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:06:44.279954 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:06:44.279954 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:06:44.279954 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:06:44.279954 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Sep 14 09:06:44.279954 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 14 09:06:44.279954 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:06:44.279954 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:06:44.279954 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:06:44.279954 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:06:44.284577 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e670908-5bb6-49ad-92f3-dad1b4df1b5a could not be found. Sep 14 09:06:44.284577 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:44.284577 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:06:44.284577 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:44.284577 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:06:44.284577 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:06:44.284577 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:06:44.284577 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:06:44.284577 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:06:44.284577 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e670908-5bb6-49ad-92f3-dad1b4df1b5a could not be found. Sep 14 09:06:44.284577 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:44.288933 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-920d0428-4c12-4e35-9add-2a79297db629 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Returning 404 to user: Instance 8e670908-5bb6-49ad-92f3-dad1b4df1b5a could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:06:44.293518 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-920d0428-4c12-4e35-9add-2a79297db629 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "POST /compute/v2.1/servers/8e670908-5bb6-49ad-92f3-dad1b4df1b5a/action" status: 404 len: 111 microversion: 2.1 time: 0.089819 Sep 14 09:06:44.296004 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2002/4021] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:06:44 2022] POST /compute/v2.1/servers/8e670908-5bb6-49ad-92f3-dad1b4df1b5a/action => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:06:44.306306 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b9fbf2e7-e6e6-41f9-980e-05bf666ea814 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:44.308558 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b9fbf2e7-e6e6-41f9-980e-05bf666ea814 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:44.317396 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b9fbf2e7-e6e6-41f9-980e-05bf666ea814 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:44.318250 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b9fbf2e7-e6e6-41f9-980e-05bf666ea814 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:44.319549 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b9fbf2e7-e6e6-41f9-980e-05bf666ea814 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:44.320579 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b9fbf2e7-e6e6-41f9-980e-05bf666ea814 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:44.321220 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b9fbf2e7-e6e6-41f9-980e-05bf666ea814 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:44.322028 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b9fbf2e7-e6e6-41f9-980e-05bf666ea814 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:44.860464 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-90ec1f62-27b7-42a0-af32-d63dc354de92 tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f1bd1c415841ee98182783de5ef3fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23348c10cb84b6194d31c299dd8394a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:06:44.869329 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-90ec1f62-27b7-42a0-af32-d63dc354de92 tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] 10.222.0.60 "GET /compute/v2.1/servers/fb0ed293-ad31-4733-9318-c38b86e7bf45" status: 200 len: 1314 microversion: 2.1 time: 0.709229 Sep 14 09:06:44.879790 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2020/4022] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:06:44 2022] GET /compute/v2.1/servers/fb0ed293-ad31-4733-9318-c38b86e7bf45 => generated 1314 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:06:45.117654 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b9fbf2e7-e6e6-41f9-980e-05bf666ea814 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:06:45.146596 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b9fbf2e7-e6e6-41f9-980e-05bf666ea814 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1506 microversion: 2.1 time: 0.846621 Sep 14 09:06:45.150749 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2003/4023] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:06:44 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1506 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:06:45.175629 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-f10e5669-cc38-4a16-aa1e-ccd4f5e883be tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:45.176246 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-f10e5669-cc38-4a16-aa1e-ccd4f5e883be tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:45.183292 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f10e5669-cc38-4a16-aa1e-ccd4f5e883be tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:45.183767 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f10e5669-cc38-4a16-aa1e-ccd4f5e883be tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:45.184203 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f10e5669-cc38-4a16-aa1e-ccd4f5e883be tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:45.184908 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f10e5669-cc38-4a16-aa1e-ccd4f5e883be tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:45.185409 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f10e5669-cc38-4a16-aa1e-ccd4f5e883be tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:45.186485 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-20c512b7-9331-4c5a-9262-2132756fb3bc tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:45.187167 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-20c512b7-9331-4c5a-9262-2132756fb3bc tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] [instance: ed6976ad-867b-4570-a547-758efc8f622f] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:45.187703 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f10e5669-cc38-4a16-aa1e-ccd4f5e883be tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:45.201874 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-20c512b7-9331-4c5a-9262-2132756fb3bc tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:45.202456 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-20c512b7-9331-4c5a-9262-2132756fb3bc tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:45.203047 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-20c512b7-9331-4c5a-9262-2132756fb3bc tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:45.205514 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-20c512b7-9331-4c5a-9262-2132756fb3bc tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:45.206002 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-20c512b7-9331-4c5a-9262-2132756fb3bc tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:45.206460 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-20c512b7-9331-4c5a-9262-2132756fb3bc tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:45.826859 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-20c512b7-9331-4c5a-9262-2132756fb3bc tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5165b8fc101c47c7a4370f9007bc5a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a597fc389b4805bbd3a53ecd17c5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:06:45.860353 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-20c512b7-9331-4c5a-9262-2132756fb3bc tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute/v2.1/servers/ed6976ad-867b-4570-a547-758efc8f622f" status: 200 len: 1497 microversion: 2.1 time: 0.678918 Sep 14 09:06:45.861594 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2004/4024] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:06:45 2022] GET /compute/v2.1/servers/ed6976ad-867b-4570-a547-758efc8f622f => generated 1497 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:06:45.866739 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-f10e5669-cc38-4a16-aa1e-ccd4f5e883be tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:06:45.876345 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-22786993-d7ba-48ce-b487-95e30021559d req-84cceb1d-6519-4c02-a1cb-85401df8a6f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb0ed293-ad31-4733-9318-c38b86e7bf45", "tag": "0a885251-2109-4da9-bd76-0d3a214c2087"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:06:45.894961 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-f10e5669-cc38-4a16-aa1e-ccd4f5e883be tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1506 microversion: 2.1 time: 0.722871 Sep 14 09:06:45.896238 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2021/4025] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:06:45 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1506 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:06:45.904140 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-22786993-d7ba-48ce-b487-95e30021559d req-84cceb1d-6519-4c02-a1cb-85401df8a6f3 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:45.904644 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-22786993-d7ba-48ce-b487-95e30021559d req-84cceb1d-6519-4c02-a1cb-85401df8a6f3 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:45.905380 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-22786993-d7ba-48ce-b487-95e30021559d req-84cceb1d-6519-4c02-a1cb-85401df8a6f3 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:45.907534 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-72d372f2-5372-47d3-a3c5-ac46c2232ee8 tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:45.910831 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-72d372f2-5372-47d3-a3c5-ac46c2232ee8 tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] [instance: fb0ed293-ad31-4733-9318-c38b86e7bf45] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:45.919248 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-22786993-d7ba-48ce-b487-95e30021559d req-84cceb1d-6519-4c02-a1cb-85401df8a6f3 service nova] Creating event network-changed:0a885251-2109-4da9-bd76-0d3a214c2087 for instance fb0ed293-ad31-4733-9318-c38b86e7bf45 on n-h2-836830-18 Sep 14 09:06:45.926845 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-22786993-d7ba-48ce-b487-95e30021559d req-84cceb1d-6519-4c02-a1cb-85401df8a6f3 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063959 Sep 14 09:06:45.927594 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2005/4026] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:06:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:06:45.929726 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-72d372f2-5372-47d3-a3c5-ac46c2232ee8 tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:45.932507 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-72d372f2-5372-47d3-a3c5-ac46c2232ee8 tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:45.937611 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-72d372f2-5372-47d3-a3c5-ac46c2232ee8 tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:45.939322 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-72d372f2-5372-47d3-a3c5-ac46c2232ee8 tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:45.939991 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-72d372f2-5372-47d3-a3c5-ac46c2232ee8 tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:45.941413 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-580c9b13-860c-49c1-be10-51dc003cc988 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:06:45.942034 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-72d372f2-5372-47d3-a3c5-ac46c2232ee8 tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:45.949495 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-580c9b13-860c-49c1-be10-51dc003cc988 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: d4e48003-835b-4199-ab3f-c6673cd87244] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:45.963727 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-580c9b13-860c-49c1-be10-51dc003cc988 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] HTTP exception thrown: Instance d4e48003-835b-4199-ab3f-c6673cd87244 could not be found. Sep 14 09:06:45.967505 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-580c9b13-860c-49c1-be10-51dc003cc988 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Request method failure captured: Sep 14 09:06:45.967505 n-d-836830-18 devstack@n-api.service[128759]: request: POST /compute/v2.1/servers/d4e48003-835b-4199-ab3f-c6673cd87244/action HTTP/1.1 Sep 14 09:06:45.967505 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:06:45.967505 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:06:45.967505 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:06:45.967505 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 28 Sep 14 09:06:45.967505 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:06:45.967505 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:06:45.967505 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:06:45.967505 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:06:45.967505 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZk2EvHIWQyXATvY4f6phbqF3DzIIyaJjJFCE11LxTKbrsndvuk5zoyyEUR0VXx32_kFjD0I6jBROuj0ZPSHQav7u9FFvOPFGrPkf9qZrgXY9k3zAUFrOVfwLECoLZOolubyCPUAGSEOi_HvFIP_Dd_DCbUCKDEGGLtdnAzy2tLCxHs Sep 14 09:06:45.967505 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:06:45.967505 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:06:45.967505 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:06:45.967505 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:06:45.967505 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:06:45.967505 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:06:45.967505 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 6907b82c9d5c4a23a63bbeec31c3c365 Sep 14 09:06:45.967505 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ServersNegativeTestJSON-1654813540 Sep 14 09:06:45.967505 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:06:45.967505 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:06:45.967505 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6907b82c9d5c4a23a63bbeec31c3c365"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6907b82c9d5c4a23a63bbeec31c3c365"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6907b82c9d5c4a23a63bbeec31c3c365"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6907b82c9d5c4a23a63bbeec31c3c365"}]}] Sep 14 09:06:45.967505 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ServersNegativeTestJSON-1654813540 Sep 14 09:06:45.967505 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 6907b82c9d5c4a23a63bbeec31c3c365 Sep 14 09:06:45.967505 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1654813540 Sep 14 09:06:45.967505 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ServersNegativeTestJSON-1654813540-project Sep 14 09:06:45.967505 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:06:45.967505 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:06:45.967505 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 79583c4e80a04f138927f09eb4e170f4 Sep 14 09:06:45.967505 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ServersNegativeTestJSON-1654813540-project Sep 14 09:06:45.967505 n-d-836830-18 devstack@n-api.service[128759]: Sep 14 09:06:45.967505 n-d-836830-18 devstack@n-api.service[128759]: {"reboot": {"type": "SOFT"}} Sep 14 09:06:45.967505 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:06:45.967505 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance d4e48003-835b-4199-ab3f-c6673cd87244 could not be found. Sep 14 09:06:45.967505 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': 'd4e48003-835b-4199-ab3f-c6673cd87244', 'body': {'reboot': {'type': 'SOFT'}}} Sep 14 09:06:45.967505 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:06:45.967505 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:06:45.967505 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:06:45.967505 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:06:45.967505 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:06:45.967505 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:06:45.967505 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 14 09:06:45.967505 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 14 09:06:45.967505 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4e48003-835b-4199-ab3f-c6673cd87244 could not be found. Sep 14 09:06:45.967505 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:45.967505 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:06:45.967505 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:45.967505 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:06:45.967505 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:06:45.967505 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:06:45.967505 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:06:45.967505 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:06:45.967505 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:06:45.967505 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:06:45.967505 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:06:45.967505 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:06:45.967505 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Sep 14 09:06:45.967505 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 14 09:06:45.967505 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:06:45.967505 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:06:45.967505 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:06:45.967505 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:06:45.967505 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4e48003-835b-4199-ab3f-c6673cd87244 could not be found. Sep 14 09:06:45.967505 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:45.971473 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:06:45.971473 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:45.971473 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:06:45.971473 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:06:45.971473 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:06:45.971473 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:06:45.971473 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:06:45.971473 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4e48003-835b-4199-ab3f-c6673cd87244 could not be found. Sep 14 09:06:45.971473 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:45.971473 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-580c9b13-860c-49c1-be10-51dc003cc988 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Returning 404 to user: Instance d4e48003-835b-4199-ab3f-c6673cd87244 could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:06:45.971473 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-580c9b13-860c-49c1-be10-51dc003cc988 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "POST /compute/v2.1/servers/d4e48003-835b-4199-ab3f-c6673cd87244/action" status: 404 len: 111 microversion: 2.1 time: 0.039407 Sep 14 09:06:45.972884 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2006/4027] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:06:45 2022] POST /compute/v2.1/servers/d4e48003-835b-4199-ab3f-c6673cd87244/action => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:06:45.986036 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d3f34cb8-abbf-472b-81dd-e52ae71922c7 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:45.988597 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-d3f34cb8-abbf-472b-81dd-e52ae71922c7 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:46.002467 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d3f34cb8-abbf-472b-81dd-e52ae71922c7 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:46.008009 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d3f34cb8-abbf-472b-81dd-e52ae71922c7 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:46.008742 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d3f34cb8-abbf-472b-81dd-e52ae71922c7 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:46.011730 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d3f34cb8-abbf-472b-81dd-e52ae71922c7 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:46.012421 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d3f34cb8-abbf-472b-81dd-e52ae71922c7 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:46.019881 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d3f34cb8-abbf-472b-81dd-e52ae71922c7 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:46.316462 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-d3f34cb8-abbf-472b-81dd-e52ae71922c7 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:06:46.328014 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d3f34cb8-abbf-472b-81dd-e52ae71922c7 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1506 microversion: 2.1 time: 0.353797 Sep 14 09:06:46.329785 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2007/4028] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:06:45 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1506 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:06:46.357120 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-5e6e164a-12f6-4a07-afe8-4ec3a416a281 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:46.357990 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-5e6e164a-12f6-4a07-afe8-4ec3a416a281 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:46.370727 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5e6e164a-12f6-4a07-afe8-4ec3a416a281 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:46.371285 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5e6e164a-12f6-4a07-afe8-4ec3a416a281 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:46.371742 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5e6e164a-12f6-4a07-afe8-4ec3a416a281 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:46.372478 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5e6e164a-12f6-4a07-afe8-4ec3a416a281 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:46.372950 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5e6e164a-12f6-4a07-afe8-4ec3a416a281 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:46.373389 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5e6e164a-12f6-4a07-afe8-4ec3a416a281 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:46.549868 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-72d372f2-5372-47d3-a3c5-ac46c2232ee8 tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f1bd1c415841ee98182783de5ef3fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23348c10cb84b6194d31c299dd8394a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:06:46.558804 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-72d372f2-5372-47d3-a3c5-ac46c2232ee8 tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] 10.222.0.60 "GET /compute/v2.1/servers/fb0ed293-ad31-4733-9318-c38b86e7bf45" status: 200 len: 1314 microversion: 2.1 time: 0.659827 Sep 14 09:06:46.570266 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2022/4029] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:06:45 2022] GET /compute/v2.1/servers/fb0ed293-ad31-4733-9318-c38b86e7bf45 => generated 1314 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:06:46.801678 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-5e6e164a-12f6-4a07-afe8-4ec3a416a281 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:06:46.814539 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-5e6e164a-12f6-4a07-afe8-4ec3a416a281 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1506 microversion: 2.1 time: 0.463245 Sep 14 09:06:46.815768 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2008/4030] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:06:46 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1506 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:06:46.845647 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-85ff96b4-72a1-4025-bbc7-ad67f8823e9f tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:06:46.848840 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-85ff96b4-72a1-4025-bbc7-ad67f8823e9f tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: 8e670908-5bb6-49ad-92f3-dad1b4df1b5a] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:46.862236 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-85ff96b4-72a1-4025-bbc7-ad67f8823e9f tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:46.867807 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-85ff96b4-72a1-4025-bbc7-ad67f8823e9f tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:46.868986 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-85ff96b4-72a1-4025-bbc7-ad67f8823e9f tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:46.869948 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-85ff96b4-72a1-4025-bbc7-ad67f8823e9f tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:46.870624 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-85ff96b4-72a1-4025-bbc7-ad67f8823e9f tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:46.871310 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-85ff96b4-72a1-4025-bbc7-ad67f8823e9f tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:46.884802 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-5644fcd5-3630-4b17-a7ce-bccff82ce888 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:46.885673 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-5644fcd5-3630-4b17-a7ce-bccff82ce888 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] [instance: ed6976ad-867b-4570-a547-758efc8f622f] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:46.904580 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5644fcd5-3630-4b17-a7ce-bccff82ce888 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:46.905467 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5644fcd5-3630-4b17-a7ce-bccff82ce888 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:46.906123 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5644fcd5-3630-4b17-a7ce-bccff82ce888 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:46.911209 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5644fcd5-3630-4b17-a7ce-bccff82ce888 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:46.913703 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5644fcd5-3630-4b17-a7ce-bccff82ce888 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:46.914416 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5644fcd5-3630-4b17-a7ce-bccff82ce888 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:46.939608 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-85ff96b4-72a1-4025-bbc7-ad67f8823e9f tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] HTTP exception thrown: Instance 8e670908-5bb6-49ad-92f3-dad1b4df1b5a could not be found. Sep 14 09:06:46.947266 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-85ff96b4-72a1-4025-bbc7-ad67f8823e9f tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Request method failure captured: Sep 14 09:06:46.947266 n-d-836830-18 devstack@n-api.service[128758]: request: POST /compute/v2.1/servers/8e670908-5bb6-49ad-92f3-dad1b4df1b5a/action HTTP/1.1 Sep 14 09:06:46.947266 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 09:06:46.947266 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 09:06:46.947266 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 09:06:46.947266 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 65 Sep 14 09:06:46.947266 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 09:06:46.947266 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 09:06:46.947266 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 09:06:46.947266 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 09:06:46.947266 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZk2EvHIWQyXATvY4f6phbqF3DzIIyaJjJFCE11LxTKbrsndvuk5zoyyEUR0VXx32_kFjD0I6jBROuj0ZPSHQav7u9FFvOPFGrPkf9qZrgXY9k3zAUFrOVfwLECoLZOolubyCPUAGSEOi_HvFIP_Dd_DCbUCKDEGGLtdnAzy2tLCxHs Sep 14 09:06:46.947266 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 09:06:46.947266 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 09:06:46.947266 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 09:06:46.947266 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 09:06:46.947266 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 09:06:46.947266 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 09:06:46.947266 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 6907b82c9d5c4a23a63bbeec31c3c365 Sep 14 09:06:46.947266 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-ServersNegativeTestJSON-1654813540 Sep 14 09:06:46.947266 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 09:06:46.947266 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 09:06:46.947266 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6907b82c9d5c4a23a63bbeec31c3c365"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6907b82c9d5c4a23a63bbeec31c3c365"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6907b82c9d5c4a23a63bbeec31c3c365"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6907b82c9d5c4a23a63bbeec31c3c365"}]}] Sep 14 09:06:46.947266 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-ServersNegativeTestJSON-1654813540 Sep 14 09:06:46.947266 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 6907b82c9d5c4a23a63bbeec31c3c365 Sep 14 09:06:46.947266 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1654813540 Sep 14 09:06:46.947266 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-ServersNegativeTestJSON-1654813540-project Sep 14 09:06:46.947266 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 09:06:46.947266 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 09:06:46.947266 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 79583c4e80a04f138927f09eb4e170f4 Sep 14 09:06:46.947266 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-ServersNegativeTestJSON-1654813540-project Sep 14 09:06:46.947266 n-d-836830-18 devstack@n-api.service[128758]: Sep 14 09:06:46.947266 n-d-836830-18 devstack@n-api.service[128758]: {"rebuild": {"imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9"}} Sep 14 09:06:46.947266 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 09:06:46.947266 n-d-836830-18 devstack@n-api.service[128758]: exception: Instance 8e670908-5bb6-49ad-92f3-dad1b4df1b5a could not be found. Sep 14 09:06:46.947266 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': '8e670908-5bb6-49ad-92f3-dad1b4df1b5a', 'body': {'rebuild': {'imageRef': 'bff4ab7f-4846-441f-8940-d96fec4c28e9'}}} Sep 14 09:06:46.947266 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:06:46.947266 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:06:46.947266 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:06:46.947266 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:06:46.947266 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:06:46.947266 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:06:46.947266 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:06:46.947266 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:06:46.947266 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:06:46.947266 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:06:46.947266 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e670908-5bb6-49ad-92f3-dad1b4df1b5a could not be found. Sep 14 09:06:46.947266 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:06:46.947266 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:06:46.947266 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:06:46.947266 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:06:46.947266 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:06:46.947266 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:06:46.947266 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:06:46.947266 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:06:46.947266 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:06:46.947266 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:06:46.947266 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:06:46.947266 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:06:46.947266 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:06:46.947266 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:06:46.947266 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:06:46.947266 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:06:46.947266 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Sep 14 09:06:46.947266 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Sep 14 09:06:46.950805 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 14 09:06:46.950805 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:06:46.950805 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:06:46.950805 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:06:46.950805 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:06:46.950805 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e670908-5bb6-49ad-92f3-dad1b4df1b5a could not be found. Sep 14 09:06:46.950805 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:06:46.950805 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:06:46.950805 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:06:46.950805 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:06:46.950805 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:06:46.950805 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:06:46.950805 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:06:46.950805 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:06:46.950805 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e670908-5bb6-49ad-92f3-dad1b4df1b5a could not be found. Sep 14 09:06:46.950805 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:06:46.956439 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-85ff96b4-72a1-4025-bbc7-ad67f8823e9f tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Returning 404 to user: Instance 8e670908-5bb6-49ad-92f3-dad1b4df1b5a could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:06:46.957904 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-85ff96b4-72a1-4025-bbc7-ad67f8823e9f tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "POST /compute/v2.1/servers/8e670908-5bb6-49ad-92f3-dad1b4df1b5a/action" status: 404 len: 111 microversion: 2.1 time: 0.116843 Sep 14 09:06:46.962879 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2023/4031] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:06:46 2022] POST /compute/v2.1/servers/8e670908-5bb6-49ad-92f3-dad1b4df1b5a/action => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:06:46.971698 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-e85d6a37-0a64-4356-baf7-4c039ab37183 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:46.975594 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-e85d6a37-0a64-4356-baf7-4c039ab37183 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:46.994973 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e85d6a37-0a64-4356-baf7-4c039ab37183 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:47.003926 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e85d6a37-0a64-4356-baf7-4c039ab37183 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:47.004615 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e85d6a37-0a64-4356-baf7-4c039ab37183 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:47.005522 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e85d6a37-0a64-4356-baf7-4c039ab37183 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:47.006251 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e85d6a37-0a64-4356-baf7-4c039ab37183 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:47.007081 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e85d6a37-0a64-4356-baf7-4c039ab37183 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:47.405744 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-5644fcd5-3630-4b17-a7ce-bccff82ce888 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5165b8fc101c47c7a4370f9007bc5a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a597fc389b4805bbd3a53ecd17c5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:06:47.473749 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-5644fcd5-3630-4b17-a7ce-bccff82ce888 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute/v2.1/servers/ed6976ad-867b-4570-a547-758efc8f622f" status: 200 len: 1497 microversion: 2.1 time: 0.594021 Sep 14 09:06:47.485028 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2009/4032] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:06:46 2022] GET /compute/v2.1/servers/ed6976ad-867b-4570-a547-758efc8f622f => generated 1497 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:06:47.593950 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ea67d651-45f9-4731-a93d-1a0fd728883b tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:47.594788 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-ea67d651-45f9-4731-a93d-1a0fd728883b tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] [instance: fb0ed293-ad31-4733-9318-c38b86e7bf45] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:47.600369 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-e85d6a37-0a64-4356-baf7-4c039ab37183 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:06:47.606749 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ea67d651-45f9-4731-a93d-1a0fd728883b tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:47.607288 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ea67d651-45f9-4731-a93d-1a0fd728883b tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:47.607740 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ea67d651-45f9-4731-a93d-1a0fd728883b tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:47.611141 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ea67d651-45f9-4731-a93d-1a0fd728883b tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:47.611675 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ea67d651-45f9-4731-a93d-1a0fd728883b tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:47.611933 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-e85d6a37-0a64-4356-baf7-4c039ab37183 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1506 microversion: 2.1 time: 0.642907 Sep 14 09:06:47.612125 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ea67d651-45f9-4731-a93d-1a0fd728883b tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:47.614483 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2024/4033] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:06:46 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1506 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:06:47.640653 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-e505cf95-d8df-450c-a155-313e406a8f3a tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:47.641373 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-e505cf95-d8df-450c-a155-313e406a8f3a tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:47.653389 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e505cf95-d8df-450c-a155-313e406a8f3a tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:47.655775 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e505cf95-d8df-450c-a155-313e406a8f3a tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:47.658016 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e505cf95-d8df-450c-a155-313e406a8f3a tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:47.659018 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e505cf95-d8df-450c-a155-313e406a8f3a tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:47.659579 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e505cf95-d8df-450c-a155-313e406a8f3a tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:47.661476 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e505cf95-d8df-450c-a155-313e406a8f3a tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:47.695804 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:06:47.922392 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=2 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:06:48.016490 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=6 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:06:48.411058 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=2 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:06:48.735273 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-e505cf95-d8df-450c-a155-313e406a8f3a tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:06:48.748024 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-e505cf95-d8df-450c-a155-313e406a8f3a tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1506 microversion: 2.1 time: 1.112065 Sep 14 09:06:48.748950 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2025/4034] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:06:47 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1506 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:06:48.753541 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-3de0d0bc-8922-462d-abf2-c40a49120ebb tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:48.754156 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-3de0d0bc-8922-462d-abf2-c40a49120ebb tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] [instance: ed6976ad-867b-4570-a547-758efc8f622f] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:48.767598 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3de0d0bc-8922-462d-abf2-c40a49120ebb tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:48.768101 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3de0d0bc-8922-462d-abf2-c40a49120ebb tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:48.783299 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3de0d0bc-8922-462d-abf2-c40a49120ebb tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:48.784017 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3de0d0bc-8922-462d-abf2-c40a49120ebb tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:48.784514 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3de0d0bc-8922-462d-abf2-c40a49120ebb tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:48.785320 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3de0d0bc-8922-462d-abf2-c40a49120ebb tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:48.862201 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-ea67d651-45f9-4731-a93d-1a0fd728883b tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f1bd1c415841ee98182783de5ef3fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23348c10cb84b6194d31c299dd8394a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:06:48.870065 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-ea67d651-45f9-4731-a93d-1a0fd728883b tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] 10.222.0.60 "GET /compute/v2.1/servers/fb0ed293-ad31-4733-9318-c38b86e7bf45" status: 200 len: 1314 microversion: 2.1 time: 1.282202 Sep 14 09:06:48.870657 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2010/4035] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:06:47 2022] GET /compute/v2.1/servers/fb0ed293-ad31-4733-9318-c38b86e7bf45 => generated 1314 bytes in 1284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:06:48.904169 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-1805c287-30a0-4fed-beae-b673b40e0251 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:06:48.907110 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-1805c287-30a0-4fed-beae-b673b40e0251 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: a0d604fe-7c1f-4f4a-805b-889708bd8f0c] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:48.923344 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-1805c287-30a0-4fed-beae-b673b40e0251 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] HTTP exception thrown: Instance a0d604fe-7c1f-4f4a-805b-889708bd8f0c could not be found. Sep 14 09:06:48.925001 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-1805c287-30a0-4fed-beae-b673b40e0251 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Request method failure captured: Sep 14 09:06:48.925001 n-d-836830-18 devstack@n-api.service[128759]: request: POST /compute/v2.1/servers/a0d604fe-7c1f-4f4a-805b-889708bd8f0c/action HTTP/1.1 Sep 14 09:06:48.925001 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:06:48.925001 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:06:48.925001 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:06:48.925001 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 65 Sep 14 09:06:48.925001 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:06:48.925001 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:06:48.925001 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:06:48.925001 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:06:48.925001 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZk2EvHIWQyXATvY4f6phbqF3DzIIyaJjJFCE11LxTKbrsndvuk5zoyyEUR0VXx32_kFjD0I6jBROuj0ZPSHQav7u9FFvOPFGrPkf9qZrgXY9k3zAUFrOVfwLECoLZOolubyCPUAGSEOi_HvFIP_Dd_DCbUCKDEGGLtdnAzy2tLCxHs Sep 14 09:06:48.925001 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:06:48.925001 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:06:48.925001 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:06:48.925001 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:06:48.925001 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:06:48.925001 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:06:48.925001 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 6907b82c9d5c4a23a63bbeec31c3c365 Sep 14 09:06:48.925001 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ServersNegativeTestJSON-1654813540 Sep 14 09:06:48.925001 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:06:48.925001 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:06:48.925001 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6907b82c9d5c4a23a63bbeec31c3c365"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6907b82c9d5c4a23a63bbeec31c3c365"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6907b82c9d5c4a23a63bbeec31c3c365"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6907b82c9d5c4a23a63bbeec31c3c365"}]}] Sep 14 09:06:48.925001 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ServersNegativeTestJSON-1654813540 Sep 14 09:06:48.925001 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 6907b82c9d5c4a23a63bbeec31c3c365 Sep 14 09:06:48.925001 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1654813540 Sep 14 09:06:48.925001 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ServersNegativeTestJSON-1654813540-project Sep 14 09:06:48.925001 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:06:48.925001 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:06:48.925001 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 79583c4e80a04f138927f09eb4e170f4 Sep 14 09:06:48.925001 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ServersNegativeTestJSON-1654813540-project Sep 14 09:06:48.925001 n-d-836830-18 devstack@n-api.service[128759]: Sep 14 09:06:48.925001 n-d-836830-18 devstack@n-api.service[128759]: {"rebuild": {"imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9"}} Sep 14 09:06:48.925001 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:06:48.925001 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance a0d604fe-7c1f-4f4a-805b-889708bd8f0c could not be found. Sep 14 09:06:48.925001 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': 'a0d604fe-7c1f-4f4a-805b-889708bd8f0c', 'body': {'rebuild': {'imageRef': 'bff4ab7f-4846-441f-8940-d96fec4c28e9'}}} Sep 14 09:06:48.925001 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:06:48.925001 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:06:48.925001 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:06:48.925001 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:06:48.925001 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:06:48.925001 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:06:48.925001 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 14 09:06:48.925001 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 14 09:06:48.925001 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0d604fe-7c1f-4f4a-805b-889708bd8f0c could not be found. Sep 14 09:06:48.925001 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:48.925001 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:06:48.925001 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:48.925001 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:06:48.925001 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:06:48.925001 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:06:48.925001 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:06:48.925001 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:06:48.925001 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:06:48.925001 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:06:48.925001 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:06:48.925001 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:06:48.925001 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:06:48.925001 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:06:48.925001 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:06:48.925001 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:06:48.925001 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Sep 14 09:06:48.925001 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Sep 14 09:06:48.925001 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 14 09:06:48.925001 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:06:48.932590 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:06:48.932590 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:06:48.932590 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:06:48.932590 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0d604fe-7c1f-4f4a-805b-889708bd8f0c could not be found. Sep 14 09:06:48.932590 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:48.932590 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:06:48.932590 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:48.932590 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:06:48.932590 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:06:48.932590 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:06:48.932590 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:06:48.932590 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:06:48.932590 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0d604fe-7c1f-4f4a-805b-889708bd8f0c could not be found. Sep 14 09:06:48.932590 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:48.932590 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-1805c287-30a0-4fed-beae-b673b40e0251 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Returning 404 to user: Instance a0d604fe-7c1f-4f4a-805b-889708bd8f0c could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:06:48.932590 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-1805c287-30a0-4fed-beae-b673b40e0251 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "POST /compute/v2.1/servers/a0d604fe-7c1f-4f4a-805b-889708bd8f0c/action" status: 404 len: 111 microversion: 2.1 time: 0.034374 Sep 14 09:06:48.932590 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2011/4036] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:06:48 2022] POST /compute/v2.1/servers/a0d604fe-7c1f-4f4a-805b-889708bd8f0c/action => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:06:48.935051 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f45a7372-08be-4ecb-9640-a1c85362a141 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:48.935673 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f45a7372-08be-4ecb-9640-a1c85362a141 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:48.966164 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f45a7372-08be-4ecb-9640-a1c85362a141 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:48.966865 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f45a7372-08be-4ecb-9640-a1c85362a141 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:48.967358 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f45a7372-08be-4ecb-9640-a1c85362a141 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:48.970576 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f45a7372-08be-4ecb-9640-a1c85362a141 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:48.971236 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f45a7372-08be-4ecb-9640-a1c85362a141 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:48.971864 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f45a7372-08be-4ecb-9640-a1c85362a141 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:49.508074 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f45a7372-08be-4ecb-9640-a1c85362a141 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:06:49.517602 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f45a7372-08be-4ecb-9640-a1c85362a141 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1506 microversion: 2.1 time: 0.586241 Sep 14 09:06:49.530082 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2012/4037] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:06:48 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1506 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:06:49.530217 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-3de0d0bc-8922-462d-abf2-c40a49120ebb tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5165b8fc101c47c7a4370f9007bc5a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a597fc389b4805bbd3a53ecd17c5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:06:49.540201 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-3de0d0bc-8922-462d-abf2-c40a49120ebb tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute/v2.1/servers/ed6976ad-867b-4570-a547-758efc8f622f" status: 200 len: 1497 microversion: 2.1 time: 0.790192 Sep 14 09:06:49.548263 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2026/4038] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:06:48 2022] GET /compute/v2.1/servers/ed6976ad-867b-4570-a547-758efc8f622f => generated 1497 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:06:49.550607 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e2914576-f973-4e14-b703-40a5b19b8839 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:49.551474 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e2914576-f973-4e14-b703-40a5b19b8839 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:49.564125 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e2914576-f973-4e14-b703-40a5b19b8839 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:49.564816 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e2914576-f973-4e14-b703-40a5b19b8839 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:49.565703 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e2914576-f973-4e14-b703-40a5b19b8839 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:49.575129 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e2914576-f973-4e14-b703-40a5b19b8839 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:49.576038 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e2914576-f973-4e14-b703-40a5b19b8839 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:49.577260 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e2914576-f973-4e14-b703-40a5b19b8839 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:49.894083 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-9656b611-e319-4ed6-9314-8a7d7a7f847f tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:49.894921 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-9656b611-e319-4ed6-9314-8a7d7a7f847f tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] [instance: fb0ed293-ad31-4733-9318-c38b86e7bf45] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:49.902060 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9656b611-e319-4ed6-9314-8a7d7a7f847f tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:49.902725 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9656b611-e319-4ed6-9314-8a7d7a7f847f tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:49.903339 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9656b611-e319-4ed6-9314-8a7d7a7f847f tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:49.904231 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9656b611-e319-4ed6-9314-8a7d7a7f847f tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:49.904839 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9656b611-e319-4ed6-9314-8a7d7a7f847f tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:49.905408 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9656b611-e319-4ed6-9314-8a7d7a7f847f tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:50.411732 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-9656b611-e319-4ed6-9314-8a7d7a7f847f tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f1bd1c415841ee98182783de5ef3fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23348c10cb84b6194d31c299dd8394a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:06:50.429800 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-9656b611-e319-4ed6-9314-8a7d7a7f847f tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] 10.222.0.60 "GET /compute/v2.1/servers/fb0ed293-ad31-4733-9318-c38b86e7bf45" status: 200 len: 1314 microversion: 2.1 time: 0.539912 Sep 14 09:06:50.436388 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-e2914576-f973-4e14-b703-40a5b19b8839 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:06:50.447161 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e2914576-f973-4e14-b703-40a5b19b8839 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1506 microversion: 2.1 time: 0.905591 Sep 14 09:06:50.447742 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2013/4040] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:06:49 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1506 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:06:50.452158 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2027/4040] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:06:49 2022] GET /compute/v2.1/servers/fb0ed293-ad31-4733-9318-c38b86e7bf45 => generated 1314 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:06:50.484521 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-23f55efd-e6fd-49ac-8813-2f780f7ab40d tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:06:50.486284 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-23f55efd-e6fd-49ac-8813-2f780f7ab40d tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: b0f82d75-8978-4670-a633-6528ae916414] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:50.504586 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-23f55efd-e6fd-49ac-8813-2f780f7ab40d tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] HTTP exception thrown: Instance b0f82d75-8978-4670-a633-6528ae916414 could not be found. Sep 14 09:06:50.509961 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-23f55efd-e6fd-49ac-8813-2f780f7ab40d tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Request method failure captured: Sep 14 09:06:50.509961 n-d-836830-18 devstack@n-api.service[128759]: request: POST /compute/v2.1/servers/b0f82d75-8978-4670-a633-6528ae916414/action HTTP/1.1 Sep 14 09:06:50.509961 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:06:50.509961 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:06:50.509961 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:06:50.509961 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 15 Sep 14 09:06:50.509961 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:06:50.509961 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:06:50.509961 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:06:50.509961 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:06:50.509961 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZk2EvHIWQyXATvY4f6phbqF3DzIIyaJjJFCE11LxTKbrsndvuk5zoyyEUR0VXx32_kFjD0I6jBROuj0ZPSHQav7u9FFvOPFGrPkf9qZrgXY9k3zAUFrOVfwLECoLZOolubyCPUAGSEOi_HvFIP_Dd_DCbUCKDEGGLtdnAzy2tLCxHs Sep 14 09:06:50.509961 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:06:50.509961 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:06:50.509961 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:06:50.509961 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:06:50.509961 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:06:50.509961 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:06:50.509961 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 6907b82c9d5c4a23a63bbeec31c3c365 Sep 14 09:06:50.509961 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ServersNegativeTestJSON-1654813540 Sep 14 09:06:50.509961 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:06:50.509961 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:06:50.509961 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6907b82c9d5c4a23a63bbeec31c3c365"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6907b82c9d5c4a23a63bbeec31c3c365"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6907b82c9d5c4a23a63bbeec31c3c365"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6907b82c9d5c4a23a63bbeec31c3c365"}]}] Sep 14 09:06:50.509961 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ServersNegativeTestJSON-1654813540 Sep 14 09:06:50.509961 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 6907b82c9d5c4a23a63bbeec31c3c365 Sep 14 09:06:50.509961 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1654813540 Sep 14 09:06:50.509961 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ServersNegativeTestJSON-1654813540-project Sep 14 09:06:50.509961 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:06:50.509961 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:06:50.509961 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 79583c4e80a04f138927f09eb4e170f4 Sep 14 09:06:50.509961 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ServersNegativeTestJSON-1654813540-project Sep 14 09:06:50.509961 n-d-836830-18 devstack@n-api.service[128759]: Sep 14 09:06:50.509961 n-d-836830-18 devstack@n-api.service[128759]: {"restore": {}} Sep 14 09:06:50.509961 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:06:50.509961 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance b0f82d75-8978-4670-a633-6528ae916414 could not be found. Sep 14 09:06:50.509961 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': 'b0f82d75-8978-4670-a633-6528ae916414', 'body': {'restore': {}}} Sep 14 09:06:50.509961 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:06:50.509961 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:06:50.509961 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:06:50.509961 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:06:50.509961 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:06:50.509961 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:06:50.509961 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 14 09:06:50.509961 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 14 09:06:50.509961 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0f82d75-8978-4670-a633-6528ae916414 could not be found. Sep 14 09:06:50.509961 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:50.509961 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:06:50.509961 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:50.509961 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:06:50.509961 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:06:50.509961 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:06:50.509961 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:06:50.509961 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:06:50.509961 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:06:50.509961 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:06:50.509961 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Sep 14 09:06:50.509961 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 14 09:06:50.509961 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:06:50.509961 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:06:50.509961 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0f82d75-8978-4670-a633-6528ae916414 could not be found. Sep 14 09:06:50.509961 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:50.509961 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:06:50.509961 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:50.509961 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:06:50.509961 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:06:50.509961 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:06:50.514660 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:06:50.514660 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:06:50.514660 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0f82d75-8978-4670-a633-6528ae916414 could not be found. Sep 14 09:06:50.514660 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:50.514660 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-23f55efd-e6fd-49ac-8813-2f780f7ab40d tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Returning 404 to user: Instance b0f82d75-8978-4670-a633-6528ae916414 could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:06:50.514660 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-23f55efd-e6fd-49ac-8813-2f780f7ab40d tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "POST /compute/v2.1/servers/b0f82d75-8978-4670-a633-6528ae916414/action" status: 404 len: 111 microversion: 2.1 time: 0.034095 Sep 14 09:06:50.516073 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2014/4041] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:06:50 2022] POST /compute/v2.1/servers/b0f82d75-8978-4670-a633-6528ae916414/action => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:06:50.522603 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-f770f01d-c136-410c-b427-983ec0602b1c tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:50.523255 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-f770f01d-c136-410c-b427-983ec0602b1c tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:50.537824 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f770f01d-c136-410c-b427-983ec0602b1c tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:50.538429 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f770f01d-c136-410c-b427-983ec0602b1c tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:50.538999 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f770f01d-c136-410c-b427-983ec0602b1c tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:50.539751 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f770f01d-c136-410c-b427-983ec0602b1c tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:50.540226 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f770f01d-c136-410c-b427-983ec0602b1c tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:50.540657 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f770f01d-c136-410c-b427-983ec0602b1c tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:50.580156 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d4bfe201-c264-4c76-becb-ecd8ca0c13bf tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:50.580969 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-d4bfe201-c264-4c76-becb-ecd8ca0c13bf tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] [instance: ed6976ad-867b-4570-a547-758efc8f622f] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:50.597841 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d4bfe201-c264-4c76-becb-ecd8ca0c13bf tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:50.598524 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d4bfe201-c264-4c76-becb-ecd8ca0c13bf tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:50.599020 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d4bfe201-c264-4c76-becb-ecd8ca0c13bf tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:50.600250 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d4bfe201-c264-4c76-becb-ecd8ca0c13bf tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:50.600785 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d4bfe201-c264-4c76-becb-ecd8ca0c13bf tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:50.607306 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d4bfe201-c264-4c76-becb-ecd8ca0c13bf tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:51.241543 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-f770f01d-c136-410c-b427-983ec0602b1c tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:06:51.258728 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-f770f01d-c136-410c-b427-983ec0602b1c tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1506 microversion: 2.1 time: 0.740017 Sep 14 09:06:51.259353 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2028/4042] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:06:50 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1506 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:06:51.291348 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-de5c7ed9-df37-47bf-8396-aa7f82cfd3e9 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:51.291975 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-de5c7ed9-df37-47bf-8396-aa7f82cfd3e9 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:51.309944 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-de5c7ed9-df37-47bf-8396-aa7f82cfd3e9 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:51.310750 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-de5c7ed9-df37-47bf-8396-aa7f82cfd3e9 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:51.311372 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-de5c7ed9-df37-47bf-8396-aa7f82cfd3e9 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:51.312273 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-de5c7ed9-df37-47bf-8396-aa7f82cfd3e9 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:51.312895 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-de5c7ed9-df37-47bf-8396-aa7f82cfd3e9 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:51.315603 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-de5c7ed9-df37-47bf-8396-aa7f82cfd3e9 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:51.507465 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-d4bfe201-c264-4c76-becb-ecd8ca0c13bf tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5165b8fc101c47c7a4370f9007bc5a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a597fc389b4805bbd3a53ecd17c5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:06:51.524514 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d4bfe201-c264-4c76-becb-ecd8ca0c13bf tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute/v2.1/servers/ed6976ad-867b-4570-a547-758efc8f622f" status: 200 len: 1497 microversion: 2.1 time: 0.951485 Sep 14 09:06:51.540015 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2015/4043] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:06:50 2022] GET /compute/v2.1/servers/ed6976ad-867b-4570-a547-758efc8f622f => generated 1497 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:06:51.546253 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-6350d31f-da0c-4415-a4bf-834f0d607f5a tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:51.547261 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-6350d31f-da0c-4415-a4bf-834f0d607f5a tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] [instance: fb0ed293-ad31-4733-9318-c38b86e7bf45] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:51.555281 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6350d31f-da0c-4415-a4bf-834f0d607f5a tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:51.556091 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6350d31f-da0c-4415-a4bf-834f0d607f5a tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:51.556697 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6350d31f-da0c-4415-a4bf-834f0d607f5a tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:51.557577 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6350d31f-da0c-4415-a4bf-834f0d607f5a tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:51.558245 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6350d31f-da0c-4415-a4bf-834f0d607f5a tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:51.558831 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6350d31f-da0c-4415-a4bf-834f0d607f5a tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:52.248020 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-de5c7ed9-df37-47bf-8396-aa7f82cfd3e9 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:06:52.265917 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-de5c7ed9-df37-47bf-8396-aa7f82cfd3e9 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1506 microversion: 2.1 time: 0.984771 Sep 14 09:06:52.268932 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2029/4044] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:06:51 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1506 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:06:52.273951 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-a2b07e8f-a943-4262-8170-fa068a9d0820 req-3700c689-f320-4f90-bc89-ca897a855801 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb0ed293-ad31-4733-9318-c38b86e7bf45", "name": "network-vif-plugged", "status": "completed", "tag": "0a885251-2109-4da9-bd76-0d3a214c2087"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:06:52.295314 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-a2b07e8f-a943-4262-8170-fa068a9d0820 req-3700c689-f320-4f90-bc89-ca897a855801 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:52.296072 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-a2b07e8f-a943-4262-8170-fa068a9d0820 req-3700c689-f320-4f90-bc89-ca897a855801 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:52.297755 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-a2b07e8f-a943-4262-8170-fa068a9d0820 req-3700c689-f320-4f90-bc89-ca897a855801 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:52.333300 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-a2b07e8f-a943-4262-8170-fa068a9d0820 req-3700c689-f320-4f90-bc89-ca897a855801 service nova] Creating event network-vif-plugged:0a885251-2109-4da9-bd76-0d3a214c2087 for instance fb0ed293-ad31-4733-9318-c38b86e7bf45 on n-h2-836830-18 Sep 14 09:06:52.340972 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-a2b07e8f-a943-4262-8170-fa068a9d0820 req-3700c689-f320-4f90-bc89-ca897a855801 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070509 Sep 14 09:06:52.341872 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2030/4045] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:06:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:06:52.354906 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c7fda507-cea8-4dc9-91b3-7d3b2028eb41 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:06:52.367343 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-c7fda507-cea8-4dc9-91b3-7d3b2028eb41 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:52.375288 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c7fda507-cea8-4dc9-91b3-7d3b2028eb41 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:52.381197 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c7fda507-cea8-4dc9-91b3-7d3b2028eb41 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:52.382618 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c7fda507-cea8-4dc9-91b3-7d3b2028eb41 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:52.383583 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c7fda507-cea8-4dc9-91b3-7d3b2028eb41 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:52.384400 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c7fda507-cea8-4dc9-91b3-7d3b2028eb41 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:52.385047 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c7fda507-cea8-4dc9-91b3-7d3b2028eb41 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:52.423963 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-6350d31f-da0c-4415-a4bf-834f0d607f5a tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f1bd1c415841ee98182783de5ef3fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23348c10cb84b6194d31c299dd8394a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:06:52.439170 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-6350d31f-da0c-4415-a4bf-834f0d607f5a tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] 10.222.0.60 "GET /compute/v2.1/servers/fb0ed293-ad31-4733-9318-c38b86e7bf45" status: 200 len: 1314 microversion: 2.1 time: 0.897788 Sep 14 09:06:52.445708 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2016/4046] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:06:51 2022] GET /compute/v2.1/servers/fb0ed293-ad31-4733-9318-c38b86e7bf45 => generated 1314 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:06:52.491329 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-c7fda507-cea8-4dc9-91b3-7d3b2028eb41 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] HTTP exception thrown: Cannot 'restore' instance ae344b98-a354-4df8-83ba-3c5a786694f4 while it is in vm_state active Sep 14 09:06:52.496332 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c7fda507-cea8-4dc9-91b3-7d3b2028eb41 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Request method failure captured: Sep 14 09:06:52.496332 n-d-836830-18 devstack@n-api.service[128758]: request: POST /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4/action HTTP/1.1 Sep 14 09:06:52.496332 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 09:06:52.496332 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 09:06:52.496332 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 09:06:52.496332 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 15 Sep 14 09:06:52.496332 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 09:06:52.496332 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 09:06:52.496332 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 09:06:52.496332 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 09:06:52.496332 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZk2EvHIWQyXATvY4f6phbqF3DzIIyaJjJFCE11LxTKbrsndvuk5zoyyEUR0VXx32_kFjD0I6jBROuj0ZPSHQav7u9FFvOPFGrPkf9qZrgXY9k3zAUFrOVfwLECoLZOolubyCPUAGSEOi_HvFIP_Dd_DCbUCKDEGGLtdnAzy2tLCxHs Sep 14 09:06:52.496332 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 09:06:52.496332 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 09:06:52.496332 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 09:06:52.496332 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 09:06:52.496332 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 09:06:52.496332 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 09:06:52.496332 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 6907b82c9d5c4a23a63bbeec31c3c365 Sep 14 09:06:52.496332 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-ServersNegativeTestJSON-1654813540 Sep 14 09:06:52.496332 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 09:06:52.496332 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 09:06:52.496332 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6907b82c9d5c4a23a63bbeec31c3c365"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6907b82c9d5c4a23a63bbeec31c3c365"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6907b82c9d5c4a23a63bbeec31c3c365"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6907b82c9d5c4a23a63bbeec31c3c365"}]}] Sep 14 09:06:52.496332 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-ServersNegativeTestJSON-1654813540 Sep 14 09:06:52.496332 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 6907b82c9d5c4a23a63bbeec31c3c365 Sep 14 09:06:52.496332 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1654813540 Sep 14 09:06:52.496332 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-ServersNegativeTestJSON-1654813540-project Sep 14 09:06:52.496332 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 09:06:52.496332 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 09:06:52.496332 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 79583c4e80a04f138927f09eb4e170f4 Sep 14 09:06:52.496332 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-ServersNegativeTestJSON-1654813540-project Sep 14 09:06:52.496332 n-d-836830-18 devstack@n-api.service[128758]: Sep 14 09:06:52.496332 n-d-836830-18 devstack@n-api.service[128758]: {"restore": {}} Sep 14 09:06:52.496332 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 09:06:52.496332 n-d-836830-18 devstack@n-api.service[128758]: exception: Cannot 'restore' instance ae344b98-a354-4df8-83ba-3c5a786694f4 while it is in vm_state active Sep 14 09:06:52.496332 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': 'ae344b98-a354-4df8-83ba-3c5a786694f4', 'body': {'restore': {}}} Sep 14 09:06:52.496332 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:06:52.496332 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:06:52.496332 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Sep 14 09:06:52.496332 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Sep 14 09:06:52.496332 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 14 09:06:52.496332 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 14 09:06:52.496332 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 14 09:06:52.496332 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 14 09:06:52.496332 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ae344b98-a354-4df8-83ba-3c5a786694f4 in vm_state active. Cannot restore while the instance is in this state. Sep 14 09:06:52.496332 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:06:52.496332 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:06:52.496332 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:06:52.496332 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:06:52.496332 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:06:52.496332 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:06:52.496332 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:06:52.496332 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:06:52.496332 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:06:52.496332 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:06:52.496332 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Sep 14 09:06:52.496332 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 14 09:06:52.496332 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 14 09:06:52.496332 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 14 09:06:52.496332 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance ae344b98-a354-4df8-83ba-3c5a786694f4 while it is in vm_state active Sep 14 09:06:52.496332 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:06:52.496332 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:06:52.496332 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:06:52.496332 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:06:52.496332 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:06:52.500911 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:06:52.500911 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:06:52.500911 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:06:52.500911 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance ae344b98-a354-4df8-83ba-3c5a786694f4 while it is in vm_state active Sep 14 09:06:52.500911 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:06:52.500911 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c7fda507-cea8-4dc9-91b3-7d3b2028eb41 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Returning 409 to user: Cannot 'restore' instance ae344b98-a354-4df8-83ba-3c5a786694f4 while it is in vm_state active {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:06:52.500911 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-c7fda507-cea8-4dc9-91b3-7d3b2028eb41 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "POST /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4/action" status: 409 len: 145 microversion: 2.1 time: 0.155740 Sep 14 09:06:52.502130 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2031/4047] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:06:52 2022] POST /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4/action => generated 145 bytes in 158 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 14 09:06:52.509528 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e68c31ee-bd5e-46e5-99d1-0588837d24be tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:52.510378 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e68c31ee-bd5e-46e5-99d1-0588837d24be tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:52.535551 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e68c31ee-bd5e-46e5-99d1-0588837d24be tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:52.537881 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e68c31ee-bd5e-46e5-99d1-0588837d24be tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:52.538761 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e68c31ee-bd5e-46e5-99d1-0588837d24be tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:52.546905 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e68c31ee-bd5e-46e5-99d1-0588837d24be tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:52.547791 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e68c31ee-bd5e-46e5-99d1-0588837d24be tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:52.551320 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-6a77c541-2286-41c3-9e0e-292234fa6e2b tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:52.552206 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e68c31ee-bd5e-46e5-99d1-0588837d24be tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:52.575924 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-6a77c541-2286-41c3-9e0e-292234fa6e2b tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] [instance: ed6976ad-867b-4570-a547-758efc8f622f] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:52.604191 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6a77c541-2286-41c3-9e0e-292234fa6e2b tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:52.606711 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6a77c541-2286-41c3-9e0e-292234fa6e2b tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:52.608345 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6a77c541-2286-41c3-9e0e-292234fa6e2b tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:52.610730 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6a77c541-2286-41c3-9e0e-292234fa6e2b tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:52.613678 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6a77c541-2286-41c3-9e0e-292234fa6e2b tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:52.616064 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6a77c541-2286-41c3-9e0e-292234fa6e2b tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:53.236610 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-e68c31ee-bd5e-46e5-99d1-0588837d24be tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:06:53.252309 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e68c31ee-bd5e-46e5-99d1-0588837d24be tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1506 microversion: 2.1 time: 0.743983 Sep 14 09:06:53.254388 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2017/4048] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:06:52 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1506 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:06:53.298958 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-6a77c541-2286-41c3-9e0e-292234fa6e2b tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5165b8fc101c47c7a4370f9007bc5a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a597fc389b4805bbd3a53ecd17c5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:06:53.324925 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-6a77c541-2286-41c3-9e0e-292234fa6e2b tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute/v2.1/servers/ed6976ad-867b-4570-a547-758efc8f622f" status: 200 len: 1474 microversion: 2.1 time: 0.777314 Sep 14 09:06:53.328072 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2032/4049] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:06:52 2022] GET /compute/v2.1/servers/ed6976ad-867b-4570-a547-758efc8f622f => generated 1474 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:06:53.342289 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-e7bcd4ca-0f46-49ee-b0fa-83fc50f8dc04 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:53.343857 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-e7bcd4ca-0f46-49ee-b0fa-83fc50f8dc04 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:53.367402 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e7bcd4ca-0f46-49ee-b0fa-83fc50f8dc04 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:53.369387 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e7bcd4ca-0f46-49ee-b0fa-83fc50f8dc04 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:53.370340 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e7bcd4ca-0f46-49ee-b0fa-83fc50f8dc04 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:53.372879 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e7bcd4ca-0f46-49ee-b0fa-83fc50f8dc04 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:53.374625 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e7bcd4ca-0f46-49ee-b0fa-83fc50f8dc04 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:53.376400 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e7bcd4ca-0f46-49ee-b0fa-83fc50f8dc04 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:53.393091 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=100 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:06:53.512116 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8cbb0bbd-3163-4880-811d-7337ea1eda9c tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-145136185", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "networks": [{"uuid": "f6201275-5924-436a-915a-cc825429863b"}]}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:06:53.585424 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=92 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:06:53.671911 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.network.neutron [None req-8cbb0bbd-3163-4880-811d-7337ea1eda9c tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] validate_networks() for [('f6201275-5924-436a-915a-cc825429863b', None, None, None, None, None)] {{(pid=128759) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:06:54.026467 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-e7bcd4ca-0f46-49ee-b0fa-83fc50f8dc04 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:06:54.034311 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-e7bcd4ca-0f46-49ee-b0fa-83fc50f8dc04 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1506 microversion: 2.1 time: 0.704602 Sep 14 09:06:54.047932 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2033/4050] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:06:53 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1506 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:06:54.048302 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1d5b4029-67f7-49de-bcef-8ba5edd802bf tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1717212487"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:06:54.066634 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-1d5b4029-67f7-49de-bcef-8ba5edd802bf tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] [instance: ed6976ad-867b-4570-a547-758efc8f622f] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:54.083271 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1d5b4029-67f7-49de-bcef-8ba5edd802bf tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:54.083859 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1d5b4029-67f7-49de-bcef-8ba5edd802bf tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:54.085669 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1d5b4029-67f7-49de-bcef-8ba5edd802bf tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:54.086974 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1d5b4029-67f7-49de-bcef-8ba5edd802bf tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:54.090243 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1d5b4029-67f7-49de-bcef-8ba5edd802bf tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:54.090712 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1d5b4029-67f7-49de-bcef-8ba5edd802bf tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:54.529582 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-1d5b4029-67f7-49de-bcef-8ba5edd802bf tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "POST /compute/v2.1/servers/ed6976ad-867b-4570-a547-758efc8f622f/action" status: 202 len: 0 microversion: 2.1 time: 0.473633 Sep 14 09:06:54.544690 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2034/4051] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:06:54 2022] POST /compute/v2.1/servers/ed6976ad-867b-4570-a547-758efc8f622f/action => generated 0 bytes in 495 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 14 09:06:54.583665 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-da502e5f-ee31-43d7-81d5-e4c52d815436 tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:54.587133 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-da502e5f-ee31-43d7-81d5-e4c52d815436 tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] [instance: fb0ed293-ad31-4733-9318-c38b86e7bf45] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:54.609143 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-da502e5f-ee31-43d7-81d5-e4c52d815436 tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:54.617993 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-da502e5f-ee31-43d7-81d5-e4c52d815436 tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:54.618718 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-da502e5f-ee31-43d7-81d5-e4c52d815436 tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:54.619625 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-da502e5f-ee31-43d7-81d5-e4c52d815436 tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:54.624099 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-da502e5f-ee31-43d7-81d5-e4c52d815436 tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:54.629395 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-da502e5f-ee31-43d7-81d5-e4c52d815436 tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:54.829000 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-8cbb0bbd-3163-4880-811d-7337ea1eda9c tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Flavor limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:06:54.829491 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-8cbb0bbd-3163-4880-811d-7337ea1eda9c tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Image limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:06:54.830103 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-8cbb0bbd-3163-4880-811d-7337ea1eda9c tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Flavor pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:06:54.830533 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-8cbb0bbd-3163-4880-811d-7337ea1eda9c tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Image pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:06:54.831044 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-8cbb0bbd-3163-4880-811d-7337ea1eda9c tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:06:54.857695 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8cbb0bbd-3163-4880-811d-7337ea1eda9c tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:54.858203 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8cbb0bbd-3163-4880-811d-7337ea1eda9c tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:54.858647 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8cbb0bbd-3163-4880-811d-7337ea1eda9c tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:54.859475 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8cbb0bbd-3163-4880-811d-7337ea1eda9c tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:54.859877 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8cbb0bbd-3163-4880-811d-7337ea1eda9c tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:54.860309 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8cbb0bbd-3163-4880-811d-7337ea1eda9c tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:54.883746 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-da502e5f-ee31-43d7-81d5-e4c52d815436 tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f1bd1c415841ee98182783de5ef3fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23348c10cb84b6194d31c299dd8394a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:06:54.898659 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-da502e5f-ee31-43d7-81d5-e4c52d815436 tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] 10.222.0.60 "GET /compute/v2.1/servers/fb0ed293-ad31-4733-9318-c38b86e7bf45" status: 200 len: 1501 microversion: 2.1 time: 0.346770 Sep 14 09:06:54.900160 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2035/4052] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:06:54 2022] GET /compute/v2.1/servers/fb0ed293-ad31-4733-9318-c38b86e7bf45 => generated 1501 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:06:54.905799 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-09839904-5f0c-4898-b5ac-eb83aa63d875 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:06:54.906888 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-09839904-5f0c-4898-b5ac-eb83aa63d875 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: 9eb58b75-c33a-4d52-aa70-c775951c1cea] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:54.913872 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-09839904-5f0c-4898-b5ac-eb83aa63d875 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] HTTP exception thrown: Instance 9eb58b75-c33a-4d52-aa70-c775951c1cea could not be found. Sep 14 09:06:54.922912 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-09839904-5f0c-4898-b5ac-eb83aa63d875 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Request method failure captured: Sep 14 09:06:54.922912 n-d-836830-18 devstack@n-api.service[128758]: request: POST /compute/v2.1/servers/9eb58b75-c33a-4d52-aa70-c775951c1cea/action HTTP/1.1 Sep 14 09:06:54.922912 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 09:06:54.922912 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 09:06:54.922912 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 09:06:54.922912 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 14 Sep 14 09:06:54.922912 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 09:06:54.922912 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 09:06:54.922912 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 09:06:54.922912 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 09:06:54.922912 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZk2EvHIWQyXATvY4f6phbqF3DzIIyaJjJFCE11LxTKbrsndvuk5zoyyEUR0VXx32_kFjD0I6jBROuj0ZPSHQav7u9FFvOPFGrPkf9qZrgXY9k3zAUFrOVfwLECoLZOolubyCPUAGSEOi_HvFIP_Dd_DCbUCKDEGGLtdnAzy2tLCxHs Sep 14 09:06:54.922912 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 09:06:54.922912 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 09:06:54.922912 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 09:06:54.922912 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 09:06:54.922912 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 09:06:54.922912 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 09:06:54.922912 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 6907b82c9d5c4a23a63bbeec31c3c365 Sep 14 09:06:54.922912 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-ServersNegativeTestJSON-1654813540 Sep 14 09:06:54.922912 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 09:06:54.922912 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 09:06:54.922912 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6907b82c9d5c4a23a63bbeec31c3c365"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6907b82c9d5c4a23a63bbeec31c3c365"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6907b82c9d5c4a23a63bbeec31c3c365"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6907b82c9d5c4a23a63bbeec31c3c365"}]}] Sep 14 09:06:54.922912 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-ServersNegativeTestJSON-1654813540 Sep 14 09:06:54.922912 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 6907b82c9d5c4a23a63bbeec31c3c365 Sep 14 09:06:54.922912 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1654813540 Sep 14 09:06:54.922912 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-ServersNegativeTestJSON-1654813540-project Sep 14 09:06:54.922912 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 09:06:54.922912 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 09:06:54.922912 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 79583c4e80a04f138927f09eb4e170f4 Sep 14 09:06:54.922912 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-ServersNegativeTestJSON-1654813540-project Sep 14 09:06:54.922912 n-d-836830-18 devstack@n-api.service[128758]: Sep 14 09:06:54.922912 n-d-836830-18 devstack@n-api.service[128758]: {"resume": {}} Sep 14 09:06:54.922912 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 09:06:54.922912 n-d-836830-18 devstack@n-api.service[128758]: exception: Instance 9eb58b75-c33a-4d52-aa70-c775951c1cea could not be found. Sep 14 09:06:54.922912 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': '9eb58b75-c33a-4d52-aa70-c775951c1cea', 'body': {'resume': {}}} Sep 14 09:06:54.922912 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:06:54.922912 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:06:54.922912 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:06:54.922912 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:06:54.922912 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:06:54.922912 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:06:54.922912 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 14 09:06:54.922912 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 14 09:06:54.922912 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9eb58b75-c33a-4d52-aa70-c775951c1cea could not be found. Sep 14 09:06:54.922912 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:06:54.922912 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:06:54.922912 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:06:54.922912 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:06:54.922912 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:06:54.922912 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:06:54.922912 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:06:54.922912 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:06:54.922912 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:06:54.922912 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:06:54.922912 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Sep 14 09:06:54.922912 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Sep 14 09:06:54.922912 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:06:54.922912 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:06:54.922912 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9eb58b75-c33a-4d52-aa70-c775951c1cea could not be found. Sep 14 09:06:54.922912 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:06:54.922912 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:06:54.922912 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:06:54.922912 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:06:54.922912 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:06:54.922912 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:06:54.926716 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:06:54.926716 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:06:54.926716 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9eb58b75-c33a-4d52-aa70-c775951c1cea could not be found. Sep 14 09:06:54.926716 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:06:54.931060 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-09839904-5f0c-4898-b5ac-eb83aa63d875 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Returning 404 to user: Instance 9eb58b75-c33a-4d52-aa70-c775951c1cea could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:06:54.932193 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-09839904-5f0c-4898-b5ac-eb83aa63d875 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "POST /compute/v2.1/servers/9eb58b75-c33a-4d52-aa70-c775951c1cea/action" status: 404 len: 111 microversion: 2.1 time: 0.030745 Sep 14 09:06:54.933168 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2036/4053] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:06:54 2022] POST /compute/v2.1/servers/9eb58b75-c33a-4d52-aa70-c775951c1cea/action => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:06:54.937608 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-8cbb0bbd-3163-4880-811d-7337ea1eda9c tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Getting quotas for project a6c30be307734cecbb607753f3345c7c. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:06:54.940932 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1dff74ed-ba89-4cb6-baba-d401fca02a07 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '.version_select at 0x7f7d4493f3a0>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:54.954574 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-8cbb0bbd-3163-4880-811d-7337ea1eda9c tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Getting quotas for user 0fffaf9fa0894fe3b4ba967e0854d50e and project a6c30be307734cecbb607753f3345c7c. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:06:54.980657 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-8cbb0bbd-3163-4880-811d-7337ea1eda9c tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Going to run 1 instances... {{(pid=128759) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:06:54.983198 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-8cbb0bbd-3163-4880-811d-7337ea1eda9c tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] [instance: c07aefa3-4ced-496c-9397-abae833e373d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128759) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:06:55.008613 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-1dff74ed-ba89-4cb6-baba-d401fca02a07 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute/v2.1/images/07477c68-aba6-4fa9-a6a2-3ce18dedfc78" status: 200 len: 1414 microversion: 2.1 time: 0.071370 Sep 14 09:06:55.010694 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2037/4054] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:06:54 2022] GET /compute/v2.1/images/07477c68-aba6-4fa9-a6a2-3ce18dedfc78 => generated 1414 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:06:55.030803 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-113abd87-f792-4b20-9b64-5abdf5571190 tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:55.031491 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-113abd87-f792-4b20-9b64-5abdf5571190 tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] [instance: fb0ed293-ad31-4733-9318-c38b86e7bf45] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:55.040941 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-113abd87-f792-4b20-9b64-5abdf5571190 tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:55.041590 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-113abd87-f792-4b20-9b64-5abdf5571190 tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:55.042148 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-113abd87-f792-4b20-9b64-5abdf5571190 tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:55.043229 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-113abd87-f792-4b20-9b64-5abdf5571190 tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:55.043908 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-113abd87-f792-4b20-9b64-5abdf5571190 tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:55.044444 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-113abd87-f792-4b20-9b64-5abdf5571190 tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:55.074049 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-8cbb0bbd-3163-4880-811d-7337ea1eda9c tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.813334 Sep 14 09:06:55.074739 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2018/4055] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 09:06:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1820 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:06:55.090088 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-39c2119d-d292-48ce-ba12-6ffd090430b1 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:55.092176 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-39c2119d-d292-48ce-ba12-6ffd090430b1 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:55.101645 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-39c2119d-d292-48ce-ba12-6ffd090430b1 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:55.102415 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-39c2119d-d292-48ce-ba12-6ffd090430b1 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:55.103794 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-39c2119d-d292-48ce-ba12-6ffd090430b1 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:55.104741 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-39c2119d-d292-48ce-ba12-6ffd090430b1 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:55.105369 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-39c2119d-d292-48ce-ba12-6ffd090430b1 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:55.106033 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-39c2119d-d292-48ce-ba12-6ffd090430b1 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:55.201948 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-113abd87-f792-4b20-9b64-5abdf5571190 tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] 10.222.0.60 "DELETE /compute/v2.1/servers/fb0ed293-ad31-4733-9318-c38b86e7bf45/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.187159 Sep 14 09:06:55.204102 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2038/4056] 10.222.0.60 () {58 vars in 1296 bytes} [Wed Sep 14 09:06:55 2022] DELETE /compute/v2.1/servers/fb0ed293-ad31-4733-9318-c38b86e7bf45/os-server-password => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:06:55.216381 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-05324167-d3aa-4b2c-8726-858853836204 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:55.219912 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-05324167-d3aa-4b2c-8726-858853836204 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] [instance: c07aefa3-4ced-496c-9397-abae833e373d] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:55.305347 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-39c2119d-d292-48ce-ba12-6ffd090430b1 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:06:55.320744 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-39c2119d-d292-48ce-ba12-6ffd090430b1 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1506 microversion: 2.1 time: 0.242534 Sep 14 09:06:55.321983 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2019/4057] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:06:55 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1506 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:06:55.332619 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-7edddf4d-8f36-4c21-8bde-1c500ad05e4a tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:55.334702 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-7edddf4d-8f36-4c21-8bde-1c500ad05e4a tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] [instance: fb0ed293-ad31-4733-9318-c38b86e7bf45] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:55.347625 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7edddf4d-8f36-4c21-8bde-1c500ad05e4a tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:55.350632 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7edddf4d-8f36-4c21-8bde-1c500ad05e4a tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:55.355420 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7edddf4d-8f36-4c21-8bde-1c500ad05e4a tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:55.356335 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7edddf4d-8f36-4c21-8bde-1c500ad05e4a tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:55.356933 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7edddf4d-8f36-4c21-8bde-1c500ad05e4a tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:55.357893 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7edddf4d-8f36-4c21-8bde-1c500ad05e4a tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:55.364861 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-05324167-d3aa-4b2c-8726-858853836204 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fffaf9fa0894fe3b4ba967e0854d50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6c30be307734cecbb607753f3345c7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:06:55.378787 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-05324167-d3aa-4b2c-8726-858853836204 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] 10.222.0.60 "GET /compute/v2.1/servers/c07aefa3-4ced-496c-9397-abae833e373d" status: 200 len: 1227 microversion: 2.1 time: 0.170614 Sep 14 09:06:55.383658 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2039/4058] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:06:55 2022] GET /compute/v2.1/servers/c07aefa3-4ced-496c-9397-abae833e373d => generated 1227 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:06:55.394447 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-4b97aa11-72c5-4942-876e-f1a5b486e62d tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:55.399398 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-4b97aa11-72c5-4942-876e-f1a5b486e62d tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:55.418073 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4b97aa11-72c5-4942-876e-f1a5b486e62d tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:55.418584 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4b97aa11-72c5-4942-876e-f1a5b486e62d tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:55.419048 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4b97aa11-72c5-4942-876e-f1a5b486e62d tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:55.423941 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4b97aa11-72c5-4942-876e-f1a5b486e62d tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:55.427086 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4b97aa11-72c5-4942-876e-f1a5b486e62d tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:55.427704 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4b97aa11-72c5-4942-876e-f1a5b486e62d tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:55.442154 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-7edddf4d-8f36-4c21-8bde-1c500ad05e4a tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] 10.222.0.60 "GET /compute/v2.1/servers/fb0ed293-ad31-4733-9318-c38b86e7bf45/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.118804 Sep 14 09:06:55.448804 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2020/4059] 10.222.0.60 () {58 vars in 1293 bytes} [Wed Sep 14 09:06:55 2022] GET /compute/v2.1/servers/fb0ed293-ad31-4733-9318-c38b86e7bf45/os-server-password => generated 16 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 09:06:55.461802 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-0524b271-f9c9-41ff-9f4d-3f80d69cf290 tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:55.463071 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-0524b271-f9c9-41ff-9f4d-3f80d69cf290 tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] [instance: fb0ed293-ad31-4733-9318-c38b86e7bf45] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:55.479086 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0524b271-f9c9-41ff-9f4d-3f80d69cf290 tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:55.479603 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0524b271-f9c9-41ff-9f4d-3f80d69cf290 tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:55.480054 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0524b271-f9c9-41ff-9f4d-3f80d69cf290 tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:55.480763 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0524b271-f9c9-41ff-9f4d-3f80d69cf290 tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:55.488882 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0524b271-f9c9-41ff-9f4d-3f80d69cf290 tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:55.489545 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0524b271-f9c9-41ff-9f4d-3f80d69cf290 tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:55.541184 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-0524b271-f9c9-41ff-9f4d-3f80d69cf290 tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] [instance: fb0ed293-ad31-4733-9318-c38b86e7bf45] Going to try to terminate instance {{(pid=128759) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:06:55.794418 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-0524b271-f9c9-41ff-9f4d-3f80d69cf290 tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] 10.222.0.60 "DELETE /compute/v2.1/servers/fb0ed293-ad31-4733-9318-c38b86e7bf45" status: 204 len: 0 microversion: 2.1 time: 0.340530 Sep 14 09:06:55.797247 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2021/4060] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:06:55 2022] DELETE /compute/v2.1/servers/fb0ed293-ad31-4733-9318-c38b86e7bf45 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:06:55.807583 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9a92b095-2bc6-4309-96dc-64003944311a tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:55.808493 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-9a92b095-2bc6-4309-96dc-64003944311a tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] [instance: fb0ed293-ad31-4733-9318-c38b86e7bf45] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:55.829671 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9a92b095-2bc6-4309-96dc-64003944311a tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:55.835323 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9a92b095-2bc6-4309-96dc-64003944311a tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:55.836055 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9a92b095-2bc6-4309-96dc-64003944311a tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:55.836970 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9a92b095-2bc6-4309-96dc-64003944311a tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:55.837602 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9a92b095-2bc6-4309-96dc-64003944311a tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:55.838189 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9a92b095-2bc6-4309-96dc-64003944311a tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:55.862612 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-4b97aa11-72c5-4942-876e-f1a5b486e62d tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:06:55.885420 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-4b97aa11-72c5-4942-876e-f1a5b486e62d tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1506 microversion: 2.1 time: 0.497230 Sep 14 09:06:55.904597 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2040/4061] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:06:55 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1506 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:06:55.918090 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-f7cc1afa-f074-4968-be0e-baecc9f18650 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:06:55.919058 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-f7cc1afa-f074-4968-be0e-baecc9f18650 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:55.934714 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f7cc1afa-f074-4968-be0e-baecc9f18650 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:55.935357 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f7cc1afa-f074-4968-be0e-baecc9f18650 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:55.936043 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f7cc1afa-f074-4968-be0e-baecc9f18650 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:55.937010 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f7cc1afa-f074-4968-be0e-baecc9f18650 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:55.937694 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f7cc1afa-f074-4968-be0e-baecc9f18650 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:55.938364 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f7cc1afa-f074-4968-be0e-baecc9f18650 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:56.010793 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-f7cc1afa-f074-4968-be0e-baecc9f18650 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] HTTP exception thrown: Cannot 'resume' instance ae344b98-a354-4df8-83ba-3c5a786694f4 while it is in vm_state active Sep 14 09:06:56.012578 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-f7cc1afa-f074-4968-be0e-baecc9f18650 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Request method failure captured: Sep 14 09:06:56.012578 n-d-836830-18 devstack@n-api.service[128758]: request: POST /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4/action HTTP/1.1 Sep 14 09:06:56.012578 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 09:06:56.012578 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 09:06:56.012578 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 09:06:56.012578 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 14 Sep 14 09:06:56.012578 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 09:06:56.012578 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 09:06:56.012578 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 09:06:56.012578 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 09:06:56.012578 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZk2EvHIWQyXATvY4f6phbqF3DzIIyaJjJFCE11LxTKbrsndvuk5zoyyEUR0VXx32_kFjD0I6jBROuj0ZPSHQav7u9FFvOPFGrPkf9qZrgXY9k3zAUFrOVfwLECoLZOolubyCPUAGSEOi_HvFIP_Dd_DCbUCKDEGGLtdnAzy2tLCxHs Sep 14 09:06:56.012578 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 09:06:56.012578 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 09:06:56.012578 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 09:06:56.012578 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 09:06:56.012578 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 09:06:56.012578 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 09:06:56.012578 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 6907b82c9d5c4a23a63bbeec31c3c365 Sep 14 09:06:56.012578 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-ServersNegativeTestJSON-1654813540 Sep 14 09:06:56.012578 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 09:06:56.012578 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 09:06:56.012578 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6907b82c9d5c4a23a63bbeec31c3c365"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6907b82c9d5c4a23a63bbeec31c3c365"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6907b82c9d5c4a23a63bbeec31c3c365"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6907b82c9d5c4a23a63bbeec31c3c365"}]}] Sep 14 09:06:56.012578 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-ServersNegativeTestJSON-1654813540 Sep 14 09:06:56.012578 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 6907b82c9d5c4a23a63bbeec31c3c365 Sep 14 09:06:56.012578 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1654813540 Sep 14 09:06:56.012578 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-ServersNegativeTestJSON-1654813540-project Sep 14 09:06:56.012578 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 09:06:56.012578 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 09:06:56.012578 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 79583c4e80a04f138927f09eb4e170f4 Sep 14 09:06:56.012578 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-ServersNegativeTestJSON-1654813540-project Sep 14 09:06:56.012578 n-d-836830-18 devstack@n-api.service[128758]: Sep 14 09:06:56.012578 n-d-836830-18 devstack@n-api.service[128758]: {"resume": {}} Sep 14 09:06:56.012578 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 09:06:56.012578 n-d-836830-18 devstack@n-api.service[128758]: exception: Cannot 'resume' instance ae344b98-a354-4df8-83ba-3c5a786694f4 while it is in vm_state active Sep 14 09:06:56.012578 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': 'ae344b98-a354-4df8-83ba-3c5a786694f4', 'body': {'resume': {}}} Sep 14 09:06:56.012578 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:06:56.012578 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:06:56.012578 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Sep 14 09:06:56.012578 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Sep 14 09:06:56.012578 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 14 09:06:56.012578 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 14 09:06:56.012578 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Sep 14 09:06:56.012578 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 14 09:06:56.012578 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 14 09:06:56.012578 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 14 09:06:56.012578 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ae344b98-a354-4df8-83ba-3c5a786694f4 in vm_state active. Cannot resume while the instance is in this state. Sep 14 09:06:56.012578 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:06:56.012578 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:06:56.012578 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:06:56.012578 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:06:56.012578 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:06:56.012578 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:06:56.012578 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:06:56.012578 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:06:56.012578 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:06:56.012578 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:06:56.012578 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Sep 14 09:06:56.012578 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 14 09:06:56.012578 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 14 09:06:56.012578 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 14 09:06:56.012578 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance ae344b98-a354-4df8-83ba-3c5a786694f4 while it is in vm_state active Sep 14 09:06:56.012578 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:06:56.012578 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:06:56.012578 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:06:56.016116 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:06:56.016116 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:06:56.016116 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:06:56.016116 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:06:56.016116 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:06:56.016116 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance ae344b98-a354-4df8-83ba-3c5a786694f4 while it is in vm_state active Sep 14 09:06:56.016116 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:06:56.035846 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-f7cc1afa-f074-4968-be0e-baecc9f18650 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Returning 409 to user: Cannot 'resume' instance ae344b98-a354-4df8-83ba-3c5a786694f4 while it is in vm_state active {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:06:56.036908 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-f7cc1afa-f074-4968-be0e-baecc9f18650 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "POST /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4/action" status: 409 len: 144 microversion: 2.1 time: 0.123992 Sep 14 09:06:56.043133 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2041/4062] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:06:55 2022] POST /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4/action => generated 144 bytes in 129 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 14 09:06:56.046276 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-739d07cf-f03b-4b71-9ca9-54aaeb8a8f54 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '.version_select at 0x7f7d440275e0>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:56.126468 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-739d07cf-f03b-4b71-9ca9-54aaeb8a8f54 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute/v2.1/images/07477c68-aba6-4fa9-a6a2-3ce18dedfc78" status: 200 len: 1414 microversion: 2.1 time: 0.084086 Sep 14 09:06:56.127870 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2042/4063] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:06:56 2022] GET /compute/v2.1/images/07477c68-aba6-4fa9-a6a2-3ce18dedfc78 => generated 1414 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:06:56.133354 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-10f113fd-f8c0-4728-911e-d55182b95e8c tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:56.137652 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-10f113fd-f8c0-4728-911e-d55182b95e8c tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:56.165897 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-10f113fd-f8c0-4728-911e-d55182b95e8c tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:56.166619 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-10f113fd-f8c0-4728-911e-d55182b95e8c tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:56.167278 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-10f113fd-f8c0-4728-911e-d55182b95e8c tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:56.168052 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-9a92b095-2bc6-4309-96dc-64003944311a tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f1bd1c415841ee98182783de5ef3fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23348c10cb84b6194d31c299dd8394a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:06:56.168249 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-10f113fd-f8c0-4728-911e-d55182b95e8c tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:56.168798 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-10f113fd-f8c0-4728-911e-d55182b95e8c tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:56.171056 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-10f113fd-f8c0-4728-911e-d55182b95e8c tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:56.181652 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-9a92b095-2bc6-4309-96dc-64003944311a tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] 10.222.0.60 "GET /compute/v2.1/servers/fb0ed293-ad31-4733-9318-c38b86e7bf45" status: 200 len: 1507 microversion: 2.1 time: 0.377355 Sep 14 09:06:56.183229 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2022/4064] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:06:55 2022] GET /compute/v2.1/servers/fb0ed293-ad31-4733-9318-c38b86e7bf45 => generated 1507 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:06:56.411930 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8db03f24-f4f9-4eee-b239-69d0dc69cf00 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:56.413577 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-8db03f24-f4f9-4eee-b239-69d0dc69cf00 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] [instance: c07aefa3-4ced-496c-9397-abae833e373d] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:56.431091 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8db03f24-f4f9-4eee-b239-69d0dc69cf00 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:56.433383 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8db03f24-f4f9-4eee-b239-69d0dc69cf00 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:56.435566 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8db03f24-f4f9-4eee-b239-69d0dc69cf00 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:56.437278 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8db03f24-f4f9-4eee-b239-69d0dc69cf00 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:56.439778 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8db03f24-f4f9-4eee-b239-69d0dc69cf00 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:56.442234 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8db03f24-f4f9-4eee-b239-69d0dc69cf00 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:56.556300 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-10f113fd-f8c0-4728-911e-d55182b95e8c tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:06:56.565618 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-10f113fd-f8c0-4728-911e-d55182b95e8c tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1506 microversion: 2.1 time: 0.436162 Sep 14 09:06:56.578536 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2043/4065] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:06:56 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1506 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:06:56.598777 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-773cf181-563a-4614-ad8c-2d7fcca3520e tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:56.600418 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-773cf181-563a-4614-ad8c-2d7fcca3520e tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:56.619474 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-773cf181-563a-4614-ad8c-2d7fcca3520e tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:56.620228 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-773cf181-563a-4614-ad8c-2d7fcca3520e tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:56.620829 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-773cf181-563a-4614-ad8c-2d7fcca3520e tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:56.621704 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-773cf181-563a-4614-ad8c-2d7fcca3520e tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:56.622146 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-8db03f24-f4f9-4eee-b239-69d0dc69cf00 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fffaf9fa0894fe3b4ba967e0854d50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6c30be307734cecbb607753f3345c7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:06:56.622672 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-773cf181-563a-4614-ad8c-2d7fcca3520e tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:56.623570 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-773cf181-563a-4614-ad8c-2d7fcca3520e tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:56.633853 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-8db03f24-f4f9-4eee-b239-69d0dc69cf00 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] 10.222.0.60 "GET /compute/v2.1/servers/c07aefa3-4ced-496c-9397-abae833e373d" status: 200 len: 1223 microversion: 2.1 time: 0.227954 Sep 14 09:06:56.651078 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2023/4066] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:06:56 2022] GET /compute/v2.1/servers/c07aefa3-4ced-496c-9397-abae833e373d => generated 1223 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:06:56.939680 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-773cf181-563a-4614-ad8c-2d7fcca3520e tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:06:56.964181 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-773cf181-563a-4614-ad8c-2d7fcca3520e tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1506 microversion: 2.1 time: 0.370811 Sep 14 09:06:56.968575 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2044/4067] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:06:56 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1506 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:06:57.142781 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-03687cd4-44d1-4b1e-a403-4d197d0040f1 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '.version_select at 0x7f7d48665670>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:57.219580 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d0840d09-2a7e-4684-8a81-603dce46043b tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:57.220261 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-d0840d09-2a7e-4684-8a81-603dce46043b tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] [instance: fb0ed293-ad31-4733-9318-c38b86e7bf45] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:57.228780 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d0840d09-2a7e-4684-8a81-603dce46043b tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:57.229285 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d0840d09-2a7e-4684-8a81-603dce46043b tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:57.229726 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d0840d09-2a7e-4684-8a81-603dce46043b tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:57.230452 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d0840d09-2a7e-4684-8a81-603dce46043b tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:57.230916 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d0840d09-2a7e-4684-8a81-603dce46043b tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:57.258606 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d0840d09-2a7e-4684-8a81-603dce46043b tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:57.293872 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-03687cd4-44d1-4b1e-a403-4d197d0040f1 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute/v2.1/images/07477c68-aba6-4fa9-a6a2-3ce18dedfc78" status: 200 len: 1414 microversion: 2.1 time: 0.154814 Sep 14 09:06:57.313363 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2024/4068] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:06:57 2022] GET /compute/v2.1/images/07477c68-aba6-4fa9-a6a2-3ce18dedfc78 => generated 1414 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:06:57.355742 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-aab38343-984c-44e9-8fbc-bdd18a99175d tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "networks": [{"uuid": "2616a0b0-fea1-46f8-bf23-608a226da1ef"}]}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:06:57.360501 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-aab38343-984c-44e9-8fbc-bdd18a99175d tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Request method failure captured: Sep 14 09:06:57.360501 n-d-836830-18 devstack@n-api.service[128759]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 14 09:06:57.360501 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:06:57.360501 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:06:57.360501 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:06:57.360501 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 160 Sep 14 09:06:57.360501 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:06:57.360501 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:06:57.360501 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:06:57.360501 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:06:57.360501 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZk2EvHIWQyXATvY4f6phbqF3DzIIyaJjJFCE11LxTKbrsndvuk5zoyyEUR0VXx32_kFjD0I6jBROuj0ZPSHQav7u9FFvOPFGrPkf9qZrgXY9k3zAUFrOVfwLECoLZOolubyCPUAGSEOi_HvFIP_Dd_DCbUCKDEGGLtdnAzy2tLCxHs Sep 14 09:06:57.360501 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:06:57.360501 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:06:57.360501 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:06:57.360501 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:06:57.360501 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:06:57.360501 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:06:57.360501 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 6907b82c9d5c4a23a63bbeec31c3c365 Sep 14 09:06:57.360501 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ServersNegativeTestJSON-1654813540 Sep 14 09:06:57.360501 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:06:57.360501 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:06:57.360501 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6907b82c9d5c4a23a63bbeec31c3c365"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6907b82c9d5c4a23a63bbeec31c3c365"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6907b82c9d5c4a23a63bbeec31c3c365"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6907b82c9d5c4a23a63bbeec31c3c365"}]}] Sep 14 09:06:57.360501 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ServersNegativeTestJSON-1654813540 Sep 14 09:06:57.360501 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 6907b82c9d5c4a23a63bbeec31c3c365 Sep 14 09:06:57.360501 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1654813540 Sep 14 09:06:57.360501 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ServersNegativeTestJSON-1654813540-project Sep 14 09:06:57.360501 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:06:57.360501 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:06:57.360501 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 79583c4e80a04f138927f09eb4e170f4 Sep 14 09:06:57.360501 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ServersNegativeTestJSON-1654813540-project Sep 14 09:06:57.360501 n-d-836830-18 devstack@n-api.service[128759]: Sep 14 09:06:57.360501 n-d-836830-18 devstack@n-api.service[128759]: {"server": {"name": "", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "networks": [{"uuid": "2616a0b0-fea1-46f8-bf23-608a226da1ef"}]}} Sep 14 09:06:57.360501 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:06:57.360501 n-d-836830-18 devstack@n-api.service[128759]: exception: Invalid input for field/attribute name. Value: . '' is too short Sep 14 09:06:57.360501 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'body': {'server': {'name': '', 'imageRef': 'bff4ab7f-4846-441f-8940-d96fec4c28e9', 'flavorRef': '452', 'networks': [{'uuid': '2616a0b0-fea1-46f8-bf23-608a226da1ef'}]}}} Sep 14 09:06:57.360501 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:06:57.360501 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:06:57.360501 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 14 09:06:57.360501 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 14 09:06:57.360501 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 14 09:06:57.360501 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise error Sep 14 09:06:57.360501 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Sep 14 09:06:57.360501 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:57.360501 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Sep 14 09:06:57.360501 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 14 09:06:57.360501 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:57.360501 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 14 09:06:57.360501 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi '' Sep 14 09:06:57.360501 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:57.360501 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:06:57.360501 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:57.360501 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:06:57.360501 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:06:57.360501 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:06:57.360501 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:06:57.360501 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:06:57.360501 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:06:57.360501 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:06:57.360501 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:06:57.360501 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:06:57.360501 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 14 09:06:57.360501 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 14 09:06:57.360501 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 14 09:06:57.360501 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 14 09:06:57.360501 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 14 09:06:57.364189 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 14 09:06:57.364189 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Sep 14 09:06:57.364189 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:57.364189 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:06:57.364189 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:57.364189 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:06:57.364189 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:06:57.364189 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:06:57.364189 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 14 09:06:57.364189 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 14 09:06:57.364189 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Sep 14 09:06:57.364189 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:06:57.372302 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-aab38343-984c-44e9-8fbc-bdd18a99175d tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:06:57.373496 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-aab38343-984c-44e9-8fbc-bdd18a99175d tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.021760 Sep 14 09:06:57.379279 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2025/4069] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 09:06:57 2022] POST /compute/v2.1/servers => generated 108 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 14 09:06:57.391618 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-7585c9e6-0d9b-4419-a116-a4695ef8ea9e tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:57.404385 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-7585c9e6-0d9b-4419-a116-a4695ef8ea9e tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:57.441834 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7585c9e6-0d9b-4419-a116-a4695ef8ea9e tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:57.443006 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7585c9e6-0d9b-4419-a116-a4695ef8ea9e tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:57.445174 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7585c9e6-0d9b-4419-a116-a4695ef8ea9e tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:57.446239 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7585c9e6-0d9b-4419-a116-a4695ef8ea9e tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:57.446961 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7585c9e6-0d9b-4419-a116-a4695ef8ea9e tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:57.447624 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7585c9e6-0d9b-4419-a116-a4695ef8ea9e tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:57.951821 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-d0840d09-2a7e-4684-8a81-603dce46043b tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f1bd1c415841ee98182783de5ef3fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23348c10cb84b6194d31c299dd8394a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:06:57.968249 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-d0840d09-2a7e-4684-8a81-603dce46043b tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] 10.222.0.60 "GET /compute/v2.1/servers/fb0ed293-ad31-4733-9318-c38b86e7bf45" status: 200 len: 1507 microversion: 2.1 time: 0.757125 Sep 14 09:06:57.969920 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2045/4070] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:06:57 2022] GET /compute/v2.1/servers/fb0ed293-ad31-4733-9318-c38b86e7bf45 => generated 1507 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:06:57.981949 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-3328ad4e-5857-4f5d-ba33-7e97005d6e5e tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:57.983972 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-3328ad4e-5857-4f5d-ba33-7e97005d6e5e tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] [instance: c07aefa3-4ced-496c-9397-abae833e373d] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:58.010334 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3328ad4e-5857-4f5d-ba33-7e97005d6e5e tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:58.011999 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3328ad4e-5857-4f5d-ba33-7e97005d6e5e tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:58.014919 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3328ad4e-5857-4f5d-ba33-7e97005d6e5e tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:58.015905 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3328ad4e-5857-4f5d-ba33-7e97005d6e5e tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:58.017444 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3328ad4e-5857-4f5d-ba33-7e97005d6e5e tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:58.018847 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3328ad4e-5857-4f5d-ba33-7e97005d6e5e tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:58.117080 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-7585c9e6-0d9b-4419-a116-a4695ef8ea9e tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:06:58.137979 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-7585c9e6-0d9b-4419-a116-a4695ef8ea9e tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1506 microversion: 2.1 time: 0.750982 Sep 14 09:06:58.139957 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2026/4071] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:06:57 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1506 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:06:58.168432 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-1a63d2eb-9527-4988-882d-be1a762266bc tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:58.169733 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-1a63d2eb-9527-4988-882d-be1a762266bc tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:58.181383 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1a63d2eb-9527-4988-882d-be1a762266bc tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:58.183829 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1a63d2eb-9527-4988-882d-be1a762266bc tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:58.184907 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1a63d2eb-9527-4988-882d-be1a762266bc tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:58.189760 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1a63d2eb-9527-4988-882d-be1a762266bc tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:58.191026 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1a63d2eb-9527-4988-882d-be1a762266bc tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:58.192578 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1a63d2eb-9527-4988-882d-be1a762266bc tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:58.366268 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-3328ad4e-5857-4f5d-ba33-7e97005d6e5e tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fffaf9fa0894fe3b4ba967e0854d50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6c30be307734cecbb607753f3345c7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:06:58.379472 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-3328ad4e-5857-4f5d-ba33-7e97005d6e5e tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] 10.222.0.60 "GET /compute/v2.1/servers/c07aefa3-4ced-496c-9397-abae833e373d" status: 200 len: 1279 microversion: 2.1 time: 0.405227 Sep 14 09:06:58.380305 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2046/4072] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:06:57 2022] GET /compute/v2.1/servers/c07aefa3-4ced-496c-9397-abae833e373d => generated 1279 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:06:58.395708 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-f43e19df-feff-4cfc-aebe-363e065db155 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '.version_select at 0x7f7d3fadf430>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:58.479531 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-f43e19df-feff-4cfc-aebe-363e065db155 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute/v2.1/images/07477c68-aba6-4fa9-a6a2-3ce18dedfc78" status: 200 len: 1414 microversion: 2.1 time: 0.094611 Sep 14 09:06:58.483660 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2047/4073] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:06:58 2022] GET /compute/v2.1/images/07477c68-aba6-4fa9-a6a2-3ce18dedfc78 => generated 1414 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:06:58.755334 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-1a63d2eb-9527-4988-882d-be1a762266bc tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:06:58.772087 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-1a63d2eb-9527-4988-882d-be1a762266bc tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1506 microversion: 2.1 time: 0.606554 Sep 14 09:06:58.773419 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2027/4074] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:06:58 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1506 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:06:58.799412 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d468f8d7-54cf-484f-9d43-d01d528c07b6 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:06:58.799966 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-d468f8d7-54cf-484f-9d43-d01d528c07b6 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: 8905b29a-7a5b-4432-bad7-9404ecf3a9f5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:58.811412 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-d468f8d7-54cf-484f-9d43-d01d528c07b6 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] HTTP exception thrown: Instance 8905b29a-7a5b-4432-bad7-9404ecf3a9f5 could not be found. Sep 14 09:06:58.816309 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d468f8d7-54cf-484f-9d43-d01d528c07b6 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Request method failure captured: Sep 14 09:06:58.816309 n-d-836830-18 devstack@n-api.service[128758]: request: POST /compute/v2.1/servers/8905b29a-7a5b-4432-bad7-9404ecf3a9f5/action HTTP/1.1 Sep 14 09:06:58.816309 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 09:06:58.816309 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 09:06:58.816309 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 09:06:58.816309 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 14 Sep 14 09:06:58.816309 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 09:06:58.816309 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 09:06:58.816309 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 09:06:58.816309 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 09:06:58.816309 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZk2EvHIWQyXATvY4f6phbqF3DzIIyaJjJFCE11LxTKbrsndvuk5zoyyEUR0VXx32_kFjD0I6jBROuj0ZPSHQav7u9FFvOPFGrPkf9qZrgXY9k3zAUFrOVfwLECoLZOolubyCPUAGSEOi_HvFIP_Dd_DCbUCKDEGGLtdnAzy2tLCxHs Sep 14 09:06:58.816309 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 09:06:58.816309 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 09:06:58.816309 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 09:06:58.816309 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 09:06:58.816309 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 09:06:58.816309 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 09:06:58.816309 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 6907b82c9d5c4a23a63bbeec31c3c365 Sep 14 09:06:58.816309 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-ServersNegativeTestJSON-1654813540 Sep 14 09:06:58.816309 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 09:06:58.816309 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 09:06:58.816309 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6907b82c9d5c4a23a63bbeec31c3c365"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6907b82c9d5c4a23a63bbeec31c3c365"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6907b82c9d5c4a23a63bbeec31c3c365"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6907b82c9d5c4a23a63bbeec31c3c365"}]}] Sep 14 09:06:58.816309 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-ServersNegativeTestJSON-1654813540 Sep 14 09:06:58.816309 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 6907b82c9d5c4a23a63bbeec31c3c365 Sep 14 09:06:58.816309 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1654813540 Sep 14 09:06:58.816309 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-ServersNegativeTestJSON-1654813540-project Sep 14 09:06:58.816309 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 09:06:58.816309 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 09:06:58.816309 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 79583c4e80a04f138927f09eb4e170f4 Sep 14 09:06:58.816309 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-ServersNegativeTestJSON-1654813540-project Sep 14 09:06:58.816309 n-d-836830-18 devstack@n-api.service[128758]: Sep 14 09:06:58.816309 n-d-836830-18 devstack@n-api.service[128758]: {"shelve": {}} Sep 14 09:06:58.816309 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 09:06:58.816309 n-d-836830-18 devstack@n-api.service[128758]: exception: Instance 8905b29a-7a5b-4432-bad7-9404ecf3a9f5 could not be found. Sep 14 09:06:58.816309 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': '8905b29a-7a5b-4432-bad7-9404ecf3a9f5', 'body': {'shelve': {}}} Sep 14 09:06:58.816309 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:06:58.816309 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:06:58.816309 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:06:58.816309 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:06:58.816309 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:06:58.816309 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:06:58.816309 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 14 09:06:58.816309 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 14 09:06:58.816309 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8905b29a-7a5b-4432-bad7-9404ecf3a9f5 could not be found. Sep 14 09:06:58.816309 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:06:58.816309 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:06:58.816309 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:06:58.816309 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:06:58.816309 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:06:58.816309 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:06:58.816309 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:06:58.816309 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:06:58.816309 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:06:58.816309 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:06:58.816309 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Sep 14 09:06:58.816309 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 14 09:06:58.816309 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:06:58.816309 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:06:58.816309 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8905b29a-7a5b-4432-bad7-9404ecf3a9f5 could not be found. Sep 14 09:06:58.816309 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:06:58.816309 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:06:58.816309 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:06:58.816309 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:06:58.816309 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:06:58.816309 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:06:58.824215 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:06:58.824215 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:06:58.824215 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8905b29a-7a5b-4432-bad7-9404ecf3a9f5 could not be found. Sep 14 09:06:58.824215 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:06:58.824215 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d468f8d7-54cf-484f-9d43-d01d528c07b6 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Returning 404 to user: Instance 8905b29a-7a5b-4432-bad7-9404ecf3a9f5 could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:06:58.824215 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-d468f8d7-54cf-484f-9d43-d01d528c07b6 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "POST /compute/v2.1/servers/8905b29a-7a5b-4432-bad7-9404ecf3a9f5/action" status: 404 len: 111 microversion: 2.1 time: 0.026178 Sep 14 09:06:58.824215 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2048/4075] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:06:58 2022] POST /compute/v2.1/servers/8905b29a-7a5b-4432-bad7-9404ecf3a9f5/action => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:06:58.836839 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d94c6213-6798-4ce7-9d4e-32f3a00e961a tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:58.839369 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-d94c6213-6798-4ce7-9d4e-32f3a00e961a tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:58.855184 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d94c6213-6798-4ce7-9d4e-32f3a00e961a tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:58.855790 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d94c6213-6798-4ce7-9d4e-32f3a00e961a tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:58.857057 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d94c6213-6798-4ce7-9d4e-32f3a00e961a tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:58.859154 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d94c6213-6798-4ce7-9d4e-32f3a00e961a tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:58.859856 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d94c6213-6798-4ce7-9d4e-32f3a00e961a tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:58.860437 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d94c6213-6798-4ce7-9d4e-32f3a00e961a tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:59.003797 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-91d3a477-f18c-4775-b05b-721b64ea1047 tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:59.005363 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-91d3a477-f18c-4775-b05b-721b64ea1047 tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] [instance: fb0ed293-ad31-4733-9318-c38b86e7bf45] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:59.027181 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-91d3a477-f18c-4775-b05b-721b64ea1047 tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:59.027943 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-91d3a477-f18c-4775-b05b-721b64ea1047 tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:59.028552 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-91d3a477-f18c-4775-b05b-721b64ea1047 tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:59.029544 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-91d3a477-f18c-4775-b05b-721b64ea1047 tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:59.032493 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-91d3a477-f18c-4775-b05b-721b64ea1047 tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:59.033248 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-91d3a477-f18c-4775-b05b-721b64ea1047 tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:59.352675 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-91d3a477-f18c-4775-b05b-721b64ea1047 tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f1bd1c415841ee98182783de5ef3fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23348c10cb84b6194d31c299dd8394a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:06:59.368260 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-91d3a477-f18c-4775-b05b-721b64ea1047 tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] 10.222.0.60 "GET /compute/v2.1/servers/fb0ed293-ad31-4733-9318-c38b86e7bf45" status: 200 len: 1465 microversion: 2.1 time: 0.375833 Sep 14 09:06:59.369559 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2049/4076] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:06:58 2022] GET /compute/v2.1/servers/fb0ed293-ad31-4733-9318-c38b86e7bf45 => generated 1465 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:06:59.409489 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-49864d1f-fd91-44b8-9f15-f3a8f3a9fcc1 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:59.410928 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-49864d1f-fd91-44b8-9f15-f3a8f3a9fcc1 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] [instance: c07aefa3-4ced-496c-9397-abae833e373d] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:59.433014 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-49864d1f-fd91-44b8-9f15-f3a8f3a9fcc1 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:59.433592 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-49864d1f-fd91-44b8-9f15-f3a8f3a9fcc1 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:59.435363 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-49864d1f-fd91-44b8-9f15-f3a8f3a9fcc1 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:59.436898 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-49864d1f-fd91-44b8-9f15-f3a8f3a9fcc1 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:59.437992 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-49864d1f-fd91-44b8-9f15-f3a8f3a9fcc1 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:59.442559 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-49864d1f-fd91-44b8-9f15-f3a8f3a9fcc1 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:59.542249 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-d94c6213-6798-4ce7-9d4e-32f3a00e961a tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:06:59.568898 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d94c6213-6798-4ce7-9d4e-32f3a00e961a tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1506 microversion: 2.1 time: 0.743625 Sep 14 09:06:59.570115 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2028/4077] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:06:58 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1506 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:06:59.597888 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a466439f-1b7f-4656-ad22-a558528d6d7b tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '.version_select at 0x7f7d3f117280>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:59.666156 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-49864d1f-fd91-44b8-9f15-f3a8f3a9fcc1 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fffaf9fa0894fe3b4ba967e0854d50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6c30be307734cecbb607753f3345c7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:06:59.700407 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-49864d1f-fd91-44b8-9f15-f3a8f3a9fcc1 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] 10.222.0.60 "GET /compute/v2.1/servers/c07aefa3-4ced-496c-9397-abae833e373d" status: 200 len: 1285 microversion: 2.1 time: 0.297285 Sep 14 09:06:59.701263 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2050/4078] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:06:59 2022] GET /compute/v2.1/servers/c07aefa3-4ced-496c-9397-abae833e373d => generated 1285 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:06:59.703828 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a466439f-1b7f-4656-ad22-a558528d6d7b tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute/v2.1/images/07477c68-aba6-4fa9-a6a2-3ce18dedfc78" status: 200 len: 1414 microversion: 2.1 time: 0.132245 Sep 14 09:06:59.726515 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-e75b32d0-c4f4-45e0-a2cf-42b0c3b8d3d1 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:59.727587 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2029/4079] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:06:59 2022] GET /compute/v2.1/images/07477c68-aba6-4fa9-a6a2-3ce18dedfc78 => generated 1414 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:06:59.728308 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-e75b32d0-c4f4-45e0-a2cf-42b0c3b8d3d1 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:06:59.743403 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e75b32d0-c4f4-45e0-a2cf-42b0c3b8d3d1 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:59.743905 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e75b32d0-c4f4-45e0-a2cf-42b0c3b8d3d1 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:59.744349 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e75b32d0-c4f4-45e0-a2cf-42b0c3b8d3d1 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:59.745072 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e75b32d0-c4f4-45e0-a2cf-42b0c3b8d3d1 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:59.746677 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e75b32d0-c4f4-45e0-a2cf-42b0c3b8d3d1 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:59.747356 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e75b32d0-c4f4-45e0-a2cf-42b0c3b8d3d1 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:59.832929 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-8db6dd5f-bfb3-4cf1-ae4d-91e04ec3633e req-01dde1c6-cafd-40d5-87fe-c81543b6cdbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb0ed293-ad31-4733-9318-c38b86e7bf45", "name": "network-vif-deleted", "tag": "0a885251-2109-4da9-bd76-0d3a214c2087"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:06:59.849110 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-8db6dd5f-bfb3-4cf1-ae4d-91e04ec3633e req-01dde1c6-cafd-40d5-87fe-c81543b6cdbf service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:06:59.854482 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-8db6dd5f-bfb3-4cf1-ae4d-91e04ec3633e req-01dde1c6-cafd-40d5-87fe-c81543b6cdbf service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:06:59.855282 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-8db6dd5f-bfb3-4cf1-ae4d-91e04ec3633e req-01dde1c6-cafd-40d5-87fe-c81543b6cdbf service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:06:59.873853 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-8db6dd5f-bfb3-4cf1-ae4d-91e04ec3633e req-01dde1c6-cafd-40d5-87fe-c81543b6cdbf service nova] Creating event network-vif-deleted:0a885251-2109-4da9-bd76-0d3a214c2087 for instance fb0ed293-ad31-4733-9318-c38b86e7bf45 on n-h2-836830-18 Sep 14 09:06:59.880650 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-8db6dd5f-bfb3-4cf1-ae4d-91e04ec3633e req-01dde1c6-cafd-40d5-87fe-c81543b6cdbf service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052771 Sep 14 09:06:59.889753 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2030/4080] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:06:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:07:00.170052 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-e75b32d0-c4f4-45e0-a2cf-42b0c3b8d3d1 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:07:00.181552 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-e75b32d0-c4f4-45e0-a2cf-42b0c3b8d3d1 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1506 microversion: 2.1 time: 0.476371 Sep 14 09:07:00.185480 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2051/4081] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:06:59 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1506 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:07:00.211933 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-1c07e95b-83ca-4aca-bbbc-fc590ea3c5c8 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:07:00.215863 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-1c07e95b-83ca-4aca-bbbc-fc590ea3c5c8 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:07:00.242107 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1c07e95b-83ca-4aca-bbbc-fc590ea3c5c8 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:00.245849 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1c07e95b-83ca-4aca-bbbc-fc590ea3c5c8 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:00.247583 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1c07e95b-83ca-4aca-bbbc-fc590ea3c5c8 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:00.249119 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1c07e95b-83ca-4aca-bbbc-fc590ea3c5c8 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:00.250193 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1c07e95b-83ca-4aca-bbbc-fc590ea3c5c8 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:00.252077 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1c07e95b-83ca-4aca-bbbc-fc590ea3c5c8 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:00.351796 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.objects.instance [None req-1c07e95b-83ca-4aca-bbbc-fc590ea3c5c8 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lazy-loading 'flavor' on Instance uuid ae344b98-a354-4df8-83ba-3c5a786694f4 {{(pid=128759) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:07:00.397853 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-4bf20d25-64ee-4404-a43d-fdfd50dd0ce5 tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:00.398477 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-4bf20d25-64ee-4404-a43d-fdfd50dd0ce5 tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] [instance: fb0ed293-ad31-4733-9318-c38b86e7bf45] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:07:00.406963 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4bf20d25-64ee-4404-a43d-fdfd50dd0ce5 tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:00.407462 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4bf20d25-64ee-4404-a43d-fdfd50dd0ce5 tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:00.407899 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4bf20d25-64ee-4404-a43d-fdfd50dd0ce5 tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:00.408606 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4bf20d25-64ee-4404-a43d-fdfd50dd0ce5 tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:00.409081 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4bf20d25-64ee-4404-a43d-fdfd50dd0ce5 tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:00.409509 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4bf20d25-64ee-4404-a43d-fdfd50dd0ce5 tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:00.418426 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:07:00.542010 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4bf20d25-64ee-4404-a43d-fdfd50dd0ce5 tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:00.542578 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4bf20d25-64ee-4404-a43d-fdfd50dd0ce5 tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:00.542970 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4bf20d25-64ee-4404-a43d-fdfd50dd0ce5 tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:00.551990 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.objects.instance [None req-4bf20d25-64ee-4404-a43d-fdfd50dd0ce5 tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Lazy-loading 'fault' on Instance uuid fb0ed293-ad31-4733-9318-c38b86e7bf45 {{(pid=128758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:07:00.737184 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-4bf20d25-64ee-4404-a43d-fdfd50dd0ce5 tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f1bd1c415841ee98182783de5ef3fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23348c10cb84b6194d31c299dd8394a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:07:00.746606 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-4bf20d25-64ee-4404-a43d-fdfd50dd0ce5 tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] 10.222.0.60 "GET /compute/v2.1/servers/fb0ed293-ad31-4733-9318-c38b86e7bf45" status: 200 len: 1304 microversion: 2.1 time: 0.352836 Sep 14 09:07:00.767928 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2052/4082] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:07:00 2022] GET /compute/v2.1/servers/fb0ed293-ad31-4733-9318-c38b86e7bf45 => generated 1304 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:07:00.863055 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-1c07e95b-83ca-4aca-bbbc-fc590ea3c5c8 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "POST /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4/action" status: 202 len: 0 microversion: 2.1 time: 0.661947 Sep 14 09:07:00.865905 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2031/4083] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:07:00 2022] POST /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4/action => generated 0 bytes in 666 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:07:00.876381 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b239b0f6-4817-43a2-9358-c3ce690357c4 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '.version_select at 0x7f7d4863a9d0>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:00.942467 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b239b0f6-4817-43a2-9358-c3ce690357c4 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute/v2.1/images/07477c68-aba6-4fa9-a6a2-3ce18dedfc78" status: 200 len: 1414 microversion: 2.1 time: 0.074901 Sep 14 09:07:00.952553 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2032/4084] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:07:00 2022] GET /compute/v2.1/images/07477c68-aba6-4fa9-a6a2-3ce18dedfc78 => generated 1414 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:07:00.958675 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ba8bf86c-dc4b-46ce-9a97-5130f66eff20 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:00.960279 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-ba8bf86c-dc4b-46ce-9a97-5130f66eff20 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] [instance: c07aefa3-4ced-496c-9397-abae833e373d] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:07:00.968748 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ba8bf86c-dc4b-46ce-9a97-5130f66eff20 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:00.969582 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ba8bf86c-dc4b-46ce-9a97-5130f66eff20 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:00.970292 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ba8bf86c-dc4b-46ce-9a97-5130f66eff20 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:00.971346 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ba8bf86c-dc4b-46ce-9a97-5130f66eff20 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:00.972137 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ba8bf86c-dc4b-46ce-9a97-5130f66eff20 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:00.973149 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ba8bf86c-dc4b-46ce-9a97-5130f66eff20 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:00.994822 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b5dcc0b1-41e2-4d9b-9f6b-102ebfce4093 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-158620695", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "7289fd96-9cb4-41d4-8aeb-dd7324d8106c"}]}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:07:01.106976 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.network.neutron [None req-b5dcc0b1-41e2-4d9b-9f6b-102ebfce4093 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] validate_networks() for [('7289fd96-9cb4-41d4-8aeb-dd7324d8106c', None, None, None, None, None)] {{(pid=128758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:07:01.148480 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-ba8bf86c-dc4b-46ce-9a97-5130f66eff20 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fffaf9fa0894fe3b4ba967e0854d50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6c30be307734cecbb607753f3345c7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:07:01.165323 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-ba8bf86c-dc4b-46ce-9a97-5130f66eff20 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] 10.222.0.60 "GET /compute/v2.1/servers/c07aefa3-4ced-496c-9397-abae833e373d" status: 200 len: 1285 microversion: 2.1 time: 0.210813 Sep 14 09:07:01.165941 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2033/4085] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:07:00 2022] GET /compute/v2.1/servers/c07aefa3-4ced-496c-9397-abae833e373d => generated 1285 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:07:01.183434 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-896dfc15-0f18-470f-b2cc-10dbecd2dcf3 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:01.184339 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-896dfc15-0f18-470f-b2cc-10dbecd2dcf3 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:07:01.196051 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-896dfc15-0f18-470f-b2cc-10dbecd2dcf3 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:01.196629 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-896dfc15-0f18-470f-b2cc-10dbecd2dcf3 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:01.197150 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-896dfc15-0f18-470f-b2cc-10dbecd2dcf3 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:01.201196 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-896dfc15-0f18-470f-b2cc-10dbecd2dcf3 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:01.202187 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-896dfc15-0f18-470f-b2cc-10dbecd2dcf3 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:01.202744 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-896dfc15-0f18-470f-b2cc-10dbecd2dcf3 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:01.895633 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-896dfc15-0f18-470f-b2cc-10dbecd2dcf3 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:07:01.911388 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-896dfc15-0f18-470f-b2cc-10dbecd2dcf3 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1512 microversion: 2.1 time: 0.744250 Sep 14 09:07:01.915565 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2034/4086] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:07:01 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1512 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:07:01.928899 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-bec5d9b3-99da-44cb-bd7d-505ac287c937 tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:01.929833 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-bec5d9b3-99da-44cb-bd7d-505ac287c937 tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] [instance: fb0ed293-ad31-4733-9318-c38b86e7bf45] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:07:01.942878 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bec5d9b3-99da-44cb-bd7d-505ac287c937 tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:01.945108 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bec5d9b3-99da-44cb-bd7d-505ac287c937 tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:01.946440 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bec5d9b3-99da-44cb-bd7d-505ac287c937 tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:01.947888 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bec5d9b3-99da-44cb-bd7d-505ac287c937 tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:01.950883 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bec5d9b3-99da-44cb-bd7d-505ac287c937 tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:01.951506 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bec5d9b3-99da-44cb-bd7d-505ac287c937 tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:01.979828 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-bec5d9b3-99da-44cb-bd7d-505ac287c937 tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] HTTP exception thrown: Instance fb0ed293-ad31-4733-9318-c38b86e7bf45 could not be found. Sep 14 09:07:01.981672 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-bec5d9b3-99da-44cb-bd7d-505ac287c937 tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Request method failure captured: Sep 14 09:07:01.981672 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/fb0ed293-ad31-4733-9318-c38b86e7bf45 HTTP/1.1 Sep 14 09:07:01.981672 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:07:01.981672 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:07:01.981672 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:07:01.981672 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:07:01.981672 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:07:01.981672 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:07:01.981672 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:07:01.981672 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:07:01.981672 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZmbRD1DqYdr2xCs4EMvYcWhkg6A8kNTGyhF6yq9SM5R0vcare7hYty3C6XB0cmEjM-fu96vPuRFz2507e4qoqhY0aceuNIXxsZckkq2WbzPsBHau0vhWYHd3cGmCzBXycRCwv1wWMlBg35KVydzKsIT00y5ipw4PvSlmcsHjuQC-MQ Sep 14 09:07:01.981672 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:07:01.981672 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:07:01.981672 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:07:01.981672 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:07:01.981672 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:07:01.981672 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:07:01.981672 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: a23348c10cb84b6194d31c299dd8394a Sep 14 09:07:01.981672 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ServerPasswordTestJSON-1107720847 Sep 14 09:07:01.981672 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:07:01.981672 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:07:01.981672 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a23348c10cb84b6194d31c299dd8394a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a23348c10cb84b6194d31c299dd8394a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a23348c10cb84b6194d31c299dd8394a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a23348c10cb84b6194d31c299dd8394a"}]}] Sep 14 09:07:01.981672 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ServerPasswordTestJSON-1107720847 Sep 14 09:07:01.981672 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: a23348c10cb84b6194d31c299dd8394a Sep 14 09:07:01.981672 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ServerPasswordTestJSON-1107720847 Sep 14 09:07:01.981672 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ServerPasswordTestJSON-1107720847-project Sep 14 09:07:01.981672 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:07:01.981672 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:07:01.981672 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 09f1bd1c415841ee98182783de5ef3fe Sep 14 09:07:01.981672 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ServerPasswordTestJSON-1107720847-project Sep 14 09:07:01.981672 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:07:01.981672 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance fb0ed293-ad31-4733-9318-c38b86e7bf45 could not be found. Sep 14 09:07:01.981672 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': 'fb0ed293-ad31-4733-9318-c38b86e7bf45'} Sep 14 09:07:01.981672 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:07:01.981672 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:07:01.981672 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:07:01.981672 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:07:01.981672 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:07:01.981672 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:07:01.981672 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:07:01.981672 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:07:01.981672 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:07:01.981672 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:07:01.981672 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb0ed293-ad31-4733-9318-c38b86e7bf45 could not be found. Sep 14 09:07:01.981672 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:07:01.981672 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:07:01.981672 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:07:01.981672 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:07:01.981672 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:07:01.981672 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:07:01.981672 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:07:01.981672 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:07:01.981672 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:07:01.981672 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:07:01.981672 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:07:01.981672 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:07:01.981672 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:07:01.981672 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:07:01.981672 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:07:01.981672 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:07:01.981672 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb0ed293-ad31-4733-9318-c38b86e7bf45 could not be found. Sep 14 09:07:01.981672 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:07:01.981672 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:07:01.981672 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:07:01.986197 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:07:01.986197 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:07:01.986197 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:07:01.986197 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:07:01.986197 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:07:01.986197 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb0ed293-ad31-4733-9318-c38b86e7bf45 could not be found. Sep 14 09:07:01.986197 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:07:01.986197 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-bec5d9b3-99da-44cb-bd7d-505ac287c937 tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] Returning 404 to user: Instance fb0ed293-ad31-4733-9318-c38b86e7bf45 could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:07:02.001574 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-bec5d9b3-99da-44cb-bd7d-505ac287c937 tempest-ServerPasswordTestJSON-1107720847 tempest-ServerPasswordTestJSON-1107720847-project] 10.222.0.60 "GET /compute/v2.1/servers/fb0ed293-ad31-4733-9318-c38b86e7bf45" status: 404 len: 111 microversion: 2.1 time: 0.065907 Sep 14 09:07:02.006008 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2035/4087] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:07:01 2022] GET /compute/v2.1/servers/fb0ed293-ad31-4733-9318-c38b86e7bf45 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:07:02.032073 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-07afab3e-a789-4b6e-ad82-3301ec70eac9 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '.version_select at 0x7f7d3fc3b9d0>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:02.133574 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-07afab3e-a789-4b6e-ad82-3301ec70eac9 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute/v2.1/images/07477c68-aba6-4fa9-a6a2-3ce18dedfc78" status: 200 len: 1414 microversion: 2.1 time: 0.123975 Sep 14 09:07:02.144069 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2036/4088] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:07:02 2022] GET /compute/v2.1/images/07477c68-aba6-4fa9-a6a2-3ce18dedfc78 => generated 1414 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:07:02.192364 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-7b757f23-368d-4e00-8a96-927751ba7822 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:02.193884 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-7b757f23-368d-4e00-8a96-927751ba7822 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] [instance: c07aefa3-4ced-496c-9397-abae833e373d] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:07:02.208425 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7b757f23-368d-4e00-8a96-927751ba7822 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:02.221619 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7b757f23-368d-4e00-8a96-927751ba7822 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:02.222559 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7b757f23-368d-4e00-8a96-927751ba7822 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:02.227918 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7b757f23-368d-4e00-8a96-927751ba7822 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:02.230413 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7b757f23-368d-4e00-8a96-927751ba7822 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:02.231062 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7b757f23-368d-4e00-8a96-927751ba7822 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:02.565826 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-7b757f23-368d-4e00-8a96-927751ba7822 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fffaf9fa0894fe3b4ba967e0854d50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6c30be307734cecbb607753f3345c7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:07:02.575606 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-b5dcc0b1-41e2-4d9b-9f6b-102ebfce4093 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Flavor limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:07:02.576105 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-b5dcc0b1-41e2-4d9b-9f6b-102ebfce4093 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Image limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:07:02.576505 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-b5dcc0b1-41e2-4d9b-9f6b-102ebfce4093 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Flavor pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:07:02.576930 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-b5dcc0b1-41e2-4d9b-9f6b-102ebfce4093 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Image pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:07:02.577771 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-b5dcc0b1-41e2-4d9b-9f6b-102ebfce4093 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:07:02.596827 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-7b757f23-368d-4e00-8a96-927751ba7822 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] 10.222.0.60 "GET /compute/v2.1/servers/c07aefa3-4ced-496c-9397-abae833e373d" status: 200 len: 1327 microversion: 2.1 time: 0.408520 Sep 14 09:07:02.600160 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2037/4089] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:07:02 2022] GET /compute/v2.1/servers/c07aefa3-4ced-496c-9397-abae833e373d => generated 1327 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:07:02.601971 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b5dcc0b1-41e2-4d9b-9f6b-102ebfce4093 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:02.602549 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b5dcc0b1-41e2-4d9b-9f6b-102ebfce4093 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:02.603053 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b5dcc0b1-41e2-4d9b-9f6b-102ebfce4093 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:02.603727 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b5dcc0b1-41e2-4d9b-9f6b-102ebfce4093 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:02.604191 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b5dcc0b1-41e2-4d9b-9f6b-102ebfce4093 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:02.604655 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b5dcc0b1-41e2-4d9b-9f6b-102ebfce4093 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:02.629362 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=5 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:07:02.667156 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-b5dcc0b1-41e2-4d9b-9f6b-102ebfce4093 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Getting quotas for project 0758124e187342729d19bd4b2a8124a2. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:07:02.672614 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:07:02.674207 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-b5dcc0b1-41e2-4d9b-9f6b-102ebfce4093 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Getting quotas for user d651fdca907b4c23a055a3facfab7f2d and project 0758124e187342729d19bd4b2a8124a2. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:07:02.747518 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-b5dcc0b1-41e2-4d9b-9f6b-102ebfce4093 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Going to run 1 instances... {{(pid=128758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:07:02.752912 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-b5dcc0b1-41e2-4d9b-9f6b-102ebfce4093 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] [instance: b7e289b1-ddfc-4551-8750-8d4e2727fc77] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:07:02.860196 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-fc73860c-140c-4737-b4ca-cc5b3b0bb69b req-341d57c1-0f9c-40a1-9e0a-e1c712dbc69c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed6976ad-867b-4570-a547-758efc8f622f", "name": "network-vif-plugged", "status": "completed", "tag": "5445fa77-c239-4d3c-8132-f14f545198cd"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:07:02.878708 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-fc73860c-140c-4737-b4ca-cc5b3b0bb69b req-341d57c1-0f9c-40a1-9e0a-e1c712dbc69c service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:02.879568 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-fc73860c-140c-4737-b4ca-cc5b3b0bb69b req-341d57c1-0f9c-40a1-9e0a-e1c712dbc69c service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:02.880433 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-fc73860c-140c-4737-b4ca-cc5b3b0bb69b req-341d57c1-0f9c-40a1-9e0a-e1c712dbc69c service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:02.893147 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-b5dcc0b1-41e2-4d9b-9f6b-102ebfce4093 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.117069 Sep 14 09:07:02.898324 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2053/4090] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 09:07:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 2129 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:07:02.923063 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-fc73860c-140c-4737-b4ca-cc5b3b0bb69b req-341d57c1-0f9c-40a1-9e0a-e1c712dbc69c service nova] Creating event network-vif-plugged:5445fa77-c239-4d3c-8132-f14f545198cd for instance ed6976ad-867b-4570-a547-758efc8f622f on n-h1-836830-18 Sep 14 09:07:02.925688 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1c21493f-f792-4bef-989c-d0767bc9eeab tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:02.926441 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-1c21493f-f792-4bef-989c-d0767bc9eeab tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] [instance: b7e289b1-ddfc-4551-8750-8d4e2727fc77] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:07:02.933077 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-fc73860c-140c-4737-b4ca-cc5b3b0bb69b req-341d57c1-0f9c-40a1-9e0a-e1c712dbc69c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077120 Sep 14 09:07:02.934257 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2038/4091] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:07:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:07:02.941321 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-1f3f058c-4b8c-4cc7-a893-6ef30b2ce285 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:02.942589 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-1f3f058c-4b8c-4cc7-a893-6ef30b2ce285 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:07:02.952599 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1f3f058c-4b8c-4cc7-a893-6ef30b2ce285 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:02.954849 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1f3f058c-4b8c-4cc7-a893-6ef30b2ce285 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:02.955792 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1f3f058c-4b8c-4cc7-a893-6ef30b2ce285 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:02.957266 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1f3f058c-4b8c-4cc7-a893-6ef30b2ce285 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:02.958152 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1f3f058c-4b8c-4cc7-a893-6ef30b2ce285 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:02.959356 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1f3f058c-4b8c-4cc7-a893-6ef30b2ce285 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:03.197210 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-1c21493f-f792-4bef-989c-d0767bc9eeab tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd651fdca907b4c23a055a3facfab7f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0758124e187342729d19bd4b2a8124a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:07:03.211260 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-1c21493f-f792-4bef-989c-d0767bc9eeab tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] 10.222.0.60 "GET /compute/v2.1/servers/b7e289b1-ddfc-4551-8750-8d4e2727fc77" status: 200 len: 1223 microversion: 2.1 time: 0.293059 Sep 14 09:07:03.217692 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2054/4092] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:07:02 2022] GET /compute/v2.1/servers/b7e289b1-ddfc-4551-8750-8d4e2727fc77 => generated 1223 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:07:03.233332 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-097bcfae-597e-4aaf-903d-938be23b740d tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '.version_select at 0x7f7d44567ee0>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:03.322985 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-097bcfae-597e-4aaf-903d-938be23b740d tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute/v2.1/images/07477c68-aba6-4fa9-a6a2-3ce18dedfc78" status: 200 len: 1414 microversion: 2.1 time: 0.104068 Sep 14 09:07:03.324134 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2055/4093] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:07:03 2022] GET /compute/v2.1/images/07477c68-aba6-4fa9-a6a2-3ce18dedfc78 => generated 1414 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:07:03.583655 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-1f3f058c-4b8c-4cc7-a893-6ef30b2ce285 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:07:03.595073 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-1f3f058c-4b8c-4cc7-a893-6ef30b2ce285 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1512 microversion: 2.1 time: 0.658855 Sep 14 09:07:03.595967 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2039/4094] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:07:02 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1512 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:07:03.623238 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-70ccc793-ea2d-4dad-9933-1f8108cfef49 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:03.624201 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-70ccc793-ea2d-4dad-9933-1f8108cfef49 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] [instance: c07aefa3-4ced-496c-9397-abae833e373d] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:07:03.642695 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-70ccc793-ea2d-4dad-9933-1f8108cfef49 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:03.649144 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-70ccc793-ea2d-4dad-9933-1f8108cfef49 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:03.652915 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-70ccc793-ea2d-4dad-9933-1f8108cfef49 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:03.660350 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-70ccc793-ea2d-4dad-9933-1f8108cfef49 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:03.664160 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-70ccc793-ea2d-4dad-9933-1f8108cfef49 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:03.668845 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-70ccc793-ea2d-4dad-9933-1f8108cfef49 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:04.238749 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-6918ebe3-7d95-4924-bcde-ff929cc47654 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:04.239490 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-6918ebe3-7d95-4924-bcde-ff929cc47654 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] [instance: b7e289b1-ddfc-4551-8750-8d4e2727fc77] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:07:04.253732 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6918ebe3-7d95-4924-bcde-ff929cc47654 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:04.255078 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6918ebe3-7d95-4924-bcde-ff929cc47654 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:04.257667 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6918ebe3-7d95-4924-bcde-ff929cc47654 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:04.261608 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6918ebe3-7d95-4924-bcde-ff929cc47654 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:04.265071 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6918ebe3-7d95-4924-bcde-ff929cc47654 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:04.265780 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6918ebe3-7d95-4924-bcde-ff929cc47654 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:04.758575 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-6918ebe3-7d95-4924-bcde-ff929cc47654 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd651fdca907b4c23a055a3facfab7f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0758124e187342729d19bd4b2a8124a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:07:04.772142 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-6918ebe3-7d95-4924-bcde-ff929cc47654 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] 10.222.0.60 "GET /compute/v2.1/servers/b7e289b1-ddfc-4551-8750-8d4e2727fc77" status: 200 len: 1219 microversion: 2.1 time: 0.537735 Sep 14 09:07:04.773304 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2040/4095] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:07:04 2022] GET /compute/v2.1/servers/b7e289b1-ddfc-4551-8750-8d4e2727fc77 => generated 1219 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:07:04.781651 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-52f277eb-0cc0-4946-95ac-5b16bc869321 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '.version_select at 0x7f7d3ef83430>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:04.891217 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=2 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:07:04.903854 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-52f277eb-0cc0-4946-95ac-5b16bc869321 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute/v2.1/images/07477c68-aba6-4fa9-a6a2-3ce18dedfc78" status: 200 len: 1414 microversion: 2.1 time: 0.127480 Sep 14 09:07:04.907373 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2041/4096] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:07:04 2022] GET /compute/v2.1/images/07477c68-aba6-4fa9-a6a2-3ce18dedfc78 => generated 1414 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:07:04.921718 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-fd6fa6f1-fca3-44af-8320-7680c64f15f2 req-4d952481-5dab-4284-abb9-c81de1952e90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c07aefa3-4ced-496c-9397-abae833e373d", "tag": "b61b8cc2-7cba-45d5-8c30-c0c62d0cc32a"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:07:04.964670 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-70ccc793-ea2d-4dad-9933-1f8108cfef49 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fffaf9fa0894fe3b4ba967e0854d50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6c30be307734cecbb607753f3345c7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:07:04.976804 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-fd6fa6f1-fca3-44af-8320-7680c64f15f2 req-4d952481-5dab-4284-abb9-c81de1952e90 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:04.977013 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-70ccc793-ea2d-4dad-9933-1f8108cfef49 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] 10.222.0.60 "GET /compute/v2.1/servers/c07aefa3-4ced-496c-9397-abae833e373d" status: 200 len: 1327 microversion: 2.1 time: 1.358289 Sep 14 09:07:04.978500 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2056/4097] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:07:03 2022] GET /compute/v2.1/servers/c07aefa3-4ced-496c-9397-abae833e373d => generated 1327 bytes in 1361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:07:04.978911 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-fd6fa6f1-fca3-44af-8320-7680c64f15f2 req-4d952481-5dab-4284-abb9-c81de1952e90 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:04.981951 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-fd6fa6f1-fca3-44af-8320-7680c64f15f2 req-4d952481-5dab-4284-abb9-c81de1952e90 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:04.992068 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-17277ba7-a1c0-4f4d-a0b1-06a66d514b25 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:04.992697 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-17277ba7-a1c0-4f4d-a0b1-06a66d514b25 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:07:05.008422 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-17277ba7-a1c0-4f4d-a0b1-06a66d514b25 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:05.009190 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-17277ba7-a1c0-4f4d-a0b1-06a66d514b25 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:05.009337 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=6 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:07:05.009924 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-17277ba7-a1c0-4f4d-a0b1-06a66d514b25 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:05.021874 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-17277ba7-a1c0-4f4d-a0b1-06a66d514b25 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:05.022558 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-17277ba7-a1c0-4f4d-a0b1-06a66d514b25 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:05.031026 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-17277ba7-a1c0-4f4d-a0b1-06a66d514b25 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:05.042628 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-fd6fa6f1-fca3-44af-8320-7680c64f15f2 req-4d952481-5dab-4284-abb9-c81de1952e90 service nova] Creating event network-changed:b61b8cc2-7cba-45d5-8c30-c0c62d0cc32a for instance c07aefa3-4ced-496c-9397-abae833e373d on n-h1-836830-18 Sep 14 09:07:05.061071 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-fd6fa6f1-fca3-44af-8320-7680c64f15f2 req-4d952481-5dab-4284-abb9-c81de1952e90 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.150635 Sep 14 09:07:05.070674 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2042/4098] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:07:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:07:05.505860 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-17277ba7-a1c0-4f4d-a0b1-06a66d514b25 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:07:05.519120 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-17277ba7-a1c0-4f4d-a0b1-06a66d514b25 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1512 microversion: 2.1 time: 0.536203 Sep 14 09:07:05.523911 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2057/4099] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:07:04 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1512 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:07:05.798670 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-0d3d06e2-293e-40b4-85a7-0ade69bc00c7 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:05.799501 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-0d3d06e2-293e-40b4-85a7-0ade69bc00c7 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] [instance: b7e289b1-ddfc-4551-8750-8d4e2727fc77] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:07:05.823160 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0d3d06e2-293e-40b4-85a7-0ade69bc00c7 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:05.823740 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0d3d06e2-293e-40b4-85a7-0ade69bc00c7 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:05.824215 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0d3d06e2-293e-40b4-85a7-0ade69bc00c7 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:05.824921 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0d3d06e2-293e-40b4-85a7-0ade69bc00c7 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:05.829001 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0d3d06e2-293e-40b4-85a7-0ade69bc00c7 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:05.829736 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0d3d06e2-293e-40b4-85a7-0ade69bc00c7 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:05.921735 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d809d718-d0b3-4119-ba7d-6a605ee74268 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '.version_select at 0x7f7d3f5fef70>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:06.004865 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-0d3d06e2-293e-40b4-85a7-0ade69bc00c7 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd651fdca907b4c23a055a3facfab7f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0758124e187342729d19bd4b2a8124a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:07:06.009456 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-d809d718-d0b3-4119-ba7d-6a605ee74268 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute/v2.1/images/07477c68-aba6-4fa9-a6a2-3ce18dedfc78" status: 200 len: 1414 microversion: 2.1 time: 0.083981 Sep 14 09:07:06.010107 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2058/4100] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:07:05 2022] GET /compute/v2.1/images/07477c68-aba6-4fa9-a6a2-3ce18dedfc78 => generated 1414 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:07:06.015027 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-0d3d06e2-293e-40b4-85a7-0ade69bc00c7 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] 10.222.0.60 "GET /compute/v2.1/servers/b7e289b1-ddfc-4551-8750-8d4e2727fc77" status: 200 len: 1281 microversion: 2.1 time: 0.220793 Sep 14 09:07:06.025350 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a302a544-f3a8-4294-a331-6316269c2877 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:06.025591 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2043/4101] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:07:05 2022] GET /compute/v2.1/servers/b7e289b1-ddfc-4551-8750-8d4e2727fc77 => generated 1281 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:07:06.039950 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-a302a544-f3a8-4294-a331-6316269c2877 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] [instance: c07aefa3-4ced-496c-9397-abae833e373d] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:07:06.047268 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a302a544-f3a8-4294-a331-6316269c2877 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:06.048034 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a302a544-f3a8-4294-a331-6316269c2877 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:06.048666 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a302a544-f3a8-4294-a331-6316269c2877 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:06.049569 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a302a544-f3a8-4294-a331-6316269c2877 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:06.050180 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a302a544-f3a8-4294-a331-6316269c2877 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:06.051131 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a302a544-f3a8-4294-a331-6316269c2877 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:06.347486 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-a302a544-f3a8-4294-a331-6316269c2877 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fffaf9fa0894fe3b4ba967e0854d50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6c30be307734cecbb607753f3345c7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:07:06.364248 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-a302a544-f3a8-4294-a331-6316269c2877 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] 10.222.0.60 "GET /compute/v2.1/servers/c07aefa3-4ced-496c-9397-abae833e373d" status: 200 len: 1327 microversion: 2.1 time: 0.347754 Sep 14 09:07:06.366040 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2059/4102] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:07:06 2022] GET /compute/v2.1/servers/c07aefa3-4ced-496c-9397-abae833e373d => generated 1327 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:07:06.550731 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-82edb36b-9032-4d1f-b352-95029995ec67 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:06.551441 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-82edb36b-9032-4d1f-b352-95029995ec67 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:07:06.563919 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-82edb36b-9032-4d1f-b352-95029995ec67 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:06.568685 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-82edb36b-9032-4d1f-b352-95029995ec67 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:06.569359 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-82edb36b-9032-4d1f-b352-95029995ec67 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:06.570684 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-82edb36b-9032-4d1f-b352-95029995ec67 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:06.571347 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-82edb36b-9032-4d1f-b352-95029995ec67 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:06.573338 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-82edb36b-9032-4d1f-b352-95029995ec67 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:06.882031 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-82edb36b-9032-4d1f-b352-95029995ec67 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:07:06.897299 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-82edb36b-9032-4d1f-b352-95029995ec67 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1512 microversion: 2.1 time: 0.348568 Sep 14 09:07:06.899640 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2044/4103] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:07:06 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1512 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:07:07.027661 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-3688b2e6-aa62-467e-b7fe-57be43c08eba tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '.version_select at 0x7f7d3f5fe0d0>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:07.049319 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-81b16cae-79b7-408d-83cc-8147d83835f1 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:07.049951 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-81b16cae-79b7-408d-83cc-8147d83835f1 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] [instance: b7e289b1-ddfc-4551-8750-8d4e2727fc77] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:07:07.080531 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-81b16cae-79b7-408d-83cc-8147d83835f1 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:07.081048 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-81b16cae-79b7-408d-83cc-8147d83835f1 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:07.081502 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-81b16cae-79b7-408d-83cc-8147d83835f1 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:07.082235 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-81b16cae-79b7-408d-83cc-8147d83835f1 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:07.082703 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-81b16cae-79b7-408d-83cc-8147d83835f1 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:07.083174 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-81b16cae-79b7-408d-83cc-8147d83835f1 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:07.142280 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-3688b2e6-aa62-467e-b7fe-57be43c08eba tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute/v2.1/images/07477c68-aba6-4fa9-a6a2-3ce18dedfc78" status: 200 len: 1414 microversion: 2.1 time: 0.120760 Sep 14 09:07:07.142880 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2060/4104] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:07:07 2022] GET /compute/v2.1/images/07477c68-aba6-4fa9-a6a2-3ce18dedfc78 => generated 1414 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:07:07.279412 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-81b16cae-79b7-408d-83cc-8147d83835f1 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd651fdca907b4c23a055a3facfab7f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0758124e187342729d19bd4b2a8124a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:07:07.292585 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-81b16cae-79b7-408d-83cc-8147d83835f1 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] 10.222.0.60 "GET /compute/v2.1/servers/b7e289b1-ddfc-4551-8750-8d4e2727fc77" status: 200 len: 1281 microversion: 2.1 time: 0.246544 Sep 14 09:07:07.296007 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2045/4105] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:07:07 2022] GET /compute/v2.1/servers/b7e289b1-ddfc-4551-8750-8d4e2727fc77 => generated 1281 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:07:07.392789 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-75712313-4e10-4f0f-9491-bd5505aa3fa2 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:07.393659 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-75712313-4e10-4f0f-9491-bd5505aa3fa2 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] [instance: c07aefa3-4ced-496c-9397-abae833e373d] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:07:07.407070 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-75712313-4e10-4f0f-9491-bd5505aa3fa2 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:07.407926 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-75712313-4e10-4f0f-9491-bd5505aa3fa2 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:07.408674 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-75712313-4e10-4f0f-9491-bd5505aa3fa2 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:07.409583 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-75712313-4e10-4f0f-9491-bd5505aa3fa2 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:07.411003 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-75712313-4e10-4f0f-9491-bd5505aa3fa2 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:07.412923 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-75712313-4e10-4f0f-9491-bd5505aa3fa2 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:07.928264 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-be576332-4aea-4f78-a438-bbbf26bdbfea tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:07.929929 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-be576332-4aea-4f78-a438-bbbf26bdbfea tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:07:07.945326 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-be576332-4aea-4f78-a438-bbbf26bdbfea tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:07.947520 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-be576332-4aea-4f78-a438-bbbf26bdbfea tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:07.949469 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-be576332-4aea-4f78-a438-bbbf26bdbfea tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:07.950414 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-be576332-4aea-4f78-a438-bbbf26bdbfea tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:07.952884 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-be576332-4aea-4f78-a438-bbbf26bdbfea tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:07.953545 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-be576332-4aea-4f78-a438-bbbf26bdbfea tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:07.968291 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-75712313-4e10-4f0f-9491-bd5505aa3fa2 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fffaf9fa0894fe3b4ba967e0854d50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6c30be307734cecbb607753f3345c7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:07:07.977041 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-75712313-4e10-4f0f-9491-bd5505aa3fa2 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] 10.222.0.60 "GET /compute/v2.1/servers/c07aefa3-4ced-496c-9397-abae833e373d" status: 200 len: 1327 microversion: 2.1 time: 0.589129 Sep 14 09:07:07.981177 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2061/4106] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:07:07 2022] GET /compute/v2.1/servers/c07aefa3-4ced-496c-9397-abae833e373d => generated 1327 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:07:08.159698 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-debc4954-b234-4aed-9101-608b5b92cd9b tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '.version_select at 0x7f7d44567940>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:08.238336 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-debc4954-b234-4aed-9101-608b5b92cd9b tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute/v2.1/images/07477c68-aba6-4fa9-a6a2-3ce18dedfc78" status: 200 len: 1414 microversion: 2.1 time: 0.083780 Sep 14 09:07:08.239323 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2062/4107] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:07:08 2022] GET /compute/v2.1/images/07477c68-aba6-4fa9-a6a2-3ce18dedfc78 => generated 1414 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:07:08.316758 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-0ff2a495-5b8e-4bd1-b123-018cf2f7b2ef tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:08.317952 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-0ff2a495-5b8e-4bd1-b123-018cf2f7b2ef tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] [instance: b7e289b1-ddfc-4551-8750-8d4e2727fc77] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:07:08.329870 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0ff2a495-5b8e-4bd1-b123-018cf2f7b2ef tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:08.339233 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0ff2a495-5b8e-4bd1-b123-018cf2f7b2ef tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:08.339951 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0ff2a495-5b8e-4bd1-b123-018cf2f7b2ef tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:08.341015 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0ff2a495-5b8e-4bd1-b123-018cf2f7b2ef tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:08.341706 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0ff2a495-5b8e-4bd1-b123-018cf2f7b2ef tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:08.342372 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0ff2a495-5b8e-4bd1-b123-018cf2f7b2ef tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:08.581444 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-be576332-4aea-4f78-a438-bbbf26bdbfea tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:07:08.599021 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-be576332-4aea-4f78-a438-bbbf26bdbfea tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1512 microversion: 2.1 time: 0.672781 Sep 14 09:07:08.600315 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2046/4108] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:07:07 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1512 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:07:08.736712 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-0ff2a495-5b8e-4bd1-b123-018cf2f7b2ef tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd651fdca907b4c23a055a3facfab7f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0758124e187342729d19bd4b2a8124a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:07:08.745892 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-0ff2a495-5b8e-4bd1-b123-018cf2f7b2ef tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] 10.222.0.60 "GET /compute/v2.1/servers/b7e289b1-ddfc-4551-8750-8d4e2727fc77" status: 200 len: 1323 microversion: 2.1 time: 0.433792 Sep 14 09:07:08.750356 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2063/4109] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:07:08 2022] GET /compute/v2.1/servers/b7e289b1-ddfc-4551-8750-8d4e2727fc77 => generated 1323 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:07:09.012325 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-cd95a04c-2600-4265-b5e4-130caeab5bf7 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:09.013808 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-cd95a04c-2600-4265-b5e4-130caeab5bf7 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] [instance: c07aefa3-4ced-496c-9397-abae833e373d] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:07:09.047152 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cd95a04c-2600-4265-b5e4-130caeab5bf7 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:09.051247 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cd95a04c-2600-4265-b5e4-130caeab5bf7 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:09.055816 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cd95a04c-2600-4265-b5e4-130caeab5bf7 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:09.056876 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cd95a04c-2600-4265-b5e4-130caeab5bf7 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:09.057549 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cd95a04c-2600-4265-b5e4-130caeab5bf7 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:09.058339 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cd95a04c-2600-4265-b5e4-130caeab5bf7 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:09.254272 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-e4690c34-6770-4ce7-a356-33a329b7ab3a tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '.version_select at 0x7f7d3f591280>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:09.394034 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-e4690c34-6770-4ce7-a356-33a329b7ab3a tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute/v2.1/images/07477c68-aba6-4fa9-a6a2-3ce18dedfc78" status: 200 len: 1414 microversion: 2.1 time: 0.142938 Sep 14 09:07:09.395462 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2064/4110] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:07:09 2022] GET /compute/v2.1/images/07477c68-aba6-4fa9-a6a2-3ce18dedfc78 => generated 1414 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:07:09.482761 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-cd95a04c-2600-4265-b5e4-130caeab5bf7 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fffaf9fa0894fe3b4ba967e0854d50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6c30be307734cecbb607753f3345c7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:07:09.497271 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-cd95a04c-2600-4265-b5e4-130caeab5bf7 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] 10.222.0.60 "GET /compute/v2.1/servers/c07aefa3-4ced-496c-9397-abae833e373d" status: 200 len: 1327 microversion: 2.1 time: 0.491114 Sep 14 09:07:09.499060 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2047/4111] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:07:09 2022] GET /compute/v2.1/servers/c07aefa3-4ced-496c-9397-abae833e373d => generated 1327 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:07:09.624168 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ac758bba-adbb-412d-ad99-40d52285004f tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:09.624853 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-ac758bba-adbb-412d-ad99-40d52285004f tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:07:09.638577 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ac758bba-adbb-412d-ad99-40d52285004f tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:09.641383 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ac758bba-adbb-412d-ad99-40d52285004f tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:09.643649 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ac758bba-adbb-412d-ad99-40d52285004f tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:09.644617 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ac758bba-adbb-412d-ad99-40d52285004f tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:09.647707 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ac758bba-adbb-412d-ad99-40d52285004f tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:09.648352 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ac758bba-adbb-412d-ad99-40d52285004f tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:09.776569 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e369bffe-3da1-42d8-8152-c4eb61350046 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:09.778129 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e369bffe-3da1-42d8-8152-c4eb61350046 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] [instance: b7e289b1-ddfc-4551-8750-8d4e2727fc77] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:07:09.794912 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e369bffe-3da1-42d8-8152-c4eb61350046 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:09.795729 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e369bffe-3da1-42d8-8152-c4eb61350046 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:09.796361 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e369bffe-3da1-42d8-8152-c4eb61350046 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:09.805520 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e369bffe-3da1-42d8-8152-c4eb61350046 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:09.806024 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e369bffe-3da1-42d8-8152-c4eb61350046 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:09.806477 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e369bffe-3da1-42d8-8152-c4eb61350046 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:09.869386 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-ac758bba-adbb-412d-ad99-40d52285004f tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:07:09.879350 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-ac758bba-adbb-412d-ad99-40d52285004f tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1512 microversion: 2.1 time: 0.260672 Sep 14 09:07:09.895723 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2065/4112] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:07:09 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1512 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:07:10.241522 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-e369bffe-3da1-42d8-8152-c4eb61350046 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd651fdca907b4c23a055a3facfab7f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0758124e187342729d19bd4b2a8124a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:07:10.253716 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e369bffe-3da1-42d8-8152-c4eb61350046 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] 10.222.0.60 "GET /compute/v2.1/servers/b7e289b1-ddfc-4551-8750-8d4e2727fc77" status: 200 len: 1323 microversion: 2.1 time: 0.483127 Sep 14 09:07:10.259776 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2048/4113] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:07:09 2022] GET /compute/v2.1/servers/b7e289b1-ddfc-4551-8750-8d4e2727fc77 => generated 1323 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:07:10.423183 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-f29d208f-1a32-425a-8a25-f1e7894334b6 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '.version_select at 0x7f7d44567ee0>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:10.508484 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-f29d208f-1a32-425a-8a25-f1e7894334b6 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute/v2.1/images/07477c68-aba6-4fa9-a6a2-3ce18dedfc78" status: 200 len: 1414 microversion: 2.1 time: 0.089655 Sep 14 09:07:10.510381 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2066/4114] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:07:10 2022] GET /compute/v2.1/images/07477c68-aba6-4fa9-a6a2-3ce18dedfc78 => generated 1414 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:07:10.526608 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-528e2fc1-7f34-496a-8e05-f57cb720b7a4 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:10.528298 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-528e2fc1-7f34-496a-8e05-f57cb720b7a4 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] [instance: c07aefa3-4ced-496c-9397-abae833e373d] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:07:10.535366 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-528e2fc1-7f34-496a-8e05-f57cb720b7a4 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:10.536218 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-528e2fc1-7f34-496a-8e05-f57cb720b7a4 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:10.536954 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-528e2fc1-7f34-496a-8e05-f57cb720b7a4 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:10.538431 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-528e2fc1-7f34-496a-8e05-f57cb720b7a4 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:10.539162 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-528e2fc1-7f34-496a-8e05-f57cb720b7a4 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:10.539825 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-528e2fc1-7f34-496a-8e05-f57cb720b7a4 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:10.915260 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-08e70ca4-b406-471a-b29d-035187d444b5 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:10.916146 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-08e70ca4-b406-471a-b29d-035187d444b5 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:07:10.937765 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-08e70ca4-b406-471a-b29d-035187d444b5 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:10.939268 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-08e70ca4-b406-471a-b29d-035187d444b5 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:10.939914 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-08e70ca4-b406-471a-b29d-035187d444b5 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:10.941160 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-08e70ca4-b406-471a-b29d-035187d444b5 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:10.941770 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-08e70ca4-b406-471a-b29d-035187d444b5 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:10.942392 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-08e70ca4-b406-471a-b29d-035187d444b5 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:10.990088 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-528e2fc1-7f34-496a-8e05-f57cb720b7a4 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fffaf9fa0894fe3b4ba967e0854d50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6c30be307734cecbb607753f3345c7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:07:11.007759 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-528e2fc1-7f34-496a-8e05-f57cb720b7a4 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] 10.222.0.60 "GET /compute/v2.1/servers/c07aefa3-4ced-496c-9397-abae833e373d" status: 200 len: 1327 microversion: 2.1 time: 0.485355 Sep 14 09:07:11.012311 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2049/4115] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:07:10 2022] GET /compute/v2.1/servers/c07aefa3-4ced-496c-9397-abae833e373d => generated 1327 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:07:11.282797 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9e32d93a-b662-4e5a-a6b8-2abf0dcf1429 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:11.284292 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-9e32d93a-b662-4e5a-a6b8-2abf0dcf1429 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] [instance: b7e289b1-ddfc-4551-8750-8d4e2727fc77] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:07:11.297809 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9e32d93a-b662-4e5a-a6b8-2abf0dcf1429 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:11.300848 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9e32d93a-b662-4e5a-a6b8-2abf0dcf1429 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:11.301581 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9e32d93a-b662-4e5a-a6b8-2abf0dcf1429 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:11.302837 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9e32d93a-b662-4e5a-a6b8-2abf0dcf1429 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:11.303818 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9e32d93a-b662-4e5a-a6b8-2abf0dcf1429 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:11.307665 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9e32d93a-b662-4e5a-a6b8-2abf0dcf1429 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:11.347743 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-08e70ca4-b406-471a-b29d-035187d444b5 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:07:11.364692 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-08e70ca4-b406-471a-b29d-035187d444b5 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1512 microversion: 2.1 time: 0.451941 Sep 14 09:07:11.368543 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2067/4116] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:07:10 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1512 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:07:11.528767 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c7f2517c-5c27-474c-926a-27e1e3cf0cb2 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '.version_select at 0x7f7d44478670>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:11.617860 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-c7f2517c-5c27-474c-926a-27e1e3cf0cb2 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute/v2.1/images/07477c68-aba6-4fa9-a6a2-3ce18dedfc78" status: 200 len: 1414 microversion: 2.1 time: 0.093379 Sep 14 09:07:11.619719 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2068/4117] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:07:11 2022] GET /compute/v2.1/images/07477c68-aba6-4fa9-a6a2-3ce18dedfc78 => generated 1414 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:07:11.929445 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-9e32d93a-b662-4e5a-a6b8-2abf0dcf1429 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd651fdca907b4c23a055a3facfab7f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0758124e187342729d19bd4b2a8124a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:07:11.949078 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-9e32d93a-b662-4e5a-a6b8-2abf0dcf1429 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] 10.222.0.60 "GET /compute/v2.1/servers/b7e289b1-ddfc-4551-8750-8d4e2727fc77" status: 200 len: 1323 microversion: 2.1 time: 0.670880 Sep 14 09:07:11.959911 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2050/4118] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:07:11 2022] GET /compute/v2.1/servers/b7e289b1-ddfc-4551-8750-8d4e2727fc77 => generated 1323 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:07:12.037672 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-cf4b5d21-e2d9-43e6-a993-d2d4edc30873 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:12.038372 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-cf4b5d21-e2d9-43e6-a993-d2d4edc30873 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] [instance: c07aefa3-4ced-496c-9397-abae833e373d] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:07:12.053884 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cf4b5d21-e2d9-43e6-a993-d2d4edc30873 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:12.064791 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cf4b5d21-e2d9-43e6-a993-d2d4edc30873 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:12.068917 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cf4b5d21-e2d9-43e6-a993-d2d4edc30873 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:12.071206 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cf4b5d21-e2d9-43e6-a993-d2d4edc30873 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:12.076337 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cf4b5d21-e2d9-43e6-a993-d2d4edc30873 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:12.077574 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cf4b5d21-e2d9-43e6-a993-d2d4edc30873 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:12.400019 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-6aa69dd8-5bdf-4e48-8240-6a4379fd6e64 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:12.401253 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-6aa69dd8-5bdf-4e48-8240-6a4379fd6e64 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:07:12.412924 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6aa69dd8-5bdf-4e48-8240-6a4379fd6e64 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:12.423068 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6aa69dd8-5bdf-4e48-8240-6a4379fd6e64 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:12.423767 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6aa69dd8-5bdf-4e48-8240-6a4379fd6e64 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:12.424726 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6aa69dd8-5bdf-4e48-8240-6a4379fd6e64 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:12.425386 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6aa69dd8-5bdf-4e48-8240-6a4379fd6e64 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:12.426017 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6aa69dd8-5bdf-4e48-8240-6a4379fd6e64 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:12.563467 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-cf4b5d21-e2d9-43e6-a993-d2d4edc30873 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fffaf9fa0894fe3b4ba967e0854d50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6c30be307734cecbb607753f3345c7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:07:12.577738 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-cf4b5d21-e2d9-43e6-a993-d2d4edc30873 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] 10.222.0.60 "GET /compute/v2.1/servers/c07aefa3-4ced-496c-9397-abae833e373d" status: 200 len: 1327 microversion: 2.1 time: 0.544661 Sep 14 09:07:12.579626 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2069/4119] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:07:12 2022] GET /compute/v2.1/servers/c07aefa3-4ced-496c-9397-abae833e373d => generated 1327 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:07:12.639559 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-8a4f2b60-c431-4244-ab82-8eca743e8263 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '.version_select at 0x7f7d487b9670>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:12.664859 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=2 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:07:12.738129 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-8a4f2b60-c431-4244-ab82-8eca743e8263 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute/v2.1/images/07477c68-aba6-4fa9-a6a2-3ce18dedfc78" status: 200 len: 1414 microversion: 2.1 time: 0.101689 Sep 14 09:07:12.743129 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2070/4120] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:07:12 2022] GET /compute/v2.1/images/07477c68-aba6-4fa9-a6a2-3ce18dedfc78 => generated 1414 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:07:12.832862 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-6aa69dd8-5bdf-4e48-8240-6a4379fd6e64 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:07:12.837522 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:07:12.846268 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-6aa69dd8-5bdf-4e48-8240-6a4379fd6e64 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1512 microversion: 2.1 time: 0.450204 Sep 14 09:07:12.846832 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2051/4121] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:07:12 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1512 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:07:12.983417 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ef0a2886-3fac-4be5-b73e-5b1bb466ff09 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:12.984054 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-ef0a2886-3fac-4be5-b73e-5b1bb466ff09 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] [instance: b7e289b1-ddfc-4551-8750-8d4e2727fc77] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:07:12.997372 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ef0a2886-3fac-4be5-b73e-5b1bb466ff09 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:13.008317 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ef0a2886-3fac-4be5-b73e-5b1bb466ff09 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:13.008891 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ef0a2886-3fac-4be5-b73e-5b1bb466ff09 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:13.014165 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ef0a2886-3fac-4be5-b73e-5b1bb466ff09 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:13.015896 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ef0a2886-3fac-4be5-b73e-5b1bb466ff09 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:13.015896 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ef0a2886-3fac-4be5-b73e-5b1bb466ff09 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:13.125374 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-c1e28385-f0b4-4610-ba49-6c5a4e258719 req-e40da8ca-f3cb-4168-af48-5f5d2f966f72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c07aefa3-4ced-496c-9397-abae833e373d", "name": "network-vif-plugged", "status": "completed", "tag": "b61b8cc2-7cba-45d5-8c30-c0c62d0cc32a"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:07:13.148280 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-c1e28385-f0b4-4610-ba49-6c5a4e258719 req-e40da8ca-f3cb-4168-af48-5f5d2f966f72 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:13.148905 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-c1e28385-f0b4-4610-ba49-6c5a4e258719 req-e40da8ca-f3cb-4168-af48-5f5d2f966f72 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:13.150377 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-c1e28385-f0b4-4610-ba49-6c5a4e258719 req-e40da8ca-f3cb-4168-af48-5f5d2f966f72 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:13.173025 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-c1e28385-f0b4-4610-ba49-6c5a4e258719 req-e40da8ca-f3cb-4168-af48-5f5d2f966f72 service nova] Creating event network-vif-plugged:b61b8cc2-7cba-45d5-8c30-c0c62d0cc32a for instance c07aefa3-4ced-496c-9397-abae833e373d on n-h1-836830-18 Sep 14 09:07:13.187873 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-c1e28385-f0b4-4610-ba49-6c5a4e258719 req-e40da8ca-f3cb-4168-af48-5f5d2f966f72 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065336 Sep 14 09:07:13.190895 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2052/4122] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:07:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:07:13.208001 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=10 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:07:13.371158 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-cb826ad7-cb4d-435a-9734-6bb64edd5b31 req-9b4cf558-3859-48ed-89a7-fd28b88d8f53 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7e289b1-ddfc-4551-8750-8d4e2727fc77", "tag": "0fcca4e4-7aac-49d5-b0b0-b07d3ccbe5c8"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:07:13.404061 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-cb826ad7-cb4d-435a-9734-6bb64edd5b31 req-9b4cf558-3859-48ed-89a7-fd28b88d8f53 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:13.404709 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-cb826ad7-cb4d-435a-9734-6bb64edd5b31 req-9b4cf558-3859-48ed-89a7-fd28b88d8f53 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:13.409065 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-cb826ad7-cb4d-435a-9734-6bb64edd5b31 req-9b4cf558-3859-48ed-89a7-fd28b88d8f53 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:13.411800 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-ef0a2886-3fac-4be5-b73e-5b1bb466ff09 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd651fdca907b4c23a055a3facfab7f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0758124e187342729d19bd4b2a8124a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:07:13.425704 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-ef0a2886-3fac-4be5-b73e-5b1bb466ff09 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] 10.222.0.60 "GET /compute/v2.1/servers/b7e289b1-ddfc-4551-8750-8d4e2727fc77" status: 200 len: 1323 microversion: 2.1 time: 0.444631 Sep 14 09:07:13.427298 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2071/4123] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:07:12 2022] GET /compute/v2.1/servers/b7e289b1-ddfc-4551-8750-8d4e2727fc77 => generated 1323 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:07:13.440964 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-cb826ad7-cb4d-435a-9734-6bb64edd5b31 req-9b4cf558-3859-48ed-89a7-fd28b88d8f53 service nova] Creating event network-changed:0fcca4e4-7aac-49d5-b0b0-b07d3ccbe5c8 for instance b7e289b1-ddfc-4551-8750-8d4e2727fc77 on n-h2-836830-18 Sep 14 09:07:13.455193 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-cb826ad7-cb4d-435a-9734-6bb64edd5b31 req-9b4cf558-3859-48ed-89a7-fd28b88d8f53 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091133 Sep 14 09:07:13.456325 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2053/4124] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:07:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:07:13.630575 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-50a747cc-52ac-4085-b9d5-3b6628afb0a8 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:13.631690 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-50a747cc-52ac-4085-b9d5-3b6628afb0a8 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] [instance: c07aefa3-4ced-496c-9397-abae833e373d] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:07:13.655550 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-50a747cc-52ac-4085-b9d5-3b6628afb0a8 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:13.658817 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-50a747cc-52ac-4085-b9d5-3b6628afb0a8 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:13.659958 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-50a747cc-52ac-4085-b9d5-3b6628afb0a8 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:13.670974 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-50a747cc-52ac-4085-b9d5-3b6628afb0a8 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:13.675881 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-50a747cc-52ac-4085-b9d5-3b6628afb0a8 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:13.680086 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-50a747cc-52ac-4085-b9d5-3b6628afb0a8 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:13.761422 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-38f5bb65-609a-4534-97e0-e99f48f7565e tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '.version_select at 0x7f7d48665e50>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:13.871957 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-38f5bb65-609a-4534-97e0-e99f48f7565e tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute/v2.1/images/07477c68-aba6-4fa9-a6a2-3ce18dedfc78" status: 200 len: 1414 microversion: 2.1 time: 0.111913 Sep 14 09:07:13.874781 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2054/4125] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:07:13 2022] GET /compute/v2.1/images/07477c68-aba6-4fa9-a6a2-3ce18dedfc78 => generated 1414 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:07:13.885592 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f5f45412-6908-4eef-a460-8931aac20ca6 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:13.886748 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f5f45412-6908-4eef-a460-8931aac20ca6 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:07:13.902767 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f5f45412-6908-4eef-a460-8931aac20ca6 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:13.903477 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f5f45412-6908-4eef-a460-8931aac20ca6 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:13.904071 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f5f45412-6908-4eef-a460-8931aac20ca6 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:13.904963 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f5f45412-6908-4eef-a460-8931aac20ca6 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:13.905568 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f5f45412-6908-4eef-a460-8931aac20ca6 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:13.907074 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f5f45412-6908-4eef-a460-8931aac20ca6 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:13.959503 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-50a747cc-52ac-4085-b9d5-3b6628afb0a8 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fffaf9fa0894fe3b4ba967e0854d50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6c30be307734cecbb607753f3345c7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:07:13.975547 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-50a747cc-52ac-4085-b9d5-3b6628afb0a8 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] 10.222.0.60 "GET /compute/v2.1/servers/c07aefa3-4ced-496c-9397-abae833e373d" status: 200 len: 1327 microversion: 2.1 time: 0.354737 Sep 14 09:07:13.976368 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2072/4126] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:07:13 2022] GET /compute/v2.1/servers/c07aefa3-4ced-496c-9397-abae833e373d => generated 1327 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:07:14.242288 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f5f45412-6908-4eef-a460-8931aac20ca6 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:07:14.256489 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f5f45412-6908-4eef-a460-8931aac20ca6 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1512 microversion: 2.1 time: 0.378662 Sep 14 09:07:14.275620 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2055/4127] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:07:13 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1512 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:07:14.455660 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-21a4ca46-c834-4d26-9d2c-3082e0ea535e tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:14.456571 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-21a4ca46-c834-4d26-9d2c-3082e0ea535e tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] [instance: b7e289b1-ddfc-4551-8750-8d4e2727fc77] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:07:14.473064 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-21a4ca46-c834-4d26-9d2c-3082e0ea535e tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:14.473694 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-21a4ca46-c834-4d26-9d2c-3082e0ea535e tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:14.477515 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-21a4ca46-c834-4d26-9d2c-3082e0ea535e tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:14.478650 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-21a4ca46-c834-4d26-9d2c-3082e0ea535e tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:14.479476 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-21a4ca46-c834-4d26-9d2c-3082e0ea535e tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:14.480096 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-21a4ca46-c834-4d26-9d2c-3082e0ea535e tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:14.736326 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-21a4ca46-c834-4d26-9d2c-3082e0ea535e tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd651fdca907b4c23a055a3facfab7f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0758124e187342729d19bd4b2a8124a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:07:14.747318 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-21a4ca46-c834-4d26-9d2c-3082e0ea535e tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] 10.222.0.60 "GET /compute/v2.1/servers/b7e289b1-ddfc-4551-8750-8d4e2727fc77" status: 200 len: 1323 microversion: 2.1 time: 0.294112 Sep 14 09:07:14.750214 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2073/4128] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:07:14 2022] GET /compute/v2.1/servers/b7e289b1-ddfc-4551-8750-8d4e2727fc77 => generated 1323 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:07:14.886894 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-29781d6d-e6e1-4aae-b932-ce72bb09db83 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '.version_select at 0x7f7d4863af70>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:14.978175 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-29781d6d-e6e1-4aae-b932-ce72bb09db83 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute/v2.1/images/07477c68-aba6-4fa9-a6a2-3ce18dedfc78" status: 200 len: 1414 microversion: 2.1 time: 0.092656 Sep 14 09:07:14.992295 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2056/4129] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:07:14 2022] GET /compute/v2.1/images/07477c68-aba6-4fa9-a6a2-3ce18dedfc78 => generated 1414 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:07:15.004937 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-8da2db88-7ae4-49a4-9a91-ba4dee82ee3d tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:15.006177 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-8da2db88-7ae4-49a4-9a91-ba4dee82ee3d tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] [instance: c07aefa3-4ced-496c-9397-abae833e373d] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:07:15.019730 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8da2db88-7ae4-49a4-9a91-ba4dee82ee3d tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:15.023469 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8da2db88-7ae4-49a4-9a91-ba4dee82ee3d tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:15.024153 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8da2db88-7ae4-49a4-9a91-ba4dee82ee3d tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:15.025569 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8da2db88-7ae4-49a4-9a91-ba4dee82ee3d tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:15.026632 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8da2db88-7ae4-49a4-9a91-ba4dee82ee3d tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:15.027755 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8da2db88-7ae4-49a4-9a91-ba4dee82ee3d tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:15.286300 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b08f76e5-e48d-466c-be67-cdb0a17a6872 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:15.288785 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b08f76e5-e48d-466c-be67-cdb0a17a6872 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:07:15.299346 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b08f76e5-e48d-466c-be67-cdb0a17a6872 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:15.301168 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b08f76e5-e48d-466c-be67-cdb0a17a6872 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:15.301897 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b08f76e5-e48d-466c-be67-cdb0a17a6872 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:15.303061 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b08f76e5-e48d-466c-be67-cdb0a17a6872 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:15.303779 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b08f76e5-e48d-466c-be67-cdb0a17a6872 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:15.304404 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b08f76e5-e48d-466c-be67-cdb0a17a6872 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:15.440281 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-8da2db88-7ae4-49a4-9a91-ba4dee82ee3d tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fffaf9fa0894fe3b4ba967e0854d50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6c30be307734cecbb607753f3345c7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:07:15.466242 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-8da2db88-7ae4-49a4-9a91-ba4dee82ee3d tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] 10.222.0.60 "GET /compute/v2.1/servers/c07aefa3-4ced-496c-9397-abae833e373d" status: 200 len: 1327 microversion: 2.1 time: 0.465131 Sep 14 09:07:15.476092 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2074/4130] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:07:14 2022] GET /compute/v2.1/servers/c07aefa3-4ced-496c-9397-abae833e373d => generated 1327 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:07:15.770165 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b08f76e5-e48d-466c-be67-cdb0a17a6872 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:07:15.774916 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-5ca165a6-8558-46fc-8fcd-811b15eb8a50 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:15.775696 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-5ca165a6-8558-46fc-8fcd-811b15eb8a50 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] [instance: b7e289b1-ddfc-4551-8750-8d4e2727fc77] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:07:15.779746 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b08f76e5-e48d-466c-be67-cdb0a17a6872 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1512 microversion: 2.1 time: 0.498005 Sep 14 09:07:15.780370 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2057/4131] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:07:15 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1512 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:07:15.796223 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5ca165a6-8558-46fc-8fcd-811b15eb8a50 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:15.801839 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5ca165a6-8558-46fc-8fcd-811b15eb8a50 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:15.802455 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5ca165a6-8558-46fc-8fcd-811b15eb8a50 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:15.803339 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5ca165a6-8558-46fc-8fcd-811b15eb8a50 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:15.803903 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5ca165a6-8558-46fc-8fcd-811b15eb8a50 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:15.804433 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5ca165a6-8558-46fc-8fcd-811b15eb8a50 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:15.995467 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-fcd086ba-2809-4708-acc1-750c5bbe638c tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '.version_select at 0x7f7d3efc2ca0>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:16.072347 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-fcd086ba-2809-4708-acc1-750c5bbe638c tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute/v2.1/images/07477c68-aba6-4fa9-a6a2-3ce18dedfc78" status: 200 len: 1414 microversion: 2.1 time: 0.082415 Sep 14 09:07:16.075239 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2058/4132] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:07:15 2022] GET /compute/v2.1/images/07477c68-aba6-4fa9-a6a2-3ce18dedfc78 => generated 1414 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:07:16.164411 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-5ca165a6-8558-46fc-8fcd-811b15eb8a50 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd651fdca907b4c23a055a3facfab7f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0758124e187342729d19bd4b2a8124a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:07:16.173248 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-5ca165a6-8558-46fc-8fcd-811b15eb8a50 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] 10.222.0.60 "GET /compute/v2.1/servers/b7e289b1-ddfc-4551-8750-8d4e2727fc77" status: 200 len: 1323 microversion: 2.1 time: 0.402994 Sep 14 09:07:16.180389 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2075/4133] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:07:15 2022] GET /compute/v2.1/servers/b7e289b1-ddfc-4551-8750-8d4e2727fc77 => generated 1323 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:07:16.503316 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-29cc4be0-ad3e-43b6-a128-adcd8f337475 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:16.503947 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-29cc4be0-ad3e-43b6-a128-adcd8f337475 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] [instance: c07aefa3-4ced-496c-9397-abae833e373d] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:07:16.515941 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-29cc4be0-ad3e-43b6-a128-adcd8f337475 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:16.516443 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-29cc4be0-ad3e-43b6-a128-adcd8f337475 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:16.516895 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-29cc4be0-ad3e-43b6-a128-adcd8f337475 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:16.517615 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-29cc4be0-ad3e-43b6-a128-adcd8f337475 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:16.518071 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-29cc4be0-ad3e-43b6-a128-adcd8f337475 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:16.518497 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-29cc4be0-ad3e-43b6-a128-adcd8f337475 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:16.804323 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-3beeec32-0c40-4364-96d6-15e507509825 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:16.804955 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-3beeec32-0c40-4364-96d6-15e507509825 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:07:16.817097 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3beeec32-0c40-4364-96d6-15e507509825 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:16.817581 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3beeec32-0c40-4364-96d6-15e507509825 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:16.828824 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3beeec32-0c40-4364-96d6-15e507509825 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:16.832289 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3beeec32-0c40-4364-96d6-15e507509825 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:16.835516 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3beeec32-0c40-4364-96d6-15e507509825 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:16.838710 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3beeec32-0c40-4364-96d6-15e507509825 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:16.852613 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-29cc4be0-ad3e-43b6-a128-adcd8f337475 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fffaf9fa0894fe3b4ba967e0854d50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6c30be307734cecbb607753f3345c7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:07:16.870367 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-29cc4be0-ad3e-43b6-a128-adcd8f337475 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] 10.222.0.60 "GET /compute/v2.1/servers/c07aefa3-4ced-496c-9397-abae833e373d" status: 200 len: 1327 microversion: 2.1 time: 0.372109 Sep 14 09:07:16.886502 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2059/4134] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:07:16 2022] GET /compute/v2.1/servers/c07aefa3-4ced-496c-9397-abae833e373d => generated 1327 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:07:17.089856 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-6545eeef-1eaa-4c11-a8c1-1ccb2d88cb21 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '.version_select at 0x7f7d3ef83700>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:17.170818 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-6545eeef-1eaa-4c11-a8c1-1ccb2d88cb21 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute/v2.1/images/07477c68-aba6-4fa9-a6a2-3ce18dedfc78" status: 200 len: 1414 microversion: 2.1 time: 0.084944 Sep 14 09:07:17.173550 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2060/4135] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:07:17 2022] GET /compute/v2.1/images/07477c68-aba6-4fa9-a6a2-3ce18dedfc78 => generated 1414 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:07:17.204931 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f1406143-e938-44bc-b82a-67cc08f1b52d tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:17.205321 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-3beeec32-0c40-4364-96d6-15e507509825 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:07:17.205800 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f1406143-e938-44bc-b82a-67cc08f1b52d tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] [instance: b7e289b1-ddfc-4551-8750-8d4e2727fc77] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:07:17.214087 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-3beeec32-0c40-4364-96d6-15e507509825 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1533 microversion: 2.1 time: 0.414044 Sep 14 09:07:17.214884 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2076/4136] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:07:16 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1533 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:07:17.215073 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f1406143-e938-44bc-b82a-67cc08f1b52d tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:17.215595 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f1406143-e938-44bc-b82a-67cc08f1b52d tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:17.216133 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f1406143-e938-44bc-b82a-67cc08f1b52d tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:17.217085 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f1406143-e938-44bc-b82a-67cc08f1b52d tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:17.217759 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f1406143-e938-44bc-b82a-67cc08f1b52d tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:17.218288 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f1406143-e938-44bc-b82a-67cc08f1b52d tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:17.497585 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f1406143-e938-44bc-b82a-67cc08f1b52d tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd651fdca907b4c23a055a3facfab7f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0758124e187342729d19bd4b2a8124a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:07:17.513692 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f1406143-e938-44bc-b82a-67cc08f1b52d tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] 10.222.0.60 "GET /compute/v2.1/servers/b7e289b1-ddfc-4551-8750-8d4e2727fc77" status: 200 len: 1323 microversion: 2.1 time: 0.310151 Sep 14 09:07:17.527306 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2061/4137] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:07:17 2022] GET /compute/v2.1/servers/b7e289b1-ddfc-4551-8750-8d4e2727fc77 => generated 1323 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:07:17.910004 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-e849b67e-0eef-45b6-bb33-28ec9b9b2350 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:17.915827 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-e849b67e-0eef-45b6-bb33-28ec9b9b2350 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] [instance: c07aefa3-4ced-496c-9397-abae833e373d] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:07:17.937093 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e849b67e-0eef-45b6-bb33-28ec9b9b2350 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:17.938639 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e849b67e-0eef-45b6-bb33-28ec9b9b2350 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:17.946524 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e849b67e-0eef-45b6-bb33-28ec9b9b2350 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:17.960237 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e849b67e-0eef-45b6-bb33-28ec9b9b2350 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:17.961017 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e849b67e-0eef-45b6-bb33-28ec9b9b2350 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:17.961631 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e849b67e-0eef-45b6-bb33-28ec9b9b2350 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:18.189219 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-5f9380b6-a6b8-4915-a66c-47301dcf7a2f tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '.version_select at 0x7f7d486cd8b0>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:18.279740 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-5f9380b6-a6b8-4915-a66c-47301dcf7a2f tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute/v2.1/images/07477c68-aba6-4fa9-a6a2-3ce18dedfc78" status: 200 len: 1414 microversion: 2.1 time: 0.095115 Sep 14 09:07:18.280343 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2062/4138] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:07:18 2022] GET /compute/v2.1/images/07477c68-aba6-4fa9-a6a2-3ce18dedfc78 => generated 1414 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:07:18.293832 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-bcd4045c-0d00-42a7-886d-9cfadd876326 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:18.298774 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-bcd4045c-0d00-42a7-886d-9cfadd876326 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:07:18.320532 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bcd4045c-0d00-42a7-886d-9cfadd876326 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:18.321320 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bcd4045c-0d00-42a7-886d-9cfadd876326 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:18.337802 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bcd4045c-0d00-42a7-886d-9cfadd876326 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:18.340134 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bcd4045c-0d00-42a7-886d-9cfadd876326 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:18.341349 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bcd4045c-0d00-42a7-886d-9cfadd876326 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:18.341980 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bcd4045c-0d00-42a7-886d-9cfadd876326 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:18.832875 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-e849b67e-0eef-45b6-bb33-28ec9b9b2350 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fffaf9fa0894fe3b4ba967e0854d50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6c30be307734cecbb607753f3345c7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:07:18.845512 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-e849b67e-0eef-45b6-bb33-28ec9b9b2350 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] 10.222.0.60 "GET /compute/v2.1/servers/c07aefa3-4ced-496c-9397-abae833e373d" status: 200 len: 1527 microversion: 2.1 time: 0.953070 Sep 14 09:07:18.850287 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2077/4139] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:07:17 2022] GET /compute/v2.1/servers/c07aefa3-4ced-496c-9397-abae833e373d => generated 1527 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:07:18.861245 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-02b9f49a-99eb-4a40-8d86-6ee5cd9c218d tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:18.862082 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-02b9f49a-99eb-4a40-8d86-6ee5cd9c218d tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] [instance: b7e289b1-ddfc-4551-8750-8d4e2727fc77] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:07:18.874673 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-02b9f49a-99eb-4a40-8d86-6ee5cd9c218d tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:18.877605 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-02b9f49a-99eb-4a40-8d86-6ee5cd9c218d tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:18.878268 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-02b9f49a-99eb-4a40-8d86-6ee5cd9c218d tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:18.879199 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-02b9f49a-99eb-4a40-8d86-6ee5cd9c218d tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:18.881156 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-02b9f49a-99eb-4a40-8d86-6ee5cd9c218d tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:18.881762 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-02b9f49a-99eb-4a40-8d86-6ee5cd9c218d tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:19.327818 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-bcd4045c-0d00-42a7-886d-9cfadd876326 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:07:19.336945 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-bcd4045c-0d00-42a7-886d-9cfadd876326 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1533 microversion: 2.1 time: 1.050686 Sep 14 09:07:19.343383 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2063/4140] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:07:18 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1533 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:07:19.351687 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8509216c-0b6a-4115-b691-4a6ca13bda41 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:19.355007 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-8509216c-0b6a-4115-b691-4a6ca13bda41 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] [instance: c07aefa3-4ced-496c-9397-abae833e373d] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:07:19.370826 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8509216c-0b6a-4115-b691-4a6ca13bda41 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:19.373126 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8509216c-0b6a-4115-b691-4a6ca13bda41 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:19.373818 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8509216c-0b6a-4115-b691-4a6ca13bda41 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:19.375361 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8509216c-0b6a-4115-b691-4a6ca13bda41 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:19.377131 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8509216c-0b6a-4115-b691-4a6ca13bda41 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:19.377750 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8509216c-0b6a-4115-b691-4a6ca13bda41 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:20.399091 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-02b9f49a-99eb-4a40-8d86-6ee5cd9c218d tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd651fdca907b4c23a055a3facfab7f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0758124e187342729d19bd4b2a8124a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:07:20.410442 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-02b9f49a-99eb-4a40-8d86-6ee5cd9c218d tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] 10.222.0.60 "GET /compute/v2.1/servers/b7e289b1-ddfc-4551-8750-8d4e2727fc77" status: 200 len: 1323 microversion: 2.1 time: 1.556304 Sep 14 09:07:20.411344 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2078/4141] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:07:18 2022] GET /compute/v2.1/servers/b7e289b1-ddfc-4551-8750-8d4e2727fc77 => generated 1323 bytes in 1560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:07:20.420580 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-cb93a688-ffde-4c83-b879-71c527db9f0c tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '.version_select at 0x7f7d445593a0>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:20.731963 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-8509216c-0b6a-4115-b691-4a6ca13bda41 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fffaf9fa0894fe3b4ba967e0854d50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6c30be307734cecbb607753f3345c7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:07:20.748259 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-8509216c-0b6a-4115-b691-4a6ca13bda41 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] 10.222.0.60 "GET /compute/v2.1/servers/c07aefa3-4ced-496c-9397-abae833e373d" status: 200 len: 1527 microversion: 2.1 time: 1.401920 Sep 14 09:07:20.749168 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2064/4142] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:07:19 2022] GET /compute/v2.1/servers/c07aefa3-4ced-496c-9397-abae833e373d => generated 1527 bytes in 1405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:07:20.755554 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9d420f9f-6e04-4056-8a71-94dece0cbcf9 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:20.756502 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-9d420f9f-6e04-4056-8a71-94dece0cbcf9 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:07:20.775924 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9d420f9f-6e04-4056-8a71-94dece0cbcf9 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:20.777434 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9d420f9f-6e04-4056-8a71-94dece0cbcf9 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:20.780421 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9d420f9f-6e04-4056-8a71-94dece0cbcf9 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:20.781600 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9d420f9f-6e04-4056-8a71-94dece0cbcf9 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:20.784690 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9d420f9f-6e04-4056-8a71-94dece0cbcf9 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:20.785493 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9d420f9f-6e04-4056-8a71-94dece0cbcf9 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:21.137775 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-9d420f9f-6e04-4056-8a71-94dece0cbcf9 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:07:21.155697 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-9d420f9f-6e04-4056-8a71-94dece0cbcf9 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1528 microversion: 2.1 time: 0.404963 Sep 14 09:07:21.157284 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2065/4143] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:07:20 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1528 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:07:21.578475 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-15347036-e65f-49b1-84bc-5c609b01387d tempest-ServersNegativeTestMultiTenantJSON-550252837 tempest-ServersNegativeTestMultiTenantJSON-550252837-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:21.579538 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-15347036-e65f-49b1-84bc-5c609b01387d tempest-ServersNegativeTestMultiTenantJSON-550252837 tempest-ServersNegativeTestMultiTenantJSON-550252837-project] [instance: c07aefa3-4ced-496c-9397-abae833e373d] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:07:21.601268 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-15347036-e65f-49b1-84bc-5c609b01387d tempest-ServersNegativeTestMultiTenantJSON-550252837 tempest-ServersNegativeTestMultiTenantJSON-550252837-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:21.603112 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-15347036-e65f-49b1-84bc-5c609b01387d tempest-ServersNegativeTestMultiTenantJSON-550252837 tempest-ServersNegativeTestMultiTenantJSON-550252837-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:21.605817 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-15347036-e65f-49b1-84bc-5c609b01387d tempest-ServersNegativeTestMultiTenantJSON-550252837 tempest-ServersNegativeTestMultiTenantJSON-550252837-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:21.606777 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-15347036-e65f-49b1-84bc-5c609b01387d tempest-ServersNegativeTestMultiTenantJSON-550252837 tempest-ServersNegativeTestMultiTenantJSON-550252837-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:21.609874 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-15347036-e65f-49b1-84bc-5c609b01387d tempest-ServersNegativeTestMultiTenantJSON-550252837 tempest-ServersNegativeTestMultiTenantJSON-550252837-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:21.610554 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-15347036-e65f-49b1-84bc-5c609b01387d tempest-ServersNegativeTestMultiTenantJSON-550252837 tempest-ServersNegativeTestMultiTenantJSON-550252837-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:21.647294 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-15347036-e65f-49b1-84bc-5c609b01387d tempest-ServersNegativeTestMultiTenantJSON-550252837 tempest-ServersNegativeTestMultiTenantJSON-550252837-project] HTTP exception thrown: Instance c07aefa3-4ced-496c-9397-abae833e373d could not be found. Sep 14 09:07:21.650136 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-15347036-e65f-49b1-84bc-5c609b01387d tempest-ServersNegativeTestMultiTenantJSON-550252837 tempest-ServersNegativeTestMultiTenantJSON-550252837-project] Request method failure captured: Sep 14 09:07:21.650136 n-d-836830-18 devstack@n-api.service[128759]: request: DELETE /compute/v2.1/servers/c07aefa3-4ced-496c-9397-abae833e373d HTTP/1.1 Sep 14 09:07:21.650136 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:07:21.650136 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:07:21.650136 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:07:21.650136 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:07:21.650136 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:07:21.650136 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:07:21.650136 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:07:21.650136 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:07:21.650136 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZmsUbUqXLHk085v5g1Sd5a3vL57PFrAe8aGEq4Bbmbm1JFtRAKdhgUHGZbkXqM9tUkOvEiDhG3dBBw_lDMhnWeNoAqdP27kn94UkKeHh7FPGRUnhV-9WH-yq2F5Atl0dtp68Wyy1ctvUN1gf9obc8PltcBrw1mvjgKMyit1yj_OE-U Sep 14 09:07:21.650136 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:07:21.650136 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:07:21.650136 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:07:21.650136 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:07:21.650136 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:07:21.650136 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:07:21.650136 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 857b01f7efe04f7fbd3d91b40d8a35b8 Sep 14 09:07:21.650136 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-550252837 Sep 14 09:07:21.650136 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:07:21.650136 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:07:21.650136 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/857b01f7efe04f7fbd3d91b40d8a35b8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_857b01f7efe04f7fbd3d91b40d8a35b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/857b01f7efe04f7fbd3d91b40d8a35b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/857b01f7efe04f7fbd3d91b40d8a35b8"}]}] Sep 14 09:07:21.650136 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-550252837 Sep 14 09:07:21.650136 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 857b01f7efe04f7fbd3d91b40d8a35b8 Sep 14 09:07:21.650136 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-550252837 Sep 14 09:07:21.650136 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ServersNegativeTestMultiTenantJSON-550252837-project Sep 14 09:07:21.650136 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:07:21.650136 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:07:21.650136 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 3c767692ba6b4b2a817311bc4e731ac0 Sep 14 09:07:21.650136 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-550252837-project Sep 14 09:07:21.650136 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:07:21.650136 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance c07aefa3-4ced-496c-9397-abae833e373d could not be found. Sep 14 09:07:21.650136 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': 'c07aefa3-4ced-496c-9397-abae833e373d'} Sep 14 09:07:21.650136 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:07:21.650136 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:07:21.650136 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:07:21.650136 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:07:21.650136 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:07:21.650136 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:07:21.650136 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:07:21.650136 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:07:21.650136 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:07:21.650136 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:07:21.650136 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c07aefa3-4ced-496c-9397-abae833e373d could not be found. Sep 14 09:07:21.650136 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:07:21.650136 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:07:21.650136 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:07:21.650136 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:07:21.650136 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:07:21.650136 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:07:21.650136 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:07:21.650136 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:07:21.650136 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:07:21.650136 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:07:21.650136 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 09:07:21.650136 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 09:07:21.650136 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 09:07:21.650136 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 09:07:21.650136 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:07:21.650136 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:07:21.650136 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:07:21.650136 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:07:21.653914 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c07aefa3-4ced-496c-9397-abae833e373d could not be found. Sep 14 09:07:21.653914 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:07:21.653914 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:07:21.653914 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:07:21.653914 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:07:21.653914 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:07:21.653914 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:07:21.653914 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:07:21.653914 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:07:21.653914 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c07aefa3-4ced-496c-9397-abae833e373d could not be found. Sep 14 09:07:21.653914 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:07:21.656457 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-15347036-e65f-49b1-84bc-5c609b01387d tempest-ServersNegativeTestMultiTenantJSON-550252837 tempest-ServersNegativeTestMultiTenantJSON-550252837-project] Returning 404 to user: Instance c07aefa3-4ced-496c-9397-abae833e373d could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:07:21.657646 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-15347036-e65f-49b1-84bc-5c609b01387d tempest-ServersNegativeTestMultiTenantJSON-550252837 tempest-ServersNegativeTestMultiTenantJSON-550252837-project] 10.222.0.60 "DELETE /compute/v2.1/servers/c07aefa3-4ced-496c-9397-abae833e373d" status: 404 len: 111 microversion: 2.1 time: 0.498954 Sep 14 09:07:21.660258 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2066/4144] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:07:21 2022] DELETE /compute/v2.1/servers/c07aefa3-4ced-496c-9397-abae833e373d => generated 111 bytes in 502 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:07:21.665341 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-87e92481-fb4f-486c-9c4a-285489b835b9 req-e8cdc901-54c1-43eb-938e-b8eeba4b9c5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae344b98-a354-4df8-83ba-3c5a786694f4", "name": "network-vif-plugged", "status": "completed", "tag": "61e7783e-94c8-44e3-8a64-73b1fe49a7cd"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:07:21.677978 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-87e92481-fb4f-486c-9c4a-285489b835b9 req-e8cdc901-54c1-43eb-938e-b8eeba4b9c5c service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:21.678771 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-87e92481-fb4f-486c-9c4a-285489b835b9 req-e8cdc901-54c1-43eb-938e-b8eeba4b9c5c service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:21.679642 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-87e92481-fb4f-486c-9c4a-285489b835b9 req-e8cdc901-54c1-43eb-938e-b8eeba4b9c5c service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:21.694242 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-87e92481-fb4f-486c-9c4a-285489b835b9 req-e8cdc901-54c1-43eb-938e-b8eeba4b9c5c service nova] Creating event network-vif-plugged:61e7783e-94c8-44e3-8a64-73b1fe49a7cd for instance ae344b98-a354-4df8-83ba-3c5a786694f4 on n-h2-836830-18 Sep 14 09:07:21.711373 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-87e92481-fb4f-486c-9c4a-285489b835b9 req-e8cdc901-54c1-43eb-938e-b8eeba4b9c5c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049338 Sep 14 09:07:21.712561 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2067/4145] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:07:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:07:21.719326 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-dff478da-4bdf-489f-9075-d13f487a6d36 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:21.724361 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-dff478da-4bdf-489f-9075-d13f487a6d36 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] [instance: b7e289b1-ddfc-4551-8750-8d4e2727fc77] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:07:21.738795 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dff478da-4bdf-489f-9075-d13f487a6d36 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:21.741106 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dff478da-4bdf-489f-9075-d13f487a6d36 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:21.742128 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dff478da-4bdf-489f-9075-d13f487a6d36 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:21.742877 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dff478da-4bdf-489f-9075-d13f487a6d36 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:21.745660 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dff478da-4bdf-489f-9075-d13f487a6d36 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:21.749047 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dff478da-4bdf-489f-9075-d13f487a6d36 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:22.322289 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-dff478da-4bdf-489f-9075-d13f487a6d36 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd651fdca907b4c23a055a3facfab7f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0758124e187342729d19bd4b2a8124a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:07:22.336233 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-dff478da-4bdf-489f-9075-d13f487a6d36 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] 10.222.0.60 "GET /compute/v2.1/servers/b7e289b1-ddfc-4551-8750-8d4e2727fc77" status: 200 len: 1323 microversion: 2.1 time: 0.622227 Sep 14 09:07:22.347263 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2068/4146] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:07:21 2022] GET /compute/v2.1/servers/b7e289b1-ddfc-4551-8750-8d4e2727fc77 => generated 1323 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:07:22.360330 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-01294e27-afc5-4d8f-a944-6a4fc53fdea8 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:22.363918 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-01294e27-afc5-4d8f-a944-6a4fc53fdea8 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] [instance: c07aefa3-4ced-496c-9397-abae833e373d] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:07:22.385340 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:07:22.388426 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-01294e27-afc5-4d8f-a944-6a4fc53fdea8 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:22.389257 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-01294e27-afc5-4d8f-a944-6a4fc53fdea8 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:22.389871 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-01294e27-afc5-4d8f-a944-6a4fc53fdea8 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:22.390876 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-01294e27-afc5-4d8f-a944-6a4fc53fdea8 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:22.392341 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-01294e27-afc5-4d8f-a944-6a4fc53fdea8 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:22.393294 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-01294e27-afc5-4d8f-a944-6a4fc53fdea8 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:22.884036 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-01294e27-afc5-4d8f-a944-6a4fc53fdea8 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fffaf9fa0894fe3b4ba967e0854d50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6c30be307734cecbb607753f3345c7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:07:22.893036 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-01294e27-afc5-4d8f-a944-6a4fc53fdea8 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] 10.222.0.60 "GET /compute/v2.1/servers/c07aefa3-4ced-496c-9397-abae833e373d" status: 200 len: 1527 microversion: 2.1 time: 0.544339 Sep 14 09:07:22.901973 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2069/4147] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:07:22 2022] GET /compute/v2.1/servers/c07aefa3-4ced-496c-9397-abae833e373d => generated 1527 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:07:22.910815 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f819dc47-0ec0-4276-8dfc-5f09d3157a8a tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:22.912327 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f819dc47-0ec0-4276-8dfc-5f09d3157a8a tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:07:22.933172 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f819dc47-0ec0-4276-8dfc-5f09d3157a8a tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:22.933933 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f819dc47-0ec0-4276-8dfc-5f09d3157a8a tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:22.935391 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f819dc47-0ec0-4276-8dfc-5f09d3157a8a tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:22.936302 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f819dc47-0ec0-4276-8dfc-5f09d3157a8a tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:22.941794 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f819dc47-0ec0-4276-8dfc-5f09d3157a8a tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:22.943700 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f819dc47-0ec0-4276-8dfc-5f09d3157a8a tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:23.247368 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f819dc47-0ec0-4276-8dfc-5f09d3157a8a tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:07:23.273561 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f819dc47-0ec0-4276-8dfc-5f09d3157a8a tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1528 microversion: 2.1 time: 0.364352 Sep 14 09:07:23.297550 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2070/4148] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:07:22 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1528 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:07:23.319254 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c2a10957-28ef-46d0-a84c-3e8ed480a25e tempest-ServersNegativeTestMultiTenantJSON-550252837 tempest-ServersNegativeTestMultiTenantJSON-550252837-project] Action: 'update', calling method: >, body: {"server": {"name": "c07aefa3-4ced-496c-9397-abae833e373d_new"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:07:23.324567 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-c2a10957-28ef-46d0-a84c-3e8ed480a25e tempest-ServersNegativeTestMultiTenantJSON-550252837 tempest-ServersNegativeTestMultiTenantJSON-550252837-project] [instance: c07aefa3-4ced-496c-9397-abae833e373d] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:07:23.341788 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c2a10957-28ef-46d0-a84c-3e8ed480a25e tempest-ServersNegativeTestMultiTenantJSON-550252837 tempest-ServersNegativeTestMultiTenantJSON-550252837-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:23.342307 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c2a10957-28ef-46d0-a84c-3e8ed480a25e tempest-ServersNegativeTestMultiTenantJSON-550252837 tempest-ServersNegativeTestMultiTenantJSON-550252837-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:23.347214 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c2a10957-28ef-46d0-a84c-3e8ed480a25e tempest-ServersNegativeTestMultiTenantJSON-550252837 tempest-ServersNegativeTestMultiTenantJSON-550252837-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:23.348124 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c2a10957-28ef-46d0-a84c-3e8ed480a25e tempest-ServersNegativeTestMultiTenantJSON-550252837 tempest-ServersNegativeTestMultiTenantJSON-550252837-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:23.348615 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c2a10957-28ef-46d0-a84c-3e8ed480a25e tempest-ServersNegativeTestMultiTenantJSON-550252837 tempest-ServersNegativeTestMultiTenantJSON-550252837-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:23.353698 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c2a10957-28ef-46d0-a84c-3e8ed480a25e tempest-ServersNegativeTestMultiTenantJSON-550252837 tempest-ServersNegativeTestMultiTenantJSON-550252837-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:23.381409 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-c2a10957-28ef-46d0-a84c-3e8ed480a25e tempest-ServersNegativeTestMultiTenantJSON-550252837 tempest-ServersNegativeTestMultiTenantJSON-550252837-project] HTTP exception thrown: Instance c07aefa3-4ced-496c-9397-abae833e373d could not be found. Sep 14 09:07:23.383938 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c2a10957-28ef-46d0-a84c-3e8ed480a25e tempest-ServersNegativeTestMultiTenantJSON-550252837 tempest-ServersNegativeTestMultiTenantJSON-550252837-project] Request method failure captured: Sep 14 09:07:23.383938 n-d-836830-18 devstack@n-api.service[128759]: request: PUT /compute/v2.1/servers/c07aefa3-4ced-496c-9397-abae833e373d HTTP/1.1 Sep 14 09:07:23.383938 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:07:23.383938 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:07:23.383938 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:07:23.383938 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 64 Sep 14 09:07:23.383938 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:07:23.383938 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:07:23.383938 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:07:23.383938 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:07:23.383938 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZmsUbUqXLHk085v5g1Sd5a3vL57PFrAe8aGEq4Bbmbm1JFtRAKdhgUHGZbkXqM9tUkOvEiDhG3dBBw_lDMhnWeNoAqdP27kn94UkKeHh7FPGRUnhV-9WH-yq2F5Atl0dtp68Wyy1ctvUN1gf9obc8PltcBrw1mvjgKMyit1yj_OE-U Sep 14 09:07:23.383938 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:07:23.383938 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:07:23.383938 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:07:23.383938 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:07:23.383938 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:07:23.383938 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:07:23.383938 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 857b01f7efe04f7fbd3d91b40d8a35b8 Sep 14 09:07:23.383938 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-550252837 Sep 14 09:07:23.383938 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:07:23.383938 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:07:23.383938 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/857b01f7efe04f7fbd3d91b40d8a35b8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_857b01f7efe04f7fbd3d91b40d8a35b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/857b01f7efe04f7fbd3d91b40d8a35b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/857b01f7efe04f7fbd3d91b40d8a35b8"}]}] Sep 14 09:07:23.383938 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-550252837 Sep 14 09:07:23.383938 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 857b01f7efe04f7fbd3d91b40d8a35b8 Sep 14 09:07:23.383938 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-550252837 Sep 14 09:07:23.383938 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ServersNegativeTestMultiTenantJSON-550252837-project Sep 14 09:07:23.383938 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:07:23.383938 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:07:23.383938 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 3c767692ba6b4b2a817311bc4e731ac0 Sep 14 09:07:23.383938 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-550252837-project Sep 14 09:07:23.383938 n-d-836830-18 devstack@n-api.service[128759]: Sep 14 09:07:23.383938 n-d-836830-18 devstack@n-api.service[128759]: {"server": {"name": "c07aefa3-4ced-496c-9397-abae833e373d_new"}} Sep 14 09:07:23.383938 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:07:23.383938 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance c07aefa3-4ced-496c-9397-abae833e373d could not be found. Sep 14 09:07:23.383938 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': 'c07aefa3-4ced-496c-9397-abae833e373d', 'body': {'server': {'name': 'c07aefa3-4ced-496c-9397-abae833e373d_new'}}} Sep 14 09:07:23.383938 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:07:23.383938 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:07:23.383938 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:07:23.383938 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:07:23.383938 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:07:23.383938 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:07:23.383938 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:07:23.383938 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:07:23.383938 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:07:23.383938 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:07:23.383938 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c07aefa3-4ced-496c-9397-abae833e373d could not be found. Sep 14 09:07:23.383938 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:07:23.383938 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:07:23.383938 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:07:23.383938 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:07:23.383938 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:07:23.383938 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:07:23.383938 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:07:23.383938 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:07:23.383938 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:07:23.383938 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:07:23.383938 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:07:23.383938 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:07:23.383938 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:07:23.383938 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:07:23.383938 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:07:23.383938 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:07:23.383938 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 14 09:07:23.394274 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Sep 14 09:07:23.394274 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Sep 14 09:07:23.394274 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:07:23.394274 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:07:23.394274 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:07:23.394274 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:07:23.394274 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c07aefa3-4ced-496c-9397-abae833e373d could not be found. Sep 14 09:07:23.394274 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:07:23.394274 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:07:23.394274 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:07:23.394274 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:07:23.394274 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:07:23.394274 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:07:23.394274 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:07:23.394274 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:07:23.394274 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c07aefa3-4ced-496c-9397-abae833e373d could not be found. Sep 14 09:07:23.394274 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:07:23.394274 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c2a10957-28ef-46d0-a84c-3e8ed480a25e tempest-ServersNegativeTestMultiTenantJSON-550252837 tempest-ServersNegativeTestMultiTenantJSON-550252837-project] Returning 404 to user: Instance c07aefa3-4ced-496c-9397-abae833e373d could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:07:23.394274 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-c2a10957-28ef-46d0-a84c-3e8ed480a25e tempest-ServersNegativeTestMultiTenantJSON-550252837 tempest-ServersNegativeTestMultiTenantJSON-550252837-project] 10.222.0.60 "PUT /compute/v2.1/servers/c07aefa3-4ced-496c-9397-abae833e373d" status: 404 len: 111 microversion: 2.1 time: 0.097302 Sep 14 09:07:23.394274 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2071/4149] 10.222.0.60 () {60 vars in 1256 bytes} [Wed Sep 14 09:07:23 2022] PUT /compute/v2.1/servers/c07aefa3-4ced-496c-9397-abae833e373d => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:07:23.401741 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f4121dcb-72e9-4f80-aaf8-e9d041fb848b tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:23.402448 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f4121dcb-72e9-4f80-aaf8-e9d041fb848b tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] [instance: b7e289b1-ddfc-4551-8750-8d4e2727fc77] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:07:23.410998 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f4121dcb-72e9-4f80-aaf8-e9d041fb848b tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:23.411563 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f4121dcb-72e9-4f80-aaf8-e9d041fb848b tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:23.412569 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f4121dcb-72e9-4f80-aaf8-e9d041fb848b tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:23.413487 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f4121dcb-72e9-4f80-aaf8-e9d041fb848b tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:23.414005 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f4121dcb-72e9-4f80-aaf8-e9d041fb848b tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:23.414483 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f4121dcb-72e9-4f80-aaf8-e9d041fb848b tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:23.624230 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f4121dcb-72e9-4f80-aaf8-e9d041fb848b tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd651fdca907b4c23a055a3facfab7f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0758124e187342729d19bd4b2a8124a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:07:23.637278 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f4121dcb-72e9-4f80-aaf8-e9d041fb848b tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] 10.222.0.60 "GET /compute/v2.1/servers/b7e289b1-ddfc-4551-8750-8d4e2727fc77" status: 200 len: 1323 microversion: 2.1 time: 0.246406 Sep 14 09:07:23.646974 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2072/4150] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:07:23 2022] GET /compute/v2.1/servers/b7e289b1-ddfc-4551-8750-8d4e2727fc77 => generated 1323 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:07:23.656115 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b4a29051-0452-4de7-a6fd-7fc9ebc7c376 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:23.656652 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b4a29051-0452-4de7-a6fd-7fc9ebc7c376 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] [instance: c07aefa3-4ced-496c-9397-abae833e373d] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:07:23.682965 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b4a29051-0452-4de7-a6fd-7fc9ebc7c376 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:23.690029 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b4a29051-0452-4de7-a6fd-7fc9ebc7c376 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:23.691369 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b4a29051-0452-4de7-a6fd-7fc9ebc7c376 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:23.692347 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b4a29051-0452-4de7-a6fd-7fc9ebc7c376 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:23.695529 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b4a29051-0452-4de7-a6fd-7fc9ebc7c376 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:23.696158 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b4a29051-0452-4de7-a6fd-7fc9ebc7c376 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:23.794212 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b4a29051-0452-4de7-a6fd-7fc9ebc7c376 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] [instance: c07aefa3-4ced-496c-9397-abae833e373d] Going to try to terminate instance {{(pid=128759) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:07:24.045453 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b4a29051-0452-4de7-a6fd-7fc9ebc7c376 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] 10.222.0.60 "DELETE /compute/v2.1/servers/c07aefa3-4ced-496c-9397-abae833e373d" status: 204 len: 0 microversion: 2.1 time: 0.402974 Sep 14 09:07:24.047043 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2073/4151] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:07:23 2022] DELETE /compute/v2.1/servers/c07aefa3-4ced-496c-9397-abae833e373d => generated 0 bytes in 405 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:07:24.064279 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a9e0a3eb-e247-4aac-bced-6d9fd3f4f98c tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:24.065385 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-a9e0a3eb-e247-4aac-bced-6d9fd3f4f98c tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] [instance: c07aefa3-4ced-496c-9397-abae833e373d] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:07:24.078851 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a9e0a3eb-e247-4aac-bced-6d9fd3f4f98c tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:24.083572 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a9e0a3eb-e247-4aac-bced-6d9fd3f4f98c tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:24.084512 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a9e0a3eb-e247-4aac-bced-6d9fd3f4f98c tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:24.085531 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a9e0a3eb-e247-4aac-bced-6d9fd3f4f98c tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:24.086219 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a9e0a3eb-e247-4aac-bced-6d9fd3f4f98c tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:24.092972 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a9e0a3eb-e247-4aac-bced-6d9fd3f4f98c tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:24.365546 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-a9e0a3eb-e247-4aac-bced-6d9fd3f4f98c tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fffaf9fa0894fe3b4ba967e0854d50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6c30be307734cecbb607753f3345c7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:07:24.375215 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a9e0a3eb-e247-4aac-bced-6d9fd3f4f98c tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] 10.222.0.60 "GET /compute/v2.1/servers/c07aefa3-4ced-496c-9397-abae833e373d" status: 200 len: 1533 microversion: 2.1 time: 0.322450 Sep 14 09:07:24.377193 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2074/4152] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:07:24 2022] GET /compute/v2.1/servers/c07aefa3-4ced-496c-9397-abae833e373d => generated 1533 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:07:24.382772 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-be8a0c16-c9f2-46cb-8fab-4cd7949657d9 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:24.383388 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-be8a0c16-c9f2-46cb-8fab-4cd7949657d9 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:07:24.389788 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-be8a0c16-c9f2-46cb-8fab-4cd7949657d9 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:24.390401 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-be8a0c16-c9f2-46cb-8fab-4cd7949657d9 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:24.390955 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-be8a0c16-c9f2-46cb-8fab-4cd7949657d9 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:24.391835 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-be8a0c16-c9f2-46cb-8fab-4cd7949657d9 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:24.392392 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-be8a0c16-c9f2-46cb-8fab-4cd7949657d9 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:24.392988 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-be8a0c16-c9f2-46cb-8fab-4cd7949657d9 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:24.398622 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:07:24.557427 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-be8a0c16-c9f2-46cb-8fab-4cd7949657d9 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:07:24.572500 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-be8a0c16-c9f2-46cb-8fab-4cd7949657d9 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1528 microversion: 2.1 time: 0.192271 Sep 14 09:07:24.593558 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2075/4153] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:07:24 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1528 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:07:24.665529 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f5982579-77df-4ab9-91e4-cb556740b4d6 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:24.665781 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f5982579-77df-4ab9-91e4-cb556740b4d6 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] [instance: b7e289b1-ddfc-4551-8750-8d4e2727fc77] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:07:24.677083 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f5982579-77df-4ab9-91e4-cb556740b4d6 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:24.681519 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f5982579-77df-4ab9-91e4-cb556740b4d6 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:24.684303 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f5982579-77df-4ab9-91e4-cb556740b4d6 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:24.686225 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f5982579-77df-4ab9-91e4-cb556740b4d6 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:24.694386 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f5982579-77df-4ab9-91e4-cb556740b4d6 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:24.695303 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f5982579-77df-4ab9-91e4-cb556740b4d6 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:25.011676 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f5982579-77df-4ab9-91e4-cb556740b4d6 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd651fdca907b4c23a055a3facfab7f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0758124e187342729d19bd4b2a8124a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:07:25.023965 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f5982579-77df-4ab9-91e4-cb556740b4d6 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] 10.222.0.60 "GET /compute/v2.1/servers/b7e289b1-ddfc-4551-8750-8d4e2727fc77" status: 200 len: 1323 microversion: 2.1 time: 0.364697 Sep 14 09:07:25.042430 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2076/4154] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:07:24 2022] GET /compute/v2.1/servers/b7e289b1-ddfc-4551-8750-8d4e2727fc77 => generated 1323 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:07:25.053732 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-729a1a18-03ea-400b-b676-51be640ee427 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:25.054400 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-729a1a18-03ea-400b-b676-51be640ee427 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:07:25.092117 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-729a1a18-03ea-400b-b676-51be640ee427 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:25.102437 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-729a1a18-03ea-400b-b676-51be640ee427 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:25.103081 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-729a1a18-03ea-400b-b676-51be640ee427 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:25.107178 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-729a1a18-03ea-400b-b676-51be640ee427 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:25.107769 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-729a1a18-03ea-400b-b676-51be640ee427 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:25.111656 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-729a1a18-03ea-400b-b676-51be640ee427 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:25.744873 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-729a1a18-03ea-400b-b676-51be640ee427 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:07:25.754117 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-729a1a18-03ea-400b-b676-51be640ee427 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105" status: 200 len: 1668 microversion: 2.1 time: 0.710502 Sep 14 09:07:25.754709 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2077/4155] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:07:25 2022] GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105 => generated 1668 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:07:25.759907 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-8789ec16-7dd8-4497-9e2c-bd3891f62a8c req-0910602e-4b9e-4407-b825-a0d983046fc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7e289b1-ddfc-4551-8750-8d4e2727fc77", "name": "network-vif-plugged", "status": "completed", "tag": "0fcca4e4-7aac-49d5-b0b0-b07d3ccbe5c8"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:07:25.770475 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-8789ec16-7dd8-4497-9e2c-bd3891f62a8c req-0910602e-4b9e-4407-b825-a0d983046fc9 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:25.771473 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-8789ec16-7dd8-4497-9e2c-bd3891f62a8c req-0910602e-4b9e-4407-b825-a0d983046fc9 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:25.772326 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-8789ec16-7dd8-4497-9e2c-bd3891f62a8c req-0910602e-4b9e-4407-b825-a0d983046fc9 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:25.791381 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-8789ec16-7dd8-4497-9e2c-bd3891f62a8c req-0910602e-4b9e-4407-b825-a0d983046fc9 service nova] Creating event network-vif-plugged:0fcca4e4-7aac-49d5-b0b0-b07d3ccbe5c8 for instance b7e289b1-ddfc-4551-8750-8d4e2727fc77 on n-h2-836830-18 Sep 14 09:07:25.822136 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-8789ec16-7dd8-4497-9e2c-bd3891f62a8c req-0910602e-4b9e-4407-b825-a0d983046fc9 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041052 Sep 14 09:07:25.825646 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2078/4156] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:07:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:07:25.838774 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b3df7089-7065-46e0-8491-811d91898189 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:25.839532 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b3df7089-7065-46e0-8491-811d91898189 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] [instance: c07aefa3-4ced-496c-9397-abae833e373d] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:07:25.861251 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b3df7089-7065-46e0-8491-811d91898189 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:25.861774 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b3df7089-7065-46e0-8491-811d91898189 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:25.865792 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b3df7089-7065-46e0-8491-811d91898189 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:25.876191 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b3df7089-7065-46e0-8491-811d91898189 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:25.882248 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b3df7089-7065-46e0-8491-811d91898189 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:25.883115 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b3df7089-7065-46e0-8491-811d91898189 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:26.313433 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-cb93a688-ffde-4c83-b879-71c527db9f0c tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute/v2.1/images/07477c68-aba6-4fa9-a6a2-3ce18dedfc78" status: 200 len: 1423 microversion: 2.1 time: 5.899209 Sep 14 09:07:26.313990 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2079/4157] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:07:20 2022] GET /compute/v2.1/images/07477c68-aba6-4fa9-a6a2-3ce18dedfc78 => generated 1423 bytes in 5901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:07:26.323764 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b80155b0-f07f-417e-89ee-0586f96ac1c1 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:26.331906 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-b80155b0-f07f-417e-89ee-0586f96ac1c1 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:07:26.340024 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b80155b0-f07f-417e-89ee-0586f96ac1c1 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:26.340644 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b80155b0-f07f-417e-89ee-0586f96ac1c1 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:26.341315 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b80155b0-f07f-417e-89ee-0586f96ac1c1 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:26.342353 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b80155b0-f07f-417e-89ee-0586f96ac1c1 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:26.343318 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b80155b0-f07f-417e-89ee-0586f96ac1c1 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:26.353967 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b80155b0-f07f-417e-89ee-0586f96ac1c1 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:26.381962 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=100 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:07:26.717304 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b3df7089-7065-46e0-8491-811d91898189 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fffaf9fa0894fe3b4ba967e0854d50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6c30be307734cecbb607753f3345c7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:07:26.734120 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b3df7089-7065-46e0-8491-811d91898189 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] 10.222.0.60 "GET /compute/v2.1/servers/c07aefa3-4ced-496c-9397-abae833e373d" status: 200 len: 1533 microversion: 2.1 time: 0.906722 Sep 14 09:07:26.737493 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2079/4158] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:07:25 2022] GET /compute/v2.1/servers/c07aefa3-4ced-496c-9397-abae833e373d => generated 1533 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:07:26.761984 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b98ea5ab-8534-4c4f-a387-2701d7d85f1b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:26.762665 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b98ea5ab-8534-4c4f-a387-2701d7d85f1b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:07:26.770039 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b98ea5ab-8534-4c4f-a387-2701d7d85f1b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:26.770602 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b98ea5ab-8534-4c4f-a387-2701d7d85f1b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:26.771981 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b98ea5ab-8534-4c4f-a387-2701d7d85f1b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:26.772683 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b98ea5ab-8534-4c4f-a387-2701d7d85f1b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:26.773217 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b98ea5ab-8534-4c4f-a387-2701d7d85f1b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:26.773663 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b98ea5ab-8534-4c4f-a387-2701d7d85f1b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:27.074267 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-b80155b0-f07f-417e-89ee-0586f96ac1c1 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:07:27.098440 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-b80155b0-f07f-417e-89ee-0586f96ac1c1 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1528 microversion: 2.1 time: 0.780023 Sep 14 09:07:27.099254 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2080/4159] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:07:26 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1528 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:07:27.109792 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-6b247657-444d-4180-bd65-4dc6f3a93391 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:27.110422 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-6b247657-444d-4180-bd65-4dc6f3a93391 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] [instance: b7e289b1-ddfc-4551-8750-8d4e2727fc77] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:07:27.147742 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6b247657-444d-4180-bd65-4dc6f3a93391 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:27.147836 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6b247657-444d-4180-bd65-4dc6f3a93391 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:27.148594 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6b247657-444d-4180-bd65-4dc6f3a93391 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:27.148992 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6b247657-444d-4180-bd65-4dc6f3a93391 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:27.149455 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6b247657-444d-4180-bd65-4dc6f3a93391 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:27.153751 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6b247657-444d-4180-bd65-4dc6f3a93391 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:27.554723 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b98ea5ab-8534-4c4f-a387-2701d7d85f1b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:07:27.586825 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b98ea5ab-8534-4c4f-a387-2701d7d85f1b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105" status: 200 len: 1668 microversion: 2.1 time: 0.830686 Sep 14 09:07:27.590371 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2080/4160] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:07:26 2022] GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105 => generated 1668 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:07:27.598913 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-df719f83-701f-4611-a5e3-ce1d2d3f6450 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '.version_select at 0x7f7d3ef83430>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:27.763629 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-df719f83-701f-4611-a5e3-ce1d2d3f6450 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute/v2.1/images/07477c68-aba6-4fa9-a6a2-3ce18dedfc78" status: 200 len: 1423 microversion: 2.1 time: 0.171371 Sep 14 09:07:27.768599 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2081/4161] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:07:27 2022] GET /compute/v2.1/images/07477c68-aba6-4fa9-a6a2-3ce18dedfc78 => generated 1423 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:07:27.793509 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-70fabee5-0230-4ebb-b6fa-b951638869d6 req-f51bc51a-b3d1-417d-8fa1-ff59aa7a82ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c07aefa3-4ced-496c-9397-abae833e373d", "name": "network-vif-deleted", "tag": "b61b8cc2-7cba-45d5-8c30-c0c62d0cc32a"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:07:27.796037 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-6b247657-444d-4180-bd65-4dc6f3a93391 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd651fdca907b4c23a055a3facfab7f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0758124e187342729d19bd4b2a8124a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:07:27.819359 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-70fabee5-0230-4ebb-b6fa-b951638869d6 req-f51bc51a-b3d1-417d-8fa1-ff59aa7a82ac service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:27.824076 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-70fabee5-0230-4ebb-b6fa-b951638869d6 req-f51bc51a-b3d1-417d-8fa1-ff59aa7a82ac service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:27.824718 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-70fabee5-0230-4ebb-b6fa-b951638869d6 req-f51bc51a-b3d1-417d-8fa1-ff59aa7a82ac service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:27.825795 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-6b247657-444d-4180-bd65-4dc6f3a93391 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] 10.222.0.60 "GET /compute/v2.1/servers/b7e289b1-ddfc-4551-8750-8d4e2727fc77" status: 200 len: 1323 microversion: 2.1 time: 0.723806 Sep 14 09:07:27.833987 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2081/4162] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:07:27 2022] GET /compute/v2.1/servers/b7e289b1-ddfc-4551-8750-8d4e2727fc77 => generated 1323 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:07:27.842222 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-4c2c6d02-165a-4505-933a-b929dbe42a7a tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:27.850319 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-70fabee5-0230-4ebb-b6fa-b951638869d6 req-f51bc51a-b3d1-417d-8fa1-ff59aa7a82ac service nova] Creating event network-vif-deleted:b61b8cc2-7cba-45d5-8c30-c0c62d0cc32a for instance c07aefa3-4ced-496c-9397-abae833e373d on n-h1-836830-18 Sep 14 09:07:27.854505 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-4c2c6d02-165a-4505-933a-b929dbe42a7a tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:07:27.862265 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-70fabee5-0230-4ebb-b6fa-b951638869d6 req-f51bc51a-b3d1-417d-8fa1-ff59aa7a82ac service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086669 Sep 14 09:07:27.865249 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2082/4163] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:07:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:07:27.872970 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-2397dc5f-f1da-4d1d-8dd7-b786423b5731 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:27.879607 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4c2c6d02-165a-4505-933a-b929dbe42a7a tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:27.880157 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-2397dc5f-f1da-4d1d-8dd7-b786423b5731 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] [instance: c07aefa3-4ced-496c-9397-abae833e373d] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:07:27.880313 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4c2c6d02-165a-4505-933a-b929dbe42a7a tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:27.881924 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4c2c6d02-165a-4505-933a-b929dbe42a7a tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:27.882771 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4c2c6d02-165a-4505-933a-b929dbe42a7a tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:27.892292 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4c2c6d02-165a-4505-933a-b929dbe42a7a tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:27.898838 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4c2c6d02-165a-4505-933a-b929dbe42a7a tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:27.900374 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2397dc5f-f1da-4d1d-8dd7-b786423b5731 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:27.908927 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2397dc5f-f1da-4d1d-8dd7-b786423b5731 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:27.909445 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2397dc5f-f1da-4d1d-8dd7-b786423b5731 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:27.918439 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2397dc5f-f1da-4d1d-8dd7-b786423b5731 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:27.918970 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2397dc5f-f1da-4d1d-8dd7-b786423b5731 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:27.919419 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2397dc5f-f1da-4d1d-8dd7-b786423b5731 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:28.019146 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2397dc5f-f1da-4d1d-8dd7-b786423b5731 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:28.019807 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2397dc5f-f1da-4d1d-8dd7-b786423b5731 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:28.020734 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2397dc5f-f1da-4d1d-8dd7-b786423b5731 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:28.024496 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.objects.instance [None req-2397dc5f-f1da-4d1d-8dd7-b786423b5731 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Lazy-loading 'fault' on Instance uuid c07aefa3-4ced-496c-9397-abae833e373d {{(pid=128759) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:07:28.146505 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-2397dc5f-f1da-4d1d-8dd7-b786423b5731 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fffaf9fa0894fe3b4ba967e0854d50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6c30be307734cecbb607753f3345c7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:07:28.160889 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-2397dc5f-f1da-4d1d-8dd7-b786423b5731 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] 10.222.0.60 "GET /compute/v2.1/servers/c07aefa3-4ced-496c-9397-abae833e373d" status: 200 len: 1317 microversion: 2.1 time: 0.293190 Sep 14 09:07:28.162033 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2083/4164] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:07:27 2022] GET /compute/v2.1/servers/c07aefa3-4ced-496c-9397-abae833e373d => generated 1317 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:07:28.174427 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c2cfdbef-a1d8-4260-97a5-6385d93a9fa4 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '.version_select at 0x7f7d3fb83790>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:28.810024 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-4c2c6d02-165a-4505-933a-b929dbe42a7a tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:07:28.834386 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-4c2c6d02-165a-4505-933a-b929dbe42a7a tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105" status: 200 len: 1668 microversion: 2.1 time: 0.999231 Sep 14 09:07:28.838217 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2082/4165] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:07:27 2022] GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105 => generated 1668 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:07:28.871050 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-3f4f5e0b-10a7-4530-8fcd-602a0e84b72f tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:28.871702 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-3f4f5e0b-10a7-4530-8fcd-602a0e84b72f tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:07:28.882811 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3f4f5e0b-10a7-4530-8fcd-602a0e84b72f tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:28.886092 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3f4f5e0b-10a7-4530-8fcd-602a0e84b72f tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:28.886559 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3f4f5e0b-10a7-4530-8fcd-602a0e84b72f tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:28.887437 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3f4f5e0b-10a7-4530-8fcd-602a0e84b72f tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:28.889352 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3f4f5e0b-10a7-4530-8fcd-602a0e84b72f tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:28.889839 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3f4f5e0b-10a7-4530-8fcd-602a0e84b72f tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:29.557675 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-c2cfdbef-a1d8-4260-97a5-6385d93a9fa4 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "DELETE /compute/v2.1/images/07477c68-aba6-4fa9-a6a2-3ce18dedfc78" status: 204 len: 0 microversion: 2.1 time: 1.394416 Sep 14 09:07:29.559230 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2084/4166] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:07:28 2022] DELETE /compute/v2.1/images/07477c68-aba6-4fa9-a6a2-3ce18dedfc78 => generated 0 bytes in 1397 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:07:29.564767 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9744ae62-f8ec-48fb-ad50-879a111db8ee tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:29.566294 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-9744ae62-f8ec-48fb-ad50-879a111db8ee tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] [instance: b7e289b1-ddfc-4551-8750-8d4e2727fc77] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:07:29.596582 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9744ae62-f8ec-48fb-ad50-879a111db8ee tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:29.608166 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9744ae62-f8ec-48fb-ad50-879a111db8ee tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:29.609810 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9744ae62-f8ec-48fb-ad50-879a111db8ee tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:29.614170 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9744ae62-f8ec-48fb-ad50-879a111db8ee tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:29.621226 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9744ae62-f8ec-48fb-ad50-879a111db8ee tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:29.621985 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9744ae62-f8ec-48fb-ad50-879a111db8ee tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:29.649654 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-3f4f5e0b-10a7-4530-8fcd-602a0e84b72f tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:07:29.665512 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-3f4f5e0b-10a7-4530-8fcd-602a0e84b72f tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1528 microversion: 2.1 time: 0.808718 Sep 14 09:07:29.670724 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2083/4167] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:07:28 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1528 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:07:29.682312 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-462752fb-28be-4c55-9751-95003cdf7c57 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1326587602"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:07:29.707635 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-462752fb-28be-4c55-9751-95003cdf7c57 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:07:29.748719 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-462752fb-28be-4c55-9751-95003cdf7c57 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:29.752083 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-462752fb-28be-4c55-9751-95003cdf7c57 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:29.755788 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-462752fb-28be-4c55-9751-95003cdf7c57 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:29.756949 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-462752fb-28be-4c55-9751-95003cdf7c57 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:29.757450 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-462752fb-28be-4c55-9751-95003cdf7c57 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:29.757895 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-462752fb-28be-4c55-9751-95003cdf7c57 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:30.162798 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-462752fb-28be-4c55-9751-95003cdf7c57 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "POST /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105/action" status: 202 len: 0 microversion: 2.1 time: 0.487020 Sep 14 09:07:30.168162 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2084/4168] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:07:29 2022] POST /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105/action => generated 0 bytes in 494 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Sep 14 09:07:30.182972 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c5749d14-0174-4165-99dc-39871e79cc32 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:30.185531 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-c5749d14-0174-4165-99dc-39871e79cc32 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] [instance: c07aefa3-4ced-496c-9397-abae833e373d] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:07:30.198550 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c5749d14-0174-4165-99dc-39871e79cc32 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:30.199483 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c5749d14-0174-4165-99dc-39871e79cc32 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:30.200428 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c5749d14-0174-4165-99dc-39871e79cc32 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:30.201388 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c5749d14-0174-4165-99dc-39871e79cc32 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:30.202331 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c5749d14-0174-4165-99dc-39871e79cc32 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:30.203945 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c5749d14-0174-4165-99dc-39871e79cc32 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:30.236432 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-c5749d14-0174-4165-99dc-39871e79cc32 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] HTTP exception thrown: Instance c07aefa3-4ced-496c-9397-abae833e373d could not be found. Sep 14 09:07:30.238627 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c5749d14-0174-4165-99dc-39871e79cc32 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Request method failure captured: Sep 14 09:07:30.238627 n-d-836830-18 devstack@n-api.service[128758]: request: GET /compute/v2.1/servers/c07aefa3-4ced-496c-9397-abae833e373d HTTP/1.1 Sep 14 09:07:30.238627 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 09:07:30.238627 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 09:07:30.238627 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 09:07:30.238627 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 09:07:30.238627 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 09:07:30.238627 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 09:07:30.238627 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 09:07:30.238627 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 09:07:30.238627 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZmYdtCCdOT_Pd7T8LsGRwrDH0IeLhPsBJh05HMbMsrhp7FB39cMC64A8KdZ8OG7vH2Jvbahs48YwzlTVNzbT1bDbSc2TSP-qmTccxeIA1ei4scYWRWWRYciJsYyQLQmO_EVzr4d-wAKyVkiMZHjzFVE74fS1bbbCmBf3sJGPTPppYU Sep 14 09:07:30.238627 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 09:07:30.238627 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 09:07:30.238627 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 09:07:30.238627 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 09:07:30.238627 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 09:07:30.238627 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 09:07:30.238627 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: a6c30be307734cecbb607753f3345c7c Sep 14 09:07:30.238627 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1373943637 Sep 14 09:07:30.238627 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 09:07:30.238627 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 09:07:30.238627 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a6c30be307734cecbb607753f3345c7c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a6c30be307734cecbb607753f3345c7c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a6c30be307734cecbb607753f3345c7c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a6c30be307734cecbb607753f3345c7c"}]}] Sep 14 09:07:30.238627 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1373943637 Sep 14 09:07:30.238627 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: a6c30be307734cecbb607753f3345c7c Sep 14 09:07:30.238627 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1373943637 Sep 14 09:07:30.238627 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1373943637-project Sep 14 09:07:30.238627 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 09:07:30.238627 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 09:07:30.238627 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 0fffaf9fa0894fe3b4ba967e0854d50e Sep 14 09:07:30.238627 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1373943637-project Sep 14 09:07:30.238627 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 09:07:30.238627 n-d-836830-18 devstack@n-api.service[128758]: exception: Instance c07aefa3-4ced-496c-9397-abae833e373d could not be found. Sep 14 09:07:30.238627 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': 'c07aefa3-4ced-496c-9397-abae833e373d'} Sep 14 09:07:30.238627 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:07:30.238627 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:07:30.238627 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:07:30.238627 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:07:30.238627 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:07:30.238627 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:07:30.238627 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:07:30.238627 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:07:30.238627 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:07:30.238627 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:07:30.238627 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c07aefa3-4ced-496c-9397-abae833e373d could not be found. Sep 14 09:07:30.238627 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:07:30.238627 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:07:30.238627 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:07:30.238627 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:07:30.238627 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:07:30.238627 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:07:30.238627 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:07:30.238627 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:07:30.238627 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:07:30.238627 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:07:30.238627 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:07:30.238627 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:07:30.238627 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:07:30.238627 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:07:30.238627 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:07:30.238627 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:07:30.238627 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c07aefa3-4ced-496c-9397-abae833e373d could not be found. Sep 14 09:07:30.238627 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:07:30.244231 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:07:30.244231 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:07:30.244231 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:07:30.244231 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:07:30.244231 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:07:30.244231 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:07:30.244231 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:07:30.244231 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c07aefa3-4ced-496c-9397-abae833e373d could not be found. Sep 14 09:07:30.244231 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:07:30.244231 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c5749d14-0174-4165-99dc-39871e79cc32 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] Returning 404 to user: Instance c07aefa3-4ced-496c-9397-abae833e373d could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:07:30.246130 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-c5749d14-0174-4165-99dc-39871e79cc32 tempest-ServersNegativeTestMultiTenantJSON-1373943637 tempest-ServersNegativeTestMultiTenantJSON-1373943637-project] 10.222.0.60 "GET /compute/v2.1/servers/c07aefa3-4ced-496c-9397-abae833e373d" status: 404 len: 111 microversion: 2.1 time: 0.074896 Sep 14 09:07:30.247290 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2085/4169] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:07:30 2022] GET /compute/v2.1/servers/c07aefa3-4ced-496c-9397-abae833e373d => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:07:30.253301 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-99a3a3dc-bccf-4f43-b4b1-bea53b1ae77e tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:30.254005 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-99a3a3dc-bccf-4f43-b4b1-bea53b1ae77e tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] [instance: ed6976ad-867b-4570-a547-758efc8f622f] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:07:30.262574 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-99a3a3dc-bccf-4f43-b4b1-bea53b1ae77e tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:30.264692 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-99a3a3dc-bccf-4f43-b4b1-bea53b1ae77e tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:30.265385 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-99a3a3dc-bccf-4f43-b4b1-bea53b1ae77e tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:30.266698 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-99a3a3dc-bccf-4f43-b4b1-bea53b1ae77e tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:30.267438 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-99a3a3dc-bccf-4f43-b4b1-bea53b1ae77e tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:30.268270 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-99a3a3dc-bccf-4f43-b4b1-bea53b1ae77e tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:30.307787 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-9744ae62-f8ec-48fb-ad50-879a111db8ee tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd651fdca907b4c23a055a3facfab7f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0758124e187342729d19bd4b2a8124a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:07:30.313213 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-99a3a3dc-bccf-4f43-b4b1-bea53b1ae77e tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] [instance: ed6976ad-867b-4570-a547-758efc8f622f] Going to try to terminate instance {{(pid=128758) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:07:30.318899 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-9744ae62-f8ec-48fb-ad50-879a111db8ee tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] 10.222.0.60 "GET /compute/v2.1/servers/b7e289b1-ddfc-4551-8750-8d4e2727fc77" status: 200 len: 1519 microversion: 2.1 time: 0.758341 Sep 14 09:07:30.339325 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2085/4170] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:07:29 2022] GET /compute/v2.1/servers/b7e289b1-ddfc-4551-8750-8d4e2727fc77 => generated 1519 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:07:30.619585 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-99a3a3dc-bccf-4f43-b4b1-bea53b1ae77e tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "DELETE /compute/v2.1/servers/ed6976ad-867b-4570-a547-758efc8f622f" status: 204 len: 0 microversion: 2.1 time: 0.370519 Sep 14 09:07:30.624801 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2086/4171] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:07:30 2022] DELETE /compute/v2.1/servers/ed6976ad-867b-4570-a547-758efc8f622f => generated 0 bytes in 373 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:07:30.663801 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-53774249-b2e9-46b0-b949-80234b28caec tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1135478645", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "7289fd96-9cb4-41d4-8aeb-dd7324d8106c"}]}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:07:30.668245 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-53774249-b2e9-46b0-b949-80234b28caec tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Request method failure captured: Sep 14 09:07:30.668245 n-d-836830-18 devstack@n-api.service[128759]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 14 09:07:30.668245 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:07:30.668245 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:07:30.668245 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:07:30.668245 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 243 Sep 14 09:07:30.668245 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:07:30.668245 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:07:30.668245 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:07:30.668245 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:07:30.668245 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZm0kZbinC3AqHm1oeKmbCOhn2T1qSl8vFCJdEyhRqg5VleKm07QUq8sdE822LW5YAmvBt0lFhQrj-zmKdJrtYq3eJ5c3hxPU6kQg8gxxYpOe_SoYgAQVSOxGfUkyIMsV2w7Ji6CdIXdbfRqpwqdjismysMbEl1pQw6KvAlxZhaQmSU Sep 14 09:07:30.668245 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:07:30.668245 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:07:30.668245 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:07:30.668245 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:07:30.668245 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:07:30.668245 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:07:30.668245 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 0758124e187342729d19bd4b2a8124a2 Sep 14 09:07:30.668245 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1841832977 Sep 14 09:07:30.668245 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:07:30.668245 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:07:30.668245 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0758124e187342729d19bd4b2a8124a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0758124e187342729d19bd4b2a8124a2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0758124e187342729d19bd4b2a8124a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0758124e187342729d19bd4b2a8124a2"}]}] Sep 14 09:07:30.668245 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1841832977 Sep 14 09:07:30.668245 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 0758124e187342729d19bd4b2a8124a2 Sep 14 09:07:30.668245 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1841832977 Sep 14 09:07:30.668245 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ServerMetadataNegativeTestJSON-1841832977-project Sep 14 09:07:30.668245 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:07:30.668245 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:07:30.668245 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: d651fdca907b4c23a055a3facfab7f2d Sep 14 09:07:30.668245 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1841832977-project Sep 14 09:07:30.668245 n-d-836830-18 devstack@n-api.service[128759]: Sep 14 09:07:30.668245 n-d-836830-18 devstack@n-api.service[128759]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1135478645", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "7289fd96-9cb4-41d4-8aeb-dd7324d8106c"}]}} Sep 14 09:07:30.668245 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:07:30.668245 n-d-836830-18 devstack@n-api.service[128759]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 14 09:07:30.668245 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1135478645', 'imageRef': 'bff4ab7f-4846-441f-8940-d96fec4c28e9', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': '7289fd96-9cb4-41d4-8aeb-dd7324d8106c'}]}}} Sep 14 09:07:30.668245 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:07:30.668245 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:07:30.668245 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 14 09:07:30.668245 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 14 09:07:30.668245 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 14 09:07:30.668245 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise error Sep 14 09:07:30.668245 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 14 09:07:30.668245 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:07:30.668245 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Sep 14 09:07:30.668245 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 14 09:07:30.668245 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 14 09:07:30.668245 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 14 09:07:30.668245 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 14 09:07:30.668245 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:07:30.668245 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 14 09:07:30.668245 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi {'': 'data1'} Sep 14 09:07:30.668245 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:07:30.668245 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:07:30.668245 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:07:30.668245 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:07:30.668245 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:07:30.668245 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:07:30.668245 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:07:30.668245 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:07:30.668245 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:07:30.668245 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:07:30.668245 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:07:30.671971 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:07:30.671971 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 14 09:07:30.671971 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 14 09:07:30.671971 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 14 09:07:30.671971 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 14 09:07:30.671971 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 14 09:07:30.671971 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 14 09:07:30.671971 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 14 09:07:30.671971 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:07:30.671971 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:07:30.671971 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:07:30.671971 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:07:30.671971 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:07:30.671971 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:07:30.671971 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 14 09:07:30.671971 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 14 09:07:30.671971 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 14 09:07:30.671971 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:07:30.671971 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-53774249-b2e9-46b0-b949-80234b28caec tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:07:30.671971 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-53774249-b2e9-46b0-b949-80234b28caec tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.009865 Sep 14 09:07:30.671971 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2086/4172] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 09:07:30 2022] POST /compute/v2.1/servers => generated 175 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 14 09:07:30.687644 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-436f2ed1-af7c-4d01-ad28-980d034fadd9 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:30.689060 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-436f2ed1-af7c-4d01-ad28-980d034fadd9 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] [instance: 00932e4f-c0c9-4bc6-83c8-4ff3a7b7eadf] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:07:30.699994 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-32dccdc2-5f6c-4698-9e21-6f52863232e7 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:30.700612 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-32dccdc2-5f6c-4698-9e21-6f52863232e7 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:07:30.703278 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-436f2ed1-af7c-4d01-ad28-980d034fadd9 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] HTTP exception thrown: Instance 00932e4f-c0c9-4bc6-83c8-4ff3a7b7eadf could not be found. Sep 14 09:07:30.732355 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-32dccdc2-5f6c-4698-9e21-6f52863232e7 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:30.732854 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-32dccdc2-5f6c-4698-9e21-6f52863232e7 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:30.733296 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-32dccdc2-5f6c-4698-9e21-6f52863232e7 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:30.733671 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-436f2ed1-af7c-4d01-ad28-980d034fadd9 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Request method failure captured: Sep 14 09:07:30.733671 n-d-836830-18 devstack@n-api.service[128758]: request: GET /compute/v2.1/servers/00932e4f-c0c9-4bc6-83c8-4ff3a7b7eadf/metadata HTTP/1.1 Sep 14 09:07:30.733671 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 09:07:30.733671 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 09:07:30.733671 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 09:07:30.733671 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 09:07:30.733671 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 09:07:30.733671 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 09:07:30.733671 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 09:07:30.733671 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 09:07:30.733671 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZm0kZbinC3AqHm1oeKmbCOhn2T1qSl8vFCJdEyhRqg5VleKm07QUq8sdE822LW5YAmvBt0lFhQrj-zmKdJrtYq3eJ5c3hxPU6kQg8gxxYpOe_SoYgAQVSOxGfUkyIMsV2w7Ji6CdIXdbfRqpwqdjismysMbEl1pQw6KvAlxZhaQmSU Sep 14 09:07:30.733671 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 09:07:30.733671 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 09:07:30.733671 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 09:07:30.733671 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 09:07:30.733671 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 09:07:30.733671 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 09:07:30.733671 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 0758124e187342729d19bd4b2a8124a2 Sep 14 09:07:30.733671 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1841832977 Sep 14 09:07:30.733671 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 09:07:30.733671 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 09:07:30.733671 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0758124e187342729d19bd4b2a8124a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0758124e187342729d19bd4b2a8124a2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0758124e187342729d19bd4b2a8124a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0758124e187342729d19bd4b2a8124a2"}]}] Sep 14 09:07:30.733671 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1841832977 Sep 14 09:07:30.733671 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 0758124e187342729d19bd4b2a8124a2 Sep 14 09:07:30.733671 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1841832977 Sep 14 09:07:30.733671 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-ServerMetadataNegativeTestJSON-1841832977-project Sep 14 09:07:30.733671 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 09:07:30.733671 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 09:07:30.733671 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: d651fdca907b4c23a055a3facfab7f2d Sep 14 09:07:30.733671 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1841832977-project Sep 14 09:07:30.733671 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 09:07:30.733671 n-d-836830-18 devstack@n-api.service[128758]: exception: Instance 00932e4f-c0c9-4bc6-83c8-4ff3a7b7eadf could not be found. Sep 14 09:07:30.733671 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'server_id': '00932e4f-c0c9-4bc6-83c8-4ff3a7b7eadf'} Sep 14 09:07:30.733671 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:07:30.733671 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:07:30.733671 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:07:30.733671 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:07:30.733671 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:07:30.733671 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:07:30.733671 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 14 09:07:30.733671 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 14 09:07:30.733671 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00932e4f-c0c9-4bc6-83c8-4ff3a7b7eadf could not be found. Sep 14 09:07:30.733671 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:07:30.733671 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:07:30.733671 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:07:30.733671 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:07:30.733671 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:07:30.733671 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:07:30.733671 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:07:30.733671 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:07:30.733671 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:07:30.733671 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:07:30.733671 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Sep 14 09:07:30.733671 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Sep 14 09:07:30.733671 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:07:30.733671 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:07:30.733671 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00932e4f-c0c9-4bc6-83c8-4ff3a7b7eadf could not be found. Sep 14 09:07:30.733671 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:07:30.733671 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:07:30.733671 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:07:30.733671 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:07:30.733671 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:07:30.733671 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:07:30.737136 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:07:30.737136 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:07:30.737136 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00932e4f-c0c9-4bc6-83c8-4ff3a7b7eadf could not be found. Sep 14 09:07:30.737136 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:07:30.737404 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-32dccdc2-5f6c-4698-9e21-6f52863232e7 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:30.737404 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-32dccdc2-5f6c-4698-9e21-6f52863232e7 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:30.742811 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-436f2ed1-af7c-4d01-ad28-980d034fadd9 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Returning 404 to user: Instance 00932e4f-c0c9-4bc6-83c8-4ff3a7b7eadf could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:07:30.743979 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-436f2ed1-af7c-4d01-ad28-980d034fadd9 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] 10.222.0.60 "GET /compute/v2.1/servers/00932e4f-c0c9-4bc6-83c8-4ff3a7b7eadf/metadata" status: 404 len: 111 microversion: 2.1 time: 0.061144 Sep 14 09:07:30.744744 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2087/4173] 10.222.0.60 () {58 vars in 1263 bytes} [Wed Sep 14 09:07:30 2022] GET /compute/v2.1/servers/00932e4f-c0c9-4bc6-83c8-4ff3a7b7eadf/metadata => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:07:30.749675 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-32dccdc2-5f6c-4698-9e21-6f52863232e7 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:30.924316 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-f2eab751-fca9-4a8b-b6d2-fe20572724cb tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1622724548", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "networks": [{"uuid": "25039276-e7b2-497e-8f28-ebadf4eb94bc"}]}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:07:31.049545 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.network.neutron [None req-f2eab751-fca9-4a8b-b6d2-fe20572724cb tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] validate_networks() for [('25039276-e7b2-497e-8f28-ebadf4eb94bc', None, None, None, None, None)] {{(pid=128758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:07:31.579856 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-32dccdc2-5f6c-4698-9e21-6f52863232e7 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:07:31.589122 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-32dccdc2-5f6c-4698-9e21-6f52863232e7 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1528 microversion: 2.1 time: 0.894651 Sep 14 09:07:31.591227 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2087/4174] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:07:30 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1528 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:07:31.614664 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-2bba8b32-9589-4448-93a1-c48e234dd656 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-586135184", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "7289fd96-9cb4-41d4-8aeb-dd7324d8106c"}]}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:07:31.624111 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-2bba8b32-9589-4448-93a1-c48e234dd656 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Request method failure captured: Sep 14 09:07:31.624111 n-d-836830-18 devstack@n-api.service[128759]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 14 09:07:31.624111 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:07:31.624111 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:07:31.624111 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:07:31.624111 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 498 Sep 14 09:07:31.624111 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:07:31.624111 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:07:31.624111 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:07:31.624111 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:07:31.624111 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZm0kZbinC3AqHm1oeKmbCOhn2T1qSl8vFCJdEyhRqg5VleKm07QUq8sdE822LW5YAmvBt0lFhQrj-zmKdJrtYq3eJ5c3hxPU6kQg8gxxYpOe_SoYgAQVSOxGfUkyIMsV2w7Ji6CdIXdbfRqpwqdjismysMbEl1pQw6KvAlxZhaQmSU Sep 14 09:07:31.624111 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:07:31.624111 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:07:31.624111 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:07:31.624111 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:07:31.624111 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:07:31.624111 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:07:31.624111 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 0758124e187342729d19bd4b2a8124a2 Sep 14 09:07:31.624111 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1841832977 Sep 14 09:07:31.624111 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:07:31.624111 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:07:31.624111 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0758124e187342729d19bd4b2a8124a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0758124e187342729d19bd4b2a8124a2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0758124e187342729d19bd4b2a8124a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0758124e187342729d19bd4b2a8124a2"}]}] Sep 14 09:07:31.624111 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1841832977 Sep 14 09:07:31.624111 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 0758124e187342729d19bd4b2a8124a2 Sep 14 09:07:31.624111 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1841832977 Sep 14 09:07:31.624111 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ServerMetadataNegativeTestJSON-1841832977-project Sep 14 09:07:31.624111 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:07:31.624111 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:07:31.624111 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: d651fdca907b4c23a055a3facfab7f2d Sep 14 09:07:31.624111 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1841832977-project Sep 14 09:07:31.624111 n-d-836830-18 devstack@n-api.service[128759]: Sep 14 09:07:31.624111 n-d-836830-18 devstack@n-api.service[128759]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-586135184", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "7289fd96-9cb4-41d4-8aeb-dd7324d8106c"}]}} Sep 14 09:07:31.624111 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:07:31.624111 n-d-836830-18 devstack@n-api.service[128759]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 14 09:07:31.624111 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-586135184', 'imageRef': 'bff4ab7f-4846-441f-8940-d96fec4c28e9', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '7289fd96-9cb4-41d4-8aeb-dd7324d8106c'}]}}} Sep 14 09:07:31.624111 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:07:31.624111 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:07:31.624111 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 14 09:07:31.624111 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 14 09:07:31.624111 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 14 09:07:31.624111 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise error Sep 14 09:07:31.624111 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 14 09:07:31.624111 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:07:31.624111 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Sep 14 09:07:31.624111 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 14 09:07:31.624111 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 14 09:07:31.624111 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 14 09:07:31.628244 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 14 09:07:31.628244 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:07:31.628244 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 14 09:07:31.628244 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Sep 14 09:07:31.628244 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:07:31.628244 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:07:31.628244 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:07:31.628244 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:07:31.628244 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:07:31.628244 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:07:31.628244 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:07:31.628244 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:07:31.628244 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:07:31.628244 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:07:31.628244 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:07:31.628244 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:07:31.628244 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 14 09:07:31.628244 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 14 09:07:31.628244 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 14 09:07:31.628244 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 14 09:07:31.628244 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 14 09:07:31.628244 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 14 09:07:31.628244 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 14 09:07:31.628244 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:07:31.628244 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:07:31.628244 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:07:31.628244 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:07:31.628244 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:07:31.628244 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:07:31.628244 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 14 09:07:31.628244 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 14 09:07:31.628244 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 14 09:07:31.628244 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:07:31.631651 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-2bba8b32-9589-4448-93a1-c48e234dd656 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:07:31.634968 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-2bba8b32-9589-4448-93a1-c48e234dd656 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.042709 Sep 14 09:07:31.637507 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2088/4175] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 09:07:31 2022] POST /compute/v2.1/servers => generated 687 bytes in 46 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 14 09:07:31.736169 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-886bcba5-fe6f-4d65-94ec-9ffda827af53 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1426472590", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "7289fd96-9cb4-41d4-8aeb-dd7324d8106c"}]}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:07:31.748071 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-886bcba5-fe6f-4d65-94ec-9ffda827af53 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Request method failure captured: Sep 14 09:07:31.748071 n-d-836830-18 devstack@n-api.service[128759]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 14 09:07:31.748071 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:07:31.748071 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:07:31.748071 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:07:31.748071 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 500 Sep 14 09:07:31.748071 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:07:31.748071 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:07:31.748071 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:07:31.748071 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:07:31.748071 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZm0kZbinC3AqHm1oeKmbCOhn2T1qSl8vFCJdEyhRqg5VleKm07QUq8sdE822LW5YAmvBt0lFhQrj-zmKdJrtYq3eJ5c3hxPU6kQg8gxxYpOe_SoYgAQVSOxGfUkyIMsV2w7Ji6CdIXdbfRqpwqdjismysMbEl1pQw6KvAlxZhaQmSU Sep 14 09:07:31.748071 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:07:31.748071 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:07:31.748071 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:07:31.748071 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:07:31.748071 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:07:31.748071 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:07:31.748071 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 0758124e187342729d19bd4b2a8124a2 Sep 14 09:07:31.748071 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1841832977 Sep 14 09:07:31.748071 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:07:31.748071 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:07:31.748071 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0758124e187342729d19bd4b2a8124a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0758124e187342729d19bd4b2a8124a2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0758124e187342729d19bd4b2a8124a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0758124e187342729d19bd4b2a8124a2"}]}] Sep 14 09:07:31.748071 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1841832977 Sep 14 09:07:31.748071 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 0758124e187342729d19bd4b2a8124a2 Sep 14 09:07:31.748071 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1841832977 Sep 14 09:07:31.748071 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ServerMetadataNegativeTestJSON-1841832977-project Sep 14 09:07:31.748071 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:07:31.748071 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:07:31.748071 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: d651fdca907b4c23a055a3facfab7f2d Sep 14 09:07:31.748071 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1841832977-project Sep 14 09:07:31.748071 n-d-836830-18 devstack@n-api.service[128759]: Sep 14 09:07:31.748071 n-d-836830-18 devstack@n-api.service[128759]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1426472590", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "7289fd96-9cb4-41d4-8aeb-dd7324d8106c"}]}} Sep 14 09:07:31.748071 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:07:31.748071 n-d-836830-18 devstack@n-api.service[128759]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 14 09:07:31.748071 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1426472590', 'imageRef': 'bff4ab7f-4846-441f-8940-d96fec4c28e9', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '7289fd96-9cb4-41d4-8aeb-dd7324d8106c'}]}}} Sep 14 09:07:31.748071 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:07:31.748071 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:07:31.748071 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 14 09:07:31.748071 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 14 09:07:31.748071 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 14 09:07:31.748071 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise error Sep 14 09:07:31.748071 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 14 09:07:31.748071 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:07:31.748071 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Sep 14 09:07:31.748071 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 14 09:07:31.748071 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 14 09:07:31.748071 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 14 09:07:31.751470 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 14 09:07:31.751470 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:07:31.751470 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 14 09:07:31.751470 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Sep 14 09:07:31.751470 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:07:31.751470 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:07:31.751470 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:07:31.751470 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:07:31.751470 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:07:31.751470 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:07:31.751470 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:07:31.751470 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:07:31.751470 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:07:31.751470 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:07:31.751470 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:07:31.751470 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:07:31.751470 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 14 09:07:31.751470 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 14 09:07:31.751470 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 14 09:07:31.751470 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 14 09:07:31.751470 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 14 09:07:31.751470 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 14 09:07:31.751470 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 14 09:07:31.751470 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:07:31.751470 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:07:31.751470 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:07:31.751470 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:07:31.751470 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:07:31.751470 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:07:31.751470 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 14 09:07:31.751470 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 14 09:07:31.751470 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 14 09:07:31.751470 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:07:31.756819 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-886bcba5-fe6f-4d65-94ec-9ffda827af53 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:07:31.761867 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-886bcba5-fe6f-4d65-94ec-9ffda827af53 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.031646 Sep 14 09:07:31.762981 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2089/4176] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 09:07:31 2022] POST /compute/v2.1/servers => generated 689 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 14 09:07:31.784019 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-1a5885f6-4c4f-427d-9f98-d77b42385590 req-57e699d5-8d2b-42ca-a76f-e44ab975fb4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed6976ad-867b-4570-a547-758efc8f622f", "name": "network-vif-unplugged", "status": "completed", "tag": "5445fa77-c239-4d3c-8132-f14f545198cd"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:07:31.826018 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-1a5885f6-4c4f-427d-9f98-d77b42385590 req-57e699d5-8d2b-42ca-a76f-e44ab975fb4a service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:31.829490 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-1a5885f6-4c4f-427d-9f98-d77b42385590 req-57e699d5-8d2b-42ca-a76f-e44ab975fb4a service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:31.830595 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-1a5885f6-4c4f-427d-9f98-d77b42385590 req-57e699d5-8d2b-42ca-a76f-e44ab975fb4a service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:31.868846 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-1a5885f6-4c4f-427d-9f98-d77b42385590 req-57e699d5-8d2b-42ca-a76f-e44ab975fb4a service nova] Creating event network-vif-unplugged:5445fa77-c239-4d3c-8132-f14f545198cd for instance ed6976ad-867b-4570-a547-758efc8f622f on n-h1-836830-18 Sep 14 09:07:31.883363 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-1a5885f6-4c4f-427d-9f98-d77b42385590 req-57e699d5-8d2b-42ca-a76f-e44ab975fb4a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.117379 Sep 14 09:07:31.885016 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2090/4177] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:07:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:07:31.901246 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-2a4f5144-8c38-49fc-b3fc-5671e5108448 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-533779337", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "7289fd96-9cb4-41d4-8aeb-dd7324d8106c"}]}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:07:31.912762 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-2a4f5144-8c38-49fc-b3fc-5671e5108448 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Request method failure captured: Sep 14 09:07:31.912762 n-d-836830-18 devstack@n-api.service[128759]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 14 09:07:31.912762 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:07:31.912762 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:07:31.912762 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:07:31.912762 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 753 Sep 14 09:07:31.912762 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:07:31.912762 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:07:31.912762 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:07:31.912762 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:07:31.912762 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZm0kZbinC3AqHm1oeKmbCOhn2T1qSl8vFCJdEyhRqg5VleKm07QUq8sdE822LW5YAmvBt0lFhQrj-zmKdJrtYq3eJ5c3hxPU6kQg8gxxYpOe_SoYgAQVSOxGfUkyIMsV2w7Ji6CdIXdbfRqpwqdjismysMbEl1pQw6KvAlxZhaQmSU Sep 14 09:07:31.912762 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:07:31.912762 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:07:31.912762 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:07:31.912762 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:07:31.912762 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:07:31.912762 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:07:31.912762 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 0758124e187342729d19bd4b2a8124a2 Sep 14 09:07:31.912762 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1841832977 Sep 14 09:07:31.912762 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:07:31.912762 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:07:31.912762 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0758124e187342729d19bd4b2a8124a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0758124e187342729d19bd4b2a8124a2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0758124e187342729d19bd4b2a8124a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0758124e187342729d19bd4b2a8124a2"}]}] Sep 14 09:07:31.912762 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1841832977 Sep 14 09:07:31.912762 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 0758124e187342729d19bd4b2a8124a2 Sep 14 09:07:31.912762 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1841832977 Sep 14 09:07:31.912762 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ServerMetadataNegativeTestJSON-1841832977-project Sep 14 09:07:31.912762 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:07:31.912762 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:07:31.912762 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: d651fdca907b4c23a055a3facfab7f2d Sep 14 09:07:31.912762 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1841832977-project Sep 14 09:07:31.912762 n-d-836830-18 devstack@n-api.service[128759]: Sep 14 09:07:31.912762 n-d-836830-18 devstack@n-api.service[128759]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-533779337", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "7289fd96-9cb4-41d4-8aeb-dd7324d8106c"}]}} Sep 14 09:07:31.912762 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:07:31.912762 n-d-836830-18 devstack@n-api.service[128759]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 14 09:07:31.912762 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-533779337', 'imageRef': 'bff4ab7f-4846-441f-8940-d96fec4c28e9', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '7289fd96-9cb4-41d4-8aeb-dd7324d8106c'}]}}} Sep 14 09:07:31.912762 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:07:31.912762 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:07:31.912762 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 14 09:07:31.912762 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 14 09:07:31.912762 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 14 09:07:31.915692 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise error Sep 14 09:07:31.915692 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 14 09:07:31.915692 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:07:31.915692 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Sep 14 09:07:31.915692 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 14 09:07:31.915692 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 14 09:07:31.915692 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 14 09:07:31.915692 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 14 09:07:31.915692 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:07:31.915692 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 14 09:07:31.915692 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Sep 14 09:07:31.915692 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:07:31.915692 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:07:31.915692 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:07:31.915692 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:07:31.915692 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:07:31.915692 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:07:31.915692 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:07:31.915692 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:07:31.915692 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:07:31.915692 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:07:31.915692 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:07:31.915692 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:07:31.915692 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 14 09:07:31.915692 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 14 09:07:31.915692 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 14 09:07:31.915692 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 14 09:07:31.915692 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 14 09:07:31.915692 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 14 09:07:31.915692 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 14 09:07:31.915692 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:07:31.915692 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:07:31.915692 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:07:31.915692 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:07:31.915692 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:07:31.915692 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:07:31.915692 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 14 09:07:31.915692 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 14 09:07:31.927846 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 14 09:07:31.927846 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:07:31.927846 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-2a4f5144-8c38-49fc-b3fc-5671e5108448 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:07:31.927846 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-2a4f5144-8c38-49fc-b3fc-5671e5108448 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.030509 Sep 14 09:07:31.927846 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2091/4178] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 09:07:31 2022] POST /compute/v2.1/servers => generated 1197 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Sep 14 09:07:32.006477 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-1e54c4e3-7b3a-429c-ab73-510628527086 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1966206283", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "7289fd96-9cb4-41d4-8aeb-dd7324d8106c"}]}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:07:32.019197 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-1e54c4e3-7b3a-429c-ab73-510628527086 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Request method failure captured: Sep 14 09:07:32.019197 n-d-836830-18 devstack@n-api.service[128759]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 14 09:07:32.019197 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:07:32.019197 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:07:32.019197 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:07:32.019197 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 1266 Sep 14 09:07:32.019197 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:07:32.019197 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:07:32.019197 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:07:32.019197 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:07:32.019197 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZm0kZbinC3AqHm1oeKmbCOhn2T1qSl8vFCJdEyhRqg5VleKm07QUq8sdE822LW5YAmvBt0lFhQrj-zmKdJrtYq3eJ5c3hxPU6kQg8gxxYpOe_SoYgAQVSOxGfUkyIMsV2w7Ji6CdIXdbfRqpwqdjismysMbEl1pQw6KvAlxZhaQmSU Sep 14 09:07:32.019197 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:07:32.019197 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:07:32.019197 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:07:32.019197 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:07:32.019197 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:07:32.019197 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:07:32.019197 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 0758124e187342729d19bd4b2a8124a2 Sep 14 09:07:32.019197 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1841832977 Sep 14 09:07:32.019197 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:07:32.019197 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:07:32.019197 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0758124e187342729d19bd4b2a8124a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0758124e187342729d19bd4b2a8124a2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0758124e187342729d19bd4b2a8124a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0758124e187342729d19bd4b2a8124a2"}]}] Sep 14 09:07:32.019197 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1841832977 Sep 14 09:07:32.019197 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 0758124e187342729d19bd4b2a8124a2 Sep 14 09:07:32.019197 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1841832977 Sep 14 09:07:32.019197 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ServerMetadataNegativeTestJSON-1841832977-project Sep 14 09:07:32.019197 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:07:32.019197 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:07:32.019197 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: d651fdca907b4c23a055a3facfab7f2d Sep 14 09:07:32.019197 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1841832977-project Sep 14 09:07:32.019197 n-d-836830-18 devstack@n-api.service[128759]: Sep 14 09:07:32.019197 n-d-836830-18 devstack@n-api.service[128759]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1966206283", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "7289fd96-9cb4-41d4-8aeb-dd7324d8106c"}]}} Sep 14 09:07:32.019197 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:07:32.021624 n-d-836830-18 devstack@n-api.service[128759]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 14 09:07:32.021624 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1966206283', 'imageRef': 'bff4ab7f-4846-441f-8940-d96fec4c28e9', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '7289fd96-9cb4-41d4-8aeb-dd7324d8106c'}]}}} Sep 14 09:07:32.021624 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:07:32.021624 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:07:32.021624 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 14 09:07:32.021624 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 14 09:07:32.021624 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 14 09:07:32.021624 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise error Sep 14 09:07:32.021624 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 14 09:07:32.021624 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:07:32.021624 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Sep 14 09:07:32.021624 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 14 09:07:32.021624 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 14 09:07:32.021624 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 14 09:07:32.021624 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 14 09:07:32.021624 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:07:32.021624 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 14 09:07:32.023075 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Sep 14 09:07:32.023075 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:07:32.023075 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:07:32.023075 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:07:32.023075 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:07:32.023075 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:07:32.023075 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:07:32.023075 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:07:32.023075 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:07:32.023075 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:07:32.023075 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:07:32.023075 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:07:32.023075 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:07:32.023075 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 14 09:07:32.023075 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 14 09:07:32.023075 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 14 09:07:32.023075 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 14 09:07:32.023075 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 14 09:07:32.023075 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 14 09:07:32.023075 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 14 09:07:32.023075 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:07:32.023075 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:07:32.023075 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:07:32.023075 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:07:32.023075 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:07:32.023075 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:07:32.023075 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 14 09:07:32.023075 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 14 09:07:32.024945 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 14 09:07:32.024945 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:07:32.024945 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-1e54c4e3-7b3a-429c-ab73-510628527086 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:07:32.024945 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-1e54c4e3-7b3a-429c-ab73-510628527086 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.022102 Sep 14 09:07:32.034060 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2092/4179] 10.222.0.60 () {60 vars in 1148 bytes} [Wed Sep 14 09:07:31 2022] POST /compute/v2.1/servers => generated 2221 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 382 bytes (2 switches on core 0) Sep 14 09:07:32.045405 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e920b7ee-1f18-455b-85cf-59633f99213a tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:32.047535 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e920b7ee-1f18-455b-85cf-59633f99213a tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] [instance: 14f4e224-20ec-40c0-a83f-e1b71c03c4be] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:07:32.067551 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-e920b7ee-1f18-455b-85cf-59633f99213a tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] HTTP exception thrown: Instance 14f4e224-20ec-40c0-a83f-e1b71c03c4be could not be found. Sep 14 09:07:32.076877 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e920b7ee-1f18-455b-85cf-59633f99213a tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Request method failure captured: Sep 14 09:07:32.076877 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/14f4e224-20ec-40c0-a83f-e1b71c03c4be/metadata/test2 HTTP/1.1 Sep 14 09:07:32.076877 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:07:32.076877 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:07:32.076877 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:07:32.076877 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:07:32.076877 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:07:32.076877 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:07:32.076877 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:07:32.076877 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:07:32.076877 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZm0kZbinC3AqHm1oeKmbCOhn2T1qSl8vFCJdEyhRqg5VleKm07QUq8sdE822LW5YAmvBt0lFhQrj-zmKdJrtYq3eJ5c3hxPU6kQg8gxxYpOe_SoYgAQVSOxGfUkyIMsV2w7Ji6CdIXdbfRqpwqdjismysMbEl1pQw6KvAlxZhaQmSU Sep 14 09:07:32.076877 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:07:32.076877 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:07:32.076877 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:07:32.076877 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:07:32.076877 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:07:32.076877 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:07:32.076877 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 0758124e187342729d19bd4b2a8124a2 Sep 14 09:07:32.076877 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1841832977 Sep 14 09:07:32.076877 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:07:32.076877 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:07:32.076877 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0758124e187342729d19bd4b2a8124a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0758124e187342729d19bd4b2a8124a2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0758124e187342729d19bd4b2a8124a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0758124e187342729d19bd4b2a8124a2"}]}] Sep 14 09:07:32.076877 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1841832977 Sep 14 09:07:32.076877 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 0758124e187342729d19bd4b2a8124a2 Sep 14 09:07:32.076877 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1841832977 Sep 14 09:07:32.076877 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ServerMetadataNegativeTestJSON-1841832977-project Sep 14 09:07:32.076877 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:07:32.076877 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:07:32.076877 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: d651fdca907b4c23a055a3facfab7f2d Sep 14 09:07:32.076877 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1841832977-project Sep 14 09:07:32.076877 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:07:32.076877 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance 14f4e224-20ec-40c0-a83f-e1b71c03c4be could not be found. Sep 14 09:07:32.076877 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'server_id': '14f4e224-20ec-40c0-a83f-e1b71c03c4be', 'id': 'test2'} Sep 14 09:07:32.076877 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:07:32.076877 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:07:32.076877 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:07:32.076877 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:07:32.076877 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:07:32.076877 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:07:32.076877 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 14 09:07:32.076877 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 14 09:07:32.076877 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14f4e224-20ec-40c0-a83f-e1b71c03c4be could not be found. Sep 14 09:07:32.076877 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:07:32.076877 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:07:32.076877 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:07:32.076877 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:07:32.076877 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:07:32.076877 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:07:32.076877 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:07:32.076877 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:07:32.076877 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:07:32.076877 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:07:32.076877 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Sep 14 09:07:32.076877 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Sep 14 09:07:32.076877 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:07:32.076877 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:07:32.076877 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14f4e224-20ec-40c0-a83f-e1b71c03c4be could not be found. Sep 14 09:07:32.076877 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:07:32.076877 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:07:32.076877 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:07:32.076877 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:07:32.076877 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:07:32.076877 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:07:32.081411 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:07:32.081411 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:07:32.081411 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14f4e224-20ec-40c0-a83f-e1b71c03c4be could not be found. Sep 14 09:07:32.081411 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:07:32.081411 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e920b7ee-1f18-455b-85cf-59633f99213a tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Returning 404 to user: Instance 14f4e224-20ec-40c0-a83f-e1b71c03c4be could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:07:32.081411 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e920b7ee-1f18-455b-85cf-59633f99213a tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] 10.222.0.60 "GET /compute/v2.1/servers/14f4e224-20ec-40c0-a83f-e1b71c03c4be/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.041079 Sep 14 09:07:32.085359 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2093/4180] 10.222.0.60 () {58 vars in 1281 bytes} [Wed Sep 14 09:07:32 2022] GET /compute/v2.1/servers/14f4e224-20ec-40c0-a83f-e1b71c03c4be/metadata/test2 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:07:32.119198 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-83a1fd48-ec8e-4ecc-939e-515fb1a37dfa tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:32.119856 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-83a1fd48-ec8e-4ecc-939e-515fb1a37dfa tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] [instance: b7e289b1-ddfc-4551-8750-8d4e2727fc77] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:07:32.150465 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-83a1fd48-ec8e-4ecc-939e-515fb1a37dfa tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:32.150989 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-83a1fd48-ec8e-4ecc-939e-515fb1a37dfa tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:32.151430 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-83a1fd48-ec8e-4ecc-939e-515fb1a37dfa tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:32.160592 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-83a1fd48-ec8e-4ecc-939e-515fb1a37dfa tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:32.161006 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-83a1fd48-ec8e-4ecc-939e-515fb1a37dfa tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:32.161996 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-83a1fd48-ec8e-4ecc-939e-515fb1a37dfa tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:32.297332 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-83a1fd48-ec8e-4ecc-939e-515fb1a37dfa tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] [instance: b7e289b1-ddfc-4551-8750-8d4e2727fc77] Going to try to terminate instance {{(pid=128759) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:07:32.564411 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-83a1fd48-ec8e-4ecc-939e-515fb1a37dfa tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] 10.222.0.60 "DELETE /compute/v2.1/servers/b7e289b1-ddfc-4551-8750-8d4e2727fc77" status: 204 len: 0 microversion: 2.1 time: 0.464258 Sep 14 09:07:32.565382 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2094/4181] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:07:32 2022] DELETE /compute/v2.1/servers/b7e289b1-ddfc-4551-8750-8d4e2727fc77 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:07:32.580117 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-14098515-ab0c-41b9-b25a-c51ab70c4b2b tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:32.581098 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-14098515-ab0c-41b9-b25a-c51ab70c4b2b tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] [instance: b7e289b1-ddfc-4551-8750-8d4e2727fc77] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:07:32.598549 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-14098515-ab0c-41b9-b25a-c51ab70c4b2b tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:32.601997 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-14098515-ab0c-41b9-b25a-c51ab70c4b2b tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:32.602738 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-14098515-ab0c-41b9-b25a-c51ab70c4b2b tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:32.603754 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-14098515-ab0c-41b9-b25a-c51ab70c4b2b tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:32.604462 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-14098515-ab0c-41b9-b25a-c51ab70c4b2b tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:32.605147 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-14098515-ab0c-41b9-b25a-c51ab70c4b2b tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:33.102739 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-14098515-ab0c-41b9-b25a-c51ab70c4b2b tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd651fdca907b4c23a055a3facfab7f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0758124e187342729d19bd4b2a8124a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:07:33.113853 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-14098515-ab0c-41b9-b25a-c51ab70c4b2b tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] 10.222.0.60 "GET /compute/v2.1/servers/b7e289b1-ddfc-4551-8750-8d4e2727fc77" status: 200 len: 1525 microversion: 2.1 time: 0.541535 Sep 14 09:07:33.123078 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2095/4182] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:07:32 2022] GET /compute/v2.1/servers/b7e289b1-ddfc-4551-8750-8d4e2727fc77 => generated 1525 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:07:33.128207 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9cc5504f-7381-4c6b-94a4-c6d218cafaa9 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:33.128961 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-9cc5504f-7381-4c6b-94a4-c6d218cafaa9 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:07:33.141640 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9cc5504f-7381-4c6b-94a4-c6d218cafaa9 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:33.142400 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9cc5504f-7381-4c6b-94a4-c6d218cafaa9 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:33.143220 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9cc5504f-7381-4c6b-94a4-c6d218cafaa9 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:33.144207 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9cc5504f-7381-4c6b-94a4-c6d218cafaa9 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:33.144927 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9cc5504f-7381-4c6b-94a4-c6d218cafaa9 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:33.145584 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9cc5504f-7381-4c6b-94a4-c6d218cafaa9 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:33.185515 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-f2eab751-fca9-4a8b-b6d2-fe20572724cb tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Flavor limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:07:33.187946 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-f2eab751-fca9-4a8b-b6d2-fe20572724cb tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Image limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:07:33.188705 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-f2eab751-fca9-4a8b-b6d2-fe20572724cb tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Flavor pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:07:33.189276 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-f2eab751-fca9-4a8b-b6d2-fe20572724cb tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Image pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:07:33.190137 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-f2eab751-fca9-4a8b-b6d2-fe20572724cb tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:07:33.197653 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:07:33.205310 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f2eab751-fca9-4a8b-b6d2-fe20572724cb tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:33.206082 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f2eab751-fca9-4a8b-b6d2-fe20572724cb tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:33.207127 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f2eab751-fca9-4a8b-b6d2-fe20572724cb tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:33.208082 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f2eab751-fca9-4a8b-b6d2-fe20572724cb tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:33.208926 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f2eab751-fca9-4a8b-b6d2-fe20572724cb tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:33.209536 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f2eab751-fca9-4a8b-b6d2-fe20572724cb tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:33.246607 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-f2eab751-fca9-4a8b-b6d2-fe20572724cb tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Getting quotas for project 62a597fc389b4805bbd3a53ecd17c5b2. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:07:33.277486 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-f2eab751-fca9-4a8b-b6d2-fe20572724cb tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Getting quotas for user 5165b8fc101c47c7a4370f9007bc5a58 and project 62a597fc389b4805bbd3a53ecd17c5b2. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:07:33.297471 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-f2eab751-fca9-4a8b-b6d2-fe20572724cb tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Going to run 1 instances... {{(pid=128758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:07:33.304151 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-f2eab751-fca9-4a8b-b6d2-fe20572724cb tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] [instance: f8ddffc4-a877-4f95-840c-ad8ef8021755] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:07:33.412376 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-f2eab751-fca9-4a8b-b6d2-fe20572724cb tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.491221 Sep 14 09:07:33.415611 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2088/4183] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 09:07:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 2496 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 14 09:07:33.430354 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1cf93a98-569b-441a-bfb8-46df8d8e4d87 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:33.434606 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-1cf93a98-569b-441a-bfb8-46df8d8e4d87 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] [instance: f8ddffc4-a877-4f95-840c-ad8ef8021755] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:07:34.242401 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-1cf93a98-569b-441a-bfb8-46df8d8e4d87 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5165b8fc101c47c7a4370f9007bc5a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a597fc389b4805bbd3a53ecd17c5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:07:34.259176 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-1cf93a98-569b-441a-bfb8-46df8d8e4d87 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute/v2.1/servers/f8ddffc4-a877-4f95-840c-ad8ef8021755" status: 200 len: 1208 microversion: 2.1 time: 0.832922 Sep 14 09:07:34.261383 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2089/4184] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:07:33 2022] GET /compute/v2.1/servers/f8ddffc4-a877-4f95-840c-ad8ef8021755 => generated 1208 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:07:34.278709 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-f16a03a7-02cf-4703-a3bf-2cad813bdd15 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:34.286965 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-f16a03a7-02cf-4703-a3bf-2cad813bdd15 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] [instance: b7e289b1-ddfc-4551-8750-8d4e2727fc77] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:07:34.311587 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f16a03a7-02cf-4703-a3bf-2cad813bdd15 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:34.314439 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f16a03a7-02cf-4703-a3bf-2cad813bdd15 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:34.317163 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f16a03a7-02cf-4703-a3bf-2cad813bdd15 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:34.318608 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f16a03a7-02cf-4703-a3bf-2cad813bdd15 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:34.322928 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f16a03a7-02cf-4703-a3bf-2cad813bdd15 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:34.325044 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f16a03a7-02cf-4703-a3bf-2cad813bdd15 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:34.329329 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-9cc5504f-7381-4c6b-94a4-c6d218cafaa9 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:07:34.344585 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-9cc5504f-7381-4c6b-94a4-c6d218cafaa9 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1528 microversion: 2.1 time: 1.216930 Sep 14 09:07:34.346746 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2096/4185] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:07:33 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1528 bytes in 1223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:07:34.902533 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-f16a03a7-02cf-4703-a3bf-2cad813bdd15 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd651fdca907b4c23a055a3facfab7f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0758124e187342729d19bd4b2a8124a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:07:34.917545 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-f16a03a7-02cf-4703-a3bf-2cad813bdd15 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] 10.222.0.60 "GET /compute/v2.1/servers/b7e289b1-ddfc-4551-8750-8d4e2727fc77" status: 200 len: 1525 microversion: 2.1 time: 0.652447 Sep 14 09:07:34.919291 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2090/4186] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:07:34 2022] GET /compute/v2.1/servers/b7e289b1-ddfc-4551-8750-8d4e2727fc77 => generated 1525 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:07:35.290803 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-713675ff-15fa-4e42-8aed-fa42ef8cfd0a tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:35.291870 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-713675ff-15fa-4e42-8aed-fa42ef8cfd0a tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] [instance: f8ddffc4-a877-4f95-840c-ad8ef8021755] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:07:35.328416 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-713675ff-15fa-4e42-8aed-fa42ef8cfd0a tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:35.334587 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-713675ff-15fa-4e42-8aed-fa42ef8cfd0a tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:35.336277 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-713675ff-15fa-4e42-8aed-fa42ef8cfd0a tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:35.346076 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-713675ff-15fa-4e42-8aed-fa42ef8cfd0a tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:35.346777 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-713675ff-15fa-4e42-8aed-fa42ef8cfd0a tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:35.347312 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-713675ff-15fa-4e42-8aed-fa42ef8cfd0a tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:35.368470 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-af74dbcf-ed70-4952-9789-ca219d4bd4df tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:35.369096 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-af74dbcf-ed70-4952-9789-ca219d4bd4df tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:07:35.386565 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-af74dbcf-ed70-4952-9789-ca219d4bd4df tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:35.393271 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-af74dbcf-ed70-4952-9789-ca219d4bd4df tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:35.396956 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-af74dbcf-ed70-4952-9789-ca219d4bd4df tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:35.399786 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-af74dbcf-ed70-4952-9789-ca219d4bd4df tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:35.400650 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-af74dbcf-ed70-4952-9789-ca219d4bd4df tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:35.401333 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-af74dbcf-ed70-4952-9789-ca219d4bd4df tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:35.573388 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-713675ff-15fa-4e42-8aed-fa42ef8cfd0a tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5165b8fc101c47c7a4370f9007bc5a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a597fc389b4805bbd3a53ecd17c5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:07:35.594278 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-713675ff-15fa-4e42-8aed-fa42ef8cfd0a tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute/v2.1/servers/f8ddffc4-a877-4f95-840c-ad8ef8021755" status: 200 len: 1260 microversion: 2.1 time: 0.308406 Sep 14 09:07:35.607704 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2097/4187] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:07:35 2022] GET /compute/v2.1/servers/f8ddffc4-a877-4f95-840c-ad8ef8021755 => generated 1260 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:07:35.836592 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-af74dbcf-ed70-4952-9789-ca219d4bd4df tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:07:35.854077 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-af74dbcf-ed70-4952-9789-ca219d4bd4df tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1528 microversion: 2.1 time: 0.487816 Sep 14 09:07:35.856811 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2091/4188] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:07:35 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1528 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:07:35.862119 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-5a1b4153-6623-42c5-9c54-29d101c4ee47 req-c9434151-bee3-48df-8a26-0becbb39bcb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed6976ad-867b-4570-a547-758efc8f622f", "name": "network-vif-deleted", "tag": "5445fa77-c239-4d3c-8132-f14f545198cd"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:07:35.887665 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-5a1b4153-6623-42c5-9c54-29d101c4ee47 req-c9434151-bee3-48df-8a26-0becbb39bcb3 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:35.891001 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-5a1b4153-6623-42c5-9c54-29d101c4ee47 req-c9434151-bee3-48df-8a26-0becbb39bcb3 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:35.902585 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-5a1b4153-6623-42c5-9c54-29d101c4ee47 req-c9434151-bee3-48df-8a26-0becbb39bcb3 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:35.947395 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-3a0a90cf-055b-4848-b83c-b0c119213581 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:35.948365 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-3a0a90cf-055b-4848-b83c-b0c119213581 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] [instance: b7e289b1-ddfc-4551-8750-8d4e2727fc77] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:07:35.956572 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-5a1b4153-6623-42c5-9c54-29d101c4ee47 req-c9434151-bee3-48df-8a26-0becbb39bcb3 service nova] Creating event network-vif-deleted:5445fa77-c239-4d3c-8132-f14f545198cd for instance ed6976ad-867b-4570-a547-758efc8f622f on n-h1-836830-18 Sep 14 09:07:35.962321 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3a0a90cf-055b-4848-b83c-b0c119213581 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:35.964904 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3a0a90cf-055b-4848-b83c-b0c119213581 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:35.967242 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3a0a90cf-055b-4848-b83c-b0c119213581 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:35.968322 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3a0a90cf-055b-4848-b83c-b0c119213581 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:35.969075 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-5a1b4153-6623-42c5-9c54-29d101c4ee47 req-c9434151-bee3-48df-8a26-0becbb39bcb3 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111979 Sep 14 09:07:35.969730 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3a0a90cf-055b-4848-b83c-b0c119213581 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:35.970311 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2098/4189] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:07:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:07:35.972892 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3a0a90cf-055b-4848-b83c-b0c119213581 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:36.619367 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-025f4bd3-7108-436e-8f89-f01037cb4e5c tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:36.620752 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-025f4bd3-7108-436e-8f89-f01037cb4e5c tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] [instance: f8ddffc4-a877-4f95-840c-ad8ef8021755] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:07:36.628978 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-025f4bd3-7108-436e-8f89-f01037cb4e5c tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:36.629698 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-025f4bd3-7108-436e-8f89-f01037cb4e5c tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:36.633499 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-025f4bd3-7108-436e-8f89-f01037cb4e5c tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:36.636416 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-025f4bd3-7108-436e-8f89-f01037cb4e5c tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:36.637115 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-025f4bd3-7108-436e-8f89-f01037cb4e5c tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:36.637722 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-025f4bd3-7108-436e-8f89-f01037cb4e5c tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:36.812584 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-025f4bd3-7108-436e-8f89-f01037cb4e5c tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5165b8fc101c47c7a4370f9007bc5a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a597fc389b4805bbd3a53ecd17c5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:07:36.826080 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-025f4bd3-7108-436e-8f89-f01037cb4e5c tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute/v2.1/servers/f8ddffc4-a877-4f95-840c-ad8ef8021755" status: 200 len: 1266 microversion: 2.1 time: 0.211091 Sep 14 09:07:36.826655 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2099/4190] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:07:36 2022] GET /compute/v2.1/servers/f8ddffc4-a877-4f95-840c-ad8ef8021755 => generated 1266 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:07:36.877970 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-02c8ce28-4ac1-45af-9de7-5e44c1375219 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:36.879484 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-02c8ce28-4ac1-45af-9de7-5e44c1375219 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:07:36.887543 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-02c8ce28-4ac1-45af-9de7-5e44c1375219 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:36.888394 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-02c8ce28-4ac1-45af-9de7-5e44c1375219 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:36.891435 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-02c8ce28-4ac1-45af-9de7-5e44c1375219 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:36.892439 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-02c8ce28-4ac1-45af-9de7-5e44c1375219 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:36.893538 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-02c8ce28-4ac1-45af-9de7-5e44c1375219 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:36.894719 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-02c8ce28-4ac1-45af-9de7-5e44c1375219 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:36.906044 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-3a0a90cf-055b-4848-b83c-b0c119213581 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd651fdca907b4c23a055a3facfab7f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0758124e187342729d19bd4b2a8124a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:07:36.934223 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-3a0a90cf-055b-4848-b83c-b0c119213581 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] 10.222.0.60 "GET /compute/v2.1/servers/b7e289b1-ddfc-4551-8750-8d4e2727fc77" status: 200 len: 1525 microversion: 2.1 time: 0.996156 Sep 14 09:07:36.935520 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2092/4191] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:07:35 2022] GET /compute/v2.1/servers/b7e289b1-ddfc-4551-8750-8d4e2727fc77 => generated 1525 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:07:36.935790 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:07:37.805638 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-02c8ce28-4ac1-45af-9de7-5e44c1375219 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:07:37.816405 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-02c8ce28-4ac1-45af-9de7-5e44c1375219 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1528 microversion: 2.1 time: 0.941980 Sep 14 09:07:37.835305 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2100/4192] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:07:36 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1528 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:07:37.857863 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-06dc17e1-1351-4d29-b2bb-84562457f2e5 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:37.858587 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-06dc17e1-1351-4d29-b2bb-84562457f2e5 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] [instance: f8ddffc4-a877-4f95-840c-ad8ef8021755] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:07:37.882106 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-06dc17e1-1351-4d29-b2bb-84562457f2e5 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:37.882608 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-06dc17e1-1351-4d29-b2bb-84562457f2e5 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:37.885273 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-06dc17e1-1351-4d29-b2bb-84562457f2e5 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:37.889588 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-06dc17e1-1351-4d29-b2bb-84562457f2e5 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:37.890616 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-06dc17e1-1351-4d29-b2bb-84562457f2e5 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:37.895236 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-06dc17e1-1351-4d29-b2bb-84562457f2e5 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:37.958157 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-0c020396-fa34-4a29-97f7-41a52c678e08 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:37.959145 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-0c020396-fa34-4a29-97f7-41a52c678e08 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] [instance: b7e289b1-ddfc-4551-8750-8d4e2727fc77] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:07:37.975697 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0c020396-fa34-4a29-97f7-41a52c678e08 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:37.976207 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0c020396-fa34-4a29-97f7-41a52c678e08 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:37.976671 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0c020396-fa34-4a29-97f7-41a52c678e08 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:37.987509 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0c020396-fa34-4a29-97f7-41a52c678e08 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:37.988078 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0c020396-fa34-4a29-97f7-41a52c678e08 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:37.988536 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0c020396-fa34-4a29-97f7-41a52c678e08 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:38.183333 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-0c020396-fa34-4a29-97f7-41a52c678e08 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd651fdca907b4c23a055a3facfab7f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0758124e187342729d19bd4b2a8124a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:07:38.186896 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-06dc17e1-1351-4d29-b2bb-84562457f2e5 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5165b8fc101c47c7a4370f9007bc5a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a597fc389b4805bbd3a53ecd17c5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:07:38.195813 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-0c020396-fa34-4a29-97f7-41a52c678e08 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] 10.222.0.60 "GET /compute/v2.1/servers/b7e289b1-ddfc-4551-8750-8d4e2727fc77" status: 200 len: 1483 microversion: 2.1 time: 0.241555 Sep 14 09:07:38.201651 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-06dc17e1-1351-4d29-b2bb-84562457f2e5 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute/v2.1/servers/f8ddffc4-a877-4f95-840c-ad8ef8021755" status: 200 len: 1266 microversion: 2.1 time: 0.346990 Sep 14 09:07:38.204070 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2101/4193] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:07:37 2022] GET /compute/v2.1/servers/b7e289b1-ddfc-4551-8750-8d4e2727fc77 => generated 1483 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:07:38.221031 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2093/4194] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:07:37 2022] GET /compute/v2.1/servers/f8ddffc4-a877-4f95-840c-ad8ef8021755 => generated 1266 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:07:38.433926 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-3019d3dc-5c21-491f-8eb0-ef951f381461 req-ba615386-0bb3-41d8-a447-85ab96a69bf8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7e289b1-ddfc-4551-8750-8d4e2727fc77", "name": "network-vif-deleted", "tag": "0fcca4e4-7aac-49d5-b0b0-b07d3ccbe5c8"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:07:38.478216 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-3019d3dc-5c21-491f-8eb0-ef951f381461 req-ba615386-0bb3-41d8-a447-85ab96a69bf8 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:38.478824 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-3019d3dc-5c21-491f-8eb0-ef951f381461 req-ba615386-0bb3-41d8-a447-85ab96a69bf8 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:38.479214 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-3019d3dc-5c21-491f-8eb0-ef951f381461 req-ba615386-0bb3-41d8-a447-85ab96a69bf8 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:38.516166 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-3019d3dc-5c21-491f-8eb0-ef951f381461 req-ba615386-0bb3-41d8-a447-85ab96a69bf8 service nova] Creating event network-vif-deleted:0fcca4e4-7aac-49d5-b0b0-b07d3ccbe5c8 for instance b7e289b1-ddfc-4551-8750-8d4e2727fc77 on n-h2-836830-18 Sep 14 09:07:38.525803 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-3019d3dc-5c21-491f-8eb0-ef951f381461 req-ba615386-0bb3-41d8-a447-85ab96a69bf8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098828 Sep 14 09:07:38.526417 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2102/4195] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:07:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:07:38.845374 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ad91c785-0172-4bd4-a4fb-8d0a9c00fad9 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:38.846313 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-ad91c785-0172-4bd4-a4fb-8d0a9c00fad9 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:07:38.858247 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ad91c785-0172-4bd4-a4fb-8d0a9c00fad9 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:38.867120 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ad91c785-0172-4bd4-a4fb-8d0a9c00fad9 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:38.867841 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ad91c785-0172-4bd4-a4fb-8d0a9c00fad9 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:38.868820 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ad91c785-0172-4bd4-a4fb-8d0a9c00fad9 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:38.871729 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ad91c785-0172-4bd4-a4fb-8d0a9c00fad9 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:38.872416 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ad91c785-0172-4bd4-a4fb-8d0a9c00fad9 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:39.234421 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-eefcf4a7-4a80-4fdd-b868-fbfe6db8bea7 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:39.235095 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-eefcf4a7-4a80-4fdd-b868-fbfe6db8bea7 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] [instance: b7e289b1-ddfc-4551-8750-8d4e2727fc77] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:07:39.267347 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-eefcf4a7-4a80-4fdd-b868-fbfe6db8bea7 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:39.268996 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-eefcf4a7-4a80-4fdd-b868-fbfe6db8bea7 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:39.285247 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-eefcf4a7-4a80-4fdd-b868-fbfe6db8bea7 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:39.286023 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-eefcf4a7-4a80-4fdd-b868-fbfe6db8bea7 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:39.287347 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-eefcf4a7-4a80-4fdd-b868-fbfe6db8bea7 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:39.307032 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-eefcf4a7-4a80-4fdd-b868-fbfe6db8bea7 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:39.493152 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-eefcf4a7-4a80-4fdd-b868-fbfe6db8bea7 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:39.500279 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-eefcf4a7-4a80-4fdd-b868-fbfe6db8bea7 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:39.509642 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-eefcf4a7-4a80-4fdd-b868-fbfe6db8bea7 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:39.524834 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.objects.instance [None req-eefcf4a7-4a80-4fdd-b868-fbfe6db8bea7 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Lazy-loading 'fault' on Instance uuid b7e289b1-ddfc-4551-8750-8d4e2727fc77 {{(pid=128759) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:07:39.748969 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-eefcf4a7-4a80-4fdd-b868-fbfe6db8bea7 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd651fdca907b4c23a055a3facfab7f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0758124e187342729d19bd4b2a8124a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:07:39.760864 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-eefcf4a7-4a80-4fdd-b868-fbfe6db8bea7 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] 10.222.0.60 "GET /compute/v2.1/servers/b7e289b1-ddfc-4551-8750-8d4e2727fc77" status: 200 len: 1313 microversion: 2.1 time: 0.533428 Sep 14 09:07:39.761465 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2103/4196] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:07:39 2022] GET /compute/v2.1/servers/b7e289b1-ddfc-4551-8750-8d4e2727fc77 => generated 1313 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:07:39.793732 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-ad91c785-0172-4bd4-a4fb-8d0a9c00fad9 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:07:39.799923 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-553a48fc-2c66-4c2d-804c-b14e0a805406 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:39.800567 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-553a48fc-2c66-4c2d-804c-b14e0a805406 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] [instance: f8ddffc4-a877-4f95-840c-ad8ef8021755] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:07:39.802491 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-ad91c785-0172-4bd4-a4fb-8d0a9c00fad9 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1528 microversion: 2.1 time: 0.960470 Sep 14 09:07:39.803320 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2094/4197] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:07:38 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1528 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:07:39.818220 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-553a48fc-2c66-4c2d-804c-b14e0a805406 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:39.819148 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-553a48fc-2c66-4c2d-804c-b14e0a805406 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:39.819781 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-553a48fc-2c66-4c2d-804c-b14e0a805406 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:39.820503 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-553a48fc-2c66-4c2d-804c-b14e0a805406 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:39.820968 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-553a48fc-2c66-4c2d-804c-b14e0a805406 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:39.821407 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-553a48fc-2c66-4c2d-804c-b14e0a805406 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:39.828212 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-4e8caec1-621e-4919-9c98-ac2e75778a02 req-93001c87-ed0b-4f2b-8385-c4e0e367b3e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8450d385-d5d9-4c86-9ece-b3bbf9ed1105", "name": "network-vif-plugged", "status": "completed", "tag": "eb873b1a-8b40-4eb4-a329-cf733d9ed342"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:07:39.849220 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-4e8caec1-621e-4919-9c98-ac2e75778a02 req-93001c87-ed0b-4f2b-8385-c4e0e367b3e7 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:39.849724 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-4e8caec1-621e-4919-9c98-ac2e75778a02 req-93001c87-ed0b-4f2b-8385-c4e0e367b3e7 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:39.850147 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-4e8caec1-621e-4919-9c98-ac2e75778a02 req-93001c87-ed0b-4f2b-8385-c4e0e367b3e7 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:39.875850 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-4e8caec1-621e-4919-9c98-ac2e75778a02 req-93001c87-ed0b-4f2b-8385-c4e0e367b3e7 service nova] Creating event network-vif-plugged:eb873b1a-8b40-4eb4-a329-cf733d9ed342 for instance 8450d385-d5d9-4c86-9ece-b3bbf9ed1105 on n-h1-836830-18 Sep 14 09:07:39.892819 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-4e8caec1-621e-4919-9c98-ac2e75778a02 req-93001c87-ed0b-4f2b-8385-c4e0e367b3e7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075877 Sep 14 09:07:39.897557 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2095/4198] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:07:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:07:40.193410 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-553a48fc-2c66-4c2d-804c-b14e0a805406 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5165b8fc101c47c7a4370f9007bc5a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a597fc389b4805bbd3a53ecd17c5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:07:40.204042 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-553a48fc-2c66-4c2d-804c-b14e0a805406 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute/v2.1/servers/f8ddffc4-a877-4f95-840c-ad8ef8021755" status: 200 len: 1308 microversion: 2.1 time: 0.420394 Sep 14 09:07:40.204887 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2104/4199] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:07:39 2022] GET /compute/v2.1/servers/f8ddffc4-a877-4f95-840c-ad8ef8021755 => generated 1308 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:07:40.795558 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-aad5884b-368e-4c02-9b47-7f36a6abb517 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:40.796276 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-aad5884b-368e-4c02-9b47-7f36a6abb517 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] [instance: b7e289b1-ddfc-4551-8750-8d4e2727fc77] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:07:40.815092 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-aad5884b-368e-4c02-9b47-7f36a6abb517 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:40.815600 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-aad5884b-368e-4c02-9b47-7f36a6abb517 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:40.820834 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-aad5884b-368e-4c02-9b47-7f36a6abb517 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:40.821793 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-aad5884b-368e-4c02-9b47-7f36a6abb517 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:40.829570 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-724f4ac7-90c0-4640-bb84-a05b32ac3f0e tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:40.830778 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-724f4ac7-90c0-4640-bb84-a05b32ac3f0e tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:07:40.841889 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-aad5884b-368e-4c02-9b47-7f36a6abb517 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:40.842654 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-aad5884b-368e-4c02-9b47-7f36a6abb517 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:40.857819 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-724f4ac7-90c0-4640-bb84-a05b32ac3f0e tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:40.859517 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-724f4ac7-90c0-4640-bb84-a05b32ac3f0e tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:40.867030 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-724f4ac7-90c0-4640-bb84-a05b32ac3f0e tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:40.874474 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-724f4ac7-90c0-4640-bb84-a05b32ac3f0e tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:40.875279 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-724f4ac7-90c0-4640-bb84-a05b32ac3f0e tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:40.875944 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-724f4ac7-90c0-4640-bb84-a05b32ac3f0e tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:40.900414 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-aad5884b-368e-4c02-9b47-7f36a6abb517 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] HTTP exception thrown: Instance b7e289b1-ddfc-4551-8750-8d4e2727fc77 could not be found. Sep 14 09:07:40.907415 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-aad5884b-368e-4c02-9b47-7f36a6abb517 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Request method failure captured: Sep 14 09:07:40.907415 n-d-836830-18 devstack@n-api.service[128758]: request: GET /compute/v2.1/servers/b7e289b1-ddfc-4551-8750-8d4e2727fc77 HTTP/1.1 Sep 14 09:07:40.907415 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 09:07:40.907415 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 09:07:40.907415 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 09:07:40.907415 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 09:07:40.907415 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 09:07:40.907415 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 09:07:40.907415 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 09:07:40.907415 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 09:07:40.907415 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZm0kZbinC3AqHm1oeKmbCOhn2T1qSl8vFCJdEyhRqg5VleKm07QUq8sdE822LW5YAmvBt0lFhQrj-zmKdJrtYq3eJ5c3hxPU6kQg8gxxYpOe_SoYgAQVSOxGfUkyIMsV2w7Ji6CdIXdbfRqpwqdjismysMbEl1pQw6KvAlxZhaQmSU Sep 14 09:07:40.907415 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 09:07:40.907415 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 09:07:40.907415 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 09:07:40.907415 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 09:07:40.907415 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 09:07:40.907415 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 09:07:40.907415 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 0758124e187342729d19bd4b2a8124a2 Sep 14 09:07:40.907415 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1841832977 Sep 14 09:07:40.907415 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 09:07:40.907415 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 09:07:40.907415 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0758124e187342729d19bd4b2a8124a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0758124e187342729d19bd4b2a8124a2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0758124e187342729d19bd4b2a8124a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0758124e187342729d19bd4b2a8124a2"}]}] Sep 14 09:07:40.907415 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1841832977 Sep 14 09:07:40.907415 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 0758124e187342729d19bd4b2a8124a2 Sep 14 09:07:40.907415 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1841832977 Sep 14 09:07:40.907415 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-ServerMetadataNegativeTestJSON-1841832977-project Sep 14 09:07:40.907415 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 09:07:40.907415 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 09:07:40.907415 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: d651fdca907b4c23a055a3facfab7f2d Sep 14 09:07:40.907415 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1841832977-project Sep 14 09:07:40.907415 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 09:07:40.907415 n-d-836830-18 devstack@n-api.service[128758]: exception: Instance b7e289b1-ddfc-4551-8750-8d4e2727fc77 could not be found. Sep 14 09:07:40.907415 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': 'b7e289b1-ddfc-4551-8750-8d4e2727fc77'} Sep 14 09:07:40.907415 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:07:40.907415 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:07:40.907415 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:07:40.907415 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:07:40.907415 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:07:40.907415 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:07:40.907415 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:07:40.907415 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:07:40.907415 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:07:40.907415 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:07:40.907415 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7e289b1-ddfc-4551-8750-8d4e2727fc77 could not be found. Sep 14 09:07:40.907415 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:07:40.907415 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:07:40.907415 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:07:40.907415 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:07:40.907415 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:07:40.907415 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:07:40.907415 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:07:40.907415 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:07:40.907415 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:07:40.907415 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:07:40.907415 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:07:40.907415 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:07:40.907415 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:07:40.907415 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:07:40.907415 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:07:40.907415 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:07:40.907415 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7e289b1-ddfc-4551-8750-8d4e2727fc77 could not be found. Sep 14 09:07:40.907415 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:07:40.907415 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:07:40.912059 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:07:40.912059 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:07:40.912059 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:07:40.912059 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:07:40.912059 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:07:40.912059 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:07:40.912059 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7e289b1-ddfc-4551-8750-8d4e2727fc77 could not be found. Sep 14 09:07:40.912059 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:07:40.915522 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-aad5884b-368e-4c02-9b47-7f36a6abb517 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] Returning 404 to user: Instance b7e289b1-ddfc-4551-8750-8d4e2727fc77 could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:07:40.916605 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-aad5884b-368e-4c02-9b47-7f36a6abb517 tempest-ServerMetadataNegativeTestJSON-1841832977 tempest-ServerMetadataNegativeTestJSON-1841832977-project] 10.222.0.60 "GET /compute/v2.1/servers/b7e289b1-ddfc-4551-8750-8d4e2727fc77" status: 404 len: 111 microversion: 2.1 time: 0.129218 Sep 14 09:07:40.923477 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2096/4200] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:07:40 2022] GET /compute/v2.1/servers/b7e289b1-ddfc-4551-8750-8d4e2727fc77 => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:07:41.236381 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-903add04-203e-4a0b-993b-59e1304d429b tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:41.237152 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-903add04-203e-4a0b-993b-59e1304d429b tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] [instance: f8ddffc4-a877-4f95-840c-ad8ef8021755] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:07:41.244455 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-903add04-203e-4a0b-993b-59e1304d429b tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:41.245427 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-903add04-203e-4a0b-993b-59e1304d429b tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:41.246615 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-903add04-203e-4a0b-993b-59e1304d429b tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:41.248844 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-903add04-203e-4a0b-993b-59e1304d429b tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:41.250661 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-903add04-203e-4a0b-993b-59e1304d429b tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:41.255392 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-903add04-203e-4a0b-993b-59e1304d429b tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:42.212432 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-724f4ac7-90c0-4640-bb84-a05b32ac3f0e tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:07:42.222266 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-724f4ac7-90c0-4640-bb84-a05b32ac3f0e tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1528 microversion: 2.1 time: 1.396443 Sep 14 09:07:42.226413 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2105/4201] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:07:40 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1528 bytes in 1401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:07:42.443072 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-903add04-203e-4a0b-993b-59e1304d429b tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5165b8fc101c47c7a4370f9007bc5a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a597fc389b4805bbd3a53ecd17c5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:07:42.460865 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-903add04-203e-4a0b-993b-59e1304d429b tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute/v2.1/servers/f8ddffc4-a877-4f95-840c-ad8ef8021755" status: 200 len: 1308 microversion: 2.1 time: 1.232230 Sep 14 09:07:42.462171 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2097/4202] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:07:41 2022] GET /compute/v2.1/servers/f8ddffc4-a877-4f95-840c-ad8ef8021755 => generated 1308 bytes in 1240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:07:42.820491 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-707c3f76-5fc1-49a3-a208-f53d8adb8487 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-1631981700", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "networks": [{"uuid": "0577487a-08cf-4f1d-a0ed-82a9e8fd7c9b"}]}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:07:43.257606 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ec6edbbd-2700-4285-8ce7-2d7019d9d583 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:43.263243 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-ec6edbbd-2700-4285-8ce7-2d7019d9d583 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:07:43.286522 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=2 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:07:43.293155 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ec6edbbd-2700-4285-8ce7-2d7019d9d583 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:43.296169 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ec6edbbd-2700-4285-8ce7-2d7019d9d583 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:43.299091 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ec6edbbd-2700-4285-8ce7-2d7019d9d583 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:43.302686 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ec6edbbd-2700-4285-8ce7-2d7019d9d583 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:43.305735 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ec6edbbd-2700-4285-8ce7-2d7019d9d583 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:43.306491 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ec6edbbd-2700-4285-8ce7-2d7019d9d583 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:44.248789 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=8 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:07:45.767937 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-ec6edbbd-2700-4285-8ce7-2d7019d9d583 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:07:45.771465 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:07:45.783131 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-ec6edbbd-2700-4285-8ce7-2d7019d9d583 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1528 microversion: 2.1 time: 2.532447 Sep 14 09:07:45.797861 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2098/4203] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:07:43 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1528 bytes in 2548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:07:45.809460 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-09318449-26ce-4a00-9feb-5dc537ab3ad2 req-b0763f82-3835-410c-884b-125d161bf78d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8ddffc4-a877-4f95-840c-ad8ef8021755", "tag": "42b91ece-9a73-43f2-ab71-9b62a3d0ff21"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:07:45.845039 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-09318449-26ce-4a00-9feb-5dc537ab3ad2 req-b0763f82-3835-410c-884b-125d161bf78d service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:45.845538 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-09318449-26ce-4a00-9feb-5dc537ab3ad2 req-b0763f82-3835-410c-884b-125d161bf78d service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:45.847783 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-09318449-26ce-4a00-9feb-5dc537ab3ad2 req-b0763f82-3835-410c-884b-125d161bf78d service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:45.925067 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-09318449-26ce-4a00-9feb-5dc537ab3ad2 req-b0763f82-3835-410c-884b-125d161bf78d service nova] Creating event network-changed:42b91ece-9a73-43f2-ab71-9b62a3d0ff21 for instance f8ddffc4-a877-4f95-840c-ad8ef8021755 on n-h1-836830-18 Sep 14 09:07:45.944587 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-09318449-26ce-4a00-9feb-5dc537ab3ad2 req-b0763f82-3835-410c-884b-125d161bf78d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.145059 Sep 14 09:07:45.950400 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2099/4204] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:07:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:07:45.984971 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-76df1c8a-434c-4c2d-b4ea-de3f0e9118ea tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:46.015042 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-76df1c8a-434c-4c2d-b4ea-de3f0e9118ea tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] [instance: f8ddffc4-a877-4f95-840c-ad8ef8021755] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:07:46.044171 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-76df1c8a-434c-4c2d-b4ea-de3f0e9118ea tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:46.044679 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-76df1c8a-434c-4c2d-b4ea-de3f0e9118ea tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:46.045130 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-76df1c8a-434c-4c2d-b4ea-de3f0e9118ea tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:46.061219 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-76df1c8a-434c-4c2d-b4ea-de3f0e9118ea tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:46.066496 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-76df1c8a-434c-4c2d-b4ea-de3f0e9118ea tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:46.069399 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-76df1c8a-434c-4c2d-b4ea-de3f0e9118ea tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:46.610708 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-76df1c8a-434c-4c2d-b4ea-de3f0e9118ea tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5165b8fc101c47c7a4370f9007bc5a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a597fc389b4805bbd3a53ecd17c5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:07:46.629838 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-76df1c8a-434c-4c2d-b4ea-de3f0e9118ea tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute/v2.1/servers/f8ddffc4-a877-4f95-840c-ad8ef8021755" status: 200 len: 1308 microversion: 2.1 time: 0.669387 Sep 14 09:07:46.648869 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2100/4205] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:07:45 2022] GET /compute/v2.1/servers/f8ddffc4-a877-4f95-840c-ad8ef8021755 => generated 1308 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:07:46.809105 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-2896aa07-800f-47c7-9af2-c1e281dd2cf1 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:46.810599 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-2896aa07-800f-47c7-9af2-c1e281dd2cf1 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:07:46.833888 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2896aa07-800f-47c7-9af2-c1e281dd2cf1 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:46.836425 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2896aa07-800f-47c7-9af2-c1e281dd2cf1 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:46.837826 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2896aa07-800f-47c7-9af2-c1e281dd2cf1 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:46.843585 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2896aa07-800f-47c7-9af2-c1e281dd2cf1 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:46.846585 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2896aa07-800f-47c7-9af2-c1e281dd2cf1 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:46.852901 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2896aa07-800f-47c7-9af2-c1e281dd2cf1 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:47.617052 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-2896aa07-800f-47c7-9af2-c1e281dd2cf1 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:07:47.629077 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-2896aa07-800f-47c7-9af2-c1e281dd2cf1 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1528 microversion: 2.1 time: 0.823841 Sep 14 09:07:47.637441 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2101/4206] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:07:46 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1528 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:07:47.672261 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-3e0e5696-c3b6-4540-8075-4106b9755274 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:47.672381 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-3e0e5696-c3b6-4540-8075-4106b9755274 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] [instance: f8ddffc4-a877-4f95-840c-ad8ef8021755] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:07:47.680865 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3e0e5696-c3b6-4540-8075-4106b9755274 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:47.684122 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3e0e5696-c3b6-4540-8075-4106b9755274 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:47.685997 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3e0e5696-c3b6-4540-8075-4106b9755274 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:47.688451 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3e0e5696-c3b6-4540-8075-4106b9755274 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:47.689180 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3e0e5696-c3b6-4540-8075-4106b9755274 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:47.690338 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3e0e5696-c3b6-4540-8075-4106b9755274 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:48.205617 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.network.neutron [None req-707c3f76-5fc1-49a3-a208-f53d8adb8487 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] validate_networks() for [('0577487a-08cf-4f1d-a0ed-82a9e8fd7c9b', None, None, None, None, None)] {{(pid=128759) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:07:48.497603 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-3e0e5696-c3b6-4540-8075-4106b9755274 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5165b8fc101c47c7a4370f9007bc5a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a597fc389b4805bbd3a53ecd17c5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:07:48.506662 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-3e0e5696-c3b6-4540-8075-4106b9755274 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute/v2.1/servers/f8ddffc4-a877-4f95-840c-ad8ef8021755" status: 200 len: 1308 microversion: 2.1 time: 0.838582 Sep 14 09:07:48.521276 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2102/4207] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:07:47 2022] GET /compute/v2.1/servers/f8ddffc4-a877-4f95-840c-ad8ef8021755 => generated 1308 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:07:48.654998 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-5f085bbe-d878-4481-bf6a-e18e1591777a tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:48.655735 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-5f085bbe-d878-4481-bf6a-e18e1591777a tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:07:48.678055 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5f085bbe-d878-4481-bf6a-e18e1591777a tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:48.678817 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5f085bbe-d878-4481-bf6a-e18e1591777a tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:48.679357 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5f085bbe-d878-4481-bf6a-e18e1591777a tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:48.683685 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5f085bbe-d878-4481-bf6a-e18e1591777a tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:48.684600 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5f085bbe-d878-4481-bf6a-e18e1591777a tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:48.685030 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5f085bbe-d878-4481-bf6a-e18e1591777a tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:49.371791 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-707c3f76-5fc1-49a3-a208-f53d8adb8487 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Flavor limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:07:49.373037 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-707c3f76-5fc1-49a3-a208-f53d8adb8487 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Image limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:07:49.373689 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-707c3f76-5fc1-49a3-a208-f53d8adb8487 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Flavor pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:07:49.375007 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-707c3f76-5fc1-49a3-a208-f53d8adb8487 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Image pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:07:49.375592 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-707c3f76-5fc1-49a3-a208-f53d8adb8487 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:07:49.391107 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-707c3f76-5fc1-49a3-a208-f53d8adb8487 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:49.392780 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-707c3f76-5fc1-49a3-a208-f53d8adb8487 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:49.393463 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-707c3f76-5fc1-49a3-a208-f53d8adb8487 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:49.398856 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-707c3f76-5fc1-49a3-a208-f53d8adb8487 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:49.400617 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-707c3f76-5fc1-49a3-a208-f53d8adb8487 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:49.401453 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-707c3f76-5fc1-49a3-a208-f53d8adb8487 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:49.407145 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-5f085bbe-d878-4481-bf6a-e18e1591777a tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:07:49.429179 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-5f085bbe-d878-4481-bf6a-e18e1591777a tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1510 microversion: 2.1 time: 0.777243 Sep 14 09:07:49.468358 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2103/4208] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:07:48 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1510 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:07:49.518677 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-707c3f76-5fc1-49a3-a208-f53d8adb8487 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Getting quotas for project 7f279926ee014c148690608fe635e3a2. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:07:49.543450 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-707c3f76-5fc1-49a3-a208-f53d8adb8487 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Getting quotas for user 2d6eab0235b041d4b1d2ffe2fae8bdd3 and project 7f279926ee014c148690608fe635e3a2. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:07:49.548266 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d2ac2410-c9d9-4858-93bd-ac929a7f8596 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:49.552350 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-d2ac2410-c9d9-4858-93bd-ac929a7f8596 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] [instance: f8ddffc4-a877-4f95-840c-ad8ef8021755] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:07:49.578849 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d2ac2410-c9d9-4858-93bd-ac929a7f8596 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:49.580019 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d2ac2410-c9d9-4858-93bd-ac929a7f8596 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:49.582866 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d2ac2410-c9d9-4858-93bd-ac929a7f8596 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:49.584024 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d2ac2410-c9d9-4858-93bd-ac929a7f8596 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:49.586518 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d2ac2410-c9d9-4858-93bd-ac929a7f8596 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:49.588351 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d2ac2410-c9d9-4858-93bd-ac929a7f8596 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:49.617244 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-707c3f76-5fc1-49a3-a208-f53d8adb8487 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Going to run 1 instances... {{(pid=128759) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:07:49.623784 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-707c3f76-5fc1-49a3-a208-f53d8adb8487 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] [instance: d5d94249-deeb-4715-bd69-ba27597f46ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128759) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:07:49.733745 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-707c3f76-5fc1-49a3-a208-f53d8adb8487 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 7.303294 Sep 14 09:07:49.734409 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2106/4209] 10.222.0.60 () {62 vars in 1188 bytes} [Wed Sep 14 09:07:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 7305 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Sep 14 09:07:49.753678 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-351acff2-3799-4a9f-aa27-850de87ea174 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:49.777236 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-351acff2-3799-4a9f-aa27-850de87ea174 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] [instance: d5d94249-deeb-4715-bd69-ba27597f46ef] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:07:50.245048 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-351acff2-3799-4a9f-aa27-850de87ea174 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6eab0235b041d4b1d2ffe2fae8bdd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f279926ee014c148690608fe635e3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:07:50.261591 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-351acff2-3799-4a9f-aa27-850de87ea174 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d6eab0235b041d4b1d2ffe2fae8bdd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f279926ee014c148690608fe635e3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:07:50.267310 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-351acff2-3799-4a9f-aa27-850de87ea174 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d6eab0235b041d4b1d2ffe2fae8bdd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f279926ee014c148690608fe635e3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:07:50.275745 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-351acff2-3799-4a9f-aa27-850de87ea174 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] 10.222.0.60 "GET /compute/v2.1/servers/d5d94249-deeb-4715-bd69-ba27597f46ef" status: 200 len: 1262 microversion: 2.26 time: 0.531510 Sep 14 09:07:50.282692 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2107/4210] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:07:49 2022] GET /compute/v2.1/servers/d5d94249-deeb-4715-bd69-ba27597f46ef => generated 1262 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:07:50.464143 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-08e2fa2f-3b44-4cb1-9900-01396d7a61b0 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:50.464768 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-08e2fa2f-3b44-4cb1-9900-01396d7a61b0 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:07:50.484397 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-08e2fa2f-3b44-4cb1-9900-01396d7a61b0 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:50.485230 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-08e2fa2f-3b44-4cb1-9900-01396d7a61b0 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:50.487544 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-08e2fa2f-3b44-4cb1-9900-01396d7a61b0 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:50.488860 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-08e2fa2f-3b44-4cb1-9900-01396d7a61b0 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:50.490457 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-08e2fa2f-3b44-4cb1-9900-01396d7a61b0 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:50.492944 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-08e2fa2f-3b44-4cb1-9900-01396d7a61b0 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:50.743397 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-d2ac2410-c9d9-4858-93bd-ac929a7f8596 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5165b8fc101c47c7a4370f9007bc5a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a597fc389b4805bbd3a53ecd17c5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:07:50.762780 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-d2ac2410-c9d9-4858-93bd-ac929a7f8596 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute/v2.1/servers/f8ddffc4-a877-4f95-840c-ad8ef8021755" status: 200 len: 1308 microversion: 2.1 time: 1.217864 Sep 14 09:07:50.787112 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2104/4211] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:07:49 2022] GET /compute/v2.1/servers/f8ddffc4-a877-4f95-840c-ad8ef8021755 => generated 1308 bytes in 1242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:07:51.182616 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-08e2fa2f-3b44-4cb1-9900-01396d7a61b0 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:07:51.193286 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-08e2fa2f-3b44-4cb1-9900-01396d7a61b0 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1510 microversion: 2.1 time: 0.732740 Sep 14 09:07:51.193905 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2108/4212] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:07:50 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1510 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:07:51.313008 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-0cb65287-4916-454f-ac71-beb836d78776 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:51.313635 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-0cb65287-4916-454f-ac71-beb836d78776 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] [instance: d5d94249-deeb-4715-bd69-ba27597f46ef] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:07:51.332607 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0cb65287-4916-454f-ac71-beb836d78776 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:51.333435 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0cb65287-4916-454f-ac71-beb836d78776 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:51.334682 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0cb65287-4916-454f-ac71-beb836d78776 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:51.335627 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0cb65287-4916-454f-ac71-beb836d78776 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:51.336258 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0cb65287-4916-454f-ac71-beb836d78776 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:51.336890 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0cb65287-4916-454f-ac71-beb836d78776 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:51.472032 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-0cb65287-4916-454f-ac71-beb836d78776 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6eab0235b041d4b1d2ffe2fae8bdd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f279926ee014c148690608fe635e3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:07:51.481824 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-0cb65287-4916-454f-ac71-beb836d78776 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d6eab0235b041d4b1d2ffe2fae8bdd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f279926ee014c148690608fe635e3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:07:51.483324 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-0cb65287-4916-454f-ac71-beb836d78776 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d6eab0235b041d4b1d2ffe2fae8bdd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f279926ee014c148690608fe635e3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:07:51.484484 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-0cb65287-4916-454f-ac71-beb836d78776 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] 10.222.0.60 "GET /compute/v2.1/servers/d5d94249-deeb-4715-bd69-ba27597f46ef" status: 200 len: 1266 microversion: 2.26 time: 0.175504 Sep 14 09:07:51.485033 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2105/4213] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:07:51 2022] GET /compute/v2.1/servers/d5d94249-deeb-4715-bd69-ba27597f46ef => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:07:51.796858 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c8b92621-d0ca-4d3d-984a-b4693f454779 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:51.797510 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-c8b92621-d0ca-4d3d-984a-b4693f454779 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] [instance: f8ddffc4-a877-4f95-840c-ad8ef8021755] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:07:51.808846 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c8b92621-d0ca-4d3d-984a-b4693f454779 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:51.809416 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c8b92621-d0ca-4d3d-984a-b4693f454779 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:51.809915 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c8b92621-d0ca-4d3d-984a-b4693f454779 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:51.810792 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c8b92621-d0ca-4d3d-984a-b4693f454779 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:51.811326 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c8b92621-d0ca-4d3d-984a-b4693f454779 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:51.811754 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c8b92621-d0ca-4d3d-984a-b4693f454779 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:52.058542 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-4f1727bb-4b73-489e-9a63-c4ad46f8ac8a req-449876cd-371a-44f7-a826-ba2fe729f950 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8ddffc4-a877-4f95-840c-ad8ef8021755", "name": "network-vif-plugged", "status": "completed", "tag": "42b91ece-9a73-43f2-ab71-9b62a3d0ff21"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:07:52.081766 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-4f1727bb-4b73-489e-9a63-c4ad46f8ac8a req-449876cd-371a-44f7-a826-ba2fe729f950 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:52.089406 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-4f1727bb-4b73-489e-9a63-c4ad46f8ac8a req-449876cd-371a-44f7-a826-ba2fe729f950 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:52.090190 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-4f1727bb-4b73-489e-9a63-c4ad46f8ac8a req-449876cd-371a-44f7-a826-ba2fe729f950 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:52.137882 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-4f1727bb-4b73-489e-9a63-c4ad46f8ac8a req-449876cd-371a-44f7-a826-ba2fe729f950 service nova] Creating event network-vif-plugged:42b91ece-9a73-43f2-ab71-9b62a3d0ff21 for instance f8ddffc4-a877-4f95-840c-ad8ef8021755 on n-h1-836830-18 Sep 14 09:07:52.152946 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-4f1727bb-4b73-489e-9a63-c4ad46f8ac8a req-449876cd-371a-44f7-a826-ba2fe729f950 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097371 Sep 14 09:07:52.157167 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2106/4214] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:07:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:07:52.218793 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-59c0c482-9858-4149-83f1-1881728f6521 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:52.223805 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-59c0c482-9858-4149-83f1-1881728f6521 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:07:52.240918 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-59c0c482-9858-4149-83f1-1881728f6521 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:52.245773 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-59c0c482-9858-4149-83f1-1881728f6521 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:52.246623 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-59c0c482-9858-4149-83f1-1881728f6521 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:52.247683 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-59c0c482-9858-4149-83f1-1881728f6521 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:52.248342 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-59c0c482-9858-4149-83f1-1881728f6521 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:52.249038 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-59c0c482-9858-4149-83f1-1881728f6521 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:52.499711 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-c8b92621-d0ca-4d3d-984a-b4693f454779 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5165b8fc101c47c7a4370f9007bc5a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a597fc389b4805bbd3a53ecd17c5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:07:52.511063 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-c8b92621-d0ca-4d3d-984a-b4693f454779 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute/v2.1/servers/f8ddffc4-a877-4f95-840c-ad8ef8021755" status: 200 len: 1308 microversion: 2.1 time: 0.720856 Sep 14 09:07:52.528634 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2109/4215] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:07:51 2022] GET /compute/v2.1/servers/f8ddffc4-a877-4f95-840c-ad8ef8021755 => generated 1308 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:07:52.535471 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-5d56ffef-8c22-4147-9b7d-a2d2a58a9734 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:52.536132 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-5d56ffef-8c22-4147-9b7d-a2d2a58a9734 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] [instance: d5d94249-deeb-4715-bd69-ba27597f46ef] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:07:52.543770 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:07:52.546565 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5d56ffef-8c22-4147-9b7d-a2d2a58a9734 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:52.548301 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5d56ffef-8c22-4147-9b7d-a2d2a58a9734 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:52.548979 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5d56ffef-8c22-4147-9b7d-a2d2a58a9734 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:52.552838 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5d56ffef-8c22-4147-9b7d-a2d2a58a9734 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:52.554470 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5d56ffef-8c22-4147-9b7d-a2d2a58a9734 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:52.554968 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5d56ffef-8c22-4147-9b7d-a2d2a58a9734 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:52.760147 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-5d56ffef-8c22-4147-9b7d-a2d2a58a9734 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6eab0235b041d4b1d2ffe2fae8bdd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f279926ee014c148690608fe635e3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:07:52.771728 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-5d56ffef-8c22-4147-9b7d-a2d2a58a9734 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d6eab0235b041d4b1d2ffe2fae8bdd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f279926ee014c148690608fe635e3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:07:52.773195 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-5d56ffef-8c22-4147-9b7d-a2d2a58a9734 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d6eab0235b041d4b1d2ffe2fae8bdd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f279926ee014c148690608fe635e3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:07:52.774345 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-5d56ffef-8c22-4147-9b7d-a2d2a58a9734 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] 10.222.0.60 "GET /compute/v2.1/servers/d5d94249-deeb-4715-bd69-ba27597f46ef" status: 200 len: 1266 microversion: 2.26 time: 0.244510 Sep 14 09:07:52.787348 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2110/4216] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:07:52 2022] GET /compute/v2.1/servers/d5d94249-deeb-4715-bd69-ba27597f46ef => generated 1266 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:07:52.854182 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-59c0c482-9858-4149-83f1-1881728f6521 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:07:52.862008 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-59c0c482-9858-4149-83f1-1881728f6521 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1510 microversion: 2.1 time: 0.647556 Sep 14 09:07:52.878377 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2107/4217] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:07:52 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1510 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:07:53.533664 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-5d1511f4-9209-43b7-b350-c5ca2494457a tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:53.535204 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-5d1511f4-9209-43b7-b350-c5ca2494457a tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] [instance: f8ddffc4-a877-4f95-840c-ad8ef8021755] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:07:53.558686 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5d1511f4-9209-43b7-b350-c5ca2494457a tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:53.563261 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5d1511f4-9209-43b7-b350-c5ca2494457a tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:53.564050 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5d1511f4-9209-43b7-b350-c5ca2494457a tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:53.565021 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5d1511f4-9209-43b7-b350-c5ca2494457a tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:53.568171 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5d1511f4-9209-43b7-b350-c5ca2494457a tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:53.568874 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5d1511f4-9209-43b7-b350-c5ca2494457a tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:53.804520 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-6164a16d-177a-4bab-9903-fc9b5a23db24 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:53.805066 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-6164a16d-177a-4bab-9903-fc9b5a23db24 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] [instance: d5d94249-deeb-4715-bd69-ba27597f46ef] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:07:53.819683 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6164a16d-177a-4bab-9903-fc9b5a23db24 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:53.820181 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6164a16d-177a-4bab-9903-fc9b5a23db24 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:53.820623 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6164a16d-177a-4bab-9903-fc9b5a23db24 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:53.821341 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6164a16d-177a-4bab-9903-fc9b5a23db24 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:53.827577 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6164a16d-177a-4bab-9903-fc9b5a23db24 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:53.828250 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6164a16d-177a-4bab-9903-fc9b5a23db24 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:54.694544 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-6164a16d-177a-4bab-9903-fc9b5a23db24 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6eab0235b041d4b1d2ffe2fae8bdd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f279926ee014c148690608fe635e3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:07:54.712498 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-6164a16d-177a-4bab-9903-fc9b5a23db24 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d6eab0235b041d4b1d2ffe2fae8bdd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f279926ee014c148690608fe635e3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:07:54.714598 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-6164a16d-177a-4bab-9903-fc9b5a23db24 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d6eab0235b041d4b1d2ffe2fae8bdd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f279926ee014c148690608fe635e3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:07:54.715797 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-6164a16d-177a-4bab-9903-fc9b5a23db24 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] 10.222.0.60 "GET /compute/v2.1/servers/d5d94249-deeb-4715-bd69-ba27597f46ef" status: 200 len: 1314 microversion: 2.26 time: 0.915856 Sep 14 09:07:54.716367 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2108/4218] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:07:53 2022] GET /compute/v2.1/servers/d5d94249-deeb-4715-bd69-ba27597f46ef => generated 1314 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:07:54.721171 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-768fb805-40f8-4fb1-a3a4-57ca58cad01f tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:54.727582 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-768fb805-40f8-4fb1-a3a4-57ca58cad01f tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:07:54.736372 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-768fb805-40f8-4fb1-a3a4-57ca58cad01f tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:54.741518 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-768fb805-40f8-4fb1-a3a4-57ca58cad01f tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:54.742134 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-768fb805-40f8-4fb1-a3a4-57ca58cad01f tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:54.743071 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-768fb805-40f8-4fb1-a3a4-57ca58cad01f tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:54.743687 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-768fb805-40f8-4fb1-a3a4-57ca58cad01f tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:54.744272 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-768fb805-40f8-4fb1-a3a4-57ca58cad01f tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:54.836830 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-5d1511f4-9209-43b7-b350-c5ca2494457a tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5165b8fc101c47c7a4370f9007bc5a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a597fc389b4805bbd3a53ecd17c5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:07:54.845415 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-5d1511f4-9209-43b7-b350-c5ca2494457a tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute/v2.1/servers/f8ddffc4-a877-4f95-840c-ad8ef8021755" status: 200 len: 1308 microversion: 2.1 time: 1.315661 Sep 14 09:07:54.860103 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2111/4219] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:07:53 2022] GET /compute/v2.1/servers/f8ddffc4-a877-4f95-840c-ad8ef8021755 => generated 1308 bytes in 1331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:07:54.873533 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-4430b244-29a8-43c3-ba51-02d4dc1f0243 req-80f39e58-3b13-4b65-903e-2cddd917c632 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae344b98-a354-4df8-83ba-3c5a786694f4", "name": "network-vif-unplugged", "status": "completed", "tag": "61e7783e-94c8-44e3-8a64-73b1fe49a7cd"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:07:54.895137 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-4430b244-29a8-43c3-ba51-02d4dc1f0243 req-80f39e58-3b13-4b65-903e-2cddd917c632 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:54.896052 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-4430b244-29a8-43c3-ba51-02d4dc1f0243 req-80f39e58-3b13-4b65-903e-2cddd917c632 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:54.896726 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-4430b244-29a8-43c3-ba51-02d4dc1f0243 req-80f39e58-3b13-4b65-903e-2cddd917c632 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:54.913281 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.compute.server_external_events [req-4430b244-29a8-43c3-ba51-02d4dc1f0243 req-80f39e58-3b13-4b65-903e-2cddd917c632 service nova] Unable to find a host for instance ae344b98-a354-4df8-83ba-3c5a786694f4. Dropping event network-vif-unplugged {{(pid=128759) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 14 09:07:54.914576 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-4430b244-29a8-43c3-ba51-02d4dc1f0243 req-80f39e58-3b13-4b65-903e-2cddd917c632 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.051356 Sep 14 09:07:54.928317 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2112/4220] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:07:54 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 67 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 14 09:07:55.598991 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-768fb805-40f8-4fb1-a3a4-57ca58cad01f tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:07:55.618499 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-768fb805-40f8-4fb1-a3a4-57ca58cad01f tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1453 microversion: 2.1 time: 0.900745 Sep 14 09:07:55.646970 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2109/4221] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:07:54 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1453 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:07:55.664140 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-38efa87f-1033-4278-9121-6e6024e68be7 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:55.665009 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-38efa87f-1033-4278-9121-6e6024e68be7 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:07:55.693487 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-38efa87f-1033-4278-9121-6e6024e68be7 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:55.701046 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-38efa87f-1033-4278-9121-6e6024e68be7 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:55.701518 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-38efa87f-1033-4278-9121-6e6024e68be7 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:55.707187 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-38efa87f-1033-4278-9121-6e6024e68be7 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:55.709156 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-38efa87f-1033-4278-9121-6e6024e68be7 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:55.713530 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-38efa87f-1033-4278-9121-6e6024e68be7 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:55.744259 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-3ac40fc2-137b-4c58-a0ea-3297a532b25e tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:55.744881 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-3ac40fc2-137b-4c58-a0ea-3297a532b25e tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] [instance: d5d94249-deeb-4715-bd69-ba27597f46ef] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:07:55.757103 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3ac40fc2-137b-4c58-a0ea-3297a532b25e tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:55.760178 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3ac40fc2-137b-4c58-a0ea-3297a532b25e tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:55.766979 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3ac40fc2-137b-4c58-a0ea-3297a532b25e tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:55.771069 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3ac40fc2-137b-4c58-a0ea-3297a532b25e tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:55.771645 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3ac40fc2-137b-4c58-a0ea-3297a532b25e tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:55.772099 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3ac40fc2-137b-4c58-a0ea-3297a532b25e tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:56.258910 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-3ac40fc2-137b-4c58-a0ea-3297a532b25e tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6eab0235b041d4b1d2ffe2fae8bdd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f279926ee014c148690608fe635e3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:07:56.267882 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-3ac40fc2-137b-4c58-a0ea-3297a532b25e tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d6eab0235b041d4b1d2ffe2fae8bdd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f279926ee014c148690608fe635e3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:07:56.278210 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-3ac40fc2-137b-4c58-a0ea-3297a532b25e tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d6eab0235b041d4b1d2ffe2fae8bdd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f279926ee014c148690608fe635e3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:07:56.293454 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-3ac40fc2-137b-4c58-a0ea-3297a532b25e tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] 10.222.0.60 "GET /compute/v2.1/servers/d5d94249-deeb-4715-bd69-ba27597f46ef" status: 200 len: 1320 microversion: 2.26 time: 0.553024 Sep 14 09:07:56.299567 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2110/4222] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:07:55 2022] GET /compute/v2.1/servers/d5d94249-deeb-4715-bd69-ba27597f46ef => generated 1320 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 09:07:56.310577 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-6444c751-c37d-410c-973d-2bdfc3323e6b tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:56.319801 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-6444c751-c37d-410c-973d-2bdfc3323e6b tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] [instance: f8ddffc4-a877-4f95-840c-ad8ef8021755] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:07:56.353291 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6444c751-c37d-410c-973d-2bdfc3323e6b tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:56.359191 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6444c751-c37d-410c-973d-2bdfc3323e6b tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:56.359711 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6444c751-c37d-410c-973d-2bdfc3323e6b tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:56.360464 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6444c751-c37d-410c-973d-2bdfc3323e6b tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:56.362339 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-38efa87f-1033-4278-9121-6e6024e68be7 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:07:56.369596 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6444c751-c37d-410c-973d-2bdfc3323e6b tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:56.370089 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6444c751-c37d-410c-973d-2bdfc3323e6b tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:56.392016 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-38efa87f-1033-4278-9121-6e6024e68be7 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1453 microversion: 2.1 time: 0.733351 Sep 14 09:07:56.421149 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2113/4223] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:07:55 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1453 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:07:56.508224 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-afb15070-df86-454d-8456-cda317c96ce7 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:07:56.509402 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-afb15070-df86-454d-8456-cda317c96ce7 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:07:56.525203 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-afb15070-df86-454d-8456-cda317c96ce7 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:56.527585 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-afb15070-df86-454d-8456-cda317c96ce7 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:56.528443 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-afb15070-df86-454d-8456-cda317c96ce7 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:56.531306 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-afb15070-df86-454d-8456-cda317c96ce7 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:56.531972 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-afb15070-df86-454d-8456-cda317c96ce7 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:56.533134 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-afb15070-df86-454d-8456-cda317c96ce7 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:56.625164 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.objects.instance [None req-afb15070-df86-454d-8456-cda317c96ce7 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lazy-loading 'flavor' on Instance uuid ae344b98-a354-4df8-83ba-3c5a786694f4 {{(pid=128759) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:07:56.668163 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-afb15070-df86-454d-8456-cda317c96ce7 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] HTTP exception thrown: Cannot 'shelve' instance ae344b98-a354-4df8-83ba-3c5a786694f4 while it is in vm_state shelved_offloaded Sep 14 09:07:56.670153 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-afb15070-df86-454d-8456-cda317c96ce7 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Request method failure captured: Sep 14 09:07:56.670153 n-d-836830-18 devstack@n-api.service[128759]: request: POST /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4/action HTTP/1.1 Sep 14 09:07:56.670153 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:07:56.670153 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:07:56.670153 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:07:56.670153 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 14 Sep 14 09:07:56.670153 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:07:56.670153 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:07:56.670153 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:07:56.670153 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:07:56.670153 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZk2EvHIWQyXATvY4f6phbqF3DzIIyaJjJFCE11LxTKbrsndvuk5zoyyEUR0VXx32_kFjD0I6jBROuj0ZPSHQav7u9FFvOPFGrPkf9qZrgXY9k3zAUFrOVfwLECoLZOolubyCPUAGSEOi_HvFIP_Dd_DCbUCKDEGGLtdnAzy2tLCxHs Sep 14 09:07:56.670153 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:07:56.670153 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:07:56.670153 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:07:56.670153 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:07:56.670153 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:07:56.670153 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:07:56.670153 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 6907b82c9d5c4a23a63bbeec31c3c365 Sep 14 09:07:56.670153 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ServersNegativeTestJSON-1654813540 Sep 14 09:07:56.670153 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:07:56.670153 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:07:56.670153 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6907b82c9d5c4a23a63bbeec31c3c365"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6907b82c9d5c4a23a63bbeec31c3c365"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6907b82c9d5c4a23a63bbeec31c3c365"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6907b82c9d5c4a23a63bbeec31c3c365"}]}] Sep 14 09:07:56.670153 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ServersNegativeTestJSON-1654813540 Sep 14 09:07:56.670153 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 6907b82c9d5c4a23a63bbeec31c3c365 Sep 14 09:07:56.670153 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1654813540 Sep 14 09:07:56.670153 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ServersNegativeTestJSON-1654813540-project Sep 14 09:07:56.670153 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:07:56.670153 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:07:56.670153 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 79583c4e80a04f138927f09eb4e170f4 Sep 14 09:07:56.670153 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ServersNegativeTestJSON-1654813540-project Sep 14 09:07:56.670153 n-d-836830-18 devstack@n-api.service[128759]: Sep 14 09:07:56.670153 n-d-836830-18 devstack@n-api.service[128759]: {"shelve": {}} Sep 14 09:07:56.670153 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:07:56.670153 n-d-836830-18 devstack@n-api.service[128759]: exception: Cannot 'shelve' instance ae344b98-a354-4df8-83ba-3c5a786694f4 while it is in vm_state shelved_offloaded Sep 14 09:07:56.670153 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': 'ae344b98-a354-4df8-83ba-3c5a786694f4', 'body': {'shelve': {}}} Sep 14 09:07:56.670153 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:07:56.670153 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:07:56.670153 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Sep 14 09:07:56.670153 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Sep 14 09:07:56.670153 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 14 09:07:56.670153 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 14 09:07:56.670153 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Sep 14 09:07:56.670153 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 14 09:07:56.670153 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 14 09:07:56.670153 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 14 09:07:56.670153 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 14 09:07:56.670153 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 14 09:07:56.670153 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 14 09:07:56.670153 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 14 09:07:56.670153 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ae344b98-a354-4df8-83ba-3c5a786694f4 in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Sep 14 09:07:56.670153 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:07:56.670153 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:07:56.670153 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:07:56.670153 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:07:56.670153 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:07:56.670153 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:07:56.670153 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:07:56.670153 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:07:56.670153 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:07:56.670153 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:07:56.670153 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Sep 14 09:07:56.670153 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 14 09:07:56.670153 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 14 09:07:56.674012 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 14 09:07:56.674012 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance ae344b98-a354-4df8-83ba-3c5a786694f4 while it is in vm_state shelved_offloaded Sep 14 09:07:56.674012 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:07:56.674012 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:07:56.674012 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:07:56.674012 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:07:56.674012 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:07:56.674012 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:07:56.674012 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:07:56.674012 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:07:56.674012 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance ae344b98-a354-4df8-83ba-3c5a786694f4 while it is in vm_state shelved_offloaded Sep 14 09:07:56.674012 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:07:56.674012 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-afb15070-df86-454d-8456-cda317c96ce7 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Returning 409 to user: Cannot 'shelve' instance ae344b98-a354-4df8-83ba-3c5a786694f4 while it is in vm_state shelved_offloaded {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:07:56.682174 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-afb15070-df86-454d-8456-cda317c96ce7 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "POST /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4/action" status: 409 len: 155 microversion: 2.1 time: 0.182116 Sep 14 09:07:56.689941 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2114/4224] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:07:56 2022] POST /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4/action => generated 155 bytes in 191 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 14 09:07:56.700335 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-93acb136-6d5b-43b3-8495-c846904be8f2 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:07:56.700941 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-93acb136-6d5b-43b3-8495-c846904be8f2 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:07:56.727697 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-93acb136-6d5b-43b3-8495-c846904be8f2 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:56.728201 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-93acb136-6d5b-43b3-8495-c846904be8f2 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:56.732594 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-93acb136-6d5b-43b3-8495-c846904be8f2 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:56.733393 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-93acb136-6d5b-43b3-8495-c846904be8f2 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:56.739375 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-93acb136-6d5b-43b3-8495-c846904be8f2 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:56.739927 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-93acb136-6d5b-43b3-8495-c846904be8f2 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:56.819889 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-93acb136-6d5b-43b3-8495-c846904be8f2 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128759) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 14 09:07:56.944274 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-6444c751-c37d-410c-973d-2bdfc3323e6b tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5165b8fc101c47c7a4370f9007bc5a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a597fc389b4805bbd3a53ecd17c5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:07:56.955210 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-93acb136-6d5b-43b3-8495-c846904be8f2 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "POST /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4/action" status: 202 len: 0 microversion: 2.1 time: 0.263699 Sep 14 09:07:56.956981 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-6444c751-c37d-410c-973d-2bdfc3323e6b tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute/v2.1/servers/f8ddffc4-a877-4f95-840c-ad8ef8021755" status: 200 len: 1487 microversion: 2.1 time: 0.654195 Sep 14 09:07:56.958373 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2115/4225] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:07:56 2022] POST /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4/action => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:07:56.963331 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2111/4226] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:07:56 2022] GET /compute/v2.1/servers/f8ddffc4-a877-4f95-840c-ad8ef8021755 => generated 1487 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:07:56.987554 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-50b0f155-65ba-4a7d-a1ac-80ee243ead9d tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:56.988218 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-50b0f155-65ba-4a7d-a1ac-80ee243ead9d tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:07:56.991499 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-894b66ba-b27e-4cbc-b9da-540669327036 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:07:56.992331 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-894b66ba-b27e-4cbc-b9da-540669327036 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] [instance: f8ddffc4-a877-4f95-840c-ad8ef8021755] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:07:57.003876 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-50b0f155-65ba-4a7d-a1ac-80ee243ead9d tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:57.004392 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-50b0f155-65ba-4a7d-a1ac-80ee243ead9d tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:57.007024 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-894b66ba-b27e-4cbc-b9da-540669327036 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:57.007616 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-50b0f155-65ba-4a7d-a1ac-80ee243ead9d tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:57.009498 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-894b66ba-b27e-4cbc-b9da-540669327036 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:57.010203 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-894b66ba-b27e-4cbc-b9da-540669327036 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:57.010580 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-50b0f155-65ba-4a7d-a1ac-80ee243ead9d tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:57.011176 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-50b0f155-65ba-4a7d-a1ac-80ee243ead9d tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:57.012819 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-50b0f155-65ba-4a7d-a1ac-80ee243ead9d tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:57.013998 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-894b66ba-b27e-4cbc-b9da-540669327036 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:57.015898 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-894b66ba-b27e-4cbc-b9da-540669327036 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:57.017874 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-894b66ba-b27e-4cbc-b9da-540669327036 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:57.142081 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.objects.instance [None req-894b66ba-b27e-4cbc-b9da-540669327036 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lazy-loading 'flavor' on Instance uuid f8ddffc4-a877-4f95-840c-ad8ef8021755 {{(pid=128758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:07:57.433537 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-894b66ba-b27e-4cbc-b9da-540669327036 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "POST /compute/v2.1/servers/f8ddffc4-a877-4f95-840c-ad8ef8021755/action" status: 202 len: 0 microversion: 2.1 time: 0.438358 Sep 14 09:07:57.435684 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2112/4227] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:07:56 2022] POST /compute/v2.1/servers/f8ddffc4-a877-4f95-840c-ad8ef8021755/action => generated 0 bytes in 450 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 14 09:07:57.447172 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-9bf09e27-90db-4e86-b847-0ef754b544f6 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:57.453004 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-9bf09e27-90db-4e86-b847-0ef754b544f6 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] [instance: d5d94249-deeb-4715-bd69-ba27597f46ef] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:07:57.464934 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9bf09e27-90db-4e86-b847-0ef754b544f6 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:57.465840 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9bf09e27-90db-4e86-b847-0ef754b544f6 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:57.466488 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9bf09e27-90db-4e86-b847-0ef754b544f6 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:57.467484 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9bf09e27-90db-4e86-b847-0ef754b544f6 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:57.468170 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9bf09e27-90db-4e86-b847-0ef754b544f6 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:57.468802 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9bf09e27-90db-4e86-b847-0ef754b544f6 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:57.972493 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-9bf09e27-90db-4e86-b847-0ef754b544f6 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6eab0235b041d4b1d2ffe2fae8bdd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f279926ee014c148690608fe635e3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:07:57.985748 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-9bf09e27-90db-4e86-b847-0ef754b544f6 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d6eab0235b041d4b1d2ffe2fae8bdd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f279926ee014c148690608fe635e3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:07:57.988473 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-9bf09e27-90db-4e86-b847-0ef754b544f6 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d6eab0235b041d4b1d2ffe2fae8bdd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f279926ee014c148690608fe635e3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:07:57.990797 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-9bf09e27-90db-4e86-b847-0ef754b544f6 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] 10.222.0.60 "GET /compute/v2.1/servers/d5d94249-deeb-4715-bd69-ba27597f46ef" status: 200 len: 1362 microversion: 2.26 time: 0.553759 Sep 14 09:07:57.995438 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2113/4228] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:07:57 2022] GET /compute/v2.1/servers/d5d94249-deeb-4715-bd69-ba27597f46ef => generated 1362 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:07:58.000469 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-81bf3552-5d97-431f-bad1-97a3296e674d tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:58.003864 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-50b0f155-65ba-4a7d-a1ac-80ee243ead9d tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:07:58.013358 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-50b0f155-65ba-4a7d-a1ac-80ee243ead9d tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1461 microversion: 2.1 time: 1.050903 Sep 14 09:07:58.015380 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2116/4229] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:07:56 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1461 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:07:58.016450 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-81bf3552-5d97-431f-bad1-97a3296e674d tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] [instance: f8ddffc4-a877-4f95-840c-ad8ef8021755] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:07:58.022905 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-81bf3552-5d97-431f-bad1-97a3296e674d tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:58.023646 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-81bf3552-5d97-431f-bad1-97a3296e674d tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:58.024268 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-81bf3552-5d97-431f-bad1-97a3296e674d tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:58.025189 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-81bf3552-5d97-431f-bad1-97a3296e674d tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:58.025830 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-81bf3552-5d97-431f-bad1-97a3296e674d tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:58.026437 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-81bf3552-5d97-431f-bad1-97a3296e674d tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:58.357089 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-81bf3552-5d97-431f-bad1-97a3296e674d tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5165b8fc101c47c7a4370f9007bc5a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a597fc389b4805bbd3a53ecd17c5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:07:58.373108 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-81bf3552-5d97-431f-bad1-97a3296e674d tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute/v2.1/servers/f8ddffc4-a877-4f95-840c-ad8ef8021755" status: 200 len: 1495 microversion: 2.1 time: 0.376236 Sep 14 09:07:58.380926 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2114/4230] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:07:57 2022] GET /compute/v2.1/servers/f8ddffc4-a877-4f95-840c-ad8ef8021755 => generated 1495 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:07:59.024606 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f0f47b9b-5033-4286-8d1d-8fe6f9b13391 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:59.025285 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f0f47b9b-5033-4286-8d1d-8fe6f9b13391 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] [instance: d5d94249-deeb-4715-bd69-ba27597f46ef] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:07:59.042776 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-75c1e865-9e25-4719-ac3a-cfbde7b84dba tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:59.043444 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-75c1e865-9e25-4719-ac3a-cfbde7b84dba tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:07:59.057920 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f0f47b9b-5033-4286-8d1d-8fe6f9b13391 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:59.066714 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f0f47b9b-5033-4286-8d1d-8fe6f9b13391 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:59.067349 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f0f47b9b-5033-4286-8d1d-8fe6f9b13391 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:59.068100 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f0f47b9b-5033-4286-8d1d-8fe6f9b13391 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:59.070924 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-75c1e865-9e25-4719-ac3a-cfbde7b84dba tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:59.071742 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-75c1e865-9e25-4719-ac3a-cfbde7b84dba tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:59.075408 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-75c1e865-9e25-4719-ac3a-cfbde7b84dba tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:59.075650 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f0f47b9b-5033-4286-8d1d-8fe6f9b13391 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:59.076256 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f0f47b9b-5033-4286-8d1d-8fe6f9b13391 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:59.082663 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-75c1e865-9e25-4719-ac3a-cfbde7b84dba tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:07:59.084874 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-75c1e865-9e25-4719-ac3a-cfbde7b84dba tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:07:59.085832 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-75c1e865-9e25-4719-ac3a-cfbde7b84dba tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:07:59.116177 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:07:59.485275 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=2 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:08:00.250715 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=8 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:08:00.326766 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f0f47b9b-5033-4286-8d1d-8fe6f9b13391 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6eab0235b041d4b1d2ffe2fae8bdd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f279926ee014c148690608fe635e3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:08:00.348628 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f0f47b9b-5033-4286-8d1d-8fe6f9b13391 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d6eab0235b041d4b1d2ffe2fae8bdd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f279926ee014c148690608fe635e3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:08:00.355446 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f0f47b9b-5033-4286-8d1d-8fe6f9b13391 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d6eab0235b041d4b1d2ffe2fae8bdd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f279926ee014c148690608fe635e3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:08:00.358367 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f0f47b9b-5033-4286-8d1d-8fe6f9b13391 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] 10.222.0.60 "GET /compute/v2.1/servers/d5d94249-deeb-4715-bd69-ba27597f46ef" status: 200 len: 1362 microversion: 2.26 time: 1.337134 Sep 14 09:08:00.360816 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2117/4231] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:07:59 2022] GET /compute/v2.1/servers/d5d94249-deeb-4715-bd69-ba27597f46ef => generated 1362 bytes in 1340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:08:00.365793 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-75c1e865-9e25-4719-ac3a-cfbde7b84dba tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:08:00.374000 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-75c1e865-9e25-4719-ac3a-cfbde7b84dba tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1461 microversion: 2.1 time: 1.335357 Sep 14 09:08:00.374594 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2115/4232] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:07:59 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1461 bytes in 1337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:08:00.377999 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f60cae83-46a1-4e0c-9e31-ae40fe9f33b3 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:08:00.380341 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f60cae83-46a1-4e0c-9e31-ae40fe9f33b3 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] [instance: f8ddffc4-a877-4f95-840c-ad8ef8021755] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:08:00.396818 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f60cae83-46a1-4e0c-9e31-ae40fe9f33b3 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:00.397433 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f60cae83-46a1-4e0c-9e31-ae40fe9f33b3 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:00.399628 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f60cae83-46a1-4e0c-9e31-ae40fe9f33b3 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:00.405145 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f60cae83-46a1-4e0c-9e31-ae40fe9f33b3 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:00.405783 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f60cae83-46a1-4e0c-9e31-ae40fe9f33b3 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:00.406350 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f60cae83-46a1-4e0c-9e31-ae40fe9f33b3 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:00.412063 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-30831381-5699-4574-9c66-164c9966494d req-7dbd244f-836e-484b-a504-23aacb404b37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5d94249-deeb-4715-bd69-ba27597f46ef", "tag": "527c575e-0a9d-43b1-ac5b-0e42a92d6ead"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:08:00.452214 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-30831381-5699-4574-9c66-164c9966494d req-7dbd244f-836e-484b-a504-23aacb404b37 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:00.461230 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-30831381-5699-4574-9c66-164c9966494d req-7dbd244f-836e-484b-a504-23aacb404b37 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:00.463253 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-30831381-5699-4574-9c66-164c9966494d req-7dbd244f-836e-484b-a504-23aacb404b37 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:00.543636 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-30831381-5699-4574-9c66-164c9966494d req-7dbd244f-836e-484b-a504-23aacb404b37 service nova] Creating event network-changed:527c575e-0a9d-43b1-ac5b-0e42a92d6ead for instance d5d94249-deeb-4715-bd69-ba27597f46ef on n-h2-836830-18 Sep 14 09:08:00.571119 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-30831381-5699-4574-9c66-164c9966494d req-7dbd244f-836e-484b-a504-23aacb404b37 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.193316 Sep 14 09:08:00.578100 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2116/4233] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:08:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:08:00.891382 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f60cae83-46a1-4e0c-9e31-ae40fe9f33b3 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5165b8fc101c47c7a4370f9007bc5a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a597fc389b4805bbd3a53ecd17c5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:08:00.901485 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:08:00.909198 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f60cae83-46a1-4e0c-9e31-ae40fe9f33b3 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute/v2.1/servers/f8ddffc4-a877-4f95-840c-ad8ef8021755" status: 200 len: 1478 microversion: 2.1 time: 0.546192 Sep 14 09:08:00.911097 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2118/4234] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:08:00 2022] GET /compute/v2.1/servers/f8ddffc4-a877-4f95-840c-ad8ef8021755 => generated 1478 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:08:00.936516 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-e698fa34-875c-4dca-8f06-475353b1a2a5 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1343549298"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:08:00.939311 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-e698fa34-875c-4dca-8f06-475353b1a2a5 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] [instance: f8ddffc4-a877-4f95-840c-ad8ef8021755] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:08:00.947088 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e698fa34-875c-4dca-8f06-475353b1a2a5 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:00.947760 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e698fa34-875c-4dca-8f06-475353b1a2a5 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:00.948414 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e698fa34-875c-4dca-8f06-475353b1a2a5 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:00.949277 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e698fa34-875c-4dca-8f06-475353b1a2a5 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:00.950006 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e698fa34-875c-4dca-8f06-475353b1a2a5 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:00.950680 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e698fa34-875c-4dca-8f06-475353b1a2a5 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:01.343229 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-e698fa34-875c-4dca-8f06-475353b1a2a5 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "POST /compute/v2.1/servers/f8ddffc4-a877-4f95-840c-ad8ef8021755/action" status: 202 len: 0 microversion: 2.1 time: 0.410642 Sep 14 09:08:01.344845 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2117/4235] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:08:00 2022] POST /compute/v2.1/servers/f8ddffc4-a877-4f95-840c-ad8ef8021755/action => generated 0 bytes in 413 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 14 09:08:01.357043 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-15ea416b-3791-4dc6-bfd5-ae28e0b4a63e tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '.version_select at 0x7f7d3ef71c10>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:08:01.391100 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-45356f8b-9f2c-41a4-a9ac-14103ee0c5c9 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:08:01.392639 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-45356f8b-9f2c-41a4-a9ac-14103ee0c5c9 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] [instance: d5d94249-deeb-4715-bd69-ba27597f46ef] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:08:01.408800 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-45356f8b-9f2c-41a4-a9ac-14103ee0c5c9 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:01.410437 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-45356f8b-9f2c-41a4-a9ac-14103ee0c5c9 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:01.411622 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-45356f8b-9f2c-41a4-a9ac-14103ee0c5c9 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:01.412555 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-45356f8b-9f2c-41a4-a9ac-14103ee0c5c9 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:01.414279 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-45356f8b-9f2c-41a4-a9ac-14103ee0c5c9 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:01.417126 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-45356f8b-9f2c-41a4-a9ac-14103ee0c5c9 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:01.459574 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-15ea416b-3791-4dc6-bfd5-ae28e0b4a63e tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute/v2.1/images/b6fa7f64-f6a6-4a4f-bea4-43535ee682c5" status: 200 len: 1440 microversion: 2.1 time: 0.107259 Sep 14 09:08:01.469313 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2119/4236] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:08:01 2022] GET /compute/v2.1/images/b6fa7f64-f6a6-4a4f-bea4-43535ee682c5 => generated 1440 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:08:01.475307 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-2ecad521-144f-4358-8473-93b9d55e61ca tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:08:01.475988 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-2ecad521-144f-4358-8473-93b9d55e61ca tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:08:01.484688 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2ecad521-144f-4358-8473-93b9d55e61ca tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:01.485460 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2ecad521-144f-4358-8473-93b9d55e61ca tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:01.486060 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2ecad521-144f-4358-8473-93b9d55e61ca tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:01.486926 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2ecad521-144f-4358-8473-93b9d55e61ca tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:01.487615 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2ecad521-144f-4358-8473-93b9d55e61ca tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:01.488197 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2ecad521-144f-4358-8473-93b9d55e61ca tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:01.822123 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-45356f8b-9f2c-41a4-a9ac-14103ee0c5c9 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6eab0235b041d4b1d2ffe2fae8bdd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f279926ee014c148690608fe635e3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:08:01.830932 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-2ecad521-144f-4358-8473-93b9d55e61ca tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:08:01.852031 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-45356f8b-9f2c-41a4-a9ac-14103ee0c5c9 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d6eab0235b041d4b1d2ffe2fae8bdd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f279926ee014c148690608fe635e3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:08:01.853988 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-45356f8b-9f2c-41a4-a9ac-14103ee0c5c9 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d6eab0235b041d4b1d2ffe2fae8bdd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f279926ee014c148690608fe635e3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:08:01.855456 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-45356f8b-9f2c-41a4-a9ac-14103ee0c5c9 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] 10.222.0.60 "GET /compute/v2.1/servers/d5d94249-deeb-4715-bd69-ba27597f46ef" status: 200 len: 1362 microversion: 2.26 time: 0.468936 Sep 14 09:08:01.863077 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2118/4237] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:08:01 2022] GET /compute/v2.1/servers/d5d94249-deeb-4715-bd69-ba27597f46ef => generated 1362 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:08:01.874711 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-2ecad521-144f-4358-8473-93b9d55e61ca tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1519 microversion: 2.1 time: 0.396183 Sep 14 09:08:01.875530 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2120/4238] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:08:01 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1519 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:08:02.477352 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-334d5059-c8c7-4420-89f5-6d3e84e1cc8a tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '.version_select at 0x7f7d3f4ad160>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:08:02.562676 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-334d5059-c8c7-4420-89f5-6d3e84e1cc8a tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute/v2.1/images/b6fa7f64-f6a6-4a4f-bea4-43535ee682c5" status: 200 len: 1440 microversion: 2.1 time: 0.089250 Sep 14 09:08:02.571925 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2119/4239] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:08:02 2022] GET /compute/v2.1/images/b6fa7f64-f6a6-4a4f-bea4-43535ee682c5 => generated 1440 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:08:02.884849 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-759f808a-762f-44cb-bd60-f7f7d47b1403 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:08:02.885508 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-759f808a-762f-44cb-bd60-f7f7d47b1403 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] [instance: d5d94249-deeb-4715-bd69-ba27597f46ef] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:08:02.902475 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a3cfff56-9fb8-4820-b3a3-cca71a47c3ab tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:08:02.903295 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-a3cfff56-9fb8-4820-b3a3-cca71a47c3ab tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:08:02.924820 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-759f808a-762f-44cb-bd60-f7f7d47b1403 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:02.925339 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-759f808a-762f-44cb-bd60-f7f7d47b1403 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:02.928073 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a3cfff56-9fb8-4820-b3a3-cca71a47c3ab tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:02.929365 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-759f808a-762f-44cb-bd60-f7f7d47b1403 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:02.930181 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-759f808a-762f-44cb-bd60-f7f7d47b1403 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:02.930655 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-759f808a-762f-44cb-bd60-f7f7d47b1403 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:02.931292 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a3cfff56-9fb8-4820-b3a3-cca71a47c3ab tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:02.931828 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a3cfff56-9fb8-4820-b3a3-cca71a47c3ab tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:02.932914 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a3cfff56-9fb8-4820-b3a3-cca71a47c3ab tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:02.933914 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-759f808a-762f-44cb-bd60-f7f7d47b1403 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:02.935722 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a3cfff56-9fb8-4820-b3a3-cca71a47c3ab tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:02.937765 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a3cfff56-9fb8-4820-b3a3-cca71a47c3ab tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:03.320308 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-a3cfff56-9fb8-4820-b3a3-cca71a47c3ab tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:08:03.336480 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-a3cfff56-9fb8-4820-b3a3-cca71a47c3ab tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1519 microversion: 2.1 time: 0.439287 Sep 14 09:08:03.337084 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2120/4240] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:08:02 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1519 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:08:03.390824 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-759f808a-762f-44cb-bd60-f7f7d47b1403 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6eab0235b041d4b1d2ffe2fae8bdd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f279926ee014c148690608fe635e3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:08:03.406449 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-759f808a-762f-44cb-bd60-f7f7d47b1403 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d6eab0235b041d4b1d2ffe2fae8bdd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f279926ee014c148690608fe635e3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:08:03.407869 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-759f808a-762f-44cb-bd60-f7f7d47b1403 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d6eab0235b041d4b1d2ffe2fae8bdd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f279926ee014c148690608fe635e3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:08:03.409035 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-759f808a-762f-44cb-bd60-f7f7d47b1403 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] 10.222.0.60 "GET /compute/v2.1/servers/d5d94249-deeb-4715-bd69-ba27597f46ef" status: 200 len: 1362 microversion: 2.26 time: 0.531341 Sep 14 09:08:03.422359 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2121/4241] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:08:02 2022] GET /compute/v2.1/servers/d5d94249-deeb-4715-bd69-ba27597f46ef => generated 1362 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:08:03.584837 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-97340117-65f1-40c7-bfe0-278784c9686b tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '.version_select at 0x7f7d44027f70>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:08:03.652566 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-97340117-65f1-40c7-bfe0-278784c9686b tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute/v2.1/images/b6fa7f64-f6a6-4a4f-bea4-43535ee682c5" status: 200 len: 1440 microversion: 2.1 time: 0.071791 Sep 14 09:08:03.654062 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2121/4242] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:08:03 2022] GET /compute/v2.1/images/b6fa7f64-f6a6-4a4f-bea4-43535ee682c5 => generated 1440 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:08:04.361929 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-aa36021c-4e85-4e98-a2ef-94c7f0cdda29 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:08:04.363221 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-aa36021c-4e85-4e98-a2ef-94c7f0cdda29 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:08:04.377532 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-aa36021c-4e85-4e98-a2ef-94c7f0cdda29 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:04.380857 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-aa36021c-4e85-4e98-a2ef-94c7f0cdda29 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:04.382006 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-aa36021c-4e85-4e98-a2ef-94c7f0cdda29 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:04.386313 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-aa36021c-4e85-4e98-a2ef-94c7f0cdda29 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:04.387096 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-aa36021c-4e85-4e98-a2ef-94c7f0cdda29 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:04.387806 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-aa36021c-4e85-4e98-a2ef-94c7f0cdda29 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:04.440378 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-fab875f0-de03-444d-8e55-5ea2e975f42e tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:08:04.441467 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-fab875f0-de03-444d-8e55-5ea2e975f42e tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] [instance: d5d94249-deeb-4715-bd69-ba27597f46ef] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:08:04.445267 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=3 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:08:04.458620 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fab875f0-de03-444d-8e55-5ea2e975f42e tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:04.462263 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fab875f0-de03-444d-8e55-5ea2e975f42e tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:04.463787 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fab875f0-de03-444d-8e55-5ea2e975f42e tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:04.464862 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fab875f0-de03-444d-8e55-5ea2e975f42e tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:04.466753 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fab875f0-de03-444d-8e55-5ea2e975f42e tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:04.467402 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fab875f0-de03-444d-8e55-5ea2e975f42e tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:05.169103 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-fab875f0-de03-444d-8e55-5ea2e975f42e tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6eab0235b041d4b1d2ffe2fae8bdd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f279926ee014c148690608fe635e3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:08:05.184896 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-fab875f0-de03-444d-8e55-5ea2e975f42e tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d6eab0235b041d4b1d2ffe2fae8bdd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f279926ee014c148690608fe635e3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:08:05.193001 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-fab875f0-de03-444d-8e55-5ea2e975f42e tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d6eab0235b041d4b1d2ffe2fae8bdd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f279926ee014c148690608fe635e3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:08:05.196234 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-fab875f0-de03-444d-8e55-5ea2e975f42e tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] 10.222.0.60 "GET /compute/v2.1/servers/d5d94249-deeb-4715-bd69-ba27597f46ef" status: 200 len: 1362 microversion: 2.26 time: 0.762814 Sep 14 09:08:05.227004 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2122/4243] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:08:04 2022] GET /compute/v2.1/servers/d5d94249-deeb-4715-bd69-ba27597f46ef => generated 1362 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 09:08:05.237434 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-48fab74a-87c3-4ba1-97c3-0db31f28e50b tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '.version_select at 0x7f7d3f4f8940>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:08:05.273770 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-aa36021c-4e85-4e98-a2ef-94c7f0cdda29 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:08:05.289978 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-aa36021c-4e85-4e98-a2ef-94c7f0cdda29 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1519 microversion: 2.1 time: 0.928134 Sep 14 09:08:05.302965 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2122/4244] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:08:04 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1519 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:08:06.239510 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-653d2946-26ae-4e17-bd9e-e5fac401580e tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:08:06.240414 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-653d2946-26ae-4e17-bd9e-e5fac401580e tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] [instance: d5d94249-deeb-4715-bd69-ba27597f46ef] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:08:06.303781 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-653d2946-26ae-4e17-bd9e-e5fac401580e tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:06.315564 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-653d2946-26ae-4e17-bd9e-e5fac401580e tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:06.316359 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-653d2946-26ae-4e17-bd9e-e5fac401580e tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:06.317664 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-653d2946-26ae-4e17-bd9e-e5fac401580e tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:06.318158 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-653d2946-26ae-4e17-bd9e-e5fac401580e tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:06.318590 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-653d2946-26ae-4e17-bd9e-e5fac401580e tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:06.827701 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-653d2946-26ae-4e17-bd9e-e5fac401580e tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6eab0235b041d4b1d2ffe2fae8bdd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f279926ee014c148690608fe635e3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:08:06.838701 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-653d2946-26ae-4e17-bd9e-e5fac401580e tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d6eab0235b041d4b1d2ffe2fae8bdd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f279926ee014c148690608fe635e3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:08:06.840237 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-653d2946-26ae-4e17-bd9e-e5fac401580e tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d6eab0235b041d4b1d2ffe2fae8bdd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f279926ee014c148690608fe635e3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:08:06.841534 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-653d2946-26ae-4e17-bd9e-e5fac401580e tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] 10.222.0.60 "GET /compute/v2.1/servers/d5d94249-deeb-4715-bd69-ba27597f46ef" status: 200 len: 1362 microversion: 2.26 time: 0.619712 Sep 14 09:08:06.842120 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2123/4245] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:08:06 2022] GET /compute/v2.1/servers/d5d94249-deeb-4715-bd69-ba27597f46ef => generated 1362 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 09:08:06.861116 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-85989e85-fbfa-477b-947d-d6431bca716a tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:08:06.864655 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-85989e85-fbfa-477b-947d-d6431bca716a tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:08:06.894734 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-85989e85-fbfa-477b-947d-d6431bca716a tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:06.896130 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-85989e85-fbfa-477b-947d-d6431bca716a tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:06.896758 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-85989e85-fbfa-477b-947d-d6431bca716a tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:06.897821 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-85989e85-fbfa-477b-947d-d6431bca716a tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:06.898471 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-85989e85-fbfa-477b-947d-d6431bca716a tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:06.899097 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-85989e85-fbfa-477b-947d-d6431bca716a tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:07.706791 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-85989e85-fbfa-477b-947d-d6431bca716a tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:08:07.724982 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-85989e85-fbfa-477b-947d-d6431bca716a tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1519 microversion: 2.1 time: 0.866987 Sep 14 09:08:07.727182 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2124/4246] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:08:06 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1519 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:08:07.752210 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-fbdd8cb9-90ed-4e31-9dad-5297e5d7c90e req-4f364e51-197d-4d43-88e5-dadb487a9f51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5d94249-deeb-4715-bd69-ba27597f46ef", "name": "network-vif-plugged", "status": "completed", "tag": "527c575e-0a9d-43b1-ac5b-0e42a92d6ead"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:08:07.781910 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-fbdd8cb9-90ed-4e31-9dad-5297e5d7c90e req-4f364e51-197d-4d43-88e5-dadb487a9f51 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:07.790418 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-fbdd8cb9-90ed-4e31-9dad-5297e5d7c90e req-4f364e51-197d-4d43-88e5-dadb487a9f51 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:07.790884 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-fbdd8cb9-90ed-4e31-9dad-5297e5d7c90e req-4f364e51-197d-4d43-88e5-dadb487a9f51 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:07.833174 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-fbdd8cb9-90ed-4e31-9dad-5297e5d7c90e req-4f364e51-197d-4d43-88e5-dadb487a9f51 service nova] Creating event network-vif-plugged:527c575e-0a9d-43b1-ac5b-0e42a92d6ead for instance d5d94249-deeb-4715-bd69-ba27597f46ef on n-h2-836830-18 Sep 14 09:08:07.874584 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-fbdd8cb9-90ed-4e31-9dad-5297e5d7c90e req-4f364e51-197d-4d43-88e5-dadb487a9f51 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131646 Sep 14 09:08:07.880526 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2125/4247] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:08:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:08:08.253029 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-83f21681-d7e4-415b-b265-5c8aabbd289f tempest-ExtensionsTest-451715885 tempest-ExtensionsTest-451715885-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:08:08.255541 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-83f21681-d7e4-415b-b265-5c8aabbd289f tempest-ExtensionsTest-451715885 tempest-ExtensionsTest-451715885-project] 10.222.0.60 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.371154 Sep 14 09:08:08.256285 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2126/4248] 10.222.0.60 () {58 vars in 1170 bytes} [Wed Sep 14 09:08:07 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:08:08.262837 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-25878fa3-290a-43e6-874f-3a900381dbf6 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:08:08.263604 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-25878fa3-290a-43e6-874f-3a900381dbf6 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] [instance: d5d94249-deeb-4715-bd69-ba27597f46ef] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:08:08.271717 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-25878fa3-290a-43e6-874f-3a900381dbf6 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:08.272445 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-25878fa3-290a-43e6-874f-3a900381dbf6 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:08.273105 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-25878fa3-290a-43e6-874f-3a900381dbf6 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:08.274364 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-25878fa3-290a-43e6-874f-3a900381dbf6 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:08.275500 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-25878fa3-290a-43e6-874f-3a900381dbf6 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:08.276126 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-25878fa3-290a-43e6-874f-3a900381dbf6 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:09.148281 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-48fab74a-87c3-4ba1-97c3-0db31f28e50b tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute/v2.1/images/b6fa7f64-f6a6-4a4f-bea4-43535ee682c5" status: 200 len: 1440 microversion: 2.1 time: 3.919701 Sep 14 09:08:09.150720 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2123/4249] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:08:05 2022] GET /compute/v2.1/images/b6fa7f64-f6a6-4a4f-bea4-43535ee682c5 => generated 1440 bytes in 3923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:08:09.168758 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-489852da-89f8-4c52-aa6d-f2c9f277cabb tempest-ExtensionsTest-451715885 tempest-ExtensionsTest-451715885-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:08:09.171957 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-489852da-89f8-4c52-aa6d-f2c9f277cabb tempest-ExtensionsTest-451715885 tempest-ExtensionsTest-451715885-project] 10.222.0.60 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.019068 Sep 14 09:08:09.172770 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2124/4250] 10.222.0.60 () {58 vars in 1134 bytes} [Wed Sep 14 09:08:09 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 09:08:09.179687 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-8160fb30-bf1d-491d-920e-3a16e0b1d0cb tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:08:09.180579 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-8160fb30-bf1d-491d-920e-3a16e0b1d0cb tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:08:09.193370 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8160fb30-bf1d-491d-920e-3a16e0b1d0cb tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:09.194548 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8160fb30-bf1d-491d-920e-3a16e0b1d0cb tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:09.195318 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8160fb30-bf1d-491d-920e-3a16e0b1d0cb tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:09.197206 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8160fb30-bf1d-491d-920e-3a16e0b1d0cb tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:09.198487 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8160fb30-bf1d-491d-920e-3a16e0b1d0cb tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:09.199340 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8160fb30-bf1d-491d-920e-3a16e0b1d0cb tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:09.226384 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-25878fa3-290a-43e6-874f-3a900381dbf6 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6eab0235b041d4b1d2ffe2fae8bdd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f279926ee014c148690608fe635e3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:08:09.248728 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-25878fa3-290a-43e6-874f-3a900381dbf6 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d6eab0235b041d4b1d2ffe2fae8bdd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f279926ee014c148690608fe635e3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:08:09.250590 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-25878fa3-290a-43e6-874f-3a900381dbf6 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d6eab0235b041d4b1d2ffe2fae8bdd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f279926ee014c148690608fe635e3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:08:09.269036 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-25878fa3-290a-43e6-874f-3a900381dbf6 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] 10.222.0.60 "GET /compute/v2.1/servers/d5d94249-deeb-4715-bd69-ba27597f46ef" status: 200 len: 1362 microversion: 2.26 time: 1.011375 Sep 14 09:08:09.275546 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2127/4251] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:08:08 2022] GET /compute/v2.1/servers/d5d94249-deeb-4715-bd69-ba27597f46ef => generated 1362 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:08:09.300558 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e43acb3e-e2ac-47c3-b902-e49cd8fa5d65 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:08:09.301429 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e43acb3e-e2ac-47c3-b902-e49cd8fa5d65 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:08:09.336972 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e43acb3e-e2ac-47c3-b902-e49cd8fa5d65 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:09.337753 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e43acb3e-e2ac-47c3-b902-e49cd8fa5d65 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:09.340286 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e43acb3e-e2ac-47c3-b902-e49cd8fa5d65 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:09.342253 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e43acb3e-e2ac-47c3-b902-e49cd8fa5d65 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:09.345009 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e43acb3e-e2ac-47c3-b902-e49cd8fa5d65 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:09.348898 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e43acb3e-e2ac-47c3-b902-e49cd8fa5d65 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:09.737302 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-e43acb3e-e2ac-47c3-b902-e49cd8fa5d65 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:08:09.746871 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e43acb3e-e2ac-47c3-b902-e49cd8fa5d65 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105" status: 200 len: 1681 microversion: 2.1 time: 0.469159 Sep 14 09:08:09.769799 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2128/4252] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:08:09 2022] GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105 => generated 1681 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:08:09.876909 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-8160fb30-bf1d-491d-920e-3a16e0b1d0cb tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:08:09.905682 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-8160fb30-bf1d-491d-920e-3a16e0b1d0cb tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1519 microversion: 2.1 time: 0.724807 Sep 14 09:08:09.906620 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2125/4253] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:08:09 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1519 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:08:10.069356 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-898a68e8-296d-4ada-ac0c-78833e35476a req-a13ee009-faf7-4487-bbbc-f95a06a90ec4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8ddffc4-a877-4f95-840c-ad8ef8021755", "name": "network-vif-plugged", "status": "completed", "tag": "42b91ece-9a73-43f2-ab71-9b62a3d0ff21"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:08:10.119402 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-898a68e8-296d-4ada-ac0c-78833e35476a req-a13ee009-faf7-4487-bbbc-f95a06a90ec4 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:10.124892 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-898a68e8-296d-4ada-ac0c-78833e35476a req-a13ee009-faf7-4487-bbbc-f95a06a90ec4 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:10.125902 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-898a68e8-296d-4ada-ac0c-78833e35476a req-a13ee009-faf7-4487-bbbc-f95a06a90ec4 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:10.166374 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1feb3aba-589c-47da-8890-0d1c88cbd850 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '.version_select at 0x7f7d3f591ee0>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:08:10.182600 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-898a68e8-296d-4ada-ac0c-78833e35476a req-a13ee009-faf7-4487-bbbc-f95a06a90ec4 service nova] Creating event network-vif-plugged:42b91ece-9a73-43f2-ab71-9b62a3d0ff21 for instance f8ddffc4-a877-4f95-840c-ad8ef8021755 on n-h1-836830-18 Sep 14 09:08:10.206653 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-898a68e8-296d-4ada-ac0c-78833e35476a req-a13ee009-faf7-4487-bbbc-f95a06a90ec4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148547 Sep 14 09:08:10.212910 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2129/4254] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:08:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:08:10.308291 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-bdd676f0-09f9-4c75-8876-abb0c1eecaed tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:08:10.309920 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-bdd676f0-09f9-4c75-8876-abb0c1eecaed tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] [instance: d5d94249-deeb-4715-bd69-ba27597f46ef] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:08:10.321239 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bdd676f0-09f9-4c75-8876-abb0c1eecaed tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:10.321951 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bdd676f0-09f9-4c75-8876-abb0c1eecaed tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:10.323502 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bdd676f0-09f9-4c75-8876-abb0c1eecaed tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:10.327007 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bdd676f0-09f9-4c75-8876-abb0c1eecaed tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:10.327763 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bdd676f0-09f9-4c75-8876-abb0c1eecaed tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:10.328416 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bdd676f0-09f9-4c75-8876-abb0c1eecaed tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:10.813650 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-bdd676f0-09f9-4c75-8876-abb0c1eecaed tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6eab0235b041d4b1d2ffe2fae8bdd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f279926ee014c148690608fe635e3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:08:10.828076 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-bdd676f0-09f9-4c75-8876-abb0c1eecaed tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d6eab0235b041d4b1d2ffe2fae8bdd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f279926ee014c148690608fe635e3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:08:10.832995 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-bdd676f0-09f9-4c75-8876-abb0c1eecaed tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d6eab0235b041d4b1d2ffe2fae8bdd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f279926ee014c148690608fe635e3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:08:10.837317 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-bdd676f0-09f9-4c75-8876-abb0c1eecaed tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] 10.222.0.60 "GET /compute/v2.1/servers/d5d94249-deeb-4715-bd69-ba27597f46ef" status: 200 len: 1545 microversion: 2.26 time: 0.533350 Sep 14 09:08:10.841269 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2130/4255] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:08:10 2022] GET /compute/v2.1/servers/d5d94249-deeb-4715-bd69-ba27597f46ef => generated 1545 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 09:08:10.859290 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-32a7a96d-f871-4e6d-8fb6-2af361c4c723 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:08:10.860224 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-32a7a96d-f871-4e6d-8fb6-2af361c4c723 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:08:10.872451 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-32a7a96d-f871-4e6d-8fb6-2af361c4c723 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:10.873962 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-32a7a96d-f871-4e6d-8fb6-2af361c4c723 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:10.874689 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-32a7a96d-f871-4e6d-8fb6-2af361c4c723 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:10.875925 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-32a7a96d-f871-4e6d-8fb6-2af361c4c723 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:10.876647 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-32a7a96d-f871-4e6d-8fb6-2af361c4c723 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:10.877330 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-32a7a96d-f871-4e6d-8fb6-2af361c4c723 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:11.966375 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-32a7a96d-f871-4e6d-8fb6-2af361c4c723 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:08:11.978718 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-32a7a96d-f871-4e6d-8fb6-2af361c4c723 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105" status: 200 len: 1668 microversion: 2.1 time: 1.135831 Sep 14 09:08:11.979573 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2131/4256] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:08:10 2022] GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105 => generated 1668 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:08:12.009244 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-2f309734-7fa4-4624-8c71-5e271cf3eec6 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Calling method '.version_select at 0x7f7d3ef02160>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:08:12.039948 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2f309734-7fa4-4624-8c71-5e271cf3eec6 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:12.040628 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2f309734-7fa4-4624-8c71-5e271cf3eec6 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:12.041238 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2f309734-7fa4-4624-8c71-5e271cf3eec6 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:12.041941 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-2f309734-7fa4-4624-8c71-5e271cf3eec6 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] [instance: d5d94249-deeb-4715-bd69-ba27597f46ef] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:08:12.061463 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2f309734-7fa4-4624-8c71-5e271cf3eec6 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:12.065393 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2f309734-7fa4-4624-8c71-5e271cf3eec6 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:12.065979 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2f309734-7fa4-4624-8c71-5e271cf3eec6 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:12.067141 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2f309734-7fa4-4624-8c71-5e271cf3eec6 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:12.069601 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2f309734-7fa4-4624-8c71-5e271cf3eec6 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:12.072689 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2f309734-7fa4-4624-8c71-5e271cf3eec6 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:12.187949 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2f309734-7fa4-4624-8c71-5e271cf3eec6 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:12.188461 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2f309734-7fa4-4624-8c71-5e271cf3eec6 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:12.188914 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2f309734-7fa4-4624-8c71-5e271cf3eec6 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:12.280512 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2f309734-7fa4-4624-8c71-5e271cf3eec6 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:12.283597 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2f309734-7fa4-4624-8c71-5e271cf3eec6 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:12.286645 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2f309734-7fa4-4624-8c71-5e271cf3eec6 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:12.418705 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.objects.instance [None req-2f309734-7fa4-4624-8c71-5e271cf3eec6 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lazy-loading 'flavor' on Instance uuid d5d94249-deeb-4715-bd69-ba27597f46ef {{(pid=128759) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:08:12.460388 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-2f309734-7fa4-4624-8c71-5e271cf3eec6 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] 10.222.0.60 "PUT /compute/v2.1/servers/d5d94249-deeb-4715-bd69-ba27597f46ef/tags/tempest-tag-1583222642" status: 201 len: 0 microversion: 2.26 time: 0.457367 Sep 14 09:08:12.467831 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2132/4257] 10.222.0.60 () {62 vars in 1380 bytes} [Wed Sep 14 09:08:11 2022] PUT /compute/v2.1/servers/d5d94249-deeb-4715-bd69-ba27597f46ef/tags/tempest-tag-1583222642 => generated 0 bytes in 488 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Sep 14 09:08:12.477537 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-41b2d15a-d866-4f03-bca5-374690d70c1f tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:08:12.479009 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-41b2d15a-d866-4f03-bca5-374690d70c1f tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:08:12.498769 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-41b2d15a-d866-4f03-bca5-374690d70c1f tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:12.504711 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-41b2d15a-d866-4f03-bca5-374690d70c1f tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:12.506715 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-41b2d15a-d866-4f03-bca5-374690d70c1f tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:12.509647 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-41b2d15a-d866-4f03-bca5-374690d70c1f tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:12.511592 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-41b2d15a-d866-4f03-bca5-374690d70c1f tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:12.512467 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-41b2d15a-d866-4f03-bca5-374690d70c1f tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:13.743050 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-41b2d15a-d866-4f03-bca5-374690d70c1f tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:08:13.760014 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-41b2d15a-d866-4f03-bca5-374690d70c1f tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1519 microversion: 2.1 time: 1.290372 Sep 14 09:08:13.764201 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2133/4258] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:08:12 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1519 bytes in 1295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:08:13.782076 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9c389d3b-b6a6-4eab-a3a6-1c48cb0e22df tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-354574236"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:08:13.811996 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-9c389d3b-b6a6-4eab-a3a6-1c48cb0e22df tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:08:13.832039 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9c389d3b-b6a6-4eab-a3a6-1c48cb0e22df tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:13.833546 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9c389d3b-b6a6-4eab-a3a6-1c48cb0e22df tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:13.835236 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9c389d3b-b6a6-4eab-a3a6-1c48cb0e22df tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:13.836200 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9c389d3b-b6a6-4eab-a3a6-1c48cb0e22df tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:13.845394 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9c389d3b-b6a6-4eab-a3a6-1c48cb0e22df tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:13.847606 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9c389d3b-b6a6-4eab-a3a6-1c48cb0e22df tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:19.193622 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=3 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:08:19.883307 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:08:23.828793 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:08:23.947938 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=84,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=1,nova_cell1:RELEASE=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:08:25.697922 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-9c389d3b-b6a6-4eab-a3a6-1c48cb0e22df tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "POST /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105/action" status: 202 len: 0 microversion: 2.1 time: 11.931712 Sep 14 09:08:25.699795 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2134/4259] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:08:13 2022] POST /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105/action => generated 0 bytes in 11934 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Sep 14 09:08:25.706346 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-12dc418c-8bee-471d-bda5-b74b3721755a tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Calling method '.version_select at 0x7f7d3efc25e0>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:08:25.716975 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-12dc418c-8bee-471d-bda5-b74b3721755a tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:25.717356 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-12dc418c-8bee-471d-bda5-b74b3721755a tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:25.717784 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-12dc418c-8bee-471d-bda5-b74b3721755a tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:25.729619 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-12dc418c-8bee-471d-bda5-b74b3721755a tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] 10.222.0.60 "GET /compute/v2.1/servers/d5d94249-deeb-4715-bd69-ba27597f46ef/tags/tempest-tag-1583222642" status: 204 len: 0 microversion: 2.26 time: 0.028121 Sep 14 09:08:25.734275 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2135/4260] 10.222.0.60 () {60 vars in 1361 bytes} [Wed Sep 14 09:08:25 2022] GET /compute/v2.1/servers/d5d94249-deeb-4715-bd69-ba27597f46ef/tags/tempest-tag-1583222642 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 14 09:08:25.740144 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-1c572198-ae99-464d-8827-17586cae15d3 req-43655b2f-e917-410e-9dd3-a2d0c233850b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8450d385-d5d9-4c86-9ece-b3bbf9ed1105", "name": "network-vif-unplugged", "status": "completed", "tag": "eb873b1a-8b40-4eb4-a329-cf733d9ed342"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:08:25.751161 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-1c572198-ae99-464d-8827-17586cae15d3 req-43655b2f-e917-410e-9dd3-a2d0c233850b service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:25.751976 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-1c572198-ae99-464d-8827-17586cae15d3 req-43655b2f-e917-410e-9dd3-a2d0c233850b service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:25.752664 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-1c572198-ae99-464d-8827-17586cae15d3 req-43655b2f-e917-410e-9dd3-a2d0c233850b service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:25.757494 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-1feb3aba-589c-47da-8890-0d1c88cbd850 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute/v2.1/images/b6fa7f64-f6a6-4a4f-bea4-43535ee682c5" status: 200 len: 1449 microversion: 2.1 time: 15.594453 Sep 14 09:08:25.759230 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2126/4261] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:08:10 2022] GET /compute/v2.1/images/b6fa7f64-f6a6-4a4f-bea4-43535ee682c5 => generated 1449 bytes in 15597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:08:25.765345 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-1c572198-ae99-464d-8827-17586cae15d3 req-43655b2f-e917-410e-9dd3-a2d0c233850b service nova] Creating event network-vif-unplugged:eb873b1a-8b40-4eb4-a329-cf733d9ed342 for instance 8450d385-d5d9-4c86-9ece-b3bbf9ed1105 on n-h1-836830-18 Sep 14 09:08:25.765797 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-7c68836d-88f7-426f-afb2-a541c17eccf0 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:08:25.766583 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-7c68836d-88f7-426f-afb2-a541c17eccf0 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:08:25.772399 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-1c572198-ae99-464d-8827-17586cae15d3 req-43655b2f-e917-410e-9dd3-a2d0c233850b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036385 Sep 14 09:08:25.772495 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2136/4262] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:08:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:08:25.778522 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7c68836d-88f7-426f-afb2-a541c17eccf0 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:25.779440 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7c68836d-88f7-426f-afb2-a541c17eccf0 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:25.779891 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7c68836d-88f7-426f-afb2-a541c17eccf0 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:25.780732 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7c68836d-88f7-426f-afb2-a541c17eccf0 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:25.781200 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7c68836d-88f7-426f-afb2-a541c17eccf0 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:25.781625 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7c68836d-88f7-426f-afb2-a541c17eccf0 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:25.941098 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9aed6b18-0007-4c02-bd5b-8159dfba3fa3 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-208959909", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:08:25.948868 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-7c68836d-88f7-426f-afb2-a541c17eccf0 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:08:25.957754 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-7c68836d-88f7-426f-afb2-a541c17eccf0 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1519 microversion: 2.1 time: 0.196707 Sep 14 09:08:25.958330 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2127/4263] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:08:25 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1519 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:08:26.021585 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.network.neutron [None req-9aed6b18-0007-4c02-bd5b-8159dfba3fa3 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] validate_networks() for [('4bc21ab8-ade0-4350-93cd-03061c652d89', None, None, None, None, None)] {{(pid=128759) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:08:26.095319 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-56e10d3b-2a4f-47ea-b07c-53f212d52329 tempest-ComputeTenantNetworksTest-1746457914 tempest-ComputeTenantNetworksTest-1746457914-project] Calling method '.version_select at 0x7f7d487b91f0>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:08:26.273624 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-56e10d3b-2a4f-47ea-b07c-53f212d52329 tempest-ComputeTenantNetworksTest-1746457914 tempest-ComputeTenantNetworksTest-1746457914-project] 10.222.0.60 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 309 microversion: 2.1 time: 0.314049 Sep 14 09:08:26.274214 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2128/4264] 10.222.0.60 () {58 vars in 1158 bytes} [Wed Sep 14 09:08:25 2022] GET /compute/v2.1/os-tenant-networks => generated 309 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:08:26.279245 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-910b2e9c-a587-4d49-851a-7fbb3aca880c tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Calling method '.version_select at 0x7f7d3f591dc0>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:08:26.296113 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-910b2e9c-a587-4d49-851a-7fbb3aca880c tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:26.296993 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-910b2e9c-a587-4d49-851a-7fbb3aca880c tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:26.297546 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-910b2e9c-a587-4d49-851a-7fbb3aca880c tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:26.298298 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-910b2e9c-a587-4d49-851a-7fbb3aca880c tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] [instance: d5d94249-deeb-4715-bd69-ba27597f46ef] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:08:26.307510 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-910b2e9c-a587-4d49-851a-7fbb3aca880c tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:26.308090 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-910b2e9c-a587-4d49-851a-7fbb3aca880c tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:26.308851 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-910b2e9c-a587-4d49-851a-7fbb3aca880c tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:26.310221 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-910b2e9c-a587-4d49-851a-7fbb3aca880c tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:26.311302 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-910b2e9c-a587-4d49-851a-7fbb3aca880c tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:26.311935 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-910b2e9c-a587-4d49-851a-7fbb3aca880c tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:26.340685 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-910b2e9c-a587-4d49-851a-7fbb3aca880c tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:26.341242 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-910b2e9c-a587-4d49-851a-7fbb3aca880c tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:26.341868 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-910b2e9c-a587-4d49-851a-7fbb3aca880c tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:26.363297 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.objects.instance [None req-910b2e9c-a587-4d49-851a-7fbb3aca880c tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lazy-loading 'flavor' on Instance uuid d5d94249-deeb-4715-bd69-ba27597f46ef {{(pid=128758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:08:26.381995 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-910b2e9c-a587-4d49-851a-7fbb3aca880c tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] 10.222.0.60 "DELETE /compute/v2.1/servers/d5d94249-deeb-4715-bd69-ba27597f46ef/tags" status: 204 len: 0 microversion: 2.26 time: 0.106633 Sep 14 09:08:26.382686 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2129/4265] 10.222.0.60 () {60 vars in 1295 bytes} [Wed Sep 14 09:08:26 2022] DELETE /compute/v2.1/servers/d5d94249-deeb-4715-bd69-ba27597f46ef/tags => generated 0 bytes in 108 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 14 09:08:26.391665 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-780af484-2bd2-4cdd-b096-6a9f37d79978 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '.version_select at 0x7f7d487b95e0>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:08:26.438715 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-780af484-2bd2-4cdd-b096-6a9f37d79978 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute/v2.1/images/b6fa7f64-f6a6-4a4f-bea4-43535ee682c5" status: 200 len: 1449 microversion: 2.1 time: 0.054417 Sep 14 09:08:26.439555 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2130/4266] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:08:26 2022] GET /compute/v2.1/images/b6fa7f64-f6a6-4a4f-bea4-43535ee682c5 => generated 1449 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:08:26.446452 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-54290f0a-6760-4d29-92d0-c8aab2b67fa1 tempest-ComputeTenantNetworksTest-1746457914 tempest-ComputeTenantNetworksTest-1746457914-project] Calling method '.version_select at 0x7f7d3f48e4c0>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:08:26.591402 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-54290f0a-6760-4d29-92d0-c8aab2b67fa1 tempest-ComputeTenantNetworksTest-1746457914 tempest-ComputeTenantNetworksTest-1746457914-project] 10.222.0.60 "GET /compute/v2.1/os-tenant-networks/094eb0da-4f1b-40c0-81e9-3d636b627f80" status: 200 len: 140 microversion: 2.1 time: 0.150126 Sep 14 09:08:26.598457 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2131/4267] 10.222.0.60 () {58 vars in 1269 bytes} [Wed Sep 14 09:08:26 2022] GET /compute/v2.1/os-tenant-networks/094eb0da-4f1b-40c0-81e9-3d636b627f80 => generated 140 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:08:26.604668 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ee421fac-f3c9-4745-aec4-855968de626b tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Calling method '.version_select at 0x7f7d44346dc0>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:08:26.612869 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ee421fac-f3c9-4745-aec4-855968de626b tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:26.614303 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ee421fac-f3c9-4745-aec4-855968de626b tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:26.614988 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ee421fac-f3c9-4745-aec4-855968de626b tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:26.633654 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-9aed6b18-0007-4c02-bd5b-8159dfba3fa3 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Flavor limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:08:26.634085 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-9aed6b18-0007-4c02-bd5b-8159dfba3fa3 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Image limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:08:26.634563 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-9aed6b18-0007-4c02-bd5b-8159dfba3fa3 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Flavor pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:08:26.634998 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-9aed6b18-0007-4c02-bd5b-8159dfba3fa3 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Image pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:08:26.635644 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-9aed6b18-0007-4c02-bd5b-8159dfba3fa3 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:08:26.635774 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-ee421fac-f3c9-4745-aec4-855968de626b tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] 10.222.0.60 "GET /compute/v2.1/servers/d5d94249-deeb-4715-bd69-ba27597f46ef/tags" status: 200 len: 12 microversion: 2.26 time: 0.034951 Sep 14 09:08:26.639058 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2132/4268] 10.222.0.60 () {60 vars in 1292 bytes} [Wed Sep 14 09:08:26 2022] GET /compute/v2.1/servers/d5d94249-deeb-4715-bd69-ba27597f46ef/tags => generated 12 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:08:26.644003 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d86a015e-8cfb-4771-ae35-ba422d2651e2 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '.version_select at 0x7f7d3f4bbf70>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:08:26.645234 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9aed6b18-0007-4c02-bd5b-8159dfba3fa3 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:26.645756 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9aed6b18-0007-4c02-bd5b-8159dfba3fa3 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:26.646194 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9aed6b18-0007-4c02-bd5b-8159dfba3fa3 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:26.646922 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9aed6b18-0007-4c02-bd5b-8159dfba3fa3 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:26.647437 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9aed6b18-0007-4c02-bd5b-8159dfba3fa3 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:26.647866 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9aed6b18-0007-4c02-bd5b-8159dfba3fa3 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:26.668216 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-9aed6b18-0007-4c02-bd5b-8159dfba3fa3 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Getting quotas for project 44b713d80d5243659644e0c74c6df59c. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:08:26.674256 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-9aed6b18-0007-4c02-bd5b-8159dfba3fa3 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Getting quotas for user 932f3d4bbfd04cae8e48a937a5b10716 and project 44b713d80d5243659644e0c74c6df59c. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:08:26.688684 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-9aed6b18-0007-4c02-bd5b-8159dfba3fa3 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Going to run 1 instances... {{(pid=128759) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:08:26.691124 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-9aed6b18-0007-4c02-bd5b-8159dfba3fa3 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] [instance: 6957a5fb-4af4-4ca1-809a-8dd02e517c24] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128759) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:08:26.745895 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-9aed6b18-0007-4c02-bd5b-8159dfba3fa3 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.966914 Sep 14 09:08:26.746570 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2137/4269] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 09:08:25 2022] POST /compute/v2.1/servers => generated 383 bytes in 974 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:08:26.751547 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-6f95ec25-56a3-4515-8208-2466e10dfc9e tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Calling method '.version_select at 0x7f7d3ef2d310>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:08:26.764923 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6f95ec25-56a3-4515-8208-2466e10dfc9e tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:26.765553 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6f95ec25-56a3-4515-8208-2466e10dfc9e tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:26.766006 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6f95ec25-56a3-4515-8208-2466e10dfc9e tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:26.766494 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-6f95ec25-56a3-4515-8208-2466e10dfc9e tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] [instance: d5d94249-deeb-4715-bd69-ba27597f46ef] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:08:26.772727 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6f95ec25-56a3-4515-8208-2466e10dfc9e tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:26.773222 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6f95ec25-56a3-4515-8208-2466e10dfc9e tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:26.773723 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6f95ec25-56a3-4515-8208-2466e10dfc9e tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:26.774503 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6f95ec25-56a3-4515-8208-2466e10dfc9e tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:26.775038 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6f95ec25-56a3-4515-8208-2466e10dfc9e tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:26.775431 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6f95ec25-56a3-4515-8208-2466e10dfc9e tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:26.803892 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6f95ec25-56a3-4515-8208-2466e10dfc9e tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:26.804643 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6f95ec25-56a3-4515-8208-2466e10dfc9e tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:26.805395 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6f95ec25-56a3-4515-8208-2466e10dfc9e tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:26.817076 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6f95ec25-56a3-4515-8208-2466e10dfc9e tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:26.817783 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6f95ec25-56a3-4515-8208-2466e10dfc9e tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:26.818416 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6f95ec25-56a3-4515-8208-2466e10dfc9e tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:26.853066 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.objects.instance [None req-6f95ec25-56a3-4515-8208-2466e10dfc9e tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lazy-loading 'flavor' on Instance uuid d5d94249-deeb-4715-bd69-ba27597f46ef {{(pid=128759) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:08:26.884747 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-6f95ec25-56a3-4515-8208-2466e10dfc9e tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] 10.222.0.60 "PUT /compute/v2.1/servers/d5d94249-deeb-4715-bd69-ba27597f46ef/tags/tempest-tag-777445066" status: 201 len: 0 microversion: 2.26 time: 0.137048 Sep 14 09:08:26.885895 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2138/4270] 10.222.0.60 () {62 vars in 1377 bytes} [Wed Sep 14 09:08:26 2022] PUT /compute/v2.1/servers/d5d94249-deeb-4715-bd69-ba27597f46ef/tags/tempest-tag-777445066 => generated 0 bytes in 139 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Sep 14 09:08:26.891144 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b5181183-ccc3-4da5-ba15-c9be1bb58633 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:08:26.892042 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b5181183-ccc3-4da5-ba15-c9be1bb58633 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] [instance: 6957a5fb-4af4-4ca1-809a-8dd02e517c24] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:08:26.986658 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b5181183-ccc3-4da5-ba15-c9be1bb58633 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932f3d4bbfd04cae8e48a937a5b10716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b713d80d5243659644e0c74c6df59c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:08:26.998059 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b5181183-ccc3-4da5-ba15-c9be1bb58633 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] 10.222.0.60 "GET /compute/v2.1/servers/6957a5fb-4af4-4ca1-809a-8dd02e517c24" status: 200 len: 1222 microversion: 2.1 time: 0.110590 Sep 14 09:08:26.999285 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2139/4271] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:08:26 2022] GET /compute/v2.1/servers/6957a5fb-4af4-4ca1-809a-8dd02e517c24 => generated 1222 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:08:27.028019 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-233a7309-b6f8-4372-b7c4-e31c0a85208c tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Calling method '.version_select at 0x7f7d3ef2dca0>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:08:27.048215 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-233a7309-b6f8-4372-b7c4-e31c0a85208c tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:27.051392 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-233a7309-b6f8-4372-b7c4-e31c0a85208c tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:27.052556 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-233a7309-b6f8-4372-b7c4-e31c0a85208c tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:27.112515 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-233a7309-b6f8-4372-b7c4-e31c0a85208c tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] 10.222.0.60 "GET /compute/v2.1/servers/d5d94249-deeb-4715-bd69-ba27597f46ef/tags" status: 200 len: 35 microversion: 2.26 time: 0.098989 Sep 14 09:08:27.116415 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2140/4272] 10.222.0.60 () {60 vars in 1292 bytes} [Wed Sep 14 09:08:27 2022] GET /compute/v2.1/servers/d5d94249-deeb-4715-bd69-ba27597f46ef/tags => generated 35 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:08:27.134431 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8371bcc7-262e-46d1-b17f-116350914dd8 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:08:27.135107 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-8371bcc7-262e-46d1-b17f-116350914dd8 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:08:27.155695 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8371bcc7-262e-46d1-b17f-116350914dd8 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:27.156274 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8371bcc7-262e-46d1-b17f-116350914dd8 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:27.156679 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8371bcc7-262e-46d1-b17f-116350914dd8 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:27.157409 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8371bcc7-262e-46d1-b17f-116350914dd8 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:27.157869 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8371bcc7-262e-46d1-b17f-116350914dd8 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:27.158296 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8371bcc7-262e-46d1-b17f-116350914dd8 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:27.435885 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-8371bcc7-262e-46d1-b17f-116350914dd8 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:08:27.449223 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-8371bcc7-262e-46d1-b17f-116350914dd8 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1519 microversion: 2.1 time: 0.331559 Sep 14 09:08:27.452021 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2141/4273] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:08:27 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1519 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:08:27.468405 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d9c231a9-1115-495f-a09d-9237d6f804d1 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Calling method '.version_select at 0x7f7d3ef92b80>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:08:27.479814 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d9c231a9-1115-495f-a09d-9237d6f804d1 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:27.480877 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d9c231a9-1115-495f-a09d-9237d6f804d1 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:27.481509 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d9c231a9-1115-495f-a09d-9237d6f804d1 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:27.482237 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-d9c231a9-1115-495f-a09d-9237d6f804d1 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] [instance: d5d94249-deeb-4715-bd69-ba27597f46ef] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:08:27.492069 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d9c231a9-1115-495f-a09d-9237d6f804d1 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:27.493294 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d9c231a9-1115-495f-a09d-9237d6f804d1 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:27.494620 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d9c231a9-1115-495f-a09d-9237d6f804d1 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:27.495936 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d9c231a9-1115-495f-a09d-9237d6f804d1 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:27.505535 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d9c231a9-1115-495f-a09d-9237d6f804d1 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:27.506000 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d9c231a9-1115-495f-a09d-9237d6f804d1 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:27.586804 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d9c231a9-1115-495f-a09d-9237d6f804d1 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:27.590960 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d9c231a9-1115-495f-a09d-9237d6f804d1 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:27.592008 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d9c231a9-1115-495f-a09d-9237d6f804d1 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:27.646639 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.objects.instance [None req-d9c231a9-1115-495f-a09d-9237d6f804d1 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lazy-loading 'flavor' on Instance uuid d5d94249-deeb-4715-bd69-ba27597f46ef {{(pid=128759) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:08:27.648922 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-d86a015e-8cfb-4771-ae35-ba422d2651e2 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "DELETE /compute/v2.1/images/b6fa7f64-f6a6-4a4f-bea4-43535ee682c5" status: 204 len: 0 microversion: 2.1 time: 1.010678 Sep 14 09:08:27.649594 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2133/4274] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:08:26 2022] DELETE /compute/v2.1/images/b6fa7f64-f6a6-4a4f-bea4-43535ee682c5 => generated 0 bytes in 1012 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:08:27.657655 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d0c25a5f-0c93-41dc-bd7c-8dd23234e98e tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:08:27.658152 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-d0c25a5f-0c93-41dc-bd7c-8dd23234e98e tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] [instance: f8ddffc4-a877-4f95-840c-ad8ef8021755] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:08:27.668310 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d0c25a5f-0c93-41dc-bd7c-8dd23234e98e tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:27.668587 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d0c25a5f-0c93-41dc-bd7c-8dd23234e98e tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:27.669021 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d0c25a5f-0c93-41dc-bd7c-8dd23234e98e tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:27.672455 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d0c25a5f-0c93-41dc-bd7c-8dd23234e98e tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:27.674140 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d0c25a5f-0c93-41dc-bd7c-8dd23234e98e tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:27.675309 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d0c25a5f-0c93-41dc-bd7c-8dd23234e98e tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:27.681841 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d9c231a9-1115-495f-a09d-9237d6f804d1 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] 10.222.0.60 "DELETE /compute/v2.1/servers/d5d94249-deeb-4715-bd69-ba27597f46ef/tags/tempest-tag-777445066" status: 204 len: 0 microversion: 2.26 time: 0.222157 Sep 14 09:08:27.682918 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2142/4275] 10.222.0.60 () {60 vars in 1361 bytes} [Wed Sep 14 09:08:27 2022] DELETE /compute/v2.1/servers/d5d94249-deeb-4715-bd69-ba27597f46ef/tags/tempest-tag-777445066 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 14 09:08:27.693682 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-2cd598d0-c8a6-47a5-baee-265f34b74adc tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Calling method '.version_select at 0x7f7d3ef83550>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:08:27.710141 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2cd598d0-c8a6-47a5-baee-265f34b74adc tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:27.710637 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2cd598d0-c8a6-47a5-baee-265f34b74adc tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:27.711106 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2cd598d0-c8a6-47a5-baee-265f34b74adc tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:27.724290 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-2cd598d0-c8a6-47a5-baee-265f34b74adc tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] 10.222.0.60 "GET /compute/v2.1/servers/d5d94249-deeb-4715-bd69-ba27597f46ef/tags" status: 200 len: 12 microversion: 2.26 time: 0.035897 Sep 14 09:08:27.736146 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2143/4276] 10.222.0.60 () {60 vars in 1292 bytes} [Wed Sep 14 09:08:27 2022] GET /compute/v2.1/servers/d5d94249-deeb-4715-bd69-ba27597f46ef/tags => generated 12 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:08:27.740752 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-d0c25a5f-0c93-41dc-bd7c-8dd23234e98e tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] [instance: f8ddffc4-a877-4f95-840c-ad8ef8021755] Going to try to terminate instance {{(pid=128758) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:08:27.770204 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-5d331800-077c-4e2c-8dd2-9e8d56dcbb3d tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Calling method '.version_select at 0x7f7d3eebf5e0>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:08:27.790202 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5d331800-077c-4e2c-8dd2-9e8d56dcbb3d tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:27.790695 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5d331800-077c-4e2c-8dd2-9e8d56dcbb3d tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:27.791164 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5d331800-077c-4e2c-8dd2-9e8d56dcbb3d tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:27.794919 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-5d331800-077c-4e2c-8dd2-9e8d56dcbb3d tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] [instance: d5d94249-deeb-4715-bd69-ba27597f46ef] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:08:27.808522 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5d331800-077c-4e2c-8dd2-9e8d56dcbb3d tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:27.809024 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5d331800-077c-4e2c-8dd2-9e8d56dcbb3d tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:27.809469 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5d331800-077c-4e2c-8dd2-9e8d56dcbb3d tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:27.810185 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5d331800-077c-4e2c-8dd2-9e8d56dcbb3d tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:27.810637 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5d331800-077c-4e2c-8dd2-9e8d56dcbb3d tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:27.811092 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5d331800-077c-4e2c-8dd2-9e8d56dcbb3d tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:27.871902 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5d331800-077c-4e2c-8dd2-9e8d56dcbb3d tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:27.872393 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5d331800-077c-4e2c-8dd2-9e8d56dcbb3d tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:27.872841 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5d331800-077c-4e2c-8dd2-9e8d56dcbb3d tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:27.880425 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-d0c25a5f-0c93-41dc-bd7c-8dd23234e98e tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "DELETE /compute/v2.1/servers/f8ddffc4-a877-4f95-840c-ad8ef8021755" status: 204 len: 0 microversion: 2.1 time: 0.225973 Sep 14 09:08:27.883298 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2134/4277] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:08:27 2022] DELETE /compute/v2.1/servers/f8ddffc4-a877-4f95-840c-ad8ef8021755 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 14 09:08:27.905100 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.objects.instance [None req-5d331800-077c-4e2c-8dd2-9e8d56dcbb3d tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lazy-loading 'flavor' on Instance uuid d5d94249-deeb-4715-bd69-ba27597f46ef {{(pid=128759) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:08:27.932161 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-5d331800-077c-4e2c-8dd2-9e8d56dcbb3d tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] 10.222.0.60 "DELETE /compute/v2.1/servers/d5d94249-deeb-4715-bd69-ba27597f46ef/tags" status: 204 len: 0 microversion: 2.26 time: 0.190933 Sep 14 09:08:27.949540 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2144/4278] 10.222.0.60 () {60 vars in 1295 bytes} [Wed Sep 14 09:08:27 2022] DELETE /compute/v2.1/servers/d5d94249-deeb-4715-bd69-ba27597f46ef/tags => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 14 09:08:27.960258 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-e6629aee-fb4a-469d-8472-71f7c3d2dab6 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Calling method '.version_select at 0x7f7d3f5911f0>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:08:27.974451 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e6629aee-fb4a-469d-8472-71f7c3d2dab6 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:27.975212 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e6629aee-fb4a-469d-8472-71f7c3d2dab6 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:27.975795 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e6629aee-fb4a-469d-8472-71f7c3d2dab6 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:27.976553 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-e6629aee-fb4a-469d-8472-71f7c3d2dab6 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] [instance: d5d94249-deeb-4715-bd69-ba27597f46ef] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:08:27.984118 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e6629aee-fb4a-469d-8472-71f7c3d2dab6 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:27.984844 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e6629aee-fb4a-469d-8472-71f7c3d2dab6 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:27.985477 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e6629aee-fb4a-469d-8472-71f7c3d2dab6 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:27.986328 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e6629aee-fb4a-469d-8472-71f7c3d2dab6 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:27.986959 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e6629aee-fb4a-469d-8472-71f7c3d2dab6 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:27.987531 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e6629aee-fb4a-469d-8472-71f7c3d2dab6 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:28.026745 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b75dd504-9fca-4815-beb0-3e70ddd3e5eb tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:08:28.027475 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b75dd504-9fca-4815-beb0-3e70ddd3e5eb tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] [instance: 6957a5fb-4af4-4ca1-809a-8dd02e517c24] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:08:28.034806 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b75dd504-9fca-4815-beb0-3e70ddd3e5eb tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:28.036103 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b75dd504-9fca-4815-beb0-3e70ddd3e5eb tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:28.037657 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b75dd504-9fca-4815-beb0-3e70ddd3e5eb tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:28.038377 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b75dd504-9fca-4815-beb0-3e70ddd3e5eb tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:28.038839 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b75dd504-9fca-4815-beb0-3e70ddd3e5eb tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:28.039300 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b75dd504-9fca-4815-beb0-3e70ddd3e5eb tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:28.054467 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e6629aee-fb4a-469d-8472-71f7c3d2dab6 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:28.055235 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e6629aee-fb4a-469d-8472-71f7c3d2dab6 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:28.055835 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e6629aee-fb4a-469d-8472-71f7c3d2dab6 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:28.074673 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e6629aee-fb4a-469d-8472-71f7c3d2dab6 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:28.075369 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e6629aee-fb4a-469d-8472-71f7c3d2dab6 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:28.076288 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e6629aee-fb4a-469d-8472-71f7c3d2dab6 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:28.151657 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.objects.instance [None req-e6629aee-fb4a-469d-8472-71f7c3d2dab6 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lazy-loading 'flavor' on Instance uuid d5d94249-deeb-4715-bd69-ba27597f46ef {{(pid=128758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:08:28.168276 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b75dd504-9fca-4815-beb0-3e70ddd3e5eb tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932f3d4bbfd04cae8e48a937a5b10716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b713d80d5243659644e0c74c6df59c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:08:28.181134 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b75dd504-9fca-4815-beb0-3e70ddd3e5eb tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] 10.222.0.60 "GET /compute/v2.1/servers/6957a5fb-4af4-4ca1-809a-8dd02e517c24" status: 200 len: 1218 microversion: 2.1 time: 0.158805 Sep 14 09:08:28.193421 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-e6629aee-fb4a-469d-8472-71f7c3d2dab6 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] 10.222.0.60 "PUT /compute/v2.1/servers/d5d94249-deeb-4715-bd69-ba27597f46ef/tags/tempest-tag-1055770991" status: 201 len: 0 microversion: 2.26 time: 0.238032 Sep 14 09:08:28.195648 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2145/4279] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:08:28 2022] GET /compute/v2.1/servers/6957a5fb-4af4-4ca1-809a-8dd02e517c24 => generated 1218 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:08:28.199192 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2135/4280] 10.222.0.60 () {62 vars in 1380 bytes} [Wed Sep 14 09:08:27 2022] PUT /compute/v2.1/servers/d5d94249-deeb-4715-bd69-ba27597f46ef/tags/tempest-tag-1055770991 => generated 0 bytes in 245 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Sep 14 09:08:28.206451 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-727a116e-5618-4e36-9d8f-a06abceedcf3 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Calling method '.version_select at 0x7f7d443cb5e0>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:08:28.208748 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9e184a24-5e36-40d8-866f-8144304c7e32 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-96310748", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "networks": [{"uuid": "25039276-e7b2-497e-8f28-ebadf4eb94bc"}]}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:08:28.217221 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-727a116e-5618-4e36-9d8f-a06abceedcf3 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:28.217959 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-727a116e-5618-4e36-9d8f-a06abceedcf3 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:28.218611 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-727a116e-5618-4e36-9d8f-a06abceedcf3 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:28.219329 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-727a116e-5618-4e36-9d8f-a06abceedcf3 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] [instance: d5d94249-deeb-4715-bd69-ba27597f46ef] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:08:28.226555 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-727a116e-5618-4e36-9d8f-a06abceedcf3 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:28.227670 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-727a116e-5618-4e36-9d8f-a06abceedcf3 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:28.228269 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-727a116e-5618-4e36-9d8f-a06abceedcf3 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:28.229283 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-727a116e-5618-4e36-9d8f-a06abceedcf3 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:28.229946 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-727a116e-5618-4e36-9d8f-a06abceedcf3 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:28.230626 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-727a116e-5618-4e36-9d8f-a06abceedcf3 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:28.263037 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-727a116e-5618-4e36-9d8f-a06abceedcf3 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:28.263722 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-727a116e-5618-4e36-9d8f-a06abceedcf3 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:28.264314 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-727a116e-5618-4e36-9d8f-a06abceedcf3 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:28.275105 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-727a116e-5618-4e36-9d8f-a06abceedcf3 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:28.275769 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-727a116e-5618-4e36-9d8f-a06abceedcf3 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:28.276396 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-727a116e-5618-4e36-9d8f-a06abceedcf3 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:28.306566 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.network.neutron [None req-9e184a24-5e36-40d8-866f-8144304c7e32 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] validate_networks() for [('25039276-e7b2-497e-8f28-ebadf4eb94bc', None, None, None, None, None)] {{(pid=128759) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:08:28.335585 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.objects.instance [None req-727a116e-5618-4e36-9d8f-a06abceedcf3 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lazy-loading 'flavor' on Instance uuid d5d94249-deeb-4715-bd69-ba27597f46ef {{(pid=128758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:08:28.366362 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-727a116e-5618-4e36-9d8f-a06abceedcf3 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] 10.222.0.60 "PUT /compute/v2.1/servers/d5d94249-deeb-4715-bd69-ba27597f46ef/tags/tempest-tag-1001040448" status: 201 len: 0 microversion: 2.26 time: 0.163801 Sep 14 09:08:28.371182 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2136/4281] 10.222.0.60 () {62 vars in 1380 bytes} [Wed Sep 14 09:08:28 2022] PUT /compute/v2.1/servers/d5d94249-deeb-4715-bd69-ba27597f46ef/tags/tempest-tag-1001040448 => generated 0 bytes in 165 msecs (HTTP/1.1 201) 10 headers in 486 bytes (2 switches on core 0) Sep 14 09:08:28.384807 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c0c81aba-cede-4f67-bb25-225ae377d3e9 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Calling method '.version_select at 0x7f7d3f5fe550>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:08:28.409502 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c0c81aba-cede-4f67-bb25-225ae377d3e9 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:28.415586 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c0c81aba-cede-4f67-bb25-225ae377d3e9 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:28.416261 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c0c81aba-cede-4f67-bb25-225ae377d3e9 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:28.416970 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-c0c81aba-cede-4f67-bb25-225ae377d3e9 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] [instance: d5d94249-deeb-4715-bd69-ba27597f46ef] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:08:28.435264 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c0c81aba-cede-4f67-bb25-225ae377d3e9 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:28.436113 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c0c81aba-cede-4f67-bb25-225ae377d3e9 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:28.436775 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c0c81aba-cede-4f67-bb25-225ae377d3e9 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:28.437740 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c0c81aba-cede-4f67-bb25-225ae377d3e9 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:28.438417 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c0c81aba-cede-4f67-bb25-225ae377d3e9 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:28.439129 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c0c81aba-cede-4f67-bb25-225ae377d3e9 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:28.480268 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c0c81aba-cede-4f67-bb25-225ae377d3e9 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:28.483165 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c0c81aba-cede-4f67-bb25-225ae377d3e9 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:28.483693 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c0c81aba-cede-4f67-bb25-225ae377d3e9 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:28.506426 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.objects.instance [None req-c0c81aba-cede-4f67-bb25-225ae377d3e9 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lazy-loading 'flavor' on Instance uuid d5d94249-deeb-4715-bd69-ba27597f46ef {{(pid=128758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:08:28.532113 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-c0c81aba-cede-4f67-bb25-225ae377d3e9 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] 10.222.0.60 "DELETE /compute/v2.1/servers/d5d94249-deeb-4715-bd69-ba27597f46ef/tags" status: 204 len: 0 microversion: 2.26 time: 0.151543 Sep 14 09:08:28.532814 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2137/4282] 10.222.0.60 () {60 vars in 1295 bytes} [Wed Sep 14 09:08:28 2022] DELETE /compute/v2.1/servers/d5d94249-deeb-4715-bd69-ba27597f46ef/tags => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 14 09:08:28.548339 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-7e37f46f-869b-4bfd-b61b-6784e82d6941 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:08:28.549990 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-7e37f46f-869b-4bfd-b61b-6784e82d6941 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:08:28.579199 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7e37f46f-869b-4bfd-b61b-6784e82d6941 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:28.579979 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7e37f46f-869b-4bfd-b61b-6784e82d6941 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:28.581556 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7e37f46f-869b-4bfd-b61b-6784e82d6941 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:28.583239 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7e37f46f-869b-4bfd-b61b-6784e82d6941 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:28.584782 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7e37f46f-869b-4bfd-b61b-6784e82d6941 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:28.588831 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7e37f46f-869b-4bfd-b61b-6784e82d6941 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:29.295961 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-7e37f46f-869b-4bfd-b61b-6784e82d6941 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:08:29.322171 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-7e37f46f-869b-4bfd-b61b-6784e82d6941 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1519 microversion: 2.1 time: 0.783063 Sep 14 09:08:29.322779 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2138/4283] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:08:28 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1519 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:08:29.347016 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-0cb08768-4137-4050-a52f-ee04bb538476 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Calling method '.version_select at 0x7f7d3f4af4c0>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:08:29.380000 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0cb08768-4137-4050-a52f-ee04bb538476 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:29.382753 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0cb08768-4137-4050-a52f-ee04bb538476 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:29.383228 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0cb08768-4137-4050-a52f-ee04bb538476 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:29.405213 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-0cb08768-4137-4050-a52f-ee04bb538476 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] 10.222.0.60 "GET /compute/v2.1/servers/d5d94249-deeb-4715-bd69-ba27597f46ef/tags" status: 200 len: 12 microversion: 2.26 time: 0.075570 Sep 14 09:08:29.405853 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2139/4284] 10.222.0.60 () {60 vars in 1292 bytes} [Wed Sep 14 09:08:29 2022] GET /compute/v2.1/servers/d5d94249-deeb-4715-bd69-ba27597f46ef/tags => generated 12 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:08:29.414437 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-2a4dd176-1547-48f6-be80-3e6253027bb5 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:08:29.420756 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-2a4dd176-1547-48f6-be80-3e6253027bb5 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] [instance: 6957a5fb-4af4-4ca1-809a-8dd02e517c24] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:08:29.424023 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2a4dd176-1547-48f6-be80-3e6253027bb5 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:29.424523 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2a4dd176-1547-48f6-be80-3e6253027bb5 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:29.424963 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2a4dd176-1547-48f6-be80-3e6253027bb5 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:29.425718 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2a4dd176-1547-48f6-be80-3e6253027bb5 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:29.426447 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2a4dd176-1547-48f6-be80-3e6253027bb5 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:29.426879 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2a4dd176-1547-48f6-be80-3e6253027bb5 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:29.449937 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-9e184a24-5e36-40d8-866f-8144304c7e32 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Flavor limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:08:29.450541 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-9e184a24-5e36-40d8-866f-8144304c7e32 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Image limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:08:29.450890 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-9e184a24-5e36-40d8-866f-8144304c7e32 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Flavor pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:08:29.451348 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-9e184a24-5e36-40d8-866f-8144304c7e32 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Image pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:08:29.451800 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-9e184a24-5e36-40d8-866f-8144304c7e32 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:08:29.465810 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9e184a24-5e36-40d8-866f-8144304c7e32 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:29.466547 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9e184a24-5e36-40d8-866f-8144304c7e32 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:29.467229 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9e184a24-5e36-40d8-866f-8144304c7e32 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:29.468495 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9e184a24-5e36-40d8-866f-8144304c7e32 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:29.469829 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9e184a24-5e36-40d8-866f-8144304c7e32 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:29.470337 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9e184a24-5e36-40d8-866f-8144304c7e32 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:29.492003 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-9e184a24-5e36-40d8-866f-8144304c7e32 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Getting quotas for project 62a597fc389b4805bbd3a53ecd17c5b2. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:08:29.500471 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-9e184a24-5e36-40d8-866f-8144304c7e32 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Getting quotas for user 5165b8fc101c47c7a4370f9007bc5a58 and project 62a597fc389b4805bbd3a53ecd17c5b2. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:08:29.515232 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-2a4dd176-1547-48f6-be80-3e6253027bb5 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932f3d4bbfd04cae8e48a937a5b10716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b713d80d5243659644e0c74c6df59c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:08:29.521968 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-9e184a24-5e36-40d8-866f-8144304c7e32 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Going to run 1 instances... {{(pid=128759) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:08:29.524380 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-2a4dd176-1547-48f6-be80-3e6253027bb5 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] 10.222.0.60 "GET /compute/v2.1/servers/6957a5fb-4af4-4ca1-809a-8dd02e517c24" status: 200 len: 1280 microversion: 2.1 time: 0.116273 Sep 14 09:08:29.524986 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2140/4285] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:08:29 2022] GET /compute/v2.1/servers/6957a5fb-4af4-4ca1-809a-8dd02e517c24 => generated 1280 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:08:29.525544 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-9e184a24-5e36-40d8-866f-8144304c7e32 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] [instance: 8032c321-1baa-44a9-b3bd-b0ce09999b9e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128759) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:08:29.544445 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-405a5328-b276-447c-895c-f1a3836f7977 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Calling method '.version_select at 0x7f7d3f5fea60>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:08:29.554194 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-405a5328-b276-447c-895c-f1a3836f7977 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:29.555052 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-405a5328-b276-447c-895c-f1a3836f7977 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:29.555715 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-405a5328-b276-447c-895c-f1a3836f7977 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:29.556512 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-405a5328-b276-447c-895c-f1a3836f7977 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] [instance: d5d94249-deeb-4715-bd69-ba27597f46ef] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:08:29.565068 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-405a5328-b276-447c-895c-f1a3836f7977 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:29.567426 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-405a5328-b276-447c-895c-f1a3836f7977 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:29.567975 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-405a5328-b276-447c-895c-f1a3836f7977 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:29.569023 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-405a5328-b276-447c-895c-f1a3836f7977 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:29.569725 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-405a5328-b276-447c-895c-f1a3836f7977 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:29.570391 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-405a5328-b276-447c-895c-f1a3836f7977 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:29.603960 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-405a5328-b276-447c-895c-f1a3836f7977 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:29.604835 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-405a5328-b276-447c-895c-f1a3836f7977 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:29.605437 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-405a5328-b276-447c-895c-f1a3836f7977 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:29.617368 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.objects.instance [None req-405a5328-b276-447c-895c-f1a3836f7977 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lazy-loading 'flavor' on Instance uuid d5d94249-deeb-4715-bd69-ba27597f46ef {{(pid=128758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:08:29.620717 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-9e184a24-5e36-40d8-866f-8144304c7e32 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.423742 Sep 14 09:08:29.621701 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2146/4286] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 09:08:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 1425 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:08:29.623240 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9e184a24-5e36-40d8-866f-8144304c7e32 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:08:29.624354 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-9e184a24-5e36-40d8-866f-8144304c7e32 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001479 Sep 14 09:08:29.631412 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2147/4287] 10.222.0.60 () {56 vars in 886 bytes} [Wed Sep 14 09:08:29 2022] GET /compute/ => generated 377 bytes in 9 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Sep 14 09:08:29.638921 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-1fa07075-375c-460d-bf06-0e1acbaeedeb tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:08:29.639850 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-1fa07075-375c-460d-bf06-0e1acbaeedeb tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] [instance: 8032c321-1baa-44a9-b3bd-b0ce09999b9e] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:08:29.649334 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=89,nova_cell1:DELETE=3,nova_cell1:UPDATE=1,nova_cell1:INSERT=3,nova_cell1:SAVEPOINT=2,nova_cell1:RELEASE=2 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:08:29.655651 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-405a5328-b276-447c-895c-f1a3836f7977 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] 10.222.0.60 "DELETE /compute/v2.1/servers/d5d94249-deeb-4715-bd69-ba27597f46ef/tags" status: 204 len: 0 microversion: 2.26 time: 0.129689 Sep 14 09:08:29.661959 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2141/4288] 10.222.0.60 () {60 vars in 1295 bytes} [Wed Sep 14 09:08:29 2022] DELETE /compute/v2.1/servers/d5d94249-deeb-4715-bd69-ba27597f46ef/tags => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 14 09:08:29.663500 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-405a5328-b276-447c-895c-f1a3836f7977 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:08:29.664758 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-405a5328-b276-447c-895c-f1a3836f7977 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] 10.222.0.60 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.001726 Sep 14 09:08:29.665412 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2142/4289] 10.222.0.60 () {54 vars in 1035 bytes} [Wed Sep 14 09:08:29 2022] GET /compute/v2/ => generated 379 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Sep 14 09:08:29.675768 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-0025307e-a948-4a38-8ffd-efc517ae9874 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Calling method '.version_select at 0x7f7d3f4f8c10>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:08:29.687464 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0025307e-a948-4a38-8ffd-efc517ae9874 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:29.687964 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0025307e-a948-4a38-8ffd-efc517ae9874 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:29.688407 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0025307e-a948-4a38-8ffd-efc517ae9874 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:29.689099 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-0025307e-a948-4a38-8ffd-efc517ae9874 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] [instance: d5d94249-deeb-4715-bd69-ba27597f46ef] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:08:29.697656 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0025307e-a948-4a38-8ffd-efc517ae9874 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:29.698433 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0025307e-a948-4a38-8ffd-efc517ae9874 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:29.698873 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0025307e-a948-4a38-8ffd-efc517ae9874 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:29.699608 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0025307e-a948-4a38-8ffd-efc517ae9874 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:29.700067 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0025307e-a948-4a38-8ffd-efc517ae9874 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:29.700493 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0025307e-a948-4a38-8ffd-efc517ae9874 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:29.739187 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0025307e-a948-4a38-8ffd-efc517ae9874 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:29.739827 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0025307e-a948-4a38-8ffd-efc517ae9874 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:29.740368 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0025307e-a948-4a38-8ffd-efc517ae9874 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:29.753215 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0025307e-a948-4a38-8ffd-efc517ae9874 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:29.754085 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0025307e-a948-4a38-8ffd-efc517ae9874 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:29.754728 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0025307e-a948-4a38-8ffd-efc517ae9874 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:29.759732 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-1fa07075-375c-460d-bf06-0e1acbaeedeb tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5165b8fc101c47c7a4370f9007bc5a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a597fc389b4805bbd3a53ecd17c5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:08:29.770030 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-1fa07075-375c-460d-bf06-0e1acbaeedeb tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute/v2.1/servers/8032c321-1baa-44a9-b3bd-b0ce09999b9e" status: 200 len: 1206 microversion: 2.1 time: 0.136905 Sep 14 09:08:29.772804 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2148/4290] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:08:29 2022] GET /compute/v2.1/servers/8032c321-1baa-44a9-b3bd-b0ce09999b9e => generated 1206 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:08:29.779649 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-1fa07075-375c-460d-bf06-0e1acbaeedeb tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:08:29.781097 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-1fa07075-375c-460d-bf06-0e1acbaeedeb tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.003256 Sep 14 09:08:29.791170 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2149/4291] 10.222.0.60 () {54 vars in 1041 bytes} [Wed Sep 14 09:08:29 2022] GET /compute/v2.1/ => generated 388 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:08:29.795619 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-1fa07075-375c-460d-bf06-0e1acbaeedeb tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:08:29.796895 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-1fa07075-375c-460d-bf06-0e1acbaeedeb tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001689 Sep 14 09:08:29.797663 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2150/4292] 10.222.0.60 () {56 vars in 886 bytes} [Wed Sep 14 09:08:29 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Sep 14 09:08:29.842865 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.objects.instance [None req-0025307e-a948-4a38-8ffd-efc517ae9874 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lazy-loading 'flavor' on Instance uuid d5d94249-deeb-4715-bd69-ba27597f46ef {{(pid=128758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:08:29.869030 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-0025307e-a948-4a38-8ffd-efc517ae9874 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] 10.222.0.60 "PUT /compute/v2.1/servers/d5d94249-deeb-4715-bd69-ba27597f46ef/tags/tempest-tag-1449122720" status: 201 len: 0 microversion: 2.26 time: 0.202334 Sep 14 09:08:29.870000 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2143/4293] 10.222.0.60 () {62 vars in 1380 bytes} [Wed Sep 14 09:08:29 2022] PUT /compute/v2.1/servers/d5d94249-deeb-4715-bd69-ba27597f46ef/tags/tempest-tag-1449122720 => generated 0 bytes in 204 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Sep 14 09:08:29.883181 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3b51b196-86df-41f3-8a89-00e6dcf10442 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Calling method '.version_select at 0x7f7d48671430>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:08:29.919861 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3b51b196-86df-41f3-8a89-00e6dcf10442 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:29.922125 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3b51b196-86df-41f3-8a89-00e6dcf10442 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:29.933364 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3b51b196-86df-41f3-8a89-00e6dcf10442 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:29.934089 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-3b51b196-86df-41f3-8a89-00e6dcf10442 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] [instance: d5d94249-deeb-4715-bd69-ba27597f46ef] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:08:29.944449 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3b51b196-86df-41f3-8a89-00e6dcf10442 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:29.945300 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3b51b196-86df-41f3-8a89-00e6dcf10442 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:29.945464 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3b51b196-86df-41f3-8a89-00e6dcf10442 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:29.948844 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3b51b196-86df-41f3-8a89-00e6dcf10442 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:29.949696 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3b51b196-86df-41f3-8a89-00e6dcf10442 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:29.950485 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3b51b196-86df-41f3-8a89-00e6dcf10442 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:29.989331 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3b51b196-86df-41f3-8a89-00e6dcf10442 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:29.990327 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3b51b196-86df-41f3-8a89-00e6dcf10442 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:29.991243 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3b51b196-86df-41f3-8a89-00e6dcf10442 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:30.005325 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3b51b196-86df-41f3-8a89-00e6dcf10442 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:30.006273 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3b51b196-86df-41f3-8a89-00e6dcf10442 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:30.006862 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3b51b196-86df-41f3-8a89-00e6dcf10442 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:30.014077 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-5085bae5-986a-4273-87c8-82febd0af1eb req-2c73b290-8881-478b-8b33-2a5bd392b25f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8ddffc4-a877-4f95-840c-ad8ef8021755", "name": "network-vif-unplugged", "status": "completed", "tag": "42b91ece-9a73-43f2-ab71-9b62a3d0ff21"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:08:30.033409 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-5085bae5-986a-4273-87c8-82febd0af1eb req-2c73b290-8881-478b-8b33-2a5bd392b25f service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:30.034034 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-5085bae5-986a-4273-87c8-82febd0af1eb req-2c73b290-8881-478b-8b33-2a5bd392b25f service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:30.034337 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-5085bae5-986a-4273-87c8-82febd0af1eb req-2c73b290-8881-478b-8b33-2a5bd392b25f service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:30.063915 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.objects.instance [None req-3b51b196-86df-41f3-8a89-00e6dcf10442 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lazy-loading 'flavor' on Instance uuid d5d94249-deeb-4715-bd69-ba27597f46ef {{(pid=128759) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:08:30.087844 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-5085bae5-986a-4273-87c8-82febd0af1eb req-2c73b290-8881-478b-8b33-2a5bd392b25f service nova] Creating event network-vif-unplugged:42b91ece-9a73-43f2-ab71-9b62a3d0ff21 for instance f8ddffc4-a877-4f95-840c-ad8ef8021755 on n-h1-836830-18 Sep 14 09:08:30.103259 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-5085bae5-986a-4273-87c8-82febd0af1eb req-2c73b290-8881-478b-8b33-2a5bd392b25f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.092875 Sep 14 09:08:30.110266 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2144/4294] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:08:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:08:30.117201 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-3b51b196-86df-41f3-8a89-00e6dcf10442 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] 10.222.0.60 "PUT /compute/v2.1/servers/d5d94249-deeb-4715-bd69-ba27597f46ef/tags/tempest-tag-1873689341" status: 201 len: 0 microversion: 2.26 time: 0.237634 Sep 14 09:08:30.118073 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2151/4295] 10.222.0.60 () {62 vars in 1380 bytes} [Wed Sep 14 09:08:29 2022] PUT /compute/v2.1/servers/d5d94249-deeb-4715-bd69-ba27597f46ef/tags/tempest-tag-1873689341 => generated 0 bytes in 242 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Sep 14 09:08:30.132538 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ce975da5-725e-43db-beb8-c73d25b87ef9 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Action: 'update_all', calling method: .version_select at 0x7f7d3f4f8ca0>, body: {"tags": ["tempest-tag-484775237", "tempest-tag-1499211896"]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:08:30.186762 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ce975da5-725e-43db-beb8-c73d25b87ef9 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:30.187613 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ce975da5-725e-43db-beb8-c73d25b87ef9 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:30.188201 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ce975da5-725e-43db-beb8-c73d25b87ef9 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:30.189272 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-ce975da5-725e-43db-beb8-c73d25b87ef9 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] [instance: d5d94249-deeb-4715-bd69-ba27597f46ef] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:08:30.197032 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ce975da5-725e-43db-beb8-c73d25b87ef9 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:30.197799 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ce975da5-725e-43db-beb8-c73d25b87ef9 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:30.198481 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ce975da5-725e-43db-beb8-c73d25b87ef9 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:30.201013 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ce975da5-725e-43db-beb8-c73d25b87ef9 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:30.201661 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ce975da5-725e-43db-beb8-c73d25b87ef9 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:30.202557 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ce975da5-725e-43db-beb8-c73d25b87ef9 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:30.236353 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ce975da5-725e-43db-beb8-c73d25b87ef9 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:30.236353 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ce975da5-725e-43db-beb8-c73d25b87ef9 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:30.236624 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ce975da5-725e-43db-beb8-c73d25b87ef9 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:30.271452 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.objects.instance [None req-ce975da5-725e-43db-beb8-c73d25b87ef9 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lazy-loading 'flavor' on Instance uuid d5d94249-deeb-4715-bd69-ba27597f46ef {{(pid=128758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:08:30.317695 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-ce975da5-725e-43db-beb8-c73d25b87ef9 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] 10.222.0.60 "PUT /compute/v2.1/servers/d5d94249-deeb-4715-bd69-ba27597f46ef/tags" status: 200 len: 61 microversion: 2.26 time: 0.187525 Sep 14 09:08:30.319363 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2145/4296] 10.222.0.60 () {62 vars in 1312 bytes} [Wed Sep 14 09:08:30 2022] PUT /compute/v2.1/servers/d5d94249-deeb-4715-bd69-ba27597f46ef/tags => generated 61 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:08:30.331918 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e6b9a57d-f2a6-4f40-802d-2d81ad90aa73 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Calling method '.version_select at 0x7f7d3efbb430>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:08:30.349982 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d95255ed-3834-492d-bac9-2b3883994d23 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:08:30.350609 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-d95255ed-3834-492d-bac9-2b3883994d23 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:08:30.360463 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e6b9a57d-f2a6-4f40-802d-2d81ad90aa73 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:30.363375 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e6b9a57d-f2a6-4f40-802d-2d81ad90aa73 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:30.363844 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e6b9a57d-f2a6-4f40-802d-2d81ad90aa73 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:30.372337 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d95255ed-3834-492d-bac9-2b3883994d23 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:30.373606 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d95255ed-3834-492d-bac9-2b3883994d23 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:30.374038 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d95255ed-3834-492d-bac9-2b3883994d23 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:30.380824 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d95255ed-3834-492d-bac9-2b3883994d23 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:30.381391 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d95255ed-3834-492d-bac9-2b3883994d23 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:30.383836 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d95255ed-3834-492d-bac9-2b3883994d23 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:30.396067 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e6b9a57d-f2a6-4f40-802d-2d81ad90aa73 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] 10.222.0.60 "GET /compute/v2.1/servers/d5d94249-deeb-4715-bd69-ba27597f46ef/tags" status: 200 len: 61 microversion: 2.26 time: 0.070539 Sep 14 09:08:30.400075 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2152/4297] 10.222.0.60 () {60 vars in 1292 bytes} [Wed Sep 14 09:08:30 2022] GET /compute/v2.1/servers/d5d94249-deeb-4715-bd69-ba27597f46ef/tags => generated 61 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:08:30.420162 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-2e20205e-3f77-4efa-afc6-480b6cbb4b35 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Calling method '.version_select at 0x7f7d3ef02c10>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:08:30.436851 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2e20205e-3f77-4efa-afc6-480b6cbb4b35 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:30.437505 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2e20205e-3f77-4efa-afc6-480b6cbb4b35 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:30.438026 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2e20205e-3f77-4efa-afc6-480b6cbb4b35 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:30.438602 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-2e20205e-3f77-4efa-afc6-480b6cbb4b35 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] [instance: d5d94249-deeb-4715-bd69-ba27597f46ef] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:08:30.446699 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2e20205e-3f77-4efa-afc6-480b6cbb4b35 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:30.447560 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2e20205e-3f77-4efa-afc6-480b6cbb4b35 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:30.448115 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2e20205e-3f77-4efa-afc6-480b6cbb4b35 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:30.449883 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2e20205e-3f77-4efa-afc6-480b6cbb4b35 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:30.449883 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2e20205e-3f77-4efa-afc6-480b6cbb4b35 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:30.474048 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2e20205e-3f77-4efa-afc6-480b6cbb4b35 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:30.536997 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2e20205e-3f77-4efa-afc6-480b6cbb4b35 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:30.537610 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2e20205e-3f77-4efa-afc6-480b6cbb4b35 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:30.538155 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2e20205e-3f77-4efa-afc6-480b6cbb4b35 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:30.579144 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=3,nova_cell1:SAVEPOINT=2,nova_cell1:RELEASE=2,nova_cell1:DELETE=3 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:08:30.593734 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.objects.instance [None req-2e20205e-3f77-4efa-afc6-480b6cbb4b35 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lazy-loading 'flavor' on Instance uuid d5d94249-deeb-4715-bd69-ba27597f46ef {{(pid=128759) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:08:30.632893 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-2e20205e-3f77-4efa-afc6-480b6cbb4b35 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] 10.222.0.60 "DELETE /compute/v2.1/servers/d5d94249-deeb-4715-bd69-ba27597f46ef/tags" status: 204 len: 0 microversion: 2.26 time: 0.220814 Sep 14 09:08:30.635517 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2153/4298] 10.222.0.60 () {60 vars in 1295 bytes} [Wed Sep 14 09:08:30 2022] DELETE /compute/v2.1/servers/d5d94249-deeb-4715-bd69-ba27597f46ef/tags => generated 0 bytes in 224 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 14 09:08:30.648286 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f5825249-0c15-4c02-908f-d6d40fb8265e tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:08:30.652641 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f5825249-0c15-4c02-908f-d6d40fb8265e tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] [instance: 6957a5fb-4af4-4ca1-809a-8dd02e517c24] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:08:30.668947 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f5825249-0c15-4c02-908f-d6d40fb8265e tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:30.669898 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f5825249-0c15-4c02-908f-d6d40fb8265e tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:30.674335 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f5825249-0c15-4c02-908f-d6d40fb8265e tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:30.675602 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f5825249-0c15-4c02-908f-d6d40fb8265e tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:30.676869 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f5825249-0c15-4c02-908f-d6d40fb8265e tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:30.677817 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f5825249-0c15-4c02-908f-d6d40fb8265e tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:31.011087 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-d95255ed-3834-492d-bac9-2b3883994d23 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:08:31.035099 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-d95255ed-3834-492d-bac9-2b3883994d23 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1519 microversion: 2.1 time: 0.691442 Sep 14 09:08:31.038869 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2146/4299] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:08:30 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1519 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:08:31.052670 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-418b589b-eaf5-449d-8c45-ab6258ae2387 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:08:31.054427 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-418b589b-eaf5-449d-8c45-ab6258ae2387 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] [instance: d5d94249-deeb-4715-bd69-ba27597f46ef] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:08:31.080758 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-418b589b-eaf5-449d-8c45-ab6258ae2387 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:31.081316 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-418b589b-eaf5-449d-8c45-ab6258ae2387 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:31.081800 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-418b589b-eaf5-449d-8c45-ab6258ae2387 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:31.082535 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-418b589b-eaf5-449d-8c45-ab6258ae2387 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:31.083141 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-418b589b-eaf5-449d-8c45-ab6258ae2387 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:31.084045 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-418b589b-eaf5-449d-8c45-ab6258ae2387 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:31.124333 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-418b589b-eaf5-449d-8c45-ab6258ae2387 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] [instance: d5d94249-deeb-4715-bd69-ba27597f46ef] Going to try to terminate instance {{(pid=128758) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:08:31.258374 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f5825249-0c15-4c02-908f-d6d40fb8265e tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932f3d4bbfd04cae8e48a937a5b10716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b713d80d5243659644e0c74c6df59c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:08:31.274705 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f5825249-0c15-4c02-908f-d6d40fb8265e tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] 10.222.0.60 "GET /compute/v2.1/servers/6957a5fb-4af4-4ca1-809a-8dd02e517c24" status: 200 len: 1322 microversion: 2.1 time: 0.636434 Sep 14 09:08:31.275614 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2154/4300] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:08:30 2022] GET /compute/v2.1/servers/6957a5fb-4af4-4ca1-809a-8dd02e517c24 => generated 1322 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:08:31.310357 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-7512962f-be55-4b4a-8e5e-221339e8af53 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:08:31.312107 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-7512962f-be55-4b4a-8e5e-221339e8af53 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] [instance: 8032c321-1baa-44a9-b3bd-b0ce09999b9e] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:08:31.343724 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7512962f-be55-4b4a-8e5e-221339e8af53 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:31.346992 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7512962f-be55-4b4a-8e5e-221339e8af53 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:31.348054 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7512962f-be55-4b4a-8e5e-221339e8af53 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:31.348817 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7512962f-be55-4b4a-8e5e-221339e8af53 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:31.349290 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7512962f-be55-4b4a-8e5e-221339e8af53 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:31.351709 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7512962f-be55-4b4a-8e5e-221339e8af53 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:31.389853 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-418b589b-eaf5-449d-8c45-ab6258ae2387 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] 10.222.0.60 "DELETE /compute/v2.1/servers/d5d94249-deeb-4715-bd69-ba27597f46ef" status: 204 len: 0 microversion: 2.26 time: 0.348233 Sep 14 09:08:31.390547 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2147/4301] 10.222.0.60 () {60 vars in 1280 bytes} [Wed Sep 14 09:08:31 2022] DELETE /compute/v2.1/servers/d5d94249-deeb-4715-bd69-ba27597f46ef => generated 0 bytes in 351 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 14 09:08:31.419037 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-bad9b6cc-af19-40e0-9bd7-b7f5274abeaa tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:08:31.419037 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-bad9b6cc-af19-40e0-9bd7-b7f5274abeaa tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] [instance: d5d94249-deeb-4715-bd69-ba27597f46ef] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:08:31.430814 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bad9b6cc-af19-40e0-9bd7-b7f5274abeaa tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:31.430814 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bad9b6cc-af19-40e0-9bd7-b7f5274abeaa tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:31.430814 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bad9b6cc-af19-40e0-9bd7-b7f5274abeaa tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:31.430814 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bad9b6cc-af19-40e0-9bd7-b7f5274abeaa tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:31.430814 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bad9b6cc-af19-40e0-9bd7-b7f5274abeaa tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:31.430814 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bad9b6cc-af19-40e0-9bd7-b7f5274abeaa tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:32.333640 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-7512962f-be55-4b4a-8e5e-221339e8af53 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5165b8fc101c47c7a4370f9007bc5a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a597fc389b4805bbd3a53ecd17c5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:08:32.349855 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-7512962f-be55-4b4a-8e5e-221339e8af53 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute/v2.1/servers/8032c321-1baa-44a9-b3bd-b0ce09999b9e" status: 200 len: 1258 microversion: 2.1 time: 1.055284 Sep 14 09:08:32.358724 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2155/4302] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:08:31 2022] GET /compute/v2.1/servers/8032c321-1baa-44a9-b3bd-b0ce09999b9e => generated 1258 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:08:32.379620 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-b61917e1-24de-4535-abf4-d31120343aaf req-6f7172fe-3a7e-47e1-bd11-709f3d211e2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8ddffc4-a877-4f95-840c-ad8ef8021755", "name": "network-vif-deleted", "tag": "42b91ece-9a73-43f2-ab71-9b62a3d0ff21"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:08:32.409296 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-b61917e1-24de-4535-abf4-d31120343aaf req-6f7172fe-3a7e-47e1-bd11-709f3d211e2d service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:32.416332 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-b61917e1-24de-4535-abf4-d31120343aaf req-6f7172fe-3a7e-47e1-bd11-709f3d211e2d service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:32.417244 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-b61917e1-24de-4535-abf4-d31120343aaf req-6f7172fe-3a7e-47e1-bd11-709f3d211e2d service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:32.442114 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-b61917e1-24de-4535-abf4-d31120343aaf req-6f7172fe-3a7e-47e1-bd11-709f3d211e2d service nova] Creating event network-vif-deleted:42b91ece-9a73-43f2-ab71-9b62a3d0ff21 for instance f8ddffc4-a877-4f95-840c-ad8ef8021755 on n-h1-836830-18 Sep 14 09:08:32.458249 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-b61917e1-24de-4535-abf4-d31120343aaf req-6f7172fe-3a7e-47e1-bd11-709f3d211e2d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096878 Sep 14 09:08:32.462716 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2156/4303] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:08:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:08:32.475934 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a129b46f-2d83-4192-aa2c-7590adf43a07 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:08:32.486162 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-a129b46f-2d83-4192-aa2c-7590adf43a07 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:08:32.501572 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a129b46f-2d83-4192-aa2c-7590adf43a07 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:32.503680 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a129b46f-2d83-4192-aa2c-7590adf43a07 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:32.506504 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a129b46f-2d83-4192-aa2c-7590adf43a07 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:32.507696 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a129b46f-2d83-4192-aa2c-7590adf43a07 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:32.517209 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a129b46f-2d83-4192-aa2c-7590adf43a07 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:32.526788 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a129b46f-2d83-4192-aa2c-7590adf43a07 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:32.709321 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-bad9b6cc-af19-40e0-9bd7-b7f5274abeaa tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6eab0235b041d4b1d2ffe2fae8bdd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f279926ee014c148690608fe635e3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:08:32.721655 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-bad9b6cc-af19-40e0-9bd7-b7f5274abeaa tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d6eab0235b041d4b1d2ffe2fae8bdd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f279926ee014c148690608fe635e3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:08:32.723574 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-bad9b6cc-af19-40e0-9bd7-b7f5274abeaa tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d6eab0235b041d4b1d2ffe2fae8bdd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f279926ee014c148690608fe635e3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:08:32.731877 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-bad9b6cc-af19-40e0-9bd7-b7f5274abeaa tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] 10.222.0.60 "GET /compute/v2.1/servers/d5d94249-deeb-4715-bd69-ba27597f46ef" status: 200 len: 1551 microversion: 2.26 time: 1.329083 Sep 14 09:08:32.748922 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2148/4304] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:08:31 2022] GET /compute/v2.1/servers/d5d94249-deeb-4715-bd69-ba27597f46ef => generated 1551 bytes in 1354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:08:32.773569 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-4bad4060-0546-43f5-ba65-8d435f71ff30 req-d4ca1d90-d7ba-4f30-96cd-258df0b08741 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae344b98-a354-4df8-83ba-3c5a786694f4", "name": "network-vif-plugged", "status": "completed", "tag": "61e7783e-94c8-44e3-8a64-73b1fe49a7cd"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:08:32.802262 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-4bad4060-0546-43f5-ba65-8d435f71ff30 req-d4ca1d90-d7ba-4f30-96cd-258df0b08741 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:32.805689 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-4bad4060-0546-43f5-ba65-8d435f71ff30 req-d4ca1d90-d7ba-4f30-96cd-258df0b08741 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:32.806154 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-4bad4060-0546-43f5-ba65-8d435f71ff30 req-d4ca1d90-d7ba-4f30-96cd-258df0b08741 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:32.865278 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-4bad4060-0546-43f5-ba65-8d435f71ff30 req-d4ca1d90-d7ba-4f30-96cd-258df0b08741 service nova] Creating event network-vif-plugged:61e7783e-94c8-44e3-8a64-73b1fe49a7cd for instance ae344b98-a354-4df8-83ba-3c5a786694f4 on n-h2-836830-18 Sep 14 09:08:32.887202 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-4bad4060-0546-43f5-ba65-8d435f71ff30 req-d4ca1d90-d7ba-4f30-96cd-258df0b08741 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136180 Sep 14 09:08:32.890762 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2149/4305] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:08:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:08:32.902652 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b1449770-b3ce-4ff0-8f9e-a4b2c3177e62 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:08:32.903397 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-b1449770-b3ce-4ff0-8f9e-a4b2c3177e62 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] [instance: 6957a5fb-4af4-4ca1-809a-8dd02e517c24] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:08:32.933992 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b1449770-b3ce-4ff0-8f9e-a4b2c3177e62 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:32.934559 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b1449770-b3ce-4ff0-8f9e-a4b2c3177e62 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:32.936613 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b1449770-b3ce-4ff0-8f9e-a4b2c3177e62 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:32.937770 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b1449770-b3ce-4ff0-8f9e-a4b2c3177e62 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:32.938246 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b1449770-b3ce-4ff0-8f9e-a4b2c3177e62 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:32.938695 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b1449770-b3ce-4ff0-8f9e-a4b2c3177e62 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:33.500522 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-b1449770-b3ce-4ff0-8f9e-a4b2c3177e62 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932f3d4bbfd04cae8e48a937a5b10716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b713d80d5243659644e0c74c6df59c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:08:33.510873 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-b1449770-b3ce-4ff0-8f9e-a4b2c3177e62 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] 10.222.0.60 "GET /compute/v2.1/servers/6957a5fb-4af4-4ca1-809a-8dd02e517c24" status: 200 len: 1322 microversion: 2.1 time: 0.614836 Sep 14 09:08:33.535506 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2150/4306] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:08:32 2022] GET /compute/v2.1/servers/6957a5fb-4af4-4ca1-809a-8dd02e517c24 => generated 1322 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:08:33.548808 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-8c021d17-c0ec-476e-9eaf-cc3a737d3b32 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:08:33.549438 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-8c021d17-c0ec-476e-9eaf-cc3a737d3b32 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] [instance: 8032c321-1baa-44a9-b3bd-b0ce09999b9e] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:08:33.579525 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8c021d17-c0ec-476e-9eaf-cc3a737d3b32 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:33.580208 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8c021d17-c0ec-476e-9eaf-cc3a737d3b32 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:33.580816 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8c021d17-c0ec-476e-9eaf-cc3a737d3b32 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:33.583787 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8c021d17-c0ec-476e-9eaf-cc3a737d3b32 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:33.584429 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8c021d17-c0ec-476e-9eaf-cc3a737d3b32 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:33.585017 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8c021d17-c0ec-476e-9eaf-cc3a737d3b32 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:33.706243 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-a129b46f-2d83-4192-aa2c-7590adf43a07 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:08:33.714860 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a129b46f-2d83-4192-aa2c-7590adf43a07 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1519 microversion: 2.1 time: 1.250678 Sep 14 09:08:33.731562 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2157/4307] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:08:32 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1519 bytes in 1268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:08:33.762113 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-053a9b7f-296d-4c90-bbb8-fdb1d58c5e97 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:08:33.763090 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-053a9b7f-296d-4c90-bbb8-fdb1d58c5e97 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] [instance: d5d94249-deeb-4715-bd69-ba27597f46ef] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:08:33.772249 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-053a9b7f-296d-4c90-bbb8-fdb1d58c5e97 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:33.774162 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-053a9b7f-296d-4c90-bbb8-fdb1d58c5e97 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:33.774830 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-053a9b7f-296d-4c90-bbb8-fdb1d58c5e97 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:33.777162 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-053a9b7f-296d-4c90-bbb8-fdb1d58c5e97 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:33.777849 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-053a9b7f-296d-4c90-bbb8-fdb1d58c5e97 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:33.779409 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-053a9b7f-296d-4c90-bbb8-fdb1d58c5e97 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:33.804973 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-8c021d17-c0ec-476e-9eaf-cc3a737d3b32 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5165b8fc101c47c7a4370f9007bc5a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a597fc389b4805bbd3a53ecd17c5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:08:33.815751 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-8c021d17-c0ec-476e-9eaf-cc3a737d3b32 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute/v2.1/servers/8032c321-1baa-44a9-b3bd-b0ce09999b9e" status: 200 len: 1264 microversion: 2.1 time: 0.278767 Sep 14 09:08:33.823408 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2151/4308] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:08:33 2022] GET /compute/v2.1/servers/8032c321-1baa-44a9-b3bd-b0ce09999b9e => generated 1264 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:08:34.214875 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-053a9b7f-296d-4c90-bbb8-fdb1d58c5e97 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6eab0235b041d4b1d2ffe2fae8bdd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f279926ee014c148690608fe635e3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:08:34.227433 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-053a9b7f-296d-4c90-bbb8-fdb1d58c5e97 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d6eab0235b041d4b1d2ffe2fae8bdd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f279926ee014c148690608fe635e3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:08:34.231406 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-053a9b7f-296d-4c90-bbb8-fdb1d58c5e97 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d6eab0235b041d4b1d2ffe2fae8bdd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f279926ee014c148690608fe635e3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:08:34.236344 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-053a9b7f-296d-4c90-bbb8-fdb1d58c5e97 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] 10.222.0.60 "GET /compute/v2.1/servers/d5d94249-deeb-4715-bd69-ba27597f46ef" status: 200 len: 1551 microversion: 2.26 time: 0.479385 Sep 14 09:08:34.237326 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2158/4309] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:08:33 2022] GET /compute/v2.1/servers/d5d94249-deeb-4715-bd69-ba27597f46ef => generated 1551 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:08:34.486806 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-4ecd1811-c026-4f63-95c6-a49811ee4524 req-f8d9301c-f09c-4bf9-b33c-06faac54a729 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6957a5fb-4af4-4ca1-809a-8dd02e517c24", "tag": "ace61c6b-a7bc-48b0-ba9c-109092ffc122"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:08:34.515190 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-4ecd1811-c026-4f63-95c6-a49811ee4524 req-f8d9301c-f09c-4bf9-b33c-06faac54a729 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:34.516045 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-4ecd1811-c026-4f63-95c6-a49811ee4524 req-f8d9301c-f09c-4bf9-b33c-06faac54a729 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:34.516659 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-4ecd1811-c026-4f63-95c6-a49811ee4524 req-f8d9301c-f09c-4bf9-b33c-06faac54a729 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:34.535334 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-cd80ad39-43ae-4895-a245-248f41390edf tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:08:34.536173 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-cd80ad39-43ae-4895-a245-248f41390edf tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] [instance: 6957a5fb-4af4-4ca1-809a-8dd02e517c24] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:08:34.545014 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cd80ad39-43ae-4895-a245-248f41390edf tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:34.545528 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cd80ad39-43ae-4895-a245-248f41390edf tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:34.545904 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-4ecd1811-c026-4f63-95c6-a49811ee4524 req-f8d9301c-f09c-4bf9-b33c-06faac54a729 service nova] Creating event network-changed:ace61c6b-a7bc-48b0-ba9c-109092ffc122 for instance 6957a5fb-4af4-4ca1-809a-8dd02e517c24 on n-h2-836830-18 Sep 14 09:08:34.551647 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cd80ad39-43ae-4895-a245-248f41390edf tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:34.552532 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cd80ad39-43ae-4895-a245-248f41390edf tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:34.553112 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cd80ad39-43ae-4895-a245-248f41390edf tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:34.553889 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cd80ad39-43ae-4895-a245-248f41390edf tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:34.565020 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-4ecd1811-c026-4f63-95c6-a49811ee4524 req-f8d9301c-f09c-4bf9-b33c-06faac54a729 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081905 Sep 14 09:08:34.576903 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2152/4310] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:08:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:08:34.752683 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-e09e19bd-6508-4c5b-a2f4-66ec6055aae5 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:08:34.753423 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-e09e19bd-6508-4c5b-a2f4-66ec6055aae5 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:08:34.763954 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e09e19bd-6508-4c5b-a2f4-66ec6055aae5 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:34.764440 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e09e19bd-6508-4c5b-a2f4-66ec6055aae5 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:34.764872 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e09e19bd-6508-4c5b-a2f4-66ec6055aae5 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:34.766658 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e09e19bd-6508-4c5b-a2f4-66ec6055aae5 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:34.767207 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e09e19bd-6508-4c5b-a2f4-66ec6055aae5 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:34.767681 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e09e19bd-6508-4c5b-a2f4-66ec6055aae5 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:35.346925 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-cd80ad39-43ae-4895-a245-248f41390edf tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932f3d4bbfd04cae8e48a937a5b10716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b713d80d5243659644e0c74c6df59c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:08:35.363715 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-cd80ad39-43ae-4895-a245-248f41390edf tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] 10.222.0.60 "GET /compute/v2.1/servers/6957a5fb-4af4-4ca1-809a-8dd02e517c24" status: 200 len: 1322 microversion: 2.1 time: 0.833667 Sep 14 09:08:35.366138 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2159/4311] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:08:34 2022] GET /compute/v2.1/servers/6957a5fb-4af4-4ca1-809a-8dd02e517c24 => generated 1322 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:08:35.389917 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-89bf735e-0e5e-4b3a-aea9-65f959b05a44 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:08:35.398601 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-89bf735e-0e5e-4b3a-aea9-65f959b05a44 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] [instance: 8032c321-1baa-44a9-b3bd-b0ce09999b9e] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:08:35.404726 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-e09e19bd-6508-4c5b-a2f4-66ec6055aae5 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:08:35.414913 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-89bf735e-0e5e-4b3a-aea9-65f959b05a44 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:35.415606 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-e09e19bd-6508-4c5b-a2f4-66ec6055aae5 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1519 microversion: 2.1 time: 0.677542 Sep 14 09:08:35.417528 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-89bf735e-0e5e-4b3a-aea9-65f959b05a44 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:35.418192 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-89bf735e-0e5e-4b3a-aea9-65f959b05a44 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:35.420105 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-89bf735e-0e5e-4b3a-aea9-65f959b05a44 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:35.420761 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-89bf735e-0e5e-4b3a-aea9-65f959b05a44 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:35.421606 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-89bf735e-0e5e-4b3a-aea9-65f959b05a44 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:35.431835 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2153/4312] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:08:34 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1519 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:08:35.436904 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-53391361-2693-43ce-8b37-e23450d38386 req-43ac2144-cbee-4933-9fd0-9fb5db6bbea2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8450d385-d5d9-4c86-9ece-b3bbf9ed1105", "name": "network-vif-plugged", "status": "completed", "tag": "eb873b1a-8b40-4eb4-a329-cf733d9ed342"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:08:35.462587 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-53391361-2693-43ce-8b37-e23450d38386 req-43ac2144-cbee-4933-9fd0-9fb5db6bbea2 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:35.463107 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-53391361-2693-43ce-8b37-e23450d38386 req-43ac2144-cbee-4933-9fd0-9fb5db6bbea2 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:35.463631 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-53391361-2693-43ce-8b37-e23450d38386 req-43ac2144-cbee-4933-9fd0-9fb5db6bbea2 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:35.485303 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-53391361-2693-43ce-8b37-e23450d38386 req-43ac2144-cbee-4933-9fd0-9fb5db6bbea2 service nova] Creating event network-vif-plugged:eb873b1a-8b40-4eb4-a329-cf733d9ed342 for instance 8450d385-d5d9-4c86-9ece-b3bbf9ed1105 on n-h1-836830-18 Sep 14 09:08:35.496232 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-53391361-2693-43ce-8b37-e23450d38386 req-43ac2144-cbee-4933-9fd0-9fb5db6bbea2 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062812 Sep 14 09:08:35.497272 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2154/4313] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:08:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:08:35.504637 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-6d81d4c3-a67f-4460-aa3d-46b33542ed08 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:08:35.505627 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-6d81d4c3-a67f-4460-aa3d-46b33542ed08 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] [instance: d5d94249-deeb-4715-bd69-ba27597f46ef] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:08:35.516101 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6d81d4c3-a67f-4460-aa3d-46b33542ed08 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:35.517046 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6d81d4c3-a67f-4460-aa3d-46b33542ed08 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:35.537704 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6d81d4c3-a67f-4460-aa3d-46b33542ed08 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:35.540096 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6d81d4c3-a67f-4460-aa3d-46b33542ed08 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:35.542295 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6d81d4c3-a67f-4460-aa3d-46b33542ed08 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:35.549222 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6d81d4c3-a67f-4460-aa3d-46b33542ed08 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:35.589180 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-89bf735e-0e5e-4b3a-aea9-65f959b05a44 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5165b8fc101c47c7a4370f9007bc5a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a597fc389b4805bbd3a53ecd17c5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:08:35.614390 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-89bf735e-0e5e-4b3a-aea9-65f959b05a44 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute/v2.1/servers/8032c321-1baa-44a9-b3bd-b0ce09999b9e" status: 200 len: 1264 microversion: 2.1 time: 0.246959 Sep 14 09:08:35.624300 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6d81d4c3-a67f-4460-aa3d-46b33542ed08 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:35.624794 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6d81d4c3-a67f-4460-aa3d-46b33542ed08 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:35.625226 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6d81d4c3-a67f-4460-aa3d-46b33542ed08 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:35.625677 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.objects.instance [None req-6d81d4c3-a67f-4460-aa3d-46b33542ed08 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lazy-loading 'fault' on Instance uuid d5d94249-deeb-4715-bd69-ba27597f46ef {{(pid=128758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:08:35.634008 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2160/4314] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:08:35 2022] GET /compute/v2.1/servers/8032c321-1baa-44a9-b3bd-b0ce09999b9e => generated 1264 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:08:35.739064 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-6d81d4c3-a67f-4460-aa3d-46b33542ed08 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6eab0235b041d4b1d2ffe2fae8bdd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f279926ee014c148690608fe635e3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:08:35.771090 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-6d81d4c3-a67f-4460-aa3d-46b33542ed08 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d6eab0235b041d4b1d2ffe2fae8bdd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f279926ee014c148690608fe635e3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:08:35.780171 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-6d81d4c3-a67f-4460-aa3d-46b33542ed08 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d6eab0235b041d4b1d2ffe2fae8bdd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f279926ee014c148690608fe635e3a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:08:35.783247 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-6d81d4c3-a67f-4460-aa3d-46b33542ed08 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] 10.222.0.60 "GET /compute/v2.1/servers/d5d94249-deeb-4715-bd69-ba27597f46ef" status: 200 len: 1352 microversion: 2.26 time: 0.282543 Sep 14 09:08:35.792030 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2155/4315] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:08:35 2022] GET /compute/v2.1/servers/d5d94249-deeb-4715-bd69-ba27597f46ef => generated 1352 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:08:36.393518 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-fc8c4d01-fdb6-482d-9ab8-caf5906a19a9 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:08:36.394284 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-fc8c4d01-fdb6-482d-9ab8-caf5906a19a9 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] [instance: 6957a5fb-4af4-4ca1-809a-8dd02e517c24] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:08:36.433698 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fc8c4d01-fdb6-482d-9ab8-caf5906a19a9 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:36.435109 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fc8c4d01-fdb6-482d-9ab8-caf5906a19a9 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:36.437107 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fc8c4d01-fdb6-482d-9ab8-caf5906a19a9 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:36.439162 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b6269378-adcb-459e-8bef-36c8261ce95d tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:08:36.440866 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-b6269378-adcb-459e-8bef-36c8261ce95d tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:08:36.442023 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fc8c4d01-fdb6-482d-9ab8-caf5906a19a9 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:36.442523 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fc8c4d01-fdb6-482d-9ab8-caf5906a19a9 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:36.444803 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fc8c4d01-fdb6-482d-9ab8-caf5906a19a9 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:36.456410 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b6269378-adcb-459e-8bef-36c8261ce95d tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:36.456971 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b6269378-adcb-459e-8bef-36c8261ce95d tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:36.457409 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b6269378-adcb-459e-8bef-36c8261ce95d tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:36.465738 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b6269378-adcb-459e-8bef-36c8261ce95d tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:36.466236 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b6269378-adcb-459e-8bef-36c8261ce95d tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:36.466676 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b6269378-adcb-459e-8bef-36c8261ce95d tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:37.282323 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-b6269378-adcb-459e-8bef-36c8261ce95d tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:08:37.297473 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-b6269378-adcb-459e-8bef-36c8261ce95d tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1519 microversion: 2.1 time: 0.862267 Sep 14 09:08:37.299951 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2156/4316] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:08:36 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1519 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:08:37.319421 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-c74990d8-0792-4fe1-8b0d-e654e4a64d9a req-96aac8bd-3ad8-40f7-8c91-32018063d3a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5d94249-deeb-4715-bd69-ba27597f46ef", "name": "network-vif-deleted", "tag": "527c575e-0a9d-43b1-ac5b-0e42a92d6ead"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:08:37.351495 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-c74990d8-0792-4fe1-8b0d-e654e4a64d9a req-96aac8bd-3ad8-40f7-8c91-32018063d3a5 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:37.359729 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-c74990d8-0792-4fe1-8b0d-e654e4a64d9a req-96aac8bd-3ad8-40f7-8c91-32018063d3a5 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:37.360638 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-c74990d8-0792-4fe1-8b0d-e654e4a64d9a req-96aac8bd-3ad8-40f7-8c91-32018063d3a5 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:37.369781 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=93,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=3,nova_cell1:RELEASE=1,nova_cell1:DELETE=1,nova_cell1:UPDATE=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:08:37.410320 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-c74990d8-0792-4fe1-8b0d-e654e4a64d9a req-96aac8bd-3ad8-40f7-8c91-32018063d3a5 service nova] Creating event network-vif-deleted:527c575e-0a9d-43b1-ac5b-0e42a92d6ead for instance d5d94249-deeb-4715-bd69-ba27597f46ef on n-h2-836830-18 Sep 14 09:08:37.423225 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-c74990d8-0792-4fe1-8b0d-e654e4a64d9a req-96aac8bd-3ad8-40f7-8c91-32018063d3a5 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115273 Sep 14 09:08:37.424235 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2157/4317] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:08:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:08:37.444504 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-07cd3422-8584-4795-8a18-90fb234a5d67 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:08:37.451991 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-07cd3422-8584-4795-8a18-90fb234a5d67 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] [instance: 8032c321-1baa-44a9-b3bd-b0ce09999b9e] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:08:37.493200 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-07cd3422-8584-4795-8a18-90fb234a5d67 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:37.494058 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-07cd3422-8584-4795-8a18-90fb234a5d67 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:37.494708 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-07cd3422-8584-4795-8a18-90fb234a5d67 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:37.496197 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-07cd3422-8584-4795-8a18-90fb234a5d67 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:37.496658 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-07cd3422-8584-4795-8a18-90fb234a5d67 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:37.497091 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-07cd3422-8584-4795-8a18-90fb234a5d67 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:37.834796 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-fc8c4d01-fdb6-482d-9ab8-caf5906a19a9 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932f3d4bbfd04cae8e48a937a5b10716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b713d80d5243659644e0c74c6df59c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:08:37.850775 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-fc8c4d01-fdb6-482d-9ab8-caf5906a19a9 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] 10.222.0.60 "GET /compute/v2.1/servers/6957a5fb-4af4-4ca1-809a-8dd02e517c24" status: 200 len: 1322 microversion: 2.1 time: 1.463893 Sep 14 09:08:37.850775 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2161/4318] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:08:36 2022] GET /compute/v2.1/servers/6957a5fb-4af4-4ca1-809a-8dd02e517c24 => generated 1322 bytes in 1465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:08:37.861882 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c50bb74b-dbae-47ce-a395-c8d3ab221891 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:08:37.861882 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-c50bb74b-dbae-47ce-a395-c8d3ab221891 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] [instance: d5d94249-deeb-4715-bd69-ba27597f46ef] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:08:37.875929 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c50bb74b-dbae-47ce-a395-c8d3ab221891 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:37.876430 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c50bb74b-dbae-47ce-a395-c8d3ab221891 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:37.876867 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c50bb74b-dbae-47ce-a395-c8d3ab221891 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:37.877576 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c50bb74b-dbae-47ce-a395-c8d3ab221891 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:37.878036 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c50bb74b-dbae-47ce-a395-c8d3ab221891 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:37.878462 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c50bb74b-dbae-47ce-a395-c8d3ab221891 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:37.916141 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-c50bb74b-dbae-47ce-a395-c8d3ab221891 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] HTTP exception thrown: Instance d5d94249-deeb-4715-bd69-ba27597f46ef could not be found. Sep 14 09:08:37.917986 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c50bb74b-dbae-47ce-a395-c8d3ab221891 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Request method failure captured: Sep 14 09:08:37.917986 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/d5d94249-deeb-4715-bd69-ba27597f46ef HTTP/1.1 Sep 14 09:08:37.917986 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:08:37.917986 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:08:37.917986 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:08:37.917986 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:08:37.917986 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:08:37.917986 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:08:37.917986 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:08:37.917986 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:08:37.917986 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZneE3zhJk9qdEdcHun1JgXheaqtCF8c-Ok4lQiuKO0ioHNumx9pe6VRdpTkknpm0_CeShB5pjFoT5U_51JbgyOPxDWxdYD25-43_xrgJ7kdit0DgHvEJQi88Bgc9cGF7A28LiKT2usQclFYWc75sB0rquJdL_qA66rq__boPYlV0qI Sep 14 09:08:37.917986 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:08:37.917986 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:08:37.917986 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:08:37.917986 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:08:37.917986 n-d-836830-18 devstack@n-api.service[128759]: X-Openstack-Nova-Api-Version: 2.26 Sep 14 09:08:37.917986 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:08:37.917986 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:08:37.917986 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 7f279926ee014c148690608fe635e3a2 Sep 14 09:08:37.917986 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ServerTagsTestJSON-463896614 Sep 14 09:08:37.917986 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:08:37.917986 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:08:37.917986 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/7f279926ee014c148690608fe635e3a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_7f279926ee014c148690608fe635e3a2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/7f279926ee014c148690608fe635e3a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/7f279926ee014c148690608fe635e3a2"}]}] Sep 14 09:08:37.917986 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ServerTagsTestJSON-463896614 Sep 14 09:08:37.917986 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 7f279926ee014c148690608fe635e3a2 Sep 14 09:08:37.917986 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ServerTagsTestJSON-463896614 Sep 14 09:08:37.917986 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ServerTagsTestJSON-463896614-project Sep 14 09:08:37.917986 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:08:37.917986 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:08:37.917986 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 2d6eab0235b041d4b1d2ffe2fae8bdd3 Sep 14 09:08:37.917986 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ServerTagsTestJSON-463896614-project Sep 14 09:08:37.917986 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:08:37.917986 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance d5d94249-deeb-4715-bd69-ba27597f46ef could not be found. Sep 14 09:08:37.917986 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': 'd5d94249-deeb-4715-bd69-ba27597f46ef'} Sep 14 09:08:37.917986 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:08:37.917986 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:08:37.917986 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:08:37.917986 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:08:37.917986 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:08:37.917986 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:08:37.917986 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:08:37.917986 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:08:37.917986 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:08:37.917986 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:08:37.917986 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5d94249-deeb-4715-bd69-ba27597f46ef could not be found. Sep 14 09:08:37.917986 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:08:37.917986 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:08:37.917986 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:08:37.917986 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:08:37.917986 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:08:37.917986 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:08:37.917986 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:08:37.917986 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:08:37.917986 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:08:37.917986 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:08:37.917986 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:08:37.917986 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:08:37.917986 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:08:37.917986 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:08:37.917986 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:08:37.917986 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:08:37.917986 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5d94249-deeb-4715-bd69-ba27597f46ef could not be found. Sep 14 09:08:37.917986 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:08:37.917986 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:08:37.917986 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:08:37.922378 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:08:37.922378 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:08:37.922378 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:08:37.922378 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:08:37.922378 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:08:37.922378 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5d94249-deeb-4715-bd69-ba27597f46ef could not be found. Sep 14 09:08:37.922378 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:08:37.922378 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c50bb74b-dbae-47ce-a395-c8d3ab221891 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] Returning 404 to user: Instance d5d94249-deeb-4715-bd69-ba27597f46ef could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:08:37.922378 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-c50bb74b-dbae-47ce-a395-c8d3ab221891 tempest-ServerTagsTestJSON-463896614 tempest-ServerTagsTestJSON-463896614-project] 10.222.0.60 "GET /compute/v2.1/servers/d5d94249-deeb-4715-bd69-ba27597f46ef" status: 404 len: 111 microversion: 2.26 time: 0.067800 Sep 14 09:08:37.922378 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2162/4319] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:08:37 2022] GET /compute/v2.1/servers/d5d94249-deeb-4715-bd69-ba27597f46ef => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 14 09:08:38.326771 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-52aa2561-8dea-4b5c-a56e-96345c16a5ad tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:08:38.327457 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-52aa2561-8dea-4b5c-a56e-96345c16a5ad tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:08:38.339136 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-52aa2561-8dea-4b5c-a56e-96345c16a5ad tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:38.344927 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-52aa2561-8dea-4b5c-a56e-96345c16a5ad tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:38.348196 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-52aa2561-8dea-4b5c-a56e-96345c16a5ad tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:38.349281 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-52aa2561-8dea-4b5c-a56e-96345c16a5ad tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:38.352946 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-52aa2561-8dea-4b5c-a56e-96345c16a5ad tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:38.353616 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-52aa2561-8dea-4b5c-a56e-96345c16a5ad tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:38.670380 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-07cd3422-8584-4795-8a18-90fb234a5d67 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5165b8fc101c47c7a4370f9007bc5a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a597fc389b4805bbd3a53ecd17c5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:08:38.680268 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-07cd3422-8584-4795-8a18-90fb234a5d67 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute/v2.1/servers/8032c321-1baa-44a9-b3bd-b0ce09999b9e" status: 200 len: 1306 microversion: 2.1 time: 1.251230 Sep 14 09:08:38.686096 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2158/4320] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:08:37 2022] GET /compute/v2.1/servers/8032c321-1baa-44a9-b3bd-b0ce09999b9e => generated 1306 bytes in 1258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:08:38.877345 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-8e4260db-be29-417e-87d0-a8f45f0afe90 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:08:38.878461 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-8e4260db-be29-417e-87d0-a8f45f0afe90 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] [instance: 6957a5fb-4af4-4ca1-809a-8dd02e517c24] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:08:38.893564 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8e4260db-be29-417e-87d0-a8f45f0afe90 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:38.897152 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8e4260db-be29-417e-87d0-a8f45f0afe90 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:38.897879 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8e4260db-be29-417e-87d0-a8f45f0afe90 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:38.898801 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8e4260db-be29-417e-87d0-a8f45f0afe90 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:38.899944 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8e4260db-be29-417e-87d0-a8f45f0afe90 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:38.902755 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8e4260db-be29-417e-87d0-a8f45f0afe90 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:39.023065 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-52aa2561-8dea-4b5c-a56e-96345c16a5ad tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:08:39.032820 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-52aa2561-8dea-4b5c-a56e-96345c16a5ad tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1506 microversion: 2.1 time: 0.709733 Sep 14 09:08:39.042741 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2163/4321] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:08:38 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1506 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:08:39.070271 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d71d9039-2b6b-4707-9b5d-29d805452223 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:08:39.070903 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-d71d9039-2b6b-4707-9b5d-29d805452223 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:08:39.081657 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d71d9039-2b6b-4707-9b5d-29d805452223 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:39.085586 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d71d9039-2b6b-4707-9b5d-29d805452223 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:39.086108 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d71d9039-2b6b-4707-9b5d-29d805452223 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:39.089477 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d71d9039-2b6b-4707-9b5d-29d805452223 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:39.090047 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d71d9039-2b6b-4707-9b5d-29d805452223 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:39.090498 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d71d9039-2b6b-4707-9b5d-29d805452223 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:39.481763 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=4 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:08:39.723169 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-8e4260db-be29-417e-87d0-a8f45f0afe90 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932f3d4bbfd04cae8e48a937a5b10716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b713d80d5243659644e0c74c6df59c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:08:39.737824 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-8e4260db-be29-417e-87d0-a8f45f0afe90 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] 10.222.0.60 "GET /compute/v2.1/servers/6957a5fb-4af4-4ca1-809a-8dd02e517c24" status: 200 len: 1322 microversion: 2.1 time: 0.863774 Sep 14 09:08:39.738837 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2159/4322] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:08:38 2022] GET /compute/v2.1/servers/6957a5fb-4af4-4ca1-809a-8dd02e517c24 => generated 1322 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:08:39.765139 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=16 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:08:39.765284 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-2c3a218a-afdb-4aeb-872b-f17bc5c54e84 req-0e505567-0b69-4416-ba8e-a94908ca05ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6957a5fb-4af4-4ca1-809a-8dd02e517c24", "name": "network-vif-plugged", "status": "completed", "tag": "ace61c6b-a7bc-48b0-ba9c-109092ffc122"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:08:39.816912 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-2c3a218a-afdb-4aeb-872b-f17bc5c54e84 req-0e505567-0b69-4416-ba8e-a94908ca05ec service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:39.817428 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-2c3a218a-afdb-4aeb-872b-f17bc5c54e84 req-0e505567-0b69-4416-ba8e-a94908ca05ec service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:39.817887 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-2c3a218a-afdb-4aeb-872b-f17bc5c54e84 req-0e505567-0b69-4416-ba8e-a94908ca05ec service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:39.832273 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-d71d9039-2b6b-4707-9b5d-29d805452223 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:08:39.864876 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d71d9039-2b6b-4707-9b5d-29d805452223 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1506 microversion: 2.1 time: 0.799865 Sep 14 09:08:39.865500 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2164/4323] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:08:39 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1506 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:08:39.908624 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-2c3a218a-afdb-4aeb-872b-f17bc5c54e84 req-0e505567-0b69-4416-ba8e-a94908ca05ec service nova] Creating event network-vif-plugged:ace61c6b-a7bc-48b0-ba9c-109092ffc122 for instance 6957a5fb-4af4-4ca1-809a-8dd02e517c24 on n-h2-836830-18 Sep 14 09:08:39.917455 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a83b9eba-6ce2-4569-bbfc-5363cdc2d302 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:08:39.918505 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-a83b9eba-6ce2-4569-bbfc-5363cdc2d302 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] [instance: 8032c321-1baa-44a9-b3bd-b0ce09999b9e] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:08:39.935191 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-2c3a218a-afdb-4aeb-872b-f17bc5c54e84 req-0e505567-0b69-4416-ba8e-a94908ca05ec service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.193326 Sep 14 09:08:39.935825 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2160/4324] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:08:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:08:39.945609 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a83b9eba-6ce2-4569-bbfc-5363cdc2d302 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:39.946114 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a83b9eba-6ce2-4569-bbfc-5363cdc2d302 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:39.946560 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a83b9eba-6ce2-4569-bbfc-5363cdc2d302 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:39.950490 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a83b9eba-6ce2-4569-bbfc-5363cdc2d302 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:39.951039 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a83b9eba-6ce2-4569-bbfc-5363cdc2d302 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:39.951492 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a83b9eba-6ce2-4569-bbfc-5363cdc2d302 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:39.962475 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-3e418e6a-548e-430d-a914-73b6a883b0eb tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:08:39.963247 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-3e418e6a-548e-430d-a914-73b6a883b0eb tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:08:39.985164 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3e418e6a-548e-430d-a914-73b6a883b0eb tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:39.985949 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3e418e6a-548e-430d-a914-73b6a883b0eb tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:39.991679 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3e418e6a-548e-430d-a914-73b6a883b0eb tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:39.992698 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3e418e6a-548e-430d-a914-73b6a883b0eb tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:39.993332 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3e418e6a-548e-430d-a914-73b6a883b0eb tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:39.995727 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3e418e6a-548e-430d-a914-73b6a883b0eb tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:41.022875 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-3e418e6a-548e-430d-a914-73b6a883b0eb tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:08:41.030928 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-3e418e6a-548e-430d-a914-73b6a883b0eb tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1506 microversion: 2.1 time: 1.087994 Sep 14 09:08:41.031537 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2161/4325] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:08:39 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1506 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:08:41.061511 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-a83b9eba-6ce2-4569-bbfc-5363cdc2d302 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5165b8fc101c47c7a4370f9007bc5a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a597fc389b4805bbd3a53ecd17c5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:08:41.082022 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a83b9eba-6ce2-4569-bbfc-5363cdc2d302 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute/v2.1/servers/8032c321-1baa-44a9-b3bd-b0ce09999b9e" status: 200 len: 1306 microversion: 2.1 time: 1.215321 Sep 14 09:08:41.091413 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2165/4326] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:08:39 2022] GET /compute/v2.1/servers/8032c321-1baa-44a9-b3bd-b0ce09999b9e => generated 1306 bytes in 1225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:08:41.105765 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9095b5c3-dfbd-4922-90b6-6892ff2d26b0 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:08:41.106451 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-9095b5c3-dfbd-4922-90b6-6892ff2d26b0 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] [instance: 6957a5fb-4af4-4ca1-809a-8dd02e517c24] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:08:41.130071 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:08:41.142018 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9095b5c3-dfbd-4922-90b6-6892ff2d26b0 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:41.142689 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9095b5c3-dfbd-4922-90b6-6892ff2d26b0 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:41.143445 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9095b5c3-dfbd-4922-90b6-6892ff2d26b0 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:41.144397 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9095b5c3-dfbd-4922-90b6-6892ff2d26b0 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:41.145027 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9095b5c3-dfbd-4922-90b6-6892ff2d26b0 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:41.145811 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9095b5c3-dfbd-4922-90b6-6892ff2d26b0 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:41.657279 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-7f24ba7e-f462-4156-8744-d9e5399f9299 req-f6dad8d5-9804-4824-abbd-054daca0419b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8032c321-1baa-44a9-b3bd-b0ce09999b9e", "tag": "cce2e6e9-f211-4837-a59b-5cf9a4fb29e9"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:08:41.699160 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-7f24ba7e-f462-4156-8744-d9e5399f9299 req-f6dad8d5-9804-4824-abbd-054daca0419b service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:41.708213 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-7f24ba7e-f462-4156-8744-d9e5399f9299 req-f6dad8d5-9804-4824-abbd-054daca0419b service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:41.708675 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-7f24ba7e-f462-4156-8744-d9e5399f9299 req-f6dad8d5-9804-4824-abbd-054daca0419b service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:41.761626 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-7f24ba7e-f462-4156-8744-d9e5399f9299 req-f6dad8d5-9804-4824-abbd-054daca0419b service nova] Creating event network-changed:cce2e6e9-f211-4837-a59b-5cf9a4fb29e9 for instance 8032c321-1baa-44a9-b3bd-b0ce09999b9e on n-h2-836830-18 Sep 14 09:08:41.767695 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-7f24ba7e-f462-4156-8744-d9e5399f9299 req-f6dad8d5-9804-4824-abbd-054daca0419b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.734882 Sep 14 09:08:41.768948 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2162/4327] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:08:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:08:41.778339 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-908db1e8-0581-4e5a-9a7e-56adc4c1b44b tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:08:41.785678 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-908db1e8-0581-4e5a-9a7e-56adc4c1b44b tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] HTTP exception thrown: Instance 7168b6ab-a171-48b7-87df-ac791b2f5122 has no mapping to a cell. Sep 14 09:08:41.801975 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-908db1e8-0581-4e5a-9a7e-56adc4c1b44b tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Request method failure captured: Sep 14 09:08:41.801975 n-d-836830-18 devstack@n-api.service[128758]: request: POST /compute/v2.1/servers/7168b6ab-a171-48b7-87df-ac791b2f5122/action HTTP/1.1 Sep 14 09:08:41.801975 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 09:08:41.801975 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 09:08:41.801975 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 09:08:41.801975 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 15 Sep 14 09:08:41.801975 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 09:08:41.801975 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 09:08:41.801975 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 09:08:41.801975 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 09:08:41.801975 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZk2EvHIWQyXATvY4f6phbqF3DzIIyaJjJFCE11LxTKbrsndvuk5zoyyEUR0VXx32_kFjD0I6jBROuj0ZPSHQav7u9FFvOPFGrPkf9qZrgXY9k3zAUFrOVfwLECoLZOolubyCPUAGSEOi_HvFIP_Dd_DCbUCKDEGGLtdnAzy2tLCxHs Sep 14 09:08:41.801975 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 09:08:41.801975 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 09:08:41.801975 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 09:08:41.801975 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 09:08:41.801975 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 09:08:41.801975 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 09:08:41.801975 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 6907b82c9d5c4a23a63bbeec31c3c365 Sep 14 09:08:41.801975 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-ServersNegativeTestJSON-1654813540 Sep 14 09:08:41.801975 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 09:08:41.801975 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 09:08:41.801975 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6907b82c9d5c4a23a63bbeec31c3c365"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6907b82c9d5c4a23a63bbeec31c3c365"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6907b82c9d5c4a23a63bbeec31c3c365"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6907b82c9d5c4a23a63bbeec31c3c365"}]}] Sep 14 09:08:41.801975 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-ServersNegativeTestJSON-1654813540 Sep 14 09:08:41.801975 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 6907b82c9d5c4a23a63bbeec31c3c365 Sep 14 09:08:41.801975 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1654813540 Sep 14 09:08:41.801975 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-ServersNegativeTestJSON-1654813540-project Sep 14 09:08:41.801975 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 09:08:41.801975 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 09:08:41.801975 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 79583c4e80a04f138927f09eb4e170f4 Sep 14 09:08:41.801975 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-ServersNegativeTestJSON-1654813540-project Sep 14 09:08:41.801975 n-d-836830-18 devstack@n-api.service[128758]: Sep 14 09:08:41.801975 n-d-836830-18 devstack@n-api.service[128758]: {"os-stop": {}} Sep 14 09:08:41.801975 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 09:08:41.801975 n-d-836830-18 devstack@n-api.service[128758]: exception: Instance 7168b6ab-a171-48b7-87df-ac791b2f5122 has no mapping to a cell. Sep 14 09:08:41.801975 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': '7168b6ab-a171-48b7-87df-ac791b2f5122', 'body': {'os-stop': {}}} Sep 14 09:08:41.801975 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:08:41.801975 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:08:41.801975 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1411, in _get_instance Sep 14 09:08:41.801975 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Sep 14 09:08:41.801975 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 14 09:08:41.801975 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 14 09:08:41.801975 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Sep 14 09:08:41.801975 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Sep 14 09:08:41.801975 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 14 09:08:41.801975 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 14 09:08:41.801975 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Sep 14 09:08:41.801975 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Sep 14 09:08:41.801975 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance 7168b6ab-a171-48b7-87df-ac791b2f5122 has no mapping to a cell. Sep 14 09:08:41.801975 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:08:41.801975 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:08:41.801975 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:08:41.801975 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:08:41.801975 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:08:41.801975 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:08:41.801975 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:08:41.801975 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:08:41.801975 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:08:41.801975 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:08:41.801975 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1444, in _stop_server Sep 14 09:08:41.801975 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Sep 14 09:08:41.801975 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1418, in _get_instance Sep 14 09:08:41.801975 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:08:41.801975 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7168b6ab-a171-48b7-87df-ac791b2f5122 has no mapping to a cell. Sep 14 09:08:41.805979 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:08:41.805979 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:08:41.805979 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:08:41.805979 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:08:41.805979 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:08:41.805979 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:08:41.805979 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:08:41.805979 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:08:41.805979 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7168b6ab-a171-48b7-87df-ac791b2f5122 has no mapping to a cell. Sep 14 09:08:41.805979 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:08:41.826546 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-908db1e8-0581-4e5a-9a7e-56adc4c1b44b tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Returning 404 to user: Instance 7168b6ab-a171-48b7-87df-ac791b2f5122 has no mapping to a cell. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:08:41.828988 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-908db1e8-0581-4e5a-9a7e-56adc4c1b44b tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "POST /compute/v2.1/servers/7168b6ab-a171-48b7-87df-ac791b2f5122/action" status: 404 len: 117 microversion: 2.1 time: 0.056481 Sep 14 09:08:41.829811 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2163/4328] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:08:41 2022] POST /compute/v2.1/servers/7168b6ab-a171-48b7-87df-ac791b2f5122/action => generated 117 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:08:41.842676 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-aa0ec723-6621-4b95-97b0-e9692174a3a9 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:08:41.856069 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-aa0ec723-6621-4b95-97b0-e9692174a3a9 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:08:41.881572 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-aa0ec723-6621-4b95-97b0-e9692174a3a9 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:41.882578 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-aa0ec723-6621-4b95-97b0-e9692174a3a9 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:41.883336 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-aa0ec723-6621-4b95-97b0-e9692174a3a9 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:41.886323 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-aa0ec723-6621-4b95-97b0-e9692174a3a9 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:41.887268 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-aa0ec723-6621-4b95-97b0-e9692174a3a9 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:41.892937 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-aa0ec723-6621-4b95-97b0-e9692174a3a9 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:41.967213 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-9095b5c3-dfbd-4922-90b6-6892ff2d26b0 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932f3d4bbfd04cae8e48a937a5b10716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b713d80d5243659644e0c74c6df59c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:08:41.975294 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-9095b5c3-dfbd-4922-90b6-6892ff2d26b0 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] 10.222.0.60 "GET /compute/v2.1/servers/6957a5fb-4af4-4ca1-809a-8dd02e517c24" status: 200 len: 1322 microversion: 2.1 time: 0.882446 Sep 14 09:08:41.983718 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2166/4329] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:08:41 2022] GET /compute/v2.1/servers/6957a5fb-4af4-4ca1-809a-8dd02e517c24 => generated 1322 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:08:42.113711 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-45cfd1af-99e5-4f33-9965-801fb1ece557 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:08:42.115105 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-45cfd1af-99e5-4f33-9965-801fb1ece557 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] [instance: 8032c321-1baa-44a9-b3bd-b0ce09999b9e] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:08:42.125665 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-45cfd1af-99e5-4f33-9965-801fb1ece557 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:42.127524 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-45cfd1af-99e5-4f33-9965-801fb1ece557 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:42.130040 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-45cfd1af-99e5-4f33-9965-801fb1ece557 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:42.131557 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-45cfd1af-99e5-4f33-9965-801fb1ece557 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:42.135626 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-45cfd1af-99e5-4f33-9965-801fb1ece557 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:42.136366 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-45cfd1af-99e5-4f33-9965-801fb1ece557 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:43.198640 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-aa0ec723-6621-4b95-97b0-e9692174a3a9 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:08:43.225936 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-aa0ec723-6621-4b95-97b0-e9692174a3a9 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1506 microversion: 2.1 time: 1.382991 Sep 14 09:08:43.255910 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2164/4330] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:08:41 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1506 bytes in 1415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:08:43.274775 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-7e4e9d0c-301b-41b2-a9c4-421189efb8c4 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:08:43.283744 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-7e4e9d0c-301b-41b2-a9c4-421189efb8c4 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] [instance: 6957a5fb-4af4-4ca1-809a-8dd02e517c24] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:08:43.305957 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7e4e9d0c-301b-41b2-a9c4-421189efb8c4 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:43.306520 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7e4e9d0c-301b-41b2-a9c4-421189efb8c4 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:43.306984 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7e4e9d0c-301b-41b2-a9c4-421189efb8c4 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:43.307767 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7e4e9d0c-301b-41b2-a9c4-421189efb8c4 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:43.308411 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7e4e9d0c-301b-41b2-a9c4-421189efb8c4 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:43.308997 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7e4e9d0c-301b-41b2-a9c4-421189efb8c4 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:43.853945 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-45cfd1af-99e5-4f33-9965-801fb1ece557 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5165b8fc101c47c7a4370f9007bc5a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a597fc389b4805bbd3a53ecd17c5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:08:43.899557 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-45cfd1af-99e5-4f33-9965-801fb1ece557 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute/v2.1/servers/8032c321-1baa-44a9-b3bd-b0ce09999b9e" status: 200 len: 1306 microversion: 2.1 time: 1.770434 Sep 14 09:08:43.900231 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2167/4331] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:08:42 2022] GET /compute/v2.1/servers/8032c321-1baa-44a9-b3bd-b0ce09999b9e => generated 1306 bytes in 1792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:08:43.936440 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e264a5ab-6daf-4753-9db4-a44a87770ee7 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:08:43.937074 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e264a5ab-6daf-4753-9db4-a44a87770ee7 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:08:43.974366 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e264a5ab-6daf-4753-9db4-a44a87770ee7 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:43.975271 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e264a5ab-6daf-4753-9db4-a44a87770ee7 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:43.980241 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e264a5ab-6daf-4753-9db4-a44a87770ee7 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:43.980595 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-7e4e9d0c-301b-41b2-a9c4-421189efb8c4 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932f3d4bbfd04cae8e48a937a5b10716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b713d80d5243659644e0c74c6df59c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:08:43.990270 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-7e4e9d0c-301b-41b2-a9c4-421189efb8c4 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] 10.222.0.60 "GET /compute/v2.1/servers/6957a5fb-4af4-4ca1-809a-8dd02e517c24" status: 200 len: 1516 microversion: 2.1 time: 0.733190 Sep 14 09:08:43.990820 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e264a5ab-6daf-4753-9db4-a44a87770ee7 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:43.991341 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e264a5ab-6daf-4753-9db4-a44a87770ee7 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:44.012553 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e264a5ab-6daf-4753-9db4-a44a87770ee7 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:44.012772 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2165/4332] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:08:43 2022] GET /compute/v2.1/servers/6957a5fb-4af4-4ca1-809a-8dd02e517c24 => generated 1516 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:08:44.037395 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-2c9c7a43-ddcb-491a-9a03-aa22d20c269a tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:08:44.040223 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-2c9c7a43-ddcb-491a-9a03-aa22d20c269a tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] [instance: 6957a5fb-4af4-4ca1-809a-8dd02e517c24] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:08:44.050426 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2c9c7a43-ddcb-491a-9a03-aa22d20c269a tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:44.054712 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2c9c7a43-ddcb-491a-9a03-aa22d20c269a tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:44.055773 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2c9c7a43-ddcb-491a-9a03-aa22d20c269a tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:44.060363 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2c9c7a43-ddcb-491a-9a03-aa22d20c269a tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:44.060363 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2c9c7a43-ddcb-491a-9a03-aa22d20c269a tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:44.060363 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2c9c7a43-ddcb-491a-9a03-aa22d20c269a tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:44.113597 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.objects.instance [None req-2c9c7a43-ddcb-491a-9a03-aa22d20c269a tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Lazy-loading 'flavor' on Instance uuid 6957a5fb-4af4-4ca1-809a-8dd02e517c24 {{(pid=128758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:08:44.302122 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-2c9c7a43-ddcb-491a-9a03-aa22d20c269a tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] 10.222.0.60 "POST /compute/v2.1/servers/6957a5fb-4af4-4ca1-809a-8dd02e517c24/action" status: 200 len: 32 microversion: 2.1 time: 0.268685 Sep 14 09:08:44.319892 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2166/4333] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:08:44 2022] POST /compute/v2.1/servers/6957a5fb-4af4-4ca1-809a-8dd02e517c24/action => generated 32 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 14 09:08:44.325340 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-4f26baaa-7699-4368-a398-1c944fbb1e04 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:08:44.339303 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-4f26baaa-7699-4368-a398-1c944fbb1e04 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] [instance: 6957a5fb-4af4-4ca1-809a-8dd02e517c24] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:08:44.367214 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:08:44.368888 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4f26baaa-7699-4368-a398-1c944fbb1e04 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:44.369386 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4f26baaa-7699-4368-a398-1c944fbb1e04 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:44.369857 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4f26baaa-7699-4368-a398-1c944fbb1e04 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:44.370541 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4f26baaa-7699-4368-a398-1c944fbb1e04 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:44.377781 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4f26baaa-7699-4368-a398-1c944fbb1e04 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:44.379913 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4f26baaa-7699-4368-a398-1c944fbb1e04 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:45.034381 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-4f26baaa-7699-4368-a398-1c944fbb1e04 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932f3d4bbfd04cae8e48a937a5b10716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b713d80d5243659644e0c74c6df59c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:08:45.047267 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-4f26baaa-7699-4368-a398-1c944fbb1e04 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] 10.222.0.60 "GET /compute/v2.1/servers/6957a5fb-4af4-4ca1-809a-8dd02e517c24" status: 200 len: 1522 microversion: 2.1 time: 0.725984 Sep 14 09:08:45.048021 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2167/4334] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:08:44 2022] GET /compute/v2.1/servers/6957a5fb-4af4-4ca1-809a-8dd02e517c24 => generated 1522 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:08:45.071967 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1a90c2fc-4489-49a8-abfa-052315c8c58c tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:08:45.072753 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-1a90c2fc-4489-49a8-abfa-052315c8c58c tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] [instance: 8032c321-1baa-44a9-b3bd-b0ce09999b9e] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:08:45.086842 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-e264a5ab-6daf-4753-9db4-a44a87770ee7 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:08:45.091302 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1a90c2fc-4489-49a8-abfa-052315c8c58c tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:45.091965 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1a90c2fc-4489-49a8-abfa-052315c8c58c tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:45.099829 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1a90c2fc-4489-49a8-abfa-052315c8c58c tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:45.104033 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e264a5ab-6daf-4753-9db4-a44a87770ee7 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1506 microversion: 2.1 time: 1.173692 Sep 14 09:08:45.105011 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1a90c2fc-4489-49a8-abfa-052315c8c58c tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:45.105649 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1a90c2fc-4489-49a8-abfa-052315c8c58c tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:45.106140 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1a90c2fc-4489-49a8-abfa-052315c8c58c tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:45.116923 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2168/4335] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:08:43 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1506 bytes in 1216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:08:45.135699 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-30efcbcb-f883-4a84-aefe-60ab71265381 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:08:45.136158 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-30efcbcb-f883-4a84-aefe-60ab71265381 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: fe65a06f-13f2-4822-9b28-9db17ea40259] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:08:45.150231 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-30efcbcb-f883-4a84-aefe-60ab71265381 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] HTTP exception thrown: Instance fe65a06f-13f2-4822-9b28-9db17ea40259 could not be found. Sep 14 09:08:45.157503 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-30efcbcb-f883-4a84-aefe-60ab71265381 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Request method failure captured: Sep 14 09:08:45.157503 n-d-836830-18 devstack@n-api.service[128759]: request: POST /compute/v2.1/servers/fe65a06f-13f2-4822-9b28-9db17ea40259/action HTTP/1.1 Sep 14 09:08:45.157503 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:08:45.157503 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:08:45.157503 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:08:45.157503 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 15 Sep 14 09:08:45.157503 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:08:45.157503 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:08:45.157503 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:08:45.157503 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:08:45.157503 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZk2EvHIWQyXATvY4f6phbqF3DzIIyaJjJFCE11LxTKbrsndvuk5zoyyEUR0VXx32_kFjD0I6jBROuj0ZPSHQav7u9FFvOPFGrPkf9qZrgXY9k3zAUFrOVfwLECoLZOolubyCPUAGSEOi_HvFIP_Dd_DCbUCKDEGGLtdnAzy2tLCxHs Sep 14 09:08:45.157503 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:08:45.157503 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:08:45.157503 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:08:45.157503 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:08:45.157503 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:08:45.157503 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:08:45.157503 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 6907b82c9d5c4a23a63bbeec31c3c365 Sep 14 09:08:45.157503 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ServersNegativeTestJSON-1654813540 Sep 14 09:08:45.157503 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:08:45.157503 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:08:45.157503 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6907b82c9d5c4a23a63bbeec31c3c365"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6907b82c9d5c4a23a63bbeec31c3c365"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6907b82c9d5c4a23a63bbeec31c3c365"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6907b82c9d5c4a23a63bbeec31c3c365"}]}] Sep 14 09:08:45.157503 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ServersNegativeTestJSON-1654813540 Sep 14 09:08:45.157503 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 6907b82c9d5c4a23a63bbeec31c3c365 Sep 14 09:08:45.157503 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1654813540 Sep 14 09:08:45.157503 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ServersNegativeTestJSON-1654813540-project Sep 14 09:08:45.157503 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:08:45.157503 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:08:45.157503 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 79583c4e80a04f138927f09eb4e170f4 Sep 14 09:08:45.157503 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ServersNegativeTestJSON-1654813540-project Sep 14 09:08:45.157503 n-d-836830-18 devstack@n-api.service[128759]: Sep 14 09:08:45.157503 n-d-836830-18 devstack@n-api.service[128759]: {"suspend": {}} Sep 14 09:08:45.157503 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:08:45.157503 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance fe65a06f-13f2-4822-9b28-9db17ea40259 could not be found. Sep 14 09:08:45.157503 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': 'fe65a06f-13f2-4822-9b28-9db17ea40259', 'body': {'suspend': {}}} Sep 14 09:08:45.157503 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:08:45.157503 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:08:45.157503 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:08:45.157503 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:08:45.157503 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:08:45.157503 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:08:45.157503 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 14 09:08:45.157503 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 14 09:08:45.157503 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe65a06f-13f2-4822-9b28-9db17ea40259 could not be found. Sep 14 09:08:45.157503 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:08:45.157503 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:08:45.157503 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:08:45.157503 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:08:45.157503 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:08:45.157503 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:08:45.157503 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:08:45.157503 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:08:45.157503 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:08:45.157503 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:08:45.157503 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Sep 14 09:08:45.157503 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Sep 14 09:08:45.157503 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:08:45.157503 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:08:45.157503 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe65a06f-13f2-4822-9b28-9db17ea40259 could not be found. Sep 14 09:08:45.157503 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:08:45.157503 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:08:45.157503 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:08:45.157503 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:08:45.157503 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:08:45.157503 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:08:45.161569 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:08:45.161569 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:08:45.161569 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe65a06f-13f2-4822-9b28-9db17ea40259 could not be found. Sep 14 09:08:45.161569 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:08:45.161569 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-30efcbcb-f883-4a84-aefe-60ab71265381 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Returning 404 to user: Instance fe65a06f-13f2-4822-9b28-9db17ea40259 could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:08:45.161569 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-30efcbcb-f883-4a84-aefe-60ab71265381 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "POST /compute/v2.1/servers/fe65a06f-13f2-4822-9b28-9db17ea40259/action" status: 404 len: 111 microversion: 2.1 time: 0.031076 Sep 14 09:08:45.164101 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2169/4336] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:08:45 2022] POST /compute/v2.1/servers/fe65a06f-13f2-4822-9b28-9db17ea40259/action => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:08:45.169880 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e851d27a-2955-4a1e-ba28-f5d33badc0e5 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:08:45.170874 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e851d27a-2955-4a1e-ba28-f5d33badc0e5 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:08:45.180007 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e851d27a-2955-4a1e-ba28-f5d33badc0e5 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:45.180882 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e851d27a-2955-4a1e-ba28-f5d33badc0e5 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:45.181597 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e851d27a-2955-4a1e-ba28-f5d33badc0e5 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:45.182567 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e851d27a-2955-4a1e-ba28-f5d33badc0e5 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:45.183874 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e851d27a-2955-4a1e-ba28-f5d33badc0e5 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:45.184532 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e851d27a-2955-4a1e-ba28-f5d33badc0e5 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:45.918794 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-1a90c2fc-4489-49a8-abfa-052315c8c58c tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5165b8fc101c47c7a4370f9007bc5a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a597fc389b4805bbd3a53ecd17c5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:08:45.932103 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-1a90c2fc-4489-49a8-abfa-052315c8c58c tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute/v2.1/servers/8032c321-1baa-44a9-b3bd-b0ce09999b9e" status: 200 len: 1306 microversion: 2.1 time: 0.874936 Sep 14 09:08:45.933268 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2168/4337] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:08:45 2022] GET /compute/v2.1/servers/8032c321-1baa-44a9-b3bd-b0ce09999b9e => generated 1306 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:08:46.048552 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-e851d27a-2955-4a1e-ba28-f5d33badc0e5 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:08:46.078352 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d9ef8380-2042-48ea-aae3-e759975ddb33 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:08:46.080597 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e851d27a-2955-4a1e-ba28-f5d33badc0e5 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1506 microversion: 2.1 time: 0.915110 Sep 14 09:08:46.086183 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2170/4338] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:08:45 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1506 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:08:46.088308 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-d9ef8380-2042-48ea-aae3-e759975ddb33 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] [instance: 6957a5fb-4af4-4ca1-809a-8dd02e517c24] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:08:46.109222 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d9ef8380-2042-48ea-aae3-e759975ddb33 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:46.109730 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d9ef8380-2042-48ea-aae3-e759975ddb33 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:46.110173 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d9ef8380-2042-48ea-aae3-e759975ddb33 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:46.120251 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d9ef8380-2042-48ea-aae3-e759975ddb33 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:46.121646 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d9ef8380-2042-48ea-aae3-e759975ddb33 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:46.124109 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d9ef8380-2042-48ea-aae3-e759975ddb33 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:46.124236 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a9fe613c-e1e0-4670-8007-c9b98c362c7f tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:08:46.124793 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-a9fe613c-e1e0-4670-8007-c9b98c362c7f tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:08:46.151451 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a9fe613c-e1e0-4670-8007-c9b98c362c7f tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:46.155853 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a9fe613c-e1e0-4670-8007-c9b98c362c7f tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:46.156353 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a9fe613c-e1e0-4670-8007-c9b98c362c7f tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:46.157116 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a9fe613c-e1e0-4670-8007-c9b98c362c7f tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:46.162717 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a9fe613c-e1e0-4670-8007-c9b98c362c7f tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:46.162813 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a9fe613c-e1e0-4670-8007-c9b98c362c7f tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:47.308840 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-a9fe613c-e1e0-4670-8007-c9b98c362c7f tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:08:47.321541 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a9fe613c-e1e0-4670-8007-c9b98c362c7f tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1506 microversion: 2.1 time: 1.207455 Sep 14 09:08:47.323496 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2171/4339] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:08:46 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1506 bytes in 1212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:08:47.342414 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-5966d7e6-9ac1-4c36-8952-6e104ec0d6c8 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:08:47.343265 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-5966d7e6-9ac1-4c36-8952-6e104ec0d6c8 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] [instance: 8032c321-1baa-44a9-b3bd-b0ce09999b9e] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:08:47.353640 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-d9ef8380-2042-48ea-aae3-e759975ddb33 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932f3d4bbfd04cae8e48a937a5b10716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b713d80d5243659644e0c74c6df59c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:08:47.362649 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-d9ef8380-2042-48ea-aae3-e759975ddb33 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] 10.222.0.60 "GET /compute/v2.1/servers/6957a5fb-4af4-4ca1-809a-8dd02e517c24" status: 200 len: 1522 microversion: 2.1 time: 1.290274 Sep 14 09:08:47.371594 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5966d7e6-9ac1-4c36-8952-6e104ec0d6c8 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:47.375922 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5966d7e6-9ac1-4c36-8952-6e104ec0d6c8 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:47.376351 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2169/4340] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:08:46 2022] GET /compute/v2.1/servers/6957a5fb-4af4-4ca1-809a-8dd02e517c24 => generated 1522 bytes in 1305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:08:47.378029 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5966d7e6-9ac1-4c36-8952-6e104ec0d6c8 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:47.384040 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5966d7e6-9ac1-4c36-8952-6e104ec0d6c8 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:47.384656 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5966d7e6-9ac1-4c36-8952-6e104ec0d6c8 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:47.385380 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5966d7e6-9ac1-4c36-8952-6e104ec0d6c8 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:47.397401 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-cb7096be-a20b-4253-944e-b3aff2cd3ece tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:08:47.398790 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-cb7096be-a20b-4253-944e-b3aff2cd3ece tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:08:47.433355 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cb7096be-a20b-4253-944e-b3aff2cd3ece tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:47.434346 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cb7096be-a20b-4253-944e-b3aff2cd3ece tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:47.436388 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cb7096be-a20b-4253-944e-b3aff2cd3ece tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:47.441811 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cb7096be-a20b-4253-944e-b3aff2cd3ece tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:47.442582 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cb7096be-a20b-4253-944e-b3aff2cd3ece tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:47.444791 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cb7096be-a20b-4253-944e-b3aff2cd3ece tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:47.479634 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.objects.instance [None req-cb7096be-a20b-4253-944e-b3aff2cd3ece tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lazy-loading 'flavor' on Instance uuid ae344b98-a354-4df8-83ba-3c5a786694f4 {{(pid=128758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:08:47.511135 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=100 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:08:47.689325 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-cb7096be-a20b-4253-944e-b3aff2cd3ece tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "POST /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4/action" status: 202 len: 0 microversion: 2.1 time: 0.309206 Sep 14 09:08:47.698457 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2170/4341] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:08:47 2022] POST /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4/action => generated 0 bytes in 319 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:08:47.718866 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-47a363da-5a31-4a39-8627-4a945789d3fc tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:08:47.728907 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-47a363da-5a31-4a39-8627-4a945789d3fc tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:08:47.751436 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-47a363da-5a31-4a39-8627-4a945789d3fc tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:47.759025 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-47a363da-5a31-4a39-8627-4a945789d3fc tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:47.759839 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-47a363da-5a31-4a39-8627-4a945789d3fc tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:47.782206 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-47a363da-5a31-4a39-8627-4a945789d3fc tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:47.787692 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-47a363da-5a31-4a39-8627-4a945789d3fc tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:47.788452 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-47a363da-5a31-4a39-8627-4a945789d3fc tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:48.416959 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-5966d7e6-9ac1-4c36-8952-6e104ec0d6c8 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5165b8fc101c47c7a4370f9007bc5a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a597fc389b4805bbd3a53ecd17c5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:08:48.431330 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-5966d7e6-9ac1-4c36-8952-6e104ec0d6c8 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute/v2.1/servers/8032c321-1baa-44a9-b3bd-b0ce09999b9e" status: 200 len: 1306 microversion: 2.1 time: 1.106508 Sep 14 09:08:48.442287 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2172/4342] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:08:47 2022] GET /compute/v2.1/servers/8032c321-1baa-44a9-b3bd-b0ce09999b9e => generated 1306 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:08:48.459656 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-5f00975f-ee43-4c73-80ca-de3c39e19678 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:08:48.467850 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-5f00975f-ee43-4c73-80ca-de3c39e19678 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] [instance: 6957a5fb-4af4-4ca1-809a-8dd02e517c24] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:08:48.492800 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5f00975f-ee43-4c73-80ca-de3c39e19678 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:48.497749 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5f00975f-ee43-4c73-80ca-de3c39e19678 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:48.498615 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5f00975f-ee43-4c73-80ca-de3c39e19678 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:48.499653 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5f00975f-ee43-4c73-80ca-de3c39e19678 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:48.500345 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5f00975f-ee43-4c73-80ca-de3c39e19678 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:48.502532 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5f00975f-ee43-4c73-80ca-de3c39e19678 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:48.876483 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-47a363da-5a31-4a39-8627-4a945789d3fc tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:08:48.885122 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-47a363da-5a31-4a39-8627-4a945789d3fc tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1514 microversion: 2.1 time: 1.183925 Sep 14 09:08:48.885714 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2171/4343] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:08:47 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1514 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:08:49.157596 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-5f00975f-ee43-4c73-80ca-de3c39e19678 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932f3d4bbfd04cae8e48a937a5b10716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b713d80d5243659644e0c74c6df59c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:08:49.166312 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-5f00975f-ee43-4c73-80ca-de3c39e19678 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] 10.222.0.60 "GET /compute/v2.1/servers/6957a5fb-4af4-4ca1-809a-8dd02e517c24" status: 200 len: 1522 microversion: 2.1 time: 0.722129 Sep 14 09:08:49.166909 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2173/4344] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:08:48 2022] GET /compute/v2.1/servers/6957a5fb-4af4-4ca1-809a-8dd02e517c24 => generated 1522 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:08:49.468563 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d7b6643a-4afd-46dc-8465-0cdcbb82b3b5 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:08:49.469194 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-d7b6643a-4afd-46dc-8465-0cdcbb82b3b5 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] [instance: 8032c321-1baa-44a9-b3bd-b0ce09999b9e] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:08:49.491782 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d7b6643a-4afd-46dc-8465-0cdcbb82b3b5 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:49.492791 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d7b6643a-4afd-46dc-8465-0cdcbb82b3b5 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:49.495151 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d7b6643a-4afd-46dc-8465-0cdcbb82b3b5 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:49.498574 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d7b6643a-4afd-46dc-8465-0cdcbb82b3b5 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:49.499343 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d7b6643a-4afd-46dc-8465-0cdcbb82b3b5 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:49.500013 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d7b6643a-4afd-46dc-8465-0cdcbb82b3b5 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:49.914120 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-758ef321-f5fc-4e00-8f28-e000f07f15c5 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:08:49.916737 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-758ef321-f5fc-4e00-8f28-e000f07f15c5 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:08:49.951510 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-758ef321-f5fc-4e00-8f28-e000f07f15c5 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:49.954756 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-758ef321-f5fc-4e00-8f28-e000f07f15c5 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:49.955571 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-758ef321-f5fc-4e00-8f28-e000f07f15c5 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:49.957110 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-758ef321-f5fc-4e00-8f28-e000f07f15c5 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:49.961831 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-758ef321-f5fc-4e00-8f28-e000f07f15c5 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:49.962682 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-758ef321-f5fc-4e00-8f28-e000f07f15c5 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:50.173890 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-d7b6643a-4afd-46dc-8465-0cdcbb82b3b5 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5165b8fc101c47c7a4370f9007bc5a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a597fc389b4805bbd3a53ecd17c5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:08:50.189650 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-d7b6643a-4afd-46dc-8465-0cdcbb82b3b5 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute/v2.1/servers/8032c321-1baa-44a9-b3bd-b0ce09999b9e" status: 200 len: 1306 microversion: 2.1 time: 0.724861 Sep 14 09:08:50.190262 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2172/4345] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:08:49 2022] GET /compute/v2.1/servers/8032c321-1baa-44a9-b3bd-b0ce09999b9e => generated 1306 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:08:50.200784 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-0b934136-c9fe-4eb1-a6a5-1836cef431c7 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:08:50.201642 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-0b934136-c9fe-4eb1-a6a5-1836cef431c7 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] [instance: 6957a5fb-4af4-4ca1-809a-8dd02e517c24] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:08:50.222553 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0b934136-c9fe-4eb1-a6a5-1836cef431c7 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:50.231305 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0b934136-c9fe-4eb1-a6a5-1836cef431c7 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:50.232611 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0b934136-c9fe-4eb1-a6a5-1836cef431c7 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:50.232611 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0b934136-c9fe-4eb1-a6a5-1836cef431c7 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:50.232818 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0b934136-c9fe-4eb1-a6a5-1836cef431c7 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:50.233205 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0b934136-c9fe-4eb1-a6a5-1836cef431c7 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:50.324289 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:08:50.385542 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-758ef321-f5fc-4e00-8f28-e000f07f15c5 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:08:50.398357 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-758ef321-f5fc-4e00-8f28-e000f07f15c5 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1497 microversion: 2.1 time: 0.489118 Sep 14 09:08:50.402223 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2174/4346] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:08:49 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1497 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:08:50.431498 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-bb11b12e-994c-4942-b37d-d7f6cb532a3c tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:08:50.432482 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-bb11b12e-994c-4942-b37d-d7f6cb532a3c tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:08:50.452944 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bb11b12e-994c-4942-b37d-d7f6cb532a3c tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:50.452944 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bb11b12e-994c-4942-b37d-d7f6cb532a3c tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:50.453333 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bb11b12e-994c-4942-b37d-d7f6cb532a3c tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:50.454050 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bb11b12e-994c-4942-b37d-d7f6cb532a3c tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:50.463208 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bb11b12e-994c-4942-b37d-d7f6cb532a3c tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:50.465194 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bb11b12e-994c-4942-b37d-d7f6cb532a3c tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:50.525083 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.objects.instance [None req-bb11b12e-994c-4942-b37d-d7f6cb532a3c tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lazy-loading 'flavor' on Instance uuid ae344b98-a354-4df8-83ba-3c5a786694f4 {{(pid=128759) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:08:50.591988 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-bb11b12e-994c-4942-b37d-d7f6cb532a3c tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] HTTP exception thrown: Cannot 'suspend' instance ae344b98-a354-4df8-83ba-3c5a786694f4 while it is in vm_state suspended Sep 14 09:08:50.599534 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-bb11b12e-994c-4942-b37d-d7f6cb532a3c tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Request method failure captured: Sep 14 09:08:50.599534 n-d-836830-18 devstack@n-api.service[128759]: request: POST /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4/action HTTP/1.1 Sep 14 09:08:50.599534 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:08:50.599534 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:08:50.599534 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:08:50.599534 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 15 Sep 14 09:08:50.599534 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:08:50.599534 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:08:50.599534 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:08:50.599534 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:08:50.599534 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZk2EvHIWQyXATvY4f6phbqF3DzIIyaJjJFCE11LxTKbrsndvuk5zoyyEUR0VXx32_kFjD0I6jBROuj0ZPSHQav7u9FFvOPFGrPkf9qZrgXY9k3zAUFrOVfwLECoLZOolubyCPUAGSEOi_HvFIP_Dd_DCbUCKDEGGLtdnAzy2tLCxHs Sep 14 09:08:50.599534 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:08:50.599534 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:08:50.599534 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:08:50.599534 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:08:50.599534 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:08:50.599534 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:08:50.599534 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 6907b82c9d5c4a23a63bbeec31c3c365 Sep 14 09:08:50.599534 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ServersNegativeTestJSON-1654813540 Sep 14 09:08:50.599534 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:08:50.599534 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:08:50.599534 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6907b82c9d5c4a23a63bbeec31c3c365"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6907b82c9d5c4a23a63bbeec31c3c365"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6907b82c9d5c4a23a63bbeec31c3c365"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6907b82c9d5c4a23a63bbeec31c3c365"}]}] Sep 14 09:08:50.599534 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ServersNegativeTestJSON-1654813540 Sep 14 09:08:50.599534 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 6907b82c9d5c4a23a63bbeec31c3c365 Sep 14 09:08:50.599534 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1654813540 Sep 14 09:08:50.599534 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ServersNegativeTestJSON-1654813540-project Sep 14 09:08:50.599534 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:08:50.599534 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:08:50.599534 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 79583c4e80a04f138927f09eb4e170f4 Sep 14 09:08:50.599534 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ServersNegativeTestJSON-1654813540-project Sep 14 09:08:50.599534 n-d-836830-18 devstack@n-api.service[128759]: Sep 14 09:08:50.599534 n-d-836830-18 devstack@n-api.service[128759]: {"suspend": {}} Sep 14 09:08:50.599534 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:08:50.599534 n-d-836830-18 devstack@n-api.service[128759]: exception: Cannot 'suspend' instance ae344b98-a354-4df8-83ba-3c5a786694f4 while it is in vm_state suspended Sep 14 09:08:50.599534 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': 'ae344b98-a354-4df8-83ba-3c5a786694f4', 'body': {'suspend': {}}} Sep 14 09:08:50.599534 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:08:50.599534 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:08:50.599534 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Sep 14 09:08:50.599534 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Sep 14 09:08:50.599534 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 14 09:08:50.599534 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 14 09:08:50.599534 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Sep 14 09:08:50.599534 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 14 09:08:50.599534 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 14 09:08:50.599534 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 14 09:08:50.599534 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Sep 14 09:08:50.599534 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 14 09:08:50.599534 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 14 09:08:50.599534 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 14 09:08:50.599534 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 14 09:08:50.599534 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 14 09:08:50.599534 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ae344b98-a354-4df8-83ba-3c5a786694f4 in vm_state suspended. Cannot suspend while the instance is in this state. Sep 14 09:08:50.599534 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:08:50.599534 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:08:50.599534 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:08:50.599534 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:08:50.599534 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:08:50.599534 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:08:50.599534 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:08:50.599534 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:08:50.599534 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:08:50.599534 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:08:50.599534 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Sep 14 09:08:50.599534 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 14 09:08:50.603637 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 14 09:08:50.603637 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 14 09:08:50.603637 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance ae344b98-a354-4df8-83ba-3c5a786694f4 while it is in vm_state suspended Sep 14 09:08:50.603637 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:08:50.603637 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:08:50.603637 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:08:50.603637 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:08:50.603637 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:08:50.603637 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:08:50.603637 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:08:50.603637 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:08:50.603637 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance ae344b98-a354-4df8-83ba-3c5a786694f4 while it is in vm_state suspended Sep 14 09:08:50.603637 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:08:50.607172 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-bb11b12e-994c-4942-b37d-d7f6cb532a3c tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Returning 409 to user: Cannot 'suspend' instance ae344b98-a354-4df8-83ba-3c5a786694f4 while it is in vm_state suspended {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:08:50.614597 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-bb11b12e-994c-4942-b37d-d7f6cb532a3c tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "POST /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4/action" status: 409 len: 148 microversion: 2.1 time: 0.187233 Sep 14 09:08:50.618599 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2175/4347] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:08:50 2022] POST /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4/action => generated 148 bytes in 193 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 14 09:08:50.630156 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-1a09ea59-84de-4f8a-a1d4-a4f37359f19c tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:08:50.646600 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-1a09ea59-84de-4f8a-a1d4-a4f37359f19c tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:08:50.667647 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1a09ea59-84de-4f8a-a1d4-a4f37359f19c tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:50.669452 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1a09ea59-84de-4f8a-a1d4-a4f37359f19c tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:50.672208 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1a09ea59-84de-4f8a-a1d4-a4f37359f19c tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:50.673392 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1a09ea59-84de-4f8a-a1d4-a4f37359f19c tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:50.674070 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1a09ea59-84de-4f8a-a1d4-a4f37359f19c tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:50.685785 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1a09ea59-84de-4f8a-a1d4-a4f37359f19c tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:50.849434 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-0b934136-c9fe-4eb1-a6a5-1836cef431c7 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932f3d4bbfd04cae8e48a937a5b10716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b713d80d5243659644e0c74c6df59c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:08:50.857753 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-1a09ea59-84de-4f8a-a1d4-a4f37359f19c tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "POST /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4/action" status: 202 len: 0 microversion: 2.1 time: 0.235672 Sep 14 09:08:50.859116 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2176/4348] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:08:50 2022] POST /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4/action => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:08:50.868592 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-0b934136-c9fe-4eb1-a6a5-1836cef431c7 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] 10.222.0.60 "GET /compute/v2.1/servers/6957a5fb-4af4-4ca1-809a-8dd02e517c24" status: 200 len: 1522 microversion: 2.1 time: 0.671547 Sep 14 09:08:50.887969 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2173/4349] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:08:50 2022] GET /compute/v2.1/servers/6957a5fb-4af4-4ca1-809a-8dd02e517c24 => generated 1522 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:08:50.911635 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-2ecc6116-4763-4a0d-88d4-79b4caf65566 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:08:50.912369 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-2ecc6116-4763-4a0d-88d4-79b4caf65566 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:08:50.939242 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2ecc6116-4763-4a0d-88d4-79b4caf65566 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:50.939783 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2ecc6116-4763-4a0d-88d4-79b4caf65566 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:50.940240 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2ecc6116-4763-4a0d-88d4-79b4caf65566 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:50.941853 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2ecc6116-4763-4a0d-88d4-79b4caf65566 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:50.943838 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2ecc6116-4763-4a0d-88d4-79b4caf65566 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:50.945016 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2ecc6116-4763-4a0d-88d4-79b4caf65566 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:51.036610 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9fdfc392-020b-4600-a875-334a85c14e92 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Action: 'create', calling method: .version_select at 0x7f7d3eebf550>, body: {"keypair": {"name": "tempest-keypair-1144299381", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC1Ztve+QhM9Gn3xrchTimjGO9tuvqPM+anhIcT4wIFh1Rxjjg1+FtcPt5uxF/JK2bbz9+35Fx3qZPCPzu5yfTaPEJfwUHaLkF5L+p3rngJKvknYzUHcA6QA8HaVVgt/Sw=="}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:08:51.108203 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-9fdfc392-020b-4600-a875-334a85c14e92 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Getting quotas for project 9c0762ad3f774829b58669b312dd13f7. Resources: {'key_pairs'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:08:51.161102 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-9fdfc392-020b-4600-a875-334a85c14e92 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Getting quotas for user 78051740ae354035b119d5d8ebe226f1 and project 9c0762ad3f774829b58669b312dd13f7. Resources: {'key_pairs'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:08:51.228658 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-9fdfc392-020b-4600-a875-334a85c14e92 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.367098 Sep 14 09:08:51.236030 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2177/4350] 10.222.0.60 () {62 vars in 1200 bytes} [Wed Sep 14 09:08:50 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 376 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 14 09:08:51.241515 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-84b656a8-5e3e-438c-b070-98f76722e4fa tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:08:51.244881 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-84b656a8-5e3e-438c-b070-98f76722e4fa tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] [instance: 8032c321-1baa-44a9-b3bd-b0ce09999b9e] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:08:51.259237 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-84b656a8-5e3e-438c-b070-98f76722e4fa tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:51.266311 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-84b656a8-5e3e-438c-b070-98f76722e4fa tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:51.266961 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-84b656a8-5e3e-438c-b070-98f76722e4fa tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:51.267773 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-84b656a8-5e3e-438c-b070-98f76722e4fa tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:51.268262 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-84b656a8-5e3e-438c-b070-98f76722e4fa tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:51.268700 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-84b656a8-5e3e-438c-b070-98f76722e4fa tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:51.984071 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-2ecc6116-4763-4a0d-88d4-79b4caf65566 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:08:52.005070 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-2ecc6116-4763-4a0d-88d4-79b4caf65566 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1503 microversion: 2.1 time: 1.113822 Sep 14 09:08:52.006399 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2174/4351] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:08:50 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1503 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:08:52.033919 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-e4473084-4031-42d6-9b84-ce9488b0e490 req-1a893377-d073-4b3b-8876-75b3d01d4c40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8032c321-1baa-44a9-b3bd-b0ce09999b9e", "name": "network-vif-plugged", "status": "completed", "tag": "cce2e6e9-f211-4837-a59b-5cf9a4fb29e9"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:08:52.063972 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-e4473084-4031-42d6-9b84-ce9488b0e490 req-1a893377-d073-4b3b-8876-75b3d01d4c40 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:52.072927 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-e4473084-4031-42d6-9b84-ce9488b0e490 req-1a893377-d073-4b3b-8876-75b3d01d4c40 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:52.076321 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-e4473084-4031-42d6-9b84-ce9488b0e490 req-1a893377-d073-4b3b-8876-75b3d01d4c40 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:52.109946 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-e4473084-4031-42d6-9b84-ce9488b0e490 req-1a893377-d073-4b3b-8876-75b3d01d4c40 service nova] Creating event network-vif-plugged:cce2e6e9-f211-4837-a59b-5cf9a4fb29e9 for instance 8032c321-1baa-44a9-b3bd-b0ce09999b9e on n-h2-836830-18 Sep 14 09:08:52.126792 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-e4473084-4031-42d6-9b84-ce9488b0e490 req-1a893377-d073-4b3b-8876-75b3d01d4c40 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118777 Sep 14 09:08:52.130420 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2175/4352] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:08:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:08:52.170266 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-0cd14751-4b6d-4faa-8918-487ecf684dd0 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:08:52.173411 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-0cd14751-4b6d-4faa-8918-487ecf684dd0 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] [instance: 6957a5fb-4af4-4ca1-809a-8dd02e517c24] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:08:52.177391 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-84b656a8-5e3e-438c-b070-98f76722e4fa tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5165b8fc101c47c7a4370f9007bc5a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a597fc389b4805bbd3a53ecd17c5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:08:52.187415 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-84b656a8-5e3e-438c-b070-98f76722e4fa tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute/v2.1/servers/8032c321-1baa-44a9-b3bd-b0ce09999b9e" status: 200 len: 1306 microversion: 2.1 time: 0.950153 Sep 14 09:08:52.200153 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0cd14751-4b6d-4faa-8918-487ecf684dd0 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:52.200909 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0cd14751-4b6d-4faa-8918-487ecf684dd0 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:52.201810 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0cd14751-4b6d-4faa-8918-487ecf684dd0 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:52.205278 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0cd14751-4b6d-4faa-8918-487ecf684dd0 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:52.205422 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2178/4353] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:08:51 2022] GET /compute/v2.1/servers/8032c321-1baa-44a9-b3bd-b0ce09999b9e => generated 1306 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:08:52.206581 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0cd14751-4b6d-4faa-8918-487ecf684dd0 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:52.207162 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0cd14751-4b6d-4faa-8918-487ecf684dd0 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:53.028965 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-0a0f56a8-f3e0-4a27-aaeb-b08e8a5c115d tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:08:53.029586 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-0a0f56a8-f3e0-4a27-aaeb-b08e8a5c115d tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:08:53.038005 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0a0f56a8-f3e0-4a27-aaeb-b08e8a5c115d tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:53.038501 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0a0f56a8-f3e0-4a27-aaeb-b08e8a5c115d tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:53.038995 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0a0f56a8-f3e0-4a27-aaeb-b08e8a5c115d tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:53.039672 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0a0f56a8-f3e0-4a27-aaeb-b08e8a5c115d tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:53.040133 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0a0f56a8-f3e0-4a27-aaeb-b08e8a5c115d tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:53.040561 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0a0f56a8-f3e0-4a27-aaeb-b08e8a5c115d tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:53.617354 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-0cd14751-4b6d-4faa-8918-487ecf684dd0 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932f3d4bbfd04cae8e48a937a5b10716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b713d80d5243659644e0c74c6df59c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:08:53.630092 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-0cd14751-4b6d-4faa-8918-487ecf684dd0 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] 10.222.0.60 "GET /compute/v2.1/servers/6957a5fb-4af4-4ca1-809a-8dd02e517c24" status: 200 len: 1522 microversion: 2.1 time: 1.498039 Sep 14 09:08:53.633599 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2176/4354] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:08:52 2022] GET /compute/v2.1/servers/6957a5fb-4af4-4ca1-809a-8dd02e517c24 => generated 1522 bytes in 1502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:08:53.645073 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a8643a0c-442a-4b1f-9870-74b3fa4ca2f6 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:08:53.652381 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-a8643a0c-442a-4b1f-9870-74b3fa4ca2f6 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] [instance: 8032c321-1baa-44a9-b3bd-b0ce09999b9e] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:08:53.663225 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a8643a0c-442a-4b1f-9870-74b3fa4ca2f6 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:53.669151 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a8643a0c-442a-4b1f-9870-74b3fa4ca2f6 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:53.669797 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a8643a0c-442a-4b1f-9870-74b3fa4ca2f6 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:53.670711 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a8643a0c-442a-4b1f-9870-74b3fa4ca2f6 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:53.671375 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a8643a0c-442a-4b1f-9870-74b3fa4ca2f6 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:53.671975 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a8643a0c-442a-4b1f-9870-74b3fa4ca2f6 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:53.687960 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-0a0f56a8-f3e0-4a27-aaeb-b08e8a5c115d tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:08:53.697094 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-0a0f56a8-f3e0-4a27-aaeb-b08e8a5c115d tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1503 microversion: 2.1 time: 0.671947 Sep 14 09:08:53.703728 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2179/4355] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:08:53 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1503 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:08:54.136881 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-a8643a0c-442a-4b1f-9870-74b3fa4ca2f6 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5165b8fc101c47c7a4370f9007bc5a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a597fc389b4805bbd3a53ecd17c5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:08:54.171700 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-a8643a0c-442a-4b1f-9870-74b3fa4ca2f6 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute/v2.1/servers/8032c321-1baa-44a9-b3bd-b0ce09999b9e" status: 200 len: 1306 microversion: 2.1 time: 0.536424 Sep 14 09:08:54.177643 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2177/4356] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:08:53 2022] GET /compute/v2.1/servers/8032c321-1baa-44a9-b3bd-b0ce09999b9e => generated 1306 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:08:54.652748 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-303bf10b-1344-4aa6-9cfe-4da4cafedabe tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:08:54.654323 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-303bf10b-1344-4aa6-9cfe-4da4cafedabe tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] [instance: 6957a5fb-4af4-4ca1-809a-8dd02e517c24] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:08:54.663900 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-303bf10b-1344-4aa6-9cfe-4da4cafedabe tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:54.676272 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-303bf10b-1344-4aa6-9cfe-4da4cafedabe tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:54.677133 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-303bf10b-1344-4aa6-9cfe-4da4cafedabe tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:54.678149 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-303bf10b-1344-4aa6-9cfe-4da4cafedabe tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:54.678861 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-303bf10b-1344-4aa6-9cfe-4da4cafedabe tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:54.687308 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-303bf10b-1344-4aa6-9cfe-4da4cafedabe tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:54.736593 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-8ccd7370-efc7-46fb-a7e7-e29c54826b95 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:08:54.737228 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-8ccd7370-efc7-46fb-a7e7-e29c54826b95 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:08:54.785061 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8ccd7370-efc7-46fb-a7e7-e29c54826b95 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:54.796548 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8ccd7370-efc7-46fb-a7e7-e29c54826b95 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:54.799162 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8ccd7370-efc7-46fb-a7e7-e29c54826b95 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:54.803165 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8ccd7370-efc7-46fb-a7e7-e29c54826b95 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:54.809428 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8ccd7370-efc7-46fb-a7e7-e29c54826b95 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:54.811284 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8ccd7370-efc7-46fb-a7e7-e29c54826b95 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:55.905297 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-303bf10b-1344-4aa6-9cfe-4da4cafedabe tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932f3d4bbfd04cae8e48a937a5b10716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b713d80d5243659644e0c74c6df59c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:08:55.918336 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-303bf10b-1344-4aa6-9cfe-4da4cafedabe tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] 10.222.0.60 "GET /compute/v2.1/servers/6957a5fb-4af4-4ca1-809a-8dd02e517c24" status: 200 len: 1522 microversion: 2.1 time: 1.269519 Sep 14 09:08:55.919064 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2180/4357] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:08:54 2022] GET /compute/v2.1/servers/6957a5fb-4af4-4ca1-809a-8dd02e517c24 => generated 1522 bytes in 1271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:08:55.934695 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-8ccd7370-efc7-46fb-a7e7-e29c54826b95 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:08:55.951274 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-1d570094-1660-4c90-90d3-ef039e13dc31 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:08:55.951684 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-1d570094-1660-4c90-90d3-ef039e13dc31 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] [instance: 8032c321-1baa-44a9-b3bd-b0ce09999b9e] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:08:55.965115 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-8ccd7370-efc7-46fb-a7e7-e29c54826b95 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1506 microversion: 2.1 time: 1.242284 Sep 14 09:08:55.971285 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2178/4358] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:08:54 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1506 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:08:55.975275 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1d570094-1660-4c90-90d3-ef039e13dc31 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:55.976240 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1d570094-1660-4c90-90d3-ef039e13dc31 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:55.978800 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1d570094-1660-4c90-90d3-ef039e13dc31 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:55.980885 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1d570094-1660-4c90-90d3-ef039e13dc31 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:55.981483 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1d570094-1660-4c90-90d3-ef039e13dc31 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:55.990063 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-f885dcd2-3b01-42d5-bb06-8a555f76c3c6 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:08:55.990707 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-f885dcd2-3b01-42d5-bb06-8a555f76c3c6 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:08:55.997056 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1d570094-1660-4c90-90d3-ef039e13dc31 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:56.005933 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f885dcd2-3b01-42d5-bb06-8a555f76c3c6 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:56.006433 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f885dcd2-3b01-42d5-bb06-8a555f76c3c6 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:56.006882 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f885dcd2-3b01-42d5-bb06-8a555f76c3c6 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:56.013407 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f885dcd2-3b01-42d5-bb06-8a555f76c3c6 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:56.013921 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f885dcd2-3b01-42d5-bb06-8a555f76c3c6 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:56.014374 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f885dcd2-3b01-42d5-bb06-8a555f76c3c6 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:56.671619 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-1d570094-1660-4c90-90d3-ef039e13dc31 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5165b8fc101c47c7a4370f9007bc5a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a597fc389b4805bbd3a53ecd17c5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:08:56.687165 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-f885dcd2-3b01-42d5-bb06-8a555f76c3c6 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:08:56.689032 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-1d570094-1660-4c90-90d3-ef039e13dc31 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute/v2.1/servers/8032c321-1baa-44a9-b3bd-b0ce09999b9e" status: 200 len: 1485 microversion: 2.1 time: 0.768879 Sep 14 09:08:56.690147 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2181/4359] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:08:55 2022] GET /compute/v2.1/servers/8032c321-1baa-44a9-b3bd-b0ce09999b9e => generated 1485 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:08:56.699795 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-f885dcd2-3b01-42d5-bb06-8a555f76c3c6 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1506 microversion: 2.1 time: 0.714520 Sep 14 09:08:56.727210 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2179/4360] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:08:55 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1506 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:08:56.732979 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-6c126604-e78a-4a7e-b1ed-3bbefe9dc8bd tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-552756749"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:08:56.738908 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-6c126604-e78a-4a7e-b1ed-3bbefe9dc8bd tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] [instance: 8032c321-1baa-44a9-b3bd-b0ce09999b9e] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:08:56.746071 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-87bde954-4183-4bfb-93c6-7998ba0ca04e tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:08:56.746630 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-87bde954-4183-4bfb-93c6-7998ba0ca04e tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: 2283ddcf-11c0-4ffd-8053-32252df7d7f1] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:08:56.766912 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6c126604-e78a-4a7e-b1ed-3bbefe9dc8bd tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:56.767458 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6c126604-e78a-4a7e-b1ed-3bbefe9dc8bd tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:56.767773 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-87bde954-4183-4bfb-93c6-7998ba0ca04e tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] HTTP exception thrown: Instance 2283ddcf-11c0-4ffd-8053-32252df7d7f1 could not be found. Sep 14 09:08:56.772250 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6c126604-e78a-4a7e-b1ed-3bbefe9dc8bd tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:56.773025 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6c126604-e78a-4a7e-b1ed-3bbefe9dc8bd tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:56.773500 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6c126604-e78a-4a7e-b1ed-3bbefe9dc8bd tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:56.773979 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-87bde954-4183-4bfb-93c6-7998ba0ca04e tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Request method failure captured: Sep 14 09:08:56.773979 n-d-836830-18 devstack@n-api.service[128758]: request: POST /compute/v2.1/servers/2283ddcf-11c0-4ffd-8053-32252df7d7f1/action HTTP/1.1 Sep 14 09:08:56.773979 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 09:08:56.773979 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 09:08:56.773979 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 09:08:56.773979 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 15 Sep 14 09:08:56.773979 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 09:08:56.773979 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 09:08:56.773979 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 09:08:56.773979 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 09:08:56.773979 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZk2EvHIWQyXATvY4f6phbqF3DzIIyaJjJFCE11LxTKbrsndvuk5zoyyEUR0VXx32_kFjD0I6jBROuj0ZPSHQav7u9FFvOPFGrPkf9qZrgXY9k3zAUFrOVfwLECoLZOolubyCPUAGSEOi_HvFIP_Dd_DCbUCKDEGGLtdnAzy2tLCxHs Sep 14 09:08:56.773979 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 09:08:56.773979 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 09:08:56.773979 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 09:08:56.773979 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 09:08:56.773979 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 09:08:56.773979 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 09:08:56.773979 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 6907b82c9d5c4a23a63bbeec31c3c365 Sep 14 09:08:56.773979 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-ServersNegativeTestJSON-1654813540 Sep 14 09:08:56.773979 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 09:08:56.773979 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 09:08:56.773979 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6907b82c9d5c4a23a63bbeec31c3c365"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6907b82c9d5c4a23a63bbeec31c3c365"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6907b82c9d5c4a23a63bbeec31c3c365"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6907b82c9d5c4a23a63bbeec31c3c365"}]}] Sep 14 09:08:56.773979 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-ServersNegativeTestJSON-1654813540 Sep 14 09:08:56.773979 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 6907b82c9d5c4a23a63bbeec31c3c365 Sep 14 09:08:56.773979 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1654813540 Sep 14 09:08:56.773979 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-ServersNegativeTestJSON-1654813540-project Sep 14 09:08:56.773979 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 09:08:56.773979 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 09:08:56.773979 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 79583c4e80a04f138927f09eb4e170f4 Sep 14 09:08:56.773979 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-ServersNegativeTestJSON-1654813540-project Sep 14 09:08:56.773979 n-d-836830-18 devstack@n-api.service[128758]: Sep 14 09:08:56.773979 n-d-836830-18 devstack@n-api.service[128758]: {"unpause": {}} Sep 14 09:08:56.773979 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 09:08:56.773979 n-d-836830-18 devstack@n-api.service[128758]: exception: Instance 2283ddcf-11c0-4ffd-8053-32252df7d7f1 could not be found. Sep 14 09:08:56.773979 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': '2283ddcf-11c0-4ffd-8053-32252df7d7f1', 'body': {'unpause': {}}} Sep 14 09:08:56.773979 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:08:56.773979 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:08:56.773979 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:08:56.773979 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:08:56.773979 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:08:56.773979 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:08:56.773979 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 14 09:08:56.773979 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 14 09:08:56.773979 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2283ddcf-11c0-4ffd-8053-32252df7d7f1 could not be found. Sep 14 09:08:56.773979 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:08:56.773979 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:08:56.773979 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:08:56.773979 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:08:56.773979 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:08:56.773979 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:08:56.773979 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:08:56.773979 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:08:56.773979 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:08:56.773979 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:08:56.773979 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Sep 14 09:08:56.773979 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Sep 14 09:08:56.773979 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:08:56.773979 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:08:56.773979 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2283ddcf-11c0-4ffd-8053-32252df7d7f1 could not be found. Sep 14 09:08:56.773979 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:08:56.773979 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:08:56.773979 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:08:56.773979 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:08:56.773979 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:08:56.773979 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:08:56.778813 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:08:56.778813 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:08:56.778813 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2283ddcf-11c0-4ffd-8053-32252df7d7f1 could not be found. Sep 14 09:08:56.778813 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:08:56.778813 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-87bde954-4183-4bfb-93c6-7998ba0ca04e tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Returning 404 to user: Instance 2283ddcf-11c0-4ffd-8053-32252df7d7f1 could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:08:56.778813 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-87bde954-4183-4bfb-93c6-7998ba0ca04e tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "POST /compute/v2.1/servers/2283ddcf-11c0-4ffd-8053-32252df7d7f1/action" status: 404 len: 111 microversion: 2.1 time: 0.043976 Sep 14 09:08:56.779322 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6c126604-e78a-4a7e-b1ed-3bbefe9dc8bd tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:56.780237 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2180/4361] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:08:56 2022] POST /compute/v2.1/servers/2283ddcf-11c0-4ffd-8053-32252df7d7f1/action => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:08:56.801869 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d6b64715-4b77-4fa1-adc0-60905dea9405 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:08:56.803012 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-d6b64715-4b77-4fa1-adc0-60905dea9405 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:08:56.829376 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d6b64715-4b77-4fa1-adc0-60905dea9405 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:56.835794 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d6b64715-4b77-4fa1-adc0-60905dea9405 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:56.836800 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d6b64715-4b77-4fa1-adc0-60905dea9405 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:56.838255 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d6b64715-4b77-4fa1-adc0-60905dea9405 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:56.838924 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d6b64715-4b77-4fa1-adc0-60905dea9405 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:56.839814 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d6b64715-4b77-4fa1-adc0-60905dea9405 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:57.457130 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-6c126604-e78a-4a7e-b1ed-3bbefe9dc8bd tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "POST /compute/v2.1/servers/8032c321-1baa-44a9-b3bd-b0ce09999b9e/action" status: 202 len: 0 microversion: 2.1 time: 0.736342 Sep 14 09:08:57.458850 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2182/4362] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:08:56 2022] POST /compute/v2.1/servers/8032c321-1baa-44a9-b3bd-b0ce09999b9e/action => generated 0 bytes in 743 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 14 09:08:57.487754 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3e2e57dc-2a2f-469b-a06e-1f8ee882aeb6 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:08:57.488740 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-3e2e57dc-2a2f-469b-a06e-1f8ee882aeb6 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] [instance: 6957a5fb-4af4-4ca1-809a-8dd02e517c24] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:08:57.524612 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3e2e57dc-2a2f-469b-a06e-1f8ee882aeb6 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:57.534450 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3e2e57dc-2a2f-469b-a06e-1f8ee882aeb6 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:57.535242 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3e2e57dc-2a2f-469b-a06e-1f8ee882aeb6 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:57.538252 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3e2e57dc-2a2f-469b-a06e-1f8ee882aeb6 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:57.540434 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3e2e57dc-2a2f-469b-a06e-1f8ee882aeb6 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:57.547163 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3e2e57dc-2a2f-469b-a06e-1f8ee882aeb6 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:57.633808 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-d6b64715-4b77-4fa1-adc0-60905dea9405 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:08:57.663159 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-d6b64715-4b77-4fa1-adc0-60905dea9405 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1506 microversion: 2.1 time: 0.867102 Sep 14 09:08:57.682393 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2181/4363] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:08:56 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1506 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:08:57.687617 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-f9e93aa7-6cf3-46c9-9a2d-c114ba2e02bf tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '.version_select at 0x7f7d3f458ee0>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:08:57.801693 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-f9e93aa7-6cf3-46c9-9a2d-c114ba2e02bf tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute/v2.1/images/c5c71d41-e6d8-4c62-847e-65e5b33c1981" status: 200 len: 1413 microversion: 2.1 time: 0.117801 Sep 14 09:08:57.802716 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2182/4364] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:08:57 2022] GET /compute/v2.1/images/c5c71d41-e6d8-4c62-847e-65e5b33c1981 => generated 1413 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:08:57.814758 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-aa5eede4-681c-49b0-8e7f-c68d78a87ae9 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:08:57.819279 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-aa5eede4-681c-49b0-8e7f-c68d78a87ae9 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:08:57.839356 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-aa5eede4-681c-49b0-8e7f-c68d78a87ae9 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:57.844528 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-aa5eede4-681c-49b0-8e7f-c68d78a87ae9 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:57.847612 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-aa5eede4-681c-49b0-8e7f-c68d78a87ae9 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:57.852987 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-aa5eede4-681c-49b0-8e7f-c68d78a87ae9 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:57.853675 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-aa5eede4-681c-49b0-8e7f-c68d78a87ae9 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:57.857278 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-aa5eede4-681c-49b0-8e7f-c68d78a87ae9 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:58.119093 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-3e2e57dc-2a2f-469b-a06e-1f8ee882aeb6 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932f3d4bbfd04cae8e48a937a5b10716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b713d80d5243659644e0c74c6df59c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:08:58.127484 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-3e2e57dc-2a2f-469b-a06e-1f8ee882aeb6 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] 10.222.0.60 "GET /compute/v2.1/servers/6957a5fb-4af4-4ca1-809a-8dd02e517c24" status: 200 len: 1522 microversion: 2.1 time: 0.663863 Sep 14 09:08:58.131817 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2183/4365] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:08:57 2022] GET /compute/v2.1/servers/6957a5fb-4af4-4ca1-809a-8dd02e517c24 => generated 1522 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:08:58.147200 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-dee99485-6649-4268-be95-63173ad09970 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '.version_select at 0x7f7d3ef08af0>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:08:58.214376 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-aa5eede4-681c-49b0-8e7f-c68d78a87ae9 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:08:58.230080 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-aa5eede4-681c-49b0-8e7f-c68d78a87ae9 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1506 microversion: 2.1 time: 0.426178 Sep 14 09:08:58.230696 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2183/4366] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:08:57 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1506 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:08:58.233374 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-dee99485-6649-4268-be95-63173ad09970 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute/v2.1/images/c5c71d41-e6d8-4c62-847e-65e5b33c1981" status: 200 len: 1413 microversion: 2.1 time: 0.100220 Sep 14 09:08:58.234227 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2184/4367] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:08:58 2022] GET /compute/v2.1/images/c5c71d41-e6d8-4c62-847e-65e5b33c1981 => generated 1413 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:08:58.260087 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3461b4fb-cc75-4e13-b8d2-d046d7d0b22f tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '.version_select at 0x7f7d3efb0c10>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:08:58.275500 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-916d64fb-853a-4b47-89a3-efa43f325906 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-817425102", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cf8ff039-9ce3-49c0-bc1b-5843a8f13c00"}], "security_groups": [{"name": "tempest-securitygroup--1196160988"}], "key_name": "tempest-keypair-1144299381", "user_data": "}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:08:58.572534 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-3461b4fb-cc75-4e13-b8d2-d046d7d0b22f tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "DELETE /compute/v2.1/images/c5c71d41-e6d8-4c62-847e-65e5b33c1981" status: 204 len: 0 microversion: 2.1 time: 0.318933 Sep 14 09:08:58.574123 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2185/4368] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:08:58 2022] DELETE /compute/v2.1/images/c5c71d41-e6d8-4c62-847e-65e5b33c1981 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:08:58.596518 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b7f8eeb6-7dbe-48ef-94d6-bc848a443056 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:08:58.600696 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b7f8eeb6-7dbe-48ef-94d6-bc848a443056 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:08:58.613716 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b7f8eeb6-7dbe-48ef-94d6-bc848a443056 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:58.617230 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b7f8eeb6-7dbe-48ef-94d6-bc848a443056 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:58.618121 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b7f8eeb6-7dbe-48ef-94d6-bc848a443056 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:58.620117 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b7f8eeb6-7dbe-48ef-94d6-bc848a443056 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:58.621264 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b7f8eeb6-7dbe-48ef-94d6-bc848a443056 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:58.623346 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b7f8eeb6-7dbe-48ef-94d6-bc848a443056 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:58.686659 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-b7f8eeb6-7dbe-48ef-94d6-bc848a443056 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] HTTP exception thrown: Cannot 'unpause' instance ae344b98-a354-4df8-83ba-3c5a786694f4 while it is in vm_state active Sep 14 09:08:58.689352 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b7f8eeb6-7dbe-48ef-94d6-bc848a443056 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Request method failure captured: Sep 14 09:08:58.689352 n-d-836830-18 devstack@n-api.service[128759]: request: POST /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4/action HTTP/1.1 Sep 14 09:08:58.689352 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:08:58.689352 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:08:58.689352 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:08:58.689352 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 15 Sep 14 09:08:58.689352 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:08:58.689352 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:08:58.689352 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:08:58.689352 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:08:58.689352 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZk2EvHIWQyXATvY4f6phbqF3DzIIyaJjJFCE11LxTKbrsndvuk5zoyyEUR0VXx32_kFjD0I6jBROuj0ZPSHQav7u9FFvOPFGrPkf9qZrgXY9k3zAUFrOVfwLECoLZOolubyCPUAGSEOi_HvFIP_Dd_DCbUCKDEGGLtdnAzy2tLCxHs Sep 14 09:08:58.689352 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:08:58.689352 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:08:58.689352 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:08:58.689352 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:08:58.689352 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:08:58.689352 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:08:58.689352 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 6907b82c9d5c4a23a63bbeec31c3c365 Sep 14 09:08:58.689352 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ServersNegativeTestJSON-1654813540 Sep 14 09:08:58.689352 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:08:58.689352 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:08:58.689352 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6907b82c9d5c4a23a63bbeec31c3c365"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6907b82c9d5c4a23a63bbeec31c3c365"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6907b82c9d5c4a23a63bbeec31c3c365"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6907b82c9d5c4a23a63bbeec31c3c365"}]}] Sep 14 09:08:58.689352 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ServersNegativeTestJSON-1654813540 Sep 14 09:08:58.689352 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 6907b82c9d5c4a23a63bbeec31c3c365 Sep 14 09:08:58.689352 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1654813540 Sep 14 09:08:58.689352 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ServersNegativeTestJSON-1654813540-project Sep 14 09:08:58.689352 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:08:58.689352 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:08:58.689352 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 79583c4e80a04f138927f09eb4e170f4 Sep 14 09:08:58.689352 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ServersNegativeTestJSON-1654813540-project Sep 14 09:08:58.689352 n-d-836830-18 devstack@n-api.service[128759]: Sep 14 09:08:58.689352 n-d-836830-18 devstack@n-api.service[128759]: {"unpause": {}} Sep 14 09:08:58.689352 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:08:58.689352 n-d-836830-18 devstack@n-api.service[128759]: exception: Cannot 'unpause' instance ae344b98-a354-4df8-83ba-3c5a786694f4 while it is in vm_state active Sep 14 09:08:58.689352 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': 'ae344b98-a354-4df8-83ba-3c5a786694f4', 'body': {'unpause': {}}} Sep 14 09:08:58.689352 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:08:58.689352 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:08:58.689352 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Sep 14 09:08:58.689352 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Sep 14 09:08:58.689352 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 14 09:08:58.689352 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 14 09:08:58.689352 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 14 09:08:58.689352 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 14 09:08:58.689352 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ae344b98-a354-4df8-83ba-3c5a786694f4 in vm_state active. Cannot unpause while the instance is in this state. Sep 14 09:08:58.689352 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:08:58.689352 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:08:58.689352 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:08:58.689352 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:08:58.689352 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:08:58.689352 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:08:58.689352 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:08:58.689352 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:08:58.689352 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:08:58.689352 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:08:58.689352 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Sep 14 09:08:58.689352 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 14 09:08:58.689352 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 14 09:08:58.689352 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 14 09:08:58.689352 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance ae344b98-a354-4df8-83ba-3c5a786694f4 while it is in vm_state active Sep 14 09:08:58.689352 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:08:58.689352 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:08:58.689352 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:08:58.689352 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:08:58.689352 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:08:58.695534 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:08:58.695534 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:08:58.695534 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:08:58.695534 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance ae344b98-a354-4df8-83ba-3c5a786694f4 while it is in vm_state active Sep 14 09:08:58.695534 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:08:58.698082 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b7f8eeb6-7dbe-48ef-94d6-bc848a443056 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Returning 409 to user: Cannot 'unpause' instance ae344b98-a354-4df8-83ba-3c5a786694f4 while it is in vm_state active {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:08:58.699211 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b7f8eeb6-7dbe-48ef-94d6-bc848a443056 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "POST /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4/action" status: 409 len: 145 microversion: 2.1 time: 0.123630 Sep 14 09:08:58.699989 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2186/4369] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:08:58 2022] POST /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4/action => generated 145 bytes in 125 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 14 09:08:58.714068 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d0aa8269-3a7e-4e91-97ae-55ddf7ed92f3 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '.version_select at 0x7f7d3eee6700>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:08:58.786116 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-d0aa8269-3a7e-4e91-97ae-55ddf7ed92f3 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] HTTP exception thrown: Image not found. Sep 14 09:08:58.788866 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d0aa8269-3a7e-4e91-97ae-55ddf7ed92f3 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Request method failure captured: Sep 14 09:08:58.788866 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/images/c5c71d41-e6d8-4c62-847e-65e5b33c1981 HTTP/1.1 Sep 14 09:08:58.788866 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:08:58.788866 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:08:58.788866 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:08:58.788866 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:08:58.788866 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:08:58.788866 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:08:58.788866 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:08:58.788866 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:08:58.788866 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZk14GDuYfxsa-wsuRIzuMO54ZShhfsgwUWfj31e0zoblQtY51e_R-CAnEXwf-TeZMtlksIN48WuJE6pMDpTtkDTOMNoN3z5PF_FFos2425zrkF0JqqhjIavK21BkzJ8vfAPZ1nB6uut9GecGR4ysuDCA3zc9nB4uf2O7loF0oE9d4c Sep 14 09:08:58.788866 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:08:58.788866 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:08:58.788866 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:08:58.788866 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:08:58.788866 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:08:58.788866 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:08:58.788866 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 62a597fc389b4805bbd3a53ecd17c5b2 Sep 14 09:08:58.788866 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ImagesTestJSON-1442595664 Sep 14 09:08:58.788866 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:08:58.788866 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:08:58.788866 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/62a597fc389b4805bbd3a53ecd17c5b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_62a597fc389b4805bbd3a53ecd17c5b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/62a597fc389b4805bbd3a53ecd17c5b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/62a597fc389b4805bbd3a53ecd17c5b2"}]}] Sep 14 09:08:58.788866 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ImagesTestJSON-1442595664 Sep 14 09:08:58.788866 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 62a597fc389b4805bbd3a53ecd17c5b2 Sep 14 09:08:58.788866 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ImagesTestJSON-1442595664 Sep 14 09:08:58.788866 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ImagesTestJSON-1442595664-project Sep 14 09:08:58.788866 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:08:58.788866 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:08:58.788866 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 5165b8fc101c47c7a4370f9007bc5a58 Sep 14 09:08:58.788866 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ImagesTestJSON-1442595664-project Sep 14 09:08:58.788866 n-d-836830-18 devstack@n-api.service[128759]: method: Sep 14 09:08:58.788866 n-d-836830-18 devstack@n-api.service[128759]: exception: Image not found. Sep 14 09:08:58.788866 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': 'c5c71d41-e6d8-4c62-847e-65e5b33c1981'} Sep 14 09:08:58.788866 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:08:58.788866 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:08:58.788866 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 14 09:08:58.788866 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 14 09:08:58.788866 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 14 09:08:58.788866 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 14 09:08:58.788866 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 14 09:08:58.788866 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 14 09:08:58.788866 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 14 09:08:58.788866 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 14 09:08:58.788866 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 14 09:08:58.788866 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 14 09:08:58.788866 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 14 09:08:58.788866 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 14 09:08:58.788866 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 14 09:08:58.788866 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 14 09:08:58.788866 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 14 09:08:58.788866 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 14 09:08:58.788866 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID c5c71d41-e6d8-4c62-847e-65e5b33c1981 Sep 14 09:08:58.788866 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:08:58.788866 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:08:58.788866 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:08:58.788866 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:08:58.788866 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Sep 14 09:08:58.788866 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Sep 14 09:08:58.788866 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 14 09:08:58.788866 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 14 09:08:58.788866 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 14 09:08:58.788866 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 14 09:08:58.788866 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 14 09:08:58.788866 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 14 09:08:58.793859 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 14 09:08:58.793859 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 14 09:08:58.793859 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 14 09:08:58.793859 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 14 09:08:58.793859 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 14 09:08:58.793859 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 14 09:08:58.793859 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 14 09:08:58.793859 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 14 09:08:58.793859 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 14 09:08:58.793859 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 14 09:08:58.793859 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 14 09:08:58.793859 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 14 09:08:58.793859 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 14 09:08:58.793859 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 14 09:08:58.793859 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 14 09:08:58.793859 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 14 09:08:58.793859 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c5c71d41-e6d8-4c62-847e-65e5b33c1981 could not be found. Sep 14 09:08:58.793859 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:08:58.793859 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:08:58.793859 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:08:58.793859 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:08:58.793859 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:08:58.793859 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:08:58.793859 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:08:58.793859 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:08:58.793859 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:08:58.793859 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:08:58.793859 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:08:58.793859 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:08:58.793859 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Sep 14 09:08:58.793859 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 14 09:08:58.793859 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 14 09:08:58.793859 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:08:58.793859 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:08:58.793859 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:08:58.793859 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:08:58.793859 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:08:58.793859 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:08:58.793859 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:08:58.793859 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:08:58.793859 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 14 09:08:58.793859 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:08:58.793859 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d0aa8269-3a7e-4e91-97ae-55ddf7ed92f3 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Returning 404 to user: Image not found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:08:58.793859 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d0aa8269-3a7e-4e91-97ae-55ddf7ed92f3 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute/v2.1/images/c5c71d41-e6d8-4c62-847e-65e5b33c1981" status: 404 len: 62 microversion: 2.1 time: 0.089357 Sep 14 09:08:58.793859 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2187/4370] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 14 09:08:58 2022] GET /compute/v2.1/images/c5c71d41-e6d8-4c62-847e-65e5b33c1981 => generated 62 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 14 09:08:58.810324 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-14afb84d-436d-4a35-a883-9fa1746f092a tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:08:58.812794 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-14afb84d-436d-4a35-a883-9fa1746f092a tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:08:58.831993 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-14afb84d-436d-4a35-a883-9fa1746f092a tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:58.832701 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-14afb84d-436d-4a35-a883-9fa1746f092a tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:58.833332 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-14afb84d-436d-4a35-a883-9fa1746f092a tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:58.834283 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-14afb84d-436d-4a35-a883-9fa1746f092a tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:58.834949 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-14afb84d-436d-4a35-a883-9fa1746f092a tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:58.835990 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-14afb84d-436d-4a35-a883-9fa1746f092a tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:58.981944 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.network.neutron [None req-916d64fb-853a-4b47-89a3-efa43f325906 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] validate_networks() for [('cf8ff039-9ce3-49c0-bc1b-5843a8f13c00', None, None, None, None, None)] {{(pid=128758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:08:59.346256 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-14afb84d-436d-4a35-a883-9fa1746f092a tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:08:59.361400 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-14afb84d-436d-4a35-a883-9fa1746f092a tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1506 microversion: 2.1 time: 0.566760 Sep 14 09:08:59.364868 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2188/4371] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:08:58 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1506 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:08:59.400315 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-31c7f562-fddf-4cca-ba19-99879a8800ee tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:08:59.401364 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-31c7f562-fddf-4cca-ba19-99879a8800ee tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] [instance: 8032c321-1baa-44a9-b3bd-b0ce09999b9e] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:08:59.422391 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-31c7f562-fddf-4cca-ba19-99879a8800ee tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:59.423204 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-31c7f562-fddf-4cca-ba19-99879a8800ee tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:59.423876 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-31c7f562-fddf-4cca-ba19-99879a8800ee tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:08:59.428042 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-31c7f562-fddf-4cca-ba19-99879a8800ee tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:08:59.428845 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-31c7f562-fddf-4cca-ba19-99879a8800ee tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:08:59.431386 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-31c7f562-fddf-4cca-ba19-99879a8800ee tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:00.106184 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-31c7f562-fddf-4cca-ba19-99879a8800ee tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5165b8fc101c47c7a4370f9007bc5a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a597fc389b4805bbd3a53ecd17c5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:09:00.114288 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-31c7f562-fddf-4cca-ba19-99879a8800ee tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute/v2.1/servers/8032c321-1baa-44a9-b3bd-b0ce09999b9e" status: 200 len: 1503 microversion: 2.1 time: 0.733955 Sep 14 09:09:00.114808 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2189/4372] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:08:59 2022] GET /compute/v2.1/servers/8032c321-1baa-44a9-b3bd-b0ce09999b9e => generated 1503 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:09:00.133929 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c4f54433-d3e7-4aee-97b5-3573cddcb879 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:09:00.140501 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-c4f54433-d3e7-4aee-97b5-3573cddcb879 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] [instance: 6957a5fb-4af4-4ca1-809a-8dd02e517c24] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:09:00.168026 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c4f54433-d3e7-4aee-97b5-3573cddcb879 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:00.168535 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c4f54433-d3e7-4aee-97b5-3573cddcb879 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:00.176801 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c4f54433-d3e7-4aee-97b5-3573cddcb879 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:00.177594 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c4f54433-d3e7-4aee-97b5-3573cddcb879 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:00.178083 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c4f54433-d3e7-4aee-97b5-3573cddcb879 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:00.178530 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c4f54433-d3e7-4aee-97b5-3573cddcb879 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:00.430911 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-916d64fb-853a-4b47-89a3-efa43f325906 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Flavor limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:09:00.433213 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-916d64fb-853a-4b47-89a3-efa43f325906 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Image limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:09:00.433950 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-916d64fb-853a-4b47-89a3-efa43f325906 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Flavor pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:09:00.434545 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-916d64fb-853a-4b47-89a3-efa43f325906 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Image pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:09:00.435198 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-916d64fb-853a-4b47-89a3-efa43f325906 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:09:00.456292 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-916d64fb-853a-4b47-89a3-efa43f325906 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:00.462655 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-916d64fb-853a-4b47-89a3-efa43f325906 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:00.463440 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-916d64fb-853a-4b47-89a3-efa43f325906 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:00.464543 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-916d64fb-853a-4b47-89a3-efa43f325906 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:00.465209 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-916d64fb-853a-4b47-89a3-efa43f325906 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:00.465820 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-916d64fb-853a-4b47-89a3-efa43f325906 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:00.519592 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-916d64fb-853a-4b47-89a3-efa43f325906 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Getting quotas for project 9c0762ad3f774829b58669b312dd13f7. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:09:00.530626 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-916d64fb-853a-4b47-89a3-efa43f325906 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Getting quotas for user 78051740ae354035b119d5d8ebe226f1 and project 9c0762ad3f774829b58669b312dd13f7. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:09:00.580448 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-916d64fb-853a-4b47-89a3-efa43f325906 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Going to run 1 instances... {{(pid=128758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:09:00.585080 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-916d64fb-853a-4b47-89a3-efa43f325906 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:09:00.665921 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-c4f54433-d3e7-4aee-97b5-3573cddcb879 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932f3d4bbfd04cae8e48a937a5b10716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b713d80d5243659644e0c74c6df59c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:09:00.674375 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-c4f54433-d3e7-4aee-97b5-3573cddcb879 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] 10.222.0.60 "GET /compute/v2.1/servers/6957a5fb-4af4-4ca1-809a-8dd02e517c24" status: 200 len: 1522 microversion: 2.1 time: 0.558479 Sep 14 09:09:00.696241 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2190/4373] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:09:00 2022] GET /compute/v2.1/servers/6957a5fb-4af4-4ca1-809a-8dd02e517c24 => generated 1522 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:09:00.710585 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-4d64f978-d71b-4ccd-be8e-a5beb6f1b914 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:09:00.711509 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-4d64f978-d71b-4ccd-be8e-a5beb6f1b914 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:09:00.727385 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-916d64fb-853a-4b47-89a3-efa43f325906 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.484595 Sep 14 09:09:00.728929 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2184/4374] 10.222.0.60 () {62 vars in 1188 bytes} [Wed Sep 14 09:08:58 2022] POST /compute/v2.1/servers => generated 402 bytes in 2497 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 14 09:09:00.735859 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4d64f978-d71b-4ccd-be8e-a5beb6f1b914 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:00.744265 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-84d42499-6c9c-4c8c-ac58-8db6e3d6e5e3 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:09:00.747124 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-84d42499-6c9c-4c8c-ac58-8db6e3d6e5e3 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:09:00.749245 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4d64f978-d71b-4ccd-be8e-a5beb6f1b914 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:00.749719 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4d64f978-d71b-4ccd-be8e-a5beb6f1b914 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:00.750543 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4d64f978-d71b-4ccd-be8e-a5beb6f1b914 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:00.751060 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4d64f978-d71b-4ccd-be8e-a5beb6f1b914 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:00.765548 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4d64f978-d71b-4ccd-be8e-a5beb6f1b914 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:00.912321 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-84d42499-6c9c-4c8c-ac58-8db6e3d6e5e3 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:09:00.923952 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-84d42499-6c9c-4c8c-ac58-8db6e3d6e5e3 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:09:00.928753 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:09:00.933025 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-84d42499-6c9c-4c8c-ac58-8db6e3d6e5e3 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:09:00.934236 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-84d42499-6c9c-4c8c-ac58-8db6e3d6e5e3 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5" status: 200 len: 1281 microversion: 2.20 time: 0.197669 Sep 14 09:09:00.949266 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2185/4375] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:09:00 2022] GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5 => generated 1281 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:09:01.138249 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-9500bdc7-03ec-4716-8f7b-8b1d51a86331 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:09:01.139989 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-9500bdc7-03ec-4716-8f7b-8b1d51a86331 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] [instance: 8032c321-1baa-44a9-b3bd-b0ce09999b9e] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:09:01.152533 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9500bdc7-03ec-4716-8f7b-8b1d51a86331 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:01.154875 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9500bdc7-03ec-4716-8f7b-8b1d51a86331 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:01.156094 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9500bdc7-03ec-4716-8f7b-8b1d51a86331 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:01.158430 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9500bdc7-03ec-4716-8f7b-8b1d51a86331 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:01.162869 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9500bdc7-03ec-4716-8f7b-8b1d51a86331 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:01.164559 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9500bdc7-03ec-4716-8f7b-8b1d51a86331 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:01.179136 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=4 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:09:01.432766 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-4d64f978-d71b-4ccd-be8e-a5beb6f1b914 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:09:01.449125 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-4d64f978-d71b-4ccd-be8e-a5beb6f1b914 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1506 microversion: 2.1 time: 0.749870 Sep 14 09:09:01.468578 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2191/4376] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:09:00 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1506 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:09:01.481670 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d4de9e1a-a0a9-4ef1-a0f1-9a70d5f369f3 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:09:01.483108 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-d4de9e1a-a0a9-4ef1-a0f1-9a70d5f369f3 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: 8ff2be8f-1d62-4b94-9ffd-182de0a73ae2] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:09:01.520280 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-d4de9e1a-a0a9-4ef1-a0f1-9a70d5f369f3 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] HTTP exception thrown: Instance 8ff2be8f-1d62-4b94-9ffd-182de0a73ae2 could not be found. Sep 14 09:09:01.534402 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d4de9e1a-a0a9-4ef1-a0f1-9a70d5f369f3 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Request method failure captured: Sep 14 09:09:01.534402 n-d-836830-18 devstack@n-api.service[128759]: request: POST /compute/v2.1/servers/8ff2be8f-1d62-4b94-9ffd-182de0a73ae2/action HTTP/1.1 Sep 14 09:09:01.534402 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:09:01.534402 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:09:01.534402 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:09:01.534402 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 18 Sep 14 09:09:01.534402 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:09:01.534402 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:09:01.534402 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:09:01.534402 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:09:01.534402 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZk2EvHIWQyXATvY4f6phbqF3DzIIyaJjJFCE11LxTKbrsndvuk5zoyyEUR0VXx32_kFjD0I6jBROuj0ZPSHQav7u9FFvOPFGrPkf9qZrgXY9k3zAUFrOVfwLECoLZOolubyCPUAGSEOi_HvFIP_Dd_DCbUCKDEGGLtdnAzy2tLCxHs Sep 14 09:09:01.534402 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:09:01.534402 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:09:01.534402 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:09:01.534402 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:09:01.534402 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:09:01.534402 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:09:01.534402 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 6907b82c9d5c4a23a63bbeec31c3c365 Sep 14 09:09:01.534402 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ServersNegativeTestJSON-1654813540 Sep 14 09:09:01.534402 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:09:01.534402 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:09:01.534402 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6907b82c9d5c4a23a63bbeec31c3c365"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6907b82c9d5c4a23a63bbeec31c3c365"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6907b82c9d5c4a23a63bbeec31c3c365"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6907b82c9d5c4a23a63bbeec31c3c365"}]}] Sep 14 09:09:01.534402 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ServersNegativeTestJSON-1654813540 Sep 14 09:09:01.534402 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 6907b82c9d5c4a23a63bbeec31c3c365 Sep 14 09:09:01.534402 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1654813540 Sep 14 09:09:01.534402 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ServersNegativeTestJSON-1654813540-project Sep 14 09:09:01.534402 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:09:01.534402 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:09:01.534402 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 79583c4e80a04f138927f09eb4e170f4 Sep 14 09:09:01.534402 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ServersNegativeTestJSON-1654813540-project Sep 14 09:09:01.534402 n-d-836830-18 devstack@n-api.service[128759]: Sep 14 09:09:01.534402 n-d-836830-18 devstack@n-api.service[128759]: {"unshelve": null} Sep 14 09:09:01.534402 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:09:01.534402 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance 8ff2be8f-1d62-4b94-9ffd-182de0a73ae2 could not be found. Sep 14 09:09:01.534402 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '8ff2be8f-1d62-4b94-9ffd-182de0a73ae2', 'body': {'unshelve': None}} Sep 14 09:09:01.534402 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:09:01.534402 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:09:01.534402 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:09:01.534402 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:09:01.534402 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:09:01.534402 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:09:01.534402 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 14 09:09:01.534402 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 14 09:09:01.534402 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ff2be8f-1d62-4b94-9ffd-182de0a73ae2 could not be found. Sep 14 09:09:01.534402 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:09:01.534402 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:09:01.534402 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:09:01.534402 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:09:01.534402 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:09:01.534402 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:09:01.534402 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:09:01.534402 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:09:01.534402 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:09:01.534402 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:09:01.534402 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:09:01.534402 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:09:01.534402 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:09:01.534402 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:09:01.534402 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Sep 14 09:09:01.534402 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 14 09:09:01.534402 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:09:01.534402 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:09:01.534402 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ff2be8f-1d62-4b94-9ffd-182de0a73ae2 could not be found. Sep 14 09:09:01.534402 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:09:01.534402 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:09:01.541496 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:09:01.541496 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:09:01.541496 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:09:01.541496 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:09:01.541496 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:09:01.541496 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:09:01.541496 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ff2be8f-1d62-4b94-9ffd-182de0a73ae2 could not be found. Sep 14 09:09:01.541496 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:09:01.544263 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d4de9e1a-a0a9-4ef1-a0f1-9a70d5f369f3 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Returning 404 to user: Instance 8ff2be8f-1d62-4b94-9ffd-182de0a73ae2 could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:09:01.548722 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d4de9e1a-a0a9-4ef1-a0f1-9a70d5f369f3 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "POST /compute/v2.1/servers/8ff2be8f-1d62-4b94-9ffd-182de0a73ae2/action" status: 404 len: 111 microversion: 2.1 time: 0.073982 Sep 14 09:09:01.557291 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2192/4377] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:09:01 2022] POST /compute/v2.1/servers/8ff2be8f-1d62-4b94-9ffd-182de0a73ae2/action => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:09:01.562386 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-57c2ba79-3a66-4a37-922d-5edba256066e tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:09:01.571370 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-57c2ba79-3a66-4a37-922d-5edba256066e tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:09:01.585573 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-57c2ba79-3a66-4a37-922d-5edba256066e tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:01.589199 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-57c2ba79-3a66-4a37-922d-5edba256066e tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:01.589846 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-57c2ba79-3a66-4a37-922d-5edba256066e tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:01.590768 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-57c2ba79-3a66-4a37-922d-5edba256066e tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:01.594787 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-57c2ba79-3a66-4a37-922d-5edba256066e tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:01.595475 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-57c2ba79-3a66-4a37-922d-5edba256066e tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:01.668272 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-9500bdc7-03ec-4716-8f7b-8b1d51a86331 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5165b8fc101c47c7a4370f9007bc5a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a597fc389b4805bbd3a53ecd17c5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:09:01.681626 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-9500bdc7-03ec-4716-8f7b-8b1d51a86331 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute/v2.1/servers/8032c321-1baa-44a9-b3bd-b0ce09999b9e" status: 200 len: 1485 microversion: 2.1 time: 0.547562 Sep 14 09:09:01.699321 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2186/4378] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:09:01 2022] GET /compute/v2.1/servers/8032c321-1baa-44a9-b3bd-b0ce09999b9e => generated 1485 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:09:01.720460 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b1dc6440-2941-4e3c-8ce3-98042c7a9309 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:09:01.723509 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-b1dc6440-2941-4e3c-8ce3-98042c7a9309 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] [instance: 6957a5fb-4af4-4ca1-809a-8dd02e517c24] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:09:01.743903 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b1dc6440-2941-4e3c-8ce3-98042c7a9309 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:01.744408 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b1dc6440-2941-4e3c-8ce3-98042c7a9309 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:01.746583 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b1dc6440-2941-4e3c-8ce3-98042c7a9309 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:01.747571 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b1dc6440-2941-4e3c-8ce3-98042c7a9309 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:01.748195 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b1dc6440-2941-4e3c-8ce3-98042c7a9309 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:01.750624 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b1dc6440-2941-4e3c-8ce3-98042c7a9309 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:02.202305 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-57c2ba79-3a66-4a37-922d-5edba256066e tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:09:02.218961 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-57c2ba79-3a66-4a37-922d-5edba256066e tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1506 microversion: 2.1 time: 0.656254 Sep 14 09:09:02.240039 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2193/4379] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:09:01 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1506 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:09:02.254730 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f64fc4d4-712b-4abd-9dc4-d852f6cd8d78 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:09:02.261084 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f64fc4d4-712b-4abd-9dc4-d852f6cd8d78 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] [instance: 8032c321-1baa-44a9-b3bd-b0ce09999b9e] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:09:02.279220 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f64fc4d4-712b-4abd-9dc4-d852f6cd8d78 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:02.286503 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f64fc4d4-712b-4abd-9dc4-d852f6cd8d78 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:02.288392 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f64fc4d4-712b-4abd-9dc4-d852f6cd8d78 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:02.289406 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f64fc4d4-712b-4abd-9dc4-d852f6cd8d78 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:02.292780 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f64fc4d4-712b-4abd-9dc4-d852f6cd8d78 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:02.293512 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f64fc4d4-712b-4abd-9dc4-d852f6cd8d78 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:02.417635 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f64fc4d4-712b-4abd-9dc4-d852f6cd8d78 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] [instance: 8032c321-1baa-44a9-b3bd-b0ce09999b9e] Going to try to terminate instance {{(pid=128759) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:09:02.487660 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-b1dc6440-2941-4e3c-8ce3-98042c7a9309 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932f3d4bbfd04cae8e48a937a5b10716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b713d80d5243659644e0c74c6df59c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:09:02.506520 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-b1dc6440-2941-4e3c-8ce3-98042c7a9309 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] 10.222.0.60 "GET /compute/v2.1/servers/6957a5fb-4af4-4ca1-809a-8dd02e517c24" status: 200 len: 1522 microversion: 2.1 time: 0.799667 Sep 14 09:09:02.507339 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2187/4380] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:09:01 2022] GET /compute/v2.1/servers/6957a5fb-4af4-4ca1-809a-8dd02e517c24 => generated 1522 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:09:02.517320 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1575bb2d-9e03-45c6-87ba-59e0c54e245c tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:09:02.521262 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-1575bb2d-9e03-45c6-87ba-59e0c54e245c tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:09:02.744233 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-1575bb2d-9e03-45c6-87ba-59e0c54e245c tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:09:02.762397 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-1575bb2d-9e03-45c6-87ba-59e0c54e245c tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:09:02.766034 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-1575bb2d-9e03-45c6-87ba-59e0c54e245c tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:09:02.769825 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-1575bb2d-9e03-45c6-87ba-59e0c54e245c tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5" status: 200 len: 1281 microversion: 2.20 time: 0.260248 Sep 14 09:09:02.770824 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2188/4381] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:09:02 2022] GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5 => generated 1281 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:09:02.777459 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-6b8617ee-be5e-414f-b850-db63b9d19bfd tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:09:02.778341 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-6b8617ee-be5e-414f-b850-db63b9d19bfd tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:09:02.786088 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6b8617ee-be5e-414f-b850-db63b9d19bfd tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:02.791649 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6b8617ee-be5e-414f-b850-db63b9d19bfd tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:02.792718 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6b8617ee-be5e-414f-b850-db63b9d19bfd tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:02.794203 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6b8617ee-be5e-414f-b850-db63b9d19bfd tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:02.795042 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6b8617ee-be5e-414f-b850-db63b9d19bfd tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:02.795170 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f64fc4d4-712b-4abd-9dc4-d852f6cd8d78 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "DELETE /compute/v2.1/servers/8032c321-1baa-44a9-b3bd-b0ce09999b9e" status: 204 len: 0 microversion: 2.1 time: 0.544545 Sep 14 09:09:02.795777 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6b8617ee-be5e-414f-b850-db63b9d19bfd tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:02.799139 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2194/4382] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:09:02 2022] DELETE /compute/v2.1/servers/8032c321-1baa-44a9-b3bd-b0ce09999b9e => generated 0 bytes in 558 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:09:02.863097 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e8ad8284-b6e1-4694-a6fe-34c788056390 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '.version_select at 0x7f7d486713a0>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:09:02.921671 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-e8ad8284-b6e1-4694-a6fe-34c788056390 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] HTTP exception thrown: Image not found. Sep 14 09:09:02.926194 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e8ad8284-b6e1-4694-a6fe-34c788056390 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Request method failure captured: Sep 14 09:09:02.926194 n-d-836830-18 devstack@n-api.service[128759]: request: DELETE /compute/v2.1/images/c5c71d41-e6d8-4c62-847e-65e5b33c1981 HTTP/1.1 Sep 14 09:09:02.926194 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:09:02.926194 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:09:02.926194 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:09:02.926194 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:09:02.926194 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:09:02.926194 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:09:02.926194 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:09:02.926194 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:09:02.926194 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZk14GDuYfxsa-wsuRIzuMO54ZShhfsgwUWfj31e0zoblQtY51e_R-CAnEXwf-TeZMtlksIN48WuJE6pMDpTtkDTOMNoN3z5PF_FFos2425zrkF0JqqhjIavK21BkzJ8vfAPZ1nB6uut9GecGR4ysuDCA3zc9nB4uf2O7loF0oE9d4c Sep 14 09:09:02.926194 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:09:02.926194 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:09:02.926194 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:09:02.926194 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:09:02.926194 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:09:02.926194 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:09:02.926194 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 62a597fc389b4805bbd3a53ecd17c5b2 Sep 14 09:09:02.926194 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ImagesTestJSON-1442595664 Sep 14 09:09:02.926194 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:09:02.926194 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:09:02.926194 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/62a597fc389b4805bbd3a53ecd17c5b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_62a597fc389b4805bbd3a53ecd17c5b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/62a597fc389b4805bbd3a53ecd17c5b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/62a597fc389b4805bbd3a53ecd17c5b2"}]}] Sep 14 09:09:02.926194 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ImagesTestJSON-1442595664 Sep 14 09:09:02.926194 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 62a597fc389b4805bbd3a53ecd17c5b2 Sep 14 09:09:02.926194 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ImagesTestJSON-1442595664 Sep 14 09:09:02.926194 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ImagesTestJSON-1442595664-project Sep 14 09:09:02.926194 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:09:02.926194 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:09:02.926194 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 5165b8fc101c47c7a4370f9007bc5a58 Sep 14 09:09:02.926194 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ImagesTestJSON-1442595664-project Sep 14 09:09:02.926194 n-d-836830-18 devstack@n-api.service[128759]: method: Sep 14 09:09:02.926194 n-d-836830-18 devstack@n-api.service[128759]: exception: Image not found. Sep 14 09:09:02.926194 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': 'c5c71d41-e6d8-4c62-847e-65e5b33c1981'} Sep 14 09:09:02.926194 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:09:02.926194 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:09:02.926194 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 14 09:09:02.926194 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 14 09:09:02.926194 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 14 09:09:02.926194 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 14 09:09:02.926194 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 14 09:09:02.926194 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 14 09:09:02.926194 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 14 09:09:02.926194 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 14 09:09:02.926194 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 14 09:09:02.926194 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 14 09:09:02.926194 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 14 09:09:02.926194 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 14 09:09:02.926194 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 14 09:09:02.926194 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 14 09:09:02.926194 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image c5c71d41-e6d8-4c62-847e-65e5b33c1981 to delete Sep 14 09:09:02.926194 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:09:02.926194 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:09:02.926194 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:09:02.926194 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:09:02.926194 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 14 09:09:02.926194 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 14 09:09:02.926194 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 14 09:09:02.926194 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 14 09:09:02.926194 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 14 09:09:02.926194 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 14 09:09:02.926194 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c5c71d41-e6d8-4c62-847e-65e5b33c1981 could not be found. Sep 14 09:09:02.926194 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:09:02.926194 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:09:02.926194 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:09:02.926194 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:09:02.931154 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:09:02.931154 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:09:02.931154 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:09:02.931154 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:09:02.931154 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:09:02.931154 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:09:02.931154 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:09:02.931154 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:09:02.931154 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 14 09:09:02.931154 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 14 09:09:02.931154 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 14 09:09:02.931154 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:09:02.931154 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:09:02.931154 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:09:02.931154 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:09:02.931154 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:09:02.931154 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:09:02.931154 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:09:02.931154 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:09:02.931154 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 14 09:09:02.931154 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:09:02.937964 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e8ad8284-b6e1-4694-a6fe-34c788056390 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Returning 404 to user: Image not found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:09:02.939015 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e8ad8284-b6e1-4694-a6fe-34c788056390 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "DELETE /compute/v2.1/images/c5c71d41-e6d8-4c62-847e-65e5b33c1981" status: 404 len: 62 microversion: 2.1 time: 0.128333 Sep 14 09:09:02.945391 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2195/4383] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:09:02 2022] DELETE /compute/v2.1/images/c5c71d41-e6d8-4c62-847e-65e5b33c1981 => generated 62 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 14 09:09:02.963228 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8fb6df2e-31bf-4389-86ef-a40d51850064 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:09:02.964770 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-8fb6df2e-31bf-4389-86ef-a40d51850064 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] [instance: 8032c321-1baa-44a9-b3bd-b0ce09999b9e] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:09:02.990142 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8fb6df2e-31bf-4389-86ef-a40d51850064 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:02.990650 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8fb6df2e-31bf-4389-86ef-a40d51850064 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:02.991135 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8fb6df2e-31bf-4389-86ef-a40d51850064 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:02.991869 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8fb6df2e-31bf-4389-86ef-a40d51850064 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:02.992330 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8fb6df2e-31bf-4389-86ef-a40d51850064 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:02.993897 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8fb6df2e-31bf-4389-86ef-a40d51850064 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:03.095336 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-8fb6df2e-31bf-4389-86ef-a40d51850064 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] [instance: 8032c321-1baa-44a9-b3bd-b0ce09999b9e] Going to try to terminate instance {{(pid=128759) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:09:03.264438 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.compute.api [None req-8fb6df2e-31bf-4389-86ef-a40d51850064 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] [instance: 8032c321-1baa-44a9-b3bd-b0ce09999b9e] Instance is already in deleting state, ignoring this request Sep 14 09:09:03.265287 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-8fb6df2e-31bf-4389-86ef-a40d51850064 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "DELETE /compute/v2.1/servers/8032c321-1baa-44a9-b3bd-b0ce09999b9e" status: 204 len: 0 microversion: 2.1 time: 0.318542 Sep 14 09:09:03.265878 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2196/4384] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:09:02 2022] DELETE /compute/v2.1/servers/8032c321-1baa-44a9-b3bd-b0ce09999b9e => generated 0 bytes in 320 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:09:03.284659 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a1925b61-a04a-4ed6-9e41-4bc78e1f7bfd tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:09:03.288574 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-6b8617ee-be5e-414f-b850-db63b9d19bfd tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:09:03.297608 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-6b8617ee-be5e-414f-b850-db63b9d19bfd tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1506 microversion: 2.1 time: 0.524440 Sep 14 09:09:03.318565 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2189/4385] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:09:02 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1506 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:09:03.321691 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-a1925b61-a04a-4ed6-9e41-4bc78e1f7bfd tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] [instance: 8032c321-1baa-44a9-b3bd-b0ce09999b9e] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:09:03.330415 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-bec85198-8ad1-4ff7-9439-2d5772adee83 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:09:03.339355 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-bec85198-8ad1-4ff7-9439-2d5772adee83 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:09:03.342400 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a1925b61-a04a-4ed6-9e41-4bc78e1f7bfd tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:03.346545 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a1925b61-a04a-4ed6-9e41-4bc78e1f7bfd tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:03.348911 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a1925b61-a04a-4ed6-9e41-4bc78e1f7bfd tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:03.352292 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a1925b61-a04a-4ed6-9e41-4bc78e1f7bfd tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:03.356420 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a1925b61-a04a-4ed6-9e41-4bc78e1f7bfd tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:03.357092 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a1925b61-a04a-4ed6-9e41-4bc78e1f7bfd tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:03.368094 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bec85198-8ad1-4ff7-9439-2d5772adee83 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:03.371284 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bec85198-8ad1-4ff7-9439-2d5772adee83 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:03.372158 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bec85198-8ad1-4ff7-9439-2d5772adee83 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:03.374511 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bec85198-8ad1-4ff7-9439-2d5772adee83 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:03.377629 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bec85198-8ad1-4ff7-9439-2d5772adee83 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:03.378336 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bec85198-8ad1-4ff7-9439-2d5772adee83 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:03.460907 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-bec85198-8ad1-4ff7-9439-2d5772adee83 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] HTTP exception thrown: Cannot 'unshelve' instance ae344b98-a354-4df8-83ba-3c5a786694f4 while it is in vm_state active Sep 14 09:09:03.478366 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-bec85198-8ad1-4ff7-9439-2d5772adee83 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Request method failure captured: Sep 14 09:09:03.478366 n-d-836830-18 devstack@n-api.service[128758]: request: POST /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4/action HTTP/1.1 Sep 14 09:09:03.478366 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 09:09:03.478366 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 09:09:03.478366 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 09:09:03.478366 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 18 Sep 14 09:09:03.478366 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 09:09:03.478366 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 09:09:03.478366 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 09:09:03.478366 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 09:09:03.478366 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZk2EvHIWQyXATvY4f6phbqF3DzIIyaJjJFCE11LxTKbrsndvuk5zoyyEUR0VXx32_kFjD0I6jBROuj0ZPSHQav7u9FFvOPFGrPkf9qZrgXY9k3zAUFrOVfwLECoLZOolubyCPUAGSEOi_HvFIP_Dd_DCbUCKDEGGLtdnAzy2tLCxHs Sep 14 09:09:03.478366 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 09:09:03.478366 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 09:09:03.478366 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 09:09:03.478366 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 09:09:03.478366 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 09:09:03.478366 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 09:09:03.478366 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 6907b82c9d5c4a23a63bbeec31c3c365 Sep 14 09:09:03.478366 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-ServersNegativeTestJSON-1654813540 Sep 14 09:09:03.478366 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 09:09:03.478366 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 09:09:03.478366 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6907b82c9d5c4a23a63bbeec31c3c365"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6907b82c9d5c4a23a63bbeec31c3c365"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6907b82c9d5c4a23a63bbeec31c3c365"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6907b82c9d5c4a23a63bbeec31c3c365"}]}] Sep 14 09:09:03.478366 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-ServersNegativeTestJSON-1654813540 Sep 14 09:09:03.478366 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 6907b82c9d5c4a23a63bbeec31c3c365 Sep 14 09:09:03.478366 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1654813540 Sep 14 09:09:03.478366 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-ServersNegativeTestJSON-1654813540-project Sep 14 09:09:03.478366 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 09:09:03.478366 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 09:09:03.478366 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 79583c4e80a04f138927f09eb4e170f4 Sep 14 09:09:03.478366 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-ServersNegativeTestJSON-1654813540-project Sep 14 09:09:03.478366 n-d-836830-18 devstack@n-api.service[128758]: Sep 14 09:09:03.478366 n-d-836830-18 devstack@n-api.service[128758]: {"unshelve": null} Sep 14 09:09:03.478366 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 09:09:03.478366 n-d-836830-18 devstack@n-api.service[128758]: exception: Cannot 'unshelve' instance ae344b98-a354-4df8-83ba-3c5a786694f4 while it is in vm_state active Sep 14 09:09:03.478366 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': 'ae344b98-a354-4df8-83ba-3c5a786694f4', 'body': {'unshelve': None}} Sep 14 09:09:03.478366 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:09:03.478366 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:09:03.478366 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Sep 14 09:09:03.478366 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Sep 14 09:09:03.478366 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 14 09:09:03.478366 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 14 09:09:03.478366 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 14 09:09:03.478366 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 14 09:09:03.478366 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 14 09:09:03.478366 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 14 09:09:03.478366 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ae344b98-a354-4df8-83ba-3c5a786694f4 in vm_state active. Cannot unshelve while the instance is in this state. Sep 14 09:09:03.478366 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:09:03.478366 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:09:03.478366 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:09:03.478366 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:09:03.478366 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:09:03.478366 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:09:03.478366 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:09:03.478366 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:09:03.478366 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:09:03.478366 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:09:03.478366 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:09:03.478366 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:09:03.478366 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:09:03.478366 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:09:03.478366 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Sep 14 09:09:03.478366 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Sep 14 09:09:03.478366 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 14 09:09:03.478366 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 14 09:09:03.482505 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance ae344b98-a354-4df8-83ba-3c5a786694f4 while it is in vm_state active Sep 14 09:09:03.482505 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:09:03.482505 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:09:03.482505 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:09:03.482505 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:09:03.482505 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:09:03.482505 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:09:03.482505 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:09:03.482505 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:09:03.482505 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance ae344b98-a354-4df8-83ba-3c5a786694f4 while it is in vm_state active Sep 14 09:09:03.482505 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:09:03.486826 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-bec85198-8ad1-4ff7-9439-2d5772adee83 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Returning 409 to user: Cannot 'unshelve' instance ae344b98-a354-4df8-83ba-3c5a786694f4 while it is in vm_state active {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:09:03.500400 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-bec85198-8ad1-4ff7-9439-2d5772adee83 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "POST /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4/action" status: 409 len: 146 microversion: 2.1 time: 0.173831 Sep 14 09:09:03.515654 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2190/4386] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:09:03 2022] POST /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4/action => generated 146 bytes in 190 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 14 09:09:03.535940 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-0d4fd9c1-3a5c-4fa4-b960-9d2be05bbbf0 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:09:03.538490 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-0d4fd9c1-3a5c-4fa4-b960-9d2be05bbbf0 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:09:03.579465 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0d4fd9c1-3a5c-4fa4-b960-9d2be05bbbf0 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:03.579970 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0d4fd9c1-3a5c-4fa4-b960-9d2be05bbbf0 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:03.580423 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0d4fd9c1-3a5c-4fa4-b960-9d2be05bbbf0 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:03.581198 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0d4fd9c1-3a5c-4fa4-b960-9d2be05bbbf0 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:03.585803 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0d4fd9c1-3a5c-4fa4-b960-9d2be05bbbf0 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:03.586571 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0d4fd9c1-3a5c-4fa4-b960-9d2be05bbbf0 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:03.886595 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-a1925b61-a04a-4ed6-9e41-4bc78e1f7bfd tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5165b8fc101c47c7a4370f9007bc5a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a597fc389b4805bbd3a53ecd17c5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:09:03.896593 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a1925b61-a04a-4ed6-9e41-4bc78e1f7bfd tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute/v2.1/servers/8032c321-1baa-44a9-b3bd-b0ce09999b9e" status: 200 len: 1491 microversion: 2.1 time: 0.617789 Sep 14 09:09:03.912623 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2197/4387] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:09:03 2022] GET /compute/v2.1/servers/8032c321-1baa-44a9-b3bd-b0ce09999b9e => generated 1491 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:09:03.933957 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e74f4b55-3729-44a6-a0e8-b7b2e1f4e7af tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:09:03.934867 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e74f4b55-3729-44a6-a0e8-b7b2e1f4e7af tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] [instance: 6957a5fb-4af4-4ca1-809a-8dd02e517c24] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:09:03.943839 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e74f4b55-3729-44a6-a0e8-b7b2e1f4e7af tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:03.944998 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e74f4b55-3729-44a6-a0e8-b7b2e1f4e7af tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:03.945888 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e74f4b55-3729-44a6-a0e8-b7b2e1f4e7af tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:03.946798 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e74f4b55-3729-44a6-a0e8-b7b2e1f4e7af tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:03.947458 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e74f4b55-3729-44a6-a0e8-b7b2e1f4e7af tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:03.948216 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e74f4b55-3729-44a6-a0e8-b7b2e1f4e7af tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:04.061059 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-0d4fd9c1-3a5c-4fa4-b960-9d2be05bbbf0 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:09:04.073665 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-0d4fd9c1-3a5c-4fa4-b960-9d2be05bbbf0 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1506 microversion: 2.1 time: 0.555601 Sep 14 09:09:04.075793 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2191/4388] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:09:03 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1506 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:09:04.100161 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ec93ee42-972b-4930-8a02-b44c6afc8b59 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:09:04.108502 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-ec93ee42-972b-4930-8a02-b44c6afc8b59 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:09:04.131913 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ec93ee42-972b-4930-8a02-b44c6afc8b59 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:04.132824 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ec93ee42-972b-4930-8a02-b44c6afc8b59 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:04.135442 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ec93ee42-972b-4930-8a02-b44c6afc8b59 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:04.138011 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ec93ee42-972b-4930-8a02-b44c6afc8b59 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:04.139126 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ec93ee42-972b-4930-8a02-b44c6afc8b59 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:04.141001 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ec93ee42-972b-4930-8a02-b44c6afc8b59 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:04.332356 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-ec93ee42-972b-4930-8a02-b44c6afc8b59 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:09:04.341458 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-ec93ee42-972b-4930-8a02-b44c6afc8b59 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:09:04.351320 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-ec93ee42-972b-4930-8a02-b44c6afc8b59 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:09:04.356833 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-ec93ee42-972b-4930-8a02-b44c6afc8b59 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5" status: 200 len: 1333 microversion: 2.20 time: 0.278972 Sep 14 09:09:04.376106 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2192/4389] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:09:04 2022] GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5 => generated 1333 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:09:04.383834 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-68046fe2-f1e0-4a78-b4b3-79bcff41fe00 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:09:04.388962 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-68046fe2-f1e0-4a78-b4b3-79bcff41fe00 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:09:04.404203 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-68046fe2-f1e0-4a78-b4b3-79bcff41fe00 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:04.405095 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-68046fe2-f1e0-4a78-b4b3-79bcff41fe00 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:04.407465 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-68046fe2-f1e0-4a78-b4b3-79bcff41fe00 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:04.409985 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-68046fe2-f1e0-4a78-b4b3-79bcff41fe00 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:04.412659 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-68046fe2-f1e0-4a78-b4b3-79bcff41fe00 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:04.413438 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-68046fe2-f1e0-4a78-b4b3-79bcff41fe00 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:04.438298 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-e74f4b55-3729-44a6-a0e8-b7b2e1f4e7af tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932f3d4bbfd04cae8e48a937a5b10716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b713d80d5243659644e0c74c6df59c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:09:04.450817 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e74f4b55-3729-44a6-a0e8-b7b2e1f4e7af tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] 10.222.0.60 "GET /compute/v2.1/servers/6957a5fb-4af4-4ca1-809a-8dd02e517c24" status: 200 len: 1522 microversion: 2.1 time: 0.535546 Sep 14 09:09:04.451574 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2198/4390] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:09:03 2022] GET /compute/v2.1/servers/6957a5fb-4af4-4ca1-809a-8dd02e517c24 => generated 1522 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:09:04.729312 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-68046fe2-f1e0-4a78-b4b3-79bcff41fe00 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:09:04.737973 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-68046fe2-f1e0-4a78-b4b3-79bcff41fe00 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1506 microversion: 2.1 time: 0.360292 Sep 14 09:09:04.742091 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2193/4391] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:09:04 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1506 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:09:04.766103 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3297ee5c-40e8-46b0-8558-83fb549cd6d1 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1749554677_updated"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:09:04.769834 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-3297ee5c-40e8-46b0-8558-83fb549cd6d1 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: 4da0fae1-a3a9-4e05-8cb2-b1ea2f75efc1] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:09:04.788523 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-3297ee5c-40e8-46b0-8558-83fb549cd6d1 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] HTTP exception thrown: Instance 4da0fae1-a3a9-4e05-8cb2-b1ea2f75efc1 could not be found. Sep 14 09:09:04.790170 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3297ee5c-40e8-46b0-8558-83fb549cd6d1 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Request method failure captured: Sep 14 09:09:04.790170 n-d-836830-18 devstack@n-api.service[128759]: request: PUT /compute/v2.1/servers/4da0fae1-a3a9-4e05-8cb2-b1ea2f75efc1 HTTP/1.1 Sep 14 09:09:04.790170 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:09:04.790170 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:09:04.790170 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:09:04.790170 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 81 Sep 14 09:09:04.790170 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:09:04.790170 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:09:04.790170 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:09:04.790170 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:09:04.790170 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZk2EvHIWQyXATvY4f6phbqF3DzIIyaJjJFCE11LxTKbrsndvuk5zoyyEUR0VXx32_kFjD0I6jBROuj0ZPSHQav7u9FFvOPFGrPkf9qZrgXY9k3zAUFrOVfwLECoLZOolubyCPUAGSEOi_HvFIP_Dd_DCbUCKDEGGLtdnAzy2tLCxHs Sep 14 09:09:04.790170 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:09:04.790170 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:09:04.790170 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:09:04.790170 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:09:04.790170 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:09:04.790170 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:09:04.790170 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 6907b82c9d5c4a23a63bbeec31c3c365 Sep 14 09:09:04.790170 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ServersNegativeTestJSON-1654813540 Sep 14 09:09:04.790170 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:09:04.790170 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:09:04.790170 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6907b82c9d5c4a23a63bbeec31c3c365"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6907b82c9d5c4a23a63bbeec31c3c365"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6907b82c9d5c4a23a63bbeec31c3c365"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6907b82c9d5c4a23a63bbeec31c3c365"}]}] Sep 14 09:09:04.790170 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ServersNegativeTestJSON-1654813540 Sep 14 09:09:04.790170 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 6907b82c9d5c4a23a63bbeec31c3c365 Sep 14 09:09:04.790170 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1654813540 Sep 14 09:09:04.790170 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ServersNegativeTestJSON-1654813540-project Sep 14 09:09:04.790170 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:09:04.790170 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:09:04.790170 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 79583c4e80a04f138927f09eb4e170f4 Sep 14 09:09:04.790170 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ServersNegativeTestJSON-1654813540-project Sep 14 09:09:04.790170 n-d-836830-18 devstack@n-api.service[128759]: Sep 14 09:09:04.790170 n-d-836830-18 devstack@n-api.service[128759]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1749554677_updated"}} Sep 14 09:09:04.790170 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:09:04.790170 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance 4da0fae1-a3a9-4e05-8cb2-b1ea2f75efc1 could not be found. Sep 14 09:09:04.790170 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '4da0fae1-a3a9-4e05-8cb2-b1ea2f75efc1', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1749554677_updated'}}} Sep 14 09:09:04.790170 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:09:04.790170 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:09:04.790170 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:09:04.790170 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:09:04.790170 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:09:04.790170 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:09:04.790170 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 14 09:09:04.790170 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 14 09:09:04.790170 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4da0fae1-a3a9-4e05-8cb2-b1ea2f75efc1 could not be found. Sep 14 09:09:04.790170 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:09:04.790170 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:09:04.790170 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:09:04.790170 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:09:04.790170 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:09:04.790170 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:09:04.790170 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:09:04.790170 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:09:04.790170 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:09:04.790170 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:09:04.790170 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:09:04.790170 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:09:04.790170 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:09:04.790170 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:09:04.790170 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:09:04.790170 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:09:04.790170 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 14 09:09:04.790170 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Sep 14 09:09:04.790170 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Sep 14 09:09:04.790170 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:09:04.794266 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:09:04.794266 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:09:04.794266 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:09:04.794266 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4da0fae1-a3a9-4e05-8cb2-b1ea2f75efc1 could not be found. Sep 14 09:09:04.794266 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:09:04.794266 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:09:04.794266 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:09:04.794266 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:09:04.794266 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:09:04.794266 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:09:04.794266 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:09:04.794266 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:09:04.794266 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4da0fae1-a3a9-4e05-8cb2-b1ea2f75efc1 could not be found. Sep 14 09:09:04.794266 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:09:04.794266 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3297ee5c-40e8-46b0-8558-83fb549cd6d1 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Returning 404 to user: Instance 4da0fae1-a3a9-4e05-8cb2-b1ea2f75efc1 could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:09:04.794266 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-3297ee5c-40e8-46b0-8558-83fb549cd6d1 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "PUT /compute/v2.1/servers/4da0fae1-a3a9-4e05-8cb2-b1ea2f75efc1" status: 404 len: 111 microversion: 2.1 time: 0.029801 Sep 14 09:09:04.794266 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2199/4392] 10.222.0.60 () {60 vars in 1256 bytes} [Wed Sep 14 09:09:04 2022] PUT /compute/v2.1/servers/4da0fae1-a3a9-4e05-8cb2-b1ea2f75efc1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:09:04.800600 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-44c74c18-a587-4bf1-932c-84701408c203 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:09:04.801218 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-44c74c18-a587-4bf1-932c-84701408c203 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:09:04.808735 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-44c74c18-a587-4bf1-932c-84701408c203 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:04.809345 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-44c74c18-a587-4bf1-932c-84701408c203 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:04.810111 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-44c74c18-a587-4bf1-932c-84701408c203 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:04.811154 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-44c74c18-a587-4bf1-932c-84701408c203 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:04.811727 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-44c74c18-a587-4bf1-932c-84701408c203 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:04.812670 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-44c74c18-a587-4bf1-932c-84701408c203 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:04.935624 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3f3d6f8a-53e4-492c-8b9f-c7966f83d1f7 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:09:04.936247 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-3f3d6f8a-53e4-492c-8b9f-c7966f83d1f7 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] [instance: 8032c321-1baa-44a9-b3bd-b0ce09999b9e] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:09:04.955369 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3f3d6f8a-53e4-492c-8b9f-c7966f83d1f7 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:04.955785 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3f3d6f8a-53e4-492c-8b9f-c7966f83d1f7 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:04.957024 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3f3d6f8a-53e4-492c-8b9f-c7966f83d1f7 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:04.959907 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3f3d6f8a-53e4-492c-8b9f-c7966f83d1f7 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:04.961914 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3f3d6f8a-53e4-492c-8b9f-c7966f83d1f7 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:04.963862 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3f3d6f8a-53e4-492c-8b9f-c7966f83d1f7 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:05.322468 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-44c74c18-a587-4bf1-932c-84701408c203 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:09:05.333281 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-44c74c18-a587-4bf1-932c-84701408c203 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1506 microversion: 2.1 time: 0.536485 Sep 14 09:09:05.333886 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2194/4393] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:09:04 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1506 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:09:05.363991 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-0dccf9a0-196e-45d1-a7e0-a51640064a6e tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:09:05.366757 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-0dccf9a0-196e-45d1-a7e0-a51640064a6e tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:09:05.388611 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0dccf9a0-196e-45d1-a7e0-a51640064a6e tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:05.389306 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0dccf9a0-196e-45d1-a7e0-a51640064a6e tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:05.389866 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0dccf9a0-196e-45d1-a7e0-a51640064a6e tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:05.391284 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0dccf9a0-196e-45d1-a7e0-a51640064a6e tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:05.392671 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0dccf9a0-196e-45d1-a7e0-a51640064a6e tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:05.393226 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0dccf9a0-196e-45d1-a7e0-a51640064a6e tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:05.473091 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=100 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:09:05.510888 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-3f3d6f8a-53e4-492c-8b9f-c7966f83d1f7 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5165b8fc101c47c7a4370f9007bc5a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a597fc389b4805bbd3a53ecd17c5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:09:05.531125 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-3f3d6f8a-53e4-492c-8b9f-c7966f83d1f7 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute/v2.1/servers/8032c321-1baa-44a9-b3bd-b0ce09999b9e" status: 200 len: 1491 microversion: 2.1 time: 0.599020 Sep 14 09:09:05.532467 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2200/4394] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:09:04 2022] GET /compute/v2.1/servers/8032c321-1baa-44a9-b3bd-b0ce09999b9e => generated 1491 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:09:05.543588 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-37a2c6f7-2fa5-47da-bd64-80eaa92913e9 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:09:05.544521 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-37a2c6f7-2fa5-47da-bd64-80eaa92913e9 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:09:05.582231 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-37a2c6f7-2fa5-47da-bd64-80eaa92913e9 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:05.592845 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-37a2c6f7-2fa5-47da-bd64-80eaa92913e9 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:05.593619 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-37a2c6f7-2fa5-47da-bd64-80eaa92913e9 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:05.594554 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-37a2c6f7-2fa5-47da-bd64-80eaa92913e9 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:05.595274 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-37a2c6f7-2fa5-47da-bd64-80eaa92913e9 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:05.596044 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-37a2c6f7-2fa5-47da-bd64-80eaa92913e9 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:05.903337 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-37a2c6f7-2fa5-47da-bd64-80eaa92913e9 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:09:05.915268 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-37a2c6f7-2fa5-47da-bd64-80eaa92913e9 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:09:05.917037 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-37a2c6f7-2fa5-47da-bd64-80eaa92913e9 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:09:05.926299 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-37a2c6f7-2fa5-47da-bd64-80eaa92913e9 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5" status: 200 len: 1339 microversion: 2.20 time: 0.391912 Sep 14 09:09:05.935148 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2201/4395] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:09:05 2022] GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5 => generated 1339 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:09:05.945670 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ae74642b-0a6b-4d7f-8106-af4763acecf2 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:09:05.953024 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-ae74642b-0a6b-4d7f-8106-af4763acecf2 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] [instance: 6957a5fb-4af4-4ca1-809a-8dd02e517c24] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:09:05.970707 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ae74642b-0a6b-4d7f-8106-af4763acecf2 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:05.971295 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ae74642b-0a6b-4d7f-8106-af4763acecf2 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:05.972390 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ae74642b-0a6b-4d7f-8106-af4763acecf2 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:05.979626 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ae74642b-0a6b-4d7f-8106-af4763acecf2 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:05.980156 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ae74642b-0a6b-4d7f-8106-af4763acecf2 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:05.980605 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ae74642b-0a6b-4d7f-8106-af4763acecf2 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:06.015412 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-0dccf9a0-196e-45d1-a7e0-a51640064a6e tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:09:06.030067 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-0dccf9a0-196e-45d1-a7e0-a51640064a6e tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1506 microversion: 2.1 time: 0.672064 Sep 14 09:09:06.034300 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2195/4396] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:09:05 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1506 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:09:06.405482 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-d750e52f-b1f6-4981-8ed7-05394e6ddd13 req-e275f07f-90b9-493b-b061-244d20387df8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8032c321-1baa-44a9-b3bd-b0ce09999b9e", "name": "network-vif-plugged", "status": "completed", "tag": "cce2e6e9-f211-4837-a59b-5cf9a4fb29e9"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:09:06.431622 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-d750e52f-b1f6-4981-8ed7-05394e6ddd13 req-e275f07f-90b9-493b-b061-244d20387df8 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:06.433292 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-d750e52f-b1f6-4981-8ed7-05394e6ddd13 req-e275f07f-90b9-493b-b061-244d20387df8 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:06.433779 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-d750e52f-b1f6-4981-8ed7-05394e6ddd13 req-e275f07f-90b9-493b-b061-244d20387df8 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:06.462336 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-d750e52f-b1f6-4981-8ed7-05394e6ddd13 req-e275f07f-90b9-493b-b061-244d20387df8 service nova] Creating event network-vif-plugged:cce2e6e9-f211-4837-a59b-5cf9a4fb29e9 for instance 8032c321-1baa-44a9-b3bd-b0ce09999b9e on n-h2-836830-18 Sep 14 09:09:06.475569 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-d750e52f-b1f6-4981-8ed7-05394e6ddd13 req-e275f07f-90b9-493b-b061-244d20387df8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.425478 Sep 14 09:09:06.484750 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2196/4397] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:09:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:09:06.499047 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a10ec7e2-fae2-4e7c-a8a8-f849157a9569 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:09:06.511256 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a10ec7e2-fae2-4e7c-a8a8-f849157a9569 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Request method failure captured: Sep 14 09:09:06.511256 n-d-836830-18 devstack@n-api.service[128758]: request: PUT /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 HTTP/1.1 Sep 14 09:09:06.511256 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 09:09:06.511256 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 09:09:06.511256 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 09:09:06.511256 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 280 Sep 14 09:09:06.511256 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 09:09:06.511256 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 09:09:06.511256 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 09:09:06.511256 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 09:09:06.511256 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZk2EvHIWQyXATvY4f6phbqF3DzIIyaJjJFCE11LxTKbrsndvuk5zoyyEUR0VXx32_kFjD0I6jBROuj0ZPSHQav7u9FFvOPFGrPkf9qZrgXY9k3zAUFrOVfwLECoLZOolubyCPUAGSEOi_HvFIP_Dd_DCbUCKDEGGLtdnAzy2tLCxHs Sep 14 09:09:06.511256 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 09:09:06.511256 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 09:09:06.511256 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 09:09:06.511256 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 09:09:06.511256 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 09:09:06.511256 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 09:09:06.511256 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 6907b82c9d5c4a23a63bbeec31c3c365 Sep 14 09:09:06.511256 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-ServersNegativeTestJSON-1654813540 Sep 14 09:09:06.511256 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 09:09:06.511256 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 09:09:06.511256 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6907b82c9d5c4a23a63bbeec31c3c365"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6907b82c9d5c4a23a63bbeec31c3c365"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6907b82c9d5c4a23a63bbeec31c3c365"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6907b82c9d5c4a23a63bbeec31c3c365"}]}] Sep 14 09:09:06.511256 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-ServersNegativeTestJSON-1654813540 Sep 14 09:09:06.511256 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 6907b82c9d5c4a23a63bbeec31c3c365 Sep 14 09:09:06.511256 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1654813540 Sep 14 09:09:06.511256 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-ServersNegativeTestJSON-1654813540-project Sep 14 09:09:06.511256 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 09:09:06.511256 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 09:09:06.511256 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 79583c4e80a04f138927f09eb4e170f4 Sep 14 09:09:06.511256 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-ServersNegativeTestJSON-1654813540-project Sep 14 09:09:06.511256 n-d-836830-18 devstack@n-api.service[128758]: Sep 14 09:09:06.511256 n-d-836830-18 devstack@n-api.service[128758]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Sep 14 09:09:06.511256 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 09:09:06.511256 n-d-836830-18 devstack@n-api.service[128758]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 14 09:09:06.511256 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': 'ae344b98-a354-4df8-83ba-3c5a786694f4', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Sep 14 09:09:06.511256 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:09:06.511256 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:09:06.511256 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 14 09:09:06.511256 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 14 09:09:06.511256 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 14 09:09:06.511256 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise error Sep 14 09:09:06.511256 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 14 09:09:06.511256 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:09:06.511256 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Sep 14 09:09:06.511256 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 14 09:09:06.511256 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:09:06.511256 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 14 09:09:06.511256 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Sep 14 09:09:06.511256 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:09:06.511256 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:09:06.511256 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:09:06.511256 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:09:06.516295 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:09:06.516295 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:09:06.516295 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:09:06.516295 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:09:06.516295 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:09:06.516295 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:09:06.516295 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:09:06.516295 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:09:06.516295 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 14 09:09:06.516295 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 14 09:09:06.516295 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 14 09:09:06.516295 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 14 09:09:06.516295 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 14 09:09:06.516295 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 14 09:09:06.516295 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 14 09:09:06.516295 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:09:06.516295 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:09:06.516295 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:09:06.516295 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:09:06.516295 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:09:06.516295 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:09:06.516295 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 14 09:09:06.516295 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 14 09:09:06.516295 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 14 09:09:06.516295 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:09:06.516295 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a10ec7e2-fae2-4e7c-a8a8-f849157a9569 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:09:06.516295 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-a10ec7e2-fae2-4e7c-a8a8-f849157a9569 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "PUT /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 400 len: 619 microversion: 2.1 time: 0.029245 Sep 14 09:09:06.520702 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2197/4398] 10.222.0.60 () {60 vars in 1257 bytes} [Wed Sep 14 09:09:06 2022] PUT /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 619 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 14 09:09:06.525578 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b3c57726-a76d-42ff-9de1-1ce68f7305c1 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:09:06.526329 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-b3c57726-a76d-42ff-9de1-1ce68f7305c1 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:09:06.534746 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b3c57726-a76d-42ff-9de1-1ce68f7305c1 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:06.535295 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b3c57726-a76d-42ff-9de1-1ce68f7305c1 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:06.535737 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b3c57726-a76d-42ff-9de1-1ce68f7305c1 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:06.536639 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b3c57726-a76d-42ff-9de1-1ce68f7305c1 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:06.537652 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b3c57726-a76d-42ff-9de1-1ce68f7305c1 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:06.538099 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b3c57726-a76d-42ff-9de1-1ce68f7305c1 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:07.298088 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-ae74642b-0a6b-4d7f-8106-af4763acecf2 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932f3d4bbfd04cae8e48a937a5b10716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b713d80d5243659644e0c74c6df59c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:09:07.311441 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-ae74642b-0a6b-4d7f-8106-af4763acecf2 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] 10.222.0.60 "GET /compute/v2.1/servers/6957a5fb-4af4-4ca1-809a-8dd02e517c24" status: 200 len: 1522 microversion: 2.1 time: 1.374700 Sep 14 09:09:07.348428 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-b3c57726-a76d-42ff-9de1-1ce68f7305c1 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:09:07.349711 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2202/4399] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:09:05 2022] GET /compute/v2.1/servers/6957a5fb-4af4-4ca1-809a-8dd02e517c24 => generated 1522 bytes in 1414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:09:07.361275 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-b3c57726-a76d-42ff-9de1-1ce68f7305c1 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1506 microversion: 2.1 time: 0.839528 Sep 14 09:09:07.361899 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2198/4400] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:09:06 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1506 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:09:07.362540 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-7ee1dc58-d299-420f-8560-89921f4233d7 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:09:07.369621 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-7ee1dc58-d299-420f-8560-89921f4233d7 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] [instance: 8032c321-1baa-44a9-b3bd-b0ce09999b9e] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:09:07.388480 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7ee1dc58-d299-420f-8560-89921f4233d7 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:07.392656 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7ee1dc58-d299-420f-8560-89921f4233d7 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:07.397896 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7ee1dc58-d299-420f-8560-89921f4233d7 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:07.398125 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-5b22bc13-3bdf-4ad3-8c04-6ad840d1bcaf tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:09:07.398522 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-5b22bc13-3bdf-4ad3-8c04-6ad840d1bcaf tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:09:07.400640 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7ee1dc58-d299-420f-8560-89921f4233d7 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:07.403086 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7ee1dc58-d299-420f-8560-89921f4233d7 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:07.404785 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7ee1dc58-d299-420f-8560-89921f4233d7 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:07.421391 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5b22bc13-3bdf-4ad3-8c04-6ad840d1bcaf tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:07.422613 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5b22bc13-3bdf-4ad3-8c04-6ad840d1bcaf tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:07.427317 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5b22bc13-3bdf-4ad3-8c04-6ad840d1bcaf tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:07.435926 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5b22bc13-3bdf-4ad3-8c04-6ad840d1bcaf tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:07.437698 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5b22bc13-3bdf-4ad3-8c04-6ad840d1bcaf tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:07.439386 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5b22bc13-3bdf-4ad3-8c04-6ad840d1bcaf tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:07.824853 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-7ee1dc58-d299-420f-8560-89921f4233d7 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5165b8fc101c47c7a4370f9007bc5a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a597fc389b4805bbd3a53ecd17c5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:09:07.842210 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-7ee1dc58-d299-420f-8560-89921f4233d7 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute/v2.1/servers/8032c321-1baa-44a9-b3bd-b0ce09999b9e" status: 200 len: 1449 microversion: 2.1 time: 0.491169 Sep 14 09:09:07.871028 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2203/4401] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:09:07 2022] GET /compute/v2.1/servers/8032c321-1baa-44a9-b3bd-b0ce09999b9e => generated 1449 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:09:07.902134 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-4eb5a57d-4125-431a-9075-507e9c2d7465 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:09:07.906162 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-4eb5a57d-4125-431a-9075-507e9c2d7465 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:09:07.937862 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4eb5a57d-4125-431a-9075-507e9c2d7465 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:07.939190 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4eb5a57d-4125-431a-9075-507e9c2d7465 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:07.942499 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4eb5a57d-4125-431a-9075-507e9c2d7465 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:07.946157 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4eb5a57d-4125-431a-9075-507e9c2d7465 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:07.949413 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4eb5a57d-4125-431a-9075-507e9c2d7465 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:07.951563 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4eb5a57d-4125-431a-9075-507e9c2d7465 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:08.021261 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-5b22bc13-3bdf-4ad3-8c04-6ad840d1bcaf tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:09:08.050315 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-5b22bc13-3bdf-4ad3-8c04-6ad840d1bcaf tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:09:08.052668 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-5b22bc13-3bdf-4ad3-8c04-6ad840d1bcaf tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:09:08.054362 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-5b22bc13-3bdf-4ad3-8c04-6ad840d1bcaf tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5" status: 200 len: 1407 microversion: 2.20 time: 0.674580 Sep 14 09:09:08.066378 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2199/4402] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:09:07 2022] GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5 => generated 1407 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:09:08.072394 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-34160335-2ce0-4755-9258-0b7f99b0deb4 req-c60b6fb7-4465-47f6-8de7-0dec697fadc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8032c321-1baa-44a9-b3bd-b0ce09999b9e", "name": "network-vif-deleted", "tag": "cce2e6e9-f211-4837-a59b-5cf9a4fb29e9"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:09:08.109940 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-34160335-2ce0-4755-9258-0b7f99b0deb4 req-c60b6fb7-4465-47f6-8de7-0dec697fadc4 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:08.114079 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-34160335-2ce0-4755-9258-0b7f99b0deb4 req-c60b6fb7-4465-47f6-8de7-0dec697fadc4 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:08.118130 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-34160335-2ce0-4755-9258-0b7f99b0deb4 req-c60b6fb7-4465-47f6-8de7-0dec697fadc4 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:08.151421 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-34160335-2ce0-4755-9258-0b7f99b0deb4 req-c60b6fb7-4465-47f6-8de7-0dec697fadc4 service nova] Creating event network-vif-deleted:cce2e6e9-f211-4837-a59b-5cf9a4fb29e9 for instance 8032c321-1baa-44a9-b3bd-b0ce09999b9e on n-h2-836830-18 Sep 14 09:09:08.173775 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-34160335-2ce0-4755-9258-0b7f99b0deb4 req-c60b6fb7-4465-47f6-8de7-0dec697fadc4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105580 Sep 14 09:09:08.178877 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2200/4403] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:09:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:09:08.342267 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-9805c1fe-95e1-4f02-bdd6-43f805248bb6 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:09:08.343642 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-9805c1fe-95e1-4f02-bdd6-43f805248bb6 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] [instance: 6957a5fb-4af4-4ca1-809a-8dd02e517c24] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:09:08.385169 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9805c1fe-95e1-4f02-bdd6-43f805248bb6 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:08.388715 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9805c1fe-95e1-4f02-bdd6-43f805248bb6 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:08.391074 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9805c1fe-95e1-4f02-bdd6-43f805248bb6 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:08.392554 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9805c1fe-95e1-4f02-bdd6-43f805248bb6 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:08.408642 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9805c1fe-95e1-4f02-bdd6-43f805248bb6 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:08.415104 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9805c1fe-95e1-4f02-bdd6-43f805248bb6 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:08.417027 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-4eb5a57d-4125-431a-9075-507e9c2d7465 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:09:08.433641 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-4eb5a57d-4125-431a-9075-507e9c2d7465 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1506 microversion: 2.1 time: 0.561233 Sep 14 09:09:08.435080 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2204/4404] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:09:07 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1506 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:09:08.471366 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-89962ae6-2878-4bdc-8a99-823c172fc84a tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:09:08.489450 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-89962ae6-2878-4bdc-8a99-823c172fc84a tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Request method failure captured: Sep 14 09:09:08.489450 n-d-836830-18 devstack@n-api.service[128759]: request: PUT /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 HTTP/1.1 Sep 14 09:09:08.489450 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:09:08.489450 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:09:08.489450 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:09:08.489450 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 24 Sep 14 09:09:08.489450 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:09:08.489450 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:09:08.489450 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:09:08.489450 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:09:08.489450 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZk2EvHIWQyXATvY4f6phbqF3DzIIyaJjJFCE11LxTKbrsndvuk5zoyyEUR0VXx32_kFjD0I6jBROuj0ZPSHQav7u9FFvOPFGrPkf9qZrgXY9k3zAUFrOVfwLECoLZOolubyCPUAGSEOi_HvFIP_Dd_DCbUCKDEGGLtdnAzy2tLCxHs Sep 14 09:09:08.489450 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:09:08.489450 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:09:08.489450 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:09:08.489450 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:09:08.489450 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:09:08.489450 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:09:08.489450 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 6907b82c9d5c4a23a63bbeec31c3c365 Sep 14 09:09:08.489450 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ServersNegativeTestJSON-1654813540 Sep 14 09:09:08.489450 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:09:08.489450 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:09:08.489450 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6907b82c9d5c4a23a63bbeec31c3c365"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6907b82c9d5c4a23a63bbeec31c3c365"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6907b82c9d5c4a23a63bbeec31c3c365"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6907b82c9d5c4a23a63bbeec31c3c365"}]}] Sep 14 09:09:08.489450 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ServersNegativeTestJSON-1654813540 Sep 14 09:09:08.489450 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 6907b82c9d5c4a23a63bbeec31c3c365 Sep 14 09:09:08.489450 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1654813540 Sep 14 09:09:08.489450 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ServersNegativeTestJSON-1654813540-project Sep 14 09:09:08.489450 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:09:08.489450 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:09:08.489450 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 79583c4e80a04f138927f09eb4e170f4 Sep 14 09:09:08.489450 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ServersNegativeTestJSON-1654813540-project Sep 14 09:09:08.489450 n-d-836830-18 devstack@n-api.service[128759]: Sep 14 09:09:08.489450 n-d-836830-18 devstack@n-api.service[128759]: {"server": {"name": ""}} Sep 14 09:09:08.489450 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:09:08.489450 n-d-836830-18 devstack@n-api.service[128759]: exception: Invalid input for field/attribute name. Value: . '' is too short Sep 14 09:09:08.489450 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': 'ae344b98-a354-4df8-83ba-3c5a786694f4', 'body': {'server': {'name': ''}}} Sep 14 09:09:08.489450 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:09:08.489450 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:09:08.489450 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 14 09:09:08.489450 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 14 09:09:08.489450 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 14 09:09:08.489450 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise error Sep 14 09:09:08.489450 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Sep 14 09:09:08.489450 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:09:08.489450 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Sep 14 09:09:08.489450 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 14 09:09:08.489450 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:09:08.489450 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 14 09:09:08.489450 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi '' Sep 14 09:09:08.489450 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:09:08.489450 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:09:08.489450 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:09:08.489450 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:09:08.489450 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:09:08.489450 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:09:08.489450 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:09:08.489450 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:09:08.489450 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:09:08.489450 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:09:08.489450 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:09:08.489450 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:09:08.489450 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 14 09:09:08.489450 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 14 09:09:08.489450 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 14 09:09:08.489450 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 14 09:09:08.489450 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 14 09:09:08.489450 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 14 09:09:08.494480 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Sep 14 09:09:08.494480 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:09:08.494480 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:09:08.494480 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:09:08.494480 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:09:08.494480 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:09:08.494480 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:09:08.494480 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 14 09:09:08.494480 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 14 09:09:08.494480 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Sep 14 09:09:08.494480 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:09:08.498441 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-89962ae6-2878-4bdc-8a99-823c172fc84a tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:09:08.505353 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-89962ae6-2878-4bdc-8a99-823c172fc84a tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "PUT /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 400 len: 108 microversion: 2.1 time: 0.043457 Sep 14 09:09:08.509986 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2205/4405] 10.222.0.60 () {60 vars in 1256 bytes} [Wed Sep 14 09:09:08 2022] PUT /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 108 bytes in 50 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 14 09:09:08.522895 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-550db89b-b2f3-4892-b48f-6d8ddcd33153 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:09:08.526070 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-550db89b-b2f3-4892-b48f-6d8ddcd33153 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:09:08.551743 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-550db89b-b2f3-4892-b48f-6d8ddcd33153 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:08.552658 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-550db89b-b2f3-4892-b48f-6d8ddcd33153 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:08.553697 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-550db89b-b2f3-4892-b48f-6d8ddcd33153 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:08.555215 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-550db89b-b2f3-4892-b48f-6d8ddcd33153 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:08.555846 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-550db89b-b2f3-4892-b48f-6d8ddcd33153 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:08.556612 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-550db89b-b2f3-4892-b48f-6d8ddcd33153 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:08.880867 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-9805c1fe-95e1-4f02-bdd6-43f805248bb6 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932f3d4bbfd04cae8e48a937a5b10716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b713d80d5243659644e0c74c6df59c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:09:08.890808 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-9805c1fe-95e1-4f02-bdd6-43f805248bb6 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] 10.222.0.60 "GET /compute/v2.1/servers/6957a5fb-4af4-4ca1-809a-8dd02e517c24" status: 200 len: 1502 microversion: 2.1 time: 0.552727 Sep 14 09:09:08.896262 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-550db89b-b2f3-4892-b48f-6d8ddcd33153 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:09:08.905995 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2201/4406] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:09:08 2022] GET /compute/v2.1/servers/6957a5fb-4af4-4ca1-809a-8dd02e517c24 => generated 1502 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:09:08.910903 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-550db89b-b2f3-4892-b48f-6d8ddcd33153 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1506 microversion: 2.1 time: 0.398505 Sep 14 09:09:08.918195 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2206/4407] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:09:08 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1506 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:09:08.920262 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-eaf1107d-a05b-4533-a442-a66fc348185a tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:09:08.922624 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-eaf1107d-a05b-4533-a442-a66fc348185a tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] [instance: 8032c321-1baa-44a9-b3bd-b0ce09999b9e] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:09:08.932593 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-2c7bbf30-8aef-4699-b015-077182fc5d4a tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Action: 'create', calling method: .version_select at 0x7f7d3eed59d0>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-966901935", "description": "tempest-description-340093135"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:09:08.961969 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-eaf1107d-a05b-4533-a442-a66fc348185a tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:08.962805 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-eaf1107d-a05b-4533-a442-a66fc348185a tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:08.964885 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-eaf1107d-a05b-4533-a442-a66fc348185a tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:08.965981 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-eaf1107d-a05b-4533-a442-a66fc348185a tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:08.967737 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-eaf1107d-a05b-4533-a442-a66fc348185a tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:08.969135 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-eaf1107d-a05b-4533-a442-a66fc348185a tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:09.004106 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-eaf1107d-a05b-4533-a442-a66fc348185a tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] HTTP exception thrown: Instance 8032c321-1baa-44a9-b3bd-b0ce09999b9e could not be found. Sep 14 09:09:09.006630 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-eaf1107d-a05b-4533-a442-a66fc348185a tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Request method failure captured: Sep 14 09:09:09.006630 n-d-836830-18 devstack@n-api.service[128758]: request: GET /compute/v2.1/servers/8032c321-1baa-44a9-b3bd-b0ce09999b9e HTTP/1.1 Sep 14 09:09:09.006630 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 09:09:09.006630 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 09:09:09.006630 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 09:09:09.006630 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 09:09:09.006630 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 09:09:09.006630 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 09:09:09.006630 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 09:09:09.006630 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 09:09:09.006630 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZk14GDuYfxsa-wsuRIzuMO54ZShhfsgwUWfj31e0zoblQtY51e_R-CAnEXwf-TeZMtlksIN48WuJE6pMDpTtkDTOMNoN3z5PF_FFos2425zrkF0JqqhjIavK21BkzJ8vfAPZ1nB6uut9GecGR4ysuDCA3zc9nB4uf2O7loF0oE9d4c Sep 14 09:09:09.006630 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 09:09:09.006630 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 09:09:09.006630 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 09:09:09.006630 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 09:09:09.006630 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 09:09:09.006630 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 09:09:09.006630 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 62a597fc389b4805bbd3a53ecd17c5b2 Sep 14 09:09:09.006630 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-ImagesTestJSON-1442595664 Sep 14 09:09:09.006630 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 09:09:09.006630 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 09:09:09.006630 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/62a597fc389b4805bbd3a53ecd17c5b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_62a597fc389b4805bbd3a53ecd17c5b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/62a597fc389b4805bbd3a53ecd17c5b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/62a597fc389b4805bbd3a53ecd17c5b2"}]}] Sep 14 09:09:09.006630 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-ImagesTestJSON-1442595664 Sep 14 09:09:09.006630 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 62a597fc389b4805bbd3a53ecd17c5b2 Sep 14 09:09:09.006630 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-ImagesTestJSON-1442595664 Sep 14 09:09:09.006630 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-ImagesTestJSON-1442595664-project Sep 14 09:09:09.006630 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 09:09:09.006630 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 09:09:09.006630 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 5165b8fc101c47c7a4370f9007bc5a58 Sep 14 09:09:09.006630 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-ImagesTestJSON-1442595664-project Sep 14 09:09:09.006630 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 09:09:09.006630 n-d-836830-18 devstack@n-api.service[128758]: exception: Instance 8032c321-1baa-44a9-b3bd-b0ce09999b9e could not be found. Sep 14 09:09:09.006630 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': '8032c321-1baa-44a9-b3bd-b0ce09999b9e'} Sep 14 09:09:09.006630 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:09:09.006630 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:09:09.006630 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:09:09.006630 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:09:09.006630 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:09:09.006630 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:09:09.006630 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:09:09.006630 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:09:09.006630 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:09:09.006630 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:09:09.006630 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8032c321-1baa-44a9-b3bd-b0ce09999b9e could not be found. Sep 14 09:09:09.006630 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:09:09.006630 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:09:09.006630 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:09:09.006630 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:09:09.006630 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:09:09.006630 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:09:09.006630 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:09:09.006630 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:09:09.006630 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:09:09.006630 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:09:09.006630 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:09:09.006630 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:09:09.006630 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:09:09.006630 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:09:09.006630 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:09:09.006630 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:09:09.006630 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8032c321-1baa-44a9-b3bd-b0ce09999b9e could not be found. Sep 14 09:09:09.006630 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:09:09.006630 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:09:09.006630 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:09:09.006630 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:09:09.012467 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:09:09.012467 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:09:09.012467 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:09:09.012467 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:09:09.012467 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8032c321-1baa-44a9-b3bd-b0ce09999b9e could not be found. Sep 14 09:09:09.012467 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:09:09.015925 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-eaf1107d-a05b-4533-a442-a66fc348185a tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Returning 404 to user: Instance 8032c321-1baa-44a9-b3bd-b0ce09999b9e could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:09:09.017376 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-eaf1107d-a05b-4533-a442-a66fc348185a tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute/v2.1/servers/8032c321-1baa-44a9-b3bd-b0ce09999b9e" status: 404 len: 111 microversion: 2.1 time: 0.108567 Sep 14 09:09:09.018304 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2202/4408] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:09:08 2022] GET /compute/v2.1/servers/8032c321-1baa-44a9-b3bd-b0ce09999b9e => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:09:09.031927 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-16a671ff-870f-4827-b910-987cca200a8a tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '.version_select at 0x7f7d3f455dc0>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:09:09.098544 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-16a671ff-870f-4827-b910-987cca200a8a tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] HTTP exception thrown: Image not found. Sep 14 09:09:09.100421 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-16a671ff-870f-4827-b910-987cca200a8a tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Request method failure captured: Sep 14 09:09:09.100421 n-d-836830-18 devstack@n-api.service[128758]: request: DELETE /compute/v2.1/images/b6fa7f64-f6a6-4a4f-bea4-43535ee682c5 HTTP/1.1 Sep 14 09:09:09.100421 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 09:09:09.100421 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 09:09:09.100421 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 09:09:09.100421 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 09:09:09.100421 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 09:09:09.100421 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 09:09:09.100421 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 09:09:09.100421 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 09:09:09.100421 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZk14GDuYfxsa-wsuRIzuMO54ZShhfsgwUWfj31e0zoblQtY51e_R-CAnEXwf-TeZMtlksIN48WuJE6pMDpTtkDTOMNoN3z5PF_FFos2425zrkF0JqqhjIavK21BkzJ8vfAPZ1nB6uut9GecGR4ysuDCA3zc9nB4uf2O7loF0oE9d4c Sep 14 09:09:09.100421 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 09:09:09.100421 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 09:09:09.100421 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 09:09:09.100421 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 09:09:09.100421 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 09:09:09.100421 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 09:09:09.100421 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 62a597fc389b4805bbd3a53ecd17c5b2 Sep 14 09:09:09.100421 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-ImagesTestJSON-1442595664 Sep 14 09:09:09.100421 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 09:09:09.100421 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 09:09:09.100421 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/62a597fc389b4805bbd3a53ecd17c5b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_62a597fc389b4805bbd3a53ecd17c5b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/62a597fc389b4805bbd3a53ecd17c5b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/62a597fc389b4805bbd3a53ecd17c5b2"}]}] Sep 14 09:09:09.100421 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-ImagesTestJSON-1442595664 Sep 14 09:09:09.100421 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 62a597fc389b4805bbd3a53ecd17c5b2 Sep 14 09:09:09.100421 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-ImagesTestJSON-1442595664 Sep 14 09:09:09.100421 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-ImagesTestJSON-1442595664-project Sep 14 09:09:09.100421 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 09:09:09.100421 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 09:09:09.100421 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 5165b8fc101c47c7a4370f9007bc5a58 Sep 14 09:09:09.100421 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-ImagesTestJSON-1442595664-project Sep 14 09:09:09.100421 n-d-836830-18 devstack@n-api.service[128758]: method: Sep 14 09:09:09.100421 n-d-836830-18 devstack@n-api.service[128758]: exception: Image not found. Sep 14 09:09:09.100421 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': 'b6fa7f64-f6a6-4a4f-bea4-43535ee682c5'} Sep 14 09:09:09.100421 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:09:09.100421 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:09:09.100421 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 14 09:09:09.100421 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 14 09:09:09.100421 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 14 09:09:09.100421 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 14 09:09:09.100421 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 14 09:09:09.100421 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 14 09:09:09.100421 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 14 09:09:09.100421 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 14 09:09:09.100421 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 14 09:09:09.100421 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 14 09:09:09.100421 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 14 09:09:09.100421 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 14 09:09:09.100421 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 14 09:09:09.100421 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 14 09:09:09.100421 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image b6fa7f64-f6a6-4a4f-bea4-43535ee682c5 to delete Sep 14 09:09:09.100421 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:09:09.100421 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:09:09.100421 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:09:09.100421 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:09:09.100421 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 14 09:09:09.100421 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 14 09:09:09.100421 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 14 09:09:09.100421 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 14 09:09:09.100421 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 14 09:09:09.100421 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 14 09:09:09.100421 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image b6fa7f64-f6a6-4a4f-bea4-43535ee682c5 could not be found. Sep 14 09:09:09.100421 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:09:09.100421 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:09:09.100421 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:09:09.100421 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:09:09.104489 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:09:09.104489 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:09:09.104489 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:09:09.104489 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:09:09.104489 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:09:09.104489 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:09:09.104489 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:09:09.104489 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:09:09.104489 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 14 09:09:09.104489 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 14 09:09:09.104489 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 14 09:09:09.104489 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:09:09.104489 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:09:09.104489 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:09:09.104489 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:09:09.104489 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:09:09.104489 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:09:09.104489 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:09:09.104489 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:09:09.104489 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 14 09:09:09.104489 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:09:09.104489 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-16a671ff-870f-4827-b910-987cca200a8a tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Returning 404 to user: Image not found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:09:09.104489 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-16a671ff-870f-4827-b910-987cca200a8a tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "DELETE /compute/v2.1/images/b6fa7f64-f6a6-4a4f-bea4-43535ee682c5" status: 404 len: 62 microversion: 2.1 time: 0.078559 Sep 14 09:09:09.104489 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2203/4409] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:09:09 2022] DELETE /compute/v2.1/images/b6fa7f64-f6a6-4a4f-bea4-43535ee682c5 => generated 62 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 14 09:09:09.114476 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-30e55548-9cf6-439a-8bac-6923abdabbac tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:09:09.140119 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-30e55548-9cf6-439a-8bac-6923abdabbac tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:09:09.172945 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-30e55548-9cf6-439a-8bac-6923abdabbac tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:09.173876 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-30e55548-9cf6-439a-8bac-6923abdabbac tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:09.174514 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-30e55548-9cf6-439a-8bac-6923abdabbac tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:09.175969 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-30e55548-9cf6-439a-8bac-6923abdabbac tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:09.176597 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-30e55548-9cf6-439a-8bac-6923abdabbac tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:09.177193 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-30e55548-9cf6-439a-8bac-6923abdabbac tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:09.417668 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-2c7bbf30-8aef-4699-b015-077182fc5d4a tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] 10.222.0.60 "POST /compute/v2.1/os-security-groups" status: 200 len: 249 microversion: 2.1 time: 0.489698 Sep 14 09:09:09.426979 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2207/4410] 10.222.0.60 () {60 vars in 1180 bytes} [Wed Sep 14 09:09:08 2022] POST /compute/v2.1/os-security-groups => generated 249 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:09:09.430551 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-63280a1c-fdee-4096-9a77-77a5e6304d33 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:09:09.431083 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-63280a1c-fdee-4096-9a77-77a5e6304d33 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] [instance: f8ddffc4-a877-4f95-840c-ad8ef8021755] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:09:09.439101 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-63280a1c-fdee-4096-9a77-77a5e6304d33 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:09.439601 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-63280a1c-fdee-4096-9a77-77a5e6304d33 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:09.440038 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-63280a1c-fdee-4096-9a77-77a5e6304d33 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:09.440971 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-63280a1c-fdee-4096-9a77-77a5e6304d33 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:09.441271 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-63280a1c-fdee-4096-9a77-77a5e6304d33 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:09.441962 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-63280a1c-fdee-4096-9a77-77a5e6304d33 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:09.484160 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-63280a1c-fdee-4096-9a77-77a5e6304d33 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] HTTP exception thrown: Instance f8ddffc4-a877-4f95-840c-ad8ef8021755 could not be found. Sep 14 09:09:09.486088 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-63280a1c-fdee-4096-9a77-77a5e6304d33 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Request method failure captured: Sep 14 09:09:09.486088 n-d-836830-18 devstack@n-api.service[128759]: request: DELETE /compute/v2.1/servers/f8ddffc4-a877-4f95-840c-ad8ef8021755 HTTP/1.1 Sep 14 09:09:09.486088 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:09:09.486088 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:09:09.486088 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:09:09.486088 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:09:09.486088 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:09:09.486088 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:09:09.486088 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:09:09.486088 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:09:09.486088 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZk14GDuYfxsa-wsuRIzuMO54ZShhfsgwUWfj31e0zoblQtY51e_R-CAnEXwf-TeZMtlksIN48WuJE6pMDpTtkDTOMNoN3z5PF_FFos2425zrkF0JqqhjIavK21BkzJ8vfAPZ1nB6uut9GecGR4ysuDCA3zc9nB4uf2O7loF0oE9d4c Sep 14 09:09:09.486088 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:09:09.486088 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:09:09.486088 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:09:09.486088 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:09:09.486088 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:09:09.486088 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:09:09.486088 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 62a597fc389b4805bbd3a53ecd17c5b2 Sep 14 09:09:09.486088 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ImagesTestJSON-1442595664 Sep 14 09:09:09.486088 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:09:09.486088 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:09:09.486088 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/62a597fc389b4805bbd3a53ecd17c5b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_62a597fc389b4805bbd3a53ecd17c5b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/62a597fc389b4805bbd3a53ecd17c5b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/62a597fc389b4805bbd3a53ecd17c5b2"}]}] Sep 14 09:09:09.486088 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ImagesTestJSON-1442595664 Sep 14 09:09:09.486088 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 62a597fc389b4805bbd3a53ecd17c5b2 Sep 14 09:09:09.486088 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ImagesTestJSON-1442595664 Sep 14 09:09:09.486088 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ImagesTestJSON-1442595664-project Sep 14 09:09:09.486088 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:09:09.486088 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:09:09.486088 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 5165b8fc101c47c7a4370f9007bc5a58 Sep 14 09:09:09.486088 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ImagesTestJSON-1442595664-project Sep 14 09:09:09.486088 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:09:09.486088 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance f8ddffc4-a877-4f95-840c-ad8ef8021755 could not be found. Sep 14 09:09:09.486088 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': 'f8ddffc4-a877-4f95-840c-ad8ef8021755'} Sep 14 09:09:09.486088 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:09:09.486088 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:09:09.486088 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:09:09.486088 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:09:09.486088 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:09:09.486088 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:09:09.486088 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:09:09.486088 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:09:09.486088 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:09:09.486088 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:09:09.486088 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8ddffc4-a877-4f95-840c-ad8ef8021755 could not be found. Sep 14 09:09:09.486088 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:09:09.486088 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:09:09.486088 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:09:09.486088 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:09:09.486088 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:09:09.486088 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:09:09.486088 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:09:09.486088 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:09:09.486088 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:09:09.486088 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:09:09.486088 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 09:09:09.486088 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 09:09:09.486088 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 09:09:09.486088 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 09:09:09.486088 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:09:09.486088 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:09:09.486088 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:09:09.486088 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:09:09.486088 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8ddffc4-a877-4f95-840c-ad8ef8021755 could not be found. Sep 14 09:09:09.491273 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:09:09.491273 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:09:09.491273 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:09:09.491273 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:09:09.491273 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:09:09.491273 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:09:09.491273 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:09:09.491273 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:09:09.491273 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8ddffc4-a877-4f95-840c-ad8ef8021755 could not be found. Sep 14 09:09:09.491273 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:09:09.495156 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-63280a1c-fdee-4096-9a77-77a5e6304d33 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Returning 404 to user: Instance f8ddffc4-a877-4f95-840c-ad8ef8021755 could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:09:09.496219 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-63280a1c-fdee-4096-9a77-77a5e6304d33 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "DELETE /compute/v2.1/servers/f8ddffc4-a877-4f95-840c-ad8ef8021755" status: 404 len: 111 microversion: 2.1 time: 0.076697 Sep 14 09:09:09.499922 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2208/4411] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:09:09 2022] DELETE /compute/v2.1/servers/f8ddffc4-a877-4f95-840c-ad8ef8021755 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:09:09.509608 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f2487e66-363f-4692-bac3-3cea0e2ff81c tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-966901935"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:09:09.510431 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f2487e66-363f-4692-bac3-3cea0e2ff81c tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] [instance: 6957a5fb-4af4-4ca1-809a-8dd02e517c24] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:09:09.526676 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f2487e66-363f-4692-bac3-3cea0e2ff81c tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:09.527702 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f2487e66-363f-4692-bac3-3cea0e2ff81c tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:09.528066 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f2487e66-363f-4692-bac3-3cea0e2ff81c tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:09.528778 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f2487e66-363f-4692-bac3-3cea0e2ff81c tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:09.529411 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f2487e66-363f-4692-bac3-3cea0e2ff81c tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:09.529822 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f2487e66-363f-4692-bac3-3cea0e2ff81c tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:09.660437 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-30e55548-9cf6-439a-8bac-6923abdabbac tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:09:09.674696 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-30e55548-9cf6-439a-8bac-6923abdabbac tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:09:09.683531 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-30e55548-9cf6-439a-8bac-6923abdabbac tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:09:09.688138 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-30e55548-9cf6-439a-8bac-6923abdabbac tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5" status: 200 len: 1407 microversion: 2.20 time: 0.581478 Sep 14 09:09:09.689611 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2204/4412] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:09:09 2022] GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5 => generated 1407 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:09:09.699781 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-3bdc4e65-3828-4a8d-8317-931a653ad853 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:09:09.700617 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-3bdc4e65-3828-4a8d-8317-931a653ad853 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] [instance: f8ddffc4-a877-4f95-840c-ad8ef8021755] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:09:09.714544 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3bdc4e65-3828-4a8d-8317-931a653ad853 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:09.715081 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3bdc4e65-3828-4a8d-8317-931a653ad853 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:09.719556 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3bdc4e65-3828-4a8d-8317-931a653ad853 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:09.720527 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3bdc4e65-3828-4a8d-8317-931a653ad853 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:09.721429 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3bdc4e65-3828-4a8d-8317-931a653ad853 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:09.723513 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3bdc4e65-3828-4a8d-8317-931a653ad853 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:09.755625 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-3bdc4e65-3828-4a8d-8317-931a653ad853 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] HTTP exception thrown: Instance f8ddffc4-a877-4f95-840c-ad8ef8021755 could not be found. Sep 14 09:09:09.761465 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-3bdc4e65-3828-4a8d-8317-931a653ad853 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Request method failure captured: Sep 14 09:09:09.761465 n-d-836830-18 devstack@n-api.service[128758]: request: GET /compute/v2.1/servers/f8ddffc4-a877-4f95-840c-ad8ef8021755 HTTP/1.1 Sep 14 09:09:09.761465 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 09:09:09.761465 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 09:09:09.761465 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 09:09:09.761465 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 09:09:09.761465 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 09:09:09.761465 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 09:09:09.761465 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 09:09:09.761465 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 09:09:09.761465 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZk14GDuYfxsa-wsuRIzuMO54ZShhfsgwUWfj31e0zoblQtY51e_R-CAnEXwf-TeZMtlksIN48WuJE6pMDpTtkDTOMNoN3z5PF_FFos2425zrkF0JqqhjIavK21BkzJ8vfAPZ1nB6uut9GecGR4ysuDCA3zc9nB4uf2O7loF0oE9d4c Sep 14 09:09:09.761465 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 09:09:09.761465 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 09:09:09.761465 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 09:09:09.761465 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 09:09:09.761465 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 09:09:09.761465 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 09:09:09.761465 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 62a597fc389b4805bbd3a53ecd17c5b2 Sep 14 09:09:09.761465 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-ImagesTestJSON-1442595664 Sep 14 09:09:09.761465 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 09:09:09.761465 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 09:09:09.761465 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/62a597fc389b4805bbd3a53ecd17c5b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_62a597fc389b4805bbd3a53ecd17c5b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/62a597fc389b4805bbd3a53ecd17c5b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/62a597fc389b4805bbd3a53ecd17c5b2"}]}] Sep 14 09:09:09.761465 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-ImagesTestJSON-1442595664 Sep 14 09:09:09.761465 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 62a597fc389b4805bbd3a53ecd17c5b2 Sep 14 09:09:09.761465 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-ImagesTestJSON-1442595664 Sep 14 09:09:09.761465 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-ImagesTestJSON-1442595664-project Sep 14 09:09:09.761465 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 09:09:09.761465 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 09:09:09.761465 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 5165b8fc101c47c7a4370f9007bc5a58 Sep 14 09:09:09.761465 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-ImagesTestJSON-1442595664-project Sep 14 09:09:09.761465 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 09:09:09.761465 n-d-836830-18 devstack@n-api.service[128758]: exception: Instance f8ddffc4-a877-4f95-840c-ad8ef8021755 could not be found. Sep 14 09:09:09.761465 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': 'f8ddffc4-a877-4f95-840c-ad8ef8021755'} Sep 14 09:09:09.761465 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:09:09.761465 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:09:09.761465 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:09:09.761465 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:09:09.761465 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:09:09.761465 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:09:09.761465 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:09:09.761465 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:09:09.761465 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:09:09.761465 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:09:09.761465 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8ddffc4-a877-4f95-840c-ad8ef8021755 could not be found. Sep 14 09:09:09.761465 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:09:09.761465 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:09:09.761465 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:09:09.761465 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:09:09.761465 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:09:09.761465 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:09:09.761465 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:09:09.761465 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:09:09.761465 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:09:09.761465 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:09:09.761465 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:09:09.761465 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:09:09.761465 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:09:09.761465 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:09:09.761465 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:09:09.761465 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:09:09.761465 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8ddffc4-a877-4f95-840c-ad8ef8021755 could not be found. Sep 14 09:09:09.761465 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:09:09.761465 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:09:09.761465 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:09:09.761465 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:09:09.766357 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:09:09.766357 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:09:09.766357 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:09:09.766357 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:09:09.766357 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8ddffc4-a877-4f95-840c-ad8ef8021755 could not be found. Sep 14 09:09:09.766357 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:09:09.769214 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-3bdc4e65-3828-4a8d-8317-931a653ad853 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Returning 404 to user: Instance f8ddffc4-a877-4f95-840c-ad8ef8021755 could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:09:09.773851 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-3bdc4e65-3828-4a8d-8317-931a653ad853 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute/v2.1/servers/f8ddffc4-a877-4f95-840c-ad8ef8021755" status: 404 len: 111 microversion: 2.1 time: 0.082880 Sep 14 09:09:09.792403 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2205/4413] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:09:09 2022] GET /compute/v2.1/servers/f8ddffc4-a877-4f95-840c-ad8ef8021755 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:09:09.812663 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-3b276356-fce4-41ea-9eeb-3c73a55710f0 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:09:09.813609 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-3b276356-fce4-41ea-9eeb-3c73a55710f0 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:09:09.822508 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3b276356-fce4-41ea-9eeb-3c73a55710f0 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:09.823316 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3b276356-fce4-41ea-9eeb-3c73a55710f0 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:09.824781 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3b276356-fce4-41ea-9eeb-3c73a55710f0 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:09.825752 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3b276356-fce4-41ea-9eeb-3c73a55710f0 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:09.826642 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3b276356-fce4-41ea-9eeb-3c73a55710f0 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:09.827459 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3b276356-fce4-41ea-9eeb-3c73a55710f0 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:09.869317 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.network.security_group_api [None req-f2487e66-363f-4692-bac3-3cea0e2ff81c tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Adding security group eb0e9013-6b5d-456d-bd00-85d0f241e025 to port ace61c6b-a7bc-48b0-ba9c-109092ffc122 Sep 14 09:09:10.194290 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-3b276356-fce4-41ea-9eeb-3c73a55710f0 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:09:10.202764 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-3b276356-fce4-41ea-9eeb-3c73a55710f0 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105" status: 200 len: 1668 microversion: 2.1 time: 0.408997 Sep 14 09:09:10.205963 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2206/4414] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:09:09 2022] GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105 => generated 1668 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:09:10.261449 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c08215c4-5660-44da-972c-d2b1f05a2fdb tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '.version_select at 0x7f7d3f4ad820>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:09:10.300515 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-c08215c4-5660-44da-972c-d2b1f05a2fdb tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] HTTP exception thrown: Image not found. Sep 14 09:09:10.302717 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c08215c4-5660-44da-972c-d2b1f05a2fdb tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Request method failure captured: Sep 14 09:09:10.302717 n-d-836830-18 devstack@n-api.service[128758]: request: DELETE /compute/v2.1/images/07477c68-aba6-4fa9-a6a2-3ce18dedfc78 HTTP/1.1 Sep 14 09:09:10.302717 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 09:09:10.302717 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 09:09:10.302717 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 09:09:10.302717 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 09:09:10.302717 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 09:09:10.302717 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 09:09:10.302717 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 09:09:10.302717 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 09:09:10.302717 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZk14GDuYfxsa-wsuRIzuMO54ZShhfsgwUWfj31e0zoblQtY51e_R-CAnEXwf-TeZMtlksIN48WuJE6pMDpTtkDTOMNoN3z5PF_FFos2425zrkF0JqqhjIavK21BkzJ8vfAPZ1nB6uut9GecGR4ysuDCA3zc9nB4uf2O7loF0oE9d4c Sep 14 09:09:10.302717 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 09:09:10.302717 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 09:09:10.302717 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 09:09:10.302717 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 09:09:10.302717 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 09:09:10.302717 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 09:09:10.302717 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 62a597fc389b4805bbd3a53ecd17c5b2 Sep 14 09:09:10.302717 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-ImagesTestJSON-1442595664 Sep 14 09:09:10.302717 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 09:09:10.302717 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 09:09:10.302717 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/62a597fc389b4805bbd3a53ecd17c5b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_62a597fc389b4805bbd3a53ecd17c5b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/62a597fc389b4805bbd3a53ecd17c5b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/62a597fc389b4805bbd3a53ecd17c5b2"}]}] Sep 14 09:09:10.302717 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-ImagesTestJSON-1442595664 Sep 14 09:09:10.302717 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 62a597fc389b4805bbd3a53ecd17c5b2 Sep 14 09:09:10.302717 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-ImagesTestJSON-1442595664 Sep 14 09:09:10.302717 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-ImagesTestJSON-1442595664-project Sep 14 09:09:10.302717 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 09:09:10.302717 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 09:09:10.302717 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 5165b8fc101c47c7a4370f9007bc5a58 Sep 14 09:09:10.302717 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-ImagesTestJSON-1442595664-project Sep 14 09:09:10.302717 n-d-836830-18 devstack@n-api.service[128758]: method: Sep 14 09:09:10.302717 n-d-836830-18 devstack@n-api.service[128758]: exception: Image not found. Sep 14 09:09:10.302717 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': '07477c68-aba6-4fa9-a6a2-3ce18dedfc78'} Sep 14 09:09:10.302717 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:09:10.302717 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:09:10.302717 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 14 09:09:10.302717 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 14 09:09:10.302717 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 14 09:09:10.302717 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 14 09:09:10.302717 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 14 09:09:10.302717 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 14 09:09:10.302717 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 14 09:09:10.302717 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 14 09:09:10.302717 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 14 09:09:10.302717 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 14 09:09:10.302717 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 14 09:09:10.302717 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 14 09:09:10.302717 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 14 09:09:10.302717 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 14 09:09:10.302717 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 07477c68-aba6-4fa9-a6a2-3ce18dedfc78 to delete Sep 14 09:09:10.302717 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:09:10.302717 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:09:10.302717 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:09:10.302717 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:09:10.302717 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 14 09:09:10.302717 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 14 09:09:10.302717 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 14 09:09:10.302717 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 14 09:09:10.302717 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 14 09:09:10.302717 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 14 09:09:10.302717 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 07477c68-aba6-4fa9-a6a2-3ce18dedfc78 could not be found. Sep 14 09:09:10.302717 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:09:10.302717 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:09:10.302717 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:09:10.302717 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:09:10.307507 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:09:10.307507 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:09:10.307507 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:09:10.307507 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:09:10.307507 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:09:10.307507 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:09:10.307507 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:09:10.307507 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:09:10.307507 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 14 09:09:10.307507 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 14 09:09:10.307507 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 14 09:09:10.307507 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:09:10.307507 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:09:10.307507 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:09:10.307507 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:09:10.307507 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:09:10.307507 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:09:10.307507 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:09:10.307507 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:09:10.307507 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 14 09:09:10.307507 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:09:10.310095 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c08215c4-5660-44da-972c-d2b1f05a2fdb tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Returning 404 to user: Image not found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:09:10.311152 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-c08215c4-5660-44da-972c-d2b1f05a2fdb tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "DELETE /compute/v2.1/images/07477c68-aba6-4fa9-a6a2-3ce18dedfc78" status: 404 len: 62 microversion: 2.1 time: 0.092973 Sep 14 09:09:10.312669 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2207/4415] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:09:10 2022] DELETE /compute/v2.1/images/07477c68-aba6-4fa9-a6a2-3ce18dedfc78 => generated 62 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 14 09:09:10.337496 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-bdd24cf7-1811-4e8b-bb21-6a552f1b1b03 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-1948165862"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:09:10.349995 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-bdd24cf7-1811-4e8b-bb21-6a552f1b1b03 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:09:10.367965 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bdd24cf7-1811-4e8b-bb21-6a552f1b1b03 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:10.368615 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bdd24cf7-1811-4e8b-bb21-6a552f1b1b03 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:10.369285 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bdd24cf7-1811-4e8b-bb21-6a552f1b1b03 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:10.370143 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bdd24cf7-1811-4e8b-bb21-6a552f1b1b03 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:10.370733 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bdd24cf7-1811-4e8b-bb21-6a552f1b1b03 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:10.371335 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bdd24cf7-1811-4e8b-bb21-6a552f1b1b03 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:10.504493 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=2 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:09:10.634058 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f2487e66-363f-4692-bac3-3cea0e2ff81c tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] 10.222.0.60 "POST /compute/v2.1/servers/6957a5fb-4af4-4ca1-809a-8dd02e517c24/action" status: 202 len: 0 microversion: 2.1 time: 1.132851 Sep 14 09:09:10.637845 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2209/4416] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:09:09 2022] POST /compute/v2.1/servers/6957a5fb-4af4-4ca1-809a-8dd02e517c24/action => generated 0 bytes in 1134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:09:10.640245 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b7f72f32-2418-4f63-870f-bacf574dab5b tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:09:10.640760 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b7f72f32-2418-4f63-870f-bacf574dab5b tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] [instance: ed6976ad-867b-4570-a547-758efc8f622f] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:09:10.662759 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b7f72f32-2418-4f63-870f-bacf574dab5b tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:10.663289 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b7f72f32-2418-4f63-870f-bacf574dab5b tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:10.663731 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b7f72f32-2418-4f63-870f-bacf574dab5b tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:10.664439 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b7f72f32-2418-4f63-870f-bacf574dab5b tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:10.664886 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b7f72f32-2418-4f63-870f-bacf574dab5b tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:10.678341 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b7f72f32-2418-4f63-870f-bacf574dab5b tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:10.743609 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-b7f72f32-2418-4f63-870f-bacf574dab5b tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] HTTP exception thrown: Instance ed6976ad-867b-4570-a547-758efc8f622f could not be found. Sep 14 09:09:10.753944 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b7f72f32-2418-4f63-870f-bacf574dab5b tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Request method failure captured: Sep 14 09:09:10.753944 n-d-836830-18 devstack@n-api.service[128759]: request: DELETE /compute/v2.1/servers/ed6976ad-867b-4570-a547-758efc8f622f HTTP/1.1 Sep 14 09:09:10.753944 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:09:10.753944 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:09:10.753944 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:09:10.753944 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:09:10.753944 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:09:10.753944 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:09:10.753944 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:09:10.753944 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:09:10.753944 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZk14GDuYfxsa-wsuRIzuMO54ZShhfsgwUWfj31e0zoblQtY51e_R-CAnEXwf-TeZMtlksIN48WuJE6pMDpTtkDTOMNoN3z5PF_FFos2425zrkF0JqqhjIavK21BkzJ8vfAPZ1nB6uut9GecGR4ysuDCA3zc9nB4uf2O7loF0oE9d4c Sep 14 09:09:10.753944 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:09:10.753944 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:09:10.753944 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:09:10.753944 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:09:10.753944 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:09:10.753944 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:09:10.753944 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 62a597fc389b4805bbd3a53ecd17c5b2 Sep 14 09:09:10.753944 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ImagesTestJSON-1442595664 Sep 14 09:09:10.753944 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:09:10.753944 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:09:10.753944 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/62a597fc389b4805bbd3a53ecd17c5b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_62a597fc389b4805bbd3a53ecd17c5b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/62a597fc389b4805bbd3a53ecd17c5b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/62a597fc389b4805bbd3a53ecd17c5b2"}]}] Sep 14 09:09:10.753944 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ImagesTestJSON-1442595664 Sep 14 09:09:10.753944 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 62a597fc389b4805bbd3a53ecd17c5b2 Sep 14 09:09:10.753944 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ImagesTestJSON-1442595664 Sep 14 09:09:10.753944 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ImagesTestJSON-1442595664-project Sep 14 09:09:10.753944 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:09:10.753944 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:09:10.753944 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 5165b8fc101c47c7a4370f9007bc5a58 Sep 14 09:09:10.753944 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ImagesTestJSON-1442595664-project Sep 14 09:09:10.753944 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:09:10.753944 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance ed6976ad-867b-4570-a547-758efc8f622f could not be found. Sep 14 09:09:10.753944 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': 'ed6976ad-867b-4570-a547-758efc8f622f'} Sep 14 09:09:10.753944 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:09:10.753944 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:09:10.753944 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:09:10.753944 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:09:10.753944 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:09:10.753944 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:09:10.753944 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:09:10.753944 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:09:10.753944 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:09:10.753944 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:09:10.753944 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed6976ad-867b-4570-a547-758efc8f622f could not be found. Sep 14 09:09:10.753944 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:09:10.753944 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:09:10.753944 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:09:10.753944 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:09:10.753944 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:09:10.753944 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:09:10.753944 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:09:10.753944 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:09:10.753944 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:09:10.753944 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:09:10.753944 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 09:09:10.753944 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 09:09:10.753944 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 09:09:10.753944 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 09:09:10.753944 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:09:10.753944 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:09:10.753944 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:09:10.753944 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:09:10.753944 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed6976ad-867b-4570-a547-758efc8f622f could not be found. Sep 14 09:09:10.758604 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:09:10.758604 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:09:10.758604 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:09:10.758604 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:09:10.758604 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:09:10.758604 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:09:10.758604 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:09:10.758604 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:09:10.758604 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed6976ad-867b-4570-a547-758efc8f622f could not be found. Sep 14 09:09:10.758604 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:09:10.758604 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b7f72f32-2418-4f63-870f-bacf574dab5b tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Returning 404 to user: Instance ed6976ad-867b-4570-a547-758efc8f622f could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:09:10.759405 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b7f72f32-2418-4f63-870f-bacf574dab5b tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "DELETE /compute/v2.1/servers/ed6976ad-867b-4570-a547-758efc8f622f" status: 404 len: 111 microversion: 2.1 time: 0.123395 Sep 14 09:09:10.764435 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2210/4417] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:09:10 2022] DELETE /compute/v2.1/servers/ed6976ad-867b-4570-a547-758efc8f622f => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:09:10.782780 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-7669bd30-919a-48e8-96cd-02edb7efb53f tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-966901935"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:09:10.783417 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-7669bd30-919a-48e8-96cd-02edb7efb53f tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] [instance: 6957a5fb-4af4-4ca1-809a-8dd02e517c24] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:09:10.809455 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7669bd30-919a-48e8-96cd-02edb7efb53f tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:10.814702 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7669bd30-919a-48e8-96cd-02edb7efb53f tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:10.815254 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7669bd30-919a-48e8-96cd-02edb7efb53f tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:10.818205 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7669bd30-919a-48e8-96cd-02edb7efb53f tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:10.818683 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7669bd30-919a-48e8-96cd-02edb7efb53f tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:10.826409 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7669bd30-919a-48e8-96cd-02edb7efb53f tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:10.887043 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-bdd24cf7-1811-4e8b-bb21-6a552f1b1b03 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "POST /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105/action" status: 202 len: 0 microversion: 2.1 time: 0.559248 Sep 14 09:09:10.891310 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2208/4418] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:09:10 2022] POST /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105/action => generated 0 bytes in 578 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Sep 14 09:09:10.899112 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-22ef34bd-23b2-4ce4-afca-b96fd0219c05 req-afb94b83-7c63-4821-ad61-cfb6402bff5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6957a5fb-4af4-4ca1-809a-8dd02e517c24", "tag": "ace61c6b-a7bc-48b0-ba9c-109092ffc122"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:09:10.912155 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-22ef34bd-23b2-4ce4-afca-b96fd0219c05 req-afb94b83-7c63-4821-ad61-cfb6402bff5e service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:10.912973 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-22ef34bd-23b2-4ce4-afca-b96fd0219c05 req-afb94b83-7c63-4821-ad61-cfb6402bff5e service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:10.913406 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:09:10.913890 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-22ef34bd-23b2-4ce4-afca-b96fd0219c05 req-afb94b83-7c63-4821-ad61-cfb6402bff5e service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:10.931613 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-22ef34bd-23b2-4ce4-afca-b96fd0219c05 req-afb94b83-7c63-4821-ad61-cfb6402bff5e service nova] Creating event network-changed:ace61c6b-a7bc-48b0-ba9c-109092ffc122 for instance 6957a5fb-4af4-4ca1-809a-8dd02e517c24 on n-h2-836830-18 Sep 14 09:09:10.939780 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-22ef34bd-23b2-4ce4-afca-b96fd0219c05 req-afb94b83-7c63-4821-ad61-cfb6402bff5e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046803 Sep 14 09:09:10.946834 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2209/4419] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:09:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:09:10.953274 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ed6a2d5f-253b-433e-ab37-40e46f8165dc tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:09:10.954876 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-ed6a2d5f-253b-433e-ab37-40e46f8165dc tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:09:10.970374 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ed6a2d5f-253b-433e-ab37-40e46f8165dc tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:10.971216 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ed6a2d5f-253b-433e-ab37-40e46f8165dc tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:10.972478 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ed6a2d5f-253b-433e-ab37-40e46f8165dc tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:10.973385 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ed6a2d5f-253b-433e-ab37-40e46f8165dc tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:10.974033 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ed6a2d5f-253b-433e-ab37-40e46f8165dc tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:10.986580 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ed6a2d5f-253b-433e-ab37-40e46f8165dc tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:11.630428 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.network.security_group_api [None req-7669bd30-919a-48e8-96cd-02edb7efb53f tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Removing security group eb0e9013-6b5d-456d-bd00-85d0f241e025 from port ace61c6b-a7bc-48b0-ba9c-109092ffc122 Sep 14 09:09:11.666827 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-ed6a2d5f-253b-433e-ab37-40e46f8165dc tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:09:11.717043 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-ed6a2d5f-253b-433e-ab37-40e46f8165dc tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:09:11.723931 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-ed6a2d5f-253b-433e-ab37-40e46f8165dc tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:09:11.732874 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-ed6a2d5f-253b-433e-ab37-40e46f8165dc tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5" status: 200 len: 1407 microversion: 2.20 time: 0.784358 Sep 14 09:09:11.734093 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2210/4420] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:09:10 2022] GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5 => generated 1407 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:09:11.740285 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c2a325fb-44ea-45e5-985f-00e2cbf41e3d tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:09:11.741553 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-c2a325fb-44ea-45e5-985f-00e2cbf41e3d tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] [instance: ed6976ad-867b-4570-a547-758efc8f622f] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:09:11.747739 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:09:11.751326 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c2a325fb-44ea-45e5-985f-00e2cbf41e3d tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:11.752428 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c2a325fb-44ea-45e5-985f-00e2cbf41e3d tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:11.755155 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c2a325fb-44ea-45e5-985f-00e2cbf41e3d tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:11.756138 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c2a325fb-44ea-45e5-985f-00e2cbf41e3d tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:11.757111 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c2a325fb-44ea-45e5-985f-00e2cbf41e3d tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:11.764466 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c2a325fb-44ea-45e5-985f-00e2cbf41e3d tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:11.789944 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-c2a325fb-44ea-45e5-985f-00e2cbf41e3d tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] HTTP exception thrown: Instance ed6976ad-867b-4570-a547-758efc8f622f could not be found. Sep 14 09:09:11.792682 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c2a325fb-44ea-45e5-985f-00e2cbf41e3d tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Request method failure captured: Sep 14 09:09:11.792682 n-d-836830-18 devstack@n-api.service[128758]: request: GET /compute/v2.1/servers/ed6976ad-867b-4570-a547-758efc8f622f HTTP/1.1 Sep 14 09:09:11.792682 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 09:09:11.792682 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 09:09:11.792682 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 09:09:11.792682 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 09:09:11.792682 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 09:09:11.792682 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 09:09:11.792682 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 09:09:11.792682 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 09:09:11.792682 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZk14GDuYfxsa-wsuRIzuMO54ZShhfsgwUWfj31e0zoblQtY51e_R-CAnEXwf-TeZMtlksIN48WuJE6pMDpTtkDTOMNoN3z5PF_FFos2425zrkF0JqqhjIavK21BkzJ8vfAPZ1nB6uut9GecGR4ysuDCA3zc9nB4uf2O7loF0oE9d4c Sep 14 09:09:11.792682 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 09:09:11.792682 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 09:09:11.792682 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 09:09:11.792682 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 09:09:11.792682 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 09:09:11.792682 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 09:09:11.792682 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 62a597fc389b4805bbd3a53ecd17c5b2 Sep 14 09:09:11.792682 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-ImagesTestJSON-1442595664 Sep 14 09:09:11.792682 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 09:09:11.792682 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 09:09:11.792682 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/62a597fc389b4805bbd3a53ecd17c5b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_62a597fc389b4805bbd3a53ecd17c5b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/62a597fc389b4805bbd3a53ecd17c5b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/62a597fc389b4805bbd3a53ecd17c5b2"}]}] Sep 14 09:09:11.792682 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-ImagesTestJSON-1442595664 Sep 14 09:09:11.792682 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 62a597fc389b4805bbd3a53ecd17c5b2 Sep 14 09:09:11.792682 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-ImagesTestJSON-1442595664 Sep 14 09:09:11.792682 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-ImagesTestJSON-1442595664-project Sep 14 09:09:11.792682 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 09:09:11.792682 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 09:09:11.792682 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 5165b8fc101c47c7a4370f9007bc5a58 Sep 14 09:09:11.792682 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-ImagesTestJSON-1442595664-project Sep 14 09:09:11.792682 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 09:09:11.792682 n-d-836830-18 devstack@n-api.service[128758]: exception: Instance ed6976ad-867b-4570-a547-758efc8f622f could not be found. Sep 14 09:09:11.792682 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': 'ed6976ad-867b-4570-a547-758efc8f622f'} Sep 14 09:09:11.792682 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:09:11.792682 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:09:11.792682 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:09:11.792682 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:09:11.792682 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:09:11.792682 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:09:11.792682 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:09:11.792682 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:09:11.792682 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:09:11.792682 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:09:11.792682 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed6976ad-867b-4570-a547-758efc8f622f could not be found. Sep 14 09:09:11.792682 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:09:11.792682 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:09:11.792682 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:09:11.792682 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:09:11.792682 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:09:11.792682 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:09:11.792682 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:09:11.792682 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:09:11.792682 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:09:11.792682 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:09:11.792682 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:09:11.792682 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:09:11.792682 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:09:11.792682 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:09:11.792682 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:09:11.792682 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:09:11.792682 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed6976ad-867b-4570-a547-758efc8f622f could not be found. Sep 14 09:09:11.792682 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:09:11.792682 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:09:11.792682 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:09:11.792682 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:09:11.802851 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:09:11.802851 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:09:11.802851 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:09:11.802851 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:09:11.802851 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed6976ad-867b-4570-a547-758efc8f622f could not be found. Sep 14 09:09:11.802851 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:09:11.802851 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c2a325fb-44ea-45e5-985f-00e2cbf41e3d tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Returning 404 to user: Instance ed6976ad-867b-4570-a547-758efc8f622f could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:09:11.804885 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-c2a325fb-44ea-45e5-985f-00e2cbf41e3d tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute/v2.1/servers/ed6976ad-867b-4570-a547-758efc8f622f" status: 404 len: 111 microversion: 2.1 time: 0.059589 Sep 14 09:09:11.805782 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2211/4421] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:09:11 2022] GET /compute/v2.1/servers/ed6976ad-867b-4570-a547-758efc8f622f => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:09:11.812748 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-88bd265c-a087-4672-9b57-09abadc8be32 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:09:11.814100 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-88bd265c-a087-4672-9b57-09abadc8be32 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:09:11.822689 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-88bd265c-a087-4672-9b57-09abadc8be32 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:11.823448 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-88bd265c-a087-4672-9b57-09abadc8be32 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:11.824043 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-88bd265c-a087-4672-9b57-09abadc8be32 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:11.825429 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-88bd265c-a087-4672-9b57-09abadc8be32 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:11.826006 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-88bd265c-a087-4672-9b57-09abadc8be32 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:11.826553 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-88bd265c-a087-4672-9b57-09abadc8be32 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:12.665772 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-7669bd30-919a-48e8-96cd-02edb7efb53f tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] 10.222.0.60 "POST /compute/v2.1/servers/6957a5fb-4af4-4ca1-809a-8dd02e517c24/action" status: 202 len: 0 microversion: 2.1 time: 1.897905 Sep 14 09:09:12.670878 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2211/4422] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:09:10 2022] POST /compute/v2.1/servers/6957a5fb-4af4-4ca1-809a-8dd02e517c24/action => generated 0 bytes in 1906 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:09:12.758218 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=10 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:09:12.781351 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-88bd265c-a087-4672-9b57-09abadc8be32 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:09:12.797892 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-88bd265c-a087-4672-9b57-09abadc8be32 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105" status: 200 len: 1678 microversion: 2.1 time: 0.990761 Sep 14 09:09:12.801306 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2212/4423] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:09:11 2022] GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105 => generated 1678 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:09:12.824656 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1a58a738-9a18-4928-92f7-451ad2867868 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '.version_select at 0x7f7d3f458430>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:09:12.867778 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-1a58a738-9a18-4928-92f7-451ad2867868 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] HTTP exception thrown: Image not found. Sep 14 09:09:12.869741 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1a58a738-9a18-4928-92f7-451ad2867868 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Request method failure captured: Sep 14 09:09:12.869741 n-d-836830-18 devstack@n-api.service[128758]: request: DELETE /compute/v2.1/images/a62c47ed-e003-4adc-bdf0-222dc0068fa9 HTTP/1.1 Sep 14 09:09:12.869741 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 09:09:12.869741 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 09:09:12.869741 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 09:09:12.869741 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 09:09:12.869741 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 09:09:12.869741 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 09:09:12.869741 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 09:09:12.869741 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 09:09:12.869741 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZk14GDuYfxsa-wsuRIzuMO54ZShhfsgwUWfj31e0zoblQtY51e_R-CAnEXwf-TeZMtlksIN48WuJE6pMDpTtkDTOMNoN3z5PF_FFos2425zrkF0JqqhjIavK21BkzJ8vfAPZ1nB6uut9GecGR4ysuDCA3zc9nB4uf2O7loF0oE9d4c Sep 14 09:09:12.869741 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 09:09:12.869741 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 09:09:12.869741 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 09:09:12.869741 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 09:09:12.869741 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 09:09:12.869741 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 09:09:12.869741 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 62a597fc389b4805bbd3a53ecd17c5b2 Sep 14 09:09:12.869741 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-ImagesTestJSON-1442595664 Sep 14 09:09:12.869741 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 09:09:12.869741 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 09:09:12.869741 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/62a597fc389b4805bbd3a53ecd17c5b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_62a597fc389b4805bbd3a53ecd17c5b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/62a597fc389b4805bbd3a53ecd17c5b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/62a597fc389b4805bbd3a53ecd17c5b2"}]}] Sep 14 09:09:12.869741 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-ImagesTestJSON-1442595664 Sep 14 09:09:12.869741 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 62a597fc389b4805bbd3a53ecd17c5b2 Sep 14 09:09:12.869741 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-ImagesTestJSON-1442595664 Sep 14 09:09:12.869741 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-ImagesTestJSON-1442595664-project Sep 14 09:09:12.869741 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 09:09:12.869741 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 09:09:12.869741 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 5165b8fc101c47c7a4370f9007bc5a58 Sep 14 09:09:12.869741 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-ImagesTestJSON-1442595664-project Sep 14 09:09:12.869741 n-d-836830-18 devstack@n-api.service[128758]: method: Sep 14 09:09:12.869741 n-d-836830-18 devstack@n-api.service[128758]: exception: Image not found. Sep 14 09:09:12.869741 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': 'a62c47ed-e003-4adc-bdf0-222dc0068fa9'} Sep 14 09:09:12.869741 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:09:12.869741 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:09:12.869741 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 14 09:09:12.869741 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 14 09:09:12.869741 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 14 09:09:12.869741 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 14 09:09:12.869741 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 14 09:09:12.869741 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 14 09:09:12.869741 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 14 09:09:12.869741 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 14 09:09:12.869741 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 14 09:09:12.869741 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 14 09:09:12.869741 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 14 09:09:12.869741 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 14 09:09:12.869741 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 14 09:09:12.869741 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 14 09:09:12.869741 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image a62c47ed-e003-4adc-bdf0-222dc0068fa9 to delete Sep 14 09:09:12.869741 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:09:12.869741 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:09:12.869741 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:09:12.869741 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:09:12.869741 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 14 09:09:12.869741 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 14 09:09:12.869741 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 14 09:09:12.869741 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 14 09:09:12.869741 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 14 09:09:12.869741 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 14 09:09:12.869741 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a62c47ed-e003-4adc-bdf0-222dc0068fa9 could not be found. Sep 14 09:09:12.869741 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:09:12.869741 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:09:12.869741 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:09:12.869741 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:09:12.874240 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:09:12.874240 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:09:12.874240 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:09:12.874240 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:09:12.874240 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:09:12.874240 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:09:12.874240 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:09:12.874240 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:09:12.874240 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 14 09:09:12.874240 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 14 09:09:12.874240 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 14 09:09:12.874240 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:09:12.874240 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:09:12.874240 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:09:12.874240 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:09:12.874240 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:09:12.874240 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:09:12.874240 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:09:12.874240 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:09:12.874240 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 14 09:09:12.874240 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:09:12.876582 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1a58a738-9a18-4928-92f7-451ad2867868 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Returning 404 to user: Image not found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:09:12.879048 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-1a58a738-9a18-4928-92f7-451ad2867868 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "DELETE /compute/v2.1/images/a62c47ed-e003-4adc-bdf0-222dc0068fa9" status: 404 len: 62 microversion: 2.1 time: 0.071920 Sep 14 09:09:12.886889 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2213/4424] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:09:12 2022] DELETE /compute/v2.1/images/a62c47ed-e003-4adc-bdf0-222dc0068fa9 => generated 62 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 14 09:09:12.895880 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-9d2577bd-56c0-4ff6-b086-281184e08200 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Action: 'create', calling method: .version_select at 0x7f7d3f414820>, body: {"pool": null} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:09:13.186564 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-5cb7a6ab-4040-4436-8121-d2354ed245da req-7a80e027-a49f-4523-bfa2-c7d17a10be69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5", "tag": "906bcc79-e290-4b18-8447-de06233392de"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:09:13.205787 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:09:13.225926 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-5cb7a6ab-4040-4436-8121-d2354ed245da req-7a80e027-a49f-4523-bfa2-c7d17a10be69 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:13.226419 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-5cb7a6ab-4040-4436-8121-d2354ed245da req-7a80e027-a49f-4523-bfa2-c7d17a10be69 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:13.226858 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-5cb7a6ab-4040-4436-8121-d2354ed245da req-7a80e027-a49f-4523-bfa2-c7d17a10be69 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:13.268324 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-5cb7a6ab-4040-4436-8121-d2354ed245da req-7a80e027-a49f-4523-bfa2-c7d17a10be69 service nova] Creating event network-changed:906bcc79-e290-4b18-8447-de06233392de for instance 4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5 on n-h1-836830-18 Sep 14 09:09:13.282483 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-5cb7a6ab-4040-4436-8121-d2354ed245da req-7a80e027-a49f-4523-bfa2-c7d17a10be69 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.610189 Sep 14 09:09:13.284333 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2212/4425] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:09:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:09:13.303088 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3bc7479b-44b3-4f1c-bb81-f98f5005b2c9 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:09:13.303822 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-3bc7479b-44b3-4f1c-bb81-f98f5005b2c9 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:09:13.326098 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3bc7479b-44b3-4f1c-bb81-f98f5005b2c9 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:13.329901 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3bc7479b-44b3-4f1c-bb81-f98f5005b2c9 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:13.330451 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3bc7479b-44b3-4f1c-bb81-f98f5005b2c9 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:13.332355 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3bc7479b-44b3-4f1c-bb81-f98f5005b2c9 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:13.336496 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3bc7479b-44b3-4f1c-bb81-f98f5005b2c9 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:13.339824 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3bc7479b-44b3-4f1c-bb81-f98f5005b2c9 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:13.907704 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-3bc7479b-44b3-4f1c-bb81-f98f5005b2c9 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:09:13.927684 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-3bc7479b-44b3-4f1c-bb81-f98f5005b2c9 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:09:13.930477 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-3bc7479b-44b3-4f1c-bb81-f98f5005b2c9 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:09:13.944789 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-3bc7479b-44b3-4f1c-bb81-f98f5005b2c9 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5" status: 200 len: 1407 microversion: 2.20 time: 0.656772 Sep 14 09:09:13.946197 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2213/4426] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:09:13 2022] GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5 => generated 1407 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:09:13.965284 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-3480e285-2ad5-4eec-b934-be03cf04096b req-d830408c-0a5a-48e2-861b-67b6e3bda32f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8450d385-d5d9-4c86-9ece-b3bbf9ed1105", "name": "network-vif-unplugged", "status": "completed", "tag": "eb873b1a-8b40-4eb4-a329-cf733d9ed342"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:09:14.007994 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-3480e285-2ad5-4eec-b934-be03cf04096b req-d830408c-0a5a-48e2-861b-67b6e3bda32f service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:14.014681 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-3480e285-2ad5-4eec-b934-be03cf04096b req-d830408c-0a5a-48e2-861b-67b6e3bda32f service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:14.015433 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-3480e285-2ad5-4eec-b934-be03cf04096b req-d830408c-0a5a-48e2-861b-67b6e3bda32f service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:14.051283 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-3480e285-2ad5-4eec-b934-be03cf04096b req-d830408c-0a5a-48e2-861b-67b6e3bda32f service nova] Creating event network-vif-unplugged:eb873b1a-8b40-4eb4-a329-cf733d9ed342 for instance 8450d385-d5d9-4c86-9ece-b3bbf9ed1105 on n-h1-836830-18 Sep 14 09:09:14.056666 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-3480e285-2ad5-4eec-b934-be03cf04096b req-d830408c-0a5a-48e2-861b-67b6e3bda32f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.104369 Sep 14 09:09:14.066354 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2214/4427] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:09:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:09:14.073625 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ef30f5a3-7103-4c43-8205-260b88a99c17 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:09:14.074471 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-ef30f5a3-7103-4c43-8205-260b88a99c17 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] [instance: 70b0fcd2-6fc4-4445-96bb-165dccf6c81c] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:09:14.089676 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ef30f5a3-7103-4c43-8205-260b88a99c17 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:14.090435 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ef30f5a3-7103-4c43-8205-260b88a99c17 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:14.095855 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ef30f5a3-7103-4c43-8205-260b88a99c17 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:14.097284 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ef30f5a3-7103-4c43-8205-260b88a99c17 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:14.097937 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ef30f5a3-7103-4c43-8205-260b88a99c17 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:14.098757 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ef30f5a3-7103-4c43-8205-260b88a99c17 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:14.130644 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-ef30f5a3-7103-4c43-8205-260b88a99c17 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] HTTP exception thrown: Instance 70b0fcd2-6fc4-4445-96bb-165dccf6c81c could not be found. Sep 14 09:09:14.139293 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ef30f5a3-7103-4c43-8205-260b88a99c17 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Request method failure captured: Sep 14 09:09:14.139293 n-d-836830-18 devstack@n-api.service[128759]: request: DELETE /compute/v2.1/servers/70b0fcd2-6fc4-4445-96bb-165dccf6c81c HTTP/1.1 Sep 14 09:09:14.139293 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:09:14.139293 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:09:14.139293 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:09:14.139293 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:09:14.139293 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:09:14.139293 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:09:14.139293 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:09:14.139293 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:09:14.139293 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZk14GDuYfxsa-wsuRIzuMO54ZShhfsgwUWfj31e0zoblQtY51e_R-CAnEXwf-TeZMtlksIN48WuJE6pMDpTtkDTOMNoN3z5PF_FFos2425zrkF0JqqhjIavK21BkzJ8vfAPZ1nB6uut9GecGR4ysuDCA3zc9nB4uf2O7loF0oE9d4c Sep 14 09:09:14.139293 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:09:14.139293 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:09:14.139293 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:09:14.139293 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:09:14.139293 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:09:14.139293 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:09:14.139293 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 62a597fc389b4805bbd3a53ecd17c5b2 Sep 14 09:09:14.139293 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ImagesTestJSON-1442595664 Sep 14 09:09:14.139293 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:09:14.139293 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:09:14.139293 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/62a597fc389b4805bbd3a53ecd17c5b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_62a597fc389b4805bbd3a53ecd17c5b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/62a597fc389b4805bbd3a53ecd17c5b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/62a597fc389b4805bbd3a53ecd17c5b2"}]}] Sep 14 09:09:14.139293 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ImagesTestJSON-1442595664 Sep 14 09:09:14.139293 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 62a597fc389b4805bbd3a53ecd17c5b2 Sep 14 09:09:14.139293 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ImagesTestJSON-1442595664 Sep 14 09:09:14.139293 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ImagesTestJSON-1442595664-project Sep 14 09:09:14.139293 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:09:14.139293 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:09:14.139293 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 5165b8fc101c47c7a4370f9007bc5a58 Sep 14 09:09:14.139293 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ImagesTestJSON-1442595664-project Sep 14 09:09:14.139293 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:09:14.139293 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance 70b0fcd2-6fc4-4445-96bb-165dccf6c81c could not be found. Sep 14 09:09:14.139293 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '70b0fcd2-6fc4-4445-96bb-165dccf6c81c'} Sep 14 09:09:14.139293 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:09:14.139293 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:09:14.139293 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:09:14.139293 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:09:14.139293 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:09:14.139293 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:09:14.139293 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:09:14.139293 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:09:14.139293 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:09:14.139293 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:09:14.139293 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70b0fcd2-6fc4-4445-96bb-165dccf6c81c could not be found. Sep 14 09:09:14.139293 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:09:14.139293 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:09:14.139293 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:09:14.139293 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:09:14.139293 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:09:14.139293 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:09:14.139293 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:09:14.139293 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:09:14.139293 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:09:14.139293 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:09:14.139293 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 09:09:14.139293 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 09:09:14.139293 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 09:09:14.139293 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 09:09:14.139293 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:09:14.139293 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:09:14.139293 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:09:14.139293 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:09:14.139293 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70b0fcd2-6fc4-4445-96bb-165dccf6c81c could not be found. Sep 14 09:09:14.143990 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:09:14.143990 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:09:14.143990 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:09:14.143990 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:09:14.143990 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:09:14.143990 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:09:14.143990 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:09:14.143990 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:09:14.143990 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70b0fcd2-6fc4-4445-96bb-165dccf6c81c could not be found. Sep 14 09:09:14.143990 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:09:14.145738 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ef30f5a3-7103-4c43-8205-260b88a99c17 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Returning 404 to user: Instance 70b0fcd2-6fc4-4445-96bb-165dccf6c81c could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:09:14.146777 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-ef30f5a3-7103-4c43-8205-260b88a99c17 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "DELETE /compute/v2.1/servers/70b0fcd2-6fc4-4445-96bb-165dccf6c81c" status: 404 len: 111 microversion: 2.1 time: 0.077485 Sep 14 09:09:14.147550 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2215/4428] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:09:14 2022] DELETE /compute/v2.1/servers/70b0fcd2-6fc4-4445-96bb-165dccf6c81c => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:09:14.157403 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-111273c9-94ba-4454-8d4d-d3a0d57bb7d0 req-afb7865b-129c-477c-a5bd-696464c609fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6957a5fb-4af4-4ca1-809a-8dd02e517c24", "tag": "ace61c6b-a7bc-48b0-ba9c-109092ffc122"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:09:14.183011 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-111273c9-94ba-4454-8d4d-d3a0d57bb7d0 req-afb7865b-129c-477c-a5bd-696464c609fb service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:14.183778 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-111273c9-94ba-4454-8d4d-d3a0d57bb7d0 req-afb7865b-129c-477c-a5bd-696464c609fb service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:14.184381 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-111273c9-94ba-4454-8d4d-d3a0d57bb7d0 req-afb7865b-129c-477c-a5bd-696464c609fb service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:14.214952 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-111273c9-94ba-4454-8d4d-d3a0d57bb7d0 req-afb7865b-129c-477c-a5bd-696464c609fb service nova] Creating event network-changed:ace61c6b-a7bc-48b0-ba9c-109092ffc122 for instance 6957a5fb-4af4-4ca1-809a-8dd02e517c24 on n-h2-836830-18 Sep 14 09:09:14.227174 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-111273c9-94ba-4454-8d4d-d3a0d57bb7d0 req-afb7865b-129c-477c-a5bd-696464c609fb service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077099 Sep 14 09:09:14.229982 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2216/4429] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:09:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:09:14.240638 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-08bd184c-6f5f-44b6-aa66-cc98236ce797 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:09:14.246677 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-08bd184c-6f5f-44b6-aa66-cc98236ce797 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:09:14.258817 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-08bd184c-6f5f-44b6-aa66-cc98236ce797 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:14.260970 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-08bd184c-6f5f-44b6-aa66-cc98236ce797 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:14.264388 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-08bd184c-6f5f-44b6-aa66-cc98236ce797 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:14.265326 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-08bd184c-6f5f-44b6-aa66-cc98236ce797 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:14.265956 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-08bd184c-6f5f-44b6-aa66-cc98236ce797 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:14.267310 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-08bd184c-6f5f-44b6-aa66-cc98236ce797 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:15.071175 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-08bd184c-6f5f-44b6-aa66-cc98236ce797 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:09:15.082135 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-08bd184c-6f5f-44b6-aa66-cc98236ce797 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105" status: 200 len: 1678 microversion: 2.1 time: 0.849987 Sep 14 09:09:15.082927 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2217/4430] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:09:14 2022] GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105 => generated 1678 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:09:15.091723 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-85c2c2b8-f0a3-44a1-8dbe-2221d001a118 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:09:15.095693 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-85c2c2b8-f0a3-44a1-8dbe-2221d001a118 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] [instance: 70b0fcd2-6fc4-4445-96bb-165dccf6c81c] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:09:15.106267 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-85c2c2b8-f0a3-44a1-8dbe-2221d001a118 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:15.109750 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-85c2c2b8-f0a3-44a1-8dbe-2221d001a118 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:15.110424 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-85c2c2b8-f0a3-44a1-8dbe-2221d001a118 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:15.111420 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-85c2c2b8-f0a3-44a1-8dbe-2221d001a118 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:15.114255 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-85c2c2b8-f0a3-44a1-8dbe-2221d001a118 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:15.114926 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-85c2c2b8-f0a3-44a1-8dbe-2221d001a118 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:15.148311 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-85c2c2b8-f0a3-44a1-8dbe-2221d001a118 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] HTTP exception thrown: Instance 70b0fcd2-6fc4-4445-96bb-165dccf6c81c could not be found. Sep 14 09:09:15.152706 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-85c2c2b8-f0a3-44a1-8dbe-2221d001a118 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Request method failure captured: Sep 14 09:09:15.152706 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/70b0fcd2-6fc4-4445-96bb-165dccf6c81c HTTP/1.1 Sep 14 09:09:15.152706 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:09:15.152706 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:09:15.152706 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:09:15.152706 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:09:15.152706 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:09:15.152706 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:09:15.152706 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:09:15.152706 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:09:15.152706 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZk14GDuYfxsa-wsuRIzuMO54ZShhfsgwUWfj31e0zoblQtY51e_R-CAnEXwf-TeZMtlksIN48WuJE6pMDpTtkDTOMNoN3z5PF_FFos2425zrkF0JqqhjIavK21BkzJ8vfAPZ1nB6uut9GecGR4ysuDCA3zc9nB4uf2O7loF0oE9d4c Sep 14 09:09:15.152706 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:09:15.152706 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:09:15.152706 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:09:15.152706 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:09:15.152706 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:09:15.152706 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:09:15.152706 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 62a597fc389b4805bbd3a53ecd17c5b2 Sep 14 09:09:15.152706 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ImagesTestJSON-1442595664 Sep 14 09:09:15.152706 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:09:15.152706 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:09:15.152706 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/62a597fc389b4805bbd3a53ecd17c5b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_62a597fc389b4805bbd3a53ecd17c5b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/62a597fc389b4805bbd3a53ecd17c5b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/62a597fc389b4805bbd3a53ecd17c5b2"}]}] Sep 14 09:09:15.152706 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ImagesTestJSON-1442595664 Sep 14 09:09:15.152706 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 62a597fc389b4805bbd3a53ecd17c5b2 Sep 14 09:09:15.152706 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ImagesTestJSON-1442595664 Sep 14 09:09:15.152706 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ImagesTestJSON-1442595664-project Sep 14 09:09:15.152706 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:09:15.152706 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:09:15.152706 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 5165b8fc101c47c7a4370f9007bc5a58 Sep 14 09:09:15.152706 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ImagesTestJSON-1442595664-project Sep 14 09:09:15.152706 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:09:15.152706 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance 70b0fcd2-6fc4-4445-96bb-165dccf6c81c could not be found. Sep 14 09:09:15.152706 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '70b0fcd2-6fc4-4445-96bb-165dccf6c81c'} Sep 14 09:09:15.152706 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:09:15.152706 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:09:15.152706 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:09:15.152706 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:09:15.152706 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:09:15.152706 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:09:15.152706 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:09:15.152706 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:09:15.152706 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:09:15.152706 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:09:15.152706 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70b0fcd2-6fc4-4445-96bb-165dccf6c81c could not be found. Sep 14 09:09:15.152706 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:09:15.152706 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:09:15.152706 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:09:15.152706 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:09:15.152706 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:09:15.152706 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:09:15.152706 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:09:15.152706 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:09:15.152706 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:09:15.152706 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:09:15.152706 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:09:15.152706 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:09:15.152706 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:09:15.152706 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:09:15.152706 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:09:15.152706 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:09:15.152706 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70b0fcd2-6fc4-4445-96bb-165dccf6c81c could not be found. Sep 14 09:09:15.152706 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:09:15.152706 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:09:15.152706 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:09:15.152706 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:09:15.157937 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:09:15.157937 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:09:15.157937 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:09:15.157937 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:09:15.157937 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70b0fcd2-6fc4-4445-96bb-165dccf6c81c could not be found. Sep 14 09:09:15.157937 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:09:15.171835 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-85c2c2b8-f0a3-44a1-8dbe-2221d001a118 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Returning 404 to user: Instance 70b0fcd2-6fc4-4445-96bb-165dccf6c81c could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:09:15.173050 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-85c2c2b8-f0a3-44a1-8dbe-2221d001a118 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute/v2.1/servers/70b0fcd2-6fc4-4445-96bb-165dccf6c81c" status: 404 len: 111 microversion: 2.1 time: 0.085086 Sep 14 09:09:15.174143 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2218/4431] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:09:15 2022] GET /compute/v2.1/servers/70b0fcd2-6fc4-4445-96bb-165dccf6c81c => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:09:15.175372 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-85c2c2b8-f0a3-44a1-8dbe-2221d001a118 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:09:15.176485 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-85c2c2b8-f0a3-44a1-8dbe-2221d001a118 tempest-ImagesTestJSON-1442595664 tempest-ImagesTestJSON-1442595664-project] 10.222.0.60 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001310 Sep 14 09:09:15.177261 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2219/4432] 10.222.0.60 () {56 vars in 886 bytes} [Wed Sep 14 09:09:15 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Sep 14 09:09:15.188914 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a5b1cce7-f120-4dee-8685-0619905b762e tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:09:15.190081 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-a5b1cce7-f120-4dee-8685-0619905b762e tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:09:15.197331 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a5b1cce7-f120-4dee-8685-0619905b762e tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:15.206645 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a5b1cce7-f120-4dee-8685-0619905b762e tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:15.207491 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a5b1cce7-f120-4dee-8685-0619905b762e tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:15.208867 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a5b1cce7-f120-4dee-8685-0619905b762e tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:15.209554 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a5b1cce7-f120-4dee-8685-0619905b762e tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:15.210219 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a5b1cce7-f120-4dee-8685-0619905b762e tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:15.791949 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-a5b1cce7-f120-4dee-8685-0619905b762e tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:09:15.804336 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-a5b1cce7-f120-4dee-8685-0619905b762e tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:09:15.805799 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-a5b1cce7-f120-4dee-8685-0619905b762e tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:09:15.806953 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a5b1cce7-f120-4dee-8685-0619905b762e tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5" status: 200 len: 1407 microversion: 2.20 time: 0.628596 Sep 14 09:09:15.810009 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2220/4433] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:09:15 2022] GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5 => generated 1407 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:09:16.112355 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8ab22dc7-714f-4389-9187-f27f512faf25 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:09:16.113041 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-8ab22dc7-714f-4389-9187-f27f512faf25 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:09:16.119389 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8ab22dc7-714f-4389-9187-f27f512faf25 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:16.119873 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8ab22dc7-714f-4389-9187-f27f512faf25 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:16.120304 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8ab22dc7-714f-4389-9187-f27f512faf25 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:16.121052 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8ab22dc7-714f-4389-9187-f27f512faf25 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:16.121541 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8ab22dc7-714f-4389-9187-f27f512faf25 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:16.121967 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8ab22dc7-714f-4389-9187-f27f512faf25 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:16.668250 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-8ab22dc7-714f-4389-9187-f27f512faf25 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:09:16.676744 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-8ab22dc7-714f-4389-9187-f27f512faf25 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105" status: 200 len: 1686 microversion: 2.1 time: 0.568209 Sep 14 09:09:16.680389 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2221/4434] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:09:16 2022] GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105 => generated 1686 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:09:16.837857 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-bc955c7d-6bca-4b57-be41-dc92a5617848 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:09:16.838778 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-bc955c7d-6bca-4b57-be41-dc92a5617848 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:09:16.849042 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bc955c7d-6bca-4b57-be41-dc92a5617848 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:16.853054 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bc955c7d-6bca-4b57-be41-dc92a5617848 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:16.853695 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bc955c7d-6bca-4b57-be41-dc92a5617848 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:16.854599 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bc955c7d-6bca-4b57-be41-dc92a5617848 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:16.855262 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bc955c7d-6bca-4b57-be41-dc92a5617848 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:16.856030 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bc955c7d-6bca-4b57-be41-dc92a5617848 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:17.461431 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-bc955c7d-6bca-4b57-be41-dc92a5617848 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:09:17.477179 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-bc955c7d-6bca-4b57-be41-dc92a5617848 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:09:17.484310 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-bc955c7d-6bca-4b57-be41-dc92a5617848 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:09:17.489667 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-bc955c7d-6bca-4b57-be41-dc92a5617848 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5" status: 200 len: 1407 microversion: 2.20 time: 0.656013 Sep 14 09:09:17.490422 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2222/4435] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:09:16 2022] GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5 => generated 1407 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 09:09:17.535407 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-9d2577bd-56c0-4ff6-b086-281184e08200 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] 10.222.0.60 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.642084 Sep 14 09:09:17.537469 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2214/4436] 10.222.0.60 () {60 vars in 1170 bytes} [Wed Sep 14 09:09:12 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4650 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:09:17.551777 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-40d2a205-edd9-4a2d-8539-9d62c6353696 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.9.224"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:09:17.584027 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-40d2a205-edd9-4a2d-8539-9d62c6353696 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] [instance: 6957a5fb-4af4-4ca1-809a-8dd02e517c24] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:09:17.601991 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-40d2a205-edd9-4a2d-8539-9d62c6353696 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:17.604870 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-40d2a205-edd9-4a2d-8539-9d62c6353696 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:17.607517 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-40d2a205-edd9-4a2d-8539-9d62c6353696 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:17.608819 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-40d2a205-edd9-4a2d-8539-9d62c6353696 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:17.611409 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-40d2a205-edd9-4a2d-8539-9d62c6353696 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:17.612081 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-40d2a205-edd9-4a2d-8539-9d62c6353696 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:17.676161 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-40d2a205-edd9-4a2d-8539-9d62c6353696 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Acquiring lock "refresh_cache-6957a5fb-4af4-4ca1-809a-8dd02e517c24" {{(pid=128759) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 14 09:09:17.680658 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-40d2a205-edd9-4a2d-8539-9d62c6353696 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Acquired lock "refresh_cache-6957a5fb-4af4-4ca1-809a-8dd02e517c24" {{(pid=128759) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 14 09:09:17.706400 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-bcaf4bc5-3452-474c-bbf3-b5b1aa90635e tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:09:17.707323 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-bcaf4bc5-3452-474c-bbf3-b5b1aa90635e tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:09:17.735150 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bcaf4bc5-3452-474c-bbf3-b5b1aa90635e tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:17.741679 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bcaf4bc5-3452-474c-bbf3-b5b1aa90635e tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:17.744630 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bcaf4bc5-3452-474c-bbf3-b5b1aa90635e tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:17.745593 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bcaf4bc5-3452-474c-bbf3-b5b1aa90635e tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:17.746611 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bcaf4bc5-3452-474c-bbf3-b5b1aa90635e tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:17.749309 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bcaf4bc5-3452-474c-bbf3-b5b1aa90635e tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:18.601268 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-bcaf4bc5-3452-474c-bbf3-b5b1aa90635e tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:09:18.610175 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-bcaf4bc5-3452-474c-bbf3-b5b1aa90635e tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105" status: 200 len: 1686 microversion: 2.1 time: 0.909496 Sep 14 09:09:18.617050 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2215/4437] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:09:17 2022] GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105 => generated 1686 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:09:18.622638 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-23ea9833-82b4-4d42-a686-78bafb495d41 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:09:18.623315 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-23ea9833-82b4-4d42-a686-78bafb495d41 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:09:18.650593 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-23ea9833-82b4-4d42-a686-78bafb495d41 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:18.651478 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-23ea9833-82b4-4d42-a686-78bafb495d41 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:18.654253 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-23ea9833-82b4-4d42-a686-78bafb495d41 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:18.655240 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-23ea9833-82b4-4d42-a686-78bafb495d41 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:18.656303 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-23ea9833-82b4-4d42-a686-78bafb495d41 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:18.664046 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-23ea9833-82b4-4d42-a686-78bafb495d41 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:19.008907 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-23ea9833-82b4-4d42-a686-78bafb495d41 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:09:19.018055 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-23ea9833-82b4-4d42-a686-78bafb495d41 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:09:19.023367 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-23ea9833-82b4-4d42-a686-78bafb495d41 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:09:19.029546 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-23ea9833-82b4-4d42-a686-78bafb495d41 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5" status: 200 len: 1407 microversion: 2.20 time: 0.411356 Sep 14 09:09:19.030436 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2216/4438] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:09:18 2022] GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5 => generated 1407 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:09:19.405091 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d715074c-2a24-469a-9831-83409dd9ebe3 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:09:19.405733 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-d715074c-2a24-469a-9831-83409dd9ebe3 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: 8e670908-5bb6-49ad-92f3-dad1b4df1b5a] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:09:19.419146 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d715074c-2a24-469a-9831-83409dd9ebe3 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:19.427711 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d715074c-2a24-469a-9831-83409dd9ebe3 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:19.428307 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d715074c-2a24-469a-9831-83409dd9ebe3 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:19.429185 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d715074c-2a24-469a-9831-83409dd9ebe3 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:19.429828 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d715074c-2a24-469a-9831-83409dd9ebe3 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:19.432645 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d715074c-2a24-469a-9831-83409dd9ebe3 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:19.470154 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-d715074c-2a24-469a-9831-83409dd9ebe3 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] HTTP exception thrown: Instance 8e670908-5bb6-49ad-92f3-dad1b4df1b5a could not be found. Sep 14 09:09:19.472649 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d715074c-2a24-469a-9831-83409dd9ebe3 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Request method failure captured: Sep 14 09:09:19.472649 n-d-836830-18 devstack@n-api.service[128758]: request: DELETE /compute/v2.1/servers/8e670908-5bb6-49ad-92f3-dad1b4df1b5a HTTP/1.1 Sep 14 09:09:19.472649 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 09:09:19.472649 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 09:09:19.472649 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 09:09:19.472649 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 09:09:19.472649 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 09:09:19.472649 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 09:09:19.472649 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 09:09:19.472649 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 09:09:19.472649 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZk2EvHIWQyXATvY4f6phbqF3DzIIyaJjJFCE11LxTKbrsndvuk5zoyyEUR0VXx32_kFjD0I6jBROuj0ZPSHQav7u9FFvOPFGrPkf9qZrgXY9k3zAUFrOVfwLECoLZOolubyCPUAGSEOi_HvFIP_Dd_DCbUCKDEGGLtdnAzy2tLCxHs Sep 14 09:09:19.472649 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 09:09:19.472649 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 09:09:19.472649 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 09:09:19.472649 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 09:09:19.472649 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 09:09:19.472649 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 09:09:19.472649 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 6907b82c9d5c4a23a63bbeec31c3c365 Sep 14 09:09:19.472649 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-ServersNegativeTestJSON-1654813540 Sep 14 09:09:19.472649 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 09:09:19.472649 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 09:09:19.472649 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6907b82c9d5c4a23a63bbeec31c3c365"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6907b82c9d5c4a23a63bbeec31c3c365"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6907b82c9d5c4a23a63bbeec31c3c365"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6907b82c9d5c4a23a63bbeec31c3c365"}]}] Sep 14 09:09:19.472649 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-ServersNegativeTestJSON-1654813540 Sep 14 09:09:19.472649 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 6907b82c9d5c4a23a63bbeec31c3c365 Sep 14 09:09:19.472649 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1654813540 Sep 14 09:09:19.472649 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-ServersNegativeTestJSON-1654813540-project Sep 14 09:09:19.472649 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 09:09:19.472649 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 09:09:19.472649 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 79583c4e80a04f138927f09eb4e170f4 Sep 14 09:09:19.472649 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-ServersNegativeTestJSON-1654813540-project Sep 14 09:09:19.472649 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 09:09:19.472649 n-d-836830-18 devstack@n-api.service[128758]: exception: Instance 8e670908-5bb6-49ad-92f3-dad1b4df1b5a could not be found. Sep 14 09:09:19.472649 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': '8e670908-5bb6-49ad-92f3-dad1b4df1b5a'} Sep 14 09:09:19.472649 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:09:19.472649 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:09:19.472649 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:09:19.472649 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:09:19.472649 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:09:19.472649 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:09:19.472649 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:09:19.472649 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:09:19.472649 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:09:19.472649 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:09:19.472649 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e670908-5bb6-49ad-92f3-dad1b4df1b5a could not be found. Sep 14 09:09:19.472649 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:09:19.472649 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:09:19.472649 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:09:19.472649 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:09:19.472649 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:09:19.472649 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:09:19.472649 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:09:19.472649 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:09:19.472649 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:09:19.472649 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:09:19.472649 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 09:09:19.472649 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 09:09:19.472649 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 09:09:19.472649 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 09:09:19.472649 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:09:19.472649 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:09:19.472649 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:09:19.472649 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:09:19.476355 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e670908-5bb6-49ad-92f3-dad1b4df1b5a could not be found. Sep 14 09:09:19.476355 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:09:19.476355 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:09:19.476355 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:09:19.476355 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:09:19.476355 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:09:19.476355 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:09:19.476355 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:09:19.476355 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:09:19.476355 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e670908-5bb6-49ad-92f3-dad1b4df1b5a could not be found. Sep 14 09:09:19.476355 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:09:19.478538 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d715074c-2a24-469a-9831-83409dd9ebe3 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Returning 404 to user: Instance 8e670908-5bb6-49ad-92f3-dad1b4df1b5a could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:09:19.486484 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-d715074c-2a24-469a-9831-83409dd9ebe3 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "DELETE /compute/v2.1/servers/8e670908-5bb6-49ad-92f3-dad1b4df1b5a" status: 404 len: 111 microversion: 2.1 time: 0.085207 Sep 14 09:09:19.490807 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2217/4439] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:09:19 2022] DELETE /compute/v2.1/servers/8e670908-5bb6-49ad-92f3-dad1b4df1b5a => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 14 09:09:19.497537 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a6221efa-b157-4bb4-98f7-21c7344f99be tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:09:19.508894 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-a6221efa-b157-4bb4-98f7-21c7344f99be tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: 8e670908-5bb6-49ad-92f3-dad1b4df1b5a] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:09:19.525249 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a6221efa-b157-4bb4-98f7-21c7344f99be tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:19.525997 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a6221efa-b157-4bb4-98f7-21c7344f99be tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:19.526651 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a6221efa-b157-4bb4-98f7-21c7344f99be tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:19.528986 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a6221efa-b157-4bb4-98f7-21c7344f99be tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:19.532052 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a6221efa-b157-4bb4-98f7-21c7344f99be tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:19.532740 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a6221efa-b157-4bb4-98f7-21c7344f99be tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:19.570112 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-a6221efa-b157-4bb4-98f7-21c7344f99be tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] HTTP exception thrown: Instance 8e670908-5bb6-49ad-92f3-dad1b4df1b5a could not be found. Sep 14 09:09:19.578311 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a6221efa-b157-4bb4-98f7-21c7344f99be tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Request method failure captured: Sep 14 09:09:19.578311 n-d-836830-18 devstack@n-api.service[128758]: request: GET /compute/v2.1/servers/8e670908-5bb6-49ad-92f3-dad1b4df1b5a HTTP/1.1 Sep 14 09:09:19.578311 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 09:09:19.578311 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 09:09:19.578311 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 09:09:19.578311 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 09:09:19.578311 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 09:09:19.578311 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 09:09:19.578311 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 09:09:19.578311 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 09:09:19.578311 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZk2EvHIWQyXATvY4f6phbqF3DzIIyaJjJFCE11LxTKbrsndvuk5zoyyEUR0VXx32_kFjD0I6jBROuj0ZPSHQav7u9FFvOPFGrPkf9qZrgXY9k3zAUFrOVfwLECoLZOolubyCPUAGSEOi_HvFIP_Dd_DCbUCKDEGGLtdnAzy2tLCxHs Sep 14 09:09:19.578311 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 09:09:19.578311 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 09:09:19.578311 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 09:09:19.578311 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 09:09:19.578311 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 09:09:19.578311 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 09:09:19.578311 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 6907b82c9d5c4a23a63bbeec31c3c365 Sep 14 09:09:19.578311 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-ServersNegativeTestJSON-1654813540 Sep 14 09:09:19.578311 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 09:09:19.578311 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 09:09:19.578311 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6907b82c9d5c4a23a63bbeec31c3c365"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6907b82c9d5c4a23a63bbeec31c3c365"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6907b82c9d5c4a23a63bbeec31c3c365"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6907b82c9d5c4a23a63bbeec31c3c365"}]}] Sep 14 09:09:19.578311 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-ServersNegativeTestJSON-1654813540 Sep 14 09:09:19.578311 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 6907b82c9d5c4a23a63bbeec31c3c365 Sep 14 09:09:19.578311 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1654813540 Sep 14 09:09:19.578311 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-ServersNegativeTestJSON-1654813540-project Sep 14 09:09:19.578311 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 09:09:19.578311 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 09:09:19.578311 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 79583c4e80a04f138927f09eb4e170f4 Sep 14 09:09:19.578311 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-ServersNegativeTestJSON-1654813540-project Sep 14 09:09:19.578311 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 09:09:19.578311 n-d-836830-18 devstack@n-api.service[128758]: exception: Instance 8e670908-5bb6-49ad-92f3-dad1b4df1b5a could not be found. Sep 14 09:09:19.578311 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': '8e670908-5bb6-49ad-92f3-dad1b4df1b5a'} Sep 14 09:09:19.578311 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:09:19.578311 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:09:19.578311 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:09:19.578311 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:09:19.578311 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:09:19.578311 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:09:19.578311 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:09:19.578311 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:09:19.578311 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:09:19.578311 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:09:19.578311 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e670908-5bb6-49ad-92f3-dad1b4df1b5a could not be found. Sep 14 09:09:19.578311 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:09:19.578311 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:09:19.578311 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:09:19.578311 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:09:19.578311 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:09:19.578311 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:09:19.578311 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:09:19.578311 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:09:19.578311 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:09:19.578311 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:09:19.578311 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:09:19.578311 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:09:19.578311 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:09:19.578311 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:09:19.578311 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:09:19.578311 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:09:19.578311 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e670908-5bb6-49ad-92f3-dad1b4df1b5a could not be found. Sep 14 09:09:19.578311 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:09:19.578311 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:09:19.578311 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:09:19.583374 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:09:19.583374 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:09:19.583374 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:09:19.583374 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:09:19.583374 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:09:19.583374 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e670908-5bb6-49ad-92f3-dad1b4df1b5a could not be found. Sep 14 09:09:19.583374 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:09:19.583374 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a6221efa-b157-4bb4-98f7-21c7344f99be tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Returning 404 to user: Instance 8e670908-5bb6-49ad-92f3-dad1b4df1b5a could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:09:19.583374 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-a6221efa-b157-4bb4-98f7-21c7344f99be tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/8e670908-5bb6-49ad-92f3-dad1b4df1b5a" status: 404 len: 111 microversion: 2.1 time: 0.090804 Sep 14 09:09:19.586745 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2218/4440] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:09:19 2022] GET /compute/v2.1/servers/8e670908-5bb6-49ad-92f3-dad1b4df1b5a => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:09:19.591577 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-2b3774a3-6ce9-4799-b052-fb8fa6ebcd24 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:09:19.592071 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-2b3774a3-6ce9-4799-b052-fb8fa6ebcd24 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:09:19.600876 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2b3774a3-6ce9-4799-b052-fb8fa6ebcd24 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:19.601265 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2b3774a3-6ce9-4799-b052-fb8fa6ebcd24 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:19.601699 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2b3774a3-6ce9-4799-b052-fb8fa6ebcd24 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:19.602406 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2b3774a3-6ce9-4799-b052-fb8fa6ebcd24 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:19.602857 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2b3774a3-6ce9-4799-b052-fb8fa6ebcd24 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:19.603416 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2b3774a3-6ce9-4799-b052-fb8fa6ebcd24 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:19.636951 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-2b3774a3-6ce9-4799-b052-fb8fa6ebcd24 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Going to try to terminate instance {{(pid=128758) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:09:19.729465 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:09:19.817503 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-2b3774a3-6ce9-4799-b052-fb8fa6ebcd24 tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "DELETE /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 204 len: 0 microversion: 2.1 time: 0.224425 Sep 14 09:09:19.821531 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2219/4441] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:09:19 2022] DELETE /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:09:19.834520 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d6438193-e1af-4dd7-8120-d443f1a22d71 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:09:19.835641 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-d6438193-e1af-4dd7-8120-d443f1a22d71 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:09:19.870129 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d6438193-e1af-4dd7-8120-d443f1a22d71 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:19.870643 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d6438193-e1af-4dd7-8120-d443f1a22d71 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:19.871155 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d6438193-e1af-4dd7-8120-d443f1a22d71 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:19.871913 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d6438193-e1af-4dd7-8120-d443f1a22d71 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:19.872379 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d6438193-e1af-4dd7-8120-d443f1a22d71 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:19.873320 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d6438193-e1af-4dd7-8120-d443f1a22d71 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:20.533867 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-d6438193-e1af-4dd7-8120-d443f1a22d71 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:09:20.550102 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-d6438193-e1af-4dd7-8120-d443f1a22d71 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105" status: 200 len: 1686 microversion: 2.1 time: 0.726846 Sep 14 09:09:20.556275 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2220/4442] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:09:19 2022] GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105 => generated 1686 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:09:20.568162 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-f0ac424e-a72d-48e3-991a-2abbab63f26a tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:09:20.571945 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-f0ac424e-a72d-48e3-991a-2abbab63f26a tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:09:20.589723 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f0ac424e-a72d-48e3-991a-2abbab63f26a tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:20.594618 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f0ac424e-a72d-48e3-991a-2abbab63f26a tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:20.595396 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f0ac424e-a72d-48e3-991a-2abbab63f26a tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:20.596431 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f0ac424e-a72d-48e3-991a-2abbab63f26a tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:20.597136 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f0ac424e-a72d-48e3-991a-2abbab63f26a tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:20.597958 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f0ac424e-a72d-48e3-991a-2abbab63f26a tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:20.740529 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.network.neutron [None req-40d2a205-edd9-4a2d-8539-9d62c6353696 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] [instance: 6957a5fb-4af4-4ca1-809a-8dd02e517c24] Building network info cache for instance {{(pid=128759) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 14 09:09:21.484853 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-f0ac424e-a72d-48e3-991a-2abbab63f26a tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:09:21.497330 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-f0ac424e-a72d-48e3-991a-2abbab63f26a tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1512 microversion: 2.1 time: 0.939613 Sep 14 09:09:21.506510 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2221/4443] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:09:20 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1512 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:09:21.529474 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-9d0f7dde-9bb7-40f6-8e0a-04c14d7db7bf tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:09:21.531813 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-9d0f7dde-9bb7-40f6-8e0a-04c14d7db7bf tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:09:21.550780 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9d0f7dde-9bb7-40f6-8e0a-04c14d7db7bf tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:21.551697 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9d0f7dde-9bb7-40f6-8e0a-04c14d7db7bf tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:21.553420 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9d0f7dde-9bb7-40f6-8e0a-04c14d7db7bf tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:21.556240 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9d0f7dde-9bb7-40f6-8e0a-04c14d7db7bf tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:21.557820 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9d0f7dde-9bb7-40f6-8e0a-04c14d7db7bf tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:21.559725 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9d0f7dde-9bb7-40f6-8e0a-04c14d7db7bf tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:22.089826 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-9d0f7dde-9bb7-40f6-8e0a-04c14d7db7bf tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:09:22.101736 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-9d0f7dde-9bb7-40f6-8e0a-04c14d7db7bf tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:09:22.108752 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-9d0f7dde-9bb7-40f6-8e0a-04c14d7db7bf tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:09:22.116630 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-9d0f7dde-9bb7-40f6-8e0a-04c14d7db7bf tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5" status: 200 len: 1407 microversion: 2.20 time: 0.607538 Sep 14 09:09:22.127855 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2222/4444] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:09:21 2022] GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5 => generated 1407 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:09:22.137535 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-ddade180-cbc0-4a02-a1fd-12f1c2b683ea req-1a819b74-bd9f-4c63-bf8a-e1cdb34c6b14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6957a5fb-4af4-4ca1-809a-8dd02e517c24", "tag": "ace61c6b-a7bc-48b0-ba9c-109092ffc122"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:09:22.158952 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-ddade180-cbc0-4a02-a1fd-12f1c2b683ea req-1a819b74-bd9f-4c63-bf8a-e1cdb34c6b14 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:22.159574 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-ddade180-cbc0-4a02-a1fd-12f1c2b683ea req-1a819b74-bd9f-4c63-bf8a-e1cdb34c6b14 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:22.160627 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-ddade180-cbc0-4a02-a1fd-12f1c2b683ea req-1a819b74-bd9f-4c63-bf8a-e1cdb34c6b14 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:22.181994 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-ddade180-cbc0-4a02-a1fd-12f1c2b683ea req-1a819b74-bd9f-4c63-bf8a-e1cdb34c6b14 service nova] Creating event network-changed:ace61c6b-a7bc-48b0-ba9c-109092ffc122 for instance 6957a5fb-4af4-4ca1-809a-8dd02e517c24 on n-h2-836830-18 Sep 14 09:09:22.189077 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-ddade180-cbc0-4a02-a1fd-12f1c2b683ea req-1a819b74-bd9f-4c63-bf8a-e1cdb34c6b14 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069955 Sep 14 09:09:22.190238 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2223/4445] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:09:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:09:22.213895 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-357de783-2745-437e-b87c-f692aa2bf136 req-92a33763-6681-4885-b17a-2526a212f0dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8450d385-d5d9-4c86-9ece-b3bbf9ed1105", "name": "network-vif-plugged", "status": "completed", "tag": "eb873b1a-8b40-4eb4-a329-cf733d9ed342"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:09:22.285389 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-357de783-2745-437e-b87c-f692aa2bf136 req-92a33763-6681-4885-b17a-2526a212f0dd service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:22.286260 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-357de783-2745-437e-b87c-f692aa2bf136 req-92a33763-6681-4885-b17a-2526a212f0dd service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:22.286824 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-357de783-2745-437e-b87c-f692aa2bf136 req-92a33763-6681-4885-b17a-2526a212f0dd service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:22.313959 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-357de783-2745-437e-b87c-f692aa2bf136 req-92a33763-6681-4885-b17a-2526a212f0dd service nova] Creating event network-vif-plugged:eb873b1a-8b40-4eb4-a329-cf733d9ed342 for instance 8450d385-d5d9-4c86-9ece-b3bbf9ed1105 on n-h1-836830-18 Sep 14 09:09:22.332454 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-357de783-2745-437e-b87c-f692aa2bf136 req-92a33763-6681-4885-b17a-2526a212f0dd service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138676 Sep 14 09:09:22.337934 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2224/4446] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:09:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:09:22.355025 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-6f9586fd-3fb2-44e9-8ec6-e2cf51b54e64 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:09:22.361572 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-6f9586fd-3fb2-44e9-8ec6-e2cf51b54e64 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:09:22.396160 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6f9586fd-3fb2-44e9-8ec6-e2cf51b54e64 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:22.399684 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6f9586fd-3fb2-44e9-8ec6-e2cf51b54e64 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:22.401516 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6f9586fd-3fb2-44e9-8ec6-e2cf51b54e64 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:22.402506 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6f9586fd-3fb2-44e9-8ec6-e2cf51b54e64 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:22.419830 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6f9586fd-3fb2-44e9-8ec6-e2cf51b54e64 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:22.420688 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6f9586fd-3fb2-44e9-8ec6-e2cf51b54e64 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:24.336390 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-6f9586fd-3fb2-44e9-8ec6-e2cf51b54e64 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:09:24.345771 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-6f9586fd-3fb2-44e9-8ec6-e2cf51b54e64 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105" status: 200 len: 1681 microversion: 2.1 time: 2.006107 Sep 14 09:09:24.348214 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2225/4447] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:09:22 2022] GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105 => generated 1681 bytes in 2009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:09:24.374815 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-f7792fae-ddef-425a-a4cd-e332aa18848c tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:09:24.375637 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-f7792fae-ddef-425a-a4cd-e332aa18848c tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:09:24.403560 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f7792fae-ddef-425a-a4cd-e332aa18848c tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:24.404338 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f7792fae-ddef-425a-a4cd-e332aa18848c tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:24.404965 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f7792fae-ddef-425a-a4cd-e332aa18848c tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:24.405870 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f7792fae-ddef-425a-a4cd-e332aa18848c tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:24.408054 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f7792fae-ddef-425a-a4cd-e332aa18848c tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:24.408969 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f7792fae-ddef-425a-a4cd-e332aa18848c tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:24.769784 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-f7792fae-ddef-425a-a4cd-e332aa18848c tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79583c4e80a04f138927f09eb4e170f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6907b82c9d5c4a23a63bbeec31c3c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:09:24.791703 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-f7792fae-ddef-425a-a4cd-e332aa18848c tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 200 len: 1470 microversion: 2.1 time: 0.429919 Sep 14 09:09:24.796305 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2226/4448] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:09:24 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 1470 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:09:24.801891 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-244c5dbd-f34d-480c-a992-874de0e15239 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:09:24.818806 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-244c5dbd-f34d-480c-a992-874de0e15239 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:09:24.855318 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-244c5dbd-f34d-480c-a992-874de0e15239 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:24.856077 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-244c5dbd-f34d-480c-a992-874de0e15239 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:24.857285 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-244c5dbd-f34d-480c-a992-874de0e15239 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:24.858528 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-244c5dbd-f34d-480c-a992-874de0e15239 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:24.859202 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-244c5dbd-f34d-480c-a992-874de0e15239 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:24.860362 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-244c5dbd-f34d-480c-a992-874de0e15239 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:24.884131 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.network.neutron [None req-40d2a205-edd9-4a2d-8539-9d62c6353696 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] [instance: 6957a5fb-4af4-4ca1-809a-8dd02e517c24] Updating instance_info_cache with network_info: [{"id": "ace61c6b-a7bc-48b0-ba9c-109092ffc122", "address": "fa:16:3e:2e:b3:93", "network": {"id": "4bc21ab8-ade0-4350-93cd-03061c652d89", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-970272613-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.9.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "44b713d80d5243659644e0c74c6df59c", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapace61c6b-a7", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128759) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 14 09:09:24.897314 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-40d2a205-edd9-4a2d-8539-9d62c6353696 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Releasing lock "refresh_cache-6957a5fb-4af4-4ca1-809a-8dd02e517c24" {{(pid=128759) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 14 09:09:24.901822 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-40d2a205-edd9-4a2d-8539-9d62c6353696 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] 10.222.0.60 "POST /compute/v2.1/servers/6957a5fb-4af4-4ca1-809a-8dd02e517c24/action" status: 202 len: 0 microversion: 2.1 time: 7.354779 Sep 14 09:09:24.905056 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2223/4449] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:09:17 2022] POST /compute/v2.1/servers/6957a5fb-4af4-4ca1-809a-8dd02e517c24/action => generated 0 bytes in 7359 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 14 09:09:24.954023 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-250ab4a7-aebf-45e4-a1a1-a5464e9206f5 req-15bb3ff4-3469-4053-8c47-b9b10bf0f274 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5", "name": "network-vif-plugged", "status": "completed", "tag": "906bcc79-e290-4b18-8447-de06233392de"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:09:25.014790 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-250ab4a7-aebf-45e4-a1a1-a5464e9206f5 req-15bb3ff4-3469-4053-8c47-b9b10bf0f274 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:25.024538 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-250ab4a7-aebf-45e4-a1a1-a5464e9206f5 req-15bb3ff4-3469-4053-8c47-b9b10bf0f274 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:25.027223 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-250ab4a7-aebf-45e4-a1a1-a5464e9206f5 req-15bb3ff4-3469-4053-8c47-b9b10bf0f274 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:25.094469 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-250ab4a7-aebf-45e4-a1a1-a5464e9206f5 req-15bb3ff4-3469-4053-8c47-b9b10bf0f274 service nova] Creating event network-vif-plugged:906bcc79-e290-4b18-8447-de06233392de for instance 4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5 on n-h1-836830-18 Sep 14 09:09:25.113708 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-250ab4a7-aebf-45e4-a1a1-a5464e9206f5 req-15bb3ff4-3469-4053-8c47-b9b10bf0f274 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.207299 Sep 14 09:09:25.117208 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2224/4450] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:09:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:09:25.144933 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3a8f0b15-a745-462c-8705-c80556b5983d tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.9.224"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:09:25.416657 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-244c5dbd-f34d-480c-a992-874de0e15239 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:09:25.428192 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-244c5dbd-f34d-480c-a992-874de0e15239 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:09:25.438880 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-244c5dbd-f34d-480c-a992-874de0e15239 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:09:25.446149 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-244c5dbd-f34d-480c-a992-874de0e15239 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5" status: 200 len: 1407 microversion: 2.20 time: 0.648500 Sep 14 09:09:25.447282 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2227/4451] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:09:24 2022] GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5 => generated 1407 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:09:25.458744 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-ad856b49-9ecf-4fad-ba48-342115c63ea4 req-1a5e1af6-f302-435f-9e7a-c3dd61d162b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae344b98-a354-4df8-83ba-3c5a786694f4", "name": "network-vif-deleted", "tag": "61e7783e-94c8-44e3-8a64-73b1fe49a7cd"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:09:25.478611 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-ad856b49-9ecf-4fad-ba48-342115c63ea4 req-1a5e1af6-f302-435f-9e7a-c3dd61d162b9 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:25.487131 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-ad856b49-9ecf-4fad-ba48-342115c63ea4 req-1a5e1af6-f302-435f-9e7a-c3dd61d162b9 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:25.488254 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-ad856b49-9ecf-4fad-ba48-342115c63ea4 req-1a5e1af6-f302-435f-9e7a-c3dd61d162b9 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:25.522315 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-ad856b49-9ecf-4fad-ba48-342115c63ea4 req-1a5e1af6-f302-435f-9e7a-c3dd61d162b9 service nova] Creating event network-vif-deleted:61e7783e-94c8-44e3-8a64-73b1fe49a7cd for instance ae344b98-a354-4df8-83ba-3c5a786694f4 on n-h2-836830-18 Sep 14 09:09:25.530106 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-ad856b49-9ecf-4fad-ba48-342115c63ea4 req-1a5e1af6-f302-435f-9e7a-c3dd61d162b9 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081302 Sep 14 09:09:25.532254 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2228/4452] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:09:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:09:25.544500 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-f3863294-a383-44b4-9805-54e576e402b2 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:09:25.546608 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-f3863294-a383-44b4-9805-54e576e402b2 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:09:25.548284 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-3a8f0b15-a745-462c-8705-c80556b5983d tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] [instance: 6957a5fb-4af4-4ca1-809a-8dd02e517c24] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:09:25.556135 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3a8f0b15-a745-462c-8705-c80556b5983d tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:25.556713 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3a8f0b15-a745-462c-8705-c80556b5983d tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:25.556849 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f3863294-a383-44b4-9805-54e576e402b2 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:25.557263 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3a8f0b15-a745-462c-8705-c80556b5983d tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:25.557996 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f3863294-a383-44b4-9805-54e576e402b2 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:25.558767 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f3863294-a383-44b4-9805-54e576e402b2 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:25.558892 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3a8f0b15-a745-462c-8705-c80556b5983d tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:25.559856 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f3863294-a383-44b4-9805-54e576e402b2 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:25.561495 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f3863294-a383-44b4-9805-54e576e402b2 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:25.562352 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f3863294-a383-44b4-9805-54e576e402b2 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:25.562496 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3a8f0b15-a745-462c-8705-c80556b5983d tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:25.563046 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3a8f0b15-a745-462c-8705-c80556b5983d tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:25.972505 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-f3863294-a383-44b4-9805-54e576e402b2 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:09:25.981841 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-f3863294-a383-44b4-9805-54e576e402b2 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105" status: 200 len: 1681 microversion: 2.1 time: 0.447930 Sep 14 09:09:26.007772 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2229/4453] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:09:25 2022] GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105 => generated 1681 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:09:26.012771 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-93766b07-aa39-4e8d-9169-c664f4fb15db tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:09:26.015744 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-93766b07-aa39-4e8d-9169-c664f4fb15db tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] [instance: ae344b98-a354-4df8-83ba-3c5a786694f4] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:09:26.029087 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-93766b07-aa39-4e8d-9169-c664f4fb15db tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:26.030771 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-93766b07-aa39-4e8d-9169-c664f4fb15db tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:26.037282 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-93766b07-aa39-4e8d-9169-c664f4fb15db tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:26.038317 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-93766b07-aa39-4e8d-9169-c664f4fb15db tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:26.038897 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-93766b07-aa39-4e8d-9169-c664f4fb15db tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:26.039478 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-93766b07-aa39-4e8d-9169-c664f4fb15db tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:26.062989 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-93766b07-aa39-4e8d-9169-c664f4fb15db tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] HTTP exception thrown: Instance ae344b98-a354-4df8-83ba-3c5a786694f4 could not be found. Sep 14 09:09:26.069267 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-93766b07-aa39-4e8d-9169-c664f4fb15db tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Request method failure captured: Sep 14 09:09:26.069267 n-d-836830-18 devstack@n-api.service[128758]: request: GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 HTTP/1.1 Sep 14 09:09:26.069267 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 09:09:26.069267 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 09:09:26.069267 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 09:09:26.069267 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 09:09:26.069267 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 09:09:26.069267 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 09:09:26.069267 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 09:09:26.069267 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 09:09:26.069267 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZk2EvHIWQyXATvY4f6phbqF3DzIIyaJjJFCE11LxTKbrsndvuk5zoyyEUR0VXx32_kFjD0I6jBROuj0ZPSHQav7u9FFvOPFGrPkf9qZrgXY9k3zAUFrOVfwLECoLZOolubyCPUAGSEOi_HvFIP_Dd_DCbUCKDEGGLtdnAzy2tLCxHs Sep 14 09:09:26.069267 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 09:09:26.069267 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 09:09:26.069267 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 09:09:26.069267 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 09:09:26.069267 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 09:09:26.069267 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 09:09:26.069267 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 6907b82c9d5c4a23a63bbeec31c3c365 Sep 14 09:09:26.069267 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-ServersNegativeTestJSON-1654813540 Sep 14 09:09:26.069267 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 09:09:26.069267 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 09:09:26.069267 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6907b82c9d5c4a23a63bbeec31c3c365"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6907b82c9d5c4a23a63bbeec31c3c365"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6907b82c9d5c4a23a63bbeec31c3c365"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6907b82c9d5c4a23a63bbeec31c3c365"}]}] Sep 14 09:09:26.069267 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-ServersNegativeTestJSON-1654813540 Sep 14 09:09:26.069267 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 6907b82c9d5c4a23a63bbeec31c3c365 Sep 14 09:09:26.069267 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1654813540 Sep 14 09:09:26.069267 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-ServersNegativeTestJSON-1654813540-project Sep 14 09:09:26.069267 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 09:09:26.069267 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 09:09:26.069267 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 79583c4e80a04f138927f09eb4e170f4 Sep 14 09:09:26.069267 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-ServersNegativeTestJSON-1654813540-project Sep 14 09:09:26.069267 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 09:09:26.069267 n-d-836830-18 devstack@n-api.service[128758]: exception: Instance ae344b98-a354-4df8-83ba-3c5a786694f4 could not be found. Sep 14 09:09:26.069267 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': 'ae344b98-a354-4df8-83ba-3c5a786694f4'} Sep 14 09:09:26.069267 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:09:26.069267 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:09:26.069267 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:09:26.069267 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:09:26.069267 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:09:26.069267 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:09:26.069267 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:09:26.069267 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:09:26.069267 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:09:26.069267 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:09:26.069267 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae344b98-a354-4df8-83ba-3c5a786694f4 could not be found. Sep 14 09:09:26.069267 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:09:26.069267 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:09:26.069267 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:09:26.069267 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:09:26.069267 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:09:26.069267 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:09:26.069267 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:09:26.069267 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:09:26.069267 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:09:26.069267 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:09:26.069267 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:09:26.069267 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:09:26.069267 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:09:26.069267 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:09:26.069267 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:09:26.069267 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:09:26.069267 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae344b98-a354-4df8-83ba-3c5a786694f4 could not be found. Sep 14 09:09:26.069267 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:09:26.069267 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:09:26.069267 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:09:26.074049 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:09:26.074049 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:09:26.074049 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:09:26.074049 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:09:26.074049 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:09:26.074049 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae344b98-a354-4df8-83ba-3c5a786694f4 could not be found. Sep 14 09:09:26.074049 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:09:26.079584 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-93766b07-aa39-4e8d-9169-c664f4fb15db tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] Returning 404 to user: Instance ae344b98-a354-4df8-83ba-3c5a786694f4 could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:09:26.081232 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-93766b07-aa39-4e8d-9169-c664f4fb15db tempest-ServersNegativeTestJSON-1654813540 tempest-ServersNegativeTestJSON-1654813540-project] 10.222.0.60 "GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4" status: 404 len: 111 microversion: 2.1 time: 0.071705 Sep 14 09:09:26.082551 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2230/4454] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:09:26 2022] GET /compute/v2.1/servers/ae344b98-a354-4df8-83ba-3c5a786694f4 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:09:26.248262 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3a8f0b15-a745-462c-8705-c80556b5983d tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Acquiring lock "refresh_cache-6957a5fb-4af4-4ca1-809a-8dd02e517c24" {{(pid=128759) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 14 09:09:26.248763 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3a8f0b15-a745-462c-8705-c80556b5983d tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Acquired lock "refresh_cache-6957a5fb-4af4-4ca1-809a-8dd02e517c24" {{(pid=128759) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 14 09:09:26.472694 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c6751dc3-04e6-4467-99a3-8f5aecae3b2b tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:09:26.473890 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-c6751dc3-04e6-4467-99a3-8f5aecae3b2b tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:09:26.485007 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c6751dc3-04e6-4467-99a3-8f5aecae3b2b tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:26.487549 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c6751dc3-04e6-4467-99a3-8f5aecae3b2b tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:26.488250 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c6751dc3-04e6-4467-99a3-8f5aecae3b2b tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:26.489247 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c6751dc3-04e6-4467-99a3-8f5aecae3b2b tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:26.491717 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c6751dc3-04e6-4467-99a3-8f5aecae3b2b tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:26.492952 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c6751dc3-04e6-4467-99a3-8f5aecae3b2b tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:28.108954 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-c6751dc3-04e6-4467-99a3-8f5aecae3b2b tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:09:28.141358 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-c6751dc3-04e6-4467-99a3-8f5aecae3b2b tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:09:28.148698 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-c6751dc3-04e6-4467-99a3-8f5aecae3b2b tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:09:28.152932 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-c6751dc3-04e6-4467-99a3-8f5aecae3b2b tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5" status: 200 len: 1407 microversion: 2.20 time: 1.684204 Sep 14 09:09:28.159706 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2231/4455] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:09:26 2022] GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5 => generated 1407 bytes in 1692 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:09:28.181415 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-9f9f83f1-e2b1-4b7d-b112-2ade7bd0ea09 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:09:28.183399 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-9f9f83f1-e2b1-4b7d-b112-2ade7bd0ea09 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:09:28.207566 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9f9f83f1-e2b1-4b7d-b112-2ade7bd0ea09 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:28.211644 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9f9f83f1-e2b1-4b7d-b112-2ade7bd0ea09 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:28.213664 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9f9f83f1-e2b1-4b7d-b112-2ade7bd0ea09 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:28.216468 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9f9f83f1-e2b1-4b7d-b112-2ade7bd0ea09 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:28.217916 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9f9f83f1-e2b1-4b7d-b112-2ade7bd0ea09 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:28.220863 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9f9f83f1-e2b1-4b7d-b112-2ade7bd0ea09 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:28.599552 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-9f9f83f1-e2b1-4b7d-b112-2ade7bd0ea09 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:09:28.610654 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-9f9f83f1-e2b1-4b7d-b112-2ade7bd0ea09 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105" status: 200 len: 1681 microversion: 2.1 time: 0.445752 Sep 14 09:09:28.617197 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2232/4456] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:09:28 2022] GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105 => generated 1681 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:09:28.706046 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.network.neutron [None req-3a8f0b15-a745-462c-8705-c80556b5983d tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] [instance: 6957a5fb-4af4-4ca1-809a-8dd02e517c24] Building network info cache for instance {{(pid=128759) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 14 09:09:28.715708 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-335726a6-1c3f-4aa2-a689-64aa396369bc req-3922b5f4-b877-4a8a-b45e-3b466b45343e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6957a5fb-4af4-4ca1-809a-8dd02e517c24", "tag": "ace61c6b-a7bc-48b0-ba9c-109092ffc122"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:09:28.735815 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-335726a6-1c3f-4aa2-a689-64aa396369bc req-3922b5f4-b877-4a8a-b45e-3b466b45343e service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:28.736324 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-335726a6-1c3f-4aa2-a689-64aa396369bc req-3922b5f4-b877-4a8a-b45e-3b466b45343e service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:28.736816 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-335726a6-1c3f-4aa2-a689-64aa396369bc req-3922b5f4-b877-4a8a-b45e-3b466b45343e service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:28.777647 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-335726a6-1c3f-4aa2-a689-64aa396369bc req-3922b5f4-b877-4a8a-b45e-3b466b45343e service nova] Creating event network-changed:ace61c6b-a7bc-48b0-ba9c-109092ffc122 for instance 6957a5fb-4af4-4ca1-809a-8dd02e517c24 on n-h2-836830-18 Sep 14 09:09:28.814178 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-335726a6-1c3f-4aa2-a689-64aa396369bc req-3922b5f4-b877-4a8a-b45e-3b466b45343e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083961 Sep 14 09:09:28.816309 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2233/4457] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:09:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:09:29.186256 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1a5c0375-d994-4ee2-9ae0-c49729f5efe9 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:09:29.187439 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-1a5c0375-d994-4ee2-9ae0-c49729f5efe9 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:09:29.204629 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1a5c0375-d994-4ee2-9ae0-c49729f5efe9 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:29.205137 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1a5c0375-d994-4ee2-9ae0-c49729f5efe9 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:29.206136 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1a5c0375-d994-4ee2-9ae0-c49729f5efe9 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:29.208767 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1a5c0375-d994-4ee2-9ae0-c49729f5efe9 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:29.209179 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1a5c0375-d994-4ee2-9ae0-c49729f5efe9 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:29.214512 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1a5c0375-d994-4ee2-9ae0-c49729f5efe9 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:30.484054 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-1a5c0375-d994-4ee2-9ae0-c49729f5efe9 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:09:30.493293 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-1a5c0375-d994-4ee2-9ae0-c49729f5efe9 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:09:30.504045 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-1a5c0375-d994-4ee2-9ae0-c49729f5efe9 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:09:30.512174 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-1a5c0375-d994-4ee2-9ae0-c49729f5efe9 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5" status: 200 len: 1598 microversion: 2.20 time: 1.330052 Sep 14 09:09:30.512818 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2234/4458] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:09:29 2022] GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5 => generated 1598 bytes in 1332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 09:09:30.547386 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-284fe665-0945-4a52-a704-188db629b9c5 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:09:30.548282 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-284fe665-0945-4a52-a704-188db629b9c5 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:09:30.584862 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-284fe665-0945-4a52-a704-188db629b9c5 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:30.585380 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-284fe665-0945-4a52-a704-188db629b9c5 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:30.588434 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-284fe665-0945-4a52-a704-188db629b9c5 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:30.600020 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-284fe665-0945-4a52-a704-188db629b9c5 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:30.600774 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-284fe665-0945-4a52-a704-188db629b9c5 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:30.601383 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-284fe665-0945-4a52-a704-188db629b9c5 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:31.062026 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.network.neutron [None req-3a8f0b15-a745-462c-8705-c80556b5983d tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] [instance: 6957a5fb-4af4-4ca1-809a-8dd02e517c24] Updating instance_info_cache with network_info: [{"id": "ace61c6b-a7bc-48b0-ba9c-109092ffc122", "address": "fa:16:3e:2e:b3:93", "network": {"id": "4bc21ab8-ade0-4350-93cd-03061c652d89", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-970272613-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "44b713d80d5243659644e0c74c6df59c", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapace61c6b-a7", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128759) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 14 09:09:31.089102 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3a8f0b15-a745-462c-8705-c80556b5983d tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Releasing lock "refresh_cache-6957a5fb-4af4-4ca1-809a-8dd02e517c24" {{(pid=128759) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 14 09:09:31.103535 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-3a8f0b15-a745-462c-8705-c80556b5983d tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] 10.222.0.60 "POST /compute/v2.1/servers/6957a5fb-4af4-4ca1-809a-8dd02e517c24/action" status: 202 len: 0 microversion: 2.1 time: 5.968487 Sep 14 09:09:31.107891 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2225/4459] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:09:25 2022] POST /compute/v2.1/servers/6957a5fb-4af4-4ca1-809a-8dd02e517c24/action => generated 0 bytes in 5990 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 14 09:09:31.117926 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ad54817e-616f-4911-83db-e37b9066766e tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:09:31.118811 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-ad54817e-616f-4911-83db-e37b9066766e tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:09:31.126412 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ad54817e-616f-4911-83db-e37b9066766e tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:31.127379 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ad54817e-616f-4911-83db-e37b9066766e tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:31.128206 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ad54817e-616f-4911-83db-e37b9066766e tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:31.129153 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ad54817e-616f-4911-83db-e37b9066766e tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:31.129846 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ad54817e-616f-4911-83db-e37b9066766e tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:31.130492 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ad54817e-616f-4911-83db-e37b9066766e tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:31.392655 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-ad54817e-616f-4911-83db-e37b9066766e tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.283376 Sep 14 09:09:31.393920 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2226/4460] 10.222.0.60 () {60 vars in 1316 bytes} [Wed Sep 14 09:09:31 2022] GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5/os-interface => generated 284 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 09:09:31.398967 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-6a62887a-e8a2-4f5d-88f6-ae4111dc29b4 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Calling method '.version_select at 0x7f7d3ee57d30>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:09:31.791948 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-284fe665-0945-4a52-a704-188db629b9c5 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:09:31.804173 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-284fe665-0945-4a52-a704-188db629b9c5 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105" status: 200 len: 1681 microversion: 2.1 time: 1.270434 Sep 14 09:09:31.806607 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2235/4461] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:09:30 2022] GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105 => generated 1681 bytes in 1293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:09:32.830037 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-7a415b29-7dcf-4355-bfad-30ad1497c190 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:09:32.832170 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-7a415b29-7dcf-4355-bfad-30ad1497c190 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:09:32.840321 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7a415b29-7dcf-4355-bfad-30ad1497c190 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:32.844829 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7a415b29-7dcf-4355-bfad-30ad1497c190 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:32.846287 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7a415b29-7dcf-4355-bfad-30ad1497c190 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:32.849109 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7a415b29-7dcf-4355-bfad-30ad1497c190 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:32.849827 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7a415b29-7dcf-4355-bfad-30ad1497c190 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:32.852104 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7a415b29-7dcf-4355-bfad-30ad1497c190 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:34.007311 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-7a415b29-7dcf-4355-bfad-30ad1497c190 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:09:34.021041 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-7a415b29-7dcf-4355-bfad-30ad1497c190 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105" status: 200 len: 1681 microversion: 2.1 time: 1.193701 Sep 14 09:09:34.024225 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2236/4462] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:09:32 2022] GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105 => generated 1681 bytes in 1198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:09:35.056293 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-7512e5bd-34cb-4632-8408-c027a81157e7 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:09:35.057764 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-7512e5bd-34cb-4632-8408-c027a81157e7 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:09:35.076642 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7512e5bd-34cb-4632-8408-c027a81157e7 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:35.081637 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7512e5bd-34cb-4632-8408-c027a81157e7 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:35.082870 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7512e5bd-34cb-4632-8408-c027a81157e7 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:35.088872 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7512e5bd-34cb-4632-8408-c027a81157e7 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:35.089654 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7512e5bd-34cb-4632-8408-c027a81157e7 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:35.090291 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7512e5bd-34cb-4632-8408-c027a81157e7 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:35.542440 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-6a62887a-e8a2-4f5d-88f6-ae4111dc29b4 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] 10.222.0.60 "DELETE /compute/v2.1/os-floating-ips/37768615-774f-465b-92f7-ded2705aa81a" status: 202 len: 0 microversion: 2.1 time: 4.147043 Sep 14 09:09:35.550228 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2227/4463] 10.222.0.60 () {58 vars in 1263 bytes} [Wed Sep 14 09:09:31 2022] DELETE /compute/v2.1/os-floating-ips/37768615-774f-465b-92f7-ded2705aa81a => generated 0 bytes in 4155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:09:35.556199 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-6385e180-d326-4cd6-9309-36f5e5f8a7d4 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Calling method '.version_select at 0x7f7d3ef9cca0>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:09:35.668517 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-7512e5bd-34cb-4632-8408-c027a81157e7 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:09:35.686028 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-7512e5bd-34cb-4632-8408-c027a81157e7 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105" status: 200 len: 1681 microversion: 2.1 time: 0.634499 Sep 14 09:09:35.705054 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2237/4464] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:09:35 2022] GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105 => generated 1681 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:09:35.906737 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-17bf62fd-38d2-4c3f-99ec-df1a536f1fc0 req-597d2936-b722-4234-b7cc-5112d8b10a16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5", "tag": "906bcc79-e290-4b18-8447-de06233392de"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:09:35.930802 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-17bf62fd-38d2-4c3f-99ec-df1a536f1fc0 req-597d2936-b722-4234-b7cc-5112d8b10a16 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:35.931328 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-17bf62fd-38d2-4c3f-99ec-df1a536f1fc0 req-597d2936-b722-4234-b7cc-5112d8b10a16 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:35.931767 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-17bf62fd-38d2-4c3f-99ec-df1a536f1fc0 req-597d2936-b722-4234-b7cc-5112d8b10a16 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:35.973669 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-17bf62fd-38d2-4c3f-99ec-df1a536f1fc0 req-597d2936-b722-4234-b7cc-5112d8b10a16 service nova] Creating event network-changed:906bcc79-e290-4b18-8447-de06233392de for instance 4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5 on n-h1-836830-18 Sep 14 09:09:35.993405 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-17bf62fd-38d2-4c3f-99ec-df1a536f1fc0 req-597d2936-b722-4234-b7cc-5112d8b10a16 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088974 Sep 14 09:09:35.996282 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2238/4465] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:09:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:09:36.207764 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-6385e180-d326-4cd6-9309-36f5e5f8a7d4 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/eb0e9013-6b5d-456d-bd00-85d0f241e025" status: 202 len: 0 microversion: 2.1 time: 0.655765 Sep 14 09:09:36.212314 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2228/4466] 10.222.0.60 () {58 vars in 1272 bytes} [Wed Sep 14 09:09:35 2022] DELETE /compute/v2.1/os-security-groups/eb0e9013-6b5d-456d-bd00-85d0f241e025 => generated 0 bytes in 660 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:09:36.218532 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-59e815cd-0be7-446c-9343-232406ec6370 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:09:36.219224 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-59e815cd-0be7-446c-9343-232406ec6370 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] [instance: 6957a5fb-4af4-4ca1-809a-8dd02e517c24] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:09:36.242911 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-59e815cd-0be7-446c-9343-232406ec6370 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:36.246876 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-59e815cd-0be7-446c-9343-232406ec6370 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:36.253017 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-59e815cd-0be7-446c-9343-232406ec6370 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:36.253800 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-59e815cd-0be7-446c-9343-232406ec6370 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:36.259839 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-59e815cd-0be7-446c-9343-232406ec6370 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:36.260374 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-59e815cd-0be7-446c-9343-232406ec6370 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:36.347500 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-59e815cd-0be7-446c-9343-232406ec6370 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] [instance: 6957a5fb-4af4-4ca1-809a-8dd02e517c24] Going to try to terminate instance {{(pid=128758) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:09:36.452995 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:09:36.569372 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-59e815cd-0be7-446c-9343-232406ec6370 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] 10.222.0.60 "DELETE /compute/v2.1/servers/6957a5fb-4af4-4ca1-809a-8dd02e517c24" status: 204 len: 0 microversion: 2.1 time: 0.355710 Sep 14 09:09:36.570641 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2239/4467] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:09:36 2022] DELETE /compute/v2.1/servers/6957a5fb-4af4-4ca1-809a-8dd02e517c24 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:09:36.579017 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9301997d-d30e-4c0d-9dc8-f075f15d0e23 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:09:36.579592 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-9301997d-d30e-4c0d-9dc8-f075f15d0e23 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] [instance: 6957a5fb-4af4-4ca1-809a-8dd02e517c24] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:09:36.593801 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9301997d-d30e-4c0d-9dc8-f075f15d0e23 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:36.599288 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9301997d-d30e-4c0d-9dc8-f075f15d0e23 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:36.599844 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9301997d-d30e-4c0d-9dc8-f075f15d0e23 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:36.600599 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9301997d-d30e-4c0d-9dc8-f075f15d0e23 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:36.601076 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9301997d-d30e-4c0d-9dc8-f075f15d0e23 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:36.601509 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9301997d-d30e-4c0d-9dc8-f075f15d0e23 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:36.716984 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-8cdf1d5c-ceaa-44df-800f-2ab2daf6b54f tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:09:36.718147 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-8cdf1d5c-ceaa-44df-800f-2ab2daf6b54f tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:09:36.729676 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8cdf1d5c-ceaa-44df-800f-2ab2daf6b54f tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:36.731737 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8cdf1d5c-ceaa-44df-800f-2ab2daf6b54f tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:36.733733 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8cdf1d5c-ceaa-44df-800f-2ab2daf6b54f tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:36.737299 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8cdf1d5c-ceaa-44df-800f-2ab2daf6b54f tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:36.737980 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8cdf1d5c-ceaa-44df-800f-2ab2daf6b54f tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:36.740401 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8cdf1d5c-ceaa-44df-800f-2ab2daf6b54f tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:37.153718 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-8cdf1d5c-ceaa-44df-800f-2ab2daf6b54f tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:09:37.163174 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-8cdf1d5c-ceaa-44df-800f-2ab2daf6b54f tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105" status: 200 len: 1681 microversion: 2.1 time: 0.451677 Sep 14 09:09:37.174612 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2240/4468] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:09:36 2022] GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105 => generated 1681 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:09:37.267535 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-9301997d-d30e-4c0d-9dc8-f075f15d0e23 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932f3d4bbfd04cae8e48a937a5b10716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b713d80d5243659644e0c74c6df59c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:09:37.278736 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-9301997d-d30e-4c0d-9dc8-f075f15d0e23 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] 10.222.0.60 "GET /compute/v2.1/servers/6957a5fb-4af4-4ca1-809a-8dd02e517c24" status: 200 len: 1508 microversion: 2.1 time: 0.704079 Sep 14 09:09:37.294171 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2229/4469] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:09:36 2022] GET /compute/v2.1/servers/6957a5fb-4af4-4ca1-809a-8dd02e517c24 => generated 1508 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:09:38.201830 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-2363c2fe-7166-497d-af79-3b25a0db8c2f tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:09:38.202624 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-2363c2fe-7166-497d-af79-3b25a0db8c2f tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:09:38.215751 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2363c2fe-7166-497d-af79-3b25a0db8c2f tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:38.217158 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2363c2fe-7166-497d-af79-3b25a0db8c2f tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:38.220834 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2363c2fe-7166-497d-af79-3b25a0db8c2f tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:38.222249 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2363c2fe-7166-497d-af79-3b25a0db8c2f tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:38.223428 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2363c2fe-7166-497d-af79-3b25a0db8c2f tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:38.225255 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2363c2fe-7166-497d-af79-3b25a0db8c2f tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:38.307623 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a1e110a3-45f0-40b3-bef8-171414b34893 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:09:38.309249 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-a1e110a3-45f0-40b3-bef8-171414b34893 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] [instance: 6957a5fb-4af4-4ca1-809a-8dd02e517c24] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:09:38.317786 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a1e110a3-45f0-40b3-bef8-171414b34893 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:38.318280 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a1e110a3-45f0-40b3-bef8-171414b34893 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:38.318808 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a1e110a3-45f0-40b3-bef8-171414b34893 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:38.319482 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a1e110a3-45f0-40b3-bef8-171414b34893 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:38.325486 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a1e110a3-45f0-40b3-bef8-171414b34893 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:38.327297 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a1e110a3-45f0-40b3-bef8-171414b34893 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:38.805402 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-2363c2fe-7166-497d-af79-3b25a0db8c2f tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:09:38.815513 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-2363c2fe-7166-497d-af79-3b25a0db8c2f tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105" status: 200 len: 1681 microversion: 2.1 time: 0.618357 Sep 14 09:09:38.816109 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2241/4470] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:09:38 2022] GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105 => generated 1681 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:09:38.889245 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-a1e110a3-45f0-40b3-bef8-171414b34893 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932f3d4bbfd04cae8e48a937a5b10716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b713d80d5243659644e0c74c6df59c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:09:38.907195 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a1e110a3-45f0-40b3-bef8-171414b34893 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] 10.222.0.60 "GET /compute/v2.1/servers/6957a5fb-4af4-4ca1-809a-8dd02e517c24" status: 200 len: 1508 microversion: 2.1 time: 0.601547 Sep 14 09:09:38.909386 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2230/4471] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:09:38 2022] GET /compute/v2.1/servers/6957a5fb-4af4-4ca1-809a-8dd02e517c24 => generated 1508 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:09:39.751865 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-deeca5eb-39bd-4dfa-b174-74e759a721a1 tempest-AbsoluteLimitsTestJSON-603188287 tempest-AbsoluteLimitsTestJSON-603188287-project] Calling method '.version_select at 0x7f7d3f3fc1f0>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:09:39.845701 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-bac4d540-70d5-4681-ab4a-b53702cd97bd tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:09:39.846875 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-bac4d540-70d5-4681-ab4a-b53702cd97bd tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:09:39.872196 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bac4d540-70d5-4681-ab4a-b53702cd97bd tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:39.872699 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bac4d540-70d5-4681-ab4a-b53702cd97bd tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:39.875418 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-deeca5eb-39bd-4dfa-b174-74e759a721a1 tempest-AbsoluteLimitsTestJSON-603188287 tempest-AbsoluteLimitsTestJSON-603188287-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:39.875981 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-deeca5eb-39bd-4dfa-b174-74e759a721a1 tempest-AbsoluteLimitsTestJSON-603188287 tempest-AbsoluteLimitsTestJSON-603188287-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:39.876425 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-deeca5eb-39bd-4dfa-b174-74e759a721a1 tempest-AbsoluteLimitsTestJSON-603188287 tempest-AbsoluteLimitsTestJSON-603188287-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:39.877214 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bac4d540-70d5-4681-ab4a-b53702cd97bd tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:39.878387 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-deeca5eb-39bd-4dfa-b174-74e759a721a1 tempest-AbsoluteLimitsTestJSON-603188287 tempest-AbsoluteLimitsTestJSON-603188287-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:39.878854 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-deeca5eb-39bd-4dfa-b174-74e759a721a1 tempest-AbsoluteLimitsTestJSON-603188287 tempest-AbsoluteLimitsTestJSON-603188287-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:39.880271 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bac4d540-70d5-4681-ab4a-b53702cd97bd tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:39.880792 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bac4d540-70d5-4681-ab4a-b53702cd97bd tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:39.881206 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bac4d540-70d5-4681-ab4a-b53702cd97bd tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:39.881853 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-deeca5eb-39bd-4dfa-b174-74e759a721a1 tempest-AbsoluteLimitsTestJSON-603188287 tempest-AbsoluteLimitsTestJSON-603188287-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:39.995098 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-deeca5eb-39bd-4dfa-b174-74e759a721a1 tempest-AbsoluteLimitsTestJSON-603188287 tempest-AbsoluteLimitsTestJSON-603188287-project] 10.222.0.60 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 1.020854 Sep 14 09:09:40.010988 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2242/4472] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 14 09:09:38 2022] GET /compute/v2.1/limits => generated 511 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:09:40.015472 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-4a995f35-bc53-42ee-add9-321649dd95c2 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:09:40.025255 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-4a995f35-bc53-42ee-add9-321649dd95c2 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] [instance: 6957a5fb-4af4-4ca1-809a-8dd02e517c24] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:09:40.041964 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4a995f35-bc53-42ee-add9-321649dd95c2 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:40.045468 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4a995f35-bc53-42ee-add9-321649dd95c2 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:40.046232 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4a995f35-bc53-42ee-add9-321649dd95c2 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:40.047192 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4a995f35-bc53-42ee-add9-321649dd95c2 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:40.049079 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4a995f35-bc53-42ee-add9-321649dd95c2 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:40.055047 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4a995f35-bc53-42ee-add9-321649dd95c2 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:40.194331 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-bac4d540-70d5-4681-ab4a-b53702cd97bd tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:09:40.203809 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-bac4d540-70d5-4681-ab4a-b53702cd97bd tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105" status: 200 len: 1681 microversion: 2.1 time: 0.364032 Sep 14 09:09:40.222502 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2231/4473] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:09:39 2022] GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105 => generated 1681 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:09:40.425359 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-4a995f35-bc53-42ee-add9-321649dd95c2 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932f3d4bbfd04cae8e48a937a5b10716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b713d80d5243659644e0c74c6df59c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:09:40.434647 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-4a995f35-bc53-42ee-add9-321649dd95c2 tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] 10.222.0.60 "GET /compute/v2.1/servers/6957a5fb-4af4-4ca1-809a-8dd02e517c24" status: 200 len: 1508 microversion: 2.1 time: 0.430627 Sep 14 09:09:40.450973 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2243/4474] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:09:40 2022] GET /compute/v2.1/servers/6957a5fb-4af4-4ca1-809a-8dd02e517c24 => generated 1508 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:09:41.055093 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-744f3398-70bc-4e79-9083-2e48acad6e5d req-a096dac9-9e05-4b05-8390-a5b9e87e5273 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6957a5fb-4af4-4ca1-809a-8dd02e517c24", "name": "network-vif-deleted", "tag": "ace61c6b-a7bc-48b0-ba9c-109092ffc122"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:09:41.080018 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-744f3398-70bc-4e79-9083-2e48acad6e5d req-a096dac9-9e05-4b05-8390-a5b9e87e5273 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:41.085711 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-744f3398-70bc-4e79-9083-2e48acad6e5d req-a096dac9-9e05-4b05-8390-a5b9e87e5273 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:41.086330 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-744f3398-70bc-4e79-9083-2e48acad6e5d req-a096dac9-9e05-4b05-8390-a5b9e87e5273 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:41.090894 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=81,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=2,nova_cell1:RELEASE=2 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:09:41.125135 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-744f3398-70bc-4e79-9083-2e48acad6e5d req-a096dac9-9e05-4b05-8390-a5b9e87e5273 service nova] Creating event network-vif-deleted:ace61c6b-a7bc-48b0-ba9c-109092ffc122 for instance 6957a5fb-4af4-4ca1-809a-8dd02e517c24 on n-h2-836830-18 Sep 14 09:09:41.145402 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-744f3398-70bc-4e79-9083-2e48acad6e5d req-a096dac9-9e05-4b05-8390-a5b9e87e5273 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094061 Sep 14 09:09:41.151116 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2232/4475] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:09:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:09:41.239115 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-3f987cb4-ad35-49ce-a689-dd8e546049fd tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:09:41.240360 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-3f987cb4-ad35-49ce-a689-dd8e546049fd tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:09:41.252023 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3f987cb4-ad35-49ce-a689-dd8e546049fd tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:41.252801 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3f987cb4-ad35-49ce-a689-dd8e546049fd tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:41.255945 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3f987cb4-ad35-49ce-a689-dd8e546049fd tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:41.257180 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3f987cb4-ad35-49ce-a689-dd8e546049fd tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:41.259296 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3f987cb4-ad35-49ce-a689-dd8e546049fd tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:41.259959 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3f987cb4-ad35-49ce-a689-dd8e546049fd tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:41.474690 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-7c44cb65-6fc6-43e5-9ce8-04825a3db29b tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:09:41.475439 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-7c44cb65-6fc6-43e5-9ce8-04825a3db29b tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] [instance: 6957a5fb-4af4-4ca1-809a-8dd02e517c24] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:09:41.493893 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7c44cb65-6fc6-43e5-9ce8-04825a3db29b tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:41.494446 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7c44cb65-6fc6-43e5-9ce8-04825a3db29b tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:41.494886 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7c44cb65-6fc6-43e5-9ce8-04825a3db29b tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:41.495827 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7c44cb65-6fc6-43e5-9ce8-04825a3db29b tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:41.496441 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7c44cb65-6fc6-43e5-9ce8-04825a3db29b tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:41.497695 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7c44cb65-6fc6-43e5-9ce8-04825a3db29b tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:41.534427 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7c44cb65-6fc6-43e5-9ce8-04825a3db29b tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:41.535123 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7c44cb65-6fc6-43e5-9ce8-04825a3db29b tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:41.535773 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7c44cb65-6fc6-43e5-9ce8-04825a3db29b tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:41.536386 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.objects.instance [None req-7c44cb65-6fc6-43e5-9ce8-04825a3db29b tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Lazy-loading 'fault' on Instance uuid 6957a5fb-4af4-4ca1-809a-8dd02e517c24 {{(pid=128759) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:09:41.652199 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-7c44cb65-6fc6-43e5-9ce8-04825a3db29b tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932f3d4bbfd04cae8e48a937a5b10716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b713d80d5243659644e0c74c6df59c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:09:41.662689 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-7c44cb65-6fc6-43e5-9ce8-04825a3db29b tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] 10.222.0.60 "GET /compute/v2.1/servers/6957a5fb-4af4-4ca1-809a-8dd02e517c24" status: 200 len: 1312 microversion: 2.1 time: 0.193842 Sep 14 09:09:41.684091 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2233/4476] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:09:41 2022] GET /compute/v2.1/servers/6957a5fb-4af4-4ca1-809a-8dd02e517c24 => generated 1312 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:09:41.742203 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-3f987cb4-ad35-49ce-a689-dd8e546049fd tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:09:41.753561 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-3f987cb4-ad35-49ce-a689-dd8e546049fd tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105" status: 200 len: 1681 microversion: 2.1 time: 0.521517 Sep 14 09:09:41.756772 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2244/4477] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:09:41 2022] GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105 => generated 1681 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:09:42.698160 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-5bd22ac0-455e-4d34-a8ca-400cee00021c tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:09:42.700126 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-5bd22ac0-455e-4d34-a8ca-400cee00021c tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] [instance: 6957a5fb-4af4-4ca1-809a-8dd02e517c24] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:09:42.712226 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5bd22ac0-455e-4d34-a8ca-400cee00021c tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:42.715288 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5bd22ac0-455e-4d34-a8ca-400cee00021c tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:42.716135 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5bd22ac0-455e-4d34-a8ca-400cee00021c tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:42.721829 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5bd22ac0-455e-4d34-a8ca-400cee00021c tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:42.723602 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5bd22ac0-455e-4d34-a8ca-400cee00021c tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:42.727436 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5bd22ac0-455e-4d34-a8ca-400cee00021c tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:42.756843 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-5bd22ac0-455e-4d34-a8ca-400cee00021c tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] HTTP exception thrown: Instance 6957a5fb-4af4-4ca1-809a-8dd02e517c24 could not be found. Sep 14 09:09:42.759266 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-5bd22ac0-455e-4d34-a8ca-400cee00021c tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Request method failure captured: Sep 14 09:09:42.759266 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/6957a5fb-4af4-4ca1-809a-8dd02e517c24 HTTP/1.1 Sep 14 09:09:42.759266 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:09:42.759266 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:09:42.759266 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:09:42.759266 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:09:42.759266 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:09:42.759266 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:09:42.759266 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:09:42.759266 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:09:42.759266 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZn_XRzME-nQQ0TbSCP-3bTzdJbHTUc6xULZZjK2S_q1emvUP78KEXPlLuG1g_XGBRB7ShU2AyfUzl1KevNVdeth4RkNoLDJf9thPqjGL5LdDvxFi2qMkOFVLB4tAlqCtZtZcmd34VtqMoYnRJQ96kno6bt0RfqA7M094pKFs6IQJIc Sep 14 09:09:42.759266 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:09:42.759266 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:09:42.759266 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:09:42.759266 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:09:42.759266 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:09:42.759266 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:09:42.759266 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 44b713d80d5243659644e0c74c6df59c Sep 14 09:09:42.759266 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-1157799061 Sep 14 09:09:42.759266 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:09:42.759266 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:09:42.759266 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/44b713d80d5243659644e0c74c6df59c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_44b713d80d5243659644e0c74c6df59c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/44b713d80d5243659644e0c74c6df59c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/44b713d80d5243659644e0c74c6df59c"}]}] Sep 14 09:09:42.759266 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-1157799061 Sep 14 09:09:42.759266 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 44b713d80d5243659644e0c74c6df59c Sep 14 09:09:42.759266 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-1157799061 Sep 14 09:09:42.759266 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ServerRescueTestJSONUnderV235-1157799061-project Sep 14 09:09:42.759266 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:09:42.759266 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:09:42.759266 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 932f3d4bbfd04cae8e48a937a5b10716 Sep 14 09:09:42.759266 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-1157799061-project Sep 14 09:09:42.759266 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:09:42.759266 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance 6957a5fb-4af4-4ca1-809a-8dd02e517c24 could not be found. Sep 14 09:09:42.759266 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '6957a5fb-4af4-4ca1-809a-8dd02e517c24'} Sep 14 09:09:42.759266 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:09:42.759266 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:09:42.759266 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:09:42.759266 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:09:42.759266 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:09:42.759266 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:09:42.759266 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:09:42.759266 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:09:42.759266 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:09:42.759266 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:09:42.759266 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6957a5fb-4af4-4ca1-809a-8dd02e517c24 could not be found. Sep 14 09:09:42.759266 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:09:42.759266 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:09:42.759266 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:09:42.759266 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:09:42.759266 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:09:42.759266 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:09:42.759266 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:09:42.759266 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:09:42.759266 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:09:42.759266 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:09:42.759266 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:09:42.759266 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:09:42.759266 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:09:42.759266 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:09:42.759266 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:09:42.759266 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:09:42.759266 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6957a5fb-4af4-4ca1-809a-8dd02e517c24 could not be found. Sep 14 09:09:42.759266 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:09:42.759266 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:09:42.765363 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:09:42.765363 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:09:42.765363 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:09:42.765363 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:09:42.765363 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:09:42.765363 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:09:42.765363 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6957a5fb-4af4-4ca1-809a-8dd02e517c24 could not be found. Sep 14 09:09:42.765363 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:09:42.769795 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-5bd22ac0-455e-4d34-a8ca-400cee00021c tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] Returning 404 to user: Instance 6957a5fb-4af4-4ca1-809a-8dd02e517c24 could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:09:42.773326 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-5bd22ac0-455e-4d34-a8ca-400cee00021c tempest-ServerRescueTestJSONUnderV235-1157799061 tempest-ServerRescueTestJSONUnderV235-1157799061-project] 10.222.0.60 "GET /compute/v2.1/servers/6957a5fb-4af4-4ca1-809a-8dd02e517c24" status: 404 len: 111 microversion: 2.1 time: 0.079772 Sep 14 09:09:42.779004 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2234/4478] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:09:42 2022] GET /compute/v2.1/servers/6957a5fb-4af4-4ca1-809a-8dd02e517c24 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:09:42.783152 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-f4f4cd4f-13ab-44d5-ae79-eb7f850b2ec7 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:09:42.784314 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-f4f4cd4f-13ab-44d5-ae79-eb7f850b2ec7 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:09:42.788115 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=2 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:09:42.804503 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f4f4cd4f-13ab-44d5-ae79-eb7f850b2ec7 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:42.805228 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f4f4cd4f-13ab-44d5-ae79-eb7f850b2ec7 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:42.805840 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f4f4cd4f-13ab-44d5-ae79-eb7f850b2ec7 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:42.806720 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f4f4cd4f-13ab-44d5-ae79-eb7f850b2ec7 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:42.807366 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f4f4cd4f-13ab-44d5-ae79-eb7f850b2ec7 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:42.808027 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f4f4cd4f-13ab-44d5-ae79-eb7f850b2ec7 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:43.172703 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-f4f4cd4f-13ab-44d5-ae79-eb7f850b2ec7 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:09:43.188308 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-f4f4cd4f-13ab-44d5-ae79-eb7f850b2ec7 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105" status: 200 len: 1681 microversion: 2.1 time: 0.408447 Sep 14 09:09:43.190632 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2245/4479] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:09:42 2022] GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105 => generated 1681 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:09:44.213778 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3abd0bfb-cc89-498f-bee4-d35ebf7ce0f6 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:09:44.215088 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-3abd0bfb-cc89-498f-bee4-d35ebf7ce0f6 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:09:44.227575 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=42 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:09:44.281808 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3abd0bfb-cc89-498f-bee4-d35ebf7ce0f6 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:44.282503 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3abd0bfb-cc89-498f-bee4-d35ebf7ce0f6 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:44.286085 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3abd0bfb-cc89-498f-bee4-d35ebf7ce0f6 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:44.291700 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3abd0bfb-cc89-498f-bee4-d35ebf7ce0f6 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:44.295587 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3abd0bfb-cc89-498f-bee4-d35ebf7ce0f6 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:44.302271 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3abd0bfb-cc89-498f-bee4-d35ebf7ce0f6 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:44.667864 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-3abd0bfb-cc89-498f-bee4-d35ebf7ce0f6 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:09:44.692086 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-3abd0bfb-cc89-498f-bee4-d35ebf7ce0f6 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105" status: 200 len: 1681 microversion: 2.1 time: 0.480590 Sep 14 09:09:44.692719 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2235/4480] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:09:44 2022] GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105 => generated 1681 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:09:45.719760 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-515acc04-ba3d-4631-9ce2-e6e593f205e9 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:09:45.721610 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-515acc04-ba3d-4631-9ce2-e6e593f205e9 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:09:45.737313 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-515acc04-ba3d-4631-9ce2-e6e593f205e9 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:45.743549 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-515acc04-ba3d-4631-9ce2-e6e593f205e9 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:45.744220 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-515acc04-ba3d-4631-9ce2-e6e593f205e9 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:45.745216 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-515acc04-ba3d-4631-9ce2-e6e593f205e9 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:45.745845 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-515acc04-ba3d-4631-9ce2-e6e593f205e9 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:45.746501 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-515acc04-ba3d-4631-9ce2-e6e593f205e9 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:46.365051 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-515acc04-ba3d-4631-9ce2-e6e593f205e9 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:09:46.377163 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-515acc04-ba3d-4631-9ce2-e6e593f205e9 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105" status: 200 len: 1681 microversion: 2.1 time: 0.662265 Sep 14 09:09:46.402249 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2246/4481] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:09:45 2022] GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105 => generated 1681 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:09:47.425551 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c5f36224-4956-4ac4-8ac4-a3ec8854402e tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:09:47.426207 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-c5f36224-4956-4ac4-8ac4-a3ec8854402e tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:09:47.449905 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c5f36224-4956-4ac4-8ac4-a3ec8854402e tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:47.453687 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c5f36224-4956-4ac4-8ac4-a3ec8854402e tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:47.454552 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c5f36224-4956-4ac4-8ac4-a3ec8854402e tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:47.455765 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c5f36224-4956-4ac4-8ac4-a3ec8854402e tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:47.461394 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c5f36224-4956-4ac4-8ac4-a3ec8854402e tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:47.462529 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c5f36224-4956-4ac4-8ac4-a3ec8854402e tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:47.956144 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-c5f36224-4956-4ac4-8ac4-a3ec8854402e tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:09:47.975414 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-c5f36224-4956-4ac4-8ac4-a3ec8854402e tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105" status: 200 len: 1681 microversion: 2.1 time: 0.549127 Sep 14 09:09:47.984593 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2236/4482] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:09:47 2022] GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105 => generated 1681 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:09:49.001084 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-9eac244f-0015-4f78-bd2a-655c780debef tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:09:49.001784 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-9eac244f-0015-4f78-bd2a-655c780debef tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:09:49.013532 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9eac244f-0015-4f78-bd2a-655c780debef tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:49.014339 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9eac244f-0015-4f78-bd2a-655c780debef tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:49.016042 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9eac244f-0015-4f78-bd2a-655c780debef tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:49.017619 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9eac244f-0015-4f78-bd2a-655c780debef tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:49.020671 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9eac244f-0015-4f78-bd2a-655c780debef tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:49.021401 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9eac244f-0015-4f78-bd2a-655c780debef tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:49.711477 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-9eac244f-0015-4f78-bd2a-655c780debef tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:09:49.724581 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-9eac244f-0015-4f78-bd2a-655c780debef tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105" status: 200 len: 1681 microversion: 2.1 time: 0.727515 Sep 14 09:09:49.788796 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2247/4483] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:09:48 2022] GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105 => generated 1681 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:09:50.782782 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-2e30d08e-2b5f-4ecc-83c8-905b96003be7 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:09:50.785619 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-2e30d08e-2b5f-4ecc-83c8-905b96003be7 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:09:50.797505 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2e30d08e-2b5f-4ecc-83c8-905b96003be7 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:50.803411 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2e30d08e-2b5f-4ecc-83c8-905b96003be7 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:50.804107 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2e30d08e-2b5f-4ecc-83c8-905b96003be7 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:50.805062 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2e30d08e-2b5f-4ecc-83c8-905b96003be7 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:50.811772 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2e30d08e-2b5f-4ecc-83c8-905b96003be7 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:50.812971 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2e30d08e-2b5f-4ecc-83c8-905b96003be7 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:51.303925 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-2e30d08e-2b5f-4ecc-83c8-905b96003be7 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:09:51.318841 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-2e30d08e-2b5f-4ecc-83c8-905b96003be7 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105" status: 200 len: 1681 microversion: 2.1 time: 0.537651 Sep 14 09:09:51.323402 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2237/4484] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:09:50 2022] GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105 => generated 1681 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:09:52.344848 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-513f2b25-e236-46e5-abce-168731f867b4 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:09:52.346608 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-513f2b25-e236-46e5-abce-168731f867b4 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:09:52.358101 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=2 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:09:52.360255 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=2 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:09:52.367662 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-513f2b25-e236-46e5-abce-168731f867b4 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:52.368820 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-513f2b25-e236-46e5-abce-168731f867b4 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:52.369444 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-513f2b25-e236-46e5-abce-168731f867b4 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:52.370675 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-513f2b25-e236-46e5-abce-168731f867b4 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:52.373761 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-513f2b25-e236-46e5-abce-168731f867b4 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:52.374073 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-513f2b25-e236-46e5-abce-168731f867b4 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:53.069501 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-513f2b25-e236-46e5-abce-168731f867b4 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:09:53.084149 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-513f2b25-e236-46e5-abce-168731f867b4 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105" status: 200 len: 1668 microversion: 2.1 time: 0.742987 Sep 14 09:09:53.084742 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2248/4485] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:09:52 2022] GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105 => generated 1668 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:09:53.403915 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-20cde6c8-765d-4398-865f-49aa203cd826 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:09:53.404534 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-20cde6c8-765d-4398-865f-49aa203cd826 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:09:53.416139 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-20cde6c8-765d-4398-865f-49aa203cd826 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:53.428653 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-20cde6c8-765d-4398-865f-49aa203cd826 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:53.429634 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-20cde6c8-765d-4398-865f-49aa203cd826 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:53.430794 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-20cde6c8-765d-4398-865f-49aa203cd826 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:53.431514 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-20cde6c8-765d-4398-865f-49aa203cd826 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:53.432160 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-20cde6c8-765d-4398-865f-49aa203cd826 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:54.687705 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-20cde6c8-765d-4398-865f-49aa203cd826 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:09:54.719111 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-20cde6c8-765d-4398-865f-49aa203cd826 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105" status: 200 len: 1668 microversion: 2.1 time: 1.321168 Sep 14 09:09:54.719915 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2238/4486] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:09:53 2022] GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105 => generated 1668 bytes in 1324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:09:54.927607 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-cbc82b8d-7f12-461d-a344-cff988ff2dae req-7a940f09-30e5-48a4-a864-102edb40cb81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8450d385-d5d9-4c86-9ece-b3bbf9ed1105", "name": "network-vif-unplugged", "status": "completed", "tag": "eb873b1a-8b40-4eb4-a329-cf733d9ed342"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:09:54.962098 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-cbc82b8d-7f12-461d-a344-cff988ff2dae req-7a940f09-30e5-48a4-a864-102edb40cb81 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:54.962590 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-cbc82b8d-7f12-461d-a344-cff988ff2dae req-7a940f09-30e5-48a4-a864-102edb40cb81 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:54.965105 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-cbc82b8d-7f12-461d-a344-cff988ff2dae req-7a940f09-30e5-48a4-a864-102edb40cb81 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:55.008163 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-cbc82b8d-7f12-461d-a344-cff988ff2dae req-7a940f09-30e5-48a4-a864-102edb40cb81 service nova] Creating event network-vif-unplugged:eb873b1a-8b40-4eb4-a329-cf733d9ed342 for instance 8450d385-d5d9-4c86-9ece-b3bbf9ed1105 on n-h1-836830-18 Sep 14 09:09:55.019481 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-cbc82b8d-7f12-461d-a344-cff988ff2dae req-7a940f09-30e5-48a4-a864-102edb40cb81 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.094024 Sep 14 09:09:55.021986 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2249/4487] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:09:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:09:57.688422 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d98583a4-b865-4277-a108-b9f90dd70159 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Action: 'create', calling method: .version_select at 0x7f7d3ee58700>, body: {"keypair": {"name": "tempest-keypair-17846728", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPpkiUSF7kWFKL6RxVu1nmKwePANdbcpzh7FGt2aEet9iv7WQCnI7BSwDnflwPKlp4YxMXL26HIIS1+V6IHjPOrBnlaVRP2I/ug9fUtn/s1nfl0EaLbyaoRqDvLcsGGXCw=="}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:09:57.753097 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-d98583a4-b865-4277-a108-b9f90dd70159 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Getting quotas for project 9672a6c416ee44289eaa4d7c664d307e. Resources: {'key_pairs'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:09:57.773668 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-d98583a4-b865-4277-a108-b9f90dd70159 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Getting quotas for user 7daab4f69af5452c8641006d9f09edce and project 9672a6c416ee44289eaa4d7c664d307e. Resources: {'key_pairs'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:09:57.871696 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d98583a4-b865-4277-a108-b9f90dd70159 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.593370 Sep 14 09:09:57.873409 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2239/4488] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Sep 14 09:09:57 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:09:59.282309 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-126a80f2-ddb1-40a8-a0d5-cc904d606080 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:09:59.283160 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-126a80f2-ddb1-40a8-a0d5-cc904d606080 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:09:59.315465 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-126a80f2-ddb1-40a8-a0d5-cc904d606080 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:59.315992 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-126a80f2-ddb1-40a8-a0d5-cc904d606080 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:59.316428 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-126a80f2-ddb1-40a8-a0d5-cc904d606080 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:59.317407 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-126a80f2-ddb1-40a8-a0d5-cc904d606080 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:09:59.317872 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-126a80f2-ddb1-40a8-a0d5-cc904d606080 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:09:59.318300 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-126a80f2-ddb1-40a8-a0d5-cc904d606080 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:09:59.949376 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-126a80f2-ddb1-40a8-a0d5-cc904d606080 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:09:59.966910 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-126a80f2-ddb1-40a8-a0d5-cc904d606080 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105" status: 200 len: 1668 microversion: 2.1 time: 0.690650 Sep 14 09:09:59.977822 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2250/4489] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:09:59 2022] GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105 => generated 1668 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:10:00.003380 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-cf3da0fa-7cef-4b25-9f9d-b279f5fa2752 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:10:00.004272 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-cf3da0fa-7cef-4b25-9f9d-b279f5fa2752 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:10:00.019361 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cf3da0fa-7cef-4b25-9f9d-b279f5fa2752 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:00.019871 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cf3da0fa-7cef-4b25-9f9d-b279f5fa2752 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:00.020319 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cf3da0fa-7cef-4b25-9f9d-b279f5fa2752 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:00.025394 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cf3da0fa-7cef-4b25-9f9d-b279f5fa2752 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:00.026353 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cf3da0fa-7cef-4b25-9f9d-b279f5fa2752 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:00.027067 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cf3da0fa-7cef-4b25-9f9d-b279f5fa2752 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:00.325978 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-cf3da0fa-7cef-4b25-9f9d-b279f5fa2752 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:10:00.337795 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-cf3da0fa-7cef-4b25-9f9d-b279f5fa2752 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105" status: 200 len: 1668 microversion: 2.1 time: 0.340746 Sep 14 09:10:00.338395 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2240/4490] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:09:59 2022] GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105 => generated 1668 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:10:00.363177 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-5c289de4-5f0a-4554-a21c-3e617cadac09 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:10:00.364482 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-5c289de4-5f0a-4554-a21c-3e617cadac09 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:10:00.386791 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5c289de4-5f0a-4554-a21c-3e617cadac09 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:00.391129 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5c289de4-5f0a-4554-a21c-3e617cadac09 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:00.391940 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5c289de4-5f0a-4554-a21c-3e617cadac09 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:00.393425 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5c289de4-5f0a-4554-a21c-3e617cadac09 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:00.395156 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5c289de4-5f0a-4554-a21c-3e617cadac09 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:00.396952 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5c289de4-5f0a-4554-a21c-3e617cadac09 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:00.710926 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-5c289de4-5f0a-4554-a21c-3e617cadac09 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:10:00.752035 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-5c289de4-5f0a-4554-a21c-3e617cadac09 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105" status: 200 len: 1668 microversion: 2.1 time: 0.385740 Sep 14 09:10:00.753339 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2251/4491] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:10:00 2022] GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105 => generated 1668 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:10:00.781132 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e863313d-7da2-4d9f-906e-f2d05c46e7af tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:10:00.784622 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e863313d-7da2-4d9f-906e-f2d05c46e7af tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:10:00.808876 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e863313d-7da2-4d9f-906e-f2d05c46e7af tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:00.809391 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e863313d-7da2-4d9f-906e-f2d05c46e7af tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:00.809840 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e863313d-7da2-4d9f-906e-f2d05c46e7af tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:00.810565 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e863313d-7da2-4d9f-906e-f2d05c46e7af tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:00.811063 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e863313d-7da2-4d9f-906e-f2d05c46e7af tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:00.814394 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e863313d-7da2-4d9f-906e-f2d05c46e7af tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:01.080958 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e863313d-7da2-4d9f-906e-f2d05c46e7af tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "POST /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105/action" status: 202 len: 0 microversion: 2.1 time: 0.304655 Sep 14 09:10:01.081640 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2241/4492] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:10:00 2022] POST /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105/action => generated 0 bytes in 307 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:10:01.090115 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a4dcba5f-9b33-4abe-bf18-f12af16b9417 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:10:01.090744 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-a4dcba5f-9b33-4abe-bf18-f12af16b9417 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:10:01.102106 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a4dcba5f-9b33-4abe-bf18-f12af16b9417 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:01.102884 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a4dcba5f-9b33-4abe-bf18-f12af16b9417 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:01.104298 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a4dcba5f-9b33-4abe-bf18-f12af16b9417 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:01.108783 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a4dcba5f-9b33-4abe-bf18-f12af16b9417 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:01.109449 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a4dcba5f-9b33-4abe-bf18-f12af16b9417 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:01.110907 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a4dcba5f-9b33-4abe-bf18-f12af16b9417 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:01.695626 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-a4dcba5f-9b33-4abe-bf18-f12af16b9417 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:10:01.710050 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-a4dcba5f-9b33-4abe-bf18-f12af16b9417 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105" status: 200 len: 1670 microversion: 2.1 time: 0.623146 Sep 14 09:10:01.717342 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2252/4493] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:10:01 2022] GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105 => generated 1670 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:10:02.743738 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-534b6586-df3e-4a84-91e9-7b4085bdc68b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:10:02.745072 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-534b6586-df3e-4a84-91e9-7b4085bdc68b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:10:02.753855 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-534b6586-df3e-4a84-91e9-7b4085bdc68b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:02.754621 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-534b6586-df3e-4a84-91e9-7b4085bdc68b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:02.755254 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-534b6586-df3e-4a84-91e9-7b4085bdc68b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:02.756140 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-534b6586-df3e-4a84-91e9-7b4085bdc68b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:02.756766 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-534b6586-df3e-4a84-91e9-7b4085bdc68b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:02.757390 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-534b6586-df3e-4a84-91e9-7b4085bdc68b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:03.133352 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-534b6586-df3e-4a84-91e9-7b4085bdc68b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:10:03.153596 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-534b6586-df3e-4a84-91e9-7b4085bdc68b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105" status: 200 len: 1670 microversion: 2.1 time: 0.412359 Sep 14 09:10:03.158711 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2242/4494] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:10:02 2022] GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105 => generated 1670 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:10:04.202377 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-e2dd5573-bc65-4631-aa50-8c4b7290b0c7 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:10:04.205337 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-e2dd5573-bc65-4631-aa50-8c4b7290b0c7 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:10:04.215981 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e2dd5573-bc65-4631-aa50-8c4b7290b0c7 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:04.217171 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e2dd5573-bc65-4631-aa50-8c4b7290b0c7 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:04.217933 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e2dd5573-bc65-4631-aa50-8c4b7290b0c7 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:04.218858 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e2dd5573-bc65-4631-aa50-8c4b7290b0c7 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:04.219522 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e2dd5573-bc65-4631-aa50-8c4b7290b0c7 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:04.220116 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e2dd5573-bc65-4631-aa50-8c4b7290b0c7 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:04.640836 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-e2dd5573-bc65-4631-aa50-8c4b7290b0c7 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:10:04.649696 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-e2dd5573-bc65-4631-aa50-8c4b7290b0c7 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105" status: 200 len: 1670 microversion: 2.1 time: 0.470494 Sep 14 09:10:04.650357 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2253/4495] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:10:04 2022] GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105 => generated 1670 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:10:05.358760 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-01955a56-8782-4f9d-aa8f-310f28f748b6 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1405593929", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8747ac4b-fb94-4411-ac98-d9ed15dcd41c"}], "security_groups": [{"name": "tempest-securitygroup--1099068997"}], "key_name": "tempest-keypair-17846728", "user_data": "}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:10:05.663827 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.network.neutron [None req-01955a56-8782-4f9d-aa8f-310f28f748b6 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] validate_networks() for [('8747ac4b-fb94-4411-ac98-d9ed15dcd41c', None, None, None, None, None)] {{(pid=128759) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:10:05.680881 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-3687a5c3-dc61-4def-8a72-229b5dad648f tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:10:05.683136 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-3687a5c3-dc61-4def-8a72-229b5dad648f tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:10:05.714594 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3687a5c3-dc61-4def-8a72-229b5dad648f tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:05.715159 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3687a5c3-dc61-4def-8a72-229b5dad648f tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:05.721597 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3687a5c3-dc61-4def-8a72-229b5dad648f tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:05.722595 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3687a5c3-dc61-4def-8a72-229b5dad648f tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:05.725216 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3687a5c3-dc61-4def-8a72-229b5dad648f tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:05.725914 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3687a5c3-dc61-4def-8a72-229b5dad648f tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:06.617837 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-3687a5c3-dc61-4def-8a72-229b5dad648f tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:10:06.621236 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:10:06.634352 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-3687a5c3-dc61-4def-8a72-229b5dad648f tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105" status: 200 len: 1675 microversion: 2.1 time: 0.959539 Sep 14 09:10:06.638351 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2254/4496] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:10:05 2022] GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105 => generated 1675 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:10:07.121904 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-8726a832-afae-4dec-aa5b-22132cc5dee1 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Action: 'create', calling method: .version_select at 0x7f7d3f37fc10>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-247008795", "description": "tempest-description-375948370"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:10:07.426235 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-01955a56-8782-4f9d-aa8f-310f28f748b6 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Flavor limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:10:07.426779 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-01955a56-8782-4f9d-aa8f-310f28f748b6 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Image limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:10:07.428183 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-01955a56-8782-4f9d-aa8f-310f28f748b6 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Flavor pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:10:07.428623 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-01955a56-8782-4f9d-aa8f-310f28f748b6 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Image pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:10:07.429050 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-01955a56-8782-4f9d-aa8f-310f28f748b6 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:10:07.463123 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-01955a56-8782-4f9d-aa8f-310f28f748b6 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:07.463626 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-01955a56-8782-4f9d-aa8f-310f28f748b6 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:07.464074 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-01955a56-8782-4f9d-aa8f-310f28f748b6 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:07.464818 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-01955a56-8782-4f9d-aa8f-310f28f748b6 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:07.465283 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-01955a56-8782-4f9d-aa8f-310f28f748b6 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:07.465718 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-01955a56-8782-4f9d-aa8f-310f28f748b6 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:07.568770 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-01955a56-8782-4f9d-aa8f-310f28f748b6 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Getting quotas for project 9672a6c416ee44289eaa4d7c664d307e. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:10:07.602247 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-01955a56-8782-4f9d-aa8f-310f28f748b6 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Getting quotas for user 7daab4f69af5452c8641006d9f09edce and project 9672a6c416ee44289eaa4d7c664d307e. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:10:07.649691 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-01955a56-8782-4f9d-aa8f-310f28f748b6 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Going to run 1 instances... {{(pid=128759) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:10:07.652117 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-01955a56-8782-4f9d-aa8f-310f28f748b6 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [instance: 81ad242a-93d0-4f76-a6f1-e02e5e537e95] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128759) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:10:07.819704 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-01955a56-8782-4f9d-aa8f-310f28f748b6 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.459733 Sep 14 09:10:07.823252 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2243/4497] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 09:10:05 2022] POST /compute/v2.1/servers => generated 402 bytes in 2470 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:10:07.848391 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-73ef58c3-c139-46ae-874c-8539e6f30ca0 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:10:07.849035 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-73ef58c3-c139-46ae-874c-8539e6f30ca0 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:10:07.867901 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-73ef58c3-c139-46ae-874c-8539e6f30ca0 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:07.868825 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-73ef58c3-c139-46ae-874c-8539e6f30ca0 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:07.871022 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-73ef58c3-c139-46ae-874c-8539e6f30ca0 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:07.875007 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-73ef58c3-c139-46ae-874c-8539e6f30ca0 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:07.875710 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-73ef58c3-c139-46ae-874c-8539e6f30ca0 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:07.876337 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-73ef58c3-c139-46ae-874c-8539e6f30ca0 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:08.286033 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-8726a832-afae-4dec-aa5b-22132cc5dee1 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] 10.222.0.60 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 1.646544 Sep 14 09:10:08.286632 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2255/4498] 10.222.0.60 () {60 vars in 1180 bytes} [Wed Sep 14 09:10:06 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 1648 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:10:08.291865 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-3eb85e43-de36-453d-b095-1e77a0f19a78 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:10:08.292782 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-3eb85e43-de36-453d-b095-1e77a0f19a78 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [instance: 81ad242a-93d0-4f76-a6f1-e02e5e537e95] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:10:08.453124 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-3eb85e43-de36-453d-b095-1e77a0f19a78 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daab4f69af5452c8641006d9f09edce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9672a6c416ee44289eaa4d7c664d307e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:10:08.470051 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-3eb85e43-de36-453d-b095-1e77a0f19a78 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "GET /compute/v2.1/servers/81ad242a-93d0-4f76-a6f1-e02e5e537e95" status: 200 len: 1240 microversion: 2.1 time: 0.182090 Sep 14 09:10:08.473342 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2256/4499] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:10:08 2022] GET /compute/v2.1/servers/81ad242a-93d0-4f76-a6f1-e02e5e537e95 => generated 1240 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:10:08.501346 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-0e093db2-0059-4e56-8082-b99b5b858532 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Action: 'create', calling method: .version_select at 0x7f7d3f35f550>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1018015496", "description": "tempest-description-1614586021"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:10:08.502995 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-73ef58c3-c139-46ae-874c-8539e6f30ca0 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:10:08.512966 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-73ef58c3-c139-46ae-874c-8539e6f30ca0 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105" status: 200 len: 1668 microversion: 2.1 time: 0.684350 Sep 14 09:10:08.514249 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2244/4500] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:10:07 2022] GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105 => generated 1668 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:10:08.542281 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9985f786-9e0c-4e8e-b6b3-6270e5a0bc42 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:10:08.551437 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-9985f786-9e0c-4e8e-b6b3-6270e5a0bc42 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:10:08.566315 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9985f786-9e0c-4e8e-b6b3-6270e5a0bc42 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:08.570194 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9985f786-9e0c-4e8e-b6b3-6270e5a0bc42 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:08.571059 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9985f786-9e0c-4e8e-b6b3-6270e5a0bc42 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:08.572063 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9985f786-9e0c-4e8e-b6b3-6270e5a0bc42 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:08.574099 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9985f786-9e0c-4e8e-b6b3-6270e5a0bc42 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:08.575989 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9985f786-9e0c-4e8e-b6b3-6270e5a0bc42 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:08.690013 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-9985f786-9e0c-4e8e-b6b3-6270e5a0bc42 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "POST /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105/action" status: 200 len: 324 microversion: 2.1 time: 0.150217 Sep 14 09:10:08.691947 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2245/4501] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:10:08 2022] POST /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105/action => generated 324 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:10:08.710351 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-5f04bf96-19cf-4642-922c-0773616397fc tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:10:08.714171 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-5f04bf96-19cf-4642-922c-0773616397fc tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:10:08.734093 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5f04bf96-19cf-4642-922c-0773616397fc tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:08.735483 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5f04bf96-19cf-4642-922c-0773616397fc tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:08.736589 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5f04bf96-19cf-4642-922c-0773616397fc tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:08.740121 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5f04bf96-19cf-4642-922c-0773616397fc tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:08.742453 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5f04bf96-19cf-4642-922c-0773616397fc tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:08.742965 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5f04bf96-19cf-4642-922c-0773616397fc tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:08.857591 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-0e093db2-0059-4e56-8082-b99b5b858532 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] 10.222.0.60 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.383058 Sep 14 09:10:08.858199 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2257/4502] 10.222.0.60 () {60 vars in 1180 bytes} [Wed Sep 14 09:10:08 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:10:09.058109 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-5f04bf96-19cf-4642-922c-0773616397fc tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:10:09.067394 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-5f04bf96-19cf-4642-922c-0773616397fc tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105" status: 200 len: 1668 microversion: 2.1 time: 0.368533 Sep 14 09:10:09.071453 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2246/4503] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:10:08 2022] GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105 => generated 1668 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:10:09.099341 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-99a528e1-4549-4bbb-8c47-ac8f862ad35b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:10:09.099959 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-99a528e1-4549-4bbb-8c47-ac8f862ad35b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:10:09.106332 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-99a528e1-4549-4bbb-8c47-ac8f862ad35b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:09.107192 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-99a528e1-4549-4bbb-8c47-ac8f862ad35b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:09.107821 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-99a528e1-4549-4bbb-8c47-ac8f862ad35b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:09.117895 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-99a528e1-4549-4bbb-8c47-ac8f862ad35b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:09.118394 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-99a528e1-4549-4bbb-8c47-ac8f862ad35b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:09.120357 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-99a528e1-4549-4bbb-8c47-ac8f862ad35b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:09.369834 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-0890275f-ce47-4cf7-8f30-a8e793bba006 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1587581367", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "networks": [{"uuid": "2af9a6d1-9a21-4625-a5d3-57e4d554ab16"}]}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:10:09.381235 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-99a528e1-4549-4bbb-8c47-ac8f862ad35b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:10:09.404444 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-99a528e1-4549-4bbb-8c47-ac8f862ad35b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105" status: 200 len: 1668 microversion: 2.1 time: 0.309387 Sep 14 09:10:09.416619 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2258/4504] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:10:09 2022] GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105 => generated 1668 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:10:09.439155 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-fcfa6ace-ac26-46bd-b265-002a904e4de2 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:10:09.439722 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-fcfa6ace-ac26-46bd-b265-002a904e4de2 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:10:09.454483 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fcfa6ace-ac26-46bd-b265-002a904e4de2 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:09.455824 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fcfa6ace-ac26-46bd-b265-002a904e4de2 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:09.456428 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fcfa6ace-ac26-46bd-b265-002a904e4de2 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:09.465412 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fcfa6ace-ac26-46bd-b265-002a904e4de2 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:09.467395 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fcfa6ace-ac26-46bd-b265-002a904e4de2 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:09.468019 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fcfa6ace-ac26-46bd-b265-002a904e4de2 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:09.539844 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.network.neutron [None req-0890275f-ce47-4cf7-8f30-a8e793bba006 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] validate_networks() for [('2af9a6d1-9a21-4625-a5d3-57e4d554ab16', None, None, None, None, None)] {{(pid=128759) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:10:10.185279 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-fcfa6ace-ac26-46bd-b265-002a904e4de2 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:10:10.199991 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-fcfa6ace-ac26-46bd-b265-002a904e4de2 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105" status: 200 len: 1668 microversion: 2.1 time: 0.773812 Sep 14 09:10:10.214044 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2259/4505] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:10:09 2022] GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105 => generated 1668 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:10:10.226725 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-17918a6c-493c-430a-a665-e77615898e59 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:10:10.228197 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-17918a6c-493c-430a-a665-e77615898e59 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [instance: 81ad242a-93d0-4f76-a6f1-e02e5e537e95] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:10:10.236874 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-17918a6c-493c-430a-a665-e77615898e59 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:10.240304 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-17918a6c-493c-430a-a665-e77615898e59 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:10.241163 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-17918a6c-493c-430a-a665-e77615898e59 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:10.242102 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-17918a6c-493c-430a-a665-e77615898e59 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:10.242906 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-17918a6c-493c-430a-a665-e77615898e59 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:10.243542 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-17918a6c-493c-430a-a665-e77615898e59 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:10.399158 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-17918a6c-493c-430a-a665-e77615898e59 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daab4f69af5452c8641006d9f09edce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9672a6c416ee44289eaa4d7c664d307e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:10:10.408133 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-17918a6c-493c-430a-a665-e77615898e59 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "GET /compute/v2.1/servers/81ad242a-93d0-4f76-a6f1-e02e5e537e95" status: 200 len: 1298 microversion: 2.1 time: 0.191344 Sep 14 09:10:10.426758 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2260/4506] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:10:10 2022] GET /compute/v2.1/servers/81ad242a-93d0-4f76-a6f1-e02e5e537e95 => generated 1298 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:10:10.440455 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1b50d1c3-5304-42c0-8bb3-e88d49af9cf3 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:10:10.441143 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-1b50d1c3-5304-42c0-8bb3-e88d49af9cf3 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:10:10.461286 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1b50d1c3-5304-42c0-8bb3-e88d49af9cf3 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:10.464426 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1b50d1c3-5304-42c0-8bb3-e88d49af9cf3 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:10.465121 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1b50d1c3-5304-42c0-8bb3-e88d49af9cf3 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:10.466091 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1b50d1c3-5304-42c0-8bb3-e88d49af9cf3 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:10.467480 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1b50d1c3-5304-42c0-8bb3-e88d49af9cf3 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:10.471573 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1b50d1c3-5304-42c0-8bb3-e88d49af9cf3 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:10.763775 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-1b50d1c3-5304-42c0-8bb3-e88d49af9cf3 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:10:10.789703 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-1b50d1c3-5304-42c0-8bb3-e88d49af9cf3 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105" status: 200 len: 1668 microversion: 2.1 time: 0.358034 Sep 14 09:10:10.807757 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2261/4507] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:10:10 2022] GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105 => generated 1668 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:10:10.919866 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-0890275f-ce47-4cf7-8f30-a8e793bba006 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Flavor limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:10:10.922832 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-0890275f-ce47-4cf7-8f30-a8e793bba006 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Image limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:10:10.923961 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-0890275f-ce47-4cf7-8f30-a8e793bba006 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Flavor pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:10:10.924869 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-0890275f-ce47-4cf7-8f30-a8e793bba006 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Image pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:10:10.926009 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-0890275f-ce47-4cf7-8f30-a8e793bba006 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:10:10.945548 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0890275f-ce47-4cf7-8f30-a8e793bba006 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:10.946458 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0890275f-ce47-4cf7-8f30-a8e793bba006 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:10.947175 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0890275f-ce47-4cf7-8f30-a8e793bba006 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:10.948278 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0890275f-ce47-4cf7-8f30-a8e793bba006 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:10.949154 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0890275f-ce47-4cf7-8f30-a8e793bba006 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:10.949813 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0890275f-ce47-4cf7-8f30-a8e793bba006 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:10.984161 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-0890275f-ce47-4cf7-8f30-a8e793bba006 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Getting quotas for project de0783155bf04154bf28fc70bcb7580d. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:10:10.992243 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-0890275f-ce47-4cf7-8f30-a8e793bba006 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Getting quotas for user 2dabfdd5a6e049c48d00bc1b55a0a30f and project de0783155bf04154bf28fc70bcb7580d. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:10:11.010349 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-0890275f-ce47-4cf7-8f30-a8e793bba006 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Going to run 1 instances... {{(pid=128759) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:10:11.013207 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-0890275f-ce47-4cf7-8f30-a8e793bba006 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] [instance: d02d241a-fae5-47c7-9858-cac8171f580a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128759) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:10:11.084695 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-0890275f-ce47-4cf7-8f30-a8e793bba006 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.721603 Sep 14 09:10:11.092080 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2247/4508] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 09:10:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1730 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 14 09:10:11.098650 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a0f287cd-74e2-44b2-bb41-0d407096f656 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:10:11.101149 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-a0f287cd-74e2-44b2-bb41-0d407096f656 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] [instance: d02d241a-fae5-47c7-9858-cac8171f580a] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:10:11.151231 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f49bf514-df84-40e4-a8c8-8ac956d76a3b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-60838560", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "networks": [{"uuid": "63df5062-0947-41ef-8d8c-a8d82a21791b"}]}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:10:11.233495 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-a0f287cd-74e2-44b2-bb41-0d407096f656 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dabfdd5a6e049c48d00bc1b55a0a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0783155bf04154bf28fc70bcb7580d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:10:11.242479 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-a0f287cd-74e2-44b2-bb41-0d407096f656 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] 10.222.0.60 "GET /compute/v2.1/servers/d02d241a-fae5-47c7-9858-cac8171f580a" status: 200 len: 1216 microversion: 2.1 time: 0.149410 Sep 14 09:10:11.245178 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2262/4509] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:10:11 2022] GET /compute/v2.1/servers/d02d241a-fae5-47c7-9858-cac8171f580a => generated 1216 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:10:11.299280 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.network.neutron [None req-f49bf514-df84-40e4-a8c8-8ac956d76a3b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] validate_networks() for [('63df5062-0947-41ef-8d8c-a8d82a21791b', None, None, None, None, None)] {{(pid=128759) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:10:11.433708 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c5974718-e3f1-45c4-84fd-3fb366f5528b tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:10:11.434338 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-c5974718-e3f1-45c4-84fd-3fb366f5528b tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [instance: 81ad242a-93d0-4f76-a6f1-e02e5e537e95] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:10:11.450717 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c5974718-e3f1-45c4-84fd-3fb366f5528b tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:11.452496 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c5974718-e3f1-45c4-84fd-3fb366f5528b tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:11.452820 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c5974718-e3f1-45c4-84fd-3fb366f5528b tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:11.459673 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c5974718-e3f1-45c4-84fd-3fb366f5528b tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:11.460185 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c5974718-e3f1-45c4-84fd-3fb366f5528b tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:11.460631 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c5974718-e3f1-45c4-84fd-3fb366f5528b tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:12.192960 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-c5974718-e3f1-45c4-84fd-3fb366f5528b tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daab4f69af5452c8641006d9f09edce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9672a6c416ee44289eaa4d7c664d307e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:10:12.205491 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-c5974718-e3f1-45c4-84fd-3fb366f5528b tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "GET /compute/v2.1/servers/81ad242a-93d0-4f76-a6f1-e02e5e537e95" status: 200 len: 1366 microversion: 2.1 time: 0.773522 Sep 14 09:10:12.218899 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2263/4510] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:10:11 2022] GET /compute/v2.1/servers/81ad242a-93d0-4f76-a6f1-e02e5e537e95 => generated 1366 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:10:12.270244 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1dce6891-a8c2-433e-aaa1-67baaa6bcf10 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:10:12.271017 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-1dce6891-a8c2-433e-aaa1-67baaa6bcf10 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] [instance: d02d241a-fae5-47c7-9858-cac8171f580a] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:10:12.278608 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1dce6891-a8c2-433e-aaa1-67baaa6bcf10 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:12.285296 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1dce6891-a8c2-433e-aaa1-67baaa6bcf10 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:12.288314 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1dce6891-a8c2-433e-aaa1-67baaa6bcf10 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:12.289196 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1dce6891-a8c2-433e-aaa1-67baaa6bcf10 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:12.292893 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1dce6891-a8c2-433e-aaa1-67baaa6bcf10 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:12.294253 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1dce6891-a8c2-433e-aaa1-67baaa6bcf10 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:12.618559 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-1dce6891-a8c2-433e-aaa1-67baaa6bcf10 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dabfdd5a6e049c48d00bc1b55a0a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0783155bf04154bf28fc70bcb7580d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:10:12.627328 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-1dce6891-a8c2-433e-aaa1-67baaa6bcf10 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] 10.222.0.60 "GET /compute/v2.1/servers/d02d241a-fae5-47c7-9858-cac8171f580a" status: 200 len: 1220 microversion: 2.1 time: 0.362565 Sep 14 09:10:12.627939 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2264/4511] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:10:12 2022] GET /compute/v2.1/servers/d02d241a-fae5-47c7-9858-cac8171f580a => generated 1220 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:10:13.012179 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-f49bf514-df84-40e4-a8c8-8ac956d76a3b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Flavor limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:10:13.013789 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-f49bf514-df84-40e4-a8c8-8ac956d76a3b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Image limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:10:13.014449 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-f49bf514-df84-40e4-a8c8-8ac956d76a3b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Flavor pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:10:13.015321 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-f49bf514-df84-40e4-a8c8-8ac956d76a3b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Image pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:10:13.015935 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-f49bf514-df84-40e4-a8c8-8ac956d76a3b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:10:13.039948 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f49bf514-df84-40e4-a8c8-8ac956d76a3b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:13.044983 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f49bf514-df84-40e4-a8c8-8ac956d76a3b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:13.046624 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f49bf514-df84-40e4-a8c8-8ac956d76a3b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:13.049154 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f49bf514-df84-40e4-a8c8-8ac956d76a3b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:13.050889 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f49bf514-df84-40e4-a8c8-8ac956d76a3b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:13.051859 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f49bf514-df84-40e4-a8c8-8ac956d76a3b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:13.096065 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:10:13.121263 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-f49bf514-df84-40e4-a8c8-8ac956d76a3b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Getting quotas for project 2f075a2c6aa4489abb3428e0a4ac5738. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:10:13.188017 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-f49bf514-df84-40e4-a8c8-8ac956d76a3b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Getting quotas for user 950da33830ae4ae1a5511dd146e4e3be and project 2f075a2c6aa4489abb3428e0a4ac5738. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:10:13.233558 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-5c1c2258-ff1c-481c-9375-9f71f6fc9267 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:10:13.235368 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-5c1c2258-ff1c-481c-9375-9f71f6fc9267 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [instance: 81ad242a-93d0-4f76-a6f1-e02e5e537e95] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:10:13.240215 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=40 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:10:13.251046 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5c1c2258-ff1c-481c-9375-9f71f6fc9267 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:13.253915 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f49bf514-df84-40e4-a8c8-8ac956d76a3b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Going to run 1 instances... {{(pid=128759) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:10:13.254697 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5c1c2258-ff1c-481c-9375-9f71f6fc9267 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:13.255184 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5c1c2258-ff1c-481c-9375-9f71f6fc9267 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:13.257103 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f49bf514-df84-40e4-a8c8-8ac956d76a3b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 0be5d897-13d0-43ef-9122-96c21dafd94c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128759) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:10:13.263168 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5c1c2258-ff1c-481c-9375-9f71f6fc9267 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:13.263887 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5c1c2258-ff1c-481c-9375-9f71f6fc9267 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:13.268005 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5c1c2258-ff1c-481c-9375-9f71f6fc9267 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:13.382280 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f49bf514-df84-40e4-a8c8-8ac956d76a3b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.249307 Sep 14 09:10:13.389707 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2248/4512] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 09:10:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 2255 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:10:13.401441 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a6e63131-a39d-4a56-acb9-a37da01863dd tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:10:13.404262 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-a6e63131-a39d-4a56-acb9-a37da01863dd tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 0be5d897-13d0-43ef-9122-96c21dafd94c] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:10:13.532106 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-a6e63131-a39d-4a56-acb9-a37da01863dd tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:10:13.542415 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a6e63131-a39d-4a56-acb9-a37da01863dd tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/0be5d897-13d0-43ef-9122-96c21dafd94c" status: 200 len: 1213 microversion: 2.1 time: 0.151249 Sep 14 09:10:13.544329 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2249/4513] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:10:13 2022] GET /compute/v2.1/servers/0be5d897-13d0-43ef-9122-96c21dafd94c => generated 1213 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:10:13.632212 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-5c1c2258-ff1c-481c-9375-9f71f6fc9267 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daab4f69af5452c8641006d9f09edce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9672a6c416ee44289eaa4d7c664d307e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:10:13.640913 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-5c1c2258-ff1c-481c-9375-9f71f6fc9267 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "GET /compute/v2.1/servers/81ad242a-93d0-4f76-a6f1-e02e5e537e95" status: 200 len: 1366 microversion: 2.1 time: 0.412119 Sep 14 09:10:13.646420 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2265/4514] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:10:13 2022] GET /compute/v2.1/servers/81ad242a-93d0-4f76-a6f1-e02e5e537e95 => generated 1366 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:10:13.668293 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8f3bf795-e719-4cfc-b415-33986e1cf458 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:10:13.668949 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-8f3bf795-e719-4cfc-b415-33986e1cf458 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] [instance: d02d241a-fae5-47c7-9858-cac8171f580a] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:10:13.687997 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8f3bf795-e719-4cfc-b415-33986e1cf458 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:13.691715 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8f3bf795-e719-4cfc-b415-33986e1cf458 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:13.692620 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8f3bf795-e719-4cfc-b415-33986e1cf458 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:13.693712 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8f3bf795-e719-4cfc-b415-33986e1cf458 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:13.694329 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8f3bf795-e719-4cfc-b415-33986e1cf458 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:13.695851 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8f3bf795-e719-4cfc-b415-33986e1cf458 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:13.909037 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-8f3bf795-e719-4cfc-b415-33986e1cf458 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dabfdd5a6e049c48d00bc1b55a0a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0783155bf04154bf28fc70bcb7580d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:10:13.919418 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-8f3bf795-e719-4cfc-b415-33986e1cf458 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] 10.222.0.60 "GET /compute/v2.1/servers/d02d241a-fae5-47c7-9858-cac8171f580a" status: 200 len: 1286 microversion: 2.1 time: 0.262077 Sep 14 09:10:13.920536 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2250/4515] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:10:13 2022] GET /compute/v2.1/servers/d02d241a-fae5-47c7-9858-cac8171f580a => generated 1286 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:10:14.581106 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-faecb626-46e2-4adb-86a1-e04493e81da7 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:10:14.583572 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-faecb626-46e2-4adb-86a1-e04493e81da7 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 0be5d897-13d0-43ef-9122-96c21dafd94c] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:10:14.615290 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-faecb626-46e2-4adb-86a1-e04493e81da7 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:14.619728 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-faecb626-46e2-4adb-86a1-e04493e81da7 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:14.620178 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-faecb626-46e2-4adb-86a1-e04493e81da7 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:14.620981 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-faecb626-46e2-4adb-86a1-e04493e81da7 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:14.621450 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-faecb626-46e2-4adb-86a1-e04493e81da7 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:14.630016 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-faecb626-46e2-4adb-86a1-e04493e81da7 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:14.668797 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-263e38a8-1577-4b0a-9441-7ccd056211ec tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:10:14.669413 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-263e38a8-1577-4b0a-9441-7ccd056211ec tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [instance: 81ad242a-93d0-4f76-a6f1-e02e5e537e95] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:10:14.671525 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=10 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:10:14.680425 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-263e38a8-1577-4b0a-9441-7ccd056211ec tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:14.680929 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-263e38a8-1577-4b0a-9441-7ccd056211ec tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:14.681375 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-263e38a8-1577-4b0a-9441-7ccd056211ec tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:14.682122 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-263e38a8-1577-4b0a-9441-7ccd056211ec tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:14.682555 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-263e38a8-1577-4b0a-9441-7ccd056211ec tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:14.683007 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-263e38a8-1577-4b0a-9441-7ccd056211ec tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:14.849739 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-faecb626-46e2-4adb-86a1-e04493e81da7 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:10:14.864000 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-faecb626-46e2-4adb-86a1-e04493e81da7 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/0be5d897-13d0-43ef-9122-96c21dafd94c" status: 200 len: 1217 microversion: 2.1 time: 0.295298 Sep 14 09:10:14.866544 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2266/4516] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:10:14 2022] GET /compute/v2.1/servers/0be5d897-13d0-43ef-9122-96c21dafd94c => generated 1217 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:10:14.948497 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-095931e8-6b53-42ae-97cf-db54a9507746 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:10:14.949464 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-095931e8-6b53-42ae-97cf-db54a9507746 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] [instance: d02d241a-fae5-47c7-9858-cac8171f580a] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:10:14.969599 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-095931e8-6b53-42ae-97cf-db54a9507746 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:14.974470 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-095931e8-6b53-42ae-97cf-db54a9507746 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:14.976678 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-095931e8-6b53-42ae-97cf-db54a9507746 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:14.979418 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-095931e8-6b53-42ae-97cf-db54a9507746 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:14.980535 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-095931e8-6b53-42ae-97cf-db54a9507746 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:14.982513 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-095931e8-6b53-42ae-97cf-db54a9507746 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:15.173007 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-263e38a8-1577-4b0a-9441-7ccd056211ec tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daab4f69af5452c8641006d9f09edce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9672a6c416ee44289eaa4d7c664d307e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:10:15.194224 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-263e38a8-1577-4b0a-9441-7ccd056211ec tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "GET /compute/v2.1/servers/81ad242a-93d0-4f76-a6f1-e02e5e537e95" status: 200 len: 1366 microversion: 2.1 time: 0.530136 Sep 14 09:10:15.211756 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2251/4517] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:10:14 2022] GET /compute/v2.1/servers/81ad242a-93d0-4f76-a6f1-e02e5e537e95 => generated 1366 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:10:15.216721 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-095931e8-6b53-42ae-97cf-db54a9507746 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dabfdd5a6e049c48d00bc1b55a0a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0783155bf04154bf28fc70bcb7580d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:10:15.222584 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-0a5ac079-49af-4480-9614-5766a2c69699 req-7d7e7bf6-131c-4a83-bbdb-77c76b22467f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81ad242a-93d0-4f76-a6f1-e02e5e537e95", "tag": "50f39472-c166-4d11-b75f-be5e33cb27d4"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:10:15.230252 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-095931e8-6b53-42ae-97cf-db54a9507746 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] 10.222.0.60 "GET /compute/v2.1/servers/d02d241a-fae5-47c7-9858-cac8171f580a" status: 200 len: 1274 microversion: 2.1 time: 0.284050 Sep 14 09:10:15.232021 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2267/4518] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:10:14 2022] GET /compute/v2.1/servers/d02d241a-fae5-47c7-9858-cac8171f580a => generated 1274 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:10:15.256415 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-0a5ac079-49af-4480-9614-5766a2c69699 req-7d7e7bf6-131c-4a83-bbdb-77c76b22467f service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:15.257076 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-0a5ac079-49af-4480-9614-5766a2c69699 req-7d7e7bf6-131c-4a83-bbdb-77c76b22467f service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:15.258277 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-0a5ac079-49af-4480-9614-5766a2c69699 req-7d7e7bf6-131c-4a83-bbdb-77c76b22467f service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:15.275891 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-0a5ac079-49af-4480-9614-5766a2c69699 req-7d7e7bf6-131c-4a83-bbdb-77c76b22467f service nova] Creating event network-changed:50f39472-c166-4d11-b75f-be5e33cb27d4 for instance 81ad242a-93d0-4f76-a6f1-e02e5e537e95 on n-h2-836830-18 Sep 14 09:10:15.283100 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-0a5ac079-49af-4480-9614-5766a2c69699 req-7d7e7bf6-131c-4a83-bbdb-77c76b22467f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070545 Sep 14 09:10:15.284856 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2252/4519] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:10:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:10:15.891595 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-91d07d94-310e-45b3-8947-f3aab6295dd7 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:10:15.892962 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-91d07d94-310e-45b3-8947-f3aab6295dd7 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 0be5d897-13d0-43ef-9122-96c21dafd94c] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:10:15.907088 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-91d07d94-310e-45b3-8947-f3aab6295dd7 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:15.908642 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-91d07d94-310e-45b3-8947-f3aab6295dd7 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:15.909239 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-91d07d94-310e-45b3-8947-f3aab6295dd7 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:15.910134 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-91d07d94-310e-45b3-8947-f3aab6295dd7 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:15.913492 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-91d07d94-310e-45b3-8947-f3aab6295dd7 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:15.914120 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-91d07d94-310e-45b3-8947-f3aab6295dd7 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:16.138880 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-91d07d94-310e-45b3-8947-f3aab6295dd7 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:10:16.153750 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-91d07d94-310e-45b3-8947-f3aab6295dd7 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/0be5d897-13d0-43ef-9122-96c21dafd94c" status: 200 len: 1271 microversion: 2.1 time: 0.263102 Sep 14 09:10:16.169101 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2268/4520] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:10:15 2022] GET /compute/v2.1/servers/0be5d897-13d0-43ef-9122-96c21dafd94c => generated 1271 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:10:16.231271 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e51a8c0c-e6c4-4de7-924c-57089f17dbd1 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:10:16.232001 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e51a8c0c-e6c4-4de7-924c-57089f17dbd1 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [instance: 81ad242a-93d0-4f76-a6f1-e02e5e537e95] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:10:16.250817 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e51a8c0c-e6c4-4de7-924c-57089f17dbd1 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:16.254970 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e51a8c0c-e6c4-4de7-924c-57089f17dbd1 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:16.257142 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e51a8c0c-e6c4-4de7-924c-57089f17dbd1 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:16.257728 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-5207570d-248b-4742-b88b-42de24fb02b7 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:10:16.258614 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-5207570d-248b-4742-b88b-42de24fb02b7 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] [instance: d02d241a-fae5-47c7-9858-cac8171f580a] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:10:16.261375 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e51a8c0c-e6c4-4de7-924c-57089f17dbd1 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:16.262075 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e51a8c0c-e6c4-4de7-924c-57089f17dbd1 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:16.263376 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e51a8c0c-e6c4-4de7-924c-57089f17dbd1 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:16.290746 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5207570d-248b-4742-b88b-42de24fb02b7 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:16.292576 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5207570d-248b-4742-b88b-42de24fb02b7 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:16.295173 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5207570d-248b-4742-b88b-42de24fb02b7 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:16.296060 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5207570d-248b-4742-b88b-42de24fb02b7 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:16.297353 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5207570d-248b-4742-b88b-42de24fb02b7 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:16.299403 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5207570d-248b-4742-b88b-42de24fb02b7 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:16.800289 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-5207570d-248b-4742-b88b-42de24fb02b7 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dabfdd5a6e049c48d00bc1b55a0a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0783155bf04154bf28fc70bcb7580d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:10:16.814834 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-5207570d-248b-4742-b88b-42de24fb02b7 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] 10.222.0.60 "GET /compute/v2.1/servers/d02d241a-fae5-47c7-9858-cac8171f580a" status: 200 len: 1316 microversion: 2.1 time: 0.563677 Sep 14 09:10:16.834744 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2269/4521] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:10:16 2022] GET /compute/v2.1/servers/d02d241a-fae5-47c7-9858-cac8171f580a => generated 1316 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:10:16.916709 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-e51a8c0c-e6c4-4de7-924c-57089f17dbd1 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daab4f69af5452c8641006d9f09edce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9672a6c416ee44289eaa4d7c664d307e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:10:16.924820 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e51a8c0c-e6c4-4de7-924c-57089f17dbd1 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "GET /compute/v2.1/servers/81ad242a-93d0-4f76-a6f1-e02e5e537e95" status: 200 len: 1366 microversion: 2.1 time: 0.708738 Sep 14 09:10:16.925403 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2253/4522] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:10:16 2022] GET /compute/v2.1/servers/81ad242a-93d0-4f76-a6f1-e02e5e537e95 => generated 1366 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:10:17.183923 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-834b1268-ca63-4071-8060-36502565badd tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:10:17.185382 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-834b1268-ca63-4071-8060-36502565badd tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 0be5d897-13d0-43ef-9122-96c21dafd94c] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:10:17.200500 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-834b1268-ca63-4071-8060-36502565badd tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:17.202487 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-834b1268-ca63-4071-8060-36502565badd tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:17.203979 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-834b1268-ca63-4071-8060-36502565badd tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:17.206800 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-834b1268-ca63-4071-8060-36502565badd tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:17.207894 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-834b1268-ca63-4071-8060-36502565badd tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:17.212014 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-834b1268-ca63-4071-8060-36502565badd tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:17.460223 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-834b1268-ca63-4071-8060-36502565badd tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:10:17.487690 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-834b1268-ca63-4071-8060-36502565badd tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/0be5d897-13d0-43ef-9122-96c21dafd94c" status: 200 len: 1271 microversion: 2.1 time: 0.306299 Sep 14 09:10:17.505296 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2270/4523] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:10:17 2022] GET /compute/v2.1/servers/0be5d897-13d0-43ef-9122-96c21dafd94c => generated 1271 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:10:17.843252 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-2b165fb7-03ff-4bbc-8dfa-61db90c84033 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:10:17.844177 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-2b165fb7-03ff-4bbc-8dfa-61db90c84033 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] [instance: d02d241a-fae5-47c7-9858-cac8171f580a] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:10:17.862686 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2b165fb7-03ff-4bbc-8dfa-61db90c84033 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:17.863262 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2b165fb7-03ff-4bbc-8dfa-61db90c84033 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:17.863700 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2b165fb7-03ff-4bbc-8dfa-61db90c84033 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:17.867363 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2b165fb7-03ff-4bbc-8dfa-61db90c84033 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:17.868349 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2b165fb7-03ff-4bbc-8dfa-61db90c84033 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:17.868954 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2b165fb7-03ff-4bbc-8dfa-61db90c84033 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:17.948868 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-f8a07bec-bb11-4a9b-9d49-428dd00dac8c tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:10:17.950023 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-f8a07bec-bb11-4a9b-9d49-428dd00dac8c tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [instance: 81ad242a-93d0-4f76-a6f1-e02e5e537e95] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:10:17.964524 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f8a07bec-bb11-4a9b-9d49-428dd00dac8c tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:17.979980 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f8a07bec-bb11-4a9b-9d49-428dd00dac8c tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:17.980876 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f8a07bec-bb11-4a9b-9d49-428dd00dac8c tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:17.982030 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f8a07bec-bb11-4a9b-9d49-428dd00dac8c tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:17.983545 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f8a07bec-bb11-4a9b-9d49-428dd00dac8c tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:17.984469 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f8a07bec-bb11-4a9b-9d49-428dd00dac8c tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:18.580723 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-f8a07bec-bb11-4a9b-9d49-428dd00dac8c tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daab4f69af5452c8641006d9f09edce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9672a6c416ee44289eaa4d7c664d307e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:10:18.594278 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-f8a07bec-bb11-4a9b-9d49-428dd00dac8c tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "GET /compute/v2.1/servers/81ad242a-93d0-4f76-a6f1-e02e5e537e95" status: 200 len: 1366 microversion: 2.1 time: 0.649534 Sep 14 09:10:18.615495 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2271/4524] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:10:17 2022] GET /compute/v2.1/servers/81ad242a-93d0-4f76-a6f1-e02e5e537e95 => generated 1366 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:10:18.621412 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-bc23ca45-f392-4072-8f97-399139b099ef req-babe3331-f4ee-43c1-8f6a-7a13e8e4a35a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d02d241a-fae5-47c7-9858-cac8171f580a", "tag": "5f024dc9-ac58-4e56-8032-628e56a69cfa"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:10:18.639633 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-bc23ca45-f392-4072-8f97-399139b099ef req-babe3331-f4ee-43c1-8f6a-7a13e8e4a35a service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:18.640455 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-bc23ca45-f392-4072-8f97-399139b099ef req-babe3331-f4ee-43c1-8f6a-7a13e8e4a35a service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:18.641114 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-bc23ca45-f392-4072-8f97-399139b099ef req-babe3331-f4ee-43c1-8f6a-7a13e8e4a35a service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:18.660434 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-bc23ca45-f392-4072-8f97-399139b099ef req-babe3331-f4ee-43c1-8f6a-7a13e8e4a35a service nova] Creating event network-changed:5f024dc9-ac58-4e56-8032-628e56a69cfa for instance d02d241a-fae5-47c7-9858-cac8171f580a on n-h1-836830-18 Sep 14 09:10:18.671263 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-2b165fb7-03ff-4bbc-8dfa-61db90c84033 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dabfdd5a6e049c48d00bc1b55a0a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0783155bf04154bf28fc70bcb7580d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:10:18.673363 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-bc23ca45-f392-4072-8f97-399139b099ef req-babe3331-f4ee-43c1-8f6a-7a13e8e4a35a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056266 Sep 14 09:10:18.678386 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2272/4525] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:10:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:10:18.682254 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-2b165fb7-03ff-4bbc-8dfa-61db90c84033 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] 10.222.0.60 "GET /compute/v2.1/servers/d02d241a-fae5-47c7-9858-cac8171f580a" status: 200 len: 1316 microversion: 2.1 time: 0.844221 Sep 14 09:10:18.686421 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2254/4526] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:10:17 2022] GET /compute/v2.1/servers/d02d241a-fae5-47c7-9858-cac8171f580a => generated 1316 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:10:18.696128 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-8c2fd0d4-d4bb-42d5-a170-8f640f9cd611 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:10:18.697742 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-8c2fd0d4-d4bb-42d5-a170-8f640f9cd611 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 0be5d897-13d0-43ef-9122-96c21dafd94c] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:10:18.722045 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8c2fd0d4-d4bb-42d5-a170-8f640f9cd611 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:18.724135 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8c2fd0d4-d4bb-42d5-a170-8f640f9cd611 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:18.724575 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8c2fd0d4-d4bb-42d5-a170-8f640f9cd611 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:18.725349 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8c2fd0d4-d4bb-42d5-a170-8f640f9cd611 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:18.725831 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8c2fd0d4-d4bb-42d5-a170-8f640f9cd611 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:18.726258 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8c2fd0d4-d4bb-42d5-a170-8f640f9cd611 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:19.137184 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-8c2fd0d4-d4bb-42d5-a170-8f640f9cd611 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:10:19.145884 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-8c2fd0d4-d4bb-42d5-a170-8f640f9cd611 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/0be5d897-13d0-43ef-9122-96c21dafd94c" status: 200 len: 1313 microversion: 2.1 time: 0.465635 Sep 14 09:10:19.149075 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2273/4527] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:10:18 2022] GET /compute/v2.1/servers/0be5d897-13d0-43ef-9122-96c21dafd94c => generated 1313 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:10:19.626854 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9f79879d-a411-43b6-9f22-feb015eeec77 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:10:19.627525 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-9f79879d-a411-43b6-9f22-feb015eeec77 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [instance: 81ad242a-93d0-4f76-a6f1-e02e5e537e95] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:10:19.643392 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9f79879d-a411-43b6-9f22-feb015eeec77 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:19.645101 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9f79879d-a411-43b6-9f22-feb015eeec77 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:19.647440 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9f79879d-a411-43b6-9f22-feb015eeec77 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:19.648664 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9f79879d-a411-43b6-9f22-feb015eeec77 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:19.650193 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9f79879d-a411-43b6-9f22-feb015eeec77 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:19.651601 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9f79879d-a411-43b6-9f22-feb015eeec77 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:19.713334 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-4e4fcb67-18b8-4b95-8ffd-9887da33f375 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:10:19.714121 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-4e4fcb67-18b8-4b95-8ffd-9887da33f375 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] [instance: d02d241a-fae5-47c7-9858-cac8171f580a] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:10:19.739244 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4e4fcb67-18b8-4b95-8ffd-9887da33f375 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:19.745016 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4e4fcb67-18b8-4b95-8ffd-9887da33f375 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:19.748063 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4e4fcb67-18b8-4b95-8ffd-9887da33f375 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:19.763325 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4e4fcb67-18b8-4b95-8ffd-9887da33f375 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:19.765181 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4e4fcb67-18b8-4b95-8ffd-9887da33f375 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:19.766192 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4e4fcb67-18b8-4b95-8ffd-9887da33f375 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:20.260071 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-9f79879d-a411-43b6-9f22-feb015eeec77 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daab4f69af5452c8641006d9f09edce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9672a6c416ee44289eaa4d7c664d307e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:10:20.273384 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-9f79879d-a411-43b6-9f22-feb015eeec77 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "GET /compute/v2.1/servers/81ad242a-93d0-4f76-a6f1-e02e5e537e95" status: 200 len: 1366 microversion: 2.1 time: 0.654724 Sep 14 09:10:20.285123 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-4e4fcb67-18b8-4b95-8ffd-9887da33f375 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dabfdd5a6e049c48d00bc1b55a0a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0783155bf04154bf28fc70bcb7580d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:10:20.294007 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2255/4528] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:10:19 2022] GET /compute/v2.1/servers/81ad242a-93d0-4f76-a6f1-e02e5e537e95 => generated 1366 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:10:20.303941 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-4e4fcb67-18b8-4b95-8ffd-9887da33f375 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] 10.222.0.60 "GET /compute/v2.1/servers/d02d241a-fae5-47c7-9858-cac8171f580a" status: 200 len: 1316 microversion: 2.1 time: 0.591255 Sep 14 09:10:20.311814 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9a46c79f-5712-4cb0-bc21-b464019d75de tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:10:20.314148 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-9a46c79f-5712-4cb0-bc21-b464019d75de tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 0be5d897-13d0-43ef-9122-96c21dafd94c] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:10:20.321559 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2274/4529] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:10:19 2022] GET /compute/v2.1/servers/d02d241a-fae5-47c7-9858-cac8171f580a => generated 1316 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:10:20.334770 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9a46c79f-5712-4cb0-bc21-b464019d75de tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:20.335640 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9a46c79f-5712-4cb0-bc21-b464019d75de tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:20.336924 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9a46c79f-5712-4cb0-bc21-b464019d75de tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:20.338788 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9a46c79f-5712-4cb0-bc21-b464019d75de tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:20.343378 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9a46c79f-5712-4cb0-bc21-b464019d75de tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:20.344037 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9a46c79f-5712-4cb0-bc21-b464019d75de tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:20.942567 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-c9b45697-8f21-4613-9e55-34a966f94062 req-12d5c742-9d65-493c-bb8a-0a50332bc516 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0be5d897-13d0-43ef-9122-96c21dafd94c", "tag": "ec4b48d5-c2cf-4b8e-94ff-b7bc6da1ad27"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:10:20.977279 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-c9b45697-8f21-4613-9e55-34a966f94062 req-12d5c742-9d65-493c-bb8a-0a50332bc516 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:20.980926 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-c9b45697-8f21-4613-9e55-34a966f94062 req-12d5c742-9d65-493c-bb8a-0a50332bc516 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:20.981958 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-c9b45697-8f21-4613-9e55-34a966f94062 req-12d5c742-9d65-493c-bb8a-0a50332bc516 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:21.013381 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-c9b45697-8f21-4613-9e55-34a966f94062 req-12d5c742-9d65-493c-bb8a-0a50332bc516 service nova] Creating event network-changed:ec4b48d5-c2cf-4b8e-94ff-b7bc6da1ad27 for instance 0be5d897-13d0-43ef-9122-96c21dafd94c on n-h2-836830-18 Sep 14 09:10:21.026408 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-c9b45697-8f21-4613-9e55-34a966f94062 req-12d5c742-9d65-493c-bb8a-0a50332bc516 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088840 Sep 14 09:10:21.027894 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2275/4530] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:10:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:10:21.088177 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-9a46c79f-5712-4cb0-bc21-b464019d75de tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:10:21.101582 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-9a46c79f-5712-4cb0-bc21-b464019d75de tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/0be5d897-13d0-43ef-9122-96c21dafd94c" status: 200 len: 1313 microversion: 2.1 time: 0.797715 Sep 14 09:10:21.102575 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2256/4531] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:10:20 2022] GET /compute/v2.1/servers/0be5d897-13d0-43ef-9122-96c21dafd94c => generated 1313 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:10:21.321556 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-c85d87ef-3941-489a-a5a6-6c442d0e2acd req-b342b0d4-8750-491a-9a31-7984297f3dfb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81ad242a-93d0-4f76-a6f1-e02e5e537e95", "name": "network-vif-plugged", "status": "completed", "tag": "50f39472-c166-4d11-b75f-be5e33cb27d4"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:10:21.327706 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d0ed8962-842f-41a0-8fa9-0551c0c5ac94 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:10:21.330435 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-d0ed8962-842f-41a0-8fa9-0551c0c5ac94 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [instance: 81ad242a-93d0-4f76-a6f1-e02e5e537e95] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:10:21.342163 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=4 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:10:21.358686 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d0ed8962-842f-41a0-8fa9-0551c0c5ac94 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:21.360025 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d0ed8962-842f-41a0-8fa9-0551c0c5ac94 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:21.361298 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d0ed8962-842f-41a0-8fa9-0551c0c5ac94 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:21.362817 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d0ed8962-842f-41a0-8fa9-0551c0c5ac94 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:21.363618 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d0ed8962-842f-41a0-8fa9-0551c0c5ac94 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:21.364269 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d0ed8962-842f-41a0-8fa9-0551c0c5ac94 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:21.400321 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-c85d87ef-3941-489a-a5a6-6c442d0e2acd req-b342b0d4-8750-491a-9a31-7984297f3dfb service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:21.403174 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-c85d87ef-3941-489a-a5a6-6c442d0e2acd req-b342b0d4-8750-491a-9a31-7984297f3dfb service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:21.408695 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-c85d87ef-3941-489a-a5a6-6c442d0e2acd req-b342b0d4-8750-491a-9a31-7984297f3dfb service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:21.441888 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-c85d87ef-3941-489a-a5a6-6c442d0e2acd req-b342b0d4-8750-491a-9a31-7984297f3dfb service nova] Creating event network-vif-plugged:50f39472-c166-4d11-b75f-be5e33cb27d4 for instance 81ad242a-93d0-4f76-a6f1-e02e5e537e95 on n-h2-836830-18 Sep 14 09:10:21.474341 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-c85d87ef-3941-489a-a5a6-6c442d0e2acd req-b342b0d4-8750-491a-9a31-7984297f3dfb service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.168569 Sep 14 09:10:21.476695 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2257/4532] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:10:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:10:21.494610 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-77c2a7cd-8e35-4706-b743-501342019da8 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:10:21.495573 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-77c2a7cd-8e35-4706-b743-501342019da8 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] [instance: d02d241a-fae5-47c7-9858-cac8171f580a] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:10:21.505159 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-77c2a7cd-8e35-4706-b743-501342019da8 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:21.506726 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-77c2a7cd-8e35-4706-b743-501342019da8 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:21.507603 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-77c2a7cd-8e35-4706-b743-501342019da8 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:21.508692 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-77c2a7cd-8e35-4706-b743-501342019da8 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:21.509260 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-77c2a7cd-8e35-4706-b743-501342019da8 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:21.510137 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-77c2a7cd-8e35-4706-b743-501342019da8 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:21.853589 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-77c2a7cd-8e35-4706-b743-501342019da8 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dabfdd5a6e049c48d00bc1b55a0a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0783155bf04154bf28fc70bcb7580d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:10:21.865420 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-77c2a7cd-8e35-4706-b743-501342019da8 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] 10.222.0.60 "GET /compute/v2.1/servers/d02d241a-fae5-47c7-9858-cac8171f580a" status: 200 len: 1316 microversion: 2.1 time: 0.386745 Sep 14 09:10:21.866977 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2258/4533] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:10:21 2022] GET /compute/v2.1/servers/d02d241a-fae5-47c7-9858-cac8171f580a => generated 1316 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:10:21.949294 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-d0ed8962-842f-41a0-8fa9-0551c0c5ac94 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daab4f69af5452c8641006d9f09edce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9672a6c416ee44289eaa4d7c664d307e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:10:21.951716 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=100 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:10:21.970874 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-d0ed8962-842f-41a0-8fa9-0551c0c5ac94 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "GET /compute/v2.1/servers/81ad242a-93d0-4f76-a6f1-e02e5e537e95" status: 200 len: 1366 microversion: 2.1 time: 0.664193 Sep 14 09:10:21.972648 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2276/4534] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:10:21 2022] GET /compute/v2.1/servers/81ad242a-93d0-4f76-a6f1-e02e5e537e95 => generated 1366 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:10:22.125204 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3148d9d0-8ca4-42c8-99d8-97ab37603614 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:10:22.125869 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-3148d9d0-8ca4-42c8-99d8-97ab37603614 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 0be5d897-13d0-43ef-9122-96c21dafd94c] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:10:22.140645 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3148d9d0-8ca4-42c8-99d8-97ab37603614 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:22.144152 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3148d9d0-8ca4-42c8-99d8-97ab37603614 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:22.145502 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3148d9d0-8ca4-42c8-99d8-97ab37603614 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:22.146262 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3148d9d0-8ca4-42c8-99d8-97ab37603614 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:22.146730 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3148d9d0-8ca4-42c8-99d8-97ab37603614 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:22.152051 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3148d9d0-8ca4-42c8-99d8-97ab37603614 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:22.526622 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-3148d9d0-8ca4-42c8-99d8-97ab37603614 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:10:22.542060 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-3148d9d0-8ca4-42c8-99d8-97ab37603614 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/0be5d897-13d0-43ef-9122-96c21dafd94c" status: 200 len: 1313 microversion: 2.1 time: 0.418539 Sep 14 09:10:22.545134 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2259/4535] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:10:22 2022] GET /compute/v2.1/servers/0be5d897-13d0-43ef-9122-96c21dafd94c => generated 1313 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:10:22.896134 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-9d0c3d0a-466d-4ad7-8ee2-ef40105057f5 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:10:22.896766 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-9d0c3d0a-466d-4ad7-8ee2-ef40105057f5 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] [instance: d02d241a-fae5-47c7-9858-cac8171f580a] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:10:22.912059 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9d0c3d0a-466d-4ad7-8ee2-ef40105057f5 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:22.912808 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9d0c3d0a-466d-4ad7-8ee2-ef40105057f5 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:22.913407 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9d0c3d0a-466d-4ad7-8ee2-ef40105057f5 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:22.914283 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9d0c3d0a-466d-4ad7-8ee2-ef40105057f5 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:22.914900 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9d0c3d0a-466d-4ad7-8ee2-ef40105057f5 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:22.915632 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9d0c3d0a-466d-4ad7-8ee2-ef40105057f5 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:22.995473 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-5270af38-905b-4bf6-bf37-bdc30a2cffdd tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:10:22.995985 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-5270af38-905b-4bf6-bf37-bdc30a2cffdd tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [instance: 81ad242a-93d0-4f76-a6f1-e02e5e537e95] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:10:23.045619 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5270af38-905b-4bf6-bf37-bdc30a2cffdd tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:23.046317 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5270af38-905b-4bf6-bf37-bdc30a2cffdd tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:23.047437 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5270af38-905b-4bf6-bf37-bdc30a2cffdd tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:23.051068 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5270af38-905b-4bf6-bf37-bdc30a2cffdd tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:23.053053 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5270af38-905b-4bf6-bf37-bdc30a2cffdd tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:23.060702 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5270af38-905b-4bf6-bf37-bdc30a2cffdd tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:23.119478 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=6 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:10:23.538183 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=24 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:10:23.568691 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-9d0c3d0a-466d-4ad7-8ee2-ef40105057f5 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dabfdd5a6e049c48d00bc1b55a0a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0783155bf04154bf28fc70bcb7580d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:10:23.583693 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-9d0c3d0a-466d-4ad7-8ee2-ef40105057f5 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] 10.222.0.60 "GET /compute/v2.1/servers/d02d241a-fae5-47c7-9858-cac8171f580a" status: 200 len: 1316 microversion: 2.1 time: 0.693956 Sep 14 09:10:23.600107 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2277/4536] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:10:22 2022] GET /compute/v2.1/servers/d02d241a-fae5-47c7-9858-cac8171f580a => generated 1316 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:10:23.617858 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-74fba1f3-26a9-42a3-b274-1a6103422070 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:10:23.620823 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-74fba1f3-26a9-42a3-b274-1a6103422070 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 0be5d897-13d0-43ef-9122-96c21dafd94c] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:10:23.633200 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-5270af38-905b-4bf6-bf37-bdc30a2cffdd tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daab4f69af5452c8641006d9f09edce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9672a6c416ee44289eaa4d7c664d307e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:10:23.640160 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-74fba1f3-26a9-42a3-b274-1a6103422070 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:23.642685 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-74fba1f3-26a9-42a3-b274-1a6103422070 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:23.643342 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-74fba1f3-26a9-42a3-b274-1a6103422070 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:23.645078 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-74fba1f3-26a9-42a3-b274-1a6103422070 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:23.646609 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-74fba1f3-26a9-42a3-b274-1a6103422070 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:23.648571 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-74fba1f3-26a9-42a3-b274-1a6103422070 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:23.650250 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-5270af38-905b-4bf6-bf37-bdc30a2cffdd tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "GET /compute/v2.1/servers/81ad242a-93d0-4f76-a6f1-e02e5e537e95" status: 200 len: 1366 microversion: 2.1 time: 0.657900 Sep 14 09:10:23.660601 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2260/4537] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:10:22 2022] GET /compute/v2.1/servers/81ad242a-93d0-4f76-a6f1-e02e5e537e95 => generated 1366 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:10:24.013498 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-74fba1f3-26a9-42a3-b274-1a6103422070 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:10:24.021924 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-74fba1f3-26a9-42a3-b274-1a6103422070 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/0be5d897-13d0-43ef-9122-96c21dafd94c" status: 200 len: 1313 microversion: 2.1 time: 0.419686 Sep 14 09:10:24.022515 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2278/4538] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:10:23 2022] GET /compute/v2.1/servers/0be5d897-13d0-43ef-9122-96c21dafd94c => generated 1313 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:10:24.620993 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a794c795-59f3-4130-9562-4fc0638bcf01 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:10:24.621636 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-a794c795-59f3-4130-9562-4fc0638bcf01 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] [instance: d02d241a-fae5-47c7-9858-cac8171f580a] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:10:24.649892 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a794c795-59f3-4130-9562-4fc0638bcf01 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:24.654697 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a794c795-59f3-4130-9562-4fc0638bcf01 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:24.657474 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a794c795-59f3-4130-9562-4fc0638bcf01 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:24.658297 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a794c795-59f3-4130-9562-4fc0638bcf01 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:24.658789 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a794c795-59f3-4130-9562-4fc0638bcf01 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:24.660263 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a794c795-59f3-4130-9562-4fc0638bcf01 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:24.677378 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-e8100113-6dc5-4b30-89b1-8daa57f164d2 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:10:24.678009 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-e8100113-6dc5-4b30-89b1-8daa57f164d2 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [instance: 81ad242a-93d0-4f76-a6f1-e02e5e537e95] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:10:24.701859 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e8100113-6dc5-4b30-89b1-8daa57f164d2 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:24.702392 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e8100113-6dc5-4b30-89b1-8daa57f164d2 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:24.708144 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e8100113-6dc5-4b30-89b1-8daa57f164d2 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:24.711995 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e8100113-6dc5-4b30-89b1-8daa57f164d2 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:24.713694 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e8100113-6dc5-4b30-89b1-8daa57f164d2 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:24.714156 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e8100113-6dc5-4b30-89b1-8daa57f164d2 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:25.441321 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-e8100113-6dc5-4b30-89b1-8daa57f164d2 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daab4f69af5452c8641006d9f09edce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9672a6c416ee44289eaa4d7c664d307e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:10:25.466084 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-e8100113-6dc5-4b30-89b1-8daa57f164d2 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "GET /compute/v2.1/servers/81ad242a-93d0-4f76-a6f1-e02e5e537e95" status: 200 len: 1557 microversion: 2.1 time: 0.794096 Sep 14 09:10:25.484143 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2279/4539] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:10:24 2022] GET /compute/v2.1/servers/81ad242a-93d0-4f76-a6f1-e02e5e537e95 => generated 1557 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:10:25.484143 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-e6bd7280-a553-4c04-958d-1478e84be9b6 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:10:25.484143 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-e6bd7280-a553-4c04-958d-1478e84be9b6 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 0be5d897-13d0-43ef-9122-96c21dafd94c] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:10:25.504410 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e6bd7280-a553-4c04-958d-1478e84be9b6 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:25.504979 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e6bd7280-a553-4c04-958d-1478e84be9b6 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:25.505344 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e6bd7280-a553-4c04-958d-1478e84be9b6 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:25.512966 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e6bd7280-a553-4c04-958d-1478e84be9b6 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:25.514551 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e6bd7280-a553-4c04-958d-1478e84be9b6 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:25.516659 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e6bd7280-a553-4c04-958d-1478e84be9b6 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:25.528958 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-a794c795-59f3-4130-9562-4fc0638bcf01 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dabfdd5a6e049c48d00bc1b55a0a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0783155bf04154bf28fc70bcb7580d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:10:25.551756 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a794c795-59f3-4130-9562-4fc0638bcf01 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] 10.222.0.60 "GET /compute/v2.1/servers/d02d241a-fae5-47c7-9858-cac8171f580a" status: 200 len: 1316 microversion: 2.1 time: 0.929620 Sep 14 09:10:25.575069 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2261/4540] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:10:24 2022] GET /compute/v2.1/servers/d02d241a-fae5-47c7-9858-cac8171f580a => generated 1316 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:10:25.598493 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-4e03de6f-8917-4364-8ea8-43f6a1b93e10 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:10:25.599848 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-4e03de6f-8917-4364-8ea8-43f6a1b93e10 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [instance: 81ad242a-93d0-4f76-a6f1-e02e5e537e95] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:10:25.627672 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4e03de6f-8917-4364-8ea8-43f6a1b93e10 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:25.631272 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4e03de6f-8917-4364-8ea8-43f6a1b93e10 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:25.634820 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4e03de6f-8917-4364-8ea8-43f6a1b93e10 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:25.636587 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4e03de6f-8917-4364-8ea8-43f6a1b93e10 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:25.637079 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4e03de6f-8917-4364-8ea8-43f6a1b93e10 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:25.637513 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4e03de6f-8917-4364-8ea8-43f6a1b93e10 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:25.887047 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-4e03de6f-8917-4364-8ea8-43f6a1b93e10 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "GET /compute/v2.1/servers/81ad242a-93d0-4f76-a6f1-e02e5e537e95/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.305636 Sep 14 09:10:25.887654 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2262/4541] 10.222.0.60 () {58 vars in 1275 bytes} [Wed Sep 14 09:10:25 2022] GET /compute/v2.1/servers/81ad242a-93d0-4f76-a6f1-e02e5e537e95/os-interface => generated 285 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:10:25.972352 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-e6bd7280-a553-4c04-958d-1478e84be9b6 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:10:25.982741 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-e6bd7280-a553-4c04-958d-1478e84be9b6 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/0be5d897-13d0-43ef-9122-96c21dafd94c" status: 200 len: 1313 microversion: 2.1 time: 0.510539 Sep 14 09:10:25.985532 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2280/4542] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:10:25 2022] GET /compute/v2.1/servers/0be5d897-13d0-43ef-9122-96c21dafd94c => generated 1313 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:10:26.568878 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-0d8c82c9-e7e6-4142-966c-268573771354 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:10:26.569580 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-0d8c82c9-e7e6-4142-966c-268573771354 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] [instance: d02d241a-fae5-47c7-9858-cac8171f580a] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:10:26.584488 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0d8c82c9-e7e6-4142-966c-268573771354 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:26.585367 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0d8c82c9-e7e6-4142-966c-268573771354 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:26.589193 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0d8c82c9-e7e6-4142-966c-268573771354 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:26.590184 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0d8c82c9-e7e6-4142-966c-268573771354 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:26.590810 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0d8c82c9-e7e6-4142-966c-268573771354 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:26.593630 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0d8c82c9-e7e6-4142-966c-268573771354 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:26.872271 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-7feebbc8-9640-4ec8-8655-ea630aa9fe32 req-b3b017ae-8185-4b9c-b5c8-8d6cd6c0271c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d02d241a-fae5-47c7-9858-cac8171f580a", "name": "network-vif-plugged", "status": "completed", "tag": "5f024dc9-ac58-4e56-8032-628e56a69cfa"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:10:26.908785 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-7feebbc8-9640-4ec8-8655-ea630aa9fe32 req-b3b017ae-8185-4b9c-b5c8-8d6cd6c0271c service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:26.912677 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-7feebbc8-9640-4ec8-8655-ea630aa9fe32 req-b3b017ae-8185-4b9c-b5c8-8d6cd6c0271c service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:26.913340 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-7feebbc8-9640-4ec8-8655-ea630aa9fe32 req-b3b017ae-8185-4b9c-b5c8-8d6cd6c0271c service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:26.949997 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-7feebbc8-9640-4ec8-8655-ea630aa9fe32 req-b3b017ae-8185-4b9c-b5c8-8d6cd6c0271c service nova] Creating event network-vif-plugged:5f024dc9-ac58-4e56-8032-628e56a69cfa for instance d02d241a-fae5-47c7-9858-cac8171f580a on n-h1-836830-18 Sep 14 09:10:26.973275 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-7feebbc8-9640-4ec8-8655-ea630aa9fe32 req-b3b017ae-8185-4b9c-b5c8-8d6cd6c0271c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108245 Sep 14 09:10:26.978547 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2281/4543] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:10:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:10:27.020078 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ad622dd9-5261-49ba-9f64-ee82734d3250 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:10:27.020818 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-ad622dd9-5261-49ba-9f64-ee82734d3250 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 0be5d897-13d0-43ef-9122-96c21dafd94c] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:10:27.045972 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ad622dd9-5261-49ba-9f64-ee82734d3250 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:27.050402 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ad622dd9-5261-49ba-9f64-ee82734d3250 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:27.053094 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ad622dd9-5261-49ba-9f64-ee82734d3250 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:27.054195 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ad622dd9-5261-49ba-9f64-ee82734d3250 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:27.063304 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-0d8c82c9-e7e6-4142-966c-268573771354 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dabfdd5a6e049c48d00bc1b55a0a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0783155bf04154bf28fc70bcb7580d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:10:27.064839 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ad622dd9-5261-49ba-9f64-ee82734d3250 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:27.065585 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ad622dd9-5261-49ba-9f64-ee82734d3250 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:27.091612 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-0d8c82c9-e7e6-4142-966c-268573771354 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] 10.222.0.60 "GET /compute/v2.1/servers/d02d241a-fae5-47c7-9858-cac8171f580a" status: 200 len: 1316 microversion: 2.1 time: 0.529410 Sep 14 09:10:27.092765 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2263/4544] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:10:26 2022] GET /compute/v2.1/servers/d02d241a-fae5-47c7-9858-cac8171f580a => generated 1316 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:10:27.388044 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-ad622dd9-5261-49ba-9f64-ee82734d3250 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:10:27.408383 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-ad622dd9-5261-49ba-9f64-ee82734d3250 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/0be5d897-13d0-43ef-9122-96c21dafd94c" status: 200 len: 1313 microversion: 2.1 time: 0.400208 Sep 14 09:10:27.410460 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2282/4545] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:10:27 2022] GET /compute/v2.1/servers/0be5d897-13d0-43ef-9122-96c21dafd94c => generated 1313 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:10:28.118850 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-18b4eae9-382a-487f-9542-7df9acdc21a1 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:10:28.120011 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-18b4eae9-382a-487f-9542-7df9acdc21a1 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] [instance: d02d241a-fae5-47c7-9858-cac8171f580a] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:10:28.131000 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-18b4eae9-382a-487f-9542-7df9acdc21a1 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:28.133053 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-18b4eae9-382a-487f-9542-7df9acdc21a1 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:28.134355 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-18b4eae9-382a-487f-9542-7df9acdc21a1 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:28.136005 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-18b4eae9-382a-487f-9542-7df9acdc21a1 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:28.136480 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-18b4eae9-382a-487f-9542-7df9acdc21a1 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:28.137613 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-18b4eae9-382a-487f-9542-7df9acdc21a1 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:28.203901 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-415e24a1-a737-4cb0-9d89-24e05505fc04 req-bdb2174c-5ac5-4510-ab4d-a423a8373bfe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81ad242a-93d0-4f76-a6f1-e02e5e537e95", "tag": "50f39472-c166-4d11-b75f-be5e33cb27d4"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:10:28.221324 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-415e24a1-a737-4cb0-9d89-24e05505fc04 req-bdb2174c-5ac5-4510-ab4d-a423a8373bfe service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:28.224393 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-415e24a1-a737-4cb0-9d89-24e05505fc04 req-bdb2174c-5ac5-4510-ab4d-a423a8373bfe service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:28.228401 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-415e24a1-a737-4cb0-9d89-24e05505fc04 req-bdb2174c-5ac5-4510-ab4d-a423a8373bfe service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:28.256881 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-415e24a1-a737-4cb0-9d89-24e05505fc04 req-bdb2174c-5ac5-4510-ab4d-a423a8373bfe service nova] Creating event network-changed:50f39472-c166-4d11-b75f-be5e33cb27d4 for instance 81ad242a-93d0-4f76-a6f1-e02e5e537e95 on n-h2-836830-18 Sep 14 09:10:28.269846 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-415e24a1-a737-4cb0-9d89-24e05505fc04 req-bdb2174c-5ac5-4510-ab4d-a423a8373bfe service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070663 Sep 14 09:10:28.271554 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2283/4546] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:10:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:10:28.434403 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-84884566-f85b-42ea-9118-ea68ff23a988 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:10:28.437383 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-84884566-f85b-42ea-9118-ea68ff23a988 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 0be5d897-13d0-43ef-9122-96c21dafd94c] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:10:28.455909 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-84884566-f85b-42ea-9118-ea68ff23a988 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:28.462614 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-84884566-f85b-42ea-9118-ea68ff23a988 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:28.463209 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-84884566-f85b-42ea-9118-ea68ff23a988 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:28.463981 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-84884566-f85b-42ea-9118-ea68ff23a988 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:28.464457 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-84884566-f85b-42ea-9118-ea68ff23a988 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:28.464887 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-84884566-f85b-42ea-9118-ea68ff23a988 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:28.952540 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-18b4eae9-382a-487f-9542-7df9acdc21a1 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dabfdd5a6e049c48d00bc1b55a0a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0783155bf04154bf28fc70bcb7580d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:10:28.990596 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-18b4eae9-382a-487f-9542-7df9acdc21a1 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] 10.222.0.60 "GET /compute/v2.1/servers/d02d241a-fae5-47c7-9858-cac8171f580a" status: 200 len: 1316 microversion: 2.1 time: 0.858361 Sep 14 09:10:28.993456 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2264/4547] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:10:28 2022] GET /compute/v2.1/servers/d02d241a-fae5-47c7-9858-cac8171f580a => generated 1316 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:10:29.012280 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-11971dd3-660f-43ac-b987-49cfb568093a req-4419b8f3-a4e3-4b39-a96e-719848cd76e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0be5d897-13d0-43ef-9122-96c21dafd94c", "name": "network-vif-plugged", "status": "completed", "tag": "ec4b48d5-c2cf-4b8e-94ff-b7bc6da1ad27"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:10:29.042154 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-11971dd3-660f-43ac-b987-49cfb568093a req-4419b8f3-a4e3-4b39-a96e-719848cd76e3 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:29.042778 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-11971dd3-660f-43ac-b987-49cfb568093a req-4419b8f3-a4e3-4b39-a96e-719848cd76e3 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:29.044075 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-11971dd3-660f-43ac-b987-49cfb568093a req-4419b8f3-a4e3-4b39-a96e-719848cd76e3 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:29.075890 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-11971dd3-660f-43ac-b987-49cfb568093a req-4419b8f3-a4e3-4b39-a96e-719848cd76e3 service nova] Creating event network-vif-plugged:ec4b48d5-c2cf-4b8e-94ff-b7bc6da1ad27 for instance 0be5d897-13d0-43ef-9122-96c21dafd94c on n-h2-836830-18 Sep 14 09:10:29.084745 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-11971dd3-660f-43ac-b987-49cfb568093a req-4419b8f3-a4e3-4b39-a96e-719848cd76e3 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089555 Sep 14 09:10:29.085593 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2265/4548] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:10:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:10:29.291906 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-84884566-f85b-42ea-9118-ea68ff23a988 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:10:29.303922 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-84884566-f85b-42ea-9118-ea68ff23a988 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/0be5d897-13d0-43ef-9122-96c21dafd94c" status: 200 len: 1313 microversion: 2.1 time: 0.875579 Sep 14 09:10:29.304769 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2284/4549] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:10:28 2022] GET /compute/v2.1/servers/0be5d897-13d0-43ef-9122-96c21dafd94c => generated 1313 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:10:30.031194 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-dae33710-b59a-42c1-a4db-55d0297a96fb tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:10:30.034570 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-dae33710-b59a-42c1-a4db-55d0297a96fb tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] [instance: d02d241a-fae5-47c7-9858-cac8171f580a] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:10:30.082433 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dae33710-b59a-42c1-a4db-55d0297a96fb tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:30.086537 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dae33710-b59a-42c1-a4db-55d0297a96fb tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:30.090099 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dae33710-b59a-42c1-a4db-55d0297a96fb tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:30.091177 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dae33710-b59a-42c1-a4db-55d0297a96fb tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:30.092917 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dae33710-b59a-42c1-a4db-55d0297a96fb tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:30.094598 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dae33710-b59a-42c1-a4db-55d0297a96fb tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:30.330797 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-0a87b71b-bbc8-4cf7-b9b2-7ab27605cee5 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:10:30.331495 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-0a87b71b-bbc8-4cf7-b9b2-7ab27605cee5 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 0be5d897-13d0-43ef-9122-96c21dafd94c] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:10:30.354897 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0a87b71b-bbc8-4cf7-b9b2-7ab27605cee5 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:30.357526 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0a87b71b-bbc8-4cf7-b9b2-7ab27605cee5 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:30.359596 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0a87b71b-bbc8-4cf7-b9b2-7ab27605cee5 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:30.361766 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0a87b71b-bbc8-4cf7-b9b2-7ab27605cee5 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:30.365185 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0a87b71b-bbc8-4cf7-b9b2-7ab27605cee5 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:30.365628 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0a87b71b-bbc8-4cf7-b9b2-7ab27605cee5 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:30.389413 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-dae33710-b59a-42c1-a4db-55d0297a96fb tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dabfdd5a6e049c48d00bc1b55a0a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0783155bf04154bf28fc70bcb7580d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:10:30.400974 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-dae33710-b59a-42c1-a4db-55d0297a96fb tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] 10.222.0.60 "GET /compute/v2.1/servers/d02d241a-fae5-47c7-9858-cac8171f580a" status: 200 len: 1504 microversion: 2.1 time: 0.387362 Sep 14 09:10:30.402121 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2266/4550] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:10:30 2022] GET /compute/v2.1/servers/d02d241a-fae5-47c7-9858-cac8171f580a => generated 1504 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:10:30.428898 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-bff8f348-7c6f-49b4-b5e6-72299ebaf578 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-247008795"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:10:30.429854 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-bff8f348-7c6f-49b4-b5e6-72299ebaf578 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] [instance: d02d241a-fae5-47c7-9858-cac8171f580a] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:10:30.447138 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bff8f348-7c6f-49b4-b5e6-72299ebaf578 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:30.448159 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bff8f348-7c6f-49b4-b5e6-72299ebaf578 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:30.451549 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bff8f348-7c6f-49b4-b5e6-72299ebaf578 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:30.452854 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bff8f348-7c6f-49b4-b5e6-72299ebaf578 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:30.456110 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bff8f348-7c6f-49b4-b5e6-72299ebaf578 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:30.458302 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bff8f348-7c6f-49b4-b5e6-72299ebaf578 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:30.850368 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-0a87b71b-bbc8-4cf7-b9b2-7ab27605cee5 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:10:30.868110 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.network.security_group_api [None req-bff8f348-7c6f-49b4-b5e6-72299ebaf578 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Adding security group 1d246c1e-439c-4c9f-9e54-7067d4b0ee1f to port 5f024dc9-ac58-4e56-8032-628e56a69cfa Sep 14 09:10:30.869389 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-0a87b71b-bbc8-4cf7-b9b2-7ab27605cee5 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/0be5d897-13d0-43ef-9122-96c21dafd94c" status: 200 len: 1313 microversion: 2.1 time: 0.538086 Sep 14 09:10:30.871056 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2285/4551] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:10:30 2022] GET /compute/v2.1/servers/0be5d897-13d0-43ef-9122-96c21dafd94c => generated 1313 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:10:31.491178 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-bff8f348-7c6f-49b4-b5e6-72299ebaf578 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] 10.222.0.60 "POST /compute/v2.1/servers/d02d241a-fae5-47c7-9858-cac8171f580a/action" status: 202 len: 0 microversion: 2.1 time: 1.068294 Sep 14 09:10:31.492257 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2267/4552] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:10:30 2022] POST /compute/v2.1/servers/d02d241a-fae5-47c7-9858-cac8171f580a/action => generated 0 bytes in 1070 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 14 09:10:31.500676 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b59fcfcf-ae90-4dc6-beb2-f7fb299c7651 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1018015496"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:10:31.501281 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-b59fcfcf-ae90-4dc6-beb2-f7fb299c7651 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] [instance: d02d241a-fae5-47c7-9858-cac8171f580a] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:10:31.529097 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b59fcfcf-ae90-4dc6-beb2-f7fb299c7651 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:31.531125 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-127b252e-a6f6-4e7e-aef7-63585ab141db req-edbb9997-19d7-4889-808a-9d2fad740f09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d02d241a-fae5-47c7-9858-cac8171f580a", "tag": "5f024dc9-ac58-4e56-8032-628e56a69cfa"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:10:31.534112 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b59fcfcf-ae90-4dc6-beb2-f7fb299c7651 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:31.534577 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b59fcfcf-ae90-4dc6-beb2-f7fb299c7651 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:31.535353 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b59fcfcf-ae90-4dc6-beb2-f7fb299c7651 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:31.543526 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b59fcfcf-ae90-4dc6-beb2-f7fb299c7651 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:31.543678 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b59fcfcf-ae90-4dc6-beb2-f7fb299c7651 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:31.550199 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-127b252e-a6f6-4e7e-aef7-63585ab141db req-edbb9997-19d7-4889-808a-9d2fad740f09 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:31.553517 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-127b252e-a6f6-4e7e-aef7-63585ab141db req-edbb9997-19d7-4889-808a-9d2fad740f09 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:31.554173 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-127b252e-a6f6-4e7e-aef7-63585ab141db req-edbb9997-19d7-4889-808a-9d2fad740f09 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:31.590212 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-127b252e-a6f6-4e7e-aef7-63585ab141db req-edbb9997-19d7-4889-808a-9d2fad740f09 service nova] Creating event network-changed:5f024dc9-ac58-4e56-8032-628e56a69cfa for instance d02d241a-fae5-47c7-9858-cac8171f580a on n-h1-836830-18 Sep 14 09:10:31.599935 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-127b252e-a6f6-4e7e-aef7-63585ab141db req-edbb9997-19d7-4889-808a-9d2fad740f09 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071240 Sep 14 09:10:31.602380 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2268/4553] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:10:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:10:32.033373 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.network.security_group_api [None req-b59fcfcf-ae90-4dc6-beb2-f7fb299c7651 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Adding security group 59864ebb-3f82-4f96-b37c-3c6ffc7622f9 to port 5f024dc9-ac58-4e56-8032-628e56a69cfa Sep 14 09:10:32.857424 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-07628124-ec30-4438-b78e-e3b764ab75c9 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:10:32.859170 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-07628124-ec30-4438-b78e-e3b764ab75c9 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 0be5d897-13d0-43ef-9122-96c21dafd94c] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:10:32.875570 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-b59fcfcf-ae90-4dc6-beb2-f7fb299c7651 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] 10.222.0.60 "POST /compute/v2.1/servers/d02d241a-fae5-47c7-9858-cac8171f580a/action" status: 202 len: 0 microversion: 2.1 time: 1.379149 Sep 14 09:10:32.880679 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2286/4554] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:10:31 2022] POST /compute/v2.1/servers/d02d241a-fae5-47c7-9858-cac8171f580a/action => generated 0 bytes in 1382 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:10:32.880826 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-07628124-ec30-4438-b78e-e3b764ab75c9 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:32.880826 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-07628124-ec30-4438-b78e-e3b764ab75c9 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:32.880826 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-07628124-ec30-4438-b78e-e3b764ab75c9 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:32.880826 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-07628124-ec30-4438-b78e-e3b764ab75c9 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:32.884022 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-07628124-ec30-4438-b78e-e3b764ab75c9 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:32.885132 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-07628124-ec30-4438-b78e-e3b764ab75c9 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:32.887580 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b230f271-a28c-4c13-be7b-dc9e6294e0c1 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:10:32.888361 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-b230f271-a28c-4c13-be7b-dc9e6294e0c1 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] [instance: d02d241a-fae5-47c7-9858-cac8171f580a] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:10:32.903143 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b230f271-a28c-4c13-be7b-dc9e6294e0c1 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:32.903696 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b230f271-a28c-4c13-be7b-dc9e6294e0c1 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:32.904157 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b230f271-a28c-4c13-be7b-dc9e6294e0c1 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:32.905140 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b230f271-a28c-4c13-be7b-dc9e6294e0c1 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:32.905616 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b230f271-a28c-4c13-be7b-dc9e6294e0c1 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:32.906057 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b230f271-a28c-4c13-be7b-dc9e6294e0c1 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:33.380992 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-07628124-ec30-4438-b78e-e3b764ab75c9 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:10:33.385201 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=100 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:10:33.397793 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-b230f271-a28c-4c13-be7b-dc9e6294e0c1 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] 10.222.0.60 "GET /compute/v2.1/servers/d02d241a-fae5-47c7-9858-cac8171f580a/os-security-groups" status: 200 len: 1157 microversion: 2.1 time: 0.514229 Sep 14 09:10:33.399353 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2287/4555] 10.222.0.60 () {58 vars in 1293 bytes} [Wed Sep 14 09:10:32 2022] GET /compute/v2.1/servers/d02d241a-fae5-47c7-9858-cac8171f580a/os-security-groups => generated 1157 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:10:33.404804 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-07628124-ec30-4438-b78e-e3b764ab75c9 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/0be5d897-13d0-43ef-9122-96c21dafd94c" status: 200 len: 1500 microversion: 2.1 time: 1.506520 Sep 14 09:10:33.407625 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2269/4556] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:10:31 2022] GET /compute/v2.1/servers/0be5d897-13d0-43ef-9122-96c21dafd94c => generated 1500 bytes in 1516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:10:33.441487 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-2cebe334-3bbc-40ea-9a81-48ea1e1edcb3 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Action: 'create', calling method: .version_select at 0x7f7d3f37f5e0>, body: {"security_group": {"name": " tempest-securitygroup -20416544 ", "description": "tempest-description-1555673494"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:10:33.442996 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-05a93358-d2e6-4a0f-ac77-f37f4ba0564e tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:10:33.455071 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-05a93358-d2e6-4a0f-ac77-f37f4ba0564e tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:33.458262 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-05a93358-d2e6-4a0f-ac77-f37f4ba0564e tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:33.459510 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-05a93358-d2e6-4a0f-ac77-f37f4ba0564e tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:33.493726 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-05a93358-d2e6-4a0f-ac77-f37f4ba0564e tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 0be5d897-13d0-43ef-9122-96c21dafd94c] Going to try to stop instance {{(pid=128759) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 14 09:10:33.678273 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-05a93358-d2e6-4a0f-ac77-f37f4ba0564e tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "POST /compute/v2.1/servers/0be5d897-13d0-43ef-9122-96c21dafd94c/action" status: 202 len: 0 microversion: 2.1 time: 0.235931 Sep 14 09:10:33.679894 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2270/4557] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:10:33 2022] POST /compute/v2.1/servers/0be5d897-13d0-43ef-9122-96c21dafd94c/action => generated 0 bytes in 248 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:10:33.696253 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-cd540519-b7ad-418c-930e-331079063ef0 req-73976168-6e4c-4f88-9a1d-4a958f896941 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d02d241a-fae5-47c7-9858-cac8171f580a", "tag": "5f024dc9-ac58-4e56-8032-628e56a69cfa"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:10:33.721762 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-cd540519-b7ad-418c-930e-331079063ef0 req-73976168-6e4c-4f88-9a1d-4a958f896941 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:33.722174 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-cd540519-b7ad-418c-930e-331079063ef0 req-73976168-6e4c-4f88-9a1d-4a958f896941 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:33.722610 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-cd540519-b7ad-418c-930e-331079063ef0 req-73976168-6e4c-4f88-9a1d-4a958f896941 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:33.764974 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-cd540519-b7ad-418c-930e-331079063ef0 req-73976168-6e4c-4f88-9a1d-4a958f896941 service nova] Creating event network-changed:5f024dc9-ac58-4e56-8032-628e56a69cfa for instance d02d241a-fae5-47c7-9858-cac8171f580a on n-h1-836830-18 Sep 14 09:10:33.779786 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-cd540519-b7ad-418c-930e-331079063ef0 req-73976168-6e4c-4f88-9a1d-4a958f896941 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095621 Sep 14 09:10:33.780668 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2271/4558] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:10:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:10:33.790075 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-2cebe334-3bbc-40ea-9a81-48ea1e1edcb3 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] 10.222.0.60 "POST /compute/v2.1/os-security-groups" status: 200 len: 222 microversion: 2.1 time: 0.369579 Sep 14 09:10:33.791004 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2288/4559] 10.222.0.60 () {60 vars in 1180 bytes} [Wed Sep 14 09:10:33 2022] POST /compute/v2.1/os-security-groups => generated 222 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:10:33.797042 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-1842fa3c-b042-4932-9b4e-d61837b756ba tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:10:33.798977 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-1842fa3c-b042-4932-9b4e-d61837b756ba tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 0be5d897-13d0-43ef-9122-96c21dafd94c] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:10:33.806083 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-f05d040e-0918-4630-9873-708ecf4b0721 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Calling method '.version_select at 0x7f7d3f3aef70>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:10:33.823876 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1842fa3c-b042-4932-9b4e-d61837b756ba tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:33.826526 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1842fa3c-b042-4932-9b4e-d61837b756ba tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:33.840052 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1842fa3c-b042-4932-9b4e-d61837b756ba tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:33.841369 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1842fa3c-b042-4932-9b4e-d61837b756ba tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:33.847972 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1842fa3c-b042-4932-9b4e-d61837b756ba tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:33.849690 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1842fa3c-b042-4932-9b4e-d61837b756ba tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:33.887572 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-f05d040e-0918-4630-9873-708ecf4b0721 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] 10.222.0.60 "GET /compute/v2.1/os-security-groups/a19bce2c-356d-4c64-a198-59bd3c46d3c9" status: 200 len: 222 microversion: 2.1 time: 0.087029 Sep 14 09:10:33.888176 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2289/4560] 10.222.0.60 () {58 vars in 1269 bytes} [Wed Sep 14 09:10:33 2022] GET /compute/v2.1/os-security-groups/a19bce2c-356d-4c64-a198-59bd3c46d3c9 => generated 222 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:10:33.901271 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-e26c5468-5507-40f8-975a-7dd9b4372851 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Calling method '.version_select at 0x7f7d3f368670>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:10:34.192164 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-1842fa3c-b042-4932-9b4e-d61837b756ba tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:10:34.206844 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-1842fa3c-b042-4932-9b4e-d61837b756ba tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/0be5d897-13d0-43ef-9122-96c21dafd94c" status: 200 len: 1510 microversion: 2.1 time: 0.422657 Sep 14 09:10:34.210276 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2272/4561] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:10:33 2022] GET /compute/v2.1/servers/0be5d897-13d0-43ef-9122-96c21dafd94c => generated 1510 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:10:34.418792 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-e26c5468-5507-40f8-975a-7dd9b4372851 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/a19bce2c-356d-4c64-a198-59bd3c46d3c9" status: 202 len: 0 microversion: 2.1 time: 0.521537 Sep 14 09:10:34.419457 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2290/4562] 10.222.0.60 () {58 vars in 1272 bytes} [Wed Sep 14 09:10:33 2022] DELETE /compute/v2.1/os-security-groups/a19bce2c-356d-4c64-a198-59bd3c46d3c9 => generated 0 bytes in 523 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 14 09:10:34.428286 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-4a7f4911-1ae2-4fa6-938f-d07e9884b21b tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Calling method '.version_select at 0x7f7d3ef6ba60>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:10:34.474033 n-d-836830-18 devstack@n-api.service[128759]: DEBUG neutronclient.v2_0.client [None req-4a7f4911-1ae2-4fa6-938f-d07e9884b21b tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a19bce2c-356d-4c64-a198-59bd3c46d3c9 does not exist", "detail": ""}} {{(pid=128759) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 14 09:10:34.474633 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.network.security_group_api [None req-4a7f4911-1ae2-4fa6-938f-d07e9884b21b tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Neutron security group a19bce2c-356d-4c64-a198-59bd3c46d3c9 not found {{(pid=128759) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 14 09:10:34.475391 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-4a7f4911-1ae2-4fa6-938f-d07e9884b21b tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] HTTP exception thrown: Security group a19bce2c-356d-4c64-a198-59bd3c46d3c9 does not exist Sep 14 09:10:34.475391 n-d-836830-18 devstack@n-api.service[128759]: Neutron server returns request_ids: ['req-dfb4d217-f913-40ba-a459-9018d638b888'] Sep 14 09:10:34.477567 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-4a7f4911-1ae2-4fa6-938f-d07e9884b21b tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Request method failure captured: Sep 14 09:10:34.477567 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/os-security-groups/a19bce2c-356d-4c64-a198-59bd3c46d3c9 HTTP/1.1 Sep 14 09:10:34.477567 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:10:34.477567 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:10:34.477567 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:10:34.477567 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:10:34.477567 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:10:34.477567 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:10:34.477567 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:10:34.477567 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:10:34.477567 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZpubEr9UgWj_j7j968HWFZ0D3vsD9X5NGBGI22hLpa671vkRnOFuLUHN5BGyBOTOD_eSiiXbv14AW_KXyWtJ-nEaHjFTRMlAQdICZGgh9e4MfCMr0iqhNEP0c19crMOXUBhQTUSoeq6F9tEyTwVcFxkCl04_QVOcf30LScxQWEOmzE Sep 14 09:10:34.477567 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:10:34.477567 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:10:34.477567 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:10:34.477567 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:10:34.477567 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:10:34.477567 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:10:34.477567 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: de0783155bf04154bf28fc70bcb7580d Sep 14 09:10:34.477567 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-SecurityGroupsTestJSON-367581750 Sep 14 09:10:34.477567 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:10:34.477567 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:10:34.477567 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/de0783155bf04154bf28fc70bcb7580d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_de0783155bf04154bf28fc70bcb7580d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/de0783155bf04154bf28fc70bcb7580d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/de0783155bf04154bf28fc70bcb7580d"}]}] Sep 14 09:10:34.477567 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-SecurityGroupsTestJSON-367581750 Sep 14 09:10:34.477567 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: de0783155bf04154bf28fc70bcb7580d Sep 14 09:10:34.477567 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-367581750 Sep 14 09:10:34.477567 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-SecurityGroupsTestJSON-367581750-project Sep 14 09:10:34.477567 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:10:34.477567 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:10:34.477567 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 2dabfdd5a6e049c48d00bc1b55a0a30f Sep 14 09:10:34.477567 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-SecurityGroupsTestJSON-367581750-project Sep 14 09:10:34.477567 n-d-836830-18 devstack@n-api.service[128759]: method: Sep 14 09:10:34.477567 n-d-836830-18 devstack@n-api.service[128759]: exception: Security group a19bce2c-356d-4c64-a198-59bd3c46d3c9 does not exist Sep 14 09:10:34.477567 n-d-836830-18 devstack@n-api.service[128759]: Neutron server returns request_ids: ['req-dfb4d217-f913-40ba-a459-9018d638b888'] Sep 14 09:10:34.477567 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': 'a19bce2c-356d-4c64-a198-59bd3c46d3c9'} Sep 14 09:10:34.477567 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:10:34.477567 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:10:34.477567 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 14 09:10:34.477567 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 14 09:10:34.477567 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:10:34.477567 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:10:34.477567 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 14 09:10:34.477567 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 14 09:10:34.477567 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:10:34.477567 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:10:34.477567 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 14 09:10:34.477567 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 14 09:10:34.477567 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:10:34.477567 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:10:34.477567 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 14 09:10:34.477567 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 14 09:10:34.477567 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:10:34.477567 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:10:34.477567 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 14 09:10:34.477567 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 14 09:10:34.477567 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:10:34.477567 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:10:34.477567 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 14 09:10:34.477567 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 14 09:10:34.477567 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 14 09:10:34.477567 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 14 09:10:34.477567 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group a19bce2c-356d-4c64-a198-59bd3c46d3c9 does not exist Sep 14 09:10:34.482846 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dfb4d217-f913-40ba-a459-9018d638b888'] Sep 14 09:10:34.482846 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:10:34.482846 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:10:34.482846 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:10:34.482846 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:10:34.482846 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Sep 14 09:10:34.482846 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 14 09:10:34.482846 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 14 09:10:34.482846 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 14 09:10:34.482846 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group a19bce2c-356d-4c64-a198-59bd3c46d3c9 does not exist Sep 14 09:10:34.482846 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dfb4d217-f913-40ba-a459-9018d638b888'] Sep 14 09:10:34.482846 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:10:34.482846 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:10:34.482846 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:10:34.482846 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:10:34.482846 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:10:34.482846 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:10:34.482846 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:10:34.482846 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:10:34.482846 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:10:34.482846 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:10:34.482846 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:10:34.482846 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:10:34.482846 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Sep 14 09:10:34.482846 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 14 09:10:34.482846 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group a19bce2c-356d-4c64-a198-59bd3c46d3c9 does not exist Sep 14 09:10:34.482846 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dfb4d217-f913-40ba-a459-9018d638b888'] Sep 14 09:10:34.482846 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:10:34.482846 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:10:34.482846 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:10:34.482846 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:10:34.482846 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:10:34.482846 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:10:34.482846 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:10:34.482846 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:10:34.482846 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group a19bce2c-356d-4c64-a198-59bd3c46d3c9 does not exist Sep 14 09:10:34.482846 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dfb4d217-f913-40ba-a459-9018d638b888'] Sep 14 09:10:34.482846 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:10:34.482846 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-4a7f4911-1ae2-4fa6-938f-d07e9884b21b tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Returning 404 to user: Security group a19bce2c-356d-4c64-a198-59bd3c46d3c9 does not exist Sep 14 09:10:34.482846 n-d-836830-18 devstack@n-api.service[128759]: Neutron server returns request_ids: ['req-dfb4d217-f913-40ba-a459-9018d638b888'] {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:10:34.482846 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-4a7f4911-1ae2-4fa6-938f-d07e9884b21b tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] 10.222.0.60 "GET /compute/v2.1/os-security-groups/a19bce2c-356d-4c64-a198-59bd3c46d3c9" status: 404 len: 194 microversion: 2.1 time: 0.054770 Sep 14 09:10:34.482846 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2273/4563] 10.222.0.60 () {58 vars in 1269 bytes} [Wed Sep 14 09:10:34 2022] GET /compute/v2.1/os-security-groups/a19bce2c-356d-4c64-a198-59bd3c46d3c9 => generated 194 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:10:34.488730 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-0df2a731-711a-4752-936a-6a3490143e2e tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Action: 'create', calling method: .version_select at 0x7f7d3f3b91f0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-807636096", "description": "tempest-description-973161117"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:10:35.012638 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-0df2a731-711a-4752-936a-6a3490143e2e tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] 10.222.0.60 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.527702 Sep 14 09:10:35.015078 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2291/4564] 10.222.0.60 () {60 vars in 1180 bytes} [Wed Sep 14 09:10:34 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:10:35.026322 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-7b4776aa-7bf4-41c2-8bf9-2d660680dc1b tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Action: 'create', calling method: .version_select at 0x7f7d3ee78c10>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1841459983", "description": "tempest-description-2137949029"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:10:35.241847 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b9ad424f-87b9-4ac4-9a6d-aa6bea1a0463 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:10:35.243610 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-b9ad424f-87b9-4ac4-9a6d-aa6bea1a0463 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 0be5d897-13d0-43ef-9122-96c21dafd94c] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:10:35.254768 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b9ad424f-87b9-4ac4-9a6d-aa6bea1a0463 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:35.256186 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b9ad424f-87b9-4ac4-9a6d-aa6bea1a0463 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:35.257073 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b9ad424f-87b9-4ac4-9a6d-aa6bea1a0463 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:35.258210 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b9ad424f-87b9-4ac4-9a6d-aa6bea1a0463 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:35.258987 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b9ad424f-87b9-4ac4-9a6d-aa6bea1a0463 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:35.259410 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b9ad424f-87b9-4ac4-9a6d-aa6bea1a0463 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:35.297422 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-7b4776aa-7bf4-41c2-8bf9-2d660680dc1b tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] 10.222.0.60 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.274802 Sep 14 09:10:35.298014 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2274/4565] 10.222.0.60 () {60 vars in 1180 bytes} [Wed Sep 14 09:10:35 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:10:35.313241 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-054842c1-ab6a-41a4-8868-92e914e20438 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Action: 'create', calling method: .version_select at 0x7f7d3ee649d0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-356526277", "description": "tempest-description-579868382"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:10:35.601778 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-054842c1-ab6a-41a4-8868-92e914e20438 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] 10.222.0.60 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.293642 Sep 14 09:10:35.603621 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2275/4566] 10.222.0.60 () {60 vars in 1180 bytes} [Wed Sep 14 09:10:35 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:10:35.617915 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-da4f511c-f152-4561-b65b-6c75c89058a1 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Calling method '.version_select at 0x7f7d3eef4430>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:10:35.644734 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-b9ad424f-87b9-4ac4-9a6d-aa6bea1a0463 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:10:35.657128 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-b9ad424f-87b9-4ac4-9a6d-aa6bea1a0463 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/0be5d897-13d0-43ef-9122-96c21dafd94c" status: 200 len: 1510 microversion: 2.1 time: 0.425747 Sep 14 09:10:35.658580 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2292/4567] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:10:35 2022] GET /compute/v2.1/servers/0be5d897-13d0-43ef-9122-96c21dafd94c => generated 1510 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:10:36.117336 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-da4f511c-f152-4561-b65b-6c75c89058a1 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] 10.222.0.60 "GET /compute/v2.1/os-security-groups" status: 200 len: 1831 microversion: 2.1 time: 0.504438 Sep 14 09:10:36.117931 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2276/4568] 10.222.0.60 () {58 vars in 1158 bytes} [Wed Sep 14 09:10:35 2022] GET /compute/v2.1/os-security-groups => generated 1831 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:10:36.134599 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a9be676b-ac3d-4792-b171-7effcba9ed08 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Calling method '.version_select at 0x7f7d3f37f280>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:10:36.405199 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-a9be676b-ac3d-4792-b171-7effcba9ed08 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/be8381c4-c1e6-42f8-b294-6f39e7eb2588" status: 202 len: 0 microversion: 2.1 time: 0.275167 Sep 14 09:10:36.409865 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2293/4569] 10.222.0.60 () {58 vars in 1272 bytes} [Wed Sep 14 09:10:36 2022] DELETE /compute/v2.1/os-security-groups/be8381c4-c1e6-42f8-b294-6f39e7eb2588 => generated 0 bytes in 280 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:10:36.414841 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-80e45290-9d4e-4f97-a054-ec9981aaf5fa tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Calling method '.version_select at 0x7f7d3ee41ca0>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:10:36.464266 n-d-836830-18 devstack@n-api.service[128759]: DEBUG neutronclient.v2_0.client [None req-80e45290-9d4e-4f97-a054-ec9981aaf5fa tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group be8381c4-c1e6-42f8-b294-6f39e7eb2588 does not exist", "detail": ""}} {{(pid=128759) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 14 09:10:36.465504 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.network.security_group_api [None req-80e45290-9d4e-4f97-a054-ec9981aaf5fa tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Neutron security group be8381c4-c1e6-42f8-b294-6f39e7eb2588 not found {{(pid=128759) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 14 09:10:36.466276 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-80e45290-9d4e-4f97-a054-ec9981aaf5fa tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] HTTP exception thrown: Security group be8381c4-c1e6-42f8-b294-6f39e7eb2588 does not exist Sep 14 09:10:36.466276 n-d-836830-18 devstack@n-api.service[128759]: Neutron server returns request_ids: ['req-56dddce8-f591-43ee-8964-7511fdbc28e9'] Sep 14 09:10:36.468139 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-80e45290-9d4e-4f97-a054-ec9981aaf5fa tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Request method failure captured: Sep 14 09:10:36.468139 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/os-security-groups/be8381c4-c1e6-42f8-b294-6f39e7eb2588 HTTP/1.1 Sep 14 09:10:36.468139 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:10:36.468139 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:10:36.468139 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:10:36.468139 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:10:36.468139 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:10:36.468139 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:10:36.468139 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:10:36.468139 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:10:36.468139 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZpubEr9UgWj_j7j968HWFZ0D3vsD9X5NGBGI22hLpa671vkRnOFuLUHN5BGyBOTOD_eSiiXbv14AW_KXyWtJ-nEaHjFTRMlAQdICZGgh9e4MfCMr0iqhNEP0c19crMOXUBhQTUSoeq6F9tEyTwVcFxkCl04_QVOcf30LScxQWEOmzE Sep 14 09:10:36.468139 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:10:36.468139 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:10:36.468139 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:10:36.468139 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:10:36.468139 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:10:36.468139 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:10:36.468139 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: de0783155bf04154bf28fc70bcb7580d Sep 14 09:10:36.468139 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-SecurityGroupsTestJSON-367581750 Sep 14 09:10:36.468139 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:10:36.468139 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:10:36.468139 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/de0783155bf04154bf28fc70bcb7580d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_de0783155bf04154bf28fc70bcb7580d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/de0783155bf04154bf28fc70bcb7580d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/de0783155bf04154bf28fc70bcb7580d"}]}] Sep 14 09:10:36.468139 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-SecurityGroupsTestJSON-367581750 Sep 14 09:10:36.468139 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: de0783155bf04154bf28fc70bcb7580d Sep 14 09:10:36.468139 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-367581750 Sep 14 09:10:36.468139 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-SecurityGroupsTestJSON-367581750-project Sep 14 09:10:36.468139 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:10:36.468139 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:10:36.468139 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 2dabfdd5a6e049c48d00bc1b55a0a30f Sep 14 09:10:36.468139 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-SecurityGroupsTestJSON-367581750-project Sep 14 09:10:36.468139 n-d-836830-18 devstack@n-api.service[128759]: method: Sep 14 09:10:36.468139 n-d-836830-18 devstack@n-api.service[128759]: exception: Security group be8381c4-c1e6-42f8-b294-6f39e7eb2588 does not exist Sep 14 09:10:36.468139 n-d-836830-18 devstack@n-api.service[128759]: Neutron server returns request_ids: ['req-56dddce8-f591-43ee-8964-7511fdbc28e9'] Sep 14 09:10:36.468139 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': 'be8381c4-c1e6-42f8-b294-6f39e7eb2588'} Sep 14 09:10:36.468139 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:10:36.468139 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:10:36.468139 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 14 09:10:36.468139 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 14 09:10:36.468139 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:10:36.468139 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:10:36.468139 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 14 09:10:36.468139 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 14 09:10:36.468139 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:10:36.468139 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:10:36.468139 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 14 09:10:36.468139 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 14 09:10:36.468139 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:10:36.468139 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:10:36.468139 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 14 09:10:36.468139 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 14 09:10:36.468139 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:10:36.468139 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:10:36.468139 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 14 09:10:36.468139 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 14 09:10:36.468139 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:10:36.468139 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:10:36.468139 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 14 09:10:36.468139 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 14 09:10:36.468139 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 14 09:10:36.468139 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 14 09:10:36.468139 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group be8381c4-c1e6-42f8-b294-6f39e7eb2588 does not exist Sep 14 09:10:36.476108 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-56dddce8-f591-43ee-8964-7511fdbc28e9'] Sep 14 09:10:36.476108 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:10:36.476108 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:10:36.476108 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:10:36.476108 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:10:36.476108 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Sep 14 09:10:36.476108 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 14 09:10:36.476108 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 14 09:10:36.476108 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 14 09:10:36.476108 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group be8381c4-c1e6-42f8-b294-6f39e7eb2588 does not exist Sep 14 09:10:36.476108 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-56dddce8-f591-43ee-8964-7511fdbc28e9'] Sep 14 09:10:36.476108 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:10:36.476108 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:10:36.476108 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:10:36.476108 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:10:36.476108 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:10:36.476108 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:10:36.476108 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:10:36.476108 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:10:36.476108 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:10:36.476108 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:10:36.476108 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:10:36.476108 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:10:36.476108 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Sep 14 09:10:36.476108 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 14 09:10:36.476108 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group be8381c4-c1e6-42f8-b294-6f39e7eb2588 does not exist Sep 14 09:10:36.476108 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-56dddce8-f591-43ee-8964-7511fdbc28e9'] Sep 14 09:10:36.476108 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:10:36.476108 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:10:36.476108 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:10:36.476108 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:10:36.476108 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:10:36.476108 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:10:36.476108 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:10:36.476108 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:10:36.476108 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group be8381c4-c1e6-42f8-b294-6f39e7eb2588 does not exist Sep 14 09:10:36.476108 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-56dddce8-f591-43ee-8964-7511fdbc28e9'] Sep 14 09:10:36.476108 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:10:36.476108 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-80e45290-9d4e-4f97-a054-ec9981aaf5fa tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Returning 404 to user: Security group be8381c4-c1e6-42f8-b294-6f39e7eb2588 does not exist Sep 14 09:10:36.476108 n-d-836830-18 devstack@n-api.service[128759]: Neutron server returns request_ids: ['req-56dddce8-f591-43ee-8964-7511fdbc28e9'] {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:10:36.476108 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-80e45290-9d4e-4f97-a054-ec9981aaf5fa tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] 10.222.0.60 "GET /compute/v2.1/os-security-groups/be8381c4-c1e6-42f8-b294-6f39e7eb2588" status: 404 len: 194 microversion: 2.1 time: 0.058845 Sep 14 09:10:36.476108 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2277/4570] 10.222.0.60 () {58 vars in 1269 bytes} [Wed Sep 14 09:10:36 2022] GET /compute/v2.1/os-security-groups/be8381c4-c1e6-42f8-b294-6f39e7eb2588 => generated 194 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 14 09:10:36.484329 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-01f521ce-1985-4c5c-8b40-967cc5e74a8b tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Calling method '.version_select at 0x7f7d3f311c10>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:10:36.682646 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-91adb9d5-2c5a-471c-95bc-9fd0b8a41227 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:10:36.683480 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-91adb9d5-2c5a-471c-95bc-9fd0b8a41227 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 0be5d897-13d0-43ef-9122-96c21dafd94c] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:10:36.694001 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-91adb9d5-2c5a-471c-95bc-9fd0b8a41227 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:36.697736 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-91adb9d5-2c5a-471c-95bc-9fd0b8a41227 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:36.699132 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-91adb9d5-2c5a-471c-95bc-9fd0b8a41227 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:36.700018 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-91adb9d5-2c5a-471c-95bc-9fd0b8a41227 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:36.701266 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-91adb9d5-2c5a-471c-95bc-9fd0b8a41227 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:36.702463 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-91adb9d5-2c5a-471c-95bc-9fd0b8a41227 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:36.867899 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-01f521ce-1985-4c5c-8b40-967cc5e74a8b tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/a64e0e10-fe4c-491e-a817-3c9faa913e20" status: 202 len: 0 microversion: 2.1 time: 0.387698 Sep 14 09:10:36.871316 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2294/4571] 10.222.0.60 () {58 vars in 1272 bytes} [Wed Sep 14 09:10:36 2022] DELETE /compute/v2.1/os-security-groups/a64e0e10-fe4c-491e-a817-3c9faa913e20 => generated 0 bytes in 395 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:10:36.876243 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1ea50e78-ff89-4179-8f65-065149e7eaca tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Calling method '.version_select at 0x7f7d3f37d5e0>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:10:36.955424 n-d-836830-18 devstack@n-api.service[128758]: DEBUG neutronclient.v2_0.client [None req-1ea50e78-ff89-4179-8f65-065149e7eaca tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a64e0e10-fe4c-491e-a817-3c9faa913e20 does not exist", "detail": ""}} {{(pid=128758) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 14 09:10:36.956029 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.network.security_group_api [None req-1ea50e78-ff89-4179-8f65-065149e7eaca tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Neutron security group a64e0e10-fe4c-491e-a817-3c9faa913e20 not found {{(pid=128758) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 14 09:10:36.956567 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-1ea50e78-ff89-4179-8f65-065149e7eaca tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] HTTP exception thrown: Security group a64e0e10-fe4c-491e-a817-3c9faa913e20 does not exist Sep 14 09:10:36.956567 n-d-836830-18 devstack@n-api.service[128758]: Neutron server returns request_ids: ['req-a8df510e-f3cc-4da4-ac11-a483d7edbfc0'] Sep 14 09:10:36.960824 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1ea50e78-ff89-4179-8f65-065149e7eaca tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Request method failure captured: Sep 14 09:10:36.960824 n-d-836830-18 devstack@n-api.service[128758]: request: GET /compute/v2.1/os-security-groups/a64e0e10-fe4c-491e-a817-3c9faa913e20 HTTP/1.1 Sep 14 09:10:36.960824 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 09:10:36.960824 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 09:10:36.960824 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 09:10:36.960824 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 09:10:36.960824 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 09:10:36.960824 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 09:10:36.960824 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 09:10:36.960824 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 09:10:36.960824 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZpubEr9UgWj_j7j968HWFZ0D3vsD9X5NGBGI22hLpa671vkRnOFuLUHN5BGyBOTOD_eSiiXbv14AW_KXyWtJ-nEaHjFTRMlAQdICZGgh9e4MfCMr0iqhNEP0c19crMOXUBhQTUSoeq6F9tEyTwVcFxkCl04_QVOcf30LScxQWEOmzE Sep 14 09:10:36.960824 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 09:10:36.960824 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 09:10:36.960824 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 09:10:36.960824 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 09:10:36.960824 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 09:10:36.960824 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 09:10:36.960824 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: de0783155bf04154bf28fc70bcb7580d Sep 14 09:10:36.960824 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-SecurityGroupsTestJSON-367581750 Sep 14 09:10:36.960824 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 09:10:36.960824 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 09:10:36.960824 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/de0783155bf04154bf28fc70bcb7580d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_de0783155bf04154bf28fc70bcb7580d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/de0783155bf04154bf28fc70bcb7580d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/de0783155bf04154bf28fc70bcb7580d"}]}] Sep 14 09:10:36.960824 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-SecurityGroupsTestJSON-367581750 Sep 14 09:10:36.960824 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: de0783155bf04154bf28fc70bcb7580d Sep 14 09:10:36.960824 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-367581750 Sep 14 09:10:36.960824 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-SecurityGroupsTestJSON-367581750-project Sep 14 09:10:36.960824 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 09:10:36.960824 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 09:10:36.960824 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 2dabfdd5a6e049c48d00bc1b55a0a30f Sep 14 09:10:36.960824 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-SecurityGroupsTestJSON-367581750-project Sep 14 09:10:36.960824 n-d-836830-18 devstack@n-api.service[128758]: method: Sep 14 09:10:36.960824 n-d-836830-18 devstack@n-api.service[128758]: exception: Security group a64e0e10-fe4c-491e-a817-3c9faa913e20 does not exist Sep 14 09:10:36.960824 n-d-836830-18 devstack@n-api.service[128758]: Neutron server returns request_ids: ['req-a8df510e-f3cc-4da4-ac11-a483d7edbfc0'] Sep 14 09:10:36.960824 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': 'a64e0e10-fe4c-491e-a817-3c9faa913e20'} Sep 14 09:10:36.960824 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:10:36.960824 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:10:36.960824 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 14 09:10:36.960824 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 14 09:10:36.960824 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:10:36.960824 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:10:36.960824 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 14 09:10:36.960824 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 14 09:10:36.960824 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:10:36.960824 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:10:36.960824 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 14 09:10:36.960824 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 14 09:10:36.960824 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:10:36.960824 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:10:36.960824 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 14 09:10:36.960824 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 14 09:10:36.960824 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:10:36.960824 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:10:36.960824 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 14 09:10:36.960824 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 14 09:10:36.960824 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:10:36.960824 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:10:36.960824 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 14 09:10:36.960824 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 14 09:10:36.960824 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 14 09:10:36.960824 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 14 09:10:36.960824 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group a64e0e10-fe4c-491e-a817-3c9faa913e20 does not exist Sep 14 09:10:36.968688 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a8df510e-f3cc-4da4-ac11-a483d7edbfc0'] Sep 14 09:10:36.968688 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:10:36.968688 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:10:36.968688 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:10:36.968688 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:10:36.968688 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Sep 14 09:10:36.968688 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 14 09:10:36.968688 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 14 09:10:36.968688 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 14 09:10:36.968688 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group a64e0e10-fe4c-491e-a817-3c9faa913e20 does not exist Sep 14 09:10:36.968688 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a8df510e-f3cc-4da4-ac11-a483d7edbfc0'] Sep 14 09:10:36.968688 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:10:36.968688 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:10:36.968688 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:10:36.968688 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:10:36.968688 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:10:36.968688 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:10:36.968688 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:10:36.968688 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:10:36.968688 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:10:36.968688 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:10:36.968688 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:10:36.968688 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:10:36.968688 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Sep 14 09:10:36.968688 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 14 09:10:36.968688 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group a64e0e10-fe4c-491e-a817-3c9faa913e20 does not exist Sep 14 09:10:36.968688 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a8df510e-f3cc-4da4-ac11-a483d7edbfc0'] Sep 14 09:10:36.968688 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:10:36.968688 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:10:36.968688 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:10:36.968688 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:10:36.968688 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:10:36.968688 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:10:36.968688 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:10:36.968688 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:10:36.968688 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group a64e0e10-fe4c-491e-a817-3c9faa913e20 does not exist Sep 14 09:10:36.968688 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a8df510e-f3cc-4da4-ac11-a483d7edbfc0'] Sep 14 09:10:36.968688 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:10:36.968688 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1ea50e78-ff89-4179-8f65-065149e7eaca tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Returning 404 to user: Security group a64e0e10-fe4c-491e-a817-3c9faa913e20 does not exist Sep 14 09:10:36.968688 n-d-836830-18 devstack@n-api.service[128758]: Neutron server returns request_ids: ['req-a8df510e-f3cc-4da4-ac11-a483d7edbfc0'] {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:10:36.968688 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-1ea50e78-ff89-4179-8f65-065149e7eaca tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] 10.222.0.60 "GET /compute/v2.1/os-security-groups/a64e0e10-fe4c-491e-a817-3c9faa913e20" status: 404 len: 194 microversion: 2.1 time: 0.090503 Sep 14 09:10:36.968688 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2295/4572] 10.222.0.60 () {58 vars in 1269 bytes} [Wed Sep 14 09:10:36 2022] GET /compute/v2.1/os-security-groups/a64e0e10-fe4c-491e-a817-3c9faa913e20 => generated 194 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 14 09:10:36.976155 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-bfaed9f1-96c1-4522-ac2b-653704465c1f tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Calling method '.version_select at 0x7f7d3f37f0d0>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:10:37.082185 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-91adb9d5-2c5a-471c-95bc-9fd0b8a41227 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:10:37.093858 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-91adb9d5-2c5a-471c-95bc-9fd0b8a41227 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/0be5d897-13d0-43ef-9122-96c21dafd94c" status: 200 len: 1510 microversion: 2.1 time: 0.412941 Sep 14 09:10:37.099091 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2278/4573] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:10:36 2022] GET /compute/v2.1/servers/0be5d897-13d0-43ef-9122-96c21dafd94c => generated 1510 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:10:37.360055 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-bfaed9f1-96c1-4522-ac2b-653704465c1f tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/3d2ebfb9-22c3-4d2f-afc8-9d28d87e5d47" status: 202 len: 0 microversion: 2.1 time: 0.390696 Sep 14 09:10:37.362304 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2296/4574] 10.222.0.60 () {58 vars in 1272 bytes} [Wed Sep 14 09:10:36 2022] DELETE /compute/v2.1/os-security-groups/3d2ebfb9-22c3-4d2f-afc8-9d28d87e5d47 => generated 0 bytes in 394 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:10:37.374296 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-80697ba7-0926-4a57-a280-0160247c710c tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Calling method '.version_select at 0x7f7d3ee419d0>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:10:37.402813 n-d-836830-18 devstack@n-api.service[128759]: DEBUG neutronclient.v2_0.client [None req-80697ba7-0926-4a57-a280-0160247c710c tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 3d2ebfb9-22c3-4d2f-afc8-9d28d87e5d47 does not exist", "detail": ""}} {{(pid=128759) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 14 09:10:37.403487 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.network.security_group_api [None req-80697ba7-0926-4a57-a280-0160247c710c tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Neutron security group 3d2ebfb9-22c3-4d2f-afc8-9d28d87e5d47 not found {{(pid=128759) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 14 09:10:37.404211 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-80697ba7-0926-4a57-a280-0160247c710c tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] HTTP exception thrown: Security group 3d2ebfb9-22c3-4d2f-afc8-9d28d87e5d47 does not exist Sep 14 09:10:37.404211 n-d-836830-18 devstack@n-api.service[128759]: Neutron server returns request_ids: ['req-b55ca566-9382-42f9-acd3-5e7b7ed72b74'] Sep 14 09:10:37.406379 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-80697ba7-0926-4a57-a280-0160247c710c tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Request method failure captured: Sep 14 09:10:37.406379 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/os-security-groups/3d2ebfb9-22c3-4d2f-afc8-9d28d87e5d47 HTTP/1.1 Sep 14 09:10:37.406379 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:10:37.406379 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:10:37.406379 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:10:37.406379 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:10:37.406379 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:10:37.406379 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:10:37.406379 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:10:37.406379 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:10:37.406379 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZpubEr9UgWj_j7j968HWFZ0D3vsD9X5NGBGI22hLpa671vkRnOFuLUHN5BGyBOTOD_eSiiXbv14AW_KXyWtJ-nEaHjFTRMlAQdICZGgh9e4MfCMr0iqhNEP0c19crMOXUBhQTUSoeq6F9tEyTwVcFxkCl04_QVOcf30LScxQWEOmzE Sep 14 09:10:37.406379 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:10:37.406379 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:10:37.406379 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:10:37.406379 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:10:37.406379 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:10:37.406379 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:10:37.406379 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: de0783155bf04154bf28fc70bcb7580d Sep 14 09:10:37.406379 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-SecurityGroupsTestJSON-367581750 Sep 14 09:10:37.406379 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:10:37.406379 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:10:37.406379 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/de0783155bf04154bf28fc70bcb7580d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_de0783155bf04154bf28fc70bcb7580d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/de0783155bf04154bf28fc70bcb7580d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/de0783155bf04154bf28fc70bcb7580d"}]}] Sep 14 09:10:37.406379 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-SecurityGroupsTestJSON-367581750 Sep 14 09:10:37.406379 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: de0783155bf04154bf28fc70bcb7580d Sep 14 09:10:37.406379 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-367581750 Sep 14 09:10:37.406379 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-SecurityGroupsTestJSON-367581750-project Sep 14 09:10:37.406379 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:10:37.406379 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:10:37.406379 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 2dabfdd5a6e049c48d00bc1b55a0a30f Sep 14 09:10:37.406379 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-SecurityGroupsTestJSON-367581750-project Sep 14 09:10:37.406379 n-d-836830-18 devstack@n-api.service[128759]: method: Sep 14 09:10:37.406379 n-d-836830-18 devstack@n-api.service[128759]: exception: Security group 3d2ebfb9-22c3-4d2f-afc8-9d28d87e5d47 does not exist Sep 14 09:10:37.406379 n-d-836830-18 devstack@n-api.service[128759]: Neutron server returns request_ids: ['req-b55ca566-9382-42f9-acd3-5e7b7ed72b74'] Sep 14 09:10:37.406379 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '3d2ebfb9-22c3-4d2f-afc8-9d28d87e5d47'} Sep 14 09:10:37.406379 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:10:37.406379 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:10:37.406379 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 14 09:10:37.406379 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 14 09:10:37.406379 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:10:37.406379 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:10:37.406379 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 14 09:10:37.406379 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 14 09:10:37.406379 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:10:37.406379 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:10:37.406379 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 14 09:10:37.406379 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 14 09:10:37.406379 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:10:37.406379 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:10:37.406379 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 14 09:10:37.406379 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 14 09:10:37.406379 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:10:37.406379 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:10:37.406379 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 14 09:10:37.406379 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 14 09:10:37.406379 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:10:37.406379 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:10:37.406379 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 14 09:10:37.406379 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 14 09:10:37.406379 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 14 09:10:37.406379 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 14 09:10:37.406379 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 3d2ebfb9-22c3-4d2f-afc8-9d28d87e5d47 does not exist Sep 14 09:10:37.411649 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b55ca566-9382-42f9-acd3-5e7b7ed72b74'] Sep 14 09:10:37.411649 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:10:37.411649 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:10:37.411649 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:10:37.411649 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:10:37.411649 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Sep 14 09:10:37.411649 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 14 09:10:37.411649 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 14 09:10:37.411649 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 14 09:10:37.411649 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 3d2ebfb9-22c3-4d2f-afc8-9d28d87e5d47 does not exist Sep 14 09:10:37.411649 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b55ca566-9382-42f9-acd3-5e7b7ed72b74'] Sep 14 09:10:37.411649 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:10:37.411649 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:10:37.411649 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:10:37.411649 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:10:37.411649 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:10:37.411649 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:10:37.411649 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:10:37.411649 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:10:37.411649 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:10:37.411649 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:10:37.411649 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:10:37.411649 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:10:37.411649 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Sep 14 09:10:37.411649 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 14 09:10:37.411649 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 3d2ebfb9-22c3-4d2f-afc8-9d28d87e5d47 does not exist Sep 14 09:10:37.411649 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b55ca566-9382-42f9-acd3-5e7b7ed72b74'] Sep 14 09:10:37.411649 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:10:37.411649 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:10:37.411649 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:10:37.411649 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:10:37.411649 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:10:37.411649 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:10:37.411649 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:10:37.411649 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:10:37.411649 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 3d2ebfb9-22c3-4d2f-afc8-9d28d87e5d47 does not exist Sep 14 09:10:37.411649 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b55ca566-9382-42f9-acd3-5e7b7ed72b74'] Sep 14 09:10:37.411649 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:10:37.411649 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-80697ba7-0926-4a57-a280-0160247c710c tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Returning 404 to user: Security group 3d2ebfb9-22c3-4d2f-afc8-9d28d87e5d47 does not exist Sep 14 09:10:37.411649 n-d-836830-18 devstack@n-api.service[128759]: Neutron server returns request_ids: ['req-b55ca566-9382-42f9-acd3-5e7b7ed72b74'] {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:10:37.411649 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-80697ba7-0926-4a57-a280-0160247c710c tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] 10.222.0.60 "GET /compute/v2.1/os-security-groups/3d2ebfb9-22c3-4d2f-afc8-9d28d87e5d47" status: 404 len: 194 microversion: 2.1 time: 0.041976 Sep 14 09:10:37.411649 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2279/4575] 10.222.0.60 () {58 vars in 1269 bytes} [Wed Sep 14 09:10:37 2022] GET /compute/v2.1/os-security-groups/3d2ebfb9-22c3-4d2f-afc8-9d28d87e5d47 => generated 194 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:10:37.421462 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-8d5f8222-9d0b-45e8-a505-2189bdcb8b94 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Calling method '.version_select at 0x7f7d3f311c10>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:10:37.548451 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-42904f75-a34c-4fb5-8599-895679d7a548 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:10:37.549706 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-42904f75-a34c-4fb5-8599-895679d7a548 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:10:37.561462 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-42904f75-a34c-4fb5-8599-895679d7a548 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:37.562021 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-42904f75-a34c-4fb5-8599-895679d7a548 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:37.562471 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-42904f75-a34c-4fb5-8599-895679d7a548 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:37.564840 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-42904f75-a34c-4fb5-8599-895679d7a548 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:37.565438 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-42904f75-a34c-4fb5-8599-895679d7a548 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:37.565777 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-42904f75-a34c-4fb5-8599-895679d7a548 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:37.628193 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-42904f75-a34c-4fb5-8599-895679d7a548 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5/ips" status: 200 len: 150 microversion: 2.20 time: 0.094473 Sep 14 09:10:37.638310 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2280/4576] 10.222.0.60 () {60 vars in 1289 bytes} [Wed Sep 14 09:10:37 2022] GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5/ips => generated 150 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 09:10:37.747679 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-8d5f8222-9d0b-45e8-a505-2189bdcb8b94 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] 10.222.0.60 "GET /compute/v2.1/os-security-groups" status: 200 len: 1157 microversion: 2.1 time: 0.333632 Sep 14 09:10:37.748517 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2297/4577] 10.222.0.60 () {58 vars in 1158 bytes} [Wed Sep 14 09:10:37 2022] GET /compute/v2.1/os-security-groups => generated 1157 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:10:37.767154 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a9e42d4d-28c9-4002-af9d-9dd5d349c1b4 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Action: 'create', calling method: .version_select at 0x7f7d3ee41550>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1013449298", "description": "tempest-description-2029737361"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:10:37.998727 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a9e42d4d-28c9-4002-af9d-9dd5d349c1b4 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] 10.222.0.60 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.235800 Sep 14 09:10:38.008078 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2281/4578] 10.222.0.60 () {60 vars in 1180 bytes} [Wed Sep 14 09:10:37 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:10:38.014412 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-7107bd29-ed32-4794-af5d-62800f66a23e tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Action: 'create', calling method: .version_select at 0x7f7d3f3e31f0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-213304339", "description": "tempest-description-310487724"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:10:38.121776 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b735618f-2cb2-4087-a0dc-c21ae6ac6c5f tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:10:38.122461 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b735618f-2cb2-4087-a0dc-c21ae6ac6c5f tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 0be5d897-13d0-43ef-9122-96c21dafd94c] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:10:38.138533 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b735618f-2cb2-4087-a0dc-c21ae6ac6c5f tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:38.146517 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b735618f-2cb2-4087-a0dc-c21ae6ac6c5f tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:38.147104 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b735618f-2cb2-4087-a0dc-c21ae6ac6c5f tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:38.155390 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b735618f-2cb2-4087-a0dc-c21ae6ac6c5f tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:38.156990 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b735618f-2cb2-4087-a0dc-c21ae6ac6c5f tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:38.158184 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b735618f-2cb2-4087-a0dc-c21ae6ac6c5f tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:38.276905 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-7107bd29-ed32-4794-af5d-62800f66a23e tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] 10.222.0.60 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.267526 Sep 14 09:10:38.293590 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2298/4579] 10.222.0.60 () {60 vars in 1180 bytes} [Wed Sep 14 09:10:38 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:10:38.410930 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b735618f-2cb2-4087-a0dc-c21ae6ac6c5f tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:10:38.419801 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b735618f-2cb2-4087-a0dc-c21ae6ac6c5f tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/0be5d897-13d0-43ef-9122-96c21dafd94c" status: 200 len: 1510 microversion: 2.1 time: 0.302819 Sep 14 09:10:38.435811 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2282/4580] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:10:38 2022] GET /compute/v2.1/servers/0be5d897-13d0-43ef-9122-96c21dafd94c => generated 1510 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:10:38.467798 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-892f80a2-bb70-40d1-a24e-519151f6fa24 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1432043003", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "networks": [{"uuid": "2af9a6d1-9a21-4625-a5d3-57e4d554ab16"}]}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:10:38.561922 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.network.neutron [None req-892f80a2-bb70-40d1-a24e-519151f6fa24 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] validate_networks() for [('2af9a6d1-9a21-4625-a5d3-57e4d554ab16', None, None, None, None, None)] {{(pid=128758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:10:39.444062 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-892f80a2-bb70-40d1-a24e-519151f6fa24 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Flavor limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:10:39.444740 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-892f80a2-bb70-40d1-a24e-519151f6fa24 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Image limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:10:39.445812 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-892f80a2-bb70-40d1-a24e-519151f6fa24 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Flavor pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:10:39.446260 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-892f80a2-bb70-40d1-a24e-519151f6fa24 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Image pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:10:39.446722 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-892f80a2-bb70-40d1-a24e-519151f6fa24 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:10:39.447898 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8820f3c9-ba53-44f3-b270-1579947d64a1 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:10:39.448700 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-8820f3c9-ba53-44f3-b270-1579947d64a1 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 0be5d897-13d0-43ef-9122-96c21dafd94c] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:10:39.462027 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8820f3c9-ba53-44f3-b270-1579947d64a1 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:39.466774 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8820f3c9-ba53-44f3-b270-1579947d64a1 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:39.467445 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8820f3c9-ba53-44f3-b270-1579947d64a1 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:39.468364 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8820f3c9-ba53-44f3-b270-1579947d64a1 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:39.469235 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8820f3c9-ba53-44f3-b270-1579947d64a1 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:39.469857 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8820f3c9-ba53-44f3-b270-1579947d64a1 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:39.471871 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-892f80a2-bb70-40d1-a24e-519151f6fa24 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:39.475354 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-892f80a2-bb70-40d1-a24e-519151f6fa24 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:39.475836 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-892f80a2-bb70-40d1-a24e-519151f6fa24 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:39.478823 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-892f80a2-bb70-40d1-a24e-519151f6fa24 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:39.481267 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-892f80a2-bb70-40d1-a24e-519151f6fa24 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:39.482706 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-892f80a2-bb70-40d1-a24e-519151f6fa24 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:39.538424 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-892f80a2-bb70-40d1-a24e-519151f6fa24 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Getting quotas for project de0783155bf04154bf28fc70bcb7580d. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:10:39.583176 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-892f80a2-bb70-40d1-a24e-519151f6fa24 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Getting quotas for user 2dabfdd5a6e049c48d00bc1b55a0a30f and project de0783155bf04154bf28fc70bcb7580d. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:10:39.601035 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-892f80a2-bb70-40d1-a24e-519151f6fa24 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Going to run 1 instances... {{(pid=128758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:10:39.630904 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-892f80a2-bb70-40d1-a24e-519151f6fa24 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] [instance: e6f9d068-5708-4f4d-b9fe-ab03179ed31e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:10:39.747132 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-892f80a2-bb70-40d1-a24e-519151f6fa24 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.285977 Sep 14 09:10:39.751235 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2299/4581] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 09:10:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1290 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 14 09:10:39.764681 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-91c5b68f-cc3c-4994-a0a5-410b5dffa252 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:10:39.765333 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-91c5b68f-cc3c-4994-a0a5-410b5dffa252 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] [instance: e6f9d068-5708-4f4d-b9fe-ab03179ed31e] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:10:39.867038 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-8820f3c9-ba53-44f3-b270-1579947d64a1 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:10:39.886243 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-91c5b68f-cc3c-4994-a0a5-410b5dffa252 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dabfdd5a6e049c48d00bc1b55a0a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0783155bf04154bf28fc70bcb7580d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:10:39.892441 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-8820f3c9-ba53-44f3-b270-1579947d64a1 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/0be5d897-13d0-43ef-9122-96c21dafd94c" status: 200 len: 1510 microversion: 2.1 time: 0.443822 Sep 14 09:10:39.893857 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-91c5b68f-cc3c-4994-a0a5-410b5dffa252 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] 10.222.0.60 "GET /compute/v2.1/servers/e6f9d068-5708-4f4d-b9fe-ab03179ed31e" status: 200 len: 1216 microversion: 2.1 time: 0.136839 Sep 14 09:10:39.895795 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2300/4582] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:10:39 2022] GET /compute/v2.1/servers/e6f9d068-5708-4f4d-b9fe-ab03179ed31e => generated 1216 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:10:39.895983 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2283/4583] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:10:39 2022] GET /compute/v2.1/servers/0be5d897-13d0-43ef-9122-96c21dafd94c => generated 1510 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:10:40.922288 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-8000737a-e54f-4037-824f-494e40c19136 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:10:40.923143 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-55cd60c0-6a4c-421e-8ed3-bde104b4a51d tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:10:40.923566 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-8000737a-e54f-4037-824f-494e40c19136 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 0be5d897-13d0-43ef-9122-96c21dafd94c] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:10:40.924483 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-55cd60c0-6a4c-421e-8ed3-bde104b4a51d tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] [instance: e6f9d068-5708-4f4d-b9fe-ab03179ed31e] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:10:40.932856 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-55cd60c0-6a4c-421e-8ed3-bde104b4a51d tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:40.934886 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-55cd60c0-6a4c-421e-8ed3-bde104b4a51d tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:40.935757 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-55cd60c0-6a4c-421e-8ed3-bde104b4a51d tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:40.937071 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8000737a-e54f-4037-824f-494e40c19136 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:40.937824 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8000737a-e54f-4037-824f-494e40c19136 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:40.938353 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-55cd60c0-6a4c-421e-8ed3-bde104b4a51d tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:40.938484 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8000737a-e54f-4037-824f-494e40c19136 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:40.940011 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-55cd60c0-6a4c-421e-8ed3-bde104b4a51d tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:40.940652 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8000737a-e54f-4037-824f-494e40c19136 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:40.940979 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-55cd60c0-6a4c-421e-8ed3-bde104b4a51d tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:40.941734 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8000737a-e54f-4037-824f-494e40c19136 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:40.943069 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8000737a-e54f-4037-824f-494e40c19136 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:41.586613 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-55cd60c0-6a4c-421e-8ed3-bde104b4a51d tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dabfdd5a6e049c48d00bc1b55a0a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0783155bf04154bf28fc70bcb7580d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:10:41.603878 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-55cd60c0-6a4c-421e-8ed3-bde104b4a51d tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] 10.222.0.60 "GET /compute/v2.1/servers/e6f9d068-5708-4f4d-b9fe-ab03179ed31e" status: 200 len: 1212 microversion: 2.1 time: 0.685831 Sep 14 09:10:41.604464 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2284/4584] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:10:40 2022] GET /compute/v2.1/servers/e6f9d068-5708-4f4d-b9fe-ab03179ed31e => generated 1212 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:10:41.609750 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-22e6dac0-91e3-4d0a-9116-0105f2e202ea tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:10:41.611045 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-22e6dac0-91e3-4d0a-9116-0105f2e202ea tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:10:41.617629 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-22e6dac0-91e3-4d0a-9116-0105f2e202ea tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:41.618299 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-22e6dac0-91e3-4d0a-9116-0105f2e202ea tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:41.618905 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-22e6dac0-91e3-4d0a-9116-0105f2e202ea tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:41.622430 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-22e6dac0-91e3-4d0a-9116-0105f2e202ea tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:41.623143 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-22e6dac0-91e3-4d0a-9116-0105f2e202ea tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:41.624075 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-22e6dac0-91e3-4d0a-9116-0105f2e202ea tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:41.717509 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.objects.instance [None req-22e6dac0-91e3-4d0a-9116-0105f2e202ea tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lazy-loading 'flavor' on Instance uuid 4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5 {{(pid=128759) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:10:41.777838 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-8000737a-e54f-4037-824f-494e40c19136 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:10:41.796396 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-8000737a-e54f-4037-824f-494e40c19136 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/0be5d897-13d0-43ef-9122-96c21dafd94c" status: 200 len: 1510 microversion: 2.1 time: 0.878763 Sep 14 09:10:41.798708 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2301/4585] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:10:40 2022] GET /compute/v2.1/servers/0be5d897-13d0-43ef-9122-96c21dafd94c => generated 1510 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:10:42.078462 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-22e6dac0-91e3-4d0a-9116-0105f2e202ea tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "POST /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5/action" status: 202 len: 0 microversion: 2.20 time: 0.472570 Sep 14 09:10:42.090728 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-72b2d887-3e8f-4f80-912e-b997036a6fce tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:10:42.092368 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-72b2d887-3e8f-4f80-912e-b997036a6fce tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:10:42.092940 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2285/4586] 10.222.0.60 () {62 vars in 1319 bytes} [Wed Sep 14 09:10:41 2022] POST /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5/action => generated 0 bytes in 486 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:10:42.110803 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-72b2d887-3e8f-4f80-912e-b997036a6fce tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:42.112883 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-72b2d887-3e8f-4f80-912e-b997036a6fce tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:42.114626 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-72b2d887-3e8f-4f80-912e-b997036a6fce tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:42.118645 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-72b2d887-3e8f-4f80-912e-b997036a6fce tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:42.119186 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-72b2d887-3e8f-4f80-912e-b997036a6fce tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:42.122816 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-72b2d887-3e8f-4f80-912e-b997036a6fce tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:42.457851 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-72b2d887-3e8f-4f80-912e-b997036a6fce tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:10:42.472678 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-72b2d887-3e8f-4f80-912e-b997036a6fce tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:10:42.482285 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-72b2d887-3e8f-4f80-912e-b997036a6fce tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:10:42.483651 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-72b2d887-3e8f-4f80-912e-b997036a6fce tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5" status: 200 len: 1722 microversion: 2.20 time: 0.399855 Sep 14 09:10:42.484271 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2302/4587] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:10:42 2022] GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5 => generated 1722 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 09:10:42.628817 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-0a88a03e-6348-4fc0-824a-57f6b4c59431 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:10:42.629461 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-0a88a03e-6348-4fc0-824a-57f6b4c59431 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] [instance: e6f9d068-5708-4f4d-b9fe-ab03179ed31e] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:10:42.641548 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0a88a03e-6348-4fc0-824a-57f6b4c59431 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:42.642058 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0a88a03e-6348-4fc0-824a-57f6b4c59431 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:42.647034 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0a88a03e-6348-4fc0-824a-57f6b4c59431 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:42.650660 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0a88a03e-6348-4fc0-824a-57f6b4c59431 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:42.651193 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0a88a03e-6348-4fc0-824a-57f6b4c59431 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:42.651644 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0a88a03e-6348-4fc0-824a-57f6b4c59431 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:42.778098 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-0a88a03e-6348-4fc0-824a-57f6b4c59431 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dabfdd5a6e049c48d00bc1b55a0a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0783155bf04154bf28fc70bcb7580d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:10:42.788828 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-0a88a03e-6348-4fc0-824a-57f6b4c59431 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] 10.222.0.60 "GET /compute/v2.1/servers/e6f9d068-5708-4f4d-b9fe-ab03179ed31e" status: 200 len: 1274 microversion: 2.1 time: 0.163647 Sep 14 09:10:42.790254 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2286/4588] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:10:42 2022] GET /compute/v2.1/servers/e6f9d068-5708-4f4d-b9fe-ab03179ed31e => generated 1274 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:10:42.828977 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d86ee533-f0db-41fa-8280-42ef2acc1abc tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:10:42.830044 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-d86ee533-f0db-41fa-8280-42ef2acc1abc tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 0be5d897-13d0-43ef-9122-96c21dafd94c] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:10:42.838271 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d86ee533-f0db-41fa-8280-42ef2acc1abc tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:42.839099 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d86ee533-f0db-41fa-8280-42ef2acc1abc tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:42.839702 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d86ee533-f0db-41fa-8280-42ef2acc1abc tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:42.840604 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d86ee533-f0db-41fa-8280-42ef2acc1abc tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:42.841366 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d86ee533-f0db-41fa-8280-42ef2acc1abc tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:42.841952 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d86ee533-f0db-41fa-8280-42ef2acc1abc tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:43.099767 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-d86ee533-f0db-41fa-8280-42ef2acc1abc tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:10:43.109633 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-d86ee533-f0db-41fa-8280-42ef2acc1abc tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/0be5d897-13d0-43ef-9122-96c21dafd94c" status: 200 len: 1510 microversion: 2.1 time: 0.284843 Sep 14 09:10:43.111956 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2303/4589] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:10:42 2022] GET /compute/v2.1/servers/0be5d897-13d0-43ef-9122-96c21dafd94c => generated 1510 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:10:43.520048 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-561744cf-1f8f-4bea-964c-b3a8299f3fca tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:10:43.524897 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-561744cf-1f8f-4bea-964c-b3a8299f3fca tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:10:43.541004 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-561744cf-1f8f-4bea-964c-b3a8299f3fca tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:43.554387 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-561744cf-1f8f-4bea-964c-b3a8299f3fca tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:43.555456 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-561744cf-1f8f-4bea-964c-b3a8299f3fca tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:43.556655 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-561744cf-1f8f-4bea-964c-b3a8299f3fca tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:43.557356 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-561744cf-1f8f-4bea-964c-b3a8299f3fca tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:43.558092 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-561744cf-1f8f-4bea-964c-b3a8299f3fca tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:43.814757 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-3bf4b72b-f549-4625-9b15-454c15301a8a tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:10:43.816747 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-3bf4b72b-f549-4625-9b15-454c15301a8a tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] [instance: e6f9d068-5708-4f4d-b9fe-ab03179ed31e] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:10:43.829768 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:10:43.833613 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3bf4b72b-f549-4625-9b15-454c15301a8a tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:43.859897 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3bf4b72b-f549-4625-9b15-454c15301a8a tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:43.860936 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3bf4b72b-f549-4625-9b15-454c15301a8a tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:43.861667 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3bf4b72b-f549-4625-9b15-454c15301a8a tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:43.862137 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3bf4b72b-f549-4625-9b15-454c15301a8a tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:43.862576 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3bf4b72b-f549-4625-9b15-454c15301a8a tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:43.977788 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-561744cf-1f8f-4bea-964c-b3a8299f3fca tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:10:43.991311 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-561744cf-1f8f-4bea-964c-b3a8299f3fca tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:10:43.993035 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-561744cf-1f8f-4bea-964c-b3a8299f3fca tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:10:43.994246 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-561744cf-1f8f-4bea-964c-b3a8299f3fca tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5" status: 200 len: 1722 microversion: 2.20 time: 0.482747 Sep 14 09:10:44.004078 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2287/4590] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:10:43 2022] GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5 => generated 1722 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:10:44.134285 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-7b24b560-5be3-44de-9080-2eeb87c85be3 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:10:44.135265 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-7b24b560-5be3-44de-9080-2eeb87c85be3 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 0be5d897-13d0-43ef-9122-96c21dafd94c] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:10:44.141775 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-3bf4b72b-f549-4625-9b15-454c15301a8a tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dabfdd5a6e049c48d00bc1b55a0a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0783155bf04154bf28fc70bcb7580d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:10:44.147357 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7b24b560-5be3-44de-9080-2eeb87c85be3 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:44.150377 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7b24b560-5be3-44de-9080-2eeb87c85be3 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:44.151229 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7b24b560-5be3-44de-9080-2eeb87c85be3 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:44.151382 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-3bf4b72b-f549-4625-9b15-454c15301a8a tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] 10.222.0.60 "GET /compute/v2.1/servers/e6f9d068-5708-4f4d-b9fe-ab03179ed31e" status: 200 len: 1316 microversion: 2.1 time: 0.341398 Sep 14 09:10:44.153960 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7b24b560-5be3-44de-9080-2eeb87c85be3 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:44.155769 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7b24b560-5be3-44de-9080-2eeb87c85be3 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:44.158330 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7b24b560-5be3-44de-9080-2eeb87c85be3 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:44.167232 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2304/4591] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:10:43 2022] GET /compute/v2.1/servers/e6f9d068-5708-4f4d-b9fe-ab03179ed31e => generated 1316 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:10:44.377077 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-7b24b560-5be3-44de-9080-2eeb87c85be3 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:10:44.388641 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-7b24b560-5be3-44de-9080-2eeb87c85be3 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/0be5d897-13d0-43ef-9122-96c21dafd94c" status: 200 len: 1510 microversion: 2.1 time: 0.255765 Sep 14 09:10:44.389304 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2288/4592] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:10:44 2022] GET /compute/v2.1/servers/0be5d897-13d0-43ef-9122-96c21dafd94c => generated 1510 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:10:44.901140 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-3fb2a1dc-a32c-4194-8be6-694f9643ac5f req-76e11a22-e5bd-4029-9fb3-7d1420a5dd45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6f9d068-5708-4f4d-b9fe-ab03179ed31e", "tag": "ceedee83-069d-49a0-9a90-87bb7bfc25be"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:10:44.934977 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-3fb2a1dc-a32c-4194-8be6-694f9643ac5f req-76e11a22-e5bd-4029-9fb3-7d1420a5dd45 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:44.935946 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-3fb2a1dc-a32c-4194-8be6-694f9643ac5f req-76e11a22-e5bd-4029-9fb3-7d1420a5dd45 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:44.939486 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-3fb2a1dc-a32c-4194-8be6-694f9643ac5f req-76e11a22-e5bd-4029-9fb3-7d1420a5dd45 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:44.960018 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-3fb2a1dc-a32c-4194-8be6-694f9643ac5f req-76e11a22-e5bd-4029-9fb3-7d1420a5dd45 service nova] Creating event network-changed:ceedee83-069d-49a0-9a90-87bb7bfc25be for instance e6f9d068-5708-4f4d-b9fe-ab03179ed31e on n-h1-836830-18 Sep 14 09:10:44.967860 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-3fb2a1dc-a32c-4194-8be6-694f9643ac5f req-76e11a22-e5bd-4029-9fb3-7d1420a5dd45 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070294 Sep 14 09:10:44.970073 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2305/4593] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:10:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:10:45.026848 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9e651029-d6e1-4074-a8ca-b97b132652f9 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:10:45.028589 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-9e651029-d6e1-4074-a8ca-b97b132652f9 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:10:45.038516 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=62 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:10:45.040969 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9e651029-d6e1-4074-a8ca-b97b132652f9 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:45.041752 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9e651029-d6e1-4074-a8ca-b97b132652f9 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:45.042453 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9e651029-d6e1-4074-a8ca-b97b132652f9 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:45.043566 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9e651029-d6e1-4074-a8ca-b97b132652f9 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:45.044450 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9e651029-d6e1-4074-a8ca-b97b132652f9 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:45.045086 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9e651029-d6e1-4074-a8ca-b97b132652f9 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:45.176014 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-809ad618-f951-4fb1-88df-cbcbbac1fb34 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:10:45.177324 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-809ad618-f951-4fb1-88df-cbcbbac1fb34 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] [instance: e6f9d068-5708-4f4d-b9fe-ab03179ed31e] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:10:45.191717 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-809ad618-f951-4fb1-88df-cbcbbac1fb34 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:45.194117 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-809ad618-f951-4fb1-88df-cbcbbac1fb34 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:45.194780 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-809ad618-f951-4fb1-88df-cbcbbac1fb34 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:45.197364 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-809ad618-f951-4fb1-88df-cbcbbac1fb34 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:45.198016 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-809ad618-f951-4fb1-88df-cbcbbac1fb34 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:45.198651 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-809ad618-f951-4fb1-88df-cbcbbac1fb34 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:45.321673 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-9e651029-d6e1-4074-a8ca-b97b132652f9 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:10:45.335944 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-9e651029-d6e1-4074-a8ca-b97b132652f9 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:10:45.338783 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-9e651029-d6e1-4074-a8ca-b97b132652f9 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:10:45.340501 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-9e651029-d6e1-4074-a8ca-b97b132652f9 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5" status: 200 len: 1722 microversion: 2.20 time: 0.319682 Sep 14 09:10:45.341455 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2289/4594] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:10:45 2022] GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5 => generated 1722 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:10:45.412227 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-67650a4f-926e-407b-ae80-7bc2c6fa3632 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:10:45.413165 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-67650a4f-926e-407b-ae80-7bc2c6fa3632 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 0be5d897-13d0-43ef-9122-96c21dafd94c] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:10:45.422295 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-67650a4f-926e-407b-ae80-7bc2c6fa3632 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:45.425693 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-67650a4f-926e-407b-ae80-7bc2c6fa3632 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:45.426806 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-67650a4f-926e-407b-ae80-7bc2c6fa3632 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:45.429630 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-67650a4f-926e-407b-ae80-7bc2c6fa3632 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:45.430299 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-67650a4f-926e-407b-ae80-7bc2c6fa3632 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:45.432346 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-67650a4f-926e-407b-ae80-7bc2c6fa3632 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:45.480208 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-809ad618-f951-4fb1-88df-cbcbbac1fb34 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dabfdd5a6e049c48d00bc1b55a0a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0783155bf04154bf28fc70bcb7580d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:10:45.505392 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-809ad618-f951-4fb1-88df-cbcbbac1fb34 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] 10.222.0.60 "GET /compute/v2.1/servers/e6f9d068-5708-4f4d-b9fe-ab03179ed31e" status: 200 len: 1316 microversion: 2.1 time: 0.334200 Sep 14 09:10:45.511010 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2306/4595] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:10:45 2022] GET /compute/v2.1/servers/e6f9d068-5708-4f4d-b9fe-ab03179ed31e => generated 1316 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:10:45.889292 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-67650a4f-926e-407b-ae80-7bc2c6fa3632 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:10:45.904921 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-67650a4f-926e-407b-ae80-7bc2c6fa3632 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/0be5d897-13d0-43ef-9122-96c21dafd94c" status: 200 len: 1510 microversion: 2.1 time: 0.496554 Sep 14 09:10:45.905763 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2290/4596] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:10:45 2022] GET /compute/v2.1/servers/0be5d897-13d0-43ef-9122-96c21dafd94c => generated 1510 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:10:45.929699 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1c43d7e1-b66f-46db-8e70-5c9f9c9f3342 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2005243573 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2005243573-project-admin] Calling method '.version_select at 0x7f7d3f37a940>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:10:45.932590 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1c43d7e1-b66f-46db-8e70-5c9f9c9f3342 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2005243573 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2005243573-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:45.933091 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1c43d7e1-b66f-46db-8e70-5c9f9c9f3342 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2005243573 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2005243573-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:45.933535 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1c43d7e1-b66f-46db-8e70-5c9f9c9f3342 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2005243573 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2005243573-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:45.957692 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1c43d7e1-b66f-46db-8e70-5c9f9c9f3342 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2005243573 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2005243573-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:45.958045 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1c43d7e1-b66f-46db-8e70-5c9f9c9f3342 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2005243573 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2005243573-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:45.958489 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1c43d7e1-b66f-46db-8e70-5c9f9c9f3342 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2005243573 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2005243573-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:45.974444 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1c43d7e1-b66f-46db-8e70-5c9f9c9f3342 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2005243573 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2005243573-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:45.974983 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1c43d7e1-b66f-46db-8e70-5c9f9c9f3342 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2005243573 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2005243573-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:45.975541 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1c43d7e1-b66f-46db-8e70-5c9f9c9f3342 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2005243573 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2005243573-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:45.994529 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=100 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:10:45.997337 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-1c43d7e1-b66f-46db-8e70-5c9f9c9f3342 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2005243573 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2005243573-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.397245 Sep 14 09:10:45.999902 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2307/4597] 10.222.0.60 () {58 vars in 1146 bytes} [Wed Sep 14 09:10:45 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:10:46.370660 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f54d84a6-6279-4e7f-94a8-fad00f2b9285 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:10:46.371339 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f54d84a6-6279-4e7f-94a8-fad00f2b9285 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:10:46.389794 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f54d84a6-6279-4e7f-94a8-fad00f2b9285 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:46.393988 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f54d84a6-6279-4e7f-94a8-fad00f2b9285 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:46.397779 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f54d84a6-6279-4e7f-94a8-fad00f2b9285 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:46.398891 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f54d84a6-6279-4e7f-94a8-fad00f2b9285 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:46.399396 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f54d84a6-6279-4e7f-94a8-fad00f2b9285 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:46.399838 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f54d84a6-6279-4e7f-94a8-fad00f2b9285 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:46.446033 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:10:46.538911 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-11b4bc90-c406-4713-936d-673eaf912249 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:10:46.539917 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-11b4bc90-c406-4713-936d-673eaf912249 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] [instance: e6f9d068-5708-4f4d-b9fe-ab03179ed31e] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:10:46.578995 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-11b4bc90-c406-4713-936d-673eaf912249 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:46.582133 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-11b4bc90-c406-4713-936d-673eaf912249 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:46.582599 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-11b4bc90-c406-4713-936d-673eaf912249 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:46.583428 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-11b4bc90-c406-4713-936d-673eaf912249 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:46.587394 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-11b4bc90-c406-4713-936d-673eaf912249 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:46.588076 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-11b4bc90-c406-4713-936d-673eaf912249 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:46.638386 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f54d84a6-6279-4e7f-94a8-fad00f2b9285 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:10:46.648906 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f54d84a6-6279-4e7f-94a8-fad00f2b9285 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:10:46.652495 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f54d84a6-6279-4e7f-94a8-fad00f2b9285 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:10:46.653716 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f54d84a6-6279-4e7f-94a8-fad00f2b9285 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5" status: 200 len: 1722 microversion: 2.20 time: 0.287454 Sep 14 09:10:46.677866 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2291/4598] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:10:46 2022] GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5 => generated 1722 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:10:46.834285 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-11b4bc90-c406-4713-936d-673eaf912249 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dabfdd5a6e049c48d00bc1b55a0a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0783155bf04154bf28fc70bcb7580d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:10:46.844900 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-11b4bc90-c406-4713-936d-673eaf912249 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] 10.222.0.60 "GET /compute/v2.1/servers/e6f9d068-5708-4f4d-b9fe-ab03179ed31e" status: 200 len: 1316 microversion: 2.1 time: 0.311321 Sep 14 09:10:46.861866 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2308/4599] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:10:46 2022] GET /compute/v2.1/servers/e6f9d068-5708-4f4d-b9fe-ab03179ed31e => generated 1316 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:10:46.930223 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d69344ee-df3d-4999-8dd5-309ab9714b61 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:10:46.930894 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-d69344ee-df3d-4999-8dd5-309ab9714b61 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 0be5d897-13d0-43ef-9122-96c21dafd94c] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:10:46.940648 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d69344ee-df3d-4999-8dd5-309ab9714b61 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:46.942858 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d69344ee-df3d-4999-8dd5-309ab9714b61 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:46.946523 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d69344ee-df3d-4999-8dd5-309ab9714b61 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:46.947730 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d69344ee-df3d-4999-8dd5-309ab9714b61 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:46.948402 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d69344ee-df3d-4999-8dd5-309ab9714b61 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:46.949015 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d69344ee-df3d-4999-8dd5-309ab9714b61 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:47.218362 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-d69344ee-df3d-4999-8dd5-309ab9714b61 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:10:47.240600 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d69344ee-df3d-4999-8dd5-309ab9714b61 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/0be5d897-13d0-43ef-9122-96c21dafd94c" status: 200 len: 1510 microversion: 2.1 time: 0.314507 Sep 14 09:10:47.241221 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2292/4600] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:10:46 2022] GET /compute/v2.1/servers/0be5d897-13d0-43ef-9122-96c21dafd94c => generated 1510 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:10:47.685703 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-3f15ae86-6819-42c0-b966-b95952705e76 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:10:47.687268 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-3f15ae86-6819-42c0-b966-b95952705e76 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:10:47.705010 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3f15ae86-6819-42c0-b966-b95952705e76 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:47.705511 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3f15ae86-6819-42c0-b966-b95952705e76 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:47.716884 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3f15ae86-6819-42c0-b966-b95952705e76 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:47.717661 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3f15ae86-6819-42c0-b966-b95952705e76 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:47.720873 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3f15ae86-6819-42c0-b966-b95952705e76 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:47.721327 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3f15ae86-6819-42c0-b966-b95952705e76 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:47.871057 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-facc9614-c14e-4ecb-a26b-e72f25dd9b46 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:10:47.871698 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-facc9614-c14e-4ecb-a26b-e72f25dd9b46 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] [instance: e6f9d068-5708-4f4d-b9fe-ab03179ed31e] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:10:47.879924 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-facc9614-c14e-4ecb-a26b-e72f25dd9b46 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:47.880422 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-facc9614-c14e-4ecb-a26b-e72f25dd9b46 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:47.887836 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-facc9614-c14e-4ecb-a26b-e72f25dd9b46 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:47.893965 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-facc9614-c14e-4ecb-a26b-e72f25dd9b46 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:47.894765 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-facc9614-c14e-4ecb-a26b-e72f25dd9b46 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:47.895252 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-facc9614-c14e-4ecb-a26b-e72f25dd9b46 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:48.011815 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-3f15ae86-6819-42c0-b966-b95952705e76 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:10:48.024679 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-3f15ae86-6819-42c0-b966-b95952705e76 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:10:48.026262 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-3f15ae86-6819-42c0-b966-b95952705e76 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:10:48.028323 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-3f15ae86-6819-42c0-b966-b95952705e76 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5" status: 200 len: 1722 microversion: 2.20 time: 0.346907 Sep 14 09:10:48.029724 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2309/4601] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:10:47 2022] GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5 => generated 1722 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:10:48.180326 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-facc9614-c14e-4ecb-a26b-e72f25dd9b46 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dabfdd5a6e049c48d00bc1b55a0a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0783155bf04154bf28fc70bcb7580d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:10:48.195795 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-facc9614-c14e-4ecb-a26b-e72f25dd9b46 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] 10.222.0.60 "GET /compute/v2.1/servers/e6f9d068-5708-4f4d-b9fe-ab03179ed31e" status: 200 len: 1316 microversion: 2.1 time: 0.325678 Sep 14 09:10:48.196717 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2293/4602] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:10:47 2022] GET /compute/v2.1/servers/e6f9d068-5708-4f4d-b9fe-ab03179ed31e => generated 1316 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:10:48.269359 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-937565f9-1f47-41cb-8937-2bfc9a6e47fd tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:10:48.270291 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-937565f9-1f47-41cb-8937-2bfc9a6e47fd tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 0be5d897-13d0-43ef-9122-96c21dafd94c] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:10:48.278704 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-937565f9-1f47-41cb-8937-2bfc9a6e47fd tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:48.279250 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-937565f9-1f47-41cb-8937-2bfc9a6e47fd tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:48.279911 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-937565f9-1f47-41cb-8937-2bfc9a6e47fd tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:48.280712 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-937565f9-1f47-41cb-8937-2bfc9a6e47fd tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:48.281185 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-937565f9-1f47-41cb-8937-2bfc9a6e47fd tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:48.281619 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-937565f9-1f47-41cb-8937-2bfc9a6e47fd tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:48.870280 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-937565f9-1f47-41cb-8937-2bfc9a6e47fd tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:10:48.882640 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-937565f9-1f47-41cb-8937-2bfc9a6e47fd tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/0be5d897-13d0-43ef-9122-96c21dafd94c" status: 200 len: 1510 microversion: 2.1 time: 0.618932 Sep 14 09:10:48.883386 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2310/4603] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:10:48 2022] GET /compute/v2.1/servers/0be5d897-13d0-43ef-9122-96c21dafd94c => generated 1510 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:10:49.057727 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f3e52ed0-82a6-4c32-9b8f-43c0ce7e5829 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:10:49.059146 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f3e52ed0-82a6-4c32-9b8f-43c0ce7e5829 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:10:49.072733 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f3e52ed0-82a6-4c32-9b8f-43c0ce7e5829 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:49.073440 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f3e52ed0-82a6-4c32-9b8f-43c0ce7e5829 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:49.074606 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f3e52ed0-82a6-4c32-9b8f-43c0ce7e5829 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:49.075561 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f3e52ed0-82a6-4c32-9b8f-43c0ce7e5829 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:49.077103 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f3e52ed0-82a6-4c32-9b8f-43c0ce7e5829 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:49.077788 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f3e52ed0-82a6-4c32-9b8f-43c0ce7e5829 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:49.224272 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b8c481c3-27b4-41b8-a1c2-cb3740c05be2 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:10:49.225961 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-b8c481c3-27b4-41b8-a1c2-cb3740c05be2 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] [instance: e6f9d068-5708-4f4d-b9fe-ab03179ed31e] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:10:49.236373 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b8c481c3-27b4-41b8-a1c2-cb3740c05be2 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:49.244667 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b8c481c3-27b4-41b8-a1c2-cb3740c05be2 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:49.246398 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b8c481c3-27b4-41b8-a1c2-cb3740c05be2 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:49.247747 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b8c481c3-27b4-41b8-a1c2-cb3740c05be2 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:49.249585 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b8c481c3-27b4-41b8-a1c2-cb3740c05be2 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:49.252638 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b8c481c3-27b4-41b8-a1c2-cb3740c05be2 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:49.326872 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f3e52ed0-82a6-4c32-9b8f-43c0ce7e5829 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:10:49.341727 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f3e52ed0-82a6-4c32-9b8f-43c0ce7e5829 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:10:49.347911 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f3e52ed0-82a6-4c32-9b8f-43c0ce7e5829 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:10:49.351977 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f3e52ed0-82a6-4c32-9b8f-43c0ce7e5829 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5" status: 200 len: 1722 microversion: 2.20 time: 0.296356 Sep 14 09:10:49.353715 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2294/4604] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:10:49 2022] GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5 => generated 1722 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:10:49.474323 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-b8c481c3-27b4-41b8-a1c2-cb3740c05be2 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dabfdd5a6e049c48d00bc1b55a0a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0783155bf04154bf28fc70bcb7580d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:10:49.485248 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-b8c481c3-27b4-41b8-a1c2-cb3740c05be2 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] 10.222.0.60 "GET /compute/v2.1/servers/e6f9d068-5708-4f4d-b9fe-ab03179ed31e" status: 200 len: 1316 microversion: 2.1 time: 0.266479 Sep 14 09:10:49.502618 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2311/4605] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:10:49 2022] GET /compute/v2.1/servers/e6f9d068-5708-4f4d-b9fe-ab03179ed31e => generated 1316 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:10:49.909821 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-64552c06-6c7c-458e-ba0f-da6156f83e30 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:10:49.910605 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-64552c06-6c7c-458e-ba0f-da6156f83e30 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 0be5d897-13d0-43ef-9122-96c21dafd94c] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:10:49.923491 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-64552c06-6c7c-458e-ba0f-da6156f83e30 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:49.924019 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-64552c06-6c7c-458e-ba0f-da6156f83e30 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:49.924467 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-64552c06-6c7c-458e-ba0f-da6156f83e30 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:49.925377 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-64552c06-6c7c-458e-ba0f-da6156f83e30 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:49.925956 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-64552c06-6c7c-458e-ba0f-da6156f83e30 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:49.927108 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-64552c06-6c7c-458e-ba0f-da6156f83e30 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:50.141743 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-64552c06-6c7c-458e-ba0f-da6156f83e30 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:10:50.172619 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-64552c06-6c7c-458e-ba0f-da6156f83e30 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/0be5d897-13d0-43ef-9122-96c21dafd94c" status: 200 len: 1510 microversion: 2.1 time: 0.267296 Sep 14 09:10:50.206535 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2295/4606] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:10:49 2022] GET /compute/v2.1/servers/0be5d897-13d0-43ef-9122-96c21dafd94c => generated 1510 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:10:50.378925 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a214bc01-35f1-4180-8def-eafcb2ca12b9 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:10:50.379552 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-a214bc01-35f1-4180-8def-eafcb2ca12b9 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:10:50.383003 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=2 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:10:50.384697 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=8 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:10:50.393231 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a214bc01-35f1-4180-8def-eafcb2ca12b9 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:50.393730 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a214bc01-35f1-4180-8def-eafcb2ca12b9 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:50.394161 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a214bc01-35f1-4180-8def-eafcb2ca12b9 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:50.395089 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a214bc01-35f1-4180-8def-eafcb2ca12b9 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:50.395701 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a214bc01-35f1-4180-8def-eafcb2ca12b9 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:50.396284 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a214bc01-35f1-4180-8def-eafcb2ca12b9 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:50.513967 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9145489c-68c0-40a9-9b83-19b3f8fd0e7e tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:10:50.515393 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-9145489c-68c0-40a9-9b83-19b3f8fd0e7e tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] [instance: e6f9d068-5708-4f4d-b9fe-ab03179ed31e] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:10:50.529211 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9145489c-68c0-40a9-9b83-19b3f8fd0e7e tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:50.532033 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9145489c-68c0-40a9-9b83-19b3f8fd0e7e tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:50.533909 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9145489c-68c0-40a9-9b83-19b3f8fd0e7e tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:50.534666 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9145489c-68c0-40a9-9b83-19b3f8fd0e7e tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:50.536761 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9145489c-68c0-40a9-9b83-19b3f8fd0e7e tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:50.538208 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9145489c-68c0-40a9-9b83-19b3f8fd0e7e tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:50.670129 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-a214bc01-35f1-4180-8def-eafcb2ca12b9 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:10:50.683617 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-a214bc01-35f1-4180-8def-eafcb2ca12b9 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:10:50.693222 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-a214bc01-35f1-4180-8def-eafcb2ca12b9 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:10:50.694715 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-a214bc01-35f1-4180-8def-eafcb2ca12b9 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5" status: 200 len: 1722 microversion: 2.20 time: 0.320366 Sep 14 09:10:50.695856 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2312/4607] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:10:50 2022] GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5 => generated 1722 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:10:50.791434 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-9145489c-68c0-40a9-9b83-19b3f8fd0e7e tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dabfdd5a6e049c48d00bc1b55a0a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0783155bf04154bf28fc70bcb7580d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:10:50.804834 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-9145489c-68c0-40a9-9b83-19b3f8fd0e7e tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] 10.222.0.60 "GET /compute/v2.1/servers/e6f9d068-5708-4f4d-b9fe-ab03179ed31e" status: 200 len: 1316 microversion: 2.1 time: 0.297987 Sep 14 09:10:50.806347 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2296/4608] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:10:50 2022] GET /compute/v2.1/servers/e6f9d068-5708-4f4d-b9fe-ab03179ed31e => generated 1316 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:10:51.209355 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-577d26b0-0603-4ccf-9e4b-c3aafd40f59b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:10:51.209355 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-577d26b0-0603-4ccf-9e4b-c3aafd40f59b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 0be5d897-13d0-43ef-9122-96c21dafd94c] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:10:51.231543 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-577d26b0-0603-4ccf-9e4b-c3aafd40f59b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:51.232087 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-577d26b0-0603-4ccf-9e4b-c3aafd40f59b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:51.233582 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-577d26b0-0603-4ccf-9e4b-c3aafd40f59b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:51.234327 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-577d26b0-0603-4ccf-9e4b-c3aafd40f59b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:51.237395 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-577d26b0-0603-4ccf-9e4b-c3aafd40f59b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:51.237879 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-577d26b0-0603-4ccf-9e4b-c3aafd40f59b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:51.524971 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-577d26b0-0603-4ccf-9e4b-c3aafd40f59b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:10:51.546375 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-577d26b0-0603-4ccf-9e4b-c3aafd40f59b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/0be5d897-13d0-43ef-9122-96c21dafd94c" status: 200 len: 1510 microversion: 2.1 time: 0.348580 Sep 14 09:10:51.547603 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2313/4609] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:10:51 2022] GET /compute/v2.1/servers/0be5d897-13d0-43ef-9122-96c21dafd94c => generated 1510 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:10:51.720340 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b234c064-6480-44ed-bee7-150a490b5fb7 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:10:51.722364 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b234c064-6480-44ed-bee7-150a490b5fb7 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:10:51.732894 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b234c064-6480-44ed-bee7-150a490b5fb7 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:51.744216 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b234c064-6480-44ed-bee7-150a490b5fb7 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:51.744694 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b234c064-6480-44ed-bee7-150a490b5fb7 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:51.745501 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b234c064-6480-44ed-bee7-150a490b5fb7 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:51.746001 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b234c064-6480-44ed-bee7-150a490b5fb7 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:51.748300 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b234c064-6480-44ed-bee7-150a490b5fb7 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:51.834303 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ff6d96ff-5ca2-44f3-bdac-ffe4eedc2b46 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:10:51.835468 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-ff6d96ff-5ca2-44f3-bdac-ffe4eedc2b46 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] [instance: e6f9d068-5708-4f4d-b9fe-ab03179ed31e] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:10:51.850409 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ff6d96ff-5ca2-44f3-bdac-ffe4eedc2b46 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:51.850924 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ff6d96ff-5ca2-44f3-bdac-ffe4eedc2b46 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:51.851402 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ff6d96ff-5ca2-44f3-bdac-ffe4eedc2b46 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:51.853265 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ff6d96ff-5ca2-44f3-bdac-ffe4eedc2b46 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:51.854986 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ff6d96ff-5ca2-44f3-bdac-ffe4eedc2b46 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:51.855438 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ff6d96ff-5ca2-44f3-bdac-ffe4eedc2b46 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:52.191595 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-ff6d96ff-5ca2-44f3-bdac-ffe4eedc2b46 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dabfdd5a6e049c48d00bc1b55a0a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0783155bf04154bf28fc70bcb7580d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:10:52.212611 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-ff6d96ff-5ca2-44f3-bdac-ffe4eedc2b46 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] 10.222.0.60 "GET /compute/v2.1/servers/e6f9d068-5708-4f4d-b9fe-ab03179ed31e" status: 200 len: 1316 microversion: 2.1 time: 0.384583 Sep 14 09:10:52.213837 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2314/4610] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:10:51 2022] GET /compute/v2.1/servers/e6f9d068-5708-4f4d-b9fe-ab03179ed31e => generated 1316 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:10:52.514292 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b234c064-6480-44ed-bee7-150a490b5fb7 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:10:52.528165 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b234c064-6480-44ed-bee7-150a490b5fb7 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:10:52.532631 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b234c064-6480-44ed-bee7-150a490b5fb7 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:10:52.536394 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b234c064-6480-44ed-bee7-150a490b5fb7 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5" status: 200 len: 1722 microversion: 2.20 time: 0.818321 Sep 14 09:10:52.537651 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2297/4611] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:10:51 2022] GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5 => generated 1722 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:10:52.578056 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-85050a15-fc7b-4a15-a971-dc6c676bd186 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:10:52.578517 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-85050a15-fc7b-4a15-a971-dc6c676bd186 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 0be5d897-13d0-43ef-9122-96c21dafd94c] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:10:52.593160 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-85050a15-fc7b-4a15-a971-dc6c676bd186 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:52.594601 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-85050a15-fc7b-4a15-a971-dc6c676bd186 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:52.598632 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-85050a15-fc7b-4a15-a971-dc6c676bd186 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:52.599971 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-85050a15-fc7b-4a15-a971-dc6c676bd186 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:52.600609 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-85050a15-fc7b-4a15-a971-dc6c676bd186 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:52.603425 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-85050a15-fc7b-4a15-a971-dc6c676bd186 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:52.851582 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-58c51c8a-cc77-4366-b894-564db67a9031 req-8fdf2f55-c5a7-4e1a-bbd4-17b12f0d949a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6f9d068-5708-4f4d-b9fe-ab03179ed31e", "name": "network-vif-plugged", "status": "completed", "tag": "ceedee83-069d-49a0-9a90-87bb7bfc25be"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:10:52.869814 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-58c51c8a-cc77-4366-b894-564db67a9031 req-8fdf2f55-c5a7-4e1a-bbd4-17b12f0d949a service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:52.872895 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-58c51c8a-cc77-4366-b894-564db67a9031 req-8fdf2f55-c5a7-4e1a-bbd4-17b12f0d949a service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:52.873513 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-58c51c8a-cc77-4366-b894-564db67a9031 req-8fdf2f55-c5a7-4e1a-bbd4-17b12f0d949a service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:52.901338 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-58c51c8a-cc77-4366-b894-564db67a9031 req-8fdf2f55-c5a7-4e1a-bbd4-17b12f0d949a service nova] Creating event network-vif-plugged:ceedee83-069d-49a0-9a90-87bb7bfc25be for instance e6f9d068-5708-4f4d-b9fe-ab03179ed31e on n-h1-836830-18 Sep 14 09:10:52.903989 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-85050a15-fc7b-4a15-a971-dc6c676bd186 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:10:52.917171 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-58c51c8a-cc77-4366-b894-564db67a9031 req-8fdf2f55-c5a7-4e1a-bbd4-17b12f0d949a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068012 Sep 14 09:10:52.918464 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2298/4612] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:10:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:10:52.918807 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-85050a15-fc7b-4a15-a971-dc6c676bd186 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/0be5d897-13d0-43ef-9122-96c21dafd94c" status: 200 len: 1510 microversion: 2.1 time: 0.343513 Sep 14 09:10:52.920935 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2315/4613] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:10:52 2022] GET /compute/v2.1/servers/0be5d897-13d0-43ef-9122-96c21dafd94c => generated 1510 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:10:53.245100 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-41716b92-5e46-4186-946f-7c69edc18557 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:10:53.252963 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-41716b92-5e46-4186-946f-7c69edc18557 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] [instance: e6f9d068-5708-4f4d-b9fe-ab03179ed31e] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:10:53.280634 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-41716b92-5e46-4186-946f-7c69edc18557 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:53.281490 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-41716b92-5e46-4186-946f-7c69edc18557 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:53.282193 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-41716b92-5e46-4186-946f-7c69edc18557 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:53.283163 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-41716b92-5e46-4186-946f-7c69edc18557 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:53.283839 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-41716b92-5e46-4186-946f-7c69edc18557 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:53.284482 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-41716b92-5e46-4186-946f-7c69edc18557 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:53.578529 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-096d086b-ce41-48a7-bfa6-f13c50269341 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:10:53.579548 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-096d086b-ce41-48a7-bfa6-f13c50269341 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:10:53.586046 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-41716b92-5e46-4186-946f-7c69edc18557 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dabfdd5a6e049c48d00bc1b55a0a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0783155bf04154bf28fc70bcb7580d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:10:53.616734 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-096d086b-ce41-48a7-bfa6-f13c50269341 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:53.643850 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-096d086b-ce41-48a7-bfa6-f13c50269341 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:53.646064 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-096d086b-ce41-48a7-bfa6-f13c50269341 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:53.648060 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-096d086b-ce41-48a7-bfa6-f13c50269341 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:53.648995 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-096d086b-ce41-48a7-bfa6-f13c50269341 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:53.649608 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-096d086b-ce41-48a7-bfa6-f13c50269341 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:53.651533 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-41716b92-5e46-4186-946f-7c69edc18557 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] 10.222.0.60 "GET /compute/v2.1/servers/e6f9d068-5708-4f4d-b9fe-ab03179ed31e" status: 200 len: 1316 microversion: 2.1 time: 0.414707 Sep 14 09:10:53.660392 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2299/4614] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:10:53 2022] GET /compute/v2.1/servers/e6f9d068-5708-4f4d-b9fe-ab03179ed31e => generated 1316 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:10:53.948369 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-264c0800-04c5-498d-b7f9-3037e2da19ef tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:10:53.949325 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-264c0800-04c5-498d-b7f9-3037e2da19ef tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 0be5d897-13d0-43ef-9122-96c21dafd94c] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:10:53.958022 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-264c0800-04c5-498d-b7f9-3037e2da19ef tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:53.958642 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-264c0800-04c5-498d-b7f9-3037e2da19ef tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:53.959353 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-264c0800-04c5-498d-b7f9-3037e2da19ef tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:53.960163 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-264c0800-04c5-498d-b7f9-3037e2da19ef tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:53.960722 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-264c0800-04c5-498d-b7f9-3037e2da19ef tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:53.961712 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-264c0800-04c5-498d-b7f9-3037e2da19ef tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:54.006591 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-096d086b-ce41-48a7-bfa6-f13c50269341 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:10:54.024669 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-096d086b-ce41-48a7-bfa6-f13c50269341 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:10:54.026438 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-096d086b-ce41-48a7-bfa6-f13c50269341 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:10:54.027990 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-096d086b-ce41-48a7-bfa6-f13c50269341 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5" status: 200 len: 1722 microversion: 2.20 time: 0.462555 Sep 14 09:10:54.046970 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2316/4615] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:10:53 2022] GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5 => generated 1722 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 09:10:54.276609 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-264c0800-04c5-498d-b7f9-3037e2da19ef tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:10:54.289269 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-264c0800-04c5-498d-b7f9-3037e2da19ef tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/0be5d897-13d0-43ef-9122-96c21dafd94c" status: 200 len: 1510 microversion: 2.1 time: 0.346152 Sep 14 09:10:54.290313 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2300/4616] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:10:53 2022] GET /compute/v2.1/servers/0be5d897-13d0-43ef-9122-96c21dafd94c => generated 1510 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:10:54.682863 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-fd46d480-2ebf-4d32-a067-642b503ddbe2 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:10:54.684169 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-fd46d480-2ebf-4d32-a067-642b503ddbe2 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] [instance: e6f9d068-5708-4f4d-b9fe-ab03179ed31e] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:10:54.695280 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fd46d480-2ebf-4d32-a067-642b503ddbe2 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:54.696025 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fd46d480-2ebf-4d32-a067-642b503ddbe2 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:54.696671 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fd46d480-2ebf-4d32-a067-642b503ddbe2 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:54.698861 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fd46d480-2ebf-4d32-a067-642b503ddbe2 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:54.699537 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fd46d480-2ebf-4d32-a067-642b503ddbe2 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:54.700414 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fd46d480-2ebf-4d32-a067-642b503ddbe2 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:55.057424 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d07873f0-56d1-49d9-b9c2-46e8fb9a5306 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:10:55.058486 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-d07873f0-56d1-49d9-b9c2-46e8fb9a5306 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:10:55.074882 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-fd46d480-2ebf-4d32-a067-642b503ddbe2 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dabfdd5a6e049c48d00bc1b55a0a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0783155bf04154bf28fc70bcb7580d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:10:55.094877 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-fd46d480-2ebf-4d32-a067-642b503ddbe2 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] 10.222.0.60 "GET /compute/v2.1/servers/e6f9d068-5708-4f4d-b9fe-ab03179ed31e" status: 200 len: 1316 microversion: 2.1 time: 0.416950 Sep 14 09:10:55.099500 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2317/4617] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:10:54 2022] GET /compute/v2.1/servers/e6f9d068-5708-4f4d-b9fe-ab03179ed31e => generated 1316 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:10:55.099672 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d07873f0-56d1-49d9-b9c2-46e8fb9a5306 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:55.100455 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d07873f0-56d1-49d9-b9c2-46e8fb9a5306 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:55.100912 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d07873f0-56d1-49d9-b9c2-46e8fb9a5306 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:55.101708 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d07873f0-56d1-49d9-b9c2-46e8fb9a5306 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:55.102795 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d07873f0-56d1-49d9-b9c2-46e8fb9a5306 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:55.103263 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d07873f0-56d1-49d9-b9c2-46e8fb9a5306 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:55.316180 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-9975afb8-14f5-4baa-bce5-a3a5c817daf5 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:10:55.316958 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-9975afb8-14f5-4baa-bce5-a3a5c817daf5 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 0be5d897-13d0-43ef-9122-96c21dafd94c] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:10:55.330888 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9975afb8-14f5-4baa-bce5-a3a5c817daf5 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:55.333231 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9975afb8-14f5-4baa-bce5-a3a5c817daf5 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:55.334405 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9975afb8-14f5-4baa-bce5-a3a5c817daf5 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:55.336528 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9975afb8-14f5-4baa-bce5-a3a5c817daf5 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:55.337014 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9975afb8-14f5-4baa-bce5-a3a5c817daf5 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:55.338434 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9975afb8-14f5-4baa-bce5-a3a5c817daf5 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:55.385190 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-d07873f0-56d1-49d9-b9c2-46e8fb9a5306 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:10:55.398306 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-d07873f0-56d1-49d9-b9c2-46e8fb9a5306 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:10:55.407848 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-d07873f0-56d1-49d9-b9c2-46e8fb9a5306 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:10:55.410890 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d07873f0-56d1-49d9-b9c2-46e8fb9a5306 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5" status: 200 len: 1743 microversion: 2.20 time: 0.360458 Sep 14 09:10:55.415740 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2301/4618] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:10:55 2022] GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5 => generated 1743 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:10:55.644611 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-9975afb8-14f5-4baa-bce5-a3a5c817daf5 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:10:55.657816 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-9975afb8-14f5-4baa-bce5-a3a5c817daf5 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/0be5d897-13d0-43ef-9122-96c21dafd94c" status: 200 len: 1510 microversion: 2.1 time: 0.342790 Sep 14 09:10:55.658470 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2318/4619] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:10:55 2022] GET /compute/v2.1/servers/0be5d897-13d0-43ef-9122-96c21dafd94c => generated 1510 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:10:56.124668 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-0186e666-00e8-48a4-a341-4934224751b9 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:10:56.125496 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-0186e666-00e8-48a4-a341-4934224751b9 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] [instance: e6f9d068-5708-4f4d-b9fe-ab03179ed31e] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:10:56.138456 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0186e666-00e8-48a4-a341-4934224751b9 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:56.142203 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0186e666-00e8-48a4-a341-4934224751b9 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:56.142824 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0186e666-00e8-48a4-a341-4934224751b9 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:56.143850 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0186e666-00e8-48a4-a341-4934224751b9 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:56.144350 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0186e666-00e8-48a4-a341-4934224751b9 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:56.144786 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0186e666-00e8-48a4-a341-4934224751b9 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:56.365863 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-0186e666-00e8-48a4-a341-4934224751b9 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dabfdd5a6e049c48d00bc1b55a0a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0783155bf04154bf28fc70bcb7580d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:10:56.394624 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-0186e666-00e8-48a4-a341-4934224751b9 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] 10.222.0.60 "GET /compute/v2.1/servers/e6f9d068-5708-4f4d-b9fe-ab03179ed31e" status: 200 len: 1505 microversion: 2.1 time: 0.273682 Sep 14 09:10:56.396306 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2302/4620] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:10:56 2022] GET /compute/v2.1/servers/e6f9d068-5708-4f4d-b9fe-ab03179ed31e => generated 1505 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:10:56.430247 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-721459d4-b4a9-4547-a1a8-b6a36afc2ca4 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1013449298"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:10:56.430912 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-721459d4-b4a9-4547-a1a8-b6a36afc2ca4 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] [instance: e6f9d068-5708-4f4d-b9fe-ab03179ed31e] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:10:56.443266 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-4ead64cf-8fd4-4be2-b95c-c60fc9f60998 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:10:56.447256 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-4ead64cf-8fd4-4be2-b95c-c60fc9f60998 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:10:56.455319 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-721459d4-b4a9-4547-a1a8-b6a36afc2ca4 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:56.457841 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-721459d4-b4a9-4547-a1a8-b6a36afc2ca4 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:56.459585 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-721459d4-b4a9-4547-a1a8-b6a36afc2ca4 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:56.460467 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-721459d4-b4a9-4547-a1a8-b6a36afc2ca4 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:56.460823 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-721459d4-b4a9-4547-a1a8-b6a36afc2ca4 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:56.461264 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-721459d4-b4a9-4547-a1a8-b6a36afc2ca4 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:56.462633 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4ead64cf-8fd4-4be2-b95c-c60fc9f60998 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:56.463688 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4ead64cf-8fd4-4be2-b95c-c60fc9f60998 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:56.464360 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4ead64cf-8fd4-4be2-b95c-c60fc9f60998 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:56.465567 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4ead64cf-8fd4-4be2-b95c-c60fc9f60998 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:56.466264 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4ead64cf-8fd4-4be2-b95c-c60fc9f60998 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:56.468103 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4ead64cf-8fd4-4be2-b95c-c60fc9f60998 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:56.924344 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-4ead64cf-8fd4-4be2-b95c-c60fc9f60998 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:10:56.933855 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-4ead64cf-8fd4-4be2-b95c-c60fc9f60998 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:10:56.941353 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-4ead64cf-8fd4-4be2-b95c-c60fc9f60998 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:10:56.945261 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-4ead64cf-8fd4-4be2-b95c-c60fc9f60998 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5" status: 200 len: 1743 microversion: 2.20 time: 0.508248 Sep 14 09:10:56.946815 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2303/4621] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:10:56 2022] GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5 => generated 1743 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 09:10:56.981697 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3f6d3449-c43f-4d7d-bc5e-7e83963ed0d1 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:10:56.983649 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-3f6d3449-c43f-4d7d-bc5e-7e83963ed0d1 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 0be5d897-13d0-43ef-9122-96c21dafd94c] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:10:57.008966 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3f6d3449-c43f-4d7d-bc5e-7e83963ed0d1 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:57.009480 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3f6d3449-c43f-4d7d-bc5e-7e83963ed0d1 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:57.009930 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3f6d3449-c43f-4d7d-bc5e-7e83963ed0d1 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:57.010640 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3f6d3449-c43f-4d7d-bc5e-7e83963ed0d1 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:57.011142 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3f6d3449-c43f-4d7d-bc5e-7e83963ed0d1 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:57.011574 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3f6d3449-c43f-4d7d-bc5e-7e83963ed0d1 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:57.171573 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.network.security_group_api [None req-721459d4-b4a9-4547-a1a8-b6a36afc2ca4 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Adding security group 523f0cb2-3dce-4392-9ab2-3b37cd888198 to port ceedee83-069d-49a0-9a90-87bb7bfc25be Sep 14 09:10:57.439224 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-3f6d3449-c43f-4d7d-bc5e-7e83963ed0d1 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:10:57.466264 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-3f6d3449-c43f-4d7d-bc5e-7e83963ed0d1 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/0be5d897-13d0-43ef-9122-96c21dafd94c" status: 200 len: 1510 microversion: 2.1 time: 0.516232 Sep 14 09:10:57.468919 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2304/4622] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:10:56 2022] GET /compute/v2.1/servers/0be5d897-13d0-43ef-9122-96c21dafd94c => generated 1510 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:10:57.986652 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-4a932887-fd0d-474f-b201-9cfb86e861fd tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:10:57.996598 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-4a932887-fd0d-474f-b201-9cfb86e861fd tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:10:58.032295 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-721459d4-b4a9-4547-a1a8-b6a36afc2ca4 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] 10.222.0.60 "POST /compute/v2.1/servers/e6f9d068-5708-4f4d-b9fe-ab03179ed31e/action" status: 202 len: 0 microversion: 2.1 time: 1.613880 Sep 14 09:10:58.036233 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2319/4623] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:10:56 2022] POST /compute/v2.1/servers/e6f9d068-5708-4f4d-b9fe-ab03179ed31e/action => generated 0 bytes in 1620 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:10:58.057722 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-9937ebe2-58fc-4912-8420-b287966634a3 req-2f6cd74d-5718-4d7e-8874-acd65c25068d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6f9d068-5708-4f4d-b9fe-ab03179ed31e", "tag": "ceedee83-069d-49a0-9a90-87bb7bfc25be"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:10:58.060256 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4a932887-fd0d-474f-b201-9cfb86e861fd tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:58.067754 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4a932887-fd0d-474f-b201-9cfb86e861fd tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:58.068593 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4a932887-fd0d-474f-b201-9cfb86e861fd tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:58.073746 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4a932887-fd0d-474f-b201-9cfb86e861fd tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:58.074573 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4a932887-fd0d-474f-b201-9cfb86e861fd tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:58.077772 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4a932887-fd0d-474f-b201-9cfb86e861fd tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:58.085624 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-9937ebe2-58fc-4912-8420-b287966634a3 req-2f6cd74d-5718-4d7e-8874-acd65c25068d service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:58.086377 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-9937ebe2-58fc-4912-8420-b287966634a3 req-2f6cd74d-5718-4d7e-8874-acd65c25068d service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:58.087023 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-9937ebe2-58fc-4912-8420-b287966634a3 req-2f6cd74d-5718-4d7e-8874-acd65c25068d service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:58.118172 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-9937ebe2-58fc-4912-8420-b287966634a3 req-2f6cd74d-5718-4d7e-8874-acd65c25068d service nova] Creating event network-changed:ceedee83-069d-49a0-9a90-87bb7bfc25be for instance e6f9d068-5708-4f4d-b9fe-ab03179ed31e on n-h1-836830-18 Sep 14 09:10:58.133375 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-9937ebe2-58fc-4912-8420-b287966634a3 req-2f6cd74d-5718-4d7e-8874-acd65c25068d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086663 Sep 14 09:10:58.134318 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2320/4624] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:10:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:10:58.152386 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ff3a61e1-963e-487a-8de5-11e35c1c7713 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Calling method '.version_select at 0x7f7d3f3ede50>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:10:58.647797 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-4a932887-fd0d-474f-b201-9cfb86e861fd tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:10:58.650440 n-d-836830-18 devstack@n-api.service[128758]: DEBUG neutronclient.v2_0.client [None req-ff3a61e1-963e-487a-8de5-11e35c1c7713 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 523f0cb2-3dce-4392-9ab2-3b37cd888198 in use.", "detail": ""}} {{(pid=128758) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 14 09:10:58.651469 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-ff3a61e1-963e-487a-8de5-11e35c1c7713 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] HTTP exception thrown: Security Group 523f0cb2-3dce-4392-9ab2-3b37cd888198 in use. Sep 14 09:10:58.651469 n-d-836830-18 devstack@n-api.service[128758]: Neutron server returns request_ids: ['req-7f3acd4a-c131-43c6-b06a-3752fc189e69'] Sep 14 09:10:58.654330 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ff3a61e1-963e-487a-8de5-11e35c1c7713 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Request method failure captured: Sep 14 09:10:58.654330 n-d-836830-18 devstack@n-api.service[128758]: request: DELETE /compute/v2.1/os-security-groups/523f0cb2-3dce-4392-9ab2-3b37cd888198 HTTP/1.1 Sep 14 09:10:58.654330 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 09:10:58.654330 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 09:10:58.654330 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 09:10:58.654330 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 09:10:58.654330 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 09:10:58.654330 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 09:10:58.654330 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 09:10:58.654330 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 09:10:58.654330 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZpubEr9UgWj_j7j968HWFZ0D3vsD9X5NGBGI22hLpa671vkRnOFuLUHN5BGyBOTOD_eSiiXbv14AW_KXyWtJ-nEaHjFTRMlAQdICZGgh9e4MfCMr0iqhNEP0c19crMOXUBhQTUSoeq6F9tEyTwVcFxkCl04_QVOcf30LScxQWEOmzE Sep 14 09:10:58.654330 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 09:10:58.654330 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 09:10:58.654330 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 09:10:58.654330 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 09:10:58.654330 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 09:10:58.654330 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 09:10:58.654330 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: de0783155bf04154bf28fc70bcb7580d Sep 14 09:10:58.654330 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-SecurityGroupsTestJSON-367581750 Sep 14 09:10:58.654330 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 09:10:58.654330 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 09:10:58.654330 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/de0783155bf04154bf28fc70bcb7580d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_de0783155bf04154bf28fc70bcb7580d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/de0783155bf04154bf28fc70bcb7580d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/de0783155bf04154bf28fc70bcb7580d"}]}] Sep 14 09:10:58.654330 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-SecurityGroupsTestJSON-367581750 Sep 14 09:10:58.654330 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: de0783155bf04154bf28fc70bcb7580d Sep 14 09:10:58.654330 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-367581750 Sep 14 09:10:58.654330 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-SecurityGroupsTestJSON-367581750-project Sep 14 09:10:58.654330 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 09:10:58.654330 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 09:10:58.654330 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 2dabfdd5a6e049c48d00bc1b55a0a30f Sep 14 09:10:58.654330 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-SecurityGroupsTestJSON-367581750-project Sep 14 09:10:58.654330 n-d-836830-18 devstack@n-api.service[128758]: method: Sep 14 09:10:58.654330 n-d-836830-18 devstack@n-api.service[128758]: exception: Security Group 523f0cb2-3dce-4392-9ab2-3b37cd888198 in use. Sep 14 09:10:58.654330 n-d-836830-18 devstack@n-api.service[128758]: Neutron server returns request_ids: ['req-7f3acd4a-c131-43c6-b06a-3752fc189e69'] Sep 14 09:10:58.654330 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': '523f0cb2-3dce-4392-9ab2-3b37cd888198'} Sep 14 09:10:58.654330 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:10:58.654330 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:10:58.654330 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Sep 14 09:10:58.654330 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Sep 14 09:10:58.654330 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:10:58.654330 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:10:58.654330 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Sep 14 09:10:58.654330 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Sep 14 09:10:58.654330 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:10:58.654330 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:10:58.654330 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Sep 14 09:10:58.654330 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Sep 14 09:10:58.654330 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:10:58.654330 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:10:58.654330 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 14 09:10:58.654330 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 14 09:10:58.654330 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:10:58.654330 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:10:58.654330 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 14 09:10:58.654330 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 14 09:10:58.654330 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:10:58.654330 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:10:58.654330 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 14 09:10:58.654330 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 14 09:10:58.654330 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 14 09:10:58.654330 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 14 09:10:58.654330 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 523f0cb2-3dce-4392-9ab2-3b37cd888198 in use. Sep 14 09:10:58.661041 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7f3acd4a-c131-43c6-b06a-3752fc189e69'] Sep 14 09:10:58.661041 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:10:58.661041 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:10:58.661041 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:10:58.661041 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:10:58.661041 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Sep 14 09:10:58.661041 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Sep 14 09:10:58.661041 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Sep 14 09:10:58.661041 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Sep 14 09:10:58.661041 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 523f0cb2-3dce-4392-9ab2-3b37cd888198 in use. Sep 14 09:10:58.661041 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7f3acd4a-c131-43c6-b06a-3752fc189e69'] Sep 14 09:10:58.661041 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:10:58.661041 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:10:58.661041 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:10:58.661041 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:10:58.661041 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:10:58.661041 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:10:58.661041 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:10:58.661041 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:10:58.661041 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:10:58.661041 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:10:58.661041 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:10:58.661041 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:10:58.661041 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Sep 14 09:10:58.661041 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 14 09:10:58.661041 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 523f0cb2-3dce-4392-9ab2-3b37cd888198 in use. Sep 14 09:10:58.661041 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7f3acd4a-c131-43c6-b06a-3752fc189e69'] Sep 14 09:10:58.661041 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:10:58.661041 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:10:58.661041 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:10:58.661041 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:10:58.661041 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:10:58.661041 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:10:58.661041 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:10:58.661041 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:10:58.661041 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 523f0cb2-3dce-4392-9ab2-3b37cd888198 in use. Sep 14 09:10:58.661041 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7f3acd4a-c131-43c6-b06a-3752fc189e69'] Sep 14 09:10:58.661041 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:10:58.661041 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ff3a61e1-963e-487a-8de5-11e35c1c7713 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Returning 400 to user: Security Group 523f0cb2-3dce-4392-9ab2-3b37cd888198 in use. Sep 14 09:10:58.661041 n-d-836830-18 devstack@n-api.service[128758]: Neutron server returns request_ids: ['req-7f3acd4a-c131-43c6-b06a-3752fc189e69'] {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:10:58.661041 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-ff3a61e1-963e-487a-8de5-11e35c1c7713 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/523f0cb2-3dce-4392-9ab2-3b37cd888198" status: 400 len: 185 microversion: 2.1 time: 0.520103 Sep 14 09:10:58.661041 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2321/4625] 10.222.0.60 () {58 vars in 1272 bytes} [Wed Sep 14 09:10:58 2022] DELETE /compute/v2.1/os-security-groups/523f0cb2-3dce-4392-9ab2-3b37cd888198 => generated 185 bytes in 524 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 14 09:10:58.670703 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a9a2844c-11cc-4bfa-8e06-e5c6100b2a53 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:10:58.671712 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-a9a2844c-11cc-4bfa-8e06-e5c6100b2a53 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 0be5d897-13d0-43ef-9122-96c21dafd94c] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:10:58.679503 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a9a2844c-11cc-4bfa-8e06-e5c6100b2a53 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:58.680331 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a9a2844c-11cc-4bfa-8e06-e5c6100b2a53 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:58.681031 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a9a2844c-11cc-4bfa-8e06-e5c6100b2a53 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:58.681883 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a9a2844c-11cc-4bfa-8e06-e5c6100b2a53 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:58.682484 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a9a2844c-11cc-4bfa-8e06-e5c6100b2a53 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:58.683118 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a9a2844c-11cc-4bfa-8e06-e5c6100b2a53 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:58.683786 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-4a932887-fd0d-474f-b201-9cfb86e861fd tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:10:58.685251 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-4a932887-fd0d-474f-b201-9cfb86e861fd tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:10:58.706679 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-4a932887-fd0d-474f-b201-9cfb86e861fd tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5" status: 200 len: 1743 microversion: 2.20 time: 0.725755 Sep 14 09:10:58.707306 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2305/4626] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:10:57 2022] GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5 => generated 1743 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:10:58.738565 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-23908747-bd61-47f1-a38c-e7b6c357a40a tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:10:58.743764 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-23908747-bd61-47f1-a38c-e7b6c357a40a tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] [instance: e6f9d068-5708-4f4d-b9fe-ab03179ed31e] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:10:58.770512 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-23908747-bd61-47f1-a38c-e7b6c357a40a tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:58.778043 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-23908747-bd61-47f1-a38c-e7b6c357a40a tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:58.785950 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-23908747-bd61-47f1-a38c-e7b6c357a40a tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:58.786793 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-23908747-bd61-47f1-a38c-e7b6c357a40a tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:58.788056 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-23908747-bd61-47f1-a38c-e7b6c357a40a tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:58.790774 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-23908747-bd61-47f1-a38c-e7b6c357a40a tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:59.019647 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-23908747-bd61-47f1-a38c-e7b6c357a40a tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] 10.222.0.60 "POST /compute/v2.1/servers/e6f9d068-5708-4f4d-b9fe-ab03179ed31e/action" status: 202 len: 0 microversion: 2.1 time: 0.310227 Sep 14 09:10:59.020768 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2306/4627] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:10:58 2022] POST /compute/v2.1/servers/e6f9d068-5708-4f4d-b9fe-ab03179ed31e/action => generated 0 bytes in 312 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:10:59.031392 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e3773e95-40b7-4a9b-b9d8-6c56416eb972 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:10:59.035911 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e3773e95-40b7-4a9b-b9d8-6c56416eb972 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] [instance: e6f9d068-5708-4f4d-b9fe-ab03179ed31e] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:10:59.046849 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e3773e95-40b7-4a9b-b9d8-6c56416eb972 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:59.057009 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e3773e95-40b7-4a9b-b9d8-6c56416eb972 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:59.057731 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e3773e95-40b7-4a9b-b9d8-6c56416eb972 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:59.058631 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e3773e95-40b7-4a9b-b9d8-6c56416eb972 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:59.059293 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e3773e95-40b7-4a9b-b9d8-6c56416eb972 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:59.059897 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e3773e95-40b7-4a9b-b9d8-6c56416eb972 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:59.063517 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-a9a2844c-11cc-4bfa-8e06-e5c6100b2a53 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:10:59.082414 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-a9a2844c-11cc-4bfa-8e06-e5c6100b2a53 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/0be5d897-13d0-43ef-9122-96c21dafd94c" status: 200 len: 1510 microversion: 2.1 time: 0.418363 Sep 14 09:10:59.083001 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2322/4628] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:10:58 2022] GET /compute/v2.1/servers/0be5d897-13d0-43ef-9122-96c21dafd94c => generated 1510 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:10:59.384147 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-e3773e95-40b7-4a9b-b9d8-6c56416eb972 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dabfdd5a6e049c48d00bc1b55a0a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0783155bf04154bf28fc70bcb7580d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:10:59.393475 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:10:59.405327 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e3773e95-40b7-4a9b-b9d8-6c56416eb972 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] 10.222.0.60 "GET /compute/v2.1/servers/e6f9d068-5708-4f4d-b9fe-ab03179ed31e" status: 200 len: 1576 microversion: 2.1 time: 0.378079 Sep 14 09:10:59.405940 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2307/4629] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:10:59 2022] GET /compute/v2.1/servers/e6f9d068-5708-4f4d-b9fe-ab03179ed31e => generated 1576 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:10:59.745222 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-4042321f-df1e-40c0-a30a-969ddbfc5900 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:10:59.746275 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-4042321f-df1e-40c0-a30a-969ddbfc5900 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:10:59.774480 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4042321f-df1e-40c0-a30a-969ddbfc5900 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:59.776399 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4042321f-df1e-40c0-a30a-969ddbfc5900 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:59.777502 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4042321f-df1e-40c0-a30a-969ddbfc5900 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:10:59.781520 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4042321f-df1e-40c0-a30a-969ddbfc5900 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:10:59.782694 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4042321f-df1e-40c0-a30a-969ddbfc5900 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:10:59.786341 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4042321f-df1e-40c0-a30a-969ddbfc5900 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:00.121310 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-35d2c9c9-22d5-441f-80dc-d761e1b09d11 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:11:00.122979 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-35d2c9c9-22d5-441f-80dc-d761e1b09d11 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 0be5d897-13d0-43ef-9122-96c21dafd94c] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:11:00.148429 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-35d2c9c9-22d5-441f-80dc-d761e1b09d11 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:00.151731 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-35d2c9c9-22d5-441f-80dc-d761e1b09d11 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:00.154615 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-35d2c9c9-22d5-441f-80dc-d761e1b09d11 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:00.155734 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-35d2c9c9-22d5-441f-80dc-d761e1b09d11 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:00.157615 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-35d2c9c9-22d5-441f-80dc-d761e1b09d11 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:00.160462 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-35d2c9c9-22d5-441f-80dc-d761e1b09d11 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:00.175471 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-4042321f-df1e-40c0-a30a-969ddbfc5900 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:11:00.195301 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-4042321f-df1e-40c0-a30a-969ddbfc5900 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:11:00.197738 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-4042321f-df1e-40c0-a30a-969ddbfc5900 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:11:00.201931 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-4042321f-df1e-40c0-a30a-969ddbfc5900 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5" status: 200 len: 1743 microversion: 2.20 time: 0.461301 Sep 14 09:11:00.229394 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2323/4630] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:10:59 2022] GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5 => generated 1743 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:11:00.375905 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-eaad6ae2-f7e8-4d65-960d-3c9b4d4502dd req-59d3d833-fcc4-4a4a-a0c6-4f178602be6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5", "name": "network-vif-plugged", "status": "completed", "tag": "906bcc79-e290-4b18-8447-de06233392de"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:11:00.401996 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-eaad6ae2-f7e8-4d65-960d-3c9b4d4502dd req-59d3d833-fcc4-4a4a-a0c6-4f178602be6b service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:00.403444 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-eaad6ae2-f7e8-4d65-960d-3c9b4d4502dd req-59d3d833-fcc4-4a4a-a0c6-4f178602be6b service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:00.404179 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-eaad6ae2-f7e8-4d65-960d-3c9b4d4502dd req-59d3d833-fcc4-4a4a-a0c6-4f178602be6b service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:00.458387 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-eaad6ae2-f7e8-4d65-960d-3c9b4d4502dd req-59d3d833-fcc4-4a4a-a0c6-4f178602be6b service nova] Creating event network-vif-plugged:906bcc79-e290-4b18-8447-de06233392de for instance 4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5 on n-h1-836830-18 Sep 14 09:11:00.479493 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-eaad6ae2-f7e8-4d65-960d-3c9b4d4502dd req-59d3d833-fcc4-4a4a-a0c6-4f178602be6b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107402 Sep 14 09:11:00.480726 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2324/4631] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:11:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:11:00.490108 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-03dd11af-82ca-4df2-b74a-b645dc40f176 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:11:00.492757 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-03dd11af-82ca-4df2-b74a-b645dc40f176 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] [instance: e6f9d068-5708-4f4d-b9fe-ab03179ed31e] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:11:00.517406 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-03dd11af-82ca-4df2-b74a-b645dc40f176 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:00.517920 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-03dd11af-82ca-4df2-b74a-b645dc40f176 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:00.518369 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-03dd11af-82ca-4df2-b74a-b645dc40f176 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:00.519119 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-03dd11af-82ca-4df2-b74a-b645dc40f176 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:00.519581 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-03dd11af-82ca-4df2-b74a-b645dc40f176 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:00.520176 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-03dd11af-82ca-4df2-b74a-b645dc40f176 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:01.136980 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-35d2c9c9-22d5-441f-80dc-d761e1b09d11 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:11:01.155870 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-35d2c9c9-22d5-441f-80dc-d761e1b09d11 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/0be5d897-13d0-43ef-9122-96c21dafd94c" status: 200 len: 1487 microversion: 2.1 time: 1.046116 Sep 14 09:11:01.159876 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2308/4632] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:11:00 2022] GET /compute/v2.1/servers/0be5d897-13d0-43ef-9122-96c21dafd94c => generated 1487 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:11:01.188935 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-bea217bc-062b-46d5-bf0d-c51e73fb359d tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:11:01.189859 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-bea217bc-062b-46d5-bf0d-c51e73fb359d tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [instance: 81ad242a-93d0-4f76-a6f1-e02e5e537e95] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:11:01.205532 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bea217bc-062b-46d5-bf0d-c51e73fb359d tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:01.212665 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bea217bc-062b-46d5-bf0d-c51e73fb359d tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:01.213386 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bea217bc-062b-46d5-bf0d-c51e73fb359d tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:01.215274 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bea217bc-062b-46d5-bf0d-c51e73fb359d tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:01.216146 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bea217bc-062b-46d5-bf0d-c51e73fb359d tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:01.218329 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bea217bc-062b-46d5-bf0d-c51e73fb359d tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:01.340783 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-bea217bc-062b-46d5-bf0d-c51e73fb359d tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "GET /compute/v2.1/servers/81ad242a-93d0-4f76-a6f1-e02e5e537e95/ips" status: 200 len: 150 microversion: 2.1 time: 0.179507 Sep 14 09:11:01.341425 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2309/4633] 10.222.0.60 () {58 vars in 1248 bytes} [Wed Sep 14 09:11:01 2022] GET /compute/v2.1/servers/81ad242a-93d0-4f76-a6f1-e02e5e537e95/ips => generated 150 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:11:01.368288 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-bf7f2874-9e5b-4a6e-ae52-882d50768ef0 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:11:01.371526 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-bf7f2874-9e5b-4a6e-ae52-882d50768ef0 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:11:01.425017 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bf7f2874-9e5b-4a6e-ae52-882d50768ef0 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:01.425749 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bf7f2874-9e5b-4a6e-ae52-882d50768ef0 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:01.427938 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bf7f2874-9e5b-4a6e-ae52-882d50768ef0 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:01.428842 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bf7f2874-9e5b-4a6e-ae52-882d50768ef0 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:01.430668 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bf7f2874-9e5b-4a6e-ae52-882d50768ef0 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:01.431141 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bf7f2874-9e5b-4a6e-ae52-882d50768ef0 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:01.630888 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-bf7f2874-9e5b-4a6e-ae52-882d50768ef0 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "POST /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105/action" status: 200 len: 141 microversion: 2.1 time: 0.285475 Sep 14 09:11:01.631782 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2310/4634] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:11:01 2022] POST /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105/action => generated 141 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:11:01.642676 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-bd8f2b4f-696b-46c0-829f-6974c3262f3b tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:11:01.646680 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-bd8f2b4f-696b-46c0-829f-6974c3262f3b tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:11:01.661742 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bd8f2b4f-696b-46c0-829f-6974c3262f3b tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:01.664818 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bd8f2b4f-696b-46c0-829f-6974c3262f3b tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:01.665533 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bd8f2b4f-696b-46c0-829f-6974c3262f3b tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:01.666525 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bd8f2b4f-696b-46c0-829f-6974c3262f3b tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:01.667260 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bd8f2b4f-696b-46c0-829f-6974c3262f3b tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:01.669888 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bd8f2b4f-696b-46c0-829f-6974c3262f3b tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:03.531416 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-03dd11af-82ca-4df2-b74a-b645dc40f176 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dabfdd5a6e049c48d00bc1b55a0a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0783155bf04154bf28fc70bcb7580d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:11:03.540238 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-03dd11af-82ca-4df2-b74a-b645dc40f176 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] 10.222.0.60 "GET /compute/v2.1/servers/e6f9d068-5708-4f4d-b9fe-ab03179ed31e" status: 200 len: 1576 microversion: 2.1 time: 3.058126 Sep 14 09:11:03.550153 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2325/4635] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:11:00 2022] GET /compute/v2.1/servers/e6f9d068-5708-4f4d-b9fe-ab03179ed31e => generated 1576 bytes in 3069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:11:03.564024 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-4be10917-37f8-4f07-a9f6-d79cbc1819d1 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:11:03.565008 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-4be10917-37f8-4f07-a9f6-d79cbc1819d1 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:11:03.573109 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4be10917-37f8-4f07-a9f6-d79cbc1819d1 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:03.576651 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4be10917-37f8-4f07-a9f6-d79cbc1819d1 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:03.577331 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4be10917-37f8-4f07-a9f6-d79cbc1819d1 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:03.578320 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4be10917-37f8-4f07-a9f6-d79cbc1819d1 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:03.579471 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4be10917-37f8-4f07-a9f6-d79cbc1819d1 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:03.582976 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4be10917-37f8-4f07-a9f6-d79cbc1819d1 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:04.080159 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-4be10917-37f8-4f07-a9f6-d79cbc1819d1 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:11:04.095097 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-4be10917-37f8-4f07-a9f6-d79cbc1819d1 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105" status: 200 len: 1668 microversion: 2.1 time: 0.543361 Sep 14 09:11:04.097470 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2326/4636] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:11:03 2022] GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105 => generated 1668 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:11:04.139773 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-bd8f2b4f-696b-46c0-829f-6974c3262f3b tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:11:04.144184 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-689f212c-0526-431c-8f1e-ec7fe67dd161 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:11:04.148150 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-689f212c-0526-431c-8f1e-ec7fe67dd161 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:11:04.165725 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-689f212c-0526-431c-8f1e-ec7fe67dd161 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:04.169329 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-689f212c-0526-431c-8f1e-ec7fe67dd161 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:04.170249 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-689f212c-0526-431c-8f1e-ec7fe67dd161 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:04.172019 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-689f212c-0526-431c-8f1e-ec7fe67dd161 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:04.174389 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-689f212c-0526-431c-8f1e-ec7fe67dd161 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:04.177102 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-689f212c-0526-431c-8f1e-ec7fe67dd161 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:04.181350 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=100 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:11:04.193442 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-bd8f2b4f-696b-46c0-829f-6974c3262f3b tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:11:04.223476 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-bd8f2b4f-696b-46c0-829f-6974c3262f3b tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:11:04.227113 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-bd8f2b4f-696b-46c0-829f-6974c3262f3b tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5" status: 200 len: 1738 microversion: 2.20 time: 2.594069 Sep 14 09:11:04.239670 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2311/4637] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:11:01 2022] GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5 => generated 1738 bytes in 2607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:11:04.582347 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-844c0a9b-b2eb-4e26-8ca8-f99d780aba0a tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:11:04.583370 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-844c0a9b-b2eb-4e26-8ca8-f99d780aba0a tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] [instance: e6f9d068-5708-4f4d-b9fe-ab03179ed31e] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:11:04.605030 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-844c0a9b-b2eb-4e26-8ca8-f99d780aba0a tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:04.612914 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-844c0a9b-b2eb-4e26-8ca8-f99d780aba0a tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:04.615341 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-844c0a9b-b2eb-4e26-8ca8-f99d780aba0a tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:04.617331 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-844c0a9b-b2eb-4e26-8ca8-f99d780aba0a tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:04.622834 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-844c0a9b-b2eb-4e26-8ca8-f99d780aba0a tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:04.623633 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-844c0a9b-b2eb-4e26-8ca8-f99d780aba0a tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:05.449105 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-689f212c-0526-431c-8f1e-ec7fe67dd161 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:11:05.478149 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-689f212c-0526-431c-8f1e-ec7fe67dd161 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105" status: 200 len: 1668 microversion: 2.1 time: 1.341804 Sep 14 09:11:05.484143 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2327/4638] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:11:04 2022] GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105 => generated 1668 bytes in 1349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:11:05.497390 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c7f89f73-d9e2-43ff-85de-1a7d19222575 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:11:05.498512 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-c7f89f73-d9e2-43ff-85de-1a7d19222575 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:11:05.532979 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c7f89f73-d9e2-43ff-85de-1a7d19222575 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:05.533496 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c7f89f73-d9e2-43ff-85de-1a7d19222575 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:05.543352 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c7f89f73-d9e2-43ff-85de-1a7d19222575 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:05.544191 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c7f89f73-d9e2-43ff-85de-1a7d19222575 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:05.551662 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c7f89f73-d9e2-43ff-85de-1a7d19222575 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:05.564457 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c7f89f73-d9e2-43ff-85de-1a7d19222575 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:05.993603 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-844c0a9b-b2eb-4e26-8ca8-f99d780aba0a tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dabfdd5a6e049c48d00bc1b55a0a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0783155bf04154bf28fc70bcb7580d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:11:06.002621 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-844c0a9b-b2eb-4e26-8ca8-f99d780aba0a tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] 10.222.0.60 "GET /compute/v2.1/servers/e6f9d068-5708-4f4d-b9fe-ab03179ed31e" status: 200 len: 1574 microversion: 2.1 time: 1.425736 Sep 14 09:11:06.027267 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2312/4639] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:11:04 2022] GET /compute/v2.1/servers/e6f9d068-5708-4f4d-b9fe-ab03179ed31e => generated 1574 bytes in 1445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:11:06.043632 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-7aa377dd-008f-4167-8b68-864519aecf91 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:11:06.044310 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-7aa377dd-008f-4167-8b68-864519aecf91 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:11:06.061443 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7aa377dd-008f-4167-8b68-864519aecf91 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:06.061960 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7aa377dd-008f-4167-8b68-864519aecf91 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:06.067992 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7aa377dd-008f-4167-8b68-864519aecf91 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:06.071868 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7aa377dd-008f-4167-8b68-864519aecf91 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:06.072850 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7aa377dd-008f-4167-8b68-864519aecf91 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:06.073469 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7aa377dd-008f-4167-8b68-864519aecf91 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:06.325740 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-c7f89f73-d9e2-43ff-85de-1a7d19222575 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:11:06.349224 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-c7f89f73-d9e2-43ff-85de-1a7d19222575 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:11:06.351029 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-c7f89f73-d9e2-43ff-85de-1a7d19222575 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:11:06.361800 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-c7f89f73-d9e2-43ff-85de-1a7d19222575 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5" status: 200 len: 1738 microversion: 2.20 time: 0.876106 Sep 14 09:11:06.367161 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2328/4640] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:11:05 2022] GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5 => generated 1738 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:11:06.381357 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a9b49a1c-75d2-4c93-b7b4-d7ca4e025849 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dd4d6708-1fdb-4ad3-8f19-e6f38c2a9664"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:11:06.398781 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-7aa377dd-008f-4167-8b68-864519aecf91 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:11:06.407192 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-a9b49a1c-75d2-4c93-b7b4-d7ca4e025849 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [instance: 81ad242a-93d0-4f76-a6f1-e02e5e537e95] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:11:06.410802 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-7aa377dd-008f-4167-8b68-864519aecf91 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105" status: 200 len: 1668 microversion: 2.1 time: 0.382259 Sep 14 09:11:06.411718 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2313/4641] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:11:06 2022] GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105 => generated 1668 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:11:06.442782 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-cf0bb188-101e-4ad1-a6c8-c2c27acc3cb0 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-213304339"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:11:06.451948 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-cf0bb188-101e-4ad1-a6c8-c2c27acc3cb0 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] [instance: e6f9d068-5708-4f4d-b9fe-ab03179ed31e] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:11:06.453265 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a9b49a1c-75d2-4c93-b7b4-d7ca4e025849 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:06.464713 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a9b49a1c-75d2-4c93-b7b4-d7ca4e025849 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:06.465201 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a9b49a1c-75d2-4c93-b7b4-d7ca4e025849 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:06.467182 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a9b49a1c-75d2-4c93-b7b4-d7ca4e025849 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:06.468435 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a9b49a1c-75d2-4c93-b7b4-d7ca4e025849 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:06.470233 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a9b49a1c-75d2-4c93-b7b4-d7ca4e025849 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:06.472515 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cf0bb188-101e-4ad1-a6c8-c2c27acc3cb0 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:06.481845 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cf0bb188-101e-4ad1-a6c8-c2c27acc3cb0 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:06.482659 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cf0bb188-101e-4ad1-a6c8-c2c27acc3cb0 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:06.486075 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cf0bb188-101e-4ad1-a6c8-c2c27acc3cb0 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:06.486862 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cf0bb188-101e-4ad1-a6c8-c2c27acc3cb0 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:06.490032 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cf0bb188-101e-4ad1-a6c8-c2c27acc3cb0 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:06.992553 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.network.security_group_api [None req-cf0bb188-101e-4ad1-a6c8-c2c27acc3cb0 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Adding security group fbbaaf8a-c7b2-496d-9a1c-7dd85d0b3648 to port ceedee83-069d-49a0-9a90-87bb7bfc25be Sep 14 09:11:07.108861 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-a9b49a1c-75d2-4c93-b7b4-d7ca4e025849 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "POST /compute/v2.1/servers/81ad242a-93d0-4f76-a6f1-e02e5e537e95/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.739454 Sep 14 09:11:07.125552 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2329/4642] 10.222.0.60 () {60 vars in 1323 bytes} [Wed Sep 14 09:11:06 2022] POST /compute/v2.1/servers/81ad242a-93d0-4f76-a6f1-e02e5e537e95/os-volume_attachments => generated 194 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:11:07.147063 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a24a628f-c229-4e91-ab60-9a277524a63c tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:11:07.149027 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-a24a628f-c229-4e91-ab60-9a277524a63c tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:11:07.172706 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a24a628f-c229-4e91-ab60-9a277524a63c tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:07.174260 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a24a628f-c229-4e91-ab60-9a277524a63c tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:07.174980 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a24a628f-c229-4e91-ab60-9a277524a63c tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:07.200709 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a24a628f-c229-4e91-ab60-9a277524a63c tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:07.202073 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a24a628f-c229-4e91-ab60-9a277524a63c tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:07.202555 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a24a628f-c229-4e91-ab60-9a277524a63c tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:07.923953 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-a24a628f-c229-4e91-ab60-9a277524a63c tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:11:07.933915 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-a24a628f-c229-4e91-ab60-9a277524a63c tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105" status: 200 len: 1668 microversion: 2.1 time: 0.804894 Sep 14 09:11:07.951635 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2330/4643] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:11:07 2022] GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105 => generated 1668 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:11:07.972951 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1ab7a6f7-fe20-47b0-8f9f-db9d84e4e224 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:11:07.973870 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-1ab7a6f7-fe20-47b0-8f9f-db9d84e4e224 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:11:07.982309 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1ab7a6f7-fe20-47b0-8f9f-db9d84e4e224 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:07.983112 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1ab7a6f7-fe20-47b0-8f9f-db9d84e4e224 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:07.983780 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1ab7a6f7-fe20-47b0-8f9f-db9d84e4e224 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:07.985402 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1ab7a6f7-fe20-47b0-8f9f-db9d84e4e224 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:07.985950 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1ab7a6f7-fe20-47b0-8f9f-db9d84e4e224 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:07.986590 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1ab7a6f7-fe20-47b0-8f9f-db9d84e4e224 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:08.424769 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-1ab7a6f7-fe20-47b0-8f9f-db9d84e4e224 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:11:08.441787 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-1ab7a6f7-fe20-47b0-8f9f-db9d84e4e224 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:11:08.448726 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-1ab7a6f7-fe20-47b0-8f9f-db9d84e4e224 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:11:08.474981 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-1ab7a6f7-fe20-47b0-8f9f-db9d84e4e224 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5" status: 200 len: 1738 microversion: 2.20 time: 0.517821 Sep 14 09:11:08.494989 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2331/4644] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:11:07 2022] GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5 => generated 1738 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:11:08.501233 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-5099c829-fe02-463e-928c-894ee1da9f1a tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-484174956", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "networks": [{"uuid": "63df5062-0947-41ef-8d8c-a8d82a21791b"}]}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:11:08.550482 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-cf0bb188-101e-4ad1-a6c8-c2c27acc3cb0 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] 10.222.0.60 "POST /compute/v2.1/servers/e6f9d068-5708-4f4d-b9fe-ab03179ed31e/action" status: 202 len: 0 microversion: 2.1 time: 2.135637 Sep 14 09:11:08.551378 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2314/4645] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:11:06 2022] POST /compute/v2.1/servers/e6f9d068-5708-4f4d-b9fe-ab03179ed31e/action => generated 0 bytes in 2137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:11:08.560503 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-97f5d108-0684-483a-8981-5585657c1884 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Calling method '.version_select at 0x7f7d3ee23820>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:11:08.641264 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.network.neutron [None req-5099c829-fe02-463e-928c-894ee1da9f1a tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] validate_networks() for [('63df5062-0947-41ef-8d8c-a8d82a21791b', None, None, None, None, None)] {{(pid=128758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:11:09.228450 n-d-836830-18 devstack@n-api.service[128759]: DEBUG neutronclient.v2_0.client [None req-97f5d108-0684-483a-8981-5585657c1884 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group fbbaaf8a-c7b2-496d-9a1c-7dd85d0b3648 in use.", "detail": ""}} {{(pid=128759) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 14 09:11:09.229224 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-97f5d108-0684-483a-8981-5585657c1884 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] HTTP exception thrown: Security Group fbbaaf8a-c7b2-496d-9a1c-7dd85d0b3648 in use. Sep 14 09:11:09.229224 n-d-836830-18 devstack@n-api.service[128759]: Neutron server returns request_ids: ['req-6aba8b28-a2d7-488f-89df-fa3d4c260468'] Sep 14 09:11:09.231313 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-97f5d108-0684-483a-8981-5585657c1884 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Request method failure captured: Sep 14 09:11:09.231313 n-d-836830-18 devstack@n-api.service[128759]: request: DELETE /compute/v2.1/os-security-groups/fbbaaf8a-c7b2-496d-9a1c-7dd85d0b3648 HTTP/1.1 Sep 14 09:11:09.231313 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:11:09.231313 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:11:09.231313 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:11:09.231313 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:11:09.231313 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:11:09.231313 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:11:09.231313 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:11:09.231313 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:11:09.231313 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZpubEr9UgWj_j7j968HWFZ0D3vsD9X5NGBGI22hLpa671vkRnOFuLUHN5BGyBOTOD_eSiiXbv14AW_KXyWtJ-nEaHjFTRMlAQdICZGgh9e4MfCMr0iqhNEP0c19crMOXUBhQTUSoeq6F9tEyTwVcFxkCl04_QVOcf30LScxQWEOmzE Sep 14 09:11:09.231313 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:11:09.231313 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:11:09.231313 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:11:09.231313 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:11:09.231313 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:11:09.231313 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:11:09.231313 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: de0783155bf04154bf28fc70bcb7580d Sep 14 09:11:09.231313 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-SecurityGroupsTestJSON-367581750 Sep 14 09:11:09.231313 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:11:09.231313 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:11:09.231313 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/de0783155bf04154bf28fc70bcb7580d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_de0783155bf04154bf28fc70bcb7580d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/de0783155bf04154bf28fc70bcb7580d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/de0783155bf04154bf28fc70bcb7580d"}]}] Sep 14 09:11:09.231313 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-SecurityGroupsTestJSON-367581750 Sep 14 09:11:09.231313 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: de0783155bf04154bf28fc70bcb7580d Sep 14 09:11:09.231313 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-367581750 Sep 14 09:11:09.231313 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-SecurityGroupsTestJSON-367581750-project Sep 14 09:11:09.231313 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:11:09.231313 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:11:09.231313 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 2dabfdd5a6e049c48d00bc1b55a0a30f Sep 14 09:11:09.231313 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-SecurityGroupsTestJSON-367581750-project Sep 14 09:11:09.231313 n-d-836830-18 devstack@n-api.service[128759]: method: Sep 14 09:11:09.231313 n-d-836830-18 devstack@n-api.service[128759]: exception: Security Group fbbaaf8a-c7b2-496d-9a1c-7dd85d0b3648 in use. Sep 14 09:11:09.231313 n-d-836830-18 devstack@n-api.service[128759]: Neutron server returns request_ids: ['req-6aba8b28-a2d7-488f-89df-fa3d4c260468'] Sep 14 09:11:09.231313 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': 'fbbaaf8a-c7b2-496d-9a1c-7dd85d0b3648'} Sep 14 09:11:09.231313 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:11:09.231313 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:11:09.231313 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Sep 14 09:11:09.231313 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Sep 14 09:11:09.231313 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:11:09.231313 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:11:09.231313 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Sep 14 09:11:09.231313 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Sep 14 09:11:09.231313 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:11:09.231313 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:11:09.231313 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Sep 14 09:11:09.231313 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Sep 14 09:11:09.231313 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:11:09.231313 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:11:09.231313 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 14 09:11:09.231313 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 14 09:11:09.231313 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:11:09.231313 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:11:09.231313 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 14 09:11:09.231313 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 14 09:11:09.231313 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:11:09.231313 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:11:09.231313 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 14 09:11:09.231313 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 14 09:11:09.231313 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 14 09:11:09.231313 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 14 09:11:09.231313 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group fbbaaf8a-c7b2-496d-9a1c-7dd85d0b3648 in use. Sep 14 09:11:09.235427 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6aba8b28-a2d7-488f-89df-fa3d4c260468'] Sep 14 09:11:09.235427 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:11:09.235427 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:11:09.235427 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:11:09.235427 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:11:09.235427 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Sep 14 09:11:09.235427 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Sep 14 09:11:09.235427 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Sep 14 09:11:09.235427 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Sep 14 09:11:09.235427 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group fbbaaf8a-c7b2-496d-9a1c-7dd85d0b3648 in use. Sep 14 09:11:09.235427 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6aba8b28-a2d7-488f-89df-fa3d4c260468'] Sep 14 09:11:09.235427 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:11:09.235427 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:11:09.235427 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:11:09.235427 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:11:09.235427 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:11:09.235427 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:11:09.235427 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:11:09.235427 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:11:09.235427 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:11:09.235427 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:11:09.235427 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:11:09.235427 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:11:09.235427 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Sep 14 09:11:09.235427 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 14 09:11:09.235427 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group fbbaaf8a-c7b2-496d-9a1c-7dd85d0b3648 in use. Sep 14 09:11:09.235427 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6aba8b28-a2d7-488f-89df-fa3d4c260468'] Sep 14 09:11:09.235427 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:11:09.235427 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:11:09.235427 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:11:09.235427 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:11:09.235427 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:11:09.235427 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:11:09.235427 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:11:09.235427 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:11:09.235427 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group fbbaaf8a-c7b2-496d-9a1c-7dd85d0b3648 in use. Sep 14 09:11:09.235427 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6aba8b28-a2d7-488f-89df-fa3d4c260468'] Sep 14 09:11:09.235427 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:11:09.235427 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-97f5d108-0684-483a-8981-5585657c1884 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Returning 400 to user: Security Group fbbaaf8a-c7b2-496d-9a1c-7dd85d0b3648 in use. Sep 14 09:11:09.235427 n-d-836830-18 devstack@n-api.service[128759]: Neutron server returns request_ids: ['req-6aba8b28-a2d7-488f-89df-fa3d4c260468'] {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:11:09.235427 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-97f5d108-0684-483a-8981-5585657c1884 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/fbbaaf8a-c7b2-496d-9a1c-7dd85d0b3648" status: 400 len: 185 microversion: 2.1 time: 0.677349 Sep 14 09:11:09.235427 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2315/4646] 10.222.0.60 () {58 vars in 1272 bytes} [Wed Sep 14 09:11:08 2022] DELETE /compute/v2.1/os-security-groups/fbbaaf8a-c7b2-496d-9a1c-7dd85d0b3648 => generated 185 bytes in 678 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 14 09:11:09.254696 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-89a2f327-1b98-4021-856f-a51f726f269f req-0459340a-ad3c-4193-9dd8-31289c2235f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6f9d068-5708-4f4d-b9fe-ab03179ed31e", "tag": "ceedee83-069d-49a0-9a90-87bb7bfc25be"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:11:09.267532 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-89a2f327-1b98-4021-856f-a51f726f269f req-0459340a-ad3c-4193-9dd8-31289c2235f5 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:09.270434 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-89a2f327-1b98-4021-856f-a51f726f269f req-0459340a-ad3c-4193-9dd8-31289c2235f5 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:09.272535 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-89a2f327-1b98-4021-856f-a51f726f269f req-0459340a-ad3c-4193-9dd8-31289c2235f5 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:09.301357 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-89a2f327-1b98-4021-856f-a51f726f269f req-0459340a-ad3c-4193-9dd8-31289c2235f5 service nova] Creating event network-changed:ceedee83-069d-49a0-9a90-87bb7bfc25be for instance e6f9d068-5708-4f4d-b9fe-ab03179ed31e on n-h1-836830-18 Sep 14 09:11:09.326892 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-89a2f327-1b98-4021-856f-a51f726f269f req-0459340a-ad3c-4193-9dd8-31289c2235f5 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092170 Sep 14 09:11:09.327595 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2316/4647] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:11:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:11:09.360874 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d23e3814-a410-464f-8713-8dc02f6e73b3 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:11:09.368423 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-d23e3814-a410-464f-8713-8dc02f6e73b3 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] [instance: e6f9d068-5708-4f4d-b9fe-ab03179ed31e] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:11:09.392204 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d23e3814-a410-464f-8713-8dc02f6e73b3 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:09.392878 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d23e3814-a410-464f-8713-8dc02f6e73b3 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:09.393460 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d23e3814-a410-464f-8713-8dc02f6e73b3 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:09.398594 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d23e3814-a410-464f-8713-8dc02f6e73b3 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:09.399344 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d23e3814-a410-464f-8713-8dc02f6e73b3 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:09.399962 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d23e3814-a410-464f-8713-8dc02f6e73b3 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:09.488328 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-d23e3814-a410-464f-8713-8dc02f6e73b3 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] [instance: e6f9d068-5708-4f4d-b9fe-ab03179ed31e] Going to try to terminate instance {{(pid=128759) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:11:09.788988 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d23e3814-a410-464f-8713-8dc02f6e73b3 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] 10.222.0.60 "DELETE /compute/v2.1/servers/e6f9d068-5708-4f4d-b9fe-ab03179ed31e" status: 204 len: 0 microversion: 2.1 time: 0.459045 Sep 14 09:11:09.790145 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2317/4648] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:11:09 2022] DELETE /compute/v2.1/servers/e6f9d068-5708-4f4d-b9fe-ab03179ed31e => generated 0 bytes in 461 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:11:09.812160 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-84e6edee-997d-495f-a1b2-e191a61ec620 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:11:09.812932 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-84e6edee-997d-495f-a1b2-e191a61ec620 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:11:09.826635 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-84e6edee-997d-495f-a1b2-e191a61ec620 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:09.827154 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-84e6edee-997d-495f-a1b2-e191a61ec620 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:09.827591 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-84e6edee-997d-495f-a1b2-e191a61ec620 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:09.828373 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-84e6edee-997d-495f-a1b2-e191a61ec620 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:09.828830 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-84e6edee-997d-495f-a1b2-e191a61ec620 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:09.829251 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-84e6edee-997d-495f-a1b2-e191a61ec620 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:09.896355 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-5099c829-fe02-463e-928c-894ee1da9f1a tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Flavor limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:11:09.897592 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-5099c829-fe02-463e-928c-894ee1da9f1a tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Image limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:11:09.898315 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-5099c829-fe02-463e-928c-894ee1da9f1a tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Flavor pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:11:09.899002 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-5099c829-fe02-463e-928c-894ee1da9f1a tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Image pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:11:09.899726 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-5099c829-fe02-463e-928c-894ee1da9f1a tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:11:09.917591 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5099c829-fe02-463e-928c-894ee1da9f1a tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:09.918394 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5099c829-fe02-463e-928c-894ee1da9f1a tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:09.919113 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5099c829-fe02-463e-928c-894ee1da9f1a tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:09.920112 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5099c829-fe02-463e-928c-894ee1da9f1a tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:09.920807 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5099c829-fe02-463e-928c-894ee1da9f1a tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:09.922762 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5099c829-fe02-463e-928c-894ee1da9f1a tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:09.945830 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-5099c829-fe02-463e-928c-894ee1da9f1a tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Getting quotas for project 2f075a2c6aa4489abb3428e0a4ac5738. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:11:09.952581 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-5099c829-fe02-463e-928c-894ee1da9f1a tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Getting quotas for user 950da33830ae4ae1a5511dd146e4e3be and project 2f075a2c6aa4489abb3428e0a4ac5738. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:11:10.037418 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-5099c829-fe02-463e-928c-894ee1da9f1a tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Going to run 1 instances... {{(pid=128758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:11:10.057410 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-5099c829-fe02-463e-928c-894ee1da9f1a tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 0ba2a1b2-907f-4598-931a-c6605ffe5682] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:11:10.180272 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-5099c829-fe02-463e-928c-894ee1da9f1a tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.699204 Sep 14 09:11:10.184809 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2332/4649] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 09:11:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1704 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:11:10.205531 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-eea7d124-3143-4602-89d2-a7de6c9803a2 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:11:10.211344 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-eea7d124-3143-4602-89d2-a7de6c9803a2 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] [instance: e6f9d068-5708-4f4d-b9fe-ab03179ed31e] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:11:10.230744 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-eea7d124-3143-4602-89d2-a7de6c9803a2 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:10.232294 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-eea7d124-3143-4602-89d2-a7de6c9803a2 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:10.232761 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-eea7d124-3143-4602-89d2-a7de6c9803a2 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:10.233495 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-eea7d124-3143-4602-89d2-a7de6c9803a2 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:10.236928 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-eea7d124-3143-4602-89d2-a7de6c9803a2 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:10.237597 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-eea7d124-3143-4602-89d2-a7de6c9803a2 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:10.714480 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-eea7d124-3143-4602-89d2-a7de6c9803a2 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dabfdd5a6e049c48d00bc1b55a0a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0783155bf04154bf28fc70bcb7580d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:11:10.726262 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-eea7d124-3143-4602-89d2-a7de6c9803a2 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] 10.222.0.60 "GET /compute/v2.1/servers/e6f9d068-5708-4f4d-b9fe-ab03179ed31e" status: 200 len: 1648 microversion: 2.1 time: 0.537516 Sep 14 09:11:10.746817 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2333/4650] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:11:10 2022] GET /compute/v2.1/servers/e6f9d068-5708-4f4d-b9fe-ab03179ed31e => generated 1648 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:11:10.754651 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-84e6edee-997d-495f-a1b2-e191a61ec620 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:11:10.778721 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-84e6edee-997d-495f-a1b2-e191a61ec620 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:11:10.783486 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-84e6edee-997d-495f-a1b2-e191a61ec620 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:11:10.784962 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-84e6edee-997d-495f-a1b2-e191a61ec620 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5" status: 200 len: 1738 microversion: 2.20 time: 0.993793 Sep 14 09:11:10.785219 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-fd2d2540-e498-4a83-b6bc-09bd039268bc tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:11:10.786743 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-fd2d2540-e498-4a83-b6bc-09bd039268bc tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 0ba2a1b2-907f-4598-931a-c6605ffe5682] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:11:10.793041 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2318/4651] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:11:09 2022] GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5 => generated 1738 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:11:10.939515 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-fd2d2540-e498-4a83-b6bc-09bd039268bc tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:11:10.949691 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-fd2d2540-e498-4a83-b6bc-09bd039268bc tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/0ba2a1b2-907f-4598-931a-c6605ffe5682" status: 200 len: 1214 microversion: 2.1 time: 0.201195 Sep 14 09:11:10.963532 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2334/4652] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:11:10 2022] GET /compute/v2.1/servers/0ba2a1b2-907f-4598-931a-c6605ffe5682 => generated 1214 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:11:11.749728 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-86d3f9dc-ebcf-43e4-9dd0-bd0839bf98c6 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:11:11.750397 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-86d3f9dc-ebcf-43e4-9dd0-bd0839bf98c6 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] [instance: e6f9d068-5708-4f4d-b9fe-ab03179ed31e] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:11:11.760646 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-86d3f9dc-ebcf-43e4-9dd0-bd0839bf98c6 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:11.761143 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-86d3f9dc-ebcf-43e4-9dd0-bd0839bf98c6 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:11.761587 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-86d3f9dc-ebcf-43e4-9dd0-bd0839bf98c6 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:11.762290 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-86d3f9dc-ebcf-43e4-9dd0-bd0839bf98c6 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:11.762760 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-86d3f9dc-ebcf-43e4-9dd0-bd0839bf98c6 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:11.780669 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-86d3f9dc-ebcf-43e4-9dd0-bd0839bf98c6 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:11.821457 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b332e031-5071-4426-b940-7febc7e6195c tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:11:11.822288 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-b332e031-5071-4426-b940-7febc7e6195c tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:11:11.844535 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b332e031-5071-4426-b940-7febc7e6195c tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:11.853749 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b332e031-5071-4426-b940-7febc7e6195c tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:11.859654 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b332e031-5071-4426-b940-7febc7e6195c tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:11.860712 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b332e031-5071-4426-b940-7febc7e6195c tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:11.861903 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b332e031-5071-4426-b940-7febc7e6195c tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:11.863044 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b332e031-5071-4426-b940-7febc7e6195c tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:12.728081 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-b332e031-5071-4426-b940-7febc7e6195c tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:11:12.746129 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-b332e031-5071-4426-b940-7febc7e6195c tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:11:12.758063 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-b332e031-5071-4426-b940-7febc7e6195c tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:11:12.760847 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-b332e031-5071-4426-b940-7febc7e6195c tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5" status: 200 len: 1738 microversion: 2.20 time: 0.943544 Sep 14 09:11:12.786841 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2335/4653] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:11:11 2022] GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5 => generated 1738 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 09:11:12.800905 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-bdf70592-7524-4afc-bfd6-b1bdeaccd9a4 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:11:12.801867 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-bdf70592-7524-4afc-bfd6-b1bdeaccd9a4 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 0ba2a1b2-907f-4598-931a-c6605ffe5682] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:11:12.819193 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bdf70592-7524-4afc-bfd6-b1bdeaccd9a4 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:12.820143 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bdf70592-7524-4afc-bfd6-b1bdeaccd9a4 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:12.822400 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bdf70592-7524-4afc-bfd6-b1bdeaccd9a4 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:12.824560 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bdf70592-7524-4afc-bfd6-b1bdeaccd9a4 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:12.826741 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bdf70592-7524-4afc-bfd6-b1bdeaccd9a4 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:12.827879 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bdf70592-7524-4afc-bfd6-b1bdeaccd9a4 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:13.076384 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-bdf70592-7524-4afc-bfd6-b1bdeaccd9a4 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:11:13.114594 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-bdf70592-7524-4afc-bfd6-b1bdeaccd9a4 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/0ba2a1b2-907f-4598-931a-c6605ffe5682" status: 200 len: 1266 microversion: 2.1 time: 0.320835 Sep 14 09:11:13.117046 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2336/4654] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:11:12 2022] GET /compute/v2.1/servers/0ba2a1b2-907f-4598-931a-c6605ffe5682 => generated 1266 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:11:13.624713 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-98e43da5-ee21-4fb3-a30d-69c50b928191 req-361087f4-5e41-41ae-8883-96567cbf0dad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6f9d068-5708-4f4d-b9fe-ab03179ed31e", "name": "network-vif-deleted", "tag": "ceedee83-069d-49a0-9a90-87bb7bfc25be"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:11:13.646060 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-98e43da5-ee21-4fb3-a30d-69c50b928191 req-361087f4-5e41-41ae-8883-96567cbf0dad service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:13.646807 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-98e43da5-ee21-4fb3-a30d-69c50b928191 req-361087f4-5e41-41ae-8883-96567cbf0dad service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:13.650302 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-86d3f9dc-ebcf-43e4-9dd0-bd0839bf98c6 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dabfdd5a6e049c48d00bc1b55a0a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0783155bf04154bf28fc70bcb7580d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:11:13.661727 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-98e43da5-ee21-4fb3-a30d-69c50b928191 req-361087f4-5e41-41ae-8883-96567cbf0dad service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:13.669335 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-86d3f9dc-ebcf-43e4-9dd0-bd0839bf98c6 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] 10.222.0.60 "GET /compute/v2.1/servers/e6f9d068-5708-4f4d-b9fe-ab03179ed31e" status: 200 len: 1648 microversion: 2.1 time: 1.915385 Sep 14 09:11:13.683986 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2319/4655] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:11:11 2022] GET /compute/v2.1/servers/e6f9d068-5708-4f4d-b9fe-ab03179ed31e => generated 1648 bytes in 1939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:11:13.698659 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-98e43da5-ee21-4fb3-a30d-69c50b928191 req-361087f4-5e41-41ae-8883-96567cbf0dad service nova] Creating event network-vif-deleted:ceedee83-069d-49a0-9a90-87bb7bfc25be for instance e6f9d068-5708-4f4d-b9fe-ab03179ed31e on n-h1-836830-18 Sep 14 09:11:13.732914 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-98e43da5-ee21-4fb3-a30d-69c50b928191 req-361087f4-5e41-41ae-8883-96567cbf0dad service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112021 Sep 14 09:11:13.737090 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2337/4656] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:11:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:11:13.793477 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-570f88a8-26e6-49c7-97ad-d7734dd6bd5c tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:11:13.794092 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-570f88a8-26e6-49c7-97ad-d7734dd6bd5c tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:11:13.815196 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-570f88a8-26e6-49c7-97ad-d7734dd6bd5c tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:13.815832 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-570f88a8-26e6-49c7-97ad-d7734dd6bd5c tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:13.819402 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-570f88a8-26e6-49c7-97ad-d7734dd6bd5c tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:13.823365 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-570f88a8-26e6-49c7-97ad-d7734dd6bd5c tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:13.823863 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-570f88a8-26e6-49c7-97ad-d7734dd6bd5c tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:13.824311 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-570f88a8-26e6-49c7-97ad-d7734dd6bd5c tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:14.142997 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-7829b129-1631-4902-b2a8-aa3d270b4ccc tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:11:14.144190 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-7829b129-1631-4902-b2a8-aa3d270b4ccc tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 0ba2a1b2-907f-4598-931a-c6605ffe5682] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:11:14.172539 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:11:14.174281 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7829b129-1631-4902-b2a8-aa3d270b4ccc tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:14.175162 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7829b129-1631-4902-b2a8-aa3d270b4ccc tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:14.175301 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7829b129-1631-4902-b2a8-aa3d270b4ccc tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:14.175939 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7829b129-1631-4902-b2a8-aa3d270b4ccc tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:14.176402 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7829b129-1631-4902-b2a8-aa3d270b4ccc tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:14.176830 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7829b129-1631-4902-b2a8-aa3d270b4ccc tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:14.486995 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-7829b129-1631-4902-b2a8-aa3d270b4ccc tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:11:14.487499 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-570f88a8-26e6-49c7-97ad-d7734dd6bd5c tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:11:14.501034 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-570f88a8-26e6-49c7-97ad-d7734dd6bd5c tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:11:14.505660 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-7829b129-1631-4902-b2a8-aa3d270b4ccc tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/0ba2a1b2-907f-4598-931a-c6605ffe5682" status: 200 len: 1272 microversion: 2.1 time: 0.367506 Sep 14 09:11:14.514522 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2338/4657] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:11:14 2022] GET /compute/v2.1/servers/0ba2a1b2-907f-4598-931a-c6605ffe5682 => generated 1272 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:11:14.517118 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-570f88a8-26e6-49c7-97ad-d7734dd6bd5c tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:11:14.522004 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-570f88a8-26e6-49c7-97ad-d7734dd6bd5c tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5" status: 200 len: 1738 microversion: 2.20 time: 0.732438 Sep 14 09:11:14.523317 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2320/4658] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:11:13 2022] GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5 => generated 1738 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:11:14.698154 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-0758ff0f-cd79-46fa-bf11-505a4248e3dc tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:11:14.698916 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-0758ff0f-cd79-46fa-bf11-505a4248e3dc tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] [instance: e6f9d068-5708-4f4d-b9fe-ab03179ed31e] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:11:14.721830 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0758ff0f-cd79-46fa-bf11-505a4248e3dc tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:14.741302 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0758ff0f-cd79-46fa-bf11-505a4248e3dc tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:14.743443 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0758ff0f-cd79-46fa-bf11-505a4248e3dc tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:14.744392 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0758ff0f-cd79-46fa-bf11-505a4248e3dc tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:14.746622 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0758ff0f-cd79-46fa-bf11-505a4248e3dc tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:14.747986 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0758ff0f-cd79-46fa-bf11-505a4248e3dc tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:14.891463 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0758ff0f-cd79-46fa-bf11-505a4248e3dc tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:14.894780 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0758ff0f-cd79-46fa-bf11-505a4248e3dc tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:14.895788 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0758ff0f-cd79-46fa-bf11-505a4248e3dc tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:14.896712 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.objects.instance [None req-0758ff0f-cd79-46fa-bf11-505a4248e3dc tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lazy-loading 'fault' on Instance uuid e6f9d068-5708-4f4d-b9fe-ab03179ed31e {{(pid=128758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:11:14.961423 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-0758ff0f-cd79-46fa-bf11-505a4248e3dc tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dabfdd5a6e049c48d00bc1b55a0a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0783155bf04154bf28fc70bcb7580d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:11:14.975357 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-0758ff0f-cd79-46fa-bf11-505a4248e3dc tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] 10.222.0.60 "GET /compute/v2.1/servers/e6f9d068-5708-4f4d-b9fe-ab03179ed31e" status: 200 len: 1306 microversion: 2.1 time: 0.282543 Sep 14 09:11:14.986789 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2339/4659] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:11:14 2022] GET /compute/v2.1/servers/e6f9d068-5708-4f4d-b9fe-ab03179ed31e => generated 1306 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:11:15.530513 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-bbb53b92-ef45-434d-8e80-0d1739081c66 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:11:15.532469 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-bbb53b92-ef45-434d-8e80-0d1739081c66 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 0ba2a1b2-907f-4598-931a-c6605ffe5682] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:11:15.536214 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:11:15.556858 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bbb53b92-ef45-434d-8e80-0d1739081c66 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:15.561807 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-0710e21b-10d8-47ce-bc5e-d0a69e77570b tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:11:15.562837 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-0710e21b-10d8-47ce-bc5e-d0a69e77570b tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:11:15.571438 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bbb53b92-ef45-434d-8e80-0d1739081c66 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:15.581046 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bbb53b92-ef45-434d-8e80-0d1739081c66 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:15.584075 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bbb53b92-ef45-434d-8e80-0d1739081c66 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:15.585830 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0710e21b-10d8-47ce-bc5e-d0a69e77570b tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:15.586798 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bbb53b92-ef45-434d-8e80-0d1739081c66 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:15.587854 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0710e21b-10d8-47ce-bc5e-d0a69e77570b tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:15.588899 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bbb53b92-ef45-434d-8e80-0d1739081c66 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:15.589734 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0710e21b-10d8-47ce-bc5e-d0a69e77570b tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:15.597008 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0710e21b-10d8-47ce-bc5e-d0a69e77570b tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:15.599946 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0710e21b-10d8-47ce-bc5e-d0a69e77570b tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:15.601433 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0710e21b-10d8-47ce-bc5e-d0a69e77570b tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:16.301101 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-bbb53b92-ef45-434d-8e80-0d1739081c66 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:11:16.320850 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-bbb53b92-ef45-434d-8e80-0d1739081c66 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/0ba2a1b2-907f-4598-931a-c6605ffe5682" status: 200 len: 1272 microversion: 2.1 time: 0.794876 Sep 14 09:11:16.322073 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2321/4660] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:11:15 2022] GET /compute/v2.1/servers/0ba2a1b2-907f-4598-931a-c6605ffe5682 => generated 1272 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:11:16.334818 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-246cf99a-0a90-49a3-9700-886bb1a42717 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:11:16.335733 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-246cf99a-0a90-49a3-9700-886bb1a42717 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] [instance: e6f9d068-5708-4f4d-b9fe-ab03179ed31e] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:11:16.366151 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-246cf99a-0a90-49a3-9700-886bb1a42717 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:16.368127 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-246cf99a-0a90-49a3-9700-886bb1a42717 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:16.369380 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-246cf99a-0a90-49a3-9700-886bb1a42717 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:16.373135 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-246cf99a-0a90-49a3-9700-886bb1a42717 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:16.375048 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-246cf99a-0a90-49a3-9700-886bb1a42717 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:16.376848 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-246cf99a-0a90-49a3-9700-886bb1a42717 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:16.502447 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-246cf99a-0a90-49a3-9700-886bb1a42717 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] HTTP exception thrown: Instance e6f9d068-5708-4f4d-b9fe-ab03179ed31e could not be found. Sep 14 09:11:16.508872 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-246cf99a-0a90-49a3-9700-886bb1a42717 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Request method failure captured: Sep 14 09:11:16.508872 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/e6f9d068-5708-4f4d-b9fe-ab03179ed31e HTTP/1.1 Sep 14 09:11:16.508872 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:11:16.508872 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:11:16.508872 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:11:16.508872 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:11:16.508872 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:11:16.508872 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:11:16.508872 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:11:16.508872 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:11:16.508872 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZpubEr9UgWj_j7j968HWFZ0D3vsD9X5NGBGI22hLpa671vkRnOFuLUHN5BGyBOTOD_eSiiXbv14AW_KXyWtJ-nEaHjFTRMlAQdICZGgh9e4MfCMr0iqhNEP0c19crMOXUBhQTUSoeq6F9tEyTwVcFxkCl04_QVOcf30LScxQWEOmzE Sep 14 09:11:16.508872 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:11:16.508872 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:11:16.508872 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:11:16.508872 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:11:16.508872 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:11:16.508872 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:11:16.508872 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: de0783155bf04154bf28fc70bcb7580d Sep 14 09:11:16.508872 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-SecurityGroupsTestJSON-367581750 Sep 14 09:11:16.508872 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:11:16.508872 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:11:16.508872 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/de0783155bf04154bf28fc70bcb7580d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_de0783155bf04154bf28fc70bcb7580d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/de0783155bf04154bf28fc70bcb7580d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/de0783155bf04154bf28fc70bcb7580d"}]}] Sep 14 09:11:16.508872 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-SecurityGroupsTestJSON-367581750 Sep 14 09:11:16.508872 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: de0783155bf04154bf28fc70bcb7580d Sep 14 09:11:16.508872 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-367581750 Sep 14 09:11:16.508872 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-SecurityGroupsTestJSON-367581750-project Sep 14 09:11:16.508872 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:11:16.508872 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:11:16.508872 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 2dabfdd5a6e049c48d00bc1b55a0a30f Sep 14 09:11:16.508872 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-SecurityGroupsTestJSON-367581750-project Sep 14 09:11:16.508872 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:11:16.508872 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance e6f9d068-5708-4f4d-b9fe-ab03179ed31e could not be found. Sep 14 09:11:16.508872 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': 'e6f9d068-5708-4f4d-b9fe-ab03179ed31e'} Sep 14 09:11:16.508872 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:11:16.508872 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:11:16.508872 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:11:16.508872 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:11:16.508872 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:11:16.508872 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:11:16.508872 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:11:16.508872 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:11:16.508872 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:11:16.508872 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:11:16.508872 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6f9d068-5708-4f4d-b9fe-ab03179ed31e could not be found. Sep 14 09:11:16.508872 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:11:16.508872 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:11:16.508872 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:11:16.508872 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:11:16.508872 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:11:16.508872 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:11:16.508872 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:11:16.508872 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:11:16.508872 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:11:16.508872 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:11:16.508872 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:11:16.508872 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:11:16.508872 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:11:16.508872 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:11:16.508872 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:11:16.508872 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:11:16.508872 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6f9d068-5708-4f4d-b9fe-ab03179ed31e could not be found. Sep 14 09:11:16.508872 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:11:16.508872 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:11:16.508872 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:11:16.514368 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:11:16.514368 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:11:16.514368 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:11:16.514368 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:11:16.514368 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:11:16.514368 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6f9d068-5708-4f4d-b9fe-ab03179ed31e could not be found. Sep 14 09:11:16.514368 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:11:16.520319 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-246cf99a-0a90-49a3-9700-886bb1a42717 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Returning 404 to user: Instance e6f9d068-5708-4f4d-b9fe-ab03179ed31e could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:11:16.524816 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-246cf99a-0a90-49a3-9700-886bb1a42717 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] 10.222.0.60 "GET /compute/v2.1/servers/e6f9d068-5708-4f4d-b9fe-ab03179ed31e" status: 404 len: 111 microversion: 2.1 time: 0.196819 Sep 14 09:11:16.537734 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2322/4661] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:11:16 2022] GET /compute/v2.1/servers/e6f9d068-5708-4f4d-b9fe-ab03179ed31e => generated 111 bytes in 214 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:11:16.576348 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-cad6d320-3b36-4e48-b6f7-9b33e0d0dba5 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Calling method '.version_select at 0x7f7d3ef02670>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:11:17.323846 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-0710e21b-10d8-47ce-bc5e-d0a69e77570b tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:11:17.342634 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-0710e21b-10d8-47ce-bc5e-d0a69e77570b tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:11:17.349199 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-0710e21b-10d8-47ce-bc5e-d0a69e77570b tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:11:17.350870 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-0710e21b-10d8-47ce-bc5e-d0a69e77570b tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5" status: 200 len: 1738 microversion: 2.20 time: 1.796969 Sep 14 09:11:17.354169 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2340/4662] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:11:15 2022] GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5 => generated 1738 bytes in 1801 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:11:17.372203 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-bb334a23-1800-48fc-8f1a-a9d5b2191dcf tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:11:17.376117 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-bb334a23-1800-48fc-8f1a-a9d5b2191dcf tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 0ba2a1b2-907f-4598-931a-c6605ffe5682] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:11:17.412027 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bb334a23-1800-48fc-8f1a-a9d5b2191dcf tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:17.412791 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bb334a23-1800-48fc-8f1a-a9d5b2191dcf tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:17.413981 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bb334a23-1800-48fc-8f1a-a9d5b2191dcf tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:17.415351 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bb334a23-1800-48fc-8f1a-a9d5b2191dcf tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:17.417148 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bb334a23-1800-48fc-8f1a-a9d5b2191dcf tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:17.418421 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bb334a23-1800-48fc-8f1a-a9d5b2191dcf tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:18.434553 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-bb334a23-1800-48fc-8f1a-a9d5b2191dcf tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:11:18.449638 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-bb334a23-1800-48fc-8f1a-a9d5b2191dcf tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/0ba2a1b2-907f-4598-931a-c6605ffe5682" status: 200 len: 1314 microversion: 2.1 time: 1.093978 Sep 14 09:11:18.451506 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2341/4663] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:11:17 2022] GET /compute/v2.1/servers/0ba2a1b2-907f-4598-931a-c6605ffe5682 => generated 1314 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:11:18.466545 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1c2965b8-2aba-43b5-90f9-7ec9fbca9e78 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:11:18.467876 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-1c2965b8-2aba-43b5-90f9-7ec9fbca9e78 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:11:18.482240 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1c2965b8-2aba-43b5-90f9-7ec9fbca9e78 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:18.483173 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1c2965b8-2aba-43b5-90f9-7ec9fbca9e78 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:18.483886 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1c2965b8-2aba-43b5-90f9-7ec9fbca9e78 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:18.485417 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1c2965b8-2aba-43b5-90f9-7ec9fbca9e78 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:18.486122 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1c2965b8-2aba-43b5-90f9-7ec9fbca9e78 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:18.488414 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1c2965b8-2aba-43b5-90f9-7ec9fbca9e78 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:19.160978 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-cad6d320-3b36-4e48-b6f7-9b33e0d0dba5 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/523f0cb2-3dce-4392-9ab2-3b37cd888198" status: 202 len: 0 microversion: 2.1 time: 2.620836 Sep 14 09:11:19.161715 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2323/4664] 10.222.0.60 () {58 vars in 1272 bytes} [Wed Sep 14 09:11:16 2022] DELETE /compute/v2.1/os-security-groups/523f0cb2-3dce-4392-9ab2-3b37cd888198 => generated 0 bytes in 2622 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:11:19.170131 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-bd02549c-6ad8-4fac-a7da-142941b57a18 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Calling method '.version_select at 0x7f7d3ef5c040>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:11:19.712931 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-1c2965b8-2aba-43b5-90f9-7ec9fbca9e78 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:11:19.733089 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-1c2965b8-2aba-43b5-90f9-7ec9fbca9e78 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:11:19.734731 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-1c2965b8-2aba-43b5-90f9-7ec9fbca9e78 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:11:19.736012 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-1c2965b8-2aba-43b5-90f9-7ec9fbca9e78 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5" status: 200 len: 1738 microversion: 2.20 time: 1.282448 Sep 14 09:11:19.743324 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2342/4665] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:11:18 2022] GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5 => generated 1738 bytes in 1290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:11:19.760860 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-c6f62cdc-a92c-4857-a689-e264f23d5db6 req-4e1ec88e-55c9-4935-ad8b-eba7eb469cd1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ba2a1b2-907f-4598-931a-c6605ffe5682", "tag": "fbe17787-eb51-420c-a0a5-759d340dee8c"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:11:19.792061 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-c6f62cdc-a92c-4857-a689-e264f23d5db6 req-4e1ec88e-55c9-4935-ad8b-eba7eb469cd1 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:19.794915 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-c6f62cdc-a92c-4857-a689-e264f23d5db6 req-4e1ec88e-55c9-4935-ad8b-eba7eb469cd1 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:19.795527 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-c6f62cdc-a92c-4857-a689-e264f23d5db6 req-4e1ec88e-55c9-4935-ad8b-eba7eb469cd1 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:19.830605 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-c6f62cdc-a92c-4857-a689-e264f23d5db6 req-4e1ec88e-55c9-4935-ad8b-eba7eb469cd1 service nova] Creating event network-changed:fbe17787-eb51-420c-a0a5-759d340dee8c for instance 0ba2a1b2-907f-4598-931a-c6605ffe5682 on n-h1-836830-18 Sep 14 09:11:19.856959 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-c6f62cdc-a92c-4857-a689-e264f23d5db6 req-4e1ec88e-55c9-4935-ad8b-eba7eb469cd1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112229 Sep 14 09:11:19.857592 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2343/4666] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:11:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:11:19.875595 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-3ab5fc34-13eb-4495-acf2-c15405ef1dc2 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:11:19.876323 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-3ab5fc34-13eb-4495-acf2-c15405ef1dc2 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 0ba2a1b2-907f-4598-931a-c6605ffe5682] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:11:19.926220 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3ab5fc34-13eb-4495-acf2-c15405ef1dc2 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:19.933831 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3ab5fc34-13eb-4495-acf2-c15405ef1dc2 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:19.934959 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3ab5fc34-13eb-4495-acf2-c15405ef1dc2 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:19.938890 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3ab5fc34-13eb-4495-acf2-c15405ef1dc2 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:19.943336 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3ab5fc34-13eb-4495-acf2-c15405ef1dc2 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:19.946888 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3ab5fc34-13eb-4495-acf2-c15405ef1dc2 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:19.954590 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=2 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:11:20.461894 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-3ab5fc34-13eb-4495-acf2-c15405ef1dc2 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:11:20.489406 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-3ab5fc34-13eb-4495-acf2-c15405ef1dc2 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/0ba2a1b2-907f-4598-931a-c6605ffe5682" status: 200 len: 1314 microversion: 2.1 time: 0.625768 Sep 14 09:11:20.490324 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2344/4667] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:11:19 2022] GET /compute/v2.1/servers/0ba2a1b2-907f-4598-931a-c6605ffe5682 => generated 1314 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:11:20.520080 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-bd02549c-6ad8-4fac-a7da-142941b57a18 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/fbbaaf8a-c7b2-496d-9a1c-7dd85d0b3648" status: 202 len: 0 microversion: 2.1 time: 1.353481 Sep 14 09:11:20.521947 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2324/4668] 10.222.0.60 () {58 vars in 1272 bytes} [Wed Sep 14 09:11:19 2022] DELETE /compute/v2.1/os-security-groups/fbbaaf8a-c7b2-496d-9a1c-7dd85d0b3648 => generated 0 bytes in 1357 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 14 09:11:20.538504 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a5a4fa64-a52f-4da0-9e76-a1bc31c9d8fe tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Action: 'create', calling method: .version_select at 0x7f7d3f59f550>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1401353547", "description": "tempest-description-2015167634"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:11:20.767496 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-184312f8-e0c8-4e93-be58-6a56d08f4ab5 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:11:20.768459 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-184312f8-e0c8-4e93-be58-6a56d08f4ab5 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:11:20.778295 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-184312f8-e0c8-4e93-be58-6a56d08f4ab5 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:20.785972 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-184312f8-e0c8-4e93-be58-6a56d08f4ab5 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:20.787995 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-184312f8-e0c8-4e93-be58-6a56d08f4ab5 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:20.791701 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-184312f8-e0c8-4e93-be58-6a56d08f4ab5 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:20.793128 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-184312f8-e0c8-4e93-be58-6a56d08f4ab5 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:20.797377 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-184312f8-e0c8-4e93-be58-6a56d08f4ab5 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:20.944629 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=8 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:11:21.292517 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-a5a4fa64-a52f-4da0-9e76-a1bc31c9d8fe tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] 10.222.0.60 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.758672 Sep 14 09:11:21.302108 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2345/4669] 10.222.0.60 () {60 vars in 1180 bytes} [Wed Sep 14 09:11:20 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:11:21.310259 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-2c723fc8-b9b5-4063-81b5-2fb2a58637d4 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Action: 'update', calling method: .version_select at 0x7f7d3f4af550>, body: {"security_group": {"name": "tempest-sg-hth-1460642951", "description": "tempest-description-hth-426144584"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:11:21.512720 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-184312f8-e0c8-4e93-be58-6a56d08f4ab5 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:11:21.531569 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-184312f8-e0c8-4e93-be58-6a56d08f4ab5 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:11:21.534448 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-184312f8-e0c8-4e93-be58-6a56d08f4ab5 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:11:21.536003 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-184312f8-e0c8-4e93-be58-6a56d08f4ab5 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5" status: 200 len: 1738 microversion: 2.20 time: 0.772580 Sep 14 09:11:21.540137 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2325/4670] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:11:20 2022] GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5 => generated 1738 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:11:21.552241 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-bad3194d-7346-465a-a93b-356e98082416 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:11:21.555993 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-bad3194d-7346-465a-a93b-356e98082416 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 0ba2a1b2-907f-4598-931a-c6605ffe5682] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:11:21.585404 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bad3194d-7346-465a-a93b-356e98082416 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:21.586216 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bad3194d-7346-465a-a93b-356e98082416 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:21.586860 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bad3194d-7346-465a-a93b-356e98082416 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:21.588006 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bad3194d-7346-465a-a93b-356e98082416 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:21.588649 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bad3194d-7346-465a-a93b-356e98082416 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:21.589264 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bad3194d-7346-465a-a93b-356e98082416 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:21.808406 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-2c723fc8-b9b5-4063-81b5-2fb2a58637d4 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] 10.222.0.60 "PUT /compute/v2.1/os-security-groups/fa9994b1-ccee-4e50-a2db-6f100677d134" status: 200 len: 217 microversion: 2.1 time: 0.502645 Sep 14 09:11:21.809540 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2346/4671] 10.222.0.60 () {60 vars in 1290 bytes} [Wed Sep 14 09:11:21 2022] PUT /compute/v2.1/os-security-groups/fa9994b1-ccee-4e50-a2db-6f100677d134 => generated 217 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:11:21.822411 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-166f6ee2-0bc9-4147-a941-085d31fd6024 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Calling method '.version_select at 0x7f7d3f4afb80>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:11:21.916682 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-bad3194d-7346-465a-a93b-356e98082416 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:11:21.928236 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-bad3194d-7346-465a-a93b-356e98082416 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/0ba2a1b2-907f-4598-931a-c6605ffe5682" status: 200 len: 1314 microversion: 2.1 time: 0.386747 Sep 14 09:11:21.931594 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2326/4672] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:11:21 2022] GET /compute/v2.1/servers/0ba2a1b2-907f-4598-931a-c6605ffe5682 => generated 1314 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:11:22.009807 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-166f6ee2-0bc9-4147-a941-085d31fd6024 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] 10.222.0.60 "GET /compute/v2.1/os-security-groups/fa9994b1-ccee-4e50-a2db-6f100677d134" status: 200 len: 217 microversion: 2.1 time: 0.191249 Sep 14 09:11:22.010592 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2347/4673] 10.222.0.60 () {58 vars in 1269 bytes} [Wed Sep 14 09:11:21 2022] GET /compute/v2.1/os-security-groups/fa9994b1-ccee-4e50-a2db-6f100677d134 => generated 217 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:11:22.026563 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-96f31b48-2583-473f-aac8-aa22768b9a41 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Calling method '.version_select at 0x7f7d3ee81430>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:11:22.582069 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-8dfa414b-91b3-42d4-b973-5dbec17ee49b tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:11:22.582928 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-8dfa414b-91b3-42d4-b973-5dbec17ee49b tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:11:22.590727 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-96f31b48-2583-473f-aac8-aa22768b9a41 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/fa9994b1-ccee-4e50-a2db-6f100677d134" status: 202 len: 0 microversion: 2.1 time: 0.568325 Sep 14 09:11:22.592487 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2327/4674] 10.222.0.60 () {58 vars in 1272 bytes} [Wed Sep 14 09:11:22 2022] DELETE /compute/v2.1/os-security-groups/fa9994b1-ccee-4e50-a2db-6f100677d134 => generated 0 bytes in 571 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:11:22.601122 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-14cf8bd0-94d0-4297-88b7-9af7d922386b tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:11:22.601982 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-14cf8bd0-94d0-4297-88b7-9af7d922386b tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] [instance: e6f9d068-5708-4f4d-b9fe-ab03179ed31e] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:11:22.610294 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8dfa414b-91b3-42d4-b973-5dbec17ee49b tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:22.611915 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8dfa414b-91b3-42d4-b973-5dbec17ee49b tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:22.613428 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8dfa414b-91b3-42d4-b973-5dbec17ee49b tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:22.615418 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8dfa414b-91b3-42d4-b973-5dbec17ee49b tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:22.629349 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-14cf8bd0-94d0-4297-88b7-9af7d922386b tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:22.629869 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-14cf8bd0-94d0-4297-88b7-9af7d922386b tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:22.630317 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-14cf8bd0-94d0-4297-88b7-9af7d922386b tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:22.631596 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8dfa414b-91b3-42d4-b973-5dbec17ee49b tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:22.632029 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8dfa414b-91b3-42d4-b973-5dbec17ee49b tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:22.655924 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-14cf8bd0-94d0-4297-88b7-9af7d922386b tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:22.657991 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-14cf8bd0-94d0-4297-88b7-9af7d922386b tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:22.658814 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-14cf8bd0-94d0-4297-88b7-9af7d922386b tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:22.682729 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:11:22.709495 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-14cf8bd0-94d0-4297-88b7-9af7d922386b tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] HTTP exception thrown: Instance e6f9d068-5708-4f4d-b9fe-ab03179ed31e could not be found. Sep 14 09:11:22.726286 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-14cf8bd0-94d0-4297-88b7-9af7d922386b tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Request method failure captured: Sep 14 09:11:22.726286 n-d-836830-18 devstack@n-api.service[128759]: request: DELETE /compute/v2.1/servers/e6f9d068-5708-4f4d-b9fe-ab03179ed31e HTTP/1.1 Sep 14 09:11:22.726286 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:11:22.726286 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:11:22.726286 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:11:22.726286 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:11:22.726286 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:11:22.726286 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:11:22.726286 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:11:22.726286 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:11:22.726286 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZpubEr9UgWj_j7j968HWFZ0D3vsD9X5NGBGI22hLpa671vkRnOFuLUHN5BGyBOTOD_eSiiXbv14AW_KXyWtJ-nEaHjFTRMlAQdICZGgh9e4MfCMr0iqhNEP0c19crMOXUBhQTUSoeq6F9tEyTwVcFxkCl04_QVOcf30LScxQWEOmzE Sep 14 09:11:22.726286 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:11:22.726286 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:11:22.726286 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:11:22.726286 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:11:22.726286 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:11:22.726286 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:11:22.726286 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: de0783155bf04154bf28fc70bcb7580d Sep 14 09:11:22.726286 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-SecurityGroupsTestJSON-367581750 Sep 14 09:11:22.726286 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:11:22.726286 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:11:22.726286 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/de0783155bf04154bf28fc70bcb7580d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_de0783155bf04154bf28fc70bcb7580d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/de0783155bf04154bf28fc70bcb7580d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/de0783155bf04154bf28fc70bcb7580d"}]}] Sep 14 09:11:22.726286 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-SecurityGroupsTestJSON-367581750 Sep 14 09:11:22.726286 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: de0783155bf04154bf28fc70bcb7580d Sep 14 09:11:22.726286 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-367581750 Sep 14 09:11:22.726286 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-SecurityGroupsTestJSON-367581750-project Sep 14 09:11:22.726286 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:11:22.726286 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:11:22.726286 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 2dabfdd5a6e049c48d00bc1b55a0a30f Sep 14 09:11:22.726286 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-SecurityGroupsTestJSON-367581750-project Sep 14 09:11:22.726286 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:11:22.726286 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance e6f9d068-5708-4f4d-b9fe-ab03179ed31e could not be found. Sep 14 09:11:22.726286 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': 'e6f9d068-5708-4f4d-b9fe-ab03179ed31e'} Sep 14 09:11:22.726286 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:11:22.726286 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:11:22.726286 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:11:22.726286 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:11:22.726286 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:11:22.726286 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:11:22.726286 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:11:22.726286 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:11:22.726286 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:11:22.726286 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:11:22.726286 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6f9d068-5708-4f4d-b9fe-ab03179ed31e could not be found. Sep 14 09:11:22.726286 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:11:22.726286 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:11:22.726286 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:11:22.726286 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:11:22.726286 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:11:22.726286 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:11:22.726286 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:11:22.726286 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:11:22.726286 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:11:22.726286 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:11:22.726286 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 09:11:22.726286 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 09:11:22.726286 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 09:11:22.726286 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 09:11:22.726286 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:11:22.726286 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:11:22.726286 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:11:22.726286 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:11:22.731092 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6f9d068-5708-4f4d-b9fe-ab03179ed31e could not be found. Sep 14 09:11:22.731092 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:11:22.731092 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:11:22.731092 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:11:22.731092 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:11:22.731092 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:11:22.731092 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:11:22.731092 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:11:22.731092 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:11:22.731092 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6f9d068-5708-4f4d-b9fe-ab03179ed31e could not be found. Sep 14 09:11:22.731092 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:11:22.740691 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-14cf8bd0-94d0-4297-88b7-9af7d922386b tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Returning 404 to user: Instance e6f9d068-5708-4f4d-b9fe-ab03179ed31e could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:11:22.746207 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-14cf8bd0-94d0-4297-88b7-9af7d922386b tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] 10.222.0.60 "DELETE /compute/v2.1/servers/e6f9d068-5708-4f4d-b9fe-ab03179ed31e" status: 404 len: 111 microversion: 2.1 time: 0.149613 Sep 14 09:11:22.753762 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2328/4675] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:11:22 2022] DELETE /compute/v2.1/servers/e6f9d068-5708-4f4d-b9fe-ab03179ed31e => generated 111 bytes in 157 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 14 09:11:22.770346 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c54de165-ee54-44a1-a266-258b4ae4a059 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:11:22.771746 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-c54de165-ee54-44a1-a266-258b4ae4a059 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] [instance: e6f9d068-5708-4f4d-b9fe-ab03179ed31e] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:11:22.852994 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c54de165-ee54-44a1-a266-258b4ae4a059 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:22.853500 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c54de165-ee54-44a1-a266-258b4ae4a059 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:22.856308 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c54de165-ee54-44a1-a266-258b4ae4a059 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:22.857107 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c54de165-ee54-44a1-a266-258b4ae4a059 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:22.857591 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c54de165-ee54-44a1-a266-258b4ae4a059 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:22.859963 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c54de165-ee54-44a1-a266-258b4ae4a059 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:22.899107 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-c54de165-ee54-44a1-a266-258b4ae4a059 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] HTTP exception thrown: Instance e6f9d068-5708-4f4d-b9fe-ab03179ed31e could not be found. Sep 14 09:11:22.900984 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c54de165-ee54-44a1-a266-258b4ae4a059 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Request method failure captured: Sep 14 09:11:22.900984 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/e6f9d068-5708-4f4d-b9fe-ab03179ed31e HTTP/1.1 Sep 14 09:11:22.900984 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:11:22.900984 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:11:22.900984 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:11:22.900984 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:11:22.900984 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:11:22.900984 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:11:22.900984 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:11:22.900984 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:11:22.900984 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZpubEr9UgWj_j7j968HWFZ0D3vsD9X5NGBGI22hLpa671vkRnOFuLUHN5BGyBOTOD_eSiiXbv14AW_KXyWtJ-nEaHjFTRMlAQdICZGgh9e4MfCMr0iqhNEP0c19crMOXUBhQTUSoeq6F9tEyTwVcFxkCl04_QVOcf30LScxQWEOmzE Sep 14 09:11:22.900984 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:11:22.900984 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:11:22.900984 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:11:22.900984 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:11:22.900984 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:11:22.900984 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:11:22.900984 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: de0783155bf04154bf28fc70bcb7580d Sep 14 09:11:22.900984 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-SecurityGroupsTestJSON-367581750 Sep 14 09:11:22.900984 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:11:22.900984 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:11:22.900984 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/de0783155bf04154bf28fc70bcb7580d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_de0783155bf04154bf28fc70bcb7580d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/de0783155bf04154bf28fc70bcb7580d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/de0783155bf04154bf28fc70bcb7580d"}]}] Sep 14 09:11:22.900984 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-SecurityGroupsTestJSON-367581750 Sep 14 09:11:22.900984 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: de0783155bf04154bf28fc70bcb7580d Sep 14 09:11:22.900984 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-367581750 Sep 14 09:11:22.900984 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-SecurityGroupsTestJSON-367581750-project Sep 14 09:11:22.900984 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:11:22.900984 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:11:22.900984 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 2dabfdd5a6e049c48d00bc1b55a0a30f Sep 14 09:11:22.900984 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-SecurityGroupsTestJSON-367581750-project Sep 14 09:11:22.900984 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:11:22.900984 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance e6f9d068-5708-4f4d-b9fe-ab03179ed31e could not be found. Sep 14 09:11:22.900984 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': 'e6f9d068-5708-4f4d-b9fe-ab03179ed31e'} Sep 14 09:11:22.900984 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:11:22.900984 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:11:22.900984 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:11:22.900984 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:11:22.900984 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:11:22.900984 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:11:22.900984 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:11:22.900984 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:11:22.900984 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:11:22.900984 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:11:22.900984 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6f9d068-5708-4f4d-b9fe-ab03179ed31e could not be found. Sep 14 09:11:22.900984 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:11:22.900984 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:11:22.900984 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:11:22.900984 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:11:22.900984 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:11:22.900984 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:11:22.900984 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:11:22.900984 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:11:22.900984 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:11:22.900984 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:11:22.900984 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:11:22.900984 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:11:22.900984 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:11:22.900984 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:11:22.900984 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:11:22.900984 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:11:22.900984 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6f9d068-5708-4f4d-b9fe-ab03179ed31e could not be found. Sep 14 09:11:22.900984 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:11:22.900984 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:11:22.900984 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:11:22.906107 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:11:22.906107 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:11:22.906107 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:11:22.906107 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:11:22.906107 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:11:22.906107 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6f9d068-5708-4f4d-b9fe-ab03179ed31e could not be found. Sep 14 09:11:22.906107 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:11:22.911936 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c54de165-ee54-44a1-a266-258b4ae4a059 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Returning 404 to user: Instance e6f9d068-5708-4f4d-b9fe-ab03179ed31e could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:11:22.918470 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-c54de165-ee54-44a1-a266-258b4ae4a059 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] 10.222.0.60 "GET /compute/v2.1/servers/e6f9d068-5708-4f4d-b9fe-ab03179ed31e" status: 404 len: 111 microversion: 2.1 time: 0.159894 Sep 14 09:11:22.923600 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2329/4676] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:11:22 2022] GET /compute/v2.1/servers/e6f9d068-5708-4f4d-b9fe-ab03179ed31e => generated 111 bytes in 168 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:11:22.932372 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-65054ebe-0fda-462f-a03c-f50b26205b2c tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Calling method '.version_select at 0x7f7d3ef43310>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:11:23.236429 n-d-836830-18 devstack@n-api.service[128759]: DEBUG neutronclient.v2_0.client [None req-65054ebe-0fda-462f-a03c-f50b26205b2c tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group fbbaaf8a-c7b2-496d-9a1c-7dd85d0b3648 does not exist", "detail": ""}} {{(pid=128759) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 14 09:11:23.239989 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.network.security_group_api [None req-65054ebe-0fda-462f-a03c-f50b26205b2c tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Neutron security group fbbaaf8a-c7b2-496d-9a1c-7dd85d0b3648 not found {{(pid=128759) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 14 09:11:23.240605 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-65054ebe-0fda-462f-a03c-f50b26205b2c tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] HTTP exception thrown: Security group fbbaaf8a-c7b2-496d-9a1c-7dd85d0b3648 does not exist Sep 14 09:11:23.240605 n-d-836830-18 devstack@n-api.service[128759]: Neutron server returns request_ids: ['req-c052d9d9-f440-45f9-86d1-02ec9c7debbc'] Sep 14 09:11:23.246462 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-65054ebe-0fda-462f-a03c-f50b26205b2c tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Request method failure captured: Sep 14 09:11:23.246462 n-d-836830-18 devstack@n-api.service[128759]: request: DELETE /compute/v2.1/os-security-groups/fbbaaf8a-c7b2-496d-9a1c-7dd85d0b3648 HTTP/1.1 Sep 14 09:11:23.246462 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:11:23.246462 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:11:23.246462 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:11:23.246462 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:11:23.246462 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:11:23.246462 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:11:23.246462 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:11:23.246462 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:11:23.246462 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZpubEr9UgWj_j7j968HWFZ0D3vsD9X5NGBGI22hLpa671vkRnOFuLUHN5BGyBOTOD_eSiiXbv14AW_KXyWtJ-nEaHjFTRMlAQdICZGgh9e4MfCMr0iqhNEP0c19crMOXUBhQTUSoeq6F9tEyTwVcFxkCl04_QVOcf30LScxQWEOmzE Sep 14 09:11:23.246462 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:11:23.246462 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:11:23.246462 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:11:23.246462 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:11:23.246462 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:11:23.246462 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:11:23.246462 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: de0783155bf04154bf28fc70bcb7580d Sep 14 09:11:23.246462 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-SecurityGroupsTestJSON-367581750 Sep 14 09:11:23.246462 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:11:23.246462 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:11:23.246462 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/de0783155bf04154bf28fc70bcb7580d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_de0783155bf04154bf28fc70bcb7580d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/de0783155bf04154bf28fc70bcb7580d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/de0783155bf04154bf28fc70bcb7580d"}]}] Sep 14 09:11:23.246462 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-SecurityGroupsTestJSON-367581750 Sep 14 09:11:23.246462 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: de0783155bf04154bf28fc70bcb7580d Sep 14 09:11:23.246462 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-367581750 Sep 14 09:11:23.246462 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-SecurityGroupsTestJSON-367581750-project Sep 14 09:11:23.246462 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:11:23.246462 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:11:23.246462 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 2dabfdd5a6e049c48d00bc1b55a0a30f Sep 14 09:11:23.246462 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-SecurityGroupsTestJSON-367581750-project Sep 14 09:11:23.246462 n-d-836830-18 devstack@n-api.service[128759]: method: Sep 14 09:11:23.246462 n-d-836830-18 devstack@n-api.service[128759]: exception: Security group fbbaaf8a-c7b2-496d-9a1c-7dd85d0b3648 does not exist Sep 14 09:11:23.246462 n-d-836830-18 devstack@n-api.service[128759]: Neutron server returns request_ids: ['req-c052d9d9-f440-45f9-86d1-02ec9c7debbc'] Sep 14 09:11:23.246462 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': 'fbbaaf8a-c7b2-496d-9a1c-7dd85d0b3648'} Sep 14 09:11:23.246462 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:11:23.246462 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:11:23.246462 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 14 09:11:23.246462 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 14 09:11:23.246462 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:11:23.246462 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:11:23.246462 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 14 09:11:23.246462 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 14 09:11:23.246462 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:11:23.246462 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:11:23.246462 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 14 09:11:23.246462 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 14 09:11:23.246462 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:11:23.246462 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:11:23.246462 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 14 09:11:23.246462 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 14 09:11:23.246462 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:11:23.246462 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:11:23.246462 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 14 09:11:23.246462 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 14 09:11:23.246462 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:11:23.246462 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:11:23.246462 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 14 09:11:23.246462 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 14 09:11:23.246462 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 14 09:11:23.246462 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 14 09:11:23.246462 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group fbbaaf8a-c7b2-496d-9a1c-7dd85d0b3648 does not exist Sep 14 09:11:23.251909 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c052d9d9-f440-45f9-86d1-02ec9c7debbc'] Sep 14 09:11:23.251909 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:11:23.251909 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:11:23.251909 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:11:23.251909 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:11:23.251909 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 14 09:11:23.251909 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 14 09:11:23.251909 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 14 09:11:23.251909 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 14 09:11:23.251909 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group fbbaaf8a-c7b2-496d-9a1c-7dd85d0b3648 does not exist Sep 14 09:11:23.251909 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c052d9d9-f440-45f9-86d1-02ec9c7debbc'] Sep 14 09:11:23.251909 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:11:23.251909 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:11:23.251909 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:11:23.251909 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:11:23.251909 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:11:23.251909 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:11:23.251909 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:11:23.251909 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:11:23.251909 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:11:23.251909 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:11:23.251909 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:11:23.251909 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:11:23.251909 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 14 09:11:23.251909 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 14 09:11:23.251909 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group fbbaaf8a-c7b2-496d-9a1c-7dd85d0b3648 does not exist Sep 14 09:11:23.251909 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c052d9d9-f440-45f9-86d1-02ec9c7debbc'] Sep 14 09:11:23.251909 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:11:23.251909 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:11:23.251909 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:11:23.251909 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:11:23.251909 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:11:23.251909 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:11:23.251909 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:11:23.251909 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:11:23.251909 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group fbbaaf8a-c7b2-496d-9a1c-7dd85d0b3648 does not exist Sep 14 09:11:23.251909 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c052d9d9-f440-45f9-86d1-02ec9c7debbc'] Sep 14 09:11:23.251909 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:11:23.251909 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-65054ebe-0fda-462f-a03c-f50b26205b2c tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Returning 404 to user: Security group fbbaaf8a-c7b2-496d-9a1c-7dd85d0b3648 does not exist Sep 14 09:11:23.251909 n-d-836830-18 devstack@n-api.service[128759]: Neutron server returns request_ids: ['req-c052d9d9-f440-45f9-86d1-02ec9c7debbc'] {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:11:23.251909 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-65054ebe-0fda-462f-a03c-f50b26205b2c tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/fbbaaf8a-c7b2-496d-9a1c-7dd85d0b3648" status: 404 len: 194 microversion: 2.1 time: 0.325120 Sep 14 09:11:23.254705 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2330/4677] 10.222.0.60 () {58 vars in 1272 bytes} [Wed Sep 14 09:11:22 2022] DELETE /compute/v2.1/os-security-groups/fbbaaf8a-c7b2-496d-9a1c-7dd85d0b3648 => generated 194 bytes in 328 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:11:23.272791 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b8e2431d-3f88-4a16-9f24-975ddf6689f3 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:11:23.273488 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b8e2431d-3f88-4a16-9f24-975ddf6689f3 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 0ba2a1b2-907f-4598-931a-c6605ffe5682] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:11:23.312250 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b8e2431d-3f88-4a16-9f24-975ddf6689f3 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:23.313442 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b8e2431d-3f88-4a16-9f24-975ddf6689f3 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:23.313931 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b8e2431d-3f88-4a16-9f24-975ddf6689f3 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:23.314755 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b8e2431d-3f88-4a16-9f24-975ddf6689f3 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:23.315287 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b8e2431d-3f88-4a16-9f24-975ddf6689f3 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:23.316919 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b8e2431d-3f88-4a16-9f24-975ddf6689f3 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:23.325328 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-8dfa414b-91b3-42d4-b973-5dbec17ee49b tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:11:23.363804 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:11:23.376829 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-8dfa414b-91b3-42d4-b973-5dbec17ee49b tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:11:23.396579 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-8dfa414b-91b3-42d4-b973-5dbec17ee49b tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:11:23.404101 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-8dfa414b-91b3-42d4-b973-5dbec17ee49b tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5" status: 200 len: 1738 microversion: 2.20 time: 0.839674 Sep 14 09:11:23.405480 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2348/4678] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:11:22 2022] GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5 => generated 1738 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:11:23.415555 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-04086898-7648-4a4a-a7fc-5fbbe19d0510 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Calling method '.version_select at 0x7f7d487fb4c0>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:11:23.491669 n-d-836830-18 devstack@n-api.service[128758]: DEBUG neutronclient.v2_0.client [None req-04086898-7648-4a4a-a7fc-5fbbe19d0510 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 523f0cb2-3dce-4392-9ab2-3b37cd888198 does not exist", "detail": ""}} {{(pid=128758) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 14 09:11:23.492548 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.network.security_group_api [None req-04086898-7648-4a4a-a7fc-5fbbe19d0510 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Neutron security group 523f0cb2-3dce-4392-9ab2-3b37cd888198 not found {{(pid=128758) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 14 09:11:23.493316 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-04086898-7648-4a4a-a7fc-5fbbe19d0510 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] HTTP exception thrown: Security group 523f0cb2-3dce-4392-9ab2-3b37cd888198 does not exist Sep 14 09:11:23.493316 n-d-836830-18 devstack@n-api.service[128758]: Neutron server returns request_ids: ['req-b02f5c4c-9830-4f27-80aa-f697af91fedb'] Sep 14 09:11:23.496103 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-04086898-7648-4a4a-a7fc-5fbbe19d0510 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Request method failure captured: Sep 14 09:11:23.496103 n-d-836830-18 devstack@n-api.service[128758]: request: DELETE /compute/v2.1/os-security-groups/523f0cb2-3dce-4392-9ab2-3b37cd888198 HTTP/1.1 Sep 14 09:11:23.496103 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 09:11:23.496103 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 09:11:23.496103 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 09:11:23.496103 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 09:11:23.496103 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 09:11:23.496103 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 09:11:23.496103 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 09:11:23.496103 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 09:11:23.496103 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZpubEr9UgWj_j7j968HWFZ0D3vsD9X5NGBGI22hLpa671vkRnOFuLUHN5BGyBOTOD_eSiiXbv14AW_KXyWtJ-nEaHjFTRMlAQdICZGgh9e4MfCMr0iqhNEP0c19crMOXUBhQTUSoeq6F9tEyTwVcFxkCl04_QVOcf30LScxQWEOmzE Sep 14 09:11:23.496103 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 09:11:23.496103 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 09:11:23.496103 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 09:11:23.496103 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 09:11:23.496103 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 09:11:23.496103 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 09:11:23.496103 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: de0783155bf04154bf28fc70bcb7580d Sep 14 09:11:23.496103 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-SecurityGroupsTestJSON-367581750 Sep 14 09:11:23.496103 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 09:11:23.496103 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 09:11:23.496103 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/de0783155bf04154bf28fc70bcb7580d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_de0783155bf04154bf28fc70bcb7580d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/de0783155bf04154bf28fc70bcb7580d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/de0783155bf04154bf28fc70bcb7580d"}]}] Sep 14 09:11:23.496103 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-SecurityGroupsTestJSON-367581750 Sep 14 09:11:23.496103 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: de0783155bf04154bf28fc70bcb7580d Sep 14 09:11:23.496103 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-367581750 Sep 14 09:11:23.496103 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-SecurityGroupsTestJSON-367581750-project Sep 14 09:11:23.496103 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 09:11:23.496103 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 09:11:23.496103 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 2dabfdd5a6e049c48d00bc1b55a0a30f Sep 14 09:11:23.496103 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-SecurityGroupsTestJSON-367581750-project Sep 14 09:11:23.496103 n-d-836830-18 devstack@n-api.service[128758]: method: Sep 14 09:11:23.496103 n-d-836830-18 devstack@n-api.service[128758]: exception: Security group 523f0cb2-3dce-4392-9ab2-3b37cd888198 does not exist Sep 14 09:11:23.496103 n-d-836830-18 devstack@n-api.service[128758]: Neutron server returns request_ids: ['req-b02f5c4c-9830-4f27-80aa-f697af91fedb'] Sep 14 09:11:23.496103 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': '523f0cb2-3dce-4392-9ab2-3b37cd888198'} Sep 14 09:11:23.496103 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:11:23.496103 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:11:23.496103 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 14 09:11:23.496103 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 14 09:11:23.496103 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:11:23.496103 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:11:23.496103 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 14 09:11:23.496103 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 14 09:11:23.496103 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:11:23.496103 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:11:23.496103 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 14 09:11:23.496103 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 14 09:11:23.496103 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:11:23.496103 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:11:23.496103 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 14 09:11:23.496103 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 14 09:11:23.496103 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:11:23.496103 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:11:23.496103 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 14 09:11:23.496103 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 14 09:11:23.496103 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:11:23.496103 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:11:23.496103 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 14 09:11:23.496103 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 14 09:11:23.496103 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 14 09:11:23.496103 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 14 09:11:23.496103 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 523f0cb2-3dce-4392-9ab2-3b37cd888198 does not exist Sep 14 09:11:23.500393 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b02f5c4c-9830-4f27-80aa-f697af91fedb'] Sep 14 09:11:23.500393 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:11:23.500393 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:11:23.500393 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:11:23.500393 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:11:23.500393 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 14 09:11:23.500393 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 14 09:11:23.500393 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 14 09:11:23.500393 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 14 09:11:23.500393 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 523f0cb2-3dce-4392-9ab2-3b37cd888198 does not exist Sep 14 09:11:23.500393 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b02f5c4c-9830-4f27-80aa-f697af91fedb'] Sep 14 09:11:23.500393 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:11:23.500393 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:11:23.500393 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:11:23.500393 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:11:23.500393 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:11:23.500393 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:11:23.500393 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:11:23.500393 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:11:23.500393 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:11:23.500393 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:11:23.500393 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:11:23.500393 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:11:23.500393 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 14 09:11:23.500393 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 14 09:11:23.500393 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 523f0cb2-3dce-4392-9ab2-3b37cd888198 does not exist Sep 14 09:11:23.500393 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b02f5c4c-9830-4f27-80aa-f697af91fedb'] Sep 14 09:11:23.500393 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:11:23.500393 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:11:23.500393 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:11:23.500393 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:11:23.500393 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:11:23.500393 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:11:23.500393 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:11:23.500393 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:11:23.500393 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 523f0cb2-3dce-4392-9ab2-3b37cd888198 does not exist Sep 14 09:11:23.500393 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b02f5c4c-9830-4f27-80aa-f697af91fedb'] Sep 14 09:11:23.500393 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:11:23.508227 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-04086898-7648-4a4a-a7fc-5fbbe19d0510 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Returning 404 to user: Security group 523f0cb2-3dce-4392-9ab2-3b37cd888198 does not exist Sep 14 09:11:23.508227 n-d-836830-18 devstack@n-api.service[128758]: Neutron server returns request_ids: ['req-b02f5c4c-9830-4f27-80aa-f697af91fedb'] {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:11:23.509196 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-04086898-7648-4a4a-a7fc-5fbbe19d0510 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/523f0cb2-3dce-4392-9ab2-3b37cd888198" status: 404 len: 194 microversion: 2.1 time: 0.101780 Sep 14 09:11:23.513362 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2349/4679] 10.222.0.60 () {58 vars in 1272 bytes} [Wed Sep 14 09:11:23 2022] DELETE /compute/v2.1/os-security-groups/523f0cb2-3dce-4392-9ab2-3b37cd888198 => generated 194 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:11:23.521150 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-0a7cd38c-34ea-4c3a-96ae-d30751156699 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Calling method '.version_select at 0x7f7d3f3ed4c0>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:11:23.587446 n-d-836830-18 devstack@n-api.service[128758]: DEBUG neutronclient.v2_0.client [None req-0a7cd38c-34ea-4c3a-96ae-d30751156699 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 3d2ebfb9-22c3-4d2f-afc8-9d28d87e5d47 does not exist", "detail": ""}} {{(pid=128758) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 14 09:11:23.591841 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.network.security_group_api [None req-0a7cd38c-34ea-4c3a-96ae-d30751156699 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Neutron security group 3d2ebfb9-22c3-4d2f-afc8-9d28d87e5d47 not found {{(pid=128758) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 14 09:11:23.592465 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-0a7cd38c-34ea-4c3a-96ae-d30751156699 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] HTTP exception thrown: Security group 3d2ebfb9-22c3-4d2f-afc8-9d28d87e5d47 does not exist Sep 14 09:11:23.592465 n-d-836830-18 devstack@n-api.service[128758]: Neutron server returns request_ids: ['req-400e93cc-369e-4d68-8fda-31e98dd6fc3d'] Sep 14 09:11:23.594999 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-0a7cd38c-34ea-4c3a-96ae-d30751156699 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Request method failure captured: Sep 14 09:11:23.594999 n-d-836830-18 devstack@n-api.service[128758]: request: DELETE /compute/v2.1/os-security-groups/3d2ebfb9-22c3-4d2f-afc8-9d28d87e5d47 HTTP/1.1 Sep 14 09:11:23.594999 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 09:11:23.594999 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 09:11:23.594999 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 09:11:23.594999 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 09:11:23.594999 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 09:11:23.594999 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 09:11:23.594999 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 09:11:23.594999 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 09:11:23.594999 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZpubEr9UgWj_j7j968HWFZ0D3vsD9X5NGBGI22hLpa671vkRnOFuLUHN5BGyBOTOD_eSiiXbv14AW_KXyWtJ-nEaHjFTRMlAQdICZGgh9e4MfCMr0iqhNEP0c19crMOXUBhQTUSoeq6F9tEyTwVcFxkCl04_QVOcf30LScxQWEOmzE Sep 14 09:11:23.594999 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 09:11:23.594999 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 09:11:23.594999 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 09:11:23.594999 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 09:11:23.594999 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 09:11:23.594999 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 09:11:23.594999 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: de0783155bf04154bf28fc70bcb7580d Sep 14 09:11:23.594999 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-SecurityGroupsTestJSON-367581750 Sep 14 09:11:23.594999 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 09:11:23.594999 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 09:11:23.594999 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/de0783155bf04154bf28fc70bcb7580d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_de0783155bf04154bf28fc70bcb7580d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/de0783155bf04154bf28fc70bcb7580d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/de0783155bf04154bf28fc70bcb7580d"}]}] Sep 14 09:11:23.594999 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-SecurityGroupsTestJSON-367581750 Sep 14 09:11:23.594999 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: de0783155bf04154bf28fc70bcb7580d Sep 14 09:11:23.594999 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-367581750 Sep 14 09:11:23.594999 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-SecurityGroupsTestJSON-367581750-project Sep 14 09:11:23.594999 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 09:11:23.594999 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 09:11:23.594999 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 2dabfdd5a6e049c48d00bc1b55a0a30f Sep 14 09:11:23.594999 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-SecurityGroupsTestJSON-367581750-project Sep 14 09:11:23.594999 n-d-836830-18 devstack@n-api.service[128758]: method: Sep 14 09:11:23.594999 n-d-836830-18 devstack@n-api.service[128758]: exception: Security group 3d2ebfb9-22c3-4d2f-afc8-9d28d87e5d47 does not exist Sep 14 09:11:23.594999 n-d-836830-18 devstack@n-api.service[128758]: Neutron server returns request_ids: ['req-400e93cc-369e-4d68-8fda-31e98dd6fc3d'] Sep 14 09:11:23.594999 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': '3d2ebfb9-22c3-4d2f-afc8-9d28d87e5d47'} Sep 14 09:11:23.594999 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:11:23.594999 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:11:23.594999 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 14 09:11:23.594999 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 14 09:11:23.594999 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:11:23.594999 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:11:23.594999 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 14 09:11:23.594999 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 14 09:11:23.594999 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:11:23.594999 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:11:23.594999 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 14 09:11:23.594999 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 14 09:11:23.594999 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:11:23.594999 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:11:23.594999 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 14 09:11:23.594999 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 14 09:11:23.594999 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:11:23.594999 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:11:23.594999 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 14 09:11:23.594999 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 14 09:11:23.594999 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:11:23.594999 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:11:23.594999 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 14 09:11:23.594999 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 14 09:11:23.594999 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 14 09:11:23.594999 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 14 09:11:23.594999 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 3d2ebfb9-22c3-4d2f-afc8-9d28d87e5d47 does not exist Sep 14 09:11:23.599716 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-400e93cc-369e-4d68-8fda-31e98dd6fc3d'] Sep 14 09:11:23.599716 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:11:23.599716 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:11:23.599716 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:11:23.599716 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:11:23.599716 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 14 09:11:23.599716 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 14 09:11:23.599716 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 14 09:11:23.599716 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 14 09:11:23.599716 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 3d2ebfb9-22c3-4d2f-afc8-9d28d87e5d47 does not exist Sep 14 09:11:23.599716 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-400e93cc-369e-4d68-8fda-31e98dd6fc3d'] Sep 14 09:11:23.599716 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:11:23.599716 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:11:23.599716 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:11:23.599716 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:11:23.599716 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:11:23.599716 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:11:23.599716 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:11:23.599716 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:11:23.599716 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:11:23.599716 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:11:23.599716 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:11:23.599716 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:11:23.599716 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 14 09:11:23.599716 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 14 09:11:23.599716 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 3d2ebfb9-22c3-4d2f-afc8-9d28d87e5d47 does not exist Sep 14 09:11:23.599716 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-400e93cc-369e-4d68-8fda-31e98dd6fc3d'] Sep 14 09:11:23.599716 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:11:23.599716 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:11:23.599716 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:11:23.599716 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:11:23.599716 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:11:23.599716 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:11:23.599716 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:11:23.599716 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:11:23.599716 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 3d2ebfb9-22c3-4d2f-afc8-9d28d87e5d47 does not exist Sep 14 09:11:23.599716 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-400e93cc-369e-4d68-8fda-31e98dd6fc3d'] Sep 14 09:11:23.599716 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:11:23.606087 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-0a7cd38c-34ea-4c3a-96ae-d30751156699 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Returning 404 to user: Security group 3d2ebfb9-22c3-4d2f-afc8-9d28d87e5d47 does not exist Sep 14 09:11:23.606087 n-d-836830-18 devstack@n-api.service[128758]: Neutron server returns request_ids: ['req-400e93cc-369e-4d68-8fda-31e98dd6fc3d'] {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:11:23.606087 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-0a7cd38c-34ea-4c3a-96ae-d30751156699 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/3d2ebfb9-22c3-4d2f-afc8-9d28d87e5d47" status: 404 len: 194 microversion: 2.1 time: 0.090100 Sep 14 09:11:23.609384 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2350/4680] 10.222.0.60 () {58 vars in 1272 bytes} [Wed Sep 14 09:11:23 2022] DELETE /compute/v2.1/os-security-groups/3d2ebfb9-22c3-4d2f-afc8-9d28d87e5d47 => generated 194 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:11:23.622929 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-bd018d9a-a77e-418d-99d2-9610b27aa6bb tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Calling method '.version_select at 0x7f7d3f36d3a0>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:11:23.651960 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b8e2431d-3f88-4a16-9f24-975ddf6689f3 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:11:23.663816 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b8e2431d-3f88-4a16-9f24-975ddf6689f3 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/0ba2a1b2-907f-4598-931a-c6605ffe5682" status: 200 len: 1314 microversion: 2.1 time: 0.404652 Sep 14 09:11:23.678190 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2331/4681] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:11:23 2022] GET /compute/v2.1/servers/0ba2a1b2-907f-4598-931a-c6605ffe5682 => generated 1314 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:11:23.679252 n-d-836830-18 devstack@n-api.service[128758]: DEBUG neutronclient.v2_0.client [None req-bd018d9a-a77e-418d-99d2-9610b27aa6bb tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a64e0e10-fe4c-491e-a817-3c9faa913e20 does not exist", "detail": ""}} {{(pid=128758) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 14 09:11:23.680078 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.network.security_group_api [None req-bd018d9a-a77e-418d-99d2-9610b27aa6bb tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Neutron security group a64e0e10-fe4c-491e-a817-3c9faa913e20 not found {{(pid=128758) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 14 09:11:23.680768 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-bd018d9a-a77e-418d-99d2-9610b27aa6bb tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] HTTP exception thrown: Security group a64e0e10-fe4c-491e-a817-3c9faa913e20 does not exist Sep 14 09:11:23.680768 n-d-836830-18 devstack@n-api.service[128758]: Neutron server returns request_ids: ['req-d5ac95ce-6996-4578-a4f8-73930cf8c682'] Sep 14 09:11:23.683085 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-bd018d9a-a77e-418d-99d2-9610b27aa6bb tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Request method failure captured: Sep 14 09:11:23.683085 n-d-836830-18 devstack@n-api.service[128758]: request: DELETE /compute/v2.1/os-security-groups/a64e0e10-fe4c-491e-a817-3c9faa913e20 HTTP/1.1 Sep 14 09:11:23.683085 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 09:11:23.683085 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 09:11:23.683085 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 09:11:23.683085 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 09:11:23.683085 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 09:11:23.683085 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 09:11:23.683085 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 09:11:23.683085 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 09:11:23.683085 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZpubEr9UgWj_j7j968HWFZ0D3vsD9X5NGBGI22hLpa671vkRnOFuLUHN5BGyBOTOD_eSiiXbv14AW_KXyWtJ-nEaHjFTRMlAQdICZGgh9e4MfCMr0iqhNEP0c19crMOXUBhQTUSoeq6F9tEyTwVcFxkCl04_QVOcf30LScxQWEOmzE Sep 14 09:11:23.683085 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 09:11:23.683085 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 09:11:23.683085 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 09:11:23.683085 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 09:11:23.683085 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 09:11:23.683085 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 09:11:23.683085 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: de0783155bf04154bf28fc70bcb7580d Sep 14 09:11:23.683085 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-SecurityGroupsTestJSON-367581750 Sep 14 09:11:23.683085 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 09:11:23.683085 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 09:11:23.683085 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/de0783155bf04154bf28fc70bcb7580d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_de0783155bf04154bf28fc70bcb7580d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/de0783155bf04154bf28fc70bcb7580d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/de0783155bf04154bf28fc70bcb7580d"}]}] Sep 14 09:11:23.683085 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-SecurityGroupsTestJSON-367581750 Sep 14 09:11:23.683085 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: de0783155bf04154bf28fc70bcb7580d Sep 14 09:11:23.683085 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-367581750 Sep 14 09:11:23.683085 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-SecurityGroupsTestJSON-367581750-project Sep 14 09:11:23.683085 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 09:11:23.683085 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 09:11:23.683085 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 2dabfdd5a6e049c48d00bc1b55a0a30f Sep 14 09:11:23.683085 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-SecurityGroupsTestJSON-367581750-project Sep 14 09:11:23.683085 n-d-836830-18 devstack@n-api.service[128758]: method: Sep 14 09:11:23.683085 n-d-836830-18 devstack@n-api.service[128758]: exception: Security group a64e0e10-fe4c-491e-a817-3c9faa913e20 does not exist Sep 14 09:11:23.683085 n-d-836830-18 devstack@n-api.service[128758]: Neutron server returns request_ids: ['req-d5ac95ce-6996-4578-a4f8-73930cf8c682'] Sep 14 09:11:23.683085 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': 'a64e0e10-fe4c-491e-a817-3c9faa913e20'} Sep 14 09:11:23.683085 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:11:23.683085 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:11:23.683085 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 14 09:11:23.683085 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 14 09:11:23.683085 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:11:23.683085 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:11:23.683085 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 14 09:11:23.683085 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 14 09:11:23.683085 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:11:23.683085 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:11:23.683085 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 14 09:11:23.683085 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 14 09:11:23.683085 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:11:23.683085 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:11:23.683085 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 14 09:11:23.683085 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 14 09:11:23.683085 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:11:23.683085 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:11:23.683085 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 14 09:11:23.683085 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 14 09:11:23.683085 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:11:23.683085 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:11:23.683085 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 14 09:11:23.683085 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 14 09:11:23.683085 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 14 09:11:23.683085 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 14 09:11:23.683085 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group a64e0e10-fe4c-491e-a817-3c9faa913e20 does not exist Sep 14 09:11:23.687231 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d5ac95ce-6996-4578-a4f8-73930cf8c682'] Sep 14 09:11:23.687231 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:11:23.687231 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:11:23.687231 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:11:23.687231 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:11:23.687231 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 14 09:11:23.687231 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 14 09:11:23.687231 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 14 09:11:23.687231 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 14 09:11:23.687231 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group a64e0e10-fe4c-491e-a817-3c9faa913e20 does not exist Sep 14 09:11:23.687231 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d5ac95ce-6996-4578-a4f8-73930cf8c682'] Sep 14 09:11:23.687231 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:11:23.687231 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:11:23.687231 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:11:23.687231 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:11:23.687231 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:11:23.687231 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:11:23.687231 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:11:23.687231 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:11:23.687231 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:11:23.687231 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:11:23.687231 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:11:23.687231 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:11:23.687231 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 14 09:11:23.687231 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 14 09:11:23.687231 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group a64e0e10-fe4c-491e-a817-3c9faa913e20 does not exist Sep 14 09:11:23.687231 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d5ac95ce-6996-4578-a4f8-73930cf8c682'] Sep 14 09:11:23.687231 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:11:23.687231 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:11:23.687231 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:11:23.687231 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:11:23.687231 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:11:23.687231 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:11:23.687231 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:11:23.687231 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:11:23.687231 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group a64e0e10-fe4c-491e-a817-3c9faa913e20 does not exist Sep 14 09:11:23.687231 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d5ac95ce-6996-4578-a4f8-73930cf8c682'] Sep 14 09:11:23.687231 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:11:23.691852 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-bd018d9a-a77e-418d-99d2-9610b27aa6bb tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Returning 404 to user: Security group a64e0e10-fe4c-491e-a817-3c9faa913e20 does not exist Sep 14 09:11:23.691852 n-d-836830-18 devstack@n-api.service[128758]: Neutron server returns request_ids: ['req-d5ac95ce-6996-4578-a4f8-73930cf8c682'] {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:11:23.691852 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-bd018d9a-a77e-418d-99d2-9610b27aa6bb tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/a64e0e10-fe4c-491e-a817-3c9faa913e20" status: 404 len: 194 microversion: 2.1 time: 0.079848 Sep 14 09:11:23.691852 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2351/4682] 10.222.0.60 () {58 vars in 1272 bytes} [Wed Sep 14 09:11:23 2022] DELETE /compute/v2.1/os-security-groups/a64e0e10-fe4c-491e-a817-3c9faa913e20 => generated 194 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:11:23.701114 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8fb01976-43c5-4cd4-ac54-9d862e2bc63b tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Calling method '.version_select at 0x7f7d3ef43dc0>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:11:23.739328 n-d-836830-18 devstack@n-api.service[128759]: DEBUG neutronclient.v2_0.client [None req-8fb01976-43c5-4cd4-ac54-9d862e2bc63b tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group be8381c4-c1e6-42f8-b294-6f39e7eb2588 does not exist", "detail": ""}} {{(pid=128759) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 14 09:11:23.739884 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.network.security_group_api [None req-8fb01976-43c5-4cd4-ac54-9d862e2bc63b tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Neutron security group be8381c4-c1e6-42f8-b294-6f39e7eb2588 not found {{(pid=128759) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 14 09:11:23.740536 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-8fb01976-43c5-4cd4-ac54-9d862e2bc63b tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] HTTP exception thrown: Security group be8381c4-c1e6-42f8-b294-6f39e7eb2588 does not exist Sep 14 09:11:23.740536 n-d-836830-18 devstack@n-api.service[128759]: Neutron server returns request_ids: ['req-9dfb00ef-e4fe-44e1-a98b-9665817a6c22'] Sep 14 09:11:23.742728 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8fb01976-43c5-4cd4-ac54-9d862e2bc63b tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Request method failure captured: Sep 14 09:11:23.742728 n-d-836830-18 devstack@n-api.service[128759]: request: DELETE /compute/v2.1/os-security-groups/be8381c4-c1e6-42f8-b294-6f39e7eb2588 HTTP/1.1 Sep 14 09:11:23.742728 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:11:23.742728 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:11:23.742728 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:11:23.742728 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:11:23.742728 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:11:23.742728 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:11:23.742728 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:11:23.742728 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:11:23.742728 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZpubEr9UgWj_j7j968HWFZ0D3vsD9X5NGBGI22hLpa671vkRnOFuLUHN5BGyBOTOD_eSiiXbv14AW_KXyWtJ-nEaHjFTRMlAQdICZGgh9e4MfCMr0iqhNEP0c19crMOXUBhQTUSoeq6F9tEyTwVcFxkCl04_QVOcf30LScxQWEOmzE Sep 14 09:11:23.742728 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:11:23.742728 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:11:23.742728 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:11:23.742728 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:11:23.742728 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:11:23.742728 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:11:23.742728 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: de0783155bf04154bf28fc70bcb7580d Sep 14 09:11:23.742728 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-SecurityGroupsTestJSON-367581750 Sep 14 09:11:23.742728 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:11:23.742728 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:11:23.742728 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/de0783155bf04154bf28fc70bcb7580d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_de0783155bf04154bf28fc70bcb7580d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/de0783155bf04154bf28fc70bcb7580d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/de0783155bf04154bf28fc70bcb7580d"}]}] Sep 14 09:11:23.742728 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-SecurityGroupsTestJSON-367581750 Sep 14 09:11:23.742728 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: de0783155bf04154bf28fc70bcb7580d Sep 14 09:11:23.742728 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-367581750 Sep 14 09:11:23.742728 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-SecurityGroupsTestJSON-367581750-project Sep 14 09:11:23.742728 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:11:23.742728 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:11:23.742728 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 2dabfdd5a6e049c48d00bc1b55a0a30f Sep 14 09:11:23.742728 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-SecurityGroupsTestJSON-367581750-project Sep 14 09:11:23.742728 n-d-836830-18 devstack@n-api.service[128759]: method: Sep 14 09:11:23.742728 n-d-836830-18 devstack@n-api.service[128759]: exception: Security group be8381c4-c1e6-42f8-b294-6f39e7eb2588 does not exist Sep 14 09:11:23.742728 n-d-836830-18 devstack@n-api.service[128759]: Neutron server returns request_ids: ['req-9dfb00ef-e4fe-44e1-a98b-9665817a6c22'] Sep 14 09:11:23.742728 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': 'be8381c4-c1e6-42f8-b294-6f39e7eb2588'} Sep 14 09:11:23.742728 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:11:23.742728 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:11:23.742728 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 14 09:11:23.742728 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 14 09:11:23.742728 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:11:23.742728 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:11:23.742728 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 14 09:11:23.742728 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 14 09:11:23.742728 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:11:23.742728 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:11:23.742728 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 14 09:11:23.742728 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 14 09:11:23.742728 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:11:23.742728 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:11:23.742728 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 14 09:11:23.742728 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 14 09:11:23.742728 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:11:23.742728 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:11:23.742728 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 14 09:11:23.742728 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 14 09:11:23.742728 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:11:23.742728 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:11:23.742728 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 14 09:11:23.742728 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 14 09:11:23.742728 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 14 09:11:23.742728 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 14 09:11:23.742728 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group be8381c4-c1e6-42f8-b294-6f39e7eb2588 does not exist Sep 14 09:11:23.747682 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9dfb00ef-e4fe-44e1-a98b-9665817a6c22'] Sep 14 09:11:23.747682 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:11:23.747682 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:11:23.747682 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:11:23.747682 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:11:23.747682 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 14 09:11:23.747682 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 14 09:11:23.747682 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 14 09:11:23.747682 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 14 09:11:23.747682 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group be8381c4-c1e6-42f8-b294-6f39e7eb2588 does not exist Sep 14 09:11:23.747682 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9dfb00ef-e4fe-44e1-a98b-9665817a6c22'] Sep 14 09:11:23.747682 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:11:23.747682 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:11:23.747682 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:11:23.747682 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:11:23.747682 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:11:23.747682 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:11:23.747682 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:11:23.747682 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:11:23.747682 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:11:23.747682 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:11:23.747682 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:11:23.747682 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:11:23.747682 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 14 09:11:23.747682 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 14 09:11:23.747682 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group be8381c4-c1e6-42f8-b294-6f39e7eb2588 does not exist Sep 14 09:11:23.747682 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9dfb00ef-e4fe-44e1-a98b-9665817a6c22'] Sep 14 09:11:23.747682 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:11:23.747682 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:11:23.747682 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:11:23.747682 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:11:23.747682 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:11:23.747682 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:11:23.747682 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:11:23.747682 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:11:23.747682 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group be8381c4-c1e6-42f8-b294-6f39e7eb2588 does not exist Sep 14 09:11:23.747682 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9dfb00ef-e4fe-44e1-a98b-9665817a6c22'] Sep 14 09:11:23.747682 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:11:23.747682 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8fb01976-43c5-4cd4-ac54-9d862e2bc63b tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Returning 404 to user: Security group be8381c4-c1e6-42f8-b294-6f39e7eb2588 does not exist Sep 14 09:11:23.747682 n-d-836830-18 devstack@n-api.service[128759]: Neutron server returns request_ids: ['req-9dfb00ef-e4fe-44e1-a98b-9665817a6c22'] {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:11:23.747682 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-8fb01976-43c5-4cd4-ac54-9d862e2bc63b tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/be8381c4-c1e6-42f8-b294-6f39e7eb2588" status: 404 len: 194 microversion: 2.1 time: 0.049181 Sep 14 09:11:23.747682 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2332/4683] 10.222.0.60 () {58 vars in 1272 bytes} [Wed Sep 14 09:11:23 2022] DELETE /compute/v2.1/os-security-groups/be8381c4-c1e6-42f8-b294-6f39e7eb2588 => generated 194 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:11:23.756726 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-e6228096-9630-4b64-85c1-143b5ad4f4d6 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Calling method '.version_select at 0x7f7d3faa3160>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:11:23.786905 n-d-836830-18 devstack@n-api.service[128758]: DEBUG neutronclient.v2_0.client [None req-e6228096-9630-4b64-85c1-143b5ad4f4d6 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a19bce2c-356d-4c64-a198-59bd3c46d3c9 does not exist", "detail": ""}} {{(pid=128758) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 14 09:11:23.787744 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.network.security_group_api [None req-e6228096-9630-4b64-85c1-143b5ad4f4d6 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Neutron security group a19bce2c-356d-4c64-a198-59bd3c46d3c9 not found {{(pid=128758) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 14 09:11:23.788445 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-e6228096-9630-4b64-85c1-143b5ad4f4d6 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] HTTP exception thrown: Security group a19bce2c-356d-4c64-a198-59bd3c46d3c9 does not exist Sep 14 09:11:23.788445 n-d-836830-18 devstack@n-api.service[128758]: Neutron server returns request_ids: ['req-2314253c-3c3a-4721-b672-d0ff1139f29a'] Sep 14 09:11:23.790932 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-e6228096-9630-4b64-85c1-143b5ad4f4d6 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Request method failure captured: Sep 14 09:11:23.790932 n-d-836830-18 devstack@n-api.service[128758]: request: DELETE /compute/v2.1/os-security-groups/a19bce2c-356d-4c64-a198-59bd3c46d3c9 HTTP/1.1 Sep 14 09:11:23.790932 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 09:11:23.790932 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 09:11:23.790932 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 09:11:23.790932 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 09:11:23.790932 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 09:11:23.790932 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 09:11:23.790932 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 09:11:23.790932 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 09:11:23.790932 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZpubEr9UgWj_j7j968HWFZ0D3vsD9X5NGBGI22hLpa671vkRnOFuLUHN5BGyBOTOD_eSiiXbv14AW_KXyWtJ-nEaHjFTRMlAQdICZGgh9e4MfCMr0iqhNEP0c19crMOXUBhQTUSoeq6F9tEyTwVcFxkCl04_QVOcf30LScxQWEOmzE Sep 14 09:11:23.790932 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 09:11:23.790932 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 09:11:23.790932 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 09:11:23.790932 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 09:11:23.790932 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 09:11:23.790932 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 09:11:23.790932 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: de0783155bf04154bf28fc70bcb7580d Sep 14 09:11:23.790932 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-SecurityGroupsTestJSON-367581750 Sep 14 09:11:23.790932 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 09:11:23.790932 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 09:11:23.790932 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/de0783155bf04154bf28fc70bcb7580d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_de0783155bf04154bf28fc70bcb7580d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/de0783155bf04154bf28fc70bcb7580d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/de0783155bf04154bf28fc70bcb7580d"}]}] Sep 14 09:11:23.790932 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-SecurityGroupsTestJSON-367581750 Sep 14 09:11:23.790932 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: de0783155bf04154bf28fc70bcb7580d Sep 14 09:11:23.790932 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-367581750 Sep 14 09:11:23.790932 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-SecurityGroupsTestJSON-367581750-project Sep 14 09:11:23.790932 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 09:11:23.790932 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 09:11:23.790932 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 2dabfdd5a6e049c48d00bc1b55a0a30f Sep 14 09:11:23.790932 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-SecurityGroupsTestJSON-367581750-project Sep 14 09:11:23.790932 n-d-836830-18 devstack@n-api.service[128758]: method: Sep 14 09:11:23.790932 n-d-836830-18 devstack@n-api.service[128758]: exception: Security group a19bce2c-356d-4c64-a198-59bd3c46d3c9 does not exist Sep 14 09:11:23.790932 n-d-836830-18 devstack@n-api.service[128758]: Neutron server returns request_ids: ['req-2314253c-3c3a-4721-b672-d0ff1139f29a'] Sep 14 09:11:23.790932 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': 'a19bce2c-356d-4c64-a198-59bd3c46d3c9'} Sep 14 09:11:23.790932 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:11:23.790932 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:11:23.790932 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 14 09:11:23.790932 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 14 09:11:23.790932 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:11:23.790932 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:11:23.790932 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 14 09:11:23.790932 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 14 09:11:23.790932 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:11:23.790932 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:11:23.790932 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 14 09:11:23.790932 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 14 09:11:23.790932 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:11:23.790932 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:11:23.790932 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 14 09:11:23.790932 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 14 09:11:23.790932 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:11:23.790932 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:11:23.790932 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 14 09:11:23.790932 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 14 09:11:23.790932 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:11:23.790932 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:11:23.790932 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 14 09:11:23.790932 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 14 09:11:23.790932 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 14 09:11:23.790932 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 14 09:11:23.790932 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group a19bce2c-356d-4c64-a198-59bd3c46d3c9 does not exist Sep 14 09:11:23.795952 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2314253c-3c3a-4721-b672-d0ff1139f29a'] Sep 14 09:11:23.795952 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:11:23.795952 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:11:23.795952 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:11:23.795952 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:11:23.795952 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 14 09:11:23.795952 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 14 09:11:23.795952 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 14 09:11:23.795952 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 14 09:11:23.795952 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group a19bce2c-356d-4c64-a198-59bd3c46d3c9 does not exist Sep 14 09:11:23.795952 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2314253c-3c3a-4721-b672-d0ff1139f29a'] Sep 14 09:11:23.795952 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:11:23.795952 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:11:23.795952 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:11:23.795952 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:11:23.795952 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:11:23.795952 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:11:23.795952 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:11:23.795952 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:11:23.795952 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:11:23.795952 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:11:23.795952 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:11:23.795952 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:11:23.795952 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 14 09:11:23.795952 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 14 09:11:23.795952 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group a19bce2c-356d-4c64-a198-59bd3c46d3c9 does not exist Sep 14 09:11:23.795952 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2314253c-3c3a-4721-b672-d0ff1139f29a'] Sep 14 09:11:23.795952 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:11:23.795952 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:11:23.795952 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:11:23.795952 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:11:23.795952 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:11:23.795952 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:11:23.795952 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:11:23.795952 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:11:23.795952 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group a19bce2c-356d-4c64-a198-59bd3c46d3c9 does not exist Sep 14 09:11:23.795952 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2314253c-3c3a-4721-b672-d0ff1139f29a'] Sep 14 09:11:23.795952 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:11:23.800214 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-e6228096-9630-4b64-85c1-143b5ad4f4d6 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Returning 404 to user: Security group a19bce2c-356d-4c64-a198-59bd3c46d3c9 does not exist Sep 14 09:11:23.800214 n-d-836830-18 devstack@n-api.service[128758]: Neutron server returns request_ids: ['req-2314253c-3c3a-4721-b672-d0ff1139f29a'] {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:11:23.801364 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-e6228096-9630-4b64-85c1-143b5ad4f4d6 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/a19bce2c-356d-4c64-a198-59bd3c46d3c9" status: 404 len: 194 microversion: 2.1 time: 0.048908 Sep 14 09:11:23.802086 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2352/4684] 10.222.0.60 () {58 vars in 1272 bytes} [Wed Sep 14 09:11:23 2022] DELETE /compute/v2.1/os-security-groups/a19bce2c-356d-4c64-a198-59bd3c46d3c9 => generated 194 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:11:23.810546 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-875b228f-6de6-4a2e-adbe-57819eaa1c17 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:11:23.811089 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-875b228f-6de6-4a2e-adbe-57819eaa1c17 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] [instance: d02d241a-fae5-47c7-9858-cac8171f580a] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:11:23.826974 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-875b228f-6de6-4a2e-adbe-57819eaa1c17 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:23.827503 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-875b228f-6de6-4a2e-adbe-57819eaa1c17 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:23.828480 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-875b228f-6de6-4a2e-adbe-57819eaa1c17 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:23.829203 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-875b228f-6de6-4a2e-adbe-57819eaa1c17 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:23.838122 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-875b228f-6de6-4a2e-adbe-57819eaa1c17 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:23.838705 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-875b228f-6de6-4a2e-adbe-57819eaa1c17 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:23.882773 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-875b228f-6de6-4a2e-adbe-57819eaa1c17 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] [instance: d02d241a-fae5-47c7-9858-cac8171f580a] Going to try to terminate instance {{(pid=128759) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:11:24.030148 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-875b228f-6de6-4a2e-adbe-57819eaa1c17 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] 10.222.0.60 "DELETE /compute/v2.1/servers/d02d241a-fae5-47c7-9858-cac8171f580a" status: 204 len: 0 microversion: 2.1 time: 0.221395 Sep 14 09:11:24.037877 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2333/4685] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:11:23 2022] DELETE /compute/v2.1/servers/d02d241a-fae5-47c7-9858-cac8171f580a => generated 0 bytes in 225 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:11:24.039940 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-cc5e7638-cd83-4c5d-b090-33cd92f2a2a4 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:11:24.040805 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-cc5e7638-cd83-4c5d-b090-33cd92f2a2a4 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] [instance: d02d241a-fae5-47c7-9858-cac8171f580a] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:11:24.070981 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cc5e7638-cd83-4c5d-b090-33cd92f2a2a4 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:24.080190 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cc5e7638-cd83-4c5d-b090-33cd92f2a2a4 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:24.080842 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cc5e7638-cd83-4c5d-b090-33cd92f2a2a4 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:24.081609 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cc5e7638-cd83-4c5d-b090-33cd92f2a2a4 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:24.082084 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cc5e7638-cd83-4c5d-b090-33cd92f2a2a4 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:24.082517 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cc5e7638-cd83-4c5d-b090-33cd92f2a2a4 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:24.418978 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-cc5e7638-cd83-4c5d-b090-33cd92f2a2a4 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dabfdd5a6e049c48d00bc1b55a0a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0783155bf04154bf28fc70bcb7580d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:11:24.434664 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-cc5e7638-cd83-4c5d-b090-33cd92f2a2a4 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] 10.222.0.60 "GET /compute/v2.1/servers/d02d241a-fae5-47c7-9858-cac8171f580a" status: 200 len: 1647 microversion: 2.1 time: 0.399162 Sep 14 09:11:24.435982 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2353/4686] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:11:24 2022] GET /compute/v2.1/servers/d02d241a-fae5-47c7-9858-cac8171f580a => generated 1647 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:11:24.457678 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-86b610bb-9345-451b-8ec9-114085fc2f64 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:11:24.458578 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-86b610bb-9345-451b-8ec9-114085fc2f64 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:11:24.474834 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-86b610bb-9345-451b-8ec9-114085fc2f64 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:24.475645 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-86b610bb-9345-451b-8ec9-114085fc2f64 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:24.478174 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-86b610bb-9345-451b-8ec9-114085fc2f64 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:24.479069 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-86b610bb-9345-451b-8ec9-114085fc2f64 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:24.479804 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-86b610bb-9345-451b-8ec9-114085fc2f64 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:24.480477 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-86b610bb-9345-451b-8ec9-114085fc2f64 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:24.693194 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c37190aa-7f31-47c9-bb1d-53adbc761ccd tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:11:24.695370 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-c37190aa-7f31-47c9-bb1d-53adbc761ccd tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 0ba2a1b2-907f-4598-931a-c6605ffe5682] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:11:24.705741 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c37190aa-7f31-47c9-bb1d-53adbc761ccd tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:24.707801 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c37190aa-7f31-47c9-bb1d-53adbc761ccd tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:24.709328 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c37190aa-7f31-47c9-bb1d-53adbc761ccd tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:24.712642 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c37190aa-7f31-47c9-bb1d-53adbc761ccd tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:24.713415 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c37190aa-7f31-47c9-bb1d-53adbc761ccd tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:24.716953 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c37190aa-7f31-47c9-bb1d-53adbc761ccd tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:24.739891 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-86b610bb-9345-451b-8ec9-114085fc2f64 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:11:24.759896 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-86b610bb-9345-451b-8ec9-114085fc2f64 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:11:24.765494 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-86b610bb-9345-451b-8ec9-114085fc2f64 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:11:24.774481 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-86b610bb-9345-451b-8ec9-114085fc2f64 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5" status: 200 len: 1738 microversion: 2.20 time: 0.321557 Sep 14 09:11:24.791373 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2334/4687] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:11:24 2022] GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5 => generated 1738 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:11:25.460445 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3936b674-8049-4d84-8893-451316ee9fcf tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:11:25.461072 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-3936b674-8049-4d84-8893-451316ee9fcf tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] [instance: d02d241a-fae5-47c7-9858-cac8171f580a] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:11:25.468063 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3936b674-8049-4d84-8893-451316ee9fcf tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:25.474456 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3936b674-8049-4d84-8893-451316ee9fcf tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:25.475195 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3936b674-8049-4d84-8893-451316ee9fcf tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:25.479393 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3936b674-8049-4d84-8893-451316ee9fcf tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:25.480352 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3936b674-8049-4d84-8893-451316ee9fcf tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:25.481209 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3936b674-8049-4d84-8893-451316ee9fcf tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:25.525491 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-c37190aa-7f31-47c9-bb1d-53adbc761ccd tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:11:25.537331 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-c37190aa-7f31-47c9-bb1d-53adbc761ccd tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/0ba2a1b2-907f-4598-931a-c6605ffe5682" status: 200 len: 1314 microversion: 2.1 time: 0.848986 Sep 14 09:11:25.546535 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2354/4688] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:11:24 2022] GET /compute/v2.1/servers/0ba2a1b2-907f-4598-931a-c6605ffe5682 => generated 1314 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:11:25.806607 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-8b1bdc98-ad4c-4ad0-9538-167dd760a72e tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:11:25.807482 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-8b1bdc98-ad4c-4ad0-9538-167dd760a72e tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:11:25.827637 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8b1bdc98-ad4c-4ad0-9538-167dd760a72e tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:25.830107 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8b1bdc98-ad4c-4ad0-9538-167dd760a72e tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:25.830912 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8b1bdc98-ad4c-4ad0-9538-167dd760a72e tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:25.834635 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8b1bdc98-ad4c-4ad0-9538-167dd760a72e tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:25.835365 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8b1bdc98-ad4c-4ad0-9538-167dd760a72e tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:25.836010 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8b1bdc98-ad4c-4ad0-9538-167dd760a72e tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:25.919194 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-3936b674-8049-4d84-8893-451316ee9fcf tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dabfdd5a6e049c48d00bc1b55a0a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0783155bf04154bf28fc70bcb7580d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:11:25.929562 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-3936b674-8049-4d84-8893-451316ee9fcf tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] 10.222.0.60 "GET /compute/v2.1/servers/d02d241a-fae5-47c7-9858-cac8171f580a" status: 200 len: 1647 microversion: 2.1 time: 0.473928 Sep 14 09:11:25.930167 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2335/4689] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:11:25 2022] GET /compute/v2.1/servers/d02d241a-fae5-47c7-9858-cac8171f580a => generated 1647 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:11:26.575253 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-78c86e75-c748-41d9-bdb4-e7a67e0f1a77 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:11:26.575877 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-78c86e75-c748-41d9-bdb4-e7a67e0f1a77 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 0ba2a1b2-907f-4598-931a-c6605ffe5682] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:11:26.598991 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-78c86e75-c748-41d9-bdb4-e7a67e0f1a77 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:26.599503 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-78c86e75-c748-41d9-bdb4-e7a67e0f1a77 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:26.612234 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-78c86e75-c748-41d9-bdb4-e7a67e0f1a77 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:26.613863 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-78c86e75-c748-41d9-bdb4-e7a67e0f1a77 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:26.614571 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-78c86e75-c748-41d9-bdb4-e7a67e0f1a77 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:26.615110 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-78c86e75-c748-41d9-bdb4-e7a67e0f1a77 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:26.716647 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-8b1bdc98-ad4c-4ad0-9538-167dd760a72e tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:11:26.730015 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-8b1bdc98-ad4c-4ad0-9538-167dd760a72e tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:11:26.736027 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-8b1bdc98-ad4c-4ad0-9538-167dd760a72e tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:11:26.737527 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-8b1bdc98-ad4c-4ad0-9538-167dd760a72e tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5" status: 200 len: 1738 microversion: 2.20 time: 0.936650 Sep 14 09:11:26.739293 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2355/4690] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:11:25 2022] GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5 => generated 1738 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:11:26.963542 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-71250199-ac4d-4825-b5d0-ae5ac87c3fd9 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:11:26.964374 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-71250199-ac4d-4825-b5d0-ae5ac87c3fd9 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] [instance: d02d241a-fae5-47c7-9858-cac8171f580a] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:11:27.004067 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-71250199-ac4d-4825-b5d0-ae5ac87c3fd9 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:27.016025 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-71250199-ac4d-4825-b5d0-ae5ac87c3fd9 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:27.016578 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-71250199-ac4d-4825-b5d0-ae5ac87c3fd9 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:27.021140 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-71250199-ac4d-4825-b5d0-ae5ac87c3fd9 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:27.021670 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-71250199-ac4d-4825-b5d0-ae5ac87c3fd9 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:27.022116 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-71250199-ac4d-4825-b5d0-ae5ac87c3fd9 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:27.484688 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-71250199-ac4d-4825-b5d0-ae5ac87c3fd9 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dabfdd5a6e049c48d00bc1b55a0a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0783155bf04154bf28fc70bcb7580d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:11:27.493354 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-71250199-ac4d-4825-b5d0-ae5ac87c3fd9 tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] 10.222.0.60 "GET /compute/v2.1/servers/d02d241a-fae5-47c7-9858-cac8171f580a" status: 200 len: 1468 microversion: 2.1 time: 0.535306 Sep 14 09:11:27.493954 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2356/4691] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:11:26 2022] GET /compute/v2.1/servers/d02d241a-fae5-47c7-9858-cac8171f580a => generated 1468 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:11:27.640752 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-78c86e75-c748-41d9-bdb4-e7a67e0f1a77 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:11:27.651562 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-78c86e75-c748-41d9-bdb4-e7a67e0f1a77 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/0ba2a1b2-907f-4598-931a-c6605ffe5682" status: 200 len: 1314 microversion: 2.1 time: 1.081504 Sep 14 09:11:27.657307 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2336/4692] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:11:26 2022] GET /compute/v2.1/servers/0ba2a1b2-907f-4598-931a-c6605ffe5682 => generated 1314 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:11:27.734694 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-25c47a1c-22da-4d23-81b3-debe9bbc28e4 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Action: 'create', calling method: .version_select at 0x7f7d3f332e50>, body: {"keypair": {"name": "tempest-keypair-1269555688", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEXJe6maLY79yV9Ga53QPdVna6f/rfdE2YIkFAKxuLPvPja4oOfa1XqEO3Q2oRDsk3pX0+X0Jlw/jNEzHiWHt+0u9mDpcp50pK83jv6PBewiNnPngsltrbC/Kf0e2jimJA=="}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:11:27.766239 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b4ea78e9-9725-4d31-97de-79a74b96f9c8 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:11:27.766852 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b4ea78e9-9725-4d31-97de-79a74b96f9c8 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:11:27.775300 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b4ea78e9-9725-4d31-97de-79a74b96f9c8 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:27.775794 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b4ea78e9-9725-4d31-97de-79a74b96f9c8 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:27.776234 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b4ea78e9-9725-4d31-97de-79a74b96f9c8 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:27.776940 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b4ea78e9-9725-4d31-97de-79a74b96f9c8 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:27.777394 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b4ea78e9-9725-4d31-97de-79a74b96f9c8 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:27.777817 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b4ea78e9-9725-4d31-97de-79a74b96f9c8 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:27.790601 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-25c47a1c-22da-4d23-81b3-debe9bbc28e4 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Getting quotas for project 9672a6c416ee44289eaa4d7c664d307e. Resources: {'key_pairs'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:11:27.820609 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-25c47a1c-22da-4d23-81b3-debe9bbc28e4 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Getting quotas for user 7daab4f69af5452c8641006d9f09edce and project 9672a6c416ee44289eaa4d7c664d307e. Resources: {'key_pairs'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:11:27.864624 n-d-836830-18 devstack@n-api.service[128758]: ERROR oslo.messaging._drivers.impl_rabbit [None req-25c47a1c-22da-4d23-81b3-debe9bbc28e4 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [9c307738-a09e-46fc-a558-c2b092a37ed4] AMQP server on 10.222.0.60:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 14 09:11:28.734226 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b4ea78e9-9725-4d31-97de-79a74b96f9c8 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:11:28.761262 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b4ea78e9-9725-4d31-97de-79a74b96f9c8 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:11:28.776884 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b4ea78e9-9725-4d31-97de-79a74b96f9c8 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:11:28.789175 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b4ea78e9-9725-4d31-97de-79a74b96f9c8 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5" status: 200 len: 1738 microversion: 2.20 time: 1.020068 Sep 14 09:11:28.791080 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2337/4693] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:11:27 2022] GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5 => generated 1738 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:11:28.814059 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-27431398-c40a-49d8-b045-813570e8e467 req-9bccd0ce-5971-43a1-b97a-12b32302254a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ba2a1b2-907f-4598-931a-c6605ffe5682", "name": "network-vif-plugged", "status": "completed", "tag": "fbe17787-eb51-420c-a0a5-759d340dee8c"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:11:28.873487 n-d-836830-18 devstack@n-api.service[128758]: INFO oslo.messaging._drivers.impl_rabbit [None req-25c47a1c-22da-4d23-81b3-debe9bbc28e4 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [9c307738-a09e-46fc-a558-c2b092a37ed4] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 44286. Sep 14 09:11:28.886901 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-27431398-c40a-49d8-b045-813570e8e467 req-9bccd0ce-5971-43a1-b97a-12b32302254a service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:28.893175 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-27431398-c40a-49d8-b045-813570e8e467 req-9bccd0ce-5971-43a1-b97a-12b32302254a service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:28.894855 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-27431398-c40a-49d8-b045-813570e8e467 req-9bccd0ce-5971-43a1-b97a-12b32302254a service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:28.901493 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-25c47a1c-22da-4d23-81b3-debe9bbc28e4 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.171991 Sep 14 09:11:28.905518 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2357/4694] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Sep 14 09:11:27 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:11:28.930131 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-681fdcfb-43cd-462c-b419-b74185ade1d8 req-84a41ecd-4fdf-4d0f-8472-7664fb67c1fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d02d241a-fae5-47c7-9858-cac8171f580a", "name": "network-vif-deleted", "tag": "5f024dc9-ac58-4e56-8032-628e56a69cfa"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:11:28.945854 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-27431398-c40a-49d8-b045-813570e8e467 req-9bccd0ce-5971-43a1-b97a-12b32302254a service nova] Creating event network-vif-plugged:fbe17787-eb51-420c-a0a5-759d340dee8c for instance 0ba2a1b2-907f-4598-931a-c6605ffe5682 on n-h1-836830-18 Sep 14 09:11:28.962482 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-27431398-c40a-49d8-b045-813570e8e467 req-9bccd0ce-5971-43a1-b97a-12b32302254a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.166533 Sep 14 09:11:28.963852 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2338/4695] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:11:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:11:28.971256 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-1a465ded-b133-4c0d-a001-b7c12dcda27b tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:11:28.972202 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-1a465ded-b133-4c0d-a001-b7c12dcda27b tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] [instance: d02d241a-fae5-47c7-9858-cac8171f580a] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:11:28.979512 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1a465ded-b133-4c0d-a001-b7c12dcda27b tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:28.980403 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1a465ded-b133-4c0d-a001-b7c12dcda27b tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:28.981103 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1a465ded-b133-4c0d-a001-b7c12dcda27b tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:28.982019 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1a465ded-b133-4c0d-a001-b7c12dcda27b tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:28.982651 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1a465ded-b133-4c0d-a001-b7c12dcda27b tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:28.983407 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1a465ded-b133-4c0d-a001-b7c12dcda27b tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:28.986652 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-681fdcfb-43cd-462c-b419-b74185ade1d8 req-84a41ecd-4fdf-4d0f-8472-7664fb67c1fe service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:28.997722 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-681fdcfb-43cd-462c-b419-b74185ade1d8 req-84a41ecd-4fdf-4d0f-8472-7664fb67c1fe service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:28.999009 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-681fdcfb-43cd-462c-b419-b74185ade1d8 req-84a41ecd-4fdf-4d0f-8472-7664fb67c1fe service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:29.035096 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-1a465ded-b133-4c0d-a001-b7c12dcda27b tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] HTTP exception thrown: Instance d02d241a-fae5-47c7-9858-cac8171f580a could not be found. Sep 14 09:11:29.043367 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-1a465ded-b133-4c0d-a001-b7c12dcda27b tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Request method failure captured: Sep 14 09:11:29.043367 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/d02d241a-fae5-47c7-9858-cac8171f580a HTTP/1.1 Sep 14 09:11:29.043367 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:11:29.043367 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:11:29.043367 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:11:29.043367 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:11:29.043367 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:11:29.043367 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:11:29.043367 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:11:29.043367 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:11:29.043367 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZpubEr9UgWj_j7j968HWFZ0D3vsD9X5NGBGI22hLpa671vkRnOFuLUHN5BGyBOTOD_eSiiXbv14AW_KXyWtJ-nEaHjFTRMlAQdICZGgh9e4MfCMr0iqhNEP0c19crMOXUBhQTUSoeq6F9tEyTwVcFxkCl04_QVOcf30LScxQWEOmzE Sep 14 09:11:29.043367 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:11:29.043367 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:11:29.043367 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:11:29.043367 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:11:29.043367 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:11:29.043367 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:11:29.043367 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: de0783155bf04154bf28fc70bcb7580d Sep 14 09:11:29.043367 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-SecurityGroupsTestJSON-367581750 Sep 14 09:11:29.043367 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:11:29.043367 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:11:29.043367 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/de0783155bf04154bf28fc70bcb7580d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_de0783155bf04154bf28fc70bcb7580d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/de0783155bf04154bf28fc70bcb7580d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/de0783155bf04154bf28fc70bcb7580d"}]}] Sep 14 09:11:29.043367 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-SecurityGroupsTestJSON-367581750 Sep 14 09:11:29.043367 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: de0783155bf04154bf28fc70bcb7580d Sep 14 09:11:29.043367 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-367581750 Sep 14 09:11:29.043367 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-SecurityGroupsTestJSON-367581750-project Sep 14 09:11:29.043367 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:11:29.043367 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:11:29.043367 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 2dabfdd5a6e049c48d00bc1b55a0a30f Sep 14 09:11:29.043367 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-SecurityGroupsTestJSON-367581750-project Sep 14 09:11:29.043367 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:11:29.043367 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance d02d241a-fae5-47c7-9858-cac8171f580a could not be found. Sep 14 09:11:29.043367 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': 'd02d241a-fae5-47c7-9858-cac8171f580a'} Sep 14 09:11:29.043367 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:11:29.043367 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:11:29.043367 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:11:29.043367 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:11:29.043367 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:11:29.043367 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:11:29.043367 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:11:29.043367 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:11:29.043367 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:11:29.043367 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:11:29.043367 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d02d241a-fae5-47c7-9858-cac8171f580a could not be found. Sep 14 09:11:29.043367 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:11:29.043367 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:11:29.043367 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:11:29.043367 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:11:29.043367 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:11:29.043367 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:11:29.043367 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:11:29.043367 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:11:29.043367 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:11:29.043367 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:11:29.043367 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:11:29.043367 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:11:29.043367 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:11:29.043367 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:11:29.043367 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:11:29.043367 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:11:29.043367 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d02d241a-fae5-47c7-9858-cac8171f580a could not be found. Sep 14 09:11:29.043367 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:11:29.043367 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:11:29.043367 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:11:29.051031 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:11:29.051031 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:11:29.051031 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:11:29.051031 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:11:29.051031 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:11:29.051031 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d02d241a-fae5-47c7-9858-cac8171f580a could not be found. Sep 14 09:11:29.051031 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:11:29.054122 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-1a465ded-b133-4c0d-a001-b7c12dcda27b tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Returning 404 to user: Instance d02d241a-fae5-47c7-9858-cac8171f580a could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:11:29.057661 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-1a465ded-b133-4c0d-a001-b7c12dcda27b tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] 10.222.0.60 "GET /compute/v2.1/servers/d02d241a-fae5-47c7-9858-cac8171f580a" status: 404 len: 111 microversion: 2.1 time: 0.092392 Sep 14 09:11:29.059976 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2339/4696] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:11:28 2022] GET /compute/v2.1/servers/d02d241a-fae5-47c7-9858-cac8171f580a => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:11:29.090723 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-681fdcfb-43cd-462c-b419-b74185ade1d8 req-84a41ecd-4fdf-4d0f-8472-7664fb67c1fe service nova] Creating event network-vif-deleted:5f024dc9-ac58-4e56-8032-628e56a69cfa for instance d02d241a-fae5-47c7-9858-cac8171f580a on n-h1-836830-18 Sep 14 09:11:29.105764 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ab42c357-c86b-4770-a66f-9344e75187ee tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:11:29.109884 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-ab42c357-c86b-4770-a66f-9344e75187ee tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 0ba2a1b2-907f-4598-931a-c6605ffe5682] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:11:29.117154 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-681fdcfb-43cd-462c-b419-b74185ade1d8 req-84a41ecd-4fdf-4d0f-8472-7664fb67c1fe service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.205534 Sep 14 09:11:29.123359 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2358/4697] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:11:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:11:29.132550 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ab42c357-c86b-4770-a66f-9344e75187ee tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:29.133063 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ab42c357-c86b-4770-a66f-9344e75187ee tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:29.133515 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ab42c357-c86b-4770-a66f-9344e75187ee tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:29.138550 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ab42c357-c86b-4770-a66f-9344e75187ee tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:29.139052 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ab42c357-c86b-4770-a66f-9344e75187ee tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:29.142637 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ab42c357-c86b-4770-a66f-9344e75187ee tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:29.148413 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-e357dca2-2254-43f8-9f5c-b2e3706643fd tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Calling method '.version_select at 0x7f7d3f3324c0>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:11:29.839179 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-ab42c357-c86b-4770-a66f-9344e75187ee tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:11:29.860167 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-ab42c357-c86b-4770-a66f-9344e75187ee tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/0ba2a1b2-907f-4598-931a-c6605ffe5682" status: 200 len: 1314 microversion: 2.1 time: 0.798461 Sep 14 09:11:29.860920 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2340/4698] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:11:29 2022] GET /compute/v2.1/servers/0ba2a1b2-907f-4598-931a-c6605ffe5682 => generated 1314 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:11:29.879768 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-325ba000-34ca-45e9-831e-8637c099e018 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:11:29.880774 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-325ba000-34ca-45e9-831e-8637c099e018 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:11:29.895974 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-325ba000-34ca-45e9-831e-8637c099e018 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:29.896847 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-325ba000-34ca-45e9-831e-8637c099e018 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:29.897579 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-325ba000-34ca-45e9-831e-8637c099e018 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:29.899398 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-325ba000-34ca-45e9-831e-8637c099e018 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:29.900547 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-325ba000-34ca-45e9-831e-8637c099e018 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:29.901191 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-325ba000-34ca-45e9-831e-8637c099e018 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:30.086802 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-e357dca2-2254-43f8-9f5c-b2e3706643fd tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/59864ebb-3f82-4f96-b37c-3c6ffc7622f9" status: 202 len: 0 microversion: 2.1 time: 0.960071 Sep 14 09:11:30.087514 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2359/4699] 10.222.0.60 () {58 vars in 1272 bytes} [Wed Sep 14 09:11:29 2022] DELETE /compute/v2.1/os-security-groups/59864ebb-3f82-4f96-b37c-3c6ffc7622f9 => generated 0 bytes in 963 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:11:30.095962 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-88909a0a-986b-4075-b34a-17f074881e7f tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] Calling method '.version_select at 0x7f7d3f4143a0>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:11:30.501159 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-325ba000-34ca-45e9-831e-8637c099e018 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:11:30.561312 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-325ba000-34ca-45e9-831e-8637c099e018 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:11:30.571131 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-325ba000-34ca-45e9-831e-8637c099e018 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:11:30.572556 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-325ba000-34ca-45e9-831e-8637c099e018 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5" status: 200 len: 1738 microversion: 2.20 time: 0.709004 Sep 14 09:11:30.582088 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2341/4700] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:11:29 2022] GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5 => generated 1738 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:11:30.884190 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-36f77ef0-57b4-4fa0-ae92-aaeab127c519 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:11:30.886830 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-36f77ef0-57b4-4fa0-ae92-aaeab127c519 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 0ba2a1b2-907f-4598-931a-c6605ffe5682] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:11:30.918117 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-36f77ef0-57b4-4fa0-ae92-aaeab127c519 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:30.929894 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-36f77ef0-57b4-4fa0-ae92-aaeab127c519 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:30.937905 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-36f77ef0-57b4-4fa0-ae92-aaeab127c519 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:30.949068 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-36f77ef0-57b4-4fa0-ae92-aaeab127c519 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:30.953680 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-36f77ef0-57b4-4fa0-ae92-aaeab127c519 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:30.956935 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-36f77ef0-57b4-4fa0-ae92-aaeab127c519 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:30.976600 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-88909a0a-986b-4075-b34a-17f074881e7f tempest-SecurityGroupsTestJSON-367581750 tempest-SecurityGroupsTestJSON-367581750-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/1d246c1e-439c-4c9f-9e54-7067d4b0ee1f" status: 202 len: 0 microversion: 2.1 time: 0.884895 Sep 14 09:11:30.978498 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2360/4701] 10.222.0.60 () {58 vars in 1272 bytes} [Wed Sep 14 09:11:30 2022] DELETE /compute/v2.1/os-security-groups/1d246c1e-439c-4c9f-9e54-7067d4b0ee1f => generated 0 bytes in 887 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 14 09:11:31.611966 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-9169cda1-ff32-48ec-b129-e3456bf40685 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:11:31.615859 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-9169cda1-ff32-48ec-b129-e3456bf40685 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:11:31.663852 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9169cda1-ff32-48ec-b129-e3456bf40685 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:31.664362 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9169cda1-ff32-48ec-b129-e3456bf40685 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:31.664803 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9169cda1-ff32-48ec-b129-e3456bf40685 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:31.665535 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9169cda1-ff32-48ec-b129-e3456bf40685 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:31.665996 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9169cda1-ff32-48ec-b129-e3456bf40685 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:31.666426 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9169cda1-ff32-48ec-b129-e3456bf40685 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:32.876010 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-36f77ef0-57b4-4fa0-ae92-aaeab127c519 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:11:32.895407 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-36f77ef0-57b4-4fa0-ae92-aaeab127c519 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/0ba2a1b2-907f-4598-931a-c6605ffe5682" status: 200 len: 1314 microversion: 2.1 time: 2.015288 Sep 14 09:11:32.922404 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2342/4702] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:11:30 2022] GET /compute/v2.1/servers/0ba2a1b2-907f-4598-931a-c6605ffe5682 => generated 1314 bytes in 2040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:11:33.492877 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-9169cda1-ff32-48ec-b129-e3456bf40685 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:11:33.573306 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-9169cda1-ff32-48ec-b129-e3456bf40685 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:11:33.601222 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-9169cda1-ff32-48ec-b129-e3456bf40685 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:11:33.622784 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-9169cda1-ff32-48ec-b129-e3456bf40685 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5" status: 200 len: 1738 microversion: 2.20 time: 1.998964 Sep 14 09:11:33.654440 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2361/4703] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:11:31 2022] GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5 => generated 1738 bytes in 2048 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:11:33.938681 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ba5a0cd2-f088-4f3d-af74-f879dfd3a10c tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:11:33.940199 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-ba5a0cd2-f088-4f3d-af74-f879dfd3a10c tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 0ba2a1b2-907f-4598-931a-c6605ffe5682] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:11:33.956046 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ba5a0cd2-f088-4f3d-af74-f879dfd3a10c tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:33.958248 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ba5a0cd2-f088-4f3d-af74-f879dfd3a10c tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:33.959097 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ba5a0cd2-f088-4f3d-af74-f879dfd3a10c tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:33.960032 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ba5a0cd2-f088-4f3d-af74-f879dfd3a10c tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:33.962194 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ba5a0cd2-f088-4f3d-af74-f879dfd3a10c tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:33.964451 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ba5a0cd2-f088-4f3d-af74-f879dfd3a10c tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:34.654135 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-7d71d0cd-1c9b-4e53-a07a-b9306706458f tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:11:34.659327 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-7d71d0cd-1c9b-4e53-a07a-b9306706458f tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:11:34.673751 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7d71d0cd-1c9b-4e53-a07a-b9306706458f tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:34.676423 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7d71d0cd-1c9b-4e53-a07a-b9306706458f tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:34.677111 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7d71d0cd-1c9b-4e53-a07a-b9306706458f tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:34.678080 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7d71d0cd-1c9b-4e53-a07a-b9306706458f tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:34.682507 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7d71d0cd-1c9b-4e53-a07a-b9306706458f tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:34.683232 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7d71d0cd-1c9b-4e53-a07a-b9306706458f tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:35.703689 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-ba5a0cd2-f088-4f3d-af74-f879dfd3a10c tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:11:35.716194 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-ba5a0cd2-f088-4f3d-af74-f879dfd3a10c tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/0ba2a1b2-907f-4598-931a-c6605ffe5682" status: 200 len: 1501 microversion: 2.1 time: 1.789521 Sep 14 09:11:35.717070 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2343/4704] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:11:33 2022] GET /compute/v2.1/servers/0ba2a1b2-907f-4598-931a-c6605ffe5682 => generated 1501 bytes in 1791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:11:35.746721 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-99a0809c-0f27-4141-abc3-56591c918498 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:11:35.749943 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-99a0809c-0f27-4141-abc3-56591c918498 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 0ba2a1b2-907f-4598-931a-c6605ffe5682] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:11:35.777311 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-99a0809c-0f27-4141-abc3-56591c918498 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:35.777859 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-99a0809c-0f27-4141-abc3-56591c918498 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:35.778309 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-99a0809c-0f27-4141-abc3-56591c918498 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:35.779095 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-99a0809c-0f27-4141-abc3-56591c918498 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:35.779564 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-99a0809c-0f27-4141-abc3-56591c918498 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:35.779995 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-99a0809c-0f27-4141-abc3-56591c918498 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:35.871364 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-99a0809c-0f27-4141-abc3-56591c918498 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "POST /compute/v2.1/servers/0ba2a1b2-907f-4598-931a-c6605ffe5682/action" status: 200 len: 14 microversion: 2.1 time: 0.123290 Sep 14 09:11:35.876106 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2344/4705] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:11:35 2022] POST /compute/v2.1/servers/0ba2a1b2-907f-4598-931a-c6605ffe5682/action => generated 14 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 09:11:36.100539 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-7d71d0cd-1c9b-4e53-a07a-b9306706458f tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:11:36.112396 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-7d71d0cd-1c9b-4e53-a07a-b9306706458f tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:11:36.116897 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-7d71d0cd-1c9b-4e53-a07a-b9306706458f tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:11:36.128574 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-7d71d0cd-1c9b-4e53-a07a-b9306706458f tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5" status: 200 len: 1738 microversion: 2.20 time: 1.479811 Sep 14 09:11:36.129792 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2362/4706] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:11:34 2022] GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5 => generated 1738 bytes in 1482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:11:36.887326 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-96130819-8489-4e9f-a0dd-d6f143521cde tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:11:36.893036 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-96130819-8489-4e9f-a0dd-d6f143521cde tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 0ba2a1b2-907f-4598-931a-c6605ffe5682] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:11:36.914180 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-96130819-8489-4e9f-a0dd-d6f143521cde tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:36.915434 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-96130819-8489-4e9f-a0dd-d6f143521cde tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:36.916206 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-96130819-8489-4e9f-a0dd-d6f143521cde tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:36.917156 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-96130819-8489-4e9f-a0dd-d6f143521cde tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:36.917900 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-96130819-8489-4e9f-a0dd-d6f143521cde tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:36.918556 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-96130819-8489-4e9f-a0dd-d6f143521cde tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:37.146205 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-96130819-8489-4e9f-a0dd-d6f143521cde tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "POST /compute/v2.1/servers/0ba2a1b2-907f-4598-931a-c6605ffe5682/action" status: 200 len: 14 microversion: 2.1 time: 0.265339 Sep 14 09:11:37.147559 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2345/4707] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:11:36 2022] POST /compute/v2.1/servers/0ba2a1b2-907f-4598-931a-c6605ffe5682/action => generated 14 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 14 09:11:37.166346 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-fb9b71d9-aa3c-44e9-b6bd-8b70081eedda tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:11:37.166976 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-fb9b71d9-aa3c-44e9-b6bd-8b70081eedda tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:11:37.185776 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fb9b71d9-aa3c-44e9-b6bd-8b70081eedda tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:37.186531 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fb9b71d9-aa3c-44e9-b6bd-8b70081eedda tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:37.187283 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fb9b71d9-aa3c-44e9-b6bd-8b70081eedda tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:37.188220 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fb9b71d9-aa3c-44e9-b6bd-8b70081eedda tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:37.188826 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fb9b71d9-aa3c-44e9-b6bd-8b70081eedda tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:37.189401 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fb9b71d9-aa3c-44e9-b6bd-8b70081eedda tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:37.728588 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-fb9b71d9-aa3c-44e9-b6bd-8b70081eedda tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:11:37.738291 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-fb9b71d9-aa3c-44e9-b6bd-8b70081eedda tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:11:37.754498 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-fb9b71d9-aa3c-44e9-b6bd-8b70081eedda tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:11:37.763018 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-fb9b71d9-aa3c-44e9-b6bd-8b70081eedda tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5" status: 200 len: 1720 microversion: 2.20 time: 0.599137 Sep 14 09:11:37.767178 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2363/4708] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:11:37 2022] GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5 => generated 1720 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:11:38.159310 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e50a1bdf-52f9-451b-8e10-efad2a5a820c tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:11:38.162225 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e50a1bdf-52f9-451b-8e10-efad2a5a820c tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 0ba2a1b2-907f-4598-931a-c6605ffe5682] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:11:38.180918 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e50a1bdf-52f9-451b-8e10-efad2a5a820c tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:38.191782 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e50a1bdf-52f9-451b-8e10-efad2a5a820c tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:38.192527 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e50a1bdf-52f9-451b-8e10-efad2a5a820c tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:38.193725 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e50a1bdf-52f9-451b-8e10-efad2a5a820c tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:38.194441 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e50a1bdf-52f9-451b-8e10-efad2a5a820c tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:38.195083 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e50a1bdf-52f9-451b-8e10-efad2a5a820c tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:38.282377 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e50a1bdf-52f9-451b-8e10-efad2a5a820c tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "POST /compute/v2.1/servers/0ba2a1b2-907f-4598-931a-c6605ffe5682/action" status: 200 len: 14 microversion: 2.1 time: 0.127790 Sep 14 09:11:38.283407 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2346/4709] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:11:38 2022] POST /compute/v2.1/servers/0ba2a1b2-907f-4598-931a-c6605ffe5682/action => generated 14 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 09:11:38.794389 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c3202529-4dab-45a0-826f-3c14a68d690f tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:11:38.795791 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-c3202529-4dab-45a0-826f-3c14a68d690f tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:11:38.799862 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=4 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:11:38.817361 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c3202529-4dab-45a0-826f-3c14a68d690f tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:38.818132 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c3202529-4dab-45a0-826f-3c14a68d690f tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:38.818573 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c3202529-4dab-45a0-826f-3c14a68d690f tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:38.819341 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c3202529-4dab-45a0-826f-3c14a68d690f tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:38.819765 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c3202529-4dab-45a0-826f-3c14a68d690f tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:38.824931 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c3202529-4dab-45a0-826f-3c14a68d690f tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:38.985194 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f93621b8-6ee2-4134-8975-ddfab4728301 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-68062077", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8747ac4b-fb94-4411-ac98-d9ed15dcd41c"}], "security_groups": [{"name": "tempest-securitygroup--2092661726"}], "key_name": "tempest-keypair-1269555688", "user_data": "}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:11:39.523832 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-c3202529-4dab-45a0-826f-3c14a68d690f tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:11:39.525825 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.network.neutron [None req-f93621b8-6ee2-4134-8975-ddfab4728301 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] validate_networks() for [('8747ac4b-fb94-4411-ac98-d9ed15dcd41c', None, None, None, None, None)] {{(pid=128759) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:11:39.539427 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-c3202529-4dab-45a0-826f-3c14a68d690f tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:11:39.546461 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-c3202529-4dab-45a0-826f-3c14a68d690f tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:11:39.548179 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-c3202529-4dab-45a0-826f-3c14a68d690f tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5" status: 200 len: 1720 microversion: 2.20 time: 0.758345 Sep 14 09:11:39.549484 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2364/4710] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:11:38 2022] GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5 => generated 1720 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:11:39.566603 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a7e0d8b6-c061-440b-af49-001a229350c3 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:11:39.574317 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-a7e0d8b6-c061-440b-af49-001a229350c3 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 0ba2a1b2-907f-4598-931a-c6605ffe5682] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:11:39.592399 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a7e0d8b6-c061-440b-af49-001a229350c3 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:39.594542 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a7e0d8b6-c061-440b-af49-001a229350c3 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:39.597361 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a7e0d8b6-c061-440b-af49-001a229350c3 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:39.598334 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a7e0d8b6-c061-440b-af49-001a229350c3 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:39.599072 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a7e0d8b6-c061-440b-af49-001a229350c3 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:39.601423 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a7e0d8b6-c061-440b-af49-001a229350c3 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:39.861539 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-a7e0d8b6-c061-440b-af49-001a229350c3 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "POST /compute/v2.1/servers/0ba2a1b2-907f-4598-931a-c6605ffe5682/action" status: 200 len: 14 microversion: 2.1 time: 0.310406 Sep 14 09:11:39.864835 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2365/4711] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:11:39 2022] POST /compute/v2.1/servers/0ba2a1b2-907f-4598-931a-c6605ffe5682/action => generated 14 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 09:11:39.871184 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-e962fe18-6fc5-4e3e-98e3-3f7f84e4ba97 req-579877f3-398d-4f72-a038-708f725e47c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5", "name": "network-vif-unplugged", "status": "completed", "tag": "906bcc79-e290-4b18-8447-de06233392de"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:11:39.899350 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-e962fe18-6fc5-4e3e-98e3-3f7f84e4ba97 req-579877f3-398d-4f72-a038-708f725e47c4 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:39.900622 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-e962fe18-6fc5-4e3e-98e3-3f7f84e4ba97 req-579877f3-398d-4f72-a038-708f725e47c4 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:39.902423 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-e962fe18-6fc5-4e3e-98e3-3f7f84e4ba97 req-579877f3-398d-4f72-a038-708f725e47c4 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:39.935296 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-e962fe18-6fc5-4e3e-98e3-3f7f84e4ba97 req-579877f3-398d-4f72-a038-708f725e47c4 service nova] Creating event network-vif-unplugged:906bcc79-e290-4b18-8447-de06233392de for instance 4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5 on n-h1-836830-18 Sep 14 09:11:39.948243 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-e962fe18-6fc5-4e3e-98e3-3f7f84e4ba97 req-579877f3-398d-4f72-a038-708f725e47c4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.081633 Sep 14 09:11:39.953308 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2366/4712] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:11:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:11:40.579887 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-935a3e19-bf0d-4c5d-94b6-a42e6914b89d tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:11:40.581741 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-935a3e19-bf0d-4c5d-94b6-a42e6914b89d tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:11:40.589271 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-935a3e19-bf0d-4c5d-94b6-a42e6914b89d tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:40.589775 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-935a3e19-bf0d-4c5d-94b6-a42e6914b89d tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:40.590423 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-935a3e19-bf0d-4c5d-94b6-a42e6914b89d tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:40.591512 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-935a3e19-bf0d-4c5d-94b6-a42e6914b89d tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:40.591971 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-935a3e19-bf0d-4c5d-94b6-a42e6914b89d tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:40.592434 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-935a3e19-bf0d-4c5d-94b6-a42e6914b89d tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:41.364722 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-f93621b8-6ee2-4134-8975-ddfab4728301 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Flavor limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:11:41.366082 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-f93621b8-6ee2-4134-8975-ddfab4728301 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Image limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:11:41.366767 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-f93621b8-6ee2-4134-8975-ddfab4728301 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Flavor pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:11:41.367586 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-f93621b8-6ee2-4134-8975-ddfab4728301 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Image pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:11:41.368223 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-f93621b8-6ee2-4134-8975-ddfab4728301 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:11:41.379378 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f93621b8-6ee2-4134-8975-ddfab4728301 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:41.380254 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f93621b8-6ee2-4134-8975-ddfab4728301 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:41.381354 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f93621b8-6ee2-4134-8975-ddfab4728301 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:41.384348 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f93621b8-6ee2-4134-8975-ddfab4728301 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:41.385166 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f93621b8-6ee2-4134-8975-ddfab4728301 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:41.386198 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f93621b8-6ee2-4134-8975-ddfab4728301 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:41.416295 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-f93621b8-6ee2-4134-8975-ddfab4728301 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Getting quotas for project 9672a6c416ee44289eaa4d7c664d307e. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:11:41.424063 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-f93621b8-6ee2-4134-8975-ddfab4728301 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Getting quotas for user 7daab4f69af5452c8641006d9f09edce and project 9672a6c416ee44289eaa4d7c664d307e. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:11:41.441314 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f93621b8-6ee2-4134-8975-ddfab4728301 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Going to run 1 instances... {{(pid=128759) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:11:41.445026 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f93621b8-6ee2-4134-8975-ddfab4728301 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [instance: b13cd01f-fa9b-4d21-a1f9-4f7745dbbe37] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128759) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:11:41.507854 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f93621b8-6ee2-4134-8975-ddfab4728301 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.533791 Sep 14 09:11:41.508783 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2347/4713] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 09:11:38 2022] POST /compute/v2.1/servers => generated 402 bytes in 2536 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:11:41.514017 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-58e5f4bc-bc42-4d52-8341-684ad303b3f1 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:11:41.518162 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-58e5f4bc-bc42-4d52-8341-684ad303b3f1 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 0ba2a1b2-907f-4598-931a-c6605ffe5682] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:11:41.525194 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-58e5f4bc-bc42-4d52-8341-684ad303b3f1 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:41.525985 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-58e5f4bc-bc42-4d52-8341-684ad303b3f1 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:41.526582 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-58e5f4bc-bc42-4d52-8341-684ad303b3f1 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:41.527535 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-58e5f4bc-bc42-4d52-8341-684ad303b3f1 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:41.528149 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-58e5f4bc-bc42-4d52-8341-684ad303b3f1 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:41.528737 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-58e5f4bc-bc42-4d52-8341-684ad303b3f1 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:41.583228 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-935a3e19-bf0d-4c5d-94b6-a42e6914b89d tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:11:41.593545 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-935a3e19-bf0d-4c5d-94b6-a42e6914b89d tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:11:41.600103 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-935a3e19-bf0d-4c5d-94b6-a42e6914b89d tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:11:41.601670 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-935a3e19-bf0d-4c5d-94b6-a42e6914b89d tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5" status: 200 len: 1723 microversion: 2.20 time: 1.027364 Sep 14 09:11:41.603591 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2367/4714] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:11:40 2022] GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5 => generated 1723 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:11:41.610844 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-69541ef5-303e-4476-820f-76106e8c357b tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:11:41.627799 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-69541ef5-303e-4476-820f-76106e8c357b tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [instance: b13cd01f-fa9b-4d21-a1f9-4f7745dbbe37] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:11:41.631779 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-58e5f4bc-bc42-4d52-8341-684ad303b3f1 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "POST /compute/v2.1/servers/0ba2a1b2-907f-4598-931a-c6605ffe5682/action" status: 200 len: 14 microversion: 2.1 time: 0.121494 Sep 14 09:11:41.643443 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2348/4715] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:11:41 2022] POST /compute/v2.1/servers/0ba2a1b2-907f-4598-931a-c6605ffe5682/action => generated 14 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 09:11:41.649258 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-7484a7dc-f72e-40ef-a3d5-d31302f9866c tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6947c133-a0dd-46fe-ae35-0b4c6c12a808"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:11:41.663638 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-7484a7dc-f72e-40ef-a3d5-d31302f9866c tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:11:41.679178 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7484a7dc-f72e-40ef-a3d5-d31302f9866c tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:41.679681 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7484a7dc-f72e-40ef-a3d5-d31302f9866c tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:41.680136 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7484a7dc-f72e-40ef-a3d5-d31302f9866c tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:41.680841 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7484a7dc-f72e-40ef-a3d5-d31302f9866c tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:41.681303 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7484a7dc-f72e-40ef-a3d5-d31302f9866c tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:41.681736 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7484a7dc-f72e-40ef-a3d5-d31302f9866c tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:41.745060 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-69541ef5-303e-4476-820f-76106e8c357b tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daab4f69af5452c8641006d9f09edce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9672a6c416ee44289eaa4d7c664d307e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:11:41.754878 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-69541ef5-303e-4476-820f-76106e8c357b tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "GET /compute/v2.1/servers/b13cd01f-fa9b-4d21-a1f9-4f7745dbbe37" status: 200 len: 1240 microversion: 2.1 time: 0.148346 Sep 14 09:11:41.763314 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2368/4716] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:11:41 2022] GET /compute/v2.1/servers/b13cd01f-fa9b-4d21-a1f9-4f7745dbbe37 => generated 1240 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:11:42.162416 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:11:42.413706 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-7484a7dc-f72e-40ef-a3d5-d31302f9866c tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "POST /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.768824 Sep 14 09:11:42.414351 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2349/4717] 10.222.0.60 () {62 vars in 1364 bytes} [Wed Sep 14 09:11:41 2022] POST /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5/os-volume_attachments => generated 188 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 09:11:42.636124 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-37b2793c-5344-43c2-bf76-51fb1c538bd6 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:11:42.637558 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-37b2793c-5344-43c2-bf76-51fb1c538bd6 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:11:42.643716 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d7b2f181-4475-4f9f-be33-460ef6d6f7be tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:11:42.649157 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-37b2793c-5344-43c2-bf76-51fb1c538bd6 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:42.649652 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-37b2793c-5344-43c2-bf76-51fb1c538bd6 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:42.650097 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-37b2793c-5344-43c2-bf76-51fb1c538bd6 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:42.650808 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-37b2793c-5344-43c2-bf76-51fb1c538bd6 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:42.651080 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-d7b2f181-4475-4f9f-be33-460ef6d6f7be tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 0ba2a1b2-907f-4598-931a-c6605ffe5682] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:11:42.651355 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-37b2793c-5344-43c2-bf76-51fb1c538bd6 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:42.651793 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-37b2793c-5344-43c2-bf76-51fb1c538bd6 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:42.685312 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d7b2f181-4475-4f9f-be33-460ef6d6f7be tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:42.685827 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d7b2f181-4475-4f9f-be33-460ef6d6f7be tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:42.689861 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d7b2f181-4475-4f9f-be33-460ef6d6f7be tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:42.690625 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d7b2f181-4475-4f9f-be33-460ef6d6f7be tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:42.691218 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d7b2f181-4475-4f9f-be33-460ef6d6f7be tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:42.691572 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d7b2f181-4475-4f9f-be33-460ef6d6f7be tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:42.780068 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-37b2793c-5344-43c2-bf76-51fb1c538bd6 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128758) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 14 09:11:42.855315 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d7b2f181-4475-4f9f-be33-460ef6d6f7be tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "POST /compute/v2.1/servers/0ba2a1b2-907f-4598-931a-c6605ffe5682/action" status: 200 len: 14 microversion: 2.1 time: 0.216607 Sep 14 09:11:42.859640 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2350/4718] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:11:42 2022] POST /compute/v2.1/servers/0ba2a1b2-907f-4598-931a-c6605ffe5682/action => generated 14 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 09:11:42.861990 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-6f3c0fc9-8b76-4a21-9474-c6ec0033c97e tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:11:42.862695 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-6f3c0fc9-8b76-4a21-9474-c6ec0033c97e tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [instance: b13cd01f-fa9b-4d21-a1f9-4f7745dbbe37] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:11:42.884214 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6f3c0fc9-8b76-4a21-9474-c6ec0033c97e tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:42.884711 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6f3c0fc9-8b76-4a21-9474-c6ec0033c97e tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:42.885149 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6f3c0fc9-8b76-4a21-9474-c6ec0033c97e tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:42.885855 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6f3c0fc9-8b76-4a21-9474-c6ec0033c97e tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:42.886336 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6f3c0fc9-8b76-4a21-9474-c6ec0033c97e tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:42.886766 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6f3c0fc9-8b76-4a21-9474-c6ec0033c97e tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:42.953913 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-37b2793c-5344-43c2-bf76-51fb1c538bd6 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "POST /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5/action" status: 202 len: 0 microversion: 2.20 time: 0.323327 Sep 14 09:11:42.955415 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2369/4719] 10.222.0.60 () {62 vars in 1319 bytes} [Wed Sep 14 09:11:42 2022] POST /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5/action => generated 0 bytes in 325 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:11:42.965157 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-41eca1da-abbb-413a-8637-b250e5e33be8 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:11:42.966376 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-41eca1da-abbb-413a-8637-b250e5e33be8 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:11:42.992318 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-41eca1da-abbb-413a-8637-b250e5e33be8 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:42.993579 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-41eca1da-abbb-413a-8637-b250e5e33be8 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:42.994377 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-41eca1da-abbb-413a-8637-b250e5e33be8 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:42.996871 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-41eca1da-abbb-413a-8637-b250e5e33be8 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:42.997681 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-41eca1da-abbb-413a-8637-b250e5e33be8 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:42.998444 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-41eca1da-abbb-413a-8637-b250e5e33be8 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:43.100885 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-6f3c0fc9-8b76-4a21-9474-c6ec0033c97e tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daab4f69af5452c8641006d9f09edce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9672a6c416ee44289eaa4d7c664d307e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:11:43.117557 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-6f3c0fc9-8b76-4a21-9474-c6ec0033c97e tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "GET /compute/v2.1/servers/b13cd01f-fa9b-4d21-a1f9-4f7745dbbe37" status: 200 len: 1236 microversion: 2.1 time: 0.260251 Sep 14 09:11:43.118146 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2351/4720] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:11:42 2022] GET /compute/v2.1/servers/b13cd01f-fa9b-4d21-a1f9-4f7745dbbe37 => generated 1236 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:11:43.529493 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-41eca1da-abbb-413a-8637-b250e5e33be8 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:11:43.542149 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-41eca1da-abbb-413a-8637-b250e5e33be8 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:11:43.546625 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-41eca1da-abbb-413a-8637-b250e5e33be8 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:11:43.554674 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-41eca1da-abbb-413a-8637-b250e5e33be8 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5" status: 200 len: 1749 microversion: 2.20 time: 0.594085 Sep 14 09:11:43.571754 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2370/4721] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:11:42 2022] GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5 => generated 1749 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 09:11:43.867703 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3b4202a8-a11a-44b8-bdbc-54babf365d81 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:11:43.870051 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-3b4202a8-a11a-44b8-bdbc-54babf365d81 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 0ba2a1b2-907f-4598-931a-c6605ffe5682] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:11:43.899723 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3b4202a8-a11a-44b8-bdbc-54babf365d81 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:43.900279 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3b4202a8-a11a-44b8-bdbc-54babf365d81 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:43.900740 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3b4202a8-a11a-44b8-bdbc-54babf365d81 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:43.901491 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3b4202a8-a11a-44b8-bdbc-54babf365d81 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:43.907753 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3b4202a8-a11a-44b8-bdbc-54babf365d81 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:43.908223 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3b4202a8-a11a-44b8-bdbc-54babf365d81 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:44.035739 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-3b4202a8-a11a-44b8-bdbc-54babf365d81 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "POST /compute/v2.1/servers/0ba2a1b2-907f-4598-931a-c6605ffe5682/action" status: 200 len: 8207 microversion: 2.1 time: 0.171528 Sep 14 09:11:44.036901 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2352/4722] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:11:43 2022] POST /compute/v2.1/servers/0ba2a1b2-907f-4598-931a-c6605ffe5682/action => generated 8207 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:11:44.046886 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-12d65425-7acb-424e-90e0-d595d29da60b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:11:44.047569 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-12d65425-7acb-424e-90e0-d595d29da60b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:11:44.069684 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-12d65425-7acb-424e-90e0-d595d29da60b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:44.070461 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-12d65425-7acb-424e-90e0-d595d29da60b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:44.071131 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-12d65425-7acb-424e-90e0-d595d29da60b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:44.077001 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-12d65425-7acb-424e-90e0-d595d29da60b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:44.077988 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-12d65425-7acb-424e-90e0-d595d29da60b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:44.078730 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-12d65425-7acb-424e-90e0-d595d29da60b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:44.144928 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-914c1022-b941-4333-b41d-1e3dabcf8798 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:11:44.145958 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-914c1022-b941-4333-b41d-1e3dabcf8798 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [instance: b13cd01f-fa9b-4d21-a1f9-4f7745dbbe37] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:11:44.169977 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-914c1022-b941-4333-b41d-1e3dabcf8798 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:44.176422 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-914c1022-b941-4333-b41d-1e3dabcf8798 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:44.177072 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-914c1022-b941-4333-b41d-1e3dabcf8798 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:44.179656 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-914c1022-b941-4333-b41d-1e3dabcf8798 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:44.180378 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-914c1022-b941-4333-b41d-1e3dabcf8798 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:44.182127 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-914c1022-b941-4333-b41d-1e3dabcf8798 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:44.738322 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-914c1022-b941-4333-b41d-1e3dabcf8798 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daab4f69af5452c8641006d9f09edce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9672a6c416ee44289eaa4d7c664d307e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:11:44.746281 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-914c1022-b941-4333-b41d-1e3dabcf8798 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "GET /compute/v2.1/servers/b13cd01f-fa9b-4d21-a1f9-4f7745dbbe37" status: 200 len: 1310 microversion: 2.1 time: 0.605695 Sep 14 09:11:44.752108 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2353/4723] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:11:44 2022] GET /compute/v2.1/servers/b13cd01f-fa9b-4d21-a1f9-4f7745dbbe37 => generated 1310 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:11:44.762452 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-cd6084ac-a0bf-4aa4-8a00-82c444605541 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:11:44.763485 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-cd6084ac-a0bf-4aa4-8a00-82c444605541 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:11:44.785255 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cd6084ac-a0bf-4aa4-8a00-82c444605541 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:44.786125 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cd6084ac-a0bf-4aa4-8a00-82c444605541 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:44.786805 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cd6084ac-a0bf-4aa4-8a00-82c444605541 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:44.787780 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cd6084ac-a0bf-4aa4-8a00-82c444605541 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:44.788476 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cd6084ac-a0bf-4aa4-8a00-82c444605541 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:44.789162 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cd6084ac-a0bf-4aa4-8a00-82c444605541 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:45.064494 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-12d65425-7acb-424e-90e0-d595d29da60b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:11:45.077064 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-12d65425-7acb-424e-90e0-d595d29da60b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105" status: 200 len: 1668 microversion: 2.1 time: 1.034542 Sep 14 09:11:45.096986 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2371/4724] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:11:44 2022] GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105 => generated 1668 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:11:45.113328 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-cc721812-c905-4412-90ce-76cea0cbe067 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:11:45.114042 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-cc721812-c905-4412-90ce-76cea0cbe067 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:11:45.135157 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:11:45.137587 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cc721812-c905-4412-90ce-76cea0cbe067 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:45.139176 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cc721812-c905-4412-90ce-76cea0cbe067 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:45.139176 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cc721812-c905-4412-90ce-76cea0cbe067 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:45.142665 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cc721812-c905-4412-90ce-76cea0cbe067 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:45.146460 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cc721812-c905-4412-90ce-76cea0cbe067 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:45.147145 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cc721812-c905-4412-90ce-76cea0cbe067 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:45.580898 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-cd6084ac-a0bf-4aa4-8a00-82c444605541 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:11:45.594555 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-cd6084ac-a0bf-4aa4-8a00-82c444605541 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:11:45.603872 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-cd6084ac-a0bf-4aa4-8a00-82c444605541 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:11:45.605747 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-cd6084ac-a0bf-4aa4-8a00-82c444605541 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5" status: 200 len: 1751 microversion: 2.20 time: 0.852383 Sep 14 09:11:45.609198 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2354/4725] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:11:44 2022] GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5 => generated 1751 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:11:45.785130 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-19d5af5a-6ac3-4ced-9499-8b0a6508e7c5 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:11:45.785756 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-19d5af5a-6ac3-4ced-9499-8b0a6508e7c5 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [instance: b13cd01f-fa9b-4d21-a1f9-4f7745dbbe37] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:11:45.787892 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:11:45.802666 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-19d5af5a-6ac3-4ced-9499-8b0a6508e7c5 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:45.806145 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-19d5af5a-6ac3-4ced-9499-8b0a6508e7c5 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:45.806811 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-19d5af5a-6ac3-4ced-9499-8b0a6508e7c5 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:45.807747 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-19d5af5a-6ac3-4ced-9499-8b0a6508e7c5 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:45.808368 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-19d5af5a-6ac3-4ced-9499-8b0a6508e7c5 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:45.808952 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-19d5af5a-6ac3-4ced-9499-8b0a6508e7c5 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:45.909115 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-cc721812-c905-4412-90ce-76cea0cbe067 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:11:45.924023 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-cc721812-c905-4412-90ce-76cea0cbe067 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105" status: 200 len: 1668 microversion: 2.1 time: 0.814670 Sep 14 09:11:45.937502 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2372/4726] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:11:45 2022] GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105 => generated 1668 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:11:45.969948 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-7c0bbcf7-359a-4ea1-8c39-349ffda607d7 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:11:45.970576 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-7c0bbcf7-359a-4ea1-8c39-349ffda607d7 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:11:46.005207 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7c0bbcf7-359a-4ea1-8c39-349ffda607d7 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:46.005709 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7c0bbcf7-359a-4ea1-8c39-349ffda607d7 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:46.006152 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7c0bbcf7-359a-4ea1-8c39-349ffda607d7 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:46.006843 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7c0bbcf7-359a-4ea1-8c39-349ffda607d7 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:46.016668 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7c0bbcf7-359a-4ea1-8c39-349ffda607d7 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:46.017154 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7c0bbcf7-359a-4ea1-8c39-349ffda607d7 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:46.062441 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:11:46.294428 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-19d5af5a-6ac3-4ced-9499-8b0a6508e7c5 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daab4f69af5452c8641006d9f09edce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9672a6c416ee44289eaa4d7c664d307e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:11:46.305639 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-19d5af5a-6ac3-4ced-9499-8b0a6508e7c5 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "GET /compute/v2.1/servers/b13cd01f-fa9b-4d21-a1f9-4f7745dbbe37" status: 200 len: 1298 microversion: 2.1 time: 0.524158 Sep 14 09:11:46.306467 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2355/4727] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:11:45 2022] GET /compute/v2.1/servers/b13cd01f-fa9b-4d21-a1f9-4f7745dbbe37 => generated 1298 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:11:46.638272 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f76c4f4a-d735-431c-9bd0-90aaae1875a4 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:11:46.640274 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f76c4f4a-d735-431c-9bd0-90aaae1875a4 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:11:46.665785 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f76c4f4a-d735-431c-9bd0-90aaae1875a4 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:46.667159 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f76c4f4a-d735-431c-9bd0-90aaae1875a4 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:46.668716 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f76c4f4a-d735-431c-9bd0-90aaae1875a4 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:46.672188 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f76c4f4a-d735-431c-9bd0-90aaae1875a4 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:46.672693 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f76c4f4a-d735-431c-9bd0-90aaae1875a4 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:46.673136 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f76c4f4a-d735-431c-9bd0-90aaae1875a4 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:47.351467 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-7c0bbcf7-359a-4ea1-8c39-349ffda607d7 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:11:47.371885 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-7c0bbcf7-359a-4ea1-8c39-349ffda607d7 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105" status: 200 len: 1668 microversion: 2.1 time: 1.408145 Sep 14 09:11:47.377744 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2373/4728] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:11:45 2022] GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105 => generated 1668 bytes in 1415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:11:47.387039 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-fc3eede2-fd4e-4287-8943-9ebc98af7244 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:11:47.388542 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-fc3eede2-fd4e-4287-8943-9ebc98af7244 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [instance: b13cd01f-fa9b-4d21-a1f9-4f7745dbbe37] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:11:47.410910 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fc3eede2-fd4e-4287-8943-9ebc98af7244 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:47.411437 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fc3eede2-fd4e-4287-8943-9ebc98af7244 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:47.426043 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fc3eede2-fd4e-4287-8943-9ebc98af7244 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:47.426825 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fc3eede2-fd4e-4287-8943-9ebc98af7244 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:47.433049 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fc3eede2-fd4e-4287-8943-9ebc98af7244 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:47.433584 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fc3eede2-fd4e-4287-8943-9ebc98af7244 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:47.659932 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f76c4f4a-d735-431c-9bd0-90aaae1875a4 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:11:47.702766 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f76c4f4a-d735-431c-9bd0-90aaae1875a4 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:11:47.709488 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-fc3eede2-fd4e-4287-8943-9ebc98af7244 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daab4f69af5452c8641006d9f09edce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9672a6c416ee44289eaa4d7c664d307e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:11:47.712224 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f76c4f4a-d735-431c-9bd0-90aaae1875a4 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:11:47.718755 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f76c4f4a-d735-431c-9bd0-90aaae1875a4 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5" status: 200 len: 1751 microversion: 2.20 time: 1.084282 Sep 14 09:11:47.721113 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-fc3eede2-fd4e-4287-8943-9ebc98af7244 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "GET /compute/v2.1/servers/b13cd01f-fa9b-4d21-a1f9-4f7745dbbe37" status: 200 len: 1298 microversion: 2.1 time: 0.342028 Sep 14 09:11:47.729893 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2356/4729] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:11:46 2022] GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5 => generated 1751 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 09:11:47.743113 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2374/4730] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:11:47 2022] GET /compute/v2.1/servers/b13cd01f-fa9b-4d21-a1f9-4f7745dbbe37 => generated 1298 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:11:47.755069 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-62437cf6-f7e0-41e6-9c37-dae5ae49dfc8 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:11:47.756000 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-62437cf6-f7e0-41e6-9c37-dae5ae49dfc8 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:11:47.764351 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-62437cf6-f7e0-41e6-9c37-dae5ae49dfc8 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:47.765599 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-62437cf6-f7e0-41e6-9c37-dae5ae49dfc8 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:47.766244 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-62437cf6-f7e0-41e6-9c37-dae5ae49dfc8 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:47.767213 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-62437cf6-f7e0-41e6-9c37-dae5ae49dfc8 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:47.767910 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-62437cf6-f7e0-41e6-9c37-dae5ae49dfc8 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:47.768544 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-62437cf6-f7e0-41e6-9c37-dae5ae49dfc8 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:48.754850 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-70af717c-d983-4bd6-82bf-f2f3a62ab161 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:11:48.756158 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-70af717c-d983-4bd6-82bf-f2f3a62ab161 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [instance: b13cd01f-fa9b-4d21-a1f9-4f7745dbbe37] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:11:48.770645 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-70af717c-d983-4bd6-82bf-f2f3a62ab161 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:48.777779 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-70af717c-d983-4bd6-82bf-f2f3a62ab161 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:48.778408 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-70af717c-d983-4bd6-82bf-f2f3a62ab161 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:48.785061 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-70af717c-d983-4bd6-82bf-f2f3a62ab161 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:48.787209 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-70af717c-d983-4bd6-82bf-f2f3a62ab161 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:48.787718 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-70af717c-d983-4bd6-82bf-f2f3a62ab161 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:49.111889 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-62437cf6-f7e0-41e6-9c37-dae5ae49dfc8 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:11:49.130929 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-62437cf6-f7e0-41e6-9c37-dae5ae49dfc8 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105" status: 200 len: 1668 microversion: 2.1 time: 1.388206 Sep 14 09:11:49.133528 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2357/4731] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:11:47 2022] GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105 => generated 1668 bytes in 1403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:11:49.149292 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f5944631-7e3f-49ee-814a-c2a3fa49d72c tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:11:49.153636 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f5944631-7e3f-49ee-814a-c2a3fa49d72c tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:11:49.169336 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f5944631-7e3f-49ee-814a-c2a3fa49d72c tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:49.169855 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f5944631-7e3f-49ee-814a-c2a3fa49d72c tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:49.170311 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f5944631-7e3f-49ee-814a-c2a3fa49d72c tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:49.174758 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f5944631-7e3f-49ee-814a-c2a3fa49d72c tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:49.176974 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f5944631-7e3f-49ee-814a-c2a3fa49d72c tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:49.177509 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f5944631-7e3f-49ee-814a-c2a3fa49d72c tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:49.757008 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-70af717c-d983-4bd6-82bf-f2f3a62ab161 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daab4f69af5452c8641006d9f09edce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9672a6c416ee44289eaa4d7c664d307e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:11:49.776254 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-70af717c-d983-4bd6-82bf-f2f3a62ab161 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "GET /compute/v2.1/servers/b13cd01f-fa9b-4d21-a1f9-4f7745dbbe37" status: 200 len: 1366 microversion: 2.1 time: 1.025138 Sep 14 09:11:49.783285 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f5944631-7e3f-49ee-814a-c2a3fa49d72c tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:11:49.787544 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2375/4732] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:11:48 2022] GET /compute/v2.1/servers/b13cd01f-fa9b-4d21-a1f9-4f7745dbbe37 => generated 1366 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:11:49.807337 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f5944631-7e3f-49ee-814a-c2a3fa49d72c tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:11:49.814126 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-83896dfd-e46a-46ae-9b48-37689b52cb1f tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:11:49.815575 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-83896dfd-e46a-46ae-9b48-37689b52cb1f tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:11:49.817950 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f5944631-7e3f-49ee-814a-c2a3fa49d72c tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:11:49.822300 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f5944631-7e3f-49ee-814a-c2a3fa49d72c tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5" status: 200 len: 1751 microversion: 2.20 time: 0.686544 Sep 14 09:11:49.833135 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2358/4733] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:11:49 2022] GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5 => generated 1751 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:11:49.839182 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-83896dfd-e46a-46ae-9b48-37689b52cb1f tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:49.840029 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-83896dfd-e46a-46ae-9b48-37689b52cb1f tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:49.840659 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-83896dfd-e46a-46ae-9b48-37689b52cb1f tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:49.841549 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-83896dfd-e46a-46ae-9b48-37689b52cb1f tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:49.843496 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-83896dfd-e46a-46ae-9b48-37689b52cb1f tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:49.850989 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-83896dfd-e46a-46ae-9b48-37689b52cb1f tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:50.009878 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-83896dfd-e46a-46ae-9b48-37689b52cb1f tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Locking {{(pid=128758) lock /opt/stack/nova/nova/compute/api.py:4845}} Sep 14 09:11:50.159408 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-83896dfd-e46a-46ae-9b48-37689b52cb1f tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "POST /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105/action" status: 202 len: 0 microversion: 2.1 time: 0.365356 Sep 14 09:11:50.160063 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2376/4734] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:11:49 2022] POST /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105/action => generated 0 bytes in 367 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:11:50.168776 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f3a5bc87-15f8-4f33-bbd7-673ef2e85b33 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:11:50.169531 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f3a5bc87-15f8-4f33-bbd7-673ef2e85b33 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:11:50.183832 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f3a5bc87-15f8-4f33-bbd7-673ef2e85b33 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:50.187079 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f3a5bc87-15f8-4f33-bbd7-673ef2e85b33 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:50.189475 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f3a5bc87-15f8-4f33-bbd7-673ef2e85b33 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:50.191317 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f3a5bc87-15f8-4f33-bbd7-673ef2e85b33 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:50.199131 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f3a5bc87-15f8-4f33-bbd7-673ef2e85b33 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:50.201324 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f3a5bc87-15f8-4f33-bbd7-673ef2e85b33 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:50.803615 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-6cf5e96b-7a6e-4c79-94a9-3f939a170076 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:11:50.804323 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-6cf5e96b-7a6e-4c79-94a9-3f939a170076 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [instance: b13cd01f-fa9b-4d21-a1f9-4f7745dbbe37] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:11:50.814782 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6cf5e96b-7a6e-4c79-94a9-3f939a170076 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:50.815360 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6cf5e96b-7a6e-4c79-94a9-3f939a170076 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:50.815808 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6cf5e96b-7a6e-4c79-94a9-3f939a170076 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:50.823361 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6cf5e96b-7a6e-4c79-94a9-3f939a170076 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:50.825799 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6cf5e96b-7a6e-4c79-94a9-3f939a170076 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:50.828339 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6cf5e96b-7a6e-4c79-94a9-3f939a170076 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:50.941119 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f3a5bc87-15f8-4f33-bbd7-673ef2e85b33 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:11:50.954514 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f3a5bc87-15f8-4f33-bbd7-673ef2e85b33 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105" status: 200 len: 1668 microversion: 2.1 time: 0.789238 Sep 14 09:11:50.956131 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2359/4735] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:11:50 2022] GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105 => generated 1668 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:11:50.981970 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-4871bbdf-c50e-4325-add7-c2af1a093bc1 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:11:50.983094 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-4871bbdf-c50e-4325-add7-c2af1a093bc1 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:11:50.991499 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4871bbdf-c50e-4325-add7-c2af1a093bc1 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:50.992333 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4871bbdf-c50e-4325-add7-c2af1a093bc1 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:50.992970 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4871bbdf-c50e-4325-add7-c2af1a093bc1 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:50.994746 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4871bbdf-c50e-4325-add7-c2af1a093bc1 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:50.995570 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4871bbdf-c50e-4325-add7-c2af1a093bc1 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:50.996436 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4871bbdf-c50e-4325-add7-c2af1a093bc1 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:51.405790 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=2 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:11:51.434831 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=6 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:11:51.712276 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-6cf5e96b-7a6e-4c79-94a9-3f939a170076 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daab4f69af5452c8641006d9f09edce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9672a6c416ee44289eaa4d7c664d307e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:11:51.728960 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-6cf5e96b-7a6e-4c79-94a9-3f939a170076 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "GET /compute/v2.1/servers/b13cd01f-fa9b-4d21-a1f9-4f7745dbbe37" status: 200 len: 1366 microversion: 2.1 time: 0.929366 Sep 14 09:11:51.729514 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2377/4736] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:11:50 2022] GET /compute/v2.1/servers/b13cd01f-fa9b-4d21-a1f9-4f7745dbbe37 => generated 1366 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:11:51.747087 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-0a795ac4-a168-4dd9-aeb5-c00dffa965a4 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:11:51.767461 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=2 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:11:51.771195 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0a795ac4-a168-4dd9-aeb5-c00dffa965a4 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:51.771705 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0a795ac4-a168-4dd9-aeb5-c00dffa965a4 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:51.772153 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0a795ac4-a168-4dd9-aeb5-c00dffa965a4 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:51.848863 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-0a795ac4-a168-4dd9-aeb5-c00dffa965a4 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] HTTP exception thrown: Instance 8450d385-d5d9-4c86-9ece-b3bbf9ed1105 is locked Sep 14 09:11:51.856011 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-0a795ac4-a168-4dd9-aeb5-c00dffa965a4 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Request method failure captured: Sep 14 09:11:51.856011 n-d-836830-18 devstack@n-api.service[128758]: request: POST /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105/action HTTP/1.1 Sep 14 09:11:51.856011 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 09:11:51.856011 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 09:11:51.856011 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 09:11:51.856011 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 15 Sep 14 09:11:51.856011 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 09:11:51.856011 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 09:11:51.856011 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 09:11:51.856011 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 09:11:51.856011 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZlbli-DUCcgcnIp82pgLH1MeZCUcHfkT5yyfUsmiHSxBD3c429y8-wgStj1whz8DzX2TZgyd3HgxP1s3YxgJlQF250cUgsVCoic4jlEyGeyIt_z0tJbq-ZVXxXpuOTFUrJr1sEtIyXnC0IrYNMyG6UkTPf7SAAui15bmxZyXWBXgjc Sep 14 09:11:51.856011 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 09:11:51.856011 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 09:11:51.856011 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 09:11:51.856011 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 09:11:51.856011 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 09:11:51.856011 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 09:11:51.856011 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 2f075a2c6aa4489abb3428e0a4ac5738 Sep 14 09:11:51.856011 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-ServerActionsTestJSON-1840244566 Sep 14 09:11:51.856011 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 09:11:51.856011 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 09:11:51.856011 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/2f075a2c6aa4489abb3428e0a4ac5738"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_2f075a2c6aa4489abb3428e0a4ac5738"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2f075a2c6aa4489abb3428e0a4ac5738"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2f075a2c6aa4489abb3428e0a4ac5738"}]}] Sep 14 09:11:51.856011 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-ServerActionsTestJSON-1840244566 Sep 14 09:11:51.856011 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 2f075a2c6aa4489abb3428e0a4ac5738 Sep 14 09:11:51.856011 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-ServerActionsTestJSON-1840244566 Sep 14 09:11:51.856011 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-ServerActionsTestJSON-1840244566-project Sep 14 09:11:51.856011 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 09:11:51.856011 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 09:11:51.856011 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 950da33830ae4ae1a5511dd146e4e3be Sep 14 09:11:51.856011 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-ServerActionsTestJSON-1840244566-project Sep 14 09:11:51.856011 n-d-836830-18 devstack@n-api.service[128758]: Sep 14 09:11:51.856011 n-d-836830-18 devstack@n-api.service[128758]: {"os-stop": {}} Sep 14 09:11:51.856011 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 09:11:51.856011 n-d-836830-18 devstack@n-api.service[128758]: exception: Instance 8450d385-d5d9-4c86-9ece-b3bbf9ed1105 is locked Sep 14 09:11:51.856011 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': '8450d385-d5d9-4c86-9ece-b3bbf9ed1105', 'body': {'os-stop': {}}} Sep 14 09:11:51.856011 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:11:51.856011 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:11:51.856011 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1449, in _stop_server Sep 14 09:11:51.856011 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Sep 14 09:11:51.856011 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 240, in inner Sep 14 09:11:51.856011 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Sep 14 09:11:51.856011 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance 8450d385-d5d9-4c86-9ece-b3bbf9ed1105 is locked Sep 14 09:11:51.856011 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:11:51.856011 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:11:51.856011 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:11:51.856011 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:11:51.856011 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:11:51.856011 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:11:51.856011 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:11:51.856011 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:11:51.856011 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:11:51.856011 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:11:51.856011 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1451, in _stop_server Sep 14 09:11:51.856011 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Sep 14 09:11:51.856011 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance 8450d385-d5d9-4c86-9ece-b3bbf9ed1105 is locked Sep 14 09:11:51.856011 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:11:51.856011 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:11:51.856011 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:11:51.856011 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:11:51.856011 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:11:51.856011 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:11:51.856011 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:11:51.856011 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:11:51.856011 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8450d385-d5d9-4c86-9ece-b3bbf9ed1105 is locked Sep 14 09:11:51.856011 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:11:51.861811 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-0a795ac4-a168-4dd9-aeb5-c00dffa965a4 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Returning 409 to user: Instance 8450d385-d5d9-4c86-9ece-b3bbf9ed1105 is locked {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:11:51.861811 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-0a795ac4-a168-4dd9-aeb5-c00dffa965a4 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "POST /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105/action" status: 409 len: 107 microversion: 2.1 time: 0.126930 Sep 14 09:11:51.863773 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2378/4737] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:11:51 2022] POST /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105/action => generated 107 bytes in 133 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 14 09:11:51.872602 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-68d0affd-8159-47b4-9b3a-cf11694094ca tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:11:51.877344 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-68d0affd-8159-47b4-9b3a-cf11694094ca tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:11:51.887751 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-68d0affd-8159-47b4-9b3a-cf11694094ca tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:51.888257 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-68d0affd-8159-47b4-9b3a-cf11694094ca tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:51.893220 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-68d0affd-8159-47b4-9b3a-cf11694094ca tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:51.894124 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-68d0affd-8159-47b4-9b3a-cf11694094ca tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:51.894617 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-68d0affd-8159-47b4-9b3a-cf11694094ca tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:51.895149 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-68d0affd-8159-47b4-9b3a-cf11694094ca tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:51.958456 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-68d0affd-8159-47b4-9b3a-cf11694094ca tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Unlocking {{(pid=128758) unlock /opt/stack/nova/nova/compute/api.py:4874}} Sep 14 09:11:52.048353 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-4871bbdf-c50e-4325-add7-c2af1a093bc1 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:11:52.070173 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-4871bbdf-c50e-4325-add7-c2af1a093bc1 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:11:52.079699 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-4871bbdf-c50e-4325-add7-c2af1a093bc1 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:11:52.083132 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-4871bbdf-c50e-4325-add7-c2af1a093bc1 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5" status: 200 len: 1751 microversion: 2.20 time: 1.125182 Sep 14 09:11:52.083734 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2360/4738] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:11:50 2022] GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5 => generated 1751 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:11:52.097518 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-68d0affd-8159-47b4-9b3a-cf11694094ca tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "POST /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105/action" status: 202 len: 0 microversion: 2.1 time: 0.233115 Sep 14 09:11:52.103338 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2379/4739] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:11:51 2022] POST /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105/action => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:11:52.108980 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-902d33ea-83c6-4dc1-9de4-4397e17a0a7d tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:11:52.123216 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-902d33ea-83c6-4dc1-9de4-4397e17a0a7d tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:52.124519 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-902d33ea-83c6-4dc1-9de4-4397e17a0a7d tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:52.127422 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-902d33ea-83c6-4dc1-9de4-4397e17a0a7d tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:52.185641 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-902d33ea-83c6-4dc1-9de4-4397e17a0a7d tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Going to try to stop instance {{(pid=128759) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 14 09:11:52.305125 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-902d33ea-83c6-4dc1-9de4-4397e17a0a7d tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "POST /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105/action" status: 202 len: 0 microversion: 2.1 time: 0.199286 Sep 14 09:11:52.316727 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c56f26c1-cc5b-447e-8a68-79a7c713c637 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:11:52.317570 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-c56f26c1-cc5b-447e-8a68-79a7c713c637 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:11:52.325306 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2361/4740] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:11:52 2022] POST /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105/action => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 14 09:11:52.331105 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c56f26c1-cc5b-447e-8a68-79a7c713c637 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:52.331620 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c56f26c1-cc5b-447e-8a68-79a7c713c637 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:52.335793 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c56f26c1-cc5b-447e-8a68-79a7c713c637 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:52.338232 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c56f26c1-cc5b-447e-8a68-79a7c713c637 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:52.338745 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c56f26c1-cc5b-447e-8a68-79a7c713c637 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:52.341272 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c56f26c1-cc5b-447e-8a68-79a7c713c637 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:52.589095 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-a786ff12-9399-42aa-bca8-3ce60d9a9d10 req-6fa99535-e93e-4a2a-9b67-f96a2762cee8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b13cd01f-fa9b-4d21-a1f9-4f7745dbbe37", "tag": "1a63584e-aab3-4542-b006-dd4f1e9c014b"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:11:52.609781 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-a786ff12-9399-42aa-bca8-3ce60d9a9d10 req-6fa99535-e93e-4a2a-9b67-f96a2762cee8 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:52.613788 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-a786ff12-9399-42aa-bca8-3ce60d9a9d10 req-6fa99535-e93e-4a2a-9b67-f96a2762cee8 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:52.616267 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-a786ff12-9399-42aa-bca8-3ce60d9a9d10 req-6fa99535-e93e-4a2a-9b67-f96a2762cee8 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:52.650466 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-a786ff12-9399-42aa-bca8-3ce60d9a9d10 req-6fa99535-e93e-4a2a-9b67-f96a2762cee8 service nova] Creating event network-changed:1a63584e-aab3-4542-b006-dd4f1e9c014b for instance b13cd01f-fa9b-4d21-a1f9-4f7745dbbe37 on n-h2-836830-18 Sep 14 09:11:52.665941 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-a786ff12-9399-42aa-bca8-3ce60d9a9d10 req-6fa99535-e93e-4a2a-9b67-f96a2762cee8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081434 Sep 14 09:11:52.666889 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2362/4741] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:11:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:11:52.762067 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-1d688394-6fb3-4db7-a77c-18d2b2bc5990 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:11:52.763209 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-1d688394-6fb3-4db7-a77c-18d2b2bc5990 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [instance: b13cd01f-fa9b-4d21-a1f9-4f7745dbbe37] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:11:52.777114 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1d688394-6fb3-4db7-a77c-18d2b2bc5990 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:52.779148 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1d688394-6fb3-4db7-a77c-18d2b2bc5990 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:52.779852 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1d688394-6fb3-4db7-a77c-18d2b2bc5990 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:52.783225 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1d688394-6fb3-4db7-a77c-18d2b2bc5990 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:52.784052 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1d688394-6fb3-4db7-a77c-18d2b2bc5990 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:52.784751 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1d688394-6fb3-4db7-a77c-18d2b2bc5990 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:53.257350 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-c56f26c1-cc5b-447e-8a68-79a7c713c637 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:11:53.278674 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-c56f26c1-cc5b-447e-8a68-79a7c713c637 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105" status: 200 len: 1678 microversion: 2.1 time: 0.965994 Sep 14 09:11:53.279657 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2380/4742] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:11:52 2022] GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105 => generated 1678 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:11:53.311310 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1ebbb819-279e-4bae-a45f-fb7f4e3eb597 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:11:53.312621 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-1ebbb819-279e-4bae-a45f-fb7f4e3eb597 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:11:53.324334 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1ebbb819-279e-4bae-a45f-fb7f4e3eb597 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:53.324845 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1ebbb819-279e-4bae-a45f-fb7f4e3eb597 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:53.325488 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1ebbb819-279e-4bae-a45f-fb7f4e3eb597 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:53.326515 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1ebbb819-279e-4bae-a45f-fb7f4e3eb597 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:53.328595 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1ebbb819-279e-4bae-a45f-fb7f4e3eb597 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:53.334056 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1ebbb819-279e-4bae-a45f-fb7f4e3eb597 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:53.605014 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-1d688394-6fb3-4db7-a77c-18d2b2bc5990 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daab4f69af5452c8641006d9f09edce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9672a6c416ee44289eaa4d7c664d307e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:11:53.620528 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-1d688394-6fb3-4db7-a77c-18d2b2bc5990 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "GET /compute/v2.1/servers/b13cd01f-fa9b-4d21-a1f9-4f7745dbbe37" status: 200 len: 1366 microversion: 2.1 time: 0.863067 Sep 14 09:11:53.621708 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2363/4743] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:11:52 2022] GET /compute/v2.1/servers/b13cd01f-fa9b-4d21-a1f9-4f7745dbbe37 => generated 1366 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:11:54.025470 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-1ebbb819-279e-4bae-a45f-fb7f4e3eb597 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:11:54.045198 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-1ebbb819-279e-4bae-a45f-fb7f4e3eb597 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:11:54.048029 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-1ebbb819-279e-4bae-a45f-fb7f4e3eb597 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:11:54.049541 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-1ebbb819-279e-4bae-a45f-fb7f4e3eb597 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5" status: 200 len: 1751 microversion: 2.20 time: 0.758969 Sep 14 09:11:54.050818 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2381/4744] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:11:53 2022] GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5 => generated 1751 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:11:54.313067 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-42f654d6-5a07-42ce-a047-4e1004823717 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:11:54.313972 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-42f654d6-5a07-42ce-a047-4e1004823717 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:11:54.339630 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-42f654d6-5a07-42ce-a047-4e1004823717 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:54.359046 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-42f654d6-5a07-42ce-a047-4e1004823717 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:54.363118 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-42f654d6-5a07-42ce-a047-4e1004823717 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:54.364237 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-42f654d6-5a07-42ce-a047-4e1004823717 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:54.364916 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-42f654d6-5a07-42ce-a047-4e1004823717 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:54.365539 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-42f654d6-5a07-42ce-a047-4e1004823717 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:54.648907 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-23100057-d887-4221-acd7-bca73f3aa137 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:11:54.650108 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-23100057-d887-4221-acd7-bca73f3aa137 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [instance: b13cd01f-fa9b-4d21-a1f9-4f7745dbbe37] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:11:54.676903 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-23100057-d887-4221-acd7-bca73f3aa137 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:54.677406 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-23100057-d887-4221-acd7-bca73f3aa137 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:54.677845 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-23100057-d887-4221-acd7-bca73f3aa137 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:54.678562 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-23100057-d887-4221-acd7-bca73f3aa137 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:54.679041 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-23100057-d887-4221-acd7-bca73f3aa137 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:54.679465 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-23100057-d887-4221-acd7-bca73f3aa137 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:54.997286 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-42f654d6-5a07-42ce-a047-4e1004823717 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:11:55.013376 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-42f654d6-5a07-42ce-a047-4e1004823717 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105" status: 200 len: 1678 microversion: 2.1 time: 0.702979 Sep 14 09:11:55.042775 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2364/4745] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:11:54 2022] GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105 => generated 1678 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:11:55.071772 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-23100057-d887-4221-acd7-bca73f3aa137 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daab4f69af5452c8641006d9f09edce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9672a6c416ee44289eaa4d7c664d307e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:11:55.081339 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-34a5511a-ec9f-41b6-8050-30d83becc998 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:11:55.082355 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-34a5511a-ec9f-41b6-8050-30d83becc998 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:11:55.083083 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-23100057-d887-4221-acd7-bca73f3aa137 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "GET /compute/v2.1/servers/b13cd01f-fa9b-4d21-a1f9-4f7745dbbe37" status: 200 len: 1366 microversion: 2.1 time: 0.438839 Sep 14 09:11:55.083926 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2382/4746] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:11:54 2022] GET /compute/v2.1/servers/b13cd01f-fa9b-4d21-a1f9-4f7745dbbe37 => generated 1366 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:11:55.093648 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-34a5511a-ec9f-41b6-8050-30d83becc998 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:55.096571 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-34a5511a-ec9f-41b6-8050-30d83becc998 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:55.097035 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-34a5511a-ec9f-41b6-8050-30d83becc998 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:55.097881 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-34a5511a-ec9f-41b6-8050-30d83becc998 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:55.099727 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-34a5511a-ec9f-41b6-8050-30d83becc998 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:55.103094 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-34a5511a-ec9f-41b6-8050-30d83becc998 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:55.111637 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:11:55.390556 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-34a5511a-ec9f-41b6-8050-30d83becc998 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:11:55.405836 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-34a5511a-ec9f-41b6-8050-30d83becc998 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:11:55.407870 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-34a5511a-ec9f-41b6-8050-30d83becc998 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:11:55.409501 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-34a5511a-ec9f-41b6-8050-30d83becc998 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5" status: 200 len: 1751 microversion: 2.20 time: 0.333759 Sep 14 09:11:55.431185 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2365/4747] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:11:55 2022] GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5 => generated 1751 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 09:11:56.053765 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-921bfa4f-62bf-4790-a744-52c05551d2b2 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:11:56.056311 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-921bfa4f-62bf-4790-a744-52c05551d2b2 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:11:56.072895 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-921bfa4f-62bf-4790-a744-52c05551d2b2 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:56.080862 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-921bfa4f-62bf-4790-a744-52c05551d2b2 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:56.081605 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-921bfa4f-62bf-4790-a744-52c05551d2b2 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:56.083294 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-921bfa4f-62bf-4790-a744-52c05551d2b2 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:56.084024 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-921bfa4f-62bf-4790-a744-52c05551d2b2 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:56.084681 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-921bfa4f-62bf-4790-a744-52c05551d2b2 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:56.112626 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-28097e69-43b4-42e6-ac18-4f803eda1ed2 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:11:56.113367 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-28097e69-43b4-42e6-ac18-4f803eda1ed2 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [instance: b13cd01f-fa9b-4d21-a1f9-4f7745dbbe37] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:11:56.127466 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-28097e69-43b4-42e6-ac18-4f803eda1ed2 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:56.130989 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-28097e69-43b4-42e6-ac18-4f803eda1ed2 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:56.131686 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-28097e69-43b4-42e6-ac18-4f803eda1ed2 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:56.136790 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-28097e69-43b4-42e6-ac18-4f803eda1ed2 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:56.137797 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-28097e69-43b4-42e6-ac18-4f803eda1ed2 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:56.142217 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-28097e69-43b4-42e6-ac18-4f803eda1ed2 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:57.388236 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-28097e69-43b4-42e6-ac18-4f803eda1ed2 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daab4f69af5452c8641006d9f09edce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9672a6c416ee44289eaa4d7c664d307e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:11:57.415213 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-28097e69-43b4-42e6-ac18-4f803eda1ed2 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "GET /compute/v2.1/servers/b13cd01f-fa9b-4d21-a1f9-4f7745dbbe37" status: 200 len: 1366 microversion: 2.1 time: 1.307209 Sep 14 09:11:57.427653 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2366/4748] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:11:56 2022] GET /compute/v2.1/servers/b13cd01f-fa9b-4d21-a1f9-4f7745dbbe37 => generated 1366 bytes in 1320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:11:57.439845 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8b3fca6e-6b26-4944-aa74-8e9350926bef tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:11:57.442726 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-8b3fca6e-6b26-4944-aa74-8e9350926bef tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:11:57.459504 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8b3fca6e-6b26-4944-aa74-8e9350926bef tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:57.460235 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8b3fca6e-6b26-4944-aa74-8e9350926bef tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:57.462864 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8b3fca6e-6b26-4944-aa74-8e9350926bef tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:57.463680 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8b3fca6e-6b26-4944-aa74-8e9350926bef tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:57.464247 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8b3fca6e-6b26-4944-aa74-8e9350926bef tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:57.464745 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8b3fca6e-6b26-4944-aa74-8e9350926bef tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:57.726719 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-921bfa4f-62bf-4790-a744-52c05551d2b2 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:11:57.738426 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-921bfa4f-62bf-4790-a744-52c05551d2b2 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105" status: 200 len: 1678 microversion: 2.1 time: 1.693620 Sep 14 09:11:57.745527 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2383/4749] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:11:56 2022] GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105 => generated 1678 bytes in 1702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:11:57.859724 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-8b3fca6e-6b26-4944-aa74-8e9350926bef tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:11:57.872728 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-8b3fca6e-6b26-4944-aa74-8e9350926bef tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:11:57.874482 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-8b3fca6e-6b26-4944-aa74-8e9350926bef tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:11:57.878779 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-8b3fca6e-6b26-4944-aa74-8e9350926bef tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5" status: 200 len: 1807 microversion: 2.20 time: 0.446936 Sep 14 09:11:57.900695 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2367/4750] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:11:57 2022] GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5 => generated 1807 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:11:58.444854 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-716d89b2-2772-4392-9d6a-cbee7c6e7324 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:11:58.445488 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-716d89b2-2772-4392-9d6a-cbee7c6e7324 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [instance: b13cd01f-fa9b-4d21-a1f9-4f7745dbbe37] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:11:58.458093 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-716d89b2-2772-4392-9d6a-cbee7c6e7324 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:58.458596 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-716d89b2-2772-4392-9d6a-cbee7c6e7324 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:58.459066 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-716d89b2-2772-4392-9d6a-cbee7c6e7324 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:58.459775 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-716d89b2-2772-4392-9d6a-cbee7c6e7324 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:58.461623 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-716d89b2-2772-4392-9d6a-cbee7c6e7324 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:58.463478 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-716d89b2-2772-4392-9d6a-cbee7c6e7324 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:58.740549 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-716d89b2-2772-4392-9d6a-cbee7c6e7324 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daab4f69af5452c8641006d9f09edce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9672a6c416ee44289eaa4d7c664d307e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:11:58.765533 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-716d89b2-2772-4392-9d6a-cbee7c6e7324 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "GET /compute/v2.1/servers/b13cd01f-fa9b-4d21-a1f9-4f7745dbbe37" status: 200 len: 1366 microversion: 2.1 time: 0.325533 Sep 14 09:11:58.771825 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ea70bcd6-de13-4003-bd13-9f4c2b22ce8e tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:11:58.773574 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-ea70bcd6-de13-4003-bd13-9f4c2b22ce8e tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:11:58.779398 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2384/4751] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:11:58 2022] GET /compute/v2.1/servers/b13cd01f-fa9b-4d21-a1f9-4f7745dbbe37 => generated 1366 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:11:58.785536 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ea70bcd6-de13-4003-bd13-9f4c2b22ce8e tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:58.788260 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ea70bcd6-de13-4003-bd13-9f4c2b22ce8e tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:58.790397 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ea70bcd6-de13-4003-bd13-9f4c2b22ce8e tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:58.791908 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ea70bcd6-de13-4003-bd13-9f4c2b22ce8e tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:58.792628 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ea70bcd6-de13-4003-bd13-9f4c2b22ce8e tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:58.793426 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ea70bcd6-de13-4003-bd13-9f4c2b22ce8e tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:58.909643 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-3b1072b4-14d5-4b15-8a97-8138baaa2c87 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:11:58.910649 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-3b1072b4-14d5-4b15-8a97-8138baaa2c87 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:11:58.918642 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3b1072b4-14d5-4b15-8a97-8138baaa2c87 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:58.919857 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3b1072b4-14d5-4b15-8a97-8138baaa2c87 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:58.920707 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3b1072b4-14d5-4b15-8a97-8138baaa2c87 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:58.922091 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3b1072b4-14d5-4b15-8a97-8138baaa2c87 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:58.922827 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3b1072b4-14d5-4b15-8a97-8138baaa2c87 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:58.923687 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3b1072b4-14d5-4b15-8a97-8138baaa2c87 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:58.954848 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=88,nova_cell1:INSERT=4,nova_cell1:UPDATE=8 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:11:59.308541 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-ea70bcd6-de13-4003-bd13-9f4c2b22ce8e tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:11:59.313308 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-3b1072b4-14d5-4b15-8a97-8138baaa2c87 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:11:59.319888 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-ea70bcd6-de13-4003-bd13-9f4c2b22ce8e tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105" status: 200 len: 1678 microversion: 2.1 time: 0.554008 Sep 14 09:11:59.320539 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2368/4752] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:11:58 2022] GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105 => generated 1678 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:11:59.329189 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-3b1072b4-14d5-4b15-8a97-8138baaa2c87 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:11:59.331422 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-3b1072b4-14d5-4b15-8a97-8138baaa2c87 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:11:59.336500 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-3b1072b4-14d5-4b15-8a97-8138baaa2c87 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5" status: 200 len: 1807 microversion: 2.20 time: 0.432448 Sep 14 09:11:59.340282 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2385/4753] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:11:58 2022] GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5 => generated 1807 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:11:59.564023 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-40f83e2c-b79f-4756-98c9-f276b3c12ad3 req-dfa2b3c6-27e8-422c-b352-a00bc07641e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b13cd01f-fa9b-4d21-a1f9-4f7745dbbe37", "name": "network-vif-plugged", "status": "completed", "tag": "1a63584e-aab3-4542-b006-dd4f1e9c014b"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:11:59.598596 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-40f83e2c-b79f-4756-98c9-f276b3c12ad3 req-dfa2b3c6-27e8-422c-b352-a00bc07641e2 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:59.599231 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-40f83e2c-b79f-4756-98c9-f276b3c12ad3 req-dfa2b3c6-27e8-422c-b352-a00bc07641e2 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:59.599680 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-40f83e2c-b79f-4756-98c9-f276b3c12ad3 req-dfa2b3c6-27e8-422c-b352-a00bc07641e2 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:59.678875 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-40f83e2c-b79f-4756-98c9-f276b3c12ad3 req-dfa2b3c6-27e8-422c-b352-a00bc07641e2 service nova] Creating event network-vif-plugged:1a63584e-aab3-4542-b006-dd4f1e9c014b for instance b13cd01f-fa9b-4d21-a1f9-4f7745dbbe37 on n-h2-836830-18 Sep 14 09:11:59.696581 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-40f83e2c-b79f-4756-98c9-f276b3c12ad3 req-dfa2b3c6-27e8-422c-b352-a00bc07641e2 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144196 Sep 14 09:11:59.700038 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2369/4754] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:11:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:11:59.803233 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-73fd8412-d426-4a2d-8dce-c366f498a2a7 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:11:59.804308 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-73fd8412-d426-4a2d-8dce-c366f498a2a7 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [instance: b13cd01f-fa9b-4d21-a1f9-4f7745dbbe37] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:11:59.819955 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-73fd8412-d426-4a2d-8dce-c366f498a2a7 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:59.821029 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-73fd8412-d426-4a2d-8dce-c366f498a2a7 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:59.826469 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-73fd8412-d426-4a2d-8dce-c366f498a2a7 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:11:59.830563 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-73fd8412-d426-4a2d-8dce-c366f498a2a7 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:11:59.831857 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-73fd8412-d426-4a2d-8dce-c366f498a2a7 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:11:59.833702 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-73fd8412-d426-4a2d-8dce-c366f498a2a7 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:00.351348 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-80f49150-789e-4dbb-bb8a-15eb76eb584f tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:12:00.352076 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-80f49150-789e-4dbb-bb8a-15eb76eb584f tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:12:00.377496 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-80f49150-789e-4dbb-bb8a-15eb76eb584f tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:00.378291 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-80f49150-789e-4dbb-bb8a-15eb76eb584f tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:00.380564 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-80f49150-789e-4dbb-bb8a-15eb76eb584f tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:00.384374 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-80f49150-789e-4dbb-bb8a-15eb76eb584f tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:00.387561 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-80f49150-789e-4dbb-bb8a-15eb76eb584f tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:00.389435 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-80f49150-789e-4dbb-bb8a-15eb76eb584f tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:00.504843 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-73fd8412-d426-4a2d-8dce-c366f498a2a7 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daab4f69af5452c8641006d9f09edce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9672a6c416ee44289eaa4d7c664d307e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:12:00.520211 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-73fd8412-d426-4a2d-8dce-c366f498a2a7 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "GET /compute/v2.1/servers/b13cd01f-fa9b-4d21-a1f9-4f7745dbbe37" status: 200 len: 1366 microversion: 2.1 time: 0.721187 Sep 14 09:12:00.520814 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2386/4755] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:11:59 2022] GET /compute/v2.1/servers/b13cd01f-fa9b-4d21-a1f9-4f7745dbbe37 => generated 1366 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:12:00.539835 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-3ed1d96a-6340-4a2a-a179-c6b27cbbd04d tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:12:00.540498 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-3ed1d96a-6340-4a2a-a179-c6b27cbbd04d tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:12:00.558132 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3ed1d96a-6340-4a2a-a179-c6b27cbbd04d tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:00.559083 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3ed1d96a-6340-4a2a-a179-c6b27cbbd04d tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:00.563404 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3ed1d96a-6340-4a2a-a179-c6b27cbbd04d tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:00.570878 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3ed1d96a-6340-4a2a-a179-c6b27cbbd04d tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:00.571901 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3ed1d96a-6340-4a2a-a179-c6b27cbbd04d tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:00.572769 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3ed1d96a-6340-4a2a-a179-c6b27cbbd04d tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:01.392549 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-3ed1d96a-6340-4a2a-a179-c6b27cbbd04d tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:12:01.402906 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-3ed1d96a-6340-4a2a-a179-c6b27cbbd04d tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:12:01.417872 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-3ed1d96a-6340-4a2a-a179-c6b27cbbd04d tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:12:01.423322 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-3ed1d96a-6340-4a2a-a179-c6b27cbbd04d tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5" status: 200 len: 1807 microversion: 2.20 time: 0.899486 Sep 14 09:12:01.425105 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2387/4756] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:12:00 2022] GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5 => generated 1807 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:12:01.443273 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-80f49150-789e-4dbb-bb8a-15eb76eb584f tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:12:01.459884 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-80f49150-789e-4dbb-bb8a-15eb76eb584f tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105" status: 200 len: 1678 microversion: 2.1 time: 1.114474 Sep 14 09:12:01.463828 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2370/4757] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:12:00 2022] GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105 => generated 1678 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:12:01.551297 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-de0a5d6d-9b83-4bbe-b102-576f8e1d963d tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:12:01.552246 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-de0a5d6d-9b83-4bbe-b102-576f8e1d963d tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [instance: b13cd01f-fa9b-4d21-a1f9-4f7745dbbe37] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:12:01.590203 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-de0a5d6d-9b83-4bbe-b102-576f8e1d963d tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:01.590705 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-de0a5d6d-9b83-4bbe-b102-576f8e1d963d tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:01.591184 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-de0a5d6d-9b83-4bbe-b102-576f8e1d963d tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:01.591901 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-de0a5d6d-9b83-4bbe-b102-576f8e1d963d tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:01.592391 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-de0a5d6d-9b83-4bbe-b102-576f8e1d963d tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:01.592824 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-de0a5d6d-9b83-4bbe-b102-576f8e1d963d tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:02.222857 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-de0a5d6d-9b83-4bbe-b102-576f8e1d963d tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daab4f69af5452c8641006d9f09edce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9672a6c416ee44289eaa4d7c664d307e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:12:02.232821 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-de0a5d6d-9b83-4bbe-b102-576f8e1d963d tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "GET /compute/v2.1/servers/b13cd01f-fa9b-4d21-a1f9-4f7745dbbe37" status: 200 len: 1366 microversion: 2.1 time: 0.690113 Sep 14 09:12:02.233514 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2388/4758] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:12:01 2022] GET /compute/v2.1/servers/b13cd01f-fa9b-4d21-a1f9-4f7745dbbe37 => generated 1366 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:12:02.459473 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ce77a441-d10e-42f6-bb24-14d75d7e394e tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:12:02.461880 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-ce77a441-d10e-42f6-bb24-14d75d7e394e tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:12:02.475567 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ce77a441-d10e-42f6-bb24-14d75d7e394e tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:02.476564 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ce77a441-d10e-42f6-bb24-14d75d7e394e tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:02.480928 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ce77a441-d10e-42f6-bb24-14d75d7e394e tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:02.482351 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ce77a441-d10e-42f6-bb24-14d75d7e394e tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:02.483387 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ce77a441-d10e-42f6-bb24-14d75d7e394e tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:02.484800 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ce77a441-d10e-42f6-bb24-14d75d7e394e tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:02.491679 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-413d4808-937d-4097-80d5-e116e4450e67 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:12:02.493143 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-413d4808-937d-4097-80d5-e116e4450e67 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:12:02.500669 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-413d4808-937d-4097-80d5-e116e4450e67 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:02.501447 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-413d4808-937d-4097-80d5-e116e4450e67 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:02.503169 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-413d4808-937d-4097-80d5-e116e4450e67 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:02.506796 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-413d4808-937d-4097-80d5-e116e4450e67 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:02.507499 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-413d4808-937d-4097-80d5-e116e4450e67 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:02.508105 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-413d4808-937d-4097-80d5-e116e4450e67 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:02.944585 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-413d4808-937d-4097-80d5-e116e4450e67 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:12:02.959206 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-413d4808-937d-4097-80d5-e116e4450e67 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105" status: 200 len: 1678 microversion: 2.1 time: 0.471006 Sep 14 09:12:02.962635 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2389/4759] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:12:02 2022] GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105 => generated 1678 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:12:03.260115 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-25502e27-f1c7-44b9-9540-952d371b4e72 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:12:03.260936 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-25502e27-f1c7-44b9-9540-952d371b4e72 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [instance: b13cd01f-fa9b-4d21-a1f9-4f7745dbbe37] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:12:03.291960 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-25502e27-f1c7-44b9-9540-952d371b4e72 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:03.292481 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-25502e27-f1c7-44b9-9540-952d371b4e72 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:03.292932 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-25502e27-f1c7-44b9-9540-952d371b4e72 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:03.293838 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-25502e27-f1c7-44b9-9540-952d371b4e72 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:03.299138 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-25502e27-f1c7-44b9-9540-952d371b4e72 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:03.299824 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-25502e27-f1c7-44b9-9540-952d371b4e72 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:03.590153 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-ce77a441-d10e-42f6-bb24-14d75d7e394e tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:12:03.611485 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-ce77a441-d10e-42f6-bb24-14d75d7e394e tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:12:03.623597 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-ce77a441-d10e-42f6-bb24-14d75d7e394e tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:12:03.625613 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-ce77a441-d10e-42f6-bb24-14d75d7e394e tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5" status: 200 len: 1807 microversion: 2.20 time: 1.171263 Sep 14 09:12:03.626527 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2371/4760] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:12:02 2022] GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5 => generated 1807 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 09:12:03.757822 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-25502e27-f1c7-44b9-9540-952d371b4e72 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daab4f69af5452c8641006d9f09edce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9672a6c416ee44289eaa4d7c664d307e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:12:03.768935 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-25502e27-f1c7-44b9-9540-952d371b4e72 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "GET /compute/v2.1/servers/b13cd01f-fa9b-4d21-a1f9-4f7745dbbe37" status: 200 len: 1556 microversion: 2.1 time: 0.514120 Sep 14 09:12:03.775328 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2390/4761] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:12:03 2022] GET /compute/v2.1/servers/b13cd01f-fa9b-4d21-a1f9-4f7745dbbe37 => generated 1556 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:12:03.801775 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c1f1b0fd-8ccb-4ab5-856a-f742811a58c6 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:12:03.803768 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-c1f1b0fd-8ccb-4ab5-856a-f742811a58c6 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [instance: b13cd01f-fa9b-4d21-a1f9-4f7745dbbe37] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:12:03.826585 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c1f1b0fd-8ccb-4ab5-856a-f742811a58c6 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:03.827536 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c1f1b0fd-8ccb-4ab5-856a-f742811a58c6 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:03.828978 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c1f1b0fd-8ccb-4ab5-856a-f742811a58c6 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:03.830282 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c1f1b0fd-8ccb-4ab5-856a-f742811a58c6 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:03.839723 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c1f1b0fd-8ccb-4ab5-856a-f742811a58c6 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:03.840193 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c1f1b0fd-8ccb-4ab5-856a-f742811a58c6 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:03.991459 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a3b2fea8-e97f-4c2d-a8ea-dd6591f437b3 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:12:03.993224 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-a3b2fea8-e97f-4c2d-a8ea-dd6591f437b3 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:12:04.009797 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a3b2fea8-e97f-4c2d-a8ea-dd6591f437b3 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:04.013132 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a3b2fea8-e97f-4c2d-a8ea-dd6591f437b3 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:04.018558 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a3b2fea8-e97f-4c2d-a8ea-dd6591f437b3 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:04.019971 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a3b2fea8-e97f-4c2d-a8ea-dd6591f437b3 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:04.020775 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a3b2fea8-e97f-4c2d-a8ea-dd6591f437b3 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:04.021890 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a3b2fea8-e97f-4c2d-a8ea-dd6591f437b3 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:04.598693 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-c1f1b0fd-8ccb-4ab5-856a-f742811a58c6 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "GET /compute/v2.1/servers/b13cd01f-fa9b-4d21-a1f9-4f7745dbbe37/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.801379 Sep 14 09:12:04.600390 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2372/4762] 10.222.0.60 () {58 vars in 1275 bytes} [Wed Sep 14 09:12:03 2022] GET /compute/v2.1/servers/b13cd01f-fa9b-4d21-a1f9-4f7745dbbe37/os-interface => generated 284 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:12:04.658529 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-aaf5046f-844a-4b75-a496-612677d52dcf tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:12:04.659515 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-aaf5046f-844a-4b75-a496-612677d52dcf tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:12:04.675918 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-aaf5046f-844a-4b75-a496-612677d52dcf tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:04.676893 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-aaf5046f-844a-4b75-a496-612677d52dcf tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:04.679082 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-aaf5046f-844a-4b75-a496-612677d52dcf tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:04.680853 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-aaf5046f-844a-4b75-a496-612677d52dcf tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:04.681595 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-aaf5046f-844a-4b75-a496-612677d52dcf tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:04.682273 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-aaf5046f-844a-4b75-a496-612677d52dcf tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:05.052722 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-a3b2fea8-e97f-4c2d-a8ea-dd6591f437b3 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:12:05.079338 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-a3b2fea8-e97f-4c2d-a8ea-dd6591f437b3 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105" status: 200 len: 1655 microversion: 2.1 time: 1.092291 Sep 14 09:12:05.087167 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2391/4763] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:12:03 2022] GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105 => generated 1655 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:12:05.121914 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d7b4c4a3-dbb7-4c97-bc95-53186e145afb tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:12:05.131578 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d7b4c4a3-dbb7-4c97-bc95-53186e145afb tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:05.133806 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d7b4c4a3-dbb7-4c97-bc95-53186e145afb tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:05.134660 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d7b4c4a3-dbb7-4c97-bc95-53186e145afb tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:05.236797 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-d7b4c4a3-dbb7-4c97-bc95-53186e145afb tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Going to try to start instance {{(pid=128758) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 14 09:12:05.312030 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-aaf5046f-844a-4b75-a496-612677d52dcf tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:12:05.330429 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-aaf5046f-844a-4b75-a496-612677d52dcf tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:12:05.335351 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-aaf5046f-844a-4b75-a496-612677d52dcf tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:12:05.344978 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-aaf5046f-844a-4b75-a496-612677d52dcf tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5" status: 200 len: 1807 microversion: 2.20 time: 0.688093 Sep 14 09:12:05.346385 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2373/4764] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:12:04 2022] GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5 => generated 1807 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 09:12:05.364994 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-d7b4c4a3-dbb7-4c97-bc95-53186e145afb tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "POST /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105/action" status: 202 len: 0 microversion: 2.1 time: 0.243735 Sep 14 09:12:05.371194 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2392/4765] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:12:05 2022] POST /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105/action => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 14 09:12:05.380201 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ed7f4337-fb91-4906-80ce-d328872bfebf tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:12:05.381233 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-ed7f4337-fb91-4906-80ce-d328872bfebf tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:12:05.406171 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ed7f4337-fb91-4906-80ce-d328872bfebf tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:05.407138 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ed7f4337-fb91-4906-80ce-d328872bfebf tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:05.407833 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ed7f4337-fb91-4906-80ce-d328872bfebf tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:05.408942 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ed7f4337-fb91-4906-80ce-d328872bfebf tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:05.409730 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ed7f4337-fb91-4906-80ce-d328872bfebf tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:05.421269 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ed7f4337-fb91-4906-80ce-d328872bfebf tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:06.379061 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-309a7038-773d-4b07-afc7-b3241f9af66f tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:12:06.380439 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-309a7038-773d-4b07-afc7-b3241f9af66f tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:12:06.396641 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-309a7038-773d-4b07-afc7-b3241f9af66f tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:06.397444 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-309a7038-773d-4b07-afc7-b3241f9af66f tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:06.399040 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-309a7038-773d-4b07-afc7-b3241f9af66f tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:06.400405 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-309a7038-773d-4b07-afc7-b3241f9af66f tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:06.401203 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-309a7038-773d-4b07-afc7-b3241f9af66f tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:06.401800 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-309a7038-773d-4b07-afc7-b3241f9af66f tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:06.892500 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-ed7f4337-fb91-4906-80ce-d328872bfebf tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:12:06.909933 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-ed7f4337-fb91-4906-80ce-d328872bfebf tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105" status: 200 len: 1664 microversion: 2.1 time: 1.528444 Sep 14 09:12:06.914229 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2374/4766] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:12:05 2022] GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105 => generated 1664 bytes in 1539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:12:07.230062 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-309a7038-773d-4b07-afc7-b3241f9af66f tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:12:07.252323 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-309a7038-773d-4b07-afc7-b3241f9af66f tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:12:07.254144 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-309a7038-773d-4b07-afc7-b3241f9af66f tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:12:07.258199 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-309a7038-773d-4b07-afc7-b3241f9af66f tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5" status: 200 len: 1807 microversion: 2.20 time: 0.885218 Sep 14 09:12:07.258994 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2393/4767] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:12:06 2022] GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5 => generated 1807 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 09:12:07.943894 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-2f5b2c91-7ca2-4fe7-be3d-4aa07e7884a9 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:12:07.945693 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-2f5b2c91-7ca2-4fe7-be3d-4aa07e7884a9 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:12:07.968508 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2f5b2c91-7ca2-4fe7-be3d-4aa07e7884a9 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:07.969619 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2f5b2c91-7ca2-4fe7-be3d-4aa07e7884a9 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:07.971369 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2f5b2c91-7ca2-4fe7-be3d-4aa07e7884a9 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:07.975775 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2f5b2c91-7ca2-4fe7-be3d-4aa07e7884a9 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:07.979047 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2f5b2c91-7ca2-4fe7-be3d-4aa07e7884a9 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:07.979852 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2f5b2c91-7ca2-4fe7-be3d-4aa07e7884a9 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:08.290234 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-9eab8801-e154-4396-93e6-4fd999c060d7 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:12:08.291250 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-9eab8801-e154-4396-93e6-4fd999c060d7 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:12:08.303729 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9eab8801-e154-4396-93e6-4fd999c060d7 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:08.304299 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9eab8801-e154-4396-93e6-4fd999c060d7 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:08.304750 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9eab8801-e154-4396-93e6-4fd999c060d7 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:08.307674 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9eab8801-e154-4396-93e6-4fd999c060d7 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:08.308205 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9eab8801-e154-4396-93e6-4fd999c060d7 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:08.308651 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9eab8801-e154-4396-93e6-4fd999c060d7 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:09.360407 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-9eab8801-e154-4396-93e6-4fd999c060d7 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:12:09.390549 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-9eab8801-e154-4396-93e6-4fd999c060d7 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:12:09.402441 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-9eab8801-e154-4396-93e6-4fd999c060d7 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:12:09.406062 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-9eab8801-e154-4396-93e6-4fd999c060d7 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5" status: 200 len: 1807 microversion: 2.20 time: 1.119895 Sep 14 09:12:09.412909 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2394/4768] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:12:08 2022] GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5 => generated 1807 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 09:12:09.699776 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-2f5b2c91-7ca2-4fe7-be3d-4aa07e7884a9 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:12:09.714691 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-2f5b2c91-7ca2-4fe7-be3d-4aa07e7884a9 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105" status: 200 len: 1664 microversion: 2.1 time: 1.776931 Sep 14 09:12:09.731899 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2375/4769] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:12:07 2022] GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105 => generated 1664 bytes in 1795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:12:10.434695 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-78b58123-2fba-42be-8241-9ad1aef365a1 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:12:10.435363 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-78b58123-2fba-42be-8241-9ad1aef365a1 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:12:10.449578 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-78b58123-2fba-42be-8241-9ad1aef365a1 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:10.478064 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-78b58123-2fba-42be-8241-9ad1aef365a1 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:10.480151 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-78b58123-2fba-42be-8241-9ad1aef365a1 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:10.488176 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-78b58123-2fba-42be-8241-9ad1aef365a1 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:10.488702 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-78b58123-2fba-42be-8241-9ad1aef365a1 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:10.490722 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-78b58123-2fba-42be-8241-9ad1aef365a1 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:10.758175 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b0b29480-6748-416d-b8a0-bd63ab2e96e3 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:12:10.760022 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b0b29480-6748-416d-b8a0-bd63ab2e96e3 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:12:10.822846 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b0b29480-6748-416d-b8a0-bd63ab2e96e3 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:10.823696 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b0b29480-6748-416d-b8a0-bd63ab2e96e3 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:10.824339 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b0b29480-6748-416d-b8a0-bd63ab2e96e3 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:10.828032 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b0b29480-6748-416d-b8a0-bd63ab2e96e3 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:10.831598 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b0b29480-6748-416d-b8a0-bd63ab2e96e3 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:10.837617 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b0b29480-6748-416d-b8a0-bd63ab2e96e3 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:11.262526 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-78b58123-2fba-42be-8241-9ad1aef365a1 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:12:11.285782 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-78b58123-2fba-42be-8241-9ad1aef365a1 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:12:11.287182 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-78b58123-2fba-42be-8241-9ad1aef365a1 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:12:11.288433 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-78b58123-2fba-42be-8241-9ad1aef365a1 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5" status: 200 len: 1807 microversion: 2.20 time: 0.858556 Sep 14 09:12:11.314051 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b0b29480-6748-416d-b8a0-bd63ab2e96e3 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:12:11.324602 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2395/4770] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:12:10 2022] GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5 => generated 1807 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:12:11.338995 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-5c376e3a-11bb-4d61-92f9-00d0c608db99 req-e8919dd9-9044-46ce-928a-e38276aaf0c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b13cd01f-fa9b-4d21-a1f9-4f7745dbbe37", "tag": "1a63584e-aab3-4542-b006-dd4f1e9c014b"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:12:11.340666 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b0b29480-6748-416d-b8a0-bd63ab2e96e3 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105" status: 200 len: 1668 microversion: 2.1 time: 0.599161 Sep 14 09:12:11.343459 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2376/4771] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:12:10 2022] GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105 => generated 1668 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:12:11.361400 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-5c376e3a-11bb-4d61-92f9-00d0c608db99 req-e8919dd9-9044-46ce-928a-e38276aaf0c8 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:11.367581 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-5c376e3a-11bb-4d61-92f9-00d0c608db99 req-e8919dd9-9044-46ce-928a-e38276aaf0c8 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:11.368069 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-5c376e3a-11bb-4d61-92f9-00d0c608db99 req-e8919dd9-9044-46ce-928a-e38276aaf0c8 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:11.381728 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e956f680-1642-4f85-a097-272f757b05fb tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:12:11.382412 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e956f680-1642-4f85-a097-272f757b05fb tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:12:11.395275 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-5c376e3a-11bb-4d61-92f9-00d0c608db99 req-e8919dd9-9044-46ce-928a-e38276aaf0c8 service nova] Creating event network-changed:1a63584e-aab3-4542-b006-dd4f1e9c014b for instance b13cd01f-fa9b-4d21-a1f9-4f7745dbbe37 on n-h2-836830-18 Sep 14 09:12:11.412393 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e956f680-1642-4f85-a097-272f757b05fb tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:11.413112 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e956f680-1642-4f85-a097-272f757b05fb tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:11.416988 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-5c376e3a-11bb-4d61-92f9-00d0c608db99 req-e8919dd9-9044-46ce-928a-e38276aaf0c8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089084 Sep 14 09:12:11.418814 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e956f680-1642-4f85-a097-272f757b05fb tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:11.419777 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2396/4772] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:12:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:12:11.421394 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e956f680-1642-4f85-a097-272f757b05fb tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:11.425828 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e956f680-1642-4f85-a097-272f757b05fb tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:11.430216 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e956f680-1642-4f85-a097-272f757b05fb tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:12.323162 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a2aa7679-b37d-41f5-9268-95cfb89aae55 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:12:12.324203 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-a2aa7679-b37d-41f5-9268-95cfb89aae55 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:12:12.343825 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a2aa7679-b37d-41f5-9268-95cfb89aae55 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:12.344484 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a2aa7679-b37d-41f5-9268-95cfb89aae55 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:12.345049 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a2aa7679-b37d-41f5-9268-95cfb89aae55 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:12.347050 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a2aa7679-b37d-41f5-9268-95cfb89aae55 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:12.350684 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a2aa7679-b37d-41f5-9268-95cfb89aae55 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:12.351348 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a2aa7679-b37d-41f5-9268-95cfb89aae55 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:12.367419 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-e956f680-1642-4f85-a097-272f757b05fb tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:12:12.377077 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e956f680-1642-4f85-a097-272f757b05fb tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105" status: 200 len: 1668 microversion: 2.1 time: 1.005621 Sep 14 09:12:12.381460 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2377/4773] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:12:11 2022] GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105 => generated 1668 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:12:12.408306 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-cea93ce2-b7b6-4fa2-82fe-49a1f03e367c tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:12:12.415861 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-cea93ce2-b7b6-4fa2-82fe-49a1f03e367c tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:12:12.438003 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cea93ce2-b7b6-4fa2-82fe-49a1f03e367c tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:12.439881 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cea93ce2-b7b6-4fa2-82fe-49a1f03e367c tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:12.442007 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cea93ce2-b7b6-4fa2-82fe-49a1f03e367c tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:12.443354 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cea93ce2-b7b6-4fa2-82fe-49a1f03e367c tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:12.448187 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cea93ce2-b7b6-4fa2-82fe-49a1f03e367c tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:12.448996 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cea93ce2-b7b6-4fa2-82fe-49a1f03e367c tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:12.555388 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-cea93ce2-b7b6-4fa2-82fe-49a1f03e367c tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Unlocking {{(pid=128759) unlock /opt/stack/nova/nova/compute/api.py:4874}} Sep 14 09:12:12.682887 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-cea93ce2-b7b6-4fa2-82fe-49a1f03e367c tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "POST /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105/action" status: 202 len: 0 microversion: 2.1 time: 0.278416 Sep 14 09:12:12.684131 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2378/4774] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:12:12 2022] POST /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105/action => generated 0 bytes in 281 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 14 09:12:12.701438 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-50839021-b93f-470b-82f6-f008c4204349 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:12:12.703227 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-50839021-b93f-470b-82f6-f008c4204349 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:12:12.713199 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-50839021-b93f-470b-82f6-f008c4204349 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:12.714277 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-50839021-b93f-470b-82f6-f008c4204349 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:12.715394 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-50839021-b93f-470b-82f6-f008c4204349 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:12.718845 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-50839021-b93f-470b-82f6-f008c4204349 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:12.719974 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-50839021-b93f-470b-82f6-f008c4204349 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:12.721207 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-50839021-b93f-470b-82f6-f008c4204349 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:13.422439 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-a2aa7679-b37d-41f5-9268-95cfb89aae55 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:12:13.436986 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-a2aa7679-b37d-41f5-9268-95cfb89aae55 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:12:13.442317 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-a2aa7679-b37d-41f5-9268-95cfb89aae55 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:12:13.448338 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-a2aa7679-b37d-41f5-9268-95cfb89aae55 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5" status: 200 len: 1807 microversion: 2.20 time: 1.130723 Sep 14 09:12:13.449602 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2397/4775] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:12:12 2022] GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5 => generated 1807 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:12:14.480116 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ac7f5c1f-3d17-4626-838f-bfae4c1845ff tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:12:14.481865 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-ac7f5c1f-3d17-4626-838f-bfae4c1845ff tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:12:14.509738 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ac7f5c1f-3d17-4626-838f-bfae4c1845ff tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:14.517470 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ac7f5c1f-3d17-4626-838f-bfae4c1845ff tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:14.521978 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ac7f5c1f-3d17-4626-838f-bfae4c1845ff tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:14.525707 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ac7f5c1f-3d17-4626-838f-bfae4c1845ff tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:14.529461 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ac7f5c1f-3d17-4626-838f-bfae4c1845ff tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:14.534006 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ac7f5c1f-3d17-4626-838f-bfae4c1845ff tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:14.943270 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-50839021-b93f-470b-82f6-f008c4204349 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:12:14.964565 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-50839021-b93f-470b-82f6-f008c4204349 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105" status: 200 len: 1668 microversion: 2.1 time: 2.271278 Sep 14 09:12:14.965625 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2379/4776] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:12:12 2022] GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105 => generated 1668 bytes in 2273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:12:14.992450 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-28bb9251-fdb2-4d7d-83ca-5c2177d6432e tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:12:14.993409 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-28bb9251-fdb2-4d7d-83ca-5c2177d6432e tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:12:15.001218 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-28bb9251-fdb2-4d7d-83ca-5c2177d6432e tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:15.002056 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-28bb9251-fdb2-4d7d-83ca-5c2177d6432e tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:15.002818 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-28bb9251-fdb2-4d7d-83ca-5c2177d6432e tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:15.003804 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-28bb9251-fdb2-4d7d-83ca-5c2177d6432e tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:15.004511 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-28bb9251-fdb2-4d7d-83ca-5c2177d6432e tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:15.005170 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-28bb9251-fdb2-4d7d-83ca-5c2177d6432e tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:15.010383 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:12:15.448983 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-ac7f5c1f-3d17-4626-838f-bfae4c1845ff tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:12:15.459525 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-ac7f5c1f-3d17-4626-838f-bfae4c1845ff tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:12:15.461450 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-ac7f5c1f-3d17-4626-838f-bfae4c1845ff tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:12:15.462756 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-ac7f5c1f-3d17-4626-838f-bfae4c1845ff tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5" status: 200 len: 1807 microversion: 2.20 time: 0.987226 Sep 14 09:12:15.463747 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2398/4777] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:12:14 2022] GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5 => generated 1807 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 09:12:15.688160 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-28bb9251-fdb2-4d7d-83ca-5c2177d6432e tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:12:15.696787 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-28bb9251-fdb2-4d7d-83ca-5c2177d6432e tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105" status: 200 len: 1668 microversion: 2.1 time: 0.708722 Sep 14 09:12:15.701520 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2380/4778] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:12:14 2022] GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105 => generated 1668 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:12:15.727267 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a858a8f3-e16c-4b0d-8c56-08b3bed3fc03 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:12:15.728061 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-a858a8f3-e16c-4b0d-8c56-08b3bed3fc03 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:12:15.730853 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=54 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:12:15.746931 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a858a8f3-e16c-4b0d-8c56-08b3bed3fc03 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:15.747455 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a858a8f3-e16c-4b0d-8c56-08b3bed3fc03 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:15.747891 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a858a8f3-e16c-4b0d-8c56-08b3bed3fc03 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:15.748638 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a858a8f3-e16c-4b0d-8c56-08b3bed3fc03 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:15.749095 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a858a8f3-e16c-4b0d-8c56-08b3bed3fc03 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:15.749525 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a858a8f3-e16c-4b0d-8c56-08b3bed3fc03 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:16.061330 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-2d0dec4e-e04f-4b61-bbcc-58618dd2f68c tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1122348521", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:12:16.075603 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=52 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:12:16.163331 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.network.neutron [None req-2d0dec4e-e04f-4b61-bbcc-58618dd2f68c tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] validate_networks() for None {{(pid=128759) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:12:16.360271 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-a858a8f3-e16c-4b0d-8c56-08b3bed3fc03 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:12:16.372068 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-a858a8f3-e16c-4b0d-8c56-08b3bed3fc03 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105" status: 200 len: 1668 microversion: 2.1 time: 0.648862 Sep 14 09:12:16.373078 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2399/4779] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:12:15 2022] GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105 => generated 1668 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:12:16.396411 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-648be847-d5cc-4e57-8bc5-17def7d55af3 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:12:16.397619 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-648be847-d5cc-4e57-8bc5-17def7d55af3 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:12:16.413958 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-648be847-d5cc-4e57-8bc5-17def7d55af3 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:16.414873 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-648be847-d5cc-4e57-8bc5-17def7d55af3 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:16.416596 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-648be847-d5cc-4e57-8bc5-17def7d55af3 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:16.427378 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-648be847-d5cc-4e57-8bc5-17def7d55af3 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:16.432613 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-648be847-d5cc-4e57-8bc5-17def7d55af3 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:16.433893 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-648be847-d5cc-4e57-8bc5-17def7d55af3 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:16.525820 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:12:16.539871 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-648be847-d5cc-4e57-8bc5-17def7d55af3 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "POST /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105/action" status: 202 len: 0 microversion: 2.1 time: 0.147393 Sep 14 09:12:16.541643 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2400/4780] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:12:16 2022] POST /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105/action => generated 0 bytes in 150 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 14 09:12:16.548747 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-75bbece1-9a67-4328-8e02-0af1ee7c9286 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:12:16.550122 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-75bbece1-9a67-4328-8e02-0af1ee7c9286 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:12:16.579593 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-75bbece1-9a67-4328-8e02-0af1ee7c9286 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:16.580363 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-75bbece1-9a67-4328-8e02-0af1ee7c9286 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:16.581155 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-75bbece1-9a67-4328-8e02-0af1ee7c9286 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:16.582128 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-75bbece1-9a67-4328-8e02-0af1ee7c9286 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:16.582826 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-75bbece1-9a67-4328-8e02-0af1ee7c9286 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:16.583619 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-75bbece1-9a67-4328-8e02-0af1ee7c9286 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:17.247421 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-2d0dec4e-e04f-4b61-bbcc-58618dd2f68c tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Flavor limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:12:17.248826 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-2d0dec4e-e04f-4b61-bbcc-58618dd2f68c tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Image limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:12:17.249759 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-2d0dec4e-e04f-4b61-bbcc-58618dd2f68c tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Flavor pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:12:17.250531 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-2d0dec4e-e04f-4b61-bbcc-58618dd2f68c tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Image pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:12:17.252521 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-2d0dec4e-e04f-4b61-bbcc-58618dd2f68c tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:12:17.282005 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2d0dec4e-e04f-4b61-bbcc-58618dd2f68c tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:17.283552 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2d0dec4e-e04f-4b61-bbcc-58618dd2f68c tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:17.284910 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2d0dec4e-e04f-4b61-bbcc-58618dd2f68c tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:17.286998 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2d0dec4e-e04f-4b61-bbcc-58618dd2f68c tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:17.288775 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2d0dec4e-e04f-4b61-bbcc-58618dd2f68c tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:17.290696 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2d0dec4e-e04f-4b61-bbcc-58618dd2f68c tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:17.320807 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-75bbece1-9a67-4328-8e02-0af1ee7c9286 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:12:17.335313 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-75bbece1-9a67-4328-8e02-0af1ee7c9286 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:12:17.341378 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-75bbece1-9a67-4328-8e02-0af1ee7c9286 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:12:17.345832 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-75bbece1-9a67-4328-8e02-0af1ee7c9286 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5" status: 200 len: 1807 microversion: 2.20 time: 0.802611 Sep 14 09:12:17.352258 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-2d0dec4e-e04f-4b61-bbcc-58618dd2f68c tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Getting quotas for project a77e7aab450842cf8b27d62e76a06569. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:12:17.364249 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2401/4781] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:12:16 2022] GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5 => generated 1807 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:12:17.368885 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-2d0dec4e-e04f-4b61-bbcc-58618dd2f68c tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Getting quotas for user 0445809b8ae242bb8b72fe37550589c3 and project a77e7aab450842cf8b27d62e76a06569. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:12:17.376797 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d8c4f632-fc32-492f-9d89-f0abe49d02c5 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:12:17.377703 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-d8c4f632-fc32-492f-9d89-f0abe49d02c5 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:12:17.384371 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d8c4f632-fc32-492f-9d89-f0abe49d02c5 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:17.385178 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d8c4f632-fc32-492f-9d89-f0abe49d02c5 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:17.385842 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d8c4f632-fc32-492f-9d89-f0abe49d02c5 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:17.386802 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d8c4f632-fc32-492f-9d89-f0abe49d02c5 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:17.387509 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d8c4f632-fc32-492f-9d89-f0abe49d02c5 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:17.388152 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d8c4f632-fc32-492f-9d89-f0abe49d02c5 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:17.388784 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-2d0dec4e-e04f-4b61-bbcc-58618dd2f68c tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Going to run 1 instances... {{(pid=128759) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:12:17.393292 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-2d0dec4e-e04f-4b61-bbcc-58618dd2f68c tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] [instance: b697814f-f228-4d60-b62e-1677867aeb4b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128759) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:12:17.463740 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-2d0dec4e-e04f-4b61-bbcc-58618dd2f68c tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.406622 Sep 14 09:12:17.473056 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2381/4782] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 09:12:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1417 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:12:17.479048 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d8f767be-2121-464a-878c-4252f86af9b4 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:12:17.480538 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-d8f767be-2121-464a-878c-4252f86af9b4 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] [instance: b697814f-f228-4d60-b62e-1677867aeb4b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:12:17.585266 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-d8f767be-2121-464a-878c-4252f86af9b4 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0445809b8ae242bb8b72fe37550589c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77e7aab450842cf8b27d62e76a06569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:12:17.597093 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d8f767be-2121-464a-878c-4252f86af9b4 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] 10.222.0.60 "GET /compute/v2.1/servers/b697814f-f228-4d60-b62e-1677867aeb4b" status: 200 len: 1215 microversion: 2.1 time: 0.122520 Sep 14 09:12:17.611262 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2382/4783] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:12:17 2022] GET /compute/v2.1/servers/b697814f-f228-4d60-b62e-1677867aeb4b => generated 1215 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:12:18.134254 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-d8c4f632-fc32-492f-9d89-f0abe49d02c5 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:12:18.150673 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-d8c4f632-fc32-492f-9d89-f0abe49d02c5 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105" status: 200 len: 1653 microversion: 2.1 time: 0.782817 Sep 14 09:12:18.150673 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2402/4784] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:12:17 2022] GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105 => generated 1653 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:12:18.172934 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a466228d-63ac-4dd5-935a-bd2bb27be7bf tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:12:18.173593 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-a466228d-63ac-4dd5-935a-bd2bb27be7bf tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:12:18.186356 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a466228d-63ac-4dd5-935a-bd2bb27be7bf tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:18.189779 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a466228d-63ac-4dd5-935a-bd2bb27be7bf tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:18.190346 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a466228d-63ac-4dd5-935a-bd2bb27be7bf tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:18.191373 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a466228d-63ac-4dd5-935a-bd2bb27be7bf tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:18.200151 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a466228d-63ac-4dd5-935a-bd2bb27be7bf tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:18.202357 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a466228d-63ac-4dd5-935a-bd2bb27be7bf tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:18.370998 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a466228d-63ac-4dd5-935a-bd2bb27be7bf tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "POST /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105/action" status: 202 len: 0 microversion: 2.1 time: 0.200889 Sep 14 09:12:18.375057 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2383/4785] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:12:18 2022] POST /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105/action => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:12:18.381128 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-8439ef20-2e87-4b5a-ade0-76f972ed8e32 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:12:18.382347 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-8439ef20-2e87-4b5a-ade0-76f972ed8e32 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:12:18.393336 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-35f39a26-f955-4ce3-909d-f3f762bd0541 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:12:18.396452 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8439ef20-2e87-4b5a-ade0-76f972ed8e32 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:18.397184 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8439ef20-2e87-4b5a-ade0-76f972ed8e32 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:18.397805 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8439ef20-2e87-4b5a-ade0-76f972ed8e32 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:18.398725 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8439ef20-2e87-4b5a-ade0-76f972ed8e32 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:18.399842 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-35f39a26-f955-4ce3-909d-f3f762bd0541 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:12:18.400530 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8439ef20-2e87-4b5a-ade0-76f972ed8e32 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:18.402293 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8439ef20-2e87-4b5a-ade0-76f972ed8e32 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:18.415733 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-35f39a26-f955-4ce3-909d-f3f762bd0541 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:18.420935 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-35f39a26-f955-4ce3-909d-f3f762bd0541 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:18.430672 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-35f39a26-f955-4ce3-909d-f3f762bd0541 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:18.431831 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-35f39a26-f955-4ce3-909d-f3f762bd0541 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:18.435397 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-35f39a26-f955-4ce3-909d-f3f762bd0541 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:18.436800 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-35f39a26-f955-4ce3-909d-f3f762bd0541 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:19.272957 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-8439ef20-2e87-4b5a-ade0-76f972ed8e32 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:12:19.294194 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-8439ef20-2e87-4b5a-ade0-76f972ed8e32 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:12:19.305115 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-8439ef20-2e87-4b5a-ade0-76f972ed8e32 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:12:19.307538 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-8439ef20-2e87-4b5a-ade0-76f972ed8e32 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5" status: 200 len: 1807 microversion: 2.20 time: 0.930449 Sep 14 09:12:19.310209 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2403/4786] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:12:18 2022] GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5 => generated 1807 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:12:19.321616 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-6a595801-6e6e-4673-9991-7e0a6ba08654 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:12:19.323362 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-6a595801-6e6e-4673-9991-7e0a6ba08654 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] [instance: b697814f-f228-4d60-b62e-1677867aeb4b] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:12:19.339332 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6a595801-6e6e-4673-9991-7e0a6ba08654 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:19.339840 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6a595801-6e6e-4673-9991-7e0a6ba08654 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:19.340289 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6a595801-6e6e-4673-9991-7e0a6ba08654 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:19.341011 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6a595801-6e6e-4673-9991-7e0a6ba08654 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:19.350393 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6a595801-6e6e-4673-9991-7e0a6ba08654 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:19.351265 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6a595801-6e6e-4673-9991-7e0a6ba08654 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:19.453462 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-35f39a26-f955-4ce3-909d-f3f762bd0541 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:12:19.471528 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-35f39a26-f955-4ce3-909d-f3f762bd0541 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105" status: 200 len: 1660 microversion: 2.1 time: 1.082999 Sep 14 09:12:19.472338 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2384/4787] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:12:18 2022] GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105 => generated 1660 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:12:19.541530 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-6a595801-6e6e-4673-9991-7e0a6ba08654 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0445809b8ae242bb8b72fe37550589c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77e7aab450842cf8b27d62e76a06569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:12:19.584934 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-6a595801-6e6e-4673-9991-7e0a6ba08654 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] 10.222.0.60 "GET /compute/v2.1/servers/b697814f-f228-4d60-b62e-1677867aeb4b" status: 200 len: 1211 microversion: 2.1 time: 0.268645 Sep 14 09:12:19.586642 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2404/4788] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:12:19 2022] GET /compute/v2.1/servers/b697814f-f228-4d60-b62e-1677867aeb4b => generated 1211 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:12:20.097821 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-4ab897d4-340c-49d4-9612-acc5fb23d1c1 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1077863651", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "networks": [{"uuid": "b042f13f-03cb-405b-9030-9bd2a14f4bd9"}, {"uuid": "c855f260-5cbf-473f-a7d9-273172ae6548"}, {"uuid": "b042f13f-03cb-405b-9030-9bd2a14f4bd9"}]}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:12:20.303224 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.network.neutron [None req-4ab897d4-340c-49d4-9612-acc5fb23d1c1 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] validate_networks() for [('b042f13f-03cb-405b-9030-9bd2a14f4bd9', None, None, None, None, None), ('c855f260-5cbf-473f-a7d9-273172ae6548', None, None, None, None, None), ('b042f13f-03cb-405b-9030-9bd2a14f4bd9', None, None, None, None, None)] {{(pid=128759) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:12:20.343723 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1fedb7e6-bfa1-49ba-be45-c1f0c6871085 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:12:20.344792 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-1fedb7e6-bfa1-49ba-be45-c1f0c6871085 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:12:20.353417 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1fedb7e6-bfa1-49ba-be45-c1f0c6871085 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:20.354277 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1fedb7e6-bfa1-49ba-be45-c1f0c6871085 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:20.354930 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1fedb7e6-bfa1-49ba-be45-c1f0c6871085 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:20.356018 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1fedb7e6-bfa1-49ba-be45-c1f0c6871085 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:20.356713 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1fedb7e6-bfa1-49ba-be45-c1f0c6871085 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:20.357692 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1fedb7e6-bfa1-49ba-be45-c1f0c6871085 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:21.293866 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-1fedb7e6-bfa1-49ba-be45-c1f0c6871085 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:12:21.311806 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-1fedb7e6-bfa1-49ba-be45-c1f0c6871085 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:12:21.313385 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-1fedb7e6-bfa1-49ba-be45-c1f0c6871085 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:12:21.314630 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-1fedb7e6-bfa1-49ba-be45-c1f0c6871085 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5" status: 200 len: 1807 microversion: 2.20 time: 0.976717 Sep 14 09:12:21.315707 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2405/4789] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:12:20 2022] GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5 => generated 1807 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:12:21.331639 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1857cb80-fe0c-4b46-8563-265db1a3ce46 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:12:21.332625 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-1857cb80-fe0c-4b46-8563-265db1a3ce46 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:12:21.343542 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1857cb80-fe0c-4b46-8563-265db1a3ce46 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:21.349568 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1857cb80-fe0c-4b46-8563-265db1a3ce46 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:21.350024 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1857cb80-fe0c-4b46-8563-265db1a3ce46 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:21.350875 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1857cb80-fe0c-4b46-8563-265db1a3ce46 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:21.356365 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1857cb80-fe0c-4b46-8563-265db1a3ce46 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:21.362380 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1857cb80-fe0c-4b46-8563-265db1a3ce46 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:21.981421 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-1857cb80-fe0c-4b46-8563-265db1a3ce46 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:12:21.997249 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-1857cb80-fe0c-4b46-8563-265db1a3ce46 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105" status: 200 len: 1668 microversion: 2.1 time: 0.679059 Sep 14 09:12:22.010968 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2406/4790] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:12:21 2022] GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105 => generated 1668 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:12:22.011483 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1956b6fe-6460-4cd5-b259-a349c7533d79 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:12:22.012338 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-1956b6fe-6460-4cd5-b259-a349c7533d79 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] [instance: b697814f-f228-4d60-b62e-1677867aeb4b] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:12:22.026978 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1956b6fe-6460-4cd5-b259-a349c7533d79 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:22.030098 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1956b6fe-6460-4cd5-b259-a349c7533d79 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:22.030998 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1956b6fe-6460-4cd5-b259-a349c7533d79 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:22.033798 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1956b6fe-6460-4cd5-b259-a349c7533d79 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:22.037306 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1956b6fe-6460-4cd5-b259-a349c7533d79 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:22.043393 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1956b6fe-6460-4cd5-b259-a349c7533d79 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:22.203468 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-1956b6fe-6460-4cd5-b259-a349c7533d79 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0445809b8ae242bb8b72fe37550589c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77e7aab450842cf8b27d62e76a06569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:12:22.212017 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-1956b6fe-6460-4cd5-b259-a349c7533d79 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] 10.222.0.60 "GET /compute/v2.1/servers/b697814f-f228-4d60-b62e-1677867aeb4b" status: 200 len: 1273 microversion: 2.1 time: 0.210184 Sep 14 09:12:22.212611 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2407/4791] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:12:22 2022] GET /compute/v2.1/servers/b697814f-f228-4d60-b62e-1677867aeb4b => generated 1273 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:12:22.222768 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c018a951-9846-4e2e-be1b-90df5c33d986 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:12:22.228729 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-c018a951-9846-4e2e-be1b-90df5c33d986 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:12:22.241638 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c018a951-9846-4e2e-be1b-90df5c33d986 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:22.242150 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c018a951-9846-4e2e-be1b-90df5c33d986 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:22.242594 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c018a951-9846-4e2e-be1b-90df5c33d986 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:22.243469 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c018a951-9846-4e2e-be1b-90df5c33d986 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:22.243801 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c018a951-9846-4e2e-be1b-90df5c33d986 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:22.244232 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c018a951-9846-4e2e-be1b-90df5c33d986 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:23.110441 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-c018a951-9846-4e2e-be1b-90df5c33d986 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:12:23.130307 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-c018a951-9846-4e2e-be1b-90df5c33d986 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105" status: 200 len: 1668 microversion: 2.1 time: 0.911437 Sep 14 09:12:23.132505 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2408/4792] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:12:22 2022] GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105 => generated 1668 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:12:23.139486 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-651bca2f-5b6b-4fb3-970a-a0a34cc6856a tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:12:23.142114 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-651bca2f-5b6b-4fb3-970a-a0a34cc6856a tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:12:23.170540 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-651bca2f-5b6b-4fb3-970a-a0a34cc6856a tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:23.173913 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-651bca2f-5b6b-4fb3-970a-a0a34cc6856a tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:23.175222 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-651bca2f-5b6b-4fb3-970a-a0a34cc6856a tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:23.176443 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-651bca2f-5b6b-4fb3-970a-a0a34cc6856a tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:23.177388 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-651bca2f-5b6b-4fb3-970a-a0a34cc6856a tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:23.178022 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-651bca2f-5b6b-4fb3-970a-a0a34cc6856a tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:23.513501 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-651bca2f-5b6b-4fb3-970a-a0a34cc6856a tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:12:23.525307 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-651bca2f-5b6b-4fb3-970a-a0a34cc6856a tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:12:23.527416 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-651bca2f-5b6b-4fb3-970a-a0a34cc6856a tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:12:23.528640 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-651bca2f-5b6b-4fb3-970a-a0a34cc6856a tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5" status: 200 len: 1807 microversion: 2.20 time: 0.394980 Sep 14 09:12:23.529679 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2409/4793] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:12:23 2022] GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5 => generated 1807 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:12:23.535846 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-7c75effe-867d-4050-989e-b0bcf40c9345 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:12:23.536609 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-7c75effe-867d-4050-989e-b0bcf40c9345 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:12:23.546582 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7c75effe-867d-4050-989e-b0bcf40c9345 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:23.547464 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7c75effe-867d-4050-989e-b0bcf40c9345 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:23.548175 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7c75effe-867d-4050-989e-b0bcf40c9345 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:23.549289 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7c75effe-867d-4050-989e-b0bcf40c9345 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:23.550056 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7c75effe-867d-4050-989e-b0bcf40c9345 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:23.550733 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7c75effe-867d-4050-989e-b0bcf40c9345 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:23.828053 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-4ab897d4-340c-49d4-9612-acc5fb23d1c1 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Flavor limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:12:23.829060 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-4ab897d4-340c-49d4-9612-acc5fb23d1c1 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Image limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:12:23.829720 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-4ab897d4-340c-49d4-9612-acc5fb23d1c1 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Flavor pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:12:23.830324 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-4ab897d4-340c-49d4-9612-acc5fb23d1c1 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Image pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:12:23.831052 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-4ab897d4-340c-49d4-9612-acc5fb23d1c1 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:12:23.841413 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4ab897d4-340c-49d4-9612-acc5fb23d1c1 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:23.842377 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4ab897d4-340c-49d4-9612-acc5fb23d1c1 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:23.843128 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4ab897d4-340c-49d4-9612-acc5fb23d1c1 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:23.844383 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4ab897d4-340c-49d4-9612-acc5fb23d1c1 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:23.845073 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4ab897d4-340c-49d4-9612-acc5fb23d1c1 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:23.846538 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4ab897d4-340c-49d4-9612-acc5fb23d1c1 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:23.872942 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-7c75effe-867d-4050-989e-b0bcf40c9345 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:12:23.889190 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-7c75effe-867d-4050-989e-b0bcf40c9345 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105" status: 200 len: 1668 microversion: 2.1 time: 0.358057 Sep 14 09:12:23.890639 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2410/4794] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:12:23 2022] GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105 => generated 1668 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:12:23.896024 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-91fa1f99-0490-45e5-8e85-653de609aa91 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:12:23.897250 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-91fa1f99-0490-45e5-8e85-653de609aa91 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] [instance: b697814f-f228-4d60-b62e-1677867aeb4b] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:12:23.905840 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-91fa1f99-0490-45e5-8e85-653de609aa91 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:23.906702 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-91fa1f99-0490-45e5-8e85-653de609aa91 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:23.907697 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-91fa1f99-0490-45e5-8e85-653de609aa91 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:23.908812 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-91fa1f99-0490-45e5-8e85-653de609aa91 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:23.909607 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-91fa1f99-0490-45e5-8e85-653de609aa91 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:23.910366 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-91fa1f99-0490-45e5-8e85-653de609aa91 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:23.921338 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-4ab897d4-340c-49d4-9612-acc5fb23d1c1 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Getting quotas for project b94e25a7caf946c2a80b874416e4906b. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:12:23.941423 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-4ab897d4-340c-49d4-9612-acc5fb23d1c1 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Getting quotas for user fe73f3d7f4734e1ab9f6b7283db1388b and project b94e25a7caf946c2a80b874416e4906b. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:12:23.965712 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-4ab897d4-340c-49d4-9612-acc5fb23d1c1 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Going to run 1 instances... {{(pid=128759) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:12:23.969749 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-4ab897d4-340c-49d4-9612-acc5fb23d1c1 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] [instance: a261d310-161f-4e77-a27a-7f377072cb2d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128759) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:12:24.101149 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-4ab897d4-340c-49d4-9612-acc5fb23d1c1 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.008897 Sep 14 09:12:24.118123 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2385/4795] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 09:12:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 4026 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:12:24.126109 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-281d59c4-fb3f-4c00-aeeb-5f99511d8655 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:12:24.147513 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-281d59c4-fb3f-4c00-aeeb-5f99511d8655 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:12:24.164466 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-281d59c4-fb3f-4c00-aeeb-5f99511d8655 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:24.165522 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-281d59c4-fb3f-4c00-aeeb-5f99511d8655 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:24.166262 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-281d59c4-fb3f-4c00-aeeb-5f99511d8655 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:24.171221 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-281d59c4-fb3f-4c00-aeeb-5f99511d8655 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:24.173344 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-281d59c4-fb3f-4c00-aeeb-5f99511d8655 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:24.174105 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-281d59c4-fb3f-4c00-aeeb-5f99511d8655 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:24.395101 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-91fa1f99-0490-45e5-8e85-653de609aa91 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0445809b8ae242bb8b72fe37550589c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77e7aab450842cf8b27d62e76a06569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:12:24.428597 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-91fa1f99-0490-45e5-8e85-653de609aa91 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] 10.222.0.60 "GET /compute/v2.1/servers/b697814f-f228-4d60-b62e-1677867aeb4b" status: 200 len: 1315 microversion: 2.1 time: 0.535460 Sep 14 09:12:24.429352 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2411/4796] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:12:23 2022] GET /compute/v2.1/servers/b697814f-f228-4d60-b62e-1677867aeb4b => generated 1315 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:12:24.454983 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1e8ddf7c-b198-4371-ab6f-792930b8228c tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:12:24.455696 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-1e8ddf7c-b198-4371-ab6f-792930b8228c tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] [instance: a261d310-161f-4e77-a27a-7f377072cb2d] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:12:24.632544 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-1e8ddf7c-b198-4371-ab6f-792930b8228c tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe73f3d7f4734e1ab9f6b7283db1388b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94e25a7caf946c2a80b874416e4906b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:12:24.642015 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-1e8ddf7c-b198-4371-ab6f-792930b8228c tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] 10.222.0.60 "GET /compute/v2.1/servers/a261d310-161f-4e77-a27a-7f377072cb2d" status: 200 len: 1213 microversion: 2.1 time: 0.201221 Sep 14 09:12:24.645385 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2412/4797] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:12:24 2022] GET /compute/v2.1/servers/a261d310-161f-4e77-a27a-7f377072cb2d => generated 1213 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:12:24.668802 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-df61ef59-8708-4735-ac42-f7def1f71367 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:12:24.672863 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-df61ef59-8708-4735-ac42-f7def1f71367 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:12:24.694073 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-df61ef59-8708-4735-ac42-f7def1f71367 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:24.694569 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-df61ef59-8708-4735-ac42-f7def1f71367 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:24.697391 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-df61ef59-8708-4735-ac42-f7def1f71367 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:24.699142 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-df61ef59-8708-4735-ac42-f7def1f71367 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:24.704433 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-df61ef59-8708-4735-ac42-f7def1f71367 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:24.704864 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-df61ef59-8708-4735-ac42-f7def1f71367 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:24.790245 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-281d59c4-fb3f-4c00-aeeb-5f99511d8655 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:12:24.824916 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-281d59c4-fb3f-4c00-aeeb-5f99511d8655 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105" status: 200 len: 1668 microversion: 2.1 time: 0.702811 Sep 14 09:12:24.829435 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2386/4798] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:12:24 2022] GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105 => generated 1668 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:12:24.852852 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-67250cae-dc90-4e75-b201-a2e6ee213dc0 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:12:24.853663 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-67250cae-dc90-4e75-b201-a2e6ee213dc0 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:12:24.883572 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-67250cae-dc90-4e75-b201-a2e6ee213dc0 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:24.886292 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-67250cae-dc90-4e75-b201-a2e6ee213dc0 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:24.887900 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-67250cae-dc90-4e75-b201-a2e6ee213dc0 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:24.890674 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-67250cae-dc90-4e75-b201-a2e6ee213dc0 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:24.891358 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-67250cae-dc90-4e75-b201-a2e6ee213dc0 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:24.893527 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-67250cae-dc90-4e75-b201-a2e6ee213dc0 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:25.163229 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-df61ef59-8708-4735-ac42-f7def1f71367 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:12:25.181729 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-df61ef59-8708-4735-ac42-f7def1f71367 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:12:25.184066 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-df61ef59-8708-4735-ac42-f7def1f71367 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:12:25.186856 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-df61ef59-8708-4735-ac42-f7def1f71367 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5" status: 200 len: 1807 microversion: 2.20 time: 0.533036 Sep 14 09:12:25.207052 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2413/4799] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:12:24 2022] GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5 => generated 1807 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:12:25.451571 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-67250cae-dc90-4e75-b201-a2e6ee213dc0 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:12:25.454076 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-0d04ac71-8797-4563-b96d-6464ad677209 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:12:25.454712 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-0d04ac71-8797-4563-b96d-6464ad677209 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] [instance: b697814f-f228-4d60-b62e-1677867aeb4b] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:12:25.463088 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-67250cae-dc90-4e75-b201-a2e6ee213dc0 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105" status: 200 len: 1668 microversion: 2.1 time: 0.614678 Sep 14 09:12:25.471377 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0d04ac71-8797-4563-b96d-6464ad677209 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:25.471881 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0d04ac71-8797-4563-b96d-6464ad677209 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:25.472328 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0d04ac71-8797-4563-b96d-6464ad677209 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:25.478419 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0d04ac71-8797-4563-b96d-6464ad677209 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:25.481354 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0d04ac71-8797-4563-b96d-6464ad677209 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:25.481829 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0d04ac71-8797-4563-b96d-6464ad677209 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:25.487454 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2387/4800] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:12:24 2022] GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105 => generated 1668 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:12:25.494657 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b225ed3d-69d6-4acf-9c71-b84b47624c8f tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:12:25.495874 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b225ed3d-69d6-4acf-9c71-b84b47624c8f tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:12:25.503054 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b225ed3d-69d6-4acf-9c71-b84b47624c8f tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:25.503805 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b225ed3d-69d6-4acf-9c71-b84b47624c8f tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:25.504243 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b225ed3d-69d6-4acf-9c71-b84b47624c8f tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:25.505132 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b225ed3d-69d6-4acf-9c71-b84b47624c8f tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:25.505756 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b225ed3d-69d6-4acf-9c71-b84b47624c8f tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:25.506347 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b225ed3d-69d6-4acf-9c71-b84b47624c8f tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:26.052522 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-0d04ac71-8797-4563-b96d-6464ad677209 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0445809b8ae242bb8b72fe37550589c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77e7aab450842cf8b27d62e76a06569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:12:26.063933 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-0d04ac71-8797-4563-b96d-6464ad677209 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] 10.222.0.60 "GET /compute/v2.1/servers/b697814f-f228-4d60-b62e-1677867aeb4b" status: 200 len: 1315 microversion: 2.1 time: 0.613927 Sep 14 09:12:26.064766 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2414/4801] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:12:25 2022] GET /compute/v2.1/servers/b697814f-f228-4d60-b62e-1677867aeb4b => generated 1315 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:12:26.079623 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-4c6055ee-0acf-4ec7-9937-3f297e349a72 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:12:26.080446 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-4c6055ee-0acf-4ec7-9937-3f297e349a72 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] [instance: a261d310-161f-4e77-a27a-7f377072cb2d] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:12:26.089433 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4c6055ee-0acf-4ec7-9937-3f297e349a72 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:26.095937 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4c6055ee-0acf-4ec7-9937-3f297e349a72 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:26.096647 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4c6055ee-0acf-4ec7-9937-3f297e349a72 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:26.097568 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4c6055ee-0acf-4ec7-9937-3f297e349a72 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:26.098199 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4c6055ee-0acf-4ec7-9937-3f297e349a72 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:26.099013 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4c6055ee-0acf-4ec7-9937-3f297e349a72 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:26.110348 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b225ed3d-69d6-4acf-9c71-b84b47624c8f tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:12:26.124792 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b225ed3d-69d6-4acf-9c71-b84b47624c8f tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105" status: 200 len: 1668 microversion: 2.1 time: 0.633112 Sep 14 09:12:26.125476 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2388/4802] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:12:25 2022] GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105 => generated 1668 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:12:26.206471 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-4c6055ee-0acf-4ec7-9937-3f297e349a72 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe73f3d7f4734e1ab9f6b7283db1388b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94e25a7caf946c2a80b874416e4906b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:12:26.216208 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c1364c68-ef6c-466c-846c-a1f39cdd95ba tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:12:26.217376 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-c1364c68-ef6c-466c-846c-a1f39cdd95ba tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:12:26.218319 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-4c6055ee-0acf-4ec7-9937-3f297e349a72 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] 10.222.0.60 "GET /compute/v2.1/servers/a261d310-161f-4e77-a27a-7f377072cb2d" status: 200 len: 1265 microversion: 2.1 time: 0.151770 Sep 14 09:12:26.222586 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2415/4803] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:12:26 2022] GET /compute/v2.1/servers/a261d310-161f-4e77-a27a-7f377072cb2d => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:12:26.236606 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c1364c68-ef6c-466c-846c-a1f39cdd95ba tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:26.236606 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c1364c68-ef6c-466c-846c-a1f39cdd95ba tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:26.236606 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c1364c68-ef6c-466c-846c-a1f39cdd95ba tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:26.236606 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c1364c68-ef6c-466c-846c-a1f39cdd95ba tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:26.236606 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c1364c68-ef6c-466c-846c-a1f39cdd95ba tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:26.236606 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c1364c68-ef6c-466c-846c-a1f39cdd95ba tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:26.850115 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-c1364c68-ef6c-466c-846c-a1f39cdd95ba tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:12:26.865432 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-c1364c68-ef6c-466c-846c-a1f39cdd95ba tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:12:26.869058 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-c1364c68-ef6c-466c-846c-a1f39cdd95ba tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:12:26.871389 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-c1364c68-ef6c-466c-846c-a1f39cdd95ba tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5" status: 200 len: 1807 microversion: 2.20 time: 0.658866 Sep 14 09:12:26.883001 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2389/4804] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:12:26 2022] GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5 => generated 1807 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 09:12:27.092949 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-bf111346-b84f-4f6e-8514-f17fec76e185 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:12:27.093710 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-bf111346-b84f-4f6e-8514-f17fec76e185 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] [instance: b697814f-f228-4d60-b62e-1677867aeb4b] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:12:27.112366 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bf111346-b84f-4f6e-8514-f17fec76e185 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:27.113160 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bf111346-b84f-4f6e-8514-f17fec76e185 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:27.113800 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bf111346-b84f-4f6e-8514-f17fec76e185 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:27.114828 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bf111346-b84f-4f6e-8514-f17fec76e185 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:27.115477 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bf111346-b84f-4f6e-8514-f17fec76e185 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:27.116072 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bf111346-b84f-4f6e-8514-f17fec76e185 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:27.251207 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-62f84f28-6296-45d0-968a-1dc9ab015ef1 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:12:27.251881 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-62f84f28-6296-45d0-968a-1dc9ab015ef1 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] [instance: a261d310-161f-4e77-a27a-7f377072cb2d] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:12:27.272246 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-62f84f28-6296-45d0-968a-1dc9ab015ef1 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:27.272246 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-62f84f28-6296-45d0-968a-1dc9ab015ef1 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:27.272246 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-62f84f28-6296-45d0-968a-1dc9ab015ef1 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:27.273132 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-62f84f28-6296-45d0-968a-1dc9ab015ef1 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:27.281007 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-62f84f28-6296-45d0-968a-1dc9ab015ef1 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:27.281459 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-62f84f28-6296-45d0-968a-1dc9ab015ef1 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:28.054907 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-bf111346-b84f-4f6e-8514-f17fec76e185 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0445809b8ae242bb8b72fe37550589c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77e7aab450842cf8b27d62e76a06569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:12:28.070513 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-bf111346-b84f-4f6e-8514-f17fec76e185 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] 10.222.0.60 "GET /compute/v2.1/servers/b697814f-f228-4d60-b62e-1677867aeb4b" status: 200 len: 1315 microversion: 2.1 time: 0.982613 Sep 14 09:12:28.078340 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2416/4805] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:12:27 2022] GET /compute/v2.1/servers/b697814f-f228-4d60-b62e-1677867aeb4b => generated 1315 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:12:28.090898 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-686e59af-8c94-4e6b-99ff-0976b8b626cb tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:12:28.094540 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-686e59af-8c94-4e6b-99ff-0976b8b626cb tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:12:28.113934 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-686e59af-8c94-4e6b-99ff-0976b8b626cb tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:28.116230 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-686e59af-8c94-4e6b-99ff-0976b8b626cb tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:28.116230 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-686e59af-8c94-4e6b-99ff-0976b8b626cb tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:28.116230 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-686e59af-8c94-4e6b-99ff-0976b8b626cb tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:28.131018 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-686e59af-8c94-4e6b-99ff-0976b8b626cb tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:28.134661 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-686e59af-8c94-4e6b-99ff-0976b8b626cb tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:28.233364 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-62f84f28-6296-45d0-968a-1dc9ab015ef1 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe73f3d7f4734e1ab9f6b7283db1388b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94e25a7caf946c2a80b874416e4906b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:12:28.273633 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-62f84f28-6296-45d0-968a-1dc9ab015ef1 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] 10.222.0.60 "GET /compute/v2.1/servers/a261d310-161f-4e77-a27a-7f377072cb2d" status: 200 len: 1313 microversion: 2.1 time: 1.027543 Sep 14 09:12:28.278129 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2390/4806] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:12:27 2022] GET /compute/v2.1/servers/a261d310-161f-4e77-a27a-7f377072cb2d => generated 1313 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:12:28.291355 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-f50c5896-d58a-4fa4-a464-8e99afbb5c0b req-437eb475-b2fd-4373-8285-1420e1a2a53a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b697814f-f228-4d60-b62e-1677867aeb4b", "tag": "64fba0b2-29e9-4ad8-99f8-dfadbf444b24"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:12:28.304553 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-f50c5896-d58a-4fa4-a464-8e99afbb5c0b req-437eb475-b2fd-4373-8285-1420e1a2a53a service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:28.305346 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-f50c5896-d58a-4fa4-a464-8e99afbb5c0b req-437eb475-b2fd-4373-8285-1420e1a2a53a service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:28.305989 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-f50c5896-d58a-4fa4-a464-8e99afbb5c0b req-437eb475-b2fd-4373-8285-1420e1a2a53a service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:28.324996 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-f50c5896-d58a-4fa4-a464-8e99afbb5c0b req-437eb475-b2fd-4373-8285-1420e1a2a53a service nova] Creating event network-changed:64fba0b2-29e9-4ad8-99f8-dfadbf444b24 for instance b697814f-f228-4d60-b62e-1677867aeb4b on n-h1-836830-18 Sep 14 09:12:28.330966 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-f50c5896-d58a-4fa4-a464-8e99afbb5c0b req-437eb475-b2fd-4373-8285-1420e1a2a53a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051344 Sep 14 09:12:28.332585 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2391/4807] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:12:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:12:29.074758 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-686e59af-8c94-4e6b-99ff-0976b8b626cb tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:12:29.103555 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-495fb52e-6fcb-49a8-b4b7-567116c085f6 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:12:29.104495 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-495fb52e-6fcb-49a8-b4b7-567116c085f6 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] [instance: b697814f-f228-4d60-b62e-1677867aeb4b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:12:29.112262 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-686e59af-8c94-4e6b-99ff-0976b8b626cb tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:12:29.115197 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-686e59af-8c94-4e6b-99ff-0976b8b626cb tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:12:29.122212 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-495fb52e-6fcb-49a8-b4b7-567116c085f6 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:29.123519 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-686e59af-8c94-4e6b-99ff-0976b8b626cb tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5" status: 200 len: 1807 microversion: 2.20 time: 1.040172 Sep 14 09:12:29.124531 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-495fb52e-6fcb-49a8-b4b7-567116c085f6 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:29.125170 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-495fb52e-6fcb-49a8-b4b7-567116c085f6 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:29.128032 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2417/4808] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:12:28 2022] GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5 => generated 1807 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:12:29.150742 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-495fb52e-6fcb-49a8-b4b7-567116c085f6 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:29.151922 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-495fb52e-6fcb-49a8-b4b7-567116c085f6 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:29.152725 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-495fb52e-6fcb-49a8-b4b7-567116c085f6 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:29.300205 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-3577e535-e4d5-46cc-b605-9fcca0f9b890 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:12:29.301148 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-3577e535-e4d5-46cc-b605-9fcca0f9b890 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] [instance: a261d310-161f-4e77-a27a-7f377072cb2d] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:12:29.327097 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3577e535-e4d5-46cc-b605-9fcca0f9b890 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:29.329203 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3577e535-e4d5-46cc-b605-9fcca0f9b890 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:29.329913 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3577e535-e4d5-46cc-b605-9fcca0f9b890 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:29.332334 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3577e535-e4d5-46cc-b605-9fcca0f9b890 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:29.333605 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3577e535-e4d5-46cc-b605-9fcca0f9b890 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:29.335954 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3577e535-e4d5-46cc-b605-9fcca0f9b890 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:29.356727 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:12:29.851724 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-495fb52e-6fcb-49a8-b4b7-567116c085f6 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0445809b8ae242bb8b72fe37550589c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77e7aab450842cf8b27d62e76a06569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:12:29.861327 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-495fb52e-6fcb-49a8-b4b7-567116c085f6 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] 10.222.0.60 "GET /compute/v2.1/servers/b697814f-f228-4d60-b62e-1677867aeb4b" status: 200 len: 1315 microversion: 2.1 time: 0.765890 Sep 14 09:12:29.862640 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2392/4809] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:12:29 2022] GET /compute/v2.1/servers/b697814f-f228-4d60-b62e-1677867aeb4b => generated 1315 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:12:29.867800 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-9e1e7d84-93fe-485c-a20b-1aa3e5cecc6d req-b0392b35-6546-4b2f-80ba-f5b49ba9caa9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5", "name": "network-vif-plugged", "status": "completed", "tag": "906bcc79-e290-4b18-8447-de06233392de"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:12:29.882722 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-9e1e7d84-93fe-485c-a20b-1aa3e5cecc6d req-b0392b35-6546-4b2f-80ba-f5b49ba9caa9 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:29.886193 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-9e1e7d84-93fe-485c-a20b-1aa3e5cecc6d req-b0392b35-6546-4b2f-80ba-f5b49ba9caa9 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:29.887001 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-9e1e7d84-93fe-485c-a20b-1aa3e5cecc6d req-b0392b35-6546-4b2f-80ba-f5b49ba9caa9 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:29.920341 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-9e1e7d84-93fe-485c-a20b-1aa3e5cecc6d req-b0392b35-6546-4b2f-80ba-f5b49ba9caa9 service nova] Creating event network-vif-plugged:906bcc79-e290-4b18-8447-de06233392de for instance 4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5 on n-h1-836830-18 Sep 14 09:12:29.929355 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-3577e535-e4d5-46cc-b605-9fcca0f9b890 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe73f3d7f4734e1ab9f6b7283db1388b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94e25a7caf946c2a80b874416e4906b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:12:29.942883 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-9e1e7d84-93fe-485c-a20b-1aa3e5cecc6d req-b0392b35-6546-4b2f-80ba-f5b49ba9caa9 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077005 Sep 14 09:12:29.943691 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-3577e535-e4d5-46cc-b605-9fcca0f9b890 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] 10.222.0.60 "GET /compute/v2.1/servers/a261d310-161f-4e77-a27a-7f377072cb2d" status: 200 len: 1355 microversion: 2.1 time: 0.648846 Sep 14 09:12:29.944907 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2418/4810] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:12:29 2022] GET /compute/v2.1/servers/a261d310-161f-4e77-a27a-7f377072cb2d => generated 1355 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:12:29.945117 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2393/4811] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:12:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:12:30.157671 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ddeab5f2-bae7-46ad-8952-6f1221ca785c tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:12:30.158365 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-ddeab5f2-bae7-46ad-8952-6f1221ca785c tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:12:30.166607 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ddeab5f2-bae7-46ad-8952-6f1221ca785c tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:30.167461 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ddeab5f2-bae7-46ad-8952-6f1221ca785c tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:30.167984 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ddeab5f2-bae7-46ad-8952-6f1221ca785c tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:30.168774 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ddeab5f2-bae7-46ad-8952-6f1221ca785c tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:30.169307 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ddeab5f2-bae7-46ad-8952-6f1221ca785c tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:30.169863 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ddeab5f2-bae7-46ad-8952-6f1221ca785c tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:30.532038 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-afa304cd-089f-4b70-9642-e32ea68f7b73 req-8b74d14c-9495-4c65-a2ef-c9f413c21c28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a261d310-161f-4e77-a27a-7f377072cb2d", "tag": "1f9300a0-b0f7-400b-bf70-95c2a598e0ea"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:12:30.559021 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-afa304cd-089f-4b70-9642-e32ea68f7b73 req-8b74d14c-9495-4c65-a2ef-c9f413c21c28 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:30.559953 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-afa304cd-089f-4b70-9642-e32ea68f7b73 req-8b74d14c-9495-4c65-a2ef-c9f413c21c28 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:30.561235 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-afa304cd-089f-4b70-9642-e32ea68f7b73 req-8b74d14c-9495-4c65-a2ef-c9f413c21c28 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:30.590078 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-afa304cd-089f-4b70-9642-e32ea68f7b73 req-8b74d14c-9495-4c65-a2ef-c9f413c21c28 service nova] Creating event network-changed:1f9300a0-b0f7-400b-bf70-95c2a598e0ea for instance a261d310-161f-4e77-a27a-7f377072cb2d on n-h2-836830-18 Sep 14 09:12:30.599314 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-afa304cd-089f-4b70-9642-e32ea68f7b73 req-8b74d14c-9495-4c65-a2ef-c9f413c21c28 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072729 Sep 14 09:12:30.600242 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2394/4812] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:12:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:12:30.887907 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a4503d7a-9237-4ee5-a5d6-70d372d0f093 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:12:30.888687 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-a4503d7a-9237-4ee5-a5d6-70d372d0f093 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] [instance: b697814f-f228-4d60-b62e-1677867aeb4b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:12:30.908773 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a4503d7a-9237-4ee5-a5d6-70d372d0f093 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:30.909623 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a4503d7a-9237-4ee5-a5d6-70d372d0f093 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:30.910269 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a4503d7a-9237-4ee5-a5d6-70d372d0f093 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:30.911255 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a4503d7a-9237-4ee5-a5d6-70d372d0f093 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:30.911904 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a4503d7a-9237-4ee5-a5d6-70d372d0f093 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:30.912512 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a4503d7a-9237-4ee5-a5d6-70d372d0f093 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:31.213565 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-ddeab5f2-bae7-46ad-8952-6f1221ca785c tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:12:31.227851 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-ddeab5f2-bae7-46ad-8952-6f1221ca785c tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:12:31.229369 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-ddeab5f2-bae7-46ad-8952-6f1221ca785c tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:12:31.244307 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-ddeab5f2-bae7-46ad-8952-6f1221ca785c tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5" status: 200 len: 1807 microversion: 2.20 time: 1.091609 Sep 14 09:12:31.259347 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2419/4813] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:12:30 2022] GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5 => generated 1807 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:12:31.270289 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ce51aa3b-1e31-4f5f-9879-a5621db92fae tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:12:31.271226 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-ce51aa3b-1e31-4f5f-9879-a5621db92fae tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] [instance: a261d310-161f-4e77-a27a-7f377072cb2d] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:12:31.282518 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ce51aa3b-1e31-4f5f-9879-a5621db92fae tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:31.283346 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ce51aa3b-1e31-4f5f-9879-a5621db92fae tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:31.284120 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ce51aa3b-1e31-4f5f-9879-a5621db92fae tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:31.285075 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ce51aa3b-1e31-4f5f-9879-a5621db92fae tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:31.289302 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ce51aa3b-1e31-4f5f-9879-a5621db92fae tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:31.289954 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ce51aa3b-1e31-4f5f-9879-a5621db92fae tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:31.568270 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-a4503d7a-9237-4ee5-a5d6-70d372d0f093 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0445809b8ae242bb8b72fe37550589c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77e7aab450842cf8b27d62e76a06569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:12:31.585755 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a4503d7a-9237-4ee5-a5d6-70d372d0f093 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] 10.222.0.60 "GET /compute/v2.1/servers/b697814f-f228-4d60-b62e-1677867aeb4b" status: 200 len: 1315 microversion: 2.1 time: 0.699939 Sep 14 09:12:31.589598 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2395/4814] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:12:30 2022] GET /compute/v2.1/servers/b697814f-f228-4d60-b62e-1677867aeb4b => generated 1315 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:12:31.827697 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-ce51aa3b-1e31-4f5f-9879-a5621db92fae tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe73f3d7f4734e1ab9f6b7283db1388b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94e25a7caf946c2a80b874416e4906b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:12:31.846716 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-ce51aa3b-1e31-4f5f-9879-a5621db92fae tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] 10.222.0.60 "GET /compute/v2.1/servers/a261d310-161f-4e77-a27a-7f377072cb2d" status: 200 len: 1355 microversion: 2.1 time: 0.586171 Sep 14 09:12:31.853711 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2420/4815] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:12:31 2022] GET /compute/v2.1/servers/a261d310-161f-4e77-a27a-7f377072cb2d => generated 1355 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:12:32.276915 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d174c574-b854-48a3-a4d6-1e967e02ffaf tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:12:32.278206 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-d174c574-b854-48a3-a4d6-1e967e02ffaf tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:12:32.285945 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d174c574-b854-48a3-a4d6-1e967e02ffaf tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:32.288540 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d174c574-b854-48a3-a4d6-1e967e02ffaf tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:32.289157 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d174c574-b854-48a3-a4d6-1e967e02ffaf tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:32.290760 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d174c574-b854-48a3-a4d6-1e967e02ffaf tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:32.291908 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d174c574-b854-48a3-a4d6-1e967e02ffaf tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:32.292515 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d174c574-b854-48a3-a4d6-1e967e02ffaf tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:32.550511 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-d174c574-b854-48a3-a4d6-1e967e02ffaf tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:12:32.568900 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-d174c574-b854-48a3-a4d6-1e967e02ffaf tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:12:32.570818 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-d174c574-b854-48a3-a4d6-1e967e02ffaf tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:12:32.575453 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d174c574-b854-48a3-a4d6-1e967e02ffaf tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5" status: 200 len: 1807 microversion: 2.20 time: 0.302730 Sep 14 09:12:32.591369 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2396/4816] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:12:32 2022] GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5 => generated 1807 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:12:32.611249 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-0a4d3a5d-f435-413b-99ae-862f675c464a tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:12:32.612025 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-0a4d3a5d-f435-413b-99ae-862f675c464a tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] [instance: b697814f-f228-4d60-b62e-1677867aeb4b] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:12:32.625342 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0a4d3a5d-f435-413b-99ae-862f675c464a tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:32.626079 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0a4d3a5d-f435-413b-99ae-862f675c464a tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:32.627226 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0a4d3a5d-f435-413b-99ae-862f675c464a tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:32.628074 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0a4d3a5d-f435-413b-99ae-862f675c464a tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:32.630706 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0a4d3a5d-f435-413b-99ae-862f675c464a tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:32.631286 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0a4d3a5d-f435-413b-99ae-862f675c464a tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:32.641455 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-37092bc3-8ac7-47c7-9405-9ce8299dd78c req-f507be77-83f4-47b1-b263-82d518bc288e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a261d310-161f-4e77-a27a-7f377072cb2d", "tag": "3dd9f84d-f03d-4653-8593-72b1bfb59713"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:12:32.659547 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-37092bc3-8ac7-47c7-9405-9ce8299dd78c req-f507be77-83f4-47b1-b263-82d518bc288e service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:32.660332 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-37092bc3-8ac7-47c7-9405-9ce8299dd78c req-f507be77-83f4-47b1-b263-82d518bc288e service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:32.661151 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-37092bc3-8ac7-47c7-9405-9ce8299dd78c req-f507be77-83f4-47b1-b263-82d518bc288e service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:32.690632 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-37092bc3-8ac7-47c7-9405-9ce8299dd78c req-f507be77-83f4-47b1-b263-82d518bc288e service nova] Creating event network-changed:3dd9f84d-f03d-4653-8593-72b1bfb59713 for instance a261d310-161f-4e77-a27a-7f377072cb2d on n-h2-836830-18 Sep 14 09:12:32.703366 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-37092bc3-8ac7-47c7-9405-9ce8299dd78c req-f507be77-83f4-47b1-b263-82d518bc288e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066920 Sep 14 09:12:32.704717 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2397/4817] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:12:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:12:32.876257 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3bd28b93-0e08-4439-8774-ae18d2fb1d6a tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:12:32.877260 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-3bd28b93-0e08-4439-8774-ae18d2fb1d6a tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] [instance: a261d310-161f-4e77-a27a-7f377072cb2d] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:12:32.890967 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3bd28b93-0e08-4439-8774-ae18d2fb1d6a tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:32.891623 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3bd28b93-0e08-4439-8774-ae18d2fb1d6a tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:32.892180 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3bd28b93-0e08-4439-8774-ae18d2fb1d6a tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:32.893015 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3bd28b93-0e08-4439-8774-ae18d2fb1d6a tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:32.893579 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3bd28b93-0e08-4439-8774-ae18d2fb1d6a tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:32.897381 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3bd28b93-0e08-4439-8774-ae18d2fb1d6a tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:33.322600 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-0a4d3a5d-f435-413b-99ae-862f675c464a tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0445809b8ae242bb8b72fe37550589c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77e7aab450842cf8b27d62e76a06569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:12:33.348267 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-0a4d3a5d-f435-413b-99ae-862f675c464a tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] 10.222.0.60 "GET /compute/v2.1/servers/b697814f-f228-4d60-b62e-1677867aeb4b" status: 200 len: 1315 microversion: 2.1 time: 0.739857 Sep 14 09:12:33.350075 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2421/4818] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:12:32 2022] GET /compute/v2.1/servers/b697814f-f228-4d60-b62e-1677867aeb4b => generated 1315 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:12:33.613349 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1c8f6fd8-e6c2-462a-8776-fc3a9778b787 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:12:33.614313 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-1c8f6fd8-e6c2-462a-8776-fc3a9778b787 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:12:33.621926 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1c8f6fd8-e6c2-462a-8776-fc3a9778b787 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:33.622721 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1c8f6fd8-e6c2-462a-8776-fc3a9778b787 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:33.623856 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1c8f6fd8-e6c2-462a-8776-fc3a9778b787 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:33.624704 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1c8f6fd8-e6c2-462a-8776-fc3a9778b787 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:33.625391 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1c8f6fd8-e6c2-462a-8776-fc3a9778b787 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:33.625940 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1c8f6fd8-e6c2-462a-8776-fc3a9778b787 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:33.873436 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=4 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:12:33.955138 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=14 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:12:34.072971 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-3bd28b93-0e08-4439-8774-ae18d2fb1d6a tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe73f3d7f4734e1ab9f6b7283db1388b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94e25a7caf946c2a80b874416e4906b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:12:34.085986 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-3bd28b93-0e08-4439-8774-ae18d2fb1d6a tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] 10.222.0.60 "GET /compute/v2.1/servers/a261d310-161f-4e77-a27a-7f377072cb2d" status: 200 len: 1355 microversion: 2.1 time: 1.213996 Sep 14 09:12:34.089269 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2398/4819] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:12:32 2022] GET /compute/v2.1/servers/a261d310-161f-4e77-a27a-7f377072cb2d => generated 1355 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:12:34.345089 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-1c8f6fd8-e6c2-462a-8776-fc3a9778b787 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:12:34.356734 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-1c8f6fd8-e6c2-462a-8776-fc3a9778b787 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:12:34.358769 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-1c8f6fd8-e6c2-462a-8776-fc3a9778b787 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:12:34.360695 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-1c8f6fd8-e6c2-462a-8776-fc3a9778b787 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5" status: 200 len: 1807 microversion: 2.20 time: 0.762108 Sep 14 09:12:34.361488 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2422/4820] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:12:33 2022] GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5 => generated 1807 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:12:34.385732 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-dc53d6e7-70aa-471a-931c-d45d77157891 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:12:34.386585 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-dc53d6e7-70aa-471a-931c-d45d77157891 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] [instance: b697814f-f228-4d60-b62e-1677867aeb4b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:12:34.398796 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dc53d6e7-70aa-471a-931c-d45d77157891 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:34.401750 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dc53d6e7-70aa-471a-931c-d45d77157891 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:34.403486 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dc53d6e7-70aa-471a-931c-d45d77157891 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:34.405563 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dc53d6e7-70aa-471a-931c-d45d77157891 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:34.406287 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dc53d6e7-70aa-471a-931c-d45d77157891 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:34.408297 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dc53d6e7-70aa-471a-931c-d45d77157891 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:34.723960 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-c84a7604-24e4-4cc7-b845-1ee4a3ff2feb req-9b4f92f3-838f-4171-bbc7-49eda8bb5615 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a261d310-161f-4e77-a27a-7f377072cb2d", "tag": "266a5c2c-484a-48bd-bbfb-983712ba55e6"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:12:34.736642 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=2 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:12:34.775838 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-c84a7604-24e4-4cc7-b845-1ee4a3ff2feb req-9b4f92f3-838f-4171-bbc7-49eda8bb5615 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:34.776329 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-c84a7604-24e4-4cc7-b845-1ee4a3ff2feb req-9b4f92f3-838f-4171-bbc7-49eda8bb5615 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:34.776951 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-c84a7604-24e4-4cc7-b845-1ee4a3ff2feb req-9b4f92f3-838f-4171-bbc7-49eda8bb5615 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:34.812897 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-c84a7604-24e4-4cc7-b845-1ee4a3ff2feb req-9b4f92f3-838f-4171-bbc7-49eda8bb5615 service nova] Creating event network-changed:266a5c2c-484a-48bd-bbfb-983712ba55e6 for instance a261d310-161f-4e77-a27a-7f377072cb2d on n-h2-836830-18 Sep 14 09:12:34.820812 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-c84a7604-24e4-4cc7-b845-1ee4a3ff2feb req-9b4f92f3-838f-4171-bbc7-49eda8bb5615 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101443 Sep 14 09:12:34.828482 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2423/4821] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:12:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:12:34.900267 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-dc53d6e7-70aa-471a-931c-d45d77157891 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0445809b8ae242bb8b72fe37550589c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77e7aab450842cf8b27d62e76a06569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:12:34.912915 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-dc53d6e7-70aa-471a-931c-d45d77157891 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] 10.222.0.60 "GET /compute/v2.1/servers/b697814f-f228-4d60-b62e-1677867aeb4b" status: 200 len: 1315 microversion: 2.1 time: 0.530165 Sep 14 09:12:34.913535 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2399/4822] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:12:34 2022] GET /compute/v2.1/servers/b697814f-f228-4d60-b62e-1677867aeb4b => generated 1315 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:12:35.116760 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-406581f9-2476-4df6-a9f1-d2174c11ebd5 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:12:35.126076 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-406581f9-2476-4df6-a9f1-d2174c11ebd5 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] [instance: a261d310-161f-4e77-a27a-7f377072cb2d] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:12:35.143111 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-406581f9-2476-4df6-a9f1-d2174c11ebd5 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:35.145230 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-406581f9-2476-4df6-a9f1-d2174c11ebd5 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:35.145966 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-406581f9-2476-4df6-a9f1-d2174c11ebd5 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:35.149204 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-406581f9-2476-4df6-a9f1-d2174c11ebd5 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:35.150622 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-406581f9-2476-4df6-a9f1-d2174c11ebd5 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:35.151405 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-406581f9-2476-4df6-a9f1-d2174c11ebd5 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:35.390398 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e5c56c01-3097-472b-b93c-51f6d09d1b74 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:12:35.399068 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e5c56c01-3097-472b-b93c-51f6d09d1b74 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:12:35.415390 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e5c56c01-3097-472b-b93c-51f6d09d1b74 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:35.416777 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e5c56c01-3097-472b-b93c-51f6d09d1b74 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:35.417613 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e5c56c01-3097-472b-b93c-51f6d09d1b74 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:35.418529 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e5c56c01-3097-472b-b93c-51f6d09d1b74 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:35.419209 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e5c56c01-3097-472b-b93c-51f6d09d1b74 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:35.420003 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e5c56c01-3097-472b-b93c-51f6d09d1b74 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:35.915476 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-406581f9-2476-4df6-a9f1-d2174c11ebd5 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe73f3d7f4734e1ab9f6b7283db1388b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94e25a7caf946c2a80b874416e4906b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:12:35.932945 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-406581f9-2476-4df6-a9f1-d2174c11ebd5 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] 10.222.0.60 "GET /compute/v2.1/servers/a261d310-161f-4e77-a27a-7f377072cb2d" status: 200 len: 1355 microversion: 2.1 time: 0.826519 Sep 14 09:12:35.936566 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2424/4823] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:12:35 2022] GET /compute/v2.1/servers/a261d310-161f-4e77-a27a-7f377072cb2d => generated 1355 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:12:35.957658 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-cdef7b43-499f-4fda-9d87-de76f03e7f8a tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:12:35.958685 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-cdef7b43-499f-4fda-9d87-de76f03e7f8a tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] [instance: b697814f-f228-4d60-b62e-1677867aeb4b] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:12:35.966432 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cdef7b43-499f-4fda-9d87-de76f03e7f8a tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:35.967756 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cdef7b43-499f-4fda-9d87-de76f03e7f8a tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:35.968490 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cdef7b43-499f-4fda-9d87-de76f03e7f8a tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:35.969705 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cdef7b43-499f-4fda-9d87-de76f03e7f8a tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:35.970470 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cdef7b43-499f-4fda-9d87-de76f03e7f8a tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:35.971518 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cdef7b43-499f-4fda-9d87-de76f03e7f8a tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:36.323227 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-e5c56c01-3097-472b-b93c-51f6d09d1b74 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:12:36.331302 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:12:36.335888 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-e5c56c01-3097-472b-b93c-51f6d09d1b74 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:12:36.337614 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-e5c56c01-3097-472b-b93c-51f6d09d1b74 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:12:36.339457 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e5c56c01-3097-472b-b93c-51f6d09d1b74 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5" status: 200 len: 1794 microversion: 2.20 time: 0.953369 Sep 14 09:12:36.340696 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2400/4824] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:12:35 2022] GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5 => generated 1794 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:12:36.538230 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-cdef7b43-499f-4fda-9d87-de76f03e7f8a tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0445809b8ae242bb8b72fe37550589c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77e7aab450842cf8b27d62e76a06569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:12:36.556699 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-cdef7b43-499f-4fda-9d87-de76f03e7f8a tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] 10.222.0.60 "GET /compute/v2.1/servers/b697814f-f228-4d60-b62e-1677867aeb4b" status: 200 len: 1315 microversion: 2.1 time: 0.618546 Sep 14 09:12:36.557893 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2425/4825] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:12:35 2022] GET /compute/v2.1/servers/b697814f-f228-4d60-b62e-1677867aeb4b => generated 1315 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:12:36.974160 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-5b39fa11-f0e1-4f3a-812d-12928d4d4f0d tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:12:36.975124 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-5b39fa11-f0e1-4f3a-812d-12928d4d4f0d tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] [instance: a261d310-161f-4e77-a27a-7f377072cb2d] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:12:36.984915 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5b39fa11-f0e1-4f3a-812d-12928d4d4f0d tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:36.985722 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5b39fa11-f0e1-4f3a-812d-12928d4d4f0d tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:36.986455 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5b39fa11-f0e1-4f3a-812d-12928d4d4f0d tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:36.987389 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5b39fa11-f0e1-4f3a-812d-12928d4d4f0d tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:36.988030 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5b39fa11-f0e1-4f3a-812d-12928d4d4f0d tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:36.988633 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5b39fa11-f0e1-4f3a-812d-12928d4d4f0d tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:37.007789 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-55d00f8a-1d3f-49c9-8f94-f7da9c7ba531 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:12:37.008297 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-55d00f8a-1d3f-49c9-8f94-f7da9c7ba531 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [instance: b13cd01f-fa9b-4d21-a1f9-4f7745dbbe37] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:12:37.034220 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-55d00f8a-1d3f-49c9-8f94-f7da9c7ba531 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:37.034722 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-55d00f8a-1d3f-49c9-8f94-f7da9c7ba531 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:37.047365 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-55d00f8a-1d3f-49c9-8f94-f7da9c7ba531 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:37.048673 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-55d00f8a-1d3f-49c9-8f94-f7da9c7ba531 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:37.050747 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-55d00f8a-1d3f-49c9-8f94-f7da9c7ba531 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:37.051430 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-55d00f8a-1d3f-49c9-8f94-f7da9c7ba531 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:37.082993 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-55d00f8a-1d3f-49c9-8f94-f7da9c7ba531 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "GET /compute/v2.1/servers/b13cd01f-fa9b-4d21-a1f9-4f7745dbbe37/ips" status: 200 len: 149 microversion: 2.1 time: 0.079112 Sep 14 09:12:37.085109 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2426/4826] 10.222.0.60 () {58 vars in 1248 bytes} [Wed Sep 14 09:12:37 2022] GET /compute/v2.1/servers/b13cd01f-fa9b-4d21-a1f9-4f7745dbbe37/ips => generated 149 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:12:37.097801 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-3ba54cab-5ac0-48fd-921a-08b1bd4e956e tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dd4d6708-1fdb-4ad3-8f19-e6f38c2a9664"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:12:37.100656 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-3ba54cab-5ac0-48fd-921a-08b1bd4e956e tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [instance: b13cd01f-fa9b-4d21-a1f9-4f7745dbbe37] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:12:37.106888 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3ba54cab-5ac0-48fd-921a-08b1bd4e956e tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:37.108297 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3ba54cab-5ac0-48fd-921a-08b1bd4e956e tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:37.108897 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3ba54cab-5ac0-48fd-921a-08b1bd4e956e tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:37.109781 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3ba54cab-5ac0-48fd-921a-08b1bd4e956e tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:37.110238 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3ba54cab-5ac0-48fd-921a-08b1bd4e956e tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:37.110670 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3ba54cab-5ac0-48fd-921a-08b1bd4e956e tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:37.209143 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-3ba54cab-5ac0-48fd-921a-08b1bd4e956e tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] HTTP exception thrown: Invalid volume: volume dd4d6708-1fdb-4ad3-8f19-e6f38c2a9664 is already attached to instances: 81ad242a-93d0-4f76-a6f1-e02e5e537e95 Sep 14 09:12:37.211425 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-3ba54cab-5ac0-48fd-921a-08b1bd4e956e tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Request method failure captured: Sep 14 09:12:37.211425 n-d-836830-18 devstack@n-api.service[128758]: request: POST /compute/v2.1/servers/b13cd01f-fa9b-4d21-a1f9-4f7745dbbe37/os-volume_attachments HTTP/1.1 Sep 14 09:12:37.211425 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 09:12:37.211425 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 09:12:37.211425 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 09:12:37.211425 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 74 Sep 14 09:12:37.211425 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 09:12:37.211425 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 09:12:37.211425 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 09:12:37.211425 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 09:12:37.211425 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZplAooet3f0j7YfTn10UjWWncQT1X8Zx5oRj6ix43s3Uyu8Vx6JxK5zNIVmYD3adrXMKIf-yKfD6YAxNfiXzTvsjQqMQGw8jI4-W3D7BlestqvRpahzOMSDEzmtF5nK9S-Py3GvFBoobDIQWLv-aBhO1lijqGds4gt8aJhEwjvOnnU Sep 14 09:12:37.211425 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 09:12:37.211425 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 09:12:37.211425 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 09:12:37.211425 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 09:12:37.211425 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 09:12:37.211425 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 09:12:37.211425 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 9672a6c416ee44289eaa4d7c664d307e Sep 14 09:12:37.211425 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-AttachVolumeNegativeTest-1303332785 Sep 14 09:12:37.211425 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 09:12:37.211425 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 09:12:37.211425 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/9672a6c416ee44289eaa4d7c664d307e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_9672a6c416ee44289eaa4d7c664d307e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9672a6c416ee44289eaa4d7c664d307e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9672a6c416ee44289eaa4d7c664d307e"}]}] Sep 14 09:12:37.211425 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-AttachVolumeNegativeTest-1303332785 Sep 14 09:12:37.211425 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 9672a6c416ee44289eaa4d7c664d307e Sep 14 09:12:37.211425 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1303332785 Sep 14 09:12:37.211425 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-AttachVolumeNegativeTest-1303332785-project Sep 14 09:12:37.211425 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 09:12:37.211425 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 09:12:37.211425 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 7daab4f69af5452c8641006d9f09edce Sep 14 09:12:37.211425 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-AttachVolumeNegativeTest-1303332785-project Sep 14 09:12:37.211425 n-d-836830-18 devstack@n-api.service[128758]: Sep 14 09:12:37.211425 n-d-836830-18 devstack@n-api.service[128758]: {"volumeAttachment": {"volumeId": "dd4d6708-1fdb-4ad3-8f19-e6f38c2a9664"}} Sep 14 09:12:37.211425 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 09:12:37.211425 n-d-836830-18 devstack@n-api.service[128758]: exception: Invalid volume: volume dd4d6708-1fdb-4ad3-8f19-e6f38c2a9664 is already attached to instances: 81ad242a-93d0-4f76-a6f1-e02e5e537e95 Sep 14 09:12:37.211425 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'server_id': 'b13cd01f-fa9b-4d21-a1f9-4f7745dbbe37', 'body': {'volumeAttachment': {'volumeId': 'dd4d6708-1fdb-4ad3-8f19-e6f38c2a9664'}}} Sep 14 09:12:37.211425 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:12:37.211425 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:12:37.211425 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 14 09:12:37.211425 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 14 09:12:37.211425 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 14 09:12:37.211425 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 14 09:12:37.211425 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 14 09:12:37.211425 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 14 09:12:37.211425 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 14 09:12:37.211425 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 14 09:12:37.211425 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 14 09:12:37.211425 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 14 09:12:37.211425 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume dd4d6708-1fdb-4ad3-8f19-e6f38c2a9664 is already attached to instances: 81ad242a-93d0-4f76-a6f1-e02e5e537e95 Sep 14 09:12:37.211425 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:12:37.211425 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:12:37.211425 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:12:37.211425 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:12:37.211425 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:12:37.211425 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:12:37.211425 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:12:37.211425 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:12:37.211425 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:12:37.211425 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:12:37.211425 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:12:37.211425 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:12:37.211425 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:12:37.211425 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:12:37.216798 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:12:37.216798 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:12:37.216798 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 14 09:12:37.216798 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 14 09:12:37.216798 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume dd4d6708-1fdb-4ad3-8f19-e6f38c2a9664 is already attached to instances: 81ad242a-93d0-4f76-a6f1-e02e5e537e95 Sep 14 09:12:37.216798 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:12:37.216798 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:12:37.216798 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:12:37.216798 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:12:37.216798 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:12:37.216798 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:12:37.216798 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:12:37.216798 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:12:37.216798 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume dd4d6708-1fdb-4ad3-8f19-e6f38c2a9664 is already attached to instances: 81ad242a-93d0-4f76-a6f1-e02e5e537e95 Sep 14 09:12:37.216798 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:12:37.219361 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-3ba54cab-5ac0-48fd-921a-08b1bd4e956e tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Returning 400 to user: Invalid volume: volume dd4d6708-1fdb-4ad3-8f19-e6f38c2a9664 is already attached to instances: 81ad242a-93d0-4f76-a6f1-e02e5e537e95 {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:12:37.220468 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-3ba54cab-5ac0-48fd-921a-08b1bd4e956e tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "POST /compute/v2.1/servers/b13cd01f-fa9b-4d21-a1f9-4f7745dbbe37/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.126882 Sep 14 09:12:37.224655 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2427/4827] 10.222.0.60 () {60 vars in 1323 bytes} [Wed Sep 14 09:12:37 2022] POST /compute/v2.1/servers/b13cd01f-fa9b-4d21-a1f9-4f7745dbbe37/os-volume_attachments => generated 174 bytes in 131 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 14 09:12:37.230180 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-8e2dabc6-45ac-4234-9139-2902372ba570 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:12:37.231004 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-8e2dabc6-45ac-4234-9139-2902372ba570 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [instance: b13cd01f-fa9b-4d21-a1f9-4f7745dbbe37] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:12:37.238542 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8e2dabc6-45ac-4234-9139-2902372ba570 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:37.239496 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8e2dabc6-45ac-4234-9139-2902372ba570 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:37.240115 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8e2dabc6-45ac-4234-9139-2902372ba570 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:37.241002 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8e2dabc6-45ac-4234-9139-2902372ba570 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:37.241649 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8e2dabc6-45ac-4234-9139-2902372ba570 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:37.242239 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8e2dabc6-45ac-4234-9139-2902372ba570 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:37.278131 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-8e2dabc6-45ac-4234-9139-2902372ba570 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [instance: b13cd01f-fa9b-4d21-a1f9-4f7745dbbe37] Going to try to terminate instance {{(pid=128758) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:12:37.376839 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-8e2dabc6-45ac-4234-9139-2902372ba570 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "DELETE /compute/v2.1/servers/b13cd01f-fa9b-4d21-a1f9-4f7745dbbe37" status: 204 len: 0 microversion: 2.1 time: 0.150439 Sep 14 09:12:37.381170 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2428/4828] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:12:37 2022] DELETE /compute/v2.1/servers/b13cd01f-fa9b-4d21-a1f9-4f7745dbbe37 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:12:37.387996 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-dd4a66b4-0dc8-43f5-a7f4-14bd43e96147 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:12:37.389096 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-dd4a66b4-0dc8-43f5-a7f4-14bd43e96147 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [instance: b13cd01f-fa9b-4d21-a1f9-4f7745dbbe37] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:12:37.395683 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dd4a66b4-0dc8-43f5-a7f4-14bd43e96147 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:37.397002 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dd4a66b4-0dc8-43f5-a7f4-14bd43e96147 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:37.397856 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dd4a66b4-0dc8-43f5-a7f4-14bd43e96147 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:37.398855 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dd4a66b4-0dc8-43f5-a7f4-14bd43e96147 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:37.399508 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dd4a66b4-0dc8-43f5-a7f4-14bd43e96147 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:37.400096 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dd4a66b4-0dc8-43f5-a7f4-14bd43e96147 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:37.457823 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-5b39fa11-f0e1-4f3a-812d-12928d4d4f0d tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe73f3d7f4734e1ab9f6b7283db1388b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94e25a7caf946c2a80b874416e4906b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:12:37.475212 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-5b39fa11-f0e1-4f3a-812d-12928d4d4f0d tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] 10.222.0.60 "GET /compute/v2.1/servers/a261d310-161f-4e77-a27a-7f377072cb2d" status: 200 len: 1355 microversion: 2.1 time: 0.515728 Sep 14 09:12:37.491300 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2401/4829] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:12:36 2022] GET /compute/v2.1/servers/a261d310-161f-4e77-a27a-7f377072cb2d => generated 1355 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:12:37.587243 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b41b02d6-d0f7-4699-9aec-34e919b53fa9 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:12:37.594423 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b41b02d6-d0f7-4699-9aec-34e919b53fa9 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] [instance: b697814f-f228-4d60-b62e-1677867aeb4b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:12:37.606804 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b41b02d6-d0f7-4699-9aec-34e919b53fa9 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:37.608301 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b41b02d6-d0f7-4699-9aec-34e919b53fa9 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:37.610366 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b41b02d6-d0f7-4699-9aec-34e919b53fa9 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:37.611521 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b41b02d6-d0f7-4699-9aec-34e919b53fa9 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:37.612259 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b41b02d6-d0f7-4699-9aec-34e919b53fa9 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:37.612860 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b41b02d6-d0f7-4699-9aec-34e919b53fa9 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:37.677432 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-dd4a66b4-0dc8-43f5-a7f4-14bd43e96147 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daab4f69af5452c8641006d9f09edce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9672a6c416ee44289eaa4d7c664d307e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:12:37.686216 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-dd4a66b4-0dc8-43f5-a7f4-14bd43e96147 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "GET /compute/v2.1/servers/b13cd01f-fa9b-4d21-a1f9-4f7745dbbe37" status: 200 len: 1680 microversion: 2.1 time: 0.303024 Sep 14 09:12:37.686820 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2429/4830] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:12:37 2022] GET /compute/v2.1/servers/b13cd01f-fa9b-4d21-a1f9-4f7745dbbe37 => generated 1680 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:12:37.892950 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-ffbeb5b9-39c9-4aeb-aa90-52c4c5a37e18 req-b8708d48-49ba-4250-9360-567726d95bc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b697814f-f228-4d60-b62e-1677867aeb4b", "name": "network-vif-plugged", "status": "completed", "tag": "64fba0b2-29e9-4ad8-99f8-dfadbf444b24"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:12:37.910694 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-ffbeb5b9-39c9-4aeb-aa90-52c4c5a37e18 req-b8708d48-49ba-4250-9360-567726d95bc5 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:37.915084 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-ffbeb5b9-39c9-4aeb-aa90-52c4c5a37e18 req-b8708d48-49ba-4250-9360-567726d95bc5 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:37.915893 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-ffbeb5b9-39c9-4aeb-aa90-52c4c5a37e18 req-b8708d48-49ba-4250-9360-567726d95bc5 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:37.932977 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-ffbeb5b9-39c9-4aeb-aa90-52c4c5a37e18 req-b8708d48-49ba-4250-9360-567726d95bc5 service nova] Creating event network-vif-plugged:64fba0b2-29e9-4ad8-99f8-dfadbf444b24 for instance b697814f-f228-4d60-b62e-1677867aeb4b on n-h1-836830-18 Sep 14 09:12:37.958054 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-ffbeb5b9-39c9-4aeb-aa90-52c4c5a37e18 req-b8708d48-49ba-4250-9360-567726d95bc5 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075695 Sep 14 09:12:37.960050 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2430/4831] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:12:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:12:37.981055 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b41b02d6-d0f7-4699-9aec-34e919b53fa9 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0445809b8ae242bb8b72fe37550589c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77e7aab450842cf8b27d62e76a06569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:12:37.995140 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b41b02d6-d0f7-4699-9aec-34e919b53fa9 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] 10.222.0.60 "GET /compute/v2.1/servers/b697814f-f228-4d60-b62e-1677867aeb4b" status: 200 len: 1315 microversion: 2.1 time: 0.417376 Sep 14 09:12:37.999338 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2402/4832] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:12:37 2022] GET /compute/v2.1/servers/b697814f-f228-4d60-b62e-1677867aeb4b => generated 1315 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:12:38.503447 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-69b5115a-f574-4230-a3ad-b12fd059d9f7 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:12:38.504385 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-69b5115a-f574-4230-a3ad-b12fd059d9f7 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] [instance: a261d310-161f-4e77-a27a-7f377072cb2d] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:12:38.524390 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-69b5115a-f574-4230-a3ad-b12fd059d9f7 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:38.536065 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-69b5115a-f574-4230-a3ad-b12fd059d9f7 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:38.538206 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-69b5115a-f574-4230-a3ad-b12fd059d9f7 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:38.539405 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-69b5115a-f574-4230-a3ad-b12fd059d9f7 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:38.540122 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-69b5115a-f574-4230-a3ad-b12fd059d9f7 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:38.540980 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-69b5115a-f574-4230-a3ad-b12fd059d9f7 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:38.710715 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e1d5212c-9fd7-4c80-9844-1fbbacfa4f8f tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:12:38.711850 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e1d5212c-9fd7-4c80-9844-1fbbacfa4f8f tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [instance: b13cd01f-fa9b-4d21-a1f9-4f7745dbbe37] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:12:38.723760 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e1d5212c-9fd7-4c80-9844-1fbbacfa4f8f tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:38.725725 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e1d5212c-9fd7-4c80-9844-1fbbacfa4f8f tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:38.726189 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e1d5212c-9fd7-4c80-9844-1fbbacfa4f8f tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:38.729116 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e1d5212c-9fd7-4c80-9844-1fbbacfa4f8f tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:38.729689 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e1d5212c-9fd7-4c80-9844-1fbbacfa4f8f tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:38.730252 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e1d5212c-9fd7-4c80-9844-1fbbacfa4f8f tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:39.026607 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-69b5115a-f574-4230-a3ad-b12fd059d9f7 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe73f3d7f4734e1ab9f6b7283db1388b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94e25a7caf946c2a80b874416e4906b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:12:39.039375 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-69b5115a-f574-4230-a3ad-b12fd059d9f7 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] 10.222.0.60 "GET /compute/v2.1/servers/a261d310-161f-4e77-a27a-7f377072cb2d" status: 200 len: 1355 microversion: 2.1 time: 0.541671 Sep 14 09:12:39.059249 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2431/4833] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:12:38 2022] GET /compute/v2.1/servers/a261d310-161f-4e77-a27a-7f377072cb2d => generated 1355 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:12:39.067793 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-6f3b77b9-6306-4d18-97a7-b6d9f68b8dec tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:12:39.069958 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-6f3b77b9-6306-4d18-97a7-b6d9f68b8dec tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] [instance: b697814f-f228-4d60-b62e-1677867aeb4b] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:12:39.084370 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6f3b77b9-6306-4d18-97a7-b6d9f68b8dec tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:39.086432 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6f3b77b9-6306-4d18-97a7-b6d9f68b8dec tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:39.087181 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6f3b77b9-6306-4d18-97a7-b6d9f68b8dec tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:39.088454 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6f3b77b9-6306-4d18-97a7-b6d9f68b8dec tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:39.089209 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6f3b77b9-6306-4d18-97a7-b6d9f68b8dec tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:39.089966 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6f3b77b9-6306-4d18-97a7-b6d9f68b8dec tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:39.184228 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-e1d5212c-9fd7-4c80-9844-1fbbacfa4f8f tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daab4f69af5452c8641006d9f09edce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9672a6c416ee44289eaa4d7c664d307e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:12:39.194545 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e1d5212c-9fd7-4c80-9844-1fbbacfa4f8f tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "GET /compute/v2.1/servers/b13cd01f-fa9b-4d21-a1f9-4f7745dbbe37" status: 200 len: 1680 microversion: 2.1 time: 0.488482 Sep 14 09:12:39.196423 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2403/4834] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:12:38 2022] GET /compute/v2.1/servers/b13cd01f-fa9b-4d21-a1f9-4f7745dbbe37 => generated 1680 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:12:39.353460 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-6f3b77b9-6306-4d18-97a7-b6d9f68b8dec tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0445809b8ae242bb8b72fe37550589c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77e7aab450842cf8b27d62e76a06569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:12:39.362899 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-6f3b77b9-6306-4d18-97a7-b6d9f68b8dec tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] 10.222.0.60 "GET /compute/v2.1/servers/b697814f-f228-4d60-b62e-1677867aeb4b" status: 200 len: 1315 microversion: 2.1 time: 0.302017 Sep 14 09:12:39.363665 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2432/4835] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:12:39 2022] GET /compute/v2.1/servers/b697814f-f228-4d60-b62e-1677867aeb4b => generated 1315 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:12:40.067534 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-7d13a3dc-0ffc-4fc1-9f13-892c409e120f tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:12:40.068418 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-7d13a3dc-0ffc-4fc1-9f13-892c409e120f tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] [instance: a261d310-161f-4e77-a27a-7f377072cb2d] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:12:40.075415 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7d13a3dc-0ffc-4fc1-9f13-892c409e120f tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:40.076496 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7d13a3dc-0ffc-4fc1-9f13-892c409e120f tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:40.076958 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7d13a3dc-0ffc-4fc1-9f13-892c409e120f tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:40.077715 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7d13a3dc-0ffc-4fc1-9f13-892c409e120f tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:40.078131 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7d13a3dc-0ffc-4fc1-9f13-892c409e120f tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:40.078564 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7d13a3dc-0ffc-4fc1-9f13-892c409e120f tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:40.223198 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-0b287056-a4be-4f96-bc14-0665999c425a tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:12:40.225542 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-0b287056-a4be-4f96-bc14-0665999c425a tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [instance: b13cd01f-fa9b-4d21-a1f9-4f7745dbbe37] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:12:40.234977 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0b287056-a4be-4f96-bc14-0665999c425a tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:40.236288 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0b287056-a4be-4f96-bc14-0665999c425a tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:40.236952 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0b287056-a4be-4f96-bc14-0665999c425a tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:40.238069 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0b287056-a4be-4f96-bc14-0665999c425a tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:40.238751 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0b287056-a4be-4f96-bc14-0665999c425a tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:40.239566 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0b287056-a4be-4f96-bc14-0665999c425a tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:40.256142 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-7d13a3dc-0ffc-4fc1-9f13-892c409e120f tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe73f3d7f4734e1ab9f6b7283db1388b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94e25a7caf946c2a80b874416e4906b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:12:40.266387 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-7d13a3dc-0ffc-4fc1-9f13-892c409e120f tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] 10.222.0.60 "GET /compute/v2.1/servers/a261d310-161f-4e77-a27a-7f377072cb2d" status: 200 len: 1355 microversion: 2.1 time: 0.202679 Sep 14 09:12:40.273516 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2404/4836] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:12:40 2022] GET /compute/v2.1/servers/a261d310-161f-4e77-a27a-7f377072cb2d => generated 1355 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:12:40.387589 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-1049220b-1484-4cd8-b5ab-57c585900941 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:12:40.388347 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-1049220b-1484-4cd8-b5ab-57c585900941 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] [instance: b697814f-f228-4d60-b62e-1677867aeb4b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:12:40.413633 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1049220b-1484-4cd8-b5ab-57c585900941 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:40.414241 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1049220b-1484-4cd8-b5ab-57c585900941 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:40.415630 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1049220b-1484-4cd8-b5ab-57c585900941 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:40.418322 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1049220b-1484-4cd8-b5ab-57c585900941 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:40.423676 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1049220b-1484-4cd8-b5ab-57c585900941 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:40.424310 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1049220b-1484-4cd8-b5ab-57c585900941 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:40.587458 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-0b287056-a4be-4f96-bc14-0665999c425a tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daab4f69af5452c8641006d9f09edce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9672a6c416ee44289eaa4d7c664d307e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:12:40.598191 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-0b287056-a4be-4f96-bc14-0665999c425a tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "GET /compute/v2.1/servers/b13cd01f-fa9b-4d21-a1f9-4f7745dbbe37" status: 200 len: 1680 microversion: 2.1 time: 0.380130 Sep 14 09:12:40.615197 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2433/4837] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:12:40 2022] GET /compute/v2.1/servers/b13cd01f-fa9b-4d21-a1f9-4f7745dbbe37 => generated 1680 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:12:40.838449 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-1049220b-1484-4cd8-b5ab-57c585900941 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0445809b8ae242bb8b72fe37550589c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77e7aab450842cf8b27d62e76a06569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:12:40.851377 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-1049220b-1484-4cd8-b5ab-57c585900941 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] 10.222.0.60 "GET /compute/v2.1/servers/b697814f-f228-4d60-b62e-1677867aeb4b" status: 200 len: 1464 microversion: 2.1 time: 0.469149 Sep 14 09:12:40.866963 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2405/4838] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:12:40 2022] GET /compute/v2.1/servers/b697814f-f228-4d60-b62e-1677867aeb4b => generated 1464 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:12:40.943288 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-33e1bf76-973d-490b-aaa3-80d5d46b85b4 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:12:40.944244 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-33e1bf76-973d-490b-aaa3-80d5d46b85b4 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] [instance: b697814f-f228-4d60-b62e-1677867aeb4b] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:12:40.965196 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-33e1bf76-973d-490b-aaa3-80d5d46b85b4 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:40.967489 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-33e1bf76-973d-490b-aaa3-80d5d46b85b4 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:40.968269 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-33e1bf76-973d-490b-aaa3-80d5d46b85b4 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:40.971211 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-33e1bf76-973d-490b-aaa3-80d5d46b85b4 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:40.973624 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-33e1bf76-973d-490b-aaa3-80d5d46b85b4 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:40.975260 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-33e1bf76-973d-490b-aaa3-80d5d46b85b4 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:41.052230 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-33e1bf76-973d-490b-aaa3-80d5d46b85b4 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] [instance: b697814f-f228-4d60-b62e-1677867aeb4b] Going to try to terminate instance {{(pid=128758) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:12:41.136291 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:12:41.222272 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-33e1bf76-973d-490b-aaa3-80d5d46b85b4 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] 10.222.0.60 "DELETE /compute/v2.1/servers/b697814f-f228-4d60-b62e-1677867aeb4b" status: 204 len: 0 microversion: 2.1 time: 0.286600 Sep 14 09:12:41.223357 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2434/4839] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:12:40 2022] DELETE /compute/v2.1/servers/b697814f-f228-4d60-b62e-1677867aeb4b => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:12:41.234639 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-fcc4613b-5038-4e66-9cf0-06b879975a61 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:12:41.235321 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-fcc4613b-5038-4e66-9cf0-06b879975a61 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] [instance: b697814f-f228-4d60-b62e-1677867aeb4b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:12:41.244005 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fcc4613b-5038-4e66-9cf0-06b879975a61 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:41.244494 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fcc4613b-5038-4e66-9cf0-06b879975a61 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:41.244933 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fcc4613b-5038-4e66-9cf0-06b879975a61 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:41.245878 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fcc4613b-5038-4e66-9cf0-06b879975a61 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:41.246513 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fcc4613b-5038-4e66-9cf0-06b879975a61 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:41.247174 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fcc4613b-5038-4e66-9cf0-06b879975a61 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:41.293328 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-94e3fe25-d9c3-4495-ae16-e3ece433ff48 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:12:41.294220 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-94e3fe25-d9c3-4495-ae16-e3ece433ff48 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] [instance: a261d310-161f-4e77-a27a-7f377072cb2d] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:12:41.303025 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-94e3fe25-d9c3-4495-ae16-e3ece433ff48 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:41.303914 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-94e3fe25-d9c3-4495-ae16-e3ece433ff48 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:41.304644 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-94e3fe25-d9c3-4495-ae16-e3ece433ff48 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:41.305607 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-94e3fe25-d9c3-4495-ae16-e3ece433ff48 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:41.306482 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-94e3fe25-d9c3-4495-ae16-e3ece433ff48 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:41.307373 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-94e3fe25-d9c3-4495-ae16-e3ece433ff48 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:41.526962 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-fcc4613b-5038-4e66-9cf0-06b879975a61 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0445809b8ae242bb8b72fe37550589c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77e7aab450842cf8b27d62e76a06569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:12:41.536667 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-fcc4613b-5038-4e66-9cf0-06b879975a61 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] 10.222.0.60 "GET /compute/v2.1/servers/b697814f-f228-4d60-b62e-1677867aeb4b" status: 200 len: 1470 microversion: 2.1 time: 0.308236 Sep 14 09:12:41.537276 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2406/4840] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:12:41 2022] GET /compute/v2.1/servers/b697814f-f228-4d60-b62e-1677867aeb4b => generated 1470 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:12:41.623783 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-1d5ea838-7908-431f-9e72-9fc9a0414da8 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:12:41.624350 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-1d5ea838-7908-431f-9e72-9fc9a0414da8 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [instance: b13cd01f-fa9b-4d21-a1f9-4f7745dbbe37] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:12:41.633122 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1d5ea838-7908-431f-9e72-9fc9a0414da8 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:41.635735 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1d5ea838-7908-431f-9e72-9fc9a0414da8 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:41.636223 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1d5ea838-7908-431f-9e72-9fc9a0414da8 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:41.642731 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1d5ea838-7908-431f-9e72-9fc9a0414da8 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:41.643088 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1d5ea838-7908-431f-9e72-9fc9a0414da8 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:41.644379 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1d5ea838-7908-431f-9e72-9fc9a0414da8 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:41.656967 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-94e3fe25-d9c3-4495-ae16-e3ece433ff48 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe73f3d7f4734e1ab9f6b7283db1388b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94e25a7caf946c2a80b874416e4906b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:12:41.666902 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-94e3fe25-d9c3-4495-ae16-e3ece433ff48 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] 10.222.0.60 "GET /compute/v2.1/servers/a261d310-161f-4e77-a27a-7f377072cb2d" status: 200 len: 1355 microversion: 2.1 time: 0.378406 Sep 14 09:12:41.685150 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2435/4841] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:12:41 2022] GET /compute/v2.1/servers/a261d310-161f-4e77-a27a-7f377072cb2d => generated 1355 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:12:41.781338 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-1d5ea838-7908-431f-9e72-9fc9a0414da8 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daab4f69af5452c8641006d9f09edce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9672a6c416ee44289eaa4d7c664d307e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:12:41.794410 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-1d5ea838-7908-431f-9e72-9fc9a0414da8 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "GET /compute/v2.1/servers/b13cd01f-fa9b-4d21-a1f9-4f7745dbbe37" status: 200 len: 1612 microversion: 2.1 time: 0.174062 Sep 14 09:12:41.795428 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2407/4842] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:12:41 2022] GET /compute/v2.1/servers/b13cd01f-fa9b-4d21-a1f9-4f7745dbbe37 => generated 1612 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:12:42.375864 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-6b677997-244c-4ea1-9595-59714a9a11e7 req-671f85b9-ebb4-47bf-8829-cdd286eb5e2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b13cd01f-fa9b-4d21-a1f9-4f7745dbbe37", "name": "network-vif-deleted", "tag": "1a63584e-aab3-4542-b006-dd4f1e9c014b"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:12:42.398024 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-6b677997-244c-4ea1-9595-59714a9a11e7 req-671f85b9-ebb4-47bf-8829-cdd286eb5e2e service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:42.398727 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-6b677997-244c-4ea1-9595-59714a9a11e7 req-671f85b9-ebb4-47bf-8829-cdd286eb5e2e service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:42.399387 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-6b677997-244c-4ea1-9595-59714a9a11e7 req-671f85b9-ebb4-47bf-8829-cdd286eb5e2e service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:42.418212 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-6b677997-244c-4ea1-9595-59714a9a11e7 req-671f85b9-ebb4-47bf-8829-cdd286eb5e2e service nova] Creating event network-vif-deleted:1a63584e-aab3-4542-b006-dd4f1e9c014b for instance b13cd01f-fa9b-4d21-a1f9-4f7745dbbe37 on n-h2-836830-18 Sep 14 09:12:42.426472 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-6b677997-244c-4ea1-9595-59714a9a11e7 req-671f85b9-ebb4-47bf-8829-cdd286eb5e2e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054862 Sep 14 09:12:42.428191 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2436/4843] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:12:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:12:42.569081 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d51100f9-1d18-431f-86e6-40030ef78684 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:12:42.569683 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-d51100f9-1d18-431f-86e6-40030ef78684 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] [instance: b697814f-f228-4d60-b62e-1677867aeb4b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:12:42.583386 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d51100f9-1d18-431f-86e6-40030ef78684 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:42.584249 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d51100f9-1d18-431f-86e6-40030ef78684 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:42.585238 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d51100f9-1d18-431f-86e6-40030ef78684 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:42.586254 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d51100f9-1d18-431f-86e6-40030ef78684 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:42.587015 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d51100f9-1d18-431f-86e6-40030ef78684 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:42.587498 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d51100f9-1d18-431f-86e6-40030ef78684 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:42.701376 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-76448b97-0ece-4eb7-833a-ebc18382687f tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:12:42.702089 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-76448b97-0ece-4eb7-833a-ebc18382687f tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] [instance: a261d310-161f-4e77-a27a-7f377072cb2d] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:12:42.712860 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-76448b97-0ece-4eb7-833a-ebc18382687f tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:42.720995 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-76448b97-0ece-4eb7-833a-ebc18382687f tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:42.721716 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-76448b97-0ece-4eb7-833a-ebc18382687f tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:42.722662 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-76448b97-0ece-4eb7-833a-ebc18382687f tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:42.723418 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-76448b97-0ece-4eb7-833a-ebc18382687f tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:42.724490 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-76448b97-0ece-4eb7-833a-ebc18382687f tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:42.788005 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-d51100f9-1d18-431f-86e6-40030ef78684 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0445809b8ae242bb8b72fe37550589c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77e7aab450842cf8b27d62e76a06569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:12:42.799585 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d51100f9-1d18-431f-86e6-40030ef78684 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] 10.222.0.60 "GET /compute/v2.1/servers/b697814f-f228-4d60-b62e-1677867aeb4b" status: 200 len: 1470 microversion: 2.1 time: 0.238999 Sep 14 09:12:42.800720 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2408/4844] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:12:42 2022] GET /compute/v2.1/servers/b697814f-f228-4d60-b62e-1677867aeb4b => generated 1470 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:12:42.821912 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-66ae1704-0525-48dd-a447-96db53a44a75 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:12:42.822857 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-66ae1704-0525-48dd-a447-96db53a44a75 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [instance: b13cd01f-fa9b-4d21-a1f9-4f7745dbbe37] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:12:42.829653 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-66ae1704-0525-48dd-a447-96db53a44a75 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:42.830410 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-66ae1704-0525-48dd-a447-96db53a44a75 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:42.831071 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-66ae1704-0525-48dd-a447-96db53a44a75 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:42.831976 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-66ae1704-0525-48dd-a447-96db53a44a75 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:42.832766 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-66ae1704-0525-48dd-a447-96db53a44a75 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:42.833372 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-66ae1704-0525-48dd-a447-96db53a44a75 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:42.868936 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-66ae1704-0525-48dd-a447-96db53a44a75 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:42.869624 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-66ae1704-0525-48dd-a447-96db53a44a75 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:42.870233 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-66ae1704-0525-48dd-a447-96db53a44a75 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:42.871254 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.objects.instance [None req-66ae1704-0525-48dd-a447-96db53a44a75 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lazy-loading 'fault' on Instance uuid b13cd01f-fa9b-4d21-a1f9-4f7745dbbe37 {{(pid=128759) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:12:42.973655 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-66ae1704-0525-48dd-a447-96db53a44a75 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daab4f69af5452c8641006d9f09edce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9672a6c416ee44289eaa4d7c664d307e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:12:42.987762 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-66ae1704-0525-48dd-a447-96db53a44a75 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "GET /compute/v2.1/servers/b13cd01f-fa9b-4d21-a1f9-4f7745dbbe37" status: 200 len: 1330 microversion: 2.1 time: 0.166903 Sep 14 09:12:42.988480 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2409/4845] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:12:42 2022] GET /compute/v2.1/servers/b13cd01f-fa9b-4d21-a1f9-4f7745dbbe37 => generated 1330 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:12:43.020663 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-76448b97-0ece-4eb7-833a-ebc18382687f tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe73f3d7f4734e1ab9f6b7283db1388b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94e25a7caf946c2a80b874416e4906b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:12:43.035707 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-76448b97-0ece-4eb7-833a-ebc18382687f tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] 10.222.0.60 "GET /compute/v2.1/servers/a261d310-161f-4e77-a27a-7f377072cb2d" status: 200 len: 1355 microversion: 2.1 time: 0.335521 Sep 14 09:12:43.036349 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2437/4846] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:12:42 2022] GET /compute/v2.1/servers/a261d310-161f-4e77-a27a-7f377072cb2d => generated 1355 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:12:43.800017 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-d260ce11-3e50-47c4-ba0f-1b40a07976c1 req-e4a848e7-fee7-442b-84e0-b06f0d365b39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b697814f-f228-4d60-b62e-1677867aeb4b", "name": "network-vif-deleted", "tag": "64fba0b2-29e9-4ad8-99f8-dfadbf444b24"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:12:43.826849 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-10281612-888a-4e8c-b7f5-d98d6ec87874 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:12:43.830033 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-10281612-888a-4e8c-b7f5-d98d6ec87874 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] [instance: b697814f-f228-4d60-b62e-1677867aeb4b] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:12:43.839011 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-d260ce11-3e50-47c4-ba0f-1b40a07976c1 req-e4a848e7-fee7-442b-84e0-b06f0d365b39 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:43.839512 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-d260ce11-3e50-47c4-ba0f-1b40a07976c1 req-e4a848e7-fee7-442b-84e0-b06f0d365b39 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:43.839953 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-d260ce11-3e50-47c4-ba0f-1b40a07976c1 req-e4a848e7-fee7-442b-84e0-b06f0d365b39 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:43.840961 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-10281612-888a-4e8c-b7f5-d98d6ec87874 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:43.843210 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-10281612-888a-4e8c-b7f5-d98d6ec87874 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:43.843778 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-10281612-888a-4e8c-b7f5-d98d6ec87874 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:43.845087 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-10281612-888a-4e8c-b7f5-d98d6ec87874 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:43.846966 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-10281612-888a-4e8c-b7f5-d98d6ec87874 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:43.849042 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-10281612-888a-4e8c-b7f5-d98d6ec87874 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:43.878911 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-d260ce11-3e50-47c4-ba0f-1b40a07976c1 req-e4a848e7-fee7-442b-84e0-b06f0d365b39 service nova] Creating event network-vif-deleted:64fba0b2-29e9-4ad8-99f8-dfadbf444b24 for instance b697814f-f228-4d60-b62e-1677867aeb4b on n-h1-836830-18 Sep 14 09:12:43.888721 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-d260ce11-3e50-47c4-ba0f-1b40a07976c1 req-e4a848e7-fee7-442b-84e0-b06f0d365b39 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093063 Sep 14 09:12:43.895019 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2410/4847] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:12:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:12:43.973905 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-10281612-888a-4e8c-b7f5-d98d6ec87874 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0445809b8ae242bb8b72fe37550589c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77e7aab450842cf8b27d62e76a06569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:12:43.993363 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-10281612-888a-4e8c-b7f5-d98d6ec87874 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] 10.222.0.60 "GET /compute/v2.1/servers/b697814f-f228-4d60-b62e-1677867aeb4b" status: 200 len: 1300 microversion: 2.1 time: 0.160746 Sep 14 09:12:44.007501 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2438/4848] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:12:43 2022] GET /compute/v2.1/servers/b697814f-f228-4d60-b62e-1677867aeb4b => generated 1300 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:12:44.021370 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f7737c35-8baa-40da-8528-f29f84785d23 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:12:44.022124 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f7737c35-8baa-40da-8528-f29f84785d23 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [instance: b13cd01f-fa9b-4d21-a1f9-4f7745dbbe37] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:12:44.035128 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f7737c35-8baa-40da-8528-f29f84785d23 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:44.035633 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f7737c35-8baa-40da-8528-f29f84785d23 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:44.036078 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f7737c35-8baa-40da-8528-f29f84785d23 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:44.036794 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f7737c35-8baa-40da-8528-f29f84785d23 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:44.037255 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f7737c35-8baa-40da-8528-f29f84785d23 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:44.037690 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f7737c35-8baa-40da-8528-f29f84785d23 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:44.061510 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-24e162a2-742e-41fe-9850-af067983aea5 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:12:44.062526 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-24e162a2-742e-41fe-9850-af067983aea5 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] [instance: a261d310-161f-4e77-a27a-7f377072cb2d] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:12:44.079081 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-f7737c35-8baa-40da-8528-f29f84785d23 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] HTTP exception thrown: Instance b13cd01f-fa9b-4d21-a1f9-4f7745dbbe37 could not be found. Sep 14 09:12:44.080984 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f7737c35-8baa-40da-8528-f29f84785d23 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Request method failure captured: Sep 14 09:12:44.080984 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/b13cd01f-fa9b-4d21-a1f9-4f7745dbbe37 HTTP/1.1 Sep 14 09:12:44.080984 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:12:44.080984 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:12:44.080984 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:12:44.080984 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:12:44.080984 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:12:44.080984 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:12:44.080984 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:12:44.080984 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:12:44.080984 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZplAooet3f0j7YfTn10UjWWncQT1X8Zx5oRj6ix43s3Uyu8Vx6JxK5zNIVmYD3adrXMKIf-yKfD6YAxNfiXzTvsjQqMQGw8jI4-W3D7BlestqvRpahzOMSDEzmtF5nK9S-Py3GvFBoobDIQWLv-aBhO1lijqGds4gt8aJhEwjvOnnU Sep 14 09:12:44.080984 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:12:44.080984 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:12:44.080984 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:12:44.080984 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:12:44.080984 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:12:44.080984 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:12:44.080984 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 9672a6c416ee44289eaa4d7c664d307e Sep 14 09:12:44.080984 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-AttachVolumeNegativeTest-1303332785 Sep 14 09:12:44.080984 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:12:44.080984 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:12:44.080984 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/9672a6c416ee44289eaa4d7c664d307e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_9672a6c416ee44289eaa4d7c664d307e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9672a6c416ee44289eaa4d7c664d307e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9672a6c416ee44289eaa4d7c664d307e"}]}] Sep 14 09:12:44.080984 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-AttachVolumeNegativeTest-1303332785 Sep 14 09:12:44.080984 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 9672a6c416ee44289eaa4d7c664d307e Sep 14 09:12:44.080984 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1303332785 Sep 14 09:12:44.080984 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-AttachVolumeNegativeTest-1303332785-project Sep 14 09:12:44.080984 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:12:44.080984 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:12:44.080984 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 7daab4f69af5452c8641006d9f09edce Sep 14 09:12:44.080984 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-AttachVolumeNegativeTest-1303332785-project Sep 14 09:12:44.080984 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:12:44.080984 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance b13cd01f-fa9b-4d21-a1f9-4f7745dbbe37 could not be found. Sep 14 09:12:44.080984 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': 'b13cd01f-fa9b-4d21-a1f9-4f7745dbbe37'} Sep 14 09:12:44.080984 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:12:44.080984 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:12:44.080984 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:12:44.080984 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:12:44.080984 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:12:44.080984 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:12:44.080984 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:12:44.080984 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:12:44.080984 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:12:44.080984 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:12:44.080984 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b13cd01f-fa9b-4d21-a1f9-4f7745dbbe37 could not be found. Sep 14 09:12:44.080984 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:12:44.080984 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:12:44.080984 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:12:44.080984 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:12:44.080984 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:12:44.080984 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:12:44.080984 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:12:44.080984 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:12:44.080984 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:12:44.080984 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:12:44.080984 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:12:44.080984 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:12:44.080984 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:12:44.080984 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:12:44.080984 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:12:44.080984 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:12:44.080984 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b13cd01f-fa9b-4d21-a1f9-4f7745dbbe37 could not be found. Sep 14 09:12:44.080984 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:12:44.080984 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:12:44.080984 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:12:44.087383 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:12:44.087383 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:12:44.087383 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:12:44.087383 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:12:44.087383 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:12:44.087383 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b13cd01f-fa9b-4d21-a1f9-4f7745dbbe37 could not be found. Sep 14 09:12:44.087383 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:12:44.087383 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f7737c35-8baa-40da-8528-f29f84785d23 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Returning 404 to user: Instance b13cd01f-fa9b-4d21-a1f9-4f7745dbbe37 could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:12:44.087383 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f7737c35-8baa-40da-8528-f29f84785d23 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "GET /compute/v2.1/servers/b13cd01f-fa9b-4d21-a1f9-4f7745dbbe37" status: 404 len: 111 microversion: 2.1 time: 0.074561 Sep 14 09:12:44.087383 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2411/4849] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:12:44 2022] GET /compute/v2.1/servers/b13cd01f-fa9b-4d21-a1f9-4f7745dbbe37 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 14 09:12:44.088351 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-24e162a2-742e-41fe-9850-af067983aea5 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:44.089810 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-24e162a2-742e-41fe-9850-af067983aea5 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:44.089810 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-24e162a2-742e-41fe-9850-af067983aea5 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:44.090539 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-24e162a2-742e-41fe-9850-af067983aea5 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:44.091247 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-24e162a2-742e-41fe-9850-af067983aea5 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:44.091817 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-24e162a2-742e-41fe-9850-af067983aea5 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:44.092788 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-919edd2f-f53f-4b61-976b-565e184ed00a tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Calling method '.version_select at 0x7f7d48655ee0>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:12:44.105816 n-d-836830-18 devstack@n-api.service[128759]: ERROR oslo.messaging._drivers.impl_rabbit [None req-919edd2f-f53f-4b61-976b-565e184ed00a tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [48ddcf4f-b5ef-443d-80c4-a7292cbf1807] AMQP server on 10.222.0.60:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 14 09:12:44.272127 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-24e162a2-742e-41fe-9850-af067983aea5 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe73f3d7f4734e1ab9f6b7283db1388b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94e25a7caf946c2a80b874416e4906b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:12:44.285522 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-24e162a2-742e-41fe-9850-af067983aea5 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] 10.222.0.60 "GET /compute/v2.1/servers/a261d310-161f-4e77-a27a-7f377072cb2d" status: 200 len: 1355 microversion: 2.1 time: 0.229245 Sep 14 09:12:44.290612 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2439/4850] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:12:44 2022] GET /compute/v2.1/servers/a261d310-161f-4e77-a27a-7f377072cb2d => generated 1355 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:12:45.025665 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-5534d375-fe06-4993-a805-6974fc08b0b0 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:12:45.027141 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-5534d375-fe06-4993-a805-6974fc08b0b0 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] [instance: b697814f-f228-4d60-b62e-1677867aeb4b] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:12:45.043543 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5534d375-fe06-4993-a805-6974fc08b0b0 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:45.049104 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5534d375-fe06-4993-a805-6974fc08b0b0 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:45.050026 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5534d375-fe06-4993-a805-6974fc08b0b0 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:45.051143 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5534d375-fe06-4993-a805-6974fc08b0b0 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:45.053748 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5534d375-fe06-4993-a805-6974fc08b0b0 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:45.054510 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5534d375-fe06-4993-a805-6974fc08b0b0 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:45.101652 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-5534d375-fe06-4993-a805-6974fc08b0b0 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] HTTP exception thrown: Instance b697814f-f228-4d60-b62e-1677867aeb4b could not be found. Sep 14 09:12:45.103449 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-5534d375-fe06-4993-a805-6974fc08b0b0 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Request method failure captured: Sep 14 09:12:45.103449 n-d-836830-18 devstack@n-api.service[128758]: request: GET /compute/v2.1/servers/b697814f-f228-4d60-b62e-1677867aeb4b HTTP/1.1 Sep 14 09:12:45.103449 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 09:12:45.103449 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 09:12:45.103449 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 09:12:45.103449 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 09:12:45.103449 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 09:12:45.103449 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 09:12:45.103449 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 09:12:45.103449 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 09:12:45.103449 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZrrD_-I8XB97PfktQDOAeAWDnRwOEJj3qyjx_2WNe0zAeL3wn3Cv3ZyHnHmrrHxDc__0ONS-F0WZXq2lXmpWmfLSbKMnCN8xxixlzrxsHOOEl5vf4bHsGKQVevB5PLifhRTLZBBam7a9TEeKXO77xMbeWuqgyT5Jh-ozqRb4gGFzlk Sep 14 09:12:45.103449 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 09:12:45.103449 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 09:12:45.103449 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 09:12:45.103449 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 09:12:45.103449 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 09:12:45.103449 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 09:12:45.103449 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: a77e7aab450842cf8b27d62e76a06569 Sep 14 09:12:45.103449 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-VolumesNegativeTest-92449119 Sep 14 09:12:45.103449 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 09:12:45.103449 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 09:12:45.103449 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a77e7aab450842cf8b27d62e76a06569"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a77e7aab450842cf8b27d62e76a06569"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a77e7aab450842cf8b27d62e76a06569"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a77e7aab450842cf8b27d62e76a06569"}]}] Sep 14 09:12:45.103449 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-VolumesNegativeTest-92449119 Sep 14 09:12:45.103449 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: a77e7aab450842cf8b27d62e76a06569 Sep 14 09:12:45.103449 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-VolumesNegativeTest-92449119 Sep 14 09:12:45.103449 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-VolumesNegativeTest-92449119-project Sep 14 09:12:45.103449 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 09:12:45.103449 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 09:12:45.103449 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 0445809b8ae242bb8b72fe37550589c3 Sep 14 09:12:45.103449 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-VolumesNegativeTest-92449119-project Sep 14 09:12:45.103449 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 09:12:45.103449 n-d-836830-18 devstack@n-api.service[128758]: exception: Instance b697814f-f228-4d60-b62e-1677867aeb4b could not be found. Sep 14 09:12:45.103449 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': 'b697814f-f228-4d60-b62e-1677867aeb4b'} Sep 14 09:12:45.103449 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:12:45.103449 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:12:45.103449 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:12:45.103449 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:12:45.103449 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:12:45.103449 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:12:45.103449 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:12:45.103449 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:12:45.103449 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:12:45.103449 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:12:45.103449 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b697814f-f228-4d60-b62e-1677867aeb4b could not be found. Sep 14 09:12:45.103449 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:12:45.103449 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:12:45.103449 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:12:45.103449 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:12:45.103449 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:12:45.103449 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:12:45.103449 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:12:45.103449 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:12:45.103449 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:12:45.103449 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:12:45.103449 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:12:45.103449 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:12:45.103449 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:12:45.103449 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:12:45.103449 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:12:45.103449 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:12:45.103449 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b697814f-f228-4d60-b62e-1677867aeb4b could not be found. Sep 14 09:12:45.103449 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:12:45.103449 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:12:45.103449 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:12:45.109471 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:12:45.109471 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:12:45.109471 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:12:45.109471 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:12:45.109471 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:12:45.109471 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b697814f-f228-4d60-b62e-1677867aeb4b could not be found. Sep 14 09:12:45.109471 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:12:45.109471 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-5534d375-fe06-4993-a805-6974fc08b0b0 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] Returning 404 to user: Instance b697814f-f228-4d60-b62e-1677867aeb4b could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:12:45.109471 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-5534d375-fe06-4993-a805-6974fc08b0b0 tempest-VolumesNegativeTest-92449119 tempest-VolumesNegativeTest-92449119-project] 10.222.0.60 "GET /compute/v2.1/servers/b697814f-f228-4d60-b62e-1677867aeb4b" status: 404 len: 111 microversion: 2.1 time: 0.085653 Sep 14 09:12:45.111120 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2440/4851] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:12:45 2022] GET /compute/v2.1/servers/b697814f-f228-4d60-b62e-1677867aeb4b => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 14 09:12:45.127714 n-d-836830-18 devstack@n-api.service[128759]: INFO oslo.messaging._drivers.impl_rabbit [None req-919edd2f-f53f-4b61-976b-565e184ed00a tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [48ddcf4f-b5ef-443d-80c4-a7292cbf1807] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 45956. Sep 14 09:12:45.180014 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-919edd2f-f53f-4b61-976b-565e184ed00a tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1269555688" status: 202 len: 0 microversion: 2.1 time: 1.090823 Sep 14 09:12:45.184911 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2412/4852] 10.222.0.60 () {58 vars in 1221 bytes} [Wed Sep 14 09:12:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1269555688 => generated 0 bytes in 1096 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 14 09:12:45.313251 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a9cd332a-33cb-4a55-9cbd-74e45169af52 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:12:45.314423 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-a9cd332a-33cb-4a55-9cbd-74e45169af52 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] [instance: a261d310-161f-4e77-a27a-7f377072cb2d] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:12:45.321958 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a9cd332a-33cb-4a55-9cbd-74e45169af52 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:45.322771 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a9cd332a-33cb-4a55-9cbd-74e45169af52 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:45.323416 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a9cd332a-33cb-4a55-9cbd-74e45169af52 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:45.324601 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a9cd332a-33cb-4a55-9cbd-74e45169af52 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:45.325236 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a9cd332a-33cb-4a55-9cbd-74e45169af52 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:45.327331 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a9cd332a-33cb-4a55-9cbd-74e45169af52 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:46.100263 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-a9cd332a-33cb-4a55-9cbd-74e45169af52 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe73f3d7f4734e1ab9f6b7283db1388b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94e25a7caf946c2a80b874416e4906b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:12:46.111067 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-a9cd332a-33cb-4a55-9cbd-74e45169af52 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] 10.222.0.60 "GET /compute/v2.1/servers/a261d310-161f-4e77-a27a-7f377072cb2d" status: 200 len: 1355 microversion: 2.1 time: 0.802531 Sep 14 09:12:46.112825 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2441/4853] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:12:45 2022] GET /compute/v2.1/servers/a261d310-161f-4e77-a27a-7f377072cb2d => generated 1355 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:12:46.395154 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-1575baf4-6c7f-433c-806a-c3c96ef621a8 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:12:46.396368 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-1575baf4-6c7f-433c-806a-c3c96ef621a8 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [instance: 81ad242a-93d0-4f76-a6f1-e02e5e537e95] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:12:46.406100 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:12:46.410144 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1575baf4-6c7f-433c-806a-c3c96ef621a8 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:46.410877 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1575baf4-6c7f-433c-806a-c3c96ef621a8 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:46.411374 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1575baf4-6c7f-433c-806a-c3c96ef621a8 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:46.414686 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1575baf4-6c7f-433c-806a-c3c96ef621a8 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:46.415393 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1575baf4-6c7f-433c-806a-c3c96ef621a8 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:46.416022 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1575baf4-6c7f-433c-806a-c3c96ef621a8 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:46.440094 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-8186c613-f87f-472e-bb83-90c2f69cc092 req-4450190c-1f26-4127-8e44-2a3c7b57ff3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a261d310-161f-4e77-a27a-7f377072cb2d", "name": "network-vif-plugged", "status": "completed", "tag": "1f9300a0-b0f7-400b-bf70-95c2a598e0ea"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:12:46.452813 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:12:46.460521 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-8186c613-f87f-472e-bb83-90c2f69cc092 req-4450190c-1f26-4127-8e44-2a3c7b57ff3b service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:46.461395 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-8186c613-f87f-472e-bb83-90c2f69cc092 req-4450190c-1f26-4127-8e44-2a3c7b57ff3b service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:46.462325 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-8186c613-f87f-472e-bb83-90c2f69cc092 req-4450190c-1f26-4127-8e44-2a3c7b57ff3b service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:46.480064 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-8186c613-f87f-472e-bb83-90c2f69cc092 req-4450190c-1f26-4127-8e44-2a3c7b57ff3b service nova] Creating event network-vif-plugged:1f9300a0-b0f7-400b-bf70-95c2a598e0ea for instance a261d310-161f-4e77-a27a-7f377072cb2d on n-h2-836830-18 Sep 14 09:12:46.486958 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-8186c613-f87f-472e-bb83-90c2f69cc092 req-4450190c-1f26-4127-8e44-2a3c7b57ff3b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052849 Sep 14 09:12:46.488659 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2442/4854] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:12:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:12:46.719639 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.objects.instance [None req-1575baf4-6c7f-433c-806a-c3c96ef621a8 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lazy-loading 'services' on Instance uuid 81ad242a-93d0-4f76-a6f1-e02e5e537e95 {{(pid=128759) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:12:46.906338 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-1575baf4-6c7f-433c-806a-c3c96ef621a8 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "DELETE /compute/v2.1/servers/81ad242a-93d0-4f76-a6f1-e02e5e537e95/os-volume_attachments/dd4d6708-1fdb-4ad3-8f19-e6f38c2a9664" status: 202 len: 0 microversion: 2.1 time: 0.515299 Sep 14 09:12:46.908506 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2413/4855] 10.222.0.60 () {58 vars in 1416 bytes} [Wed Sep 14 09:12:46 2022] DELETE /compute/v2.1/servers/81ad242a-93d0-4f76-a6f1-e02e5e537e95/os-volume_attachments/dd4d6708-1fdb-4ad3-8f19-e6f38c2a9664 => generated 0 bytes in 519 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:12:46.917224 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-5d6deb33-bf99-4488-9a37-4f39af68d80b tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:12:46.920278 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-5d6deb33-bf99-4488-9a37-4f39af68d80b tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [instance: 81ad242a-93d0-4f76-a6f1-e02e5e537e95] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:12:46.938039 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5d6deb33-bf99-4488-9a37-4f39af68d80b tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:46.942524 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5d6deb33-bf99-4488-9a37-4f39af68d80b tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:46.943530 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5d6deb33-bf99-4488-9a37-4f39af68d80b tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:46.947693 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5d6deb33-bf99-4488-9a37-4f39af68d80b tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:46.948377 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5d6deb33-bf99-4488-9a37-4f39af68d80b tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:46.948994 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5d6deb33-bf99-4488-9a37-4f39af68d80b tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:47.021591 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-5d6deb33-bf99-4488-9a37-4f39af68d80b tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "GET /compute/v2.1/servers/81ad242a-93d0-4f76-a6f1-e02e5e537e95/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.108454 Sep 14 09:12:47.022212 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2443/4856] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 14 09:12:46 2022] GET /compute/v2.1/servers/81ad242a-93d0-4f76-a6f1-e02e5e537e95/os-volume_attachments => generated 197 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:12:47.142684 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b3ee5e2d-d480-407f-926c-e226bf64ffdf tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:12:47.143761 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b3ee5e2d-d480-407f-926c-e226bf64ffdf tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] [instance: a261d310-161f-4e77-a27a-7f377072cb2d] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:12:47.161806 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b3ee5e2d-d480-407f-926c-e226bf64ffdf tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:47.162968 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b3ee5e2d-d480-407f-926c-e226bf64ffdf tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:47.163845 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b3ee5e2d-d480-407f-926c-e226bf64ffdf tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:47.164760 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b3ee5e2d-d480-407f-926c-e226bf64ffdf tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:47.166796 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b3ee5e2d-d480-407f-926c-e226bf64ffdf tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:47.171165 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b3ee5e2d-d480-407f-926c-e226bf64ffdf tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:48.036722 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-0937c26b-fb7b-46d7-bb38-1896129d1fbd tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:12:48.039292 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-0937c26b-fb7b-46d7-bb38-1896129d1fbd tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [instance: 81ad242a-93d0-4f76-a6f1-e02e5e537e95] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:12:48.059876 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0937c26b-fb7b-46d7-bb38-1896129d1fbd tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:48.061908 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0937c26b-fb7b-46d7-bb38-1896129d1fbd tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:48.065916 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0937c26b-fb7b-46d7-bb38-1896129d1fbd tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:48.067386 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0937c26b-fb7b-46d7-bb38-1896129d1fbd tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:48.071622 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0937c26b-fb7b-46d7-bb38-1896129d1fbd tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:48.072375 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0937c26b-fb7b-46d7-bb38-1896129d1fbd tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:48.159432 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-0937c26b-fb7b-46d7-bb38-1896129d1fbd tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "GET /compute/v2.1/servers/81ad242a-93d0-4f76-a6f1-e02e5e537e95/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.127239 Sep 14 09:12:48.173386 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2444/4857] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 14 09:12:48 2022] GET /compute/v2.1/servers/81ad242a-93d0-4f76-a6f1-e02e5e537e95/os-volume_attachments => generated 197 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:12:48.239269 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b3ee5e2d-d480-407f-926c-e226bf64ffdf tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe73f3d7f4734e1ab9f6b7283db1388b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94e25a7caf946c2a80b874416e4906b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:12:48.252736 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b3ee5e2d-d480-407f-926c-e226bf64ffdf tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] 10.222.0.60 "GET /compute/v2.1/servers/a261d310-161f-4e77-a27a-7f377072cb2d" status: 200 len: 1355 microversion: 2.1 time: 1.114682 Sep 14 09:12:48.256575 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2414/4858] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:12:47 2022] GET /compute/v2.1/servers/a261d310-161f-4e77-a27a-7f377072cb2d => generated 1355 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:12:48.551485 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-ef9c2cfc-bdbb-4a58-9b53-05737483e5b5 req-9dd2c964-bdb8-4c56-9555-9abb43ef72d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a261d310-161f-4e77-a27a-7f377072cb2d", "name": "network-vif-plugged", "status": "completed", "tag": "3dd9f84d-f03d-4653-8593-72b1bfb59713"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:12:48.597651 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-ef9c2cfc-bdbb-4a58-9b53-05737483e5b5 req-9dd2c964-bdb8-4c56-9555-9abb43ef72d6 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:48.598157 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-ef9c2cfc-bdbb-4a58-9b53-05737483e5b5 req-9dd2c964-bdb8-4c56-9555-9abb43ef72d6 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:48.598606 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-ef9c2cfc-bdbb-4a58-9b53-05737483e5b5 req-9dd2c964-bdb8-4c56-9555-9abb43ef72d6 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:48.684817 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-ef9c2cfc-bdbb-4a58-9b53-05737483e5b5 req-9dd2c964-bdb8-4c56-9555-9abb43ef72d6 service nova] Creating event network-vif-plugged:3dd9f84d-f03d-4653-8593-72b1bfb59713 for instance a261d310-161f-4e77-a27a-7f377072cb2d on n-h2-836830-18 Sep 14 09:12:48.713300 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-ef9c2cfc-bdbb-4a58-9b53-05737483e5b5 req-9dd2c964-bdb8-4c56-9555-9abb43ef72d6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.167586 Sep 14 09:12:48.719276 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2445/4859] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:12:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:12:49.172550 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f168c1aa-d521-4e71-aca0-225f2d88bda0 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:12:49.175199 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f168c1aa-d521-4e71-aca0-225f2d88bda0 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [instance: 81ad242a-93d0-4f76-a6f1-e02e5e537e95] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:12:49.190394 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f168c1aa-d521-4e71-aca0-225f2d88bda0 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:49.191276 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f168c1aa-d521-4e71-aca0-225f2d88bda0 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:49.191939 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f168c1aa-d521-4e71-aca0-225f2d88bda0 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:49.192908 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f168c1aa-d521-4e71-aca0-225f2d88bda0 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:49.193885 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f168c1aa-d521-4e71-aca0-225f2d88bda0 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:49.194581 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f168c1aa-d521-4e71-aca0-225f2d88bda0 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:49.280087 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f168c1aa-d521-4e71-aca0-225f2d88bda0 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "GET /compute/v2.1/servers/81ad242a-93d0-4f76-a6f1-e02e5e537e95/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.105735 Sep 14 09:12:49.281107 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2415/4860] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 14 09:12:49 2022] GET /compute/v2.1/servers/81ad242a-93d0-4f76-a6f1-e02e5e537e95/os-volume_attachments => generated 197 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:12:49.283453 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-bfe86c7e-9e41-4ce2-84bb-7ec48e88bb54 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:12:49.284253 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-bfe86c7e-9e41-4ce2-84bb-7ec48e88bb54 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] [instance: a261d310-161f-4e77-a27a-7f377072cb2d] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:12:49.305924 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bfe86c7e-9e41-4ce2-84bb-7ec48e88bb54 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:49.306685 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bfe86c7e-9e41-4ce2-84bb-7ec48e88bb54 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:49.308538 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bfe86c7e-9e41-4ce2-84bb-7ec48e88bb54 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:49.310078 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bfe86c7e-9e41-4ce2-84bb-7ec48e88bb54 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:49.310078 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bfe86c7e-9e41-4ce2-84bb-7ec48e88bb54 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:49.315529 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bfe86c7e-9e41-4ce2-84bb-7ec48e88bb54 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:49.687236 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-bfe86c7e-9e41-4ce2-84bb-7ec48e88bb54 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe73f3d7f4734e1ab9f6b7283db1388b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94e25a7caf946c2a80b874416e4906b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:12:49.704111 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-bfe86c7e-9e41-4ce2-84bb-7ec48e88bb54 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] 10.222.0.60 "GET /compute/v2.1/servers/a261d310-161f-4e77-a27a-7f377072cb2d" status: 200 len: 1355 microversion: 2.1 time: 0.428304 Sep 14 09:12:49.705713 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2446/4861] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:12:49 2022] GET /compute/v2.1/servers/a261d310-161f-4e77-a27a-7f377072cb2d => generated 1355 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:12:50.292373 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-5fd16619-0ec5-4bcd-80c1-01bec2085720 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:12:50.298172 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-5fd16619-0ec5-4bcd-80c1-01bec2085720 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [instance: 81ad242a-93d0-4f76-a6f1-e02e5e537e95] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:12:50.308505 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5fd16619-0ec5-4bcd-80c1-01bec2085720 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:50.309003 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5fd16619-0ec5-4bcd-80c1-01bec2085720 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:50.309447 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5fd16619-0ec5-4bcd-80c1-01bec2085720 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:50.310285 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5fd16619-0ec5-4bcd-80c1-01bec2085720 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:50.310845 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5fd16619-0ec5-4bcd-80c1-01bec2085720 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:50.325717 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5fd16619-0ec5-4bcd-80c1-01bec2085720 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:50.391633 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-5fd16619-0ec5-4bcd-80c1-01bec2085720 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "GET /compute/v2.1/servers/81ad242a-93d0-4f76-a6f1-e02e5e537e95/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.103171 Sep 14 09:12:50.399150 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2416/4862] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 14 09:12:50 2022] GET /compute/v2.1/servers/81ad242a-93d0-4f76-a6f1-e02e5e537e95/os-volume_attachments => generated 197 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:12:50.729824 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-83ebfa73-bbc6-49d8-9d3a-29d0786fdaa4 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:12:50.731136 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-83ebfa73-bbc6-49d8-9d3a-29d0786fdaa4 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] [instance: a261d310-161f-4e77-a27a-7f377072cb2d] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:12:50.751261 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-83ebfa73-bbc6-49d8-9d3a-29d0786fdaa4 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:50.751757 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-83ebfa73-bbc6-49d8-9d3a-29d0786fdaa4 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:50.752200 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-83ebfa73-bbc6-49d8-9d3a-29d0786fdaa4 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:50.752918 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-83ebfa73-bbc6-49d8-9d3a-29d0786fdaa4 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:50.753929 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-83ebfa73-bbc6-49d8-9d3a-29d0786fdaa4 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:50.754377 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-83ebfa73-bbc6-49d8-9d3a-29d0786fdaa4 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:50.766055 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-bd9c6fe8-73a4-4049-94ba-8a7684c2f470 req-79d0cb13-02e8-414f-942f-e7953d1edd73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a261d310-161f-4e77-a27a-7f377072cb2d", "name": "network-vif-plugged", "status": "completed", "tag": "266a5c2c-484a-48bd-bbfb-983712ba55e6"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:12:50.782317 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-bd9c6fe8-73a4-4049-94ba-8a7684c2f470 req-79d0cb13-02e8-414f-942f-e7953d1edd73 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:50.782803 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-bd9c6fe8-73a4-4049-94ba-8a7684c2f470 req-79d0cb13-02e8-414f-942f-e7953d1edd73 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:50.787466 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-bd9c6fe8-73a4-4049-94ba-8a7684c2f470 req-79d0cb13-02e8-414f-942f-e7953d1edd73 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:50.821582 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-bd9c6fe8-73a4-4049-94ba-8a7684c2f470 req-79d0cb13-02e8-414f-942f-e7953d1edd73 service nova] Creating event network-vif-plugged:266a5c2c-484a-48bd-bbfb-983712ba55e6 for instance a261d310-161f-4e77-a27a-7f377072cb2d on n-h2-836830-18 Sep 14 09:12:50.833245 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-bd9c6fe8-73a4-4049-94ba-8a7684c2f470 req-79d0cb13-02e8-414f-942f-e7953d1edd73 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066680 Sep 14 09:12:50.847983 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2417/4863] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:12:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:12:51.116722 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-83ebfa73-bbc6-49d8-9d3a-29d0786fdaa4 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe73f3d7f4734e1ab9f6b7283db1388b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94e25a7caf946c2a80b874416e4906b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:12:51.131747 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-83ebfa73-bbc6-49d8-9d3a-29d0786fdaa4 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] 10.222.0.60 "GET /compute/v2.1/servers/a261d310-161f-4e77-a27a-7f377072cb2d" status: 200 len: 1355 microversion: 2.1 time: 0.405780 Sep 14 09:12:51.132352 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2447/4864] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:12:50 2022] GET /compute/v2.1/servers/a261d310-161f-4e77-a27a-7f377072cb2d => generated 1355 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:12:51.407614 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-6fb782a8-da4e-428c-9e80-37286407c2be tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:12:51.411417 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-6fb782a8-da4e-428c-9e80-37286407c2be tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [instance: 81ad242a-93d0-4f76-a6f1-e02e5e537e95] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:12:51.424960 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6fb782a8-da4e-428c-9e80-37286407c2be tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:51.430582 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6fb782a8-da4e-428c-9e80-37286407c2be tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:51.431135 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6fb782a8-da4e-428c-9e80-37286407c2be tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:51.435087 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6fb782a8-da4e-428c-9e80-37286407c2be tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:51.435587 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6fb782a8-da4e-428c-9e80-37286407c2be tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:51.436033 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6fb782a8-da4e-428c-9e80-37286407c2be tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:51.504267 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-6fb782a8-da4e-428c-9e80-37286407c2be tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "GET /compute/v2.1/servers/81ad242a-93d0-4f76-a6f1-e02e5e537e95/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.102706 Sep 14 09:12:51.509582 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2418/4865] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 14 09:12:51 2022] GET /compute/v2.1/servers/81ad242a-93d0-4f76-a6f1-e02e5e537e95/os-volume_attachments => generated 197 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:12:52.155904 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-8a414660-e873-4c14-9cde-6cf85ee8944e tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:12:52.156543 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-8a414660-e873-4c14-9cde-6cf85ee8944e tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] [instance: a261d310-161f-4e77-a27a-7f377072cb2d] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:12:52.180467 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8a414660-e873-4c14-9cde-6cf85ee8944e tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:52.181298 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8a414660-e873-4c14-9cde-6cf85ee8944e tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:52.181987 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8a414660-e873-4c14-9cde-6cf85ee8944e tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:52.182925 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8a414660-e873-4c14-9cde-6cf85ee8944e tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:52.183649 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8a414660-e873-4c14-9cde-6cf85ee8944e tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:52.187298 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8a414660-e873-4c14-9cde-6cf85ee8944e tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:52.517951 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-27288248-6d4e-4b81-b77a-e9fd2ce8214a tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:12:52.521126 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-27288248-6d4e-4b81-b77a-e9fd2ce8214a tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [instance: 81ad242a-93d0-4f76-a6f1-e02e5e537e95] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:12:52.545628 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-27288248-6d4e-4b81-b77a-e9fd2ce8214a tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:52.546187 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-27288248-6d4e-4b81-b77a-e9fd2ce8214a tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:52.546642 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-27288248-6d4e-4b81-b77a-e9fd2ce8214a tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:52.555857 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-27288248-6d4e-4b81-b77a-e9fd2ce8214a tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:52.556354 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-27288248-6d4e-4b81-b77a-e9fd2ce8214a tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:52.556799 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-27288248-6d4e-4b81-b77a-e9fd2ce8214a tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:52.594723 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:12:52.637810 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-27288248-6d4e-4b81-b77a-e9fd2ce8214a tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "GET /compute/v2.1/servers/81ad242a-93d0-4f76-a6f1-e02e5e537e95/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.124313 Sep 14 09:12:52.661227 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2419/4866] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 14 09:12:52 2022] GET /compute/v2.1/servers/81ad242a-93d0-4f76-a6f1-e02e5e537e95/os-volume_attachments => generated 197 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:12:52.683181 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-8a414660-e873-4c14-9cde-6cf85ee8944e tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe73f3d7f4734e1ab9f6b7283db1388b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94e25a7caf946c2a80b874416e4906b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:12:52.692050 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-8a414660-e873-4c14-9cde-6cf85ee8944e tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] 10.222.0.60 "GET /compute/v2.1/servers/a261d310-161f-4e77-a27a-7f377072cb2d" status: 200 len: 1355 microversion: 2.1 time: 0.540812 Sep 14 09:12:52.693657 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2448/4867] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:12:52 2022] GET /compute/v2.1/servers/a261d310-161f-4e77-a27a-7f377072cb2d => generated 1355 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:12:53.649890 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a310028a-3512-4de3-81d1-df0158a36a61 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:12:53.652883 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-a310028a-3512-4de3-81d1-df0158a36a61 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [instance: 81ad242a-93d0-4f76-a6f1-e02e5e537e95] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:12:53.668345 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a310028a-3512-4de3-81d1-df0158a36a61 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:53.668854 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a310028a-3512-4de3-81d1-df0158a36a61 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:53.669350 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a310028a-3512-4de3-81d1-df0158a36a61 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:53.673589 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a310028a-3512-4de3-81d1-df0158a36a61 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:53.675204 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a310028a-3512-4de3-81d1-df0158a36a61 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:53.676880 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a310028a-3512-4de3-81d1-df0158a36a61 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:53.720812 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-4db8528b-ffed-4dd9-a931-86685fccf14f tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:12:53.721793 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-4db8528b-ffed-4dd9-a931-86685fccf14f tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] [instance: a261d310-161f-4e77-a27a-7f377072cb2d] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:12:53.737164 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4db8528b-ffed-4dd9-a931-86685fccf14f tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:53.742153 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4db8528b-ffed-4dd9-a931-86685fccf14f tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:53.746681 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4db8528b-ffed-4dd9-a931-86685fccf14f tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:53.748197 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4db8528b-ffed-4dd9-a931-86685fccf14f tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:53.748675 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4db8528b-ffed-4dd9-a931-86685fccf14f tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:53.753098 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4db8528b-ffed-4dd9-a931-86685fccf14f tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:53.793172 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a310028a-3512-4de3-81d1-df0158a36a61 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "GET /compute/v2.1/servers/81ad242a-93d0-4f76-a6f1-e02e5e537e95/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.147185 Sep 14 09:12:53.793774 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2420/4868] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 14 09:12:53 2022] GET /compute/v2.1/servers/81ad242a-93d0-4f76-a6f1-e02e5e537e95/os-volume_attachments => generated 197 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:12:54.208489 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-4db8528b-ffed-4dd9-a931-86685fccf14f tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe73f3d7f4734e1ab9f6b7283db1388b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94e25a7caf946c2a80b874416e4906b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:12:54.220780 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-4db8528b-ffed-4dd9-a931-86685fccf14f tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] 10.222.0.60 "GET /compute/v2.1/servers/a261d310-161f-4e77-a27a-7f377072cb2d" status: 200 len: 1806 microversion: 2.1 time: 0.503814 Sep 14 09:12:54.222665 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2449/4869] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:12:53 2022] GET /compute/v2.1/servers/a261d310-161f-4e77-a27a-7f377072cb2d => generated 1806 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:12:54.251594 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f2d8dfc7-c04b-47a5-9cf3-315d032282f4 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:12:54.252111 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f2d8dfc7-c04b-47a5-9cf3-315d032282f4 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] [instance: a261d310-161f-4e77-a27a-7f377072cb2d] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:12:54.272172 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f2d8dfc7-c04b-47a5-9cf3-315d032282f4 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:54.272759 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f2d8dfc7-c04b-47a5-9cf3-315d032282f4 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:54.273226 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f2d8dfc7-c04b-47a5-9cf3-315d032282f4 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:54.274550 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f2d8dfc7-c04b-47a5-9cf3-315d032282f4 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:54.281598 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f2d8dfc7-c04b-47a5-9cf3-315d032282f4 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:54.282227 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f2d8dfc7-c04b-47a5-9cf3-315d032282f4 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:54.359688 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f2d8dfc7-c04b-47a5-9cf3-315d032282f4 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] 10.222.0.60 "GET /compute/v2.1/servers/a261d310-161f-4e77-a27a-7f377072cb2d/ips" status: 200 len: 219 microversion: 2.1 time: 0.113967 Sep 14 09:12:54.372913 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2421/4870] 10.222.0.60 () {58 vars in 1248 bytes} [Wed Sep 14 09:12:54 2022] GET /compute/v2.1/servers/a261d310-161f-4e77-a27a-7f377072cb2d/ips => generated 219 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:12:54.378050 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-e81ad6f3-eab5-452f-abd6-a04ffc9428bc tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:12:54.378568 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-e81ad6f3-eab5-452f-abd6-a04ffc9428bc tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] [instance: a261d310-161f-4e77-a27a-7f377072cb2d] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:12:54.400739 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e81ad6f3-eab5-452f-abd6-a04ffc9428bc tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:54.401258 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e81ad6f3-eab5-452f-abd6-a04ffc9428bc tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:54.401711 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e81ad6f3-eab5-452f-abd6-a04ffc9428bc tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:54.404665 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e81ad6f3-eab5-452f-abd6-a04ffc9428bc tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:54.405178 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e81ad6f3-eab5-452f-abd6-a04ffc9428bc tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:54.405629 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e81ad6f3-eab5-452f-abd6-a04ffc9428bc tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:54.499545 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-e81ad6f3-eab5-452f-abd6-a04ffc9428bc tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] [instance: a261d310-161f-4e77-a27a-7f377072cb2d] Going to try to terminate instance {{(pid=128758) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:12:54.730540 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-e81ad6f3-eab5-452f-abd6-a04ffc9428bc tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] 10.222.0.60 "DELETE /compute/v2.1/servers/a261d310-161f-4e77-a27a-7f377072cb2d" status: 204 len: 0 microversion: 2.1 time: 0.356090 Sep 14 09:12:54.731265 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2450/4871] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:12:54 2022] DELETE /compute/v2.1/servers/a261d310-161f-4e77-a27a-7f377072cb2d => generated 0 bytes in 359 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:12:54.746105 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c9816178-9e59-4137-a227-8959358adb83 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:12:54.747435 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-c9816178-9e59-4137-a227-8959358adb83 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] [instance: a261d310-161f-4e77-a27a-7f377072cb2d] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:12:54.757283 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c9816178-9e59-4137-a227-8959358adb83 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:54.757924 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c9816178-9e59-4137-a227-8959358adb83 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:54.760174 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c9816178-9e59-4137-a227-8959358adb83 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:54.761184 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c9816178-9e59-4137-a227-8959358adb83 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:54.761878 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c9816178-9e59-4137-a227-8959358adb83 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:54.762707 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c9816178-9e59-4137-a227-8959358adb83 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:54.806384 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-cae40dae-e14e-480f-b0a6-213e40f5576a tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:12:54.808860 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-cae40dae-e14e-480f-b0a6-213e40f5576a tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [instance: 81ad242a-93d0-4f76-a6f1-e02e5e537e95] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:12:54.829426 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cae40dae-e14e-480f-b0a6-213e40f5576a tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:54.830197 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cae40dae-e14e-480f-b0a6-213e40f5576a tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:54.830821 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cae40dae-e14e-480f-b0a6-213e40f5576a tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:54.832114 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cae40dae-e14e-480f-b0a6-213e40f5576a tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:54.835231 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cae40dae-e14e-480f-b0a6-213e40f5576a tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:54.837663 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cae40dae-e14e-480f-b0a6-213e40f5576a tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:54.874542 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:12:54.891058 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-cae40dae-e14e-480f-b0a6-213e40f5576a tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "GET /compute/v2.1/servers/81ad242a-93d0-4f76-a6f1-e02e5e537e95/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088725 Sep 14 09:12:54.892353 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2451/4872] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 14 09:12:54 2022] GET /compute/v2.1/servers/81ad242a-93d0-4f76-a6f1-e02e5e537e95/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:12:55.308382 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-c9816178-9e59-4137-a227-8959358adb83 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe73f3d7f4734e1ab9f6b7283db1388b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94e25a7caf946c2a80b874416e4906b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:12:55.317926 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-c9816178-9e59-4137-a227-8959358adb83 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] 10.222.0.60 "GET /compute/v2.1/servers/a261d310-161f-4e77-a27a-7f377072cb2d" status: 200 len: 1812 microversion: 2.1 time: 0.581048 Sep 14 09:12:55.318791 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2422/4873] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:12:54 2022] GET /compute/v2.1/servers/a261d310-161f-4e77-a27a-7f377072cb2d => generated 1812 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:12:55.907608 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-e7d4b624-8807-43e9-8684-593655f03151 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:12:55.909806 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-e7d4b624-8807-43e9-8684-593655f03151 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [instance: 81ad242a-93d0-4f76-a6f1-e02e5e537e95] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:12:55.927249 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e7d4b624-8807-43e9-8684-593655f03151 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:55.927750 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e7d4b624-8807-43e9-8684-593655f03151 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:55.928190 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e7d4b624-8807-43e9-8684-593655f03151 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:55.928898 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e7d4b624-8807-43e9-8684-593655f03151 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:55.929352 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e7d4b624-8807-43e9-8684-593655f03151 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:55.930390 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e7d4b624-8807-43e9-8684-593655f03151 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:55.973982 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-e7d4b624-8807-43e9-8684-593655f03151 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "GET /compute/v2.1/servers/81ad242a-93d0-4f76-a6f1-e02e5e537e95/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073260 Sep 14 09:12:55.979185 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2452/4874] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 14 09:12:55 2022] GET /compute/v2.1/servers/81ad242a-93d0-4f76-a6f1-e02e5e537e95/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:12:56.348975 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3e63e57c-7311-409b-a548-32ed0c35c056 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:12:56.349985 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-3e63e57c-7311-409b-a548-32ed0c35c056 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] [instance: a261d310-161f-4e77-a27a-7f377072cb2d] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:12:56.371841 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3e63e57c-7311-409b-a548-32ed0c35c056 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:56.374008 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3e63e57c-7311-409b-a548-32ed0c35c056 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:56.375659 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3e63e57c-7311-409b-a548-32ed0c35c056 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:56.376525 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3e63e57c-7311-409b-a548-32ed0c35c056 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:56.378825 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3e63e57c-7311-409b-a548-32ed0c35c056 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:56.380962 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3e63e57c-7311-409b-a548-32ed0c35c056 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:56.883759 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-3e63e57c-7311-409b-a548-32ed0c35c056 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe73f3d7f4734e1ab9f6b7283db1388b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94e25a7caf946c2a80b874416e4906b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:12:56.899778 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-3e63e57c-7311-409b-a548-32ed0c35c056 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] 10.222.0.60 "GET /compute/v2.1/servers/a261d310-161f-4e77-a27a-7f377072cb2d" status: 200 len: 1812 microversion: 2.1 time: 0.559455 Sep 14 09:12:56.900908 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2423/4875] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:12:56 2022] GET /compute/v2.1/servers/a261d310-161f-4e77-a27a-7f377072cb2d => generated 1812 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:12:56.986418 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-e89978df-7bd2-47ea-b803-428b2f3f5bfd tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:12:56.993496 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-e89978df-7bd2-47ea-b803-428b2f3f5bfd tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [instance: 81ad242a-93d0-4f76-a6f1-e02e5e537e95] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:12:57.009363 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e89978df-7bd2-47ea-b803-428b2f3f5bfd tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:57.012357 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e89978df-7bd2-47ea-b803-428b2f3f5bfd tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:57.012357 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e89978df-7bd2-47ea-b803-428b2f3f5bfd tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:57.012357 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e89978df-7bd2-47ea-b803-428b2f3f5bfd tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:57.013609 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e89978df-7bd2-47ea-b803-428b2f3f5bfd tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:57.021684 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e89978df-7bd2-47ea-b803-428b2f3f5bfd tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:57.090046 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-e89978df-7bd2-47ea-b803-428b2f3f5bfd tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "GET /compute/v2.1/servers/81ad242a-93d0-4f76-a6f1-e02e5e537e95/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.107454 Sep 14 09:12:57.099531 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2453/4876] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 14 09:12:56 2022] GET /compute/v2.1/servers/81ad242a-93d0-4f76-a6f1-e02e5e537e95/os-volume_attachments => generated 25 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 09:12:57.173819 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c55928a3-7e00-4e99-a000-dbebc706b1dc tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:12:57.173974 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-c55928a3-7e00-4e99-a000-dbebc706b1dc tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [instance: 81ad242a-93d0-4f76-a6f1-e02e5e537e95] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:12:57.180529 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c55928a3-7e00-4e99-a000-dbebc706b1dc tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:57.182338 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c55928a3-7e00-4e99-a000-dbebc706b1dc tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:57.183286 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c55928a3-7e00-4e99-a000-dbebc706b1dc tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:57.184273 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c55928a3-7e00-4e99-a000-dbebc706b1dc tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:57.185463 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c55928a3-7e00-4e99-a000-dbebc706b1dc tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:57.186099 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c55928a3-7e00-4e99-a000-dbebc706b1dc tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:57.229402 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-c55928a3-7e00-4e99-a000-dbebc706b1dc tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [instance: 81ad242a-93d0-4f76-a6f1-e02e5e537e95] Going to try to terminate instance {{(pid=128759) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:12:57.345135 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-c55928a3-7e00-4e99-a000-dbebc706b1dc tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "DELETE /compute/v2.1/servers/81ad242a-93d0-4f76-a6f1-e02e5e537e95" status: 204 len: 0 microversion: 2.1 time: 0.175670 Sep 14 09:12:57.350725 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2424/4877] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:12:57 2022] DELETE /compute/v2.1/servers/81ad242a-93d0-4f76-a6f1-e02e5e537e95 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:12:57.355649 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-63dbb6ac-540f-413e-92f2-25b103bf62e2 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:12:57.357317 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-63dbb6ac-540f-413e-92f2-25b103bf62e2 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [instance: 81ad242a-93d0-4f76-a6f1-e02e5e537e95] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:12:57.376774 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-63dbb6ac-540f-413e-92f2-25b103bf62e2 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:57.377365 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-63dbb6ac-540f-413e-92f2-25b103bf62e2 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:57.378221 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-63dbb6ac-540f-413e-92f2-25b103bf62e2 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:57.378990 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-63dbb6ac-540f-413e-92f2-25b103bf62e2 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:57.379460 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-63dbb6ac-540f-413e-92f2-25b103bf62e2 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:57.379895 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-63dbb6ac-540f-413e-92f2-25b103bf62e2 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:57.735118 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-dbf156b7-57b7-44f6-8363-062bcd2e080f req-8761fa49-da4e-4475-81e0-b4739465924d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a261d310-161f-4e77-a27a-7f377072cb2d", "name": "network-vif-deleted", "tag": "1f9300a0-b0f7-400b-bf70-95c2a598e0ea"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:12:57.747723 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-dbf156b7-57b7-44f6-8363-062bcd2e080f req-8761fa49-da4e-4475-81e0-b4739465924d service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:57.750174 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-dbf156b7-57b7-44f6-8363-062bcd2e080f req-8761fa49-da4e-4475-81e0-b4739465924d service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:57.750972 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-dbf156b7-57b7-44f6-8363-062bcd2e080f req-8761fa49-da4e-4475-81e0-b4739465924d service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:57.768713 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-dbf156b7-57b7-44f6-8363-062bcd2e080f req-8761fa49-da4e-4475-81e0-b4739465924d service nova] Creating event network-vif-deleted:1f9300a0-b0f7-400b-bf70-95c2a598e0ea for instance a261d310-161f-4e77-a27a-7f377072cb2d on n-h2-836830-18 Sep 14 09:12:57.779781 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-dbf156b7-57b7-44f6-8363-062bcd2e080f req-8761fa49-da4e-4475-81e0-b4739465924d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046405 Sep 14 09:12:57.780992 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2425/4878] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:12:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:12:57.926901 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a118d995-47b4-414e-af62-87a11f820bc7 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:12:57.928067 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-a118d995-47b4-414e-af62-87a11f820bc7 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] [instance: a261d310-161f-4e77-a27a-7f377072cb2d] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:12:57.951192 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a118d995-47b4-414e-af62-87a11f820bc7 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:57.954083 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a118d995-47b4-414e-af62-87a11f820bc7 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:57.954835 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a118d995-47b4-414e-af62-87a11f820bc7 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:57.955791 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a118d995-47b4-414e-af62-87a11f820bc7 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:57.959951 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a118d995-47b4-414e-af62-87a11f820bc7 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:57.960752 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a118d995-47b4-414e-af62-87a11f820bc7 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:58.012029 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-63dbb6ac-540f-413e-92f2-25b103bf62e2 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daab4f69af5452c8641006d9f09edce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9672a6c416ee44289eaa4d7c664d307e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:12:58.028422 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-63dbb6ac-540f-413e-92f2-25b103bf62e2 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "GET /compute/v2.1/servers/81ad242a-93d0-4f76-a6f1-e02e5e537e95" status: 200 len: 1681 microversion: 2.1 time: 0.677273 Sep 14 09:12:58.047646 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2454/4879] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:12:57 2022] GET /compute/v2.1/servers/81ad242a-93d0-4f76-a6f1-e02e5e537e95 => generated 1681 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:12:58.287990 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-a118d995-47b4-414e-af62-87a11f820bc7 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe73f3d7f4734e1ab9f6b7283db1388b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94e25a7caf946c2a80b874416e4906b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:12:58.299835 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a118d995-47b4-414e-af62-87a11f820bc7 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] 10.222.0.60 "GET /compute/v2.1/servers/a261d310-161f-4e77-a27a-7f377072cb2d" status: 200 len: 1791 microversion: 2.1 time: 0.376303 Sep 14 09:12:58.300915 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2426/4880] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:12:57 2022] GET /compute/v2.1/servers/a261d310-161f-4e77-a27a-7f377072cb2d => generated 1791 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:12:59.062327 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-531497bd-62b9-4a59-aad3-d48566fa292b tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:12:59.063314 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-531497bd-62b9-4a59-aad3-d48566fa292b tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [instance: 81ad242a-93d0-4f76-a6f1-e02e5e537e95] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:12:59.073532 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-531497bd-62b9-4a59-aad3-d48566fa292b tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:59.074037 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-531497bd-62b9-4a59-aad3-d48566fa292b tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:59.074628 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-531497bd-62b9-4a59-aad3-d48566fa292b tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:59.078620 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-531497bd-62b9-4a59-aad3-d48566fa292b tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:59.079359 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-531497bd-62b9-4a59-aad3-d48566fa292b tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:59.080004 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-531497bd-62b9-4a59-aad3-d48566fa292b tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:59.328977 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-7790aa76-d83c-4a66-9ede-a674bf95c94b tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:12:59.329583 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-7790aa76-d83c-4a66-9ede-a674bf95c94b tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] [instance: a261d310-161f-4e77-a27a-7f377072cb2d] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:12:59.342422 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7790aa76-d83c-4a66-9ede-a674bf95c94b tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:59.343323 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7790aa76-d83c-4a66-9ede-a674bf95c94b tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:59.343930 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7790aa76-d83c-4a66-9ede-a674bf95c94b tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:59.344877 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7790aa76-d83c-4a66-9ede-a674bf95c94b tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:59.346483 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7790aa76-d83c-4a66-9ede-a674bf95c94b tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:59.348546 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7790aa76-d83c-4a66-9ede-a674bf95c94b tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:59.629680 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-531497bd-62b9-4a59-aad3-d48566fa292b tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daab4f69af5452c8641006d9f09edce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9672a6c416ee44289eaa4d7c664d307e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:12:59.647290 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-531497bd-62b9-4a59-aad3-d48566fa292b tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "GET /compute/v2.1/servers/81ad242a-93d0-4f76-a6f1-e02e5e537e95" status: 200 len: 1681 microversion: 2.1 time: 0.590831 Sep 14 09:12:59.647920 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2455/4881] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:12:59 2022] GET /compute/v2.1/servers/81ad242a-93d0-4f76-a6f1-e02e5e537e95 => generated 1681 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:12:59.843433 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-a04db3b0-983e-4c7b-90a4-035248a38cb9 req-ba31bbec-d597-4eba-a26f-82eec2c7b583 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a261d310-161f-4e77-a27a-7f377072cb2d", "name": "network-vif-deleted", "tag": "3dd9f84d-f03d-4653-8593-72b1bfb59713"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:12:59.867888 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-a04db3b0-983e-4c7b-90a4-035248a38cb9 req-ba31bbec-d597-4eba-a26f-82eec2c7b583 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:12:59.868666 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-a04db3b0-983e-4c7b-90a4-035248a38cb9 req-ba31bbec-d597-4eba-a26f-82eec2c7b583 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:12:59.870133 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-a04db3b0-983e-4c7b-90a4-035248a38cb9 req-ba31bbec-d597-4eba-a26f-82eec2c7b583 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:12:59.931977 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-a04db3b0-983e-4c7b-90a4-035248a38cb9 req-ba31bbec-d597-4eba-a26f-82eec2c7b583 service nova] Creating event network-vif-deleted:3dd9f84d-f03d-4653-8593-72b1bfb59713 for instance a261d310-161f-4e77-a27a-7f377072cb2d on n-h2-836830-18 Sep 14 09:12:59.944006 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-a04db3b0-983e-4c7b-90a4-035248a38cb9 req-ba31bbec-d597-4eba-a26f-82eec2c7b583 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108207 Sep 14 09:12:59.952191 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2456/4882] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:12:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:13:00.084878 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-7790aa76-d83c-4a66-9ede-a674bf95c94b tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe73f3d7f4734e1ab9f6b7283db1388b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94e25a7caf946c2a80b874416e4906b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:13:00.093693 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-7790aa76-d83c-4a66-9ede-a674bf95c94b tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] 10.222.0.60 "GET /compute/v2.1/servers/a261d310-161f-4e77-a27a-7f377072cb2d" status: 200 len: 1676 microversion: 2.1 time: 0.769156 Sep 14 09:13:00.095266 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-018bc044-026c-4481-a7fe-0bf06dcd32f2 req-0b4a609e-9b72-4a09-9ba6-47a8fc778f76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81ad242a-93d0-4f76-a6f1-e02e5e537e95", "name": "network-vif-unplugged", "status": "completed", "tag": "50f39472-c166-4d11-b75f-be5e33cb27d4"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:13:00.102011 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2427/4883] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:12:59 2022] GET /compute/v2.1/servers/a261d310-161f-4e77-a27a-7f377072cb2d => generated 1676 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:13:00.135353 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-018bc044-026c-4481-a7fe-0bf06dcd32f2 req-0b4a609e-9b72-4a09-9ba6-47a8fc778f76 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:00.135958 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-018bc044-026c-4481-a7fe-0bf06dcd32f2 req-0b4a609e-9b72-4a09-9ba6-47a8fc778f76 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:00.136714 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-018bc044-026c-4481-a7fe-0bf06dcd32f2 req-0b4a609e-9b72-4a09-9ba6-47a8fc778f76 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:00.152546 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-018bc044-026c-4481-a7fe-0bf06dcd32f2 req-0b4a609e-9b72-4a09-9ba6-47a8fc778f76 service nova] Creating event network-vif-unplugged:50f39472-c166-4d11-b75f-be5e33cb27d4 for instance 81ad242a-93d0-4f76-a6f1-e02e5e537e95 on n-h2-836830-18 Sep 14 09:13:00.168799 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-018bc044-026c-4481-a7fe-0bf06dcd32f2 req-0b4a609e-9b72-4a09-9ba6-47a8fc778f76 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.080932 Sep 14 09:13:00.183409 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2457/4884] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:13:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:13:00.675618 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ee03bf17-7d54-4a65-9360-d98594cb7b68 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:13:00.676228 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-ee03bf17-7d54-4a65-9360-d98594cb7b68 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [instance: 81ad242a-93d0-4f76-a6f1-e02e5e537e95] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:13:00.695152 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ee03bf17-7d54-4a65-9360-d98594cb7b68 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:00.695901 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ee03bf17-7d54-4a65-9360-d98594cb7b68 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:00.697318 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ee03bf17-7d54-4a65-9360-d98594cb7b68 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:00.710065 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ee03bf17-7d54-4a65-9360-d98594cb7b68 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:00.710534 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ee03bf17-7d54-4a65-9360-d98594cb7b68 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:00.724155 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ee03bf17-7d54-4a65-9360-d98594cb7b68 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:00.930829 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-ee03bf17-7d54-4a65-9360-d98594cb7b68 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daab4f69af5452c8641006d9f09edce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9672a6c416ee44289eaa4d7c664d307e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:13:00.948023 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-ee03bf17-7d54-4a65-9360-d98594cb7b68 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "GET /compute/v2.1/servers/81ad242a-93d0-4f76-a6f1-e02e5e537e95" status: 200 len: 1613 microversion: 2.1 time: 0.276226 Sep 14 09:13:00.948667 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2428/4885] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:13:00 2022] GET /compute/v2.1/servers/81ad242a-93d0-4f76-a6f1-e02e5e537e95 => generated 1613 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:13:01.128681 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-81585cdd-6a6d-43e1-9172-3820259d79d5 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:13:01.129396 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-81585cdd-6a6d-43e1-9172-3820259d79d5 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] [instance: a261d310-161f-4e77-a27a-7f377072cb2d] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:13:01.145697 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-81585cdd-6a6d-43e1-9172-3820259d79d5 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:01.146207 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-81585cdd-6a6d-43e1-9172-3820259d79d5 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:01.146645 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-81585cdd-6a6d-43e1-9172-3820259d79d5 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:01.152950 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-81585cdd-6a6d-43e1-9172-3820259d79d5 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:01.154069 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-81585cdd-6a6d-43e1-9172-3820259d79d5 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:01.154518 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-81585cdd-6a6d-43e1-9172-3820259d79d5 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:01.265722 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-81585cdd-6a6d-43e1-9172-3820259d79d5 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe73f3d7f4734e1ab9f6b7283db1388b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94e25a7caf946c2a80b874416e4906b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:13:01.281608 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-81585cdd-6a6d-43e1-9172-3820259d79d5 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] 10.222.0.60 "GET /compute/v2.1/servers/a261d310-161f-4e77-a27a-7f377072cb2d" status: 200 len: 1298 microversion: 2.1 time: 0.157162 Sep 14 09:13:01.283421 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2458/4886] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:13:01 2022] GET /compute/v2.1/servers/a261d310-161f-4e77-a27a-7f377072cb2d => generated 1298 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:13:01.689664 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-88ffe8a6-3da3-4299-980b-a67c38172b60 req-c8381990-c3ec-448c-b97f-1d64f8d3f001 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81ad242a-93d0-4f76-a6f1-e02e5e537e95", "name": "network-vif-deleted", "tag": "50f39472-c166-4d11-b75f-be5e33cb27d4"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:13:01.713921 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-88ffe8a6-3da3-4299-980b-a67c38172b60 req-c8381990-c3ec-448c-b97f-1d64f8d3f001 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:01.714591 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-88ffe8a6-3da3-4299-980b-a67c38172b60 req-c8381990-c3ec-448c-b97f-1d64f8d3f001 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:01.715593 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-88ffe8a6-3da3-4299-980b-a67c38172b60 req-c8381990-c3ec-448c-b97f-1d64f8d3f001 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:01.731504 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-88ffe8a6-3da3-4299-980b-a67c38172b60 req-c8381990-c3ec-448c-b97f-1d64f8d3f001 service nova] Creating event network-vif-deleted:50f39472-c166-4d11-b75f-be5e33cb27d4 for instance 81ad242a-93d0-4f76-a6f1-e02e5e537e95 on n-h2-836830-18 Sep 14 09:13:01.739384 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-88ffe8a6-3da3-4299-980b-a67c38172b60 req-c8381990-c3ec-448c-b97f-1d64f8d3f001 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053069 Sep 14 09:13:01.740781 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2429/4887] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:13:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:13:01.868067 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b14393da-7502-4afc-bb94-c23cdb6ea91f tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1483434574", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "networks": [{"uuid": "88ba4c46-f0ea-42e7-ab61-91a6a12baee5"}]}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:13:01.984362 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.network.neutron [None req-b14393da-7502-4afc-bb94-c23cdb6ea91f tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] validate_networks() for [('88ba4c46-f0ea-42e7-ab61-91a6a12baee5', None, None, None, None, None)] {{(pid=128758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:13:01.985040 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-5ca254ba-9d0b-4034-9e95-314d2c992503 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:13:01.985881 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-5ca254ba-9d0b-4034-9e95-314d2c992503 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [instance: 81ad242a-93d0-4f76-a6f1-e02e5e537e95] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:13:02.016777 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5ca254ba-9d0b-4034-9e95-314d2c992503 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:02.017665 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5ca254ba-9d0b-4034-9e95-314d2c992503 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:02.018346 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5ca254ba-9d0b-4034-9e95-314d2c992503 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:02.028270 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5ca254ba-9d0b-4034-9e95-314d2c992503 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:02.030611 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5ca254ba-9d0b-4034-9e95-314d2c992503 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:02.040634 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5ca254ba-9d0b-4034-9e95-314d2c992503 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:02.141009 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5ca254ba-9d0b-4034-9e95-314d2c992503 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:02.141649 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5ca254ba-9d0b-4034-9e95-314d2c992503 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:02.142335 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5ca254ba-9d0b-4034-9e95-314d2c992503 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:02.142928 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.objects.instance [None req-5ca254ba-9d0b-4034-9e95-314d2c992503 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lazy-loading 'fault' on Instance uuid 81ad242a-93d0-4f76-a6f1-e02e5e537e95 {{(pid=128759) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:13:02.205217 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-5ca254ba-9d0b-4034-9e95-314d2c992503 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daab4f69af5452c8641006d9f09edce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9672a6c416ee44289eaa4d7c664d307e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:13:02.214487 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-5ca254ba-9d0b-4034-9e95-314d2c992503 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "GET /compute/v2.1/servers/81ad242a-93d0-4f76-a6f1-e02e5e537e95" status: 200 len: 1330 microversion: 2.1 time: 0.241039 Sep 14 09:13:02.218396 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2430/4888] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:13:01 2022] GET /compute/v2.1/servers/81ad242a-93d0-4f76-a6f1-e02e5e537e95 => generated 1330 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:13:02.243179 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-172d00cc-43f9-4e44-b939-02b9007dda6f req-387e7580-7791-487d-b5bb-9ac520074fba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a261d310-161f-4e77-a27a-7f377072cb2d", "name": "network-vif-deleted", "tag": "266a5c2c-484a-48bd-bbfb-983712ba55e6"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:13:02.269113 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-172d00cc-43f9-4e44-b939-02b9007dda6f req-387e7580-7791-487d-b5bb-9ac520074fba service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:02.270005 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-172d00cc-43f9-4e44-b939-02b9007dda6f req-387e7580-7791-487d-b5bb-9ac520074fba service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:02.273212 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-172d00cc-43f9-4e44-b939-02b9007dda6f req-387e7580-7791-487d-b5bb-9ac520074fba service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:02.301650 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-172d00cc-43f9-4e44-b939-02b9007dda6f req-387e7580-7791-487d-b5bb-9ac520074fba service nova] Creating event network-vif-deleted:266a5c2c-484a-48bd-bbfb-983712ba55e6 for instance a261d310-161f-4e77-a27a-7f377072cb2d on n-h2-836830-18 Sep 14 09:13:02.321260 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-172d00cc-43f9-4e44-b939-02b9007dda6f req-387e7580-7791-487d-b5bb-9ac520074fba service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083587 Sep 14 09:13:02.322359 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2431/4889] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:13:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:13:02.334921 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ccd30319-39a0-442b-b2bc-ba7f8e0d175a tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:13:02.336830 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-ccd30319-39a0-442b-b2bc-ba7f8e0d175a tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] [instance: a261d310-161f-4e77-a27a-7f377072cb2d] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:13:02.354494 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ccd30319-39a0-442b-b2bc-ba7f8e0d175a tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:02.357708 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ccd30319-39a0-442b-b2bc-ba7f8e0d175a tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:02.358882 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ccd30319-39a0-442b-b2bc-ba7f8e0d175a tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:02.361228 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ccd30319-39a0-442b-b2bc-ba7f8e0d175a tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:02.361825 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ccd30319-39a0-442b-b2bc-ba7f8e0d175a tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:02.362462 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ccd30319-39a0-442b-b2bc-ba7f8e0d175a tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:02.398336 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-ccd30319-39a0-442b-b2bc-ba7f8e0d175a tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] HTTP exception thrown: Instance a261d310-161f-4e77-a27a-7f377072cb2d could not be found. Sep 14 09:13:02.400510 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ccd30319-39a0-442b-b2bc-ba7f8e0d175a tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Request method failure captured: Sep 14 09:13:02.400510 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/a261d310-161f-4e77-a27a-7f377072cb2d HTTP/1.1 Sep 14 09:13:02.400510 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:13:02.400510 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:13:02.400510 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:13:02.400510 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:13:02.400510 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:13:02.400510 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:13:02.400510 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:13:02.400510 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:13:02.400510 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZrtIhgDvEWeYp7O8tRO-UH3fduWm5FD7xz3GXCLY8eZPbMpWYUt5fj5Ti8tXK5lTZx-nfK5gJJfuBtlE07BSJ2KA2x76buWcCJQ7nse5zDoRqoBleeqIX9h2-Fe4Nj9WkSpOS3iOWRVPqJ6_3Psi-nP7Y1_O2rjYO5bDiD5p7HyYqI Sep 14 09:13:02.400510 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:13:02.400510 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:13:02.400510 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:13:02.400510 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:13:02.400510 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:13:02.400510 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:13:02.400510 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: b94e25a7caf946c2a80b874416e4906b Sep 14 09:13:02.400510 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ServersTestMultiNic-1878356894 Sep 14 09:13:02.400510 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:13:02.400510 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:13:02.400510 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b94e25a7caf946c2a80b874416e4906b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b94e25a7caf946c2a80b874416e4906b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b94e25a7caf946c2a80b874416e4906b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b94e25a7caf946c2a80b874416e4906b"}]}] Sep 14 09:13:02.400510 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ServersTestMultiNic-1878356894 Sep 14 09:13:02.400510 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: b94e25a7caf946c2a80b874416e4906b Sep 14 09:13:02.400510 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ServersTestMultiNic-1878356894 Sep 14 09:13:02.400510 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ServersTestMultiNic-1878356894-project Sep 14 09:13:02.400510 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:13:02.400510 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:13:02.400510 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: fe73f3d7f4734e1ab9f6b7283db1388b Sep 14 09:13:02.400510 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ServersTestMultiNic-1878356894-project Sep 14 09:13:02.400510 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:13:02.400510 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance a261d310-161f-4e77-a27a-7f377072cb2d could not be found. Sep 14 09:13:02.400510 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': 'a261d310-161f-4e77-a27a-7f377072cb2d'} Sep 14 09:13:02.400510 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:13:02.400510 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:13:02.400510 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:13:02.400510 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:13:02.400510 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:13:02.400510 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:13:02.400510 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:13:02.400510 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:13:02.400510 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:13:02.400510 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:13:02.400510 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a261d310-161f-4e77-a27a-7f377072cb2d could not be found. Sep 14 09:13:02.400510 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:13:02.400510 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:13:02.400510 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:13:02.400510 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:13:02.400510 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:13:02.400510 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:13:02.400510 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:13:02.400510 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:13:02.400510 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:13:02.400510 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:13:02.400510 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:13:02.400510 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:13:02.400510 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:13:02.400510 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:13:02.400510 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:13:02.400510 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:13:02.400510 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a261d310-161f-4e77-a27a-7f377072cb2d could not be found. Sep 14 09:13:02.400510 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:13:02.400510 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:13:02.400510 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:13:02.407954 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:13:02.407954 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:13:02.407954 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:13:02.407954 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:13:02.407954 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:13:02.407954 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a261d310-161f-4e77-a27a-7f377072cb2d could not be found. Sep 14 09:13:02.407954 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:13:02.407954 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ccd30319-39a0-442b-b2bc-ba7f8e0d175a tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Returning 404 to user: Instance a261d310-161f-4e77-a27a-7f377072cb2d could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:13:02.409110 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-ccd30319-39a0-442b-b2bc-ba7f8e0d175a tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] 10.222.0.60 "GET /compute/v2.1/servers/a261d310-161f-4e77-a27a-7f377072cb2d" status: 404 len: 111 microversion: 2.1 time: 0.081231 Sep 14 09:13:02.415290 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2432/4890] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:13:02 2022] GET /compute/v2.1/servers/a261d310-161f-4e77-a27a-7f377072cb2d => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:13:03.230606 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-b14393da-7502-4afc-bb94-c23cdb6ea91f tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Flavor limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:13:03.231718 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-b14393da-7502-4afc-bb94-c23cdb6ea91f tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Image limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:13:03.232279 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-b14393da-7502-4afc-bb94-c23cdb6ea91f tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Flavor pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:13:03.232770 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-b14393da-7502-4afc-bb94-c23cdb6ea91f tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Image pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:13:03.233382 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-b14393da-7502-4afc-bb94-c23cdb6ea91f tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:13:03.242254 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d981e3f2-84cb-4d9f-b049-ebfcdc5ff41a tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:13:03.243178 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-d981e3f2-84cb-4d9f-b049-ebfcdc5ff41a tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [instance: 81ad242a-93d0-4f76-a6f1-e02e5e537e95] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:13:03.258418 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d981e3f2-84cb-4d9f-b049-ebfcdc5ff41a tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:03.261305 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b14393da-7502-4afc-bb94-c23cdb6ea91f tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:03.261899 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d981e3f2-84cb-4d9f-b049-ebfcdc5ff41a tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:03.262442 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d981e3f2-84cb-4d9f-b049-ebfcdc5ff41a tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:03.263699 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b14393da-7502-4afc-bb94-c23cdb6ea91f tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:03.264662 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d981e3f2-84cb-4d9f-b049-ebfcdc5ff41a tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:03.265376 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d981e3f2-84cb-4d9f-b049-ebfcdc5ff41a tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:03.266060 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b14393da-7502-4afc-bb94-c23cdb6ea91f tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:03.266657 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d981e3f2-84cb-4d9f-b049-ebfcdc5ff41a tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:03.267530 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b14393da-7502-4afc-bb94-c23cdb6ea91f tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:03.271572 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b14393da-7502-4afc-bb94-c23cdb6ea91f tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:03.274179 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b14393da-7502-4afc-bb94-c23cdb6ea91f tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:03.283847 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-d981e3f2-84cb-4d9f-b049-ebfcdc5ff41a tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] HTTP exception thrown: Instance 81ad242a-93d0-4f76-a6f1-e02e5e537e95 could not be found. Sep 14 09:13:03.289586 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d981e3f2-84cb-4d9f-b049-ebfcdc5ff41a tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Request method failure captured: Sep 14 09:13:03.289586 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/81ad242a-93d0-4f76-a6f1-e02e5e537e95 HTTP/1.1 Sep 14 09:13:03.289586 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:13:03.289586 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:13:03.289586 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:13:03.289586 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:13:03.289586 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:13:03.289586 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:13:03.289586 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:13:03.289586 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:13:03.289586 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZplAooet3f0j7YfTn10UjWWncQT1X8Zx5oRj6ix43s3Uyu8Vx6JxK5zNIVmYD3adrXMKIf-yKfD6YAxNfiXzTvsjQqMQGw8jI4-W3D7BlestqvRpahzOMSDEzmtF5nK9S-Py3GvFBoobDIQWLv-aBhO1lijqGds4gt8aJhEwjvOnnU Sep 14 09:13:03.289586 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:13:03.289586 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:13:03.289586 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:13:03.289586 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:13:03.289586 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:13:03.289586 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:13:03.289586 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 9672a6c416ee44289eaa4d7c664d307e Sep 14 09:13:03.289586 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-AttachVolumeNegativeTest-1303332785 Sep 14 09:13:03.289586 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:13:03.289586 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:13:03.289586 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/9672a6c416ee44289eaa4d7c664d307e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_9672a6c416ee44289eaa4d7c664d307e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9672a6c416ee44289eaa4d7c664d307e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9672a6c416ee44289eaa4d7c664d307e"}]}] Sep 14 09:13:03.289586 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-AttachVolumeNegativeTest-1303332785 Sep 14 09:13:03.289586 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 9672a6c416ee44289eaa4d7c664d307e Sep 14 09:13:03.289586 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1303332785 Sep 14 09:13:03.289586 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-AttachVolumeNegativeTest-1303332785-project Sep 14 09:13:03.289586 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:13:03.289586 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:13:03.289586 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 7daab4f69af5452c8641006d9f09edce Sep 14 09:13:03.289586 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-AttachVolumeNegativeTest-1303332785-project Sep 14 09:13:03.289586 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:13:03.289586 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance 81ad242a-93d0-4f76-a6f1-e02e5e537e95 could not be found. Sep 14 09:13:03.289586 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '81ad242a-93d0-4f76-a6f1-e02e5e537e95'} Sep 14 09:13:03.289586 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:13:03.289586 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:13:03.289586 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:13:03.289586 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:13:03.289586 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:13:03.289586 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:13:03.289586 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:13:03.289586 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:13:03.289586 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:13:03.289586 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:13:03.289586 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81ad242a-93d0-4f76-a6f1-e02e5e537e95 could not be found. Sep 14 09:13:03.289586 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:13:03.289586 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:13:03.289586 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:13:03.289586 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:13:03.289586 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:13:03.289586 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:13:03.289586 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:13:03.289586 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:13:03.289586 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:13:03.289586 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:13:03.289586 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:13:03.289586 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:13:03.289586 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:13:03.289586 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:13:03.289586 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:13:03.289586 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:13:03.289586 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81ad242a-93d0-4f76-a6f1-e02e5e537e95 could not be found. Sep 14 09:13:03.289586 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:13:03.289586 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:13:03.289586 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:13:03.294359 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:13:03.294359 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:13:03.294359 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:13:03.294359 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:13:03.294359 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:13:03.294359 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81ad242a-93d0-4f76-a6f1-e02e5e537e95 could not be found. Sep 14 09:13:03.294359 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:13:03.296232 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-b14393da-7502-4afc-bb94-c23cdb6ea91f tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Getting quotas for project a020c15f895946328ab384514c1ba463. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:13:03.296623 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d981e3f2-84cb-4d9f-b049-ebfcdc5ff41a tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Returning 404 to user: Instance 81ad242a-93d0-4f76-a6f1-e02e5e537e95 could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:13:03.297744 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d981e3f2-84cb-4d9f-b049-ebfcdc5ff41a tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "GET /compute/v2.1/servers/81ad242a-93d0-4f76-a6f1-e02e5e537e95" status: 404 len: 111 microversion: 2.1 time: 0.059567 Sep 14 09:13:03.302667 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2433/4891] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:13:03 2022] GET /compute/v2.1/servers/81ad242a-93d0-4f76-a6f1-e02e5e537e95 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:13:03.309000 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-b14393da-7502-4afc-bb94-c23cdb6ea91f tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Getting quotas for user 421bf1609a6d4f808a4cb3612bf64615 and project a020c15f895946328ab384514c1ba463. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:13:03.310163 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-af5b9612-2b94-4a3e-af5b-d8bbf8d6a447 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Calling method '.version_select at 0x7f7d3ef6b8b0>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:13:03.328064 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-b14393da-7502-4afc-bb94-c23cdb6ea91f tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Going to run 1 instances... {{(pid=128758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:13:03.330603 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-b14393da-7502-4afc-bb94-c23cdb6ea91f tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] [instance: b6babb9f-02ef-445c-bf52-a329fe43964f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:13:03.343470 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-af5b9612-2b94-4a3e-af5b-d8bbf8d6a447 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-17846728" status: 202 len: 0 microversion: 2.1 time: 0.039255 Sep 14 09:13:03.345920 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2434/4892] 10.222.0.60 () {58 vars in 1215 bytes} [Wed Sep 14 09:13:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-17846728 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:13:03.387889 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-b14393da-7502-4afc-bb94-c23cdb6ea91f tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.525845 Sep 14 09:13:03.395367 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2459/4893] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 09:13:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1534 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:13:03.400722 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-6b240e94-7212-4c19-bda4-3bdbcaad7544 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:13:03.401253 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-6b240e94-7212-4c19-bda4-3bdbcaad7544 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] [instance: b6babb9f-02ef-445c-bf52-a329fe43964f] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:13:03.636782 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-6b240e94-7212-4c19-bda4-3bdbcaad7544 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421bf1609a6d4f808a4cb3612bf64615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a020c15f895946328ab384514c1ba463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:13:03.653674 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-6b240e94-7212-4c19-bda4-3bdbcaad7544 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] 10.222.0.60 "GET /compute/v2.1/servers/b6babb9f-02ef-445c-bf52-a329fe43964f" status: 200 len: 1214 microversion: 2.1 time: 0.257146 Sep 14 09:13:03.656048 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2435/4894] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:13:03 2022] GET /compute/v2.1/servers/b6babb9f-02ef-445c-bf52-a329fe43964f => generated 1214 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:13:04.680700 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-f70bc7db-56df-4ae4-937e-c63c7a4cf6b0 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:13:04.681815 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-f70bc7db-56df-4ae4-937e-c63c7a4cf6b0 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] [instance: b6babb9f-02ef-445c-bf52-a329fe43964f] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:13:04.698161 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f70bc7db-56df-4ae4-937e-c63c7a4cf6b0 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:04.698677 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f70bc7db-56df-4ae4-937e-c63c7a4cf6b0 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:04.703452 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f70bc7db-56df-4ae4-937e-c63c7a4cf6b0 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:04.707226 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f70bc7db-56df-4ae4-937e-c63c7a4cf6b0 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:04.707905 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f70bc7db-56df-4ae4-937e-c63c7a4cf6b0 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:04.708605 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f70bc7db-56df-4ae4-937e-c63c7a4cf6b0 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:04.841654 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-f70bc7db-56df-4ae4-937e-c63c7a4cf6b0 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421bf1609a6d4f808a4cb3612bf64615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a020c15f895946328ab384514c1ba463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:13:04.862076 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-f70bc7db-56df-4ae4-937e-c63c7a4cf6b0 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] 10.222.0.60 "GET /compute/v2.1/servers/b6babb9f-02ef-445c-bf52-a329fe43964f" status: 200 len: 1266 microversion: 2.1 time: 0.186265 Sep 14 09:13:04.863432 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2460/4895] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:13:04 2022] GET /compute/v2.1/servers/b6babb9f-02ef-445c-bf52-a329fe43964f => generated 1266 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:13:05.448404 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e10e169d-8251-418e-b48a-fd2081ca2934 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Action: 'create', calling method: .version_select at 0x7f7d4863a4c0>, body: {"keypair": {"name": "tempest-keypair-681289818", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPH6FKLQ3CfKKzo02ytN9Dpg9xjj2MiomHwARYwb08+h5lhKVdt67sDoZDh4Xk2Gq/tFpZVtidSsbVAuthiPo95oOYHNUQegQRV9cn80HqkPqRNsjL49VKJ4f8LLJry67w=="}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:13:05.502595 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-e10e169d-8251-418e-b48a-fd2081ca2934 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Getting quotas for project 9672a6c416ee44289eaa4d7c664d307e. Resources: {'key_pairs'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:13:05.512363 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-e10e169d-8251-418e-b48a-fd2081ca2934 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Getting quotas for user 7daab4f69af5452c8641006d9f09edce and project 9672a6c416ee44289eaa4d7c664d307e. Resources: {'key_pairs'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:13:05.594511 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e10e169d-8251-418e-b48a-fd2081ca2934 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.151682 Sep 14 09:13:05.595980 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2436/4896] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Sep 14 09:13:05 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:13:05.889583 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b1767636-90a0-438c-98ac-9164ba0029b4 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:13:05.896098 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-b1767636-90a0-438c-98ac-9164ba0029b4 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] [instance: b6babb9f-02ef-445c-bf52-a329fe43964f] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:13:05.932287 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b1767636-90a0-438c-98ac-9164ba0029b4 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:05.933202 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b1767636-90a0-438c-98ac-9164ba0029b4 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:05.935689 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b1767636-90a0-438c-98ac-9164ba0029b4 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:05.939519 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b1767636-90a0-438c-98ac-9164ba0029b4 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:05.940255 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b1767636-90a0-438c-98ac-9164ba0029b4 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:05.940928 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b1767636-90a0-438c-98ac-9164ba0029b4 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:06.117563 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-b1767636-90a0-438c-98ac-9164ba0029b4 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421bf1609a6d4f808a4cb3612bf64615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a020c15f895946328ab384514c1ba463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:13:06.130908 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-b1767636-90a0-438c-98ac-9164ba0029b4 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] 10.222.0.60 "GET /compute/v2.1/servers/b6babb9f-02ef-445c-bf52-a329fe43964f" status: 200 len: 1272 microversion: 2.1 time: 0.243020 Sep 14 09:13:06.142970 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2461/4897] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:13:05 2022] GET /compute/v2.1/servers/b6babb9f-02ef-445c-bf52-a329fe43964f => generated 1272 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:13:07.156397 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a3c7ff88-4e43-4a6f-94fa-d4d89127b964 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:13:07.157016 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-a3c7ff88-4e43-4a6f-94fa-d4d89127b964 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] [instance: b6babb9f-02ef-445c-bf52-a329fe43964f] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:13:07.163844 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a3c7ff88-4e43-4a6f-94fa-d4d89127b964 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:07.164343 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a3c7ff88-4e43-4a6f-94fa-d4d89127b964 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:07.164790 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a3c7ff88-4e43-4a6f-94fa-d4d89127b964 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:07.165494 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a3c7ff88-4e43-4a6f-94fa-d4d89127b964 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:07.165950 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a3c7ff88-4e43-4a6f-94fa-d4d89127b964 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:07.166378 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a3c7ff88-4e43-4a6f-94fa-d4d89127b964 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:07.348336 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-60833e00-149f-417a-b187-9d51971b2b11 req-e24f68fe-26a1-4887-b58d-6b77f87dc8c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6babb9f-02ef-445c-bf52-a329fe43964f", "tag": "c2ec6305-e5ef-4396-8668-7b097ef75ea2"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:13:07.385860 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-60833e00-149f-417a-b187-9d51971b2b11 req-e24f68fe-26a1-4887-b58d-6b77f87dc8c4 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:07.388764 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-60833e00-149f-417a-b187-9d51971b2b11 req-e24f68fe-26a1-4887-b58d-6b77f87dc8c4 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:07.389985 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-60833e00-149f-417a-b187-9d51971b2b11 req-e24f68fe-26a1-4887-b58d-6b77f87dc8c4 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:07.430172 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-60833e00-149f-417a-b187-9d51971b2b11 req-e24f68fe-26a1-4887-b58d-6b77f87dc8c4 service nova] Creating event network-changed:c2ec6305-e5ef-4396-8668-7b097ef75ea2 for instance b6babb9f-02ef-445c-bf52-a329fe43964f on n-h2-836830-18 Sep 14 09:13:07.440305 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-60833e00-149f-417a-b187-9d51971b2b11 req-e24f68fe-26a1-4887-b58d-6b77f87dc8c4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093743 Sep 14 09:13:07.447910 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2462/4898] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:13:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:13:07.536350 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-a3c7ff88-4e43-4a6f-94fa-d4d89127b964 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421bf1609a6d4f808a4cb3612bf64615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a020c15f895946328ab384514c1ba463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:13:07.552094 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a3c7ff88-4e43-4a6f-94fa-d4d89127b964 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] 10.222.0.60 "GET /compute/v2.1/servers/b6babb9f-02ef-445c-bf52-a329fe43964f" status: 200 len: 1314 microversion: 2.1 time: 0.400393 Sep 14 09:13:07.552895 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2437/4899] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:13:07 2022] GET /compute/v2.1/servers/b6babb9f-02ef-445c-bf52-a329fe43964f => generated 1314 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:13:08.584021 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-f6d6f698-e8e9-4028-a60f-254e30c42831 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:13:08.585523 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-f6d6f698-e8e9-4028-a60f-254e30c42831 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] [instance: b6babb9f-02ef-445c-bf52-a329fe43964f] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:13:08.595247 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f6d6f698-e8e9-4028-a60f-254e30c42831 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:08.596066 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f6d6f698-e8e9-4028-a60f-254e30c42831 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:08.597592 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f6d6f698-e8e9-4028-a60f-254e30c42831 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:08.598872 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f6d6f698-e8e9-4028-a60f-254e30c42831 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:08.599545 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f6d6f698-e8e9-4028-a60f-254e30c42831 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:08.600560 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f6d6f698-e8e9-4028-a60f-254e30c42831 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:08.892877 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-f6d6f698-e8e9-4028-a60f-254e30c42831 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421bf1609a6d4f808a4cb3612bf64615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a020c15f895946328ab384514c1ba463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:13:08.904820 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-f6d6f698-e8e9-4028-a60f-254e30c42831 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] 10.222.0.60 "GET /compute/v2.1/servers/b6babb9f-02ef-445c-bf52-a329fe43964f" status: 200 len: 1314 microversion: 2.1 time: 0.326106 Sep 14 09:13:08.906771 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2463/4900] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:13:08 2022] GET /compute/v2.1/servers/b6babb9f-02ef-445c-bf52-a329fe43964f => generated 1314 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:13:09.928810 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c4a9e280-2f24-4f0b-8cd5-1d9e72392b63 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:13:09.930076 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-c4a9e280-2f24-4f0b-8cd5-1d9e72392b63 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] [instance: b6babb9f-02ef-445c-bf52-a329fe43964f] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:13:09.942577 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c4a9e280-2f24-4f0b-8cd5-1d9e72392b63 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:09.945903 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c4a9e280-2f24-4f0b-8cd5-1d9e72392b63 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:09.955615 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c4a9e280-2f24-4f0b-8cd5-1d9e72392b63 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:09.956622 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c4a9e280-2f24-4f0b-8cd5-1d9e72392b63 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:09.957284 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c4a9e280-2f24-4f0b-8cd5-1d9e72392b63 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:09.957926 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c4a9e280-2f24-4f0b-8cd5-1d9e72392b63 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:10.017695 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-08130c30-2959-4793-a164-1e22d2937ad2 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1417704507", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8747ac4b-fb94-4411-ac98-d9ed15dcd41c"}], "security_groups": [{"name": "tempest-securitygroup--902155626"}], "key_name": "tempest-keypair-681289818", "user_data": "}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:13:10.243556 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.network.neutron [None req-08130c30-2959-4793-a164-1e22d2937ad2 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] validate_networks() for [('8747ac4b-fb94-4411-ac98-d9ed15dcd41c', None, None, None, None, None)] {{(pid=128758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:13:10.332044 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-c4a9e280-2f24-4f0b-8cd5-1d9e72392b63 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421bf1609a6d4f808a4cb3612bf64615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a020c15f895946328ab384514c1ba463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:13:10.349633 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-c4a9e280-2f24-4f0b-8cd5-1d9e72392b63 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] 10.222.0.60 "GET /compute/v2.1/servers/b6babb9f-02ef-445c-bf52-a329fe43964f" status: 200 len: 1314 microversion: 2.1 time: 0.423617 Sep 14 09:13:10.352812 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2438/4901] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:13:09 2022] GET /compute/v2.1/servers/b6babb9f-02ef-445c-bf52-a329fe43964f => generated 1314 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:13:11.092494 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-08130c30-2959-4793-a164-1e22d2937ad2 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Flavor limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:13:11.093362 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-08130c30-2959-4793-a164-1e22d2937ad2 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Image limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:13:11.094142 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-08130c30-2959-4793-a164-1e22d2937ad2 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Flavor pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:13:11.094865 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-08130c30-2959-4793-a164-1e22d2937ad2 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Image pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:13:11.095652 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-08130c30-2959-4793-a164-1e22d2937ad2 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:13:11.112874 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-08130c30-2959-4793-a164-1e22d2937ad2 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:11.113778 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-08130c30-2959-4793-a164-1e22d2937ad2 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:11.114984 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-08130c30-2959-4793-a164-1e22d2937ad2 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:11.115843 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-08130c30-2959-4793-a164-1e22d2937ad2 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:11.116490 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-08130c30-2959-4793-a164-1e22d2937ad2 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:11.117023 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-08130c30-2959-4793-a164-1e22d2937ad2 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:11.144790 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-08130c30-2959-4793-a164-1e22d2937ad2 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Getting quotas for project 9672a6c416ee44289eaa4d7c664d307e. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:13:11.153406 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-08130c30-2959-4793-a164-1e22d2937ad2 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Getting quotas for user 7daab4f69af5452c8641006d9f09edce and project 9672a6c416ee44289eaa4d7c664d307e. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:13:11.174117 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-08130c30-2959-4793-a164-1e22d2937ad2 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Going to run 1 instances... {{(pid=128758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:13:11.177933 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-08130c30-2959-4793-a164-1e22d2937ad2 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [instance: 53aade05-189d-455b-901e-6fb092cfbb07] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:13:11.281367 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-08130c30-2959-4793-a164-1e22d2937ad2 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.268064 Sep 14 09:13:11.282894 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2464/4902] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 09:13:10 2022] POST /compute/v2.1/servers => generated 401 bytes in 1270 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 14 09:13:11.295243 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-4cd7647c-9fce-48d6-b1fd-dd2f9ee70697 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:13:11.296718 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-4cd7647c-9fce-48d6-b1fd-dd2f9ee70697 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [instance: 53aade05-189d-455b-901e-6fb092cfbb07] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:13:11.380517 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-bccc524d-2ce2-4aa3-ac8e-2ba8875fa286 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:13:11.381152 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-bccc524d-2ce2-4aa3-ac8e-2ba8875fa286 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] [instance: b6babb9f-02ef-445c-bf52-a329fe43964f] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:13:11.391363 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bccc524d-2ce2-4aa3-ac8e-2ba8875fa286 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:11.392884 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bccc524d-2ce2-4aa3-ac8e-2ba8875fa286 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:11.393660 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bccc524d-2ce2-4aa3-ac8e-2ba8875fa286 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:11.398101 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bccc524d-2ce2-4aa3-ac8e-2ba8875fa286 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:11.398880 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bccc524d-2ce2-4aa3-ac8e-2ba8875fa286 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:11.400441 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bccc524d-2ce2-4aa3-ac8e-2ba8875fa286 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:11.582252 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-4cd7647c-9fce-48d6-b1fd-dd2f9ee70697 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daab4f69af5452c8641006d9f09edce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9672a6c416ee44289eaa4d7c664d307e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:13:11.596234 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-4cd7647c-9fce-48d6-b1fd-dd2f9ee70697 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "GET /compute/v2.1/servers/53aade05-189d-455b-901e-6fb092cfbb07" status: 200 len: 1241 microversion: 2.1 time: 0.306037 Sep 14 09:13:11.599195 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2439/4903] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:13:11 2022] GET /compute/v2.1/servers/53aade05-189d-455b-901e-6fb092cfbb07 => generated 1241 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:13:11.636872 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-181b721f-8702-4321-a486-4007af41c3ab tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:13:11.642092 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-181b721f-8702-4321-a486-4007af41c3ab tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:13:11.682385 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-181b721f-8702-4321-a486-4007af41c3ab tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:11.683209 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-181b721f-8702-4321-a486-4007af41c3ab tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:11.684427 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-181b721f-8702-4321-a486-4007af41c3ab tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:11.685767 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-181b721f-8702-4321-a486-4007af41c3ab tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:11.687664 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-181b721f-8702-4321-a486-4007af41c3ab tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:11.688317 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-181b721f-8702-4321-a486-4007af41c3ab tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:11.820688 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-bccc524d-2ce2-4aa3-ac8e-2ba8875fa286 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421bf1609a6d4f808a4cb3612bf64615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a020c15f895946328ab384514c1ba463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:13:11.829913 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-bccc524d-2ce2-4aa3-ac8e-2ba8875fa286 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] 10.222.0.60 "GET /compute/v2.1/servers/b6babb9f-02ef-445c-bf52-a329fe43964f" status: 200 len: 1314 microversion: 2.1 time: 0.453788 Sep 14 09:13:11.843658 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2465/4904] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:13:11 2022] GET /compute/v2.1/servers/b6babb9f-02ef-445c-bf52-a329fe43964f => generated 1314 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:13:11.947089 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:13:11.994658 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-181b721f-8702-4321-a486-4007af41c3ab tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "POST /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105/action" status: 202 len: 0 microversion: 2.1 time: 0.367191 Sep 14 09:13:12.004019 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2440/4905] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:13:11 2022] POST /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105/action => generated 0 bytes in 381 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:13:12.007503 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-7697aced-1ba9-47a9-9598-ede27afb7e25 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:13:12.008131 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-7697aced-1ba9-47a9-9598-ede27afb7e25 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:13:12.020904 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7697aced-1ba9-47a9-9598-ede27afb7e25 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:12.021444 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7697aced-1ba9-47a9-9598-ede27afb7e25 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:12.021889 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7697aced-1ba9-47a9-9598-ede27afb7e25 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:12.022549 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7697aced-1ba9-47a9-9598-ede27afb7e25 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:12.023169 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7697aced-1ba9-47a9-9598-ede27afb7e25 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:12.023500 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7697aced-1ba9-47a9-9598-ede27afb7e25 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:12.437432 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-7697aced-1ba9-47a9-9598-ede27afb7e25 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:13:12.470177 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-7697aced-1ba9-47a9-9598-ede27afb7e25 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105" status: 200 len: 1670 microversion: 2.1 time: 0.466113 Sep 14 09:13:12.495915 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2466/4906] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:13:12 2022] GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105 => generated 1670 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:13:12.628759 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f9c86351-c878-4f41-ac1a-d7dbcb10c89c tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:13:12.629594 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f9c86351-c878-4f41-ac1a-d7dbcb10c89c tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [instance: 53aade05-189d-455b-901e-6fb092cfbb07] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:13:12.649467 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f9c86351-c878-4f41-ac1a-d7dbcb10c89c tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:12.653802 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f9c86351-c878-4f41-ac1a-d7dbcb10c89c tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:12.658369 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f9c86351-c878-4f41-ac1a-d7dbcb10c89c tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:12.660340 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f9c86351-c878-4f41-ac1a-d7dbcb10c89c tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:12.662874 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f9c86351-c878-4f41-ac1a-d7dbcb10c89c tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:12.664383 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f9c86351-c878-4f41-ac1a-d7dbcb10c89c tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:12.867982 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-7d1ad3df-55a6-4f6b-994f-60f192fd27ab tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:13:12.869794 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-7d1ad3df-55a6-4f6b-994f-60f192fd27ab tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] [instance: b6babb9f-02ef-445c-bf52-a329fe43964f] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:13:12.879249 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f9c86351-c878-4f41-ac1a-d7dbcb10c89c tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daab4f69af5452c8641006d9f09edce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9672a6c416ee44289eaa4d7c664d307e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:13:12.898471 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f9c86351-c878-4f41-ac1a-d7dbcb10c89c tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "GET /compute/v2.1/servers/53aade05-189d-455b-901e-6fb092cfbb07" status: 200 len: 1293 microversion: 2.1 time: 0.273356 Sep 14 09:13:12.901195 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7d1ad3df-55a6-4f6b-994f-60f192fd27ab tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:12.901647 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7d1ad3df-55a6-4f6b-994f-60f192fd27ab tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:12.902077 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7d1ad3df-55a6-4f6b-994f-60f192fd27ab tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:12.907166 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7d1ad3df-55a6-4f6b-994f-60f192fd27ab tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:12.907773 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7d1ad3df-55a6-4f6b-994f-60f192fd27ab tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:12.908180 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7d1ad3df-55a6-4f6b-994f-60f192fd27ab tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:12.908838 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2441/4907] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:13:12 2022] GET /compute/v2.1/servers/53aade05-189d-455b-901e-6fb092cfbb07 => generated 1293 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:13:13.115706 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-cc569cde-62fd-4a71-8422-bd307002dd4d tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-128470948", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "networks": [{"uuid": "635abcae-8647-47ea-ae80-8072fd207058"}, {"uuid": "eb5ffba4-bfcb-419e-ae28-03bce641928c"}]}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:13:13.217596 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.network.neutron [None req-cc569cde-62fd-4a71-8422-bd307002dd4d tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] validate_networks() for [('635abcae-8647-47ea-ae80-8072fd207058', None, None, None, None, None), ('eb5ffba4-bfcb-419e-ae28-03bce641928c', None, None, None, None, None)] {{(pid=128759) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:13:13.469632 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-7d1ad3df-55a6-4f6b-994f-60f192fd27ab tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421bf1609a6d4f808a4cb3612bf64615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a020c15f895946328ab384514c1ba463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:13:13.486389 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-7d1ad3df-55a6-4f6b-994f-60f192fd27ab tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] 10.222.0.60 "GET /compute/v2.1/servers/b6babb9f-02ef-445c-bf52-a329fe43964f" status: 200 len: 1314 microversion: 2.1 time: 0.622475 Sep 14 09:13:13.494773 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2467/4908] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:13:12 2022] GET /compute/v2.1/servers/b6babb9f-02ef-445c-bf52-a329fe43964f => generated 1314 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:13:13.516298 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-36326bf2-2448-4776-b5cb-7dc169afe33f tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:13:13.518141 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-36326bf2-2448-4776-b5cb-7dc169afe33f tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:13:13.530233 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-36326bf2-2448-4776-b5cb-7dc169afe33f tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:13.534143 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-36326bf2-2448-4776-b5cb-7dc169afe33f tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:13.538168 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-36326bf2-2448-4776-b5cb-7dc169afe33f tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:13.539574 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-36326bf2-2448-4776-b5cb-7dc169afe33f tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:13.542391 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-36326bf2-2448-4776-b5cb-7dc169afe33f tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:13.543110 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-36326bf2-2448-4776-b5cb-7dc169afe33f tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:14.171695 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-36326bf2-2448-4776-b5cb-7dc169afe33f tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:13:14.188049 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-36326bf2-2448-4776-b5cb-7dc169afe33f tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105" status: 200 len: 1670 microversion: 2.1 time: 0.677458 Sep 14 09:13:14.206561 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2468/4909] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:13:13 2022] GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105 => generated 1670 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:13:14.218327 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-3eb8d559-6c03-409c-b48b-2080f5311c5b tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:13:14.226402 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-3eb8d559-6c03-409c-b48b-2080f5311c5b tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [instance: 53aade05-189d-455b-901e-6fb092cfbb07] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:13:14.245546 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3eb8d559-6c03-409c-b48b-2080f5311c5b tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:14.246584 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3eb8d559-6c03-409c-b48b-2080f5311c5b tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:14.247275 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3eb8d559-6c03-409c-b48b-2080f5311c5b tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:14.249601 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3eb8d559-6c03-409c-b48b-2080f5311c5b tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:14.251721 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3eb8d559-6c03-409c-b48b-2080f5311c5b tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:14.252372 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3eb8d559-6c03-409c-b48b-2080f5311c5b tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:14.378184 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-3eb8d559-6c03-409c-b48b-2080f5311c5b tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daab4f69af5452c8641006d9f09edce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9672a6c416ee44289eaa4d7c664d307e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:13:14.392004 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-3eb8d559-6c03-409c-b48b-2080f5311c5b tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "GET /compute/v2.1/servers/53aade05-189d-455b-901e-6fb092cfbb07" status: 200 len: 1299 microversion: 2.1 time: 0.184039 Sep 14 09:13:14.392875 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2469/4910] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:13:14 2022] GET /compute/v2.1/servers/53aade05-189d-455b-901e-6fb092cfbb07 => generated 1299 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:13:14.522425 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-18dd41d2-cb95-4f0e-b4cf-0b22bfdcc826 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:13:14.523970 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-18dd41d2-cb95-4f0e-b4cf-0b22bfdcc826 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] [instance: b6babb9f-02ef-445c-bf52-a329fe43964f] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:13:14.531158 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-18dd41d2-cb95-4f0e-b4cf-0b22bfdcc826 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:14.531943 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-18dd41d2-cb95-4f0e-b4cf-0b22bfdcc826 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:14.534125 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-18dd41d2-cb95-4f0e-b4cf-0b22bfdcc826 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:14.535126 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-18dd41d2-cb95-4f0e-b4cf-0b22bfdcc826 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:14.535768 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-18dd41d2-cb95-4f0e-b4cf-0b22bfdcc826 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:14.536377 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-18dd41d2-cb95-4f0e-b4cf-0b22bfdcc826 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:14.859566 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-18dd41d2-cb95-4f0e-b4cf-0b22bfdcc826 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421bf1609a6d4f808a4cb3612bf64615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a020c15f895946328ab384514c1ba463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:13:14.870297 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-18dd41d2-cb95-4f0e-b4cf-0b22bfdcc826 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] 10.222.0.60 "GET /compute/v2.1/servers/b6babb9f-02ef-445c-bf52-a329fe43964f" status: 200 len: 1314 microversion: 2.1 time: 0.352301 Sep 14 09:13:14.870824 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2470/4911] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:13:14 2022] GET /compute/v2.1/servers/b6babb9f-02ef-445c-bf52-a329fe43964f => generated 1314 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:13:15.222187 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-3f65b546-28db-49d1-b8db-19d9c67423f6 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:13:15.222806 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-3f65b546-28db-49d1-b8db-19d9c67423f6 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:13:15.235771 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3f65b546-28db-49d1-b8db-19d9c67423f6 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:15.240607 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3f65b546-28db-49d1-b8db-19d9c67423f6 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:15.241962 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3f65b546-28db-49d1-b8db-19d9c67423f6 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:15.243877 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3f65b546-28db-49d1-b8db-19d9c67423f6 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:15.249497 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3f65b546-28db-49d1-b8db-19d9c67423f6 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:15.250467 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3f65b546-28db-49d1-b8db-19d9c67423f6 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:15.254236 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=100 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:13:15.279496 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-cc569cde-62fd-4a71-8422-bd307002dd4d tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Flavor limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:13:15.280071 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-cc569cde-62fd-4a71-8422-bd307002dd4d tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Image limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:13:15.280541 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-cc569cde-62fd-4a71-8422-bd307002dd4d tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Flavor pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:13:15.280977 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-cc569cde-62fd-4a71-8422-bd307002dd4d tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Image pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:13:15.281431 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-cc569cde-62fd-4a71-8422-bd307002dd4d tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:13:15.299089 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cc569cde-62fd-4a71-8422-bd307002dd4d tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:15.299619 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cc569cde-62fd-4a71-8422-bd307002dd4d tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:15.300290 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cc569cde-62fd-4a71-8422-bd307002dd4d tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:15.301468 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cc569cde-62fd-4a71-8422-bd307002dd4d tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:15.302229 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cc569cde-62fd-4a71-8422-bd307002dd4d tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:15.302843 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cc569cde-62fd-4a71-8422-bd307002dd4d tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:15.351509 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-cc569cde-62fd-4a71-8422-bd307002dd4d tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Getting quotas for project b94e25a7caf946c2a80b874416e4906b. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:13:15.358743 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-cc569cde-62fd-4a71-8422-bd307002dd4d tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Getting quotas for user fe73f3d7f4734e1ab9f6b7283db1388b and project b94e25a7caf946c2a80b874416e4906b. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:13:15.378375 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-cc569cde-62fd-4a71-8422-bd307002dd4d tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Going to run 1 instances... {{(pid=128759) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:13:15.381960 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-cc569cde-62fd-4a71-8422-bd307002dd4d tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] [instance: ac1c3be3-de1d-456b-bfb9-aad6baafbb34] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128759) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:13:15.477180 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-cc569cde-62fd-4a71-8422-bd307002dd4d tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.366623 Sep 14 09:13:15.479490 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2442/4912] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 09:13:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 2370 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:13:15.486792 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e9b6cefe-fc27-411f-b365-3c0937ecdb01 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:13:15.494522 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e9b6cefe-fc27-411f-b365-3c0937ecdb01 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [instance: 53aade05-189d-455b-901e-6fb092cfbb07] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:13:15.496583 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e9b6cefe-fc27-411f-b365-3c0937ecdb01 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:15.501635 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e9b6cefe-fc27-411f-b365-3c0937ecdb01 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:15.502365 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e9b6cefe-fc27-411f-b365-3c0937ecdb01 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:15.503342 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e9b6cefe-fc27-411f-b365-3c0937ecdb01 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:15.504957 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e9b6cefe-fc27-411f-b365-3c0937ecdb01 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:15.505784 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e9b6cefe-fc27-411f-b365-3c0937ecdb01 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:15.511213 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-3f65b546-28db-49d1-b8db-19d9c67423f6 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:13:15.525792 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-3f65b546-28db-49d1-b8db-19d9c67423f6 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105" status: 200 len: 1668 microversion: 2.1 time: 0.307476 Sep 14 09:13:15.526433 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2471/4913] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:13:15 2022] GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105 => generated 1668 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:13:15.540048 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ba893c5f-17eb-4812-9344-7d67dc3d2bee tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:13:15.540700 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-ba893c5f-17eb-4812-9344-7d67dc3d2bee tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] [instance: ac1c3be3-de1d-456b-bfb9-aad6baafbb34] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:13:15.633968 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-ba893c5f-17eb-4812-9344-7d67dc3d2bee tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe73f3d7f4734e1ab9f6b7283db1388b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94e25a7caf946c2a80b874416e4906b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:13:15.641921 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-ba893c5f-17eb-4812-9344-7d67dc3d2bee tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] 10.222.0.60 "GET /compute/v2.1/servers/ac1c3be3-de1d-456b-bfb9-aad6baafbb34" status: 200 len: 1212 microversion: 2.1 time: 0.114276 Sep 14 09:13:15.642510 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2472/4914] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:13:15 2022] GET /compute/v2.1/servers/ac1c3be3-de1d-456b-bfb9-aad6baafbb34 => generated 1212 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:13:15.902159 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-df0e88bf-3f22-4480-beb3-c1a240d55ec9 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:13:15.902800 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-df0e88bf-3f22-4480-beb3-c1a240d55ec9 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] [instance: b6babb9f-02ef-445c-bf52-a329fe43964f] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:13:15.905877 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:13:15.922785 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-e9b6cefe-fc27-411f-b365-3c0937ecdb01 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daab4f69af5452c8641006d9f09edce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9672a6c416ee44289eaa4d7c664d307e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:13:15.945702 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-df0e88bf-3f22-4480-beb3-c1a240d55ec9 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:15.946234 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-df0e88bf-3f22-4480-beb3-c1a240d55ec9 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:15.947773 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e9b6cefe-fc27-411f-b365-3c0937ecdb01 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "GET /compute/v2.1/servers/53aade05-189d-455b-901e-6fb092cfbb07" status: 200 len: 1366 microversion: 2.1 time: 0.464495 Sep 14 09:13:15.949723 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2443/4915] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:13:15 2022] GET /compute/v2.1/servers/53aade05-189d-455b-901e-6fb092cfbb07 => generated 1366 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:13:15.951528 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-df0e88bf-3f22-4480-beb3-c1a240d55ec9 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:15.952308 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-df0e88bf-3f22-4480-beb3-c1a240d55ec9 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:15.954604 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-df0e88bf-3f22-4480-beb3-c1a240d55ec9 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:15.955746 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-df0e88bf-3f22-4480-beb3-c1a240d55ec9 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:16.537073 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-46fbee63-47d1-4e6b-9d86-69c8aee7e0bd req-dabbb5e0-08de-4064-ae2a-1ffb67d2f92b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6babb9f-02ef-445c-bf52-a329fe43964f", "name": "network-vif-plugged", "status": "completed", "tag": "c2ec6305-e5ef-4396-8668-7b097ef75ea2"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:13:16.567877 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:13:16.582081 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-46fbee63-47d1-4e6b-9d86-69c8aee7e0bd req-dabbb5e0-08de-4064-ae2a-1ffb67d2f92b service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:16.584145 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-46fbee63-47d1-4e6b-9d86-69c8aee7e0bd req-dabbb5e0-08de-4064-ae2a-1ffb67d2f92b service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:16.584969 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-46fbee63-47d1-4e6b-9d86-69c8aee7e0bd req-dabbb5e0-08de-4064-ae2a-1ffb67d2f92b service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:16.604143 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-46fbee63-47d1-4e6b-9d86-69c8aee7e0bd req-dabbb5e0-08de-4064-ae2a-1ffb67d2f92b service nova] Creating event network-vif-plugged:c2ec6305-e5ef-4396-8668-7b097ef75ea2 for instance b6babb9f-02ef-445c-bf52-a329fe43964f on n-h2-836830-18 Sep 14 09:13:16.616580 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-46fbee63-47d1-4e6b-9d86-69c8aee7e0bd req-dabbb5e0-08de-4064-ae2a-1ffb67d2f92b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083854 Sep 14 09:13:16.618813 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2444/4916] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:13:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:13:16.671662 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3420fc9f-a23c-4a91-aaa4-1f06a0ce02e3 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:13:16.672960 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-3420fc9f-a23c-4a91-aaa4-1f06a0ce02e3 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] [instance: ac1c3be3-de1d-456b-bfb9-aad6baafbb34] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:13:16.702413 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3420fc9f-a23c-4a91-aaa4-1f06a0ce02e3 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:16.713401 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3420fc9f-a23c-4a91-aaa4-1f06a0ce02e3 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:16.718888 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3420fc9f-a23c-4a91-aaa4-1f06a0ce02e3 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:16.723841 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3420fc9f-a23c-4a91-aaa4-1f06a0ce02e3 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:16.724412 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3420fc9f-a23c-4a91-aaa4-1f06a0ce02e3 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:16.726342 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3420fc9f-a23c-4a91-aaa4-1f06a0ce02e3 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:16.899406 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-3420fc9f-a23c-4a91-aaa4-1f06a0ce02e3 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe73f3d7f4734e1ab9f6b7283db1388b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94e25a7caf946c2a80b874416e4906b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:13:16.931521 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-3420fc9f-a23c-4a91-aaa4-1f06a0ce02e3 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] 10.222.0.60 "GET /compute/v2.1/servers/ac1c3be3-de1d-456b-bfb9-aad6baafbb34" status: 200 len: 1208 microversion: 2.1 time: 0.266878 Sep 14 09:13:16.933331 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2445/4917] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:13:16 2022] GET /compute/v2.1/servers/ac1c3be3-de1d-456b-bfb9-aad6baafbb34 => generated 1208 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:13:16.982188 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b8f9d738-bf40-4027-b9a9-0a6b07932792 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:13:16.983540 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b8f9d738-bf40-4027-b9a9-0a6b07932792 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [instance: 53aade05-189d-455b-901e-6fb092cfbb07] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:13:16.998271 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b8f9d738-bf40-4027-b9a9-0a6b07932792 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:16.999394 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b8f9d738-bf40-4027-b9a9-0a6b07932792 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:17.000008 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b8f9d738-bf40-4027-b9a9-0a6b07932792 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:17.000901 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b8f9d738-bf40-4027-b9a9-0a6b07932792 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:17.005489 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b8f9d738-bf40-4027-b9a9-0a6b07932792 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:17.005831 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-df0e88bf-3f22-4480-beb3-c1a240d55ec9 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421bf1609a6d4f808a4cb3612bf64615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a020c15f895946328ab384514c1ba463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:13:17.007483 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b8f9d738-bf40-4027-b9a9-0a6b07932792 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:17.030665 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-df0e88bf-3f22-4480-beb3-c1a240d55ec9 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] 10.222.0.60 "GET /compute/v2.1/servers/b6babb9f-02ef-445c-bf52-a329fe43964f" status: 200 len: 1314 microversion: 2.1 time: 1.128274 Sep 14 09:13:17.032176 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2473/4918] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:13:15 2022] GET /compute/v2.1/servers/b6babb9f-02ef-445c-bf52-a329fe43964f => generated 1314 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:13:17.227555 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b8f9d738-bf40-4027-b9a9-0a6b07932792 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daab4f69af5452c8641006d9f09edce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9672a6c416ee44289eaa4d7c664d307e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:13:17.244867 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b8f9d738-bf40-4027-b9a9-0a6b07932792 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "GET /compute/v2.1/servers/53aade05-189d-455b-901e-6fb092cfbb07" status: 200 len: 1366 microversion: 2.1 time: 0.272375 Sep 14 09:13:17.266096 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2446/4919] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:13:16 2022] GET /compute/v2.1/servers/53aade05-189d-455b-901e-6fb092cfbb07 => generated 1366 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:13:17.962363 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-9163256c-3d42-4934-90b7-7ccc99871028 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:13:17.963449 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-9163256c-3d42-4934-90b7-7ccc99871028 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] [instance: ac1c3be3-de1d-456b-bfb9-aad6baafbb34] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:13:17.975799 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9163256c-3d42-4934-90b7-7ccc99871028 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:17.976742 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9163256c-3d42-4934-90b7-7ccc99871028 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:17.977733 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9163256c-3d42-4934-90b7-7ccc99871028 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:17.978687 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9163256c-3d42-4934-90b7-7ccc99871028 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:17.980117 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9163256c-3d42-4934-90b7-7ccc99871028 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:17.980765 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9163256c-3d42-4934-90b7-7ccc99871028 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:18.058472 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9fbc3f25-a2ba-46f5-b433-67f8136b6d3c tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:13:18.059143 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-9fbc3f25-a2ba-46f5-b433-67f8136b6d3c tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] [instance: b6babb9f-02ef-445c-bf52-a329fe43964f] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:13:18.079990 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9fbc3f25-a2ba-46f5-b433-67f8136b6d3c tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:18.080728 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9fbc3f25-a2ba-46f5-b433-67f8136b6d3c tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:18.081392 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9fbc3f25-a2ba-46f5-b433-67f8136b6d3c tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:18.082644 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9fbc3f25-a2ba-46f5-b433-67f8136b6d3c tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:18.083347 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9fbc3f25-a2ba-46f5-b433-67f8136b6d3c tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:18.083957 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9fbc3f25-a2ba-46f5-b433-67f8136b6d3c tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:18.142453 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-9163256c-3d42-4934-90b7-7ccc99871028 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe73f3d7f4734e1ab9f6b7283db1388b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94e25a7caf946c2a80b874416e4906b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:13:18.155990 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-9163256c-3d42-4934-90b7-7ccc99871028 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] 10.222.0.60 "GET /compute/v2.1/servers/ac1c3be3-de1d-456b-bfb9-aad6baafbb34" status: 200 len: 1272 microversion: 2.1 time: 0.198644 Sep 14 09:13:18.157932 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2474/4920] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:13:17 2022] GET /compute/v2.1/servers/ac1c3be3-de1d-456b-bfb9-aad6baafbb34 => generated 1272 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:13:18.276443 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-83302981-d326-479f-9125-dda813fb70d2 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:13:18.277340 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-83302981-d326-479f-9125-dda813fb70d2 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [instance: 53aade05-189d-455b-901e-6fb092cfbb07] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:13:18.286582 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-83302981-d326-479f-9125-dda813fb70d2 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:18.287388 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-83302981-d326-479f-9125-dda813fb70d2 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:18.288125 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-83302981-d326-479f-9125-dda813fb70d2 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:18.301686 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-83302981-d326-479f-9125-dda813fb70d2 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:18.303525 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-83302981-d326-479f-9125-dda813fb70d2 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:18.308819 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-83302981-d326-479f-9125-dda813fb70d2 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:18.685647 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-9fbc3f25-a2ba-46f5-b433-67f8136b6d3c tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421bf1609a6d4f808a4cb3612bf64615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a020c15f895946328ab384514c1ba463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:13:18.705205 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-9fbc3f25-a2ba-46f5-b433-67f8136b6d3c tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] 10.222.0.60 "GET /compute/v2.1/servers/b6babb9f-02ef-445c-bf52-a329fe43964f" status: 200 len: 1314 microversion: 2.1 time: 0.652035 Sep 14 09:13:18.706784 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2447/4921] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:13:18 2022] GET /compute/v2.1/servers/b6babb9f-02ef-445c-bf52-a329fe43964f => generated 1314 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:13:18.810551 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-83302981-d326-479f-9125-dda813fb70d2 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daab4f69af5452c8641006d9f09edce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9672a6c416ee44289eaa4d7c664d307e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:13:18.819583 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-83302981-d326-479f-9125-dda813fb70d2 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "GET /compute/v2.1/servers/53aade05-189d-455b-901e-6fb092cfbb07" status: 200 len: 1366 microversion: 2.1 time: 0.549292 Sep 14 09:13:18.821811 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2475/4922] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:13:18 2022] GET /compute/v2.1/servers/53aade05-189d-455b-901e-6fb092cfbb07 => generated 1366 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:13:19.180735 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-381acf75-c465-4987-8567-7a13018478c4 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:13:19.181989 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-381acf75-c465-4987-8567-7a13018478c4 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] [instance: ac1c3be3-de1d-456b-bfb9-aad6baafbb34] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:13:19.197411 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-381acf75-c465-4987-8567-7a13018478c4 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:19.198349 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-381acf75-c465-4987-8567-7a13018478c4 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:19.199072 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-381acf75-c465-4987-8567-7a13018478c4 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:19.200086 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-381acf75-c465-4987-8567-7a13018478c4 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:19.200785 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-381acf75-c465-4987-8567-7a13018478c4 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:19.201452 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-381acf75-c465-4987-8567-7a13018478c4 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:19.332815 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-381acf75-c465-4987-8567-7a13018478c4 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe73f3d7f4734e1ab9f6b7283db1388b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94e25a7caf946c2a80b874416e4906b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:13:19.341609 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-381acf75-c465-4987-8567-7a13018478c4 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] 10.222.0.60 "GET /compute/v2.1/servers/ac1c3be3-de1d-456b-bfb9-aad6baafbb34" status: 200 len: 1270 microversion: 2.1 time: 0.164737 Sep 14 09:13:19.347962 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2448/4923] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:13:19 2022] GET /compute/v2.1/servers/ac1c3be3-de1d-456b-bfb9-aad6baafbb34 => generated 1270 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:13:19.727754 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-f78aecdd-bf67-471e-bffa-c2bf46e6e207 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:13:19.728375 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-f78aecdd-bf67-471e-bffa-c2bf46e6e207 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] [instance: b6babb9f-02ef-445c-bf52-a329fe43964f] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:13:19.736740 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f78aecdd-bf67-471e-bffa-c2bf46e6e207 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:19.737225 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f78aecdd-bf67-471e-bffa-c2bf46e6e207 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:19.737662 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f78aecdd-bf67-471e-bffa-c2bf46e6e207 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:19.738364 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f78aecdd-bf67-471e-bffa-c2bf46e6e207 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:19.738818 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f78aecdd-bf67-471e-bffa-c2bf46e6e207 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:19.739272 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f78aecdd-bf67-471e-bffa-c2bf46e6e207 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:19.844953 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b24850e8-5fc4-4133-a8b5-c16cd1f22bb2 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:13:19.846048 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b24850e8-5fc4-4133-a8b5-c16cd1f22bb2 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [instance: 53aade05-189d-455b-901e-6fb092cfbb07] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:13:19.854000 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b24850e8-5fc4-4133-a8b5-c16cd1f22bb2 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:19.854705 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b24850e8-5fc4-4133-a8b5-c16cd1f22bb2 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:19.855380 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b24850e8-5fc4-4133-a8b5-c16cd1f22bb2 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:19.856151 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b24850e8-5fc4-4133-a8b5-c16cd1f22bb2 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:19.856622 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b24850e8-5fc4-4133-a8b5-c16cd1f22bb2 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:19.857064 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b24850e8-5fc4-4133-a8b5-c16cd1f22bb2 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:19.893485 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-f78aecdd-bf67-471e-bffa-c2bf46e6e207 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421bf1609a6d4f808a4cb3612bf64615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a020c15f895946328ab384514c1ba463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:13:19.903037 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-f78aecdd-bf67-471e-bffa-c2bf46e6e207 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] 10.222.0.60 "GET /compute/v2.1/servers/b6babb9f-02ef-445c-bf52-a329fe43964f" status: 200 len: 1498 microversion: 2.1 time: 0.179077 Sep 14 09:13:19.905233 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2476/4924] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:13:19 2022] GET /compute/v2.1/servers/b6babb9f-02ef-445c-bf52-a329fe43964f => generated 1498 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:13:20.042532 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b24850e8-5fc4-4133-a8b5-c16cd1f22bb2 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daab4f69af5452c8641006d9f09edce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9672a6c416ee44289eaa4d7c664d307e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:13:20.056002 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b24850e8-5fc4-4133-a8b5-c16cd1f22bb2 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "GET /compute/v2.1/servers/53aade05-189d-455b-901e-6fb092cfbb07" status: 200 len: 1366 microversion: 2.1 time: 0.214853 Sep 14 09:13:20.058667 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2449/4925] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:13:19 2022] GET /compute/v2.1/servers/53aade05-189d-455b-901e-6fb092cfbb07 => generated 1366 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:13:20.364330 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1814ec4e-4c75-45fd-a95d-ecd68cc33b6e tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:13:20.364884 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-1814ec4e-4c75-45fd-a95d-ecd68cc33b6e tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] [instance: b6babb9f-02ef-445c-bf52-a329fe43964f] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:13:20.365700 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-937d30eb-42a5-4e6e-a2da-d7f65f6c6465 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:13:20.366478 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-937d30eb-42a5-4e6e-a2da-d7f65f6c6465 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] [instance: ac1c3be3-de1d-456b-bfb9-aad6baafbb34] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:13:20.373264 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1814ec4e-4c75-45fd-a95d-ecd68cc33b6e tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:20.373755 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1814ec4e-4c75-45fd-a95d-ecd68cc33b6e tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:20.374351 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1814ec4e-4c75-45fd-a95d-ecd68cc33b6e tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:20.375089 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1814ec4e-4c75-45fd-a95d-ecd68cc33b6e tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:20.375414 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-937d30eb-42a5-4e6e-a2da-d7f65f6c6465 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:20.375539 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1814ec4e-4c75-45fd-a95d-ecd68cc33b6e tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:20.375962 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1814ec4e-4c75-45fd-a95d-ecd68cc33b6e tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:20.376118 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-937d30eb-42a5-4e6e-a2da-d7f65f6c6465 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:20.376650 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-937d30eb-42a5-4e6e-a2da-d7f65f6c6465 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:20.377555 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-937d30eb-42a5-4e6e-a2da-d7f65f6c6465 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:20.378077 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-937d30eb-42a5-4e6e-a2da-d7f65f6c6465 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:20.378879 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-937d30eb-42a5-4e6e-a2da-d7f65f6c6465 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:20.414356 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-1814ec4e-4c75-45fd-a95d-ecd68cc33b6e tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] [instance: b6babb9f-02ef-445c-bf52-a329fe43964f] Going to try to terminate instance {{(pid=128758) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:13:20.550417 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-1814ec4e-4c75-45fd-a95d-ecd68cc33b6e tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] 10.222.0.60 "DELETE /compute/v2.1/servers/b6babb9f-02ef-445c-bf52-a329fe43964f" status: 204 len: 0 microversion: 2.1 time: 0.192602 Sep 14 09:13:20.555335 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2477/4926] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:13:20 2022] DELETE /compute/v2.1/servers/b6babb9f-02ef-445c-bf52-a329fe43964f => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:13:20.568759 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-c7adefed-ed15-4bdc-84e2-8efe15059ba9 req-7c3d2a5a-923a-4724-a59b-ebe8e9a538df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53aade05-189d-455b-901e-6fb092cfbb07", "tag": "90bc5925-bdaa-4a69-ba3a-ee4df95942a0"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:13:20.581530 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-c7adefed-ed15-4bdc-84e2-8efe15059ba9 req-7c3d2a5a-923a-4724-a59b-ebe8e9a538df service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:20.582228 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-c7adefed-ed15-4bdc-84e2-8efe15059ba9 req-7c3d2a5a-923a-4724-a59b-ebe8e9a538df service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:20.582658 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-c7adefed-ed15-4bdc-84e2-8efe15059ba9 req-7c3d2a5a-923a-4724-a59b-ebe8e9a538df service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:20.592192 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-937d30eb-42a5-4e6e-a2da-d7f65f6c6465 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe73f3d7f4734e1ab9f6b7283db1388b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94e25a7caf946c2a80b874416e4906b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:13:20.603610 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-c7adefed-ed15-4bdc-84e2-8efe15059ba9 req-7c3d2a5a-923a-4724-a59b-ebe8e9a538df service nova] Creating event network-changed:90bc5925-bdaa-4a69-ba3a-ee4df95942a0 for instance 53aade05-189d-455b-901e-6fb092cfbb07 on n-h1-836830-18 Sep 14 09:13:20.604209 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-937d30eb-42a5-4e6e-a2da-d7f65f6c6465 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] 10.222.0.60 "GET /compute/v2.1/servers/ac1c3be3-de1d-456b-bfb9-aad6baafbb34" status: 200 len: 1312 microversion: 2.1 time: 0.242313 Sep 14 09:13:20.614973 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2450/4927] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:13:20 2022] GET /compute/v2.1/servers/ac1c3be3-de1d-456b-bfb9-aad6baafbb34 => generated 1312 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:13:20.615179 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-c7adefed-ed15-4bdc-84e2-8efe15059ba9 req-7c3d2a5a-923a-4724-a59b-ebe8e9a538df service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051916 Sep 14 09:13:20.615179 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2478/4928] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:13:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:13:20.615432 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-7d5c2eff-e5cc-472d-b806-0cfb1248b314 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:13:20.615432 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-7d5c2eff-e5cc-472d-b806-0cfb1248b314 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] [instance: b6babb9f-02ef-445c-bf52-a329fe43964f] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:13:20.619856 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7d5c2eff-e5cc-472d-b806-0cfb1248b314 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:20.620353 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7d5c2eff-e5cc-472d-b806-0cfb1248b314 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:20.620794 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7d5c2eff-e5cc-472d-b806-0cfb1248b314 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:20.621499 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7d5c2eff-e5cc-472d-b806-0cfb1248b314 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:20.622522 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7d5c2eff-e5cc-472d-b806-0cfb1248b314 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:20.622975 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7d5c2eff-e5cc-472d-b806-0cfb1248b314 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:20.810715 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-7d5c2eff-e5cc-472d-b806-0cfb1248b314 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421bf1609a6d4f808a4cb3612bf64615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a020c15f895946328ab384514c1ba463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:13:20.821559 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-7d5c2eff-e5cc-472d-b806-0cfb1248b314 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] 10.222.0.60 "GET /compute/v2.1/servers/b6babb9f-02ef-445c-bf52-a329fe43964f" status: 200 len: 1504 microversion: 2.1 time: 0.215302 Sep 14 09:13:20.822892 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2451/4929] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:13:20 2022] GET /compute/v2.1/servers/b6babb9f-02ef-445c-bf52-a329fe43964f => generated 1504 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:13:21.082394 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-276e5cea-c215-4acb-a7e0-93cdc5e1f34b tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:13:21.083248 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-276e5cea-c215-4acb-a7e0-93cdc5e1f34b tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [instance: 53aade05-189d-455b-901e-6fb092cfbb07] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:13:21.089833 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-276e5cea-c215-4acb-a7e0-93cdc5e1f34b tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:21.091013 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-276e5cea-c215-4acb-a7e0-93cdc5e1f34b tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:21.091286 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-276e5cea-c215-4acb-a7e0-93cdc5e1f34b tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:21.091984 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-276e5cea-c215-4acb-a7e0-93cdc5e1f34b tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:21.092435 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-276e5cea-c215-4acb-a7e0-93cdc5e1f34b tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:21.092858 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-276e5cea-c215-4acb-a7e0-93cdc5e1f34b tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:21.127933 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=4 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:13:21.228900 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-276e5cea-c215-4acb-a7e0-93cdc5e1f34b tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daab4f69af5452c8641006d9f09edce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9672a6c416ee44289eaa4d7c664d307e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:13:21.237247 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-276e5cea-c215-4acb-a7e0-93cdc5e1f34b tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "GET /compute/v2.1/servers/53aade05-189d-455b-901e-6fb092cfbb07" status: 200 len: 1366 microversion: 2.1 time: 0.160162 Sep 14 09:13:21.238449 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2479/4930] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:13:21 2022] GET /compute/v2.1/servers/53aade05-189d-455b-901e-6fb092cfbb07 => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:13:21.635670 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e8ed14eb-ed9c-450b-93d0-1b7535f16cce tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:13:21.636297 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e8ed14eb-ed9c-450b-93d0-1b7535f16cce tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] [instance: ac1c3be3-de1d-456b-bfb9-aad6baafbb34] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:13:21.644541 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e8ed14eb-ed9c-450b-93d0-1b7535f16cce tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:21.645082 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e8ed14eb-ed9c-450b-93d0-1b7535f16cce tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:21.645534 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e8ed14eb-ed9c-450b-93d0-1b7535f16cce tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:21.646240 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e8ed14eb-ed9c-450b-93d0-1b7535f16cce tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:21.646698 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e8ed14eb-ed9c-450b-93d0-1b7535f16cce tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:21.647350 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e8ed14eb-ed9c-450b-93d0-1b7535f16cce tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:21.851161 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-89091608-6f7e-43de-b1bd-8274d05a066e tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:13:21.853198 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-89091608-6f7e-43de-b1bd-8274d05a066e tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] [instance: b6babb9f-02ef-445c-bf52-a329fe43964f] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:13:21.864184 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-89091608-6f7e-43de-b1bd-8274d05a066e tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:21.865176 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-89091608-6f7e-43de-b1bd-8274d05a066e tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:21.865730 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-89091608-6f7e-43de-b1bd-8274d05a066e tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:21.866754 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-89091608-6f7e-43de-b1bd-8274d05a066e tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:21.867561 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-89091608-6f7e-43de-b1bd-8274d05a066e tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:21.868140 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-89091608-6f7e-43de-b1bd-8274d05a066e tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:21.884150 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-e8ed14eb-ed9c-450b-93d0-1b7535f16cce tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe73f3d7f4734e1ab9f6b7283db1388b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94e25a7caf946c2a80b874416e4906b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:13:21.902118 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e8ed14eb-ed9c-450b-93d0-1b7535f16cce tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] 10.222.0.60 "GET /compute/v2.1/servers/ac1c3be3-de1d-456b-bfb9-aad6baafbb34" status: 200 len: 1312 microversion: 2.1 time: 0.270203 Sep 14 09:13:21.905645 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2452/4931] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:13:21 2022] GET /compute/v2.1/servers/ac1c3be3-de1d-456b-bfb9-aad6baafbb34 => generated 1312 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:13:22.261428 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-59e79dd8-2eb8-4fc0-8f96-a5bf9c35a098 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:13:22.261695 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-59e79dd8-2eb8-4fc0-8f96-a5bf9c35a098 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [instance: 53aade05-189d-455b-901e-6fb092cfbb07] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:13:22.267733 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-59e79dd8-2eb8-4fc0-8f96-a5bf9c35a098 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:22.268623 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-59e79dd8-2eb8-4fc0-8f96-a5bf9c35a098 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:22.269320 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-59e79dd8-2eb8-4fc0-8f96-a5bf9c35a098 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:22.270312 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-59e79dd8-2eb8-4fc0-8f96-a5bf9c35a098 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:22.271030 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-59e79dd8-2eb8-4fc0-8f96-a5bf9c35a098 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:22.271692 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-59e79dd8-2eb8-4fc0-8f96-a5bf9c35a098 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:22.283459 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-89091608-6f7e-43de-b1bd-8274d05a066e tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421bf1609a6d4f808a4cb3612bf64615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a020c15f895946328ab384514c1ba463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:13:22.297814 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-89091608-6f7e-43de-b1bd-8274d05a066e tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] 10.222.0.60 "GET /compute/v2.1/servers/b6babb9f-02ef-445c-bf52-a329fe43964f" status: 200 len: 1504 microversion: 2.1 time: 0.455714 Sep 14 09:13:22.298437 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2480/4932] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:13:21 2022] GET /compute/v2.1/servers/b6babb9f-02ef-445c-bf52-a329fe43964f => generated 1504 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:13:22.698400 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-59e79dd8-2eb8-4fc0-8f96-a5bf9c35a098 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daab4f69af5452c8641006d9f09edce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9672a6c416ee44289eaa4d7c664d307e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:13:22.708809 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-59e79dd8-2eb8-4fc0-8f96-a5bf9c35a098 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "GET /compute/v2.1/servers/53aade05-189d-455b-901e-6fb092cfbb07" status: 200 len: 1366 microversion: 2.1 time: 0.451723 Sep 14 09:13:22.726674 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2453/4933] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:13:22 2022] GET /compute/v2.1/servers/53aade05-189d-455b-901e-6fb092cfbb07 => generated 1366 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:13:22.925914 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-7dc890f7-04e3-4257-9052-c00c60bda1c3 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:13:22.926831 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-7dc890f7-04e3-4257-9052-c00c60bda1c3 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] [instance: ac1c3be3-de1d-456b-bfb9-aad6baafbb34] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:13:22.933412 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7dc890f7-04e3-4257-9052-c00c60bda1c3 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:22.935652 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7dc890f7-04e3-4257-9052-c00c60bda1c3 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:22.936285 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7dc890f7-04e3-4257-9052-c00c60bda1c3 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:22.937190 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7dc890f7-04e3-4257-9052-c00c60bda1c3 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:22.937841 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7dc890f7-04e3-4257-9052-c00c60bda1c3 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:22.938275 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7dc890f7-04e3-4257-9052-c00c60bda1c3 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:23.189027 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-7dc890f7-04e3-4257-9052-c00c60bda1c3 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe73f3d7f4734e1ab9f6b7283db1388b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94e25a7caf946c2a80b874416e4906b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:13:23.201136 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-7dc890f7-04e3-4257-9052-c00c60bda1c3 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] 10.222.0.60 "GET /compute/v2.1/servers/ac1c3be3-de1d-456b-bfb9-aad6baafbb34" status: 200 len: 1312 microversion: 2.1 time: 0.276804 Sep 14 09:13:23.204013 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2481/4934] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:13:22 2022] GET /compute/v2.1/servers/ac1c3be3-de1d-456b-bfb9-aad6baafbb34 => generated 1312 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:13:23.322573 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c7037acb-0931-4929-957d-978a886de487 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:13:23.323511 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-c7037acb-0931-4929-957d-978a886de487 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] [instance: b6babb9f-02ef-445c-bf52-a329fe43964f] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:13:23.332752 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c7037acb-0931-4929-957d-978a886de487 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:23.334779 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c7037acb-0931-4929-957d-978a886de487 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:23.337489 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c7037acb-0931-4929-957d-978a886de487 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:23.338526 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c7037acb-0931-4929-957d-978a886de487 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:23.339232 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c7037acb-0931-4929-957d-978a886de487 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:23.341796 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c7037acb-0931-4929-957d-978a886de487 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:23.353700 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-e7730aff-06a9-4903-81f0-166232fd4cd6 req-be4a77e6-b6ac-494d-8db1-1a52b50f244e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6babb9f-02ef-445c-bf52-a329fe43964f", "name": "network-vif-deleted", "tag": "c2ec6305-e5ef-4396-8668-7b097ef75ea2"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:13:23.381950 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-e7730aff-06a9-4903-81f0-166232fd4cd6 req-be4a77e6-b6ac-494d-8db1-1a52b50f244e service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:23.385819 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-e7730aff-06a9-4903-81f0-166232fd4cd6 req-be4a77e6-b6ac-494d-8db1-1a52b50f244e service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:23.388063 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-e7730aff-06a9-4903-81f0-166232fd4cd6 req-be4a77e6-b6ac-494d-8db1-1a52b50f244e service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:23.418183 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-e7730aff-06a9-4903-81f0-166232fd4cd6 req-be4a77e6-b6ac-494d-8db1-1a52b50f244e service nova] Creating event network-vif-deleted:c2ec6305-e5ef-4396-8668-7b097ef75ea2 for instance b6babb9f-02ef-445c-bf52-a329fe43964f on n-h2-836830-18 Sep 14 09:13:23.435436 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-e7730aff-06a9-4903-81f0-166232fd4cd6 req-be4a77e6-b6ac-494d-8db1-1a52b50f244e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085372 Sep 14 09:13:23.436398 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2482/4935] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:13:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:13:23.504117 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-c7037acb-0931-4929-957d-978a886de487 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421bf1609a6d4f808a4cb3612bf64615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a020c15f895946328ab384514c1ba463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:13:23.520118 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-c7037acb-0931-4929-957d-978a886de487 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] 10.222.0.60 "GET /compute/v2.1/servers/b6babb9f-02ef-445c-bf52-a329fe43964f" status: 200 len: 1462 microversion: 2.1 time: 0.202194 Sep 14 09:13:23.520736 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2454/4936] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:13:23 2022] GET /compute/v2.1/servers/b6babb9f-02ef-445c-bf52-a329fe43964f => generated 1462 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:13:23.734823 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-8b2b7659-fd41-4837-9c06-07b8bda64fb6 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:13:23.736627 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-8b2b7659-fd41-4837-9c06-07b8bda64fb6 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [instance: 53aade05-189d-455b-901e-6fb092cfbb07] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:13:23.746926 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8b2b7659-fd41-4837-9c06-07b8bda64fb6 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:23.749163 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8b2b7659-fd41-4837-9c06-07b8bda64fb6 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:23.749818 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8b2b7659-fd41-4837-9c06-07b8bda64fb6 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:23.751884 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8b2b7659-fd41-4837-9c06-07b8bda64fb6 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:23.754519 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8b2b7659-fd41-4837-9c06-07b8bda64fb6 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:23.755719 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8b2b7659-fd41-4837-9c06-07b8bda64fb6 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:24.161483 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-8b2b7659-fd41-4837-9c06-07b8bda64fb6 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daab4f69af5452c8641006d9f09edce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9672a6c416ee44289eaa4d7c664d307e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:13:24.172456 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-8b2b7659-fd41-4837-9c06-07b8bda64fb6 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "GET /compute/v2.1/servers/53aade05-189d-455b-901e-6fb092cfbb07" status: 200 len: 1366 microversion: 2.1 time: 0.441265 Sep 14 09:13:24.173835 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2483/4937] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:13:23 2022] GET /compute/v2.1/servers/53aade05-189d-455b-901e-6fb092cfbb07 => generated 1366 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:13:24.226341 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-7cdb8445-fc68-49d0-80df-7bf2218702d2 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:13:24.227046 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-7cdb8445-fc68-49d0-80df-7bf2218702d2 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] [instance: ac1c3be3-de1d-456b-bfb9-aad6baafbb34] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:13:24.239265 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7cdb8445-fc68-49d0-80df-7bf2218702d2 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:24.240630 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7cdb8445-fc68-49d0-80df-7bf2218702d2 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:24.241383 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7cdb8445-fc68-49d0-80df-7bf2218702d2 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:24.243390 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7cdb8445-fc68-49d0-80df-7bf2218702d2 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:24.244778 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7cdb8445-fc68-49d0-80df-7bf2218702d2 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:24.246195 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7cdb8445-fc68-49d0-80df-7bf2218702d2 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:24.549884 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d81308c9-b30b-4c0f-ad83-6ea439d1df80 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:13:24.550529 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-d81308c9-b30b-4c0f-ad83-6ea439d1df80 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] [instance: b6babb9f-02ef-445c-bf52-a329fe43964f] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:13:24.562998 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d81308c9-b30b-4c0f-ad83-6ea439d1df80 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:24.564696 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d81308c9-b30b-4c0f-ad83-6ea439d1df80 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:24.565202 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d81308c9-b30b-4c0f-ad83-6ea439d1df80 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:24.565947 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d81308c9-b30b-4c0f-ad83-6ea439d1df80 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:24.566419 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d81308c9-b30b-4c0f-ad83-6ea439d1df80 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:24.566854 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d81308c9-b30b-4c0f-ad83-6ea439d1df80 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:24.598081 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-d81308c9-b30b-4c0f-ad83-6ea439d1df80 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] HTTP exception thrown: Instance b6babb9f-02ef-445c-bf52-a329fe43964f could not be found. Sep 14 09:13:24.604170 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d81308c9-b30b-4c0f-ad83-6ea439d1df80 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Request method failure captured: Sep 14 09:13:24.604170 n-d-836830-18 devstack@n-api.service[128758]: request: GET /compute/v2.1/servers/b6babb9f-02ef-445c-bf52-a329fe43964f HTTP/1.1 Sep 14 09:13:24.604170 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 09:13:24.604170 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 09:13:24.604170 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 09:13:24.604170 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 09:13:24.604170 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 09:13:24.604170 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 09:13:24.604170 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 09:13:24.604170 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 09:13:24.604170 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZsaEPHsAnWxZrOYuD-xLVEsbIfmuOHPlUOT1hWl6X9nda8VkFyRgjwpTRu0kXD2TNExza081lKyneqUatk5d68cLnPExx1CVknFP6yCNX20j4bdvRtryE6L-kkZDfXy-gsM2_1iF5IlBVFn4zAIYu4h2owbM9uQL9HNOZK-j-ycyFQ Sep 14 09:13:24.604170 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 09:13:24.604170 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 09:13:24.604170 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 09:13:24.604170 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 09:13:24.604170 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 09:13:24.604170 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 09:13:24.604170 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: a020c15f895946328ab384514c1ba463 Sep 14 09:13:24.604170 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-VolumesActionsTest-716596873 Sep 14 09:13:24.604170 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 09:13:24.604170 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 09:13:24.604170 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a020c15f895946328ab384514c1ba463"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a020c15f895946328ab384514c1ba463"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a020c15f895946328ab384514c1ba463"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a020c15f895946328ab384514c1ba463"}]}] Sep 14 09:13:24.604170 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-VolumesActionsTest-716596873 Sep 14 09:13:24.604170 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: a020c15f895946328ab384514c1ba463 Sep 14 09:13:24.604170 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-VolumesActionsTest-716596873 Sep 14 09:13:24.604170 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-VolumesActionsTest-716596873-project Sep 14 09:13:24.604170 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 09:13:24.604170 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 09:13:24.604170 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 421bf1609a6d4f808a4cb3612bf64615 Sep 14 09:13:24.604170 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-VolumesActionsTest-716596873-project Sep 14 09:13:24.604170 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 09:13:24.604170 n-d-836830-18 devstack@n-api.service[128758]: exception: Instance b6babb9f-02ef-445c-bf52-a329fe43964f could not be found. Sep 14 09:13:24.604170 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': 'b6babb9f-02ef-445c-bf52-a329fe43964f'} Sep 14 09:13:24.604170 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:13:24.604170 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:13:24.604170 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:13:24.604170 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:13:24.604170 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:13:24.604170 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:13:24.604170 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:13:24.604170 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:13:24.604170 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:13:24.604170 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:13:24.604170 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6babb9f-02ef-445c-bf52-a329fe43964f could not be found. Sep 14 09:13:24.604170 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:13:24.604170 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:13:24.604170 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:13:24.604170 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:13:24.604170 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:13:24.604170 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:13:24.604170 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:13:24.604170 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:13:24.604170 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:13:24.604170 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:13:24.604170 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:13:24.604170 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:13:24.604170 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:13:24.604170 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:13:24.604170 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:13:24.604170 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:13:24.604170 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6babb9f-02ef-445c-bf52-a329fe43964f could not be found. Sep 14 09:13:24.604170 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:13:24.604170 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:13:24.604170 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:13:24.621149 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:13:24.621149 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:13:24.621149 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:13:24.621149 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:13:24.621149 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:13:24.621149 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6babb9f-02ef-445c-bf52-a329fe43964f could not be found. Sep 14 09:13:24.621149 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:13:24.621149 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d81308c9-b30b-4c0f-ad83-6ea439d1df80 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Returning 404 to user: Instance b6babb9f-02ef-445c-bf52-a329fe43964f could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:13:24.621149 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-d81308c9-b30b-4c0f-ad83-6ea439d1df80 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] 10.222.0.60 "GET /compute/v2.1/servers/b6babb9f-02ef-445c-bf52-a329fe43964f" status: 404 len: 111 microversion: 2.1 time: 0.059719 Sep 14 09:13:24.621149 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2484/4938] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:13:24 2022] GET /compute/v2.1/servers/b6babb9f-02ef-445c-bf52-a329fe43964f => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 14 09:13:24.735959 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-7cdb8445-fc68-49d0-80df-7bf2218702d2 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe73f3d7f4734e1ab9f6b7283db1388b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94e25a7caf946c2a80b874416e4906b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:13:24.745442 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-7cdb8445-fc68-49d0-80df-7bf2218702d2 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] 10.222.0.60 "GET /compute/v2.1/servers/ac1c3be3-de1d-456b-bfb9-aad6baafbb34" status: 200 len: 1333 microversion: 2.1 time: 0.523407 Sep 14 09:13:24.746137 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2455/4939] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:13:24 2022] GET /compute/v2.1/servers/ac1c3be3-de1d-456b-bfb9-aad6baafbb34 => generated 1333 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:13:24.813119 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-555d4dd2-003f-4207-8b25-5063114bd944 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1168393773", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "networks": [{"uuid": "88ba4c46-f0ea-42e7-ab61-91a6a12baee5"}]}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:13:24.910117 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.network.neutron [None req-555d4dd2-003f-4207-8b25-5063114bd944 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] validate_networks() for [('88ba4c46-f0ea-42e7-ab61-91a6a12baee5', None, None, None, None, None)] {{(pid=128758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:13:25.204139 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f364ee9c-a61d-4900-b0a3-858de4ba4fa6 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:13:25.204785 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f364ee9c-a61d-4900-b0a3-858de4ba4fa6 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [instance: 53aade05-189d-455b-901e-6fb092cfbb07] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:13:25.223024 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f364ee9c-a61d-4900-b0a3-858de4ba4fa6 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:25.223823 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f364ee9c-a61d-4900-b0a3-858de4ba4fa6 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:25.224461 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f364ee9c-a61d-4900-b0a3-858de4ba4fa6 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:25.225379 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f364ee9c-a61d-4900-b0a3-858de4ba4fa6 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:25.227866 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f364ee9c-a61d-4900-b0a3-858de4ba4fa6 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:25.228454 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f364ee9c-a61d-4900-b0a3-858de4ba4fa6 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:25.313480 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=2 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:13:25.370168 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=14 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:13:25.638786 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=14 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:13:25.898293 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f364ee9c-a61d-4900-b0a3-858de4ba4fa6 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daab4f69af5452c8641006d9f09edce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9672a6c416ee44289eaa4d7c664d307e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:13:25.912283 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f364ee9c-a61d-4900-b0a3-858de4ba4fa6 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "GET /compute/v2.1/servers/53aade05-189d-455b-901e-6fb092cfbb07" status: 200 len: 1366 microversion: 2.1 time: 0.708522 Sep 14 09:13:25.921198 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2456/4940] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:13:25 2022] GET /compute/v2.1/servers/53aade05-189d-455b-901e-6fb092cfbb07 => generated 1366 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:13:25.934123 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-332bd66c-dd5b-4c93-81db-0f7596d8db14 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:13:25.943527 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-332bd66c-dd5b-4c93-81db-0f7596d8db14 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] [instance: ac1c3be3-de1d-456b-bfb9-aad6baafbb34] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:13:25.958731 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-332bd66c-dd5b-4c93-81db-0f7596d8db14 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:25.959290 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-332bd66c-dd5b-4c93-81db-0f7596d8db14 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:25.959741 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-332bd66c-dd5b-4c93-81db-0f7596d8db14 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:25.960472 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-332bd66c-dd5b-4c93-81db-0f7596d8db14 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:25.960937 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-332bd66c-dd5b-4c93-81db-0f7596d8db14 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:25.961381 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-332bd66c-dd5b-4c93-81db-0f7596d8db14 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:26.441276 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-332bd66c-dd5b-4c93-81db-0f7596d8db14 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe73f3d7f4734e1ab9f6b7283db1388b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94e25a7caf946c2a80b874416e4906b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:13:26.473912 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-332bd66c-dd5b-4c93-81db-0f7596d8db14 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] 10.222.0.60 "GET /compute/v2.1/servers/ac1c3be3-de1d-456b-bfb9-aad6baafbb34" status: 200 len: 1333 microversion: 2.1 time: 0.551323 Sep 14 09:13:26.491560 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2457/4941] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:13:25 2022] GET /compute/v2.1/servers/ac1c3be3-de1d-456b-bfb9-aad6baafbb34 => generated 1333 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:13:26.948847 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-694970e2-1d47-4ec8-858e-b1644cb75c34 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:13:26.950440 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-694970e2-1d47-4ec8-858e-b1644cb75c34 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [instance: 53aade05-189d-455b-901e-6fb092cfbb07] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:13:26.961061 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-555d4dd2-003f-4207-8b25-5063114bd944 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Flavor limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:13:26.961545 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-555d4dd2-003f-4207-8b25-5063114bd944 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Image limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:13:26.962554 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-555d4dd2-003f-4207-8b25-5063114bd944 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Flavor pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:13:26.963147 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-555d4dd2-003f-4207-8b25-5063114bd944 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Image pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:13:26.963588 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-555d4dd2-003f-4207-8b25-5063114bd944 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:13:26.976958 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-694970e2-1d47-4ec8-858e-b1644cb75c34 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:26.977527 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-694970e2-1d47-4ec8-858e-b1644cb75c34 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:26.977978 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-694970e2-1d47-4ec8-858e-b1644cb75c34 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:26.982922 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-694970e2-1d47-4ec8-858e-b1644cb75c34 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:26.985565 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-694970e2-1d47-4ec8-858e-b1644cb75c34 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:26.986020 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-694970e2-1d47-4ec8-858e-b1644cb75c34 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:26.987026 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-555d4dd2-003f-4207-8b25-5063114bd944 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:26.987509 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-555d4dd2-003f-4207-8b25-5063114bd944 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:26.987943 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-555d4dd2-003f-4207-8b25-5063114bd944 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:26.992886 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-555d4dd2-003f-4207-8b25-5063114bd944 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:26.993393 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-555d4dd2-003f-4207-8b25-5063114bd944 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:26.993818 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-555d4dd2-003f-4207-8b25-5063114bd944 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:27.049315 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-555d4dd2-003f-4207-8b25-5063114bd944 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Getting quotas for project a020c15f895946328ab384514c1ba463. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:13:27.056285 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-555d4dd2-003f-4207-8b25-5063114bd944 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Getting quotas for user 421bf1609a6d4f808a4cb3612bf64615 and project a020c15f895946328ab384514c1ba463. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:13:27.084087 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-555d4dd2-003f-4207-8b25-5063114bd944 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Going to run 1 instances... {{(pid=128758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:13:27.087804 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-555d4dd2-003f-4207-8b25-5063114bd944 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] [instance: d8ae775e-e822-487d-a211-a4f4bd042c21] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:13:27.160529 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-555d4dd2-003f-4207-8b25-5063114bd944 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.351232 Sep 14 09:13:27.169024 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2485/4942] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 09:13:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 2360 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:13:27.174831 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-75a4137b-7170-4d80-b46f-194037bee070 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:13:27.175925 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-75a4137b-7170-4d80-b46f-194037bee070 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] [instance: d8ae775e-e822-487d-a211-a4f4bd042c21] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:13:27.278055 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-75a4137b-7170-4d80-b46f-194037bee070 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421bf1609a6d4f808a4cb3612bf64615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a020c15f895946328ab384514c1ba463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:13:27.295869 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-75a4137b-7170-4d80-b46f-194037bee070 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] 10.222.0.60 "GET /compute/v2.1/servers/d8ae775e-e822-487d-a211-a4f4bd042c21" status: 200 len: 1214 microversion: 2.1 time: 0.125303 Sep 14 09:13:27.297620 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2486/4943] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:13:27 2022] GET /compute/v2.1/servers/d8ae775e-e822-487d-a211-a4f4bd042c21 => generated 1214 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:13:27.330602 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-694970e2-1d47-4ec8-858e-b1644cb75c34 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daab4f69af5452c8641006d9f09edce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9672a6c416ee44289eaa4d7c664d307e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:13:27.347884 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=100 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:13:27.357249 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-694970e2-1d47-4ec8-858e-b1644cb75c34 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "GET /compute/v2.1/servers/53aade05-189d-455b-901e-6fb092cfbb07" status: 200 len: 1366 microversion: 2.1 time: 0.411284 Sep 14 09:13:27.358744 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2458/4944] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:13:26 2022] GET /compute/v2.1/servers/53aade05-189d-455b-901e-6fb092cfbb07 => generated 1366 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:13:27.505935 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b187dad2-01ce-46bc-a9d4-f49dc63fc351 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:13:27.507621 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-b187dad2-01ce-46bc-a9d4-f49dc63fc351 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] [instance: ac1c3be3-de1d-456b-bfb9-aad6baafbb34] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:13:27.520778 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b187dad2-01ce-46bc-a9d4-f49dc63fc351 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:27.523389 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b187dad2-01ce-46bc-a9d4-f49dc63fc351 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:27.524111 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b187dad2-01ce-46bc-a9d4-f49dc63fc351 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:27.526333 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b187dad2-01ce-46bc-a9d4-f49dc63fc351 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:27.528658 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b187dad2-01ce-46bc-a9d4-f49dc63fc351 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:27.529662 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b187dad2-01ce-46bc-a9d4-f49dc63fc351 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:27.931462 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-b187dad2-01ce-46bc-a9d4-f49dc63fc351 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe73f3d7f4734e1ab9f6b7283db1388b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94e25a7caf946c2a80b874416e4906b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:13:27.945008 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-b187dad2-01ce-46bc-a9d4-f49dc63fc351 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] 10.222.0.60 "GET /compute/v2.1/servers/ac1c3be3-de1d-456b-bfb9-aad6baafbb34" status: 200 len: 1333 microversion: 2.1 time: 0.443654 Sep 14 09:13:27.946711 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2487/4945] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:13:27 2022] GET /compute/v2.1/servers/ac1c3be3-de1d-456b-bfb9-aad6baafbb34 => generated 1333 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:13:28.329439 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-87c9e3e9-23bb-4ae1-adda-841a4b80d54a tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:13:28.330803 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-87c9e3e9-23bb-4ae1-adda-841a4b80d54a tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] [instance: d8ae775e-e822-487d-a211-a4f4bd042c21] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:13:28.351032 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-87c9e3e9-23bb-4ae1-adda-841a4b80d54a tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:28.353422 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-87c9e3e9-23bb-4ae1-adda-841a4b80d54a tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:28.354080 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-87c9e3e9-23bb-4ae1-adda-841a4b80d54a tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:28.355074 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-87c9e3e9-23bb-4ae1-adda-841a4b80d54a tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:28.357398 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-87c9e3e9-23bb-4ae1-adda-841a4b80d54a tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:28.358837 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-87c9e3e9-23bb-4ae1-adda-841a4b80d54a tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:28.390203 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-cdeba0f8-596d-4f42-b138-ba1112a5af28 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:13:28.392514 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-cdeba0f8-596d-4f42-b138-ba1112a5af28 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [instance: 53aade05-189d-455b-901e-6fb092cfbb07] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:13:28.401416 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cdeba0f8-596d-4f42-b138-ba1112a5af28 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:28.402197 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cdeba0f8-596d-4f42-b138-ba1112a5af28 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:28.402841 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cdeba0f8-596d-4f42-b138-ba1112a5af28 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:28.403918 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cdeba0f8-596d-4f42-b138-ba1112a5af28 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:28.404725 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cdeba0f8-596d-4f42-b138-ba1112a5af28 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:28.405338 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cdeba0f8-596d-4f42-b138-ba1112a5af28 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:28.521190 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-87c9e3e9-23bb-4ae1-adda-841a4b80d54a tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421bf1609a6d4f808a4cb3612bf64615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a020c15f895946328ab384514c1ba463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:13:28.535008 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-87c9e3e9-23bb-4ae1-adda-841a4b80d54a tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] 10.222.0.60 "GET /compute/v2.1/servers/d8ae775e-e822-487d-a211-a4f4bd042c21" status: 200 len: 1266 microversion: 2.1 time: 0.212903 Sep 14 09:13:28.538383 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2459/4946] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:13:28 2022] GET /compute/v2.1/servers/d8ae775e-e822-487d-a211-a4f4bd042c21 => generated 1266 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:13:28.776469 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-cdeba0f8-596d-4f42-b138-ba1112a5af28 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daab4f69af5452c8641006d9f09edce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9672a6c416ee44289eaa4d7c664d307e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:13:28.797904 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-cdeba0f8-596d-4f42-b138-ba1112a5af28 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "GET /compute/v2.1/servers/53aade05-189d-455b-901e-6fb092cfbb07" status: 200 len: 1366 microversion: 2.1 time: 0.413795 Sep 14 09:13:28.800896 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2488/4947] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:13:28 2022] GET /compute/v2.1/servers/53aade05-189d-455b-901e-6fb092cfbb07 => generated 1366 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:13:28.823223 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-fba1c51e-88fd-4175-9bdb-14d9b79b8b5e req-26899cb1-1d45-44e8-a15f-d8f977a4e921 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac1c3be3-de1d-456b-bfb9-aad6baafbb34", "tag": "0391a3db-803f-4dc5-aeb7-7b667c18bfdb"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:13:28.852211 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-fba1c51e-88fd-4175-9bdb-14d9b79b8b5e req-26899cb1-1d45-44e8-a15f-d8f977a4e921 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:28.852701 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-fba1c51e-88fd-4175-9bdb-14d9b79b8b5e req-26899cb1-1d45-44e8-a15f-d8f977a4e921 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:28.853134 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-fba1c51e-88fd-4175-9bdb-14d9b79b8b5e req-26899cb1-1d45-44e8-a15f-d8f977a4e921 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:28.866740 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-fba1c51e-88fd-4175-9bdb-14d9b79b8b5e req-26899cb1-1d45-44e8-a15f-d8f977a4e921 service nova] Creating event network-changed:0391a3db-803f-4dc5-aeb7-7b667c18bfdb for instance ac1c3be3-de1d-456b-bfb9-aad6baafbb34 on n-h2-836830-18 Sep 14 09:13:28.872357 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-fba1c51e-88fd-4175-9bdb-14d9b79b8b5e req-26899cb1-1d45-44e8-a15f-d8f977a4e921 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054302 Sep 14 09:13:28.876234 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2460/4948] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:13:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:13:28.980975 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-8379ec6b-4e32-4fe2-9724-89afc7a058b7 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:13:28.981611 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-8379ec6b-4e32-4fe2-9724-89afc7a058b7 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] [instance: ac1c3be3-de1d-456b-bfb9-aad6baafbb34] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:13:29.002111 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8379ec6b-4e32-4fe2-9724-89afc7a058b7 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:29.004129 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8379ec6b-4e32-4fe2-9724-89afc7a058b7 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:29.005770 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8379ec6b-4e32-4fe2-9724-89afc7a058b7 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:29.008219 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8379ec6b-4e32-4fe2-9724-89afc7a058b7 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:29.011415 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8379ec6b-4e32-4fe2-9724-89afc7a058b7 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:29.025098 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8379ec6b-4e32-4fe2-9724-89afc7a058b7 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:29.363980 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-8379ec6b-4e32-4fe2-9724-89afc7a058b7 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe73f3d7f4734e1ab9f6b7283db1388b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94e25a7caf946c2a80b874416e4906b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:13:29.373727 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-8379ec6b-4e32-4fe2-9724-89afc7a058b7 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] 10.222.0.60 "GET /compute/v2.1/servers/ac1c3be3-de1d-456b-bfb9-aad6baafbb34" status: 200 len: 1333 microversion: 2.1 time: 0.403123 Sep 14 09:13:29.374397 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2489/4949] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:13:28 2022] GET /compute/v2.1/servers/ac1c3be3-de1d-456b-bfb9-aad6baafbb34 => generated 1333 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:13:29.568651 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b85f909a-fd1d-428b-82df-7933bbfe99af tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:13:29.569367 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b85f909a-fd1d-428b-82df-7933bbfe99af tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] [instance: d8ae775e-e822-487d-a211-a4f4bd042c21] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:13:29.581115 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b85f909a-fd1d-428b-82df-7933bbfe99af tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:29.581660 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b85f909a-fd1d-428b-82df-7933bbfe99af tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:29.582065 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b85f909a-fd1d-428b-82df-7933bbfe99af tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:29.582816 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b85f909a-fd1d-428b-82df-7933bbfe99af tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:29.583249 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b85f909a-fd1d-428b-82df-7933bbfe99af tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:29.593139 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b85f909a-fd1d-428b-82df-7933bbfe99af tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:29.707383 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b85f909a-fd1d-428b-82df-7933bbfe99af tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421bf1609a6d4f808a4cb3612bf64615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a020c15f895946328ab384514c1ba463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:13:29.716781 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b85f909a-fd1d-428b-82df-7933bbfe99af tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] 10.222.0.60 "GET /compute/v2.1/servers/d8ae775e-e822-487d-a211-a4f4bd042c21" status: 200 len: 1272 microversion: 2.1 time: 0.156381 Sep 14 09:13:29.718039 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2461/4950] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:13:29 2022] GET /compute/v2.1/servers/d8ae775e-e822-487d-a211-a4f4bd042c21 => generated 1272 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:13:29.828697 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-196cd86d-8ff2-49d0-aa6f-7b53935935d7 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:13:29.830984 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-196cd86d-8ff2-49d0-aa6f-7b53935935d7 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [instance: 53aade05-189d-455b-901e-6fb092cfbb07] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:13:29.839281 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-196cd86d-8ff2-49d0-aa6f-7b53935935d7 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:29.840045 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-196cd86d-8ff2-49d0-aa6f-7b53935935d7 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:29.840964 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-196cd86d-8ff2-49d0-aa6f-7b53935935d7 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:29.841894 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-196cd86d-8ff2-49d0-aa6f-7b53935935d7 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:29.842722 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-196cd86d-8ff2-49d0-aa6f-7b53935935d7 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:29.843611 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-196cd86d-8ff2-49d0-aa6f-7b53935935d7 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:30.114512 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-196cd86d-8ff2-49d0-aa6f-7b53935935d7 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daab4f69af5452c8641006d9f09edce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9672a6c416ee44289eaa4d7c664d307e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:13:30.117758 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:13:30.127039 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-196cd86d-8ff2-49d0-aa6f-7b53935935d7 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "GET /compute/v2.1/servers/53aade05-189d-455b-901e-6fb092cfbb07" status: 200 len: 1366 microversion: 2.1 time: 0.302478 Sep 14 09:13:30.128083 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2490/4951] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:13:29 2022] GET /compute/v2.1/servers/53aade05-189d-455b-901e-6fb092cfbb07 => generated 1366 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:13:30.194022 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-569cde7e-cac0-48fd-a07c-515ca480b754 req-6facd4f7-0b26-4fbd-acc5-30e5a7519cf0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53aade05-189d-455b-901e-6fb092cfbb07", "name": "network-vif-plugged", "status": "completed", "tag": "90bc5925-bdaa-4a69-ba3a-ee4df95942a0"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:13:30.239167 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-569cde7e-cac0-48fd-a07c-515ca480b754 req-6facd4f7-0b26-4fbd-acc5-30e5a7519cf0 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:30.240053 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-569cde7e-cac0-48fd-a07c-515ca480b754 req-6facd4f7-0b26-4fbd-acc5-30e5a7519cf0 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:30.240609 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-569cde7e-cac0-48fd-a07c-515ca480b754 req-6facd4f7-0b26-4fbd-acc5-30e5a7519cf0 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:30.276540 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-569cde7e-cac0-48fd-a07c-515ca480b754 req-6facd4f7-0b26-4fbd-acc5-30e5a7519cf0 service nova] Creating event network-vif-plugged:90bc5925-bdaa-4a69-ba3a-ee4df95942a0 for instance 53aade05-189d-455b-901e-6fb092cfbb07 on n-h1-836830-18 Sep 14 09:13:30.293283 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-569cde7e-cac0-48fd-a07c-515ca480b754 req-6facd4f7-0b26-4fbd-acc5-30e5a7519cf0 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101173 Sep 14 09:13:30.298881 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2462/4952] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:13:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:13:30.402069 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b0c1172b-698c-4b9e-a1e6-96008e7a1f23 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:13:30.404301 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-b0c1172b-698c-4b9e-a1e6-96008e7a1f23 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] [instance: ac1c3be3-de1d-456b-bfb9-aad6baafbb34] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:13:30.426295 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b0c1172b-698c-4b9e-a1e6-96008e7a1f23 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:30.427191 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b0c1172b-698c-4b9e-a1e6-96008e7a1f23 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:30.428114 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b0c1172b-698c-4b9e-a1e6-96008e7a1f23 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:30.429173 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b0c1172b-698c-4b9e-a1e6-96008e7a1f23 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:30.429941 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b0c1172b-698c-4b9e-a1e6-96008e7a1f23 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:30.430544 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b0c1172b-698c-4b9e-a1e6-96008e7a1f23 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:30.703143 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-b0c1172b-698c-4b9e-a1e6-96008e7a1f23 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe73f3d7f4734e1ab9f6b7283db1388b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94e25a7caf946c2a80b874416e4906b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:13:30.712342 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-b0c1172b-698c-4b9e-a1e6-96008e7a1f23 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] 10.222.0.60 "GET /compute/v2.1/servers/ac1c3be3-de1d-456b-bfb9-aad6baafbb34" status: 200 len: 1333 microversion: 2.1 time: 0.314512 Sep 14 09:13:30.716512 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2491/4953] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:13:30 2022] GET /compute/v2.1/servers/ac1c3be3-de1d-456b-bfb9-aad6baafbb34 => generated 1333 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:13:30.761022 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-fc834385-737d-48bc-b82b-d6828406d23e tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:13:30.761817 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-fc834385-737d-48bc-b82b-d6828406d23e tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] [instance: d8ae775e-e822-487d-a211-a4f4bd042c21] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:13:30.786177 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fc834385-737d-48bc-b82b-d6828406d23e tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:30.790596 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fc834385-737d-48bc-b82b-d6828406d23e tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:30.792974 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fc834385-737d-48bc-b82b-d6828406d23e tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:30.795004 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fc834385-737d-48bc-b82b-d6828406d23e tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:30.797040 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fc834385-737d-48bc-b82b-d6828406d23e tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:30.797730 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fc834385-737d-48bc-b82b-d6828406d23e tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:30.969691 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-fc834385-737d-48bc-b82b-d6828406d23e tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421bf1609a6d4f808a4cb3612bf64615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a020c15f895946328ab384514c1ba463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:13:30.979494 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-fc834385-737d-48bc-b82b-d6828406d23e tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] 10.222.0.60 "GET /compute/v2.1/servers/d8ae775e-e822-487d-a211-a4f4bd042c21" status: 200 len: 1272 microversion: 2.1 time: 0.238451 Sep 14 09:13:31.000969 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2463/4954] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:13:30 2022] GET /compute/v2.1/servers/d8ae775e-e822-487d-a211-a4f4bd042c21 => generated 1272 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:13:31.155841 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-03a6efa2-1f5e-4d9d-bc79-d2b27b5b55bf tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:13:31.157425 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-03a6efa2-1f5e-4d9d-bc79-d2b27b5b55bf tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [instance: 53aade05-189d-455b-901e-6fb092cfbb07] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:13:31.174117 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-03a6efa2-1f5e-4d9d-bc79-d2b27b5b55bf tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:31.175010 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-03a6efa2-1f5e-4d9d-bc79-d2b27b5b55bf tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:31.175651 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-03a6efa2-1f5e-4d9d-bc79-d2b27b5b55bf tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:31.176791 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-03a6efa2-1f5e-4d9d-bc79-d2b27b5b55bf tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:31.180765 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-03a6efa2-1f5e-4d9d-bc79-d2b27b5b55bf tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:31.181541 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-03a6efa2-1f5e-4d9d-bc79-d2b27b5b55bf tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:31.630439 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-03a6efa2-1f5e-4d9d-bc79-d2b27b5b55bf tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daab4f69af5452c8641006d9f09edce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9672a6c416ee44289eaa4d7c664d307e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:13:31.639736 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-03a6efa2-1f5e-4d9d-bc79-d2b27b5b55bf tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "GET /compute/v2.1/servers/53aade05-189d-455b-901e-6fb092cfbb07" status: 200 len: 1366 microversion: 2.1 time: 0.488602 Sep 14 09:13:31.641097 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2492/4955] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:13:31 2022] GET /compute/v2.1/servers/53aade05-189d-455b-901e-6fb092cfbb07 => generated 1366 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:13:31.740857 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-2ea2c06e-6d38-45f0-b1f9-eb113ac491d1 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:13:31.741664 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-2ea2c06e-6d38-45f0-b1f9-eb113ac491d1 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] [instance: ac1c3be3-de1d-456b-bfb9-aad6baafbb34] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:13:31.756402 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2ea2c06e-6d38-45f0-b1f9-eb113ac491d1 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:31.757243 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2ea2c06e-6d38-45f0-b1f9-eb113ac491d1 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:31.759543 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2ea2c06e-6d38-45f0-b1f9-eb113ac491d1 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:31.760670 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2ea2c06e-6d38-45f0-b1f9-eb113ac491d1 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:31.763083 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2ea2c06e-6d38-45f0-b1f9-eb113ac491d1 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:31.764607 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2ea2c06e-6d38-45f0-b1f9-eb113ac491d1 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:32.008621 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d6130920-8225-4682-9617-6b85ff2d50c2 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:13:32.009557 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-d6130920-8225-4682-9617-6b85ff2d50c2 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] [instance: d8ae775e-e822-487d-a211-a4f4bd042c21] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:13:32.019609 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d6130920-8225-4682-9617-6b85ff2d50c2 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:32.020364 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d6130920-8225-4682-9617-6b85ff2d50c2 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:32.023399 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d6130920-8225-4682-9617-6b85ff2d50c2 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:32.025369 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d6130920-8225-4682-9617-6b85ff2d50c2 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:32.028941 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d6130920-8225-4682-9617-6b85ff2d50c2 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:32.030183 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d6130920-8225-4682-9617-6b85ff2d50c2 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:32.112986 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-2ea2c06e-6d38-45f0-b1f9-eb113ac491d1 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe73f3d7f4734e1ab9f6b7283db1388b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94e25a7caf946c2a80b874416e4906b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:13:32.127651 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-2ea2c06e-6d38-45f0-b1f9-eb113ac491d1 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] 10.222.0.60 "GET /compute/v2.1/servers/ac1c3be3-de1d-456b-bfb9-aad6baafbb34" status: 200 len: 1333 microversion: 2.1 time: 0.390833 Sep 14 09:13:32.129466 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2464/4956] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:13:31 2022] GET /compute/v2.1/servers/ac1c3be3-de1d-456b-bfb9-aad6baafbb34 => generated 1333 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:13:32.175706 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-d6130920-8225-4682-9617-6b85ff2d50c2 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421bf1609a6d4f808a4cb3612bf64615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a020c15f895946328ab384514c1ba463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:13:32.188124 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-d6130920-8225-4682-9617-6b85ff2d50c2 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] 10.222.0.60 "GET /compute/v2.1/servers/d8ae775e-e822-487d-a211-a4f4bd042c21" status: 200 len: 1272 microversion: 2.1 time: 0.183810 Sep 14 09:13:32.188814 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2493/4957] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:13:32 2022] GET /compute/v2.1/servers/d8ae775e-e822-487d-a211-a4f4bd042c21 => generated 1272 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:13:32.665895 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-669a64cb-a421-40a1-b892-0844850cdf4e tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:13:32.666918 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-669a64cb-a421-40a1-b892-0844850cdf4e tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [instance: 53aade05-189d-455b-901e-6fb092cfbb07] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:13:32.673799 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-669a64cb-a421-40a1-b892-0844850cdf4e tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:32.674618 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-669a64cb-a421-40a1-b892-0844850cdf4e tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:32.675290 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-669a64cb-a421-40a1-b892-0844850cdf4e tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:32.676221 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-669a64cb-a421-40a1-b892-0844850cdf4e tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:32.676877 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-669a64cb-a421-40a1-b892-0844850cdf4e tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:32.677461 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-669a64cb-a421-40a1-b892-0844850cdf4e tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:33.152603 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ca4e47f5-f793-429a-b93b-c152ab72acfb tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:13:33.153861 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-ca4e47f5-f793-429a-b93b-c152ab72acfb tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] [instance: ac1c3be3-de1d-456b-bfb9-aad6baafbb34] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:13:33.165098 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ca4e47f5-f793-429a-b93b-c152ab72acfb tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:33.165837 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ca4e47f5-f793-429a-b93b-c152ab72acfb tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:33.166659 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ca4e47f5-f793-429a-b93b-c152ab72acfb tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:33.168164 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ca4e47f5-f793-429a-b93b-c152ab72acfb tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:33.168906 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ca4e47f5-f793-429a-b93b-c152ab72acfb tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:33.169599 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ca4e47f5-f793-429a-b93b-c152ab72acfb tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:33.601843 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-669a64cb-a421-40a1-b892-0844850cdf4e tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daab4f69af5452c8641006d9f09edce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9672a6c416ee44289eaa4d7c664d307e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:13:33.623333 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-669a64cb-a421-40a1-b892-0844850cdf4e tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "GET /compute/v2.1/servers/53aade05-189d-455b-901e-6fb092cfbb07" status: 200 len: 1366 microversion: 2.1 time: 0.961165 Sep 14 09:13:33.625440 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2465/4958] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:13:32 2022] GET /compute/v2.1/servers/53aade05-189d-455b-901e-6fb092cfbb07 => generated 1366 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:13:33.635378 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-ca4e47f5-f793-429a-b93b-c152ab72acfb tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe73f3d7f4734e1ab9f6b7283db1388b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94e25a7caf946c2a80b874416e4906b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:13:33.643204 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c890aefe-f647-499b-b90f-8988520571b6 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:13:33.645702 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-c890aefe-f647-499b-b90f-8988520571b6 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] [instance: d8ae775e-e822-487d-a211-a4f4bd042c21] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:13:33.656244 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-ca4e47f5-f793-429a-b93b-c152ab72acfb tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] 10.222.0.60 "GET /compute/v2.1/servers/ac1c3be3-de1d-456b-bfb9-aad6baafbb34" status: 200 len: 1333 microversion: 2.1 time: 0.508160 Sep 14 09:13:33.661553 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2494/4959] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:13:33 2022] GET /compute/v2.1/servers/ac1c3be3-de1d-456b-bfb9-aad6baafbb34 => generated 1333 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:13:33.671813 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-86be47df-f52e-4e32-8e61-687b3bdca0bd req-db2ceeaf-1dbf-488b-9c10-94909fe5756a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac1c3be3-de1d-456b-bfb9-aad6baafbb34", "tag": "281abffd-f25c-48c2-bfb8-373ceff41810"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:13:33.681035 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c890aefe-f647-499b-b90f-8988520571b6 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:33.681728 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c890aefe-f647-499b-b90f-8988520571b6 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:33.683449 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c890aefe-f647-499b-b90f-8988520571b6 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:33.686617 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c890aefe-f647-499b-b90f-8988520571b6 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:33.687348 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c890aefe-f647-499b-b90f-8988520571b6 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:33.688015 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c890aefe-f647-499b-b90f-8988520571b6 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:33.706799 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-86be47df-f52e-4e32-8e61-687b3bdca0bd req-db2ceeaf-1dbf-488b-9c10-94909fe5756a service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:33.707401 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-86be47df-f52e-4e32-8e61-687b3bdca0bd req-db2ceeaf-1dbf-488b-9c10-94909fe5756a service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:33.707855 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-86be47df-f52e-4e32-8e61-687b3bdca0bd req-db2ceeaf-1dbf-488b-9c10-94909fe5756a service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:33.742848 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-86be47df-f52e-4e32-8e61-687b3bdca0bd req-db2ceeaf-1dbf-488b-9c10-94909fe5756a service nova] Creating event network-changed:281abffd-f25c-48c2-bfb8-373ceff41810 for instance ac1c3be3-de1d-456b-bfb9-aad6baafbb34 on n-h2-836830-18 Sep 14 09:13:33.749700 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-86be47df-f52e-4e32-8e61-687b3bdca0bd req-db2ceeaf-1dbf-488b-9c10-94909fe5756a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086527 Sep 14 09:13:33.752684 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2495/4960] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:13:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:13:34.007977 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-c890aefe-f647-499b-b90f-8988520571b6 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421bf1609a6d4f808a4cb3612bf64615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a020c15f895946328ab384514c1ba463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:13:34.021463 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-c890aefe-f647-499b-b90f-8988520571b6 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] 10.222.0.60 "GET /compute/v2.1/servers/d8ae775e-e822-487d-a211-a4f4bd042c21" status: 200 len: 1314 microversion: 2.1 time: 0.391070 Sep 14 09:13:34.022992 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2466/4961] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:13:33 2022] GET /compute/v2.1/servers/d8ae775e-e822-487d-a211-a4f4bd042c21 => generated 1314 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:13:34.655206 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-afbcdeb2-387f-478d-9318-b4ec3d7a8fdc tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:13:34.655913 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-afbcdeb2-387f-478d-9318-b4ec3d7a8fdc tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [instance: 53aade05-189d-455b-901e-6fb092cfbb07] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:13:34.673822 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-afbcdeb2-387f-478d-9318-b4ec3d7a8fdc tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:34.674346 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-afbcdeb2-387f-478d-9318-b4ec3d7a8fdc tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:34.674799 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-afbcdeb2-387f-478d-9318-b4ec3d7a8fdc tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:34.675567 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-afbcdeb2-387f-478d-9318-b4ec3d7a8fdc tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:34.676033 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-afbcdeb2-387f-478d-9318-b4ec3d7a8fdc tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:34.676477 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-afbcdeb2-387f-478d-9318-b4ec3d7a8fdc tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:34.686956 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-5b829e99-b52e-498f-b1ea-86447ac37f85 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:13:34.687805 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-5b829e99-b52e-498f-b1ea-86447ac37f85 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] [instance: ac1c3be3-de1d-456b-bfb9-aad6baafbb34] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:13:34.697884 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5b829e99-b52e-498f-b1ea-86447ac37f85 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:34.698421 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5b829e99-b52e-498f-b1ea-86447ac37f85 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:34.698878 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5b829e99-b52e-498f-b1ea-86447ac37f85 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:34.699739 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5b829e99-b52e-498f-b1ea-86447ac37f85 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:34.700109 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5b829e99-b52e-498f-b1ea-86447ac37f85 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:34.700546 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5b829e99-b52e-498f-b1ea-86447ac37f85 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:35.187321 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-afbcdeb2-387f-478d-9318-b4ec3d7a8fdc tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daab4f69af5452c8641006d9f09edce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9672a6c416ee44289eaa4d7c664d307e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:13:35.204380 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-afbcdeb2-387f-478d-9318-b4ec3d7a8fdc tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "GET /compute/v2.1/servers/53aade05-189d-455b-901e-6fb092cfbb07" status: 200 len: 1557 microversion: 2.1 time: 0.556097 Sep 14 09:13:35.205599 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2496/4962] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:13:34 2022] GET /compute/v2.1/servers/53aade05-189d-455b-901e-6fb092cfbb07 => generated 1557 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:13:35.211282 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-437cd53c-95c0-4051-a085-0f1334491c22 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:13:35.214565 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-5b829e99-b52e-498f-b1ea-86447ac37f85 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe73f3d7f4734e1ab9f6b7283db1388b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94e25a7caf946c2a80b874416e4906b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:13:35.223952 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-5b829e99-b52e-498f-b1ea-86447ac37f85 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] 10.222.0.60 "GET /compute/v2.1/servers/ac1c3be3-de1d-456b-bfb9-aad6baafbb34" status: 200 len: 1333 microversion: 2.1 time: 0.541066 Sep 14 09:13:35.228083 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2467/4963] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:13:34 2022] GET /compute/v2.1/servers/ac1c3be3-de1d-456b-bfb9-aad6baafbb34 => generated 1333 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:13:35.229090 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-437cd53c-95c0-4051-a085-0f1334491c22 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] [instance: d8ae775e-e822-487d-a211-a4f4bd042c21] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:13:35.240329 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-52b2cbc1-951c-4100-a4ae-8bb0972b477c tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:13:35.244865 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-437cd53c-95c0-4051-a085-0f1334491c22 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:35.245370 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-437cd53c-95c0-4051-a085-0f1334491c22 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:35.245550 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-52b2cbc1-951c-4100-a4ae-8bb0972b477c tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [instance: 53aade05-189d-455b-901e-6fb092cfbb07] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:13:35.246154 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-437cd53c-95c0-4051-a085-0f1334491c22 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:35.247652 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-437cd53c-95c0-4051-a085-0f1334491c22 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:35.248273 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-437cd53c-95c0-4051-a085-0f1334491c22 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:35.253492 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-52b2cbc1-951c-4100-a4ae-8bb0972b477c tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:35.254289 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-52b2cbc1-951c-4100-a4ae-8bb0972b477c tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:35.254990 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-52b2cbc1-951c-4100-a4ae-8bb0972b477c tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:35.256212 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-52b2cbc1-951c-4100-a4ae-8bb0972b477c tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:35.256905 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-52b2cbc1-951c-4100-a4ae-8bb0972b477c tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:35.257463 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-437cd53c-95c0-4051-a085-0f1334491c22 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:35.257814 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-52b2cbc1-951c-4100-a4ae-8bb0972b477c tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:35.482639 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-52b2cbc1-951c-4100-a4ae-8bb0972b477c tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "GET /compute/v2.1/servers/53aade05-189d-455b-901e-6fb092cfbb07/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.249535 Sep 14 09:13:35.487847 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2468/4964] 10.222.0.60 () {58 vars in 1275 bytes} [Wed Sep 14 09:13:35 2022] GET /compute/v2.1/servers/53aade05-189d-455b-901e-6fb092cfbb07/os-interface => generated 285 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:13:35.725584 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-437cd53c-95c0-4051-a085-0f1334491c22 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421bf1609a6d4f808a4cb3612bf64615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a020c15f895946328ab384514c1ba463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:13:35.737864 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-437cd53c-95c0-4051-a085-0f1334491c22 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] 10.222.0.60 "GET /compute/v2.1/servers/d8ae775e-e822-487d-a211-a4f4bd042c21" status: 200 len: 1314 microversion: 2.1 time: 0.530595 Sep 14 09:13:35.739085 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2497/4965] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:13:35 2022] GET /compute/v2.1/servers/d8ae775e-e822-487d-a211-a4f4bd042c21 => generated 1314 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:13:36.250728 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-75a7722a-3d43-41cc-a4cd-3e7410da34eb tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:13:36.251409 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-75a7722a-3d43-41cc-a4cd-3e7410da34eb tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] [instance: ac1c3be3-de1d-456b-bfb9-aad6baafbb34] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:13:36.266608 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-75a7722a-3d43-41cc-a4cd-3e7410da34eb tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:36.268024 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-75a7722a-3d43-41cc-a4cd-3e7410da34eb tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:36.268640 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-75a7722a-3d43-41cc-a4cd-3e7410da34eb tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:36.269538 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-75a7722a-3d43-41cc-a4cd-3e7410da34eb tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:36.270166 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-75a7722a-3d43-41cc-a4cd-3e7410da34eb tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:36.270764 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-75a7722a-3d43-41cc-a4cd-3e7410da34eb tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:36.761734 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-4caf9304-df52-4087-a054-33256c80c5b8 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:13:36.762959 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-4caf9304-df52-4087-a054-33256c80c5b8 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] [instance: d8ae775e-e822-487d-a211-a4f4bd042c21] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:13:36.770835 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4caf9304-df52-4087-a054-33256c80c5b8 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:36.773811 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4caf9304-df52-4087-a054-33256c80c5b8 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:36.774266 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4caf9304-df52-4087-a054-33256c80c5b8 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:36.775041 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4caf9304-df52-4087-a054-33256c80c5b8 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:36.775516 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4caf9304-df52-4087-a054-33256c80c5b8 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:36.775945 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4caf9304-df52-4087-a054-33256c80c5b8 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:37.025588 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=2 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:13:37.281348 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-75a7722a-3d43-41cc-a4cd-3e7410da34eb tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe73f3d7f4734e1ab9f6b7283db1388b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94e25a7caf946c2a80b874416e4906b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:13:37.295830 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=8 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:13:37.307102 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-75a7722a-3d43-41cc-a4cd-3e7410da34eb tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] 10.222.0.60 "GET /compute/v2.1/servers/ac1c3be3-de1d-456b-bfb9-aad6baafbb34" status: 200 len: 1333 microversion: 2.1 time: 1.058904 Sep 14 09:13:37.312523 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2469/4966] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:13:36 2022] GET /compute/v2.1/servers/ac1c3be3-de1d-456b-bfb9-aad6baafbb34 => generated 1333 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:13:37.474861 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-4caf9304-df52-4087-a054-33256c80c5b8 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421bf1609a6d4f808a4cb3612bf64615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a020c15f895946328ab384514c1ba463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:13:37.490516 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-4caf9304-df52-4087-a054-33256c80c5b8 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] 10.222.0.60 "GET /compute/v2.1/servers/d8ae775e-e822-487d-a211-a4f4bd042c21" status: 200 len: 1314 microversion: 2.1 time: 0.732645 Sep 14 09:13:37.510104 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2498/4967] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:13:36 2022] GET /compute/v2.1/servers/d8ae775e-e822-487d-a211-a4f4bd042c21 => generated 1314 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:13:37.802238 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-b037bd17-f636-4f6a-9dae-c55f7afda5f1 req-320a891b-4b12-45bf-90fc-7758f5ed5e00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8ae775e-e822-487d-a211-a4f4bd042c21", "tag": "4eb2d6f4-d3a5-4426-aaae-c70f33c5937a"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:13:37.815553 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-b037bd17-f636-4f6a-9dae-c55f7afda5f1 req-320a891b-4b12-45bf-90fc-7758f5ed5e00 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:37.816437 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-b037bd17-f636-4f6a-9dae-c55f7afda5f1 req-320a891b-4b12-45bf-90fc-7758f5ed5e00 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:37.817115 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-b037bd17-f636-4f6a-9dae-c55f7afda5f1 req-320a891b-4b12-45bf-90fc-7758f5ed5e00 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:37.835832 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-b037bd17-f636-4f6a-9dae-c55f7afda5f1 req-320a891b-4b12-45bf-90fc-7758f5ed5e00 service nova] Creating event network-changed:4eb2d6f4-d3a5-4426-aaae-c70f33c5937a for instance d8ae775e-e822-487d-a211-a4f4bd042c21 on n-h2-836830-18 Sep 14 09:13:37.843700 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-b037bd17-f636-4f6a-9dae-c55f7afda5f1 req-320a891b-4b12-45bf-90fc-7758f5ed5e00 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045480 Sep 14 09:13:37.844888 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2470/4968] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:13:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:13:38.339549 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-bbe9ae81-c880-46f1-8e45-cef95e7ec2e5 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:13:38.341646 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-bbe9ae81-c880-46f1-8e45-cef95e7ec2e5 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] [instance: ac1c3be3-de1d-456b-bfb9-aad6baafbb34] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:13:38.361511 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bbe9ae81-c880-46f1-8e45-cef95e7ec2e5 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:38.362768 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bbe9ae81-c880-46f1-8e45-cef95e7ec2e5 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:38.363534 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bbe9ae81-c880-46f1-8e45-cef95e7ec2e5 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:38.364948 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bbe9ae81-c880-46f1-8e45-cef95e7ec2e5 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:38.366046 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bbe9ae81-c880-46f1-8e45-cef95e7ec2e5 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:38.367198 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bbe9ae81-c880-46f1-8e45-cef95e7ec2e5 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:38.516529 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e796474a-c643-4c98-803e-ee31b315658f tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:13:38.518157 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e796474a-c643-4c98-803e-ee31b315658f tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] [instance: d8ae775e-e822-487d-a211-a4f4bd042c21] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:13:38.530386 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e796474a-c643-4c98-803e-ee31b315658f tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:38.532204 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e796474a-c643-4c98-803e-ee31b315658f tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:38.537527 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e796474a-c643-4c98-803e-ee31b315658f tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:38.539555 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e796474a-c643-4c98-803e-ee31b315658f tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:38.542145 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e796474a-c643-4c98-803e-ee31b315658f tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:38.542764 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e796474a-c643-4c98-803e-ee31b315658f tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:38.740617 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-e796474a-c643-4c98-803e-ee31b315658f tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421bf1609a6d4f808a4cb3612bf64615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a020c15f895946328ab384514c1ba463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:13:38.745108 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-bbe9ae81-c880-46f1-8e45-cef95e7ec2e5 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe73f3d7f4734e1ab9f6b7283db1388b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94e25a7caf946c2a80b874416e4906b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:13:38.752851 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e796474a-c643-4c98-803e-ee31b315658f tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] 10.222.0.60 "GET /compute/v2.1/servers/d8ae775e-e822-487d-a211-a4f4bd042c21" status: 200 len: 1314 microversion: 2.1 time: 0.240860 Sep 14 09:13:38.754677 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2471/4969] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:13:38 2022] GET /compute/v2.1/servers/d8ae775e-e822-487d-a211-a4f4bd042c21 => generated 1314 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:13:38.755368 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-bbe9ae81-c880-46f1-8e45-cef95e7ec2e5 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] 10.222.0.60 "GET /compute/v2.1/servers/ac1c3be3-de1d-456b-bfb9-aad6baafbb34" status: 200 len: 1333 microversion: 2.1 time: 0.423466 Sep 14 09:13:38.756403 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2499/4970] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:13:38 2022] GET /compute/v2.1/servers/ac1c3be3-de1d-456b-bfb9-aad6baafbb34 => generated 1333 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:13:39.503505 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9907c66a-bda3-4a06-a8e2-c5c940fb33bc tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Action: 'create', calling method: .version_select at 0x7f7d487f1430>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-149670870", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK+Lw6a7PUYV5/fwO1auAWTzVdYxFilYu+FY2KretulID3YFkcV5pPS26nirX9A3yJwLRhcQcOSxU303rzpYRhf/5Lk9fABZZCT2rPyCAJmq/Q3uePf5HBSi0HvBDRMnHg=="}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:13:39.525359 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-9907c66a-bda3-4a06-a8e2-c5c940fb33bc tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Getting quotas for project 021b73b20f2042c6a08f94ed23ff66e5. Resources: {'key_pairs'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:13:39.532907 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-9907c66a-bda3-4a06-a8e2-c5c940fb33bc tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Getting quotas for user 17918433a3994b69a65999a59a7f833c and project 021b73b20f2042c6a08f94ed23ff66e5. Resources: {'key_pairs'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:13:39.573553 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-9907c66a-bda3-4a06-a8e2-c5c940fb33bc tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.074530 Sep 14 09:13:39.573553 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2472/4971] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Sep 14 09:13:39 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:13:39.780363 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-87cd5647-2e29-426a-b62b-898f8e5639c5 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:13:39.781001 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-87cd5647-2e29-426a-b62b-898f8e5639c5 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] [instance: d8ae775e-e822-487d-a211-a4f4bd042c21] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:13:39.788455 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-50a26c13-0de8-483a-820b-0f0ce2f5bcbf tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:13:39.797198 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-87cd5647-2e29-426a-b62b-898f8e5639c5 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:39.797647 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-50a26c13-0de8-483a-820b-0f0ce2f5bcbf tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] [instance: ac1c3be3-de1d-456b-bfb9-aad6baafbb34] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:13:39.801290 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-87cd5647-2e29-426a-b62b-898f8e5639c5 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:39.803503 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-87cd5647-2e29-426a-b62b-898f8e5639c5 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:39.804430 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-87cd5647-2e29-426a-b62b-898f8e5639c5 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:39.806887 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-87cd5647-2e29-426a-b62b-898f8e5639c5 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:39.807648 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-87cd5647-2e29-426a-b62b-898f8e5639c5 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:39.841111 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-50a26c13-0de8-483a-820b-0f0ce2f5bcbf tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:39.841621 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-50a26c13-0de8-483a-820b-0f0ce2f5bcbf tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:39.843109 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-50a26c13-0de8-483a-820b-0f0ce2f5bcbf tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:39.844446 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-50a26c13-0de8-483a-820b-0f0ce2f5bcbf tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:39.845097 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-50a26c13-0de8-483a-820b-0f0ce2f5bcbf tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:39.845703 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-50a26c13-0de8-483a-820b-0f0ce2f5bcbf tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:40.253337 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-50a26c13-0de8-483a-820b-0f0ce2f5bcbf tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe73f3d7f4734e1ab9f6b7283db1388b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94e25a7caf946c2a80b874416e4906b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:13:40.264651 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-50a26c13-0de8-483a-820b-0f0ce2f5bcbf tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] 10.222.0.60 "GET /compute/v2.1/servers/ac1c3be3-de1d-456b-bfb9-aad6baafbb34" status: 200 len: 1333 microversion: 2.1 time: 0.486845 Sep 14 09:13:40.268945 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2473/4972] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:13:39 2022] GET /compute/v2.1/servers/ac1c3be3-de1d-456b-bfb9-aad6baafbb34 => generated 1333 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:13:40.297844 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-87cd5647-2e29-426a-b62b-898f8e5639c5 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421bf1609a6d4f808a4cb3612bf64615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a020c15f895946328ab384514c1ba463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:13:40.320206 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-87cd5647-2e29-426a-b62b-898f8e5639c5 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] 10.222.0.60 "GET /compute/v2.1/servers/d8ae775e-e822-487d-a211-a4f4bd042c21" status: 200 len: 1314 microversion: 2.1 time: 0.544559 Sep 14 09:13:40.320850 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2500/4973] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:13:39 2022] GET /compute/v2.1/servers/d8ae775e-e822-487d-a211-a4f4bd042c21 => generated 1314 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:13:40.495653 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-6c63df32-53fc-4384-9da9-5a7c87d4438b req-8278f2f0-5e46-4984-81a4-8e7694800839 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53aade05-189d-455b-901e-6fb092cfbb07", "tag": "90bc5925-bdaa-4a69-ba3a-ee4df95942a0"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:13:40.520968 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-6c63df32-53fc-4384-9da9-5a7c87d4438b req-8278f2f0-5e46-4984-81a4-8e7694800839 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:40.522856 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-6c63df32-53fc-4384-9da9-5a7c87d4438b req-8278f2f0-5e46-4984-81a4-8e7694800839 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:40.523333 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-6c63df32-53fc-4384-9da9-5a7c87d4438b req-8278f2f0-5e46-4984-81a4-8e7694800839 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:40.547902 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-6c63df32-53fc-4384-9da9-5a7c87d4438b req-8278f2f0-5e46-4984-81a4-8e7694800839 service nova] Creating event network-changed:90bc5925-bdaa-4a69-ba3a-ee4df95942a0 for instance 53aade05-189d-455b-901e-6fb092cfbb07 on n-h1-836830-18 Sep 14 09:13:40.554863 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-6c63df32-53fc-4384-9da9-5a7c87d4438b req-8278f2f0-5e46-4984-81a4-8e7694800839 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063507 Sep 14 09:13:40.555793 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2474/4974] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:13:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:13:41.242191 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-e82f7c7e-3d61-4f67-9e78-3a1e0030876e tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:13:41.243390 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-e82f7c7e-3d61-4f67-9e78-3a1e0030876e tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:13:41.252986 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e82f7c7e-3d61-4f67-9e78-3a1e0030876e tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:41.253401 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e82f7c7e-3d61-4f67-9e78-3a1e0030876e tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:41.253846 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e82f7c7e-3d61-4f67-9e78-3a1e0030876e tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:41.254563 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e82f7c7e-3d61-4f67-9e78-3a1e0030876e tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:41.255061 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e82f7c7e-3d61-4f67-9e78-3a1e0030876e tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:41.255492 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e82f7c7e-3d61-4f67-9e78-3a1e0030876e tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:41.296990 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b9157ce0-a410-4f7d-bbf3-9c9786ff34f4 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:13:41.297721 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b9157ce0-a410-4f7d-bbf3-9c9786ff34f4 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] [instance: ac1c3be3-de1d-456b-bfb9-aad6baafbb34] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:13:41.310007 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b9157ce0-a410-4f7d-bbf3-9c9786ff34f4 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:41.311742 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b9157ce0-a410-4f7d-bbf3-9c9786ff34f4 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:41.312370 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b9157ce0-a410-4f7d-bbf3-9c9786ff34f4 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:41.315823 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b9157ce0-a410-4f7d-bbf3-9c9786ff34f4 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:41.317395 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b9157ce0-a410-4f7d-bbf3-9c9786ff34f4 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:41.319163 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b9157ce0-a410-4f7d-bbf3-9c9786ff34f4 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:41.386793 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-e82f7c7e-3d61-4f67-9e78-3a1e0030876e tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5/os-volume_attachments/6947c133-a0dd-46fe-ae35-0b4c6c12a808" status: 200 len: 194 microversion: 2.20 time: 0.149500 Sep 14 09:13:41.392394 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2501/4975] 10.222.0.60 () {60 vars in 1454 bytes} [Wed Sep 14 09:13:41 2022] GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5/os-volume_attachments/6947c133-a0dd-46fe-ae35-0b4c6c12a808 => generated 194 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 09:13:41.400357 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-f445ffef-3e31-4789-9a48-aa720ce91d69 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:13:41.400995 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-f445ffef-3e31-4789-9a48-aa720ce91d69 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] [instance: d8ae775e-e822-487d-a211-a4f4bd042c21] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:13:41.414594 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f445ffef-3e31-4789-9a48-aa720ce91d69 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:41.415131 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f445ffef-3e31-4789-9a48-aa720ce91d69 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:41.415579 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f445ffef-3e31-4789-9a48-aa720ce91d69 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:41.416304 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f445ffef-3e31-4789-9a48-aa720ce91d69 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:41.416769 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f445ffef-3e31-4789-9a48-aa720ce91d69 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:41.417205 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f445ffef-3e31-4789-9a48-aa720ce91d69 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:41.894103 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-f445ffef-3e31-4789-9a48-aa720ce91d69 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421bf1609a6d4f808a4cb3612bf64615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a020c15f895946328ab384514c1ba463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:13:41.894525 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b9157ce0-a410-4f7d-bbf3-9c9786ff34f4 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe73f3d7f4734e1ab9f6b7283db1388b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94e25a7caf946c2a80b874416e4906b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:13:41.910012 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-f445ffef-3e31-4789-9a48-aa720ce91d69 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] 10.222.0.60 "GET /compute/v2.1/servers/d8ae775e-e822-487d-a211-a4f4bd042c21" status: 200 len: 1314 microversion: 2.1 time: 0.514592 Sep 14 09:13:41.911833 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2502/4976] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:13:41 2022] GET /compute/v2.1/servers/d8ae775e-e822-487d-a211-a4f4bd042c21 => generated 1314 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:13:41.916896 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-aa17c931-ba6c-4da2-9399-37bc026c8cf3 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:13:41.923137 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-aa17c931-ba6c-4da2-9399-37bc026c8cf3 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:13:41.942117 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b9157ce0-a410-4f7d-bbf3-9c9786ff34f4 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] 10.222.0.60 "GET /compute/v2.1/servers/ac1c3be3-de1d-456b-bfb9-aad6baafbb34" status: 200 len: 1333 microversion: 2.1 time: 0.649998 Sep 14 09:13:41.944926 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-aa17c931-ba6c-4da2-9399-37bc026c8cf3 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:41.945593 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-aa17c931-ba6c-4da2-9399-37bc026c8cf3 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:41.946206 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-aa17c931-ba6c-4da2-9399-37bc026c8cf3 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:41.947976 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-aa17c931-ba6c-4da2-9399-37bc026c8cf3 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:41.948575 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-aa17c931-ba6c-4da2-9399-37bc026c8cf3 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:41.949146 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-aa17c931-ba6c-4da2-9399-37bc026c8cf3 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:41.950771 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2475/4977] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:13:41 2022] GET /compute/v2.1/servers/ac1c3be3-de1d-456b-bfb9-aad6baafbb34 => generated 1333 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:13:42.077878 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.objects.instance [None req-aa17c931-ba6c-4da2-9399-37bc026c8cf3 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lazy-loading 'services' on Instance uuid 4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5 {{(pid=128758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:13:42.212768 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-aa17c931-ba6c-4da2-9399-37bc026c8cf3 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "DELETE /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5/os-volume_attachments/6947c133-a0dd-46fe-ae35-0b4c6c12a808" status: 202 len: 0 microversion: 2.20 time: 0.298356 Sep 14 09:13:42.216075 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2503/4978] 10.222.0.60 () {60 vars in 1457 bytes} [Wed Sep 14 09:13:41 2022] DELETE /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5/os-volume_attachments/6947c133-a0dd-46fe-ae35-0b4c6c12a808 => generated 0 bytes in 303 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:13:42.226496 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ea28399e-7640-428c-be63-b1bf5e73d696 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:13:42.231718 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-ea28399e-7640-428c-be63-b1bf5e73d696 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:13:42.241848 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ea28399e-7640-428c-be63-b1bf5e73d696 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:42.242805 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ea28399e-7640-428c-be63-b1bf5e73d696 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:42.244644 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ea28399e-7640-428c-be63-b1bf5e73d696 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:42.245749 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ea28399e-7640-428c-be63-b1bf5e73d696 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:42.247676 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ea28399e-7640-428c-be63-b1bf5e73d696 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:42.248444 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ea28399e-7640-428c-be63-b1bf5e73d696 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:42.316088 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-ea28399e-7640-428c-be63-b1bf5e73d696 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.097137 Sep 14 09:13:42.334393 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2476/4979] 10.222.0.60 () {60 vars in 1343 bytes} [Wed Sep 14 09:13:42 2022] GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5/os-volume_attachments => generated 197 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 14 09:13:42.462043 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-12a0e993-74ab-49e7-a4e3-d1aedfcc182d tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1865109354", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "networks": [{"uuid": "3c41a1b1-078a-46ec-a899-a1f9de1485d9"}], "key_name": "tempest-TestNetworkBasicOps-149670870", "security_groups": [{"name": "tempest-secgroup-smoke-1520191750"}]}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:13:42.583877 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.network.neutron [None req-12a0e993-74ab-49e7-a4e3-d1aedfcc182d tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] validate_networks() for [('3c41a1b1-078a-46ec-a899-a1f9de1485d9', None, None, None, None, None)] {{(pid=128758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:13:42.936909 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-fb9781c2-ab59-43b5-9e77-2b35cb93907e tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:13:42.937534 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-fb9781c2-ab59-43b5-9e77-2b35cb93907e tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] [instance: d8ae775e-e822-487d-a211-a4f4bd042c21] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:13:42.951369 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fb9781c2-ab59-43b5-9e77-2b35cb93907e tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:42.951941 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fb9781c2-ab59-43b5-9e77-2b35cb93907e tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:42.952403 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fb9781c2-ab59-43b5-9e77-2b35cb93907e tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:42.953161 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fb9781c2-ab59-43b5-9e77-2b35cb93907e tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:42.953602 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fb9781c2-ab59-43b5-9e77-2b35cb93907e tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:42.954037 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fb9781c2-ab59-43b5-9e77-2b35cb93907e tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:43.036160 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-12a0e993-74ab-49e7-a4e3-d1aedfcc182d tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Flavor limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:13:43.037096 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-12a0e993-74ab-49e7-a4e3-d1aedfcc182d tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Image limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:13:43.037775 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-12a0e993-74ab-49e7-a4e3-d1aedfcc182d tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Flavor pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:13:43.038375 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-12a0e993-74ab-49e7-a4e3-d1aedfcc182d tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Image pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:13:43.039010 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-12a0e993-74ab-49e7-a4e3-d1aedfcc182d tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:13:43.053297 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-12a0e993-74ab-49e7-a4e3-d1aedfcc182d tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:43.058251 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-12a0e993-74ab-49e7-a4e3-d1aedfcc182d tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:43.060384 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-12a0e993-74ab-49e7-a4e3-d1aedfcc182d tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:43.066231 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-12a0e993-74ab-49e7-a4e3-d1aedfcc182d tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:43.067560 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-12a0e993-74ab-49e7-a4e3-d1aedfcc182d tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:43.068895 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-12a0e993-74ab-49e7-a4e3-d1aedfcc182d tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:43.093501 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-12a0e993-74ab-49e7-a4e3-d1aedfcc182d tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Getting quotas for project 021b73b20f2042c6a08f94ed23ff66e5. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:13:43.101689 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-12a0e993-74ab-49e7-a4e3-d1aedfcc182d tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Getting quotas for user 17918433a3994b69a65999a59a7f833c and project 021b73b20f2042c6a08f94ed23ff66e5. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:13:43.131430 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-12a0e993-74ab-49e7-a4e3-d1aedfcc182d tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Going to run 1 instances... {{(pid=128758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:13:43.134275 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-12a0e993-74ab-49e7-a4e3-d1aedfcc182d tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] [instance: d42a47fc-3124-4479-aff4-e2a5ba888729] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:13:43.182245 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=5 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:13:43.233433 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-12a0e993-74ab-49e7-a4e3-d1aedfcc182d tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.775761 Sep 14 09:13:43.234113 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2504/4980] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 09:13:42 2022] POST /compute/v2.1/servers => generated 406 bytes in 777 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:13:43.244666 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1baa50dc-a7b7-4a90-9575-907d69930e66 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:13:43.245300 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-1baa50dc-a7b7-4a90-9575-907d69930e66 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] [instance: ac1c3be3-de1d-456b-bfb9-aad6baafbb34] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:13:43.269834 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1baa50dc-a7b7-4a90-9575-907d69930e66 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:43.269834 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1baa50dc-a7b7-4a90-9575-907d69930e66 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:43.270256 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1baa50dc-a7b7-4a90-9575-907d69930e66 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:43.271013 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1baa50dc-a7b7-4a90-9575-907d69930e66 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:43.271479 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1baa50dc-a7b7-4a90-9575-907d69930e66 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:43.271914 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1baa50dc-a7b7-4a90-9575-907d69930e66 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:43.329780 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-fb9781c2-ab59-43b5-9e77-2b35cb93907e tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421bf1609a6d4f808a4cb3612bf64615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a020c15f895946328ab384514c1ba463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:13:43.339536 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-fb9781c2-ab59-43b5-9e77-2b35cb93907e tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] 10.222.0.60 "GET /compute/v2.1/servers/d8ae775e-e822-487d-a211-a4f4bd042c21" status: 200 len: 1314 microversion: 2.1 time: 0.406468 Sep 14 09:13:43.363596 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2477/4981] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:13:42 2022] GET /compute/v2.1/servers/d8ae775e-e822-487d-a211-a4f4bd042c21 => generated 1314 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:13:43.370623 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-56e62b7e-b5ed-47a5-92de-edf72ac699cd tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:13:43.372142 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-56e62b7e-b5ed-47a5-92de-edf72ac699cd tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] [instance: d42a47fc-3124-4479-aff4-e2a5ba888729] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:13:43.510454 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-56e62b7e-b5ed-47a5-92de-edf72ac699cd tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17918433a3994b69a65999a59a7f833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b73b20f2042c6a08f94ed23ff66e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:13:43.522470 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-56e62b7e-b5ed-47a5-92de-edf72ac699cd tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] 10.222.0.60 "GET /compute/v2.1/servers/d42a47fc-3124-4479-aff4-e2a5ba888729" status: 200 len: 1248 microversion: 2.1 time: 0.155866 Sep 14 09:13:43.525116 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2478/4982] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:13:43 2022] GET /compute/v2.1/servers/d42a47fc-3124-4479-aff4-e2a5ba888729 => generated 1248 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:13:43.542710 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c7dc843a-18f6-4ed7-80b6-d15785191324 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:13:43.552251 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-c7dc843a-18f6-4ed7-80b6-d15785191324 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:13:43.580780 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c7dc843a-18f6-4ed7-80b6-d15785191324 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:43.582971 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c7dc843a-18f6-4ed7-80b6-d15785191324 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:43.586130 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c7dc843a-18f6-4ed7-80b6-d15785191324 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:43.587146 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c7dc843a-18f6-4ed7-80b6-d15785191324 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:43.589934 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c7dc843a-18f6-4ed7-80b6-d15785191324 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:43.591372 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c7dc843a-18f6-4ed7-80b6-d15785191324 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:43.627839 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-1baa50dc-a7b7-4a90-9575-907d69930e66 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe73f3d7f4734e1ab9f6b7283db1388b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94e25a7caf946c2a80b874416e4906b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:13:43.644406 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-1baa50dc-a7b7-4a90-9575-907d69930e66 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] 10.222.0.60 "GET /compute/v2.1/servers/ac1c3be3-de1d-456b-bfb9-aad6baafbb34" status: 200 len: 1333 microversion: 2.1 time: 0.398189 Sep 14 09:13:43.645111 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2505/4983] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:13:43 2022] GET /compute/v2.1/servers/ac1c3be3-de1d-456b-bfb9-aad6baafbb34 => generated 1333 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:13:43.675232 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-c7dc843a-18f6-4ed7-80b6-d15785191324 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.148674 Sep 14 09:13:43.680327 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2479/4984] 10.222.0.60 () {60 vars in 1343 bytes} [Wed Sep 14 09:13:43 2022] GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5/os-volume_attachments => generated 197 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 09:13:44.366124 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d66c6cc2-d39c-4dfd-bb85-8be9a0c0ae80 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:13:44.366754 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-d66c6cc2-d39c-4dfd-bb85-8be9a0c0ae80 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] [instance: d8ae775e-e822-487d-a211-a4f4bd042c21] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:13:44.374217 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d66c6cc2-d39c-4dfd-bb85-8be9a0c0ae80 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:44.374710 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d66c6cc2-d39c-4dfd-bb85-8be9a0c0ae80 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:44.375191 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d66c6cc2-d39c-4dfd-bb85-8be9a0c0ae80 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:44.389336 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d66c6cc2-d39c-4dfd-bb85-8be9a0c0ae80 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:44.390117 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d66c6cc2-d39c-4dfd-bb85-8be9a0c0ae80 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:44.392101 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d66c6cc2-d39c-4dfd-bb85-8be9a0c0ae80 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:44.553476 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f8c75158-2634-4d1a-8e2a-61968d7693ee tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:13:44.554118 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f8c75158-2634-4d1a-8e2a-61968d7693ee tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] [instance: d42a47fc-3124-4479-aff4-e2a5ba888729] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:13:44.566512 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f8c75158-2634-4d1a-8e2a-61968d7693ee tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:44.567053 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f8c75158-2634-4d1a-8e2a-61968d7693ee tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:44.571296 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f8c75158-2634-4d1a-8e2a-61968d7693ee tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:44.572125 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f8c75158-2634-4d1a-8e2a-61968d7693ee tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:44.572800 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f8c75158-2634-4d1a-8e2a-61968d7693ee tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:44.573380 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f8c75158-2634-4d1a-8e2a-61968d7693ee tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:44.615851 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=100 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:13:45.435405 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f8c75158-2634-4d1a-8e2a-61968d7693ee tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17918433a3994b69a65999a59a7f833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b73b20f2042c6a08f94ed23ff66e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:13:45.446849 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f8c75158-2634-4d1a-8e2a-61968d7693ee tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] 10.222.0.60 "GET /compute/v2.1/servers/d42a47fc-3124-4479-aff4-e2a5ba888729" status: 200 len: 1300 microversion: 2.1 time: 0.898788 Sep 14 09:13:45.468529 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2480/4985] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:13:44 2022] GET /compute/v2.1/servers/d42a47fc-3124-4479-aff4-e2a5ba888729 => generated 1300 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:13:45.517958 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-5ede7b34-a9a6-4adb-9a7d-a4d88fe31a55 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:13:45.518788 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-5ede7b34-a9a6-4adb-9a7d-a4d88fe31a55 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] [instance: ac1c3be3-de1d-456b-bfb9-aad6baafbb34] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:13:45.559446 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5ede7b34-a9a6-4adb-9a7d-a4d88fe31a55 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:45.560118 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5ede7b34-a9a6-4adb-9a7d-a4d88fe31a55 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:45.562175 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5ede7b34-a9a6-4adb-9a7d-a4d88fe31a55 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:45.563012 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5ede7b34-a9a6-4adb-9a7d-a4d88fe31a55 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:45.563502 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5ede7b34-a9a6-4adb-9a7d-a4d88fe31a55 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:45.566444 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5ede7b34-a9a6-4adb-9a7d-a4d88fe31a55 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:45.649526 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-d66c6cc2-d39c-4dfd-bb85-8be9a0c0ae80 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421bf1609a6d4f808a4cb3612bf64615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a020c15f895946328ab384514c1ba463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:13:45.668325 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-d66c6cc2-d39c-4dfd-bb85-8be9a0c0ae80 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] 10.222.0.60 "GET /compute/v2.1/servers/d8ae775e-e822-487d-a211-a4f4bd042c21" status: 200 len: 1314 microversion: 2.1 time: 1.303876 Sep 14 09:13:45.671181 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2506/4986] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:13:44 2022] GET /compute/v2.1/servers/d8ae775e-e822-487d-a211-a4f4bd042c21 => generated 1314 bytes in 1310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:13:45.680754 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-00c5d478-9b21-4d23-a67c-646a2e1ce570 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:13:45.690386 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-00c5d478-9b21-4d23-a67c-646a2e1ce570 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:13:45.707536 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-00c5d478-9b21-4d23-a67c-646a2e1ce570 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:45.708645 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-00c5d478-9b21-4d23-a67c-646a2e1ce570 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:45.709702 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-00c5d478-9b21-4d23-a67c-646a2e1ce570 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:45.710890 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-00c5d478-9b21-4d23-a67c-646a2e1ce570 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:45.712197 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-00c5d478-9b21-4d23-a67c-646a2e1ce570 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:45.713818 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-00c5d478-9b21-4d23-a67c-646a2e1ce570 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:45.807190 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-00c5d478-9b21-4d23-a67c-646a2e1ce570 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.134542 Sep 14 09:13:45.816570 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2507/4987] 10.222.0.60 () {60 vars in 1343 bytes} [Wed Sep 14 09:13:45 2022] GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5/os-volume_attachments => generated 197 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 09:13:45.929135 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-5ede7b34-a9a6-4adb-9a7d-a4d88fe31a55 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe73f3d7f4734e1ab9f6b7283db1388b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94e25a7caf946c2a80b874416e4906b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:13:45.939920 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-5ede7b34-a9a6-4adb-9a7d-a4d88fe31a55 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] 10.222.0.60 "GET /compute/v2.1/servers/ac1c3be3-de1d-456b-bfb9-aad6baafbb34" status: 200 len: 1333 microversion: 2.1 time: 0.470121 Sep 14 09:13:45.940532 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2481/4988] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:13:45 2022] GET /compute/v2.1/servers/ac1c3be3-de1d-456b-bfb9-aad6baafbb34 => generated 1333 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:13:46.493825 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-715ab91e-e341-45a5-82e3-86515031f6a2 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:13:46.494530 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-715ab91e-e341-45a5-82e3-86515031f6a2 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] [instance: d42a47fc-3124-4479-aff4-e2a5ba888729] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:13:46.505297 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-715ab91e-e341-45a5-82e3-86515031f6a2 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:46.505806 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-715ab91e-e341-45a5-82e3-86515031f6a2 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:46.506243 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-715ab91e-e341-45a5-82e3-86515031f6a2 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:46.529067 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-715ab91e-e341-45a5-82e3-86515031f6a2 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:46.529824 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-715ab91e-e341-45a5-82e3-86515031f6a2 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:46.530439 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-715ab91e-e341-45a5-82e3-86515031f6a2 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:46.535487 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:13:46.699546 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9c319949-24c3-4c75-b9ed-39a3ae76c518 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:13:46.700313 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-9c319949-24c3-4c75-b9ed-39a3ae76c518 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] [instance: d8ae775e-e822-487d-a211-a4f4bd042c21] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:13:46.712913 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-715ab91e-e341-45a5-82e3-86515031f6a2 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17918433a3994b69a65999a59a7f833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b73b20f2042c6a08f94ed23ff66e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:13:46.716039 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9c319949-24c3-4c75-b9ed-39a3ae76c518 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:46.718578 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9c319949-24c3-4c75-b9ed-39a3ae76c518 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:46.719117 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9c319949-24c3-4c75-b9ed-39a3ae76c518 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:46.720372 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9c319949-24c3-4c75-b9ed-39a3ae76c518 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:46.720855 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9c319949-24c3-4c75-b9ed-39a3ae76c518 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:46.723643 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9c319949-24c3-4c75-b9ed-39a3ae76c518 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:46.736881 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-715ab91e-e341-45a5-82e3-86515031f6a2 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] 10.222.0.60 "GET /compute/v2.1/servers/d42a47fc-3124-4479-aff4-e2a5ba888729" status: 200 len: 1306 microversion: 2.1 time: 0.246542 Sep 14 09:13:46.755761 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2508/4989] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:13:46 2022] GET /compute/v2.1/servers/d42a47fc-3124-4479-aff4-e2a5ba888729 => generated 1306 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:13:46.829363 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-19bce483-42f4-4243-9c13-380d64d63c8c tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:13:46.833313 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-19bce483-42f4-4243-9c13-380d64d63c8c tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:13:46.848830 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-19bce483-42f4-4243-9c13-380d64d63c8c tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:46.849772 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-19bce483-42f4-4243-9c13-380d64d63c8c tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:46.850398 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-19bce483-42f4-4243-9c13-380d64d63c8c tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:46.851328 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-19bce483-42f4-4243-9c13-380d64d63c8c tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:46.853699 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-19bce483-42f4-4243-9c13-380d64d63c8c tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:46.855568 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-19bce483-42f4-4243-9c13-380d64d63c8c tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:46.896592 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-19bce483-42f4-4243-9c13-380d64d63c8c tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.072392 Sep 14 09:13:46.898187 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2509/4990] 10.222.0.60 () {60 vars in 1343 bytes} [Wed Sep 14 09:13:46 2022] GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 14 09:13:46.966760 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-84fb5742-0156-4be5-bf4e-3026ee9250cc tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:13:46.967520 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-84fb5742-0156-4be5-bf4e-3026ee9250cc tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] [instance: ac1c3be3-de1d-456b-bfb9-aad6baafbb34] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:13:46.990746 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-84fb5742-0156-4be5-bf4e-3026ee9250cc tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:46.994071 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-84fb5742-0156-4be5-bf4e-3026ee9250cc tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:46.994564 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-84fb5742-0156-4be5-bf4e-3026ee9250cc tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:46.999348 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-84fb5742-0156-4be5-bf4e-3026ee9250cc tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:47.000447 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-84fb5742-0156-4be5-bf4e-3026ee9250cc tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:47.001068 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-84fb5742-0156-4be5-bf4e-3026ee9250cc tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:47.288065 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-9c319949-24c3-4c75-b9ed-39a3ae76c518 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421bf1609a6d4f808a4cb3612bf64615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a020c15f895946328ab384514c1ba463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:13:47.301005 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-9c319949-24c3-4c75-b9ed-39a3ae76c518 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] 10.222.0.60 "GET /compute/v2.1/servers/d8ae775e-e822-487d-a211-a4f4bd042c21" status: 200 len: 1314 microversion: 2.1 time: 0.606186 Sep 14 09:13:47.301831 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2482/4991] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:13:46 2022] GET /compute/v2.1/servers/d8ae775e-e822-487d-a211-a4f4bd042c21 => generated 1314 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:13:47.633197 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-84fb5742-0156-4be5-bf4e-3026ee9250cc tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe73f3d7f4734e1ab9f6b7283db1388b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94e25a7caf946c2a80b874416e4906b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:13:47.661526 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-84fb5742-0156-4be5-bf4e-3026ee9250cc tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] 10.222.0.60 "GET /compute/v2.1/servers/ac1c3be3-de1d-456b-bfb9-aad6baafbb34" status: 200 len: 1333 microversion: 2.1 time: 0.688232 Sep 14 09:13:47.668579 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2510/4992] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:13:46 2022] GET /compute/v2.1/servers/ac1c3be3-de1d-456b-bfb9-aad6baafbb34 => generated 1333 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:13:47.760960 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-de838163-b3f3-4f08-bd3b-7fc2363a4d7b tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:13:47.762112 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-de838163-b3f3-4f08-bd3b-7fc2363a4d7b tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] [instance: d42a47fc-3124-4479-aff4-e2a5ba888729] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:13:47.765406 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:13:47.788406 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-de838163-b3f3-4f08-bd3b-7fc2363a4d7b tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:47.788922 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-de838163-b3f3-4f08-bd3b-7fc2363a4d7b tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:47.789378 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-de838163-b3f3-4f08-bd3b-7fc2363a4d7b tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:47.790113 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-de838163-b3f3-4f08-bd3b-7fc2363a4d7b tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:47.790584 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-de838163-b3f3-4f08-bd3b-7fc2363a4d7b tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:47.791046 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-de838163-b3f3-4f08-bd3b-7fc2363a4d7b tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:47.912065 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-5a32ba0d-f5a2-48d2-a4fb-8e92b158c849 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:13:47.914419 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-5a32ba0d-f5a2-48d2-a4fb-8e92b158c849 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:13:47.935650 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5a32ba0d-f5a2-48d2-a4fb-8e92b158c849 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:47.938363 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5a32ba0d-f5a2-48d2-a4fb-8e92b158c849 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:47.938863 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5a32ba0d-f5a2-48d2-a4fb-8e92b158c849 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:47.952891 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5a32ba0d-f5a2-48d2-a4fb-8e92b158c849 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:47.953612 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5a32ba0d-f5a2-48d2-a4fb-8e92b158c849 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:47.954076 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5a32ba0d-f5a2-48d2-a4fb-8e92b158c849 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:48.045477 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-5a32ba0d-f5a2-48d2-a4fb-8e92b158c849 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.138528 Sep 14 09:13:48.048060 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2511/4993] 10.222.0.60 () {60 vars in 1343 bytes} [Wed Sep 14 09:13:47 2022] GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5/os-volume_attachments => generated 197 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 14 09:13:48.154426 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-2f5aa9be-3df2-4880-b36b-ec8c8c06c244 req-13d95352-47e1-4279-b2e2-a3848dbeb2c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac1c3be3-de1d-456b-bfb9-aad6baafbb34", "name": "network-vif-plugged", "status": "completed", "tag": "281abffd-f25c-48c2-bfb8-373ceff41810"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:13:48.171404 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-2f5aa9be-3df2-4880-b36b-ec8c8c06c244 req-13d95352-47e1-4279-b2e2-a3848dbeb2c1 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:48.172213 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-2f5aa9be-3df2-4880-b36b-ec8c8c06c244 req-13d95352-47e1-4279-b2e2-a3848dbeb2c1 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:48.172838 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-2f5aa9be-3df2-4880-b36b-ec8c8c06c244 req-13d95352-47e1-4279-b2e2-a3848dbeb2c1 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:48.211157 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-2f5aa9be-3df2-4880-b36b-ec8c8c06c244 req-13d95352-47e1-4279-b2e2-a3848dbeb2c1 service nova] Creating event network-vif-plugged:281abffd-f25c-48c2-bfb8-373ceff41810 for instance ac1c3be3-de1d-456b-bfb9-aad6baafbb34 on n-h2-836830-18 Sep 14 09:13:48.217683 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-2f5aa9be-3df2-4880-b36b-ec8c8c06c244 req-13d95352-47e1-4279-b2e2-a3848dbeb2c1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066383 Sep 14 09:13:48.219677 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2512/4994] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:13:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:13:48.330049 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-86974932-d003-423a-b510-574b97c20d1f tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:13:48.330687 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-86974932-d003-423a-b510-574b97c20d1f tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] [instance: d8ae775e-e822-487d-a211-a4f4bd042c21] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:13:48.342590 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-86974932-d003-423a-b510-574b97c20d1f tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:48.344744 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-86974932-d003-423a-b510-574b97c20d1f tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:48.346459 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-86974932-d003-423a-b510-574b97c20d1f tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:48.350226 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-86974932-d003-423a-b510-574b97c20d1f tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:48.351266 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-86974932-d003-423a-b510-574b97c20d1f tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:48.352006 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-86974932-d003-423a-b510-574b97c20d1f tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:48.402674 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-de838163-b3f3-4f08-bd3b-7fc2363a4d7b tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17918433a3994b69a65999a59a7f833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b73b20f2042c6a08f94ed23ff66e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:13:48.414460 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-de838163-b3f3-4f08-bd3b-7fc2363a4d7b tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] 10.222.0.60 "GET /compute/v2.1/servers/d42a47fc-3124-4479-aff4-e2a5ba888729" status: 200 len: 1374 microversion: 2.1 time: 0.657347 Sep 14 09:13:48.417194 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2483/4995] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:13:47 2022] GET /compute/v2.1/servers/d42a47fc-3124-4479-aff4-e2a5ba888729 => generated 1374 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:13:48.687613 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a35a8c92-1fbc-45ed-a4b5-ea3f7feb986b tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:13:48.688249 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-a35a8c92-1fbc-45ed-a4b5-ea3f7feb986b tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] [instance: ac1c3be3-de1d-456b-bfb9-aad6baafbb34] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:13:48.697421 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-86974932-d003-423a-b510-574b97c20d1f tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421bf1609a6d4f808a4cb3612bf64615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a020c15f895946328ab384514c1ba463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:13:48.698589 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a35a8c92-1fbc-45ed-a4b5-ea3f7feb986b tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:48.709689 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a35a8c92-1fbc-45ed-a4b5-ea3f7feb986b tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:48.710272 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a35a8c92-1fbc-45ed-a4b5-ea3f7feb986b tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:48.711064 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a35a8c92-1fbc-45ed-a4b5-ea3f7feb986b tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:48.711742 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a35a8c92-1fbc-45ed-a4b5-ea3f7feb986b tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:48.712387 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a35a8c92-1fbc-45ed-a4b5-ea3f7feb986b tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:48.717029 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-86974932-d003-423a-b510-574b97c20d1f tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] 10.222.0.60 "GET /compute/v2.1/servers/d8ae775e-e822-487d-a211-a4f4bd042c21" status: 200 len: 1314 microversion: 2.1 time: 0.391463 Sep 14 09:13:48.733347 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2513/4996] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:13:48 2022] GET /compute/v2.1/servers/d8ae775e-e822-487d-a211-a4f4bd042c21 => generated 1314 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:13:49.062012 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-4cec5f3f-557d-4c8c-870e-1d2c34736714 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:13:49.066211 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-4cec5f3f-557d-4c8c-870e-1d2c34736714 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:13:49.090393 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4cec5f3f-557d-4c8c-870e-1d2c34736714 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:49.093199 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4cec5f3f-557d-4c8c-870e-1d2c34736714 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:49.095451 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4cec5f3f-557d-4c8c-870e-1d2c34736714 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:49.097694 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4cec5f3f-557d-4c8c-870e-1d2c34736714 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:49.100394 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4cec5f3f-557d-4c8c-870e-1d2c34736714 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:49.101756 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4cec5f3f-557d-4c8c-870e-1d2c34736714 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:49.204218 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-4cec5f3f-557d-4c8c-870e-1d2c34736714 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.148052 Sep 14 09:13:49.207666 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2514/4997] 10.222.0.60 () {60 vars in 1343 bytes} [Wed Sep 14 09:13:49 2022] GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5/os-volume_attachments => generated 197 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 09:13:49.272294 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-a35a8c92-1fbc-45ed-a4b5-ea3f7feb986b tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe73f3d7f4734e1ab9f6b7283db1388b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94e25a7caf946c2a80b874416e4906b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:13:49.284000 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a35a8c92-1fbc-45ed-a4b5-ea3f7feb986b tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] 10.222.0.60 "GET /compute/v2.1/servers/ac1c3be3-de1d-456b-bfb9-aad6baafbb34" status: 200 len: 1333 microversion: 2.1 time: 0.600856 Sep 14 09:13:49.284644 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2484/4998] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:13:48 2022] GET /compute/v2.1/servers/ac1c3be3-de1d-456b-bfb9-aad6baafbb34 => generated 1333 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:13:49.442727 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-8e63abd8-9b34-4f5c-8c9f-ee78fe936bfd tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:13:49.444508 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-8e63abd8-9b34-4f5c-8c9f-ee78fe936bfd tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] [instance: d42a47fc-3124-4479-aff4-e2a5ba888729] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:13:49.454779 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8e63abd8-9b34-4f5c-8c9f-ee78fe936bfd tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:49.455652 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8e63abd8-9b34-4f5c-8c9f-ee78fe936bfd tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:49.455795 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8e63abd8-9b34-4f5c-8c9f-ee78fe936bfd tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:49.456410 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8e63abd8-9b34-4f5c-8c9f-ee78fe936bfd tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:49.456868 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8e63abd8-9b34-4f5c-8c9f-ee78fe936bfd tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:49.457294 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8e63abd8-9b34-4f5c-8c9f-ee78fe936bfd tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:49.744879 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-4d525745-44fc-45ea-8b1e-f599c1c443a4 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:13:49.745672 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-4d525745-44fc-45ea-8b1e-f599c1c443a4 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] [instance: d8ae775e-e822-487d-a211-a4f4bd042c21] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:13:49.756585 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4d525745-44fc-45ea-8b1e-f599c1c443a4 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:49.757374 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4d525745-44fc-45ea-8b1e-f599c1c443a4 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:49.758644 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4d525745-44fc-45ea-8b1e-f599c1c443a4 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:49.760559 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4d525745-44fc-45ea-8b1e-f599c1c443a4 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:49.763148 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4d525745-44fc-45ea-8b1e-f599c1c443a4 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:49.763737 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4d525745-44fc-45ea-8b1e-f599c1c443a4 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:50.322204 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-8e63abd8-9b34-4f5c-8c9f-ee78fe936bfd tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17918433a3994b69a65999a59a7f833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b73b20f2042c6a08f94ed23ff66e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:13:50.334331 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-8e63abd8-9b34-4f5c-8c9f-ee78fe936bfd tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] 10.222.0.60 "GET /compute/v2.1/servers/d42a47fc-3124-4479-aff4-e2a5ba888729" status: 200 len: 1374 microversion: 2.1 time: 0.895190 Sep 14 09:13:50.335619 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2515/4999] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:13:49 2022] GET /compute/v2.1/servers/d42a47fc-3124-4479-aff4-e2a5ba888729 => generated 1374 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:13:50.342677 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-421e7061-12dc-4bd8-b778-fa83d7ed5f42 req-05bf66a9-df5d-41a0-896a-afea88646ad3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d42a47fc-3124-4479-aff4-e2a5ba888729", "tag": "4f2597fa-7f1f-432b-bf54-eb3d836a36dd"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:13:50.354987 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-421e7061-12dc-4bd8-b778-fa83d7ed5f42 req-05bf66a9-df5d-41a0-896a-afea88646ad3 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:50.356169 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-421e7061-12dc-4bd8-b778-fa83d7ed5f42 req-05bf66a9-df5d-41a0-896a-afea88646ad3 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:50.356613 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-421e7061-12dc-4bd8-b778-fa83d7ed5f42 req-05bf66a9-df5d-41a0-896a-afea88646ad3 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:50.369784 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-421e7061-12dc-4bd8-b778-fa83d7ed5f42 req-05bf66a9-df5d-41a0-896a-afea88646ad3 service nova] Creating event network-changed:4f2597fa-7f1f-432b-bf54-eb3d836a36dd for instance d42a47fc-3124-4479-aff4-e2a5ba888729 on n-h1-836830-18 Sep 14 09:13:50.375512 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-421e7061-12dc-4bd8-b778-fa83d7ed5f42 req-05bf66a9-df5d-41a0-896a-afea88646ad3 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038390 Sep 14 09:13:50.376687 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2516/5000] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:13:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:13:50.384164 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-7c526e5b-40ab-49e3-bfc8-970f237b76f1 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:13:50.386599 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-7c526e5b-40ab-49e3-bfc8-970f237b76f1 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:13:50.393883 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7c526e5b-40ab-49e3-bfc8-970f237b76f1 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:50.394280 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7c526e5b-40ab-49e3-bfc8-970f237b76f1 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:50.394726 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7c526e5b-40ab-49e3-bfc8-970f237b76f1 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:50.395499 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7c526e5b-40ab-49e3-bfc8-970f237b76f1 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:50.395964 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7c526e5b-40ab-49e3-bfc8-970f237b76f1 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:50.396401 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7c526e5b-40ab-49e3-bfc8-970f237b76f1 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:50.435019 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-7c526e5b-40ab-49e3-bfc8-970f237b76f1 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.056406 Sep 14 09:13:50.435721 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2517/5001] 10.222.0.60 () {60 vars in 1343 bytes} [Wed Sep 14 09:13:50 2022] GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:13:50.435721 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-001b7aeb-2f7a-4b32-b1a3-c10c0975e5be tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:13:50.454705 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-001b7aeb-2f7a-4b32-b1a3-c10c0975e5be tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] [instance: ac1c3be3-de1d-456b-bfb9-aad6baafbb34] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:13:50.469412 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-001b7aeb-2f7a-4b32-b1a3-c10c0975e5be tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:50.470070 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-001b7aeb-2f7a-4b32-b1a3-c10c0975e5be tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:50.470615 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-001b7aeb-2f7a-4b32-b1a3-c10c0975e5be tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:50.472391 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-001b7aeb-2f7a-4b32-b1a3-c10c0975e5be tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:50.473332 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-001b7aeb-2f7a-4b32-b1a3-c10c0975e5be tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:50.477729 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-001b7aeb-2f7a-4b32-b1a3-c10c0975e5be tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:50.497463 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-4d525745-44fc-45ea-8b1e-f599c1c443a4 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421bf1609a6d4f808a4cb3612bf64615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a020c15f895946328ab384514c1ba463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:13:50.506497 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-4d525745-44fc-45ea-8b1e-f599c1c443a4 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] 10.222.0.60 "GET /compute/v2.1/servers/d8ae775e-e822-487d-a211-a4f4bd042c21" status: 200 len: 1314 microversion: 2.1 time: 0.765910 Sep 14 09:13:50.513355 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2485/5002] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:13:49 2022] GET /compute/v2.1/servers/d8ae775e-e822-487d-a211-a4f4bd042c21 => generated 1314 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:13:50.518901 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-257749e6-e790-40c1-96a7-963de111e996 req-85f8c4cd-ddfe-4b31-9a0f-3b81a80a69c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac1c3be3-de1d-456b-bfb9-aad6baafbb34", "name": "network-vif-plugged", "status": "completed", "tag": "0391a3db-803f-4dc5-aeb7-7b667c18bfdb"}, {"server_uuid": "d8ae775e-e822-487d-a211-a4f4bd042c21", "name": "network-vif-plugged", "status": "completed", "tag": "4eb2d6f4-d3a5-4426-aaae-c70f33c5937a"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:13:50.543710 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-257749e6-e790-40c1-96a7-963de111e996 req-85f8c4cd-ddfe-4b31-9a0f-3b81a80a69c7 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:50.544197 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-257749e6-e790-40c1-96a7-963de111e996 req-85f8c4cd-ddfe-4b31-9a0f-3b81a80a69c7 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:50.544633 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-257749e6-e790-40c1-96a7-963de111e996 req-85f8c4cd-ddfe-4b31-9a0f-3b81a80a69c7 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:50.591926 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-257749e6-e790-40c1-96a7-963de111e996 req-85f8c4cd-ddfe-4b31-9a0f-3b81a80a69c7 service nova] Creating event network-vif-plugged:0391a3db-803f-4dc5-aeb7-7b667c18bfdb for instance ac1c3be3-de1d-456b-bfb9-aad6baafbb34 on n-h2-836830-18 Sep 14 09:13:50.592845 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-257749e6-e790-40c1-96a7-963de111e996 req-85f8c4cd-ddfe-4b31-9a0f-3b81a80a69c7 service nova] Creating event network-vif-plugged:4eb2d6f4-d3a5-4426-aaae-c70f33c5937a for instance d8ae775e-e822-487d-a211-a4f4bd042c21 on n-h2-836830-18 Sep 14 09:13:50.600567 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-257749e6-e790-40c1-96a7-963de111e996 req-85f8c4cd-ddfe-4b31-9a0f-3b81a80a69c7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.085174 Sep 14 09:13:50.601345 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2486/5003] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:13:50 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:13:50.695834 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-001b7aeb-2f7a-4b32-b1a3-c10c0975e5be tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe73f3d7f4734e1ab9f6b7283db1388b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94e25a7caf946c2a80b874416e4906b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:13:50.712102 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-001b7aeb-2f7a-4b32-b1a3-c10c0975e5be tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] 10.222.0.60 "GET /compute/v2.1/servers/ac1c3be3-de1d-456b-bfb9-aad6baafbb34" status: 200 len: 1333 microversion: 2.1 time: 0.275118 Sep 14 09:13:50.713440 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2518/5004] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:13:50 2022] GET /compute/v2.1/servers/ac1c3be3-de1d-456b-bfb9-aad6baafbb34 => generated 1333 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:13:50.874329 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-4d81bee6-589e-4a19-97db-94c4873c96bf tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:13:50.875198 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-4d81bee6-589e-4a19-97db-94c4873c96bf tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:13:50.883415 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4d81bee6-589e-4a19-97db-94c4873c96bf tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:50.884164 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4d81bee6-589e-4a19-97db-94c4873c96bf tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:50.884785 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4d81bee6-589e-4a19-97db-94c4873c96bf tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:50.885727 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4d81bee6-589e-4a19-97db-94c4873c96bf tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:50.886983 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4d81bee6-589e-4a19-97db-94c4873c96bf tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:50.887789 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4d81bee6-589e-4a19-97db-94c4873c96bf tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:50.920498 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-4d81bee6-589e-4a19-97db-94c4873c96bf tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5] Going to try to terminate instance {{(pid=128759) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:13:51.026821 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-4d81bee6-589e-4a19-97db-94c4873c96bf tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "DELETE /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5" status: 204 len: 0 microversion: 2.20 time: 0.422816 Sep 14 09:13:51.027852 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2487/5005] 10.222.0.60 () {60 vars in 1280 bytes} [Wed Sep 14 09:13:50 2022] DELETE /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 14 09:13:51.036808 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-fcd33208-619c-42f9-ab1f-de5627a94a65 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:13:51.037774 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-fcd33208-619c-42f9-ab1f-de5627a94a65 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:13:51.047968 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fcd33208-619c-42f9-ab1f-de5627a94a65 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:51.048511 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fcd33208-619c-42f9-ab1f-de5627a94a65 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:51.048940 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fcd33208-619c-42f9-ab1f-de5627a94a65 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:51.049860 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fcd33208-619c-42f9-ab1f-de5627a94a65 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:51.050319 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fcd33208-619c-42f9-ab1f-de5627a94a65 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:51.050749 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fcd33208-619c-42f9-ab1f-de5627a94a65 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:51.202023 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-fcd33208-619c-42f9-ab1f-de5627a94a65 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:13:51.213351 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-fcd33208-619c-42f9-ab1f-de5627a94a65 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:13:51.214854 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-fcd33208-619c-42f9-ab1f-de5627a94a65 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:13:51.216197 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-fcd33208-619c-42f9-ab1f-de5627a94a65 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5" status: 200 len: 1722 microversion: 2.20 time: 0.183926 Sep 14 09:13:51.216780 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2519/5006] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:13:51 2022] GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5 => generated 1722 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:13:51.359991 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8424b132-afbf-4b4f-b650-dfbdcbb33947 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:13:51.361079 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-8424b132-afbf-4b4f-b650-dfbdcbb33947 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] [instance: d42a47fc-3124-4479-aff4-e2a5ba888729] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:13:51.368302 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8424b132-afbf-4b4f-b650-dfbdcbb33947 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:51.369225 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8424b132-afbf-4b4f-b650-dfbdcbb33947 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:51.370067 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8424b132-afbf-4b4f-b650-dfbdcbb33947 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:51.371629 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8424b132-afbf-4b4f-b650-dfbdcbb33947 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:51.372284 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8424b132-afbf-4b4f-b650-dfbdcbb33947 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:51.373006 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8424b132-afbf-4b4f-b650-dfbdcbb33947 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:51.533991 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-af748487-4307-43ea-babe-e6627712e64d tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:13:51.535310 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-af748487-4307-43ea-babe-e6627712e64d tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] [instance: d8ae775e-e822-487d-a211-a4f4bd042c21] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:13:51.543400 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-af748487-4307-43ea-babe-e6627712e64d tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:51.544106 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-af748487-4307-43ea-babe-e6627712e64d tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:51.545431 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-af748487-4307-43ea-babe-e6627712e64d tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:51.552414 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-af748487-4307-43ea-babe-e6627712e64d tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:51.563998 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-af748487-4307-43ea-babe-e6627712e64d tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:51.576185 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-af748487-4307-43ea-babe-e6627712e64d tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:51.901415 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-8424b132-afbf-4b4f-b650-dfbdcbb33947 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17918433a3994b69a65999a59a7f833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b73b20f2042c6a08f94ed23ff66e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:13:51.919119 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-8424b132-afbf-4b4f-b650-dfbdcbb33947 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] 10.222.0.60 "GET /compute/v2.1/servers/d42a47fc-3124-4479-aff4-e2a5ba888729" status: 200 len: 1374 microversion: 2.1 time: 0.562078 Sep 14 09:13:51.920957 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2488/5007] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:13:51 2022] GET /compute/v2.1/servers/d42a47fc-3124-4479-aff4-e2a5ba888729 => generated 1374 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:13:51.924307 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-af748487-4307-43ea-babe-e6627712e64d tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421bf1609a6d4f808a4cb3612bf64615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a020c15f895946328ab384514c1ba463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:13:51.937717 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-615f289c-e50b-4600-9c40-18dae3238382 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:13:51.940511 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-615f289c-e50b-4600-9c40-18dae3238382 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] [instance: ac1c3be3-de1d-456b-bfb9-aad6baafbb34] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:13:51.943393 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-af748487-4307-43ea-babe-e6627712e64d tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] 10.222.0.60 "GET /compute/v2.1/servers/d8ae775e-e822-487d-a211-a4f4bd042c21" status: 200 len: 1314 microversion: 2.1 time: 0.413840 Sep 14 09:13:51.944258 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2520/5008] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:13:51 2022] GET /compute/v2.1/servers/d8ae775e-e822-487d-a211-a4f4bd042c21 => generated 1314 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:13:51.985137 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-615f289c-e50b-4600-9c40-18dae3238382 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:51.986725 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-615f289c-e50b-4600-9c40-18dae3238382 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:51.987919 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-615f289c-e50b-4600-9c40-18dae3238382 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:51.988864 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-615f289c-e50b-4600-9c40-18dae3238382 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:51.989513 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-615f289c-e50b-4600-9c40-18dae3238382 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:51.990141 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-615f289c-e50b-4600-9c40-18dae3238382 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:52.248903 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c3533a83-ece0-4fc5-92f0-9c9efcceb5cc tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:13:52.249961 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-c3533a83-ece0-4fc5-92f0-9c9efcceb5cc tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:13:52.265367 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-615f289c-e50b-4600-9c40-18dae3238382 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe73f3d7f4734e1ab9f6b7283db1388b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94e25a7caf946c2a80b874416e4906b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:13:52.265696 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c3533a83-ece0-4fc5-92f0-9c9efcceb5cc tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:52.271694 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c3533a83-ece0-4fc5-92f0-9c9efcceb5cc tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:52.272709 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c3533a83-ece0-4fc5-92f0-9c9efcceb5cc tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:52.273684 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c3533a83-ece0-4fc5-92f0-9c9efcceb5cc tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:52.275135 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c3533a83-ece0-4fc5-92f0-9c9efcceb5cc tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:52.278639 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c3533a83-ece0-4fc5-92f0-9c9efcceb5cc tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:52.297773 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-615f289c-e50b-4600-9c40-18dae3238382 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] 10.222.0.60 "GET /compute/v2.1/servers/ac1c3be3-de1d-456b-bfb9-aad6baafbb34" status: 200 len: 1333 microversion: 2.1 time: 0.370492 Sep 14 09:13:52.303101 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2489/5009] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:13:51 2022] GET /compute/v2.1/servers/ac1c3be3-de1d-456b-bfb9-aad6baafbb34 => generated 1333 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:13:52.473239 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-c3533a83-ece0-4fc5-92f0-9c9efcceb5cc tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:13:52.487978 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-c3533a83-ece0-4fc5-92f0-9c9efcceb5cc tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:13:52.493148 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-c3533a83-ece0-4fc5-92f0-9c9efcceb5cc tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:13:52.496416 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-c3533a83-ece0-4fc5-92f0-9c9efcceb5cc tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5" status: 200 len: 1722 microversion: 2.20 time: 0.256744 Sep 14 09:13:52.496936 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2521/5010] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:13:52 2022] GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5 => generated 1722 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 09:13:52.948718 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-1cbde25a-335c-4499-812e-9d665de29029 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:13:52.949388 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-1cbde25a-335c-4499-812e-9d665de29029 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] [instance: d42a47fc-3124-4479-aff4-e2a5ba888729] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:13:52.956502 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1cbde25a-335c-4499-812e-9d665de29029 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:52.956998 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1cbde25a-335c-4499-812e-9d665de29029 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:52.957443 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1cbde25a-335c-4499-812e-9d665de29029 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:52.960781 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1cbde25a-335c-4499-812e-9d665de29029 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:52.961469 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1cbde25a-335c-4499-812e-9d665de29029 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:52.962080 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1cbde25a-335c-4499-812e-9d665de29029 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:52.971441 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-3337c2d3-66ff-4a20-a6af-c3c1073a9e6b tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:13:52.972233 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-3337c2d3-66ff-4a20-a6af-c3c1073a9e6b tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] [instance: d8ae775e-e822-487d-a211-a4f4bd042c21] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:13:52.983849 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3337c2d3-66ff-4a20-a6af-c3c1073a9e6b tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:52.984356 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3337c2d3-66ff-4a20-a6af-c3c1073a9e6b tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:52.985611 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3337c2d3-66ff-4a20-a6af-c3c1073a9e6b tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:52.986345 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3337c2d3-66ff-4a20-a6af-c3c1073a9e6b tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:52.986812 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3337c2d3-66ff-4a20-a6af-c3c1073a9e6b tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:52.987675 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3337c2d3-66ff-4a20-a6af-c3c1073a9e6b tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:53.083588 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=2 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:13:53.121576 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=6 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:13:53.388483 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-1cbde25a-335c-4499-812e-9d665de29029 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17918433a3994b69a65999a59a7f833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b73b20f2042c6a08f94ed23ff66e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:13:53.399584 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-1cbde25a-335c-4499-812e-9d665de29029 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] 10.222.0.60 "GET /compute/v2.1/servers/d42a47fc-3124-4479-aff4-e2a5ba888729" status: 200 len: 1374 microversion: 2.1 time: 0.454391 Sep 14 09:13:53.401968 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2490/5011] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:13:52 2022] GET /compute/v2.1/servers/d42a47fc-3124-4479-aff4-e2a5ba888729 => generated 1374 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:13:53.407770 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9f98a348-c65d-4ccc-b3db-90a69cc9b355 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:13:53.408755 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-9f98a348-c65d-4ccc-b3db-90a69cc9b355 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] [instance: ac1c3be3-de1d-456b-bfb9-aad6baafbb34] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:13:53.415850 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9f98a348-c65d-4ccc-b3db-90a69cc9b355 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:53.416682 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9f98a348-c65d-4ccc-b3db-90a69cc9b355 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:53.417303 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9f98a348-c65d-4ccc-b3db-90a69cc9b355 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:53.418971 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9f98a348-c65d-4ccc-b3db-90a69cc9b355 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:53.419741 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9f98a348-c65d-4ccc-b3db-90a69cc9b355 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:53.420332 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9f98a348-c65d-4ccc-b3db-90a69cc9b355 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:53.462967 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-3337c2d3-66ff-4a20-a6af-c3c1073a9e6b tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421bf1609a6d4f808a4cb3612bf64615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a020c15f895946328ab384514c1ba463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:13:53.476530 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-3337c2d3-66ff-4a20-a6af-c3c1073a9e6b tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] 10.222.0.60 "GET /compute/v2.1/servers/d8ae775e-e822-487d-a211-a4f4bd042c21" status: 200 len: 1498 microversion: 2.1 time: 0.508902 Sep 14 09:13:53.494849 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2522/5012] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:13:52 2022] GET /compute/v2.1/servers/d8ae775e-e822-487d-a211-a4f4bd042c21 => generated 1498 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:13:53.519771 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=6 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:13:53.522587 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-f66c6bbb-94ca-4d86-a507-11e1f683e098 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:13:53.523220 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-f66c6bbb-94ca-4d86-a507-11e1f683e098 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:13:53.533248 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f66c6bbb-94ca-4d86-a507-11e1f683e098 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:53.533746 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f66c6bbb-94ca-4d86-a507-11e1f683e098 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:53.544124 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f66c6bbb-94ca-4d86-a507-11e1f683e098 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:53.545098 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f66c6bbb-94ca-4d86-a507-11e1f683e098 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:53.545750 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f66c6bbb-94ca-4d86-a507-11e1f683e098 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:53.546495 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f66c6bbb-94ca-4d86-a507-11e1f683e098 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:53.922971 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-f66c6bbb-94ca-4d86-a507-11e1f683e098 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:13:53.923577 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-9f98a348-c65d-4ccc-b3db-90a69cc9b355 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe73f3d7f4734e1ab9f6b7283db1388b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94e25a7caf946c2a80b874416e4906b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:13:53.925870 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-f66c6bbb-94ca-4d86-a507-11e1f683e098 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:13:53.927653 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-f66c6bbb-94ca-4d86-a507-11e1f683e098 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:13:53.929093 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-f66c6bbb-94ca-4d86-a507-11e1f683e098 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5" status: 200 len: 1722 microversion: 2.20 time: 0.410763 Sep 14 09:13:53.929627 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2523/5013] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:13:53 2022] GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5 => generated 1722 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 09:13:53.940547 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-9f98a348-c65d-4ccc-b3db-90a69cc9b355 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] 10.222.0.60 "GET /compute/v2.1/servers/ac1c3be3-de1d-456b-bfb9-aad6baafbb34" status: 200 len: 1667 microversion: 2.1 time: 0.536536 Sep 14 09:13:53.941952 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2491/5014] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:13:53 2022] GET /compute/v2.1/servers/ac1c3be3-de1d-456b-bfb9-aad6baafbb34 => generated 1667 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:13:53.969853 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-721e553a-a941-4c67-8300-308e1a9a0d1e tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:13:53.974821 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-721e553a-a941-4c67-8300-308e1a9a0d1e tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] [instance: ac1c3be3-de1d-456b-bfb9-aad6baafbb34] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:13:54.000119 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-721e553a-a941-4c67-8300-308e1a9a0d1e tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:54.001186 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-721e553a-a941-4c67-8300-308e1a9a0d1e tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:54.003901 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-721e553a-a941-4c67-8300-308e1a9a0d1e tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:54.004925 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-721e553a-a941-4c67-8300-308e1a9a0d1e tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:54.008864 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-721e553a-a941-4c67-8300-308e1a9a0d1e tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:54.009824 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-721e553a-a941-4c67-8300-308e1a9a0d1e tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:54.098829 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-721e553a-a941-4c67-8300-308e1a9a0d1e tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] 10.222.0.60 "GET /compute/v2.1/servers/ac1c3be3-de1d-456b-bfb9-aad6baafbb34/ips" status: 200 len: 178 microversion: 2.1 time: 0.137973 Sep 14 09:13:54.106764 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2524/5015] 10.222.0.60 () {58 vars in 1248 bytes} [Wed Sep 14 09:13:53 2022] GET /compute/v2.1/servers/ac1c3be3-de1d-456b-bfb9-aad6baafbb34/ips => generated 178 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:13:54.112027 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-690f5960-9e3d-494d-982c-4a28be27d165 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:13:54.112540 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-690f5960-9e3d-494d-982c-4a28be27d165 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] [instance: ac1c3be3-de1d-456b-bfb9-aad6baafbb34] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:13:54.120102 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-690f5960-9e3d-494d-982c-4a28be27d165 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:54.120608 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-690f5960-9e3d-494d-982c-4a28be27d165 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:54.121084 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-690f5960-9e3d-494d-982c-4a28be27d165 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:54.121787 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-690f5960-9e3d-494d-982c-4a28be27d165 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:54.122356 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-690f5960-9e3d-494d-982c-4a28be27d165 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:54.122842 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-690f5960-9e3d-494d-982c-4a28be27d165 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:54.165487 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-690f5960-9e3d-494d-982c-4a28be27d165 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] [instance: ac1c3be3-de1d-456b-bfb9-aad6baafbb34] Going to try to terminate instance {{(pid=128759) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:13:54.234121 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d47bfc6f-9e64-4ab1-806a-769ac4a1d0e0 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:13:54.234638 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-d47bfc6f-9e64-4ab1-806a-769ac4a1d0e0 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] [instance: d8ae775e-e822-487d-a211-a4f4bd042c21] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:13:54.254008 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d47bfc6f-9e64-4ab1-806a-769ac4a1d0e0 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:54.254513 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d47bfc6f-9e64-4ab1-806a-769ac4a1d0e0 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:54.254984 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d47bfc6f-9e64-4ab1-806a-769ac4a1d0e0 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:54.255734 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d47bfc6f-9e64-4ab1-806a-769ac4a1d0e0 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:54.256193 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d47bfc6f-9e64-4ab1-806a-769ac4a1d0e0 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:54.256618 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d47bfc6f-9e64-4ab1-806a-769ac4a1d0e0 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:54.377346 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-d47bfc6f-9e64-4ab1-806a-769ac4a1d0e0 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] [instance: d8ae775e-e822-487d-a211-a4f4bd042c21] Going to try to terminate instance {{(pid=128758) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:13:54.419413 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-690f5960-9e3d-494d-982c-4a28be27d165 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] 10.222.0.60 "DELETE /compute/v2.1/servers/ac1c3be3-de1d-456b-bfb9-aad6baafbb34" status: 204 len: 0 microversion: 2.1 time: 0.310940 Sep 14 09:13:54.420162 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2492/5016] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:13:54 2022] DELETE /compute/v2.1/servers/ac1c3be3-de1d-456b-bfb9-aad6baafbb34 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:13:54.429552 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-65402e01-e8fa-485d-97c6-01624fc0a6ac tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:13:54.430785 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-65402e01-e8fa-485d-97c6-01624fc0a6ac tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] [instance: d42a47fc-3124-4479-aff4-e2a5ba888729] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:13:54.452645 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-65402e01-e8fa-485d-97c6-01624fc0a6ac tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:54.455474 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-65402e01-e8fa-485d-97c6-01624fc0a6ac tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:54.456144 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-65402e01-e8fa-485d-97c6-01624fc0a6ac tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:54.457097 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=100 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:13:54.458114 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-65402e01-e8fa-485d-97c6-01624fc0a6ac tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:54.458581 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-65402e01-e8fa-485d-97c6-01624fc0a6ac tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:54.461411 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-65402e01-e8fa-485d-97c6-01624fc0a6ac tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:54.580911 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-d47bfc6f-9e64-4ab1-806a-769ac4a1d0e0 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] 10.222.0.60 "DELETE /compute/v2.1/servers/d8ae775e-e822-487d-a211-a4f4bd042c21" status: 204 len: 0 microversion: 2.1 time: 0.351844 Sep 14 09:13:54.585196 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2525/5017] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:13:54 2022] DELETE /compute/v2.1/servers/d8ae775e-e822-487d-a211-a4f4bd042c21 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:13:54.589066 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-3ae89ab6-92b5-426a-beb9-e2fc5e1b5277 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:13:54.591288 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-3ae89ab6-92b5-426a-beb9-e2fc5e1b5277 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] [instance: ac1c3be3-de1d-456b-bfb9-aad6baafbb34] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:13:54.598661 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3ae89ab6-92b5-426a-beb9-e2fc5e1b5277 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:54.599413 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3ae89ab6-92b5-426a-beb9-e2fc5e1b5277 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:54.599789 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3ae89ab6-92b5-426a-beb9-e2fc5e1b5277 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:54.600544 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3ae89ab6-92b5-426a-beb9-e2fc5e1b5277 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:54.601327 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3ae89ab6-92b5-426a-beb9-e2fc5e1b5277 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:54.601458 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3ae89ab6-92b5-426a-beb9-e2fc5e1b5277 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:54.988202 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-65402e01-e8fa-485d-97c6-01624fc0a6ac tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17918433a3994b69a65999a59a7f833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b73b20f2042c6a08f94ed23ff66e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:13:54.999157 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-65402e01-e8fa-485d-97c6-01624fc0a6ac tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] 10.222.0.60 "GET /compute/v2.1/servers/d42a47fc-3124-4479-aff4-e2a5ba888729" status: 200 len: 1374 microversion: 2.1 time: 0.574333 Sep 14 09:13:55.014143 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2493/5018] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:13:54 2022] GET /compute/v2.1/servers/d42a47fc-3124-4479-aff4-e2a5ba888729 => generated 1374 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:13:55.023478 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c95d3b5a-a8fb-4af4-8888-562cb38dbcf4 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:13:55.024781 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-c95d3b5a-a8fb-4af4-8888-562cb38dbcf4 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] [instance: d8ae775e-e822-487d-a211-a4f4bd042c21] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:13:55.032595 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c95d3b5a-a8fb-4af4-8888-562cb38dbcf4 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:55.033708 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c95d3b5a-a8fb-4af4-8888-562cb38dbcf4 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:55.033708 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c95d3b5a-a8fb-4af4-8888-562cb38dbcf4 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:55.034757 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c95d3b5a-a8fb-4af4-8888-562cb38dbcf4 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:55.035466 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c95d3b5a-a8fb-4af4-8888-562cb38dbcf4 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:55.035689 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c95d3b5a-a8fb-4af4-8888-562cb38dbcf4 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:55.057529 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:13:55.287189 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-3ae89ab6-92b5-426a-beb9-e2fc5e1b5277 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe73f3d7f4734e1ab9f6b7283db1388b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94e25a7caf946c2a80b874416e4906b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:13:55.298260 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-3ae89ab6-92b5-426a-beb9-e2fc5e1b5277 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] 10.222.0.60 "GET /compute/v2.1/servers/ac1c3be3-de1d-456b-bfb9-aad6baafbb34" status: 200 len: 1673 microversion: 2.1 time: 0.714950 Sep 14 09:13:55.299306 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2526/5019] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:13:54 2022] GET /compute/v2.1/servers/ac1c3be3-de1d-456b-bfb9-aad6baafbb34 => generated 1673 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:13:55.309704 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-94987013-509e-4852-8180-38bf285697a8 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:13:55.310920 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-94987013-509e-4852-8180-38bf285697a8 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:13:55.319728 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-94987013-509e-4852-8180-38bf285697a8 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:55.321657 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-94987013-509e-4852-8180-38bf285697a8 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:55.322368 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-94987013-509e-4852-8180-38bf285697a8 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:55.324420 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-94987013-509e-4852-8180-38bf285697a8 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:55.325344 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-94987013-509e-4852-8180-38bf285697a8 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:55.326148 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-94987013-509e-4852-8180-38bf285697a8 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:55.736021 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-c95d3b5a-a8fb-4af4-8888-562cb38dbcf4 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421bf1609a6d4f808a4cb3612bf64615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a020c15f895946328ab384514c1ba463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:13:55.752063 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-c95d3b5a-a8fb-4af4-8888-562cb38dbcf4 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] 10.222.0.60 "GET /compute/v2.1/servers/d8ae775e-e822-487d-a211-a4f4bd042c21" status: 200 len: 1504 microversion: 2.1 time: 0.736277 Sep 14 09:13:55.757879 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2494/5020] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:13:55 2022] GET /compute/v2.1/servers/d8ae775e-e822-487d-a211-a4f4bd042c21 => generated 1504 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:13:55.803344 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-94987013-509e-4852-8180-38bf285697a8 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:13:55.824698 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-94987013-509e-4852-8180-38bf285697a8 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:13:55.826434 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-94987013-509e-4852-8180-38bf285697a8 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:13:55.827885 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-94987013-509e-4852-8180-38bf285697a8 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5" status: 200 len: 1722 microversion: 2.20 time: 0.526573 Sep 14 09:13:55.829225 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2527/5021] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:13:55 2022] GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5 => generated 1722 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:13:56.026847 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-4303eb71-2d12-455f-8f1a-e451f4d94d35 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:13:56.027539 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-4303eb71-2d12-455f-8f1a-e451f4d94d35 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] [instance: d42a47fc-3124-4479-aff4-e2a5ba888729] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:13:56.034111 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4303eb71-2d12-455f-8f1a-e451f4d94d35 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:56.035020 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4303eb71-2d12-455f-8f1a-e451f4d94d35 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:56.035726 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4303eb71-2d12-455f-8f1a-e451f4d94d35 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:56.036688 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4303eb71-2d12-455f-8f1a-e451f4d94d35 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:56.037386 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4303eb71-2d12-455f-8f1a-e451f4d94d35 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:56.038058 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4303eb71-2d12-455f-8f1a-e451f4d94d35 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:56.327101 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-f44e495e-ad7a-48a6-a1a4-f61c488d6810 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:13:56.327736 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-f44e495e-ad7a-48a6-a1a4-f61c488d6810 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] [instance: ac1c3be3-de1d-456b-bfb9-aad6baafbb34] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:13:56.338576 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f44e495e-ad7a-48a6-a1a4-f61c488d6810 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:56.341402 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f44e495e-ad7a-48a6-a1a4-f61c488d6810 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:56.343073 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f44e495e-ad7a-48a6-a1a4-f61c488d6810 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:56.344136 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f44e495e-ad7a-48a6-a1a4-f61c488d6810 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:56.345509 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f44e495e-ad7a-48a6-a1a4-f61c488d6810 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:56.347545 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f44e495e-ad7a-48a6-a1a4-f61c488d6810 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:56.622761 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-4303eb71-2d12-455f-8f1a-e451f4d94d35 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17918433a3994b69a65999a59a7f833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b73b20f2042c6a08f94ed23ff66e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:13:56.630913 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-4303eb71-2d12-455f-8f1a-e451f4d94d35 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] 10.222.0.60 "GET /compute/v2.1/servers/d42a47fc-3124-4479-aff4-e2a5ba888729" status: 200 len: 1374 microversion: 2.1 time: 0.607919 Sep 14 09:13:56.640115 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2495/5022] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:13:56 2022] GET /compute/v2.1/servers/d42a47fc-3124-4479-aff4-e2a5ba888729 => generated 1374 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:13:56.686288 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-f44e495e-ad7a-48a6-a1a4-f61c488d6810 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe73f3d7f4734e1ab9f6b7283db1388b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94e25a7caf946c2a80b874416e4906b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:13:56.702252 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-f44e495e-ad7a-48a6-a1a4-f61c488d6810 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] 10.222.0.60 "GET /compute/v2.1/servers/ac1c3be3-de1d-456b-bfb9-aad6baafbb34" status: 200 len: 1673 microversion: 2.1 time: 0.378693 Sep 14 09:13:56.703195 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2528/5023] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:13:56 2022] GET /compute/v2.1/servers/ac1c3be3-de1d-456b-bfb9-aad6baafbb34 => generated 1673 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:13:56.779640 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-020e9a86-c474-45ef-94a3-79e4059c3c50 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:13:56.780329 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-020e9a86-c474-45ef-94a3-79e4059c3c50 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] [instance: d8ae775e-e822-487d-a211-a4f4bd042c21] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:13:56.792481 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-020e9a86-c474-45ef-94a3-79e4059c3c50 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:56.793324 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-020e9a86-c474-45ef-94a3-79e4059c3c50 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:56.793943 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-020e9a86-c474-45ef-94a3-79e4059c3c50 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:56.794845 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-020e9a86-c474-45ef-94a3-79e4059c3c50 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:56.795498 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-020e9a86-c474-45ef-94a3-79e4059c3c50 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:56.796102 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-020e9a86-c474-45ef-94a3-79e4059c3c50 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:56.854279 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-89402f54-1826-49c9-8bac-5a91e4345d0b tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:13:56.854912 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-89402f54-1826-49c9-8bac-5a91e4345d0b tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:13:56.876555 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-89402f54-1826-49c9-8bac-5a91e4345d0b tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:56.877324 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-89402f54-1826-49c9-8bac-5a91e4345d0b tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:56.877924 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-89402f54-1826-49c9-8bac-5a91e4345d0b tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:56.878851 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-89402f54-1826-49c9-8bac-5a91e4345d0b tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:56.879336 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-89402f54-1826-49c9-8bac-5a91e4345d0b tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:56.879768 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-89402f54-1826-49c9-8bac-5a91e4345d0b tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:57.008718 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-89402f54-1826-49c9-8bac-5a91e4345d0b tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:13:57.020110 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-89402f54-1826-49c9-8bac-5a91e4345d0b tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:13:57.027650 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-89402f54-1826-49c9-8bac-5a91e4345d0b tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:13:57.029029 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-89402f54-1826-49c9-8bac-5a91e4345d0b tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5" status: 200 len: 1654 microversion: 2.20 time: 0.178899 Sep 14 09:13:57.032786 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2529/5024] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:13:56 2022] GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5 => generated 1654 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:13:57.112522 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-020e9a86-c474-45ef-94a3-79e4059c3c50 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421bf1609a6d4f808a4cb3612bf64615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a020c15f895946328ab384514c1ba463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:13:57.121436 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-020e9a86-c474-45ef-94a3-79e4059c3c50 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] 10.222.0.60 "GET /compute/v2.1/servers/d8ae775e-e822-487d-a211-a4f4bd042c21" status: 200 len: 1504 microversion: 2.1 time: 0.345821 Sep 14 09:13:57.122410 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2496/5025] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:13:56 2022] GET /compute/v2.1/servers/d8ae775e-e822-487d-a211-a4f4bd042c21 => generated 1504 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:13:57.157878 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-d8fab3c7-b58a-497a-87cc-0159082dfb80 req-5d0351bd-fb07-4030-8823-f914d43b5e10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5", "name": "network-vif-deleted", "tag": "906bcc79-e290-4b18-8447-de06233392de"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:13:57.169090 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-d8fab3c7-b58a-497a-87cc-0159082dfb80 req-5d0351bd-fb07-4030-8823-f914d43b5e10 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:57.169513 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-d8fab3c7-b58a-497a-87cc-0159082dfb80 req-5d0351bd-fb07-4030-8823-f914d43b5e10 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:57.169948 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-d8fab3c7-b58a-497a-87cc-0159082dfb80 req-5d0351bd-fb07-4030-8823-f914d43b5e10 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:57.188682 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-d8fab3c7-b58a-497a-87cc-0159082dfb80 req-5d0351bd-fb07-4030-8823-f914d43b5e10 service nova] Creating event network-vif-deleted:906bcc79-e290-4b18-8447-de06233392de for instance 4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5 on n-h1-836830-18 Sep 14 09:13:57.205676 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-d8fab3c7-b58a-497a-87cc-0159082dfb80 req-5d0351bd-fb07-4030-8823-f914d43b5e10 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.153417 Sep 14 09:13:57.210859 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2530/5026] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:13:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:13:57.655202 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c7da040e-c1af-42c0-afc4-0e9f1e5277f1 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:13:57.655944 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-c7da040e-c1af-42c0-afc4-0e9f1e5277f1 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] [instance: d42a47fc-3124-4479-aff4-e2a5ba888729] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:13:57.662747 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c7da040e-c1af-42c0-afc4-0e9f1e5277f1 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:57.668926 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c7da040e-c1af-42c0-afc4-0e9f1e5277f1 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:57.669416 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c7da040e-c1af-42c0-afc4-0e9f1e5277f1 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:57.670407 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c7da040e-c1af-42c0-afc4-0e9f1e5277f1 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:57.679057 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c7da040e-c1af-42c0-afc4-0e9f1e5277f1 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:57.679592 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c7da040e-c1af-42c0-afc4-0e9f1e5277f1 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:57.733146 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-f9583962-5eb7-4867-aab1-598d8ffbdb3a tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:13:57.734719 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-f9583962-5eb7-4867-aab1-598d8ffbdb3a tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] [instance: ac1c3be3-de1d-456b-bfb9-aad6baafbb34] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:13:57.764134 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f9583962-5eb7-4867-aab1-598d8ffbdb3a tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:57.765972 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f9583962-5eb7-4867-aab1-598d8ffbdb3a tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:57.766720 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f9583962-5eb7-4867-aab1-598d8ffbdb3a tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:57.768676 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f9583962-5eb7-4867-aab1-598d8ffbdb3a tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:57.769707 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f9583962-5eb7-4867-aab1-598d8ffbdb3a tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:57.771912 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f9583962-5eb7-4867-aab1-598d8ffbdb3a tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:58.447684 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-c7da040e-c1af-42c0-afc4-0e9f1e5277f1 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17918433a3994b69a65999a59a7f833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b73b20f2042c6a08f94ed23ff66e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:13:58.461773 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-f9583962-5eb7-4867-aab1-598d8ffbdb3a tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe73f3d7f4734e1ab9f6b7283db1388b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94e25a7caf946c2a80b874416e4906b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:13:58.463416 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-c7da040e-c1af-42c0-afc4-0e9f1e5277f1 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] 10.222.0.60 "GET /compute/v2.1/servers/d42a47fc-3124-4479-aff4-e2a5ba888729" status: 200 len: 1374 microversion: 2.1 time: 0.811971 Sep 14 09:13:58.475659 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2497/5027] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:13:57 2022] GET /compute/v2.1/servers/d42a47fc-3124-4479-aff4-e2a5ba888729 => generated 1374 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:13:58.487551 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8a8fc6df-a42a-4772-8791-f67f1b8d6c4f tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:13:58.489162 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-8a8fc6df-a42a-4772-8791-f67f1b8d6c4f tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:13:58.497467 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8a8fc6df-a42a-4772-8791-f67f1b8d6c4f tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:58.498216 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8a8fc6df-a42a-4772-8791-f67f1b8d6c4f tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:58.498863 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8a8fc6df-a42a-4772-8791-f67f1b8d6c4f tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:58.499993 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8a8fc6df-a42a-4772-8791-f67f1b8d6c4f tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:58.500497 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-f9583962-5eb7-4867-aab1-598d8ffbdb3a tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] 10.222.0.60 "GET /compute/v2.1/servers/ac1c3be3-de1d-456b-bfb9-aad6baafbb34" status: 200 len: 1673 microversion: 2.1 time: 0.774722 Sep 14 09:13:58.500910 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8a8fc6df-a42a-4772-8791-f67f1b8d6c4f tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:58.501563 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8a8fc6df-a42a-4772-8791-f67f1b8d6c4f tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:58.502667 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2531/5028] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:13:57 2022] GET /compute/v2.1/servers/ac1c3be3-de1d-456b-bfb9-aad6baafbb34 => generated 1673 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:13:58.516265 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-3c757df3-f9f2-4d3d-aec6-6e3a0cb59bba tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:13:58.520037 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-3c757df3-f9f2-4d3d-aec6-6e3a0cb59bba tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] [instance: d8ae775e-e822-487d-a211-a4f4bd042c21] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:13:58.527252 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3c757df3-f9f2-4d3d-aec6-6e3a0cb59bba tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:58.527818 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3c757df3-f9f2-4d3d-aec6-6e3a0cb59bba tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:58.528557 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3c757df3-f9f2-4d3d-aec6-6e3a0cb59bba tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:58.529281 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3c757df3-f9f2-4d3d-aec6-6e3a0cb59bba tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:58.529736 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3c757df3-f9f2-4d3d-aec6-6e3a0cb59bba tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:58.530221 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3c757df3-f9f2-4d3d-aec6-6e3a0cb59bba tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:58.530912 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-8a8fc6df-a42a-4772-8791-f67f1b8d6c4f tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] HTTP exception thrown: Instance 4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5 could not be found. Sep 14 09:13:58.536158 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8a8fc6df-a42a-4772-8791-f67f1b8d6c4f tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Request method failure captured: Sep 14 09:13:58.536158 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5 HTTP/1.1 Sep 14 09:13:58.536158 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:13:58.536158 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:13:58.536158 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:13:58.536158 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:13:58.536158 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:13:58.536158 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:13:58.536158 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:13:58.536158 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:13:58.536158 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZoiSZxqfCErkF28duCwoLyyA4BG19wUNeFXOWecMNNAmQ9wif7QtxjzWvetj4gEDO8xf7CL7dW1ytU3meYaX-_dv0e24VHnEQ0Ft5dtNXSDMao67NjyX9jDMbRsLsyQjAEEs08qr3suFBU2oznwRQHl5Fh4kiecRaFcfIdWFOEZaLM Sep 14 09:13:58.536158 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:13:58.536158 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:13:58.536158 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:13:58.536158 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:13:58.536158 n-d-836830-18 devstack@n-api.service[128759]: X-Openstack-Nova-Api-Version: 2.20 Sep 14 09:13:58.536158 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:13:58.536158 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:13:58.536158 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 9c0762ad3f774829b58669b312dd13f7 Sep 14 09:13:58.536158 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-760665547 Sep 14 09:13:58.536158 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:13:58.536158 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:13:58.536158 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/9c0762ad3f774829b58669b312dd13f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_9c0762ad3f774829b58669b312dd13f7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9c0762ad3f774829b58669b312dd13f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9c0762ad3f774829b58669b312dd13f7"}]}] Sep 14 09:13:58.536158 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-AttachVolumeShelveTestJSON-760665547 Sep 14 09:13:58.536158 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 9c0762ad3f774829b58669b312dd13f7 Sep 14 09:13:58.536158 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-760665547 Sep 14 09:13:58.536158 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-AttachVolumeShelveTestJSON-760665547-project Sep 14 09:13:58.536158 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:13:58.536158 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:13:58.536158 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 78051740ae354035b119d5d8ebe226f1 Sep 14 09:13:58.536158 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-AttachVolumeShelveTestJSON-760665547-project Sep 14 09:13:58.536158 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:13:58.536158 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance 4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5 could not be found. Sep 14 09:13:58.536158 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5'} Sep 14 09:13:58.536158 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:13:58.536158 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:13:58.536158 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:13:58.536158 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:13:58.536158 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:13:58.536158 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:13:58.536158 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:13:58.536158 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:13:58.536158 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:13:58.536158 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:13:58.536158 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5 could not be found. Sep 14 09:13:58.536158 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:13:58.536158 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:13:58.536158 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:13:58.536158 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:13:58.536158 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:13:58.536158 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:13:58.536158 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:13:58.536158 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:13:58.536158 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:13:58.536158 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:13:58.536158 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:13:58.536158 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:13:58.536158 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:13:58.536158 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:13:58.536158 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:13:58.536158 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:13:58.536158 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5 could not be found. Sep 14 09:13:58.536158 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:13:58.536158 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:13:58.547243 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:13:58.547243 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:13:58.547243 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:13:58.547243 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:13:58.547243 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:13:58.547243 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:13:58.547243 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5 could not be found. Sep 14 09:13:58.547243 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:13:58.551932 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8a8fc6df-a42a-4772-8791-f67f1b8d6c4f tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Returning 404 to user: Instance 4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5 could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:13:58.553192 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-8a8fc6df-a42a-4772-8791-f67f1b8d6c4f tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5" status: 404 len: 111 microversion: 2.20 time: 0.069970 Sep 14 09:13:58.554346 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2498/5029] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:13:58 2022] GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 14 09:13:58.561380 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-a421f385-8355-4ec0-9ae6-0748043b6a23 req-6f0de39d-0edf-4dd2-b8ee-ae83ff6dbc87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d42a47fc-3124-4479-aff4-e2a5ba888729", "name": "network-vif-plugged", "status": "completed", "tag": "4f2597fa-7f1f-432b-bf54-eb3d836a36dd"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:13:58.572497 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-a421f385-8355-4ec0-9ae6-0748043b6a23 req-6f0de39d-0edf-4dd2-b8ee-ae83ff6dbc87 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:58.573374 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-a421f385-8355-4ec0-9ae6-0748043b6a23 req-6f0de39d-0edf-4dd2-b8ee-ae83ff6dbc87 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:58.574892 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-a421f385-8355-4ec0-9ae6-0748043b6a23 req-6f0de39d-0edf-4dd2-b8ee-ae83ff6dbc87 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:58.595311 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-a421f385-8355-4ec0-9ae6-0748043b6a23 req-6f0de39d-0edf-4dd2-b8ee-ae83ff6dbc87 service nova] Creating event network-vif-plugged:4f2597fa-7f1f-432b-bf54-eb3d836a36dd for instance d42a47fc-3124-4479-aff4-e2a5ba888729 on n-h1-836830-18 Sep 14 09:13:58.602046 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-a421f385-8355-4ec0-9ae6-0748043b6a23 req-6f0de39d-0edf-4dd2-b8ee-ae83ff6dbc87 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046134 Sep 14 09:13:58.603972 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2499/5030] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:13:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:13:58.633012 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-5239415c-b344-4811-8fb0-58f7fa05f0c4 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '.version_select at 0x7f7d487f1f70>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:13:58.672431 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-5239415c-b344-4811-8fb0-58f7fa05f0c4 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1144299381" status: 204 len: 0 microversion: 2.20 time: 0.065846 Sep 14 09:13:58.673979 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2500/5031] 10.222.0.60 () {60 vars in 1262 bytes} [Wed Sep 14 09:13:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1144299381 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 14 09:13:58.829367 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-427e521f-7a0f-4bdb-ab31-9cf8a93ad612 req-6882dec9-bdb5-4e72-9121-72f434c10896 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac1c3be3-de1d-456b-bfb9-aad6baafbb34", "name": "network-vif-deleted", "tag": "0391a3db-803f-4dc5-aeb7-7b667c18bfdb"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:13:58.843038 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-427e521f-7a0f-4bdb-ab31-9cf8a93ad612 req-6882dec9-bdb5-4e72-9121-72f434c10896 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:58.843843 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-427e521f-7a0f-4bdb-ab31-9cf8a93ad612 req-6882dec9-bdb5-4e72-9121-72f434c10896 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:58.844512 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-427e521f-7a0f-4bdb-ab31-9cf8a93ad612 req-6882dec9-bdb5-4e72-9121-72f434c10896 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:58.858680 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-427e521f-7a0f-4bdb-ab31-9cf8a93ad612 req-6882dec9-bdb5-4e72-9121-72f434c10896 service nova] Creating event network-vif-deleted:0391a3db-803f-4dc5-aeb7-7b667c18bfdb for instance ac1c3be3-de1d-456b-bfb9-aad6baafbb34 on n-h2-836830-18 Sep 14 09:13:58.865655 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-427e521f-7a0f-4bdb-ab31-9cf8a93ad612 req-6882dec9-bdb5-4e72-9121-72f434c10896 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041406 Sep 14 09:13:58.867032 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2501/5032] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:13:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:13:59.055135 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-3c757df3-f9f2-4d3d-aec6-6e3a0cb59bba tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421bf1609a6d4f808a4cb3612bf64615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a020c15f895946328ab384514c1ba463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:13:59.067460 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-3c757df3-f9f2-4d3d-aec6-6e3a0cb59bba tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] 10.222.0.60 "GET /compute/v2.1/servers/d8ae775e-e822-487d-a211-a4f4bd042c21" status: 200 len: 1504 microversion: 2.1 time: 0.560966 Sep 14 09:13:59.086996 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2532/5033] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:13:58 2022] GET /compute/v2.1/servers/d8ae775e-e822-487d-a211-a4f4bd042c21 => generated 1504 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:13:59.491288 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ad7e6730-a943-4ce4-8ed4-0f26c251c496 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:13:59.492928 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-ad7e6730-a943-4ce4-8ed4-0f26c251c496 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] [instance: d42a47fc-3124-4479-aff4-e2a5ba888729] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:13:59.516801 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ad7e6730-a943-4ce4-8ed4-0f26c251c496 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:59.518004 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ad7e6730-a943-4ce4-8ed4-0f26c251c496 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:59.518652 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ad7e6730-a943-4ce4-8ed4-0f26c251c496 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:59.519581 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ad7e6730-a943-4ce4-8ed4-0f26c251c496 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:59.526557 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-7fde7902-059a-469c-a4fe-e5984fb32417 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:13:59.528322 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-7fde7902-059a-469c-a4fe-e5984fb32417 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] [instance: ac1c3be3-de1d-456b-bfb9-aad6baafbb34] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:13:59.531454 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ad7e6730-a943-4ce4-8ed4-0f26c251c496 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:59.532768 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ad7e6730-a943-4ce4-8ed4-0f26c251c496 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:59.537818 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7fde7902-059a-469c-a4fe-e5984fb32417 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:59.545384 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7fde7902-059a-469c-a4fe-e5984fb32417 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:59.546177 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7fde7902-059a-469c-a4fe-e5984fb32417 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:59.547208 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7fde7902-059a-469c-a4fe-e5984fb32417 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:13:59.549036 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7fde7902-059a-469c-a4fe-e5984fb32417 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:13:59.551247 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7fde7902-059a-469c-a4fe-e5984fb32417 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:13:59.855610 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-7fde7902-059a-469c-a4fe-e5984fb32417 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe73f3d7f4734e1ab9f6b7283db1388b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94e25a7caf946c2a80b874416e4906b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:13:59.880391 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-7fde7902-059a-469c-a4fe-e5984fb32417 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] 10.222.0.60 "GET /compute/v2.1/servers/ac1c3be3-de1d-456b-bfb9-aad6baafbb34" status: 200 len: 1453 microversion: 2.1 time: 0.358269 Sep 14 09:13:59.882168 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2533/5034] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:13:59 2022] GET /compute/v2.1/servers/ac1c3be3-de1d-456b-bfb9-aad6baafbb34 => generated 1453 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:14:00.050252 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-ad7e6730-a943-4ce4-8ed4-0f26c251c496 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17918433a3994b69a65999a59a7f833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b73b20f2042c6a08f94ed23ff66e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:14:00.059337 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-ad7e6730-a943-4ce4-8ed4-0f26c251c496 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] 10.222.0.60 "GET /compute/v2.1/servers/d42a47fc-3124-4479-aff4-e2a5ba888729" status: 200 len: 1374 microversion: 2.1 time: 0.573563 Sep 14 09:14:00.059941 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2502/5035] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:13:59 2022] GET /compute/v2.1/servers/d42a47fc-3124-4479-aff4-e2a5ba888729 => generated 1374 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:14:00.102307 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-10e767c5-83db-45ce-b03f-5d83ef7958b1 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:14:00.103188 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-10e767c5-83db-45ce-b03f-5d83ef7958b1 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] [instance: d8ae775e-e822-487d-a211-a4f4bd042c21] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:14:00.110495 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-10e767c5-83db-45ce-b03f-5d83ef7958b1 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:00.111012 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-10e767c5-83db-45ce-b03f-5d83ef7958b1 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:00.111519 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-10e767c5-83db-45ce-b03f-5d83ef7958b1 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:00.112248 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-10e767c5-83db-45ce-b03f-5d83ef7958b1 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:00.112861 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-10e767c5-83db-45ce-b03f-5d83ef7958b1 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:00.113303 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-10e767c5-83db-45ce-b03f-5d83ef7958b1 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:00.197291 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-10e767c5-83db-45ce-b03f-5d83ef7958b1 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:00.200449 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-10e767c5-83db-45ce-b03f-5d83ef7958b1 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:00.201586 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-10e767c5-83db-45ce-b03f-5d83ef7958b1 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:00.216210 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.objects.instance [None req-10e767c5-83db-45ce-b03f-5d83ef7958b1 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lazy-loading 'fault' on Instance uuid d8ae775e-e822-487d-a211-a4f4bd042c21 {{(pid=128758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:14:00.361009 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-10e767c5-83db-45ce-b03f-5d83ef7958b1 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421bf1609a6d4f808a4cb3612bf64615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a020c15f895946328ab384514c1ba463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:14:00.371722 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-10e767c5-83db-45ce-b03f-5d83ef7958b1 tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] 10.222.0.60 "GET /compute/v2.1/servers/d8ae775e-e822-487d-a211-a4f4bd042c21" status: 200 len: 1304 microversion: 2.1 time: 0.276785 Sep 14 09:14:00.373156 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2534/5036] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:14:00 2022] GET /compute/v2.1/servers/d8ae775e-e822-487d-a211-a4f4bd042c21 => generated 1304 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:14:00.519059 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-2b500cc5-ff43-4293-b8bd-ac6bbe6c0161 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Action: 'create', calling method: .version_select at 0x7f7d4424b0d0>, body: {"keypair": {"name": "tempest-keypair-1111074361", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM7jeUct1ehUFVLHw/Ri8FRZH0nI1nVQ+YSrAZ5fzUVrnNLF8g4dLE7Y6snGjzp9dXNFfTCwslaWgtXTcaLneXjMOdPWNDsdinohuRMBf+q/SJLInq9bMv+PLfPasCoNcQ=="}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:14:00.574418 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-2b500cc5-ff43-4293-b8bd-ac6bbe6c0161 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Getting quotas for project 9c0762ad3f774829b58669b312dd13f7. Resources: {'key_pairs'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:14:00.582738 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-2b500cc5-ff43-4293-b8bd-ac6bbe6c0161 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Getting quotas for user 78051740ae354035b119d5d8ebe226f1 and project 9c0762ad3f774829b58669b312dd13f7. Resources: {'key_pairs'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:14:00.621661 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-2b500cc5-ff43-4293-b8bd-ac6bbe6c0161 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.114254 Sep 14 09:14:00.622590 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2503/5037] 10.222.0.60 () {62 vars in 1200 bytes} [Wed Sep 14 09:14:00 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 117 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 14 09:14:00.909028 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-18fd2c4a-c92e-420e-a9b1-d96805f74503 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:14:00.909655 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-18fd2c4a-c92e-420e-a9b1-d96805f74503 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] [instance: ac1c3be3-de1d-456b-bfb9-aad6baafbb34] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:14:00.934500 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-18fd2c4a-c92e-420e-a9b1-d96805f74503 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:00.935048 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-18fd2c4a-c92e-420e-a9b1-d96805f74503 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:00.935852 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-18fd2c4a-c92e-420e-a9b1-d96805f74503 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:00.938764 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-18fd2c4a-c92e-420e-a9b1-d96805f74503 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:00.939348 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-18fd2c4a-c92e-420e-a9b1-d96805f74503 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:00.939804 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-18fd2c4a-c92e-420e-a9b1-d96805f74503 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:00.970207 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-18fd2c4a-c92e-420e-a9b1-d96805f74503 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] HTTP exception thrown: Instance ac1c3be3-de1d-456b-bfb9-aad6baafbb34 could not be found. Sep 14 09:14:00.973158 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-18fd2c4a-c92e-420e-a9b1-d96805f74503 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Request method failure captured: Sep 14 09:14:00.973158 n-d-836830-18 devstack@n-api.service[128758]: request: GET /compute/v2.1/servers/ac1c3be3-de1d-456b-bfb9-aad6baafbb34 HTTP/1.1 Sep 14 09:14:00.973158 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 09:14:00.973158 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 09:14:00.973158 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 09:14:00.973158 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 09:14:00.973158 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 09:14:00.973158 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 09:14:00.973158 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 09:14:00.973158 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 09:14:00.973158 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZrtIhgDvEWeYp7O8tRO-UH3fduWm5FD7xz3GXCLY8eZPbMpWYUt5fj5Ti8tXK5lTZx-nfK5gJJfuBtlE07BSJ2KA2x76buWcCJQ7nse5zDoRqoBleeqIX9h2-Fe4Nj9WkSpOS3iOWRVPqJ6_3Psi-nP7Y1_O2rjYO5bDiD5p7HyYqI Sep 14 09:14:00.973158 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 09:14:00.973158 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 09:14:00.973158 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 09:14:00.973158 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 09:14:00.973158 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 09:14:00.973158 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 09:14:00.973158 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: b94e25a7caf946c2a80b874416e4906b Sep 14 09:14:00.973158 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-ServersTestMultiNic-1878356894 Sep 14 09:14:00.973158 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 09:14:00.973158 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 09:14:00.973158 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b94e25a7caf946c2a80b874416e4906b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b94e25a7caf946c2a80b874416e4906b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b94e25a7caf946c2a80b874416e4906b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b94e25a7caf946c2a80b874416e4906b"}]}] Sep 14 09:14:00.973158 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-ServersTestMultiNic-1878356894 Sep 14 09:14:00.973158 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: b94e25a7caf946c2a80b874416e4906b Sep 14 09:14:00.973158 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-ServersTestMultiNic-1878356894 Sep 14 09:14:00.973158 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-ServersTestMultiNic-1878356894-project Sep 14 09:14:00.973158 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 09:14:00.973158 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 09:14:00.973158 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: fe73f3d7f4734e1ab9f6b7283db1388b Sep 14 09:14:00.973158 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-ServersTestMultiNic-1878356894-project Sep 14 09:14:00.973158 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 09:14:00.973158 n-d-836830-18 devstack@n-api.service[128758]: exception: Instance ac1c3be3-de1d-456b-bfb9-aad6baafbb34 could not be found. Sep 14 09:14:00.973158 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': 'ac1c3be3-de1d-456b-bfb9-aad6baafbb34'} Sep 14 09:14:00.973158 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:14:00.973158 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:14:00.973158 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:14:00.973158 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:14:00.973158 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:14:00.973158 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:14:00.973158 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:14:00.973158 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:14:00.973158 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:14:00.973158 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:14:00.973158 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac1c3be3-de1d-456b-bfb9-aad6baafbb34 could not be found. Sep 14 09:14:00.973158 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:14:00.973158 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:14:00.973158 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:14:00.973158 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:14:00.973158 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:14:00.973158 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:14:00.973158 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:14:00.973158 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:14:00.973158 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:14:00.973158 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:14:00.973158 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:14:00.973158 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:14:00.973158 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:14:00.973158 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:14:00.973158 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:14:00.973158 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:14:00.973158 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac1c3be3-de1d-456b-bfb9-aad6baafbb34 could not be found. Sep 14 09:14:00.973158 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:14:00.973158 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:14:00.973158 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:14:00.978095 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:14:00.978095 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:14:00.978095 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:14:00.978095 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:14:00.978095 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:14:00.978095 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac1c3be3-de1d-456b-bfb9-aad6baafbb34 could not be found. Sep 14 09:14:00.978095 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:14:00.981973 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-18fd2c4a-c92e-420e-a9b1-d96805f74503 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Returning 404 to user: Instance ac1c3be3-de1d-456b-bfb9-aad6baafbb34 could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:14:00.983220 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-18fd2c4a-c92e-420e-a9b1-d96805f74503 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] 10.222.0.60 "GET /compute/v2.1/servers/ac1c3be3-de1d-456b-bfb9-aad6baafbb34" status: 404 len: 111 microversion: 2.1 time: 0.078070 Sep 14 09:14:00.984536 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2535/5038] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:14:00 2022] GET /compute/v2.1/servers/ac1c3be3-de1d-456b-bfb9-aad6baafbb34 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:14:01.022795 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-649b9580-d268-40e3-af01-aa0414e81928 req-cd69c28e-c0be-4091-bcb8-e6fbd93462cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8ae775e-e822-487d-a211-a4f4bd042c21", "name": "network-vif-deleted", "tag": "4eb2d6f4-d3a5-4426-aaae-c70f33c5937a"}, {"server_uuid": "ac1c3be3-de1d-456b-bfb9-aad6baafbb34", "name": "network-vif-deleted", "tag": "281abffd-f25c-48c2-bfb8-373ceff41810"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:14:01.060378 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-649b9580-d268-40e3-af01-aa0414e81928 req-cd69c28e-c0be-4091-bcb8-e6fbd93462cf service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:01.061878 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-649b9580-d268-40e3-af01-aa0414e81928 req-cd69c28e-c0be-4091-bcb8-e6fbd93462cf service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:01.062329 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-649b9580-d268-40e3-af01-aa0414e81928 req-cd69c28e-c0be-4091-bcb8-e6fbd93462cf service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:01.083409 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-dc604fae-a1b9-450d-bc10-a66f15b50264 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:14:01.084040 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-dc604fae-a1b9-450d-bc10-a66f15b50264 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] [instance: d42a47fc-3124-4479-aff4-e2a5ba888729] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:14:01.085995 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-649b9580-d268-40e3-af01-aa0414e81928 req-cd69c28e-c0be-4091-bcb8-e6fbd93462cf service nova] Creating event network-vif-deleted:4eb2d6f4-d3a5-4426-aaae-c70f33c5937a for instance d8ae775e-e822-487d-a211-a4f4bd042c21 on n-h2-836830-18 Sep 14 09:14:01.086975 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-649b9580-d268-40e3-af01-aa0414e81928 req-cd69c28e-c0be-4091-bcb8-e6fbd93462cf service nova] Creating event network-vif-deleted:281abffd-f25c-48c2-bfb8-373ceff41810 for instance ac1c3be3-de1d-456b-bfb9-aad6baafbb34 on n-h2-836830-18 Sep 14 09:14:01.096881 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-649b9580-d268-40e3-af01-aa0414e81928 req-cd69c28e-c0be-4091-bcb8-e6fbd93462cf service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.078409 Sep 14 09:14:01.098222 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2504/5039] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:14:01 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:14:01.099058 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dc604fae-a1b9-450d-bc10-a66f15b50264 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:01.099574 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dc604fae-a1b9-450d-bc10-a66f15b50264 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:01.103019 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dc604fae-a1b9-450d-bc10-a66f15b50264 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:01.103852 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dc604fae-a1b9-450d-bc10-a66f15b50264 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:01.106127 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dc604fae-a1b9-450d-bc10-a66f15b50264 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:01.106601 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dc604fae-a1b9-450d-bc10-a66f15b50264 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:01.397694 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e1feb870-9ade-4278-94b5-7d6102bfe3df tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:14:01.399028 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e1feb870-9ade-4278-94b5-7d6102bfe3df tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] [instance: d8ae775e-e822-487d-a211-a4f4bd042c21] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:14:01.407404 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e1feb870-9ade-4278-94b5-7d6102bfe3df tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:01.408278 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e1feb870-9ade-4278-94b5-7d6102bfe3df tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:01.409584 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e1feb870-9ade-4278-94b5-7d6102bfe3df tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:01.410538 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e1feb870-9ade-4278-94b5-7d6102bfe3df tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:01.411190 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e1feb870-9ade-4278-94b5-7d6102bfe3df tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:01.411841 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e1feb870-9ade-4278-94b5-7d6102bfe3df tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:01.433834 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-e1feb870-9ade-4278-94b5-7d6102bfe3df tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] HTTP exception thrown: Instance d8ae775e-e822-487d-a211-a4f4bd042c21 could not be found. Sep 14 09:14:01.436615 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e1feb870-9ade-4278-94b5-7d6102bfe3df tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Request method failure captured: Sep 14 09:14:01.436615 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/d8ae775e-e822-487d-a211-a4f4bd042c21 HTTP/1.1 Sep 14 09:14:01.436615 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:14:01.436615 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:14:01.436615 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:14:01.436615 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:14:01.436615 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:14:01.436615 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:14:01.436615 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:14:01.436615 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:14:01.436615 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZsaEPHsAnWxZrOYuD-xLVEsbIfmuOHPlUOT1hWl6X9nda8VkFyRgjwpTRu0kXD2TNExza081lKyneqUatk5d68cLnPExx1CVknFP6yCNX20j4bdvRtryE6L-kkZDfXy-gsM2_1iF5IlBVFn4zAIYu4h2owbM9uQL9HNOZK-j-ycyFQ Sep 14 09:14:01.436615 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:14:01.436615 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:14:01.436615 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:14:01.436615 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:14:01.436615 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:14:01.436615 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:14:01.436615 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: a020c15f895946328ab384514c1ba463 Sep 14 09:14:01.436615 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-VolumesActionsTest-716596873 Sep 14 09:14:01.436615 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:14:01.436615 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:14:01.436615 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a020c15f895946328ab384514c1ba463"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a020c15f895946328ab384514c1ba463"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a020c15f895946328ab384514c1ba463"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a020c15f895946328ab384514c1ba463"}]}] Sep 14 09:14:01.436615 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-VolumesActionsTest-716596873 Sep 14 09:14:01.436615 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: a020c15f895946328ab384514c1ba463 Sep 14 09:14:01.436615 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-VolumesActionsTest-716596873 Sep 14 09:14:01.436615 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-VolumesActionsTest-716596873-project Sep 14 09:14:01.436615 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:14:01.436615 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:14:01.436615 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 421bf1609a6d4f808a4cb3612bf64615 Sep 14 09:14:01.436615 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-VolumesActionsTest-716596873-project Sep 14 09:14:01.436615 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:14:01.436615 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance d8ae775e-e822-487d-a211-a4f4bd042c21 could not be found. Sep 14 09:14:01.436615 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': 'd8ae775e-e822-487d-a211-a4f4bd042c21'} Sep 14 09:14:01.436615 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:14:01.436615 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:14:01.436615 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:14:01.436615 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:14:01.436615 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:14:01.436615 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:14:01.436615 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:14:01.436615 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:14:01.436615 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:14:01.436615 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:14:01.436615 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8ae775e-e822-487d-a211-a4f4bd042c21 could not be found. Sep 14 09:14:01.436615 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:14:01.436615 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:14:01.436615 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:14:01.436615 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:14:01.436615 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:14:01.436615 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:14:01.436615 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:14:01.436615 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:14:01.436615 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:14:01.436615 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:14:01.436615 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:14:01.436615 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:14:01.436615 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:14:01.436615 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:14:01.436615 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:14:01.436615 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:14:01.436615 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8ae775e-e822-487d-a211-a4f4bd042c21 could not be found. Sep 14 09:14:01.436615 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:14:01.436615 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:14:01.436615 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:14:01.441588 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:14:01.441588 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:14:01.441588 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:14:01.441588 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:14:01.441588 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:14:01.441588 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8ae775e-e822-487d-a211-a4f4bd042c21 could not be found. Sep 14 09:14:01.441588 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:14:01.444001 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e1feb870-9ade-4278-94b5-7d6102bfe3df tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] Returning 404 to user: Instance d8ae775e-e822-487d-a211-a4f4bd042c21 could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:14:01.445212 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e1feb870-9ade-4278-94b5-7d6102bfe3df tempest-VolumesActionsTest-716596873 tempest-VolumesActionsTest-716596873-project] 10.222.0.60 "GET /compute/v2.1/servers/d8ae775e-e822-487d-a211-a4f4bd042c21" status: 404 len: 111 microversion: 2.1 time: 0.052967 Sep 14 09:14:01.446309 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2505/5040] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:14:01 2022] GET /compute/v2.1/servers/d8ae775e-e822-487d-a211-a4f4bd042c21 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 14 09:14:01.464853 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-dc604fae-a1b9-450d-bc10-a66f15b50264 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17918433a3994b69a65999a59a7f833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b73b20f2042c6a08f94ed23ff66e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:14:01.474001 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-dc604fae-a1b9-450d-bc10-a66f15b50264 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] 10.222.0.60 "GET /compute/v2.1/servers/d42a47fc-3124-4479-aff4-e2a5ba888729" status: 200 len: 1545 microversion: 2.1 time: 0.394452 Sep 14 09:14:01.474597 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2536/5041] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:14:01 2022] GET /compute/v2.1/servers/d42a47fc-3124-4479-aff4-e2a5ba888729 => generated 1545 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:14:01.502203 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-465cf39d-9b9e-4ac0-894c-b1fa9345749e tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:14:01.503162 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-465cf39d-9b9e-4ac0-894c-b1fa9345749e tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] [instance: d42a47fc-3124-4479-aff4-e2a5ba888729] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:14:01.525322 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-465cf39d-9b9e-4ac0-894c-b1fa9345749e tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:01.527983 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-465cf39d-9b9e-4ac0-894c-b1fa9345749e tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:01.528892 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-465cf39d-9b9e-4ac0-894c-b1fa9345749e tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:01.533053 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-465cf39d-9b9e-4ac0-894c-b1fa9345749e tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:01.535065 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-465cf39d-9b9e-4ac0-894c-b1fa9345749e tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:01.536108 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-465cf39d-9b9e-4ac0-894c-b1fa9345749e tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:01.931401 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-465cf39d-9b9e-4ac0-894c-b1fa9345749e tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17918433a3994b69a65999a59a7f833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b73b20f2042c6a08f94ed23ff66e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:14:01.944468 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-465cf39d-9b9e-4ac0-894c-b1fa9345749e tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] 10.222.0.60 "GET /compute/v2.1/servers/d42a47fc-3124-4479-aff4-e2a5ba888729" status: 200 len: 1545 microversion: 2.1 time: 0.447141 Sep 14 09:14:01.945040 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2506/5042] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:14:01 2022] GET /compute/v2.1/servers/d42a47fc-3124-4479-aff4-e2a5ba888729 => generated 1545 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:14:03.558562 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-4f7a0a27-e7a4-4d60-a5fe-f71480002383 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1882300764", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cf8ff039-9ce3-49c0-bc1b-5843a8f13c00"}], "security_groups": [{"name": "tempest-securitygroup--134058257"}], "key_name": "tempest-keypair-1111074361", "user_data": "}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:14:03.954909 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.network.neutron [None req-4f7a0a27-e7a4-4d60-a5fe-f71480002383 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] validate_networks() for [('cf8ff039-9ce3-49c0-bc1b-5843a8f13c00', None, None, None, None, None)] {{(pid=128758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:14:05.573324 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-0265ad92-89c5-456d-9b8a-b01e35d51745 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:14:05.574554 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-0265ad92-89c5-456d-9b8a-b01e35d51745 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] [instance: ac1c3be3-de1d-456b-bfb9-aad6baafbb34] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:14:05.609415 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0265ad92-89c5-456d-9b8a-b01e35d51745 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:05.610814 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0265ad92-89c5-456d-9b8a-b01e35d51745 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:05.611463 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0265ad92-89c5-456d-9b8a-b01e35d51745 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:05.613008 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0265ad92-89c5-456d-9b8a-b01e35d51745 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:05.613654 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0265ad92-89c5-456d-9b8a-b01e35d51745 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:05.617176 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0265ad92-89c5-456d-9b8a-b01e35d51745 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:05.643465 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-0265ad92-89c5-456d-9b8a-b01e35d51745 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] HTTP exception thrown: Instance ac1c3be3-de1d-456b-bfb9-aad6baafbb34 could not be found. Sep 14 09:14:05.657520 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-0265ad92-89c5-456d-9b8a-b01e35d51745 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Request method failure captured: Sep 14 09:14:05.657520 n-d-836830-18 devstack@n-api.service[128759]: request: DELETE /compute/v2.1/servers/ac1c3be3-de1d-456b-bfb9-aad6baafbb34 HTTP/1.1 Sep 14 09:14:05.657520 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:14:05.657520 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:14:05.657520 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:14:05.657520 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:14:05.657520 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:14:05.657520 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:14:05.657520 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:14:05.657520 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:14:05.657520 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZrtIhgDvEWeYp7O8tRO-UH3fduWm5FD7xz3GXCLY8eZPbMpWYUt5fj5Ti8tXK5lTZx-nfK5gJJfuBtlE07BSJ2KA2x76buWcCJQ7nse5zDoRqoBleeqIX9h2-Fe4Nj9WkSpOS3iOWRVPqJ6_3Psi-nP7Y1_O2rjYO5bDiD5p7HyYqI Sep 14 09:14:05.657520 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:14:05.657520 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:14:05.657520 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:14:05.657520 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:14:05.657520 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:14:05.657520 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:14:05.657520 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: b94e25a7caf946c2a80b874416e4906b Sep 14 09:14:05.657520 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ServersTestMultiNic-1878356894 Sep 14 09:14:05.657520 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:14:05.657520 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:14:05.657520 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b94e25a7caf946c2a80b874416e4906b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b94e25a7caf946c2a80b874416e4906b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b94e25a7caf946c2a80b874416e4906b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b94e25a7caf946c2a80b874416e4906b"}]}] Sep 14 09:14:05.657520 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ServersTestMultiNic-1878356894 Sep 14 09:14:05.657520 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: b94e25a7caf946c2a80b874416e4906b Sep 14 09:14:05.657520 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ServersTestMultiNic-1878356894 Sep 14 09:14:05.657520 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ServersTestMultiNic-1878356894-project Sep 14 09:14:05.657520 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:14:05.657520 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:14:05.657520 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: fe73f3d7f4734e1ab9f6b7283db1388b Sep 14 09:14:05.657520 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ServersTestMultiNic-1878356894-project Sep 14 09:14:05.657520 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:14:05.657520 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance ac1c3be3-de1d-456b-bfb9-aad6baafbb34 could not be found. Sep 14 09:14:05.657520 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': 'ac1c3be3-de1d-456b-bfb9-aad6baafbb34'} Sep 14 09:14:05.657520 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:14:05.657520 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:14:05.657520 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:14:05.657520 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:14:05.657520 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:14:05.657520 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:14:05.657520 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:14:05.657520 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:14:05.657520 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:14:05.657520 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:14:05.657520 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac1c3be3-de1d-456b-bfb9-aad6baafbb34 could not be found. Sep 14 09:14:05.657520 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:14:05.657520 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:14:05.657520 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:14:05.657520 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:14:05.657520 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:14:05.657520 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:14:05.657520 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:14:05.657520 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:14:05.657520 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:14:05.657520 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:14:05.657520 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 09:14:05.657520 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 09:14:05.657520 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 09:14:05.657520 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 09:14:05.657520 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:14:05.657520 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:14:05.657520 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:14:05.657520 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:14:05.663998 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac1c3be3-de1d-456b-bfb9-aad6baafbb34 could not be found. Sep 14 09:14:05.663998 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:14:05.663998 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:14:05.663998 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:14:05.663998 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:14:05.663998 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:14:05.663998 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:14:05.663998 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:14:05.663998 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:14:05.663998 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac1c3be3-de1d-456b-bfb9-aad6baafbb34 could not be found. Sep 14 09:14:05.663998 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:14:05.663998 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-0265ad92-89c5-456d-9b8a-b01e35d51745 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Returning 404 to user: Instance ac1c3be3-de1d-456b-bfb9-aad6baafbb34 could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:14:05.663998 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-0265ad92-89c5-456d-9b8a-b01e35d51745 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] 10.222.0.60 "DELETE /compute/v2.1/servers/ac1c3be3-de1d-456b-bfb9-aad6baafbb34" status: 404 len: 111 microversion: 2.1 time: 0.090820 Sep 14 09:14:05.663998 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2507/5043] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:14:05 2022] DELETE /compute/v2.1/servers/ac1c3be3-de1d-456b-bfb9-aad6baafbb34 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:14:05.675517 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-18a3942d-a07f-4440-aa8f-b33cd602e441 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:14:05.676411 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-18a3942d-a07f-4440-aa8f-b33cd602e441 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] [instance: ac1c3be3-de1d-456b-bfb9-aad6baafbb34] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:14:05.686330 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-18a3942d-a07f-4440-aa8f-b33cd602e441 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:05.687230 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-18a3942d-a07f-4440-aa8f-b33cd602e441 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:05.688276 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-18a3942d-a07f-4440-aa8f-b33cd602e441 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:05.689673 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-18a3942d-a07f-4440-aa8f-b33cd602e441 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:05.690675 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-18a3942d-a07f-4440-aa8f-b33cd602e441 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:05.691435 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-18a3942d-a07f-4440-aa8f-b33cd602e441 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:05.718998 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-18a3942d-a07f-4440-aa8f-b33cd602e441 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] HTTP exception thrown: Instance ac1c3be3-de1d-456b-bfb9-aad6baafbb34 could not be found. Sep 14 09:14:05.721085 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-18a3942d-a07f-4440-aa8f-b33cd602e441 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Request method failure captured: Sep 14 09:14:05.721085 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/ac1c3be3-de1d-456b-bfb9-aad6baafbb34 HTTP/1.1 Sep 14 09:14:05.721085 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:14:05.721085 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:14:05.721085 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:14:05.721085 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:14:05.721085 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:14:05.721085 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:14:05.721085 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:14:05.721085 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:14:05.721085 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZrtIhgDvEWeYp7O8tRO-UH3fduWm5FD7xz3GXCLY8eZPbMpWYUt5fj5Ti8tXK5lTZx-nfK5gJJfuBtlE07BSJ2KA2x76buWcCJQ7nse5zDoRqoBleeqIX9h2-Fe4Nj9WkSpOS3iOWRVPqJ6_3Psi-nP7Y1_O2rjYO5bDiD5p7HyYqI Sep 14 09:14:05.721085 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:14:05.721085 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:14:05.721085 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:14:05.721085 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:14:05.721085 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:14:05.721085 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:14:05.721085 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: b94e25a7caf946c2a80b874416e4906b Sep 14 09:14:05.721085 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ServersTestMultiNic-1878356894 Sep 14 09:14:05.721085 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:14:05.721085 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:14:05.721085 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b94e25a7caf946c2a80b874416e4906b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b94e25a7caf946c2a80b874416e4906b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b94e25a7caf946c2a80b874416e4906b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b94e25a7caf946c2a80b874416e4906b"}]}] Sep 14 09:14:05.721085 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ServersTestMultiNic-1878356894 Sep 14 09:14:05.721085 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: b94e25a7caf946c2a80b874416e4906b Sep 14 09:14:05.721085 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ServersTestMultiNic-1878356894 Sep 14 09:14:05.721085 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ServersTestMultiNic-1878356894-project Sep 14 09:14:05.721085 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:14:05.721085 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:14:05.721085 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: fe73f3d7f4734e1ab9f6b7283db1388b Sep 14 09:14:05.721085 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ServersTestMultiNic-1878356894-project Sep 14 09:14:05.721085 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:14:05.721085 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance ac1c3be3-de1d-456b-bfb9-aad6baafbb34 could not be found. Sep 14 09:14:05.721085 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': 'ac1c3be3-de1d-456b-bfb9-aad6baafbb34'} Sep 14 09:14:05.721085 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:14:05.721085 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:14:05.721085 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:14:05.721085 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:14:05.721085 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:14:05.721085 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:14:05.721085 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:14:05.721085 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:14:05.721085 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:14:05.721085 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:14:05.721085 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac1c3be3-de1d-456b-bfb9-aad6baafbb34 could not be found. Sep 14 09:14:05.721085 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:14:05.721085 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:14:05.721085 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:14:05.721085 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:14:05.721085 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:14:05.721085 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:14:05.721085 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:14:05.721085 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:14:05.721085 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:14:05.721085 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:14:05.721085 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:14:05.721085 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:14:05.721085 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:14:05.721085 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:14:05.721085 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:14:05.721085 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:14:05.721085 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac1c3be3-de1d-456b-bfb9-aad6baafbb34 could not be found. Sep 14 09:14:05.721085 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:14:05.721085 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:14:05.721085 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:14:05.726116 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:14:05.726116 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:14:05.726116 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:14:05.726116 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:14:05.726116 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:14:05.726116 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac1c3be3-de1d-456b-bfb9-aad6baafbb34 could not be found. Sep 14 09:14:05.726116 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:14:05.729709 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-18a3942d-a07f-4440-aa8f-b33cd602e441 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Returning 404 to user: Instance ac1c3be3-de1d-456b-bfb9-aad6baafbb34 could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:14:05.749997 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-18a3942d-a07f-4440-aa8f-b33cd602e441 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] 10.222.0.60 "GET /compute/v2.1/servers/ac1c3be3-de1d-456b-bfb9-aad6baafbb34" status: 404 len: 111 microversion: 2.1 time: 0.080981 Sep 14 09:14:05.754967 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2508/5044] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:14:05 2022] GET /compute/v2.1/servers/ac1c3be3-de1d-456b-bfb9-aad6baafbb34 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:14:05.806360 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3b48e4b2-c239-48c5-b127-320cf2c31717 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:14:05.815100 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-3b48e4b2-c239-48c5-b127-320cf2c31717 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] [instance: a261d310-161f-4e77-a27a-7f377072cb2d] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:14:05.846466 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3b48e4b2-c239-48c5-b127-320cf2c31717 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:05.854735 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3b48e4b2-c239-48c5-b127-320cf2c31717 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:05.856159 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3b48e4b2-c239-48c5-b127-320cf2c31717 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:05.859090 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3b48e4b2-c239-48c5-b127-320cf2c31717 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:05.864742 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3b48e4b2-c239-48c5-b127-320cf2c31717 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:05.866476 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3b48e4b2-c239-48c5-b127-320cf2c31717 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:05.935646 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-3b48e4b2-c239-48c5-b127-320cf2c31717 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] HTTP exception thrown: Instance a261d310-161f-4e77-a27a-7f377072cb2d could not be found. Sep 14 09:14:05.938100 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3b48e4b2-c239-48c5-b127-320cf2c31717 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Request method failure captured: Sep 14 09:14:05.938100 n-d-836830-18 devstack@n-api.service[128759]: request: DELETE /compute/v2.1/servers/a261d310-161f-4e77-a27a-7f377072cb2d HTTP/1.1 Sep 14 09:14:05.938100 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:14:05.938100 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:14:05.938100 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:14:05.938100 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:14:05.938100 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:14:05.938100 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:14:05.938100 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:14:05.938100 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:14:05.938100 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZrtIhgDvEWeYp7O8tRO-UH3fduWm5FD7xz3GXCLY8eZPbMpWYUt5fj5Ti8tXK5lTZx-nfK5gJJfuBtlE07BSJ2KA2x76buWcCJQ7nse5zDoRqoBleeqIX9h2-Fe4Nj9WkSpOS3iOWRVPqJ6_3Psi-nP7Y1_O2rjYO5bDiD5p7HyYqI Sep 14 09:14:05.938100 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:14:05.938100 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:14:05.938100 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:14:05.938100 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:14:05.938100 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:14:05.938100 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:14:05.938100 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: b94e25a7caf946c2a80b874416e4906b Sep 14 09:14:05.938100 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ServersTestMultiNic-1878356894 Sep 14 09:14:05.938100 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:14:05.938100 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:14:05.938100 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b94e25a7caf946c2a80b874416e4906b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b94e25a7caf946c2a80b874416e4906b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b94e25a7caf946c2a80b874416e4906b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b94e25a7caf946c2a80b874416e4906b"}]}] Sep 14 09:14:05.938100 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ServersTestMultiNic-1878356894 Sep 14 09:14:05.938100 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: b94e25a7caf946c2a80b874416e4906b Sep 14 09:14:05.938100 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ServersTestMultiNic-1878356894 Sep 14 09:14:05.938100 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ServersTestMultiNic-1878356894-project Sep 14 09:14:05.938100 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:14:05.938100 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:14:05.938100 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: fe73f3d7f4734e1ab9f6b7283db1388b Sep 14 09:14:05.938100 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ServersTestMultiNic-1878356894-project Sep 14 09:14:05.938100 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:14:05.938100 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance a261d310-161f-4e77-a27a-7f377072cb2d could not be found. Sep 14 09:14:05.938100 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': 'a261d310-161f-4e77-a27a-7f377072cb2d'} Sep 14 09:14:05.938100 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:14:05.938100 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:14:05.938100 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:14:05.938100 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:14:05.938100 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:14:05.938100 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:14:05.938100 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:14:05.938100 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:14:05.938100 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:14:05.938100 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:14:05.938100 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a261d310-161f-4e77-a27a-7f377072cb2d could not be found. Sep 14 09:14:05.938100 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:14:05.938100 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:14:05.938100 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:14:05.938100 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:14:05.938100 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:14:05.938100 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:14:05.938100 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:14:05.938100 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:14:05.938100 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:14:05.938100 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:14:05.938100 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 09:14:05.938100 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 09:14:05.938100 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 09:14:05.938100 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 09:14:05.938100 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:14:05.938100 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:14:05.938100 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:14:05.938100 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:14:05.943392 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a261d310-161f-4e77-a27a-7f377072cb2d could not be found. Sep 14 09:14:05.943392 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:14:05.943392 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:14:05.943392 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:14:05.943392 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:14:05.943392 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:14:05.943392 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:14:05.943392 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:14:05.943392 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:14:05.943392 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a261d310-161f-4e77-a27a-7f377072cb2d could not be found. Sep 14 09:14:05.943392 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:14:05.945589 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3b48e4b2-c239-48c5-b127-320cf2c31717 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Returning 404 to user: Instance a261d310-161f-4e77-a27a-7f377072cb2d could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:14:05.946838 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-3b48e4b2-c239-48c5-b127-320cf2c31717 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] 10.222.0.60 "DELETE /compute/v2.1/servers/a261d310-161f-4e77-a27a-7f377072cb2d" status: 404 len: 111 microversion: 2.1 time: 0.188012 Sep 14 09:14:05.947945 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2509/5045] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:14:05 2022] DELETE /compute/v2.1/servers/a261d310-161f-4e77-a27a-7f377072cb2d => generated 111 bytes in 192 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:14:05.968743 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c26550ba-4730-4209-a1b4-712b8e3e2432 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:14:05.969624 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-c26550ba-4730-4209-a1b4-712b8e3e2432 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] [instance: a261d310-161f-4e77-a27a-7f377072cb2d] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:14:05.996199 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c26550ba-4730-4209-a1b4-712b8e3e2432 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:06.003745 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c26550ba-4730-4209-a1b4-712b8e3e2432 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:06.006567 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c26550ba-4730-4209-a1b4-712b8e3e2432 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:06.010356 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c26550ba-4730-4209-a1b4-712b8e3e2432 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:06.013895 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c26550ba-4730-4209-a1b4-712b8e3e2432 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:06.014357 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c26550ba-4730-4209-a1b4-712b8e3e2432 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:06.059396 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-c26550ba-4730-4209-a1b4-712b8e3e2432 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] HTTP exception thrown: Instance a261d310-161f-4e77-a27a-7f377072cb2d could not be found. Sep 14 09:14:06.061003 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c26550ba-4730-4209-a1b4-712b8e3e2432 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Request method failure captured: Sep 14 09:14:06.061003 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/a261d310-161f-4e77-a27a-7f377072cb2d HTTP/1.1 Sep 14 09:14:06.061003 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:14:06.061003 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:14:06.061003 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:14:06.061003 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:14:06.061003 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:14:06.061003 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:14:06.061003 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:14:06.061003 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:14:06.061003 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZrtIhgDvEWeYp7O8tRO-UH3fduWm5FD7xz3GXCLY8eZPbMpWYUt5fj5Ti8tXK5lTZx-nfK5gJJfuBtlE07BSJ2KA2x76buWcCJQ7nse5zDoRqoBleeqIX9h2-Fe4Nj9WkSpOS3iOWRVPqJ6_3Psi-nP7Y1_O2rjYO5bDiD5p7HyYqI Sep 14 09:14:06.061003 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:14:06.061003 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:14:06.061003 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:14:06.061003 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:14:06.061003 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:14:06.061003 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:14:06.061003 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: b94e25a7caf946c2a80b874416e4906b Sep 14 09:14:06.061003 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ServersTestMultiNic-1878356894 Sep 14 09:14:06.061003 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:14:06.061003 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:14:06.061003 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b94e25a7caf946c2a80b874416e4906b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b94e25a7caf946c2a80b874416e4906b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b94e25a7caf946c2a80b874416e4906b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b94e25a7caf946c2a80b874416e4906b"}]}] Sep 14 09:14:06.061003 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ServersTestMultiNic-1878356894 Sep 14 09:14:06.061003 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: b94e25a7caf946c2a80b874416e4906b Sep 14 09:14:06.061003 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ServersTestMultiNic-1878356894 Sep 14 09:14:06.061003 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ServersTestMultiNic-1878356894-project Sep 14 09:14:06.061003 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:14:06.061003 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:14:06.061003 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: fe73f3d7f4734e1ab9f6b7283db1388b Sep 14 09:14:06.061003 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ServersTestMultiNic-1878356894-project Sep 14 09:14:06.061003 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:14:06.061003 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance a261d310-161f-4e77-a27a-7f377072cb2d could not be found. Sep 14 09:14:06.061003 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': 'a261d310-161f-4e77-a27a-7f377072cb2d'} Sep 14 09:14:06.061003 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:14:06.061003 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:14:06.061003 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:14:06.061003 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:14:06.061003 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:14:06.061003 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:14:06.061003 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:14:06.061003 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:14:06.061003 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:14:06.061003 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:14:06.061003 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a261d310-161f-4e77-a27a-7f377072cb2d could not be found. Sep 14 09:14:06.061003 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:14:06.061003 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:14:06.061003 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:14:06.061003 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:14:06.061003 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:14:06.061003 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:14:06.061003 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:14:06.061003 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:14:06.061003 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:14:06.061003 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:14:06.061003 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:14:06.061003 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:14:06.061003 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:14:06.061003 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:14:06.061003 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:14:06.061003 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:14:06.061003 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a261d310-161f-4e77-a27a-7f377072cb2d could not be found. Sep 14 09:14:06.061003 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:14:06.061003 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:14:06.061003 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:14:06.066695 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:14:06.066695 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:14:06.066695 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:14:06.066695 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:14:06.066695 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:14:06.066695 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a261d310-161f-4e77-a27a-7f377072cb2d could not be found. Sep 14 09:14:06.066695 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:14:06.066695 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c26550ba-4730-4209-a1b4-712b8e3e2432 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] Returning 404 to user: Instance a261d310-161f-4e77-a27a-7f377072cb2d could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:14:06.066695 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-c26550ba-4730-4209-a1b4-712b8e3e2432 tempest-ServersTestMultiNic-1878356894 tempest-ServersTestMultiNic-1878356894-project] 10.222.0.60 "GET /compute/v2.1/servers/a261d310-161f-4e77-a27a-7f377072cb2d" status: 404 len: 111 microversion: 2.1 time: 0.110464 Sep 14 09:14:06.066695 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2510/5046] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:14:05 2022] GET /compute/v2.1/servers/a261d310-161f-4e77-a27a-7f377072cb2d => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:14:06.493020 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-4f7a0a27-e7a4-4d60-a5fe-f71480002383 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Flavor limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:14:06.493716 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-4f7a0a27-e7a4-4d60-a5fe-f71480002383 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Image limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:14:06.494270 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-4f7a0a27-e7a4-4d60-a5fe-f71480002383 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Flavor pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:14:06.494905 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-4f7a0a27-e7a4-4d60-a5fe-f71480002383 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Image pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:14:06.495511 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-4f7a0a27-e7a4-4d60-a5fe-f71480002383 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:14:06.532059 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4f7a0a27-e7a4-4d60-a5fe-f71480002383 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:06.532987 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4f7a0a27-e7a4-4d60-a5fe-f71480002383 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:06.533535 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4f7a0a27-e7a4-4d60-a5fe-f71480002383 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:06.534577 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4f7a0a27-e7a4-4d60-a5fe-f71480002383 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:06.536629 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4f7a0a27-e7a4-4d60-a5fe-f71480002383 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:06.537168 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4f7a0a27-e7a4-4d60-a5fe-f71480002383 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:06.571370 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-4f7a0a27-e7a4-4d60-a5fe-f71480002383 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Getting quotas for project 9c0762ad3f774829b58669b312dd13f7. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:14:06.582802 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-4f7a0a27-e7a4-4d60-a5fe-f71480002383 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Getting quotas for user 78051740ae354035b119d5d8ebe226f1 and project 9c0762ad3f774829b58669b312dd13f7. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:14:06.603970 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-4f7a0a27-e7a4-4d60-a5fe-f71480002383 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Going to run 1 instances... {{(pid=128758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:14:06.613389 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-4f7a0a27-e7a4-4d60-a5fe-f71480002383 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 50157c1b-c748-4d1f-928e-207482b37ec6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:14:06.710720 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-4f7a0a27-e7a4-4d60-a5fe-f71480002383 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 3.157434 Sep 14 09:14:06.720294 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2537/5047] 10.222.0.60 () {62 vars in 1188 bytes} [Wed Sep 14 09:14:03 2022] POST /compute/v2.1/servers => generated 401 bytes in 3167 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 14 09:14:06.725622 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-7dc4cbb7-16fe-4b4c-a07d-c7b9237653c1 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:14:06.727332 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-7dc4cbb7-16fe-4b4c-a07d-c7b9237653c1 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 50157c1b-c748-4d1f-928e-207482b37ec6] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:14:06.919799 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-7dc4cbb7-16fe-4b4c-a07d-c7b9237653c1 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:14:06.939466 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-7dc4cbb7-16fe-4b4c-a07d-c7b9237653c1 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:14:06.941703 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-7dc4cbb7-16fe-4b4c-a07d-c7b9237653c1 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:14:06.943257 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-7dc4cbb7-16fe-4b4c-a07d-c7b9237653c1 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6" status: 200 len: 1282 microversion: 2.20 time: 0.223661 Sep 14 09:14:06.944851 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2511/5048] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:14:06 2022] GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6 => generated 1282 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 09:14:07.981822 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ae922f23-780a-4eaf-ba19-2e0a9dff6b8f tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:14:07.983572 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-ae922f23-780a-4eaf-ba19-2e0a9dff6b8f tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 50157c1b-c748-4d1f-928e-207482b37ec6] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:14:08.135423 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-ae922f23-780a-4eaf-ba19-2e0a9dff6b8f tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:14:08.145618 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-ae922f23-780a-4eaf-ba19-2e0a9dff6b8f tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:14:08.156294 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-ae922f23-780a-4eaf-ba19-2e0a9dff6b8f tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:14:08.157619 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-ae922f23-780a-4eaf-ba19-2e0a9dff6b8f tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6" status: 200 len: 1282 microversion: 2.20 time: 0.184751 Sep 14 09:14:08.187433 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2538/5049] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:14:07 2022] GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6 => generated 1282 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:14:08.744122 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-11460c7f-f1a9-4006-90c0-5b6464d77e85 req-bd8f5865-17e7-4717-bb51-57cbcfb31d26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d42a47fc-3124-4479-aff4-e2a5ba888729", "tag": "4f2597fa-7f1f-432b-bf54-eb3d836a36dd"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:14:08.773307 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-11460c7f-f1a9-4006-90c0-5b6464d77e85 req-bd8f5865-17e7-4717-bb51-57cbcfb31d26 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:08.782910 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-11460c7f-f1a9-4006-90c0-5b6464d77e85 req-bd8f5865-17e7-4717-bb51-57cbcfb31d26 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:08.786672 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-11460c7f-f1a9-4006-90c0-5b6464d77e85 req-bd8f5865-17e7-4717-bb51-57cbcfb31d26 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:08.828580 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-11460c7f-f1a9-4006-90c0-5b6464d77e85 req-bd8f5865-17e7-4717-bb51-57cbcfb31d26 service nova] Creating event network-changed:4f2597fa-7f1f-432b-bf54-eb3d836a36dd for instance d42a47fc-3124-4479-aff4-e2a5ba888729 on n-h1-836830-18 Sep 14 09:14:08.850022 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-11460c7f-f1a9-4006-90c0-5b6464d77e85 req-bd8f5865-17e7-4717-bb51-57cbcfb31d26 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110580 Sep 14 09:14:08.853428 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2512/5050] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:14:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:14:09.186314 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-40721c93-b94b-469c-b25b-3f3422c4ceeb tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:14:09.187697 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-40721c93-b94b-469c-b25b-3f3422c4ceeb tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 50157c1b-c748-4d1f-928e-207482b37ec6] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:14:09.210623 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-40721c93-b94b-469c-b25b-3f3422c4ceeb tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:09.218955 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-40721c93-b94b-469c-b25b-3f3422c4ceeb tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:09.227270 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-40721c93-b94b-469c-b25b-3f3422c4ceeb tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:09.228196 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-40721c93-b94b-469c-b25b-3f3422c4ceeb tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:09.231183 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-40721c93-b94b-469c-b25b-3f3422c4ceeb tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:09.237588 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-40721c93-b94b-469c-b25b-3f3422c4ceeb tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:09.558932 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-40721c93-b94b-469c-b25b-3f3422c4ceeb tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:14:09.576627 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-40721c93-b94b-469c-b25b-3f3422c4ceeb tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:14:09.585969 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-40721c93-b94b-469c-b25b-3f3422c4ceeb tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:14:09.590920 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-40721c93-b94b-469c-b25b-3f3422c4ceeb tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6" status: 200 len: 1342 microversion: 2.20 time: 0.405918 Sep 14 09:14:09.615522 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2539/5051] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:14:09 2022] GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6 => generated 1342 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:14:10.625661 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-7540c80c-51c3-4dbb-b536-d7968cf16938 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:14:10.626359 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-7540c80c-51c3-4dbb-b536-d7968cf16938 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 50157c1b-c748-4d1f-928e-207482b37ec6] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:14:10.656262 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7540c80c-51c3-4dbb-b536-d7968cf16938 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:10.657214 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7540c80c-51c3-4dbb-b536-d7968cf16938 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:10.659754 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7540c80c-51c3-4dbb-b536-d7968cf16938 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:10.664508 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7540c80c-51c3-4dbb-b536-d7968cf16938 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:10.671613 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7540c80c-51c3-4dbb-b536-d7968cf16938 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:10.672299 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7540c80c-51c3-4dbb-b536-d7968cf16938 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:10.952610 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-7540c80c-51c3-4dbb-b536-d7968cf16938 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:14:10.978222 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-7540c80c-51c3-4dbb-b536-d7968cf16938 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:14:10.988533 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-7540c80c-51c3-4dbb-b536-d7968cf16938 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:14:10.990099 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-7540c80c-51c3-4dbb-b536-d7968cf16938 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6" status: 200 len: 1340 microversion: 2.20 time: 0.370636 Sep 14 09:14:10.991255 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2513/5052] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:14:10 2022] GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6 => generated 1340 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:14:12.024422 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-6a203ab2-92e9-4707-a1d8-9f65ab8dbe9b tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:14:12.029733 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-6a203ab2-92e9-4707-a1d8-9f65ab8dbe9b tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 50157c1b-c748-4d1f-928e-207482b37ec6] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:14:12.050621 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6a203ab2-92e9-4707-a1d8-9f65ab8dbe9b tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:12.060066 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6a203ab2-92e9-4707-a1d8-9f65ab8dbe9b tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:12.061629 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6a203ab2-92e9-4707-a1d8-9f65ab8dbe9b tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:12.062744 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6a203ab2-92e9-4707-a1d8-9f65ab8dbe9b tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:12.063590 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6a203ab2-92e9-4707-a1d8-9f65ab8dbe9b tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:12.065590 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6a203ab2-92e9-4707-a1d8-9f65ab8dbe9b tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:12.406409 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-6a203ab2-92e9-4707-a1d8-9f65ab8dbe9b tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:14:12.419699 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-6a203ab2-92e9-4707-a1d8-9f65ab8dbe9b tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:14:12.439660 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-6a203ab2-92e9-4707-a1d8-9f65ab8dbe9b tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:14:12.446730 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-6a203ab2-92e9-4707-a1d8-9f65ab8dbe9b tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6" status: 200 len: 1407 microversion: 2.20 time: 0.425235 Sep 14 09:14:12.470104 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2540/5053] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:14:12 2022] GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6 => generated 1407 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:14:13.477438 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e64a5e6e-c94e-4c20-a718-f2d19669e194 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:14:13.478044 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e64a5e6e-c94e-4c20-a718-f2d19669e194 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 50157c1b-c748-4d1f-928e-207482b37ec6] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:14:13.490229 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e64a5e6e-c94e-4c20-a718-f2d19669e194 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:13.492322 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e64a5e6e-c94e-4c20-a718-f2d19669e194 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:13.497829 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e64a5e6e-c94e-4c20-a718-f2d19669e194 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:13.499342 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e64a5e6e-c94e-4c20-a718-f2d19669e194 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:13.500057 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e64a5e6e-c94e-4c20-a718-f2d19669e194 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:13.500730 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e64a5e6e-c94e-4c20-a718-f2d19669e194 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:14.032931 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-e64a5e6e-c94e-4c20-a718-f2d19669e194 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:14:14.041998 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-e64a5e6e-c94e-4c20-a718-f2d19669e194 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:14:14.051579 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-e64a5e6e-c94e-4c20-a718-f2d19669e194 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:14:14.057505 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e64a5e6e-c94e-4c20-a718-f2d19669e194 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6" status: 200 len: 1407 microversion: 2.20 time: 0.583935 Sep 14 09:14:14.061140 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2514/5054] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:14:13 2022] GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6 => generated 1407 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:14:15.091622 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-eadf3323-59ff-45db-9db5-567b07d1c52b tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:14:15.092971 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-eadf3323-59ff-45db-9db5-567b07d1c52b tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 50157c1b-c748-4d1f-928e-207482b37ec6] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:14:15.110445 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=95,nova_api:UPDATE=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:14:15.115101 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-eadf3323-59ff-45db-9db5-567b07d1c52b tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:15.115936 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-eadf3323-59ff-45db-9db5-567b07d1c52b tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:15.116662 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-eadf3323-59ff-45db-9db5-567b07d1c52b tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:15.123970 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-eadf3323-59ff-45db-9db5-567b07d1c52b tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:15.124996 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-eadf3323-59ff-45db-9db5-567b07d1c52b tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:15.125639 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-eadf3323-59ff-45db-9db5-567b07d1c52b tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:16.285122 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-d3b67bf4-e6cd-449f-b49d-e8fd82069230 req-817d77bb-d691-43fb-82ff-02262f53b002 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50157c1b-c748-4d1f-928e-207482b37ec6", "tag": "6bb7c82b-6dea-4020-abff-f1c92580e9d8"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:14:16.300793 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-d3b67bf4-e6cd-449f-b49d-e8fd82069230 req-817d77bb-d691-43fb-82ff-02262f53b002 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:16.301275 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-d3b67bf4-e6cd-449f-b49d-e8fd82069230 req-817d77bb-d691-43fb-82ff-02262f53b002 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:16.301708 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-d3b67bf4-e6cd-449f-b49d-e8fd82069230 req-817d77bb-d691-43fb-82ff-02262f53b002 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:16.341885 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-d3b67bf4-e6cd-449f-b49d-e8fd82069230 req-817d77bb-d691-43fb-82ff-02262f53b002 service nova] Creating event network-changed:6bb7c82b-6dea-4020-abff-f1c92580e9d8 for instance 50157c1b-c748-4d1f-928e-207482b37ec6 on n-h2-836830-18 Sep 14 09:14:16.360843 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-d3b67bf4-e6cd-449f-b49d-e8fd82069230 req-817d77bb-d691-43fb-82ff-02262f53b002 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.439758 Sep 14 09:14:16.362055 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2515/5055] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:14:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:14:16.475104 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-eadf3323-59ff-45db-9db5-567b07d1c52b tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:14:16.485317 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-eadf3323-59ff-45db-9db5-567b07d1c52b tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:14:16.490598 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-eadf3323-59ff-45db-9db5-567b07d1c52b tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:14:16.494492 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-eadf3323-59ff-45db-9db5-567b07d1c52b tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6" status: 200 len: 1407 microversion: 2.20 time: 1.406753 Sep 14 09:14:16.501566 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2541/5056] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:14:15 2022] GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6 => generated 1407 bytes in 1415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:14:17.530005 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=6 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:14:17.537677 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-746b77a3-fbe5-4f46-9c03-2cb8b1ea1d4e tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:14:17.538638 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-746b77a3-fbe5-4f46-9c03-2cb8b1ea1d4e tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 50157c1b-c748-4d1f-928e-207482b37ec6] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:14:17.558242 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-746b77a3-fbe5-4f46-9c03-2cb8b1ea1d4e tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:17.562928 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-746b77a3-fbe5-4f46-9c03-2cb8b1ea1d4e tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:17.566473 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-746b77a3-fbe5-4f46-9c03-2cb8b1ea1d4e tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:17.569432 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-746b77a3-fbe5-4f46-9c03-2cb8b1ea1d4e tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:17.570899 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-746b77a3-fbe5-4f46-9c03-2cb8b1ea1d4e tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:17.572434 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-746b77a3-fbe5-4f46-9c03-2cb8b1ea1d4e tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:17.983708 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-746b77a3-fbe5-4f46-9c03-2cb8b1ea1d4e tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:14:17.997850 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-746b77a3-fbe5-4f46-9c03-2cb8b1ea1d4e tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:14:18.001977 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-746b77a3-fbe5-4f46-9c03-2cb8b1ea1d4e tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:14:18.006668 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-746b77a3-fbe5-4f46-9c03-2cb8b1ea1d4e tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6" status: 200 len: 1407 microversion: 2.20 time: 0.475560 Sep 14 09:14:18.008001 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2516/5057] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:14:17 2022] GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6 => generated 1407 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:14:18.768382 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-217f2a76-084b-4f02-9e91-084808cdb031 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:14:18.770362 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-217f2a76-084b-4f02-9e91-084808cdb031 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:14:18.780345 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=2 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:14:18.783799 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=8 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:14:18.786193 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-217f2a76-084b-4f02-9e91-084808cdb031 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:18.792579 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-217f2a76-084b-4f02-9e91-084808cdb031 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:18.794123 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-217f2a76-084b-4f02-9e91-084808cdb031 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:18.796988 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-217f2a76-084b-4f02-9e91-084808cdb031 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:18.802567 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-217f2a76-084b-4f02-9e91-084808cdb031 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:18.804368 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-217f2a76-084b-4f02-9e91-084808cdb031 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:19.035276 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9dc69ced-fc9e-45e0-8070-c9070109c855 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:14:19.036563 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-9dc69ced-fc9e-45e0-8070-c9070109c855 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 50157c1b-c748-4d1f-928e-207482b37ec6] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:14:19.046336 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:14:19.064720 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9dc69ced-fc9e-45e0-8070-c9070109c855 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:19.067889 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9dc69ced-fc9e-45e0-8070-c9070109c855 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:19.068990 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9dc69ced-fc9e-45e0-8070-c9070109c855 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:19.070009 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9dc69ced-fc9e-45e0-8070-c9070109c855 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:19.071548 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9dc69ced-fc9e-45e0-8070-c9070109c855 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:19.075247 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9dc69ced-fc9e-45e0-8070-c9070109c855 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:19.184012 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-217f2a76-084b-4f02-9e91-084808cdb031 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:14:19.215226 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-217f2a76-084b-4f02-9e91-084808cdb031 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105" status: 200 len: 1668 microversion: 2.1 time: 0.450846 Sep 14 09:14:19.224781 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2542/5058] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:14:18 2022] GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105 => generated 1668 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:14:19.285988 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-9c59f0f9-b67f-468f-bcb5-48c6b8cba40b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:14:19.285988 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-9c59f0f9-b67f-468f-bcb5-48c6b8cba40b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:14:19.285988 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9c59f0f9-b67f-468f-bcb5-48c6b8cba40b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:19.285988 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9c59f0f9-b67f-468f-bcb5-48c6b8cba40b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:19.285988 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9c59f0f9-b67f-468f-bcb5-48c6b8cba40b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:19.285988 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9c59f0f9-b67f-468f-bcb5-48c6b8cba40b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:19.285988 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9c59f0f9-b67f-468f-bcb5-48c6b8cba40b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:19.285988 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9c59f0f9-b67f-468f-bcb5-48c6b8cba40b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:19.586415 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-9c59f0f9-b67f-468f-bcb5-48c6b8cba40b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:14:19.599598 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-9c59f0f9-b67f-468f-bcb5-48c6b8cba40b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105" status: 200 len: 1668 microversion: 2.1 time: 0.350639 Sep 14 09:14:19.616573 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2543/5059] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:14:19 2022] GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105 => generated 1668 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:14:19.630584 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-70de7b79-b2b0-4a3a-b70e-f0f94d8d4d3c tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:14:19.633253 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-70de7b79-b2b0-4a3a-b70e-f0f94d8d4d3c tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:14:19.646928 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-9dc69ced-fc9e-45e0-8070-c9070109c855 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:14:19.658664 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-9dc69ced-fc9e-45e0-8070-c9070109c855 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:14:19.660871 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-9dc69ced-fc9e-45e0-8070-c9070109c855 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:14:19.662522 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-70de7b79-b2b0-4a3a-b70e-f0f94d8d4d3c tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:19.666609 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-70de7b79-b2b0-4a3a-b70e-f0f94d8d4d3c tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:19.668726 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-9dc69ced-fc9e-45e0-8070-c9070109c855 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6" status: 200 len: 1407 microversion: 2.20 time: 0.637595 Sep 14 09:14:19.669396 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-70de7b79-b2b0-4a3a-b70e-f0f94d8d4d3c tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:19.671343 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-70de7b79-b2b0-4a3a-b70e-f0f94d8d4d3c tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:19.673131 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2517/5060] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:14:19 2022] GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6 => generated 1407 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 09:14:19.673495 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-70de7b79-b2b0-4a3a-b70e-f0f94d8d4d3c tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:19.674146 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-70de7b79-b2b0-4a3a-b70e-f0f94d8d4d3c tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:19.679520 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:14:20.071533 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-70de7b79-b2b0-4a3a-b70e-f0f94d8d4d3c tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:14:20.096477 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-70de7b79-b2b0-4a3a-b70e-f0f94d8d4d3c tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105" status: 200 len: 1668 microversion: 2.1 time: 0.470341 Sep 14 09:14:20.100455 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2544/5061] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:14:19 2022] GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105 => generated 1668 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:14:20.121640 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-4407167e-d043-4b97-81fb-38b795b4e151 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:14:20.123171 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-4407167e-d043-4b97-81fb-38b795b4e151 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:14:20.136444 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4407167e-d043-4b97-81fb-38b795b4e151 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:20.137388 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4407167e-d043-4b97-81fb-38b795b4e151 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:20.138077 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4407167e-d043-4b97-81fb-38b795b4e151 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:20.139781 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4407167e-d043-4b97-81fb-38b795b4e151 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:20.143049 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4407167e-d043-4b97-81fb-38b795b4e151 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:20.143823 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4407167e-d043-4b97-81fb-38b795b4e151 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:20.705850 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-5c6d28b8-12d4-44da-9731-d4e86ea1e7b3 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:14:20.706475 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-5c6d28b8-12d4-44da-9731-d4e86ea1e7b3 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 50157c1b-c748-4d1f-928e-207482b37ec6] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:14:20.714515 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5c6d28b8-12d4-44da-9731-d4e86ea1e7b3 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:20.714924 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5c6d28b8-12d4-44da-9731-d4e86ea1e7b3 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:20.715406 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5c6d28b8-12d4-44da-9731-d4e86ea1e7b3 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:20.716096 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5c6d28b8-12d4-44da-9731-d4e86ea1e7b3 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:20.733607 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5c6d28b8-12d4-44da-9731-d4e86ea1e7b3 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:20.736200 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5c6d28b8-12d4-44da-9731-d4e86ea1e7b3 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:20.794613 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-4407167e-d043-4b97-81fb-38b795b4e151 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:14:20.809846 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-4407167e-d043-4b97-81fb-38b795b4e151 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105" status: 200 len: 1668 microversion: 2.1 time: 0.685996 Sep 14 09:14:20.824965 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2518/5062] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:14:20 2022] GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105 => generated 1668 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:14:21.379026 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c3b6d039-e885-47af-9e68-0b1b5a2006a6 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-976372044", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "networks": [{"uuid": "63df5062-0947-41ef-8d8c-a8d82a21791b"}]}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:14:21.507748 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.network.neutron [None req-c3b6d039-e885-47af-9e68-0b1b5a2006a6 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] validate_networks() for [('63df5062-0947-41ef-8d8c-a8d82a21791b', None, None, None, None, None)] {{(pid=128759) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:14:21.949391 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-5c6d28b8-12d4-44da-9731-d4e86ea1e7b3 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:14:22.020612 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-5c6d28b8-12d4-44da-9731-d4e86ea1e7b3 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:14:22.040435 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-5c6d28b8-12d4-44da-9731-d4e86ea1e7b3 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:14:22.042709 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-5c6d28b8-12d4-44da-9731-d4e86ea1e7b3 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6" status: 200 len: 1407 microversion: 2.20 time: 1.340817 Sep 14 09:14:22.044345 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2545/5063] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:14:20 2022] GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6 => generated 1407 bytes in 1343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:14:22.409697 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-05c8bba2-397c-4db3-b319-c8537ad0ad0a req-63edb414-d9f6-4ffc-ad71-eff1eb8dfaf6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50157c1b-c748-4d1f-928e-207482b37ec6", "name": "network-vif-plugged", "status": "completed", "tag": "6bb7c82b-6dea-4020-abff-f1c92580e9d8"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:14:22.427030 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-05c8bba2-397c-4db3-b319-c8537ad0ad0a req-63edb414-d9f6-4ffc-ad71-eff1eb8dfaf6 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:22.428382 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-05c8bba2-397c-4db3-b319-c8537ad0ad0a req-63edb414-d9f6-4ffc-ad71-eff1eb8dfaf6 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:22.429089 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-05c8bba2-397c-4db3-b319-c8537ad0ad0a req-63edb414-d9f6-4ffc-ad71-eff1eb8dfaf6 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:22.444732 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-05c8bba2-397c-4db3-b319-c8537ad0ad0a req-63edb414-d9f6-4ffc-ad71-eff1eb8dfaf6 service nova] Creating event network-vif-plugged:6bb7c82b-6dea-4020-abff-f1c92580e9d8 for instance 50157c1b-c748-4d1f-928e-207482b37ec6 on n-h2-836830-18 Sep 14 09:14:22.452745 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-05c8bba2-397c-4db3-b319-c8537ad0ad0a req-63edb414-d9f6-4ffc-ad71-eff1eb8dfaf6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.402042 Sep 14 09:14:22.453726 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2546/5064] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:14:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:14:23.077561 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-39c9e492-e05b-4f89-8372-ef716b5b3042 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:14:23.078217 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-39c9e492-e05b-4f89-8372-ef716b5b3042 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 50157c1b-c748-4d1f-928e-207482b37ec6] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:14:23.098714 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-39c9e492-e05b-4f89-8372-ef716b5b3042 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:23.102246 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-39c9e492-e05b-4f89-8372-ef716b5b3042 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:23.111429 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-39c9e492-e05b-4f89-8372-ef716b5b3042 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:23.112314 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-39c9e492-e05b-4f89-8372-ef716b5b3042 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:23.114697 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-39c9e492-e05b-4f89-8372-ef716b5b3042 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:23.118184 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-39c9e492-e05b-4f89-8372-ef716b5b3042 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:23.629858 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-39c9e492-e05b-4f89-8372-ef716b5b3042 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:14:23.649804 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-39c9e492-e05b-4f89-8372-ef716b5b3042 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:14:23.659476 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-39c9e492-e05b-4f89-8372-ef716b5b3042 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:14:23.672519 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-39c9e492-e05b-4f89-8372-ef716b5b3042 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6" status: 200 len: 1407 microversion: 2.20 time: 0.588878 Sep 14 09:14:23.676619 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2547/5065] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:14:23 2022] GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6 => generated 1407 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:14:23.864078 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-c3b6d039-e885-47af-9e68-0b1b5a2006a6 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Flavor limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:14:23.865750 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-c3b6d039-e885-47af-9e68-0b1b5a2006a6 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Image limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:14:23.866619 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-c3b6d039-e885-47af-9e68-0b1b5a2006a6 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Flavor pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:14:23.867504 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-c3b6d039-e885-47af-9e68-0b1b5a2006a6 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Image pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:14:23.868485 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-c3b6d039-e885-47af-9e68-0b1b5a2006a6 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:14:23.904390 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c3b6d039-e885-47af-9e68-0b1b5a2006a6 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:23.907101 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c3b6d039-e885-47af-9e68-0b1b5a2006a6 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:23.913492 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c3b6d039-e885-47af-9e68-0b1b5a2006a6 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:23.918149 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c3b6d039-e885-47af-9e68-0b1b5a2006a6 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:23.923109 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c3b6d039-e885-47af-9e68-0b1b5a2006a6 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:23.927410 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c3b6d039-e885-47af-9e68-0b1b5a2006a6 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:24.045526 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-c3b6d039-e885-47af-9e68-0b1b5a2006a6 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Getting quotas for project 2f075a2c6aa4489abb3428e0a4ac5738. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:14:24.079798 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-c3b6d039-e885-47af-9e68-0b1b5a2006a6 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Getting quotas for user 950da33830ae4ae1a5511dd146e4e3be and project 2f075a2c6aa4489abb3428e0a4ac5738. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:14:24.141726 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-c3b6d039-e885-47af-9e68-0b1b5a2006a6 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Going to run 1 instances... {{(pid=128759) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:14:24.149825 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-c3b6d039-e885-47af-9e68-0b1b5a2006a6 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 907157a9-afff-4acb-98b7-b07b9c055ab1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128759) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:14:24.313983 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-c3b6d039-e885-47af-9e68-0b1b5a2006a6 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.938753 Sep 14 09:14:24.315066 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2519/5066] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 09:14:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 2941 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:14:24.334242 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1f7197bd-2aee-43a8-a595-9547fdcdef9f tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:14:24.334844 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-1f7197bd-2aee-43a8-a595-9547fdcdef9f tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 907157a9-afff-4acb-98b7-b07b9c055ab1] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:14:24.416654 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-1f7197bd-2aee-43a8-a595-9547fdcdef9f tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:14:24.425963 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-1f7197bd-2aee-43a8-a595-9547fdcdef9f tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/907157a9-afff-4acb-98b7-b07b9c055ab1" status: 200 len: 1214 microversion: 2.1 time: 0.094961 Sep 14 09:14:24.429406 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2548/5067] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:14:24 2022] GET /compute/v2.1/servers/907157a9-afff-4acb-98b7-b07b9c055ab1 => generated 1214 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:14:24.716177 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-eb7a1814-7a0e-4ea6-818a-84f9c3f58d84 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:14:24.719543 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-eb7a1814-7a0e-4ea6-818a-84f9c3f58d84 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 50157c1b-c748-4d1f-928e-207482b37ec6] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:14:24.731145 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-eb7a1814-7a0e-4ea6-818a-84f9c3f58d84 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:24.732394 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-eb7a1814-7a0e-4ea6-818a-84f9c3f58d84 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:24.733398 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-eb7a1814-7a0e-4ea6-818a-84f9c3f58d84 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:24.734556 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-eb7a1814-7a0e-4ea6-818a-84f9c3f58d84 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:24.736191 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-eb7a1814-7a0e-4ea6-818a-84f9c3f58d84 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:24.736913 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-eb7a1814-7a0e-4ea6-818a-84f9c3f58d84 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:25.452757 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-eb7a1814-7a0e-4ea6-818a-84f9c3f58d84 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:14:25.455856 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=91 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:14:25.466732 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-eb7a1814-7a0e-4ea6-818a-84f9c3f58d84 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:14:25.468321 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c8ff1f08-91ac-4ecf-a8c5-462b57ff8774 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:14:25.470684 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-c8ff1f08-91ac-4ecf-a8c5-462b57ff8774 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 907157a9-afff-4acb-98b7-b07b9c055ab1] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:14:25.474886 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-eb7a1814-7a0e-4ea6-818a-84f9c3f58d84 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:14:25.483894 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-eb7a1814-7a0e-4ea6-818a-84f9c3f58d84 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6" status: 200 len: 1598 microversion: 2.20 time: 0.783719 Sep 14 09:14:25.484891 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2520/5068] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:14:24 2022] GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6 => generated 1598 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:14:25.521591 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-95c89e6d-46ff-4de2-8592-205283bf0f2c tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:14:25.522288 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c8ff1f08-91ac-4ecf-a8c5-462b57ff8774 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:25.522853 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-95c89e6d-46ff-4de2-8592-205283bf0f2c tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 50157c1b-c748-4d1f-928e-207482b37ec6] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:14:25.524233 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c8ff1f08-91ac-4ecf-a8c5-462b57ff8774 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:25.525367 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c8ff1f08-91ac-4ecf-a8c5-462b57ff8774 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:25.534971 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c8ff1f08-91ac-4ecf-a8c5-462b57ff8774 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:25.535591 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c8ff1f08-91ac-4ecf-a8c5-462b57ff8774 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:25.537312 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c8ff1f08-91ac-4ecf-a8c5-462b57ff8774 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:25.539219 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-95c89e6d-46ff-4de2-8592-205283bf0f2c tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:25.543262 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-95c89e6d-46ff-4de2-8592-205283bf0f2c tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:25.545086 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-95c89e6d-46ff-4de2-8592-205283bf0f2c tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:25.548338 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-95c89e6d-46ff-4de2-8592-205283bf0f2c tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:25.550439 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-95c89e6d-46ff-4de2-8592-205283bf0f2c tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:25.552545 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-95c89e6d-46ff-4de2-8592-205283bf0f2c tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:26.014432 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-c8ff1f08-91ac-4ecf-a8c5-462b57ff8774 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:14:26.028690 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-c8ff1f08-91ac-4ecf-a8c5-462b57ff8774 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/907157a9-afff-4acb-98b7-b07b9c055ab1" status: 200 len: 1210 microversion: 2.1 time: 0.581274 Sep 14 09:14:26.029454 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2549/5069] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:14:25 2022] GET /compute/v2.1/servers/907157a9-afff-4acb-98b7-b07b9c055ab1 => generated 1210 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:14:26.071432 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-95c89e6d-46ff-4de2-8592-205283bf0f2c tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.559597 Sep 14 09:14:26.085220 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2521/5070] 10.222.0.60 () {60 vars in 1316 bytes} [Wed Sep 14 09:14:25 2022] GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6/os-interface => generated 284 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 14 09:14:27.052773 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-06947b12-1e4d-456f-8f98-3efea4dd1968 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:14:27.053391 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-06947b12-1e4d-456f-8f98-3efea4dd1968 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 907157a9-afff-4acb-98b7-b07b9c055ab1] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:14:27.070657 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-06947b12-1e4d-456f-8f98-3efea4dd1968 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:27.073889 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-06947b12-1e4d-456f-8f98-3efea4dd1968 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:27.074892 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-06947b12-1e4d-456f-8f98-3efea4dd1968 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:27.077812 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-06947b12-1e4d-456f-8f98-3efea4dd1968 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:27.078544 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-06947b12-1e4d-456f-8f98-3efea4dd1968 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:27.079912 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-06947b12-1e4d-456f-8f98-3efea4dd1968 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:27.277293 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-06947b12-1e4d-456f-8f98-3efea4dd1968 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:14:27.291448 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-06947b12-1e4d-456f-8f98-3efea4dd1968 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/907157a9-afff-4acb-98b7-b07b9c055ab1" status: 200 len: 1272 microversion: 2.1 time: 0.243162 Sep 14 09:14:27.293561 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2550/5071] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:14:27 2022] GET /compute/v2.1/servers/907157a9-afff-4acb-98b7-b07b9c055ab1 => generated 1272 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:14:28.318082 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-34a72f75-2d06-42db-a82d-68dbc8a535eb tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:14:28.319001 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-34a72f75-2d06-42db-a82d-68dbc8a535eb tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 907157a9-afff-4acb-98b7-b07b9c055ab1] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:14:28.333885 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-34a72f75-2d06-42db-a82d-68dbc8a535eb tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:28.340604 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-34a72f75-2d06-42db-a82d-68dbc8a535eb tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:28.341362 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-34a72f75-2d06-42db-a82d-68dbc8a535eb tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:28.344112 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-34a72f75-2d06-42db-a82d-68dbc8a535eb tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:28.346891 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-34a72f75-2d06-42db-a82d-68dbc8a535eb tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:28.348649 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-34a72f75-2d06-42db-a82d-68dbc8a535eb tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:28.466275 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-34a72f75-2d06-42db-a82d-68dbc8a535eb tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:14:28.480140 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-34a72f75-2d06-42db-a82d-68dbc8a535eb tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/907157a9-afff-4acb-98b7-b07b9c055ab1" status: 200 len: 1272 microversion: 2.1 time: 0.163512 Sep 14 09:14:28.481980 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2522/5072] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:14:28 2022] GET /compute/v2.1/servers/907157a9-afff-4acb-98b7-b07b9c055ab1 => generated 1272 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:14:29.507749 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-93d736d7-2b94-4f44-a289-c8af0c61ae19 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:14:29.508380 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-93d736d7-2b94-4f44-a289-c8af0c61ae19 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 907157a9-afff-4acb-98b7-b07b9c055ab1] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:14:29.542884 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-93d736d7-2b94-4f44-a289-c8af0c61ae19 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:29.543701 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-93d736d7-2b94-4f44-a289-c8af0c61ae19 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:29.544326 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-93d736d7-2b94-4f44-a289-c8af0c61ae19 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:29.545278 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-93d736d7-2b94-4f44-a289-c8af0c61ae19 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:29.548167 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-93d736d7-2b94-4f44-a289-c8af0c61ae19 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:29.548954 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-93d736d7-2b94-4f44-a289-c8af0c61ae19 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:29.825404 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-93d736d7-2b94-4f44-a289-c8af0c61ae19 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:14:29.837341 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-93d736d7-2b94-4f44-a289-c8af0c61ae19 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/907157a9-afff-4acb-98b7-b07b9c055ab1" status: 200 len: 1272 microversion: 2.1 time: 0.333484 Sep 14 09:14:29.840896 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2551/5073] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:14:29 2022] GET /compute/v2.1/servers/907157a9-afff-4acb-98b7-b07b9c055ab1 => generated 1272 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:14:30.579131 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-8e4e6f72-4a64-4e90-b8be-84645679c281 req-7909adc8-98a2-4bbc-a034-1b259350a6cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50157c1b-c748-4d1f-928e-207482b37ec6", "tag": "6bb7c82b-6dea-4020-abff-f1c92580e9d8"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:14:30.603485 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-8e4e6f72-4a64-4e90-b8be-84645679c281 req-7909adc8-98a2-4bbc-a034-1b259350a6cf service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:30.609247 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-8e4e6f72-4a64-4e90-b8be-84645679c281 req-7909adc8-98a2-4bbc-a034-1b259350a6cf service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:30.610634 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-8e4e6f72-4a64-4e90-b8be-84645679c281 req-7909adc8-98a2-4bbc-a034-1b259350a6cf service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:30.662114 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-8e4e6f72-4a64-4e90-b8be-84645679c281 req-7909adc8-98a2-4bbc-a034-1b259350a6cf service nova] Creating event network-changed:6bb7c82b-6dea-4020-abff-f1c92580e9d8 for instance 50157c1b-c748-4d1f-928e-207482b37ec6 on n-h2-836830-18 Sep 14 09:14:30.684885 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-8e4e6f72-4a64-4e90-b8be-84645679c281 req-7909adc8-98a2-4bbc-a034-1b259350a6cf service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110385 Sep 14 09:14:30.695991 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2523/5074] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:14:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:14:30.867728 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-f99bd496-ffa0-4dd8-b8e6-fc41c09d4597 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:14:30.868352 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-f99bd496-ffa0-4dd8-b8e6-fc41c09d4597 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 907157a9-afff-4acb-98b7-b07b9c055ab1] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:14:30.881608 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f99bd496-ffa0-4dd8-b8e6-fc41c09d4597 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:30.882108 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f99bd496-ffa0-4dd8-b8e6-fc41c09d4597 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:30.882549 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f99bd496-ffa0-4dd8-b8e6-fc41c09d4597 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:30.883298 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f99bd496-ffa0-4dd8-b8e6-fc41c09d4597 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:30.883757 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f99bd496-ffa0-4dd8-b8e6-fc41c09d4597 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:30.884183 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f99bd496-ffa0-4dd8-b8e6-fc41c09d4597 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:31.493566 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-f99bd496-ffa0-4dd8-b8e6-fc41c09d4597 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:14:31.504000 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-f99bd496-ffa0-4dd8-b8e6-fc41c09d4597 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/907157a9-afff-4acb-98b7-b07b9c055ab1" status: 200 len: 1314 microversion: 2.1 time: 0.640612 Sep 14 09:14:31.504610 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2552/5075] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:14:30 2022] GET /compute/v2.1/servers/907157a9-afff-4acb-98b7-b07b9c055ab1 => generated 1314 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:14:32.530897 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b40c5617-0a9c-4d9b-89e9-202c66e647cc tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:14:32.532321 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b40c5617-0a9c-4d9b-89e9-202c66e647cc tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 907157a9-afff-4acb-98b7-b07b9c055ab1] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:14:32.550671 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b40c5617-0a9c-4d9b-89e9-202c66e647cc tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:32.551518 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b40c5617-0a9c-4d9b-89e9-202c66e647cc tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:32.552156 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b40c5617-0a9c-4d9b-89e9-202c66e647cc tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:32.554806 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b40c5617-0a9c-4d9b-89e9-202c66e647cc tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:32.555543 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b40c5617-0a9c-4d9b-89e9-202c66e647cc tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:32.563610 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b40c5617-0a9c-4d9b-89e9-202c66e647cc tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:33.042645 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b40c5617-0a9c-4d9b-89e9-202c66e647cc tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:14:33.052785 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b40c5617-0a9c-4d9b-89e9-202c66e647cc tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/907157a9-afff-4acb-98b7-b07b9c055ab1" status: 200 len: 1314 microversion: 2.1 time: 0.526357 Sep 14 09:14:33.072406 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2524/5076] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:14:32 2022] GET /compute/v2.1/servers/907157a9-afff-4acb-98b7-b07b9c055ab1 => generated 1314 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:14:33.615593 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-97757944-1c6e-418c-b795-2c8225322efc tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-318845299", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:14:33.799994 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.network.neutron [None req-97757944-1c6e-418c-b795-2c8225322efc tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] validate_networks() for [('c6de249d-bd37-4bcc-8666-b0c831cedfe7', None, None, None, None, None)] {{(pid=128758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:14:34.080336 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-5a4070e0-5c7b-47cf-90f1-f1009faf8654 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:14:34.081683 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-5a4070e0-5c7b-47cf-90f1-f1009faf8654 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 907157a9-afff-4acb-98b7-b07b9c055ab1] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:14:34.092828 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=2 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:14:34.094492 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5a4070e0-5c7b-47cf-90f1-f1009faf8654 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:34.095017 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5a4070e0-5c7b-47cf-90f1-f1009faf8654 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:34.095463 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5a4070e0-5c7b-47cf-90f1-f1009faf8654 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:34.096180 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5a4070e0-5c7b-47cf-90f1-f1009faf8654 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:34.117051 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5a4070e0-5c7b-47cf-90f1-f1009faf8654 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:34.119633 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5a4070e0-5c7b-47cf-90f1-f1009faf8654 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:34.121334 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=6 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:14:34.421766 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=2 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:14:35.210578 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-5a4070e0-5c7b-47cf-90f1-f1009faf8654 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:14:35.227211 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-5a4070e0-5c7b-47cf-90f1-f1009faf8654 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/907157a9-afff-4acb-98b7-b07b9c055ab1" status: 200 len: 1314 microversion: 2.1 time: 1.150615 Sep 14 09:14:35.247424 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2525/5077] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:14:34 2022] GET /compute/v2.1/servers/907157a9-afff-4acb-98b7-b07b9c055ab1 => generated 1314 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:14:35.269036 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-1b0ea946-b8a9-4b88-aa89-df47f6d117da req-98762183-02db-4daf-bc7a-3a901b557d49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "907157a9-afff-4acb-98b7-b07b9c055ab1", "tag": "d50c4b90-8c94-4358-9585-2daa4f7e7d1d"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:14:35.319237 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-1b0ea946-b8a9-4b88-aa89-df47f6d117da req-98762183-02db-4daf-bc7a-3a901b557d49 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:35.324074 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-1b0ea946-b8a9-4b88-aa89-df47f6d117da req-98762183-02db-4daf-bc7a-3a901b557d49 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:35.324763 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-1b0ea946-b8a9-4b88-aa89-df47f6d117da req-98762183-02db-4daf-bc7a-3a901b557d49 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:35.370561 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-1b0ea946-b8a9-4b88-aa89-df47f6d117da req-98762183-02db-4daf-bc7a-3a901b557d49 service nova] Creating event network-changed:d50c4b90-8c94-4358-9585-2daa4f7e7d1d for instance 907157a9-afff-4acb-98b7-b07b9c055ab1 on n-h2-836830-18 Sep 14 09:14:35.394078 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-1b0ea946-b8a9-4b88-aa89-df47f6d117da req-98762183-02db-4daf-bc7a-3a901b557d49 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.143305 Sep 14 09:14:35.395002 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2526/5078] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:14:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:14:36.258385 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-6eeb2fcd-7213-45da-bd87-813136769d46 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:14:36.259181 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-6eeb2fcd-7213-45da-bd87-813136769d46 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 907157a9-afff-4acb-98b7-b07b9c055ab1] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:14:36.269087 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6eeb2fcd-7213-45da-bd87-813136769d46 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:36.272572 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6eeb2fcd-7213-45da-bd87-813136769d46 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:36.273740 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6eeb2fcd-7213-45da-bd87-813136769d46 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:36.274481 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6eeb2fcd-7213-45da-bd87-813136769d46 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:36.274968 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6eeb2fcd-7213-45da-bd87-813136769d46 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:36.277584 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6eeb2fcd-7213-45da-bd87-813136769d46 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:36.649904 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-97757944-1c6e-418c-b795-2c8225322efc tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Flavor limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:14:36.651701 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-97757944-1c6e-418c-b795-2c8225322efc tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Image limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:14:36.652428 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-97757944-1c6e-418c-b795-2c8225322efc tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Flavor pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:14:36.653101 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-97757944-1c6e-418c-b795-2c8225322efc tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Image pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:14:36.653757 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-97757944-1c6e-418c-b795-2c8225322efc tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:14:36.701707 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-6eeb2fcd-7213-45da-bd87-813136769d46 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:14:36.703181 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-97757944-1c6e-418c-b795-2c8225322efc tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:36.705395 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-97757944-1c6e-418c-b795-2c8225322efc tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:36.705962 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-97757944-1c6e-418c-b795-2c8225322efc tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:36.708835 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-97757944-1c6e-418c-b795-2c8225322efc tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:36.709437 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-97757944-1c6e-418c-b795-2c8225322efc tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:36.710010 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-97757944-1c6e-418c-b795-2c8225322efc tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:36.712189 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-6eeb2fcd-7213-45da-bd87-813136769d46 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/907157a9-afff-4acb-98b7-b07b9c055ab1" status: 200 len: 1314 microversion: 2.1 time: 0.458163 Sep 14 09:14:36.753701 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-97757944-1c6e-418c-b795-2c8225322efc tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Getting quotas for project 24f2e13835b240578d411521ee520115. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:14:36.758284 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2527/5079] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:14:36 2022] GET /compute/v2.1/servers/907157a9-afff-4acb-98b7-b07b9c055ab1 => generated 1314 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:14:36.768951 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-97757944-1c6e-418c-b795-2c8225322efc tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Getting quotas for user bb33a017168c4a8bae36eacd9ba6a7ac and project 24f2e13835b240578d411521ee520115. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:14:36.799503 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-97757944-1c6e-418c-b795-2c8225322efc tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Going to run 1 instances... {{(pid=128758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:14:36.803455 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-97757944-1c6e-418c-b795-2c8225322efc tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] [instance: cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:14:36.903756 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-97757944-1c6e-418c-b795-2c8225322efc tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.962841 Sep 14 09:14:36.905826 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2553/5080] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 09:14:32 2022] POST /compute/v2.1/servers => generated 383 bytes in 3966 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 14 09:14:36.915924 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-5440f200-c254-4106-8051-87ea2a7ae844 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:14:36.916456 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-5440f200-c254-4106-8051-87ea2a7ae844 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] [instance: cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:14:37.043848 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-5440f200-c254-4106-8051-87ea2a7ae844 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb33a017168c4a8bae36eacd9ba6a7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24f2e13835b240578d411521ee520115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:14:37.065348 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-5440f200-c254-4106-8051-87ea2a7ae844 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] 10.222.0.60 "GET /compute/v2.1/servers/cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f" status: 200 len: 1213 microversion: 2.1 time: 0.143273 Sep 14 09:14:37.068531 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2528/5081] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:14:36 2022] GET /compute/v2.1/servers/cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f => generated 1213 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:14:37.755936 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a65c999a-f972-4fcb-989a-93b68a767cda tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:14:37.756571 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-a65c999a-f972-4fcb-989a-93b68a767cda tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 907157a9-afff-4acb-98b7-b07b9c055ab1] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:14:37.804476 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a65c999a-f972-4fcb-989a-93b68a767cda tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:37.809884 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a65c999a-f972-4fcb-989a-93b68a767cda tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:37.810480 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a65c999a-f972-4fcb-989a-93b68a767cda tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:37.816171 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a65c999a-f972-4fcb-989a-93b68a767cda tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:37.831174 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a65c999a-f972-4fcb-989a-93b68a767cda tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:37.831646 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a65c999a-f972-4fcb-989a-93b68a767cda tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:38.090474 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-0e11a715-a8f9-4bbe-b35a-feb050bc1da7 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:14:38.091141 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-0e11a715-a8f9-4bbe-b35a-feb050bc1da7 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] [instance: cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:14:38.100403 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0e11a715-a8f9-4bbe-b35a-feb050bc1da7 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:38.109436 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0e11a715-a8f9-4bbe-b35a-feb050bc1da7 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:38.110908 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0e11a715-a8f9-4bbe-b35a-feb050bc1da7 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:38.113523 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0e11a715-a8f9-4bbe-b35a-feb050bc1da7 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:38.114164 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0e11a715-a8f9-4bbe-b35a-feb050bc1da7 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:38.115826 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0e11a715-a8f9-4bbe-b35a-feb050bc1da7 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:38.372984 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-0e11a715-a8f9-4bbe-b35a-feb050bc1da7 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb33a017168c4a8bae36eacd9ba6a7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24f2e13835b240578d411521ee520115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:14:38.392370 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-0e11a715-a8f9-4bbe-b35a-feb050bc1da7 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] 10.222.0.60 "GET /compute/v2.1/servers/cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f" status: 200 len: 1209 microversion: 2.1 time: 0.306162 Sep 14 09:14:38.396429 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-a65c999a-f972-4fcb-989a-93b68a767cda tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:14:38.405757 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2529/5082] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:14:38 2022] GET /compute/v2.1/servers/cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f => generated 1209 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:14:38.411424 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-a65c999a-f972-4fcb-989a-93b68a767cda tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/907157a9-afff-4acb-98b7-b07b9c055ab1" status: 200 len: 1314 microversion: 2.1 time: 0.666952 Sep 14 09:14:38.416534 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2554/5083] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:14:37 2022] GET /compute/v2.1/servers/907157a9-afff-4acb-98b7-b07b9c055ab1 => generated 1314 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:14:38.701442 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-4361088d-912c-473f-a847-8d7f50202354 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:14:38.704112 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-4361088d-912c-473f-a847-8d7f50202354 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] [instance: d42a47fc-3124-4479-aff4-e2a5ba888729] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:14:38.728584 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4361088d-912c-473f-a847-8d7f50202354 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:38.731157 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4361088d-912c-473f-a847-8d7f50202354 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:38.731841 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4361088d-912c-473f-a847-8d7f50202354 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:38.733670 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4361088d-912c-473f-a847-8d7f50202354 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:38.735205 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4361088d-912c-473f-a847-8d7f50202354 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:38.736687 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4361088d-912c-473f-a847-8d7f50202354 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:38.881706 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-4361088d-912c-473f-a847-8d7f50202354 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] 10.222.0.60 "POST /compute/v2.1/servers/d42a47fc-3124-4479-aff4-e2a5ba888729/action" status: 200 len: 24574 microversion: 2.1 time: 0.184594 Sep 14 09:14:38.882370 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2530/5084] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:14:38 2022] POST /compute/v2.1/servers/d42a47fc-3124-4479-aff4-e2a5ba888729/action => generated 24574 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 14 09:14:39.429119 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-640fcdd2-0273-49bc-8dd8-04df2bb83595 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:14:39.429804 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-640fcdd2-0273-49bc-8dd8-04df2bb83595 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] [instance: cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:14:39.443134 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-62c7dd51-2130-4abe-b695-9290f0302f62 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:14:39.444777 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-62c7dd51-2130-4abe-b695-9290f0302f62 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 907157a9-afff-4acb-98b7-b07b9c055ab1] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:14:39.449988 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-640fcdd2-0273-49bc-8dd8-04df2bb83595 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:39.450594 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-640fcdd2-0273-49bc-8dd8-04df2bb83595 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:39.465630 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-640fcdd2-0273-49bc-8dd8-04df2bb83595 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:39.467132 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-62c7dd51-2130-4abe-b695-9290f0302f62 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:39.470351 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-640fcdd2-0273-49bc-8dd8-04df2bb83595 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:39.471734 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-62c7dd51-2130-4abe-b695-9290f0302f62 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:39.471898 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-640fcdd2-0273-49bc-8dd8-04df2bb83595 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:39.472256 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-640fcdd2-0273-49bc-8dd8-04df2bb83595 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:39.472747 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-62c7dd51-2130-4abe-b695-9290f0302f62 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:39.473874 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-62c7dd51-2130-4abe-b695-9290f0302f62 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:39.474534 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-62c7dd51-2130-4abe-b695-9290f0302f62 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:39.475899 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-62c7dd51-2130-4abe-b695-9290f0302f62 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:39.898135 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-640fcdd2-0273-49bc-8dd8-04df2bb83595 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb33a017168c4a8bae36eacd9ba6a7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24f2e13835b240578d411521ee520115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:14:39.914131 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-640fcdd2-0273-49bc-8dd8-04df2bb83595 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] 10.222.0.60 "GET /compute/v2.1/servers/cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f" status: 200 len: 1265 microversion: 2.1 time: 0.489130 Sep 14 09:14:39.915505 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2555/5085] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:14:39 2022] GET /compute/v2.1/servers/cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f => generated 1265 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:14:40.072191 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-62c7dd51-2130-4abe-b695-9290f0302f62 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:14:40.086456 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-62c7dd51-2130-4abe-b695-9290f0302f62 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/907157a9-afff-4acb-98b7-b07b9c055ab1" status: 200 len: 1314 microversion: 2.1 time: 0.648156 Sep 14 09:14:40.090180 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2531/5086] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:14:39 2022] GET /compute/v2.1/servers/907157a9-afff-4acb-98b7-b07b9c055ab1 => generated 1314 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:14:40.941667 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ef512240-cc90-4f65-bd5d-e4bc4711ec64 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:14:40.942538 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-ef512240-cc90-4f65-bd5d-e4bc4711ec64 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] [instance: cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:14:40.956442 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ef512240-cc90-4f65-bd5d-e4bc4711ec64 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:40.960450 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ef512240-cc90-4f65-bd5d-e4bc4711ec64 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:40.961038 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ef512240-cc90-4f65-bd5d-e4bc4711ec64 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:40.961912 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ef512240-cc90-4f65-bd5d-e4bc4711ec64 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:40.964608 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ef512240-cc90-4f65-bd5d-e4bc4711ec64 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:40.965199 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ef512240-cc90-4f65-bd5d-e4bc4711ec64 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:41.116092 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-77be9387-479c-4f76-aeea-523b207fbb00 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:14:41.116723 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-77be9387-479c-4f76-aeea-523b207fbb00 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 907157a9-afff-4acb-98b7-b07b9c055ab1] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:14:41.143633 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-77be9387-479c-4f76-aeea-523b207fbb00 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:41.144148 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-77be9387-479c-4f76-aeea-523b207fbb00 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:41.147182 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-77be9387-479c-4f76-aeea-523b207fbb00 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:41.148014 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-77be9387-479c-4f76-aeea-523b207fbb00 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:41.148483 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-77be9387-479c-4f76-aeea-523b207fbb00 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:41.148918 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-77be9387-479c-4f76-aeea-523b207fbb00 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:41.190370 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-ef512240-cc90-4f65-bd5d-e4bc4711ec64 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb33a017168c4a8bae36eacd9ba6a7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24f2e13835b240578d411521ee520115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:14:41.200122 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-ef512240-cc90-4f65-bd5d-e4bc4711ec64 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] 10.222.0.60 "GET /compute/v2.1/servers/cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f" status: 200 len: 1271 microversion: 2.1 time: 0.262300 Sep 14 09:14:41.205459 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2556/5087] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:14:40 2022] GET /compute/v2.1/servers/cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f => generated 1271 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:14:41.487415 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-77be9387-479c-4f76-aeea-523b207fbb00 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:14:41.496986 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-77be9387-479c-4f76-aeea-523b207fbb00 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/907157a9-afff-4acb-98b7-b07b9c055ab1" status: 200 len: 1314 microversion: 2.1 time: 0.386030 Sep 14 09:14:41.504822 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2532/5088] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:14:41 2022] GET /compute/v2.1/servers/907157a9-afff-4acb-98b7-b07b9c055ab1 => generated 1314 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:14:41.852539 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-f2a15a3a-9006-40d3-8253-07d339c7f3e1 req-f4e6471e-3e0c-4435-84a9-5e3e8e01ff97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "907157a9-afff-4acb-98b7-b07b9c055ab1", "name": "network-vif-plugged", "status": "completed", "tag": "d50c4b90-8c94-4358-9585-2daa4f7e7d1d"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:14:41.872860 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-f2a15a3a-9006-40d3-8253-07d339c7f3e1 req-f4e6471e-3e0c-4435-84a9-5e3e8e01ff97 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:41.873574 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-f2a15a3a-9006-40d3-8253-07d339c7f3e1 req-f4e6471e-3e0c-4435-84a9-5e3e8e01ff97 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:41.874026 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-f2a15a3a-9006-40d3-8253-07d339c7f3e1 req-f4e6471e-3e0c-4435-84a9-5e3e8e01ff97 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:41.899716 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-f2a15a3a-9006-40d3-8253-07d339c7f3e1 req-f4e6471e-3e0c-4435-84a9-5e3e8e01ff97 service nova] Creating event network-vif-plugged:d50c4b90-8c94-4358-9585-2daa4f7e7d1d for instance 907157a9-afff-4acb-98b7-b07b9c055ab1 on n-h2-836830-18 Sep 14 09:14:41.915326 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-f2a15a3a-9006-40d3-8253-07d339c7f3e1 req-f4e6471e-3e0c-4435-84a9-5e3e8e01ff97 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064197 Sep 14 09:14:41.919127 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2557/5089] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:14:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:14:42.234559 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-1dd60c3c-8196-4448-95f7-4c1a00c294ec tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:14:42.235816 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-1dd60c3c-8196-4448-95f7-4c1a00c294ec tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] [instance: cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:14:42.244278 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1dd60c3c-8196-4448-95f7-4c1a00c294ec tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:42.245803 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1dd60c3c-8196-4448-95f7-4c1a00c294ec tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:42.246445 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1dd60c3c-8196-4448-95f7-4c1a00c294ec tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:42.247393 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1dd60c3c-8196-4448-95f7-4c1a00c294ec tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:42.248025 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1dd60c3c-8196-4448-95f7-4c1a00c294ec tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:42.248620 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1dd60c3c-8196-4448-95f7-4c1a00c294ec tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:42.531796 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d003899e-0c41-41b0-b56f-75ecb5f0a7a3 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:14:42.533454 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-d003899e-0c41-41b0-b56f-75ecb5f0a7a3 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 907157a9-afff-4acb-98b7-b07b9c055ab1] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:14:42.566428 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d003899e-0c41-41b0-b56f-75ecb5f0a7a3 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:42.566969 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d003899e-0c41-41b0-b56f-75ecb5f0a7a3 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:42.567432 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d003899e-0c41-41b0-b56f-75ecb5f0a7a3 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:42.579609 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d003899e-0c41-41b0-b56f-75ecb5f0a7a3 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:42.582088 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d003899e-0c41-41b0-b56f-75ecb5f0a7a3 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:42.582770 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d003899e-0c41-41b0-b56f-75ecb5f0a7a3 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:42.966502 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-1dd60c3c-8196-4448-95f7-4c1a00c294ec tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb33a017168c4a8bae36eacd9ba6a7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24f2e13835b240578d411521ee520115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:14:42.980870 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-1dd60c3c-8196-4448-95f7-4c1a00c294ec tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] 10.222.0.60 "GET /compute/v2.1/servers/cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f" status: 200 len: 1313 microversion: 2.1 time: 0.752456 Sep 14 09:14:42.981469 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2533/5090] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:14:42 2022] GET /compute/v2.1/servers/cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f => generated 1313 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:14:43.207370 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-d003899e-0c41-41b0-b56f-75ecb5f0a7a3 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:14:43.215712 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-d003899e-0c41-41b0-b56f-75ecb5f0a7a3 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/907157a9-afff-4acb-98b7-b07b9c055ab1" status: 200 len: 1314 microversion: 2.1 time: 0.689710 Sep 14 09:14:43.227293 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2558/5091] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:14:42 2022] GET /compute/v2.1/servers/907157a9-afff-4acb-98b7-b07b9c055ab1 => generated 1314 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:14:44.016468 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-6a5f786a-57d5-4a0c-b4aa-2de4edda7133 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:14:44.018740 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-6a5f786a-57d5-4a0c-b4aa-2de4edda7133 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] [instance: cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:14:44.030849 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6a5f786a-57d5-4a0c-b4aa-2de4edda7133 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:44.039783 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6a5f786a-57d5-4a0c-b4aa-2de4edda7133 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:44.039783 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6a5f786a-57d5-4a0c-b4aa-2de4edda7133 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:44.041373 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6a5f786a-57d5-4a0c-b4aa-2de4edda7133 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:44.041373 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6a5f786a-57d5-4a0c-b4aa-2de4edda7133 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:44.041373 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6a5f786a-57d5-4a0c-b4aa-2de4edda7133 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:44.240318 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-13a2f552-6ffd-4bbf-bb38-4154e8bb10f0 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:14:44.241077 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-13a2f552-6ffd-4bbf-bb38-4154e8bb10f0 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 907157a9-afff-4acb-98b7-b07b9c055ab1] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:14:44.254871 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-13a2f552-6ffd-4bbf-bb38-4154e8bb10f0 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:44.276985 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-13a2f552-6ffd-4bbf-bb38-4154e8bb10f0 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:44.287731 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-13a2f552-6ffd-4bbf-bb38-4154e8bb10f0 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:44.296886 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-13a2f552-6ffd-4bbf-bb38-4154e8bb10f0 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:44.297523 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-13a2f552-6ffd-4bbf-bb38-4154e8bb10f0 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:44.298075 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-13a2f552-6ffd-4bbf-bb38-4154e8bb10f0 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:44.626476 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-6a5f786a-57d5-4a0c-b4aa-2de4edda7133 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb33a017168c4a8bae36eacd9ba6a7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24f2e13835b240578d411521ee520115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:14:44.642765 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-6a5f786a-57d5-4a0c-b4aa-2de4edda7133 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] 10.222.0.60 "GET /compute/v2.1/servers/cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f" status: 200 len: 1313 microversion: 2.1 time: 0.632041 Sep 14 09:14:44.667456 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2534/5092] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:14:44 2022] GET /compute/v2.1/servers/cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f => generated 1313 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:14:44.688736 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-3b0b7969-293f-4c36-9f44-1e334342b021 req-3927e8b0-62f8-471b-8755-d72dab5290bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f", "tag": "2344ca56-66c0-4a48-9202-1a4e7210fff4"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:14:44.713045 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-3b0b7969-293f-4c36-9f44-1e334342b021 req-3927e8b0-62f8-471b-8755-d72dab5290bd service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:44.719626 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-3b0b7969-293f-4c36-9f44-1e334342b021 req-3927e8b0-62f8-471b-8755-d72dab5290bd service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:44.720085 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-3b0b7969-293f-4c36-9f44-1e334342b021 req-3927e8b0-62f8-471b-8755-d72dab5290bd service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:44.743084 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-3b0b7969-293f-4c36-9f44-1e334342b021 req-3927e8b0-62f8-471b-8755-d72dab5290bd service nova] Creating event network-changed:2344ca56-66c0-4a48-9202-1a4e7210fff4 for instance cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f on n-h1-836830-18 Sep 14 09:14:44.766160 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-3b0b7969-293f-4c36-9f44-1e334342b021 req-3927e8b0-62f8-471b-8755-d72dab5290bd service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096890 Sep 14 09:14:44.768257 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2535/5093] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:14:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:14:44.803721 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-13a2f552-6ffd-4bbf-bb38-4154e8bb10f0 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:14:44.813184 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-13a2f552-6ffd-4bbf-bb38-4154e8bb10f0 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/907157a9-afff-4acb-98b7-b07b9c055ab1" status: 200 len: 1501 microversion: 2.1 time: 0.576875 Sep 14 09:14:44.820135 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2559/5094] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:14:44 2022] GET /compute/v2.1/servers/907157a9-afff-4acb-98b7-b07b9c055ab1 => generated 1501 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:14:44.852120 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8fdbb296-318f-415c-9368-1cd98cf76a78 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:14:44.852773 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-8fdbb296-318f-415c-9368-1cd98cf76a78 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 907157a9-afff-4acb-98b7-b07b9c055ab1] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:14:44.864216 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8fdbb296-318f-415c-9368-1cd98cf76a78 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:44.866486 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8fdbb296-318f-415c-9368-1cd98cf76a78 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:44.866964 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8fdbb296-318f-415c-9368-1cd98cf76a78 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:44.869071 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8fdbb296-318f-415c-9368-1cd98cf76a78 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:44.870102 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8fdbb296-318f-415c-9368-1cd98cf76a78 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:44.871455 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8fdbb296-318f-415c-9368-1cd98cf76a78 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:45.155651 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.network.security_group_api [None req-8fdbb296-318f-415c-9368-1cd98cf76a78 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Removing security group 6b23b7aa-dfcc-4e1c-8f81-5280d669a655 from port d50c4b90-8c94-4358-9585-2daa4f7e7d1d Sep 14 09:14:45.677256 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-59ad5eb8-c4c6-4fe0-a3dd-4a6f46e80950 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:14:45.677256 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-59ad5eb8-c4c6-4fe0-a3dd-4a6f46e80950 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] [instance: cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:14:45.685643 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:14:45.708395 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-59ad5eb8-c4c6-4fe0-a3dd-4a6f46e80950 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:45.715828 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-59ad5eb8-c4c6-4fe0-a3dd-4a6f46e80950 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:45.728670 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-59ad5eb8-c4c6-4fe0-a3dd-4a6f46e80950 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:45.730279 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-59ad5eb8-c4c6-4fe0-a3dd-4a6f46e80950 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:45.730779 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-59ad5eb8-c4c6-4fe0-a3dd-4a6f46e80950 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:45.731263 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-59ad5eb8-c4c6-4fe0-a3dd-4a6f46e80950 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:46.491939 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-59ad5eb8-c4c6-4fe0-a3dd-4a6f46e80950 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb33a017168c4a8bae36eacd9ba6a7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24f2e13835b240578d411521ee520115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:14:46.508215 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-59ad5eb8-c4c6-4fe0-a3dd-4a6f46e80950 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] 10.222.0.60 "GET /compute/v2.1/servers/cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f" status: 200 len: 1313 microversion: 2.1 time: 0.836692 Sep 14 09:14:46.527395 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2560/5095] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:14:45 2022] GET /compute/v2.1/servers/cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f => generated 1313 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:14:46.532813 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-8fdbb296-318f-415c-9368-1cd98cf76a78 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "POST /compute/v2.1/servers/907157a9-afff-4acb-98b7-b07b9c055ab1/action" status: 202 len: 0 microversion: 2.1 time: 1.685580 Sep 14 09:14:46.534618 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2536/5096] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:14:44 2022] POST /compute/v2.1/servers/907157a9-afff-4acb-98b7-b07b9c055ab1/action => generated 0 bytes in 1688 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 14 09:14:46.544690 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c41b606a-1352-49f2-b96b-5720524196eb tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:14:46.545323 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-c41b606a-1352-49f2-b96b-5720524196eb tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 907157a9-afff-4acb-98b7-b07b9c055ab1] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:14:46.566287 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c41b606a-1352-49f2-b96b-5720524196eb tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:46.566737 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c41b606a-1352-49f2-b96b-5720524196eb tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:46.581693 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c41b606a-1352-49f2-b96b-5720524196eb tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:46.584008 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c41b606a-1352-49f2-b96b-5720524196eb tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:46.584685 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c41b606a-1352-49f2-b96b-5720524196eb tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:46.586000 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c41b606a-1352-49f2-b96b-5720524196eb tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:46.738395 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=2 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:14:46.761110 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-c41b606a-1352-49f2-b96b-5720524196eb tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:14:46.775535 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-c41b606a-1352-49f2-b96b-5720524196eb tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/907157a9-afff-4acb-98b7-b07b9c055ab1" status: 200 len: 1459 microversion: 2.1 time: 0.231940 Sep 14 09:14:46.783719 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-ec80d098-cfc5-431c-b942-15d1ae8e3a53 req-1c3472d1-41e1-4778-b2bb-64eee66735a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "907157a9-afff-4acb-98b7-b07b9c055ab1", "tag": "d50c4b90-8c94-4358-9585-2daa4f7e7d1d"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:14:46.792245 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2561/5097] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:14:46 2022] GET /compute/v2.1/servers/907157a9-afff-4acb-98b7-b07b9c055ab1 => generated 1459 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:14:46.801036 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-8f2301db-4fef-4027-977f-14e38eb4ecb2 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:14:46.801829 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-ec80d098-cfc5-431c-b942-15d1ae8e3a53 req-1c3472d1-41e1-4778-b2bb-64eee66735a9 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:46.802414 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-8f2301db-4fef-4027-977f-14e38eb4ecb2 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:14:46.806355 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-ec80d098-cfc5-431c-b942-15d1ae8e3a53 req-1c3472d1-41e1-4778-b2bb-64eee66735a9 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:46.807585 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-ec80d098-cfc5-431c-b942-15d1ae8e3a53 req-1c3472d1-41e1-4778-b2bb-64eee66735a9 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:46.808847 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=6 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:14:46.810659 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8f2301db-4fef-4027-977f-14e38eb4ecb2 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:46.811839 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8f2301db-4fef-4027-977f-14e38eb4ecb2 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:46.812937 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8f2301db-4fef-4027-977f-14e38eb4ecb2 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:46.813845 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8f2301db-4fef-4027-977f-14e38eb4ecb2 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:46.815102 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8f2301db-4fef-4027-977f-14e38eb4ecb2 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:46.815709 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8f2301db-4fef-4027-977f-14e38eb4ecb2 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:46.829618 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-ec80d098-cfc5-431c-b942-15d1ae8e3a53 req-1c3472d1-41e1-4778-b2bb-64eee66735a9 service nova] Creating event network-changed:d50c4b90-8c94-4358-9585-2daa4f7e7d1d for instance 907157a9-afff-4acb-98b7-b07b9c055ab1 on n-h2-836830-18 Sep 14 09:14:46.848758 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-ec80d098-cfc5-431c-b942-15d1ae8e3a53 req-1c3472d1-41e1-4778-b2bb-64eee66735a9 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069025 Sep 14 09:14:46.852423 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2537/5098] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:14:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:14:47.115877 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-8f2301db-4fef-4027-977f-14e38eb4ecb2 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:14:47.125089 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-8f2301db-4fef-4027-977f-14e38eb4ecb2 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105" status: 200 len: 1668 microversion: 2.1 time: 0.328239 Sep 14 09:14:47.128997 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2562/5099] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:14:46 2022] GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105 => generated 1668 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:14:47.162678 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=2 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:14:47.169390 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-6758e7d2-b6b9-4aa2-ba5f-73336a34265b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:14:47.170509 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-6758e7d2-b6b9-4aa2-ba5f-73336a34265b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:14:47.179760 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6758e7d2-b6b9-4aa2-ba5f-73336a34265b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:47.180547 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6758e7d2-b6b9-4aa2-ba5f-73336a34265b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:47.181251 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6758e7d2-b6b9-4aa2-ba5f-73336a34265b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:47.182338 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6758e7d2-b6b9-4aa2-ba5f-73336a34265b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:47.183006 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6758e7d2-b6b9-4aa2-ba5f-73336a34265b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:47.183891 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6758e7d2-b6b9-4aa2-ba5f-73336a34265b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:47.378032 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-6758e7d2-b6b9-4aa2-ba5f-73336a34265b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:14:47.389667 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-6758e7d2-b6b9-4aa2-ba5f-73336a34265b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105" status: 200 len: 1668 microversion: 2.1 time: 0.229131 Sep 14 09:14:47.407999 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2538/5100] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:14:47 2022] GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105 => generated 1668 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:14:47.456411 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-fb32ff4b-9c71-4f32-9ef1-62c1cf3fd5ca tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:14:47.456411 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-fb32ff4b-9c71-4f32-9ef1-62c1cf3fd5ca tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:14:47.456411 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fb32ff4b-9c71-4f32-9ef1-62c1cf3fd5ca tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:47.456411 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fb32ff4b-9c71-4f32-9ef1-62c1cf3fd5ca tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:47.456411 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fb32ff4b-9c71-4f32-9ef1-62c1cf3fd5ca tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:47.456411 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fb32ff4b-9c71-4f32-9ef1-62c1cf3fd5ca tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:47.456411 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fb32ff4b-9c71-4f32-9ef1-62c1cf3fd5ca tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:47.456411 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fb32ff4b-9c71-4f32-9ef1-62c1cf3fd5ca tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:47.535162 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-289991f6-6d98-4045-8783-e4dd34758aa2 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:14:47.536392 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-289991f6-6d98-4045-8783-e4dd34758aa2 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] [instance: cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:14:47.543348 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-289991f6-6d98-4045-8783-e4dd34758aa2 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:47.543999 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-289991f6-6d98-4045-8783-e4dd34758aa2 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:47.544568 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-289991f6-6d98-4045-8783-e4dd34758aa2 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:47.545383 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-289991f6-6d98-4045-8783-e4dd34758aa2 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:47.546097 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-289991f6-6d98-4045-8783-e4dd34758aa2 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:47.546632 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-289991f6-6d98-4045-8783-e4dd34758aa2 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:47.771111 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-fb32ff4b-9c71-4f32-9ef1-62c1cf3fd5ca tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:14:47.774159 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=100 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:14:47.784884 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-fb32ff4b-9c71-4f32-9ef1-62c1cf3fd5ca tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105" status: 200 len: 1668 microversion: 2.1 time: 0.370772 Sep 14 09:14:47.785642 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2563/5101] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:14:47 2022] GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105 => generated 1668 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:14:47.818047 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-cf44802e-0341-4925-8d1b-404cf84c8628 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:14:47.819800 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-cf44802e-0341-4925-8d1b-404cf84c8628 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:14:47.831286 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cf44802e-0341-4925-8d1b-404cf84c8628 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:47.832292 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cf44802e-0341-4925-8d1b-404cf84c8628 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:47.833323 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cf44802e-0341-4925-8d1b-404cf84c8628 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:47.835282 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cf44802e-0341-4925-8d1b-404cf84c8628 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:47.836588 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cf44802e-0341-4925-8d1b-404cf84c8628 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:47.837152 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cf44802e-0341-4925-8d1b-404cf84c8628 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:47.856959 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-289991f6-6d98-4045-8783-e4dd34758aa2 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb33a017168c4a8bae36eacd9ba6a7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24f2e13835b240578d411521ee520115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:14:47.866855 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-289991f6-6d98-4045-8783-e4dd34758aa2 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] 10.222.0.60 "GET /compute/v2.1/servers/cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f" status: 200 len: 1313 microversion: 2.1 time: 0.335618 Sep 14 09:14:47.868678 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2539/5102] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:14:47 2022] GET /compute/v2.1/servers/cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f => generated 1313 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:14:48.052773 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-cf44802e-0341-4925-8d1b-404cf84c8628 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:14:48.077994 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-cf44802e-0341-4925-8d1b-404cf84c8628 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105" status: 200 len: 1668 microversion: 2.1 time: 0.264879 Sep 14 09:14:48.079233 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2564/5103] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:14:47 2022] GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105 => generated 1668 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:14:48.243455 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-066248e0-e78a-4878-a85c-51c12c7b25c5 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-380984968", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "networks": [{"uuid": "63df5062-0947-41ef-8d8c-a8d82a21791b"}]}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:14:48.335272 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.network.neutron [None req-066248e0-e78a-4878-a85c-51c12c7b25c5 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] validate_networks() for [('63df5062-0947-41ef-8d8c-a8d82a21791b', None, None, None, None, None)] {{(pid=128759) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:14:48.892599 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d2a8cf74-759f-4e06-8eba-379f10e54d02 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:14:48.893743 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-d2a8cf74-759f-4e06-8eba-379f10e54d02 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] [instance: cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:14:48.904709 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d2a8cf74-759f-4e06-8eba-379f10e54d02 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:48.905282 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d2a8cf74-759f-4e06-8eba-379f10e54d02 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:48.905832 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d2a8cf74-759f-4e06-8eba-379f10e54d02 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:48.906892 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d2a8cf74-759f-4e06-8eba-379f10e54d02 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:48.907862 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d2a8cf74-759f-4e06-8eba-379f10e54d02 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:48.908656 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d2a8cf74-759f-4e06-8eba-379f10e54d02 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:49.639666 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-d2a8cf74-759f-4e06-8eba-379f10e54d02 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb33a017168c4a8bae36eacd9ba6a7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24f2e13835b240578d411521ee520115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:14:49.654489 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-d2a8cf74-759f-4e06-8eba-379f10e54d02 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] 10.222.0.60 "GET /compute/v2.1/servers/cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f" status: 200 len: 1313 microversion: 2.1 time: 0.765627 Sep 14 09:14:49.658565 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2565/5104] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:14:48 2022] GET /compute/v2.1/servers/cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f => generated 1313 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:14:49.793158 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-066248e0-e78a-4878-a85c-51c12c7b25c5 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Flavor limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:14:49.793158 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-066248e0-e78a-4878-a85c-51c12c7b25c5 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Image limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:14:49.794308 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-066248e0-e78a-4878-a85c-51c12c7b25c5 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Flavor pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:14:49.794308 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-066248e0-e78a-4878-a85c-51c12c7b25c5 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Image pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:14:49.799238 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-066248e0-e78a-4878-a85c-51c12c7b25c5 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:14:49.802389 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:14:49.820646 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-066248e0-e78a-4878-a85c-51c12c7b25c5 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:49.821161 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-066248e0-e78a-4878-a85c-51c12c7b25c5 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:49.821607 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-066248e0-e78a-4878-a85c-51c12c7b25c5 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:49.826474 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-066248e0-e78a-4878-a85c-51c12c7b25c5 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:49.827036 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-066248e0-e78a-4878-a85c-51c12c7b25c5 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:49.827490 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-066248e0-e78a-4878-a85c-51c12c7b25c5 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:49.873963 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-066248e0-e78a-4878-a85c-51c12c7b25c5 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Getting quotas for project 2f075a2c6aa4489abb3428e0a4ac5738. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:14:49.883251 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-066248e0-e78a-4878-a85c-51c12c7b25c5 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Getting quotas for user 950da33830ae4ae1a5511dd146e4e3be and project 2f075a2c6aa4489abb3428e0a4ac5738. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:14:49.915974 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-066248e0-e78a-4878-a85c-51c12c7b25c5 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Going to run 1 instances... {{(pid=128759) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:14:49.919902 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-066248e0-e78a-4878-a85c-51c12c7b25c5 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: cf1f1bf7-3e3b-4e28-b4e5-5279b05cd751] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128759) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:14:49.977380 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-066248e0-e78a-4878-a85c-51c12c7b25c5 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.737990 Sep 14 09:14:49.979353 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2540/5105] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 09:14:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1740 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:14:49.992436 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-483834d2-3f13-481d-95c0-f6df3908ad14 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:14:49.993617 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-483834d2-3f13-481d-95c0-f6df3908ad14 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: cf1f1bf7-3e3b-4e28-b4e5-5279b05cd751] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:14:50.081771 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-483834d2-3f13-481d-95c0-f6df3908ad14 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:14:50.091965 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-483834d2-3f13-481d-95c0-f6df3908ad14 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/cf1f1bf7-3e3b-4e28-b4e5-5279b05cd751" status: 200 len: 1214 microversion: 2.1 time: 0.103549 Sep 14 09:14:50.096879 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2566/5106] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:14:49 2022] GET /compute/v2.1/servers/cf1f1bf7-3e3b-4e28-b4e5-5279b05cd751 => generated 1214 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:14:50.680915 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-07e83d7a-c3d0-4b8b-9de6-4ec2eec7bbb5 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:14:50.681614 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-07e83d7a-c3d0-4b8b-9de6-4ec2eec7bbb5 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] [instance: cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:14:50.689589 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-07e83d7a-c3d0-4b8b-9de6-4ec2eec7bbb5 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:50.690104 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-07e83d7a-c3d0-4b8b-9de6-4ec2eec7bbb5 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:50.690557 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-07e83d7a-c3d0-4b8b-9de6-4ec2eec7bbb5 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:50.691317 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-07e83d7a-c3d0-4b8b-9de6-4ec2eec7bbb5 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:50.691979 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-07e83d7a-c3d0-4b8b-9de6-4ec2eec7bbb5 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:50.692840 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-07e83d7a-c3d0-4b8b-9de6-4ec2eec7bbb5 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:50.944035 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-07e83d7a-c3d0-4b8b-9de6-4ec2eec7bbb5 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb33a017168c4a8bae36eacd9ba6a7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24f2e13835b240578d411521ee520115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:14:50.954896 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-07e83d7a-c3d0-4b8b-9de6-4ec2eec7bbb5 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] 10.222.0.60 "GET /compute/v2.1/servers/cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f" status: 200 len: 1313 microversion: 2.1 time: 0.278906 Sep 14 09:14:50.955565 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2541/5107] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:14:50 2022] GET /compute/v2.1/servers/cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f => generated 1313 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:14:51.117464 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-4e8a4ca6-97db-405e-b543-12b1cc6a693c tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:14:51.118092 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-4e8a4ca6-97db-405e-b543-12b1cc6a693c tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: cf1f1bf7-3e3b-4e28-b4e5-5279b05cd751] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:14:51.131615 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4e8a4ca6-97db-405e-b543-12b1cc6a693c tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:51.132137 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4e8a4ca6-97db-405e-b543-12b1cc6a693c tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:51.132588 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4e8a4ca6-97db-405e-b543-12b1cc6a693c tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:51.133322 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4e8a4ca6-97db-405e-b543-12b1cc6a693c tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:51.133788 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4e8a4ca6-97db-405e-b543-12b1cc6a693c tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:51.134225 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4e8a4ca6-97db-405e-b543-12b1cc6a693c tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:51.249258 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-4e8a4ca6-97db-405e-b543-12b1cc6a693c tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:14:51.260896 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-4e8a4ca6-97db-405e-b543-12b1cc6a693c tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/cf1f1bf7-3e3b-4e28-b4e5-5279b05cd751" status: 200 len: 1266 microversion: 2.1 time: 0.146637 Sep 14 09:14:51.261492 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2567/5108] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:14:51 2022] GET /compute/v2.1/servers/cf1f1bf7-3e3b-4e28-b4e5-5279b05cd751 => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:14:51.979654 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8672887f-86f2-4541-9be4-116c98adb829 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:14:51.980284 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-8672887f-86f2-4541-9be4-116c98adb829 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] [instance: cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:14:51.990417 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8672887f-86f2-4541-9be4-116c98adb829 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:51.990916 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8672887f-86f2-4541-9be4-116c98adb829 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:51.991380 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8672887f-86f2-4541-9be4-116c98adb829 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:51.999979 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8672887f-86f2-4541-9be4-116c98adb829 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:52.000507 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8672887f-86f2-4541-9be4-116c98adb829 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:52.000964 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8672887f-86f2-4541-9be4-116c98adb829 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:52.286667 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c10a0875-ee6e-48a5-886a-dfd00992dff5 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:14:52.287963 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-c10a0875-ee6e-48a5-886a-dfd00992dff5 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: cf1f1bf7-3e3b-4e28-b4e5-5279b05cd751] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:14:52.307387 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c10a0875-ee6e-48a5-886a-dfd00992dff5 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:52.308128 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c10a0875-ee6e-48a5-886a-dfd00992dff5 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:52.308766 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c10a0875-ee6e-48a5-886a-dfd00992dff5 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:52.312883 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c10a0875-ee6e-48a5-886a-dfd00992dff5 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:52.313511 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c10a0875-ee6e-48a5-886a-dfd00992dff5 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:52.315261 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c10a0875-ee6e-48a5-886a-dfd00992dff5 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:52.565031 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-c10a0875-ee6e-48a5-886a-dfd00992dff5 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:14:52.609936 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-c10a0875-ee6e-48a5-886a-dfd00992dff5 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/cf1f1bf7-3e3b-4e28-b4e5-5279b05cd751" status: 200 len: 1272 microversion: 2.1 time: 0.327425 Sep 14 09:14:52.611596 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2568/5109] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:14:52 2022] GET /compute/v2.1/servers/cf1f1bf7-3e3b-4e28-b4e5-5279b05cd751 => generated 1272 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:14:52.700868 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-8fa9621e-2a02-4790-87c6-feac92a902e5 req-b806c8c2-0064-4fe4-9c61-29cc71d5a5fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f", "name": "network-vif-plugged", "status": "completed", "tag": "2344ca56-66c0-4a48-9202-1a4e7210fff4"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:14:52.714558 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-8fa9621e-2a02-4790-87c6-feac92a902e5 req-b806c8c2-0064-4fe4-9c61-29cc71d5a5fe service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:52.715068 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-8fa9621e-2a02-4790-87c6-feac92a902e5 req-b806c8c2-0064-4fe4-9c61-29cc71d5a5fe service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:52.715495 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-8fa9621e-2a02-4790-87c6-feac92a902e5 req-b806c8c2-0064-4fe4-9c61-29cc71d5a5fe service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:52.757882 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-8672887f-86f2-4541-9be4-116c98adb829 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb33a017168c4a8bae36eacd9ba6a7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24f2e13835b240578d411521ee520115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:14:52.761491 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=100 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:14:52.772190 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-8672887f-86f2-4541-9be4-116c98adb829 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] 10.222.0.60 "GET /compute/v2.1/servers/cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f" status: 200 len: 1313 microversion: 2.1 time: 0.794071 Sep 14 09:14:52.772875 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2542/5110] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:14:51 2022] GET /compute/v2.1/servers/cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f => generated 1313 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:14:52.774750 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-8fa9621e-2a02-4790-87c6-feac92a902e5 req-b806c8c2-0064-4fe4-9c61-29cc71d5a5fe service nova] Creating event network-vif-plugged:2344ca56-66c0-4a48-9202-1a4e7210fff4 for instance cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f on n-h1-836830-18 Sep 14 09:14:52.799106 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-8fa9621e-2a02-4790-87c6-feac92a902e5 req-b806c8c2-0064-4fe4-9c61-29cc71d5a5fe service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102375 Sep 14 09:14:52.802666 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2569/5111] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:14:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:14:53.228281 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b79878a7-eb29-4a3f-a30a-7fc64fdbf28a tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:14:53.229292 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b79878a7-eb29-4a3f-a30a-7fc64fdbf28a tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [instance: 53aade05-189d-455b-901e-6fb092cfbb07] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:14:53.242185 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b79878a7-eb29-4a3f-a30a-7fc64fdbf28a tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:53.244304 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b79878a7-eb29-4a3f-a30a-7fc64fdbf28a tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:53.246566 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b79878a7-eb29-4a3f-a30a-7fc64fdbf28a tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:53.247408 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b79878a7-eb29-4a3f-a30a-7fc64fdbf28a tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:53.247877 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b79878a7-eb29-4a3f-a30a-7fc64fdbf28a tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:53.250031 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b79878a7-eb29-4a3f-a30a-7fc64fdbf28a tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:53.289499 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b79878a7-eb29-4a3f-a30a-7fc64fdbf28a tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "GET /compute/v2.1/servers/53aade05-189d-455b-901e-6fb092cfbb07/ips" status: 200 len: 151 microversion: 2.1 time: 0.066592 Sep 14 09:14:53.292906 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2543/5112] 10.222.0.60 () {58 vars in 1248 bytes} [Wed Sep 14 09:14:53 2022] GET /compute/v2.1/servers/53aade05-189d-455b-901e-6fb092cfbb07/ips => generated 151 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:14:53.635482 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1551c43f-3f3e-47c1-a984-23348cc5ac23 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:14:53.636889 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-1551c43f-3f3e-47c1-a984-23348cc5ac23 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: cf1f1bf7-3e3b-4e28-b4e5-5279b05cd751] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:14:53.657206 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1551c43f-3f3e-47c1-a984-23348cc5ac23 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:53.657789 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1551c43f-3f3e-47c1-a984-23348cc5ac23 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:53.658231 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1551c43f-3f3e-47c1-a984-23348cc5ac23 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:53.659062 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1551c43f-3f3e-47c1-a984-23348cc5ac23 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:53.659520 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1551c43f-3f3e-47c1-a984-23348cc5ac23 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:53.660102 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1551c43f-3f3e-47c1-a984-23348cc5ac23 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:53.803688 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-7a29bb5f-082e-41f7-b64e-aa465e30fcbd tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:14:53.805245 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-7a29bb5f-082e-41f7-b64e-aa465e30fcbd tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] [instance: cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:14:53.818344 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7a29bb5f-082e-41f7-b64e-aa465e30fcbd tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:53.821800 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7a29bb5f-082e-41f7-b64e-aa465e30fcbd tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:53.823209 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7a29bb5f-082e-41f7-b64e-aa465e30fcbd tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:53.840671 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7a29bb5f-082e-41f7-b64e-aa465e30fcbd tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:53.841723 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7a29bb5f-082e-41f7-b64e-aa465e30fcbd tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:53.843638 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7a29bb5f-082e-41f7-b64e-aa465e30fcbd tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:54.085966 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-1551c43f-3f3e-47c1-a984-23348cc5ac23 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:14:54.105040 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-1551c43f-3f3e-47c1-a984-23348cc5ac23 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/cf1f1bf7-3e3b-4e28-b4e5-5279b05cd751" status: 200 len: 1314 microversion: 2.1 time: 0.473916 Sep 14 09:14:54.119199 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2570/5113] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:14:53 2022] GET /compute/v2.1/servers/cf1f1bf7-3e3b-4e28-b4e5-5279b05cd751 => generated 1314 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:14:54.203536 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-7a29bb5f-082e-41f7-b64e-aa465e30fcbd tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb33a017168c4a8bae36eacd9ba6a7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24f2e13835b240578d411521ee520115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:14:54.212473 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-7a29bb5f-082e-41f7-b64e-aa465e30fcbd tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] 10.222.0.60 "GET /compute/v2.1/servers/cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f" status: 200 len: 1313 microversion: 2.1 time: 0.415689 Sep 14 09:14:54.219065 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2544/5114] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:14:53 2022] GET /compute/v2.1/servers/cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f => generated 1313 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:14:54.530554 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-daad5590-8721-454c-a2d3-2821c157690b req-c202e39b-ad84-4b7a-910a-cc45f30e0a63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf1f1bf7-3e3b-4e28-b4e5-5279b05cd751", "tag": "44b6b52c-db23-4790-a977-0e4c3a8cdcf5"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:14:54.544342 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-daad5590-8721-454c-a2d3-2821c157690b req-c202e39b-ad84-4b7a-910a-cc45f30e0a63 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:54.545181 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-daad5590-8721-454c-a2d3-2821c157690b req-c202e39b-ad84-4b7a-910a-cc45f30e0a63 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:54.545795 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-daad5590-8721-454c-a2d3-2821c157690b req-c202e39b-ad84-4b7a-910a-cc45f30e0a63 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:54.561330 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-daad5590-8721-454c-a2d3-2821c157690b req-c202e39b-ad84-4b7a-910a-cc45f30e0a63 service nova] Creating event network-changed:44b6b52c-db23-4790-a977-0e4c3a8cdcf5 for instance cf1f1bf7-3e3b-4e28-b4e5-5279b05cd751 on n-h1-836830-18 Sep 14 09:14:54.568135 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-daad5590-8721-454c-a2d3-2821c157690b req-c202e39b-ad84-4b7a-910a-cc45f30e0a63 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043053 Sep 14 09:14:54.569495 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2571/5115] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:14:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:14:55.034038 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-0681682e-d875-4cfd-aabc-fa24092ae14b tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "40241786-54d4-47dd-8a8c-b712b2aa39ed"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:14:55.037387 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-0681682e-d875-4cfd-aabc-fa24092ae14b tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [instance: 53aade05-189d-455b-901e-6fb092cfbb07] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:14:55.049916 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0681682e-d875-4cfd-aabc-fa24092ae14b tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:55.052665 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0681682e-d875-4cfd-aabc-fa24092ae14b tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:55.055192 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0681682e-d875-4cfd-aabc-fa24092ae14b tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:55.059389 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0681682e-d875-4cfd-aabc-fa24092ae14b tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:55.059890 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0681682e-d875-4cfd-aabc-fa24092ae14b tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:55.060337 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0681682e-d875-4cfd-aabc-fa24092ae14b tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:55.133802 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ecef9700-5c73-4605-b9f0-bfbb91e105bf tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:14:55.134537 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-ecef9700-5c73-4605-b9f0-bfbb91e105bf tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: cf1f1bf7-3e3b-4e28-b4e5-5279b05cd751] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:14:55.148812 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ecef9700-5c73-4605-b9f0-bfbb91e105bf tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:55.150392 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ecef9700-5c73-4605-b9f0-bfbb91e105bf tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:55.152433 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ecef9700-5c73-4605-b9f0-bfbb91e105bf tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:55.153988 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ecef9700-5c73-4605-b9f0-bfbb91e105bf tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:55.156821 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ecef9700-5c73-4605-b9f0-bfbb91e105bf tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:55.158370 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ecef9700-5c73-4605-b9f0-bfbb91e105bf tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:55.459928 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-ecef9700-5c73-4605-b9f0-bfbb91e105bf tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:14:55.486155 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-ecef9700-5c73-4605-b9f0-bfbb91e105bf tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/cf1f1bf7-3e3b-4e28-b4e5-5279b05cd751" status: 200 len: 1314 microversion: 2.1 time: 0.356164 Sep 14 09:14:55.486793 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2572/5116] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:14:55 2022] GET /compute/v2.1/servers/cf1f1bf7-3e3b-4e28-b4e5-5279b05cd751 => generated 1314 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:14:55.501678 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-be7fc22a-db51-4e9f-bc3c-4b125fcbeffb tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:14:55.507179 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-0681682e-d875-4cfd-aabc-fa24092ae14b tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "POST /compute/v2.1/servers/53aade05-189d-455b-901e-6fb092cfbb07/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.476908 Sep 14 09:14:55.508094 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-be7fc22a-db51-4e9f-bc3c-4b125fcbeffb tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] [instance: cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:14:55.516465 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2545/5117] 10.222.0.60 () {60 vars in 1323 bytes} [Wed Sep 14 09:14:55 2022] POST /compute/v2.1/servers/53aade05-189d-455b-901e-6fb092cfbb07/os-volume_attachments => generated 194 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:14:55.519865 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-be7fc22a-db51-4e9f-bc3c-4b125fcbeffb tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:55.520781 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-be7fc22a-db51-4e9f-bc3c-4b125fcbeffb tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:55.521394 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-be7fc22a-db51-4e9f-bc3c-4b125fcbeffb tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:55.522300 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-be7fc22a-db51-4e9f-bc3c-4b125fcbeffb tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:55.523168 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-be7fc22a-db51-4e9f-bc3c-4b125fcbeffb tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:55.523778 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-be7fc22a-db51-4e9f-bc3c-4b125fcbeffb tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:55.898085 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-be7fc22a-db51-4e9f-bc3c-4b125fcbeffb tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb33a017168c4a8bae36eacd9ba6a7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24f2e13835b240578d411521ee520115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:14:55.925485 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-be7fc22a-db51-4e9f-bc3c-4b125fcbeffb tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] 10.222.0.60 "GET /compute/v2.1/servers/cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f" status: 200 len: 1499 microversion: 2.1 time: 0.437288 Sep 14 09:14:55.927283 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2573/5118] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:14:55 2022] GET /compute/v2.1/servers/cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f => generated 1499 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:14:55.980870 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8f10a10b-c265-4cdf-84e1-82078536b900 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:14:55.991387 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-8f10a10b-c265-4cdf-84e1-82078536b900 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] [instance: cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:14:56.013898 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8f10a10b-c265-4cdf-84e1-82078536b900 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:56.014397 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8f10a10b-c265-4cdf-84e1-82078536b900 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:56.019699 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8f10a10b-c265-4cdf-84e1-82078536b900 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:56.021554 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8f10a10b-c265-4cdf-84e1-82078536b900 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:56.021969 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8f10a10b-c265-4cdf-84e1-82078536b900 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:56.022408 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8f10a10b-c265-4cdf-84e1-82078536b900 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:56.090889 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.objects.instance [None req-8f10a10b-c265-4cdf-84e1-82078536b900 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lazy-loading 'flavor' on Instance uuid cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f {{(pid=128759) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:14:56.287867 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-8f10a10b-c265-4cdf-84e1-82078536b900 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] 10.222.0.60 "POST /compute/v2.1/servers/cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f/action" status: 200 len: 32 microversion: 2.1 time: 0.329805 Sep 14 09:14:56.288495 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2546/5119] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:14:55 2022] POST /compute/v2.1/servers/cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f/action => generated 32 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 09:14:56.306073 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ce11a0ee-7463-421e-afb6-5fd5b2b0fffd tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:14:56.307969 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-ce11a0ee-7463-421e-afb6-5fd5b2b0fffd tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] [instance: cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:14:56.331733 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ce11a0ee-7463-421e-afb6-5fd5b2b0fffd tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:56.332393 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ce11a0ee-7463-421e-afb6-5fd5b2b0fffd tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:56.332904 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ce11a0ee-7463-421e-afb6-5fd5b2b0fffd tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:56.333830 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ce11a0ee-7463-421e-afb6-5fd5b2b0fffd tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:56.334418 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ce11a0ee-7463-421e-afb6-5fd5b2b0fffd tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:56.334873 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ce11a0ee-7463-421e-afb6-5fd5b2b0fffd tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:56.511704 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-dd2bcf35-58b2-4cf5-b6ab-267ecf7690dd tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:14:56.512426 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-dd2bcf35-58b2-4cf5-b6ab-267ecf7690dd tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: cf1f1bf7-3e3b-4e28-b4e5-5279b05cd751] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:14:56.529445 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dd2bcf35-58b2-4cf5-b6ab-267ecf7690dd tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:56.529445 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dd2bcf35-58b2-4cf5-b6ab-267ecf7690dd tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:56.529445 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dd2bcf35-58b2-4cf5-b6ab-267ecf7690dd tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:56.529445 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dd2bcf35-58b2-4cf5-b6ab-267ecf7690dd tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:56.529445 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dd2bcf35-58b2-4cf5-b6ab-267ecf7690dd tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:56.531518 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dd2bcf35-58b2-4cf5-b6ab-267ecf7690dd tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:56.591940 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-ce11a0ee-7463-421e-afb6-5fd5b2b0fffd tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb33a017168c4a8bae36eacd9ba6a7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24f2e13835b240578d411521ee520115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:14:56.608061 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-ce11a0ee-7463-421e-afb6-5fd5b2b0fffd tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] 10.222.0.60 "GET /compute/v2.1/servers/cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f" status: 200 len: 1505 microversion: 2.1 time: 0.312644 Sep 14 09:14:56.608828 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2574/5120] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:14:56 2022] GET /compute/v2.1/servers/cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f => generated 1505 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:14:56.827273 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-dd2bcf35-58b2-4cf5-b6ab-267ecf7690dd tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:14:56.851537 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-dd2bcf35-58b2-4cf5-b6ab-267ecf7690dd tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/cf1f1bf7-3e3b-4e28-b4e5-5279b05cd751" status: 200 len: 1314 microversion: 2.1 time: 0.345165 Sep 14 09:14:56.854766 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2547/5121] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:14:56 2022] GET /compute/v2.1/servers/cf1f1bf7-3e3b-4e28-b4e5-5279b05cd751 => generated 1314 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:14:57.633401 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-6181de6a-ce75-4a2c-8e8f-f20c701481d7 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:14:57.634090 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-6181de6a-ce75-4a2c-8e8f-f20c701481d7 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] [instance: cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:14:57.651382 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6181de6a-ce75-4a2c-8e8f-f20c701481d7 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:57.652566 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6181de6a-ce75-4a2c-8e8f-f20c701481d7 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:57.653197 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6181de6a-ce75-4a2c-8e8f-f20c701481d7 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:57.654121 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6181de6a-ce75-4a2c-8e8f-f20c701481d7 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:57.655159 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6181de6a-ce75-4a2c-8e8f-f20c701481d7 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:57.655649 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6181de6a-ce75-4a2c-8e8f-f20c701481d7 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:57.876976 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8ca4f268-782c-4009-b892-d2b834bf8051 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:14:57.877671 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-8ca4f268-782c-4009-b892-d2b834bf8051 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: cf1f1bf7-3e3b-4e28-b4e5-5279b05cd751] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:14:57.898527 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8ca4f268-782c-4009-b892-d2b834bf8051 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:57.900836 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8ca4f268-782c-4009-b892-d2b834bf8051 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:57.903664 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8ca4f268-782c-4009-b892-d2b834bf8051 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:57.907661 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8ca4f268-782c-4009-b892-d2b834bf8051 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:57.908177 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8ca4f268-782c-4009-b892-d2b834bf8051 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:57.908629 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8ca4f268-782c-4009-b892-d2b834bf8051 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:58.060562 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-6181de6a-ce75-4a2c-8e8f-f20c701481d7 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb33a017168c4a8bae36eacd9ba6a7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24f2e13835b240578d411521ee520115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:14:58.072875 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-6181de6a-ce75-4a2c-8e8f-f20c701481d7 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] 10.222.0.60 "GET /compute/v2.1/servers/cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f" status: 200 len: 1505 microversion: 2.1 time: 0.445368 Sep 14 09:14:58.073705 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2575/5122] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:14:57 2022] GET /compute/v2.1/servers/cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f => generated 1505 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:14:58.257345 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-8ca4f268-782c-4009-b892-d2b834bf8051 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:14:58.267984 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-8ca4f268-782c-4009-b892-d2b834bf8051 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/cf1f1bf7-3e3b-4e28-b4e5-5279b05cd751" status: 200 len: 1314 microversion: 2.1 time: 0.395665 Sep 14 09:14:58.269284 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2548/5123] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:14:57 2022] GET /compute/v2.1/servers/cf1f1bf7-3e3b-4e28-b4e5-5279b05cd751 => generated 1314 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:14:59.101644 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-8d9ddde0-9b9e-493e-b2d3-cfe50cd13896 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:14:59.103225 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-8d9ddde0-9b9e-493e-b2d3-cfe50cd13896 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] [instance: cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:14:59.118074 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8d9ddde0-9b9e-493e-b2d3-cfe50cd13896 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:59.119640 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8d9ddde0-9b9e-493e-b2d3-cfe50cd13896 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:59.123387 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8d9ddde0-9b9e-493e-b2d3-cfe50cd13896 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:59.124413 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8d9ddde0-9b9e-493e-b2d3-cfe50cd13896 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:59.125043 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8d9ddde0-9b9e-493e-b2d3-cfe50cd13896 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:59.132038 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8d9ddde0-9b9e-493e-b2d3-cfe50cd13896 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:59.296537 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e0790eb7-eacb-4212-a0cf-78ce291f8c00 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:14:59.298100 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e0790eb7-eacb-4212-a0cf-78ce291f8c00 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: cf1f1bf7-3e3b-4e28-b4e5-5279b05cd751] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:14:59.314638 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e0790eb7-eacb-4212-a0cf-78ce291f8c00 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:59.315644 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e0790eb7-eacb-4212-a0cf-78ce291f8c00 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:59.316223 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e0790eb7-eacb-4212-a0cf-78ce291f8c00 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:59.317122 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e0790eb7-eacb-4212-a0cf-78ce291f8c00 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:59.317735 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e0790eb7-eacb-4212-a0cf-78ce291f8c00 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:59.318302 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e0790eb7-eacb-4212-a0cf-78ce291f8c00 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:59.587715 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-8d9ddde0-9b9e-493e-b2d3-cfe50cd13896 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb33a017168c4a8bae36eacd9ba6a7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24f2e13835b240578d411521ee520115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:14:59.603341 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-8d9ddde0-9b9e-493e-b2d3-cfe50cd13896 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] 10.222.0.60 "GET /compute/v2.1/servers/cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f" status: 200 len: 1505 microversion: 2.1 time: 0.505666 Sep 14 09:14:59.627010 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2576/5124] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:14:59 2022] GET /compute/v2.1/servers/cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f => generated 1505 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:14:59.703920 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-e0790eb7-eacb-4212-a0cf-78ce291f8c00 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:14:59.712309 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e0790eb7-eacb-4212-a0cf-78ce291f8c00 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/cf1f1bf7-3e3b-4e28-b4e5-5279b05cd751" status: 200 len: 1314 microversion: 2.1 time: 0.422242 Sep 14 09:14:59.718270 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2549/5125] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:14:59 2022] GET /compute/v2.1/servers/cf1f1bf7-3e3b-4e28-b4e5-5279b05cd751 => generated 1314 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:15:00.639629 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-8cac3a47-bafe-4450-9ed4-84d9cfb3900f tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:00.640253 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-8cac3a47-bafe-4450-9ed4-84d9cfb3900f tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] [instance: cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:00.642459 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=2 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:15:00.660759 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8cac3a47-bafe-4450-9ed4-84d9cfb3900f tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:00.661274 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8cac3a47-bafe-4450-9ed4-84d9cfb3900f tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:00.661724 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8cac3a47-bafe-4450-9ed4-84d9cfb3900f tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:00.662447 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8cac3a47-bafe-4450-9ed4-84d9cfb3900f tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:00.662910 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8cac3a47-bafe-4450-9ed4-84d9cfb3900f tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:00.663384 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8cac3a47-bafe-4450-9ed4-84d9cfb3900f tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:00.742863 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b20ea43a-175b-43de-8574-b1ebeddfa6df tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:00.744269 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b20ea43a-175b-43de-8574-b1ebeddfa6df tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: cf1f1bf7-3e3b-4e28-b4e5-5279b05cd751] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:00.747063 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=2 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:15:00.748005 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=6 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:15:00.765797 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b20ea43a-175b-43de-8574-b1ebeddfa6df tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:00.766479 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b20ea43a-175b-43de-8574-b1ebeddfa6df tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:00.767872 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b20ea43a-175b-43de-8574-b1ebeddfa6df tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:00.769035 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b20ea43a-175b-43de-8574-b1ebeddfa6df tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:00.769797 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b20ea43a-175b-43de-8574-b1ebeddfa6df tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:00.770432 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b20ea43a-175b-43de-8574-b1ebeddfa6df tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:01.387602 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-8cac3a47-bafe-4450-9ed4-84d9cfb3900f tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb33a017168c4a8bae36eacd9ba6a7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24f2e13835b240578d411521ee520115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:01.402020 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-8cac3a47-bafe-4450-9ed4-84d9cfb3900f tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] 10.222.0.60 "GET /compute/v2.1/servers/cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f" status: 200 len: 1505 microversion: 2.1 time: 0.763587 Sep 14 09:15:01.403480 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2577/5126] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:15:00 2022] GET /compute/v2.1/servers/cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f => generated 1505 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:15:01.416325 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b20ea43a-175b-43de-8574-b1ebeddfa6df tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:01.424476 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b20ea43a-175b-43de-8574-b1ebeddfa6df tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/cf1f1bf7-3e3b-4e28-b4e5-5279b05cd751" status: 200 len: 1314 microversion: 2.1 time: 0.686748 Sep 14 09:15:01.425072 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2550/5127] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:15:00 2022] GET /compute/v2.1/servers/cf1f1bf7-3e3b-4e28-b4e5-5279b05cd751 => generated 1314 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:15:02.428193 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-16570bd8-7ebd-44b3-8432-7272aac73e73 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:02.430419 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-16570bd8-7ebd-44b3-8432-7272aac73e73 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] [instance: cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:02.450667 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3353b987-0508-424f-aca2-0a9180120543 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:02.452013 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-3353b987-0508-424f-aca2-0a9180120543 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: cf1f1bf7-3e3b-4e28-b4e5-5279b05cd751] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:02.472692 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-16570bd8-7ebd-44b3-8432-7272aac73e73 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:02.474804 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-16570bd8-7ebd-44b3-8432-7272aac73e73 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:02.475817 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-16570bd8-7ebd-44b3-8432-7272aac73e73 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:02.478337 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-16570bd8-7ebd-44b3-8432-7272aac73e73 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:02.479383 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3353b987-0508-424f-aca2-0a9180120543 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:02.491261 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-16570bd8-7ebd-44b3-8432-7272aac73e73 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:02.491879 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-16570bd8-7ebd-44b3-8432-7272aac73e73 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:02.495709 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3353b987-0508-424f-aca2-0a9180120543 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:02.496273 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3353b987-0508-424f-aca2-0a9180120543 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:02.498078 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3353b987-0508-424f-aca2-0a9180120543 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:02.498078 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3353b987-0508-424f-aca2-0a9180120543 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:02.498265 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3353b987-0508-424f-aca2-0a9180120543 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:02.856855 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-16570bd8-7ebd-44b3-8432-7272aac73e73 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb33a017168c4a8bae36eacd9ba6a7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24f2e13835b240578d411521ee520115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:02.867485 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-16570bd8-7ebd-44b3-8432-7272aac73e73 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] 10.222.0.60 "GET /compute/v2.1/servers/cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f" status: 200 len: 1505 microversion: 2.1 time: 0.442193 Sep 14 09:15:02.886043 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2578/5128] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:15:02 2022] GET /compute/v2.1/servers/cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f => generated 1505 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:15:02.893691 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-3353b987-0508-424f-aca2-0a9180120543 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:02.902879 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-3353b987-0508-424f-aca2-0a9180120543 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/cf1f1bf7-3e3b-4e28-b4e5-5279b05cd751" status: 200 len: 1314 microversion: 2.1 time: 0.458127 Sep 14 09:15:02.907186 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-5c9f2665-82ed-4f4f-aecf-82b7d3e696f6 req-1dbb73d5-b03d-4f2c-b8fb-3e46df21b41f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf1f1bf7-3e3b-4e28-b4e5-5279b05cd751", "name": "network-vif-plugged", "status": "completed", "tag": "44b6b52c-db23-4790-a977-0e4c3a8cdcf5"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:15:02.908291 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2551/5129] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:15:02 2022] GET /compute/v2.1/servers/cf1f1bf7-3e3b-4e28-b4e5-5279b05cd751 => generated 1314 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:15:02.919089 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b45867ba-e5a4-46ff-a3c7-9a259a32d287 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:02.920089 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b45867ba-e5a4-46ff-a3c7-9a259a32d287 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 50157c1b-c748-4d1f-928e-207482b37ec6] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:02.927030 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b45867ba-e5a4-46ff-a3c7-9a259a32d287 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:02.927820 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b45867ba-e5a4-46ff-a3c7-9a259a32d287 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:02.928266 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b45867ba-e5a4-46ff-a3c7-9a259a32d287 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:02.928974 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b45867ba-e5a4-46ff-a3c7-9a259a32d287 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:02.929436 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b45867ba-e5a4-46ff-a3c7-9a259a32d287 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:02.929866 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b45867ba-e5a4-46ff-a3c7-9a259a32d287 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:02.937941 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-5c9f2665-82ed-4f4f-aecf-82b7d3e696f6 req-1dbb73d5-b03d-4f2c-b8fb-3e46df21b41f service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:02.938669 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-5c9f2665-82ed-4f4f-aecf-82b7d3e696f6 req-1dbb73d5-b03d-4f2c-b8fb-3e46df21b41f service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:02.939425 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-5c9f2665-82ed-4f4f-aecf-82b7d3e696f6 req-1dbb73d5-b03d-4f2c-b8fb-3e46df21b41f service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:02.957023 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b45867ba-e5a4-46ff-a3c7-9a259a32d287 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6/ips" status: 200 len: 150 microversion: 2.20 time: 0.047399 Sep 14 09:15:02.964046 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-5c9f2665-82ed-4f4f-aecf-82b7d3e696f6 req-1dbb73d5-b03d-4f2c-b8fb-3e46df21b41f service nova] Creating event network-vif-plugged:44b6b52c-db23-4790-a977-0e4c3a8cdcf5 for instance cf1f1bf7-3e3b-4e28-b4e5-5279b05cd751 on n-h1-836830-18 Sep 14 09:15:02.966014 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2552/5130] 10.222.0.60 () {60 vars in 1289 bytes} [Wed Sep 14 09:15:02 2022] GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6/ips => generated 150 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 09:15:02.971642 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-5c9f2665-82ed-4f4f-aecf-82b7d3e696f6 req-1dbb73d5-b03d-4f2c-b8fb-3e46df21b41f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082721 Sep 14 09:15:02.972421 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2579/5131] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:15:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:15:03.893906 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-75791fad-b143-4d41-a29f-ff780391aa66 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:03.895316 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-75791fad-b143-4d41-a29f-ff780391aa66 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] [instance: cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:03.904152 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-75791fad-b143-4d41-a29f-ff780391aa66 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:03.905042 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-75791fad-b143-4d41-a29f-ff780391aa66 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:03.905981 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-75791fad-b143-4d41-a29f-ff780391aa66 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:03.907063 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-75791fad-b143-4d41-a29f-ff780391aa66 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:03.907746 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-75791fad-b143-4d41-a29f-ff780391aa66 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:03.908398 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-75791fad-b143-4d41-a29f-ff780391aa66 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:03.930861 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-fd478501-87df-4d63-8340-3a5dbce9266f tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:03.932432 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-fd478501-87df-4d63-8340-3a5dbce9266f tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: cf1f1bf7-3e3b-4e28-b4e5-5279b05cd751] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:03.957708 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fd478501-87df-4d63-8340-3a5dbce9266f tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:03.961200 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fd478501-87df-4d63-8340-3a5dbce9266f tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:03.962476 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fd478501-87df-4d63-8340-3a5dbce9266f tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:03.968957 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fd478501-87df-4d63-8340-3a5dbce9266f tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:03.972264 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fd478501-87df-4d63-8340-3a5dbce9266f tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:03.972947 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fd478501-87df-4d63-8340-3a5dbce9266f tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:04.265651 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-75791fad-b143-4d41-a29f-ff780391aa66 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb33a017168c4a8bae36eacd9ba6a7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24f2e13835b240578d411521ee520115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:04.269378 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-fd478501-87df-4d63-8340-3a5dbce9266f tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:04.272935 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-75791fad-b143-4d41-a29f-ff780391aa66 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] 10.222.0.60 "GET /compute/v2.1/servers/cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f" status: 200 len: 1505 microversion: 2.1 time: 0.383321 Sep 14 09:15:04.285238 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2553/5132] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:15:03 2022] GET /compute/v2.1/servers/cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f => generated 1505 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:15:04.292322 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-fd478501-87df-4d63-8340-3a5dbce9266f tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/cf1f1bf7-3e3b-4e28-b4e5-5279b05cd751" status: 200 len: 1314 microversion: 2.1 time: 0.365861 Sep 14 09:15:04.301411 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2580/5133] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:15:03 2022] GET /compute/v2.1/servers/cf1f1bf7-3e3b-4e28-b4e5-5279b05cd751 => generated 1314 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:15:05.057245 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3ee46dd9-6dd6-478f-b53f-c7ee330dcd20 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:15:05.057747 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-3ee46dd9-6dd6-478f-b53f-c7ee330dcd20 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 50157c1b-c748-4d1f-928e-207482b37ec6] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:05.066436 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3ee46dd9-6dd6-478f-b53f-c7ee330dcd20 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:05.067191 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3ee46dd9-6dd6-478f-b53f-c7ee330dcd20 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:05.068379 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3ee46dd9-6dd6-478f-b53f-c7ee330dcd20 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:05.069910 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3ee46dd9-6dd6-478f-b53f-c7ee330dcd20 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:05.070466 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3ee46dd9-6dd6-478f-b53f-c7ee330dcd20 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:05.071017 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3ee46dd9-6dd6-478f-b53f-c7ee330dcd20 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:05.100400 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.objects.instance [None req-3ee46dd9-6dd6-478f-b53f-c7ee330dcd20 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lazy-loading 'flavor' on Instance uuid 50157c1b-c748-4d1f-928e-207482b37ec6 {{(pid=128759) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:15:05.209307 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:15:05.298077 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-71311746-393d-4994-8bec-a2b14066188a tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:05.298763 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-71311746-393d-4994-8bec-a2b14066188a tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] [instance: cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:05.310377 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-71311746-393d-4994-8bec-a2b14066188a tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:05.310883 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-71311746-393d-4994-8bec-a2b14066188a tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:05.311349 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-71311746-393d-4994-8bec-a2b14066188a tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:05.312061 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-71311746-393d-4994-8bec-a2b14066188a tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:05.312528 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-71311746-393d-4994-8bec-a2b14066188a tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:05.318516 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-71311746-393d-4994-8bec-a2b14066188a tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:05.410279 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-3ee46dd9-6dd6-478f-b53f-c7ee330dcd20 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "POST /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6/action" status: 202 len: 0 microversion: 2.20 time: 0.357832 Sep 14 09:15:05.411064 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2554/5134] 10.222.0.60 () {62 vars in 1319 bytes} [Wed Sep 14 09:15:05 2022] POST /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6/action => generated 0 bytes in 360 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:15:05.419891 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a63573d5-ae28-4774-93a4-f8176fdb6975 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:05.422124 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-a63573d5-ae28-4774-93a4-f8176fdb6975 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: cf1f1bf7-3e3b-4e28-b4e5-5279b05cd751] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:05.435829 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a63573d5-ae28-4774-93a4-f8176fdb6975 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:05.437335 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a63573d5-ae28-4774-93a4-f8176fdb6975 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:05.438023 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a63573d5-ae28-4774-93a4-f8176fdb6975 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:05.439012 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a63573d5-ae28-4774-93a4-f8176fdb6975 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:05.443496 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a63573d5-ae28-4774-93a4-f8176fdb6975 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:05.444491 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a63573d5-ae28-4774-93a4-f8176fdb6975 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:05.528775 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-71311746-393d-4994-8bec-a2b14066188a tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb33a017168c4a8bae36eacd9ba6a7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24f2e13835b240578d411521ee520115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:05.554757 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-71311746-393d-4994-8bec-a2b14066188a tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] 10.222.0.60 "GET /compute/v2.1/servers/cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f" status: 200 len: 1505 microversion: 2.1 time: 0.246758 Sep 14 09:15:05.559465 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2581/5135] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:15:05 2022] GET /compute/v2.1/servers/cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f => generated 1505 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:15:05.565357 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-05fdbf30-02b6-47f4-b407-8195edff9fa1 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:05.572798 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-05fdbf30-02b6-47f4-b407-8195edff9fa1 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 50157c1b-c748-4d1f-928e-207482b37ec6] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:05.581381 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-05fdbf30-02b6-47f4-b407-8195edff9fa1 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:05.582239 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-05fdbf30-02b6-47f4-b407-8195edff9fa1 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:05.582917 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-05fdbf30-02b6-47f4-b407-8195edff9fa1 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:05.584226 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-05fdbf30-02b6-47f4-b407-8195edff9fa1 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:05.585182 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-05fdbf30-02b6-47f4-b407-8195edff9fa1 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:05.585615 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-05fdbf30-02b6-47f4-b407-8195edff9fa1 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:05.705542 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-a63573d5-ae28-4774-93a4-f8176fdb6975 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:05.717376 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a63573d5-ae28-4774-93a4-f8176fdb6975 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/cf1f1bf7-3e3b-4e28-b4e5-5279b05cd751" status: 200 len: 1500 microversion: 2.1 time: 0.304148 Sep 14 09:15:05.717971 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2555/5136] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:15:05 2022] GET /compute/v2.1/servers/cf1f1bf7-3e3b-4e28-b4e5-5279b05cd751 => generated 1500 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:15:05.744171 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3fe0744d-e5e4-4fb5-9e44-ce685ca9743b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:15:05.747126 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-3fe0744d-e5e4-4fb5-9e44-ce685ca9743b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: cf1f1bf7-3e3b-4e28-b4e5-5279b05cd751] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:05.755741 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3fe0744d-e5e4-4fb5-9e44-ce685ca9743b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:05.756472 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3fe0744d-e5e4-4fb5-9e44-ce685ca9743b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:05.757068 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3fe0744d-e5e4-4fb5-9e44-ce685ca9743b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:05.758344 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3fe0744d-e5e4-4fb5-9e44-ce685ca9743b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:05.758991 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3fe0744d-e5e4-4fb5-9e44-ce685ca9743b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:05.759901 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3fe0744d-e5e4-4fb5-9e44-ce685ca9743b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:05.786218 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-05fdbf30-02b6-47f4-b407-8195edff9fa1 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:05.797798 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-05fdbf30-02b6-47f4-b407-8195edff9fa1 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:05.799298 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-05fdbf30-02b6-47f4-b407-8195edff9fa1 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:05.800591 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-05fdbf30-02b6-47f4-b407-8195edff9fa1 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6" status: 200 len: 1722 microversion: 2.20 time: 0.239740 Sep 14 09:15:05.811073 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2582/5137] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:15:05 2022] GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6 => generated 1722 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:15:05.864765 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-3fe0744d-e5e4-4fb5-9e44-ce685ca9743b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "POST /compute/v2.1/servers/cf1f1bf7-3e3b-4e28-b4e5-5279b05cd751/action" status: 202 len: 0 microversion: 2.1 time: 0.126619 Sep 14 09:15:05.870823 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2556/5138] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:15:05 2022] POST /compute/v2.1/servers/cf1f1bf7-3e3b-4e28-b4e5-5279b05cd751/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 14 09:15:05.876815 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-58290c61-2f16-43c1-a098-cd8087a0ee3d tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:05.877751 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-58290c61-2f16-43c1-a098-cd8087a0ee3d tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: cf1f1bf7-3e3b-4e28-b4e5-5279b05cd751] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:05.885730 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-58290c61-2f16-43c1-a098-cd8087a0ee3d tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:05.886510 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-58290c61-2f16-43c1-a098-cd8087a0ee3d tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:05.887141 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-58290c61-2f16-43c1-a098-cd8087a0ee3d tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:05.888032 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-58290c61-2f16-43c1-a098-cd8087a0ee3d tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:05.888723 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-58290c61-2f16-43c1-a098-cd8087a0ee3d tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:05.889706 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-58290c61-2f16-43c1-a098-cd8087a0ee3d tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:05.907991 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=100 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:15:06.123154 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-58290c61-2f16-43c1-a098-cd8087a0ee3d tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:06.143875 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-58290c61-2f16-43c1-a098-cd8087a0ee3d tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/cf1f1bf7-3e3b-4e28-b4e5-5279b05cd751" status: 200 len: 1505 microversion: 2.1 time: 0.271644 Sep 14 09:15:06.145699 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2583/5139] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:15:05 2022] GET /compute/v2.1/servers/cf1f1bf7-3e3b-4e28-b4e5-5279b05cd751 => generated 1505 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:15:06.579195 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-5845d814-ea22-4ae0-b01d-deb990a75fa4 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:06.579894 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-5845d814-ea22-4ae0-b01d-deb990a75fa4 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] [instance: cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:06.589677 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5845d814-ea22-4ae0-b01d-deb990a75fa4 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:06.590429 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5845d814-ea22-4ae0-b01d-deb990a75fa4 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:06.591125 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5845d814-ea22-4ae0-b01d-deb990a75fa4 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:06.592121 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5845d814-ea22-4ae0-b01d-deb990a75fa4 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:06.593264 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5845d814-ea22-4ae0-b01d-deb990a75fa4 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:06.593978 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5845d814-ea22-4ae0-b01d-deb990a75fa4 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:06.777890 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-5845d814-ea22-4ae0-b01d-deb990a75fa4 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb33a017168c4a8bae36eacd9ba6a7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24f2e13835b240578d411521ee520115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:06.791703 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-5845d814-ea22-4ae0-b01d-deb990a75fa4 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] 10.222.0.60 "GET /compute/v2.1/servers/cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f" status: 200 len: 1505 microversion: 2.1 time: 0.216357 Sep 14 09:15:06.792580 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2557/5140] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:15:06 2022] GET /compute/v2.1/servers/cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f => generated 1505 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:15:06.830732 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-3960c903-df73-4cf4-a51b-073d36428221 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:06.832310 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-3960c903-df73-4cf4-a51b-073d36428221 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 50157c1b-c748-4d1f-928e-207482b37ec6] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:06.841303 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3960c903-df73-4cf4-a51b-073d36428221 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:06.842000 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3960c903-df73-4cf4-a51b-073d36428221 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:06.842670 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3960c903-df73-4cf4-a51b-073d36428221 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:06.843595 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3960c903-df73-4cf4-a51b-073d36428221 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:06.844441 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3960c903-df73-4cf4-a51b-073d36428221 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:06.845168 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3960c903-df73-4cf4-a51b-073d36428221 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:07.055729 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-3960c903-df73-4cf4-a51b-073d36428221 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:07.067180 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-3960c903-df73-4cf4-a51b-073d36428221 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:07.069304 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-3960c903-df73-4cf4-a51b-073d36428221 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:07.071189 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-3960c903-df73-4cf4-a51b-073d36428221 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6" status: 200 len: 1722 microversion: 2.20 time: 0.245716 Sep 14 09:15:07.071973 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2584/5141] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:15:06 2022] GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6 => generated 1722 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:15:07.174051 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-66ee2bf5-f806-4bc9-814c-a08e1d40441f tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:07.175393 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-66ee2bf5-f806-4bc9-814c-a08e1d40441f tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: cf1f1bf7-3e3b-4e28-b4e5-5279b05cd751] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:07.187337 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-66ee2bf5-f806-4bc9-814c-a08e1d40441f tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:07.192627 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-66ee2bf5-f806-4bc9-814c-a08e1d40441f tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:07.193297 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-66ee2bf5-f806-4bc9-814c-a08e1d40441f tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:07.194877 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-66ee2bf5-f806-4bc9-814c-a08e1d40441f tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:07.196259 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-66ee2bf5-f806-4bc9-814c-a08e1d40441f tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:07.196871 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-66ee2bf5-f806-4bc9-814c-a08e1d40441f tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:07.398411 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-66ee2bf5-f806-4bc9-814c-a08e1d40441f tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:07.410812 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-66ee2bf5-f806-4bc9-814c-a08e1d40441f tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/cf1f1bf7-3e3b-4e28-b4e5-5279b05cd751" status: 200 len: 1485 microversion: 2.1 time: 0.243826 Sep 14 09:15:07.411951 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2558/5142] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:15:07 2022] GET /compute/v2.1/servers/cf1f1bf7-3e3b-4e28-b4e5-5279b05cd751 => generated 1485 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:15:07.450807 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-fe0c51cd-bcba-463c-a854-b54de421670e tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:15:07.451451 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-fe0c51cd-bcba-463c-a854-b54de421670e tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: cf1f1bf7-3e3b-4e28-b4e5-5279b05cd751] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:07.458449 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fe0c51cd-bcba-463c-a854-b54de421670e tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:07.458960 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fe0c51cd-bcba-463c-a854-b54de421670e tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:07.459408 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fe0c51cd-bcba-463c-a854-b54de421670e tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:07.460110 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fe0c51cd-bcba-463c-a854-b54de421670e tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:07.460575 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fe0c51cd-bcba-463c-a854-b54de421670e tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:07.460997 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fe0c51cd-bcba-463c-a854-b54de421670e tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:07.497857 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.objects.instance [None req-fe0c51cd-bcba-463c-a854-b54de421670e tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lazy-loading 'flavor' on Instance uuid cf1f1bf7-3e3b-4e28-b4e5-5279b05cd751 {{(pid=128758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:15:07.808227 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-fe0c51cd-bcba-463c-a854-b54de421670e tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "POST /compute/v2.1/servers/cf1f1bf7-3e3b-4e28-b4e5-5279b05cd751/action" status: 202 len: 0 microversion: 2.1 time: 0.363101 Sep 14 09:15:07.810794 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2585/5143] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:15:07 2022] POST /compute/v2.1/servers/cf1f1bf7-3e3b-4e28-b4e5-5279b05cd751/action => generated 0 bytes in 367 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:15:07.822037 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-f6df4d02-aa2e-4c35-865b-eb6da47babbe tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:07.822832 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-f6df4d02-aa2e-4c35-865b-eb6da47babbe tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: cf1f1bf7-3e3b-4e28-b4e5-5279b05cd751] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:07.829196 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-84926ca0-d0ee-4b72-8b25-25f3c2444b79 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:07.829835 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-84926ca0-d0ee-4b72-8b25-25f3c2444b79 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] [instance: cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:07.831958 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f6df4d02-aa2e-4c35-865b-eb6da47babbe tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:07.833250 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f6df4d02-aa2e-4c35-865b-eb6da47babbe tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:07.834076 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f6df4d02-aa2e-4c35-865b-eb6da47babbe tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:07.835358 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f6df4d02-aa2e-4c35-865b-eb6da47babbe tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:07.836330 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f6df4d02-aa2e-4c35-865b-eb6da47babbe tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:07.837048 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f6df4d02-aa2e-4c35-865b-eb6da47babbe tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:07.847431 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-84926ca0-d0ee-4b72-8b25-25f3c2444b79 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:07.848157 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-84926ca0-d0ee-4b72-8b25-25f3c2444b79 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:07.848620 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-84926ca0-d0ee-4b72-8b25-25f3c2444b79 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:07.850952 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-84926ca0-d0ee-4b72-8b25-25f3c2444b79 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:07.855197 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-84926ca0-d0ee-4b72-8b25-25f3c2444b79 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:07.855668 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-84926ca0-d0ee-4b72-8b25-25f3c2444b79 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:08.069677 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-f6df4d02-aa2e-4c35-865b-eb6da47babbe tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:08.080950 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-f6df4d02-aa2e-4c35-865b-eb6da47babbe tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/cf1f1bf7-3e3b-4e28-b4e5-5279b05cd751" status: 200 len: 1491 microversion: 2.1 time: 0.265798 Sep 14 09:15:08.081920 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2586/5144] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:15:07 2022] GET /compute/v2.1/servers/cf1f1bf7-3e3b-4e28-b4e5-5279b05cd751 => generated 1491 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:15:08.097992 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-3199fb4f-d9b4-4656-9826-0cb3d5daabb9 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:08.098739 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-84926ca0-d0ee-4b72-8b25-25f3c2444b79 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb33a017168c4a8bae36eacd9ba6a7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24f2e13835b240578d411521ee520115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:08.099221 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-3199fb4f-d9b4-4656-9826-0cb3d5daabb9 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 50157c1b-c748-4d1f-928e-207482b37ec6] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:08.105896 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3199fb4f-d9b4-4656-9826-0cb3d5daabb9 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:08.106791 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3199fb4f-d9b4-4656-9826-0cb3d5daabb9 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:08.107693 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3199fb4f-d9b4-4656-9826-0cb3d5daabb9 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:08.108410 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3199fb4f-d9b4-4656-9826-0cb3d5daabb9 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:08.109018 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3199fb4f-d9b4-4656-9826-0cb3d5daabb9 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:08.109601 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3199fb4f-d9b4-4656-9826-0cb3d5daabb9 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:08.111629 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-84926ca0-d0ee-4b72-8b25-25f3c2444b79 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] 10.222.0.60 "GET /compute/v2.1/servers/cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f" status: 200 len: 1505 microversion: 2.1 time: 0.296209 Sep 14 09:15:08.113005 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2559/5145] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:15:07 2022] GET /compute/v2.1/servers/cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f => generated 1505 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:15:08.266740 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-3199fb4f-d9b4-4656-9826-0cb3d5daabb9 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:08.277687 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-3199fb4f-d9b4-4656-9826-0cb3d5daabb9 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:08.279320 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-3199fb4f-d9b4-4656-9826-0cb3d5daabb9 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:08.281054 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-3199fb4f-d9b4-4656-9826-0cb3d5daabb9 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6" status: 200 len: 1722 microversion: 2.20 time: 0.186969 Sep 14 09:15:08.292765 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2587/5146] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:15:08 2022] GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6 => generated 1722 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 09:15:09.108651 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e409b792-1e61-4257-a415-4810a183b40e tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:09.110177 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e409b792-1e61-4257-a415-4810a183b40e tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: cf1f1bf7-3e3b-4e28-b4e5-5279b05cd751] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:09.120298 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e409b792-1e61-4257-a415-4810a183b40e tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:09.121110 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e409b792-1e61-4257-a415-4810a183b40e tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:09.121756 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e409b792-1e61-4257-a415-4810a183b40e tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:09.122741 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e409b792-1e61-4257-a415-4810a183b40e tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:09.123552 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e409b792-1e61-4257-a415-4810a183b40e tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:09.124174 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e409b792-1e61-4257-a415-4810a183b40e tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:09.137684 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-7cc96425-6727-4bc3-8385-c40bd098df0f tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:09.139082 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-7cc96425-6727-4bc3-8385-c40bd098df0f tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] [instance: cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:09.149371 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7cc96425-6727-4bc3-8385-c40bd098df0f tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:09.149813 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7cc96425-6727-4bc3-8385-c40bd098df0f tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:09.150844 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7cc96425-6727-4bc3-8385-c40bd098df0f tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:09.151590 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7cc96425-6727-4bc3-8385-c40bd098df0f tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:09.152563 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7cc96425-6727-4bc3-8385-c40bd098df0f tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:09.160870 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7cc96425-6727-4bc3-8385-c40bd098df0f tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:09.416231 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-7cc96425-6727-4bc3-8385-c40bd098df0f tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb33a017168c4a8bae36eacd9ba6a7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24f2e13835b240578d411521ee520115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:09.425826 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-7cc96425-6727-4bc3-8385-c40bd098df0f tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] 10.222.0.60 "GET /compute/v2.1/servers/cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f" status: 200 len: 1505 microversion: 2.1 time: 0.293476 Sep 14 09:15:09.435831 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2588/5147] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:15:09 2022] GET /compute/v2.1/servers/cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f => generated 1505 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:15:09.448675 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d6d22ff3-7328-419d-b5fe-538f418bcde2 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:09.451113 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-d6d22ff3-7328-419d-b5fe-538f418bcde2 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 50157c1b-c748-4d1f-928e-207482b37ec6] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:09.468060 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d6d22ff3-7328-419d-b5fe-538f418bcde2 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:09.470286 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d6d22ff3-7328-419d-b5fe-538f418bcde2 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:09.471442 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d6d22ff3-7328-419d-b5fe-538f418bcde2 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:09.472286 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-e409b792-1e61-4257-a415-4810a183b40e tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:09.473127 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d6d22ff3-7328-419d-b5fe-538f418bcde2 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:09.473607 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d6d22ff3-7328-419d-b5fe-538f418bcde2 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:09.474130 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d6d22ff3-7328-419d-b5fe-538f418bcde2 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:09.484418 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e409b792-1e61-4257-a415-4810a183b40e tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/cf1f1bf7-3e3b-4e28-b4e5-5279b05cd751" status: 200 len: 1491 microversion: 2.1 time: 0.379954 Sep 14 09:15:09.485043 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2560/5148] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:15:09 2022] GET /compute/v2.1/servers/cf1f1bf7-3e3b-4e28-b4e5-5279b05cd751 => generated 1491 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:15:09.632169 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-0fe3b011-7f01-45dd-a08d-8422a2d5f982 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "40241786-54d4-47dd-8a8c-b712b2aa39ed"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:15:09.635857 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-0fe3b011-7f01-45dd-a08d-8422a2d5f982 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [instance: 53aade05-189d-455b-901e-6fb092cfbb07] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:09.642807 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0fe3b011-7f01-45dd-a08d-8422a2d5f982 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:09.643444 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0fe3b011-7f01-45dd-a08d-8422a2d5f982 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:09.644520 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0fe3b011-7f01-45dd-a08d-8422a2d5f982 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:09.645086 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0fe3b011-7f01-45dd-a08d-8422a2d5f982 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:09.645922 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0fe3b011-7f01-45dd-a08d-8422a2d5f982 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:09.646611 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0fe3b011-7f01-45dd-a08d-8422a2d5f982 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:09.679196 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-d6d22ff3-7328-419d-b5fe-538f418bcde2 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:09.688326 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-d6d22ff3-7328-419d-b5fe-538f418bcde2 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:09.692470 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-d6d22ff3-7328-419d-b5fe-538f418bcde2 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:09.692470 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-d6d22ff3-7328-419d-b5fe-538f418bcde2 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6" status: 200 len: 1722 microversion: 2.20 time: 0.253052 Sep 14 09:15:09.703511 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2589/5149] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:15:09 2022] GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6 => generated 1722 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:15:09.772394 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-0fe3b011-7f01-45dd-a08d-8422a2d5f982 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] HTTP exception thrown: Invalid volume: volume 40241786-54d4-47dd-8a8c-b712b2aa39ed is already attached to instances: 53aade05-189d-455b-901e-6fb092cfbb07 Sep 14 09:15:09.774195 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-0fe3b011-7f01-45dd-a08d-8422a2d5f982 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Request method failure captured: Sep 14 09:15:09.774195 n-d-836830-18 devstack@n-api.service[128759]: request: POST /compute/v2.1/servers/53aade05-189d-455b-901e-6fb092cfbb07/os-volume_attachments HTTP/1.1 Sep 14 09:15:09.774195 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:15:09.774195 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:15:09.774195 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:15:09.774195 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 74 Sep 14 09:15:09.774195 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:15:09.774195 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:15:09.774195 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:15:09.774195 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:15:09.774195 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZplAooet3f0j7YfTn10UjWWncQT1X8Zx5oRj6ix43s3Uyu8Vx6JxK5zNIVmYD3adrXMKIf-yKfD6YAxNfiXzTvsjQqMQGw8jI4-W3D7BlestqvRpahzOMSDEzmtF5nK9S-Py3GvFBoobDIQWLv-aBhO1lijqGds4gt8aJhEwjvOnnU Sep 14 09:15:09.774195 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:15:09.774195 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:15:09.774195 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:15:09.774195 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:15:09.774195 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:15:09.774195 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:15:09.774195 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 9672a6c416ee44289eaa4d7c664d307e Sep 14 09:15:09.774195 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-AttachVolumeNegativeTest-1303332785 Sep 14 09:15:09.774195 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:15:09.774195 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:15:09.774195 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/9672a6c416ee44289eaa4d7c664d307e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_9672a6c416ee44289eaa4d7c664d307e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9672a6c416ee44289eaa4d7c664d307e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9672a6c416ee44289eaa4d7c664d307e"}]}] Sep 14 09:15:09.774195 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-AttachVolumeNegativeTest-1303332785 Sep 14 09:15:09.774195 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 9672a6c416ee44289eaa4d7c664d307e Sep 14 09:15:09.774195 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1303332785 Sep 14 09:15:09.774195 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-AttachVolumeNegativeTest-1303332785-project Sep 14 09:15:09.774195 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:15:09.774195 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:15:09.774195 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 7daab4f69af5452c8641006d9f09edce Sep 14 09:15:09.774195 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-AttachVolumeNegativeTest-1303332785-project Sep 14 09:15:09.774195 n-d-836830-18 devstack@n-api.service[128759]: Sep 14 09:15:09.774195 n-d-836830-18 devstack@n-api.service[128759]: {"volumeAttachment": {"volumeId": "40241786-54d4-47dd-8a8c-b712b2aa39ed"}} Sep 14 09:15:09.774195 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:15:09.774195 n-d-836830-18 devstack@n-api.service[128759]: exception: Invalid volume: volume 40241786-54d4-47dd-8a8c-b712b2aa39ed is already attached to instances: 53aade05-189d-455b-901e-6fb092cfbb07 Sep 14 09:15:09.774195 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'server_id': '53aade05-189d-455b-901e-6fb092cfbb07', 'body': {'volumeAttachment': {'volumeId': '40241786-54d4-47dd-8a8c-b712b2aa39ed'}}} Sep 14 09:15:09.774195 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:15:09.774195 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:15:09.774195 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 14 09:15:09.774195 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 14 09:15:09.774195 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 14 09:15:09.774195 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 14 09:15:09.774195 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 14 09:15:09.774195 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 14 09:15:09.774195 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 14 09:15:09.774195 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 14 09:15:09.774195 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 14 09:15:09.774195 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 14 09:15:09.774195 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 40241786-54d4-47dd-8a8c-b712b2aa39ed is already attached to instances: 53aade05-189d-455b-901e-6fb092cfbb07 Sep 14 09:15:09.774195 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:15:09.774195 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:15:09.774195 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:15:09.774195 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:15:09.774195 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:15:09.774195 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:15:09.774195 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:15:09.774195 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:15:09.774195 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:15:09.774195 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:15:09.774195 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:15:09.774195 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:15:09.774195 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:15:09.774195 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:15:09.778422 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:15:09.778422 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:15:09.778422 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 14 09:15:09.778422 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 14 09:15:09.778422 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 40241786-54d4-47dd-8a8c-b712b2aa39ed is already attached to instances: 53aade05-189d-455b-901e-6fb092cfbb07 Sep 14 09:15:09.778422 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:15:09.778422 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:15:09.778422 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:15:09.778422 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:15:09.778422 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:15:09.778422 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:15:09.778422 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:15:09.778422 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:15:09.778422 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 40241786-54d4-47dd-8a8c-b712b2aa39ed is already attached to instances: 53aade05-189d-455b-901e-6fb092cfbb07 Sep 14 09:15:09.778422 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:15:09.780409 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-0fe3b011-7f01-45dd-a08d-8422a2d5f982 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Returning 400 to user: Invalid volume: volume 40241786-54d4-47dd-8a8c-b712b2aa39ed is already attached to instances: 53aade05-189d-455b-901e-6fb092cfbb07 {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:15:09.781458 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-0fe3b011-7f01-45dd-a08d-8422a2d5f982 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "POST /compute/v2.1/servers/53aade05-189d-455b-901e-6fb092cfbb07/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.153885 Sep 14 09:15:09.782194 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2561/5150] 10.222.0.60 () {60 vars in 1323 bytes} [Wed Sep 14 09:15:09 2022] POST /compute/v2.1/servers/53aade05-189d-455b-901e-6fb092cfbb07/os-volume_attachments => generated 174 bytes in 155 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 14 09:15:09.865429 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-45c47839-ccd5-45a2-8fa1-22d62f4fa73f tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:09.866384 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-45c47839-ccd5-45a2-8fa1-22d62f4fa73f tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [instance: 53aade05-189d-455b-901e-6fb092cfbb07] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:09.873586 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-45c47839-ccd5-45a2-8fa1-22d62f4fa73f tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:09.874129 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-45c47839-ccd5-45a2-8fa1-22d62f4fa73f tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:09.874576 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-45c47839-ccd5-45a2-8fa1-22d62f4fa73f tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:09.875389 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-45c47839-ccd5-45a2-8fa1-22d62f4fa73f tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:09.875852 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-45c47839-ccd5-45a2-8fa1-22d62f4fa73f tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:09.876285 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-45c47839-ccd5-45a2-8fa1-22d62f4fa73f tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:09.980085 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.objects.instance [None req-45c47839-ccd5-45a2-8fa1-22d62f4fa73f tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lazy-loading 'services' on Instance uuid 53aade05-189d-455b-901e-6fb092cfbb07 {{(pid=128758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:15:10.077856 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-45c47839-ccd5-45a2-8fa1-22d62f4fa73f tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "DELETE /compute/v2.1/servers/53aade05-189d-455b-901e-6fb092cfbb07/os-volume_attachments/40241786-54d4-47dd-8a8c-b712b2aa39ed" status: 202 len: 0 microversion: 2.1 time: 0.216195 Sep 14 09:15:10.082109 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2590/5151] 10.222.0.60 () {58 vars in 1416 bytes} [Wed Sep 14 09:15:09 2022] DELETE /compute/v2.1/servers/53aade05-189d-455b-901e-6fb092cfbb07/os-volume_attachments/40241786-54d4-47dd-8a8c-b712b2aa39ed => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:15:10.087443 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-473e2e56-08ee-4548-8b98-4ee7288b9507 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:10.090473 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-473e2e56-08ee-4548-8b98-4ee7288b9507 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [instance: 53aade05-189d-455b-901e-6fb092cfbb07] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:10.098259 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-473e2e56-08ee-4548-8b98-4ee7288b9507 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:10.100099 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-473e2e56-08ee-4548-8b98-4ee7288b9507 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:10.102465 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-473e2e56-08ee-4548-8b98-4ee7288b9507 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:10.103538 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-473e2e56-08ee-4548-8b98-4ee7288b9507 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:10.104837 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-473e2e56-08ee-4548-8b98-4ee7288b9507 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:10.108024 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-473e2e56-08ee-4548-8b98-4ee7288b9507 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:10.155196 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-473e2e56-08ee-4548-8b98-4ee7288b9507 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "GET /compute/v2.1/servers/53aade05-189d-455b-901e-6fb092cfbb07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072017 Sep 14 09:15:10.156592 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2562/5152] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 14 09:15:10 2022] GET /compute/v2.1/servers/53aade05-189d-455b-901e-6fb092cfbb07/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:15:10.480536 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-6a49a06d-190a-4593-8e82-1512f39c260f tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:10.483128 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-6a49a06d-190a-4593-8e82-1512f39c260f tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] [instance: cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:10.501322 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6a49a06d-190a-4593-8e82-1512f39c260f tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:10.501819 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6a49a06d-190a-4593-8e82-1512f39c260f tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:10.502267 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6a49a06d-190a-4593-8e82-1512f39c260f tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:10.503032 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6a49a06d-190a-4593-8e82-1512f39c260f tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:10.503478 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6a49a06d-190a-4593-8e82-1512f39c260f tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:10.503914 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6a49a06d-190a-4593-8e82-1512f39c260f tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:10.516442 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-91df4750-9b46-45e6-8261-2c3b82919cdb tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:10.517077 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-91df4750-9b46-45e6-8261-2c3b82919cdb tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: cf1f1bf7-3e3b-4e28-b4e5-5279b05cd751] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:10.532601 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-91df4750-9b46-45e6-8261-2c3b82919cdb tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:10.533131 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-91df4750-9b46-45e6-8261-2c3b82919cdb tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:10.533585 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-91df4750-9b46-45e6-8261-2c3b82919cdb tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:10.541928 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-91df4750-9b46-45e6-8261-2c3b82919cdb tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:10.542441 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-91df4750-9b46-45e6-8261-2c3b82919cdb tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:10.542893 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-91df4750-9b46-45e6-8261-2c3b82919cdb tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:10.920864 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-91df4750-9b46-45e6-8261-2c3b82919cdb tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:10.933901 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-6a49a06d-190a-4593-8e82-1512f39c260f tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb33a017168c4a8bae36eacd9ba6a7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24f2e13835b240578d411521ee520115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:10.948127 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-6a49a06d-190a-4593-8e82-1512f39c260f tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] 10.222.0.60 "GET /compute/v2.1/servers/cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f" status: 200 len: 1505 microversion: 2.1 time: 0.470103 Sep 14 09:15:10.949028 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2591/5153] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:15:10 2022] GET /compute/v2.1/servers/cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f => generated 1505 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:15:10.949217 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-91df4750-9b46-45e6-8261-2c3b82919cdb tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/cf1f1bf7-3e3b-4e28-b4e5-5279b05cd751" status: 200 len: 1512 microversion: 2.1 time: 0.437295 Sep 14 09:15:10.950609 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2563/5154] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:15:10 2022] GET /compute/v2.1/servers/cf1f1bf7-3e3b-4e28-b4e5-5279b05cd751 => generated 1512 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:15:10.955535 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-cd23ace1-2c89-41ce-a6d2-58cfe72a68af tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:10.961809 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-cd23ace1-2c89-41ce-a6d2-58cfe72a68af tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 50157c1b-c748-4d1f-928e-207482b37ec6] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:10.977256 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cd23ace1-2c89-41ce-a6d2-58cfe72a68af tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:10.980736 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cd23ace1-2c89-41ce-a6d2-58cfe72a68af tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:10.983588 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cd23ace1-2c89-41ce-a6d2-58cfe72a68af tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:10.984618 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cd23ace1-2c89-41ce-a6d2-58cfe72a68af tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:10.985299 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cd23ace1-2c89-41ce-a6d2-58cfe72a68af tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:10.985941 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cd23ace1-2c89-41ce-a6d2-58cfe72a68af tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:11.169768 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e645b52a-ae24-489a-be7f-7f5ec8990a98 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:11.173063 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e645b52a-ae24-489a-be7f-7f5ec8990a98 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [instance: 53aade05-189d-455b-901e-6fb092cfbb07] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:11.188677 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e645b52a-ae24-489a-be7f-7f5ec8990a98 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:11.189385 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e645b52a-ae24-489a-be7f-7f5ec8990a98 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:11.189843 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e645b52a-ae24-489a-be7f-7f5ec8990a98 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:11.190566 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e645b52a-ae24-489a-be7f-7f5ec8990a98 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:11.194277 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e645b52a-ae24-489a-be7f-7f5ec8990a98 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:11.194741 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e645b52a-ae24-489a-be7f-7f5ec8990a98 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:11.246193 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e645b52a-ae24-489a-be7f-7f5ec8990a98 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "GET /compute/v2.1/servers/53aade05-189d-455b-901e-6fb092cfbb07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080959 Sep 14 09:15:11.247137 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2564/5155] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 14 09:15:11 2022] GET /compute/v2.1/servers/53aade05-189d-455b-901e-6fb092cfbb07/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:15:11.331534 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-cd23ace1-2c89-41ce-a6d2-58cfe72a68af tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:11.345224 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-cd23ace1-2c89-41ce-a6d2-58cfe72a68af tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:11.347133 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-cd23ace1-2c89-41ce-a6d2-58cfe72a68af tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:11.348988 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-cd23ace1-2c89-41ce-a6d2-58cfe72a68af tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6" status: 200 len: 1722 microversion: 2.20 time: 0.397315 Sep 14 09:15:11.351763 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2592/5156] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:15:10 2022] GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6 => generated 1722 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:15:11.998734 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f240f6c1-d153-4ab3-8219-6a8692f65f67 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:11.999481 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f240f6c1-d153-4ab3-8219-6a8692f65f67 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] [instance: cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:12.005681 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f240f6c1-d153-4ab3-8219-6a8692f65f67 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:12.006356 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f240f6c1-d153-4ab3-8219-6a8692f65f67 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:12.007053 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f240f6c1-d153-4ab3-8219-6a8692f65f67 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:12.008000 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f240f6c1-d153-4ab3-8219-6a8692f65f67 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:12.008532 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f240f6c1-d153-4ab3-8219-6a8692f65f67 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:12.009035 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f240f6c1-d153-4ab3-8219-6a8692f65f67 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:12.017718 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-33277a45-3ed2-47bd-a200-9709922225ee tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:12.018408 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-33277a45-3ed2-47bd-a200-9709922225ee tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: cf1f1bf7-3e3b-4e28-b4e5-5279b05cd751] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:12.041199 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-33277a45-3ed2-47bd-a200-9709922225ee tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:12.042040 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-33277a45-3ed2-47bd-a200-9709922225ee tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:12.042686 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-33277a45-3ed2-47bd-a200-9709922225ee tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:12.061717 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-33277a45-3ed2-47bd-a200-9709922225ee tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:12.062671 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-33277a45-3ed2-47bd-a200-9709922225ee tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:12.066871 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-33277a45-3ed2-47bd-a200-9709922225ee tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:12.398328 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-33277a45-3ed2-47bd-a200-9709922225ee tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:12.417555 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f240f6c1-d153-4ab3-8219-6a8692f65f67 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb33a017168c4a8bae36eacd9ba6a7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24f2e13835b240578d411521ee520115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:12.422181 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-33277a45-3ed2-47bd-a200-9709922225ee tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/cf1f1bf7-3e3b-4e28-b4e5-5279b05cd751" status: 200 len: 1512 microversion: 2.1 time: 0.408325 Sep 14 09:15:12.424716 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2593/5157] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:15:12 2022] GET /compute/v2.1/servers/cf1f1bf7-3e3b-4e28-b4e5-5279b05cd751 => generated 1512 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:15:12.428961 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f240f6c1-d153-4ab3-8219-6a8692f65f67 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] 10.222.0.60 "GET /compute/v2.1/servers/cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f" status: 200 len: 1505 microversion: 2.1 time: 0.435234 Sep 14 09:15:12.429544 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2565/5158] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:15:11 2022] GET /compute/v2.1/servers/cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f => generated 1505 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:15:12.438285 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-7209eb1d-2f18-423a-b0bf-d6a6183a036f tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:12.439953 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-155d3cf6-20d4-4dc2-8654-a11a55b1c6df tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:12.444626 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-7209eb1d-2f18-423a-b0bf-d6a6183a036f tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 50157c1b-c748-4d1f-928e-207482b37ec6] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:12.452697 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-155d3cf6-20d4-4dc2-8654-a11a55b1c6df tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [instance: 53aade05-189d-455b-901e-6fb092cfbb07] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:12.456834 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7209eb1d-2f18-423a-b0bf-d6a6183a036f tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:12.458008 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7209eb1d-2f18-423a-b0bf-d6a6183a036f tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:12.459300 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7209eb1d-2f18-423a-b0bf-d6a6183a036f tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:12.461255 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7209eb1d-2f18-423a-b0bf-d6a6183a036f tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:12.463058 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7209eb1d-2f18-423a-b0bf-d6a6183a036f tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:12.464942 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7209eb1d-2f18-423a-b0bf-d6a6183a036f tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:12.467494 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-155d3cf6-20d4-4dc2-8654-a11a55b1c6df tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:12.470196 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-155d3cf6-20d4-4dc2-8654-a11a55b1c6df tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:12.472827 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-155d3cf6-20d4-4dc2-8654-a11a55b1c6df tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:12.480790 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-155d3cf6-20d4-4dc2-8654-a11a55b1c6df tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:12.481526 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-155d3cf6-20d4-4dc2-8654-a11a55b1c6df tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:12.481983 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-155d3cf6-20d4-4dc2-8654-a11a55b1c6df tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:12.530667 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-155d3cf6-20d4-4dc2-8654-a11a55b1c6df tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "GET /compute/v2.1/servers/53aade05-189d-455b-901e-6fb092cfbb07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.104612 Sep 14 09:15:12.532056 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2594/5159] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 14 09:15:12 2022] GET /compute/v2.1/servers/53aade05-189d-455b-901e-6fb092cfbb07/os-volume_attachments => generated 197 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:15:12.740584 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-7209eb1d-2f18-423a-b0bf-d6a6183a036f tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:12.752831 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-7209eb1d-2f18-423a-b0bf-d6a6183a036f tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:12.761776 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-7209eb1d-2f18-423a-b0bf-d6a6183a036f tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:12.763107 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-7209eb1d-2f18-423a-b0bf-d6a6183a036f tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6" status: 200 len: 1722 microversion: 2.20 time: 0.328479 Sep 14 09:15:12.763976 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2566/5160] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:15:12 2022] GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6 => generated 1722 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:15:12.777000 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-2ef95fbc-65ce-4f3a-a440-9085c3a53478 req-45c67715-3e5b-4d83-b590-9db4ff65fbf9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf1f1bf7-3e3b-4e28-b4e5-5279b05cd751", "name": "network-vif-plugged", "status": "completed", "tag": "44b6b52c-db23-4790-a977-0e4c3a8cdcf5"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:15:12.797405 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-2ef95fbc-65ce-4f3a-a440-9085c3a53478 req-45c67715-3e5b-4d83-b590-9db4ff65fbf9 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:12.798160 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-2ef95fbc-65ce-4f3a-a440-9085c3a53478 req-45c67715-3e5b-4d83-b590-9db4ff65fbf9 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:12.800810 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-2ef95fbc-65ce-4f3a-a440-9085c3a53478 req-45c67715-3e5b-4d83-b590-9db4ff65fbf9 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:12.835024 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-2ef95fbc-65ce-4f3a-a440-9085c3a53478 req-45c67715-3e5b-4d83-b590-9db4ff65fbf9 service nova] Creating event network-vif-plugged:44b6b52c-db23-4790-a977-0e4c3a8cdcf5 for instance cf1f1bf7-3e3b-4e28-b4e5-5279b05cd751 on n-h1-836830-18 Sep 14 09:15:12.849856 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-2ef95fbc-65ce-4f3a-a440-9085c3a53478 req-45c67715-3e5b-4d83-b590-9db4ff65fbf9 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089240 Sep 14 09:15:12.851040 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2595/5161] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:15:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:15:13.451877 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-7253dbde-5dad-47b9-a925-6f5a538b71d1 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:13.452638 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-7253dbde-5dad-47b9-a925-6f5a538b71d1 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: cf1f1bf7-3e3b-4e28-b4e5-5279b05cd751] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:13.457486 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-84ac3b72-d2f3-406c-bdf4-9b5da21fa8bd tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:13.458209 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-84ac3b72-d2f3-406c-bdf4-9b5da21fa8bd tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] [instance: cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:13.466602 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7253dbde-5dad-47b9-a925-6f5a538b71d1 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:13.473144 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-84ac3b72-d2f3-406c-bdf4-9b5da21fa8bd tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:13.473659 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-84ac3b72-d2f3-406c-bdf4-9b5da21fa8bd tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:13.474107 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-84ac3b72-d2f3-406c-bdf4-9b5da21fa8bd tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:13.474362 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7253dbde-5dad-47b9-a925-6f5a538b71d1 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:13.474851 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-84ac3b72-d2f3-406c-bdf4-9b5da21fa8bd tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:13.475349 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-84ac3b72-d2f3-406c-bdf4-9b5da21fa8bd tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:13.475785 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-84ac3b72-d2f3-406c-bdf4-9b5da21fa8bd tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:13.476302 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7253dbde-5dad-47b9-a925-6f5a538b71d1 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:13.479329 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7253dbde-5dad-47b9-a925-6f5a538b71d1 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:13.482926 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7253dbde-5dad-47b9-a925-6f5a538b71d1 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:13.484844 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7253dbde-5dad-47b9-a925-6f5a538b71d1 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:13.898435 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-7253dbde-5dad-47b9-a925-6f5a538b71d1 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:13.910183 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-7253dbde-5dad-47b9-a925-6f5a538b71d1 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/cf1f1bf7-3e3b-4e28-b4e5-5279b05cd751" status: 200 len: 1512 microversion: 2.1 time: 0.466967 Sep 14 09:15:13.913884 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2567/5162] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:15:13 2022] GET /compute/v2.1/servers/cf1f1bf7-3e3b-4e28-b4e5-5279b05cd751 => generated 1512 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:15:13.919378 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-84ac3b72-d2f3-406c-bdf4-9b5da21fa8bd tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb33a017168c4a8bae36eacd9ba6a7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24f2e13835b240578d411521ee520115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:13.926983 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8b1169e2-e780-44cd-b563-f7032ef22dba tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:13.934650 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-84ac3b72-d2f3-406c-bdf4-9b5da21fa8bd tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] 10.222.0.60 "GET /compute/v2.1/servers/cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f" status: 200 len: 1505 microversion: 2.1 time: 0.482156 Sep 14 09:15:13.935539 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2596/5163] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:15:13 2022] GET /compute/v2.1/servers/cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f => generated 1505 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:15:13.957618 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-8b1169e2-e780-44cd-b563-f7032ef22dba tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [instance: 53aade05-189d-455b-901e-6fb092cfbb07] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:13.960602 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-e2dad99b-0669-4794-bd35-86e0544191e1 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:13.963560 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-e2dad99b-0669-4794-bd35-86e0544191e1 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 50157c1b-c748-4d1f-928e-207482b37ec6] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:13.972966 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8b1169e2-e780-44cd-b563-f7032ef22dba tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:13.975865 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8b1169e2-e780-44cd-b563-f7032ef22dba tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:13.976585 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8b1169e2-e780-44cd-b563-f7032ef22dba tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:13.979052 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e2dad99b-0669-4794-bd35-86e0544191e1 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:13.980068 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8b1169e2-e780-44cd-b563-f7032ef22dba tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:13.980778 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8b1169e2-e780-44cd-b563-f7032ef22dba tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:13.981225 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8b1169e2-e780-44cd-b563-f7032ef22dba tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:13.985875 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e2dad99b-0669-4794-bd35-86e0544191e1 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:13.986558 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e2dad99b-0669-4794-bd35-86e0544191e1 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:13.987508 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e2dad99b-0669-4794-bd35-86e0544191e1 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:13.988347 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e2dad99b-0669-4794-bd35-86e0544191e1 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:13.989265 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e2dad99b-0669-4794-bd35-86e0544191e1 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:14.064302 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-8b1169e2-e780-44cd-b563-f7032ef22dba tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "GET /compute/v2.1/servers/53aade05-189d-455b-901e-6fb092cfbb07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.148824 Sep 14 09:15:14.064916 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2568/5164] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 14 09:15:13 2022] GET /compute/v2.1/servers/53aade05-189d-455b-901e-6fb092cfbb07/os-volume_attachments => generated 197 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:15:14.178396 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-e2dad99b-0669-4794-bd35-86e0544191e1 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:14.194529 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-e2dad99b-0669-4794-bd35-86e0544191e1 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:14.196404 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-e2dad99b-0669-4794-bd35-86e0544191e1 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:14.198221 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-e2dad99b-0669-4794-bd35-86e0544191e1 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6" status: 200 len: 1722 microversion: 2.20 time: 0.252069 Sep 14 09:15:14.200505 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2597/5165] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:15:13 2022] GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6 => generated 1722 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:15:14.940151 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-0d3080f2-d94d-487c-9831-2143a1b0ea28 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:14.940773 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-0d3080f2-d94d-487c-9831-2143a1b0ea28 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: cf1f1bf7-3e3b-4e28-b4e5-5279b05cd751] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:14.948286 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0d3080f2-d94d-487c-9831-2143a1b0ea28 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:14.949005 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0d3080f2-d94d-487c-9831-2143a1b0ea28 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:14.949589 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0d3080f2-d94d-487c-9831-2143a1b0ea28 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:14.951021 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0d3080f2-d94d-487c-9831-2143a1b0ea28 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:14.952328 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0d3080f2-d94d-487c-9831-2143a1b0ea28 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:14.953486 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0d3080f2-d94d-487c-9831-2143a1b0ea28 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:14.965610 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-7e571114-9cd1-4fc4-b5d6-cf37b5796f38 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:14.967429 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-7e571114-9cd1-4fc4-b5d6-cf37b5796f38 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] [instance: cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:14.990025 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7e571114-9cd1-4fc4-b5d6-cf37b5796f38 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:14.991506 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7e571114-9cd1-4fc4-b5d6-cf37b5796f38 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:14.995061 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7e571114-9cd1-4fc4-b5d6-cf37b5796f38 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:14.996645 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7e571114-9cd1-4fc4-b5d6-cf37b5796f38 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:14.997468 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7e571114-9cd1-4fc4-b5d6-cf37b5796f38 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:15.000340 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7e571114-9cd1-4fc4-b5d6-cf37b5796f38 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:15.012333 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:15:15.383304 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-0d3080f2-d94d-487c-9831-2143a1b0ea28 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:15.392746 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-0d3080f2-d94d-487c-9831-2143a1b0ea28 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/cf1f1bf7-3e3b-4e28-b4e5-5279b05cd751" status: 200 len: 1507 microversion: 2.1 time: 0.456450 Sep 14 09:15:15.398179 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2569/5166] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:15:14 2022] GET /compute/v2.1/servers/cf1f1bf7-3e3b-4e28-b4e5-5279b05cd751 => generated 1507 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:15:15.424386 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d3874a01-df64-4c6e-a56e-27afe36b23f7 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:15.429553 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-d3874a01-df64-4c6e-a56e-27afe36b23f7 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [instance: 53aade05-189d-455b-901e-6fb092cfbb07] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:15.459806 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d3874a01-df64-4c6e-a56e-27afe36b23f7 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:15.460720 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d3874a01-df64-4c6e-a56e-27afe36b23f7 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:15.461469 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d3874a01-df64-4c6e-a56e-27afe36b23f7 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:15.463085 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d3874a01-df64-4c6e-a56e-27afe36b23f7 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:15.470355 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d3874a01-df64-4c6e-a56e-27afe36b23f7 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:15.471202 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d3874a01-df64-4c6e-a56e-27afe36b23f7 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:15.505938 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-7e571114-9cd1-4fc4-b5d6-cf37b5796f38 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb33a017168c4a8bae36eacd9ba6a7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24f2e13835b240578d411521ee520115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:15.509873 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:15:15.514596 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-7e571114-9cd1-4fc4-b5d6-cf37b5796f38 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] 10.222.0.60 "GET /compute/v2.1/servers/cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f" status: 200 len: 1505 microversion: 2.1 time: 0.556876 Sep 14 09:15:15.521918 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2598/5167] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:15:14 2022] GET /compute/v2.1/servers/cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f => generated 1505 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:15:15.527732 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b7ba431b-b586-47f5-8d62-f3a630d67f17 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:15.540216 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-b7ba431b-b586-47f5-8d62-f3a630d67f17 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 50157c1b-c748-4d1f-928e-207482b37ec6] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:15.553703 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b7ba431b-b586-47f5-8d62-f3a630d67f17 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:15.557210 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b7ba431b-b586-47f5-8d62-f3a630d67f17 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:15.559517 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b7ba431b-b586-47f5-8d62-f3a630d67f17 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:15.560486 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b7ba431b-b586-47f5-8d62-f3a630d67f17 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:15.561159 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b7ba431b-b586-47f5-8d62-f3a630d67f17 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:15.563855 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d3874a01-df64-4c6e-a56e-27afe36b23f7 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "GET /compute/v2.1/servers/53aade05-189d-455b-901e-6fb092cfbb07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.164204 Sep 14 09:15:15.564591 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b7ba431b-b586-47f5-8d62-f3a630d67f17 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:15.570689 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2570/5168] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 14 09:15:15 2022] GET /compute/v2.1/servers/53aade05-189d-455b-901e-6fb092cfbb07/os-volume_attachments => generated 197 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:15:15.796999 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-b7ba431b-b586-47f5-8d62-f3a630d67f17 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:15.806154 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-b7ba431b-b586-47f5-8d62-f3a630d67f17 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:15.813978 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-b7ba431b-b586-47f5-8d62-f3a630d67f17 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:15.815548 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-b7ba431b-b586-47f5-8d62-f3a630d67f17 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6" status: 200 len: 1722 microversion: 2.20 time: 0.292399 Sep 14 09:15:15.816678 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2599/5169] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:15:15 2022] GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6 => generated 1722 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:15:16.427415 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-bfe3319b-e695-4b18-86da-5fba9241ab7b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:16.428659 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-bfe3319b-e695-4b18-86da-5fba9241ab7b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: cf1f1bf7-3e3b-4e28-b4e5-5279b05cd751] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:16.439806 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bfe3319b-e695-4b18-86da-5fba9241ab7b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:16.441988 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bfe3319b-e695-4b18-86da-5fba9241ab7b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:16.444692 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bfe3319b-e695-4b18-86da-5fba9241ab7b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:16.445813 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bfe3319b-e695-4b18-86da-5fba9241ab7b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:16.446292 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bfe3319b-e695-4b18-86da-5fba9241ab7b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:16.446762 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bfe3319b-e695-4b18-86da-5fba9241ab7b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:16.549868 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-2b158214-e036-40a1-b453-349a0b8bf3dc tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:16.550396 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-2b158214-e036-40a1-b453-349a0b8bf3dc tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] [instance: cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:16.560339 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=82 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:15:16.562212 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2b158214-e036-40a1-b453-349a0b8bf3dc tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:16.562714 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2b158214-e036-40a1-b453-349a0b8bf3dc tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:16.571500 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2b158214-e036-40a1-b453-349a0b8bf3dc tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:16.572912 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2b158214-e036-40a1-b453-349a0b8bf3dc tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:16.573408 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2b158214-e036-40a1-b453-349a0b8bf3dc tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:16.573854 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2b158214-e036-40a1-b453-349a0b8bf3dc tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:16.770201 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-bfe3319b-e695-4b18-86da-5fba9241ab7b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:16.785727 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-bfe3319b-e695-4b18-86da-5fba9241ab7b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/cf1f1bf7-3e3b-4e28-b4e5-5279b05cd751" status: 200 len: 1507 microversion: 2.1 time: 0.356517 Sep 14 09:15:16.786983 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2571/5170] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:15:16 2022] GET /compute/v2.1/servers/cf1f1bf7-3e3b-4e28-b4e5-5279b05cd751 => generated 1507 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:15:16.796504 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-fee3e258-4732-481f-9a21-86c98a229c39 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:16.809492 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-fee3e258-4732-481f-9a21-86c98a229c39 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [instance: 53aade05-189d-455b-901e-6fb092cfbb07] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:16.838107 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fee3e258-4732-481f-9a21-86c98a229c39 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:16.838988 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fee3e258-4732-481f-9a21-86c98a229c39 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:16.839673 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fee3e258-4732-481f-9a21-86c98a229c39 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:16.843445 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fee3e258-4732-481f-9a21-86c98a229c39 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:16.847583 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fee3e258-4732-481f-9a21-86c98a229c39 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:16.848303 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fee3e258-4732-481f-9a21-86c98a229c39 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:16.950325 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-fee3e258-4732-481f-9a21-86c98a229c39 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "GET /compute/v2.1/servers/53aade05-189d-455b-901e-6fb092cfbb07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.161094 Sep 14 09:15:16.959308 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2572/5171] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 14 09:15:16 2022] GET /compute/v2.1/servers/53aade05-189d-455b-901e-6fb092cfbb07/os-volume_attachments => generated 197 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:15:16.964902 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-db9468d4-a0b8-4782-9a54-81015772a12f tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:16.970777 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-db9468d4-a0b8-4782-9a54-81015772a12f tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 50157c1b-c748-4d1f-928e-207482b37ec6] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:16.984933 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-db9468d4-a0b8-4782-9a54-81015772a12f tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:16.986087 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-db9468d4-a0b8-4782-9a54-81015772a12f tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:16.986802 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-db9468d4-a0b8-4782-9a54-81015772a12f tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:16.987226 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-2b158214-e036-40a1-b453-349a0b8bf3dc tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb33a017168c4a8bae36eacd9ba6a7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24f2e13835b240578d411521ee520115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:16.988113 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-db9468d4-a0b8-4782-9a54-81015772a12f tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:16.988813 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-db9468d4-a0b8-4782-9a54-81015772a12f tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:16.989458 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-db9468d4-a0b8-4782-9a54-81015772a12f tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:17.005306 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-2b158214-e036-40a1-b453-349a0b8bf3dc tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] 10.222.0.60 "GET /compute/v2.1/servers/cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f" status: 200 len: 1505 microversion: 2.1 time: 0.459462 Sep 14 09:15:17.016118 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2600/5172] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:15:16 2022] GET /compute/v2.1/servers/cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f => generated 1505 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:15:17.179170 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-db9468d4-a0b8-4782-9a54-81015772a12f tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:17.193710 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-db9468d4-a0b8-4782-9a54-81015772a12f tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:17.200345 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-db9468d4-a0b8-4782-9a54-81015772a12f tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:17.203919 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-db9468d4-a0b8-4782-9a54-81015772a12f tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6" status: 200 len: 1743 microversion: 2.20 time: 0.243104 Sep 14 09:15:17.205315 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2573/5173] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:15:16 2022] GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6 => generated 1743 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:15:17.814039 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a5be1215-208a-4a2d-b144-a0c75b87b424 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:17.814669 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-a5be1215-208a-4a2d-b144-a0c75b87b424 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: cf1f1bf7-3e3b-4e28-b4e5-5279b05cd751] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:17.840607 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a5be1215-208a-4a2d-b144-a0c75b87b424 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:17.841025 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a5be1215-208a-4a2d-b144-a0c75b87b424 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:17.841467 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a5be1215-208a-4a2d-b144-a0c75b87b424 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:17.842183 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a5be1215-208a-4a2d-b144-a0c75b87b424 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:17.842654 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a5be1215-208a-4a2d-b144-a0c75b87b424 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:17.858742 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a5be1215-208a-4a2d-b144-a0c75b87b424 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:17.966477 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-4c7436f6-0528-493c-aa20-f46cd1fe7495 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:17.968965 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-4c7436f6-0528-493c-aa20-f46cd1fe7495 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [instance: 53aade05-189d-455b-901e-6fb092cfbb07] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:17.983699 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4c7436f6-0528-493c-aa20-f46cd1fe7495 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:17.991570 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4c7436f6-0528-493c-aa20-f46cd1fe7495 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:17.993662 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4c7436f6-0528-493c-aa20-f46cd1fe7495 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:17.996168 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4c7436f6-0528-493c-aa20-f46cd1fe7495 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:17.998843 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4c7436f6-0528-493c-aa20-f46cd1fe7495 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:18.001359 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4c7436f6-0528-493c-aa20-f46cd1fe7495 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:18.125146 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-4c7436f6-0528-493c-aa20-f46cd1fe7495 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "GET /compute/v2.1/servers/53aade05-189d-455b-901e-6fb092cfbb07/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.163402 Sep 14 09:15:18.136484 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2574/5174] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 14 09:15:17 2022] GET /compute/v2.1/servers/53aade05-189d-455b-901e-6fb092cfbb07/os-volume_attachments => generated 25 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 14 09:15:18.154830 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b1471790-1e98-4fe8-93f8-b750f6f41044 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:18.163677 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b1471790-1e98-4fe8-93f8-b750f6f41044 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] [instance: cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:18.187830 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b1471790-1e98-4fe8-93f8-b750f6f41044 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:18.192716 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b1471790-1e98-4fe8-93f8-b750f6f41044 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:18.193406 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b1471790-1e98-4fe8-93f8-b750f6f41044 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:18.197974 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b1471790-1e98-4fe8-93f8-b750f6f41044 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:18.202185 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b1471790-1e98-4fe8-93f8-b750f6f41044 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:18.203426 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b1471790-1e98-4fe8-93f8-b750f6f41044 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:18.217320 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-a5be1215-208a-4a2d-b144-a0c75b87b424 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:18.226700 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-a5be1215-208a-4a2d-b144-a0c75b87b424 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/cf1f1bf7-3e3b-4e28-b4e5-5279b05cd751" status: 200 len: 1507 microversion: 2.1 time: 0.415393 Sep 14 09:15:18.251150 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2601/5175] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:15:17 2022] GET /compute/v2.1/servers/cf1f1bf7-3e3b-4e28-b4e5-5279b05cd751 => generated 1507 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:15:18.256255 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-579e92da-562b-4c62-b01c-0cb1ac3fd84c tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:18.256890 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-579e92da-562b-4c62-b01c-0cb1ac3fd84c tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 50157c1b-c748-4d1f-928e-207482b37ec6] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:18.277046 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-579e92da-562b-4c62-b01c-0cb1ac3fd84c tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:18.277822 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-579e92da-562b-4c62-b01c-0cb1ac3fd84c tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:18.278421 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-579e92da-562b-4c62-b01c-0cb1ac3fd84c tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:18.279358 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-579e92da-562b-4c62-b01c-0cb1ac3fd84c tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:18.280011 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-579e92da-562b-4c62-b01c-0cb1ac3fd84c tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:18.283295 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-579e92da-562b-4c62-b01c-0cb1ac3fd84c tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:18.938838 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-579e92da-562b-4c62-b01c-0cb1ac3fd84c tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:18.950658 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-579e92da-562b-4c62-b01c-0cb1ac3fd84c tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:18.956204 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-579e92da-562b-4c62-b01c-0cb1ac3fd84c tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:18.958971 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-579e92da-562b-4c62-b01c-0cb1ac3fd84c tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6" status: 200 len: 1738 microversion: 2.20 time: 0.706708 Sep 14 09:15:18.960118 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b1471790-1e98-4fe8-93f8-b750f6f41044 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb33a017168c4a8bae36eacd9ba6a7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24f2e13835b240578d411521ee520115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:18.975963 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2602/5176] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:15:18 2022] GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6 => generated 1738 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:15:18.977737 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b1471790-1e98-4fe8-93f8-b750f6f41044 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] 10.222.0.60 "GET /compute/v2.1/servers/cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f" status: 200 len: 1505 microversion: 2.1 time: 0.839911 Sep 14 09:15:18.978986 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2575/5177] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:15:18 2022] GET /compute/v2.1/servers/cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f => generated 1505 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:15:18.984685 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a0130a99-16ca-49c0-aeab-14be79ff8d08 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:18.985440 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-a0130a99-16ca-49c0-aeab-14be79ff8d08 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [instance: 53aade05-189d-455b-901e-6fb092cfbb07] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:18.992437 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a0130a99-16ca-49c0-aeab-14be79ff8d08 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:18.993131 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a0130a99-16ca-49c0-aeab-14be79ff8d08 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:18.994462 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a0130a99-16ca-49c0-aeab-14be79ff8d08 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:18.995376 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a0130a99-16ca-49c0-aeab-14be79ff8d08 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:18.996523 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a0130a99-16ca-49c0-aeab-14be79ff8d08 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:18.997121 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a0130a99-16ca-49c0-aeab-14be79ff8d08 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:19.026795 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-a0130a99-16ca-49c0-aeab-14be79ff8d08 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [instance: 53aade05-189d-455b-901e-6fb092cfbb07] Going to try to terminate instance {{(pid=128758) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:15:19.142843 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-a0130a99-16ca-49c0-aeab-14be79ff8d08 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "DELETE /compute/v2.1/servers/53aade05-189d-455b-901e-6fb092cfbb07" status: 204 len: 0 microversion: 2.1 time: 0.165382 Sep 14 09:15:19.144090 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2603/5178] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:15:18 2022] DELETE /compute/v2.1/servers/53aade05-189d-455b-901e-6fb092cfbb07 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:15:19.153873 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-4b722183-e5c4-4d99-bca2-b68556dae6b4 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:19.154670 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-4b722183-e5c4-4d99-bca2-b68556dae6b4 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [instance: 53aade05-189d-455b-901e-6fb092cfbb07] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:19.164944 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4b722183-e5c4-4d99-bca2-b68556dae6b4 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:19.169982 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4b722183-e5c4-4d99-bca2-b68556dae6b4 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:19.171916 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4b722183-e5c4-4d99-bca2-b68556dae6b4 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:19.172799 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4b722183-e5c4-4d99-bca2-b68556dae6b4 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:19.173772 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4b722183-e5c4-4d99-bca2-b68556dae6b4 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:19.174613 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4b722183-e5c4-4d99-bca2-b68556dae6b4 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:19.261983 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-7e370d79-c3d7-4a57-8445-dee539bf6945 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:19.263061 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-7e370d79-c3d7-4a57-8445-dee539bf6945 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: cf1f1bf7-3e3b-4e28-b4e5-5279b05cd751] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:19.288732 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7e370d79-c3d7-4a57-8445-dee539bf6945 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:19.289249 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7e370d79-c3d7-4a57-8445-dee539bf6945 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:19.291301 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7e370d79-c3d7-4a57-8445-dee539bf6945 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:19.294210 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7e370d79-c3d7-4a57-8445-dee539bf6945 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:19.295025 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7e370d79-c3d7-4a57-8445-dee539bf6945 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:19.295991 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7e370d79-c3d7-4a57-8445-dee539bf6945 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:19.471958 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-4b722183-e5c4-4d99-bca2-b68556dae6b4 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daab4f69af5452c8641006d9f09edce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9672a6c416ee44289eaa4d7c664d307e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:19.482195 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-4b722183-e5c4-4d99-bca2-b68556dae6b4 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "GET /compute/v2.1/servers/53aade05-189d-455b-901e-6fb092cfbb07" status: 200 len: 1682 microversion: 2.1 time: 0.333435 Sep 14 09:15:19.486344 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2576/5179] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:15:19 2022] GET /compute/v2.1/servers/53aade05-189d-455b-901e-6fb092cfbb07 => generated 1682 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:15:19.601238 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-7e370d79-c3d7-4a57-8445-dee539bf6945 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:19.627953 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-7e370d79-c3d7-4a57-8445-dee539bf6945 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/cf1f1bf7-3e3b-4e28-b4e5-5279b05cd751" status: 200 len: 1507 microversion: 2.1 time: 0.371602 Sep 14 09:15:19.642979 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2604/5180] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:15:19 2022] GET /compute/v2.1/servers/cf1f1bf7-3e3b-4e28-b4e5-5279b05cd751 => generated 1507 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:15:19.990064 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-2304eeec-1336-4da0-a11a-8437cfdcd199 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:19.991320 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-2304eeec-1336-4da0-a11a-8437cfdcd199 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 50157c1b-c748-4d1f-928e-207482b37ec6] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:20.004402 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-8f2e91c0-34af-43ce-bcce-95d3e69f41cc tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:20.012913 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-8f2e91c0-34af-43ce-bcce-95d3e69f41cc tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] [instance: cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:20.020498 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=3 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:15:20.022996 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2304eeec-1336-4da0-a11a-8437cfdcd199 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:20.024451 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2304eeec-1336-4da0-a11a-8437cfdcd199 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:20.026253 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2304eeec-1336-4da0-a11a-8437cfdcd199 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:20.027868 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2304eeec-1336-4da0-a11a-8437cfdcd199 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:20.028588 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2304eeec-1336-4da0-a11a-8437cfdcd199 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:20.029241 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2304eeec-1336-4da0-a11a-8437cfdcd199 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:20.043166 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8f2e91c0-34af-43ce-bcce-95d3e69f41cc tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:20.043807 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8f2e91c0-34af-43ce-bcce-95d3e69f41cc tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:20.044267 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8f2e91c0-34af-43ce-bcce-95d3e69f41cc tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:20.045014 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8f2e91c0-34af-43ce-bcce-95d3e69f41cc tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:20.045477 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8f2e91c0-34af-43ce-bcce-95d3e69f41cc tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:20.045904 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8f2e91c0-34af-43ce-bcce-95d3e69f41cc tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:20.593019 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-2304eeec-1336-4da0-a11a-8437cfdcd199 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:20.618211 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-2304eeec-1336-4da0-a11a-8437cfdcd199 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:20.625197 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-2304eeec-1336-4da0-a11a-8437cfdcd199 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:20.628615 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-2304eeec-1336-4da0-a11a-8437cfdcd199 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6" status: 200 len: 1738 microversion: 2.20 time: 0.642964 Sep 14 09:15:20.643873 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2577/5181] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:15:19 2022] GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6 => generated 1738 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:15:20.649169 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-d95a96ae-4a41-4857-b609-5b71eb580597 req-51699072-ef1f-4f23-b237-40224b3d55bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50157c1b-c748-4d1f-928e-207482b37ec6", "name": "network-vif-plugged", "status": "completed", "tag": "6bb7c82b-6dea-4020-abff-f1c92580e9d8"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:15:20.675666 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-d95a96ae-4a41-4857-b609-5b71eb580597 req-51699072-ef1f-4f23-b237-40224b3d55bb service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:20.676407 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-d95a96ae-4a41-4857-b609-5b71eb580597 req-51699072-ef1f-4f23-b237-40224b3d55bb service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:20.677416 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-d95a96ae-4a41-4857-b609-5b71eb580597 req-51699072-ef1f-4f23-b237-40224b3d55bb service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:20.686283 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-8f2e91c0-34af-43ce-bcce-95d3e69f41cc tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb33a017168c4a8bae36eacd9ba6a7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24f2e13835b240578d411521ee520115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:20.695921 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-d95a96ae-4a41-4857-b609-5b71eb580597 req-51699072-ef1f-4f23-b237-40224b3d55bb service nova] Creating event network-vif-plugged:6bb7c82b-6dea-4020-abff-f1c92580e9d8 for instance 50157c1b-c748-4d1f-928e-207482b37ec6 on n-h2-836830-18 Sep 14 09:15:20.698431 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-8f2e91c0-34af-43ce-bcce-95d3e69f41cc tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] 10.222.0.60 "GET /compute/v2.1/servers/cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f" status: 200 len: 1505 microversion: 2.1 time: 0.697848 Sep 14 09:15:20.703391 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2605/5182] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:15:19 2022] GET /compute/v2.1/servers/cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f => generated 1505 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:15:20.708353 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1766da1d-ea66-4e19-a158-c37f159fa907 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:20.708977 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-1766da1d-ea66-4e19-a158-c37f159fa907 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [instance: 53aade05-189d-455b-901e-6fb092cfbb07] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:20.715925 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-d95a96ae-4a41-4857-b609-5b71eb580597 req-51699072-ef1f-4f23-b237-40224b3d55bb service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070307 Sep 14 09:15:20.717027 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2578/5183] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:15:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:15:20.730632 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-66d4a35c-bef3-4fe7-a188-1821c7dc3bc4 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:20.731713 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-66d4a35c-bef3-4fe7-a188-1821c7dc3bc4 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: cf1f1bf7-3e3b-4e28-b4e5-5279b05cd751] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:20.742214 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-66d4a35c-bef3-4fe7-a188-1821c7dc3bc4 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:20.742557 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1766da1d-ea66-4e19-a158-c37f159fa907 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:20.743111 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1766da1d-ea66-4e19-a158-c37f159fa907 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:20.743439 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-66d4a35c-bef3-4fe7-a188-1821c7dc3bc4 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:20.743631 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1766da1d-ea66-4e19-a158-c37f159fa907 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:20.744282 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1766da1d-ea66-4e19-a158-c37f159fa907 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:20.744570 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-66d4a35c-bef3-4fe7-a188-1821c7dc3bc4 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:20.744741 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1766da1d-ea66-4e19-a158-c37f159fa907 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:20.745175 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1766da1d-ea66-4e19-a158-c37f159fa907 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:20.746162 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-66d4a35c-bef3-4fe7-a188-1821c7dc3bc4 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:20.746870 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-66d4a35c-bef3-4fe7-a188-1821c7dc3bc4 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:20.747670 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-66d4a35c-bef3-4fe7-a188-1821c7dc3bc4 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:21.429632 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-1766da1d-ea66-4e19-a158-c37f159fa907 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daab4f69af5452c8641006d9f09edce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9672a6c416ee44289eaa4d7c664d307e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:21.450199 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-1766da1d-ea66-4e19-a158-c37f159fa907 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "GET /compute/v2.1/servers/53aade05-189d-455b-901e-6fb092cfbb07" status: 200 len: 1682 microversion: 2.1 time: 0.744886 Sep 14 09:15:21.458288 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2606/5184] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:15:20 2022] GET /compute/v2.1/servers/53aade05-189d-455b-901e-6fb092cfbb07 => generated 1682 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:15:21.589068 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-66d4a35c-bef3-4fe7-a188-1821c7dc3bc4 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:21.609504 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-66d4a35c-bef3-4fe7-a188-1821c7dc3bc4 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/cf1f1bf7-3e3b-4e28-b4e5-5279b05cd751" status: 200 len: 1507 microversion: 2.1 time: 0.877923 Sep 14 09:15:21.611668 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2579/5185] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:15:20 2022] GET /compute/v2.1/servers/cf1f1bf7-3e3b-4e28-b4e5-5279b05cd751 => generated 1507 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:15:21.683628 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-50459cff-75f9-4a71-b2b2-fc7ca30fddd1 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:21.687950 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-50459cff-75f9-4a71-b2b2-fc7ca30fddd1 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 50157c1b-c748-4d1f-928e-207482b37ec6] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:21.714633 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-50459cff-75f9-4a71-b2b2-fc7ca30fddd1 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:21.718234 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-50459cff-75f9-4a71-b2b2-fc7ca30fddd1 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:21.720312 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-50459cff-75f9-4a71-b2b2-fc7ca30fddd1 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:21.734724 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-5fa44a23-e9f2-409a-814f-c359e6c7a2a7 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:21.736111 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-5fa44a23-e9f2-409a-814f-c359e6c7a2a7 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] [instance: cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:21.741385 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-50459cff-75f9-4a71-b2b2-fc7ca30fddd1 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:21.741892 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-50459cff-75f9-4a71-b2b2-fc7ca30fddd1 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:21.749872 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-50459cff-75f9-4a71-b2b2-fc7ca30fddd1 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:21.765855 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5fa44a23-e9f2-409a-814f-c359e6c7a2a7 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:21.767496 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5fa44a23-e9f2-409a-814f-c359e6c7a2a7 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:21.768068 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5fa44a23-e9f2-409a-814f-c359e6c7a2a7 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:21.769067 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5fa44a23-e9f2-409a-814f-c359e6c7a2a7 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:21.769549 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5fa44a23-e9f2-409a-814f-c359e6c7a2a7 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:21.777923 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5fa44a23-e9f2-409a-814f-c359e6c7a2a7 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:22.354974 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-50459cff-75f9-4a71-b2b2-fc7ca30fddd1 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:22.396944 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-50459cff-75f9-4a71-b2b2-fc7ca30fddd1 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:22.400173 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-50459cff-75f9-4a71-b2b2-fc7ca30fddd1 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:22.406649 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-50459cff-75f9-4a71-b2b2-fc7ca30fddd1 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6" status: 200 len: 1738 microversion: 2.20 time: 0.739420 Sep 14 09:15:22.432002 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2607/5186] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:15:21 2022] GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6 => generated 1738 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:15:22.484067 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-f1a8714b-5b28-4ff3-b293-15687524f6e4 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:22.484902 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-f1a8714b-5b28-4ff3-b293-15687524f6e4 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [instance: 53aade05-189d-455b-901e-6fb092cfbb07] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:22.497180 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f1a8714b-5b28-4ff3-b293-15687524f6e4 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:22.498039 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f1a8714b-5b28-4ff3-b293-15687524f6e4 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:22.498702 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f1a8714b-5b28-4ff3-b293-15687524f6e4 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:22.499658 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f1a8714b-5b28-4ff3-b293-15687524f6e4 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:22.500330 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f1a8714b-5b28-4ff3-b293-15687524f6e4 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:22.501065 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f1a8714b-5b28-4ff3-b293-15687524f6e4 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:23.131365 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-5fa44a23-e9f2-409a-814f-c359e6c7a2a7 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb33a017168c4a8bae36eacd9ba6a7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24f2e13835b240578d411521ee520115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:23.147505 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-5fa44a23-e9f2-409a-814f-c359e6c7a2a7 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] 10.222.0.60 "GET /compute/v2.1/servers/cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f" status: 200 len: 1505 microversion: 2.1 time: 1.423014 Sep 14 09:15:23.150218 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2580/5187] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:15:21 2022] GET /compute/v2.1/servers/cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f => generated 1505 bytes in 1429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:15:23.167806 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-bc885a83-db2f-48a6-b8f4-75f455802922 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:23.168687 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-bc885a83-db2f-48a6-b8f4-75f455802922 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: cf1f1bf7-3e3b-4e28-b4e5-5279b05cd751] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:23.175239 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bc885a83-db2f-48a6-b8f4-75f455802922 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:23.189091 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bc885a83-db2f-48a6-b8f4-75f455802922 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:23.189660 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bc885a83-db2f-48a6-b8f4-75f455802922 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:23.190328 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bc885a83-db2f-48a6-b8f4-75f455802922 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:23.190799 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bc885a83-db2f-48a6-b8f4-75f455802922 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:23.191263 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bc885a83-db2f-48a6-b8f4-75f455802922 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:23.303177 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-f1a8714b-5b28-4ff3-b293-15687524f6e4 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daab4f69af5452c8641006d9f09edce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9672a6c416ee44289eaa4d7c664d307e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:23.323124 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-f1a8714b-5b28-4ff3-b293-15687524f6e4 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "GET /compute/v2.1/servers/53aade05-189d-455b-901e-6fb092cfbb07" status: 200 len: 1682 microversion: 2.1 time: 0.834172 Sep 14 09:15:23.324885 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2608/5188] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:15:22 2022] GET /compute/v2.1/servers/53aade05-189d-455b-901e-6fb092cfbb07 => generated 1682 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:15:23.436826 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-73ccac0f-ea65-40ab-9cd0-b9d84cf2de0e tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:23.437435 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-73ccac0f-ea65-40ab-9cd0-b9d84cf2de0e tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 50157c1b-c748-4d1f-928e-207482b37ec6] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:23.464662 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-73ccac0f-ea65-40ab-9cd0-b9d84cf2de0e tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:23.465373 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-73ccac0f-ea65-40ab-9cd0-b9d84cf2de0e tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:23.465886 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-73ccac0f-ea65-40ab-9cd0-b9d84cf2de0e tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:23.466671 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-73ccac0f-ea65-40ab-9cd0-b9d84cf2de0e tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:23.467391 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-73ccac0f-ea65-40ab-9cd0-b9d84cf2de0e tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:23.468140 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-73ccac0f-ea65-40ab-9cd0-b9d84cf2de0e tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:24.870896 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-73ccac0f-ea65-40ab-9cd0-b9d84cf2de0e tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:24.908448 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-73ccac0f-ea65-40ab-9cd0-b9d84cf2de0e tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:24.909959 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-73ccac0f-ea65-40ab-9cd0-b9d84cf2de0e tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:24.918081 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-73ccac0f-ea65-40ab-9cd0-b9d84cf2de0e tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6" status: 200 len: 1738 microversion: 2.20 time: 1.485354 Sep 14 09:15:24.919339 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2609/5189] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:15:23 2022] GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6 => generated 1738 bytes in 1487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:15:24.937137 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-727b3d22-c310-459c-ba4a-82a01f81ad98 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:24.942132 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-727b3d22-c310-459c-ba4a-82a01f81ad98 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] [instance: cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:24.956689 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-727b3d22-c310-459c-ba4a-82a01f81ad98 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:24.965660 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-727b3d22-c310-459c-ba4a-82a01f81ad98 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:24.967482 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-727b3d22-c310-459c-ba4a-82a01f81ad98 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:24.969472 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-727b3d22-c310-459c-ba4a-82a01f81ad98 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:24.972086 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-727b3d22-c310-459c-ba4a-82a01f81ad98 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:24.975937 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-727b3d22-c310-459c-ba4a-82a01f81ad98 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:25.201972 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-bc885a83-db2f-48a6-b8f4-75f455802922 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:25.247408 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-bc885a83-db2f-48a6-b8f4-75f455802922 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/cf1f1bf7-3e3b-4e28-b4e5-5279b05cd751" status: 200 len: 1507 microversion: 2.1 time: 2.083919 Sep 14 09:15:25.248107 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2581/5190] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:15:23 2022] GET /compute/v2.1/servers/cf1f1bf7-3e3b-4e28-b4e5-5279b05cd751 => generated 1507 bytes in 2097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:15:25.270191 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ce5e1f4b-7315-4e68-ab06-734c35cbd897 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:25.270844 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-ce5e1f4b-7315-4e68-ab06-734c35cbd897 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [instance: 53aade05-189d-455b-901e-6fb092cfbb07] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:25.301848 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ce5e1f4b-7315-4e68-ab06-734c35cbd897 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:25.302326 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ce5e1f4b-7315-4e68-ab06-734c35cbd897 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:25.302779 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ce5e1f4b-7315-4e68-ab06-734c35cbd897 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:25.303545 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ce5e1f4b-7315-4e68-ab06-734c35cbd897 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:25.304005 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ce5e1f4b-7315-4e68-ab06-734c35cbd897 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:25.304433 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ce5e1f4b-7315-4e68-ab06-734c35cbd897 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:25.828700 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-ce5e1f4b-7315-4e68-ab06-734c35cbd897 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daab4f69af5452c8641006d9f09edce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9672a6c416ee44289eaa4d7c664d307e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:25.845033 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-ce5e1f4b-7315-4e68-ab06-734c35cbd897 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "GET /compute/v2.1/servers/53aade05-189d-455b-901e-6fb092cfbb07" status: 200 len: 1615 microversion: 2.1 time: 0.595809 Sep 14 09:15:25.848085 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2582/5191] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:15:25 2022] GET /compute/v2.1/servers/53aade05-189d-455b-901e-6fb092cfbb07 => generated 1615 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:15:25.950059 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d89e2868-f598-484a-bcec-a115df3268c7 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:25.951204 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-d89e2868-f598-484a-bcec-a115df3268c7 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 50157c1b-c748-4d1f-928e-207482b37ec6] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:25.980771 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d89e2868-f598-484a-bcec-a115df3268c7 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:25.986005 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d89e2868-f598-484a-bcec-a115df3268c7 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:25.989394 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d89e2868-f598-484a-bcec-a115df3268c7 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:25.991210 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d89e2868-f598-484a-bcec-a115df3268c7 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:25.994254 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d89e2868-f598-484a-bcec-a115df3268c7 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:25.995827 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d89e2868-f598-484a-bcec-a115df3268c7 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:26.035646 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-727b3d22-c310-459c-ba4a-82a01f81ad98 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb33a017168c4a8bae36eacd9ba6a7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24f2e13835b240578d411521ee520115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:26.044869 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-727b3d22-c310-459c-ba4a-82a01f81ad98 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] 10.222.0.60 "GET /compute/v2.1/servers/cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f" status: 200 len: 1505 microversion: 2.1 time: 1.124336 Sep 14 09:15:26.045709 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2610/5192] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:15:24 2022] GET /compute/v2.1/servers/cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f => generated 1505 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:15:26.077424 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-511e5c97-3aa4-4b8a-b3c4-690516710694 req-3dfba6c6-1a9e-4763-a2a5-3faec4a4a1aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53aade05-189d-455b-901e-6fb092cfbb07", "name": "network-vif-deleted", "tag": "90bc5925-bdaa-4a69-ba3a-ee4df95942a0"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:15:26.108590 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-511e5c97-3aa4-4b8a-b3c4-690516710694 req-3dfba6c6-1a9e-4763-a2a5-3faec4a4a1aa service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:26.109011 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-511e5c97-3aa4-4b8a-b3c4-690516710694 req-3dfba6c6-1a9e-4763-a2a5-3faec4a4a1aa service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:26.120166 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-511e5c97-3aa4-4b8a-b3c4-690516710694 req-3dfba6c6-1a9e-4763-a2a5-3faec4a4a1aa service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:26.156929 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-511e5c97-3aa4-4b8a-b3c4-690516710694 req-3dfba6c6-1a9e-4763-a2a5-3faec4a4a1aa service nova] Creating event network-vif-deleted:90bc5925-bdaa-4a69-ba3a-ee4df95942a0 for instance 53aade05-189d-455b-901e-6fb092cfbb07 on n-h1-836830-18 Sep 14 09:15:26.181331 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-511e5c97-3aa4-4b8a-b3c4-690516710694 req-3dfba6c6-1a9e-4763-a2a5-3faec4a4a1aa service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133332 Sep 14 09:15:26.182605 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2611/5193] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:15:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:15:26.278385 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a68a6e1b-ed1e-431f-b7ff-234c04d0bc88 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:26.279389 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-a68a6e1b-ed1e-431f-b7ff-234c04d0bc88 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: cf1f1bf7-3e3b-4e28-b4e5-5279b05cd751] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:26.292093 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a68a6e1b-ed1e-431f-b7ff-234c04d0bc88 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:26.292596 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a68a6e1b-ed1e-431f-b7ff-234c04d0bc88 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:26.293043 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a68a6e1b-ed1e-431f-b7ff-234c04d0bc88 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:26.293784 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a68a6e1b-ed1e-431f-b7ff-234c04d0bc88 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:26.300196 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a68a6e1b-ed1e-431f-b7ff-234c04d0bc88 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:26.300658 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a68a6e1b-ed1e-431f-b7ff-234c04d0bc88 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:26.388157 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-d89e2868-f598-484a-bcec-a115df3268c7 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:26.406807 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-d89e2868-f598-484a-bcec-a115df3268c7 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:26.411818 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-d89e2868-f598-484a-bcec-a115df3268c7 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:26.414217 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d89e2868-f598-484a-bcec-a115df3268c7 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6" status: 200 len: 1738 microversion: 2.20 time: 0.469072 Sep 14 09:15:26.416842 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2583/5194] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:15:25 2022] GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6 => generated 1738 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:15:26.820125 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-a68a6e1b-ed1e-431f-b7ff-234c04d0bc88 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:26.833455 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-a68a6e1b-ed1e-431f-b7ff-234c04d0bc88 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/cf1f1bf7-3e3b-4e28-b4e5-5279b05cd751" status: 200 len: 1507 microversion: 2.1 time: 0.560279 Sep 14 09:15:26.837753 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2612/5195] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:15:26 2022] GET /compute/v2.1/servers/cf1f1bf7-3e3b-4e28-b4e5-5279b05cd751 => generated 1507 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:15:26.883495 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-98e14fa9-8b3c-408e-9295-f87d10982572 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:26.886469 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-98e14fa9-8b3c-408e-9295-f87d10982572 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [instance: 53aade05-189d-455b-901e-6fb092cfbb07] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:26.906832 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-98e14fa9-8b3c-408e-9295-f87d10982572 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:26.910711 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-98e14fa9-8b3c-408e-9295-f87d10982572 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:26.911545 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-98e14fa9-8b3c-408e-9295-f87d10982572 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:26.928170 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-98e14fa9-8b3c-408e-9295-f87d10982572 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:26.929273 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-98e14fa9-8b3c-408e-9295-f87d10982572 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:26.932969 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-98e14fa9-8b3c-408e-9295-f87d10982572 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:27.075860 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d1965d94-3e91-43bd-a399-0f0fe9a55889 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:27.076607 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-d1965d94-3e91-43bd-a399-0f0fe9a55889 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] [instance: cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:27.090427 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d1965d94-3e91-43bd-a399-0f0fe9a55889 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:27.102179 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d1965d94-3e91-43bd-a399-0f0fe9a55889 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:27.104633 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d1965d94-3e91-43bd-a399-0f0fe9a55889 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:27.108477 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d1965d94-3e91-43bd-a399-0f0fe9a55889 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:27.110829 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d1965d94-3e91-43bd-a399-0f0fe9a55889 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:27.113741 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d1965d94-3e91-43bd-a399-0f0fe9a55889 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:27.351340 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-98e14fa9-8b3c-408e-9295-f87d10982572 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daab4f69af5452c8641006d9f09edce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9672a6c416ee44289eaa4d7c664d307e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:27.373263 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-98e14fa9-8b3c-408e-9295-f87d10982572 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "GET /compute/v2.1/servers/53aade05-189d-455b-901e-6fb092cfbb07" status: 200 len: 1615 microversion: 2.1 time: 0.496620 Sep 14 09:15:27.374515 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2584/5196] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:15:26 2022] GET /compute/v2.1/servers/53aade05-189d-455b-901e-6fb092cfbb07 => generated 1615 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:15:27.444394 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-0dde0303-7d25-4f94-bbad-780567b5ed27 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:27.445114 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-0dde0303-7d25-4f94-bbad-780567b5ed27 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 50157c1b-c748-4d1f-928e-207482b37ec6] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:27.453189 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0dde0303-7d25-4f94-bbad-780567b5ed27 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:27.453928 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0dde0303-7d25-4f94-bbad-780567b5ed27 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:27.456229 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0dde0303-7d25-4f94-bbad-780567b5ed27 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:27.456229 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0dde0303-7d25-4f94-bbad-780567b5ed27 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:27.456229 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0dde0303-7d25-4f94-bbad-780567b5ed27 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:27.456599 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0dde0303-7d25-4f94-bbad-780567b5ed27 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:27.505363 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-d1965d94-3e91-43bd-a399-0f0fe9a55889 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb33a017168c4a8bae36eacd9ba6a7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24f2e13835b240578d411521ee520115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:27.507748 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:15:27.523766 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-d1965d94-3e91-43bd-a399-0f0fe9a55889 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] 10.222.0.60 "GET /compute/v2.1/servers/cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f" status: 200 len: 1505 microversion: 2.1 time: 0.453210 Sep 14 09:15:27.526803 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2613/5197] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:15:27 2022] GET /compute/v2.1/servers/cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f => generated 1505 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:15:27.609150 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b017bff0-3ede-49d2-bff3-d5d42620ba09 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Action: 'create', calling method: .version_select at 0x7f7d3f762040>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-62008268", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO8WYDAZUpmgqmAJhf41Z0N++uJzIrwYifi49fT+7RwPZu5ZGvXqUG03pKJm6Mf6Hn403l9csCMHzoQIpSV4n9Lx3LdcZakPSmYmtnrMWv2WUhVzE9RA9/UPIsEI+rUjkw=="}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:15:27.642303 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-b017bff0-3ede-49d2-bff3-d5d42620ba09 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Getting quotas for project 021b73b20f2042c6a08f94ed23ff66e5. Resources: {'key_pairs'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:15:27.658012 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-b017bff0-3ede-49d2-bff3-d5d42620ba09 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Getting quotas for user 17918433a3994b69a65999a59a7f833c and project 021b73b20f2042c6a08f94ed23ff66e5. Resources: {'key_pairs'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:15:27.719725 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-b017bff0-3ede-49d2-bff3-d5d42620ba09 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.115758 Sep 14 09:15:27.720947 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2614/5198] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Sep 14 09:15:27 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:15:27.862355 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-25b3a4cb-8da4-425a-8813-8c8980fd5bfe tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:27.863065 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-25b3a4cb-8da4-425a-8813-8c8980fd5bfe tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: cf1f1bf7-3e3b-4e28-b4e5-5279b05cd751] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:27.896862 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-25b3a4cb-8da4-425a-8813-8c8980fd5bfe tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:27.897170 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-25b3a4cb-8da4-425a-8813-8c8980fd5bfe tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:27.901977 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-25b3a4cb-8da4-425a-8813-8c8980fd5bfe tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:27.908101 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-25b3a4cb-8da4-425a-8813-8c8980fd5bfe tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:27.909627 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-25b3a4cb-8da4-425a-8813-8c8980fd5bfe tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:27.915900 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-25b3a4cb-8da4-425a-8813-8c8980fd5bfe tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:29.688122 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-0dde0303-7d25-4f94-bbad-780567b5ed27 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:29.721301 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-0dde0303-7d25-4f94-bbad-780567b5ed27 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:29.723215 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-0dde0303-7d25-4f94-bbad-780567b5ed27 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:29.724454 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-0dde0303-7d25-4f94-bbad-780567b5ed27 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6" status: 200 len: 1738 microversion: 2.20 time: 2.286140 Sep 14 09:15:29.765031 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-25b3a4cb-8da4-425a-8813-8c8980fd5bfe tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:29.768702 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2585/5199] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:15:27 2022] GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6 => generated 1738 bytes in 2332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 09:15:29.779567 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-25b3a4cb-8da4-425a-8813-8c8980fd5bfe tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/cf1f1bf7-3e3b-4e28-b4e5-5279b05cd751" status: 200 len: 1507 microversion: 2.1 time: 1.925425 Sep 14 09:15:29.783274 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2615/5200] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:15:27 2022] GET /compute/v2.1/servers/cf1f1bf7-3e3b-4e28-b4e5-5279b05cd751 => generated 1507 bytes in 1930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:15:29.790004 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-7fbe771f-af60-44cb-9a1d-5a3f7be52bf0 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:29.792748 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-7fbe771f-af60-44cb-9a1d-5a3f7be52bf0 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [instance: 53aade05-189d-455b-901e-6fb092cfbb07] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:29.795876 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-53a8d227-8d66-4bc4-b5dd-8e07fbc9581e tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:29.796661 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-53a8d227-8d66-4bc4-b5dd-8e07fbc9581e tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] [instance: cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:29.843687 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7fbe771f-af60-44cb-9a1d-5a3f7be52bf0 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:29.843687 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7fbe771f-af60-44cb-9a1d-5a3f7be52bf0 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:29.843687 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7fbe771f-af60-44cb-9a1d-5a3f7be52bf0 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:29.843687 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7fbe771f-af60-44cb-9a1d-5a3f7be52bf0 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:29.844051 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7fbe771f-af60-44cb-9a1d-5a3f7be52bf0 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:29.845520 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7fbe771f-af60-44cb-9a1d-5a3f7be52bf0 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:29.845751 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-53a8d227-8d66-4bc4-b5dd-8e07fbc9581e tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:29.846570 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-53a8d227-8d66-4bc4-b5dd-8e07fbc9581e tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:29.847239 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-53a8d227-8d66-4bc4-b5dd-8e07fbc9581e tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:29.849603 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-53a8d227-8d66-4bc4-b5dd-8e07fbc9581e tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:29.853596 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-53a8d227-8d66-4bc4-b5dd-8e07fbc9581e tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:29.854308 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-53a8d227-8d66-4bc4-b5dd-8e07fbc9581e tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:29.911632 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-7fbe771f-af60-44cb-9a1d-5a3f7be52bf0 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] HTTP exception thrown: Instance 53aade05-189d-455b-901e-6fb092cfbb07 could not be found. Sep 14 09:15:29.922527 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-7fbe771f-af60-44cb-9a1d-5a3f7be52bf0 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Request method failure captured: Sep 14 09:15:29.922527 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/53aade05-189d-455b-901e-6fb092cfbb07 HTTP/1.1 Sep 14 09:15:29.922527 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:15:29.922527 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:15:29.922527 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:15:29.922527 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:15:29.922527 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:15:29.922527 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:15:29.922527 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:15:29.922527 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:15:29.922527 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZplAooet3f0j7YfTn10UjWWncQT1X8Zx5oRj6ix43s3Uyu8Vx6JxK5zNIVmYD3adrXMKIf-yKfD6YAxNfiXzTvsjQqMQGw8jI4-W3D7BlestqvRpahzOMSDEzmtF5nK9S-Py3GvFBoobDIQWLv-aBhO1lijqGds4gt8aJhEwjvOnnU Sep 14 09:15:29.922527 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:15:29.922527 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:15:29.922527 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:15:29.922527 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:15:29.922527 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:15:29.922527 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:15:29.922527 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 9672a6c416ee44289eaa4d7c664d307e Sep 14 09:15:29.922527 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-AttachVolumeNegativeTest-1303332785 Sep 14 09:15:29.922527 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:15:29.922527 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:15:29.922527 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/9672a6c416ee44289eaa4d7c664d307e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_9672a6c416ee44289eaa4d7c664d307e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9672a6c416ee44289eaa4d7c664d307e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9672a6c416ee44289eaa4d7c664d307e"}]}] Sep 14 09:15:29.922527 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-AttachVolumeNegativeTest-1303332785 Sep 14 09:15:29.922527 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 9672a6c416ee44289eaa4d7c664d307e Sep 14 09:15:29.922527 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1303332785 Sep 14 09:15:29.922527 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-AttachVolumeNegativeTest-1303332785-project Sep 14 09:15:29.922527 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:15:29.922527 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:15:29.922527 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 7daab4f69af5452c8641006d9f09edce Sep 14 09:15:29.922527 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-AttachVolumeNegativeTest-1303332785-project Sep 14 09:15:29.922527 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:15:29.922527 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance 53aade05-189d-455b-901e-6fb092cfbb07 could not be found. Sep 14 09:15:29.922527 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '53aade05-189d-455b-901e-6fb092cfbb07'} Sep 14 09:15:29.922527 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:15:29.922527 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:15:29.922527 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:15:29.922527 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:15:29.922527 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:15:29.922527 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:15:29.922527 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:15:29.922527 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:15:29.922527 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:15:29.922527 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:15:29.922527 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53aade05-189d-455b-901e-6fb092cfbb07 could not be found. Sep 14 09:15:29.922527 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:15:29.922527 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:15:29.922527 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:15:29.922527 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:15:29.922527 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:15:29.922527 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:15:29.922527 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:15:29.922527 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:15:29.922527 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:15:29.922527 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:15:29.922527 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:15:29.922527 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:15:29.922527 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:15:29.922527 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:15:29.922527 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:15:29.922527 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:15:29.922527 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53aade05-189d-455b-901e-6fb092cfbb07 could not be found. Sep 14 09:15:29.922527 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:15:29.922527 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:15:29.922527 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:15:29.926658 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:15:29.926658 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:15:29.926658 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:15:29.926658 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:15:29.926658 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:15:29.926658 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53aade05-189d-455b-901e-6fb092cfbb07 could not be found. Sep 14 09:15:29.926658 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:15:29.926658 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-7fbe771f-af60-44cb-9a1d-5a3f7be52bf0 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Returning 404 to user: Instance 53aade05-189d-455b-901e-6fb092cfbb07 could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:15:29.927989 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-7fbe771f-af60-44cb-9a1d-5a3f7be52bf0 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "GET /compute/v2.1/servers/53aade05-189d-455b-901e-6fb092cfbb07" status: 404 len: 111 microversion: 2.1 time: 0.157318 Sep 14 09:15:29.934219 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2586/5201] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:15:29 2022] GET /compute/v2.1/servers/53aade05-189d-455b-901e-6fb092cfbb07 => generated 111 bytes in 162 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:15:29.952229 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d9c8d3d3-a3d2-4b3d-9109-ea97a96f7617 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Calling method '.version_select at 0x7f7d48658c10>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:30.081104 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d9c8d3d3-a3d2-4b3d-9109-ea97a96f7617 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-681289818" status: 202 len: 0 microversion: 2.1 time: 0.143118 Sep 14 09:15:30.082087 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2587/5202] 10.222.0.60 () {58 vars in 1218 bytes} [Wed Sep 14 09:15:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-681289818 => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:15:30.349559 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-53a8d227-8d66-4bc4-b5dd-8e07fbc9581e tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb33a017168c4a8bae36eacd9ba6a7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24f2e13835b240578d411521ee520115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:30.362905 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-53a8d227-8d66-4bc4-b5dd-8e07fbc9581e tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] 10.222.0.60 "GET /compute/v2.1/servers/cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f" status: 200 len: 1505 microversion: 2.1 time: 0.578013 Sep 14 09:15:30.371237 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2616/5203] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:15:29 2022] GET /compute/v2.1/servers/cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f => generated 1505 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:15:30.757689 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8e4a7791-e736-422a-918d-2d054263ad4f tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:30.758311 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-8e4a7791-e736-422a-918d-2d054263ad4f tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 50157c1b-c748-4d1f-928e-207482b37ec6] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:30.771644 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8e4a7791-e736-422a-918d-2d054263ad4f tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:30.772143 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8e4a7791-e736-422a-918d-2d054263ad4f tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:30.772592 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8e4a7791-e736-422a-918d-2d054263ad4f tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:30.773310 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8e4a7791-e736-422a-918d-2d054263ad4f tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:30.774167 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8e4a7791-e736-422a-918d-2d054263ad4f tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:30.774167 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8e4a7791-e736-422a-918d-2d054263ad4f tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:30.808360 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c56065ee-81b5-4337-b261-17f9091c2e7b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:30.809784 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-c56065ee-81b5-4337-b261-17f9091c2e7b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: cf1f1bf7-3e3b-4e28-b4e5-5279b05cd751] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:30.827815 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c56065ee-81b5-4337-b261-17f9091c2e7b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:30.836010 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c56065ee-81b5-4337-b261-17f9091c2e7b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:30.843244 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c56065ee-81b5-4337-b261-17f9091c2e7b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:30.844123 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c56065ee-81b5-4337-b261-17f9091c2e7b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:30.844621 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c56065ee-81b5-4337-b261-17f9091c2e7b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:30.845108 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c56065ee-81b5-4337-b261-17f9091c2e7b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:31.797856 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-c56065ee-81b5-4337-b261-17f9091c2e7b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:31.812528 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-c56065ee-81b5-4337-b261-17f9091c2e7b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/cf1f1bf7-3e3b-4e28-b4e5-5279b05cd751" status: 200 len: 1507 microversion: 2.1 time: 1.006876 Sep 14 09:15:31.848025 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2617/5204] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:15:30 2022] GET /compute/v2.1/servers/cf1f1bf7-3e3b-4e28-b4e5-5279b05cd751 => generated 1507 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:15:31.858957 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-11127095-ee86-410a-9f31-ef90b139723c tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:31.868086 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-11127095-ee86-410a-9f31-ef90b139723c tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] [instance: cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:31.904866 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-11127095-ee86-410a-9f31-ef90b139723c tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:31.905384 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-11127095-ee86-410a-9f31-ef90b139723c tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:31.905834 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-11127095-ee86-410a-9f31-ef90b139723c tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:31.906568 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-11127095-ee86-410a-9f31-ef90b139723c tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:31.907055 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-11127095-ee86-410a-9f31-ef90b139723c tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:31.907497 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-11127095-ee86-410a-9f31-ef90b139723c tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:31.957776 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-8e4a7791-e736-422a-918d-2d054263ad4f tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:31.967116 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-8e4a7791-e736-422a-918d-2d054263ad4f tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:31.968600 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-8e4a7791-e736-422a-918d-2d054263ad4f tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:31.969810 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-8e4a7791-e736-422a-918d-2d054263ad4f tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6" status: 200 len: 1738 microversion: 2.20 time: 1.216997 Sep 14 09:15:32.007391 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2588/5205] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:15:30 2022] GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6 => generated 1738 bytes in 1255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:15:32.043746 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c3ef89a9-438d-4301-a58b-0269123a0347 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Action: 'create', calling method: .version_select at 0x7f7d48665f70>, body: {"keypair": {"name": "tempest-keypair-450861825", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEeJ/A5ZUFxo4Ge5oGhM2cjCZi8gX6CZWi2OEhmY8yrYIYKLXC1qzZQFD6ycb6IBzkUW9cI+yK87448pc7TOC8AByMgnH/GLncaFwrTx7tiokIVMLJFKoa51xtSJkD4Vng=="}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:15:32.143832 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-c3ef89a9-438d-4301-a58b-0269123a0347 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Getting quotas for project 9672a6c416ee44289eaa4d7c664d307e. Resources: {'key_pairs'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:15:32.203790 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-c3ef89a9-438d-4301-a58b-0269123a0347 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Getting quotas for user 7daab4f69af5452c8641006d9f09edce and project 9672a6c416ee44289eaa4d7c664d307e. Resources: {'key_pairs'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:15:32.336128 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-c3ef89a9-438d-4301-a58b-0269123a0347 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.297078 Sep 14 09:15:32.339654 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2589/5206] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Sep 14 09:15:32 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:15:32.750987 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-11127095-ee86-410a-9f31-ef90b139723c tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb33a017168c4a8bae36eacd9ba6a7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24f2e13835b240578d411521ee520115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:32.762498 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-11127095-ee86-410a-9f31-ef90b139723c tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] 10.222.0.60 "GET /compute/v2.1/servers/cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f" status: 200 len: 1485 microversion: 2.1 time: 0.911381 Sep 14 09:15:32.768188 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2618/5207] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:15:31 2022] GET /compute/v2.1/servers/cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f => generated 1485 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:15:32.839373 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-56931cf9-e875-4996-abc3-ce6f40c7a8e3 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:32.840245 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-56931cf9-e875-4996-abc3-ce6f40c7a8e3 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: cf1f1bf7-3e3b-4e28-b4e5-5279b05cd751] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:32.884791 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-56931cf9-e875-4996-abc3-ce6f40c7a8e3 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:32.887341 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-56931cf9-e875-4996-abc3-ce6f40c7a8e3 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:32.891252 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-56931cf9-e875-4996-abc3-ce6f40c7a8e3 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:32.893497 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-56931cf9-e875-4996-abc3-ce6f40c7a8e3 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:32.906921 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-56931cf9-e875-4996-abc3-ce6f40c7a8e3 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:32.911035 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-56931cf9-e875-4996-abc3-ce6f40c7a8e3 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:33.000680 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-2b25018c-d079-4111-8cf2-9350e080f15c tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:33.001304 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-2b25018c-d079-4111-8cf2-9350e080f15c tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 50157c1b-c748-4d1f-928e-207482b37ec6] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:33.009599 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2b25018c-d079-4111-8cf2-9350e080f15c tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:33.010099 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2b25018c-d079-4111-8cf2-9350e080f15c tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:33.010538 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2b25018c-d079-4111-8cf2-9350e080f15c tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:33.032561 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2b25018c-d079-4111-8cf2-9350e080f15c tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:33.033120 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2b25018c-d079-4111-8cf2-9350e080f15c tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:33.033564 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2b25018c-d079-4111-8cf2-9350e080f15c tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:33.045004 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=100 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:15:33.736590 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-2b25018c-d079-4111-8cf2-9350e080f15c tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:33.746713 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-2b25018c-d079-4111-8cf2-9350e080f15c tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:33.749950 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-2b25018c-d079-4111-8cf2-9350e080f15c tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:33.752401 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-2b25018c-d079-4111-8cf2-9350e080f15c tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6" status: 200 len: 1738 microversion: 2.20 time: 0.755697 Sep 14 09:15:33.793900 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2619/5208] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:15:32 2022] GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6 => generated 1738 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 09:15:33.812656 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-8cab2e01-bd4f-448d-a6ff-ec50b02320fd tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-179688319", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:15:34.682481 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-56931cf9-e875-4996-abc3-ce6f40c7a8e3 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:34.690921 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-56931cf9-e875-4996-abc3-ce6f40c7a8e3 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/cf1f1bf7-3e3b-4e28-b4e5-5279b05cd751" status: 200 len: 1507 microversion: 2.1 time: 1.857103 Sep 14 09:15:34.702795 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2590/5209] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:15:32 2022] GET /compute/v2.1/servers/cf1f1bf7-3e3b-4e28-b4e5-5279b05cd751 => generated 1507 bytes in 1869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:15:34.711418 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c1a8356d-d79a-4b7b-8a10-0eb82857db74 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-800021695", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "networks": [{"uuid": "8afcdf02-2811-4dfd-9683-855ca85e187d"}], "key_name": "tempest-TestNetworkBasicOps-62008268", "security_groups": [{"name": "tempest-secgroup-smoke-1624589216"}]}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:15:37.684419 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=4 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:15:38.799067 n-d-836830-18 devstack@n-api.service[128759]: ERROR sqlalchemy.pool.impl.QueuePool [-] Exception during reset or similar: AssertionError: do not call blocking functions from the mainloop Sep 14 09:15:38.799067 n-d-836830-18 devstack@n-api.service[128759]: ERROR sqlalchemy.pool.impl.QueuePool Traceback (most recent call last): Sep 14 09:15:38.799067 n-d-836830-18 devstack@n-api.service[128759]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 739, in _finalize_fairy Sep 14 09:15:38.799067 n-d-836830-18 devstack@n-api.service[128759]: ERROR sqlalchemy.pool.impl.QueuePool fairy._reset(pool) Sep 14 09:15:38.799067 n-d-836830-18 devstack@n-api.service[128759]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 988, in _reset Sep 14 09:15:38.799067 n-d-836830-18 devstack@n-api.service[128759]: ERROR sqlalchemy.pool.impl.QueuePool pool._dialect.do_rollback(self) Sep 14 09:15:38.799067 n-d-836830-18 devstack@n-api.service[128759]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 682, in do_rollback Sep 14 09:15:38.799067 n-d-836830-18 devstack@n-api.service[128759]: ERROR sqlalchemy.pool.impl.QueuePool dbapi_connection.rollback() Sep 14 09:15:38.799067 n-d-836830-18 devstack@n-api.service[128759]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 480, in rollback Sep 14 09:15:38.799067 n-d-836830-18 devstack@n-api.service[128759]: ERROR sqlalchemy.pool.impl.QueuePool self._read_ok_packet() Sep 14 09:15:38.799067 n-d-836830-18 devstack@n-api.service[128759]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 443, in _read_ok_packet Sep 14 09:15:38.799067 n-d-836830-18 devstack@n-api.service[128759]: ERROR sqlalchemy.pool.impl.QueuePool pkt = self._read_packet() Sep 14 09:15:38.799067 n-d-836830-18 devstack@n-api.service[128759]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 692, in _read_packet Sep 14 09:15:38.799067 n-d-836830-18 devstack@n-api.service[128759]: ERROR sqlalchemy.pool.impl.QueuePool packet_header = self._read_bytes(4) Sep 14 09:15:38.799067 n-d-836830-18 devstack@n-api.service[128759]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 732, in _read_bytes Sep 14 09:15:38.799067 n-d-836830-18 devstack@n-api.service[128759]: ERROR sqlalchemy.pool.impl.QueuePool data = self._rfile.read(num_bytes) Sep 14 09:15:38.799067 n-d-836830-18 devstack@n-api.service[128759]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/lib/python3.8/socket.py", line 669, in readinto Sep 14 09:15:38.799067 n-d-836830-18 devstack@n-api.service[128759]: ERROR sqlalchemy.pool.impl.QueuePool return self._sock.recv_into(b) Sep 14 09:15:38.799067 n-d-836830-18 devstack@n-api.service[128759]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/eventlet/greenio/base.py", line 376, in recv_into Sep 14 09:15:38.799067 n-d-836830-18 devstack@n-api.service[128759]: ERROR sqlalchemy.pool.impl.QueuePool return self._recv_loop(self.fd.recv_into, 0, buffer, nbytes, flags) Sep 14 09:15:38.799067 n-d-836830-18 devstack@n-api.service[128759]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/eventlet/greenio/base.py", line 364, in _recv_loop Sep 14 09:15:38.799067 n-d-836830-18 devstack@n-api.service[128759]: ERROR sqlalchemy.pool.impl.QueuePool self._read_trampoline() Sep 14 09:15:38.799067 n-d-836830-18 devstack@n-api.service[128759]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/eventlet/greenio/base.py", line 332, in _read_trampoline Sep 14 09:15:38.799067 n-d-836830-18 devstack@n-api.service[128759]: ERROR sqlalchemy.pool.impl.QueuePool self._trampoline( Sep 14 09:15:38.799067 n-d-836830-18 devstack@n-api.service[128759]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/eventlet/greenio/base.py", line 211, in _trampoline Sep 14 09:15:38.799067 n-d-836830-18 devstack@n-api.service[128759]: ERROR sqlalchemy.pool.impl.QueuePool return trampoline(fd, read=read, write=write, timeout=timeout, Sep 14 09:15:38.799067 n-d-836830-18 devstack@n-api.service[128759]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/__init__.py", line 141, in trampoline Sep 14 09:15:38.799067 n-d-836830-18 devstack@n-api.service[128759]: ERROR sqlalchemy.pool.impl.QueuePool assert hub.greenlet is not current, 'do not call blocking functions from the mainloop' Sep 14 09:15:38.799067 n-d-836830-18 devstack@n-api.service[128759]: ERROR sqlalchemy.pool.impl.QueuePool AssertionError: do not call blocking functions from the mainloop Sep 14 09:15:38.799067 n-d-836830-18 devstack@n-api.service[128759]: ERROR sqlalchemy.pool.impl.QueuePool Sep 14 09:15:38.802348 n-d-836830-18 devstack@n-api.service[128759]: Exception ignored in: . at 0x7f7d3fdffdc0> Sep 14 09:15:38.802638 n-d-836830-18 devstack@n-api.service[128759]: Traceback (most recent call last): Sep 14 09:15:38.802777 n-d-836830-18 devstack@n-api.service[128759]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 488, in Sep 14 09:15:38.803237 n-d-836830-18 devstack@n-api.service[128759]: and _finalize_fairy(None, rec, pool, ref, echo, True), Sep 14 09:15:38.803376 n-d-836830-18 devstack@n-api.service[128759]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 774, in _finalize_fairy Sep 14 09:15:38.803866 n-d-836830-18 devstack@n-api.service[128759]: connection_record.checkin() Sep 14 09:15:38.804323 n-d-836830-18 devstack@n-api.service[128759]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 521, in checkin Sep 14 09:15:38.804745 n-d-836830-18 devstack@n-api.service[128759]: pool.dispatch.checkin(connection, self) Sep 14 09:15:38.804884 n-d-836830-18 devstack@n-api.service[128759]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/event/attr.py", line 343, in __call__ Sep 14 09:15:38.815786 n-d-836830-18 devstack@n-api.service[128759]: fn(*args, **kw) Sep 14 09:15:38.816151 n-d-836830-18 devstack@n-api.service[128759]: File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py", line 51, in _thread_yield Sep 14 09:15:38.821316 n-d-836830-18 devstack@n-api.service[128759]: time.sleep(0) Sep 14 09:15:38.821533 n-d-836830-18 devstack@n-api.service[128759]: File "/usr/local/lib/python3.8/dist-packages/eventlet/greenthread.py", line 33, in sleep Sep 14 09:15:38.825217 n-d-836830-18 devstack@n-api.service[128759]: assert hub.greenlet is not current, 'do not call blocking functions from the mainloop' Sep 14 09:15:38.825420 n-d-836830-18 devstack@n-api.service[128759]: AssertionError: do not call blocking functions from the mainloop Sep 14 09:15:40.993164 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.network.neutron [None req-8cab2e01-bd4f-448d-a6ff-ec50b02320fd tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] validate_networks() for [('c6de249d-bd37-4bcc-8666-b0c831cedfe7', None, None, None, None, None)] {{(pid=128758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:15:41.154688 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.network.neutron [None req-c1a8356d-d79a-4b7b-8a10-0eb82857db74 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] validate_networks() for [('8afcdf02-2811-4dfd-9683-855ca85e187d', None, None, None, None, None)] {{(pid=128759) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:15:42.247394 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=4 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:15:42.304484 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-8cab2e01-bd4f-448d-a6ff-ec50b02320fd tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Flavor limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:15:42.306083 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-8cab2e01-bd4f-448d-a6ff-ec50b02320fd tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Image limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:15:42.307165 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-8cab2e01-bd4f-448d-a6ff-ec50b02320fd tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Flavor pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:15:42.307809 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-8cab2e01-bd4f-448d-a6ff-ec50b02320fd tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Image pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:15:42.308628 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-8cab2e01-bd4f-448d-a6ff-ec50b02320fd tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:15:42.334227 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8cab2e01-bd4f-448d-a6ff-ec50b02320fd tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:42.337192 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8cab2e01-bd4f-448d-a6ff-ec50b02320fd tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:42.337868 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8cab2e01-bd4f-448d-a6ff-ec50b02320fd tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:42.340512 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8cab2e01-bd4f-448d-a6ff-ec50b02320fd tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:42.341239 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8cab2e01-bd4f-448d-a6ff-ec50b02320fd tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:42.343881 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8cab2e01-bd4f-448d-a6ff-ec50b02320fd tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:42.382396 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-8cab2e01-bd4f-448d-a6ff-ec50b02320fd tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Getting quotas for project 24f2e13835b240578d411521ee520115. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:15:42.407324 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-8cab2e01-bd4f-448d-a6ff-ec50b02320fd tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Getting quotas for user bb33a017168c4a8bae36eacd9ba6a7ac and project 24f2e13835b240578d411521ee520115. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:15:42.447760 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-8cab2e01-bd4f-448d-a6ff-ec50b02320fd tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Going to run 1 instances... {{(pid=128758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:15:42.451302 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-8cab2e01-bd4f-448d-a6ff-ec50b02320fd tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] [instance: a8305358-1f82-4022-b511-8d3e3d445a92] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:15:42.560896 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-8cab2e01-bd4f-448d-a6ff-ec50b02320fd tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 8.765543 Sep 14 09:15:42.561830 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2620/5210] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 09:15:33 2022] POST /compute/v2.1/servers => generated 383 bytes in 8767 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:15:42.572708 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-5fe151fe-94cc-4e62-a822-bc9ba8c530be tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:42.576881 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-5fe151fe-94cc-4e62-a822-bc9ba8c530be tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 50157c1b-c748-4d1f-928e-207482b37ec6] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:42.592300 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5fe151fe-94cc-4e62-a822-bc9ba8c530be tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:42.595040 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5fe151fe-94cc-4e62-a822-bc9ba8c530be tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:42.596771 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5fe151fe-94cc-4e62-a822-bc9ba8c530be tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:42.601429 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5fe151fe-94cc-4e62-a822-bc9ba8c530be tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:42.602150 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5fe151fe-94cc-4e62-a822-bc9ba8c530be tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:42.603679 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5fe151fe-94cc-4e62-a822-bc9ba8c530be tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:42.987884 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-c1a8356d-d79a-4b7b-8a10-0eb82857db74 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Flavor limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:15:42.988667 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-c1a8356d-d79a-4b7b-8a10-0eb82857db74 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Image limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:15:42.989159 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-c1a8356d-d79a-4b7b-8a10-0eb82857db74 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Flavor pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:15:42.989644 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-c1a8356d-d79a-4b7b-8a10-0eb82857db74 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Image pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:15:42.990892 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-c1a8356d-d79a-4b7b-8a10-0eb82857db74 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:15:43.023228 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c1a8356d-d79a-4b7b-8a10-0eb82857db74 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:43.027246 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c1a8356d-d79a-4b7b-8a10-0eb82857db74 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:43.027837 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c1a8356d-d79a-4b7b-8a10-0eb82857db74 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:43.031340 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c1a8356d-d79a-4b7b-8a10-0eb82857db74 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:43.031932 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c1a8356d-d79a-4b7b-8a10-0eb82857db74 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:43.035551 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c1a8356d-d79a-4b7b-8a10-0eb82857db74 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:43.115005 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-c1a8356d-d79a-4b7b-8a10-0eb82857db74 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Getting quotas for project 021b73b20f2042c6a08f94ed23ff66e5. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:15:43.133138 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-c1a8356d-d79a-4b7b-8a10-0eb82857db74 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Getting quotas for user 17918433a3994b69a65999a59a7f833c and project 021b73b20f2042c6a08f94ed23ff66e5. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:15:43.173967 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-c1a8356d-d79a-4b7b-8a10-0eb82857db74 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Going to run 1 instances... {{(pid=128759) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:15:43.180274 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-c1a8356d-d79a-4b7b-8a10-0eb82857db74 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] [instance: a5837087-a7ec-4b17-9162-d1ef5ecf2574] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128759) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:15:43.285649 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-5fe151fe-94cc-4e62-a822-bc9ba8c530be tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:43.332967 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-c1a8356d-d79a-4b7b-8a10-0eb82857db74 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 8.628930 Sep 14 09:15:43.341686 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2591/5211] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 09:15:34 2022] POST /compute/v2.1/servers => generated 406 bytes in 8638 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:15:43.351859 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-5fe151fe-94cc-4e62-a822-bc9ba8c530be tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:43.355506 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-87e336a6-3632-4de9-8871-c52ccea04a88 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:43.356345 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-87e336a6-3632-4de9-8871-c52ccea04a88 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: cf1f1bf7-3e3b-4e28-b4e5-5279b05cd751] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:43.367274 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-5fe151fe-94cc-4e62-a822-bc9ba8c530be tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:43.369933 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-87e336a6-3632-4de9-8871-c52ccea04a88 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:43.370677 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-87e336a6-3632-4de9-8871-c52ccea04a88 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:43.371336 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-87e336a6-3632-4de9-8871-c52ccea04a88 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:43.372273 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-87e336a6-3632-4de9-8871-c52ccea04a88 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:43.372735 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-87e336a6-3632-4de9-8871-c52ccea04a88 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:43.374561 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-87e336a6-3632-4de9-8871-c52ccea04a88 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:43.375410 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-5fe151fe-94cc-4e62-a822-bc9ba8c530be tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6" status: 200 len: 1738 microversion: 2.20 time: 0.808187 Sep 14 09:15:43.379880 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2621/5212] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:15:42 2022] GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6 => generated 1738 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:15:43.423407 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-2d4faf00-b363-4c92-9dbb-29efe95fa699 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1747822340", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8747ac4b-fb94-4411-ac98-d9ed15dcd41c"}], "security_groups": [{"name": "tempest-securitygroup--1101398703"}], "key_name": "tempest-keypair-450861825", "user_data": "}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:15:43.875209 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.network.neutron [None req-2d4faf00-b363-4c92-9dbb-29efe95fa699 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] validate_networks() for [('8747ac4b-fb94-4411-ac98-d9ed15dcd41c', None, None, None, None, None)] {{(pid=128758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:15:44.013129 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-87e336a6-3632-4de9-8871-c52ccea04a88 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:44.021416 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-87e336a6-3632-4de9-8871-c52ccea04a88 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/cf1f1bf7-3e3b-4e28-b4e5-5279b05cd751" status: 200 len: 1504 microversion: 2.1 time: 0.678317 Sep 14 09:15:44.039397 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2592/5213] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:15:43 2022] GET /compute/v2.1/servers/cf1f1bf7-3e3b-4e28-b4e5-5279b05cd751 => generated 1504 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:15:44.055546 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-7f4f5c79-4a20-46d6-9a17-c788cd696b4f tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:44.063260 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-7f4f5c79-4a20-46d6-9a17-c788cd696b4f tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] [instance: a8305358-1f82-4022-b511-8d3e3d445a92] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:44.084743 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7f4f5c79-4a20-46d6-9a17-c788cd696b4f tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:44.087917 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7f4f5c79-4a20-46d6-9a17-c788cd696b4f tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:44.089855 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7f4f5c79-4a20-46d6-9a17-c788cd696b4f tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:44.090773 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7f4f5c79-4a20-46d6-9a17-c788cd696b4f tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:44.092586 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7f4f5c79-4a20-46d6-9a17-c788cd696b4f tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:44.095474 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7f4f5c79-4a20-46d6-9a17-c788cd696b4f tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:44.219748 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-7f4f5c79-4a20-46d6-9a17-c788cd696b4f tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb33a017168c4a8bae36eacd9ba6a7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24f2e13835b240578d411521ee520115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:44.228520 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-7f4f5c79-4a20-46d6-9a17-c788cd696b4f tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] 10.222.0.60 "GET /compute/v2.1/servers/a8305358-1f82-4022-b511-8d3e3d445a92" status: 200 len: 1217 microversion: 2.1 time: 0.187369 Sep 14 09:15:44.248227 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2593/5214] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:15:44 2022] GET /compute/v2.1/servers/a8305358-1f82-4022-b511-8d3e3d445a92 => generated 1217 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:15:44.254041 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-016ad020-4acb-47e9-91c1-5e2d59640c05 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:44.263983 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-016ad020-4acb-47e9-91c1-5e2d59640c05 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] [instance: a5837087-a7ec-4b17-9162-d1ef5ecf2574] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:44.291602 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-016ad020-4acb-47e9-91c1-5e2d59640c05 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:44.292370 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-016ad020-4acb-47e9-91c1-5e2d59640c05 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:44.293023 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-016ad020-4acb-47e9-91c1-5e2d59640c05 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:44.296833 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-016ad020-4acb-47e9-91c1-5e2d59640c05 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:44.297576 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-016ad020-4acb-47e9-91c1-5e2d59640c05 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:44.298251 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-016ad020-4acb-47e9-91c1-5e2d59640c05 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:44.449109 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-016ad020-4acb-47e9-91c1-5e2d59640c05 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17918433a3994b69a65999a59a7f833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b73b20f2042c6a08f94ed23ff66e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:44.460043 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-016ad020-4acb-47e9-91c1-5e2d59640c05 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] 10.222.0.60 "GET /compute/v2.1/servers/a5837087-a7ec-4b17-9162-d1ef5ecf2574" status: 200 len: 1250 microversion: 2.1 time: 0.209757 Sep 14 09:15:44.465586 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2594/5215] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:15:44 2022] GET /compute/v2.1/servers/a5837087-a7ec-4b17-9162-d1ef5ecf2574 => generated 1250 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:15:44.477133 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9011f1e3-0b08-4db4-bd8d-f9c513aa7371 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:44.480682 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-9011f1e3-0b08-4db4-bd8d-f9c513aa7371 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 50157c1b-c748-4d1f-928e-207482b37ec6] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:44.495947 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9011f1e3-0b08-4db4-bd8d-f9c513aa7371 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:44.505058 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9011f1e3-0b08-4db4-bd8d-f9c513aa7371 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:44.512442 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9011f1e3-0b08-4db4-bd8d-f9c513aa7371 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:44.513494 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9011f1e3-0b08-4db4-bd8d-f9c513aa7371 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:44.514781 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9011f1e3-0b08-4db4-bd8d-f9c513aa7371 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:44.514781 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9011f1e3-0b08-4db4-bd8d-f9c513aa7371 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:45.036836 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-9011f1e3-0b08-4db4-bd8d-f9c513aa7371 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:45.046116 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-9011f1e3-0b08-4db4-bd8d-f9c513aa7371 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:45.053285 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-9011f1e3-0b08-4db4-bd8d-f9c513aa7371 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:45.056364 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-9011f1e3-0b08-4db4-bd8d-f9c513aa7371 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6" status: 200 len: 1738 microversion: 2.20 time: 0.589537 Sep 14 09:15:45.059867 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2595/5216] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:15:44 2022] GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6 => generated 1738 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:15:45.082062 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-5081fb0a-221d-434d-b664-4b944a3e5b7f req-2010f3be-f514-432f-a4f4-ddb092800e5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf1f1bf7-3e3b-4e28-b4e5-5279b05cd751", "name": "network-vif-unplugged", "status": "completed", "tag": "44b6b52c-db23-4790-a977-0e4c3a8cdcf5"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:15:45.099370 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-5081fb0a-221d-434d-b664-4b944a3e5b7f req-2010f3be-f514-432f-a4f4-ddb092800e5d service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:45.100337 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-5081fb0a-221d-434d-b664-4b944a3e5b7f req-2010f3be-f514-432f-a4f4-ddb092800e5d service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:45.100959 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-5081fb0a-221d-434d-b664-4b944a3e5b7f req-2010f3be-f514-432f-a4f4-ddb092800e5d service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:45.106882 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-2d4faf00-b363-4c92-9dbb-29efe95fa699 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Flavor limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:15:45.108401 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-2d4faf00-b363-4c92-9dbb-29efe95fa699 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Image limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:15:45.110162 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-2d4faf00-b363-4c92-9dbb-29efe95fa699 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Flavor pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:15:45.114555 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-2d4faf00-b363-4c92-9dbb-29efe95fa699 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Image pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:15:45.116564 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-2d4faf00-b363-4c92-9dbb-29efe95fa699 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:15:45.151241 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2d4faf00-b363-4c92-9dbb-29efe95fa699 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:45.152714 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2d4faf00-b363-4c92-9dbb-29efe95fa699 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:45.155209 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2d4faf00-b363-4c92-9dbb-29efe95fa699 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:45.158187 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2d4faf00-b363-4c92-9dbb-29efe95fa699 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:45.160258 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2d4faf00-b363-4c92-9dbb-29efe95fa699 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:45.161036 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2d4faf00-b363-4c92-9dbb-29efe95fa699 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:45.167874 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-5081fb0a-221d-434d-b664-4b944a3e5b7f req-2010f3be-f514-432f-a4f4-ddb092800e5d service nova] Creating event network-vif-unplugged:44b6b52c-db23-4790-a977-0e4c3a8cdcf5 for instance cf1f1bf7-3e3b-4e28-b4e5-5279b05cd751 on n-h1-836830-18 Sep 14 09:15:45.179645 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-5081fb0a-221d-434d-b664-4b944a3e5b7f req-2010f3be-f514-432f-a4f4-ddb092800e5d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.118276 Sep 14 09:15:45.192802 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2596/5217] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:15:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:15:45.201698 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d5b9ce47-7b2f-4deb-bcb1-8652b661a8c5 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:45.202647 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-d5b9ce47-7b2f-4deb-bcb1-8652b661a8c5 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: cf1f1bf7-3e3b-4e28-b4e5-5279b05cd751] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:45.211078 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d5b9ce47-7b2f-4deb-bcb1-8652b661a8c5 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:45.212505 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d5b9ce47-7b2f-4deb-bcb1-8652b661a8c5 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:45.213158 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d5b9ce47-7b2f-4deb-bcb1-8652b661a8c5 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:45.214189 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d5b9ce47-7b2f-4deb-bcb1-8652b661a8c5 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:45.214927 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d5b9ce47-7b2f-4deb-bcb1-8652b661a8c5 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:45.215786 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d5b9ce47-7b2f-4deb-bcb1-8652b661a8c5 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:45.253555 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-2d4faf00-b363-4c92-9dbb-29efe95fa699 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Getting quotas for project 9672a6c416ee44289eaa4d7c664d307e. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:15:45.281562 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-2d4faf00-b363-4c92-9dbb-29efe95fa699 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Getting quotas for user 7daab4f69af5452c8641006d9f09edce and project 9672a6c416ee44289eaa4d7c664d307e. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:15:45.339686 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-2d4faf00-b363-4c92-9dbb-29efe95fa699 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Going to run 1 instances... {{(pid=128758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:15:45.349606 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-2d4faf00-b363-4c92-9dbb-29efe95fa699 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [instance: 3ceabacb-cbf6-409a-8c82-55e9901bd8d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:15:45.434993 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-d5b9ce47-7b2f-4deb-bcb1-8652b661a8c5 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:45.443923 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d5b9ce47-7b2f-4deb-bcb1-8652b661a8c5 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/cf1f1bf7-3e3b-4e28-b4e5-5279b05cd751" status: 200 len: 1504 microversion: 2.1 time: 0.249519 Sep 14 09:15:45.449696 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2597/5218] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:15:45 2022] GET /compute/v2.1/servers/cf1f1bf7-3e3b-4e28-b4e5-5279b05cd751 => generated 1504 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:15:45.463838 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-0d99e593-e367-422b-a8d9-b2b8cbccaed7 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:45.467116 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-0d99e593-e367-422b-a8d9-b2b8cbccaed7 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] [instance: a8305358-1f82-4022-b511-8d3e3d445a92] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:45.481632 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0d99e593-e367-422b-a8d9-b2b8cbccaed7 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:45.482360 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0d99e593-e367-422b-a8d9-b2b8cbccaed7 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:45.485826 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0d99e593-e367-422b-a8d9-b2b8cbccaed7 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:45.487686 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0d99e593-e367-422b-a8d9-b2b8cbccaed7 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:45.489900 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0d99e593-e367-422b-a8d9-b2b8cbccaed7 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:45.491976 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0d99e593-e367-422b-a8d9-b2b8cbccaed7 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:45.645188 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-2d4faf00-b363-4c92-9dbb-29efe95fa699 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.248039 Sep 14 09:15:45.648479 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2622/5219] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 09:15:43 2022] POST /compute/v2.1/servers => generated 402 bytes in 2267 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:15:45.687611 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-adc64717-c505-4bf5-b57c-2d42e4e73b2f tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:45.688717 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-adc64717-c505-4bf5-b57c-2d42e4e73b2f tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] [instance: a5837087-a7ec-4b17-9162-d1ef5ecf2574] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:45.711387 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-adc64717-c505-4bf5-b57c-2d42e4e73b2f tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:45.720143 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-0d99e593-e367-422b-a8d9-b2b8cbccaed7 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb33a017168c4a8bae36eacd9ba6a7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24f2e13835b240578d411521ee520115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:45.730125 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-adc64717-c505-4bf5-b57c-2d42e4e73b2f tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:45.731418 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-adc64717-c505-4bf5-b57c-2d42e4e73b2f tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:45.732007 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-0d99e593-e367-422b-a8d9-b2b8cbccaed7 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] 10.222.0.60 "GET /compute/v2.1/servers/a8305358-1f82-4022-b511-8d3e3d445a92" status: 200 len: 1283 microversion: 2.1 time: 0.273849 Sep 14 09:15:45.733021 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-adc64717-c505-4bf5-b57c-2d42e4e73b2f tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:45.733712 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2598/5220] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:15:45 2022] GET /compute/v2.1/servers/a8305358-1f82-4022-b511-8d3e3d445a92 => generated 1283 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:15:45.735634 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-adc64717-c505-4bf5-b57c-2d42e4e73b2f tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:45.739227 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-adc64717-c505-4bf5-b57c-2d42e4e73b2f tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:45.752336 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-43c9f5d8-25e6-45e9-b339-d1895a4318ae tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:45.757108 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-43c9f5d8-25e6-45e9-b339-d1895a4318ae tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [instance: 3ceabacb-cbf6-409a-8c82-55e9901bd8d7] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:45.928701 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-43c9f5d8-25e6-45e9-b339-d1895a4318ae tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daab4f69af5452c8641006d9f09edce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9672a6c416ee44289eaa4d7c664d307e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:45.943879 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-43c9f5d8-25e6-45e9-b339-d1895a4318ae tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "GET /compute/v2.1/servers/3ceabacb-cbf6-409a-8c82-55e9901bd8d7" status: 200 len: 1241 microversion: 2.1 time: 0.200666 Sep 14 09:15:45.949772 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2599/5221] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:15:45 2022] GET /compute/v2.1/servers/3ceabacb-cbf6-409a-8c82-55e9901bd8d7 => generated 1241 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:15:46.005199 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-adc64717-c505-4bf5-b57c-2d42e4e73b2f tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17918433a3994b69a65999a59a7f833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b73b20f2042c6a08f94ed23ff66e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:46.020661 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-adc64717-c505-4bf5-b57c-2d42e4e73b2f tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] 10.222.0.60 "GET /compute/v2.1/servers/a5837087-a7ec-4b17-9162-d1ef5ecf2574" status: 200 len: 1298 microversion: 2.1 time: 0.364806 Sep 14 09:15:46.028447 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2623/5222] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:15:45 2022] GET /compute/v2.1/servers/a5837087-a7ec-4b17-9162-d1ef5ecf2574 => generated 1298 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:15:46.101519 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c6bf21fd-e44b-4f72-bbe3-419b2097d0d2 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:46.104359 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-c6bf21fd-e44b-4f72-bbe3-419b2097d0d2 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 50157c1b-c748-4d1f-928e-207482b37ec6] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:46.136163 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c6bf21fd-e44b-4f72-bbe3-419b2097d0d2 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:46.138728 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c6bf21fd-e44b-4f72-bbe3-419b2097d0d2 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:46.139890 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c6bf21fd-e44b-4f72-bbe3-419b2097d0d2 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:46.140870 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c6bf21fd-e44b-4f72-bbe3-419b2097d0d2 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:46.141352 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c6bf21fd-e44b-4f72-bbe3-419b2097d0d2 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:46.141792 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c6bf21fd-e44b-4f72-bbe3-419b2097d0d2 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:46.475322 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-46c22e90-6752-4d8c-a8a6-3020b221a1f6 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:46.476581 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-46c22e90-6752-4d8c-a8a6-3020b221a1f6 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: cf1f1bf7-3e3b-4e28-b4e5-5279b05cd751] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:46.492090 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-46c22e90-6752-4d8c-a8a6-3020b221a1f6 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:46.493604 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-46c22e90-6752-4d8c-a8a6-3020b221a1f6 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:46.494595 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-46c22e90-6752-4d8c-a8a6-3020b221a1f6 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:46.495693 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-46c22e90-6752-4d8c-a8a6-3020b221a1f6 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:46.496366 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-46c22e90-6752-4d8c-a8a6-3020b221a1f6 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:46.496945 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-46c22e90-6752-4d8c-a8a6-3020b221a1f6 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:46.535979 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-c6bf21fd-e44b-4f72-bbe3-419b2097d0d2 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:46.552062 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-c6bf21fd-e44b-4f72-bbe3-419b2097d0d2 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:46.562732 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-c6bf21fd-e44b-4f72-bbe3-419b2097d0d2 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:46.564459 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-c6bf21fd-e44b-4f72-bbe3-419b2097d0d2 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6" status: 200 len: 1738 microversion: 2.20 time: 0.475996 Sep 14 09:15:46.565283 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2600/5223] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:15:46 2022] GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6 => generated 1738 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:15:46.763283 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-6a720e03-0916-4e25-bc0e-292ca9d54d14 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:46.764227 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-6a720e03-0916-4e25-bc0e-292ca9d54d14 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] [instance: a8305358-1f82-4022-b511-8d3e3d445a92] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:46.776377 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6a720e03-0916-4e25-bc0e-292ca9d54d14 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:46.778527 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6a720e03-0916-4e25-bc0e-292ca9d54d14 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:46.779151 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6a720e03-0916-4e25-bc0e-292ca9d54d14 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:46.781412 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6a720e03-0916-4e25-bc0e-292ca9d54d14 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:46.783157 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6a720e03-0916-4e25-bc0e-292ca9d54d14 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:46.784834 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6a720e03-0916-4e25-bc0e-292ca9d54d14 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:46.859046 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-46c22e90-6752-4d8c-a8a6-3020b221a1f6 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:46.870243 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-46c22e90-6752-4d8c-a8a6-3020b221a1f6 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/cf1f1bf7-3e3b-4e28-b4e5-5279b05cd751" status: 200 len: 1507 microversion: 2.1 time: 0.398957 Sep 14 09:15:46.871172 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2624/5224] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:15:46 2022] GET /compute/v2.1/servers/cf1f1bf7-3e3b-4e28-b4e5-5279b05cd751 => generated 1507 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:15:46.898926 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-2c274d42-5a5e-4007-b356-42243c300fba tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:46.900872 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-2c274d42-5a5e-4007-b356-42243c300fba tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:46.913607 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=1,nova_api:INSERT=7 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:15:46.930898 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2c274d42-5a5e-4007-b356-42243c300fba tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:46.935807 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2c274d42-5a5e-4007-b356-42243c300fba tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:46.937725 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2c274d42-5a5e-4007-b356-42243c300fba tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:46.938771 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2c274d42-5a5e-4007-b356-42243c300fba tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:46.940879 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2c274d42-5a5e-4007-b356-42243c300fba tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:46.941598 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2c274d42-5a5e-4007-b356-42243c300fba tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:47.051791 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-6a720e03-0916-4e25-bc0e-292ca9d54d14 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb33a017168c4a8bae36eacd9ba6a7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24f2e13835b240578d411521ee520115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:47.064599 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-6a720e03-0916-4e25-bc0e-292ca9d54d14 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] 10.222.0.60 "GET /compute/v2.1/servers/a8305358-1f82-4022-b511-8d3e3d445a92" status: 200 len: 1271 microversion: 2.1 time: 0.306972 Sep 14 09:15:47.065512 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2601/5225] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:15:46 2022] GET /compute/v2.1/servers/a8305358-1f82-4022-b511-8d3e3d445a92 => generated 1271 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:15:47.076258 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-02171b9b-5610-4585-a5ac-055511ca19e1 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:47.077290 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-02171b9b-5610-4585-a5ac-055511ca19e1 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [instance: 3ceabacb-cbf6-409a-8c82-55e9901bd8d7] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:47.094824 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-02171b9b-5610-4585-a5ac-055511ca19e1 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:47.095658 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-02171b9b-5610-4585-a5ac-055511ca19e1 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:47.096332 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-02171b9b-5610-4585-a5ac-055511ca19e1 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:47.099458 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-02171b9b-5610-4585-a5ac-055511ca19e1 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:47.100186 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-02171b9b-5610-4585-a5ac-055511ca19e1 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:47.100840 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-02171b9b-5610-4585-a5ac-055511ca19e1 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:47.254578 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-02171b9b-5610-4585-a5ac-055511ca19e1 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daab4f69af5452c8641006d9f09edce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9672a6c416ee44289eaa4d7c664d307e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:47.265547 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-02171b9b-5610-4585-a5ac-055511ca19e1 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "GET /compute/v2.1/servers/3ceabacb-cbf6-409a-8c82-55e9901bd8d7" status: 200 len: 1245 microversion: 2.1 time: 0.196389 Sep 14 09:15:47.266317 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2602/5226] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:15:47 2022] GET /compute/v2.1/servers/3ceabacb-cbf6-409a-8c82-55e9901bd8d7 => generated 1245 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:15:47.283265 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3f28ddd6-0147-4de0-ac3c-5e0d45d96282 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:47.284634 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-3f28ddd6-0147-4de0-ac3c-5e0d45d96282 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] [instance: a5837087-a7ec-4b17-9162-d1ef5ecf2574] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:47.295582 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3f28ddd6-0147-4de0-ac3c-5e0d45d96282 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:47.296351 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3f28ddd6-0147-4de0-ac3c-5e0d45d96282 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:47.296958 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3f28ddd6-0147-4de0-ac3c-5e0d45d96282 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:47.297885 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3f28ddd6-0147-4de0-ac3c-5e0d45d96282 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:47.298514 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3f28ddd6-0147-4de0-ac3c-5e0d45d96282 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:47.306356 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3f28ddd6-0147-4de0-ac3c-5e0d45d96282 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:47.539435 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-3f28ddd6-0147-4de0-ac3c-5e0d45d96282 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17918433a3994b69a65999a59a7f833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b73b20f2042c6a08f94ed23ff66e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:47.552108 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-3f28ddd6-0147-4de0-ac3c-5e0d45d96282 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] 10.222.0.60 "GET /compute/v2.1/servers/a5837087-a7ec-4b17-9162-d1ef5ecf2574" status: 200 len: 1304 microversion: 2.1 time: 0.283920 Sep 14 09:15:47.611022 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2603/5227] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:15:47 2022] GET /compute/v2.1/servers/a5837087-a7ec-4b17-9162-d1ef5ecf2574 => generated 1304 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:15:47.629305 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-60f333bc-8b53-435d-bac0-964c06207428 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:47.629933 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-60f333bc-8b53-435d-bac0-964c06207428 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 50157c1b-c748-4d1f-928e-207482b37ec6] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:47.655219 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-60f333bc-8b53-435d-bac0-964c06207428 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:47.655728 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-60f333bc-8b53-435d-bac0-964c06207428 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:47.656176 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-60f333bc-8b53-435d-bac0-964c06207428 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:47.656968 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-60f333bc-8b53-435d-bac0-964c06207428 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:47.660227 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-60f333bc-8b53-435d-bac0-964c06207428 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:47.665817 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-60f333bc-8b53-435d-bac0-964c06207428 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:47.849693 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-2c274d42-5a5e-4007-b356-42243c300fba tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:47.860752 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-2c274d42-5a5e-4007-b356-42243c300fba tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105" status: 200 len: 1668 microversion: 2.1 time: 0.967125 Sep 14 09:15:47.870336 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2625/5228] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:15:46 2022] GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105 => generated 1668 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:15:47.905718 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-3b8537a0-d0b2-47b2-927b-a5633e450541 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:47.906575 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-3b8537a0-d0b2-47b2-927b-a5633e450541 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:47.914069 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3b8537a0-d0b2-47b2-927b-a5633e450541 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:47.915746 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3b8537a0-d0b2-47b2-927b-a5633e450541 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:47.917509 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3b8537a0-d0b2-47b2-927b-a5633e450541 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:47.919676 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3b8537a0-d0b2-47b2-927b-a5633e450541 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:47.920664 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3b8537a0-d0b2-47b2-927b-a5633e450541 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:47.922025 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3b8537a0-d0b2-47b2-927b-a5633e450541 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:48.179664 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-3b8537a0-d0b2-47b2-927b-a5633e450541 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:48.191279 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-3b8537a0-d0b2-47b2-927b-a5633e450541 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105" status: 200 len: 1668 microversion: 2.1 time: 0.293346 Sep 14 09:15:48.206694 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2626/5229] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:15:47 2022] GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105 => generated 1668 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:15:48.223317 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-3aec7c4a-ee76-4200-b675-1e4d18f80fac tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:48.224155 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-3aec7c4a-ee76-4200-b675-1e4d18f80fac tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] [instance: a8305358-1f82-4022-b511-8d3e3d445a92] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:48.233631 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3aec7c4a-ee76-4200-b675-1e4d18f80fac tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:48.234524 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3aec7c4a-ee76-4200-b675-1e4d18f80fac tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:48.235270 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3aec7c4a-ee76-4200-b675-1e4d18f80fac tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:48.236771 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3aec7c4a-ee76-4200-b675-1e4d18f80fac tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:48.238037 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3aec7c4a-ee76-4200-b675-1e4d18f80fac tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:48.238703 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3aec7c4a-ee76-4200-b675-1e4d18f80fac tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:48.437160 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-60f333bc-8b53-435d-bac0-964c06207428 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:48.450593 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-60f333bc-8b53-435d-bac0-964c06207428 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:48.459664 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-60f333bc-8b53-435d-bac0-964c06207428 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:48.470969 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-60f333bc-8b53-435d-bac0-964c06207428 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6" status: 200 len: 1720 microversion: 2.20 time: 0.858425 Sep 14 09:15:48.473688 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2604/5230] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:15:47 2022] GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6 => generated 1720 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:15:48.482238 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-3aec7c4a-ee76-4200-b675-1e4d18f80fac tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb33a017168c4a8bae36eacd9ba6a7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24f2e13835b240578d411521ee520115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:48.493562 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-3aec7c4a-ee76-4200-b675-1e4d18f80fac tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] 10.222.0.60 "GET /compute/v2.1/servers/a8305358-1f82-4022-b511-8d3e3d445a92" status: 200 len: 1271 microversion: 2.1 time: 0.275351 Sep 14 09:15:48.494174 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2627/5231] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:15:48 2022] GET /compute/v2.1/servers/a8305358-1f82-4022-b511-8d3e3d445a92 => generated 1271 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:15:48.505318 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-10864731-bed1-4922-80ad-f0f4a7158d42 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:48.509741 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-10864731-bed1-4922-80ad-f0f4a7158d42 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:48.511418 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-e2abaeec-89b1-45e7-8f35-f76da7475439 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:48.512512 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-e2abaeec-89b1-45e7-8f35-f76da7475439 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [instance: 3ceabacb-cbf6-409a-8c82-55e9901bd8d7] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:48.520622 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e2abaeec-89b1-45e7-8f35-f76da7475439 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:48.521116 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e2abaeec-89b1-45e7-8f35-f76da7475439 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:48.525749 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e2abaeec-89b1-45e7-8f35-f76da7475439 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:48.526434 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e2abaeec-89b1-45e7-8f35-f76da7475439 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:48.526917 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e2abaeec-89b1-45e7-8f35-f76da7475439 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:48.528547 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e2abaeec-89b1-45e7-8f35-f76da7475439 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:48.532125 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-10864731-bed1-4922-80ad-f0f4a7158d42 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:48.532920 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-10864731-bed1-4922-80ad-f0f4a7158d42 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:48.535895 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-10864731-bed1-4922-80ad-f0f4a7158d42 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:48.538588 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-10864731-bed1-4922-80ad-f0f4a7158d42 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:48.540779 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-10864731-bed1-4922-80ad-f0f4a7158d42 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:48.542021 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-10864731-bed1-4922-80ad-f0f4a7158d42 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:48.673393 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-e2abaeec-89b1-45e7-8f35-f76da7475439 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daab4f69af5452c8641006d9f09edce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9672a6c416ee44289eaa4d7c664d307e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:48.686374 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-e2abaeec-89b1-45e7-8f35-f76da7475439 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "GET /compute/v2.1/servers/3ceabacb-cbf6-409a-8c82-55e9901bd8d7" status: 200 len: 1299 microversion: 2.1 time: 0.190060 Sep 14 09:15:48.687221 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2628/5232] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:15:48 2022] GET /compute/v2.1/servers/3ceabacb-cbf6-409a-8c82-55e9901bd8d7 => generated 1299 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:15:48.696560 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-9027055b-f360-4b14-945b-a0c80d8bbee5 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:48.697461 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-9027055b-f360-4b14-945b-a0c80d8bbee5 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] [instance: a5837087-a7ec-4b17-9162-d1ef5ecf2574] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:48.716348 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9027055b-f360-4b14-945b-a0c80d8bbee5 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:48.717934 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9027055b-f360-4b14-945b-a0c80d8bbee5 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:48.718567 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9027055b-f360-4b14-945b-a0c80d8bbee5 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:48.719355 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9027055b-f360-4b14-945b-a0c80d8bbee5 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:48.719798 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9027055b-f360-4b14-945b-a0c80d8bbee5 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:48.720228 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9027055b-f360-4b14-945b-a0c80d8bbee5 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:49.349502 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-9027055b-f360-4b14-945b-a0c80d8bbee5 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17918433a3994b69a65999a59a7f833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b73b20f2042c6a08f94ed23ff66e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:49.364092 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-9027055b-f360-4b14-945b-a0c80d8bbee5 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] 10.222.0.60 "GET /compute/v2.1/servers/a5837087-a7ec-4b17-9162-d1ef5ecf2574" status: 200 len: 1304 microversion: 2.1 time: 0.676001 Sep 14 09:15:49.365010 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2629/5233] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:15:48 2022] GET /compute/v2.1/servers/a5837087-a7ec-4b17-9162-d1ef5ecf2574 => generated 1304 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:15:49.505056 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-fdadae29-7061-434a-9f97-e1d2589f77db tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:49.505945 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-fdadae29-7061-434a-9f97-e1d2589f77db tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 50157c1b-c748-4d1f-928e-207482b37ec6] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:49.513495 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-10864731-bed1-4922-80ad-f0f4a7158d42 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:49.517825 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fdadae29-7061-434a-9f97-e1d2589f77db tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:49.520191 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fdadae29-7061-434a-9f97-e1d2589f77db tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:49.520816 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fdadae29-7061-434a-9f97-e1d2589f77db tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:49.522907 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fdadae29-7061-434a-9f97-e1d2589f77db tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:49.523646 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fdadae29-7061-434a-9f97-e1d2589f77db tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:49.524791 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fdadae29-7061-434a-9f97-e1d2589f77db tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:49.527497 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-10864731-bed1-4922-80ad-f0f4a7158d42 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105" status: 200 len: 1668 microversion: 2.1 time: 1.047049 Sep 14 09:15:49.529980 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2605/5234] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:15:48 2022] GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105 => generated 1668 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:15:49.536116 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a36d19d6-991c-4d44-b1bb-5896055399ec tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:49.537113 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-a36d19d6-991c-4d44-b1bb-5896055399ec tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] [instance: a8305358-1f82-4022-b511-8d3e3d445a92] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:49.546836 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a36d19d6-991c-4d44-b1bb-5896055399ec tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:49.548134 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a36d19d6-991c-4d44-b1bb-5896055399ec tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:49.548897 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a36d19d6-991c-4d44-b1bb-5896055399ec tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:49.552694 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a36d19d6-991c-4d44-b1bb-5896055399ec tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:49.562484 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a36d19d6-991c-4d44-b1bb-5896055399ec tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:49.563441 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a36d19d6-991c-4d44-b1bb-5896055399ec tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:50.180819 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-a36d19d6-991c-4d44-b1bb-5896055399ec tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb33a017168c4a8bae36eacd9ba6a7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24f2e13835b240578d411521ee520115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:50.190597 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a36d19d6-991c-4d44-b1bb-5896055399ec tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] 10.222.0.60 "GET /compute/v2.1/servers/a8305358-1f82-4022-b511-8d3e3d445a92" status: 200 len: 1313 microversion: 2.1 time: 0.659268 Sep 14 09:15:50.194715 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2606/5235] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:15:49 2022] GET /compute/v2.1/servers/a8305358-1f82-4022-b511-8d3e3d445a92 => generated 1313 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:15:50.200484 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-cb4389e1-4b3e-44f8-9c5f-9e9ef7c43c1d tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:50.207043 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-fdadae29-7061-434a-9f97-e1d2589f77db tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:50.218260 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-fdadae29-7061-434a-9f97-e1d2589f77db tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:50.220933 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-fdadae29-7061-434a-9f97-e1d2589f77db tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:50.229390 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-fdadae29-7061-434a-9f97-e1d2589f77db tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6" status: 200 len: 1720 microversion: 2.20 time: 0.729525 Sep 14 09:15:50.230926 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-cb4389e1-4b3e-44f8-9c5f-9e9ef7c43c1d tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:50.233056 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:15:50.236802 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2630/5236] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:15:49 2022] GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6 => generated 1720 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:15:50.241812 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-653d3cad-b249-4f5a-92b6-4a99ddac5807 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:50.251470 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-653d3cad-b249-4f5a-92b6-4a99ddac5807 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [instance: 3ceabacb-cbf6-409a-8c82-55e9901bd8d7] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:50.253852 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cb4389e1-4b3e-44f8-9c5f-9e9ef7c43c1d tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:50.261961 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cb4389e1-4b3e-44f8-9c5f-9e9ef7c43c1d tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:50.262418 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cb4389e1-4b3e-44f8-9c5f-9e9ef7c43c1d tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:50.263368 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cb4389e1-4b3e-44f8-9c5f-9e9ef7c43c1d tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:50.263835 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cb4389e1-4b3e-44f8-9c5f-9e9ef7c43c1d tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:50.266446 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cb4389e1-4b3e-44f8-9c5f-9e9ef7c43c1d tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:50.276241 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-653d3cad-b249-4f5a-92b6-4a99ddac5807 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:50.276843 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-653d3cad-b249-4f5a-92b6-4a99ddac5807 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:50.277325 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-653d3cad-b249-4f5a-92b6-4a99ddac5807 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:50.278109 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-653d3cad-b249-4f5a-92b6-4a99ddac5807 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:50.278625 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-653d3cad-b249-4f5a-92b6-4a99ddac5807 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:50.279082 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-653d3cad-b249-4f5a-92b6-4a99ddac5807 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:50.452019 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-653d3cad-b249-4f5a-92b6-4a99ddac5807 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daab4f69af5452c8641006d9f09edce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9672a6c416ee44289eaa4d7c664d307e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:50.464612 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-653d3cad-b249-4f5a-92b6-4a99ddac5807 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "GET /compute/v2.1/servers/3ceabacb-cbf6-409a-8c82-55e9901bd8d7" status: 200 len: 1299 microversion: 2.1 time: 0.225934 Sep 14 09:15:50.478978 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2631/5237] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:15:50 2022] GET /compute/v2.1/servers/3ceabacb-cbf6-409a-8c82-55e9901bd8d7 => generated 1299 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:15:50.478978 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-1dbe4f8e-8d49-430c-95db-ef1bbbb3ac4e req-7d4c04c6-75af-4635-ab36-a30e87349d78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50157c1b-c748-4d1f-928e-207482b37ec6", "name": "network-vif-unplugged", "status": "completed", "tag": "6bb7c82b-6dea-4020-abff-f1c92580e9d8"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:15:50.483905 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-1dbe4f8e-8d49-430c-95db-ef1bbbb3ac4e req-7d4c04c6-75af-4635-ab36-a30e87349d78 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:50.485525 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-1dbe4f8e-8d49-430c-95db-ef1bbbb3ac4e req-7d4c04c6-75af-4635-ab36-a30e87349d78 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:50.485525 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-1dbe4f8e-8d49-430c-95db-ef1bbbb3ac4e req-7d4c04c6-75af-4635-ab36-a30e87349d78 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:50.503031 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-1dbe4f8e-8d49-430c-95db-ef1bbbb3ac4e req-7d4c04c6-75af-4635-ab36-a30e87349d78 service nova] Creating event network-vif-unplugged:6bb7c82b-6dea-4020-abff-f1c92580e9d8 for instance 50157c1b-c748-4d1f-928e-207482b37ec6 on n-h2-836830-18 Sep 14 09:15:50.511507 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-1dbe4f8e-8d49-430c-95db-ef1bbbb3ac4e req-7d4c04c6-75af-4635-ab36-a30e87349d78 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042774 Sep 14 09:15:50.512469 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2632/5238] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:15:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:15:50.520478 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-4560e4f9-78d7-4f72-9018-e5dcb6bab72e tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:50.521196 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-4560e4f9-78d7-4f72-9018-e5dcb6bab72e tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] [instance: a5837087-a7ec-4b17-9162-d1ef5ecf2574] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:50.531443 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4560e4f9-78d7-4f72-9018-e5dcb6bab72e tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:50.532270 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4560e4f9-78d7-4f72-9018-e5dcb6bab72e tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:50.532973 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4560e4f9-78d7-4f72-9018-e5dcb6bab72e tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:50.534542 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4560e4f9-78d7-4f72-9018-e5dcb6bab72e tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:50.535269 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4560e4f9-78d7-4f72-9018-e5dcb6bab72e tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:50.536038 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4560e4f9-78d7-4f72-9018-e5dcb6bab72e tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:50.559438 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=100 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:15:50.580843 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-cb4389e1-4b3e-44f8-9c5f-9e9ef7c43c1d tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:50.590812 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-cb4389e1-4b3e-44f8-9c5f-9e9ef7c43c1d tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105" status: 200 len: 1668 microversion: 2.1 time: 0.393753 Sep 14 09:15:50.592127 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2607/5239] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:15:50 2022] GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105 => generated 1668 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:15:50.619848 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-cd296266-0e3a-4d92-93a5-1d5ed9b2ffbe tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:15:50.629521 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cd296266-0e3a-4d92-93a5-1d5ed9b2ffbe tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:50.630578 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cd296266-0e3a-4d92-93a5-1d5ed9b2ffbe tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:50.632278 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cd296266-0e3a-4d92-93a5-1d5ed9b2ffbe tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:50.666396 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-cd296266-0e3a-4d92-93a5-1d5ed9b2ffbe tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Going to try to stop instance {{(pid=128759) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 14 09:15:50.698041 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:15:50.723713 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-cd296266-0e3a-4d92-93a5-1d5ed9b2ffbe tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "POST /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105/action" status: 202 len: 0 microversion: 2.1 time: 0.111994 Sep 14 09:15:50.727428 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2608/5240] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:15:50 2022] POST /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 14 09:15:50.734345 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-0c2a66cd-71cb-458b-9840-dbecd57bdbd9 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:50.735208 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-0c2a66cd-71cb-458b-9840-dbecd57bdbd9 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:50.745361 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0c2a66cd-71cb-458b-9840-dbecd57bdbd9 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:50.746243 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0c2a66cd-71cb-458b-9840-dbecd57bdbd9 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:50.748523 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0c2a66cd-71cb-458b-9840-dbecd57bdbd9 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:50.749519 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0c2a66cd-71cb-458b-9840-dbecd57bdbd9 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:50.750171 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0c2a66cd-71cb-458b-9840-dbecd57bdbd9 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:50.750675 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0c2a66cd-71cb-458b-9840-dbecd57bdbd9 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:50.908029 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-4560e4f9-78d7-4f72-9018-e5dcb6bab72e tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17918433a3994b69a65999a59a7f833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b73b20f2042c6a08f94ed23ff66e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:50.918214 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-4560e4f9-78d7-4f72-9018-e5dcb6bab72e tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] 10.222.0.60 "GET /compute/v2.1/servers/a5837087-a7ec-4b17-9162-d1ef5ecf2574" status: 200 len: 1372 microversion: 2.1 time: 0.404455 Sep 14 09:15:50.922063 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2633/5241] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:15:50 2022] GET /compute/v2.1/servers/a5837087-a7ec-4b17-9162-d1ef5ecf2574 => generated 1372 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:15:51.016927 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-0c2a66cd-71cb-458b-9840-dbecd57bdbd9 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:51.029300 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-0c2a66cd-71cb-458b-9840-dbecd57bdbd9 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105" status: 200 len: 1678 microversion: 2.1 time: 0.299491 Sep 14 09:15:51.030677 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2609/5242] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:15:50 2022] GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105 => generated 1678 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:15:51.218886 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ff0a9bda-955d-47fa-bac7-6438e0020bae tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:51.219731 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-ff0a9bda-955d-47fa-bac7-6438e0020bae tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] [instance: a8305358-1f82-4022-b511-8d3e3d445a92] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:51.235576 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ff0a9bda-955d-47fa-bac7-6438e0020bae tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:51.236505 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ff0a9bda-955d-47fa-bac7-6438e0020bae tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:51.237015 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ff0a9bda-955d-47fa-bac7-6438e0020bae tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:51.240582 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ff0a9bda-955d-47fa-bac7-6438e0020bae tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:51.243598 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ff0a9bda-955d-47fa-bac7-6438e0020bae tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:51.244806 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ff0a9bda-955d-47fa-bac7-6438e0020bae tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:51.260976 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c460d83b-c64f-4221-af45-6f2f9657abce tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:51.261942 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-c460d83b-c64f-4221-af45-6f2f9657abce tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 50157c1b-c748-4d1f-928e-207482b37ec6] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:51.270602 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c460d83b-c64f-4221-af45-6f2f9657abce tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:51.272653 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c460d83b-c64f-4221-af45-6f2f9657abce tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:51.273363 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c460d83b-c64f-4221-af45-6f2f9657abce tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:51.275257 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c460d83b-c64f-4221-af45-6f2f9657abce tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:51.276262 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c460d83b-c64f-4221-af45-6f2f9657abce tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:51.278709 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c460d83b-c64f-4221-af45-6f2f9657abce tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:51.802409 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-ff0a9bda-955d-47fa-bac7-6438e0020bae tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb33a017168c4a8bae36eacd9ba6a7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24f2e13835b240578d411521ee520115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:51.817300 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-ff0a9bda-955d-47fa-bac7-6438e0020bae tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] 10.222.0.60 "GET /compute/v2.1/servers/a8305358-1f82-4022-b511-8d3e3d445a92" status: 200 len: 1313 microversion: 2.1 time: 0.602766 Sep 14 09:15:51.818311 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2634/5243] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:15:51 2022] GET /compute/v2.1/servers/a8305358-1f82-4022-b511-8d3e3d445a92 => generated 1313 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:15:51.826712 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-f9f156ff-c1f4-47f1-a426-d8ee237b4663 req-4e929373-7304-434f-83b2-072fd5c9bc7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8305358-1f82-4022-b511-8d3e3d445a92", "tag": "8565d189-2e08-43da-9cd2-6cbe981a8d3a"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:15:51.840549 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-f9f156ff-c1f4-47f1-a426-d8ee237b4663 req-4e929373-7304-434f-83b2-072fd5c9bc7b service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:51.841419 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-f9f156ff-c1f4-47f1-a426-d8ee237b4663 req-4e929373-7304-434f-83b2-072fd5c9bc7b service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:51.843997 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-f9f156ff-c1f4-47f1-a426-d8ee237b4663 req-4e929373-7304-434f-83b2-072fd5c9bc7b service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:51.860585 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-f9f156ff-c1f4-47f1-a426-d8ee237b4663 req-4e929373-7304-434f-83b2-072fd5c9bc7b service nova] Creating event network-changed:8565d189-2e08-43da-9cd2-6cbe981a8d3a for instance a8305358-1f82-4022-b511-8d3e3d445a92 on n-h2-836830-18 Sep 14 09:15:51.872522 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-f9f156ff-c1f4-47f1-a426-d8ee237b4663 req-4e929373-7304-434f-83b2-072fd5c9bc7b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051654 Sep 14 09:15:51.873503 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2635/5244] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:15:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:15:51.881486 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-13208c48-e962-44d3-86f8-cb9f9fb3c3b8 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:51.882826 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-13208c48-e962-44d3-86f8-cb9f9fb3c3b8 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [instance: 3ceabacb-cbf6-409a-8c82-55e9901bd8d7] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:51.902878 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-13208c48-e962-44d3-86f8-cb9f9fb3c3b8 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:51.903409 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-13208c48-e962-44d3-86f8-cb9f9fb3c3b8 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:51.904027 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-13208c48-e962-44d3-86f8-cb9f9fb3c3b8 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:51.905119 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-13208c48-e962-44d3-86f8-cb9f9fb3c3b8 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:51.905582 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-13208c48-e962-44d3-86f8-cb9f9fb3c3b8 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:51.906014 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-13208c48-e962-44d3-86f8-cb9f9fb3c3b8 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:51.952500 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-c460d83b-c64f-4221-af45-6f2f9657abce tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:51.970459 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-c460d83b-c64f-4221-af45-6f2f9657abce tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:51.972010 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-c460d83b-c64f-4221-af45-6f2f9657abce tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:51.973470 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-c460d83b-c64f-4221-af45-6f2f9657abce tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6" status: 200 len: 1720 microversion: 2.20 time: 0.718696 Sep 14 09:15:51.975223 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2610/5245] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:15:51 2022] GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6 => generated 1720 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 09:15:51.980836 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a2412436-fb27-4299-9070-d7c1eea4824d tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:51.988592 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-a2412436-fb27-4299-9070-d7c1eea4824d tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] [instance: a5837087-a7ec-4b17-9162-d1ef5ecf2574] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:52.005823 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a2412436-fb27-4299-9070-d7c1eea4824d tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:52.006333 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a2412436-fb27-4299-9070-d7c1eea4824d tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:52.006809 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a2412436-fb27-4299-9070-d7c1eea4824d tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:52.007565 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a2412436-fb27-4299-9070-d7c1eea4824d tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:52.008031 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a2412436-fb27-4299-9070-d7c1eea4824d tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:52.008519 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a2412436-fb27-4299-9070-d7c1eea4824d tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:52.691222 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-a2412436-fb27-4299-9070-d7c1eea4824d tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17918433a3994b69a65999a59a7f833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b73b20f2042c6a08f94ed23ff66e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:52.698244 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-13208c48-e962-44d3-86f8-cb9f9fb3c3b8 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daab4f69af5452c8641006d9f09edce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9672a6c416ee44289eaa4d7c664d307e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:52.700911 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a2412436-fb27-4299-9070-d7c1eea4824d tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] 10.222.0.60 "GET /compute/v2.1/servers/a5837087-a7ec-4b17-9162-d1ef5ecf2574" status: 200 len: 1372 microversion: 2.1 time: 0.724384 Sep 14 09:15:52.703679 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2611/5246] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:15:51 2022] GET /compute/v2.1/servers/a5837087-a7ec-4b17-9162-d1ef5ecf2574 => generated 1372 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:15:52.709941 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-13208c48-e962-44d3-86f8-cb9f9fb3c3b8 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "GET /compute/v2.1/servers/3ceabacb-cbf6-409a-8c82-55e9901bd8d7" status: 200 len: 1367 microversion: 2.1 time: 0.832659 Sep 14 09:15:52.722962 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2636/5247] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:15:51 2022] GET /compute/v2.1/servers/3ceabacb-cbf6-409a-8c82-55e9901bd8d7 => generated 1367 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:15:52.730437 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-6caa5a17-d8f1-4bca-ae43-4fc0cae7d721 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:52.734190 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-6caa5a17-d8f1-4bca-ae43-4fc0cae7d721 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:52.755104 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6caa5a17-d8f1-4bca-ae43-4fc0cae7d721 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:52.756950 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6caa5a17-d8f1-4bca-ae43-4fc0cae7d721 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:52.757612 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6caa5a17-d8f1-4bca-ae43-4fc0cae7d721 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:52.758602 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6caa5a17-d8f1-4bca-ae43-4fc0cae7d721 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:52.759296 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6caa5a17-d8f1-4bca-ae43-4fc0cae7d721 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:52.760369 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6caa5a17-d8f1-4bca-ae43-4fc0cae7d721 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:52.846006 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-3b9aab5d-aaee-42e7-a8fe-358c9e368cbd tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:52.846913 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-3b9aab5d-aaee-42e7-a8fe-358c9e368cbd tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] [instance: a8305358-1f82-4022-b511-8d3e3d445a92] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:52.869079 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3b9aab5d-aaee-42e7-a8fe-358c9e368cbd tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:52.875326 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3b9aab5d-aaee-42e7-a8fe-358c9e368cbd tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:52.876003 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3b9aab5d-aaee-42e7-a8fe-358c9e368cbd tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:52.876924 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3b9aab5d-aaee-42e7-a8fe-358c9e368cbd tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:52.879463 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3b9aab5d-aaee-42e7-a8fe-358c9e368cbd tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:52.881157 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3b9aab5d-aaee-42e7-a8fe-358c9e368cbd tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:53.077252 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=2 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:15:53.194362 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-6caa5a17-d8f1-4bca-ae43-4fc0cae7d721 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:53.207151 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-6caa5a17-d8f1-4bca-ae43-4fc0cae7d721 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105" status: 200 len: 1678 microversion: 2.1 time: 0.499771 Sep 14 09:15:53.208390 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2612/5248] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:15:52 2022] GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105 => generated 1678 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:15:53.214761 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f3293c74-54f3-4b7c-a177-4554ebec1ea5 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:53.215808 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f3293c74-54f3-4b7c-a177-4554ebec1ea5 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 50157c1b-c748-4d1f-928e-207482b37ec6] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:53.223856 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f3293c74-54f3-4b7c-a177-4554ebec1ea5 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:53.224961 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f3293c74-54f3-4b7c-a177-4554ebec1ea5 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:53.225660 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f3293c74-54f3-4b7c-a177-4554ebec1ea5 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:53.227097 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f3293c74-54f3-4b7c-a177-4554ebec1ea5 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:53.228340 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f3293c74-54f3-4b7c-a177-4554ebec1ea5 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:53.229300 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f3293c74-54f3-4b7c-a177-4554ebec1ea5 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:53.266383 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-3b9aab5d-aaee-42e7-a8fe-358c9e368cbd tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb33a017168c4a8bae36eacd9ba6a7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24f2e13835b240578d411521ee520115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:53.274534 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-3b9aab5d-aaee-42e7-a8fe-358c9e368cbd tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] 10.222.0.60 "GET /compute/v2.1/servers/a8305358-1f82-4022-b511-8d3e3d445a92" status: 200 len: 1313 microversion: 2.1 time: 0.437041 Sep 14 09:15:53.280120 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2637/5249] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:15:52 2022] GET /compute/v2.1/servers/a8305358-1f82-4022-b511-8d3e3d445a92 => generated 1313 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:15:53.522859 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f3293c74-54f3-4b7c-a177-4554ebec1ea5 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:53.528981 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-eab49ed8-38cf-4e13-ae9b-2e67310a3a2c req-09dd2105-f1fb-4f50-ade2-e0b8eb5318b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ceabacb-cbf6-409a-8c82-55e9901bd8d7", "tag": "e75fecd4-ad0f-481f-b575-74e5343cdbc3"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:15:53.562259 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f3293c74-54f3-4b7c-a177-4554ebec1ea5 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:53.564901 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f3293c74-54f3-4b7c-a177-4554ebec1ea5 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:53.567196 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-eab49ed8-38cf-4e13-ae9b-2e67310a3a2c req-09dd2105-f1fb-4f50-ade2-e0b8eb5318b0 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:53.571719 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f3293c74-54f3-4b7c-a177-4554ebec1ea5 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6" status: 200 len: 1663 microversion: 2.20 time: 0.361814 Sep 14 09:15:53.572284 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2613/5250] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:15:53 2022] GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6 => generated 1663 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:15:53.583385 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-eab49ed8-38cf-4e13-ae9b-2e67310a3a2c req-09dd2105-f1fb-4f50-ade2-e0b8eb5318b0 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:53.583385 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-eab49ed8-38cf-4e13-ae9b-2e67310a3a2c req-09dd2105-f1fb-4f50-ade2-e0b8eb5318b0 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:53.607051 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-290db108-b3bf-401a-b92a-f7062dffba6b tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2bf419f9-ca22-4666-87d6-039db0dfb924"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:15:53.612026 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-290db108-b3bf-401a-b92a-f7062dffba6b tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 50157c1b-c748-4d1f-928e-207482b37ec6] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:53.616775 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-eab49ed8-38cf-4e13-ae9b-2e67310a3a2c req-09dd2105-f1fb-4f50-ade2-e0b8eb5318b0 service nova] Creating event network-changed:e75fecd4-ad0f-481f-b575-74e5343cdbc3 for instance 3ceabacb-cbf6-409a-8c82-55e9901bd8d7 on n-h1-836830-18 Sep 14 09:15:53.623460 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-290db108-b3bf-401a-b92a-f7062dffba6b tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:53.624642 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-290db108-b3bf-401a-b92a-f7062dffba6b tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:53.625286 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-290db108-b3bf-401a-b92a-f7062dffba6b tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:53.626254 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-290db108-b3bf-401a-b92a-f7062dffba6b tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:53.626900 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-290db108-b3bf-401a-b92a-f7062dffba6b tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:53.634134 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-eab49ed8-38cf-4e13-ae9b-2e67310a3a2c req-09dd2105-f1fb-4f50-ade2-e0b8eb5318b0 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119819 Sep 14 09:15:53.635002 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2638/5251] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:15:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:15:53.635773 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-290db108-b3bf-401a-b92a-f7062dffba6b tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:53.729526 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-f958bb34-8a0f-4a73-9359-d4ae5a230032 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:53.731065 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-f958bb34-8a0f-4a73-9359-d4ae5a230032 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] [instance: a5837087-a7ec-4b17-9162-d1ef5ecf2574] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:53.751912 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f958bb34-8a0f-4a73-9359-d4ae5a230032 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:53.752426 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f958bb34-8a0f-4a73-9359-d4ae5a230032 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:53.752875 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f958bb34-8a0f-4a73-9359-d4ae5a230032 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:53.753673 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f958bb34-8a0f-4a73-9359-d4ae5a230032 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:53.754139 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f958bb34-8a0f-4a73-9359-d4ae5a230032 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:53.754577 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f958bb34-8a0f-4a73-9359-d4ae5a230032 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:54.183089 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-290db108-b3bf-401a-b92a-f7062dffba6b tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "POST /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.580616 Sep 14 09:15:54.189201 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2614/5252] 10.222.0.60 () {62 vars in 1364 bytes} [Wed Sep 14 09:15:53 2022] POST /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6/os-volume_attachments => generated 188 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 09:15:54.190338 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3227f6d2-b17e-4aab-a2b2-761e353ba307 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:54.191622 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-3227f6d2-b17e-4aab-a2b2-761e353ba307 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [instance: 3ceabacb-cbf6-409a-8c82-55e9901bd8d7] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:54.227642 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3227f6d2-b17e-4aab-a2b2-761e353ba307 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:54.231191 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3227f6d2-b17e-4aab-a2b2-761e353ba307 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:54.234396 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3227f6d2-b17e-4aab-a2b2-761e353ba307 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:54.241879 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3227f6d2-b17e-4aab-a2b2-761e353ba307 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:54.242286 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3227f6d2-b17e-4aab-a2b2-761e353ba307 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:54.247654 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3227f6d2-b17e-4aab-a2b2-761e353ba307 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:54.721533 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-f958bb34-8a0f-4a73-9359-d4ae5a230032 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17918433a3994b69a65999a59a7f833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b73b20f2042c6a08f94ed23ff66e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:54.744276 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-f958bb34-8a0f-4a73-9359-d4ae5a230032 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] 10.222.0.60 "GET /compute/v2.1/servers/a5837087-a7ec-4b17-9162-d1ef5ecf2574" status: 200 len: 1372 microversion: 2.1 time: 1.018736 Sep 14 09:15:54.749683 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2639/5253] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:15:53 2022] GET /compute/v2.1/servers/a5837087-a7ec-4b17-9162-d1ef5ecf2574 => generated 1372 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:15:54.753589 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-3227f6d2-b17e-4aab-a2b2-761e353ba307 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daab4f69af5452c8641006d9f09edce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9672a6c416ee44289eaa4d7c664d307e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:54.758312 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-71707bbe-737e-4f29-9dd6-d73d670b55bb req-3902d786-c9a2-4424-884c-0fb6fef3a7bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5837087-a7ec-4b17-9162-d1ef5ecf2574", "tag": "a50f72ef-bb63-4ef6-b28d-a3d8cd24469e"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:15:54.767955 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-3227f6d2-b17e-4aab-a2b2-761e353ba307 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "GET /compute/v2.1/servers/3ceabacb-cbf6-409a-8c82-55e9901bd8d7" status: 200 len: 1367 microversion: 2.1 time: 0.579693 Sep 14 09:15:54.770329 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2615/5254] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:15:54 2022] GET /compute/v2.1/servers/3ceabacb-cbf6-409a-8c82-55e9901bd8d7 => generated 1367 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:15:54.779197 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-eea57600-e833-4459-b74b-7245b096d2b4 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:54.782520 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-eea57600-e833-4459-b74b-7245b096d2b4 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:54.796041 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-eea57600-e833-4459-b74b-7245b096d2b4 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:54.798666 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-eea57600-e833-4459-b74b-7245b096d2b4 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:54.799332 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-eea57600-e833-4459-b74b-7245b096d2b4 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:54.800066 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-eea57600-e833-4459-b74b-7245b096d2b4 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:54.800538 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-eea57600-e833-4459-b74b-7245b096d2b4 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:54.800978 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-eea57600-e833-4459-b74b-7245b096d2b4 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:54.804222 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-71707bbe-737e-4f29-9dd6-d73d670b55bb req-3902d786-c9a2-4424-884c-0fb6fef3a7bf service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:54.804934 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-71707bbe-737e-4f29-9dd6-d73d670b55bb req-3902d786-c9a2-4424-884c-0fb6fef3a7bf service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:54.807286 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-71707bbe-737e-4f29-9dd6-d73d670b55bb req-3902d786-c9a2-4424-884c-0fb6fef3a7bf service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:54.835176 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-71707bbe-737e-4f29-9dd6-d73d670b55bb req-3902d786-c9a2-4424-884c-0fb6fef3a7bf service nova] Creating event network-changed:a50f72ef-bb63-4ef6-b28d-a3d8cd24469e for instance a5837087-a7ec-4b17-9162-d1ef5ecf2574 on n-h2-836830-18 Sep 14 09:15:54.846395 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-71707bbe-737e-4f29-9dd6-d73d670b55bb req-3902d786-c9a2-4424-884c-0fb6fef3a7bf service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095217 Sep 14 09:15:54.847138 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2640/5255] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:15:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:15:54.866028 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-4fc0568d-a54a-44d2-8c2c-52e6e755c155 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:54.866660 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-4fc0568d-a54a-44d2-8c2c-52e6e755c155 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] [instance: a8305358-1f82-4022-b511-8d3e3d445a92] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:54.873100 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4fc0568d-a54a-44d2-8c2c-52e6e755c155 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:54.873598 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4fc0568d-a54a-44d2-8c2c-52e6e755c155 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:54.874044 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4fc0568d-a54a-44d2-8c2c-52e6e755c155 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:54.874755 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4fc0568d-a54a-44d2-8c2c-52e6e755c155 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:54.879735 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4fc0568d-a54a-44d2-8c2c-52e6e755c155 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:54.882155 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4fc0568d-a54a-44d2-8c2c-52e6e755c155 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:55.058007 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-eea57600-e833-4459-b74b-7245b096d2b4 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:55.067782 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-eea57600-e833-4459-b74b-7245b096d2b4 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105" status: 200 len: 1678 microversion: 2.1 time: 0.296088 Sep 14 09:15:55.068589 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2616/5256] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:15:54 2022] GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105 => generated 1678 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:15:55.074396 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8f89c759-6b48-4720-931c-8e397fab112a tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:55.075886 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-8f89c759-6b48-4720-931c-8e397fab112a tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 50157c1b-c748-4d1f-928e-207482b37ec6] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:55.083046 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8f89c759-6b48-4720-931c-8e397fab112a tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:55.083770 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8f89c759-6b48-4720-931c-8e397fab112a tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:55.085230 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8f89c759-6b48-4720-931c-8e397fab112a tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:55.086004 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8f89c759-6b48-4720-931c-8e397fab112a tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:55.087645 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8f89c759-6b48-4720-931c-8e397fab112a tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:55.089405 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8f89c759-6b48-4720-931c-8e397fab112a tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:55.167785 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-4fc0568d-a54a-44d2-8c2c-52e6e755c155 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb33a017168c4a8bae36eacd9ba6a7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24f2e13835b240578d411521ee520115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:55.176189 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-4fc0568d-a54a-44d2-8c2c-52e6e755c155 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] 10.222.0.60 "GET /compute/v2.1/servers/a8305358-1f82-4022-b511-8d3e3d445a92" status: 200 len: 1313 microversion: 2.1 time: 0.326615 Sep 14 09:15:55.188127 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2641/5257] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:15:54 2022] GET /compute/v2.1/servers/a8305358-1f82-4022-b511-8d3e3d445a92 => generated 1313 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:15:55.465501 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-8f89c759-6b48-4720-931c-8e397fab112a tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "DELETE /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6/os-volume_attachments/2bf419f9-ca22-4666-87d6-039db0dfb924" status: 202 len: 0 microversion: 2.20 time: 0.395340 Sep 14 09:15:55.466333 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2617/5258] 10.222.0.60 () {60 vars in 1457 bytes} [Wed Sep 14 09:15:55 2022] DELETE /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6/os-volume_attachments/2bf419f9-ca22-4666-87d6-039db0dfb924 => generated 0 bytes in 397 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:15:55.561044 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d7fc6b6f-d25a-4a5c-9be3-5d145c42ec82 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:15:55.561956 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-d7fc6b6f-d25a-4a5c-9be3-5d145c42ec82 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 50157c1b-c748-4d1f-928e-207482b37ec6] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:55.566931 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=4 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:15:55.568432 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=12 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:15:55.594481 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d7fc6b6f-d25a-4a5c-9be3-5d145c42ec82 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:55.594481 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d7fc6b6f-d25a-4a5c-9be3-5d145c42ec82 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:55.594481 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d7fc6b6f-d25a-4a5c-9be3-5d145c42ec82 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:55.594481 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d7fc6b6f-d25a-4a5c-9be3-5d145c42ec82 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:55.594481 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d7fc6b6f-d25a-4a5c-9be3-5d145c42ec82 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:55.594481 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d7fc6b6f-d25a-4a5c-9be3-5d145c42ec82 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:55.691864 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-d7fc6b6f-d25a-4a5c-9be3-5d145c42ec82 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 50157c1b-c748-4d1f-928e-207482b37ec6] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128758) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 14 09:15:55.771956 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-091a650c-fc05-4912-a89e-e7860597d262 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:55.772786 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-091a650c-fc05-4912-a89e-e7860597d262 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] [instance: a5837087-a7ec-4b17-9162-d1ef5ecf2574] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:55.789917 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-091a650c-fc05-4912-a89e-e7860597d262 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:55.790646 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-091a650c-fc05-4912-a89e-e7860597d262 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:55.791266 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-091a650c-fc05-4912-a89e-e7860597d262 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:55.792160 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-091a650c-fc05-4912-a89e-e7860597d262 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:55.793665 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-091a650c-fc05-4912-a89e-e7860597d262 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:55.794350 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-091a650c-fc05-4912-a89e-e7860597d262 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:55.810357 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-d7fc6b6f-d25a-4a5c-9be3-5d145c42ec82 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "POST /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6/action" status: 202 len: 0 microversion: 2.20 time: 0.255063 Sep 14 09:15:55.812234 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2642/5259] 10.222.0.60 () {62 vars in 1319 bytes} [Wed Sep 14 09:15:55 2022] POST /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6/action => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:15:55.824059 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-fea5b4b6-2c56-454e-a5eb-adfd7d5e7078 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:55.829341 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-fea5b4b6-2c56-454e-a5eb-adfd7d5e7078 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [instance: 3ceabacb-cbf6-409a-8c82-55e9901bd8d7] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:55.841365 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fea5b4b6-2c56-454e-a5eb-adfd7d5e7078 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:55.844338 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fea5b4b6-2c56-454e-a5eb-adfd7d5e7078 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:55.845096 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fea5b4b6-2c56-454e-a5eb-adfd7d5e7078 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:55.845949 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fea5b4b6-2c56-454e-a5eb-adfd7d5e7078 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:55.849449 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fea5b4b6-2c56-454e-a5eb-adfd7d5e7078 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:55.850045 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fea5b4b6-2c56-454e-a5eb-adfd7d5e7078 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:55.936360 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=8 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:15:56.060692 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-091a650c-fc05-4912-a89e-e7860597d262 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17918433a3994b69a65999a59a7f833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b73b20f2042c6a08f94ed23ff66e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:56.074620 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-091a650c-fc05-4912-a89e-e7860597d262 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] 10.222.0.60 "GET /compute/v2.1/servers/a5837087-a7ec-4b17-9162-d1ef5ecf2574" status: 200 len: 1372 microversion: 2.1 time: 0.303974 Sep 14 09:15:56.076710 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2618/5260] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:15:55 2022] GET /compute/v2.1/servers/a5837087-a7ec-4b17-9162-d1ef5ecf2574 => generated 1372 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:15:56.104719 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8ada4a91-9aaa-48b9-bafb-eb8b74558bd2 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:56.110138 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-8ada4a91-9aaa-48b9-bafb-eb8b74558bd2 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 50157c1b-c748-4d1f-928e-207482b37ec6] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:56.121439 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8ada4a91-9aaa-48b9-bafb-eb8b74558bd2 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:56.123854 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8ada4a91-9aaa-48b9-bafb-eb8b74558bd2 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:56.126123 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8ada4a91-9aaa-48b9-bafb-eb8b74558bd2 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:56.127061 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8ada4a91-9aaa-48b9-bafb-eb8b74558bd2 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:56.129896 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8ada4a91-9aaa-48b9-bafb-eb8b74558bd2 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:56.132615 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8ada4a91-9aaa-48b9-bafb-eb8b74558bd2 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:56.248594 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-fea5b4b6-2c56-454e-a5eb-adfd7d5e7078 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daab4f69af5452c8641006d9f09edce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9672a6c416ee44289eaa4d7c664d307e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:56.258002 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-fea5b4b6-2c56-454e-a5eb-adfd7d5e7078 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "GET /compute/v2.1/servers/3ceabacb-cbf6-409a-8c82-55e9901bd8d7" status: 200 len: 1367 microversion: 2.1 time: 0.443487 Sep 14 09:15:56.261936 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2643/5261] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:15:55 2022] GET /compute/v2.1/servers/3ceabacb-cbf6-409a-8c82-55e9901bd8d7 => generated 1367 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:15:56.297879 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-6106aff9-8faf-4fde-b6af-3e8f4b747ba7 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:56.298726 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-6106aff9-8faf-4fde-b6af-3e8f4b747ba7 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:56.305452 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6106aff9-8faf-4fde-b6af-3e8f4b747ba7 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:56.306294 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6106aff9-8faf-4fde-b6af-3e8f4b747ba7 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:56.306915 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6106aff9-8faf-4fde-b6af-3e8f4b747ba7 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:56.307859 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6106aff9-8faf-4fde-b6af-3e8f4b747ba7 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:56.308612 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6106aff9-8faf-4fde-b6af-3e8f4b747ba7 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:56.309216 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6106aff9-8faf-4fde-b6af-3e8f4b747ba7 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:56.783897 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-8ada4a91-9aaa-48b9-bafb-eb8b74558bd2 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:56.793202 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=86,nova_cell1:INSERT=6,nova_cell1:UPDATE=8 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:15:56.828852 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-8ada4a91-9aaa-48b9-bafb-eb8b74558bd2 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:56.831100 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-8ada4a91-9aaa-48b9-bafb-eb8b74558bd2 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:56.834004 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-8ada4a91-9aaa-48b9-bafb-eb8b74558bd2 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6" status: 200 len: 1671 microversion: 2.20 time: 0.755823 Sep 14 09:15:56.848751 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2619/5262] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:15:56 2022] GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6 => generated 1671 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:15:56.861822 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-18d80048-2774-4a51-85de-2f8511f1a834 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:56.862815 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-18d80048-2774-4a51-85de-2f8511f1a834 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] [instance: a8305358-1f82-4022-b511-8d3e3d445a92] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:56.875568 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-18d80048-2774-4a51-85de-2f8511f1a834 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:56.876515 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-18d80048-2774-4a51-85de-2f8511f1a834 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:56.882066 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-18d80048-2774-4a51-85de-2f8511f1a834 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:56.883042 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-18d80048-2774-4a51-85de-2f8511f1a834 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:56.884105 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-18d80048-2774-4a51-85de-2f8511f1a834 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:56.888044 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-18d80048-2774-4a51-85de-2f8511f1a834 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:56.913234 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-6106aff9-8faf-4fde-b6af-3e8f4b747ba7 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:56.960394 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-6106aff9-8faf-4fde-b6af-3e8f4b747ba7 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105" status: 200 len: 1678 microversion: 2.1 time: 0.676608 Sep 14 09:15:56.961400 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2644/5263] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:15:56 2022] GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105 => generated 1678 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:15:56.978037 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-508a882f-d937-457a-b662-11b171c5dbeb req-592ec6fc-d019-43f3-8b10-8fd0f5d1e498 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8305358-1f82-4022-b511-8d3e3d445a92", "name": "network-vif-plugged", "status": "completed", "tag": "8565d189-2e08-43da-9cd2-6cbe981a8d3a"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:15:57.007445 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-508a882f-d937-457a-b662-11b171c5dbeb req-592ec6fc-d019-43f3-8b10-8fd0f5d1e498 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:57.008898 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-508a882f-d937-457a-b662-11b171c5dbeb req-592ec6fc-d019-43f3-8b10-8fd0f5d1e498 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:57.010020 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-508a882f-d937-457a-b662-11b171c5dbeb req-592ec6fc-d019-43f3-8b10-8fd0f5d1e498 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:57.053349 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-508a882f-d937-457a-b662-11b171c5dbeb req-592ec6fc-d019-43f3-8b10-8fd0f5d1e498 service nova] Creating event network-vif-plugged:8565d189-2e08-43da-9cd2-6cbe981a8d3a for instance a8305358-1f82-4022-b511-8d3e3d445a92 on n-h2-836830-18 Sep 14 09:15:57.093944 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-508a882f-d937-457a-b662-11b171c5dbeb req-592ec6fc-d019-43f3-8b10-8fd0f5d1e498 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106176 Sep 14 09:15:57.096153 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2645/5264] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:15:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:15:57.106219 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-106e0363-fe73-4bd5-b048-91dbf723abe3 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:57.111541 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-106e0363-fe73-4bd5-b048-91dbf723abe3 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] [instance: a5837087-a7ec-4b17-9162-d1ef5ecf2574] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:57.133683 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-106e0363-fe73-4bd5-b048-91dbf723abe3 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:57.134256 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-106e0363-fe73-4bd5-b048-91dbf723abe3 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:57.135580 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-106e0363-fe73-4bd5-b048-91dbf723abe3 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:57.137222 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-106e0363-fe73-4bd5-b048-91dbf723abe3 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:57.139137 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-106e0363-fe73-4bd5-b048-91dbf723abe3 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:57.140035 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-106e0363-fe73-4bd5-b048-91dbf723abe3 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:57.176294 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-18d80048-2774-4a51-85de-2f8511f1a834 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb33a017168c4a8bae36eacd9ba6a7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24f2e13835b240578d411521ee520115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:57.185061 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-18d80048-2774-4a51-85de-2f8511f1a834 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] 10.222.0.60 "GET /compute/v2.1/servers/a8305358-1f82-4022-b511-8d3e3d445a92" status: 200 len: 1313 microversion: 2.1 time: 0.334729 Sep 14 09:15:57.189649 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2620/5265] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:15:56 2022] GET /compute/v2.1/servers/a8305358-1f82-4022-b511-8d3e3d445a92 => generated 1313 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:15:57.292185 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-1e6188d0-467e-4133-ae7a-1a5db5ce1b1b tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:57.292829 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-1e6188d0-467e-4133-ae7a-1a5db5ce1b1b tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [instance: 3ceabacb-cbf6-409a-8c82-55e9901bd8d7] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:57.312820 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1e6188d0-467e-4133-ae7a-1a5db5ce1b1b tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:57.312820 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1e6188d0-467e-4133-ae7a-1a5db5ce1b1b tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:57.312820 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1e6188d0-467e-4133-ae7a-1a5db5ce1b1b tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:57.312820 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1e6188d0-467e-4133-ae7a-1a5db5ce1b1b tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:57.312820 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1e6188d0-467e-4133-ae7a-1a5db5ce1b1b tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:57.313149 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1e6188d0-467e-4133-ae7a-1a5db5ce1b1b tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:57.518677 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-106e0363-fe73-4bd5-b048-91dbf723abe3 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17918433a3994b69a65999a59a7f833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b73b20f2042c6a08f94ed23ff66e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:57.531268 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-106e0363-fe73-4bd5-b048-91dbf723abe3 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] 10.222.0.60 "GET /compute/v2.1/servers/a5837087-a7ec-4b17-9162-d1ef5ecf2574" status: 200 len: 1372 microversion: 2.1 time: 0.433606 Sep 14 09:15:57.534164 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2646/5266] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:15:57 2022] GET /compute/v2.1/servers/a5837087-a7ec-4b17-9162-d1ef5ecf2574 => generated 1372 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:15:57.724704 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-2f3236df-44bf-4909-a058-d8f2599fdc5f tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-619172122", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:15:57.747394 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-1e6188d0-467e-4133-ae7a-1a5db5ce1b1b tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daab4f69af5452c8641006d9f09edce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9672a6c416ee44289eaa4d7c664d307e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:57.763832 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-1e6188d0-467e-4133-ae7a-1a5db5ce1b1b tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "GET /compute/v2.1/servers/3ceabacb-cbf6-409a-8c82-55e9901bd8d7" status: 200 len: 1367 microversion: 2.1 time: 0.477995 Sep 14 09:15:57.781087 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2621/5267] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:15:57 2022] GET /compute/v2.1/servers/3ceabacb-cbf6-409a-8c82-55e9901bd8d7 => generated 1367 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:15:57.810256 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.network.neutron [None req-2f3236df-44bf-4909-a058-d8f2599fdc5f tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] validate_networks() for None {{(pid=128758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:15:57.866157 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ece53898-8f3d-481e-8fe1-5eab601b9838 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:57.867916 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-ece53898-8f3d-481e-8fe1-5eab601b9838 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 50157c1b-c748-4d1f-928e-207482b37ec6] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:57.887189 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ece53898-8f3d-481e-8fe1-5eab601b9838 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:57.887698 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ece53898-8f3d-481e-8fe1-5eab601b9838 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:57.888144 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ece53898-8f3d-481e-8fe1-5eab601b9838 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:57.888866 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ece53898-8f3d-481e-8fe1-5eab601b9838 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:57.889329 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ece53898-8f3d-481e-8fe1-5eab601b9838 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:57.889760 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ece53898-8f3d-481e-8fe1-5eab601b9838 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:58.307420 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-ece53898-8f3d-481e-8fe1-5eab601b9838 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:58.323850 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-ece53898-8f3d-481e-8fe1-5eab601b9838 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:58.325576 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-ece53898-8f3d-481e-8fe1-5eab601b9838 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:58.328809 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-ece53898-8f3d-481e-8fe1-5eab601b9838 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6" status: 200 len: 1671 microversion: 2.20 time: 0.468454 Sep 14 09:15:58.336808 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2622/5268] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:15:57 2022] GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6 => generated 1671 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:15:58.344706 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f3acbb6c-c7c8-4211-93fd-7bd4667de8fc tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:58.345746 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f3acbb6c-c7c8-4211-93fd-7bd4667de8fc tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:58.366753 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f3acbb6c-c7c8-4211-93fd-7bd4667de8fc tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:58.368038 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f3acbb6c-c7c8-4211-93fd-7bd4667de8fc tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:58.368808 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f3acbb6c-c7c8-4211-93fd-7bd4667de8fc tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:58.369665 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f3acbb6c-c7c8-4211-93fd-7bd4667de8fc tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:58.370269 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f3acbb6c-c7c8-4211-93fd-7bd4667de8fc tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:58.370867 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f3acbb6c-c7c8-4211-93fd-7bd4667de8fc tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:58.551301 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-2f3236df-44bf-4909-a058-d8f2599fdc5f tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Flavor limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:15:58.551755 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-2f3236df-44bf-4909-a058-d8f2599fdc5f tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Image limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:15:58.552241 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-2f3236df-44bf-4909-a058-d8f2599fdc5f tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Flavor pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:15:58.553902 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-2f3236df-44bf-4909-a058-d8f2599fdc5f tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Image pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:15:58.554351 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-2f3236df-44bf-4909-a058-d8f2599fdc5f tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:15:58.578911 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2f3236df-44bf-4909-a058-d8f2599fdc5f tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:58.581470 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2f3236df-44bf-4909-a058-d8f2599fdc5f tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:58.583248 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2f3236df-44bf-4909-a058-d8f2599fdc5f tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:58.585430 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2f3236df-44bf-4909-a058-d8f2599fdc5f tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:58.587130 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2f3236df-44bf-4909-a058-d8f2599fdc5f tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:58.587730 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2f3236df-44bf-4909-a058-d8f2599fdc5f tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:58.629713 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-2f3236df-44bf-4909-a058-d8f2599fdc5f tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Getting quotas for project 693e3fb677fb4bd387f1c86b369061dc. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:15:58.639786 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-2f3236df-44bf-4909-a058-d8f2599fdc5f tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Getting quotas for user 538af7e0ab7c462fae161e4e8c5bf1eb and project 693e3fb677fb4bd387f1c86b369061dc. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:15:58.655373 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-2f3236df-44bf-4909-a058-d8f2599fdc5f tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Going to run 1 instances... {{(pid=128758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:15:58.658080 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-2f3236df-44bf-4909-a058-d8f2599fdc5f tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] [instance: 12910e13-030f-4238-94b4-0d5c50c1e9e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:15:58.685393 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f3acbb6c-c7c8-4211-93fd-7bd4667de8fc tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:58.699522 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f3acbb6c-c7c8-4211-93fd-7bd4667de8fc tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105" status: 200 len: 1678 microversion: 2.1 time: 0.361245 Sep 14 09:15:58.704478 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2623/5269] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:15:58 2022] GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105 => generated 1678 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:15:58.712738 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e71ba819-59c0-44cd-8b79-ca7c9de2ab78 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:58.713389 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e71ba819-59c0-44cd-8b79-ca7c9de2ab78 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] [instance: a8305358-1f82-4022-b511-8d3e3d445a92] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:58.726401 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-2f3236df-44bf-4909-a058-d8f2599fdc5f tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.007499 Sep 14 09:15:58.727472 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e71ba819-59c0-44cd-8b79-ca7c9de2ab78 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:58.727971 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e71ba819-59c0-44cd-8b79-ca7c9de2ab78 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:58.729574 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e71ba819-59c0-44cd-8b79-ca7c9de2ab78 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:58.730287 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e71ba819-59c0-44cd-8b79-ca7c9de2ab78 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:58.731199 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2647/5270] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 09:15:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1012 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 14 09:15:58.731541 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e71ba819-59c0-44cd-8b79-ca7c9de2ab78 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:58.731973 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e71ba819-59c0-44cd-8b79-ca7c9de2ab78 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:58.758582 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-32cda706-6a00-41b4-af40-bde60bc3f65b tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:58.774865 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-32cda706-6a00-41b4-af40-bde60bc3f65b tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] [instance: a5837087-a7ec-4b17-9162-d1ef5ecf2574] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:58.793731 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-32cda706-6a00-41b4-af40-bde60bc3f65b tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:58.795565 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-32cda706-6a00-41b4-af40-bde60bc3f65b tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:58.803599 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-32cda706-6a00-41b4-af40-bde60bc3f65b tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:58.804668 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-32cda706-6a00-41b4-af40-bde60bc3f65b tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:58.805336 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-32cda706-6a00-41b4-af40-bde60bc3f65b tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:58.807207 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-32cda706-6a00-41b4-af40-bde60bc3f65b tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:59.095515 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-e71ba819-59c0-44cd-8b79-ca7c9de2ab78 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb33a017168c4a8bae36eacd9ba6a7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24f2e13835b240578d411521ee520115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:59.103706 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e71ba819-59c0-44cd-8b79-ca7c9de2ab78 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] 10.222.0.60 "GET /compute/v2.1/servers/a8305358-1f82-4022-b511-8d3e3d445a92" status: 200 len: 1498 microversion: 2.1 time: 0.398175 Sep 14 09:15:59.119284 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2624/5271] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:15:58 2022] GET /compute/v2.1/servers/a8305358-1f82-4022-b511-8d3e3d445a92 => generated 1498 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:15:59.131093 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-26eb5ed8-abb0-43ea-abe6-ec63cfd6d613 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:59.132094 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-26eb5ed8-abb0-43ea-abe6-ec63cfd6d613 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] [instance: 12910e13-030f-4238-94b4-0d5c50c1e9e2] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:59.245099 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-32cda706-6a00-41b4-af40-bde60bc3f65b tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17918433a3994b69a65999a59a7f833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b73b20f2042c6a08f94ed23ff66e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:59.262771 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-32cda706-6a00-41b4-af40-bde60bc3f65b tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] 10.222.0.60 "GET /compute/v2.1/servers/a5837087-a7ec-4b17-9162-d1ef5ecf2574" status: 200 len: 1372 microversion: 2.1 time: 0.527658 Sep 14 09:15:59.275227 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2648/5272] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:15:58 2022] GET /compute/v2.1/servers/a5837087-a7ec-4b17-9162-d1ef5ecf2574 => generated 1372 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:15:59.281260 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b5c4afff-27cf-4dab-97ae-b182bd75098f tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:59.281883 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-b5c4afff-27cf-4dab-97ae-b182bd75098f tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [instance: 3ceabacb-cbf6-409a-8c82-55e9901bd8d7] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:59.289871 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b5c4afff-27cf-4dab-97ae-b182bd75098f tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:59.290600 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b5c4afff-27cf-4dab-97ae-b182bd75098f tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:59.291251 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b5c4afff-27cf-4dab-97ae-b182bd75098f tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:59.292112 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b5c4afff-27cf-4dab-97ae-b182bd75098f tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:59.292719 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b5c4afff-27cf-4dab-97ae-b182bd75098f tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:59.299599 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b5c4afff-27cf-4dab-97ae-b182bd75098f tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:59.307543 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-26eb5ed8-abb0-43ea-abe6-ec63cfd6d613 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538af7e0ab7c462fae161e4e8c5bf1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693e3fb677fb4bd387f1c86b369061dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:59.317523 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-26eb5ed8-abb0-43ea-abe6-ec63cfd6d613 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] 10.222.0.60 "GET /compute/v2.1/servers/12910e13-030f-4238-94b4-0d5c50c1e9e2" status: 200 len: 1213 microversion: 2.1 time: 0.208367 Sep 14 09:15:59.331918 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2625/5273] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:15:59 2022] GET /compute/v2.1/servers/12910e13-030f-4238-94b4-0d5c50c1e9e2 => generated 1213 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:15:59.349013 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-5df581ea-35e3-411e-af47-cd2ccf7bea29 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:15:59.356242 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-5df581ea-35e3-411e-af47-cd2ccf7bea29 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] [instance: a8305358-1f82-4022-b511-8d3e3d445a92] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:59.367159 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5df581ea-35e3-411e-af47-cd2ccf7bea29 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:59.368002 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5df581ea-35e3-411e-af47-cd2ccf7bea29 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:59.368658 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5df581ea-35e3-411e-af47-cd2ccf7bea29 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:59.369590 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5df581ea-35e3-411e-af47-cd2ccf7bea29 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:59.370269 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5df581ea-35e3-411e-af47-cd2ccf7bea29 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:59.370911 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5df581ea-35e3-411e-af47-cd2ccf7bea29 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:59.401747 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.objects.instance [None req-5df581ea-35e3-411e-af47-cd2ccf7bea29 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lazy-loading 'flavor' on Instance uuid a8305358-1f82-4022-b511-8d3e3d445a92 {{(pid=128759) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:15:59.515872 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-5df581ea-35e3-411e-af47-cd2ccf7bea29 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] 10.222.0.60 "POST /compute/v2.1/servers/a8305358-1f82-4022-b511-8d3e3d445a92/action" status: 200 len: 32 microversion: 2.1 time: 0.182083 Sep 14 09:15:59.517421 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2626/5274] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:15:59 2022] POST /compute/v2.1/servers/a8305358-1f82-4022-b511-8d3e3d445a92/action => generated 32 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 09:15:59.537902 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-8f2cb775-2004-4ed9-b5d1-9f298ac7b0e4 req-d096d27b-2dd1-4832-bfd5-074a63da0394 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5837087-a7ec-4b17-9162-d1ef5ecf2574", "name": "network-vif-plugged", "status": "completed", "tag": "a50f72ef-bb63-4ef6-b28d-a3d8cd24469e"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:15:59.557941 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-8f2cb775-2004-4ed9-b5d1-9f298ac7b0e4 req-d096d27b-2dd1-4832-bfd5-074a63da0394 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:59.558476 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-8f2cb775-2004-4ed9-b5d1-9f298ac7b0e4 req-d096d27b-2dd1-4832-bfd5-074a63da0394 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:59.559239 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-8f2cb775-2004-4ed9-b5d1-9f298ac7b0e4 req-d096d27b-2dd1-4832-bfd5-074a63da0394 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:59.576306 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-8f2cb775-2004-4ed9-b5d1-9f298ac7b0e4 req-d096d27b-2dd1-4832-bfd5-074a63da0394 service nova] Creating event network-vif-plugged:a50f72ef-bb63-4ef6-b28d-a3d8cd24469e for instance a5837087-a7ec-4b17-9162-d1ef5ecf2574 on n-h2-836830-18 Sep 14 09:15:59.584191 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-8f2cb775-2004-4ed9-b5d1-9f298ac7b0e4 req-d096d27b-2dd1-4832-bfd5-074a63da0394 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063740 Sep 14 09:15:59.584191 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2627/5275] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:15:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:15:59.594171 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8d708653-bc32-4506-ab23-cf102f46db7b tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:59.607381 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-8d708653-bc32-4506-ab23-cf102f46db7b tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 50157c1b-c748-4d1f-928e-207482b37ec6] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:59.642062 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8d708653-bc32-4506-ab23-cf102f46db7b tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:59.642972 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8d708653-bc32-4506-ab23-cf102f46db7b tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:59.643529 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8d708653-bc32-4506-ab23-cf102f46db7b tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:59.646796 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8d708653-bc32-4506-ab23-cf102f46db7b tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:59.647763 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8d708653-bc32-4506-ab23-cf102f46db7b tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:59.652139 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8d708653-bc32-4506-ab23-cf102f46db7b tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:00.491895 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-b5c4afff-27cf-4dab-97ae-b182bd75098f tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daab4f69af5452c8641006d9f09edce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9672a6c416ee44289eaa4d7c664d307e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:00.506224 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-b5c4afff-27cf-4dab-97ae-b182bd75098f tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "GET /compute/v2.1/servers/3ceabacb-cbf6-409a-8c82-55e9901bd8d7" status: 200 len: 1367 microversion: 2.1 time: 1.229799 Sep 14 09:16:00.506830 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2649/5276] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:15:59 2022] GET /compute/v2.1/servers/3ceabacb-cbf6-409a-8c82-55e9901bd8d7 => generated 1367 bytes in 1231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:00.515049 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d0d6f8a8-6458-477c-bb5c-841e74e1d8b0 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:00.515680 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-d0d6f8a8-6458-477c-bb5c-841e74e1d8b0 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] [instance: a8305358-1f82-4022-b511-8d3e3d445a92] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:00.531228 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d0d6f8a8-6458-477c-bb5c-841e74e1d8b0 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:00.531730 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d0d6f8a8-6458-477c-bb5c-841e74e1d8b0 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:00.532177 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d0d6f8a8-6458-477c-bb5c-841e74e1d8b0 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:00.532906 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d0d6f8a8-6458-477c-bb5c-841e74e1d8b0 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:00.533368 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d0d6f8a8-6458-477c-bb5c-841e74e1d8b0 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:00.533795 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d0d6f8a8-6458-477c-bb5c-841e74e1d8b0 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:00.764677 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-8d708653-bc32-4506-ab23-cf102f46db7b tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:00.798305 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-8d708653-bc32-4506-ab23-cf102f46db7b tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:00.800011 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-8d708653-bc32-4506-ab23-cf102f46db7b tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:00.801369 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-8d708653-bc32-4506-ab23-cf102f46db7b tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6" status: 200 len: 1729 microversion: 2.20 time: 1.216764 Sep 14 09:16:00.803764 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2628/5277] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:15:59 2022] GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6 => generated 1729 bytes in 1220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:16:00.826800 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-1f68e343-501c-4103-846c-978e4b1645b6 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:00.834539 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-1f68e343-501c-4103-846c-978e4b1645b6 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:00.855612 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1f68e343-501c-4103-846c-978e4b1645b6 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:00.856524 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1f68e343-501c-4103-846c-978e4b1645b6 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:00.857167 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1f68e343-501c-4103-846c-978e4b1645b6 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:00.859447 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1f68e343-501c-4103-846c-978e4b1645b6 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:00.861400 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1f68e343-501c-4103-846c-978e4b1645b6 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:00.863469 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1f68e343-501c-4103-846c-978e4b1645b6 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:01.035772 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-d0d6f8a8-6458-477c-bb5c-841e74e1d8b0 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb33a017168c4a8bae36eacd9ba6a7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24f2e13835b240578d411521ee520115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:01.048413 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-d0d6f8a8-6458-477c-bb5c-841e74e1d8b0 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] 10.222.0.60 "GET /compute/v2.1/servers/a8305358-1f82-4022-b511-8d3e3d445a92" status: 200 len: 1504 microversion: 2.1 time: 0.540216 Sep 14 09:16:01.050923 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2650/5278] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:00 2022] GET /compute/v2.1/servers/a8305358-1f82-4022-b511-8d3e3d445a92 => generated 1504 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:01.077243 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a76588ac-8380-4d8c-8e94-71cf93d31c60 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:01.078751 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-a76588ac-8380-4d8c-8e94-71cf93d31c60 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] [instance: a5837087-a7ec-4b17-9162-d1ef5ecf2574] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:01.100718 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a76588ac-8380-4d8c-8e94-71cf93d31c60 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:01.103920 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a76588ac-8380-4d8c-8e94-71cf93d31c60 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:01.116142 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a76588ac-8380-4d8c-8e94-71cf93d31c60 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:01.117335 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a76588ac-8380-4d8c-8e94-71cf93d31c60 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:01.119498 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a76588ac-8380-4d8c-8e94-71cf93d31c60 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:01.122517 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a76588ac-8380-4d8c-8e94-71cf93d31c60 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:01.466843 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-1f68e343-501c-4103-846c-978e4b1645b6 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:01.481082 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-1f68e343-501c-4103-846c-978e4b1645b6 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105" status: 200 len: 1678 microversion: 2.1 time: 0.675953 Sep 14 09:16:01.481852 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2629/5279] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:00 2022] GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105 => generated 1678 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:01.505254 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8f3e5761-df55-44e1-ac56-150286183588 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:01.506867 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-8f3e5761-df55-44e1-ac56-150286183588 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] [instance: 12910e13-030f-4238-94b4-0d5c50c1e9e2] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:01.514745 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8f3e5761-df55-44e1-ac56-150286183588 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:01.515287 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8f3e5761-df55-44e1-ac56-150286183588 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:01.516308 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8f3e5761-df55-44e1-ac56-150286183588 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:01.517161 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8f3e5761-df55-44e1-ac56-150286183588 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:01.517669 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8f3e5761-df55-44e1-ac56-150286183588 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:01.518842 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8f3e5761-df55-44e1-ac56-150286183588 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:01.549830 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-a76588ac-8380-4d8c-8e94-71cf93d31c60 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17918433a3994b69a65999a59a7f833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b73b20f2042c6a08f94ed23ff66e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:01.564437 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-a76588ac-8380-4d8c-8e94-71cf93d31c60 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] 10.222.0.60 "GET /compute/v2.1/servers/a5837087-a7ec-4b17-9162-d1ef5ecf2574" status: 200 len: 1372 microversion: 2.1 time: 0.510901 Sep 14 09:16:01.566086 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2651/5280] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:01 2022] GET /compute/v2.1/servers/a5837087-a7ec-4b17-9162-d1ef5ecf2574 => generated 1372 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:01.576656 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-e2086fb4-aaff-4c74-8dae-cf97978eff25 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:01.584077 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-e2086fb4-aaff-4c74-8dae-cf97978eff25 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [instance: 3ceabacb-cbf6-409a-8c82-55e9901bd8d7] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:01.598513 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e2086fb4-aaff-4c74-8dae-cf97978eff25 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:01.601097 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e2086fb4-aaff-4c74-8dae-cf97978eff25 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:01.603906 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e2086fb4-aaff-4c74-8dae-cf97978eff25 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:01.604915 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e2086fb4-aaff-4c74-8dae-cf97978eff25 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:01.605541 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e2086fb4-aaff-4c74-8dae-cf97978eff25 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:01.609005 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e2086fb4-aaff-4c74-8dae-cf97978eff25 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:01.638520 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:16:01.709191 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-8f3e5761-df55-44e1-ac56-150286183588 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538af7e0ab7c462fae161e4e8c5bf1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693e3fb677fb4bd387f1c86b369061dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:01.719744 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-8f3e5761-df55-44e1-ac56-150286183588 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] 10.222.0.60 "GET /compute/v2.1/servers/12910e13-030f-4238-94b4-0d5c50c1e9e2" status: 200 len: 1271 microversion: 2.1 time: 0.218338 Sep 14 09:16:01.726242 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2630/5281] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:01 2022] GET /compute/v2.1/servers/12910e13-030f-4238-94b4-0d5c50c1e9e2 => generated 1271 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:01.739165 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-2ab95cfa-316f-45b8-a5d3-14b0f245c65b req-5f6aa096-04c6-4743-a22c-838de816a8d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ceabacb-cbf6-409a-8c82-55e9901bd8d7", "name": "network-vif-plugged", "status": "completed", "tag": "e75fecd4-ad0f-481f-b575-74e5343cdbc3"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:16:01.761977 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-2ab95cfa-316f-45b8-a5d3-14b0f245c65b req-5f6aa096-04c6-4743-a22c-838de816a8d6 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:01.762477 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-2ab95cfa-316f-45b8-a5d3-14b0f245c65b req-5f6aa096-04c6-4743-a22c-838de816a8d6 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:01.762915 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-2ab95cfa-316f-45b8-a5d3-14b0f245c65b req-5f6aa096-04c6-4743-a22c-838de816a8d6 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:01.793923 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-2ab95cfa-316f-45b8-a5d3-14b0f245c65b req-5f6aa096-04c6-4743-a22c-838de816a8d6 service nova] Creating event network-vif-plugged:e75fecd4-ad0f-481f-b575-74e5343cdbc3 for instance 3ceabacb-cbf6-409a-8c82-55e9901bd8d7 on n-h1-836830-18 Sep 14 09:16:01.802173 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-2ab95cfa-316f-45b8-a5d3-14b0f245c65b req-5f6aa096-04c6-4743-a22c-838de816a8d6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073989 Sep 14 09:16:01.804516 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2631/5282] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:16:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:16:01.830496 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-bf4eecaa-a8d3-4f07-a651-fa02f1261d25 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:01.831260 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-bf4eecaa-a8d3-4f07-a651-fa02f1261d25 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 50157c1b-c748-4d1f-928e-207482b37ec6] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:01.869013 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bf4eecaa-a8d3-4f07-a651-fa02f1261d25 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:01.889870 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bf4eecaa-a8d3-4f07-a651-fa02f1261d25 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:01.890457 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bf4eecaa-a8d3-4f07-a651-fa02f1261d25 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:01.892977 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bf4eecaa-a8d3-4f07-a651-fa02f1261d25 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:01.894806 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bf4eecaa-a8d3-4f07-a651-fa02f1261d25 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:01.895433 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bf4eecaa-a8d3-4f07-a651-fa02f1261d25 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:02.037000 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-e2086fb4-aaff-4c74-8dae-cf97978eff25 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daab4f69af5452c8641006d9f09edce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9672a6c416ee44289eaa4d7c664d307e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:02.050308 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-e2086fb4-aaff-4c74-8dae-cf97978eff25 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "GET /compute/v2.1/servers/3ceabacb-cbf6-409a-8c82-55e9901bd8d7" status: 200 len: 1367 microversion: 2.1 time: 0.482710 Sep 14 09:16:02.054681 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2652/5283] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:01 2022] GET /compute/v2.1/servers/3ceabacb-cbf6-409a-8c82-55e9901bd8d7 => generated 1367 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:02.064056 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-c7eb46e6-6096-43ca-91bb-c3dc6f7f281e req-78c3943e-c334-40de-9e02-46f8e5488701 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50157c1b-c748-4d1f-928e-207482b37ec6", "tag": "6bb7c82b-6dea-4020-abff-f1c92580e9d8"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:16:02.088112 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-c7eb46e6-6096-43ca-91bb-c3dc6f7f281e req-78c3943e-c334-40de-9e02-46f8e5488701 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:02.091450 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-c7eb46e6-6096-43ca-91bb-c3dc6f7f281e req-78c3943e-c334-40de-9e02-46f8e5488701 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:02.092057 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-c7eb46e6-6096-43ca-91bb-c3dc6f7f281e req-78c3943e-c334-40de-9e02-46f8e5488701 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:02.118394 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-c7eb46e6-6096-43ca-91bb-c3dc6f7f281e req-78c3943e-c334-40de-9e02-46f8e5488701 service nova] Creating event network-changed:6bb7c82b-6dea-4020-abff-f1c92580e9d8 for instance 50157c1b-c748-4d1f-928e-207482b37ec6 on n-h1-836830-18 Sep 14 09:16:02.133383 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-c7eb46e6-6096-43ca-91bb-c3dc6f7f281e req-78c3943e-c334-40de-9e02-46f8e5488701 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077041 Sep 14 09:16:02.134040 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2653/5284] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:16:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:16:02.146603 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-8412fe4e-4945-4f28-b6b7-cf0a515811e5 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:02.152201 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-8412fe4e-4945-4f28-b6b7-cf0a515811e5 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] [instance: a8305358-1f82-4022-b511-8d3e3d445a92] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:02.166459 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8412fe4e-4945-4f28-b6b7-cf0a515811e5 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:02.167472 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8412fe4e-4945-4f28-b6b7-cf0a515811e5 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:02.168076 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8412fe4e-4945-4f28-b6b7-cf0a515811e5 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:02.169011 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8412fe4e-4945-4f28-b6b7-cf0a515811e5 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:02.169694 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8412fe4e-4945-4f28-b6b7-cf0a515811e5 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:02.170322 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8412fe4e-4945-4f28-b6b7-cf0a515811e5 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:02.644644 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-bf4eecaa-a8d3-4f07-a651-fa02f1261d25 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:02.654844 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-bf4eecaa-a8d3-4f07-a651-fa02f1261d25 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:02.663958 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-bf4eecaa-a8d3-4f07-a651-fa02f1261d25 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:02.666728 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-bf4eecaa-a8d3-4f07-a651-fa02f1261d25 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6" status: 200 len: 1729 microversion: 2.20 time: 0.842162 Sep 14 09:16:02.669210 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2632/5285] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:16:01 2022] GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6 => generated 1729 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:16:02.678661 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-1035ddf3-4fb9-44b5-85cf-b92f482b202a tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:02.681344 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-1035ddf3-4fb9-44b5-85cf-b92f482b202a tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:02.697172 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1035ddf3-4fb9-44b5-85cf-b92f482b202a tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:02.707646 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-8412fe4e-4945-4f28-b6b7-cf0a515811e5 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb33a017168c4a8bae36eacd9ba6a7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24f2e13835b240578d411521ee520115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:02.713227 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1035ddf3-4fb9-44b5-85cf-b92f482b202a tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:02.716734 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1035ddf3-4fb9-44b5-85cf-b92f482b202a tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:02.720245 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1035ddf3-4fb9-44b5-85cf-b92f482b202a tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:02.722047 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-8412fe4e-4945-4f28-b6b7-cf0a515811e5 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] 10.222.0.60 "GET /compute/v2.1/servers/a8305358-1f82-4022-b511-8d3e3d445a92" status: 200 len: 1504 microversion: 2.1 time: 0.586784 Sep 14 09:16:02.722383 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1035ddf3-4fb9-44b5-85cf-b92f482b202a tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:02.723132 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1035ddf3-4fb9-44b5-85cf-b92f482b202a tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:02.740277 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2654/5286] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:02 2022] GET /compute/v2.1/servers/a8305358-1f82-4022-b511-8d3e3d445a92 => generated 1504 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:02.760634 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-54c4ae99-81df-48b3-9913-0d8c4cc7b49d tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:02.762590 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-54c4ae99-81df-48b3-9913-0d8c4cc7b49d tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] [instance: a5837087-a7ec-4b17-9162-d1ef5ecf2574] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:02.780947 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-54c4ae99-81df-48b3-9913-0d8c4cc7b49d tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:02.782477 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-54c4ae99-81df-48b3-9913-0d8c4cc7b49d tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:02.784250 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-54c4ae99-81df-48b3-9913-0d8c4cc7b49d tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:02.787117 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-54c4ae99-81df-48b3-9913-0d8c4cc7b49d tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:02.789540 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-54c4ae99-81df-48b3-9913-0d8c4cc7b49d tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:02.790621 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-54c4ae99-81df-48b3-9913-0d8c4cc7b49d tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:03.299881 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-54c4ae99-81df-48b3-9913-0d8c4cc7b49d tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17918433a3994b69a65999a59a7f833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b73b20f2042c6a08f94ed23ff66e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:03.318625 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-54c4ae99-81df-48b3-9913-0d8c4cc7b49d tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] 10.222.0.60 "GET /compute/v2.1/servers/a5837087-a7ec-4b17-9162-d1ef5ecf2574" status: 200 len: 1545 microversion: 2.1 time: 0.574970 Sep 14 09:16:03.319559 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2655/5287] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:02 2022] GET /compute/v2.1/servers/a5837087-a7ec-4b17-9162-d1ef5ecf2574 => generated 1545 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:03.330688 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-888a9f72-d8b7-4abc-9f83-7f6bd13331ab tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:03.331351 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-888a9f72-d8b7-4abc-9f83-7f6bd13331ab tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] [instance: 12910e13-030f-4238-94b4-0d5c50c1e9e2] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:03.345818 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-888a9f72-d8b7-4abc-9f83-7f6bd13331ab tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:03.346324 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-888a9f72-d8b7-4abc-9f83-7f6bd13331ab tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:03.346770 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-888a9f72-d8b7-4abc-9f83-7f6bd13331ab tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:03.349938 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-888a9f72-d8b7-4abc-9f83-7f6bd13331ab tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:03.350429 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-888a9f72-d8b7-4abc-9f83-7f6bd13331ab tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:03.350877 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-888a9f72-d8b7-4abc-9f83-7f6bd13331ab tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:03.461664 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-1035ddf3-4fb9-44b5-85cf-b92f482b202a tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:03.475776 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-1035ddf3-4fb9-44b5-85cf-b92f482b202a tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105" status: 200 len: 1655 microversion: 2.1 time: 0.804569 Sep 14 09:16:03.479061 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2633/5288] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:02 2022] GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105 => generated 1655 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:03.483745 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-1bc3ebad-5e29-46fd-93f4-5a313cb14b1d tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:03.484431 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-1bc3ebad-5e29-46fd-93f4-5a313cb14b1d tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [instance: 3ceabacb-cbf6-409a-8c82-55e9901bd8d7] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:03.494632 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1bc3ebad-5e29-46fd-93f4-5a313cb14b1d tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:03.496580 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1bc3ebad-5e29-46fd-93f4-5a313cb14b1d tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:03.507607 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1bc3ebad-5e29-46fd-93f4-5a313cb14b1d tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:03.508509 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1bc3ebad-5e29-46fd-93f4-5a313cb14b1d tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:03.509021 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1bc3ebad-5e29-46fd-93f4-5a313cb14b1d tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:03.509741 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1bc3ebad-5e29-46fd-93f4-5a313cb14b1d tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:03.612245 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-888a9f72-d8b7-4abc-9f83-7f6bd13331ab tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538af7e0ab7c462fae161e4e8c5bf1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693e3fb677fb4bd387f1c86b369061dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:03.621751 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-888a9f72-d8b7-4abc-9f83-7f6bd13331ab tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] 10.222.0.60 "GET /compute/v2.1/servers/12910e13-030f-4238-94b4-0d5c50c1e9e2" status: 200 len: 1313 microversion: 2.1 time: 0.299050 Sep 14 09:16:03.635262 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2656/5289] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:03 2022] GET /compute/v2.1/servers/12910e13-030f-4238-94b4-0d5c50c1e9e2 => generated 1313 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:03.645043 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-448161a9-24ea-4741-b4da-a1f946d8cc82 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:03.645754 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-448161a9-24ea-4741-b4da-a1f946d8cc82 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] [instance: a5837087-a7ec-4b17-9162-d1ef5ecf2574] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:03.662785 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-448161a9-24ea-4741-b4da-a1f946d8cc82 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:03.663336 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-448161a9-24ea-4741-b4da-a1f946d8cc82 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:03.663779 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-448161a9-24ea-4741-b4da-a1f946d8cc82 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:03.665081 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-448161a9-24ea-4741-b4da-a1f946d8cc82 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:03.666270 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-448161a9-24ea-4741-b4da-a1f946d8cc82 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:03.666270 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-448161a9-24ea-4741-b4da-a1f946d8cc82 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:03.893496 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-1bc3ebad-5e29-46fd-93f4-5a313cb14b1d tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daab4f69af5452c8641006d9f09edce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9672a6c416ee44289eaa4d7c664d307e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:03.906136 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-1bc3ebad-5e29-46fd-93f4-5a313cb14b1d tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "GET /compute/v2.1/servers/3ceabacb-cbf6-409a-8c82-55e9901bd8d7" status: 200 len: 1367 microversion: 2.1 time: 0.427974 Sep 14 09:16:03.919463 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2634/5290] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:03 2022] GET /compute/v2.1/servers/3ceabacb-cbf6-409a-8c82-55e9901bd8d7 => generated 1367 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:03.925144 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f505c10f-1b11-463f-9330-7c908deccb9c tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:16:03.931617 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f505c10f-1b11-463f-9330-7c908deccb9c tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:03.932348 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f505c10f-1b11-463f-9330-7c908deccb9c tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:03.932959 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f505c10f-1b11-463f-9330-7c908deccb9c tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:03.959440 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f505c10f-1b11-463f-9330-7c908deccb9c tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Going to try to start instance {{(pid=128759) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 14 09:16:04.006795 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:16:04.028510 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f505c10f-1b11-463f-9330-7c908deccb9c tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "POST /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105/action" status: 202 len: 0 microversion: 2.1 time: 0.108035 Sep 14 09:16:04.029130 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2635/5291] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:16:03 2022] POST /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:16:04.043381 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-44b13cdf-189a-48f0-bf39-b239d78e5568 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:04.044129 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-44b13cdf-189a-48f0-bf39-b239d78e5568 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 50157c1b-c748-4d1f-928e-207482b37ec6] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:04.072395 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-44b13cdf-189a-48f0-bf39-b239d78e5568 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:04.073135 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-44b13cdf-189a-48f0-bf39-b239d78e5568 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:04.073735 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-44b13cdf-189a-48f0-bf39-b239d78e5568 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:04.074458 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-44b13cdf-189a-48f0-bf39-b239d78e5568 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:04.075115 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-44b13cdf-189a-48f0-bf39-b239d78e5568 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:04.075699 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-44b13cdf-189a-48f0-bf39-b239d78e5568 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:04.199467 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-448161a9-24ea-4741-b4da-a1f946d8cc82 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17918433a3994b69a65999a59a7f833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b73b20f2042c6a08f94ed23ff66e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:04.211075 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-448161a9-24ea-4741-b4da-a1f946d8cc82 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] 10.222.0.60 "GET /compute/v2.1/servers/a5837087-a7ec-4b17-9162-d1ef5ecf2574" status: 200 len: 1545 microversion: 2.1 time: 0.587569 Sep 14 09:16:04.212136 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2657/5292] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:03 2022] GET /compute/v2.1/servers/a5837087-a7ec-4b17-9162-d1ef5ecf2574 => generated 1545 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:04.216756 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-bce413f3-dd84-4833-9118-3ba9943101b3 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:04.217378 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-bce413f3-dd84-4833-9118-3ba9943101b3 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] [instance: a8305358-1f82-4022-b511-8d3e3d445a92] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:04.237545 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bce413f3-dd84-4833-9118-3ba9943101b3 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:04.238054 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bce413f3-dd84-4833-9118-3ba9943101b3 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:04.238511 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bce413f3-dd84-4833-9118-3ba9943101b3 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:04.239283 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bce413f3-dd84-4833-9118-3ba9943101b3 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:04.243504 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bce413f3-dd84-4833-9118-3ba9943101b3 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:04.245825 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bce413f3-dd84-4833-9118-3ba9943101b3 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:04.578782 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-44b13cdf-189a-48f0-bf39-b239d78e5568 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:04.588594 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-44b13cdf-189a-48f0-bf39-b239d78e5568 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:04.590080 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-44b13cdf-189a-48f0-bf39-b239d78e5568 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:04.591311 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-44b13cdf-189a-48f0-bf39-b239d78e5568 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6" status: 200 len: 1729 microversion: 2.20 time: 0.560842 Sep 14 09:16:04.591898 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2636/5293] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:16:04 2022] GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6 => generated 1729 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:16:04.614182 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-1a3d9c85-db23-4eaf-9fa9-d274343540e0 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:04.614818 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-1a3d9c85-db23-4eaf-9fa9-d274343540e0 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:04.624053 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1a3d9c85-db23-4eaf-9fa9-d274343540e0 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:04.624560 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1a3d9c85-db23-4eaf-9fa9-d274343540e0 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:04.625056 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1a3d9c85-db23-4eaf-9fa9-d274343540e0 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:04.625994 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1a3d9c85-db23-4eaf-9fa9-d274343540e0 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:04.629520 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1a3d9c85-db23-4eaf-9fa9-d274343540e0 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:04.630227 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1a3d9c85-db23-4eaf-9fa9-d274343540e0 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:04.642789 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-bce413f3-dd84-4833-9118-3ba9943101b3 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb33a017168c4a8bae36eacd9ba6a7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24f2e13835b240578d411521ee520115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:04.653363 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-bce413f3-dd84-4833-9118-3ba9943101b3 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] 10.222.0.60 "GET /compute/v2.1/servers/a8305358-1f82-4022-b511-8d3e3d445a92" status: 200 len: 1504 microversion: 2.1 time: 0.440144 Sep 14 09:16:04.657058 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2658/5294] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:04 2022] GET /compute/v2.1/servers/a8305358-1f82-4022-b511-8d3e3d445a92 => generated 1504 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:04.674867 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c986a437-f097-4b85-b07b-0907b0821437 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:04.679936 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-c986a437-f097-4b85-b07b-0907b0821437 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] [instance: 12910e13-030f-4238-94b4-0d5c50c1e9e2] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:04.690319 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c986a437-f097-4b85-b07b-0907b0821437 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:04.690870 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c986a437-f097-4b85-b07b-0907b0821437 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:04.691927 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c986a437-f097-4b85-b07b-0907b0821437 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:04.692772 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c986a437-f097-4b85-b07b-0907b0821437 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:04.693285 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c986a437-f097-4b85-b07b-0907b0821437 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:04.693721 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c986a437-f097-4b85-b07b-0907b0821437 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:04.978915 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-1a3d9c85-db23-4eaf-9fa9-d274343540e0 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:04.997416 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-1a3d9c85-db23-4eaf-9fa9-d274343540e0 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105" status: 200 len: 1664 microversion: 2.1 time: 0.396672 Sep 14 09:16:04.998301 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2637/5295] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:04 2022] GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105 => generated 1664 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:05.033092 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b7c6bb19-f9aa-4c78-ab88-f87ee7522e5c tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:05.034063 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b7c6bb19-f9aa-4c78-ab88-f87ee7522e5c tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [instance: 3ceabacb-cbf6-409a-8c82-55e9901bd8d7] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:05.036267 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-c986a437-f097-4b85-b07b-0907b0821437 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538af7e0ab7c462fae161e4e8c5bf1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693e3fb677fb4bd387f1c86b369061dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:05.049050 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-c986a437-f097-4b85-b07b-0907b0821437 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] 10.222.0.60 "GET /compute/v2.1/servers/12910e13-030f-4238-94b4-0d5c50c1e9e2" status: 200 len: 1313 microversion: 2.1 time: 0.387938 Sep 14 09:16:05.051973 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2659/5296] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:04 2022] GET /compute/v2.1/servers/12910e13-030f-4238-94b4-0d5c50c1e9e2 => generated 1313 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:05.078380 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b7c6bb19-f9aa-4c78-ab88-f87ee7522e5c tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:05.083349 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b7c6bb19-f9aa-4c78-ab88-f87ee7522e5c tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:05.084921 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b7c6bb19-f9aa-4c78-ab88-f87ee7522e5c tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:05.086538 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b7c6bb19-f9aa-4c78-ab88-f87ee7522e5c tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:05.090499 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b7c6bb19-f9aa-4c78-ab88-f87ee7522e5c tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:05.092243 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b7c6bb19-f9aa-4c78-ab88-f87ee7522e5c tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:05.134826 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-7901b0de-3439-45e1-833f-9422c6f35842 req-9af3b376-0e76-4b38-9569-7ce03106f01f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12910e13-030f-4238-94b4-0d5c50c1e9e2", "tag": "6b991f7d-3428-4ddd-bfaf-d97feb016922"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:16:05.164940 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-7901b0de-3439-45e1-833f-9422c6f35842 req-9af3b376-0e76-4b38-9569-7ce03106f01f service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:05.166044 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-7901b0de-3439-45e1-833f-9422c6f35842 req-9af3b376-0e76-4b38-9569-7ce03106f01f service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:05.166769 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-7901b0de-3439-45e1-833f-9422c6f35842 req-9af3b376-0e76-4b38-9569-7ce03106f01f service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:05.209137 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-7901b0de-3439-45e1-833f-9422c6f35842 req-9af3b376-0e76-4b38-9569-7ce03106f01f service nova] Creating event network-changed:6b991f7d-3428-4ddd-bfaf-d97feb016922 for instance 12910e13-030f-4238-94b4-0d5c50c1e9e2 on n-h1-836830-18 Sep 14 09:16:05.220093 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-7901b0de-3439-45e1-833f-9422c6f35842 req-9af3b376-0e76-4b38-9569-7ce03106f01f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090139 Sep 14 09:16:05.221298 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2660/5297] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:16:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:16:05.496030 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b7c6bb19-f9aa-4c78-ab88-f87ee7522e5c tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daab4f69af5452c8641006d9f09edce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9672a6c416ee44289eaa4d7c664d307e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:05.512452 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b7c6bb19-f9aa-4c78-ab88-f87ee7522e5c tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "GET /compute/v2.1/servers/3ceabacb-cbf6-409a-8c82-55e9901bd8d7" status: 200 len: 1558 microversion: 2.1 time: 0.502872 Sep 14 09:16:05.531878 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2638/5298] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:05 2022] GET /compute/v2.1/servers/3ceabacb-cbf6-409a-8c82-55e9901bd8d7 => generated 1558 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:05.539905 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-805a31d6-4eab-4b01-b51a-d2640d235a44 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:05.540749 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-805a31d6-4eab-4b01-b51a-d2640d235a44 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [instance: 3ceabacb-cbf6-409a-8c82-55e9901bd8d7] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:05.549731 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-805a31d6-4eab-4b01-b51a-d2640d235a44 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:05.550406 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-805a31d6-4eab-4b01-b51a-d2640d235a44 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:05.551078 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-805a31d6-4eab-4b01-b51a-d2640d235a44 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:05.551977 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-805a31d6-4eab-4b01-b51a-d2640d235a44 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:05.552782 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-805a31d6-4eab-4b01-b51a-d2640d235a44 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:05.553796 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-805a31d6-4eab-4b01-b51a-d2640d235a44 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:05.627808 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9eda09c4-5543-4d3d-a977-f4efb140562c tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:05.629033 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-9eda09c4-5543-4d3d-a977-f4efb140562c tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 50157c1b-c748-4d1f-928e-207482b37ec6] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:05.646281 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9eda09c4-5543-4d3d-a977-f4efb140562c tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:05.653537 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9eda09c4-5543-4d3d-a977-f4efb140562c tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:05.656271 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9eda09c4-5543-4d3d-a977-f4efb140562c tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:05.660517 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9eda09c4-5543-4d3d-a977-f4efb140562c tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:05.663631 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9eda09c4-5543-4d3d-a977-f4efb140562c tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:05.665578 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9eda09c4-5543-4d3d-a977-f4efb140562c tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:05.928422 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-805a31d6-4eab-4b01-b51a-d2640d235a44 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "GET /compute/v2.1/servers/3ceabacb-cbf6-409a-8c82-55e9901bd8d7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.393639 Sep 14 09:16:05.935280 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2661/5299] 10.222.0.60 () {58 vars in 1275 bytes} [Wed Sep 14 09:16:05 2022] GET /compute/v2.1/servers/3ceabacb-cbf6-409a-8c82-55e9901bd8d7/os-interface => generated 285 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:16:05.959880 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-2f12c68b-d93f-4e47-b7b0-c949c9261dc0 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:05.960850 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-2f12c68b-d93f-4e47-b7b0-c949c9261dc0 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] [instance: a8305358-1f82-4022-b511-8d3e3d445a92] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:05.985138 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2f12c68b-d93f-4e47-b7b0-c949c9261dc0 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:05.988014 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2f12c68b-d93f-4e47-b7b0-c949c9261dc0 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:05.989711 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2f12c68b-d93f-4e47-b7b0-c949c9261dc0 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:05.993602 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2f12c68b-d93f-4e47-b7b0-c949c9261dc0 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:05.997334 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2f12c68b-d93f-4e47-b7b0-c949c9261dc0 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:05.999325 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2f12c68b-d93f-4e47-b7b0-c949c9261dc0 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:06.747558 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-9eda09c4-5543-4d3d-a977-f4efb140562c tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:06.761867 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-9eda09c4-5543-4d3d-a977-f4efb140562c tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:06.769379 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-9eda09c4-5543-4d3d-a977-f4efb140562c tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:06.776283 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-9eda09c4-5543-4d3d-a977-f4efb140562c tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6" status: 200 len: 1729 microversion: 2.20 time: 1.150587 Sep 14 09:16:06.777675 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2639/5300] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:16:05 2022] GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6 => generated 1729 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 09:16:06.802255 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-148b270a-4ccf-4586-8606-92ca4e4a8518 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:06.805957 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-148b270a-4ccf-4586-8606-92ca4e4a8518 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:06.835708 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-148b270a-4ccf-4586-8606-92ca4e4a8518 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:06.838248 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-148b270a-4ccf-4586-8606-92ca4e4a8518 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:06.839038 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-148b270a-4ccf-4586-8606-92ca4e4a8518 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:06.841125 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-148b270a-4ccf-4586-8606-92ca4e4a8518 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:06.841901 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-148b270a-4ccf-4586-8606-92ca4e4a8518 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:06.842582 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-148b270a-4ccf-4586-8606-92ca4e4a8518 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:07.093447 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-2f12c68b-d93f-4e47-b7b0-c949c9261dc0 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb33a017168c4a8bae36eacd9ba6a7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24f2e13835b240578d411521ee520115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:07.102304 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-2f12c68b-d93f-4e47-b7b0-c949c9261dc0 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] 10.222.0.60 "GET /compute/v2.1/servers/a8305358-1f82-4022-b511-8d3e3d445a92" status: 200 len: 1504 microversion: 2.1 time: 1.163841 Sep 14 09:16:07.103514 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2662/5301] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:05 2022] GET /compute/v2.1/servers/a8305358-1f82-4022-b511-8d3e3d445a92 => generated 1504 bytes in 1167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:07.108638 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-5d83d987-9445-4c45-841d-fb7efe28a73c tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:07.109602 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-5d83d987-9445-4c45-841d-fb7efe28a73c tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] [instance: 12910e13-030f-4238-94b4-0d5c50c1e9e2] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:07.115834 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5d83d987-9445-4c45-841d-fb7efe28a73c tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:07.116506 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5d83d987-9445-4c45-841d-fb7efe28a73c tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:07.117301 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5d83d987-9445-4c45-841d-fb7efe28a73c tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:07.118774 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5d83d987-9445-4c45-841d-fb7efe28a73c tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:07.119419 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5d83d987-9445-4c45-841d-fb7efe28a73c tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:07.120113 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5d83d987-9445-4c45-841d-fb7efe28a73c tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:07.608036 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-148b270a-4ccf-4586-8606-92ca4e4a8518 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:07.623784 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-148b270a-4ccf-4586-8606-92ca4e4a8518 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105" status: 200 len: 1668 microversion: 2.1 time: 0.844786 Sep 14 09:16:07.624623 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2640/5302] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:06 2022] GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105 => generated 1668 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:07.651742 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-0cb04670-8f4a-46b2-b0c2-9275e0856e15 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:07.652610 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-0cb04670-8f4a-46b2-b0c2-9275e0856e15 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:07.660254 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0cb04670-8f4a-46b2-b0c2-9275e0856e15 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:07.660872 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0cb04670-8f4a-46b2-b0c2-9275e0856e15 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:07.661369 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0cb04670-8f4a-46b2-b0c2-9275e0856e15 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:07.662148 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0cb04670-8f4a-46b2-b0c2-9275e0856e15 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:07.662786 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0cb04670-8f4a-46b2-b0c2-9275e0856e15 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:07.663392 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0cb04670-8f4a-46b2-b0c2-9275e0856e15 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:07.874151 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-5d83d987-9445-4c45-841d-fb7efe28a73c tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538af7e0ab7c462fae161e4e8c5bf1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693e3fb677fb4bd387f1c86b369061dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:07.882367 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-5d83d987-9445-4c45-841d-fb7efe28a73c tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] 10.222.0.60 "GET /compute/v2.1/servers/12910e13-030f-4238-94b4-0d5c50c1e9e2" status: 200 len: 1313 microversion: 2.1 time: 0.777598 Sep 14 09:16:07.899319 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2663/5303] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:07 2022] GET /compute/v2.1/servers/12910e13-030f-4238-94b4-0d5c50c1e9e2 => generated 1313 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:07.904564 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-8644408b-6c58-4039-9253-b85dd39c0647 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:07.905394 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-8644408b-6c58-4039-9253-b85dd39c0647 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 50157c1b-c748-4d1f-928e-207482b37ec6] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:07.911895 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8644408b-6c58-4039-9253-b85dd39c0647 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:07.912577 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8644408b-6c58-4039-9253-b85dd39c0647 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:07.913172 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8644408b-6c58-4039-9253-b85dd39c0647 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:07.914064 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8644408b-6c58-4039-9253-b85dd39c0647 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:07.914680 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8644408b-6c58-4039-9253-b85dd39c0647 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:07.915303 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8644408b-6c58-4039-9253-b85dd39c0647 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:07.943972 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-0cb04670-8f4a-46b2-b0c2-9275e0856e15 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:07.956120 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-0cb04670-8f4a-46b2-b0c2-9275e0856e15 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105" status: 200 len: 1668 microversion: 2.1 time: 0.311480 Sep 14 09:16:07.957158 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2641/5304] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:07 2022] GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105 => generated 1668 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:16:07.981075 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8fdb09fc-e3b4-456f-b91a-ae84ef41c46f tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:07.981707 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-8fdb09fc-e3b4-456f-b91a-ae84ef41c46f tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:07.988397 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8fdb09fc-e3b4-456f-b91a-ae84ef41c46f tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:07.988894 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8fdb09fc-e3b4-456f-b91a-ae84ef41c46f tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:07.989343 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8fdb09fc-e3b4-456f-b91a-ae84ef41c46f tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:07.990051 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8fdb09fc-e3b4-456f-b91a-ae84ef41c46f tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:07.990514 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8fdb09fc-e3b4-456f-b91a-ae84ef41c46f tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:07.990957 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8fdb09fc-e3b4-456f-b91a-ae84ef41c46f tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:08.205564 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-8644408b-6c58-4039-9253-b85dd39c0647 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:08.218820 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-8644408b-6c58-4039-9253-b85dd39c0647 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:08.220480 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-8644408b-6c58-4039-9253-b85dd39c0647 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:08.221730 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-8644408b-6c58-4039-9253-b85dd39c0647 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6" status: 200 len: 1729 microversion: 2.20 time: 0.321127 Sep 14 09:16:08.222637 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2664/5305] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:16:07 2022] GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6 => generated 1729 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:16:08.229030 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-4c4c4a35-d628-45e6-a1a6-0ed65b43cd9f tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:08.230102 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-4c4c4a35-d628-45e6-a1a6-0ed65b43cd9f tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] [instance: a8305358-1f82-4022-b511-8d3e3d445a92] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:08.234080 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:16:08.238166 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4c4c4a35-d628-45e6-a1a6-0ed65b43cd9f tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:08.238831 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4c4c4a35-d628-45e6-a1a6-0ed65b43cd9f tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:08.239619 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4c4c4a35-d628-45e6-a1a6-0ed65b43cd9f tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:08.240412 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4c4c4a35-d628-45e6-a1a6-0ed65b43cd9f tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:08.240882 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4c4c4a35-d628-45e6-a1a6-0ed65b43cd9f tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:08.241316 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4c4c4a35-d628-45e6-a1a6-0ed65b43cd9f tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:08.337996 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-8fdb09fc-e3b4-456f-b91a-ae84ef41c46f tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:08.346639 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-8fdb09fc-e3b4-456f-b91a-ae84ef41c46f tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105" status: 200 len: 1668 microversion: 2.1 time: 0.369409 Sep 14 09:16:08.359656 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2642/5306] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:07 2022] GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105 => generated 1668 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:16:08.375080 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-67f390a4-daf2-486e-9884-df61fbc6515b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:08.375919 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-67f390a4-daf2-486e-9884-df61fbc6515b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:08.384026 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-67f390a4-daf2-486e-9884-df61fbc6515b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:08.384750 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-67f390a4-daf2-486e-9884-df61fbc6515b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:08.385415 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-67f390a4-daf2-486e-9884-df61fbc6515b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:08.386396 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-67f390a4-daf2-486e-9884-df61fbc6515b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:08.386868 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-67f390a4-daf2-486e-9884-df61fbc6515b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:08.387486 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-67f390a4-daf2-486e-9884-df61fbc6515b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:08.523533 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-4c4c4a35-d628-45e6-a1a6-0ed65b43cd9f tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb33a017168c4a8bae36eacd9ba6a7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24f2e13835b240578d411521ee520115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:08.533668 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-4c4c4a35-d628-45e6-a1a6-0ed65b43cd9f tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] 10.222.0.60 "GET /compute/v2.1/servers/a8305358-1f82-4022-b511-8d3e3d445a92" status: 200 len: 1504 microversion: 2.1 time: 0.309941 Sep 14 09:16:08.534501 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2665/5307] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:08 2022] GET /compute/v2.1/servers/a8305358-1f82-4022-b511-8d3e3d445a92 => generated 1504 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:08.632459 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-67f390a4-daf2-486e-9884-df61fbc6515b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:08.642783 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-67f390a4-daf2-486e-9884-df61fbc6515b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105" status: 200 len: 1668 microversion: 2.1 time: 0.275884 Sep 14 09:16:08.644537 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2643/5308] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:08 2022] GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105 => generated 1668 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:08.675941 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ee6e4785-7847-4ab0-a8e1-4e238529fb50 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:08.676834 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-ee6e4785-7847-4ab0-a8e1-4e238529fb50 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:08.682342 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=2 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:16:08.688542 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=6 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:16:08.697832 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ee6e4785-7847-4ab0-a8e1-4e238529fb50 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:08.698699 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ee6e4785-7847-4ab0-a8e1-4e238529fb50 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:08.699337 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ee6e4785-7847-4ab0-a8e1-4e238529fb50 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:08.700387 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ee6e4785-7847-4ab0-a8e1-4e238529fb50 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:08.701012 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ee6e4785-7847-4ab0-a8e1-4e238529fb50 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:08.701596 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ee6e4785-7847-4ab0-a8e1-4e238529fb50 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:08.817237 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-cbedc9e6-3221-481b-8032-5b4ca86e26b0 req-bdb09a25-406d-4e12-b325-81c4694b43cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ceabacb-cbf6-409a-8c82-55e9901bd8d7", "tag": "e75fecd4-ad0f-481f-b575-74e5343cdbc3"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:16:08.839538 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-cbedc9e6-3221-481b-8032-5b4ca86e26b0 req-bdb09a25-406d-4e12-b325-81c4694b43cc service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:08.840022 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-cbedc9e6-3221-481b-8032-5b4ca86e26b0 req-bdb09a25-406d-4e12-b325-81c4694b43cc service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:08.840624 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-cbedc9e6-3221-481b-8032-5b4ca86e26b0 req-bdb09a25-406d-4e12-b325-81c4694b43cc service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:08.869250 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-cbedc9e6-3221-481b-8032-5b4ca86e26b0 req-bdb09a25-406d-4e12-b325-81c4694b43cc service nova] Creating event network-changed:e75fecd4-ad0f-481f-b575-74e5343cdbc3 for instance 3ceabacb-cbf6-409a-8c82-55e9901bd8d7 on n-h1-836830-18 Sep 14 09:16:08.896841 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-ee6e4785-7847-4ab0-a8e1-4e238529fb50 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:08.897942 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-cbedc9e6-3221-481b-8032-5b4ca86e26b0 req-bdb09a25-406d-4e12-b325-81c4694b43cc service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084933 Sep 14 09:16:08.900867 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2644/5309] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:16:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:16:08.908845 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-ee6e4785-7847-4ab0-a8e1-4e238529fb50 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105" status: 200 len: 1668 microversion: 2.1 time: 0.236691 Sep 14 09:16:08.910170 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9553985f-70e2-4bc8-a8ae-8c29ab8cf1ae tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:08.911224 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-9553985f-70e2-4bc8-a8ae-8c29ab8cf1ae tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] [instance: 12910e13-030f-4238-94b4-0d5c50c1e9e2] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:08.912330 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2666/5310] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:08 2022] GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105 => generated 1668 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:08.919683 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9553985f-70e2-4bc8-a8ae-8c29ab8cf1ae tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:08.920527 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9553985f-70e2-4bc8-a8ae-8c29ab8cf1ae tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:08.921245 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9553985f-70e2-4bc8-a8ae-8c29ab8cf1ae tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:08.922118 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9553985f-70e2-4bc8-a8ae-8c29ab8cf1ae tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:08.923027 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9553985f-70e2-4bc8-a8ae-8c29ab8cf1ae tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:08.923601 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9553985f-70e2-4bc8-a8ae-8c29ab8cf1ae tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:08.938426 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-37916ca5-1651-4331-89b7-cfcffd6202e8 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:16:08.938825 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-37916ca5-1651-4331-89b7-cfcffd6202e8 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:08.950258 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-37916ca5-1651-4331-89b7-cfcffd6202e8 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:08.954761 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-37916ca5-1651-4331-89b7-cfcffd6202e8 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:08.955356 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-37916ca5-1651-4331-89b7-cfcffd6202e8 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:08.956243 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-37916ca5-1651-4331-89b7-cfcffd6202e8 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:08.956762 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-37916ca5-1651-4331-89b7-cfcffd6202e8 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:08.957255 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-37916ca5-1651-4331-89b7-cfcffd6202e8 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:09.022205 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.objects.instance [None req-37916ca5-1651-4331-89b7-cfcffd6202e8 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lazy-loading 'flavor' on Instance uuid 8450d385-d5d9-4c86-9ece-b3bbf9ed1105 {{(pid=128758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:16:09.126987 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-37916ca5-1651-4331-89b7-cfcffd6202e8 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "POST /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105/action" status: 202 len: 0 microversion: 2.1 time: 0.192335 Sep 14 09:16:09.131639 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2667/5311] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:16:08 2022] POST /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105/action => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:16:09.139745 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-4fb93882-04af-469c-9e57-ac459b4f6193 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:09.140691 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-4fb93882-04af-469c-9e57-ac459b4f6193 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:09.152696 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4fb93882-04af-469c-9e57-ac459b4f6193 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:09.153252 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4fb93882-04af-469c-9e57-ac459b4f6193 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:09.153877 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4fb93882-04af-469c-9e57-ac459b4f6193 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:09.154812 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4fb93882-04af-469c-9e57-ac459b4f6193 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:09.156162 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4fb93882-04af-469c-9e57-ac459b4f6193 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:09.157445 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4fb93882-04af-469c-9e57-ac459b4f6193 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:09.169676 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-9553985f-70e2-4bc8-a8ae-8c29ab8cf1ae tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538af7e0ab7c462fae161e4e8c5bf1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693e3fb677fb4bd387f1c86b369061dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:09.179489 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-9553985f-70e2-4bc8-a8ae-8c29ab8cf1ae tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] 10.222.0.60 "GET /compute/v2.1/servers/12910e13-030f-4238-94b4-0d5c50c1e9e2" status: 200 len: 1313 microversion: 2.1 time: 0.276706 Sep 14 09:16:09.184915 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2645/5312] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:08 2022] GET /compute/v2.1/servers/12910e13-030f-4238-94b4-0d5c50c1e9e2 => generated 1313 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:09.252940 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f024c227-3d77-44d1-97bc-27a9667d81c1 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:09.253987 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f024c227-3d77-44d1-97bc-27a9667d81c1 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 50157c1b-c748-4d1f-928e-207482b37ec6] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:09.266239 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f024c227-3d77-44d1-97bc-27a9667d81c1 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:09.266757 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f024c227-3d77-44d1-97bc-27a9667d81c1 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:09.269403 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f024c227-3d77-44d1-97bc-27a9667d81c1 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:09.270505 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f024c227-3d77-44d1-97bc-27a9667d81c1 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:09.273214 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f024c227-3d77-44d1-97bc-27a9667d81c1 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:09.275686 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f024c227-3d77-44d1-97bc-27a9667d81c1 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:09.316966 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=2 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:16:09.530589 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f024c227-3d77-44d1-97bc-27a9667d81c1 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:09.545927 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f024c227-3d77-44d1-97bc-27a9667d81c1 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:09.549238 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f024c227-3d77-44d1-97bc-27a9667d81c1 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:09.563998 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f024c227-3d77-44d1-97bc-27a9667d81c1 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6" status: 200 len: 1729 microversion: 2.20 time: 0.315600 Sep 14 09:16:09.565623 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2646/5313] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:16:09 2022] GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6 => generated 1729 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 09:16:09.583658 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b8c69515-3f71-47e7-947b-57ec6ba29c1e tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:09.589675 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b8c69515-3f71-47e7-947b-57ec6ba29c1e tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] [instance: a8305358-1f82-4022-b511-8d3e3d445a92] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:09.606057 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b8c69515-3f71-47e7-947b-57ec6ba29c1e tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:09.606706 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b8c69515-3f71-47e7-947b-57ec6ba29c1e tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:09.608643 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b8c69515-3f71-47e7-947b-57ec6ba29c1e tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:09.609503 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b8c69515-3f71-47e7-947b-57ec6ba29c1e tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:09.610079 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b8c69515-3f71-47e7-947b-57ec6ba29c1e tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:09.611166 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b8c69515-3f71-47e7-947b-57ec6ba29c1e tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:09.629518 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-4fb93882-04af-469c-9e57-ac459b4f6193 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:09.640006 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-4fb93882-04af-469c-9e57-ac459b4f6193 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105" status: 200 len: 1676 microversion: 2.1 time: 0.507039 Sep 14 09:16:09.647546 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2668/5314] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:09 2022] GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105 => generated 1676 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:09.907964 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b8c69515-3f71-47e7-947b-57ec6ba29c1e tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb33a017168c4a8bae36eacd9ba6a7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24f2e13835b240578d411521ee520115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:09.923943 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b8c69515-3f71-47e7-947b-57ec6ba29c1e tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] 10.222.0.60 "GET /compute/v2.1/servers/a8305358-1f82-4022-b511-8d3e3d445a92" status: 200 len: 1504 microversion: 2.1 time: 0.357043 Sep 14 09:16:09.930598 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2647/5315] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:09 2022] GET /compute/v2.1/servers/a8305358-1f82-4022-b511-8d3e3d445a92 => generated 1504 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:10.214962 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b7135c86-8ee5-4e18-be9b-066aec421fac tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:10.215958 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-b7135c86-8ee5-4e18-be9b-066aec421fac tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] [instance: 12910e13-030f-4238-94b4-0d5c50c1e9e2] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:10.247692 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b7135c86-8ee5-4e18-be9b-066aec421fac tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:10.248548 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b7135c86-8ee5-4e18-be9b-066aec421fac tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:10.249934 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b7135c86-8ee5-4e18-be9b-066aec421fac tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:10.253629 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b7135c86-8ee5-4e18-be9b-066aec421fac tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:10.254373 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b7135c86-8ee5-4e18-be9b-066aec421fac tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:10.255086 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b7135c86-8ee5-4e18-be9b-066aec421fac tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:10.270775 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:16:10.595040 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-34fb322e-c09b-445e-a28f-7f114d0d4e3d tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:10.596636 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-34fb322e-c09b-445e-a28f-7f114d0d4e3d tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 50157c1b-c748-4d1f-928e-207482b37ec6] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:10.611570 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-b7135c86-8ee5-4e18-be9b-066aec421fac tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538af7e0ab7c462fae161e4e8c5bf1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693e3fb677fb4bd387f1c86b369061dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:10.618103 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-34fb322e-c09b-445e-a28f-7f114d0d4e3d tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:10.619132 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-34fb322e-c09b-445e-a28f-7f114d0d4e3d tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:10.619801 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-34fb322e-c09b-445e-a28f-7f114d0d4e3d tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:10.620654 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-34fb322e-c09b-445e-a28f-7f114d0d4e3d tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:10.621025 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-b7135c86-8ee5-4e18-be9b-066aec421fac tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] 10.222.0.60 "GET /compute/v2.1/servers/12910e13-030f-4238-94b4-0d5c50c1e9e2" status: 200 len: 1313 microversion: 2.1 time: 0.416607 Sep 14 09:16:10.621646 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2669/5316] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:10 2022] GET /compute/v2.1/servers/12910e13-030f-4238-94b4-0d5c50c1e9e2 => generated 1313 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:16:10.622592 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-34fb322e-c09b-445e-a28f-7f114d0d4e3d tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:10.623593 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-34fb322e-c09b-445e-a28f-7f114d0d4e3d tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:10.669896 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-246a0782-4d11-443e-987b-0932974776dd tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:10.670531 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-246a0782-4d11-443e-987b-0932974776dd tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:10.686496 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-246a0782-4d11-443e-987b-0932974776dd tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:10.686919 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-246a0782-4d11-443e-987b-0932974776dd tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:10.687388 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-246a0782-4d11-443e-987b-0932974776dd tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:10.688116 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-246a0782-4d11-443e-987b-0932974776dd tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:10.688577 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-246a0782-4d11-443e-987b-0932974776dd tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:10.689015 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-246a0782-4d11-443e-987b-0932974776dd tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:11.282673 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-246a0782-4d11-443e-987b-0932974776dd tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:11.293976 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-246a0782-4d11-443e-987b-0932974776dd tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105" status: 200 len: 1676 microversion: 2.1 time: 0.629860 Sep 14 09:16:11.296675 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2670/5317] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:10 2022] GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105 => generated 1676 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:11.304128 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-34fb322e-c09b-445e-a28f-7f114d0d4e3d tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:11.316535 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-34fb322e-c09b-445e-a28f-7f114d0d4e3d tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:11.320768 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-6dd9559a-e43e-4ff2-9b17-d68ef460c7bd tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:11.337533 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-6dd9559a-e43e-4ff2-9b17-d68ef460c7bd tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] [instance: a8305358-1f82-4022-b511-8d3e3d445a92] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:11.337844 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-34fb322e-c09b-445e-a28f-7f114d0d4e3d tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:11.339404 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-34fb322e-c09b-445e-a28f-7f114d0d4e3d tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6" status: 200 len: 1729 microversion: 2.20 time: 0.751267 Sep 14 09:16:11.343741 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2648/5318] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:16:10 2022] GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6 => generated 1729 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 09:16:11.350344 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6dd9559a-e43e-4ff2-9b17-d68ef460c7bd tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:11.351207 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6dd9559a-e43e-4ff2-9b17-d68ef460c7bd tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:11.352437 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6dd9559a-e43e-4ff2-9b17-d68ef460c7bd tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:11.353502 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6dd9559a-e43e-4ff2-9b17-d68ef460c7bd tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:11.354260 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6dd9559a-e43e-4ff2-9b17-d68ef460c7bd tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:11.354904 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6dd9559a-e43e-4ff2-9b17-d68ef460c7bd tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:11.647179 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-94321660-72d7-4136-966f-d2335cdf5fa8 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:11.648498 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-94321660-72d7-4136-966f-d2335cdf5fa8 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] [instance: 12910e13-030f-4238-94b4-0d5c50c1e9e2] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:11.660941 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-94321660-72d7-4136-966f-d2335cdf5fa8 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:11.661948 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-94321660-72d7-4136-966f-d2335cdf5fa8 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:11.662083 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-6dd9559a-e43e-4ff2-9b17-d68ef460c7bd tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb33a017168c4a8bae36eacd9ba6a7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24f2e13835b240578d411521ee520115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:11.662438 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-94321660-72d7-4136-966f-d2335cdf5fa8 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:11.663204 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-94321660-72d7-4136-966f-d2335cdf5fa8 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:11.663856 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-94321660-72d7-4136-966f-d2335cdf5fa8 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:11.665107 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-94321660-72d7-4136-966f-d2335cdf5fa8 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:11.679465 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-6dd9559a-e43e-4ff2-9b17-d68ef460c7bd tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] 10.222.0.60 "GET /compute/v2.1/servers/a8305358-1f82-4022-b511-8d3e3d445a92" status: 200 len: 1504 microversion: 2.1 time: 0.381365 Sep 14 09:16:11.696239 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2671/5319] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:11 2022] GET /compute/v2.1/servers/a8305358-1f82-4022-b511-8d3e3d445a92 => generated 1504 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:11.920579 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-94321660-72d7-4136-966f-d2335cdf5fa8 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538af7e0ab7c462fae161e4e8c5bf1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693e3fb677fb4bd387f1c86b369061dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:11.933882 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-94321660-72d7-4136-966f-d2335cdf5fa8 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] 10.222.0.60 "GET /compute/v2.1/servers/12910e13-030f-4238-94b4-0d5c50c1e9e2" status: 200 len: 1313 microversion: 2.1 time: 0.286494 Sep 14 09:16:11.947387 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2649/5320] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:11 2022] GET /compute/v2.1/servers/12910e13-030f-4238-94b4-0d5c50c1e9e2 => generated 1313 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:12.323440 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-6371e251-9b6a-4746-beba-1fbc2f1218a2 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:12.324628 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-6371e251-9b6a-4746-beba-1fbc2f1218a2 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:12.344391 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6371e251-9b6a-4746-beba-1fbc2f1218a2 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:12.345670 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6371e251-9b6a-4746-beba-1fbc2f1218a2 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:12.346275 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6371e251-9b6a-4746-beba-1fbc2f1218a2 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:12.347185 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6371e251-9b6a-4746-beba-1fbc2f1218a2 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:12.349864 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6371e251-9b6a-4746-beba-1fbc2f1218a2 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:12.350584 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6371e251-9b6a-4746-beba-1fbc2f1218a2 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:12.373834 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f69073dd-d5e5-4e45-a4f1-0d9af0481df7 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:12.374750 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f69073dd-d5e5-4e45-a4f1-0d9af0481df7 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 50157c1b-c748-4d1f-928e-207482b37ec6] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:12.383423 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f69073dd-d5e5-4e45-a4f1-0d9af0481df7 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:12.384261 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f69073dd-d5e5-4e45-a4f1-0d9af0481df7 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:12.384743 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f69073dd-d5e5-4e45-a4f1-0d9af0481df7 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:12.385579 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f69073dd-d5e5-4e45-a4f1-0d9af0481df7 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:12.386208 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f69073dd-d5e5-4e45-a4f1-0d9af0481df7 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:12.386636 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f69073dd-d5e5-4e45-a4f1-0d9af0481df7 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:12.603817 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f69073dd-d5e5-4e45-a4f1-0d9af0481df7 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:12.604421 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-6371e251-9b6a-4746-beba-1fbc2f1218a2 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:12.619357 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-6371e251-9b6a-4746-beba-1fbc2f1218a2 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105" status: 200 len: 1676 microversion: 2.1 time: 0.300422 Sep 14 09:16:12.619975 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f69073dd-d5e5-4e45-a4f1-0d9af0481df7 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:12.630657 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2672/5321] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:12 2022] GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105 => generated 1676 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:12.630858 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f69073dd-d5e5-4e45-a4f1-0d9af0481df7 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:12.630858 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f69073dd-d5e5-4e45-a4f1-0d9af0481df7 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6" status: 200 len: 1729 microversion: 2.20 time: 0.260180 Sep 14 09:16:12.630858 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2650/5322] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:16:12 2022] GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6 => generated 1729 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:16:12.703016 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-5d17797a-1a1f-4388-a5c5-7f9e1f5d9654 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:12.703645 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-5d17797a-1a1f-4388-a5c5-7f9e1f5d9654 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] [instance: a8305358-1f82-4022-b511-8d3e3d445a92] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:12.710423 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5d17797a-1a1f-4388-a5c5-7f9e1f5d9654 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:12.711074 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5d17797a-1a1f-4388-a5c5-7f9e1f5d9654 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:12.711617 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5d17797a-1a1f-4388-a5c5-7f9e1f5d9654 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:12.712451 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5d17797a-1a1f-4388-a5c5-7f9e1f5d9654 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:12.713347 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5d17797a-1a1f-4388-a5c5-7f9e1f5d9654 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:12.713839 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5d17797a-1a1f-4388-a5c5-7f9e1f5d9654 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:12.865425 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-5d17797a-1a1f-4388-a5c5-7f9e1f5d9654 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb33a017168c4a8bae36eacd9ba6a7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24f2e13835b240578d411521ee520115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:12.874264 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-5d17797a-1a1f-4388-a5c5-7f9e1f5d9654 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] 10.222.0.60 "GET /compute/v2.1/servers/a8305358-1f82-4022-b511-8d3e3d445a92" status: 200 len: 1504 microversion: 2.1 time: 0.175071 Sep 14 09:16:12.878977 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2673/5323] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:12 2022] GET /compute/v2.1/servers/a8305358-1f82-4022-b511-8d3e3d445a92 => generated 1504 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:12.963747 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c7a5959d-fa69-4309-849d-128665aed212 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:12.964399 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-c7a5959d-fa69-4309-849d-128665aed212 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] [instance: 12910e13-030f-4238-94b4-0d5c50c1e9e2] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:12.970686 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c7a5959d-fa69-4309-849d-128665aed212 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:12.971091 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c7a5959d-fa69-4309-849d-128665aed212 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:12.971532 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c7a5959d-fa69-4309-849d-128665aed212 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:12.972550 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c7a5959d-fa69-4309-849d-128665aed212 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:12.973165 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c7a5959d-fa69-4309-849d-128665aed212 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:12.973593 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c7a5959d-fa69-4309-849d-128665aed212 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:13.181840 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-c7a5959d-fa69-4309-849d-128665aed212 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538af7e0ab7c462fae161e4e8c5bf1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693e3fb677fb4bd387f1c86b369061dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:13.191744 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-c7a5959d-fa69-4309-849d-128665aed212 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] 10.222.0.60 "GET /compute/v2.1/servers/12910e13-030f-4238-94b4-0d5c50c1e9e2" status: 200 len: 1313 microversion: 2.1 time: 0.237505 Sep 14 09:16:13.192889 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2651/5324] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:12 2022] GET /compute/v2.1/servers/12910e13-030f-4238-94b4-0d5c50c1e9e2 => generated 1313 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:16:13.609094 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-864540e8-2096-4d1e-8a05-659f05cf672d req-a11b76ec-f481-46c2-8ae1-7d90386aa904 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12910e13-030f-4238-94b4-0d5c50c1e9e2", "name": "network-vif-plugged", "status": "completed", "tag": "6b991f7d-3428-4ddd-bfaf-d97feb016922"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:16:13.626090 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-864540e8-2096-4d1e-8a05-659f05cf672d req-a11b76ec-f481-46c2-8ae1-7d90386aa904 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:13.626580 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-864540e8-2096-4d1e-8a05-659f05cf672d req-a11b76ec-f481-46c2-8ae1-7d90386aa904 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:13.627170 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-864540e8-2096-4d1e-8a05-659f05cf672d req-a11b76ec-f481-46c2-8ae1-7d90386aa904 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:13.644705 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-aab15aea-6ccf-429a-ab04-c848038cf365 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:13.645608 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-aab15aea-6ccf-429a-ab04-c848038cf365 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:13.654858 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-aab15aea-6ccf-429a-ab04-c848038cf365 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:13.655389 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-aab15aea-6ccf-429a-ab04-c848038cf365 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:13.656109 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-aab15aea-6ccf-429a-ab04-c848038cf365 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:13.656536 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-aab15aea-6ccf-429a-ab04-c848038cf365 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:13.657000 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-aab15aea-6ccf-429a-ab04-c848038cf365 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:13.657428 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-aab15aea-6ccf-429a-ab04-c848038cf365 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:13.673340 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-864540e8-2096-4d1e-8a05-659f05cf672d req-a11b76ec-f481-46c2-8ae1-7d90386aa904 service nova] Creating event network-vif-plugged:6b991f7d-3428-4ddd-bfaf-d97feb016922 for instance 12910e13-030f-4238-94b4-0d5c50c1e9e2 on n-h1-836830-18 Sep 14 09:16:13.679635 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-864540e8-2096-4d1e-8a05-659f05cf672d req-a11b76ec-f481-46c2-8ae1-7d90386aa904 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074335 Sep 14 09:16:13.680780 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2674/5325] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:16:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:16:13.687518 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-69354d52-df49-4d04-bdbf-20c363c02bd0 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:13.689061 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-69354d52-df49-4d04-bdbf-20c363c02bd0 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 50157c1b-c748-4d1f-928e-207482b37ec6] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:13.700720 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-69354d52-df49-4d04-bdbf-20c363c02bd0 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:13.701565 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-69354d52-df49-4d04-bdbf-20c363c02bd0 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:13.702217 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-69354d52-df49-4d04-bdbf-20c363c02bd0 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:13.703211 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-69354d52-df49-4d04-bdbf-20c363c02bd0 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:13.704501 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-69354d52-df49-4d04-bdbf-20c363c02bd0 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:13.705125 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-69354d52-df49-4d04-bdbf-20c363c02bd0 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:13.946161 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-aab15aea-6ccf-429a-ab04-c848038cf365 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:13.949404 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-69354d52-df49-4d04-bdbf-20c363c02bd0 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:13.955798 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-aab15aea-6ccf-429a-ab04-c848038cf365 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105" status: 200 len: 1676 microversion: 2.1 time: 0.315408 Sep 14 09:16:13.960172 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-69354d52-df49-4d04-bdbf-20c363c02bd0 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:13.962548 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-69354d52-df49-4d04-bdbf-20c363c02bd0 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:13.963948 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-69354d52-df49-4d04-bdbf-20c363c02bd0 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6" status: 200 len: 1729 microversion: 2.20 time: 0.281867 Sep 14 09:16:13.971798 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2652/5326] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:13 2022] GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105 => generated 1676 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:13.979905 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c2db7eae-1bc5-4d84-afa1-1aa029760fe2 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:13.980441 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2675/5327] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:16:13 2022] GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6 => generated 1729 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:16:13.981076 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-c2db7eae-1bc5-4d84-afa1-1aa029760fe2 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] [instance: a8305358-1f82-4022-b511-8d3e3d445a92] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:13.988793 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c2db7eae-1bc5-4d84-afa1-1aa029760fe2 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:13.989298 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c2db7eae-1bc5-4d84-afa1-1aa029760fe2 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:13.989740 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c2db7eae-1bc5-4d84-afa1-1aa029760fe2 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:13.990628 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c2db7eae-1bc5-4d84-afa1-1aa029760fe2 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:13.991125 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c2db7eae-1bc5-4d84-afa1-1aa029760fe2 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:13.991879 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c2db7eae-1bc5-4d84-afa1-1aa029760fe2 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:13.997072 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=100 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:16:14.144869 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-c2db7eae-1bc5-4d84-afa1-1aa029760fe2 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb33a017168c4a8bae36eacd9ba6a7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24f2e13835b240578d411521ee520115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:14.154267 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-c2db7eae-1bc5-4d84-afa1-1aa029760fe2 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] 10.222.0.60 "GET /compute/v2.1/servers/a8305358-1f82-4022-b511-8d3e3d445a92" status: 200 len: 1504 microversion: 2.1 time: 0.180704 Sep 14 09:16:14.154867 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2653/5328] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:13 2022] GET /compute/v2.1/servers/a8305358-1f82-4022-b511-8d3e3d445a92 => generated 1504 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:14.216589 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-554f4406-dc78-48f9-9991-eb8629614ee6 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:14.217355 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-554f4406-dc78-48f9-9991-eb8629614ee6 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] [instance: 12910e13-030f-4238-94b4-0d5c50c1e9e2] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:14.224977 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-554f4406-dc78-48f9-9991-eb8629614ee6 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:14.225810 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-554f4406-dc78-48f9-9991-eb8629614ee6 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:14.226422 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-554f4406-dc78-48f9-9991-eb8629614ee6 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:14.227550 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-554f4406-dc78-48f9-9991-eb8629614ee6 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:14.228080 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-554f4406-dc78-48f9-9991-eb8629614ee6 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:14.228228 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-554f4406-dc78-48f9-9991-eb8629614ee6 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:14.394609 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-554f4406-dc78-48f9-9991-eb8629614ee6 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538af7e0ab7c462fae161e4e8c5bf1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693e3fb677fb4bd387f1c86b369061dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:14.406094 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-554f4406-dc78-48f9-9991-eb8629614ee6 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] 10.222.0.60 "GET /compute/v2.1/servers/12910e13-030f-4238-94b4-0d5c50c1e9e2" status: 200 len: 1313 microversion: 2.1 time: 0.194257 Sep 14 09:16:14.406691 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2676/5329] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:14 2022] GET /compute/v2.1/servers/12910e13-030f-4238-94b4-0d5c50c1e9e2 => generated 1313 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:14.983934 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ef1158bf-a806-4808-914c-60b66985e9aa tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:14.992200 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-fc6c72f7-4206-49de-afa7-3e17cab6179a tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:14.994429 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-fc6c72f7-4206-49de-afa7-3e17cab6179a tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 50157c1b-c748-4d1f-928e-207482b37ec6] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:14.995065 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-ef1158bf-a806-4808-914c-60b66985e9aa tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:15.010691 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ef1158bf-a806-4808-914c-60b66985e9aa tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:15.011017 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fc6c72f7-4206-49de-afa7-3e17cab6179a tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:15.011681 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fc6c72f7-4206-49de-afa7-3e17cab6179a tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:15.012429 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ef1158bf-a806-4808-914c-60b66985e9aa tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:15.013027 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fc6c72f7-4206-49de-afa7-3e17cab6179a tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:15.013625 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ef1158bf-a806-4808-914c-60b66985e9aa tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:15.014506 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fc6c72f7-4206-49de-afa7-3e17cab6179a tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:15.015409 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ef1158bf-a806-4808-914c-60b66985e9aa tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:15.016018 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fc6c72f7-4206-49de-afa7-3e17cab6179a tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:15.016644 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ef1158bf-a806-4808-914c-60b66985e9aa tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:15.017236 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fc6c72f7-4206-49de-afa7-3e17cab6179a tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:15.017813 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ef1158bf-a806-4808-914c-60b66985e9aa tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:15.272183 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-ef1158bf-a806-4808-914c-60b66985e9aa tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:15.275541 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-fc6c72f7-4206-49de-afa7-3e17cab6179a tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:15.281241 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-ef1158bf-a806-4808-914c-60b66985e9aa tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105" status: 200 len: 1676 microversion: 2.1 time: 0.301195 Sep 14 09:16:15.282164 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2654/5330] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:14 2022] GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105 => generated 1676 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:15.284249 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-fc6c72f7-4206-49de-afa7-3e17cab6179a tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:15.288628 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-1bd75b1a-b862-4a0e-bb4a-1eeb1693f2c4 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:15.290177 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-1bd75b1a-b862-4a0e-bb4a-1eeb1693f2c4 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] [instance: a8305358-1f82-4022-b511-8d3e3d445a92] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:15.301990 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-fc6c72f7-4206-49de-afa7-3e17cab6179a tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:15.303268 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-fc6c72f7-4206-49de-afa7-3e17cab6179a tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6" status: 200 len: 1729 microversion: 2.20 time: 0.315057 Sep 14 09:16:15.319811 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2677/5331] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:16:14 2022] GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6 => generated 1729 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:16:15.328904 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1bd75b1a-b862-4a0e-bb4a-1eeb1693f2c4 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:15.329428 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1bd75b1a-b862-4a0e-bb4a-1eeb1693f2c4 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:15.329876 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1bd75b1a-b862-4a0e-bb4a-1eeb1693f2c4 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:15.330602 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1bd75b1a-b862-4a0e-bb4a-1eeb1693f2c4 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:15.331724 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1bd75b1a-b862-4a0e-bb4a-1eeb1693f2c4 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:15.332176 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1bd75b1a-b862-4a0e-bb4a-1eeb1693f2c4 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:15.430761 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-64307043-18f5-4d28-b78e-81399aaecf9b tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:15.435012 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-64307043-18f5-4d28-b78e-81399aaecf9b tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] [instance: 12910e13-030f-4238-94b4-0d5c50c1e9e2] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:15.451306 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-64307043-18f5-4d28-b78e-81399aaecf9b tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:15.452234 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-64307043-18f5-4d28-b78e-81399aaecf9b tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:15.452931 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-64307043-18f5-4d28-b78e-81399aaecf9b tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:15.453975 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-64307043-18f5-4d28-b78e-81399aaecf9b tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:15.454669 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-64307043-18f5-4d28-b78e-81399aaecf9b tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:15.455380 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-64307043-18f5-4d28-b78e-81399aaecf9b tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:15.546763 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-1bd75b1a-b862-4a0e-bb4a-1eeb1693f2c4 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb33a017168c4a8bae36eacd9ba6a7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24f2e13835b240578d411521ee520115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:15.566638 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-1bd75b1a-b862-4a0e-bb4a-1eeb1693f2c4 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] 10.222.0.60 "GET /compute/v2.1/servers/a8305358-1f82-4022-b511-8d3e3d445a92" status: 200 len: 1504 microversion: 2.1 time: 0.282884 Sep 14 09:16:15.571775 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2655/5332] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:15 2022] GET /compute/v2.1/servers/a8305358-1f82-4022-b511-8d3e3d445a92 => generated 1504 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:15.664891 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-64307043-18f5-4d28-b78e-81399aaecf9b tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538af7e0ab7c462fae161e4e8c5bf1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693e3fb677fb4bd387f1c86b369061dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:15.673475 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-64307043-18f5-4d28-b78e-81399aaecf9b tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] 10.222.0.60 "GET /compute/v2.1/servers/12910e13-030f-4238-94b4-0d5c50c1e9e2" status: 200 len: 1313 microversion: 2.1 time: 0.248022 Sep 14 09:16:15.674277 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2678/5333] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:15 2022] GET /compute/v2.1/servers/12910e13-030f-4238-94b4-0d5c50c1e9e2 => generated 1313 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:16:16.305815 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-57a94992-3319-4b12-83a4-4a0ac1b638b2 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:16.306443 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-57a94992-3319-4b12-83a4-4a0ac1b638b2 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:16.309377 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=100 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:16:16.315781 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-57a94992-3319-4b12-83a4-4a0ac1b638b2 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:16.316286 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-57a94992-3319-4b12-83a4-4a0ac1b638b2 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:16.316738 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-57a94992-3319-4b12-83a4-4a0ac1b638b2 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:16.317540 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-57a94992-3319-4b12-83a4-4a0ac1b638b2 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:16.318002 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-57a94992-3319-4b12-83a4-4a0ac1b638b2 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:16.318435 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-57a94992-3319-4b12-83a4-4a0ac1b638b2 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:16.331180 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-65580615-78b8-47b9-a3be-d87c8dfecfa7 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:16.331932 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-65580615-78b8-47b9-a3be-d87c8dfecfa7 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 50157c1b-c748-4d1f-928e-207482b37ec6] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:16.339175 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-65580615-78b8-47b9-a3be-d87c8dfecfa7 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:16.339683 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-65580615-78b8-47b9-a3be-d87c8dfecfa7 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:16.340313 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-65580615-78b8-47b9-a3be-d87c8dfecfa7 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:16.341025 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-65580615-78b8-47b9-a3be-d87c8dfecfa7 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:16.341646 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-65580615-78b8-47b9-a3be-d87c8dfecfa7 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:16.342085 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-65580615-78b8-47b9-a3be-d87c8dfecfa7 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:16.580855 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-65580615-78b8-47b9-a3be-d87c8dfecfa7 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:16.603935 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-65580615-78b8-47b9-a3be-d87c8dfecfa7 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:16.610180 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-65580615-78b8-47b9-a3be-d87c8dfecfa7 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:16.611875 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-65580615-78b8-47b9-a3be-d87c8dfecfa7 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6" status: 200 len: 1729 microversion: 2.20 time: 0.284430 Sep 14 09:16:16.630556 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2679/5334] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:16:16 2022] GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6 => generated 1729 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 09:16:16.630783 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-57a94992-3319-4b12-83a4-4a0ac1b638b2 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:16.630894 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-293a893a-11b5-4549-b798-8937056c17d8 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:16.630894 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-293a893a-11b5-4549-b798-8937056c17d8 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] [instance: a8305358-1f82-4022-b511-8d3e3d445a92] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:16.631087 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-57a94992-3319-4b12-83a4-4a0ac1b638b2 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105" status: 200 len: 1676 microversion: 2.1 time: 0.319818 Sep 14 09:16:16.631177 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-293a893a-11b5-4549-b798-8937056c17d8 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:16.631177 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-293a893a-11b5-4549-b798-8937056c17d8 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:16.631177 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-293a893a-11b5-4549-b798-8937056c17d8 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:16.631177 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-293a893a-11b5-4549-b798-8937056c17d8 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:16.631177 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-293a893a-11b5-4549-b798-8937056c17d8 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:16.631177 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-293a893a-11b5-4549-b798-8937056c17d8 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:16.635872 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2656/5335] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:16 2022] GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105 => generated 1676 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:16.697412 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-4eccb9c3-8f2e-438d-8815-6f8f0feb62b0 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:16.698301 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-4eccb9c3-8f2e-438d-8815-6f8f0feb62b0 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] [instance: 12910e13-030f-4238-94b4-0d5c50c1e9e2] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:16.709046 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4eccb9c3-8f2e-438d-8815-6f8f0feb62b0 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:16.712038 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4eccb9c3-8f2e-438d-8815-6f8f0feb62b0 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:16.712038 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4eccb9c3-8f2e-438d-8815-6f8f0feb62b0 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:16.712038 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4eccb9c3-8f2e-438d-8815-6f8f0feb62b0 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:16.712038 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4eccb9c3-8f2e-438d-8815-6f8f0feb62b0 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:16.712435 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4eccb9c3-8f2e-438d-8815-6f8f0feb62b0 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:16.880202 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-293a893a-11b5-4549-b798-8937056c17d8 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb33a017168c4a8bae36eacd9ba6a7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24f2e13835b240578d411521ee520115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:16.890138 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-293a893a-11b5-4549-b798-8937056c17d8 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] 10.222.0.60 "GET /compute/v2.1/servers/a8305358-1f82-4022-b511-8d3e3d445a92" status: 200 len: 1504 microversion: 2.1 time: 0.276309 Sep 14 09:16:16.890994 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2680/5336] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:16 2022] GET /compute/v2.1/servers/a8305358-1f82-4022-b511-8d3e3d445a92 => generated 1504 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:16.946333 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-4eccb9c3-8f2e-438d-8815-6f8f0feb62b0 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538af7e0ab7c462fae161e4e8c5bf1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693e3fb677fb4bd387f1c86b369061dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:16.958974 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-4eccb9c3-8f2e-438d-8815-6f8f0feb62b0 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] 10.222.0.60 "GET /compute/v2.1/servers/12910e13-030f-4238-94b4-0d5c50c1e9e2" status: 200 len: 1313 microversion: 2.1 time: 0.265829 Sep 14 09:16:16.959588 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2657/5337] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:16 2022] GET /compute/v2.1/servers/12910e13-030f-4238-94b4-0d5c50c1e9e2 => generated 1313 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:16:17.638694 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ae3a2128-3300-4819-8a84-4efbaba496c1 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:17.639628 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-ae3a2128-3300-4819-8a84-4efbaba496c1 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 50157c1b-c748-4d1f-928e-207482b37ec6] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:17.646083 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-6bbd2c03-85eb-43b4-bd5a-4688fbb50e4b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:17.646895 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-6bbd2c03-85eb-43b4-bd5a-4688fbb50e4b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:17.651218 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ae3a2128-3300-4819-8a84-4efbaba496c1 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:17.651885 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ae3a2128-3300-4819-8a84-4efbaba496c1 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:17.652345 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ae3a2128-3300-4819-8a84-4efbaba496c1 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:17.653337 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ae3a2128-3300-4819-8a84-4efbaba496c1 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:17.653803 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ae3a2128-3300-4819-8a84-4efbaba496c1 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:17.654240 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ae3a2128-3300-4819-8a84-4efbaba496c1 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:17.656945 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6bbd2c03-85eb-43b4-bd5a-4688fbb50e4b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:17.657829 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6bbd2c03-85eb-43b4-bd5a-4688fbb50e4b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:17.658367 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6bbd2c03-85eb-43b4-bd5a-4688fbb50e4b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:17.661204 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6bbd2c03-85eb-43b4-bd5a-4688fbb50e4b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:17.661813 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6bbd2c03-85eb-43b4-bd5a-4688fbb50e4b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:17.662324 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6bbd2c03-85eb-43b4-bd5a-4688fbb50e4b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:17.882501 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-ae3a2128-3300-4819-8a84-4efbaba496c1 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:17.894061 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-ae3a2128-3300-4819-8a84-4efbaba496c1 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:17.894061 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-ae3a2128-3300-4819-8a84-4efbaba496c1 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:17.894555 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-ae3a2128-3300-4819-8a84-4efbaba496c1 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6" status: 200 len: 1729 microversion: 2.20 time: 0.259907 Sep 14 09:16:17.899837 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-6bbd2c03-85eb-43b4-bd5a-4688fbb50e4b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:17.908461 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2681/5338] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:16:17 2022] GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6 => generated 1729 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:16:17.909795 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-6bbd2c03-85eb-43b4-bd5a-4688fbb50e4b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105" status: 200 len: 1676 microversion: 2.1 time: 0.268545 Sep 14 09:16:17.910111 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2658/5339] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:17 2022] GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105 => generated 1676 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:16:17.928074 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a4383621-b89a-4a82-bd15-be17c2505ddb tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:17.928708 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-a4383621-b89a-4a82-bd15-be17c2505ddb tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] [instance: a8305358-1f82-4022-b511-8d3e3d445a92] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:17.936578 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a4383621-b89a-4a82-bd15-be17c2505ddb tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:17.937092 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a4383621-b89a-4a82-bd15-be17c2505ddb tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:17.937535 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a4383621-b89a-4a82-bd15-be17c2505ddb tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:17.938259 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a4383621-b89a-4a82-bd15-be17c2505ddb tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:17.938709 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a4383621-b89a-4a82-bd15-be17c2505ddb tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:17.939171 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a4383621-b89a-4a82-bd15-be17c2505ddb tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:17.981691 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-35da1481-7fbe-4c48-a10b-8829808a2331 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:17.982321 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-35da1481-7fbe-4c48-a10b-8829808a2331 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] [instance: 12910e13-030f-4238-94b4-0d5c50c1e9e2] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:17.988548 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-35da1481-7fbe-4c48-a10b-8829808a2331 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:17.989369 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-35da1481-7fbe-4c48-a10b-8829808a2331 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:17.989468 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-35da1481-7fbe-4c48-a10b-8829808a2331 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:17.990236 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-35da1481-7fbe-4c48-a10b-8829808a2331 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:17.990630 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-35da1481-7fbe-4c48-a10b-8829808a2331 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:17.991092 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-35da1481-7fbe-4c48-a10b-8829808a2331 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:18.121085 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-a4383621-b89a-4a82-bd15-be17c2505ddb tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb33a017168c4a8bae36eacd9ba6a7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24f2e13835b240578d411521ee520115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:18.129109 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-a4383621-b89a-4a82-bd15-be17c2505ddb tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] 10.222.0.60 "GET /compute/v2.1/servers/a8305358-1f82-4022-b511-8d3e3d445a92" status: 200 len: 1504 microversion: 2.1 time: 0.212954 Sep 14 09:16:18.131049 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2682/5340] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:17 2022] GET /compute/v2.1/servers/a8305358-1f82-4022-b511-8d3e3d445a92 => generated 1504 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:18.155272 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-35da1481-7fbe-4c48-a10b-8829808a2331 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538af7e0ab7c462fae161e4e8c5bf1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693e3fb677fb4bd387f1c86b369061dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:18.163216 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-35da1481-7fbe-4c48-a10b-8829808a2331 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] 10.222.0.60 "GET /compute/v2.1/servers/12910e13-030f-4238-94b4-0d5c50c1e9e2" status: 200 len: 1313 microversion: 2.1 time: 0.185404 Sep 14 09:16:18.164303 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2659/5341] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:17 2022] GET /compute/v2.1/servers/12910e13-030f-4238-94b4-0d5c50c1e9e2 => generated 1313 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:16:18.933952 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-6ef09f26-ac46-4854-8b9c-be9520f7ee51 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:18.934592 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-6ef09f26-ac46-4854-8b9c-be9520f7ee51 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 50157c1b-c748-4d1f-928e-207482b37ec6] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:18.940228 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f4b6af01-af1b-425a-8aca-85c9401e9fbd tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:18.941431 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f4b6af01-af1b-425a-8aca-85c9401e9fbd tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:18.941722 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6ef09f26-ac46-4854-8b9c-be9520f7ee51 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:18.942221 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6ef09f26-ac46-4854-8b9c-be9520f7ee51 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:18.942658 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6ef09f26-ac46-4854-8b9c-be9520f7ee51 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:18.943512 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6ef09f26-ac46-4854-8b9c-be9520f7ee51 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:18.943977 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6ef09f26-ac46-4854-8b9c-be9520f7ee51 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:18.944667 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6ef09f26-ac46-4854-8b9c-be9520f7ee51 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:18.949642 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f4b6af01-af1b-425a-8aca-85c9401e9fbd tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:18.951565 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f4b6af01-af1b-425a-8aca-85c9401e9fbd tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:18.951565 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f4b6af01-af1b-425a-8aca-85c9401e9fbd tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:18.951565 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f4b6af01-af1b-425a-8aca-85c9401e9fbd tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:18.951836 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f4b6af01-af1b-425a-8aca-85c9401e9fbd tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:18.952213 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f4b6af01-af1b-425a-8aca-85c9401e9fbd tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:19.157010 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f4b6af01-af1b-425a-8aca-85c9401e9fbd tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:19.165716 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-6ef09f26-ac46-4854-8b9c-be9520f7ee51 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:19.171107 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f4b6af01-af1b-425a-8aca-85c9401e9fbd tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105" status: 200 len: 1676 microversion: 2.1 time: 0.234524 Sep 14 09:16:19.172636 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2660/5342] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:18 2022] GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105 => generated 1676 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:19.180776 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-fdb5cb01-3680-4ab9-a077-d234455afe4f tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:19.181741 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-fdb5cb01-3680-4ab9-a077-d234455afe4f tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] [instance: a8305358-1f82-4022-b511-8d3e3d445a92] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:19.192674 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fdb5cb01-3680-4ab9-a077-d234455afe4f tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:19.193179 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fdb5cb01-3680-4ab9-a077-d234455afe4f tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:19.194016 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fdb5cb01-3680-4ab9-a077-d234455afe4f tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:19.195831 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fdb5cb01-3680-4ab9-a077-d234455afe4f tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:19.196304 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fdb5cb01-3680-4ab9-a077-d234455afe4f tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:19.196551 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-6ef09f26-ac46-4854-8b9c-be9520f7ee51 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:19.196769 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fdb5cb01-3680-4ab9-a077-d234455afe4f tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:19.198531 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-6ef09f26-ac46-4854-8b9c-be9520f7ee51 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:19.200585 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-6ef09f26-ac46-4854-8b9c-be9520f7ee51 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6" status: 200 len: 1729 microversion: 2.20 time: 0.270665 Sep 14 09:16:19.213112 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2683/5343] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:16:18 2022] GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6 => generated 1729 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:16:19.227413 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-9786c5fb-7684-4f31-84d4-029d7eca825c tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:19.228341 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-9786c5fb-7684-4f31-84d4-029d7eca825c tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] [instance: 12910e13-030f-4238-94b4-0d5c50c1e9e2] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:19.235299 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9786c5fb-7684-4f31-84d4-029d7eca825c tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:19.236136 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9786c5fb-7684-4f31-84d4-029d7eca825c tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:19.236737 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9786c5fb-7684-4f31-84d4-029d7eca825c tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:19.237685 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9786c5fb-7684-4f31-84d4-029d7eca825c tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:19.239053 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9786c5fb-7684-4f31-84d4-029d7eca825c tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:19.239790 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9786c5fb-7684-4f31-84d4-029d7eca825c tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:19.422567 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-fdb5cb01-3680-4ab9-a077-d234455afe4f tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb33a017168c4a8bae36eacd9ba6a7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24f2e13835b240578d411521ee520115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:19.436581 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-fdb5cb01-3680-4ab9-a077-d234455afe4f tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] 10.222.0.60 "GET /compute/v2.1/servers/a8305358-1f82-4022-b511-8d3e3d445a92" status: 200 len: 1504 microversion: 2.1 time: 0.261426 Sep 14 09:16:19.452253 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2661/5344] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:19 2022] GET /compute/v2.1/servers/a8305358-1f82-4022-b511-8d3e3d445a92 => generated 1504 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:19.461623 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-9786c5fb-7684-4f31-84d4-029d7eca825c tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538af7e0ab7c462fae161e4e8c5bf1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693e3fb677fb4bd387f1c86b369061dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:19.470364 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-9786c5fb-7684-4f31-84d4-029d7eca825c tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] 10.222.0.60 "GET /compute/v2.1/servers/12910e13-030f-4238-94b4-0d5c50c1e9e2" status: 200 len: 1313 microversion: 2.1 time: 0.256115 Sep 14 09:16:19.470980 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2684/5345] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:19 2022] GET /compute/v2.1/servers/12910e13-030f-4238-94b4-0d5c50c1e9e2 => generated 1313 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:20.201889 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a9d5162b-3863-49c6-a97b-adddbdf778f5 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:20.202521 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-a9d5162b-3863-49c6-a97b-adddbdf778f5 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:20.212696 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a9d5162b-3863-49c6-a97b-adddbdf778f5 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:20.213253 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a9d5162b-3863-49c6-a97b-adddbdf778f5 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:20.213848 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a9d5162b-3863-49c6-a97b-adddbdf778f5 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:20.214560 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a9d5162b-3863-49c6-a97b-adddbdf778f5 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:20.215055 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a9d5162b-3863-49c6-a97b-adddbdf778f5 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:20.215497 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a9d5162b-3863-49c6-a97b-adddbdf778f5 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:20.233783 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-cc8bce35-f5b8-400c-bdcf-bf7fc0cbbe8e tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:20.235251 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-cc8bce35-f5b8-400c-bdcf-bf7fc0cbbe8e tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 50157c1b-c748-4d1f-928e-207482b37ec6] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:20.242728 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cc8bce35-f5b8-400c-bdcf-bf7fc0cbbe8e tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:20.243142 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cc8bce35-f5b8-400c-bdcf-bf7fc0cbbe8e tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:20.243587 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cc8bce35-f5b8-400c-bdcf-bf7fc0cbbe8e tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:20.244298 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cc8bce35-f5b8-400c-bdcf-bf7fc0cbbe8e tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:20.244743 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cc8bce35-f5b8-400c-bdcf-bf7fc0cbbe8e tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:20.245172 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cc8bce35-f5b8-400c-bdcf-bf7fc0cbbe8e tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:20.430675 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-a9d5162b-3863-49c6-a97b-adddbdf778f5 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:20.438805 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-cc8bce35-f5b8-400c-bdcf-bf7fc0cbbe8e tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:20.448803 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-cc8bce35-f5b8-400c-bdcf-bf7fc0cbbe8e tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:20.450227 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a9d5162b-3863-49c6-a97b-adddbdf778f5 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105" status: 200 len: 1676 microversion: 2.1 time: 0.252242 Sep 14 09:16:20.450417 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-cc8bce35-f5b8-400c-bdcf-bf7fc0cbbe8e tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:20.463248 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2662/5346] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:20 2022] GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105 => generated 1676 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:16:20.464052 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-cc8bce35-f5b8-400c-bdcf-bf7fc0cbbe8e tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6" status: 200 len: 1729 microversion: 2.20 time: 0.221996 Sep 14 09:16:20.464052 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2685/5347] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:16:20 2022] GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6 => generated 1729 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 09:16:20.466975 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-5f434179-f229-45ff-9dc0-0decd4662ebf tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:20.467814 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-5f434179-f229-45ff-9dc0-0decd4662ebf tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] [instance: a8305358-1f82-4022-b511-8d3e3d445a92] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:20.474699 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5f434179-f229-45ff-9dc0-0decd4662ebf tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:20.475229 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5f434179-f229-45ff-9dc0-0decd4662ebf tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:20.475669 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5f434179-f229-45ff-9dc0-0decd4662ebf tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:20.476739 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5f434179-f229-45ff-9dc0-0decd4662ebf tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:20.477465 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5f434179-f229-45ff-9dc0-0decd4662ebf tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:20.477769 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5f434179-f229-45ff-9dc0-0decd4662ebf tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:20.493895 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-0655646d-af58-4fcc-83ba-58b186108e22 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:20.494782 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-0655646d-af58-4fcc-83ba-58b186108e22 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] [instance: 12910e13-030f-4238-94b4-0d5c50c1e9e2] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:20.502742 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0655646d-af58-4fcc-83ba-58b186108e22 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:20.503385 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0655646d-af58-4fcc-83ba-58b186108e22 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:20.504064 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0655646d-af58-4fcc-83ba-58b186108e22 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:20.504998 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0655646d-af58-4fcc-83ba-58b186108e22 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:20.505674 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0655646d-af58-4fcc-83ba-58b186108e22 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:20.506312 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0655646d-af58-4fcc-83ba-58b186108e22 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:20.529931 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=100 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:16:20.720863 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-5f434179-f229-45ff-9dc0-0decd4662ebf tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb33a017168c4a8bae36eacd9ba6a7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24f2e13835b240578d411521ee520115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:20.736093 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-5f434179-f229-45ff-9dc0-0decd4662ebf tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] 10.222.0.60 "GET /compute/v2.1/servers/a8305358-1f82-4022-b511-8d3e3d445a92" status: 200 len: 1504 microversion: 2.1 time: 0.278426 Sep 14 09:16:20.752870 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2663/5348] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:20 2022] GET /compute/v2.1/servers/a8305358-1f82-4022-b511-8d3e3d445a92 => generated 1504 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:16:20.755412 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-0655646d-af58-4fcc-83ba-58b186108e22 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538af7e0ab7c462fae161e4e8c5bf1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693e3fb677fb4bd387f1c86b369061dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:20.766636 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-0655646d-af58-4fcc-83ba-58b186108e22 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] 10.222.0.60 "GET /compute/v2.1/servers/12910e13-030f-4238-94b4-0d5c50c1e9e2" status: 200 len: 1313 microversion: 2.1 time: 0.276711 Sep 14 09:16:20.767281 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2686/5349] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:20 2022] GET /compute/v2.1/servers/12910e13-030f-4238-94b4-0d5c50c1e9e2 => generated 1313 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:16:21.490532 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-013510f7-74dc-4d43-bcf2-f0f9fe2f4f04 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:21.491458 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-013510f7-74dc-4d43-bcf2-f0f9fe2f4f04 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:21.496369 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-492059d2-89b8-4a8a-bfe4-3297519316e0 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:21.497800 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-492059d2-89b8-4a8a-bfe4-3297519316e0 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 50157c1b-c748-4d1f-928e-207482b37ec6] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:21.503235 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-013510f7-74dc-4d43-bcf2-f0f9fe2f4f04 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:21.504172 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-013510f7-74dc-4d43-bcf2-f0f9fe2f4f04 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:21.504661 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-013510f7-74dc-4d43-bcf2-f0f9fe2f4f04 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:21.506855 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-013510f7-74dc-4d43-bcf2-f0f9fe2f4f04 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:21.508532 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-013510f7-74dc-4d43-bcf2-f0f9fe2f4f04 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:21.509344 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-013510f7-74dc-4d43-bcf2-f0f9fe2f4f04 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:21.518330 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-492059d2-89b8-4a8a-bfe4-3297519316e0 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:21.521433 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-492059d2-89b8-4a8a-bfe4-3297519316e0 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:21.522665 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-492059d2-89b8-4a8a-bfe4-3297519316e0 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:21.525220 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-492059d2-89b8-4a8a-bfe4-3297519316e0 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:21.528252 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-492059d2-89b8-4a8a-bfe4-3297519316e0 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:21.530345 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-492059d2-89b8-4a8a-bfe4-3297519316e0 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:21.847962 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-013510f7-74dc-4d43-bcf2-f0f9fe2f4f04 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:21.852761 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-492059d2-89b8-4a8a-bfe4-3297519316e0 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:21.856952 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-013510f7-74dc-4d43-bcf2-f0f9fe2f4f04 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105" status: 200 len: 1659 microversion: 2.1 time: 0.373545 Sep 14 09:16:21.857723 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2664/5350] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:21 2022] GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105 => generated 1659 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:21.863311 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-82382040-1fca-4eb7-8abd-e0fef94bdbc2 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:21.863923 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-82382040-1fca-4eb7-8abd-e0fef94bdbc2 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] [instance: a8305358-1f82-4022-b511-8d3e3d445a92] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:21.870881 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-82382040-1fca-4eb7-8abd-e0fef94bdbc2 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:21.871584 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-82382040-1fca-4eb7-8abd-e0fef94bdbc2 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:21.872026 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-82382040-1fca-4eb7-8abd-e0fef94bdbc2 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:21.872862 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-82382040-1fca-4eb7-8abd-e0fef94bdbc2 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:21.873326 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-82382040-1fca-4eb7-8abd-e0fef94bdbc2 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:21.873751 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-82382040-1fca-4eb7-8abd-e0fef94bdbc2 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:21.881217 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-492059d2-89b8-4a8a-bfe4-3297519316e0 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:21.882983 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-492059d2-89b8-4a8a-bfe4-3297519316e0 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:21.884164 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-492059d2-89b8-4a8a-bfe4-3297519316e0 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6" status: 200 len: 1729 microversion: 2.20 time: 0.393379 Sep 14 09:16:21.891926 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2687/5351] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:16:21 2022] GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6 => generated 1729 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 09:16:21.891926 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-6814537a-7a60-4845-9c51-63aa370d3287 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:21.891926 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-6814537a-7a60-4845-9c51-63aa370d3287 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] [instance: 12910e13-030f-4238-94b4-0d5c50c1e9e2] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:21.897181 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6814537a-7a60-4845-9c51-63aa370d3287 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:21.897668 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6814537a-7a60-4845-9c51-63aa370d3287 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:21.898271 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6814537a-7a60-4845-9c51-63aa370d3287 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:21.899008 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6814537a-7a60-4845-9c51-63aa370d3287 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:21.899467 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6814537a-7a60-4845-9c51-63aa370d3287 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:21.899886 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6814537a-7a60-4845-9c51-63aa370d3287 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:22.094755 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-82382040-1fca-4eb7-8abd-e0fef94bdbc2 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb33a017168c4a8bae36eacd9ba6a7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24f2e13835b240578d411521ee520115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:22.099668 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-6814537a-7a60-4845-9c51-63aa370d3287 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538af7e0ab7c462fae161e4e8c5bf1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693e3fb677fb4bd387f1c86b369061dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:22.111595 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-6814537a-7a60-4845-9c51-63aa370d3287 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] 10.222.0.60 "GET /compute/v2.1/servers/12910e13-030f-4238-94b4-0d5c50c1e9e2" status: 200 len: 1313 microversion: 2.1 time: 0.225472 Sep 14 09:16:22.112200 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2688/5352] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:21 2022] GET /compute/v2.1/servers/12910e13-030f-4238-94b4-0d5c50c1e9e2 => generated 1313 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:22.126598 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-82382040-1fca-4eb7-8abd-e0fef94bdbc2 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] 10.222.0.60 "GET /compute/v2.1/servers/a8305358-1f82-4022-b511-8d3e3d445a92" status: 200 len: 1504 microversion: 2.1 time: 0.266735 Sep 14 09:16:22.126852 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2665/5353] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:21 2022] GET /compute/v2.1/servers/a8305358-1f82-4022-b511-8d3e3d445a92 => generated 1504 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:22.140056 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b064ec37-6356-44a1-b585-bb7f528cdb4a tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:16:22.141816 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b064ec37-6356-44a1-b585-bb7f528cdb4a tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:22.169865 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b064ec37-6356-44a1-b585-bb7f528cdb4a tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:22.171233 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b064ec37-6356-44a1-b585-bb7f528cdb4a tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:22.171857 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b064ec37-6356-44a1-b585-bb7f528cdb4a tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:22.173175 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b064ec37-6356-44a1-b585-bb7f528cdb4a tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:22.173642 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b064ec37-6356-44a1-b585-bb7f528cdb4a tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:22.174077 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b064ec37-6356-44a1-b585-bb7f528cdb4a tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:22.248359 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b064ec37-6356-44a1-b585-bb7f528cdb4a tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "POST /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105/action" status: 202 len: 0 microversion: 2.1 time: 0.119149 Sep 14 09:16:22.249040 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2666/5354] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:16:22 2022] POST /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:16:22.257285 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-de285337-4f78-434d-92c3-6c5315229059 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:22.258536 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-de285337-4f78-434d-92c3-6c5315229059 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:22.264839 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-de285337-4f78-434d-92c3-6c5315229059 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:22.265296 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-de285337-4f78-434d-92c3-6c5315229059 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:22.265739 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-de285337-4f78-434d-92c3-6c5315229059 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:22.266465 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-de285337-4f78-434d-92c3-6c5315229059 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:22.267039 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-de285337-4f78-434d-92c3-6c5315229059 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:22.267472 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-de285337-4f78-434d-92c3-6c5315229059 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:22.402279 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-de285337-4f78-434d-92c3-6c5315229059 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:22.410753 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-de285337-4f78-434d-92c3-6c5315229059 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105" status: 200 len: 1665 microversion: 2.1 time: 0.157389 Sep 14 09:16:22.411352 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2689/5355] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:22 2022] GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105 => generated 1665 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:22.914911 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-98b9dee8-64e1-4806-a8d4-9d295da76fce tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:22.915634 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-98b9dee8-64e1-4806-a8d4-9d295da76fce tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 50157c1b-c748-4d1f-928e-207482b37ec6] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:22.921767 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-98b9dee8-64e1-4806-a8d4-9d295da76fce tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:22.922245 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-98b9dee8-64e1-4806-a8d4-9d295da76fce tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:22.922696 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-98b9dee8-64e1-4806-a8d4-9d295da76fce tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:22.923396 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-98b9dee8-64e1-4806-a8d4-9d295da76fce tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:22.923848 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-98b9dee8-64e1-4806-a8d4-9d295da76fce tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:22.924270 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-98b9dee8-64e1-4806-a8d4-9d295da76fce tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:23.063449 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-98b9dee8-64e1-4806-a8d4-9d295da76fce tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:23.072280 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-98b9dee8-64e1-4806-a8d4-9d295da76fce tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:23.073755 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-98b9dee8-64e1-4806-a8d4-9d295da76fce tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:23.074932 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-98b9dee8-64e1-4806-a8d4-9d295da76fce tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6" status: 200 len: 1729 microversion: 2.20 time: 0.165724 Sep 14 09:16:23.075760 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2667/5356] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:16:22 2022] GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6 => generated 1729 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:16:23.140252 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d9f2f1e4-4e6f-42e4-8628-e5ec2a3c45d9 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:23.140879 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-d9f2f1e4-4e6f-42e4-8628-e5ec2a3c45d9 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] [instance: 12910e13-030f-4238-94b4-0d5c50c1e9e2] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:23.147809 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d9f2f1e4-4e6f-42e4-8628-e5ec2a3c45d9 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:23.148837 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d9f2f1e4-4e6f-42e4-8628-e5ec2a3c45d9 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:23.149347 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d9f2f1e4-4e6f-42e4-8628-e5ec2a3c45d9 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:23.150046 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d9f2f1e4-4e6f-42e4-8628-e5ec2a3c45d9 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:23.150505 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d9f2f1e4-4e6f-42e4-8628-e5ec2a3c45d9 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:23.152418 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d9f2f1e4-4e6f-42e4-8628-e5ec2a3c45d9 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:23.157664 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9f12dcc5-1284-4ea5-9930-8bae9a51966a tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:23.158440 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-9f12dcc5-1284-4ea5-9930-8bae9a51966a tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] [instance: a8305358-1f82-4022-b511-8d3e3d445a92] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:23.165546 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9f12dcc5-1284-4ea5-9930-8bae9a51966a tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:23.166221 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9f12dcc5-1284-4ea5-9930-8bae9a51966a tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:23.166854 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9f12dcc5-1284-4ea5-9930-8bae9a51966a tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:23.167922 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9f12dcc5-1284-4ea5-9930-8bae9a51966a tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:23.168665 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9f12dcc5-1284-4ea5-9930-8bae9a51966a tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:23.169163 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9f12dcc5-1284-4ea5-9930-8bae9a51966a tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:23.360695 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-d9f2f1e4-4e6f-42e4-8628-e5ec2a3c45d9 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538af7e0ab7c462fae161e4e8c5bf1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693e3fb677fb4bd387f1c86b369061dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:23.364314 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-9f12dcc5-1284-4ea5-9930-8bae9a51966a tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb33a017168c4a8bae36eacd9ba6a7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24f2e13835b240578d411521ee520115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:23.368447 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:16:23.370536 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-d9f2f1e4-4e6f-42e4-8628-e5ec2a3c45d9 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] 10.222.0.60 "GET /compute/v2.1/servers/12910e13-030f-4238-94b4-0d5c50c1e9e2" status: 200 len: 1313 microversion: 2.1 time: 0.234080 Sep 14 09:16:23.375215 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2690/5357] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:23 2022] GET /compute/v2.1/servers/12910e13-030f-4238-94b4-0d5c50c1e9e2 => generated 1313 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:23.375372 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-9f12dcc5-1284-4ea5-9930-8bae9a51966a tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] 10.222.0.60 "GET /compute/v2.1/servers/a8305358-1f82-4022-b511-8d3e3d445a92" status: 200 len: 1504 microversion: 2.1 time: 0.220743 Sep 14 09:16:23.375372 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2668/5358] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:23 2022] GET /compute/v2.1/servers/a8305358-1f82-4022-b511-8d3e3d445a92 => generated 1504 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:23.433630 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-0c41f1a4-db2c-4452-b60a-a90ba51414e5 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:23.434246 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-0c41f1a4-db2c-4452-b60a-a90ba51414e5 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:23.440348 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0c41f1a4-db2c-4452-b60a-a90ba51414e5 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:23.440857 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0c41f1a4-db2c-4452-b60a-a90ba51414e5 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:23.441294 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0c41f1a4-db2c-4452-b60a-a90ba51414e5 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:23.441982 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0c41f1a4-db2c-4452-b60a-a90ba51414e5 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:23.442440 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0c41f1a4-db2c-4452-b60a-a90ba51414e5 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:23.442866 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0c41f1a4-db2c-4452-b60a-a90ba51414e5 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:23.582174 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-0c41f1a4-db2c-4452-b60a-a90ba51414e5 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:23.591050 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-0c41f1a4-db2c-4452-b60a-a90ba51414e5 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105" status: 200 len: 1665 microversion: 2.1 time: 0.161192 Sep 14 09:16:23.591682 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2691/5359] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:23 2022] GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105 => generated 1665 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:24.101994 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-87033cb7-84a5-4afb-9f17-aef4577debf9 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:24.102669 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-87033cb7-84a5-4afb-9f17-aef4577debf9 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 50157c1b-c748-4d1f-928e-207482b37ec6] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:24.110388 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-87033cb7-84a5-4afb-9f17-aef4577debf9 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:24.111041 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-87033cb7-84a5-4afb-9f17-aef4577debf9 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:24.111485 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-87033cb7-84a5-4afb-9f17-aef4577debf9 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:24.112180 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-87033cb7-84a5-4afb-9f17-aef4577debf9 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:24.112631 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-87033cb7-84a5-4afb-9f17-aef4577debf9 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:24.113056 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-87033cb7-84a5-4afb-9f17-aef4577debf9 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:24.245428 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-87033cb7-84a5-4afb-9f17-aef4577debf9 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:24.254039 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-87033cb7-84a5-4afb-9f17-aef4577debf9 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:24.255527 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-87033cb7-84a5-4afb-9f17-aef4577debf9 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:24.256694 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-87033cb7-84a5-4afb-9f17-aef4577debf9 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6" status: 200 len: 1729 microversion: 2.20 time: 0.160228 Sep 14 09:16:24.257265 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2669/5360] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:16:24 2022] GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6 => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 09:16:24.393968 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-3e1f71ae-eb33-4b16-a8f2-8d09b5163422 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:24.394604 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-3e1f71ae-eb33-4b16-a8f2-8d09b5163422 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] [instance: 12910e13-030f-4238-94b4-0d5c50c1e9e2] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:24.397831 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-eb0b6fba-52dc-4ae2-ad64-8709febfbf53 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:24.398695 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-eb0b6fba-52dc-4ae2-ad64-8709febfbf53 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] [instance: a8305358-1f82-4022-b511-8d3e3d445a92] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:24.402417 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3e1f71ae-eb33-4b16-a8f2-8d09b5163422 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:24.403170 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3e1f71ae-eb33-4b16-a8f2-8d09b5163422 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:24.403720 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3e1f71ae-eb33-4b16-a8f2-8d09b5163422 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:24.404585 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3e1f71ae-eb33-4b16-a8f2-8d09b5163422 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:24.405154 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3e1f71ae-eb33-4b16-a8f2-8d09b5163422 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:24.405395 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-eb0b6fba-52dc-4ae2-ad64-8709febfbf53 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:24.405774 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3e1f71ae-eb33-4b16-a8f2-8d09b5163422 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:24.405893 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-eb0b6fba-52dc-4ae2-ad64-8709febfbf53 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:24.406332 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-eb0b6fba-52dc-4ae2-ad64-8709febfbf53 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:24.407069 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-eb0b6fba-52dc-4ae2-ad64-8709febfbf53 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:24.407540 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-eb0b6fba-52dc-4ae2-ad64-8709febfbf53 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:24.408040 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-eb0b6fba-52dc-4ae2-ad64-8709febfbf53 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:24.628520 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-eb0b6fba-52dc-4ae2-ad64-8709febfbf53 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb33a017168c4a8bae36eacd9ba6a7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24f2e13835b240578d411521ee520115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:24.632554 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-3e1f71ae-eb33-4b16-a8f2-8d09b5163422 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538af7e0ab7c462fae161e4e8c5bf1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693e3fb677fb4bd387f1c86b369061dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:24.636658 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-eb0b6fba-52dc-4ae2-ad64-8709febfbf53 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] 10.222.0.60 "GET /compute/v2.1/servers/a8305358-1f82-4022-b511-8d3e3d445a92" status: 200 len: 1504 microversion: 2.1 time: 0.242990 Sep 14 09:16:24.637559 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2670/5361] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:24 2022] GET /compute/v2.1/servers/a8305358-1f82-4022-b511-8d3e3d445a92 => generated 1504 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:24.640571 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-3e1f71ae-eb33-4b16-a8f2-8d09b5163422 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] 10.222.0.60 "GET /compute/v2.1/servers/12910e13-030f-4238-94b4-0d5c50c1e9e2" status: 200 len: 1313 microversion: 2.1 time: 0.250693 Sep 14 09:16:24.641147 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2692/5362] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:24 2022] GET /compute/v2.1/servers/12910e13-030f-4238-94b4-0d5c50c1e9e2 => generated 1313 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:24.642085 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ffdca89c-63e6-417f-ad19-59e3a59a679a tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:24.642847 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-ffdca89c-63e6-417f-ad19-59e3a59a679a tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:24.650186 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ffdca89c-63e6-417f-ad19-59e3a59a679a tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:24.650676 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ffdca89c-63e6-417f-ad19-59e3a59a679a tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:24.651281 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ffdca89c-63e6-417f-ad19-59e3a59a679a tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:24.652424 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ffdca89c-63e6-417f-ad19-59e3a59a679a tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:24.653161 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ffdca89c-63e6-417f-ad19-59e3a59a679a tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:24.653599 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ffdca89c-63e6-417f-ad19-59e3a59a679a tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:24.791205 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-ffdca89c-63e6-417f-ad19-59e3a59a679a tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:24.799080 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-ffdca89c-63e6-417f-ad19-59e3a59a679a tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105" status: 200 len: 1665 microversion: 2.1 time: 0.160521 Sep 14 09:16:24.799665 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2671/5363] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:24 2022] GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105 => generated 1665 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:25.281827 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-56a32c87-a2e8-452d-a6bd-949646f88acc tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:25.283092 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-56a32c87-a2e8-452d-a6bd-949646f88acc tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 50157c1b-c748-4d1f-928e-207482b37ec6] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:25.298208 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-56a32c87-a2e8-452d-a6bd-949646f88acc tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:25.298977 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-56a32c87-a2e8-452d-a6bd-949646f88acc tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:25.299586 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-56a32c87-a2e8-452d-a6bd-949646f88acc tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:25.300585 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-56a32c87-a2e8-452d-a6bd-949646f88acc tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:25.300773 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-56a32c87-a2e8-452d-a6bd-949646f88acc tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:25.301246 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-56a32c87-a2e8-452d-a6bd-949646f88acc tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:25.536936 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-56a32c87-a2e8-452d-a6bd-949646f88acc tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:25.547235 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-56a32c87-a2e8-452d-a6bd-949646f88acc tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:25.548702 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-56a32c87-a2e8-452d-a6bd-949646f88acc tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:25.550056 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-56a32c87-a2e8-452d-a6bd-949646f88acc tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6" status: 200 len: 1729 microversion: 2.20 time: 0.272190 Sep 14 09:16:25.552637 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2693/5364] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:16:25 2022] GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6 => generated 1729 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:16:25.661823 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a46f9f45-d25c-436e-9da1-07337428b964 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:25.662507 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-a46f9f45-d25c-436e-9da1-07337428b964 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] [instance: a8305358-1f82-4022-b511-8d3e3d445a92] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:25.667600 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-8edf357c-49fd-4fb1-adce-890b3b950031 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:25.668483 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-8edf357c-49fd-4fb1-adce-890b3b950031 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] [instance: 12910e13-030f-4238-94b4-0d5c50c1e9e2] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:25.672022 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a46f9f45-d25c-436e-9da1-07337428b964 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:25.673811 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a46f9f45-d25c-436e-9da1-07337428b964 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:25.675770 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a46f9f45-d25c-436e-9da1-07337428b964 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:25.675952 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8edf357c-49fd-4fb1-adce-890b3b950031 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:25.676617 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8edf357c-49fd-4fb1-adce-890b3b950031 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:25.677345 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8edf357c-49fd-4fb1-adce-890b3b950031 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:25.677619 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a46f9f45-d25c-436e-9da1-07337428b964 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:25.678541 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a46f9f45-d25c-436e-9da1-07337428b964 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:25.678798 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8edf357c-49fd-4fb1-adce-890b3b950031 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:25.679235 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a46f9f45-d25c-436e-9da1-07337428b964 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:25.679664 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8edf357c-49fd-4fb1-adce-890b3b950031 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:25.680265 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8edf357c-49fd-4fb1-adce-890b3b950031 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:26.506151 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-8edf357c-49fd-4fb1-adce-890b3b950031 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538af7e0ab7c462fae161e4e8c5bf1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693e3fb677fb4bd387f1c86b369061dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:26.515325 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-8edf357c-49fd-4fb1-adce-890b3b950031 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] 10.222.0.60 "GET /compute/v2.1/servers/12910e13-030f-4238-94b4-0d5c50c1e9e2" status: 200 len: 1313 microversion: 2.1 time: 0.852369 Sep 14 09:16:26.516125 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2694/5365] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:25 2022] GET /compute/v2.1/servers/12910e13-030f-4238-94b4-0d5c50c1e9e2 => generated 1313 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:16:26.520957 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-da744a2f-5260-4ba8-bf81-37170d10ba68 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:26.521574 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-da744a2f-5260-4ba8-bf81-37170d10ba68 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:26.545383 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-da744a2f-5260-4ba8-bf81-37170d10ba68 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:26.547415 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-a46f9f45-d25c-436e-9da1-07337428b964 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb33a017168c4a8bae36eacd9ba6a7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24f2e13835b240578d411521ee520115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:26.547850 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-da744a2f-5260-4ba8-bf81-37170d10ba68 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:26.549551 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-da744a2f-5260-4ba8-bf81-37170d10ba68 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:26.553518 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-da744a2f-5260-4ba8-bf81-37170d10ba68 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:26.554567 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-da744a2f-5260-4ba8-bf81-37170d10ba68 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:26.555208 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-da744a2f-5260-4ba8-bf81-37170d10ba68 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:26.566770 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a46f9f45-d25c-436e-9da1-07337428b964 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] 10.222.0.60 "GET /compute/v2.1/servers/a8305358-1f82-4022-b511-8d3e3d445a92" status: 200 len: 1504 microversion: 2.1 time: 0.908703 Sep 14 09:16:26.567602 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2672/5366] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:25 2022] GET /compute/v2.1/servers/a8305358-1f82-4022-b511-8d3e3d445a92 => generated 1504 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:26.583688 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-42e6d1a4-352e-438e-984c-6e88addd9302 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:26.584477 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-42e6d1a4-352e-438e-984c-6e88addd9302 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 50157c1b-c748-4d1f-928e-207482b37ec6] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:26.591344 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-42e6d1a4-352e-438e-984c-6e88addd9302 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:26.592037 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-42e6d1a4-352e-438e-984c-6e88addd9302 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:26.592473 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-42e6d1a4-352e-438e-984c-6e88addd9302 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:26.593167 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-42e6d1a4-352e-438e-984c-6e88addd9302 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:26.593640 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-42e6d1a4-352e-438e-984c-6e88addd9302 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:26.594066 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-42e6d1a4-352e-438e-984c-6e88addd9302 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:26.803014 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-42e6d1a4-352e-438e-984c-6e88addd9302 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:26.807890 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-da744a2f-5260-4ba8-bf81-37170d10ba68 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:26.812573 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-42e6d1a4-352e-438e-984c-6e88addd9302 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:26.814086 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-42e6d1a4-352e-438e-984c-6e88addd9302 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:26.815342 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-42e6d1a4-352e-438e-984c-6e88addd9302 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6" status: 200 len: 1729 microversion: 2.20 time: 0.235958 Sep 14 09:16:26.816067 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2673/5367] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:16:26 2022] GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6 => generated 1729 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:16:26.817138 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-da744a2f-5260-4ba8-bf81-37170d10ba68 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105" status: 200 len: 1665 microversion: 2.1 time: 0.298886 Sep 14 09:16:26.818258 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2695/5368] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:26 2022] GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105 => generated 1665 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:27.545685 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-2fb9b91e-0b72-475d-8239-86ad594cb9d3 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:27.546603 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-2fb9b91e-0b72-475d-8239-86ad594cb9d3 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] [instance: 12910e13-030f-4238-94b4-0d5c50c1e9e2] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:27.553758 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2fb9b91e-0b72-475d-8239-86ad594cb9d3 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:27.554301 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2fb9b91e-0b72-475d-8239-86ad594cb9d3 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:27.555006 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2fb9b91e-0b72-475d-8239-86ad594cb9d3 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:27.555907 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2fb9b91e-0b72-475d-8239-86ad594cb9d3 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:27.556518 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2fb9b91e-0b72-475d-8239-86ad594cb9d3 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:27.557095 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2fb9b91e-0b72-475d-8239-86ad594cb9d3 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:27.597708 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-74574160-42e2-49be-bbf4-74c08f459544 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:27.598517 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-74574160-42e2-49be-bbf4-74c08f459544 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] [instance: a8305358-1f82-4022-b511-8d3e3d445a92] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:27.619104 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-74574160-42e2-49be-bbf4-74c08f459544 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:27.619604 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-74574160-42e2-49be-bbf4-74c08f459544 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:27.620055 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-74574160-42e2-49be-bbf4-74c08f459544 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:27.620783 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-74574160-42e2-49be-bbf4-74c08f459544 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:27.621249 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-74574160-42e2-49be-bbf4-74c08f459544 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:27.621682 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-74574160-42e2-49be-bbf4-74c08f459544 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:28.014783 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-74574160-42e2-49be-bbf4-74c08f459544 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb33a017168c4a8bae36eacd9ba6a7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24f2e13835b240578d411521ee520115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:28.030774 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-74574160-42e2-49be-bbf4-74c08f459544 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] 10.222.0.60 "GET /compute/v2.1/servers/a8305358-1f82-4022-b511-8d3e3d445a92" status: 200 len: 1504 microversion: 2.1 time: 0.437321 Sep 14 09:16:28.031899 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2696/5369] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:27 2022] GET /compute/v2.1/servers/a8305358-1f82-4022-b511-8d3e3d445a92 => generated 1504 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:16:28.042561 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-5e46b7f8-a33a-4f2c-9489-21d3b0b74096 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:28.043862 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-5e46b7f8-a33a-4f2c-9489-21d3b0b74096 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 50157c1b-c748-4d1f-928e-207482b37ec6] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:28.060470 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5e46b7f8-a33a-4f2c-9489-21d3b0b74096 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:28.061199 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5e46b7f8-a33a-4f2c-9489-21d3b0b74096 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:28.062279 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5e46b7f8-a33a-4f2c-9489-21d3b0b74096 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:28.064758 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5e46b7f8-a33a-4f2c-9489-21d3b0b74096 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:28.069141 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-2fb9b91e-0b72-475d-8239-86ad594cb9d3 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538af7e0ab7c462fae161e4e8c5bf1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693e3fb677fb4bd387f1c86b369061dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:28.079371 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5e46b7f8-a33a-4f2c-9489-21d3b0b74096 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:28.080831 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5e46b7f8-a33a-4f2c-9489-21d3b0b74096 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:28.085130 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-2fb9b91e-0b72-475d-8239-86ad594cb9d3 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] 10.222.0.60 "GET /compute/v2.1/servers/12910e13-030f-4238-94b4-0d5c50c1e9e2" status: 200 len: 1462 microversion: 2.1 time: 0.544234 Sep 14 09:16:28.086523 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2674/5370] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:27 2022] GET /compute/v2.1/servers/12910e13-030f-4238-94b4-0d5c50c1e9e2 => generated 1462 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:16:28.116092 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a8fb048d-b354-429a-8c71-72462d8527c8 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:28.119418 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-a8fb048d-b354-429a-8c71-72462d8527c8 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:28.134466 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a8fb048d-b354-429a-8c71-72462d8527c8 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:28.138824 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a8fb048d-b354-429a-8c71-72462d8527c8 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:28.139603 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a8fb048d-b354-429a-8c71-72462d8527c8 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:28.140484 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a8fb048d-b354-429a-8c71-72462d8527c8 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:28.141053 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a8fb048d-b354-429a-8c71-72462d8527c8 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:28.142283 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a8fb048d-b354-429a-8c71-72462d8527c8 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:28.310752 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-5e46b7f8-a33a-4f2c-9489-21d3b0b74096 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:28.334081 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-5e46b7f8-a33a-4f2c-9489-21d3b0b74096 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:28.336285 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-5e46b7f8-a33a-4f2c-9489-21d3b0b74096 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:28.346017 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-5e46b7f8-a33a-4f2c-9489-21d3b0b74096 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6" status: 200 len: 1729 microversion: 2.20 time: 0.308143 Sep 14 09:16:28.361072 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2697/5371] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:16:28 2022] GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6 => generated 1729 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:16:28.381187 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-4ad176ff-ad51-46af-b674-95c066a6ee3b req-91fca4f6-5401-4600-a54b-d6f71c779cef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50157c1b-c748-4d1f-928e-207482b37ec6", "name": "network-vif-plugged", "status": "completed", "tag": "6bb7c82b-6dea-4020-abff-f1c92580e9d8"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:16:28.403676 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-a8fb048d-b354-429a-8c71-72462d8527c8 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:28.404322 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-4ad176ff-ad51-46af-b674-95c066a6ee3b req-91fca4f6-5401-4600-a54b-d6f71c779cef service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:28.404818 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-4ad176ff-ad51-46af-b674-95c066a6ee3b req-91fca4f6-5401-4600-a54b-d6f71c779cef service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:28.405258 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-4ad176ff-ad51-46af-b674-95c066a6ee3b req-91fca4f6-5401-4600-a54b-d6f71c779cef service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:28.416309 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a8fb048d-b354-429a-8c71-72462d8527c8 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105" status: 200 len: 1668 microversion: 2.1 time: 0.313338 Sep 14 09:16:28.417146 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2675/5372] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:28 2022] GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105 => generated 1668 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:28.431792 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b2da54ef-5aeb-4b4f-ac65-36abbd600630 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2ade0265-d09a-4dd7-bf7f-c2c1435ebd93", "device": "/dev/sdb"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:16:28.434523 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b2da54ef-5aeb-4b4f-ac65-36abbd600630 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] [instance: 12910e13-030f-4238-94b4-0d5c50c1e9e2] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:28.439390 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-4ad176ff-ad51-46af-b674-95c066a6ee3b req-91fca4f6-5401-4600-a54b-d6f71c779cef service nova] Creating event network-vif-plugged:6bb7c82b-6dea-4020-abff-f1c92580e9d8 for instance 50157c1b-c748-4d1f-928e-207482b37ec6 on n-h1-836830-18 Sep 14 09:16:28.447436 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-4ad176ff-ad51-46af-b674-95c066a6ee3b req-91fca4f6-5401-4600-a54b-d6f71c779cef service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076191 Sep 14 09:16:28.447569 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b2da54ef-5aeb-4b4f-ac65-36abbd600630 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:28.449236 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b2da54ef-5aeb-4b4f-ac65-36abbd600630 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:28.449236 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b2da54ef-5aeb-4b4f-ac65-36abbd600630 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:28.449236 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b2da54ef-5aeb-4b4f-ac65-36abbd600630 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:28.449498 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2698/5373] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:16:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:16:28.449699 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b2da54ef-5aeb-4b4f-ac65-36abbd600630 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:28.450299 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b2da54ef-5aeb-4b4f-ac65-36abbd600630 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:28.456654 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-bb08b205-0ad2-47bd-8f86-12fe01bba899 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:28.457362 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-bb08b205-0ad2-47bd-8f86-12fe01bba899 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:28.464583 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bb08b205-0ad2-47bd-8f86-12fe01bba899 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:28.465072 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bb08b205-0ad2-47bd-8f86-12fe01bba899 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:28.465506 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bb08b205-0ad2-47bd-8f86-12fe01bba899 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:28.466210 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bb08b205-0ad2-47bd-8f86-12fe01bba899 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:28.466662 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bb08b205-0ad2-47bd-8f86-12fe01bba899 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:28.467191 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bb08b205-0ad2-47bd-8f86-12fe01bba899 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:28.665260 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-bb08b205-0ad2-47bd-8f86-12fe01bba899 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:28.676089 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-bb08b205-0ad2-47bd-8f86-12fe01bba899 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105" status: 200 len: 1668 microversion: 2.1 time: 0.225213 Sep 14 09:16:28.677475 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2699/5374] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:28 2022] GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105 => generated 1668 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:28.704528 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-f769e73f-c6ab-4bf6-b8f4-2eaeb1832861 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:28.705264 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-f769e73f-c6ab-4bf6-b8f4-2eaeb1832861 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: cf1f1bf7-3e3b-4e28-b4e5-5279b05cd751] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:28.713192 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f769e73f-c6ab-4bf6-b8f4-2eaeb1832861 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:28.713763 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f769e73f-c6ab-4bf6-b8f4-2eaeb1832861 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:28.714385 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f769e73f-c6ab-4bf6-b8f4-2eaeb1832861 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:28.715287 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f769e73f-c6ab-4bf6-b8f4-2eaeb1832861 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:28.716552 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f769e73f-c6ab-4bf6-b8f4-2eaeb1832861 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:28.717144 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f769e73f-c6ab-4bf6-b8f4-2eaeb1832861 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:28.763062 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-f769e73f-c6ab-4bf6-b8f4-2eaeb1832861 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: cf1f1bf7-3e3b-4e28-b4e5-5279b05cd751] Going to try to terminate instance {{(pid=128758) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:16:28.774027 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.compute.api [None req-f769e73f-c6ab-4bf6-b8f4-2eaeb1832861 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: cf1f1bf7-3e3b-4e28-b4e5-5279b05cd751] Working on deleting snapshot d1ecee36-7a5c-48d2-a9ed-acb0af0ff015 from shelved instance... Sep 14 09:16:28.848412 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b2da54ef-5aeb-4b4f-ac65-36abbd600630 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] 10.222.0.60 "POST /compute/v2.1/servers/12910e13-030f-4238-94b4-0d5c50c1e9e2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.429491 Sep 14 09:16:28.854469 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2676/5375] 10.222.0.60 () {60 vars in 1323 bytes} [Wed Sep 14 09:16:28 2022] POST /compute/v2.1/servers/12910e13-030f-4238-94b4-0d5c50c1e9e2/os-volume_attachments => generated 194 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:16:29.059208 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a9f53560-8a03-4005-884b-4e5643c76a4d tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:29.060053 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-a9f53560-8a03-4005-884b-4e5643c76a4d tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] [instance: a8305358-1f82-4022-b511-8d3e3d445a92] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:29.070597 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a9f53560-8a03-4005-884b-4e5643c76a4d tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:29.071807 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a9f53560-8a03-4005-884b-4e5643c76a4d tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:29.072480 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a9f53560-8a03-4005-884b-4e5643c76a4d tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:29.073428 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a9f53560-8a03-4005-884b-4e5643c76a4d tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:29.074086 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a9f53560-8a03-4005-884b-4e5643c76a4d tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:29.074732 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a9f53560-8a03-4005-884b-4e5643c76a4d tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:29.244493 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-a9f53560-8a03-4005-884b-4e5643c76a4d tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb33a017168c4a8bae36eacd9ba6a7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24f2e13835b240578d411521ee520115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:29.255684 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a9f53560-8a03-4005-884b-4e5643c76a4d tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] 10.222.0.60 "GET /compute/v2.1/servers/a8305358-1f82-4022-b511-8d3e3d445a92" status: 200 len: 1504 microversion: 2.1 time: 0.201567 Sep 14 09:16:29.268387 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2677/5376] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:29 2022] GET /compute/v2.1/servers/a8305358-1f82-4022-b511-8d3e3d445a92 => generated 1504 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:16:29.274821 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-68f7aca9-6039-4a06-b863-593ef525d176 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:29.275360 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-68f7aca9-6039-4a06-b863-593ef525d176 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] [instance: a5837087-a7ec-4b17-9162-d1ef5ecf2574] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:29.282457 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-68f7aca9-6039-4a06-b863-593ef525d176 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:29.283008 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-68f7aca9-6039-4a06-b863-593ef525d176 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:29.283422 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-68f7aca9-6039-4a06-b863-593ef525d176 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:29.284331 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-68f7aca9-6039-4a06-b863-593ef525d176 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:29.284770 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-68f7aca9-6039-4a06-b863-593ef525d176 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:29.285226 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-68f7aca9-6039-4a06-b863-593ef525d176 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:29.321823 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-68f7aca9-6039-4a06-b863-593ef525d176 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] [instance: a5837087-a7ec-4b17-9162-d1ef5ecf2574] Going to try to terminate instance {{(pid=128759) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:16:29.405990 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-68f7aca9-6039-4a06-b863-593ef525d176 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] 10.222.0.60 "DELETE /compute/v2.1/servers/a5837087-a7ec-4b17-9162-d1ef5ecf2574" status: 204 len: 0 microversion: 2.1 time: 0.136245 Sep 14 09:16:29.406886 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2678/5377] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:16:29 2022] DELETE /compute/v2.1/servers/a5837087-a7ec-4b17-9162-d1ef5ecf2574 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:16:29.414053 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-7bf9cb8f-3bd4-4b89-8a2c-6e45d0c4da41 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:29.414897 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-7bf9cb8f-3bd4-4b89-8a2c-6e45d0c4da41 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 50157c1b-c748-4d1f-928e-207482b37ec6] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:29.421469 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7bf9cb8f-3bd4-4b89-8a2c-6e45d0c4da41 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:29.422216 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7bf9cb8f-3bd4-4b89-8a2c-6e45d0c4da41 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:29.422684 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7bf9cb8f-3bd4-4b89-8a2c-6e45d0c4da41 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:29.423406 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7bf9cb8f-3bd4-4b89-8a2c-6e45d0c4da41 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:29.423873 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7bf9cb8f-3bd4-4b89-8a2c-6e45d0c4da41 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:29.424358 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7bf9cb8f-3bd4-4b89-8a2c-6e45d0c4da41 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:29.515866 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-f769e73f-c6ab-4bf6-b8f4-2eaeb1832861 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: cf1f1bf7-3e3b-4e28-b4e5-5279b05cd751] Doing local delete in cell 0a35f87f-19b7-4b11-98e6-8bcd07b0466f(cell1) {{(pid=128758) _delete /opt/stack/nova/nova/compute/api.py:2546}} Sep 14 09:16:29.516603 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f769e73f-c6ab-4bf6-b8f4-2eaeb1832861 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:29.517092 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f769e73f-c6ab-4bf6-b8f4-2eaeb1832861 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:29.517531 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f769e73f-c6ab-4bf6-b8f4-2eaeb1832861 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:29.517955 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.compute.api [None req-f769e73f-c6ab-4bf6-b8f4-2eaeb1832861 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: cf1f1bf7-3e3b-4e28-b4e5-5279b05cd751] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Sep 14 09:16:29.522514 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.network.neutron [None req-f769e73f-c6ab-4bf6-b8f4-2eaeb1832861 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: cf1f1bf7-3e3b-4e28-b4e5-5279b05cd751] deallocate_for_instance() {{(pid=128758) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Sep 14 09:16:29.677857 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-7bf9cb8f-3bd4-4b89-8a2c-6e45d0c4da41 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:29.688916 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-7bf9cb8f-3bd4-4b89-8a2c-6e45d0c4da41 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:29.690683 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-7bf9cb8f-3bd4-4b89-8a2c-6e45d0c4da41 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:29.691948 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-7bf9cb8f-3bd4-4b89-8a2c-6e45d0c4da41 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6" status: 200 len: 1729 microversion: 2.20 time: 0.283433 Sep 14 09:16:29.692967 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2679/5378] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:16:29 2022] GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6 => generated 1729 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:16:29.713937 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-305d3bcf-1bbc-4105-a01a-52dccbf52f33 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:29.714559 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-305d3bcf-1bbc-4105-a01a-52dccbf52f33 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] [instance: a5837087-a7ec-4b17-9162-d1ef5ecf2574] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:29.720822 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-305d3bcf-1bbc-4105-a01a-52dccbf52f33 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:29.721317 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-305d3bcf-1bbc-4105-a01a-52dccbf52f33 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:29.721757 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-305d3bcf-1bbc-4105-a01a-52dccbf52f33 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:29.722905 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-305d3bcf-1bbc-4105-a01a-52dccbf52f33 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:29.723408 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-305d3bcf-1bbc-4105-a01a-52dccbf52f33 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:29.723839 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-305d3bcf-1bbc-4105-a01a-52dccbf52f33 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:30.004495 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-305d3bcf-1bbc-4105-a01a-52dccbf52f33 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17918433a3994b69a65999a59a7f833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b73b20f2042c6a08f94ed23ff66e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:30.014091 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-305d3bcf-1bbc-4105-a01a-52dccbf52f33 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] 10.222.0.60 "GET /compute/v2.1/servers/a5837087-a7ec-4b17-9162-d1ef5ecf2574" status: 200 len: 1551 microversion: 2.1 time: 0.304952 Sep 14 09:16:30.014693 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2680/5379] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:29 2022] GET /compute/v2.1/servers/a5837087-a7ec-4b17-9162-d1ef5ecf2574 => generated 1551 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:30.280501 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-50840d3b-908e-4c7c-9b51-88588ccf1749 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:30.282679 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-50840d3b-908e-4c7c-9b51-88588ccf1749 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] [instance: a8305358-1f82-4022-b511-8d3e3d445a92] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:30.295464 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-50840d3b-908e-4c7c-9b51-88588ccf1749 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:30.296244 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-50840d3b-908e-4c7c-9b51-88588ccf1749 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:30.296839 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-50840d3b-908e-4c7c-9b51-88588ccf1749 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:30.297726 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-50840d3b-908e-4c7c-9b51-88588ccf1749 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:30.298458 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-50840d3b-908e-4c7c-9b51-88588ccf1749 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:30.299370 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-50840d3b-908e-4c7c-9b51-88588ccf1749 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:30.341316 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.network.neutron [None req-f769e73f-c6ab-4bf6-b8f4-2eaeb1832861 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: cf1f1bf7-3e3b-4e28-b4e5-5279b05cd751] Updating instance_info_cache with network_info: [] {{(pid=128758) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 14 09:16:30.602482 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-50840d3b-908e-4c7c-9b51-88588ccf1749 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb33a017168c4a8bae36eacd9ba6a7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24f2e13835b240578d411521ee520115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:30.613049 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-50840d3b-908e-4c7c-9b51-88588ccf1749 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] 10.222.0.60 "GET /compute/v2.1/servers/a8305358-1f82-4022-b511-8d3e3d445a92" status: 200 len: 1484 microversion: 2.1 time: 0.336291 Sep 14 09:16:30.614193 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2681/5380] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:30 2022] GET /compute/v2.1/servers/a8305358-1f82-4022-b511-8d3e3d445a92 => generated 1484 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:30.627278 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-d1730708-474e-4408-8223-712b0f2d8782 req-b7a4d0c0-ca53-4aee-b636-33a1600d6b11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf1f1bf7-3e3b-4e28-b4e5-5279b05cd751", "name": "network-vif-deleted", "tag": "44b6b52c-db23-4790-a977-0e4c3a8cdcf5"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:16:30.648854 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-d1730708-474e-4408-8223-712b0f2d8782 req-b7a4d0c0-ca53-4aee-b636-33a1600d6b11 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:30.649501 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-d1730708-474e-4408-8223-712b0f2d8782 req-b7a4d0c0-ca53-4aee-b636-33a1600d6b11 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:30.652819 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-d1730708-474e-4408-8223-712b0f2d8782 req-b7a4d0c0-ca53-4aee-b636-33a1600d6b11 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:30.670489 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:16:30.682005 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.compute.server_external_events [req-d1730708-474e-4408-8223-712b0f2d8782 req-b7a4d0c0-ca53-4aee-b636-33a1600d6b11 service nova] Unable to find a host for instance cf1f1bf7-3e3b-4e28-b4e5-5279b05cd751. Dropping event network-vif-deleted {{(pid=128759) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 14 09:16:30.683891 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-d1730708-474e-4408-8223-712b0f2d8782 req-b7a4d0c0-ca53-4aee-b636-33a1600d6b11 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.067612 Sep 14 09:16:30.689510 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2682/5381] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:16:30 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 74 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 14 09:16:30.698744 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-53a454fd-9405-4233-ab90-8feeee6a6041 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:16:30.699377 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-53a454fd-9405-4233-ab90-8feeee6a6041 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] [instance: a8305358-1f82-4022-b511-8d3e3d445a92] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:30.722623 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-53a454fd-9405-4233-ab90-8feeee6a6041 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:30.723140 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-53a454fd-9405-4233-ab90-8feeee6a6041 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:30.723583 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-53a454fd-9405-4233-ab90-8feeee6a6041 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:30.724291 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-53a454fd-9405-4233-ab90-8feeee6a6041 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:30.731421 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-53a454fd-9405-4233-ab90-8feeee6a6041 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:30.731865 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-53a454fd-9405-4233-ab90-8feeee6a6041 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:30.792981 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:16:30.949190 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-53a454fd-9405-4233-ab90-8feeee6a6041 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] 10.222.0.60 "POST /compute/v2.1/servers/a8305358-1f82-4022-b511-8d3e3d445a92/action" status: 202 len: 0 microversion: 2.1 time: 0.249095 Sep 14 09:16:30.954491 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2683/5382] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:16:30 2022] POST /compute/v2.1/servers/a8305358-1f82-4022-b511-8d3e3d445a92/action => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:16:30.967836 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-79b73d03-1d02-4522-9cc8-34c39efff15f tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:30.973688 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-79b73d03-1d02-4522-9cc8-34c39efff15f tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 50157c1b-c748-4d1f-928e-207482b37ec6] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:30.989392 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-79b73d03-1d02-4522-9cc8-34c39efff15f tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:30.991305 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-79b73d03-1d02-4522-9cc8-34c39efff15f tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:30.991819 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-79b73d03-1d02-4522-9cc8-34c39efff15f tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:30.994713 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-79b73d03-1d02-4522-9cc8-34c39efff15f tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:30.995519 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-79b73d03-1d02-4522-9cc8-34c39efff15f tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:30.996587 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-79b73d03-1d02-4522-9cc8-34c39efff15f tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:31.001467 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-f769e73f-c6ab-4bf6-b8f4-2eaeb1832861 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "DELETE /compute/v2.1/servers/cf1f1bf7-3e3b-4e28-b4e5-5279b05cd751" status: 204 len: 0 microversion: 2.1 time: 2.300967 Sep 14 09:16:31.005629 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2700/5383] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:16:28 2022] DELETE /compute/v2.1/servers/cf1f1bf7-3e3b-4e28-b4e5-5279b05cd751 => generated 0 bytes in 2302 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:16:31.013628 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-172812eb-4e7e-4093-b213-5f6493c579c9 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:31.016872 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-172812eb-4e7e-4093-b213-5f6493c579c9 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] [instance: a8305358-1f82-4022-b511-8d3e3d445a92] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:31.039504 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-172812eb-4e7e-4093-b213-5f6493c579c9 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:31.039917 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-172812eb-4e7e-4093-b213-5f6493c579c9 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:31.040368 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-172812eb-4e7e-4093-b213-5f6493c579c9 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:31.041100 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-172812eb-4e7e-4093-b213-5f6493c579c9 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:31.041563 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-172812eb-4e7e-4093-b213-5f6493c579c9 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:31.042001 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-172812eb-4e7e-4093-b213-5f6493c579c9 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:31.475408 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-172812eb-4e7e-4093-b213-5f6493c579c9 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb33a017168c4a8bae36eacd9ba6a7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24f2e13835b240578d411521ee520115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:31.479443 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-79b73d03-1d02-4522-9cc8-34c39efff15f tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:31.490209 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-79b73d03-1d02-4522-9cc8-34c39efff15f tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:31.492587 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-79b73d03-1d02-4522-9cc8-34c39efff15f tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:31.493712 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-172812eb-4e7e-4093-b213-5f6493c579c9 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] 10.222.0.60 "GET /compute/v2.1/servers/a8305358-1f82-4022-b511-8d3e3d445a92" status: 200 len: 1492 microversion: 2.1 time: 0.489989 Sep 14 09:16:31.494191 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-79b73d03-1d02-4522-9cc8-34c39efff15f tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6" status: 200 len: 1729 microversion: 2.20 time: 0.531521 Sep 14 09:16:31.494707 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2701/5384] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:31 2022] GET /compute/v2.1/servers/a8305358-1f82-4022-b511-8d3e3d445a92 => generated 1492 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:31.499475 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b8ad7e78-5f11-43a1-a8c6-a9ab29c971eb tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:31.507441 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2684/5385] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:16:30 2022] GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6 => generated 1729 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:16:31.508202 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-b8ad7e78-5f11-43a1-a8c6-a9ab29c971eb tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: cf1f1bf7-3e3b-4e28-b4e5-5279b05cd751] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:31.515101 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b8ad7e78-5f11-43a1-a8c6-a9ab29c971eb tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:31.515812 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b8ad7e78-5f11-43a1-a8c6-a9ab29c971eb tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:31.520272 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-32c1f025-a48b-48d0-a614-d9ba145cecf3 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:31.525258 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-32c1f025-a48b-48d0-a614-d9ba145cecf3 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] [instance: a5837087-a7ec-4b17-9162-d1ef5ecf2574] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:31.525709 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b8ad7e78-5f11-43a1-a8c6-a9ab29c971eb tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:31.528790 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b8ad7e78-5f11-43a1-a8c6-a9ab29c971eb tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:31.533635 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b8ad7e78-5f11-43a1-a8c6-a9ab29c971eb tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:31.534191 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b8ad7e78-5f11-43a1-a8c6-a9ab29c971eb tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:31.536794 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-32c1f025-a48b-48d0-a614-d9ba145cecf3 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:31.540963 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-32c1f025-a48b-48d0-a614-d9ba145cecf3 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:31.541610 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-32c1f025-a48b-48d0-a614-d9ba145cecf3 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:31.542490 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-32c1f025-a48b-48d0-a614-d9ba145cecf3 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:31.543223 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-32c1f025-a48b-48d0-a614-d9ba145cecf3 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:31.543820 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-32c1f025-a48b-48d0-a614-d9ba145cecf3 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:31.571805 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-b8ad7e78-5f11-43a1-a8c6-a9ab29c971eb tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] HTTP exception thrown: Instance cf1f1bf7-3e3b-4e28-b4e5-5279b05cd751 could not be found. Sep 14 09:16:31.576563 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b8ad7e78-5f11-43a1-a8c6-a9ab29c971eb tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Request method failure captured: Sep 14 09:16:31.576563 n-d-836830-18 devstack@n-api.service[128758]: request: GET /compute/v2.1/servers/cf1f1bf7-3e3b-4e28-b4e5-5279b05cd751 HTTP/1.1 Sep 14 09:16:31.576563 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 09:16:31.576563 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 09:16:31.576563 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 09:16:31.576563 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 09:16:31.576563 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 09:16:31.576563 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 09:16:31.576563 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 09:16:31.576563 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 09:16:31.576563 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZlbli-DUCcgcnIp82pgLH1MeZCUcHfkT5yyfUsmiHSxBD3c429y8-wgStj1whz8DzX2TZgyd3HgxP1s3YxgJlQF250cUgsVCoic4jlEyGeyIt_z0tJbq-ZVXxXpuOTFUrJr1sEtIyXnC0IrYNMyG6UkTPf7SAAui15bmxZyXWBXgjc Sep 14 09:16:31.576563 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 09:16:31.576563 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 09:16:31.576563 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 09:16:31.576563 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 09:16:31.576563 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 09:16:31.576563 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 09:16:31.576563 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 2f075a2c6aa4489abb3428e0a4ac5738 Sep 14 09:16:31.576563 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-ServerActionsTestJSON-1840244566 Sep 14 09:16:31.576563 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 09:16:31.576563 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 09:16:31.576563 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/2f075a2c6aa4489abb3428e0a4ac5738"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_2f075a2c6aa4489abb3428e0a4ac5738"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2f075a2c6aa4489abb3428e0a4ac5738"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2f075a2c6aa4489abb3428e0a4ac5738"}]}] Sep 14 09:16:31.576563 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-ServerActionsTestJSON-1840244566 Sep 14 09:16:31.576563 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 2f075a2c6aa4489abb3428e0a4ac5738 Sep 14 09:16:31.576563 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-ServerActionsTestJSON-1840244566 Sep 14 09:16:31.576563 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-ServerActionsTestJSON-1840244566-project Sep 14 09:16:31.576563 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 09:16:31.576563 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 09:16:31.576563 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 950da33830ae4ae1a5511dd146e4e3be Sep 14 09:16:31.576563 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-ServerActionsTestJSON-1840244566-project Sep 14 09:16:31.576563 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 09:16:31.576563 n-d-836830-18 devstack@n-api.service[128758]: exception: Instance cf1f1bf7-3e3b-4e28-b4e5-5279b05cd751 could not be found. Sep 14 09:16:31.576563 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': 'cf1f1bf7-3e3b-4e28-b4e5-5279b05cd751'} Sep 14 09:16:31.576563 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:16:31.576563 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:16:31.576563 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:16:31.576563 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:16:31.576563 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:16:31.576563 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:16:31.576563 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:16:31.576563 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:16:31.576563 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:16:31.576563 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:16:31.576563 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf1f1bf7-3e3b-4e28-b4e5-5279b05cd751 could not be found. Sep 14 09:16:31.576563 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:16:31.576563 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:16:31.576563 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:16:31.576563 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:16:31.576563 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:16:31.576563 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:16:31.576563 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:16:31.576563 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:16:31.576563 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:16:31.576563 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:16:31.576563 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:16:31.576563 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:16:31.576563 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:16:31.576563 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:16:31.576563 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:16:31.576563 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:16:31.576563 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf1f1bf7-3e3b-4e28-b4e5-5279b05cd751 could not be found. Sep 14 09:16:31.576563 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:16:31.576563 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:16:31.576563 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:16:31.581230 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:16:31.581230 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:16:31.581230 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:16:31.581230 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:16:31.581230 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:16:31.581230 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf1f1bf7-3e3b-4e28-b4e5-5279b05cd751 could not be found. Sep 14 09:16:31.581230 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:16:31.583614 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b8ad7e78-5f11-43a1-a8c6-a9ab29c971eb tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Returning 404 to user: Instance cf1f1bf7-3e3b-4e28-b4e5-5279b05cd751 could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:16:31.591947 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-b8ad7e78-5f11-43a1-a8c6-a9ab29c971eb tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/cf1f1bf7-3e3b-4e28-b4e5-5279b05cd751" status: 404 len: 111 microversion: 2.1 time: 0.096138 Sep 14 09:16:31.594639 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2702/5386] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:31 2022] GET /compute/v2.1/servers/cf1f1bf7-3e3b-4e28-b4e5-5279b05cd751 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:16:31.602653 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-06e06244-7630-45a0-a684-e5e314eb8fe6 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:31.603487 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-06e06244-7630-45a0-a684-e5e314eb8fe6 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 907157a9-afff-4acb-98b7-b07b9c055ab1] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:31.617055 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-06e06244-7630-45a0-a684-e5e314eb8fe6 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:31.621933 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-06e06244-7630-45a0-a684-e5e314eb8fe6 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:31.622791 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-06e06244-7630-45a0-a684-e5e314eb8fe6 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:31.623768 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-06e06244-7630-45a0-a684-e5e314eb8fe6 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:31.624884 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-06e06244-7630-45a0-a684-e5e314eb8fe6 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:31.625476 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-06e06244-7630-45a0-a684-e5e314eb8fe6 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:31.669671 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-06e06244-7630-45a0-a684-e5e314eb8fe6 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 907157a9-afff-4acb-98b7-b07b9c055ab1] Going to try to terminate instance {{(pid=128758) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:16:31.781122 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-32c1f025-a48b-48d0-a614-d9ba145cecf3 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17918433a3994b69a65999a59a7f833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b73b20f2042c6a08f94ed23ff66e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:31.797573 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-32c1f025-a48b-48d0-a614-d9ba145cecf3 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] 10.222.0.60 "GET /compute/v2.1/servers/a5837087-a7ec-4b17-9162-d1ef5ecf2574" status: 200 len: 1551 microversion: 2.1 time: 0.283451 Sep 14 09:16:31.798753 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2685/5387] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:31 2022] GET /compute/v2.1/servers/a5837087-a7ec-4b17-9162-d1ef5ecf2574 => generated 1551 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:31.844518 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-06e06244-7630-45a0-a684-e5e314eb8fe6 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "DELETE /compute/v2.1/servers/907157a9-afff-4acb-98b7-b07b9c055ab1" status: 204 len: 0 microversion: 2.1 time: 0.245381 Sep 14 09:16:31.845552 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2703/5388] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:16:31 2022] DELETE /compute/v2.1/servers/907157a9-afff-4acb-98b7-b07b9c055ab1 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:16:31.858106 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-cd7c816d-8d32-432e-b713-2c7505dfe046 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:31.859066 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-cd7c816d-8d32-432e-b713-2c7505dfe046 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 907157a9-afff-4acb-98b7-b07b9c055ab1] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:31.865935 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cd7c816d-8d32-432e-b713-2c7505dfe046 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:31.867263 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cd7c816d-8d32-432e-b713-2c7505dfe046 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:31.867854 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cd7c816d-8d32-432e-b713-2c7505dfe046 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:31.868726 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cd7c816d-8d32-432e-b713-2c7505dfe046 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:31.869330 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cd7c816d-8d32-432e-b713-2c7505dfe046 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:31.870515 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cd7c816d-8d32-432e-b713-2c7505dfe046 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:32.022505 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-cd7c816d-8d32-432e-b713-2c7505dfe046 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:32.034400 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-cd7c816d-8d32-432e-b713-2c7505dfe046 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/907157a9-afff-4acb-98b7-b07b9c055ab1" status: 200 len: 1465 microversion: 2.1 time: 0.183822 Sep 14 09:16:32.047795 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2686/5389] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:31 2022] GET /compute/v2.1/servers/907157a9-afff-4acb-98b7-b07b9c055ab1 => generated 1465 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:32.137504 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-a848aa8a-bdb2-4603-8c42-7c0e10ed8013 req-27ab51d2-2fc7-420b-9d2b-d1090c6c288d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5837087-a7ec-4b17-9162-d1ef5ecf2574", "name": "network-vif-deleted", "tag": "a50f72ef-bb63-4ef6-b28d-a3d8cd24469e"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:16:32.148360 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-a848aa8a-bdb2-4603-8c42-7c0e10ed8013 req-27ab51d2-2fc7-420b-9d2b-d1090c6c288d service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:32.148840 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-a848aa8a-bdb2-4603-8c42-7c0e10ed8013 req-27ab51d2-2fc7-420b-9d2b-d1090c6c288d service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:32.149382 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-a848aa8a-bdb2-4603-8c42-7c0e10ed8013 req-27ab51d2-2fc7-420b-9d2b-d1090c6c288d service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:32.163182 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-a848aa8a-bdb2-4603-8c42-7c0e10ed8013 req-27ab51d2-2fc7-420b-9d2b-d1090c6c288d service nova] Creating event network-vif-deleted:a50f72ef-bb63-4ef6-b28d-a3d8cd24469e for instance a5837087-a7ec-4b17-9162-d1ef5ecf2574 on n-h2-836830-18 Sep 14 09:16:32.169023 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-a848aa8a-bdb2-4603-8c42-7c0e10ed8013 req-27ab51d2-2fc7-420b-9d2b-d1090c6c288d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035611 Sep 14 09:16:32.170565 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2704/5390] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:16:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:16:32.521727 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-20d2d4cd-32fb-4c4f-a150-f9d3e35268ad tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:32.522342 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-20d2d4cd-32fb-4c4f-a150-f9d3e35268ad tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] [instance: a8305358-1f82-4022-b511-8d3e3d445a92] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:32.523800 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-606338f2-f0bd-4c95-a609-9dd2e35e3729 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:32.525031 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-606338f2-f0bd-4c95-a609-9dd2e35e3729 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 50157c1b-c748-4d1f-928e-207482b37ec6] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:32.541039 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-20d2d4cd-32fb-4c4f-a150-f9d3e35268ad tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:32.541546 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-20d2d4cd-32fb-4c4f-a150-f9d3e35268ad tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:32.541990 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-20d2d4cd-32fb-4c4f-a150-f9d3e35268ad tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:32.542123 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-606338f2-f0bd-4c95-a609-9dd2e35e3729 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:32.542754 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-20d2d4cd-32fb-4c4f-a150-f9d3e35268ad tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:32.543176 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-20d2d4cd-32fb-4c4f-a150-f9d3e35268ad tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:32.543452 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-606338f2-f0bd-4c95-a609-9dd2e35e3729 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:32.543601 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-20d2d4cd-32fb-4c4f-a150-f9d3e35268ad tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:32.544189 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-606338f2-f0bd-4c95-a609-9dd2e35e3729 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:32.545143 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-606338f2-f0bd-4c95-a609-9dd2e35e3729 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:32.545867 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-606338f2-f0bd-4c95-a609-9dd2e35e3729 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:32.546648 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-606338f2-f0bd-4c95-a609-9dd2e35e3729 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:32.817243 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-20d2d4cd-32fb-4c4f-a150-f9d3e35268ad tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb33a017168c4a8bae36eacd9ba6a7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24f2e13835b240578d411521ee520115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:32.827777 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-606338f2-f0bd-4c95-a609-9dd2e35e3729 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:32.849940 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-20d2d4cd-32fb-4c4f-a150-f9d3e35268ad tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] 10.222.0.60 "GET /compute/v2.1/servers/a8305358-1f82-4022-b511-8d3e3d445a92" status: 200 len: 1492 microversion: 2.1 time: 0.330474 Sep 14 09:16:32.852213 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2687/5391] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:32 2022] GET /compute/v2.1/servers/a8305358-1f82-4022-b511-8d3e3d445a92 => generated 1492 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:32.855695 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-606338f2-f0bd-4c95-a609-9dd2e35e3729 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:32.857174 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-606338f2-f0bd-4c95-a609-9dd2e35e3729 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:32.866345 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8473bd26-0f0c-4bf5-8030-f26321b9e850 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:32.868662 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-606338f2-f0bd-4c95-a609-9dd2e35e3729 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6" status: 200 len: 1716 microversion: 2.20 time: 0.340513 Sep 14 09:16:32.869067 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-8473bd26-0f0c-4bf5-8030-f26321b9e850 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] [instance: a5837087-a7ec-4b17-9162-d1ef5ecf2574] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:32.870414 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2705/5392] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:16:32 2022] GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6 => generated 1716 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:16:32.878611 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8473bd26-0f0c-4bf5-8030-f26321b9e850 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:32.879796 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8473bd26-0f0c-4bf5-8030-f26321b9e850 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:32.880537 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8473bd26-0f0c-4bf5-8030-f26321b9e850 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:32.881590 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8473bd26-0f0c-4bf5-8030-f26321b9e850 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:32.882784 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8473bd26-0f0c-4bf5-8030-f26321b9e850 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:32.883404 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8473bd26-0f0c-4bf5-8030-f26321b9e850 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:32.966929 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-8473bd26-0f0c-4bf5-8030-f26321b9e850 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17918433a3994b69a65999a59a7f833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b73b20f2042c6a08f94ed23ff66e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:32.976384 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-8473bd26-0f0c-4bf5-8030-f26321b9e850 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] 10.222.0.60 "GET /compute/v2.1/servers/a5837087-a7ec-4b17-9162-d1ef5ecf2574" status: 200 len: 1331 microversion: 2.1 time: 0.122642 Sep 14 09:16:32.977302 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2688/5393] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:32 2022] GET /compute/v2.1/servers/a5837087-a7ec-4b17-9162-d1ef5ecf2574 => generated 1331 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:33.063080 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-95747008-815d-44e5-9363-0d11d3836d42 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:33.063639 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-95747008-815d-44e5-9363-0d11d3836d42 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 907157a9-afff-4acb-98b7-b07b9c055ab1] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:33.076477 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-95747008-815d-44e5-9363-0d11d3836d42 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:33.076986 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-95747008-815d-44e5-9363-0d11d3836d42 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:33.077658 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-95747008-815d-44e5-9363-0d11d3836d42 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:33.079103 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-95747008-815d-44e5-9363-0d11d3836d42 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:33.079772 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-95747008-815d-44e5-9363-0d11d3836d42 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:33.080571 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-95747008-815d-44e5-9363-0d11d3836d42 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:33.202688 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-95747008-815d-44e5-9363-0d11d3836d42 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:33.211836 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-95747008-815d-44e5-9363-0d11d3836d42 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/907157a9-afff-4acb-98b7-b07b9c055ab1" status: 200 len: 1465 microversion: 2.1 time: 0.155785 Sep 14 09:16:33.223939 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2706/5394] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:33 2022] GET /compute/v2.1/servers/907157a9-afff-4acb-98b7-b07b9c055ab1 => generated 1465 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:33.876579 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-aa106723-8716-41a5-8d65-98c967d5041f tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:33.877703 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-aa106723-8716-41a5-8d65-98c967d5041f tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] [instance: a8305358-1f82-4022-b511-8d3e3d445a92] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:33.887927 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-aa106723-8716-41a5-8d65-98c967d5041f tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:33.888404 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-aa106723-8716-41a5-8d65-98c967d5041f tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:33.888842 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-aa106723-8716-41a5-8d65-98c967d5041f tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:33.889543 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-aa106723-8716-41a5-8d65-98c967d5041f tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:33.890024 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-aa106723-8716-41a5-8d65-98c967d5041f tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:33.890401 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-aa106723-8716-41a5-8d65-98c967d5041f tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:34.002352 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d0110730-cdbf-41e4-a89f-ca532b7d7099 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:34.003160 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-d0110730-cdbf-41e4-a89f-ca532b7d7099 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] [instance: a5837087-a7ec-4b17-9162-d1ef5ecf2574] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:34.020316 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d0110730-cdbf-41e4-a89f-ca532b7d7099 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:34.024606 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d0110730-cdbf-41e4-a89f-ca532b7d7099 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:34.025082 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d0110730-cdbf-41e4-a89f-ca532b7d7099 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:34.026055 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d0110730-cdbf-41e4-a89f-ca532b7d7099 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:34.028039 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d0110730-cdbf-41e4-a89f-ca532b7d7099 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:34.028650 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d0110730-cdbf-41e4-a89f-ca532b7d7099 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:34.059854 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-aa106723-8716-41a5-8d65-98c967d5041f tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb33a017168c4a8bae36eacd9ba6a7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24f2e13835b240578d411521ee520115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:34.062990 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-d0110730-cdbf-41e4-a89f-ca532b7d7099 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] HTTP exception thrown: Instance a5837087-a7ec-4b17-9162-d1ef5ecf2574 could not be found. Sep 14 09:16:34.064680 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d0110730-cdbf-41e4-a89f-ca532b7d7099 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Request method failure captured: Sep 14 09:16:34.064680 n-d-836830-18 devstack@n-api.service[128758]: request: GET /compute/v2.1/servers/a5837087-a7ec-4b17-9162-d1ef5ecf2574 HTTP/1.1 Sep 14 09:16:34.064680 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 09:16:34.064680 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 09:16:34.064680 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 09:16:34.064680 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 09:16:34.064680 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 09:16:34.064680 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 09:16:34.064680 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 09:16:34.064680 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 09:16:34.064680 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZspPmHjwZujiBcFD9QR0xKRglPEsjHrxFyZ2jvI3y4w7WsV_uOazq2PIFhXWJstUoVfI5CfG-SbSDJQWJGpK1XjUqfYNhZcp5K7_6hUB7flJnxmZDSxGD91GsUMnRbAXa_LtSdQIgpS8r244D3MU9iQdVusPNXmSG4qhMgXymnz-Wo Sep 14 09:16:34.064680 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 09:16:34.064680 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 09:16:34.064680 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 09:16:34.064680 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 09:16:34.064680 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 09:16:34.064680 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 09:16:34.064680 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 021b73b20f2042c6a08f94ed23ff66e5 Sep 14 09:16:34.064680 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-TestNetworkBasicOps-1034807082 Sep 14 09:16:34.064680 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 09:16:34.064680 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 09:16:34.064680 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/021b73b20f2042c6a08f94ed23ff66e5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_021b73b20f2042c6a08f94ed23ff66e5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/021b73b20f2042c6a08f94ed23ff66e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/021b73b20f2042c6a08f94ed23ff66e5"}]}] Sep 14 09:16:34.064680 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-TestNetworkBasicOps-1034807082 Sep 14 09:16:34.064680 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 021b73b20f2042c6a08f94ed23ff66e5 Sep 14 09:16:34.064680 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-TestNetworkBasicOps-1034807082 Sep 14 09:16:34.064680 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-TestNetworkBasicOps-1034807082-project Sep 14 09:16:34.064680 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 09:16:34.064680 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 09:16:34.064680 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 17918433a3994b69a65999a59a7f833c Sep 14 09:16:34.064680 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-TestNetworkBasicOps-1034807082-project Sep 14 09:16:34.064680 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 09:16:34.064680 n-d-836830-18 devstack@n-api.service[128758]: exception: Instance a5837087-a7ec-4b17-9162-d1ef5ecf2574 could not be found. Sep 14 09:16:34.064680 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': 'a5837087-a7ec-4b17-9162-d1ef5ecf2574'} Sep 14 09:16:34.064680 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:16:34.064680 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:16:34.064680 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:16:34.064680 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:16:34.064680 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:16:34.064680 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:16:34.064680 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:16:34.064680 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:16:34.064680 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:16:34.064680 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:16:34.064680 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5837087-a7ec-4b17-9162-d1ef5ecf2574 could not be found. Sep 14 09:16:34.064680 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:16:34.064680 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:16:34.064680 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:16:34.064680 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:16:34.064680 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:16:34.064680 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:16:34.064680 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:16:34.064680 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:16:34.064680 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:16:34.064680 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:16:34.064680 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:16:34.064680 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:16:34.064680 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:16:34.064680 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:16:34.064680 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:16:34.064680 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:16:34.064680 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5837087-a7ec-4b17-9162-d1ef5ecf2574 could not be found. Sep 14 09:16:34.064680 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:16:34.064680 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:16:34.064680 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:16:34.068269 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:16:34.068269 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:16:34.068269 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:16:34.068269 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:16:34.068269 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:16:34.068269 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5837087-a7ec-4b17-9162-d1ef5ecf2574 could not be found. Sep 14 09:16:34.068269 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:16:34.068269 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d0110730-cdbf-41e4-a89f-ca532b7d7099 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Returning 404 to user: Instance a5837087-a7ec-4b17-9162-d1ef5ecf2574 could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:16:34.068269 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-d0110730-cdbf-41e4-a89f-ca532b7d7099 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] 10.222.0.60 "GET /compute/v2.1/servers/a5837087-a7ec-4b17-9162-d1ef5ecf2574" status: 404 len: 111 microversion: 2.1 time: 0.068457 Sep 14 09:16:34.068269 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2707/5395] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:33 2022] GET /compute/v2.1/servers/a5837087-a7ec-4b17-9162-d1ef5ecf2574 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:16:34.074825 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-aa106723-8716-41a5-8d65-98c967d5041f tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] 10.222.0.60 "GET /compute/v2.1/servers/a8305358-1f82-4022-b511-8d3e3d445a92" status: 200 len: 1492 microversion: 2.1 time: 0.202549 Sep 14 09:16:34.076066 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2689/5396] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:33 2022] GET /compute/v2.1/servers/a8305358-1f82-4022-b511-8d3e3d445a92 => generated 1492 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:34.185651 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-74324bd0-6d72-404f-a901-63445610d732 req-7a4df373-30f9-4dc9-a19a-4f6f490181c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "907157a9-afff-4acb-98b7-b07b9c055ab1", "name": "network-vif-deleted", "tag": "d50c4b90-8c94-4358-9585-2daa4f7e7d1d"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:16:34.192035 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:16:34.201657 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-74324bd0-6d72-404f-a901-63445610d732 req-7a4df373-30f9-4dc9-a19a-4f6f490181c7 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:34.202144 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-74324bd0-6d72-404f-a901-63445610d732 req-7a4df373-30f9-4dc9-a19a-4f6f490181c7 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:34.202579 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-74324bd0-6d72-404f-a901-63445610d732 req-7a4df373-30f9-4dc9-a19a-4f6f490181c7 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:34.236637 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-1b50e086-27e2-42ff-8a46-4cee1a353fa9 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:34.237268 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-1b50e086-27e2-42ff-8a46-4cee1a353fa9 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 907157a9-afff-4acb-98b7-b07b9c055ab1] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:34.245301 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-74324bd0-6d72-404f-a901-63445610d732 req-7a4df373-30f9-4dc9-a19a-4f6f490181c7 service nova] Creating event network-vif-deleted:d50c4b90-8c94-4358-9585-2daa4f7e7d1d for instance 907157a9-afff-4acb-98b7-b07b9c055ab1 on n-h2-836830-18 Sep 14 09:16:34.251745 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1b50e086-27e2-42ff-8a46-4cee1a353fa9 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:34.252456 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1b50e086-27e2-42ff-8a46-4cee1a353fa9 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:34.253086 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1b50e086-27e2-42ff-8a46-4cee1a353fa9 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:34.253955 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1b50e086-27e2-42ff-8a46-4cee1a353fa9 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:34.254569 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1b50e086-27e2-42ff-8a46-4cee1a353fa9 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:34.255186 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1b50e086-27e2-42ff-8a46-4cee1a353fa9 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:34.260015 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-74324bd0-6d72-404f-a901-63445610d732 req-7a4df373-30f9-4dc9-a19a-4f6f490181c7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078314 Sep 14 09:16:34.262841 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2708/5397] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:16:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:16:34.285287 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-af904fa2-d558-4235-a3ed-ea625ca9717a tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Calling method '.version_select at 0x7f7d3f37a790>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:34.346788 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-af904fa2-d558-4235-a3ed-ea625ca9717a tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-62008268" status: 202 len: 0 microversion: 2.1 time: 0.065468 Sep 14 09:16:34.347911 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2709/5398] 10.222.0.60 () {58 vars in 1251 bytes} [Wed Sep 14 09:16:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-62008268 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 14 09:16:34.378661 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-1b50e086-27e2-42ff-8a46-4cee1a353fa9 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:34.392466 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-1b50e086-27e2-42ff-8a46-4cee1a353fa9 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/907157a9-afff-4acb-98b7-b07b9c055ab1" status: 200 len: 1465 microversion: 2.1 time: 0.159773 Sep 14 09:16:34.393537 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2690/5399] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:34 2022] GET /compute/v2.1/servers/907157a9-afff-4acb-98b7-b07b9c055ab1 => generated 1465 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:35.100256 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-38e12039-ce27-4b60-966e-cd41bbbb7afb tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:35.104032 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-38e12039-ce27-4b60-966e-cd41bbbb7afb tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] [instance: a8305358-1f82-4022-b511-8d3e3d445a92] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:35.134958 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-38e12039-ce27-4b60-966e-cd41bbbb7afb tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:35.138430 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-38e12039-ce27-4b60-966e-cd41bbbb7afb tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:35.139958 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-38e12039-ce27-4b60-966e-cd41bbbb7afb tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:35.142903 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-38e12039-ce27-4b60-966e-cd41bbbb7afb tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:35.145838 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-38e12039-ce27-4b60-966e-cd41bbbb7afb tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:35.146799 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-38e12039-ce27-4b60-966e-cd41bbbb7afb tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:35.416310 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c8af9298-c62d-42f1-9177-229c047de57a tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:35.417553 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-c8af9298-c62d-42f1-9177-229c047de57a tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 907157a9-afff-4acb-98b7-b07b9c055ab1] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:35.438194 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c8af9298-c62d-42f1-9177-229c047de57a tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:35.439913 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c8af9298-c62d-42f1-9177-229c047de57a tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:35.441905 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c8af9298-c62d-42f1-9177-229c047de57a tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:35.447903 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c8af9298-c62d-42f1-9177-229c047de57a tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:35.451730 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c8af9298-c62d-42f1-9177-229c047de57a tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:35.452493 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c8af9298-c62d-42f1-9177-229c047de57a tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:35.603731 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c8af9298-c62d-42f1-9177-229c047de57a tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:35.619101 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c8af9298-c62d-42f1-9177-229c047de57a tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:35.619679 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c8af9298-c62d-42f1-9177-229c047de57a tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:35.625697 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.objects.instance [None req-c8af9298-c62d-42f1-9177-229c047de57a tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lazy-loading 'fault' on Instance uuid 907157a9-afff-4acb-98b7-b07b9c055ab1 {{(pid=128759) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:16:35.792122 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-c8af9298-c62d-42f1-9177-229c047de57a tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:35.809607 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-38e12039-ce27-4b60-966e-cd41bbbb7afb tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb33a017168c4a8bae36eacd9ba6a7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24f2e13835b240578d411521ee520115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:35.813377 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-c8af9298-c62d-42f1-9177-229c047de57a tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/907157a9-afff-4acb-98b7-b07b9c055ab1" status: 200 len: 1304 microversion: 2.1 time: 0.401424 Sep 14 09:16:35.816492 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2691/5400] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:35 2022] GET /compute/v2.1/servers/907157a9-afff-4acb-98b7-b07b9c055ab1 => generated 1304 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:35.834906 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-38e12039-ce27-4b60-966e-cd41bbbb7afb tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] 10.222.0.60 "GET /compute/v2.1/servers/a8305358-1f82-4022-b511-8d3e3d445a92" status: 200 len: 1498 microversion: 2.1 time: 0.741030 Sep 14 09:16:35.851516 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2710/5401] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:35 2022] GET /compute/v2.1/servers/a8305358-1f82-4022-b511-8d3e3d445a92 => generated 1498 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:35.871233 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-479f1a13-f3cd-4cf9-bde4-0055ce5e3b40 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:35.871968 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-479f1a13-f3cd-4cf9-bde4-0055ce5e3b40 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] [instance: a8305358-1f82-4022-b511-8d3e3d445a92] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:35.879488 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-479f1a13-f3cd-4cf9-bde4-0055ce5e3b40 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:35.880159 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-479f1a13-f3cd-4cf9-bde4-0055ce5e3b40 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:35.881026 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-479f1a13-f3cd-4cf9-bde4-0055ce5e3b40 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:35.881960 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-479f1a13-f3cd-4cf9-bde4-0055ce5e3b40 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:35.883184 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-479f1a13-f3cd-4cf9-bde4-0055ce5e3b40 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:35.883769 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-479f1a13-f3cd-4cf9-bde4-0055ce5e3b40 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:35.914543 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-479f1a13-f3cd-4cf9-bde4-0055ce5e3b40 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] [instance: a8305358-1f82-4022-b511-8d3e3d445a92] Going to try to terminate instance {{(pid=128759) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:16:36.049776 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-479f1a13-f3cd-4cf9-bde4-0055ce5e3b40 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] 10.222.0.60 "DELETE /compute/v2.1/servers/a8305358-1f82-4022-b511-8d3e3d445a92" status: 204 len: 0 microversion: 2.1 time: 0.182674 Sep 14 09:16:36.050626 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2692/5402] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:16:35 2022] DELETE /compute/v2.1/servers/a8305358-1f82-4022-b511-8d3e3d445a92 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:16:36.059975 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-65bdd037-17d6-47c7-8093-157983a622b2 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:36.060900 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-65bdd037-17d6-47c7-8093-157983a622b2 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] [instance: a8305358-1f82-4022-b511-8d3e3d445a92] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:36.077244 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-65bdd037-17d6-47c7-8093-157983a622b2 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:36.078446 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-65bdd037-17d6-47c7-8093-157983a622b2 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:36.083586 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-65bdd037-17d6-47c7-8093-157983a622b2 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:36.084745 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-65bdd037-17d6-47c7-8093-157983a622b2 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:36.085472 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-65bdd037-17d6-47c7-8093-157983a622b2 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:36.086144 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-65bdd037-17d6-47c7-8093-157983a622b2 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:36.337460 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-65bdd037-17d6-47c7-8093-157983a622b2 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb33a017168c4a8bae36eacd9ba6a7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24f2e13835b240578d411521ee520115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:36.348740 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-65bdd037-17d6-47c7-8093-157983a622b2 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] 10.222.0.60 "GET /compute/v2.1/servers/a8305358-1f82-4022-b511-8d3e3d445a92" status: 200 len: 1504 microversion: 2.1 time: 0.293084 Sep 14 09:16:36.349862 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2711/5403] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:36 2022] GET /compute/v2.1/servers/a8305358-1f82-4022-b511-8d3e3d445a92 => generated 1504 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:36.843448 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-08882296-d3ed-47da-bd03-4415473f99d3 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:36.845244 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-08882296-d3ed-47da-bd03-4415473f99d3 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 907157a9-afff-4acb-98b7-b07b9c055ab1] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:36.859074 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-08882296-d3ed-47da-bd03-4415473f99d3 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:36.859865 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-08882296-d3ed-47da-bd03-4415473f99d3 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:36.860535 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-08882296-d3ed-47da-bd03-4415473f99d3 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:36.862219 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-08882296-d3ed-47da-bd03-4415473f99d3 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:36.863079 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-08882296-d3ed-47da-bd03-4415473f99d3 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:36.864351 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-08882296-d3ed-47da-bd03-4415473f99d3 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:36.886133 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-08882296-d3ed-47da-bd03-4415473f99d3 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] HTTP exception thrown: Instance 907157a9-afff-4acb-98b7-b07b9c055ab1 could not be found. Sep 14 09:16:36.888296 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-08882296-d3ed-47da-bd03-4415473f99d3 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Request method failure captured: Sep 14 09:16:36.888296 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/907157a9-afff-4acb-98b7-b07b9c055ab1 HTTP/1.1 Sep 14 09:16:36.888296 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:16:36.888296 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:16:36.888296 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:16:36.888296 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:16:36.888296 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:16:36.888296 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:16:36.888296 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:16:36.888296 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:16:36.888296 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZlbli-DUCcgcnIp82pgLH1MeZCUcHfkT5yyfUsmiHSxBD3c429y8-wgStj1whz8DzX2TZgyd3HgxP1s3YxgJlQF250cUgsVCoic4jlEyGeyIt_z0tJbq-ZVXxXpuOTFUrJr1sEtIyXnC0IrYNMyG6UkTPf7SAAui15bmxZyXWBXgjc Sep 14 09:16:36.888296 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:16:36.888296 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:16:36.888296 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:16:36.888296 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:16:36.888296 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:16:36.888296 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:16:36.888296 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 2f075a2c6aa4489abb3428e0a4ac5738 Sep 14 09:16:36.888296 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ServerActionsTestJSON-1840244566 Sep 14 09:16:36.888296 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:16:36.888296 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:16:36.888296 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/2f075a2c6aa4489abb3428e0a4ac5738"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_2f075a2c6aa4489abb3428e0a4ac5738"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2f075a2c6aa4489abb3428e0a4ac5738"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2f075a2c6aa4489abb3428e0a4ac5738"}]}] Sep 14 09:16:36.888296 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ServerActionsTestJSON-1840244566 Sep 14 09:16:36.888296 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 2f075a2c6aa4489abb3428e0a4ac5738 Sep 14 09:16:36.888296 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ServerActionsTestJSON-1840244566 Sep 14 09:16:36.888296 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ServerActionsTestJSON-1840244566-project Sep 14 09:16:36.888296 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:16:36.888296 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:16:36.888296 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 950da33830ae4ae1a5511dd146e4e3be Sep 14 09:16:36.888296 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ServerActionsTestJSON-1840244566-project Sep 14 09:16:36.888296 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:16:36.888296 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance 907157a9-afff-4acb-98b7-b07b9c055ab1 could not be found. Sep 14 09:16:36.888296 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '907157a9-afff-4acb-98b7-b07b9c055ab1'} Sep 14 09:16:36.888296 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:16:36.888296 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:16:36.888296 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:16:36.888296 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:16:36.888296 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:16:36.888296 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:16:36.888296 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:16:36.888296 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:16:36.888296 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:16:36.888296 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:16:36.888296 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 907157a9-afff-4acb-98b7-b07b9c055ab1 could not be found. Sep 14 09:16:36.888296 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:16:36.888296 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:16:36.888296 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:16:36.888296 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:16:36.888296 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:16:36.888296 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:16:36.888296 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:16:36.888296 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:16:36.888296 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:16:36.888296 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:16:36.888296 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:16:36.888296 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:16:36.888296 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:16:36.888296 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:16:36.888296 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:16:36.888296 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:16:36.888296 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 907157a9-afff-4acb-98b7-b07b9c055ab1 could not be found. Sep 14 09:16:36.888296 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:16:36.888296 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:16:36.888296 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:16:36.892434 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:16:36.892434 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:16:36.892434 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:16:36.892434 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:16:36.892434 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:16:36.892434 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 907157a9-afff-4acb-98b7-b07b9c055ab1 could not be found. Sep 14 09:16:36.892434 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:16:36.893781 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-08882296-d3ed-47da-bd03-4415473f99d3 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Returning 404 to user: Instance 907157a9-afff-4acb-98b7-b07b9c055ab1 could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:16:36.895007 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-08882296-d3ed-47da-bd03-4415473f99d3 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/907157a9-afff-4acb-98b7-b07b9c055ab1" status: 404 len: 111 microversion: 2.1 time: 0.056593 Sep 14 09:16:36.896105 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2693/5404] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:36 2022] GET /compute/v2.1/servers/907157a9-afff-4acb-98b7-b07b9c055ab1 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:16:36.905813 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d5719398-7245-4798-be98-e322cd69d282 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:36.906352 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-d5719398-7245-4798-be98-e322cd69d282 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 0ba2a1b2-907f-4598-931a-c6605ffe5682] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:36.913607 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d5719398-7245-4798-be98-e322cd69d282 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:36.914333 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d5719398-7245-4798-be98-e322cd69d282 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:36.915194 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d5719398-7245-4798-be98-e322cd69d282 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:36.916272 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d5719398-7245-4798-be98-e322cd69d282 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:36.916888 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d5719398-7245-4798-be98-e322cd69d282 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:36.917577 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d5719398-7245-4798-be98-e322cd69d282 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:36.949442 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-d5719398-7245-4798-be98-e322cd69d282 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 0ba2a1b2-907f-4598-931a-c6605ffe5682] Going to try to terminate instance {{(pid=128758) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:16:37.068762 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-d5719398-7245-4798-be98-e322cd69d282 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "DELETE /compute/v2.1/servers/0ba2a1b2-907f-4598-931a-c6605ffe5682" status: 204 len: 0 microversion: 2.1 time: 0.166552 Sep 14 09:16:37.074414 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2712/5405] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:16:36 2022] DELETE /compute/v2.1/servers/0ba2a1b2-907f-4598-931a-c6605ffe5682 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:16:37.080067 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e1ce788c-1252-4086-b6e4-2cf64eab9c61 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:37.081430 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e1ce788c-1252-4086-b6e4-2cf64eab9c61 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 0ba2a1b2-907f-4598-931a-c6605ffe5682] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:37.104327 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e1ce788c-1252-4086-b6e4-2cf64eab9c61 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:37.104842 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e1ce788c-1252-4086-b6e4-2cf64eab9c61 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:37.105295 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e1ce788c-1252-4086-b6e4-2cf64eab9c61 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:37.106139 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e1ce788c-1252-4086-b6e4-2cf64eab9c61 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:37.106522 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e1ce788c-1252-4086-b6e4-2cf64eab9c61 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:37.106987 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e1ce788c-1252-4086-b6e4-2cf64eab9c61 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:37.206370 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-7f4ca4b8-b7ae-4842-a8b0-a5f1e9566ceb tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:37.206981 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-7f4ca4b8-b7ae-4842-a8b0-a5f1e9566ceb tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] [instance: d42a47fc-3124-4479-aff4-e2a5ba888729] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:37.215831 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7f4ca4b8-b7ae-4842-a8b0-a5f1e9566ceb tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:37.216611 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7f4ca4b8-b7ae-4842-a8b0-a5f1e9566ceb tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:37.217356 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7f4ca4b8-b7ae-4842-a8b0-a5f1e9566ceb tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:37.218312 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7f4ca4b8-b7ae-4842-a8b0-a5f1e9566ceb tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:37.218921 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7f4ca4b8-b7ae-4842-a8b0-a5f1e9566ceb tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:37.219577 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7f4ca4b8-b7ae-4842-a8b0-a5f1e9566ceb tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:37.253191 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-7f4ca4b8-b7ae-4842-a8b0-a5f1e9566ceb tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] [instance: d42a47fc-3124-4479-aff4-e2a5ba888729] Going to try to terminate instance {{(pid=128758) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:16:37.298341 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=14,nova_cell1:DELETE=2,nova_cell1:INSERT=2 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:16:37.370197 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-e1ce788c-1252-4086-b6e4-2cf64eab9c61 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:37.378478 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-7f4ca4b8-b7ae-4842-a8b0-a5f1e9566ceb tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] 10.222.0.60 "DELETE /compute/v2.1/servers/d42a47fc-3124-4479-aff4-e2a5ba888729" status: 204 len: 0 microversion: 2.1 time: 0.176611 Sep 14 09:16:37.379921 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2713/5406] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:16:37 2022] DELETE /compute/v2.1/servers/d42a47fc-3124-4479-aff4-e2a5ba888729 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:16:37.385831 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e1ce788c-1252-4086-b6e4-2cf64eab9c61 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/0ba2a1b2-907f-4598-931a-c6605ffe5682" status: 200 len: 1507 microversion: 2.1 time: 0.310844 Sep 14 09:16:37.386085 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-08873e76-185c-4926-9b82-4f86b6c9e0de req-d25f5da1-adf0-4662-b6d6-8ccaad005fdf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d42a47fc-3124-4479-aff4-e2a5ba888729", "tag": "4f2597fa-7f1f-432b-bf54-eb3d836a36dd"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:16:37.388259 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2694/5407] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:37 2022] GET /compute/v2.1/servers/0ba2a1b2-907f-4598-931a-c6605ffe5682 => generated 1507 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:37.410668 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-98b4f1c3-9710-4cff-95b7-f490a0179b01 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:37.411500 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-98b4f1c3-9710-4cff-95b7-f490a0179b01 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] [instance: a8305358-1f82-4022-b511-8d3e3d445a92] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:37.414522 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-08873e76-185c-4926-9b82-4f86b6c9e0de req-d25f5da1-adf0-4662-b6d6-8ccaad005fdf service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:37.415041 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-08873e76-185c-4926-9b82-4f86b6c9e0de req-d25f5da1-adf0-4662-b6d6-8ccaad005fdf service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:37.415481 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-08873e76-185c-4926-9b82-4f86b6c9e0de req-d25f5da1-adf0-4662-b6d6-8ccaad005fdf service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:37.420305 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-98b4f1c3-9710-4cff-95b7-f490a0179b01 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:37.421052 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-98b4f1c3-9710-4cff-95b7-f490a0179b01 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:37.421640 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-98b4f1c3-9710-4cff-95b7-f490a0179b01 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:37.422462 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-98b4f1c3-9710-4cff-95b7-f490a0179b01 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:37.423077 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-98b4f1c3-9710-4cff-95b7-f490a0179b01 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:37.423610 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-98b4f1c3-9710-4cff-95b7-f490a0179b01 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:37.428168 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-08873e76-185c-4926-9b82-4f86b6c9e0de req-d25f5da1-adf0-4662-b6d6-8ccaad005fdf service nova] Creating event network-changed:4f2597fa-7f1f-432b-bf54-eb3d836a36dd for instance d42a47fc-3124-4479-aff4-e2a5ba888729 on n-h1-836830-18 Sep 14 09:16:37.433369 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-08873e76-185c-4926-9b82-4f86b6c9e0de req-d25f5da1-adf0-4662-b6d6-8ccaad005fdf service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051934 Sep 14 09:16:37.434145 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2714/5408] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:16:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:16:37.439442 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-aabdd8a4-7c28-4f12-a18d-9451f5545b90 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:37.440343 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-aabdd8a4-7c28-4f12-a18d-9451f5545b90 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] [instance: d42a47fc-3124-4479-aff4-e2a5ba888729] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:37.446902 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-aabdd8a4-7c28-4f12-a18d-9451f5545b90 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:37.447622 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-aabdd8a4-7c28-4f12-a18d-9451f5545b90 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:37.448212 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-aabdd8a4-7c28-4f12-a18d-9451f5545b90 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:37.449695 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-aabdd8a4-7c28-4f12-a18d-9451f5545b90 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:37.450555 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-aabdd8a4-7c28-4f12-a18d-9451f5545b90 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:37.451178 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-aabdd8a4-7c28-4f12-a18d-9451f5545b90 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:37.664184 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-98b4f1c3-9710-4cff-95b7-f490a0179b01 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb33a017168c4a8bae36eacd9ba6a7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24f2e13835b240578d411521ee520115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:37.674085 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-98b4f1c3-9710-4cff-95b7-f490a0179b01 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] 10.222.0.60 "GET /compute/v2.1/servers/a8305358-1f82-4022-b511-8d3e3d445a92" status: 200 len: 1504 microversion: 2.1 time: 0.285791 Sep 14 09:16:37.692120 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2695/5409] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:37 2022] GET /compute/v2.1/servers/a8305358-1f82-4022-b511-8d3e3d445a92 => generated 1504 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:37.713590 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-aabdd8a4-7c28-4f12-a18d-9451f5545b90 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17918433a3994b69a65999a59a7f833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b73b20f2042c6a08f94ed23ff66e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:37.721603 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-aabdd8a4-7c28-4f12-a18d-9451f5545b90 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] 10.222.0.60 "GET /compute/v2.1/servers/d42a47fc-3124-4479-aff4-e2a5ba888729" status: 200 len: 1670 microversion: 2.1 time: 0.286322 Sep 14 09:16:37.722189 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2715/5410] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:37 2022] GET /compute/v2.1/servers/d42a47fc-3124-4479-aff4-e2a5ba888729 => generated 1670 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:38.416120 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-5b76e715-ee85-4ab0-9eae-596fe52c2bc4 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:38.416741 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-5b76e715-ee85-4ab0-9eae-596fe52c2bc4 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 0ba2a1b2-907f-4598-931a-c6605ffe5682] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:38.425008 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5b76e715-ee85-4ab0-9eae-596fe52c2bc4 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:38.425497 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5b76e715-ee85-4ab0-9eae-596fe52c2bc4 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:38.425929 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5b76e715-ee85-4ab0-9eae-596fe52c2bc4 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:38.426626 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5b76e715-ee85-4ab0-9eae-596fe52c2bc4 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:38.427117 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5b76e715-ee85-4ab0-9eae-596fe52c2bc4 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:38.427544 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5b76e715-ee85-4ab0-9eae-596fe52c2bc4 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:38.564873 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-5b76e715-ee85-4ab0-9eae-596fe52c2bc4 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:38.574015 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-5b76e715-ee85-4ab0-9eae-596fe52c2bc4 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/0ba2a1b2-907f-4598-931a-c6605ffe5682" status: 200 len: 1507 microversion: 2.1 time: 0.161688 Sep 14 09:16:38.574518 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2696/5411] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:38 2022] GET /compute/v2.1/servers/0ba2a1b2-907f-4598-931a-c6605ffe5682 => generated 1507 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:38.698568 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d683be8a-f26c-4857-ac2f-96c5f2fa27ef tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:38.699229 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-d683be8a-f26c-4857-ac2f-96c5f2fa27ef tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] [instance: a8305358-1f82-4022-b511-8d3e3d445a92] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:38.706203 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d683be8a-f26c-4857-ac2f-96c5f2fa27ef tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:38.706665 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d683be8a-f26c-4857-ac2f-96c5f2fa27ef tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:38.707317 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d683be8a-f26c-4857-ac2f-96c5f2fa27ef tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:38.708494 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d683be8a-f26c-4857-ac2f-96c5f2fa27ef tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:38.708960 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d683be8a-f26c-4857-ac2f-96c5f2fa27ef tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:38.709395 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d683be8a-f26c-4857-ac2f-96c5f2fa27ef tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:38.746597 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-53cbc210-9a8f-4d83-b67c-fbcf8cabfcbe tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:38.747461 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-53cbc210-9a8f-4d83-b67c-fbcf8cabfcbe tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] [instance: d42a47fc-3124-4479-aff4-e2a5ba888729] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:38.753767 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-53cbc210-9a8f-4d83-b67c-fbcf8cabfcbe tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:38.754583 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-53cbc210-9a8f-4d83-b67c-fbcf8cabfcbe tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:38.755369 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-53cbc210-9a8f-4d83-b67c-fbcf8cabfcbe tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:38.756280 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-53cbc210-9a8f-4d83-b67c-fbcf8cabfcbe tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:38.756825 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-53cbc210-9a8f-4d83-b67c-fbcf8cabfcbe tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:38.757962 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-53cbc210-9a8f-4d83-b67c-fbcf8cabfcbe tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:38.781458 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:16:38.904411 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-d683be8a-f26c-4857-ac2f-96c5f2fa27ef tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb33a017168c4a8bae36eacd9ba6a7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24f2e13835b240578d411521ee520115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:38.914222 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-d683be8a-f26c-4857-ac2f-96c5f2fa27ef tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] 10.222.0.60 "GET /compute/v2.1/servers/a8305358-1f82-4022-b511-8d3e3d445a92" status: 200 len: 1504 microversion: 2.1 time: 0.220315 Sep 14 09:16:38.914834 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2716/5412] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:38 2022] GET /compute/v2.1/servers/a8305358-1f82-4022-b511-8d3e3d445a92 => generated 1504 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:16:38.953386 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-53cbc210-9a8f-4d83-b67c-fbcf8cabfcbe tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17918433a3994b69a65999a59a7f833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b73b20f2042c6a08f94ed23ff66e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:38.963399 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-53cbc210-9a8f-4d83-b67c-fbcf8cabfcbe tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] 10.222.0.60 "GET /compute/v2.1/servers/d42a47fc-3124-4479-aff4-e2a5ba888729" status: 200 len: 1670 microversion: 2.1 time: 0.221083 Sep 14 09:16:38.974996 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2697/5413] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:38 2022] GET /compute/v2.1/servers/d42a47fc-3124-4479-aff4-e2a5ba888729 => generated 1670 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:16:39.496309 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-23d87173-7fee-427b-8fd1-7f0690e8afbc req-8426400f-27b3-4f86-aee2-e3e3c3b0030e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8305358-1f82-4022-b511-8d3e3d445a92", "name": "network-vif-deleted", "tag": "8565d189-2e08-43da-9cd2-6cbe981a8d3a"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:16:39.506667 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-23d87173-7fee-427b-8fd1-7f0690e8afbc req-8426400f-27b3-4f86-aee2-e3e3c3b0030e service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:39.507877 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-23d87173-7fee-427b-8fd1-7f0690e8afbc req-8426400f-27b3-4f86-aee2-e3e3c3b0030e service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:39.508310 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-23d87173-7fee-427b-8fd1-7f0690e8afbc req-8426400f-27b3-4f86-aee2-e3e3c3b0030e service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:39.521208 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-23d87173-7fee-427b-8fd1-7f0690e8afbc req-8426400f-27b3-4f86-aee2-e3e3c3b0030e service nova] Creating event network-vif-deleted:8565d189-2e08-43da-9cd2-6cbe981a8d3a for instance a8305358-1f82-4022-b511-8d3e3d445a92 on n-h2-836830-18 Sep 14 09:16:39.527389 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-23d87173-7fee-427b-8fd1-7f0690e8afbc req-8426400f-27b3-4f86-aee2-e3e3c3b0030e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034689 Sep 14 09:16:39.528231 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2717/5414] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:16:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:16:39.597626 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-5d39709d-35e3-42da-ab53-651ce703a555 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:39.599004 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-5d39709d-35e3-42da-ab53-651ce703a555 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 0ba2a1b2-907f-4598-931a-c6605ffe5682] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:39.614529 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5d39709d-35e3-42da-ab53-651ce703a555 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:39.614857 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5d39709d-35e3-42da-ab53-651ce703a555 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:39.615335 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5d39709d-35e3-42da-ab53-651ce703a555 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:39.616035 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5d39709d-35e3-42da-ab53-651ce703a555 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:39.616580 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5d39709d-35e3-42da-ab53-651ce703a555 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:39.616969 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5d39709d-35e3-42da-ab53-651ce703a555 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:39.853060 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-5d39709d-35e3-42da-ab53-651ce703a555 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:39.864179 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-5d39709d-35e3-42da-ab53-651ce703a555 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/0ba2a1b2-907f-4598-931a-c6605ffe5682" status: 200 len: 1507 microversion: 2.1 time: 0.270369 Sep 14 09:16:39.865396 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2698/5415] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:39 2022] GET /compute/v2.1/servers/0ba2a1b2-907f-4598-931a-c6605ffe5682 => generated 1507 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:39.939654 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-9fe2e4d5-87fb-4bfa-b820-cbafac90dabb tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:39.941472 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-9fe2e4d5-87fb-4bfa-b820-cbafac90dabb tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] [instance: a8305358-1f82-4022-b511-8d3e3d445a92] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:39.952103 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9fe2e4d5-87fb-4bfa-b820-cbafac90dabb tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:39.952884 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9fe2e4d5-87fb-4bfa-b820-cbafac90dabb tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:39.953662 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9fe2e4d5-87fb-4bfa-b820-cbafac90dabb tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:39.954542 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9fe2e4d5-87fb-4bfa-b820-cbafac90dabb tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:39.955329 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9fe2e4d5-87fb-4bfa-b820-cbafac90dabb tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:39.955913 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9fe2e4d5-87fb-4bfa-b820-cbafac90dabb tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:39.994393 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ff9efeea-5967-436c-a937-3c55603f19ca tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:39.996112 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-ff9efeea-5967-436c-a937-3c55603f19ca tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] [instance: d42a47fc-3124-4479-aff4-e2a5ba888729] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:39.998826 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:16:40.011498 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ff9efeea-5967-436c-a937-3c55603f19ca tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:40.014007 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ff9efeea-5967-436c-a937-3c55603f19ca tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:40.014488 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ff9efeea-5967-436c-a937-3c55603f19ca tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:40.015230 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ff9efeea-5967-436c-a937-3c55603f19ca tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:40.015842 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ff9efeea-5967-436c-a937-3c55603f19ca tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:40.016283 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ff9efeea-5967-436c-a937-3c55603f19ca tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:40.026008 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9fe2e4d5-87fb-4bfa-b820-cbafac90dabb tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:40.026687 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9fe2e4d5-87fb-4bfa-b820-cbafac90dabb tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:40.027332 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9fe2e4d5-87fb-4bfa-b820-cbafac90dabb tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:40.028149 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.objects.instance [None req-9fe2e4d5-87fb-4bfa-b820-cbafac90dabb tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lazy-loading 'fault' on Instance uuid a8305358-1f82-4022-b511-8d3e3d445a92 {{(pid=128758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:16:40.129599 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-9fe2e4d5-87fb-4bfa-b820-cbafac90dabb tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb33a017168c4a8bae36eacd9ba6a7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24f2e13835b240578d411521ee520115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:40.140679 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-9fe2e4d5-87fb-4bfa-b820-cbafac90dabb tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] 10.222.0.60 "GET /compute/v2.1/servers/a8305358-1f82-4022-b511-8d3e3d445a92" status: 200 len: 1303 microversion: 2.1 time: 0.206533 Sep 14 09:16:40.141084 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2718/5416] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:39 2022] GET /compute/v2.1/servers/a8305358-1f82-4022-b511-8d3e3d445a92 => generated 1303 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:40.226665 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-ff9efeea-5967-436c-a937-3c55603f19ca tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17918433a3994b69a65999a59a7f833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b73b20f2042c6a08f94ed23ff66e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:40.235311 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-ff9efeea-5967-436c-a937-3c55603f19ca tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] 10.222.0.60 "GET /compute/v2.1/servers/d42a47fc-3124-4479-aff4-e2a5ba888729" status: 200 len: 1670 microversion: 2.1 time: 0.251152 Sep 14 09:16:40.235909 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2699/5417] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:39 2022] GET /compute/v2.1/servers/d42a47fc-3124-4479-aff4-e2a5ba888729 => generated 1670 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:40.890806 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-3fedd127-d53c-4871-b432-7515e515b62f tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:40.892506 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-3fedd127-d53c-4871-b432-7515e515b62f tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 0ba2a1b2-907f-4598-931a-c6605ffe5682] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:40.901170 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3fedd127-d53c-4871-b432-7515e515b62f tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:40.901864 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3fedd127-d53c-4871-b432-7515e515b62f tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:40.902777 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3fedd127-d53c-4871-b432-7515e515b62f tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:40.904302 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3fedd127-d53c-4871-b432-7515e515b62f tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:40.905085 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3fedd127-d53c-4871-b432-7515e515b62f tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:40.905732 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3fedd127-d53c-4871-b432-7515e515b62f tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:40.947436 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3fedd127-d53c-4871-b432-7515e515b62f tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:40.948762 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3fedd127-d53c-4871-b432-7515e515b62f tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:40.949484 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3fedd127-d53c-4871-b432-7515e515b62f tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:40.950282 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.objects.instance [None req-3fedd127-d53c-4871-b432-7515e515b62f tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lazy-loading 'fault' on Instance uuid 0ba2a1b2-907f-4598-931a-c6605ffe5682 {{(pid=128758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:16:41.001755 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-3fedd127-d53c-4871-b432-7515e515b62f tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:41.013909 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-3fedd127-d53c-4871-b432-7515e515b62f tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/0ba2a1b2-907f-4598-931a-c6605ffe5682" status: 200 len: 1304 microversion: 2.1 time: 0.125680 Sep 14 09:16:41.027926 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2719/5418] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:40 2022] GET /compute/v2.1/servers/0ba2a1b2-907f-4598-931a-c6605ffe5682 => generated 1304 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:41.164682 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c6cadc5b-1b49-4d11-ac60-d17f8f4aac0d tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:41.166063 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-c6cadc5b-1b49-4d11-ac60-d17f8f4aac0d tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] [instance: a8305358-1f82-4022-b511-8d3e3d445a92] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:41.174368 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c6cadc5b-1b49-4d11-ac60-d17f8f4aac0d tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:41.174889 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c6cadc5b-1b49-4d11-ac60-d17f8f4aac0d tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:41.175640 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c6cadc5b-1b49-4d11-ac60-d17f8f4aac0d tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:41.176376 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c6cadc5b-1b49-4d11-ac60-d17f8f4aac0d tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:41.176962 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c6cadc5b-1b49-4d11-ac60-d17f8f4aac0d tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:41.177465 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c6cadc5b-1b49-4d11-ac60-d17f8f4aac0d tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:41.194001 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-c6cadc5b-1b49-4d11-ac60-d17f8f4aac0d tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] HTTP exception thrown: Instance a8305358-1f82-4022-b511-8d3e3d445a92 could not be found. Sep 14 09:16:41.196839 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c6cadc5b-1b49-4d11-ac60-d17f8f4aac0d tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Request method failure captured: Sep 14 09:16:41.196839 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/a8305358-1f82-4022-b511-8d3e3d445a92 HTTP/1.1 Sep 14 09:16:41.196839 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:16:41.196839 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:16:41.196839 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:16:41.196839 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:16:41.196839 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:16:41.196839 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:16:41.196839 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:16:41.196839 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:16:41.196839 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZt446FviltuOnCGiDNcekFU9GpfP61usS3Hz93kQVGcyEnyFjCYYKNU-_kaLKg3GyyHwWALSCjdD985jUIBDhZ6IiQ_k1elSdy4cOTAKHmrQXu9WL2A8xY5U6qBze4d-QAuwAnppzzGGSQ7AHpl1L2hJiC-GfzH262HlSkIIHg_hos Sep 14 09:16:41.196839 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:16:41.196839 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:16:41.196839 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:16:41.196839 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:16:41.196839 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:16:41.196839 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:16:41.196839 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 24f2e13835b240578d411521ee520115 Sep 14 09:16:41.196839 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ServerRescueTestJSON-1061299090 Sep 14 09:16:41.196839 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:16:41.196839 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:16:41.196839 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/24f2e13835b240578d411521ee520115"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_24f2e13835b240578d411521ee520115"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/24f2e13835b240578d411521ee520115"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/24f2e13835b240578d411521ee520115"}]}] Sep 14 09:16:41.196839 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ServerRescueTestJSON-1061299090 Sep 14 09:16:41.196839 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 24f2e13835b240578d411521ee520115 Sep 14 09:16:41.196839 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ServerRescueTestJSON-1061299090 Sep 14 09:16:41.196839 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ServerRescueTestJSON-1061299090-project Sep 14 09:16:41.196839 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:16:41.196839 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:16:41.196839 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: bb33a017168c4a8bae36eacd9ba6a7ac Sep 14 09:16:41.196839 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ServerRescueTestJSON-1061299090-project Sep 14 09:16:41.196839 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:16:41.196839 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance a8305358-1f82-4022-b511-8d3e3d445a92 could not be found. Sep 14 09:16:41.196839 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': 'a8305358-1f82-4022-b511-8d3e3d445a92'} Sep 14 09:16:41.196839 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:16:41.196839 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:16:41.196839 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:16:41.196839 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:16:41.196839 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:16:41.196839 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:16:41.196839 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:16:41.196839 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:16:41.196839 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:16:41.196839 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:16:41.196839 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8305358-1f82-4022-b511-8d3e3d445a92 could not be found. Sep 14 09:16:41.196839 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:16:41.196839 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:16:41.196839 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:16:41.196839 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:16:41.196839 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:16:41.196839 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:16:41.196839 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:16:41.196839 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:16:41.196839 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:16:41.196839 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:16:41.196839 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:16:41.196839 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:16:41.196839 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:16:41.196839 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:16:41.196839 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:16:41.196839 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:16:41.196839 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8305358-1f82-4022-b511-8d3e3d445a92 could not be found. Sep 14 09:16:41.196839 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:16:41.196839 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:16:41.196839 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:16:41.200667 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:16:41.200667 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:16:41.200667 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:16:41.200667 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:16:41.200667 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:16:41.200667 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8305358-1f82-4022-b511-8d3e3d445a92 could not be found. Sep 14 09:16:41.200667 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:16:41.200667 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c6cadc5b-1b49-4d11-ac60-d17f8f4aac0d tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Returning 404 to user: Instance a8305358-1f82-4022-b511-8d3e3d445a92 could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:16:41.200667 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-c6cadc5b-1b49-4d11-ac60-d17f8f4aac0d tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] 10.222.0.60 "GET /compute/v2.1/servers/a8305358-1f82-4022-b511-8d3e3d445a92" status: 404 len: 111 microversion: 2.1 time: 0.038001 Sep 14 09:16:41.200667 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2700/5419] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:41 2022] GET /compute/v2.1/servers/a8305358-1f82-4022-b511-8d3e3d445a92 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:16:41.211507 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-481104fc-a930-47eb-9312-e5a96c8079ef tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:41.212257 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-481104fc-a930-47eb-9312-e5a96c8079ef tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] [instance: cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:41.240504 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-481104fc-a930-47eb-9312-e5a96c8079ef tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:41.241044 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-481104fc-a930-47eb-9312-e5a96c8079ef tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:41.242057 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-481104fc-a930-47eb-9312-e5a96c8079ef tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:41.242807 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-481104fc-a930-47eb-9312-e5a96c8079ef tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:41.243396 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-481104fc-a930-47eb-9312-e5a96c8079ef tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:41.243711 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-481104fc-a930-47eb-9312-e5a96c8079ef tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:41.259932 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-cefd3889-b1c4-4a4b-8fb3-5dfdb0f3d481 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:41.260880 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-cefd3889-b1c4-4a4b-8fb3-5dfdb0f3d481 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] [instance: d42a47fc-3124-4479-aff4-e2a5ba888729] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:41.267588 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cefd3889-b1c4-4a4b-8fb3-5dfdb0f3d481 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:41.268077 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cefd3889-b1c4-4a4b-8fb3-5dfdb0f3d481 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:41.268782 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cefd3889-b1c4-4a4b-8fb3-5dfdb0f3d481 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:41.269588 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cefd3889-b1c4-4a4b-8fb3-5dfdb0f3d481 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:41.270119 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cefd3889-b1c4-4a4b-8fb3-5dfdb0f3d481 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:41.270620 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cefd3889-b1c4-4a4b-8fb3-5dfdb0f3d481 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:41.305503 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-481104fc-a930-47eb-9312-e5a96c8079ef tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] [instance: cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f] Going to try to terminate instance {{(pid=128758) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:16:41.311255 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cefd3889-b1c4-4a4b-8fb3-5dfdb0f3d481 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:41.312005 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cefd3889-b1c4-4a4b-8fb3-5dfdb0f3d481 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:41.312780 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cefd3889-b1c4-4a4b-8fb3-5dfdb0f3d481 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:41.313447 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.objects.instance [None req-cefd3889-b1c4-4a4b-8fb3-5dfdb0f3d481 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lazy-loading 'fault' on Instance uuid d42a47fc-3124-4479-aff4-e2a5ba888729 {{(pid=128759) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:16:41.367454 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-cefd3889-b1c4-4a4b-8fb3-5dfdb0f3d481 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17918433a3994b69a65999a59a7f833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b73b20f2042c6a08f94ed23ff66e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:41.389490 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-cefd3889-b1c4-4a4b-8fb3-5dfdb0f3d481 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] 10.222.0.60 "GET /compute/v2.1/servers/d42a47fc-3124-4479-aff4-e2a5ba888729" status: 200 len: 1488 microversion: 2.1 time: 0.133900 Sep 14 09:16:41.390135 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2701/5420] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:41 2022] GET /compute/v2.1/servers/d42a47fc-3124-4479-aff4-e2a5ba888729 => generated 1488 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:41.419976 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-481104fc-a930-47eb-9312-e5a96c8079ef tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] 10.222.0.60 "DELETE /compute/v2.1/servers/cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f" status: 204 len: 0 microversion: 2.1 time: 0.213841 Sep 14 09:16:41.420782 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2720/5421] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:16:41 2022] DELETE /compute/v2.1/servers/cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f => generated 0 bytes in 216 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:16:41.430731 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e0d18054-7801-4ece-ba82-105af88d6272 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:41.431840 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e0d18054-7801-4ece-ba82-105af88d6272 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] [instance: cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:41.445585 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e0d18054-7801-4ece-ba82-105af88d6272 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:41.446076 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e0d18054-7801-4ece-ba82-105af88d6272 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:41.447126 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e0d18054-7801-4ece-ba82-105af88d6272 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:41.447841 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e0d18054-7801-4ece-ba82-105af88d6272 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:41.448631 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e0d18054-7801-4ece-ba82-105af88d6272 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:41.449072 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e0d18054-7801-4ece-ba82-105af88d6272 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:41.545834 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-1d3a6e1c-c121-4f31-81d4-213bfcea06b4 req-1b237703-dcbe-465c-8105-acedfed4fa68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ba2a1b2-907f-4598-931a-c6605ffe5682", "name": "network-vif-deleted", "tag": "fbe17787-eb51-420c-a0a5-759d340dee8c"}, {"server_uuid": "d42a47fc-3124-4479-aff4-e2a5ba888729", "name": "network-vif-deleted", "tag": "4f2597fa-7f1f-432b-bf54-eb3d836a36dd"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:16:41.559705 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-1d3a6e1c-c121-4f31-81d4-213bfcea06b4 req-1b237703-dcbe-465c-8105-acedfed4fa68 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:41.560758 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-1d3a6e1c-c121-4f31-81d4-213bfcea06b4 req-1b237703-dcbe-465c-8105-acedfed4fa68 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:41.561578 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-1d3a6e1c-c121-4f31-81d4-213bfcea06b4 req-1b237703-dcbe-465c-8105-acedfed4fa68 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:41.582343 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-1d3a6e1c-c121-4f31-81d4-213bfcea06b4 req-1b237703-dcbe-465c-8105-acedfed4fa68 service nova] Creating event network-vif-deleted:fbe17787-eb51-420c-a0a5-759d340dee8c for instance 0ba2a1b2-907f-4598-931a-c6605ffe5682 on n-h1-836830-18 Sep 14 09:16:41.583537 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-1d3a6e1c-c121-4f31-81d4-213bfcea06b4 req-1b237703-dcbe-465c-8105-acedfed4fa68 service nova] Creating event network-vif-deleted:4f2597fa-7f1f-432b-bf54-eb3d836a36dd for instance d42a47fc-3124-4479-aff4-e2a5ba888729 on n-h1-836830-18 Sep 14 09:16:41.592018 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-1d3a6e1c-c121-4f31-81d4-213bfcea06b4 req-1b237703-dcbe-465c-8105-acedfed4fa68 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.051550 Sep 14 09:16:41.596869 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2721/5422] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:16:41 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:16:41.607243 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-e0d18054-7801-4ece-ba82-105af88d6272 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb33a017168c4a8bae36eacd9ba6a7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24f2e13835b240578d411521ee520115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:41.615592 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e0d18054-7801-4ece-ba82-105af88d6272 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] 10.222.0.60 "GET /compute/v2.1/servers/cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f" status: 200 len: 1491 microversion: 2.1 time: 0.190395 Sep 14 09:16:41.616177 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2702/5423] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:41 2022] GET /compute/v2.1/servers/cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f => generated 1491 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:42.042945 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-6b276b56-24f0-42fe-9cba-cc6b7fbad063 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:42.043713 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-6b276b56-24f0-42fe-9cba-cc6b7fbad063 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 0ba2a1b2-907f-4598-931a-c6605ffe5682] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:42.050194 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6b276b56-24f0-42fe-9cba-cc6b7fbad063 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:42.050685 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6b276b56-24f0-42fe-9cba-cc6b7fbad063 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:42.051167 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6b276b56-24f0-42fe-9cba-cc6b7fbad063 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:42.051885 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6b276b56-24f0-42fe-9cba-cc6b7fbad063 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:42.052345 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6b276b56-24f0-42fe-9cba-cc6b7fbad063 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:42.052773 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6b276b56-24f0-42fe-9cba-cc6b7fbad063 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:42.088107 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6b276b56-24f0-42fe-9cba-cc6b7fbad063 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:42.088602 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6b276b56-24f0-42fe-9cba-cc6b7fbad063 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:42.089039 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6b276b56-24f0-42fe-9cba-cc6b7fbad063 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:42.089497 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.objects.instance [None req-6b276b56-24f0-42fe-9cba-cc6b7fbad063 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lazy-loading 'fault' on Instance uuid 0ba2a1b2-907f-4598-931a-c6605ffe5682 {{(pid=128758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:16:42.131009 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-6b276b56-24f0-42fe-9cba-cc6b7fbad063 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:42.139732 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-6b276b56-24f0-42fe-9cba-cc6b7fbad063 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/0ba2a1b2-907f-4598-931a-c6605ffe5682" status: 200 len: 1304 microversion: 2.1 time: 0.102425 Sep 14 09:16:42.140339 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2722/5424] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:42 2022] GET /compute/v2.1/servers/0ba2a1b2-907f-4598-931a-c6605ffe5682 => generated 1304 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:42.412259 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-5215d43d-5dc0-4860-a1e7-5cfb44e40fe1 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:42.413196 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-5215d43d-5dc0-4860-a1e7-5cfb44e40fe1 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] [instance: d42a47fc-3124-4479-aff4-e2a5ba888729] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:42.420394 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5215d43d-5dc0-4860-a1e7-5cfb44e40fe1 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:42.420883 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5215d43d-5dc0-4860-a1e7-5cfb44e40fe1 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:42.421316 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5215d43d-5dc0-4860-a1e7-5cfb44e40fe1 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:42.422005 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5215d43d-5dc0-4860-a1e7-5cfb44e40fe1 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:42.422455 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5215d43d-5dc0-4860-a1e7-5cfb44e40fe1 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:42.422874 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5215d43d-5dc0-4860-a1e7-5cfb44e40fe1 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:42.456031 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5215d43d-5dc0-4860-a1e7-5cfb44e40fe1 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:42.456411 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5215d43d-5dc0-4860-a1e7-5cfb44e40fe1 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:42.457016 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5215d43d-5dc0-4860-a1e7-5cfb44e40fe1 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:42.457643 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.objects.instance [None req-5215d43d-5dc0-4860-a1e7-5cfb44e40fe1 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lazy-loading 'fault' on Instance uuid d42a47fc-3124-4479-aff4-e2a5ba888729 {{(pid=128759) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:16:42.499318 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-5215d43d-5dc0-4860-a1e7-5cfb44e40fe1 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17918433a3994b69a65999a59a7f833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b73b20f2042c6a08f94ed23ff66e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:42.509095 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-5215d43d-5dc0-4860-a1e7-5cfb44e40fe1 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] 10.222.0.60 "GET /compute/v2.1/servers/d42a47fc-3124-4479-aff4-e2a5ba888729" status: 200 len: 1488 microversion: 2.1 time: 0.100629 Sep 14 09:16:42.524041 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2703/5425] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:42 2022] GET /compute/v2.1/servers/d42a47fc-3124-4479-aff4-e2a5ba888729 => generated 1488 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:42.643564 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-17369f06-0ca3-4358-a13f-a215fe537319 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:42.647125 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-17369f06-0ca3-4358-a13f-a215fe537319 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] [instance: cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:42.672658 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-17369f06-0ca3-4358-a13f-a215fe537319 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:42.673200 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-17369f06-0ca3-4358-a13f-a215fe537319 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:42.673842 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-17369f06-0ca3-4358-a13f-a215fe537319 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:42.674569 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-17369f06-0ca3-4358-a13f-a215fe537319 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:42.675067 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-17369f06-0ca3-4358-a13f-a215fe537319 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:42.675654 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-17369f06-0ca3-4358-a13f-a215fe537319 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:42.835006 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-17369f06-0ca3-4358-a13f-a215fe537319 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb33a017168c4a8bae36eacd9ba6a7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24f2e13835b240578d411521ee520115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:42.846018 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-17369f06-0ca3-4358-a13f-a215fe537319 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] 10.222.0.60 "GET /compute/v2.1/servers/cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f" status: 200 len: 1491 microversion: 2.1 time: 0.210245 Sep 14 09:16:42.846865 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2723/5426] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:42 2022] GET /compute/v2.1/servers/cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f => generated 1491 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:43.163637 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a2e5a7eb-670e-44ba-a4d7-fb5534bba091 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:43.164318 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-a2e5a7eb-670e-44ba-a4d7-fb5534bba091 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 0ba2a1b2-907f-4598-931a-c6605ffe5682] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:43.170444 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a2e5a7eb-670e-44ba-a4d7-fb5534bba091 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:43.170928 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a2e5a7eb-670e-44ba-a4d7-fb5534bba091 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:43.171396 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a2e5a7eb-670e-44ba-a4d7-fb5534bba091 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:43.172110 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a2e5a7eb-670e-44ba-a4d7-fb5534bba091 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:43.172587 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a2e5a7eb-670e-44ba-a4d7-fb5534bba091 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:43.173009 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a2e5a7eb-670e-44ba-a4d7-fb5534bba091 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:43.207769 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a2e5a7eb-670e-44ba-a4d7-fb5534bba091 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:43.208237 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a2e5a7eb-670e-44ba-a4d7-fb5534bba091 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:43.208676 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a2e5a7eb-670e-44ba-a4d7-fb5534bba091 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:43.209117 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.objects.instance [None req-a2e5a7eb-670e-44ba-a4d7-fb5534bba091 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lazy-loading 'fault' on Instance uuid 0ba2a1b2-907f-4598-931a-c6605ffe5682 {{(pid=128759) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:16:43.261915 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-a2e5a7eb-670e-44ba-a4d7-fb5534bba091 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:43.270895 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a2e5a7eb-670e-44ba-a4d7-fb5534bba091 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/0ba2a1b2-907f-4598-931a-c6605ffe5682" status: 200 len: 1304 microversion: 2.1 time: 0.111606 Sep 14 09:16:43.271522 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2704/5427] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:43 2022] GET /compute/v2.1/servers/0ba2a1b2-907f-4598-931a-c6605ffe5682 => generated 1304 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:43.533816 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-62eeab00-0390-4779-9403-2429111ff228 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:43.534517 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-62eeab00-0390-4779-9403-2429111ff228 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] [instance: d42a47fc-3124-4479-aff4-e2a5ba888729] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:43.542664 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-62eeab00-0390-4779-9403-2429111ff228 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:43.543204 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-62eeab00-0390-4779-9403-2429111ff228 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:43.543653 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-62eeab00-0390-4779-9403-2429111ff228 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:43.544520 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-62eeab00-0390-4779-9403-2429111ff228 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:43.544989 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-62eeab00-0390-4779-9403-2429111ff228 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:43.545421 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-62eeab00-0390-4779-9403-2429111ff228 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:43.582677 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-62eeab00-0390-4779-9403-2429111ff228 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:43.583212 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-62eeab00-0390-4779-9403-2429111ff228 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:43.583704 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-62eeab00-0390-4779-9403-2429111ff228 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:43.584287 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.objects.instance [None req-62eeab00-0390-4779-9403-2429111ff228 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lazy-loading 'fault' on Instance uuid d42a47fc-3124-4479-aff4-e2a5ba888729 {{(pid=128758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:16:43.625791 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-62eeab00-0390-4779-9403-2429111ff228 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17918433a3994b69a65999a59a7f833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b73b20f2042c6a08f94ed23ff66e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:43.634356 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-62eeab00-0390-4779-9403-2429111ff228 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] 10.222.0.60 "GET /compute/v2.1/servers/d42a47fc-3124-4479-aff4-e2a5ba888729" status: 200 len: 1488 microversion: 2.1 time: 0.104731 Sep 14 09:16:43.635025 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2724/5428] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:43 2022] GET /compute/v2.1/servers/d42a47fc-3124-4479-aff4-e2a5ba888729 => generated 1488 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:43.869661 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-4ed210ac-42c2-4eb3-a126-697a21a4040a tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:43.870290 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-4ed210ac-42c2-4eb3-a126-697a21a4040a tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] [instance: cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:43.877338 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4ed210ac-42c2-4eb3-a126-697a21a4040a tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:43.877843 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4ed210ac-42c2-4eb3-a126-697a21a4040a tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:43.878353 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4ed210ac-42c2-4eb3-a126-697a21a4040a tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:43.879009 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4ed210ac-42c2-4eb3-a126-697a21a4040a tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:43.879472 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4ed210ac-42c2-4eb3-a126-697a21a4040a tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:43.880360 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4ed210ac-42c2-4eb3-a126-697a21a4040a tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:44.031681 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-4ed210ac-42c2-4eb3-a126-697a21a4040a tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb33a017168c4a8bae36eacd9ba6a7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24f2e13835b240578d411521ee520115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:44.039785 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-4ed210ac-42c2-4eb3-a126-697a21a4040a tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] 10.222.0.60 "GET /compute/v2.1/servers/cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f" status: 200 len: 1491 microversion: 2.1 time: 0.174019 Sep 14 09:16:44.040727 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2705/5429] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:43 2022] GET /compute/v2.1/servers/cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f => generated 1491 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:44.294837 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-36454541-52d6-493c-bcf2-4c1ed50026b5 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:44.295766 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-36454541-52d6-493c-bcf2-4c1ed50026b5 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 0ba2a1b2-907f-4598-931a-c6605ffe5682] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:44.302117 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-36454541-52d6-493c-bcf2-4c1ed50026b5 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:44.302586 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-36454541-52d6-493c-bcf2-4c1ed50026b5 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:44.303060 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-36454541-52d6-493c-bcf2-4c1ed50026b5 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:44.303824 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-36454541-52d6-493c-bcf2-4c1ed50026b5 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:44.304961 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-36454541-52d6-493c-bcf2-4c1ed50026b5 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:44.305367 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-36454541-52d6-493c-bcf2-4c1ed50026b5 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:44.344956 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-36454541-52d6-493c-bcf2-4c1ed50026b5 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:44.345766 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-36454541-52d6-493c-bcf2-4c1ed50026b5 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:44.346533 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-36454541-52d6-493c-bcf2-4c1ed50026b5 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:44.346812 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.objects.instance [None req-36454541-52d6-493c-bcf2-4c1ed50026b5 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lazy-loading 'fault' on Instance uuid 0ba2a1b2-907f-4598-931a-c6605ffe5682 {{(pid=128758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:16:44.413679 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-36454541-52d6-493c-bcf2-4c1ed50026b5 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:44.424561 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-36454541-52d6-493c-bcf2-4c1ed50026b5 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/0ba2a1b2-907f-4598-931a-c6605ffe5682" status: 200 len: 1304 microversion: 2.1 time: 0.133728 Sep 14 09:16:44.426121 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2725/5430] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:44 2022] GET /compute/v2.1/servers/0ba2a1b2-907f-4598-931a-c6605ffe5682 => generated 1304 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:44.660289 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f41a7ef5-1947-4b0b-9de5-6b5321f955ed tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:44.660946 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f41a7ef5-1947-4b0b-9de5-6b5321f955ed tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] [instance: d42a47fc-3124-4479-aff4-e2a5ba888729] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:44.668111 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f41a7ef5-1947-4b0b-9de5-6b5321f955ed tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:44.668689 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f41a7ef5-1947-4b0b-9de5-6b5321f955ed tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:44.669209 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f41a7ef5-1947-4b0b-9de5-6b5321f955ed tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:44.669987 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f41a7ef5-1947-4b0b-9de5-6b5321f955ed tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:44.670543 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f41a7ef5-1947-4b0b-9de5-6b5321f955ed tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:44.671081 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f41a7ef5-1947-4b0b-9de5-6b5321f955ed tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:44.714301 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f41a7ef5-1947-4b0b-9de5-6b5321f955ed tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:44.715169 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f41a7ef5-1947-4b0b-9de5-6b5321f955ed tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:44.715844 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f41a7ef5-1947-4b0b-9de5-6b5321f955ed tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:44.716525 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.objects.instance [None req-f41a7ef5-1947-4b0b-9de5-6b5321f955ed tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lazy-loading 'fault' on Instance uuid d42a47fc-3124-4479-aff4-e2a5ba888729 {{(pid=128759) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:16:44.779689 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f41a7ef5-1947-4b0b-9de5-6b5321f955ed tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17918433a3994b69a65999a59a7f833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b73b20f2042c6a08f94ed23ff66e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:44.789798 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f41a7ef5-1947-4b0b-9de5-6b5321f955ed tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] 10.222.0.60 "GET /compute/v2.1/servers/d42a47fc-3124-4479-aff4-e2a5ba888729" status: 200 len: 1338 microversion: 2.1 time: 0.134184 Sep 14 09:16:44.791111 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2706/5431] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:44 2022] GET /compute/v2.1/servers/d42a47fc-3124-4479-aff4-e2a5ba888729 => generated 1338 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:45.063960 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-2e4a203a-9530-4125-954f-e7c1bb4f75d4 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:45.065672 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-2e4a203a-9530-4125-954f-e7c1bb4f75d4 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] [instance: cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:45.079148 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2e4a203a-9530-4125-954f-e7c1bb4f75d4 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:45.079750 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2e4a203a-9530-4125-954f-e7c1bb4f75d4 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:45.088882 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2e4a203a-9530-4125-954f-e7c1bb4f75d4 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:45.091803 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2e4a203a-9530-4125-954f-e7c1bb4f75d4 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:45.092481 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2e4a203a-9530-4125-954f-e7c1bb4f75d4 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:45.093074 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2e4a203a-9530-4125-954f-e7c1bb4f75d4 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:45.343301 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-2e4a203a-9530-4125-954f-e7c1bb4f75d4 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb33a017168c4a8bae36eacd9ba6a7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24f2e13835b240578d411521ee520115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:45.353918 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-2e4a203a-9530-4125-954f-e7c1bb4f75d4 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] 10.222.0.60 "GET /compute/v2.1/servers/cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f" status: 200 len: 1491 microversion: 2.1 time: 0.293779 Sep 14 09:16:45.368946 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2726/5432] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:45 2022] GET /compute/v2.1/servers/cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f => generated 1491 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:45.396506 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-6ec5550f-278a-4ac7-85b5-f770356a530f req-a82fc26f-2a80-4c18-b697-bc1bc6e7c5b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f", "name": "network-vif-deleted", "tag": "2344ca56-66c0-4a48-9202-1a4e7210fff4"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:16:45.407495 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-6ec5550f-278a-4ac7-85b5-f770356a530f req-a82fc26f-2a80-4c18-b697-bc1bc6e7c5b3 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:45.408694 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-6ec5550f-278a-4ac7-85b5-f770356a530f req-a82fc26f-2a80-4c18-b697-bc1bc6e7c5b3 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:45.408694 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-6ec5550f-278a-4ac7-85b5-f770356a530f req-a82fc26f-2a80-4c18-b697-bc1bc6e7c5b3 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:45.428397 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-6ec5550f-278a-4ac7-85b5-f770356a530f req-a82fc26f-2a80-4c18-b697-bc1bc6e7c5b3 service nova] Creating event network-vif-deleted:2344ca56-66c0-4a48-9202-1a4e7210fff4 for instance cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f on n-h1-836830-18 Sep 14 09:16:45.435804 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-6ec5550f-278a-4ac7-85b5-f770356a530f req-a82fc26f-2a80-4c18-b697-bc1bc6e7c5b3 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042971 Sep 14 09:16:45.436431 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2707/5433] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:16:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:16:45.456808 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-89445025-2192-405a-b793-7d762f664f04 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:45.457447 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-89445025-2192-405a-b793-7d762f664f04 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 0ba2a1b2-907f-4598-931a-c6605ffe5682] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:45.467020 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-89445025-2192-405a-b793-7d762f664f04 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:45.467776 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-89445025-2192-405a-b793-7d762f664f04 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:45.468218 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-89445025-2192-405a-b793-7d762f664f04 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:45.469150 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-89445025-2192-405a-b793-7d762f664f04 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:45.473475 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-89445025-2192-405a-b793-7d762f664f04 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:45.474794 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-89445025-2192-405a-b793-7d762f664f04 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:45.496997 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-89445025-2192-405a-b793-7d762f664f04 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] HTTP exception thrown: Instance 0ba2a1b2-907f-4598-931a-c6605ffe5682 could not be found. Sep 14 09:16:45.499832 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-89445025-2192-405a-b793-7d762f664f04 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Request method failure captured: Sep 14 09:16:45.499832 n-d-836830-18 devstack@n-api.service[128758]: request: GET /compute/v2.1/servers/0ba2a1b2-907f-4598-931a-c6605ffe5682 HTTP/1.1 Sep 14 09:16:45.499832 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 09:16:45.499832 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 09:16:45.499832 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 09:16:45.499832 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 09:16:45.499832 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 09:16:45.499832 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 09:16:45.499832 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 09:16:45.499832 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 09:16:45.499832 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZlbli-DUCcgcnIp82pgLH1MeZCUcHfkT5yyfUsmiHSxBD3c429y8-wgStj1whz8DzX2TZgyd3HgxP1s3YxgJlQF250cUgsVCoic4jlEyGeyIt_z0tJbq-ZVXxXpuOTFUrJr1sEtIyXnC0IrYNMyG6UkTPf7SAAui15bmxZyXWBXgjc Sep 14 09:16:45.499832 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 09:16:45.499832 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 09:16:45.499832 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 09:16:45.499832 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 09:16:45.499832 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 09:16:45.499832 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 09:16:45.499832 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 2f075a2c6aa4489abb3428e0a4ac5738 Sep 14 09:16:45.499832 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-ServerActionsTestJSON-1840244566 Sep 14 09:16:45.499832 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 09:16:45.499832 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 09:16:45.499832 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/2f075a2c6aa4489abb3428e0a4ac5738"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_2f075a2c6aa4489abb3428e0a4ac5738"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2f075a2c6aa4489abb3428e0a4ac5738"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2f075a2c6aa4489abb3428e0a4ac5738"}]}] Sep 14 09:16:45.499832 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-ServerActionsTestJSON-1840244566 Sep 14 09:16:45.499832 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 2f075a2c6aa4489abb3428e0a4ac5738 Sep 14 09:16:45.499832 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-ServerActionsTestJSON-1840244566 Sep 14 09:16:45.499832 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-ServerActionsTestJSON-1840244566-project Sep 14 09:16:45.499832 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 09:16:45.499832 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 09:16:45.499832 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 950da33830ae4ae1a5511dd146e4e3be Sep 14 09:16:45.499832 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-ServerActionsTestJSON-1840244566-project Sep 14 09:16:45.499832 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 09:16:45.499832 n-d-836830-18 devstack@n-api.service[128758]: exception: Instance 0ba2a1b2-907f-4598-931a-c6605ffe5682 could not be found. Sep 14 09:16:45.499832 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': '0ba2a1b2-907f-4598-931a-c6605ffe5682'} Sep 14 09:16:45.499832 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:16:45.499832 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:16:45.499832 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:16:45.499832 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:16:45.499832 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:16:45.499832 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:16:45.499832 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:16:45.499832 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:16:45.499832 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:16:45.499832 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:16:45.499832 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ba2a1b2-907f-4598-931a-c6605ffe5682 could not be found. Sep 14 09:16:45.499832 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:16:45.499832 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:16:45.499832 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:16:45.499832 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:16:45.499832 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:16:45.499832 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:16:45.499832 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:16:45.499832 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:16:45.499832 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:16:45.499832 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:16:45.499832 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:16:45.499832 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:16:45.499832 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:16:45.499832 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:16:45.499832 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:16:45.499832 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:16:45.499832 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ba2a1b2-907f-4598-931a-c6605ffe5682 could not be found. Sep 14 09:16:45.499832 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:16:45.499832 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:16:45.499832 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:16:45.504514 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:16:45.504514 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:16:45.504514 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:16:45.504514 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:16:45.504514 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:16:45.504514 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ba2a1b2-907f-4598-931a-c6605ffe5682 could not be found. Sep 14 09:16:45.504514 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:16:45.504514 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-89445025-2192-405a-b793-7d762f664f04 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Returning 404 to user: Instance 0ba2a1b2-907f-4598-931a-c6605ffe5682 could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:16:45.504514 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-89445025-2192-405a-b793-7d762f664f04 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/0ba2a1b2-907f-4598-931a-c6605ffe5682" status: 404 len: 111 microversion: 2.1 time: 0.053462 Sep 14 09:16:45.505804 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2727/5434] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:45 2022] GET /compute/v2.1/servers/0ba2a1b2-907f-4598-931a-c6605ffe5682 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:16:45.512583 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e3a1892c-8e43-4bdc-9e54-2cd3872f4382 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:45.513418 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e3a1892c-8e43-4bdc-9e54-2cd3872f4382 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 0be5d897-13d0-43ef-9122-96c21dafd94c] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:45.520083 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e3a1892c-8e43-4bdc-9e54-2cd3872f4382 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:45.520760 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e3a1892c-8e43-4bdc-9e54-2cd3872f4382 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:45.521374 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e3a1892c-8e43-4bdc-9e54-2cd3872f4382 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:45.522388 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e3a1892c-8e43-4bdc-9e54-2cd3872f4382 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:45.522899 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e3a1892c-8e43-4bdc-9e54-2cd3872f4382 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:45.523385 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e3a1892c-8e43-4bdc-9e54-2cd3872f4382 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:45.551386 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e3a1892c-8e43-4bdc-9e54-2cd3872f4382 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 0be5d897-13d0-43ef-9122-96c21dafd94c] Going to try to terminate instance {{(pid=128759) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:16:45.689084 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e3a1892c-8e43-4bdc-9e54-2cd3872f4382 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "DELETE /compute/v2.1/servers/0be5d897-13d0-43ef-9122-96c21dafd94c" status: 204 len: 0 microversion: 2.1 time: 0.181170 Sep 14 09:16:45.690097 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2708/5435] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:16:45 2022] DELETE /compute/v2.1/servers/0be5d897-13d0-43ef-9122-96c21dafd94c => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 14 09:16:45.702310 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-4008a7df-e2a4-41ee-a8a1-1baccae9800b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:45.703396 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-4008a7df-e2a4-41ee-a8a1-1baccae9800b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 0be5d897-13d0-43ef-9122-96c21dafd94c] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:45.718760 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4008a7df-e2a4-41ee-a8a1-1baccae9800b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:45.719371 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4008a7df-e2a4-41ee-a8a1-1baccae9800b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:45.719916 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4008a7df-e2a4-41ee-a8a1-1baccae9800b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:45.722425 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4008a7df-e2a4-41ee-a8a1-1baccae9800b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:45.723901 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4008a7df-e2a4-41ee-a8a1-1baccae9800b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:45.724497 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4008a7df-e2a4-41ee-a8a1-1baccae9800b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:45.817807 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-bda31404-d82c-43cc-9a6e-38cda0c1e7cc tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:45.818787 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-bda31404-d82c-43cc-9a6e-38cda0c1e7cc tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] [instance: d42a47fc-3124-4479-aff4-e2a5ba888729] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:45.832731 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bda31404-d82c-43cc-9a6e-38cda0c1e7cc tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:45.833310 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bda31404-d82c-43cc-9a6e-38cda0c1e7cc tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:45.833999 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bda31404-d82c-43cc-9a6e-38cda0c1e7cc tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:45.834995 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bda31404-d82c-43cc-9a6e-38cda0c1e7cc tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:45.835679 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bda31404-d82c-43cc-9a6e-38cda0c1e7cc tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:45.836321 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bda31404-d82c-43cc-9a6e-38cda0c1e7cc tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:45.869031 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-bda31404-d82c-43cc-9a6e-38cda0c1e7cc tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] HTTP exception thrown: Instance d42a47fc-3124-4479-aff4-e2a5ba888729 could not be found. Sep 14 09:16:45.879230 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-bda31404-d82c-43cc-9a6e-38cda0c1e7cc tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Request method failure captured: Sep 14 09:16:45.879230 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/d42a47fc-3124-4479-aff4-e2a5ba888729 HTTP/1.1 Sep 14 09:16:45.879230 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:16:45.879230 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:16:45.879230 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:16:45.879230 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:16:45.879230 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:16:45.879230 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:16:45.879230 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:16:45.879230 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:16:45.879230 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZspPmHjwZujiBcFD9QR0xKRglPEsjHrxFyZ2jvI3y4w7WsV_uOazq2PIFhXWJstUoVfI5CfG-SbSDJQWJGpK1XjUqfYNhZcp5K7_6hUB7flJnxmZDSxGD91GsUMnRbAXa_LtSdQIgpS8r244D3MU9iQdVusPNXmSG4qhMgXymnz-Wo Sep 14 09:16:45.879230 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:16:45.879230 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:16:45.879230 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:16:45.879230 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:16:45.879230 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:16:45.879230 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:16:45.879230 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 021b73b20f2042c6a08f94ed23ff66e5 Sep 14 09:16:45.879230 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-TestNetworkBasicOps-1034807082 Sep 14 09:16:45.879230 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:16:45.879230 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:16:45.879230 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/021b73b20f2042c6a08f94ed23ff66e5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_021b73b20f2042c6a08f94ed23ff66e5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/021b73b20f2042c6a08f94ed23ff66e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/021b73b20f2042c6a08f94ed23ff66e5"}]}] Sep 14 09:16:45.879230 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-TestNetworkBasicOps-1034807082 Sep 14 09:16:45.879230 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 021b73b20f2042c6a08f94ed23ff66e5 Sep 14 09:16:45.879230 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-TestNetworkBasicOps-1034807082 Sep 14 09:16:45.879230 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-TestNetworkBasicOps-1034807082-project Sep 14 09:16:45.879230 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:16:45.879230 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:16:45.879230 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 17918433a3994b69a65999a59a7f833c Sep 14 09:16:45.879230 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-TestNetworkBasicOps-1034807082-project Sep 14 09:16:45.879230 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:16:45.879230 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance d42a47fc-3124-4479-aff4-e2a5ba888729 could not be found. Sep 14 09:16:45.879230 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': 'd42a47fc-3124-4479-aff4-e2a5ba888729'} Sep 14 09:16:45.879230 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:16:45.879230 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:16:45.879230 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:16:45.879230 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:16:45.879230 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:16:45.879230 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:16:45.879230 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:16:45.879230 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:16:45.879230 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:16:45.879230 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:16:45.879230 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d42a47fc-3124-4479-aff4-e2a5ba888729 could not be found. Sep 14 09:16:45.879230 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:16:45.879230 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:16:45.879230 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:16:45.879230 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:16:45.879230 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:16:45.879230 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:16:45.879230 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:16:45.879230 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:16:45.879230 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:16:45.879230 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:16:45.879230 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:16:45.879230 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:16:45.879230 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:16:45.879230 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:16:45.879230 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:16:45.879230 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:16:45.879230 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d42a47fc-3124-4479-aff4-e2a5ba888729 could not be found. Sep 14 09:16:45.879230 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:16:45.879230 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:16:45.879230 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:16:45.883776 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:16:45.883776 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:16:45.883776 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:16:45.883776 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:16:45.883776 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:16:45.883776 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d42a47fc-3124-4479-aff4-e2a5ba888729 could not be found. Sep 14 09:16:45.883776 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:16:45.885493 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-bda31404-d82c-43cc-9a6e-38cda0c1e7cc tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Returning 404 to user: Instance d42a47fc-3124-4479-aff4-e2a5ba888729 could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:16:45.886582 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-bda31404-d82c-43cc-9a6e-38cda0c1e7cc tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] 10.222.0.60 "GET /compute/v2.1/servers/d42a47fc-3124-4479-aff4-e2a5ba888729" status: 404 len: 111 microversion: 2.1 time: 0.073375 Sep 14 09:16:45.887694 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2709/5436] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:45 2022] GET /compute/v2.1/servers/d42a47fc-3124-4479-aff4-e2a5ba888729 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:16:45.951181 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-4008a7df-e2a4-41ee-a8a1-1baccae9800b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:45.958881 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:16:45.965431 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-4008a7df-e2a4-41ee-a8a1-1baccae9800b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/0be5d897-13d0-43ef-9122-96c21dafd94c" status: 200 len: 1493 microversion: 2.1 time: 0.269462 Sep 14 09:16:45.984415 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2728/5437] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:45 2022] GET /compute/v2.1/servers/0be5d897-13d0-43ef-9122-96c21dafd94c => generated 1493 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:46.112835 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-36e8258e-044b-4726-8e43-ec1d5e762c98 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Calling method '.version_select at 0x7f7d3ee64940>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:46.158325 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-36e8258e-044b-4726-8e43-ec1d5e762c98 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-149670870" status: 202 len: 0 microversion: 2.1 time: 0.049914 Sep 14 09:16:46.166516 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2710/5438] 10.222.0.60 () {58 vars in 1254 bytes} [Wed Sep 14 09:16:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-149670870 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:16:46.394560 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-7a40a32f-7b86-44ee-b1be-bc0c5d19a9f4 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:46.397084 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-7a40a32f-7b86-44ee-b1be-bc0c5d19a9f4 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] [instance: cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:46.412318 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7a40a32f-7b86-44ee-b1be-bc0c5d19a9f4 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:46.417940 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7a40a32f-7b86-44ee-b1be-bc0c5d19a9f4 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:46.418449 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7a40a32f-7b86-44ee-b1be-bc0c5d19a9f4 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:46.425770 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7a40a32f-7b86-44ee-b1be-bc0c5d19a9f4 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:46.445493 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7a40a32f-7b86-44ee-b1be-bc0c5d19a9f4 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:46.449015 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7a40a32f-7b86-44ee-b1be-bc0c5d19a9f4 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:46.604211 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7a40a32f-7b86-44ee-b1be-bc0c5d19a9f4 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:46.606765 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7a40a32f-7b86-44ee-b1be-bc0c5d19a9f4 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:46.607739 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7a40a32f-7b86-44ee-b1be-bc0c5d19a9f4 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:46.611138 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.objects.instance [None req-7a40a32f-7b86-44ee-b1be-bc0c5d19a9f4 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lazy-loading 'fault' on Instance uuid cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f {{(pid=128758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:16:46.765233 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-7a40a32f-7b86-44ee-b1be-bc0c5d19a9f4 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb33a017168c4a8bae36eacd9ba6a7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24f2e13835b240578d411521ee520115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:46.778372 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-7a40a32f-7b86-44ee-b1be-bc0c5d19a9f4 tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] 10.222.0.60 "GET /compute/v2.1/servers/cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f" status: 200 len: 1303 microversion: 2.1 time: 0.398725 Sep 14 09:16:46.779653 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2729/5439] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:46 2022] GET /compute/v2.1/servers/cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f => generated 1303 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:46.967576 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-153e7434-85ae-4dc2-853e-11eabe1d46eb req-eafbf62d-31fe-4908-a53a-3dc94d0bfa94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0be5d897-13d0-43ef-9122-96c21dafd94c", "name": "network-vif-deleted", "tag": "ec4b48d5-c2cf-4b8e-94ff-b7bc6da1ad27"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:16:46.979035 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-153e7434-85ae-4dc2-853e-11eabe1d46eb req-eafbf62d-31fe-4908-a53a-3dc94d0bfa94 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:46.979665 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-153e7434-85ae-4dc2-853e-11eabe1d46eb req-eafbf62d-31fe-4908-a53a-3dc94d0bfa94 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:46.980349 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-153e7434-85ae-4dc2-853e-11eabe1d46eb req-eafbf62d-31fe-4908-a53a-3dc94d0bfa94 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:46.992994 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-153e7434-85ae-4dc2-853e-11eabe1d46eb req-eafbf62d-31fe-4908-a53a-3dc94d0bfa94 service nova] Creating event network-vif-deleted:ec4b48d5-c2cf-4b8e-94ff-b7bc6da1ad27 for instance 0be5d897-13d0-43ef-9122-96c21dafd94c on n-h2-836830-18 Sep 14 09:16:46.999504 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-11614140-39b3-4926-baf3-4986b0f374d3 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:47.000134 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-11614140-39b3-4926-baf3-4986b0f374d3 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 0be5d897-13d0-43ef-9122-96c21dafd94c] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:47.005499 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-153e7434-85ae-4dc2-853e-11eabe1d46eb req-eafbf62d-31fe-4908-a53a-3dc94d0bfa94 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042336 Sep 14 09:16:47.006254 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2711/5440] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:16:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:16:47.019446 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-11614140-39b3-4926-baf3-4986b0f374d3 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:47.023864 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-11614140-39b3-4926-baf3-4986b0f374d3 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:47.025327 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-11614140-39b3-4926-baf3-4986b0f374d3 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:47.027622 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-11614140-39b3-4926-baf3-4986b0f374d3 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:47.028970 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-11614140-39b3-4926-baf3-4986b0f374d3 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:47.034540 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-11614140-39b3-4926-baf3-4986b0f374d3 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:47.295504 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-11614140-39b3-4926-baf3-4986b0f374d3 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:47.316547 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-11614140-39b3-4926-baf3-4986b0f374d3 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/0be5d897-13d0-43ef-9122-96c21dafd94c" status: 200 len: 1285 microversion: 2.1 time: 0.322691 Sep 14 09:16:47.327487 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2730/5441] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:46 2022] GET /compute/v2.1/servers/0be5d897-13d0-43ef-9122-96c21dafd94c => generated 1285 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:47.810288 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-98d138c4-b3d5-424b-850b-9412602ee4da tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:47.811452 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-98d138c4-b3d5-424b-850b-9412602ee4da tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] [instance: cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:47.819138 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-98d138c4-b3d5-424b-850b-9412602ee4da tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:47.820951 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-98d138c4-b3d5-424b-850b-9412602ee4da tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:47.821618 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-98d138c4-b3d5-424b-850b-9412602ee4da tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:47.822624 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-98d138c4-b3d5-424b-850b-9412602ee4da tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:47.823344 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-98d138c4-b3d5-424b-850b-9412602ee4da tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:47.824602 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-98d138c4-b3d5-424b-850b-9412602ee4da tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:47.841865 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-98d138c4-b3d5-424b-850b-9412602ee4da tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] HTTP exception thrown: Instance cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f could not be found. Sep 14 09:16:47.843875 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-98d138c4-b3d5-424b-850b-9412602ee4da tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Request method failure captured: Sep 14 09:16:47.843875 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f HTTP/1.1 Sep 14 09:16:47.843875 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:16:47.843875 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:16:47.843875 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:16:47.843875 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:16:47.843875 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:16:47.843875 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:16:47.843875 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:16:47.843875 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:16:47.843875 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZt446FviltuOnCGiDNcekFU9GpfP61usS3Hz93kQVGcyEnyFjCYYKNU-_kaLKg3GyyHwWALSCjdD985jUIBDhZ6IiQ_k1elSdy4cOTAKHmrQXu9WL2A8xY5U6qBze4d-QAuwAnppzzGGSQ7AHpl1L2hJiC-GfzH262HlSkIIHg_hos Sep 14 09:16:47.843875 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:16:47.843875 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:16:47.843875 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:16:47.843875 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:16:47.843875 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:16:47.843875 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:16:47.843875 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 24f2e13835b240578d411521ee520115 Sep 14 09:16:47.843875 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ServerRescueTestJSON-1061299090 Sep 14 09:16:47.843875 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:16:47.843875 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:16:47.843875 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/24f2e13835b240578d411521ee520115"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_24f2e13835b240578d411521ee520115"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/24f2e13835b240578d411521ee520115"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/24f2e13835b240578d411521ee520115"}]}] Sep 14 09:16:47.843875 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ServerRescueTestJSON-1061299090 Sep 14 09:16:47.843875 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 24f2e13835b240578d411521ee520115 Sep 14 09:16:47.843875 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ServerRescueTestJSON-1061299090 Sep 14 09:16:47.843875 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ServerRescueTestJSON-1061299090-project Sep 14 09:16:47.843875 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:16:47.843875 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:16:47.843875 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: bb33a017168c4a8bae36eacd9ba6a7ac Sep 14 09:16:47.843875 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ServerRescueTestJSON-1061299090-project Sep 14 09:16:47.843875 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:16:47.843875 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f could not be found. Sep 14 09:16:47.843875 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': 'cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f'} Sep 14 09:16:47.843875 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:16:47.843875 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:16:47.843875 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:16:47.843875 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:16:47.843875 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:16:47.843875 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:16:47.843875 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:16:47.843875 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:16:47.843875 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:16:47.843875 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:16:47.843875 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f could not be found. Sep 14 09:16:47.843875 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:16:47.843875 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:16:47.843875 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:16:47.843875 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:16:47.843875 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:16:47.843875 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:16:47.843875 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:16:47.843875 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:16:47.843875 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:16:47.843875 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:16:47.843875 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:16:47.843875 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:16:47.843875 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:16:47.843875 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:16:47.843875 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:16:47.843875 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:16:47.843875 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f could not be found. Sep 14 09:16:47.843875 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:16:47.843875 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:16:47.843875 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:16:47.848291 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:16:47.848291 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:16:47.848291 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:16:47.848291 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:16:47.848291 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:16:47.848291 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f could not be found. Sep 14 09:16:47.848291 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:16:47.849890 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-98d138c4-b3d5-424b-850b-9412602ee4da tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] Returning 404 to user: Instance cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:16:47.850960 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-98d138c4-b3d5-424b-850b-9412602ee4da tempest-ServerRescueTestJSON-1061299090 tempest-ServerRescueTestJSON-1061299090-project] 10.222.0.60 "GET /compute/v2.1/servers/cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f" status: 404 len: 111 microversion: 2.1 time: 0.045999 Sep 14 09:16:47.851695 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2712/5442] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:47 2022] GET /compute/v2.1/servers/cb3fef95-96e8-416c-ac8f-1f7ae1b25a5f => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:16:48.336561 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-3d85ce54-77dc-48e7-81e5-c80f3960a665 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:48.337202 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-3d85ce54-77dc-48e7-81e5-c80f3960a665 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 0be5d897-13d0-43ef-9122-96c21dafd94c] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:48.349722 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3d85ce54-77dc-48e7-81e5-c80f3960a665 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:48.350287 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3d85ce54-77dc-48e7-81e5-c80f3960a665 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:48.351531 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3d85ce54-77dc-48e7-81e5-c80f3960a665 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:48.352457 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3d85ce54-77dc-48e7-81e5-c80f3960a665 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:48.353551 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3d85ce54-77dc-48e7-81e5-c80f3960a665 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:48.353551 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3d85ce54-77dc-48e7-81e5-c80f3960a665 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:48.384162 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-3d85ce54-77dc-48e7-81e5-c80f3960a665 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] HTTP exception thrown: Instance 0be5d897-13d0-43ef-9122-96c21dafd94c could not be found. Sep 14 09:16:48.387589 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-3d85ce54-77dc-48e7-81e5-c80f3960a665 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Request method failure captured: Sep 14 09:16:48.387589 n-d-836830-18 devstack@n-api.service[128758]: request: GET /compute/v2.1/servers/0be5d897-13d0-43ef-9122-96c21dafd94c HTTP/1.1 Sep 14 09:16:48.387589 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 09:16:48.387589 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 09:16:48.387589 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 09:16:48.387589 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 09:16:48.387589 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 09:16:48.387589 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 09:16:48.387589 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 09:16:48.387589 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 09:16:48.387589 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZlbli-DUCcgcnIp82pgLH1MeZCUcHfkT5yyfUsmiHSxBD3c429y8-wgStj1whz8DzX2TZgyd3HgxP1s3YxgJlQF250cUgsVCoic4jlEyGeyIt_z0tJbq-ZVXxXpuOTFUrJr1sEtIyXnC0IrYNMyG6UkTPf7SAAui15bmxZyXWBXgjc Sep 14 09:16:48.387589 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 09:16:48.387589 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 09:16:48.387589 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 09:16:48.387589 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 09:16:48.387589 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 09:16:48.387589 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 09:16:48.387589 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 2f075a2c6aa4489abb3428e0a4ac5738 Sep 14 09:16:48.387589 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-ServerActionsTestJSON-1840244566 Sep 14 09:16:48.387589 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 09:16:48.387589 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 09:16:48.387589 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/2f075a2c6aa4489abb3428e0a4ac5738"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_2f075a2c6aa4489abb3428e0a4ac5738"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2f075a2c6aa4489abb3428e0a4ac5738"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2f075a2c6aa4489abb3428e0a4ac5738"}]}] Sep 14 09:16:48.387589 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-ServerActionsTestJSON-1840244566 Sep 14 09:16:48.387589 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 2f075a2c6aa4489abb3428e0a4ac5738 Sep 14 09:16:48.387589 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-ServerActionsTestJSON-1840244566 Sep 14 09:16:48.387589 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-ServerActionsTestJSON-1840244566-project Sep 14 09:16:48.387589 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 09:16:48.387589 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 09:16:48.387589 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 950da33830ae4ae1a5511dd146e4e3be Sep 14 09:16:48.387589 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-ServerActionsTestJSON-1840244566-project Sep 14 09:16:48.387589 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 09:16:48.387589 n-d-836830-18 devstack@n-api.service[128758]: exception: Instance 0be5d897-13d0-43ef-9122-96c21dafd94c could not be found. Sep 14 09:16:48.387589 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': '0be5d897-13d0-43ef-9122-96c21dafd94c'} Sep 14 09:16:48.387589 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:16:48.387589 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:16:48.387589 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:16:48.387589 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:16:48.387589 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:16:48.387589 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:16:48.387589 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:16:48.387589 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:16:48.387589 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:16:48.387589 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:16:48.387589 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0be5d897-13d0-43ef-9122-96c21dafd94c could not be found. Sep 14 09:16:48.387589 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:16:48.387589 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:16:48.387589 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:16:48.387589 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:16:48.387589 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:16:48.387589 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:16:48.387589 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:16:48.387589 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:16:48.387589 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:16:48.387589 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:16:48.387589 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:16:48.387589 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:16:48.387589 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:16:48.387589 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:16:48.387589 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:16:48.387589 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:16:48.387589 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0be5d897-13d0-43ef-9122-96c21dafd94c could not be found. Sep 14 09:16:48.387589 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:16:48.387589 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:16:48.387589 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:16:48.392052 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:16:48.392052 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:16:48.392052 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:16:48.392052 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:16:48.392052 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:16:48.392052 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0be5d897-13d0-43ef-9122-96c21dafd94c could not be found. Sep 14 09:16:48.392052 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:16:48.394440 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-3d85ce54-77dc-48e7-81e5-c80f3960a665 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Returning 404 to user: Instance 0be5d897-13d0-43ef-9122-96c21dafd94c could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:16:48.395548 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-3d85ce54-77dc-48e7-81e5-c80f3960a665 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/0be5d897-13d0-43ef-9122-96c21dafd94c" status: 404 len: 111 microversion: 2.1 time: 0.063460 Sep 14 09:16:48.400292 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2731/5443] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:48 2022] GET /compute/v2.1/servers/0be5d897-13d0-43ef-9122-96c21dafd94c => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 14 09:16:48.406717 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-7381f3cf-c84c-4ab8-81b3-d78b6dbe96a7 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:48.407294 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-7381f3cf-c84c-4ab8-81b3-d78b6dbe96a7 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:48.418814 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7381f3cf-c84c-4ab8-81b3-d78b6dbe96a7 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:48.426629 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7381f3cf-c84c-4ab8-81b3-d78b6dbe96a7 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:48.427479 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7381f3cf-c84c-4ab8-81b3-d78b6dbe96a7 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:48.428259 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7381f3cf-c84c-4ab8-81b3-d78b6dbe96a7 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:48.429348 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7381f3cf-c84c-4ab8-81b3-d78b6dbe96a7 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:48.429973 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7381f3cf-c84c-4ab8-81b3-d78b6dbe96a7 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:48.493773 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-7381f3cf-c84c-4ab8-81b3-d78b6dbe96a7 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Going to try to terminate instance {{(pid=128759) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:16:48.670624 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:16:48.773605 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-7381f3cf-c84c-4ab8-81b3-d78b6dbe96a7 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "DELETE /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105" status: 204 len: 0 microversion: 2.1 time: 0.369680 Sep 14 09:16:48.784250 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-34db32fc-34cc-4310-be6f-c5b39d7607f4 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:48.785018 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-34db32fc-34cc-4310-be6f-c5b39d7607f4 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:48.790268 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2713/5444] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:16:48 2022] DELETE /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 14 09:16:48.792121 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-34db32fc-34cc-4310-be6f-c5b39d7607f4 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:48.792973 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-34db32fc-34cc-4310-be6f-c5b39d7607f4 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:48.793566 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-34db32fc-34cc-4310-be6f-c5b39d7607f4 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:48.808020 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-34db32fc-34cc-4310-be6f-c5b39d7607f4 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:48.809820 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-34db32fc-34cc-4310-be6f-c5b39d7607f4 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:48.813515 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-34db32fc-34cc-4310-be6f-c5b39d7607f4 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:49.112488 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-34db32fc-34cc-4310-be6f-c5b39d7607f4 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:49.124233 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-34db32fc-34cc-4310-be6f-c5b39d7607f4 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105" status: 200 len: 1674 microversion: 2.1 time: 0.344643 Sep 14 09:16:49.125057 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2732/5445] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:48 2022] GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105 => generated 1674 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:50.153758 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-329faa5c-5bac-4de6-a7ee-0579ea019e79 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:50.163013 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-329faa5c-5bac-4de6-a7ee-0579ea019e79 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:50.182487 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-329faa5c-5bac-4de6-a7ee-0579ea019e79 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:50.183392 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-329faa5c-5bac-4de6-a7ee-0579ea019e79 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:50.189144 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-329faa5c-5bac-4de6-a7ee-0579ea019e79 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:50.190211 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-329faa5c-5bac-4de6-a7ee-0579ea019e79 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:50.191063 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-329faa5c-5bac-4de6-a7ee-0579ea019e79 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:50.193810 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-329faa5c-5bac-4de6-a7ee-0579ea019e79 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:50.522790 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-329faa5c-5bac-4de6-a7ee-0579ea019e79 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:50.535810 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-329faa5c-5bac-4de6-a7ee-0579ea019e79 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105" status: 200 len: 1674 microversion: 2.1 time: 0.382136 Sep 14 09:16:50.537444 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2714/5446] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:50 2022] GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105 => generated 1674 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:51.567440 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b48b03db-e96f-4d02-b28a-2f69b7f32096 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:51.569159 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-b48b03db-e96f-4d02-b28a-2f69b7f32096 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:51.587278 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b48b03db-e96f-4d02-b28a-2f69b7f32096 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:51.588212 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b48b03db-e96f-4d02-b28a-2f69b7f32096 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:51.592210 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b48b03db-e96f-4d02-b28a-2f69b7f32096 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:51.593359 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b48b03db-e96f-4d02-b28a-2f69b7f32096 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:51.594290 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b48b03db-e96f-4d02-b28a-2f69b7f32096 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:51.595305 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b48b03db-e96f-4d02-b28a-2f69b7f32096 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:51.868456 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-b48b03db-e96f-4d02-b28a-2f69b7f32096 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:51.883008 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-b48b03db-e96f-4d02-b28a-2f69b7f32096 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105" status: 200 len: 1674 microversion: 2.1 time: 0.323377 Sep 14 09:16:51.884050 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2733/5447] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:51 2022] GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105 => generated 1674 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:16:52.913453 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-91dc0e46-f39b-4301-a3dd-6ec91dd92b48 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:52.914976 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-91dc0e46-f39b-4301-a3dd-6ec91dd92b48 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:52.932060 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-91dc0e46-f39b-4301-a3dd-6ec91dd92b48 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:52.933034 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-91dc0e46-f39b-4301-a3dd-6ec91dd92b48 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:52.933804 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-91dc0e46-f39b-4301-a3dd-6ec91dd92b48 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:52.934961 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-91dc0e46-f39b-4301-a3dd-6ec91dd92b48 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:52.935658 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-91dc0e46-f39b-4301-a3dd-6ec91dd92b48 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:52.936924 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-91dc0e46-f39b-4301-a3dd-6ec91dd92b48 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:53.016002 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-c88d8f48-5781-4fac-94fa-319e91b1fe04 req-a1518812-377a-4271-9ec4-d1de52b24b54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8450d385-d5d9-4c86-9ece-b3bbf9ed1105", "name": "network-vif-deleted", "tag": "eb873b1a-8b40-4eb4-a329-cf733d9ed342"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:16:53.050920 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-c88d8f48-5781-4fac-94fa-319e91b1fe04 req-a1518812-377a-4271-9ec4-d1de52b24b54 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:53.057680 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-c88d8f48-5781-4fac-94fa-319e91b1fe04 req-a1518812-377a-4271-9ec4-d1de52b24b54 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:53.058424 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-c88d8f48-5781-4fac-94fa-319e91b1fe04 req-a1518812-377a-4271-9ec4-d1de52b24b54 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:53.088084 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-c88d8f48-5781-4fac-94fa-319e91b1fe04 req-a1518812-377a-4271-9ec4-d1de52b24b54 service nova] Creating event network-vif-deleted:eb873b1a-8b40-4eb4-a329-cf733d9ed342 for instance 8450d385-d5d9-4c86-9ece-b3bbf9ed1105 on n-h1-836830-18 Sep 14 09:16:53.107271 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-c88d8f48-5781-4fac-94fa-319e91b1fe04 req-a1518812-377a-4271-9ec4-d1de52b24b54 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120748 Sep 14 09:16:53.108341 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2734/5448] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:16:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:16:53.162911 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-91dc0e46-f39b-4301-a3dd-6ec91dd92b48 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950da33830ae4ae1a5511dd146e4e3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f075a2c6aa4489abb3428e0a4ac5738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:53.176170 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-91dc0e46-f39b-4301-a3dd-6ec91dd92b48 tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105" status: 200 len: 1324 microversion: 2.1 time: 0.264742 Sep 14 09:16:53.188854 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2715/5449] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:52 2022] GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105 => generated 1324 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:54.207359 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-4c6927fa-e864-4504-966f-6215e2ebb99c tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:54.209492 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-4c6927fa-e864-4504-966f-6215e2ebb99c tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] [instance: 8450d385-d5d9-4c86-9ece-b3bbf9ed1105] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:54.228217 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4c6927fa-e864-4504-966f-6215e2ebb99c tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:54.229124 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4c6927fa-e864-4504-966f-6215e2ebb99c tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:54.229786 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4c6927fa-e864-4504-966f-6215e2ebb99c tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:54.230722 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4c6927fa-e864-4504-966f-6215e2ebb99c tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:54.231725 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4c6927fa-e864-4504-966f-6215e2ebb99c tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:54.232257 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4c6927fa-e864-4504-966f-6215e2ebb99c tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:54.271482 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-4c6927fa-e864-4504-966f-6215e2ebb99c tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] HTTP exception thrown: Instance 8450d385-d5d9-4c86-9ece-b3bbf9ed1105 could not be found. Sep 14 09:16:54.276998 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-4c6927fa-e864-4504-966f-6215e2ebb99c tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Request method failure captured: Sep 14 09:16:54.276998 n-d-836830-18 devstack@n-api.service[128758]: request: GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105 HTTP/1.1 Sep 14 09:16:54.276998 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 09:16:54.276998 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 09:16:54.276998 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 09:16:54.276998 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 09:16:54.276998 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 09:16:54.276998 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 09:16:54.276998 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 09:16:54.276998 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 09:16:54.276998 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZlbli-DUCcgcnIp82pgLH1MeZCUcHfkT5yyfUsmiHSxBD3c429y8-wgStj1whz8DzX2TZgyd3HgxP1s3YxgJlQF250cUgsVCoic4jlEyGeyIt_z0tJbq-ZVXxXpuOTFUrJr1sEtIyXnC0IrYNMyG6UkTPf7SAAui15bmxZyXWBXgjc Sep 14 09:16:54.276998 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 09:16:54.276998 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 09:16:54.276998 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 09:16:54.276998 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 09:16:54.276998 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 09:16:54.276998 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 09:16:54.276998 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 2f075a2c6aa4489abb3428e0a4ac5738 Sep 14 09:16:54.276998 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-ServerActionsTestJSON-1840244566 Sep 14 09:16:54.276998 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 09:16:54.276998 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 09:16:54.276998 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/2f075a2c6aa4489abb3428e0a4ac5738"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_2f075a2c6aa4489abb3428e0a4ac5738"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2f075a2c6aa4489abb3428e0a4ac5738"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2f075a2c6aa4489abb3428e0a4ac5738"}]}] Sep 14 09:16:54.276998 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-ServerActionsTestJSON-1840244566 Sep 14 09:16:54.276998 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 2f075a2c6aa4489abb3428e0a4ac5738 Sep 14 09:16:54.276998 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-ServerActionsTestJSON-1840244566 Sep 14 09:16:54.276998 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-ServerActionsTestJSON-1840244566-project Sep 14 09:16:54.276998 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 09:16:54.276998 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 09:16:54.276998 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 950da33830ae4ae1a5511dd146e4e3be Sep 14 09:16:54.276998 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-ServerActionsTestJSON-1840244566-project Sep 14 09:16:54.276998 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 09:16:54.276998 n-d-836830-18 devstack@n-api.service[128758]: exception: Instance 8450d385-d5d9-4c86-9ece-b3bbf9ed1105 could not be found. Sep 14 09:16:54.276998 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': '8450d385-d5d9-4c86-9ece-b3bbf9ed1105'} Sep 14 09:16:54.276998 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:16:54.276998 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:16:54.276998 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:16:54.276998 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:16:54.276998 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:16:54.276998 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:16:54.276998 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:16:54.276998 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:16:54.276998 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:16:54.276998 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:16:54.276998 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8450d385-d5d9-4c86-9ece-b3bbf9ed1105 could not be found. Sep 14 09:16:54.276998 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:16:54.276998 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:16:54.276998 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:16:54.276998 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:16:54.276998 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:16:54.276998 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:16:54.276998 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:16:54.276998 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:16:54.276998 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:16:54.276998 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:16:54.276998 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:16:54.276998 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:16:54.276998 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:16:54.276998 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:16:54.276998 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:16:54.276998 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:16:54.276998 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8450d385-d5d9-4c86-9ece-b3bbf9ed1105 could not be found. Sep 14 09:16:54.276998 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:16:54.276998 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:16:54.276998 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:16:54.281775 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:16:54.281775 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:16:54.281775 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:16:54.281775 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:16:54.281775 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:16:54.281775 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8450d385-d5d9-4c86-9ece-b3bbf9ed1105 could not be found. Sep 14 09:16:54.281775 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:16:54.282456 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-4c6927fa-e864-4504-966f-6215e2ebb99c tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Returning 404 to user: Instance 8450d385-d5d9-4c86-9ece-b3bbf9ed1105 could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:16:54.289020 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-4c6927fa-e864-4504-966f-6215e2ebb99c tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105" status: 404 len: 111 microversion: 2.1 time: 0.083731 Sep 14 09:16:54.292858 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2735/5450] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:54 2022] GET /compute/v2.1/servers/8450d385-d5d9-4c86-9ece-b3bbf9ed1105 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:16:54.298442 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-2e0f01d5-52db-434b-9379-9694011c627b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] Calling method '.version_select at 0x7f7d3ee2d5e0>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:54.342657 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-2e0f01d5-52db-434b-9379-9694011c627b tempest-ServerActionsTestJSON-1840244566 tempest-ServerActionsTestJSON-1840244566-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1803326428" status: 202 len: 0 microversion: 2.1 time: 0.048315 Sep 14 09:16:54.346560 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2716/5451] 10.222.0.60 () {58 vars in 1221 bytes} [Wed Sep 14 09:16:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1803326428 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:17:07.141129 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-425ca450-c78b-4e7f-baa9-25bbd4898e43 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Action: 'create', calling method: .version_select at 0x7f7d3f3f1700>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-2024510798", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLGzTkkTnA3WzpD9Q7NsutTujI9nSqK1RX9RfeOdxMXIhujVVXtOehsEtRQPtox2tC+k6oiFdmbGuTxASD+QUcKl2G07GiSFHdwstRrpphMMKvncZ12Dbhx0VYQQQL7VVg=="}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:17:07.157264 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=82,nova_api:DELETE=1,nova_api:UPDATE=3 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:17:07.163568 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=33 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:17:07.206443 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-425ca450-c78b-4e7f-baa9-25bbd4898e43 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Getting quotas for project 021b73b20f2042c6a08f94ed23ff66e5. Resources: {'key_pairs'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:17:07.218268 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-425ca450-c78b-4e7f-baa9-25bbd4898e43 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Getting quotas for user 17918433a3994b69a65999a59a7f833c and project 021b73b20f2042c6a08f94ed23ff66e5. Resources: {'key_pairs'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:17:07.309946 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-425ca450-c78b-4e7f-baa9-25bbd4898e43 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.172668 Sep 14 09:17:07.316665 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2736/5452] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Sep 14 09:17:07 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:17:07.661077 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=12 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:17:07.662675 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:17:08.145289 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d30b99f5-18ba-44f1-b49d-f9530e796d18 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-720041005", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:17:08.264294 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.network.neutron [None req-d30b99f5-18ba-44f1-b49d-f9530e796d18 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] validate_networks() for [('74bb7a5b-218d-4c3f-a039-ea51c9690838', None, None, None, None, None)] {{(pid=128759) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:17:09.341151 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-d30b99f5-18ba-44f1-b49d-f9530e796d18 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Flavor limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:17:09.341852 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-d30b99f5-18ba-44f1-b49d-f9530e796d18 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Image limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:17:09.342051 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-d30b99f5-18ba-44f1-b49d-f9530e796d18 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Flavor pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:17:09.342484 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-d30b99f5-18ba-44f1-b49d-f9530e796d18 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Image pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:17:09.342893 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-d30b99f5-18ba-44f1-b49d-f9530e796d18 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:17:09.384021 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d30b99f5-18ba-44f1-b49d-f9530e796d18 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:09.384518 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d30b99f5-18ba-44f1-b49d-f9530e796d18 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:09.386617 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d30b99f5-18ba-44f1-b49d-f9530e796d18 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:09.393084 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d30b99f5-18ba-44f1-b49d-f9530e796d18 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:09.395613 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d30b99f5-18ba-44f1-b49d-f9530e796d18 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:09.396159 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d30b99f5-18ba-44f1-b49d-f9530e796d18 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:09.505030 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-d30b99f5-18ba-44f1-b49d-f9530e796d18 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Getting quotas for project 229e11b3c1fe48b088d0f3c4bb7e2cb6. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:17:09.538028 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-d30b99f5-18ba-44f1-b49d-f9530e796d18 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Getting quotas for user d03dc827647f4483beb2e1b7888be608 and project 229e11b3c1fe48b088d0f3c4bb7e2cb6. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:17:09.581199 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-d30b99f5-18ba-44f1-b49d-f9530e796d18 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Going to run 1 instances... {{(pid=128759) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:17:09.584355 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-d30b99f5-18ba-44f1-b49d-f9530e796d18 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 80f0d7ed-260a-4c9d-a13b-be676b9edba0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128759) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:17:09.674475 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d30b99f5-18ba-44f1-b49d-f9530e796d18 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.015266 Sep 14 09:17:09.675940 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2717/5453] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 09:17:07 2022] POST /compute/v2.1/servers => generated 383 bytes in 2017 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:17:09.688559 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-0077b01a-d429-4d3d-8c2a-c0f31142db26 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:09.689777 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-0077b01a-d429-4d3d-8c2a-c0f31142db26 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 80f0d7ed-260a-4c9d-a13b-be676b9edba0] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:09.883721 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-0077b01a-d429-4d3d-8c2a-c0f31142db26 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03dc827647f4483beb2e1b7888be608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229e11b3c1fe48b088d0f3c4bb7e2cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:09.893190 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-0077b01a-d429-4d3d-8c2a-c0f31142db26 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "GET /compute/v2.1/servers/80f0d7ed-260a-4c9d-a13b-be676b9edba0" status: 200 len: 1221 microversion: 2.1 time: 0.209518 Sep 14 09:17:09.900459 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2737/5454] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:17:09 2022] GET /compute/v2.1/servers/80f0d7ed-260a-4c9d-a13b-be676b9edba0 => generated 1221 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:17:10.129270 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-38d8dd0f-8957-4869-9b6c-0a1686a161b6 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-966819487", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "networks": [{"uuid": "9a94bf13-0384-40b3-a5c8-ac3df78e9587"}], "key_name": "tempest-TestNetworkBasicOps-2024510798", "security_groups": [{"name": "tempest-secgroup-smoke-423200443"}]}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:17:10.291486 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-39caea87-be1c-4236-bdb5-7d2a5dc5774c tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1609242085", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:17:10.408702 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.network.neutron [None req-38d8dd0f-8957-4869-9b6c-0a1686a161b6 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] validate_networks() for [('9a94bf13-0384-40b3-a5c8-ac3df78e9587', None, None, None, None, None)] {{(pid=128759) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:17:10.449071 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.network.neutron [None req-39caea87-be1c-4236-bdb5-7d2a5dc5774c tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] validate_networks() for [('74bb7a5b-218d-4c3f-a039-ea51c9690838', None, None, None, None, None)] {{(pid=128758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:17:11.998167 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-38d8dd0f-8957-4869-9b6c-0a1686a161b6 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Flavor limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:17:11.999390 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-38d8dd0f-8957-4869-9b6c-0a1686a161b6 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Image limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:17:12.000428 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-38d8dd0f-8957-4869-9b6c-0a1686a161b6 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Flavor pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:17:12.001170 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-38d8dd0f-8957-4869-9b6c-0a1686a161b6 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Image pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:17:12.002647 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-38d8dd0f-8957-4869-9b6c-0a1686a161b6 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:17:12.040522 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-38d8dd0f-8957-4869-9b6c-0a1686a161b6 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:12.044659 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-38d8dd0f-8957-4869-9b6c-0a1686a161b6 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:12.046113 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-38d8dd0f-8957-4869-9b6c-0a1686a161b6 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:12.049480 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-38d8dd0f-8957-4869-9b6c-0a1686a161b6 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:12.051861 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-38d8dd0f-8957-4869-9b6c-0a1686a161b6 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:12.052766 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-38d8dd0f-8957-4869-9b6c-0a1686a161b6 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:12.097686 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-38d8dd0f-8957-4869-9b6c-0a1686a161b6 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Getting quotas for project 021b73b20f2042c6a08f94ed23ff66e5. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:17:12.106396 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-38d8dd0f-8957-4869-9b6c-0a1686a161b6 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Getting quotas for user 17918433a3994b69a65999a59a7f833c and project 021b73b20f2042c6a08f94ed23ff66e5. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:17:12.127214 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-38d8dd0f-8957-4869-9b6c-0a1686a161b6 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Going to run 1 instances... {{(pid=128759) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:17:12.144880 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-38d8dd0f-8957-4869-9b6c-0a1686a161b6 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] [instance: f31deffe-182e-46b5-9643-725b7d7b4561] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128759) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:17:12.282247 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-38d8dd0f-8957-4869-9b6c-0a1686a161b6 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.167503 Sep 14 09:17:12.285201 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2718/5455] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 09:17:10 2022] POST /compute/v2.1/servers => generated 405 bytes in 2171 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:17:12.298542 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9bce5db9-8257-47f1-9ca9-232b1daf4041 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:12.302008 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-9bce5db9-8257-47f1-9ca9-232b1daf4041 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] [instance: f31deffe-182e-46b5-9643-725b7d7b4561] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:12.479592 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-9bce5db9-8257-47f1-9ca9-232b1daf4041 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17918433a3994b69a65999a59a7f833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b73b20f2042c6a08f94ed23ff66e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:12.487488 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-9bce5db9-8257-47f1-9ca9-232b1daf4041 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] 10.222.0.60 "GET /compute/v2.1/servers/f31deffe-182e-46b5-9643-725b7d7b4561" status: 200 len: 1248 microversion: 2.1 time: 0.193842 Sep 14 09:17:12.491997 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2719/5456] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:17:12 2022] GET /compute/v2.1/servers/f31deffe-182e-46b5-9643-725b7d7b4561 => generated 1248 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:17:12.522599 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-39caea87-be1c-4236-bdb5-7d2a5dc5774c tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Flavor limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:17:12.523097 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-39caea87-be1c-4236-bdb5-7d2a5dc5774c tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Image limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:17:12.523535 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-39caea87-be1c-4236-bdb5-7d2a5dc5774c tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Flavor pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:17:12.523955 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-39caea87-be1c-4236-bdb5-7d2a5dc5774c tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Image pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:17:12.524386 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-39caea87-be1c-4236-bdb5-7d2a5dc5774c tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:17:12.585499 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-39caea87-be1c-4236-bdb5-7d2a5dc5774c tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:12.586033 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-39caea87-be1c-4236-bdb5-7d2a5dc5774c tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:12.586481 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-39caea87-be1c-4236-bdb5-7d2a5dc5774c tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:12.588858 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-39caea87-be1c-4236-bdb5-7d2a5dc5774c tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:12.589625 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-39caea87-be1c-4236-bdb5-7d2a5dc5774c tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:12.590218 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-39caea87-be1c-4236-bdb5-7d2a5dc5774c tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:12.650602 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-39caea87-be1c-4236-bdb5-7d2a5dc5774c tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Getting quotas for project 229e11b3c1fe48b088d0f3c4bb7e2cb6. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:17:12.664071 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-39caea87-be1c-4236-bdb5-7d2a5dc5774c tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Getting quotas for user d03dc827647f4483beb2e1b7888be608 and project 229e11b3c1fe48b088d0f3c4bb7e2cb6. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:17:12.698797 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-39caea87-be1c-4236-bdb5-7d2a5dc5774c tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Going to run 1 instances... {{(pid=128758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:17:12.701874 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-39caea87-be1c-4236-bdb5-7d2a5dc5774c tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 3c2f5d0d-16a5-4f33-8f02-a84296eb09ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:17:12.793524 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-39caea87-be1c-4236-bdb5-7d2a5dc5774c tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.507238 Sep 14 09:17:12.800093 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2738/5457] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 09:17:10 2022] POST /compute/v2.1/servers => generated 383 bytes in 2509 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 14 09:17:12.809829 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8f676b23-9926-47f8-9909-5189cb39f43d tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:12.810444 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-8f676b23-9926-47f8-9909-5189cb39f43d tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 3c2f5d0d-16a5-4f33-8f02-a84296eb09ef] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:13.001567 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-8f676b23-9926-47f8-9909-5189cb39f43d tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03dc827647f4483beb2e1b7888be608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229e11b3c1fe48b088d0f3c4bb7e2cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:13.013319 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-8f676b23-9926-47f8-9909-5189cb39f43d tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "GET /compute/v2.1/servers/3c2f5d0d-16a5-4f33-8f02-a84296eb09ef" status: 200 len: 1222 microversion: 2.1 time: 0.207228 Sep 14 09:17:13.027654 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2720/5458] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:17:12 2022] GET /compute/v2.1/servers/3c2f5d0d-16a5-4f33-8f02-a84296eb09ef => generated 1222 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:17:13.516315 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-4fd71ba3-f8a4-4f7e-a8e0-0f3b7f687bc8 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:13.517001 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-4fd71ba3-f8a4-4f7e-a8e0-0f3b7f687bc8 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] [instance: f31deffe-182e-46b5-9643-725b7d7b4561] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:14.036809 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-24b6b73c-4079-4e54-b1c4-6b1a376664d7 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:14.037713 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-24b6b73c-4079-4e54-b1c4-6b1a376664d7 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 3c2f5d0d-16a5-4f33-8f02-a84296eb09ef] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:14.654188 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-4fd71ba3-f8a4-4f7e-a8e0-0f3b7f687bc8 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17918433a3994b69a65999a59a7f833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b73b20f2042c6a08f94ed23ff66e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:14.670491 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-4fd71ba3-f8a4-4f7e-a8e0-0f3b7f687bc8 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] 10.222.0.60 "GET /compute/v2.1/servers/f31deffe-182e-46b5-9643-725b7d7b4561" status: 200 len: 1248 microversion: 2.1 time: 1.157043 Sep 14 09:17:14.674505 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2739/5459] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:17:13 2022] GET /compute/v2.1/servers/f31deffe-182e-46b5-9643-725b7d7b4561 => generated 1248 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:17:14.744887 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-24b6b73c-4079-4e54-b1c4-6b1a376664d7 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03dc827647f4483beb2e1b7888be608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229e11b3c1fe48b088d0f3c4bb7e2cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:14.756917 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-24b6b73c-4079-4e54-b1c4-6b1a376664d7 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "GET /compute/v2.1/servers/3c2f5d0d-16a5-4f33-8f02-a84296eb09ef" status: 200 len: 1222 microversion: 2.1 time: 0.723207 Sep 14 09:17:14.758206 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2721/5460] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:17:14 2022] GET /compute/v2.1/servers/3c2f5d0d-16a5-4f33-8f02-a84296eb09ef => generated 1222 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:17:15.701020 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-8575c220-5efe-445e-ad23-37238d4646ad tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:15.701656 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-8575c220-5efe-445e-ad23-37238d4646ad tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] [instance: f31deffe-182e-46b5-9643-725b7d7b4561] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:15.721424 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8575c220-5efe-445e-ad23-37238d4646ad tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:15.721938 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8575c220-5efe-445e-ad23-37238d4646ad tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:15.729230 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8575c220-5efe-445e-ad23-37238d4646ad tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:15.732968 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8575c220-5efe-445e-ad23-37238d4646ad tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:15.733845 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8575c220-5efe-445e-ad23-37238d4646ad tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:15.734310 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8575c220-5efe-445e-ad23-37238d4646ad tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:15.783965 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c6e04fbb-ecd0-4cc8-bc35-c19184e428d2 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:15.784591 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-c6e04fbb-ecd0-4cc8-bc35-c19184e428d2 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 3c2f5d0d-16a5-4f33-8f02-a84296eb09ef] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:15.807346 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c6e04fbb-ecd0-4cc8-bc35-c19184e428d2 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:15.808914 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c6e04fbb-ecd0-4cc8-bc35-c19184e428d2 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:15.810224 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c6e04fbb-ecd0-4cc8-bc35-c19184e428d2 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:15.813275 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c6e04fbb-ecd0-4cc8-bc35-c19184e428d2 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:15.819726 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c6e04fbb-ecd0-4cc8-bc35-c19184e428d2 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:15.821194 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c6e04fbb-ecd0-4cc8-bc35-c19184e428d2 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:16.232826 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-8575c220-5efe-445e-ad23-37238d4646ad tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17918433a3994b69a65999a59a7f833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b73b20f2042c6a08f94ed23ff66e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:16.243957 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-8575c220-5efe-445e-ad23-37238d4646ad tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] 10.222.0.60 "GET /compute/v2.1/servers/f31deffe-182e-46b5-9643-725b7d7b4561" status: 200 len: 1306 microversion: 2.1 time: 0.547596 Sep 14 09:17:16.261774 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2740/5461] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:17:15 2022] GET /compute/v2.1/servers/f31deffe-182e-46b5-9643-725b7d7b4561 => generated 1306 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:17:16.287537 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-c6e04fbb-ecd0-4cc8-bc35-c19184e428d2 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03dc827647f4483beb2e1b7888be608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229e11b3c1fe48b088d0f3c4bb7e2cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:16.303005 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-c6e04fbb-ecd0-4cc8-bc35-c19184e428d2 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "GET /compute/v2.1/servers/3c2f5d0d-16a5-4f33-8f02-a84296eb09ef" status: 200 len: 1274 microversion: 2.1 time: 0.526598 Sep 14 09:17:16.303640 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2722/5462] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:17:15 2022] GET /compute/v2.1/servers/3c2f5d0d-16a5-4f33-8f02-a84296eb09ef => generated 1274 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:17:16.360079 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-90af8205-68b2-4875-951a-ff1f447ed30b req-67893346-d416-4cdf-b700-3cc2f1929f13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80f0d7ed-260a-4c9d-a13b-be676b9edba0", "tag": "d05db12d-2504-41c6-af6a-8194cdcab027"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:17:16.387119 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-90af8205-68b2-4875-951a-ff1f447ed30b req-67893346-d416-4cdf-b700-3cc2f1929f13 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:16.390365 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-90af8205-68b2-4875-951a-ff1f447ed30b req-67893346-d416-4cdf-b700-3cc2f1929f13 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:16.390961 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-90af8205-68b2-4875-951a-ff1f447ed30b req-67893346-d416-4cdf-b700-3cc2f1929f13 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:16.419588 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-90af8205-68b2-4875-951a-ff1f447ed30b req-67893346-d416-4cdf-b700-3cc2f1929f13 service nova] Creating event network-changed:d05db12d-2504-41c6-af6a-8194cdcab027 for instance 80f0d7ed-260a-4c9d-a13b-be676b9edba0 on n-h2-836830-18 Sep 14 09:17:16.432149 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-90af8205-68b2-4875-951a-ff1f447ed30b req-67893346-d416-4cdf-b700-3cc2f1929f13 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078569 Sep 14 09:17:16.436998 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2741/5463] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:17:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:17:17.270146 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e74d54a7-3b5c-4fa0-ab02-839c203f6862 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:17.275840 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e74d54a7-3b5c-4fa0-ab02-839c203f6862 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] [instance: f31deffe-182e-46b5-9643-725b7d7b4561] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:17.293456 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e74d54a7-3b5c-4fa0-ab02-839c203f6862 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:17.294257 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e74d54a7-3b5c-4fa0-ab02-839c203f6862 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:17.295545 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e74d54a7-3b5c-4fa0-ab02-839c203f6862 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:17.299963 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e74d54a7-3b5c-4fa0-ab02-839c203f6862 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:17.300739 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e74d54a7-3b5c-4fa0-ab02-839c203f6862 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:17.301756 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e74d54a7-3b5c-4fa0-ab02-839c203f6862 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:17.339567 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-2e384015-3137-4d0a-a202-262d4765efed tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:17.340940 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-2e384015-3137-4d0a-a202-262d4765efed tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 3c2f5d0d-16a5-4f33-8f02-a84296eb09ef] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:17.436613 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2e384015-3137-4d0a-a202-262d4765efed tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:17.437123 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2e384015-3137-4d0a-a202-262d4765efed tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:17.449066 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2e384015-3137-4d0a-a202-262d4765efed tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:17.452237 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2e384015-3137-4d0a-a202-262d4765efed tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:17.456410 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2e384015-3137-4d0a-a202-262d4765efed tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:17.477764 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2e384015-3137-4d0a-a202-262d4765efed tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:17.871569 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-e74d54a7-3b5c-4fa0-ab02-839c203f6862 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17918433a3994b69a65999a59a7f833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b73b20f2042c6a08f94ed23ff66e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:17.883097 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e74d54a7-3b5c-4fa0-ab02-839c203f6862 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] 10.222.0.60 "GET /compute/v2.1/servers/f31deffe-182e-46b5-9643-725b7d7b4561" status: 200 len: 1306 microversion: 2.1 time: 0.616608 Sep 14 09:17:17.883608 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2723/5464] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:17:17 2022] GET /compute/v2.1/servers/f31deffe-182e-46b5-9643-725b7d7b4561 => generated 1306 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:17:18.058022 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-2e384015-3137-4d0a-a202-262d4765efed tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03dc827647f4483beb2e1b7888be608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229e11b3c1fe48b088d0f3c4bb7e2cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:18.085348 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-2e384015-3137-4d0a-a202-262d4765efed tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "GET /compute/v2.1/servers/3c2f5d0d-16a5-4f33-8f02-a84296eb09ef" status: 200 len: 1280 microversion: 2.1 time: 0.757121 Sep 14 09:17:18.090731 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2742/5465] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:17:17 2022] GET /compute/v2.1/servers/3c2f5d0d-16a5-4f33-8f02-a84296eb09ef => generated 1280 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:17:18.905991 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-80e4a350-022b-4eaa-9c7b-2a1cb9e7e750 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:18.906612 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-80e4a350-022b-4eaa-9c7b-2a1cb9e7e750 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] [instance: f31deffe-182e-46b5-9643-725b7d7b4561] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:18.920132 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-80e4a350-022b-4eaa-9c7b-2a1cb9e7e750 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:18.921513 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-80e4a350-022b-4eaa-9c7b-2a1cb9e7e750 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:18.923825 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-80e4a350-022b-4eaa-9c7b-2a1cb9e7e750 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:18.925506 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-80e4a350-022b-4eaa-9c7b-2a1cb9e7e750 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:18.928594 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-80e4a350-022b-4eaa-9c7b-2a1cb9e7e750 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:18.933877 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-80e4a350-022b-4eaa-9c7b-2a1cb9e7e750 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:19.120730 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-71dbb549-8472-46ff-a827-ea13b62bd8ed tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:19.121414 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-71dbb549-8472-46ff-a827-ea13b62bd8ed tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 3c2f5d0d-16a5-4f33-8f02-a84296eb09ef] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:19.136176 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-71dbb549-8472-46ff-a827-ea13b62bd8ed tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:19.139520 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-71dbb549-8472-46ff-a827-ea13b62bd8ed tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:19.140150 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-71dbb549-8472-46ff-a827-ea13b62bd8ed tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:19.141041 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-71dbb549-8472-46ff-a827-ea13b62bd8ed tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:19.145315 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-71dbb549-8472-46ff-a827-ea13b62bd8ed tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:19.145954 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-71dbb549-8472-46ff-a827-ea13b62bd8ed tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:19.717487 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-80e4a350-022b-4eaa-9c7b-2a1cb9e7e750 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17918433a3994b69a65999a59a7f833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b73b20f2042c6a08f94ed23ff66e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:19.726591 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-80e4a350-022b-4eaa-9c7b-2a1cb9e7e750 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] 10.222.0.60 "GET /compute/v2.1/servers/f31deffe-182e-46b5-9643-725b7d7b4561" status: 200 len: 1373 microversion: 2.1 time: 0.824391 Sep 14 09:17:19.750391 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2724/5466] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:17:18 2022] GET /compute/v2.1/servers/f31deffe-182e-46b5-9643-725b7d7b4561 => generated 1373 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:17:20.046360 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-71dbb549-8472-46ff-a827-ea13b62bd8ed tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03dc827647f4483beb2e1b7888be608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229e11b3c1fe48b088d0f3c4bb7e2cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:20.062764 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-71dbb549-8472-46ff-a827-ea13b62bd8ed tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "GET /compute/v2.1/servers/3c2f5d0d-16a5-4f33-8f02-a84296eb09ef" status: 200 len: 1322 microversion: 2.1 time: 0.950355 Sep 14 09:17:20.064134 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2743/5467] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:17:19 2022] GET /compute/v2.1/servers/3c2f5d0d-16a5-4f33-8f02-a84296eb09ef => generated 1322 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:17:20.775983 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-edd71cf3-c595-4505-a2f7-516d13833760 req-3fd9a43c-dd72-42c2-bb29-11b9f92617f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f31deffe-182e-46b5-9643-725b7d7b4561", "tag": "0190f876-37ba-4929-9e15-dd1e9c1f6cd4"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:17:20.778174 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a5d408fe-5c2b-4775-9c25-ee96bb9c820f tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:20.779697 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-a5d408fe-5c2b-4775-9c25-ee96bb9c820f tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] [instance: f31deffe-182e-46b5-9643-725b7d7b4561] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:20.817130 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a5d408fe-5c2b-4775-9c25-ee96bb9c820f tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:20.819862 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a5d408fe-5c2b-4775-9c25-ee96bb9c820f tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:20.821307 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a5d408fe-5c2b-4775-9c25-ee96bb9c820f tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:20.822467 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a5d408fe-5c2b-4775-9c25-ee96bb9c820f tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:20.822961 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a5d408fe-5c2b-4775-9c25-ee96bb9c820f tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:20.825302 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a5d408fe-5c2b-4775-9c25-ee96bb9c820f tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:20.827846 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-edd71cf3-c595-4505-a2f7-516d13833760 req-3fd9a43c-dd72-42c2-bb29-11b9f92617f2 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:20.833068 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-edd71cf3-c595-4505-a2f7-516d13833760 req-3fd9a43c-dd72-42c2-bb29-11b9f92617f2 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:20.836892 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-edd71cf3-c595-4505-a2f7-516d13833760 req-3fd9a43c-dd72-42c2-bb29-11b9f92617f2 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:20.851512 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-edd71cf3-c595-4505-a2f7-516d13833760 req-3fd9a43c-dd72-42c2-bb29-11b9f92617f2 service nova] Creating event network-changed:0190f876-37ba-4929-9e15-dd1e9c1f6cd4 for instance f31deffe-182e-46b5-9643-725b7d7b4561 on n-h1-836830-18 Sep 14 09:17:20.860440 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-edd71cf3-c595-4505-a2f7-516d13833760 req-3fd9a43c-dd72-42c2-bb29-11b9f92617f2 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106345 Sep 14 09:17:20.861672 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2725/5468] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:17:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:17:20.955717 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-cadd25f5-0f18-4393-b3e2-bae7fcb0eddc req-1a7ec576-ec06-44a9-aae9-f5b735bd4470 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80f0d7ed-260a-4c9d-a13b-be676b9edba0", "name": "network-vif-plugged", "status": "completed", "tag": "d05db12d-2504-41c6-af6a-8194cdcab027"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:17:20.981794 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-cadd25f5-0f18-4393-b3e2-bae7fcb0eddc req-1a7ec576-ec06-44a9-aae9-f5b735bd4470 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:20.982498 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-cadd25f5-0f18-4393-b3e2-bae7fcb0eddc req-1a7ec576-ec06-44a9-aae9-f5b735bd4470 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:20.982948 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-cadd25f5-0f18-4393-b3e2-bae7fcb0eddc req-1a7ec576-ec06-44a9-aae9-f5b735bd4470 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:21.005756 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-cadd25f5-0f18-4393-b3e2-bae7fcb0eddc req-1a7ec576-ec06-44a9-aae9-f5b735bd4470 service nova] Creating event network-vif-plugged:d05db12d-2504-41c6-af6a-8194cdcab027 for instance 80f0d7ed-260a-4c9d-a13b-be676b9edba0 on n-h2-836830-18 Sep 14 09:17:21.022454 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-cadd25f5-0f18-4393-b3e2-bae7fcb0eddc req-1a7ec576-ec06-44a9-aae9-f5b735bd4470 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071849 Sep 14 09:17:21.023638 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2726/5469] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:17:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:17:21.089312 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-7fb6fbc6-60b8-4a74-aa7a-ea10770848f1 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:21.090034 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-7fb6fbc6-60b8-4a74-aa7a-ea10770848f1 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 3c2f5d0d-16a5-4f33-8f02-a84296eb09ef] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:21.111156 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7fb6fbc6-60b8-4a74-aa7a-ea10770848f1 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:21.121307 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7fb6fbc6-60b8-4a74-aa7a-ea10770848f1 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:21.122834 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7fb6fbc6-60b8-4a74-aa7a-ea10770848f1 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:21.127972 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7fb6fbc6-60b8-4a74-aa7a-ea10770848f1 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:21.128720 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7fb6fbc6-60b8-4a74-aa7a-ea10770848f1 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:21.129332 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7fb6fbc6-60b8-4a74-aa7a-ea10770848f1 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:21.446452 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-a5d408fe-5c2b-4775-9c25-ee96bb9c820f tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17918433a3994b69a65999a59a7f833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b73b20f2042c6a08f94ed23ff66e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:21.459164 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-a5d408fe-5c2b-4775-9c25-ee96bb9c820f tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] 10.222.0.60 "GET /compute/v2.1/servers/f31deffe-182e-46b5-9643-725b7d7b4561" status: 200 len: 1373 microversion: 2.1 time: 0.695948 Sep 14 09:17:21.459841 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2744/5470] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:17:20 2022] GET /compute/v2.1/servers/f31deffe-182e-46b5-9643-725b7d7b4561 => generated 1373 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:17:21.511467 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-7fb6fbc6-60b8-4a74-aa7a-ea10770848f1 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03dc827647f4483beb2e1b7888be608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229e11b3c1fe48b088d0f3c4bb7e2cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:21.531683 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-7fb6fbc6-60b8-4a74-aa7a-ea10770848f1 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "GET /compute/v2.1/servers/3c2f5d0d-16a5-4f33-8f02-a84296eb09ef" status: 200 len: 1322 microversion: 2.1 time: 0.436121 Sep 14 09:17:21.542180 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2727/5471] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:17:21 2022] GET /compute/v2.1/servers/3c2f5d0d-16a5-4f33-8f02-a84296eb09ef => generated 1322 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:17:22.298914 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-775a4f62-8f30-4140-8542-a7a18a331202 req-e8a9c630-d2de-4b0c-a936-ab67a86bf5d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c2f5d0d-16a5-4f33-8f02-a84296eb09ef", "tag": "3563db43-cf81-42a5-b3d8-8411d4bd6b11"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:17:22.357033 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-775a4f62-8f30-4140-8542-a7a18a331202 req-e8a9c630-d2de-4b0c-a936-ab67a86bf5d9 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:22.358785 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-775a4f62-8f30-4140-8542-a7a18a331202 req-e8a9c630-d2de-4b0c-a936-ab67a86bf5d9 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:22.361327 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-775a4f62-8f30-4140-8542-a7a18a331202 req-e8a9c630-d2de-4b0c-a936-ab67a86bf5d9 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:22.387121 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-775a4f62-8f30-4140-8542-a7a18a331202 req-e8a9c630-d2de-4b0c-a936-ab67a86bf5d9 service nova] Creating event network-changed:3563db43-cf81-42a5-b3d8-8411d4bd6b11 for instance 3c2f5d0d-16a5-4f33-8f02-a84296eb09ef on n-h1-836830-18 Sep 14 09:17:22.395849 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-775a4f62-8f30-4140-8542-a7a18a331202 req-e8a9c630-d2de-4b0c-a936-ab67a86bf5d9 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109412 Sep 14 09:17:22.402854 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2745/5472] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:17:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:17:22.490646 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-624abb6e-0617-4095-99aa-ff7aca538417 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:22.499637 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-624abb6e-0617-4095-99aa-ff7aca538417 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] [instance: f31deffe-182e-46b5-9643-725b7d7b4561] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:22.505816 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=4 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:17:22.556425 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-20616a07-c080-4b9d-beac-e38c0bfaf600 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:22.558329 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-20616a07-c080-4b9d-beac-e38c0bfaf600 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 3c2f5d0d-16a5-4f33-8f02-a84296eb09ef] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:22.561827 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-624abb6e-0617-4095-99aa-ff7aca538417 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:22.574687 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-624abb6e-0617-4095-99aa-ff7aca538417 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:22.580969 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-20616a07-c080-4b9d-beac-e38c0bfaf600 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:22.581463 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-624abb6e-0617-4095-99aa-ff7aca538417 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:22.582639 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-20616a07-c080-4b9d-beac-e38c0bfaf600 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:22.583131 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-20616a07-c080-4b9d-beac-e38c0bfaf600 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:22.603541 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-20616a07-c080-4b9d-beac-e38c0bfaf600 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:22.603541 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-20616a07-c080-4b9d-beac-e38c0bfaf600 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:22.603541 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-20616a07-c080-4b9d-beac-e38c0bfaf600 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:22.604377 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-624abb6e-0617-4095-99aa-ff7aca538417 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:22.604377 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-624abb6e-0617-4095-99aa-ff7aca538417 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:22.604377 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-624abb6e-0617-4095-99aa-ff7aca538417 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:22.643630 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=2 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:17:22.970755 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-624abb6e-0617-4095-99aa-ff7aca538417 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17918433a3994b69a65999a59a7f833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b73b20f2042c6a08f94ed23ff66e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:22.982441 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-624abb6e-0617-4095-99aa-ff7aca538417 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] 10.222.0.60 "GET /compute/v2.1/servers/f31deffe-182e-46b5-9643-725b7d7b4561" status: 200 len: 1373 microversion: 2.1 time: 0.496960 Sep 14 09:17:22.983250 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2728/5473] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:17:22 2022] GET /compute/v2.1/servers/f31deffe-182e-46b5-9643-725b7d7b4561 => generated 1373 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:17:22.999544 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-cd5924cf-c15b-4342-accd-e7727c27ad49 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:23.004217 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-cd5924cf-c15b-4342-accd-e7727c27ad49 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [instance: 3ceabacb-cbf6-409a-8c82-55e9901bd8d7] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:23.020782 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cd5924cf-c15b-4342-accd-e7727c27ad49 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:23.024307 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cd5924cf-c15b-4342-accd-e7727c27ad49 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:23.025011 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cd5924cf-c15b-4342-accd-e7727c27ad49 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:23.026685 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cd5924cf-c15b-4342-accd-e7727c27ad49 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:23.028540 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cd5924cf-c15b-4342-accd-e7727c27ad49 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:23.029580 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cd5924cf-c15b-4342-accd-e7727c27ad49 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:23.040047 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-20616a07-c080-4b9d-beac-e38c0bfaf600 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03dc827647f4483beb2e1b7888be608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229e11b3c1fe48b088d0f3c4bb7e2cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:23.060303 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-20616a07-c080-4b9d-beac-e38c0bfaf600 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "GET /compute/v2.1/servers/3c2f5d0d-16a5-4f33-8f02-a84296eb09ef" status: 200 len: 1322 microversion: 2.1 time: 0.499033 Sep 14 09:17:23.063434 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2746/5474] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:17:22 2022] GET /compute/v2.1/servers/3c2f5d0d-16a5-4f33-8f02-a84296eb09ef => generated 1322 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:17:23.070818 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-cd5924cf-c15b-4342-accd-e7727c27ad49 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "GET /compute/v2.1/servers/3ceabacb-cbf6-409a-8c82-55e9901bd8d7/ips" status: 200 len: 150 microversion: 2.1 time: 0.084682 Sep 14 09:17:23.079195 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2729/5475] 10.222.0.60 () {58 vars in 1248 bytes} [Wed Sep 14 09:17:22 2022] GET /compute/v2.1/servers/3ceabacb-cbf6-409a-8c82-55e9901bd8d7/ips => generated 150 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:17:24.015774 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-16142e48-acad-48dd-8e27-cfdd78393aa6 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:24.016326 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-16142e48-acad-48dd-8e27-cfdd78393aa6 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] [instance: f31deffe-182e-46b5-9643-725b7d7b4561] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:24.060957 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-16142e48-acad-48dd-8e27-cfdd78393aa6 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:24.061880 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-16142e48-acad-48dd-8e27-cfdd78393aa6 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:24.063358 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-16142e48-acad-48dd-8e27-cfdd78393aa6 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:24.066708 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-16142e48-acad-48dd-8e27-cfdd78393aa6 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:24.082200 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-16142e48-acad-48dd-8e27-cfdd78393aa6 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:24.083210 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-16142e48-acad-48dd-8e27-cfdd78393aa6 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:24.097029 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9c0e30fc-6b74-4c6e-bc4f-b51665988a36 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:24.098349 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-9c0e30fc-6b74-4c6e-bc4f-b51665988a36 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 3c2f5d0d-16a5-4f33-8f02-a84296eb09ef] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:24.179864 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9c0e30fc-6b74-4c6e-bc4f-b51665988a36 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:24.199232 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9c0e30fc-6b74-4c6e-bc4f-b51665988a36 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:24.199907 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9c0e30fc-6b74-4c6e-bc4f-b51665988a36 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:24.200746 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9c0e30fc-6b74-4c6e-bc4f-b51665988a36 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:24.201164 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9c0e30fc-6b74-4c6e-bc4f-b51665988a36 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:24.201595 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9c0e30fc-6b74-4c6e-bc4f-b51665988a36 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:24.663769 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=14 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:17:24.751037 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=18 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:17:24.862591 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-16142e48-acad-48dd-8e27-cfdd78393aa6 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17918433a3994b69a65999a59a7f833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b73b20f2042c6a08f94ed23ff66e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:24.879860 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-16142e48-acad-48dd-8e27-cfdd78393aa6 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] 10.222.0.60 "GET /compute/v2.1/servers/f31deffe-182e-46b5-9643-725b7d7b4561" status: 200 len: 1373 microversion: 2.1 time: 0.871000 Sep 14 09:17:24.906614 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-9c0e30fc-6b74-4c6e-bc4f-b51665988a36 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03dc827647f4483beb2e1b7888be608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229e11b3c1fe48b088d0f3c4bb7e2cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:24.909940 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2747/5476] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:17:24 2022] GET /compute/v2.1/servers/f31deffe-182e-46b5-9643-725b7d7b4561 => generated 1373 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:17:24.918699 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-9c0e30fc-6b74-4c6e-bc4f-b51665988a36 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "GET /compute/v2.1/servers/3c2f5d0d-16a5-4f33-8f02-a84296eb09ef" status: 200 len: 1322 microversion: 2.1 time: 0.830763 Sep 14 09:17:24.919747 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2730/5477] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:17:24 2022] GET /compute/v2.1/servers/3c2f5d0d-16a5-4f33-8f02-a84296eb09ef => generated 1322 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:17:25.741209 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d6193a22-170c-4502-856f-b7cbb534d14b tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-939880629", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "networks": [{"uuid": "dac62360-12ea-49ca-a640-a53b55c7383f"}]}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:17:25.886770 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.network.neutron [None req-d6193a22-170c-4502-856f-b7cbb534d14b tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] validate_networks() for [('dac62360-12ea-49ca-a640-a53b55c7383f', None, None, None, None, None)] {{(pid=128758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:17:25.909169 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8c47976c-0fa5-47a3-a71b-afa5b168725d tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:25.909887 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-8c47976c-0fa5-47a3-a71b-afa5b168725d tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] [instance: f31deffe-182e-46b5-9643-725b7d7b4561] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:25.942998 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8c47976c-0fa5-47a3-a71b-afa5b168725d tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:25.942998 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8c47976c-0fa5-47a3-a71b-afa5b168725d tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:25.943504 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8c47976c-0fa5-47a3-a71b-afa5b168725d tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:25.946598 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8c47976c-0fa5-47a3-a71b-afa5b168725d tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:25.947129 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8c47976c-0fa5-47a3-a71b-afa5b168725d tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:25.948071 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8c47976c-0fa5-47a3-a71b-afa5b168725d tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:27.157959 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-8c47976c-0fa5-47a3-a71b-afa5b168725d tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17918433a3994b69a65999a59a7f833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b73b20f2042c6a08f94ed23ff66e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:27.168843 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-8c47976c-0fa5-47a3-a71b-afa5b168725d tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] 10.222.0.60 "GET /compute/v2.1/servers/f31deffe-182e-46b5-9643-725b7d7b4561" status: 200 len: 1373 microversion: 2.1 time: 1.264705 Sep 14 09:17:27.201554 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2731/5478] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:17:25 2022] GET /compute/v2.1/servers/f31deffe-182e-46b5-9643-725b7d7b4561 => generated 1373 bytes in 1298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:17:27.208272 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-7588bf6a-9a40-4834-89e2-2a3221a5016e tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:27.219951 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-7588bf6a-9a40-4834-89e2-2a3221a5016e tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 3c2f5d0d-16a5-4f33-8f02-a84296eb09ef] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:27.228145 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7588bf6a-9a40-4834-89e2-2a3221a5016e tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:27.229021 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7588bf6a-9a40-4834-89e2-2a3221a5016e tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:27.229931 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7588bf6a-9a40-4834-89e2-2a3221a5016e tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:27.231064 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7588bf6a-9a40-4834-89e2-2a3221a5016e tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:27.231879 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7588bf6a-9a40-4834-89e2-2a3221a5016e tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:27.233162 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7588bf6a-9a40-4834-89e2-2a3221a5016e tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:27.776535 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-7588bf6a-9a40-4834-89e2-2a3221a5016e tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03dc827647f4483beb2e1b7888be608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229e11b3c1fe48b088d0f3c4bb7e2cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:27.792566 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-7588bf6a-9a40-4834-89e2-2a3221a5016e tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "GET /compute/v2.1/servers/3c2f5d0d-16a5-4f33-8f02-a84296eb09ef" status: 200 len: 1322 microversion: 2.1 time: 0.589416 Sep 14 09:17:27.803380 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-d6193a22-170c-4502-856f-b7cbb534d14b tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Flavor limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:17:27.804474 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-d6193a22-170c-4502-856f-b7cbb534d14b tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Image limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:17:27.805190 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-d6193a22-170c-4502-856f-b7cbb534d14b tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Flavor pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:17:27.805810 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-d6193a22-170c-4502-856f-b7cbb534d14b tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Image pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:17:27.806415 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2732/5479] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:17:27 2022] GET /compute/v2.1/servers/3c2f5d0d-16a5-4f33-8f02-a84296eb09ef => generated 1322 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:17:27.806691 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-d6193a22-170c-4502-856f-b7cbb534d14b tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:17:27.814346 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-eeb98111-2e45-4a16-b67d-12a6905e3071 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "50567dc2-707f-44df-b47b-d99897b1f1c7"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:17:27.817392 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-eeb98111-2e45-4a16-b67d-12a6905e3071 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [instance: 3ceabacb-cbf6-409a-8c82-55e9901bd8d7] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:27.824873 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-eeb98111-2e45-4a16-b67d-12a6905e3071 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:27.826008 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-eeb98111-2e45-4a16-b67d-12a6905e3071 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:27.826834 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-eeb98111-2e45-4a16-b67d-12a6905e3071 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:27.828372 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-eeb98111-2e45-4a16-b67d-12a6905e3071 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:27.829536 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-eeb98111-2e45-4a16-b67d-12a6905e3071 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:27.830160 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-eeb98111-2e45-4a16-b67d-12a6905e3071 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:27.839725 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d6193a22-170c-4502-856f-b7cbb534d14b tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:27.843416 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d6193a22-170c-4502-856f-b7cbb534d14b tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:27.843926 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d6193a22-170c-4502-856f-b7cbb534d14b tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:27.851392 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d6193a22-170c-4502-856f-b7cbb534d14b tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:27.852085 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d6193a22-170c-4502-856f-b7cbb534d14b tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:27.852636 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d6193a22-170c-4502-856f-b7cbb534d14b tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:27.909712 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-d6193a22-170c-4502-856f-b7cbb534d14b tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Getting quotas for project 101dd9bc525c4a91a5ac4d7c653bbcbe. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:17:27.923978 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-d6193a22-170c-4502-856f-b7cbb534d14b tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Getting quotas for user 6eee489741984db7a55454c253d1781d and project 101dd9bc525c4a91a5ac4d7c653bbcbe. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:17:27.947620 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-d6193a22-170c-4502-856f-b7cbb534d14b tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Going to run 1 instances... {{(pid=128758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:17:27.957759 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-d6193a22-170c-4502-856f-b7cbb534d14b tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] [instance: 53243bcd-4f54-4e0d-a3a9-52e273f20504] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:17:28.090852 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-d6193a22-170c-4502-856f-b7cbb534d14b tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.732933 Sep 14 09:17:28.103442 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2748/5480] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 09:17:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 2746 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:17:28.111173 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-dd598e79-1b43-4f36-8095-da62e22862ee tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:28.111841 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-dd598e79-1b43-4f36-8095-da62e22862ee tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] [instance: 53243bcd-4f54-4e0d-a3a9-52e273f20504] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:28.207626 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-dd598e79-1b43-4f36-8095-da62e22862ee tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eee489741984db7a55454c253d1781d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '101dd9bc525c4a91a5ac4d7c653bbcbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:28.226256 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-dd598e79-1b43-4f36-8095-da62e22862ee tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] 10.222.0.60 "GET /compute/v2.1/servers/53243bcd-4f54-4e0d-a3a9-52e273f20504" status: 200 len: 1216 microversion: 2.1 time: 0.120854 Sep 14 09:17:28.227094 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2749/5481] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:17:28 2022] GET /compute/v2.1/servers/53243bcd-4f54-4e0d-a3a9-52e273f20504 => generated 1216 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:17:28.237726 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-78524387-5a1a-4591-8f85-1168075eeee9 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:28.242568 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-78524387-5a1a-4591-8f85-1168075eeee9 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] [instance: f31deffe-182e-46b5-9643-725b7d7b4561] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:28.259085 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-78524387-5a1a-4591-8f85-1168075eeee9 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:28.259843 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-78524387-5a1a-4591-8f85-1168075eeee9 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:28.261158 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-78524387-5a1a-4591-8f85-1168075eeee9 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:28.262415 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-78524387-5a1a-4591-8f85-1168075eeee9 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:28.263378 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-78524387-5a1a-4591-8f85-1168075eeee9 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:28.264424 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-78524387-5a1a-4591-8f85-1168075eeee9 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:28.706862 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-78524387-5a1a-4591-8f85-1168075eeee9 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17918433a3994b69a65999a59a7f833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b73b20f2042c6a08f94ed23ff66e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:28.720749 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-78524387-5a1a-4591-8f85-1168075eeee9 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] 10.222.0.60 "GET /compute/v2.1/servers/f31deffe-182e-46b5-9643-725b7d7b4561" status: 200 len: 1373 microversion: 2.1 time: 0.491223 Sep 14 09:17:28.723308 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2750/5482] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:17:28 2022] GET /compute/v2.1/servers/f31deffe-182e-46b5-9643-725b7d7b4561 => generated 1373 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:17:28.825720 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-0219ed85-16fc-43dc-ba36-4137f5b9c883 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:28.831150 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-0219ed85-16fc-43dc-ba36-4137f5b9c883 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 3c2f5d0d-16a5-4f33-8f02-a84296eb09ef] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:28.841228 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0219ed85-16fc-43dc-ba36-4137f5b9c883 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:28.843425 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0219ed85-16fc-43dc-ba36-4137f5b9c883 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:28.846910 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0219ed85-16fc-43dc-ba36-4137f5b9c883 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:28.847968 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0219ed85-16fc-43dc-ba36-4137f5b9c883 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:28.848541 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0219ed85-16fc-43dc-ba36-4137f5b9c883 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:28.849077 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0219ed85-16fc-43dc-ba36-4137f5b9c883 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:29.111457 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-0219ed85-16fc-43dc-ba36-4137f5b9c883 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03dc827647f4483beb2e1b7888be608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229e11b3c1fe48b088d0f3c4bb7e2cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:29.121918 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-0219ed85-16fc-43dc-ba36-4137f5b9c883 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "GET /compute/v2.1/servers/3c2f5d0d-16a5-4f33-8f02-a84296eb09ef" status: 200 len: 1322 microversion: 2.1 time: 0.304139 Sep 14 09:17:29.139509 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2751/5483] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:17:28 2022] GET /compute/v2.1/servers/3c2f5d0d-16a5-4f33-8f02-a84296eb09ef => generated 1322 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:17:29.257192 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-25567c9e-5ece-4204-acc8-9980601b6439 tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:29.258384 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-25567c9e-5ece-4204-acc8-9980601b6439 tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] [instance: 53243bcd-4f54-4e0d-a3a9-52e273f20504] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:29.268112 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-25567c9e-5ece-4204-acc8-9980601b6439 tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:29.268913 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-25567c9e-5ece-4204-acc8-9980601b6439 tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:29.270414 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-25567c9e-5ece-4204-acc8-9980601b6439 tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:29.272215 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-25567c9e-5ece-4204-acc8-9980601b6439 tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:29.272928 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-25567c9e-5ece-4204-acc8-9980601b6439 tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:29.273588 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-25567c9e-5ece-4204-acc8-9980601b6439 tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:29.398460 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-25567c9e-5ece-4204-acc8-9980601b6439 tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eee489741984db7a55454c253d1781d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '101dd9bc525c4a91a5ac4d7c653bbcbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:29.411437 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-25567c9e-5ece-4204-acc8-9980601b6439 tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] 10.222.0.60 "GET /compute/v2.1/servers/53243bcd-4f54-4e0d-a3a9-52e273f20504" status: 200 len: 1212 microversion: 2.1 time: 0.160932 Sep 14 09:17:29.413400 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2752/5484] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:17:29 2022] GET /compute/v2.1/servers/53243bcd-4f54-4e0d-a3a9-52e273f20504 => generated 1212 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:17:29.752248 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-7e7da43f-fffd-4441-a3dc-9403a81c896a tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:29.752884 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-7e7da43f-fffd-4441-a3dc-9403a81c896a tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] [instance: f31deffe-182e-46b5-9643-725b7d7b4561] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:29.768537 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7e7da43f-fffd-4441-a3dc-9403a81c896a tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:29.769043 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7e7da43f-fffd-4441-a3dc-9403a81c896a tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:29.769487 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7e7da43f-fffd-4441-a3dc-9403a81c896a tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:29.770205 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7e7da43f-fffd-4441-a3dc-9403a81c896a tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:29.770668 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7e7da43f-fffd-4441-a3dc-9403a81c896a tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:29.775282 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7e7da43f-fffd-4441-a3dc-9403a81c896a tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:30.058128 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-7e7da43f-fffd-4441-a3dc-9403a81c896a tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17918433a3994b69a65999a59a7f833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b73b20f2042c6a08f94ed23ff66e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:30.067080 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-7e7da43f-fffd-4441-a3dc-9403a81c896a tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] 10.222.0.60 "GET /compute/v2.1/servers/f31deffe-182e-46b5-9643-725b7d7b4561" status: 200 len: 1373 microversion: 2.1 time: 0.321270 Sep 14 09:17:30.069148 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2753/5485] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:17:29 2022] GET /compute/v2.1/servers/f31deffe-182e-46b5-9643-725b7d7b4561 => generated 1373 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:17:30.151741 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-47e9d661-78ea-4617-8b3f-b83afd308c3e tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:30.156298 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-47e9d661-78ea-4617-8b3f-b83afd308c3e tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 3c2f5d0d-16a5-4f33-8f02-a84296eb09ef] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:30.190246 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-47e9d661-78ea-4617-8b3f-b83afd308c3e tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:30.191035 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-47e9d661-78ea-4617-8b3f-b83afd308c3e tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:30.191684 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-47e9d661-78ea-4617-8b3f-b83afd308c3e tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:30.192919 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-47e9d661-78ea-4617-8b3f-b83afd308c3e tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:30.194064 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-47e9d661-78ea-4617-8b3f-b83afd308c3e tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:30.195060 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-47e9d661-78ea-4617-8b3f-b83afd308c3e tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:30.517304 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-47e9d661-78ea-4617-8b3f-b83afd308c3e tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03dc827647f4483beb2e1b7888be608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229e11b3c1fe48b088d0f3c4bb7e2cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:30.530837 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-47e9d661-78ea-4617-8b3f-b83afd308c3e tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "GET /compute/v2.1/servers/3c2f5d0d-16a5-4f33-8f02-a84296eb09ef" status: 200 len: 1322 microversion: 2.1 time: 0.387793 Sep 14 09:17:30.548682 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2754/5486] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:17:30 2022] GET /compute/v2.1/servers/3c2f5d0d-16a5-4f33-8f02-a84296eb09ef => generated 1322 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:17:30.564733 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-cfdf1015-bc4c-4c2a-8ac4-e767a4898021 tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:30.565819 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-cfdf1015-bc4c-4c2a-8ac4-e767a4898021 tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] [instance: 53243bcd-4f54-4e0d-a3a9-52e273f20504] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:30.591606 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cfdf1015-bc4c-4c2a-8ac4-e767a4898021 tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:30.595166 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cfdf1015-bc4c-4c2a-8ac4-e767a4898021 tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:30.595857 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cfdf1015-bc4c-4c2a-8ac4-e767a4898021 tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:30.596778 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cfdf1015-bc4c-4c2a-8ac4-e767a4898021 tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:30.597246 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cfdf1015-bc4c-4c2a-8ac4-e767a4898021 tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:30.600740 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cfdf1015-bc4c-4c2a-8ac4-e767a4898021 tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:30.751538 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-cfdf1015-bc4c-4c2a-8ac4-e767a4898021 tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eee489741984db7a55454c253d1781d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '101dd9bc525c4a91a5ac4d7c653bbcbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:30.767193 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-cfdf1015-bc4c-4c2a-8ac4-e767a4898021 tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] 10.222.0.60 "GET /compute/v2.1/servers/53243bcd-4f54-4e0d-a3a9-52e273f20504" status: 200 len: 1274 microversion: 2.1 time: 0.216972 Sep 14 09:17:30.772154 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2755/5487] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:17:30 2022] GET /compute/v2.1/servers/53243bcd-4f54-4e0d-a3a9-52e273f20504 => generated 1274 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:17:30.829696 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-61430937-83cb-4540-8788-0413173a9427 req-a8e585bf-4b50-47d6-95ee-ba406ab1e123 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f31deffe-182e-46b5-9643-725b7d7b4561", "name": "network-vif-plugged", "status": "completed", "tag": "0190f876-37ba-4929-9e15-dd1e9c1f6cd4"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:17:30.851049 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-61430937-83cb-4540-8788-0413173a9427 req-a8e585bf-4b50-47d6-95ee-ba406ab1e123 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:30.860101 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-61430937-83cb-4540-8788-0413173a9427 req-a8e585bf-4b50-47d6-95ee-ba406ab1e123 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:30.866824 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-61430937-83cb-4540-8788-0413173a9427 req-a8e585bf-4b50-47d6-95ee-ba406ab1e123 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:30.911698 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-61430937-83cb-4540-8788-0413173a9427 req-a8e585bf-4b50-47d6-95ee-ba406ab1e123 service nova] Creating event network-vif-plugged:0190f876-37ba-4929-9e15-dd1e9c1f6cd4 for instance f31deffe-182e-46b5-9643-725b7d7b4561 on n-h1-836830-18 Sep 14 09:17:30.919597 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-61430937-83cb-4540-8788-0413173a9427 req-a8e585bf-4b50-47d6-95ee-ba406ab1e123 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093328 Sep 14 09:17:30.921308 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2756/5488] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:17:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:17:30.963198 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-eeb98111-2e45-4a16-b67d-12a6905e3071 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "POST /compute/v2.1/servers/3ceabacb-cbf6-409a-8c82-55e9901bd8d7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.155185 Sep 14 09:17:30.965056 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2733/5489] 10.222.0.60 () {60 vars in 1323 bytes} [Wed Sep 14 09:17:27 2022] POST /compute/v2.1/servers/3ceabacb-cbf6-409a-8c82-55e9901bd8d7/os-volume_attachments => generated 194 bytes in 3158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:17:31.111165 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-caf5b97f-3008-4eaa-aca0-124a66379e86 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:31.111165 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-caf5b97f-3008-4eaa-aca0-124a66379e86 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] [instance: f31deffe-182e-46b5-9643-725b7d7b4561] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:31.118839 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-caf5b97f-3008-4eaa-aca0-124a66379e86 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:31.121334 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-caf5b97f-3008-4eaa-aca0-124a66379e86 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:31.121870 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-caf5b97f-3008-4eaa-aca0-124a66379e86 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:31.122619 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-caf5b97f-3008-4eaa-aca0-124a66379e86 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:31.127881 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-caf5b97f-3008-4eaa-aca0-124a66379e86 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:31.128320 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-caf5b97f-3008-4eaa-aca0-124a66379e86 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:31.482106 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-caf5b97f-3008-4eaa-aca0-124a66379e86 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17918433a3994b69a65999a59a7f833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b73b20f2042c6a08f94ed23ff66e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:31.491077 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-caf5b97f-3008-4eaa-aca0-124a66379e86 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] 10.222.0.60 "GET /compute/v2.1/servers/f31deffe-182e-46b5-9643-725b7d7b4561" status: 200 len: 1373 microversion: 2.1 time: 0.395218 Sep 14 09:17:31.507167 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2757/5490] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:17:31 2022] GET /compute/v2.1/servers/f31deffe-182e-46b5-9643-725b7d7b4561 => generated 1373 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:17:31.568764 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-cce4a43b-61a8-4cae-b3a2-1e50c5f91cb7 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:31.570220 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-cce4a43b-61a8-4cae-b3a2-1e50c5f91cb7 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 3c2f5d0d-16a5-4f33-8f02-a84296eb09ef] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:31.591254 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cce4a43b-61a8-4cae-b3a2-1e50c5f91cb7 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:31.600338 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cce4a43b-61a8-4cae-b3a2-1e50c5f91cb7 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:31.603480 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cce4a43b-61a8-4cae-b3a2-1e50c5f91cb7 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:31.607215 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cce4a43b-61a8-4cae-b3a2-1e50c5f91cb7 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:31.607865 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cce4a43b-61a8-4cae-b3a2-1e50c5f91cb7 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:31.612228 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cce4a43b-61a8-4cae-b3a2-1e50c5f91cb7 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:31.802137 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-788ecea3-6784-43ee-b711-3f59d666429b tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:31.802911 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-788ecea3-6784-43ee-b711-3f59d666429b tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] [instance: 53243bcd-4f54-4e0d-a3a9-52e273f20504] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:31.812631 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-788ecea3-6784-43ee-b711-3f59d666429b tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:31.826335 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-788ecea3-6784-43ee-b711-3f59d666429b tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:31.827741 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-788ecea3-6784-43ee-b711-3f59d666429b tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:31.828929 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-788ecea3-6784-43ee-b711-3f59d666429b tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:31.829680 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-788ecea3-6784-43ee-b711-3f59d666429b tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:31.831553 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-788ecea3-6784-43ee-b711-3f59d666429b tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:31.931851 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-cce4a43b-61a8-4cae-b3a2-1e50c5f91cb7 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03dc827647f4483beb2e1b7888be608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229e11b3c1fe48b088d0f3c4bb7e2cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:31.943805 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-cce4a43b-61a8-4cae-b3a2-1e50c5f91cb7 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "GET /compute/v2.1/servers/3c2f5d0d-16a5-4f33-8f02-a84296eb09ef" status: 200 len: 1322 microversion: 2.1 time: 0.382932 Sep 14 09:17:31.949450 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2734/5491] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:17:31 2022] GET /compute/v2.1/servers/3c2f5d0d-16a5-4f33-8f02-a84296eb09ef => generated 1322 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:17:32.127131 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-788ecea3-6784-43ee-b711-3f59d666429b tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eee489741984db7a55454c253d1781d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '101dd9bc525c4a91a5ac4d7c653bbcbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:32.138121 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-788ecea3-6784-43ee-b711-3f59d666429b tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] 10.222.0.60 "GET /compute/v2.1/servers/53243bcd-4f54-4e0d-a3a9-52e273f20504" status: 200 len: 1316 microversion: 2.1 time: 0.341962 Sep 14 09:17:32.159468 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2758/5492] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:17:31 2022] GET /compute/v2.1/servers/53243bcd-4f54-4e0d-a3a9-52e273f20504 => generated 1316 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:17:32.531125 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c4167979-d66e-4387-b71d-8ec333ebf472 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:32.531761 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-c4167979-d66e-4387-b71d-8ec333ebf472 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] [instance: f31deffe-182e-46b5-9643-725b7d7b4561] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:32.539921 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c4167979-d66e-4387-b71d-8ec333ebf472 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:32.541423 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c4167979-d66e-4387-b71d-8ec333ebf472 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:32.543280 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c4167979-d66e-4387-b71d-8ec333ebf472 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:32.544414 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c4167979-d66e-4387-b71d-8ec333ebf472 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:32.546535 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c4167979-d66e-4387-b71d-8ec333ebf472 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:32.547248 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c4167979-d66e-4387-b71d-8ec333ebf472 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:32.979245 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-168cd123-a4ca-4885-b487-5ceb33222994 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:32.980290 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-168cd123-a4ca-4885-b487-5ceb33222994 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 3c2f5d0d-16a5-4f33-8f02-a84296eb09ef] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:33.000542 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-c4167979-d66e-4387-b71d-8ec333ebf472 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17918433a3994b69a65999a59a7f833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b73b20f2042c6a08f94ed23ff66e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:33.004120 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-168cd123-a4ca-4885-b487-5ceb33222994 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:33.005615 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-168cd123-a4ca-4885-b487-5ceb33222994 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:33.007936 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-168cd123-a4ca-4885-b487-5ceb33222994 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:33.010142 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-168cd123-a4ca-4885-b487-5ceb33222994 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:33.018120 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-c4167979-d66e-4387-b71d-8ec333ebf472 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] 10.222.0.60 "GET /compute/v2.1/servers/f31deffe-182e-46b5-9643-725b7d7b4561" status: 200 len: 1373 microversion: 2.1 time: 0.491203 Sep 14 09:17:33.034429 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-168cd123-a4ca-4885-b487-5ceb33222994 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:33.035021 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2735/5493] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:17:32 2022] GET /compute/v2.1/servers/f31deffe-182e-46b5-9643-725b7d7b4561 => generated 1373 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:17:33.035493 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-168cd123-a4ca-4885-b487-5ceb33222994 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:33.167589 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8061b564-f508-4573-a444-21f4e14124f5 tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:33.168686 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-8061b564-f508-4573-a444-21f4e14124f5 tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] [instance: 53243bcd-4f54-4e0d-a3a9-52e273f20504] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:33.179117 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8061b564-f508-4573-a444-21f4e14124f5 tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:33.183781 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8061b564-f508-4573-a444-21f4e14124f5 tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:33.184747 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8061b564-f508-4573-a444-21f4e14124f5 tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:33.185753 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8061b564-f508-4573-a444-21f4e14124f5 tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:33.187689 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8061b564-f508-4573-a444-21f4e14124f5 tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:33.188464 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8061b564-f508-4573-a444-21f4e14124f5 tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:33.373087 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-168cd123-a4ca-4885-b487-5ceb33222994 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03dc827647f4483beb2e1b7888be608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229e11b3c1fe48b088d0f3c4bb7e2cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:33.376763 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=100 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:17:33.385214 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-168cd123-a4ca-4885-b487-5ceb33222994 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "GET /compute/v2.1/servers/3c2f5d0d-16a5-4f33-8f02-a84296eb09ef" status: 200 len: 1322 microversion: 2.1 time: 0.413364 Sep 14 09:17:33.385817 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2759/5494] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:17:32 2022] GET /compute/v2.1/servers/3c2f5d0d-16a5-4f33-8f02-a84296eb09ef => generated 1322 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:17:33.468609 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-6c297987-f65f-4263-8612-e8778f6632c3 req-38ae0935-292f-4b76-ae5f-804932f7a239 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53243bcd-4f54-4e0d-a3a9-52e273f20504", "tag": "7f2aa605-ffb0-497b-9fe2-69a397a4b22e"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:17:33.487099 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-8061b564-f508-4573-a444-21f4e14124f5 tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eee489741984db7a55454c253d1781d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '101dd9bc525c4a91a5ac4d7c653bbcbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:33.488894 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-6c297987-f65f-4263-8612-e8778f6632c3 req-38ae0935-292f-4b76-ae5f-804932f7a239 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:33.491979 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-6c297987-f65f-4263-8612-e8778f6632c3 req-38ae0935-292f-4b76-ae5f-804932f7a239 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:33.494225 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-6c297987-f65f-4263-8612-e8778f6632c3 req-38ae0935-292f-4b76-ae5f-804932f7a239 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:33.496255 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-8061b564-f508-4573-a444-21f4e14124f5 tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] 10.222.0.60 "GET /compute/v2.1/servers/53243bcd-4f54-4e0d-a3a9-52e273f20504" status: 200 len: 1316 microversion: 2.1 time: 0.333371 Sep 14 09:17:33.511505 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2736/5495] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:17:33 2022] GET /compute/v2.1/servers/53243bcd-4f54-4e0d-a3a9-52e273f20504 => generated 1316 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:17:33.515684 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-6c297987-f65f-4263-8612-e8778f6632c3 req-38ae0935-292f-4b76-ae5f-804932f7a239 service nova] Creating event network-changed:7f2aa605-ffb0-497b-9fe2-69a397a4b22e for instance 53243bcd-4f54-4e0d-a3a9-52e273f20504 on n-h2-836830-18 Sep 14 09:17:33.532218 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-6c297987-f65f-4263-8612-e8778f6632c3 req-38ae0935-292f-4b76-ae5f-804932f7a239 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082712 Sep 14 09:17:33.533126 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2760/5496] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:17:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:17:34.045167 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-6926df69-dd61-4be7-b812-0a735f710c51 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:34.046532 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-6926df69-dd61-4be7-b812-0a735f710c51 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] [instance: f31deffe-182e-46b5-9643-725b7d7b4561] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:34.056791 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6926df69-dd61-4be7-b812-0a735f710c51 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:34.057663 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6926df69-dd61-4be7-b812-0a735f710c51 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:34.058530 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6926df69-dd61-4be7-b812-0a735f710c51 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:34.060085 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6926df69-dd61-4be7-b812-0a735f710c51 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:34.061040 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6926df69-dd61-4be7-b812-0a735f710c51 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:34.061800 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6926df69-dd61-4be7-b812-0a735f710c51 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:34.246354 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-6926df69-dd61-4be7-b812-0a735f710c51 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17918433a3994b69a65999a59a7f833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b73b20f2042c6a08f94ed23ff66e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:34.273201 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-6926df69-dd61-4be7-b812-0a735f710c51 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] 10.222.0.60 "GET /compute/v2.1/servers/f31deffe-182e-46b5-9643-725b7d7b4561" status: 200 len: 1545 microversion: 2.1 time: 0.231156 Sep 14 09:17:34.277588 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2737/5497] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:17:34 2022] GET /compute/v2.1/servers/f31deffe-182e-46b5-9643-725b7d7b4561 => generated 1545 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:17:34.308826 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-f2fd609d-55fc-479f-9d8d-939beab8d611 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:34.309662 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-f2fd609d-55fc-479f-9d8d-939beab8d611 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] [instance: f31deffe-182e-46b5-9643-725b7d7b4561] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:34.326807 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f2fd609d-55fc-479f-9d8d-939beab8d611 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:34.327545 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f2fd609d-55fc-479f-9d8d-939beab8d611 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:34.328110 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f2fd609d-55fc-479f-9d8d-939beab8d611 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:34.329026 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f2fd609d-55fc-479f-9d8d-939beab8d611 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:34.329699 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f2fd609d-55fc-479f-9d8d-939beab8d611 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:34.330157 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f2fd609d-55fc-479f-9d8d-939beab8d611 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:34.410216 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-04b9a339-9a0d-46d4-9149-dbb7fe0e01a6 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:34.411356 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-04b9a339-9a0d-46d4-9149-dbb7fe0e01a6 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 3c2f5d0d-16a5-4f33-8f02-a84296eb09ef] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:34.426729 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-04b9a339-9a0d-46d4-9149-dbb7fe0e01a6 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:34.428093 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-04b9a339-9a0d-46d4-9149-dbb7fe0e01a6 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:34.428763 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-04b9a339-9a0d-46d4-9149-dbb7fe0e01a6 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:34.429689 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-04b9a339-9a0d-46d4-9149-dbb7fe0e01a6 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:34.430347 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-04b9a339-9a0d-46d4-9149-dbb7fe0e01a6 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:34.431034 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-04b9a339-9a0d-46d4-9149-dbb7fe0e01a6 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:34.446042 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:17:34.600732 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-f2fd609d-55fc-479f-9d8d-939beab8d611 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17918433a3994b69a65999a59a7f833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b73b20f2042c6a08f94ed23ff66e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:34.609546 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-f2fd609d-55fc-479f-9d8d-939beab8d611 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] 10.222.0.60 "GET /compute/v2.1/servers/f31deffe-182e-46b5-9643-725b7d7b4561" status: 200 len: 1545 microversion: 2.1 time: 0.305192 Sep 14 09:17:34.609546 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2761/5498] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:17:34 2022] GET /compute/v2.1/servers/f31deffe-182e-46b5-9643-725b7d7b4561 => generated 1545 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:17:34.621895 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-51cacb86-8099-4951-a6e3-4860aca23cca tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:34.622608 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-51cacb86-8099-4951-a6e3-4860aca23cca tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] [instance: 53243bcd-4f54-4e0d-a3a9-52e273f20504] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:34.639411 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-51cacb86-8099-4951-a6e3-4860aca23cca tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:34.639904 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-51cacb86-8099-4951-a6e3-4860aca23cca tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:34.640342 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-51cacb86-8099-4951-a6e3-4860aca23cca tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:34.641057 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-51cacb86-8099-4951-a6e3-4860aca23cca tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:34.641618 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-51cacb86-8099-4951-a6e3-4860aca23cca tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:34.642042 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-51cacb86-8099-4951-a6e3-4860aca23cca tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:34.788009 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-04b9a339-9a0d-46d4-9149-dbb7fe0e01a6 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03dc827647f4483beb2e1b7888be608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229e11b3c1fe48b088d0f3c4bb7e2cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:34.801588 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-04b9a339-9a0d-46d4-9149-dbb7fe0e01a6 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "GET /compute/v2.1/servers/3c2f5d0d-16a5-4f33-8f02-a84296eb09ef" status: 200 len: 1322 microversion: 2.1 time: 0.395629 Sep 14 09:17:34.802203 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2738/5499] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:17:34 2022] GET /compute/v2.1/servers/3c2f5d0d-16a5-4f33-8f02-a84296eb09ef => generated 1322 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:17:34.822395 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-79ad8028-1190-45dd-a3d8-2ba7dcb4af70 req-aba90664-adc0-4268-9f5c-13e3c252c65c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c2f5d0d-16a5-4f33-8f02-a84296eb09ef", "name": "network-vif-plugged", "status": "completed", "tag": "3563db43-cf81-42a5-b3d8-8411d4bd6b11"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:17:34.832142 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-79ad8028-1190-45dd-a3d8-2ba7dcb4af70 req-aba90664-adc0-4268-9f5c-13e3c252c65c service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:34.832698 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-79ad8028-1190-45dd-a3d8-2ba7dcb4af70 req-aba90664-adc0-4268-9f5c-13e3c252c65c service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:34.833141 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-79ad8028-1190-45dd-a3d8-2ba7dcb4af70 req-aba90664-adc0-4268-9f5c-13e3c252c65c service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:34.844940 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-79ad8028-1190-45dd-a3d8-2ba7dcb4af70 req-aba90664-adc0-4268-9f5c-13e3c252c65c service nova] Creating event network-vif-plugged:3563db43-cf81-42a5-b3d8-8411d4bd6b11 for instance 3c2f5d0d-16a5-4f33-8f02-a84296eb09ef on n-h1-836830-18 Sep 14 09:17:34.850624 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-79ad8028-1190-45dd-a3d8-2ba7dcb4af70 req-aba90664-adc0-4268-9f5c-13e3c252c65c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032225 Sep 14 09:17:34.851312 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2739/5500] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:17:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:17:34.975210 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-51cacb86-8099-4951-a6e3-4860aca23cca tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eee489741984db7a55454c253d1781d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '101dd9bc525c4a91a5ac4d7c653bbcbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:34.988677 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-51cacb86-8099-4951-a6e3-4860aca23cca tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] 10.222.0.60 "GET /compute/v2.1/servers/53243bcd-4f54-4e0d-a3a9-52e273f20504" status: 200 len: 1316 microversion: 2.1 time: 0.377778 Sep 14 09:17:34.989847 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2762/5501] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:17:34 2022] GET /compute/v2.1/servers/53243bcd-4f54-4e0d-a3a9-52e273f20504 => generated 1316 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:17:35.827778 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-72253094-7c67-45ff-803b-245d4cab02cf tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:35.828669 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-72253094-7c67-45ff-803b-245d4cab02cf tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 3c2f5d0d-16a5-4f33-8f02-a84296eb09ef] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:35.836464 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-72253094-7c67-45ff-803b-245d4cab02cf tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:35.836994 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-72253094-7c67-45ff-803b-245d4cab02cf tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:35.837738 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-72253094-7c67-45ff-803b-245d4cab02cf tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:35.838565 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-72253094-7c67-45ff-803b-245d4cab02cf tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:35.839204 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-72253094-7c67-45ff-803b-245d4cab02cf tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:35.839762 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-72253094-7c67-45ff-803b-245d4cab02cf tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:36.021626 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-8fdabf25-26c9-46e1-a0b3-e6aa3d50a1e8 tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:36.023780 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-8fdabf25-26c9-46e1-a0b3-e6aa3d50a1e8 tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] [instance: 53243bcd-4f54-4e0d-a3a9-52e273f20504] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:36.028848 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:17:36.036553 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8fdabf25-26c9-46e1-a0b3-e6aa3d50a1e8 tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:36.037900 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8fdabf25-26c9-46e1-a0b3-e6aa3d50a1e8 tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:36.038547 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8fdabf25-26c9-46e1-a0b3-e6aa3d50a1e8 tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:36.039614 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8fdabf25-26c9-46e1-a0b3-e6aa3d50a1e8 tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:36.040290 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8fdabf25-26c9-46e1-a0b3-e6aa3d50a1e8 tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:36.040957 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8fdabf25-26c9-46e1-a0b3-e6aa3d50a1e8 tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:36.077995 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-72253094-7c67-45ff-803b-245d4cab02cf tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03dc827647f4483beb2e1b7888be608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229e11b3c1fe48b088d0f3c4bb7e2cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:36.086483 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-72253094-7c67-45ff-803b-245d4cab02cf tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "GET /compute/v2.1/servers/3c2f5d0d-16a5-4f33-8f02-a84296eb09ef" status: 200 len: 1322 microversion: 2.1 time: 0.264559 Sep 14 09:17:36.106910 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2740/5502] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:17:35 2022] GET /compute/v2.1/servers/3c2f5d0d-16a5-4f33-8f02-a84296eb09ef => generated 1322 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:17:36.348362 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-8fdabf25-26c9-46e1-a0b3-e6aa3d50a1e8 tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eee489741984db7a55454c253d1781d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '101dd9bc525c4a91a5ac4d7c653bbcbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:36.381704 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-8fdabf25-26c9-46e1-a0b3-e6aa3d50a1e8 tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] 10.222.0.60 "GET /compute/v2.1/servers/53243bcd-4f54-4e0d-a3a9-52e273f20504" status: 200 len: 1316 microversion: 2.1 time: 0.365370 Sep 14 09:17:36.382908 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2763/5503] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:17:36 2022] GET /compute/v2.1/servers/53243bcd-4f54-4e0d-a3a9-52e273f20504 => generated 1316 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:17:37.118995 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-1823922f-8676-419f-b85e-43090f97da07 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:37.120302 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-1823922f-8676-419f-b85e-43090f97da07 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 3c2f5d0d-16a5-4f33-8f02-a84296eb09ef] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:37.133244 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1823922f-8676-419f-b85e-43090f97da07 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:37.139113 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1823922f-8676-419f-b85e-43090f97da07 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:37.139861 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1823922f-8676-419f-b85e-43090f97da07 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:37.140843 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1823922f-8676-419f-b85e-43090f97da07 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:37.141505 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1823922f-8676-419f-b85e-43090f97da07 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:37.142137 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1823922f-8676-419f-b85e-43090f97da07 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:37.408904 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-311f04be-eefb-437f-9e96-bfc38465ee8d tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:37.411024 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-311f04be-eefb-437f-9e96-bfc38465ee8d tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] [instance: 53243bcd-4f54-4e0d-a3a9-52e273f20504] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:37.428860 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-311f04be-eefb-437f-9e96-bfc38465ee8d tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:37.429651 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-311f04be-eefb-437f-9e96-bfc38465ee8d tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:37.430380 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-311f04be-eefb-437f-9e96-bfc38465ee8d tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:37.430954 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-1823922f-8676-419f-b85e-43090f97da07 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03dc827647f4483beb2e1b7888be608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229e11b3c1fe48b088d0f3c4bb7e2cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:37.431858 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-311f04be-eefb-437f-9e96-bfc38465ee8d tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:37.432607 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-311f04be-eefb-437f-9e96-bfc38465ee8d tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:37.433233 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-311f04be-eefb-437f-9e96-bfc38465ee8d tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:37.473755 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-1823922f-8676-419f-b85e-43090f97da07 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "GET /compute/v2.1/servers/3c2f5d0d-16a5-4f33-8f02-a84296eb09ef" status: 200 len: 1516 microversion: 2.1 time: 0.364027 Sep 14 09:17:37.487368 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2741/5504] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:17:37 2022] GET /compute/v2.1/servers/3c2f5d0d-16a5-4f33-8f02-a84296eb09ef => generated 1516 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:17:37.502409 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e271424e-d6ce-4967-95ac-dc08a229a625 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:17:37.520635 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e271424e-d6ce-4967-95ac-dc08a229a625 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 3c2f5d0d-16a5-4f33-8f02-a84296eb09ef] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:37.540092 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e271424e-d6ce-4967-95ac-dc08a229a625 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:37.540092 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e271424e-d6ce-4967-95ac-dc08a229a625 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:37.540092 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e271424e-d6ce-4967-95ac-dc08a229a625 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:37.540801 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e271424e-d6ce-4967-95ac-dc08a229a625 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:37.541561 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e271424e-d6ce-4967-95ac-dc08a229a625 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:37.542291 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e271424e-d6ce-4967-95ac-dc08a229a625 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:37.602530 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.objects.instance [None req-e271424e-d6ce-4967-95ac-dc08a229a625 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lazy-loading 'flavor' on Instance uuid 3c2f5d0d-16a5-4f33-8f02-a84296eb09ef {{(pid=128759) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:17:37.751922 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-311f04be-eefb-437f-9e96-bfc38465ee8d tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eee489741984db7a55454c253d1781d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '101dd9bc525c4a91a5ac4d7c653bbcbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:37.762524 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-311f04be-eefb-437f-9e96-bfc38465ee8d tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] 10.222.0.60 "GET /compute/v2.1/servers/53243bcd-4f54-4e0d-a3a9-52e273f20504" status: 200 len: 1316 microversion: 2.1 time: 0.357327 Sep 14 09:17:37.763158 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2764/5505] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:17:37 2022] GET /compute/v2.1/servers/53243bcd-4f54-4e0d-a3a9-52e273f20504 => generated 1316 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:17:37.776284 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-d04449d2-1cfe-4782-bb5f-6c7656735021 req-fa0c5e37-9b90-430f-abdd-831340411319 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f31deffe-182e-46b5-9643-725b7d7b4561", "tag": "0190f876-37ba-4929-9e15-dd1e9c1f6cd4"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:17:37.792261 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-d04449d2-1cfe-4782-bb5f-6c7656735021 req-fa0c5e37-9b90-430f-abdd-831340411319 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:37.795340 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e271424e-d6ce-4967-95ac-dc08a229a625 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "POST /compute/v2.1/servers/3c2f5d0d-16a5-4f33-8f02-a84296eb09ef/action" status: 200 len: 32 microversion: 2.1 time: 0.298306 Sep 14 09:17:37.795947 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2742/5506] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:17:37 2022] POST /compute/v2.1/servers/3c2f5d0d-16a5-4f33-8f02-a84296eb09ef/action => generated 32 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 09:17:37.796918 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-d04449d2-1cfe-4782-bb5f-6c7656735021 req-fa0c5e37-9b90-430f-abdd-831340411319 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:37.797566 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-d04449d2-1cfe-4782-bb5f-6c7656735021 req-fa0c5e37-9b90-430f-abdd-831340411319 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:37.816895 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-bf56d5ca-a4ee-451e-b36b-6ca770bc23a1 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:37.817617 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-bf56d5ca-a4ee-451e-b36b-6ca770bc23a1 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 3c2f5d0d-16a5-4f33-8f02-a84296eb09ef] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:37.826391 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-d04449d2-1cfe-4782-bb5f-6c7656735021 req-fa0c5e37-9b90-430f-abdd-831340411319 service nova] Creating event network-changed:0190f876-37ba-4929-9e15-dd1e9c1f6cd4 for instance f31deffe-182e-46b5-9643-725b7d7b4561 on n-h1-836830-18 Sep 14 09:17:37.838030 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-d04449d2-1cfe-4782-bb5f-6c7656735021 req-fa0c5e37-9b90-430f-abdd-831340411319 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073035 Sep 14 09:17:37.839961 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2765/5507] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:17:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:17:37.844047 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=6 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:17:37.850006 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bf56d5ca-a4ee-451e-b36b-6ca770bc23a1 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:37.852540 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bf56d5ca-a4ee-451e-b36b-6ca770bc23a1 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:37.855251 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bf56d5ca-a4ee-451e-b36b-6ca770bc23a1 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:37.856674 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bf56d5ca-a4ee-451e-b36b-6ca770bc23a1 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:37.856674 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bf56d5ca-a4ee-451e-b36b-6ca770bc23a1 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:37.857064 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bf56d5ca-a4ee-451e-b36b-6ca770bc23a1 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:38.339758 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-bf56d5ca-a4ee-451e-b36b-6ca770bc23a1 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03dc827647f4483beb2e1b7888be608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229e11b3c1fe48b088d0f3c4bb7e2cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:38.348917 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-bf56d5ca-a4ee-451e-b36b-6ca770bc23a1 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "GET /compute/v2.1/servers/3c2f5d0d-16a5-4f33-8f02-a84296eb09ef" status: 200 len: 1522 microversion: 2.1 time: 0.544912 Sep 14 09:17:38.354318 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2743/5508] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:17:37 2022] GET /compute/v2.1/servers/3c2f5d0d-16a5-4f33-8f02-a84296eb09ef => generated 1522 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:17:38.795425 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d1855c90-288d-4529-ad13-5ea61aad9eab tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:38.796156 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-d1855c90-288d-4529-ad13-5ea61aad9eab tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] [instance: 53243bcd-4f54-4e0d-a3a9-52e273f20504] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:38.798353 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=2 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:17:38.811979 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=8 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:17:38.846551 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d1855c90-288d-4529-ad13-5ea61aad9eab tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:38.847078 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d1855c90-288d-4529-ad13-5ea61aad9eab tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:38.847526 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d1855c90-288d-4529-ad13-5ea61aad9eab tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:38.848240 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d1855c90-288d-4529-ad13-5ea61aad9eab tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:38.848713 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d1855c90-288d-4529-ad13-5ea61aad9eab tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:38.849186 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d1855c90-288d-4529-ad13-5ea61aad9eab tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:39.151183 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-ddd22d29-d252-4a8d-ac98-8146be09023f req-c1f851c1-ec22-4432-aac7-2c9634e98c7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53243bcd-4f54-4e0d-a3a9-52e273f20504", "name": "network-vif-plugged", "status": "completed", "tag": "7f2aa605-ffb0-497b-9fe2-69a397a4b22e"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:17:39.216324 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-ddd22d29-d252-4a8d-ac98-8146be09023f req-c1f851c1-ec22-4432-aac7-2c9634e98c7d service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:39.217133 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-ddd22d29-d252-4a8d-ac98-8146be09023f req-c1f851c1-ec22-4432-aac7-2c9634e98c7d service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:39.217737 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-ddd22d29-d252-4a8d-ac98-8146be09023f req-c1f851c1-ec22-4432-aac7-2c9634e98c7d service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:39.243530 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-ddd22d29-d252-4a8d-ac98-8146be09023f req-c1f851c1-ec22-4432-aac7-2c9634e98c7d service nova] Creating event network-vif-plugged:7f2aa605-ffb0-497b-9fe2-69a397a4b22e for instance 53243bcd-4f54-4e0d-a3a9-52e273f20504 on n-h2-836830-18 Sep 14 09:17:39.251061 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-ddd22d29-d252-4a8d-ac98-8146be09023f req-c1f851c1-ec22-4432-aac7-2c9634e98c7d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103633 Sep 14 09:17:39.272943 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2744/5509] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:17:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:17:39.384276 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e9e2c105-2da7-45f8-a611-660ab93abb82 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:39.386009 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e9e2c105-2da7-45f8-a611-660ab93abb82 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 3c2f5d0d-16a5-4f33-8f02-a84296eb09ef] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:39.397333 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e9e2c105-2da7-45f8-a611-660ab93abb82 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:39.401275 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e9e2c105-2da7-45f8-a611-660ab93abb82 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:39.401919 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e9e2c105-2da7-45f8-a611-660ab93abb82 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:39.402845 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e9e2c105-2da7-45f8-a611-660ab93abb82 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:39.404965 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e9e2c105-2da7-45f8-a611-660ab93abb82 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:39.405747 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e9e2c105-2da7-45f8-a611-660ab93abb82 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:39.493141 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-d1855c90-288d-4529-ad13-5ea61aad9eab tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eee489741984db7a55454c253d1781d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '101dd9bc525c4a91a5ac4d7c653bbcbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:39.507339 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-d1855c90-288d-4529-ad13-5ea61aad9eab tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] 10.222.0.60 "GET /compute/v2.1/servers/53243bcd-4f54-4e0d-a3a9-52e273f20504" status: 200 len: 1316 microversion: 2.1 time: 0.721191 Sep 14 09:17:39.508290 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2766/5510] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:17:38 2022] GET /compute/v2.1/servers/53243bcd-4f54-4e0d-a3a9-52e273f20504 => generated 1316 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:17:39.683766 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-e9e2c105-2da7-45f8-a611-660ab93abb82 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03dc827647f4483beb2e1b7888be608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229e11b3c1fe48b088d0f3c4bb7e2cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:39.694173 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e9e2c105-2da7-45f8-a611-660ab93abb82 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "GET /compute/v2.1/servers/3c2f5d0d-16a5-4f33-8f02-a84296eb09ef" status: 200 len: 1522 microversion: 2.1 time: 0.320104 Sep 14 09:17:39.695614 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2745/5511] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:17:39 2022] GET /compute/v2.1/servers/3c2f5d0d-16a5-4f33-8f02-a84296eb09ef => generated 1522 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:17:40.533726 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-7bf44cad-7425-4fb7-9de7-778d9bf0f281 tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:40.534335 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-7bf44cad-7425-4fb7-9de7-778d9bf0f281 tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] [instance: 53243bcd-4f54-4e0d-a3a9-52e273f20504] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:40.542632 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7bf44cad-7425-4fb7-9de7-778d9bf0f281 tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:40.543408 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7bf44cad-7425-4fb7-9de7-778d9bf0f281 tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:40.544011 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7bf44cad-7425-4fb7-9de7-778d9bf0f281 tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:40.544726 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7bf44cad-7425-4fb7-9de7-778d9bf0f281 tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:40.545212 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7bf44cad-7425-4fb7-9de7-778d9bf0f281 tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:40.545804 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7bf44cad-7425-4fb7-9de7-778d9bf0f281 tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:40.720116 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3db4d193-eb81-4f4d-a0f1-67d2dea7f871 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:40.721370 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-3db4d193-eb81-4f4d-a0f1-67d2dea7f871 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 3c2f5d0d-16a5-4f33-8f02-a84296eb09ef] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:40.734570 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-7bf44cad-7425-4fb7-9de7-778d9bf0f281 tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eee489741984db7a55454c253d1781d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '101dd9bc525c4a91a5ac4d7c653bbcbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:40.734762 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3db4d193-eb81-4f4d-a0f1-67d2dea7f871 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:40.735105 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3db4d193-eb81-4f4d-a0f1-67d2dea7f871 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:40.741010 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3db4d193-eb81-4f4d-a0f1-67d2dea7f871 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:40.741971 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3db4d193-eb81-4f4d-a0f1-67d2dea7f871 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:40.742609 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3db4d193-eb81-4f4d-a0f1-67d2dea7f871 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:40.743240 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3db4d193-eb81-4f4d-a0f1-67d2dea7f871 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:40.744730 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-7bf44cad-7425-4fb7-9de7-778d9bf0f281 tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] 10.222.0.60 "GET /compute/v2.1/servers/53243bcd-4f54-4e0d-a3a9-52e273f20504" status: 200 len: 1316 microversion: 2.1 time: 0.215079 Sep 14 09:17:40.746327 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2767/5512] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:17:40 2022] GET /compute/v2.1/servers/53243bcd-4f54-4e0d-a3a9-52e273f20504 => generated 1316 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:17:40.943936 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-3db4d193-eb81-4f4d-a0f1-67d2dea7f871 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03dc827647f4483beb2e1b7888be608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229e11b3c1fe48b088d0f3c4bb7e2cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:40.956735 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-3db4d193-eb81-4f4d-a0f1-67d2dea7f871 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "GET /compute/v2.1/servers/3c2f5d0d-16a5-4f33-8f02-a84296eb09ef" status: 200 len: 1522 microversion: 2.1 time: 0.241347 Sep 14 09:17:40.971538 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2746/5513] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:17:40 2022] GET /compute/v2.1/servers/3c2f5d0d-16a5-4f33-8f02-a84296eb09ef => generated 1522 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:17:41.771625 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-eb4a611e-9cc1-42f2-9e47-e8d7918a7013 tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:41.774320 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-eb4a611e-9cc1-42f2-9e47-e8d7918a7013 tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] [instance: 53243bcd-4f54-4e0d-a3a9-52e273f20504] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:41.791615 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-eb4a611e-9cc1-42f2-9e47-e8d7918a7013 tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:41.792414 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-eb4a611e-9cc1-42f2-9e47-e8d7918a7013 tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:41.793008 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-eb4a611e-9cc1-42f2-9e47-e8d7918a7013 tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:41.793912 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-eb4a611e-9cc1-42f2-9e47-e8d7918a7013 tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:41.794550 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-eb4a611e-9cc1-42f2-9e47-e8d7918a7013 tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:41.795019 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-eb4a611e-9cc1-42f2-9e47-e8d7918a7013 tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:41.982624 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f4139a8c-a473-4c30-8f0d-904e2df526aa tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:41.984172 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f4139a8c-a473-4c30-8f0d-904e2df526aa tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 3c2f5d0d-16a5-4f33-8f02-a84296eb09ef] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:41.993457 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f4139a8c-a473-4c30-8f0d-904e2df526aa tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:41.994097 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f4139a8c-a473-4c30-8f0d-904e2df526aa tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:41.994740 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f4139a8c-a473-4c30-8f0d-904e2df526aa tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:41.995504 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f4139a8c-a473-4c30-8f0d-904e2df526aa tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:41.995970 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f4139a8c-a473-4c30-8f0d-904e2df526aa tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:41.996665 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f4139a8c-a473-4c30-8f0d-904e2df526aa tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:42.075767 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-eb4a611e-9cc1-42f2-9e47-e8d7918a7013 tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eee489741984db7a55454c253d1781d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '101dd9bc525c4a91a5ac4d7c653bbcbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:42.087741 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-eb4a611e-9cc1-42f2-9e47-e8d7918a7013 tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] 10.222.0.60 "GET /compute/v2.1/servers/53243bcd-4f54-4e0d-a3a9-52e273f20504" status: 200 len: 1505 microversion: 2.1 time: 0.322197 Sep 14 09:17:42.104827 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2768/5514] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:17:41 2022] GET /compute/v2.1/servers/53243bcd-4f54-4e0d-a3a9-52e273f20504 => generated 1505 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:17:42.118726 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-f5b93402-ef2c-4b73-9459-8025955ae20b tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:42.119566 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-f5b93402-ef2c-4b73-9459-8025955ae20b tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] [instance: 53243bcd-4f54-4e0d-a3a9-52e273f20504] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:42.127414 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f5b93402-ef2c-4b73-9459-8025955ae20b tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:42.129450 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f5b93402-ef2c-4b73-9459-8025955ae20b tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:42.130847 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f5b93402-ef2c-4b73-9459-8025955ae20b tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:42.133892 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f5b93402-ef2c-4b73-9459-8025955ae20b tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:42.135718 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f5b93402-ef2c-4b73-9459-8025955ae20b tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:42.138241 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f5b93402-ef2c-4b73-9459-8025955ae20b tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:42.182791 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-f5b93402-ef2c-4b73-9459-8025955ae20b tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] 10.222.0.60 "GET /compute/v2.1/servers/53243bcd-4f54-4e0d-a3a9-52e273f20504/ips" status: 200 len: 109 microversion: 2.1 time: 0.068225 Sep 14 09:17:42.183825 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2769/5515] 10.222.0.60 () {58 vars in 1248 bytes} [Wed Sep 14 09:17:42 2022] GET /compute/v2.1/servers/53243bcd-4f54-4e0d-a3a9-52e273f20504/ips => generated 109 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:17:42.202671 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-773b9d8e-f554-447a-8d1c-ad60c3e96430 tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:42.203325 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-773b9d8e-f554-447a-8d1c-ad60c3e96430 tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] [instance: 53243bcd-4f54-4e0d-a3a9-52e273f20504] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:42.210604 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-773b9d8e-f554-447a-8d1c-ad60c3e96430 tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:42.211397 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-773b9d8e-f554-447a-8d1c-ad60c3e96430 tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:42.212156 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-773b9d8e-f554-447a-8d1c-ad60c3e96430 tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:42.213417 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-773b9d8e-f554-447a-8d1c-ad60c3e96430 tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:42.213988 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-773b9d8e-f554-447a-8d1c-ad60c3e96430 tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:42.214820 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-773b9d8e-f554-447a-8d1c-ad60c3e96430 tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:42.244566 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f4139a8c-a473-4c30-8f0d-904e2df526aa tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03dc827647f4483beb2e1b7888be608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229e11b3c1fe48b088d0f3c4bb7e2cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:42.246189 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-773b9d8e-f554-447a-8d1c-ad60c3e96430 tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] 10.222.0.60 "GET /compute/v2.1/servers/53243bcd-4f54-4e0d-a3a9-52e273f20504/ips" status: 200 len: 109 microversion: 2.1 time: 0.053037 Sep 14 09:17:42.253683 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f4139a8c-a473-4c30-8f0d-904e2df526aa tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "GET /compute/v2.1/servers/3c2f5d0d-16a5-4f33-8f02-a84296eb09ef" status: 200 len: 1522 microversion: 2.1 time: 0.276384 Sep 14 09:17:42.254302 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2747/5516] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:17:41 2022] GET /compute/v2.1/servers/3c2f5d0d-16a5-4f33-8f02-a84296eb09ef => generated 1522 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:17:42.259080 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2770/5517] 10.222.0.60 () {58 vars in 1248 bytes} [Wed Sep 14 09:17:42 2022] GET /compute/v2.1/servers/53243bcd-4f54-4e0d-a3a9-52e273f20504/ips => generated 109 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:17:42.268116 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f6bb6768-3628-4e48-9013-25b03315de7f tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:42.268646 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f6bb6768-3628-4e48-9013-25b03315de7f tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] [instance: 53243bcd-4f54-4e0d-a3a9-52e273f20504] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:42.276560 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f6bb6768-3628-4e48-9013-25b03315de7f tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:42.277062 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f6bb6768-3628-4e48-9013-25b03315de7f tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:42.277513 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f6bb6768-3628-4e48-9013-25b03315de7f tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:42.278229 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f6bb6768-3628-4e48-9013-25b03315de7f tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:42.278700 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f6bb6768-3628-4e48-9013-25b03315de7f tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:42.279285 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f6bb6768-3628-4e48-9013-25b03315de7f tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:42.305434 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f6bb6768-3628-4e48-9013-25b03315de7f tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] 10.222.0.60 "GET /compute/v2.1/servers/53243bcd-4f54-4e0d-a3a9-52e273f20504/ips/tempest-ServerAddressesTestJSON-527920202-network" status: 200 len: 94 microversion: 2.1 time: 0.043107 Sep 14 09:17:42.306406 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2748/5518] 10.222.0.60 () {58 vars in 1398 bytes} [Wed Sep 14 09:17:42 2022] GET /compute/v2.1/servers/53243bcd-4f54-4e0d-a3a9-52e273f20504/ips/tempest-ServerAddressesTestJSON-527920202-network => generated 94 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 09:17:42.317585 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-5b3e6383-a9c8-42c2-94da-986aacf73fe2 tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:42.319085 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-5b3e6383-a9c8-42c2-94da-986aacf73fe2 tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] [instance: 53243bcd-4f54-4e0d-a3a9-52e273f20504] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:42.325829 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5b3e6383-a9c8-42c2-94da-986aacf73fe2 tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:42.326566 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5b3e6383-a9c8-42c2-94da-986aacf73fe2 tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:42.327032 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5b3e6383-a9c8-42c2-94da-986aacf73fe2 tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:42.327743 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5b3e6383-a9c8-42c2-94da-986aacf73fe2 tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:42.328197 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5b3e6383-a9c8-42c2-94da-986aacf73fe2 tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:42.329521 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5b3e6383-a9c8-42c2-94da-986aacf73fe2 tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:42.365834 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-5b3e6383-a9c8-42c2-94da-986aacf73fe2 tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] [instance: 53243bcd-4f54-4e0d-a3a9-52e273f20504] Going to try to terminate instance {{(pid=128758) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:17:42.454793 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-5b3e6383-a9c8-42c2-94da-986aacf73fe2 tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] 10.222.0.60 "DELETE /compute/v2.1/servers/53243bcd-4f54-4e0d-a3a9-52e273f20504" status: 204 len: 0 microversion: 2.1 time: 0.140782 Sep 14 09:17:42.458672 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2771/5519] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:17:42 2022] DELETE /compute/v2.1/servers/53243bcd-4f54-4e0d-a3a9-52e273f20504 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 14 09:17:42.464236 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d1373aa3-64b1-4d81-a5f6-e8ec4d5e165b tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:42.464865 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-d1373aa3-64b1-4d81-a5f6-e8ec4d5e165b tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] [instance: 53243bcd-4f54-4e0d-a3a9-52e273f20504] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:42.470830 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d1373aa3-64b1-4d81-a5f6-e8ec4d5e165b tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:42.471362 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d1373aa3-64b1-4d81-a5f6-e8ec4d5e165b tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:42.471806 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d1373aa3-64b1-4d81-a5f6-e8ec4d5e165b tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:42.472507 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d1373aa3-64b1-4d81-a5f6-e8ec4d5e165b tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:42.472974 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d1373aa3-64b1-4d81-a5f6-e8ec4d5e165b tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:42.473408 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d1373aa3-64b1-4d81-a5f6-e8ec4d5e165b tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:42.611624 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-d1373aa3-64b1-4d81-a5f6-e8ec4d5e165b tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eee489741984db7a55454c253d1781d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '101dd9bc525c4a91a5ac4d7c653bbcbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:42.642996 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d1373aa3-64b1-4d81-a5f6-e8ec4d5e165b tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] 10.222.0.60 "GET /compute/v2.1/servers/53243bcd-4f54-4e0d-a3a9-52e273f20504" status: 200 len: 1511 microversion: 2.1 time: 0.172558 Sep 14 09:17:42.643783 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2749/5520] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:17:42 2022] GET /compute/v2.1/servers/53243bcd-4f54-4e0d-a3a9-52e273f20504 => generated 1511 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:17:43.279060 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-47b8f63c-4186-4d8a-9996-b17a2b6b627c tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:43.280714 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-47b8f63c-4186-4d8a-9996-b17a2b6b627c tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 3c2f5d0d-16a5-4f33-8f02-a84296eb09ef] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:43.288611 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-47b8f63c-4186-4d8a-9996-b17a2b6b627c tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:43.289103 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-47b8f63c-4186-4d8a-9996-b17a2b6b627c tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:43.289743 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-47b8f63c-4186-4d8a-9996-b17a2b6b627c tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:43.290923 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-47b8f63c-4186-4d8a-9996-b17a2b6b627c tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:43.291406 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-47b8f63c-4186-4d8a-9996-b17a2b6b627c tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:43.291830 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-47b8f63c-4186-4d8a-9996-b17a2b6b627c tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:43.469181 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-47b8f63c-4186-4d8a-9996-b17a2b6b627c tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03dc827647f4483beb2e1b7888be608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229e11b3c1fe48b088d0f3c4bb7e2cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:43.476413 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-47b8f63c-4186-4d8a-9996-b17a2b6b627c tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "GET /compute/v2.1/servers/3c2f5d0d-16a5-4f33-8f02-a84296eb09ef" status: 200 len: 1522 microversion: 2.1 time: 0.201760 Sep 14 09:17:43.477436 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2772/5521] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:17:43 2022] GET /compute/v2.1/servers/3c2f5d0d-16a5-4f33-8f02-a84296eb09ef => generated 1522 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:17:43.666923 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-83ecffcf-c2f7-4147-bc6b-125bb18690b3 tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:43.667649 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-83ecffcf-c2f7-4147-bc6b-125bb18690b3 tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] [instance: 53243bcd-4f54-4e0d-a3a9-52e273f20504] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:43.698382 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-83ecffcf-c2f7-4147-bc6b-125bb18690b3 tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:43.700225 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-83ecffcf-c2f7-4147-bc6b-125bb18690b3 tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:43.700681 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-83ecffcf-c2f7-4147-bc6b-125bb18690b3 tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:43.701408 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-83ecffcf-c2f7-4147-bc6b-125bb18690b3 tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:43.701877 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-83ecffcf-c2f7-4147-bc6b-125bb18690b3 tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:43.703700 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-83ecffcf-c2f7-4147-bc6b-125bb18690b3 tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:43.908170 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-83ecffcf-c2f7-4147-bc6b-125bb18690b3 tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eee489741984db7a55454c253d1781d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '101dd9bc525c4a91a5ac4d7c653bbcbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:43.919021 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-83ecffcf-c2f7-4147-bc6b-125bb18690b3 tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] 10.222.0.60 "GET /compute/v2.1/servers/53243bcd-4f54-4e0d-a3a9-52e273f20504" status: 200 len: 1511 microversion: 2.1 time: 0.256639 Sep 14 09:17:43.920303 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2750/5522] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:17:43 2022] GET /compute/v2.1/servers/53243bcd-4f54-4e0d-a3a9-52e273f20504 => generated 1511 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:17:44.515408 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a0c376fe-d607-4bcf-aa82-462bfd1d3355 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:44.523669 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-a0c376fe-d607-4bcf-aa82-462bfd1d3355 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 3c2f5d0d-16a5-4f33-8f02-a84296eb09ef] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:44.537642 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a0c376fe-d607-4bcf-aa82-462bfd1d3355 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:44.539928 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a0c376fe-d607-4bcf-aa82-462bfd1d3355 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:44.541438 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a0c376fe-d607-4bcf-aa82-462bfd1d3355 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:44.542440 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a0c376fe-d607-4bcf-aa82-462bfd1d3355 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:44.543214 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a0c376fe-d607-4bcf-aa82-462bfd1d3355 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:44.543768 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a0c376fe-d607-4bcf-aa82-462bfd1d3355 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:44.717647 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-a0c376fe-d607-4bcf-aa82-462bfd1d3355 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03dc827647f4483beb2e1b7888be608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229e11b3c1fe48b088d0f3c4bb7e2cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:44.727153 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-a0c376fe-d607-4bcf-aa82-462bfd1d3355 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "GET /compute/v2.1/servers/3c2f5d0d-16a5-4f33-8f02-a84296eb09ef" status: 200 len: 1522 microversion: 2.1 time: 0.231405 Sep 14 09:17:44.739695 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2773/5523] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:17:44 2022] GET /compute/v2.1/servers/3c2f5d0d-16a5-4f33-8f02-a84296eb09ef => generated 1522 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:17:44.945046 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b8d8ff78-1db6-4bf5-b08d-cba5afe5d385 tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:44.945685 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b8d8ff78-1db6-4bf5-b08d-cba5afe5d385 tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] [instance: 53243bcd-4f54-4e0d-a3a9-52e273f20504] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:44.965051 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b8d8ff78-1db6-4bf5-b08d-cba5afe5d385 tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:44.965554 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b8d8ff78-1db6-4bf5-b08d-cba5afe5d385 tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:44.965998 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b8d8ff78-1db6-4bf5-b08d-cba5afe5d385 tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:44.966712 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b8d8ff78-1db6-4bf5-b08d-cba5afe5d385 tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:44.967221 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b8d8ff78-1db6-4bf5-b08d-cba5afe5d385 tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:44.967649 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b8d8ff78-1db6-4bf5-b08d-cba5afe5d385 tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:44.977177 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-e1f523d1-9f64-4590-9f8c-d494d2bcf2dc req-0493f3c1-d7f1-479d-93ba-32bb94fb10db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53243bcd-4f54-4e0d-a3a9-52e273f20504", "name": "network-vif-deleted", "tag": "7f2aa605-ffb0-497b-9fe2-69a397a4b22e"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:17:44.990030 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-e1f523d1-9f64-4590-9f8c-d494d2bcf2dc req-0493f3c1-d7f1-479d-93ba-32bb94fb10db service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:44.990525 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-e1f523d1-9f64-4590-9f8c-d494d2bcf2dc req-0493f3c1-d7f1-479d-93ba-32bb94fb10db service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:44.990974 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-e1f523d1-9f64-4590-9f8c-d494d2bcf2dc req-0493f3c1-d7f1-479d-93ba-32bb94fb10db service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:45.038040 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-e1f523d1-9f64-4590-9f8c-d494d2bcf2dc req-0493f3c1-d7f1-479d-93ba-32bb94fb10db service nova] Creating event network-vif-deleted:7f2aa605-ffb0-497b-9fe2-69a397a4b22e for instance 53243bcd-4f54-4e0d-a3a9-52e273f20504 on n-h2-836830-18 Sep 14 09:17:45.047893 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-e1f523d1-9f64-4590-9f8c-d494d2bcf2dc req-0493f3c1-d7f1-479d-93ba-32bb94fb10db service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089148 Sep 14 09:17:45.049286 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2774/5524] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:17:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:17:45.119572 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b8d8ff78-1db6-4bf5-b08d-cba5afe5d385 tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eee489741984db7a55454c253d1781d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '101dd9bc525c4a91a5ac4d7c653bbcbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:45.144386 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b8d8ff78-1db6-4bf5-b08d-cba5afe5d385 tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] 10.222.0.60 "GET /compute/v2.1/servers/53243bcd-4f54-4e0d-a3a9-52e273f20504" status: 200 len: 1301 microversion: 2.1 time: 0.203801 Sep 14 09:17:45.145857 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2751/5525] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:17:44 2022] GET /compute/v2.1/servers/53243bcd-4f54-4e0d-a3a9-52e273f20504 => generated 1301 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:17:45.770293 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-be4ae2bf-17ca-419a-b347-10874ca08914 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:45.772502 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-be4ae2bf-17ca-419a-b347-10874ca08914 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 3c2f5d0d-16a5-4f33-8f02-a84296eb09ef] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:45.798487 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-be4ae2bf-17ca-419a-b347-10874ca08914 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:45.801242 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-be4ae2bf-17ca-419a-b347-10874ca08914 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:45.801704 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-be4ae2bf-17ca-419a-b347-10874ca08914 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:45.802738 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-be4ae2bf-17ca-419a-b347-10874ca08914 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:45.809060 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-be4ae2bf-17ca-419a-b347-10874ca08914 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:45.809518 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-be4ae2bf-17ca-419a-b347-10874ca08914 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:46.014278 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-be4ae2bf-17ca-419a-b347-10874ca08914 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03dc827647f4483beb2e1b7888be608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229e11b3c1fe48b088d0f3c4bb7e2cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:46.025957 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-be4ae2bf-17ca-419a-b347-10874ca08914 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "GET /compute/v2.1/servers/3c2f5d0d-16a5-4f33-8f02-a84296eb09ef" status: 200 len: 1522 microversion: 2.1 time: 0.274872 Sep 14 09:17:46.049351 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2775/5526] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:17:45 2022] GET /compute/v2.1/servers/3c2f5d0d-16a5-4f33-8f02-a84296eb09ef => generated 1522 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:17:46.174684 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b4fb25d3-fc4a-4d9f-8f4e-83fc8e2d2e43 tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:46.175441 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b4fb25d3-fc4a-4d9f-8f4e-83fc8e2d2e43 tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] [instance: 53243bcd-4f54-4e0d-a3a9-52e273f20504] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:46.195358 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b4fb25d3-fc4a-4d9f-8f4e-83fc8e2d2e43 tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:46.195861 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b4fb25d3-fc4a-4d9f-8f4e-83fc8e2d2e43 tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:46.198974 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b4fb25d3-fc4a-4d9f-8f4e-83fc8e2d2e43 tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:46.200261 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b4fb25d3-fc4a-4d9f-8f4e-83fc8e2d2e43 tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:46.200947 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b4fb25d3-fc4a-4d9f-8f4e-83fc8e2d2e43 tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:46.201880 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b4fb25d3-fc4a-4d9f-8f4e-83fc8e2d2e43 tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:46.221305 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-b4fb25d3-fc4a-4d9f-8f4e-83fc8e2d2e43 tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] HTTP exception thrown: Instance 53243bcd-4f54-4e0d-a3a9-52e273f20504 could not be found. Sep 14 09:17:46.223420 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b4fb25d3-fc4a-4d9f-8f4e-83fc8e2d2e43 tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Request method failure captured: Sep 14 09:17:46.223420 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/53243bcd-4f54-4e0d-a3a9-52e273f20504 HTTP/1.1 Sep 14 09:17:46.223420 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:17:46.223420 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:17:46.223420 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:17:46.223420 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:17:46.223420 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:17:46.223420 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:17:46.223420 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:17:46.223420 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:17:46.223420 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZwlIx_eO8uJ48ZIbueRUWo6LxqtF6mCSgDa0YzYuSnrr3UGFQqLasS_L1yUpusforXM6uq9KxyKuXSrAF8Kc5vvzzOqLe4E1_qULi6H7yjFCACpft8xQp6sfQy2oyMy0_uTwOVVRoZkTRkYPB_BWbAvimFboUeb33gkj9UgsaJT-sY Sep 14 09:17:46.223420 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:17:46.223420 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:17:46.223420 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:17:46.223420 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:17:46.223420 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:17:46.223420 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:17:46.223420 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 101dd9bc525c4a91a5ac4d7c653bbcbe Sep 14 09:17:46.223420 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ServerAddressesTestJSON-476367954 Sep 14 09:17:46.223420 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:17:46.223420 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:17:46.223420 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/101dd9bc525c4a91a5ac4d7c653bbcbe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_101dd9bc525c4a91a5ac4d7c653bbcbe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/101dd9bc525c4a91a5ac4d7c653bbcbe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/101dd9bc525c4a91a5ac4d7c653bbcbe"}]}] Sep 14 09:17:46.223420 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ServerAddressesTestJSON-476367954 Sep 14 09:17:46.223420 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 101dd9bc525c4a91a5ac4d7c653bbcbe Sep 14 09:17:46.223420 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ServerAddressesTestJSON-476367954 Sep 14 09:17:46.223420 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ServerAddressesTestJSON-476367954-project Sep 14 09:17:46.223420 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:17:46.223420 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:17:46.223420 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 6eee489741984db7a55454c253d1781d Sep 14 09:17:46.223420 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ServerAddressesTestJSON-476367954-project Sep 14 09:17:46.223420 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:17:46.223420 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance 53243bcd-4f54-4e0d-a3a9-52e273f20504 could not be found. Sep 14 09:17:46.223420 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '53243bcd-4f54-4e0d-a3a9-52e273f20504'} Sep 14 09:17:46.223420 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:17:46.223420 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:17:46.223420 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:17:46.223420 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:17:46.223420 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:17:46.223420 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:17:46.223420 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:17:46.223420 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:17:46.223420 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:17:46.223420 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:17:46.223420 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53243bcd-4f54-4e0d-a3a9-52e273f20504 could not be found. Sep 14 09:17:46.223420 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:17:46.223420 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:17:46.223420 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:17:46.223420 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:17:46.223420 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:17:46.223420 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:17:46.223420 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:17:46.223420 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:17:46.223420 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:17:46.223420 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:17:46.223420 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:17:46.223420 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:17:46.223420 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:17:46.223420 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:17:46.223420 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:17:46.223420 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:17:46.223420 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53243bcd-4f54-4e0d-a3a9-52e273f20504 could not be found. Sep 14 09:17:46.223420 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:17:46.223420 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:17:46.223420 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:17:46.231830 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:17:46.231830 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:17:46.231830 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:17:46.231830 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:17:46.231830 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:17:46.231830 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53243bcd-4f54-4e0d-a3a9-52e273f20504 could not be found. Sep 14 09:17:46.231830 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:17:46.233968 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b4fb25d3-fc4a-4d9f-8f4e-83fc8e2d2e43 tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] Returning 404 to user: Instance 53243bcd-4f54-4e0d-a3a9-52e273f20504 could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:17:46.236085 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b4fb25d3-fc4a-4d9f-8f4e-83fc8e2d2e43 tempest-ServerAddressesTestJSON-476367954 tempest-ServerAddressesTestJSON-476367954-project] 10.222.0.60 "GET /compute/v2.1/servers/53243bcd-4f54-4e0d-a3a9-52e273f20504" status: 404 len: 111 microversion: 2.1 time: 0.066045 Sep 14 09:17:46.237100 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2752/5527] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:17:46 2022] GET /compute/v2.1/servers/53243bcd-4f54-4e0d-a3a9-52e273f20504 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:17:46.806968 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-310eddf0-50d8-4558-8ee2-989fef65cb35 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:46.807469 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-310eddf0-50d8-4558-8ee2-989fef65cb35 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [instance: 3ceabacb-cbf6-409a-8c82-55e9901bd8d7] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:46.814736 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-310eddf0-50d8-4558-8ee2-989fef65cb35 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:46.815259 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-310eddf0-50d8-4558-8ee2-989fef65cb35 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:46.815705 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-310eddf0-50d8-4558-8ee2-989fef65cb35 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:46.816415 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-310eddf0-50d8-4558-8ee2-989fef65cb35 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:46.816870 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-310eddf0-50d8-4558-8ee2-989fef65cb35 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:46.817297 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-310eddf0-50d8-4558-8ee2-989fef65cb35 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:46.933006 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.objects.instance [None req-310eddf0-50d8-4558-8ee2-989fef65cb35 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lazy-loading 'services' on Instance uuid 3ceabacb-cbf6-409a-8c82-55e9901bd8d7 {{(pid=128758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:17:47.059156 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:17:47.060318 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-97d136ff-bd7b-48f9-8749-46d78c2dd85b tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:47.061181 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-97d136ff-bd7b-48f9-8749-46d78c2dd85b tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 3c2f5d0d-16a5-4f33-8f02-a84296eb09ef] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:47.083446 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-310eddf0-50d8-4558-8ee2-989fef65cb35 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "DELETE /compute/v2.1/servers/3ceabacb-cbf6-409a-8c82-55e9901bd8d7/os-volume_attachments/50567dc2-707f-44df-b47b-d99897b1f1c7" status: 202 len: 0 microversion: 2.1 time: 0.277679 Sep 14 09:17:47.087011 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2776/5528] 10.222.0.60 () {58 vars in 1416 bytes} [Wed Sep 14 09:17:46 2022] DELETE /compute/v2.1/servers/3ceabacb-cbf6-409a-8c82-55e9901bd8d7/os-volume_attachments/50567dc2-707f-44df-b47b-d99897b1f1c7 => generated 0 bytes in 285 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:17:47.090182 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-97d136ff-bd7b-48f9-8749-46d78c2dd85b tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:47.095630 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-97d136ff-bd7b-48f9-8749-46d78c2dd85b tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:47.097032 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-97d136ff-bd7b-48f9-8749-46d78c2dd85b tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:47.097955 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-97d136ff-bd7b-48f9-8749-46d78c2dd85b tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:47.100800 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-97d136ff-bd7b-48f9-8749-46d78c2dd85b tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:47.101432 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-97d136ff-bd7b-48f9-8749-46d78c2dd85b tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:47.102644 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-03d99e90-a7c0-49d5-90a7-b9c5ff5d4e3f tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:47.108766 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-03d99e90-a7c0-49d5-90a7-b9c5ff5d4e3f tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [instance: 3ceabacb-cbf6-409a-8c82-55e9901bd8d7] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:47.122680 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-03d99e90-a7c0-49d5-90a7-b9c5ff5d4e3f tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:47.123537 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-03d99e90-a7c0-49d5-90a7-b9c5ff5d4e3f tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:47.125000 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-03d99e90-a7c0-49d5-90a7-b9c5ff5d4e3f tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:47.126834 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-03d99e90-a7c0-49d5-90a7-b9c5ff5d4e3f tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:47.129175 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-03d99e90-a7c0-49d5-90a7-b9c5ff5d4e3f tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:47.129891 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-03d99e90-a7c0-49d5-90a7-b9c5ff5d4e3f tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:47.202579 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-03d99e90-a7c0-49d5-90a7-b9c5ff5d4e3f tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "GET /compute/v2.1/servers/3ceabacb-cbf6-409a-8c82-55e9901bd8d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.110786 Sep 14 09:17:47.203486 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2777/5529] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 14 09:17:47 2022] GET /compute/v2.1/servers/3ceabacb-cbf6-409a-8c82-55e9901bd8d7/os-volume_attachments => generated 197 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:17:47.566712 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-97d136ff-bd7b-48f9-8749-46d78c2dd85b tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03dc827647f4483beb2e1b7888be608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229e11b3c1fe48b088d0f3c4bb7e2cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:47.584523 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-97d136ff-bd7b-48f9-8749-46d78c2dd85b tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "GET /compute/v2.1/servers/3c2f5d0d-16a5-4f33-8f02-a84296eb09ef" status: 200 len: 1522 microversion: 2.1 time: 0.527926 Sep 14 09:17:47.585495 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2753/5530] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:17:47 2022] GET /compute/v2.1/servers/3c2f5d0d-16a5-4f33-8f02-a84296eb09ef => generated 1522 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:17:48.216155 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-391288c2-a966-4590-bb16-38d62a4e238d tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:48.219215 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-391288c2-a966-4590-bb16-38d62a4e238d tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [instance: 3ceabacb-cbf6-409a-8c82-55e9901bd8d7] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:48.230021 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-391288c2-a966-4590-bb16-38d62a4e238d tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:48.230971 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-391288c2-a966-4590-bb16-38d62a4e238d tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:48.231946 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-391288c2-a966-4590-bb16-38d62a4e238d tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:48.239205 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-391288c2-a966-4590-bb16-38d62a4e238d tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:48.240528 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-391288c2-a966-4590-bb16-38d62a4e238d tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:48.241134 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-391288c2-a966-4590-bb16-38d62a4e238d tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:48.288288 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-391288c2-a966-4590-bb16-38d62a4e238d tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "GET /compute/v2.1/servers/3ceabacb-cbf6-409a-8c82-55e9901bd8d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076468 Sep 14 09:17:48.289822 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2778/5531] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 14 09:17:48 2022] GET /compute/v2.1/servers/3ceabacb-cbf6-409a-8c82-55e9901bd8d7/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:17:48.609468 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-96b6c867-935e-4439-925f-9778cbd14ec2 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:48.610084 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-96b6c867-935e-4439-925f-9778cbd14ec2 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 3c2f5d0d-16a5-4f33-8f02-a84296eb09ef] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:48.624630 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-96b6c867-935e-4439-925f-9778cbd14ec2 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:48.629343 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-96b6c867-935e-4439-925f-9778cbd14ec2 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:48.629816 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-96b6c867-935e-4439-925f-9778cbd14ec2 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:48.630608 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-96b6c867-935e-4439-925f-9778cbd14ec2 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:48.631106 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-96b6c867-935e-4439-925f-9778cbd14ec2 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:48.631540 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-96b6c867-935e-4439-925f-9778cbd14ec2 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:49.178210 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-96b6c867-935e-4439-925f-9778cbd14ec2 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03dc827647f4483beb2e1b7888be608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229e11b3c1fe48b088d0f3c4bb7e2cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:49.195093 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-96b6c867-935e-4439-925f-9778cbd14ec2 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "GET /compute/v2.1/servers/3c2f5d0d-16a5-4f33-8f02-a84296eb09ef" status: 200 len: 1522 microversion: 2.1 time: 0.585078 Sep 14 09:17:49.199645 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2754/5532] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:17:48 2022] GET /compute/v2.1/servers/3c2f5d0d-16a5-4f33-8f02-a84296eb09ef => generated 1522 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:17:49.301697 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-7823d5b0-fc49-400d-af27-d2c937cc0e7e tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:49.309296 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-7823d5b0-fc49-400d-af27-d2c937cc0e7e tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [instance: 3ceabacb-cbf6-409a-8c82-55e9901bd8d7] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:49.335090 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7823d5b0-fc49-400d-af27-d2c937cc0e7e tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:49.337021 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7823d5b0-fc49-400d-af27-d2c937cc0e7e tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:49.338775 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7823d5b0-fc49-400d-af27-d2c937cc0e7e tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:49.340916 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7823d5b0-fc49-400d-af27-d2c937cc0e7e tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:49.341563 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7823d5b0-fc49-400d-af27-d2c937cc0e7e tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:49.342108 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7823d5b0-fc49-400d-af27-d2c937cc0e7e tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:49.432386 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-7823d5b0-fc49-400d-af27-d2c937cc0e7e tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "GET /compute/v2.1/servers/3ceabacb-cbf6-409a-8c82-55e9901bd8d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.134620 Sep 14 09:17:49.433161 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2779/5533] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 14 09:17:49 2022] GET /compute/v2.1/servers/3ceabacb-cbf6-409a-8c82-55e9901bd8d7/os-volume_attachments => generated 197 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:17:49.629555 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-386b8a35-a460-4cff-8dba-3d9be5e106ef tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:49.633006 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-386b8a35-a460-4cff-8dba-3d9be5e106ef tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 50157c1b-c748-4d1f-928e-207482b37ec6] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:49.645232 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-386b8a35-a460-4cff-8dba-3d9be5e106ef tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:49.648541 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-386b8a35-a460-4cff-8dba-3d9be5e106ef tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:49.649169 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-386b8a35-a460-4cff-8dba-3d9be5e106ef tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:49.651374 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-386b8a35-a460-4cff-8dba-3d9be5e106ef tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:49.652171 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-386b8a35-a460-4cff-8dba-3d9be5e106ef tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:49.652796 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-386b8a35-a460-4cff-8dba-3d9be5e106ef tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:49.678139 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:17:49.693391 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-386b8a35-a460-4cff-8dba-3d9be5e106ef tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.070429 Sep 14 09:17:49.699727 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2755/5534] 10.222.0.60 () {60 vars in 1343 bytes} [Wed Sep 14 09:17:49 2022] GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6/os-volume_attachments => generated 25 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:17:49.782298 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-2725fcb2-8ae5-41fe-9abe-6a4d717b39d4 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:49.783254 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-2725fcb2-8ae5-41fe-9abe-6a4d717b39d4 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 50157c1b-c748-4d1f-928e-207482b37ec6] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:49.789985 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2725fcb2-8ae5-41fe-9abe-6a4d717b39d4 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:49.790769 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2725fcb2-8ae5-41fe-9abe-6a4d717b39d4 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:49.791448 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2725fcb2-8ae5-41fe-9abe-6a4d717b39d4 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:49.792500 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2725fcb2-8ae5-41fe-9abe-6a4d717b39d4 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:49.793171 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2725fcb2-8ae5-41fe-9abe-6a4d717b39d4 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:49.793830 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2725fcb2-8ae5-41fe-9abe-6a4d717b39d4 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:49.836098 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-2725fcb2-8ae5-41fe-9abe-6a4d717b39d4 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 50157c1b-c748-4d1f-928e-207482b37ec6] Going to try to terminate instance {{(pid=128758) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:17:50.004029 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-2725fcb2-8ae5-41fe-9abe-6a4d717b39d4 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "DELETE /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6" status: 204 len: 0 microversion: 2.20 time: 0.225129 Sep 14 09:17:50.009200 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2780/5535] 10.222.0.60 () {60 vars in 1280 bytes} [Wed Sep 14 09:17:49 2022] DELETE /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 14 09:17:50.013963 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3515743e-d35f-4cc6-a238-18f08d2a3bfc tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:50.014547 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-3515743e-d35f-4cc6-a238-18f08d2a3bfc tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 50157c1b-c748-4d1f-928e-207482b37ec6] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:50.029009 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3515743e-d35f-4cc6-a238-18f08d2a3bfc tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:50.029513 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3515743e-d35f-4cc6-a238-18f08d2a3bfc tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:50.029951 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3515743e-d35f-4cc6-a238-18f08d2a3bfc tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:50.030859 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3515743e-d35f-4cc6-a238-18f08d2a3bfc tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:50.037400 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3515743e-d35f-4cc6-a238-18f08d2a3bfc tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:50.037855 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3515743e-d35f-4cc6-a238-18f08d2a3bfc tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:50.227304 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-4b14756e-be94-4cce-a809-73c0e4dd640d tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:50.228023 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-4b14756e-be94-4cce-a809-73c0e4dd640d tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 3c2f5d0d-16a5-4f33-8f02-a84296eb09ef] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:50.238662 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4b14756e-be94-4cce-a809-73c0e4dd640d tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:50.245128 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4b14756e-be94-4cce-a809-73c0e4dd640d tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:50.246391 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4b14756e-be94-4cce-a809-73c0e4dd640d tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:50.247214 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4b14756e-be94-4cce-a809-73c0e4dd640d tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:50.247792 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4b14756e-be94-4cce-a809-73c0e4dd640d tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:50.248682 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4b14756e-be94-4cce-a809-73c0e4dd640d tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:50.767937 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-3515743e-d35f-4cc6-a238-18f08d2a3bfc tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:50.777874 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-4b14756e-be94-4cce-a809-73c0e4dd640d tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03dc827647f4483beb2e1b7888be608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229e11b3c1fe48b088d0f3c4bb7e2cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:50.795205 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-4b14756e-be94-4cce-a809-73c0e4dd640d tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "GET /compute/v2.1/servers/3c2f5d0d-16a5-4f33-8f02-a84296eb09ef" status: 200 len: 1522 microversion: 2.1 time: 0.572484 Sep 14 09:17:50.795995 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2781/5536] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:17:50 2022] GET /compute/v2.1/servers/3c2f5d0d-16a5-4f33-8f02-a84296eb09ef => generated 1522 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:17:50.812013 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-3515743e-d35f-4cc6-a238-18f08d2a3bfc tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:50.814109 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-3515743e-d35f-4cc6-a238-18f08d2a3bfc tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:50.821901 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-3515743e-d35f-4cc6-a238-18f08d2a3bfc tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6" status: 200 len: 1722 microversion: 2.20 time: 0.811120 Sep 14 09:17:50.822987 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2756/5537] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:17:50 2022] GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6 => generated 1722 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:17:50.824200 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-619cdb6c-c520-4760-b48e-2dee5f0d938d tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:50.827799 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-619cdb6c-c520-4760-b48e-2dee5f0d938d tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [instance: 3ceabacb-cbf6-409a-8c82-55e9901bd8d7] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:50.835478 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-619cdb6c-c520-4760-b48e-2dee5f0d938d tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:50.836214 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-619cdb6c-c520-4760-b48e-2dee5f0d938d tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:50.837725 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-619cdb6c-c520-4760-b48e-2dee5f0d938d tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:50.838703 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-619cdb6c-c520-4760-b48e-2dee5f0d938d tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:50.839413 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-619cdb6c-c520-4760-b48e-2dee5f0d938d tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:50.840134 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-619cdb6c-c520-4760-b48e-2dee5f0d938d tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:50.901158 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-619cdb6c-c520-4760-b48e-2dee5f0d938d tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "GET /compute/v2.1/servers/3ceabacb-cbf6-409a-8c82-55e9901bd8d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073938 Sep 14 09:17:50.902998 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2782/5538] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 14 09:17:50 2022] GET /compute/v2.1/servers/3ceabacb-cbf6-409a-8c82-55e9901bd8d7/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:17:51.819237 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8ed46982-9296-439f-aa89-0dfc4a4b6a92 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:51.820143 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-8ed46982-9296-439f-aa89-0dfc4a4b6a92 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 3c2f5d0d-16a5-4f33-8f02-a84296eb09ef] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:51.850855 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-56d1cac7-c376-44a4-867e-357b804a4476 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:51.851499 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-56d1cac7-c376-44a4-867e-357b804a4476 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 50157c1b-c748-4d1f-928e-207482b37ec6] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:51.857544 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8ed46982-9296-439f-aa89-0dfc4a4b6a92 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:51.866180 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8ed46982-9296-439f-aa89-0dfc4a4b6a92 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:51.867009 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8ed46982-9296-439f-aa89-0dfc4a4b6a92 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:51.868307 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-56d1cac7-c376-44a4-867e-357b804a4476 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:51.869350 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8ed46982-9296-439f-aa89-0dfc4a4b6a92 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:51.870054 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8ed46982-9296-439f-aa89-0dfc4a4b6a92 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:51.870743 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-56d1cac7-c376-44a4-867e-357b804a4476 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:51.871420 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8ed46982-9296-439f-aa89-0dfc4a4b6a92 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:51.872055 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-56d1cac7-c376-44a4-867e-357b804a4476 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:51.875906 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-56d1cac7-c376-44a4-867e-357b804a4476 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:51.877599 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-56d1cac7-c376-44a4-867e-357b804a4476 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:51.878452 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-56d1cac7-c376-44a4-867e-357b804a4476 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:52.378350 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-8ed46982-9296-439f-aa89-0dfc4a4b6a92 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03dc827647f4483beb2e1b7888be608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229e11b3c1fe48b088d0f3c4bb7e2cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:52.387217 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-8ed46982-9296-439f-aa89-0dfc4a4b6a92 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "GET /compute/v2.1/servers/3c2f5d0d-16a5-4f33-8f02-a84296eb09ef" status: 200 len: 1522 microversion: 2.1 time: 0.573362 Sep 14 09:17:52.390141 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2757/5539] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:17:51 2022] GET /compute/v2.1/servers/3c2f5d0d-16a5-4f33-8f02-a84296eb09ef => generated 1522 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:17:52.396328 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-968b818e-30de-46c0-8bdf-93696bf19823 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:52.398859 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-968b818e-30de-46c0-8bdf-93696bf19823 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [instance: 3ceabacb-cbf6-409a-8c82-55e9901bd8d7] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:52.421233 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-968b818e-30de-46c0-8bdf-93696bf19823 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:52.422365 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-968b818e-30de-46c0-8bdf-93696bf19823 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:52.427166 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-968b818e-30de-46c0-8bdf-93696bf19823 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:52.428140 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-968b818e-30de-46c0-8bdf-93696bf19823 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:52.428795 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-968b818e-30de-46c0-8bdf-93696bf19823 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:52.429389 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-968b818e-30de-46c0-8bdf-93696bf19823 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:52.464381 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-56d1cac7-c376-44a4-867e-357b804a4476 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:52.492187 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-56d1cac7-c376-44a4-867e-357b804a4476 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:52.499500 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-56d1cac7-c376-44a4-867e-357b804a4476 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:52.502044 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-56d1cac7-c376-44a4-867e-357b804a4476 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6" status: 200 len: 1722 microversion: 2.20 time: 0.655526 Sep 14 09:17:52.504598 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2783/5540] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:17:51 2022] GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6 => generated 1722 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:17:52.522006 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-968b818e-30de-46c0-8bdf-93696bf19823 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "GET /compute/v2.1/servers/3ceabacb-cbf6-409a-8c82-55e9901bd8d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.130455 Sep 14 09:17:52.529375 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2758/5541] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 14 09:17:52 2022] GET /compute/v2.1/servers/3ceabacb-cbf6-409a-8c82-55e9901bd8d7/os-volume_attachments => generated 197 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:17:53.421312 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-44a294eb-2e2b-46d4-9e31-ea75c4f32818 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:53.424057 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-44a294eb-2e2b-46d4-9e31-ea75c4f32818 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 3c2f5d0d-16a5-4f33-8f02-a84296eb09ef] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:53.445751 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-44a294eb-2e2b-46d4-9e31-ea75c4f32818 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:53.448552 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-44a294eb-2e2b-46d4-9e31-ea75c4f32818 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:53.452161 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-44a294eb-2e2b-46d4-9e31-ea75c4f32818 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:53.453226 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-44a294eb-2e2b-46d4-9e31-ea75c4f32818 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:53.453874 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-44a294eb-2e2b-46d4-9e31-ea75c4f32818 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:53.454479 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-44a294eb-2e2b-46d4-9e31-ea75c4f32818 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:53.542932 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-7eebe740-05bd-4e26-8e41-6c8ad534c427 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:53.545192 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-7eebe740-05bd-4e26-8e41-6c8ad534c427 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [instance: 3ceabacb-cbf6-409a-8c82-55e9901bd8d7] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:53.580948 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7eebe740-05bd-4e26-8e41-6c8ad534c427 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:53.581309 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7eebe740-05bd-4e26-8e41-6c8ad534c427 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:53.581756 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7eebe740-05bd-4e26-8e41-6c8ad534c427 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:53.582484 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7eebe740-05bd-4e26-8e41-6c8ad534c427 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:53.582969 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7eebe740-05bd-4e26-8e41-6c8ad534c427 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:53.587231 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7eebe740-05bd-4e26-8e41-6c8ad534c427 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:53.702154 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-7eebe740-05bd-4e26-8e41-6c8ad534c427 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "GET /compute/v2.1/servers/3ceabacb-cbf6-409a-8c82-55e9901bd8d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.166732 Sep 14 09:17:53.714824 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2759/5542] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 14 09:17:53 2022] GET /compute/v2.1/servers/3ceabacb-cbf6-409a-8c82-55e9901bd8d7/os-volume_attachments => generated 197 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:17:53.731204 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-1b3934d3-9a68-4a22-8261-508ce42fbc82 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:53.736921 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-1b3934d3-9a68-4a22-8261-508ce42fbc82 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 50157c1b-c748-4d1f-928e-207482b37ec6] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:53.767118 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1b3934d3-9a68-4a22-8261-508ce42fbc82 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:53.767668 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1b3934d3-9a68-4a22-8261-508ce42fbc82 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:53.768135 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1b3934d3-9a68-4a22-8261-508ce42fbc82 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:53.768881 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1b3934d3-9a68-4a22-8261-508ce42fbc82 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:53.769363 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1b3934d3-9a68-4a22-8261-508ce42fbc82 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:53.769788 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1b3934d3-9a68-4a22-8261-508ce42fbc82 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:54.049889 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-1b3934d3-9a68-4a22-8261-508ce42fbc82 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:54.063542 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-1b3934d3-9a68-4a22-8261-508ce42fbc82 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:54.070480 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-1b3934d3-9a68-4a22-8261-508ce42fbc82 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78051740ae354035b119d5d8ebe226f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0762ad3f774829b58669b312dd13f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:54.073564 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-1b3934d3-9a68-4a22-8261-508ce42fbc82 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6" status: 200 len: 1655 microversion: 2.20 time: 0.356840 Sep 14 09:17:54.078127 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2760/5543] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:17:53 2022] GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6 => generated 1655 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:17:54.092085 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-5a2ef5b7-7133-4551-9ca5-492b504f8098 req-8b149735-60b7-4d6f-acf7-20c42a76580a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50157c1b-c748-4d1f-928e-207482b37ec6", "name": "network-vif-deleted", "tag": "6bb7c82b-6dea-4020-abff-f1c92580e9d8"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:17:54.109751 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-5a2ef5b7-7133-4551-9ca5-492b504f8098 req-8b149735-60b7-4d6f-acf7-20c42a76580a service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:54.113860 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-5a2ef5b7-7133-4551-9ca5-492b504f8098 req-8b149735-60b7-4d6f-acf7-20c42a76580a service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:54.114627 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-5a2ef5b7-7133-4551-9ca5-492b504f8098 req-8b149735-60b7-4d6f-acf7-20c42a76580a service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:54.152425 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-5a2ef5b7-7133-4551-9ca5-492b504f8098 req-8b149735-60b7-4d6f-acf7-20c42a76580a service nova] Creating event network-vif-deleted:6bb7c82b-6dea-4020-abff-f1c92580e9d8 for instance 50157c1b-c748-4d1f-928e-207482b37ec6 on n-h1-836830-18 Sep 14 09:17:54.170147 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-5a2ef5b7-7133-4551-9ca5-492b504f8098 req-8b149735-60b7-4d6f-acf7-20c42a76580a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080534 Sep 14 09:17:54.171532 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2761/5544] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:17:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:17:54.182523 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-44a294eb-2e2b-46d4-9e31-ea75c4f32818 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03dc827647f4483beb2e1b7888be608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229e11b3c1fe48b088d0f3c4bb7e2cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:54.192219 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-44a294eb-2e2b-46d4-9e31-ea75c4f32818 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "GET /compute/v2.1/servers/3c2f5d0d-16a5-4f33-8f02-a84296eb09ef" status: 200 len: 1522 microversion: 2.1 time: 0.781818 Sep 14 09:17:54.197869 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2784/5545] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:17:53 2022] GET /compute/v2.1/servers/3c2f5d0d-16a5-4f33-8f02-a84296eb09ef => generated 1522 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:17:54.729583 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-533b96bc-1cee-4cf6-bc13-9cc6a5184f2e tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:54.731964 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-533b96bc-1cee-4cf6-bc13-9cc6a5184f2e tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [instance: 3ceabacb-cbf6-409a-8c82-55e9901bd8d7] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:54.749851 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-533b96bc-1cee-4cf6-bc13-9cc6a5184f2e tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:54.751512 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-533b96bc-1cee-4cf6-bc13-9cc6a5184f2e tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:54.751969 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-533b96bc-1cee-4cf6-bc13-9cc6a5184f2e tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:54.752694 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-533b96bc-1cee-4cf6-bc13-9cc6a5184f2e tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:54.753161 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-533b96bc-1cee-4cf6-bc13-9cc6a5184f2e tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:54.753591 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-533b96bc-1cee-4cf6-bc13-9cc6a5184f2e tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:54.838635 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-533b96bc-1cee-4cf6-bc13-9cc6a5184f2e tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "GET /compute/v2.1/servers/3ceabacb-cbf6-409a-8c82-55e9901bd8d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.116017 Sep 14 09:17:54.839706 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2762/5546] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 14 09:17:54 2022] GET /compute/v2.1/servers/3ceabacb-cbf6-409a-8c82-55e9901bd8d7/os-volume_attachments => generated 197 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:17:55.109843 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1e005f4a-3b47-410a-968d-b81f2da1c508 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:55.110640 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-1e005f4a-3b47-410a-968d-b81f2da1c508 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 50157c1b-c748-4d1f-928e-207482b37ec6] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:55.136365 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1e005f4a-3b47-410a-968d-b81f2da1c508 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:55.137429 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1e005f4a-3b47-410a-968d-b81f2da1c508 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:55.138044 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1e005f4a-3b47-410a-968d-b81f2da1c508 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:55.139019 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1e005f4a-3b47-410a-968d-b81f2da1c508 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:55.139771 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1e005f4a-3b47-410a-968d-b81f2da1c508 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:55.140366 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1e005f4a-3b47-410a-968d-b81f2da1c508 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:55.173647 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-1e005f4a-3b47-410a-968d-b81f2da1c508 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] HTTP exception thrown: Instance 50157c1b-c748-4d1f-928e-207482b37ec6 could not be found. Sep 14 09:17:55.176144 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1e005f4a-3b47-410a-968d-b81f2da1c508 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Request method failure captured: Sep 14 09:17:55.176144 n-d-836830-18 devstack@n-api.service[128758]: request: GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6 HTTP/1.1 Sep 14 09:17:55.176144 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 09:17:55.176144 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 09:17:55.176144 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 09:17:55.176144 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 09:17:55.176144 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 09:17:55.176144 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 09:17:55.176144 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 09:17:55.176144 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 09:17:55.176144 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZoiSZxqfCErkF28duCwoLyyA4BG19wUNeFXOWecMNNAmQ9wif7QtxjzWvetj4gEDO8xf7CL7dW1ytU3meYaX-_dv0e24VHnEQ0Ft5dtNXSDMao67NjyX9jDMbRsLsyQjAEEs08qr3suFBU2oznwRQHl5Fh4kiecRaFcfIdWFOEZaLM Sep 14 09:17:55.176144 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 09:17:55.176144 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 09:17:55.176144 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 09:17:55.176144 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 09:17:55.176144 n-d-836830-18 devstack@n-api.service[128758]: X-Openstack-Nova-Api-Version: 2.20 Sep 14 09:17:55.176144 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 09:17:55.176144 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 09:17:55.176144 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 9c0762ad3f774829b58669b312dd13f7 Sep 14 09:17:55.176144 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-760665547 Sep 14 09:17:55.176144 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 09:17:55.176144 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 09:17:55.176144 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/9c0762ad3f774829b58669b312dd13f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_9c0762ad3f774829b58669b312dd13f7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9c0762ad3f774829b58669b312dd13f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9c0762ad3f774829b58669b312dd13f7"}]}] Sep 14 09:17:55.176144 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-AttachVolumeShelveTestJSON-760665547 Sep 14 09:17:55.176144 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 9c0762ad3f774829b58669b312dd13f7 Sep 14 09:17:55.176144 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-760665547 Sep 14 09:17:55.176144 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-AttachVolumeShelveTestJSON-760665547-project Sep 14 09:17:55.176144 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 09:17:55.176144 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 09:17:55.176144 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 78051740ae354035b119d5d8ebe226f1 Sep 14 09:17:55.176144 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-AttachVolumeShelveTestJSON-760665547-project Sep 14 09:17:55.176144 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 09:17:55.176144 n-d-836830-18 devstack@n-api.service[128758]: exception: Instance 50157c1b-c748-4d1f-928e-207482b37ec6 could not be found. Sep 14 09:17:55.176144 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': '50157c1b-c748-4d1f-928e-207482b37ec6'} Sep 14 09:17:55.176144 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:17:55.176144 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:17:55.176144 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:17:55.176144 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:17:55.176144 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:17:55.176144 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:17:55.176144 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:17:55.176144 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:17:55.176144 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:17:55.176144 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:17:55.176144 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50157c1b-c748-4d1f-928e-207482b37ec6 could not be found. Sep 14 09:17:55.176144 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:17:55.176144 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:17:55.176144 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:17:55.176144 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:17:55.176144 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:17:55.176144 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:17:55.176144 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:17:55.176144 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:17:55.176144 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:17:55.176144 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:17:55.176144 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:17:55.176144 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:17:55.176144 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:17:55.176144 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:17:55.176144 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:17:55.176144 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:17:55.176144 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50157c1b-c748-4d1f-928e-207482b37ec6 could not be found. Sep 14 09:17:55.176144 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:17:55.176144 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:17:55.183638 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:17:55.183638 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:17:55.183638 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:17:55.183638 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:17:55.183638 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:17:55.183638 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:17:55.183638 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50157c1b-c748-4d1f-928e-207482b37ec6 could not be found. Sep 14 09:17:55.183638 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:17:55.187405 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1e005f4a-3b47-410a-968d-b81f2da1c508 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Returning 404 to user: Instance 50157c1b-c748-4d1f-928e-207482b37ec6 could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:17:55.190072 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-1e005f4a-3b47-410a-968d-b81f2da1c508 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6" status: 404 len: 111 microversion: 2.20 time: 0.088006 Sep 14 09:17:55.196678 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2785/5547] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:17:55 2022] GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 14 09:17:55.200768 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a3bdddf9-4550-4190-aa2a-4fcc9b35138d tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '.version_select at 0x7f7d3edcb1f0>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:55.227584 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ac2b7e4d-e0a1-4fb9-b9ab-461e314df940 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:55.227787 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-ac2b7e4d-e0a1-4fb9-b9ab-461e314df940 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 3c2f5d0d-16a5-4f33-8f02-a84296eb09ef] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:55.249887 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ac2b7e4d-e0a1-4fb9-b9ab-461e314df940 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:55.251026 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ac2b7e4d-e0a1-4fb9-b9ab-461e314df940 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:55.255995 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ac2b7e4d-e0a1-4fb9-b9ab-461e314df940 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:55.256931 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ac2b7e4d-e0a1-4fb9-b9ab-461e314df940 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:55.257619 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ac2b7e4d-e0a1-4fb9-b9ab-461e314df940 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:55.258221 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ac2b7e4d-e0a1-4fb9-b9ab-461e314df940 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:55.288812 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a3bdddf9-4550-4190-aa2a-4fcc9b35138d tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1111074361" status: 204 len: 0 microversion: 2.20 time: 0.092016 Sep 14 09:17:55.289666 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2763/5548] 10.222.0.60 () {60 vars in 1262 bytes} [Wed Sep 14 09:17:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1111074361 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 14 09:17:55.777130 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-ac2b7e4d-e0a1-4fb9-b9ab-461e314df940 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03dc827647f4483beb2e1b7888be608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229e11b3c1fe48b088d0f3c4bb7e2cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:55.786972 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-ac2b7e4d-e0a1-4fb9-b9ab-461e314df940 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "GET /compute/v2.1/servers/3c2f5d0d-16a5-4f33-8f02-a84296eb09ef" status: 200 len: 1522 microversion: 2.1 time: 0.563964 Sep 14 09:17:55.787558 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2786/5549] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:17:55 2022] GET /compute/v2.1/servers/3c2f5d0d-16a5-4f33-8f02-a84296eb09ef => generated 1522 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:17:55.851353 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-bb6557fd-7039-483b-a4a7-b0f79a1d1e0c tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:55.853621 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-bb6557fd-7039-483b-a4a7-b0f79a1d1e0c tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [instance: 3ceabacb-cbf6-409a-8c82-55e9901bd8d7] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:55.871094 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bb6557fd-7039-483b-a4a7-b0f79a1d1e0c tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:55.871697 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bb6557fd-7039-483b-a4a7-b0f79a1d1e0c tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:55.872350 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bb6557fd-7039-483b-a4a7-b0f79a1d1e0c tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:55.873712 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bb6557fd-7039-483b-a4a7-b0f79a1d1e0c tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:55.883771 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bb6557fd-7039-483b-a4a7-b0f79a1d1e0c tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:55.884471 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bb6557fd-7039-483b-a4a7-b0f79a1d1e0c tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:55.944385 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-bb6557fd-7039-483b-a4a7-b0f79a1d1e0c tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "GET /compute/v2.1/servers/3ceabacb-cbf6-409a-8c82-55e9901bd8d7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.094926 Sep 14 09:17:55.962804 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2764/5550] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 14 09:17:55 2022] GET /compute/v2.1/servers/3ceabacb-cbf6-409a-8c82-55e9901bd8d7/os-volume_attachments => generated 25 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 09:17:56.085927 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-bfbad28b-7db1-4c1f-9ffc-fbd2573ca98b tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:56.086805 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-bfbad28b-7db1-4c1f-9ffc-fbd2573ca98b tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [instance: 3ceabacb-cbf6-409a-8c82-55e9901bd8d7] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:56.093684 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bfbad28b-7db1-4c1f-9ffc-fbd2573ca98b tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:56.094661 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bfbad28b-7db1-4c1f-9ffc-fbd2573ca98b tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:56.095338 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bfbad28b-7db1-4c1f-9ffc-fbd2573ca98b tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:56.096295 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bfbad28b-7db1-4c1f-9ffc-fbd2573ca98b tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:56.096964 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bfbad28b-7db1-4c1f-9ffc-fbd2573ca98b tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:56.097602 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bfbad28b-7db1-4c1f-9ffc-fbd2573ca98b tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:56.131670 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-bfbad28b-7db1-4c1f-9ffc-fbd2573ca98b tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [instance: 3ceabacb-cbf6-409a-8c82-55e9901bd8d7] Going to try to terminate instance {{(pid=128758) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:17:56.264877 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-bfbad28b-7db1-4c1f-9ffc-fbd2573ca98b tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "DELETE /compute/v2.1/servers/3ceabacb-cbf6-409a-8c82-55e9901bd8d7" status: 204 len: 0 microversion: 2.1 time: 0.183080 Sep 14 09:17:56.265483 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2787/5551] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:17:56 2022] DELETE /compute/v2.1/servers/3ceabacb-cbf6-409a-8c82-55e9901bd8d7 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:17:56.275465 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-27674896-a5f9-4f7b-832b-af3601161802 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:56.276191 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-27674896-a5f9-4f7b-832b-af3601161802 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [instance: 3ceabacb-cbf6-409a-8c82-55e9901bd8d7] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:56.300644 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-27674896-a5f9-4f7b-832b-af3601161802 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:56.301264 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-27674896-a5f9-4f7b-832b-af3601161802 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:56.302551 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-27674896-a5f9-4f7b-832b-af3601161802 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:56.304025 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-27674896-a5f9-4f7b-832b-af3601161802 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:56.305230 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-27674896-a5f9-4f7b-832b-af3601161802 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:56.305990 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-27674896-a5f9-4f7b-832b-af3601161802 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:56.811999 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-74d47768-270f-4531-984d-0b93f70d9220 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:56.813066 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-74d47768-270f-4531-984d-0b93f70d9220 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 3c2f5d0d-16a5-4f33-8f02-a84296eb09ef] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:56.835675 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-74d47768-270f-4531-984d-0b93f70d9220 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:56.837673 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-74d47768-270f-4531-984d-0b93f70d9220 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:56.838213 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-74d47768-270f-4531-984d-0b93f70d9220 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:56.840762 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-74d47768-270f-4531-984d-0b93f70d9220 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:56.844773 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-74d47768-270f-4531-984d-0b93f70d9220 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:56.845576 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-74d47768-270f-4531-984d-0b93f70d9220 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:57.090829 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-27674896-a5f9-4f7b-832b-af3601161802 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daab4f69af5452c8641006d9f09edce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9672a6c416ee44289eaa4d7c664d307e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:57.102572 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-27674896-a5f9-4f7b-832b-af3601161802 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "GET /compute/v2.1/servers/3ceabacb-cbf6-409a-8c82-55e9901bd8d7" status: 200 len: 1682 microversion: 2.1 time: 0.832230 Sep 14 09:17:57.108516 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2765/5552] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:17:56 2022] GET /compute/v2.1/servers/3ceabacb-cbf6-409a-8c82-55e9901bd8d7 => generated 1682 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:17:57.311049 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-74d47768-270f-4531-984d-0b93f70d9220 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03dc827647f4483beb2e1b7888be608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229e11b3c1fe48b088d0f3c4bb7e2cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:57.322414 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-74d47768-270f-4531-984d-0b93f70d9220 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "GET /compute/v2.1/servers/3c2f5d0d-16a5-4f33-8f02-a84296eb09ef" status: 200 len: 1522 microversion: 2.1 time: 0.514814 Sep 14 09:17:57.324313 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2788/5553] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:17:56 2022] GET /compute/v2.1/servers/3c2f5d0d-16a5-4f33-8f02-a84296eb09ef => generated 1522 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:17:58.151928 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-34db9dd3-62bf-4ef6-bd3c-a98a06e78d10 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:58.152601 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-34db9dd3-62bf-4ef6-bd3c-a98a06e78d10 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [instance: 3ceabacb-cbf6-409a-8c82-55e9901bd8d7] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:58.177906 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-34db9dd3-62bf-4ef6-bd3c-a98a06e78d10 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:58.179468 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-34db9dd3-62bf-4ef6-bd3c-a98a06e78d10 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:58.181141 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-34db9dd3-62bf-4ef6-bd3c-a98a06e78d10 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:58.182881 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-34db9dd3-62bf-4ef6-bd3c-a98a06e78d10 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:58.184878 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-34db9dd3-62bf-4ef6-bd3c-a98a06e78d10 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:58.186909 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-34db9dd3-62bf-4ef6-bd3c-a98a06e78d10 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:58.353444 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ba495551-ad1e-44b2-9ec3-ca3d23d61e01 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:58.354764 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-ba495551-ad1e-44b2-9ec3-ca3d23d61e01 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 3c2f5d0d-16a5-4f33-8f02-a84296eb09ef] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:58.369260 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ba495551-ad1e-44b2-9ec3-ca3d23d61e01 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:58.374543 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ba495551-ad1e-44b2-9ec3-ca3d23d61e01 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:58.375326 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ba495551-ad1e-44b2-9ec3-ca3d23d61e01 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:58.376274 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ba495551-ad1e-44b2-9ec3-ca3d23d61e01 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:58.376937 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ba495551-ad1e-44b2-9ec3-ca3d23d61e01 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:58.377595 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ba495551-ad1e-44b2-9ec3-ca3d23d61e01 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:58.425122 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-34db9dd3-62bf-4ef6-bd3c-a98a06e78d10 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daab4f69af5452c8641006d9f09edce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9672a6c416ee44289eaa4d7c664d307e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:58.438687 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-34db9dd3-62bf-4ef6-bd3c-a98a06e78d10 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "GET /compute/v2.1/servers/3ceabacb-cbf6-409a-8c82-55e9901bd8d7" status: 200 len: 1682 microversion: 2.1 time: 0.310311 Sep 14 09:17:58.443597 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2766/5554] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:17:58 2022] GET /compute/v2.1/servers/3ceabacb-cbf6-409a-8c82-55e9901bd8d7 => generated 1682 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:17:59.086575 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-ba495551-ad1e-44b2-9ec3-ca3d23d61e01 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03dc827647f4483beb2e1b7888be608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229e11b3c1fe48b088d0f3c4bb7e2cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:59.118126 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-ba495551-ad1e-44b2-9ec3-ca3d23d61e01 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "GET /compute/v2.1/servers/3c2f5d0d-16a5-4f33-8f02-a84296eb09ef" status: 200 len: 1522 microversion: 2.1 time: 0.767581 Sep 14 09:17:59.122406 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2789/5555] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:17:58 2022] GET /compute/v2.1/servers/3c2f5d0d-16a5-4f33-8f02-a84296eb09ef => generated 1522 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:17:59.475713 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-07571b1d-9260-4fb6-a719-96ccb4a3cac3 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:59.477625 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-07571b1d-9260-4fb6-a719-96ccb4a3cac3 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [instance: 3ceabacb-cbf6-409a-8c82-55e9901bd8d7] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:59.509865 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-07571b1d-9260-4fb6-a719-96ccb4a3cac3 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:59.511214 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-07571b1d-9260-4fb6-a719-96ccb4a3cac3 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:59.523711 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-07571b1d-9260-4fb6-a719-96ccb4a3cac3 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:59.530741 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-07571b1d-9260-4fb6-a719-96ccb4a3cac3 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:59.536312 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-07571b1d-9260-4fb6-a719-96ccb4a3cac3 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:59.545607 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-07571b1d-9260-4fb6-a719-96ccb4a3cac3 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:00.151615 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-250debe0-04c4-4176-a723-5bdef20d516f tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:00.152435 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-250debe0-04c4-4176-a723-5bdef20d516f tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 3c2f5d0d-16a5-4f33-8f02-a84296eb09ef] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:00.169390 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-250debe0-04c4-4176-a723-5bdef20d516f tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:00.171324 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-250debe0-04c4-4176-a723-5bdef20d516f tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:00.173207 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-250debe0-04c4-4176-a723-5bdef20d516f tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:00.175180 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-250debe0-04c4-4176-a723-5bdef20d516f tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:00.178285 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-250debe0-04c4-4176-a723-5bdef20d516f tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:00.179711 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-250debe0-04c4-4176-a723-5bdef20d516f tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:00.196982 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-07571b1d-9260-4fb6-a719-96ccb4a3cac3 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daab4f69af5452c8641006d9f09edce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9672a6c416ee44289eaa4d7c664d307e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:00.212383 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-07571b1d-9260-4fb6-a719-96ccb4a3cac3 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "GET /compute/v2.1/servers/3ceabacb-cbf6-409a-8c82-55e9901bd8d7" status: 200 len: 1682 microversion: 2.1 time: 0.745821 Sep 14 09:18:00.214020 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2767/5556] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:17:59 2022] GET /compute/v2.1/servers/3ceabacb-cbf6-409a-8c82-55e9901bd8d7 => generated 1682 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:18:01.244833 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-250debe0-04c4-4176-a723-5bdef20d516f tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03dc827647f4483beb2e1b7888be608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229e11b3c1fe48b088d0f3c4bb7e2cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:01.245358 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-cbfe6fd7-e185-49c1-96e2-1e68433d43ad tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:01.245810 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-cbfe6fd7-e185-49c1-96e2-1e68433d43ad tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [instance: 3ceabacb-cbf6-409a-8c82-55e9901bd8d7] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:01.253303 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:18:01.257169 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-250debe0-04c4-4176-a723-5bdef20d516f tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "GET /compute/v2.1/servers/3c2f5d0d-16a5-4f33-8f02-a84296eb09ef" status: 200 len: 1522 microversion: 2.1 time: 1.110621 Sep 14 09:18:01.259600 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cbfe6fd7-e185-49c1-96e2-1e68433d43ad tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:01.269822 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cbfe6fd7-e185-49c1-96e2-1e68433d43ad tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:01.270644 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2790/5557] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:18:00 2022] GET /compute/v2.1/servers/3c2f5d0d-16a5-4f33-8f02-a84296eb09ef => generated 1522 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:18:01.270769 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cbfe6fd7-e185-49c1-96e2-1e68433d43ad tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:01.271897 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cbfe6fd7-e185-49c1-96e2-1e68433d43ad tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:01.276902 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cbfe6fd7-e185-49c1-96e2-1e68433d43ad tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:01.280673 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cbfe6fd7-e185-49c1-96e2-1e68433d43ad tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:01.704099 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-cbfe6fd7-e185-49c1-96e2-1e68433d43ad tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daab4f69af5452c8641006d9f09edce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9672a6c416ee44289eaa4d7c664d307e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:01.714604 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-cbfe6fd7-e185-49c1-96e2-1e68433d43ad tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "GET /compute/v2.1/servers/3ceabacb-cbf6-409a-8c82-55e9901bd8d7" status: 200 len: 1614 microversion: 2.1 time: 0.476385 Sep 14 09:18:01.738164 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2768/5558] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:18:01 2022] GET /compute/v2.1/servers/3ceabacb-cbf6-409a-8c82-55e9901bd8d7 => generated 1614 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:18:01.998881 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-4c2a12b0-5ec6-45d4-b119-7065e445e7c2 req-38a4ffe2-32fc-44b9-86cb-ceae102aae79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ceabacb-cbf6-409a-8c82-55e9901bd8d7", "name": "network-vif-deleted", "tag": "e75fecd4-ad0f-481f-b575-74e5343cdbc3"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:18:02.042794 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-4c2a12b0-5ec6-45d4-b119-7065e445e7c2 req-38a4ffe2-32fc-44b9-86cb-ceae102aae79 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:02.044251 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-4c2a12b0-5ec6-45d4-b119-7065e445e7c2 req-38a4ffe2-32fc-44b9-86cb-ceae102aae79 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:02.044706 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-4c2a12b0-5ec6-45d4-b119-7065e445e7c2 req-38a4ffe2-32fc-44b9-86cb-ceae102aae79 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:02.077538 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-4c2a12b0-5ec6-45d4-b119-7065e445e7c2 req-38a4ffe2-32fc-44b9-86cb-ceae102aae79 service nova] Creating event network-vif-deleted:e75fecd4-ad0f-481f-b575-74e5343cdbc3 for instance 3ceabacb-cbf6-409a-8c82-55e9901bd8d7 on n-h1-836830-18 Sep 14 09:18:02.086436 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-4c2a12b0-5ec6-45d4-b119-7065e445e7c2 req-38a4ffe2-32fc-44b9-86cb-ceae102aae79 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091847 Sep 14 09:18:02.087094 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2791/5559] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:18:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:18:02.283120 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-1859fc49-4988-439d-aaa9-a84dc08191ef tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:02.283749 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-1859fc49-4988-439d-aaa9-a84dc08191ef tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 3c2f5d0d-16a5-4f33-8f02-a84296eb09ef] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:02.304477 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1859fc49-4988-439d-aaa9-a84dc08191ef tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:02.306022 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1859fc49-4988-439d-aaa9-a84dc08191ef tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:02.307341 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1859fc49-4988-439d-aaa9-a84dc08191ef tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:02.311899 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1859fc49-4988-439d-aaa9-a84dc08191ef tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:02.312607 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1859fc49-4988-439d-aaa9-a84dc08191ef tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:02.313243 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1859fc49-4988-439d-aaa9-a84dc08191ef tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:02.693835 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-9007f5cc-4315-409f-834b-bc7fd60ad374 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:02.695135 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-9007f5cc-4315-409f-834b-bc7fd60ad374 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 50157c1b-c748-4d1f-928e-207482b37ec6] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:02.711731 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9007f5cc-4315-409f-834b-bc7fd60ad374 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:02.712237 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9007f5cc-4315-409f-834b-bc7fd60ad374 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:02.712684 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9007f5cc-4315-409f-834b-bc7fd60ad374 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:02.713410 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9007f5cc-4315-409f-834b-bc7fd60ad374 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:02.713877 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9007f5cc-4315-409f-834b-bc7fd60ad374 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:02.714309 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9007f5cc-4315-409f-834b-bc7fd60ad374 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:02.744006 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-9007f5cc-4315-409f-834b-bc7fd60ad374 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] HTTP exception thrown: Instance 50157c1b-c748-4d1f-928e-207482b37ec6 could not be found. Sep 14 09:18:02.752262 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-9007f5cc-4315-409f-834b-bc7fd60ad374 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Request method failure captured: Sep 14 09:18:02.752262 n-d-836830-18 devstack@n-api.service[128758]: request: DELETE /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6 HTTP/1.1 Sep 14 09:18:02.752262 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 09:18:02.752262 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 09:18:02.752262 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 09:18:02.752262 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 09:18:02.752262 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 09:18:02.752262 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 09:18:02.752262 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 09:18:02.752262 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 09:18:02.752262 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZoiSZxqfCErkF28duCwoLyyA4BG19wUNeFXOWecMNNAmQ9wif7QtxjzWvetj4gEDO8xf7CL7dW1ytU3meYaX-_dv0e24VHnEQ0Ft5dtNXSDMao67NjyX9jDMbRsLsyQjAEEs08qr3suFBU2oznwRQHl5Fh4kiecRaFcfIdWFOEZaLM Sep 14 09:18:02.752262 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 09:18:02.752262 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 09:18:02.752262 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 09:18:02.752262 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 09:18:02.752262 n-d-836830-18 devstack@n-api.service[128758]: X-Openstack-Nova-Api-Version: 2.20 Sep 14 09:18:02.752262 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 09:18:02.752262 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 09:18:02.752262 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 9c0762ad3f774829b58669b312dd13f7 Sep 14 09:18:02.752262 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-760665547 Sep 14 09:18:02.752262 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 09:18:02.752262 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 09:18:02.752262 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/9c0762ad3f774829b58669b312dd13f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_9c0762ad3f774829b58669b312dd13f7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9c0762ad3f774829b58669b312dd13f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9c0762ad3f774829b58669b312dd13f7"}]}] Sep 14 09:18:02.752262 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-AttachVolumeShelveTestJSON-760665547 Sep 14 09:18:02.752262 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 9c0762ad3f774829b58669b312dd13f7 Sep 14 09:18:02.752262 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-760665547 Sep 14 09:18:02.752262 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-AttachVolumeShelveTestJSON-760665547-project Sep 14 09:18:02.752262 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 09:18:02.752262 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 09:18:02.752262 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 78051740ae354035b119d5d8ebe226f1 Sep 14 09:18:02.752262 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-AttachVolumeShelveTestJSON-760665547-project Sep 14 09:18:02.752262 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 09:18:02.752262 n-d-836830-18 devstack@n-api.service[128758]: exception: Instance 50157c1b-c748-4d1f-928e-207482b37ec6 could not be found. Sep 14 09:18:02.752262 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': '50157c1b-c748-4d1f-928e-207482b37ec6'} Sep 14 09:18:02.752262 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:18:02.752262 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:18:02.752262 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:18:02.752262 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:18:02.752262 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:18:02.752262 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:18:02.752262 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:18:02.752262 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:18:02.752262 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:18:02.752262 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:18:02.752262 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50157c1b-c748-4d1f-928e-207482b37ec6 could not be found. Sep 14 09:18:02.752262 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:18:02.752262 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:18:02.752262 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:18:02.752262 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:18:02.752262 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:18:02.752262 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:18:02.752262 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:18:02.752262 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:18:02.752262 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:18:02.752262 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:18:02.752262 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 09:18:02.752262 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 09:18:02.752262 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 09:18:02.752262 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 09:18:02.752262 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:18:02.752262 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:18:02.752262 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:18:02.752262 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:18:02.757719 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50157c1b-c748-4d1f-928e-207482b37ec6 could not be found. Sep 14 09:18:02.757719 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:18:02.757719 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:18:02.757719 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:18:02.757719 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:18:02.757719 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:18:02.757719 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:18:02.757719 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:18:02.757719 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:18:02.757719 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50157c1b-c748-4d1f-928e-207482b37ec6 could not be found. Sep 14 09:18:02.757719 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:18:02.762109 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-9007f5cc-4315-409f-834b-bc7fd60ad374 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Returning 404 to user: Instance 50157c1b-c748-4d1f-928e-207482b37ec6 could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:18:02.764928 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-9007f5cc-4315-409f-834b-bc7fd60ad374 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "DELETE /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6" status: 404 len: 111 microversion: 2.20 time: 0.077583 Sep 14 09:18:02.773856 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2792/5560] 10.222.0.60 () {60 vars in 1280 bytes} [Wed Sep 14 09:18:02 2022] DELETE /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 14 09:18:02.786915 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-5abd4ed5-3eab-4ac0-bf5a-ab2728245957 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:02.788735 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-5abd4ed5-3eab-4ac0-bf5a-ab2728245957 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [instance: 3ceabacb-cbf6-409a-8c82-55e9901bd8d7] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:02.825213 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5abd4ed5-3eab-4ac0-bf5a-ab2728245957 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:02.826064 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5abd4ed5-3eab-4ac0-bf5a-ab2728245957 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:02.827371 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5abd4ed5-3eab-4ac0-bf5a-ab2728245957 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:02.829130 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5abd4ed5-3eab-4ac0-bf5a-ab2728245957 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:02.831407 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5abd4ed5-3eab-4ac0-bf5a-ab2728245957 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:02.833712 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5abd4ed5-3eab-4ac0-bf5a-ab2728245957 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:02.884467 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-1859fc49-4988-439d-aaa9-a84dc08191ef tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03dc827647f4483beb2e1b7888be608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229e11b3c1fe48b088d0f3c4bb7e2cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:02.896510 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-1859fc49-4988-439d-aaa9-a84dc08191ef tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "GET /compute/v2.1/servers/3c2f5d0d-16a5-4f33-8f02-a84296eb09ef" status: 200 len: 1522 microversion: 2.1 time: 0.614762 Sep 14 09:18:02.897158 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2769/5561] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:18:02 2022] GET /compute/v2.1/servers/3c2f5d0d-16a5-4f33-8f02-a84296eb09ef => generated 1522 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:18:02.913231 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f3a360ac-4c58-4e55-b59b-770fff136724 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:02.914668 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f3a360ac-4c58-4e55-b59b-770fff136724 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 50157c1b-c748-4d1f-928e-207482b37ec6] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:02.922289 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5abd4ed5-3eab-4ac0-bf5a-ab2728245957 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:02.923252 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5abd4ed5-3eab-4ac0-bf5a-ab2728245957 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:02.925599 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5abd4ed5-3eab-4ac0-bf5a-ab2728245957 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:02.927276 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.objects.instance [None req-5abd4ed5-3eab-4ac0-bf5a-ab2728245957 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lazy-loading 'fault' on Instance uuid 3ceabacb-cbf6-409a-8c82-55e9901bd8d7 {{(pid=128758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:18:02.928851 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f3a360ac-4c58-4e55-b59b-770fff136724 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:02.929364 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f3a360ac-4c58-4e55-b59b-770fff136724 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:02.929810 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f3a360ac-4c58-4e55-b59b-770fff136724 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:02.937488 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f3a360ac-4c58-4e55-b59b-770fff136724 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:02.942140 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f3a360ac-4c58-4e55-b59b-770fff136724 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:02.943253 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f3a360ac-4c58-4e55-b59b-770fff136724 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:02.970840 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-f3a360ac-4c58-4e55-b59b-770fff136724 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] HTTP exception thrown: Instance 50157c1b-c748-4d1f-928e-207482b37ec6 could not be found. Sep 14 09:18:02.977393 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f3a360ac-4c58-4e55-b59b-770fff136724 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Request method failure captured: Sep 14 09:18:02.977393 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6 HTTP/1.1 Sep 14 09:18:02.977393 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:18:02.977393 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:18:02.977393 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:18:02.977393 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:18:02.977393 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:18:02.977393 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:18:02.977393 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:18:02.977393 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:18:02.977393 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZoiSZxqfCErkF28duCwoLyyA4BG19wUNeFXOWecMNNAmQ9wif7QtxjzWvetj4gEDO8xf7CL7dW1ytU3meYaX-_dv0e24VHnEQ0Ft5dtNXSDMao67NjyX9jDMbRsLsyQjAEEs08qr3suFBU2oznwRQHl5Fh4kiecRaFcfIdWFOEZaLM Sep 14 09:18:02.977393 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:18:02.977393 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:18:02.977393 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:18:02.977393 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:18:02.977393 n-d-836830-18 devstack@n-api.service[128759]: X-Openstack-Nova-Api-Version: 2.20 Sep 14 09:18:02.977393 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:18:02.977393 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:18:02.977393 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 9c0762ad3f774829b58669b312dd13f7 Sep 14 09:18:02.977393 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-760665547 Sep 14 09:18:02.977393 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:18:02.977393 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:18:02.977393 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/9c0762ad3f774829b58669b312dd13f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_9c0762ad3f774829b58669b312dd13f7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9c0762ad3f774829b58669b312dd13f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9c0762ad3f774829b58669b312dd13f7"}]}] Sep 14 09:18:02.977393 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-AttachVolumeShelveTestJSON-760665547 Sep 14 09:18:02.977393 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 9c0762ad3f774829b58669b312dd13f7 Sep 14 09:18:02.977393 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-760665547 Sep 14 09:18:02.977393 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-AttachVolumeShelveTestJSON-760665547-project Sep 14 09:18:02.977393 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:18:02.977393 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:18:02.977393 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 78051740ae354035b119d5d8ebe226f1 Sep 14 09:18:02.977393 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-AttachVolumeShelveTestJSON-760665547-project Sep 14 09:18:02.977393 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:18:02.977393 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance 50157c1b-c748-4d1f-928e-207482b37ec6 could not be found. Sep 14 09:18:02.977393 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '50157c1b-c748-4d1f-928e-207482b37ec6'} Sep 14 09:18:02.977393 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:18:02.977393 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:18:02.977393 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:18:02.977393 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:18:02.977393 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:18:02.977393 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:18:02.977393 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:18:02.977393 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:18:02.977393 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:18:02.977393 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:18:02.977393 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50157c1b-c748-4d1f-928e-207482b37ec6 could not be found. Sep 14 09:18:02.977393 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:18:02.977393 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:18:02.977393 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:18:02.977393 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:18:02.977393 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:18:02.977393 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:18:02.977393 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:18:02.977393 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:18:02.977393 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:18:02.977393 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:18:02.977393 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:18:02.977393 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:18:02.977393 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:18:02.977393 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:18:02.977393 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:18:02.977393 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:18:02.977393 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50157c1b-c748-4d1f-928e-207482b37ec6 could not be found. Sep 14 09:18:02.977393 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:18:02.977393 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:18:02.986418 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:18:02.986418 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:18:02.986418 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:18:02.986418 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:18:02.986418 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:18:02.986418 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:18:02.986418 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50157c1b-c748-4d1f-928e-207482b37ec6 could not be found. Sep 14 09:18:02.986418 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:18:02.986418 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f3a360ac-4c58-4e55-b59b-770fff136724 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Returning 404 to user: Instance 50157c1b-c748-4d1f-928e-207482b37ec6 could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:18:02.986418 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f3a360ac-4c58-4e55-b59b-770fff136724 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6" status: 404 len: 111 microversion: 2.20 time: 0.080455 Sep 14 09:18:02.990396 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2770/5562] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:18:02 2022] GET /compute/v2.1/servers/50157c1b-c748-4d1f-928e-207482b37ec6 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 14 09:18:03.306400 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-5abd4ed5-3eab-4ac0-bf5a-ab2728245957 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daab4f69af5452c8641006d9f09edce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9672a6c416ee44289eaa4d7c664d307e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:03.326630 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-5abd4ed5-3eab-4ac0-bf5a-ab2728245957 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "GET /compute/v2.1/servers/3ceabacb-cbf6-409a-8c82-55e9901bd8d7" status: 200 len: 1331 microversion: 2.1 time: 0.551202 Sep 14 09:18:03.330544 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2793/5563] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:18:02 2022] GET /compute/v2.1/servers/3ceabacb-cbf6-409a-8c82-55e9901bd8d7 => generated 1331 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:18:03.929026 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-fd645c1a-d21b-4df5-8c00-ab72bee18471 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:03.929922 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-fd645c1a-d21b-4df5-8c00-ab72bee18471 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 3c2f5d0d-16a5-4f33-8f02-a84296eb09ef] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:03.970451 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fd645c1a-d21b-4df5-8c00-ab72bee18471 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:03.971263 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fd645c1a-d21b-4df5-8c00-ab72bee18471 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:03.973193 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fd645c1a-d21b-4df5-8c00-ab72bee18471 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:03.986843 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fd645c1a-d21b-4df5-8c00-ab72bee18471 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:03.987989 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fd645c1a-d21b-4df5-8c00-ab72bee18471 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:03.988464 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fd645c1a-d21b-4df5-8c00-ab72bee18471 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:04.355048 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ed088ab6-3bc9-4a1b-b1b9-e9cf89c681fb tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:04.355677 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-ed088ab6-3bc9-4a1b-b1b9-e9cf89c681fb tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [instance: 3ceabacb-cbf6-409a-8c82-55e9901bd8d7] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:04.404513 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ed088ab6-3bc9-4a1b-b1b9-e9cf89c681fb tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:04.405042 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ed088ab6-3bc9-4a1b-b1b9-e9cf89c681fb tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:04.405748 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ed088ab6-3bc9-4a1b-b1b9-e9cf89c681fb tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:04.412135 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ed088ab6-3bc9-4a1b-b1b9-e9cf89c681fb tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:04.413091 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ed088ab6-3bc9-4a1b-b1b9-e9cf89c681fb tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:04.414439 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ed088ab6-3bc9-4a1b-b1b9-e9cf89c681fb tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:04.520851 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-ed088ab6-3bc9-4a1b-b1b9-e9cf89c681fb tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] HTTP exception thrown: Instance 3ceabacb-cbf6-409a-8c82-55e9901bd8d7 could not be found. Sep 14 09:18:04.522466 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ed088ab6-3bc9-4a1b-b1b9-e9cf89c681fb tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Request method failure captured: Sep 14 09:18:04.522466 n-d-836830-18 devstack@n-api.service[128758]: request: GET /compute/v2.1/servers/3ceabacb-cbf6-409a-8c82-55e9901bd8d7 HTTP/1.1 Sep 14 09:18:04.522466 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 09:18:04.522466 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 09:18:04.522466 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 09:18:04.522466 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 09:18:04.522466 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 09:18:04.522466 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 09:18:04.522466 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 09:18:04.522466 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 09:18:04.522466 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZplAooet3f0j7YfTn10UjWWncQT1X8Zx5oRj6ix43s3Uyu8Vx6JxK5zNIVmYD3adrXMKIf-yKfD6YAxNfiXzTvsjQqMQGw8jI4-W3D7BlestqvRpahzOMSDEzmtF5nK9S-Py3GvFBoobDIQWLv-aBhO1lijqGds4gt8aJhEwjvOnnU Sep 14 09:18:04.522466 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 09:18:04.522466 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 09:18:04.522466 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 09:18:04.522466 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 09:18:04.522466 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 09:18:04.522466 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 09:18:04.522466 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 9672a6c416ee44289eaa4d7c664d307e Sep 14 09:18:04.522466 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-AttachVolumeNegativeTest-1303332785 Sep 14 09:18:04.522466 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 09:18:04.522466 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 09:18:04.522466 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/9672a6c416ee44289eaa4d7c664d307e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_9672a6c416ee44289eaa4d7c664d307e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9672a6c416ee44289eaa4d7c664d307e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9672a6c416ee44289eaa4d7c664d307e"}]}] Sep 14 09:18:04.522466 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-AttachVolumeNegativeTest-1303332785 Sep 14 09:18:04.522466 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 9672a6c416ee44289eaa4d7c664d307e Sep 14 09:18:04.522466 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1303332785 Sep 14 09:18:04.522466 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-AttachVolumeNegativeTest-1303332785-project Sep 14 09:18:04.522466 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 09:18:04.522466 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 09:18:04.522466 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 7daab4f69af5452c8641006d9f09edce Sep 14 09:18:04.522466 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-AttachVolumeNegativeTest-1303332785-project Sep 14 09:18:04.522466 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 09:18:04.522466 n-d-836830-18 devstack@n-api.service[128758]: exception: Instance 3ceabacb-cbf6-409a-8c82-55e9901bd8d7 could not be found. Sep 14 09:18:04.522466 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': '3ceabacb-cbf6-409a-8c82-55e9901bd8d7'} Sep 14 09:18:04.522466 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:18:04.522466 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:18:04.522466 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:18:04.522466 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:18:04.522466 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:18:04.522466 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:18:04.522466 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:18:04.522466 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:18:04.522466 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:18:04.522466 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:18:04.522466 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ceabacb-cbf6-409a-8c82-55e9901bd8d7 could not be found. Sep 14 09:18:04.522466 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:18:04.522466 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:18:04.522466 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:18:04.522466 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:18:04.522466 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:18:04.522466 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:18:04.522466 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:18:04.522466 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:18:04.522466 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:18:04.522466 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:18:04.522466 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:18:04.522466 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:18:04.522466 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:18:04.522466 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:18:04.522466 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:18:04.522466 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:18:04.522466 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ceabacb-cbf6-409a-8c82-55e9901bd8d7 could not be found. Sep 14 09:18:04.522466 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:18:04.522466 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:18:04.522466 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:18:04.528230 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:18:04.528230 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:18:04.528230 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:18:04.528230 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:18:04.528230 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:18:04.528230 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ceabacb-cbf6-409a-8c82-55e9901bd8d7 could not be found. Sep 14 09:18:04.528230 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:18:04.528230 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ed088ab6-3bc9-4a1b-b1b9-e9cf89c681fb tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Returning 404 to user: Instance 3ceabacb-cbf6-409a-8c82-55e9901bd8d7 could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:18:04.528926 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-ed088ab6-3bc9-4a1b-b1b9-e9cf89c681fb tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "GET /compute/v2.1/servers/3ceabacb-cbf6-409a-8c82-55e9901bd8d7" status: 404 len: 111 microversion: 2.1 time: 0.177852 Sep 14 09:18:04.532444 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2794/5564] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:18:04 2022] GET /compute/v2.1/servers/3ceabacb-cbf6-409a-8c82-55e9901bd8d7 => generated 111 bytes in 183 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:18:04.538196 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-778a7eda-5677-4a8f-b23b-433253b95920 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Calling method '.version_select at 0x7f7d3f329550>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:04.578422 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-778a7eda-5677-4a8f-b23b-433253b95920 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-450861825" status: 202 len: 0 microversion: 2.1 time: 0.044503 Sep 14 09:18:04.579741 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2795/5565] 10.222.0.60 () {58 vars in 1218 bytes} [Wed Sep 14 09:18:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-450861825 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:18:04.648284 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-fd645c1a-d21b-4df5-8c00-ab72bee18471 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03dc827647f4483beb2e1b7888be608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229e11b3c1fe48b088d0f3c4bb7e2cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:04.665307 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-fd645c1a-d21b-4df5-8c00-ab72bee18471 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "GET /compute/v2.1/servers/3c2f5d0d-16a5-4f33-8f02-a84296eb09ef" status: 200 len: 1522 microversion: 2.1 time: 0.743161 Sep 14 09:18:04.670104 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2771/5566] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:18:03 2022] GET /compute/v2.1/servers/3c2f5d0d-16a5-4f33-8f02-a84296eb09ef => generated 1522 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:18:05.691247 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b3b3e829-9a52-42d0-a655-907dc81d5448 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:05.691946 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-b3b3e829-9a52-42d0-a655-907dc81d5448 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 3c2f5d0d-16a5-4f33-8f02-a84296eb09ef] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:05.705364 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b3b3e829-9a52-42d0-a655-907dc81d5448 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:05.712231 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b3b3e829-9a52-42d0-a655-907dc81d5448 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:05.712823 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b3b3e829-9a52-42d0-a655-907dc81d5448 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:05.714200 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b3b3e829-9a52-42d0-a655-907dc81d5448 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:05.714903 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b3b3e829-9a52-42d0-a655-907dc81d5448 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:05.715650 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b3b3e829-9a52-42d0-a655-907dc81d5448 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:06.810082 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-b3b3e829-9a52-42d0-a655-907dc81d5448 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03dc827647f4483beb2e1b7888be608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229e11b3c1fe48b088d0f3c4bb7e2cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:06.830532 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-b3b3e829-9a52-42d0-a655-907dc81d5448 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "GET /compute/v2.1/servers/3c2f5d0d-16a5-4f33-8f02-a84296eb09ef" status: 200 len: 1522 microversion: 2.1 time: 1.142814 Sep 14 09:18:06.833374 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2796/5567] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:18:05 2022] GET /compute/v2.1/servers/3c2f5d0d-16a5-4f33-8f02-a84296eb09ef => generated 1522 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:18:07.854182 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-151e46fb-d80a-42d0-b561-1d8d3586061f tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:07.854849 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-151e46fb-d80a-42d0-b561-1d8d3586061f tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 3c2f5d0d-16a5-4f33-8f02-a84296eb09ef] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:07.869133 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-151e46fb-d80a-42d0-b561-1d8d3586061f tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:07.869644 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-151e46fb-d80a-42d0-b561-1d8d3586061f tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:07.870085 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-151e46fb-d80a-42d0-b561-1d8d3586061f tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:07.870818 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-151e46fb-d80a-42d0-b561-1d8d3586061f tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:07.883602 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-151e46fb-d80a-42d0-b561-1d8d3586061f tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:07.884234 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-151e46fb-d80a-42d0-b561-1d8d3586061f tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:09.084340 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-151e46fb-d80a-42d0-b561-1d8d3586061f tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03dc827647f4483beb2e1b7888be608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229e11b3c1fe48b088d0f3c4bb7e2cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:09.096179 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-151e46fb-d80a-42d0-b561-1d8d3586061f tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "GET /compute/v2.1/servers/3c2f5d0d-16a5-4f33-8f02-a84296eb09ef" status: 200 len: 1522 microversion: 2.1 time: 1.246288 Sep 14 09:18:09.100302 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2772/5568] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:18:07 2022] GET /compute/v2.1/servers/3c2f5d0d-16a5-4f33-8f02-a84296eb09ef => generated 1522 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:18:09.880842 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-bb45bb5d-24a9-46ab-a7b0-98d675019084 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:09.881382 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-bb45bb5d-24a9-46ab-a7b0-98d675019084 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:09.890196 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:18:09.899224 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bb45bb5d-24a9-46ab-a7b0-98d675019084 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:09.899727 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bb45bb5d-24a9-46ab-a7b0-98d675019084 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:09.900180 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bb45bb5d-24a9-46ab-a7b0-98d675019084 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:09.909497 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bb45bb5d-24a9-46ab-a7b0-98d675019084 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:09.909764 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bb45bb5d-24a9-46ab-a7b0-98d675019084 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:09.910227 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bb45bb5d-24a9-46ab-a7b0-98d675019084 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:09.957426 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-bb45bb5d-24a9-46ab-a7b0-98d675019084 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] HTTP exception thrown: Instance 4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5 could not be found. Sep 14 09:18:09.964918 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-bb45bb5d-24a9-46ab-a7b0-98d675019084 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Request method failure captured: Sep 14 09:18:09.964918 n-d-836830-18 devstack@n-api.service[128758]: request: DELETE /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5 HTTP/1.1 Sep 14 09:18:09.964918 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 09:18:09.964918 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 09:18:09.964918 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 09:18:09.964918 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 09:18:09.964918 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 09:18:09.964918 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 09:18:09.964918 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 09:18:09.964918 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 09:18:09.964918 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZoiSZxqfCErkF28duCwoLyyA4BG19wUNeFXOWecMNNAmQ9wif7QtxjzWvetj4gEDO8xf7CL7dW1ytU3meYaX-_dv0e24VHnEQ0Ft5dtNXSDMao67NjyX9jDMbRsLsyQjAEEs08qr3suFBU2oznwRQHl5Fh4kiecRaFcfIdWFOEZaLM Sep 14 09:18:09.964918 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 09:18:09.964918 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 09:18:09.964918 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 09:18:09.964918 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 09:18:09.964918 n-d-836830-18 devstack@n-api.service[128758]: X-Openstack-Nova-Api-Version: 2.20 Sep 14 09:18:09.964918 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 09:18:09.964918 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 09:18:09.964918 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 9c0762ad3f774829b58669b312dd13f7 Sep 14 09:18:09.964918 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-760665547 Sep 14 09:18:09.964918 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 09:18:09.964918 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 09:18:09.964918 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/9c0762ad3f774829b58669b312dd13f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_9c0762ad3f774829b58669b312dd13f7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9c0762ad3f774829b58669b312dd13f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9c0762ad3f774829b58669b312dd13f7"}]}] Sep 14 09:18:09.964918 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-AttachVolumeShelveTestJSON-760665547 Sep 14 09:18:09.964918 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 9c0762ad3f774829b58669b312dd13f7 Sep 14 09:18:09.964918 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-760665547 Sep 14 09:18:09.964918 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-AttachVolumeShelveTestJSON-760665547-project Sep 14 09:18:09.964918 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 09:18:09.964918 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 09:18:09.964918 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 78051740ae354035b119d5d8ebe226f1 Sep 14 09:18:09.964918 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-AttachVolumeShelveTestJSON-760665547-project Sep 14 09:18:09.964918 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 09:18:09.964918 n-d-836830-18 devstack@n-api.service[128758]: exception: Instance 4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5 could not be found. Sep 14 09:18:09.964918 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': '4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5'} Sep 14 09:18:09.964918 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:18:09.964918 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:18:09.964918 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:18:09.964918 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:18:09.964918 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:18:09.964918 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:18:09.964918 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:18:09.964918 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:18:09.964918 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:18:09.964918 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:18:09.964918 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5 could not be found. Sep 14 09:18:09.964918 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:18:09.964918 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:18:09.964918 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:18:09.964918 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:18:09.964918 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:18:09.964918 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:18:09.964918 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:18:09.964918 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:18:09.964918 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:18:09.964918 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:18:09.964918 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 09:18:09.964918 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 09:18:09.964918 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 09:18:09.964918 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 09:18:09.964918 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:18:09.964918 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:18:09.964918 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:18:09.964918 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:18:09.969719 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5 could not be found. Sep 14 09:18:09.969719 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:18:09.969719 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:18:09.969719 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:18:09.969719 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:18:09.969719 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:18:09.969719 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:18:09.969719 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:18:09.969719 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:18:09.969719 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5 could not be found. Sep 14 09:18:09.969719 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:18:09.971452 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-bb45bb5d-24a9-46ab-a7b0-98d675019084 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Returning 404 to user: Instance 4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5 could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:18:09.972691 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-bb45bb5d-24a9-46ab-a7b0-98d675019084 tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "DELETE /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5" status: 404 len: 111 microversion: 2.20 time: 0.100938 Sep 14 09:18:09.979438 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2797/5569] 10.222.0.60 () {60 vars in 1280 bytes} [Wed Sep 14 09:18:09 2022] DELETE /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 14 09:18:09.987850 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-0b17fc43-2019-4a8c-a59e-e738639f055b tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:09.988700 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-0b17fc43-2019-4a8c-a59e-e738639f055b tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] [instance: 4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:10.000704 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=61,nova_api:DELETE=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:18:10.011691 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0b17fc43-2019-4a8c-a59e-e738639f055b tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:10.014650 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0b17fc43-2019-4a8c-a59e-e738639f055b tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:10.015231 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0b17fc43-2019-4a8c-a59e-e738639f055b tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:10.017530 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0b17fc43-2019-4a8c-a59e-e738639f055b tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:10.021992 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0b17fc43-2019-4a8c-a59e-e738639f055b tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:10.022570 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0b17fc43-2019-4a8c-a59e-e738639f055b tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:10.055367 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-0b17fc43-2019-4a8c-a59e-e738639f055b tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] HTTP exception thrown: Instance 4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5 could not be found. Sep 14 09:18:10.059650 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-0b17fc43-2019-4a8c-a59e-e738639f055b tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Request method failure captured: Sep 14 09:18:10.059650 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5 HTTP/1.1 Sep 14 09:18:10.059650 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:18:10.059650 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:18:10.059650 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:18:10.059650 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:18:10.059650 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:18:10.059650 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:18:10.059650 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:18:10.059650 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:18:10.059650 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZoiSZxqfCErkF28duCwoLyyA4BG19wUNeFXOWecMNNAmQ9wif7QtxjzWvetj4gEDO8xf7CL7dW1ytU3meYaX-_dv0e24VHnEQ0Ft5dtNXSDMao67NjyX9jDMbRsLsyQjAEEs08qr3suFBU2oznwRQHl5Fh4kiecRaFcfIdWFOEZaLM Sep 14 09:18:10.059650 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:18:10.059650 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:18:10.059650 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:18:10.059650 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:18:10.059650 n-d-836830-18 devstack@n-api.service[128759]: X-Openstack-Nova-Api-Version: 2.20 Sep 14 09:18:10.059650 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:18:10.059650 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:18:10.059650 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 9c0762ad3f774829b58669b312dd13f7 Sep 14 09:18:10.059650 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-760665547 Sep 14 09:18:10.059650 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:18:10.059650 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:18:10.059650 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/9c0762ad3f774829b58669b312dd13f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_9c0762ad3f774829b58669b312dd13f7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9c0762ad3f774829b58669b312dd13f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9c0762ad3f774829b58669b312dd13f7"}]}] Sep 14 09:18:10.059650 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-AttachVolumeShelveTestJSON-760665547 Sep 14 09:18:10.059650 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 9c0762ad3f774829b58669b312dd13f7 Sep 14 09:18:10.059650 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-760665547 Sep 14 09:18:10.059650 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-AttachVolumeShelveTestJSON-760665547-project Sep 14 09:18:10.059650 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:18:10.059650 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:18:10.059650 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 78051740ae354035b119d5d8ebe226f1 Sep 14 09:18:10.059650 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-AttachVolumeShelveTestJSON-760665547-project Sep 14 09:18:10.059650 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:18:10.059650 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance 4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5 could not be found. Sep 14 09:18:10.059650 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5'} Sep 14 09:18:10.059650 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:18:10.059650 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:18:10.059650 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:18:10.059650 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:18:10.059650 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:18:10.059650 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:18:10.059650 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:18:10.059650 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:18:10.059650 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:18:10.059650 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:18:10.059650 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5 could not be found. Sep 14 09:18:10.059650 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:18:10.059650 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:18:10.059650 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:18:10.059650 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:18:10.059650 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:18:10.059650 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:18:10.059650 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:18:10.059650 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:18:10.059650 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:18:10.059650 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:18:10.059650 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:18:10.059650 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:18:10.059650 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:18:10.059650 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:18:10.059650 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:18:10.059650 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:18:10.059650 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5 could not be found. Sep 14 09:18:10.059650 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:18:10.059650 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:18:10.064874 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:18:10.064874 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:18:10.064874 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:18:10.064874 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:18:10.064874 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:18:10.064874 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:18:10.064874 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5 could not be found. Sep 14 09:18:10.064874 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:18:10.064874 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-0b17fc43-2019-4a8c-a59e-e738639f055b tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] Returning 404 to user: Instance 4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5 could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:18:10.067670 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-0b17fc43-2019-4a8c-a59e-e738639f055b tempest-AttachVolumeShelveTestJSON-760665547 tempest-AttachVolumeShelveTestJSON-760665547-project] 10.222.0.60 "GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5" status: 404 len: 111 microversion: 2.20 time: 0.082734 Sep 14 09:18:10.070522 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2773/5570] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:18:09 2022] GET /compute/v2.1/servers/4ebab6c2-ff5c-4da2-b1c1-13dbe6412ab5 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 14 09:18:10.131642 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-710a51a2-8a7a-4286-8f8b-a9850cb283ec tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:10.132264 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-710a51a2-8a7a-4286-8f8b-a9850cb283ec tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 3c2f5d0d-16a5-4f33-8f02-a84296eb09ef] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:10.140911 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-710a51a2-8a7a-4286-8f8b-a9850cb283ec tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:10.141691 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-710a51a2-8a7a-4286-8f8b-a9850cb283ec tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:10.142299 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-710a51a2-8a7a-4286-8f8b-a9850cb283ec tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:10.143717 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-710a51a2-8a7a-4286-8f8b-a9850cb283ec tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:10.144340 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-710a51a2-8a7a-4286-8f8b-a9850cb283ec tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:10.144935 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-710a51a2-8a7a-4286-8f8b-a9850cb283ec tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:10.301212 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8c93cc70-fdbf-4bf4-9e87-5d63430219cc tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:10.302547 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-8c93cc70-fdbf-4bf4-9e87-5d63430219cc tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] [instance: 12910e13-030f-4238-94b4-0d5c50c1e9e2] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:10.314690 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8c93cc70-fdbf-4bf4-9e87-5d63430219cc tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:10.315399 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8c93cc70-fdbf-4bf4-9e87-5d63430219cc tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:10.316732 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8c93cc70-fdbf-4bf4-9e87-5d63430219cc tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:10.318388 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8c93cc70-fdbf-4bf4-9e87-5d63430219cc tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:10.322796 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8c93cc70-fdbf-4bf4-9e87-5d63430219cc tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:10.323435 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8c93cc70-fdbf-4bf4-9e87-5d63430219cc tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:10.515499 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=100 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:18:10.521317 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.objects.instance [None req-8c93cc70-fdbf-4bf4-9e87-5d63430219cc tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Lazy-loading 'services' on Instance uuid 12910e13-030f-4238-94b4-0d5c50c1e9e2 {{(pid=128759) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:18:10.647851 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-710a51a2-8a7a-4286-8f8b-a9850cb283ec tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03dc827647f4483beb2e1b7888be608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229e11b3c1fe48b088d0f3c4bb7e2cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:10.685584 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-710a51a2-8a7a-4286-8f8b-a9850cb283ec tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "GET /compute/v2.1/servers/3c2f5d0d-16a5-4f33-8f02-a84296eb09ef" status: 200 len: 1522 microversion: 2.1 time: 0.545106 Sep 14 09:18:10.718964 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2798/5571] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:18:10 2022] GET /compute/v2.1/servers/3c2f5d0d-16a5-4f33-8f02-a84296eb09ef => generated 1522 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:18:10.764800 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-8c93cc70-fdbf-4bf4-9e87-5d63430219cc tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] 10.222.0.60 "DELETE /compute/v2.1/servers/12910e13-030f-4238-94b4-0d5c50c1e9e2/os-volume_attachments/2ade0265-d09a-4dd7-bf7f-c2c1435ebd93" status: 202 len: 0 microversion: 2.1 time: 0.467442 Sep 14 09:18:10.771641 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2774/5572] 10.222.0.60 () {58 vars in 1416 bytes} [Wed Sep 14 09:18:10 2022] DELETE /compute/v2.1/servers/12910e13-030f-4238-94b4-0d5c50c1e9e2/os-volume_attachments/2ade0265-d09a-4dd7-bf7f-c2c1435ebd93 => generated 0 bytes in 475 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:18:11.232317 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-e00091fe-de3e-4df4-aabd-b7629ba66ae6 tempest-TestAggregatesBasicOps-400199684 tempest-TestAggregatesBasicOps-400199684-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-1977339072", "availability_zone": "foo_zone"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:18:11.238178 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.objects.aggregate [None req-e00091fe-de3e-4df4-aabd-b7629ba66ae6 tempest-TestAggregatesBasicOps-400199684 tempest-TestAggregatesBasicOps-400199684-project-admin] Generated uuid 1587a1aa-9c61-4ffd-a416-f646bdbf4f7b for aggregate {{(pid=128758) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 14 09:18:11.276916 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-e00091fe-de3e-4df4-aabd-b7629ba66ae6 tempest-TestAggregatesBasicOps-400199684 tempest-TestAggregatesBasicOps-400199684-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates" status: 200 len: 209 microversion: 2.1 time: 0.283321 Sep 14 09:18:11.288902 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2799/5573] 10.222.0.60 () {60 vars in 1164 bytes} [Wed Sep 14 09:18:10 2022] POST /compute/v2.1/os-aggregates => generated 209 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:18:11.298719 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-f0f4b7fb-35cd-4bb0-8824-37b24545964a tempest-TestAggregatesBasicOps-400199684 tempest-TestAggregatesBasicOps-400199684-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:18:11.357683 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-bb454daa-6e94-449b-804d-696e4f44d568 tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-548674465", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "networks": [{"uuid": "a888954e-9db3-49e4-9ac9-7255eaffa019"}]}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:18:11.359581 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-f0f4b7fb-35cd-4bb0-8824-37b24545964a tempest-TestAggregatesBasicOps-400199684 tempest-TestAggregatesBasicOps-400199684-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 319 microversion: 2.1 time: 0.066905 Sep 14 09:18:11.360306 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2800/5574] 10.222.0.60 () {60 vars in 1194 bytes} [Wed Sep 14 09:18:11 2022] POST /compute/v2.1/os-aggregates/19/action => generated 319 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:18:11.376697 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-7fb57368-b959-4764-87e6-12699ed30490 tempest-TestAggregatesBasicOps-400199684 tempest-TestAggregatesBasicOps-400199684-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:11.388594 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7fb57368-b959-4764-87e6-12699ed30490 tempest-TestAggregatesBasicOps-400199684 tempest-TestAggregatesBasicOps-400199684-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:11.399287 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7fb57368-b959-4764-87e6-12699ed30490 tempest-TestAggregatesBasicOps-400199684 tempest-TestAggregatesBasicOps-400199684-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:11.399761 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7fb57368-b959-4764-87e6-12699ed30490 tempest-TestAggregatesBasicOps-400199684 tempest-TestAggregatesBasicOps-400199684-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:11.400601 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7fb57368-b959-4764-87e6-12699ed30490 tempest-TestAggregatesBasicOps-400199684 tempest-TestAggregatesBasicOps-400199684-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:11.401072 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7fb57368-b959-4764-87e6-12699ed30490 tempest-TestAggregatesBasicOps-400199684 tempest-TestAggregatesBasicOps-400199684-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:11.401779 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7fb57368-b959-4764-87e6-12699ed30490 tempest-TestAggregatesBasicOps-400199684 tempest-TestAggregatesBasicOps-400199684-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:11.451732 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-7fb57368-b959-4764-87e6-12699ed30490 tempest-TestAggregatesBasicOps-400199684 tempest-TestAggregatesBasicOps-400199684-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.082033 Sep 14 09:18:11.452569 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2801/5575] 10.222.0.60 () {58 vars in 1176 bytes} [Wed Sep 14 09:18:11 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:18:11.465540 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-8888a781-777d-4dc1-811d-bd735f052575 tempest-TestAggregatesBasicOps-400199684 tempest-TestAggregatesBasicOps-400199684-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:11.471811 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.network.neutron [None req-bb454daa-6e94-449b-804d-696e4f44d568 tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] validate_networks() for [('a888954e-9db3-49e4-9ac9-7255eaffa019', None, None, None, None, None)] {{(pid=128759) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:18:11.490574 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-8888a781-777d-4dc1-811d-bd735f052575 tempest-TestAggregatesBasicOps-400199684 tempest-TestAggregatesBasicOps-400199684-project-admin] 10.222.0.60 "GET /compute/v2.1/os-aggregates" status: 200 len: 298 microversion: 2.1 time: 0.026575 Sep 14 09:18:11.491819 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2802/5576] 10.222.0.60 () {58 vars in 1143 bytes} [Wed Sep 14 09:18:11 2022] GET /compute/v2.1/os-aggregates => generated 298 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:18:11.507620 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-3f33b703-c2af-4c22-bc68-5b823f59fc6a tempest-TestAggregatesBasicOps-400199684 tempest-TestAggregatesBasicOps-400199684-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-836830-18"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:18:11.539358 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3f33b703-c2af-4c22-bc68-5b823f59fc6a tempest-TestAggregatesBasicOps-400199684 tempest-TestAggregatesBasicOps-400199684-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:11.540657 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3f33b703-c2af-4c22-bc68-5b823f59fc6a tempest-TestAggregatesBasicOps-400199684 tempest-TestAggregatesBasicOps-400199684-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:11.545751 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3f33b703-c2af-4c22-bc68-5b823f59fc6a tempest-TestAggregatesBasicOps-400199684 tempest-TestAggregatesBasicOps-400199684-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:11.885793 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-3f33b703-c2af-4c22-bc68-5b823f59fc6a tempest-TestAggregatesBasicOps-400199684 tempest-TestAggregatesBasicOps-400199684-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 311 microversion: 2.1 time: 0.384828 Sep 14 09:18:11.889022 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2803/5577] 10.222.0.60 () {60 vars in 1194 bytes} [Wed Sep 14 09:18:11 2022] POST /compute/v2.1/os-aggregates/19/action => generated 311 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:18:11.913912 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-eb4fae76-ead2-47cd-b4c2-d748767726c5 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:11.915489 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-eb4fae76-ead2-47cd-b4c2-d748767726c5 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 3c2f5d0d-16a5-4f33-8f02-a84296eb09ef] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:11.927489 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-eb4fae76-ead2-47cd-b4c2-d748767726c5 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:11.930155 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-eb4fae76-ead2-47cd-b4c2-d748767726c5 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:11.930985 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-eb4fae76-ead2-47cd-b4c2-d748767726c5 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:11.934664 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-eb4fae76-ead2-47cd-b4c2-d748767726c5 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:11.939553 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-eb4fae76-ead2-47cd-b4c2-d748767726c5 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:11.942995 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-eb4fae76-ead2-47cd-b4c2-d748767726c5 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:12.313985 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-bb454daa-6e94-449b-804d-696e4f44d568 tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Flavor limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:18:12.314974 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-bb454daa-6e94-449b-804d-696e4f44d568 tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Image limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:18:12.315666 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-bb454daa-6e94-449b-804d-696e4f44d568 tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Flavor pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:18:12.316284 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-bb454daa-6e94-449b-804d-696e4f44d568 tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Image pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:18:12.316903 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-bb454daa-6e94-449b-804d-696e4f44d568 tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:18:12.337794 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bb454daa-6e94-449b-804d-696e4f44d568 tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:12.340388 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bb454daa-6e94-449b-804d-696e4f44d568 tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:12.345929 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bb454daa-6e94-449b-804d-696e4f44d568 tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:12.347095 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bb454daa-6e94-449b-804d-696e4f44d568 tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:12.347810 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bb454daa-6e94-449b-804d-696e4f44d568 tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:12.348502 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bb454daa-6e94-449b-804d-696e4f44d568 tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:12.404835 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-bb454daa-6e94-449b-804d-696e4f44d568 tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Getting quotas for project df68a404f623498b9e77b3914b52edb0. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:18:12.428061 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-bb454daa-6e94-449b-804d-696e4f44d568 tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Getting quotas for user 5c4f7a9bfa5d492084378a9e51f9f483 and project df68a404f623498b9e77b3914b52edb0. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:18:12.449117 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-eb4fae76-ead2-47cd-b4c2-d748767726c5 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03dc827647f4483beb2e1b7888be608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229e11b3c1fe48b088d0f3c4bb7e2cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:12.458339 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-eb4fae76-ead2-47cd-b4c2-d748767726c5 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "GET /compute/v2.1/servers/3c2f5d0d-16a5-4f33-8f02-a84296eb09ef" status: 200 len: 1522 microversion: 2.1 time: 0.567360 Sep 14 09:18:12.460541 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2804/5578] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:18:11 2022] GET /compute/v2.1/servers/3c2f5d0d-16a5-4f33-8f02-a84296eb09ef => generated 1522 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:18:12.464784 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-bb454daa-6e94-449b-804d-696e4f44d568 tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Going to run 1 instances... {{(pid=128759) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:18:12.465934 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-41d8d7f6-5be1-4ab6-8127-d2fb58a9085b tempest-TestAggregatesBasicOps-400199684 tempest-TestAggregatesBasicOps-400199684-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:12.467274 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-bb454daa-6e94-449b-804d-696e4f44d568 tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] [instance: c2a3c381-0ffb-48a1-88fd-6f3dabde0749] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128759) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:18:12.474845 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-41d8d7f6-5be1-4ab6-8127-d2fb58a9085b tempest-TestAggregatesBasicOps-400199684 tempest-TestAggregatesBasicOps-400199684-project-admin] 10.222.0.60 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 311 microversion: 2.1 time: 0.012708 Sep 14 09:18:12.475754 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2805/5579] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Sep 14 09:18:12 2022] GET /compute/v2.1/os-aggregates/19 => generated 311 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:18:12.489024 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-137ae1d3-33e1-49df-b952-0ec2654cc261 tempest-TestAggregatesBasicOps-400199684 tempest-TestAggregatesBasicOps-400199684-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-1064381643", "availability_zone": "foo_zone"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:18:12.576632 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-137ae1d3-33e1-49df-b952-0ec2654cc261 tempest-TestAggregatesBasicOps-400199684 tempest-TestAggregatesBasicOps-400199684-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 343 microversion: 2.1 time: 0.093076 Sep 14 09:18:12.579352 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2806/5580] 10.222.0.60 () {60 vars in 1173 bytes} [Wed Sep 14 09:18:12 2022] PUT /compute/v2.1/os-aggregates/19 => generated 343 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:18:12.608130 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-bb454daa-6e94-449b-804d-696e4f44d568 tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.391311 Sep 14 09:18:12.608800 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2775/5581] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 09:18:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1393 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 14 09:18:12.612100 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-4033a344-78ce-4226-b4f9-3f1a130c7caf tempest-TestAggregatesBasicOps-400199684 tempest-TestAggregatesBasicOps-400199684-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:18:12.628445 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e6bafdea-7849-4d16-9ae5-c0638f66036d tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:12.629081 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e6bafdea-7849-4d16-9ae5-c0638f66036d tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] [instance: c2a3c381-0ffb-48a1-88fd-6f3dabde0749] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:12.694526 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-4033a344-78ce-4226-b4f9-3f1a130c7caf tempest-TestAggregatesBasicOps-400199684 tempest-TestAggregatesBasicOps-400199684-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 357 microversion: 2.1 time: 0.105899 Sep 14 09:18:12.699638 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2807/5582] 10.222.0.60 () {60 vars in 1194 bytes} [Wed Sep 14 09:18:12 2022] POST /compute/v2.1/os-aggregates/19/action => generated 357 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:18:12.732922 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-39077488-fab0-48db-bd6b-46243c72021a tempest-TestAggregatesBasicOps-400199684 tempest-TestAggregatesBasicOps-400199684-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:12.766922 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-39077488-fab0-48db-bd6b-46243c72021a tempest-TestAggregatesBasicOps-400199684 tempest-TestAggregatesBasicOps-400199684-project-admin] 10.222.0.60 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 357 microversion: 2.1 time: 0.052442 Sep 14 09:18:12.793354 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2808/5583] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Sep 14 09:18:12 2022] GET /compute/v2.1/os-aggregates/19 => generated 357 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:18:12.803536 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-e6bafdea-7849-4d16-9ae5-c0638f66036d tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4f7a9bfa5d492084378a9e51f9f483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68a404f623498b9e77b3914b52edb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:12.816553 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-7c816b37-9505-4818-a851-d88565f8091f tempest-TestAggregatesBasicOps-400199684 tempest-TestAggregatesBasicOps-400199684-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-836830-18"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:18:12.819432 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e6bafdea-7849-4d16-9ae5-c0638f66036d tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] 10.222.0.60 "GET /compute/v2.1/servers/c2a3c381-0ffb-48a1-88fd-6f3dabde0749" status: 200 len: 1224 microversion: 2.1 time: 0.198830 Sep 14 09:18:12.820896 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2776/5584] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:18:12 2022] GET /compute/v2.1/servers/c2a3c381-0ffb-48a1-88fd-6f3dabde0749 => generated 1224 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:18:12.844920 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7c816b37-9505-4818-a851-d88565f8091f tempest-TestAggregatesBasicOps-400199684 tempest-TestAggregatesBasicOps-400199684-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:12.845856 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7c816b37-9505-4818-a851-d88565f8091f tempest-TestAggregatesBasicOps-400199684 tempest-TestAggregatesBasicOps-400199684-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:12.846664 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7c816b37-9505-4818-a851-d88565f8091f tempest-TestAggregatesBasicOps-400199684 tempest-TestAggregatesBasicOps-400199684-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:13.140843 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-7c816b37-9505-4818-a851-d88565f8091f tempest-TestAggregatesBasicOps-400199684 tempest-TestAggregatesBasicOps-400199684-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 341 microversion: 2.1 time: 0.345515 Sep 14 09:18:13.144003 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2809/5585] 10.222.0.60 () {60 vars in 1194 bytes} [Wed Sep 14 09:18:12 2022] POST /compute/v2.1/os-aggregates/19/action => generated 341 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:18:13.155665 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-02a7f492-b81d-465d-baee-023acc9943f0 tempest-TestAggregatesBasicOps-400199684 tempest-TestAggregatesBasicOps-400199684-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:13.206981 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-02a7f492-b81d-465d-baee-023acc9943f0 tempest-TestAggregatesBasicOps-400199684 tempest-TestAggregatesBasicOps-400199684-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.055058 Sep 14 09:18:13.228691 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2777/5586] 10.222.0.60 () {58 vars in 1155 bytes} [Wed Sep 14 09:18:13 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 14 09:18:13.483163 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ec773bc4-4d1a-48b6-88aa-0659776ddc60 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:13.484610 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-ec773bc4-4d1a-48b6-88aa-0659776ddc60 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 3c2f5d0d-16a5-4f33-8f02-a84296eb09ef] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:13.508939 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ec773bc4-4d1a-48b6-88aa-0659776ddc60 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:13.509703 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ec773bc4-4d1a-48b6-88aa-0659776ddc60 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:13.510454 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ec773bc4-4d1a-48b6-88aa-0659776ddc60 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:13.512468 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ec773bc4-4d1a-48b6-88aa-0659776ddc60 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:13.514570 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ec773bc4-4d1a-48b6-88aa-0659776ddc60 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:13.515356 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ec773bc4-4d1a-48b6-88aa-0659776ddc60 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:13.847743 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-7599776d-89f2-483f-a262-a4bc846835c8 tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:13.849425 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-7599776d-89f2-483f-a262-a4bc846835c8 tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] [instance: c2a3c381-0ffb-48a1-88fd-6f3dabde0749] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:13.866884 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7599776d-89f2-483f-a262-a4bc846835c8 tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:13.873736 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7599776d-89f2-483f-a262-a4bc846835c8 tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:13.875624 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7599776d-89f2-483f-a262-a4bc846835c8 tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:13.880636 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7599776d-89f2-483f-a262-a4bc846835c8 tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:13.881342 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7599776d-89f2-483f-a262-a4bc846835c8 tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:13.884348 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7599776d-89f2-483f-a262-a4bc846835c8 tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:14.251208 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-7599776d-89f2-483f-a262-a4bc846835c8 tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4f7a9bfa5d492084378a9e51f9f483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68a404f623498b9e77b3914b52edb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:14.292339 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-7599776d-89f2-483f-a262-a4bc846835c8 tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] 10.222.0.60 "GET /compute/v2.1/servers/c2a3c381-0ffb-48a1-88fd-6f3dabde0749" status: 200 len: 1228 microversion: 2.1 time: 0.427615 Sep 14 09:18:14.298114 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2778/5587] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:18:13 2022] GET /compute/v2.1/servers/c2a3c381-0ffb-48a1-88fd-6f3dabde0749 => generated 1228 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:18:14.602771 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-ec773bc4-4d1a-48b6-88aa-0659776ddc60 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03dc827647f4483beb2e1b7888be608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229e11b3c1fe48b088d0f3c4bb7e2cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:14.627012 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-ec773bc4-4d1a-48b6-88aa-0659776ddc60 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "GET /compute/v2.1/servers/3c2f5d0d-16a5-4f33-8f02-a84296eb09ef" status: 200 len: 1502 microversion: 2.1 time: 1.147863 Sep 14 09:18:14.638971 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2810/5588] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:18:13 2022] GET /compute/v2.1/servers/3c2f5d0d-16a5-4f33-8f02-a84296eb09ef => generated 1502 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:18:14.650713 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-4ad23054-bdc0-4318-b17d-438d04303afc tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:14.651635 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-4ad23054-bdc0-4318-b17d-438d04303afc tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 80f0d7ed-260a-4c9d-a13b-be676b9edba0] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:14.667325 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8b071b50-dab6-4d8d-9689-a515df5c6d30 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:18:14.673888 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-8b071b50-dab6-4d8d-9689-a515df5c6d30 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] [instance: f31deffe-182e-46b5-9643-725b7d7b4561] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:14.675257 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4ad23054-bdc0-4318-b17d-438d04303afc tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:14.675989 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4ad23054-bdc0-4318-b17d-438d04303afc tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:14.677555 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4ad23054-bdc0-4318-b17d-438d04303afc tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:14.678613 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4ad23054-bdc0-4318-b17d-438d04303afc tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:14.681053 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4ad23054-bdc0-4318-b17d-438d04303afc tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:14.681676 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4ad23054-bdc0-4318-b17d-438d04303afc tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:14.710848 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8b071b50-dab6-4d8d-9689-a515df5c6d30 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:14.719899 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8b071b50-dab6-4d8d-9689-a515df5c6d30 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:14.721179 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8b071b50-dab6-4d8d-9689-a515df5c6d30 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:14.722133 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8b071b50-dab6-4d8d-9689-a515df5c6d30 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:14.722726 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8b071b50-dab6-4d8d-9689-a515df5c6d30 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:14.723847 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8b071b50-dab6-4d8d-9689-a515df5c6d30 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:14.807404 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-8b071b50-dab6-4d8d-9689-a515df5c6d30 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] 10.222.0.60 "POST /compute/v2.1/servers/f31deffe-182e-46b5-9643-725b7d7b4561/action" status: 200 len: 24545 microversion: 2.1 time: 0.482430 Sep 14 09:18:14.809774 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2779/5589] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:18:14 2022] POST /compute/v2.1/servers/f31deffe-182e-46b5-9643-725b7d7b4561/action => generated 24545 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 14 09:18:15.017488 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-4ad23054-bdc0-4318-b17d-438d04303afc tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03dc827647f4483beb2e1b7888be608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229e11b3c1fe48b088d0f3c4bb7e2cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:15.048739 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-4ad23054-bdc0-4318-b17d-438d04303afc tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "GET /compute/v2.1/servers/80f0d7ed-260a-4c9d-a13b-be676b9edba0" status: 200 len: 1514 microversion: 2.1 time: 0.402037 Sep 14 09:18:15.051376 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2811/5590] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:18:14 2022] GET /compute/v2.1/servers/80f0d7ed-260a-4c9d-a13b-be676b9edba0 => generated 1514 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:18:15.083356 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f53031eb-04de-4e83-b989-2a5bd70c8544 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:18:15.087103 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f53031eb-04de-4e83-b989-2a5bd70c8544 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: ba9206a1-30c4-4a72-ae6d-93d4acde00ac] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:15.112505 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-f53031eb-04de-4e83-b989-2a5bd70c8544 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] HTTP exception thrown: Instance ba9206a1-30c4-4a72-ae6d-93d4acde00ac could not be found. Sep 14 09:18:15.125574 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f53031eb-04de-4e83-b989-2a5bd70c8544 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Request method failure captured: Sep 14 09:18:15.125574 n-d-836830-18 devstack@n-api.service[128759]: request: POST /compute/v2.1/servers/ba9206a1-30c4-4a72-ae6d-93d4acde00ac/action HTTP/1.1 Sep 14 09:18:15.125574 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:18:15.125574 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:18:15.125574 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:18:15.125574 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 14 Sep 14 09:18:15.125574 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:18:15.125574 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:18:15.125574 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:18:15.125574 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:18:15.125574 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZwTx_6je2Mw19l1lk1T0KIWHROT3f4iq0u8_a7vTqyoq1BZh-ur0UF5KgJJeIlC54HlZaHspjBV72bT6ijQhdvPr0BCEmv-eUjjBTB_inJvaG7XMCMIoIIz39iqAFnj3jFdepR5dS7_uhYCyzmsUFKn1SkfeR8JmAZc_qs5ymrt_EA Sep 14 09:18:15.125574 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:18:15.125574 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:18:15.125574 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:18:15.125574 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:18:15.125574 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:18:15.125574 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:18:15.125574 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 229e11b3c1fe48b088d0f3c4bb7e2cb6 Sep 14 09:18:15.125574 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2043241234 Sep 14 09:18:15.125574 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:18:15.125574 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:18:15.125574 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/229e11b3c1fe48b088d0f3c4bb7e2cb6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_229e11b3c1fe48b088d0f3c4bb7e2cb6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/229e11b3c1fe48b088d0f3c4bb7e2cb6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/229e11b3c1fe48b088d0f3c4bb7e2cb6"}]}] Sep 14 09:18:15.125574 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2043241234 Sep 14 09:18:15.125574 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 229e11b3c1fe48b088d0f3c4bb7e2cb6 Sep 14 09:18:15.125574 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2043241234 Sep 14 09:18:15.125574 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ServerRescueNegativeTestJSON-2043241234-project Sep 14 09:18:15.125574 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:18:15.125574 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:18:15.125574 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: d03dc827647f4483beb2e1b7888be608 Sep 14 09:18:15.125574 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2043241234-project Sep 14 09:18:15.125574 n-d-836830-18 devstack@n-api.service[128759]: Sep 14 09:18:15.125574 n-d-836830-18 devstack@n-api.service[128759]: {"rescue": {}} Sep 14 09:18:15.125574 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:18:15.125574 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance ba9206a1-30c4-4a72-ae6d-93d4acde00ac could not be found. Sep 14 09:18:15.125574 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': 'ba9206a1-30c4-4a72-ae6d-93d4acde00ac', 'body': {'rescue': {}}} Sep 14 09:18:15.125574 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:18:15.125574 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:18:15.125574 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:18:15.125574 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:18:15.125574 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:18:15.125574 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:18:15.125574 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 14 09:18:15.125574 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 14 09:18:15.125574 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba9206a1-30c4-4a72-ae6d-93d4acde00ac could not be found. Sep 14 09:18:15.125574 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:18:15.125574 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:18:15.125574 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:18:15.125574 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:18:15.125574 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:18:15.125574 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:18:15.125574 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:18:15.125574 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:18:15.125574 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:18:15.125574 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:18:15.125574 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:18:15.125574 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:18:15.125574 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Sep 14 09:18:15.125574 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 14 09:18:15.125574 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:18:15.125574 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:18:15.125574 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba9206a1-30c4-4a72-ae6d-93d4acde00ac could not be found. Sep 14 09:18:15.125574 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:18:15.125574 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:18:15.125574 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:18:15.125574 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:18:15.135296 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:18:15.135296 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:18:15.135296 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:18:15.135296 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:18:15.135296 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba9206a1-30c4-4a72-ae6d-93d4acde00ac could not be found. Sep 14 09:18:15.135296 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:18:15.135296 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f53031eb-04de-4e83-b989-2a5bd70c8544 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Returning 404 to user: Instance ba9206a1-30c4-4a72-ae6d-93d4acde00ac could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:18:15.135296 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f53031eb-04de-4e83-b989-2a5bd70c8544 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "POST /compute/v2.1/servers/ba9206a1-30c4-4a72-ae6d-93d4acde00ac/action" status: 404 len: 111 microversion: 2.1 time: 0.049088 Sep 14 09:18:15.135296 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2780/5591] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:18:15 2022] POST /compute/v2.1/servers/ba9206a1-30c4-4a72-ae6d-93d4acde00ac/action => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:18:15.140840 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-23f42bb8-45c2-4763-a8aa-231b77ea5515 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:18:15.141566 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-23f42bb8-45c2-4763-a8aa-231b77ea5515 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 80f0d7ed-260a-4c9d-a13b-be676b9edba0] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:15.152445 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-23f42bb8-45c2-4763-a8aa-231b77ea5515 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:15.157051 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-23f42bb8-45c2-4763-a8aa-231b77ea5515 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:15.163846 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-23f42bb8-45c2-4763-a8aa-231b77ea5515 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:15.167256 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-23f42bb8-45c2-4763-a8aa-231b77ea5515 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:15.167918 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-23f42bb8-45c2-4763-a8aa-231b77ea5515 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:15.175589 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-23f42bb8-45c2-4763-a8aa-231b77ea5515 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:15.332123 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-eae70706-ac4e-4da4-a27d-730a80a61933 tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:15.334808 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-eae70706-ac4e-4da4-a27d-730a80a61933 tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] [instance: c2a3c381-0ffb-48a1-88fd-6f3dabde0749] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:15.348040 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-eae70706-ac4e-4da4-a27d-730a80a61933 tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:15.352084 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-eae70706-ac4e-4da4-a27d-730a80a61933 tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:15.352788 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-eae70706-ac4e-4da4-a27d-730a80a61933 tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:15.356204 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-eae70706-ac4e-4da4-a27d-730a80a61933 tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:15.359393 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-eae70706-ac4e-4da4-a27d-730a80a61933 tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:15.361363 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-eae70706-ac4e-4da4-a27d-730a80a61933 tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:15.399256 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-23f42bb8-45c2-4763-a8aa-231b77ea5515 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "POST /compute/v2.1/servers/80f0d7ed-260a-4c9d-a13b-be676b9edba0/action" status: 202 len: 0 microversion: 2.1 time: 0.262078 Sep 14 09:18:15.403106 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2812/5592] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:18:15 2022] POST /compute/v2.1/servers/80f0d7ed-260a-4c9d-a13b-be676b9edba0/action => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:18:15.417079 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-2c291747-7bdb-4834-9d92-52476c61971d tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:15.422165 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-2c291747-7bdb-4834-9d92-52476c61971d tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 80f0d7ed-260a-4c9d-a13b-be676b9edba0] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:15.462824 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2c291747-7bdb-4834-9d92-52476c61971d tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:15.476579 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2c291747-7bdb-4834-9d92-52476c61971d tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:15.477920 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2c291747-7bdb-4834-9d92-52476c61971d tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:15.481070 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2c291747-7bdb-4834-9d92-52476c61971d tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:15.488663 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2c291747-7bdb-4834-9d92-52476c61971d tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:15.488663 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2c291747-7bdb-4834-9d92-52476c61971d tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:15.783705 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-eae70706-ac4e-4da4-a27d-730a80a61933 tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4f7a9bfa5d492084378a9e51f9f483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68a404f623498b9e77b3914b52edb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:15.800343 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-eae70706-ac4e-4da4-a27d-730a80a61933 tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] 10.222.0.60 "GET /compute/v2.1/servers/c2a3c381-0ffb-48a1-88fd-6f3dabde0749" status: 200 len: 1282 microversion: 2.1 time: 0.474450 Sep 14 09:18:15.816127 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2781/5593] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:18:15 2022] GET /compute/v2.1/servers/c2a3c381-0ffb-48a1-88fd-6f3dabde0749 => generated 1282 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:18:16.026819 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-2c291747-7bdb-4834-9d92-52476c61971d tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03dc827647f4483beb2e1b7888be608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229e11b3c1fe48b088d0f3c4bb7e2cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:16.041525 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-2c291747-7bdb-4834-9d92-52476c61971d tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "GET /compute/v2.1/servers/80f0d7ed-260a-4c9d-a13b-be676b9edba0" status: 200 len: 1519 microversion: 2.1 time: 0.634842 Sep 14 09:18:16.043819 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2813/5594] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:18:15 2022] GET /compute/v2.1/servers/80f0d7ed-260a-4c9d-a13b-be676b9edba0 => generated 1519 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:18:16.826438 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-0322228e-b488-4afb-9333-f36af0c350c9 tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:16.827064 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-0322228e-b488-4afb-9333-f36af0c350c9 tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] [instance: c2a3c381-0ffb-48a1-88fd-6f3dabde0749] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:16.858775 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0322228e-b488-4afb-9333-f36af0c350c9 tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:16.860137 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0322228e-b488-4afb-9333-f36af0c350c9 tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:16.861688 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0322228e-b488-4afb-9333-f36af0c350c9 tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:16.862007 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-20c8def0-b137-4da7-8503-99995b03ee5a tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:16.862692 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-20c8def0-b137-4da7-8503-99995b03ee5a tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [instance: 3ceabacb-cbf6-409a-8c82-55e9901bd8d7] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:16.864726 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0322228e-b488-4afb-9333-f36af0c350c9 tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:16.865204 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0322228e-b488-4afb-9333-f36af0c350c9 tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:16.865638 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0322228e-b488-4afb-9333-f36af0c350c9 tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:16.874030 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-20c8def0-b137-4da7-8503-99995b03ee5a tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:16.874790 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-20c8def0-b137-4da7-8503-99995b03ee5a tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:16.882272 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-20c8def0-b137-4da7-8503-99995b03ee5a tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:16.883355 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-20c8def0-b137-4da7-8503-99995b03ee5a tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:16.884079 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-20c8def0-b137-4da7-8503-99995b03ee5a tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:16.884731 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-20c8def0-b137-4da7-8503-99995b03ee5a tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:16.916248 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-20c8def0-b137-4da7-8503-99995b03ee5a tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] HTTP exception thrown: Instance 3ceabacb-cbf6-409a-8c82-55e9901bd8d7 could not be found. Sep 14 09:18:16.931398 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-20c8def0-b137-4da7-8503-99995b03ee5a tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Request method failure captured: Sep 14 09:18:16.931398 n-d-836830-18 devstack@n-api.service[128758]: request: DELETE /compute/v2.1/servers/3ceabacb-cbf6-409a-8c82-55e9901bd8d7 HTTP/1.1 Sep 14 09:18:16.931398 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 09:18:16.931398 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 09:18:16.931398 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 09:18:16.931398 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 09:18:16.931398 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 09:18:16.931398 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 09:18:16.931398 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 09:18:16.931398 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 09:18:16.931398 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZplAooet3f0j7YfTn10UjWWncQT1X8Zx5oRj6ix43s3Uyu8Vx6JxK5zNIVmYD3adrXMKIf-yKfD6YAxNfiXzTvsjQqMQGw8jI4-W3D7BlestqvRpahzOMSDEzmtF5nK9S-Py3GvFBoobDIQWLv-aBhO1lijqGds4gt8aJhEwjvOnnU Sep 14 09:18:16.931398 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 09:18:16.931398 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 09:18:16.931398 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 09:18:16.931398 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 09:18:16.931398 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 09:18:16.931398 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 09:18:16.931398 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 9672a6c416ee44289eaa4d7c664d307e Sep 14 09:18:16.931398 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-AttachVolumeNegativeTest-1303332785 Sep 14 09:18:16.931398 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 09:18:16.931398 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 09:18:16.931398 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/9672a6c416ee44289eaa4d7c664d307e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_9672a6c416ee44289eaa4d7c664d307e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9672a6c416ee44289eaa4d7c664d307e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9672a6c416ee44289eaa4d7c664d307e"}]}] Sep 14 09:18:16.931398 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-AttachVolumeNegativeTest-1303332785 Sep 14 09:18:16.931398 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 9672a6c416ee44289eaa4d7c664d307e Sep 14 09:18:16.931398 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1303332785 Sep 14 09:18:16.931398 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-AttachVolumeNegativeTest-1303332785-project Sep 14 09:18:16.931398 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 09:18:16.931398 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 09:18:16.931398 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 7daab4f69af5452c8641006d9f09edce Sep 14 09:18:16.931398 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-AttachVolumeNegativeTest-1303332785-project Sep 14 09:18:16.931398 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 09:18:16.931398 n-d-836830-18 devstack@n-api.service[128758]: exception: Instance 3ceabacb-cbf6-409a-8c82-55e9901bd8d7 could not be found. Sep 14 09:18:16.931398 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': '3ceabacb-cbf6-409a-8c82-55e9901bd8d7'} Sep 14 09:18:16.931398 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:18:16.931398 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:18:16.931398 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:18:16.931398 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:18:16.931398 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:18:16.931398 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:18:16.931398 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:18:16.931398 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:18:16.931398 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:18:16.931398 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:18:16.931398 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ceabacb-cbf6-409a-8c82-55e9901bd8d7 could not be found. Sep 14 09:18:16.931398 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:18:16.931398 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:18:16.931398 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:18:16.931398 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:18:16.931398 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:18:16.931398 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:18:16.931398 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:18:16.931398 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:18:16.931398 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:18:16.931398 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:18:16.931398 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 09:18:16.931398 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 09:18:16.931398 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 09:18:16.931398 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 09:18:16.931398 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:18:16.931398 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:18:16.931398 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:18:16.931398 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:18:16.936246 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ceabacb-cbf6-409a-8c82-55e9901bd8d7 could not be found. Sep 14 09:18:16.936246 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:18:16.936246 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:18:16.936246 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:18:16.936246 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:18:16.936246 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:18:16.936246 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:18:16.936246 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:18:16.936246 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:18:16.936246 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ceabacb-cbf6-409a-8c82-55e9901bd8d7 could not be found. Sep 14 09:18:16.936246 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:18:16.936246 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-20c8def0-b137-4da7-8503-99995b03ee5a tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Returning 404 to user: Instance 3ceabacb-cbf6-409a-8c82-55e9901bd8d7 could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:18:16.937907 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-20c8def0-b137-4da7-8503-99995b03ee5a tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "DELETE /compute/v2.1/servers/3ceabacb-cbf6-409a-8c82-55e9901bd8d7" status: 404 len: 111 microversion: 2.1 time: 0.079755 Sep 14 09:18:16.938906 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2814/5595] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:18:16 2022] DELETE /compute/v2.1/servers/3ceabacb-cbf6-409a-8c82-55e9901bd8d7 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:18:16.947371 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c13308cf-b029-4b5d-bf1c-de1dd16519a0 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:16.950059 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-c13308cf-b029-4b5d-bf1c-de1dd16519a0 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [instance: 3ceabacb-cbf6-409a-8c82-55e9901bd8d7] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:16.960972 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c13308cf-b029-4b5d-bf1c-de1dd16519a0 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:16.963495 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c13308cf-b029-4b5d-bf1c-de1dd16519a0 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:16.964083 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c13308cf-b029-4b5d-bf1c-de1dd16519a0 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:16.964932 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c13308cf-b029-4b5d-bf1c-de1dd16519a0 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:16.970244 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c13308cf-b029-4b5d-bf1c-de1dd16519a0 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:16.970842 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c13308cf-b029-4b5d-bf1c-de1dd16519a0 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:16.997933 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-c13308cf-b029-4b5d-bf1c-de1dd16519a0 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] HTTP exception thrown: Instance 3ceabacb-cbf6-409a-8c82-55e9901bd8d7 could not be found. Sep 14 09:18:17.001519 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c13308cf-b029-4b5d-bf1c-de1dd16519a0 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Request method failure captured: Sep 14 09:18:17.001519 n-d-836830-18 devstack@n-api.service[128758]: request: GET /compute/v2.1/servers/3ceabacb-cbf6-409a-8c82-55e9901bd8d7 HTTP/1.1 Sep 14 09:18:17.001519 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 09:18:17.001519 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 09:18:17.001519 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 09:18:17.001519 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 09:18:17.001519 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 09:18:17.001519 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 09:18:17.001519 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 09:18:17.001519 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 09:18:17.001519 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZplAooet3f0j7YfTn10UjWWncQT1X8Zx5oRj6ix43s3Uyu8Vx6JxK5zNIVmYD3adrXMKIf-yKfD6YAxNfiXzTvsjQqMQGw8jI4-W3D7BlestqvRpahzOMSDEzmtF5nK9S-Py3GvFBoobDIQWLv-aBhO1lijqGds4gt8aJhEwjvOnnU Sep 14 09:18:17.001519 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 09:18:17.001519 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 09:18:17.001519 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 09:18:17.001519 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 09:18:17.001519 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 09:18:17.001519 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 09:18:17.001519 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 9672a6c416ee44289eaa4d7c664d307e Sep 14 09:18:17.001519 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-AttachVolumeNegativeTest-1303332785 Sep 14 09:18:17.001519 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 09:18:17.001519 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 09:18:17.001519 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/9672a6c416ee44289eaa4d7c664d307e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_9672a6c416ee44289eaa4d7c664d307e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9672a6c416ee44289eaa4d7c664d307e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9672a6c416ee44289eaa4d7c664d307e"}]}] Sep 14 09:18:17.001519 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-AttachVolumeNegativeTest-1303332785 Sep 14 09:18:17.001519 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 9672a6c416ee44289eaa4d7c664d307e Sep 14 09:18:17.001519 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1303332785 Sep 14 09:18:17.001519 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-AttachVolumeNegativeTest-1303332785-project Sep 14 09:18:17.001519 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 09:18:17.001519 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 09:18:17.001519 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 7daab4f69af5452c8641006d9f09edce Sep 14 09:18:17.001519 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-AttachVolumeNegativeTest-1303332785-project Sep 14 09:18:17.001519 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 09:18:17.001519 n-d-836830-18 devstack@n-api.service[128758]: exception: Instance 3ceabacb-cbf6-409a-8c82-55e9901bd8d7 could not be found. Sep 14 09:18:17.001519 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': '3ceabacb-cbf6-409a-8c82-55e9901bd8d7'} Sep 14 09:18:17.001519 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:18:17.001519 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:18:17.001519 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:18:17.001519 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:18:17.001519 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:18:17.001519 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:18:17.001519 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:18:17.001519 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:18:17.001519 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:18:17.001519 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:18:17.001519 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ceabacb-cbf6-409a-8c82-55e9901bd8d7 could not be found. Sep 14 09:18:17.001519 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:18:17.001519 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:18:17.001519 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:18:17.001519 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:18:17.001519 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:18:17.001519 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:18:17.001519 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:18:17.001519 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:18:17.001519 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:18:17.001519 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:18:17.001519 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:18:17.001519 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:18:17.001519 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:18:17.001519 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:18:17.001519 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:18:17.001519 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:18:17.001519 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ceabacb-cbf6-409a-8c82-55e9901bd8d7 could not be found. Sep 14 09:18:17.001519 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:18:17.001519 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:18:17.001519 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:18:17.006333 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:18:17.006333 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:18:17.006333 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:18:17.006333 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:18:17.006333 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:18:17.006333 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ceabacb-cbf6-409a-8c82-55e9901bd8d7 could not be found. Sep 14 09:18:17.006333 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:18:17.010691 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c13308cf-b029-4b5d-bf1c-de1dd16519a0 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Returning 404 to user: Instance 3ceabacb-cbf6-409a-8c82-55e9901bd8d7 could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:18:17.011756 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-c13308cf-b029-4b5d-bf1c-de1dd16519a0 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "GET /compute/v2.1/servers/3ceabacb-cbf6-409a-8c82-55e9901bd8d7" status: 404 len: 111 microversion: 2.1 time: 0.068786 Sep 14 09:18:17.012900 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2815/5596] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:18:16 2022] GET /compute/v2.1/servers/3ceabacb-cbf6-409a-8c82-55e9901bd8d7 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 14 09:18:17.069549 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-afe4fc61-a625-4021-9f48-1a2e7557b92d tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:17.070570 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-afe4fc61-a625-4021-9f48-1a2e7557b92d tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 80f0d7ed-260a-4c9d-a13b-be676b9edba0] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:17.082982 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-afe4fc61-a625-4021-9f48-1a2e7557b92d tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:17.083621 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-afe4fc61-a625-4021-9f48-1a2e7557b92d tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:17.084494 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-afe4fc61-a625-4021-9f48-1a2e7557b92d tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:17.085327 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-afe4fc61-a625-4021-9f48-1a2e7557b92d tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:17.091592 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-afe4fc61-a625-4021-9f48-1a2e7557b92d tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:17.092202 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-afe4fc61-a625-4021-9f48-1a2e7557b92d tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:17.134438 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-0322228e-b488-4afb-9333-f36af0c350c9 tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4f7a9bfa5d492084378a9e51f9f483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68a404f623498b9e77b3914b52edb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:17.146895 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-0322228e-b488-4afb-9333-f36af0c350c9 tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] 10.222.0.60 "GET /compute/v2.1/servers/c2a3c381-0ffb-48a1-88fd-6f3dabde0749" status: 200 len: 1282 microversion: 2.1 time: 0.323987 Sep 14 09:18:17.147561 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2782/5597] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:18:16 2022] GET /compute/v2.1/servers/c2a3c381-0ffb-48a1-88fd-6f3dabde0749 => generated 1282 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:18:17.532051 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-afe4fc61-a625-4021-9f48-1a2e7557b92d tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03dc827647f4483beb2e1b7888be608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229e11b3c1fe48b088d0f3c4bb7e2cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:17.541359 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-afe4fc61-a625-4021-9f48-1a2e7557b92d tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "GET /compute/v2.1/servers/80f0d7ed-260a-4c9d-a13b-be676b9edba0" status: 200 len: 1499 microversion: 2.1 time: 0.475761 Sep 14 09:18:17.547429 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2816/5598] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:18:17 2022] GET /compute/v2.1/servers/80f0d7ed-260a-4c9d-a13b-be676b9edba0 => generated 1499 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:18:17.576116 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-376829f9-ca37-4a12-8409-d9e9acd5b873 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:18:17.580204 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-376829f9-ca37-4a12-8409-d9e9acd5b873 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 80f0d7ed-260a-4c9d-a13b-be676b9edba0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:17.593257 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-376829f9-ca37-4a12-8409-d9e9acd5b873 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:17.594530 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-376829f9-ca37-4a12-8409-d9e9acd5b873 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:17.595648 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-376829f9-ca37-4a12-8409-d9e9acd5b873 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:17.597270 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-376829f9-ca37-4a12-8409-d9e9acd5b873 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:17.598268 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-376829f9-ca37-4a12-8409-d9e9acd5b873 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:17.598888 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-376829f9-ca37-4a12-8409-d9e9acd5b873 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:17.647848 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.objects.instance [None req-376829f9-ca37-4a12-8409-d9e9acd5b873 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lazy-loading 'flavor' on Instance uuid 80f0d7ed-260a-4c9d-a13b-be676b9edba0 {{(pid=128759) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:18:17.676919 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-376829f9-ca37-4a12-8409-d9e9acd5b873 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] HTTP exception thrown: Cannot 'rescue' instance 80f0d7ed-260a-4c9d-a13b-be676b9edba0 while it is in vm_state paused Sep 14 09:18:17.678537 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-376829f9-ca37-4a12-8409-d9e9acd5b873 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Request method failure captured: Sep 14 09:18:17.678537 n-d-836830-18 devstack@n-api.service[128759]: request: POST /compute/v2.1/servers/80f0d7ed-260a-4c9d-a13b-be676b9edba0/action HTTP/1.1 Sep 14 09:18:17.678537 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:18:17.678537 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:18:17.678537 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:18:17.678537 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 14 Sep 14 09:18:17.678537 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:18:17.678537 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:18:17.678537 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:18:17.678537 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:18:17.678537 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZwTx_6je2Mw19l1lk1T0KIWHROT3f4iq0u8_a7vTqyoq1BZh-ur0UF5KgJJeIlC54HlZaHspjBV72bT6ijQhdvPr0BCEmv-eUjjBTB_inJvaG7XMCMIoIIz39iqAFnj3jFdepR5dS7_uhYCyzmsUFKn1SkfeR8JmAZc_qs5ymrt_EA Sep 14 09:18:17.678537 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:18:17.678537 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:18:17.678537 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:18:17.678537 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:18:17.678537 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:18:17.678537 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:18:17.678537 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 229e11b3c1fe48b088d0f3c4bb7e2cb6 Sep 14 09:18:17.678537 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2043241234 Sep 14 09:18:17.678537 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:18:17.678537 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:18:17.678537 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/229e11b3c1fe48b088d0f3c4bb7e2cb6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_229e11b3c1fe48b088d0f3c4bb7e2cb6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/229e11b3c1fe48b088d0f3c4bb7e2cb6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/229e11b3c1fe48b088d0f3c4bb7e2cb6"}]}] Sep 14 09:18:17.678537 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2043241234 Sep 14 09:18:17.678537 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 229e11b3c1fe48b088d0f3c4bb7e2cb6 Sep 14 09:18:17.678537 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2043241234 Sep 14 09:18:17.678537 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ServerRescueNegativeTestJSON-2043241234-project Sep 14 09:18:17.678537 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:18:17.678537 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:18:17.678537 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: d03dc827647f4483beb2e1b7888be608 Sep 14 09:18:17.678537 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2043241234-project Sep 14 09:18:17.678537 n-d-836830-18 devstack@n-api.service[128759]: Sep 14 09:18:17.678537 n-d-836830-18 devstack@n-api.service[128759]: {"rescue": {}} Sep 14 09:18:17.678537 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:18:17.678537 n-d-836830-18 devstack@n-api.service[128759]: exception: Cannot 'rescue' instance 80f0d7ed-260a-4c9d-a13b-be676b9edba0 while it is in vm_state paused Sep 14 09:18:17.678537 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '80f0d7ed-260a-4c9d-a13b-be676b9edba0', 'body': {'rescue': {}}} Sep 14 09:18:17.678537 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:18:17.678537 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:18:17.678537 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Sep 14 09:18:17.678537 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Sep 14 09:18:17.678537 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Sep 14 09:18:17.678537 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 14 09:18:17.678537 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 14 09:18:17.678537 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 14 09:18:17.678537 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 14 09:18:17.678537 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 14 09:18:17.678537 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 80f0d7ed-260a-4c9d-a13b-be676b9edba0 in vm_state paused. Cannot rescue while the instance is in this state. Sep 14 09:18:17.678537 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:18:17.678537 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:18:17.678537 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:18:17.678537 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:18:17.678537 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:18:17.678537 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:18:17.678537 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:18:17.678537 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:18:17.678537 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:18:17.678537 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:18:17.678537 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:18:17.678537 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:18:17.678537 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Sep 14 09:18:17.678537 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Sep 14 09:18:17.678537 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 14 09:18:17.678537 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 14 09:18:17.678537 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance 80f0d7ed-260a-4c9d-a13b-be676b9edba0 while it is in vm_state paused Sep 14 09:18:17.678537 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:18:17.685069 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:18:17.685069 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:18:17.685069 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:18:17.685069 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:18:17.685069 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:18:17.685069 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:18:17.685069 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:18:17.685069 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance 80f0d7ed-260a-4c9d-a13b-be676b9edba0 while it is in vm_state paused Sep 14 09:18:17.685069 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:18:17.685069 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-376829f9-ca37-4a12-8409-d9e9acd5b873 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Returning 409 to user: Cannot 'rescue' instance 80f0d7ed-260a-4c9d-a13b-be676b9edba0 while it is in vm_state paused {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:18:17.686172 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-376829f9-ca37-4a12-8409-d9e9acd5b873 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "POST /compute/v2.1/servers/80f0d7ed-260a-4c9d-a13b-be676b9edba0/action" status: 409 len: 144 microversion: 2.1 time: 0.115367 Sep 14 09:18:17.689986 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2783/5599] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:18:17 2022] POST /compute/v2.1/servers/80f0d7ed-260a-4c9d-a13b-be676b9edba0/action => generated 144 bytes in 121 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 14 09:18:17.695712 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-0cafcade-481f-49d6-9408-d5cc22bd9dee tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:18:17.696821 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-0cafcade-481f-49d6-9408-d5cc22bd9dee tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 80f0d7ed-260a-4c9d-a13b-be676b9edba0] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:17.705527 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0cafcade-481f-49d6-9408-d5cc22bd9dee tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:17.706398 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0cafcade-481f-49d6-9408-d5cc22bd9dee tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:17.707154 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0cafcade-481f-49d6-9408-d5cc22bd9dee tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:17.708625 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0cafcade-481f-49d6-9408-d5cc22bd9dee tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:17.709201 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0cafcade-481f-49d6-9408-d5cc22bd9dee tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:17.709735 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0cafcade-481f-49d6-9408-d5cc22bd9dee tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:17.805196 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-0cafcade-481f-49d6-9408-d5cc22bd9dee tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "POST /compute/v2.1/servers/80f0d7ed-260a-4c9d-a13b-be676b9edba0/action" status: 202 len: 0 microversion: 2.1 time: 0.114403 Sep 14 09:18:17.808901 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2817/5600] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:18:17 2022] POST /compute/v2.1/servers/80f0d7ed-260a-4c9d-a13b-be676b9edba0/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:18:17.815302 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f30dc5d8-47e9-4d4c-a31d-226968c6ddb9 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:17.816842 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f30dc5d8-47e9-4d4c-a31d-226968c6ddb9 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 80f0d7ed-260a-4c9d-a13b-be676b9edba0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:17.831955 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f30dc5d8-47e9-4d4c-a31d-226968c6ddb9 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:17.832637 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f30dc5d8-47e9-4d4c-a31d-226968c6ddb9 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:17.832914 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f30dc5d8-47e9-4d4c-a31d-226968c6ddb9 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:17.833816 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f30dc5d8-47e9-4d4c-a31d-226968c6ddb9 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:17.839138 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f30dc5d8-47e9-4d4c-a31d-226968c6ddb9 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:17.839831 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f30dc5d8-47e9-4d4c-a31d-226968c6ddb9 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:18.182653 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-435b1ee6-dc13-4561-8d12-7b1dc0fd4eea tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:18.183977 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-435b1ee6-dc13-4561-8d12-7b1dc0fd4eea tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] [instance: c2a3c381-0ffb-48a1-88fd-6f3dabde0749] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:18.199138 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-435b1ee6-dc13-4561-8d12-7b1dc0fd4eea tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:18.200254 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-435b1ee6-dc13-4561-8d12-7b1dc0fd4eea tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:18.200871 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-435b1ee6-dc13-4561-8d12-7b1dc0fd4eea tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:18.202224 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-435b1ee6-dc13-4561-8d12-7b1dc0fd4eea tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:18.204330 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-435b1ee6-dc13-4561-8d12-7b1dc0fd4eea tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:18.204975 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-435b1ee6-dc13-4561-8d12-7b1dc0fd4eea tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:18.248984 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:18:18.297985 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f30dc5d8-47e9-4d4c-a31d-226968c6ddb9 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03dc827647f4483beb2e1b7888be608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229e11b3c1fe48b088d0f3c4bb7e2cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:18.314731 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f30dc5d8-47e9-4d4c-a31d-226968c6ddb9 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "GET /compute/v2.1/servers/80f0d7ed-260a-4c9d-a13b-be676b9edba0" status: 200 len: 1506 microversion: 2.1 time: 0.500601 Sep 14 09:18:18.337267 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2784/5601] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:18:17 2022] GET /compute/v2.1/servers/80f0d7ed-260a-4c9d-a13b-be676b9edba0 => generated 1506 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:18:18.872774 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-435b1ee6-dc13-4561-8d12-7b1dc0fd4eea tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4f7a9bfa5d492084378a9e51f9f483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68a404f623498b9e77b3914b52edb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:18.889356 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-435b1ee6-dc13-4561-8d12-7b1dc0fd4eea tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] 10.222.0.60 "GET /compute/v2.1/servers/c2a3c381-0ffb-48a1-88fd-6f3dabde0749" status: 200 len: 1324 microversion: 2.1 time: 0.723214 Sep 14 09:18:18.890407 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2818/5602] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:18:18 2022] GET /compute/v2.1/servers/c2a3c381-0ffb-48a1-88fd-6f3dabde0749 => generated 1324 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:18:19.349308 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d18fd2f2-4af1-4822-b7d5-34b9414a5f83 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:19.349940 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-d18fd2f2-4af1-4822-b7d5-34b9414a5f83 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 80f0d7ed-260a-4c9d-a13b-be676b9edba0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:19.362294 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d18fd2f2-4af1-4822-b7d5-34b9414a5f83 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:19.362792 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d18fd2f2-4af1-4822-b7d5-34b9414a5f83 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:19.365737 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d18fd2f2-4af1-4822-b7d5-34b9414a5f83 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:19.370286 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d18fd2f2-4af1-4822-b7d5-34b9414a5f83 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:19.370986 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d18fd2f2-4af1-4822-b7d5-34b9414a5f83 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:19.372349 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d18fd2f2-4af1-4822-b7d5-34b9414a5f83 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:19.635039 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-4d9f0d20-50ad-46d5-93f5-c044a95c164a req-a7076e8e-c19b-4fca-ad64-aea0b3c221ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2a3c381-0ffb-48a1-88fd-6f3dabde0749", "tag": "fb22d11d-2da1-42c4-bf73-e1c168750beb"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:18:19.668489 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-4d9f0d20-50ad-46d5-93f5-c044a95c164a req-a7076e8e-c19b-4fca-ad64-aea0b3c221ef service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:19.670838 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-4d9f0d20-50ad-46d5-93f5-c044a95c164a req-a7076e8e-c19b-4fca-ad64-aea0b3c221ef service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:19.674163 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-4d9f0d20-50ad-46d5-93f5-c044a95c164a req-a7076e8e-c19b-4fca-ad64-aea0b3c221ef service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:19.699336 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-4d9f0d20-50ad-46d5-93f5-c044a95c164a req-a7076e8e-c19b-4fca-ad64-aea0b3c221ef service nova] Creating event network-changed:fb22d11d-2da1-42c4-bf73-e1c168750beb for instance c2a3c381-0ffb-48a1-88fd-6f3dabde0749 on n-h2-836830-18 Sep 14 09:18:19.710403 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-4d9f0d20-50ad-46d5-93f5-c044a95c164a req-a7076e8e-c19b-4fca-ad64-aea0b3c221ef service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080837 Sep 14 09:18:19.711523 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2819/5603] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:18:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:18:19.914828 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-071816d7-2ff1-4def-ac08-afdd52e91c34 tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:19.915806 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-071816d7-2ff1-4def-ac08-afdd52e91c34 tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] [instance: c2a3c381-0ffb-48a1-88fd-6f3dabde0749] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:19.927585 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-071816d7-2ff1-4def-ac08-afdd52e91c34 tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:19.928091 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-071816d7-2ff1-4def-ac08-afdd52e91c34 tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:19.928540 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-071816d7-2ff1-4def-ac08-afdd52e91c34 tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:19.931508 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-071816d7-2ff1-4def-ac08-afdd52e91c34 tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:19.931994 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-071816d7-2ff1-4def-ac08-afdd52e91c34 tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:19.932443 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-071816d7-2ff1-4def-ac08-afdd52e91c34 tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:19.998447 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-d18fd2f2-4af1-4822-b7d5-34b9414a5f83 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03dc827647f4483beb2e1b7888be608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229e11b3c1fe48b088d0f3c4bb7e2cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:20.013622 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d18fd2f2-4af1-4822-b7d5-34b9414a5f83 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "GET /compute/v2.1/servers/80f0d7ed-260a-4c9d-a13b-be676b9edba0" status: 200 len: 1514 microversion: 2.1 time: 0.668358 Sep 14 09:18:20.014100 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2785/5604] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:18:19 2022] GET /compute/v2.1/servers/80f0d7ed-260a-4c9d-a13b-be676b9edba0 => generated 1514 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:18:20.447417 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-071816d7-2ff1-4def-ac08-afdd52e91c34 tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4f7a9bfa5d492084378a9e51f9f483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68a404f623498b9e77b3914b52edb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:20.476371 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-071816d7-2ff1-4def-ac08-afdd52e91c34 tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] 10.222.0.60 "GET /compute/v2.1/servers/c2a3c381-0ffb-48a1-88fd-6f3dabde0749" status: 200 len: 1324 microversion: 2.1 time: 0.557897 Sep 14 09:18:20.480349 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2820/5605] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:18:19 2022] GET /compute/v2.1/servers/c2a3c381-0ffb-48a1-88fd-6f3dabde0749 => generated 1324 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:18:21.501970 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a1b01aab-ecdf-4f61-a38a-2a6817ae6f90 tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:21.502597 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-a1b01aab-ecdf-4f61-a38a-2a6817ae6f90 tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] [instance: c2a3c381-0ffb-48a1-88fd-6f3dabde0749] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:21.511617 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a1b01aab-ecdf-4f61-a38a-2a6817ae6f90 tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:21.512759 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a1b01aab-ecdf-4f61-a38a-2a6817ae6f90 tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:21.514445 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a1b01aab-ecdf-4f61-a38a-2a6817ae6f90 tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:21.518312 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a1b01aab-ecdf-4f61-a38a-2a6817ae6f90 tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:21.519101 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a1b01aab-ecdf-4f61-a38a-2a6817ae6f90 tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:21.519736 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a1b01aab-ecdf-4f61-a38a-2a6817ae6f90 tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:21.777351 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1137eea3-5c63-4a25-9cc9-e08f8e89490c tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:21.777900 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-1137eea3-5c63-4a25-9cc9-e08f8e89490c tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] [instance: 12910e13-030f-4238-94b4-0d5c50c1e9e2] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:21.896023 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=2 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:18:21.901400 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1137eea3-5c63-4a25-9cc9-e08f8e89490c tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:21.904673 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1137eea3-5c63-4a25-9cc9-e08f8e89490c tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:21.905451 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1137eea3-5c63-4a25-9cc9-e08f8e89490c tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:21.906405 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1137eea3-5c63-4a25-9cc9-e08f8e89490c tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:21.907548 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1137eea3-5c63-4a25-9cc9-e08f8e89490c tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:21.913802 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1137eea3-5c63-4a25-9cc9-e08f8e89490c tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:21.963767 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-1137eea3-5c63-4a25-9cc9-e08f8e89490c tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] [instance: 12910e13-030f-4238-94b4-0d5c50c1e9e2] Going to try to terminate instance {{(pid=128758) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:18:22.163380 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-1137eea3-5c63-4a25-9cc9-e08f8e89490c tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] 10.222.0.60 "DELETE /compute/v2.1/servers/12910e13-030f-4238-94b4-0d5c50c1e9e2" status: 204 len: 0 microversion: 2.1 time: 0.396109 Sep 14 09:18:22.164002 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2821/5606] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:18:21 2022] DELETE /compute/v2.1/servers/12910e13-030f-4238-94b4-0d5c50c1e9e2 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 14 09:18:22.173435 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-3225079e-c3ab-4e06-887b-c29e9cf528cb tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:22.174131 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-3225079e-c3ab-4e06-887b-c29e9cf528cb tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] [instance: 12910e13-030f-4238-94b4-0d5c50c1e9e2] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:22.190140 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3225079e-c3ab-4e06-887b-c29e9cf528cb tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:22.190646 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3225079e-c3ab-4e06-887b-c29e9cf528cb tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:22.191119 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3225079e-c3ab-4e06-887b-c29e9cf528cb tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:22.195380 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3225079e-c3ab-4e06-887b-c29e9cf528cb tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:22.195770 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3225079e-c3ab-4e06-887b-c29e9cf528cb tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:22.196222 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3225079e-c3ab-4e06-887b-c29e9cf528cb tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:22.366124 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=2 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:18:22.455688 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-a1b01aab-ecdf-4f61-a38a-2a6817ae6f90 tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4f7a9bfa5d492084378a9e51f9f483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68a404f623498b9e77b3914b52edb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:22.471721 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a1b01aab-ecdf-4f61-a38a-2a6817ae6f90 tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] 10.222.0.60 "GET /compute/v2.1/servers/c2a3c381-0ffb-48a1-88fd-6f3dabde0749" status: 200 len: 1324 microversion: 2.1 time: 0.973241 Sep 14 09:18:22.472333 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2786/5607] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:18:21 2022] GET /compute/v2.1/servers/c2a3c381-0ffb-48a1-88fd-6f3dabde0749 => generated 1324 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:18:22.510403 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-3225079e-c3ab-4e06-887b-c29e9cf528cb tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538af7e0ab7c462fae161e4e8c5bf1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693e3fb677fb4bd387f1c86b369061dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:22.528456 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-3225079e-c3ab-4e06-887b-c29e9cf528cb tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] 10.222.0.60 "GET /compute/v2.1/servers/12910e13-030f-4238-94b4-0d5c50c1e9e2" status: 200 len: 1468 microversion: 2.1 time: 0.354062 Sep 14 09:18:22.529462 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2822/5608] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:18:22 2022] GET /compute/v2.1/servers/12910e13-030f-4238-94b4-0d5c50c1e9e2 => generated 1468 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:18:22.717983 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-bd0e051d-7c13-4d89-a21f-ce093c5247ef tempest-VolumesSnapshotsTestJSON-166415185 tempest-VolumesSnapshotsTestJSON-166415185-project] Action: 'create', calling method: .version_select at 0x7f7d3edc7e50>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-2014062365"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:18:22.818699 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=8 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:18:22.990147 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1e882496-36c6-4a64-8641-46694c88e979 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:18:22.992672 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-1e882496-36c6-4a64-8641-46694c88e979 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 80f0d7ed-260a-4c9d-a13b-be676b9edba0] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:23.009683 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1e882496-36c6-4a64-8641-46694c88e979 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:23.010275 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1e882496-36c6-4a64-8641-46694c88e979 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:23.010718 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1e882496-36c6-4a64-8641-46694c88e979 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:23.011671 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1e882496-36c6-4a64-8641-46694c88e979 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:23.012138 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1e882496-36c6-4a64-8641-46694c88e979 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:23.012570 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1e882496-36c6-4a64-8641-46694c88e979 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:23.064969 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.objects.instance [None req-1e882496-36c6-4a64-8641-46694c88e979 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lazy-loading 'flavor' on Instance uuid 80f0d7ed-260a-4c9d-a13b-be676b9edba0 {{(pid=128758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:18:23.223418 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-bd0e051d-7c13-4d89-a21f-ce093c5247ef tempest-VolumesSnapshotsTestJSON-166415185 tempest-VolumesSnapshotsTestJSON-166415185-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.682440 Sep 14 09:18:23.224855 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2787/5609] 10.222.0.60 () {60 vars in 1155 bytes} [Wed Sep 14 09:18:22 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 685 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 14 09:18:23.240147 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f8ca773a-97d9-417d-b686-3774d6b4c948 tempest-VolumesSnapshotsTestJSON-166415185 tempest-VolumesSnapshotsTestJSON-166415185-project] Calling method '.version_select at 0x7f7d3ee2d790>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:23.266858 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-1e882496-36c6-4a64-8641-46694c88e979 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "POST /compute/v2.1/servers/80f0d7ed-260a-4c9d-a13b-be676b9edba0/action" status: 200 len: 32 microversion: 2.1 time: 0.281296 Sep 14 09:18:23.267841 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2823/5610] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:18:22 2022] POST /compute/v2.1/servers/80f0d7ed-260a-4c9d-a13b-be676b9edba0/action => generated 32 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 14 09:18:23.288214 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-fa860294-2154-4d28-a4cf-9603746100af tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:23.294393 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-fa860294-2154-4d28-a4cf-9603746100af tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 80f0d7ed-260a-4c9d-a13b-be676b9edba0] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:23.323592 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fa860294-2154-4d28-a4cf-9603746100af tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:23.324014 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fa860294-2154-4d28-a4cf-9603746100af tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:23.324465 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fa860294-2154-4d28-a4cf-9603746100af tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:23.325205 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fa860294-2154-4d28-a4cf-9603746100af tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:23.325668 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fa860294-2154-4d28-a4cf-9603746100af tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:23.326540 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fa860294-2154-4d28-a4cf-9603746100af tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:23.393784 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f8ca773a-97d9-417d-b686-3774d6b4c948 tempest-VolumesSnapshotsTestJSON-166415185 tempest-VolumesSnapshotsTestJSON-166415185-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/a6cf1dd5-d147-4bfc-b4ec-faa4a0d8c92e" status: 200 len: 345 microversion: 2.1 time: 0.158676 Sep 14 09:18:23.395761 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2788/5611] 10.222.0.60 () {58 vars in 1245 bytes} [Wed Sep 14 09:18:23 2022] GET /compute/v2.1/os-volumes/a6cf1dd5-d147-4bfc-b4ec-faa4a0d8c92e => generated 345 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:18:23.500216 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-36e642c7-ec8a-4920-8672-533df9f3e7ae tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:23.501149 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-36e642c7-ec8a-4920-8672-533df9f3e7ae tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] [instance: c2a3c381-0ffb-48a1-88fd-6f3dabde0749] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:23.516640 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-36e642c7-ec8a-4920-8672-533df9f3e7ae tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:23.517357 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-36e642c7-ec8a-4920-8672-533df9f3e7ae tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:23.518470 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-36e642c7-ec8a-4920-8672-533df9f3e7ae tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:23.523053 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-36e642c7-ec8a-4920-8672-533df9f3e7ae tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:23.524746 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-36e642c7-ec8a-4920-8672-533df9f3e7ae tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:23.525876 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-36e642c7-ec8a-4920-8672-533df9f3e7ae tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:23.838072 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-fa860294-2154-4d28-a4cf-9603746100af tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03dc827647f4483beb2e1b7888be608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229e11b3c1fe48b088d0f3c4bb7e2cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:23.853016 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-fa860294-2154-4d28-a4cf-9603746100af tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "GET /compute/v2.1/servers/80f0d7ed-260a-4c9d-a13b-be676b9edba0" status: 200 len: 1520 microversion: 2.1 time: 0.579601 Sep 14 09:18:23.856954 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2824/5612] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:18:23 2022] GET /compute/v2.1/servers/80f0d7ed-260a-4c9d-a13b-be676b9edba0 => generated 1520 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:18:23.861707 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-36e642c7-ec8a-4920-8672-533df9f3e7ae tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4f7a9bfa5d492084378a9e51f9f483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68a404f623498b9e77b3914b52edb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:23.871241 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-36e642c7-ec8a-4920-8672-533df9f3e7ae tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] 10.222.0.60 "GET /compute/v2.1/servers/c2a3c381-0ffb-48a1-88fd-6f3dabde0749" status: 200 len: 1324 microversion: 2.1 time: 0.375588 Sep 14 09:18:23.873278 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-0a0fe48b-eaba-46e2-a263-e0dd0dcc1c3b tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:23.874175 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-0a0fe48b-eaba-46e2-a263-e0dd0dcc1c3b tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] [instance: 12910e13-030f-4238-94b4-0d5c50c1e9e2] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:23.880327 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=5,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:18:23.883323 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2789/5613] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:18:23 2022] GET /compute/v2.1/servers/c2a3c381-0ffb-48a1-88fd-6f3dabde0749 => generated 1324 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:18:23.912594 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0a0fe48b-eaba-46e2-a263-e0dd0dcc1c3b tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:23.913413 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0a0fe48b-eaba-46e2-a263-e0dd0dcc1c3b tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:23.915114 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0a0fe48b-eaba-46e2-a263-e0dd0dcc1c3b tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:23.917627 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0a0fe48b-eaba-46e2-a263-e0dd0dcc1c3b tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:23.919070 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0a0fe48b-eaba-46e2-a263-e0dd0dcc1c3b tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:23.921759 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0a0fe48b-eaba-46e2-a263-e0dd0dcc1c3b tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:24.212298 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-0a0fe48b-eaba-46e2-a263-e0dd0dcc1c3b tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538af7e0ab7c462fae161e4e8c5bf1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693e3fb677fb4bd387f1c86b369061dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:24.219798 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-0a0fe48b-eaba-46e2-a263-e0dd0dcc1c3b tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] 10.222.0.60 "GET /compute/v2.1/servers/12910e13-030f-4238-94b4-0d5c50c1e9e2" status: 200 len: 1468 microversion: 2.1 time: 0.361526 Sep 14 09:18:24.220396 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2825/5614] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:18:23 2022] GET /compute/v2.1/servers/12910e13-030f-4238-94b4-0d5c50c1e9e2 => generated 1468 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:18:24.412408 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-fc396c9e-0b96-4472-b05d-fec826cb889b tempest-VolumesSnapshotsTestJSON-166415185 tempest-VolumesSnapshotsTestJSON-166415185-project] Calling method '.version_select at 0x7f7d3ed95dc0>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:24.511222 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-fc396c9e-0b96-4472-b05d-fec826cb889b tempest-VolumesSnapshotsTestJSON-166415185 tempest-VolumesSnapshotsTestJSON-166415185-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/a6cf1dd5-d147-4bfc-b4ec-faa4a0d8c92e" status: 200 len: 345 microversion: 2.1 time: 0.105242 Sep 14 09:18:24.511806 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2790/5615] 10.222.0.60 () {58 vars in 1245 bytes} [Wed Sep 14 09:18:24 2022] GET /compute/v2.1/os-volumes/a6cf1dd5-d147-4bfc-b4ec-faa4a0d8c92e => generated 345 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:18:24.898457 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-df53e9dc-2e67-418c-95c0-d8c7916bace6 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:24.900983 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-39e63b8f-25de-45b9-937b-2a286460c61e tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:24.902067 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-df53e9dc-2e67-418c-95c0-d8c7916bace6 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 80f0d7ed-260a-4c9d-a13b-be676b9edba0] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:24.905827 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-39e63b8f-25de-45b9-937b-2a286460c61e tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] [instance: c2a3c381-0ffb-48a1-88fd-6f3dabde0749] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:24.923731 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-df53e9dc-2e67-418c-95c0-d8c7916bace6 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:24.929608 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-df53e9dc-2e67-418c-95c0-d8c7916bace6 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:24.931680 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-df53e9dc-2e67-418c-95c0-d8c7916bace6 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:24.933405 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-df53e9dc-2e67-418c-95c0-d8c7916bace6 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:24.939417 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-df53e9dc-2e67-418c-95c0-d8c7916bace6 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:24.940044 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-df53e9dc-2e67-418c-95c0-d8c7916bace6 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:24.955713 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-39e63b8f-25de-45b9-937b-2a286460c61e tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:24.956248 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-39e63b8f-25de-45b9-937b-2a286460c61e tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:24.958315 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-39e63b8f-25de-45b9-937b-2a286460c61e tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:24.960591 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-39e63b8f-25de-45b9-937b-2a286460c61e tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:24.961080 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-39e63b8f-25de-45b9-937b-2a286460c61e tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:24.966814 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-39e63b8f-25de-45b9-937b-2a286460c61e tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:25.277668 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-39e63b8f-25de-45b9-937b-2a286460c61e tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4f7a9bfa5d492084378a9e51f9f483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68a404f623498b9e77b3914b52edb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:25.306166 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-39e63b8f-25de-45b9-937b-2a286460c61e tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] 10.222.0.60 "GET /compute/v2.1/servers/c2a3c381-0ffb-48a1-88fd-6f3dabde0749" status: 200 len: 1324 microversion: 2.1 time: 0.413516 Sep 14 09:18:25.308884 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2791/5616] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:18:24 2022] GET /compute/v2.1/servers/c2a3c381-0ffb-48a1-88fd-6f3dabde0749 => generated 1324 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:18:25.322219 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-ec37b849-df6a-435e-80ed-d34a470ac354 req-03ae606b-427f-448a-b95f-d40840861f72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2a3c381-0ffb-48a1-88fd-6f3dabde0749", "name": "network-vif-plugged", "status": "completed", "tag": "fb22d11d-2da1-42c4-bf73-e1c168750beb"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:18:25.349344 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-ec37b849-df6a-435e-80ed-d34a470ac354 req-03ae606b-427f-448a-b95f-d40840861f72 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:25.350226 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-ec37b849-df6a-435e-80ed-d34a470ac354 req-03ae606b-427f-448a-b95f-d40840861f72 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:25.353119 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-ec37b849-df6a-435e-80ed-d34a470ac354 req-03ae606b-427f-448a-b95f-d40840861f72 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:25.377502 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-ec37b849-df6a-435e-80ed-d34a470ac354 req-03ae606b-427f-448a-b95f-d40840861f72 service nova] Creating event network-vif-plugged:fb22d11d-2da1-42c4-bf73-e1c168750beb for instance c2a3c381-0ffb-48a1-88fd-6f3dabde0749 on n-h2-836830-18 Sep 14 09:18:25.383825 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-ec37b849-df6a-435e-80ed-d34a470ac354 req-03ae606b-427f-448a-b95f-d40840861f72 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071396 Sep 14 09:18:25.385011 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2792/5617] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:18:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:18:25.396526 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-a1eb13c6-f71c-4f09-9e19-9f3836acb172 req-2d81114d-deb7-42c6-b36b-b61ef67b95c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12910e13-030f-4238-94b4-0d5c50c1e9e2", "name": "network-vif-deleted", "tag": "6b991f7d-3428-4ddd-bfaf-d97feb016922"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:18:25.417575 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-a1eb13c6-f71c-4f09-9e19-9f3836acb172 req-2d81114d-deb7-42c6-b36b-b61ef67b95c0 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:25.420545 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-a1eb13c6-f71c-4f09-9e19-9f3836acb172 req-2d81114d-deb7-42c6-b36b-b61ef67b95c0 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:25.421353 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-a1eb13c6-f71c-4f09-9e19-9f3836acb172 req-2d81114d-deb7-42c6-b36b-b61ef67b95c0 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:25.450560 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-a1eb13c6-f71c-4f09-9e19-9f3836acb172 req-2d81114d-deb7-42c6-b36b-b61ef67b95c0 service nova] Creating event network-vif-deleted:6b991f7d-3428-4ddd-bfaf-d97feb016922 for instance 12910e13-030f-4238-94b4-0d5c50c1e9e2 on n-h1-836830-18 Sep 14 09:18:25.460582 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-df53e9dc-2e67-418c-95c0-d8c7916bace6 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03dc827647f4483beb2e1b7888be608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229e11b3c1fe48b088d0f3c4bb7e2cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:25.466261 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-a1eb13c6-f71c-4f09-9e19-9f3836acb172 req-2d81114d-deb7-42c6-b36b-b61ef67b95c0 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078770 Sep 14 09:18:25.472520 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2793/5618] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:18:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:18:25.475873 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-df53e9dc-2e67-418c-95c0-d8c7916bace6 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "GET /compute/v2.1/servers/80f0d7ed-260a-4c9d-a13b-be676b9edba0" status: 200 len: 1520 microversion: 2.1 time: 0.594910 Sep 14 09:18:25.491221 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2826/5619] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:18:24 2022] GET /compute/v2.1/servers/80f0d7ed-260a-4c9d-a13b-be676b9edba0 => generated 1520 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:18:25.497777 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d8e1e4a1-028a-41c7-aa04-5d7a3829b2c9 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:25.498364 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-39e03047-a5e5-4246-83bb-45602ac77ac7 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:25.499008 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-39e03047-a5e5-4246-83bb-45602ac77ac7 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [instance: 53aade05-189d-455b-901e-6fb092cfbb07] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:25.499353 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-d8e1e4a1-028a-41c7-aa04-5d7a3829b2c9 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] [instance: 12910e13-030f-4238-94b4-0d5c50c1e9e2] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:25.506216 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-39e03047-a5e5-4246-83bb-45602ac77ac7 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:25.506880 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-39e03047-a5e5-4246-83bb-45602ac77ac7 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:25.507309 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d8e1e4a1-028a-41c7-aa04-5d7a3829b2c9 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:25.507565 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-39e03047-a5e5-4246-83bb-45602ac77ac7 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:25.508119 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d8e1e4a1-028a-41c7-aa04-5d7a3829b2c9 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:25.508559 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d8e1e4a1-028a-41c7-aa04-5d7a3829b2c9 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:25.509190 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-39e03047-a5e5-4246-83bb-45602ac77ac7 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:25.509603 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d8e1e4a1-028a-41c7-aa04-5d7a3829b2c9 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:25.509865 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-39e03047-a5e5-4246-83bb-45602ac77ac7 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:25.510432 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-39e03047-a5e5-4246-83bb-45602ac77ac7 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:25.510771 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d8e1e4a1-028a-41c7-aa04-5d7a3829b2c9 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:25.511368 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d8e1e4a1-028a-41c7-aa04-5d7a3829b2c9 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:25.531464 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-39e03047-a5e5-4246-83bb-45602ac77ac7 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] HTTP exception thrown: Instance 53aade05-189d-455b-901e-6fb092cfbb07 could not be found. Sep 14 09:18:25.533460 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-39e03047-a5e5-4246-83bb-45602ac77ac7 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Request method failure captured: Sep 14 09:18:25.533460 n-d-836830-18 devstack@n-api.service[128758]: request: DELETE /compute/v2.1/servers/53aade05-189d-455b-901e-6fb092cfbb07 HTTP/1.1 Sep 14 09:18:25.533460 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 09:18:25.533460 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 09:18:25.533460 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 09:18:25.533460 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 09:18:25.533460 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 09:18:25.533460 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 09:18:25.533460 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 09:18:25.533460 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 09:18:25.533460 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZplAooet3f0j7YfTn10UjWWncQT1X8Zx5oRj6ix43s3Uyu8Vx6JxK5zNIVmYD3adrXMKIf-yKfD6YAxNfiXzTvsjQqMQGw8jI4-W3D7BlestqvRpahzOMSDEzmtF5nK9S-Py3GvFBoobDIQWLv-aBhO1lijqGds4gt8aJhEwjvOnnU Sep 14 09:18:25.533460 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 09:18:25.533460 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 09:18:25.533460 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 09:18:25.533460 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 09:18:25.533460 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 09:18:25.533460 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 09:18:25.533460 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 9672a6c416ee44289eaa4d7c664d307e Sep 14 09:18:25.533460 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-AttachVolumeNegativeTest-1303332785 Sep 14 09:18:25.533460 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 09:18:25.533460 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 09:18:25.533460 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/9672a6c416ee44289eaa4d7c664d307e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_9672a6c416ee44289eaa4d7c664d307e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9672a6c416ee44289eaa4d7c664d307e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9672a6c416ee44289eaa4d7c664d307e"}]}] Sep 14 09:18:25.533460 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-AttachVolumeNegativeTest-1303332785 Sep 14 09:18:25.533460 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 9672a6c416ee44289eaa4d7c664d307e Sep 14 09:18:25.533460 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1303332785 Sep 14 09:18:25.533460 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-AttachVolumeNegativeTest-1303332785-project Sep 14 09:18:25.533460 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 09:18:25.533460 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 09:18:25.533460 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 7daab4f69af5452c8641006d9f09edce Sep 14 09:18:25.533460 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-AttachVolumeNegativeTest-1303332785-project Sep 14 09:18:25.533460 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 09:18:25.533460 n-d-836830-18 devstack@n-api.service[128758]: exception: Instance 53aade05-189d-455b-901e-6fb092cfbb07 could not be found. Sep 14 09:18:25.533460 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': '53aade05-189d-455b-901e-6fb092cfbb07'} Sep 14 09:18:25.533460 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:18:25.533460 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:18:25.533460 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:18:25.533460 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:18:25.533460 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:18:25.533460 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:18:25.533460 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:18:25.533460 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:18:25.533460 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:18:25.533460 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:18:25.533460 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53aade05-189d-455b-901e-6fb092cfbb07 could not be found. Sep 14 09:18:25.533460 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:18:25.533460 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:18:25.533460 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:18:25.533460 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:18:25.533460 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:18:25.533460 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:18:25.533460 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:18:25.533460 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:18:25.533460 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:18:25.533460 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:18:25.533460 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 09:18:25.533460 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 09:18:25.533460 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 09:18:25.533460 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 09:18:25.533460 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:18:25.533460 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:18:25.533460 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:18:25.533460 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:18:25.539832 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53aade05-189d-455b-901e-6fb092cfbb07 could not be found. Sep 14 09:18:25.539832 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:18:25.539832 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:18:25.539832 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:18:25.539832 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:18:25.539832 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:18:25.539832 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:18:25.539832 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:18:25.539832 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:18:25.539832 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53aade05-189d-455b-901e-6fb092cfbb07 could not be found. Sep 14 09:18:25.539832 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:18:25.539832 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-39e03047-a5e5-4246-83bb-45602ac77ac7 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Returning 404 to user: Instance 53aade05-189d-455b-901e-6fb092cfbb07 could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:18:25.541072 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-39e03047-a5e5-4246-83bb-45602ac77ac7 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "DELETE /compute/v2.1/servers/53aade05-189d-455b-901e-6fb092cfbb07" status: 404 len: 111 microversion: 2.1 time: 0.045714 Sep 14 09:18:25.541787 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2827/5620] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:18:25 2022] DELETE /compute/v2.1/servers/53aade05-189d-455b-901e-6fb092cfbb07 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:18:25.546435 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-208fc31b-f099-465f-91c6-e5812489060c tempest-VolumesSnapshotsTestJSON-166415185 tempest-VolumesSnapshotsTestJSON-166415185-project] Calling method '.version_select at 0x7f7d3f455040>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:25.565732 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d8e1e4a1-028a-41c7-aa04-5d7a3829b2c9 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:25.566453 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d8e1e4a1-028a-41c7-aa04-5d7a3829b2c9 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:25.566698 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d8e1e4a1-028a-41c7-aa04-5d7a3829b2c9 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:25.567303 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.objects.instance [None req-d8e1e4a1-028a-41c7-aa04-5d7a3829b2c9 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Lazy-loading 'fault' on Instance uuid 12910e13-030f-4238-94b4-0d5c50c1e9e2 {{(pid=128759) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:18:25.621964 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-208fc31b-f099-465f-91c6-e5812489060c tempest-VolumesSnapshotsTestJSON-166415185 tempest-VolumesSnapshotsTestJSON-166415185-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/a6cf1dd5-d147-4bfc-b4ec-faa4a0d8c92e" status: 200 len: 346 microversion: 2.1 time: 0.079179 Sep 14 09:18:25.622676 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2828/5621] 10.222.0.60 () {58 vars in 1245 bytes} [Wed Sep 14 09:18:25 2022] GET /compute/v2.1/os-volumes/a6cf1dd5-d147-4bfc-b4ec-faa4a0d8c92e => generated 346 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:18:25.635678 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a03d453f-6a9b-463a-82a8-4be6dc452ca1 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:25.636666 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-a03d453f-6a9b-463a-82a8-4be6dc452ca1 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [instance: 53aade05-189d-455b-901e-6fb092cfbb07] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:25.645288 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a03d453f-6a9b-463a-82a8-4be6dc452ca1 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:25.646117 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a03d453f-6a9b-463a-82a8-4be6dc452ca1 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:25.646790 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a03d453f-6a9b-463a-82a8-4be6dc452ca1 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:25.647961 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a03d453f-6a9b-463a-82a8-4be6dc452ca1 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:25.648586 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a03d453f-6a9b-463a-82a8-4be6dc452ca1 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:25.649262 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a03d453f-6a9b-463a-82a8-4be6dc452ca1 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:25.649455 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-d8e1e4a1-028a-41c7-aa04-5d7a3829b2c9 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538af7e0ab7c462fae161e4e8c5bf1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693e3fb677fb4bd387f1c86b369061dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:25.657940 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d8e1e4a1-028a-41c7-aa04-5d7a3829b2c9 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] 10.222.0.60 "GET /compute/v2.1/servers/12910e13-030f-4238-94b4-0d5c50c1e9e2" status: 200 len: 1303 microversion: 2.1 time: 0.183335 Sep 14 09:18:25.658523 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2794/5622] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:18:25 2022] GET /compute/v2.1/servers/12910e13-030f-4238-94b4-0d5c50c1e9e2 => generated 1303 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:18:25.669006 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-da379fd6-58e8-44f2-801c-af57f065fd17 tempest-VolumesSnapshotsTestJSON-166415185 tempest-VolumesSnapshotsTestJSON-166415185-project] Action: 'create', calling method: .version_select at 0x7f7d3ee2d3a0>, body: {"snapshot": {"volume_id": "a6cf1dd5-d147-4bfc-b4ec-faa4a0d8c92e", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-676173461"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:18:25.679025 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-a03d453f-6a9b-463a-82a8-4be6dc452ca1 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] HTTP exception thrown: Instance 53aade05-189d-455b-901e-6fb092cfbb07 could not be found. Sep 14 09:18:25.681657 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a03d453f-6a9b-463a-82a8-4be6dc452ca1 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Request method failure captured: Sep 14 09:18:25.681657 n-d-836830-18 devstack@n-api.service[128758]: request: GET /compute/v2.1/servers/53aade05-189d-455b-901e-6fb092cfbb07 HTTP/1.1 Sep 14 09:18:25.681657 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 09:18:25.681657 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 09:18:25.681657 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 09:18:25.681657 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 09:18:25.681657 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 09:18:25.681657 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 09:18:25.681657 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 09:18:25.681657 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 09:18:25.681657 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZplAooet3f0j7YfTn10UjWWncQT1X8Zx5oRj6ix43s3Uyu8Vx6JxK5zNIVmYD3adrXMKIf-yKfD6YAxNfiXzTvsjQqMQGw8jI4-W3D7BlestqvRpahzOMSDEzmtF5nK9S-Py3GvFBoobDIQWLv-aBhO1lijqGds4gt8aJhEwjvOnnU Sep 14 09:18:25.681657 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 09:18:25.681657 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 09:18:25.681657 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 09:18:25.681657 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 09:18:25.681657 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 09:18:25.681657 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 09:18:25.681657 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 9672a6c416ee44289eaa4d7c664d307e Sep 14 09:18:25.681657 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-AttachVolumeNegativeTest-1303332785 Sep 14 09:18:25.681657 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 09:18:25.681657 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 09:18:25.681657 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/9672a6c416ee44289eaa4d7c664d307e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_9672a6c416ee44289eaa4d7c664d307e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9672a6c416ee44289eaa4d7c664d307e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9672a6c416ee44289eaa4d7c664d307e"}]}] Sep 14 09:18:25.681657 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-AttachVolumeNegativeTest-1303332785 Sep 14 09:18:25.681657 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 9672a6c416ee44289eaa4d7c664d307e Sep 14 09:18:25.681657 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1303332785 Sep 14 09:18:25.681657 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-AttachVolumeNegativeTest-1303332785-project Sep 14 09:18:25.681657 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 09:18:25.681657 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 09:18:25.681657 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 7daab4f69af5452c8641006d9f09edce Sep 14 09:18:25.681657 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-AttachVolumeNegativeTest-1303332785-project Sep 14 09:18:25.681657 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 09:18:25.681657 n-d-836830-18 devstack@n-api.service[128758]: exception: Instance 53aade05-189d-455b-901e-6fb092cfbb07 could not be found. Sep 14 09:18:25.681657 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': '53aade05-189d-455b-901e-6fb092cfbb07'} Sep 14 09:18:25.681657 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:18:25.681657 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:18:25.681657 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:18:25.681657 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:18:25.681657 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:18:25.681657 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:18:25.681657 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:18:25.681657 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:18:25.681657 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:18:25.681657 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:18:25.681657 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53aade05-189d-455b-901e-6fb092cfbb07 could not be found. Sep 14 09:18:25.681657 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:18:25.681657 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:18:25.681657 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:18:25.681657 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:18:25.681657 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:18:25.681657 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:18:25.681657 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:18:25.681657 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:18:25.681657 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:18:25.681657 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:18:25.681657 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:18:25.681657 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:18:25.681657 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:18:25.681657 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:18:25.681657 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:18:25.681657 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:18:25.681657 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53aade05-189d-455b-901e-6fb092cfbb07 could not be found. Sep 14 09:18:25.681657 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:18:25.681657 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:18:25.681657 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:18:25.685877 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:18:25.685877 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:18:25.685877 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:18:25.685877 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:18:25.685877 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:18:25.685877 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53aade05-189d-455b-901e-6fb092cfbb07 could not be found. Sep 14 09:18:25.685877 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:18:25.685877 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a03d453f-6a9b-463a-82a8-4be6dc452ca1 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Returning 404 to user: Instance 53aade05-189d-455b-901e-6fb092cfbb07 could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:18:25.687362 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-a03d453f-6a9b-463a-82a8-4be6dc452ca1 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "GET /compute/v2.1/servers/53aade05-189d-455b-901e-6fb092cfbb07" status: 404 len: 111 microversion: 2.1 time: 0.062371 Sep 14 09:18:25.688274 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2829/5623] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:18:25 2022] GET /compute/v2.1/servers/53aade05-189d-455b-901e-6fb092cfbb07 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:18:25.699133 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-566b999e-bd70-4a77-8509-b5e361d04f30 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:25.701821 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-566b999e-bd70-4a77-8509-b5e361d04f30 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [instance: b13cd01f-fa9b-4d21-a1f9-4f7745dbbe37] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:25.720671 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-566b999e-bd70-4a77-8509-b5e361d04f30 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:25.721501 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-566b999e-bd70-4a77-8509-b5e361d04f30 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:25.721966 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-566b999e-bd70-4a77-8509-b5e361d04f30 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:25.722999 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-566b999e-bd70-4a77-8509-b5e361d04f30 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:25.724224 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-566b999e-bd70-4a77-8509-b5e361d04f30 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:25.725547 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-566b999e-bd70-4a77-8509-b5e361d04f30 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:25.749275 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-566b999e-bd70-4a77-8509-b5e361d04f30 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] HTTP exception thrown: Instance b13cd01f-fa9b-4d21-a1f9-4f7745dbbe37 could not be found. Sep 14 09:18:25.751402 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-566b999e-bd70-4a77-8509-b5e361d04f30 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Request method failure captured: Sep 14 09:18:25.751402 n-d-836830-18 devstack@n-api.service[128758]: request: DELETE /compute/v2.1/servers/b13cd01f-fa9b-4d21-a1f9-4f7745dbbe37 HTTP/1.1 Sep 14 09:18:25.751402 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 09:18:25.751402 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 09:18:25.751402 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 09:18:25.751402 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 09:18:25.751402 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 09:18:25.751402 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 09:18:25.751402 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 09:18:25.751402 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 09:18:25.751402 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZplAooet3f0j7YfTn10UjWWncQT1X8Zx5oRj6ix43s3Uyu8Vx6JxK5zNIVmYD3adrXMKIf-yKfD6YAxNfiXzTvsjQqMQGw8jI4-W3D7BlestqvRpahzOMSDEzmtF5nK9S-Py3GvFBoobDIQWLv-aBhO1lijqGds4gt8aJhEwjvOnnU Sep 14 09:18:25.751402 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 09:18:25.751402 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 09:18:25.751402 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 09:18:25.751402 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 09:18:25.751402 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 09:18:25.751402 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 09:18:25.751402 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 9672a6c416ee44289eaa4d7c664d307e Sep 14 09:18:25.751402 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-AttachVolumeNegativeTest-1303332785 Sep 14 09:18:25.751402 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 09:18:25.751402 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 09:18:25.751402 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/9672a6c416ee44289eaa4d7c664d307e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_9672a6c416ee44289eaa4d7c664d307e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9672a6c416ee44289eaa4d7c664d307e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9672a6c416ee44289eaa4d7c664d307e"}]}] Sep 14 09:18:25.751402 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-AttachVolumeNegativeTest-1303332785 Sep 14 09:18:25.751402 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 9672a6c416ee44289eaa4d7c664d307e Sep 14 09:18:25.751402 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1303332785 Sep 14 09:18:25.751402 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-AttachVolumeNegativeTest-1303332785-project Sep 14 09:18:25.751402 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 09:18:25.751402 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 09:18:25.751402 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 7daab4f69af5452c8641006d9f09edce Sep 14 09:18:25.751402 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-AttachVolumeNegativeTest-1303332785-project Sep 14 09:18:25.751402 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 09:18:25.751402 n-d-836830-18 devstack@n-api.service[128758]: exception: Instance b13cd01f-fa9b-4d21-a1f9-4f7745dbbe37 could not be found. Sep 14 09:18:25.751402 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': 'b13cd01f-fa9b-4d21-a1f9-4f7745dbbe37'} Sep 14 09:18:25.751402 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:18:25.751402 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:18:25.751402 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:18:25.751402 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:18:25.751402 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:18:25.751402 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:18:25.751402 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:18:25.751402 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:18:25.751402 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:18:25.751402 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:18:25.751402 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b13cd01f-fa9b-4d21-a1f9-4f7745dbbe37 could not be found. Sep 14 09:18:25.751402 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:18:25.751402 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:18:25.751402 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:18:25.751402 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:18:25.751402 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:18:25.751402 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:18:25.751402 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:18:25.751402 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:18:25.751402 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:18:25.751402 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:18:25.751402 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 09:18:25.751402 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 09:18:25.751402 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 09:18:25.751402 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 09:18:25.751402 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:18:25.751402 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:18:25.751402 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:18:25.751402 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:18:25.756910 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b13cd01f-fa9b-4d21-a1f9-4f7745dbbe37 could not be found. Sep 14 09:18:25.756910 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:18:25.756910 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:18:25.756910 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:18:25.756910 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:18:25.756910 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:18:25.756910 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:18:25.756910 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:18:25.756910 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:18:25.756910 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b13cd01f-fa9b-4d21-a1f9-4f7745dbbe37 could not be found. Sep 14 09:18:25.756910 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:18:25.759344 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-566b999e-bd70-4a77-8509-b5e361d04f30 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Returning 404 to user: Instance b13cd01f-fa9b-4d21-a1f9-4f7745dbbe37 could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:18:25.768755 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-566b999e-bd70-4a77-8509-b5e361d04f30 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "DELETE /compute/v2.1/servers/b13cd01f-fa9b-4d21-a1f9-4f7745dbbe37" status: 404 len: 111 microversion: 2.1 time: 0.075592 Sep 14 09:18:25.771125 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2830/5624] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:18:25 2022] DELETE /compute/v2.1/servers/b13cd01f-fa9b-4d21-a1f9-4f7745dbbe37 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 14 09:18:25.779458 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-02f032b6-01d1-4341-af1f-191948f311c8 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:25.780096 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-02f032b6-01d1-4341-af1f-191948f311c8 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [instance: b13cd01f-fa9b-4d21-a1f9-4f7745dbbe37] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:25.787129 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-02f032b6-01d1-4341-af1f-191948f311c8 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:25.787781 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-02f032b6-01d1-4341-af1f-191948f311c8 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:25.788241 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-02f032b6-01d1-4341-af1f-191948f311c8 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:25.789996 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-02f032b6-01d1-4341-af1f-191948f311c8 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:25.790511 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-02f032b6-01d1-4341-af1f-191948f311c8 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:25.790960 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-02f032b6-01d1-4341-af1f-191948f311c8 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:25.813587 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-02f032b6-01d1-4341-af1f-191948f311c8 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] HTTP exception thrown: Instance b13cd01f-fa9b-4d21-a1f9-4f7745dbbe37 could not be found. Sep 14 09:18:25.815537 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-02f032b6-01d1-4341-af1f-191948f311c8 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Request method failure captured: Sep 14 09:18:25.815537 n-d-836830-18 devstack@n-api.service[128758]: request: GET /compute/v2.1/servers/b13cd01f-fa9b-4d21-a1f9-4f7745dbbe37 HTTP/1.1 Sep 14 09:18:25.815537 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 09:18:25.815537 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 09:18:25.815537 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 09:18:25.815537 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 09:18:25.815537 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 09:18:25.815537 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 09:18:25.815537 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 09:18:25.815537 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 09:18:25.815537 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZplAooet3f0j7YfTn10UjWWncQT1X8Zx5oRj6ix43s3Uyu8Vx6JxK5zNIVmYD3adrXMKIf-yKfD6YAxNfiXzTvsjQqMQGw8jI4-W3D7BlestqvRpahzOMSDEzmtF5nK9S-Py3GvFBoobDIQWLv-aBhO1lijqGds4gt8aJhEwjvOnnU Sep 14 09:18:25.815537 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 09:18:25.815537 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 09:18:25.815537 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 09:18:25.815537 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 09:18:25.815537 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 09:18:25.815537 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 09:18:25.815537 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 9672a6c416ee44289eaa4d7c664d307e Sep 14 09:18:25.815537 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-AttachVolumeNegativeTest-1303332785 Sep 14 09:18:25.815537 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 09:18:25.815537 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 09:18:25.815537 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/9672a6c416ee44289eaa4d7c664d307e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_9672a6c416ee44289eaa4d7c664d307e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9672a6c416ee44289eaa4d7c664d307e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9672a6c416ee44289eaa4d7c664d307e"}]}] Sep 14 09:18:25.815537 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-AttachVolumeNegativeTest-1303332785 Sep 14 09:18:25.815537 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 9672a6c416ee44289eaa4d7c664d307e Sep 14 09:18:25.815537 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1303332785 Sep 14 09:18:25.815537 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-AttachVolumeNegativeTest-1303332785-project Sep 14 09:18:25.815537 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 09:18:25.815537 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 09:18:25.815537 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 7daab4f69af5452c8641006d9f09edce Sep 14 09:18:25.815537 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-AttachVolumeNegativeTest-1303332785-project Sep 14 09:18:25.815537 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 09:18:25.815537 n-d-836830-18 devstack@n-api.service[128758]: exception: Instance b13cd01f-fa9b-4d21-a1f9-4f7745dbbe37 could not be found. Sep 14 09:18:25.815537 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': 'b13cd01f-fa9b-4d21-a1f9-4f7745dbbe37'} Sep 14 09:18:25.815537 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:18:25.815537 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:18:25.815537 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:18:25.815537 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:18:25.815537 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:18:25.815537 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:18:25.815537 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:18:25.815537 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:18:25.815537 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:18:25.815537 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:18:25.815537 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b13cd01f-fa9b-4d21-a1f9-4f7745dbbe37 could not be found. Sep 14 09:18:25.815537 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:18:25.815537 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:18:25.815537 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:18:25.815537 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:18:25.815537 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:18:25.815537 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:18:25.815537 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:18:25.815537 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:18:25.815537 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:18:25.815537 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:18:25.815537 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:18:25.815537 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:18:25.815537 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:18:25.815537 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:18:25.815537 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:18:25.815537 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:18:25.815537 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b13cd01f-fa9b-4d21-a1f9-4f7745dbbe37 could not be found. Sep 14 09:18:25.815537 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:18:25.815537 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:18:25.815537 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:18:25.821429 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:18:25.821429 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:18:25.821429 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:18:25.821429 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:18:25.821429 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:18:25.821429 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b13cd01f-fa9b-4d21-a1f9-4f7745dbbe37 could not be found. Sep 14 09:18:25.821429 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:18:25.829055 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-02f032b6-01d1-4341-af1f-191948f311c8 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Returning 404 to user: Instance b13cd01f-fa9b-4d21-a1f9-4f7745dbbe37 could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:18:25.832289 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-02f032b6-01d1-4341-af1f-191948f311c8 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "GET /compute/v2.1/servers/b13cd01f-fa9b-4d21-a1f9-4f7745dbbe37" status: 404 len: 111 microversion: 2.1 time: 0.057449 Sep 14 09:18:25.834446 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2831/5625] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:18:25 2022] GET /compute/v2.1/servers/b13cd01f-fa9b-4d21-a1f9-4f7745dbbe37 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:18:25.969470 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-da379fd6-58e8-44f2-801c-af57f065fd17 tempest-VolumesSnapshotsTestJSON-166415185 tempest-VolumesSnapshotsTestJSON-166415185-project] 10.222.0.60 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.304363 Sep 14 09:18:25.976239 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2795/5626] 10.222.0.60 () {60 vars in 1162 bytes} [Wed Sep 14 09:18:25 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:18:25.981955 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1213f19b-95e2-40d6-9c7a-098f6d73117c tempest-VolumesSnapshotsTestJSON-166415185 tempest-VolumesSnapshotsTestJSON-166415185-project] Calling method '.version_select at 0x7f7d3f35fa60>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:26.055338 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-1213f19b-95e2-40d6-9c7a-098f6d73117c tempest-VolumesSnapshotsTestJSON-166415185 tempest-VolumesSnapshotsTestJSON-166415185-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/471d4bb7-2db7-4cb7-bf38-2cdc2363cb2b" status: 200 len: 286 microversion: 2.1 time: 0.077175 Sep 14 09:18:26.071235 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2832/5627] 10.222.0.60 () {58 vars in 1251 bytes} [Wed Sep 14 09:18:25 2022] GET /compute/v2.1/os-snapshots/471d4bb7-2db7-4cb7-bf38-2cdc2363cb2b => generated 286 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:18:26.075354 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-1451e2a0-1b05-4aaf-ae6c-05fb0516ff58 tempest-VolumesSnapshotsTestJSON-166415185 tempest-VolumesSnapshotsTestJSON-166415185-project] Calling method '.version_select at 0x7f7d3edc7e50>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:26.135874 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-1451e2a0-1b05-4aaf-ae6c-05fb0516ff58 tempest-VolumesSnapshotsTestJSON-166415185 tempest-VolumesSnapshotsTestJSON-166415185-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.069659 Sep 14 09:18:26.137023 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2796/5628] 10.222.0.60 () {58 vars in 1140 bytes} [Wed Sep 14 09:18:26 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:18:26.148042 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-5444da80-c3c7-40e4-80c5-cda6329d4b9d tempest-VolumesSnapshotsTestJSON-166415185 tempest-VolumesSnapshotsTestJSON-166415185-project] Calling method '.version_select at 0x7f7d3f3b1dc0>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:26.185573 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-5444da80-c3c7-40e4-80c5-cda6329d4b9d tempest-VolumesSnapshotsTestJSON-166415185 tempest-VolumesSnapshotsTestJSON-166415185-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/471d4bb7-2db7-4cb7-bf38-2cdc2363cb2b" status: 200 len: 286 microversion: 2.1 time: 0.041432 Sep 14 09:18:26.186632 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2833/5629] 10.222.0.60 () {58 vars in 1251 bytes} [Wed Sep 14 09:18:26 2022] GET /compute/v2.1/os-snapshots/471d4bb7-2db7-4cb7-bf38-2cdc2363cb2b => generated 286 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:18:26.334236 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-4eacc03b-7155-42f6-b7ae-93cc1bd4a693 tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:26.334898 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-4eacc03b-7155-42f6-b7ae-93cc1bd4a693 tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] [instance: c2a3c381-0ffb-48a1-88fd-6f3dabde0749] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:26.343397 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4eacc03b-7155-42f6-b7ae-93cc1bd4a693 tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:26.344315 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4eacc03b-7155-42f6-b7ae-93cc1bd4a693 tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:26.345394 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4eacc03b-7155-42f6-b7ae-93cc1bd4a693 tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:26.347945 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4eacc03b-7155-42f6-b7ae-93cc1bd4a693 tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:26.348604 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4eacc03b-7155-42f6-b7ae-93cc1bd4a693 tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:26.349874 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4eacc03b-7155-42f6-b7ae-93cc1bd4a693 tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:26.500640 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a11b96c4-b685-4a2b-8baf-bc289fd7989a tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:26.501267 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-a11b96c4-b685-4a2b-8baf-bc289fd7989a tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 80f0d7ed-260a-4c9d-a13b-be676b9edba0] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:26.517837 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a11b96c4-b685-4a2b-8baf-bc289fd7989a tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:26.518361 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a11b96c4-b685-4a2b-8baf-bc289fd7989a tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:26.518809 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a11b96c4-b685-4a2b-8baf-bc289fd7989a tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:26.519563 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a11b96c4-b685-4a2b-8baf-bc289fd7989a tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:26.520063 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a11b96c4-b685-4a2b-8baf-bc289fd7989a tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:26.521123 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a11b96c4-b685-4a2b-8baf-bc289fd7989a tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:26.603022 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-4eacc03b-7155-42f6-b7ae-93cc1bd4a693 tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4f7a9bfa5d492084378a9e51f9f483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68a404f623498b9e77b3914b52edb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:26.611855 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-4eacc03b-7155-42f6-b7ae-93cc1bd4a693 tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] 10.222.0.60 "GET /compute/v2.1/servers/c2a3c381-0ffb-48a1-88fd-6f3dabde0749" status: 200 len: 1324 microversion: 2.1 time: 0.281849 Sep 14 09:18:26.616938 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2797/5630] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:18:26 2022] GET /compute/v2.1/servers/c2a3c381-0ffb-48a1-88fd-6f3dabde0749 => generated 1324 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:18:26.684258 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d2381623-d4ea-442d-8dd5-441b2670ad21 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:26.685287 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-d2381623-d4ea-442d-8dd5-441b2670ad21 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] [instance: 12910e13-030f-4238-94b4-0d5c50c1e9e2] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:26.696113 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d2381623-d4ea-442d-8dd5-441b2670ad21 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:26.696893 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d2381623-d4ea-442d-8dd5-441b2670ad21 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:26.698010 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d2381623-d4ea-442d-8dd5-441b2670ad21 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:26.700622 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d2381623-d4ea-442d-8dd5-441b2670ad21 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:26.701288 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d2381623-d4ea-442d-8dd5-441b2670ad21 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:26.701875 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d2381623-d4ea-442d-8dd5-441b2670ad21 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:26.726180 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-d2381623-d4ea-442d-8dd5-441b2670ad21 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] HTTP exception thrown: Instance 12910e13-030f-4238-94b4-0d5c50c1e9e2 could not be found. Sep 14 09:18:26.727659 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d2381623-d4ea-442d-8dd5-441b2670ad21 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Request method failure captured: Sep 14 09:18:26.727659 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/12910e13-030f-4238-94b4-0d5c50c1e9e2 HTTP/1.1 Sep 14 09:18:26.727659 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:18:26.727659 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:18:26.727659 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:18:26.727659 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:18:26.727659 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:18:26.727659 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:18:26.727659 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:18:26.727659 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:18:26.727659 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZvKSaPrXDXAibLe6HNMxCV8DqA1Q-jj6VvLsR_sEBKB8kaWR1y1eL2P6DsY51lFS8nXWwsBUwZCXPBjtVPjKzhfe2OXsdhnF_XAQjtCFRTC5r9gnmW-2_coG20pBTzb1fhOVTrlgYebT3xyDp5X34JQgmMVOj0MeFipBWYg2UeSK6I Sep 14 09:18:26.727659 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:18:26.727659 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:18:26.727659 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:18:26.727659 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:18:26.727659 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:18:26.727659 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:18:26.727659 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 693e3fb677fb4bd387f1c86b369061dc Sep 14 09:18:26.727659 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-VolumesBackupsTest-1390941017 Sep 14 09:18:26.727659 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:18:26.727659 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:18:26.727659 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/693e3fb677fb4bd387f1c86b369061dc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_693e3fb677fb4bd387f1c86b369061dc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/693e3fb677fb4bd387f1c86b369061dc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/693e3fb677fb4bd387f1c86b369061dc"}]}] Sep 14 09:18:26.727659 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-VolumesBackupsTest-1390941017 Sep 14 09:18:26.727659 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 693e3fb677fb4bd387f1c86b369061dc Sep 14 09:18:26.727659 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-VolumesBackupsTest-1390941017 Sep 14 09:18:26.727659 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-VolumesBackupsTest-1390941017-project Sep 14 09:18:26.727659 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:18:26.727659 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:18:26.727659 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 538af7e0ab7c462fae161e4e8c5bf1eb Sep 14 09:18:26.727659 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-VolumesBackupsTest-1390941017-project Sep 14 09:18:26.727659 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:18:26.727659 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance 12910e13-030f-4238-94b4-0d5c50c1e9e2 could not be found. Sep 14 09:18:26.727659 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '12910e13-030f-4238-94b4-0d5c50c1e9e2'} Sep 14 09:18:26.727659 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:18:26.727659 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:18:26.727659 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:18:26.727659 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:18:26.727659 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:18:26.727659 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:18:26.727659 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:18:26.727659 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:18:26.727659 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:18:26.727659 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:18:26.727659 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12910e13-030f-4238-94b4-0d5c50c1e9e2 could not be found. Sep 14 09:18:26.727659 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:18:26.727659 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:18:26.727659 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:18:26.727659 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:18:26.727659 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:18:26.727659 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:18:26.727659 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:18:26.727659 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:18:26.727659 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:18:26.727659 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:18:26.727659 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:18:26.727659 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:18:26.727659 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:18:26.727659 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:18:26.727659 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:18:26.727659 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:18:26.727659 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12910e13-030f-4238-94b4-0d5c50c1e9e2 could not be found. Sep 14 09:18:26.727659 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:18:26.727659 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:18:26.727659 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:18:26.732213 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:18:26.732213 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:18:26.732213 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:18:26.732213 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:18:26.732213 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:18:26.732213 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12910e13-030f-4238-94b4-0d5c50c1e9e2 could not be found. Sep 14 09:18:26.732213 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:18:26.732213 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d2381623-d4ea-442d-8dd5-441b2670ad21 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] Returning 404 to user: Instance 12910e13-030f-4238-94b4-0d5c50c1e9e2 could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:18:26.732213 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d2381623-d4ea-442d-8dd5-441b2670ad21 tempest-VolumesBackupsTest-1390941017 tempest-VolumesBackupsTest-1390941017-project] 10.222.0.60 "GET /compute/v2.1/servers/12910e13-030f-4238-94b4-0d5c50c1e9e2" status: 404 len: 111 microversion: 2.1 time: 0.048756 Sep 14 09:18:26.732213 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2798/5631] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:18:26 2022] GET /compute/v2.1/servers/12910e13-030f-4238-94b4-0d5c50c1e9e2 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 14 09:18:26.758646 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-a11b96c4-b685-4a2b-8baf-bc289fd7989a tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03dc827647f4483beb2e1b7888be608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229e11b3c1fe48b088d0f3c4bb7e2cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:26.769054 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-a11b96c4-b685-4a2b-8baf-bc289fd7989a tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "GET /compute/v2.1/servers/80f0d7ed-260a-4c9d-a13b-be676b9edba0" status: 200 len: 1520 microversion: 2.1 time: 0.271698 Sep 14 09:18:26.770807 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2834/5632] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:18:26 2022] GET /compute/v2.1/servers/80f0d7ed-260a-4c9d-a13b-be676b9edba0 => generated 1520 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:18:27.200935 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b57cafb1-2907-4d68-ab88-aff72f25402f tempest-VolumesSnapshotsTestJSON-166415185 tempest-VolumesSnapshotsTestJSON-166415185-project] Calling method '.version_select at 0x7f7d3edf3280>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:27.285223 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b57cafb1-2907-4d68-ab88-aff72f25402f tempest-VolumesSnapshotsTestJSON-166415185 tempest-VolumesSnapshotsTestJSON-166415185-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/471d4bb7-2db7-4cb7-bf38-2cdc2363cb2b" status: 200 len: 286 microversion: 2.1 time: 0.090184 Sep 14 09:18:27.287109 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2799/5633] 10.222.0.60 () {58 vars in 1251 bytes} [Wed Sep 14 09:18:27 2022] GET /compute/v2.1/os-snapshots/471d4bb7-2db7-4cb7-bf38-2cdc2363cb2b => generated 286 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:18:27.643916 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a2f88c5e-7354-4e25-bea5-14d9159813a0 tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:27.646216 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-a2f88c5e-7354-4e25-bea5-14d9159813a0 tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] [instance: c2a3c381-0ffb-48a1-88fd-6f3dabde0749] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:27.655320 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a2f88c5e-7354-4e25-bea5-14d9159813a0 tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:27.656353 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a2f88c5e-7354-4e25-bea5-14d9159813a0 tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:27.657007 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a2f88c5e-7354-4e25-bea5-14d9159813a0 tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:27.658251 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a2f88c5e-7354-4e25-bea5-14d9159813a0 tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:27.659012 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a2f88c5e-7354-4e25-bea5-14d9159813a0 tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:27.659844 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a2f88c5e-7354-4e25-bea5-14d9159813a0 tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:27.798729 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3589785e-052f-4d4c-b635-ff19eb9a3af2 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:27.799792 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-3589785e-052f-4d4c-b635-ff19eb9a3af2 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 80f0d7ed-260a-4c9d-a13b-be676b9edba0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:27.814626 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3589785e-052f-4d4c-b635-ff19eb9a3af2 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:27.815433 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3589785e-052f-4d4c-b635-ff19eb9a3af2 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:27.817227 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3589785e-052f-4d4c-b635-ff19eb9a3af2 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:27.819224 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3589785e-052f-4d4c-b635-ff19eb9a3af2 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:27.823359 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3589785e-052f-4d4c-b635-ff19eb9a3af2 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:27.824086 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3589785e-052f-4d4c-b635-ff19eb9a3af2 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:28.149731 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-a2f88c5e-7354-4e25-bea5-14d9159813a0 tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4f7a9bfa5d492084378a9e51f9f483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68a404f623498b9e77b3914b52edb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:28.167215 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-a2f88c5e-7354-4e25-bea5-14d9159813a0 tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] 10.222.0.60 "GET /compute/v2.1/servers/c2a3c381-0ffb-48a1-88fd-6f3dabde0749" status: 200 len: 1521 microversion: 2.1 time: 0.525810 Sep 14 09:18:28.182500 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2835/5634] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:18:27 2022] GET /compute/v2.1/servers/c2a3c381-0ffb-48a1-88fd-6f3dabde0749 => generated 1521 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:18:28.198517 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-037a17df-1c27-497b-af28-746553b75deb tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:28.199078 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-037a17df-1c27-497b-af28-746553b75deb tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] [instance: c2a3c381-0ffb-48a1-88fd-6f3dabde0749] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:28.216553 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-037a17df-1c27-497b-af28-746553b75deb tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:28.217095 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-037a17df-1c27-497b-af28-746553b75deb tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:28.231923 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-037a17df-1c27-497b-af28-746553b75deb tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:28.234716 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-037a17df-1c27-497b-af28-746553b75deb tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:28.235132 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-3589785e-052f-4d4c-b635-ff19eb9a3af2 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03dc827647f4483beb2e1b7888be608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229e11b3c1fe48b088d0f3c4bb7e2cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:28.242186 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-037a17df-1c27-497b-af28-746553b75deb tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:28.242665 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-037a17df-1c27-497b-af28-746553b75deb tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:28.250339 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-3589785e-052f-4d4c-b635-ff19eb9a3af2 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "GET /compute/v2.1/servers/80f0d7ed-260a-4c9d-a13b-be676b9edba0" status: 200 len: 1520 microversion: 2.1 time: 0.460034 Sep 14 09:18:28.253741 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2800/5635] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:18:27 2022] GET /compute/v2.1/servers/80f0d7ed-260a-4c9d-a13b-be676b9edba0 => generated 1520 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:18:28.299977 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-fe25da92-4ca9-4b79-b93e-4c044a6a26b0 tempest-VolumesSnapshotsTestJSON-166415185 tempest-VolumesSnapshotsTestJSON-166415185-project] Calling method '.version_select at 0x7f7d3eec1430>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:28.331672 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-037a17df-1c27-497b-af28-746553b75deb tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] HTTP exception thrown: Instance is not a member of specified network Sep 14 09:18:28.341732 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-037a17df-1c27-497b-af28-746553b75deb tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Request method failure captured: Sep 14 09:18:28.341732 n-d-836830-18 devstack@n-api.service[128758]: request: GET /compute/v2.1/servers/c2a3c381-0ffb-48a1-88fd-6f3dabde0749/ips/invalid HTTP/1.1 Sep 14 09:18:28.341732 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 09:18:28.341732 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 09:18:28.341732 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 09:18:28.341732 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 09:18:28.341732 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 09:18:28.341732 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 09:18:28.341732 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 09:18:28.341732 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 09:18:28.341732 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZxS8Y570kk0JT1XQdO4UY2p0nxcQYgHDsCcjvlFVmPEMQWGo0meG-3vuoPBmkSJ3U0pwG4qva-kUZQ2rtXGa3dNO-5f6-aL3pX6-bWWemUIDW2EBrZiaWZSbNm13lf5a5ukJyHXNrLKaksx9oycbRRzl9r-4UEIHLenIPFzcqkYPD8 Sep 14 09:18:28.341732 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 09:18:28.341732 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 09:18:28.341732 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 09:18:28.341732 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 09:18:28.341732 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 09:18:28.341732 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 09:18:28.341732 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: df68a404f623498b9e77b3914b52edb0 Sep 14 09:18:28.341732 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1241428638 Sep 14 09:18:28.341732 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 09:18:28.341732 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 09:18:28.341732 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/df68a404f623498b9e77b3914b52edb0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_df68a404f623498b9e77b3914b52edb0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/df68a404f623498b9e77b3914b52edb0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/df68a404f623498b9e77b3914b52edb0"}]}] Sep 14 09:18:28.341732 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1241428638 Sep 14 09:18:28.341732 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: df68a404f623498b9e77b3914b52edb0 Sep 14 09:18:28.341732 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1241428638 Sep 14 09:18:28.341732 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-ServerAddressesNegativeTestJSON-1241428638-project Sep 14 09:18:28.341732 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 09:18:28.341732 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 09:18:28.341732 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 5c4f7a9bfa5d492084378a9e51f9f483 Sep 14 09:18:28.341732 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1241428638-project Sep 14 09:18:28.341732 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 09:18:28.341732 n-d-836830-18 devstack@n-api.service[128758]: exception: Instance is not a member of specified network Sep 14 09:18:28.341732 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'server_id': 'c2a3c381-0ffb-48a1-88fd-6f3dabde0749', 'id': 'invalid'} Sep 14 09:18:28.341732 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:18:28.341732 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:18:28.341732 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:18:28.341732 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:18:28.341732 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:18:28.341732 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:18:28.341732 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:18:28.341732 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:18:28.341732 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Sep 14 09:18:28.341732 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 14 09:18:28.341732 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Sep 14 09:18:28.341732 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:18:28.341732 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:18:28.341732 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:18:28.341732 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:18:28.341732 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:18:28.341732 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:18:28.341732 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:18:28.341732 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:18:28.341732 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Sep 14 09:18:28.341732 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:18:28.348621 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-037a17df-1c27-497b-af28-746553b75deb tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Returning 404 to user: Instance is not a member of specified network {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:18:28.349742 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-037a17df-1c27-497b-af28-746553b75deb tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] 10.222.0.60 "GET /compute/v2.1/servers/c2a3c381-0ffb-48a1-88fd-6f3dabde0749/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.156201 Sep 14 09:18:28.350968 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2836/5636] 10.222.0.60 () {58 vars in 1272 bytes} [Wed Sep 14 09:18:28 2022] GET /compute/v2.1/servers/c2a3c381-0ffb-48a1-88fd-6f3dabde0749/ips/invalid => generated 91 bytes in 158 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 14 09:18:28.367639 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-fb1549a5-885e-4363-9f14-021c7437b800 tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:28.368132 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-fb1549a5-885e-4363-9f14-021c7437b800 tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Failed to fetch instance by id 999 {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 14 09:18:28.368640 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-fb1549a5-885e-4363-9f14-021c7437b800 tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] HTTP exception thrown: Instance 999 could not be found. Sep 14 09:18:28.370081 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-fb1549a5-885e-4363-9f14-021c7437b800 tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Request method failure captured: Sep 14 09:18:28.370081 n-d-836830-18 devstack@n-api.service[128758]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Sep 14 09:18:28.370081 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 09:18:28.370081 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 09:18:28.370081 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 09:18:28.370081 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 09:18:28.370081 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 09:18:28.370081 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 09:18:28.370081 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 09:18:28.370081 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 09:18:28.370081 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZxS8Y570kk0JT1XQdO4UY2p0nxcQYgHDsCcjvlFVmPEMQWGo0meG-3vuoPBmkSJ3U0pwG4qva-kUZQ2rtXGa3dNO-5f6-aL3pX6-bWWemUIDW2EBrZiaWZSbNm13lf5a5ukJyHXNrLKaksx9oycbRRzl9r-4UEIHLenIPFzcqkYPD8 Sep 14 09:18:28.370081 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 09:18:28.370081 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 09:18:28.370081 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 09:18:28.370081 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 09:18:28.370081 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 09:18:28.370081 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 09:18:28.370081 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: df68a404f623498b9e77b3914b52edb0 Sep 14 09:18:28.370081 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1241428638 Sep 14 09:18:28.370081 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 09:18:28.370081 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 09:18:28.370081 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/df68a404f623498b9e77b3914b52edb0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_df68a404f623498b9e77b3914b52edb0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/df68a404f623498b9e77b3914b52edb0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/df68a404f623498b9e77b3914b52edb0"}]}] Sep 14 09:18:28.370081 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1241428638 Sep 14 09:18:28.370081 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: df68a404f623498b9e77b3914b52edb0 Sep 14 09:18:28.370081 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1241428638 Sep 14 09:18:28.370081 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-ServerAddressesNegativeTestJSON-1241428638-project Sep 14 09:18:28.370081 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 09:18:28.370081 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 09:18:28.370081 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 5c4f7a9bfa5d492084378a9e51f9f483 Sep 14 09:18:28.370081 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1241428638-project Sep 14 09:18:28.370081 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 09:18:28.370081 n-d-836830-18 devstack@n-api.service[128758]: exception: Instance 999 could not be found. Sep 14 09:18:28.370081 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'server_id': '999'} Sep 14 09:18:28.370081 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:18:28.370081 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:18:28.370081 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:18:28.370081 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:18:28.370081 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 14 09:18:28.370081 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 14 09:18:28.370081 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Sep 14 09:18:28.370081 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:18:28.370081 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:18:28.370081 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:18:28.370081 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:18:28.370081 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:18:28.370081 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:18:28.370081 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:18:28.370081 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:18:28.370081 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:18:28.370081 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:18:28.370081 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Sep 14 09:18:28.370081 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Sep 14 09:18:28.370081 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:18:28.370081 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:18:28.370081 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Sep 14 09:18:28.370081 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:18:28.370081 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:18:28.370081 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:18:28.370081 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:18:28.370081 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:18:28.370081 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:18:28.370081 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:18:28.370081 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:18:28.370081 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Sep 14 09:18:28.370081 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:18:28.378228 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-fb1549a5-885e-4363-9f14-021c7437b800 tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Returning 404 to user: Instance 999 could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:18:28.378228 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-fb1549a5-885e-4363-9f14-021c7437b800 tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] 10.222.0.60 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.013751 Sep 14 09:18:28.378228 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2837/5637] 10.222.0.60 () {58 vars in 1149 bytes} [Wed Sep 14 09:18:28 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 14 09:18:28.381884 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-fe25da92-4ca9-4b79-b93e-4c044a6a26b0 tempest-VolumesSnapshotsTestJSON-166415185 tempest-VolumesSnapshotsTestJSON-166415185-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/471d4bb7-2db7-4cb7-bf38-2cdc2363cb2b" status: 200 len: 286 microversion: 2.1 time: 0.086311 Sep 14 09:18:28.382631 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2801/5638] 10.222.0.60 () {58 vars in 1251 bytes} [Wed Sep 14 09:18:28 2022] GET /compute/v2.1/os-snapshots/471d4bb7-2db7-4cb7-bf38-2cdc2363cb2b => generated 286 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:18:28.385024 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-36d72468-3389-4b4b-aee3-793ef02d6298 tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:28.385648 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-36d72468-3389-4b4b-aee3-793ef02d6298 tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] [instance: c2a3c381-0ffb-48a1-88fd-6f3dabde0749] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:28.393692 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-36d72468-3389-4b4b-aee3-793ef02d6298 tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:28.394395 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-36d72468-3389-4b4b-aee3-793ef02d6298 tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:28.395529 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-36d72468-3389-4b4b-aee3-793ef02d6298 tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:28.397609 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-36d72468-3389-4b4b-aee3-793ef02d6298 tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:28.398197 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-36d72468-3389-4b4b-aee3-793ef02d6298 tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:28.398875 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-36d72468-3389-4b4b-aee3-793ef02d6298 tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:28.458351 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-36d72468-3389-4b4b-aee3-793ef02d6298 tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] [instance: c2a3c381-0ffb-48a1-88fd-6f3dabde0749] Going to try to terminate instance {{(pid=128758) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:18:28.507700 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:18:28.622745 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-36d72468-3389-4b4b-aee3-793ef02d6298 tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] 10.222.0.60 "DELETE /compute/v2.1/servers/c2a3c381-0ffb-48a1-88fd-6f3dabde0749" status: 204 len: 0 microversion: 2.1 time: 0.239697 Sep 14 09:18:28.624781 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2838/5639] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:18:28 2022] DELETE /compute/v2.1/servers/c2a3c381-0ffb-48a1-88fd-6f3dabde0749 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 14 09:18:28.633912 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c84a0e5f-92e4-4b3f-8ae3-85059a106f03 tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:28.634531 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-c84a0e5f-92e4-4b3f-8ae3-85059a106f03 tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] [instance: c2a3c381-0ffb-48a1-88fd-6f3dabde0749] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:28.648956 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c84a0e5f-92e4-4b3f-8ae3-85059a106f03 tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:28.649540 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c84a0e5f-92e4-4b3f-8ae3-85059a106f03 tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:28.649994 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c84a0e5f-92e4-4b3f-8ae3-85059a106f03 tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:28.650897 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c84a0e5f-92e4-4b3f-8ae3-85059a106f03 tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:28.651490 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c84a0e5f-92e4-4b3f-8ae3-85059a106f03 tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:28.651923 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c84a0e5f-92e4-4b3f-8ae3-85059a106f03 tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:28.859001 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-c84a0e5f-92e4-4b3f-8ae3-85059a106f03 tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4f7a9bfa5d492084378a9e51f9f483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68a404f623498b9e77b3914b52edb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:28.869856 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-c84a0e5f-92e4-4b3f-8ae3-85059a106f03 tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] 10.222.0.60 "GET /compute/v2.1/servers/c2a3c381-0ffb-48a1-88fd-6f3dabde0749" status: 200 len: 1527 microversion: 2.1 time: 0.241034 Sep 14 09:18:28.871079 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2802/5640] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:18:28 2022] GET /compute/v2.1/servers/c2a3c381-0ffb-48a1-88fd-6f3dabde0749 => generated 1527 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:18:29.280580 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-044fdc76-2383-43f7-98d7-19073d80ca33 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:29.281998 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-044fdc76-2383-43f7-98d7-19073d80ca33 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 80f0d7ed-260a-4c9d-a13b-be676b9edba0] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:29.290556 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-044fdc76-2383-43f7-98d7-19073d80ca33 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:29.291422 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-044fdc76-2383-43f7-98d7-19073d80ca33 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:29.292027 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-044fdc76-2383-43f7-98d7-19073d80ca33 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:29.292894 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-044fdc76-2383-43f7-98d7-19073d80ca33 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:29.293506 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-044fdc76-2383-43f7-98d7-19073d80ca33 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:29.294092 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-044fdc76-2383-43f7-98d7-19073d80ca33 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:29.397620 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f815c7d6-5979-4af7-9c93-40821a876da2 tempest-VolumesSnapshotsTestJSON-166415185 tempest-VolumesSnapshotsTestJSON-166415185-project] Calling method '.version_select at 0x7f7d3ed95af0>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:29.466466 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f815c7d6-5979-4af7-9c93-40821a876da2 tempest-VolumesSnapshotsTestJSON-166415185 tempest-VolumesSnapshotsTestJSON-166415185-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/471d4bb7-2db7-4cb7-bf38-2cdc2363cb2b" status: 200 len: 287 microversion: 2.1 time: 0.074875 Sep 14 09:18:29.467825 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2803/5641] 10.222.0.60 () {58 vars in 1251 bytes} [Wed Sep 14 09:18:29 2022] GET /compute/v2.1/os-snapshots/471d4bb7-2db7-4cb7-bf38-2cdc2363cb2b => generated 287 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:18:29.479246 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-dfb3e319-da73-43e5-b897-d57592a8647a tempest-VolumesSnapshotsTestJSON-166415185 tempest-VolumesSnapshotsTestJSON-166415185-project] Calling method '.version_select at 0x7f7d3edf3dc0>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:29.578010 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-dfb3e319-da73-43e5-b897-d57592a8647a tempest-VolumesSnapshotsTestJSON-166415185 tempest-VolumesSnapshotsTestJSON-166415185-project] 10.222.0.60 "DELETE /compute/v2.1/os-snapshots/471d4bb7-2db7-4cb7-bf38-2cdc2363cb2b" status: 202 len: 0 microversion: 2.1 time: 0.102404 Sep 14 09:18:29.580012 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2804/5642] 10.222.0.60 () {58 vars in 1254 bytes} [Wed Sep 14 09:18:29 2022] DELETE /compute/v2.1/os-snapshots/471d4bb7-2db7-4cb7-bf38-2cdc2363cb2b => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 14 09:18:29.588996 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8fdb0ed1-1bf4-483e-acee-8ec5ef40d641 tempest-VolumesSnapshotsTestJSON-166415185 tempest-VolumesSnapshotsTestJSON-166415185-project] Calling method '.version_select at 0x7f7d3edf3430>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:29.638853 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-044fdc76-2383-43f7-98d7-19073d80ca33 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03dc827647f4483beb2e1b7888be608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229e11b3c1fe48b088d0f3c4bb7e2cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:29.656181 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-044fdc76-2383-43f7-98d7-19073d80ca33 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "GET /compute/v2.1/servers/80f0d7ed-260a-4c9d-a13b-be676b9edba0" status: 200 len: 1520 microversion: 2.1 time: 0.380025 Sep 14 09:18:29.670584 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-8fdb0ed1-1bf4-483e-acee-8ec5ef40d641 tempest-VolumesSnapshotsTestJSON-166415185 tempest-VolumesSnapshotsTestJSON-166415185-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/471d4bb7-2db7-4cb7-bf38-2cdc2363cb2b" status: 200 len: 286 microversion: 2.1 time: 0.086770 Sep 14 09:18:29.672137 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2805/5643] 10.222.0.60 () {58 vars in 1251 bytes} [Wed Sep 14 09:18:29 2022] GET /compute/v2.1/os-snapshots/471d4bb7-2db7-4cb7-bf38-2cdc2363cb2b => generated 286 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:18:29.677132 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2839/5644] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:18:29 2022] GET /compute/v2.1/servers/80f0d7ed-260a-4c9d-a13b-be676b9edba0 => generated 1520 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:18:29.893948 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e938ae1c-cf59-446f-9d80-9535b7cd0c50 tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:29.898440 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e938ae1c-cf59-446f-9d80-9535b7cd0c50 tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] [instance: c2a3c381-0ffb-48a1-88fd-6f3dabde0749] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:29.918764 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e938ae1c-cf59-446f-9d80-9535b7cd0c50 tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:29.919316 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e938ae1c-cf59-446f-9d80-9535b7cd0c50 tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:29.919773 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e938ae1c-cf59-446f-9d80-9535b7cd0c50 tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:29.920513 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e938ae1c-cf59-446f-9d80-9535b7cd0c50 tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:29.920987 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e938ae1c-cf59-446f-9d80-9535b7cd0c50 tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:29.921427 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e938ae1c-cf59-446f-9d80-9535b7cd0c50 tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:29.954799 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:18:30.359204 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-e938ae1c-cf59-446f-9d80-9535b7cd0c50 tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4f7a9bfa5d492084378a9e51f9f483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68a404f623498b9e77b3914b52edb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:30.369111 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e938ae1c-cf59-446f-9d80-9535b7cd0c50 tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] 10.222.0.60 "GET /compute/v2.1/servers/c2a3c381-0ffb-48a1-88fd-6f3dabde0749" status: 200 len: 1527 microversion: 2.1 time: 0.479506 Sep 14 09:18:30.370394 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2806/5645] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:18:29 2022] GET /compute/v2.1/servers/c2a3c381-0ffb-48a1-88fd-6f3dabde0749 => generated 1527 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:18:30.507910 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-92ac1edc-a803-4e58-9a87-e797b3eaba43 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:30.509068 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-92ac1edc-a803-4e58-9a87-e797b3eaba43 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [instance: 81ad242a-93d0-4f76-a6f1-e02e5e537e95] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:30.521537 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-92ac1edc-a803-4e58-9a87-e797b3eaba43 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:30.522054 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-92ac1edc-a803-4e58-9a87-e797b3eaba43 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:30.522503 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-92ac1edc-a803-4e58-9a87-e797b3eaba43 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:30.523256 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-92ac1edc-a803-4e58-9a87-e797b3eaba43 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:30.523718 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-92ac1edc-a803-4e58-9a87-e797b3eaba43 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:30.524147 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-92ac1edc-a803-4e58-9a87-e797b3eaba43 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:30.562108 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-92ac1edc-a803-4e58-9a87-e797b3eaba43 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] HTTP exception thrown: Instance 81ad242a-93d0-4f76-a6f1-e02e5e537e95 could not be found. Sep 14 09:18:30.570131 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-92ac1edc-a803-4e58-9a87-e797b3eaba43 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Request method failure captured: Sep 14 09:18:30.570131 n-d-836830-18 devstack@n-api.service[128758]: request: DELETE /compute/v2.1/servers/81ad242a-93d0-4f76-a6f1-e02e5e537e95 HTTP/1.1 Sep 14 09:18:30.570131 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 09:18:30.570131 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 09:18:30.570131 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 09:18:30.570131 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 09:18:30.570131 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 09:18:30.570131 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 09:18:30.570131 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 09:18:30.570131 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 09:18:30.570131 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZplAooet3f0j7YfTn10UjWWncQT1X8Zx5oRj6ix43s3Uyu8Vx6JxK5zNIVmYD3adrXMKIf-yKfD6YAxNfiXzTvsjQqMQGw8jI4-W3D7BlestqvRpahzOMSDEzmtF5nK9S-Py3GvFBoobDIQWLv-aBhO1lijqGds4gt8aJhEwjvOnnU Sep 14 09:18:30.570131 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 09:18:30.570131 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 09:18:30.570131 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 09:18:30.570131 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 09:18:30.570131 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 09:18:30.570131 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 09:18:30.570131 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 9672a6c416ee44289eaa4d7c664d307e Sep 14 09:18:30.570131 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-AttachVolumeNegativeTest-1303332785 Sep 14 09:18:30.570131 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 09:18:30.570131 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 09:18:30.570131 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/9672a6c416ee44289eaa4d7c664d307e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_9672a6c416ee44289eaa4d7c664d307e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9672a6c416ee44289eaa4d7c664d307e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9672a6c416ee44289eaa4d7c664d307e"}]}] Sep 14 09:18:30.570131 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-AttachVolumeNegativeTest-1303332785 Sep 14 09:18:30.570131 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 9672a6c416ee44289eaa4d7c664d307e Sep 14 09:18:30.570131 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1303332785 Sep 14 09:18:30.570131 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-AttachVolumeNegativeTest-1303332785-project Sep 14 09:18:30.570131 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 09:18:30.570131 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 09:18:30.570131 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 7daab4f69af5452c8641006d9f09edce Sep 14 09:18:30.570131 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-AttachVolumeNegativeTest-1303332785-project Sep 14 09:18:30.570131 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 09:18:30.570131 n-d-836830-18 devstack@n-api.service[128758]: exception: Instance 81ad242a-93d0-4f76-a6f1-e02e5e537e95 could not be found. Sep 14 09:18:30.570131 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': '81ad242a-93d0-4f76-a6f1-e02e5e537e95'} Sep 14 09:18:30.570131 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:18:30.570131 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:18:30.570131 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:18:30.570131 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:18:30.570131 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:18:30.570131 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:18:30.570131 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:18:30.570131 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:18:30.570131 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:18:30.570131 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:18:30.570131 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81ad242a-93d0-4f76-a6f1-e02e5e537e95 could not be found. Sep 14 09:18:30.570131 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:18:30.570131 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:18:30.570131 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:18:30.570131 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:18:30.570131 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:18:30.570131 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:18:30.570131 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:18:30.570131 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:18:30.570131 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:18:30.570131 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:18:30.570131 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 09:18:30.570131 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 09:18:30.570131 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 09:18:30.570131 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 09:18:30.570131 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:18:30.570131 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:18:30.570131 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:18:30.570131 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:18:30.574207 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81ad242a-93d0-4f76-a6f1-e02e5e537e95 could not be found. Sep 14 09:18:30.574207 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:18:30.574207 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:18:30.574207 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:18:30.574207 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:18:30.574207 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:18:30.574207 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:18:30.574207 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:18:30.574207 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:18:30.574207 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81ad242a-93d0-4f76-a6f1-e02e5e537e95 could not be found. Sep 14 09:18:30.574207 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:18:30.579921 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-92ac1edc-a803-4e58-9a87-e797b3eaba43 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Returning 404 to user: Instance 81ad242a-93d0-4f76-a6f1-e02e5e537e95 could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:18:30.582578 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-92ac1edc-a803-4e58-9a87-e797b3eaba43 tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "DELETE /compute/v2.1/servers/81ad242a-93d0-4f76-a6f1-e02e5e537e95" status: 404 len: 111 microversion: 2.1 time: 0.079628 Sep 14 09:18:30.585361 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2840/5646] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:18:30 2022] DELETE /compute/v2.1/servers/81ad242a-93d0-4f76-a6f1-e02e5e537e95 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:18:30.592787 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-96577859-49e9-4089-9d04-d35cd727e20a tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:30.593999 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-96577859-49e9-4089-9d04-d35cd727e20a tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] [instance: 81ad242a-93d0-4f76-a6f1-e02e5e537e95] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:30.601580 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-96577859-49e9-4089-9d04-d35cd727e20a tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:30.608603 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-96577859-49e9-4089-9d04-d35cd727e20a tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:30.609318 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-96577859-49e9-4089-9d04-d35cd727e20a tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:30.610572 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-96577859-49e9-4089-9d04-d35cd727e20a tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:30.611242 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-96577859-49e9-4089-9d04-d35cd727e20a tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:30.611948 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-96577859-49e9-4089-9d04-d35cd727e20a tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:30.645762 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-96577859-49e9-4089-9d04-d35cd727e20a tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] HTTP exception thrown: Instance 81ad242a-93d0-4f76-a6f1-e02e5e537e95 could not be found. Sep 14 09:18:30.658533 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-96577859-49e9-4089-9d04-d35cd727e20a tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Request method failure captured: Sep 14 09:18:30.658533 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/81ad242a-93d0-4f76-a6f1-e02e5e537e95 HTTP/1.1 Sep 14 09:18:30.658533 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:18:30.658533 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:18:30.658533 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:18:30.658533 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:18:30.658533 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:18:30.658533 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:18:30.658533 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:18:30.658533 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:18:30.658533 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZplAooet3f0j7YfTn10UjWWncQT1X8Zx5oRj6ix43s3Uyu8Vx6JxK5zNIVmYD3adrXMKIf-yKfD6YAxNfiXzTvsjQqMQGw8jI4-W3D7BlestqvRpahzOMSDEzmtF5nK9S-Py3GvFBoobDIQWLv-aBhO1lijqGds4gt8aJhEwjvOnnU Sep 14 09:18:30.658533 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:18:30.658533 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:18:30.658533 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:18:30.658533 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:18:30.658533 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:18:30.658533 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:18:30.658533 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 9672a6c416ee44289eaa4d7c664d307e Sep 14 09:18:30.658533 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-AttachVolumeNegativeTest-1303332785 Sep 14 09:18:30.658533 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:18:30.658533 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:18:30.658533 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/9672a6c416ee44289eaa4d7c664d307e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_9672a6c416ee44289eaa4d7c664d307e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9672a6c416ee44289eaa4d7c664d307e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9672a6c416ee44289eaa4d7c664d307e"}]}] Sep 14 09:18:30.658533 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-AttachVolumeNegativeTest-1303332785 Sep 14 09:18:30.658533 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 9672a6c416ee44289eaa4d7c664d307e Sep 14 09:18:30.658533 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1303332785 Sep 14 09:18:30.658533 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-AttachVolumeNegativeTest-1303332785-project Sep 14 09:18:30.658533 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:18:30.658533 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:18:30.658533 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 7daab4f69af5452c8641006d9f09edce Sep 14 09:18:30.658533 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-AttachVolumeNegativeTest-1303332785-project Sep 14 09:18:30.658533 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:18:30.658533 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance 81ad242a-93d0-4f76-a6f1-e02e5e537e95 could not be found. Sep 14 09:18:30.658533 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '81ad242a-93d0-4f76-a6f1-e02e5e537e95'} Sep 14 09:18:30.658533 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:18:30.658533 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:18:30.658533 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:18:30.658533 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:18:30.658533 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:18:30.658533 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:18:30.658533 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:18:30.658533 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:18:30.658533 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:18:30.658533 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:18:30.658533 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81ad242a-93d0-4f76-a6f1-e02e5e537e95 could not be found. Sep 14 09:18:30.658533 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:18:30.658533 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:18:30.658533 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:18:30.658533 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:18:30.658533 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:18:30.658533 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:18:30.658533 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:18:30.658533 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:18:30.658533 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:18:30.658533 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:18:30.658533 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:18:30.658533 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:18:30.658533 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:18:30.658533 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:18:30.658533 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:18:30.658533 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:18:30.658533 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81ad242a-93d0-4f76-a6f1-e02e5e537e95 could not be found. Sep 14 09:18:30.658533 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:18:30.658533 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:18:30.658533 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:18:30.663469 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:18:30.663469 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:18:30.663469 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:18:30.663469 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:18:30.663469 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:18:30.663469 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81ad242a-93d0-4f76-a6f1-e02e5e537e95 could not be found. Sep 14 09:18:30.663469 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:18:30.664995 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-96577859-49e9-4089-9d04-d35cd727e20a tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] Returning 404 to user: Instance 81ad242a-93d0-4f76-a6f1-e02e5e537e95 could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:18:30.666062 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-96577859-49e9-4089-9d04-d35cd727e20a tempest-AttachVolumeNegativeTest-1303332785 tempest-AttachVolumeNegativeTest-1303332785-project] 10.222.0.60 "GET /compute/v2.1/servers/81ad242a-93d0-4f76-a6f1-e02e5e537e95" status: 404 len: 111 microversion: 2.1 time: 0.077137 Sep 14 09:18:30.671418 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2807/5647] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:18:30 2022] GET /compute/v2.1/servers/81ad242a-93d0-4f76-a6f1-e02e5e537e95 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:18:30.686344 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-4bea9b72-f0a6-462c-a4cf-19b1ec391086 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:30.686604 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-9c98c62e-516e-41d5-86c2-f5f5bda038d3 tempest-VolumesSnapshotsTestJSON-166415185 tempest-VolumesSnapshotsTestJSON-166415185-project] Calling method '.version_select at 0x7f7d3f4373a0>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:30.687537 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-4bea9b72-f0a6-462c-a4cf-19b1ec391086 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 80f0d7ed-260a-4c9d-a13b-be676b9edba0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:30.727243 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4bea9b72-f0a6-462c-a4cf-19b1ec391086 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:30.727759 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4bea9b72-f0a6-462c-a4cf-19b1ec391086 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:30.728214 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4bea9b72-f0a6-462c-a4cf-19b1ec391086 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:30.728947 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4bea9b72-f0a6-462c-a4cf-19b1ec391086 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:30.729413 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4bea9b72-f0a6-462c-a4cf-19b1ec391086 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:30.729849 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4bea9b72-f0a6-462c-a4cf-19b1ec391086 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:30.735684 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-9c98c62e-516e-41d5-86c2-f5f5bda038d3 tempest-VolumesSnapshotsTestJSON-166415185 tempest-VolumesSnapshotsTestJSON-166415185-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/471d4bb7-2db7-4cb7-bf38-2cdc2363cb2b" status: 200 len: 286 microversion: 2.1 time: 0.054552 Sep 14 09:18:30.742771 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2841/5648] 10.222.0.60 () {58 vars in 1251 bytes} [Wed Sep 14 09:18:30 2022] GET /compute/v2.1/os-snapshots/471d4bb7-2db7-4cb7-bf38-2cdc2363cb2b => generated 286 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:18:31.226643 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-d5721116-5f7e-4b3a-84d5-f3a504d49bf5 req-a8144eb9-080b-46ef-a2ba-98e143b971d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2a3c381-0ffb-48a1-88fd-6f3dabde0749", "name": "network-vif-deleted", "tag": "fb22d11d-2da1-42c4-bf73-e1c168750beb"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:18:31.254321 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-d5721116-5f7e-4b3a-84d5-f3a504d49bf5 req-a8144eb9-080b-46ef-a2ba-98e143b971d4 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:31.257499 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-d5721116-5f7e-4b3a-84d5-f3a504d49bf5 req-a8144eb9-080b-46ef-a2ba-98e143b971d4 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:31.267989 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-d5721116-5f7e-4b3a-84d5-f3a504d49bf5 req-a8144eb9-080b-46ef-a2ba-98e143b971d4 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:31.301721 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-d5721116-5f7e-4b3a-84d5-f3a504d49bf5 req-a8144eb9-080b-46ef-a2ba-98e143b971d4 service nova] Creating event network-vif-deleted:fb22d11d-2da1-42c4-bf73-e1c168750beb for instance c2a3c381-0ffb-48a1-88fd-6f3dabde0749 on n-h2-836830-18 Sep 14 09:18:31.312779 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-d5721116-5f7e-4b3a-84d5-f3a504d49bf5 req-a8144eb9-080b-46ef-a2ba-98e143b971d4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090156 Sep 14 09:18:31.317703 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2842/5649] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:18:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:18:31.394382 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-5479842b-225f-4098-b26f-f76ae0f1aa71 tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:31.396167 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-5479842b-225f-4098-b26f-f76ae0f1aa71 tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] [instance: c2a3c381-0ffb-48a1-88fd-6f3dabde0749] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:31.418991 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5479842b-225f-4098-b26f-f76ae0f1aa71 tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:31.426283 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5479842b-225f-4098-b26f-f76ae0f1aa71 tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:31.430712 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5479842b-225f-4098-b26f-f76ae0f1aa71 tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:31.431053 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-4bea9b72-f0a6-462c-a4cf-19b1ec391086 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03dc827647f4483beb2e1b7888be608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229e11b3c1fe48b088d0f3c4bb7e2cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:31.432043 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5479842b-225f-4098-b26f-f76ae0f1aa71 tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:31.432800 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5479842b-225f-4098-b26f-f76ae0f1aa71 tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:31.433500 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5479842b-225f-4098-b26f-f76ae0f1aa71 tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:31.447034 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-4bea9b72-f0a6-462c-a4cf-19b1ec391086 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "GET /compute/v2.1/servers/80f0d7ed-260a-4c9d-a13b-be676b9edba0" status: 200 len: 1520 microversion: 2.1 time: 0.765778 Sep 14 09:18:31.454363 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2808/5650] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:18:30 2022] GET /compute/v2.1/servers/80f0d7ed-260a-4c9d-a13b-be676b9edba0 => generated 1520 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:18:31.507342 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5479842b-225f-4098-b26f-f76ae0f1aa71 tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:31.510240 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5479842b-225f-4098-b26f-f76ae0f1aa71 tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:31.516910 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5479842b-225f-4098-b26f-f76ae0f1aa71 tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:31.517749 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.objects.instance [None req-5479842b-225f-4098-b26f-f76ae0f1aa71 tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Lazy-loading 'fault' on Instance uuid c2a3c381-0ffb-48a1-88fd-6f3dabde0749 {{(pid=128758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:18:31.633156 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-5479842b-225f-4098-b26f-f76ae0f1aa71 tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4f7a9bfa5d492084378a9e51f9f483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68a404f623498b9e77b3914b52edb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:31.643623 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-5479842b-225f-4098-b26f-f76ae0f1aa71 tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] 10.222.0.60 "GET /compute/v2.1/servers/c2a3c381-0ffb-48a1-88fd-6f3dabde0749" status: 200 len: 1314 microversion: 2.1 time: 0.253821 Sep 14 09:18:31.660061 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2843/5651] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:18:31 2022] GET /compute/v2.1/servers/c2a3c381-0ffb-48a1-88fd-6f3dabde0749 => generated 1314 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:18:31.750862 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e5f66835-9973-4661-b58d-bc546e6b6652 tempest-VolumesSnapshotsTestJSON-166415185 tempest-VolumesSnapshotsTestJSON-166415185-project] Calling method '.version_select at 0x7f7d3eda35e0>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:32.257115 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e5f66835-9973-4661-b58d-bc546e6b6652 tempest-VolumesSnapshotsTestJSON-166415185 tempest-VolumesSnapshotsTestJSON-166415185-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/471d4bb7-2db7-4cb7-bf38-2cdc2363cb2b" status: 200 len: 286 microversion: 2.1 time: 0.511219 Sep 14 09:18:32.258120 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2809/5652] 10.222.0.60 () {58 vars in 1251 bytes} [Wed Sep 14 09:18:31 2022] GET /compute/v2.1/os-snapshots/471d4bb7-2db7-4cb7-bf38-2cdc2363cb2b => generated 286 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:18:32.508525 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-5647aba4-723c-499d-86ba-0fa186142cc4 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:32.514331 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-5647aba4-723c-499d-86ba-0fa186142cc4 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 80f0d7ed-260a-4c9d-a13b-be676b9edba0] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:32.541738 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5647aba4-723c-499d-86ba-0fa186142cc4 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:32.549900 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5647aba4-723c-499d-86ba-0fa186142cc4 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:32.576886 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5647aba4-723c-499d-86ba-0fa186142cc4 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:32.577722 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5647aba4-723c-499d-86ba-0fa186142cc4 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:32.578209 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5647aba4-723c-499d-86ba-0fa186142cc4 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:32.578648 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5647aba4-723c-499d-86ba-0fa186142cc4 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:32.689060 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-88f7fa6c-1dc9-4747-8bba-8c91725181ed tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:32.691048 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-88f7fa6c-1dc9-4747-8bba-8c91725181ed tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] [instance: c2a3c381-0ffb-48a1-88fd-6f3dabde0749] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:32.706254 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-88f7fa6c-1dc9-4747-8bba-8c91725181ed tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:32.707373 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-88f7fa6c-1dc9-4747-8bba-8c91725181ed tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:32.708154 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-88f7fa6c-1dc9-4747-8bba-8c91725181ed tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:32.709148 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-88f7fa6c-1dc9-4747-8bba-8c91725181ed tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:32.709867 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-88f7fa6c-1dc9-4747-8bba-8c91725181ed tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:32.711115 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-88f7fa6c-1dc9-4747-8bba-8c91725181ed tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:32.756903 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-88f7fa6c-1dc9-4747-8bba-8c91725181ed tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] HTTP exception thrown: Instance c2a3c381-0ffb-48a1-88fd-6f3dabde0749 could not be found. Sep 14 09:18:32.759193 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-88f7fa6c-1dc9-4747-8bba-8c91725181ed tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Request method failure captured: Sep 14 09:18:32.759193 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/c2a3c381-0ffb-48a1-88fd-6f3dabde0749 HTTP/1.1 Sep 14 09:18:32.759193 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:18:32.759193 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:18:32.759193 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:18:32.759193 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:18:32.759193 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:18:32.759193 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:18:32.759193 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:18:32.759193 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:18:32.759193 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZxS8Y570kk0JT1XQdO4UY2p0nxcQYgHDsCcjvlFVmPEMQWGo0meG-3vuoPBmkSJ3U0pwG4qva-kUZQ2rtXGa3dNO-5f6-aL3pX6-bWWemUIDW2EBrZiaWZSbNm13lf5a5ukJyHXNrLKaksx9oycbRRzl9r-4UEIHLenIPFzcqkYPD8 Sep 14 09:18:32.759193 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:18:32.759193 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:18:32.759193 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:18:32.759193 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:18:32.759193 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:18:32.759193 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:18:32.759193 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: df68a404f623498b9e77b3914b52edb0 Sep 14 09:18:32.759193 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1241428638 Sep 14 09:18:32.759193 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:18:32.759193 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:18:32.759193 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/df68a404f623498b9e77b3914b52edb0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_df68a404f623498b9e77b3914b52edb0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/df68a404f623498b9e77b3914b52edb0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/df68a404f623498b9e77b3914b52edb0"}]}] Sep 14 09:18:32.759193 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1241428638 Sep 14 09:18:32.759193 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: df68a404f623498b9e77b3914b52edb0 Sep 14 09:18:32.759193 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1241428638 Sep 14 09:18:32.759193 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ServerAddressesNegativeTestJSON-1241428638-project Sep 14 09:18:32.759193 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:18:32.759193 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:18:32.759193 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 5c4f7a9bfa5d492084378a9e51f9f483 Sep 14 09:18:32.759193 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1241428638-project Sep 14 09:18:32.759193 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:18:32.759193 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance c2a3c381-0ffb-48a1-88fd-6f3dabde0749 could not be found. Sep 14 09:18:32.759193 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': 'c2a3c381-0ffb-48a1-88fd-6f3dabde0749'} Sep 14 09:18:32.759193 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:18:32.759193 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:18:32.759193 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:18:32.759193 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:18:32.759193 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:18:32.759193 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:18:32.759193 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:18:32.759193 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:18:32.759193 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:18:32.759193 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:18:32.759193 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2a3c381-0ffb-48a1-88fd-6f3dabde0749 could not be found. Sep 14 09:18:32.759193 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:18:32.759193 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:18:32.759193 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:18:32.759193 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:18:32.759193 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:18:32.759193 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:18:32.759193 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:18:32.759193 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:18:32.759193 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:18:32.759193 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:18:32.759193 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:18:32.759193 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:18:32.759193 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:18:32.759193 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:18:32.759193 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:18:32.759193 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:18:32.759193 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2a3c381-0ffb-48a1-88fd-6f3dabde0749 could not be found. Sep 14 09:18:32.759193 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:18:32.759193 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:18:32.763648 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:18:32.763648 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:18:32.763648 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:18:32.763648 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:18:32.763648 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:18:32.763648 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:18:32.763648 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2a3c381-0ffb-48a1-88fd-6f3dabde0749 could not be found. Sep 14 09:18:32.763648 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:18:32.772566 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-88f7fa6c-1dc9-4747-8bba-8c91725181ed tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] Returning 404 to user: Instance c2a3c381-0ffb-48a1-88fd-6f3dabde0749 could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:18:32.773939 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-88f7fa6c-1dc9-4747-8bba-8c91725181ed tempest-ServerAddressesNegativeTestJSON-1241428638 tempest-ServerAddressesNegativeTestJSON-1241428638-project] 10.222.0.60 "GET /compute/v2.1/servers/c2a3c381-0ffb-48a1-88fd-6f3dabde0749" status: 404 len: 111 microversion: 2.1 time: 0.101003 Sep 14 09:18:32.775659 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2810/5653] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:18:32 2022] GET /compute/v2.1/servers/c2a3c381-0ffb-48a1-88fd-6f3dabde0749 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 14 09:18:33.271614 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-0c19ddf1-5165-488f-8bb4-11645ccca63a tempest-VolumesSnapshotsTestJSON-166415185 tempest-VolumesSnapshotsTestJSON-166415185-project] Calling method '.version_select at 0x7f7d3edb3160>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:33.333505 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-0c19ddf1-5165-488f-8bb4-11645ccca63a tempest-VolumesSnapshotsTestJSON-166415185 tempest-VolumesSnapshotsTestJSON-166415185-project] HTTP exception thrown: Snapshot 471d4bb7-2db7-4cb7-bf38-2cdc2363cb2b could not be found. Sep 14 09:18:33.352018 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-0c19ddf1-5165-488f-8bb4-11645ccca63a tempest-VolumesSnapshotsTestJSON-166415185 tempest-VolumesSnapshotsTestJSON-166415185-project] Request method failure captured: Sep 14 09:18:33.352018 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/os-snapshots/471d4bb7-2db7-4cb7-bf38-2cdc2363cb2b HTTP/1.1 Sep 14 09:18:33.352018 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:18:33.352018 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:18:33.352018 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:18:33.352018 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:18:33.352018 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:18:33.352018 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:18:33.352018 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:18:33.352018 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:18:33.352018 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZxec53zcyKZ8MArxz89z44Yu9QlVaJCP-UaRy-4s3IgTEl23g-9xaIN6shpWLF5CYjRilIyM0GwHfFddhwa8vX0UvPdQ9_YPIa6qObzebU32IK4hn9_BjO7Ns06OWMjXG2sssHKr90hU-7iWWTBT8E54ZeRTrs0rRvNoMniLkAr7EE Sep 14 09:18:33.352018 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:18:33.352018 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:18:33.352018 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:18:33.352018 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:18:33.352018 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:18:33.352018 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:18:33.352018 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 052b7297f9bf45a7b1d394b67bceb191 Sep 14 09:18:33.352018 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-166415185 Sep 14 09:18:33.352018 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:18:33.352018 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:18:33.352018 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/052b7297f9bf45a7b1d394b67bceb191"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_052b7297f9bf45a7b1d394b67bceb191"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/052b7297f9bf45a7b1d394b67bceb191"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/052b7297f9bf45a7b1d394b67bceb191"}]}] Sep 14 09:18:33.352018 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-VolumesSnapshotsTestJSON-166415185 Sep 14 09:18:33.352018 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 052b7297f9bf45a7b1d394b67bceb191 Sep 14 09:18:33.352018 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-166415185 Sep 14 09:18:33.352018 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-VolumesSnapshotsTestJSON-166415185-project Sep 14 09:18:33.352018 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:18:33.352018 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:18:33.352018 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 5259490602454f029a78f064699b45ee Sep 14 09:18:33.352018 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-VolumesSnapshotsTestJSON-166415185-project Sep 14 09:18:33.352018 n-d-836830-18 devstack@n-api.service[128759]: method: Sep 14 09:18:33.352018 n-d-836830-18 devstack@n-api.service[128759]: exception: Snapshot 471d4bb7-2db7-4cb7-bf38-2cdc2363cb2b could not be found. Sep 14 09:18:33.352018 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '471d4bb7-2db7-4cb7-bf38-2cdc2363cb2b'} Sep 14 09:18:33.352018 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:18:33.352018 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:18:33.352018 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 14 09:18:33.352018 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 14 09:18:33.352018 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 14 09:18:33.352018 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 14 09:18:33.352018 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 14 09:18:33.352018 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 14 09:18:33.352018 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 14 09:18:33.352018 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 14 09:18:33.352018 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 14 09:18:33.352018 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 14 09:18:33.352018 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 14 09:18:33.352018 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 14 09:18:33.352018 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 14 09:18:33.352018 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 14 09:18:33.352018 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 471d4bb7-2db7-4cb7-bf38-2cdc2363cb2b could not be found. (HTTP 404) (Request-ID: req-d7dfe909-6859-4dcb-94a0-de23098f108b) Sep 14 09:18:33.352018 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:18:33.352018 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:18:33.352018 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:18:33.352018 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:18:33.352018 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 14 09:18:33.352018 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 14 09:18:33.352018 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 14 09:18:33.352018 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 14 09:18:33.352018 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 14 09:18:33.352018 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 14 09:18:33.352018 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 14 09:18:33.352018 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 14 09:18:33.356804 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 14 09:18:33.356804 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 14 09:18:33.356804 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 14 09:18:33.356804 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 14 09:18:33.356804 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 14 09:18:33.356804 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 14 09:18:33.356804 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 14 09:18:33.356804 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 14 09:18:33.356804 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 14 09:18:33.356804 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 14 09:18:33.356804 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 14 09:18:33.356804 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 14 09:18:33.356804 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 14 09:18:33.356804 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 14 09:18:33.356804 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 471d4bb7-2db7-4cb7-bf38-2cdc2363cb2b could not be found. Sep 14 09:18:33.356804 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:18:33.356804 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:18:33.356804 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:18:33.356804 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:18:33.356804 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:18:33.356804 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:18:33.356804 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:18:33.356804 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:18:33.356804 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:18:33.356804 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:18:33.356804 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:18:33.356804 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:18:33.356804 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 14 09:18:33.356804 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:18:33.356804 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 471d4bb7-2db7-4cb7-bf38-2cdc2363cb2b could not be found. Sep 14 09:18:33.356804 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:18:33.356804 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:18:33.356804 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:18:33.356804 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:18:33.356804 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:18:33.356804 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:18:33.356804 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:18:33.356804 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:18:33.356804 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 471d4bb7-2db7-4cb7-bf38-2cdc2363cb2b could not be found. Sep 14 09:18:33.356804 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:18:33.356804 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-0c19ddf1-5165-488f-8bb4-11645ccca63a tempest-VolumesSnapshotsTestJSON-166415185 tempest-VolumesSnapshotsTestJSON-166415185-project] Returning 404 to user: Snapshot 471d4bb7-2db7-4cb7-bf38-2cdc2363cb2b could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:18:33.356804 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-0c19ddf1-5165-488f-8bb4-11645ccca63a tempest-VolumesSnapshotsTestJSON-166415185 tempest-VolumesSnapshotsTestJSON-166415185-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/471d4bb7-2db7-4cb7-bf38-2cdc2363cb2b" status: 404 len: 111 microversion: 2.1 time: 0.088863 Sep 14 09:18:33.360855 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2811/5654] 10.222.0.60 () {58 vars in 1251 bytes} [Wed Sep 14 09:18:33 2022] GET /compute/v2.1/os-snapshots/471d4bb7-2db7-4cb7-bf38-2cdc2363cb2b => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 14 09:18:33.368453 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-fe140b95-c56c-4488-8dbc-ccc20e21edae tempest-VolumesSnapshotsTestJSON-166415185 tempest-VolumesSnapshotsTestJSON-166415185-project] Calling method '.version_select at 0x7f7d4421cc10>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:33.437012 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-5647aba4-723c-499d-86ba-0fa186142cc4 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03dc827647f4483beb2e1b7888be608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229e11b3c1fe48b088d0f3c4bb7e2cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:33.449305 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-5647aba4-723c-499d-86ba-0fa186142cc4 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "GET /compute/v2.1/servers/80f0d7ed-260a-4c9d-a13b-be676b9edba0" status: 200 len: 1520 microversion: 2.1 time: 0.958138 Sep 14 09:18:33.451760 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2844/5655] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:18:32 2022] GET /compute/v2.1/servers/80f0d7ed-260a-4c9d-a13b-be676b9edba0 => generated 1520 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:18:33.528074 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-fe140b95-c56c-4488-8dbc-ccc20e21edae tempest-VolumesSnapshotsTestJSON-166415185 tempest-VolumesSnapshotsTestJSON-166415185-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/a6cf1dd5-d147-4bfc-b4ec-faa4a0d8c92e" status: 202 len: 0 microversion: 2.1 time: 0.164589 Sep 14 09:18:33.528959 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2812/5656] 10.222.0.60 () {58 vars in 1248 bytes} [Wed Sep 14 09:18:33 2022] DELETE /compute/v2.1/os-volumes/a6cf1dd5-d147-4bfc-b4ec-faa4a0d8c92e => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 14 09:18:33.538092 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-38361536-8a75-4bbb-a77f-30c75fd40a73 tempest-VolumesSnapshotsTestJSON-166415185 tempest-VolumesSnapshotsTestJSON-166415185-project] Calling method '.version_select at 0x7f7d3f3b81f0>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:33.648012 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-38361536-8a75-4bbb-a77f-30c75fd40a73 tempest-VolumesSnapshotsTestJSON-166415185 tempest-VolumesSnapshotsTestJSON-166415185-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/a6cf1dd5-d147-4bfc-b4ec-faa4a0d8c92e" status: 200 len: 345 microversion: 2.1 time: 0.114303 Sep 14 09:18:33.655566 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2845/5657] 10.222.0.60 () {58 vars in 1245 bytes} [Wed Sep 14 09:18:33 2022] GET /compute/v2.1/os-volumes/a6cf1dd5-d147-4bfc-b4ec-faa4a0d8c92e => generated 345 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:18:34.474186 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9aafdcbe-9037-4da5-b79e-6c02c3946b90 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:34.475494 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-9aafdcbe-9037-4da5-b79e-6c02c3946b90 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 80f0d7ed-260a-4c9d-a13b-be676b9edba0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:34.494722 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9aafdcbe-9037-4da5-b79e-6c02c3946b90 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:34.495545 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9aafdcbe-9037-4da5-b79e-6c02c3946b90 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:34.496336 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9aafdcbe-9037-4da5-b79e-6c02c3946b90 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:34.497318 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9aafdcbe-9037-4da5-b79e-6c02c3946b90 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:34.498011 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9aafdcbe-9037-4da5-b79e-6c02c3946b90 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:34.498691 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9aafdcbe-9037-4da5-b79e-6c02c3946b90 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:34.665594 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-13c23645-829f-4eca-a527-282a6bb269a8 tempest-VolumesSnapshotsTestJSON-166415185 tempest-VolumesSnapshotsTestJSON-166415185-project] Calling method '.version_select at 0x7f7d3f342a60>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:34.766023 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-13c23645-829f-4eca-a527-282a6bb269a8 tempest-VolumesSnapshotsTestJSON-166415185 tempest-VolumesSnapshotsTestJSON-166415185-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/a6cf1dd5-d147-4bfc-b4ec-faa4a0d8c92e" status: 200 len: 345 microversion: 2.1 time: 0.107022 Sep 14 09:18:34.766963 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2846/5658] 10.222.0.60 () {58 vars in 1245 bytes} [Wed Sep 14 09:18:34 2022] GET /compute/v2.1/os-volumes/a6cf1dd5-d147-4bfc-b4ec-faa4a0d8c92e => generated 345 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:18:34.887736 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-9aafdcbe-9037-4da5-b79e-6c02c3946b90 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03dc827647f4483beb2e1b7888be608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229e11b3c1fe48b088d0f3c4bb7e2cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:34.902837 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-9aafdcbe-9037-4da5-b79e-6c02c3946b90 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "GET /compute/v2.1/servers/80f0d7ed-260a-4c9d-a13b-be676b9edba0" status: 200 len: 1520 microversion: 2.1 time: 0.431735 Sep 14 09:18:34.925723 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2813/5659] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:18:34 2022] GET /compute/v2.1/servers/80f0d7ed-260a-4c9d-a13b-be676b9edba0 => generated 1520 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:18:35.783859 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-db10eebb-e54f-4588-88fb-28edf5881ed8 tempest-VolumesSnapshotsTestJSON-166415185 tempest-VolumesSnapshotsTestJSON-166415185-project] Calling method '.version_select at 0x7f7d3f43ed30>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:35.844135 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-db10eebb-e54f-4588-88fb-28edf5881ed8 tempest-VolumesSnapshotsTestJSON-166415185 tempest-VolumesSnapshotsTestJSON-166415185-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/a6cf1dd5-d147-4bfc-b4ec-faa4a0d8c92e" status: 200 len: 345 microversion: 2.1 time: 0.065136 Sep 14 09:18:35.845849 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2847/5660] 10.222.0.60 () {58 vars in 1245 bytes} [Wed Sep 14 09:18:35 2022] GET /compute/v2.1/os-volumes/a6cf1dd5-d147-4bfc-b4ec-faa4a0d8c92e => generated 345 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:18:35.936593 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a2c7d4ab-4e57-4050-b2a1-72c258094c87 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:35.954267 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-a2c7d4ab-4e57-4050-b2a1-72c258094c87 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 80f0d7ed-260a-4c9d-a13b-be676b9edba0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:35.966830 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a2c7d4ab-4e57-4050-b2a1-72c258094c87 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:35.967637 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a2c7d4ab-4e57-4050-b2a1-72c258094c87 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:35.968324 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a2c7d4ab-4e57-4050-b2a1-72c258094c87 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:35.969254 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a2c7d4ab-4e57-4050-b2a1-72c258094c87 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:35.969884 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a2c7d4ab-4e57-4050-b2a1-72c258094c87 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:35.970507 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a2c7d4ab-4e57-4050-b2a1-72c258094c87 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:36.136342 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-a2c7d4ab-4e57-4050-b2a1-72c258094c87 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03dc827647f4483beb2e1b7888be608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229e11b3c1fe48b088d0f3c4bb7e2cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:36.146415 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a2c7d4ab-4e57-4050-b2a1-72c258094c87 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "GET /compute/v2.1/servers/80f0d7ed-260a-4c9d-a13b-be676b9edba0" status: 200 len: 1520 microversion: 2.1 time: 0.217439 Sep 14 09:18:36.148654 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2814/5661] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:18:35 2022] GET /compute/v2.1/servers/80f0d7ed-260a-4c9d-a13b-be676b9edba0 => generated 1520 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:18:36.860078 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-36c7bc01-1734-4d5c-a4ba-4390b2533031 tempest-VolumesSnapshotsTestJSON-166415185 tempest-VolumesSnapshotsTestJSON-166415185-project] Calling method '.version_select at 0x7f7d3f330670>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:36.916132 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-36c7bc01-1734-4d5c-a4ba-4390b2533031 tempest-VolumesSnapshotsTestJSON-166415185 tempest-VolumesSnapshotsTestJSON-166415185-project] HTTP exception thrown: Volume a6cf1dd5-d147-4bfc-b4ec-faa4a0d8c92e could not be found. Sep 14 09:18:36.918857 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-36c7bc01-1734-4d5c-a4ba-4390b2533031 tempest-VolumesSnapshotsTestJSON-166415185 tempest-VolumesSnapshotsTestJSON-166415185-project] Request method failure captured: Sep 14 09:18:36.918857 n-d-836830-18 devstack@n-api.service[128758]: request: GET /compute/v2.1/os-volumes/a6cf1dd5-d147-4bfc-b4ec-faa4a0d8c92e HTTP/1.1 Sep 14 09:18:36.918857 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 09:18:36.918857 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 09:18:36.918857 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 09:18:36.918857 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 09:18:36.918857 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 09:18:36.918857 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 09:18:36.918857 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 09:18:36.918857 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 09:18:36.918857 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZxec53zcyKZ8MArxz89z44Yu9QlVaJCP-UaRy-4s3IgTEl23g-9xaIN6shpWLF5CYjRilIyM0GwHfFddhwa8vX0UvPdQ9_YPIa6qObzebU32IK4hn9_BjO7Ns06OWMjXG2sssHKr90hU-7iWWTBT8E54ZeRTrs0rRvNoMniLkAr7EE Sep 14 09:18:36.918857 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 09:18:36.918857 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 09:18:36.918857 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 09:18:36.918857 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 09:18:36.918857 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 09:18:36.918857 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 09:18:36.918857 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 052b7297f9bf45a7b1d394b67bceb191 Sep 14 09:18:36.918857 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-166415185 Sep 14 09:18:36.918857 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 09:18:36.918857 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 09:18:36.918857 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/052b7297f9bf45a7b1d394b67bceb191"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_052b7297f9bf45a7b1d394b67bceb191"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/052b7297f9bf45a7b1d394b67bceb191"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/052b7297f9bf45a7b1d394b67bceb191"}]}] Sep 14 09:18:36.918857 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-VolumesSnapshotsTestJSON-166415185 Sep 14 09:18:36.918857 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 052b7297f9bf45a7b1d394b67bceb191 Sep 14 09:18:36.918857 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-166415185 Sep 14 09:18:36.918857 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-VolumesSnapshotsTestJSON-166415185-project Sep 14 09:18:36.918857 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 09:18:36.918857 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 09:18:36.918857 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 5259490602454f029a78f064699b45ee Sep 14 09:18:36.918857 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-VolumesSnapshotsTestJSON-166415185-project Sep 14 09:18:36.918857 n-d-836830-18 devstack@n-api.service[128758]: method: Sep 14 09:18:36.918857 n-d-836830-18 devstack@n-api.service[128758]: exception: Volume a6cf1dd5-d147-4bfc-b4ec-faa4a0d8c92e could not be found. Sep 14 09:18:36.918857 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': 'a6cf1dd5-d147-4bfc-b4ec-faa4a0d8c92e'} Sep 14 09:18:36.918857 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:18:36.918857 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:18:36.918857 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 14 09:18:36.918857 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 14 09:18:36.918857 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 14 09:18:36.918857 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 14 09:18:36.918857 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 14 09:18:36.918857 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 14 09:18:36.918857 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 14 09:18:36.918857 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 14 09:18:36.918857 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 14 09:18:36.918857 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 14 09:18:36.918857 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 14 09:18:36.918857 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 14 09:18:36.918857 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 14 09:18:36.918857 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 14 09:18:36.918857 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a6cf1dd5-d147-4bfc-b4ec-faa4a0d8c92e could not be found. (HTTP 404) (Request-ID: req-88903b8d-12ab-4e44-8282-50bb95a6bc14) Sep 14 09:18:36.918857 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:18:36.918857 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:18:36.918857 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:18:36.918857 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:18:36.918857 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 14 09:18:36.918857 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 14 09:18:36.918857 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 14 09:18:36.918857 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 14 09:18:36.918857 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 14 09:18:36.918857 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 14 09:18:36.918857 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 14 09:18:36.918857 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 14 09:18:36.918857 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 14 09:18:36.923405 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 14 09:18:36.923405 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 14 09:18:36.923405 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 14 09:18:36.923405 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 14 09:18:36.923405 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 14 09:18:36.923405 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 14 09:18:36.923405 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 14 09:18:36.923405 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 14 09:18:36.923405 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 14 09:18:36.923405 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 14 09:18:36.923405 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 14 09:18:36.923405 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 14 09:18:36.923405 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 14 09:18:36.923405 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a6cf1dd5-d147-4bfc-b4ec-faa4a0d8c92e could not be found. Sep 14 09:18:36.923405 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:18:36.923405 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:18:36.923405 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:18:36.923405 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:18:36.923405 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:18:36.923405 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:18:36.923405 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:18:36.923405 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:18:36.923405 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:18:36.923405 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:18:36.923405 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:18:36.923405 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:18:36.923405 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 14 09:18:36.923405 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:18:36.923405 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a6cf1dd5-d147-4bfc-b4ec-faa4a0d8c92e could not be found. Sep 14 09:18:36.923405 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:18:36.923405 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:18:36.923405 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:18:36.923405 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:18:36.923405 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:18:36.923405 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:18:36.923405 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:18:36.923405 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:18:36.923405 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a6cf1dd5-d147-4bfc-b4ec-faa4a0d8c92e could not be found. Sep 14 09:18:36.923405 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:18:36.927431 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-36c7bc01-1734-4d5c-a4ba-4390b2533031 tempest-VolumesSnapshotsTestJSON-166415185 tempest-VolumesSnapshotsTestJSON-166415185-project] Returning 404 to user: Volume a6cf1dd5-d147-4bfc-b4ec-faa4a0d8c92e could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:18:36.928759 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-36c7bc01-1734-4d5c-a4ba-4390b2533031 tempest-VolumesSnapshotsTestJSON-166415185 tempest-VolumesSnapshotsTestJSON-166415185-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/a6cf1dd5-d147-4bfc-b4ec-faa4a0d8c92e" status: 404 len: 109 microversion: 2.1 time: 0.073123 Sep 14 09:18:36.933936 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2848/5662] 10.222.0.60 () {58 vars in 1245 bytes} [Wed Sep 14 09:18:36 2022] GET /compute/v2.1/os-volumes/a6cf1dd5-d147-4bfc-b4ec-faa4a0d8c92e => generated 109 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:18:36.939914 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-68fc12ba-04e9-401d-ba03-2052e3696ab6 tempest-VolumesSnapshotsTestJSON-166415185 tempest-VolumesSnapshotsTestJSON-166415185-project] Calling method '.version_select at 0x7f7d3ee103a0>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:36.988856 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-68fc12ba-04e9-401d-ba03-2052e3696ab6 tempest-VolumesSnapshotsTestJSON-166415185 tempest-VolumesSnapshotsTestJSON-166415185-project] HTTP exception thrown: Volume a6cf1dd5-d147-4bfc-b4ec-faa4a0d8c92e could not be found. Sep 14 09:18:36.991795 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-68fc12ba-04e9-401d-ba03-2052e3696ab6 tempest-VolumesSnapshotsTestJSON-166415185 tempest-VolumesSnapshotsTestJSON-166415185-project] Request method failure captured: Sep 14 09:18:36.991795 n-d-836830-18 devstack@n-api.service[128759]: request: DELETE /compute/v2.1/os-volumes/a6cf1dd5-d147-4bfc-b4ec-faa4a0d8c92e HTTP/1.1 Sep 14 09:18:36.991795 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:18:36.991795 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:18:36.991795 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:18:36.991795 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:18:36.991795 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:18:36.991795 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:18:36.991795 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:18:36.991795 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:18:36.991795 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZxec53zcyKZ8MArxz89z44Yu9QlVaJCP-UaRy-4s3IgTEl23g-9xaIN6shpWLF5CYjRilIyM0GwHfFddhwa8vX0UvPdQ9_YPIa6qObzebU32IK4hn9_BjO7Ns06OWMjXG2sssHKr90hU-7iWWTBT8E54ZeRTrs0rRvNoMniLkAr7EE Sep 14 09:18:36.991795 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:18:36.991795 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:18:36.991795 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:18:36.991795 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:18:36.991795 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:18:36.991795 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:18:36.991795 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 052b7297f9bf45a7b1d394b67bceb191 Sep 14 09:18:36.991795 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-166415185 Sep 14 09:18:36.991795 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:18:36.991795 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:18:36.991795 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/052b7297f9bf45a7b1d394b67bceb191"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_052b7297f9bf45a7b1d394b67bceb191"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/052b7297f9bf45a7b1d394b67bceb191"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/052b7297f9bf45a7b1d394b67bceb191"}]}] Sep 14 09:18:36.991795 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-VolumesSnapshotsTestJSON-166415185 Sep 14 09:18:36.991795 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 052b7297f9bf45a7b1d394b67bceb191 Sep 14 09:18:36.991795 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-166415185 Sep 14 09:18:36.991795 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-VolumesSnapshotsTestJSON-166415185-project Sep 14 09:18:36.991795 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:18:36.991795 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:18:36.991795 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 5259490602454f029a78f064699b45ee Sep 14 09:18:36.991795 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-VolumesSnapshotsTestJSON-166415185-project Sep 14 09:18:36.991795 n-d-836830-18 devstack@n-api.service[128759]: method: Sep 14 09:18:36.991795 n-d-836830-18 devstack@n-api.service[128759]: exception: Volume a6cf1dd5-d147-4bfc-b4ec-faa4a0d8c92e could not be found. Sep 14 09:18:36.991795 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': 'a6cf1dd5-d147-4bfc-b4ec-faa4a0d8c92e'} Sep 14 09:18:36.991795 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:18:36.991795 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:18:36.991795 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 14 09:18:36.991795 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 14 09:18:36.991795 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 14 09:18:36.991795 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 14 09:18:36.991795 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 14 09:18:36.991795 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 14 09:18:36.991795 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 14 09:18:36.991795 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 14 09:18:36.991795 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 14 09:18:36.991795 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 14 09:18:36.991795 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 14 09:18:36.991795 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 14 09:18:36.991795 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 14 09:18:36.991795 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 14 09:18:36.991795 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a6cf1dd5-d147-4bfc-b4ec-faa4a0d8c92e could not be found. (HTTP 404) (Request-ID: req-2eb0393b-ccd8-4799-b8d9-5e2f11314fbf) Sep 14 09:18:36.991795 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:18:36.991795 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:18:36.991795 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:18:36.991795 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:18:36.991795 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 14 09:18:36.991795 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 14 09:18:36.991795 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 14 09:18:36.991795 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 14 09:18:36.991795 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 14 09:18:36.991795 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 14 09:18:36.991795 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 14 09:18:36.991795 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 14 09:18:36.991795 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 14 09:18:36.997584 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 14 09:18:36.997584 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 14 09:18:36.997584 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 14 09:18:36.997584 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 14 09:18:36.997584 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 14 09:18:36.997584 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 14 09:18:36.997584 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 14 09:18:36.997584 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 14 09:18:36.997584 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 14 09:18:36.997584 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 14 09:18:36.997584 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 14 09:18:36.997584 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 14 09:18:36.997584 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 14 09:18:36.997584 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a6cf1dd5-d147-4bfc-b4ec-faa4a0d8c92e could not be found. Sep 14 09:18:36.997584 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:18:36.997584 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:18:36.997584 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:18:36.997584 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:18:36.997584 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:18:36.997584 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:18:36.997584 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:18:36.997584 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:18:36.997584 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:18:36.997584 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:18:36.997584 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:18:36.997584 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:18:36.997584 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 14 09:18:36.997584 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:18:36.997584 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a6cf1dd5-d147-4bfc-b4ec-faa4a0d8c92e could not be found. Sep 14 09:18:36.997584 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:18:36.997584 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:18:36.997584 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:18:36.997584 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:18:36.997584 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:18:36.997584 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:18:36.997584 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:18:36.997584 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:18:36.997584 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a6cf1dd5-d147-4bfc-b4ec-faa4a0d8c92e could not be found. Sep 14 09:18:36.997584 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:18:36.997584 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-68fc12ba-04e9-401d-ba03-2052e3696ab6 tempest-VolumesSnapshotsTestJSON-166415185 tempest-VolumesSnapshotsTestJSON-166415185-project] Returning 404 to user: Volume a6cf1dd5-d147-4bfc-b4ec-faa4a0d8c92e could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:18:36.997584 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-68fc12ba-04e9-401d-ba03-2052e3696ab6 tempest-VolumesSnapshotsTestJSON-166415185 tempest-VolumesSnapshotsTestJSON-166415185-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/a6cf1dd5-d147-4bfc-b4ec-faa4a0d8c92e" status: 404 len: 109 microversion: 2.1 time: 0.057266 Sep 14 09:18:37.006089 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2815/5663] 10.222.0.60 () {58 vars in 1248 bytes} [Wed Sep 14 09:18:36 2022] DELETE /compute/v2.1/os-volumes/a6cf1dd5-d147-4bfc-b4ec-faa4a0d8c92e => generated 109 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:18:37.006415 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-3abaeba7-fc87-4fd1-8acd-f1fb1d866ad9 tempest-VolumesSnapshotsTestJSON-166415185 tempest-VolumesSnapshotsTestJSON-166415185-project] Calling method '.version_select at 0x7f7d3f330160>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:37.064905 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-3abaeba7-fc87-4fd1-8acd-f1fb1d866ad9 tempest-VolumesSnapshotsTestJSON-166415185 tempest-VolumesSnapshotsTestJSON-166415185-project] HTTP exception thrown: Volume a6cf1dd5-d147-4bfc-b4ec-faa4a0d8c92e could not be found. Sep 14 09:18:37.067681 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-3abaeba7-fc87-4fd1-8acd-f1fb1d866ad9 tempest-VolumesSnapshotsTestJSON-166415185 tempest-VolumesSnapshotsTestJSON-166415185-project] Request method failure captured: Sep 14 09:18:37.067681 n-d-836830-18 devstack@n-api.service[128758]: request: GET /compute/v2.1/os-volumes/a6cf1dd5-d147-4bfc-b4ec-faa4a0d8c92e HTTP/1.1 Sep 14 09:18:37.067681 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 09:18:37.067681 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 09:18:37.067681 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 09:18:37.067681 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 09:18:37.067681 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 09:18:37.067681 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 09:18:37.067681 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 09:18:37.067681 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 09:18:37.067681 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZxec53zcyKZ8MArxz89z44Yu9QlVaJCP-UaRy-4s3IgTEl23g-9xaIN6shpWLF5CYjRilIyM0GwHfFddhwa8vX0UvPdQ9_YPIa6qObzebU32IK4hn9_BjO7Ns06OWMjXG2sssHKr90hU-7iWWTBT8E54ZeRTrs0rRvNoMniLkAr7EE Sep 14 09:18:37.067681 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 09:18:37.067681 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 09:18:37.067681 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 09:18:37.067681 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 09:18:37.067681 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 09:18:37.067681 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 09:18:37.067681 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 052b7297f9bf45a7b1d394b67bceb191 Sep 14 09:18:37.067681 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-166415185 Sep 14 09:18:37.067681 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 09:18:37.067681 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 09:18:37.067681 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/052b7297f9bf45a7b1d394b67bceb191"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_052b7297f9bf45a7b1d394b67bceb191"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/052b7297f9bf45a7b1d394b67bceb191"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/052b7297f9bf45a7b1d394b67bceb191"}]}] Sep 14 09:18:37.067681 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-VolumesSnapshotsTestJSON-166415185 Sep 14 09:18:37.067681 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 052b7297f9bf45a7b1d394b67bceb191 Sep 14 09:18:37.067681 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-166415185 Sep 14 09:18:37.067681 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-VolumesSnapshotsTestJSON-166415185-project Sep 14 09:18:37.067681 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 09:18:37.067681 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 09:18:37.067681 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 5259490602454f029a78f064699b45ee Sep 14 09:18:37.067681 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-VolumesSnapshotsTestJSON-166415185-project Sep 14 09:18:37.067681 n-d-836830-18 devstack@n-api.service[128758]: method: Sep 14 09:18:37.067681 n-d-836830-18 devstack@n-api.service[128758]: exception: Volume a6cf1dd5-d147-4bfc-b4ec-faa4a0d8c92e could not be found. Sep 14 09:18:37.067681 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': 'a6cf1dd5-d147-4bfc-b4ec-faa4a0d8c92e'} Sep 14 09:18:37.067681 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:18:37.067681 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:18:37.067681 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 14 09:18:37.067681 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 14 09:18:37.067681 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 14 09:18:37.067681 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 14 09:18:37.067681 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 14 09:18:37.067681 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 14 09:18:37.067681 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 14 09:18:37.067681 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 14 09:18:37.067681 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 14 09:18:37.067681 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 14 09:18:37.067681 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 14 09:18:37.067681 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 14 09:18:37.067681 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 14 09:18:37.067681 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 14 09:18:37.067681 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a6cf1dd5-d147-4bfc-b4ec-faa4a0d8c92e could not be found. (HTTP 404) (Request-ID: req-91b1168b-8745-4fde-bb40-fea151e38ca3) Sep 14 09:18:37.067681 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:18:37.067681 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:18:37.067681 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:18:37.067681 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:18:37.067681 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 14 09:18:37.067681 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 14 09:18:37.067681 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 14 09:18:37.067681 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 14 09:18:37.067681 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 14 09:18:37.067681 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 14 09:18:37.067681 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 14 09:18:37.067681 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 14 09:18:37.067681 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 14 09:18:37.073034 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 14 09:18:37.073034 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 14 09:18:37.073034 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 14 09:18:37.073034 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 14 09:18:37.073034 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 14 09:18:37.073034 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 14 09:18:37.073034 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 14 09:18:37.073034 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 14 09:18:37.073034 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 14 09:18:37.073034 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 14 09:18:37.073034 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 14 09:18:37.073034 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 14 09:18:37.073034 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 14 09:18:37.073034 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a6cf1dd5-d147-4bfc-b4ec-faa4a0d8c92e could not be found. Sep 14 09:18:37.073034 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:18:37.073034 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:18:37.073034 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:18:37.073034 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:18:37.073034 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:18:37.073034 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:18:37.073034 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:18:37.073034 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:18:37.073034 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:18:37.073034 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:18:37.073034 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:18:37.073034 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:18:37.073034 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 14 09:18:37.073034 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:18:37.073034 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a6cf1dd5-d147-4bfc-b4ec-faa4a0d8c92e could not be found. Sep 14 09:18:37.073034 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:18:37.073034 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:18:37.073034 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:18:37.073034 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:18:37.073034 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:18:37.073034 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:18:37.073034 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:18:37.073034 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:18:37.073034 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a6cf1dd5-d147-4bfc-b4ec-faa4a0d8c92e could not be found. Sep 14 09:18:37.073034 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:18:37.073034 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-3abaeba7-fc87-4fd1-8acd-f1fb1d866ad9 tempest-VolumesSnapshotsTestJSON-166415185 tempest-VolumesSnapshotsTestJSON-166415185-project] Returning 404 to user: Volume a6cf1dd5-d147-4bfc-b4ec-faa4a0d8c92e could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:18:37.073034 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-3abaeba7-fc87-4fd1-8acd-f1fb1d866ad9 tempest-VolumesSnapshotsTestJSON-166415185 tempest-VolumesSnapshotsTestJSON-166415185-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/a6cf1dd5-d147-4bfc-b4ec-faa4a0d8c92e" status: 404 len: 109 microversion: 2.1 time: 0.070539 Sep 14 09:18:37.073034 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2849/5664] 10.222.0.60 () {58 vars in 1245 bytes} [Wed Sep 14 09:18:36 2022] GET /compute/v2.1/os-volumes/a6cf1dd5-d147-4bfc-b4ec-faa4a0d8c92e => generated 109 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:18:37.169527 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-43c4d8f7-c7a1-4774-a1ea-2e35ce083211 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:37.170997 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-43c4d8f7-c7a1-4774-a1ea-2e35ce083211 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 80f0d7ed-260a-4c9d-a13b-be676b9edba0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:37.181716 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-43c4d8f7-c7a1-4774-a1ea-2e35ce083211 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:37.182234 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-43c4d8f7-c7a1-4774-a1ea-2e35ce083211 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:37.189451 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-43c4d8f7-c7a1-4774-a1ea-2e35ce083211 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:37.190482 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-43c4d8f7-c7a1-4774-a1ea-2e35ce083211 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:37.191165 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-43c4d8f7-c7a1-4774-a1ea-2e35ce083211 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:37.192396 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-43c4d8f7-c7a1-4774-a1ea-2e35ce083211 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:37.975412 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-43c4d8f7-c7a1-4774-a1ea-2e35ce083211 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03dc827647f4483beb2e1b7888be608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229e11b3c1fe48b088d0f3c4bb7e2cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:37.994089 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-43c4d8f7-c7a1-4774-a1ea-2e35ce083211 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "GET /compute/v2.1/servers/80f0d7ed-260a-4c9d-a13b-be676b9edba0" status: 200 len: 1520 microversion: 2.1 time: 0.828212 Sep 14 09:18:37.995067 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2816/5665] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:18:37 2022] GET /compute/v2.1/servers/80f0d7ed-260a-4c9d-a13b-be676b9edba0 => generated 1520 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:18:39.027980 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-effda0ea-75cb-4334-9303-867f40e64e8c tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:39.028643 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-effda0ea-75cb-4334-9303-867f40e64e8c tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 80f0d7ed-260a-4c9d-a13b-be676b9edba0] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:39.035767 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-effda0ea-75cb-4334-9303-867f40e64e8c tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:39.036964 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-effda0ea-75cb-4334-9303-867f40e64e8c tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:39.037547 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-effda0ea-75cb-4334-9303-867f40e64e8c tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:39.038624 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-effda0ea-75cb-4334-9303-867f40e64e8c tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:39.039127 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-effda0ea-75cb-4334-9303-867f40e64e8c tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:39.039564 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-effda0ea-75cb-4334-9303-867f40e64e8c tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:39.555944 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-effda0ea-75cb-4334-9303-867f40e64e8c tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03dc827647f4483beb2e1b7888be608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229e11b3c1fe48b088d0f3c4bb7e2cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:39.575687 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-effda0ea-75cb-4334-9303-867f40e64e8c tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "GET /compute/v2.1/servers/80f0d7ed-260a-4c9d-a13b-be676b9edba0" status: 200 len: 1520 microversion: 2.1 time: 0.557130 Sep 14 09:18:39.602163 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2850/5666] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:18:39 2022] GET /compute/v2.1/servers/80f0d7ed-260a-4c9d-a13b-be676b9edba0 => generated 1520 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:18:40.609928 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-64826c18-435d-4c75-a0ed-e2be0b9bee73 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:40.610559 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-64826c18-435d-4c75-a0ed-e2be0b9bee73 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 80f0d7ed-260a-4c9d-a13b-be676b9edba0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:40.613751 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=3,nova_api:DELETE=2 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:18:40.626177 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-64826c18-435d-4c75-a0ed-e2be0b9bee73 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:40.628093 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-64826c18-435d-4c75-a0ed-e2be0b9bee73 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:40.631997 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-64826c18-435d-4c75-a0ed-e2be0b9bee73 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:40.632859 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-64826c18-435d-4c75-a0ed-e2be0b9bee73 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:40.633447 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-64826c18-435d-4c75-a0ed-e2be0b9bee73 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:40.633991 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-64826c18-435d-4c75-a0ed-e2be0b9bee73 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:41.072736 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-64826c18-435d-4c75-a0ed-e2be0b9bee73 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03dc827647f4483beb2e1b7888be608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229e11b3c1fe48b088d0f3c4bb7e2cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:41.090134 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-64826c18-435d-4c75-a0ed-e2be0b9bee73 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "GET /compute/v2.1/servers/80f0d7ed-260a-4c9d-a13b-be676b9edba0" status: 200 len: 1520 microversion: 2.1 time: 0.483252 Sep 14 09:18:41.090750 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2817/5667] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:18:40 2022] GET /compute/v2.1/servers/80f0d7ed-260a-4c9d-a13b-be676b9edba0 => generated 1520 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:18:41.433923 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-e7b3f90b-c684-4487-8cf5-833ec4124aaf tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-1901318850", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "networks": [{"uuid": "f1675bba-2a4e-439f-95c1-ce5473a77372"}]}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:18:41.501757 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.network.neutron [None req-e7b3f90b-c684-4487-8cf5-833ec4124aaf tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] validate_networks() for [('f1675bba-2a4e-439f-95c1-ce5473a77372', None, None, None, None, None)] {{(pid=128758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:18:42.009585 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-e7b3f90b-c684-4487-8cf5-833ec4124aaf tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Flavor limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:18:42.010359 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-e7b3f90b-c684-4487-8cf5-833ec4124aaf tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Image limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:18:42.012147 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-e7b3f90b-c684-4487-8cf5-833ec4124aaf tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Flavor pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:18:42.012944 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-e7b3f90b-c684-4487-8cf5-833ec4124aaf tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Image pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:18:42.013535 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-e7b3f90b-c684-4487-8cf5-833ec4124aaf tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:18:42.024223 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e7b3f90b-c684-4487-8cf5-833ec4124aaf tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:42.025946 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e7b3f90b-c684-4487-8cf5-833ec4124aaf tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:42.026924 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e7b3f90b-c684-4487-8cf5-833ec4124aaf tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:42.028255 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e7b3f90b-c684-4487-8cf5-833ec4124aaf tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:42.028909 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e7b3f90b-c684-4487-8cf5-833ec4124aaf tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:42.029747 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e7b3f90b-c684-4487-8cf5-833ec4124aaf tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:42.053682 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-e7b3f90b-c684-4487-8cf5-833ec4124aaf tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Getting quotas for project 17da1bc0ed09449aa10d4a4ff9117f6d. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:18:42.059305 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-e7b3f90b-c684-4487-8cf5-833ec4124aaf tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Getting quotas for user c3cf41bb7d024a8c86a385ac47561b8c and project 17da1bc0ed09449aa10d4a4ff9117f6d. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:18:42.076735 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-e7b3f90b-c684-4487-8cf5-833ec4124aaf tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Going to run 1 instances... {{(pid=128758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:18:42.079297 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-e7b3f90b-c684-4487-8cf5-833ec4124aaf tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] [instance: 8b671025-214d-4349-9b4a-4f23fa069ae5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:18:42.117662 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-40e72699-0154-4b30-9814-99d4bce50821 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:42.120007 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-40e72699-0154-4b30-9814-99d4bce50821 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 80f0d7ed-260a-4c9d-a13b-be676b9edba0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:42.140124 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-40e72699-0154-4b30-9814-99d4bce50821 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:42.142865 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-40e72699-0154-4b30-9814-99d4bce50821 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:42.143549 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-40e72699-0154-4b30-9814-99d4bce50821 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:42.149466 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-40e72699-0154-4b30-9814-99d4bce50821 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:42.150140 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-40e72699-0154-4b30-9814-99d4bce50821 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:42.150747 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-40e72699-0154-4b30-9814-99d4bce50821 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:42.216785 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-e7b3f90b-c684-4487-8cf5-833ec4124aaf tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.095503 Sep 14 09:18:42.217612 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2851/5668] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 09:18:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1097 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:18:42.228873 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-991adb32-b532-4117-9e16-8643c9eea2a6 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:42.229505 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-991adb32-b532-4117-9e16-8643c9eea2a6 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] [instance: 8b671025-214d-4349-9b4a-4f23fa069ae5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:42.305119 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-991adb32-b532-4117-9e16-8643c9eea2a6 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf41bb7d024a8c86a385ac47561b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17da1bc0ed09449aa10d4a4ff9117f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:42.313751 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-991adb32-b532-4117-9e16-8643c9eea2a6 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] 10.222.0.60 "GET /compute/v2.1/servers/8b671025-214d-4349-9b4a-4f23fa069ae5" status: 200 len: 1215 microversion: 2.1 time: 0.087894 Sep 14 09:18:42.315230 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2852/5669] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:18:42 2022] GET /compute/v2.1/servers/8b671025-214d-4349-9b4a-4f23fa069ae5 => generated 1215 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:18:42.425434 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-40e72699-0154-4b30-9814-99d4bce50821 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03dc827647f4483beb2e1b7888be608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229e11b3c1fe48b088d0f3c4bb7e2cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:42.436380 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-40e72699-0154-4b30-9814-99d4bce50821 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "GET /compute/v2.1/servers/80f0d7ed-260a-4c9d-a13b-be676b9edba0" status: 200 len: 1520 microversion: 2.1 time: 0.324592 Sep 14 09:18:42.436978 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2818/5670] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:18:42 2022] GET /compute/v2.1/servers/80f0d7ed-260a-4c9d-a13b-be676b9edba0 => generated 1520 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:18:43.341826 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-9e4f8640-3412-4a1f-9fb6-31ffd6257882 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:43.343739 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-9e4f8640-3412-4a1f-9fb6-31ffd6257882 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] [instance: 8b671025-214d-4349-9b4a-4f23fa069ae5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:43.357565 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9e4f8640-3412-4a1f-9fb6-31ffd6257882 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:43.358361 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9e4f8640-3412-4a1f-9fb6-31ffd6257882 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:43.358810 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9e4f8640-3412-4a1f-9fb6-31ffd6257882 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:43.359581 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9e4f8640-3412-4a1f-9fb6-31ffd6257882 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:43.360075 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9e4f8640-3412-4a1f-9fb6-31ffd6257882 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:43.360822 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9e4f8640-3412-4a1f-9fb6-31ffd6257882 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:43.462691 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b2c18160-b981-4313-952c-5c6478f2e8c7 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:43.463957 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b2c18160-b981-4313-952c-5c6478f2e8c7 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 80f0d7ed-260a-4c9d-a13b-be676b9edba0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:43.465503 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-9e4f8640-3412-4a1f-9fb6-31ffd6257882 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf41bb7d024a8c86a385ac47561b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17da1bc0ed09449aa10d4a4ff9117f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:43.474527 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b2c18160-b981-4313-952c-5c6478f2e8c7 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:43.475147 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-9e4f8640-3412-4a1f-9fb6-31ffd6257882 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] 10.222.0.60 "GET /compute/v2.1/servers/8b671025-214d-4349-9b4a-4f23fa069ae5" status: 200 len: 1267 microversion: 2.1 time: 0.138456 Sep 14 09:18:43.475831 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b2c18160-b981-4313-952c-5c6478f2e8c7 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:43.487386 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2853/5671] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:18:43 2022] GET /compute/v2.1/servers/8b671025-214d-4349-9b4a-4f23fa069ae5 => generated 1267 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:18:43.489159 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b2c18160-b981-4313-952c-5c6478f2e8c7 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:43.494902 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b2c18160-b981-4313-952c-5c6478f2e8c7 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:43.495614 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b2c18160-b981-4313-952c-5c6478f2e8c7 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:43.496220 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b2c18160-b981-4313-952c-5c6478f2e8c7 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:43.724872 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b2c18160-b981-4313-952c-5c6478f2e8c7 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03dc827647f4483beb2e1b7888be608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229e11b3c1fe48b088d0f3c4bb7e2cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:43.738981 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b2c18160-b981-4313-952c-5c6478f2e8c7 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "GET /compute/v2.1/servers/80f0d7ed-260a-4c9d-a13b-be676b9edba0" status: 200 len: 1520 microversion: 2.1 time: 0.282253 Sep 14 09:18:43.740766 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2819/5672] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:18:43 2022] GET /compute/v2.1/servers/80f0d7ed-260a-4c9d-a13b-be676b9edba0 => generated 1520 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:18:44.511370 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-80617f2a-62d5-4077-8126-d33908dcd840 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:44.513853 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-80617f2a-62d5-4077-8126-d33908dcd840 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] [instance: 8b671025-214d-4349-9b4a-4f23fa069ae5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:44.524444 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-80617f2a-62d5-4077-8126-d33908dcd840 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:44.525315 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-80617f2a-62d5-4077-8126-d33908dcd840 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:44.526087 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-80617f2a-62d5-4077-8126-d33908dcd840 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:44.526897 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-80617f2a-62d5-4077-8126-d33908dcd840 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:44.527698 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-80617f2a-62d5-4077-8126-d33908dcd840 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:44.528202 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-80617f2a-62d5-4077-8126-d33908dcd840 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:44.654928 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-80617f2a-62d5-4077-8126-d33908dcd840 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf41bb7d024a8c86a385ac47561b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17da1bc0ed09449aa10d4a4ff9117f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:44.677989 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-80617f2a-62d5-4077-8126-d33908dcd840 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] 10.222.0.60 "GET /compute/v2.1/servers/8b671025-214d-4349-9b4a-4f23fa069ae5" status: 200 len: 1273 microversion: 2.1 time: 0.179056 Sep 14 09:18:44.678984 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2854/5673] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:18:44 2022] GET /compute/v2.1/servers/8b671025-214d-4349-9b4a-4f23fa069ae5 => generated 1273 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:18:44.766408 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-170009c8-2b5a-4e45-8d39-14937eafce74 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:44.767256 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-170009c8-2b5a-4e45-8d39-14937eafce74 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 80f0d7ed-260a-4c9d-a13b-be676b9edba0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:44.786997 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-170009c8-2b5a-4e45-8d39-14937eafce74 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:44.789642 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-170009c8-2b5a-4e45-8d39-14937eafce74 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:44.790211 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-170009c8-2b5a-4e45-8d39-14937eafce74 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:44.791091 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-170009c8-2b5a-4e45-8d39-14937eafce74 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:44.793127 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-170009c8-2b5a-4e45-8d39-14937eafce74 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:44.794208 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-170009c8-2b5a-4e45-8d39-14937eafce74 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:45.141537 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-170009c8-2b5a-4e45-8d39-14937eafce74 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03dc827647f4483beb2e1b7888be608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229e11b3c1fe48b088d0f3c4bb7e2cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:45.159243 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-170009c8-2b5a-4e45-8d39-14937eafce74 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "GET /compute/v2.1/servers/80f0d7ed-260a-4c9d-a13b-be676b9edba0" status: 200 len: 1520 microversion: 2.1 time: 0.398307 Sep 14 09:18:45.183822 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2820/5674] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:18:44 2022] GET /compute/v2.1/servers/80f0d7ed-260a-4c9d-a13b-be676b9edba0 => generated 1520 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:18:45.702983 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-4024b4b1-4117-440e-9861-f52653feb135 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:45.703685 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-4024b4b1-4117-440e-9861-f52653feb135 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] [instance: 8b671025-214d-4349-9b4a-4f23fa069ae5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:45.724400 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4024b4b1-4117-440e-9861-f52653feb135 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:45.726083 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4024b4b1-4117-440e-9861-f52653feb135 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:45.728222 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4024b4b1-4117-440e-9861-f52653feb135 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:45.732281 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4024b4b1-4117-440e-9861-f52653feb135 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:45.736561 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4024b4b1-4117-440e-9861-f52653feb135 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:45.736561 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4024b4b1-4117-440e-9861-f52653feb135 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:46.190309 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d22a5388-9757-47c0-b604-e07d821a339f tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:46.192467 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-d22a5388-9757-47c0-b604-e07d821a339f tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 80f0d7ed-260a-4c9d-a13b-be676b9edba0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:46.210060 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d22a5388-9757-47c0-b604-e07d821a339f tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:46.211224 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d22a5388-9757-47c0-b604-e07d821a339f tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:46.212385 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d22a5388-9757-47c0-b604-e07d821a339f tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:46.215488 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d22a5388-9757-47c0-b604-e07d821a339f tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:46.216226 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d22a5388-9757-47c0-b604-e07d821a339f tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:46.219766 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d22a5388-9757-47c0-b604-e07d821a339f tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:46.704602 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-4024b4b1-4117-440e-9861-f52653feb135 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf41bb7d024a8c86a385ac47561b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17da1bc0ed09449aa10d4a4ff9117f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:46.716620 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-4024b4b1-4117-440e-9861-f52653feb135 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] 10.222.0.60 "GET /compute/v2.1/servers/8b671025-214d-4349-9b4a-4f23fa069ae5" status: 200 len: 1315 microversion: 2.1 time: 1.019130 Sep 14 09:18:46.717220 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2855/5675] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:18:45 2022] GET /compute/v2.1/servers/8b671025-214d-4349-9b4a-4f23fa069ae5 => generated 1315 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:18:46.893285 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-d22a5388-9757-47c0-b604-e07d821a339f tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03dc827647f4483beb2e1b7888be608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229e11b3c1fe48b088d0f3c4bb7e2cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:46.905368 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d22a5388-9757-47c0-b604-e07d821a339f tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "GET /compute/v2.1/servers/80f0d7ed-260a-4c9d-a13b-be676b9edba0" status: 200 len: 1520 microversion: 2.1 time: 0.719722 Sep 14 09:18:46.907037 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2821/5676] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:18:46 2022] GET /compute/v2.1/servers/80f0d7ed-260a-4c9d-a13b-be676b9edba0 => generated 1520 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:18:47.326293 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-58e8da04-3bc7-410d-aef7-a6613551db34 req-93d31a0e-aa4a-43e7-a0a7-5273231b999f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b671025-214d-4349-9b4a-4f23fa069ae5", "tag": "6bf6b9a2-d16b-44fb-a0f4-26bda7b1d8fc"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:18:47.370338 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-58e8da04-3bc7-410d-aef7-a6613551db34 req-93d31a0e-aa4a-43e7-a0a7-5273231b999f service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:47.370839 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-58e8da04-3bc7-410d-aef7-a6613551db34 req-93d31a0e-aa4a-43e7-a0a7-5273231b999f service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:47.381209 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-58e8da04-3bc7-410d-aef7-a6613551db34 req-93d31a0e-aa4a-43e7-a0a7-5273231b999f service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:47.412076 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-58e8da04-3bc7-410d-aef7-a6613551db34 req-93d31a0e-aa4a-43e7-a0a7-5273231b999f service nova] Creating event network-changed:6bf6b9a2-d16b-44fb-a0f4-26bda7b1d8fc for instance 8b671025-214d-4349-9b4a-4f23fa069ae5 on n-h2-836830-18 Sep 14 09:18:47.423122 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-58e8da04-3bc7-410d-aef7-a6613551db34 req-93d31a0e-aa4a-43e7-a0a7-5273231b999f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097670 Sep 14 09:18:47.424410 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2856/5677] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:18:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:18:47.766841 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-edb2a58d-ed7f-48cb-a94d-f3f605eafe70 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:47.767512 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-edb2a58d-ed7f-48cb-a94d-f3f605eafe70 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] [instance: 8b671025-214d-4349-9b4a-4f23fa069ae5] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:47.783779 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-edb2a58d-ed7f-48cb-a94d-f3f605eafe70 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:47.784525 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-edb2a58d-ed7f-48cb-a94d-f3f605eafe70 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:47.785630 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-edb2a58d-ed7f-48cb-a94d-f3f605eafe70 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:47.790811 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-edb2a58d-ed7f-48cb-a94d-f3f605eafe70 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:47.791347 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-edb2a58d-ed7f-48cb-a94d-f3f605eafe70 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:47.793128 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-edb2a58d-ed7f-48cb-a94d-f3f605eafe70 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:47.934194 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-caa55f79-0aea-4809-a7b9-f46997c50d84 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:47.935093 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-caa55f79-0aea-4809-a7b9-f46997c50d84 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 80f0d7ed-260a-4c9d-a13b-be676b9edba0] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:47.944707 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-caa55f79-0aea-4809-a7b9-f46997c50d84 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:47.947257 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-caa55f79-0aea-4809-a7b9-f46997c50d84 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:47.949374 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-caa55f79-0aea-4809-a7b9-f46997c50d84 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:47.950541 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-caa55f79-0aea-4809-a7b9-f46997c50d84 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:47.951510 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-caa55f79-0aea-4809-a7b9-f46997c50d84 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:47.953529 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-caa55f79-0aea-4809-a7b9-f46997c50d84 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:48.377604 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-caa55f79-0aea-4809-a7b9-f46997c50d84 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03dc827647f4483beb2e1b7888be608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229e11b3c1fe48b088d0f3c4bb7e2cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:48.396119 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-caa55f79-0aea-4809-a7b9-f46997c50d84 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "GET /compute/v2.1/servers/80f0d7ed-260a-4c9d-a13b-be676b9edba0" status: 200 len: 1520 microversion: 2.1 time: 0.467033 Sep 14 09:18:48.398984 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-edb2a58d-ed7f-48cb-a94d-f3f605eafe70 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf41bb7d024a8c86a385ac47561b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17da1bc0ed09449aa10d4a4ff9117f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:48.412409 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2857/5678] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:18:47 2022] GET /compute/v2.1/servers/80f0d7ed-260a-4c9d-a13b-be676b9edba0 => generated 1520 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:18:48.413174 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-edb2a58d-ed7f-48cb-a94d-f3f605eafe70 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] 10.222.0.60 "GET /compute/v2.1/servers/8b671025-214d-4349-9b4a-4f23fa069ae5" status: 200 len: 1315 microversion: 2.1 time: 0.674355 Sep 14 09:18:48.414923 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2822/5679] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:18:47 2022] GET /compute/v2.1/servers/8b671025-214d-4349-9b4a-4f23fa069ae5 => generated 1315 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:18:49.423208 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-18f6a4b8-4a30-40ba-8dc6-064a12f64ba5 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:49.423974 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-18f6a4b8-4a30-40ba-8dc6-064a12f64ba5 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 80f0d7ed-260a-4c9d-a13b-be676b9edba0] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:49.436366 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-18f6a4b8-4a30-40ba-8dc6-064a12f64ba5 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:49.438746 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-18f6a4b8-4a30-40ba-8dc6-064a12f64ba5 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:49.440236 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-18f6a4b8-4a30-40ba-8dc6-064a12f64ba5 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:49.440659 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-bf330cb3-5851-429e-989e-7e86daee2835 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:49.441976 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-18f6a4b8-4a30-40ba-8dc6-064a12f64ba5 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:49.442523 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-bf330cb3-5851-429e-989e-7e86daee2835 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] [instance: 8b671025-214d-4349-9b4a-4f23fa069ae5] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:49.443752 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-18f6a4b8-4a30-40ba-8dc6-064a12f64ba5 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:49.445293 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-18f6a4b8-4a30-40ba-8dc6-064a12f64ba5 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:49.457575 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bf330cb3-5851-429e-989e-7e86daee2835 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:49.458094 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bf330cb3-5851-429e-989e-7e86daee2835 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:49.458971 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bf330cb3-5851-429e-989e-7e86daee2835 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:49.461131 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bf330cb3-5851-429e-989e-7e86daee2835 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:49.462057 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bf330cb3-5851-429e-989e-7e86daee2835 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:49.462506 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bf330cb3-5851-429e-989e-7e86daee2835 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:49.787306 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-bf330cb3-5851-429e-989e-7e86daee2835 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf41bb7d024a8c86a385ac47561b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17da1bc0ed09449aa10d4a4ff9117f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:49.803652 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-bf330cb3-5851-429e-989e-7e86daee2835 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] 10.222.0.60 "GET /compute/v2.1/servers/8b671025-214d-4349-9b4a-4f23fa069ae5" status: 200 len: 1315 microversion: 2.1 time: 0.361457 Sep 14 09:18:49.804320 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2823/5680] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:18:49 2022] GET /compute/v2.1/servers/8b671025-214d-4349-9b4a-4f23fa069ae5 => generated 1315 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:18:49.814823 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-18f6a4b8-4a30-40ba-8dc6-064a12f64ba5 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03dc827647f4483beb2e1b7888be608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229e11b3c1fe48b088d0f3c4bb7e2cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:49.831434 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-18f6a4b8-4a30-40ba-8dc6-064a12f64ba5 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "GET /compute/v2.1/servers/80f0d7ed-260a-4c9d-a13b-be676b9edba0" status: 200 len: 1520 microversion: 2.1 time: 0.412226 Sep 14 09:18:49.854303 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2858/5681] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:18:49 2022] GET /compute/v2.1/servers/80f0d7ed-260a-4c9d-a13b-be676b9edba0 => generated 1520 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:18:50.835569 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e19ff08e-9c02-44fe-8c2d-cbc7a5ac0fe2 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:50.836874 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e19ff08e-9c02-44fe-8c2d-cbc7a5ac0fe2 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] [instance: 8b671025-214d-4349-9b4a-4f23fa069ae5] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:50.855180 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e19ff08e-9c02-44fe-8c2d-cbc7a5ac0fe2 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:50.857416 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e19ff08e-9c02-44fe-8c2d-cbc7a5ac0fe2 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:50.859620 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e19ff08e-9c02-44fe-8c2d-cbc7a5ac0fe2 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:50.860385 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e19ff08e-9c02-44fe-8c2d-cbc7a5ac0fe2 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:50.861331 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-5d94d1df-75f5-4d00-9c60-9136a905d4f1 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:50.862269 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-5d94d1df-75f5-4d00-9c60-9136a905d4f1 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 80f0d7ed-260a-4c9d-a13b-be676b9edba0] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:50.863859 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e19ff08e-9c02-44fe-8c2d-cbc7a5ac0fe2 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:50.864372 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e19ff08e-9c02-44fe-8c2d-cbc7a5ac0fe2 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:50.870202 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5d94d1df-75f5-4d00-9c60-9136a905d4f1 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:50.870728 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5d94d1df-75f5-4d00-9c60-9136a905d4f1 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:50.871198 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5d94d1df-75f5-4d00-9c60-9136a905d4f1 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:50.871906 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5d94d1df-75f5-4d00-9c60-9136a905d4f1 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:50.872384 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5d94d1df-75f5-4d00-9c60-9136a905d4f1 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:50.872842 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5d94d1df-75f5-4d00-9c60-9136a905d4f1 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:51.248399 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-e19ff08e-9c02-44fe-8c2d-cbc7a5ac0fe2 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf41bb7d024a8c86a385ac47561b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17da1bc0ed09449aa10d4a4ff9117f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:51.262968 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e19ff08e-9c02-44fe-8c2d-cbc7a5ac0fe2 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] 10.222.0.60 "GET /compute/v2.1/servers/8b671025-214d-4349-9b4a-4f23fa069ae5" status: 200 len: 1315 microversion: 2.1 time: 0.433296 Sep 14 09:18:51.266536 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2824/5682] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:18:50 2022] GET /compute/v2.1/servers/8b671025-214d-4349-9b4a-4f23fa069ae5 => generated 1315 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:18:51.333452 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-5d94d1df-75f5-4d00-9c60-9136a905d4f1 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03dc827647f4483beb2e1b7888be608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229e11b3c1fe48b088d0f3c4bb7e2cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:51.386118 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-5d94d1df-75f5-4d00-9c60-9136a905d4f1 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "GET /compute/v2.1/servers/80f0d7ed-260a-4c9d-a13b-be676b9edba0" status: 200 len: 1520 microversion: 2.1 time: 0.529516 Sep 14 09:18:51.391107 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2859/5683] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:18:50 2022] GET /compute/v2.1/servers/80f0d7ed-260a-4c9d-a13b-be676b9edba0 => generated 1520 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:18:52.320176 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d162687d-4cbf-47ba-acf8-6d3cf6f9ac1f tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:52.320805 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-d162687d-4cbf-47ba-acf8-6d3cf6f9ac1f tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] [instance: 8b671025-214d-4349-9b4a-4f23fa069ae5] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:52.329541 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d162687d-4cbf-47ba-acf8-6d3cf6f9ac1f tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:52.330044 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d162687d-4cbf-47ba-acf8-6d3cf6f9ac1f tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:52.335487 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d162687d-4cbf-47ba-acf8-6d3cf6f9ac1f tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:52.336433 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d162687d-4cbf-47ba-acf8-6d3cf6f9ac1f tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:52.337075 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d162687d-4cbf-47ba-acf8-6d3cf6f9ac1f tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:52.339152 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d162687d-4cbf-47ba-acf8-6d3cf6f9ac1f tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:52.415251 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-06c5a379-de2c-4979-9aa2-1236de52bc65 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:52.417276 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-06c5a379-de2c-4979-9aa2-1236de52bc65 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 80f0d7ed-260a-4c9d-a13b-be676b9edba0] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:52.420823 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=2 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:18:52.422457 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=8 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:18:52.445907 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-06c5a379-de2c-4979-9aa2-1236de52bc65 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:52.456956 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-06c5a379-de2c-4979-9aa2-1236de52bc65 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:52.459898 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-06c5a379-de2c-4979-9aa2-1236de52bc65 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:52.460858 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-06c5a379-de2c-4979-9aa2-1236de52bc65 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:52.461499 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-06c5a379-de2c-4979-9aa2-1236de52bc65 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:52.462097 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-06c5a379-de2c-4979-9aa2-1236de52bc65 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:52.616017 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-d162687d-4cbf-47ba-acf8-6d3cf6f9ac1f tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf41bb7d024a8c86a385ac47561b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17da1bc0ed09449aa10d4a4ff9117f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:52.626100 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d162687d-4cbf-47ba-acf8-6d3cf6f9ac1f tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] 10.222.0.60 "GET /compute/v2.1/servers/8b671025-214d-4349-9b4a-4f23fa069ae5" status: 200 len: 1315 microversion: 2.1 time: 0.310492 Sep 14 09:18:52.656098 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2825/5684] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:18:52 2022] GET /compute/v2.1/servers/8b671025-214d-4349-9b4a-4f23fa069ae5 => generated 1315 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:18:52.793685 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-06c5a379-de2c-4979-9aa2-1236de52bc65 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03dc827647f4483beb2e1b7888be608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229e11b3c1fe48b088d0f3c4bb7e2cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:52.808876 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-06c5a379-de2c-4979-9aa2-1236de52bc65 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "GET /compute/v2.1/servers/80f0d7ed-260a-4c9d-a13b-be676b9edba0" status: 200 len: 1520 microversion: 2.1 time: 0.397496 Sep 14 09:18:52.809738 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2860/5685] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:18:52 2022] GET /compute/v2.1/servers/80f0d7ed-260a-4c9d-a13b-be676b9edba0 => generated 1520 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:18:53.667919 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-95f3eddc-3919-4f02-8842-74f676d311ad tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:53.668658 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-95f3eddc-3919-4f02-8842-74f676d311ad tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] [instance: 8b671025-214d-4349-9b4a-4f23fa069ae5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:53.680433 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-95f3eddc-3919-4f02-8842-74f676d311ad tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:53.680952 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-95f3eddc-3919-4f02-8842-74f676d311ad tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:53.681432 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-95f3eddc-3919-4f02-8842-74f676d311ad tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:53.682125 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-95f3eddc-3919-4f02-8842-74f676d311ad tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:53.682589 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-95f3eddc-3919-4f02-8842-74f676d311ad tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:53.683051 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-95f3eddc-3919-4f02-8842-74f676d311ad tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:53.994193 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-95f3eddc-3919-4f02-8842-74f676d311ad tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf41bb7d024a8c86a385ac47561b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17da1bc0ed09449aa10d4a4ff9117f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:54.003857 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-95f3eddc-3919-4f02-8842-74f676d311ad tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] 10.222.0.60 "GET /compute/v2.1/servers/8b671025-214d-4349-9b4a-4f23fa069ae5" status: 200 len: 1315 microversion: 2.1 time: 0.340145 Sep 14 09:18:54.028238 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2861/5686] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:18:53 2022] GET /compute/v2.1/servers/8b671025-214d-4349-9b4a-4f23fa069ae5 => generated 1315 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:18:54.036092 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ebabf9d5-eec9-4a18-becb-e7c4b8b0e65b tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:54.038348 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-ebabf9d5-eec9-4a18-becb-e7c4b8b0e65b tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 80f0d7ed-260a-4c9d-a13b-be676b9edba0] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:54.041441 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:18:54.068659 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-446f09df-2fba-4d44-b39b-cc6db1942c55 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Action: 'create', calling method: .version_select at 0x7f7d3ee2fc10>, body: {"keypair": {"name": "tempest-keypair-274871482", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBSwEjOOl/sVpGjuCs30tp+eMImngwrrJZG6OngAq8gMp3d1hdJoWt7jrJmckd+SoO0E3gX0wF/JuuqpVsBJpJiSWk2oC5L7Fu8bX1z1nmfu+7/le0jz2AJfqrVzpwCVWw=="}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:18:54.070307 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ebabf9d5-eec9-4a18-becb-e7c4b8b0e65b tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:54.071102 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ebabf9d5-eec9-4a18-becb-e7c4b8b0e65b tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:54.071723 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ebabf9d5-eec9-4a18-becb-e7c4b8b0e65b tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:54.072631 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ebabf9d5-eec9-4a18-becb-e7c4b8b0e65b tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:54.073257 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ebabf9d5-eec9-4a18-becb-e7c4b8b0e65b tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:54.074706 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ebabf9d5-eec9-4a18-becb-e7c4b8b0e65b tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:54.111108 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-446f09df-2fba-4d44-b39b-cc6db1942c55 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Getting quotas for project 8638ed7d7b3d4285b36865282b8caeab. Resources: {'key_pairs'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:18:54.129709 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-446f09df-2fba-4d44-b39b-cc6db1942c55 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Getting quotas for user b9568f2d3f644e409961ab34e8fa95cc and project 8638ed7d7b3d4285b36865282b8caeab. Resources: {'key_pairs'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:18:54.195854 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-446f09df-2fba-4d44-b39b-cc6db1942c55 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.682706 Sep 14 09:18:54.196494 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2826/5687] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Sep 14 09:18:53 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:18:54.207786 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-62205a15-c12a-4073-810e-7a1f7266394b tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:18:54.215901 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-62205a15-c12a-4073-810e-7a1f7266394b tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] [instance: f31deffe-182e-46b5-9643-725b7d7b4561] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:54.228318 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-62205a15-c12a-4073-810e-7a1f7266394b tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:54.230520 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-62205a15-c12a-4073-810e-7a1f7266394b tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:54.232161 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-62205a15-c12a-4073-810e-7a1f7266394b tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:54.233106 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-62205a15-c12a-4073-810e-7a1f7266394b tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:54.238453 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-62205a15-c12a-4073-810e-7a1f7266394b tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:54.239617 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-62205a15-c12a-4073-810e-7a1f7266394b tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:54.367021 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-62205a15-c12a-4073-810e-7a1f7266394b tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] 10.222.0.60 "POST /compute/v2.1/servers/f31deffe-182e-46b5-9643-725b7d7b4561/action" status: 200 len: 32617 microversion: 2.1 time: 0.169024 Sep 14 09:18:54.368162 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2827/5688] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:18:54 2022] POST /compute/v2.1/servers/f31deffe-182e-46b5-9643-725b7d7b4561/action => generated 32617 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 09:18:54.480677 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-ebabf9d5-eec9-4a18-becb-e7c4b8b0e65b tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03dc827647f4483beb2e1b7888be608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229e11b3c1fe48b088d0f3c4bb7e2cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:54.489601 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-ebabf9d5-eec9-4a18-becb-e7c4b8b0e65b tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "GET /compute/v2.1/servers/80f0d7ed-260a-4c9d-a13b-be676b9edba0" status: 200 len: 1500 microversion: 2.1 time: 0.459926 Sep 14 09:18:54.490216 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2862/5689] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:18:54 2022] GET /compute/v2.1/servers/80f0d7ed-260a-4c9d-a13b-be676b9edba0 => generated 1500 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:18:54.517258 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-38b56072-d252-4c4f-bbd4-d27ae5bab071 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "12a46fe2-342f-45ec-b427-08d117ce6cbd"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:18:54.521237 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-38b56072-d252-4c4f-bbd4-d27ae5bab071 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 80f0d7ed-260a-4c9d-a13b-be676b9edba0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:54.536693 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-38b56072-d252-4c4f-bbd4-d27ae5bab071 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:54.538138 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-38b56072-d252-4c4f-bbd4-d27ae5bab071 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:54.538765 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-38b56072-d252-4c4f-bbd4-d27ae5bab071 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:54.540213 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-38b56072-d252-4c4f-bbd4-d27ae5bab071 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:54.542054 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-38b56072-d252-4c4f-bbd4-d27ae5bab071 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:54.546119 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-38b56072-d252-4c4f-bbd4-d27ae5bab071 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:54.610083 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-38b56072-d252-4c4f-bbd4-d27ae5bab071 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] HTTP exception thrown: Cannot 'attach_volume' instance 80f0d7ed-260a-4c9d-a13b-be676b9edba0 while it is in vm_state rescued Sep 14 09:18:54.619334 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-38b56072-d252-4c4f-bbd4-d27ae5bab071 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Request method failure captured: Sep 14 09:18:54.619334 n-d-836830-18 devstack@n-api.service[128759]: request: POST /compute/v2.1/servers/80f0d7ed-260a-4c9d-a13b-be676b9edba0/os-volume_attachments HTTP/1.1 Sep 14 09:18:54.619334 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:18:54.619334 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:18:54.619334 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:18:54.619334 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 74 Sep 14 09:18:54.619334 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:18:54.619334 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:18:54.619334 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:18:54.619334 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:18:54.619334 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZwTx_6je2Mw19l1lk1T0KIWHROT3f4iq0u8_a7vTqyoq1BZh-ur0UF5KgJJeIlC54HlZaHspjBV72bT6ijQhdvPr0BCEmv-eUjjBTB_inJvaG7XMCMIoIIz39iqAFnj3jFdepR5dS7_uhYCyzmsUFKn1SkfeR8JmAZc_qs5ymrt_EA Sep 14 09:18:54.619334 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:18:54.619334 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:18:54.619334 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:18:54.619334 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:18:54.619334 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:18:54.619334 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:18:54.619334 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 229e11b3c1fe48b088d0f3c4bb7e2cb6 Sep 14 09:18:54.619334 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2043241234 Sep 14 09:18:54.619334 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:18:54.619334 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:18:54.619334 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/229e11b3c1fe48b088d0f3c4bb7e2cb6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_229e11b3c1fe48b088d0f3c4bb7e2cb6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/229e11b3c1fe48b088d0f3c4bb7e2cb6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/229e11b3c1fe48b088d0f3c4bb7e2cb6"}]}] Sep 14 09:18:54.619334 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2043241234 Sep 14 09:18:54.619334 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 229e11b3c1fe48b088d0f3c4bb7e2cb6 Sep 14 09:18:54.619334 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2043241234 Sep 14 09:18:54.619334 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ServerRescueNegativeTestJSON-2043241234-project Sep 14 09:18:54.619334 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:18:54.619334 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:18:54.619334 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: d03dc827647f4483beb2e1b7888be608 Sep 14 09:18:54.619334 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2043241234-project Sep 14 09:18:54.619334 n-d-836830-18 devstack@n-api.service[128759]: Sep 14 09:18:54.619334 n-d-836830-18 devstack@n-api.service[128759]: {"volumeAttachment": {"volumeId": "12a46fe2-342f-45ec-b427-08d117ce6cbd"}} Sep 14 09:18:54.619334 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:18:54.619334 n-d-836830-18 devstack@n-api.service[128759]: exception: Cannot 'attach_volume' instance 80f0d7ed-260a-4c9d-a13b-be676b9edba0 while it is in vm_state rescued Sep 14 09:18:54.619334 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'server_id': '80f0d7ed-260a-4c9d-a13b-be676b9edba0', 'body': {'volumeAttachment': {'volumeId': '12a46fe2-342f-45ec-b427-08d117ce6cbd'}}} Sep 14 09:18:54.619334 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:18:54.619334 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:18:54.619334 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 14 09:18:54.619334 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 14 09:18:54.619334 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 14 09:18:54.619334 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 14 09:18:54.619334 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 14 09:18:54.619334 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 14 09:18:54.619334 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 80f0d7ed-260a-4c9d-a13b-be676b9edba0 in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 14 09:18:54.619334 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:18:54.619334 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:18:54.619334 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:18:54.619334 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:18:54.619334 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:18:54.619334 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:18:54.619334 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:18:54.619334 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:18:54.619334 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:18:54.619334 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:18:54.619334 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:18:54.619334 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:18:54.619334 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:18:54.619334 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:18:54.619334 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:18:54.619334 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:18:54.619334 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 14 09:18:54.619334 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 14 09:18:54.624650 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 14 09:18:54.624650 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 14 09:18:54.624650 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 80f0d7ed-260a-4c9d-a13b-be676b9edba0 while it is in vm_state rescued Sep 14 09:18:54.624650 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:18:54.624650 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:18:54.624650 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:18:54.624650 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:18:54.624650 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:18:54.624650 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:18:54.624650 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:18:54.624650 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:18:54.624650 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 80f0d7ed-260a-4c9d-a13b-be676b9edba0 while it is in vm_state rescued Sep 14 09:18:54.624650 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:18:54.624650 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-38b56072-d252-4c4f-bbd4-d27ae5bab071 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Returning 409 to user: Cannot 'attach_volume' instance 80f0d7ed-260a-4c9d-a13b-be676b9edba0 while it is in vm_state rescued {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:18:54.624650 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-38b56072-d252-4c4f-bbd4-d27ae5bab071 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "POST /compute/v2.1/servers/80f0d7ed-260a-4c9d-a13b-be676b9edba0/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.107836 Sep 14 09:18:54.624650 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2828/5690] 10.222.0.60 () {60 vars in 1323 bytes} [Wed Sep 14 09:18:54 2022] POST /compute/v2.1/servers/80f0d7ed-260a-4c9d-a13b-be676b9edba0/os-volume_attachments => generated 152 bytes in 113 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 14 09:18:54.634100 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-53bd7cab-e607-426c-8bd3-d8509349b558 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:18:54.636003 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-53bd7cab-e607-426c-8bd3-d8509349b558 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 80f0d7ed-260a-4c9d-a13b-be676b9edba0] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:54.660422 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-53bd7cab-e607-426c-8bd3-d8509349b558 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:54.660962 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-53bd7cab-e607-426c-8bd3-d8509349b558 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:54.664469 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-53bd7cab-e607-426c-8bd3-d8509349b558 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:54.665382 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-53bd7cab-e607-426c-8bd3-d8509349b558 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:54.665882 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-53bd7cab-e607-426c-8bd3-d8509349b558 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:54.666378 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-53bd7cab-e607-426c-8bd3-d8509349b558 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:54.744034 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:18:54.904879 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-53bd7cab-e607-426c-8bd3-d8509349b558 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "POST /compute/v2.1/servers/80f0d7ed-260a-4c9d-a13b-be676b9edba0/action" status: 202 len: 0 microversion: 2.1 time: 0.272904 Sep 14 09:18:54.907067 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2863/5691] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:18:54 2022] POST /compute/v2.1/servers/80f0d7ed-260a-4c9d-a13b-be676b9edba0/action => generated 0 bytes in 280 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:18:54.917579 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-bc81d769-4c95-45fc-8c06-d184b5171166 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:54.918258 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-bc81d769-4c95-45fc-8c06-d184b5171166 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 80f0d7ed-260a-4c9d-a13b-be676b9edba0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:54.933798 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bc81d769-4c95-45fc-8c06-d184b5171166 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:54.934299 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bc81d769-4c95-45fc-8c06-d184b5171166 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:54.937046 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bc81d769-4c95-45fc-8c06-d184b5171166 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:54.942874 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bc81d769-4c95-45fc-8c06-d184b5171166 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:54.943421 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bc81d769-4c95-45fc-8c06-d184b5171166 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:54.943877 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bc81d769-4c95-45fc-8c06-d184b5171166 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:55.033821 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-735c1908-e61a-4113-9a50-da60b0a81942 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:55.035547 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-735c1908-e61a-4113-9a50-da60b0a81942 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] [instance: 8b671025-214d-4349-9b4a-4f23fa069ae5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:55.051695 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-735c1908-e61a-4113-9a50-da60b0a81942 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:55.052470 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-735c1908-e61a-4113-9a50-da60b0a81942 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:55.053262 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-735c1908-e61a-4113-9a50-da60b0a81942 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:55.054845 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-735c1908-e61a-4113-9a50-da60b0a81942 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:55.055582 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-735c1908-e61a-4113-9a50-da60b0a81942 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:55.056231 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-735c1908-e61a-4113-9a50-da60b0a81942 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:55.531933 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-bc81d769-4c95-45fc-8c06-d184b5171166 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03dc827647f4483beb2e1b7888be608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229e11b3c1fe48b088d0f3c4bb7e2cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:55.590583 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-bc81d769-4c95-45fc-8c06-d184b5171166 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "GET /compute/v2.1/servers/80f0d7ed-260a-4c9d-a13b-be676b9edba0" status: 200 len: 1508 microversion: 2.1 time: 0.677376 Sep 14 09:18:55.594774 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2829/5692] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:18:54 2022] GET /compute/v2.1/servers/80f0d7ed-260a-4c9d-a13b-be676b9edba0 => generated 1508 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:18:55.674911 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-735c1908-e61a-4113-9a50-da60b0a81942 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf41bb7d024a8c86a385ac47561b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17da1bc0ed09449aa10d4a4ff9117f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:55.726292 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-735c1908-e61a-4113-9a50-da60b0a81942 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] 10.222.0.60 "GET /compute/v2.1/servers/8b671025-214d-4349-9b4a-4f23fa069ae5" status: 200 len: 1315 microversion: 2.1 time: 0.696410 Sep 14 09:18:55.760906 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2864/5693] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:18:55 2022] GET /compute/v2.1/servers/8b671025-214d-4349-9b4a-4f23fa069ae5 => generated 1315 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:18:55.926338 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-dd97d15f-07aa-45a8-aa9f-02cc7965a700 req-038f3a34-e773-45d1-b02f-a899bd04ece8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b671025-214d-4349-9b4a-4f23fa069ae5", "name": "network-vif-plugged", "status": "completed", "tag": "6bf6b9a2-d16b-44fb-a0f4-26bda7b1d8fc"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:18:55.951472 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-dd97d15f-07aa-45a8-aa9f-02cc7965a700 req-038f3a34-e773-45d1-b02f-a899bd04ece8 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:55.952400 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-dd97d15f-07aa-45a8-aa9f-02cc7965a700 req-038f3a34-e773-45d1-b02f-a899bd04ece8 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:55.953628 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-dd97d15f-07aa-45a8-aa9f-02cc7965a700 req-038f3a34-e773-45d1-b02f-a899bd04ece8 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:55.967646 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=100 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:18:55.994746 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-dd97d15f-07aa-45a8-aa9f-02cc7965a700 req-038f3a34-e773-45d1-b02f-a899bd04ece8 service nova] Creating event network-vif-plugged:6bf6b9a2-d16b-44fb-a0f4-26bda7b1d8fc for instance 8b671025-214d-4349-9b4a-4f23fa069ae5 on n-h2-836830-18 Sep 14 09:18:56.005541 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-dd97d15f-07aa-45a8-aa9f-02cc7965a700 req-038f3a34-e773-45d1-b02f-a899bd04ece8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093360 Sep 14 09:18:56.007235 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2830/5694] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:18:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:18:56.638897 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-48a1b912-bc22-47d8-b1c1-7ec47fd2710f tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:56.640012 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-48a1b912-bc22-47d8-b1c1-7ec47fd2710f tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 80f0d7ed-260a-4c9d-a13b-be676b9edba0] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:56.656834 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-48a1b912-bc22-47d8-b1c1-7ec47fd2710f tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:56.661986 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-48a1b912-bc22-47d8-b1c1-7ec47fd2710f tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:56.663078 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-48a1b912-bc22-47d8-b1c1-7ec47fd2710f tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:56.663876 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-48a1b912-bc22-47d8-b1c1-7ec47fd2710f tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:56.665823 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-48a1b912-bc22-47d8-b1c1-7ec47fd2710f tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:56.666457 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-48a1b912-bc22-47d8-b1c1-7ec47fd2710f tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:56.779634 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-27cc3407-2a81-4845-ad10-e415e76cd8b5 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:56.781576 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-27cc3407-2a81-4845-ad10-e415e76cd8b5 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] [instance: 8b671025-214d-4349-9b4a-4f23fa069ae5] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:56.794112 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-27cc3407-2a81-4845-ad10-e415e76cd8b5 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:56.795522 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-27cc3407-2a81-4845-ad10-e415e76cd8b5 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:56.796646 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-27cc3407-2a81-4845-ad10-e415e76cd8b5 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:56.797614 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-27cc3407-2a81-4845-ad10-e415e76cd8b5 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:56.798314 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-27cc3407-2a81-4845-ad10-e415e76cd8b5 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:56.799456 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-27cc3407-2a81-4845-ad10-e415e76cd8b5 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:57.209435 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-27cc3407-2a81-4845-ad10-e415e76cd8b5 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf41bb7d024a8c86a385ac47561b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17da1bc0ed09449aa10d4a4ff9117f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:57.220556 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-27cc3407-2a81-4845-ad10-e415e76cd8b5 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] 10.222.0.60 "GET /compute/v2.1/servers/8b671025-214d-4349-9b4a-4f23fa069ae5" status: 200 len: 1315 microversion: 2.1 time: 0.448128 Sep 14 09:18:57.239556 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2831/5695] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:18:56 2022] GET /compute/v2.1/servers/8b671025-214d-4349-9b4a-4f23fa069ae5 => generated 1315 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:18:57.308624 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-48a1b912-bc22-47d8-b1c1-7ec47fd2710f tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03dc827647f4483beb2e1b7888be608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229e11b3c1fe48b088d0f3c4bb7e2cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:57.328252 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-48a1b912-bc22-47d8-b1c1-7ec47fd2710f tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "GET /compute/v2.1/servers/80f0d7ed-260a-4c9d-a13b-be676b9edba0" status: 200 len: 1508 microversion: 2.1 time: 0.692874 Sep 14 09:18:57.330687 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2865/5696] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:18:56 2022] GET /compute/v2.1/servers/80f0d7ed-260a-4c9d-a13b-be676b9edba0 => generated 1508 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:18:57.899585 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-494978cc-1bb8-4a9c-a046-2226b0ccb1f1 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:57.900153 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-494978cc-1bb8-4a9c-a046-2226b0ccb1f1 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] [instance: f31deffe-182e-46b5-9643-725b7d7b4561] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:57.912056 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-494978cc-1bb8-4a9c-a046-2226b0ccb1f1 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:57.912732 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-494978cc-1bb8-4a9c-a046-2226b0ccb1f1 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:57.913331 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-494978cc-1bb8-4a9c-a046-2226b0ccb1f1 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:57.915179 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-494978cc-1bb8-4a9c-a046-2226b0ccb1f1 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:57.916306 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-494978cc-1bb8-4a9c-a046-2226b0ccb1f1 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:57.918284 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-494978cc-1bb8-4a9c-a046-2226b0ccb1f1 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:57.993107 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-494978cc-1bb8-4a9c-a046-2226b0ccb1f1 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] [instance: f31deffe-182e-46b5-9643-725b7d7b4561] Going to try to terminate instance {{(pid=128759) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:18:58.158986 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-494978cc-1bb8-4a9c-a046-2226b0ccb1f1 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] 10.222.0.60 "DELETE /compute/v2.1/servers/f31deffe-182e-46b5-9643-725b7d7b4561" status: 204 len: 0 microversion: 2.1 time: 0.262840 Sep 14 09:18:58.160628 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2832/5697] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:18:57 2022] DELETE /compute/v2.1/servers/f31deffe-182e-46b5-9643-725b7d7b4561 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:18:58.169803 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-6de40b77-ff70-4de6-9be8-f3204cb25793 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:58.171388 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-6de40b77-ff70-4de6-9be8-f3204cb25793 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] [instance: f31deffe-182e-46b5-9643-725b7d7b4561] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:58.180424 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6de40b77-ff70-4de6-9be8-f3204cb25793 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:58.181283 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6de40b77-ff70-4de6-9be8-f3204cb25793 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:58.181947 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6de40b77-ff70-4de6-9be8-f3204cb25793 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:58.183653 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6de40b77-ff70-4de6-9be8-f3204cb25793 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:58.184409 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6de40b77-ff70-4de6-9be8-f3204cb25793 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:58.185286 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6de40b77-ff70-4de6-9be8-f3204cb25793 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:58.441760 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-19135ca4-4a80-4782-978d-c4ebde73bded req-a4730e82-a80a-461e-8adc-cb5756ba20db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f31deffe-182e-46b5-9643-725b7d7b4561", "tag": "0190f876-37ba-4929-9e15-dd1e9c1f6cd4"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:18:58.465605 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-19135ca4-4a80-4782-978d-c4ebde73bded req-a4730e82-a80a-461e-8adc-cb5756ba20db service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:58.466167 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-19135ca4-4a80-4782-978d-c4ebde73bded req-a4730e82-a80a-461e-8adc-cb5756ba20db service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:58.467631 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-19135ca4-4a80-4782-978d-c4ebde73bded req-a4730e82-a80a-461e-8adc-cb5756ba20db service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:58.526709 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-19135ca4-4a80-4782-978d-c4ebde73bded req-a4730e82-a80a-461e-8adc-cb5756ba20db service nova] Creating event network-changed:0190f876-37ba-4929-9e15-dd1e9c1f6cd4 for instance f31deffe-182e-46b5-9643-725b7d7b4561 on n-h1-836830-18 Sep 14 09:18:58.576127 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-19135ca4-4a80-4782-978d-c4ebde73bded req-a4730e82-a80a-461e-8adc-cb5756ba20db service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.635512 Sep 14 09:18:58.582781 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2866/5698] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:18:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:18:58.607269 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-7608d2cf-b4eb-4cd1-89a2-4a1c4eb6b84e tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:58.610709 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-7608d2cf-b4eb-4cd1-89a2-4a1c4eb6b84e tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] [instance: 8b671025-214d-4349-9b4a-4f23fa069ae5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:58.634032 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7608d2cf-b4eb-4cd1-89a2-4a1c4eb6b84e tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:58.634576 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-6de40b77-ff70-4de6-9be8-f3204cb25793 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17918433a3994b69a65999a59a7f833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b73b20f2042c6a08f94ed23ff66e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:58.635440 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7608d2cf-b4eb-4cd1-89a2-4a1c4eb6b84e tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:58.636888 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7608d2cf-b4eb-4cd1-89a2-4a1c4eb6b84e tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:58.637923 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7608d2cf-b4eb-4cd1-89a2-4a1c4eb6b84e tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:58.640976 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7608d2cf-b4eb-4cd1-89a2-4a1c4eb6b84e tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:58.641604 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7608d2cf-b4eb-4cd1-89a2-4a1c4eb6b84e tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:58.647725 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-6de40b77-ff70-4de6-9be8-f3204cb25793 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] 10.222.0.60 "GET /compute/v2.1/servers/f31deffe-182e-46b5-9643-725b7d7b4561" status: 200 len: 1669 microversion: 2.1 time: 0.482471 Sep 14 09:18:58.649035 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2833/5699] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:18:58 2022] GET /compute/v2.1/servers/f31deffe-182e-46b5-9643-725b7d7b4561 => generated 1669 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:18:58.662605 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b850ef4a-4f28-468b-a38e-dbaba7dd4ffb tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:58.665075 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b850ef4a-4f28-468b-a38e-dbaba7dd4ffb tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 80f0d7ed-260a-4c9d-a13b-be676b9edba0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:58.687948 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b850ef4a-4f28-468b-a38e-dbaba7dd4ffb tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:58.690093 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b850ef4a-4f28-468b-a38e-dbaba7dd4ffb tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:58.692341 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b850ef4a-4f28-468b-a38e-dbaba7dd4ffb tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:58.693762 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b850ef4a-4f28-468b-a38e-dbaba7dd4ffb tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:58.696928 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b850ef4a-4f28-468b-a38e-dbaba7dd4ffb tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:58.699008 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b850ef4a-4f28-468b-a38e-dbaba7dd4ffb tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:58.985256 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-7608d2cf-b4eb-4cd1-89a2-4a1c4eb6b84e tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf41bb7d024a8c86a385ac47561b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17da1bc0ed09449aa10d4a4ff9117f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:58.994191 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-7608d2cf-b4eb-4cd1-89a2-4a1c4eb6b84e tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] 10.222.0.60 "GET /compute/v2.1/servers/8b671025-214d-4349-9b4a-4f23fa069ae5" status: 200 len: 1503 microversion: 2.1 time: 0.406394 Sep 14 09:18:58.994780 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2867/5700] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:18:58 2022] GET /compute/v2.1/servers/8b671025-214d-4349-9b4a-4f23fa069ae5 => generated 1503 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:18:59.019687 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-6c014dd0-a986-4073-862b-8561e5361885 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1536076445", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cb112191-f1ab-4d55-91a3-99edbe0aaa28"}], "security_groups": [{"name": "tempest-securitygroup--1402007327"}], "key_name": "tempest-keypair-274871482", "user_data": "}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:18:59.093278 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b850ef4a-4f28-468b-a38e-dbaba7dd4ffb tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03dc827647f4483beb2e1b7888be608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229e11b3c1fe48b088d0f3c4bb7e2cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:59.106905 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b850ef4a-4f28-468b-a38e-dbaba7dd4ffb tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "GET /compute/v2.1/servers/80f0d7ed-260a-4c9d-a13b-be676b9edba0" status: 200 len: 1514 microversion: 2.1 time: 0.453336 Sep 14 09:18:59.136349 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2834/5701] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:18:58 2022] GET /compute/v2.1/servers/80f0d7ed-260a-4c9d-a13b-be676b9edba0 => generated 1514 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:18:59.152834 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a7d2d55e-05f3-44f6-b62b-026500cd03e1 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:59.154266 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-a7d2d55e-05f3-44f6-b62b-026500cd03e1 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] [instance: 8b671025-214d-4349-9b4a-4f23fa069ae5] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:59.182446 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a7d2d55e-05f3-44f6-b62b-026500cd03e1 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:59.182974 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a7d2d55e-05f3-44f6-b62b-026500cd03e1 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:59.184149 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a7d2d55e-05f3-44f6-b62b-026500cd03e1 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:59.187775 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a7d2d55e-05f3-44f6-b62b-026500cd03e1 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:59.188317 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a7d2d55e-05f3-44f6-b62b-026500cd03e1 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:59.188764 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a7d2d55e-05f3-44f6-b62b-026500cd03e1 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:59.201192 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.network.neutron [None req-6c014dd0-a986-4073-862b-8561e5361885 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] validate_networks() for [('cb112191-f1ab-4d55-91a3-99edbe0aaa28', None, None, None, None, None)] {{(pid=128758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:18:59.572053 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-a7d2d55e-05f3-44f6-b62b-026500cd03e1 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf41bb7d024a8c86a385ac47561b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17da1bc0ed09449aa10d4a4ff9117f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:59.590232 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a7d2d55e-05f3-44f6-b62b-026500cd03e1 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] 10.222.0.60 "GET /compute/v2.1/servers/8b671025-214d-4349-9b4a-4f23fa069ae5" status: 200 len: 1503 microversion: 2.1 time: 0.450974 Sep 14 09:18:59.591132 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2835/5702] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:18:59 2022] GET /compute/v2.1/servers/8b671025-214d-4349-9b4a-4f23fa069ae5 => generated 1503 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:18:59.617401 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e2d857b3-a5ee-4034-874b-1ad9086d1513 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:18:59.618321 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e2d857b3-a5ee-4034-874b-1ad9086d1513 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] [instance: 8b671025-214d-4349-9b4a-4f23fa069ae5] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:59.640996 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e2d857b3-a5ee-4034-874b-1ad9086d1513 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:59.642710 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e2d857b3-a5ee-4034-874b-1ad9086d1513 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:59.644315 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e2d857b3-a5ee-4034-874b-1ad9086d1513 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:59.645884 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e2d857b3-a5ee-4034-874b-1ad9086d1513 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:59.646804 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e2d857b3-a5ee-4034-874b-1ad9086d1513 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:59.647429 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e2d857b3-a5ee-4034-874b-1ad9086d1513 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:59.701710 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.objects.instance [None req-e2d857b3-a5ee-4034-874b-1ad9086d1513 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Lazy-loading 'flavor' on Instance uuid 8b671025-214d-4349-9b4a-4f23fa069ae5 {{(pid=128759) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:18:59.876703 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e2d857b3-a5ee-4034-874b-1ad9086d1513 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] 10.222.0.60 "POST /compute/v2.1/servers/8b671025-214d-4349-9b4a-4f23fa069ae5/action" status: 202 len: 0 microversion: 2.1 time: 0.264969 Sep 14 09:18:59.883544 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2836/5703] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:18:59 2022] POST /compute/v2.1/servers/8b671025-214d-4349-9b4a-4f23fa069ae5/action => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:18:59.909620 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-11507fae-a973-4f94-8325-dd9d2b7c9cbf tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:59.910544 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-11507fae-a973-4f94-8325-dd9d2b7c9cbf tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] [instance: f31deffe-182e-46b5-9643-725b7d7b4561] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:59.951353 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-11507fae-a973-4f94-8325-dd9d2b7c9cbf tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:59.952028 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-11507fae-a973-4f94-8325-dd9d2b7c9cbf tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:59.952489 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-11507fae-a973-4f94-8325-dd9d2b7c9cbf tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:59.959007 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-11507fae-a973-4f94-8325-dd9d2b7c9cbf tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:59.959509 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-11507fae-a973-4f94-8325-dd9d2b7c9cbf tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:59.959951 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-11507fae-a973-4f94-8325-dd9d2b7c9cbf tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:00.873551 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-11507fae-a973-4f94-8325-dd9d2b7c9cbf tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17918433a3994b69a65999a59a7f833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b73b20f2042c6a08f94ed23ff66e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:00.890160 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-11507fae-a973-4f94-8325-dd9d2b7c9cbf tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] 10.222.0.60 "GET /compute/v2.1/servers/f31deffe-182e-46b5-9643-725b7d7b4561" status: 200 len: 1669 microversion: 2.1 time: 1.003168 Sep 14 09:19:00.909499 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2837/5704] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:18:59 2022] GET /compute/v2.1/servers/f31deffe-182e-46b5-9643-725b7d7b4561 => generated 1669 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:19:00.938000 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-300e1577-5c35-4918-b32c-5e662a9b1eb1 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:00.940600 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-300e1577-5c35-4918-b32c-5e662a9b1eb1 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] [instance: 8b671025-214d-4349-9b4a-4f23fa069ae5] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:00.968661 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-300e1577-5c35-4918-b32c-5e662a9b1eb1 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:00.969389 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-300e1577-5c35-4918-b32c-5e662a9b1eb1 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:00.972082 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-300e1577-5c35-4918-b32c-5e662a9b1eb1 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:00.973133 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-300e1577-5c35-4918-b32c-5e662a9b1eb1 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:00.976241 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-300e1577-5c35-4918-b32c-5e662a9b1eb1 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:00.978720 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-300e1577-5c35-4918-b32c-5e662a9b1eb1 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:01.641123 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-6c014dd0-a986-4073-862b-8561e5361885 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Flavor limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:19:01.641602 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-6c014dd0-a986-4073-862b-8561e5361885 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Image limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:19:01.642312 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-6c014dd0-a986-4073-862b-8561e5361885 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Flavor pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:19:01.643010 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-6c014dd0-a986-4073-862b-8561e5361885 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Image pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:19:01.643646 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-6c014dd0-a986-4073-862b-8561e5361885 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:19:01.664775 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-300e1577-5c35-4918-b32c-5e662a9b1eb1 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf41bb7d024a8c86a385ac47561b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17da1bc0ed09449aa10d4a4ff9117f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:01.695338 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-300e1577-5c35-4918-b32c-5e662a9b1eb1 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] 10.222.0.60 "GET /compute/v2.1/servers/8b671025-214d-4349-9b4a-4f23fa069ae5" status: 200 len: 1494 microversion: 2.1 time: 0.775600 Sep 14 09:19:01.696552 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6c014dd0-a986-4073-862b-8561e5361885 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:01.710968 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6c014dd0-a986-4073-862b-8561e5361885 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:01.711214 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2838/5705] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:19:00 2022] GET /compute/v2.1/servers/8b671025-214d-4349-9b4a-4f23fa069ae5 => generated 1494 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:19:01.711320 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6c014dd0-a986-4073-862b-8561e5361885 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:01.711320 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6c014dd0-a986-4073-862b-8561e5361885 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:01.711320 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6c014dd0-a986-4073-862b-8561e5361885 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:01.711320 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6c014dd0-a986-4073-862b-8561e5361885 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:01.730236 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f908fea7-c877-4ef5-b938-379348d998ba tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:19:01.731123 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f908fea7-c877-4ef5-b938-379348d998ba tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] [instance: 8b671025-214d-4349-9b4a-4f23fa069ae5] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:01.746594 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f908fea7-c877-4ef5-b938-379348d998ba tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:01.747138 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f908fea7-c877-4ef5-b938-379348d998ba tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:01.752755 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f908fea7-c877-4ef5-b938-379348d998ba tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:01.753731 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f908fea7-c877-4ef5-b938-379348d998ba tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:01.755711 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f908fea7-c877-4ef5-b938-379348d998ba tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:01.756292 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f908fea7-c877-4ef5-b938-379348d998ba tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:01.800639 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-6c014dd0-a986-4073-862b-8561e5361885 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Getting quotas for project 8638ed7d7b3d4285b36865282b8caeab. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:19:01.829957 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-6c014dd0-a986-4073-862b-8561e5361885 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Getting quotas for user b9568f2d3f644e409961ab34e8fa95cc and project 8638ed7d7b3d4285b36865282b8caeab. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:19:01.910417 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-6c014dd0-a986-4073-862b-8561e5361885 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Going to run 1 instances... {{(pid=128758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:19:01.925834 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-6c014dd0-a986-4073-862b-8561e5361885 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] [instance: 022379ab-af51-495a-bcef-11e43774a7b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:19:01.985881 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f908fea7-c877-4ef5-b938-379348d998ba tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] 10.222.0.60 "POST /compute/v2.1/servers/8b671025-214d-4349-9b4a-4f23fa069ae5/action" status: 202 len: 0 microversion: 2.1 time: 0.261314 Sep 14 09:19:01.988539 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2839/5706] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:19:01 2022] POST /compute/v2.1/servers/8b671025-214d-4349-9b4a-4f23fa069ae5/action => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 14 09:19:02.010343 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-0544f056-cda6-4eea-9b15-4aa10b26c675 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:02.011782 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-0544f056-cda6-4eea-9b15-4aa10b26c675 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] [instance: f31deffe-182e-46b5-9643-725b7d7b4561] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:02.031762 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0544f056-cda6-4eea-9b15-4aa10b26c675 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:02.033215 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0544f056-cda6-4eea-9b15-4aa10b26c675 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:02.034177 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0544f056-cda6-4eea-9b15-4aa10b26c675 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:02.035761 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0544f056-cda6-4eea-9b15-4aa10b26c675 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:02.038049 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0544f056-cda6-4eea-9b15-4aa10b26c675 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:02.038781 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0544f056-cda6-4eea-9b15-4aa10b26c675 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:02.130805 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-6c014dd0-a986-4073-862b-8561e5361885 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.126033 Sep 14 09:19:02.138319 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2868/5707] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 09:18:58 2022] POST /compute/v2.1/servers => generated 402 bytes in 3139 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:19:02.148512 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-561bd6ef-48af-43c0-a3f0-bdd0982ee1f2 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:02.160107 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-561bd6ef-48af-43c0-a3f0-bdd0982ee1f2 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] [instance: 8b671025-214d-4349-9b4a-4f23fa069ae5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:02.178748 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-561bd6ef-48af-43c0-a3f0-bdd0982ee1f2 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:02.179288 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-561bd6ef-48af-43c0-a3f0-bdd0982ee1f2 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:02.181731 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-561bd6ef-48af-43c0-a3f0-bdd0982ee1f2 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:02.182542 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-561bd6ef-48af-43c0-a3f0-bdd0982ee1f2 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:02.183115 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-561bd6ef-48af-43c0-a3f0-bdd0982ee1f2 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:02.183596 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-561bd6ef-48af-43c0-a3f0-bdd0982ee1f2 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:02.908046 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-0544f056-cda6-4eea-9b15-4aa10b26c675 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17918433a3994b69a65999a59a7f833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b73b20f2042c6a08f94ed23ff66e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:02.918130 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-0544f056-cda6-4eea-9b15-4aa10b26c675 tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] 10.222.0.60 "GET /compute/v2.1/servers/f31deffe-182e-46b5-9643-725b7d7b4561" status: 200 len: 1602 microversion: 2.1 time: 0.927990 Sep 14 09:19:02.918735 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2840/5708] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:19:01 2022] GET /compute/v2.1/servers/f31deffe-182e-46b5-9643-725b7d7b4561 => generated 1602 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:19:02.931390 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-38976509-32f9-4c36-84c5-874c0d7f46a7 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:02.943470 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-38976509-32f9-4c36-84c5-874c0d7f46a7 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] [instance: 022379ab-af51-495a-bcef-11e43774a7b0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:03.148249 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-38976509-32f9-4c36-84c5-874c0d7f46a7 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9568f2d3f644e409961ab34e8fa95cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8638ed7d7b3d4285b36865282b8caeab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:03.161670 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-38976509-32f9-4c36-84c5-874c0d7f46a7 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] 10.222.0.60 "GET /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0" status: 200 len: 1237 microversion: 2.1 time: 0.233511 Sep 14 09:19:03.163866 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2841/5709] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:19:02 2022] GET /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0 => generated 1237 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:19:03.179649 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-b69fa3a0-fe5e-4d6e-97cf-64d6490545b4 req-56c36b24-e453-4711-a7cb-5de3465667d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f31deffe-182e-46b5-9643-725b7d7b4561", "name": "network-vif-deleted", "tag": "0190f876-37ba-4929-9e15-dd1e9c1f6cd4"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:19:03.215199 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-b69fa3a0-fe5e-4d6e-97cf-64d6490545b4 req-56c36b24-e453-4711-a7cb-5de3465667d8 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:03.234837 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-b69fa3a0-fe5e-4d6e-97cf-64d6490545b4 req-56c36b24-e453-4711-a7cb-5de3465667d8 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:03.240206 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-b69fa3a0-fe5e-4d6e-97cf-64d6490545b4 req-56c36b24-e453-4711-a7cb-5de3465667d8 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:03.280378 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-b69fa3a0-fe5e-4d6e-97cf-64d6490545b4 req-56c36b24-e453-4711-a7cb-5de3465667d8 service nova] Creating event network-vif-deleted:0190f876-37ba-4929-9e15-dd1e9c1f6cd4 for instance f31deffe-182e-46b5-9643-725b7d7b4561 on n-h1-836830-18 Sep 14 09:19:03.289754 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-561bd6ef-48af-43c0-a3f0-bdd0982ee1f2 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf41bb7d024a8c86a385ac47561b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17da1bc0ed09449aa10d4a4ff9117f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:03.304616 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-561bd6ef-48af-43c0-a3f0-bdd0982ee1f2 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] 10.222.0.60 "GET /compute/v2.1/servers/8b671025-214d-4349-9b4a-4f23fa069ae5" status: 200 len: 1500 microversion: 2.1 time: 1.164863 Sep 14 09:19:03.311635 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2869/5710] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:19:02 2022] GET /compute/v2.1/servers/8b671025-214d-4349-9b4a-4f23fa069ae5 => generated 1500 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:19:03.316735 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-b69fa3a0-fe5e-4d6e-97cf-64d6490545b4 req-56c36b24-e453-4711-a7cb-5de3465667d8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149444 Sep 14 09:19:03.322058 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2842/5711] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:19:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:19:03.325050 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-0b9815d0-fe96-48a2-94fa-ac5dff0ed2cb tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Action: 'create', calling method: .version_select at 0x7f7d3f2cdb80>, body: {"keypair": {"name": "tempest-keypair-1997239530", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK9qPMgoXzlpJzsw9rNRChpWilBNW9Kso9KhrPNGu1qaSqV3A+FYFwWuEm6dkGqxaEKVzx7zukqNYVgf0zndrWGZ64HC8pErSBx/P3fyErg0spEmW0hxTbEmK0qsvPtoWw=="}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:19:03.345584 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-0b9815d0-fe96-48a2-94fa-ac5dff0ed2cb tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Getting quotas for project 229e11b3c1fe48b088d0f3c4bb7e2cb6. Resources: {'key_pairs'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:19:03.352041 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-0b9815d0-fe96-48a2-94fa-ac5dff0ed2cb tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Getting quotas for user d03dc827647f4483beb2e1b7888be608 and project 229e11b3c1fe48b088d0f3c4bb7e2cb6. Resources: {'key_pairs'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:19:03.390200 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-0b9815d0-fe96-48a2-94fa-ac5dff0ed2cb tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.075772 Sep 14 09:19:03.392312 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2870/5712] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Sep 14 09:19:03 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:19:03.944606 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d651d2ea-4e20-4221-a025-f2b07e05594d tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:03.945717 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-d651d2ea-4e20-4221-a025-f2b07e05594d tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] [instance: f31deffe-182e-46b5-9643-725b7d7b4561] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:03.956745 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d651d2ea-4e20-4221-a025-f2b07e05594d tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:03.957505 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d651d2ea-4e20-4221-a025-f2b07e05594d tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:03.958104 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d651d2ea-4e20-4221-a025-f2b07e05594d tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:03.963189 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d651d2ea-4e20-4221-a025-f2b07e05594d tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:03.965480 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d651d2ea-4e20-4221-a025-f2b07e05594d tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:03.966192 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d651d2ea-4e20-4221-a025-f2b07e05594d tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:03.985186 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-d651d2ea-4e20-4221-a025-f2b07e05594d tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] HTTP exception thrown: Instance f31deffe-182e-46b5-9643-725b7d7b4561 could not be found. Sep 14 09:19:03.987786 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d651d2ea-4e20-4221-a025-f2b07e05594d tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Request method failure captured: Sep 14 09:19:03.987786 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/f31deffe-182e-46b5-9643-725b7d7b4561 HTTP/1.1 Sep 14 09:19:03.987786 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:19:03.987786 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:19:03.987786 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:19:03.987786 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:19:03.987786 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:19:03.987786 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:19:03.987786 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:19:03.987786 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:19:03.987786 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZspPmHjwZujiBcFD9QR0xKRglPEsjHrxFyZ2jvI3y4w7WsV_uOazq2PIFhXWJstUoVfI5CfG-SbSDJQWJGpK1XjUqfYNhZcp5K7_6hUB7flJnxmZDSxGD91GsUMnRbAXa_LtSdQIgpS8r244D3MU9iQdVusPNXmSG4qhMgXymnz-Wo Sep 14 09:19:03.987786 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:19:03.987786 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:19:03.987786 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:19:03.987786 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:19:03.987786 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:19:03.987786 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:19:03.987786 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 021b73b20f2042c6a08f94ed23ff66e5 Sep 14 09:19:03.987786 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-TestNetworkBasicOps-1034807082 Sep 14 09:19:03.987786 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:19:03.987786 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:19:03.987786 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/021b73b20f2042c6a08f94ed23ff66e5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_021b73b20f2042c6a08f94ed23ff66e5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/021b73b20f2042c6a08f94ed23ff66e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/021b73b20f2042c6a08f94ed23ff66e5"}]}] Sep 14 09:19:03.987786 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-TestNetworkBasicOps-1034807082 Sep 14 09:19:03.987786 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 021b73b20f2042c6a08f94ed23ff66e5 Sep 14 09:19:03.987786 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-TestNetworkBasicOps-1034807082 Sep 14 09:19:03.987786 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-TestNetworkBasicOps-1034807082-project Sep 14 09:19:03.987786 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:19:03.987786 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:19:03.987786 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 17918433a3994b69a65999a59a7f833c Sep 14 09:19:03.987786 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-TestNetworkBasicOps-1034807082-project Sep 14 09:19:03.987786 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:19:03.987786 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance f31deffe-182e-46b5-9643-725b7d7b4561 could not be found. Sep 14 09:19:03.987786 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': 'f31deffe-182e-46b5-9643-725b7d7b4561'} Sep 14 09:19:03.987786 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:19:03.987786 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:19:03.987786 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:19:03.987786 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:19:03.987786 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:19:03.987786 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:19:03.987786 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:19:03.987786 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:19:03.987786 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:19:03.987786 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:19:03.987786 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f31deffe-182e-46b5-9643-725b7d7b4561 could not be found. Sep 14 09:19:03.987786 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:19:03.987786 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:19:03.987786 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:19:03.987786 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:19:03.987786 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:19:03.987786 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:19:03.987786 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:19:03.987786 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:19:03.987786 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:19:03.987786 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:19:03.987786 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:19:03.987786 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:19:03.987786 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:19:03.987786 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:19:03.987786 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:19:03.987786 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:19:03.987786 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f31deffe-182e-46b5-9643-725b7d7b4561 could not be found. Sep 14 09:19:03.987786 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:19:03.987786 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:19:03.987786 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:19:03.993564 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:19:03.993564 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:19:03.993564 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:19:03.993564 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:19:03.993564 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:19:03.993564 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f31deffe-182e-46b5-9643-725b7d7b4561 could not be found. Sep 14 09:19:03.993564 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:19:03.995222 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d651d2ea-4e20-4221-a025-f2b07e05594d tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Returning 404 to user: Instance f31deffe-182e-46b5-9643-725b7d7b4561 could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:19:03.996324 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d651d2ea-4e20-4221-a025-f2b07e05594d tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] 10.222.0.60 "GET /compute/v2.1/servers/f31deffe-182e-46b5-9643-725b7d7b4561" status: 404 len: 111 microversion: 2.1 time: 0.056386 Sep 14 09:19:03.998042 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2843/5713] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:19:03 2022] GET /compute/v2.1/servers/f31deffe-182e-46b5-9643-725b7d7b4561 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:19:04.194587 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-4a7eddeb-6e37-4169-9ac5-82fc68400b08 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:04.195535 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-4a7eddeb-6e37-4169-9ac5-82fc68400b08 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] [instance: 022379ab-af51-495a-bcef-11e43774a7b0] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:04.207174 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4a7eddeb-6e37-4169-9ac5-82fc68400b08 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:04.207684 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4a7eddeb-6e37-4169-9ac5-82fc68400b08 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:04.208126 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4a7eddeb-6e37-4169-9ac5-82fc68400b08 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:04.208840 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4a7eddeb-6e37-4169-9ac5-82fc68400b08 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:04.209293 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4a7eddeb-6e37-4169-9ac5-82fc68400b08 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:04.211999 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4a7eddeb-6e37-4169-9ac5-82fc68400b08 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:04.271883 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-1e2fae8b-0119-4bf2-a8eb-2cc5f2a7372a tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] Calling method '.version_select at 0x7f7d3ee2f0d0>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:04.334863 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-1e2fae8b-0119-4bf2-a8eb-2cc5f2a7372a tempest-TestNetworkBasicOps-1034807082 tempest-TestNetworkBasicOps-1034807082-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-2024510798" status: 202 len: 0 microversion: 2.1 time: 0.067043 Sep 14 09:19:04.335506 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2844/5714] 10.222.0.60 () {58 vars in 1257 bytes} [Wed Sep 14 09:19:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-2024510798 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 14 09:19:04.340977 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b58d441d-bd89-45b7-b46e-d99f7211298c tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:04.341630 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b58d441d-bd89-45b7-b46e-d99f7211298c tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] [instance: 8b671025-214d-4349-9b4a-4f23fa069ae5] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:04.362866 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b58d441d-bd89-45b7-b46e-d99f7211298c tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:04.363400 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b58d441d-bd89-45b7-b46e-d99f7211298c tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:04.363844 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b58d441d-bd89-45b7-b46e-d99f7211298c tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:04.364559 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b58d441d-bd89-45b7-b46e-d99f7211298c tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:04.365023 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b58d441d-bd89-45b7-b46e-d99f7211298c tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:04.365458 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b58d441d-bd89-45b7-b46e-d99f7211298c tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:04.397151 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-4a7eddeb-6e37-4169-9ac5-82fc68400b08 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9568f2d3f644e409961ab34e8fa95cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8638ed7d7b3d4285b36865282b8caeab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:04.406088 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-4a7eddeb-6e37-4169-9ac5-82fc68400b08 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] 10.222.0.60 "GET /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0" status: 200 len: 1289 microversion: 2.1 time: 0.216018 Sep 14 09:19:04.411694 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2871/5715] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:19:04 2022] GET /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0 => generated 1289 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:19:04.708352 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b58d441d-bd89-45b7-b46e-d99f7211298c tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf41bb7d024a8c86a385ac47561b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17da1bc0ed09449aa10d4a4ff9117f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:04.719143 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b58d441d-bd89-45b7-b46e-d99f7211298c tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] 10.222.0.60 "GET /compute/v2.1/servers/8b671025-214d-4349-9b4a-4f23fa069ae5" status: 200 len: 1500 microversion: 2.1 time: 0.382514 Sep 14 09:19:04.719836 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2845/5716] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:19:04 2022] GET /compute/v2.1/servers/8b671025-214d-4349-9b4a-4f23fa069ae5 => generated 1500 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:19:05.430537 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1ac5870f-92b1-4d9a-b99d-10439619be3d tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:05.431138 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-1ac5870f-92b1-4d9a-b99d-10439619be3d tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] [instance: 022379ab-af51-495a-bcef-11e43774a7b0] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:05.448263 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1ac5870f-92b1-4d9a-b99d-10439619be3d tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:05.449090 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1ac5870f-92b1-4d9a-b99d-10439619be3d tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:05.449706 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1ac5870f-92b1-4d9a-b99d-10439619be3d tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:05.450624 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1ac5870f-92b1-4d9a-b99d-10439619be3d tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:05.463716 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1ac5870f-92b1-4d9a-b99d-10439619be3d tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:05.464517 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1ac5870f-92b1-4d9a-b99d-10439619be3d tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:05.745609 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-2a89a848-8b9b-4df2-8969-47d9ac98f41f tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:05.746231 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-2a89a848-8b9b-4df2-8969-47d9ac98f41f tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] [instance: 8b671025-214d-4349-9b4a-4f23fa069ae5] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:05.761987 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2a89a848-8b9b-4df2-8969-47d9ac98f41f tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:05.762902 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2a89a848-8b9b-4df2-8969-47d9ac98f41f tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:05.763525 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2a89a848-8b9b-4df2-8969-47d9ac98f41f tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:05.764631 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2a89a848-8b9b-4df2-8969-47d9ac98f41f tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:05.765267 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2a89a848-8b9b-4df2-8969-47d9ac98f41f tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:05.766868 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2a89a848-8b9b-4df2-8969-47d9ac98f41f tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:05.782258 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-1ac5870f-92b1-4d9a-b99d-10439619be3d tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9568f2d3f644e409961ab34e8fa95cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8638ed7d7b3d4285b36865282b8caeab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:05.796512 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-1ac5870f-92b1-4d9a-b99d-10439619be3d tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] 10.222.0.60 "GET /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0" status: 200 len: 1363 microversion: 2.1 time: 0.370971 Sep 14 09:19:05.811924 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:19:05.821644 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2872/5717] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:19:05 2022] GET /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0 => generated 1363 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:19:06.256751 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-2a89a848-8b9b-4df2-8969-47d9ac98f41f tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf41bb7d024a8c86a385ac47561b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17da1bc0ed09449aa10d4a4ff9117f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:06.272091 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-2a89a848-8b9b-4df2-8969-47d9ac98f41f tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] 10.222.0.60 "GET /compute/v2.1/servers/8b671025-214d-4349-9b4a-4f23fa069ae5" status: 200 len: 1503 microversion: 2.1 time: 0.530263 Sep 14 09:19:06.278742 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2846/5718] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:19:05 2022] GET /compute/v2.1/servers/8b671025-214d-4349-9b4a-4f23fa069ae5 => generated 1503 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:19:06.309355 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-8496efab-9904-40e5-9599-74f08dca8430 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:19:06.310160 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-8496efab-9904-40e5-9599-74f08dca8430 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] [instance: 8b671025-214d-4349-9b4a-4f23fa069ae5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:06.321676 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8496efab-9904-40e5-9599-74f08dca8430 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:06.322563 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8496efab-9904-40e5-9599-74f08dca8430 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:06.325349 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8496efab-9904-40e5-9599-74f08dca8430 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:06.327732 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8496efab-9904-40e5-9599-74f08dca8430 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:06.330435 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8496efab-9904-40e5-9599-74f08dca8430 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:06.331719 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8496efab-9904-40e5-9599-74f08dca8430 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:06.827822 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c49df2c8-8c32-4572-8ba3-f5bf6526eed4 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:06.828466 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-c49df2c8-8c32-4572-8ba3-f5bf6526eed4 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] [instance: 022379ab-af51-495a-bcef-11e43774a7b0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:06.846299 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c49df2c8-8c32-4572-8ba3-f5bf6526eed4 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:06.850751 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c49df2c8-8c32-4572-8ba3-f5bf6526eed4 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:06.851635 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c49df2c8-8c32-4572-8ba3-f5bf6526eed4 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:06.853320 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c49df2c8-8c32-4572-8ba3-f5bf6526eed4 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:06.856260 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c49df2c8-8c32-4572-8ba3-f5bf6526eed4 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:06.859668 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c49df2c8-8c32-4572-8ba3-f5bf6526eed4 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:06.907870 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.objects.instance [None req-8496efab-9904-40e5-9599-74f08dca8430 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Lazy-loading 'flavor' on Instance uuid 8b671025-214d-4349-9b4a-4f23fa069ae5 {{(pid=128758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:19:07.016325 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-8496efab-9904-40e5-9599-74f08dca8430 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] 10.222.0.60 "POST /compute/v2.1/servers/8b671025-214d-4349-9b4a-4f23fa069ae5/action" status: 202 len: 0 microversion: 2.1 time: 0.713501 Sep 14 09:19:07.033119 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2873/5719] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:19:06 2022] POST /compute/v2.1/servers/8b671025-214d-4349-9b4a-4f23fa069ae5/action => generated 0 bytes in 730 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:19:07.066519 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-e600f8ad-fe6e-4966-8579-19625084547e tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1584364037", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "74bb7a5b-218d-4c3f-a039-ea51c9690838"}], "security_groups": [{"name": "tempest-securitygroup--1058634340"}], "key_name": "tempest-keypair-1997239530", "user_data": "}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:19:07.327841 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.network.neutron [None req-e600f8ad-fe6e-4966-8579-19625084547e tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] validate_networks() for [('74bb7a5b-218d-4c3f-a039-ea51c9690838', None, None, None, None, None)] {{(pid=128758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:19:07.344906 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-c49df2c8-8c32-4572-8ba3-f5bf6526eed4 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9568f2d3f644e409961ab34e8fa95cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8638ed7d7b3d4285b36865282b8caeab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:07.357616 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-c49df2c8-8c32-4572-8ba3-f5bf6526eed4 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] 10.222.0.60 "GET /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0" status: 200 len: 1363 microversion: 2.1 time: 0.535109 Sep 14 09:19:07.358393 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2847/5720] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:19:06 2022] GET /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0 => generated 1363 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:19:07.370335 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-372d11fe-7426-421f-a8b3-2a9073821ba9 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:07.371915 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-372d11fe-7426-421f-a8b3-2a9073821ba9 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] [instance: 8b671025-214d-4349-9b4a-4f23fa069ae5] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:07.381186 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-372d11fe-7426-421f-a8b3-2a9073821ba9 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:07.382042 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-372d11fe-7426-421f-a8b3-2a9073821ba9 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:07.382698 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-372d11fe-7426-421f-a8b3-2a9073821ba9 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:07.383634 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-372d11fe-7426-421f-a8b3-2a9073821ba9 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:07.384262 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-372d11fe-7426-421f-a8b3-2a9073821ba9 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:07.385488 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-372d11fe-7426-421f-a8b3-2a9073821ba9 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:07.772570 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-372d11fe-7426-421f-a8b3-2a9073821ba9 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf41bb7d024a8c86a385ac47561b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17da1bc0ed09449aa10d4a4ff9117f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:07.783565 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-372d11fe-7426-421f-a8b3-2a9073821ba9 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] 10.222.0.60 "GET /compute/v2.1/servers/8b671025-214d-4349-9b4a-4f23fa069ae5" status: 200 len: 1511 microversion: 2.1 time: 0.422637 Sep 14 09:19:07.784978 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2848/5721] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:19:07 2022] GET /compute/v2.1/servers/8b671025-214d-4349-9b4a-4f23fa069ae5 => generated 1511 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:19:07.985140 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-e88ae4ea-bb35-4c7b-a233-6fae5feff71d req-62dc3add-4b78-495c-a259-d0b488a05c17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "022379ab-af51-495a-bcef-11e43774a7b0", "tag": "978742e8-02b6-4b3b-8b11-e9cef9c890d0"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:19:08.010598 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-e88ae4ea-bb35-4c7b-a233-6fae5feff71d req-62dc3add-4b78-495c-a259-d0b488a05c17 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:08.011771 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-e88ae4ea-bb35-4c7b-a233-6fae5feff71d req-62dc3add-4b78-495c-a259-d0b488a05c17 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:08.012822 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-e88ae4ea-bb35-4c7b-a233-6fae5feff71d req-62dc3add-4b78-495c-a259-d0b488a05c17 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:08.040338 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-e88ae4ea-bb35-4c7b-a233-6fae5feff71d req-62dc3add-4b78-495c-a259-d0b488a05c17 service nova] Creating event network-changed:978742e8-02b6-4b3b-8b11-e9cef9c890d0 for instance 022379ab-af51-495a-bcef-11e43774a7b0 on n-h1-836830-18 Sep 14 09:19:08.046106 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-e88ae4ea-bb35-4c7b-a233-6fae5feff71d req-62dc3add-4b78-495c-a259-d0b488a05c17 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064924 Sep 14 09:19:08.047460 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2849/5722] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:19:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:19:08.383247 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-0fbbea07-9438-4737-b039-746498053ebb tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:08.384142 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-0fbbea07-9438-4737-b039-746498053ebb tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] [instance: 022379ab-af51-495a-bcef-11e43774a7b0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:08.403777 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0fbbea07-9438-4737-b039-746498053ebb tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:08.404500 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0fbbea07-9438-4737-b039-746498053ebb tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:08.407758 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0fbbea07-9438-4737-b039-746498053ebb tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:08.409093 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0fbbea07-9438-4737-b039-746498053ebb tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:08.411893 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0fbbea07-9438-4737-b039-746498053ebb tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:08.414722 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0fbbea07-9438-4737-b039-746498053ebb tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:08.415778 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-e600f8ad-fe6e-4966-8579-19625084547e tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Flavor limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:19:08.417858 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-e600f8ad-fe6e-4966-8579-19625084547e tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Image limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:19:08.418962 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-e600f8ad-fe6e-4966-8579-19625084547e tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Flavor pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:19:08.419607 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-e600f8ad-fe6e-4966-8579-19625084547e tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Image pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:19:08.420282 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-e600f8ad-fe6e-4966-8579-19625084547e tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:19:08.441804 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e600f8ad-fe6e-4966-8579-19625084547e tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:08.443595 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e600f8ad-fe6e-4966-8579-19625084547e tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:08.444549 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e600f8ad-fe6e-4966-8579-19625084547e tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:08.447616 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e600f8ad-fe6e-4966-8579-19625084547e tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:08.451280 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e600f8ad-fe6e-4966-8579-19625084547e tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:08.452051 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e600f8ad-fe6e-4966-8579-19625084547e tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:08.514110 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-e600f8ad-fe6e-4966-8579-19625084547e tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Getting quotas for project 229e11b3c1fe48b088d0f3c4bb7e2cb6. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:19:08.521023 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-e600f8ad-fe6e-4966-8579-19625084547e tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Getting quotas for user d03dc827647f4483beb2e1b7888be608 and project 229e11b3c1fe48b088d0f3c4bb7e2cb6. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:19:08.535267 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-e600f8ad-fe6e-4966-8579-19625084547e tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Going to run 1 instances... {{(pid=128758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:19:08.538217 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-e600f8ad-fe6e-4966-8579-19625084547e tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 600cbae0-3580-4e55-9577-33b7a08439ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:19:08.630261 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-e600f8ad-fe6e-4966-8579-19625084547e tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.594287 Sep 14 09:19:08.640684 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2874/5723] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 09:19:07 2022] POST /compute/v2.1/servers => generated 409 bytes in 1607 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:19:08.647319 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c0564d69-d390-418d-82c5-f6b45513ba49 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:08.651893 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-c0564d69-d390-418d-82c5-f6b45513ba49 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 600cbae0-3580-4e55-9577-33b7a08439ad] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:08.853011 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-c0564d69-d390-418d-82c5-f6b45513ba49 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03dc827647f4483beb2e1b7888be608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229e11b3c1fe48b088d0f3c4bb7e2cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:08.862483 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-c0564d69-d390-418d-82c5-f6b45513ba49 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "GET /compute/v2.1/servers/600cbae0-3580-4e55-9577-33b7a08439ad" status: 200 len: 1246 microversion: 2.1 time: 0.219289 Sep 14 09:19:08.864892 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2875/5724] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:19:08 2022] GET /compute/v2.1/servers/600cbae0-3580-4e55-9577-33b7a08439ad => generated 1246 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:19:08.879917 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-bb910500-3eb2-4249-8af3-a660e2580b7a tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:08.880828 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-bb910500-3eb2-4249-8af3-a660e2580b7a tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] [instance: 8b671025-214d-4349-9b4a-4f23fa069ae5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:08.895391 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bb910500-3eb2-4249-8af3-a660e2580b7a tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:08.897735 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bb910500-3eb2-4249-8af3-a660e2580b7a tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:08.898599 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bb910500-3eb2-4249-8af3-a660e2580b7a tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:08.901032 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bb910500-3eb2-4249-8af3-a660e2580b7a tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:08.902921 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bb910500-3eb2-4249-8af3-a660e2580b7a tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:08.908633 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bb910500-3eb2-4249-8af3-a660e2580b7a tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:09.041363 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-0fbbea07-9438-4737-b039-746498053ebb tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9568f2d3f644e409961ab34e8fa95cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8638ed7d7b3d4285b36865282b8caeab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:09.054107 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-0fbbea07-9438-4737-b039-746498053ebb tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] 10.222.0.60 "GET /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0" status: 200 len: 1363 microversion: 2.1 time: 0.676994 Sep 14 09:19:09.077409 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2850/5725] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:19:08 2022] GET /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0 => generated 1363 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:19:09.385753 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-bb910500-3eb2-4249-8af3-a660e2580b7a tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf41bb7d024a8c86a385ac47561b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17da1bc0ed09449aa10d4a4ff9117f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:09.398180 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-bb910500-3eb2-4249-8af3-a660e2580b7a tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] 10.222.0.60 "GET /compute/v2.1/servers/8b671025-214d-4349-9b4a-4f23fa069ae5" status: 200 len: 1494 microversion: 2.1 time: 0.529887 Sep 14 09:19:09.401710 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2876/5726] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:19:08 2022] GET /compute/v2.1/servers/8b671025-214d-4349-9b4a-4f23fa069ae5 => generated 1494 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:19:09.426797 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-5969bd09-81b2-4368-8c81-5397eae4fb35 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:19:09.427914 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-5969bd09-81b2-4368-8c81-5397eae4fb35 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] [instance: 8b671025-214d-4349-9b4a-4f23fa069ae5] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:09.442189 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5969bd09-81b2-4368-8c81-5397eae4fb35 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:09.447037 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5969bd09-81b2-4368-8c81-5397eae4fb35 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:09.449098 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5969bd09-81b2-4368-8c81-5397eae4fb35 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:09.453282 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5969bd09-81b2-4368-8c81-5397eae4fb35 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:09.457399 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5969bd09-81b2-4368-8c81-5397eae4fb35 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:09.458703 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5969bd09-81b2-4368-8c81-5397eae4fb35 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:09.703268 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-5969bd09-81b2-4368-8c81-5397eae4fb35 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] 10.222.0.60 "POST /compute/v2.1/servers/8b671025-214d-4349-9b4a-4f23fa069ae5/action" status: 202 len: 0 microversion: 2.1 time: 0.280797 Sep 14 09:19:09.718072 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2851/5727] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:19:09 2022] POST /compute/v2.1/servers/8b671025-214d-4349-9b4a-4f23fa069ae5/action => generated 0 bytes in 296 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:19:09.721516 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-7ec75184-693a-4e71-93ed-4dd34c3fac40 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:09.722197 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-7ec75184-693a-4e71-93ed-4dd34c3fac40 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] [instance: 8b671025-214d-4349-9b4a-4f23fa069ae5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:09.763281 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7ec75184-693a-4e71-93ed-4dd34c3fac40 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:09.771822 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7ec75184-693a-4e71-93ed-4dd34c3fac40 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:09.773417 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7ec75184-693a-4e71-93ed-4dd34c3fac40 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:09.776061 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7ec75184-693a-4e71-93ed-4dd34c3fac40 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:09.776789 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7ec75184-693a-4e71-93ed-4dd34c3fac40 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:09.777611 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7ec75184-693a-4e71-93ed-4dd34c3fac40 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:09.888608 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-0291ff42-f93a-4175-948a-9d4ee9144fcb tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:09.889436 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-0291ff42-f93a-4175-948a-9d4ee9144fcb tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 600cbae0-3580-4e55-9577-33b7a08439ad] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:10.063736 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-0291ff42-f93a-4175-948a-9d4ee9144fcb tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03dc827647f4483beb2e1b7888be608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229e11b3c1fe48b088d0f3c4bb7e2cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:10.079043 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-0291ff42-f93a-4175-948a-9d4ee9144fcb tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "GET /compute/v2.1/servers/600cbae0-3580-4e55-9577-33b7a08439ad" status: 200 len: 1246 microversion: 2.1 time: 0.194926 Sep 14 09:19:10.079847 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2852/5728] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:19:09 2022] GET /compute/v2.1/servers/600cbae0-3580-4e55-9577-33b7a08439ad => generated 1246 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:19:10.095672 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-bde7b0b6-d8f0-4802-9b88-501ab38232fe tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:10.096687 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-bde7b0b6-d8f0-4802-9b88-501ab38232fe tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] [instance: 022379ab-af51-495a-bcef-11e43774a7b0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:10.103337 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bde7b0b6-d8f0-4802-9b88-501ab38232fe tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:10.106395 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bde7b0b6-d8f0-4802-9b88-501ab38232fe tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:10.109437 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bde7b0b6-d8f0-4802-9b88-501ab38232fe tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:10.110429 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bde7b0b6-d8f0-4802-9b88-501ab38232fe tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:10.113215 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bde7b0b6-d8f0-4802-9b88-501ab38232fe tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:10.113856 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bde7b0b6-d8f0-4802-9b88-501ab38232fe tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:10.138399 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-7ec75184-693a-4e71-93ed-4dd34c3fac40 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf41bb7d024a8c86a385ac47561b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17da1bc0ed09449aa10d4a4ff9117f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:10.149783 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-7ec75184-693a-4e71-93ed-4dd34c3fac40 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] 10.222.0.60 "GET /compute/v2.1/servers/8b671025-214d-4349-9b4a-4f23fa069ae5" status: 200 len: 1500 microversion: 2.1 time: 0.438145 Sep 14 09:19:10.155640 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2877/5729] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:19:09 2022] GET /compute/v2.1/servers/8b671025-214d-4349-9b4a-4f23fa069ae5 => generated 1500 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:19:10.446308 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-bde7b0b6-d8f0-4802-9b88-501ab38232fe tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9568f2d3f644e409961ab34e8fa95cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8638ed7d7b3d4285b36865282b8caeab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:10.459950 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-bde7b0b6-d8f0-4802-9b88-501ab38232fe tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] 10.222.0.60 "GET /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0" status: 200 len: 1363 microversion: 2.1 time: 0.378801 Sep 14 09:19:10.464425 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2853/5730] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:19:10 2022] GET /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0 => generated 1363 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:19:11.105910 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-893768b7-e3d9-4ac7-b858-8c289201d19b tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:11.106541 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-893768b7-e3d9-4ac7-b858-8c289201d19b tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 600cbae0-3580-4e55-9577-33b7a08439ad] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:11.126651 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-893768b7-e3d9-4ac7-b858-8c289201d19b tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:11.127742 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-893768b7-e3d9-4ac7-b858-8c289201d19b tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:11.133735 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-893768b7-e3d9-4ac7-b858-8c289201d19b tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:11.136995 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-893768b7-e3d9-4ac7-b858-8c289201d19b tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:11.140911 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-893768b7-e3d9-4ac7-b858-8c289201d19b tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:11.141753 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-893768b7-e3d9-4ac7-b858-8c289201d19b tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:11.178861 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-cc354a18-1d36-4260-bb64-8a814ce4ada7 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:11.179818 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-cc354a18-1d36-4260-bb64-8a814ce4ada7 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] [instance: 8b671025-214d-4349-9b4a-4f23fa069ae5] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:11.200048 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=1,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:19:11.202502 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cc354a18-1d36-4260-bb64-8a814ce4ada7 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:11.206682 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cc354a18-1d36-4260-bb64-8a814ce4ada7 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:11.207378 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cc354a18-1d36-4260-bb64-8a814ce4ada7 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:11.208838 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cc354a18-1d36-4260-bb64-8a814ce4ada7 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:11.209537 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cc354a18-1d36-4260-bb64-8a814ce4ada7 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:11.210963 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cc354a18-1d36-4260-bb64-8a814ce4ada7 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:11.342026 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-893768b7-e3d9-4ac7-b858-8c289201d19b tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03dc827647f4483beb2e1b7888be608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229e11b3c1fe48b088d0f3c4bb7e2cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:11.356293 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-893768b7-e3d9-4ac7-b858-8c289201d19b tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "GET /compute/v2.1/servers/600cbae0-3580-4e55-9577-33b7a08439ad" status: 200 len: 1250 microversion: 2.1 time: 0.256140 Sep 14 09:19:11.364436 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2878/5731] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:19:11 2022] GET /compute/v2.1/servers/600cbae0-3580-4e55-9577-33b7a08439ad => generated 1250 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:19:11.491757 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c8321c91-7a62-4943-9bc2-8d6d04e26a83 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:11.492592 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-c8321c91-7a62-4943-9bc2-8d6d04e26a83 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] [instance: 022379ab-af51-495a-bcef-11e43774a7b0] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:11.502388 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c8321c91-7a62-4943-9bc2-8d6d04e26a83 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:11.503405 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c8321c91-7a62-4943-9bc2-8d6d04e26a83 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:11.504221 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c8321c91-7a62-4943-9bc2-8d6d04e26a83 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:11.505190 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c8321c91-7a62-4943-9bc2-8d6d04e26a83 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:11.506114 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c8321c91-7a62-4943-9bc2-8d6d04e26a83 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:11.507146 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c8321c91-7a62-4943-9bc2-8d6d04e26a83 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:11.873118 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-cc354a18-1d36-4260-bb64-8a814ce4ada7 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf41bb7d024a8c86a385ac47561b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17da1bc0ed09449aa10d4a4ff9117f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:11.884876 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-cc354a18-1d36-4260-bb64-8a814ce4ada7 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] 10.222.0.60 "GET /compute/v2.1/servers/8b671025-214d-4349-9b4a-4f23fa069ae5" status: 200 len: 1500 microversion: 2.1 time: 0.710838 Sep 14 09:19:11.886300 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2854/5732] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:19:11 2022] GET /compute/v2.1/servers/8b671025-214d-4349-9b4a-4f23fa069ae5 => generated 1500 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:19:11.938742 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-c8321c91-7a62-4943-9bc2-8d6d04e26a83 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9568f2d3f644e409961ab34e8fa95cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8638ed7d7b3d4285b36865282b8caeab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:11.948375 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-c8321c91-7a62-4943-9bc2-8d6d04e26a83 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] 10.222.0.60 "GET /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0" status: 200 len: 1363 microversion: 2.1 time: 0.461014 Sep 14 09:19:11.953375 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2879/5733] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:19:11 2022] GET /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0 => generated 1363 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:19:12.381629 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-df3d3336-2e2a-4f4f-961e-685ad389011a tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:12.382720 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-df3d3336-2e2a-4f4f-961e-685ad389011a tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 600cbae0-3580-4e55-9577-33b7a08439ad] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:12.395932 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-df3d3336-2e2a-4f4f-961e-685ad389011a tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:12.396393 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-df3d3336-2e2a-4f4f-961e-685ad389011a tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:12.396865 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-df3d3336-2e2a-4f4f-961e-685ad389011a tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:12.401483 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-df3d3336-2e2a-4f4f-961e-685ad389011a tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:12.403128 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-df3d3336-2e2a-4f4f-961e-685ad389011a tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:12.403801 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-df3d3336-2e2a-4f4f-961e-685ad389011a tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:12.618482 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-df3d3336-2e2a-4f4f-961e-685ad389011a tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03dc827647f4483beb2e1b7888be608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229e11b3c1fe48b088d0f3c4bb7e2cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:12.633950 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-df3d3336-2e2a-4f4f-961e-685ad389011a tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "GET /compute/v2.1/servers/600cbae0-3580-4e55-9577-33b7a08439ad" status: 200 len: 1298 microversion: 2.1 time: 0.255889 Sep 14 09:19:12.636588 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2855/5734] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:19:12 2022] GET /compute/v2.1/servers/600cbae0-3580-4e55-9577-33b7a08439ad => generated 1298 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:19:12.917582 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c60c9a5d-faac-4a3f-b40b-c139c1744609 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:12.918747 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-c60c9a5d-faac-4a3f-b40b-c139c1744609 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] [instance: 8b671025-214d-4349-9b4a-4f23fa069ae5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:12.940162 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c60c9a5d-faac-4a3f-b40b-c139c1744609 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:12.942048 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c60c9a5d-faac-4a3f-b40b-c139c1744609 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:12.945369 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c60c9a5d-faac-4a3f-b40b-c139c1744609 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:12.946419 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c60c9a5d-faac-4a3f-b40b-c139c1744609 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:12.948573 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c60c9a5d-faac-4a3f-b40b-c139c1744609 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:12.950705 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c60c9a5d-faac-4a3f-b40b-c139c1744609 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:12.980840 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-064163b7-00e0-44fe-9c7e-d5eb5baa1098 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:12.984321 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-064163b7-00e0-44fe-9c7e-d5eb5baa1098 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] [instance: 022379ab-af51-495a-bcef-11e43774a7b0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:13.006101 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-064163b7-00e0-44fe-9c7e-d5eb5baa1098 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:13.007922 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-064163b7-00e0-44fe-9c7e-d5eb5baa1098 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:13.009959 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-064163b7-00e0-44fe-9c7e-d5eb5baa1098 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:13.014057 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-064163b7-00e0-44fe-9c7e-d5eb5baa1098 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:13.015779 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-064163b7-00e0-44fe-9c7e-d5eb5baa1098 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:13.018224 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-064163b7-00e0-44fe-9c7e-d5eb5baa1098 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:13.527816 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-c60c9a5d-faac-4a3f-b40b-c139c1744609 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf41bb7d024a8c86a385ac47561b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17da1bc0ed09449aa10d4a4ff9117f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:13.545087 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-c60c9a5d-faac-4a3f-b40b-c139c1744609 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] 10.222.0.60 "GET /compute/v2.1/servers/8b671025-214d-4349-9b4a-4f23fa069ae5" status: 200 len: 1503 microversion: 2.1 time: 0.639960 Sep 14 09:19:13.547139 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2880/5735] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:19:12 2022] GET /compute/v2.1/servers/8b671025-214d-4349-9b4a-4f23fa069ae5 => generated 1503 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:19:13.581272 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-dbe15685-5b5b-4de6-a616-284b6c73b430 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:13.585926 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-dbe15685-5b5b-4de6-a616-284b6c73b430 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] [instance: 8b671025-214d-4349-9b4a-4f23fa069ae5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:13.603049 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dbe15685-5b5b-4de6-a616-284b6c73b430 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:13.603981 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dbe15685-5b5b-4de6-a616-284b6c73b430 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:13.604679 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dbe15685-5b5b-4de6-a616-284b6c73b430 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:13.606143 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dbe15685-5b5b-4de6-a616-284b6c73b430 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:13.607245 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dbe15685-5b5b-4de6-a616-284b6c73b430 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:13.608299 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dbe15685-5b5b-4de6-a616-284b6c73b430 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:13.641030 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-064163b7-00e0-44fe-9c7e-d5eb5baa1098 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9568f2d3f644e409961ab34e8fa95cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8638ed7d7b3d4285b36865282b8caeab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:13.651533 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-064163b7-00e0-44fe-9c7e-d5eb5baa1098 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] 10.222.0.60 "GET /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0" status: 200 len: 1363 microversion: 2.1 time: 0.680110 Sep 14 09:19:13.654710 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2856/5736] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:19:12 2022] GET /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0 => generated 1363 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:19:13.667123 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-96c88621-8059-4f2e-861b-f33a7f6c0bf6 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:13.668959 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-96c88621-8059-4f2e-861b-f33a7f6c0bf6 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 600cbae0-3580-4e55-9577-33b7a08439ad] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:13.677231 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:19:13.684033 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-96c88621-8059-4f2e-861b-f33a7f6c0bf6 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:13.684830 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-96c88621-8059-4f2e-861b-f33a7f6c0bf6 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:13.688765 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-96c88621-8059-4f2e-861b-f33a7f6c0bf6 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:13.689705 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-96c88621-8059-4f2e-861b-f33a7f6c0bf6 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:13.690367 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-96c88621-8059-4f2e-861b-f33a7f6c0bf6 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:13.691313 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-96c88621-8059-4f2e-861b-f33a7f6c0bf6 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:13.702453 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-dbe15685-5b5b-4de6-a616-284b6c73b430 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] [instance: 8b671025-214d-4349-9b4a-4f23fa069ae5] Going to try to terminate instance {{(pid=128758) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:19:13.989238 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-dbe15685-5b5b-4de6-a616-284b6c73b430 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] 10.222.0.60 "DELETE /compute/v2.1/servers/8b671025-214d-4349-9b4a-4f23fa069ae5" status: 204 len: 0 microversion: 2.1 time: 0.421846 Sep 14 09:19:13.997636 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2881/5737] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:19:13 2022] DELETE /compute/v2.1/servers/8b671025-214d-4349-9b4a-4f23fa069ae5 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:19:14.012479 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-f8536bd4-387f-4c0e-a5a2-516f45672229 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:14.023700 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-f8536bd4-387f-4c0e-a5a2-516f45672229 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] [instance: 8b671025-214d-4349-9b4a-4f23fa069ae5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:14.031077 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f8536bd4-387f-4c0e-a5a2-516f45672229 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:14.031832 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f8536bd4-387f-4c0e-a5a2-516f45672229 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:14.032429 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f8536bd4-387f-4c0e-a5a2-516f45672229 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:14.033311 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f8536bd4-387f-4c0e-a5a2-516f45672229 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:14.035098 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f8536bd4-387f-4c0e-a5a2-516f45672229 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:14.036908 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f8536bd4-387f-4c0e-a5a2-516f45672229 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:14.872720 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-f8536bd4-387f-4c0e-a5a2-516f45672229 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf41bb7d024a8c86a385ac47561b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17da1bc0ed09449aa10d4a4ff9117f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:14.884615 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-f8536bd4-387f-4c0e-a5a2-516f45672229 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] 10.222.0.60 "GET /compute/v2.1/servers/8b671025-214d-4349-9b4a-4f23fa069ae5" status: 200 len: 1509 microversion: 2.1 time: 0.879810 Sep 14 09:19:14.898964 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2882/5738] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:19:14 2022] GET /compute/v2.1/servers/8b671025-214d-4349-9b4a-4f23fa069ae5 => generated 1509 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:19:14.904269 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-fdc518f9-4b75-43f4-baf2-61424ab0d32a tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:14.905827 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-fdc518f9-4b75-43f4-baf2-61424ab0d32a tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] [instance: 022379ab-af51-495a-bcef-11e43774a7b0] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:14.914788 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fdc518f9-4b75-43f4-baf2-61424ab0d32a tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:14.916777 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fdc518f9-4b75-43f4-baf2-61424ab0d32a tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:14.918157 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fdc518f9-4b75-43f4-baf2-61424ab0d32a tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:14.919208 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fdc518f9-4b75-43f4-baf2-61424ab0d32a tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:14.919688 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fdc518f9-4b75-43f4-baf2-61424ab0d32a tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:14.920130 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fdc518f9-4b75-43f4-baf2-61424ab0d32a tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:14.936221 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-96c88621-8059-4f2e-861b-f33a7f6c0bf6 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03dc827647f4483beb2e1b7888be608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229e11b3c1fe48b088d0f3c4bb7e2cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:14.954764 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-96c88621-8059-4f2e-861b-f33a7f6c0bf6 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "GET /compute/v2.1/servers/600cbae0-3580-4e55-9577-33b7a08439ad" status: 200 len: 1372 microversion: 2.1 time: 1.296369 Sep 14 09:19:14.958309 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2857/5739] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:19:13 2022] GET /compute/v2.1/servers/600cbae0-3580-4e55-9577-33b7a08439ad => generated 1372 bytes in 1301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:19:15.025157 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-bc140fae-e6d5-4c4d-ad92-910363dde7e3 req-3b8eaa3c-ebc3-4f25-97d5-fd86a675fbe7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "022379ab-af51-495a-bcef-11e43774a7b0", "name": "network-vif-plugged", "status": "completed", "tag": "978742e8-02b6-4b3b-8b11-e9cef9c890d0"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:19:15.040853 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-bc140fae-e6d5-4c4d-ad92-910363dde7e3 req-3b8eaa3c-ebc3-4f25-97d5-fd86a675fbe7 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:15.042155 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-bc140fae-e6d5-4c4d-ad92-910363dde7e3 req-3b8eaa3c-ebc3-4f25-97d5-fd86a675fbe7 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:15.043099 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-bc140fae-e6d5-4c4d-ad92-910363dde7e3 req-3b8eaa3c-ebc3-4f25-97d5-fd86a675fbe7 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:15.071793 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-bc140fae-e6d5-4c4d-ad92-910363dde7e3 req-3b8eaa3c-ebc3-4f25-97d5-fd86a675fbe7 service nova] Creating event network-vif-plugged:978742e8-02b6-4b3b-8b11-e9cef9c890d0 for instance 022379ab-af51-495a-bcef-11e43774a7b0 on n-h1-836830-18 Sep 14 09:19:15.082529 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-bc140fae-e6d5-4c4d-ad92-910363dde7e3 req-3b8eaa3c-ebc3-4f25-97d5-fd86a675fbe7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061659 Sep 14 09:19:15.084478 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2858/5740] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:19:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:19:15.339407 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-fdc518f9-4b75-43f4-baf2-61424ab0d32a tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9568f2d3f644e409961ab34e8fa95cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8638ed7d7b3d4285b36865282b8caeab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:15.349696 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-fdc518f9-4b75-43f4-baf2-61424ab0d32a tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] 10.222.0.60 "GET /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0" status: 200 len: 1363 microversion: 2.1 time: 0.459436 Sep 14 09:19:15.359707 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2883/5741] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:19:14 2022] GET /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0 => generated 1363 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:19:15.739520 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-52df2e67-f1d5-4c0f-bff7-32b920749781 req-4a211778-73af-42b0-9d4e-9a9501869735 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "600cbae0-3580-4e55-9577-33b7a08439ad", "tag": "2ab6288f-9f5a-4572-8493-c7c83f0cc3e1"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:19:15.755975 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-52df2e67-f1d5-4c0f-bff7-32b920749781 req-4a211778-73af-42b0-9d4e-9a9501869735 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:15.756376 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-52df2e67-f1d5-4c0f-bff7-32b920749781 req-4a211778-73af-42b0-9d4e-9a9501869735 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:15.756814 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-52df2e67-f1d5-4c0f-bff7-32b920749781 req-4a211778-73af-42b0-9d4e-9a9501869735 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:15.781916 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-52df2e67-f1d5-4c0f-bff7-32b920749781 req-4a211778-73af-42b0-9d4e-9a9501869735 service nova] Creating event network-changed:2ab6288f-9f5a-4572-8493-c7c83f0cc3e1 for instance 600cbae0-3580-4e55-9577-33b7a08439ad on n-h1-836830-18 Sep 14 09:19:15.789617 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-52df2e67-f1d5-4c0f-bff7-32b920749781 req-4a211778-73af-42b0-9d4e-9a9501869735 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056374 Sep 14 09:19:15.790839 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2859/5742] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:19:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:19:15.912582 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-39363a39-cbb5-4a47-9393-8f75ae83e5b9 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:15.913220 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-39363a39-cbb5-4a47-9393-8f75ae83e5b9 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] [instance: 8b671025-214d-4349-9b4a-4f23fa069ae5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:15.920148 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-39363a39-cbb5-4a47-9393-8f75ae83e5b9 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:15.920993 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-39363a39-cbb5-4a47-9393-8f75ae83e5b9 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:15.925295 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-39363a39-cbb5-4a47-9393-8f75ae83e5b9 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:15.926326 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-39363a39-cbb5-4a47-9393-8f75ae83e5b9 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:15.927132 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-39363a39-cbb5-4a47-9393-8f75ae83e5b9 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:15.927772 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-39363a39-cbb5-4a47-9393-8f75ae83e5b9 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:15.995342 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-138db645-be15-448c-8081-75825f5f083a tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:15.996210 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-138db645-be15-448c-8081-75825f5f083a tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 600cbae0-3580-4e55-9577-33b7a08439ad] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:16.024005 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-138db645-be15-448c-8081-75825f5f083a tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:16.027307 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-138db645-be15-448c-8081-75825f5f083a tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:16.027810 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-138db645-be15-448c-8081-75825f5f083a tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:16.028575 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-138db645-be15-448c-8081-75825f5f083a tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:16.032462 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-138db645-be15-448c-8081-75825f5f083a tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:16.034813 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-138db645-be15-448c-8081-75825f5f083a tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:16.260156 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-39363a39-cbb5-4a47-9393-8f75ae83e5b9 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf41bb7d024a8c86a385ac47561b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17da1bc0ed09449aa10d4a4ff9117f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:16.269832 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-39363a39-cbb5-4a47-9393-8f75ae83e5b9 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] 10.222.0.60 "GET /compute/v2.1/servers/8b671025-214d-4349-9b4a-4f23fa069ae5" status: 200 len: 1509 microversion: 2.1 time: 0.362022 Sep 14 09:19:16.270428 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2884/5743] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:19:15 2022] GET /compute/v2.1/servers/8b671025-214d-4349-9b4a-4f23fa069ae5 => generated 1509 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:19:16.363379 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-138db645-be15-448c-8081-75825f5f083a tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03dc827647f4483beb2e1b7888be608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229e11b3c1fe48b088d0f3c4bb7e2cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:16.374499 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-138db645-be15-448c-8081-75825f5f083a tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "GET /compute/v2.1/servers/600cbae0-3580-4e55-9577-33b7a08439ad" status: 200 len: 1372 microversion: 2.1 time: 0.392741 Sep 14 09:19:16.376861 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-7bfca310-689c-4acf-9b41-49975ea4d24f tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:16.377505 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-7bfca310-689c-4acf-9b41-49975ea4d24f tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] [instance: 022379ab-af51-495a-bcef-11e43774a7b0] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:16.391788 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2860/5744] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:19:15 2022] GET /compute/v2.1/servers/600cbae0-3580-4e55-9577-33b7a08439ad => generated 1372 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:19:16.393062 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7bfca310-689c-4acf-9b41-49975ea4d24f tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:16.394144 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7bfca310-689c-4acf-9b41-49975ea4d24f tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:16.394904 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7bfca310-689c-4acf-9b41-49975ea4d24f tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:16.396165 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7bfca310-689c-4acf-9b41-49975ea4d24f tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:16.396993 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7bfca310-689c-4acf-9b41-49975ea4d24f tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:16.397531 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7bfca310-689c-4acf-9b41-49975ea4d24f tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:16.722122 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-7bfca310-689c-4acf-9b41-49975ea4d24f tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9568f2d3f644e409961ab34e8fa95cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8638ed7d7b3d4285b36865282b8caeab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:16.736204 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-7bfca310-689c-4acf-9b41-49975ea4d24f tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] 10.222.0.60 "GET /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0" status: 200 len: 1363 microversion: 2.1 time: 0.363227 Sep 14 09:19:16.738050 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2885/5745] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:19:16 2022] GET /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0 => generated 1363 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:19:17.306113 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-70e78425-d02f-4321-bc0a-82974ee99674 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:17.308538 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-70e78425-d02f-4321-bc0a-82974ee99674 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] [instance: 8b671025-214d-4349-9b4a-4f23fa069ae5] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:17.334406 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-70e78425-d02f-4321-bc0a-82974ee99674 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:17.335229 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-70e78425-d02f-4321-bc0a-82974ee99674 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:17.337378 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-70e78425-d02f-4321-bc0a-82974ee99674 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:17.339696 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-70e78425-d02f-4321-bc0a-82974ee99674 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:17.341126 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-70e78425-d02f-4321-bc0a-82974ee99674 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:17.343603 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-70e78425-d02f-4321-bc0a-82974ee99674 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:17.404117 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-7463765e-f8cb-4357-bc64-bcdf72ecc34b tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:17.404735 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-7463765e-f8cb-4357-bc64-bcdf72ecc34b tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 600cbae0-3580-4e55-9577-33b7a08439ad] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:17.421595 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7463765e-f8cb-4357-bc64-bcdf72ecc34b tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:17.422107 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7463765e-f8cb-4357-bc64-bcdf72ecc34b tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:17.422558 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7463765e-f8cb-4357-bc64-bcdf72ecc34b tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:17.423316 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7463765e-f8cb-4357-bc64-bcdf72ecc34b tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:17.423785 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7463765e-f8cb-4357-bc64-bcdf72ecc34b tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:17.424217 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7463765e-f8cb-4357-bc64-bcdf72ecc34b tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:17.426187 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-70e78425-d02f-4321-bc0a-82974ee99674 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:17.426715 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-70e78425-d02f-4321-bc0a-82974ee99674 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:17.427178 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-70e78425-d02f-4321-bc0a-82974ee99674 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:17.427634 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.objects.instance [None req-70e78425-d02f-4321-bc0a-82974ee99674 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Lazy-loading 'fault' on Instance uuid 8b671025-214d-4349-9b4a-4f23fa069ae5 {{(pid=128759) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:19:17.548617 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-70e78425-d02f-4321-bc0a-82974ee99674 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf41bb7d024a8c86a385ac47561b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17da1bc0ed09449aa10d4a4ff9117f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:17.559542 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-70e78425-d02f-4321-bc0a-82974ee99674 tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] 10.222.0.60 "GET /compute/v2.1/servers/8b671025-214d-4349-9b4a-4f23fa069ae5" status: 200 len: 1305 microversion: 2.1 time: 0.263866 Sep 14 09:19:17.559542 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2861/5746] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:19:17 2022] GET /compute/v2.1/servers/8b671025-214d-4349-9b4a-4f23fa069ae5 => generated 1305 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:19:17.706134 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-7463765e-f8cb-4357-bc64-bcdf72ecc34b tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03dc827647f4483beb2e1b7888be608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229e11b3c1fe48b088d0f3c4bb7e2cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:17.714885 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-7463765e-f8cb-4357-bc64-bcdf72ecc34b tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "GET /compute/v2.1/servers/600cbae0-3580-4e55-9577-33b7a08439ad" status: 200 len: 1372 microversion: 2.1 time: 0.314588 Sep 14 09:19:17.715514 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2886/5747] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:19:17 2022] GET /compute/v2.1/servers/600cbae0-3580-4e55-9577-33b7a08439ad => generated 1372 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:19:17.761764 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-dec562a6-77ed-4fe2-93a6-a159132022e6 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:17.762986 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-dec562a6-77ed-4fe2-93a6-a159132022e6 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] [instance: 022379ab-af51-495a-bcef-11e43774a7b0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:17.773434 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dec562a6-77ed-4fe2-93a6-a159132022e6 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:17.774144 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dec562a6-77ed-4fe2-93a6-a159132022e6 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:17.779546 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dec562a6-77ed-4fe2-93a6-a159132022e6 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:17.780491 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dec562a6-77ed-4fe2-93a6-a159132022e6 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:17.781144 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dec562a6-77ed-4fe2-93a6-a159132022e6 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:17.781754 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dec562a6-77ed-4fe2-93a6-a159132022e6 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:18.144541 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-dec562a6-77ed-4fe2-93a6-a159132022e6 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9568f2d3f644e409961ab34e8fa95cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8638ed7d7b3d4285b36865282b8caeab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:18.157323 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-dec562a6-77ed-4fe2-93a6-a159132022e6 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] 10.222.0.60 "GET /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0" status: 200 len: 1548 microversion: 2.1 time: 0.399468 Sep 14 09:19:18.162651 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2862/5748] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:19:17 2022] GET /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0 => generated 1548 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:19:18.185484 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b9b28c95-9398-4627-8100-de0a55109084 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:18.186698 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b9b28c95-9398-4627-8100-de0a55109084 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] [instance: 022379ab-af51-495a-bcef-11e43774a7b0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:18.196224 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b9b28c95-9398-4627-8100-de0a55109084 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:18.196869 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b9b28c95-9398-4627-8100-de0a55109084 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:18.197376 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b9b28c95-9398-4627-8100-de0a55109084 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:18.198130 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b9b28c95-9398-4627-8100-de0a55109084 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:18.199271 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b9b28c95-9398-4627-8100-de0a55109084 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:18.199725 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b9b28c95-9398-4627-8100-de0a55109084 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:18.229355 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-87cbf7d5-02f4-4fa4-9141-a2a3711d22de req-c72be645-688d-42e5-826f-8c66432ac495 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b671025-214d-4349-9b4a-4f23fa069ae5", "name": "network-vif-deleted", "tag": "6bf6b9a2-d16b-44fb-a0f4-26bda7b1d8fc"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:19:18.236213 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:19:18.252361 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-87cbf7d5-02f4-4fa4-9141-a2a3711d22de req-c72be645-688d-42e5-826f-8c66432ac495 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:18.259283 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-87cbf7d5-02f4-4fa4-9141-a2a3711d22de req-c72be645-688d-42e5-826f-8c66432ac495 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:18.260077 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-87cbf7d5-02f4-4fa4-9141-a2a3711d22de req-c72be645-688d-42e5-826f-8c66432ac495 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:18.280996 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-87cbf7d5-02f4-4fa4-9141-a2a3711d22de req-c72be645-688d-42e5-826f-8c66432ac495 service nova] Creating event network-vif-deleted:6bf6b9a2-d16b-44fb-a0f4-26bda7b1d8fc for instance 8b671025-214d-4349-9b4a-4f23fa069ae5 on n-h2-836830-18 Sep 14 09:19:18.287845 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-87cbf7d5-02f4-4fa4-9141-a2a3711d22de req-c72be645-688d-42e5-826f-8c66432ac495 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.457843 Sep 14 09:19:18.289399 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2887/5749] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:19:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:19:18.354847 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b9b28c95-9398-4627-8100-de0a55109084 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] 10.222.0.60 "GET /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.173424 Sep 14 09:19:18.363293 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2863/5750] 10.222.0.60 () {58 vars in 1275 bytes} [Wed Sep 14 09:19:18 2022] GET /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0/os-interface => generated 284 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:19:18.581444 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=4 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:19:18.593892 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ca9497d3-0284-4573-ba1d-e7aee69f43bc tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:18.593892 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-ca9497d3-0284-4573-ba1d-e7aee69f43bc tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] [instance: 8b671025-214d-4349-9b4a-4f23fa069ae5] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:18.595832 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ca9497d3-0284-4573-ba1d-e7aee69f43bc tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:18.596326 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ca9497d3-0284-4573-ba1d-e7aee69f43bc tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:18.597337 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ca9497d3-0284-4573-ba1d-e7aee69f43bc tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:18.598208 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ca9497d3-0284-4573-ba1d-e7aee69f43bc tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:18.598898 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ca9497d3-0284-4573-ba1d-e7aee69f43bc tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:18.599439 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ca9497d3-0284-4573-ba1d-e7aee69f43bc tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:18.616929 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-ca9497d3-0284-4573-ba1d-e7aee69f43bc tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] HTTP exception thrown: Instance 8b671025-214d-4349-9b4a-4f23fa069ae5 could not be found. Sep 14 09:19:18.619195 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ca9497d3-0284-4573-ba1d-e7aee69f43bc tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Request method failure captured: Sep 14 09:19:18.619195 n-d-836830-18 devstack@n-api.service[128758]: request: GET /compute/v2.1/servers/8b671025-214d-4349-9b4a-4f23fa069ae5 HTTP/1.1 Sep 14 09:19:18.619195 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 09:19:18.619195 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 09:19:18.619195 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 09:19:18.619195 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 09:19:18.619195 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 09:19:18.619195 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 09:19:18.619195 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 09:19:18.619195 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 09:19:18.619195 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZxuilnCBgyav7Rd1TFD9P6uGASAUmc-QkXE49K4j4vlT9ErQZhuhTLVw5EmcywWAq5BPWnKRrzXte45i0oNMloQ0wkYFNszAVrVye0clMk-Vn5D0WohHfPgJOg-cKFJ_vFYd33UBvKAA0x6VII4gAlEMQWSgneHOCwQ7kSUH0cSLpg Sep 14 09:19:18.619195 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 09:19:18.619195 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 09:19:18.619195 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 09:19:18.619195 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 09:19:18.619195 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 09:19:18.619195 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 09:19:18.619195 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 17da1bc0ed09449aa10d4a4ff9117f6d Sep 14 09:19:18.619195 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-TestServerAdvancedOps-89975043 Sep 14 09:19:18.619195 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 09:19:18.619195 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 09:19:18.619195 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/17da1bc0ed09449aa10d4a4ff9117f6d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_17da1bc0ed09449aa10d4a4ff9117f6d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/17da1bc0ed09449aa10d4a4ff9117f6d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/17da1bc0ed09449aa10d4a4ff9117f6d"}]}] Sep 14 09:19:18.619195 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-TestServerAdvancedOps-89975043 Sep 14 09:19:18.619195 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 17da1bc0ed09449aa10d4a4ff9117f6d Sep 14 09:19:18.619195 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-TestServerAdvancedOps-89975043 Sep 14 09:19:18.619195 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-TestServerAdvancedOps-89975043-project Sep 14 09:19:18.619195 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 09:19:18.619195 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 09:19:18.619195 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: c3cf41bb7d024a8c86a385ac47561b8c Sep 14 09:19:18.619195 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-TestServerAdvancedOps-89975043-project Sep 14 09:19:18.619195 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 09:19:18.619195 n-d-836830-18 devstack@n-api.service[128758]: exception: Instance 8b671025-214d-4349-9b4a-4f23fa069ae5 could not be found. Sep 14 09:19:18.619195 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': '8b671025-214d-4349-9b4a-4f23fa069ae5'} Sep 14 09:19:18.619195 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:19:18.619195 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:19:18.619195 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:19:18.619195 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:19:18.619195 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:19:18.619195 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:19:18.619195 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:19:18.619195 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:19:18.619195 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:19:18.619195 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:19:18.619195 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b671025-214d-4349-9b4a-4f23fa069ae5 could not be found. Sep 14 09:19:18.619195 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:19:18.619195 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:19:18.619195 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:19:18.619195 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:19:18.619195 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:19:18.619195 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:19:18.619195 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:19:18.619195 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:19:18.619195 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:19:18.619195 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:19:18.619195 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:19:18.619195 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:19:18.619195 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:19:18.619195 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:19:18.619195 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:19:18.619195 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:19:18.619195 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b671025-214d-4349-9b4a-4f23fa069ae5 could not be found. Sep 14 09:19:18.619195 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:19:18.619195 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:19:18.619195 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:19:18.623951 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:19:18.623951 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:19:18.623951 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:19:18.623951 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:19:18.623951 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:19:18.623951 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b671025-214d-4349-9b4a-4f23fa069ae5 could not be found. Sep 14 09:19:18.623951 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:19:18.623951 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ca9497d3-0284-4573-ba1d-e7aee69f43bc tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] Returning 404 to user: Instance 8b671025-214d-4349-9b4a-4f23fa069ae5 could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:19:18.623951 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-ca9497d3-0284-4573-ba1d-e7aee69f43bc tempest-TestServerAdvancedOps-89975043 tempest-TestServerAdvancedOps-89975043-project] 10.222.0.60 "GET /compute/v2.1/servers/8b671025-214d-4349-9b4a-4f23fa069ae5" status: 404 len: 111 microversion: 2.1 time: 0.040958 Sep 14 09:19:18.623951 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2888/5751] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:19:18 2022] GET /compute/v2.1/servers/8b671025-214d-4349-9b4a-4f23fa069ae5 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:19:18.740694 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3ccd24e8-fda1-42c0-9c7c-afa220db79e2 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:18.741986 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-3ccd24e8-fda1-42c0-9c7c-afa220db79e2 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 600cbae0-3580-4e55-9577-33b7a08439ad] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:18.754992 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3ccd24e8-fda1-42c0-9c7c-afa220db79e2 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:18.754992 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3ccd24e8-fda1-42c0-9c7c-afa220db79e2 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:18.754992 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3ccd24e8-fda1-42c0-9c7c-afa220db79e2 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:18.754992 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3ccd24e8-fda1-42c0-9c7c-afa220db79e2 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:18.761508 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3ccd24e8-fda1-42c0-9c7c-afa220db79e2 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:18.763457 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3ccd24e8-fda1-42c0-9c7c-afa220db79e2 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:19.245779 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-3ccd24e8-fda1-42c0-9c7c-afa220db79e2 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03dc827647f4483beb2e1b7888be608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229e11b3c1fe48b088d0f3c4bb7e2cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:19.256550 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-3ccd24e8-fda1-42c0-9c7c-afa220db79e2 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "GET /compute/v2.1/servers/600cbae0-3580-4e55-9577-33b7a08439ad" status: 200 len: 1372 microversion: 2.1 time: 0.521189 Sep 14 09:19:19.257760 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2864/5752] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:19:18 2022] GET /compute/v2.1/servers/600cbae0-3580-4e55-9577-33b7a08439ad => generated 1372 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:19:19.848809 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=18 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:19:20.042116 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-ee5fb9b9-35c5-40e2-b55a-a88dfcccbdcf req-c6eb7962-7127-4f41-802f-d8dc66dbe6fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "022379ab-af51-495a-bcef-11e43774a7b0", "tag": "978742e8-02b6-4b3b-8b11-e9cef9c890d0"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:19:20.069484 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-ee5fb9b9-35c5-40e2-b55a-a88dfcccbdcf req-c6eb7962-7127-4f41-802f-d8dc66dbe6fb service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:20.071952 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-ee5fb9b9-35c5-40e2-b55a-a88dfcccbdcf req-c6eb7962-7127-4f41-802f-d8dc66dbe6fb service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:20.072554 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-ee5fb9b9-35c5-40e2-b55a-a88dfcccbdcf req-c6eb7962-7127-4f41-802f-d8dc66dbe6fb service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:20.085998 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=8 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:19:20.088391 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:19:20.121144 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-ee5fb9b9-35c5-40e2-b55a-a88dfcccbdcf req-c6eb7962-7127-4f41-802f-d8dc66dbe6fb service nova] Creating event network-changed:978742e8-02b6-4b3b-8b11-e9cef9c890d0 for instance 022379ab-af51-495a-bcef-11e43774a7b0 on n-h1-836830-18 Sep 14 09:19:20.133802 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-ee5fb9b9-35c5-40e2-b55a-a88dfcccbdcf req-c6eb7962-7127-4f41-802f-d8dc66dbe6fb service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096509 Sep 14 09:19:20.135707 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2865/5753] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:19:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:19:20.282103 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-1496b899-6261-405d-a20d-0557e5ecaf57 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:20.282820 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-1496b899-6261-405d-a20d-0557e5ecaf57 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 600cbae0-3580-4e55-9577-33b7a08439ad] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:20.305051 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-f1148b43-44f9-46e2-9670-2028e80c32fd tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Action: 'create', calling method: .version_select at 0x7f7d3f4393a0>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-1664083085", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLiQ+/M9bjSRKGF01LI275I+roEVq5Tr6T9ALbLPqoYXhO3qn0GxT3OcOr3GTXpsBvJ7M2j39plFnR+XjbhZXlOrZsvUikOJ8y/5gK0azJN8NPisAtlfCFk5zVcQWY/LGA=="}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:19:20.308687 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1496b899-6261-405d-a20d-0557e5ecaf57 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:20.309204 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1496b899-6261-405d-a20d-0557e5ecaf57 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:20.312190 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1496b899-6261-405d-a20d-0557e5ecaf57 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:20.312964 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1496b899-6261-405d-a20d-0557e5ecaf57 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:20.313445 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1496b899-6261-405d-a20d-0557e5ecaf57 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:20.316828 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1496b899-6261-405d-a20d-0557e5ecaf57 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:20.337287 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-f1148b43-44f9-46e2-9670-2028e80c32fd tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Getting quotas for project 57236332371c46c48719401846bfaca4. Resources: {'key_pairs'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:19:20.349728 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-f1148b43-44f9-46e2-9670-2028e80c32fd tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Getting quotas for user 7e1f3762fce549df9225bd487e237abd and project 57236332371c46c48719401846bfaca4. Resources: {'key_pairs'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:19:20.403863 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-f1148b43-44f9-46e2-9670-2028e80c32fd tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.559462 Sep 14 09:19:20.405092 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2889/5754] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Sep 14 09:19:19 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:19:20.745415 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-1496b899-6261-405d-a20d-0557e5ecaf57 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03dc827647f4483beb2e1b7888be608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229e11b3c1fe48b088d0f3c4bb7e2cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:20.761608 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-1496b899-6261-405d-a20d-0557e5ecaf57 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "GET /compute/v2.1/servers/600cbae0-3580-4e55-9577-33b7a08439ad" status: 200 len: 1372 microversion: 2.1 time: 0.482563 Sep 14 09:19:20.764623 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2866/5755] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:19:20 2022] GET /compute/v2.1/servers/600cbae0-3580-4e55-9577-33b7a08439ad => generated 1372 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:19:21.790182 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c25f2b86-26e4-4334-a2fe-96cfe1e27c4c tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:21.790821 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-c25f2b86-26e4-4334-a2fe-96cfe1e27c4c tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 600cbae0-3580-4e55-9577-33b7a08439ad] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:21.803135 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c25f2b86-26e4-4334-a2fe-96cfe1e27c4c tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:21.803635 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c25f2b86-26e4-4334-a2fe-96cfe1e27c4c tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:21.811755 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c25f2b86-26e4-4334-a2fe-96cfe1e27c4c tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:21.812771 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c25f2b86-26e4-4334-a2fe-96cfe1e27c4c tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:21.814537 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c25f2b86-26e4-4334-a2fe-96cfe1e27c4c tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:21.822874 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c25f2b86-26e4-4334-a2fe-96cfe1e27c4c tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:22.154805 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-c25f2b86-26e4-4334-a2fe-96cfe1e27c4c tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03dc827647f4483beb2e1b7888be608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229e11b3c1fe48b088d0f3c4bb7e2cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:22.196209 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-c25f2b86-26e4-4334-a2fe-96cfe1e27c4c tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "GET /compute/v2.1/servers/600cbae0-3580-4e55-9577-33b7a08439ad" status: 200 len: 1372 microversion: 2.1 time: 0.410848 Sep 14 09:19:22.197001 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2890/5756] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:19:21 2022] GET /compute/v2.1/servers/600cbae0-3580-4e55-9577-33b7a08439ad => generated 1372 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:19:23.222322 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c0692c79-75da-42c9-ab9a-b6d85b1775a5 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:23.223155 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-c0692c79-75da-42c9-ab9a-b6d85b1775a5 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 600cbae0-3580-4e55-9577-33b7a08439ad] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:23.241358 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c0692c79-75da-42c9-ab9a-b6d85b1775a5 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:23.241980 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c0692c79-75da-42c9-ab9a-b6d85b1775a5 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:23.242538 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c0692c79-75da-42c9-ab9a-b6d85b1775a5 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:23.243253 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c0692c79-75da-42c9-ab9a-b6d85b1775a5 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:23.243649 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c0692c79-75da-42c9-ab9a-b6d85b1775a5 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:23.244079 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c0692c79-75da-42c9-ab9a-b6d85b1775a5 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:23.564018 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-c0692c79-75da-42c9-ab9a-b6d85b1775a5 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03dc827647f4483beb2e1b7888be608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229e11b3c1fe48b088d0f3c4bb7e2cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:23.583208 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-c0692c79-75da-42c9-ab9a-b6d85b1775a5 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "GET /compute/v2.1/servers/600cbae0-3580-4e55-9577-33b7a08439ad" status: 200 len: 1372 microversion: 2.1 time: 0.365308 Sep 14 09:19:23.584238 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2867/5757] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:19:23 2022] GET /compute/v2.1/servers/600cbae0-3580-4e55-9577-33b7a08439ad => generated 1372 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:19:24.614232 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-405fa679-3126-43d7-833b-8c485de17f1a tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:24.615261 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-405fa679-3126-43d7-833b-8c485de17f1a tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 600cbae0-3580-4e55-9577-33b7a08439ad] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:24.629131 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-405fa679-3126-43d7-833b-8c485de17f1a tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:24.629630 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-405fa679-3126-43d7-833b-8c485de17f1a tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:24.630070 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-405fa679-3126-43d7-833b-8c485de17f1a tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:24.634216 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-405fa679-3126-43d7-833b-8c485de17f1a tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:24.636413 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-405fa679-3126-43d7-833b-8c485de17f1a tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:24.638399 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-405fa679-3126-43d7-833b-8c485de17f1a tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:24.927625 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-405fa679-3126-43d7-833b-8c485de17f1a tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03dc827647f4483beb2e1b7888be608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229e11b3c1fe48b088d0f3c4bb7e2cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:24.951392 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-405fa679-3126-43d7-833b-8c485de17f1a tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "GET /compute/v2.1/servers/600cbae0-3580-4e55-9577-33b7a08439ad" status: 200 len: 1372 microversion: 2.1 time: 0.339305 Sep 14 09:19:24.954883 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2891/5758] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:19:24 2022] GET /compute/v2.1/servers/600cbae0-3580-4e55-9577-33b7a08439ad => generated 1372 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:19:25.547744 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-1b998e13-c91c-49da-adec-5d3ebb614bc2 req-0f3daaa2-c777-4470-8934-0102b9a58a64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "600cbae0-3580-4e55-9577-33b7a08439ad", "name": "network-vif-plugged", "status": "completed", "tag": "2ab6288f-9f5a-4572-8493-c7c83f0cc3e1"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:19:25.588069 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-1b998e13-c91c-49da-adec-5d3ebb614bc2 req-0f3daaa2-c777-4470-8934-0102b9a58a64 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:25.589182 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-1b998e13-c91c-49da-adec-5d3ebb614bc2 req-0f3daaa2-c777-4470-8934-0102b9a58a64 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:25.589786 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-1b998e13-c91c-49da-adec-5d3ebb614bc2 req-0f3daaa2-c777-4470-8934-0102b9a58a64 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:25.606920 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-1b998e13-c91c-49da-adec-5d3ebb614bc2 req-0f3daaa2-c777-4470-8934-0102b9a58a64 service nova] Creating event network-vif-plugged:2ab6288f-9f5a-4572-8493-c7c83f0cc3e1 for instance 600cbae0-3580-4e55-9577-33b7a08439ad on n-h1-836830-18 Sep 14 09:19:25.635490 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-1b998e13-c91c-49da-adec-5d3ebb614bc2 req-0f3daaa2-c777-4470-8934-0102b9a58a64 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.542675 Sep 14 09:19:25.641767 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2868/5759] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:19:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:19:25.977927 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ab807a3a-a43c-4e2b-a9be-deae671ad920 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:25.978544 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-ab807a3a-a43c-4e2b-a9be-deae671ad920 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 600cbae0-3580-4e55-9577-33b7a08439ad] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:25.997139 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ab807a3a-a43c-4e2b-a9be-deae671ad920 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:25.997899 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ab807a3a-a43c-4e2b-a9be-deae671ad920 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:25.998546 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ab807a3a-a43c-4e2b-a9be-deae671ad920 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:26.001664 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ab807a3a-a43c-4e2b-a9be-deae671ad920 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:26.002326 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ab807a3a-a43c-4e2b-a9be-deae671ad920 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:26.004035 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ab807a3a-a43c-4e2b-a9be-deae671ad920 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:26.464045 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-ab807a3a-a43c-4e2b-a9be-deae671ad920 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03dc827647f4483beb2e1b7888be608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229e11b3c1fe48b088d0f3c4bb7e2cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:26.483703 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-ab807a3a-a43c-4e2b-a9be-deae671ad920 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "GET /compute/v2.1/servers/600cbae0-3580-4e55-9577-33b7a08439ad" status: 200 len: 1372 microversion: 2.1 time: 0.509530 Sep 14 09:19:26.486523 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2892/5760] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:19:25 2022] GET /compute/v2.1/servers/600cbae0-3580-4e55-9577-33b7a08439ad => generated 1372 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:19:27.510268 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-46e86bb2-52c3-45a1-8f5a-f76a8dc2669c tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:27.511026 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-46e86bb2-52c3-45a1-8f5a-f76a8dc2669c tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 600cbae0-3580-4e55-9577-33b7a08439ad] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:27.520110 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-46e86bb2-52c3-45a1-8f5a-f76a8dc2669c tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:27.521373 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-46e86bb2-52c3-45a1-8f5a-f76a8dc2669c tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:27.522083 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-46e86bb2-52c3-45a1-8f5a-f76a8dc2669c tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:27.527524 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-46e86bb2-52c3-45a1-8f5a-f76a8dc2669c tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:27.528309 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-46e86bb2-52c3-45a1-8f5a-f76a8dc2669c tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:27.529543 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-46e86bb2-52c3-45a1-8f5a-f76a8dc2669c tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:28.757972 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-46e86bb2-52c3-45a1-8f5a-f76a8dc2669c tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03dc827647f4483beb2e1b7888be608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229e11b3c1fe48b088d0f3c4bb7e2cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:28.769756 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-46e86bb2-52c3-45a1-8f5a-f76a8dc2669c tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "GET /compute/v2.1/servers/600cbae0-3580-4e55-9577-33b7a08439ad" status: 200 len: 1372 microversion: 2.1 time: 1.261014 Sep 14 09:19:28.771158 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2869/5761] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:19:27 2022] GET /compute/v2.1/servers/600cbae0-3580-4e55-9577-33b7a08439ad => generated 1372 bytes in 1266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:19:29.801328 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1200638f-2fc5-49ab-a1b4-102d7fdb3a42 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:29.801962 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-1200638f-2fc5-49ab-a1b4-102d7fdb3a42 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 600cbae0-3580-4e55-9577-33b7a08439ad] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:29.822439 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1200638f-2fc5-49ab-a1b4-102d7fdb3a42 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:29.822978 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1200638f-2fc5-49ab-a1b4-102d7fdb3a42 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:29.823415 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1200638f-2fc5-49ab-a1b4-102d7fdb3a42 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:29.824144 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1200638f-2fc5-49ab-a1b4-102d7fdb3a42 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:29.824744 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1200638f-2fc5-49ab-a1b4-102d7fdb3a42 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:29.825019 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1200638f-2fc5-49ab-a1b4-102d7fdb3a42 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:30.366177 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=4 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:19:30.396188 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-1200638f-2fc5-49ab-a1b4-102d7fdb3a42 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03dc827647f4483beb2e1b7888be608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229e11b3c1fe48b088d0f3c4bb7e2cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:30.409200 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-1200638f-2fc5-49ab-a1b4-102d7fdb3a42 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "GET /compute/v2.1/servers/600cbae0-3580-4e55-9577-33b7a08439ad" status: 200 len: 1565 microversion: 2.1 time: 0.615349 Sep 14 09:19:30.422963 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2893/5762] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:19:29 2022] GET /compute/v2.1/servers/600cbae0-3580-4e55-9577-33b7a08439ad => generated 1565 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:19:30.436358 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-53de9524-5e7e-4646-98f4-4f3e96defaa3 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:30.436933 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-53de9524-5e7e-4646-98f4-4f3e96defaa3 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 600cbae0-3580-4e55-9577-33b7a08439ad] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:30.479724 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-53de9524-5e7e-4646-98f4-4f3e96defaa3 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:30.482741 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-53de9524-5e7e-4646-98f4-4f3e96defaa3 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:30.486488 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-53de9524-5e7e-4646-98f4-4f3e96defaa3 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:30.488537 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-53de9524-5e7e-4646-98f4-4f3e96defaa3 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:30.489087 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-53de9524-5e7e-4646-98f4-4f3e96defaa3 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:30.494707 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-53de9524-5e7e-4646-98f4-4f3e96defaa3 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:30.737394 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-53de9524-5e7e-4646-98f4-4f3e96defaa3 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "GET /compute/v2.1/servers/600cbae0-3580-4e55-9577-33b7a08439ad/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.305147 Sep 14 09:19:30.746220 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2870/5763] 10.222.0.60 () {58 vars in 1275 bytes} [Wed Sep 14 09:19:30 2022] GET /compute/v2.1/servers/600cbae0-3580-4e55-9577-33b7a08439ad/os-interface => generated 284 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:19:33.259264 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a97365c8-5329-4c7b-aa2b-aab6cd67404c tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-1563243579-access_point-353853421", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "networks": [{"uuid": "6aeb7929-6960-4d72-9dc0-4868c6c4640f"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1664083085", "security_groups": [{"name": "tempest-secgroup_access--297861712"}, {"name": "tempest-secgroup_general--1327120535"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:19:33.466968 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-3912a4f8-28c4-49b0-94b7-2c6956a24e29 req-bdfcd56a-410e-4008-bf00-69c0813de832 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "600cbae0-3580-4e55-9577-33b7a08439ad", "tag": "2ab6288f-9f5a-4572-8493-c7c83f0cc3e1"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:19:33.491299 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-3912a4f8-28c4-49b0-94b7-2c6956a24e29 req-bdfcd56a-410e-4008-bf00-69c0813de832 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:33.491794 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-3912a4f8-28c4-49b0-94b7-2c6956a24e29 req-bdfcd56a-410e-4008-bf00-69c0813de832 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:33.492231 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-3912a4f8-28c4-49b0-94b7-2c6956a24e29 req-bdfcd56a-410e-4008-bf00-69c0813de832 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:33.521451 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-3912a4f8-28c4-49b0-94b7-2c6956a24e29 req-bdfcd56a-410e-4008-bf00-69c0813de832 service nova] Creating event network-changed:2ab6288f-9f5a-4572-8493-c7c83f0cc3e1 for instance 600cbae0-3580-4e55-9577-33b7a08439ad on n-h1-836830-18 Sep 14 09:19:33.534456 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-3912a4f8-28c4-49b0-94b7-2c6956a24e29 req-bdfcd56a-410e-4008-bf00-69c0813de832 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069928 Sep 14 09:19:33.536622 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2871/5764] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:19:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:19:33.598304 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.network.neutron [None req-a97365c8-5329-4c7b-aa2b-aab6cd67404c tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] validate_networks() for [('6aeb7929-6960-4d72-9dc0-4868c6c4640f', None, None, None, None, None)] {{(pid=128758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:19:34.348697 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-a97365c8-5329-4c7b-aa2b-aab6cd67404c tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Flavor limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:19:34.349355 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-a97365c8-5329-4c7b-aa2b-aab6cd67404c tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Image limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:19:34.349589 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-a97365c8-5329-4c7b-aa2b-aab6cd67404c tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Flavor pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:19:34.351185 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-a97365c8-5329-4c7b-aa2b-aab6cd67404c tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Image pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:19:34.352067 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-a97365c8-5329-4c7b-aa2b-aab6cd67404c tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:19:34.381806 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a97365c8-5329-4c7b-aa2b-aab6cd67404c tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:34.382691 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a97365c8-5329-4c7b-aa2b-aab6cd67404c tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:34.384268 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a97365c8-5329-4c7b-aa2b-aab6cd67404c tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:34.386096 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a97365c8-5329-4c7b-aa2b-aab6cd67404c tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:34.391028 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a97365c8-5329-4c7b-aa2b-aab6cd67404c tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:34.391925 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a97365c8-5329-4c7b-aa2b-aab6cd67404c tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:34.438966 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-a97365c8-5329-4c7b-aa2b-aab6cd67404c tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Getting quotas for project 57236332371c46c48719401846bfaca4. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:19:34.452854 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-a97365c8-5329-4c7b-aa2b-aab6cd67404c tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Getting quotas for user 7e1f3762fce549df9225bd487e237abd and project 57236332371c46c48719401846bfaca4. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:19:34.485874 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-a97365c8-5329-4c7b-aa2b-aab6cd67404c tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Going to run 1 instances... {{(pid=128758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:19:34.488559 n-d-836830-18 devstack@n-api.service[128758]: WARNING nova.utils [None req-a97365c8-5329-4c7b-aa2b-aab6cd67404c tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-1563243579-access_point-353853421 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-1563243579-ac Sep 14 09:19:34.489323 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-a97365c8-5329-4c7b-aa2b-aab6cd67404c tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] [instance: 454eae36-ac14-41c3-ae82-9453adf7b230] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:19:34.672671 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-a97365c8-5329-4c7b-aa2b-aab6cd67404c tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 457 microversion: 2.1 time: 1.414068 Sep 14 09:19:34.673940 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2894/5765] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 09:19:33 2022] POST /compute/v2.1/servers => generated 457 bytes in 1427 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:19:34.687606 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-32bfd163-d9bf-4aa6-9f6c-a6d45e318443 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:34.689155 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-32bfd163-d9bf-4aa6-9f6c-a6d45e318443 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] [instance: 454eae36-ac14-41c3-ae82-9453adf7b230] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:34.827140 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-32bfd163-d9bf-4aa6-9f6c-a6d45e318443 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1f3762fce549df9225bd487e237abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57236332371c46c48719401846bfaca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:34.837042 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-32bfd163-d9bf-4aa6-9f6c-a6d45e318443 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] 10.222.0.60 "GET /compute/v2.1/servers/454eae36-ac14-41c3-ae82-9453adf7b230" status: 200 len: 1294 microversion: 2.1 time: 0.154618 Sep 14 09:19:34.842458 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2872/5766] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:19:34 2022] GET /compute/v2.1/servers/454eae36-ac14-41c3-ae82-9453adf7b230 => generated 1294 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:19:35.870136 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-7ac57941-71fb-4a8a-8c76-c90c527e0a39 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:35.870765 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-7ac57941-71fb-4a8a-8c76-c90c527e0a39 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] [instance: 454eae36-ac14-41c3-ae82-9453adf7b230] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:35.881135 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7ac57941-71fb-4a8a-8c76-c90c527e0a39 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:35.881632 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7ac57941-71fb-4a8a-8c76-c90c527e0a39 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:35.882075 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7ac57941-71fb-4a8a-8c76-c90c527e0a39 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:35.882788 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7ac57941-71fb-4a8a-8c76-c90c527e0a39 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:35.885566 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7ac57941-71fb-4a8a-8c76-c90c527e0a39 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:35.886485 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7ac57941-71fb-4a8a-8c76-c90c527e0a39 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:36.069799 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-7ac57941-71fb-4a8a-8c76-c90c527e0a39 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1f3762fce549df9225bd487e237abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57236332371c46c48719401846bfaca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:36.086991 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-7ac57941-71fb-4a8a-8c76-c90c527e0a39 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] 10.222.0.60 "GET /compute/v2.1/servers/454eae36-ac14-41c3-ae82-9453adf7b230" status: 200 len: 1290 microversion: 2.1 time: 0.221645 Sep 14 09:19:36.087594 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2895/5767] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:19:35 2022] GET /compute/v2.1/servers/454eae36-ac14-41c3-ae82-9453adf7b230 => generated 1290 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:19:37.110150 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-71337ce7-e9c1-47c8-8da7-4d1160ebf701 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:37.112177 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-71337ce7-e9c1-47c8-8da7-4d1160ebf701 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] [instance: 454eae36-ac14-41c3-ae82-9453adf7b230] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:37.129435 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-71337ce7-e9c1-47c8-8da7-4d1160ebf701 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:37.130631 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-71337ce7-e9c1-47c8-8da7-4d1160ebf701 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:37.132589 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-71337ce7-e9c1-47c8-8da7-4d1160ebf701 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:37.133507 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-71337ce7-e9c1-47c8-8da7-4d1160ebf701 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:37.135168 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-71337ce7-e9c1-47c8-8da7-4d1160ebf701 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:37.138346 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-71337ce7-e9c1-47c8-8da7-4d1160ebf701 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:37.353034 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-71337ce7-e9c1-47c8-8da7-4d1160ebf701 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1f3762fce549df9225bd487e237abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57236332371c46c48719401846bfaca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:37.364650 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-71337ce7-e9c1-47c8-8da7-4d1160ebf701 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] 10.222.0.60 "GET /compute/v2.1/servers/454eae36-ac14-41c3-ae82-9453adf7b230" status: 200 len: 1352 microversion: 2.1 time: 0.258682 Sep 14 09:19:37.374532 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2873/5768] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:19:37 2022] GET /compute/v2.1/servers/454eae36-ac14-41c3-ae82-9453adf7b230 => generated 1352 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:19:38.403323 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-fcc19903-6849-4654-aa3b-af0aa9cdae4b tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:38.404859 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-fcc19903-6849-4654-aa3b-af0aa9cdae4b tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] [instance: 454eae36-ac14-41c3-ae82-9453adf7b230] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:38.418830 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fcc19903-6849-4654-aa3b-af0aa9cdae4b tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:38.419373 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fcc19903-6849-4654-aa3b-af0aa9cdae4b tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:38.419824 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fcc19903-6849-4654-aa3b-af0aa9cdae4b tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:38.420560 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fcc19903-6849-4654-aa3b-af0aa9cdae4b tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:38.421026 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fcc19903-6849-4654-aa3b-af0aa9cdae4b tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:38.421464 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fcc19903-6849-4654-aa3b-af0aa9cdae4b tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:38.813630 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-fcc19903-6849-4654-aa3b-af0aa9cdae4b tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1f3762fce549df9225bd487e237abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57236332371c46c48719401846bfaca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:38.823991 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-fcc19903-6849-4654-aa3b-af0aa9cdae4b tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] 10.222.0.60 "GET /compute/v2.1/servers/454eae36-ac14-41c3-ae82-9453adf7b230" status: 200 len: 1471 microversion: 2.1 time: 0.424605 Sep 14 09:19:38.825649 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2896/5769] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:19:38 2022] GET /compute/v2.1/servers/454eae36-ac14-41c3-ae82-9453adf7b230 => generated 1471 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:19:39.278164 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-89c9f3c4-1fd2-4a6a-9722-2c713b507262 req-42b18f90-0eb8-44f6-a074-679361c6ec3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "454eae36-ac14-41c3-ae82-9453adf7b230", "tag": "0e0086f9-f896-4fce-8a39-709c65828318"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:19:39.325823 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-89c9f3c4-1fd2-4a6a-9722-2c713b507262 req-42b18f90-0eb8-44f6-a074-679361c6ec3b service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:39.328461 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-89c9f3c4-1fd2-4a6a-9722-2c713b507262 req-42b18f90-0eb8-44f6-a074-679361c6ec3b service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:39.328940 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-89c9f3c4-1fd2-4a6a-9722-2c713b507262 req-42b18f90-0eb8-44f6-a074-679361c6ec3b service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:39.359585 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-89c9f3c4-1fd2-4a6a-9722-2c713b507262 req-42b18f90-0eb8-44f6-a074-679361c6ec3b service nova] Creating event network-changed:0e0086f9-f896-4fce-8a39-709c65828318 for instance 454eae36-ac14-41c3-ae82-9453adf7b230 on n-h2-836830-18 Sep 14 09:19:39.374373 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-89c9f3c4-1fd2-4a6a-9722-2c713b507262 req-42b18f90-0eb8-44f6-a074-679361c6ec3b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097950 Sep 14 09:19:39.375361 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2874/5770] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:19:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:19:39.853347 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-fc1b3895-a6a8-4d4c-be92-153f88592a85 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:39.854609 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-fc1b3895-a6a8-4d4c-be92-153f88592a85 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] [instance: 454eae36-ac14-41c3-ae82-9453adf7b230] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:39.875825 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fc1b3895-a6a8-4d4c-be92-153f88592a85 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:39.880849 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fc1b3895-a6a8-4d4c-be92-153f88592a85 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:39.882697 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fc1b3895-a6a8-4d4c-be92-153f88592a85 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:39.883950 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fc1b3895-a6a8-4d4c-be92-153f88592a85 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:39.886001 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fc1b3895-a6a8-4d4c-be92-153f88592a85 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:39.887844 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fc1b3895-a6a8-4d4c-be92-153f88592a85 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:40.200000 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-fc1b3895-a6a8-4d4c-be92-153f88592a85 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1f3762fce549df9225bd487e237abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57236332371c46c48719401846bfaca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:40.212968 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-fc1b3895-a6a8-4d4c-be92-153f88592a85 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] 10.222.0.60 "GET /compute/v2.1/servers/454eae36-ac14-41c3-ae82-9453adf7b230" status: 200 len: 1471 microversion: 2.1 time: 0.363615 Sep 14 09:19:40.229688 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2897/5771] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:19:39 2022] GET /compute/v2.1/servers/454eae36-ac14-41c3-ae82-9453adf7b230 => generated 1471 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:19:41.237540 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-86bfa50c-1f2a-49c4-8c51-5db188608a0c tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:41.251231 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-86bfa50c-1f2a-49c4-8c51-5db188608a0c tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] [instance: 454eae36-ac14-41c3-ae82-9453adf7b230] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:41.260453 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-86bfa50c-1f2a-49c4-8c51-5db188608a0c tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:41.261277 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-86bfa50c-1f2a-49c4-8c51-5db188608a0c tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:41.261951 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-86bfa50c-1f2a-49c4-8c51-5db188608a0c tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:41.262888 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-86bfa50c-1f2a-49c4-8c51-5db188608a0c tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:41.263572 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-86bfa50c-1f2a-49c4-8c51-5db188608a0c tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:41.264169 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-86bfa50c-1f2a-49c4-8c51-5db188608a0c tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:41.467658 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-86bfa50c-1f2a-49c4-8c51-5db188608a0c tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1f3762fce549df9225bd487e237abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57236332371c46c48719401846bfaca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:41.477777 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-86bfa50c-1f2a-49c4-8c51-5db188608a0c tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] 10.222.0.60 "GET /compute/v2.1/servers/454eae36-ac14-41c3-ae82-9453adf7b230" status: 200 len: 1471 microversion: 2.1 time: 0.244424 Sep 14 09:19:41.479895 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2875/5772] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:19:41 2022] GET /compute/v2.1/servers/454eae36-ac14-41c3-ae82-9453adf7b230 => generated 1471 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:19:42.501590 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-6ade2368-b18e-46de-a806-e3420904e43f tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:42.502258 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-6ade2368-b18e-46de-a806-e3420904e43f tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] [instance: 454eae36-ac14-41c3-ae82-9453adf7b230] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:42.510099 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6ade2368-b18e-46de-a806-e3420904e43f tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:42.510597 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6ade2368-b18e-46de-a806-e3420904e43f tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:42.511072 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6ade2368-b18e-46de-a806-e3420904e43f tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:42.511811 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6ade2368-b18e-46de-a806-e3420904e43f tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:42.512502 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6ade2368-b18e-46de-a806-e3420904e43f tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:42.513180 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6ade2368-b18e-46de-a806-e3420904e43f tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:42.723972 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-6ade2368-b18e-46de-a806-e3420904e43f tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1f3762fce549df9225bd487e237abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57236332371c46c48719401846bfaca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:42.732856 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-6ade2368-b18e-46de-a806-e3420904e43f tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] 10.222.0.60 "GET /compute/v2.1/servers/454eae36-ac14-41c3-ae82-9453adf7b230" status: 200 len: 1471 microversion: 2.1 time: 0.235121 Sep 14 09:19:42.749101 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2898/5773] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:19:42 2022] GET /compute/v2.1/servers/454eae36-ac14-41c3-ae82-9453adf7b230 => generated 1471 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:19:43.759858 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-1abd3dcc-e973-4408-a24d-696fa9409d7e tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:43.760585 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-1abd3dcc-e973-4408-a24d-696fa9409d7e tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] [instance: 454eae36-ac14-41c3-ae82-9453adf7b230] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:43.770614 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=48 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:19:43.775250 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1abd3dcc-e973-4408-a24d-696fa9409d7e tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:43.778404 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1abd3dcc-e973-4408-a24d-696fa9409d7e tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:43.779315 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1abd3dcc-e973-4408-a24d-696fa9409d7e tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:43.782564 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1abd3dcc-e973-4408-a24d-696fa9409d7e tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:43.783835 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1abd3dcc-e973-4408-a24d-696fa9409d7e tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:43.785919 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1abd3dcc-e973-4408-a24d-696fa9409d7e tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:44.056492 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-1abd3dcc-e973-4408-a24d-696fa9409d7e tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1f3762fce549df9225bd487e237abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57236332371c46c48719401846bfaca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:44.069554 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-1abd3dcc-e973-4408-a24d-696fa9409d7e tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] 10.222.0.60 "GET /compute/v2.1/servers/454eae36-ac14-41c3-ae82-9453adf7b230" status: 200 len: 1471 microversion: 2.1 time: 0.313412 Sep 14 09:19:44.070926 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2876/5774] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:19:43 2022] GET /compute/v2.1/servers/454eae36-ac14-41c3-ae82-9453adf7b230 => generated 1471 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:19:45.093692 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-2b828dc9-c348-4c47-8344-fc175bfe9f7d tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:45.094324 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-2b828dc9-c348-4c47-8344-fc175bfe9f7d tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] [instance: 454eae36-ac14-41c3-ae82-9453adf7b230] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:45.099157 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=2 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:19:45.103234 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=6 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:19:45.121032 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2b828dc9-c348-4c47-8344-fc175bfe9f7d tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:45.127191 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2b828dc9-c348-4c47-8344-fc175bfe9f7d tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:45.128317 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2b828dc9-c348-4c47-8344-fc175bfe9f7d tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:45.129657 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2b828dc9-c348-4c47-8344-fc175bfe9f7d tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:45.130402 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2b828dc9-c348-4c47-8344-fc175bfe9f7d tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:45.131223 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2b828dc9-c348-4c47-8344-fc175bfe9f7d tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:45.135649 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:19:45.306766 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-c24e35e1-beea-4795-86ff-2e4fa72c9618 req-4ddb1baf-88b8-4f77-8d83-3a7a7a3163e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "454eae36-ac14-41c3-ae82-9453adf7b230", "name": "network-vif-plugged", "status": "completed", "tag": "0e0086f9-f896-4fce-8a39-709c65828318"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:19:45.315490 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=2 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:19:45.338112 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-c24e35e1-beea-4795-86ff-2e4fa72c9618 req-4ddb1baf-88b8-4f77-8d83-3a7a7a3163e6 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:45.338924 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-c24e35e1-beea-4795-86ff-2e4fa72c9618 req-4ddb1baf-88b8-4f77-8d83-3a7a7a3163e6 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:45.340074 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-c24e35e1-beea-4795-86ff-2e4fa72c9618 req-4ddb1baf-88b8-4f77-8d83-3a7a7a3163e6 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:45.371921 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-c24e35e1-beea-4795-86ff-2e4fa72c9618 req-4ddb1baf-88b8-4f77-8d83-3a7a7a3163e6 service nova] Creating event network-vif-plugged:0e0086f9-f896-4fce-8a39-709c65828318 for instance 454eae36-ac14-41c3-ae82-9453adf7b230 on n-h2-836830-18 Sep 14 09:19:45.379765 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-c24e35e1-beea-4795-86ff-2e4fa72c9618 req-4ddb1baf-88b8-4f77-8d83-3a7a7a3163e6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079632 Sep 14 09:19:45.387067 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2877/5775] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:19:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:19:45.465870 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-2b828dc9-c348-4c47-8344-fc175bfe9f7d tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1f3762fce549df9225bd487e237abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57236332371c46c48719401846bfaca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:45.475856 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-2b828dc9-c348-4c47-8344-fc175bfe9f7d tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] 10.222.0.60 "GET /compute/v2.1/servers/454eae36-ac14-41c3-ae82-9453adf7b230" status: 200 len: 1471 microversion: 2.1 time: 0.386494 Sep 14 09:19:45.478330 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2899/5776] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:19:45 2022] GET /compute/v2.1/servers/454eae36-ac14-41c3-ae82-9453adf7b230 => generated 1471 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:19:46.504307 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a6684a66-f11e-4038-9a9b-ba03143fcea4 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:46.505586 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-a6684a66-f11e-4038-9a9b-ba03143fcea4 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] [instance: 454eae36-ac14-41c3-ae82-9453adf7b230] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:46.516464 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a6684a66-f11e-4038-9a9b-ba03143fcea4 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:46.516797 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a6684a66-f11e-4038-9a9b-ba03143fcea4 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:46.517804 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a6684a66-f11e-4038-9a9b-ba03143fcea4 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:46.519034 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a6684a66-f11e-4038-9a9b-ba03143fcea4 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:46.519885 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a6684a66-f11e-4038-9a9b-ba03143fcea4 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:46.520699 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a6684a66-f11e-4038-9a9b-ba03143fcea4 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:46.760804 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-a6684a66-f11e-4038-9a9b-ba03143fcea4 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1f3762fce549df9225bd487e237abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57236332371c46c48719401846bfaca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:46.770790 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a6684a66-f11e-4038-9a9b-ba03143fcea4 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] 10.222.0.60 "GET /compute/v2.1/servers/454eae36-ac14-41c3-ae82-9453adf7b230" status: 200 len: 1471 microversion: 2.1 time: 0.273586 Sep 14 09:19:46.774484 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2878/5777] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:19:46 2022] GET /compute/v2.1/servers/454eae36-ac14-41c3-ae82-9453adf7b230 => generated 1471 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:19:47.803316 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-2d8ba28d-f6f9-46c9-9983-430ac0e3cdc8 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:47.803858 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-2d8ba28d-f6f9-46c9-9983-430ac0e3cdc8 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] [instance: 454eae36-ac14-41c3-ae82-9453adf7b230] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:47.810383 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2d8ba28d-f6f9-46c9-9983-430ac0e3cdc8 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:47.810875 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2d8ba28d-f6f9-46c9-9983-430ac0e3cdc8 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:47.811342 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2d8ba28d-f6f9-46c9-9983-430ac0e3cdc8 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:47.812038 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2d8ba28d-f6f9-46c9-9983-430ac0e3cdc8 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:47.812526 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2d8ba28d-f6f9-46c9-9983-430ac0e3cdc8 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:47.812956 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2d8ba28d-f6f9-46c9-9983-430ac0e3cdc8 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:48.040215 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-2d8ba28d-f6f9-46c9-9983-430ac0e3cdc8 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1f3762fce549df9225bd487e237abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57236332371c46c48719401846bfaca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:48.050681 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-2d8ba28d-f6f9-46c9-9983-430ac0e3cdc8 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] 10.222.0.60 "GET /compute/v2.1/servers/454eae36-ac14-41c3-ae82-9453adf7b230" status: 200 len: 1642 microversion: 2.1 time: 0.252336 Sep 14 09:19:48.069629 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2900/5778] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:19:47 2022] GET /compute/v2.1/servers/454eae36-ac14-41c3-ae82-9453adf7b230 => generated 1642 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:19:48.075840 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-05cea5b3-aab8-4359-bff2-c63a5d513660 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:48.077099 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-05cea5b3-aab8-4359-bff2-c63a5d513660 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] [instance: 454eae36-ac14-41c3-ae82-9453adf7b230] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:48.086135 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-05cea5b3-aab8-4359-bff2-c63a5d513660 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:48.087059 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-05cea5b3-aab8-4359-bff2-c63a5d513660 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:48.087661 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-05cea5b3-aab8-4359-bff2-c63a5d513660 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:48.088514 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-05cea5b3-aab8-4359-bff2-c63a5d513660 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:48.089245 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-05cea5b3-aab8-4359-bff2-c63a5d513660 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:48.089837 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-05cea5b3-aab8-4359-bff2-c63a5d513660 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:48.257716 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-05cea5b3-aab8-4359-bff2-c63a5d513660 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1f3762fce549df9225bd487e237abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57236332371c46c48719401846bfaca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:48.266863 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-05cea5b3-aab8-4359-bff2-c63a5d513660 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] 10.222.0.60 "GET /compute/v2.1/servers/454eae36-ac14-41c3-ae82-9453adf7b230" status: 200 len: 1642 microversion: 2.1 time: 0.195287 Sep 14 09:19:48.269398 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2879/5779] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:19:48 2022] GET /compute/v2.1/servers/454eae36-ac14-41c3-ae82-9453adf7b230 => generated 1642 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:19:48.291040 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-41075692-f30c-465a-b258-2404f26e8fb7 tempest-TestSecurityGroupsBasicOps-1429721975 tempest-TestSecurityGroupsBasicOps-1429721975-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:48.291804 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-41075692-f30c-465a-b258-2404f26e8fb7 tempest-TestSecurityGroupsBasicOps-1429721975 tempest-TestSecurityGroupsBasicOps-1429721975-project-admin] [instance: 454eae36-ac14-41c3-ae82-9453adf7b230] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:48.295173 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=4 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:19:48.306018 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-41075692-f30c-465a-b258-2404f26e8fb7 tempest-TestSecurityGroupsBasicOps-1429721975 tempest-TestSecurityGroupsBasicOps-1429721975-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:48.306925 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-41075692-f30c-465a-b258-2404f26e8fb7 tempest-TestSecurityGroupsBasicOps-1429721975 tempest-TestSecurityGroupsBasicOps-1429721975-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:48.309980 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-41075692-f30c-465a-b258-2404f26e8fb7 tempest-TestSecurityGroupsBasicOps-1429721975 tempest-TestSecurityGroupsBasicOps-1429721975-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:48.311178 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-41075692-f30c-465a-b258-2404f26e8fb7 tempest-TestSecurityGroupsBasicOps-1429721975 tempest-TestSecurityGroupsBasicOps-1429721975-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:48.311867 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-41075692-f30c-465a-b258-2404f26e8fb7 tempest-TestSecurityGroupsBasicOps-1429721975 tempest-TestSecurityGroupsBasicOps-1429721975-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:48.312972 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-41075692-f30c-465a-b258-2404f26e8fb7 tempest-TestSecurityGroupsBasicOps-1429721975 tempest-TestSecurityGroupsBasicOps-1429721975-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:48.649084 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-41075692-f30c-465a-b258-2404f26e8fb7 tempest-TestSecurityGroupsBasicOps-1429721975 tempest-TestSecurityGroupsBasicOps-1429721975-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/454eae36-ac14-41c3-ae82-9453adf7b230" status: 200 len: 1795 microversion: 2.1 time: 0.361996 Sep 14 09:19:48.652584 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2901/5780] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:19:48 2022] GET /compute/v2.1/servers/454eae36-ac14-41c3-ae82-9453adf7b230 => generated 1795 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:19:50.847950 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-247ea1cf-bfd6-4099-a644-d521bc9754ff req-c7bb24e7-c5d7-4dd7-9729-b514e01d31a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "454eae36-ac14-41c3-ae82-9453adf7b230", "tag": "0e0086f9-f896-4fce-8a39-709c65828318"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:19:50.858722 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-247ea1cf-bfd6-4099-a644-d521bc9754ff req-c7bb24e7-c5d7-4dd7-9729-b514e01d31a4 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:50.859237 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-247ea1cf-bfd6-4099-a644-d521bc9754ff req-c7bb24e7-c5d7-4dd7-9729-b514e01d31a4 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:50.859668 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-247ea1cf-bfd6-4099-a644-d521bc9754ff req-c7bb24e7-c5d7-4dd7-9729-b514e01d31a4 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:50.894340 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=61 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:19:50.896617 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-247ea1cf-bfd6-4099-a644-d521bc9754ff req-c7bb24e7-c5d7-4dd7-9729-b514e01d31a4 service nova] Creating event network-changed:0e0086f9-f896-4fce-8a39-709c65828318 for instance 454eae36-ac14-41c3-ae82-9453adf7b230 on n-h2-836830-18 Sep 14 09:19:50.911827 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-247ea1cf-bfd6-4099-a644-d521bc9754ff req-c7bb24e7-c5d7-4dd7-9729-b514e01d31a4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066131 Sep 14 09:19:50.912474 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2880/5781] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:19:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:20:15.125479 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:20:15.127375 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=17 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:20:15.306208 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-f9a0a8f0-7772-4bab-8b74-ba7a96c44830 tempest-PortsAdminExtendedAttrsTestJSON-1853399950 tempest-PortsAdminExtendedAttrsTestJSON-1853399950-project-admin] Calling method '.version_select at 0x7f7d3f3b88b0>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:20:15.324756 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f9a0a8f0-7772-4bab-8b74-ba7a96c44830 tempest-PortsAdminExtendedAttrsTestJSON-1853399950 tempest-PortsAdminExtendedAttrsTestJSON-1853399950-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:15.324756 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f9a0a8f0-7772-4bab-8b74-ba7a96c44830 tempest-PortsAdminExtendedAttrsTestJSON-1853399950 tempest-PortsAdminExtendedAttrsTestJSON-1853399950-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:15.324756 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f9a0a8f0-7772-4bab-8b74-ba7a96c44830 tempest-PortsAdminExtendedAttrsTestJSON-1853399950 tempest-PortsAdminExtendedAttrsTestJSON-1853399950-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:15.347929 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f9a0a8f0-7772-4bab-8b74-ba7a96c44830 tempest-PortsAdminExtendedAttrsTestJSON-1853399950 tempest-PortsAdminExtendedAttrsTestJSON-1853399950-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:15.348647 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f9a0a8f0-7772-4bab-8b74-ba7a96c44830 tempest-PortsAdminExtendedAttrsTestJSON-1853399950 tempest-PortsAdminExtendedAttrsTestJSON-1853399950-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:15.349254 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f9a0a8f0-7772-4bab-8b74-ba7a96c44830 tempest-PortsAdminExtendedAttrsTestJSON-1853399950 tempest-PortsAdminExtendedAttrsTestJSON-1853399950-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:15.362486 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f9a0a8f0-7772-4bab-8b74-ba7a96c44830 tempest-PortsAdminExtendedAttrsTestJSON-1853399950 tempest-PortsAdminExtendedAttrsTestJSON-1853399950-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:15.363020 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f9a0a8f0-7772-4bab-8b74-ba7a96c44830 tempest-PortsAdminExtendedAttrsTestJSON-1853399950 tempest-PortsAdminExtendedAttrsTestJSON-1853399950-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:15.363476 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f9a0a8f0-7772-4bab-8b74-ba7a96c44830 tempest-PortsAdminExtendedAttrsTestJSON-1853399950 tempest-PortsAdminExtendedAttrsTestJSON-1853399950-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:15.370774 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-f9a0a8f0-7772-4bab-8b74-ba7a96c44830 tempest-PortsAdminExtendedAttrsTestJSON-1853399950 tempest-PortsAdminExtendedAttrsTestJSON-1853399950-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.253550 Sep 14 09:20:15.378056 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2902/5782] 10.222.0.60 () {58 vars in 1146 bytes} [Wed Sep 14 09:20:15 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:20:34.442823 n-d-836830-18 devstack@n-api.service[128759]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 09:20:34.443503 n-d-836830-18 devstack@n-api.service[128759]: Wed Sep 14 09:20:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0/ips (ip 10.222.0.60) !!! Sep 14 09:20:34.444081 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=9 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:20:34.451205 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-21476eb8-346b-449a-90af-2f81ee85f944 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:20:34.463939 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-21476eb8-346b-449a-90af-2f81ee85f944 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] [instance: 022379ab-af51-495a-bcef-11e43774a7b0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:20:34.473243 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-21476eb8-346b-449a-90af-2f81ee85f944 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:34.473916 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-21476eb8-346b-449a-90af-2f81ee85f944 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:34.474471 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-21476eb8-346b-449a-90af-2f81ee85f944 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:34.475330 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-21476eb8-346b-449a-90af-2f81ee85f944 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:34.478538 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-21476eb8-346b-449a-90af-2f81ee85f944 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:34.479144 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-21476eb8-346b-449a-90af-2f81ee85f944 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:34.538050 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-21476eb8-346b-449a-90af-2f81ee85f944 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] 10.222.0.60 "GET /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0/ips" status: 200 len: 144 microversion: 2.1 time: 0.096707 Sep 14 09:20:34.545238 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2881/5783] 10.222.0.60 () {58 vars in 1248 bytes} [Wed Sep 14 09:20:34 2022] GET /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0/ips => generated 144 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:20:37.193150 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-02919fcc-d662-4f15-b1b1-4ed081a57c14 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-760946926", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "networks": [{"uuid": "150d4796-be4a-4a56-9b5e-ec9b8f977dbd"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1664083085", "security_groups": []}, "os:scheduler_hints": {"different_host": ["454eae36-ac14-41c3-ae82-9453adf7b230"]}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:20:37.276320 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=4 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:20:37.278388 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=6 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:20:37.352671 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.network.neutron [None req-02919fcc-d662-4f15-b1b1-4ed081a57c14 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] validate_networks() for [('150d4796-be4a-4a56-9b5e-ec9b8f977dbd', None, None, None, None, None)] {{(pid=128758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:20:37.883229 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-02919fcc-d662-4f15-b1b1-4ed081a57c14 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Flavor limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:20:37.883748 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-02919fcc-d662-4f15-b1b1-4ed081a57c14 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Image limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:20:37.884362 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-02919fcc-d662-4f15-b1b1-4ed081a57c14 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Flavor pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:20:37.884847 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-02919fcc-d662-4f15-b1b1-4ed081a57c14 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Image pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:20:37.885365 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-02919fcc-d662-4f15-b1b1-4ed081a57c14 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:20:37.896239 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-02919fcc-d662-4f15-b1b1-4ed081a57c14 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:37.897045 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-02919fcc-d662-4f15-b1b1-4ed081a57c14 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:37.897552 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-02919fcc-d662-4f15-b1b1-4ed081a57c14 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:37.898412 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-02919fcc-d662-4f15-b1b1-4ed081a57c14 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:37.898966 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-02919fcc-d662-4f15-b1b1-4ed081a57c14 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:37.899478 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-02919fcc-d662-4f15-b1b1-4ed081a57c14 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:37.920843 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-02919fcc-d662-4f15-b1b1-4ed081a57c14 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Getting quotas for project 57236332371c46c48719401846bfaca4. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:20:37.926429 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-02919fcc-d662-4f15-b1b1-4ed081a57c14 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Getting quotas for user 7e1f3762fce549df9225bd487e237abd and project 57236332371c46c48719401846bfaca4. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:20:37.941535 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-02919fcc-d662-4f15-b1b1-4ed081a57c14 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Going to run 1 instances... {{(pid=128758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:20:37.944068 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-02919fcc-d662-4f15-b1b1-4ed081a57c14 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] [instance: 48f08ac4-01e9-492a-b249-9eb99c914f74] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:20:38.010689 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-02919fcc-d662-4f15-b1b1-4ed081a57c14 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 0.823030 Sep 14 09:20:38.025582 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-afedf194-bde5-4dc8-a357-6781bfb11716 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:20:38.026888 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-afedf194-bde5-4dc8-a357-6781bfb11716 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] [instance: 48f08ac4-01e9-492a-b249-9eb99c914f74] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:20:38.034511 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2903/5784] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 09:20:37 2022] POST /compute/v2.1/servers => generated 361 bytes in 846 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:20:38.061555 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d7021d43-1fe6-4a72-b222-3ccfd55ee72c tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d5e0e550-2f8b-4a4a-9e20-33b038e0cbb6"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:20:38.064965 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-d7021d43-1fe6-4a72-b222-3ccfd55ee72c tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] [instance: 022379ab-af51-495a-bcef-11e43774a7b0] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:20:38.087444 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d7021d43-1fe6-4a72-b222-3ccfd55ee72c tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:38.089726 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d7021d43-1fe6-4a72-b222-3ccfd55ee72c tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:38.090290 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d7021d43-1fe6-4a72-b222-3ccfd55ee72c tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:38.091133 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d7021d43-1fe6-4a72-b222-3ccfd55ee72c tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:38.091680 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d7021d43-1fe6-4a72-b222-3ccfd55ee72c tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:38.092018 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d7021d43-1fe6-4a72-b222-3ccfd55ee72c tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:38.171639 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-afedf194-bde5-4dc8-a357-6781bfb11716 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1f3762fce549df9225bd487e237abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57236332371c46c48719401846bfaca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:20:38.181128 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-afedf194-bde5-4dc8-a357-6781bfb11716 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] 10.222.0.60 "GET /compute/v2.1/servers/48f08ac4-01e9-492a-b249-9eb99c914f74" status: 200 len: 1241 microversion: 2.1 time: 0.160380 Sep 14 09:20:38.182287 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2882/5785] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:20:38 2022] GET /compute/v2.1/servers/48f08ac4-01e9-492a-b249-9eb99c914f74 => generated 1241 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:20:38.680696 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-d7021d43-1fe6-4a72-b222-3ccfd55ee72c tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] 10.222.0.60 "POST /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.623085 Sep 14 09:20:38.687882 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2904/5786] 10.222.0.60 () {60 vars in 1323 bytes} [Wed Sep 14 09:20:38 2022] POST /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0/os-volume_attachments => generated 194 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:20:39.213774 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-0b54db1f-b1e2-4fde-a6ef-439c159c5a30 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:20:39.215596 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-0b54db1f-b1e2-4fde-a6ef-439c159c5a30 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] [instance: 48f08ac4-01e9-492a-b249-9eb99c914f74] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:20:39.232164 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0b54db1f-b1e2-4fde-a6ef-439c159c5a30 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:39.233605 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0b54db1f-b1e2-4fde-a6ef-439c159c5a30 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:39.235581 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0b54db1f-b1e2-4fde-a6ef-439c159c5a30 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:39.236524 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0b54db1f-b1e2-4fde-a6ef-439c159c5a30 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:39.238586 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0b54db1f-b1e2-4fde-a6ef-439c159c5a30 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:39.239600 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0b54db1f-b1e2-4fde-a6ef-439c159c5a30 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:39.504730 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-0b54db1f-b1e2-4fde-a6ef-439c159c5a30 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1f3762fce549df9225bd487e237abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57236332371c46c48719401846bfaca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:20:39.513690 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-0b54db1f-b1e2-4fde-a6ef-439c159c5a30 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] 10.222.0.60 "GET /compute/v2.1/servers/48f08ac4-01e9-492a-b249-9eb99c914f74" status: 200 len: 1245 microversion: 2.1 time: 0.304882 Sep 14 09:20:39.514893 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2883/5787] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:20:39 2022] GET /compute/v2.1/servers/48f08ac4-01e9-492a-b249-9eb99c914f74 => generated 1245 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:20:40.540546 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c4d85e66-68b7-43ef-a96c-7afbeaffcf20 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:20:40.541237 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-c4d85e66-68b7-43ef-a96c-7afbeaffcf20 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] [instance: 48f08ac4-01e9-492a-b249-9eb99c914f74] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:20:40.567940 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c4d85e66-68b7-43ef-a96c-7afbeaffcf20 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:40.570197 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c4d85e66-68b7-43ef-a96c-7afbeaffcf20 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:40.571213 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c4d85e66-68b7-43ef-a96c-7afbeaffcf20 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:40.573730 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c4d85e66-68b7-43ef-a96c-7afbeaffcf20 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:40.575370 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c4d85e66-68b7-43ef-a96c-7afbeaffcf20 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:40.576265 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c4d85e66-68b7-43ef-a96c-7afbeaffcf20 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:41.150043 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-c4d85e66-68b7-43ef-a96c-7afbeaffcf20 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1f3762fce549df9225bd487e237abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57236332371c46c48719401846bfaca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:20:41.164586 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-c4d85e66-68b7-43ef-a96c-7afbeaffcf20 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] 10.222.0.60 "GET /compute/v2.1/servers/48f08ac4-01e9-492a-b249-9eb99c914f74" status: 200 len: 1311 microversion: 2.1 time: 0.630307 Sep 14 09:20:41.192144 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2905/5788] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:20:40 2022] GET /compute/v2.1/servers/48f08ac4-01e9-492a-b249-9eb99c914f74 => generated 1311 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:20:42.207144 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f2499f9c-4984-4f8f-8bee-badff06476bf tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:20:42.208044 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f2499f9c-4984-4f8f-8bee-badff06476bf tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] [instance: 48f08ac4-01e9-492a-b249-9eb99c914f74] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:20:42.231105 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f2499f9c-4984-4f8f-8bee-badff06476bf tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:42.231623 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f2499f9c-4984-4f8f-8bee-badff06476bf tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:42.232082 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f2499f9c-4984-4f8f-8bee-badff06476bf tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:42.232821 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f2499f9c-4984-4f8f-8bee-badff06476bf tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:42.233284 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f2499f9c-4984-4f8f-8bee-badff06476bf tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:42.233723 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f2499f9c-4984-4f8f-8bee-badff06476bf tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:42.683976 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f2499f9c-4984-4f8f-8bee-badff06476bf tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1f3762fce549df9225bd487e237abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57236332371c46c48719401846bfaca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:20:42.706313 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f2499f9c-4984-4f8f-8bee-badff06476bf tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] 10.222.0.60 "GET /compute/v2.1/servers/48f08ac4-01e9-492a-b249-9eb99c914f74" status: 200 len: 1299 microversion: 2.1 time: 0.497567 Sep 14 09:20:42.707059 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2884/5789] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:20:42 2022] GET /compute/v2.1/servers/48f08ac4-01e9-492a-b249-9eb99c914f74 => generated 1299 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:20:43.730539 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-7b732e61-67d2-468d-9b20-4551d8e2eab9 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:20:43.731278 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-7b732e61-67d2-468d-9b20-4551d8e2eab9 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] [instance: 48f08ac4-01e9-492a-b249-9eb99c914f74] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:20:43.760729 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7b732e61-67d2-468d-9b20-4551d8e2eab9 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:43.761674 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7b732e61-67d2-468d-9b20-4551d8e2eab9 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:43.763999 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7b732e61-67d2-468d-9b20-4551d8e2eab9 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:43.764825 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7b732e61-67d2-468d-9b20-4551d8e2eab9 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:43.765309 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7b732e61-67d2-468d-9b20-4551d8e2eab9 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:43.765742 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7b732e61-67d2-468d-9b20-4551d8e2eab9 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:44.035691 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-7b732e61-67d2-468d-9b20-4551d8e2eab9 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1f3762fce549df9225bd487e237abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57236332371c46c48719401846bfaca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:20:44.052119 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-7b732e61-67d2-468d-9b20-4551d8e2eab9 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] 10.222.0.60 "GET /compute/v2.1/servers/48f08ac4-01e9-492a-b249-9eb99c914f74" status: 200 len: 1299 microversion: 2.1 time: 0.324357 Sep 14 09:20:44.054928 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2906/5790] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:20:43 2022] GET /compute/v2.1/servers/48f08ac4-01e9-492a-b249-9eb99c914f74 => generated 1299 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:20:44.157715 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-a0be3034-ad43-4a97-ad84-74f57190151f req-711d8876-b8c9-447b-bd1b-9918be2818ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48f08ac4-01e9-492a-b249-9eb99c914f74", "tag": "9111a2dd-2a83-4ed0-80ba-0de85a6b3a89"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:20:44.190209 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-a0be3034-ad43-4a97-ad84-74f57190151f req-711d8876-b8c9-447b-bd1b-9918be2818ed service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:44.190871 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-a0be3034-ad43-4a97-ad84-74f57190151f req-711d8876-b8c9-447b-bd1b-9918be2818ed service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:44.191815 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-a0be3034-ad43-4a97-ad84-74f57190151f req-711d8876-b8c9-447b-bd1b-9918be2818ed service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:44.228340 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-a0be3034-ad43-4a97-ad84-74f57190151f req-711d8876-b8c9-447b-bd1b-9918be2818ed service nova] Creating event network-changed:9111a2dd-2a83-4ed0-80ba-0de85a6b3a89 for instance 48f08ac4-01e9-492a-b249-9eb99c914f74 on n-h1-836830-18 Sep 14 09:20:44.243110 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-a0be3034-ad43-4a97-ad84-74f57190151f req-711d8876-b8c9-447b-bd1b-9918be2818ed service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088983 Sep 14 09:20:44.244077 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2885/5791] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:20:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:20:45.085168 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-cf196047-5f2a-4259-9273-2b203679a033 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:20:45.087032 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-cf196047-5f2a-4259-9273-2b203679a033 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] [instance: 48f08ac4-01e9-492a-b249-9eb99c914f74] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:20:45.095805 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cf196047-5f2a-4259-9273-2b203679a033 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:45.097053 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cf196047-5f2a-4259-9273-2b203679a033 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:45.097694 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cf196047-5f2a-4259-9273-2b203679a033 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:45.099188 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cf196047-5f2a-4259-9273-2b203679a033 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:45.100115 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cf196047-5f2a-4259-9273-2b203679a033 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:45.101342 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cf196047-5f2a-4259-9273-2b203679a033 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:45.317618 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-cf196047-5f2a-4259-9273-2b203679a033 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1f3762fce549df9225bd487e237abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57236332371c46c48719401846bfaca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:20:45.331249 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-cf196047-5f2a-4259-9273-2b203679a033 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] 10.222.0.60 "GET /compute/v2.1/servers/48f08ac4-01e9-492a-b249-9eb99c914f74" status: 200 len: 1299 microversion: 2.1 time: 0.252515 Sep 14 09:20:45.331924 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2907/5792] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:20:45 2022] GET /compute/v2.1/servers/48f08ac4-01e9-492a-b249-9eb99c914f74 => generated 1299 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:20:46.358402 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ba2bcad7-9034-4bff-8cdb-de357d3f61a5 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:20:46.359800 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-ba2bcad7-9034-4bff-8cdb-de357d3f61a5 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] [instance: 48f08ac4-01e9-492a-b249-9eb99c914f74] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:20:46.367433 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ba2bcad7-9034-4bff-8cdb-de357d3f61a5 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:46.368123 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ba2bcad7-9034-4bff-8cdb-de357d3f61a5 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:46.368729 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ba2bcad7-9034-4bff-8cdb-de357d3f61a5 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:46.369719 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ba2bcad7-9034-4bff-8cdb-de357d3f61a5 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:46.381844 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ba2bcad7-9034-4bff-8cdb-de357d3f61a5 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:46.383022 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ba2bcad7-9034-4bff-8cdb-de357d3f61a5 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:46.533113 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-ba2bcad7-9034-4bff-8cdb-de357d3f61a5 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1f3762fce549df9225bd487e237abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57236332371c46c48719401846bfaca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:20:46.543753 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-ba2bcad7-9034-4bff-8cdb-de357d3f61a5 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] 10.222.0.60 "GET /compute/v2.1/servers/48f08ac4-01e9-492a-b249-9eb99c914f74" status: 200 len: 1299 microversion: 2.1 time: 0.189362 Sep 14 09:20:46.544767 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2886/5793] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:20:46 2022] GET /compute/v2.1/servers/48f08ac4-01e9-492a-b249-9eb99c914f74 => generated 1299 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:20:47.025354 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a1e30c09-3dfc-4385-ba75-1906ae62958d tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "09d9bf1e-bf95-422c-a2cb-5f728592319d"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:20:47.028815 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-a1e30c09-3dfc-4385-ba75-1906ae62958d tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 600cbae0-3580-4e55-9577-33b7a08439ad] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:20:47.043440 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a1e30c09-3dfc-4385-ba75-1906ae62958d tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:47.043960 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a1e30c09-3dfc-4385-ba75-1906ae62958d tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:47.044414 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a1e30c09-3dfc-4385-ba75-1906ae62958d tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:47.045161 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a1e30c09-3dfc-4385-ba75-1906ae62958d tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:47.045621 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a1e30c09-3dfc-4385-ba75-1906ae62958d tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:47.046060 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a1e30c09-3dfc-4385-ba75-1906ae62958d tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:47.580903 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-6e7ce113-8068-4276-b527-c3968bb9e7cf tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:20:47.582292 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-6e7ce113-8068-4276-b527-c3968bb9e7cf tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] [instance: 48f08ac4-01e9-492a-b249-9eb99c914f74] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:20:47.591683 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6e7ce113-8068-4276-b527-c3968bb9e7cf tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:47.592494 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6e7ce113-8068-4276-b527-c3968bb9e7cf tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:47.593115 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6e7ce113-8068-4276-b527-c3968bb9e7cf tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:47.594555 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6e7ce113-8068-4276-b527-c3968bb9e7cf tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:47.595200 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6e7ce113-8068-4276-b527-c3968bb9e7cf tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:47.595787 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6e7ce113-8068-4276-b527-c3968bb9e7cf tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:47.772691 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-6e7ce113-8068-4276-b527-c3968bb9e7cf tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1f3762fce549df9225bd487e237abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57236332371c46c48719401846bfaca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:20:47.784596 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-6e7ce113-8068-4276-b527-c3968bb9e7cf tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] 10.222.0.60 "GET /compute/v2.1/servers/48f08ac4-01e9-492a-b249-9eb99c914f74" status: 200 len: 1299 microversion: 2.1 time: 0.215443 Sep 14 09:20:47.786051 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2887/5794] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:20:47 2022] GET /compute/v2.1/servers/48f08ac4-01e9-492a-b249-9eb99c914f74 => generated 1299 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:20:47.916867 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=2 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:20:47.919437 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-a1e30c09-3dfc-4385-ba75-1906ae62958d tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "POST /compute/v2.1/servers/600cbae0-3580-4e55-9577-33b7a08439ad/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.898026 Sep 14 09:20:47.928291 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2908/5795] 10.222.0.60 () {60 vars in 1323 bytes} [Wed Sep 14 09:20:47 2022] POST /compute/v2.1/servers/600cbae0-3580-4e55-9577-33b7a08439ad/os-volume_attachments => generated 194 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:20:48.813131 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-acb8ad31-7ab1-441f-a434-0e2dd2a3289b tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:20:48.814738 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-acb8ad31-7ab1-441f-a434-0e2dd2a3289b tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] [instance: 48f08ac4-01e9-492a-b249-9eb99c914f74] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:20:48.825326 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=2 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:20:48.829353 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-acb8ad31-7ab1-441f-a434-0e2dd2a3289b tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:48.835453 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-acb8ad31-7ab1-441f-a434-0e2dd2a3289b tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:48.836142 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-acb8ad31-7ab1-441f-a434-0e2dd2a3289b tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:48.837126 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-acb8ad31-7ab1-441f-a434-0e2dd2a3289b tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:48.839572 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-acb8ad31-7ab1-441f-a434-0e2dd2a3289b tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:48.841950 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-acb8ad31-7ab1-441f-a434-0e2dd2a3289b tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:49.073205 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-acb8ad31-7ab1-441f-a434-0e2dd2a3289b tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1f3762fce549df9225bd487e237abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57236332371c46c48719401846bfaca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:20:49.087768 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-acb8ad31-7ab1-441f-a434-0e2dd2a3289b tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] 10.222.0.60 "GET /compute/v2.1/servers/48f08ac4-01e9-492a-b249-9eb99c914f74" status: 200 len: 1299 microversion: 2.1 time: 0.276814 Sep 14 09:20:49.089073 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2888/5796] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:20:48 2022] GET /compute/v2.1/servers/48f08ac4-01e9-492a-b249-9eb99c914f74 => generated 1299 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:20:50.111906 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=6 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:20:50.118829 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-7a12a51e-b9e3-43cb-b1d7-7f026762b969 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:20:50.124291 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-7a12a51e-b9e3-43cb-b1d7-7f026762b969 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] [instance: 48f08ac4-01e9-492a-b249-9eb99c914f74] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:20:50.141489 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7a12a51e-b9e3-43cb-b1d7-7f026762b969 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:50.142016 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7a12a51e-b9e3-43cb-b1d7-7f026762b969 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:50.142474 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7a12a51e-b9e3-43cb-b1d7-7f026762b969 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:50.148564 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7a12a51e-b9e3-43cb-b1d7-7f026762b969 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:50.149092 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7a12a51e-b9e3-43cb-b1d7-7f026762b969 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:50.153838 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7a12a51e-b9e3-43cb-b1d7-7f026762b969 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:50.327994 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-7a12a51e-b9e3-43cb-b1d7-7f026762b969 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1f3762fce549df9225bd487e237abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57236332371c46c48719401846bfaca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:20:50.354160 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-7a12a51e-b9e3-43cb-b1d7-7f026762b969 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] 10.222.0.60 "GET /compute/v2.1/servers/48f08ac4-01e9-492a-b249-9eb99c914f74" status: 200 len: 1299 microversion: 2.1 time: 0.235031 Sep 14 09:20:50.355683 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2909/5797] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:20:50 2022] GET /compute/v2.1/servers/48f08ac4-01e9-492a-b249-9eb99c914f74 => generated 1299 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:20:51.379732 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-1cb85cc7-4cb8-47fd-bf09-f0567c4ce037 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:20:51.381129 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-1cb85cc7-4cb8-47fd-bf09-f0567c4ce037 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] [instance: 48f08ac4-01e9-492a-b249-9eb99c914f74] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:20:51.397098 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1cb85cc7-4cb8-47fd-bf09-f0567c4ce037 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:51.400138 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1cb85cc7-4cb8-47fd-bf09-f0567c4ce037 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:51.402538 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1cb85cc7-4cb8-47fd-bf09-f0567c4ce037 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:51.404801 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1cb85cc7-4cb8-47fd-bf09-f0567c4ce037 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:51.407225 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1cb85cc7-4cb8-47fd-bf09-f0567c4ce037 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:51.409756 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1cb85cc7-4cb8-47fd-bf09-f0567c4ce037 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:51.610306 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-1cb85cc7-4cb8-47fd-bf09-f0567c4ce037 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1f3762fce549df9225bd487e237abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57236332371c46c48719401846bfaca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:20:51.622815 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-1cb85cc7-4cb8-47fd-bf09-f0567c4ce037 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] 10.222.0.60 "GET /compute/v2.1/servers/48f08ac4-01e9-492a-b249-9eb99c914f74" status: 200 len: 1299 microversion: 2.1 time: 0.246993 Sep 14 09:20:51.626076 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2889/5798] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:20:51 2022] GET /compute/v2.1/servers/48f08ac4-01e9-492a-b249-9eb99c914f74 => generated 1299 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:20:51.718737 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-5f747531-6d17-4962-8381-6dfdbe20428d req-821c8c11-0222-400a-8363-c8d834ab8725 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48f08ac4-01e9-492a-b249-9eb99c914f74", "name": "network-vif-plugged", "status": "completed", "tag": "9111a2dd-2a83-4ed0-80ba-0de85a6b3a89"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:20:51.740970 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-5f747531-6d17-4962-8381-6dfdbe20428d req-821c8c11-0222-400a-8363-c8d834ab8725 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:51.741587 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-5f747531-6d17-4962-8381-6dfdbe20428d req-821c8c11-0222-400a-8363-c8d834ab8725 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:51.741895 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-5f747531-6d17-4962-8381-6dfdbe20428d req-821c8c11-0222-400a-8363-c8d834ab8725 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:51.776310 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-5f747531-6d17-4962-8381-6dfdbe20428d req-821c8c11-0222-400a-8363-c8d834ab8725 service nova] Creating event network-vif-plugged:9111a2dd-2a83-4ed0-80ba-0de85a6b3a89 for instance 48f08ac4-01e9-492a-b249-9eb99c914f74 on n-h1-836830-18 Sep 14 09:20:51.785286 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-5f747531-6d17-4962-8381-6dfdbe20428d req-821c8c11-0222-400a-8363-c8d834ab8725 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072441 Sep 14 09:20:51.787267 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2910/5799] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:20:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:20:52.649767 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9b6d6262-019f-4a4a-8cd2-e4ef2ed8b004 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:20:52.650472 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-9b6d6262-019f-4a4a-8cd2-e4ef2ed8b004 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] [instance: 48f08ac4-01e9-492a-b249-9eb99c914f74] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:20:52.658414 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9b6d6262-019f-4a4a-8cd2-e4ef2ed8b004 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:52.659304 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9b6d6262-019f-4a4a-8cd2-e4ef2ed8b004 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:52.659996 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9b6d6262-019f-4a4a-8cd2-e4ef2ed8b004 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:52.660925 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9b6d6262-019f-4a4a-8cd2-e4ef2ed8b004 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:52.661600 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9b6d6262-019f-4a4a-8cd2-e4ef2ed8b004 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:52.662246 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9b6d6262-019f-4a4a-8cd2-e4ef2ed8b004 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:52.823852 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-9b6d6262-019f-4a4a-8cd2-e4ef2ed8b004 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1f3762fce549df9225bd487e237abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57236332371c46c48719401846bfaca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:20:52.834150 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-9b6d6262-019f-4a4a-8cd2-e4ef2ed8b004 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] 10.222.0.60 "GET /compute/v2.1/servers/48f08ac4-01e9-492a-b249-9eb99c914f74" status: 200 len: 1299 microversion: 2.1 time: 0.188683 Sep 14 09:20:52.836718 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2890/5800] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:20:52 2022] GET /compute/v2.1/servers/48f08ac4-01e9-492a-b249-9eb99c914f74 => generated 1299 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:20:53.862290 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b3bd9d0a-097f-4289-9941-ece0cf7f5617 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:20:53.863747 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-b3bd9d0a-097f-4289-9941-ece0cf7f5617 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] [instance: 48f08ac4-01e9-492a-b249-9eb99c914f74] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:20:53.880632 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b3bd9d0a-097f-4289-9941-ece0cf7f5617 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:53.881437 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b3bd9d0a-097f-4289-9941-ece0cf7f5617 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:53.883475 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b3bd9d0a-097f-4289-9941-ece0cf7f5617 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:53.885642 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b3bd9d0a-097f-4289-9941-ece0cf7f5617 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:53.886903 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b3bd9d0a-097f-4289-9941-ece0cf7f5617 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:53.889450 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b3bd9d0a-097f-4289-9941-ece0cf7f5617 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:54.463283 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-b3bd9d0a-097f-4289-9941-ece0cf7f5617 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1f3762fce549df9225bd487e237abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57236332371c46c48719401846bfaca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:20:54.474544 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-b3bd9d0a-097f-4289-9941-ece0cf7f5617 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] 10.222.0.60 "GET /compute/v2.1/servers/48f08ac4-01e9-492a-b249-9eb99c914f74" status: 200 len: 1471 microversion: 2.1 time: 0.618126 Sep 14 09:20:54.474544 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2911/5801] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:20:53 2022] GET /compute/v2.1/servers/48f08ac4-01e9-492a-b249-9eb99c914f74 => generated 1471 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:20:54.501928 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ef8d17f8-37a6-4453-923e-364d4f134925 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:20:54.502718 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-ef8d17f8-37a6-4453-923e-364d4f134925 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] [instance: 48f08ac4-01e9-492a-b249-9eb99c914f74] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:20:54.523638 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ef8d17f8-37a6-4453-923e-364d4f134925 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:54.524878 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ef8d17f8-37a6-4453-923e-364d4f134925 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:54.548749 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ef8d17f8-37a6-4453-923e-364d4f134925 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:54.551899 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ef8d17f8-37a6-4453-923e-364d4f134925 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:54.563075 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ef8d17f8-37a6-4453-923e-364d4f134925 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:54.578711 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ef8d17f8-37a6-4453-923e-364d4f134925 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:54.848571 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-ef8d17f8-37a6-4453-923e-364d4f134925 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1f3762fce549df9225bd487e237abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57236332371c46c48719401846bfaca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:20:54.862502 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-ef8d17f8-37a6-4453-923e-364d4f134925 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] 10.222.0.60 "GET /compute/v2.1/servers/48f08ac4-01e9-492a-b249-9eb99c914f74" status: 200 len: 1471 microversion: 2.1 time: 0.366092 Sep 14 09:20:54.872661 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2891/5802] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:20:54 2022] GET /compute/v2.1/servers/48f08ac4-01e9-492a-b249-9eb99c914f74 => generated 1471 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:20:54.894739 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-65b998c7-9c7d-4468-ae6b-0ef899c3e6ce tempest-TestSecurityGroupsBasicOps-1429721975 tempest-TestSecurityGroupsBasicOps-1429721975-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:20:54.894739 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-65b998c7-9c7d-4468-ae6b-0ef899c3e6ce tempest-TestSecurityGroupsBasicOps-1429721975 tempest-TestSecurityGroupsBasicOps-1429721975-project-admin] [instance: 48f08ac4-01e9-492a-b249-9eb99c914f74] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:20:54.900956 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-65b998c7-9c7d-4468-ae6b-0ef899c3e6ce tempest-TestSecurityGroupsBasicOps-1429721975 tempest-TestSecurityGroupsBasicOps-1429721975-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:54.901457 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-65b998c7-9c7d-4468-ae6b-0ef899c3e6ce tempest-TestSecurityGroupsBasicOps-1429721975 tempest-TestSecurityGroupsBasicOps-1429721975-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:54.901910 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-65b998c7-9c7d-4468-ae6b-0ef899c3e6ce tempest-TestSecurityGroupsBasicOps-1429721975 tempest-TestSecurityGroupsBasicOps-1429721975-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:54.902625 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-65b998c7-9c7d-4468-ae6b-0ef899c3e6ce tempest-TestSecurityGroupsBasicOps-1429721975 tempest-TestSecurityGroupsBasicOps-1429721975-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:54.908242 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-65b998c7-9c7d-4468-ae6b-0ef899c3e6ce tempest-TestSecurityGroupsBasicOps-1429721975 tempest-TestSecurityGroupsBasicOps-1429721975-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:54.911449 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-65b998c7-9c7d-4468-ae6b-0ef899c3e6ce tempest-TestSecurityGroupsBasicOps-1429721975 tempest-TestSecurityGroupsBasicOps-1429721975-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:55.141516 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-65b998c7-9c7d-4468-ae6b-0ef899c3e6ce tempest-TestSecurityGroupsBasicOps-1429721975 tempest-TestSecurityGroupsBasicOps-1429721975-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/48f08ac4-01e9-492a-b249-9eb99c914f74" status: 200 len: 1624 microversion: 2.1 time: 0.252262 Sep 14 09:20:55.142525 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2912/5803] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:20:54 2022] GET /compute/v2.1/servers/48f08ac4-01e9-492a-b249-9eb99c914f74 => generated 1624 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:20:55.175212 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-fad06f9c-2b8c-4bee-bd54-d7d0889a65f6 tempest-TestSecurityGroupsBasicOps-1429721975 tempest-TestSecurityGroupsBasicOps-1429721975-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:20:55.176198 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-fad06f9c-2b8c-4bee-bd54-d7d0889a65f6 tempest-TestSecurityGroupsBasicOps-1429721975 tempest-TestSecurityGroupsBasicOps-1429721975-project-admin] [instance: 454eae36-ac14-41c3-ae82-9453adf7b230] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:20:55.190650 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fad06f9c-2b8c-4bee-bd54-d7d0889a65f6 tempest-TestSecurityGroupsBasicOps-1429721975 tempest-TestSecurityGroupsBasicOps-1429721975-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:55.193893 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fad06f9c-2b8c-4bee-bd54-d7d0889a65f6 tempest-TestSecurityGroupsBasicOps-1429721975 tempest-TestSecurityGroupsBasicOps-1429721975-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:55.194708 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fad06f9c-2b8c-4bee-bd54-d7d0889a65f6 tempest-TestSecurityGroupsBasicOps-1429721975 tempest-TestSecurityGroupsBasicOps-1429721975-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:55.195978 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fad06f9c-2b8c-4bee-bd54-d7d0889a65f6 tempest-TestSecurityGroupsBasicOps-1429721975 tempest-TestSecurityGroupsBasicOps-1429721975-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:55.201750 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fad06f9c-2b8c-4bee-bd54-d7d0889a65f6 tempest-TestSecurityGroupsBasicOps-1429721975 tempest-TestSecurityGroupsBasicOps-1429721975-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:55.202567 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fad06f9c-2b8c-4bee-bd54-d7d0889a65f6 tempest-TestSecurityGroupsBasicOps-1429721975 tempest-TestSecurityGroupsBasicOps-1429721975-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:55.707651 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-fad06f9c-2b8c-4bee-bd54-d7d0889a65f6 tempest-TestSecurityGroupsBasicOps-1429721975 tempest-TestSecurityGroupsBasicOps-1429721975-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/454eae36-ac14-41c3-ae82-9453adf7b230" status: 200 len: 1913 microversion: 2.1 time: 0.536916 Sep 14 09:20:55.708223 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2892/5804] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:20:55 2022] GET /compute/v2.1/servers/454eae36-ac14-41c3-ae82-9453adf7b230 => generated 1913 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:20:55.890136 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d21f4d62-4d58-45b2-9542-c43acd984f20 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:20:55.891622 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-d21f4d62-4d58-45b2-9542-c43acd984f20 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] [instance: 48f08ac4-01e9-492a-b249-9eb99c914f74] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:20:55.898887 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d21f4d62-4d58-45b2-9542-c43acd984f20 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:55.900272 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d21f4d62-4d58-45b2-9542-c43acd984f20 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:55.900720 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d21f4d62-4d58-45b2-9542-c43acd984f20 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:55.901643 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d21f4d62-4d58-45b2-9542-c43acd984f20 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:55.902272 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d21f4d62-4d58-45b2-9542-c43acd984f20 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:55.902876 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d21f4d62-4d58-45b2-9542-c43acd984f20 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:55.947909 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-d21f4d62-4d58-45b2-9542-c43acd984f20 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] [instance: 48f08ac4-01e9-492a-b249-9eb99c914f74] Going to try to terminate instance {{(pid=128758) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:20:56.070128 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-d21f4d62-4d58-45b2-9542-c43acd984f20 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] 10.222.0.60 "DELETE /compute/v2.1/servers/48f08ac4-01e9-492a-b249-9eb99c914f74" status: 204 len: 0 microversion: 2.1 time: 0.183646 Sep 14 09:20:56.071242 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2913/5805] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:20:55 2022] DELETE /compute/v2.1/servers/48f08ac4-01e9-492a-b249-9eb99c914f74 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:20:56.080564 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-60bedcee-1f7c-4fde-8e74-4f14bb513681 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:20:56.083181 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-60bedcee-1f7c-4fde-8e74-4f14bb513681 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] [instance: 48f08ac4-01e9-492a-b249-9eb99c914f74] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:20:56.097769 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-60bedcee-1f7c-4fde-8e74-4f14bb513681 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:56.099168 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-60bedcee-1f7c-4fde-8e74-4f14bb513681 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:56.099819 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-60bedcee-1f7c-4fde-8e74-4f14bb513681 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:56.100767 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-60bedcee-1f7c-4fde-8e74-4f14bb513681 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:56.101408 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-60bedcee-1f7c-4fde-8e74-4f14bb513681 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:56.102641 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-60bedcee-1f7c-4fde-8e74-4f14bb513681 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:56.334990 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-60bedcee-1f7c-4fde-8e74-4f14bb513681 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1f3762fce549df9225bd487e237abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57236332371c46c48719401846bfaca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:20:56.344275 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-60bedcee-1f7c-4fde-8e74-4f14bb513681 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] 10.222.0.60 "GET /compute/v2.1/servers/48f08ac4-01e9-492a-b249-9eb99c914f74" status: 200 len: 1477 microversion: 2.1 time: 0.268180 Sep 14 09:20:56.347543 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2893/5806] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:20:56 2022] GET /compute/v2.1/servers/48f08ac4-01e9-492a-b249-9eb99c914f74 => generated 1477 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:20:57.373140 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c33a5176-6aae-4116-882c-6ffd253503a4 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:20:57.375570 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-c33a5176-6aae-4116-882c-6ffd253503a4 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] [instance: 48f08ac4-01e9-492a-b249-9eb99c914f74] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:20:57.397729 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c33a5176-6aae-4116-882c-6ffd253503a4 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:57.399068 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c33a5176-6aae-4116-882c-6ffd253503a4 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:57.401106 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c33a5176-6aae-4116-882c-6ffd253503a4 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:57.402006 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c33a5176-6aae-4116-882c-6ffd253503a4 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:57.402629 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c33a5176-6aae-4116-882c-6ffd253503a4 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:57.403274 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c33a5176-6aae-4116-882c-6ffd253503a4 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:57.532188 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-c33a5176-6aae-4116-882c-6ffd253503a4 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1f3762fce549df9225bd487e237abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57236332371c46c48719401846bfaca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:20:57.544183 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-c33a5176-6aae-4116-882c-6ffd253503a4 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] 10.222.0.60 "GET /compute/v2.1/servers/48f08ac4-01e9-492a-b249-9eb99c914f74" status: 200 len: 1477 microversion: 2.1 time: 0.175820 Sep 14 09:20:57.544793 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2914/5807] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:20:57 2022] GET /compute/v2.1/servers/48f08ac4-01e9-492a-b249-9eb99c914f74 => generated 1477 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:20:58.584416 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9864ec5f-c505-4378-9a78-95d10414a0a6 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:20:58.585294 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-9864ec5f-c505-4378-9a78-95d10414a0a6 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] [instance: 48f08ac4-01e9-492a-b249-9eb99c914f74] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:20:58.615109 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9864ec5f-c505-4378-9a78-95d10414a0a6 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:58.616739 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9864ec5f-c505-4378-9a78-95d10414a0a6 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:58.617455 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9864ec5f-c505-4378-9a78-95d10414a0a6 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:58.619960 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9864ec5f-c505-4378-9a78-95d10414a0a6 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:58.621288 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9864ec5f-c505-4378-9a78-95d10414a0a6 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:58.622066 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9864ec5f-c505-4378-9a78-95d10414a0a6 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:58.807411 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-9864ec5f-c505-4378-9a78-95d10414a0a6 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1f3762fce549df9225bd487e237abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57236332371c46c48719401846bfaca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:20:58.820022 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-9864ec5f-c505-4378-9a78-95d10414a0a6 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] 10.222.0.60 "GET /compute/v2.1/servers/48f08ac4-01e9-492a-b249-9eb99c914f74" status: 200 len: 1477 microversion: 2.1 time: 0.248268 Sep 14 09:20:58.836039 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2894/5808] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:20:58 2022] GET /compute/v2.1/servers/48f08ac4-01e9-492a-b249-9eb99c914f74 => generated 1477 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:20:58.996590 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-196d88a3-7933-443a-b16d-a413710c4328 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:20:59.007745 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-196d88a3-7933-443a-b16d-a413710c4328 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:59.008243 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-196d88a3-7933-443a-b16d-a413710c4328 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:59.008683 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-196d88a3-7933-443a-b16d-a413710c4328 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:59.081976 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-196d88a3-7933-443a-b16d-a413710c4328 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] [instance: 022379ab-af51-495a-bcef-11e43774a7b0] Going to try to stop instance {{(pid=128758) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 14 09:20:59.115757 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:20:59.162604 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-196d88a3-7933-443a-b16d-a413710c4328 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] 10.222.0.60 "POST /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0/action" status: 202 len: 0 microversion: 2.1 time: 0.171416 Sep 14 09:20:59.164602 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2915/5809] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:20:58 2022] POST /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0/action => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 14 09:20:59.172235 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-506c8f12-a570-4bad-9128-32659d34e038 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:20:59.173780 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-506c8f12-a570-4bad-9128-32659d34e038 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] [instance: 022379ab-af51-495a-bcef-11e43774a7b0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:20:59.183719 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-506c8f12-a570-4bad-9128-32659d34e038 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:59.186466 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-506c8f12-a570-4bad-9128-32659d34e038 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:59.188121 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-506c8f12-a570-4bad-9128-32659d34e038 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:59.189379 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-506c8f12-a570-4bad-9128-32659d34e038 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:59.191489 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-506c8f12-a570-4bad-9128-32659d34e038 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:59.193376 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-506c8f12-a570-4bad-9128-32659d34e038 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:59.461186 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-b5a87390-c970-467c-a78e-55d060c2014a req-fc83d209-ab82-43db-b1cf-37052bd7ebb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48f08ac4-01e9-492a-b249-9eb99c914f74", "name": "network-vif-deleted", "tag": "9111a2dd-2a83-4ed0-80ba-0de85a6b3a89"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:20:59.494433 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-b5a87390-c970-467c-a78e-55d060c2014a req-fc83d209-ab82-43db-b1cf-37052bd7ebb2 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:59.495571 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-b5a87390-c970-467c-a78e-55d060c2014a req-fc83d209-ab82-43db-b1cf-37052bd7ebb2 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:59.497248 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-b5a87390-c970-467c-a78e-55d060c2014a req-fc83d209-ab82-43db-b1cf-37052bd7ebb2 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:59.510923 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-b5a87390-c970-467c-a78e-55d060c2014a req-fc83d209-ab82-43db-b1cf-37052bd7ebb2 service nova] Creating event network-vif-deleted:9111a2dd-2a83-4ed0-80ba-0de85a6b3a89 for instance 48f08ac4-01e9-492a-b249-9eb99c914f74 on n-h1-836830-18 Sep 14 09:20:59.517566 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-b5a87390-c970-467c-a78e-55d060c2014a req-fc83d209-ab82-43db-b1cf-37052bd7ebb2 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060268 Sep 14 09:20:59.518775 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2916/5810] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:20:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:20:59.806615 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-506c8f12-a570-4bad-9128-32659d34e038 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9568f2d3f644e409961ab34e8fa95cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8638ed7d7b3d4285b36865282b8caeab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:20:59.823754 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-506c8f12-a570-4bad-9128-32659d34e038 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] 10.222.0.60 "GET /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0" status: 200 len: 1722 microversion: 2.1 time: 0.654680 Sep 14 09:20:59.825100 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2895/5811] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:20:59 2022] GET /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0 => generated 1722 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:20:59.848662 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-f1082b8e-5064-4fdf-ad57-fcd33db50644 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:20:59.850125 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-f1082b8e-5064-4fdf-ad57-fcd33db50644 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] [instance: 48f08ac4-01e9-492a-b249-9eb99c914f74] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:20:59.863099 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f1082b8e-5064-4fdf-ad57-fcd33db50644 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:59.864854 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f1082b8e-5064-4fdf-ad57-fcd33db50644 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:59.867320 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f1082b8e-5064-4fdf-ad57-fcd33db50644 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:59.868472 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f1082b8e-5064-4fdf-ad57-fcd33db50644 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:59.871348 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f1082b8e-5064-4fdf-ad57-fcd33db50644 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:59.872407 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f1082b8e-5064-4fdf-ad57-fcd33db50644 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:59.961008 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f1082b8e-5064-4fdf-ad57-fcd33db50644 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:59.961008 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f1082b8e-5064-4fdf-ad57-fcd33db50644 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:59.964125 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f1082b8e-5064-4fdf-ad57-fcd33db50644 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:59.967692 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.objects.instance [None req-f1082b8e-5064-4fdf-ad57-fcd33db50644 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lazy-loading 'fault' on Instance uuid 48f08ac4-01e9-492a-b249-9eb99c914f74 {{(pid=128758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:21:00.090563 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-f1082b8e-5064-4fdf-ad57-fcd33db50644 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1f3762fce549df9225bd487e237abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57236332371c46c48719401846bfaca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:21:00.110815 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-f1082b8e-5064-4fdf-ad57-fcd33db50644 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] 10.222.0.60 "GET /compute/v2.1/servers/48f08ac4-01e9-492a-b249-9eb99c914f74" status: 200 len: 1331 microversion: 2.1 time: 0.262455 Sep 14 09:21:00.135432 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2917/5812] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:20:59 2022] GET /compute/v2.1/servers/48f08ac4-01e9-492a-b249-9eb99c914f74 => generated 1331 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:21:00.853103 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-18e78797-7331-4141-97f1-1f8e38b383c7 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:00.853730 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-18e78797-7331-4141-97f1-1f8e38b383c7 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] [instance: 022379ab-af51-495a-bcef-11e43774a7b0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:21:00.862360 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-18e78797-7331-4141-97f1-1f8e38b383c7 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:00.862864 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-18e78797-7331-4141-97f1-1f8e38b383c7 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:00.863342 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-18e78797-7331-4141-97f1-1f8e38b383c7 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:00.864058 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-18e78797-7331-4141-97f1-1f8e38b383c7 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:00.864524 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-18e78797-7331-4141-97f1-1f8e38b383c7 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:00.864950 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-18e78797-7331-4141-97f1-1f8e38b383c7 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:01.119131 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-18e78797-7331-4141-97f1-1f8e38b383c7 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9568f2d3f644e409961ab34e8fa95cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8638ed7d7b3d4285b36865282b8caeab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:21:01.142871 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-4195ca72-0524-4089-9444-09913bc1a3f1 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:01.142871 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-4195ca72-0524-4089-9444-09913bc1a3f1 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] [instance: 48f08ac4-01e9-492a-b249-9eb99c914f74] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:21:01.155846 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-18e78797-7331-4141-97f1-1f8e38b383c7 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] 10.222.0.60 "GET /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0" status: 200 len: 1722 microversion: 2.1 time: 0.306728 Sep 14 09:21:01.156938 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2896/5813] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:21:00 2022] GET /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0 => generated 1722 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:21:01.157765 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4195ca72-0524-4089-9444-09913bc1a3f1 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:01.158264 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4195ca72-0524-4089-9444-09913bc1a3f1 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:01.158704 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4195ca72-0524-4089-9444-09913bc1a3f1 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:01.159449 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4195ca72-0524-4089-9444-09913bc1a3f1 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:01.160082 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4195ca72-0524-4089-9444-09913bc1a3f1 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:01.160677 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4195ca72-0524-4089-9444-09913bc1a3f1 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:01.212822 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-4195ca72-0524-4089-9444-09913bc1a3f1 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] HTTP exception thrown: Instance 48f08ac4-01e9-492a-b249-9eb99c914f74 could not be found. Sep 14 09:21:01.214984 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-4195ca72-0524-4089-9444-09913bc1a3f1 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Request method failure captured: Sep 14 09:21:01.214984 n-d-836830-18 devstack@n-api.service[128758]: request: GET /compute/v2.1/servers/48f08ac4-01e9-492a-b249-9eb99c914f74 HTTP/1.1 Sep 14 09:21:01.214984 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 09:21:01.214984 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 09:21:01.214984 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 09:21:01.214984 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 09:21:01.214984 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 09:21:01.214984 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 09:21:01.214984 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 09:21:01.214984 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 09:21:01.214984 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZyVfWqwu-FQa8QqMV6SAzVLVce1Y2PsdePNSRVzALtA6EH3yoS8YzHK0_jAbzzY-hj4rVpatc-ppbHkohvz4WfPb7z6MPgdWmlHTd0QNDZ7Y0Z8ZCD6dRYDozjgLBGeA0de1N4Mgn2tby_GPJdxpD24COt3Z7B2B1vhxIdVqZ5t7RM Sep 14 09:21:01.214984 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 09:21:01.214984 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 09:21:01.214984 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 09:21:01.214984 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 09:21:01.214984 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 09:21:01.214984 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 09:21:01.214984 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 57236332371c46c48719401846bfaca4 Sep 14 09:21:01.214984 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1563243579 Sep 14 09:21:01.214984 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 09:21:01.214984 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 09:21:01.214984 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/57236332371c46c48719401846bfaca4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_57236332371c46c48719401846bfaca4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/57236332371c46c48719401846bfaca4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/57236332371c46c48719401846bfaca4"}]}] Sep 14 09:21:01.214984 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1563243579 Sep 14 09:21:01.214984 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 57236332371c46c48719401846bfaca4 Sep 14 09:21:01.214984 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1563243579 Sep 14 09:21:01.214984 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-TestSecurityGroupsBasicOps-1563243579-project Sep 14 09:21:01.214984 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 09:21:01.214984 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 09:21:01.214984 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 7e1f3762fce549df9225bd487e237abd Sep 14 09:21:01.214984 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1563243579-project Sep 14 09:21:01.214984 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 09:21:01.214984 n-d-836830-18 devstack@n-api.service[128758]: exception: Instance 48f08ac4-01e9-492a-b249-9eb99c914f74 could not be found. Sep 14 09:21:01.214984 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': '48f08ac4-01e9-492a-b249-9eb99c914f74'} Sep 14 09:21:01.214984 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:21:01.214984 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:21:01.214984 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:21:01.214984 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:21:01.214984 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:21:01.214984 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:21:01.214984 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:21:01.214984 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:21:01.214984 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:21:01.214984 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:21:01.214984 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48f08ac4-01e9-492a-b249-9eb99c914f74 could not be found. Sep 14 09:21:01.214984 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:21:01.214984 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:21:01.214984 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:21:01.214984 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:21:01.214984 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:21:01.214984 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:21:01.214984 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:21:01.214984 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:21:01.214984 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:21:01.214984 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:21:01.214984 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:21:01.214984 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:21:01.214984 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:21:01.214984 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:21:01.214984 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:21:01.214984 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:21:01.214984 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48f08ac4-01e9-492a-b249-9eb99c914f74 could not be found. Sep 14 09:21:01.214984 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:21:01.214984 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:21:01.220865 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:21:01.220865 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:21:01.220865 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:21:01.220865 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:21:01.220865 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:21:01.220865 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:21:01.220865 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48f08ac4-01e9-492a-b249-9eb99c914f74 could not be found. Sep 14 09:21:01.220865 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:21:01.223999 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-4195ca72-0524-4089-9444-09913bc1a3f1 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Returning 404 to user: Instance 48f08ac4-01e9-492a-b249-9eb99c914f74 could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:21:01.225124 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-4195ca72-0524-4089-9444-09913bc1a3f1 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] 10.222.0.60 "GET /compute/v2.1/servers/48f08ac4-01e9-492a-b249-9eb99c914f74" status: 404 len: 111 microversion: 2.1 time: 0.092729 Sep 14 09:21:01.225914 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2918/5814] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:21:01 2022] GET /compute/v2.1/servers/48f08ac4-01e9-492a-b249-9eb99c914f74 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:21:02.186306 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-79d4a49d-a362-41e9-a763-558b59c953d9 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:02.188188 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-79d4a49d-a362-41e9-a763-558b59c953d9 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] [instance: 022379ab-af51-495a-bcef-11e43774a7b0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:21:02.206593 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-79d4a49d-a362-41e9-a763-558b59c953d9 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:02.207388 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-79d4a49d-a362-41e9-a763-558b59c953d9 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:02.208074 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-79d4a49d-a362-41e9-a763-558b59c953d9 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:02.211050 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-79d4a49d-a362-41e9-a763-558b59c953d9 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:02.211760 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-79d4a49d-a362-41e9-a763-558b59c953d9 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:02.212756 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-79d4a49d-a362-41e9-a763-558b59c953d9 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:02.519435 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-79d4a49d-a362-41e9-a763-558b59c953d9 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9568f2d3f644e409961ab34e8fa95cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8638ed7d7b3d4285b36865282b8caeab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:21:02.528559 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-79d4a49d-a362-41e9-a763-558b59c953d9 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] 10.222.0.60 "GET /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0" status: 200 len: 1722 microversion: 2.1 time: 0.352245 Sep 14 09:21:02.547906 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2897/5815] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:21:02 2022] GET /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0 => generated 1722 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:21:03.566891 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d13affce-1adf-4683-95a0-ced9871fd22b tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:03.570725 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-d13affce-1adf-4683-95a0-ced9871fd22b tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] [instance: 022379ab-af51-495a-bcef-11e43774a7b0] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:21:03.576883 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d13affce-1adf-4683-95a0-ced9871fd22b tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:03.577392 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d13affce-1adf-4683-95a0-ced9871fd22b tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:03.577887 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d13affce-1adf-4683-95a0-ced9871fd22b tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:03.579580 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d13affce-1adf-4683-95a0-ced9871fd22b tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:03.580250 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d13affce-1adf-4683-95a0-ced9871fd22b tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:03.580858 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d13affce-1adf-4683-95a0-ced9871fd22b tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:03.760968 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-d13affce-1adf-4683-95a0-ced9871fd22b tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9568f2d3f644e409961ab34e8fa95cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8638ed7d7b3d4285b36865282b8caeab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:21:03.772210 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-d13affce-1adf-4683-95a0-ced9871fd22b tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] 10.222.0.60 "GET /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0" status: 200 len: 1722 microversion: 2.1 time: 0.210732 Sep 14 09:21:03.788067 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2919/5816] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:21:03 2022] GET /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0 => generated 1722 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:21:04.799815 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-69066e02-1710-4a65-86da-ecaa66cbeec0 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:04.800837 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-69066e02-1710-4a65-86da-ecaa66cbeec0 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] [instance: 022379ab-af51-495a-bcef-11e43774a7b0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:21:04.813797 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=37 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:21:04.819269 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-69066e02-1710-4a65-86da-ecaa66cbeec0 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:04.820028 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-69066e02-1710-4a65-86da-ecaa66cbeec0 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:04.822172 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-69066e02-1710-4a65-86da-ecaa66cbeec0 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:04.823578 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-69066e02-1710-4a65-86da-ecaa66cbeec0 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:04.826514 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-69066e02-1710-4a65-86da-ecaa66cbeec0 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:04.827378 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-69066e02-1710-4a65-86da-ecaa66cbeec0 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:04.845360 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=92 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:21:05.144218 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-69066e02-1710-4a65-86da-ecaa66cbeec0 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9568f2d3f644e409961ab34e8fa95cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8638ed7d7b3d4285b36865282b8caeab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:21:05.160965 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-69066e02-1710-4a65-86da-ecaa66cbeec0 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] 10.222.0.60 "GET /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0" status: 200 len: 1722 microversion: 2.1 time: 0.366273 Sep 14 09:21:05.163156 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2898/5817] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:21:04 2022] GET /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0 => generated 1722 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:21:06.190408 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-724f53a4-43d4-487e-9b5c-25290f89845d tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:06.191126 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-724f53a4-43d4-487e-9b5c-25290f89845d tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] [instance: 022379ab-af51-495a-bcef-11e43774a7b0] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:21:06.229472 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-724f53a4-43d4-487e-9b5c-25290f89845d tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:06.230870 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-724f53a4-43d4-487e-9b5c-25290f89845d tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:06.231522 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-724f53a4-43d4-487e-9b5c-25290f89845d tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:06.232783 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-724f53a4-43d4-487e-9b5c-25290f89845d tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:06.235523 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-724f53a4-43d4-487e-9b5c-25290f89845d tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:06.236259 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-724f53a4-43d4-487e-9b5c-25290f89845d tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:06.876925 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-724f53a4-43d4-487e-9b5c-25290f89845d tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9568f2d3f644e409961ab34e8fa95cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8638ed7d7b3d4285b36865282b8caeab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:21:06.887776 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-724f53a4-43d4-487e-9b5c-25290f89845d tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] 10.222.0.60 "GET /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0" status: 200 len: 1722 microversion: 2.1 time: 0.702856 Sep 14 09:21:06.895330 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2920/5818] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:21:06 2022] GET /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0 => generated 1722 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:21:07.281875 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8d7846dc-98c5-4fb3-a421-1a3a57cd62c5 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:21:07.284829 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-8d7846dc-98c5-4fb3-a421-1a3a57cd62c5 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 600cbae0-3580-4e55-9577-33b7a08439ad] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:21:07.299037 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8d7846dc-98c5-4fb3-a421-1a3a57cd62c5 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:07.299538 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8d7846dc-98c5-4fb3-a421-1a3a57cd62c5 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:07.303244 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8d7846dc-98c5-4fb3-a421-1a3a57cd62c5 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:07.305235 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8d7846dc-98c5-4fb3-a421-1a3a57cd62c5 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:07.313679 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8d7846dc-98c5-4fb3-a421-1a3a57cd62c5 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:07.314212 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8d7846dc-98c5-4fb3-a421-1a3a57cd62c5 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:07.368816 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.objects.instance [None req-8d7846dc-98c5-4fb3-a421-1a3a57cd62c5 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lazy-loading 'flavor' on Instance uuid 600cbae0-3580-4e55-9577-33b7a08439ad {{(pid=128759) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:21:07.652152 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-8d7846dc-98c5-4fb3-a421-1a3a57cd62c5 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "POST /compute/v2.1/servers/600cbae0-3580-4e55-9577-33b7a08439ad/action" status: 200 len: 32 microversion: 2.1 time: 0.374850 Sep 14 09:21:07.653620 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2899/5819] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:21:07 2022] POST /compute/v2.1/servers/600cbae0-3580-4e55-9577-33b7a08439ad/action => generated 32 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 14 09:21:07.668601 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b943df52-a4df-4d84-ab27-9e736c49a54e tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:07.670624 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-b943df52-a4df-4d84-ab27-9e736c49a54e tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 600cbae0-3580-4e55-9577-33b7a08439ad] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:21:07.698169 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:21:07.706528 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b943df52-a4df-4d84-ab27-9e736c49a54e tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:07.707548 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b943df52-a4df-4d84-ab27-9e736c49a54e tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:07.708277 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b943df52-a4df-4d84-ab27-9e736c49a54e tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:07.709249 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b943df52-a4df-4d84-ab27-9e736c49a54e tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:07.709904 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b943df52-a4df-4d84-ab27-9e736c49a54e tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:07.710623 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b943df52-a4df-4d84-ab27-9e736c49a54e tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:07.913663 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e63cc1bd-c2de-49aa-88ab-6e04c4fe850e tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:07.914393 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e63cc1bd-c2de-49aa-88ab-6e04c4fe850e tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] [instance: 022379ab-af51-495a-bcef-11e43774a7b0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:21:07.930403 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e63cc1bd-c2de-49aa-88ab-6e04c4fe850e tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:07.930918 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e63cc1bd-c2de-49aa-88ab-6e04c4fe850e tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:07.931396 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e63cc1bd-c2de-49aa-88ab-6e04c4fe850e tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:07.932125 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e63cc1bd-c2de-49aa-88ab-6e04c4fe850e tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:07.932593 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e63cc1bd-c2de-49aa-88ab-6e04c4fe850e tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:07.933031 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e63cc1bd-c2de-49aa-88ab-6e04c4fe850e tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:08.366407 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-b943df52-a4df-4d84-ab27-9e736c49a54e tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03dc827647f4483beb2e1b7888be608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229e11b3c1fe48b088d0f3c4bb7e2cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:21:08.391787 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-b943df52-a4df-4d84-ab27-9e736c49a54e tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "GET /compute/v2.1/servers/600cbae0-3580-4e55-9577-33b7a08439ad" status: 200 len: 1736 microversion: 2.1 time: 0.731478 Sep 14 09:21:08.392401 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2921/5820] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:21:07 2022] GET /compute/v2.1/servers/600cbae0-3580-4e55-9577-33b7a08439ad => generated 1736 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:21:08.495399 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-e63cc1bd-c2de-49aa-88ab-6e04c4fe850e tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9568f2d3f644e409961ab34e8fa95cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8638ed7d7b3d4285b36865282b8caeab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:21:08.511839 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e63cc1bd-c2de-49aa-88ab-6e04c4fe850e tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] 10.222.0.60 "GET /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0" status: 200 len: 1722 microversion: 2.1 time: 0.602265 Sep 14 09:21:08.512718 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2900/5821] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:21:07 2022] GET /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0 => generated 1722 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:21:09.425605 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-f3e69db7-6ff1-494d-8b16-6e09be7ba95a tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:09.426443 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-f3e69db7-6ff1-494d-8b16-6e09be7ba95a tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 600cbae0-3580-4e55-9577-33b7a08439ad] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:21:09.446353 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f3e69db7-6ff1-494d-8b16-6e09be7ba95a tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:09.447330 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f3e69db7-6ff1-494d-8b16-6e09be7ba95a tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:09.448237 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f3e69db7-6ff1-494d-8b16-6e09be7ba95a tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:09.449053 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f3e69db7-6ff1-494d-8b16-6e09be7ba95a tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:09.449744 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f3e69db7-6ff1-494d-8b16-6e09be7ba95a tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:09.450495 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f3e69db7-6ff1-494d-8b16-6e09be7ba95a tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:09.542063 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b11e3349-a622-4a3c-8021-d36695086b2a tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:09.542979 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b11e3349-a622-4a3c-8021-d36695086b2a tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] [instance: 022379ab-af51-495a-bcef-11e43774a7b0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:21:09.589899 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b11e3349-a622-4a3c-8021-d36695086b2a tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:09.594977 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b11e3349-a622-4a3c-8021-d36695086b2a tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:09.595784 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b11e3349-a622-4a3c-8021-d36695086b2a tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:09.598629 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b11e3349-a622-4a3c-8021-d36695086b2a tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:09.605820 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b11e3349-a622-4a3c-8021-d36695086b2a tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:09.608193 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b11e3349-a622-4a3c-8021-d36695086b2a tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:09.957886 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-f3e69db7-6ff1-494d-8b16-6e09be7ba95a tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03dc827647f4483beb2e1b7888be608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229e11b3c1fe48b088d0f3c4bb7e2cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:21:09.975899 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-f3e69db7-6ff1-494d-8b16-6e09be7ba95a tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "GET /compute/v2.1/servers/600cbae0-3580-4e55-9577-33b7a08439ad" status: 200 len: 1736 microversion: 2.1 time: 0.558311 Sep 14 09:21:09.979000 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2922/5822] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:21:09 2022] GET /compute/v2.1/servers/600cbae0-3580-4e55-9577-33b7a08439ad => generated 1736 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:21:10.070705 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b11e3349-a622-4a3c-8021-d36695086b2a tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9568f2d3f644e409961ab34e8fa95cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8638ed7d7b3d4285b36865282b8caeab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:21:10.090721 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b11e3349-a622-4a3c-8021-d36695086b2a tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] 10.222.0.60 "GET /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0" status: 200 len: 1722 microversion: 2.1 time: 0.550917 Sep 14 09:21:10.094314 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2901/5823] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:21:09 2022] GET /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0 => generated 1722 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:21:11.008379 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-daec3de3-b2e0-40a5-a9b9-8c09665ceb31 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:11.018117 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-daec3de3-b2e0-40a5-a9b9-8c09665ceb31 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 600cbae0-3580-4e55-9577-33b7a08439ad] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:21:11.034271 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-daec3de3-b2e0-40a5-a9b9-8c09665ceb31 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:11.037668 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-daec3de3-b2e0-40a5-a9b9-8c09665ceb31 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:11.038339 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-daec3de3-b2e0-40a5-a9b9-8c09665ceb31 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:11.041466 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-daec3de3-b2e0-40a5-a9b9-8c09665ceb31 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:11.042194 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-daec3de3-b2e0-40a5-a9b9-8c09665ceb31 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:11.044122 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-daec3de3-b2e0-40a5-a9b9-8c09665ceb31 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:11.122805 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-30e969ee-cee5-4f38-9875-abfb94d2fec7 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:11.124104 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-30e969ee-cee5-4f38-9875-abfb94d2fec7 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] [instance: 022379ab-af51-495a-bcef-11e43774a7b0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:21:11.138289 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-30e969ee-cee5-4f38-9875-abfb94d2fec7 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:11.148297 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-30e969ee-cee5-4f38-9875-abfb94d2fec7 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:11.149012 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-30e969ee-cee5-4f38-9875-abfb94d2fec7 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:11.151148 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-30e969ee-cee5-4f38-9875-abfb94d2fec7 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:11.152631 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-30e969ee-cee5-4f38-9875-abfb94d2fec7 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:11.154311 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-30e969ee-cee5-4f38-9875-abfb94d2fec7 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:11.821585 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-daec3de3-b2e0-40a5-a9b9-8c09665ceb31 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03dc827647f4483beb2e1b7888be608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229e11b3c1fe48b088d0f3c4bb7e2cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:21:11.828017 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-30e969ee-cee5-4f38-9875-abfb94d2fec7 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9568f2d3f644e409961ab34e8fa95cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8638ed7d7b3d4285b36865282b8caeab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:21:11.842571 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-30e969ee-cee5-4f38-9875-abfb94d2fec7 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] 10.222.0.60 "GET /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0" status: 200 len: 1722 microversion: 2.1 time: 0.720148 Sep 14 09:21:11.843803 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2902/5824] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:21:11 2022] GET /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0 => generated 1722 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:21:11.848416 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-daec3de3-b2e0-40a5-a9b9-8c09665ceb31 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "GET /compute/v2.1/servers/600cbae0-3580-4e55-9577-33b7a08439ad" status: 200 len: 1736 microversion: 2.1 time: 0.846328 Sep 14 09:21:11.862723 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2923/5825] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:21:11 2022] GET /compute/v2.1/servers/600cbae0-3580-4e55-9577-33b7a08439ad => generated 1736 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:21:12.563369 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-8e278be4-5655-4ec6-90db-a9a23355a738 req-12e23769-7a2d-4fb4-9f2e-bf3bc49fa2ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "454eae36-ac14-41c3-ae82-9453adf7b230", "tag": "0e0086f9-f896-4fce-8a39-709c65828318"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:21:12.564918 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-5521e92d-dba8-4a64-a918-32f07cf2ca7f tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:12.565749 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-5521e92d-dba8-4a64-a918-32f07cf2ca7f tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] [instance: 454eae36-ac14-41c3-ae82-9453adf7b230] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:21:12.603066 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5521e92d-dba8-4a64-a918-32f07cf2ca7f tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:12.603685 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5521e92d-dba8-4a64-a918-32f07cf2ca7f tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:12.605667 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5521e92d-dba8-4a64-a918-32f07cf2ca7f tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:12.606410 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5521e92d-dba8-4a64-a918-32f07cf2ca7f tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:12.606880 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5521e92d-dba8-4a64-a918-32f07cf2ca7f tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:12.611923 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5521e92d-dba8-4a64-a918-32f07cf2ca7f tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:12.615032 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-8e278be4-5655-4ec6-90db-a9a23355a738 req-12e23769-7a2d-4fb4-9f2e-bf3bc49fa2ae service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:12.615732 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-8e278be4-5655-4ec6-90db-a9a23355a738 req-12e23769-7a2d-4fb4-9f2e-bf3bc49fa2ae service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:12.616370 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-8e278be4-5655-4ec6-90db-a9a23355a738 req-12e23769-7a2d-4fb4-9f2e-bf3bc49fa2ae service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:12.646015 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-8e278be4-5655-4ec6-90db-a9a23355a738 req-12e23769-7a2d-4fb4-9f2e-bf3bc49fa2ae service nova] Creating event network-changed:0e0086f9-f896-4fce-8a39-709c65828318 for instance 454eae36-ac14-41c3-ae82-9453adf7b230 on n-h2-836830-18 Sep 14 09:21:12.658509 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-8e278be4-5655-4ec6-90db-a9a23355a738 req-12e23769-7a2d-4fb4-9f2e-bf3bc49fa2ae service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110410 Sep 14 09:21:12.663589 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2924/5826] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:21:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:21:12.682703 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-5521e92d-dba8-4a64-a918-32f07cf2ca7f tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] [instance: 454eae36-ac14-41c3-ae82-9453adf7b230] Going to try to terminate instance {{(pid=128759) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:21:12.846532 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-5521e92d-dba8-4a64-a918-32f07cf2ca7f tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] 10.222.0.60 "DELETE /compute/v2.1/servers/454eae36-ac14-41c3-ae82-9453adf7b230" status: 204 len: 0 microversion: 2.1 time: 0.301924 Sep 14 09:21:12.849020 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2903/5827] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:21:12 2022] DELETE /compute/v2.1/servers/454eae36-ac14-41c3-ae82-9453adf7b230 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:21:12.860888 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ea6573d4-2736-40ca-800d-858705477e0d tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:12.868817 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-ea6573d4-2736-40ca-800d-858705477e0d tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] [instance: 454eae36-ac14-41c3-ae82-9453adf7b230] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:21:12.874330 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f9f61b29-c125-4a75-aba9-7977f766611d tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:12.875224 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f9f61b29-c125-4a75-aba9-7977f766611d tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] [instance: 022379ab-af51-495a-bcef-11e43774a7b0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:21:12.884884 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f9f61b29-c125-4a75-aba9-7977f766611d tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:12.888710 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f9f61b29-c125-4a75-aba9-7977f766611d tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:12.888935 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ea6573d4-2736-40ca-800d-858705477e0d tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:12.889212 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f9f61b29-c125-4a75-aba9-7977f766611d tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:12.889848 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ea6573d4-2736-40ca-800d-858705477e0d tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:12.889985 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f9f61b29-c125-4a75-aba9-7977f766611d tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:12.890471 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f9f61b29-c125-4a75-aba9-7977f766611d tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:12.890824 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ea6573d4-2736-40ca-800d-858705477e0d tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:12.890987 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f9f61b29-c125-4a75-aba9-7977f766611d tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:12.892001 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ea6573d4-2736-40ca-800d-858705477e0d tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:12.894528 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ea6573d4-2736-40ca-800d-858705477e0d tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:12.895179 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ea6573d4-2736-40ca-800d-858705477e0d tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:13.653129 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-ea6573d4-2736-40ca-800d-858705477e0d tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1f3762fce549df9225bd487e237abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57236332371c46c48719401846bfaca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:21:13.662231 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-ea6573d4-2736-40ca-800d-858705477e0d tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] 10.222.0.60 "GET /compute/v2.1/servers/454eae36-ac14-41c3-ae82-9453adf7b230" status: 200 len: 1766 microversion: 2.1 time: 0.806882 Sep 14 09:21:13.666596 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2925/5828] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:21:12 2022] GET /compute/v2.1/servers/454eae36-ac14-41c3-ae82-9453adf7b230 => generated 1766 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:21:13.683475 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-5c5e44df-c19e-4d40-937d-0d61d626a705 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:13.684843 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-5c5e44df-c19e-4d40-937d-0d61d626a705 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 600cbae0-3580-4e55-9577-33b7a08439ad] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:21:13.702659 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5c5e44df-c19e-4d40-937d-0d61d626a705 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:13.703292 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5c5e44df-c19e-4d40-937d-0d61d626a705 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:13.703792 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5c5e44df-c19e-4d40-937d-0d61d626a705 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:13.705025 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5c5e44df-c19e-4d40-937d-0d61d626a705 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:13.705201 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5c5e44df-c19e-4d40-937d-0d61d626a705 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:13.705822 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5c5e44df-c19e-4d40-937d-0d61d626a705 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:13.966836 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f9f61b29-c125-4a75-aba9-7977f766611d tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9568f2d3f644e409961ab34e8fa95cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8638ed7d7b3d4285b36865282b8caeab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:21:13.982217 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f9f61b29-c125-4a75-aba9-7977f766611d tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] 10.222.0.60 "GET /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0" status: 200 len: 1722 microversion: 2.1 time: 1.115233 Sep 14 09:21:13.983582 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2904/5829] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:21:12 2022] GET /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0 => generated 1722 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:21:14.073931 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-5c5e44df-c19e-4d40-937d-0d61d626a705 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03dc827647f4483beb2e1b7888be608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229e11b3c1fe48b088d0f3c4bb7e2cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:21:14.099926 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-5c5e44df-c19e-4d40-937d-0d61d626a705 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "GET /compute/v2.1/servers/600cbae0-3580-4e55-9577-33b7a08439ad" status: 200 len: 1736 microversion: 2.1 time: 0.431200 Sep 14 09:21:14.100564 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2926/5830] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:21:13 2022] GET /compute/v2.1/servers/600cbae0-3580-4e55-9577-33b7a08439ad => generated 1736 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:21:14.688812 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-0bb83b06-2a46-40b7-904d-88632b95297b tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:14.692391 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-0bb83b06-2a46-40b7-904d-88632b95297b tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] [instance: 454eae36-ac14-41c3-ae82-9453adf7b230] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:21:14.715358 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0bb83b06-2a46-40b7-904d-88632b95297b tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:14.715866 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0bb83b06-2a46-40b7-904d-88632b95297b tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:14.716312 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0bb83b06-2a46-40b7-904d-88632b95297b tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:14.717032 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0bb83b06-2a46-40b7-904d-88632b95297b tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:14.717497 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0bb83b06-2a46-40b7-904d-88632b95297b tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:14.717933 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0bb83b06-2a46-40b7-904d-88632b95297b tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:15.005678 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d50481c7-e11a-4008-971b-75f2008cdd12 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:15.006320 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-d50481c7-e11a-4008-971b-75f2008cdd12 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] [instance: 022379ab-af51-495a-bcef-11e43774a7b0] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:21:15.021818 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d50481c7-e11a-4008-971b-75f2008cdd12 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:15.022630 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d50481c7-e11a-4008-971b-75f2008cdd12 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:15.023352 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d50481c7-e11a-4008-971b-75f2008cdd12 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:15.024537 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d50481c7-e11a-4008-971b-75f2008cdd12 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:15.025111 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d50481c7-e11a-4008-971b-75f2008cdd12 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:15.025804 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d50481c7-e11a-4008-971b-75f2008cdd12 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:15.347891 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-0bb83b06-2a46-40b7-904d-88632b95297b tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e1f3762fce549df9225bd487e237abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57236332371c46c48719401846bfaca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:21:15.357056 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-0bb83b06-2a46-40b7-904d-88632b95297b tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] 10.222.0.60 "GET /compute/v2.1/servers/454eae36-ac14-41c3-ae82-9453adf7b230" status: 200 len: 1766 microversion: 2.1 time: 0.675163 Sep 14 09:21:15.372335 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2905/5831] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:21:14 2022] GET /compute/v2.1/servers/454eae36-ac14-41c3-ae82-9453adf7b230 => generated 1766 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:21:15.383713 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-480c37b8-6763-4f25-a77c-fbc9e8da6cc3 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:15.384568 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-480c37b8-6763-4f25-a77c-fbc9e8da6cc3 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 600cbae0-3580-4e55-9577-33b7a08439ad] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:21:15.402690 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-480c37b8-6763-4f25-a77c-fbc9e8da6cc3 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:15.403645 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-480c37b8-6763-4f25-a77c-fbc9e8da6cc3 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:15.404346 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-480c37b8-6763-4f25-a77c-fbc9e8da6cc3 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:15.405403 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-480c37b8-6763-4f25-a77c-fbc9e8da6cc3 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:15.406724 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-480c37b8-6763-4f25-a77c-fbc9e8da6cc3 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:15.407494 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-480c37b8-6763-4f25-a77c-fbc9e8da6cc3 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:15.472248 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-d50481c7-e11a-4008-971b-75f2008cdd12 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9568f2d3f644e409961ab34e8fa95cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8638ed7d7b3d4285b36865282b8caeab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:21:15.485758 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-d50481c7-e11a-4008-971b-75f2008cdd12 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] 10.222.0.60 "GET /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0" status: 200 len: 1722 microversion: 2.1 time: 0.483343 Sep 14 09:21:15.492269 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2927/5832] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:21:15 2022] GET /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0 => generated 1722 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:21:15.499718 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-7ac2a4a6-680d-4405-8135-7fe430d8e1ca req-b8243956-5f48-41db-9316-38a685e95afd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "454eae36-ac14-41c3-ae82-9453adf7b230", "name": "network-vif-deleted", "tag": "0e0086f9-f896-4fce-8a39-709c65828318"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:21:15.520923 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-7ac2a4a6-680d-4405-8135-7fe430d8e1ca req-b8243956-5f48-41db-9316-38a685e95afd service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:15.521800 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-7ac2a4a6-680d-4405-8135-7fe430d8e1ca req-b8243956-5f48-41db-9316-38a685e95afd service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:15.522483 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-7ac2a4a6-680d-4405-8135-7fe430d8e1ca req-b8243956-5f48-41db-9316-38a685e95afd service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:15.537626 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-7ac2a4a6-680d-4405-8135-7fe430d8e1ca req-b8243956-5f48-41db-9316-38a685e95afd service nova] Creating event network-vif-deleted:0e0086f9-f896-4fce-8a39-709c65828318 for instance 454eae36-ac14-41c3-ae82-9453adf7b230 on n-h2-836830-18 Sep 14 09:21:15.547530 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-7ac2a4a6-680d-4405-8135-7fe430d8e1ca req-b8243956-5f48-41db-9316-38a685e95afd service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052101 Sep 14 09:21:15.548998 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2928/5833] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:21:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:21:15.850298 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-480c37b8-6763-4f25-a77c-fbc9e8da6cc3 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03dc827647f4483beb2e1b7888be608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229e11b3c1fe48b088d0f3c4bb7e2cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:21:15.869896 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-480c37b8-6763-4f25-a77c-fbc9e8da6cc3 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "GET /compute/v2.1/servers/600cbae0-3580-4e55-9577-33b7a08439ad" status: 200 len: 1736 microversion: 2.1 time: 0.495703 Sep 14 09:21:15.870713 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2906/5834] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:21:15 2022] GET /compute/v2.1/servers/600cbae0-3580-4e55-9577-33b7a08439ad => generated 1736 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:21:16.386058 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-f50251b7-3159-4b71-9f20-1d077674c8c1 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:16.387895 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-f50251b7-3159-4b71-9f20-1d077674c8c1 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] [instance: 454eae36-ac14-41c3-ae82-9453adf7b230] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:21:16.399211 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f50251b7-3159-4b71-9f20-1d077674c8c1 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:16.400751 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f50251b7-3159-4b71-9f20-1d077674c8c1 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:16.400751 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f50251b7-3159-4b71-9f20-1d077674c8c1 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:16.401772 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f50251b7-3159-4b71-9f20-1d077674c8c1 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:16.402552 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f50251b7-3159-4b71-9f20-1d077674c8c1 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:16.403012 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f50251b7-3159-4b71-9f20-1d077674c8c1 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:16.422509 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-f50251b7-3159-4b71-9f20-1d077674c8c1 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] HTTP exception thrown: Instance 454eae36-ac14-41c3-ae82-9453adf7b230 could not be found. Sep 14 09:21:16.424502 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-f50251b7-3159-4b71-9f20-1d077674c8c1 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Request method failure captured: Sep 14 09:21:16.424502 n-d-836830-18 devstack@n-api.service[128758]: request: GET /compute/v2.1/servers/454eae36-ac14-41c3-ae82-9453adf7b230 HTTP/1.1 Sep 14 09:21:16.424502 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 09:21:16.424502 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 09:21:16.424502 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 09:21:16.424502 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 09:21:16.424502 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 09:21:16.424502 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 09:21:16.424502 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 09:21:16.424502 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 09:21:16.424502 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZyVfWqwu-FQa8QqMV6SAzVLVce1Y2PsdePNSRVzALtA6EH3yoS8YzHK0_jAbzzY-hj4rVpatc-ppbHkohvz4WfPb7z6MPgdWmlHTd0QNDZ7Y0Z8ZCD6dRYDozjgLBGeA0de1N4Mgn2tby_GPJdxpD24COt3Z7B2B1vhxIdVqZ5t7RM Sep 14 09:21:16.424502 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 09:21:16.424502 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 09:21:16.424502 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 09:21:16.424502 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 09:21:16.424502 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 09:21:16.424502 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 09:21:16.424502 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 57236332371c46c48719401846bfaca4 Sep 14 09:21:16.424502 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1563243579 Sep 14 09:21:16.424502 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 09:21:16.424502 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 09:21:16.424502 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/57236332371c46c48719401846bfaca4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_57236332371c46c48719401846bfaca4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/57236332371c46c48719401846bfaca4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/57236332371c46c48719401846bfaca4"}]}] Sep 14 09:21:16.424502 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1563243579 Sep 14 09:21:16.424502 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 57236332371c46c48719401846bfaca4 Sep 14 09:21:16.424502 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1563243579 Sep 14 09:21:16.424502 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-TestSecurityGroupsBasicOps-1563243579-project Sep 14 09:21:16.424502 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 09:21:16.424502 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 09:21:16.424502 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 7e1f3762fce549df9225bd487e237abd Sep 14 09:21:16.424502 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1563243579-project Sep 14 09:21:16.424502 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 09:21:16.424502 n-d-836830-18 devstack@n-api.service[128758]: exception: Instance 454eae36-ac14-41c3-ae82-9453adf7b230 could not be found. Sep 14 09:21:16.424502 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': '454eae36-ac14-41c3-ae82-9453adf7b230'} Sep 14 09:21:16.424502 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:21:16.424502 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:21:16.424502 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:21:16.424502 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:21:16.424502 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:21:16.424502 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:21:16.424502 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:21:16.424502 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:21:16.424502 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:21:16.424502 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:21:16.424502 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 454eae36-ac14-41c3-ae82-9453adf7b230 could not be found. Sep 14 09:21:16.424502 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:21:16.424502 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:21:16.424502 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:21:16.424502 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:21:16.424502 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:21:16.424502 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:21:16.424502 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:21:16.424502 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:21:16.424502 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:21:16.424502 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:21:16.424502 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:21:16.424502 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:21:16.424502 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:21:16.424502 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:21:16.424502 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:21:16.424502 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:21:16.424502 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 454eae36-ac14-41c3-ae82-9453adf7b230 could not be found. Sep 14 09:21:16.424502 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:21:16.424502 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:21:16.431140 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:21:16.431140 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:21:16.431140 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:21:16.431140 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:21:16.431140 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:21:16.431140 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:21:16.431140 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 454eae36-ac14-41c3-ae82-9453adf7b230 could not be found. Sep 14 09:21:16.431140 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:21:16.431140 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-f50251b7-3159-4b71-9f20-1d077674c8c1 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Returning 404 to user: Instance 454eae36-ac14-41c3-ae82-9453adf7b230 could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:21:16.431140 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-f50251b7-3159-4b71-9f20-1d077674c8c1 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] 10.222.0.60 "GET /compute/v2.1/servers/454eae36-ac14-41c3-ae82-9453adf7b230" status: 404 len: 111 microversion: 2.1 time: 0.044741 Sep 14 09:21:16.431140 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2929/5835] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:21:16 2022] GET /compute/v2.1/servers/454eae36-ac14-41c3-ae82-9453adf7b230 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:21:16.515737 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f7483345-6399-420a-be8e-8409c6be08d0 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:16.517106 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f7483345-6399-420a-be8e-8409c6be08d0 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] [instance: 022379ab-af51-495a-bcef-11e43774a7b0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:21:16.523459 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f7483345-6399-420a-be8e-8409c6be08d0 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:16.532800 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f7483345-6399-420a-be8e-8409c6be08d0 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:16.533782 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f7483345-6399-420a-be8e-8409c6be08d0 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:16.535055 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f7483345-6399-420a-be8e-8409c6be08d0 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:16.535764 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f7483345-6399-420a-be8e-8409c6be08d0 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:16.536421 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f7483345-6399-420a-be8e-8409c6be08d0 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:16.868478 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f7483345-6399-420a-be8e-8409c6be08d0 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9568f2d3f644e409961ab34e8fa95cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8638ed7d7b3d4285b36865282b8caeab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:21:16.880732 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f7483345-6399-420a-be8e-8409c6be08d0 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] 10.222.0.60 "GET /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0" status: 200 len: 1722 microversion: 2.1 time: 0.369440 Sep 14 09:21:16.881599 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2907/5836] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:21:16 2022] GET /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0 => generated 1722 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:21:16.899427 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-717d0683-8f1c-4ddd-9370-4400ad3f9c5e tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:16.900951 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-717d0683-8f1c-4ddd-9370-4400ad3f9c5e tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 600cbae0-3580-4e55-9577-33b7a08439ad] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:21:16.908224 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-717d0683-8f1c-4ddd-9370-4400ad3f9c5e tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:16.909119 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-717d0683-8f1c-4ddd-9370-4400ad3f9c5e tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:16.909878 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-717d0683-8f1c-4ddd-9370-4400ad3f9c5e tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:16.910808 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-717d0683-8f1c-4ddd-9370-4400ad3f9c5e tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:16.912084 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-717d0683-8f1c-4ddd-9370-4400ad3f9c5e tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:16.913138 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-717d0683-8f1c-4ddd-9370-4400ad3f9c5e tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:17.200543 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-717d0683-8f1c-4ddd-9370-4400ad3f9c5e tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03dc827647f4483beb2e1b7888be608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229e11b3c1fe48b088d0f3c4bb7e2cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:21:17.220958 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-717d0683-8f1c-4ddd-9370-4400ad3f9c5e tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "GET /compute/v2.1/servers/600cbae0-3580-4e55-9577-33b7a08439ad" status: 200 len: 1736 microversion: 2.1 time: 0.327754 Sep 14 09:21:17.221920 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2930/5837] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:21:16 2022] GET /compute/v2.1/servers/600cbae0-3580-4e55-9577-33b7a08439ad => generated 1736 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:21:17.904475 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-633b5fd0-260d-4c96-b74b-2f5a6729b26a tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:17.905118 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-633b5fd0-260d-4c96-b74b-2f5a6729b26a tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] [instance: 022379ab-af51-495a-bcef-11e43774a7b0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:21:17.916245 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-633b5fd0-260d-4c96-b74b-2f5a6729b26a tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:17.916756 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-633b5fd0-260d-4c96-b74b-2f5a6729b26a tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:17.917209 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-633b5fd0-260d-4c96-b74b-2f5a6729b26a tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:17.917931 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-633b5fd0-260d-4c96-b74b-2f5a6729b26a tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:17.918397 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-633b5fd0-260d-4c96-b74b-2f5a6729b26a tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:17.918832 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-633b5fd0-260d-4c96-b74b-2f5a6729b26a tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:18.247919 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-6078fcd3-8aa0-490e-ae8e-470ff9a3cc67 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:18.248542 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-6078fcd3-8aa0-490e-ae8e-470ff9a3cc67 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 600cbae0-3580-4e55-9577-33b7a08439ad] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:21:18.261335 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6078fcd3-8aa0-490e-ae8e-470ff9a3cc67 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:18.262021 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6078fcd3-8aa0-490e-ae8e-470ff9a3cc67 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:18.262680 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6078fcd3-8aa0-490e-ae8e-470ff9a3cc67 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:18.263990 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6078fcd3-8aa0-490e-ae8e-470ff9a3cc67 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:18.264632 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6078fcd3-8aa0-490e-ae8e-470ff9a3cc67 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:18.265469 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6078fcd3-8aa0-490e-ae8e-470ff9a3cc67 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:18.331082 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-633b5fd0-260d-4c96-b74b-2f5a6729b26a tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9568f2d3f644e409961ab34e8fa95cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8638ed7d7b3d4285b36865282b8caeab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:21:18.350768 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-633b5fd0-260d-4c96-b74b-2f5a6729b26a tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] 10.222.0.60 "GET /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0" status: 200 len: 1722 microversion: 2.1 time: 0.449659 Sep 14 09:21:18.352231 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2908/5838] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:21:17 2022] GET /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0 => generated 1722 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:21:18.521782 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-6078fcd3-8aa0-490e-ae8e-470ff9a3cc67 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03dc827647f4483beb2e1b7888be608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229e11b3c1fe48b088d0f3c4bb7e2cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:21:18.533668 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-6078fcd3-8aa0-490e-ae8e-470ff9a3cc67 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "GET /compute/v2.1/servers/600cbae0-3580-4e55-9577-33b7a08439ad" status: 200 len: 1736 microversion: 2.1 time: 0.289595 Sep 14 09:21:18.540523 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2931/5839] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:21:18 2022] GET /compute/v2.1/servers/600cbae0-3580-4e55-9577-33b7a08439ad => generated 1736 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:21:19.385442 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b59f0983-41da-4e88-b3a3-5f8fb61215c0 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:19.392232 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b59f0983-41da-4e88-b3a3-5f8fb61215c0 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] [instance: 022379ab-af51-495a-bcef-11e43774a7b0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:21:19.403901 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b59f0983-41da-4e88-b3a3-5f8fb61215c0 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:19.407622 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b59f0983-41da-4e88-b3a3-5f8fb61215c0 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:19.408099 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b59f0983-41da-4e88-b3a3-5f8fb61215c0 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:19.408852 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b59f0983-41da-4e88-b3a3-5f8fb61215c0 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:19.409327 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b59f0983-41da-4e88-b3a3-5f8fb61215c0 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:19.409773 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b59f0983-41da-4e88-b3a3-5f8fb61215c0 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:19.565202 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-5d7f5b3e-b695-4149-ae61-2c3c468745c5 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:19.569102 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-5d7f5b3e-b695-4149-ae61-2c3c468745c5 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 600cbae0-3580-4e55-9577-33b7a08439ad] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:21:19.617624 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5d7f5b3e-b695-4149-ae61-2c3c468745c5 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:19.622880 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5d7f5b3e-b695-4149-ae61-2c3c468745c5 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:19.624962 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5d7f5b3e-b695-4149-ae61-2c3c468745c5 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:19.631147 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5d7f5b3e-b695-4149-ae61-2c3c468745c5 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:19.633114 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5d7f5b3e-b695-4149-ae61-2c3c468745c5 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:19.634200 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5d7f5b3e-b695-4149-ae61-2c3c468745c5 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:19.718851 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b59f0983-41da-4e88-b3a3-5f8fb61215c0 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9568f2d3f644e409961ab34e8fa95cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8638ed7d7b3d4285b36865282b8caeab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:21:19.733225 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b59f0983-41da-4e88-b3a3-5f8fb61215c0 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] 10.222.0.60 "GET /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0" status: 200 len: 1722 microversion: 2.1 time: 0.353947 Sep 14 09:21:19.735899 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2909/5840] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:21:19 2022] GET /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0 => generated 1722 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:21:20.057235 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-5d7f5b3e-b695-4149-ae61-2c3c468745c5 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03dc827647f4483beb2e1b7888be608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229e11b3c1fe48b088d0f3c4bb7e2cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:21:20.081784 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-5d7f5b3e-b695-4149-ae61-2c3c468745c5 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "GET /compute/v2.1/servers/600cbae0-3580-4e55-9577-33b7a08439ad" status: 200 len: 1736 microversion: 2.1 time: 0.526723 Sep 14 09:21:20.085409 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2932/5841] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:21:19 2022] GET /compute/v2.1/servers/600cbae0-3580-4e55-9577-33b7a08439ad => generated 1736 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:21:20.759482 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c336f38a-a372-4d21-84fe-9bd4c59a0afd tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:20.760742 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-c336f38a-a372-4d21-84fe-9bd4c59a0afd tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] [instance: 022379ab-af51-495a-bcef-11e43774a7b0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:21:20.768340 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c336f38a-a372-4d21-84fe-9bd4c59a0afd tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:20.769125 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c336f38a-a372-4d21-84fe-9bd4c59a0afd tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:20.769751 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c336f38a-a372-4d21-84fe-9bd4c59a0afd tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:20.770653 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c336f38a-a372-4d21-84fe-9bd4c59a0afd tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:20.771316 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c336f38a-a372-4d21-84fe-9bd4c59a0afd tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:20.771911 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c336f38a-a372-4d21-84fe-9bd4c59a0afd tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:21.109775 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-5d1aed19-7bae-41e5-9e08-effdfa9bf437 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:21.110558 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-5d1aed19-7bae-41e5-9e08-effdfa9bf437 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 600cbae0-3580-4e55-9577-33b7a08439ad] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:21:21.121833 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5d1aed19-7bae-41e5-9e08-effdfa9bf437 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:21.123110 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5d1aed19-7bae-41e5-9e08-effdfa9bf437 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:21.123854 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5d1aed19-7bae-41e5-9e08-effdfa9bf437 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:21.125399 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5d1aed19-7bae-41e5-9e08-effdfa9bf437 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:21.126148 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5d1aed19-7bae-41e5-9e08-effdfa9bf437 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:21.126818 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5d1aed19-7bae-41e5-9e08-effdfa9bf437 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:21.420899 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-c336f38a-a372-4d21-84fe-9bd4c59a0afd tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9568f2d3f644e409961ab34e8fa95cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8638ed7d7b3d4285b36865282b8caeab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:21:21.429499 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-c336f38a-a372-4d21-84fe-9bd4c59a0afd tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] 10.222.0.60 "GET /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0" status: 200 len: 1722 microversion: 2.1 time: 0.674032 Sep 14 09:21:21.438967 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2910/5842] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:21:20 2022] GET /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0 => generated 1722 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:21:21.519807 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-5d1aed19-7bae-41e5-9e08-effdfa9bf437 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03dc827647f4483beb2e1b7888be608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229e11b3c1fe48b088d0f3c4bb7e2cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:21:21.534053 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-5d1aed19-7bae-41e5-9e08-effdfa9bf437 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "GET /compute/v2.1/servers/600cbae0-3580-4e55-9577-33b7a08439ad" status: 200 len: 1736 microversion: 2.1 time: 0.429479 Sep 14 09:21:21.535708 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2933/5843] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:21:21 2022] GET /compute/v2.1/servers/600cbae0-3580-4e55-9577-33b7a08439ad => generated 1736 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:21:22.473753 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-582d6936-5125-4983-90f3-0e7f2d84b221 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:22.474372 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-582d6936-5125-4983-90f3-0e7f2d84b221 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] [instance: 022379ab-af51-495a-bcef-11e43774a7b0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:21:22.494780 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-582d6936-5125-4983-90f3-0e7f2d84b221 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:22.497128 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-582d6936-5125-4983-90f3-0e7f2d84b221 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:22.497602 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-582d6936-5125-4983-90f3-0e7f2d84b221 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:22.499520 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-582d6936-5125-4983-90f3-0e7f2d84b221 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:22.499999 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-582d6936-5125-4983-90f3-0e7f2d84b221 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:22.503393 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-582d6936-5125-4983-90f3-0e7f2d84b221 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:22.569701 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-90388669-5bf1-4cf0-9899-fe04ba52f6ba tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:22.571744 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-90388669-5bf1-4cf0-9899-fe04ba52f6ba tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 600cbae0-3580-4e55-9577-33b7a08439ad] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:21:22.590349 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-90388669-5bf1-4cf0-9899-fe04ba52f6ba tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:22.591398 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-90388669-5bf1-4cf0-9899-fe04ba52f6ba tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:22.594477 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-90388669-5bf1-4cf0-9899-fe04ba52f6ba tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:22.595083 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:21:22.596107 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-90388669-5bf1-4cf0-9899-fe04ba52f6ba tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:22.597711 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-90388669-5bf1-4cf0-9899-fe04ba52f6ba tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:22.598348 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-90388669-5bf1-4cf0-9899-fe04ba52f6ba tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:22.930119 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-582d6936-5125-4983-90f3-0e7f2d84b221 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9568f2d3f644e409961ab34e8fa95cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8638ed7d7b3d4285b36865282b8caeab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:21:22.947128 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-582d6936-5125-4983-90f3-0e7f2d84b221 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] 10.222.0.60 "GET /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0" status: 200 len: 1722 microversion: 2.1 time: 0.477776 Sep 14 09:21:22.961923 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2911/5844] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:21:22 2022] GET /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0 => generated 1722 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:21:22.976452 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-90388669-5bf1-4cf0-9899-fe04ba52f6ba tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03dc827647f4483beb2e1b7888be608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229e11b3c1fe48b088d0f3c4bb7e2cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:21:22.992268 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-90388669-5bf1-4cf0-9899-fe04ba52f6ba tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "GET /compute/v2.1/servers/600cbae0-3580-4e55-9577-33b7a08439ad" status: 200 len: 1736 microversion: 2.1 time: 0.426610 Sep 14 09:21:22.994999 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2934/5845] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:21:22 2022] GET /compute/v2.1/servers/600cbae0-3580-4e55-9577-33b7a08439ad => generated 1736 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:21:23.989911 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-19212a46-6ee4-4316-a029-b084206390f5 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:23.990550 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-19212a46-6ee4-4316-a029-b084206390f5 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] [instance: 022379ab-af51-495a-bcef-11e43774a7b0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:21:24.008485 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-19212a46-6ee4-4316-a029-b084206390f5 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:24.009331 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-19212a46-6ee4-4316-a029-b084206390f5 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:24.011480 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-19212a46-6ee4-4316-a029-b084206390f5 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:24.012488 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-19212a46-6ee4-4316-a029-b084206390f5 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:24.016970 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-19212a46-6ee4-4316-a029-b084206390f5 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:24.017675 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-19212a46-6ee4-4316-a029-b084206390f5 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:24.022014 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-68b10b67-7872-4486-ba92-b07113606f65 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:24.023248 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-68b10b67-7872-4486-ba92-b07113606f65 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 600cbae0-3580-4e55-9577-33b7a08439ad] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:21:24.037807 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-68b10b67-7872-4486-ba92-b07113606f65 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:24.038552 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-68b10b67-7872-4486-ba92-b07113606f65 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:24.040951 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-68b10b67-7872-4486-ba92-b07113606f65 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:24.041930 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-68b10b67-7872-4486-ba92-b07113606f65 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:24.044402 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-68b10b67-7872-4486-ba92-b07113606f65 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:24.045057 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-68b10b67-7872-4486-ba92-b07113606f65 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:24.119732 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:21:24.328285 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-68b10b67-7872-4486-ba92-b07113606f65 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03dc827647f4483beb2e1b7888be608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229e11b3c1fe48b088d0f3c4bb7e2cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:21:24.340969 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-68b10b67-7872-4486-ba92-b07113606f65 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "GET /compute/v2.1/servers/600cbae0-3580-4e55-9577-33b7a08439ad" status: 200 len: 1736 microversion: 2.1 time: 0.321895 Sep 14 09:21:24.343505 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2935/5846] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:21:24 2022] GET /compute/v2.1/servers/600cbae0-3580-4e55-9577-33b7a08439ad => generated 1736 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:21:24.422778 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-19212a46-6ee4-4316-a029-b084206390f5 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9568f2d3f644e409961ab34e8fa95cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8638ed7d7b3d4285b36865282b8caeab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:21:24.432006 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-19212a46-6ee4-4316-a029-b084206390f5 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] 10.222.0.60 "GET /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0" status: 200 len: 1722 microversion: 2.1 time: 0.447248 Sep 14 09:21:24.439276 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2912/5847] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:21:23 2022] GET /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0 => generated 1722 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:21:24.997949 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-35817de8-09a7-4a46-abd5-6cc908e6d7a4 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] Calling method '.version_select at 0x7f7d3f512670>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:25.022792 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-35817de8-09a7-4a46-abd5-6cc908e6d7a4 tempest-TestSecurityGroupsBasicOps-1563243579 tempest-TestSecurityGroupsBasicOps-1563243579-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1664083085" status: 202 len: 0 microversion: 2.1 time: 0.028808 Sep 14 09:21:25.023857 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2936/5848] 10.222.0.60 () {58 vars in 1278 bytes} [Wed Sep 14 09:21:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1664083085 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:21:25.370413 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-dfebeb48-007f-4630-bdbe-0ad1717ac24d tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:25.371258 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-dfebeb48-007f-4630-bdbe-0ad1717ac24d tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 600cbae0-3580-4e55-9577-33b7a08439ad] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:21:25.382518 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dfebeb48-007f-4630-bdbe-0ad1717ac24d tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:25.383227 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dfebeb48-007f-4630-bdbe-0ad1717ac24d tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:25.384410 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dfebeb48-007f-4630-bdbe-0ad1717ac24d tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:25.384619 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dfebeb48-007f-4630-bdbe-0ad1717ac24d tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:25.385298 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dfebeb48-007f-4630-bdbe-0ad1717ac24d tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:25.385844 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dfebeb48-007f-4630-bdbe-0ad1717ac24d tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:25.458471 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c5de9ef4-7f2e-44dc-aa35-9ace6a607363 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:25.460417 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-c5de9ef4-7f2e-44dc-aa35-9ace6a607363 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] [instance: 022379ab-af51-495a-bcef-11e43774a7b0] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:21:25.468815 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c5de9ef4-7f2e-44dc-aa35-9ace6a607363 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:25.469618 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c5de9ef4-7f2e-44dc-aa35-9ace6a607363 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:25.472466 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c5de9ef4-7f2e-44dc-aa35-9ace6a607363 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:25.473803 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c5de9ef4-7f2e-44dc-aa35-9ace6a607363 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:25.474619 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c5de9ef4-7f2e-44dc-aa35-9ace6a607363 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:25.475487 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c5de9ef4-7f2e-44dc-aa35-9ace6a607363 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:25.825254 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-c5de9ef4-7f2e-44dc-aa35-9ace6a607363 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9568f2d3f644e409961ab34e8fa95cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8638ed7d7b3d4285b36865282b8caeab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:21:25.837041 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-c5de9ef4-7f2e-44dc-aa35-9ace6a607363 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] 10.222.0.60 "GET /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0" status: 200 len: 1722 microversion: 2.1 time: 0.383332 Sep 14 09:21:25.845592 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2937/5849] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:21:25 2022] GET /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0 => generated 1722 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:21:25.856724 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-dfebeb48-007f-4630-bdbe-0ad1717ac24d tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03dc827647f4483beb2e1b7888be608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229e11b3c1fe48b088d0f3c4bb7e2cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:21:25.883626 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-dfebeb48-007f-4630-bdbe-0ad1717ac24d tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "GET /compute/v2.1/servers/600cbae0-3580-4e55-9577-33b7a08439ad" status: 200 len: 1736 microversion: 2.1 time: 0.517940 Sep 14 09:21:25.890466 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2913/5850] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:21:25 2022] GET /compute/v2.1/servers/600cbae0-3580-4e55-9577-33b7a08439ad => generated 1736 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:21:26.882096 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-6794d887-e6ea-45bd-963b-a1e4bbe31684 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:26.883833 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-6794d887-e6ea-45bd-963b-a1e4bbe31684 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] [instance: 022379ab-af51-495a-bcef-11e43774a7b0] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:21:26.891543 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6794d887-e6ea-45bd-963b-a1e4bbe31684 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:26.892410 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6794d887-e6ea-45bd-963b-a1e4bbe31684 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:26.893112 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6794d887-e6ea-45bd-963b-a1e4bbe31684 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:26.894680 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6794d887-e6ea-45bd-963b-a1e4bbe31684 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:26.895437 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6794d887-e6ea-45bd-963b-a1e4bbe31684 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:26.896140 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6794d887-e6ea-45bd-963b-a1e4bbe31684 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:26.913869 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-5bbf5fe4-5b99-43f6-9ba2-eb6360b595c1 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:26.915240 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-5bbf5fe4-5b99-43f6-9ba2-eb6360b595c1 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 600cbae0-3580-4e55-9577-33b7a08439ad] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:21:26.924845 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5bbf5fe4-5b99-43f6-9ba2-eb6360b595c1 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:26.930134 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5bbf5fe4-5b99-43f6-9ba2-eb6360b595c1 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:26.931002 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5bbf5fe4-5b99-43f6-9ba2-eb6360b595c1 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:26.933181 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5bbf5fe4-5b99-43f6-9ba2-eb6360b595c1 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:26.933910 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5bbf5fe4-5b99-43f6-9ba2-eb6360b595c1 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:26.938071 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5bbf5fe4-5b99-43f6-9ba2-eb6360b595c1 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:27.324464 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-6794d887-e6ea-45bd-963b-a1e4bbe31684 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9568f2d3f644e409961ab34e8fa95cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8638ed7d7b3d4285b36865282b8caeab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:21:27.345240 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-6794d887-e6ea-45bd-963b-a1e4bbe31684 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] 10.222.0.60 "GET /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0" status: 200 len: 1722 microversion: 2.1 time: 0.468510 Sep 14 09:21:27.349405 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2938/5851] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:21:26 2022] GET /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0 => generated 1722 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:21:27.394318 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-5bbf5fe4-5b99-43f6-9ba2-eb6360b595c1 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03dc827647f4483beb2e1b7888be608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229e11b3c1fe48b088d0f3c4bb7e2cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:21:27.407453 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-5bbf5fe4-5b99-43f6-9ba2-eb6360b595c1 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "GET /compute/v2.1/servers/600cbae0-3580-4e55-9577-33b7a08439ad" status: 200 len: 1736 microversion: 2.1 time: 0.493198 Sep 14 09:21:27.410021 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2914/5852] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:21:26 2022] GET /compute/v2.1/servers/600cbae0-3580-4e55-9577-33b7a08439ad => generated 1736 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:21:28.375585 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-e258a5ea-a1f0-46a6-9f56-ba8924d7a1c3 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:28.377277 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-e258a5ea-a1f0-46a6-9f56-ba8924d7a1c3 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] [instance: 022379ab-af51-495a-bcef-11e43774a7b0] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:21:28.396592 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e258a5ea-a1f0-46a6-9f56-ba8924d7a1c3 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:28.398419 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e258a5ea-a1f0-46a6-9f56-ba8924d7a1c3 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:28.402561 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e258a5ea-a1f0-46a6-9f56-ba8924d7a1c3 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:28.404365 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e258a5ea-a1f0-46a6-9f56-ba8924d7a1c3 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:28.406583 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e258a5ea-a1f0-46a6-9f56-ba8924d7a1c3 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:28.407383 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e258a5ea-a1f0-46a6-9f56-ba8924d7a1c3 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:28.433969 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-50d0b979-a2a7-418b-bcb9-a8db2c985be9 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:28.434628 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-50d0b979-a2a7-418b-bcb9-a8db2c985be9 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 600cbae0-3580-4e55-9577-33b7a08439ad] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:21:28.447050 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-50d0b979-a2a7-418b-bcb9-a8db2c985be9 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:28.447800 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-50d0b979-a2a7-418b-bcb9-a8db2c985be9 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:28.448589 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-50d0b979-a2a7-418b-bcb9-a8db2c985be9 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:28.449864 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-50d0b979-a2a7-418b-bcb9-a8db2c985be9 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:28.451073 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-50d0b979-a2a7-418b-bcb9-a8db2c985be9 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:28.451677 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-50d0b979-a2a7-418b-bcb9-a8db2c985be9 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:28.980929 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-e258a5ea-a1f0-46a6-9f56-ba8924d7a1c3 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9568f2d3f644e409961ab34e8fa95cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8638ed7d7b3d4285b36865282b8caeab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:21:28.999862 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-e258a5ea-a1f0-46a6-9f56-ba8924d7a1c3 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] 10.222.0.60 "GET /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0" status: 200 len: 1722 microversion: 2.1 time: 0.629586 Sep 14 09:21:29.000992 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2939/5853] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:21:28 2022] GET /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0 => generated 1722 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:21:29.047555 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-50d0b979-a2a7-418b-bcb9-a8db2c985be9 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03dc827647f4483beb2e1b7888be608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229e11b3c1fe48b088d0f3c4bb7e2cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:21:29.070030 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-50d0b979-a2a7-418b-bcb9-a8db2c985be9 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "GET /compute/v2.1/servers/600cbae0-3580-4e55-9577-33b7a08439ad" status: 200 len: 1736 microversion: 2.1 time: 0.640386 Sep 14 09:21:29.091807 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2915/5854] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:21:28 2022] GET /compute/v2.1/servers/600cbae0-3580-4e55-9577-33b7a08439ad => generated 1736 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:21:30.027719 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-036385aa-87e2-48aa-8517-29cbcefdbcdb tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:30.029097 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-036385aa-87e2-48aa-8517-29cbcefdbcdb tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] [instance: 022379ab-af51-495a-bcef-11e43774a7b0] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:21:30.044526 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-036385aa-87e2-48aa-8517-29cbcefdbcdb tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:30.047746 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-036385aa-87e2-48aa-8517-29cbcefdbcdb tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:30.049634 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-036385aa-87e2-48aa-8517-29cbcefdbcdb tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:30.050679 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-036385aa-87e2-48aa-8517-29cbcefdbcdb tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:30.052809 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-036385aa-87e2-48aa-8517-29cbcefdbcdb tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:30.053959 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-036385aa-87e2-48aa-8517-29cbcefdbcdb tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:30.099195 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-86ab2122-fe21-46f9-bb04-865944e63455 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:30.099879 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-86ab2122-fe21-46f9-bb04-865944e63455 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 600cbae0-3580-4e55-9577-33b7a08439ad] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:21:30.119756 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-86ab2122-fe21-46f9-bb04-865944e63455 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:30.124641 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-86ab2122-fe21-46f9-bb04-865944e63455 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:30.128699 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-86ab2122-fe21-46f9-bb04-865944e63455 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:30.129409 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-86ab2122-fe21-46f9-bb04-865944e63455 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:30.129890 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-86ab2122-fe21-46f9-bb04-865944e63455 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:30.135319 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-86ab2122-fe21-46f9-bb04-865944e63455 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:30.816300 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-036385aa-87e2-48aa-8517-29cbcefdbcdb tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9568f2d3f644e409961ab34e8fa95cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8638ed7d7b3d4285b36865282b8caeab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:21:30.828768 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-036385aa-87e2-48aa-8517-29cbcefdbcdb tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] 10.222.0.60 "GET /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0" status: 200 len: 1699 microversion: 2.1 time: 0.806923 Sep 14 09:21:30.829386 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2940/5855] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:21:30 2022] GET /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0 => generated 1699 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:21:30.858023 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-86ab2122-fe21-46f9-bb04-865944e63455 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03dc827647f4483beb2e1b7888be608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229e11b3c1fe48b088d0f3c4bb7e2cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:21:30.863448 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-291092a2-8625-4925-9961-9275b517d447 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:21:30.869438 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-86ab2122-fe21-46f9-bb04-865944e63455 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "GET /compute/v2.1/servers/600cbae0-3580-4e55-9577-33b7a08439ad" status: 200 len: 1716 microversion: 2.1 time: 0.774995 Sep 14 09:21:30.871506 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-291092a2-8625-4925-9961-9275b517d447 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:30.872014 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-291092a2-8625-4925-9961-9275b517d447 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:30.872461 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-291092a2-8625-4925-9961-9275b517d447 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:30.872927 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2916/5856] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:21:30 2022] GET /compute/v2.1/servers/600cbae0-3580-4e55-9577-33b7a08439ad => generated 1716 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:21:30.932566 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-291092a2-8625-4925-9961-9275b517d447 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] [instance: 022379ab-af51-495a-bcef-11e43774a7b0] Going to try to start instance {{(pid=128758) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 14 09:21:31.038236 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-291092a2-8625-4925-9961-9275b517d447 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] 10.222.0.60 "POST /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0/action" status: 202 len: 0 microversion: 2.1 time: 0.185302 Sep 14 09:21:31.038955 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2941/5857] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:21:30 2022] POST /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0/action => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 14 09:21:31.048692 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-875f99ee-4e1c-4d40-9549-fec1f82a544a tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:31.049880 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-875f99ee-4e1c-4d40-9549-fec1f82a544a tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] [instance: 022379ab-af51-495a-bcef-11e43774a7b0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:21:31.064708 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-875f99ee-4e1c-4d40-9549-fec1f82a544a tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:31.065664 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-875f99ee-4e1c-4d40-9549-fec1f82a544a tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:31.066307 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-875f99ee-4e1c-4d40-9549-fec1f82a544a tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:31.069432 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-875f99ee-4e1c-4d40-9549-fec1f82a544a tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:31.073378 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-875f99ee-4e1c-4d40-9549-fec1f82a544a tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:31.074193 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-875f99ee-4e1c-4d40-9549-fec1f82a544a tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:31.094597 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-6d757f87-1853-4a24-aa78-427b18c3fe74 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:31.095250 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-6d757f87-1853-4a24-aa78-427b18c3fe74 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 600cbae0-3580-4e55-9577-33b7a08439ad] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:21:31.111264 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6d757f87-1853-4a24-aa78-427b18c3fe74 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:31.113643 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6d757f87-1853-4a24-aa78-427b18c3fe74 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:31.114273 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6d757f87-1853-4a24-aa78-427b18c3fe74 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:31.115242 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6d757f87-1853-4a24-aa78-427b18c3fe74 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:31.115884 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6d757f87-1853-4a24-aa78-427b18c3fe74 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:31.116514 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6d757f87-1853-4a24-aa78-427b18c3fe74 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:31.350727 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-875f99ee-4e1c-4d40-9549-fec1f82a544a tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9568f2d3f644e409961ab34e8fa95cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8638ed7d7b3d4285b36865282b8caeab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:21:31.374532 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-875f99ee-4e1c-4d40-9549-fec1f82a544a tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] 10.222.0.60 "GET /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0" status: 200 len: 1708 microversion: 2.1 time: 0.330630 Sep 14 09:21:31.385193 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2917/5858] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:21:31 2022] GET /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0 => generated 1708 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:21:31.417040 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-6d757f87-1853-4a24-aa78-427b18c3fe74 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] HTTP exception thrown: Cannot 'detach_volume' instance 600cbae0-3580-4e55-9577-33b7a08439ad while it is in vm_state rescued Sep 14 09:21:31.421667 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-6d757f87-1853-4a24-aa78-427b18c3fe74 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Request method failure captured: Sep 14 09:21:31.421667 n-d-836830-18 devstack@n-api.service[128758]: request: DELETE /compute/v2.1/servers/600cbae0-3580-4e55-9577-33b7a08439ad/os-volume_attachments/09d9bf1e-bf95-422c-a2cb-5f728592319d HTTP/1.1 Sep 14 09:21:31.421667 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 09:21:31.421667 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 09:21:31.421667 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 09:21:31.421667 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 09:21:31.421667 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 09:21:31.421667 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 09:21:31.421667 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 09:21:31.421667 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 09:21:31.421667 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZwTx_6je2Mw19l1lk1T0KIWHROT3f4iq0u8_a7vTqyoq1BZh-ur0UF5KgJJeIlC54HlZaHspjBV72bT6ijQhdvPr0BCEmv-eUjjBTB_inJvaG7XMCMIoIIz39iqAFnj3jFdepR5dS7_uhYCyzmsUFKn1SkfeR8JmAZc_qs5ymrt_EA Sep 14 09:21:31.421667 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 09:21:31.421667 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 09:21:31.421667 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 09:21:31.421667 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 09:21:31.421667 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 09:21:31.421667 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 09:21:31.421667 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 229e11b3c1fe48b088d0f3c4bb7e2cb6 Sep 14 09:21:31.421667 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2043241234 Sep 14 09:21:31.421667 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 09:21:31.421667 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 09:21:31.421667 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/229e11b3c1fe48b088d0f3c4bb7e2cb6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_229e11b3c1fe48b088d0f3c4bb7e2cb6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/229e11b3c1fe48b088d0f3c4bb7e2cb6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/229e11b3c1fe48b088d0f3c4bb7e2cb6"}]}] Sep 14 09:21:31.421667 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2043241234 Sep 14 09:21:31.421667 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 229e11b3c1fe48b088d0f3c4bb7e2cb6 Sep 14 09:21:31.421667 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2043241234 Sep 14 09:21:31.421667 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-ServerRescueNegativeTestJSON-2043241234-project Sep 14 09:21:31.421667 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 09:21:31.421667 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 09:21:31.421667 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: d03dc827647f4483beb2e1b7888be608 Sep 14 09:21:31.421667 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2043241234-project Sep 14 09:21:31.421667 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 09:21:31.421667 n-d-836830-18 devstack@n-api.service[128758]: exception: Cannot 'detach_volume' instance 600cbae0-3580-4e55-9577-33b7a08439ad while it is in vm_state rescued Sep 14 09:21:31.421667 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'server_id': '600cbae0-3580-4e55-9577-33b7a08439ad', 'id': '09d9bf1e-bf95-422c-a2cb-5f728592319d'} Sep 14 09:21:31.421667 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:21:31.421667 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:21:31.421667 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 14 09:21:31.421667 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 14 09:21:31.421667 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 14 09:21:31.421667 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 14 09:21:31.421667 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 14 09:21:31.421667 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 14 09:21:31.421667 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 600cbae0-3580-4e55-9577-33b7a08439ad in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 14 09:21:31.421667 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:21:31.421667 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:21:31.421667 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:21:31.421667 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:21:31.421667 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:21:31.421667 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:21:31.421667 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:21:31.421667 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:21:31.421667 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:21:31.421667 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:21:31.421667 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 14 09:21:31.421667 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 14 09:21:31.421667 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 14 09:21:31.421667 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 14 09:21:31.421667 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 600cbae0-3580-4e55-9577-33b7a08439ad while it is in vm_state rescued Sep 14 09:21:31.421667 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:21:31.421667 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:21:31.421667 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:21:31.421667 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:21:31.427045 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:21:31.427045 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:21:31.427045 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:21:31.427045 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:21:31.427045 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 600cbae0-3580-4e55-9577-33b7a08439ad while it is in vm_state rescued Sep 14 09:21:31.427045 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:21:31.427045 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-6d757f87-1853-4a24-aa78-427b18c3fe74 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Returning 409 to user: Cannot 'detach_volume' instance 600cbae0-3580-4e55-9577-33b7a08439ad while it is in vm_state rescued {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:21:31.429958 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-6d757f87-1853-4a24-aa78-427b18c3fe74 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "DELETE /compute/v2.1/servers/600cbae0-3580-4e55-9577-33b7a08439ad/os-volume_attachments/09d9bf1e-bf95-422c-a2cb-5f728592319d" status: 409 len: 152 microversion: 2.1 time: 0.341362 Sep 14 09:21:31.432705 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2942/5859] 10.222.0.60 () {58 vars in 1416 bytes} [Wed Sep 14 09:21:31 2022] DELETE /compute/v2.1/servers/600cbae0-3580-4e55-9577-33b7a08439ad/os-volume_attachments/09d9bf1e-bf95-422c-a2cb-5f728592319d => generated 152 bytes in 345 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Sep 14 09:21:31.442651 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-fb354c40-56f3-41fa-81d5-ede80c24da54 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:21:31.443234 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-fb354c40-56f3-41fa-81d5-ede80c24da54 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 600cbae0-3580-4e55-9577-33b7a08439ad] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:21:31.453345 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fb354c40-56f3-41fa-81d5-ede80c24da54 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:31.453827 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fb354c40-56f3-41fa-81d5-ede80c24da54 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:31.454276 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fb354c40-56f3-41fa-81d5-ede80c24da54 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:31.455004 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fb354c40-56f3-41fa-81d5-ede80c24da54 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:31.455469 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fb354c40-56f3-41fa-81d5-ede80c24da54 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:31.455899 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fb354c40-56f3-41fa-81d5-ede80c24da54 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:31.632071 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-fb354c40-56f3-41fa-81d5-ede80c24da54 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "POST /compute/v2.1/servers/600cbae0-3580-4e55-9577-33b7a08439ad/action" status: 202 len: 0 microversion: 2.1 time: 0.194025 Sep 14 09:21:31.633341 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2918/5860] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:21:31 2022] POST /compute/v2.1/servers/600cbae0-3580-4e55-9577-33b7a08439ad/action => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:21:31.642955 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-035c1914-7bf4-4c7c-8012-c9ee0c9116be tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:31.643750 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-035c1914-7bf4-4c7c-8012-c9ee0c9116be tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 600cbae0-3580-4e55-9577-33b7a08439ad] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:21:31.659570 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-035c1914-7bf4-4c7c-8012-c9ee0c9116be tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:31.662115 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-035c1914-7bf4-4c7c-8012-c9ee0c9116be tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:31.664795 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-035c1914-7bf4-4c7c-8012-c9ee0c9116be tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:31.668191 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-035c1914-7bf4-4c7c-8012-c9ee0c9116be tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:31.669031 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-035c1914-7bf4-4c7c-8012-c9ee0c9116be tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:31.672008 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-035c1914-7bf4-4c7c-8012-c9ee0c9116be tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:32.347280 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-035c1914-7bf4-4c7c-8012-c9ee0c9116be tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03dc827647f4483beb2e1b7888be608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229e11b3c1fe48b088d0f3c4bb7e2cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:21:32.365026 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-035c1914-7bf4-4c7c-8012-c9ee0c9116be tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "GET /compute/v2.1/servers/600cbae0-3580-4e55-9577-33b7a08439ad" status: 200 len: 1724 microversion: 2.1 time: 0.726887 Sep 14 09:21:32.365759 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2943/5861] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:21:31 2022] GET /compute/v2.1/servers/600cbae0-3580-4e55-9577-33b7a08439ad => generated 1724 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:21:32.403486 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ac561ac7-746f-4fb8-b4cd-92c117271ad9 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:32.404254 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-ac561ac7-746f-4fb8-b4cd-92c117271ad9 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] [instance: 022379ab-af51-495a-bcef-11e43774a7b0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:21:32.431682 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ac561ac7-746f-4fb8-b4cd-92c117271ad9 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:32.432204 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ac561ac7-746f-4fb8-b4cd-92c117271ad9 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:32.432662 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ac561ac7-746f-4fb8-b4cd-92c117271ad9 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:32.436511 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ac561ac7-746f-4fb8-b4cd-92c117271ad9 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:32.452799 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ac561ac7-746f-4fb8-b4cd-92c117271ad9 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:32.453277 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ac561ac7-746f-4fb8-b4cd-92c117271ad9 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:32.986693 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-ac561ac7-746f-4fb8-b4cd-92c117271ad9 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9568f2d3f644e409961ab34e8fa95cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8638ed7d7b3d4285b36865282b8caeab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:21:33.017643 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-ac561ac7-746f-4fb8-b4cd-92c117271ad9 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] 10.222.0.60 "GET /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0" status: 200 len: 1708 microversion: 2.1 time: 0.617386 Sep 14 09:21:33.018664 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2919/5862] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:21:32 2022] GET /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0 => generated 1708 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:21:33.396918 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-af241b38-0468-4610-8b28-21a70e98a045 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:33.404043 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-af241b38-0468-4610-8b28-21a70e98a045 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 600cbae0-3580-4e55-9577-33b7a08439ad] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:21:33.418846 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-af241b38-0468-4610-8b28-21a70e98a045 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:33.419308 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-af241b38-0468-4610-8b28-21a70e98a045 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:33.420191 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-af241b38-0468-4610-8b28-21a70e98a045 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:33.422486 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-af241b38-0468-4610-8b28-21a70e98a045 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:33.438305 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-af241b38-0468-4610-8b28-21a70e98a045 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:33.439594 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-af241b38-0468-4610-8b28-21a70e98a045 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:33.753426 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-af241b38-0468-4610-8b28-21a70e98a045 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03dc827647f4483beb2e1b7888be608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229e11b3c1fe48b088d0f3c4bb7e2cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:21:33.767547 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-af241b38-0468-4610-8b28-21a70e98a045 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "GET /compute/v2.1/servers/600cbae0-3580-4e55-9577-33b7a08439ad" status: 200 len: 1724 microversion: 2.1 time: 0.378349 Sep 14 09:21:33.768764 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2944/5863] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:21:33 2022] GET /compute/v2.1/servers/600cbae0-3580-4e55-9577-33b7a08439ad => generated 1724 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:21:34.049102 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b955fbea-64fc-4be4-b4b9-447fcbec2eb4 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:34.050068 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b955fbea-64fc-4be4-b4b9-447fcbec2eb4 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] [instance: 022379ab-af51-495a-bcef-11e43774a7b0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:21:34.063729 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b955fbea-64fc-4be4-b4b9-447fcbec2eb4 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:34.075215 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b955fbea-64fc-4be4-b4b9-447fcbec2eb4 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:34.076847 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b955fbea-64fc-4be4-b4b9-447fcbec2eb4 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:34.078160 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b955fbea-64fc-4be4-b4b9-447fcbec2eb4 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:34.078822 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b955fbea-64fc-4be4-b4b9-447fcbec2eb4 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:34.080226 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b955fbea-64fc-4be4-b4b9-447fcbec2eb4 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:34.268055 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b955fbea-64fc-4be4-b4b9-447fcbec2eb4 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9568f2d3f644e409961ab34e8fa95cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8638ed7d7b3d4285b36865282b8caeab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:21:34.283405 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b955fbea-64fc-4be4-b4b9-447fcbec2eb4 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] 10.222.0.60 "GET /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0" status: 200 len: 1708 microversion: 2.1 time: 0.240770 Sep 14 09:21:34.287889 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2920/5864] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:21:34 2022] GET /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0 => generated 1708 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:21:34.792666 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-adb8f59d-fcc4-4fdd-a0d1-afec76c78a37 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:34.793315 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-adb8f59d-fcc4-4fdd-a0d1-afec76c78a37 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 600cbae0-3580-4e55-9577-33b7a08439ad] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:21:34.802732 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-adb8f59d-fcc4-4fdd-a0d1-afec76c78a37 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:34.803455 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-adb8f59d-fcc4-4fdd-a0d1-afec76c78a37 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:34.804770 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-adb8f59d-fcc4-4fdd-a0d1-afec76c78a37 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:34.805842 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-adb8f59d-fcc4-4fdd-a0d1-afec76c78a37 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:34.806377 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-adb8f59d-fcc4-4fdd-a0d1-afec76c78a37 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:34.807030 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-adb8f59d-fcc4-4fdd-a0d1-afec76c78a37 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:35.037356 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-adb8f59d-fcc4-4fdd-a0d1-afec76c78a37 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03dc827647f4483beb2e1b7888be608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229e11b3c1fe48b088d0f3c4bb7e2cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:21:35.057848 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-adb8f59d-fcc4-4fdd-a0d1-afec76c78a37 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "GET /compute/v2.1/servers/600cbae0-3580-4e55-9577-33b7a08439ad" status: 200 len: 1724 microversion: 2.1 time: 0.269347 Sep 14 09:21:35.058470 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2945/5865] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:21:34 2022] GET /compute/v2.1/servers/600cbae0-3580-4e55-9577-33b7a08439ad => generated 1724 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:21:35.313383 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-134ab075-4e9c-4e31-82bd-69ea6a4a1a93 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:35.314034 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-134ab075-4e9c-4e31-82bd-69ea6a4a1a93 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] [instance: 022379ab-af51-495a-bcef-11e43774a7b0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:21:35.321048 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:21:35.322522 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-134ab075-4e9c-4e31-82bd-69ea6a4a1a93 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:35.323064 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-134ab075-4e9c-4e31-82bd-69ea6a4a1a93 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:35.323550 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-134ab075-4e9c-4e31-82bd-69ea6a4a1a93 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:35.324268 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-134ab075-4e9c-4e31-82bd-69ea6a4a1a93 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:35.324731 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-134ab075-4e9c-4e31-82bd-69ea6a4a1a93 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:35.326642 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-134ab075-4e9c-4e31-82bd-69ea6a4a1a93 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:35.501029 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-134ab075-4e9c-4e31-82bd-69ea6a4a1a93 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9568f2d3f644e409961ab34e8fa95cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8638ed7d7b3d4285b36865282b8caeab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:21:35.509944 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-134ab075-4e9c-4e31-82bd-69ea6a4a1a93 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] 10.222.0.60 "GET /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0" status: 200 len: 1708 microversion: 2.1 time: 0.202504 Sep 14 09:21:35.529074 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2921/5866] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:21:35 2022] GET /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0 => generated 1708 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:21:36.089686 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-7ad7b3f3-be46-4d52-82b8-21a246c85837 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:36.089686 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-7ad7b3f3-be46-4d52-82b8-21a246c85837 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 600cbae0-3580-4e55-9577-33b7a08439ad] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:21:36.099101 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7ad7b3f3-be46-4d52-82b8-21a246c85837 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:36.099762 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7ad7b3f3-be46-4d52-82b8-21a246c85837 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:36.100303 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7ad7b3f3-be46-4d52-82b8-21a246c85837 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:36.101168 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7ad7b3f3-be46-4d52-82b8-21a246c85837 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:36.101735 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7ad7b3f3-be46-4d52-82b8-21a246c85837 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:36.102280 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7ad7b3f3-be46-4d52-82b8-21a246c85837 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:36.309116 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-7ad7b3f3-be46-4d52-82b8-21a246c85837 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03dc827647f4483beb2e1b7888be608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229e11b3c1fe48b088d0f3c4bb7e2cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:21:36.319916 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-7ad7b3f3-be46-4d52-82b8-21a246c85837 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "GET /compute/v2.1/servers/600cbae0-3580-4e55-9577-33b7a08439ad" status: 200 len: 1730 microversion: 2.1 time: 0.239463 Sep 14 09:21:36.332332 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2946/5867] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:21:36 2022] GET /compute/v2.1/servers/600cbae0-3580-4e55-9577-33b7a08439ad => generated 1730 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:21:36.349179 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9896f6d7-5699-4d0b-b191-c7c00e81de1a tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:36.349804 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-9896f6d7-5699-4d0b-b191-c7c00e81de1a tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 600cbae0-3580-4e55-9577-33b7a08439ad] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:21:36.384364 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9896f6d7-5699-4d0b-b191-c7c00e81de1a tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:36.385053 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9896f6d7-5699-4d0b-b191-c7c00e81de1a tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:36.385792 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9896f6d7-5699-4d0b-b191-c7c00e81de1a tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:36.386530 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9896f6d7-5699-4d0b-b191-c7c00e81de1a tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:36.387025 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9896f6d7-5699-4d0b-b191-c7c00e81de1a tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:36.387468 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9896f6d7-5699-4d0b-b191-c7c00e81de1a tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:36.509325 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-9896f6d7-5699-4d0b-b191-c7c00e81de1a tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "GET /compute/v2.1/servers/600cbae0-3580-4e55-9577-33b7a08439ad/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.165536 Sep 14 09:21:36.510172 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2922/5868] 10.222.0.60 () {58 vars in 1275 bytes} [Wed Sep 14 09:21:36 2022] GET /compute/v2.1/servers/600cbae0-3580-4e55-9577-33b7a08439ad/os-interface => generated 284 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:21:36.538239 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-8eb88d05-5c3c-46d0-9288-17a115532c99 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:36.539784 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-8eb88d05-5c3c-46d0-9288-17a115532c99 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] [instance: 022379ab-af51-495a-bcef-11e43774a7b0] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:21:36.549850 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8eb88d05-5c3c-46d0-9288-17a115532c99 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:36.550789 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8eb88d05-5c3c-46d0-9288-17a115532c99 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:36.551544 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8eb88d05-5c3c-46d0-9288-17a115532c99 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:36.553303 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8eb88d05-5c3c-46d0-9288-17a115532c99 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:36.554201 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8eb88d05-5c3c-46d0-9288-17a115532c99 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:36.554879 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8eb88d05-5c3c-46d0-9288-17a115532c99 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:36.862168 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-8eb88d05-5c3c-46d0-9288-17a115532c99 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9568f2d3f644e409961ab34e8fa95cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8638ed7d7b3d4285b36865282b8caeab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:21:36.876682 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-8eb88d05-5c3c-46d0-9288-17a115532c99 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] 10.222.0.60 "GET /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0" status: 200 len: 1712 microversion: 2.1 time: 0.342167 Sep 14 09:21:36.896489 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2947/5869] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:21:36 2022] GET /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0 => generated 1712 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:21:38.208439 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-5898e0a1-ce80-471f-a558-97df8aaaf85e req-5e3e5671-593d-41d9-b735-817b9387a37a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "600cbae0-3580-4e55-9577-33b7a08439ad", "tag": "2ab6288f-9f5a-4572-8493-c7c83f0cc3e1"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:21:38.237322 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-5898e0a1-ce80-471f-a558-97df8aaaf85e req-5e3e5671-593d-41d9-b735-817b9387a37a service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:38.238126 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-5898e0a1-ce80-471f-a558-97df8aaaf85e req-5e3e5671-593d-41d9-b735-817b9387a37a service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:38.238749 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-5898e0a1-ce80-471f-a558-97df8aaaf85e req-5e3e5671-593d-41d9-b735-817b9387a37a service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:38.263542 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-5898e0a1-ce80-471f-a558-97df8aaaf85e req-5e3e5671-593d-41d9-b735-817b9387a37a service nova] Creating event network-changed:2ab6288f-9f5a-4572-8493-c7c83f0cc3e1 for instance 600cbae0-3580-4e55-9577-33b7a08439ad on n-h1-836830-18 Sep 14 09:21:38.277202 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-5898e0a1-ce80-471f-a558-97df8aaaf85e req-5e3e5671-593d-41d9-b735-817b9387a37a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072183 Sep 14 09:21:38.278016 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2923/5870] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:21:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:21:40.634643 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-65fcff43-0c0f-4ff5-be4d-23282723d8bd req-dc5ddc2f-5437-49ea-a370-b015fdf0d919 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "600cbae0-3580-4e55-9577-33b7a08439ad", "tag": "2ab6288f-9f5a-4572-8493-c7c83f0cc3e1"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:21:40.644057 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=55,nova_api:DELETE=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:21:40.667553 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-65fcff43-0c0f-4ff5-be4d-23282723d8bd req-dc5ddc2f-5437-49ea-a370-b015fdf0d919 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:40.669916 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-65fcff43-0c0f-4ff5-be4d-23282723d8bd req-dc5ddc2f-5437-49ea-a370-b015fdf0d919 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:40.671590 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-65fcff43-0c0f-4ff5-be4d-23282723d8bd req-dc5ddc2f-5437-49ea-a370-b015fdf0d919 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:40.689485 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-65fcff43-0c0f-4ff5-be4d-23282723d8bd req-dc5ddc2f-5437-49ea-a370-b015fdf0d919 service nova] Creating event network-changed:2ab6288f-9f5a-4572-8493-c7c83f0cc3e1 for instance 600cbae0-3580-4e55-9577-33b7a08439ad on n-h1-836830-18 Sep 14 09:21:40.696979 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-65fcff43-0c0f-4ff5-be4d-23282723d8bd req-dc5ddc2f-5437-49ea-a370-b015fdf0d919 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068351 Sep 14 09:21:40.698234 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2948/5871] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:21:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:22:32.333322 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=5 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:22:32.334137 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:22:32.335228 n-d-836830-18 devstack@n-api.service[128759]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 09:22:32.335440 n-d-836830-18 devstack@n-api.service[128759]: Wed Sep 14 09:22:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0/os-volume_attachments/d5e0e550-2f8b-4a4a-9e20-33b038e0cbb6 (ip 10.222.0.60) !!! Sep 14 09:22:32.341141 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9e78bf71-0c03-4c21-b732-935f9d2a4f9e tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:32.341765 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-9e78bf71-0c03-4c21-b732-935f9d2a4f9e tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] [instance: 022379ab-af51-495a-bcef-11e43774a7b0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:22:32.351528 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9e78bf71-0c03-4c21-b732-935f9d2a4f9e tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:32.352233 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9e78bf71-0c03-4c21-b732-935f9d2a4f9e tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:32.352857 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9e78bf71-0c03-4c21-b732-935f9d2a4f9e tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:32.353761 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9e78bf71-0c03-4c21-b732-935f9d2a4f9e tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:32.354399 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9e78bf71-0c03-4c21-b732-935f9d2a4f9e tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:32.355032 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9e78bf71-0c03-4c21-b732-935f9d2a4f9e tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:32.471031 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.objects.instance [None req-9e78bf71-0c03-4c21-b732-935f9d2a4f9e tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lazy-loading 'services' on Instance uuid 022379ab-af51-495a-bcef-11e43774a7b0 {{(pid=128759) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:22:32.578426 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-9e78bf71-0c03-4c21-b732-935f9d2a4f9e tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] 10.222.0.60 "DELETE /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0/os-volume_attachments/d5e0e550-2f8b-4a4a-9e20-33b038e0cbb6" status: 202 len: 0 microversion: 2.1 time: 0.247029 Sep 14 09:22:32.582744 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2924/5872] 10.222.0.60 () {58 vars in 1416 bytes} [Wed Sep 14 09:22:32 2022] DELETE /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0/os-volume_attachments/d5e0e550-2f8b-4a4a-9e20-33b038e0cbb6 => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:22:34.859309 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-f267d782-de4f-4f15-9ab4-63a50506fee1 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:34.861830 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-f267d782-de4f-4f15-9ab4-63a50506fee1 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 600cbae0-3580-4e55-9577-33b7a08439ad] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:22:34.876104 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:22:34.877790 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:22:34.886874 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f267d782-de4f-4f15-9ab4-63a50506fee1 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:34.888421 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f267d782-de4f-4f15-9ab4-63a50506fee1 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:34.890599 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f267d782-de4f-4f15-9ab4-63a50506fee1 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:34.892242 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f267d782-de4f-4f15-9ab4-63a50506fee1 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:34.895707 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f267d782-de4f-4f15-9ab4-63a50506fee1 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:34.896373 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f267d782-de4f-4f15-9ab4-63a50506fee1 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:35.105675 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.objects.instance [None req-f267d782-de4f-4f15-9ab4-63a50506fee1 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lazy-loading 'services' on Instance uuid 600cbae0-3580-4e55-9577-33b7a08439ad {{(pid=128758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:22:35.241197 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-f267d782-de4f-4f15-9ab4-63a50506fee1 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "DELETE /compute/v2.1/servers/600cbae0-3580-4e55-9577-33b7a08439ad/os-volume_attachments/09d9bf1e-bf95-422c-a2cb-5f728592319d" status: 202 len: 0 microversion: 2.1 time: 0.388543 Sep 14 09:22:35.242651 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2949/5873] 10.222.0.60 () {58 vars in 1416 bytes} [Wed Sep 14 09:22:34 2022] DELETE /compute/v2.1/servers/600cbae0-3580-4e55-9577-33b7a08439ad/os-volume_attachments/09d9bf1e-bf95-422c-a2cb-5f728592319d => generated 0 bytes in 391 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:22:35.254896 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-4d7fc6e3-da73-4053-97d3-7350a0327113 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:35.257260 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-4d7fc6e3-da73-4053-97d3-7350a0327113 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 600cbae0-3580-4e55-9577-33b7a08439ad] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:22:35.272026 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4d7fc6e3-da73-4053-97d3-7350a0327113 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:35.272741 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4d7fc6e3-da73-4053-97d3-7350a0327113 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:35.273699 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4d7fc6e3-da73-4053-97d3-7350a0327113 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:35.274597 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4d7fc6e3-da73-4053-97d3-7350a0327113 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:35.275369 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4d7fc6e3-da73-4053-97d3-7350a0327113 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:35.275977 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4d7fc6e3-da73-4053-97d3-7350a0327113 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:35.316547 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-4d7fc6e3-da73-4053-97d3-7350a0327113 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "GET /compute/v2.1/servers/600cbae0-3580-4e55-9577-33b7a08439ad/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069057 Sep 14 09:22:35.317596 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2925/5874] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 14 09:22:35 2022] GET /compute/v2.1/servers/600cbae0-3580-4e55-9577-33b7a08439ad/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:22:36.332872 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ee0a02d3-a63c-4a9a-a875-c00849304d50 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:36.335443 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-ee0a02d3-a63c-4a9a-a875-c00849304d50 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 600cbae0-3580-4e55-9577-33b7a08439ad] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:22:36.343326 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ee0a02d3-a63c-4a9a-a875-c00849304d50 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:36.343932 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ee0a02d3-a63c-4a9a-a875-c00849304d50 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:36.344447 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ee0a02d3-a63c-4a9a-a875-c00849304d50 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:36.345240 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ee0a02d3-a63c-4a9a-a875-c00849304d50 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:36.345941 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ee0a02d3-a63c-4a9a-a875-c00849304d50 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:36.346558 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ee0a02d3-a63c-4a9a-a875-c00849304d50 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:36.380664 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-ee0a02d3-a63c-4a9a-a875-c00849304d50 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "GET /compute/v2.1/servers/600cbae0-3580-4e55-9577-33b7a08439ad/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054204 Sep 14 09:22:36.381659 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2950/5875] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 14 09:22:36 2022] GET /compute/v2.1/servers/600cbae0-3580-4e55-9577-33b7a08439ad/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:22:37.393472 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-327e6e57-89a5-412f-b750-81cafaa8abdd tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:37.396394 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-327e6e57-89a5-412f-b750-81cafaa8abdd tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 600cbae0-3580-4e55-9577-33b7a08439ad] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:22:37.403390 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-327e6e57-89a5-412f-b750-81cafaa8abdd tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:37.404201 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-327e6e57-89a5-412f-b750-81cafaa8abdd tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:37.404900 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-327e6e57-89a5-412f-b750-81cafaa8abdd tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:37.405830 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-327e6e57-89a5-412f-b750-81cafaa8abdd tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:37.406508 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-327e6e57-89a5-412f-b750-81cafaa8abdd tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:37.407183 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-327e6e57-89a5-412f-b750-81cafaa8abdd tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:37.439156 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-327e6e57-89a5-412f-b750-81cafaa8abdd tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "GET /compute/v2.1/servers/600cbae0-3580-4e55-9577-33b7a08439ad/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049490 Sep 14 09:22:37.439758 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2926/5876] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 14 09:22:37 2022] GET /compute/v2.1/servers/600cbae0-3580-4e55-9577-33b7a08439ad/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:22:38.172915 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-720fff06-b782-4f20-a346-e3f776234952 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:22:38.184272 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-720fff06-b782-4f20-a346-e3f776234952 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:38.184686 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-720fff06-b782-4f20-a346-e3f776234952 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:38.185133 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-720fff06-b782-4f20-a346-e3f776234952 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:38.245557 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-720fff06-b782-4f20-a346-e3f776234952 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] [instance: 022379ab-af51-495a-bcef-11e43774a7b0] Going to try to stop instance {{(pid=128758) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 14 09:22:38.331905 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-720fff06-b782-4f20-a346-e3f776234952 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] 10.222.0.60 "POST /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0/action" status: 202 len: 0 microversion: 2.1 time: 0.163836 Sep 14 09:22:38.333283 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2951/5877] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:22:38 2022] POST /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0/action => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:22:38.342210 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-0dcde4a8-2279-486c-b168-5ddf8dc4d6c3 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:38.343127 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-0dcde4a8-2279-486c-b168-5ddf8dc4d6c3 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] [instance: 022379ab-af51-495a-bcef-11e43774a7b0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:22:38.356036 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0dcde4a8-2279-486c-b168-5ddf8dc4d6c3 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:38.358523 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0dcde4a8-2279-486c-b168-5ddf8dc4d6c3 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:38.360361 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0dcde4a8-2279-486c-b168-5ddf8dc4d6c3 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:38.361593 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0dcde4a8-2279-486c-b168-5ddf8dc4d6c3 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:38.362931 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0dcde4a8-2279-486c-b168-5ddf8dc4d6c3 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:38.364373 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0dcde4a8-2279-486c-b168-5ddf8dc4d6c3 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:38.452762 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-4687a580-25cd-4824-bb90-1997c6e808d9 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:38.468682 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-4687a580-25cd-4824-bb90-1997c6e808d9 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 600cbae0-3580-4e55-9577-33b7a08439ad] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:22:38.489337 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4687a580-25cd-4824-bb90-1997c6e808d9 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:38.492855 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4687a580-25cd-4824-bb90-1997c6e808d9 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:38.493562 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4687a580-25cd-4824-bb90-1997c6e808d9 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:38.494804 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4687a580-25cd-4824-bb90-1997c6e808d9 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:38.498163 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4687a580-25cd-4824-bb90-1997c6e808d9 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:38.498828 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4687a580-25cd-4824-bb90-1997c6e808d9 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:38.556937 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-4687a580-25cd-4824-bb90-1997c6e808d9 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "GET /compute/v2.1/servers/600cbae0-3580-4e55-9577-33b7a08439ad/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.109106 Sep 14 09:22:38.558445 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2952/5878] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 14 09:22:38 2022] GET /compute/v2.1/servers/600cbae0-3580-4e55-9577-33b7a08439ad/os-volume_attachments => generated 197 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:22:38.668551 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-0dcde4a8-2279-486c-b168-5ddf8dc4d6c3 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9568f2d3f644e409961ab34e8fa95cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8638ed7d7b3d4285b36865282b8caeab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:22:38.692366 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-0dcde4a8-2279-486c-b168-5ddf8dc4d6c3 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] 10.222.0.60 "GET /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0" status: 200 len: 1676 microversion: 2.1 time: 0.355416 Sep 14 09:22:38.693492 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2927/5879] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:22:38 2022] GET /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0 => generated 1676 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:22:39.569873 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-0b4be45a-1de6-41da-8204-12432979d018 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:39.573021 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-0b4be45a-1de6-41da-8204-12432979d018 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 600cbae0-3580-4e55-9577-33b7a08439ad] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:22:39.580282 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0b4be45a-1de6-41da-8204-12432979d018 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:39.581838 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0b4be45a-1de6-41da-8204-12432979d018 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:39.582569 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0b4be45a-1de6-41da-8204-12432979d018 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:39.583557 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0b4be45a-1de6-41da-8204-12432979d018 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:39.584240 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0b4be45a-1de6-41da-8204-12432979d018 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:39.584892 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0b4be45a-1de6-41da-8204-12432979d018 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:39.626233 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-0b4be45a-1de6-41da-8204-12432979d018 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "GET /compute/v2.1/servers/600cbae0-3580-4e55-9577-33b7a08439ad/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060302 Sep 14 09:22:39.627601 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2953/5880] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 14 09:22:39 2022] GET /compute/v2.1/servers/600cbae0-3580-4e55-9577-33b7a08439ad/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:22:39.721029 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-40af84b8-24b0-4472-8b6d-d4301ce79874 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:39.722378 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-40af84b8-24b0-4472-8b6d-d4301ce79874 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] [instance: 022379ab-af51-495a-bcef-11e43774a7b0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:22:39.737321 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-40af84b8-24b0-4472-8b6d-d4301ce79874 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:39.738048 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-40af84b8-24b0-4472-8b6d-d4301ce79874 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:39.738661 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-40af84b8-24b0-4472-8b6d-d4301ce79874 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:39.741449 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-40af84b8-24b0-4472-8b6d-d4301ce79874 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:39.741761 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-40af84b8-24b0-4472-8b6d-d4301ce79874 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:39.742213 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-40af84b8-24b0-4472-8b6d-d4301ce79874 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:40.056283 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-40af84b8-24b0-4472-8b6d-d4301ce79874 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9568f2d3f644e409961ab34e8fa95cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8638ed7d7b3d4285b36865282b8caeab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:22:40.067164 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-40af84b8-24b0-4472-8b6d-d4301ce79874 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] 10.222.0.60 "GET /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0" status: 200 len: 1676 microversion: 2.1 time: 0.350850 Sep 14 09:22:40.069494 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2928/5881] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:22:39 2022] GET /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0 => generated 1676 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:22:40.639156 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1edf8e5c-80b3-40d8-a277-e8d2c1bef834 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:40.646514 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-1edf8e5c-80b3-40d8-a277-e8d2c1bef834 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 600cbae0-3580-4e55-9577-33b7a08439ad] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:22:40.672448 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1edf8e5c-80b3-40d8-a277-e8d2c1bef834 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:40.673746 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1edf8e5c-80b3-40d8-a277-e8d2c1bef834 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:40.674471 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1edf8e5c-80b3-40d8-a277-e8d2c1bef834 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:40.677693 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1edf8e5c-80b3-40d8-a277-e8d2c1bef834 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:40.678501 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1edf8e5c-80b3-40d8-a277-e8d2c1bef834 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:40.679185 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1edf8e5c-80b3-40d8-a277-e8d2c1bef834 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:40.757131 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-1edf8e5c-80b3-40d8-a277-e8d2c1bef834 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "GET /compute/v2.1/servers/600cbae0-3580-4e55-9577-33b7a08439ad/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.120504 Sep 14 09:22:40.759729 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2954/5882] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 14 09:22:40 2022] GET /compute/v2.1/servers/600cbae0-3580-4e55-9577-33b7a08439ad/os-volume_attachments => generated 197 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:22:41.093288 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-052d6d2f-13ce-4ca1-8300-415ff6df0385 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:41.093916 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-052d6d2f-13ce-4ca1-8300-415ff6df0385 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] [instance: 022379ab-af51-495a-bcef-11e43774a7b0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:22:41.104861 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-052d6d2f-13ce-4ca1-8300-415ff6df0385 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:41.118485 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-052d6d2f-13ce-4ca1-8300-415ff6df0385 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:41.118485 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-052d6d2f-13ce-4ca1-8300-415ff6df0385 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:41.118485 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-052d6d2f-13ce-4ca1-8300-415ff6df0385 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:41.118485 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-052d6d2f-13ce-4ca1-8300-415ff6df0385 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:41.118485 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-052d6d2f-13ce-4ca1-8300-415ff6df0385 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:41.392923 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-052d6d2f-13ce-4ca1-8300-415ff6df0385 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9568f2d3f644e409961ab34e8fa95cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8638ed7d7b3d4285b36865282b8caeab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:22:41.403809 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-052d6d2f-13ce-4ca1-8300-415ff6df0385 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] 10.222.0.60 "GET /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0" status: 200 len: 1676 microversion: 2.1 time: 0.313862 Sep 14 09:22:41.406091 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2929/5883] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:22:41 2022] GET /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0 => generated 1676 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:22:41.772073 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-2eb1c7e0-7ac5-49d8-8215-16da6e4a2009 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:41.774439 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-2eb1c7e0-7ac5-49d8-8215-16da6e4a2009 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 600cbae0-3580-4e55-9577-33b7a08439ad] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:22:41.791408 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2eb1c7e0-7ac5-49d8-8215-16da6e4a2009 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:41.795084 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2eb1c7e0-7ac5-49d8-8215-16da6e4a2009 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:41.795660 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2eb1c7e0-7ac5-49d8-8215-16da6e4a2009 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:41.796526 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2eb1c7e0-7ac5-49d8-8215-16da6e4a2009 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:41.797123 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2eb1c7e0-7ac5-49d8-8215-16da6e4a2009 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:41.799375 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2eb1c7e0-7ac5-49d8-8215-16da6e4a2009 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:41.870112 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-2eb1c7e0-7ac5-49d8-8215-16da6e4a2009 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "GET /compute/v2.1/servers/600cbae0-3580-4e55-9577-33b7a08439ad/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.102863 Sep 14 09:22:41.876043 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2955/5884] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 14 09:22:41 2022] GET /compute/v2.1/servers/600cbae0-3580-4e55-9577-33b7a08439ad/os-volume_attachments => generated 197 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:22:42.444790 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b7c8eb0c-5386-4889-aeb6-0d131b00553e tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:42.447044 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b7c8eb0c-5386-4889-aeb6-0d131b00553e tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] [instance: 022379ab-af51-495a-bcef-11e43774a7b0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:22:42.463125 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b7c8eb0c-5386-4889-aeb6-0d131b00553e tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:42.463873 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b7c8eb0c-5386-4889-aeb6-0d131b00553e tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:42.464492 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b7c8eb0c-5386-4889-aeb6-0d131b00553e tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:42.465380 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b7c8eb0c-5386-4889-aeb6-0d131b00553e tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:42.466673 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b7c8eb0c-5386-4889-aeb6-0d131b00553e tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:42.469356 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b7c8eb0c-5386-4889-aeb6-0d131b00553e tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:42.708983 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b7c8eb0c-5386-4889-aeb6-0d131b00553e tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9568f2d3f644e409961ab34e8fa95cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8638ed7d7b3d4285b36865282b8caeab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:22:42.717781 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b7c8eb0c-5386-4889-aeb6-0d131b00553e tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] 10.222.0.60 "GET /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0" status: 200 len: 1676 microversion: 2.1 time: 0.286499 Sep 14 09:22:42.738890 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2930/5885] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:22:42 2022] GET /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0 => generated 1676 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:22:42.891333 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-0b2484d2-56f9-40b4-b705-bb50552a0e5e tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:42.893551 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-0b2484d2-56f9-40b4-b705-bb50552a0e5e tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 600cbae0-3580-4e55-9577-33b7a08439ad] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:22:42.936813 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0b2484d2-56f9-40b4-b705-bb50552a0e5e tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:42.937437 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0b2484d2-56f9-40b4-b705-bb50552a0e5e tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:42.938541 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0b2484d2-56f9-40b4-b705-bb50552a0e5e tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:42.939312 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0b2484d2-56f9-40b4-b705-bb50552a0e5e tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:42.939768 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0b2484d2-56f9-40b4-b705-bb50552a0e5e tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:42.947220 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0b2484d2-56f9-40b4-b705-bb50552a0e5e tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:42.987162 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-0b2484d2-56f9-40b4-b705-bb50552a0e5e tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "GET /compute/v2.1/servers/600cbae0-3580-4e55-9577-33b7a08439ad/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.102221 Sep 14 09:22:42.987474 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2956/5886] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 14 09:22:42 2022] GET /compute/v2.1/servers/600cbae0-3580-4e55-9577-33b7a08439ad/os-volume_attachments => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:22:43.754421 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e362c530-989c-4507-8426-7bf9e43bd1c2 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:43.755248 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e362c530-989c-4507-8426-7bf9e43bd1c2 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] [instance: 022379ab-af51-495a-bcef-11e43774a7b0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:22:43.773772 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e362c530-989c-4507-8426-7bf9e43bd1c2 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:43.774305 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e362c530-989c-4507-8426-7bf9e43bd1c2 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:43.774895 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e362c530-989c-4507-8426-7bf9e43bd1c2 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:43.779661 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e362c530-989c-4507-8426-7bf9e43bd1c2 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:43.780428 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e362c530-989c-4507-8426-7bf9e43bd1c2 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:43.784134 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e362c530-989c-4507-8426-7bf9e43bd1c2 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:43.999958 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-de1b3603-daf6-47bb-b5ee-b7111f1f51bd tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:44.003111 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-de1b3603-daf6-47bb-b5ee-b7111f1f51bd tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 600cbae0-3580-4e55-9577-33b7a08439ad] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:22:44.019796 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-de1b3603-daf6-47bb-b5ee-b7111f1f51bd tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:44.021382 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-de1b3603-daf6-47bb-b5ee-b7111f1f51bd tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:44.027737 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-de1b3603-daf6-47bb-b5ee-b7111f1f51bd tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:44.038225 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-de1b3603-daf6-47bb-b5ee-b7111f1f51bd tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:44.040025 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-de1b3603-daf6-47bb-b5ee-b7111f1f51bd tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:44.040703 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-de1b3603-daf6-47bb-b5ee-b7111f1f51bd tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:44.102956 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-de1b3603-daf6-47bb-b5ee-b7111f1f51bd tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "GET /compute/v2.1/servers/600cbae0-3580-4e55-9577-33b7a08439ad/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.107534 Sep 14 09:22:44.110853 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2957/5887] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 14 09:22:43 2022] GET /compute/v2.1/servers/600cbae0-3580-4e55-9577-33b7a08439ad/os-volume_attachments => generated 197 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:22:44.145580 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-e362c530-989c-4507-8426-7bf9e43bd1c2 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9568f2d3f644e409961ab34e8fa95cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8638ed7d7b3d4285b36865282b8caeab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:22:44.164291 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e362c530-989c-4507-8426-7bf9e43bd1c2 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] 10.222.0.60 "GET /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0" status: 200 len: 1676 microversion: 2.1 time: 0.422616 Sep 14 09:22:44.185341 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2931/5888] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:22:43 2022] GET /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0 => generated 1676 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:22:45.115420 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-5899c399-c36f-4352-b886-bfe6eeb39d60 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:45.117667 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-5899c399-c36f-4352-b886-bfe6eeb39d60 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 600cbae0-3580-4e55-9577-33b7a08439ad] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:22:45.133538 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5899c399-c36f-4352-b886-bfe6eeb39d60 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:45.134045 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5899c399-c36f-4352-b886-bfe6eeb39d60 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:45.134500 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5899c399-c36f-4352-b886-bfe6eeb39d60 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:45.135245 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5899c399-c36f-4352-b886-bfe6eeb39d60 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:45.135714 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5899c399-c36f-4352-b886-bfe6eeb39d60 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:45.136151 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5899c399-c36f-4352-b886-bfe6eeb39d60 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:45.193686 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-24609b1b-796a-48ad-a041-bd9f0cc3a45d tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:45.194300 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-24609b1b-796a-48ad-a041-bd9f0cc3a45d tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] [instance: 022379ab-af51-495a-bcef-11e43774a7b0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:22:45.204685 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-5899c399-c36f-4352-b886-bfe6eeb39d60 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "GET /compute/v2.1/servers/600cbae0-3580-4e55-9577-33b7a08439ad/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093161 Sep 14 09:22:45.206365 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-24609b1b-796a-48ad-a041-bd9f0cc3a45d tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:45.206365 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-24609b1b-796a-48ad-a041-bd9f0cc3a45d tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:45.208593 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-24609b1b-796a-48ad-a041-bd9f0cc3a45d tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:45.209299 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2958/5889] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 14 09:22:45 2022] GET /compute/v2.1/servers/600cbae0-3580-4e55-9577-33b7a08439ad/os-volume_attachments => generated 197 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:22:45.209855 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-24609b1b-796a-48ad-a041-bd9f0cc3a45d tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:45.210339 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-24609b1b-796a-48ad-a041-bd9f0cc3a45d tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:45.210783 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-24609b1b-796a-48ad-a041-bd9f0cc3a45d tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:45.479324 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-24609b1b-796a-48ad-a041-bd9f0cc3a45d tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9568f2d3f644e409961ab34e8fa95cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8638ed7d7b3d4285b36865282b8caeab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:22:45.490029 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-24609b1b-796a-48ad-a041-bd9f0cc3a45d tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] 10.222.0.60 "GET /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0" status: 200 len: 1676 microversion: 2.1 time: 0.301066 Sep 14 09:22:45.494171 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2932/5890] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:22:45 2022] GET /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0 => generated 1676 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:22:46.217300 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-0507868a-c3a5-48b6-bbe2-f9d5207e2b8e tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:46.219838 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-0507868a-c3a5-48b6-bbe2-f9d5207e2b8e tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 600cbae0-3580-4e55-9577-33b7a08439ad] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:22:46.233336 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0507868a-c3a5-48b6-bbe2-f9d5207e2b8e tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:46.233842 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0507868a-c3a5-48b6-bbe2-f9d5207e2b8e tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:46.234295 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0507868a-c3a5-48b6-bbe2-f9d5207e2b8e tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:46.236249 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0507868a-c3a5-48b6-bbe2-f9d5207e2b8e tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:46.239108 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0507868a-c3a5-48b6-bbe2-f9d5207e2b8e tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:46.242147 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0507868a-c3a5-48b6-bbe2-f9d5207e2b8e tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:46.309359 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-0507868a-c3a5-48b6-bbe2-f9d5207e2b8e tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "GET /compute/v2.1/servers/600cbae0-3580-4e55-9577-33b7a08439ad/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094141 Sep 14 09:22:46.314244 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2959/5891] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 14 09:22:46 2022] GET /compute/v2.1/servers/600cbae0-3580-4e55-9577-33b7a08439ad/os-volume_attachments => generated 197 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:22:46.519280 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-bb171904-a32f-4e89-82c7-d77d3db1663a tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:46.521213 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-bb171904-a32f-4e89-82c7-d77d3db1663a tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] [instance: 022379ab-af51-495a-bcef-11e43774a7b0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:22:46.542215 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bb171904-a32f-4e89-82c7-d77d3db1663a tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:46.550168 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bb171904-a32f-4e89-82c7-d77d3db1663a tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:46.552346 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bb171904-a32f-4e89-82c7-d77d3db1663a tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:46.553334 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bb171904-a32f-4e89-82c7-d77d3db1663a tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:46.560544 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bb171904-a32f-4e89-82c7-d77d3db1663a tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:46.566971 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bb171904-a32f-4e89-82c7-d77d3db1663a tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:46.859403 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-bb171904-a32f-4e89-82c7-d77d3db1663a tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9568f2d3f644e409961ab34e8fa95cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8638ed7d7b3d4285b36865282b8caeab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:22:46.871026 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-bb171904-a32f-4e89-82c7-d77d3db1663a tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] 10.222.0.60 "GET /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0" status: 200 len: 1676 microversion: 2.1 time: 0.357774 Sep 14 09:22:46.872163 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2933/5892] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:22:46 2022] GET /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0 => generated 1676 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:22:47.327171 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-bf9dbf09-16e3-47ae-a6d3-d17ddf39c1e0 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:47.330127 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-bf9dbf09-16e3-47ae-a6d3-d17ddf39c1e0 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 600cbae0-3580-4e55-9577-33b7a08439ad] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:22:47.346870 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bf9dbf09-16e3-47ae-a6d3-d17ddf39c1e0 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:47.349626 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bf9dbf09-16e3-47ae-a6d3-d17ddf39c1e0 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:47.351578 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bf9dbf09-16e3-47ae-a6d3-d17ddf39c1e0 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:47.352575 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bf9dbf09-16e3-47ae-a6d3-d17ddf39c1e0 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:47.354478 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bf9dbf09-16e3-47ae-a6d3-d17ddf39c1e0 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:47.355538 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bf9dbf09-16e3-47ae-a6d3-d17ddf39c1e0 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:47.429474 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-bf9dbf09-16e3-47ae-a6d3-d17ddf39c1e0 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "GET /compute/v2.1/servers/600cbae0-3580-4e55-9577-33b7a08439ad/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.107328 Sep 14 09:22:47.430449 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2960/5893] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 14 09:22:47 2022] GET /compute/v2.1/servers/600cbae0-3580-4e55-9577-33b7a08439ad/os-volume_attachments => generated 197 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:22:47.900433 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-062509e7-2b3b-43e1-9766-352d036b13fe tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:47.901134 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-062509e7-2b3b-43e1-9766-352d036b13fe tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] [instance: 022379ab-af51-495a-bcef-11e43774a7b0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:22:47.923225 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-062509e7-2b3b-43e1-9766-352d036b13fe tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:47.942018 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-062509e7-2b3b-43e1-9766-352d036b13fe tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:47.944141 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-062509e7-2b3b-43e1-9766-352d036b13fe tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:47.953725 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-062509e7-2b3b-43e1-9766-352d036b13fe tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:47.961662 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-062509e7-2b3b-43e1-9766-352d036b13fe tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:47.962148 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-062509e7-2b3b-43e1-9766-352d036b13fe tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:48.441950 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-7656ceda-4eac-42c5-9842-83c0634d24dc tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:48.444318 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-7656ceda-4eac-42c5-9842-83c0634d24dc tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 600cbae0-3580-4e55-9577-33b7a08439ad] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:22:48.458458 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7656ceda-4eac-42c5-9842-83c0634d24dc tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:48.461449 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7656ceda-4eac-42c5-9842-83c0634d24dc tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:48.463998 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7656ceda-4eac-42c5-9842-83c0634d24dc tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:48.465544 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7656ceda-4eac-42c5-9842-83c0634d24dc tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:48.468510 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7656ceda-4eac-42c5-9842-83c0634d24dc tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:48.468992 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7656ceda-4eac-42c5-9842-83c0634d24dc tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:48.566297 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-7656ceda-4eac-42c5-9842-83c0634d24dc tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "GET /compute/v2.1/servers/600cbae0-3580-4e55-9577-33b7a08439ad/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.113046 Sep 14 09:22:48.578158 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2961/5894] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 14 09:22:48 2022] GET /compute/v2.1/servers/600cbae0-3580-4e55-9577-33b7a08439ad/os-volume_attachments => generated 25 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 09:22:48.771738 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-97e9eb68-d9d4-42e6-8217-24efe865a5ac tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:22:48.774447 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-97e9eb68-d9d4-42e6-8217-24efe865a5ac tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 3c2f5d0d-16a5-4f33-8f02-a84296eb09ef] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:22:48.784957 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-062509e7-2b3b-43e1-9766-352d036b13fe tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9568f2d3f644e409961ab34e8fa95cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8638ed7d7b3d4285b36865282b8caeab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:22:48.786403 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-97e9eb68-d9d4-42e6-8217-24efe865a5ac tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:48.788919 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-97e9eb68-d9d4-42e6-8217-24efe865a5ac tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:48.789595 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-97e9eb68-d9d4-42e6-8217-24efe865a5ac tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:48.792251 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-97e9eb68-d9d4-42e6-8217-24efe865a5ac tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:48.793011 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-97e9eb68-d9d4-42e6-8217-24efe865a5ac tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:48.795768 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-97e9eb68-d9d4-42e6-8217-24efe865a5ac tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:48.796826 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-062509e7-2b3b-43e1-9766-352d036b13fe tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] 10.222.0.60 "GET /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0" status: 200 len: 1676 microversion: 2.1 time: 0.897183 Sep 14 09:22:48.798396 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2934/5895] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:22:47 2022] GET /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0 => generated 1676 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:22:48.860717 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-97e9eb68-d9d4-42e6-8217-24efe865a5ac tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] HTTP exception thrown: Cannot 'reboot' instance 3c2f5d0d-16a5-4f33-8f02-a84296eb09ef while it is in vm_state rescued Sep 14 09:22:48.871839 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-97e9eb68-d9d4-42e6-8217-24efe865a5ac tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Request method failure captured: Sep 14 09:22:48.871839 n-d-836830-18 devstack@n-api.service[128758]: request: POST /compute/v2.1/servers/3c2f5d0d-16a5-4f33-8f02-a84296eb09ef/action HTTP/1.1 Sep 14 09:22:48.871839 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 09:22:48.871839 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 09:22:48.871839 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 09:22:48.871839 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 28 Sep 14 09:22:48.871839 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 09:22:48.871839 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 09:22:48.871839 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 09:22:48.871839 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 09:22:48.871839 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZwTx_6je2Mw19l1lk1T0KIWHROT3f4iq0u8_a7vTqyoq1BZh-ur0UF5KgJJeIlC54HlZaHspjBV72bT6ijQhdvPr0BCEmv-eUjjBTB_inJvaG7XMCMIoIIz39iqAFnj3jFdepR5dS7_uhYCyzmsUFKn1SkfeR8JmAZc_qs5ymrt_EA Sep 14 09:22:48.871839 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 09:22:48.871839 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 09:22:48.871839 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 09:22:48.871839 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 09:22:48.871839 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 09:22:48.871839 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 09:22:48.871839 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 229e11b3c1fe48b088d0f3c4bb7e2cb6 Sep 14 09:22:48.871839 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2043241234 Sep 14 09:22:48.871839 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 09:22:48.871839 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 09:22:48.871839 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/229e11b3c1fe48b088d0f3c4bb7e2cb6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_229e11b3c1fe48b088d0f3c4bb7e2cb6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/229e11b3c1fe48b088d0f3c4bb7e2cb6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/229e11b3c1fe48b088d0f3c4bb7e2cb6"}]}] Sep 14 09:22:48.871839 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2043241234 Sep 14 09:22:48.871839 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 229e11b3c1fe48b088d0f3c4bb7e2cb6 Sep 14 09:22:48.871839 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2043241234 Sep 14 09:22:48.871839 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-ServerRescueNegativeTestJSON-2043241234-project Sep 14 09:22:48.871839 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 09:22:48.871839 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 09:22:48.871839 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: d03dc827647f4483beb2e1b7888be608 Sep 14 09:22:48.871839 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2043241234-project Sep 14 09:22:48.871839 n-d-836830-18 devstack@n-api.service[128758]: Sep 14 09:22:48.871839 n-d-836830-18 devstack@n-api.service[128758]: {"reboot": {"type": "HARD"}} Sep 14 09:22:48.871839 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 09:22:48.871839 n-d-836830-18 devstack@n-api.service[128758]: exception: Cannot 'reboot' instance 3c2f5d0d-16a5-4f33-8f02-a84296eb09ef while it is in vm_state rescued Sep 14 09:22:48.871839 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': '3c2f5d0d-16a5-4f33-8f02-a84296eb09ef', 'body': {'reboot': {'type': 'HARD'}}} Sep 14 09:22:48.871839 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:22:48.871839 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:22:48.871839 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Sep 14 09:22:48.871839 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Sep 14 09:22:48.871839 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 14 09:22:48.871839 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 14 09:22:48.871839 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3552, in reboot Sep 14 09:22:48.871839 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Sep 14 09:22:48.871839 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 14 09:22:48.871839 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 14 09:22:48.871839 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 3c2f5d0d-16a5-4f33-8f02-a84296eb09ef in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Sep 14 09:22:48.871839 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:22:48.871839 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:22:48.871839 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:22:48.871839 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:22:48.871839 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:22:48.871839 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:22:48.871839 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:22:48.871839 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:22:48.871839 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:22:48.871839 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:22:48.871839 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:22:48.871839 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:22:48.871839 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Sep 14 09:22:48.871839 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 14 09:22:48.871839 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 14 09:22:48.871839 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 14 09:22:48.882126 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance 3c2f5d0d-16a5-4f33-8f02-a84296eb09ef while it is in vm_state rescued Sep 14 09:22:48.882126 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:22:48.882126 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:22:48.882126 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:22:48.882126 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:22:48.882126 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:22:48.882126 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:22:48.882126 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:22:48.882126 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:22:48.882126 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance 3c2f5d0d-16a5-4f33-8f02-a84296eb09ef while it is in vm_state rescued Sep 14 09:22:48.882126 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:22:48.882126 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-97e9eb68-d9d4-42e6-8217-24efe865a5ac tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Returning 409 to user: Cannot 'reboot' instance 3c2f5d0d-16a5-4f33-8f02-a84296eb09ef while it is in vm_state rescued {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:22:48.882126 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-97e9eb68-d9d4-42e6-8217-24efe865a5ac tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "POST /compute/v2.1/servers/3c2f5d0d-16a5-4f33-8f02-a84296eb09ef/action" status: 409 len: 145 microversion: 2.1 time: 0.115118 Sep 14 09:22:48.882126 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2962/5896] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:22:48 2022] POST /compute/v2.1/servers/3c2f5d0d-16a5-4f33-8f02-a84296eb09ef/action => generated 145 bytes in 122 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Sep 14 09:22:48.887231 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-1df56c24-94a7-4ee2-b717-4d90e3bcfb6f tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:22:48.890967 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-1df56c24-94a7-4ee2-b717-4d90e3bcfb6f tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 3c2f5d0d-16a5-4f33-8f02-a84296eb09ef] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:22:48.910046 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1df56c24-94a7-4ee2-b717-4d90e3bcfb6f tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:48.910715 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1df56c24-94a7-4ee2-b717-4d90e3bcfb6f tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:48.910993 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1df56c24-94a7-4ee2-b717-4d90e3bcfb6f tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:48.917038 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1df56c24-94a7-4ee2-b717-4d90e3bcfb6f tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:48.917719 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1df56c24-94a7-4ee2-b717-4d90e3bcfb6f tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:48.920329 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1df56c24-94a7-4ee2-b717-4d90e3bcfb6f tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:48.971803 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-1df56c24-94a7-4ee2-b717-4d90e3bcfb6f tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] HTTP exception thrown: Cannot 'rebuild' instance 3c2f5d0d-16a5-4f33-8f02-a84296eb09ef while it is in vm_state rescued Sep 14 09:22:48.973916 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-1df56c24-94a7-4ee2-b717-4d90e3bcfb6f tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Request method failure captured: Sep 14 09:22:48.973916 n-d-836830-18 devstack@n-api.service[128759]: request: POST /compute/v2.1/servers/3c2f5d0d-16a5-4f33-8f02-a84296eb09ef/action HTTP/1.1 Sep 14 09:22:48.973916 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:22:48.973916 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:22:48.973916 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:22:48.973916 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 65 Sep 14 09:22:48.973916 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:22:48.973916 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:22:48.973916 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:22:48.973916 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:22:48.973916 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZwTx_6je2Mw19l1lk1T0KIWHROT3f4iq0u8_a7vTqyoq1BZh-ur0UF5KgJJeIlC54HlZaHspjBV72bT6ijQhdvPr0BCEmv-eUjjBTB_inJvaG7XMCMIoIIz39iqAFnj3jFdepR5dS7_uhYCyzmsUFKn1SkfeR8JmAZc_qs5ymrt_EA Sep 14 09:22:48.973916 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:22:48.973916 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:22:48.973916 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:22:48.973916 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:22:48.973916 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:22:48.973916 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:22:48.973916 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 229e11b3c1fe48b088d0f3c4bb7e2cb6 Sep 14 09:22:48.973916 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2043241234 Sep 14 09:22:48.973916 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:22:48.973916 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:22:48.973916 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/229e11b3c1fe48b088d0f3c4bb7e2cb6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_229e11b3c1fe48b088d0f3c4bb7e2cb6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/229e11b3c1fe48b088d0f3c4bb7e2cb6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/229e11b3c1fe48b088d0f3c4bb7e2cb6"}]}] Sep 14 09:22:48.973916 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2043241234 Sep 14 09:22:48.973916 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 229e11b3c1fe48b088d0f3c4bb7e2cb6 Sep 14 09:22:48.973916 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2043241234 Sep 14 09:22:48.973916 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ServerRescueNegativeTestJSON-2043241234-project Sep 14 09:22:48.973916 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:22:48.973916 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:22:48.973916 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: d03dc827647f4483beb2e1b7888be608 Sep 14 09:22:48.973916 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2043241234-project Sep 14 09:22:48.973916 n-d-836830-18 devstack@n-api.service[128759]: Sep 14 09:22:48.973916 n-d-836830-18 devstack@n-api.service[128759]: {"rebuild": {"imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9"}} Sep 14 09:22:48.973916 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:22:48.973916 n-d-836830-18 devstack@n-api.service[128759]: exception: Cannot 'rebuild' instance 3c2f5d0d-16a5-4f33-8f02-a84296eb09ef while it is in vm_state rescued Sep 14 09:22:48.973916 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '3c2f5d0d-16a5-4f33-8f02-a84296eb09ef', 'body': {'rebuild': {'imageRef': 'bff4ab7f-4846-441f-8940-d96fec4c28e9'}}} Sep 14 09:22:48.973916 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:22:48.973916 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:22:48.973916 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1223, in _action_rebuild Sep 14 09:22:48.973916 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Sep 14 09:22:48.973916 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Sep 14 09:22:48.973916 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 14 09:22:48.973916 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 14 09:22:48.973916 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 14 09:22:48.973916 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 14 09:22:48.973916 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 14 09:22:48.973916 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 14 09:22:48.973916 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 14 09:22:48.973916 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 3c2f5d0d-16a5-4f33-8f02-a84296eb09ef in vm_state rescued. Cannot rebuild while the instance is in this state. Sep 14 09:22:48.973916 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:22:48.973916 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:22:48.973916 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:22:48.973916 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:22:48.973916 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:22:48.973916 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:22:48.973916 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:22:48.973916 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:22:48.973916 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:22:48.973916 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:22:48.973916 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:22:48.973916 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:22:48.973916 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:22:48.973916 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:22:48.973916 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:22:48.979814 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:22:48.979814 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Sep 14 09:22:48.979814 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1231, in _action_rebuild Sep 14 09:22:48.979814 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 14 09:22:48.979814 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 14 09:22:48.979814 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 14 09:22:48.979814 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance 3c2f5d0d-16a5-4f33-8f02-a84296eb09ef while it is in vm_state rescued Sep 14 09:22:48.979814 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:22:48.979814 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:22:48.979814 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:22:48.979814 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:22:48.979814 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:22:48.979814 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:22:48.979814 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:22:48.979814 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:22:48.979814 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance 3c2f5d0d-16a5-4f33-8f02-a84296eb09ef while it is in vm_state rescued Sep 14 09:22:48.979814 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:22:48.983133 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-1df56c24-94a7-4ee2-b717-4d90e3bcfb6f tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Returning 409 to user: Cannot 'rebuild' instance 3c2f5d0d-16a5-4f33-8f02-a84296eb09ef while it is in vm_state rescued {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:22:48.984224 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-1df56c24-94a7-4ee2-b717-4d90e3bcfb6f tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "POST /compute/v2.1/servers/3c2f5d0d-16a5-4f33-8f02-a84296eb09ef/action" status: 409 len: 146 microversion: 2.1 time: 0.101539 Sep 14 09:22:48.985408 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2935/5897] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:22:48 2022] POST /compute/v2.1/servers/3c2f5d0d-16a5-4f33-8f02-a84296eb09ef/action => generated 146 bytes in 103 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 14 09:22:48.994564 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a0ac0650-014b-48a9-8eb5-ef1301166208 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:48.995113 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-a0ac0650-014b-48a9-8eb5-ef1301166208 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 600cbae0-3580-4e55-9577-33b7a08439ad] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:22:49.004595 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a0ac0650-014b-48a9-8eb5-ef1301166208 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:49.005096 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a0ac0650-014b-48a9-8eb5-ef1301166208 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:49.005544 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a0ac0650-014b-48a9-8eb5-ef1301166208 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:49.006264 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a0ac0650-014b-48a9-8eb5-ef1301166208 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:49.006718 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a0ac0650-014b-48a9-8eb5-ef1301166208 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:49.012141 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a0ac0650-014b-48a9-8eb5-ef1301166208 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:49.088685 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-a0ac0650-014b-48a9-8eb5-ef1301166208 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 600cbae0-3580-4e55-9577-33b7a08439ad] Going to try to terminate instance {{(pid=128758) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:22:49.144712 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:22:49.277095 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-a0ac0650-014b-48a9-8eb5-ef1301166208 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "DELETE /compute/v2.1/servers/600cbae0-3580-4e55-9577-33b7a08439ad" status: 204 len: 0 microversion: 2.1 time: 0.284720 Sep 14 09:22:49.282215 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2963/5898] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:22:48 2022] DELETE /compute/v2.1/servers/600cbae0-3580-4e55-9577-33b7a08439ad => generated 0 bytes in 290 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:22:49.288809 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-6c8eee39-897c-4bb8-867b-31520f12dc8a tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:49.289717 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-6c8eee39-897c-4bb8-867b-31520f12dc8a tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 600cbae0-3580-4e55-9577-33b7a08439ad] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:22:49.298803 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6c8eee39-897c-4bb8-867b-31520f12dc8a tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:49.303551 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6c8eee39-897c-4bb8-867b-31520f12dc8a tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:49.304038 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6c8eee39-897c-4bb8-867b-31520f12dc8a tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:49.304897 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6c8eee39-897c-4bb8-867b-31520f12dc8a tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:49.305300 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6c8eee39-897c-4bb8-867b-31520f12dc8a tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:49.305738 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6c8eee39-897c-4bb8-867b-31520f12dc8a tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:49.827847 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-32b9f7f2-095b-4ed4-ac0d-3c25b088a1fd tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:49.829215 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-32b9f7f2-095b-4ed4-ac0d-3c25b088a1fd tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] [instance: 022379ab-af51-495a-bcef-11e43774a7b0] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:22:49.848662 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-32b9f7f2-095b-4ed4-ac0d-3c25b088a1fd tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:49.849173 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-32b9f7f2-095b-4ed4-ac0d-3c25b088a1fd tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:49.866269 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-32b9f7f2-095b-4ed4-ac0d-3c25b088a1fd tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:49.867729 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-32b9f7f2-095b-4ed4-ac0d-3c25b088a1fd tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:49.872888 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-32b9f7f2-095b-4ed4-ac0d-3c25b088a1fd tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:49.875084 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-32b9f7f2-095b-4ed4-ac0d-3c25b088a1fd tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:50.338594 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-32b9f7f2-095b-4ed4-ac0d-3c25b088a1fd tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9568f2d3f644e409961ab34e8fa95cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8638ed7d7b3d4285b36865282b8caeab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:22:50.347371 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-6c8eee39-897c-4bb8-867b-31520f12dc8a tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03dc827647f4483beb2e1b7888be608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229e11b3c1fe48b088d0f3c4bb7e2cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:22:50.351884 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-32b9f7f2-095b-4ed4-ac0d-3c25b088a1fd tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] 10.222.0.60 "GET /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0" status: 200 len: 1653 microversion: 2.1 time: 0.530003 Sep 14 09:22:50.358439 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-6c8eee39-897c-4bb8-867b-31520f12dc8a tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "GET /compute/v2.1/servers/600cbae0-3580-4e55-9577-33b7a08439ad" status: 200 len: 1690 microversion: 2.1 time: 1.074614 Sep 14 09:22:50.363289 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2936/5899] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:22:49 2022] GET /compute/v2.1/servers/600cbae0-3580-4e55-9577-33b7a08439ad => generated 1690 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:22:50.369107 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2964/5900] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:22:49 2022] GET /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0 => generated 1653 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:22:50.384873 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-7770ef34-8859-4c84-b612-ccfa5fb883e7 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:22:50.402218 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7770ef34-8859-4c84-b612-ccfa5fb883e7 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:50.407183 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7770ef34-8859-4c84-b612-ccfa5fb883e7 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:50.409052 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7770ef34-8859-4c84-b612-ccfa5fb883e7 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:50.478891 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-7770ef34-8859-4c84-b612-ccfa5fb883e7 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] [instance: 022379ab-af51-495a-bcef-11e43774a7b0] Going to try to start instance {{(pid=128759) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 14 09:22:50.614818 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-7770ef34-8859-4c84-b612-ccfa5fb883e7 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] 10.222.0.60 "POST /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0/action" status: 202 len: 0 microversion: 2.1 time: 0.240990 Sep 14 09:22:50.615515 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2937/5901] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:22:50 2022] POST /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0/action => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:22:50.625099 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-2183638c-7f78-4944-a2fd-28db79df98dd tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:50.626010 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-2183638c-7f78-4944-a2fd-28db79df98dd tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] [instance: 022379ab-af51-495a-bcef-11e43774a7b0] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:22:50.649871 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2183638c-7f78-4944-a2fd-28db79df98dd tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:50.650661 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2183638c-7f78-4944-a2fd-28db79df98dd tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:50.651361 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2183638c-7f78-4944-a2fd-28db79df98dd tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:50.652279 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2183638c-7f78-4944-a2fd-28db79df98dd tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:50.654010 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2183638c-7f78-4944-a2fd-28db79df98dd tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:50.654772 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2183638c-7f78-4944-a2fd-28db79df98dd tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:51.007671 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-2183638c-7f78-4944-a2fd-28db79df98dd tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9568f2d3f644e409961ab34e8fa95cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8638ed7d7b3d4285b36865282b8caeab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:22:51.024101 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-2183638c-7f78-4944-a2fd-28db79df98dd tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] 10.222.0.60 "GET /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0" status: 200 len: 1662 microversion: 2.1 time: 0.404012 Sep 14 09:22:51.025556 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2965/5902] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:22:50 2022] GET /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0 => generated 1662 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:22:51.248461 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ac64d4e2-07d0-40d5-9a8c-987d0a761df2 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:51.250385 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ac64d4e2-07d0-40d5-9a8c-987d0a761df2 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:51.250889 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ac64d4e2-07d0-40d5-9a8c-987d0a761df2 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:51.251418 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ac64d4e2-07d0-40d5-9a8c-987d0a761df2 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:51.252161 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ac64d4e2-07d0-40d5-9a8c-987d0a761df2 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:51.252623 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ac64d4e2-07d0-40d5-9a8c-987d0a761df2 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:51.253553 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ac64d4e2-07d0-40d5-9a8c-987d0a761df2 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:51.282000 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-ac64d4e2-07d0-40d5-9a8c-987d0a761df2 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] 10.222.0.60 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 615 microversion: 2.1 time: 0.172515 Sep 14 09:22:51.282505 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2938/5903] 10.222.0.60 () {58 vars in 1185 bytes} [Wed Sep 14 09:22:51 2022] GET /compute/v2.1/os-availability-zone/detail => generated 615 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:22:51.388315 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-6887b828-155d-4ee2-8d8c-7c7c39a6de2d tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:51.388980 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-6887b828-155d-4ee2-8d8c-7c7c39a6de2d tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 600cbae0-3580-4e55-9577-33b7a08439ad] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:22:51.399696 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6887b828-155d-4ee2-8d8c-7c7c39a6de2d tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:51.400342 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6887b828-155d-4ee2-8d8c-7c7c39a6de2d tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:51.400796 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6887b828-155d-4ee2-8d8c-7c7c39a6de2d tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:51.401631 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6887b828-155d-4ee2-8d8c-7c7c39a6de2d tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:51.402091 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6887b828-155d-4ee2-8d8c-7c7c39a6de2d tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:51.402891 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6887b828-155d-4ee2-8d8c-7c7c39a6de2d tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:51.445485 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3c776ce6-ecfa-4461-a027-849a4742ca40 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1927889816", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "availability_zone": "nova:n-h1-836830-18", "networks": [{"uuid": "f24216cd-7cf5-4afe-a428-e5985da0c632"}]}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:22:51.527442 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.network.neutron [None req-3c776ce6-ecfa-4461-a027-849a4742ca40 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] validate_networks() for [('f24216cd-7cf5-4afe-a428-e5985da0c632', None, None, None, None, None)] {{(pid=128759) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:22:51.630416 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-6887b828-155d-4ee2-8d8c-7c7c39a6de2d tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03dc827647f4483beb2e1b7888be608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229e11b3c1fe48b088d0f3c4bb7e2cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:22:51.639018 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-6887b828-155d-4ee2-8d8c-7c7c39a6de2d tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "GET /compute/v2.1/servers/600cbae0-3580-4e55-9577-33b7a08439ad" status: 200 len: 1690 microversion: 2.1 time: 0.254821 Sep 14 09:22:51.639681 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2966/5904] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:22:51 2022] GET /compute/v2.1/servers/600cbae0-3580-4e55-9577-33b7a08439ad => generated 1690 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:22:52.049890 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-bb299f6b-fdb9-428b-91f1-f7ffaaf55f24 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:52.050595 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-bb299f6b-fdb9-428b-91f1-f7ffaaf55f24 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] [instance: 022379ab-af51-495a-bcef-11e43774a7b0] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:22:52.058492 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bb299f6b-fdb9-428b-91f1-f7ffaaf55f24 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:52.059929 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bb299f6b-fdb9-428b-91f1-f7ffaaf55f24 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:52.060621 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bb299f6b-fdb9-428b-91f1-f7ffaaf55f24 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:52.061885 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bb299f6b-fdb9-428b-91f1-f7ffaaf55f24 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:52.062586 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bb299f6b-fdb9-428b-91f1-f7ffaaf55f24 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:52.063532 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bb299f6b-fdb9-428b-91f1-f7ffaaf55f24 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:52.289185 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-3c776ce6-ecfa-4461-a027-849a4742ca40 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Flavor limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:22:52.289742 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-3c776ce6-ecfa-4461-a027-849a4742ca40 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Image limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:22:52.290298 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-3c776ce6-ecfa-4461-a027-849a4742ca40 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Flavor pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:22:52.290894 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-3c776ce6-ecfa-4461-a027-849a4742ca40 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Image pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:22:52.291413 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-3c776ce6-ecfa-4461-a027-849a4742ca40 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:22:52.312849 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3c776ce6-ecfa-4461-a027-849a4742ca40 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:52.313752 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3c776ce6-ecfa-4461-a027-849a4742ca40 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:52.315174 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3c776ce6-ecfa-4461-a027-849a4742ca40 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:52.316176 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3c776ce6-ecfa-4461-a027-849a4742ca40 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:52.317653 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3c776ce6-ecfa-4461-a027-849a4742ca40 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:52.318453 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3c776ce6-ecfa-4461-a027-849a4742ca40 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:52.347512 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-bb299f6b-fdb9-428b-91f1-f7ffaaf55f24 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9568f2d3f644e409961ab34e8fa95cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8638ed7d7b3d4285b36865282b8caeab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:22:52.358683 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-3c776ce6-ecfa-4461-a027-849a4742ca40 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Getting quotas for project 14a09c3de89348238ba73b14d4821203. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:22:52.359873 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-bb299f6b-fdb9-428b-91f1-f7ffaaf55f24 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] 10.222.0.60 "GET /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0" status: 200 len: 1662 microversion: 2.1 time: 0.313972 Sep 14 09:22:52.380977 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2967/5905] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:22:52 2022] GET /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0 => generated 1662 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:22:52.384298 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-3c776ce6-ecfa-4461-a027-849a4742ca40 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Getting quotas for user ab7bff910aa44aa3a2c18a48893147a0 and project 14a09c3de89348238ba73b14d4821203. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:22:52.400053 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-3c776ce6-ecfa-4461-a027-849a4742ca40 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Going to run 1 instances... {{(pid=128759) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:22:52.403830 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-3c776ce6-ecfa-4461-a027-849a4742ca40 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] [instance: 59078c54-87eb-46f8-8aec-fdfa0056e0d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128759) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:22:52.487294 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-3c776ce6-ecfa-4461-a027-849a4742ca40 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.045527 Sep 14 09:22:52.492003 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2939/5906] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 09:22:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1051 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 14 09:22:52.504097 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ae237926-19ac-47a7-abb7-781663ba8c7a tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:52.505047 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-ae237926-19ac-47a7-abb7-781663ba8c7a tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] [instance: 59078c54-87eb-46f8-8aec-fdfa0056e0d3] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:22:52.629302 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-ae237926-19ac-47a7-abb7-781663ba8c7a tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/59078c54-87eb-46f8-8aec-fdfa0056e0d3" status: 200 len: 1329 microversion: 2.1 time: 0.129828 Sep 14 09:22:52.643677 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2968/5907] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:22:52 2022] GET /compute/v2.1/servers/59078c54-87eb-46f8-8aec-fdfa0056e0d3 => generated 1329 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:22:52.662831 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-cfa5c16d-82c6-4e50-b02a-e52499798970 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:52.663501 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-cfa5c16d-82c6-4e50-b02a-e52499798970 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 600cbae0-3580-4e55-9577-33b7a08439ad] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:22:52.674334 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cfa5c16d-82c6-4e50-b02a-e52499798970 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:52.674871 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cfa5c16d-82c6-4e50-b02a-e52499798970 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:52.675361 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cfa5c16d-82c6-4e50-b02a-e52499798970 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:52.676102 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cfa5c16d-82c6-4e50-b02a-e52499798970 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:52.676572 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cfa5c16d-82c6-4e50-b02a-e52499798970 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:52.677009 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cfa5c16d-82c6-4e50-b02a-e52499798970 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:52.729255 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:22:53.347396 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-cfa5c16d-82c6-4e50-b02a-e52499798970 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03dc827647f4483beb2e1b7888be608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229e11b3c1fe48b088d0f3c4bb7e2cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:22:53.347396 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-cfa5c16d-82c6-4e50-b02a-e52499798970 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "GET /compute/v2.1/servers/600cbae0-3580-4e55-9577-33b7a08439ad" status: 200 len: 1690 microversion: 2.1 time: 0.659254 Sep 14 09:22:53.347396 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2940/5908] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:22:52 2022] GET /compute/v2.1/servers/600cbae0-3580-4e55-9577-33b7a08439ad => generated 1690 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:22:53.401475 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-031cb8ed-5f1d-45c9-942e-bab0d3570494 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:53.402254 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-031cb8ed-5f1d-45c9-942e-bab0d3570494 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] [instance: 022379ab-af51-495a-bcef-11e43774a7b0] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:22:53.422563 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-031cb8ed-5f1d-45c9-942e-bab0d3570494 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:53.424570 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-031cb8ed-5f1d-45c9-942e-bab0d3570494 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:53.426124 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-031cb8ed-5f1d-45c9-942e-bab0d3570494 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:53.447044 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-031cb8ed-5f1d-45c9-942e-bab0d3570494 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:53.447566 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-031cb8ed-5f1d-45c9-942e-bab0d3570494 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:53.448177 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-031cb8ed-5f1d-45c9-942e-bab0d3570494 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:53.658587 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b9098886-44a5-44c0-9f64-c4e42cd9c7e0 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:53.661848 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b9098886-44a5-44c0-9f64-c4e42cd9c7e0 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] [instance: 59078c54-87eb-46f8-8aec-fdfa0056e0d3] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:22:53.688777 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b9098886-44a5-44c0-9f64-c4e42cd9c7e0 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:53.690119 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b9098886-44a5-44c0-9f64-c4e42cd9c7e0 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:53.693591 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b9098886-44a5-44c0-9f64-c4e42cd9c7e0 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:53.695050 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b9098886-44a5-44c0-9f64-c4e42cd9c7e0 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:53.696380 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b9098886-44a5-44c0-9f64-c4e42cd9c7e0 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:53.697071 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b9098886-44a5-44c0-9f64-c4e42cd9c7e0 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:53.981525 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b9098886-44a5-44c0-9f64-c4e42cd9c7e0 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/59078c54-87eb-46f8-8aec-fdfa0056e0d3" status: 200 len: 1338 microversion: 2.1 time: 0.326591 Sep 14 09:22:53.982460 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2941/5909] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:22:53 2022] GET /compute/v2.1/servers/59078c54-87eb-46f8-8aec-fdfa0056e0d3 => generated 1338 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:22:54.024280 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-031cb8ed-5f1d-45c9-942e-bab0d3570494 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9568f2d3f644e409961ab34e8fa95cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8638ed7d7b3d4285b36865282b8caeab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:22:54.038620 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-031cb8ed-5f1d-45c9-942e-bab0d3570494 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] 10.222.0.60 "GET /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0" status: 200 len: 1662 microversion: 2.1 time: 0.649318 Sep 14 09:22:54.041219 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2969/5910] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:22:53 2022] GET /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0 => generated 1662 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:22:54.343290 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ad9ccdf1-48ef-4d37-b2d0-a5d22e1fd73d tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:54.344603 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-ad9ccdf1-48ef-4d37-b2d0-a5d22e1fd73d tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 600cbae0-3580-4e55-9577-33b7a08439ad] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:22:54.356215 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ad9ccdf1-48ef-4d37-b2d0-a5d22e1fd73d tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:54.356724 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ad9ccdf1-48ef-4d37-b2d0-a5d22e1fd73d tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:54.357176 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ad9ccdf1-48ef-4d37-b2d0-a5d22e1fd73d tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:54.357896 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ad9ccdf1-48ef-4d37-b2d0-a5d22e1fd73d tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:54.358363 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ad9ccdf1-48ef-4d37-b2d0-a5d22e1fd73d tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:54.358794 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ad9ccdf1-48ef-4d37-b2d0-a5d22e1fd73d tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:54.477167 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-ad9ccdf1-48ef-4d37-b2d0-a5d22e1fd73d tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03dc827647f4483beb2e1b7888be608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229e11b3c1fe48b088d0f3c4bb7e2cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:22:54.489550 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-ad9ccdf1-48ef-4d37-b2d0-a5d22e1fd73d tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "GET /compute/v2.1/servers/600cbae0-3580-4e55-9577-33b7a08439ad" status: 200 len: 1622 microversion: 2.1 time: 0.151745 Sep 14 09:22:54.490340 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2942/5911] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:22:54 2022] GET /compute/v2.1/servers/600cbae0-3580-4e55-9577-33b7a08439ad => generated 1622 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:22:54.793433 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-1f3132d2-07a3-4d3c-8808-5a081f5cab9e req-b14cad73-3fe1-4c34-90e9-fa0b0e150a1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "600cbae0-3580-4e55-9577-33b7a08439ad", "name": "network-vif-deleted", "tag": "2ab6288f-9f5a-4572-8493-c7c83f0cc3e1"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:22:54.814899 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-1f3132d2-07a3-4d3c-8808-5a081f5cab9e req-b14cad73-3fe1-4c34-90e9-fa0b0e150a1f service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:54.823411 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-1f3132d2-07a3-4d3c-8808-5a081f5cab9e req-b14cad73-3fe1-4c34-90e9-fa0b0e150a1f service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:54.824180 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-1f3132d2-07a3-4d3c-8808-5a081f5cab9e req-b14cad73-3fe1-4c34-90e9-fa0b0e150a1f service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:54.872978 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-1f3132d2-07a3-4d3c-8808-5a081f5cab9e req-b14cad73-3fe1-4c34-90e9-fa0b0e150a1f service nova] Creating event network-vif-deleted:2ab6288f-9f5a-4572-8493-c7c83f0cc3e1 for instance 600cbae0-3580-4e55-9577-33b7a08439ad on n-h1-836830-18 Sep 14 09:22:54.886634 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-1f3132d2-07a3-4d3c-8808-5a081f5cab9e req-b14cad73-3fe1-4c34-90e9-fa0b0e150a1f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097944 Sep 14 09:22:54.895272 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2970/5912] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:22:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:22:55.009104 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-6ee84dc7-1fbf-4203-940c-8056b7aeb5c2 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:55.010534 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-6ee84dc7-1fbf-4203-940c-8056b7aeb5c2 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] [instance: 59078c54-87eb-46f8-8aec-fdfa0056e0d3] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:22:55.025292 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6ee84dc7-1fbf-4203-940c-8056b7aeb5c2 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:55.025884 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6ee84dc7-1fbf-4203-940c-8056b7aeb5c2 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:55.026411 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6ee84dc7-1fbf-4203-940c-8056b7aeb5c2 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:55.027234 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6ee84dc7-1fbf-4203-940c-8056b7aeb5c2 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:55.027822 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6ee84dc7-1fbf-4203-940c-8056b7aeb5c2 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:55.032307 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6ee84dc7-1fbf-4203-940c-8056b7aeb5c2 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:55.079977 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b69b5bf9-b8de-4a8a-959f-ab6c95187ea9 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:55.080727 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-b69b5bf9-b8de-4a8a-959f-ab6c95187ea9 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] [instance: 022379ab-af51-495a-bcef-11e43774a7b0] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:22:55.107501 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b69b5bf9-b8de-4a8a-959f-ab6c95187ea9 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:55.108034 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b69b5bf9-b8de-4a8a-959f-ab6c95187ea9 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:55.108499 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b69b5bf9-b8de-4a8a-959f-ab6c95187ea9 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:55.109251 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b69b5bf9-b8de-4a8a-959f-ab6c95187ea9 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:55.115924 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b69b5bf9-b8de-4a8a-959f-ab6c95187ea9 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:55.116438 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b69b5bf9-b8de-4a8a-959f-ab6c95187ea9 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:55.192950 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-6ee84dc7-1fbf-4203-940c-8056b7aeb5c2 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/59078c54-87eb-46f8-8aec-fdfa0056e0d3" status: 200 len: 1436 microversion: 2.1 time: 0.188076 Sep 14 09:22:55.207530 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2943/5913] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:22:55 2022] GET /compute/v2.1/servers/59078c54-87eb-46f8-8aec-fdfa0056e0d3 => generated 1436 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:22:55.520523 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-5b20b891-15d5-41e1-80db-5b28a135d77f tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:55.521277 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-5b20b891-15d5-41e1-80db-5b28a135d77f tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 600cbae0-3580-4e55-9577-33b7a08439ad] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:22:55.545190 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5b20b891-15d5-41e1-80db-5b28a135d77f tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:55.548727 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5b20b891-15d5-41e1-80db-5b28a135d77f tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:55.549974 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5b20b891-15d5-41e1-80db-5b28a135d77f tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:55.551792 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5b20b891-15d5-41e1-80db-5b28a135d77f tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:55.556593 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-b69b5bf9-b8de-4a8a-959f-ab6c95187ea9 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9568f2d3f644e409961ab34e8fa95cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8638ed7d7b3d4285b36865282b8caeab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:22:55.562484 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5b20b891-15d5-41e1-80db-5b28a135d77f tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:55.569311 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5b20b891-15d5-41e1-80db-5b28a135d77f tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:55.572859 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-b69b5bf9-b8de-4a8a-959f-ab6c95187ea9 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] 10.222.0.60 "GET /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0" status: 200 len: 1666 microversion: 2.1 time: 0.502197 Sep 14 09:22:55.580353 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2971/5914] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:22:55 2022] GET /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0 => generated 1666 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:22:55.662749 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5b20b891-15d5-41e1-80db-5b28a135d77f tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:55.664765 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5b20b891-15d5-41e1-80db-5b28a135d77f tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:55.666822 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5b20b891-15d5-41e1-80db-5b28a135d77f tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:55.667395 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.objects.instance [None req-5b20b891-15d5-41e1-80db-5b28a135d77f tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lazy-loading 'fault' on Instance uuid 600cbae0-3580-4e55-9577-33b7a08439ad {{(pid=128759) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:22:55.729321 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-5b20b891-15d5-41e1-80db-5b28a135d77f tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03dc827647f4483beb2e1b7888be608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229e11b3c1fe48b088d0f3c4bb7e2cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:22:55.740304 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-5b20b891-15d5-41e1-80db-5b28a135d77f tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "GET /compute/v2.1/servers/600cbae0-3580-4e55-9577-33b7a08439ad" status: 200 len: 1336 microversion: 2.1 time: 0.228693 Sep 14 09:22:55.771167 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2944/5915] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:22:55 2022] GET /compute/v2.1/servers/600cbae0-3580-4e55-9577-33b7a08439ad => generated 1336 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:22:56.220504 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-e42456d3-0ea4-49ca-980f-81ccb7048f12 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:56.221135 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-e42456d3-0ea4-49ca-980f-81ccb7048f12 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] [instance: 59078c54-87eb-46f8-8aec-fdfa0056e0d3] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:22:56.237763 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e42456d3-0ea4-49ca-980f-81ccb7048f12 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:56.238294 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e42456d3-0ea4-49ca-980f-81ccb7048f12 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:56.238759 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e42456d3-0ea4-49ca-980f-81ccb7048f12 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:56.239569 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e42456d3-0ea4-49ca-980f-81ccb7048f12 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:56.240047 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e42456d3-0ea4-49ca-980f-81ccb7048f12 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:56.240492 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e42456d3-0ea4-49ca-980f-81ccb7048f12 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:56.595409 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-e42456d3-0ea4-49ca-980f-81ccb7048f12 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/59078c54-87eb-46f8-8aec-fdfa0056e0d3" status: 200 len: 1466 microversion: 2.1 time: 0.378758 Sep 14 09:22:56.597616 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2972/5916] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:22:56 2022] GET /compute/v2.1/servers/59078c54-87eb-46f8-8aec-fdfa0056e0d3 => generated 1466 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:22:56.767959 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b55108a6-8140-4760-9b93-08be0972d1b0 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:56.768615 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b55108a6-8140-4760-9b93-08be0972d1b0 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 600cbae0-3580-4e55-9577-33b7a08439ad] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:22:56.781074 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b55108a6-8140-4760-9b93-08be0972d1b0 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:56.781591 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b55108a6-8140-4760-9b93-08be0972d1b0 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:56.782051 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b55108a6-8140-4760-9b93-08be0972d1b0 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:56.782786 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b55108a6-8140-4760-9b93-08be0972d1b0 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:56.783298 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b55108a6-8140-4760-9b93-08be0972d1b0 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:56.783740 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b55108a6-8140-4760-9b93-08be0972d1b0 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:56.817066 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-b55108a6-8140-4760-9b93-08be0972d1b0 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] HTTP exception thrown: Instance 600cbae0-3580-4e55-9577-33b7a08439ad could not be found. Sep 14 09:22:56.826050 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b55108a6-8140-4760-9b93-08be0972d1b0 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Request method failure captured: Sep 14 09:22:56.826050 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/600cbae0-3580-4e55-9577-33b7a08439ad HTTP/1.1 Sep 14 09:22:56.826050 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:22:56.826050 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:22:56.826050 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:22:56.826050 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:22:56.826050 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:22:56.826050 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:22:56.826050 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:22:56.826050 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:22:56.826050 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZwTx_6je2Mw19l1lk1T0KIWHROT3f4iq0u8_a7vTqyoq1BZh-ur0UF5KgJJeIlC54HlZaHspjBV72bT6ijQhdvPr0BCEmv-eUjjBTB_inJvaG7XMCMIoIIz39iqAFnj3jFdepR5dS7_uhYCyzmsUFKn1SkfeR8JmAZc_qs5ymrt_EA Sep 14 09:22:56.826050 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:22:56.826050 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:22:56.826050 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:22:56.826050 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:22:56.826050 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:22:56.826050 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:22:56.826050 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 229e11b3c1fe48b088d0f3c4bb7e2cb6 Sep 14 09:22:56.826050 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2043241234 Sep 14 09:22:56.826050 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:22:56.826050 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:22:56.826050 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/229e11b3c1fe48b088d0f3c4bb7e2cb6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_229e11b3c1fe48b088d0f3c4bb7e2cb6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/229e11b3c1fe48b088d0f3c4bb7e2cb6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/229e11b3c1fe48b088d0f3c4bb7e2cb6"}]}] Sep 14 09:22:56.826050 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2043241234 Sep 14 09:22:56.826050 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 229e11b3c1fe48b088d0f3c4bb7e2cb6 Sep 14 09:22:56.826050 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2043241234 Sep 14 09:22:56.826050 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ServerRescueNegativeTestJSON-2043241234-project Sep 14 09:22:56.826050 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:22:56.826050 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:22:56.826050 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: d03dc827647f4483beb2e1b7888be608 Sep 14 09:22:56.826050 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2043241234-project Sep 14 09:22:56.826050 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:22:56.826050 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance 600cbae0-3580-4e55-9577-33b7a08439ad could not be found. Sep 14 09:22:56.826050 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '600cbae0-3580-4e55-9577-33b7a08439ad'} Sep 14 09:22:56.826050 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:22:56.826050 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:22:56.826050 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:22:56.826050 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:22:56.826050 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:22:56.826050 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:22:56.826050 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:22:56.826050 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:22:56.826050 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:22:56.826050 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:22:56.826050 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 600cbae0-3580-4e55-9577-33b7a08439ad could not be found. Sep 14 09:22:56.826050 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:22:56.826050 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:22:56.826050 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:22:56.826050 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:22:56.826050 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:22:56.826050 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:22:56.826050 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:22:56.826050 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:22:56.826050 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:22:56.826050 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:22:56.826050 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:22:56.826050 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:22:56.826050 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:22:56.826050 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:22:56.826050 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:22:56.826050 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:22:56.826050 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 600cbae0-3580-4e55-9577-33b7a08439ad could not be found. Sep 14 09:22:56.826050 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:22:56.826050 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:22:56.833596 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:22:56.833596 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:22:56.833596 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:22:56.833596 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:22:56.833596 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:22:56.833596 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:22:56.833596 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 600cbae0-3580-4e55-9577-33b7a08439ad could not be found. Sep 14 09:22:56.833596 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:22:56.833596 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b55108a6-8140-4760-9b93-08be0972d1b0 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Returning 404 to user: Instance 600cbae0-3580-4e55-9577-33b7a08439ad could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:22:56.833596 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b55108a6-8140-4760-9b93-08be0972d1b0 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "GET /compute/v2.1/servers/600cbae0-3580-4e55-9577-33b7a08439ad" status: 404 len: 111 microversion: 2.1 time: 0.063702 Sep 14 09:22:56.837095 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2945/5917] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:22:56 2022] GET /compute/v2.1/servers/600cbae0-3580-4e55-9577-33b7a08439ad => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:22:56.845930 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-eae7532b-25b1-4925-ae02-a6c2e15247a6 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '.version_select at 0x7f7d4439a5e0>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:56.918365 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-eae7532b-25b1-4925-ae02-a6c2e15247a6 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1997239530" status: 202 len: 0 microversion: 2.1 time: 0.081350 Sep 14 09:22:56.921816 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2973/5918] 10.222.0.60 () {58 vars in 1221 bytes} [Wed Sep 14 09:22:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1997239530 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:22:57.634006 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-7858b43a-2f3d-426f-a6af-9b4396fd24fa tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:57.634902 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-7858b43a-2f3d-426f-a6af-9b4396fd24fa tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] [instance: 59078c54-87eb-46f8-8aec-fdfa0056e0d3] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:22:57.647763 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7858b43a-2f3d-426f-a6af-9b4396fd24fa tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:57.649204 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7858b43a-2f3d-426f-a6af-9b4396fd24fa tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:57.649849 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7858b43a-2f3d-426f-a6af-9b4396fd24fa tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:57.654919 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7858b43a-2f3d-426f-a6af-9b4396fd24fa tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:57.655436 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7858b43a-2f3d-426f-a6af-9b4396fd24fa tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:57.655890 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7858b43a-2f3d-426f-a6af-9b4396fd24fa tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:58.036003 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-7858b43a-2f3d-426f-a6af-9b4396fd24fa tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/59078c54-87eb-46f8-8aec-fdfa0056e0d3" status: 200 len: 1466 microversion: 2.1 time: 0.411295 Sep 14 09:22:58.043177 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2946/5919] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:22:57 2022] GET /compute/v2.1/servers/59078c54-87eb-46f8-8aec-fdfa0056e0d3 => generated 1466 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:22:58.205941 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-43e902ea-d285-4556-8436-a4ee261633da req-6934cfd1-48cd-4ff3-9d21-0b90d1450824 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59078c54-87eb-46f8-8aec-fdfa0056e0d3", "tag": "16c09bb8-02ef-4b6b-a646-8bd6ecc9aec7"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:22:58.232993 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-43e902ea-d285-4556-8436-a4ee261633da req-6934cfd1-48cd-4ff3-9d21-0b90d1450824 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:58.233795 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-43e902ea-d285-4556-8436-a4ee261633da req-6934cfd1-48cd-4ff3-9d21-0b90d1450824 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:58.234678 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-43e902ea-d285-4556-8436-a4ee261633da req-6934cfd1-48cd-4ff3-9d21-0b90d1450824 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:58.249771 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-43e902ea-d285-4556-8436-a4ee261633da req-6934cfd1-48cd-4ff3-9d21-0b90d1450824 service nova] Creating event network-changed:16c09bb8-02ef-4b6b-a646-8bd6ecc9aec7 for instance 59078c54-87eb-46f8-8aec-fdfa0056e0d3 on n-h1-836830-18 Sep 14 09:22:58.255126 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-43e902ea-d285-4556-8436-a4ee261633da req-6934cfd1-48cd-4ff3-9d21-0b90d1450824 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052689 Sep 14 09:22:58.256019 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2974/5920] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:22:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:22:59.069938 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c2044e7c-5492-4ade-b950-3bb65f1657b0 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:59.069938 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-c2044e7c-5492-4ade-b950-3bb65f1657b0 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] [instance: 59078c54-87eb-46f8-8aec-fdfa0056e0d3] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:22:59.106911 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c2044e7c-5492-4ade-b950-3bb65f1657b0 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:59.109151 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c2044e7c-5492-4ade-b950-3bb65f1657b0 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:59.110246 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c2044e7c-5492-4ade-b950-3bb65f1657b0 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:59.113103 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c2044e7c-5492-4ade-b950-3bb65f1657b0 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:59.113845 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c2044e7c-5492-4ade-b950-3bb65f1657b0 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:59.115665 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c2044e7c-5492-4ade-b950-3bb65f1657b0 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:59.290007 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-c2044e7c-5492-4ade-b950-3bb65f1657b0 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/59078c54-87eb-46f8-8aec-fdfa0056e0d3" status: 200 len: 1466 microversion: 2.1 time: 0.227634 Sep 14 09:22:59.306433 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2947/5921] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:22:59 2022] GET /compute/v2.1/servers/59078c54-87eb-46f8-8aec-fdfa0056e0d3 => generated 1466 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:23:00.317574 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-0d412afd-6a4f-4058-8ad2-d0b7829496a9 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:00.321417 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-0d412afd-6a4f-4058-8ad2-d0b7829496a9 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] [instance: 59078c54-87eb-46f8-8aec-fdfa0056e0d3] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:00.340878 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0d412afd-6a4f-4058-8ad2-d0b7829496a9 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:00.345395 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0d412afd-6a4f-4058-8ad2-d0b7829496a9 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:00.359900 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0d412afd-6a4f-4058-8ad2-d0b7829496a9 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:00.362435 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0d412afd-6a4f-4058-8ad2-d0b7829496a9 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:00.366211 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0d412afd-6a4f-4058-8ad2-d0b7829496a9 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:00.377327 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0d412afd-6a4f-4058-8ad2-d0b7829496a9 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:00.572305 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-0d412afd-6a4f-4058-8ad2-d0b7829496a9 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/59078c54-87eb-46f8-8aec-fdfa0056e0d3" status: 200 len: 1466 microversion: 2.1 time: 0.261749 Sep 14 09:23:00.573896 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2975/5922] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:23:00 2022] GET /compute/v2.1/servers/59078c54-87eb-46f8-8aec-fdfa0056e0d3 => generated 1466 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:23:01.608589 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-72510661-d167-49b9-a6c1-eaf56dfbb2c9 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:01.609444 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-72510661-d167-49b9-a6c1-eaf56dfbb2c9 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] [instance: 59078c54-87eb-46f8-8aec-fdfa0056e0d3] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:01.620416 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-72510661-d167-49b9-a6c1-eaf56dfbb2c9 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:01.620416 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-72510661-d167-49b9-a6c1-eaf56dfbb2c9 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:01.621055 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-72510661-d167-49b9-a6c1-eaf56dfbb2c9 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:01.622161 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-72510661-d167-49b9-a6c1-eaf56dfbb2c9 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:01.622772 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-72510661-d167-49b9-a6c1-eaf56dfbb2c9 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:01.623485 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-72510661-d167-49b9-a6c1-eaf56dfbb2c9 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:01.876283 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-72510661-d167-49b9-a6c1-eaf56dfbb2c9 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/59078c54-87eb-46f8-8aec-fdfa0056e0d3" status: 200 len: 1466 microversion: 2.1 time: 0.282295 Sep 14 09:23:01.877819 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2948/5923] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:23:01 2022] GET /compute/v2.1/servers/59078c54-87eb-46f8-8aec-fdfa0056e0d3 => generated 1466 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:23:02.905712 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-3d2b8849-054b-4fcd-9b9c-15c769ad22b5 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:02.907067 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-3d2b8849-054b-4fcd-9b9c-15c769ad22b5 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] [instance: 59078c54-87eb-46f8-8aec-fdfa0056e0d3] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:02.912423 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=2 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:23:02.920549 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3d2b8849-054b-4fcd-9b9c-15c769ad22b5 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:02.921734 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3d2b8849-054b-4fcd-9b9c-15c769ad22b5 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:02.922296 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3d2b8849-054b-4fcd-9b9c-15c769ad22b5 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:02.923292 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3d2b8849-054b-4fcd-9b9c-15c769ad22b5 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:02.923924 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3d2b8849-054b-4fcd-9b9c-15c769ad22b5 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:02.924612 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3d2b8849-054b-4fcd-9b9c-15c769ad22b5 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:03.106132 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-3d2b8849-054b-4fcd-9b9c-15c769ad22b5 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/59078c54-87eb-46f8-8aec-fdfa0056e0d3" status: 200 len: 1466 microversion: 2.1 time: 0.205750 Sep 14 09:23:03.106896 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2976/5924] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:23:02 2022] GET /compute/v2.1/servers/59078c54-87eb-46f8-8aec-fdfa0056e0d3 => generated 1466 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:23:04.130707 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-407ed3ec-5f14-4375-a39d-756b77646498 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:04.132212 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-407ed3ec-5f14-4375-a39d-756b77646498 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] [instance: 59078c54-87eb-46f8-8aec-fdfa0056e0d3] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:04.135703 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=4 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:23:04.136382 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=6 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:23:04.139661 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=3 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:23:04.144809 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-407ed3ec-5f14-4375-a39d-756b77646498 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:04.145614 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-407ed3ec-5f14-4375-a39d-756b77646498 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:04.146286 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-407ed3ec-5f14-4375-a39d-756b77646498 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:04.147412 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-407ed3ec-5f14-4375-a39d-756b77646498 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:04.148106 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-407ed3ec-5f14-4375-a39d-756b77646498 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:04.148720 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-407ed3ec-5f14-4375-a39d-756b77646498 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:04.261662 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-3aa235d2-e9b1-4ac1-b8fb-d709ba35dc2c req-0060851b-4c7f-4aa9-be66-f18a6520c3e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59078c54-87eb-46f8-8aec-fdfa0056e0d3", "name": "network-vif-plugged", "status": "completed", "tag": "16c09bb8-02ef-4b6b-a646-8bd6ecc9aec7"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:23:04.302680 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-3aa235d2-e9b1-4ac1-b8fb-d709ba35dc2c req-0060851b-4c7f-4aa9-be66-f18a6520c3e9 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:04.303609 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-3aa235d2-e9b1-4ac1-b8fb-d709ba35dc2c req-0060851b-4c7f-4aa9-be66-f18a6520c3e9 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:04.304519 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-3aa235d2-e9b1-4ac1-b8fb-d709ba35dc2c req-0060851b-4c7f-4aa9-be66-f18a6520c3e9 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:04.306476 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-407ed3ec-5f14-4375-a39d-756b77646498 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/59078c54-87eb-46f8-8aec-fdfa0056e0d3" status: 200 len: 1466 microversion: 2.1 time: 0.180587 Sep 14 09:23:04.314981 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2949/5925] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:23:04 2022] GET /compute/v2.1/servers/59078c54-87eb-46f8-8aec-fdfa0056e0d3 => generated 1466 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:23:04.341635 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-3aa235d2-e9b1-4ac1-b8fb-d709ba35dc2c req-0060851b-4c7f-4aa9-be66-f18a6520c3e9 service nova] Creating event network-vif-plugged:16c09bb8-02ef-4b6b-a646-8bd6ecc9aec7 for instance 59078c54-87eb-46f8-8aec-fdfa0056e0d3 on n-h1-836830-18 Sep 14 09:23:04.347959 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-3aa235d2-e9b1-4ac1-b8fb-d709ba35dc2c req-0060851b-4c7f-4aa9-be66-f18a6520c3e9 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088915 Sep 14 09:23:04.349204 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2977/5926] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:23:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:23:05.337078 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c9f47d0b-70da-4eb0-9d0a-2e4a5f7b9cde tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:05.337746 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-c9f47d0b-70da-4eb0-9d0a-2e4a5f7b9cde tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] [instance: 59078c54-87eb-46f8-8aec-fdfa0056e0d3] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:05.345434 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c9f47d0b-70da-4eb0-9d0a-2e4a5f7b9cde tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:05.345937 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c9f47d0b-70da-4eb0-9d0a-2e4a5f7b9cde tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:05.346386 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c9f47d0b-70da-4eb0-9d0a-2e4a5f7b9cde tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:05.347130 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c9f47d0b-70da-4eb0-9d0a-2e4a5f7b9cde tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:05.347598 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c9f47d0b-70da-4eb0-9d0a-2e4a5f7b9cde tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:05.348752 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c9f47d0b-70da-4eb0-9d0a-2e4a5f7b9cde tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:05.528926 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-c9f47d0b-70da-4eb0-9d0a-2e4a5f7b9cde tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/59078c54-87eb-46f8-8aec-fdfa0056e0d3" status: 200 len: 1466 microversion: 2.1 time: 0.202252 Sep 14 09:23:05.540128 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2950/5927] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:23:05 2022] GET /compute/v2.1/servers/59078c54-87eb-46f8-8aec-fdfa0056e0d3 => generated 1466 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:23:06.554792 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-3f9f8822-6268-411f-9f5d-1304cb2f2d89 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:06.556237 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-3f9f8822-6268-411f-9f5d-1304cb2f2d89 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] [instance: 59078c54-87eb-46f8-8aec-fdfa0056e0d3] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:06.565262 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:23:06.590985 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3f9f8822-6268-411f-9f5d-1304cb2f2d89 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:06.591507 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3f9f8822-6268-411f-9f5d-1304cb2f2d89 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:06.591952 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3f9f8822-6268-411f-9f5d-1304cb2f2d89 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:06.592689 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3f9f8822-6268-411f-9f5d-1304cb2f2d89 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:06.593157 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3f9f8822-6268-411f-9f5d-1304cb2f2d89 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:06.593629 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3f9f8822-6268-411f-9f5d-1304cb2f2d89 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:06.736280 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b3a72665-fa3f-4ead-b449-d2bcb1f2acf9 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:06.736828 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b3a72665-fa3f-4ead-b449-d2bcb1f2acf9 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 3c2f5d0d-16a5-4f33-8f02-a84296eb09ef] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:06.751824 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b3a72665-fa3f-4ead-b449-d2bcb1f2acf9 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:06.752406 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b3a72665-fa3f-4ead-b449-d2bcb1f2acf9 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:06.752950 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b3a72665-fa3f-4ead-b449-d2bcb1f2acf9 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:06.753773 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b3a72665-fa3f-4ead-b449-d2bcb1f2acf9 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:06.754374 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b3a72665-fa3f-4ead-b449-d2bcb1f2acf9 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:06.754911 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b3a72665-fa3f-4ead-b449-d2bcb1f2acf9 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:06.790161 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-3f9f8822-6268-411f-9f5d-1304cb2f2d89 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/59078c54-87eb-46f8-8aec-fdfa0056e0d3" status: 200 len: 1650 microversion: 2.1 time: 0.240557 Sep 14 09:23:06.794109 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2978/5928] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:23:06 2022] GET /compute/v2.1/servers/59078c54-87eb-46f8-8aec-fdfa0056e0d3 => generated 1650 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:23:06.820209 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-19e5de6c-b6fa-4008-803a-f845b47891f6 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:06.820760 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-19e5de6c-b6fa-4008-803a-f845b47891f6 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] [instance: 59078c54-87eb-46f8-8aec-fdfa0056e0d3] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:06.831841 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-19e5de6c-b6fa-4008-803a-f845b47891f6 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:06.832689 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-19e5de6c-b6fa-4008-803a-f845b47891f6 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:06.833341 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-19e5de6c-b6fa-4008-803a-f845b47891f6 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:06.834425 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-19e5de6c-b6fa-4008-803a-f845b47891f6 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:06.835103 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-19e5de6c-b6fa-4008-803a-f845b47891f6 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:06.835714 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-19e5de6c-b6fa-4008-803a-f845b47891f6 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:06.839539 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b3a72665-fa3f-4ead-b449-d2bcb1f2acf9 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 3c2f5d0d-16a5-4f33-8f02-a84296eb09ef] Going to try to terminate instance {{(pid=128759) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:23:06.991931 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b3a72665-fa3f-4ead-b449-d2bcb1f2acf9 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "DELETE /compute/v2.1/servers/3c2f5d0d-16a5-4f33-8f02-a84296eb09ef" status: 204 len: 0 microversion: 2.1 time: 0.256889 Sep 14 09:23:06.993219 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2951/5929] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:23:06 2022] DELETE /compute/v2.1/servers/3c2f5d0d-16a5-4f33-8f02-a84296eb09ef => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 14 09:23:07.014617 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-4dca22cc-f33e-4e4c-9af1-b6f437e62ed6 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:07.016039 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-4dca22cc-f33e-4e4c-9af1-b6f437e62ed6 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 3c2f5d0d-16a5-4f33-8f02-a84296eb09ef] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:07.031244 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4dca22cc-f33e-4e4c-9af1-b6f437e62ed6 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:07.031983 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4dca22cc-f33e-4e4c-9af1-b6f437e62ed6 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:07.032638 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4dca22cc-f33e-4e4c-9af1-b6f437e62ed6 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:07.034241 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4dca22cc-f33e-4e4c-9af1-b6f437e62ed6 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:07.034891 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4dca22cc-f33e-4e4c-9af1-b6f437e62ed6 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:07.036082 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4dca22cc-f33e-4e4c-9af1-b6f437e62ed6 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:07.067036 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-19e5de6c-b6fa-4008-803a-f845b47891f6 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/59078c54-87eb-46f8-8aec-fdfa0056e0d3" status: 200 len: 1650 microversion: 2.1 time: 0.250554 Sep 14 09:23:07.068007 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2979/5930] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:23:06 2022] GET /compute/v2.1/servers/59078c54-87eb-46f8-8aec-fdfa0056e0d3 => generated 1650 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:23:07.094381 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-4a9f9b79-6a9b-4f00-8fcf-220434643e0b tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:07.095384 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-4a9f9b79-6a9b-4f00-8fcf-220434643e0b tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] [instance: 59078c54-87eb-46f8-8aec-fdfa0056e0d3] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:07.102061 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4a9f9b79-6a9b-4f00-8fcf-220434643e0b tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:07.102838 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4a9f9b79-6a9b-4f00-8fcf-220434643e0b tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:07.103500 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4a9f9b79-6a9b-4f00-8fcf-220434643e0b tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:07.104414 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4a9f9b79-6a9b-4f00-8fcf-220434643e0b tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:07.105058 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4a9f9b79-6a9b-4f00-8fcf-220434643e0b tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:07.106418 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4a9f9b79-6a9b-4f00-8fcf-220434643e0b tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:07.333776 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-4dca22cc-f33e-4e4c-9af1-b6f437e62ed6 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03dc827647f4483beb2e1b7888be608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229e11b3c1fe48b088d0f3c4bb7e2cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:07.347530 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-4dca22cc-f33e-4e4c-9af1-b6f437e62ed6 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "GET /compute/v2.1/servers/3c2f5d0d-16a5-4f33-8f02-a84296eb09ef" status: 200 len: 1508 microversion: 2.1 time: 0.342143 Sep 14 09:23:07.360783 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2952/5931] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:23:06 2022] GET /compute/v2.1/servers/3c2f5d0d-16a5-4f33-8f02-a84296eb09ef => generated 1508 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:23:07.417672 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-4a9f9b79-6a9b-4f00-8fcf-220434643e0b tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/59078c54-87eb-46f8-8aec-fdfa0056e0d3" status: 200 len: 1650 microversion: 2.1 time: 0.328037 Sep 14 09:23:07.418289 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2980/5932] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:23:07 2022] GET /compute/v2.1/servers/59078c54-87eb-46f8-8aec-fdfa0056e0d3 => generated 1650 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:23:07.483576 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f1e3bf42-1338-4729-b6bd-37abfb54f82c tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-961796790", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "availability_zone": "nova:n-h2-836830-18", "networks": [{"uuid": "f24216cd-7cf5-4afe-a428-e5985da0c632"}]}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:23:07.549205 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.network.neutron [None req-f1e3bf42-1338-4729-b6bd-37abfb54f82c tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] validate_networks() for [('f24216cd-7cf5-4afe-a428-e5985da0c632', None, None, None, None, None)] {{(pid=128759) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:23:07.957687 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-f1e3bf42-1338-4729-b6bd-37abfb54f82c tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Flavor limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:23:07.958368 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-f1e3bf42-1338-4729-b6bd-37abfb54f82c tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Image limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:23:07.958747 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-f1e3bf42-1338-4729-b6bd-37abfb54f82c tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Flavor pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:23:07.959289 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-f1e3bf42-1338-4729-b6bd-37abfb54f82c tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Image pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:23:07.959781 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-f1e3bf42-1338-4729-b6bd-37abfb54f82c tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:23:07.972327 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f1e3bf42-1338-4729-b6bd-37abfb54f82c tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:07.972971 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f1e3bf42-1338-4729-b6bd-37abfb54f82c tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:07.973575 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f1e3bf42-1338-4729-b6bd-37abfb54f82c tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:07.974888 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f1e3bf42-1338-4729-b6bd-37abfb54f82c tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:07.975568 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f1e3bf42-1338-4729-b6bd-37abfb54f82c tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:07.976135 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f1e3bf42-1338-4729-b6bd-37abfb54f82c tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:08.003970 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-f1e3bf42-1338-4729-b6bd-37abfb54f82c tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Getting quotas for project 14a09c3de89348238ba73b14d4821203. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:23:08.009787 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-f1e3bf42-1338-4729-b6bd-37abfb54f82c tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Getting quotas for user ab7bff910aa44aa3a2c18a48893147a0 and project 14a09c3de89348238ba73b14d4821203. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:23:08.024044 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f1e3bf42-1338-4729-b6bd-37abfb54f82c tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Going to run 1 instances... {{(pid=128759) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:23:08.026407 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f1e3bf42-1338-4729-b6bd-37abfb54f82c tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] [instance: 354e97e3-b872-4e92-a97d-1d840ab8bf5e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128759) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:23:08.074304 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f1e3bf42-1338-4729-b6bd-37abfb54f82c tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.594847 Sep 14 09:23:08.075937 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2953/5933] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 09:23:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 597 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:23:08.086913 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-882230e6-1ac8-4c12-8192-9f8f9458c583 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:08.087804 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-882230e6-1ac8-4c12-8192-9f8f9458c583 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] [instance: 354e97e3-b872-4e92-a97d-1d840ab8bf5e] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:08.159252 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-882230e6-1ac8-4c12-8192-9f8f9458c583 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/354e97e3-b872-4e92-a97d-1d840ab8bf5e" status: 200 len: 1328 microversion: 2.1 time: 0.073804 Sep 14 09:23:08.160600 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2981/5934] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:23:08 2022] GET /compute/v2.1/servers/354e97e3-b872-4e92-a97d-1d840ab8bf5e => generated 1328 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:23:08.376737 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-7a5bac42-dec4-4ade-870d-e779c9080400 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:08.377933 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-7a5bac42-dec4-4ade-870d-e779c9080400 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 3c2f5d0d-16a5-4f33-8f02-a84296eb09ef] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:08.386255 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7a5bac42-dec4-4ade-870d-e779c9080400 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:08.387103 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7a5bac42-dec4-4ade-870d-e779c9080400 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:08.387818 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7a5bac42-dec4-4ade-870d-e779c9080400 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:08.388630 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7a5bac42-dec4-4ade-870d-e779c9080400 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:08.389200 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7a5bac42-dec4-4ade-870d-e779c9080400 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:08.389827 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7a5bac42-dec4-4ade-870d-e779c9080400 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:08.575185 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-7a5bac42-dec4-4ade-870d-e779c9080400 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03dc827647f4483beb2e1b7888be608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229e11b3c1fe48b088d0f3c4bb7e2cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:08.584649 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-7a5bac42-dec4-4ade-870d-e779c9080400 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "GET /compute/v2.1/servers/3c2f5d0d-16a5-4f33-8f02-a84296eb09ef" status: 200 len: 1508 microversion: 2.1 time: 0.213902 Sep 14 09:23:08.585759 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2954/5935] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:23:08 2022] GET /compute/v2.1/servers/3c2f5d0d-16a5-4f33-8f02-a84296eb09ef => generated 1508 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:23:09.183501 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-9aaf2157-6c72-49e8-a2f6-a65e8366b03f tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:09.184122 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-9aaf2157-6c72-49e8-a2f6-a65e8366b03f tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] [instance: 354e97e3-b872-4e92-a97d-1d840ab8bf5e] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:09.197919 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9aaf2157-6c72-49e8-a2f6-a65e8366b03f tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:09.198808 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9aaf2157-6c72-49e8-a2f6-a65e8366b03f tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:09.199996 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9aaf2157-6c72-49e8-a2f6-a65e8366b03f tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:09.212373 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9aaf2157-6c72-49e8-a2f6-a65e8366b03f tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:09.213130 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9aaf2157-6c72-49e8-a2f6-a65e8366b03f tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:09.213804 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9aaf2157-6c72-49e8-a2f6-a65e8366b03f tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:09.298512 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-9aaf2157-6c72-49e8-a2f6-a65e8366b03f tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/354e97e3-b872-4e92-a97d-1d840ab8bf5e" status: 200 len: 1417 microversion: 2.1 time: 0.118590 Sep 14 09:23:09.304826 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2982/5936] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:23:09 2022] GET /compute/v2.1/servers/354e97e3-b872-4e92-a97d-1d840ab8bf5e => generated 1417 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:23:09.396326 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-d430da9f-bb8c-4def-a156-0c934c3b9bd9 req-bd82083a-50c2-4f6b-9363-b657be798b8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c2f5d0d-16a5-4f33-8f02-a84296eb09ef", "name": "network-vif-deleted", "tag": "3563db43-cf81-42a5-b3d8-8411d4bd6b11"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:23:09.413432 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-d430da9f-bb8c-4def-a156-0c934c3b9bd9 req-bd82083a-50c2-4f6b-9363-b657be798b8f service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:09.414380 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-d430da9f-bb8c-4def-a156-0c934c3b9bd9 req-bd82083a-50c2-4f6b-9363-b657be798b8f service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:09.415126 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-d430da9f-bb8c-4def-a156-0c934c3b9bd9 req-bd82083a-50c2-4f6b-9363-b657be798b8f service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:09.448687 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-d430da9f-bb8c-4def-a156-0c934c3b9bd9 req-bd82083a-50c2-4f6b-9363-b657be798b8f service nova] Creating event network-vif-deleted:3563db43-cf81-42a5-b3d8-8411d4bd6b11 for instance 3c2f5d0d-16a5-4f33-8f02-a84296eb09ef on n-h1-836830-18 Sep 14 09:23:09.456216 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-d430da9f-bb8c-4def-a156-0c934c3b9bd9 req-bd82083a-50c2-4f6b-9363-b657be798b8f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065117 Sep 14 09:23:09.458189 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2955/5937] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:23:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:23:09.617139 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-85b72ce8-6fd7-4788-a3d2-68535ea760bf tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:09.618508 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-85b72ce8-6fd7-4788-a3d2-68535ea760bf tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 3c2f5d0d-16a5-4f33-8f02-a84296eb09ef] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:09.630371 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-85b72ce8-6fd7-4788-a3d2-68535ea760bf tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:09.631822 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-85b72ce8-6fd7-4788-a3d2-68535ea760bf tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:09.635590 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-85b72ce8-6fd7-4788-a3d2-68535ea760bf tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:09.640192 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-85b72ce8-6fd7-4788-a3d2-68535ea760bf tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:09.640987 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-85b72ce8-6fd7-4788-a3d2-68535ea760bf tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:09.641553 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-85b72ce8-6fd7-4788-a3d2-68535ea760bf tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:09.740430 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-85b72ce8-6fd7-4788-a3d2-68535ea760bf tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:09.741034 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-85b72ce8-6fd7-4788-a3d2-68535ea760bf tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:09.742169 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-85b72ce8-6fd7-4788-a3d2-68535ea760bf tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:09.743980 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.objects.instance [None req-85b72ce8-6fd7-4788-a3d2-68535ea760bf tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lazy-loading 'fault' on Instance uuid 3c2f5d0d-16a5-4f33-8f02-a84296eb09ef {{(pid=128758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:23:09.828404 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-85b72ce8-6fd7-4788-a3d2-68535ea760bf tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03dc827647f4483beb2e1b7888be608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229e11b3c1fe48b088d0f3c4bb7e2cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:09.835362 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:23:09.838073 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-85b72ce8-6fd7-4788-a3d2-68535ea760bf tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "GET /compute/v2.1/servers/3c2f5d0d-16a5-4f33-8f02-a84296eb09ef" status: 200 len: 1312 microversion: 2.1 time: 0.233260 Sep 14 09:23:09.841748 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2983/5938] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:23:09 2022] GET /compute/v2.1/servers/3c2f5d0d-16a5-4f33-8f02-a84296eb09ef => generated 1312 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:23:10.324934 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-4e4382d1-43c6-4e9d-b861-8030396bc66e tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:10.325932 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-4e4382d1-43c6-4e9d-b861-8030396bc66e tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] [instance: 354e97e3-b872-4e92-a97d-1d840ab8bf5e] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:10.362489 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4e4382d1-43c6-4e9d-b861-8030396bc66e tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:10.363669 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4e4382d1-43c6-4e9d-b861-8030396bc66e tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:10.366233 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4e4382d1-43c6-4e9d-b861-8030396bc66e tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:10.371033 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4e4382d1-43c6-4e9d-b861-8030396bc66e tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:10.372060 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4e4382d1-43c6-4e9d-b861-8030396bc66e tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:10.375158 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4e4382d1-43c6-4e9d-b861-8030396bc66e tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:10.597859 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-4e4382d1-43c6-4e9d-b861-8030396bc66e tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/354e97e3-b872-4e92-a97d-1d840ab8bf5e" status: 200 len: 1465 microversion: 2.1 time: 0.278721 Sep 14 09:23:10.601478 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2956/5939] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:23:10 2022] GET /compute/v2.1/servers/354e97e3-b872-4e92-a97d-1d840ab8bf5e => generated 1465 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:23:10.865723 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b0897af8-6653-4c5c-b42b-4cbaef823843 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:10.866346 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-b0897af8-6653-4c5c-b42b-4cbaef823843 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 3c2f5d0d-16a5-4f33-8f02-a84296eb09ef] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:10.874976 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b0897af8-6653-4c5c-b42b-4cbaef823843 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:10.875469 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b0897af8-6653-4c5c-b42b-4cbaef823843 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:10.875973 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b0897af8-6653-4c5c-b42b-4cbaef823843 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:10.876696 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b0897af8-6653-4c5c-b42b-4cbaef823843 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:10.877171 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b0897af8-6653-4c5c-b42b-4cbaef823843 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:10.877581 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b0897af8-6653-4c5c-b42b-4cbaef823843 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:10.893879 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-b0897af8-6653-4c5c-b42b-4cbaef823843 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] HTTP exception thrown: Instance 3c2f5d0d-16a5-4f33-8f02-a84296eb09ef could not be found. Sep 14 09:23:10.895927 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b0897af8-6653-4c5c-b42b-4cbaef823843 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Request method failure captured: Sep 14 09:23:10.895927 n-d-836830-18 devstack@n-api.service[128758]: request: GET /compute/v2.1/servers/3c2f5d0d-16a5-4f33-8f02-a84296eb09ef HTTP/1.1 Sep 14 09:23:10.895927 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 09:23:10.895927 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 09:23:10.895927 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 09:23:10.895927 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 09:23:10.895927 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 09:23:10.895927 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 09:23:10.895927 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 09:23:10.895927 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 09:23:10.895927 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZwTx_6je2Mw19l1lk1T0KIWHROT3f4iq0u8_a7vTqyoq1BZh-ur0UF5KgJJeIlC54HlZaHspjBV72bT6ijQhdvPr0BCEmv-eUjjBTB_inJvaG7XMCMIoIIz39iqAFnj3jFdepR5dS7_uhYCyzmsUFKn1SkfeR8JmAZc_qs5ymrt_EA Sep 14 09:23:10.895927 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 09:23:10.895927 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 09:23:10.895927 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 09:23:10.895927 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 09:23:10.895927 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 09:23:10.895927 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 09:23:10.895927 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 229e11b3c1fe48b088d0f3c4bb7e2cb6 Sep 14 09:23:10.895927 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2043241234 Sep 14 09:23:10.895927 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 09:23:10.895927 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 09:23:10.895927 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/229e11b3c1fe48b088d0f3c4bb7e2cb6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_229e11b3c1fe48b088d0f3c4bb7e2cb6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/229e11b3c1fe48b088d0f3c4bb7e2cb6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/229e11b3c1fe48b088d0f3c4bb7e2cb6"}]}] Sep 14 09:23:10.895927 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2043241234 Sep 14 09:23:10.895927 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 229e11b3c1fe48b088d0f3c4bb7e2cb6 Sep 14 09:23:10.895927 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2043241234 Sep 14 09:23:10.895927 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-ServerRescueNegativeTestJSON-2043241234-project Sep 14 09:23:10.895927 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 09:23:10.895927 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 09:23:10.895927 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: d03dc827647f4483beb2e1b7888be608 Sep 14 09:23:10.895927 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2043241234-project Sep 14 09:23:10.895927 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 09:23:10.895927 n-d-836830-18 devstack@n-api.service[128758]: exception: Instance 3c2f5d0d-16a5-4f33-8f02-a84296eb09ef could not be found. Sep 14 09:23:10.895927 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': '3c2f5d0d-16a5-4f33-8f02-a84296eb09ef'} Sep 14 09:23:10.895927 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:23:10.895927 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:23:10.895927 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:23:10.895927 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:23:10.895927 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:23:10.895927 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:23:10.895927 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:23:10.895927 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:23:10.895927 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:23:10.895927 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:23:10.895927 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c2f5d0d-16a5-4f33-8f02-a84296eb09ef could not be found. Sep 14 09:23:10.895927 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:23:10.895927 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:23:10.895927 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:23:10.895927 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:23:10.895927 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:23:10.895927 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:23:10.895927 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:23:10.895927 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:23:10.895927 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:23:10.895927 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:23:10.895927 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:23:10.895927 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:23:10.895927 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:23:10.895927 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:23:10.895927 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:23:10.895927 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:23:10.895927 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c2f5d0d-16a5-4f33-8f02-a84296eb09ef could not be found. Sep 14 09:23:10.895927 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:23:10.895927 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:23:10.901135 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:23:10.901135 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:23:10.901135 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:23:10.901135 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:23:10.901135 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:23:10.901135 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:23:10.901135 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c2f5d0d-16a5-4f33-8f02-a84296eb09ef could not be found. Sep 14 09:23:10.901135 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:23:10.901135 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b0897af8-6653-4c5c-b42b-4cbaef823843 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Returning 404 to user: Instance 3c2f5d0d-16a5-4f33-8f02-a84296eb09ef could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:23:10.901135 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-b0897af8-6653-4c5c-b42b-4cbaef823843 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "GET /compute/v2.1/servers/3c2f5d0d-16a5-4f33-8f02-a84296eb09ef" status: 404 len: 111 microversion: 2.1 time: 0.036463 Sep 14 09:23:10.901135 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2984/5940] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:23:10 2022] GET /compute/v2.1/servers/3c2f5d0d-16a5-4f33-8f02-a84296eb09ef => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:23:10.907109 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3c7f869d-56e9-4676-bace-83617e011282 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:10.907631 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-3c7f869d-56e9-4676-bace-83617e011282 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 80f0d7ed-260a-4c9d-a13b-be676b9edba0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:10.913820 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3c7f869d-56e9-4676-bace-83617e011282 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:10.914341 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3c7f869d-56e9-4676-bace-83617e011282 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:10.914774 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3c7f869d-56e9-4676-bace-83617e011282 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:10.915534 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3c7f869d-56e9-4676-bace-83617e011282 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:10.916002 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3c7f869d-56e9-4676-bace-83617e011282 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:10.916440 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3c7f869d-56e9-4676-bace-83617e011282 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:10.920833 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:23:10.946145 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-3c7f869d-56e9-4676-bace-83617e011282 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 80f0d7ed-260a-4c9d-a13b-be676b9edba0] Going to try to terminate instance {{(pid=128759) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:23:11.052410 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-3c7f869d-56e9-4676-bace-83617e011282 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "DELETE /compute/v2.1/servers/80f0d7ed-260a-4c9d-a13b-be676b9edba0" status: 204 len: 0 microversion: 2.1 time: 0.149372 Sep 14 09:23:11.056562 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2957/5941] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:23:10 2022] DELETE /compute/v2.1/servers/80f0d7ed-260a-4c9d-a13b-be676b9edba0 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:23:11.062045 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ac20b637-dca4-4c50-803e-bfddb5a52cc5 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:11.062666 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-ac20b637-dca4-4c50-803e-bfddb5a52cc5 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 80f0d7ed-260a-4c9d-a13b-be676b9edba0] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:11.070560 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ac20b637-dca4-4c50-803e-bfddb5a52cc5 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:11.071567 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ac20b637-dca4-4c50-803e-bfddb5a52cc5 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:11.072188 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ac20b637-dca4-4c50-803e-bfddb5a52cc5 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:11.072897 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ac20b637-dca4-4c50-803e-bfddb5a52cc5 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:11.073354 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ac20b637-dca4-4c50-803e-bfddb5a52cc5 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:11.073781 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ac20b637-dca4-4c50-803e-bfddb5a52cc5 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:11.235668 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-ac20b637-dca4-4c50-803e-bfddb5a52cc5 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03dc827647f4483beb2e1b7888be608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229e11b3c1fe48b088d0f3c4bb7e2cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:11.243676 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-ac20b637-dca4-4c50-803e-bfddb5a52cc5 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "GET /compute/v2.1/servers/80f0d7ed-260a-4c9d-a13b-be676b9edba0" status: 200 len: 1520 microversion: 2.1 time: 0.186060 Sep 14 09:23:11.244269 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2985/5942] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:23:11 2022] GET /compute/v2.1/servers/80f0d7ed-260a-4c9d-a13b-be676b9edba0 => generated 1520 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:23:11.510001 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-c0cc405e-9aa7-4161-9a7f-f1b4765c28d0 req-8eecdd94-83ae-4fe7-9b88-b58bd75559ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "354e97e3-b872-4e92-a97d-1d840ab8bf5e", "tag": "ec1d96b7-659d-4a45-9c9c-c0ad3013fc5d"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:23:11.525240 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-c0cc405e-9aa7-4161-9a7f-f1b4765c28d0 req-8eecdd94-83ae-4fe7-9b88-b58bd75559ac service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:11.525860 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-c0cc405e-9aa7-4161-9a7f-f1b4765c28d0 req-8eecdd94-83ae-4fe7-9b88-b58bd75559ac service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:11.526374 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-c0cc405e-9aa7-4161-9a7f-f1b4765c28d0 req-8eecdd94-83ae-4fe7-9b88-b58bd75559ac service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:11.537815 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-c0cc405e-9aa7-4161-9a7f-f1b4765c28d0 req-8eecdd94-83ae-4fe7-9b88-b58bd75559ac service nova] Creating event network-changed:ec1d96b7-659d-4a45-9c9c-c0ad3013fc5d for instance 354e97e3-b872-4e92-a97d-1d840ab8bf5e on n-h2-836830-18 Sep 14 09:23:11.542626 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-c0cc405e-9aa7-4161-9a7f-f1b4765c28d0 req-8eecdd94-83ae-4fe7-9b88-b58bd75559ac service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036741 Sep 14 09:23:11.544717 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2958/5943] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:23:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:23:11.629688 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a33a3c66-9002-4e4a-b2c3-87720e042444 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:11.630355 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-a33a3c66-9002-4e4a-b2c3-87720e042444 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] [instance: 354e97e3-b872-4e92-a97d-1d840ab8bf5e] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:11.637581 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a33a3c66-9002-4e4a-b2c3-87720e042444 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:11.638078 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a33a3c66-9002-4e4a-b2c3-87720e042444 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:11.638766 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a33a3c66-9002-4e4a-b2c3-87720e042444 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:11.639832 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a33a3c66-9002-4e4a-b2c3-87720e042444 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:11.640304 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a33a3c66-9002-4e4a-b2c3-87720e042444 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:11.640741 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a33a3c66-9002-4e4a-b2c3-87720e042444 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:11.833866 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-a33a3c66-9002-4e4a-b2c3-87720e042444 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/354e97e3-b872-4e92-a97d-1d840ab8bf5e" status: 200 len: 1465 microversion: 2.1 time: 0.208155 Sep 14 09:23:11.834455 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2986/5944] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:23:11 2022] GET /compute/v2.1/servers/354e97e3-b872-4e92-a97d-1d840ab8bf5e => generated 1465 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:23:12.268805 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-2a23129d-de22-468d-ac8c-ee68a278d1de tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:12.269436 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-2a23129d-de22-468d-ac8c-ee68a278d1de tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 80f0d7ed-260a-4c9d-a13b-be676b9edba0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:12.276335 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2a23129d-de22-468d-ac8c-ee68a278d1de tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:12.276830 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2a23129d-de22-468d-ac8c-ee68a278d1de tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:12.277271 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2a23129d-de22-468d-ac8c-ee68a278d1de tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:12.278498 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2a23129d-de22-468d-ac8c-ee68a278d1de tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:12.278975 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2a23129d-de22-468d-ac8c-ee68a278d1de tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:12.279406 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2a23129d-de22-468d-ac8c-ee68a278d1de tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:12.422446 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-2a23129d-de22-468d-ac8c-ee68a278d1de tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03dc827647f4483beb2e1b7888be608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229e11b3c1fe48b088d0f3c4bb7e2cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:12.433364 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-2a23129d-de22-468d-ac8c-ee68a278d1de tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "GET /compute/v2.1/servers/80f0d7ed-260a-4c9d-a13b-be676b9edba0" status: 200 len: 1520 microversion: 2.1 time: 0.169071 Sep 14 09:23:12.434320 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2959/5945] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:23:12 2022] GET /compute/v2.1/servers/80f0d7ed-260a-4c9d-a13b-be676b9edba0 => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:23:12.857114 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-2a07a938-9061-402a-a7c5-581a2f818492 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:12.857753 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-2a07a938-9061-402a-a7c5-581a2f818492 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] [instance: 354e97e3-b872-4e92-a97d-1d840ab8bf5e] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:12.864599 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2a07a938-9061-402a-a7c5-581a2f818492 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:12.865336 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2a07a938-9061-402a-a7c5-581a2f818492 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:12.865951 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2a07a938-9061-402a-a7c5-581a2f818492 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:12.866861 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2a07a938-9061-402a-a7c5-581a2f818492 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:12.867512 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2a07a938-9061-402a-a7c5-581a2f818492 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:12.868116 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2a07a938-9061-402a-a7c5-581a2f818492 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:13.005670 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-2a07a938-9061-402a-a7c5-581a2f818492 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/354e97e3-b872-4e92-a97d-1d840ab8bf5e" status: 200 len: 1465 microversion: 2.1 time: 0.151822 Sep 14 09:23:13.011503 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2987/5946] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:23:12 2022] GET /compute/v2.1/servers/354e97e3-b872-4e92-a97d-1d840ab8bf5e => generated 1465 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:23:13.456796 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-10090c14-4a94-4dfc-9314-b279801a1b3c tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:13.457490 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-10090c14-4a94-4dfc-9314-b279801a1b3c tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 80f0d7ed-260a-4c9d-a13b-be676b9edba0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:13.464822 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-10090c14-4a94-4dfc-9314-b279801a1b3c tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:13.465432 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-10090c14-4a94-4dfc-9314-b279801a1b3c tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:13.465992 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-10090c14-4a94-4dfc-9314-b279801a1b3c tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:13.466788 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-10090c14-4a94-4dfc-9314-b279801a1b3c tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:13.467664 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-10090c14-4a94-4dfc-9314-b279801a1b3c tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:13.468186 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-10090c14-4a94-4dfc-9314-b279801a1b3c tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:13.625326 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-10090c14-4a94-4dfc-9314-b279801a1b3c tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03dc827647f4483beb2e1b7888be608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229e11b3c1fe48b088d0f3c4bb7e2cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:13.633689 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-10090c14-4a94-4dfc-9314-b279801a1b3c tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "GET /compute/v2.1/servers/80f0d7ed-260a-4c9d-a13b-be676b9edba0" status: 200 len: 1520 microversion: 2.1 time: 0.180859 Sep 14 09:23:13.634293 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2960/5947] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:23:13 2022] GET /compute/v2.1/servers/80f0d7ed-260a-4c9d-a13b-be676b9edba0 => generated 1520 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:23:14.029564 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-4c800b3a-db37-4d3b-bec6-ec93bb7348e8 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:14.030772 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-4c800b3a-db37-4d3b-bec6-ec93bb7348e8 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] [instance: 354e97e3-b872-4e92-a97d-1d840ab8bf5e] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:14.038704 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4c800b3a-db37-4d3b-bec6-ec93bb7348e8 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:14.040805 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4c800b3a-db37-4d3b-bec6-ec93bb7348e8 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:14.041250 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4c800b3a-db37-4d3b-bec6-ec93bb7348e8 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:14.041970 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4c800b3a-db37-4d3b-bec6-ec93bb7348e8 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:14.042426 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4c800b3a-db37-4d3b-bec6-ec93bb7348e8 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:14.044699 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4c800b3a-db37-4d3b-bec6-ec93bb7348e8 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:14.249213 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-4c800b3a-db37-4d3b-bec6-ec93bb7348e8 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/354e97e3-b872-4e92-a97d-1d840ab8bf5e" status: 200 len: 1465 microversion: 2.1 time: 0.224387 Sep 14 09:23:14.250802 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2988/5948] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:23:14 2022] GET /compute/v2.1/servers/354e97e3-b872-4e92-a97d-1d840ab8bf5e => generated 1465 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:23:14.368210 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-025ca014-1b98-43db-9449-465983e71f23 req-25788898-4257-41d2-8f9f-1ad4e022dcf2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80f0d7ed-260a-4c9d-a13b-be676b9edba0", "name": "network-vif-deleted", "tag": "d05db12d-2504-41c6-af6a-8194cdcab027"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:23:14.391764 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-025ca014-1b98-43db-9449-465983e71f23 req-25788898-4257-41d2-8f9f-1ad4e022dcf2 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:14.392593 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-025ca014-1b98-43db-9449-465983e71f23 req-25788898-4257-41d2-8f9f-1ad4e022dcf2 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:14.394538 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-025ca014-1b98-43db-9449-465983e71f23 req-25788898-4257-41d2-8f9f-1ad4e022dcf2 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:14.432844 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-025ca014-1b98-43db-9449-465983e71f23 req-25788898-4257-41d2-8f9f-1ad4e022dcf2 service nova] Creating event network-vif-deleted:d05db12d-2504-41c6-af6a-8194cdcab027 for instance 80f0d7ed-260a-4c9d-a13b-be676b9edba0 on n-h2-836830-18 Sep 14 09:23:14.450421 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-025ca014-1b98-43db-9449-465983e71f23 req-25788898-4257-41d2-8f9f-1ad4e022dcf2 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084651 Sep 14 09:23:14.451834 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2961/5949] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:23:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:23:14.657330 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-57e0499d-27ab-42c9-b88e-203a3ab8cf4d tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:14.658035 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-57e0499d-27ab-42c9-b88e-203a3ab8cf4d tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 80f0d7ed-260a-4c9d-a13b-be676b9edba0] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:14.674161 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-57e0499d-27ab-42c9-b88e-203a3ab8cf4d tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:14.676456 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-57e0499d-27ab-42c9-b88e-203a3ab8cf4d tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:14.677085 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-57e0499d-27ab-42c9-b88e-203a3ab8cf4d tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:14.678033 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-57e0499d-27ab-42c9-b88e-203a3ab8cf4d tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:14.679476 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-57e0499d-27ab-42c9-b88e-203a3ab8cf4d tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:14.680569 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-57e0499d-27ab-42c9-b88e-203a3ab8cf4d tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:14.724724 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-57e0499d-27ab-42c9-b88e-203a3ab8cf4d tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:14.725486 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-57e0499d-27ab-42c9-b88e-203a3ab8cf4d tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:14.726099 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-57e0499d-27ab-42c9-b88e-203a3ab8cf4d tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:14.726726 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.objects.instance [None req-57e0499d-27ab-42c9-b88e-203a3ab8cf4d tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lazy-loading 'fault' on Instance uuid 80f0d7ed-260a-4c9d-a13b-be676b9edba0 {{(pid=128758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:23:14.779329 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-57e0499d-27ab-42c9-b88e-203a3ab8cf4d tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03dc827647f4483beb2e1b7888be608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229e11b3c1fe48b088d0f3c4bb7e2cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:14.792029 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-57e0499d-27ab-42c9-b88e-203a3ab8cf4d tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "GET /compute/v2.1/servers/80f0d7ed-260a-4c9d-a13b-be676b9edba0" status: 200 len: 1311 microversion: 2.1 time: 0.136101 Sep 14 09:23:14.808447 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2989/5950] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:23:14 2022] GET /compute/v2.1/servers/80f0d7ed-260a-4c9d-a13b-be676b9edba0 => generated 1311 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:23:15.276259 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f68a7fdb-d447-45f6-b095-5fd41955e364 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:15.276983 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f68a7fdb-d447-45f6-b095-5fd41955e364 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] [instance: 354e97e3-b872-4e92-a97d-1d840ab8bf5e] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:15.285201 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f68a7fdb-d447-45f6-b095-5fd41955e364 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:15.285622 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f68a7fdb-d447-45f6-b095-5fd41955e364 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:15.286291 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f68a7fdb-d447-45f6-b095-5fd41955e364 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:15.287225 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f68a7fdb-d447-45f6-b095-5fd41955e364 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:15.287867 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f68a7fdb-d447-45f6-b095-5fd41955e364 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:15.288478 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f68a7fdb-d447-45f6-b095-5fd41955e364 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:15.570788 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f68a7fdb-d447-45f6-b095-5fd41955e364 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/354e97e3-b872-4e92-a97d-1d840ab8bf5e" status: 200 len: 1465 microversion: 2.1 time: 0.299484 Sep 14 09:23:15.571799 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2962/5951] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:23:15 2022] GET /compute/v2.1/servers/354e97e3-b872-4e92-a97d-1d840ab8bf5e => generated 1465 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:23:15.817982 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-489794ae-bdca-40be-843d-62bfb4b57911 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:15.818609 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-489794ae-bdca-40be-843d-62bfb4b57911 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] [instance: 80f0d7ed-260a-4c9d-a13b-be676b9edba0] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:15.825699 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-489794ae-bdca-40be-843d-62bfb4b57911 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:15.826184 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-489794ae-bdca-40be-843d-62bfb4b57911 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:15.826617 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-489794ae-bdca-40be-843d-62bfb4b57911 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:15.827911 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-489794ae-bdca-40be-843d-62bfb4b57911 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:15.828381 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-489794ae-bdca-40be-843d-62bfb4b57911 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:15.828815 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-489794ae-bdca-40be-843d-62bfb4b57911 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:15.844047 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-489794ae-bdca-40be-843d-62bfb4b57911 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] HTTP exception thrown: Instance 80f0d7ed-260a-4c9d-a13b-be676b9edba0 could not be found. Sep 14 09:23:15.846055 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-489794ae-bdca-40be-843d-62bfb4b57911 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Request method failure captured: Sep 14 09:23:15.846055 n-d-836830-18 devstack@n-api.service[128758]: request: GET /compute/v2.1/servers/80f0d7ed-260a-4c9d-a13b-be676b9edba0 HTTP/1.1 Sep 14 09:23:15.846055 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 09:23:15.846055 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 09:23:15.846055 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 09:23:15.846055 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 09:23:15.846055 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 09:23:15.846055 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 09:23:15.846055 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 09:23:15.846055 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 09:23:15.846055 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZwTx_6je2Mw19l1lk1T0KIWHROT3f4iq0u8_a7vTqyoq1BZh-ur0UF5KgJJeIlC54HlZaHspjBV72bT6ijQhdvPr0BCEmv-eUjjBTB_inJvaG7XMCMIoIIz39iqAFnj3jFdepR5dS7_uhYCyzmsUFKn1SkfeR8JmAZc_qs5ymrt_EA Sep 14 09:23:15.846055 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 09:23:15.846055 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 09:23:15.846055 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 09:23:15.846055 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 09:23:15.846055 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 09:23:15.846055 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 09:23:15.846055 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 229e11b3c1fe48b088d0f3c4bb7e2cb6 Sep 14 09:23:15.846055 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2043241234 Sep 14 09:23:15.846055 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 09:23:15.846055 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 09:23:15.846055 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/229e11b3c1fe48b088d0f3c4bb7e2cb6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_229e11b3c1fe48b088d0f3c4bb7e2cb6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/229e11b3c1fe48b088d0f3c4bb7e2cb6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/229e11b3c1fe48b088d0f3c4bb7e2cb6"}]}] Sep 14 09:23:15.846055 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2043241234 Sep 14 09:23:15.846055 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 229e11b3c1fe48b088d0f3c4bb7e2cb6 Sep 14 09:23:15.846055 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2043241234 Sep 14 09:23:15.846055 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-ServerRescueNegativeTestJSON-2043241234-project Sep 14 09:23:15.846055 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 09:23:15.846055 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 09:23:15.846055 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: d03dc827647f4483beb2e1b7888be608 Sep 14 09:23:15.846055 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2043241234-project Sep 14 09:23:15.846055 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 09:23:15.846055 n-d-836830-18 devstack@n-api.service[128758]: exception: Instance 80f0d7ed-260a-4c9d-a13b-be676b9edba0 could not be found. Sep 14 09:23:15.846055 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': '80f0d7ed-260a-4c9d-a13b-be676b9edba0'} Sep 14 09:23:15.846055 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:23:15.846055 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:23:15.846055 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:23:15.846055 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:23:15.846055 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:23:15.846055 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:23:15.846055 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:23:15.846055 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:23:15.846055 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:23:15.846055 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:23:15.846055 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80f0d7ed-260a-4c9d-a13b-be676b9edba0 could not be found. Sep 14 09:23:15.846055 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:23:15.846055 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:23:15.846055 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:23:15.846055 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:23:15.846055 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:23:15.846055 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:23:15.846055 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:23:15.846055 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:23:15.846055 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:23:15.846055 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:23:15.846055 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:23:15.846055 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:23:15.846055 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:23:15.846055 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:23:15.846055 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:23:15.846055 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:23:15.846055 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80f0d7ed-260a-4c9d-a13b-be676b9edba0 could not be found. Sep 14 09:23:15.846055 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:23:15.846055 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:23:15.852118 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:23:15.852118 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:23:15.852118 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:23:15.852118 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:23:15.852118 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:23:15.852118 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:23:15.852118 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80f0d7ed-260a-4c9d-a13b-be676b9edba0 could not be found. Sep 14 09:23:15.852118 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:23:15.852118 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-489794ae-bdca-40be-843d-62bfb4b57911 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] Returning 404 to user: Instance 80f0d7ed-260a-4c9d-a13b-be676b9edba0 could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:23:15.852118 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-489794ae-bdca-40be-843d-62bfb4b57911 tempest-ServerRescueNegativeTestJSON-2043241234 tempest-ServerRescueNegativeTestJSON-2043241234-project] 10.222.0.60 "GET /compute/v2.1/servers/80f0d7ed-260a-4c9d-a13b-be676b9edba0" status: 404 len: 111 microversion: 2.1 time: 0.033930 Sep 14 09:23:15.852118 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2990/5952] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:23:15 2022] GET /compute/v2.1/servers/80f0d7ed-260a-4c9d-a13b-be676b9edba0 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:23:16.599660 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b93e4a90-7aa4-4158-88a8-1f596e3668f4 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:16.601459 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b93e4a90-7aa4-4158-88a8-1f596e3668f4 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] [instance: 354e97e3-b872-4e92-a97d-1d840ab8bf5e] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:16.616321 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b93e4a90-7aa4-4158-88a8-1f596e3668f4 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:16.616854 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b93e4a90-7aa4-4158-88a8-1f596e3668f4 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:16.617297 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b93e4a90-7aa4-4158-88a8-1f596e3668f4 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:16.618008 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b93e4a90-7aa4-4158-88a8-1f596e3668f4 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:16.618461 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b93e4a90-7aa4-4158-88a8-1f596e3668f4 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:16.620479 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b93e4a90-7aa4-4158-88a8-1f596e3668f4 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:16.796985 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b93e4a90-7aa4-4158-88a8-1f596e3668f4 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/354e97e3-b872-4e92-a97d-1d840ab8bf5e" status: 200 len: 1465 microversion: 2.1 time: 0.203886 Sep 14 09:23:16.815737 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2963/5953] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:23:16 2022] GET /compute/v2.1/servers/354e97e3-b872-4e92-a97d-1d840ab8bf5e => generated 1465 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:23:17.837002 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-461c5e50-c267-4a8c-bf5c-6478049069cd tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:17.838393 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-461c5e50-c267-4a8c-bf5c-6478049069cd tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] [instance: 354e97e3-b872-4e92-a97d-1d840ab8bf5e] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:17.856121 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-461c5e50-c267-4a8c-bf5c-6478049069cd tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:17.856608 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-461c5e50-c267-4a8c-bf5c-6478049069cd tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:17.857063 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-461c5e50-c267-4a8c-bf5c-6478049069cd tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:17.862119 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-461c5e50-c267-4a8c-bf5c-6478049069cd tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:17.862856 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-461c5e50-c267-4a8c-bf5c-6478049069cd tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:17.863506 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-461c5e50-c267-4a8c-bf5c-6478049069cd tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:18.041162 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-461c5e50-c267-4a8c-bf5c-6478049069cd tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/354e97e3-b872-4e92-a97d-1d840ab8bf5e" status: 200 len: 1465 microversion: 2.1 time: 0.212120 Sep 14 09:23:18.042052 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2991/5954] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:23:17 2022] GET /compute/v2.1/servers/354e97e3-b872-4e92-a97d-1d840ab8bf5e => generated 1465 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:23:19.065565 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-08aee4dc-fa64-479f-8092-6154015347c8 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:19.066196 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-08aee4dc-fa64-479f-8092-6154015347c8 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] [instance: 354e97e3-b872-4e92-a97d-1d840ab8bf5e] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:19.073390 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=2 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:23:19.074643 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=6 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:23:19.076939 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-08aee4dc-fa64-479f-8092-6154015347c8 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:19.078570 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-08aee4dc-fa64-479f-8092-6154015347c8 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:19.079474 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-08aee4dc-fa64-479f-8092-6154015347c8 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:19.080373 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-08aee4dc-fa64-479f-8092-6154015347c8 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:19.081031 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-08aee4dc-fa64-479f-8092-6154015347c8 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:19.081640 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-08aee4dc-fa64-479f-8092-6154015347c8 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:19.319585 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-08aee4dc-fa64-479f-8092-6154015347c8 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/354e97e3-b872-4e92-a97d-1d840ab8bf5e" status: 200 len: 1465 microversion: 2.1 time: 0.257488 Sep 14 09:23:19.320549 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2964/5955] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:23:19 2022] GET /compute/v2.1/servers/354e97e3-b872-4e92-a97d-1d840ab8bf5e => generated 1465 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:23:20.131680 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-f8cd2f51-0a66-447a-bbfd-467040521b2d req-fa46d731-7e5c-4cd0-9b09-5c9fcf83aabd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "354e97e3-b872-4e92-a97d-1d840ab8bf5e", "name": "network-vif-plugged", "status": "completed", "tag": "ec1d96b7-659d-4a45-9c9c-c0ad3013fc5d"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:23:20.142667 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=2 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:23:20.146570 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-f8cd2f51-0a66-447a-bbfd-467040521b2d req-fa46d731-7e5c-4cd0-9b09-5c9fcf83aabd service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:20.147577 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-f8cd2f51-0a66-447a-bbfd-467040521b2d req-fa46d731-7e5c-4cd0-9b09-5c9fcf83aabd service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:20.148951 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-f8cd2f51-0a66-447a-bbfd-467040521b2d req-fa46d731-7e5c-4cd0-9b09-5c9fcf83aabd service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:20.175096 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-f8cd2f51-0a66-447a-bbfd-467040521b2d req-fa46d731-7e5c-4cd0-9b09-5c9fcf83aabd service nova] Creating event network-vif-plugged:ec1d96b7-659d-4a45-9c9c-c0ad3013fc5d for instance 354e97e3-b872-4e92-a97d-1d840ab8bf5e on n-h2-836830-18 Sep 14 09:23:20.182827 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-f8cd2f51-0a66-447a-bbfd-467040521b2d req-fa46d731-7e5c-4cd0-9b09-5c9fcf83aabd service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054833 Sep 14 09:23:20.185319 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2992/5956] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:23:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:23:20.349783 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9e22d449-2a2f-40b4-bab5-0c861c12b0f9 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:20.351064 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-9e22d449-2a2f-40b4-bab5-0c861c12b0f9 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] [instance: 354e97e3-b872-4e92-a97d-1d840ab8bf5e] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:20.363301 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9e22d449-2a2f-40b4-bab5-0c861c12b0f9 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:20.364094 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9e22d449-2a2f-40b4-bab5-0c861c12b0f9 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:20.366918 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9e22d449-2a2f-40b4-bab5-0c861c12b0f9 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:20.368221 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9e22d449-2a2f-40b4-bab5-0c861c12b0f9 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:20.368876 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9e22d449-2a2f-40b4-bab5-0c861c12b0f9 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:20.369484 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9e22d449-2a2f-40b4-bab5-0c861c12b0f9 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:20.687144 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-9e22d449-2a2f-40b4-bab5-0c861c12b0f9 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/354e97e3-b872-4e92-a97d-1d840ab8bf5e" status: 200 len: 1465 microversion: 2.1 time: 0.337492 Sep 14 09:23:20.688279 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2965/5957] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:23:20 2022] GET /compute/v2.1/servers/354e97e3-b872-4e92-a97d-1d840ab8bf5e => generated 1465 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:23:21.714261 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-50c5d447-40ae-4cb8-95f6-b7b80a7e3076 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:21.715772 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-50c5d447-40ae-4cb8-95f6-b7b80a7e3076 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] [instance: 354e97e3-b872-4e92-a97d-1d840ab8bf5e] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:21.731282 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-50c5d447-40ae-4cb8-95f6-b7b80a7e3076 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:21.732254 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-50c5d447-40ae-4cb8-95f6-b7b80a7e3076 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:21.732795 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-50c5d447-40ae-4cb8-95f6-b7b80a7e3076 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:21.733645 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-50c5d447-40ae-4cb8-95f6-b7b80a7e3076 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:21.734365 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-50c5d447-40ae-4cb8-95f6-b7b80a7e3076 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:21.735016 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-50c5d447-40ae-4cb8-95f6-b7b80a7e3076 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:21.987644 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-50c5d447-40ae-4cb8-95f6-b7b80a7e3076 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/354e97e3-b872-4e92-a97d-1d840ab8bf5e" status: 200 len: 1649 microversion: 2.1 time: 0.278281 Sep 14 09:23:21.988315 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2993/5958] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:23:21 2022] GET /compute/v2.1/servers/354e97e3-b872-4e92-a97d-1d840ab8bf5e => generated 1649 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:23:22.010046 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a936d68a-ac6a-4320-9372-5e36860a5da2 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:22.010678 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-a936d68a-ac6a-4320-9372-5e36860a5da2 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] [instance: 354e97e3-b872-4e92-a97d-1d840ab8bf5e] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:22.017354 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a936d68a-ac6a-4320-9372-5e36860a5da2 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:22.017855 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a936d68a-ac6a-4320-9372-5e36860a5da2 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:22.018300 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a936d68a-ac6a-4320-9372-5e36860a5da2 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:22.019068 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a936d68a-ac6a-4320-9372-5e36860a5da2 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:22.019541 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a936d68a-ac6a-4320-9372-5e36860a5da2 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:22.019976 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a936d68a-ac6a-4320-9372-5e36860a5da2 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:22.211641 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a936d68a-ac6a-4320-9372-5e36860a5da2 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/354e97e3-b872-4e92-a97d-1d840ab8bf5e" status: 200 len: 1649 microversion: 2.1 time: 0.205187 Sep 14 09:23:22.212556 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2966/5959] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:23:22 2022] GET /compute/v2.1/servers/354e97e3-b872-4e92-a97d-1d840ab8bf5e => generated 1649 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:23:22.237330 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c62cad0d-e152-452a-8eef-ff54560da808 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:22.238142 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-c62cad0d-e152-452a-8eef-ff54560da808 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] [instance: 354e97e3-b872-4e92-a97d-1d840ab8bf5e] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:22.244840 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c62cad0d-e152-452a-8eef-ff54560da808 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:22.245689 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c62cad0d-e152-452a-8eef-ff54560da808 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:22.246349 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c62cad0d-e152-452a-8eef-ff54560da808 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:22.247286 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c62cad0d-e152-452a-8eef-ff54560da808 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:22.247934 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c62cad0d-e152-452a-8eef-ff54560da808 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:22.248471 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c62cad0d-e152-452a-8eef-ff54560da808 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:22.392368 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-c62cad0d-e152-452a-8eef-ff54560da808 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/354e97e3-b872-4e92-a97d-1d840ab8bf5e" status: 200 len: 1649 microversion: 2.1 time: 0.160639 Sep 14 09:23:22.409972 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2994/5960] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:23:22 2022] GET /compute/v2.1/servers/354e97e3-b872-4e92-a97d-1d840ab8bf5e => generated 1649 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:23:22.416259 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-0ee81a71-4a47-4258-b0e1-5605b8522771 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:22.416999 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-0ee81a71-4a47-4258-b0e1-5605b8522771 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] [instance: 354e97e3-b872-4e92-a97d-1d840ab8bf5e] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:22.423602 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0ee81a71-4a47-4258-b0e1-5605b8522771 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:22.424100 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0ee81a71-4a47-4258-b0e1-5605b8522771 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:22.424551 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0ee81a71-4a47-4258-b0e1-5605b8522771 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:22.425257 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0ee81a71-4a47-4258-b0e1-5605b8522771 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:22.425720 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0ee81a71-4a47-4258-b0e1-5605b8522771 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:22.426153 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0ee81a71-4a47-4258-b0e1-5605b8522771 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:22.457516 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-0ee81a71-4a47-4258-b0e1-5605b8522771 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] [instance: 354e97e3-b872-4e92-a97d-1d840ab8bf5e] Going to try to terminate instance {{(pid=128759) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:23:22.552236 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-0ee81a71-4a47-4258-b0e1-5605b8522771 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] 10.222.0.60 "DELETE /compute/v2.1/servers/354e97e3-b872-4e92-a97d-1d840ab8bf5e" status: 204 len: 0 microversion: 2.1 time: 0.139463 Sep 14 09:23:22.560430 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2967/5961] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:23:22 2022] DELETE /compute/v2.1/servers/354e97e3-b872-4e92-a97d-1d840ab8bf5e => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:23:22.566372 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-37a92546-9d71-4b30-8873-d3a048d786c0 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:22.567048 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-37a92546-9d71-4b30-8873-d3a048d786c0 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] [instance: 354e97e3-b872-4e92-a97d-1d840ab8bf5e] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:22.576654 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-37a92546-9d71-4b30-8873-d3a048d786c0 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:22.577138 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-37a92546-9d71-4b30-8873-d3a048d786c0 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:22.577576 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-37a92546-9d71-4b30-8873-d3a048d786c0 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:22.579562 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-37a92546-9d71-4b30-8873-d3a048d786c0 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:22.580034 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-37a92546-9d71-4b30-8873-d3a048d786c0 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:22.580468 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-37a92546-9d71-4b30-8873-d3a048d786c0 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:22.728104 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-37a92546-9d71-4b30-8873-d3a048d786c0 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/354e97e3-b872-4e92-a97d-1d840ab8bf5e" status: 200 len: 1655 microversion: 2.1 time: 0.165867 Sep 14 09:23:22.729603 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2995/5962] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:23:22 2022] GET /compute/v2.1/servers/354e97e3-b872-4e92-a97d-1d840ab8bf5e => generated 1655 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:23:23.360077 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-6ac510d7-7476-4459-a347-d2c2ccd39e01 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-211321645", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "networks": "none"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:23:23.416496 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-6ac510d7-7476-4459-a347-d2c2ccd39e01 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Flavor limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:23:23.416922 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-6ac510d7-7476-4459-a347-d2c2ccd39e01 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Image limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:23:23.417402 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-6ac510d7-7476-4459-a347-d2c2ccd39e01 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Flavor pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:23:23.417885 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-6ac510d7-7476-4459-a347-d2c2ccd39e01 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Image pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:23:23.418305 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-6ac510d7-7476-4459-a347-d2c2ccd39e01 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:23:23.429304 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6ac510d7-7476-4459-a347-d2c2ccd39e01 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:23.431154 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6ac510d7-7476-4459-a347-d2c2ccd39e01 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:23.431913 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6ac510d7-7476-4459-a347-d2c2ccd39e01 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:23.432870 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6ac510d7-7476-4459-a347-d2c2ccd39e01 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:23.433573 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6ac510d7-7476-4459-a347-d2c2ccd39e01 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:23.434258 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6ac510d7-7476-4459-a347-d2c2ccd39e01 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:23.454382 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-6ac510d7-7476-4459-a347-d2c2ccd39e01 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Getting quotas for project 2a81e0c013b6450ebb75fe5a86220b36. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:23:23.460152 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-6ac510d7-7476-4459-a347-d2c2ccd39e01 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Getting quotas for user e46336ae28e14b1092c4f1b3778d83e5 and project 2a81e0c013b6450ebb75fe5a86220b36. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:23:23.473960 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-6ac510d7-7476-4459-a347-d2c2ccd39e01 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Going to run 1 instances... {{(pid=128759) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:23:23.476567 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-6ac510d7-7476-4459-a347-d2c2ccd39e01 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] [instance: 1653eed9-a1f5-4598-b083-85a1c8ee2bb7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128759) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:23:23.526025 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-6ac510d7-7476-4459-a347-d2c2ccd39e01 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.459633 Sep 14 09:23:23.527439 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2968/5963] 10.222.0.60 () {62 vars in 1188 bytes} [Wed Sep 14 09:23:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 462 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 14 09:23:23.538256 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-05f06876-3edd-43a5-b0ee-52389daad4fd tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:23.550627 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-05f06876-3edd-43a5-b0ee-52389daad4fd tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] [instance: 1653eed9-a1f5-4598-b083-85a1c8ee2bb7] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:23.645616 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-05f06876-3edd-43a5-b0ee-52389daad4fd tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46336ae28e14b1092c4f1b3778d83e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a81e0c013b6450ebb75fe5a86220b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:23.655382 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-05f06876-3edd-43a5-b0ee-52389daad4fd tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e46336ae28e14b1092c4f1b3778d83e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a81e0c013b6450ebb75fe5a86220b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:23.657172 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-05f06876-3edd-43a5-b0ee-52389daad4fd tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e46336ae28e14b1092c4f1b3778d83e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a81e0c013b6450ebb75fe5a86220b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:23.658360 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-05f06876-3edd-43a5-b0ee-52389daad4fd tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] 10.222.0.60 "GET /compute/v2.1/servers/1653eed9-a1f5-4598-b083-85a1c8ee2bb7" status: 200 len: 1277 microversion: 2.47 time: 0.124367 Sep 14 09:23:23.659111 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2996/5964] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:23:23 2022] GET /compute/v2.1/servers/1653eed9-a1f5-4598-b083-85a1c8ee2bb7 => generated 1277 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:23:23.733152 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-4182e299-9f32-41f4-b951-184ea2dae5c5 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1822698891", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "networks": "none"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:23:23.753330 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1977fb69-2033-4089-a6de-4d2af3666082 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:23.754545 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-1977fb69-2033-4089-a6de-4d2af3666082 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] [instance: 354e97e3-b872-4e92-a97d-1d840ab8bf5e] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:23.783298 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1977fb69-2033-4089-a6de-4d2af3666082 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:23.783896 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1977fb69-2033-4089-a6de-4d2af3666082 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:23.784350 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1977fb69-2033-4089-a6de-4d2af3666082 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:23.785100 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1977fb69-2033-4089-a6de-4d2af3666082 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:23.785564 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1977fb69-2033-4089-a6de-4d2af3666082 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:23.785991 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1977fb69-2033-4089-a6de-4d2af3666082 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:23.815883 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-4182e299-9f32-41f4-b951-184ea2dae5c5 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Flavor limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:23:23.816407 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-4182e299-9f32-41f4-b951-184ea2dae5c5 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Image limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:23:23.817183 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-4182e299-9f32-41f4-b951-184ea2dae5c5 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Flavor pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:23:23.817806 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-4182e299-9f32-41f4-b951-184ea2dae5c5 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Image pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:23:23.818425 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-4182e299-9f32-41f4-b951-184ea2dae5c5 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:23:23.834478 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4182e299-9f32-41f4-b951-184ea2dae5c5 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:23.835548 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4182e299-9f32-41f4-b951-184ea2dae5c5 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:23.835892 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4182e299-9f32-41f4-b951-184ea2dae5c5 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:23.836667 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4182e299-9f32-41f4-b951-184ea2dae5c5 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:23.837221 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4182e299-9f32-41f4-b951-184ea2dae5c5 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:23.837659 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4182e299-9f32-41f4-b951-184ea2dae5c5 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:23.865050 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-4182e299-9f32-41f4-b951-184ea2dae5c5 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Getting quotas for project 2a81e0c013b6450ebb75fe5a86220b36. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:23:23.879636 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-4182e299-9f32-41f4-b951-184ea2dae5c5 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Getting quotas for user e46336ae28e14b1092c4f1b3778d83e5 and project 2a81e0c013b6450ebb75fe5a86220b36. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:23:23.907344 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-4182e299-9f32-41f4-b951-184ea2dae5c5 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Going to run 1 instances... {{(pid=128759) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:23:23.910640 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-4182e299-9f32-41f4-b951-184ea2dae5c5 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] [instance: 48a1400e-608d-43af-8a2a-257a5c4c316b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128759) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:23:23.937414 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=3,nova_api:INSERT=6 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:23:24.030347 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-4182e299-9f32-41f4-b951-184ea2dae5c5 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.303958 Sep 14 09:23:24.033408 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2969/5965] 10.222.0.60 () {62 vars in 1188 bytes} [Wed Sep 14 09:23:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 308 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 14 09:23:24.046171 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-10aecf8f-a022-4581-bb28-8d8cdcab4879 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:23:24.053005 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-10aecf8f-a022-4581-bb28-8d8cdcab4879 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] [instance: 48a1400e-608d-43af-8a2a-257a5c4c316b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:24.060124 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-1977fb69-2033-4089-a6de-4d2af3666082 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/354e97e3-b872-4e92-a97d-1d840ab8bf5e" status: 200 len: 1655 microversion: 2.1 time: 0.310771 Sep 14 09:23:24.069878 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2997/5966] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:23:23 2022] GET /compute/v2.1/servers/354e97e3-b872-4e92-a97d-1d840ab8bf5e => generated 1655 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:23:24.151639 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-10aecf8f-a022-4581-bb28-8d8cdcab4879 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] 10.222.0.60 "PUT /compute/v2.1/servers/48a1400e-608d-43af-8a2a-257a5c4c316b" status: 200 len: 992 microversion: 2.47 time: 0.110561 Sep 14 09:23:24.152296 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2970/5967] 10.222.0.60 () {62 vars in 1297 bytes} [Wed Sep 14 09:23:24 2022] PUT /compute/v2.1/servers/48a1400e-608d-43af-8a2a-257a5c4c316b => generated 992 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 14 09:23:24.181240 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-75fbd58b-692b-4811-80c2-df9dd68daa06 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:24.181978 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-75fbd58b-692b-4811-80c2-df9dd68daa06 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] [instance: 48a1400e-608d-43af-8a2a-257a5c4c316b] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:24.295031 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-75fbd58b-692b-4811-80c2-df9dd68daa06 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46336ae28e14b1092c4f1b3778d83e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a81e0c013b6450ebb75fe5a86220b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:24.307448 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-75fbd58b-692b-4811-80c2-df9dd68daa06 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e46336ae28e14b1092c4f1b3778d83e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a81e0c013b6450ebb75fe5a86220b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:24.309765 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-75fbd58b-692b-4811-80c2-df9dd68daa06 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e46336ae28e14b1092c4f1b3778d83e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a81e0c013b6450ebb75fe5a86220b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:24.311336 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-75fbd58b-692b-4811-80c2-df9dd68daa06 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] 10.222.0.60 "GET /compute/v2.1/servers/48a1400e-608d-43af-8a2a-257a5c4c316b" status: 200 len: 1278 microversion: 2.47 time: 0.136637 Sep 14 09:23:24.324842 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2998/5968] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:23:24 2022] GET /compute/v2.1/servers/48a1400e-608d-43af-8a2a-257a5c4c316b => generated 1278 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:23:24.656091 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-cfeeca5c-78d7-4b88-ba05-23aca6761fc3 req-6e76b2ea-35a6-4898-8084-7f3198f128c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "354e97e3-b872-4e92-a97d-1d840ab8bf5e", "name": "network-vif-deleted", "tag": "ec1d96b7-659d-4a45-9c9c-c0ad3013fc5d"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:23:24.666772 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-cfeeca5c-78d7-4b88-ba05-23aca6761fc3 req-6e76b2ea-35a6-4898-8084-7f3198f128c6 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:24.668137 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-cfeeca5c-78d7-4b88-ba05-23aca6761fc3 req-6e76b2ea-35a6-4898-8084-7f3198f128c6 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:24.668979 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-cfeeca5c-78d7-4b88-ba05-23aca6761fc3 req-6e76b2ea-35a6-4898-8084-7f3198f128c6 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:24.688111 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-cfeeca5c-78d7-4b88-ba05-23aca6761fc3 req-6e76b2ea-35a6-4898-8084-7f3198f128c6 service nova] Creating event network-vif-deleted:ec1d96b7-659d-4a45-9c9c-c0ad3013fc5d for instance 354e97e3-b872-4e92-a97d-1d840ab8bf5e on n-h2-836830-18 Sep 14 09:23:24.694043 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-cfeeca5c-78d7-4b88-ba05-23aca6761fc3 req-6e76b2ea-35a6-4898-8084-7f3198f128c6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042766 Sep 14 09:23:24.698403 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2971/5969] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:23:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:23:25.102784 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-7a641681-a0ba-43a1-9b43-f050557ae0e0 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:25.106157 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-7a641681-a0ba-43a1-9b43-f050557ae0e0 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] [instance: 354e97e3-b872-4e92-a97d-1d840ab8bf5e] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:25.130313 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7a641681-a0ba-43a1-9b43-f050557ae0e0 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:25.130840 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7a641681-a0ba-43a1-9b43-f050557ae0e0 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:25.131316 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7a641681-a0ba-43a1-9b43-f050557ae0e0 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:25.132024 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7a641681-a0ba-43a1-9b43-f050557ae0e0 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:25.132484 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7a641681-a0ba-43a1-9b43-f050557ae0e0 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:25.132910 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7a641681-a0ba-43a1-9b43-f050557ae0e0 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:25.193640 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7a641681-a0ba-43a1-9b43-f050557ae0e0 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:25.197937 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7a641681-a0ba-43a1-9b43-f050557ae0e0 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:25.198623 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7a641681-a0ba-43a1-9b43-f050557ae0e0 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:25.199423 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.objects.instance [None req-7a641681-a0ba-43a1-9b43-f050557ae0e0 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lazy-loading 'fault' on Instance uuid 354e97e3-b872-4e92-a97d-1d840ab8bf5e {{(pid=128758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:23:25.343981 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b3ca7ddd-ed09-4d0a-b5af-3c5b04dd7327 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:25.345044 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b3ca7ddd-ed09-4d0a-b5af-3c5b04dd7327 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] [instance: 48a1400e-608d-43af-8a2a-257a5c4c316b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:25.365759 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b3ca7ddd-ed09-4d0a-b5af-3c5b04dd7327 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:25.366447 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b3ca7ddd-ed09-4d0a-b5af-3c5b04dd7327 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:25.367369 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b3ca7ddd-ed09-4d0a-b5af-3c5b04dd7327 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:25.368663 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b3ca7ddd-ed09-4d0a-b5af-3c5b04dd7327 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:25.369514 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b3ca7ddd-ed09-4d0a-b5af-3c5b04dd7327 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:25.370298 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b3ca7ddd-ed09-4d0a-b5af-3c5b04dd7327 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:25.486016 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-7a641681-a0ba-43a1-9b43-f050557ae0e0 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/354e97e3-b872-4e92-a97d-1d840ab8bf5e" status: 200 len: 1455 microversion: 2.1 time: 0.394305 Sep 14 09:23:25.503403 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 2999/5970] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:23:25 2022] GET /compute/v2.1/servers/354e97e3-b872-4e92-a97d-1d840ab8bf5e => generated 1455 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:23:25.522666 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b3ca7ddd-ed09-4d0a-b5af-3c5b04dd7327 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46336ae28e14b1092c4f1b3778d83e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a81e0c013b6450ebb75fe5a86220b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:25.531916 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b3ca7ddd-ed09-4d0a-b5af-3c5b04dd7327 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e46336ae28e14b1092c4f1b3778d83e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a81e0c013b6450ebb75fe5a86220b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:25.533746 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b3ca7ddd-ed09-4d0a-b5af-3c5b04dd7327 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e46336ae28e14b1092c4f1b3778d83e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a81e0c013b6450ebb75fe5a86220b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:25.534895 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b3ca7ddd-ed09-4d0a-b5af-3c5b04dd7327 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] 10.222.0.60 "GET /compute/v2.1/servers/48a1400e-608d-43af-8a2a-257a5c4c316b" status: 200 len: 1274 microversion: 2.47 time: 0.198944 Sep 14 09:23:25.535488 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2972/5971] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:23:25 2022] GET /compute/v2.1/servers/48a1400e-608d-43af-8a2a-257a5c4c316b => generated 1274 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 09:23:26.524965 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-80515f34-dc24-4522-989e-1652186261d4 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:26.534875 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-80515f34-dc24-4522-989e-1652186261d4 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] [instance: 354e97e3-b872-4e92-a97d-1d840ab8bf5e] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:26.562376 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-92692b47-a991-4eb1-afd5-85630b0853e3 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:26.564489 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-92692b47-a991-4eb1-afd5-85630b0853e3 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] [instance: 48a1400e-608d-43af-8a2a-257a5c4c316b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:26.583896 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-80515f34-dc24-4522-989e-1652186261d4 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:26.586035 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-80515f34-dc24-4522-989e-1652186261d4 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:26.587435 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-80515f34-dc24-4522-989e-1652186261d4 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:26.590551 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-80515f34-dc24-4522-989e-1652186261d4 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:26.593363 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-92692b47-a991-4eb1-afd5-85630b0853e3 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:26.594196 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-92692b47-a991-4eb1-afd5-85630b0853e3 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:26.594892 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-80515f34-dc24-4522-989e-1652186261d4 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:26.596272 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-80515f34-dc24-4522-989e-1652186261d4 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:26.597607 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-92692b47-a991-4eb1-afd5-85630b0853e3 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:26.601643 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-92692b47-a991-4eb1-afd5-85630b0853e3 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:26.602312 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-92692b47-a991-4eb1-afd5-85630b0853e3 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:26.603027 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-92692b47-a991-4eb1-afd5-85630b0853e3 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:26.651571 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-80515f34-dc24-4522-989e-1652186261d4 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] HTTP exception thrown: Instance 354e97e3-b872-4e92-a97d-1d840ab8bf5e could not be found. Sep 14 09:23:26.657272 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-80515f34-dc24-4522-989e-1652186261d4 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Request method failure captured: Sep 14 09:23:26.657272 n-d-836830-18 devstack@n-api.service[128758]: request: GET /compute/v2.1/servers/354e97e3-b872-4e92-a97d-1d840ab8bf5e HTTP/1.1 Sep 14 09:23:26.657272 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 09:23:26.657272 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 09:23:26.657272 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 09:23:26.657272 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 09:23:26.657272 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 09:23:26.657272 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 09:23:26.657272 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 09:23:26.657272 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 09:23:26.657272 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZ1qhi6yYfJb4x6l4AVNVJvhrH2HNyMiPYd7I-YYErO-Sd8HVezRC7tGywvvEcEFj1vOm0lbVq2fPff8Upy49rzSgC1hLOyjBhoxS7vMXSYudluj1Zeneon3-Ehg9ixIbid0E6z4fgMajcBr5L2EKKXEzwh8rSCzJQepyhX08BN6gNQ Sep 14 09:23:26.657272 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 09:23:26.657272 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 09:23:26.657272 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 09:23:26.657272 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 09:23:26.657272 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 09:23:26.657272 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 09:23:26.657272 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 14a09c3de89348238ba73b14d4821203 Sep 14 09:23:26.657272 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-TestServerMultinode-365974897 Sep 14 09:23:26.657272 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member,admin Sep 14 09:23:26.657272 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member,admin Sep 14 09:23:26.657272 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/14a09c3de89348238ba73b14d4821203"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_14a09c3de89348238ba73b14d4821203"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/14a09c3de89348238ba73b14d4821203"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/14a09c3de89348238ba73b14d4821203"}]}] Sep 14 09:23:26.657272 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-TestServerMultinode-365974897 Sep 14 09:23:26.657272 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 14a09c3de89348238ba73b14d4821203 Sep 14 09:23:26.657272 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-TestServerMultinode-365974897 Sep 14 09:23:26.657272 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-TestServerMultinode-365974897-project-admin Sep 14 09:23:26.657272 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 09:23:26.657272 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 09:23:26.657272 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: ab7bff910aa44aa3a2c18a48893147a0 Sep 14 09:23:26.657272 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-TestServerMultinode-365974897-project-admin Sep 14 09:23:26.657272 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 09:23:26.657272 n-d-836830-18 devstack@n-api.service[128758]: exception: Instance 354e97e3-b872-4e92-a97d-1d840ab8bf5e could not be found. Sep 14 09:23:26.657272 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': '354e97e3-b872-4e92-a97d-1d840ab8bf5e'} Sep 14 09:23:26.657272 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:23:26.657272 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:23:26.657272 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:23:26.657272 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:23:26.657272 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:23:26.657272 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:23:26.657272 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:23:26.657272 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:23:26.657272 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:23:26.657272 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:23:26.657272 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 354e97e3-b872-4e92-a97d-1d840ab8bf5e could not be found. Sep 14 09:23:26.657272 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:23:26.657272 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:23:26.657272 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:23:26.657272 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:23:26.657272 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:23:26.657272 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:23:26.657272 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:23:26.657272 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:23:26.657272 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:23:26.657272 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:23:26.657272 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:23:26.657272 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:23:26.657272 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:23:26.657272 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:23:26.657272 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:23:26.657272 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:23:26.657272 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 354e97e3-b872-4e92-a97d-1d840ab8bf5e could not be found. Sep 14 09:23:26.657272 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:23:26.657272 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:23:26.657272 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:23:26.660825 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:23:26.660825 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:23:26.660825 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:23:26.660825 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:23:26.660825 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:23:26.660825 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 354e97e3-b872-4e92-a97d-1d840ab8bf5e could not be found. Sep 14 09:23:26.660825 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:23:26.663649 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-80515f34-dc24-4522-989e-1652186261d4 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Returning 404 to user: Instance 354e97e3-b872-4e92-a97d-1d840ab8bf5e could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:23:26.664928 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-80515f34-dc24-4522-989e-1652186261d4 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/354e97e3-b872-4e92-a97d-1d840ab8bf5e" status: 404 len: 111 microversion: 2.1 time: 0.144394 Sep 14 09:23:26.666151 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3000/5972] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:23:26 2022] GET /compute/v2.1/servers/354e97e3-b872-4e92-a97d-1d840ab8bf5e => generated 111 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:23:26.682236 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1e64b0ab-80a9-471b-900c-aecfe4dd450f tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:26.684377 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-1e64b0ab-80a9-471b-900c-aecfe4dd450f tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] [instance: 59078c54-87eb-46f8-8aec-fdfa0056e0d3] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:26.712341 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1e64b0ab-80a9-471b-900c-aecfe4dd450f tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:26.713103 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1e64b0ab-80a9-471b-900c-aecfe4dd450f tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:26.713696 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1e64b0ab-80a9-471b-900c-aecfe4dd450f tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:26.715304 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1e64b0ab-80a9-471b-900c-aecfe4dd450f tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:26.717972 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1e64b0ab-80a9-471b-900c-aecfe4dd450f tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:26.718748 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1e64b0ab-80a9-471b-900c-aecfe4dd450f tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:26.775797 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-1e64b0ab-80a9-471b-900c-aecfe4dd450f tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] [instance: 59078c54-87eb-46f8-8aec-fdfa0056e0d3] Going to try to terminate instance {{(pid=128758) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:23:26.782413 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-92692b47-a991-4eb1-afd5-85630b0853e3 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46336ae28e14b1092c4f1b3778d83e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a81e0c013b6450ebb75fe5a86220b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:26.796399 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-92692b47-a991-4eb1-afd5-85630b0853e3 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e46336ae28e14b1092c4f1b3778d83e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a81e0c013b6450ebb75fe5a86220b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:26.798889 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-92692b47-a991-4eb1-afd5-85630b0853e3 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e46336ae28e14b1092c4f1b3778d83e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a81e0c013b6450ebb75fe5a86220b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:26.800279 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-92692b47-a991-4eb1-afd5-85630b0853e3 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] 10.222.0.60 "GET /compute/v2.1/servers/48a1400e-608d-43af-8a2a-257a5c4c316b" status: 200 len: 1330 microversion: 2.47 time: 0.242861 Sep 14 09:23:26.801289 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2973/5973] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:23:26 2022] GET /compute/v2.1/servers/48a1400e-608d-43af-8a2a-257a5c4c316b => generated 1330 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:23:26.892875 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-1e64b0ab-80a9-471b-900c-aecfe4dd450f tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] 10.222.0.60 "DELETE /compute/v2.1/servers/59078c54-87eb-46f8-8aec-fdfa0056e0d3" status: 204 len: 0 microversion: 2.1 time: 0.220768 Sep 14 09:23:26.894962 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3001/5974] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:23:26 2022] DELETE /compute/v2.1/servers/59078c54-87eb-46f8-8aec-fdfa0056e0d3 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:23:26.904684 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-6d016453-29ce-41a6-a1da-c6da8744263c tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:26.905554 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-6d016453-29ce-41a6-a1da-c6da8744263c tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] [instance: 59078c54-87eb-46f8-8aec-fdfa0056e0d3] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:26.912927 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6d016453-29ce-41a6-a1da-c6da8744263c tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:26.913663 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6d016453-29ce-41a6-a1da-c6da8744263c tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:26.914395 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6d016453-29ce-41a6-a1da-c6da8744263c tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:26.915331 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6d016453-29ce-41a6-a1da-c6da8744263c tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:26.915945 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6d016453-29ce-41a6-a1da-c6da8744263c tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:26.916832 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6d016453-29ce-41a6-a1da-c6da8744263c tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:27.074741 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:23:27.077451 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-6d016453-29ce-41a6-a1da-c6da8744263c tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/59078c54-87eb-46f8-8aec-fdfa0056e0d3" status: 200 len: 1656 microversion: 2.1 time: 0.177937 Sep 14 09:23:27.078286 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2974/5975] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:23:26 2022] GET /compute/v2.1/servers/59078c54-87eb-46f8-8aec-fdfa0056e0d3 => generated 1656 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:23:27.827616 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-13709008-4240-418a-8fe7-038ea26a3567 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:27.828905 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-13709008-4240-418a-8fe7-038ea26a3567 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] [instance: 48a1400e-608d-43af-8a2a-257a5c4c316b] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:27.836402 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-13709008-4240-418a-8fe7-038ea26a3567 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:27.837255 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-13709008-4240-418a-8fe7-038ea26a3567 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:27.837878 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-13709008-4240-418a-8fe7-038ea26a3567 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:27.838754 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-13709008-4240-418a-8fe7-038ea26a3567 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:27.839624 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-13709008-4240-418a-8fe7-038ea26a3567 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:27.840214 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-13709008-4240-418a-8fe7-038ea26a3567 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:27.946678 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-13709008-4240-418a-8fe7-038ea26a3567 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46336ae28e14b1092c4f1b3778d83e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a81e0c013b6450ebb75fe5a86220b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:27.950930 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:23:27.958043 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-13709008-4240-418a-8fe7-038ea26a3567 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e46336ae28e14b1092c4f1b3778d83e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a81e0c013b6450ebb75fe5a86220b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:27.960993 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-13709008-4240-418a-8fe7-038ea26a3567 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e46336ae28e14b1092c4f1b3778d83e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a81e0c013b6450ebb75fe5a86220b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:27.962980 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-13709008-4240-418a-8fe7-038ea26a3567 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] 10.222.0.60 "GET /compute/v2.1/servers/48a1400e-608d-43af-8a2a-257a5c4c316b" status: 200 len: 1336 microversion: 2.47 time: 0.140651 Sep 14 09:23:27.964217 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3002/5976] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:23:27 2022] GET /compute/v2.1/servers/48a1400e-608d-43af-8a2a-257a5c4c316b => generated 1336 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:23:28.106996 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-1ed49a29-9c8e-496f-b66f-6c8c33ceacf0 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:28.107631 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-1ed49a29-9c8e-496f-b66f-6c8c33ceacf0 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] [instance: 59078c54-87eb-46f8-8aec-fdfa0056e0d3] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:28.115940 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1ed49a29-9c8e-496f-b66f-6c8c33ceacf0 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:28.116658 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1ed49a29-9c8e-496f-b66f-6c8c33ceacf0 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:28.117117 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1ed49a29-9c8e-496f-b66f-6c8c33ceacf0 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:28.117866 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1ed49a29-9c8e-496f-b66f-6c8c33ceacf0 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:28.118480 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1ed49a29-9c8e-496f-b66f-6c8c33ceacf0 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:28.119099 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1ed49a29-9c8e-496f-b66f-6c8c33ceacf0 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:28.259476 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-1ed49a29-9c8e-496f-b66f-6c8c33ceacf0 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/59078c54-87eb-46f8-8aec-fdfa0056e0d3" status: 200 len: 1656 microversion: 2.1 time: 0.156847 Sep 14 09:23:28.260077 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2975/5977] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:23:28 2022] GET /compute/v2.1/servers/59078c54-87eb-46f8-8aec-fdfa0056e0d3 => generated 1656 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:23:28.989797 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-31c780db-9ba8-4cbf-8add-8c9058b9d264 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:28.991669 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-31c780db-9ba8-4cbf-8add-8c9058b9d264 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] [instance: 48a1400e-608d-43af-8a2a-257a5c4c316b] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:29.000205 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-31c780db-9ba8-4cbf-8add-8c9058b9d264 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:29.000922 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-31c780db-9ba8-4cbf-8add-8c9058b9d264 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:29.001533 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-31c780db-9ba8-4cbf-8add-8c9058b9d264 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:29.002440 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-31c780db-9ba8-4cbf-8add-8c9058b9d264 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:29.003097 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-31c780db-9ba8-4cbf-8add-8c9058b9d264 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:29.003699 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-31c780db-9ba8-4cbf-8add-8c9058b9d264 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:29.084677 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-31c780db-9ba8-4cbf-8add-8c9058b9d264 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46336ae28e14b1092c4f1b3778d83e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a81e0c013b6450ebb75fe5a86220b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:29.095158 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-31c780db-9ba8-4cbf-8add-8c9058b9d264 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e46336ae28e14b1092c4f1b3778d83e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a81e0c013b6450ebb75fe5a86220b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:29.096939 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-31c780db-9ba8-4cbf-8add-8c9058b9d264 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e46336ae28e14b1092c4f1b3778d83e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a81e0c013b6450ebb75fe5a86220b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:29.098144 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-31c780db-9ba8-4cbf-8add-8c9058b9d264 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] 10.222.0.60 "GET /compute/v2.1/servers/48a1400e-608d-43af-8a2a-257a5c4c316b" status: 200 len: 1336 microversion: 2.47 time: 0.111722 Sep 14 09:23:29.098905 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3003/5978] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:23:28 2022] GET /compute/v2.1/servers/48a1400e-608d-43af-8a2a-257a5c4c316b => generated 1336 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 09:23:29.237423 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-43faf5e4-4d02-477f-bda7-54cdf7da8b26 req-e402d54a-0cf8-43e4-b675-4e701a6a688f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59078c54-87eb-46f8-8aec-fdfa0056e0d3", "name": "network-vif-deleted", "tag": "16c09bb8-02ef-4b6b-a646-8bd6ecc9aec7"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:23:29.249050 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-43faf5e4-4d02-477f-bda7-54cdf7da8b26 req-e402d54a-0cf8-43e4-b675-4e701a6a688f service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:29.249532 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-43faf5e4-4d02-477f-bda7-54cdf7da8b26 req-e402d54a-0cf8-43e4-b675-4e701a6a688f service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:29.249967 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-43faf5e4-4d02-477f-bda7-54cdf7da8b26 req-e402d54a-0cf8-43e4-b675-4e701a6a688f service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:29.284266 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-63dc3ed2-013b-4b52-a981-b0d5e687b207 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:29.285277 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-63dc3ed2-013b-4b52-a981-b0d5e687b207 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] [instance: 59078c54-87eb-46f8-8aec-fdfa0056e0d3] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:29.286349 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-43faf5e4-4d02-477f-bda7-54cdf7da8b26 req-e402d54a-0cf8-43e4-b675-4e701a6a688f service nova] Creating event network-vif-deleted:16c09bb8-02ef-4b6b-a646-8bd6ecc9aec7 for instance 59078c54-87eb-46f8-8aec-fdfa0056e0d3 on n-h1-836830-18 Sep 14 09:23:29.295248 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-63dc3ed2-013b-4b52-a981-b0d5e687b207 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:29.296010 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-63dc3ed2-013b-4b52-a981-b0d5e687b207 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:29.296658 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-63dc3ed2-013b-4b52-a981-b0d5e687b207 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:29.297551 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-63dc3ed2-013b-4b52-a981-b0d5e687b207 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:29.298311 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-63dc3ed2-013b-4b52-a981-b0d5e687b207 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:29.299983 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-63dc3ed2-013b-4b52-a981-b0d5e687b207 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:29.306305 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-43faf5e4-4d02-477f-bda7-54cdf7da8b26 req-e402d54a-0cf8-43e4-b675-4e701a6a688f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072520 Sep 14 09:23:29.310880 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2976/5979] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:23:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:23:29.395715 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-63dc3ed2-013b-4b52-a981-b0d5e687b207 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/59078c54-87eb-46f8-8aec-fdfa0056e0d3" status: 200 len: 1451 microversion: 2.1 time: 0.115974 Sep 14 09:23:29.397399 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3004/5980] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:23:29 2022] GET /compute/v2.1/servers/59078c54-87eb-46f8-8aec-fdfa0056e0d3 => generated 1451 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:23:30.132933 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-dc7e1b84-6eb0-43f0-9110-aa08f8eb6e32 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:30.134367 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-dc7e1b84-6eb0-43f0-9110-aa08f8eb6e32 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] [instance: 48a1400e-608d-43af-8a2a-257a5c4c316b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:30.144251 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dc7e1b84-6eb0-43f0-9110-aa08f8eb6e32 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:30.145041 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dc7e1b84-6eb0-43f0-9110-aa08f8eb6e32 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:30.145809 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dc7e1b84-6eb0-43f0-9110-aa08f8eb6e32 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:30.146867 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dc7e1b84-6eb0-43f0-9110-aa08f8eb6e32 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:30.147882 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dc7e1b84-6eb0-43f0-9110-aa08f8eb6e32 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:30.149309 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dc7e1b84-6eb0-43f0-9110-aa08f8eb6e32 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:30.259878 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-dc7e1b84-6eb0-43f0-9110-aa08f8eb6e32 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46336ae28e14b1092c4f1b3778d83e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a81e0c013b6450ebb75fe5a86220b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:30.273335 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-dc7e1b84-6eb0-43f0-9110-aa08f8eb6e32 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e46336ae28e14b1092c4f1b3778d83e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a81e0c013b6450ebb75fe5a86220b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:30.275263 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-dc7e1b84-6eb0-43f0-9110-aa08f8eb6e32 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e46336ae28e14b1092c4f1b3778d83e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a81e0c013b6450ebb75fe5a86220b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:30.277215 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-dc7e1b84-6eb0-43f0-9110-aa08f8eb6e32 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] 10.222.0.60 "GET /compute/v2.1/servers/48a1400e-608d-43af-8a2a-257a5c4c316b" status: 200 len: 1357 microversion: 2.47 time: 0.155192 Sep 14 09:23:30.291006 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2977/5981] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:23:30 2022] GET /compute/v2.1/servers/48a1400e-608d-43af-8a2a-257a5c4c316b => generated 1357 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:23:30.305495 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-cc1586db-7e91-417d-9372-8c959c0b9344 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:23:30.309118 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-cc1586db-7e91-417d-9372-8c959c0b9344 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] [instance: 48a1400e-608d-43af-8a2a-257a5c4c316b] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:30.316458 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cc1586db-7e91-417d-9372-8c959c0b9344 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:30.317239 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cc1586db-7e91-417d-9372-8c959c0b9344 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:30.317882 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cc1586db-7e91-417d-9372-8c959c0b9344 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:30.318900 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cc1586db-7e91-417d-9372-8c959c0b9344 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:30.319633 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cc1586db-7e91-417d-9372-8c959c0b9344 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:30.320260 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cc1586db-7e91-417d-9372-8c959c0b9344 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:30.415595 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-cc1586db-7e91-417d-9372-8c959c0b9344 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Flavor limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:23:30.416293 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-cc1586db-7e91-417d-9372-8c959c0b9344 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Image limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:23:30.417077 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-cc1586db-7e91-417d-9372-8c959c0b9344 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Flavor pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:23:30.417716 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-cc1586db-7e91-417d-9372-8c959c0b9344 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Image pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:23:30.418344 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-cc1586db-7e91-417d-9372-8c959c0b9344 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:23:30.419707 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8b86d4bf-7b5b-4ae4-9f1a-9b3a2f9cfe27 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:30.420339 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-8b86d4bf-7b5b-4ae4-9f1a-9b3a2f9cfe27 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] [instance: 59078c54-87eb-46f8-8aec-fdfa0056e0d3] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:30.428703 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8b86d4bf-7b5b-4ae4-9f1a-9b3a2f9cfe27 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:30.430374 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8b86d4bf-7b5b-4ae4-9f1a-9b3a2f9cfe27 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:30.431052 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8b86d4bf-7b5b-4ae4-9f1a-9b3a2f9cfe27 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:30.432709 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8b86d4bf-7b5b-4ae4-9f1a-9b3a2f9cfe27 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:30.434081 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8b86d4bf-7b5b-4ae4-9f1a-9b3a2f9cfe27 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:30.435375 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8b86d4bf-7b5b-4ae4-9f1a-9b3a2f9cfe27 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:30.464862 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-8b86d4bf-7b5b-4ae4-9f1a-9b3a2f9cfe27 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] HTTP exception thrown: Instance 59078c54-87eb-46f8-8aec-fdfa0056e0d3 could not be found. Sep 14 09:23:30.468331 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8b86d4bf-7b5b-4ae4-9f1a-9b3a2f9cfe27 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Request method failure captured: Sep 14 09:23:30.468331 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/59078c54-87eb-46f8-8aec-fdfa0056e0d3 HTTP/1.1 Sep 14 09:23:30.468331 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:23:30.468331 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:23:30.468331 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:23:30.468331 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:23:30.468331 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:23:30.468331 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:23:30.468331 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:23:30.468331 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:23:30.468331 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZ1qhi6yYfJb4x6l4AVNVJvhrH2HNyMiPYd7I-YYErO-Sd8HVezRC7tGywvvEcEFj1vOm0lbVq2fPff8Upy49rzSgC1hLOyjBhoxS7vMXSYudluj1Zeneon3-Ehg9ixIbid0E6z4fgMajcBr5L2EKKXEzwh8rSCzJQepyhX08BN6gNQ Sep 14 09:23:30.468331 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:23:30.468331 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:23:30.468331 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:23:30.468331 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:23:30.468331 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:23:30.468331 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:23:30.468331 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 14a09c3de89348238ba73b14d4821203 Sep 14 09:23:30.468331 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-TestServerMultinode-365974897 Sep 14 09:23:30.468331 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member,admin Sep 14 09:23:30.468331 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member,admin Sep 14 09:23:30.468331 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/14a09c3de89348238ba73b14d4821203"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_14a09c3de89348238ba73b14d4821203"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/14a09c3de89348238ba73b14d4821203"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/14a09c3de89348238ba73b14d4821203"}]}] Sep 14 09:23:30.468331 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-TestServerMultinode-365974897 Sep 14 09:23:30.468331 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 14a09c3de89348238ba73b14d4821203 Sep 14 09:23:30.468331 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-TestServerMultinode-365974897 Sep 14 09:23:30.468331 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-TestServerMultinode-365974897-project-admin Sep 14 09:23:30.468331 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:23:30.468331 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:23:30.468331 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: ab7bff910aa44aa3a2c18a48893147a0 Sep 14 09:23:30.468331 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-TestServerMultinode-365974897-project-admin Sep 14 09:23:30.468331 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:23:30.468331 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance 59078c54-87eb-46f8-8aec-fdfa0056e0d3 could not be found. Sep 14 09:23:30.468331 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '59078c54-87eb-46f8-8aec-fdfa0056e0d3'} Sep 14 09:23:30.468331 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:23:30.468331 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:23:30.468331 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:23:30.468331 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:23:30.468331 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:23:30.468331 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:23:30.468331 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:23:30.468331 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:23:30.468331 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:23:30.468331 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:23:30.468331 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59078c54-87eb-46f8-8aec-fdfa0056e0d3 could not be found. Sep 14 09:23:30.468331 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:23:30.468331 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:23:30.468331 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:23:30.468331 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:23:30.468331 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:23:30.468331 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:23:30.468331 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:23:30.468331 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:23:30.468331 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:23:30.468331 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:23:30.468331 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:23:30.468331 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:23:30.468331 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:23:30.468331 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:23:30.468331 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:23:30.468331 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:23:30.468331 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59078c54-87eb-46f8-8aec-fdfa0056e0d3 could not be found. Sep 14 09:23:30.468331 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:23:30.468331 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:23:30.468331 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:23:30.471970 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:23:30.471970 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:23:30.471970 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:23:30.471970 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:23:30.471970 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:23:30.471970 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59078c54-87eb-46f8-8aec-fdfa0056e0d3 could not be found. Sep 14 09:23:30.471970 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:23:30.476903 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8b86d4bf-7b5b-4ae4-9f1a-9b3a2f9cfe27 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] Returning 404 to user: Instance 59078c54-87eb-46f8-8aec-fdfa0056e0d3 could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:23:30.478311 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-8b86d4bf-7b5b-4ae4-9f1a-9b3a2f9cfe27 tempest-TestServerMultinode-365974897 tempest-TestServerMultinode-365974897-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/59078c54-87eb-46f8-8aec-fdfa0056e0d3" status: 404 len: 111 microversion: 2.1 time: 0.062188 Sep 14 09:23:30.479130 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2978/5982] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:23:30 2022] GET /compute/v2.1/servers/59078c54-87eb-46f8-8aec-fdfa0056e0d3 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 14 09:23:30.542059 n-d-836830-18 devstack@n-api.service[128758]: ERROR oslo.messaging._drivers.impl_rabbit [None req-cc1586db-7e91-417d-9372-8c959c0b9344 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] [70ca246a-8c7e-4cbe-9ecb-1ffd476aea93] AMQP server on 10.222.0.60:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 14 09:23:31.553529 n-d-836830-18 devstack@n-api.service[128758]: INFO oslo.messaging._drivers.impl_rabbit [None req-cc1586db-7e91-417d-9372-8c959c0b9344 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] [70ca246a-8c7e-4cbe-9ecb-1ffd476aea93] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 33942. Sep 14 09:23:31.560329 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-cc1586db-7e91-417d-9372-8c959c0b9344 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] [instance: 48a1400e-608d-43af-8a2a-257a5c4c316b] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:31.570458 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cc1586db-7e91-417d-9372-8c959c0b9344 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:31.571633 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cc1586db-7e91-417d-9372-8c959c0b9344 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:31.572287 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cc1586db-7e91-417d-9372-8c959c0b9344 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:31.573771 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cc1586db-7e91-417d-9372-8c959c0b9344 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:31.574714 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cc1586db-7e91-417d-9372-8c959c0b9344 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:31.575873 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cc1586db-7e91-417d-9372-8c959c0b9344 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:31.614650 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-cc1586db-7e91-417d-9372-8c959c0b9344 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] 10.222.0.60 "POST /compute/v2.1/servers/48a1400e-608d-43af-8a2a-257a5c4c316b/action" status: 202 len: 1079 microversion: 2.47 time: 1.313449 Sep 14 09:23:31.615944 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3005/5983] 10.222.0.60 () {62 vars in 1319 bytes} [Wed Sep 14 09:23:30 2022] POST /compute/v2.1/servers/48a1400e-608d-43af-8a2a-257a5c4c316b/action => generated 1079 bytes in 1315 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Sep 14 09:23:31.638501 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f114b0e8-c441-4f8d-ae8c-fd212027e58e tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:31.639902 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f114b0e8-c441-4f8d-ae8c-fd212027e58e tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] [instance: 48a1400e-608d-43af-8a2a-257a5c4c316b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:31.647531 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f114b0e8-c441-4f8d-ae8c-fd212027e58e tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:31.648253 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f114b0e8-c441-4f8d-ae8c-fd212027e58e tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:31.648867 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f114b0e8-c441-4f8d-ae8c-fd212027e58e tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:31.649975 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f114b0e8-c441-4f8d-ae8c-fd212027e58e tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:31.650648 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f114b0e8-c441-4f8d-ae8c-fd212027e58e tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:31.651267 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f114b0e8-c441-4f8d-ae8c-fd212027e58e tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:31.758002 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f114b0e8-c441-4f8d-ae8c-fd212027e58e tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46336ae28e14b1092c4f1b3778d83e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a81e0c013b6450ebb75fe5a86220b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:31.770287 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f114b0e8-c441-4f8d-ae8c-fd212027e58e tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e46336ae28e14b1092c4f1b3778d83e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a81e0c013b6450ebb75fe5a86220b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:31.774854 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f114b0e8-c441-4f8d-ae8c-fd212027e58e tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e46336ae28e14b1092c4f1b3778d83e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a81e0c013b6450ebb75fe5a86220b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:31.778538 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f114b0e8-c441-4f8d-ae8c-fd212027e58e tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] 10.222.0.60 "GET /compute/v2.1/servers/48a1400e-608d-43af-8a2a-257a5c4c316b" status: 200 len: 1366 microversion: 2.47 time: 0.144884 Sep 14 09:23:31.791129 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2979/5984] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:23:31 2022] GET /compute/v2.1/servers/48a1400e-608d-43af-8a2a-257a5c4c316b => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:23:32.813410 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-86f219de-0720-4885-bbb0-3865bd729301 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:32.815642 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-86f219de-0720-4885-bbb0-3865bd729301 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] [instance: 48a1400e-608d-43af-8a2a-257a5c4c316b] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:32.828704 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-86f219de-0720-4885-bbb0-3865bd729301 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:32.829530 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-86f219de-0720-4885-bbb0-3865bd729301 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:32.830310 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-86f219de-0720-4885-bbb0-3865bd729301 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:32.831332 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-86f219de-0720-4885-bbb0-3865bd729301 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:32.831968 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-86f219de-0720-4885-bbb0-3865bd729301 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:32.833374 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-86f219de-0720-4885-bbb0-3865bd729301 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:32.932183 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-86f219de-0720-4885-bbb0-3865bd729301 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46336ae28e14b1092c4f1b3778d83e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a81e0c013b6450ebb75fe5a86220b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:32.942714 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-86f219de-0720-4885-bbb0-3865bd729301 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e46336ae28e14b1092c4f1b3778d83e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a81e0c013b6450ebb75fe5a86220b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:32.944503 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-86f219de-0720-4885-bbb0-3865bd729301 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e46336ae28e14b1092c4f1b3778d83e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a81e0c013b6450ebb75fe5a86220b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:32.946423 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-86f219de-0720-4885-bbb0-3865bd729301 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] 10.222.0.60 "GET /compute/v2.1/servers/48a1400e-608d-43af-8a2a-257a5c4c316b" status: 200 len: 1366 microversion: 2.47 time: 0.139746 Sep 14 09:23:32.948163 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3006/5985] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:23:32 2022] GET /compute/v2.1/servers/48a1400e-608d-43af-8a2a-257a5c4c316b => generated 1366 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:23:33.973693 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-1302e1b8-77f5-496c-8701-a534c99e18bd tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:33.974328 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-1302e1b8-77f5-496c-8701-a534c99e18bd tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] [instance: 48a1400e-608d-43af-8a2a-257a5c4c316b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:33.981383 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=4 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:23:33.982424 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=12 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:23:33.984120 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1302e1b8-77f5-496c-8701-a534c99e18bd tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:33.984780 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1302e1b8-77f5-496c-8701-a534c99e18bd tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:33.985413 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1302e1b8-77f5-496c-8701-a534c99e18bd tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:33.986284 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1302e1b8-77f5-496c-8701-a534c99e18bd tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:33.987046 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1302e1b8-77f5-496c-8701-a534c99e18bd tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:33.987822 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1302e1b8-77f5-496c-8701-a534c99e18bd tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:34.360130 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-1302e1b8-77f5-496c-8701-a534c99e18bd tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46336ae28e14b1092c4f1b3778d83e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a81e0c013b6450ebb75fe5a86220b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:34.374848 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-1302e1b8-77f5-496c-8701-a534c99e18bd tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e46336ae28e14b1092c4f1b3778d83e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a81e0c013b6450ebb75fe5a86220b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:34.376418 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-1302e1b8-77f5-496c-8701-a534c99e18bd tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e46336ae28e14b1092c4f1b3778d83e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a81e0c013b6450ebb75fe5a86220b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:34.377661 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-1302e1b8-77f5-496c-8701-a534c99e18bd tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] 10.222.0.60 "GET /compute/v2.1/servers/48a1400e-608d-43af-8a2a-257a5c4c316b" status: 200 len: 1366 microversion: 2.47 time: 0.408387 Sep 14 09:23:34.391973 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2980/5986] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:23:33 2022] GET /compute/v2.1/servers/48a1400e-608d-43af-8a2a-257a5c4c316b => generated 1366 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:23:35.405006 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1d05ad51-9bc4-463c-a7b7-104f57afb509 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:35.405618 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-1d05ad51-9bc4-463c-a7b7-104f57afb509 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] [instance: 48a1400e-608d-43af-8a2a-257a5c4c316b] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:35.411758 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=4 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:23:35.413507 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1d05ad51-9bc4-463c-a7b7-104f57afb509 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:35.414118 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1d05ad51-9bc4-463c-a7b7-104f57afb509 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:35.414599 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1d05ad51-9bc4-463c-a7b7-104f57afb509 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:35.415486 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1d05ad51-9bc4-463c-a7b7-104f57afb509 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:35.415945 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1d05ad51-9bc4-463c-a7b7-104f57afb509 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:35.416541 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1d05ad51-9bc4-463c-a7b7-104f57afb509 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:35.521681 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-1d05ad51-9bc4-463c-a7b7-104f57afb509 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46336ae28e14b1092c4f1b3778d83e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a81e0c013b6450ebb75fe5a86220b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:35.530865 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-1d05ad51-9bc4-463c-a7b7-104f57afb509 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e46336ae28e14b1092c4f1b3778d83e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a81e0c013b6450ebb75fe5a86220b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:35.533077 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-1d05ad51-9bc4-463c-a7b7-104f57afb509 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e46336ae28e14b1092c4f1b3778d83e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a81e0c013b6450ebb75fe5a86220b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:35.534686 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-1d05ad51-9bc4-463c-a7b7-104f57afb509 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] 10.222.0.60 "GET /compute/v2.1/servers/48a1400e-608d-43af-8a2a-257a5c4c316b" status: 200 len: 1366 microversion: 2.47 time: 0.134631 Sep 14 09:23:35.535502 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3007/5987] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:23:35 2022] GET /compute/v2.1/servers/48a1400e-608d-43af-8a2a-257a5c4c316b => generated 1366 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:23:36.565061 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-690aeb06-b3e7-40ac-993e-f61bf30a8c0f tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:36.566650 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-690aeb06-b3e7-40ac-993e-f61bf30a8c0f tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] [instance: 48a1400e-608d-43af-8a2a-257a5c4c316b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:36.574967 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-690aeb06-b3e7-40ac-993e-f61bf30a8c0f tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:36.575462 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-690aeb06-b3e7-40ac-993e-f61bf30a8c0f tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:36.576491 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-690aeb06-b3e7-40ac-993e-f61bf30a8c0f tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:36.577434 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-690aeb06-b3e7-40ac-993e-f61bf30a8c0f tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:36.578634 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-690aeb06-b3e7-40ac-993e-f61bf30a8c0f tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:36.579553 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-690aeb06-b3e7-40ac-993e-f61bf30a8c0f tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:36.685229 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-690aeb06-b3e7-40ac-993e-f61bf30a8c0f tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46336ae28e14b1092c4f1b3778d83e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a81e0c013b6450ebb75fe5a86220b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:36.696566 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-690aeb06-b3e7-40ac-993e-f61bf30a8c0f tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e46336ae28e14b1092c4f1b3778d83e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a81e0c013b6450ebb75fe5a86220b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:36.698374 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-690aeb06-b3e7-40ac-993e-f61bf30a8c0f tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e46336ae28e14b1092c4f1b3778d83e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a81e0c013b6450ebb75fe5a86220b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:36.705195 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-690aeb06-b3e7-40ac-993e-f61bf30a8c0f tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] 10.222.0.60 "GET /compute/v2.1/servers/48a1400e-608d-43af-8a2a-257a5c4c316b" status: 200 len: 1366 microversion: 2.47 time: 0.147065 Sep 14 09:23:36.706129 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2981/5988] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:23:36 2022] GET /compute/v2.1/servers/48a1400e-608d-43af-8a2a-257a5c4c316b => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:23:37.731835 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-f03b9d5c-02d6-4b94-b8b8-8b33f53f8a6b tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:37.732598 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-f03b9d5c-02d6-4b94-b8b8-8b33f53f8a6b tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] [instance: 48a1400e-608d-43af-8a2a-257a5c4c316b] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:37.738914 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:23:37.740621 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f03b9d5c-02d6-4b94-b8b8-8b33f53f8a6b tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:37.741369 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f03b9d5c-02d6-4b94-b8b8-8b33f53f8a6b tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:37.742027 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f03b9d5c-02d6-4b94-b8b8-8b33f53f8a6b tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:37.742995 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f03b9d5c-02d6-4b94-b8b8-8b33f53f8a6b tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:37.743680 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f03b9d5c-02d6-4b94-b8b8-8b33f53f8a6b tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:37.744332 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f03b9d5c-02d6-4b94-b8b8-8b33f53f8a6b tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:37.834917 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-f03b9d5c-02d6-4b94-b8b8-8b33f53f8a6b tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46336ae28e14b1092c4f1b3778d83e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a81e0c013b6450ebb75fe5a86220b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:37.845785 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-f03b9d5c-02d6-4b94-b8b8-8b33f53f8a6b tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e46336ae28e14b1092c4f1b3778d83e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a81e0c013b6450ebb75fe5a86220b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:37.855365 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-f03b9d5c-02d6-4b94-b8b8-8b33f53f8a6b tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e46336ae28e14b1092c4f1b3778d83e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a81e0c013b6450ebb75fe5a86220b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:37.856678 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-f03b9d5c-02d6-4b94-b8b8-8b33f53f8a6b tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] 10.222.0.60 "GET /compute/v2.1/servers/48a1400e-608d-43af-8a2a-257a5c4c316b" status: 200 len: 1366 microversion: 2.47 time: 0.128849 Sep 14 09:23:37.857266 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3008/5989] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:23:37 2022] GET /compute/v2.1/servers/48a1400e-608d-43af-8a2a-257a5c4c316b => generated 1366 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:23:38.890506 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-fccb36aa-79cc-4469-b149-8ea47498688e tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:38.894255 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-fccb36aa-79cc-4469-b149-8ea47498688e tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] [instance: 48a1400e-608d-43af-8a2a-257a5c4c316b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:38.925592 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fccb36aa-79cc-4469-b149-8ea47498688e tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:38.935781 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fccb36aa-79cc-4469-b149-8ea47498688e tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:38.936729 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fccb36aa-79cc-4469-b149-8ea47498688e tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:38.937725 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fccb36aa-79cc-4469-b149-8ea47498688e tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:38.939525 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fccb36aa-79cc-4469-b149-8ea47498688e tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:38.940215 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fccb36aa-79cc-4469-b149-8ea47498688e tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:39.496604 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-fccb36aa-79cc-4469-b149-8ea47498688e tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46336ae28e14b1092c4f1b3778d83e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a81e0c013b6450ebb75fe5a86220b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:39.507806 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-fccb36aa-79cc-4469-b149-8ea47498688e tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e46336ae28e14b1092c4f1b3778d83e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a81e0c013b6450ebb75fe5a86220b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:39.509556 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-fccb36aa-79cc-4469-b149-8ea47498688e tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e46336ae28e14b1092c4f1b3778d83e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a81e0c013b6450ebb75fe5a86220b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:39.511748 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-fccb36aa-79cc-4469-b149-8ea47498688e tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] 10.222.0.60 "GET /compute/v2.1/servers/48a1400e-608d-43af-8a2a-257a5c4c316b" status: 200 len: 1366 microversion: 2.47 time: 0.628307 Sep 14 09:23:39.512821 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2982/5990] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:23:38 2022] GET /compute/v2.1/servers/48a1400e-608d-43af-8a2a-257a5c4c316b => generated 1366 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:23:40.540098 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a667e9f7-0f5e-424d-af79-da7526161d0f tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:40.540729 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-a667e9f7-0f5e-424d-af79-da7526161d0f tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] [instance: 48a1400e-608d-43af-8a2a-257a5c4c316b] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:40.556057 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a667e9f7-0f5e-424d-af79-da7526161d0f tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:40.562890 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a667e9f7-0f5e-424d-af79-da7526161d0f tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:40.563477 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a667e9f7-0f5e-424d-af79-da7526161d0f tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:40.566660 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a667e9f7-0f5e-424d-af79-da7526161d0f tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:40.570327 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a667e9f7-0f5e-424d-af79-da7526161d0f tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:40.571198 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a667e9f7-0f5e-424d-af79-da7526161d0f tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:40.710205 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-a667e9f7-0f5e-424d-af79-da7526161d0f tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46336ae28e14b1092c4f1b3778d83e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a81e0c013b6450ebb75fe5a86220b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:40.735571 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-a667e9f7-0f5e-424d-af79-da7526161d0f tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e46336ae28e14b1092c4f1b3778d83e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a81e0c013b6450ebb75fe5a86220b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:40.738092 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-a667e9f7-0f5e-424d-af79-da7526161d0f tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e46336ae28e14b1092c4f1b3778d83e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a81e0c013b6450ebb75fe5a86220b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:40.739958 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-a667e9f7-0f5e-424d-af79-da7526161d0f tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] 10.222.0.60 "GET /compute/v2.1/servers/48a1400e-608d-43af-8a2a-257a5c4c316b" status: 200 len: 1366 microversion: 2.47 time: 0.204585 Sep 14 09:23:40.740699 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3009/5991] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:23:40 2022] GET /compute/v2.1/servers/48a1400e-608d-43af-8a2a-257a5c4c316b => generated 1366 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:23:41.779061 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-df6d7ff2-a0e2-4f42-ad1e-ecfc49410c9e tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:41.780281 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-df6d7ff2-a0e2-4f42-ad1e-ecfc49410c9e tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] [instance: 48a1400e-608d-43af-8a2a-257a5c4c316b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:41.797026 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-df6d7ff2-a0e2-4f42-ad1e-ecfc49410c9e tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:41.798140 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-df6d7ff2-a0e2-4f42-ad1e-ecfc49410c9e tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:41.798602 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-df6d7ff2-a0e2-4f42-ad1e-ecfc49410c9e tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:41.800087 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-df6d7ff2-a0e2-4f42-ad1e-ecfc49410c9e tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:41.800749 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-df6d7ff2-a0e2-4f42-ad1e-ecfc49410c9e tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:41.801190 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-df6d7ff2-a0e2-4f42-ad1e-ecfc49410c9e tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:41.988638 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-df6d7ff2-a0e2-4f42-ad1e-ecfc49410c9e tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46336ae28e14b1092c4f1b3778d83e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a81e0c013b6450ebb75fe5a86220b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:42.005275 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-df6d7ff2-a0e2-4f42-ad1e-ecfc49410c9e tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e46336ae28e14b1092c4f1b3778d83e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a81e0c013b6450ebb75fe5a86220b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:42.007222 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-df6d7ff2-a0e2-4f42-ad1e-ecfc49410c9e tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e46336ae28e14b1092c4f1b3778d83e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a81e0c013b6450ebb75fe5a86220b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:42.014450 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-df6d7ff2-a0e2-4f42-ad1e-ecfc49410c9e tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] 10.222.0.60 "GET /compute/v2.1/servers/48a1400e-608d-43af-8a2a-257a5c4c316b" status: 200 len: 1366 microversion: 2.47 time: 0.241372 Sep 14 09:23:42.027341 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2983/5992] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:23:41 2022] GET /compute/v2.1/servers/48a1400e-608d-43af-8a2a-257a5c4c316b => generated 1366 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:23:43.041487 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c3f1243d-3a02-46f0-9ed6-8fe856d3c067 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:43.042165 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-c3f1243d-3a02-46f0-9ed6-8fe856d3c067 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] [instance: 48a1400e-608d-43af-8a2a-257a5c4c316b] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:43.050259 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c3f1243d-3a02-46f0-9ed6-8fe856d3c067 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:43.050989 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c3f1243d-3a02-46f0-9ed6-8fe856d3c067 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:43.051684 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c3f1243d-3a02-46f0-9ed6-8fe856d3c067 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:43.054625 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c3f1243d-3a02-46f0-9ed6-8fe856d3c067 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:43.055326 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c3f1243d-3a02-46f0-9ed6-8fe856d3c067 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:43.056086 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c3f1243d-3a02-46f0-9ed6-8fe856d3c067 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:43.131435 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-c3f1243d-3a02-46f0-9ed6-8fe856d3c067 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46336ae28e14b1092c4f1b3778d83e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a81e0c013b6450ebb75fe5a86220b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:43.140864 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-c3f1243d-3a02-46f0-9ed6-8fe856d3c067 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e46336ae28e14b1092c4f1b3778d83e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a81e0c013b6450ebb75fe5a86220b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:43.142349 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-c3f1243d-3a02-46f0-9ed6-8fe856d3c067 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e46336ae28e14b1092c4f1b3778d83e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a81e0c013b6450ebb75fe5a86220b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:43.143653 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-c3f1243d-3a02-46f0-9ed6-8fe856d3c067 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] 10.222.0.60 "GET /compute/v2.1/servers/48a1400e-608d-43af-8a2a-257a5c4c316b" status: 200 len: 1366 microversion: 2.47 time: 0.106107 Sep 14 09:23:43.144241 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3010/5993] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:23:43 2022] GET /compute/v2.1/servers/48a1400e-608d-43af-8a2a-257a5c4c316b => generated 1366 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:23:44.170410 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-37f8aceb-e8e4-41e9-a067-66437f9ed0a8 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:44.171071 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-37f8aceb-e8e4-41e9-a067-66437f9ed0a8 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] [instance: 48a1400e-608d-43af-8a2a-257a5c4c316b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:44.200059 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-37f8aceb-e8e4-41e9-a067-66437f9ed0a8 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:44.201924 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-37f8aceb-e8e4-41e9-a067-66437f9ed0a8 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:44.203992 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-37f8aceb-e8e4-41e9-a067-66437f9ed0a8 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:44.207367 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-37f8aceb-e8e4-41e9-a067-66437f9ed0a8 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:44.208182 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-37f8aceb-e8e4-41e9-a067-66437f9ed0a8 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:44.208829 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-37f8aceb-e8e4-41e9-a067-66437f9ed0a8 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:44.362604 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-37f8aceb-e8e4-41e9-a067-66437f9ed0a8 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46336ae28e14b1092c4f1b3778d83e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a81e0c013b6450ebb75fe5a86220b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:44.377920 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-37f8aceb-e8e4-41e9-a067-66437f9ed0a8 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e46336ae28e14b1092c4f1b3778d83e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a81e0c013b6450ebb75fe5a86220b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:44.381666 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-37f8aceb-e8e4-41e9-a067-66437f9ed0a8 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e46336ae28e14b1092c4f1b3778d83e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a81e0c013b6450ebb75fe5a86220b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:44.393977 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-37f8aceb-e8e4-41e9-a067-66437f9ed0a8 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] 10.222.0.60 "GET /compute/v2.1/servers/48a1400e-608d-43af-8a2a-257a5c4c316b" status: 200 len: 1366 microversion: 2.47 time: 0.227820 Sep 14 09:23:44.397310 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2984/5994] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:23:44 2022] GET /compute/v2.1/servers/48a1400e-608d-43af-8a2a-257a5c4c316b => generated 1366 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:23:45.194293 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-8aaa3137-ec84-4f8e-bd1d-2da5cd623bc3 tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-883041893", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "networks": [{"uuid": "7d93956f-37aa-4330-a5d7-34ed9e6986c9"}]}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:23:45.269081 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.network.neutron [None req-8aaa3137-ec84-4f8e-bd1d-2da5cd623bc3 tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] validate_networks() for [('7d93956f-37aa-4330-a5d7-34ed9e6986c9', None, None, None, None, None)] {{(pid=128758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:23:45.431589 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b4c703b8-8d53-45af-9ae3-368775e940b5 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:45.433879 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b4c703b8-8d53-45af-9ae3-368775e940b5 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] [instance: 48a1400e-608d-43af-8a2a-257a5c4c316b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:45.457703 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b4c703b8-8d53-45af-9ae3-368775e940b5 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:45.459261 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b4c703b8-8d53-45af-9ae3-368775e940b5 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:45.459941 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b4c703b8-8d53-45af-9ae3-368775e940b5 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:45.461230 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b4c703b8-8d53-45af-9ae3-368775e940b5 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:45.462410 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b4c703b8-8d53-45af-9ae3-368775e940b5 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:45.465142 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b4c703b8-8d53-45af-9ae3-368775e940b5 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:45.594919 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b4c703b8-8d53-45af-9ae3-368775e940b5 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46336ae28e14b1092c4f1b3778d83e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a81e0c013b6450ebb75fe5a86220b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:45.605767 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b4c703b8-8d53-45af-9ae3-368775e940b5 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e46336ae28e14b1092c4f1b3778d83e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a81e0c013b6450ebb75fe5a86220b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:45.607749 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b4c703b8-8d53-45af-9ae3-368775e940b5 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e46336ae28e14b1092c4f1b3778d83e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a81e0c013b6450ebb75fe5a86220b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:45.609369 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b4c703b8-8d53-45af-9ae3-368775e940b5 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] 10.222.0.60 "GET /compute/v2.1/servers/48a1400e-608d-43af-8a2a-257a5c4c316b" status: 200 len: 1366 microversion: 2.47 time: 0.186875 Sep 14 09:23:45.631701 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2985/5995] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:23:45 2022] GET /compute/v2.1/servers/48a1400e-608d-43af-8a2a-257a5c4c316b => generated 1366 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:23:46.258713 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-8aaa3137-ec84-4f8e-bd1d-2da5cd623bc3 tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Flavor limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:23:46.262290 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-8aaa3137-ec84-4f8e-bd1d-2da5cd623bc3 tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Image limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:23:46.263162 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-8aaa3137-ec84-4f8e-bd1d-2da5cd623bc3 tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Flavor pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:23:46.263951 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-8aaa3137-ec84-4f8e-bd1d-2da5cd623bc3 tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Image pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:23:46.264587 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-8aaa3137-ec84-4f8e-bd1d-2da5cd623bc3 tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:23:46.286288 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8aaa3137-ec84-4f8e-bd1d-2da5cd623bc3 tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:46.287185 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8aaa3137-ec84-4f8e-bd1d-2da5cd623bc3 tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:46.287880 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8aaa3137-ec84-4f8e-bd1d-2da5cd623bc3 tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:46.288992 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8aaa3137-ec84-4f8e-bd1d-2da5cd623bc3 tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:46.289691 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8aaa3137-ec84-4f8e-bd1d-2da5cd623bc3 tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:46.290330 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8aaa3137-ec84-4f8e-bd1d-2da5cd623bc3 tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:46.319971 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-8aaa3137-ec84-4f8e-bd1d-2da5cd623bc3 tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Getting quotas for project 74627c6924304b09aeccbea302b401af. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:23:46.328555 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-8aaa3137-ec84-4f8e-bd1d-2da5cd623bc3 tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Getting quotas for user 19826a6d776745bf9e2c781c99506f98 and project 74627c6924304b09aeccbea302b401af. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:23:46.348679 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-8aaa3137-ec84-4f8e-bd1d-2da5cd623bc3 tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Going to run 1 instances... {{(pid=128758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:23:46.352563 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-8aaa3137-ec84-4f8e-bd1d-2da5cd623bc3 tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] [instance: c4cbdcff-ec3f-4c46-891a-34307e72ce39] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:23:46.443499 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-8aaa3137-ec84-4f8e-bd1d-2da5cd623bc3 tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.423274 Sep 14 09:23:46.445841 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3011/5996] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 09:23:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1428 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:23:46.466289 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b172ef4f-7c05-4130-a7bb-f16a1f7f96db tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:46.470117 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b172ef4f-7c05-4130-a7bb-f16a1f7f96db tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] [instance: c4cbdcff-ec3f-4c46-891a-34307e72ce39] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:46.637465 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-f5071996-70f8-4ee5-bdbd-e7ab49e4fe9a tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:46.638436 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-f5071996-70f8-4ee5-bdbd-e7ab49e4fe9a tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] [instance: 48a1400e-608d-43af-8a2a-257a5c4c316b] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:46.650894 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f5071996-70f8-4ee5-bdbd-e7ab49e4fe9a tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:46.651496 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f5071996-70f8-4ee5-bdbd-e7ab49e4fe9a tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:46.656367 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f5071996-70f8-4ee5-bdbd-e7ab49e4fe9a tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:46.659547 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f5071996-70f8-4ee5-bdbd-e7ab49e4fe9a tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:46.660238 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f5071996-70f8-4ee5-bdbd-e7ab49e4fe9a tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:46.660717 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f5071996-70f8-4ee5-bdbd-e7ab49e4fe9a tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:46.809337 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b172ef4f-7c05-4130-a7bb-f16a1f7f96db tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19826a6d776745bf9e2c781c99506f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74627c6924304b09aeccbea302b401af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:46.822051 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b172ef4f-7c05-4130-a7bb-f16a1f7f96db tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] 10.222.0.60 "GET /compute/v2.1/servers/c4cbdcff-ec3f-4c46-891a-34307e72ce39" status: 200 len: 1213 microversion: 2.1 time: 0.367734 Sep 14 09:23:46.826339 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2986/5997] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:23:46 2022] GET /compute/v2.1/servers/c4cbdcff-ec3f-4c46-891a-34307e72ce39 => generated 1213 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:23:46.897058 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-f5071996-70f8-4ee5-bdbd-e7ab49e4fe9a tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46336ae28e14b1092c4f1b3778d83e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a81e0c013b6450ebb75fe5a86220b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:46.925227 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-f5071996-70f8-4ee5-bdbd-e7ab49e4fe9a tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e46336ae28e14b1092c4f1b3778d83e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a81e0c013b6450ebb75fe5a86220b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:46.931868 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-f5071996-70f8-4ee5-bdbd-e7ab49e4fe9a tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e46336ae28e14b1092c4f1b3778d83e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a81e0c013b6450ebb75fe5a86220b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:46.933247 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-f5071996-70f8-4ee5-bdbd-e7ab49e4fe9a tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] 10.222.0.60 "GET /compute/v2.1/servers/48a1400e-608d-43af-8a2a-257a5c4c316b" status: 200 len: 1366 microversion: 2.47 time: 0.300515 Sep 14 09:23:46.933846 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3012/5998] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:23:46 2022] GET /compute/v2.1/servers/48a1400e-608d-43af-8a2a-257a5c4c316b => generated 1366 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:23:47.852263 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-668f8741-dc0c-4b36-ac9b-9f5d52b9a8aa tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:47.853492 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-668f8741-dc0c-4b36-ac9b-9f5d52b9a8aa tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] [instance: c4cbdcff-ec3f-4c46-891a-34307e72ce39] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:47.879281 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-668f8741-dc0c-4b36-ac9b-9f5d52b9a8aa tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:47.887785 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-668f8741-dc0c-4b36-ac9b-9f5d52b9a8aa tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:47.888749 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-668f8741-dc0c-4b36-ac9b-9f5d52b9a8aa tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:47.889701 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-668f8741-dc0c-4b36-ac9b-9f5d52b9a8aa tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:47.890514 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-668f8741-dc0c-4b36-ac9b-9f5d52b9a8aa tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:47.891512 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-668f8741-dc0c-4b36-ac9b-9f5d52b9a8aa tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:47.961604 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-843c2f76-ed24-4844-9890-8c400388ae7b tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:47.963145 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-843c2f76-ed24-4844-9890-8c400388ae7b tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] [instance: 48a1400e-608d-43af-8a2a-257a5c4c316b] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:47.996190 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-843c2f76-ed24-4844-9890-8c400388ae7b tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:48.002252 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-843c2f76-ed24-4844-9890-8c400388ae7b tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:48.003067 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-843c2f76-ed24-4844-9890-8c400388ae7b tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:48.004136 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-843c2f76-ed24-4844-9890-8c400388ae7b tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:48.006155 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-843c2f76-ed24-4844-9890-8c400388ae7b tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:48.007463 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-843c2f76-ed24-4844-9890-8c400388ae7b tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:48.105064 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-668f8741-dc0c-4b36-ac9b-9f5d52b9a8aa tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19826a6d776745bf9e2c781c99506f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74627c6924304b09aeccbea302b401af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:48.123750 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-668f8741-dc0c-4b36-ac9b-9f5d52b9a8aa tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] 10.222.0.60 "GET /compute/v2.1/servers/c4cbdcff-ec3f-4c46-891a-34307e72ce39" status: 200 len: 1265 microversion: 2.1 time: 0.275944 Sep 14 09:23:48.128542 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2987/5999] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:23:47 2022] GET /compute/v2.1/servers/c4cbdcff-ec3f-4c46-891a-34307e72ce39 => generated 1265 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:23:48.165860 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-843c2f76-ed24-4844-9890-8c400388ae7b tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46336ae28e14b1092c4f1b3778d83e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a81e0c013b6450ebb75fe5a86220b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:48.215336 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-843c2f76-ed24-4844-9890-8c400388ae7b tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e46336ae28e14b1092c4f1b3778d83e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a81e0c013b6450ebb75fe5a86220b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:48.220635 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-843c2f76-ed24-4844-9890-8c400388ae7b tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e46336ae28e14b1092c4f1b3778d83e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a81e0c013b6450ebb75fe5a86220b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:48.222388 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-843c2f76-ed24-4844-9890-8c400388ae7b tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] 10.222.0.60 "GET /compute/v2.1/servers/48a1400e-608d-43af-8a2a-257a5c4c316b" status: 200 len: 1366 microversion: 2.47 time: 0.265792 Sep 14 09:23:48.255557 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3013/6000] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:23:47 2022] GET /compute/v2.1/servers/48a1400e-608d-43af-8a2a-257a5c4c316b => generated 1366 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 09:23:49.151040 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-20872123-8f22-465f-bf7e-93291a6c8368 tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:49.152514 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-20872123-8f22-465f-bf7e-93291a6c8368 tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] [instance: c4cbdcff-ec3f-4c46-891a-34307e72ce39] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:49.165503 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-20872123-8f22-465f-bf7e-93291a6c8368 tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:49.168267 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-20872123-8f22-465f-bf7e-93291a6c8368 tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:49.169530 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-20872123-8f22-465f-bf7e-93291a6c8368 tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:49.172254 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-20872123-8f22-465f-bf7e-93291a6c8368 tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:49.174439 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-20872123-8f22-465f-bf7e-93291a6c8368 tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:49.175257 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-20872123-8f22-465f-bf7e-93291a6c8368 tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:49.250879 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-dfb45819-7e3d-4635-b5b1-37f5f11bb815 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:49.251518 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-dfb45819-7e3d-4635-b5b1-37f5f11bb815 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] [instance: 48a1400e-608d-43af-8a2a-257a5c4c316b] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:49.267427 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dfb45819-7e3d-4635-b5b1-37f5f11bb815 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:49.268314 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dfb45819-7e3d-4635-b5b1-37f5f11bb815 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:49.268938 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dfb45819-7e3d-4635-b5b1-37f5f11bb815 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:49.269867 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dfb45819-7e3d-4635-b5b1-37f5f11bb815 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:49.270503 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dfb45819-7e3d-4635-b5b1-37f5f11bb815 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:49.271152 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dfb45819-7e3d-4635-b5b1-37f5f11bb815 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:49.299216 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-20872123-8f22-465f-bf7e-93291a6c8368 tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19826a6d776745bf9e2c781c99506f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74627c6924304b09aeccbea302b401af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:49.312770 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-20872123-8f22-465f-bf7e-93291a6c8368 tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] 10.222.0.60 "GET /compute/v2.1/servers/c4cbdcff-ec3f-4c46-891a-34307e72ce39" status: 200 len: 1271 microversion: 2.1 time: 0.163799 Sep 14 09:23:49.316962 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2988/6001] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:23:49 2022] GET /compute/v2.1/servers/c4cbdcff-ec3f-4c46-891a-34307e72ce39 => generated 1271 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:23:49.451641 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-dfb45819-7e3d-4635-b5b1-37f5f11bb815 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46336ae28e14b1092c4f1b3778d83e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a81e0c013b6450ebb75fe5a86220b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:49.467491 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-dfb45819-7e3d-4635-b5b1-37f5f11bb815 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e46336ae28e14b1092c4f1b3778d83e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a81e0c013b6450ebb75fe5a86220b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:49.472001 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-dfb45819-7e3d-4635-b5b1-37f5f11bb815 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e46336ae28e14b1092c4f1b3778d83e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a81e0c013b6450ebb75fe5a86220b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:49.475764 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-dfb45819-7e3d-4635-b5b1-37f5f11bb815 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] 10.222.0.60 "GET /compute/v2.1/servers/48a1400e-608d-43af-8a2a-257a5c4c316b" status: 200 len: 1366 microversion: 2.47 time: 0.228776 Sep 14 09:23:49.476360 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3014/6002] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:23:49 2022] GET /compute/v2.1/servers/48a1400e-608d-43af-8a2a-257a5c4c316b => generated 1366 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 09:23:50.342230 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9127e862-de7c-4895-98ec-8e01d8ba4c1d tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:50.343610 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-9127e862-de7c-4895-98ec-8e01d8ba4c1d tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] [instance: c4cbdcff-ec3f-4c46-891a-34307e72ce39] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:50.357297 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9127e862-de7c-4895-98ec-8e01d8ba4c1d tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:50.367829 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9127e862-de7c-4895-98ec-8e01d8ba4c1d tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:50.368682 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9127e862-de7c-4895-98ec-8e01d8ba4c1d tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:50.369702 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9127e862-de7c-4895-98ec-8e01d8ba4c1d tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:50.370921 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9127e862-de7c-4895-98ec-8e01d8ba4c1d tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:50.371726 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9127e862-de7c-4895-98ec-8e01d8ba4c1d tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:50.505319 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a6b2b14b-662f-4654-b442-1ff995addf82 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:50.505947 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-a6b2b14b-662f-4654-b442-1ff995addf82 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] [instance: 48a1400e-608d-43af-8a2a-257a5c4c316b] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:50.520693 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a6b2b14b-662f-4654-b442-1ff995addf82 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:50.529116 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a6b2b14b-662f-4654-b442-1ff995addf82 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:50.533829 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a6b2b14b-662f-4654-b442-1ff995addf82 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:50.534899 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a6b2b14b-662f-4654-b442-1ff995addf82 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:50.535486 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a6b2b14b-662f-4654-b442-1ff995addf82 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:50.535939 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a6b2b14b-662f-4654-b442-1ff995addf82 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:50.784384 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-a6b2b14b-662f-4654-b442-1ff995addf82 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46336ae28e14b1092c4f1b3778d83e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a81e0c013b6450ebb75fe5a86220b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:50.811604 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-a6b2b14b-662f-4654-b442-1ff995addf82 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e46336ae28e14b1092c4f1b3778d83e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a81e0c013b6450ebb75fe5a86220b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:50.827348 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-a6b2b14b-662f-4654-b442-1ff995addf82 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e46336ae28e14b1092c4f1b3778d83e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a81e0c013b6450ebb75fe5a86220b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:50.833144 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-a6b2b14b-662f-4654-b442-1ff995addf82 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] 10.222.0.60 "GET /compute/v2.1/servers/48a1400e-608d-43af-8a2a-257a5c4c316b" status: 200 len: 1366 microversion: 2.47 time: 0.332516 Sep 14 09:23:50.850859 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3015/6003] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:23:50 2022] GET /compute/v2.1/servers/48a1400e-608d-43af-8a2a-257a5c4c316b => generated 1366 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 09:23:50.893578 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-9127e862-de7c-4895-98ec-8e01d8ba4c1d tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19826a6d776745bf9e2c781c99506f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74627c6924304b09aeccbea302b401af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:50.903005 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-9127e862-de7c-4895-98ec-8e01d8ba4c1d tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] 10.222.0.60 "GET /compute/v2.1/servers/c4cbdcff-ec3f-4c46-891a-34307e72ce39" status: 200 len: 1313 microversion: 2.1 time: 0.566375 Sep 14 09:23:50.904891 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2989/6004] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:23:50 2022] GET /compute/v2.1/servers/c4cbdcff-ec3f-4c46-891a-34307e72ce39 => generated 1313 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:23:51.370044 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-15693d13-312d-4a12-beb4-55bcc7aef110 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Action: 'create', calling method: .version_select at 0x7f7d44547ee0>, body: {"keypair": {"name": "tempest-TestServerBasicOps-507539977", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO/Ke+QcPa9WcZ8OHoxnzJJ0GuXpKE9GZIouGvln3dktkQVz7Ab/RsnZS3knIJkUY0AMXfAkbCK4xNu6lFOlBUHUm1ll90xI4W/UIcU7MhEHaZU4BdhKOS4/0jvkgB7k/A=="}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:23:51.433191 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-15693d13-312d-4a12-beb4-55bcc7aef110 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Getting quotas for project 1cd8586b239f4f13a775a0465b9271a0. Resources: {'key_pairs'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:23:51.451658 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-15693d13-312d-4a12-beb4-55bcc7aef110 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Getting quotas for user 7f0ed82129324c07a8c4158d207fcc4e and project 1cd8586b239f4f13a775a0465b9271a0. Resources: {'key_pairs'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:23:51.506825 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-15693d13-312d-4a12-beb4-55bcc7aef110 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.416845 Sep 14 09:23:51.515264 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3016/6005] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Sep 14 09:23:51 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:23:51.882567 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-731bef6f-6720-4ce8-919d-08d0806d07c1 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:51.884199 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-731bef6f-6720-4ce8-919d-08d0806d07c1 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] [instance: 48a1400e-608d-43af-8a2a-257a5c4c316b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:51.904052 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-731bef6f-6720-4ce8-919d-08d0806d07c1 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:51.905255 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-731bef6f-6720-4ce8-919d-08d0806d07c1 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:51.906197 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-731bef6f-6720-4ce8-919d-08d0806d07c1 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:51.909393 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-731bef6f-6720-4ce8-919d-08d0806d07c1 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:51.910705 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-731bef6f-6720-4ce8-919d-08d0806d07c1 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:51.911198 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-731bef6f-6720-4ce8-919d-08d0806d07c1 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:51.932221 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-8aa1badc-0bc1-4336-ae84-640f4772b60e tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:51.935619 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-8aa1badc-0bc1-4336-ae84-640f4772b60e tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] [instance: c4cbdcff-ec3f-4c46-891a-34307e72ce39] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:51.942985 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8aa1badc-0bc1-4336-ae84-640f4772b60e tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:51.943900 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8aa1badc-0bc1-4336-ae84-640f4772b60e tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:51.944541 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8aa1badc-0bc1-4336-ae84-640f4772b60e tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:51.945482 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8aa1badc-0bc1-4336-ae84-640f4772b60e tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:51.946401 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8aa1badc-0bc1-4336-ae84-640f4772b60e tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:51.947054 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8aa1badc-0bc1-4336-ae84-640f4772b60e tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:52.109682 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-731bef6f-6720-4ce8-919d-08d0806d07c1 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46336ae28e14b1092c4f1b3778d83e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a81e0c013b6450ebb75fe5a86220b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:52.125839 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-731bef6f-6720-4ce8-919d-08d0806d07c1 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e46336ae28e14b1092c4f1b3778d83e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a81e0c013b6450ebb75fe5a86220b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:52.127636 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-731bef6f-6720-4ce8-919d-08d0806d07c1 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e46336ae28e14b1092c4f1b3778d83e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a81e0c013b6450ebb75fe5a86220b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:52.132494 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-731bef6f-6720-4ce8-919d-08d0806d07c1 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] 10.222.0.60 "GET /compute/v2.1/servers/48a1400e-608d-43af-8a2a-257a5c4c316b" status: 200 len: 1366 microversion: 2.47 time: 0.254245 Sep 14 09:23:52.147589 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2990/6006] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:23:51 2022] GET /compute/v2.1/servers/48a1400e-608d-43af-8a2a-257a5c4c316b => generated 1366 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:23:52.508960 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-8aa1badc-0bc1-4336-ae84-640f4772b60e tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19826a6d776745bf9e2c781c99506f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74627c6924304b09aeccbea302b401af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:52.519484 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-8aa1badc-0bc1-4336-ae84-640f4772b60e tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] 10.222.0.60 "GET /compute/v2.1/servers/c4cbdcff-ec3f-4c46-891a-34307e72ce39" status: 200 len: 1313 microversion: 2.1 time: 0.591970 Sep 14 09:23:52.520639 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3017/6007] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:23:51 2022] GET /compute/v2.1/servers/c4cbdcff-ec3f-4c46-891a-34307e72ce39 => generated 1313 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:23:52.870716 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-3d1c1303-6cbc-4f9d-b0b2-8ed2d8e73e1c req-b85d6ba4-5565-45b5-aba6-4463216a4993 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4cbdcff-ec3f-4c46-891a-34307e72ce39", "tag": "4eade9a3-b4a8-4975-9192-8b0dc49bf7e6"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:23:52.896103 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-3d1c1303-6cbc-4f9d-b0b2-8ed2d8e73e1c req-b85d6ba4-5565-45b5-aba6-4463216a4993 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:52.897494 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-3d1c1303-6cbc-4f9d-b0b2-8ed2d8e73e1c req-b85d6ba4-5565-45b5-aba6-4463216a4993 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:52.899049 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-3d1c1303-6cbc-4f9d-b0b2-8ed2d8e73e1c req-b85d6ba4-5565-45b5-aba6-4463216a4993 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:52.926851 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-3d1c1303-6cbc-4f9d-b0b2-8ed2d8e73e1c req-b85d6ba4-5565-45b5-aba6-4463216a4993 service nova] Creating event network-changed:4eade9a3-b4a8-4975-9192-8b0dc49bf7e6 for instance c4cbdcff-ec3f-4c46-891a-34307e72ce39 on n-h1-836830-18 Sep 14 09:23:52.935208 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-3d1c1303-6cbc-4f9d-b0b2-8ed2d8e73e1c req-b85d6ba4-5565-45b5-aba6-4463216a4993 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067832 Sep 14 09:23:52.936985 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2991/6008] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:23:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:23:53.162284 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c308736a-7234-4533-ae20-6ee74aec4573 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:53.163832 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-c308736a-7234-4533-ae20-6ee74aec4573 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] [instance: 48a1400e-608d-43af-8a2a-257a5c4c316b] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:53.174247 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c308736a-7234-4533-ae20-6ee74aec4573 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:53.175178 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c308736a-7234-4533-ae20-6ee74aec4573 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:53.175839 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c308736a-7234-4533-ae20-6ee74aec4573 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:53.176886 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c308736a-7234-4533-ae20-6ee74aec4573 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:53.177848 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c308736a-7234-4533-ae20-6ee74aec4573 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:53.179034 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c308736a-7234-4533-ae20-6ee74aec4573 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:53.301279 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-c308736a-7234-4533-ae20-6ee74aec4573 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46336ae28e14b1092c4f1b3778d83e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a81e0c013b6450ebb75fe5a86220b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:53.315314 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-c308736a-7234-4533-ae20-6ee74aec4573 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e46336ae28e14b1092c4f1b3778d83e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a81e0c013b6450ebb75fe5a86220b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:53.318727 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-c308736a-7234-4533-ae20-6ee74aec4573 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e46336ae28e14b1092c4f1b3778d83e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a81e0c013b6450ebb75fe5a86220b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:53.322780 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-c308736a-7234-4533-ae20-6ee74aec4573 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] 10.222.0.60 "GET /compute/v2.1/servers/48a1400e-608d-43af-8a2a-257a5c4c316b" status: 200 len: 1366 microversion: 2.47 time: 0.165717 Sep 14 09:23:53.324021 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3018/6009] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:23:53 2022] GET /compute/v2.1/servers/48a1400e-608d-43af-8a2a-257a5c4c316b => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:23:53.549099 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-4253b650-f8b7-4fb5-9ae4-c8607b1becde tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:53.549819 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-4253b650-f8b7-4fb5-9ae4-c8607b1becde tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] [instance: c4cbdcff-ec3f-4c46-891a-34307e72ce39] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:53.588277 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4253b650-f8b7-4fb5-9ae4-c8607b1becde tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:53.591645 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4253b650-f8b7-4fb5-9ae4-c8607b1becde tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:53.592112 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4253b650-f8b7-4fb5-9ae4-c8607b1becde tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:53.596056 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4253b650-f8b7-4fb5-9ae4-c8607b1becde tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:53.596745 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4253b650-f8b7-4fb5-9ae4-c8607b1becde tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:53.597087 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4253b650-f8b7-4fb5-9ae4-c8607b1becde tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:53.752768 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a5aa5702-63ec-48b1-8ed2-9f777a225cce tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-1115906865", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-507539977", "security_groups": [{"name": "tempest-secgroup-smoke-680922391"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "b903dd8a-76f4-429e-847d-0f84b1370262"}]}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:23:53.921040 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-4253b650-f8b7-4fb5-9ae4-c8607b1becde tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19826a6d776745bf9e2c781c99506f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74627c6924304b09aeccbea302b401af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:53.929341 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-4253b650-f8b7-4fb5-9ae4-c8607b1becde tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] 10.222.0.60 "GET /compute/v2.1/servers/c4cbdcff-ec3f-4c46-891a-34307e72ce39" status: 200 len: 1313 microversion: 2.1 time: 0.385256 Sep 14 09:23:53.929931 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2992/6010] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:23:53 2022] GET /compute/v2.1/servers/c4cbdcff-ec3f-4c46-891a-34307e72ce39 => generated 1313 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:23:53.950816 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.network.neutron [None req-a5aa5702-63ec-48b1-8ed2-9f777a225cce tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] validate_networks() for [('b903dd8a-76f4-429e-847d-0f84b1370262', None, None, None, None, None)] {{(pid=128758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:23:54.349768 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e69f6d0b-8c1f-4eeb-a200-d577903e865a tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:54.350790 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e69f6d0b-8c1f-4eeb-a200-d577903e865a tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] [instance: 48a1400e-608d-43af-8a2a-257a5c4c316b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:54.353184 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=55 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:23:54.358536 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e69f6d0b-8c1f-4eeb-a200-d577903e865a tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:54.359487 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e69f6d0b-8c1f-4eeb-a200-d577903e865a tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:54.360393 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e69f6d0b-8c1f-4eeb-a200-d577903e865a tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:54.361348 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e69f6d0b-8c1f-4eeb-a200-d577903e865a tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:54.361887 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e69f6d0b-8c1f-4eeb-a200-d577903e865a tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:54.362930 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e69f6d0b-8c1f-4eeb-a200-d577903e865a tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:54.445148 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-e69f6d0b-8c1f-4eeb-a200-d577903e865a tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46336ae28e14b1092c4f1b3778d83e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a81e0c013b6450ebb75fe5a86220b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:54.462519 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-e69f6d0b-8c1f-4eeb-a200-d577903e865a tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e46336ae28e14b1092c4f1b3778d83e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a81e0c013b6450ebb75fe5a86220b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:54.464737 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-e69f6d0b-8c1f-4eeb-a200-d577903e865a tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e46336ae28e14b1092c4f1b3778d83e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a81e0c013b6450ebb75fe5a86220b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:54.466235 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e69f6d0b-8c1f-4eeb-a200-d577903e865a tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] 10.222.0.60 "GET /compute/v2.1/servers/48a1400e-608d-43af-8a2a-257a5c4c316b" status: 200 len: 1366 microversion: 2.47 time: 0.120440 Sep 14 09:23:54.467111 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2993/6011] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:23:54 2022] GET /compute/v2.1/servers/48a1400e-608d-43af-8a2a-257a5c4c316b => generated 1366 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:23:54.468803 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-a5aa5702-63ec-48b1-8ed2-9f777a225cce tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Getting quotas for project 1cd8586b239f4f13a775a0465b9271a0. Resources: dict_keys(['metadata_items']) {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:23:54.477363 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-a5aa5702-63ec-48b1-8ed2-9f777a225cce tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Getting quotas for user 7f0ed82129324c07a8c4158d207fcc4e and project 1cd8586b239f4f13a775a0465b9271a0. Resources: dict_keys(['metadata_items']) {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:23:54.497884 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-a5aa5702-63ec-48b1-8ed2-9f777a225cce tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Flavor limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:23:54.498259 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-a5aa5702-63ec-48b1-8ed2-9f777a225cce tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Image limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:23:54.498739 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-a5aa5702-63ec-48b1-8ed2-9f777a225cce tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Flavor pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:23:54.512342 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-a5aa5702-63ec-48b1-8ed2-9f777a225cce tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Image pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:23:54.513065 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-a5aa5702-63ec-48b1-8ed2-9f777a225cce tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:23:54.535688 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a5aa5702-63ec-48b1-8ed2-9f777a225cce tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:54.536185 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a5aa5702-63ec-48b1-8ed2-9f777a225cce tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:54.536628 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a5aa5702-63ec-48b1-8ed2-9f777a225cce tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:54.537365 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a5aa5702-63ec-48b1-8ed2-9f777a225cce tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:54.537823 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a5aa5702-63ec-48b1-8ed2-9f777a225cce tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:54.538592 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a5aa5702-63ec-48b1-8ed2-9f777a225cce tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:54.547956 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:23:54.562378 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-a5aa5702-63ec-48b1-8ed2-9f777a225cce tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Getting quotas for project 1cd8586b239f4f13a775a0465b9271a0. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:23:54.579482 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-a5aa5702-63ec-48b1-8ed2-9f777a225cce tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Getting quotas for user 7f0ed82129324c07a8c4158d207fcc4e and project 1cd8586b239f4f13a775a0465b9271a0. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:23:54.594051 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-a5aa5702-63ec-48b1-8ed2-9f777a225cce tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Going to run 1 instances... {{(pid=128758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:23:54.596355 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-a5aa5702-63ec-48b1-8ed2-9f777a225cce tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] [instance: d727e6d2-dc0c-4ee3-9d0f-999d1a4307fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:23:54.645447 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-a5aa5702-63ec-48b1-8ed2-9f777a225cce tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.896951 Sep 14 09:23:54.646111 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3019/6012] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 09:23:53 2022] POST /compute/v2.1/servers => generated 405 bytes in 898 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:23:54.658114 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-73acff7f-61c3-4a2e-ad7a-ef66515a455a tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:54.659182 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-73acff7f-61c3-4a2e-ad7a-ef66515a455a tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] [instance: d727e6d2-dc0c-4ee3-9d0f-999d1a4307fa] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:54.735353 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-73acff7f-61c3-4a2e-ad7a-ef66515a455a tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0ed82129324c07a8c4158d207fcc4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cd8586b239f4f13a775a0465b9271a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:54.743710 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-73acff7f-61c3-4a2e-ad7a-ef66515a455a tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] 10.222.0.60 "GET /compute/v2.1/servers/d727e6d2-dc0c-4ee3-9d0f-999d1a4307fa" status: 200 len: 1302 microversion: 2.1 time: 0.089481 Sep 14 09:23:54.768202 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2994/6013] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:23:54 2022] GET /compute/v2.1/servers/d727e6d2-dc0c-4ee3-9d0f-999d1a4307fa => generated 1302 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:23:54.954070 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-e2791b72-5be2-406a-8763-8acba6a10097 tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:54.954694 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-e2791b72-5be2-406a-8763-8acba6a10097 tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] [instance: c4cbdcff-ec3f-4c46-891a-34307e72ce39] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:54.969157 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e2791b72-5be2-406a-8763-8acba6a10097 tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:54.969756 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e2791b72-5be2-406a-8763-8acba6a10097 tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:54.970205 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e2791b72-5be2-406a-8763-8acba6a10097 tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:54.971754 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e2791b72-5be2-406a-8763-8acba6a10097 tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:54.972595 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e2791b72-5be2-406a-8763-8acba6a10097 tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:54.973240 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e2791b72-5be2-406a-8763-8acba6a10097 tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:55.225278 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-e2791b72-5be2-406a-8763-8acba6a10097 tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19826a6d776745bf9e2c781c99506f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74627c6924304b09aeccbea302b401af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:55.236879 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-e2791b72-5be2-406a-8763-8acba6a10097 tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] 10.222.0.60 "GET /compute/v2.1/servers/c4cbdcff-ec3f-4c46-891a-34307e72ce39" status: 200 len: 1313 microversion: 2.1 time: 0.287421 Sep 14 09:23:55.238114 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3020/6014] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:23:54 2022] GET /compute/v2.1/servers/c4cbdcff-ec3f-4c46-891a-34307e72ce39 => generated 1313 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:23:55.504104 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8ec1450a-f4bd-40e0-89d4-90d881fef47d tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:55.506257 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-8ec1450a-f4bd-40e0-89d4-90d881fef47d tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] [instance: 48a1400e-608d-43af-8a2a-257a5c4c316b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:55.539949 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8ec1450a-f4bd-40e0-89d4-90d881fef47d tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:55.546883 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8ec1450a-f4bd-40e0-89d4-90d881fef47d tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:55.547572 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8ec1450a-f4bd-40e0-89d4-90d881fef47d tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:55.550130 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8ec1450a-f4bd-40e0-89d4-90d881fef47d tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:55.550708 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8ec1450a-f4bd-40e0-89d4-90d881fef47d tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:55.551260 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8ec1450a-f4bd-40e0-89d4-90d881fef47d tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:55.593372 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=100 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:23:55.681814 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-8ec1450a-f4bd-40e0-89d4-90d881fef47d tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46336ae28e14b1092c4f1b3778d83e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a81e0c013b6450ebb75fe5a86220b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:55.708878 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-8ec1450a-f4bd-40e0-89d4-90d881fef47d tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e46336ae28e14b1092c4f1b3778d83e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a81e0c013b6450ebb75fe5a86220b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:55.713627 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-8ec1450a-f4bd-40e0-89d4-90d881fef47d tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e46336ae28e14b1092c4f1b3778d83e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a81e0c013b6450ebb75fe5a86220b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:55.716112 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-8ec1450a-f4bd-40e0-89d4-90d881fef47d tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] 10.222.0.60 "GET /compute/v2.1/servers/48a1400e-608d-43af-8a2a-257a5c4c316b" status: 200 len: 1366 microversion: 2.47 time: 0.223542 Sep 14 09:23:55.722981 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2995/6015] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:23:55 2022] GET /compute/v2.1/servers/48a1400e-608d-43af-8a2a-257a5c4c316b => generated 1366 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:23:55.768430 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c1c608c6-1067-41c6-891b-175905142118 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:55.769277 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-c1c608c6-1067-41c6-891b-175905142118 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] [instance: d727e6d2-dc0c-4ee3-9d0f-999d1a4307fa] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:55.776094 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c1c608c6-1067-41c6-891b-175905142118 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:55.778770 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c1c608c6-1067-41c6-891b-175905142118 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:55.779918 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c1c608c6-1067-41c6-891b-175905142118 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:55.784274 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c1c608c6-1067-41c6-891b-175905142118 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:55.784835 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c1c608c6-1067-41c6-891b-175905142118 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:55.785348 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c1c608c6-1067-41c6-891b-175905142118 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:55.857383 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-c1c608c6-1067-41c6-891b-175905142118 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0ed82129324c07a8c4158d207fcc4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cd8586b239f4f13a775a0465b9271a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:55.867689 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-c1c608c6-1067-41c6-891b-175905142118 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] 10.222.0.60 "GET /compute/v2.1/servers/d727e6d2-dc0c-4ee3-9d0f-999d1a4307fa" status: 200 len: 1354 microversion: 2.1 time: 0.103134 Sep 14 09:23:55.868899 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3021/6016] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:23:55 2022] GET /compute/v2.1/servers/d727e6d2-dc0c-4ee3-9d0f-999d1a4307fa => generated 1354 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:23:56.263757 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3ea12839-4a9a-433e-806f-dc6d1d854ed0 tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:56.264716 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-3ea12839-4a9a-433e-806f-dc6d1d854ed0 tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] [instance: c4cbdcff-ec3f-4c46-891a-34307e72ce39] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:56.274914 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3ea12839-4a9a-433e-806f-dc6d1d854ed0 tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:56.275441 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3ea12839-4a9a-433e-806f-dc6d1d854ed0 tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:56.275886 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3ea12839-4a9a-433e-806f-dc6d1d854ed0 tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:56.277206 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3ea12839-4a9a-433e-806f-dc6d1d854ed0 tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:56.277672 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3ea12839-4a9a-433e-806f-dc6d1d854ed0 tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:56.278103 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3ea12839-4a9a-433e-806f-dc6d1d854ed0 tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:56.514981 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-3ea12839-4a9a-433e-806f-dc6d1d854ed0 tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19826a6d776745bf9e2c781c99506f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74627c6924304b09aeccbea302b401af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:56.542788 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-3ea12839-4a9a-433e-806f-dc6d1d854ed0 tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] 10.222.0.60 "GET /compute/v2.1/servers/c4cbdcff-ec3f-4c46-891a-34307e72ce39" status: 200 len: 1313 microversion: 2.1 time: 0.283307 Sep 14 09:23:56.543911 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2996/6017] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:23:56 2022] GET /compute/v2.1/servers/c4cbdcff-ec3f-4c46-891a-34307e72ce39 => generated 1313 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:23:56.746628 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-61897020-ca51-47d3-b1ea-39ccd11834fd tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:56.747783 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-61897020-ca51-47d3-b1ea-39ccd11834fd tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] [instance: 48a1400e-608d-43af-8a2a-257a5c4c316b] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:56.756954 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-61897020-ca51-47d3-b1ea-39ccd11834fd tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:56.757821 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-61897020-ca51-47d3-b1ea-39ccd11834fd tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:56.758546 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-61897020-ca51-47d3-b1ea-39ccd11834fd tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:56.761085 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-61897020-ca51-47d3-b1ea-39ccd11834fd tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:56.761946 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-61897020-ca51-47d3-b1ea-39ccd11834fd tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:56.764035 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-61897020-ca51-47d3-b1ea-39ccd11834fd tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:56.893478 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ef395c5b-d725-4d3b-88e4-91714cd1133d tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:56.894608 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-ef395c5b-d725-4d3b-88e4-91714cd1133d tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] [instance: d727e6d2-dc0c-4ee3-9d0f-999d1a4307fa] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:56.901952 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ef395c5b-d725-4d3b-88e4-91714cd1133d tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:56.902495 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ef395c5b-d725-4d3b-88e4-91714cd1133d tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:56.902921 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ef395c5b-d725-4d3b-88e4-91714cd1133d tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:56.903664 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ef395c5b-d725-4d3b-88e4-91714cd1133d tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:56.904452 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ef395c5b-d725-4d3b-88e4-91714cd1133d tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:56.905002 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ef395c5b-d725-4d3b-88e4-91714cd1133d tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:56.915294 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-61897020-ca51-47d3-b1ea-39ccd11834fd tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46336ae28e14b1092c4f1b3778d83e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a81e0c013b6450ebb75fe5a86220b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:56.939668 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-61897020-ca51-47d3-b1ea-39ccd11834fd tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e46336ae28e14b1092c4f1b3778d83e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a81e0c013b6450ebb75fe5a86220b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:56.941839 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-61897020-ca51-47d3-b1ea-39ccd11834fd tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e46336ae28e14b1092c4f1b3778d83e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a81e0c013b6450ebb75fe5a86220b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:56.943943 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-61897020-ca51-47d3-b1ea-39ccd11834fd tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] 10.222.0.60 "GET /compute/v2.1/servers/48a1400e-608d-43af-8a2a-257a5c4c316b" status: 200 len: 1366 microversion: 2.47 time: 0.205959 Sep 14 09:23:56.956105 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3022/6018] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:23:56 2022] GET /compute/v2.1/servers/48a1400e-608d-43af-8a2a-257a5c4c316b => generated 1366 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:23:57.020290 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-ef395c5b-d725-4d3b-88e4-91714cd1133d tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0ed82129324c07a8c4158d207fcc4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cd8586b239f4f13a775a0465b9271a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:57.032586 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-ef395c5b-d725-4d3b-88e4-91714cd1133d tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] 10.222.0.60 "GET /compute/v2.1/servers/d727e6d2-dc0c-4ee3-9d0f-999d1a4307fa" status: 200 len: 1360 microversion: 2.1 time: 0.143800 Sep 14 09:23:57.043988 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2997/6019] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:23:56 2022] GET /compute/v2.1/servers/d727e6d2-dc0c-4ee3-9d0f-999d1a4307fa => generated 1360 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:23:57.569593 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-35bd82b2-8ece-41ef-9b34-46f84f46b4ce tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:57.570305 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-35bd82b2-8ece-41ef-9b34-46f84f46b4ce tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] [instance: c4cbdcff-ec3f-4c46-891a-34307e72ce39] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:57.577475 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-35bd82b2-8ece-41ef-9b34-46f84f46b4ce tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:57.578276 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-35bd82b2-8ece-41ef-9b34-46f84f46b4ce tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:57.579808 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-35bd82b2-8ece-41ef-9b34-46f84f46b4ce tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:57.580775 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-35bd82b2-8ece-41ef-9b34-46f84f46b4ce tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:57.581688 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-35bd82b2-8ece-41ef-9b34-46f84f46b4ce tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:57.583128 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-35bd82b2-8ece-41ef-9b34-46f84f46b4ce tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:57.938654 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-35bd82b2-8ece-41ef-9b34-46f84f46b4ce tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19826a6d776745bf9e2c781c99506f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74627c6924304b09aeccbea302b401af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:57.952180 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-35bd82b2-8ece-41ef-9b34-46f84f46b4ce tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] 10.222.0.60 "GET /compute/v2.1/servers/c4cbdcff-ec3f-4c46-891a-34307e72ce39" status: 200 len: 1313 microversion: 2.1 time: 0.389195 Sep 14 09:23:57.953368 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3023/6020] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:23:57 2022] GET /compute/v2.1/servers/c4cbdcff-ec3f-4c46-891a-34307e72ce39 => generated 1313 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:23:57.973838 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-0fa5d122-9bdf-4d73-8f64-d98e4e3750e0 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:57.975160 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-0fa5d122-9bdf-4d73-8f64-d98e4e3750e0 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] [instance: 48a1400e-608d-43af-8a2a-257a5c4c316b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:57.982393 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0fa5d122-9bdf-4d73-8f64-d98e4e3750e0 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:57.983258 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0fa5d122-9bdf-4d73-8f64-d98e4e3750e0 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:57.983920 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0fa5d122-9bdf-4d73-8f64-d98e4e3750e0 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:57.984841 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0fa5d122-9bdf-4d73-8f64-d98e4e3750e0 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:57.985531 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0fa5d122-9bdf-4d73-8f64-d98e4e3750e0 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:57.986175 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0fa5d122-9bdf-4d73-8f64-d98e4e3750e0 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:58.059457 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-aa73ae68-342b-4382-a749-c299f88c4c8b tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:58.060300 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-aa73ae68-342b-4382-a749-c299f88c4c8b tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] [instance: d727e6d2-dc0c-4ee3-9d0f-999d1a4307fa] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:58.067425 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-aa73ae68-342b-4382-a749-c299f88c4c8b tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:58.068057 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-aa73ae68-342b-4382-a749-c299f88c4c8b tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:58.068608 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-aa73ae68-342b-4382-a749-c299f88c4c8b tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:58.069463 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-aa73ae68-342b-4382-a749-c299f88c4c8b tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:58.070170 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-aa73ae68-342b-4382-a749-c299f88c4c8b tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:58.070813 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-aa73ae68-342b-4382-a749-c299f88c4c8b tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:58.075722 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-0fa5d122-9bdf-4d73-8f64-d98e4e3750e0 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46336ae28e14b1092c4f1b3778d83e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a81e0c013b6450ebb75fe5a86220b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:58.086305 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-0fa5d122-9bdf-4d73-8f64-d98e4e3750e0 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e46336ae28e14b1092c4f1b3778d83e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a81e0c013b6450ebb75fe5a86220b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:58.097780 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-0fa5d122-9bdf-4d73-8f64-d98e4e3750e0 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e46336ae28e14b1092c4f1b3778d83e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a81e0c013b6450ebb75fe5a86220b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:58.110225 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-0fa5d122-9bdf-4d73-8f64-d98e4e3750e0 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] 10.222.0.60 "GET /compute/v2.1/servers/48a1400e-608d-43af-8a2a-257a5c4c316b" status: 200 len: 1366 microversion: 2.47 time: 0.140129 Sep 14 09:23:58.111577 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2998/6021] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:23:57 2022] GET /compute/v2.1/servers/48a1400e-608d-43af-8a2a-257a5c4c316b => generated 1366 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:23:58.412095 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-aa73ae68-342b-4382-a749-c299f88c4c8b tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0ed82129324c07a8c4158d207fcc4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cd8586b239f4f13a775a0465b9271a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:58.424594 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-aa73ae68-342b-4382-a749-c299f88c4c8b tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] 10.222.0.60 "GET /compute/v2.1/servers/d727e6d2-dc0c-4ee3-9d0f-999d1a4307fa" status: 200 len: 1427 microversion: 2.1 time: 0.370824 Sep 14 09:23:58.426240 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3024/6022] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:23:58 2022] GET /compute/v2.1/servers/d727e6d2-dc0c-4ee3-9d0f-999d1a4307fa => generated 1427 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:23:58.501558 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-abdbd5a7-9978-447f-a10c-766153b51248 req-99e4e26b-580c-4b95-9823-f44766fa43b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d727e6d2-dc0c-4ee3-9d0f-999d1a4307fa", "tag": "e80a892b-147a-4c93-949d-38ec11071f4c"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:23:58.531177 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-abdbd5a7-9978-447f-a10c-766153b51248 req-99e4e26b-580c-4b95-9823-f44766fa43b8 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:58.531682 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-abdbd5a7-9978-447f-a10c-766153b51248 req-99e4e26b-580c-4b95-9823-f44766fa43b8 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:58.534798 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-abdbd5a7-9978-447f-a10c-766153b51248 req-99e4e26b-580c-4b95-9823-f44766fa43b8 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:58.557267 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-abdbd5a7-9978-447f-a10c-766153b51248 req-99e4e26b-580c-4b95-9823-f44766fa43b8 service nova] Creating event network-changed:e80a892b-147a-4c93-949d-38ec11071f4c for instance d727e6d2-dc0c-4ee3-9d0f-999d1a4307fa on n-h2-836830-18 Sep 14 09:23:58.560251 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-abdbd5a7-9978-447f-a10c-766153b51248 req-99e4e26b-580c-4b95-9823-f44766fa43b8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063789 Sep 14 09:23:58.563999 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 2999/6023] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:23:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:23:58.975650 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-5adafd7d-d83c-45fc-b841-30e138cdcb78 tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:58.976276 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-5adafd7d-d83c-45fc-b841-30e138cdcb78 tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] [instance: c4cbdcff-ec3f-4c46-891a-34307e72ce39] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:59.001386 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5adafd7d-d83c-45fc-b841-30e138cdcb78 tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:59.002022 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5adafd7d-d83c-45fc-b841-30e138cdcb78 tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:59.002761 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5adafd7d-d83c-45fc-b841-30e138cdcb78 tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:59.003683 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5adafd7d-d83c-45fc-b841-30e138cdcb78 tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:59.004376 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5adafd7d-d83c-45fc-b841-30e138cdcb78 tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:59.005251 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5adafd7d-d83c-45fc-b841-30e138cdcb78 tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:59.100065 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-cee53492-c9ce-4fec-a915-848aa5a7ffe7 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:59.103718 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-cee53492-c9ce-4fec-a915-848aa5a7ffe7 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] [instance: 022379ab-af51-495a-bcef-11e43774a7b0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:59.111931 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cee53492-c9ce-4fec-a915-848aa5a7ffe7 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:59.113095 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cee53492-c9ce-4fec-a915-848aa5a7ffe7 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:59.114628 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cee53492-c9ce-4fec-a915-848aa5a7ffe7 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:59.115703 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cee53492-c9ce-4fec-a915-848aa5a7ffe7 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:59.116415 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cee53492-c9ce-4fec-a915-848aa5a7ffe7 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:59.117084 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cee53492-c9ce-4fec-a915-848aa5a7ffe7 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:59.168400 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-cee53492-c9ce-4fec-a915-848aa5a7ffe7 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] 10.222.0.60 "GET /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.073393 Sep 14 09:23:59.178296 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3000/6024] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 14 09:23:59 2022] GET /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0/os-volume_attachments => generated 25 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 09:23:59.185497 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f791be88-97fb-4f1f-95ee-dcc6a5ea5236 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:59.186437 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f791be88-97fb-4f1f-95ee-dcc6a5ea5236 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] [instance: 48a1400e-608d-43af-8a2a-257a5c4c316b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:59.193633 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f791be88-97fb-4f1f-95ee-dcc6a5ea5236 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:59.194431 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f791be88-97fb-4f1f-95ee-dcc6a5ea5236 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:59.195135 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f791be88-97fb-4f1f-95ee-dcc6a5ea5236 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:59.196512 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f791be88-97fb-4f1f-95ee-dcc6a5ea5236 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:59.197733 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f791be88-97fb-4f1f-95ee-dcc6a5ea5236 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:59.199958 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f791be88-97fb-4f1f-95ee-dcc6a5ea5236 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:59.307887 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f791be88-97fb-4f1f-95ee-dcc6a5ea5236 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46336ae28e14b1092c4f1b3778d83e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a81e0c013b6450ebb75fe5a86220b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:59.313965 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-5adafd7d-d83c-45fc-b841-30e138cdcb78 tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19826a6d776745bf9e2c781c99506f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74627c6924304b09aeccbea302b401af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:59.319044 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f791be88-97fb-4f1f-95ee-dcc6a5ea5236 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e46336ae28e14b1092c4f1b3778d83e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a81e0c013b6450ebb75fe5a86220b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:59.321445 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f791be88-97fb-4f1f-95ee-dcc6a5ea5236 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e46336ae28e14b1092c4f1b3778d83e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a81e0c013b6450ebb75fe5a86220b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:59.331544 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-5adafd7d-d83c-45fc-b841-30e138cdcb78 tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] 10.222.0.60 "GET /compute/v2.1/servers/c4cbdcff-ec3f-4c46-891a-34307e72ce39" status: 200 len: 1313 microversion: 2.1 time: 0.355418 Sep 14 09:23:59.333132 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3025/6025] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:23:58 2022] GET /compute/v2.1/servers/c4cbdcff-ec3f-4c46-891a-34307e72ce39 => generated 1313 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:23:59.344878 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-9d3aaad8-51e6-4f51-b517-2ad79af592cb tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:59.345786 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-9d3aaad8-51e6-4f51-b517-2ad79af592cb tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] [instance: 022379ab-af51-495a-bcef-11e43774a7b0] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:59.357109 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f791be88-97fb-4f1f-95ee-dcc6a5ea5236 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] 10.222.0.60 "GET /compute/v2.1/servers/48a1400e-608d-43af-8a2a-257a5c4c316b" status: 200 len: 1366 microversion: 2.47 time: 0.176246 Sep 14 09:23:59.359243 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3001/6026] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:23:59 2022] GET /compute/v2.1/servers/48a1400e-608d-43af-8a2a-257a5c4c316b => generated 1366 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:23:59.361230 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9d3aaad8-51e6-4f51-b517-2ad79af592cb tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:59.364894 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9d3aaad8-51e6-4f51-b517-2ad79af592cb tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:59.365859 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9d3aaad8-51e6-4f51-b517-2ad79af592cb tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:59.368097 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9d3aaad8-51e6-4f51-b517-2ad79af592cb tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:59.370743 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9d3aaad8-51e6-4f51-b517-2ad79af592cb tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:59.372295 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9d3aaad8-51e6-4f51-b517-2ad79af592cb tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:59.408498 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-9d3aaad8-51e6-4f51-b517-2ad79af592cb tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] [instance: 022379ab-af51-495a-bcef-11e43774a7b0] Going to try to terminate instance {{(pid=128758) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:23:59.450621 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-016ac2ed-b9b6-4191-a37f-f47b9b0e7519 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:59.451293 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-016ac2ed-b9b6-4191-a37f-f47b9b0e7519 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] [instance: d727e6d2-dc0c-4ee3-9d0f-999d1a4307fa] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:59.467206 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-016ac2ed-b9b6-4191-a37f-f47b9b0e7519 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:59.468053 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-016ac2ed-b9b6-4191-a37f-f47b9b0e7519 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:59.468664 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-016ac2ed-b9b6-4191-a37f-f47b9b0e7519 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:59.469585 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-016ac2ed-b9b6-4191-a37f-f47b9b0e7519 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:59.470309 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-016ac2ed-b9b6-4191-a37f-f47b9b0e7519 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:59.470919 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-016ac2ed-b9b6-4191-a37f-f47b9b0e7519 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:59.535855 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-9d3aaad8-51e6-4f51-b517-2ad79af592cb tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] 10.222.0.60 "DELETE /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0" status: 204 len: 0 microversion: 2.1 time: 0.200428 Sep 14 09:23:59.541147 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3026/6027] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:23:59 2022] DELETE /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:23:59.551907 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-dbc08a3a-9cec-4ae0-8e7f-5327b634db91 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:59.561445 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-dbc08a3a-9cec-4ae0-8e7f-5327b634db91 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] [instance: 022379ab-af51-495a-bcef-11e43774a7b0] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:59.579576 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dbc08a3a-9cec-4ae0-8e7f-5327b634db91 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:59.580475 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dbc08a3a-9cec-4ae0-8e7f-5327b634db91 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:59.581149 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dbc08a3a-9cec-4ae0-8e7f-5327b634db91 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:59.582230 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dbc08a3a-9cec-4ae0-8e7f-5327b634db91 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:59.582977 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dbc08a3a-9cec-4ae0-8e7f-5327b634db91 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:59.583641 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dbc08a3a-9cec-4ae0-8e7f-5327b634db91 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:59.856782 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-016ac2ed-b9b6-4191-a37f-f47b9b0e7519 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0ed82129324c07a8c4158d207fcc4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cd8586b239f4f13a775a0465b9271a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:59.867343 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-016ac2ed-b9b6-4191-a37f-f47b9b0e7519 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] 10.222.0.60 "GET /compute/v2.1/servers/d727e6d2-dc0c-4ee3-9d0f-999d1a4307fa" status: 200 len: 1427 microversion: 2.1 time: 0.421291 Sep 14 09:23:59.882334 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-dbc08a3a-9cec-4ae0-8e7f-5327b634db91 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9568f2d3f644e409961ab34e8fa95cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8638ed7d7b3d4285b36865282b8caeab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:59.899136 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3002/6028] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:23:59 2022] GET /compute/v2.1/servers/d727e6d2-dc0c-4ee3-9d0f-999d1a4307fa => generated 1427 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:23:59.904841 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-dbc08a3a-9cec-4ae0-8e7f-5327b634db91 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] 10.222.0.60 "GET /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0" status: 200 len: 1672 microversion: 2.1 time: 0.359523 Sep 14 09:23:59.911076 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3027/6029] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:23:59 2022] GET /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0 => generated 1672 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:24:00.360049 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b0075ff7-8639-4f19-9254-cec6f6b09d54 tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:00.361673 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b0075ff7-8639-4f19-9254-cec6f6b09d54 tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] [instance: c4cbdcff-ec3f-4c46-891a-34307e72ce39] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:00.371505 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b0075ff7-8639-4f19-9254-cec6f6b09d54 tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:00.373017 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b0075ff7-8639-4f19-9254-cec6f6b09d54 tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:00.373800 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b0075ff7-8639-4f19-9254-cec6f6b09d54 tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:00.374711 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b0075ff7-8639-4f19-9254-cec6f6b09d54 tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:00.375450 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b0075ff7-8639-4f19-9254-cec6f6b09d54 tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:00.376664 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b0075ff7-8639-4f19-9254-cec6f6b09d54 tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:00.384882 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-3c66bb07-7eb5-465e-959a-565e1e8a5774 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:00.385679 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-3c66bb07-7eb5-465e-959a-565e1e8a5774 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] [instance: 48a1400e-608d-43af-8a2a-257a5c4c316b] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:00.397502 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3c66bb07-7eb5-465e-959a-565e1e8a5774 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:00.405775 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3c66bb07-7eb5-465e-959a-565e1e8a5774 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:00.406328 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3c66bb07-7eb5-465e-959a-565e1e8a5774 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:00.407356 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3c66bb07-7eb5-465e-959a-565e1e8a5774 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:00.407931 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3c66bb07-7eb5-465e-959a-565e1e8a5774 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:00.408663 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3c66bb07-7eb5-465e-959a-565e1e8a5774 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:00.523621 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-3c66bb07-7eb5-465e-959a-565e1e8a5774 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46336ae28e14b1092c4f1b3778d83e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a81e0c013b6450ebb75fe5a86220b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:00.532660 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-3c66bb07-7eb5-465e-959a-565e1e8a5774 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e46336ae28e14b1092c4f1b3778d83e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a81e0c013b6450ebb75fe5a86220b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:00.534136 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-3c66bb07-7eb5-465e-959a-565e1e8a5774 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e46336ae28e14b1092c4f1b3778d83e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a81e0c013b6450ebb75fe5a86220b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:00.535579 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-3c66bb07-7eb5-465e-959a-565e1e8a5774 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] 10.222.0.60 "GET /compute/v2.1/servers/48a1400e-608d-43af-8a2a-257a5c4c316b" status: 200 len: 1366 microversion: 2.47 time: 0.154933 Sep 14 09:24:00.542469 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3028/6030] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:24:00 2022] GET /compute/v2.1/servers/48a1400e-608d-43af-8a2a-257a5c4c316b => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:24:00.574976 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b0075ff7-8639-4f19-9254-cec6f6b09d54 tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19826a6d776745bf9e2c781c99506f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74627c6924304b09aeccbea302b401af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:00.583061 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b0075ff7-8639-4f19-9254-cec6f6b09d54 tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] 10.222.0.60 "GET /compute/v2.1/servers/c4cbdcff-ec3f-4c46-891a-34307e72ce39" status: 200 len: 1313 microversion: 2.1 time: 0.227893 Sep 14 09:24:00.583665 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3003/6031] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:24:00 2022] GET /compute/v2.1/servers/c4cbdcff-ec3f-4c46-891a-34307e72ce39 => generated 1313 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:24:00.902977 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-9cdbb618-70d1-46dc-b2cc-ef32bba44951 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:00.903870 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-9cdbb618-70d1-46dc-b2cc-ef32bba44951 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] [instance: d727e6d2-dc0c-4ee3-9d0f-999d1a4307fa] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:00.920494 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9cdbb618-70d1-46dc-b2cc-ef32bba44951 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:00.921072 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9cdbb618-70d1-46dc-b2cc-ef32bba44951 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:00.921684 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9cdbb618-70d1-46dc-b2cc-ef32bba44951 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:00.922423 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9cdbb618-70d1-46dc-b2cc-ef32bba44951 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:00.923174 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9cdbb618-70d1-46dc-b2cc-ef32bba44951 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:00.923613 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9cdbb618-70d1-46dc-b2cc-ef32bba44951 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:00.935103 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b6154d85-79d5-4ffb-9b5a-5227c9418a7b tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:00.935786 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b6154d85-79d5-4ffb-9b5a-5227c9418a7b tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] [instance: 022379ab-af51-495a-bcef-11e43774a7b0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:00.945746 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b6154d85-79d5-4ffb-9b5a-5227c9418a7b tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:00.946791 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b6154d85-79d5-4ffb-9b5a-5227c9418a7b tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:00.948725 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b6154d85-79d5-4ffb-9b5a-5227c9418a7b tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:00.951957 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b6154d85-79d5-4ffb-9b5a-5227c9418a7b tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:00.952451 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b6154d85-79d5-4ffb-9b5a-5227c9418a7b tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:00.952896 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b6154d85-79d5-4ffb-9b5a-5227c9418a7b tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:01.226892 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-9cdbb618-70d1-46dc-b2cc-ef32bba44951 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0ed82129324c07a8c4158d207fcc4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cd8586b239f4f13a775a0465b9271a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:01.238111 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-9cdbb618-70d1-46dc-b2cc-ef32bba44951 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] 10.222.0.60 "GET /compute/v2.1/servers/d727e6d2-dc0c-4ee3-9d0f-999d1a4307fa" status: 200 len: 1427 microversion: 2.1 time: 0.345169 Sep 14 09:24:01.239276 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3029/6032] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:24:00 2022] GET /compute/v2.1/servers/d727e6d2-dc0c-4ee3-9d0f-999d1a4307fa => generated 1427 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:24:01.252889 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b6154d85-79d5-4ffb-9b5a-5227c9418a7b tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9568f2d3f644e409961ab34e8fa95cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8638ed7d7b3d4285b36865282b8caeab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:01.265599 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b6154d85-79d5-4ffb-9b5a-5227c9418a7b tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] 10.222.0.60 "GET /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0" status: 200 len: 1672 microversion: 2.1 time: 0.337923 Sep 14 09:24:01.266195 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3004/6033] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:24:00 2022] GET /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0 => generated 1672 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:24:01.561895 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-21ebab7a-5bc5-42c8-a119-5408685e403f tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:01.562447 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-21ebab7a-5bc5-42c8-a119-5408685e403f tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] [instance: 48a1400e-608d-43af-8a2a-257a5c4c316b] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:01.569839 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-21ebab7a-5bc5-42c8-a119-5408685e403f tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:01.570332 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-21ebab7a-5bc5-42c8-a119-5408685e403f tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:01.570773 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-21ebab7a-5bc5-42c8-a119-5408685e403f tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:01.571944 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-21ebab7a-5bc5-42c8-a119-5408685e403f tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:01.572399 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-21ebab7a-5bc5-42c8-a119-5408685e403f tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:01.572999 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-21ebab7a-5bc5-42c8-a119-5408685e403f tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:01.606372 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-24e0d223-6f63-45d4-8603-cd8e05f1782e tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:01.608116 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-24e0d223-6f63-45d4-8603-cd8e05f1782e tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] [instance: c4cbdcff-ec3f-4c46-891a-34307e72ce39] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:01.615470 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-24e0d223-6f63-45d4-8603-cd8e05f1782e tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:01.615975 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-24e0d223-6f63-45d4-8603-cd8e05f1782e tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:01.616611 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-24e0d223-6f63-45d4-8603-cd8e05f1782e tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:01.617502 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-24e0d223-6f63-45d4-8603-cd8e05f1782e tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:01.617970 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-24e0d223-6f63-45d4-8603-cd8e05f1782e tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:01.618574 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-24e0d223-6f63-45d4-8603-cd8e05f1782e tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:01.650552 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-21ebab7a-5bc5-42c8-a119-5408685e403f tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46336ae28e14b1092c4f1b3778d83e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a81e0c013b6450ebb75fe5a86220b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:01.662040 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-21ebab7a-5bc5-42c8-a119-5408685e403f tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e46336ae28e14b1092c4f1b3778d83e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a81e0c013b6450ebb75fe5a86220b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:01.663726 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-21ebab7a-5bc5-42c8-a119-5408685e403f tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e46336ae28e14b1092c4f1b3778d83e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a81e0c013b6450ebb75fe5a86220b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:01.664943 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-21ebab7a-5bc5-42c8-a119-5408685e403f tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] 10.222.0.60 "GET /compute/v2.1/servers/48a1400e-608d-43af-8a2a-257a5c4c316b" status: 200 len: 1366 microversion: 2.47 time: 0.107204 Sep 14 09:24:01.665526 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3030/6034] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:24:01 2022] GET /compute/v2.1/servers/48a1400e-608d-43af-8a2a-257a5c4c316b => generated 1366 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:24:01.765050 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-24e0d223-6f63-45d4-8603-cd8e05f1782e tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19826a6d776745bf9e2c781c99506f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74627c6924304b09aeccbea302b401af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:01.772812 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-24e0d223-6f63-45d4-8603-cd8e05f1782e tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] 10.222.0.60 "GET /compute/v2.1/servers/c4cbdcff-ec3f-4c46-891a-34307e72ce39" status: 200 len: 1313 microversion: 2.1 time: 0.171090 Sep 14 09:24:01.773386 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3005/6035] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:24:01 2022] GET /compute/v2.1/servers/c4cbdcff-ec3f-4c46-891a-34307e72ce39 => generated 1313 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:24:02.264329 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-2dcde968-f0b5-46e9-bff2-bf716a3e4652 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:02.272379 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-2dcde968-f0b5-46e9-bff2-bf716a3e4652 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] [instance: d727e6d2-dc0c-4ee3-9d0f-999d1a4307fa] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:02.276219 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:24:02.282590 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2dcde968-f0b5-46e9-bff2-bf716a3e4652 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:02.283116 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2dcde968-f0b5-46e9-bff2-bf716a3e4652 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:02.285815 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2dcde968-f0b5-46e9-bff2-bf716a3e4652 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:02.291128 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a8cabb2e-07bb-4a7f-92f5-9ae14719aa00 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:02.291763 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-a8cabb2e-07bb-4a7f-92f5-9ae14719aa00 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] [instance: 022379ab-af51-495a-bcef-11e43774a7b0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:02.297721 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2dcde968-f0b5-46e9-bff2-bf716a3e4652 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:02.298218 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2dcde968-f0b5-46e9-bff2-bf716a3e4652 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:02.298664 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2dcde968-f0b5-46e9-bff2-bf716a3e4652 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:02.306183 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a8cabb2e-07bb-4a7f-92f5-9ae14719aa00 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:02.306698 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a8cabb2e-07bb-4a7f-92f5-9ae14719aa00 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:02.308005 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a8cabb2e-07bb-4a7f-92f5-9ae14719aa00 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:02.308899 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a8cabb2e-07bb-4a7f-92f5-9ae14719aa00 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:02.310987 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a8cabb2e-07bb-4a7f-92f5-9ae14719aa00 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:02.311376 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a8cabb2e-07bb-4a7f-92f5-9ae14719aa00 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:02.386846 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-a8cabb2e-07bb-4a7f-92f5-9ae14719aa00 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9568f2d3f644e409961ab34e8fa95cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8638ed7d7b3d4285b36865282b8caeab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:02.406289 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a8cabb2e-07bb-4a7f-92f5-9ae14719aa00 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] 10.222.0.60 "GET /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0" status: 200 len: 1604 microversion: 2.1 time: 0.118938 Sep 14 09:24:02.407971 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3006/6036] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:24:02 2022] GET /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0 => generated 1604 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:24:02.517643 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-2dcde968-f0b5-46e9-bff2-bf716a3e4652 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0ed82129324c07a8c4158d207fcc4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cd8586b239f4f13a775a0465b9271a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:02.519832 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-ebf4d9f9-392d-4f35-9278-5fdb9ed5c5ee req-2f22d8ad-2a28-4038-a166-fa5846a29868 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4cbdcff-ec3f-4c46-891a-34307e72ce39", "name": "network-vif-plugged", "status": "completed", "tag": "4eade9a3-b4a8-4975-9192-8b0dc49bf7e6"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:24:02.533617 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-2dcde968-f0b5-46e9-bff2-bf716a3e4652 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] 10.222.0.60 "GET /compute/v2.1/servers/d727e6d2-dc0c-4ee3-9d0f-999d1a4307fa" status: 200 len: 1427 microversion: 2.1 time: 0.274330 Sep 14 09:24:02.533875 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-ebf4d9f9-392d-4f35-9278-5fdb9ed5c5ee req-2f22d8ad-2a28-4038-a166-fa5846a29868 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:02.536215 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3031/6037] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:24:02 2022] GET /compute/v2.1/servers/d727e6d2-dc0c-4ee3-9d0f-999d1a4307fa => generated 1427 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:24:02.537949 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-ebf4d9f9-392d-4f35-9278-5fdb9ed5c5ee req-2f22d8ad-2a28-4038-a166-fa5846a29868 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:02.538759 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-ebf4d9f9-392d-4f35-9278-5fdb9ed5c5ee req-2f22d8ad-2a28-4038-a166-fa5846a29868 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:02.556470 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-ebf4d9f9-392d-4f35-9278-5fdb9ed5c5ee req-2f22d8ad-2a28-4038-a166-fa5846a29868 service nova] Creating event network-vif-plugged:4eade9a3-b4a8-4975-9192-8b0dc49bf7e6 for instance c4cbdcff-ec3f-4c46-891a-34307e72ce39 on n-h1-836830-18 Sep 14 09:24:02.567406 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-ebf4d9f9-392d-4f35-9278-5fdb9ed5c5ee req-2f22d8ad-2a28-4038-a166-fa5846a29868 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052146 Sep 14 09:24:02.568064 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3007/6038] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:24:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:24:02.622198 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-765b9a6e-7a02-48d2-8b2a-09b0a9c7f469 req-edcd7685-643e-46da-a5a4-c9dd7d3f107f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "022379ab-af51-495a-bcef-11e43774a7b0", "name": "network-vif-deleted", "tag": "978742e8-02b6-4b3b-8b11-e9cef9c890d0"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:24:02.652094 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-765b9a6e-7a02-48d2-8b2a-09b0a9c7f469 req-edcd7685-643e-46da-a5a4-c9dd7d3f107f service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:02.652785 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-765b9a6e-7a02-48d2-8b2a-09b0a9c7f469 req-edcd7685-643e-46da-a5a4-c9dd7d3f107f service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:02.653436 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-765b9a6e-7a02-48d2-8b2a-09b0a9c7f469 req-edcd7685-643e-46da-a5a4-c9dd7d3f107f service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:02.669092 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-765b9a6e-7a02-48d2-8b2a-09b0a9c7f469 req-edcd7685-643e-46da-a5a4-c9dd7d3f107f service nova] Creating event network-vif-deleted:978742e8-02b6-4b3b-8b11-e9cef9c890d0 for instance 022379ab-af51-495a-bcef-11e43774a7b0 on n-h1-836830-18 Sep 14 09:24:02.674662 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-765b9a6e-7a02-48d2-8b2a-09b0a9c7f469 req-edcd7685-643e-46da-a5a4-c9dd7d3f107f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056797 Sep 14 09:24:02.675643 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3032/6039] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:24:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:24:02.693406 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-bd72f0eb-2b63-4c92-9332-6134aedc4a5d tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:02.694845 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-bd72f0eb-2b63-4c92-9332-6134aedc4a5d tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] [instance: 48a1400e-608d-43af-8a2a-257a5c4c316b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:02.706294 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bd72f0eb-2b63-4c92-9332-6134aedc4a5d tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:02.707232 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bd72f0eb-2b63-4c92-9332-6134aedc4a5d tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:02.707977 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bd72f0eb-2b63-4c92-9332-6134aedc4a5d tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:02.709099 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bd72f0eb-2b63-4c92-9332-6134aedc4a5d tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:02.710387 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bd72f0eb-2b63-4c92-9332-6134aedc4a5d tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:02.711073 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bd72f0eb-2b63-4c92-9332-6134aedc4a5d tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:02.797857 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ffedb073-2104-4d35-a78e-212cc99ebd35 tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:02.798797 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-ffedb073-2104-4d35-a78e-212cc99ebd35 tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] [instance: c4cbdcff-ec3f-4c46-891a-34307e72ce39] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:02.815214 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ffedb073-2104-4d35-a78e-212cc99ebd35 tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:02.815945 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ffedb073-2104-4d35-a78e-212cc99ebd35 tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:02.816541 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ffedb073-2104-4d35-a78e-212cc99ebd35 tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:02.817510 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ffedb073-2104-4d35-a78e-212cc99ebd35 tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:02.818188 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ffedb073-2104-4d35-a78e-212cc99ebd35 tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:02.818786 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ffedb073-2104-4d35-a78e-212cc99ebd35 tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:02.832614 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-bd72f0eb-2b63-4c92-9332-6134aedc4a5d tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46336ae28e14b1092c4f1b3778d83e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a81e0c013b6450ebb75fe5a86220b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:02.849858 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-bd72f0eb-2b63-4c92-9332-6134aedc4a5d tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e46336ae28e14b1092c4f1b3778d83e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a81e0c013b6450ebb75fe5a86220b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:02.852000 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-bd72f0eb-2b63-4c92-9332-6134aedc4a5d tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e46336ae28e14b1092c4f1b3778d83e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a81e0c013b6450ebb75fe5a86220b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:02.853464 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-bd72f0eb-2b63-4c92-9332-6134aedc4a5d tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] 10.222.0.60 "GET /compute/v2.1/servers/48a1400e-608d-43af-8a2a-257a5c4c316b" status: 200 len: 1366 microversion: 2.47 time: 0.166023 Sep 14 09:24:02.855333 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3008/6040] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:24:02 2022] GET /compute/v2.1/servers/48a1400e-608d-43af-8a2a-257a5c4c316b => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:24:02.967823 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-ffedb073-2104-4d35-a78e-212cc99ebd35 tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19826a6d776745bf9e2c781c99506f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74627c6924304b09aeccbea302b401af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:02.975698 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-ffedb073-2104-4d35-a78e-212cc99ebd35 tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] 10.222.0.60 "GET /compute/v2.1/servers/c4cbdcff-ec3f-4c46-891a-34307e72ce39" status: 200 len: 1313 microversion: 2.1 time: 0.182760 Sep 14 09:24:02.976282 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3033/6041] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:24:02 2022] GET /compute/v2.1/servers/c4cbdcff-ec3f-4c46-891a-34307e72ce39 => generated 1313 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:24:03.431705 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-dc6d019d-614a-458c-b78c-ec66270a4332 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:03.432262 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-dc6d019d-614a-458c-b78c-ec66270a4332 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] [instance: 022379ab-af51-495a-bcef-11e43774a7b0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:03.438611 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dc6d019d-614a-458c-b78c-ec66270a4332 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:03.439144 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dc6d019d-614a-458c-b78c-ec66270a4332 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:03.439595 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dc6d019d-614a-458c-b78c-ec66270a4332 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:03.440303 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dc6d019d-614a-458c-b78c-ec66270a4332 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:03.440769 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dc6d019d-614a-458c-b78c-ec66270a4332 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:03.441204 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dc6d019d-614a-458c-b78c-ec66270a4332 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:03.473359 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dc6d019d-614a-458c-b78c-ec66270a4332 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:03.473858 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dc6d019d-614a-458c-b78c-ec66270a4332 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:03.474310 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dc6d019d-614a-458c-b78c-ec66270a4332 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:03.474770 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.objects.instance [None req-dc6d019d-614a-458c-b78c-ec66270a4332 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lazy-loading 'fault' on Instance uuid 022379ab-af51-495a-bcef-11e43774a7b0 {{(pid=128759) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:24:03.516604 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-dc6d019d-614a-458c-b78c-ec66270a4332 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9568f2d3f644e409961ab34e8fa95cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8638ed7d7b3d4285b36865282b8caeab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:03.524818 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-dc6d019d-614a-458c-b78c-ec66270a4332 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] 10.222.0.60 "GET /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0" status: 200 len: 1327 microversion: 2.1 time: 0.097262 Sep 14 09:24:03.525406 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3009/6042] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:24:03 2022] GET /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0 => generated 1327 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:24:03.559836 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-e098c041-001e-4939-bf95-c19405a2cb50 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:03.560709 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-e098c041-001e-4939-bf95-c19405a2cb50 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] [instance: d727e6d2-dc0c-4ee3-9d0f-999d1a4307fa] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:03.566720 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e098c041-001e-4939-bf95-c19405a2cb50 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:03.567252 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e098c041-001e-4939-bf95-c19405a2cb50 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:03.567693 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e098c041-001e-4939-bf95-c19405a2cb50 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:03.568575 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e098c041-001e-4939-bf95-c19405a2cb50 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:03.569051 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e098c041-001e-4939-bf95-c19405a2cb50 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:03.569484 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e098c041-001e-4939-bf95-c19405a2cb50 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:03.880890 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a50a2460-bc62-4f40-ae8d-3b7cc2d0fef5 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:03.882098 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-a50a2460-bc62-4f40-ae8d-3b7cc2d0fef5 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] [instance: 48a1400e-608d-43af-8a2a-257a5c4c316b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:03.890382 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a50a2460-bc62-4f40-ae8d-3b7cc2d0fef5 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:03.890888 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a50a2460-bc62-4f40-ae8d-3b7cc2d0fef5 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:03.891440 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a50a2460-bc62-4f40-ae8d-3b7cc2d0fef5 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:03.892170 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a50a2460-bc62-4f40-ae8d-3b7cc2d0fef5 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:03.892631 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a50a2460-bc62-4f40-ae8d-3b7cc2d0fef5 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:03.893063 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a50a2460-bc62-4f40-ae8d-3b7cc2d0fef5 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:04.067474 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-e098c041-001e-4939-bf95-c19405a2cb50 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0ed82129324c07a8c4158d207fcc4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cd8586b239f4f13a775a0465b9271a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:04.076830 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-e098c041-001e-4939-bf95-c19405a2cb50 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] 10.222.0.60 "GET /compute/v2.1/servers/d727e6d2-dc0c-4ee3-9d0f-999d1a4307fa" status: 200 len: 1427 microversion: 2.1 time: 0.521152 Sep 14 09:24:04.078039 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3034/6043] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:24:03 2022] GET /compute/v2.1/servers/d727e6d2-dc0c-4ee3-9d0f-999d1a4307fa => generated 1427 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:24:04.084410 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-a50a2460-bc62-4f40-ae8d-3b7cc2d0fef5 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46336ae28e14b1092c4f1b3778d83e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a81e0c013b6450ebb75fe5a86220b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:04.092217 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-04021eaa-ec2a-4b3c-a316-bdc7ee4f64f3 tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:04.093088 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-04021eaa-ec2a-4b3c-a316-bdc7ee4f64f3 tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] [instance: c4cbdcff-ec3f-4c46-891a-34307e72ce39] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:04.094439 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-a50a2460-bc62-4f40-ae8d-3b7cc2d0fef5 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e46336ae28e14b1092c4f1b3778d83e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a81e0c013b6450ebb75fe5a86220b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:04.096321 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-a50a2460-bc62-4f40-ae8d-3b7cc2d0fef5 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e46336ae28e14b1092c4f1b3778d83e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a81e0c013b6450ebb75fe5a86220b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:04.100831 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-04021eaa-ec2a-4b3c-a316-bdc7ee4f64f3 tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:04.101242 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-04021eaa-ec2a-4b3c-a316-bdc7ee4f64f3 tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:04.101982 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-04021eaa-ec2a-4b3c-a316-bdc7ee4f64f3 tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:04.102871 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-04021eaa-ec2a-4b3c-a316-bdc7ee4f64f3 tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:04.103081 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a50a2460-bc62-4f40-ae8d-3b7cc2d0fef5 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] 10.222.0.60 "GET /compute/v2.1/servers/48a1400e-608d-43af-8a2a-257a5c4c316b" status: 200 len: 1366 microversion: 2.47 time: 0.226086 Sep 14 09:24:04.103361 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-04021eaa-ec2a-4b3c-a316-bdc7ee4f64f3 tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:04.103787 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-04021eaa-ec2a-4b3c-a316-bdc7ee4f64f3 tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:04.103901 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3010/6044] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:24:03 2022] GET /compute/v2.1/servers/48a1400e-608d-43af-8a2a-257a5c4c316b => generated 1366 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:24:04.128850 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:24:04.249891 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-04021eaa-ec2a-4b3c-a316-bdc7ee4f64f3 tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19826a6d776745bf9e2c781c99506f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74627c6924304b09aeccbea302b401af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:04.260098 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-04021eaa-ec2a-4b3c-a316-bdc7ee4f64f3 tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] 10.222.0.60 "GET /compute/v2.1/servers/c4cbdcff-ec3f-4c46-891a-34307e72ce39" status: 200 len: 1313 microversion: 2.1 time: 0.180504 Sep 14 09:24:04.261872 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3035/6045] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:24:04 2022] GET /compute/v2.1/servers/c4cbdcff-ec3f-4c46-891a-34307e72ce39 => generated 1313 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:24:04.548998 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-1c9bfe19-4ac9-4b1c-91a1-55175751f89c tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:04.549575 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-1c9bfe19-4ac9-4b1c-91a1-55175751f89c tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] [instance: 022379ab-af51-495a-bcef-11e43774a7b0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:04.556013 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1c9bfe19-4ac9-4b1c-91a1-55175751f89c tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:04.556503 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1c9bfe19-4ac9-4b1c-91a1-55175751f89c tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:04.556950 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1c9bfe19-4ac9-4b1c-91a1-55175751f89c tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:04.558327 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1c9bfe19-4ac9-4b1c-91a1-55175751f89c tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:04.558785 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1c9bfe19-4ac9-4b1c-91a1-55175751f89c tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:04.559247 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1c9bfe19-4ac9-4b1c-91a1-55175751f89c tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:04.574236 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-1c9bfe19-4ac9-4b1c-91a1-55175751f89c tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] HTTP exception thrown: Instance 022379ab-af51-495a-bcef-11e43774a7b0 could not be found. Sep 14 09:24:04.575947 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-1c9bfe19-4ac9-4b1c-91a1-55175751f89c tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Request method failure captured: Sep 14 09:24:04.575947 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0 HTTP/1.1 Sep 14 09:24:04.575947 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:24:04.575947 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:24:04.575947 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:24:04.575947 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:24:04.575947 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:24:04.575947 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:24:04.575947 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:24:04.575947 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:24:04.575947 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZx9aFKqEB9cMgUgPNoCaUFt_lsGYQ5O0XFZVwyFFRnz3QbKviZWjgwXU5xFdgyAz8ZOyj-M7ffqBSNBl5KJuM0Uv_JGgNMNJd3ugvalumtSGtzFh-wD7f1fdJl8S4Lm2WlrH0fOtOpZ0gOE-tppUF2FxQ2JMU5kvYVSpqc9pAkzXt0 Sep 14 09:24:04.575947 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:24:04.575947 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:24:04.575947 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:24:04.575947 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:24:04.575947 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:24:04.575947 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:24:04.575947 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 8638ed7d7b3d4285b36865282b8caeab Sep 14 09:24:04.575947 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-AttachVolumeTestJSON-355816842 Sep 14 09:24:04.575947 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:24:04.575947 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:24:04.575947 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/8638ed7d7b3d4285b36865282b8caeab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_8638ed7d7b3d4285b36865282b8caeab"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8638ed7d7b3d4285b36865282b8caeab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8638ed7d7b3d4285b36865282b8caeab"}]}] Sep 14 09:24:04.575947 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-AttachVolumeTestJSON-355816842 Sep 14 09:24:04.575947 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 8638ed7d7b3d4285b36865282b8caeab Sep 14 09:24:04.575947 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-AttachVolumeTestJSON-355816842 Sep 14 09:24:04.575947 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-AttachVolumeTestJSON-355816842-project Sep 14 09:24:04.575947 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:24:04.575947 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:24:04.575947 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: b9568f2d3f644e409961ab34e8fa95cc Sep 14 09:24:04.575947 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-AttachVolumeTestJSON-355816842-project Sep 14 09:24:04.575947 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:24:04.575947 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance 022379ab-af51-495a-bcef-11e43774a7b0 could not be found. Sep 14 09:24:04.575947 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '022379ab-af51-495a-bcef-11e43774a7b0'} Sep 14 09:24:04.575947 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:24:04.575947 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:24:04.575947 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:24:04.575947 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:24:04.575947 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:24:04.575947 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:24:04.575947 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:24:04.575947 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:24:04.575947 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:24:04.575947 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:24:04.575947 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 022379ab-af51-495a-bcef-11e43774a7b0 could not be found. Sep 14 09:24:04.575947 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:24:04.575947 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:24:04.575947 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:24:04.575947 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:24:04.575947 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:24:04.575947 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:24:04.575947 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:24:04.575947 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:24:04.575947 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:24:04.575947 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:24:04.575947 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:24:04.575947 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:24:04.575947 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:24:04.575947 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:24:04.575947 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:24:04.575947 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:24:04.575947 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 022379ab-af51-495a-bcef-11e43774a7b0 could not be found. Sep 14 09:24:04.575947 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:24:04.575947 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:24:04.575947 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:24:04.580472 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:24:04.580472 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:24:04.580472 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:24:04.580472 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:24:04.580472 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:24:04.580472 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 022379ab-af51-495a-bcef-11e43774a7b0 could not be found. Sep 14 09:24:04.580472 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:24:04.580472 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-1c9bfe19-4ac9-4b1c-91a1-55175751f89c tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Returning 404 to user: Instance 022379ab-af51-495a-bcef-11e43774a7b0 could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:24:04.580472 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-1c9bfe19-4ac9-4b1c-91a1-55175751f89c tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] 10.222.0.60 "GET /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0" status: 404 len: 111 microversion: 2.1 time: 0.032382 Sep 14 09:24:04.580472 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3011/6046] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:24:04 2022] GET /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:24:04.586244 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-cd96189d-221a-4912-85ba-e490da193472 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Calling method '.version_select at 0x7f7d44653ca0>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:04.590959 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=4 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:24:04.592176 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=20 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:24:04.600744 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-d33fc7c4-daa9-4081-9997-181af14ccbbb req-fe556bc0-6df3-4a5b-83c2-fbedf471826b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d727e6d2-dc0c-4ee3-9d0f-999d1a4307fa", "name": "network-vif-plugged", "status": "completed", "tag": "e80a892b-147a-4c93-949d-38ec11071f4c"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:24:04.607812 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-cd96189d-221a-4912-85ba-e490da193472 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-274871482" status: 202 len: 0 microversion: 2.1 time: 0.025329 Sep 14 09:24:04.608733 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3036/6047] 10.222.0.60 () {58 vars in 1218 bytes} [Wed Sep 14 09:24:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-274871482 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:24:04.612210 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-d33fc7c4-daa9-4081-9997-181af14ccbbb req-fe556bc0-6df3-4a5b-83c2-fbedf471826b service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:04.612560 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-d33fc7c4-daa9-4081-9997-181af14ccbbb req-fe556bc0-6df3-4a5b-83c2-fbedf471826b service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:04.612972 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-d33fc7c4-daa9-4081-9997-181af14ccbbb req-fe556bc0-6df3-4a5b-83c2-fbedf471826b service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:04.625248 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-d33fc7c4-daa9-4081-9997-181af14ccbbb req-fe556bc0-6df3-4a5b-83c2-fbedf471826b service nova] Creating event network-vif-plugged:e80a892b-147a-4c93-949d-38ec11071f4c for instance d727e6d2-dc0c-4ee3-9d0f-999d1a4307fa on n-h2-836830-18 Sep 14 09:24:04.630359 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-d33fc7c4-daa9-4081-9997-181af14ccbbb req-fe556bc0-6df3-4a5b-83c2-fbedf471826b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033443 Sep 14 09:24:04.631151 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3012/6048] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:24:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:24:05.103760 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b2c6ea6d-1719-4164-b906-306aac52258f tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:05.104587 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-b2c6ea6d-1719-4164-b906-306aac52258f tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] [instance: d727e6d2-dc0c-4ee3-9d0f-999d1a4307fa] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:05.112757 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b2c6ea6d-1719-4164-b906-306aac52258f tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:05.113394 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b2c6ea6d-1719-4164-b906-306aac52258f tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:05.113891 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b2c6ea6d-1719-4164-b906-306aac52258f tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:05.114613 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b2c6ea6d-1719-4164-b906-306aac52258f tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:05.115218 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b2c6ea6d-1719-4164-b906-306aac52258f tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:05.116113 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b2c6ea6d-1719-4164-b906-306aac52258f tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:05.133581 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-eea1686c-c4c4-4d50-b96d-f22876765d33 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:05.134533 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-eea1686c-c4c4-4d50-b96d-f22876765d33 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] [instance: 48a1400e-608d-43af-8a2a-257a5c4c316b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:05.137898 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=4 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:24:05.144392 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-eea1686c-c4c4-4d50-b96d-f22876765d33 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:05.145107 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-eea1686c-c4c4-4d50-b96d-f22876765d33 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:05.145671 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-eea1686c-c4c4-4d50-b96d-f22876765d33 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:05.147106 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-eea1686c-c4c4-4d50-b96d-f22876765d33 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:05.148244 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-eea1686c-c4c4-4d50-b96d-f22876765d33 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:05.149630 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-eea1686c-c4c4-4d50-b96d-f22876765d33 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:05.232632 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-eea1686c-c4c4-4d50-b96d-f22876765d33 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46336ae28e14b1092c4f1b3778d83e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a81e0c013b6450ebb75fe5a86220b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:05.247370 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-eea1686c-c4c4-4d50-b96d-f22876765d33 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e46336ae28e14b1092c4f1b3778d83e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a81e0c013b6450ebb75fe5a86220b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:05.249455 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-eea1686c-c4c4-4d50-b96d-f22876765d33 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e46336ae28e14b1092c4f1b3778d83e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a81e0c013b6450ebb75fe5a86220b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:05.250675 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-eea1686c-c4c4-4d50-b96d-f22876765d33 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] 10.222.0.60 "GET /compute/v2.1/servers/48a1400e-608d-43af-8a2a-257a5c4c316b" status: 200 len: 1372 microversion: 2.47 time: 0.122066 Sep 14 09:24:05.251284 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3013/6049] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:24:05 2022] GET /compute/v2.1/servers/48a1400e-608d-43af-8a2a-257a5c4c316b => generated 1372 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 09:24:05.256101 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-6ed8e391-bd6b-42dc-b2c0-773ece8388b9 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Action: 'create', calling method: .version_select at 0x7f7d487668b0>, body: {"keypair": {"name": "tempest-keypair-1060575881", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB/UQrvAMdXuBZdmC2Gp8V47oMDiieMWNfIP5vcRDP08huOIebwgCusrY50+Z/GC5NgxHYf9SV5nPc9HI/w8+NuIO0nEqJelwjxmX0/ogjNUteOZnl9qAXVUajGetUCRgw=="}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:24:05.272577 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-6ed8e391-bd6b-42dc-b2c0-773ece8388b9 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Getting quotas for project 8638ed7d7b3d4285b36865282b8caeab. Resources: {'key_pairs'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:24:05.278411 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-6ed8e391-bd6b-42dc-b2c0-773ece8388b9 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Getting quotas for user b9568f2d3f644e409961ab34e8fa95cc and project 8638ed7d7b3d4285b36865282b8caeab. Resources: {'key_pairs'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:24:05.302373 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-b2c6ea6d-1719-4164-b906-306aac52258f tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0ed82129324c07a8c4158d207fcc4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cd8586b239f4f13a775a0465b9271a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:05.306429 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-6ed8e391-bd6b-42dc-b2c0-773ece8388b9 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.053822 Sep 14 09:24:05.307572 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3014/6050] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Sep 14 09:24:05 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:24:05.312440 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d56cc339-1c68-419c-b4ab-6492c4cb83b2 tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:05.313256 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-d56cc339-1c68-419c-b4ab-6492c4cb83b2 tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] [instance: c4cbdcff-ec3f-4c46-891a-34307e72ce39] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:05.314286 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-b2c6ea6d-1719-4164-b906-306aac52258f tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] 10.222.0.60 "GET /compute/v2.1/servers/d727e6d2-dc0c-4ee3-9d0f-999d1a4307fa" status: 200 len: 1427 microversion: 2.1 time: 0.215477 Sep 14 09:24:05.315278 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3037/6051] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:24:05 2022] GET /compute/v2.1/servers/d727e6d2-dc0c-4ee3-9d0f-999d1a4307fa => generated 1427 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:24:05.324851 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d56cc339-1c68-419c-b4ab-6492c4cb83b2 tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:05.325344 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d56cc339-1c68-419c-b4ab-6492c4cb83b2 tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:05.325789 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d56cc339-1c68-419c-b4ab-6492c4cb83b2 tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:05.326486 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d56cc339-1c68-419c-b4ab-6492c4cb83b2 tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:05.326978 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d56cc339-1c68-419c-b4ab-6492c4cb83b2 tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:05.327393 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d56cc339-1c68-419c-b4ab-6492c4cb83b2 tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:05.347251 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=100 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:24:05.481217 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-d56cc339-1c68-419c-b4ab-6492c4cb83b2 tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19826a6d776745bf9e2c781c99506f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74627c6924304b09aeccbea302b401af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:05.492045 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d56cc339-1c68-419c-b4ab-6492c4cb83b2 tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] 10.222.0.60 "GET /compute/v2.1/servers/c4cbdcff-ec3f-4c46-891a-34307e72ce39" status: 200 len: 1497 microversion: 2.1 time: 0.183047 Sep 14 09:24:05.492857 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3015/6052] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:24:05 2022] GET /compute/v2.1/servers/c4cbdcff-ec3f-4c46-891a-34307e72ce39 => generated 1497 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:24:06.278669 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a9d709bd-0885-4bb3-b28a-fc673c1cd9c9 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:06.279513 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-a9d709bd-0885-4bb3-b28a-fc673c1cd9c9 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] [instance: 48a1400e-608d-43af-8a2a-257a5c4c316b] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:06.288948 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a9d709bd-0885-4bb3-b28a-fc673c1cd9c9 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:06.289803 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a9d709bd-0885-4bb3-b28a-fc673c1cd9c9 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:06.290258 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a9d709bd-0885-4bb3-b28a-fc673c1cd9c9 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:06.291087 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a9d709bd-0885-4bb3-b28a-fc673c1cd9c9 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:06.297882 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a9d709bd-0885-4bb3-b28a-fc673c1cd9c9 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:06.298915 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a9d709bd-0885-4bb3-b28a-fc673c1cd9c9 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:06.337786 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-30a7281f-b58b-41e4-b7b5-9235ae17fda4 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:06.339069 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-30a7281f-b58b-41e4-b7b5-9235ae17fda4 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] [instance: d727e6d2-dc0c-4ee3-9d0f-999d1a4307fa] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:06.350218 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-30a7281f-b58b-41e4-b7b5-9235ae17fda4 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:06.350984 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-30a7281f-b58b-41e4-b7b5-9235ae17fda4 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:06.351604 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-30a7281f-b58b-41e4-b7b5-9235ae17fda4 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:06.352488 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-30a7281f-b58b-41e4-b7b5-9235ae17fda4 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:06.353216 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-30a7281f-b58b-41e4-b7b5-9235ae17fda4 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:06.353826 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-30a7281f-b58b-41e4-b7b5-9235ae17fda4 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:06.387112 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-a9d709bd-0885-4bb3-b28a-fc673c1cd9c9 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46336ae28e14b1092c4f1b3778d83e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a81e0c013b6450ebb75fe5a86220b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:06.400926 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-a9d709bd-0885-4bb3-b28a-fc673c1cd9c9 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e46336ae28e14b1092c4f1b3778d83e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a81e0c013b6450ebb75fe5a86220b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:06.403845 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-a9d709bd-0885-4bb3-b28a-fc673c1cd9c9 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e46336ae28e14b1092c4f1b3778d83e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a81e0c013b6450ebb75fe5a86220b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:06.405473 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-a9d709bd-0885-4bb3-b28a-fc673c1cd9c9 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] 10.222.0.60 "GET /compute/v2.1/servers/48a1400e-608d-43af-8a2a-257a5c4c316b" status: 200 len: 1372 microversion: 2.47 time: 0.131218 Sep 14 09:24:06.411141 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3038/6053] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:24:06 2022] GET /compute/v2.1/servers/48a1400e-608d-43af-8a2a-257a5c4c316b => generated 1372 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:24:06.526569 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-30a7281f-b58b-41e4-b7b5-9235ae17fda4 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0ed82129324c07a8c4158d207fcc4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cd8586b239f4f13a775a0465b9271a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:06.536279 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-30a7281f-b58b-41e4-b7b5-9235ae17fda4 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] 10.222.0.60 "GET /compute/v2.1/servers/d727e6d2-dc0c-4ee3-9d0f-999d1a4307fa" status: 200 len: 1427 microversion: 2.1 time: 0.202376 Sep 14 09:24:06.538524 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3016/6054] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:24:06 2022] GET /compute/v2.1/servers/d727e6d2-dc0c-4ee3-9d0f-999d1a4307fa => generated 1427 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:24:06.786888 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-f2a25c19-d217-4e47-9ead-0dbebeee7340 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-219719760", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cb112191-f1ab-4d55-91a3-99edbe0aaa28"}], "security_groups": [{"name": "tempest-securitygroup--1923474077"}], "key_name": "tempest-keypair-1060575881", "user_data": "}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:24:06.899524 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.network.neutron [None req-f2a25c19-d217-4e47-9ead-0dbebeee7340 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] validate_networks() for [('cb112191-f1ab-4d55-91a3-99edbe0aaa28', None, None, None, None, None)] {{(pid=128758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:24:07.316127 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-f2a25c19-d217-4e47-9ead-0dbebeee7340 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Flavor limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:24:07.316711 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-f2a25c19-d217-4e47-9ead-0dbebeee7340 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Image limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:24:07.317022 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-f2a25c19-d217-4e47-9ead-0dbebeee7340 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Flavor pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:24:07.317438 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-f2a25c19-d217-4e47-9ead-0dbebeee7340 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Image pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:24:07.317888 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-f2a25c19-d217-4e47-9ead-0dbebeee7340 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:24:07.327622 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f2a25c19-d217-4e47-9ead-0dbebeee7340 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:07.328109 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f2a25c19-d217-4e47-9ead-0dbebeee7340 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:07.328548 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f2a25c19-d217-4e47-9ead-0dbebeee7340 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:07.329275 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f2a25c19-d217-4e47-9ead-0dbebeee7340 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:07.329734 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f2a25c19-d217-4e47-9ead-0dbebeee7340 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:07.330157 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f2a25c19-d217-4e47-9ead-0dbebeee7340 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:07.349595 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-f2a25c19-d217-4e47-9ead-0dbebeee7340 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Getting quotas for project 8638ed7d7b3d4285b36865282b8caeab. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:24:07.355699 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-f2a25c19-d217-4e47-9ead-0dbebeee7340 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Getting quotas for user b9568f2d3f644e409961ab34e8fa95cc and project 8638ed7d7b3d4285b36865282b8caeab. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:24:07.368184 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-f2a25c19-d217-4e47-9ead-0dbebeee7340 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Going to run 1 instances... {{(pid=128758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:24:07.371125 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-f2a25c19-d217-4e47-9ead-0dbebeee7340 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] [instance: 55b3478d-f1ae-48db-aea5-2619b302c4a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:24:07.420455 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-f2a25c19-d217-4e47-9ead-0dbebeee7340 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.639614 Sep 14 09:24:07.421132 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3039/6055] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 09:24:06 2022] POST /compute/v2.1/servers => generated 402 bytes in 641 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:24:07.431379 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-57f4a058-7487-44e2-854c-64fd38dddaa8 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:07.432694 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-57f4a058-7487-44e2-854c-64fd38dddaa8 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] [instance: 48a1400e-608d-43af-8a2a-257a5c4c316b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:07.438114 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-7cb6fba1-9237-44fe-bbc4-1900e744e870 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:07.438914 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-7cb6fba1-9237-44fe-bbc4-1900e744e870 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] [instance: 55b3478d-f1ae-48db-aea5-2619b302c4a9] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:07.458376 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-57f4a058-7487-44e2-854c-64fd38dddaa8 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:07.459181 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-57f4a058-7487-44e2-854c-64fd38dddaa8 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:07.459818 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-57f4a058-7487-44e2-854c-64fd38dddaa8 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:07.460718 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-57f4a058-7487-44e2-854c-64fd38dddaa8 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:07.462487 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-57f4a058-7487-44e2-854c-64fd38dddaa8 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:07.464136 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-57f4a058-7487-44e2-854c-64fd38dddaa8 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:07.504881 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-7cb6fba1-9237-44fe-bbc4-1900e744e870 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9568f2d3f644e409961ab34e8fa95cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8638ed7d7b3d4285b36865282b8caeab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:07.513767 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-7cb6fba1-9237-44fe-bbc4-1900e744e870 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] 10.222.0.60 "GET /compute/v2.1/servers/55b3478d-f1ae-48db-aea5-2619b302c4a9" status: 200 len: 1237 microversion: 2.1 time: 0.081578 Sep 14 09:24:07.514353 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3040/6056] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:24:07 2022] GET /compute/v2.1/servers/55b3478d-f1ae-48db-aea5-2619b302c4a9 => generated 1237 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:24:07.554538 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-57f4a058-7487-44e2-854c-64fd38dddaa8 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46336ae28e14b1092c4f1b3778d83e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a81e0c013b6450ebb75fe5a86220b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:07.563349 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-02d5f9c2-4ad0-4a22-bdff-bbda27ddc921 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:07.563981 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-02d5f9c2-4ad0-4a22-bdff-bbda27ddc921 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] [instance: d727e6d2-dc0c-4ee3-9d0f-999d1a4307fa] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:07.571512 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-57f4a058-7487-44e2-854c-64fd38dddaa8 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e46336ae28e14b1092c4f1b3778d83e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a81e0c013b6450ebb75fe5a86220b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:07.572986 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-02d5f9c2-4ad0-4a22-bdff-bbda27ddc921 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:07.573102 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-57f4a058-7487-44e2-854c-64fd38dddaa8 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e46336ae28e14b1092c4f1b3778d83e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a81e0c013b6450ebb75fe5a86220b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:07.573483 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-02d5f9c2-4ad0-4a22-bdff-bbda27ddc921 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:07.574071 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-02d5f9c2-4ad0-4a22-bdff-bbda27ddc921 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:07.574639 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-57f4a058-7487-44e2-854c-64fd38dddaa8 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] 10.222.0.60 "GET /compute/v2.1/servers/48a1400e-608d-43af-8a2a-257a5c4c316b" status: 200 len: 1357 microversion: 2.47 time: 0.147401 Sep 14 09:24:07.574762 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-02d5f9c2-4ad0-4a22-bdff-bbda27ddc921 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:07.575258 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-02d5f9c2-4ad0-4a22-bdff-bbda27ddc921 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:07.575823 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3017/6057] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:24:07 2022] GET /compute/v2.1/servers/48a1400e-608d-43af-8a2a-257a5c4c316b => generated 1357 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:24:07.591855 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-02d5f9c2-4ad0-4a22-bdff-bbda27ddc921 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:07.601944 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b97918f9-729e-4838-bf87-0e93a3f9fbcb tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:07.608715 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b97918f9-729e-4838-bf87-0e93a3f9fbcb tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e46336ae28e14b1092c4f1b3778d83e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a81e0c013b6450ebb75fe5a86220b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:07.609560 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b97918f9-729e-4838-bf87-0e93a3f9fbcb tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Searching by: {'deleted': False, 'project_id': '2a81e0c013b6450ebb75fe5a86220b36'} {{(pid=128759) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 14 09:24:07.615692 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b97918f9-729e-4838-bf87-0e93a3f9fbcb tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:07.616366 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b97918f9-729e-4838-bf87-0e93a3f9fbcb tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:07.616960 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b97918f9-729e-4838-bf87-0e93a3f9fbcb tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:07.617864 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b97918f9-729e-4838-bf87-0e93a3f9fbcb tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:07.618475 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b97918f9-729e-4838-bf87-0e93a3f9fbcb tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:07.619089 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b97918f9-729e-4838-bf87-0e93a3f9fbcb tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:07.785599 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-02d5f9c2-4ad0-4a22-bdff-bbda27ddc921 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0ed82129324c07a8c4158d207fcc4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cd8586b239f4f13a775a0465b9271a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:07.789425 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.multi_cell_list [None req-b97918f9-729e-4838-bf87-0e93a3f9fbcb tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128759) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 14 09:24:07.798800 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-02d5f9c2-4ad0-4a22-bdff-bbda27ddc921 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] 10.222.0.60 "GET /compute/v2.1/servers/d727e6d2-dc0c-4ee3-9d0f-999d1a4307fa" status: 200 len: 1608 microversion: 2.1 time: 0.241819 Sep 14 09:24:07.800169 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3041/6058] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:24:07 2022] GET /compute/v2.1/servers/d727e6d2-dc0c-4ee3-9d0f-999d1a4307fa => generated 1608 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:24:07.826382 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ee7627bc-56ea-4dab-9afd-94ad15446900 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:07.827050 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-ee7627bc-56ea-4dab-9afd-94ad15446900 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] [instance: d727e6d2-dc0c-4ee3-9d0f-999d1a4307fa] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:07.835021 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ee7627bc-56ea-4dab-9afd-94ad15446900 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:07.835522 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ee7627bc-56ea-4dab-9afd-94ad15446900 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:07.835961 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ee7627bc-56ea-4dab-9afd-94ad15446900 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:07.836866 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ee7627bc-56ea-4dab-9afd-94ad15446900 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:07.837331 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ee7627bc-56ea-4dab-9afd-94ad15446900 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:07.837763 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ee7627bc-56ea-4dab-9afd-94ad15446900 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:07.892045 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b97918f9-729e-4838-bf87-0e93a3f9fbcb tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46336ae28e14b1092c4f1b3778d83e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a81e0c013b6450ebb75fe5a86220b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:07.901345 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b97918f9-729e-4838-bf87-0e93a3f9fbcb tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:07.902345 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b97918f9-729e-4838-bf87-0e93a3f9fbcb tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:07.903451 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b97918f9-729e-4838-bf87-0e93a3f9fbcb tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:07.923721 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b97918f9-729e-4838-bf87-0e93a3f9fbcb tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e46336ae28e14b1092c4f1b3778d83e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a81e0c013b6450ebb75fe5a86220b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:07.925325 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b97918f9-729e-4838-bf87-0e93a3f9fbcb tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e46336ae28e14b1092c4f1b3778d83e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a81e0c013b6450ebb75fe5a86220b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:07.979350 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b97918f9-729e-4838-bf87-0e93a3f9fbcb tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] 10.222.0.60 "GET /compute/v2.1/servers/detail" status: 200 len: 2706 microversion: 2.47 time: 0.383029 Sep 14 09:24:07.980377 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3018/6059] 10.222.0.60 () {60 vars in 1187 bytes} [Wed Sep 14 09:24:07 2022] GET /compute/v2.1/servers/detail => generated 2706 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:24:08.016165 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-40b6d6c6-6e23-45ee-b84c-e38de5b6fba6 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:08.016984 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-40b6d6c6-6e23-45ee-b84c-e38de5b6fba6 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] [instance: 48a1400e-608d-43af-8a2a-257a5c4c316b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:08.023786 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-40b6d6c6-6e23-45ee-b84c-e38de5b6fba6 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:08.024440 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-40b6d6c6-6e23-45ee-b84c-e38de5b6fba6 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:08.025058 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-40b6d6c6-6e23-45ee-b84c-e38de5b6fba6 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:08.025771 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-40b6d6c6-6e23-45ee-b84c-e38de5b6fba6 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:08.026885 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-40b6d6c6-6e23-45ee-b84c-e38de5b6fba6 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:08.027398 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-40b6d6c6-6e23-45ee-b84c-e38de5b6fba6 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:08.035021 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-ee7627bc-56ea-4dab-9afd-94ad15446900 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0ed82129324c07a8c4158d207fcc4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cd8586b239f4f13a775a0465b9271a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:08.046237 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-ee7627bc-56ea-4dab-9afd-94ad15446900 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] 10.222.0.60 "GET /compute/v2.1/servers/d727e6d2-dc0c-4ee3-9d0f-999d1a4307fa" status: 200 len: 1608 microversion: 2.1 time: 0.227396 Sep 14 09:24:08.047432 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3042/6060] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:24:07 2022] GET /compute/v2.1/servers/d727e6d2-dc0c-4ee3-9d0f-999d1a4307fa => generated 1608 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:24:08.052250 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-470e62fb-bb3d-43bf-a8b6-f94690f1e9e5 tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:08.052848 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-470e62fb-bb3d-43bf-a8b6-f94690f1e9e5 tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] [instance: c4cbdcff-ec3f-4c46-891a-34307e72ce39] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:08.056613 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-40b6d6c6-6e23-45ee-b84c-e38de5b6fba6 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] [instance: 48a1400e-608d-43af-8a2a-257a5c4c316b] Going to try to terminate instance {{(pid=128759) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:24:08.058862 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-470e62fb-bb3d-43bf-a8b6-f94690f1e9e5 tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:08.059493 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-470e62fb-bb3d-43bf-a8b6-f94690f1e9e5 tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:08.060182 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-470e62fb-bb3d-43bf-a8b6-f94690f1e9e5 tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:08.060985 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-470e62fb-bb3d-43bf-a8b6-f94690f1e9e5 tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:08.061539 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-470e62fb-bb3d-43bf-a8b6-f94690f1e9e5 tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:08.062058 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-470e62fb-bb3d-43bf-a8b6-f94690f1e9e5 tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:08.092333 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-470e62fb-bb3d-43bf-a8b6-f94690f1e9e5 tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] [instance: c4cbdcff-ec3f-4c46-891a-34307e72ce39] Going to try to terminate instance {{(pid=128758) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:24:08.148375 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-40b6d6c6-6e23-45ee-b84c-e38de5b6fba6 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] 10.222.0.60 "DELETE /compute/v2.1/servers/48a1400e-608d-43af-8a2a-257a5c4c316b" status: 204 len: 0 microversion: 2.47 time: 0.135417 Sep 14 09:24:08.149450 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3019/6061] 10.222.0.60 () {60 vars in 1280 bytes} [Wed Sep 14 09:24:08 2022] DELETE /compute/v2.1/servers/48a1400e-608d-43af-8a2a-257a5c4c316b => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 14 09:24:08.157960 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-7a411087-ed32-488b-af0a-f2b1758300b7 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:08.158677 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-7a411087-ed32-488b-af0a-f2b1758300b7 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] [instance: d727e6d2-dc0c-4ee3-9d0f-999d1a4307fa] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:08.167774 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7a411087-ed32-488b-af0a-f2b1758300b7 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:08.168350 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7a411087-ed32-488b-af0a-f2b1758300b7 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:08.168790 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7a411087-ed32-488b-af0a-f2b1758300b7 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:08.169523 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7a411087-ed32-488b-af0a-f2b1758300b7 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:08.169977 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7a411087-ed32-488b-af0a-f2b1758300b7 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:08.170396 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7a411087-ed32-488b-af0a-f2b1758300b7 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:08.188055 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-470e62fb-bb3d-43bf-a8b6-f94690f1e9e5 tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] 10.222.0.60 "DELETE /compute/v2.1/servers/c4cbdcff-ec3f-4c46-891a-34307e72ce39" status: 204 len: 0 microversion: 2.1 time: 0.139163 Sep 14 09:24:08.189010 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3043/6062] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:24:08 2022] DELETE /compute/v2.1/servers/c4cbdcff-ec3f-4c46-891a-34307e72ce39 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:24:08.195723 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ba8c488c-262f-4d58-a3f5-75ef27e173a4 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:08.196994 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-ba8c488c-262f-4d58-a3f5-75ef27e173a4 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] [instance: 48a1400e-608d-43af-8a2a-257a5c4c316b] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:08.204478 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ba8c488c-262f-4d58-a3f5-75ef27e173a4 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:08.204975 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ba8c488c-262f-4d58-a3f5-75ef27e173a4 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:08.205417 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ba8c488c-262f-4d58-a3f5-75ef27e173a4 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:08.206131 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ba8c488c-262f-4d58-a3f5-75ef27e173a4 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:08.206594 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ba8c488c-262f-4d58-a3f5-75ef27e173a4 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:08.207660 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ba8c488c-262f-4d58-a3f5-75ef27e173a4 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:08.282637 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-ba8c488c-262f-4d58-a3f5-75ef27e173a4 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46336ae28e14b1092c4f1b3778d83e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a81e0c013b6450ebb75fe5a86220b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:08.292298 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-ba8c488c-262f-4d58-a3f5-75ef27e173a4 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e46336ae28e14b1092c4f1b3778d83e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a81e0c013b6450ebb75fe5a86220b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:08.294030 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-ba8c488c-262f-4d58-a3f5-75ef27e173a4 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e46336ae28e14b1092c4f1b3778d83e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a81e0c013b6450ebb75fe5a86220b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:08.295436 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-ba8c488c-262f-4d58-a3f5-75ef27e173a4 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] 10.222.0.60 "GET /compute/v2.1/servers/48a1400e-608d-43af-8a2a-257a5c4c316b" status: 200 len: 1363 microversion: 2.47 time: 0.105091 Sep 14 09:24:08.296022 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3044/6063] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:24:08 2022] GET /compute/v2.1/servers/48a1400e-608d-43af-8a2a-257a5c4c316b => generated 1363 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:24:08.300819 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-f8158b45-50c3-401d-9650-c8608f5a9bfd tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:08.301439 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-f8158b45-50c3-401d-9650-c8608f5a9bfd tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] [instance: c4cbdcff-ec3f-4c46-891a-34307e72ce39] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:08.308002 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f8158b45-50c3-401d-9650-c8608f5a9bfd tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:08.308667 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f8158b45-50c3-401d-9650-c8608f5a9bfd tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:08.309111 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f8158b45-50c3-401d-9650-c8608f5a9bfd tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:08.309815 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f8158b45-50c3-401d-9650-c8608f5a9bfd tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:08.310310 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f8158b45-50c3-401d-9650-c8608f5a9bfd tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:08.310741 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f8158b45-50c3-401d-9650-c8608f5a9bfd tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:08.367484 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-7a411087-ed32-488b-af0a-f2b1758300b7 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0ed82129324c07a8c4158d207fcc4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cd8586b239f4f13a775a0465b9271a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:08.377374 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-7a411087-ed32-488b-af0a-f2b1758300b7 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] 10.222.0.60 "GET /compute/v2.1/servers/d727e6d2-dc0c-4ee3-9d0f-999d1a4307fa" status: 200 len: 1608 microversion: 2.1 time: 0.226386 Sep 14 09:24:08.377997 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3020/6064] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:24:08 2022] GET /compute/v2.1/servers/d727e6d2-dc0c-4ee3-9d0f-999d1a4307fa => generated 1608 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:24:08.455423 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-f8158b45-50c3-401d-9650-c8608f5a9bfd tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19826a6d776745bf9e2c781c99506f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74627c6924304b09aeccbea302b401af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:08.463675 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-f8158b45-50c3-401d-9650-c8608f5a9bfd tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] 10.222.0.60 "GET /compute/v2.1/servers/c4cbdcff-ec3f-4c46-891a-34307e72ce39" status: 200 len: 1503 microversion: 2.1 time: 0.166632 Sep 14 09:24:08.464414 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3045/6065] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:24:08 2022] GET /compute/v2.1/servers/c4cbdcff-ec3f-4c46-891a-34307e72ce39 => generated 1503 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:24:08.537612 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e925cd12-75cf-453d-a6ec-1731a0a2f4d0 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:08.538271 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e925cd12-75cf-453d-a6ec-1731a0a2f4d0 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] [instance: 55b3478d-f1ae-48db-aea5-2619b302c4a9] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:08.546250 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e925cd12-75cf-453d-a6ec-1731a0a2f4d0 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:08.546753 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e925cd12-75cf-453d-a6ec-1731a0a2f4d0 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:08.547229 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e925cd12-75cf-453d-a6ec-1731a0a2f4d0 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:08.552732 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e925cd12-75cf-453d-a6ec-1731a0a2f4d0 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:08.553235 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e925cd12-75cf-453d-a6ec-1731a0a2f4d0 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:08.553685 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e925cd12-75cf-453d-a6ec-1731a0a2f4d0 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:08.621821 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-e925cd12-75cf-453d-a6ec-1731a0a2f4d0 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9568f2d3f644e409961ab34e8fa95cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8638ed7d7b3d4285b36865282b8caeab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:08.629503 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e925cd12-75cf-453d-a6ec-1731a0a2f4d0 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] 10.222.0.60 "GET /compute/v2.1/servers/55b3478d-f1ae-48db-aea5-2619b302c4a9" status: 200 len: 1233 microversion: 2.1 time: 0.095757 Sep 14 09:24:08.630086 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3021/6066] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:24:08 2022] GET /compute/v2.1/servers/55b3478d-f1ae-48db-aea5-2619b302c4a9 => generated 1233 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:24:09.322118 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-96c2d6cd-3697-4153-9bc1-1ef50f8b3675 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:09.323142 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-96c2d6cd-3697-4153-9bc1-1ef50f8b3675 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] [instance: 48a1400e-608d-43af-8a2a-257a5c4c316b] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:09.331176 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-96c2d6cd-3697-4153-9bc1-1ef50f8b3675 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:09.332030 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-96c2d6cd-3697-4153-9bc1-1ef50f8b3675 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:09.332482 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-96c2d6cd-3697-4153-9bc1-1ef50f8b3675 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:09.333190 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-96c2d6cd-3697-4153-9bc1-1ef50f8b3675 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:09.333643 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-96c2d6cd-3697-4153-9bc1-1ef50f8b3675 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:09.334094 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-96c2d6cd-3697-4153-9bc1-1ef50f8b3675 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:09.407272 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-96c2d6cd-3697-4153-9bc1-1ef50f8b3675 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46336ae28e14b1092c4f1b3778d83e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a81e0c013b6450ebb75fe5a86220b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:09.416141 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-96c2d6cd-3697-4153-9bc1-1ef50f8b3675 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e46336ae28e14b1092c4f1b3778d83e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a81e0c013b6450ebb75fe5a86220b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:09.418616 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-96c2d6cd-3697-4153-9bc1-1ef50f8b3675 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e46336ae28e14b1092c4f1b3778d83e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a81e0c013b6450ebb75fe5a86220b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:09.420481 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-96c2d6cd-3697-4153-9bc1-1ef50f8b3675 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] 10.222.0.60 "GET /compute/v2.1/servers/48a1400e-608d-43af-8a2a-257a5c4c316b" status: 200 len: 1363 microversion: 2.47 time: 0.102818 Sep 14 09:24:09.421394 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3046/6067] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:24:09 2022] GET /compute/v2.1/servers/48a1400e-608d-43af-8a2a-257a5c4c316b => generated 1363 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:24:09.487910 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9f5521b6-d5e6-472c-86e9-1be84aac06bf tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:09.488535 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-9f5521b6-d5e6-472c-86e9-1be84aac06bf tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] [instance: c4cbdcff-ec3f-4c46-891a-34307e72ce39] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:09.495603 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9f5521b6-d5e6-472c-86e9-1be84aac06bf tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:09.496106 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9f5521b6-d5e6-472c-86e9-1be84aac06bf tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:09.496553 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9f5521b6-d5e6-472c-86e9-1be84aac06bf tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:09.497285 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9f5521b6-d5e6-472c-86e9-1be84aac06bf tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:09.497946 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9f5521b6-d5e6-472c-86e9-1be84aac06bf tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:09.498411 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9f5521b6-d5e6-472c-86e9-1be84aac06bf tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:09.642563 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-9f5521b6-d5e6-472c-86e9-1be84aac06bf tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19826a6d776745bf9e2c781c99506f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74627c6924304b09aeccbea302b401af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:09.651613 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-9f5521b6-d5e6-472c-86e9-1be84aac06bf tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] 10.222.0.60 "GET /compute/v2.1/servers/c4cbdcff-ec3f-4c46-891a-34307e72ce39" status: 200 len: 1503 microversion: 2.1 time: 0.167371 Sep 14 09:24:09.652241 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3022/6068] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:24:09 2022] GET /compute/v2.1/servers/c4cbdcff-ec3f-4c46-891a-34307e72ce39 => generated 1503 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:24:09.655797 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-65318d1a-96e1-40ce-a418-c885ff500c40 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:09.656525 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-65318d1a-96e1-40ce-a418-c885ff500c40 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] [instance: 55b3478d-f1ae-48db-aea5-2619b302c4a9] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:09.663893 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-65318d1a-96e1-40ce-a418-c885ff500c40 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:09.664399 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-65318d1a-96e1-40ce-a418-c885ff500c40 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:09.664842 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-65318d1a-96e1-40ce-a418-c885ff500c40 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:09.665575 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-65318d1a-96e1-40ce-a418-c885ff500c40 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:09.674597 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-65318d1a-96e1-40ce-a418-c885ff500c40 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:09.676410 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-65318d1a-96e1-40ce-a418-c885ff500c40 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:09.749856 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-65318d1a-96e1-40ce-a418-c885ff500c40 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9568f2d3f644e409961ab34e8fa95cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8638ed7d7b3d4285b36865282b8caeab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:09.759085 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-65318d1a-96e1-40ce-a418-c885ff500c40 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] 10.222.0.60 "GET /compute/v2.1/servers/55b3478d-f1ae-48db-aea5-2619b302c4a9" status: 200 len: 1289 microversion: 2.1 time: 0.109552 Sep 14 09:24:09.759695 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3047/6069] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:24:09 2022] GET /compute/v2.1/servers/55b3478d-f1ae-48db-aea5-2619b302c4a9 => generated 1289 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:24:10.450831 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8a9f2c8f-1726-477f-af4b-ba5214790024 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:10.452280 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-8a9f2c8f-1726-477f-af4b-ba5214790024 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] [instance: 48a1400e-608d-43af-8a2a-257a5c4c316b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:10.460372 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8a9f2c8f-1726-477f-af4b-ba5214790024 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:10.460372 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8a9f2c8f-1726-477f-af4b-ba5214790024 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:10.460372 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8a9f2c8f-1726-477f-af4b-ba5214790024 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:10.460678 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8a9f2c8f-1726-477f-af4b-ba5214790024 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:10.461081 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8a9f2c8f-1726-477f-af4b-ba5214790024 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:10.461675 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8a9f2c8f-1726-477f-af4b-ba5214790024 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:10.476989 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-8a9f2c8f-1726-477f-af4b-ba5214790024 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] HTTP exception thrown: Instance 48a1400e-608d-43af-8a2a-257a5c4c316b could not be found. Sep 14 09:24:10.478872 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8a9f2c8f-1726-477f-af4b-ba5214790024 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Request method failure captured: Sep 14 09:24:10.478872 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/48a1400e-608d-43af-8a2a-257a5c4c316b HTTP/1.1 Sep 14 09:24:10.478872 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:24:10.478872 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:24:10.478872 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:24:10.478872 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:24:10.478872 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:24:10.478872 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:24:10.478872 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:24:10.478872 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:24:10.478872 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZ2Kp-um6l7NvLFwF0khtNOj07qULLljpSg8fl24Jp24RUwt6vo9HO_vr7S3GrzPvL9Ajo1TGyhI_8fan0Ne0nbpIExE12h8UmPI9s3PJmhthnP54pOeTCygdbK_Ht7CkGJ-2ZG4AN1ZPG1Gy6oN23q3almc2-N_LEb5sIs86uROPos Sep 14 09:24:10.478872 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:24:10.478872 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:24:10.478872 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:24:10.478872 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:24:10.478872 n-d-836830-18 devstack@n-api.service[128759]: X-Openstack-Nova-Api-Version: 2.47 Sep 14 09:24:10.478872 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:24:10.478872 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:24:10.478872 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 2a81e0c013b6450ebb75fe5a86220b36 Sep 14 09:24:10.478872 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ServerShowV247Test-200606842 Sep 14 09:24:10.478872 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:24:10.478872 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:24:10.478872 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/2a81e0c013b6450ebb75fe5a86220b36"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_2a81e0c013b6450ebb75fe5a86220b36"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2a81e0c013b6450ebb75fe5a86220b36"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2a81e0c013b6450ebb75fe5a86220b36"}]}] Sep 14 09:24:10.478872 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ServerShowV247Test-200606842 Sep 14 09:24:10.478872 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 2a81e0c013b6450ebb75fe5a86220b36 Sep 14 09:24:10.478872 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ServerShowV247Test-200606842 Sep 14 09:24:10.478872 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ServerShowV247Test-200606842-project Sep 14 09:24:10.478872 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:24:10.478872 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:24:10.478872 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: e46336ae28e14b1092c4f1b3778d83e5 Sep 14 09:24:10.478872 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ServerShowV247Test-200606842-project Sep 14 09:24:10.478872 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:24:10.478872 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance 48a1400e-608d-43af-8a2a-257a5c4c316b could not be found. Sep 14 09:24:10.478872 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '48a1400e-608d-43af-8a2a-257a5c4c316b'} Sep 14 09:24:10.478872 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:24:10.478872 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:24:10.478872 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:24:10.478872 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:24:10.478872 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:24:10.478872 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:24:10.478872 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:24:10.478872 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:24:10.478872 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:24:10.478872 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:24:10.478872 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48a1400e-608d-43af-8a2a-257a5c4c316b could not be found. Sep 14 09:24:10.478872 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:24:10.478872 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:24:10.478872 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:24:10.478872 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:24:10.478872 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:24:10.478872 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:24:10.478872 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:24:10.478872 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:24:10.478872 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:24:10.478872 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:24:10.478872 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:24:10.478872 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:24:10.478872 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:24:10.478872 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:24:10.478872 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:24:10.478872 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:24:10.478872 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48a1400e-608d-43af-8a2a-257a5c4c316b could not be found. Sep 14 09:24:10.478872 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:24:10.478872 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:24:10.478872 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:24:10.482755 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:24:10.482755 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:24:10.482755 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:24:10.482755 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:24:10.482755 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:24:10.482755 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48a1400e-608d-43af-8a2a-257a5c4c316b could not be found. Sep 14 09:24:10.482755 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:24:10.482755 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8a9f2c8f-1726-477f-af4b-ba5214790024 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Returning 404 to user: Instance 48a1400e-608d-43af-8a2a-257a5c4c316b could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:24:10.482755 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-8a9f2c8f-1726-477f-af4b-ba5214790024 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] 10.222.0.60 "GET /compute/v2.1/servers/48a1400e-608d-43af-8a2a-257a5c4c316b" status: 404 len: 111 microversion: 2.47 time: 0.036567 Sep 14 09:24:10.482755 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3023/6070] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:24:10 2022] GET /compute/v2.1/servers/48a1400e-608d-43af-8a2a-257a5c4c316b => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 14 09:24:10.489874 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c7c98fee-ea33-4c08-96af-6093f3070d84 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:10.490389 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-c7c98fee-ea33-4c08-96af-6093f3070d84 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] [instance: 1653eed9-a1f5-4598-b083-85a1c8ee2bb7] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:10.500636 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c7c98fee-ea33-4c08-96af-6093f3070d84 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:10.501303 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c7c98fee-ea33-4c08-96af-6093f3070d84 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:10.502316 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c7c98fee-ea33-4c08-96af-6093f3070d84 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:10.503091 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c7c98fee-ea33-4c08-96af-6093f3070d84 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:10.503560 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c7c98fee-ea33-4c08-96af-6093f3070d84 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:10.503993 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c7c98fee-ea33-4c08-96af-6093f3070d84 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:10.535061 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-c7c98fee-ea33-4c08-96af-6093f3070d84 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] [instance: 1653eed9-a1f5-4598-b083-85a1c8ee2bb7] Going to try to terminate instance {{(pid=128758) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:24:10.626959 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-c7c98fee-ea33-4c08-96af-6093f3070d84 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] 10.222.0.60 "DELETE /compute/v2.1/servers/1653eed9-a1f5-4598-b083-85a1c8ee2bb7" status: 204 len: 0 microversion: 2.47 time: 0.139972 Sep 14 09:24:10.628653 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3048/6071] 10.222.0.60 () {60 vars in 1280 bytes} [Wed Sep 14 09:24:10 2022] DELETE /compute/v2.1/servers/1653eed9-a1f5-4598-b083-85a1c8ee2bb7 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 14 09:24:10.639384 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-0a43d65e-b407-465c-b090-8a22f93e4949 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:10.640598 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-0a43d65e-b407-465c-b090-8a22f93e4949 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] [instance: 1653eed9-a1f5-4598-b083-85a1c8ee2bb7] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:10.658305 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0a43d65e-b407-465c-b090-8a22f93e4949 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:10.659503 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0a43d65e-b407-465c-b090-8a22f93e4949 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:10.659955 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0a43d65e-b407-465c-b090-8a22f93e4949 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:10.660683 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0a43d65e-b407-465c-b090-8a22f93e4949 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:10.662071 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0a43d65e-b407-465c-b090-8a22f93e4949 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:10.662677 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0a43d65e-b407-465c-b090-8a22f93e4949 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:10.675388 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a0e0efb9-8a98-448b-a15e-e32377733da6 tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:10.676095 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-a0e0efb9-8a98-448b-a15e-e32377733da6 tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] [instance: c4cbdcff-ec3f-4c46-891a-34307e72ce39] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:10.682329 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a0e0efb9-8a98-448b-a15e-e32377733da6 tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:10.683058 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a0e0efb9-8a98-448b-a15e-e32377733da6 tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:10.683639 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a0e0efb9-8a98-448b-a15e-e32377733da6 tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:10.684525 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a0e0efb9-8a98-448b-a15e-e32377733da6 tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:10.685131 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a0e0efb9-8a98-448b-a15e-e32377733da6 tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:10.685702 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a0e0efb9-8a98-448b-a15e-e32377733da6 tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:10.771447 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-0a43d65e-b407-465c-b090-8a22f93e4949 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46336ae28e14b1092c4f1b3778d83e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a81e0c013b6450ebb75fe5a86220b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:10.790482 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-0a43d65e-b407-465c-b090-8a22f93e4949 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e46336ae28e14b1092c4f1b3778d83e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a81e0c013b6450ebb75fe5a86220b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:10.796120 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-0a43d65e-b407-465c-b090-8a22f93e4949 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e46336ae28e14b1092c4f1b3778d83e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a81e0c013b6450ebb75fe5a86220b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:10.798114 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-0a43d65e-b407-465c-b090-8a22f93e4949 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] 10.222.0.60 "GET /compute/v2.1/servers/1653eed9-a1f5-4598-b083-85a1c8ee2bb7" status: 200 len: 1362 microversion: 2.47 time: 0.164675 Sep 14 09:24:10.803206 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3024/6072] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:24:10 2022] GET /compute/v2.1/servers/1653eed9-a1f5-4598-b083-85a1c8ee2bb7 => generated 1362 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:24:10.811596 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d293602b-83c2-413e-b5c1-aa7eff8995c5 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:10.817784 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-d293602b-83c2-413e-b5c1-aa7eff8995c5 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] [instance: 55b3478d-f1ae-48db-aea5-2619b302c4a9] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:10.829100 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d293602b-83c2-413e-b5c1-aa7eff8995c5 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:10.831073 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d293602b-83c2-413e-b5c1-aa7eff8995c5 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:10.831677 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d293602b-83c2-413e-b5c1-aa7eff8995c5 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:10.832544 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d293602b-83c2-413e-b5c1-aa7eff8995c5 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:10.833154 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d293602b-83c2-413e-b5c1-aa7eff8995c5 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:10.833876 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d293602b-83c2-413e-b5c1-aa7eff8995c5 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:10.908702 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-a0e0efb9-8a98-448b-a15e-e32377733da6 tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19826a6d776745bf9e2c781c99506f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74627c6924304b09aeccbea302b401af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:10.923881 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-a0e0efb9-8a98-448b-a15e-e32377733da6 tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] 10.222.0.60 "GET /compute/v2.1/servers/c4cbdcff-ec3f-4c46-891a-34307e72ce39" status: 200 len: 1503 microversion: 2.1 time: 0.251173 Sep 14 09:24:10.926044 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3049/6073] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:24:10 2022] GET /compute/v2.1/servers/c4cbdcff-ec3f-4c46-891a-34307e72ce39 => generated 1503 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:24:10.938356 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-d293602b-83c2-413e-b5c1-aa7eff8995c5 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9568f2d3f644e409961ab34e8fa95cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8638ed7d7b3d4285b36865282b8caeab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:10.949137 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d293602b-83c2-413e-b5c1-aa7eff8995c5 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] 10.222.0.60 "GET /compute/v2.1/servers/55b3478d-f1ae-48db-aea5-2619b302c4a9" status: 200 len: 1295 microversion: 2.1 time: 0.141366 Sep 14 09:24:10.949925 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3025/6074] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:24:10 2022] GET /compute/v2.1/servers/55b3478d-f1ae-48db-aea5-2619b302c4a9 => generated 1295 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:24:10.975315 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-1fff07f4-5d70-415b-b880-79eb1d0f9afe req-0c0bfdd8-276b-46e2-92bb-c3833b5e3a46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d727e6d2-dc0c-4ee3-9d0f-999d1a4307fa", "tag": "e80a892b-147a-4c93-949d-38ec11071f4c"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:24:10.984296 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-1fff07f4-5d70-415b-b880-79eb1d0f9afe req-0c0bfdd8-276b-46e2-92bb-c3833b5e3a46 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:10.984700 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-1fff07f4-5d70-415b-b880-79eb1d0f9afe req-0c0bfdd8-276b-46e2-92bb-c3833b5e3a46 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:10.985139 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-1fff07f4-5d70-415b-b880-79eb1d0f9afe req-0c0bfdd8-276b-46e2-92bb-c3833b5e3a46 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:10.996924 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-1fff07f4-5d70-415b-b880-79eb1d0f9afe req-0c0bfdd8-276b-46e2-92bb-c3833b5e3a46 service nova] Creating event network-changed:e80a892b-147a-4c93-949d-38ec11071f4c for instance d727e6d2-dc0c-4ee3-9d0f-999d1a4307fa on n-h2-836830-18 Sep 14 09:24:11.002190 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-1fff07f4-5d70-415b-b880-79eb1d0f9afe req-0c0bfdd8-276b-46e2-92bb-c3833b5e3a46 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034875 Sep 14 09:24:11.003257 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3050/6075] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:24:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:24:11.828223 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-5dd2bd7e-6708-4f9d-990f-391e43ee3eab tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:11.829448 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-5dd2bd7e-6708-4f9d-990f-391e43ee3eab tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] [instance: 1653eed9-a1f5-4598-b083-85a1c8ee2bb7] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:11.841590 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5dd2bd7e-6708-4f9d-990f-391e43ee3eab tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:11.842360 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5dd2bd7e-6708-4f9d-990f-391e43ee3eab tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:11.843733 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5dd2bd7e-6708-4f9d-990f-391e43ee3eab tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:11.844682 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5dd2bd7e-6708-4f9d-990f-391e43ee3eab tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:11.845304 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5dd2bd7e-6708-4f9d-990f-391e43ee3eab tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:11.845892 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5dd2bd7e-6708-4f9d-990f-391e43ee3eab tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:11.950609 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a22ead2f-a145-41e8-8f88-c453e6868767 tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:11.951932 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-a22ead2f-a145-41e8-8f88-c453e6868767 tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] [instance: c4cbdcff-ec3f-4c46-891a-34307e72ce39] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:11.958634 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a22ead2f-a145-41e8-8f88-c453e6868767 tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:11.959385 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a22ead2f-a145-41e8-8f88-c453e6868767 tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:11.960541 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a22ead2f-a145-41e8-8f88-c453e6868767 tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:11.961445 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a22ead2f-a145-41e8-8f88-c453e6868767 tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:11.962173 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a22ead2f-a145-41e8-8f88-c453e6868767 tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:11.962779 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a22ead2f-a145-41e8-8f88-c453e6868767 tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:11.970140 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-5dd2bd7e-6708-4f9d-990f-391e43ee3eab tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46336ae28e14b1092c4f1b3778d83e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a81e0c013b6450ebb75fe5a86220b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:11.981822 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-a22ead2f-a145-41e8-8f88-c453e6868767 tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] HTTP exception thrown: Instance c4cbdcff-ec3f-4c46-891a-34307e72ce39 could not be found. Sep 14 09:24:11.983762 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a22ead2f-a145-41e8-8f88-c453e6868767 tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Request method failure captured: Sep 14 09:24:11.983762 n-d-836830-18 devstack@n-api.service[128758]: request: GET /compute/v2.1/servers/c4cbdcff-ec3f-4c46-891a-34307e72ce39 HTTP/1.1 Sep 14 09:24:11.983762 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 09:24:11.983762 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 09:24:11.983762 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 09:24:11.983762 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 09:24:11.983762 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 09:24:11.983762 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 09:24:11.983762 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 09:24:11.983762 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 09:24:11.983762 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZ2eTyz7mVdGIUBOsjggm47Xf5G_6i221D6GZ-0EB66qW1zaZTyInbVQuitIbCo9yYrm37QQCwp_UfRVueitG2ZgNbdB5YtX3k_xl-KbtNCTq0XfDOv2nGFMTtcspsbCpqrPX2JlUGLM3Yc6wYJmy5Zi1_b9iRU5dfBcAYkYdHpQJw4 Sep 14 09:24:11.983762 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 09:24:11.983762 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 09:24:11.983762 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 09:24:11.983762 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 09:24:11.983762 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 09:24:11.983762 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 09:24:11.983762 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 74627c6924304b09aeccbea302b401af Sep 14 09:24:11.983762 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-VolumesActionsTest-681373688 Sep 14 09:24:11.983762 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 09:24:11.983762 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 09:24:11.983762 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/74627c6924304b09aeccbea302b401af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_74627c6924304b09aeccbea302b401af"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/74627c6924304b09aeccbea302b401af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/74627c6924304b09aeccbea302b401af"}]}] Sep 14 09:24:11.983762 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-VolumesActionsTest-681373688 Sep 14 09:24:11.983762 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 74627c6924304b09aeccbea302b401af Sep 14 09:24:11.983762 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-VolumesActionsTest-681373688 Sep 14 09:24:11.983762 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-VolumesActionsTest-681373688-project Sep 14 09:24:11.983762 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 09:24:11.983762 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 09:24:11.983762 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 19826a6d776745bf9e2c781c99506f98 Sep 14 09:24:11.983762 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-VolumesActionsTest-681373688-project Sep 14 09:24:11.983762 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 09:24:11.983762 n-d-836830-18 devstack@n-api.service[128758]: exception: Instance c4cbdcff-ec3f-4c46-891a-34307e72ce39 could not be found. Sep 14 09:24:11.983762 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': 'c4cbdcff-ec3f-4c46-891a-34307e72ce39'} Sep 14 09:24:11.983762 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:24:11.983762 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:24:11.983762 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:24:11.983762 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:24:11.983762 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:24:11.983762 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:24:11.983762 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:24:11.983762 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:24:11.983762 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:24:11.983762 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:24:11.983762 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4cbdcff-ec3f-4c46-891a-34307e72ce39 could not be found. Sep 14 09:24:11.983762 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:24:11.983762 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:24:11.983762 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:24:11.983762 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:24:11.983762 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:24:11.983762 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:24:11.983762 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:24:11.983762 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:24:11.983762 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:24:11.983762 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:24:11.983762 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:24:11.983762 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:24:11.983762 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:24:11.983762 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:24:11.983762 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:24:11.983762 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:24:11.983762 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4cbdcff-ec3f-4c46-891a-34307e72ce39 could not be found. Sep 14 09:24:11.983762 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:24:11.983762 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:24:11.983762 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:24:11.987976 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:24:11.987976 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:24:11.987976 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:24:11.987976 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:24:11.987976 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:24:11.987976 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4cbdcff-ec3f-4c46-891a-34307e72ce39 could not be found. Sep 14 09:24:11.987976 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:24:11.988579 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-5dd2bd7e-6708-4f9d-990f-391e43ee3eab tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e46336ae28e14b1092c4f1b3778d83e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a81e0c013b6450ebb75fe5a86220b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:11.988579 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-5dd2bd7e-6708-4f9d-990f-391e43ee3eab tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e46336ae28e14b1092c4f1b3778d83e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a81e0c013b6450ebb75fe5a86220b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:11.988579 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-5dd2bd7e-6708-4f9d-990f-391e43ee3eab tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] 10.222.0.60 "GET /compute/v2.1/servers/1653eed9-a1f5-4598-b083-85a1c8ee2bb7" status: 200 len: 1362 microversion: 2.47 time: 0.164261 Sep 14 09:24:11.989329 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3026/6076] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:24:11 2022] GET /compute/v2.1/servers/1653eed9-a1f5-4598-b083-85a1c8ee2bb7 => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:24:11.995859 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-1c1f1cfe-4abf-4bc5-8c8f-e078d661aa0e tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:11.997278 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a22ead2f-a145-41e8-8f88-c453e6868767 tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] Returning 404 to user: Instance c4cbdcff-ec3f-4c46-891a-34307e72ce39 could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:24:11.997616 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-1c1f1cfe-4abf-4bc5-8c8f-e078d661aa0e tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] [instance: 55b3478d-f1ae-48db-aea5-2619b302c4a9] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:11.998551 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-a22ead2f-a145-41e8-8f88-c453e6868767 tempest-VolumesActionsTest-681373688 tempest-VolumesActionsTest-681373688-project] 10.222.0.60 "GET /compute/v2.1/servers/c4cbdcff-ec3f-4c46-891a-34307e72ce39" status: 404 len: 111 microversion: 2.1 time: 0.054040 Sep 14 09:24:12.001186 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3051/6077] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:24:11 2022] GET /compute/v2.1/servers/c4cbdcff-ec3f-4c46-891a-34307e72ce39 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 14 09:24:12.007701 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1c1f1cfe-4abf-4bc5-8c8f-e078d661aa0e tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:12.008437 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1c1f1cfe-4abf-4bc5-8c8f-e078d661aa0e tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:12.009053 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1c1f1cfe-4abf-4bc5-8c8f-e078d661aa0e tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:12.010371 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1c1f1cfe-4abf-4bc5-8c8f-e078d661aa0e tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:12.011173 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1c1f1cfe-4abf-4bc5-8c8f-e078d661aa0e tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:12.012585 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1c1f1cfe-4abf-4bc5-8c8f-e078d661aa0e tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:12.280627 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-1c1f1cfe-4abf-4bc5-8c8f-e078d661aa0e tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9568f2d3f644e409961ab34e8fa95cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8638ed7d7b3d4285b36865282b8caeab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:12.292705 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-1c1f1cfe-4abf-4bc5-8c8f-e078d661aa0e tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] 10.222.0.60 "GET /compute/v2.1/servers/55b3478d-f1ae-48db-aea5-2619b302c4a9" status: 200 len: 1363 microversion: 2.1 time: 0.299669 Sep 14 09:24:12.293635 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3027/6078] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:24:11 2022] GET /compute/v2.1/servers/55b3478d-f1ae-48db-aea5-2619b302c4a9 => generated 1363 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:24:12.671019 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-043c807d-8ca3-4dd1-9167-4d60ea53bb39 req-069ed454-e9c5-4d94-b723-a99c3681b033 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55b3478d-f1ae-48db-aea5-2619b302c4a9", "tag": "b3f8fd2b-6b54-431e-b9c4-6c4b7a937e21"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:24:12.685010 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-043c807d-8ca3-4dd1-9167-4d60ea53bb39 req-069ed454-e9c5-4d94-b723-a99c3681b033 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:12.685499 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-043c807d-8ca3-4dd1-9167-4d60ea53bb39 req-069ed454-e9c5-4d94-b723-a99c3681b033 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:12.685935 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-043c807d-8ca3-4dd1-9167-4d60ea53bb39 req-069ed454-e9c5-4d94-b723-a99c3681b033 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:12.700009 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-043c807d-8ca3-4dd1-9167-4d60ea53bb39 req-069ed454-e9c5-4d94-b723-a99c3681b033 service nova] Creating event network-changed:b3f8fd2b-6b54-431e-b9c4-6c4b7a937e21 for instance 55b3478d-f1ae-48db-aea5-2619b302c4a9 on n-h1-836830-18 Sep 14 09:24:12.705231 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-043c807d-8ca3-4dd1-9167-4d60ea53bb39 req-069ed454-e9c5-4d94-b723-a99c3681b033 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.274815 Sep 14 09:24:12.706535 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3052/6079] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:24:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:24:13.021977 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-aee73a29-13d6-4f20-a418-d9972aff4ef9 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:13.023535 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-aee73a29-13d6-4f20-a418-d9972aff4ef9 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] [instance: 1653eed9-a1f5-4598-b083-85a1c8ee2bb7] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:13.024881 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-9ab8ae0c-2dbe-413d-856b-11d87277e8d2 req-7b3d83ac-b479-411e-a576-21e11ea503b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4cbdcff-ec3f-4c46-891a-34307e72ce39", "name": "network-vif-deleted", "tag": "4eade9a3-b4a8-4975-9192-8b0dc49bf7e6"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:24:13.034177 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-aee73a29-13d6-4f20-a418-d9972aff4ef9 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:13.035109 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-aee73a29-13d6-4f20-a418-d9972aff4ef9 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:13.035764 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-aee73a29-13d6-4f20-a418-d9972aff4ef9 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:13.036755 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-aee73a29-13d6-4f20-a418-d9972aff4ef9 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:13.038308 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-aee73a29-13d6-4f20-a418-d9972aff4ef9 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:13.038753 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-aee73a29-13d6-4f20-a418-d9972aff4ef9 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:13.038874 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-9ab8ae0c-2dbe-413d-856b-11d87277e8d2 req-7b3d83ac-b479-411e-a576-21e11ea503b9 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:13.039402 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-9ab8ae0c-2dbe-413d-856b-11d87277e8d2 req-7b3d83ac-b479-411e-a576-21e11ea503b9 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:13.039832 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-9ab8ae0c-2dbe-413d-856b-11d87277e8d2 req-7b3d83ac-b479-411e-a576-21e11ea503b9 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:13.067437 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-aee73a29-13d6-4f20-a418-d9972aff4ef9 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] HTTP exception thrown: Instance 1653eed9-a1f5-4598-b083-85a1c8ee2bb7 could not be found. Sep 14 09:24:13.067647 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-9ab8ae0c-2dbe-413d-856b-11d87277e8d2 req-7b3d83ac-b479-411e-a576-21e11ea503b9 service nova] Creating event network-vif-deleted:4eade9a3-b4a8-4975-9192-8b0dc49bf7e6 for instance c4cbdcff-ec3f-4c46-891a-34307e72ce39 on n-h1-836830-18 Sep 14 09:24:13.069510 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-aee73a29-13d6-4f20-a418-d9972aff4ef9 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Request method failure captured: Sep 14 09:24:13.069510 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/1653eed9-a1f5-4598-b083-85a1c8ee2bb7 HTTP/1.1 Sep 14 09:24:13.069510 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:24:13.069510 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:24:13.069510 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:24:13.069510 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:24:13.069510 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:24:13.069510 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:24:13.069510 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:24:13.069510 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:24:13.069510 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZ2Kp-um6l7NvLFwF0khtNOj07qULLljpSg8fl24Jp24RUwt6vo9HO_vr7S3GrzPvL9Ajo1TGyhI_8fan0Ne0nbpIExE12h8UmPI9s3PJmhthnP54pOeTCygdbK_Ht7CkGJ-2ZG4AN1ZPG1Gy6oN23q3almc2-N_LEb5sIs86uROPos Sep 14 09:24:13.069510 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:24:13.069510 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:24:13.069510 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:24:13.069510 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:24:13.069510 n-d-836830-18 devstack@n-api.service[128759]: X-Openstack-Nova-Api-Version: 2.47 Sep 14 09:24:13.069510 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:24:13.069510 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:24:13.069510 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 2a81e0c013b6450ebb75fe5a86220b36 Sep 14 09:24:13.069510 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ServerShowV247Test-200606842 Sep 14 09:24:13.069510 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:24:13.069510 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:24:13.069510 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/2a81e0c013b6450ebb75fe5a86220b36"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_2a81e0c013b6450ebb75fe5a86220b36"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2a81e0c013b6450ebb75fe5a86220b36"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2a81e0c013b6450ebb75fe5a86220b36"}]}] Sep 14 09:24:13.069510 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ServerShowV247Test-200606842 Sep 14 09:24:13.069510 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 2a81e0c013b6450ebb75fe5a86220b36 Sep 14 09:24:13.069510 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ServerShowV247Test-200606842 Sep 14 09:24:13.069510 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ServerShowV247Test-200606842-project Sep 14 09:24:13.069510 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:24:13.069510 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:24:13.069510 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: e46336ae28e14b1092c4f1b3778d83e5 Sep 14 09:24:13.069510 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ServerShowV247Test-200606842-project Sep 14 09:24:13.069510 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:24:13.069510 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance 1653eed9-a1f5-4598-b083-85a1c8ee2bb7 could not be found. Sep 14 09:24:13.069510 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '1653eed9-a1f5-4598-b083-85a1c8ee2bb7'} Sep 14 09:24:13.069510 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:24:13.069510 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:24:13.069510 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:24:13.069510 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:24:13.069510 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:24:13.069510 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:24:13.069510 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:24:13.069510 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:24:13.069510 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:24:13.069510 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:24:13.069510 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1653eed9-a1f5-4598-b083-85a1c8ee2bb7 could not be found. Sep 14 09:24:13.069510 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:24:13.069510 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:24:13.069510 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:24:13.069510 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:24:13.069510 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:24:13.069510 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:24:13.069510 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:24:13.069510 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:24:13.069510 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:24:13.069510 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:24:13.069510 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:24:13.069510 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:24:13.069510 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:24:13.069510 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:24:13.069510 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:24:13.069510 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:24:13.069510 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1653eed9-a1f5-4598-b083-85a1c8ee2bb7 could not be found. Sep 14 09:24:13.069510 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:24:13.069510 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:24:13.069510 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:24:13.073865 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:24:13.073865 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:24:13.073865 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:24:13.073865 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:24:13.073865 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:24:13.073865 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1653eed9-a1f5-4598-b083-85a1c8ee2bb7 could not be found. Sep 14 09:24:13.073865 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:24:13.073865 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-aee73a29-13d6-4f20-a418-d9972aff4ef9 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] Returning 404 to user: Instance 1653eed9-a1f5-4598-b083-85a1c8ee2bb7 could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:24:13.073865 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-aee73a29-13d6-4f20-a418-d9972aff4ef9 tempest-ServerShowV247Test-200606842 tempest-ServerShowV247Test-200606842-project] 10.222.0.60 "GET /compute/v2.1/servers/1653eed9-a1f5-4598-b083-85a1c8ee2bb7" status: 404 len: 111 microversion: 2.47 time: 0.056093 Sep 14 09:24:13.076474 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3028/6080] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Sep 14 09:24:13 2022] GET /compute/v2.1/servers/1653eed9-a1f5-4598-b083-85a1c8ee2bb7 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 14 09:24:13.077174 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-9ab8ae0c-2dbe-413d-856b-11d87277e8d2 req-7b3d83ac-b479-411e-a576-21e11ea503b9 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060056 Sep 14 09:24:13.077976 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3053/6081] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:24:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:24:13.317209 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-552472d5-bc6d-45a1-9b9c-2c0b2e97be90 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:13.321588 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-552472d5-bc6d-45a1-9b9c-2c0b2e97be90 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] [instance: 55b3478d-f1ae-48db-aea5-2619b302c4a9] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:13.328013 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-552472d5-bc6d-45a1-9b9c-2c0b2e97be90 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:13.328589 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-552472d5-bc6d-45a1-9b9c-2c0b2e97be90 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:13.329099 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-552472d5-bc6d-45a1-9b9c-2c0b2e97be90 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:13.329825 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-552472d5-bc6d-45a1-9b9c-2c0b2e97be90 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:13.330301 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-552472d5-bc6d-45a1-9b9c-2c0b2e97be90 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:13.330726 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-552472d5-bc6d-45a1-9b9c-2c0b2e97be90 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:13.484494 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-552472d5-bc6d-45a1-9b9c-2c0b2e97be90 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9568f2d3f644e409961ab34e8fa95cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8638ed7d7b3d4285b36865282b8caeab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:13.493797 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-552472d5-bc6d-45a1-9b9c-2c0b2e97be90 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] 10.222.0.60 "GET /compute/v2.1/servers/55b3478d-f1ae-48db-aea5-2619b302c4a9" status: 200 len: 1363 microversion: 2.1 time: 0.180544 Sep 14 09:24:13.494713 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3029/6082] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:24:13 2022] GET /compute/v2.1/servers/55b3478d-f1ae-48db-aea5-2619b302c4a9 => generated 1363 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:24:14.520101 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ee61e973-ddf0-46d2-b3fe-67a39f5d4bf1 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:14.520910 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-ee61e973-ddf0-46d2-b3fe-67a39f5d4bf1 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] [instance: 55b3478d-f1ae-48db-aea5-2619b302c4a9] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:14.527422 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ee61e973-ddf0-46d2-b3fe-67a39f5d4bf1 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:14.527915 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ee61e973-ddf0-46d2-b3fe-67a39f5d4bf1 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:14.528625 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ee61e973-ddf0-46d2-b3fe-67a39f5d4bf1 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:14.529493 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ee61e973-ddf0-46d2-b3fe-67a39f5d4bf1 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:14.529994 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ee61e973-ddf0-46d2-b3fe-67a39f5d4bf1 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:14.530408 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ee61e973-ddf0-46d2-b3fe-67a39f5d4bf1 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:14.534721 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:24:14.688326 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-ee61e973-ddf0-46d2-b3fe-67a39f5d4bf1 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9568f2d3f644e409961ab34e8fa95cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8638ed7d7b3d4285b36865282b8caeab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:14.697058 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-ee61e973-ddf0-46d2-b3fe-67a39f5d4bf1 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] 10.222.0.60 "GET /compute/v2.1/servers/55b3478d-f1ae-48db-aea5-2619b302c4a9" status: 200 len: 1363 microversion: 2.1 time: 0.182963 Sep 14 09:24:14.697948 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3054/6083] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:24:14 2022] GET /compute/v2.1/servers/55b3478d-f1ae-48db-aea5-2619b302c4a9 => generated 1363 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:24:15.721956 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e9b3b082-1768-4343-bc82-00c04de964e9 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:15.723074 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e9b3b082-1768-4343-bc82-00c04de964e9 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] [instance: 55b3478d-f1ae-48db-aea5-2619b302c4a9] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:15.730200 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e9b3b082-1768-4343-bc82-00c04de964e9 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:15.731287 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e9b3b082-1768-4343-bc82-00c04de964e9 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:15.731824 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e9b3b082-1768-4343-bc82-00c04de964e9 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:15.732429 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e9b3b082-1768-4343-bc82-00c04de964e9 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:15.732886 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e9b3b082-1768-4343-bc82-00c04de964e9 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:15.733518 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e9b3b082-1768-4343-bc82-00c04de964e9 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:15.888688 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-e9b3b082-1768-4343-bc82-00c04de964e9 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9568f2d3f644e409961ab34e8fa95cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8638ed7d7b3d4285b36865282b8caeab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:15.897416 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e9b3b082-1768-4343-bc82-00c04de964e9 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] 10.222.0.60 "GET /compute/v2.1/servers/55b3478d-f1ae-48db-aea5-2619b302c4a9" status: 200 len: 1363 microversion: 2.1 time: 0.179465 Sep 14 09:24:15.898007 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3030/6084] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:24:15 2022] GET /compute/v2.1/servers/55b3478d-f1ae-48db-aea5-2619b302c4a9 => generated 1363 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:24:16.921775 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-30dd61df-25d1-421c-915f-93c2b0c1b5be tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:16.922579 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-30dd61df-25d1-421c-915f-93c2b0c1b5be tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] [instance: 55b3478d-f1ae-48db-aea5-2619b302c4a9] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:16.935702 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-30dd61df-25d1-421c-915f-93c2b0c1b5be tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:16.937148 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-30dd61df-25d1-421c-915f-93c2b0c1b5be tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:16.938074 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-30dd61df-25d1-421c-915f-93c2b0c1b5be tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:16.941511 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-30dd61df-25d1-421c-915f-93c2b0c1b5be tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:16.942596 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-30dd61df-25d1-421c-915f-93c2b0c1b5be tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:16.948076 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-30dd61df-25d1-421c-915f-93c2b0c1b5be tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:17.130269 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-30dd61df-25d1-421c-915f-93c2b0c1b5be tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9568f2d3f644e409961ab34e8fa95cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8638ed7d7b3d4285b36865282b8caeab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:17.139094 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-30dd61df-25d1-421c-915f-93c2b0c1b5be tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] 10.222.0.60 "GET /compute/v2.1/servers/55b3478d-f1ae-48db-aea5-2619b302c4a9" status: 200 len: 1363 microversion: 2.1 time: 0.221843 Sep 14 09:24:17.140202 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3055/6085] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:24:16 2022] GET /compute/v2.1/servers/55b3478d-f1ae-48db-aea5-2619b302c4a9 => generated 1363 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:24:18.163488 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a07abd5f-e552-4bf1-8a5e-03af0dbb7899 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:18.164195 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-a07abd5f-e552-4bf1-8a5e-03af0dbb7899 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] [instance: 55b3478d-f1ae-48db-aea5-2619b302c4a9] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:18.167760 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=2 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:24:18.171509 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=6 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:24:18.182437 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a07abd5f-e552-4bf1-8a5e-03af0dbb7899 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:18.183109 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a07abd5f-e552-4bf1-8a5e-03af0dbb7899 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:18.183804 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a07abd5f-e552-4bf1-8a5e-03af0dbb7899 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:18.184730 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a07abd5f-e552-4bf1-8a5e-03af0dbb7899 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:18.185504 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a07abd5f-e552-4bf1-8a5e-03af0dbb7899 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:18.186368 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a07abd5f-e552-4bf1-8a5e-03af0dbb7899 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:18.191558 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:24:18.341236 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-a07abd5f-e552-4bf1-8a5e-03af0dbb7899 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9568f2d3f644e409961ab34e8fa95cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8638ed7d7b3d4285b36865282b8caeab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:18.349699 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a07abd5f-e552-4bf1-8a5e-03af0dbb7899 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] 10.222.0.60 "GET /compute/v2.1/servers/55b3478d-f1ae-48db-aea5-2619b302c4a9" status: 200 len: 1363 microversion: 2.1 time: 0.190159 Sep 14 09:24:18.359450 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3031/6086] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:24:18 2022] GET /compute/v2.1/servers/55b3478d-f1ae-48db-aea5-2619b302c4a9 => generated 1363 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:24:18.374190 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-d7016a2b-5a02-41be-bfd3-f4933db8cc26 req-abeba67d-067c-4490-a622-51d795dc2fa6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55b3478d-f1ae-48db-aea5-2619b302c4a9", "name": "network-vif-plugged", "status": "completed", "tag": "b3f8fd2b-6b54-431e-b9c4-6c4b7a937e21"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:24:18.383759 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=2 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:24:18.385358 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=8 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:24:18.389418 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-d7016a2b-5a02-41be-bfd3-f4933db8cc26 req-abeba67d-067c-4490-a622-51d795dc2fa6 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:18.390082 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-d7016a2b-5a02-41be-bfd3-f4933db8cc26 req-abeba67d-067c-4490-a622-51d795dc2fa6 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:18.390603 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-d7016a2b-5a02-41be-bfd3-f4933db8cc26 req-abeba67d-067c-4490-a622-51d795dc2fa6 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:18.404467 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-d7016a2b-5a02-41be-bfd3-f4933db8cc26 req-abeba67d-067c-4490-a622-51d795dc2fa6 service nova] Creating event network-vif-plugged:b3f8fd2b-6b54-431e-b9c4-6c4b7a937e21 for instance 55b3478d-f1ae-48db-aea5-2619b302c4a9 on n-h1-836830-18 Sep 14 09:24:18.411178 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-d7016a2b-5a02-41be-bfd3-f4933db8cc26 req-abeba67d-067c-4490-a622-51d795dc2fa6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041232 Sep 14 09:24:18.412351 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3056/6087] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:24:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:24:19.373644 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-15390cdc-3b81-4f8e-a206-771d58f2d994 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:19.374261 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-15390cdc-3b81-4f8e-a206-771d58f2d994 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] [instance: 55b3478d-f1ae-48db-aea5-2619b302c4a9] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:19.377089 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:24:19.389308 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-15390cdc-3b81-4f8e-a206-771d58f2d994 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:19.389928 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-15390cdc-3b81-4f8e-a206-771d58f2d994 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:19.394463 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-15390cdc-3b81-4f8e-a206-771d58f2d994 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:19.394463 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-15390cdc-3b81-4f8e-a206-771d58f2d994 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:19.394463 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-15390cdc-3b81-4f8e-a206-771d58f2d994 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:19.394463 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-15390cdc-3b81-4f8e-a206-771d58f2d994 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:19.547442 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-15390cdc-3b81-4f8e-a206-771d58f2d994 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9568f2d3f644e409961ab34e8fa95cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8638ed7d7b3d4285b36865282b8caeab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:19.558288 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-15390cdc-3b81-4f8e-a206-771d58f2d994 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] 10.222.0.60 "GET /compute/v2.1/servers/55b3478d-f1ae-48db-aea5-2619b302c4a9" status: 200 len: 1363 microversion: 2.1 time: 0.188119 Sep 14 09:24:19.566631 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3032/6088] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:24:19 2022] GET /compute/v2.1/servers/55b3478d-f1ae-48db-aea5-2619b302c4a9 => generated 1363 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:24:20.591566 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-03d087ce-7ad1-44fd-a813-e5e7d10c3a2a tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:20.592275 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-03d087ce-7ad1-44fd-a813-e5e7d10c3a2a tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] [instance: 55b3478d-f1ae-48db-aea5-2619b302c4a9] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:20.600376 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-03d087ce-7ad1-44fd-a813-e5e7d10c3a2a tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:20.601055 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-03d087ce-7ad1-44fd-a813-e5e7d10c3a2a tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:20.601672 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-03d087ce-7ad1-44fd-a813-e5e7d10c3a2a tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:20.602544 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-03d087ce-7ad1-44fd-a813-e5e7d10c3a2a tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:20.603025 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-03d087ce-7ad1-44fd-a813-e5e7d10c3a2a tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:20.604200 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-03d087ce-7ad1-44fd-a813-e5e7d10c3a2a tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:20.860879 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-03d087ce-7ad1-44fd-a813-e5e7d10c3a2a tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9568f2d3f644e409961ab34e8fa95cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8638ed7d7b3d4285b36865282b8caeab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:20.872027 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-03d087ce-7ad1-44fd-a813-e5e7d10c3a2a tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] 10.222.0.60 "GET /compute/v2.1/servers/55b3478d-f1ae-48db-aea5-2619b302c4a9" status: 200 len: 1548 microversion: 2.1 time: 0.285728 Sep 14 09:24:20.872837 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3057/6089] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:24:20 2022] GET /compute/v2.1/servers/55b3478d-f1ae-48db-aea5-2619b302c4a9 => generated 1548 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:24:20.898972 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-6843af85-f558-4779-9a93-3c1c2e56bb22 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:20.899617 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-6843af85-f558-4779-9a93-3c1c2e56bb22 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] [instance: 55b3478d-f1ae-48db-aea5-2619b302c4a9] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:20.907823 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6843af85-f558-4779-9a93-3c1c2e56bb22 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:20.908437 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6843af85-f558-4779-9a93-3c1c2e56bb22 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:20.909100 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6843af85-f558-4779-9a93-3c1c2e56bb22 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:20.909871 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6843af85-f558-4779-9a93-3c1c2e56bb22 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:20.910519 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6843af85-f558-4779-9a93-3c1c2e56bb22 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:20.911050 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6843af85-f558-4779-9a93-3c1c2e56bb22 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:21.003832 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-6843af85-f558-4779-9a93-3c1c2e56bb22 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] 10.222.0.60 "GET /compute/v2.1/servers/55b3478d-f1ae-48db-aea5-2619b302c4a9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.108526 Sep 14 09:24:21.005572 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3033/6090] 10.222.0.60 () {58 vars in 1275 bytes} [Wed Sep 14 09:24:20 2022] GET /compute/v2.1/servers/55b3478d-f1ae-48db-aea5-2619b302c4a9/os-interface => generated 284 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:24:22.429669 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-0e5c39b1-d2a1-490b-b012-e1ee5d69dbb7 req-931f9af2-de4e-4968-868a-4597827beb87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55b3478d-f1ae-48db-aea5-2619b302c4a9", "tag": "b3f8fd2b-6b54-431e-b9c4-6c4b7a937e21"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:24:22.442561 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-0e5c39b1-d2a1-490b-b012-e1ee5d69dbb7 req-931f9af2-de4e-4968-868a-4597827beb87 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:22.443327 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-0e5c39b1-d2a1-490b-b012-e1ee5d69dbb7 req-931f9af2-de4e-4968-868a-4597827beb87 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:22.443907 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-0e5c39b1-d2a1-490b-b012-e1ee5d69dbb7 req-931f9af2-de4e-4968-868a-4597827beb87 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:22.459445 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-0e5c39b1-d2a1-490b-b012-e1ee5d69dbb7 req-931f9af2-de4e-4968-868a-4597827beb87 service nova] Creating event network-changed:b3f8fd2b-6b54-431e-b9c4-6c4b7a937e21 for instance 55b3478d-f1ae-48db-aea5-2619b302c4a9 on n-h1-836830-18 Sep 14 09:24:22.466414 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-0e5c39b1-d2a1-490b-b012-e1ee5d69dbb7 req-931f9af2-de4e-4968-868a-4597827beb87 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041438 Sep 14 09:24:22.470702 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3058/6091] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:24:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:24:46.688813 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=3 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:24:46.690054 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=14 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:24:46.695991 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-4116596e-b119-4583-ba1d-d5ed158b4b65 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:46.697327 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-4116596e-b119-4583-ba1d-d5ed158b4b65 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] [instance: d727e6d2-dc0c-4ee3-9d0f-999d1a4307fa] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:46.704657 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4116596e-b119-4583-ba1d-d5ed158b4b65 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:46.705155 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4116596e-b119-4583-ba1d-d5ed158b4b65 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:46.705595 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4116596e-b119-4583-ba1d-d5ed158b4b65 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:46.706747 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4116596e-b119-4583-ba1d-d5ed158b4b65 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:46.707448 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4116596e-b119-4583-ba1d-d5ed158b4b65 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:46.708077 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4116596e-b119-4583-ba1d-d5ed158b4b65 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:46.739297 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-4116596e-b119-4583-ba1d-d5ed158b4b65 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] 10.222.0.60 "GET /compute/v2.1/servers/d727e6d2-dc0c-4ee3-9d0f-999d1a4307fa/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.053355 Sep 14 09:24:46.739907 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3034/6092] 10.222.0.60 () {58 vars in 1293 bytes} [Wed Sep 14 09:24:46 2022] GET /compute/v2.1/servers/d727e6d2-dc0c-4ee3-9d0f-999d1a4307fa/os-server-password => generated 116 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:25:27.086017 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=81,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:25:27.087735 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=20 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:25:27.092452 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-4a6371e4-fc33-45b9-8cdb-3538ab23c94c tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:25:27.093056 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-4a6371e4-fc33-45b9-8cdb-3538ab23c94c tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] [instance: 55b3478d-f1ae-48db-aea5-2619b302c4a9] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:25:27.100673 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4a6371e4-fc33-45b9-8cdb-3538ab23c94c tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:27.101372 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4a6371e4-fc33-45b9-8cdb-3538ab23c94c tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:27.102026 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4a6371e4-fc33-45b9-8cdb-3538ab23c94c tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:27.102891 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4a6371e4-fc33-45b9-8cdb-3538ab23c94c tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:27.103695 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4a6371e4-fc33-45b9-8cdb-3538ab23c94c tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:27.104279 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4a6371e4-fc33-45b9-8cdb-3538ab23c94c tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:27.134355 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-4a6371e4-fc33-45b9-8cdb-3538ab23c94c tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] 10.222.0.60 "GET /compute/v2.1/servers/55b3478d-f1ae-48db-aea5-2619b302c4a9/ips" status: 200 len: 145 microversion: 2.1 time: 0.049875 Sep 14 09:25:27.135038 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3059/6093] 10.222.0.60 () {58 vars in 1248 bytes} [Wed Sep 14 09:25:27 2022] GET /compute/v2.1/servers/55b3478d-f1ae-48db-aea5-2619b302c4a9/ips => generated 145 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:25:29.793988 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e86bb3ef-d9df-4e6d-b098-ce383d748e48 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "695f435a-a444-4888-8c9d-757ca0710721"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:25:29.798480 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e86bb3ef-d9df-4e6d-b098-ce383d748e48 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] [instance: 55b3478d-f1ae-48db-aea5-2619b302c4a9] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:25:29.812068 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=2 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:25:29.813087 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=4 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:25:29.815284 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e86bb3ef-d9df-4e6d-b098-ce383d748e48 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:29.816198 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e86bb3ef-d9df-4e6d-b098-ce383d748e48 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:29.816855 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e86bb3ef-d9df-4e6d-b098-ce383d748e48 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:29.817679 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e86bb3ef-d9df-4e6d-b098-ce383d748e48 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:29.818287 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e86bb3ef-d9df-4e6d-b098-ce383d748e48 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:29.818875 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e86bb3ef-d9df-4e6d-b098-ce383d748e48 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:30.263670 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e86bb3ef-d9df-4e6d-b098-ce383d748e48 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] 10.222.0.60 "POST /compute/v2.1/servers/55b3478d-f1ae-48db-aea5-2619b302c4a9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.471616 Sep 14 09:25:30.264546 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3035/6094] 10.222.0.60 () {60 vars in 1323 bytes} [Wed Sep 14 09:25:29 2022] POST /compute/v2.1/servers/55b3478d-f1ae-48db-aea5-2619b302c4a9/os-volume_attachments => generated 194 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:25:43.626206 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-f1ae77f7-4354-457f-a6dd-7deef514751c tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:25:43.628897 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-f1ae77f7-4354-457f-a6dd-7deef514751c tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] [instance: 55b3478d-f1ae-48db-aea5-2619b302c4a9] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:25:43.636619 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=4 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:25:43.637695 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=2 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:25:43.641049 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f1ae77f7-4354-457f-a6dd-7deef514751c tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:43.644725 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f1ae77f7-4354-457f-a6dd-7deef514751c tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:43.645598 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f1ae77f7-4354-457f-a6dd-7deef514751c tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:43.646540 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f1ae77f7-4354-457f-a6dd-7deef514751c tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:43.647551 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f1ae77f7-4354-457f-a6dd-7deef514751c tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:43.648752 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f1ae77f7-4354-457f-a6dd-7deef514751c tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:43.690437 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-f1ae77f7-4354-457f-a6dd-7deef514751c tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] 10.222.0.60 "GET /compute/v2.1/servers/55b3478d-f1ae-48db-aea5-2619b302c4a9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068743 Sep 14 09:25:43.691898 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3060/6095] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 14 09:25:43 2022] GET /compute/v2.1/servers/55b3478d-f1ae-48db-aea5-2619b302c4a9/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:25:43.704413 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f1b1077a-85c3-43c7-a9f4-e393f12f8b9a tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:25:43.705578 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f1b1077a-85c3-43c7-a9f4-e393f12f8b9a tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] [instance: 55b3478d-f1ae-48db-aea5-2619b302c4a9] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:25:43.712867 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=2 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:25:43.713880 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:25:43.715703 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f1b1077a-85c3-43c7-a9f4-e393f12f8b9a tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:43.716480 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f1b1077a-85c3-43c7-a9f4-e393f12f8b9a tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:43.717199 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f1b1077a-85c3-43c7-a9f4-e393f12f8b9a tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:43.718560 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f1b1077a-85c3-43c7-a9f4-e393f12f8b9a tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:43.719418 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f1b1077a-85c3-43c7-a9f4-e393f12f8b9a tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:43.720319 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f1b1077a-85c3-43c7-a9f4-e393f12f8b9a tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:43.755763 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f1b1077a-85c3-43c7-a9f4-e393f12f8b9a tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] 10.222.0.60 "GET /compute/v2.1/servers/55b3478d-f1ae-48db-aea5-2619b302c4a9/os-volume_attachments/695f435a-a444-4888-8c9d-757ca0710721" status: 200 len: 194 microversion: 2.1 time: 0.056306 Sep 14 09:25:43.776513 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3036/6096] 10.222.0.60 () {58 vars in 1413 bytes} [Wed Sep 14 09:25:43 2022] GET /compute/v2.1/servers/55b3478d-f1ae-48db-aea5-2619b302c4a9/os-volume_attachments/695f435a-a444-4888-8c9d-757ca0710721 => generated 194 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:25:46.353639 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-72043889-b4fe-414c-9bca-b43a2f3d4d33 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5123155e-01db-4a8d-b559-565251212e70"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:25:46.357468 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-72043889-b4fe-414c-9bca-b43a2f3d4d33 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] [instance: 55b3478d-f1ae-48db-aea5-2619b302c4a9] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:25:46.376353 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-72043889-b4fe-414c-9bca-b43a2f3d4d33 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:46.377195 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-72043889-b4fe-414c-9bca-b43a2f3d4d33 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:46.377794 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-72043889-b4fe-414c-9bca-b43a2f3d4d33 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:46.378674 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-72043889-b4fe-414c-9bca-b43a2f3d4d33 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:46.379311 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-72043889-b4fe-414c-9bca-b43a2f3d4d33 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:46.379892 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-72043889-b4fe-414c-9bca-b43a2f3d4d33 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:46.780611 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-72043889-b4fe-414c-9bca-b43a2f3d4d33 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] 10.222.0.60 "POST /compute/v2.1/servers/55b3478d-f1ae-48db-aea5-2619b302c4a9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.431498 Sep 14 09:25:46.786580 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3061/6097] 10.222.0.60 () {60 vars in 1323 bytes} [Wed Sep 14 09:25:46 2022] POST /compute/v2.1/servers/55b3478d-f1ae-48db-aea5-2619b302c4a9/os-volume_attachments => generated 194 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:25:59.153865 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3a52a9e7-d321-4dc8-8bb6-155d364268ec tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:25:59.164692 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-3a52a9e7-d321-4dc8-8bb6-155d364268ec tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] [instance: 55b3478d-f1ae-48db-aea5-2619b302c4a9] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:25:59.172558 n-d-836830-18 devstack@n-api.service[128759]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 09:25:59.172939 n-d-836830-18 devstack@n-api.service[128759]: Wed Sep 14 09:25:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/55b3478d-f1ae-48db-aea5-2619b302c4a9/os-volume_attachments (ip 10.222.0.60) !!! Sep 14 09:25:59.175311 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=2 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:25:59.176232 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=6 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:25:59.184025 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3a52a9e7-d321-4dc8-8bb6-155d364268ec tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:59.184745 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3a52a9e7-d321-4dc8-8bb6-155d364268ec tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:59.185350 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3a52a9e7-d321-4dc8-8bb6-155d364268ec tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:59.186257 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3a52a9e7-d321-4dc8-8bb6-155d364268ec tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:59.186880 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3a52a9e7-d321-4dc8-8bb6-155d364268ec tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:59.187494 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3a52a9e7-d321-4dc8-8bb6-155d364268ec tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:59.224192 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-3a52a9e7-d321-4dc8-8bb6-155d364268ec tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] 10.222.0.60 "GET /compute/v2.1/servers/55b3478d-f1ae-48db-aea5-2619b302c4a9/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.074203 Sep 14 09:25:59.231344 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3037/6098] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 14 09:25:59 2022] GET /compute/v2.1/servers/55b3478d-f1ae-48db-aea5-2619b302c4a9/os-volume_attachments => generated 371 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:25:59.370475 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=4 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:25:59.374405 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:25:59.382506 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-39fc8146-36ec-4e3d-8e47-4a5f5bfaf428 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:25:59.385541 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-39fc8146-36ec-4e3d-8e47-4a5f5bfaf428 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] [instance: 55b3478d-f1ae-48db-aea5-2619b302c4a9] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:25:59.411591 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-39fc8146-36ec-4e3d-8e47-4a5f5bfaf428 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:59.412287 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-39fc8146-36ec-4e3d-8e47-4a5f5bfaf428 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:59.412832 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-39fc8146-36ec-4e3d-8e47-4a5f5bfaf428 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:59.413725 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-39fc8146-36ec-4e3d-8e47-4a5f5bfaf428 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:59.414286 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-39fc8146-36ec-4e3d-8e47-4a5f5bfaf428 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:59.414847 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-39fc8146-36ec-4e3d-8e47-4a5f5bfaf428 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:59.460751 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-39fc8146-36ec-4e3d-8e47-4a5f5bfaf428 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] 10.222.0.60 "GET /compute/v2.1/servers/55b3478d-f1ae-48db-aea5-2619b302c4a9/os-volume_attachments/695f435a-a444-4888-8c9d-757ca0710721" status: 200 len: 194 microversion: 2.1 time: 0.092710 Sep 14 09:25:59.463220 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3062/6099] 10.222.0.60 () {58 vars in 1413 bytes} [Wed Sep 14 09:25:59 2022] GET /compute/v2.1/servers/55b3478d-f1ae-48db-aea5-2619b302c4a9/os-volume_attachments/695f435a-a444-4888-8c9d-757ca0710721 => generated 194 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:25:59.479717 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-16d4060b-cebc-4e7c-930b-3640dfb817a1 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:25:59.480455 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-16d4060b-cebc-4e7c-930b-3640dfb817a1 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] [instance: 55b3478d-f1ae-48db-aea5-2619b302c4a9] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:25:59.488852 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-16d4060b-cebc-4e7c-930b-3640dfb817a1 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:59.489582 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-16d4060b-cebc-4e7c-930b-3640dfb817a1 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:59.490227 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-16d4060b-cebc-4e7c-930b-3640dfb817a1 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:59.491188 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-16d4060b-cebc-4e7c-930b-3640dfb817a1 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:59.492267 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-16d4060b-cebc-4e7c-930b-3640dfb817a1 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:59.496117 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-16d4060b-cebc-4e7c-930b-3640dfb817a1 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:59.652243 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.objects.instance [None req-16d4060b-cebc-4e7c-930b-3640dfb817a1 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lazy-loading 'services' on Instance uuid 55b3478d-f1ae-48db-aea5-2619b302c4a9 {{(pid=128759) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:25:59.798108 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-16d4060b-cebc-4e7c-930b-3640dfb817a1 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] 10.222.0.60 "DELETE /compute/v2.1/servers/55b3478d-f1ae-48db-aea5-2619b302c4a9/os-volume_attachments/695f435a-a444-4888-8c9d-757ca0710721" status: 202 len: 0 microversion: 2.1 time: 0.327090 Sep 14 09:25:59.799295 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3038/6100] 10.222.0.60 () {58 vars in 1416 bytes} [Wed Sep 14 09:25:59 2022] DELETE /compute/v2.1/servers/55b3478d-f1ae-48db-aea5-2619b302c4a9/os-volume_attachments/695f435a-a444-4888-8c9d-757ca0710721 => generated 0 bytes in 330 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:26:05.462574 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-0423f75b-18cb-4a43-93aa-2b02ffc35e06 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:05.467436 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-0423f75b-18cb-4a43-93aa-2b02ffc35e06 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] [instance: 55b3478d-f1ae-48db-aea5-2619b302c4a9] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:05.477953 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0423f75b-18cb-4a43-93aa-2b02ffc35e06 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:05.478453 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0423f75b-18cb-4a43-93aa-2b02ffc35e06 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:05.478897 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0423f75b-18cb-4a43-93aa-2b02ffc35e06 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:05.479856 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0423f75b-18cb-4a43-93aa-2b02ffc35e06 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:05.480323 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0423f75b-18cb-4a43-93aa-2b02ffc35e06 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:05.480753 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0423f75b-18cb-4a43-93aa-2b02ffc35e06 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:05.514920 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-0423f75b-18cb-4a43-93aa-2b02ffc35e06 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] 10.222.0.60 "GET /compute/v2.1/servers/55b3478d-f1ae-48db-aea5-2619b302c4a9/os-volume_attachments/5123155e-01db-4a8d-b559-565251212e70" status: 200 len: 194 microversion: 2.1 time: 0.056322 Sep 14 09:26:05.515859 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3063/6101] 10.222.0.60 () {58 vars in 1413 bytes} [Wed Sep 14 09:26:05 2022] GET /compute/v2.1/servers/55b3478d-f1ae-48db-aea5-2619b302c4a9/os-volume_attachments/5123155e-01db-4a8d-b559-565251212e70 => generated 194 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:26:05.528266 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-67892eb7-15a0-4398-b730-f12fc4a7a420 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:05.529441 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-67892eb7-15a0-4398-b730-f12fc4a7a420 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] [instance: 55b3478d-f1ae-48db-aea5-2619b302c4a9] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:05.535801 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-67892eb7-15a0-4398-b730-f12fc4a7a420 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:05.536679 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-67892eb7-15a0-4398-b730-f12fc4a7a420 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:05.537128 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-67892eb7-15a0-4398-b730-f12fc4a7a420 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:05.537849 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-67892eb7-15a0-4398-b730-f12fc4a7a420 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:05.538351 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-67892eb7-15a0-4398-b730-f12fc4a7a420 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:05.538769 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-67892eb7-15a0-4398-b730-f12fc4a7a420 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:05.632675 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.objects.instance [None req-67892eb7-15a0-4398-b730-f12fc4a7a420 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lazy-loading 'services' on Instance uuid 55b3478d-f1ae-48db-aea5-2619b302c4a9 {{(pid=128759) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:26:05.708741 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-67892eb7-15a0-4398-b730-f12fc4a7a420 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] 10.222.0.60 "DELETE /compute/v2.1/servers/55b3478d-f1ae-48db-aea5-2619b302c4a9/os-volume_attachments/5123155e-01db-4a8d-b559-565251212e70" status: 202 len: 0 microversion: 2.1 time: 0.185978 Sep 14 09:26:05.710362 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3039/6102] 10.222.0.60 () {58 vars in 1416 bytes} [Wed Sep 14 09:26:05 2022] DELETE /compute/v2.1/servers/55b3478d-f1ae-48db-aea5-2619b302c4a9/os-volume_attachments/5123155e-01db-4a8d-b559-565251212e70 => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:26:11.218963 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-cbd318d6-e374-4df8-9a79-ac140c85aba1 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:11.221880 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-cbd318d6-e374-4df8-9a79-ac140c85aba1 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] [instance: 55b3478d-f1ae-48db-aea5-2619b302c4a9] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:11.229042 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cbd318d6-e374-4df8-9a79-ac140c85aba1 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:11.230000 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cbd318d6-e374-4df8-9a79-ac140c85aba1 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:11.230629 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cbd318d6-e374-4df8-9a79-ac140c85aba1 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:11.231585 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cbd318d6-e374-4df8-9a79-ac140c85aba1 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:11.232207 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cbd318d6-e374-4df8-9a79-ac140c85aba1 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:11.232643 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cbd318d6-e374-4df8-9a79-ac140c85aba1 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:11.268484 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-cbd318d6-e374-4df8-9a79-ac140c85aba1 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] 10.222.0.60 "GET /compute/v2.1/servers/55b3478d-f1ae-48db-aea5-2619b302c4a9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053686 Sep 14 09:26:11.283565 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3064/6103] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 14 09:26:11 2022] GET /compute/v2.1/servers/55b3478d-f1ae-48db-aea5-2619b302c4a9/os-volume_attachments => generated 25 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 09:26:11.405192 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b5b72122-8055-4ac2-8965-9f08898ed3e8 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:11.408641 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b5b72122-8055-4ac2-8965-9f08898ed3e8 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] [instance: 55b3478d-f1ae-48db-aea5-2619b302c4a9] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:11.415105 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b5b72122-8055-4ac2-8965-9f08898ed3e8 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:11.415690 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b5b72122-8055-4ac2-8965-9f08898ed3e8 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:11.416275 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b5b72122-8055-4ac2-8965-9f08898ed3e8 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:11.417132 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b5b72122-8055-4ac2-8965-9f08898ed3e8 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:11.417803 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b5b72122-8055-4ac2-8965-9f08898ed3e8 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:11.418226 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b5b72122-8055-4ac2-8965-9f08898ed3e8 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:11.457141 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b5b72122-8055-4ac2-8965-9f08898ed3e8 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] 10.222.0.60 "GET /compute/v2.1/servers/55b3478d-f1ae-48db-aea5-2619b302c4a9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057509 Sep 14 09:26:11.457760 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3040/6104] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 14 09:26:11 2022] GET /compute/v2.1/servers/55b3478d-f1ae-48db-aea5-2619b302c4a9/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 09:26:11.536785 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-03aa5e1c-6881-459c-869f-c67684452315 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:11.537297 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-03aa5e1c-6881-459c-869f-c67684452315 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] [instance: 55b3478d-f1ae-48db-aea5-2619b302c4a9] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:11.543873 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-03aa5e1c-6881-459c-869f-c67684452315 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:11.544368 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-03aa5e1c-6881-459c-869f-c67684452315 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:11.544805 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-03aa5e1c-6881-459c-869f-c67684452315 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:11.545511 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-03aa5e1c-6881-459c-869f-c67684452315 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:11.545970 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-03aa5e1c-6881-459c-869f-c67684452315 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:11.546397 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-03aa5e1c-6881-459c-869f-c67684452315 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:11.579604 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-03aa5e1c-6881-459c-869f-c67684452315 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] [instance: 55b3478d-f1ae-48db-aea5-2619b302c4a9] Going to try to terminate instance {{(pid=128758) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:26:11.692487 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-03aa5e1c-6881-459c-869f-c67684452315 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] 10.222.0.60 "DELETE /compute/v2.1/servers/55b3478d-f1ae-48db-aea5-2619b302c4a9" status: 204 len: 0 microversion: 2.1 time: 0.159431 Sep 14 09:26:11.693097 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3065/6105] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:26:11 2022] DELETE /compute/v2.1/servers/55b3478d-f1ae-48db-aea5-2619b302c4a9 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:26:11.702567 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-bcbb1cc8-b4a9-484f-a723-848128d48385 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:11.703233 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-bcbb1cc8-b4a9-484f-a723-848128d48385 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] [instance: 55b3478d-f1ae-48db-aea5-2619b302c4a9] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:11.709256 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bcbb1cc8-b4a9-484f-a723-848128d48385 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:11.709792 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bcbb1cc8-b4a9-484f-a723-848128d48385 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:11.710227 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bcbb1cc8-b4a9-484f-a723-848128d48385 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:11.712135 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bcbb1cc8-b4a9-484f-a723-848128d48385 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:11.712810 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bcbb1cc8-b4a9-484f-a723-848128d48385 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:11.713577 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bcbb1cc8-b4a9-484f-a723-848128d48385 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:11.915910 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-bcbb1cc8-b4a9-484f-a723-848128d48385 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9568f2d3f644e409961ab34e8fa95cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8638ed7d7b3d4285b36865282b8caeab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:11.924173 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-bcbb1cc8-b4a9-484f-a723-848128d48385 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] 10.222.0.60 "GET /compute/v2.1/servers/55b3478d-f1ae-48db-aea5-2619b302c4a9" status: 200 len: 1673 microversion: 2.1 time: 0.225901 Sep 14 09:26:11.924759 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3041/6106] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:26:11 2022] GET /compute/v2.1/servers/55b3478d-f1ae-48db-aea5-2619b302c4a9 => generated 1673 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:26:12.951032 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-86ed80d2-30ae-40a4-924c-b6bfd2806916 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:12.952575 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-86ed80d2-30ae-40a4-924c-b6bfd2806916 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] [instance: 55b3478d-f1ae-48db-aea5-2619b302c4a9] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:12.964791 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-86ed80d2-30ae-40a4-924c-b6bfd2806916 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:12.965502 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-86ed80d2-30ae-40a4-924c-b6bfd2806916 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:12.966158 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-86ed80d2-30ae-40a4-924c-b6bfd2806916 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:12.967114 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-86ed80d2-30ae-40a4-924c-b6bfd2806916 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:12.968857 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-86ed80d2-30ae-40a4-924c-b6bfd2806916 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:12.969352 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-86ed80d2-30ae-40a4-924c-b6bfd2806916 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:13.135313 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-86ed80d2-30ae-40a4-924c-b6bfd2806916 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9568f2d3f644e409961ab34e8fa95cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8638ed7d7b3d4285b36865282b8caeab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:13.144138 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-86ed80d2-30ae-40a4-924c-b6bfd2806916 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] 10.222.0.60 "GET /compute/v2.1/servers/55b3478d-f1ae-48db-aea5-2619b302c4a9" status: 200 len: 1673 microversion: 2.1 time: 0.198532 Sep 14 09:26:13.163366 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3066/6107] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:26:12 2022] GET /compute/v2.1/servers/55b3478d-f1ae-48db-aea5-2619b302c4a9 => generated 1673 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:26:14.174168 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ed228240-fb46-463f-be81-a226d79e9b57 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:14.174812 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-ed228240-fb46-463f-be81-a226d79e9b57 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] [instance: 55b3478d-f1ae-48db-aea5-2619b302c4a9] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:14.182716 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ed228240-fb46-463f-be81-a226d79e9b57 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:14.183476 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ed228240-fb46-463f-be81-a226d79e9b57 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:14.184103 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ed228240-fb46-463f-be81-a226d79e9b57 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:14.184973 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ed228240-fb46-463f-be81-a226d79e9b57 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:14.185604 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ed228240-fb46-463f-be81-a226d79e9b57 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:14.186030 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ed228240-fb46-463f-be81-a226d79e9b57 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:14.684932 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-ed228240-fb46-463f-be81-a226d79e9b57 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9568f2d3f644e409961ab34e8fa95cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8638ed7d7b3d4285b36865282b8caeab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:14.695848 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-ed228240-fb46-463f-be81-a226d79e9b57 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] 10.222.0.60 "GET /compute/v2.1/servers/55b3478d-f1ae-48db-aea5-2619b302c4a9" status: 200 len: 1673 microversion: 2.1 time: 0.526217 Sep 14 09:26:14.697014 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3042/6108] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:26:14 2022] GET /compute/v2.1/servers/55b3478d-f1ae-48db-aea5-2619b302c4a9 => generated 1673 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:26:15.158834 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-89b7bd05-e15d-415a-8cc0-13ec34b02f5a req-c10e3539-6243-4c36-a4fe-0a1871292a90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55b3478d-f1ae-48db-aea5-2619b302c4a9", "name": "network-vif-deleted", "tag": "b3f8fd2b-6b54-431e-b9c4-6c4b7a937e21"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:26:15.195570 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-89b7bd05-e15d-415a-8cc0-13ec34b02f5a req-c10e3539-6243-4c36-a4fe-0a1871292a90 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:15.198699 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-89b7bd05-e15d-415a-8cc0-13ec34b02f5a req-c10e3539-6243-4c36-a4fe-0a1871292a90 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:15.200134 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-89b7bd05-e15d-415a-8cc0-13ec34b02f5a req-c10e3539-6243-4c36-a4fe-0a1871292a90 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:15.216765 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-89b7bd05-e15d-415a-8cc0-13ec34b02f5a req-c10e3539-6243-4c36-a4fe-0a1871292a90 service nova] Creating event network-vif-deleted:b3f8fd2b-6b54-431e-b9c4-6c4b7a937e21 for instance 55b3478d-f1ae-48db-aea5-2619b302c4a9 on n-h1-836830-18 Sep 14 09:26:15.229760 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-89b7bd05-e15d-415a-8cc0-13ec34b02f5a req-c10e3539-6243-4c36-a4fe-0a1871292a90 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078455 Sep 14 09:26:15.231072 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3067/6109] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:26:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:26:15.726375 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ae278255-2bfc-4469-ba69-275b2e8218ca tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:15.727792 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-ae278255-2bfc-4469-ba69-275b2e8218ca tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] [instance: 55b3478d-f1ae-48db-aea5-2619b302c4a9] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:15.735956 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ae278255-2bfc-4469-ba69-275b2e8218ca tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:15.738156 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ae278255-2bfc-4469-ba69-275b2e8218ca tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:15.738868 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ae278255-2bfc-4469-ba69-275b2e8218ca tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:15.739875 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ae278255-2bfc-4469-ba69-275b2e8218ca tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:15.740747 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ae278255-2bfc-4469-ba69-275b2e8218ca tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:15.741427 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ae278255-2bfc-4469-ba69-275b2e8218ca tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:15.779149 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ae278255-2bfc-4469-ba69-275b2e8218ca tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:15.780097 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ae278255-2bfc-4469-ba69-275b2e8218ca tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:15.780932 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ae278255-2bfc-4469-ba69-275b2e8218ca tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:15.781645 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.objects.instance [None req-ae278255-2bfc-4469-ba69-275b2e8218ca tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lazy-loading 'fault' on Instance uuid 55b3478d-f1ae-48db-aea5-2619b302c4a9 {{(pid=128759) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:26:15.847636 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-ae278255-2bfc-4469-ba69-275b2e8218ca tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9568f2d3f644e409961ab34e8fa95cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8638ed7d7b3d4285b36865282b8caeab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:15.858453 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-ae278255-2bfc-4469-ba69-275b2e8218ca tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] 10.222.0.60 "GET /compute/v2.1/servers/55b3478d-f1ae-48db-aea5-2619b302c4a9" status: 200 len: 1327 microversion: 2.1 time: 0.136162 Sep 14 09:26:15.861689 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3043/6110] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:26:15 2022] GET /compute/v2.1/servers/55b3478d-f1ae-48db-aea5-2619b302c4a9 => generated 1327 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:26:16.883339 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-5b0d3767-afbe-4258-a75c-2f04644dad2c tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:16.884609 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-5b0d3767-afbe-4258-a75c-2f04644dad2c tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] [instance: 55b3478d-f1ae-48db-aea5-2619b302c4a9] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:16.901515 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5b0d3767-afbe-4258-a75c-2f04644dad2c tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:16.902308 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5b0d3767-afbe-4258-a75c-2f04644dad2c tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:16.902910 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5b0d3767-afbe-4258-a75c-2f04644dad2c tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:16.903823 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5b0d3767-afbe-4258-a75c-2f04644dad2c tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:16.904518 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5b0d3767-afbe-4258-a75c-2f04644dad2c tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:16.905103 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5b0d3767-afbe-4258-a75c-2f04644dad2c tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:16.936501 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-5b0d3767-afbe-4258-a75c-2f04644dad2c tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] HTTP exception thrown: Instance 55b3478d-f1ae-48db-aea5-2619b302c4a9 could not be found. Sep 14 09:26:16.940870 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-5b0d3767-afbe-4258-a75c-2f04644dad2c tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Request method failure captured: Sep 14 09:26:16.940870 n-d-836830-18 devstack@n-api.service[128758]: request: GET /compute/v2.1/servers/55b3478d-f1ae-48db-aea5-2619b302c4a9 HTTP/1.1 Sep 14 09:26:16.940870 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 09:26:16.940870 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 09:26:16.940870 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 09:26:16.940870 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 09:26:16.940870 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 09:26:16.940870 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 09:26:16.940870 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 09:26:16.940870 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 09:26:16.940870 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZx9aFKqEB9cMgUgPNoCaUFt_lsGYQ5O0XFZVwyFFRnz3QbKviZWjgwXU5xFdgyAz8ZOyj-M7ffqBSNBl5KJuM0Uv_JGgNMNJd3ugvalumtSGtzFh-wD7f1fdJl8S4Lm2WlrH0fOtOpZ0gOE-tppUF2FxQ2JMU5kvYVSpqc9pAkzXt0 Sep 14 09:26:16.940870 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 09:26:16.940870 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 09:26:16.940870 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 09:26:16.940870 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 09:26:16.940870 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 09:26:16.940870 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 09:26:16.940870 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 8638ed7d7b3d4285b36865282b8caeab Sep 14 09:26:16.940870 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-AttachVolumeTestJSON-355816842 Sep 14 09:26:16.940870 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 09:26:16.940870 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 09:26:16.940870 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/8638ed7d7b3d4285b36865282b8caeab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_8638ed7d7b3d4285b36865282b8caeab"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8638ed7d7b3d4285b36865282b8caeab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8638ed7d7b3d4285b36865282b8caeab"}]}] Sep 14 09:26:16.940870 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-AttachVolumeTestJSON-355816842 Sep 14 09:26:16.940870 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 8638ed7d7b3d4285b36865282b8caeab Sep 14 09:26:16.940870 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-AttachVolumeTestJSON-355816842 Sep 14 09:26:16.940870 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-AttachVolumeTestJSON-355816842-project Sep 14 09:26:16.940870 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 09:26:16.940870 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 09:26:16.940870 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: b9568f2d3f644e409961ab34e8fa95cc Sep 14 09:26:16.940870 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-AttachVolumeTestJSON-355816842-project Sep 14 09:26:16.940870 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 09:26:16.940870 n-d-836830-18 devstack@n-api.service[128758]: exception: Instance 55b3478d-f1ae-48db-aea5-2619b302c4a9 could not be found. Sep 14 09:26:16.940870 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': '55b3478d-f1ae-48db-aea5-2619b302c4a9'} Sep 14 09:26:16.940870 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:26:16.940870 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:26:16.940870 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:26:16.940870 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:26:16.940870 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:26:16.940870 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:26:16.940870 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:26:16.940870 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:26:16.940870 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:26:16.940870 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:26:16.940870 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55b3478d-f1ae-48db-aea5-2619b302c4a9 could not be found. Sep 14 09:26:16.940870 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:26:16.940870 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:26:16.940870 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:26:16.940870 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:26:16.940870 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:26:16.940870 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:26:16.940870 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:26:16.940870 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:26:16.940870 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:26:16.940870 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:26:16.940870 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:26:16.940870 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:26:16.940870 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:26:16.940870 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:26:16.940870 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:26:16.940870 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:26:16.940870 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55b3478d-f1ae-48db-aea5-2619b302c4a9 could not be found. Sep 14 09:26:16.940870 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:26:16.940870 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:26:16.940870 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:26:16.945719 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:26:16.945719 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:26:16.945719 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:26:16.945719 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:26:16.945719 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:26:16.945719 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55b3478d-f1ae-48db-aea5-2619b302c4a9 could not be found. Sep 14 09:26:16.945719 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:26:16.947226 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-5b0d3767-afbe-4258-a75c-2f04644dad2c tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Returning 404 to user: Instance 55b3478d-f1ae-48db-aea5-2619b302c4a9 could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:26:16.948264 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-5b0d3767-afbe-4258-a75c-2f04644dad2c tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] 10.222.0.60 "GET /compute/v2.1/servers/55b3478d-f1ae-48db-aea5-2619b302c4a9" status: 404 len: 111 microversion: 2.1 time: 0.070133 Sep 14 09:26:16.949338 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3068/6111] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:26:16 2022] GET /compute/v2.1/servers/55b3478d-f1ae-48db-aea5-2619b302c4a9 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:26:16.965020 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-4f51d85e-f0ea-46c9-9271-bf783e28d41c tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Calling method '.version_select at 0x7f7d486cfdc0>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:16.986482 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-4f51d85e-f0ea-46c9-9271-bf783e28d41c tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1060575881" status: 202 len: 0 microversion: 2.1 time: 0.032892 Sep 14 09:26:16.987117 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3044/6112] 10.222.0.60 () {58 vars in 1221 bytes} [Wed Sep 14 09:26:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1060575881 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:26:24.359998 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-51dce813-fe2b-4e7a-bc8c-1537574fa0b4 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:24.360652 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-51dce813-fe2b-4e7a-bc8c-1537574fa0b4 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] [instance: 55b3478d-f1ae-48db-aea5-2619b302c4a9] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:24.373025 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-51dce813-fe2b-4e7a-bc8c-1537574fa0b4 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:24.373804 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-51dce813-fe2b-4e7a-bc8c-1537574fa0b4 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:24.374487 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-51dce813-fe2b-4e7a-bc8c-1537574fa0b4 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:24.376004 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-51dce813-fe2b-4e7a-bc8c-1537574fa0b4 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:24.376981 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-51dce813-fe2b-4e7a-bc8c-1537574fa0b4 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:24.377747 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-51dce813-fe2b-4e7a-bc8c-1537574fa0b4 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:24.397240 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-51dce813-fe2b-4e7a-bc8c-1537574fa0b4 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] HTTP exception thrown: Instance 55b3478d-f1ae-48db-aea5-2619b302c4a9 could not be found. Sep 14 09:26:24.402088 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-51dce813-fe2b-4e7a-bc8c-1537574fa0b4 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Request method failure captured: Sep 14 09:26:24.402088 n-d-836830-18 devstack@n-api.service[128758]: request: DELETE /compute/v2.1/servers/55b3478d-f1ae-48db-aea5-2619b302c4a9 HTTP/1.1 Sep 14 09:26:24.402088 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 09:26:24.402088 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 09:26:24.402088 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 09:26:24.402088 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 09:26:24.402088 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 09:26:24.402088 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 09:26:24.402088 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 09:26:24.402088 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 09:26:24.402088 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZx9aFKqEB9cMgUgPNoCaUFt_lsGYQ5O0XFZVwyFFRnz3QbKviZWjgwXU5xFdgyAz8ZOyj-M7ffqBSNBl5KJuM0Uv_JGgNMNJd3ugvalumtSGtzFh-wD7f1fdJl8S4Lm2WlrH0fOtOpZ0gOE-tppUF2FxQ2JMU5kvYVSpqc9pAkzXt0 Sep 14 09:26:24.402088 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 09:26:24.402088 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 09:26:24.402088 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 09:26:24.402088 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 09:26:24.402088 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 09:26:24.402088 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 09:26:24.402088 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 8638ed7d7b3d4285b36865282b8caeab Sep 14 09:26:24.402088 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-AttachVolumeTestJSON-355816842 Sep 14 09:26:24.402088 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 09:26:24.402088 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 09:26:24.402088 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/8638ed7d7b3d4285b36865282b8caeab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_8638ed7d7b3d4285b36865282b8caeab"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8638ed7d7b3d4285b36865282b8caeab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8638ed7d7b3d4285b36865282b8caeab"}]}] Sep 14 09:26:24.402088 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-AttachVolumeTestJSON-355816842 Sep 14 09:26:24.402088 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 8638ed7d7b3d4285b36865282b8caeab Sep 14 09:26:24.402088 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-AttachVolumeTestJSON-355816842 Sep 14 09:26:24.402088 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-AttachVolumeTestJSON-355816842-project Sep 14 09:26:24.402088 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 09:26:24.402088 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 09:26:24.402088 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: b9568f2d3f644e409961ab34e8fa95cc Sep 14 09:26:24.402088 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-AttachVolumeTestJSON-355816842-project Sep 14 09:26:24.402088 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 09:26:24.402088 n-d-836830-18 devstack@n-api.service[128758]: exception: Instance 55b3478d-f1ae-48db-aea5-2619b302c4a9 could not be found. Sep 14 09:26:24.402088 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': '55b3478d-f1ae-48db-aea5-2619b302c4a9'} Sep 14 09:26:24.402088 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:26:24.402088 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:26:24.402088 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:26:24.402088 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:26:24.402088 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:26:24.402088 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:26:24.402088 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:26:24.402088 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:26:24.402088 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:26:24.402088 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:26:24.402088 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55b3478d-f1ae-48db-aea5-2619b302c4a9 could not be found. Sep 14 09:26:24.402088 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:26:24.402088 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:26:24.402088 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:26:24.402088 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:26:24.402088 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:26:24.402088 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:26:24.402088 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:26:24.402088 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:26:24.402088 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:26:24.402088 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:26:24.402088 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 09:26:24.402088 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 09:26:24.402088 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 09:26:24.402088 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 09:26:24.402088 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:26:24.402088 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:26:24.402088 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:26:24.402088 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:26:24.405883 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55b3478d-f1ae-48db-aea5-2619b302c4a9 could not be found. Sep 14 09:26:24.405883 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:26:24.405883 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:26:24.405883 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:26:24.405883 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:26:24.405883 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:26:24.405883 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:26:24.405883 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:26:24.405883 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:26:24.405883 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55b3478d-f1ae-48db-aea5-2619b302c4a9 could not be found. Sep 14 09:26:24.405883 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:26:24.409054 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-51dce813-fe2b-4e7a-bc8c-1537574fa0b4 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Returning 404 to user: Instance 55b3478d-f1ae-48db-aea5-2619b302c4a9 could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:26:24.410343 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-51dce813-fe2b-4e7a-bc8c-1537574fa0b4 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] 10.222.0.60 "DELETE /compute/v2.1/servers/55b3478d-f1ae-48db-aea5-2619b302c4a9" status: 404 len: 111 microversion: 2.1 time: 0.054396 Sep 14 09:26:24.418388 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3069/6113] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:26:24 2022] DELETE /compute/v2.1/servers/55b3478d-f1ae-48db-aea5-2619b302c4a9 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:26:24.423974 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-6486db5b-d187-4155-a625-c9482e13b94c tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:24.424607 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-6486db5b-d187-4155-a625-c9482e13b94c tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] [instance: 55b3478d-f1ae-48db-aea5-2619b302c4a9] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:24.439752 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6486db5b-d187-4155-a625-c9482e13b94c tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:24.440433 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6486db5b-d187-4155-a625-c9482e13b94c tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:24.441047 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6486db5b-d187-4155-a625-c9482e13b94c tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:24.442222 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6486db5b-d187-4155-a625-c9482e13b94c tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:24.443393 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6486db5b-d187-4155-a625-c9482e13b94c tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:24.444590 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6486db5b-d187-4155-a625-c9482e13b94c tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:24.462108 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-6486db5b-d187-4155-a625-c9482e13b94c tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] HTTP exception thrown: Instance 55b3478d-f1ae-48db-aea5-2619b302c4a9 could not be found. Sep 14 09:26:24.464144 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-6486db5b-d187-4155-a625-c9482e13b94c tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Request method failure captured: Sep 14 09:26:24.464144 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/55b3478d-f1ae-48db-aea5-2619b302c4a9 HTTP/1.1 Sep 14 09:26:24.464144 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:26:24.464144 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:26:24.464144 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:26:24.464144 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:26:24.464144 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:26:24.464144 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:26:24.464144 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:26:24.464144 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:26:24.464144 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZx9aFKqEB9cMgUgPNoCaUFt_lsGYQ5O0XFZVwyFFRnz3QbKviZWjgwXU5xFdgyAz8ZOyj-M7ffqBSNBl5KJuM0Uv_JGgNMNJd3ugvalumtSGtzFh-wD7f1fdJl8S4Lm2WlrH0fOtOpZ0gOE-tppUF2FxQ2JMU5kvYVSpqc9pAkzXt0 Sep 14 09:26:24.464144 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:26:24.464144 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:26:24.464144 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:26:24.464144 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:26:24.464144 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:26:24.464144 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:26:24.464144 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 8638ed7d7b3d4285b36865282b8caeab Sep 14 09:26:24.464144 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-AttachVolumeTestJSON-355816842 Sep 14 09:26:24.464144 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:26:24.464144 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:26:24.464144 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/8638ed7d7b3d4285b36865282b8caeab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_8638ed7d7b3d4285b36865282b8caeab"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8638ed7d7b3d4285b36865282b8caeab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8638ed7d7b3d4285b36865282b8caeab"}]}] Sep 14 09:26:24.464144 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-AttachVolumeTestJSON-355816842 Sep 14 09:26:24.464144 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 8638ed7d7b3d4285b36865282b8caeab Sep 14 09:26:24.464144 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-AttachVolumeTestJSON-355816842 Sep 14 09:26:24.464144 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-AttachVolumeTestJSON-355816842-project Sep 14 09:26:24.464144 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:26:24.464144 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:26:24.464144 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: b9568f2d3f644e409961ab34e8fa95cc Sep 14 09:26:24.464144 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-AttachVolumeTestJSON-355816842-project Sep 14 09:26:24.464144 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:26:24.464144 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance 55b3478d-f1ae-48db-aea5-2619b302c4a9 could not be found. Sep 14 09:26:24.464144 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '55b3478d-f1ae-48db-aea5-2619b302c4a9'} Sep 14 09:26:24.464144 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:26:24.464144 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:26:24.464144 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:26:24.464144 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:26:24.464144 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:26:24.464144 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:26:24.464144 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:26:24.464144 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:26:24.464144 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:26:24.464144 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:26:24.464144 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55b3478d-f1ae-48db-aea5-2619b302c4a9 could not be found. Sep 14 09:26:24.464144 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:26:24.464144 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:26:24.464144 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:26:24.464144 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:26:24.464144 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:26:24.464144 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:26:24.464144 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:26:24.464144 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:26:24.464144 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:26:24.464144 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:26:24.464144 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:26:24.464144 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:26:24.464144 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:26:24.464144 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:26:24.464144 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:26:24.464144 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:26:24.464144 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55b3478d-f1ae-48db-aea5-2619b302c4a9 could not be found. Sep 14 09:26:24.464144 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:26:24.464144 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:26:24.464144 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:26:24.468782 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:26:24.468782 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:26:24.468782 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:26:24.468782 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:26:24.468782 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:26:24.468782 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55b3478d-f1ae-48db-aea5-2619b302c4a9 could not be found. Sep 14 09:26:24.468782 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:26:24.470330 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-6486db5b-d187-4155-a625-c9482e13b94c tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Returning 404 to user: Instance 55b3478d-f1ae-48db-aea5-2619b302c4a9 could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:26:24.471467 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-6486db5b-d187-4155-a625-c9482e13b94c tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] 10.222.0.60 "GET /compute/v2.1/servers/55b3478d-f1ae-48db-aea5-2619b302c4a9" status: 404 len: 111 microversion: 2.1 time: 0.051571 Sep 14 09:26:24.472239 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3045/6114] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:26:24 2022] GET /compute/v2.1/servers/55b3478d-f1ae-48db-aea5-2619b302c4a9 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:26:27.925658 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a965368e-539f-4eb5-b454-5c30b5233526 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:27.926230 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-a965368e-539f-4eb5-b454-5c30b5233526 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] [instance: 022379ab-af51-495a-bcef-11e43774a7b0] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:27.933924 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a965368e-539f-4eb5-b454-5c30b5233526 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:27.934978 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a965368e-539f-4eb5-b454-5c30b5233526 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:27.935587 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a965368e-539f-4eb5-b454-5c30b5233526 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:27.936489 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a965368e-539f-4eb5-b454-5c30b5233526 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:27.937145 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a965368e-539f-4eb5-b454-5c30b5233526 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:27.937739 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a965368e-539f-4eb5-b454-5c30b5233526 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:27.953150 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-a965368e-539f-4eb5-b454-5c30b5233526 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] HTTP exception thrown: Instance 022379ab-af51-495a-bcef-11e43774a7b0 could not be found. Sep 14 09:26:27.955039 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a965368e-539f-4eb5-b454-5c30b5233526 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Request method failure captured: Sep 14 09:26:27.955039 n-d-836830-18 devstack@n-api.service[128758]: request: DELETE /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0 HTTP/1.1 Sep 14 09:26:27.955039 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 09:26:27.955039 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 09:26:27.955039 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 09:26:27.955039 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 09:26:27.955039 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 09:26:27.955039 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 09:26:27.955039 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 09:26:27.955039 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 09:26:27.955039 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZx9aFKqEB9cMgUgPNoCaUFt_lsGYQ5O0XFZVwyFFRnz3QbKviZWjgwXU5xFdgyAz8ZOyj-M7ffqBSNBl5KJuM0Uv_JGgNMNJd3ugvalumtSGtzFh-wD7f1fdJl8S4Lm2WlrH0fOtOpZ0gOE-tppUF2FxQ2JMU5kvYVSpqc9pAkzXt0 Sep 14 09:26:27.955039 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 09:26:27.955039 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 09:26:27.955039 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 09:26:27.955039 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 09:26:27.955039 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 09:26:27.955039 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 09:26:27.955039 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 8638ed7d7b3d4285b36865282b8caeab Sep 14 09:26:27.955039 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-AttachVolumeTestJSON-355816842 Sep 14 09:26:27.955039 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 09:26:27.955039 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 09:26:27.955039 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/8638ed7d7b3d4285b36865282b8caeab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_8638ed7d7b3d4285b36865282b8caeab"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8638ed7d7b3d4285b36865282b8caeab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8638ed7d7b3d4285b36865282b8caeab"}]}] Sep 14 09:26:27.955039 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-AttachVolumeTestJSON-355816842 Sep 14 09:26:27.955039 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 8638ed7d7b3d4285b36865282b8caeab Sep 14 09:26:27.955039 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-AttachVolumeTestJSON-355816842 Sep 14 09:26:27.955039 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-AttachVolumeTestJSON-355816842-project Sep 14 09:26:27.955039 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 09:26:27.955039 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 09:26:27.955039 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: b9568f2d3f644e409961ab34e8fa95cc Sep 14 09:26:27.955039 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-AttachVolumeTestJSON-355816842-project Sep 14 09:26:27.955039 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 09:26:27.955039 n-d-836830-18 devstack@n-api.service[128758]: exception: Instance 022379ab-af51-495a-bcef-11e43774a7b0 could not be found. Sep 14 09:26:27.955039 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': '022379ab-af51-495a-bcef-11e43774a7b0'} Sep 14 09:26:27.955039 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:26:27.955039 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:26:27.955039 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:26:27.955039 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:26:27.955039 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:26:27.955039 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:26:27.955039 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:26:27.955039 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:26:27.955039 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:26:27.955039 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:26:27.955039 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 022379ab-af51-495a-bcef-11e43774a7b0 could not be found. Sep 14 09:26:27.955039 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:26:27.955039 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:26:27.955039 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:26:27.955039 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:26:27.955039 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:26:27.955039 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:26:27.955039 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:26:27.955039 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:26:27.955039 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:26:27.955039 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:26:27.955039 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 09:26:27.955039 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 09:26:27.955039 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 09:26:27.955039 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 09:26:27.955039 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:26:27.955039 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:26:27.955039 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:26:27.955039 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:26:27.960160 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 022379ab-af51-495a-bcef-11e43774a7b0 could not be found. Sep 14 09:26:27.960160 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:26:27.960160 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:26:27.960160 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:26:27.960160 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:26:27.960160 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:26:27.960160 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:26:27.960160 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:26:27.960160 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:26:27.960160 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 022379ab-af51-495a-bcef-11e43774a7b0 could not be found. Sep 14 09:26:27.960160 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:26:27.961748 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a965368e-539f-4eb5-b454-5c30b5233526 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Returning 404 to user: Instance 022379ab-af51-495a-bcef-11e43774a7b0 could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:26:27.962786 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-a965368e-539f-4eb5-b454-5c30b5233526 tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] 10.222.0.60 "DELETE /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0" status: 404 len: 111 microversion: 2.1 time: 0.042162 Sep 14 09:26:27.963857 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3070/6115] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:26:27 2022] DELETE /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:26:27.972580 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a029f67e-8f37-44ec-8194-b46352943ebd tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:27.973805 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-a029f67e-8f37-44ec-8194-b46352943ebd tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] [instance: 022379ab-af51-495a-bcef-11e43774a7b0] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:27.983890 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a029f67e-8f37-44ec-8194-b46352943ebd tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:27.984961 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a029f67e-8f37-44ec-8194-b46352943ebd tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:27.985563 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a029f67e-8f37-44ec-8194-b46352943ebd tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:27.986437 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a029f67e-8f37-44ec-8194-b46352943ebd tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:27.987234 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a029f67e-8f37-44ec-8194-b46352943ebd tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:27.987822 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a029f67e-8f37-44ec-8194-b46352943ebd tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:28.009224 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-a029f67e-8f37-44ec-8194-b46352943ebd tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] HTTP exception thrown: Instance 022379ab-af51-495a-bcef-11e43774a7b0 could not be found. Sep 14 09:26:28.011360 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a029f67e-8f37-44ec-8194-b46352943ebd tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Request method failure captured: Sep 14 09:26:28.011360 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0 HTTP/1.1 Sep 14 09:26:28.011360 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:26:28.011360 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:26:28.011360 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:26:28.011360 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:26:28.011360 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:26:28.011360 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:26:28.011360 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:26:28.011360 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:26:28.011360 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZx9aFKqEB9cMgUgPNoCaUFt_lsGYQ5O0XFZVwyFFRnz3QbKviZWjgwXU5xFdgyAz8ZOyj-M7ffqBSNBl5KJuM0Uv_JGgNMNJd3ugvalumtSGtzFh-wD7f1fdJl8S4Lm2WlrH0fOtOpZ0gOE-tppUF2FxQ2JMU5kvYVSpqc9pAkzXt0 Sep 14 09:26:28.011360 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:26:28.011360 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:26:28.011360 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:26:28.011360 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:26:28.011360 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:26:28.011360 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:26:28.011360 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 8638ed7d7b3d4285b36865282b8caeab Sep 14 09:26:28.011360 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-AttachVolumeTestJSON-355816842 Sep 14 09:26:28.011360 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:26:28.011360 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:26:28.011360 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/8638ed7d7b3d4285b36865282b8caeab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_8638ed7d7b3d4285b36865282b8caeab"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8638ed7d7b3d4285b36865282b8caeab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8638ed7d7b3d4285b36865282b8caeab"}]}] Sep 14 09:26:28.011360 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-AttachVolumeTestJSON-355816842 Sep 14 09:26:28.011360 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 8638ed7d7b3d4285b36865282b8caeab Sep 14 09:26:28.011360 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-AttachVolumeTestJSON-355816842 Sep 14 09:26:28.011360 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-AttachVolumeTestJSON-355816842-project Sep 14 09:26:28.011360 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:26:28.011360 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:26:28.011360 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: b9568f2d3f644e409961ab34e8fa95cc Sep 14 09:26:28.011360 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-AttachVolumeTestJSON-355816842-project Sep 14 09:26:28.011360 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:26:28.011360 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance 022379ab-af51-495a-bcef-11e43774a7b0 could not be found. Sep 14 09:26:28.011360 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '022379ab-af51-495a-bcef-11e43774a7b0'} Sep 14 09:26:28.011360 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:26:28.011360 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:26:28.011360 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:26:28.011360 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:26:28.011360 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:26:28.011360 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:26:28.011360 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:26:28.011360 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:26:28.011360 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:26:28.011360 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:26:28.011360 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 022379ab-af51-495a-bcef-11e43774a7b0 could not be found. Sep 14 09:26:28.011360 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:26:28.011360 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:26:28.011360 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:26:28.011360 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:26:28.011360 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:26:28.011360 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:26:28.011360 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:26:28.011360 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:26:28.011360 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:26:28.011360 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:26:28.011360 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:26:28.011360 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:26:28.011360 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:26:28.011360 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:26:28.011360 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:26:28.011360 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:26:28.011360 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 022379ab-af51-495a-bcef-11e43774a7b0 could not be found. Sep 14 09:26:28.011360 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:26:28.011360 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:26:28.011360 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:26:28.015929 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:26:28.015929 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:26:28.015929 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:26:28.015929 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:26:28.015929 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:26:28.015929 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 022379ab-af51-495a-bcef-11e43774a7b0 could not be found. Sep 14 09:26:28.015929 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:26:28.017315 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a029f67e-8f37-44ec-8194-b46352943ebd tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] Returning 404 to user: Instance 022379ab-af51-495a-bcef-11e43774a7b0 could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:26:28.018481 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a029f67e-8f37-44ec-8194-b46352943ebd tempest-AttachVolumeTestJSON-355816842 tempest-AttachVolumeTestJSON-355816842-project] 10.222.0.60 "GET /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0" status: 404 len: 111 microversion: 2.1 time: 0.050732 Sep 14 09:26:28.019613 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3046/6116] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:26:27 2022] GET /compute/v2.1/servers/022379ab-af51-495a-bcef-11e43774a7b0 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:26:35.507322 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-80363f76-5618-4c2f-a72d-b659f566087c tempest-VolumesNegativeTest-1356367859 tempest-VolumesNegativeTest-1356367859-project] Action: 'create', calling method: .version_select at 0x7f7d44604280>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1311984272", "metadata": {"Type": "work"}}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:26:35.517913 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-80363f76-5618-4c2f-a72d-b659f566087c tempest-VolumesNegativeTest-1356367859 tempest-VolumesNegativeTest-1356367859-project] Request method failure captured: Sep 14 09:26:35.517913 n-d-836830-18 devstack@n-api.service[128758]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 14 09:26:35.517913 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 09:26:35.517913 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 09:26:35.517913 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 09:26:35.517913 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 122 Sep 14 09:26:35.517913 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 09:26:35.517913 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 09:26:35.517913 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 09:26:35.517913 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 09:26:35.517913 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZ5LlCfABo3-nJlg75gykDK3opoNTipPfA0ERcY2ADhLBiNZ4isW6WUmRvFi40B2VmAIDCWcBUv7twXwWTv27M22_0-ybD279Ur_IlUCr1oj7raKH1aqdDGIeUiKb0UHF9vv9uL1zU_dOBI2UM9UKUVShmqDRxSCVGyqsATepznFcus Sep 14 09:26:35.517913 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 09:26:35.517913 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 09:26:35.517913 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 09:26:35.517913 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 09:26:35.517913 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 09:26:35.517913 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 09:26:35.517913 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 10f04bd1d36642b48d1afd891f9d69a9 Sep 14 09:26:35.517913 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-VolumesNegativeTest-1356367859 Sep 14 09:26:35.517913 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 09:26:35.517913 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 09:26:35.517913 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/10f04bd1d36642b48d1afd891f9d69a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_10f04bd1d36642b48d1afd891f9d69a9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/10f04bd1d36642b48d1afd891f9d69a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/10f04bd1d36642b48d1afd891f9d69a9"}]}] Sep 14 09:26:35.517913 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-VolumesNegativeTest-1356367859 Sep 14 09:26:35.517913 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 10f04bd1d36642b48d1afd891f9d69a9 Sep 14 09:26:35.517913 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-VolumesNegativeTest-1356367859 Sep 14 09:26:35.517913 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-VolumesNegativeTest-1356367859-project Sep 14 09:26:35.517913 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 09:26:35.517913 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 09:26:35.517913 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 4f0cbaf3f31f42928626872a10c6e49e Sep 14 09:26:35.517913 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-VolumesNegativeTest-1356367859-project Sep 14 09:26:35.517913 n-d-836830-18 devstack@n-api.service[128758]: Sep 14 09:26:35.517913 n-d-836830-18 devstack@n-api.service[128758]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1311984272", "metadata": {"Type": "work"}}} Sep 14 09:26:35.517913 n-d-836830-18 devstack@n-api.service[128758]: method: Sep 14 09:26:35.517913 n-d-836830-18 devstack@n-api.service[128758]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 14 09:26:35.517913 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1311984272', 'metadata': {'Type': 'work'}}}} Sep 14 09:26:35.517913 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:26:35.517913 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:26:35.517913 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 14 09:26:35.517913 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 14 09:26:35.517913 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 14 09:26:35.517913 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise error Sep 14 09:26:35.517913 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 14 09:26:35.517913 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:26:35.517913 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 14 09:26:35.517913 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 14 09:26:35.517913 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:26:35.517913 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 14 09:26:35.517913 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi '#$%' Sep 14 09:26:35.517913 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:26:35.517913 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:26:35.517913 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:26:35.517913 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:26:35.517913 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:26:35.517913 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:26:35.517913 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:26:35.517913 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:26:35.517913 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:26:35.517913 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:26:35.517913 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:26:35.517913 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:26:35.517913 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 14 09:26:35.517913 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 14 09:26:35.517913 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 14 09:26:35.517913 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 14 09:26:35.517913 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 14 09:26:35.517913 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 14 09:26:35.522714 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 14 09:26:35.522714 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:26:35.522714 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:26:35.522714 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:26:35.522714 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:26:35.522714 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:26:35.522714 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:26:35.522714 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 14 09:26:35.522714 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 14 09:26:35.522714 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 14 09:26:35.522714 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:26:35.522714 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-80363f76-5618-4c2f-a72d-b659f566087c tempest-VolumesNegativeTest-1356367859 tempest-VolumesNegativeTest-1356367859-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:26:35.522714 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-80363f76-5618-4c2f-a72d-b659f566087c tempest-VolumesNegativeTest-1356367859 tempest-VolumesNegativeTest-1356367859-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.147245 Sep 14 09:26:35.522714 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3071/6117] 10.222.0.60 () {60 vars in 1156 bytes} [Wed Sep 14 09:26:35 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 148 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 14 09:26:35.529499 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-70b12aad-6f8e-457a-aaa9-3f427d441f60 tempest-VolumesNegativeTest-1356367859 tempest-VolumesNegativeTest-1356367859-project] Action: 'create', calling method: .version_select at 0x7f7d487ff940>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2144250528", "metadata": {"Type": "work"}}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:26:35.533653 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-70b12aad-6f8e-457a-aaa9-3f427d441f60 tempest-VolumesNegativeTest-1356367859 tempest-VolumesNegativeTest-1356367859-project] Request method failure captured: Sep 14 09:26:35.533653 n-d-836830-18 devstack@n-api.service[128759]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 14 09:26:35.533653 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:26:35.533653 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:26:35.533653 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:26:35.533653 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 120 Sep 14 09:26:35.533653 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:26:35.533653 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:26:35.533653 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:26:35.533653 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:26:35.533653 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZ5LlCfABo3-nJlg75gykDK3opoNTipPfA0ERcY2ADhLBiNZ4isW6WUmRvFi40B2VmAIDCWcBUv7twXwWTv27M22_0-ybD279Ur_IlUCr1oj7raKH1aqdDGIeUiKb0UHF9vv9uL1zU_dOBI2UM9UKUVShmqDRxSCVGyqsATepznFcus Sep 14 09:26:35.533653 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:26:35.533653 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:26:35.533653 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:26:35.533653 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:26:35.533653 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:26:35.533653 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:26:35.533653 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 10f04bd1d36642b48d1afd891f9d69a9 Sep 14 09:26:35.533653 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-VolumesNegativeTest-1356367859 Sep 14 09:26:35.533653 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:26:35.533653 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:26:35.533653 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/10f04bd1d36642b48d1afd891f9d69a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_10f04bd1d36642b48d1afd891f9d69a9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/10f04bd1d36642b48d1afd891f9d69a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/10f04bd1d36642b48d1afd891f9d69a9"}]}] Sep 14 09:26:35.533653 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-VolumesNegativeTest-1356367859 Sep 14 09:26:35.533653 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 10f04bd1d36642b48d1afd891f9d69a9 Sep 14 09:26:35.533653 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-VolumesNegativeTest-1356367859 Sep 14 09:26:35.533653 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-VolumesNegativeTest-1356367859-project Sep 14 09:26:35.533653 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:26:35.533653 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:26:35.533653 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 4f0cbaf3f31f42928626872a10c6e49e Sep 14 09:26:35.533653 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-VolumesNegativeTest-1356367859-project Sep 14 09:26:35.533653 n-d-836830-18 devstack@n-api.service[128759]: Sep 14 09:26:35.533653 n-d-836830-18 devstack@n-api.service[128759]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2144250528", "metadata": {"Type": "work"}}} Sep 14 09:26:35.533653 n-d-836830-18 devstack@n-api.service[128759]: method: Sep 14 09:26:35.533653 n-d-836830-18 devstack@n-api.service[128759]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 14 09:26:35.533653 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-2144250528', 'metadata': {'Type': 'work'}}}} Sep 14 09:26:35.533653 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:26:35.533653 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:26:35.533653 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 14 09:26:35.533653 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 14 09:26:35.533653 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 14 09:26:35.533653 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise error Sep 14 09:26:35.533653 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 14 09:26:35.533653 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:26:35.533653 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 14 09:26:35.533653 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 14 09:26:35.533653 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:26:35.533653 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 14 09:26:35.533653 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi '0' Sep 14 09:26:35.533653 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:26:35.533653 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:26:35.533653 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:26:35.533653 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:26:35.533653 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:26:35.533653 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:26:35.533653 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:26:35.533653 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:26:35.533653 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:26:35.533653 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:26:35.533653 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:26:35.533653 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:26:35.533653 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 14 09:26:35.533653 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 14 09:26:35.533653 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 14 09:26:35.533653 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 14 09:26:35.533653 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 14 09:26:35.533653 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 14 09:26:35.541110 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 14 09:26:35.541110 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:26:35.541110 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:26:35.541110 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:26:35.541110 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:26:35.541110 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:26:35.541110 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:26:35.541110 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 14 09:26:35.541110 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 14 09:26:35.541110 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 14 09:26:35.541110 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:26:35.541110 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-70b12aad-6f8e-457a-aaa9-3f427d441f60 tempest-VolumesNegativeTest-1356367859 tempest-VolumesNegativeTest-1356367859-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:26:35.541110 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-70b12aad-6f8e-457a-aaa9-3f427d441f60 tempest-VolumesNegativeTest-1356367859 tempest-VolumesNegativeTest-1356367859-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009602 Sep 14 09:26:35.541110 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3047/6118] 10.222.0.60 () {60 vars in 1156 bytes} [Wed Sep 14 09:26:35 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 14 09:26:35.548454 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1f442b80-cfe2-49b6-ae94-5410de28b045 tempest-VolumesNegativeTest-1356367859 tempest-VolumesNegativeTest-1356367859-project] Action: 'create', calling method: .version_select at 0x7f7d444780d0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-850557144", "metadata": {"Type": "work"}}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:26:35.552036 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1f442b80-cfe2-49b6-ae94-5410de28b045 tempest-VolumesNegativeTest-1356367859 tempest-VolumesNegativeTest-1356367859-project] Request method failure captured: Sep 14 09:26:35.552036 n-d-836830-18 devstack@n-api.service[128758]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 14 09:26:35.552036 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 09:26:35.552036 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 09:26:35.552036 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 09:26:35.552036 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 118 Sep 14 09:26:35.552036 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 09:26:35.552036 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 09:26:35.552036 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 09:26:35.552036 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 09:26:35.552036 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZ5LlCfABo3-nJlg75gykDK3opoNTipPfA0ERcY2ADhLBiNZ4isW6WUmRvFi40B2VmAIDCWcBUv7twXwWTv27M22_0-ybD279Ur_IlUCr1oj7raKH1aqdDGIeUiKb0UHF9vv9uL1zU_dOBI2UM9UKUVShmqDRxSCVGyqsATepznFcus Sep 14 09:26:35.552036 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 09:26:35.552036 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 09:26:35.552036 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 09:26:35.552036 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 09:26:35.552036 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 09:26:35.552036 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 09:26:35.552036 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 10f04bd1d36642b48d1afd891f9d69a9 Sep 14 09:26:35.552036 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-VolumesNegativeTest-1356367859 Sep 14 09:26:35.552036 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 09:26:35.552036 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 09:26:35.552036 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/10f04bd1d36642b48d1afd891f9d69a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_10f04bd1d36642b48d1afd891f9d69a9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/10f04bd1d36642b48d1afd891f9d69a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/10f04bd1d36642b48d1afd891f9d69a9"}]}] Sep 14 09:26:35.552036 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-VolumesNegativeTest-1356367859 Sep 14 09:26:35.552036 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 10f04bd1d36642b48d1afd891f9d69a9 Sep 14 09:26:35.552036 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-VolumesNegativeTest-1356367859 Sep 14 09:26:35.552036 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-VolumesNegativeTest-1356367859-project Sep 14 09:26:35.552036 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 09:26:35.552036 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 09:26:35.552036 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 4f0cbaf3f31f42928626872a10c6e49e Sep 14 09:26:35.552036 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-VolumesNegativeTest-1356367859-project Sep 14 09:26:35.552036 n-d-836830-18 devstack@n-api.service[128758]: Sep 14 09:26:35.552036 n-d-836830-18 devstack@n-api.service[128758]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-850557144", "metadata": {"Type": "work"}}} Sep 14 09:26:35.552036 n-d-836830-18 devstack@n-api.service[128758]: method: Sep 14 09:26:35.552036 n-d-836830-18 devstack@n-api.service[128758]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 14 09:26:35.552036 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-850557144', 'metadata': {'Type': 'work'}}}} Sep 14 09:26:35.552036 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:26:35.552036 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:26:35.552036 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 14 09:26:35.552036 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 14 09:26:35.552036 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 14 09:26:35.552036 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise error Sep 14 09:26:35.552036 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 14 09:26:35.552036 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:26:35.552036 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 14 09:26:35.552036 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 14 09:26:35.552036 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:26:35.552036 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 14 09:26:35.552036 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi '' Sep 14 09:26:35.552036 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:26:35.552036 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:26:35.552036 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:26:35.552036 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:26:35.552036 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:26:35.552036 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:26:35.552036 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:26:35.552036 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:26:35.552036 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:26:35.552036 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:26:35.552036 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:26:35.552036 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:26:35.552036 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 14 09:26:35.552036 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 14 09:26:35.552036 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 14 09:26:35.552036 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 14 09:26:35.552036 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 14 09:26:35.552036 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 14 09:26:35.556255 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 14 09:26:35.556255 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:26:35.556255 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:26:35.556255 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:26:35.556255 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:26:35.556255 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:26:35.556255 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:26:35.556255 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 14 09:26:35.556255 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 14 09:26:35.556255 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 14 09:26:35.556255 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:26:35.556255 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1f442b80-cfe2-49b6-ae94-5410de28b045 tempest-VolumesNegativeTest-1356367859 tempest-VolumesNegativeTest-1356367859-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:26:35.556255 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-1f442b80-cfe2-49b6-ae94-5410de28b045 tempest-VolumesNegativeTest-1356367859 tempest-VolumesNegativeTest-1356367859-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010067 Sep 14 09:26:35.556255 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3072/6119] 10.222.0.60 () {60 vars in 1156 bytes} [Wed Sep 14 09:26:35 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 14 09:26:35.564297 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-6cd093a3-3399-4666-86ad-c1d001f7364e tempest-VolumesNegativeTest-1356367859 tempest-VolumesNegativeTest-1356367859-project] Calling method '.version_select at 0x7f7d48665310>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:35.599927 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-6cd093a3-3399-4666-86ad-c1d001f7364e tempest-VolumesNegativeTest-1356367859 tempest-VolumesNegativeTest-1356367859-project] HTTP exception thrown: Volume tempest-invalid-227402288 could not be found. Sep 14 09:26:35.601892 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-6cd093a3-3399-4666-86ad-c1d001f7364e tempest-VolumesNegativeTest-1356367859 tempest-VolumesNegativeTest-1356367859-project] Request method failure captured: Sep 14 09:26:35.601892 n-d-836830-18 devstack@n-api.service[128759]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-227402288 HTTP/1.1 Sep 14 09:26:35.601892 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:26:35.601892 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:26:35.601892 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:26:35.601892 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:26:35.601892 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:26:35.601892 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:26:35.601892 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:26:35.601892 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:26:35.601892 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZ5LlCfABo3-nJlg75gykDK3opoNTipPfA0ERcY2ADhLBiNZ4isW6WUmRvFi40B2VmAIDCWcBUv7twXwWTv27M22_0-ybD279Ur_IlUCr1oj7raKH1aqdDGIeUiKb0UHF9vv9uL1zU_dOBI2UM9UKUVShmqDRxSCVGyqsATepznFcus Sep 14 09:26:35.601892 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:26:35.601892 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:26:35.601892 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:26:35.601892 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:26:35.601892 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:26:35.601892 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:26:35.601892 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 10f04bd1d36642b48d1afd891f9d69a9 Sep 14 09:26:35.601892 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-VolumesNegativeTest-1356367859 Sep 14 09:26:35.601892 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:26:35.601892 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:26:35.601892 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/10f04bd1d36642b48d1afd891f9d69a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_10f04bd1d36642b48d1afd891f9d69a9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/10f04bd1d36642b48d1afd891f9d69a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/10f04bd1d36642b48d1afd891f9d69a9"}]}] Sep 14 09:26:35.601892 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-VolumesNegativeTest-1356367859 Sep 14 09:26:35.601892 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 10f04bd1d36642b48d1afd891f9d69a9 Sep 14 09:26:35.601892 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-VolumesNegativeTest-1356367859 Sep 14 09:26:35.601892 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-VolumesNegativeTest-1356367859-project Sep 14 09:26:35.601892 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:26:35.601892 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:26:35.601892 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 4f0cbaf3f31f42928626872a10c6e49e Sep 14 09:26:35.601892 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-VolumesNegativeTest-1356367859-project Sep 14 09:26:35.601892 n-d-836830-18 devstack@n-api.service[128759]: method: Sep 14 09:26:35.601892 n-d-836830-18 devstack@n-api.service[128759]: exception: Volume tempest-invalid-227402288 could not be found. Sep 14 09:26:35.601892 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': 'tempest-invalid-227402288'} Sep 14 09:26:35.601892 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:26:35.601892 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:26:35.601892 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 14 09:26:35.601892 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 14 09:26:35.601892 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 14 09:26:35.601892 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 14 09:26:35.601892 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 14 09:26:35.601892 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 14 09:26:35.601892 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 14 09:26:35.601892 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 14 09:26:35.601892 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 14 09:26:35.601892 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 14 09:26:35.601892 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 14 09:26:35.601892 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 14 09:26:35.601892 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 14 09:26:35.601892 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 14 09:26:35.601892 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-227402288 could not be found. (HTTP 404) (Request-ID: req-572e2b0c-bfdc-477a-828d-7776357c6422) Sep 14 09:26:35.601892 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:26:35.601892 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:26:35.601892 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:26:35.601892 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:26:35.601892 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 14 09:26:35.601892 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 14 09:26:35.601892 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 14 09:26:35.601892 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 14 09:26:35.601892 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 14 09:26:35.601892 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 14 09:26:35.601892 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 14 09:26:35.601892 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 14 09:26:35.601892 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 14 09:26:35.606353 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 14 09:26:35.606353 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 14 09:26:35.606353 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 14 09:26:35.606353 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 14 09:26:35.606353 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 14 09:26:35.606353 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 14 09:26:35.606353 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 14 09:26:35.606353 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 14 09:26:35.606353 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 14 09:26:35.606353 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 14 09:26:35.606353 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 14 09:26:35.606353 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 14 09:26:35.606353 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 14 09:26:35.606353 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-227402288 could not be found. Sep 14 09:26:35.606353 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:26:35.606353 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:26:35.606353 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:26:35.606353 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:26:35.606353 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:26:35.606353 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:26:35.606353 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:26:35.606353 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:26:35.606353 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:26:35.606353 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:26:35.606353 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:26:35.606353 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:26:35.606353 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 14 09:26:35.606353 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:26:35.606353 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-227402288 could not be found. Sep 14 09:26:35.606353 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:26:35.606353 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:26:35.606353 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:26:35.606353 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:26:35.606353 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:26:35.606353 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:26:35.606353 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:26:35.606353 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:26:35.606353 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-227402288 could not be found. Sep 14 09:26:35.606353 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:26:35.606353 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-6cd093a3-3399-4666-86ad-c1d001f7364e tempest-VolumesNegativeTest-1356367859 tempest-VolumesNegativeTest-1356367859-project] Returning 404 to user: Volume tempest-invalid-227402288 could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:26:35.606353 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-6cd093a3-3399-4666-86ad-c1d001f7364e tempest-VolumesNegativeTest-1356367859 tempest-VolumesNegativeTest-1356367859-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/tempest-invalid-227402288" status: 404 len: 98 microversion: 2.1 time: 0.042889 Sep 14 09:26:35.609390 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3048/6120] 10.222.0.60 () {58 vars in 1215 bytes} [Wed Sep 14 09:26:35 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-227402288 => generated 98 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 14 09:26:35.614201 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-eb9f0dee-7d59-49d3-8f8b-37c7a2204ded tempest-VolumesNegativeTest-1356367859 tempest-VolumesNegativeTest-1356367859-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003871 Sep 14 09:26:35.614783 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3073/6121] 10.222.0.60 () {58 vars in 1140 bytes} [Wed Sep 14 09:26:35 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 14 09:26:35.624391 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-ab4f0a5b-7f19-4af8-a9c4-e8162911ce96 tempest-VolumesNegativeTest-1356367859 tempest-VolumesNegativeTest-1356367859-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003825 Sep 14 09:26:35.624899 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3049/6122] 10.222.0.60 () {58 vars in 1137 bytes} [Wed Sep 14 09:26:35 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 14 09:26:35.633945 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b8a9f048-d3ab-4eb4-8ff7-3efe2ce81082 tempest-VolumesNegativeTest-1356367859 tempest-VolumesNegativeTest-1356367859-project] Calling method '.version_select at 0x7f7d4449ef70>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:35.663490 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-b8a9f048-d3ab-4eb4-8ff7-3efe2ce81082 tempest-VolumesNegativeTest-1356367859 tempest-VolumesNegativeTest-1356367859-project] HTTP exception thrown: Volume c9b1e956-ac13-46a9-b346-222675d98323 could not be found. Sep 14 09:26:35.665700 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b8a9f048-d3ab-4eb4-8ff7-3efe2ce81082 tempest-VolumesNegativeTest-1356367859 tempest-VolumesNegativeTest-1356367859-project] Request method failure captured: Sep 14 09:26:35.665700 n-d-836830-18 devstack@n-api.service[128758]: request: DELETE /compute/v2.1/os-volumes/c9b1e956-ac13-46a9-b346-222675d98323 HTTP/1.1 Sep 14 09:26:35.665700 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 09:26:35.665700 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 09:26:35.665700 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 09:26:35.665700 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 09:26:35.665700 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 09:26:35.665700 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 09:26:35.665700 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 09:26:35.665700 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 09:26:35.665700 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZ5LlCfABo3-nJlg75gykDK3opoNTipPfA0ERcY2ADhLBiNZ4isW6WUmRvFi40B2VmAIDCWcBUv7twXwWTv27M22_0-ybD279Ur_IlUCr1oj7raKH1aqdDGIeUiKb0UHF9vv9uL1zU_dOBI2UM9UKUVShmqDRxSCVGyqsATepznFcus Sep 14 09:26:35.665700 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 09:26:35.665700 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 09:26:35.665700 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 09:26:35.665700 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 09:26:35.665700 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 09:26:35.665700 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 09:26:35.665700 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 10f04bd1d36642b48d1afd891f9d69a9 Sep 14 09:26:35.665700 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-VolumesNegativeTest-1356367859 Sep 14 09:26:35.665700 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 09:26:35.665700 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 09:26:35.665700 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/10f04bd1d36642b48d1afd891f9d69a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_10f04bd1d36642b48d1afd891f9d69a9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/10f04bd1d36642b48d1afd891f9d69a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/10f04bd1d36642b48d1afd891f9d69a9"}]}] Sep 14 09:26:35.665700 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-VolumesNegativeTest-1356367859 Sep 14 09:26:35.665700 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 10f04bd1d36642b48d1afd891f9d69a9 Sep 14 09:26:35.665700 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-VolumesNegativeTest-1356367859 Sep 14 09:26:35.665700 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-VolumesNegativeTest-1356367859-project Sep 14 09:26:35.665700 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 09:26:35.665700 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 09:26:35.665700 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 4f0cbaf3f31f42928626872a10c6e49e Sep 14 09:26:35.665700 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-VolumesNegativeTest-1356367859-project Sep 14 09:26:35.665700 n-d-836830-18 devstack@n-api.service[128758]: method: Sep 14 09:26:35.665700 n-d-836830-18 devstack@n-api.service[128758]: exception: Volume c9b1e956-ac13-46a9-b346-222675d98323 could not be found. Sep 14 09:26:35.665700 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': 'c9b1e956-ac13-46a9-b346-222675d98323'} Sep 14 09:26:35.665700 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:26:35.665700 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:26:35.665700 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 14 09:26:35.665700 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 14 09:26:35.665700 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 14 09:26:35.665700 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 14 09:26:35.665700 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 14 09:26:35.665700 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 14 09:26:35.665700 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 14 09:26:35.665700 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 14 09:26:35.665700 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 14 09:26:35.665700 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 14 09:26:35.665700 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 14 09:26:35.665700 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 14 09:26:35.665700 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 14 09:26:35.665700 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 14 09:26:35.665700 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c9b1e956-ac13-46a9-b346-222675d98323 could not be found. (HTTP 404) (Request-ID: req-d712437c-c179-441a-9393-bb088d143c81) Sep 14 09:26:35.665700 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:26:35.665700 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:26:35.665700 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:26:35.665700 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:26:35.665700 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 14 09:26:35.665700 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 14 09:26:35.665700 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 14 09:26:35.665700 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 14 09:26:35.665700 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 14 09:26:35.665700 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 14 09:26:35.665700 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 14 09:26:35.665700 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 14 09:26:35.665700 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 14 09:26:35.669783 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 14 09:26:35.669783 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 14 09:26:35.669783 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 14 09:26:35.669783 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 14 09:26:35.669783 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 14 09:26:35.669783 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 14 09:26:35.669783 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 14 09:26:35.669783 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 14 09:26:35.669783 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 14 09:26:35.669783 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 14 09:26:35.669783 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 14 09:26:35.669783 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 14 09:26:35.669783 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 14 09:26:35.669783 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c9b1e956-ac13-46a9-b346-222675d98323 could not be found. Sep 14 09:26:35.669783 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:26:35.669783 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:26:35.669783 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:26:35.669783 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:26:35.669783 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:26:35.669783 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:26:35.669783 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:26:35.669783 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:26:35.669783 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:26:35.669783 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:26:35.669783 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:26:35.669783 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:26:35.669783 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 14 09:26:35.669783 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:26:35.669783 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c9b1e956-ac13-46a9-b346-222675d98323 could not be found. Sep 14 09:26:35.669783 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:26:35.669783 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:26:35.669783 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:26:35.669783 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:26:35.669783 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:26:35.669783 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:26:35.669783 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:26:35.669783 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:26:35.669783 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c9b1e956-ac13-46a9-b346-222675d98323 could not be found. Sep 14 09:26:35.669783 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:26:35.669783 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b8a9f048-d3ab-4eb4-8ff7-3efe2ce81082 tempest-VolumesNegativeTest-1356367859 tempest-VolumesNegativeTest-1356367859-project] Returning 404 to user: Volume c9b1e956-ac13-46a9-b346-222675d98323 could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:26:35.669783 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-b8a9f048-d3ab-4eb4-8ff7-3efe2ce81082 tempest-VolumesNegativeTest-1356367859 tempest-VolumesNegativeTest-1356367859-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/c9b1e956-ac13-46a9-b346-222675d98323" status: 404 len: 109 microversion: 2.1 time: 0.038940 Sep 14 09:26:35.669783 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3074/6123] 10.222.0.60 () {58 vars in 1248 bytes} [Wed Sep 14 09:26:35 2022] DELETE /compute/v2.1/os-volumes/c9b1e956-ac13-46a9-b346-222675d98323 => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:26:35.678658 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-34a09c3e-108a-4194-9236-e88a384d78f4 tempest-VolumesNegativeTest-1356367859 tempest-VolumesNegativeTest-1356367859-project] Calling method '.version_select at 0x7f7d486cfdc0>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:35.708485 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-34a09c3e-108a-4194-9236-e88a384d78f4 tempest-VolumesNegativeTest-1356367859 tempest-VolumesNegativeTest-1356367859-project] HTTP exception thrown: Volume 14e4d7af-653c-408c-a11e-728726a6149f could not be found. Sep 14 09:26:35.711352 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-34a09c3e-108a-4194-9236-e88a384d78f4 tempest-VolumesNegativeTest-1356367859 tempest-VolumesNegativeTest-1356367859-project] Request method failure captured: Sep 14 09:26:35.711352 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/os-volumes/14e4d7af-653c-408c-a11e-728726a6149f HTTP/1.1 Sep 14 09:26:35.711352 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:26:35.711352 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:26:35.711352 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:26:35.711352 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:26:35.711352 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:26:35.711352 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:26:35.711352 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:26:35.711352 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:26:35.711352 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZ5LlCfABo3-nJlg75gykDK3opoNTipPfA0ERcY2ADhLBiNZ4isW6WUmRvFi40B2VmAIDCWcBUv7twXwWTv27M22_0-ybD279Ur_IlUCr1oj7raKH1aqdDGIeUiKb0UHF9vv9uL1zU_dOBI2UM9UKUVShmqDRxSCVGyqsATepznFcus Sep 14 09:26:35.711352 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:26:35.711352 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:26:35.711352 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:26:35.711352 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:26:35.711352 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:26:35.711352 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:26:35.711352 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 10f04bd1d36642b48d1afd891f9d69a9 Sep 14 09:26:35.711352 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-VolumesNegativeTest-1356367859 Sep 14 09:26:35.711352 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:26:35.711352 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:26:35.711352 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/10f04bd1d36642b48d1afd891f9d69a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_10f04bd1d36642b48d1afd891f9d69a9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/10f04bd1d36642b48d1afd891f9d69a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/10f04bd1d36642b48d1afd891f9d69a9"}]}] Sep 14 09:26:35.711352 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-VolumesNegativeTest-1356367859 Sep 14 09:26:35.711352 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 10f04bd1d36642b48d1afd891f9d69a9 Sep 14 09:26:35.711352 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-VolumesNegativeTest-1356367859 Sep 14 09:26:35.711352 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-VolumesNegativeTest-1356367859-project Sep 14 09:26:35.711352 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:26:35.711352 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:26:35.711352 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 4f0cbaf3f31f42928626872a10c6e49e Sep 14 09:26:35.711352 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-VolumesNegativeTest-1356367859-project Sep 14 09:26:35.711352 n-d-836830-18 devstack@n-api.service[128759]: method: Sep 14 09:26:35.711352 n-d-836830-18 devstack@n-api.service[128759]: exception: Volume 14e4d7af-653c-408c-a11e-728726a6149f could not be found. Sep 14 09:26:35.711352 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '14e4d7af-653c-408c-a11e-728726a6149f'} Sep 14 09:26:35.711352 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:26:35.711352 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:26:35.711352 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 14 09:26:35.711352 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 14 09:26:35.711352 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 14 09:26:35.711352 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 14 09:26:35.711352 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 14 09:26:35.711352 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 14 09:26:35.711352 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 14 09:26:35.711352 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 14 09:26:35.711352 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 14 09:26:35.711352 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 14 09:26:35.711352 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 14 09:26:35.711352 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 14 09:26:35.711352 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 14 09:26:35.711352 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 14 09:26:35.711352 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 14e4d7af-653c-408c-a11e-728726a6149f could not be found. (HTTP 404) (Request-ID: req-723f5864-22bb-4b0e-912f-5c9ce7566fcf) Sep 14 09:26:35.711352 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:26:35.711352 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:26:35.711352 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:26:35.711352 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:26:35.711352 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 14 09:26:35.711352 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 14 09:26:35.711352 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 14 09:26:35.711352 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 14 09:26:35.711352 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 14 09:26:35.711352 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 14 09:26:35.711352 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 14 09:26:35.711352 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 14 09:26:35.711352 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 14 09:26:35.715833 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 14 09:26:35.715833 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 14 09:26:35.715833 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 14 09:26:35.715833 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 14 09:26:35.715833 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 14 09:26:35.715833 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 14 09:26:35.715833 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 14 09:26:35.715833 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 14 09:26:35.715833 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 14 09:26:35.715833 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 14 09:26:35.715833 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 14 09:26:35.715833 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 14 09:26:35.715833 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 14 09:26:35.715833 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 14e4d7af-653c-408c-a11e-728726a6149f could not be found. Sep 14 09:26:35.715833 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:26:35.715833 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:26:35.715833 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:26:35.715833 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:26:35.715833 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:26:35.715833 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:26:35.715833 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:26:35.715833 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:26:35.715833 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:26:35.715833 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:26:35.715833 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:26:35.715833 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:26:35.715833 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 14 09:26:35.715833 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:26:35.715833 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 14e4d7af-653c-408c-a11e-728726a6149f could not be found. Sep 14 09:26:35.715833 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:26:35.715833 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:26:35.715833 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:26:35.715833 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:26:35.715833 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:26:35.715833 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:26:35.715833 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:26:35.715833 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:26:35.715833 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 14e4d7af-653c-408c-a11e-728726a6149f could not be found. Sep 14 09:26:35.715833 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:26:35.715833 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-34a09c3e-108a-4194-9236-e88a384d78f4 tempest-VolumesNegativeTest-1356367859 tempest-VolumesNegativeTest-1356367859-project] Returning 404 to user: Volume 14e4d7af-653c-408c-a11e-728726a6149f could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:26:35.715833 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-34a09c3e-108a-4194-9236-e88a384d78f4 tempest-VolumesNegativeTest-1356367859 tempest-VolumesNegativeTest-1356367859-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/14e4d7af-653c-408c-a11e-728726a6149f" status: 404 len: 109 microversion: 2.1 time: 0.038526 Sep 14 09:26:35.715833 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3050/6124] 10.222.0.60 () {58 vars in 1245 bytes} [Wed Sep 14 09:26:35 2022] GET /compute/v2.1/os-volumes/14e4d7af-653c-408c-a11e-728726a6149f => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:28:50.222041 n-d-836830-18 devstack@n-api.service[128758]: ERROR oslo.messaging._drivers.impl_rabbit [-] [57e2b41d-7c54-48cb-b191-b7f77db67cfb] AMQP server on 10.222.0.60:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 14 09:28:50.223945 n-d-836830-18 devstack@n-api.service[128758]: ERROR oslo.messaging._drivers.impl_rabbit [-] [33d7e4a6-539b-476c-bc18-5478ca3a22f4] AMQP server on 10.222.0.60:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 14 09:28:50.224681 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:28:50.225905 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:28:50.227457 n-d-836830-18 devstack@n-api.service[128758]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 14 09:28:50.227906 n-d-836830-18 devstack@n-api.service[128758]: Wed Sep 14 09:28:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d727e6d2-dc0c-4ee3-9d0f-999d1a4307fa (ip 10.222.0.60) !!! Sep 14 09:28:50.229316 n-d-836830-18 devstack@n-api.service[128758]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 14 09:28:50.229595 n-d-836830-18 devstack@n-api.service[128758]: Wed Sep 14 09:28:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d727e6d2-dc0c-4ee3-9d0f-999d1a4307fa (ip 10.222.0.60) !!! Sep 14 09:28:50.230974 n-d-836830-18 devstack@n-api.service[128758]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 14 09:28:50.231162 n-d-836830-18 devstack@n-api.service[128758]: Wed Sep 14 09:28:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d727e6d2-dc0c-4ee3-9d0f-999d1a4307fa (ip 10.222.0.60) !!! Sep 14 09:28:50.239407 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-50ceb147-85c0-44aa-8c03-18ee3765e3c1 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:28:50.239917 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-50ceb147-85c0-44aa-8c03-18ee3765e3c1 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] [instance: d727e6d2-dc0c-4ee3-9d0f-999d1a4307fa] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:28:50.253150 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-50ceb147-85c0-44aa-8c03-18ee3765e3c1 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:50.254177 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-50ceb147-85c0-44aa-8c03-18ee3765e3c1 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:50.254634 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-50ceb147-85c0-44aa-8c03-18ee3765e3c1 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:50.255854 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-50ceb147-85c0-44aa-8c03-18ee3765e3c1 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:50.255984 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-50ceb147-85c0-44aa-8c03-18ee3765e3c1 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:50.256341 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-50ceb147-85c0-44aa-8c03-18ee3765e3c1 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:50.293204 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-50ceb147-85c0-44aa-8c03-18ee3765e3c1 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] [instance: d727e6d2-dc0c-4ee3-9d0f-999d1a4307fa] Going to try to terminate instance {{(pid=128758) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:28:50.432353 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-50ceb147-85c0-44aa-8c03-18ee3765e3c1 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] 10.222.0.60 "DELETE /compute/v2.1/servers/d727e6d2-dc0c-4ee3-9d0f-999d1a4307fa" status: 204 len: 0 microversion: 2.1 time: 0.213803 Sep 14 09:28:50.432882 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3075/6125] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:28:50 2022] DELETE /compute/v2.1/servers/d727e6d2-dc0c-4ee3-9d0f-999d1a4307fa => generated 0 bytes in 215 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:28:50.440181 n-d-836830-18 devstack@n-api.service[128759]: ERROR oslo.messaging._drivers.impl_rabbit [-] [22ef38d2-af78-43f4-be77-ac372bc70aea] AMQP server on 10.222.0.60:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 14 09:28:50.441906 n-d-836830-18 devstack@n-api.service[128759]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fe2cf8e3-40e5-4586-b96b-b3e5ef0901e5] AMQP server on 10.222.0.60:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Sep 14 09:28:50.442584 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=23,nova_api:DELETE=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:28:50.444229 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=54,nova_cell1:INSERT=2 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:28:50.449322 n-d-836830-18 devstack@n-api.service[128759]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 14 09:28:50.449789 n-d-836830-18 devstack@n-api.service[128759]: Wed Sep 14 09:28:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d727e6d2-dc0c-4ee3-9d0f-999d1a4307fa (ip 10.222.0.60) !!! Sep 14 09:28:50.451671 n-d-836830-18 devstack@n-api.service[128759]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 14 09:28:50.451942 n-d-836830-18 devstack@n-api.service[128759]: Wed Sep 14 09:28:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d727e6d2-dc0c-4ee3-9d0f-999d1a4307fa (ip 10.222.0.60) !!! Sep 14 09:28:50.462475 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9b60dc47-ea87-45de-a937-bf1f14b04c02 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:28:50.464666 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-9b60dc47-ea87-45de-a937-bf1f14b04c02 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] [instance: d727e6d2-dc0c-4ee3-9d0f-999d1a4307fa] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:28:50.479598 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9b60dc47-ea87-45de-a937-bf1f14b04c02 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:50.480091 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9b60dc47-ea87-45de-a937-bf1f14b04c02 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:50.480528 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9b60dc47-ea87-45de-a937-bf1f14b04c02 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:50.481421 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9b60dc47-ea87-45de-a937-bf1f14b04c02 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:50.482055 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9b60dc47-ea87-45de-a937-bf1f14b04c02 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:50.482643 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9b60dc47-ea87-45de-a937-bf1f14b04c02 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:51.016386 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-9b60dc47-ea87-45de-a937-bf1f14b04c02 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0ed82129324c07a8c4158d207fcc4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cd8586b239f4f13a775a0465b9271a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:28:51.030039 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-9b60dc47-ea87-45de-a937-bf1f14b04c02 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] 10.222.0.60 "GET /compute/v2.1/servers/d727e6d2-dc0c-4ee3-9d0f-999d1a4307fa" status: 200 len: 1733 microversion: 2.1 time: 0.592165 Sep 14 09:28:51.031248 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3051/6126] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:28:50 2022] GET /compute/v2.1/servers/d727e6d2-dc0c-4ee3-9d0f-999d1a4307fa => generated 1733 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:28:52.055484 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-7cda1782-86f7-4cd7-85c3-14c7ba7f8384 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:28:52.056195 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-7cda1782-86f7-4cd7-85c3-14c7ba7f8384 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] [instance: d727e6d2-dc0c-4ee3-9d0f-999d1a4307fa] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:28:52.084425 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7cda1782-86f7-4cd7-85c3-14c7ba7f8384 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:52.085309 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7cda1782-86f7-4cd7-85c3-14c7ba7f8384 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:52.086240 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7cda1782-86f7-4cd7-85c3-14c7ba7f8384 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:52.087292 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7cda1782-86f7-4cd7-85c3-14c7ba7f8384 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:52.090079 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7cda1782-86f7-4cd7-85c3-14c7ba7f8384 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:52.095341 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7cda1782-86f7-4cd7-85c3-14c7ba7f8384 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:52.099085 n-d-836830-18 devstack@n-api.service[128758]: INFO oslo.messaging._drivers.impl_rabbit [-] [57e2b41d-7c54-48cb-b191-b7f77db67cfb] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 40444. Sep 14 09:28:52.166775 n-d-836830-18 devstack@n-api.service[128758]: INFO oslo.messaging._drivers.impl_rabbit [-] [33d7e4a6-539b-476c-bc18-5478ca3a22f4] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 40446. Sep 14 09:28:52.800192 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-7cda1782-86f7-4cd7-85c3-14c7ba7f8384 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0ed82129324c07a8c4158d207fcc4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cd8586b239f4f13a775a0465b9271a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:28:52.816785 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-7cda1782-86f7-4cd7-85c3-14c7ba7f8384 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] 10.222.0.60 "GET /compute/v2.1/servers/d727e6d2-dc0c-4ee3-9d0f-999d1a4307fa" status: 200 len: 1733 microversion: 2.1 time: 0.764306 Sep 14 09:28:52.818505 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3076/6127] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:28:52 2022] GET /compute/v2.1/servers/d727e6d2-dc0c-4ee3-9d0f-999d1a4307fa => generated 1733 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:28:53.644176 n-d-836830-18 devstack@n-api.service[128759]: INFO oslo.messaging._drivers.impl_rabbit [-] [fe2cf8e3-40e5-4586-b96b-b3e5ef0901e5] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 40474. Sep 14 09:28:53.651052 n-d-836830-18 devstack@n-api.service[128759]: INFO oslo.messaging._drivers.impl_rabbit [-] [22ef38d2-af78-43f4-be77-ac372bc70aea] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 40472. Sep 14 09:28:53.849202 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-cce68652-fe15-4c89-82ad-4db481e940d7 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:28:53.849749 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-cce68652-fe15-4c89-82ad-4db481e940d7 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] [instance: d727e6d2-dc0c-4ee3-9d0f-999d1a4307fa] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:28:53.871534 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cce68652-fe15-4c89-82ad-4db481e940d7 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:53.876383 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cce68652-fe15-4c89-82ad-4db481e940d7 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:53.877070 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cce68652-fe15-4c89-82ad-4db481e940d7 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:53.878351 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cce68652-fe15-4c89-82ad-4db481e940d7 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:53.883844 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cce68652-fe15-4c89-82ad-4db481e940d7 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:53.887167 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cce68652-fe15-4c89-82ad-4db481e940d7 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:53.947781 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-73ced74d-00aa-4ba1-816b-2a57ffafb130 req-f29a3c77-d777-40fc-bb71-824768803c50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d727e6d2-dc0c-4ee3-9d0f-999d1a4307fa", "name": "network-vif-deleted", "tag": "e80a892b-147a-4c93-949d-38ec11071f4c"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:28:53.965679 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cce68652-fe15-4c89-82ad-4db481e940d7 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:53.966579 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cce68652-fe15-4c89-82ad-4db481e940d7 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:53.967224 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cce68652-fe15-4c89-82ad-4db481e940d7 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:53.967876 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.objects.instance [None req-cce68652-fe15-4c89-82ad-4db481e940d7 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Lazy-loading 'fault' on Instance uuid d727e6d2-dc0c-4ee3-9d0f-999d1a4307fa {{(pid=128758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:28:53.981396 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-73ced74d-00aa-4ba1-816b-2a57ffafb130 req-f29a3c77-d777-40fc-bb71-824768803c50 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:53.982127 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-73ced74d-00aa-4ba1-816b-2a57ffafb130 req-f29a3c77-d777-40fc-bb71-824768803c50 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:53.985979 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-73ced74d-00aa-4ba1-816b-2a57ffafb130 req-f29a3c77-d777-40fc-bb71-824768803c50 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:54.005287 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-73ced74d-00aa-4ba1-816b-2a57ffafb130 req-f29a3c77-d777-40fc-bb71-824768803c50 service nova] Creating event network-vif-deleted:e80a892b-147a-4c93-949d-38ec11071f4c for instance d727e6d2-dc0c-4ee3-9d0f-999d1a4307fa on n-h2-836830-18 Sep 14 09:28:54.025122 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-73ced74d-00aa-4ba1-816b-2a57ffafb130 req-f29a3c77-d777-40fc-bb71-824768803c50 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.405184 Sep 14 09:28:54.029117 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3052/6128] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:28:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:28:54.411540 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-cce68652-fe15-4c89-82ad-4db481e940d7 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0ed82129324c07a8c4158d207fcc4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cd8586b239f4f13a775a0465b9271a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:28:54.436359 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-cce68652-fe15-4c89-82ad-4db481e940d7 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] 10.222.0.60 "GET /compute/v2.1/servers/d727e6d2-dc0c-4ee3-9d0f-999d1a4307fa" status: 200 len: 1388 microversion: 2.1 time: 0.598850 Sep 14 09:28:54.437482 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3077/6129] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:28:53 2022] GET /compute/v2.1/servers/d727e6d2-dc0c-4ee3-9d0f-999d1a4307fa => generated 1388 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:28:55.463794 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-efa39352-8c19-4ef6-8432-9d528a70519c tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:28:55.465561 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-efa39352-8c19-4ef6-8432-9d528a70519c tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] [instance: d727e6d2-dc0c-4ee3-9d0f-999d1a4307fa] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:28:55.489270 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-efa39352-8c19-4ef6-8432-9d528a70519c tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:55.490003 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-efa39352-8c19-4ef6-8432-9d528a70519c tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:55.490679 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-efa39352-8c19-4ef6-8432-9d528a70519c tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:55.491683 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-efa39352-8c19-4ef6-8432-9d528a70519c tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:55.492376 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-efa39352-8c19-4ef6-8432-9d528a70519c tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:55.493027 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-efa39352-8c19-4ef6-8432-9d528a70519c tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:55.512154 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-efa39352-8c19-4ef6-8432-9d528a70519c tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] HTTP exception thrown: Instance d727e6d2-dc0c-4ee3-9d0f-999d1a4307fa could not be found. Sep 14 09:28:55.517351 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-efa39352-8c19-4ef6-8432-9d528a70519c tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Request method failure captured: Sep 14 09:28:55.517351 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/d727e6d2-dc0c-4ee3-9d0f-999d1a4307fa HTTP/1.1 Sep 14 09:28:55.517351 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:28:55.517351 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:28:55.517351 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:28:55.517351 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:28:55.517351 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:28:55.517351 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:28:55.517351 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:28:55.517351 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:28:55.517351 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZ2eRXU_X03YDG1NcV15mXBLiRZpb8zUvd-rA-9lXio6CaadDIKyt3uQQZZ_2S9Z51f4QpmEXgsK5CrG4CGOJI4l12wvQYGoWDGexuTMbHcszIiPqWXhinaGseOh_Fb2Snu2oTyXDA6V7fSH3doljwRGog_spNswJjI6COkz-KKO_QM Sep 14 09:28:55.517351 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:28:55.517351 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:28:55.517351 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:28:55.517351 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:28:55.517351 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:28:55.517351 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:28:55.517351 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 1cd8586b239f4f13a775a0465b9271a0 Sep 14 09:28:55.517351 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-TestServerBasicOps-521196554 Sep 14 09:28:55.517351 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:28:55.517351 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:28:55.517351 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/1cd8586b239f4f13a775a0465b9271a0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_1cd8586b239f4f13a775a0465b9271a0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1cd8586b239f4f13a775a0465b9271a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1cd8586b239f4f13a775a0465b9271a0"}]}] Sep 14 09:28:55.517351 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-TestServerBasicOps-521196554 Sep 14 09:28:55.517351 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 1cd8586b239f4f13a775a0465b9271a0 Sep 14 09:28:55.517351 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-TestServerBasicOps-521196554 Sep 14 09:28:55.517351 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-TestServerBasicOps-521196554-project Sep 14 09:28:55.517351 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:28:55.517351 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:28:55.517351 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 7f0ed82129324c07a8c4158d207fcc4e Sep 14 09:28:55.517351 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-TestServerBasicOps-521196554-project Sep 14 09:28:55.517351 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:28:55.517351 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance d727e6d2-dc0c-4ee3-9d0f-999d1a4307fa could not be found. Sep 14 09:28:55.517351 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': 'd727e6d2-dc0c-4ee3-9d0f-999d1a4307fa'} Sep 14 09:28:55.517351 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:28:55.517351 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:28:55.517351 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:28:55.517351 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:28:55.517351 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:28:55.517351 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:28:55.517351 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:28:55.517351 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:28:55.517351 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:28:55.517351 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:28:55.517351 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d727e6d2-dc0c-4ee3-9d0f-999d1a4307fa could not be found. Sep 14 09:28:55.517351 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:28:55.517351 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:28:55.517351 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:28:55.517351 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:28:55.517351 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:28:55.517351 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:28:55.517351 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:28:55.517351 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:28:55.517351 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:28:55.517351 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:28:55.517351 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:28:55.517351 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:28:55.517351 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:28:55.517351 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:28:55.517351 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:28:55.517351 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:28:55.517351 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d727e6d2-dc0c-4ee3-9d0f-999d1a4307fa could not be found. Sep 14 09:28:55.517351 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:28:55.517351 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:28:55.517351 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:28:55.522238 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:28:55.522238 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:28:55.522238 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:28:55.522238 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:28:55.522238 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:28:55.522238 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d727e6d2-dc0c-4ee3-9d0f-999d1a4307fa could not be found. Sep 14 09:28:55.522238 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:28:55.525216 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-efa39352-8c19-4ef6-8432-9d528a70519c tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Returning 404 to user: Instance d727e6d2-dc0c-4ee3-9d0f-999d1a4307fa could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:28:55.526836 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-efa39352-8c19-4ef6-8432-9d528a70519c tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] 10.222.0.60 "GET /compute/v2.1/servers/d727e6d2-dc0c-4ee3-9d0f-999d1a4307fa" status: 404 len: 111 microversion: 2.1 time: 0.069247 Sep 14 09:28:55.527670 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3053/6130] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:28:55 2022] GET /compute/v2.1/servers/d727e6d2-dc0c-4ee3-9d0f-999d1a4307fa => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:28:55.762235 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-eed3d38d-65a6-4108-9ba7-32dd38a6fb72 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Action: 'create', calling method: .version_select at 0x7f7d444784c0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-424161104", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNsfyMf5gUHDorP6SFmKGi8vGjQsw58hNLr7AtisUW9MvDvkXt6Lg8AvAFKeIgJisXsdWD9uoXXVBZW9HglDuQJFOnL9Yhkw32+PnTZox3fP8jrwBCHnxm+EyzpHnuLJZg=="}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:28:55.780873 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-eed3d38d-65a6-4108-9ba7-32dd38a6fb72 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Getting quotas for project c197eded81494b818b1e56f4c01432c5. Resources: {'key_pairs'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:28:55.786804 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-eed3d38d-65a6-4108-9ba7-32dd38a6fb72 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Getting quotas for user 725d7beb4ec54b86a455af0d7bd0ce19 and project c197eded81494b818b1e56f4c01432c5. Resources: {'key_pairs'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:28:55.815893 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-eed3d38d-65a6-4108-9ba7-32dd38a6fb72 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.336132 Sep 14 09:28:55.816534 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3078/6131] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Sep 14 09:28:55 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:28:56.299550 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-67eeda90-ef99-4b72-80d3-6a44028019b2 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:28:56.300067 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-67eeda90-ef99-4b72-80d3-6a44028019b2 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] [instance: d727e6d2-dc0c-4ee3-9d0f-999d1a4307fa] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:28:56.307056 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-67eeda90-ef99-4b72-80d3-6a44028019b2 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:56.307588 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-67eeda90-ef99-4b72-80d3-6a44028019b2 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:56.308311 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-67eeda90-ef99-4b72-80d3-6a44028019b2 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:56.308946 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-67eeda90-ef99-4b72-80d3-6a44028019b2 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:56.309413 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-67eeda90-ef99-4b72-80d3-6a44028019b2 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:56.309846 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-67eeda90-ef99-4b72-80d3-6a44028019b2 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:56.326866 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-67eeda90-ef99-4b72-80d3-6a44028019b2 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] HTTP exception thrown: Instance d727e6d2-dc0c-4ee3-9d0f-999d1a4307fa could not be found. Sep 14 09:28:56.328387 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-67eeda90-ef99-4b72-80d3-6a44028019b2 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Request method failure captured: Sep 14 09:28:56.328387 n-d-836830-18 devstack@n-api.service[128759]: request: DELETE /compute/v2.1/servers/d727e6d2-dc0c-4ee3-9d0f-999d1a4307fa HTTP/1.1 Sep 14 09:28:56.328387 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:28:56.328387 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:28:56.328387 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:28:56.328387 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:28:56.328387 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:28:56.328387 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:28:56.328387 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:28:56.328387 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:28:56.328387 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZ2eRXU_X03YDG1NcV15mXBLiRZpb8zUvd-rA-9lXio6CaadDIKyt3uQQZZ_2S9Z51f4QpmEXgsK5CrG4CGOJI4l12wvQYGoWDGexuTMbHcszIiPqWXhinaGseOh_Fb2Snu2oTyXDA6V7fSH3doljwRGog_spNswJjI6COkz-KKO_QM Sep 14 09:28:56.328387 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:28:56.328387 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:28:56.328387 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:28:56.328387 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:28:56.328387 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:28:56.328387 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:28:56.328387 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 1cd8586b239f4f13a775a0465b9271a0 Sep 14 09:28:56.328387 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-TestServerBasicOps-521196554 Sep 14 09:28:56.328387 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:28:56.328387 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:28:56.328387 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/1cd8586b239f4f13a775a0465b9271a0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_1cd8586b239f4f13a775a0465b9271a0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1cd8586b239f4f13a775a0465b9271a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1cd8586b239f4f13a775a0465b9271a0"}]}] Sep 14 09:28:56.328387 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-TestServerBasicOps-521196554 Sep 14 09:28:56.328387 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 1cd8586b239f4f13a775a0465b9271a0 Sep 14 09:28:56.328387 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-TestServerBasicOps-521196554 Sep 14 09:28:56.328387 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-TestServerBasicOps-521196554-project Sep 14 09:28:56.328387 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:28:56.328387 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:28:56.328387 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 7f0ed82129324c07a8c4158d207fcc4e Sep 14 09:28:56.328387 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-TestServerBasicOps-521196554-project Sep 14 09:28:56.328387 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:28:56.328387 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance d727e6d2-dc0c-4ee3-9d0f-999d1a4307fa could not be found. Sep 14 09:28:56.328387 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': 'd727e6d2-dc0c-4ee3-9d0f-999d1a4307fa'} Sep 14 09:28:56.328387 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:28:56.328387 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:28:56.328387 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:28:56.328387 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:28:56.328387 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:28:56.328387 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:28:56.328387 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:28:56.328387 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:28:56.328387 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:28:56.328387 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:28:56.328387 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d727e6d2-dc0c-4ee3-9d0f-999d1a4307fa could not be found. Sep 14 09:28:56.328387 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:28:56.328387 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:28:56.328387 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:28:56.328387 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:28:56.328387 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:28:56.328387 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:28:56.328387 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:28:56.328387 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:28:56.328387 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:28:56.328387 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:28:56.328387 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 09:28:56.328387 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 09:28:56.328387 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 09:28:56.328387 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 09:28:56.328387 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:28:56.328387 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:28:56.328387 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:28:56.328387 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:28:56.333296 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d727e6d2-dc0c-4ee3-9d0f-999d1a4307fa could not be found. Sep 14 09:28:56.333296 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:28:56.333296 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:28:56.333296 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:28:56.333296 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:28:56.333296 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:28:56.333296 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:28:56.333296 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:28:56.333296 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:28:56.333296 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d727e6d2-dc0c-4ee3-9d0f-999d1a4307fa could not be found. Sep 14 09:28:56.333296 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:28:56.335836 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-67eeda90-ef99-4b72-80d3-6a44028019b2 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Returning 404 to user: Instance d727e6d2-dc0c-4ee3-9d0f-999d1a4307fa could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:28:56.336735 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-67eeda90-ef99-4b72-80d3-6a44028019b2 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] 10.222.0.60 "DELETE /compute/v2.1/servers/d727e6d2-dc0c-4ee3-9d0f-999d1a4307fa" status: 404 len: 111 microversion: 2.1 time: 0.042730 Sep 14 09:28:56.337323 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3054/6132] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:28:56 2022] DELETE /compute/v2.1/servers/d727e6d2-dc0c-4ee3-9d0f-999d1a4307fa => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:28:56.356535 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a57289bd-a4b4-4e0f-bdc1-9e465329e84e tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:28:56.357163 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-a57289bd-a4b4-4e0f-bdc1-9e465329e84e tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] [instance: d727e6d2-dc0c-4ee3-9d0f-999d1a4307fa] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:28:56.366642 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a57289bd-a4b4-4e0f-bdc1-9e465329e84e tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:56.367202 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a57289bd-a4b4-4e0f-bdc1-9e465329e84e tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:56.368059 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a57289bd-a4b4-4e0f-bdc1-9e465329e84e tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:56.368790 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a57289bd-a4b4-4e0f-bdc1-9e465329e84e tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:56.369249 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a57289bd-a4b4-4e0f-bdc1-9e465329e84e tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:56.369676 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a57289bd-a4b4-4e0f-bdc1-9e465329e84e tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:56.392677 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-a57289bd-a4b4-4e0f-bdc1-9e465329e84e tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] HTTP exception thrown: Instance d727e6d2-dc0c-4ee3-9d0f-999d1a4307fa could not be found. Sep 14 09:28:56.394654 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a57289bd-a4b4-4e0f-bdc1-9e465329e84e tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Request method failure captured: Sep 14 09:28:56.394654 n-d-836830-18 devstack@n-api.service[128758]: request: GET /compute/v2.1/servers/d727e6d2-dc0c-4ee3-9d0f-999d1a4307fa HTTP/1.1 Sep 14 09:28:56.394654 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 09:28:56.394654 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 09:28:56.394654 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 09:28:56.394654 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 09:28:56.394654 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 09:28:56.394654 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 09:28:56.394654 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 09:28:56.394654 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 09:28:56.394654 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZ2eRXU_X03YDG1NcV15mXBLiRZpb8zUvd-rA-9lXio6CaadDIKyt3uQQZZ_2S9Z51f4QpmEXgsK5CrG4CGOJI4l12wvQYGoWDGexuTMbHcszIiPqWXhinaGseOh_Fb2Snu2oTyXDA6V7fSH3doljwRGog_spNswJjI6COkz-KKO_QM Sep 14 09:28:56.394654 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 09:28:56.394654 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 09:28:56.394654 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 09:28:56.394654 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 09:28:56.394654 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 09:28:56.394654 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 09:28:56.394654 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 1cd8586b239f4f13a775a0465b9271a0 Sep 14 09:28:56.394654 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-TestServerBasicOps-521196554 Sep 14 09:28:56.394654 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 09:28:56.394654 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 09:28:56.394654 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/1cd8586b239f4f13a775a0465b9271a0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_1cd8586b239f4f13a775a0465b9271a0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1cd8586b239f4f13a775a0465b9271a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1cd8586b239f4f13a775a0465b9271a0"}]}] Sep 14 09:28:56.394654 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-TestServerBasicOps-521196554 Sep 14 09:28:56.394654 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 1cd8586b239f4f13a775a0465b9271a0 Sep 14 09:28:56.394654 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-TestServerBasicOps-521196554 Sep 14 09:28:56.394654 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-TestServerBasicOps-521196554-project Sep 14 09:28:56.394654 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 09:28:56.394654 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 09:28:56.394654 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 7f0ed82129324c07a8c4158d207fcc4e Sep 14 09:28:56.394654 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-TestServerBasicOps-521196554-project Sep 14 09:28:56.394654 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 09:28:56.394654 n-d-836830-18 devstack@n-api.service[128758]: exception: Instance d727e6d2-dc0c-4ee3-9d0f-999d1a4307fa could not be found. Sep 14 09:28:56.394654 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': 'd727e6d2-dc0c-4ee3-9d0f-999d1a4307fa'} Sep 14 09:28:56.394654 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:28:56.394654 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:28:56.394654 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:28:56.394654 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:28:56.394654 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:28:56.394654 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:28:56.394654 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:28:56.394654 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:28:56.394654 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:28:56.394654 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:28:56.394654 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d727e6d2-dc0c-4ee3-9d0f-999d1a4307fa could not be found. Sep 14 09:28:56.394654 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:28:56.394654 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:28:56.394654 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:28:56.394654 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:28:56.394654 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:28:56.394654 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:28:56.394654 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:28:56.394654 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:28:56.394654 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:28:56.394654 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:28:56.394654 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:28:56.394654 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:28:56.394654 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:28:56.394654 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:28:56.394654 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:28:56.394654 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:28:56.394654 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d727e6d2-dc0c-4ee3-9d0f-999d1a4307fa could not be found. Sep 14 09:28:56.394654 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:28:56.394654 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:28:56.394654 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:28:56.399349 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:28:56.399349 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:28:56.399349 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:28:56.399349 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:28:56.399349 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:28:56.399349 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d727e6d2-dc0c-4ee3-9d0f-999d1a4307fa could not be found. Sep 14 09:28:56.399349 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:28:56.401251 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a57289bd-a4b4-4e0f-bdc1-9e465329e84e tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Returning 404 to user: Instance d727e6d2-dc0c-4ee3-9d0f-999d1a4307fa could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:28:56.402410 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-a57289bd-a4b4-4e0f-bdc1-9e465329e84e tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] 10.222.0.60 "GET /compute/v2.1/servers/d727e6d2-dc0c-4ee3-9d0f-999d1a4307fa" status: 404 len: 111 microversion: 2.1 time: 0.059512 Sep 14 09:28:56.403575 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3079/6133] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:28:56 2022] GET /compute/v2.1/servers/d727e6d2-dc0c-4ee3-9d0f-999d1a4307fa => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:28:56.607409 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9cb69045-bcf4-4036-af15-19df4fc07e91 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] Calling method '.version_select at 0x7f7d487dd3a0>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:28:56.637489 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-9cb69045-bcf4-4036-af15-19df4fc07e91 tempest-TestServerBasicOps-521196554 tempest-TestServerBasicOps-521196554-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-507539977" status: 202 len: 0 microversion: 2.1 time: 0.035913 Sep 14 09:28:56.638429 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3055/6134] 10.222.0.60 () {58 vars in 1251 bytes} [Wed Sep 14 09:28:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-507539977 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:29:06.105407 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a7b37b03-3325-40e3-87de-a06a48f55719 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-3480645", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "networks": [{"uuid": "e8a3718c-77db-45d6-894d-fa76df123030"}], "key_name": "tempest-TestNetworkAdvancedServerOps-424161104", "security_groups": [{"name": "tempest-secgroup-smoke-378581725"}]}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:29:06.147977 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=4 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:29:06.367845 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.network.neutron [None req-a7b37b03-3325-40e3-87de-a06a48f55719 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] validate_networks() for [('e8a3718c-77db-45d6-894d-fa76df123030', None, None, None, None, None)] {{(pid=128758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:29:06.375734 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:29:07.340936 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-a7b37b03-3325-40e3-87de-a06a48f55719 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Flavor limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:29:07.342260 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-a7b37b03-3325-40e3-87de-a06a48f55719 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Image limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:29:07.342919 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-a7b37b03-3325-40e3-87de-a06a48f55719 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Flavor pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:29:07.343532 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-a7b37b03-3325-40e3-87de-a06a48f55719 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Image pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:29:07.344157 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-a7b37b03-3325-40e3-87de-a06a48f55719 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:29:07.353760 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a7b37b03-3325-40e3-87de-a06a48f55719 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:07.355129 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a7b37b03-3325-40e3-87de-a06a48f55719 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:07.355990 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a7b37b03-3325-40e3-87de-a06a48f55719 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:07.357141 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a7b37b03-3325-40e3-87de-a06a48f55719 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:07.357829 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a7b37b03-3325-40e3-87de-a06a48f55719 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:07.358458 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a7b37b03-3325-40e3-87de-a06a48f55719 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:07.383662 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-a7b37b03-3325-40e3-87de-a06a48f55719 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Getting quotas for project c197eded81494b818b1e56f4c01432c5. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:29:07.390499 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-a7b37b03-3325-40e3-87de-a06a48f55719 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Getting quotas for user 725d7beb4ec54b86a455af0d7bd0ce19 and project c197eded81494b818b1e56f4c01432c5. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:29:07.404940 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-a7b37b03-3325-40e3-87de-a06a48f55719 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Going to run 1 instances... {{(pid=128758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:29:07.407560 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-a7b37b03-3325-40e3-87de-a06a48f55719 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: b93d32ea-ad59-46a2-ae7e-e23d66132271] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:29:07.461524 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-a7b37b03-3325-40e3-87de-a06a48f55719 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.361590 Sep 14 09:29:07.462745 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3080/6135] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 09:29:06 2022] POST /compute/v2.1/servers => generated 405 bytes in 1363 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:29:07.475344 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-4a8bf4b8-6852-4189-a849-a986ba69aadd tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:07.477330 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-4a8bf4b8-6852-4189-a849-a986ba69aadd tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: b93d32ea-ad59-46a2-ae7e-e23d66132271] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:07.489641 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=12 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:29:07.490888 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=11,nova_api:DELETE=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:29:07.680094 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-4a8bf4b8-6852-4189-a849-a986ba69aadd tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725d7beb4ec54b86a455af0d7bd0ce19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c197eded81494b818b1e56f4c01432c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:29:07.687553 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-4a8bf4b8-6852-4189-a849-a986ba69aadd tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/b93d32ea-ad59-46a2-ae7e-e23d66132271" status: 200 len: 1263 microversion: 2.1 time: 0.217449 Sep 14 09:29:07.688388 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3056/6136] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:29:07 2022] GET /compute/v2.1/servers/b93d32ea-ad59-46a2-ae7e-e23d66132271 => generated 1263 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:29:08.720568 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-7eeab96b-7a1b-486c-aa37-c9e12ba31ee3 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:08.721389 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-7eeab96b-7a1b-486c-aa37-c9e12ba31ee3 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: b93d32ea-ad59-46a2-ae7e-e23d66132271] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:08.739626 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7eeab96b-7a1b-486c-aa37-c9e12ba31ee3 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:08.741251 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7eeab96b-7a1b-486c-aa37-c9e12ba31ee3 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:08.741717 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7eeab96b-7a1b-486c-aa37-c9e12ba31ee3 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:08.742477 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7eeab96b-7a1b-486c-aa37-c9e12ba31ee3 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:08.747401 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7eeab96b-7a1b-486c-aa37-c9e12ba31ee3 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:08.748380 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7eeab96b-7a1b-486c-aa37-c9e12ba31ee3 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:08.899258 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-7eeab96b-7a1b-486c-aa37-c9e12ba31ee3 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725d7beb4ec54b86a455af0d7bd0ce19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c197eded81494b818b1e56f4c01432c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:29:08.913838 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-7eeab96b-7a1b-486c-aa37-c9e12ba31ee3 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/b93d32ea-ad59-46a2-ae7e-e23d66132271" status: 200 len: 1315 microversion: 2.1 time: 0.204259 Sep 14 09:29:08.915231 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3081/6137] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:29:08 2022] GET /compute/v2.1/servers/b93d32ea-ad59-46a2-ae7e-e23d66132271 => generated 1315 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:29:09.938211 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e8093550-72bd-406b-ad2e-9c76ad47ea13 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:09.941833 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e8093550-72bd-406b-ad2e-9c76ad47ea13 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: b93d32ea-ad59-46a2-ae7e-e23d66132271] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:09.960933 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e8093550-72bd-406b-ad2e-9c76ad47ea13 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:09.961806 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e8093550-72bd-406b-ad2e-9c76ad47ea13 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:09.971525 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e8093550-72bd-406b-ad2e-9c76ad47ea13 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:09.977647 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e8093550-72bd-406b-ad2e-9c76ad47ea13 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:09.978390 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e8093550-72bd-406b-ad2e-9c76ad47ea13 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:09.979041 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e8093550-72bd-406b-ad2e-9c76ad47ea13 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:10.172083 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-e8093550-72bd-406b-ad2e-9c76ad47ea13 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725d7beb4ec54b86a455af0d7bd0ce19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c197eded81494b818b1e56f4c01432c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:29:10.181362 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e8093550-72bd-406b-ad2e-9c76ad47ea13 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/b93d32ea-ad59-46a2-ae7e-e23d66132271" status: 200 len: 1321 microversion: 2.1 time: 0.246931 Sep 14 09:29:10.182369 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3057/6138] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:29:09 2022] GET /compute/v2.1/servers/b93d32ea-ad59-46a2-ae7e-e23d66132271 => generated 1321 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:29:11.205924 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b71f302e-ac58-4977-a062-2fa926c3bd37 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:11.215944 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-b71f302e-ac58-4977-a062-2fa926c3bd37 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: b93d32ea-ad59-46a2-ae7e-e23d66132271] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:11.243615 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b71f302e-ac58-4977-a062-2fa926c3bd37 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:11.244289 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b71f302e-ac58-4977-a062-2fa926c3bd37 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:11.246397 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b71f302e-ac58-4977-a062-2fa926c3bd37 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:11.249144 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b71f302e-ac58-4977-a062-2fa926c3bd37 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:11.250284 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b71f302e-ac58-4977-a062-2fa926c3bd37 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:11.253108 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b71f302e-ac58-4977-a062-2fa926c3bd37 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:11.672666 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-b71f302e-ac58-4977-a062-2fa926c3bd37 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725d7beb4ec54b86a455af0d7bd0ce19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c197eded81494b818b1e56f4c01432c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:29:11.687062 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-b71f302e-ac58-4977-a062-2fa926c3bd37 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/b93d32ea-ad59-46a2-ae7e-e23d66132271" status: 200 len: 1388 microversion: 2.1 time: 0.481796 Sep 14 09:29:11.692025 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3082/6139] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:29:11 2022] GET /compute/v2.1/servers/b93d32ea-ad59-46a2-ae7e-e23d66132271 => generated 1388 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:29:12.600147 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-315d45ce-242d-408d-82ff-303e38d2d1e1 req-4353766a-1bb2-4f65-a10b-ade10ea3748c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b93d32ea-ad59-46a2-ae7e-e23d66132271", "tag": "ffd5e266-d94c-4d18-b106-97154479401e"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:29:12.617499 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-315d45ce-242d-408d-82ff-303e38d2d1e1 req-4353766a-1bb2-4f65-a10b-ade10ea3748c service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:12.618114 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-315d45ce-242d-408d-82ff-303e38d2d1e1 req-4353766a-1bb2-4f65-a10b-ade10ea3748c service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:12.618870 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-315d45ce-242d-408d-82ff-303e38d2d1e1 req-4353766a-1bb2-4f65-a10b-ade10ea3748c service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:12.634041 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-315d45ce-242d-408d-82ff-303e38d2d1e1 req-4353766a-1bb2-4f65-a10b-ade10ea3748c service nova] Creating event network-changed:ffd5e266-d94c-4d18-b106-97154479401e for instance b93d32ea-ad59-46a2-ae7e-e23d66132271 on n-h2-836830-18 Sep 14 09:29:12.640168 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-315d45ce-242d-408d-82ff-303e38d2d1e1 req-4353766a-1bb2-4f65-a10b-ade10ea3748c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051965 Sep 14 09:29:12.641470 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3058/6140] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:29:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:29:12.714541 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-8bd7f5a2-1b83-4b1b-91e6-fbe142191f92 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:12.715061 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-8bd7f5a2-1b83-4b1b-91e6-fbe142191f92 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: b93d32ea-ad59-46a2-ae7e-e23d66132271] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:12.726110 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8bd7f5a2-1b83-4b1b-91e6-fbe142191f92 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:12.726659 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8bd7f5a2-1b83-4b1b-91e6-fbe142191f92 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:12.733164 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8bd7f5a2-1b83-4b1b-91e6-fbe142191f92 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:12.734025 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8bd7f5a2-1b83-4b1b-91e6-fbe142191f92 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:12.734520 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8bd7f5a2-1b83-4b1b-91e6-fbe142191f92 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:12.739488 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8bd7f5a2-1b83-4b1b-91e6-fbe142191f92 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:13.335410 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-8bd7f5a2-1b83-4b1b-91e6-fbe142191f92 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725d7beb4ec54b86a455af0d7bd0ce19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c197eded81494b818b1e56f4c01432c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:29:13.344409 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-8bd7f5a2-1b83-4b1b-91e6-fbe142191f92 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/b93d32ea-ad59-46a2-ae7e-e23d66132271" status: 200 len: 1388 microversion: 2.1 time: 0.634291 Sep 14 09:29:13.345649 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3083/6141] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:29:12 2022] GET /compute/v2.1/servers/b93d32ea-ad59-46a2-ae7e-e23d66132271 => generated 1388 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:29:14.368954 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-190348a7-f8cf-4c46-bc1c-5691f9d81de6 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:14.370281 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-190348a7-f8cf-4c46-bc1c-5691f9d81de6 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: b93d32ea-ad59-46a2-ae7e-e23d66132271] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:14.378420 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-190348a7-f8cf-4c46-bc1c-5691f9d81de6 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:14.379315 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-190348a7-f8cf-4c46-bc1c-5691f9d81de6 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:14.380012 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-190348a7-f8cf-4c46-bc1c-5691f9d81de6 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:14.380978 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-190348a7-f8cf-4c46-bc1c-5691f9d81de6 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:14.381670 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-190348a7-f8cf-4c46-bc1c-5691f9d81de6 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:14.382334 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-190348a7-f8cf-4c46-bc1c-5691f9d81de6 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:14.646131 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-190348a7-f8cf-4c46-bc1c-5691f9d81de6 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725d7beb4ec54b86a455af0d7bd0ce19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c197eded81494b818b1e56f4c01432c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:29:14.663170 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-190348a7-f8cf-4c46-bc1c-5691f9d81de6 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/b93d32ea-ad59-46a2-ae7e-e23d66132271" status: 200 len: 1388 microversion: 2.1 time: 0.298382 Sep 14 09:29:14.664433 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3059/6142] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:29:14 2022] GET /compute/v2.1/servers/b93d32ea-ad59-46a2-ae7e-e23d66132271 => generated 1388 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:29:15.697178 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-498687f3-b5db-4ac7-80e8-f218ec00fd77 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:15.699192 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-498687f3-b5db-4ac7-80e8-f218ec00fd77 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: b93d32ea-ad59-46a2-ae7e-e23d66132271] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:15.710385 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-498687f3-b5db-4ac7-80e8-f218ec00fd77 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:15.711335 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-498687f3-b5db-4ac7-80e8-f218ec00fd77 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:15.712038 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-498687f3-b5db-4ac7-80e8-f218ec00fd77 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:15.712993 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-498687f3-b5db-4ac7-80e8-f218ec00fd77 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:15.713760 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-498687f3-b5db-4ac7-80e8-f218ec00fd77 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:15.714417 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-498687f3-b5db-4ac7-80e8-f218ec00fd77 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:16.110576 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-498687f3-b5db-4ac7-80e8-f218ec00fd77 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725d7beb4ec54b86a455af0d7bd0ce19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c197eded81494b818b1e56f4c01432c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:29:16.119474 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-498687f3-b5db-4ac7-80e8-f218ec00fd77 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/b93d32ea-ad59-46a2-ae7e-e23d66132271" status: 200 len: 1388 microversion: 2.1 time: 0.431647 Sep 14 09:29:16.120077 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3084/6143] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:29:15 2022] GET /compute/v2.1/servers/b93d32ea-ad59-46a2-ae7e-e23d66132271 => generated 1388 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:29:17.148816 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-6d1a63fa-d56a-4300-8112-2dcd0c2014f0 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:17.151225 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-6d1a63fa-d56a-4300-8112-2dcd0c2014f0 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: b93d32ea-ad59-46a2-ae7e-e23d66132271] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:17.167870 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6d1a63fa-d56a-4300-8112-2dcd0c2014f0 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:17.168778 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6d1a63fa-d56a-4300-8112-2dcd0c2014f0 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:17.169456 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6d1a63fa-d56a-4300-8112-2dcd0c2014f0 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:17.170447 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6d1a63fa-d56a-4300-8112-2dcd0c2014f0 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:17.171283 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6d1a63fa-d56a-4300-8112-2dcd0c2014f0 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:17.171942 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6d1a63fa-d56a-4300-8112-2dcd0c2014f0 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:17.475523 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-6d1a63fa-d56a-4300-8112-2dcd0c2014f0 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725d7beb4ec54b86a455af0d7bd0ce19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c197eded81494b818b1e56f4c01432c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:29:17.490828 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-6d1a63fa-d56a-4300-8112-2dcd0c2014f0 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/b93d32ea-ad59-46a2-ae7e-e23d66132271" status: 200 len: 1388 microversion: 2.1 time: 0.346456 Sep 14 09:29:17.507595 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3060/6144] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:29:17 2022] GET /compute/v2.1/servers/b93d32ea-ad59-46a2-ae7e-e23d66132271 => generated 1388 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:29:18.116363 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=2 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:29:18.118060 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=6 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:29:18.369790 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-dffb9668-b869-4d9b-a394-882a08feb1ff req-87902303-329f-4c7f-b276-1a086dbec5c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b93d32ea-ad59-46a2-ae7e-e23d66132271", "name": "network-vif-plugged", "status": "completed", "tag": "ffd5e266-d94c-4d18-b106-97154479401e"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:29:18.382796 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-dffb9668-b869-4d9b-a394-882a08feb1ff req-87902303-329f-4c7f-b276-1a086dbec5c8 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:18.383366 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-dffb9668-b869-4d9b-a394-882a08feb1ff req-87902303-329f-4c7f-b276-1a086dbec5c8 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:18.383807 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-dffb9668-b869-4d9b-a394-882a08feb1ff req-87902303-329f-4c7f-b276-1a086dbec5c8 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:18.398559 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-dffb9668-b869-4d9b-a394-882a08feb1ff req-87902303-329f-4c7f-b276-1a086dbec5c8 service nova] Creating event network-vif-plugged:ffd5e266-d94c-4d18-b106-97154479401e for instance b93d32ea-ad59-46a2-ae7e-e23d66132271 on n-h2-836830-18 Sep 14 09:29:18.406975 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-dffb9668-b869-4d9b-a394-882a08feb1ff req-87902303-329f-4c7f-b276-1a086dbec5c8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.296738 Sep 14 09:29:18.408354 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3085/6145] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:29:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:29:18.516436 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-76ad075f-e2f0-400e-8e0c-dfb5058f1b9c tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:18.517626 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-76ad075f-e2f0-400e-8e0c-dfb5058f1b9c tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: b93d32ea-ad59-46a2-ae7e-e23d66132271] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:18.526391 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=2 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:29:18.528663 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-76ad075f-e2f0-400e-8e0c-dfb5058f1b9c tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:18.529167 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-76ad075f-e2f0-400e-8e0c-dfb5058f1b9c tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:18.529617 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-76ad075f-e2f0-400e-8e0c-dfb5058f1b9c tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:18.530339 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-76ad075f-e2f0-400e-8e0c-dfb5058f1b9c tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:18.530802 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-76ad075f-e2f0-400e-8e0c-dfb5058f1b9c tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:18.531269 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-76ad075f-e2f0-400e-8e0c-dfb5058f1b9c tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:18.859578 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-76ad075f-e2f0-400e-8e0c-dfb5058f1b9c tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725d7beb4ec54b86a455af0d7bd0ce19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c197eded81494b818b1e56f4c01432c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:29:18.869557 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-76ad075f-e2f0-400e-8e0c-dfb5058f1b9c tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/b93d32ea-ad59-46a2-ae7e-e23d66132271" status: 200 len: 1388 microversion: 2.1 time: 0.356970 Sep 14 09:29:18.887763 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3061/6146] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:29:18 2022] GET /compute/v2.1/servers/b93d32ea-ad59-46a2-ae7e-e23d66132271 => generated 1388 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:29:19.895547 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-720adf59-0356-4bcb-831c-d22e1d37f25f tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:19.900352 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-720adf59-0356-4bcb-831c-d22e1d37f25f tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: b93d32ea-ad59-46a2-ae7e-e23d66132271] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:19.908391 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-720adf59-0356-4bcb-831c-d22e1d37f25f tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:19.908872 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-720adf59-0356-4bcb-831c-d22e1d37f25f tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:19.909854 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-720adf59-0356-4bcb-831c-d22e1d37f25f tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:19.911182 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-720adf59-0356-4bcb-831c-d22e1d37f25f tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:19.911656 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-720adf59-0356-4bcb-831c-d22e1d37f25f tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:19.912094 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-720adf59-0356-4bcb-831c-d22e1d37f25f tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:20.236814 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-720adf59-0356-4bcb-831c-d22e1d37f25f tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725d7beb4ec54b86a455af0d7bd0ce19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c197eded81494b818b1e56f4c01432c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:29:20.251451 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-720adf59-0356-4bcb-831c-d22e1d37f25f tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/b93d32ea-ad59-46a2-ae7e-e23d66132271" status: 200 len: 1560 microversion: 2.1 time: 0.361195 Sep 14 09:29:20.278274 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-26aeb992-3841-4791-87d2-5eb69341fead tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:20.278909 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-26aeb992-3841-4791-87d2-5eb69341fead tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: b93d32ea-ad59-46a2-ae7e-e23d66132271] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:20.279301 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3086/6147] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:29:19 2022] GET /compute/v2.1/servers/b93d32ea-ad59-46a2-ae7e-e23d66132271 => generated 1560 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:29:20.294574 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-26aeb992-3841-4791-87d2-5eb69341fead tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:20.296439 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-26aeb992-3841-4791-87d2-5eb69341fead tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:20.296927 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-26aeb992-3841-4791-87d2-5eb69341fead tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:20.301175 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-26aeb992-3841-4791-87d2-5eb69341fead tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:20.301756 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-26aeb992-3841-4791-87d2-5eb69341fead tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:20.302274 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-26aeb992-3841-4791-87d2-5eb69341fead tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:20.664363 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-26aeb992-3841-4791-87d2-5eb69341fead tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725d7beb4ec54b86a455af0d7bd0ce19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c197eded81494b818b1e56f4c01432c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:29:20.684600 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-26aeb992-3841-4791-87d2-5eb69341fead tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/b93d32ea-ad59-46a2-ae7e-e23d66132271" status: 200 len: 1560 microversion: 2.1 time: 0.410197 Sep 14 09:29:20.694335 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3062/6148] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:29:20 2022] GET /compute/v2.1/servers/b93d32ea-ad59-46a2-ae7e-e23d66132271 => generated 1560 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:29:23.687090 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1ba245da-616a-4e54-9a97-9e1356f6ef8e tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:23.688398 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-1ba245da-616a-4e54-9a97-9e1356f6ef8e tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: b93d32ea-ad59-46a2-ae7e-e23d66132271] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:23.692279 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:29:23.725673 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1ba245da-616a-4e54-9a97-9e1356f6ef8e tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:23.726404 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1ba245da-616a-4e54-9a97-9e1356f6ef8e tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:23.727076 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1ba245da-616a-4e54-9a97-9e1356f6ef8e tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:23.727972 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1ba245da-616a-4e54-9a97-9e1356f6ef8e tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:23.728600 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1ba245da-616a-4e54-9a97-9e1356f6ef8e tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:23.729197 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1ba245da-616a-4e54-9a97-9e1356f6ef8e tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:23.994096 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-1ba245da-616a-4e54-9a97-9e1356f6ef8e tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725d7beb4ec54b86a455af0d7bd0ce19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c197eded81494b818b1e56f4c01432c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:29:24.003802 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-1ba245da-616a-4e54-9a97-9e1356f6ef8e tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/b93d32ea-ad59-46a2-ae7e-e23d66132271" status: 200 len: 1560 microversion: 2.1 time: 0.321694 Sep 14 09:29:24.004761 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3087/6149] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:29:23 2022] GET /compute/v2.1/servers/b93d32ea-ad59-46a2-ae7e-e23d66132271 => generated 1560 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:29:24.009427 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-db9307e6-32ee-4f71-8ab9-d0ac8affc376 req-1aca602a-9e06-432c-a0a4-4330a7ab4660 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b93d32ea-ad59-46a2-ae7e-e23d66132271", "tag": "ffd5e266-d94c-4d18-b106-97154479401e"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:29:24.026506 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-db9307e6-32ee-4f71-8ab9-d0ac8affc376 req-1aca602a-9e06-432c-a0a4-4330a7ab4660 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:24.027031 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-db9307e6-32ee-4f71-8ab9-d0ac8affc376 req-1aca602a-9e06-432c-a0a4-4330a7ab4660 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:24.027475 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-db9307e6-32ee-4f71-8ab9-d0ac8affc376 req-1aca602a-9e06-432c-a0a4-4330a7ab4660 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:24.062000 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-db9307e6-32ee-4f71-8ab9-d0ac8affc376 req-1aca602a-9e06-432c-a0a4-4330a7ab4660 service nova] Creating event network-changed:ffd5e266-d94c-4d18-b106-97154479401e for instance b93d32ea-ad59-46a2-ae7e-e23d66132271 on n-h2-836830-18 Sep 14 09:29:24.076287 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-db9307e6-32ee-4f71-8ab9-d0ac8affc376 req-1aca602a-9e06-432c-a0a4-4330a7ab4660 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.386091 Sep 14 09:29:24.080043 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3063/6150] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:29:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:29:30.850892 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-f4244622-6348-44be-95f8-6394bdcf451f tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2120766853", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "d2deec4c-4d57-46e4-8791-1b19013895ad", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "70503795-7dfb-4d39-a57e-91e8e5270ce0"}]}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:29:30.978807 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.network.neutron [None req-f4244622-6348-44be-95f8-6394bdcf451f tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] validate_networks() for [('70503795-7dfb-4d39-a57e-91e8e5270ce0', None, None, None, None, None)] {{(pid=128758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:29:31.635139 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-f4244622-6348-44be-95f8-6394bdcf451f tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Flavor limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:29:31.635886 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-f4244622-6348-44be-95f8-6394bdcf451f tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Image limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:29:31.636386 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-f4244622-6348-44be-95f8-6394bdcf451f tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Flavor pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:29:31.636807 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-f4244622-6348-44be-95f8-6394bdcf451f tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Image pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:29:31.637231 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-f4244622-6348-44be-95f8-6394bdcf451f tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:29:31.647208 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f4244622-6348-44be-95f8-6394bdcf451f tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:31.647699 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f4244622-6348-44be-95f8-6394bdcf451f tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:31.648397 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f4244622-6348-44be-95f8-6394bdcf451f tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:31.649294 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f4244622-6348-44be-95f8-6394bdcf451f tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:31.649603 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f4244622-6348-44be-95f8-6394bdcf451f tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:31.650041 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f4244622-6348-44be-95f8-6394bdcf451f tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:31.675579 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-f4244622-6348-44be-95f8-6394bdcf451f tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Getting quotas for project 0fca803d9ffa4b4ab0371c0d6a96a5a2. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:29:31.685505 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-f4244622-6348-44be-95f8-6394bdcf451f tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Getting quotas for user 80257054a25540c294e1787780b601b4 and project 0fca803d9ffa4b4ab0371c0d6a96a5a2. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:29:31.759080 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-f4244622-6348-44be-95f8-6394bdcf451f tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Going to run 1 instances... {{(pid=128758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:29:31.761389 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-f4244622-6348-44be-95f8-6394bdcf451f tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: 4fb2a1f5-6eda-43fa-8905-b027199a538b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d2deec4c-4d57-46e4-8791-1b19013895ad',volume_size=None,volume_type=None)] {{(pid=128758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:29:31.964520 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-f4244622-6348-44be-95f8-6394bdcf451f tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.118092 Sep 14 09:29:31.967096 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3088/6151] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 09:29:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1122 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 14 09:29:31.984444 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d0eb6254-56dd-41b5-b555-5ab5ee6084cd tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:31.985884 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-d0eb6254-56dd-41b5-b555-5ab5ee6084cd tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: 4fb2a1f5-6eda-43fa-8905-b027199a538b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:32.081507 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-d0eb6254-56dd-41b5-b555-5ab5ee6084cd tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:29:32.089918 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d0eb6254-56dd-41b5-b555-5ab5ee6084cd tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/4fb2a1f5-6eda-43fa-8905-b027199a538b" status: 200 len: 1057 microversion: 2.1 time: 0.114151 Sep 14 09:29:32.099887 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3064/6152] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:29:31 2022] GET /compute/v2.1/servers/4fb2a1f5-6eda-43fa-8905-b027199a538b => generated 1057 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:29:33.117187 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-4cf53841-0ea0-4091-bd2a-ee45865cd867 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:33.118264 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-4cf53841-0ea0-4091-bd2a-ee45865cd867 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: 4fb2a1f5-6eda-43fa-8905-b027199a538b] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:33.128418 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4cf53841-0ea0-4091-bd2a-ee45865cd867 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:33.128923 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4cf53841-0ea0-4091-bd2a-ee45865cd867 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:33.129395 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4cf53841-0ea0-4091-bd2a-ee45865cd867 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:33.130109 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4cf53841-0ea0-4091-bd2a-ee45865cd867 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:33.130561 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4cf53841-0ea0-4091-bd2a-ee45865cd867 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:33.131228 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4cf53841-0ea0-4091-bd2a-ee45865cd867 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:33.240139 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-4cf53841-0ea0-4091-bd2a-ee45865cd867 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:29:33.256944 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-4cf53841-0ea0-4091-bd2a-ee45865cd867 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/4fb2a1f5-6eda-43fa-8905-b027199a538b" status: 200 len: 1155 microversion: 2.1 time: 0.147471 Sep 14 09:29:33.257557 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3089/6153] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:29:33 2022] GET /compute/v2.1/servers/4fb2a1f5-6eda-43fa-8905-b027199a538b => generated 1155 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:29:34.282897 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-5511daf0-ff14-4160-9ffe-ec88a1e45ce2 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:34.283543 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-5511daf0-ff14-4160-9ffe-ec88a1e45ce2 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: 4fb2a1f5-6eda-43fa-8905-b027199a538b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:34.287090 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=34 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:29:34.300776 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5511daf0-ff14-4160-9ffe-ec88a1e45ce2 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:34.301279 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5511daf0-ff14-4160-9ffe-ec88a1e45ce2 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:34.301719 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5511daf0-ff14-4160-9ffe-ec88a1e45ce2 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:34.302420 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5511daf0-ff14-4160-9ffe-ec88a1e45ce2 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:34.302872 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5511daf0-ff14-4160-9ffe-ec88a1e45ce2 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:34.303339 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5511daf0-ff14-4160-9ffe-ec88a1e45ce2 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:34.585115 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-5511daf0-ff14-4160-9ffe-ec88a1e45ce2 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:29:34.615288 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-5511daf0-ff14-4160-9ffe-ec88a1e45ce2 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/4fb2a1f5-6eda-43fa-8905-b027199a538b" status: 200 len: 1215 microversion: 2.1 time: 0.337803 Sep 14 09:29:34.618357 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3065/6154] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:29:34 2022] GET /compute/v2.1/servers/4fb2a1f5-6eda-43fa-8905-b027199a538b => generated 1215 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:29:35.068360 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-1ca6712f-61b2-49b8-9dc2-443b1e445c35 req-459c4672-96d8-4ad5-9bf1-0ebb2996353a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fb2a1f5-6eda-43fa-8905-b027199a538b", "tag": "354adc34-dbe2-480f-a9ce-a225ce67a454"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:29:35.082040 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-1ca6712f-61b2-49b8-9dc2-443b1e445c35 req-459c4672-96d8-4ad5-9bf1-0ebb2996353a service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:35.082680 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-1ca6712f-61b2-49b8-9dc2-443b1e445c35 req-459c4672-96d8-4ad5-9bf1-0ebb2996353a service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:35.083379 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-1ca6712f-61b2-49b8-9dc2-443b1e445c35 req-459c4672-96d8-4ad5-9bf1-0ebb2996353a service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:35.121703 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-1ca6712f-61b2-49b8-9dc2-443b1e445c35 req-459c4672-96d8-4ad5-9bf1-0ebb2996353a service nova] Creating event network-changed:354adc34-dbe2-480f-a9ce-a225ce67a454 for instance 4fb2a1f5-6eda-43fa-8905-b027199a538b on n-h1-836830-18 Sep 14 09:29:35.128977 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-1ca6712f-61b2-49b8-9dc2-443b1e445c35 req-459c4672-96d8-4ad5-9bf1-0ebb2996353a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063541 Sep 14 09:29:35.129874 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3090/6155] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:29:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:29:35.640368 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-4527cd04-fc90-4380-8345-cd0d02f028da tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:35.640993 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-4527cd04-fc90-4380-8345-cd0d02f028da tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: 4fb2a1f5-6eda-43fa-8905-b027199a538b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:35.649202 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4527cd04-fc90-4380-8345-cd0d02f028da tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:35.649700 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4527cd04-fc90-4380-8345-cd0d02f028da tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:35.650237 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4527cd04-fc90-4380-8345-cd0d02f028da tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:35.650832 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4527cd04-fc90-4380-8345-cd0d02f028da tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:35.651322 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4527cd04-fc90-4380-8345-cd0d02f028da tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:35.651746 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4527cd04-fc90-4380-8345-cd0d02f028da tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:36.186902 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-4527cd04-fc90-4380-8345-cd0d02f028da tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:29:36.199295 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-4527cd04-fc90-4380-8345-cd0d02f028da tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/4fb2a1f5-6eda-43fa-8905-b027199a538b" status: 200 len: 1215 microversion: 2.1 time: 0.562663 Sep 14 09:29:36.201186 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3066/6156] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:29:35 2022] GET /compute/v2.1/servers/4fb2a1f5-6eda-43fa-8905-b027199a538b => generated 1215 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:29:37.223595 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-3f72fe0e-837e-4fdf-9799-32dc4e4f7cd4 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:37.224956 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-3f72fe0e-837e-4fdf-9799-32dc4e4f7cd4 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: 4fb2a1f5-6eda-43fa-8905-b027199a538b] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:37.231366 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3f72fe0e-837e-4fdf-9799-32dc4e4f7cd4 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:37.232021 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3f72fe0e-837e-4fdf-9799-32dc4e4f7cd4 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:37.232639 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3f72fe0e-837e-4fdf-9799-32dc4e4f7cd4 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:37.233323 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3f72fe0e-837e-4fdf-9799-32dc4e4f7cd4 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:37.233927 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3f72fe0e-837e-4fdf-9799-32dc4e4f7cd4 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:37.234816 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3f72fe0e-837e-4fdf-9799-32dc4e4f7cd4 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:37.255701 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=51 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:29:37.382334 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-3f72fe0e-837e-4fdf-9799-32dc4e4f7cd4 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:29:37.391064 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-3f72fe0e-837e-4fdf-9799-32dc4e4f7cd4 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/4fb2a1f5-6eda-43fa-8905-b027199a538b" status: 200 len: 1215 microversion: 2.1 time: 0.172828 Sep 14 09:29:37.391778 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3091/6157] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:29:37 2022] GET /compute/v2.1/servers/4fb2a1f5-6eda-43fa-8905-b027199a538b => generated 1215 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:29:38.416671 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-28090c1f-7ccd-474f-9e30-cf03d4ff2604 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:38.416671 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-28090c1f-7ccd-474f-9e30-cf03d4ff2604 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: 4fb2a1f5-6eda-43fa-8905-b027199a538b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:38.417192 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=27 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:29:38.423009 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-28090c1f-7ccd-474f-9e30-cf03d4ff2604 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:38.423644 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-28090c1f-7ccd-474f-9e30-cf03d4ff2604 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:38.424164 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-28090c1f-7ccd-474f-9e30-cf03d4ff2604 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:38.424953 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-28090c1f-7ccd-474f-9e30-cf03d4ff2604 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:38.425511 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-28090c1f-7ccd-474f-9e30-cf03d4ff2604 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:38.426138 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-28090c1f-7ccd-474f-9e30-cf03d4ff2604 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:38.603268 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-28090c1f-7ccd-474f-9e30-cf03d4ff2604 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:29:38.611846 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-28090c1f-7ccd-474f-9e30-cf03d4ff2604 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/4fb2a1f5-6eda-43fa-8905-b027199a538b" status: 200 len: 1215 microversion: 2.1 time: 0.202130 Sep 14 09:29:38.612723 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3067/6158] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:29:38 2022] GET /compute/v2.1/servers/4fb2a1f5-6eda-43fa-8905-b027199a538b => generated 1215 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:29:39.636565 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-2a631930-8521-454b-ac0f-cbee698f6d53 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:39.637243 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-2a631930-8521-454b-ac0f-cbee698f6d53 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: 4fb2a1f5-6eda-43fa-8905-b027199a538b] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:39.644781 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2a631930-8521-454b-ac0f-cbee698f6d53 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:39.645198 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2a631930-8521-454b-ac0f-cbee698f6d53 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:39.645653 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2a631930-8521-454b-ac0f-cbee698f6d53 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:39.646342 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2a631930-8521-454b-ac0f-cbee698f6d53 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:39.646796 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2a631930-8521-454b-ac0f-cbee698f6d53 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:39.647251 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2a631930-8521-454b-ac0f-cbee698f6d53 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:39.780591 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-2a631930-8521-454b-ac0f-cbee698f6d53 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:29:39.788715 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-2a631930-8521-454b-ac0f-cbee698f6d53 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/4fb2a1f5-6eda-43fa-8905-b027199a538b" status: 200 len: 1203 microversion: 2.1 time: 0.156102 Sep 14 09:29:39.789384 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3092/6159] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:29:39 2022] GET /compute/v2.1/servers/4fb2a1f5-6eda-43fa-8905-b027199a538b => generated 1203 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:29:40.811522 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-780f4142-da34-43ce-ab48-c96fe7da8b7f tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:40.812089 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-780f4142-da34-43ce-ab48-c96fe7da8b7f tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: 4fb2a1f5-6eda-43fa-8905-b027199a538b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:40.819252 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-780f4142-da34-43ce-ab48-c96fe7da8b7f tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:40.819745 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-780f4142-da34-43ce-ab48-c96fe7da8b7f tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:40.820182 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-780f4142-da34-43ce-ab48-c96fe7da8b7f tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:40.821096 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-780f4142-da34-43ce-ab48-c96fe7da8b7f tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:40.821561 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-780f4142-da34-43ce-ab48-c96fe7da8b7f tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:40.822253 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-780f4142-da34-43ce-ab48-c96fe7da8b7f tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:40.959703 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-780f4142-da34-43ce-ab48-c96fe7da8b7f tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:29:40.967601 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-780f4142-da34-43ce-ab48-c96fe7da8b7f tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/4fb2a1f5-6eda-43fa-8905-b027199a538b" status: 200 len: 1203 microversion: 2.1 time: 0.160075 Sep 14 09:29:40.968173 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3068/6160] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:29:40 2022] GET /compute/v2.1/servers/4fb2a1f5-6eda-43fa-8905-b027199a538b => generated 1203 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:29:41.991390 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1bd0d082-6077-4345-851f-3c872aa737c5 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:41.992641 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-1bd0d082-6077-4345-851f-3c872aa737c5 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: 4fb2a1f5-6eda-43fa-8905-b027199a538b] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:41.995478 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=2 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:29:41.996397 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=6 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:29:42.003928 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1bd0d082-6077-4345-851f-3c872aa737c5 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:42.004440 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1bd0d082-6077-4345-851f-3c872aa737c5 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:42.004891 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1bd0d082-6077-4345-851f-3c872aa737c5 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:42.005618 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1bd0d082-6077-4345-851f-3c872aa737c5 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:42.006270 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1bd0d082-6077-4345-851f-3c872aa737c5 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:42.006707 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1bd0d082-6077-4345-851f-3c872aa737c5 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:42.157084 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-1bd0d082-6077-4345-851f-3c872aa737c5 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:29:42.166641 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-1bd0d082-6077-4345-851f-3c872aa737c5 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/4fb2a1f5-6eda-43fa-8905-b027199a538b" status: 200 len: 1203 microversion: 2.1 time: 0.178838 Sep 14 09:29:42.170974 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3093/6161] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:29:41 2022] GET /compute/v2.1/servers/4fb2a1f5-6eda-43fa-8905-b027199a538b => generated 1203 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:29:43.189601 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-2aca624f-1e91-46d8-82d3-9958a8c538bd tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:43.190229 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-2aca624f-1e91-46d8-82d3-9958a8c538bd tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: 4fb2a1f5-6eda-43fa-8905-b027199a538b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:43.193026 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=2 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:29:43.198778 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2aca624f-1e91-46d8-82d3-9958a8c538bd tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:43.199298 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2aca624f-1e91-46d8-82d3-9958a8c538bd tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:43.199756 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2aca624f-1e91-46d8-82d3-9958a8c538bd tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:43.200459 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2aca624f-1e91-46d8-82d3-9958a8c538bd tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:43.201095 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2aca624f-1e91-46d8-82d3-9958a8c538bd tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:43.201535 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2aca624f-1e91-46d8-82d3-9958a8c538bd tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:43.338221 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-2aca624f-1e91-46d8-82d3-9958a8c538bd tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:29:43.346231 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-2aca624f-1e91-46d8-82d3-9958a8c538bd tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/4fb2a1f5-6eda-43fa-8905-b027199a538b" status: 200 len: 1203 microversion: 2.1 time: 0.161281 Sep 14 09:29:43.346814 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3069/6162] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:29:43 2022] GET /compute/v2.1/servers/4fb2a1f5-6eda-43fa-8905-b027199a538b => generated 1203 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:29:44.369542 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-13d023fb-de2d-49d1-9231-867463751d67 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:44.370175 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-13d023fb-de2d-49d1-9231-867463751d67 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: 4fb2a1f5-6eda-43fa-8905-b027199a538b] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:44.378232 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-13d023fb-de2d-49d1-9231-867463751d67 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:44.378736 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-13d023fb-de2d-49d1-9231-867463751d67 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:44.379186 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-13d023fb-de2d-49d1-9231-867463751d67 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:44.379896 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-13d023fb-de2d-49d1-9231-867463751d67 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:44.380354 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-13d023fb-de2d-49d1-9231-867463751d67 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:44.380789 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-13d023fb-de2d-49d1-9231-867463751d67 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:44.531480 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-13d023fb-de2d-49d1-9231-867463751d67 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:29:44.539544 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-13d023fb-de2d-49d1-9231-867463751d67 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/4fb2a1f5-6eda-43fa-8905-b027199a538b" status: 200 len: 1203 microversion: 2.1 time: 0.174114 Sep 14 09:29:44.540120 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3094/6163] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:29:44 2022] GET /compute/v2.1/servers/4fb2a1f5-6eda-43fa-8905-b027199a538b => generated 1203 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:29:44.574985 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-142e5d0c-4483-465a-a750-869aab3294c4 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:29:44.577809 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-142e5d0c-4483-465a-a750-869aab3294c4 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: b93d32ea-ad59-46a2-ae7e-e23d66132271] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:44.584721 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-142e5d0c-4483-465a-a750-869aab3294c4 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:44.585216 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-142e5d0c-4483-465a-a750-869aab3294c4 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:44.585658 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-142e5d0c-4483-465a-a750-869aab3294c4 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:44.586530 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-142e5d0c-4483-465a-a750-869aab3294c4 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:44.587097 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-142e5d0c-4483-465a-a750-869aab3294c4 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:44.587666 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-142e5d0c-4483-465a-a750-869aab3294c4 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:44.641413 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-142e5d0c-4483-465a-a750-869aab3294c4 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "POST /compute/v2.1/servers/b93d32ea-ad59-46a2-ae7e-e23d66132271/action" status: 200 len: 24560 microversion: 2.1 time: 0.070363 Sep 14 09:29:44.649154 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3070/6164] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:29:44 2022] POST /compute/v2.1/servers/b93d32ea-ad59-46a2-ae7e-e23d66132271/action => generated 24560 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 14 09:29:45.563353 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-f62f78b6-5e77-4c25-9a5a-d4a51f1f2e77 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:45.563989 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-f62f78b6-5e77-4c25-9a5a-d4a51f1f2e77 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: 4fb2a1f5-6eda-43fa-8905-b027199a538b] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:45.571343 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f62f78b6-5e77-4c25-9a5a-d4a51f1f2e77 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:45.571834 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f62f78b6-5e77-4c25-9a5a-d4a51f1f2e77 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:45.572539 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f62f78b6-5e77-4c25-9a5a-d4a51f1f2e77 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:45.573261 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f62f78b6-5e77-4c25-9a5a-d4a51f1f2e77 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:45.573905 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f62f78b6-5e77-4c25-9a5a-d4a51f1f2e77 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:45.574346 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f62f78b6-5e77-4c25-9a5a-d4a51f1f2e77 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:45.720933 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-f62f78b6-5e77-4c25-9a5a-d4a51f1f2e77 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:29:45.729049 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-f62f78b6-5e77-4c25-9a5a-d4a51f1f2e77 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/4fb2a1f5-6eda-43fa-8905-b027199a538b" status: 200 len: 1203 microversion: 2.1 time: 0.169925 Sep 14 09:29:45.729745 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3095/6165] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:29:45 2022] GET /compute/v2.1/servers/4fb2a1f5-6eda-43fa-8905-b027199a538b => generated 1203 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:29:46.753038 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-73dfbd32-ea98-4cb8-8d13-46ced7d1f47a tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:46.754642 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-73dfbd32-ea98-4cb8-8d13-46ced7d1f47a tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: 4fb2a1f5-6eda-43fa-8905-b027199a538b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:46.762981 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-73dfbd32-ea98-4cb8-8d13-46ced7d1f47a tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:46.763487 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-73dfbd32-ea98-4cb8-8d13-46ced7d1f47a tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:46.763932 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-73dfbd32-ea98-4cb8-8d13-46ced7d1f47a tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:46.764644 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-73dfbd32-ea98-4cb8-8d13-46ced7d1f47a tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:46.765102 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-73dfbd32-ea98-4cb8-8d13-46ced7d1f47a tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:46.765533 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-73dfbd32-ea98-4cb8-8d13-46ced7d1f47a tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:46.911967 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-73dfbd32-ea98-4cb8-8d13-46ced7d1f47a tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:29:46.921936 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-73dfbd32-ea98-4cb8-8d13-46ced7d1f47a tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/4fb2a1f5-6eda-43fa-8905-b027199a538b" status: 200 len: 1203 microversion: 2.1 time: 0.173431 Sep 14 09:29:46.922809 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3071/6166] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:29:46 2022] GET /compute/v2.1/servers/4fb2a1f5-6eda-43fa-8905-b027199a538b => generated 1203 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:29:47.944846 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-2743a9a8-f11e-4881-a53e-6f45e6404e75 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:47.945726 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-2743a9a8-f11e-4881-a53e-6f45e6404e75 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: 4fb2a1f5-6eda-43fa-8905-b027199a538b] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:47.953393 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2743a9a8-f11e-4881-a53e-6f45e6404e75 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:47.953923 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2743a9a8-f11e-4881-a53e-6f45e6404e75 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:47.954372 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2743a9a8-f11e-4881-a53e-6f45e6404e75 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:47.955111 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2743a9a8-f11e-4881-a53e-6f45e6404e75 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:47.955732 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2743a9a8-f11e-4881-a53e-6f45e6404e75 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:47.957163 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2743a9a8-f11e-4881-a53e-6f45e6404e75 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:48.118846 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-2743a9a8-f11e-4881-a53e-6f45e6404e75 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:29:48.126824 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-2743a9a8-f11e-4881-a53e-6f45e6404e75 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/4fb2a1f5-6eda-43fa-8905-b027199a538b" status: 200 len: 1203 microversion: 2.1 time: 0.186201 Sep 14 09:29:48.127531 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3096/6167] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:29:47 2022] GET /compute/v2.1/servers/4fb2a1f5-6eda-43fa-8905-b027199a538b => generated 1203 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:29:49.149676 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8694f6df-f57a-413f-9263-447e92f0411a tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:49.150452 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-8694f6df-f57a-413f-9263-447e92f0411a tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: 4fb2a1f5-6eda-43fa-8905-b027199a538b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:49.157294 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8694f6df-f57a-413f-9263-447e92f0411a tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:49.157861 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8694f6df-f57a-413f-9263-447e92f0411a tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:49.158376 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8694f6df-f57a-413f-9263-447e92f0411a tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:49.159188 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8694f6df-f57a-413f-9263-447e92f0411a tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:49.159722 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8694f6df-f57a-413f-9263-447e92f0411a tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:49.160226 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8694f6df-f57a-413f-9263-447e92f0411a tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:49.291861 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-8694f6df-f57a-413f-9263-447e92f0411a tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:29:49.301414 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-8694f6df-f57a-413f-9263-447e92f0411a tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/4fb2a1f5-6eda-43fa-8905-b027199a538b" status: 200 len: 1203 microversion: 2.1 time: 0.154954 Sep 14 09:29:49.306984 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3072/6168] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:29:49 2022] GET /compute/v2.1/servers/4fb2a1f5-6eda-43fa-8905-b027199a538b => generated 1203 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:29:49.459443 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-70c15b7d-057d-4b26-8624-22ea8eb586ac req-c5d8bb7c-ba88-41d8-9c64-2fd63f309704 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fb2a1f5-6eda-43fa-8905-b027199a538b", "name": "network-vif-plugged", "status": "completed", "tag": "354adc34-dbe2-480f-a9ce-a225ce67a454"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:29:49.471630 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-70c15b7d-057d-4b26-8624-22ea8eb586ac req-c5d8bb7c-ba88-41d8-9c64-2fd63f309704 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:49.472136 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-70c15b7d-057d-4b26-8624-22ea8eb586ac req-c5d8bb7c-ba88-41d8-9c64-2fd63f309704 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:49.472536 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-70c15b7d-057d-4b26-8624-22ea8eb586ac req-c5d8bb7c-ba88-41d8-9c64-2fd63f309704 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:49.487838 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-70c15b7d-057d-4b26-8624-22ea8eb586ac req-c5d8bb7c-ba88-41d8-9c64-2fd63f309704 service nova] Creating event network-vif-plugged:354adc34-dbe2-480f-a9ce-a225ce67a454 for instance 4fb2a1f5-6eda-43fa-8905-b027199a538b on n-h1-836830-18 Sep 14 09:29:49.494919 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-70c15b7d-057d-4b26-8624-22ea8eb586ac req-c5d8bb7c-ba88-41d8-9c64-2fd63f309704 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038953 Sep 14 09:29:49.496097 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3097/6169] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:29:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:29:50.324643 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-7241a836-879c-4e8d-ba8c-68288ee0840c tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:50.325182 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-7241a836-879c-4e8d-ba8c-68288ee0840c tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: 4fb2a1f5-6eda-43fa-8905-b027199a538b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:50.332054 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7241a836-879c-4e8d-ba8c-68288ee0840c tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:50.332538 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7241a836-879c-4e8d-ba8c-68288ee0840c tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:50.332973 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7241a836-879c-4e8d-ba8c-68288ee0840c tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:50.333666 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7241a836-879c-4e8d-ba8c-68288ee0840c tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:50.334123 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7241a836-879c-4e8d-ba8c-68288ee0840c tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:50.334547 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7241a836-879c-4e8d-ba8c-68288ee0840c tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:50.474359 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-7241a836-879c-4e8d-ba8c-68288ee0840c tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:29:50.485454 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-7241a836-879c-4e8d-ba8c-68288ee0840c tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/4fb2a1f5-6eda-43fa-8905-b027199a538b" status: 200 len: 1203 microversion: 2.1 time: 0.165009 Sep 14 09:29:50.486039 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3073/6170] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:29:50 2022] GET /compute/v2.1/servers/4fb2a1f5-6eda-43fa-8905-b027199a538b => generated 1203 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:29:51.510173 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-e5fc269b-a191-4605-bfd0-bc7e291fc633 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:51.510831 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-e5fc269b-a191-4605-bfd0-bc7e291fc633 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: 4fb2a1f5-6eda-43fa-8905-b027199a538b] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:51.517515 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e5fc269b-a191-4605-bfd0-bc7e291fc633 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:51.518008 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e5fc269b-a191-4605-bfd0-bc7e291fc633 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:51.518458 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e5fc269b-a191-4605-bfd0-bc7e291fc633 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:51.519208 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e5fc269b-a191-4605-bfd0-bc7e291fc633 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:51.519671 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e5fc269b-a191-4605-bfd0-bc7e291fc633 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:51.520101 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e5fc269b-a191-4605-bfd0-bc7e291fc633 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:51.663261 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-e5fc269b-a191-4605-bfd0-bc7e291fc633 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:29:51.672715 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-e5fc269b-a191-4605-bfd0-bc7e291fc633 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/4fb2a1f5-6eda-43fa-8905-b027199a538b" status: 200 len: 1387 microversion: 2.1 time: 0.167841 Sep 14 09:29:51.673501 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3098/6171] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:29:51 2022] GET /compute/v2.1/servers/4fb2a1f5-6eda-43fa-8905-b027199a538b => generated 1387 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:29:51.695700 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-5da90c47-8569-41a3-b994-3b1f33f679d7 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:51.696332 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-5da90c47-8569-41a3-b994-3b1f33f679d7 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: 4fb2a1f5-6eda-43fa-8905-b027199a538b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:51.703509 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5da90c47-8569-41a3-b994-3b1f33f679d7 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:51.703991 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5da90c47-8569-41a3-b994-3b1f33f679d7 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:51.704422 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5da90c47-8569-41a3-b994-3b1f33f679d7 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:51.705114 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5da90c47-8569-41a3-b994-3b1f33f679d7 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:51.706149 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5da90c47-8569-41a3-b994-3b1f33f679d7 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:51.706598 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5da90c47-8569-41a3-b994-3b1f33f679d7 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:51.853201 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-5da90c47-8569-41a3-b994-3b1f33f679d7 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:29:51.861074 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-5da90c47-8569-41a3-b994-3b1f33f679d7 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/4fb2a1f5-6eda-43fa-8905-b027199a538b" status: 200 len: 1387 microversion: 2.1 time: 0.169300 Sep 14 09:29:51.861665 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3074/6172] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:29:51 2022] GET /compute/v2.1/servers/4fb2a1f5-6eda-43fa-8905-b027199a538b => generated 1387 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:29:51.884405 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-15f463ef-b632-4175-afa8-b6314c06b933 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:51.885029 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-15f463ef-b632-4175-afa8-b6314c06b933 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: 4fb2a1f5-6eda-43fa-8905-b027199a538b] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:51.891334 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-15f463ef-b632-4175-afa8-b6314c06b933 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:51.891772 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-15f463ef-b632-4175-afa8-b6314c06b933 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:51.892208 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-15f463ef-b632-4175-afa8-b6314c06b933 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:51.892905 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-15f463ef-b632-4175-afa8-b6314c06b933 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:51.893903 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-15f463ef-b632-4175-afa8-b6314c06b933 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:51.894412 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-15f463ef-b632-4175-afa8-b6314c06b933 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:52.026208 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-15f463ef-b632-4175-afa8-b6314c06b933 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:29:52.034244 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-15f463ef-b632-4175-afa8-b6314c06b933 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/4fb2a1f5-6eda-43fa-8905-b027199a538b" status: 200 len: 1387 microversion: 2.1 time: 0.153911 Sep 14 09:29:52.034821 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3099/6173] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:29:51 2022] GET /compute/v2.1/servers/4fb2a1f5-6eda-43fa-8905-b027199a538b => generated 1387 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:29:52.055974 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-62d76213-8426-408a-ab1b-c9366cfde02d tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:52.056499 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-62d76213-8426-408a-ab1b-c9366cfde02d tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: 4fb2a1f5-6eda-43fa-8905-b027199a538b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:52.062469 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-62d76213-8426-408a-ab1b-c9366cfde02d tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:52.062976 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-62d76213-8426-408a-ab1b-c9366cfde02d tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:52.063685 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-62d76213-8426-408a-ab1b-c9366cfde02d tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:52.064520 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-62d76213-8426-408a-ab1b-c9366cfde02d tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:52.066641 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-62d76213-8426-408a-ab1b-c9366cfde02d tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:52.066764 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-62d76213-8426-408a-ab1b-c9366cfde02d tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:52.093947 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-62d76213-8426-408a-ab1b-c9366cfde02d tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: 4fb2a1f5-6eda-43fa-8905-b027199a538b] Going to try to terminate instance {{(pid=128759) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:29:52.169155 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-62d76213-8426-408a-ab1b-c9366cfde02d tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "DELETE /compute/v2.1/servers/4fb2a1f5-6eda-43fa-8905-b027199a538b" status: 204 len: 0 microversion: 2.1 time: 0.116884 Sep 14 09:29:52.169848 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3075/6174] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:29:52 2022] DELETE /compute/v2.1/servers/4fb2a1f5-6eda-43fa-8905-b027199a538b => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:29:52.178443 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-6785337c-fbb8-4a01-9a77-276de6ceaa70 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:52.179187 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-6785337c-fbb8-4a01-9a77-276de6ceaa70 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: 4fb2a1f5-6eda-43fa-8905-b027199a538b] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:52.185732 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6785337c-fbb8-4a01-9a77-276de6ceaa70 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:52.186229 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6785337c-fbb8-4a01-9a77-276de6ceaa70 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:52.186663 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6785337c-fbb8-4a01-9a77-276de6ceaa70 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:52.187418 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6785337c-fbb8-4a01-9a77-276de6ceaa70 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:52.187877 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6785337c-fbb8-4a01-9a77-276de6ceaa70 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:52.188306 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6785337c-fbb8-4a01-9a77-276de6ceaa70 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:52.326083 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-6785337c-fbb8-4a01-9a77-276de6ceaa70 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:29:52.334710 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-6785337c-fbb8-4a01-9a77-276de6ceaa70 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/4fb2a1f5-6eda-43fa-8905-b027199a538b" status: 200 len: 1393 microversion: 2.1 time: 0.160618 Sep 14 09:29:52.335329 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3100/6175] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:29:52 2022] GET /compute/v2.1/servers/4fb2a1f5-6eda-43fa-8905-b027199a538b => generated 1393 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:29:53.359846 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-802963d4-b558-444c-8e74-5817bcae6f4e tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:53.360725 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-802963d4-b558-444c-8e74-5817bcae6f4e tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: 4fb2a1f5-6eda-43fa-8905-b027199a538b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:53.369881 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-802963d4-b558-444c-8e74-5817bcae6f4e tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:53.370668 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-802963d4-b558-444c-8e74-5817bcae6f4e tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:53.371159 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-802963d4-b558-444c-8e74-5817bcae6f4e tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:53.372166 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-802963d4-b558-444c-8e74-5817bcae6f4e tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:53.372836 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-802963d4-b558-444c-8e74-5817bcae6f4e tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:53.373750 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-802963d4-b558-444c-8e74-5817bcae6f4e tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:53.515131 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-802963d4-b558-444c-8e74-5817bcae6f4e tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:29:53.524618 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-802963d4-b558-444c-8e74-5817bcae6f4e tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/4fb2a1f5-6eda-43fa-8905-b027199a538b" status: 200 len: 1393 microversion: 2.1 time: 0.170681 Sep 14 09:29:53.525315 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3076/6176] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:29:53 2022] GET /compute/v2.1/servers/4fb2a1f5-6eda-43fa-8905-b027199a538b => generated 1393 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:29:54.305689 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-9b9c6aec-2f3c-4ee1-acff-6145f5e0a3ff req-e20f5d03-6bd9-46f1-b702-efffb2562f5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fb2a1f5-6eda-43fa-8905-b027199a538b", "name": "network-vif-deleted", "tag": "354adc34-dbe2-480f-a9ce-a225ce67a454"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:29:54.329128 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:29:54.336479 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-9b9c6aec-2f3c-4ee1-acff-6145f5e0a3ff req-e20f5d03-6bd9-46f1-b702-efffb2562f5e service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:54.336986 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-9b9c6aec-2f3c-4ee1-acff-6145f5e0a3ff req-e20f5d03-6bd9-46f1-b702-efffb2562f5e service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:54.337518 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-9b9c6aec-2f3c-4ee1-acff-6145f5e0a3ff req-e20f5d03-6bd9-46f1-b702-efffb2562f5e service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:54.358709 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-9b9c6aec-2f3c-4ee1-acff-6145f5e0a3ff req-e20f5d03-6bd9-46f1-b702-efffb2562f5e service nova] Creating event network-vif-deleted:354adc34-dbe2-480f-a9ce-a225ce67a454 for instance 4fb2a1f5-6eda-43fa-8905-b027199a538b on n-h1-836830-18 Sep 14 09:29:54.365144 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-9b9c6aec-2f3c-4ee1-acff-6145f5e0a3ff req-e20f5d03-6bd9-46f1-b702-efffb2562f5e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063645 Sep 14 09:29:54.365778 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3101/6177] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:29:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:29:54.550387 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9e7d8a4c-de07-473d-9c17-c2eec2ed746b tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:54.551031 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-9e7d8a4c-de07-473d-9c17-c2eec2ed746b tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: 4fb2a1f5-6eda-43fa-8905-b027199a538b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:54.565560 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9e7d8a4c-de07-473d-9c17-c2eec2ed746b tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:54.566060 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9e7d8a4c-de07-473d-9c17-c2eec2ed746b tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:54.566499 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9e7d8a4c-de07-473d-9c17-c2eec2ed746b tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:54.567433 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9e7d8a4c-de07-473d-9c17-c2eec2ed746b tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:54.573991 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9e7d8a4c-de07-473d-9c17-c2eec2ed746b tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:54.574792 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9e7d8a4c-de07-473d-9c17-c2eec2ed746b tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:54.653118 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-9e7d8a4c-de07-473d-9c17-c2eec2ed746b tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:29:54.661819 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-9e7d8a4c-de07-473d-9c17-c2eec2ed746b tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/4fb2a1f5-6eda-43fa-8905-b027199a538b" status: 200 len: 1188 microversion: 2.1 time: 0.116387 Sep 14 09:29:54.662395 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3077/6178] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:29:54 2022] GET /compute/v2.1/servers/4fb2a1f5-6eda-43fa-8905-b027199a538b => generated 1188 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:29:55.658213 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ac886bdc-326e-4a63-ba7d-b97bc84ed55e tempest-TestNetworkAdvancedServerOps-649526860 tempest-TestNetworkAdvancedServerOps-649526860-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:55.659004 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-ac886bdc-326e-4a63-ba7d-b97bc84ed55e tempest-TestNetworkAdvancedServerOps-649526860 tempest-TestNetworkAdvancedServerOps-649526860-project-admin] [instance: b93d32ea-ad59-46a2-ae7e-e23d66132271] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:55.666053 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ac886bdc-326e-4a63-ba7d-b97bc84ed55e tempest-TestNetworkAdvancedServerOps-649526860 tempest-TestNetworkAdvancedServerOps-649526860-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:55.666542 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ac886bdc-326e-4a63-ba7d-b97bc84ed55e tempest-TestNetworkAdvancedServerOps-649526860 tempest-TestNetworkAdvancedServerOps-649526860-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:55.667003 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ac886bdc-326e-4a63-ba7d-b97bc84ed55e tempest-TestNetworkAdvancedServerOps-649526860 tempest-TestNetworkAdvancedServerOps-649526860-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:55.667705 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ac886bdc-326e-4a63-ba7d-b97bc84ed55e tempest-TestNetworkAdvancedServerOps-649526860 tempest-TestNetworkAdvancedServerOps-649526860-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:55.668161 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ac886bdc-326e-4a63-ba7d-b97bc84ed55e tempest-TestNetworkAdvancedServerOps-649526860 tempest-TestNetworkAdvancedServerOps-649526860-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:55.668583 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ac886bdc-326e-4a63-ba7d-b97bc84ed55e tempest-TestNetworkAdvancedServerOps-649526860 tempest-TestNetworkAdvancedServerOps-649526860-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:55.687590 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-89c32200-f082-4b09-9e77-a87a306597d0 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:55.690593 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-89c32200-f082-4b09-9e77-a87a306597d0 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: 4fb2a1f5-6eda-43fa-8905-b027199a538b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:55.700611 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-89c32200-f082-4b09-9e77-a87a306597d0 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:55.701341 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-89c32200-f082-4b09-9e77-a87a306597d0 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:55.702051 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-89c32200-f082-4b09-9e77-a87a306597d0 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:55.703112 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-89c32200-f082-4b09-9e77-a87a306597d0 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:55.703732 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-89c32200-f082-4b09-9e77-a87a306597d0 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:55.704336 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-89c32200-f082-4b09-9e77-a87a306597d0 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:55.806427 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-89c32200-f082-4b09-9e77-a87a306597d0 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:29:55.815368 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-89c32200-f082-4b09-9e77-a87a306597d0 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/4fb2a1f5-6eda-43fa-8905-b027199a538b" status: 200 len: 1188 microversion: 2.1 time: 0.133293 Sep 14 09:29:55.816391 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3078/6179] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:29:55 2022] GET /compute/v2.1/servers/4fb2a1f5-6eda-43fa-8905-b027199a538b => generated 1188 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:29:55.961047 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-ac886bdc-326e-4a63-ba7d-b97bc84ed55e tempest-TestNetworkAdvancedServerOps-649526860 tempest-TestNetworkAdvancedServerOps-649526860-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/b93d32ea-ad59-46a2-ae7e-e23d66132271" status: 200 len: 1832 microversion: 2.1 time: 0.307103 Sep 14 09:29:55.961689 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3102/6180] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:29:55 2022] GET /compute/v2.1/servers/b93d32ea-ad59-46a2-ae7e-e23d66132271 => generated 1832 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:29:55.984856 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f6ff1f3d-a783-4966-a395-842f750c21f1 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:55.985574 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f6ff1f3d-a783-4966-a395-842f750c21f1 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: b93d32ea-ad59-46a2-ae7e-e23d66132271] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:55.993220 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f6ff1f3d-a783-4966-a395-842f750c21f1 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:55.993825 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f6ff1f3d-a783-4966-a395-842f750c21f1 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:55.994355 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f6ff1f3d-a783-4966-a395-842f750c21f1 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:55.995188 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f6ff1f3d-a783-4966-a395-842f750c21f1 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:55.995728 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f6ff1f3d-a783-4966-a395-842f750c21f1 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:55.996255 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f6ff1f3d-a783-4966-a395-842f750c21f1 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:56.154236 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f6ff1f3d-a783-4966-a395-842f750c21f1 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725d7beb4ec54b86a455af0d7bd0ce19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c197eded81494b818b1e56f4c01432c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:29:56.163907 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f6ff1f3d-a783-4966-a395-842f750c21f1 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/b93d32ea-ad59-46a2-ae7e-e23d66132271" status: 200 len: 1679 microversion: 2.1 time: 0.183047 Sep 14 09:29:56.164862 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3079/6181] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:29:55 2022] GET /compute/v2.1/servers/b93d32ea-ad59-46a2-ae7e-e23d66132271 => generated 1679 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:29:56.270218 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-58b378c4-2006-41cc-a240-9fd6378f0c04 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:29:56.272699 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-58b378c4-2006-41cc-a240-9fd6378f0c04 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: b93d32ea-ad59-46a2-ae7e-e23d66132271] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:56.279624 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-58b378c4-2006-41cc-a240-9fd6378f0c04 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:56.280365 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-58b378c4-2006-41cc-a240-9fd6378f0c04 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:56.280973 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-58b378c4-2006-41cc-a240-9fd6378f0c04 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:56.281849 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-58b378c4-2006-41cc-a240-9fd6378f0c04 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:56.282477 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-58b378c4-2006-41cc-a240-9fd6378f0c04 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:56.283098 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-58b378c4-2006-41cc-a240-9fd6378f0c04 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:56.339292 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-58b378c4-2006-41cc-a240-9fd6378f0c04 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "POST /compute/v2.1/servers/b93d32ea-ad59-46a2-ae7e-e23d66132271/action" status: 200 len: 32637 microversion: 2.1 time: 0.072969 Sep 14 09:29:56.340792 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3103/6182] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:29:56 2022] POST /compute/v2.1/servers/b93d32ea-ad59-46a2-ae7e-e23d66132271/action => generated 32637 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 09:29:56.529061 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e1fcbf8b-f743-4788-8ee1-e307e57f7746 tempest-TestNetworkAdvancedServerOps-649526860 tempest-TestNetworkAdvancedServerOps-649526860-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:29:56.529649 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e1fcbf8b-f743-4788-8ee1-e307e57f7746 tempest-TestNetworkAdvancedServerOps-649526860 tempest-TestNetworkAdvancedServerOps-649526860-project-admin] [instance: b93d32ea-ad59-46a2-ae7e-e23d66132271] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:56.535705 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e1fcbf8b-f743-4788-8ee1-e307e57f7746 tempest-TestNetworkAdvancedServerOps-649526860 tempest-TestNetworkAdvancedServerOps-649526860-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:56.536415 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e1fcbf8b-f743-4788-8ee1-e307e57f7746 tempest-TestNetworkAdvancedServerOps-649526860 tempest-TestNetworkAdvancedServerOps-649526860-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:56.536858 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e1fcbf8b-f743-4788-8ee1-e307e57f7746 tempest-TestNetworkAdvancedServerOps-649526860 tempest-TestNetworkAdvancedServerOps-649526860-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:56.537556 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e1fcbf8b-f743-4788-8ee1-e307e57f7746 tempest-TestNetworkAdvancedServerOps-649526860 tempest-TestNetworkAdvancedServerOps-649526860-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:56.538017 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e1fcbf8b-f743-4788-8ee1-e307e57f7746 tempest-TestNetworkAdvancedServerOps-649526860 tempest-TestNetworkAdvancedServerOps-649526860-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:56.538450 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e1fcbf8b-f743-4788-8ee1-e307e57f7746 tempest-TestNetworkAdvancedServerOps-649526860 tempest-TestNetworkAdvancedServerOps-649526860-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:56.542349 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:29:56.714583 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-e1fcbf8b-f743-4788-8ee1-e307e57f7746 tempest-TestNetworkAdvancedServerOps-649526860 tempest-TestNetworkAdvancedServerOps-649526860-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '2cc32fcc100b4dd596a125f43d53478e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71758c2c779457c9f5bab55d0918ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:29:56.715426 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e1fcbf8b-f743-4788-8ee1-e307e57f7746 tempest-TestNetworkAdvancedServerOps-649526860 tempest-TestNetworkAdvancedServerOps-649526860-project-admin] [instance: b93d32ea-ad59-46a2-ae7e-e23d66132271] flavor_id is None. Assuming migration. {{(pid=128759) resize /opt/stack/nova/nova/compute/api.py:4196}} Sep 14 09:29:56.715966 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e1fcbf8b-f743-4788-8ee1-e307e57f7746 tempest-TestNetworkAdvancedServerOps-649526860 tempest-TestNetworkAdvancedServerOps-649526860-project-admin] [instance: b93d32ea-ad59-46a2-ae7e-e23d66132271] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=128759) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 14 09:29:56.844999 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-25b77102-34df-4c51-9b46-7c019edd09ba tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:56.847874 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-25b77102-34df-4c51-9b46-7c019edd09ba tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: 4fb2a1f5-6eda-43fa-8905-b027199a538b] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:56.859516 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-25b77102-34df-4c51-9b46-7c019edd09ba tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:56.860306 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-25b77102-34df-4c51-9b46-7c019edd09ba tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:56.860950 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-25b77102-34df-4c51-9b46-7c019edd09ba tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:56.862976 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-25b77102-34df-4c51-9b46-7c019edd09ba tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:56.863805 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-25b77102-34df-4c51-9b46-7c019edd09ba tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:56.864317 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-25b77102-34df-4c51-9b46-7c019edd09ba tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:56.961500 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-25b77102-34df-4c51-9b46-7c019edd09ba tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:29:56.970577 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-25b77102-34df-4c51-9b46-7c019edd09ba tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/4fb2a1f5-6eda-43fa-8905-b027199a538b" status: 200 len: 1188 microversion: 2.1 time: 0.133815 Sep 14 09:29:56.971596 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3104/6183] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:29:56 2022] GET /compute/v2.1/servers/4fb2a1f5-6eda-43fa-8905-b027199a538b => generated 1188 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:29:57.050796 n-d-836830-18 devstack@n-api.service[128759]: ERROR oslo.messaging._drivers.impl_rabbit [None req-e1fcbf8b-f743-4788-8ee1-e307e57f7746 tempest-TestNetworkAdvancedServerOps-649526860 tempest-TestNetworkAdvancedServerOps-649526860-project-admin] [c929dee3-a6e6-4809-84ec-28ddfd015ab1] AMQP server on 10.222.0.60:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 14 09:29:57.993691 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-403d7fcb-61c1-41ef-aace-87c76314103a tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:57.994318 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-403d7fcb-61c1-41ef-aace-87c76314103a tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: 4fb2a1f5-6eda-43fa-8905-b027199a538b] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:58.001384 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-403d7fcb-61c1-41ef-aace-87c76314103a tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:58.001884 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-403d7fcb-61c1-41ef-aace-87c76314103a tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:58.002867 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-403d7fcb-61c1-41ef-aace-87c76314103a tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:58.003607 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-403d7fcb-61c1-41ef-aace-87c76314103a tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:58.004072 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-403d7fcb-61c1-41ef-aace-87c76314103a tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:58.004507 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-403d7fcb-61c1-41ef-aace-87c76314103a tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:58.059870 n-d-836830-18 devstack@n-api.service[128759]: INFO oslo.messaging._drivers.impl_rabbit [None req-e1fcbf8b-f743-4788-8ee1-e307e57f7746 tempest-TestNetworkAdvancedServerOps-649526860 tempest-TestNetworkAdvancedServerOps-649526860-project-admin] [c929dee3-a6e6-4809-84ec-28ddfd015ab1] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 41536. Sep 14 09:29:58.063640 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e1fcbf8b-f743-4788-8ee1-e307e57f7746 tempest-TestNetworkAdvancedServerOps-649526860 tempest-TestNetworkAdvancedServerOps-649526860-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/b93d32ea-ad59-46a2-ae7e-e23d66132271/action" status: 202 len: 0 microversion: 2.1 time: 1.538375 Sep 14 09:29:58.066213 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3080/6184] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:29:56 2022] POST /compute/v2.1/servers/b93d32ea-ad59-46a2-ae7e-e23d66132271/action => generated 0 bytes in 1541 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:29:58.074602 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-97f4017d-1403-4728-b727-8096e7a843df tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:58.075321 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-97f4017d-1403-4728-b727-8096e7a843df tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: b93d32ea-ad59-46a2-ae7e-e23d66132271] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:58.091401 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-97f4017d-1403-4728-b727-8096e7a843df tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:58.092196 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-97f4017d-1403-4728-b727-8096e7a843df tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:58.092863 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-97f4017d-1403-4728-b727-8096e7a843df tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:58.095142 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-97f4017d-1403-4728-b727-8096e7a843df tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:58.096515 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-97f4017d-1403-4728-b727-8096e7a843df tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:58.098085 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-97f4017d-1403-4728-b727-8096e7a843df tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:58.120424 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-403d7fcb-61c1-41ef-aace-87c76314103a tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:29:58.135912 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-403d7fcb-61c1-41ef-aace-87c76314103a tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/4fb2a1f5-6eda-43fa-8905-b027199a538b" status: 200 len: 1188 microversion: 2.1 time: 0.144151 Sep 14 09:29:58.137755 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3105/6185] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:29:57 2022] GET /compute/v2.1/servers/4fb2a1f5-6eda-43fa-8905-b027199a538b => generated 1188 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:29:58.295782 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-97f4017d-1403-4728-b727-8096e7a843df tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725d7beb4ec54b86a455af0d7bd0ce19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c197eded81494b818b1e56f4c01432c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:29:58.306007 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-97f4017d-1403-4728-b727-8096e7a843df tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/b93d32ea-ad59-46a2-ae7e-e23d66132271" status: 200 len: 1688 microversion: 2.1 time: 0.235238 Sep 14 09:29:58.306733 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3081/6186] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:29:58 2022] GET /compute/v2.1/servers/b93d32ea-ad59-46a2-ae7e-e23d66132271 => generated 1688 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:29:59.167990 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b2f5c173-dc55-4612-806c-5826ab27cf58 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:59.168564 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-b2f5c173-dc55-4612-806c-5826ab27cf58 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: 4fb2a1f5-6eda-43fa-8905-b027199a538b] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:59.176465 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b2f5c173-dc55-4612-806c-5826ab27cf58 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:59.176948 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b2f5c173-dc55-4612-806c-5826ab27cf58 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:59.177394 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b2f5c173-dc55-4612-806c-5826ab27cf58 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:59.178116 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b2f5c173-dc55-4612-806c-5826ab27cf58 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:59.178578 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b2f5c173-dc55-4612-806c-5826ab27cf58 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:59.179063 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b2f5c173-dc55-4612-806c-5826ab27cf58 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:59.215565 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b2f5c173-dc55-4612-806c-5826ab27cf58 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:59.216023 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b2f5c173-dc55-4612-806c-5826ab27cf58 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:59.216455 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b2f5c173-dc55-4612-806c-5826ab27cf58 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:59.216903 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.objects.instance [None req-b2f5c173-dc55-4612-806c-5826ab27cf58 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lazy-loading 'fault' on Instance uuid 4fb2a1f5-6eda-43fa-8905-b027199a538b {{(pid=128758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:29:59.266749 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-b2f5c173-dc55-4612-806c-5826ab27cf58 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:29:59.277688 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-b2f5c173-dc55-4612-806c-5826ab27cf58 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/4fb2a1f5-6eda-43fa-8905-b027199a538b" status: 200 len: 1193 microversion: 2.1 time: 0.113893 Sep 14 09:29:59.278404 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3106/6187] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:29:59 2022] GET /compute/v2.1/servers/4fb2a1f5-6eda-43fa-8905-b027199a538b => generated 1193 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:29:59.333361 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-93cdcc65-db60-41ad-a7ff-64a8891d7cf5 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:59.334221 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-93cdcc65-db60-41ad-a7ff-64a8891d7cf5 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: b93d32ea-ad59-46a2-ae7e-e23d66132271] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:59.341649 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-93cdcc65-db60-41ad-a7ff-64a8891d7cf5 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:59.342311 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-93cdcc65-db60-41ad-a7ff-64a8891d7cf5 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:59.342992 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-93cdcc65-db60-41ad-a7ff-64a8891d7cf5 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:59.343870 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-93cdcc65-db60-41ad-a7ff-64a8891d7cf5 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:59.344584 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-93cdcc65-db60-41ad-a7ff-64a8891d7cf5 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:59.345213 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-93cdcc65-db60-41ad-a7ff-64a8891d7cf5 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:59.503446 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-93cdcc65-db60-41ad-a7ff-64a8891d7cf5 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725d7beb4ec54b86a455af0d7bd0ce19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c197eded81494b818b1e56f4c01432c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:29:59.513631 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-93cdcc65-db60-41ad-a7ff-64a8891d7cf5 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/b93d32ea-ad59-46a2-ae7e-e23d66132271" status: 200 len: 1688 microversion: 2.1 time: 0.186823 Sep 14 09:29:59.514240 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3082/6188] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:29:59 2022] GET /compute/v2.1/servers/b93d32ea-ad59-46a2-ae7e-e23d66132271 => generated 1688 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:30:00.301594 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-60c4bbeb-c79e-4fd9-ac96-c7998b7c3eb0 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:00.302246 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-60c4bbeb-c79e-4fd9-ac96-c7998b7c3eb0 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: 4fb2a1f5-6eda-43fa-8905-b027199a538b] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:30:00.309570 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-60c4bbeb-c79e-4fd9-ac96-c7998b7c3eb0 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:00.310069 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-60c4bbeb-c79e-4fd9-ac96-c7998b7c3eb0 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:00.310511 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-60c4bbeb-c79e-4fd9-ac96-c7998b7c3eb0 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:00.311253 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-60c4bbeb-c79e-4fd9-ac96-c7998b7c3eb0 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:00.311711 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-60c4bbeb-c79e-4fd9-ac96-c7998b7c3eb0 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:00.312142 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-60c4bbeb-c79e-4fd9-ac96-c7998b7c3eb0 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:00.327150 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-60c4bbeb-c79e-4fd9-ac96-c7998b7c3eb0 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] HTTP exception thrown: Instance 4fb2a1f5-6eda-43fa-8905-b027199a538b could not be found. Sep 14 09:30:00.328838 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-60c4bbeb-c79e-4fd9-ac96-c7998b7c3eb0 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Request method failure captured: Sep 14 09:30:00.328838 n-d-836830-18 devstack@n-api.service[128758]: request: GET /compute/v2.1/servers/4fb2a1f5-6eda-43fa-8905-b027199a538b HTTP/1.1 Sep 14 09:30:00.328838 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 09:30:00.328838 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 09:30:00.328838 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 09:30:00.328838 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 09:30:00.328838 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 09:30:00.328838 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 09:30:00.328838 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 09:30:00.328838 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 09:30:00.328838 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZ7vSEasHnu7hRXol9c-LZuMaC9uK137X6F5rG7UmloUJeCaIX1XI8DyW-6MYPzXIn8tJlRUDBfS9Xo7ko5WvlkRtwNLi8r30OmEJBkLllR4uOPeHedowZTMuQPwQppwmIxlx0K05UlAJOyH1eD16mNE7GFFk01jmhPM_9wCZyZUFi8 Sep 14 09:30:00.328838 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 09:30:00.328838 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 09:30:00.328838 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 09:30:00.328838 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 09:30:00.328838 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 09:30:00.328838 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 09:30:00.328838 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 0fca803d9ffa4b4ab0371c0d6a96a5a2 Sep 14 09:30:00.328838 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-TestVolumeBootPattern-1945148622 Sep 14 09:30:00.328838 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 09:30:00.328838 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 09:30:00.328838 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0fca803d9ffa4b4ab0371c0d6a96a5a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0fca803d9ffa4b4ab0371c0d6a96a5a2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0fca803d9ffa4b4ab0371c0d6a96a5a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0fca803d9ffa4b4ab0371c0d6a96a5a2"}]}] Sep 14 09:30:00.328838 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-TestVolumeBootPattern-1945148622 Sep 14 09:30:00.328838 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 0fca803d9ffa4b4ab0371c0d6a96a5a2 Sep 14 09:30:00.328838 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-TestVolumeBootPattern-1945148622 Sep 14 09:30:00.328838 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-TestVolumeBootPattern-1945148622-project Sep 14 09:30:00.328838 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 09:30:00.328838 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 09:30:00.328838 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 80257054a25540c294e1787780b601b4 Sep 14 09:30:00.328838 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-TestVolumeBootPattern-1945148622-project Sep 14 09:30:00.328838 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 09:30:00.328838 n-d-836830-18 devstack@n-api.service[128758]: exception: Instance 4fb2a1f5-6eda-43fa-8905-b027199a538b could not be found. Sep 14 09:30:00.328838 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': '4fb2a1f5-6eda-43fa-8905-b027199a538b'} Sep 14 09:30:00.328838 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:30:00.328838 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:30:00.328838 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:30:00.328838 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:30:00.328838 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:30:00.328838 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:30:00.328838 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:30:00.328838 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:30:00.328838 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:30:00.328838 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:30:00.328838 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4fb2a1f5-6eda-43fa-8905-b027199a538b could not be found. Sep 14 09:30:00.328838 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:30:00.328838 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:30:00.328838 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:30:00.328838 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:30:00.328838 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:30:00.328838 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:30:00.328838 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:30:00.328838 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:30:00.328838 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:30:00.328838 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:30:00.328838 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:30:00.328838 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:30:00.328838 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:30:00.328838 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:30:00.328838 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:30:00.328838 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:30:00.328838 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4fb2a1f5-6eda-43fa-8905-b027199a538b could not be found. Sep 14 09:30:00.328838 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:30:00.328838 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:30:00.328838 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:30:00.334159 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:30:00.334159 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:30:00.334159 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:30:00.334159 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:30:00.334159 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:30:00.334159 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4fb2a1f5-6eda-43fa-8905-b027199a538b could not be found. Sep 14 09:30:00.334159 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:30:00.334159 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-60c4bbeb-c79e-4fd9-ac96-c7998b7c3eb0 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Returning 404 to user: Instance 4fb2a1f5-6eda-43fa-8905-b027199a538b could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:30:00.334159 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-60c4bbeb-c79e-4fd9-ac96-c7998b7c3eb0 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/4fb2a1f5-6eda-43fa-8905-b027199a538b" status: 404 len: 111 microversion: 2.1 time: 0.033219 Sep 14 09:30:00.334159 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3107/6189] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:30:00 2022] GET /compute/v2.1/servers/4fb2a1f5-6eda-43fa-8905-b027199a538b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:30:00.539312 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ad9edcab-48a0-42ef-9dc9-8bff4ed41aaf tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:00.540070 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-ad9edcab-48a0-42ef-9dc9-8bff4ed41aaf tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: b93d32ea-ad59-46a2-ae7e-e23d66132271] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:30:00.573174 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ad9edcab-48a0-42ef-9dc9-8bff4ed41aaf tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:00.575834 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ad9edcab-48a0-42ef-9dc9-8bff4ed41aaf tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:00.576629 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ad9edcab-48a0-42ef-9dc9-8bff4ed41aaf tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:00.579246 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ad9edcab-48a0-42ef-9dc9-8bff4ed41aaf tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:00.579933 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ad9edcab-48a0-42ef-9dc9-8bff4ed41aaf tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:00.581629 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ad9edcab-48a0-42ef-9dc9-8bff4ed41aaf tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:00.770962 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-ad9edcab-48a0-42ef-9dc9-8bff4ed41aaf tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725d7beb4ec54b86a455af0d7bd0ce19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c197eded81494b818b1e56f4c01432c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:30:00.784846 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-ad9edcab-48a0-42ef-9dc9-8bff4ed41aaf tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/b93d32ea-ad59-46a2-ae7e-e23d66132271" status: 200 len: 1688 microversion: 2.1 time: 0.251417 Sep 14 09:30:00.795596 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3083/6190] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:30:00 2022] GET /compute/v2.1/servers/b93d32ea-ad59-46a2-ae7e-e23d66132271 => generated 1688 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:30:01.824704 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1f29f642-28b8-4831-a015-4005101c6748 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:01.825915 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-1f29f642-28b8-4831-a015-4005101c6748 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: b93d32ea-ad59-46a2-ae7e-e23d66132271] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:30:01.833831 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1f29f642-28b8-4831-a015-4005101c6748 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:01.834542 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1f29f642-28b8-4831-a015-4005101c6748 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:01.835333 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1f29f642-28b8-4831-a015-4005101c6748 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:01.836446 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1f29f642-28b8-4831-a015-4005101c6748 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:01.837091 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1f29f642-28b8-4831-a015-4005101c6748 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:01.837691 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1f29f642-28b8-4831-a015-4005101c6748 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:02.031959 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-1f29f642-28b8-4831-a015-4005101c6748 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725d7beb4ec54b86a455af0d7bd0ce19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c197eded81494b818b1e56f4c01432c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:30:02.041869 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-1f29f642-28b8-4831-a015-4005101c6748 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/b93d32ea-ad59-46a2-ae7e-e23d66132271" status: 200 len: 1693 microversion: 2.1 time: 0.221092 Sep 14 09:30:02.042404 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3108/6191] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:30:01 2022] GET /compute/v2.1/servers/b93d32ea-ad59-46a2-ae7e-e23d66132271 => generated 1693 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:30:03.065685 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-2fdf364e-5d10-48f1-abfc-32ac08b73923 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:03.066325 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-2fdf364e-5d10-48f1-abfc-32ac08b73923 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: b93d32ea-ad59-46a2-ae7e-e23d66132271] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:30:03.074015 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2fdf364e-5d10-48f1-abfc-32ac08b73923 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:03.074716 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2fdf364e-5d10-48f1-abfc-32ac08b73923 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:03.075193 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2fdf364e-5d10-48f1-abfc-32ac08b73923 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:03.075936 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2fdf364e-5d10-48f1-abfc-32ac08b73923 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:03.076399 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2fdf364e-5d10-48f1-abfc-32ac08b73923 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:03.076830 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2fdf364e-5d10-48f1-abfc-32ac08b73923 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:03.228935 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-2fdf364e-5d10-48f1-abfc-32ac08b73923 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725d7beb4ec54b86a455af0d7bd0ce19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c197eded81494b818b1e56f4c01432c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:30:03.241806 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-2fdf364e-5d10-48f1-abfc-32ac08b73923 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/b93d32ea-ad59-46a2-ae7e-e23d66132271" status: 200 len: 1693 microversion: 2.1 time: 0.180010 Sep 14 09:30:03.242396 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3084/6192] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:30:03 2022] GET /compute/v2.1/servers/b93d32ea-ad59-46a2-ae7e-e23d66132271 => generated 1693 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:30:04.265854 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-f1b0a770-c2df-4178-8f8e-dfdc8cf54780 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:04.266482 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-f1b0a770-c2df-4178-8f8e-dfdc8cf54780 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: b93d32ea-ad59-46a2-ae7e-e23d66132271] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:30:04.275044 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f1b0a770-c2df-4178-8f8e-dfdc8cf54780 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:04.275841 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f1b0a770-c2df-4178-8f8e-dfdc8cf54780 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:04.276454 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f1b0a770-c2df-4178-8f8e-dfdc8cf54780 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:04.277356 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f1b0a770-c2df-4178-8f8e-dfdc8cf54780 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:04.277815 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f1b0a770-c2df-4178-8f8e-dfdc8cf54780 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:04.278244 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f1b0a770-c2df-4178-8f8e-dfdc8cf54780 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:04.461368 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-f1b0a770-c2df-4178-8f8e-dfdc8cf54780 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725d7beb4ec54b86a455af0d7bd0ce19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c197eded81494b818b1e56f4c01432c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:30:04.463768 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=100 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:30:04.481606 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-f1b0a770-c2df-4178-8f8e-dfdc8cf54780 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/b93d32ea-ad59-46a2-ae7e-e23d66132271" status: 200 len: 1693 microversion: 2.1 time: 0.219590 Sep 14 09:30:04.483069 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3109/6193] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:30:04 2022] GET /compute/v2.1/servers/b93d32ea-ad59-46a2-ae7e-e23d66132271 => generated 1693 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:30:05.506591 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9b945ae2-5e0a-4403-99cb-dc66f200e2d7 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:05.507236 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-9b945ae2-5e0a-4403-99cb-dc66f200e2d7 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: b93d32ea-ad59-46a2-ae7e-e23d66132271] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:30:05.514783 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9b945ae2-5e0a-4403-99cb-dc66f200e2d7 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:05.515310 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9b945ae2-5e0a-4403-99cb-dc66f200e2d7 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:05.515756 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9b945ae2-5e0a-4403-99cb-dc66f200e2d7 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:05.516083 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-4b698123-65fe-40ec-a663-daee7a0f3141 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1799239680", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "73214152-f179-4798-b172-8e5429df1e98", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "70503795-7dfb-4d39-a57e-91e8e5270ce0"}]}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:30:05.516631 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9b945ae2-5e0a-4403-99cb-dc66f200e2d7 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:05.517333 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9b945ae2-5e0a-4403-99cb-dc66f200e2d7 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:05.518407 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9b945ae2-5e0a-4403-99cb-dc66f200e2d7 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:05.600468 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.network.neutron [None req-4b698123-65fe-40ec-a663-daee7a0f3141 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] validate_networks() for [('70503795-7dfb-4d39-a57e-91e8e5270ce0', None, None, None, None, None)] {{(pid=128758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:30:05.734839 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-9b945ae2-5e0a-4403-99cb-dc66f200e2d7 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725d7beb4ec54b86a455af0d7bd0ce19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c197eded81494b818b1e56f4c01432c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:30:05.743080 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-9b945ae2-5e0a-4403-99cb-dc66f200e2d7 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/b93d32ea-ad59-46a2-ae7e-e23d66132271" status: 200 len: 1693 microversion: 2.1 time: 0.241140 Sep 14 09:30:05.743678 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3085/6194] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:30:05 2022] GET /compute/v2.1/servers/b93d32ea-ad59-46a2-ae7e-e23d66132271 => generated 1693 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:30:06.019094 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-4b698123-65fe-40ec-a663-daee7a0f3141 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Flavor limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:30:06.019599 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-4b698123-65fe-40ec-a663-daee7a0f3141 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Image limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:30:06.020218 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-4b698123-65fe-40ec-a663-daee7a0f3141 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Flavor pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:30:06.020705 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-4b698123-65fe-40ec-a663-daee7a0f3141 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Image pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:30:06.021232 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-4b698123-65fe-40ec-a663-daee7a0f3141 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:30:06.031316 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4b698123-65fe-40ec-a663-daee7a0f3141 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:06.031905 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4b698123-65fe-40ec-a663-daee7a0f3141 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:06.032481 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4b698123-65fe-40ec-a663-daee7a0f3141 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:06.033285 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4b698123-65fe-40ec-a663-daee7a0f3141 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:06.033833 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4b698123-65fe-40ec-a663-daee7a0f3141 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:06.034274 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4b698123-65fe-40ec-a663-daee7a0f3141 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:06.052704 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-4b698123-65fe-40ec-a663-daee7a0f3141 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Getting quotas for project 0fca803d9ffa4b4ab0371c0d6a96a5a2. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:30:06.058367 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-4b698123-65fe-40ec-a663-daee7a0f3141 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Getting quotas for user 80257054a25540c294e1787780b601b4 and project 0fca803d9ffa4b4ab0371c0d6a96a5a2. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:30:06.117997 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-4b698123-65fe-40ec-a663-daee7a0f3141 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Going to run 1 instances... {{(pid=128758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:30:06.120072 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-4b698123-65fe-40ec-a663-daee7a0f3141 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: a391dacb-3645-4277-9175-8fe6cf90b09a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='73214152-f179-4798-b172-8e5429df1e98',volume_size=None,volume_type=None)] {{(pid=128758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:30:06.252485 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-4b698123-65fe-40ec-a663-daee7a0f3141 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.739745 Sep 14 09:30:06.253335 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3110/6195] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 09:30:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 742 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 14 09:30:06.264336 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b3f1609c-d20a-4fce-b510-d23a9bba1b35 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:06.264995 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b3f1609c-d20a-4fce-b510-d23a9bba1b35 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: a391dacb-3645-4277-9175-8fe6cf90b09a] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:30:06.327227 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b3f1609c-d20a-4fce-b510-d23a9bba1b35 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:30:06.335245 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b3f1609c-d20a-4fce-b510-d23a9bba1b35 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/a391dacb-3645-4277-9175-8fe6cf90b09a" status: 200 len: 1057 microversion: 2.1 time: 0.074814 Sep 14 09:30:06.342875 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3086/6196] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:30:06 2022] GET /compute/v2.1/servers/a391dacb-3645-4277-9175-8fe6cf90b09a => generated 1057 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:30:06.769428 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-feca8955-fdcb-405b-9bdd-b2b147d14409 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:06.770632 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-feca8955-fdcb-405b-9bdd-b2b147d14409 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: b93d32ea-ad59-46a2-ae7e-e23d66132271] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:30:06.778351 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-feca8955-fdcb-405b-9bdd-b2b147d14409 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:06.778857 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-feca8955-fdcb-405b-9bdd-b2b147d14409 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:06.779335 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-feca8955-fdcb-405b-9bdd-b2b147d14409 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:06.780092 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-feca8955-fdcb-405b-9bdd-b2b147d14409 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:06.780558 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-feca8955-fdcb-405b-9bdd-b2b147d14409 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:06.780992 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-feca8955-fdcb-405b-9bdd-b2b147d14409 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:06.930900 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-feca8955-fdcb-405b-9bdd-b2b147d14409 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725d7beb4ec54b86a455af0d7bd0ce19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c197eded81494b818b1e56f4c01432c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:30:06.939520 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-feca8955-fdcb-405b-9bdd-b2b147d14409 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/b93d32ea-ad59-46a2-ae7e-e23d66132271" status: 200 len: 1693 microversion: 2.1 time: 0.175017 Sep 14 09:30:06.941283 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3111/6197] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:30:06 2022] GET /compute/v2.1/servers/b93d32ea-ad59-46a2-ae7e-e23d66132271 => generated 1693 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:30:07.364109 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3b76991b-04b0-4245-af89-751e86bfdfb6 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:07.364830 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-3b76991b-04b0-4245-af89-751e86bfdfb6 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: a391dacb-3645-4277-9175-8fe6cf90b09a] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:30:07.376708 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3b76991b-04b0-4245-af89-751e86bfdfb6 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:07.377471 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3b76991b-04b0-4245-af89-751e86bfdfb6 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:07.378522 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3b76991b-04b0-4245-af89-751e86bfdfb6 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:07.379387 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3b76991b-04b0-4245-af89-751e86bfdfb6 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:07.379937 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3b76991b-04b0-4245-af89-751e86bfdfb6 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:07.380739 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3b76991b-04b0-4245-af89-751e86bfdfb6 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:07.452710 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-3b76991b-04b0-4245-af89-751e86bfdfb6 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:30:07.461785 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-3b76991b-04b0-4245-af89-751e86bfdfb6 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/a391dacb-3645-4277-9175-8fe6cf90b09a" status: 200 len: 1173 microversion: 2.1 time: 0.102272 Sep 14 09:30:07.476104 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3087/6198] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:30:07 2022] GET /compute/v2.1/servers/a391dacb-3645-4277-9175-8fe6cf90b09a => generated 1173 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:30:07.967466 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-753dbf43-87e6-4595-af9d-548f1f1ade5e tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:07.968603 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-753dbf43-87e6-4595-af9d-548f1f1ade5e tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: b93d32ea-ad59-46a2-ae7e-e23d66132271] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:30:07.992141 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-753dbf43-87e6-4595-af9d-548f1f1ade5e tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:08.003768 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-753dbf43-87e6-4595-af9d-548f1f1ade5e tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:08.004464 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-753dbf43-87e6-4595-af9d-548f1f1ade5e tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:08.005386 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-753dbf43-87e6-4595-af9d-548f1f1ade5e tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:08.006042 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-753dbf43-87e6-4595-af9d-548f1f1ade5e tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:08.006749 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-753dbf43-87e6-4595-af9d-548f1f1ade5e tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:08.203531 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-753dbf43-87e6-4595-af9d-548f1f1ade5e tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725d7beb4ec54b86a455af0d7bd0ce19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c197eded81494b818b1e56f4c01432c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:30:08.214925 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-753dbf43-87e6-4595-af9d-548f1f1ade5e tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/b93d32ea-ad59-46a2-ae7e-e23d66132271" status: 200 len: 1693 microversion: 2.1 time: 0.253060 Sep 14 09:30:08.216553 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3112/6199] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:30:07 2022] GET /compute/v2.1/servers/b93d32ea-ad59-46a2-ae7e-e23d66132271 => generated 1693 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:30:08.486799 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f7f3abe6-01fe-4e8f-91f8-b410524ba105 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:08.488360 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f7f3abe6-01fe-4e8f-91f8-b410524ba105 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: a391dacb-3645-4277-9175-8fe6cf90b09a] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:30:08.491281 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:30:08.497347 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f7f3abe6-01fe-4e8f-91f8-b410524ba105 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:08.498046 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f7f3abe6-01fe-4e8f-91f8-b410524ba105 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:08.498707 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f7f3abe6-01fe-4e8f-91f8-b410524ba105 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:08.499516 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f7f3abe6-01fe-4e8f-91f8-b410524ba105 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:08.500112 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f7f3abe6-01fe-4e8f-91f8-b410524ba105 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:08.500653 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f7f3abe6-01fe-4e8f-91f8-b410524ba105 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:08.672524 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f7f3abe6-01fe-4e8f-91f8-b410524ba105 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:30:08.683056 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f7f3abe6-01fe-4e8f-91f8-b410524ba105 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/a391dacb-3645-4277-9175-8fe6cf90b09a" status: 200 len: 1215 microversion: 2.1 time: 0.201180 Sep 14 09:30:08.684272 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3088/6200] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:30:08 2022] GET /compute/v2.1/servers/a391dacb-3645-4277-9175-8fe6cf90b09a => generated 1215 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:30:08.849053 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-cd200797-83ef-471e-ae1a-ae2ba7b2fb71 req-6aa927d4-f02a-4d5c-a8e4-a430d9ca5732 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a391dacb-3645-4277-9175-8fe6cf90b09a", "tag": "5e55a2aa-7985-420f-be32-06484124fbe7"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:30:08.876142 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-cd200797-83ef-471e-ae1a-ae2ba7b2fb71 req-6aa927d4-f02a-4d5c-a8e4-a430d9ca5732 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:08.878140 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-cd200797-83ef-471e-ae1a-ae2ba7b2fb71 req-6aa927d4-f02a-4d5c-a8e4-a430d9ca5732 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:08.878760 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-cd200797-83ef-471e-ae1a-ae2ba7b2fb71 req-6aa927d4-f02a-4d5c-a8e4-a430d9ca5732 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:08.893952 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-cd200797-83ef-471e-ae1a-ae2ba7b2fb71 req-6aa927d4-f02a-4d5c-a8e4-a430d9ca5732 service nova] Creating event network-changed:5e55a2aa-7985-420f-be32-06484124fbe7 for instance a391dacb-3645-4277-9175-8fe6cf90b09a on n-h2-836830-18 Sep 14 09:30:08.913029 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-cd200797-83ef-471e-ae1a-ae2ba7b2fb71 req-6aa927d4-f02a-4d5c-a8e4-a430d9ca5732 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068154 Sep 14 09:30:08.914219 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3113/6201] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:30:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:30:09.239765 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3671226f-7e0d-45ba-9add-e831a7a1f1ec tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:09.240654 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-3671226f-7e0d-45ba-9add-e831a7a1f1ec tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: b93d32ea-ad59-46a2-ae7e-e23d66132271] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:30:09.247368 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3671226f-7e0d-45ba-9add-e831a7a1f1ec tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:09.247949 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3671226f-7e0d-45ba-9add-e831a7a1f1ec tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:09.248602 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3671226f-7e0d-45ba-9add-e831a7a1f1ec tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:09.249312 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3671226f-7e0d-45ba-9add-e831a7a1f1ec tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:09.249967 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3671226f-7e0d-45ba-9add-e831a7a1f1ec tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:09.250529 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3671226f-7e0d-45ba-9add-e831a7a1f1ec tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:09.412198 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-3671226f-7e0d-45ba-9add-e831a7a1f1ec tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725d7beb4ec54b86a455af0d7bd0ce19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c197eded81494b818b1e56f4c01432c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:30:09.420736 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-3671226f-7e0d-45ba-9add-e831a7a1f1ec tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/b93d32ea-ad59-46a2-ae7e-e23d66132271" status: 200 len: 1693 microversion: 2.1 time: 0.185872 Sep 14 09:30:09.421312 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3089/6202] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:30:09 2022] GET /compute/v2.1/servers/b93d32ea-ad59-46a2-ae7e-e23d66132271 => generated 1693 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:30:09.710752 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-eb62e9aa-aefd-43ff-80a2-e5b0897c9ceb tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:09.711498 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-eb62e9aa-aefd-43ff-80a2-e5b0897c9ceb tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: a391dacb-3645-4277-9175-8fe6cf90b09a] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:30:09.717972 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-eb62e9aa-aefd-43ff-80a2-e5b0897c9ceb tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:09.718461 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-eb62e9aa-aefd-43ff-80a2-e5b0897c9ceb tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:09.718899 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-eb62e9aa-aefd-43ff-80a2-e5b0897c9ceb tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:09.719794 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-eb62e9aa-aefd-43ff-80a2-e5b0897c9ceb tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:09.720260 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-eb62e9aa-aefd-43ff-80a2-e5b0897c9ceb tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:09.720725 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-eb62e9aa-aefd-43ff-80a2-e5b0897c9ceb tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:09.865567 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-eb62e9aa-aefd-43ff-80a2-e5b0897c9ceb tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:30:09.873625 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-eb62e9aa-aefd-43ff-80a2-e5b0897c9ceb tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/a391dacb-3645-4277-9175-8fe6cf90b09a" status: 200 len: 1215 microversion: 2.1 time: 0.169839 Sep 14 09:30:09.874224 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3114/6203] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:30:09 2022] GET /compute/v2.1/servers/a391dacb-3645-4277-9175-8fe6cf90b09a => generated 1215 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:30:10.445354 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-756578f8-e949-472a-96ec-0941c833201d tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:10.446122 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-756578f8-e949-472a-96ec-0941c833201d tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: b93d32ea-ad59-46a2-ae7e-e23d66132271] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:30:10.461243 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-756578f8-e949-472a-96ec-0941c833201d tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:10.461815 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-756578f8-e949-472a-96ec-0941c833201d tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:10.462273 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-756578f8-e949-472a-96ec-0941c833201d tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:10.462984 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-756578f8-e949-472a-96ec-0941c833201d tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:10.463449 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-756578f8-e949-472a-96ec-0941c833201d tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:10.463902 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-756578f8-e949-472a-96ec-0941c833201d tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:10.597498 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-756578f8-e949-472a-96ec-0941c833201d tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725d7beb4ec54b86a455af0d7bd0ce19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c197eded81494b818b1e56f4c01432c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:30:10.606103 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-756578f8-e949-472a-96ec-0941c833201d tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/b93d32ea-ad59-46a2-ae7e-e23d66132271" status: 200 len: 1693 microversion: 2.1 time: 0.164564 Sep 14 09:30:10.606762 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3090/6204] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:30:10 2022] GET /compute/v2.1/servers/b93d32ea-ad59-46a2-ae7e-e23d66132271 => generated 1693 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:30:10.897108 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1e1d4f16-b8a7-4d76-a82d-a3fa1778b4f5 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:10.897951 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-1e1d4f16-b8a7-4d76-a82d-a3fa1778b4f5 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: a391dacb-3645-4277-9175-8fe6cf90b09a] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:30:10.905662 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1e1d4f16-b8a7-4d76-a82d-a3fa1778b4f5 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:10.906175 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1e1d4f16-b8a7-4d76-a82d-a3fa1778b4f5 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:10.906622 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1e1d4f16-b8a7-4d76-a82d-a3fa1778b4f5 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:10.907381 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1e1d4f16-b8a7-4d76-a82d-a3fa1778b4f5 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:10.907843 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1e1d4f16-b8a7-4d76-a82d-a3fa1778b4f5 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:10.908363 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1e1d4f16-b8a7-4d76-a82d-a3fa1778b4f5 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:11.050228 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-1e1d4f16-b8a7-4d76-a82d-a3fa1778b4f5 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:30:11.058185 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-1e1d4f16-b8a7-4d76-a82d-a3fa1778b4f5 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/a391dacb-3645-4277-9175-8fe6cf90b09a" status: 200 len: 1215 microversion: 2.1 time: 0.165644 Sep 14 09:30:11.058769 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3115/6205] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:30:10 2022] GET /compute/v2.1/servers/a391dacb-3645-4277-9175-8fe6cf90b09a => generated 1215 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:30:11.630144 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-944c92d3-0898-4b2a-95ab-b8f979a60451 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:11.630775 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-944c92d3-0898-4b2a-95ab-b8f979a60451 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: b93d32ea-ad59-46a2-ae7e-e23d66132271] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:30:11.637804 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-944c92d3-0898-4b2a-95ab-b8f979a60451 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:11.638292 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-944c92d3-0898-4b2a-95ab-b8f979a60451 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:11.638731 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-944c92d3-0898-4b2a-95ab-b8f979a60451 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:11.639457 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-944c92d3-0898-4b2a-95ab-b8f979a60451 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:11.639943 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-944c92d3-0898-4b2a-95ab-b8f979a60451 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:11.640393 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-944c92d3-0898-4b2a-95ab-b8f979a60451 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:11.782338 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-944c92d3-0898-4b2a-95ab-b8f979a60451 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725d7beb4ec54b86a455af0d7bd0ce19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c197eded81494b818b1e56f4c01432c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:30:11.790828 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-944c92d3-0898-4b2a-95ab-b8f979a60451 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/b93d32ea-ad59-46a2-ae7e-e23d66132271" status: 200 len: 1693 microversion: 2.1 time: 0.164629 Sep 14 09:30:11.791473 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3091/6206] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:30:11 2022] GET /compute/v2.1/servers/b93d32ea-ad59-46a2-ae7e-e23d66132271 => generated 1693 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:30:12.081528 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-cd0f6507-e5f5-4a73-99f0-386461800f2c tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:12.082166 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-cd0f6507-e5f5-4a73-99f0-386461800f2c tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: a391dacb-3645-4277-9175-8fe6cf90b09a] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:30:12.089203 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cd0f6507-e5f5-4a73-99f0-386461800f2c tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:12.089699 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cd0f6507-e5f5-4a73-99f0-386461800f2c tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:12.090140 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cd0f6507-e5f5-4a73-99f0-386461800f2c tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:12.090843 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cd0f6507-e5f5-4a73-99f0-386461800f2c tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:12.091332 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cd0f6507-e5f5-4a73-99f0-386461800f2c tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:12.091765 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cd0f6507-e5f5-4a73-99f0-386461800f2c tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:12.225617 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-cd0f6507-e5f5-4a73-99f0-386461800f2c tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:30:12.233524 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-cd0f6507-e5f5-4a73-99f0-386461800f2c tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/a391dacb-3645-4277-9175-8fe6cf90b09a" status: 200 len: 1215 microversion: 2.1 time: 0.156645 Sep 14 09:30:12.234105 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3116/6207] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:30:12 2022] GET /compute/v2.1/servers/a391dacb-3645-4277-9175-8fe6cf90b09a => generated 1215 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:30:12.818318 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-be8d97e9-0e77-4145-8f3d-c8aac8dfbee8 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:12.819571 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-be8d97e9-0e77-4145-8f3d-c8aac8dfbee8 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: b93d32ea-ad59-46a2-ae7e-e23d66132271] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:30:12.827810 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-be8d97e9-0e77-4145-8f3d-c8aac8dfbee8 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:12.828506 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-be8d97e9-0e77-4145-8f3d-c8aac8dfbee8 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:12.829139 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-be8d97e9-0e77-4145-8f3d-c8aac8dfbee8 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:12.830583 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-be8d97e9-0e77-4145-8f3d-c8aac8dfbee8 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:12.831243 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-be8d97e9-0e77-4145-8f3d-c8aac8dfbee8 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:12.831683 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-be8d97e9-0e77-4145-8f3d-c8aac8dfbee8 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:13.113513 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-be8d97e9-0e77-4145-8f3d-c8aac8dfbee8 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725d7beb4ec54b86a455af0d7bd0ce19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c197eded81494b818b1e56f4c01432c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:30:13.122196 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-be8d97e9-0e77-4145-8f3d-c8aac8dfbee8 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/b93d32ea-ad59-46a2-ae7e-e23d66132271" status: 200 len: 1692 microversion: 2.1 time: 0.307746 Sep 14 09:30:13.122796 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3092/6208] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:30:12 2022] GET /compute/v2.1/servers/b93d32ea-ad59-46a2-ae7e-e23d66132271 => generated 1692 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:30:13.227705 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-ac7eed3e-045a-48f9-8a11-37feb69549c5 req-0b5a9638-f9bc-4dd2-a3be-b97f4cfd2447 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b93d32ea-ad59-46a2-ae7e-e23d66132271", "name": "network-vif-unplugged", "status": "completed", "tag": "ffd5e266-d94c-4d18-b106-97154479401e"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:30:13.238723 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-ac7eed3e-045a-48f9-8a11-37feb69549c5 req-0b5a9638-f9bc-4dd2-a3be-b97f4cfd2447 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:13.239245 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-ac7eed3e-045a-48f9-8a11-37feb69549c5 req-0b5a9638-f9bc-4dd2-a3be-b97f4cfd2447 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:13.239857 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-ac7eed3e-045a-48f9-8a11-37feb69549c5 req-0b5a9638-f9bc-4dd2-a3be-b97f4cfd2447 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:13.256780 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-bc0b6abe-29aa-4220-ba6c-4c6675e4c6ba tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:13.257807 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-ac7eed3e-045a-48f9-8a11-37feb69549c5 req-0b5a9638-f9bc-4dd2-a3be-b97f4cfd2447 service nova] Creating event network-vif-unplugged:ffd5e266-d94c-4d18-b106-97154479401e for instance b93d32ea-ad59-46a2-ae7e-e23d66132271 on n-h1-836830-18 Sep 14 09:30:13.258188 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-bc0b6abe-29aa-4220-ba6c-4c6675e4c6ba tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: a391dacb-3645-4277-9175-8fe6cf90b09a] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:30:13.264438 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [req-ac7eed3e-045a-48f9-8a11-37feb69549c5 req-0b5a9638-f9bc-4dd2-a3be-b97f4cfd2447 service nova] Instance b93d32ea-ad59-46a2-ae7e-e23d66132271 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-836830-18', 'n-h2-836830-18'} {{(pid=128758) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 14 09:30:13.266736 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bc0b6abe-29aa-4220-ba6c-4c6675e4c6ba tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:13.268387 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bc0b6abe-29aa-4220-ba6c-4c6675e4c6ba tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:13.269162 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bc0b6abe-29aa-4220-ba6c-4c6675e4c6ba tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:13.270107 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bc0b6abe-29aa-4220-ba6c-4c6675e4c6ba tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:13.270775 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bc0b6abe-29aa-4220-ba6c-4c6675e4c6ba tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:13.271730 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bc0b6abe-29aa-4220-ba6c-4c6675e4c6ba tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:13.284582 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-ac7eed3e-045a-48f9-8a11-37feb69549c5 req-0b5a9638-f9bc-4dd2-a3be-b97f4cfd2447 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060955 Sep 14 09:30:13.287950 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3117/6209] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:30:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:30:13.606880 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-bc0b6abe-29aa-4220-ba6c-4c6675e4c6ba tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:30:13.616666 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-bc0b6abe-29aa-4220-ba6c-4c6675e4c6ba tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/a391dacb-3645-4277-9175-8fe6cf90b09a" status: 200 len: 1215 microversion: 2.1 time: 0.364823 Sep 14 09:30:13.619551 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3093/6210] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:30:13 2022] GET /compute/v2.1/servers/a391dacb-3645-4277-9175-8fe6cf90b09a => generated 1215 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:30:14.148671 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-cbb0bd19-cebe-42f1-a881-58986c3fa5a6 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:14.149968 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-cbb0bd19-cebe-42f1-a881-58986c3fa5a6 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: b93d32ea-ad59-46a2-ae7e-e23d66132271] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:30:14.159387 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cbb0bd19-cebe-42f1-a881-58986c3fa5a6 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:14.160202 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cbb0bd19-cebe-42f1-a881-58986c3fa5a6 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:14.160835 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cbb0bd19-cebe-42f1-a881-58986c3fa5a6 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:14.161771 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cbb0bd19-cebe-42f1-a881-58986c3fa5a6 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:14.162426 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cbb0bd19-cebe-42f1-a881-58986c3fa5a6 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:14.163158 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cbb0bd19-cebe-42f1-a881-58986c3fa5a6 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:14.488511 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-cbb0bd19-cebe-42f1-a881-58986c3fa5a6 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725d7beb4ec54b86a455af0d7bd0ce19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c197eded81494b818b1e56f4c01432c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:30:14.496984 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-cbb0bd19-cebe-42f1-a881-58986c3fa5a6 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/b93d32ea-ad59-46a2-ae7e-e23d66132271" status: 200 len: 1692 microversion: 2.1 time: 0.354151 Sep 14 09:30:14.497963 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3118/6211] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:30:14 2022] GET /compute/v2.1/servers/b93d32ea-ad59-46a2-ae7e-e23d66132271 => generated 1692 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:30:14.642670 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-0ee2688f-6e55-4d19-8914-bf9a2cb8fe87 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:14.643321 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-0ee2688f-6e55-4d19-8914-bf9a2cb8fe87 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: a391dacb-3645-4277-9175-8fe6cf90b09a] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:30:14.650674 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0ee2688f-6e55-4d19-8914-bf9a2cb8fe87 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:14.651116 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0ee2688f-6e55-4d19-8914-bf9a2cb8fe87 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:14.651774 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0ee2688f-6e55-4d19-8914-bf9a2cb8fe87 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:14.652478 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0ee2688f-6e55-4d19-8914-bf9a2cb8fe87 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:14.653079 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0ee2688f-6e55-4d19-8914-bf9a2cb8fe87 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:14.653662 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0ee2688f-6e55-4d19-8914-bf9a2cb8fe87 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:14.871083 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-0ee2688f-6e55-4d19-8914-bf9a2cb8fe87 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:30:14.882030 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-0ee2688f-6e55-4d19-8914-bf9a2cb8fe87 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/a391dacb-3645-4277-9175-8fe6cf90b09a" status: 200 len: 1203 microversion: 2.1 time: 0.240653 Sep 14 09:30:14.890814 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3094/6212] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:30:14 2022] GET /compute/v2.1/servers/a391dacb-3645-4277-9175-8fe6cf90b09a => generated 1203 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:30:15.336473 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-eb01cfe4-b704-405a-bde6-8536971025b4 req-4ad79f24-a2e4-4246-ad67-fbc33eb28f17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b93d32ea-ad59-46a2-ae7e-e23d66132271", "tag": "ffd5e266-d94c-4d18-b106-97154479401e"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:30:15.346810 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-eb01cfe4-b704-405a-bde6-8536971025b4 req-4ad79f24-a2e4-4246-ad67-fbc33eb28f17 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:15.347381 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-eb01cfe4-b704-405a-bde6-8536971025b4 req-4ad79f24-a2e4-4246-ad67-fbc33eb28f17 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:15.347805 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-eb01cfe4-b704-405a-bde6-8536971025b4 req-4ad79f24-a2e4-4246-ad67-fbc33eb28f17 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:15.359389 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-eb01cfe4-b704-405a-bde6-8536971025b4 req-4ad79f24-a2e4-4246-ad67-fbc33eb28f17 service nova] Creating event network-changed:ffd5e266-d94c-4d18-b106-97154479401e for instance b93d32ea-ad59-46a2-ae7e-e23d66132271 on n-h1-836830-18 Sep 14 09:30:15.364890 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [req-eb01cfe4-b704-405a-bde6-8536971025b4 req-4ad79f24-a2e4-4246-ad67-fbc33eb28f17 service nova] Instance b93d32ea-ad59-46a2-ae7e-e23d66132271 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-836830-18', 'n-h2-836830-18'} {{(pid=128758) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 14 09:30:15.375351 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-eb01cfe4-b704-405a-bde6-8536971025b4 req-4ad79f24-a2e4-4246-ad67-fbc33eb28f17 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042546 Sep 14 09:30:15.375958 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3119/6213] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:30:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:30:15.521532 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-2b33e49a-7d51-4d83-b8dd-f0ee3f28fb3b tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:15.522166 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-2b33e49a-7d51-4d83-b8dd-f0ee3f28fb3b tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: b93d32ea-ad59-46a2-ae7e-e23d66132271] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:30:15.528811 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2b33e49a-7d51-4d83-b8dd-f0ee3f28fb3b tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:15.529318 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2b33e49a-7d51-4d83-b8dd-f0ee3f28fb3b tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:15.529767 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2b33e49a-7d51-4d83-b8dd-f0ee3f28fb3b tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:15.530480 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2b33e49a-7d51-4d83-b8dd-f0ee3f28fb3b tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:15.530972 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2b33e49a-7d51-4d83-b8dd-f0ee3f28fb3b tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:15.531534 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2b33e49a-7d51-4d83-b8dd-f0ee3f28fb3b tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:15.686392 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-2b33e49a-7d51-4d83-b8dd-f0ee3f28fb3b tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725d7beb4ec54b86a455af0d7bd0ce19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c197eded81494b818b1e56f4c01432c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:30:15.695912 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-2b33e49a-7d51-4d83-b8dd-f0ee3f28fb3b tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/b93d32ea-ad59-46a2-ae7e-e23d66132271" status: 200 len: 1690 microversion: 2.1 time: 0.179190 Sep 14 09:30:15.696665 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3095/6214] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:30:15 2022] GET /compute/v2.1/servers/b93d32ea-ad59-46a2-ae7e-e23d66132271 => generated 1690 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:30:15.906219 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-da280a47-2569-4f65-8249-b58de66c0e29 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:15.907102 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-da280a47-2569-4f65-8249-b58de66c0e29 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: a391dacb-3645-4277-9175-8fe6cf90b09a] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:30:15.913276 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-da280a47-2569-4f65-8249-b58de66c0e29 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:15.913769 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-da280a47-2569-4f65-8249-b58de66c0e29 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:15.914220 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-da280a47-2569-4f65-8249-b58de66c0e29 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:15.914927 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-da280a47-2569-4f65-8249-b58de66c0e29 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:15.915420 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-da280a47-2569-4f65-8249-b58de66c0e29 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:15.915851 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-da280a47-2569-4f65-8249-b58de66c0e29 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:16.043253 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=2 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:30:16.054960 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-da280a47-2569-4f65-8249-b58de66c0e29 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:30:16.062880 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-da280a47-2569-4f65-8249-b58de66c0e29 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/a391dacb-3645-4277-9175-8fe6cf90b09a" status: 200 len: 1203 microversion: 2.1 time: 0.160954 Sep 14 09:30:16.063512 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3120/6215] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:30:15 2022] GET /compute/v2.1/servers/a391dacb-3645-4277-9175-8fe6cf90b09a => generated 1203 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:30:16.721791 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3f9a72aa-1ce6-4799-a690-55807b49342c tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:16.722420 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-3f9a72aa-1ce6-4799-a690-55807b49342c tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: b93d32ea-ad59-46a2-ae7e-e23d66132271] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:30:16.724398 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=2 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:30:16.730740 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3f9a72aa-1ce6-4799-a690-55807b49342c tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:16.731267 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3f9a72aa-1ce6-4799-a690-55807b49342c tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:16.731718 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3f9a72aa-1ce6-4799-a690-55807b49342c tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:16.732421 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3f9a72aa-1ce6-4799-a690-55807b49342c tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:16.732881 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3f9a72aa-1ce6-4799-a690-55807b49342c tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:16.733313 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3f9a72aa-1ce6-4799-a690-55807b49342c tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:16.737284 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:30:16.874353 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-3f9a72aa-1ce6-4799-a690-55807b49342c tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725d7beb4ec54b86a455af0d7bd0ce19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c197eded81494b818b1e56f4c01432c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:30:16.882717 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-3f9a72aa-1ce6-4799-a690-55807b49342c tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/b93d32ea-ad59-46a2-ae7e-e23d66132271" status: 200 len: 1690 microversion: 2.1 time: 0.165512 Sep 14 09:30:16.883473 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3096/6216] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:30:16 2022] GET /compute/v2.1/servers/b93d32ea-ad59-46a2-ae7e-e23d66132271 => generated 1690 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:30:17.085990 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c77372bb-111a-4a69-88c1-23b0991dd552 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:17.086645 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-c77372bb-111a-4a69-88c1-23b0991dd552 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: a391dacb-3645-4277-9175-8fe6cf90b09a] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:30:17.088670 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=6 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:30:17.096150 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c77372bb-111a-4a69-88c1-23b0991dd552 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:17.096658 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c77372bb-111a-4a69-88c1-23b0991dd552 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:17.097186 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c77372bb-111a-4a69-88c1-23b0991dd552 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:17.097927 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c77372bb-111a-4a69-88c1-23b0991dd552 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:17.098396 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c77372bb-111a-4a69-88c1-23b0991dd552 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:17.098830 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c77372bb-111a-4a69-88c1-23b0991dd552 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:17.240363 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-c77372bb-111a-4a69-88c1-23b0991dd552 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:30:17.248376 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-c77372bb-111a-4a69-88c1-23b0991dd552 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/a391dacb-3645-4277-9175-8fe6cf90b09a" status: 200 len: 1203 microversion: 2.1 time: 0.166491 Sep 14 09:30:17.248966 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3121/6217] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:30:17 2022] GET /compute/v2.1/servers/a391dacb-3645-4277-9175-8fe6cf90b09a => generated 1203 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:30:17.906853 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-16009a06-3471-4a8a-9b0d-2bd8fd76f606 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:17.907506 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-16009a06-3471-4a8a-9b0d-2bd8fd76f606 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: b93d32ea-ad59-46a2-ae7e-e23d66132271] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:30:17.914746 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-16009a06-3471-4a8a-9b0d-2bd8fd76f606 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:17.915272 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-16009a06-3471-4a8a-9b0d-2bd8fd76f606 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:17.915939 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-16009a06-3471-4a8a-9b0d-2bd8fd76f606 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:17.916647 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-16009a06-3471-4a8a-9b0d-2bd8fd76f606 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:17.917104 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-16009a06-3471-4a8a-9b0d-2bd8fd76f606 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:17.917533 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-16009a06-3471-4a8a-9b0d-2bd8fd76f606 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:18.153401 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-16009a06-3471-4a8a-9b0d-2bd8fd76f606 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725d7beb4ec54b86a455af0d7bd0ce19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c197eded81494b818b1e56f4c01432c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:30:18.163101 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-16009a06-3471-4a8a-9b0d-2bd8fd76f606 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/b93d32ea-ad59-46a2-ae7e-e23d66132271" status: 200 len: 1690 microversion: 2.1 time: 0.260042 Sep 14 09:30:18.163556 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3097/6218] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:30:17 2022] GET /compute/v2.1/servers/b93d32ea-ad59-46a2-ae7e-e23d66132271 => generated 1690 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:30:18.271275 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c2a18655-2dcc-421e-b717-82857c832b77 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:18.271911 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-c2a18655-2dcc-421e-b717-82857c832b77 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: a391dacb-3645-4277-9175-8fe6cf90b09a] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:30:18.279149 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c2a18655-2dcc-421e-b717-82857c832b77 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:18.279651 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c2a18655-2dcc-421e-b717-82857c832b77 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:18.280095 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c2a18655-2dcc-421e-b717-82857c832b77 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:18.280868 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c2a18655-2dcc-421e-b717-82857c832b77 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:18.281279 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c2a18655-2dcc-421e-b717-82857c832b77 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:18.281699 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c2a18655-2dcc-421e-b717-82857c832b77 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:18.432876 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-c2a18655-2dcc-421e-b717-82857c832b77 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:30:18.441309 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-c2a18655-2dcc-421e-b717-82857c832b77 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/a391dacb-3645-4277-9175-8fe6cf90b09a" status: 200 len: 1203 microversion: 2.1 time: 0.174015 Sep 14 09:30:18.441981 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3122/6219] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:30:18 2022] GET /compute/v2.1/servers/a391dacb-3645-4277-9175-8fe6cf90b09a => generated 1203 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:30:19.187251 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ff8d4948-f14b-4421-91f5-56b86544e96d tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:19.188002 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-ff8d4948-f14b-4421-91f5-56b86544e96d tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: b93d32ea-ad59-46a2-ae7e-e23d66132271] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:30:19.195218 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ff8d4948-f14b-4421-91f5-56b86544e96d tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:19.195724 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ff8d4948-f14b-4421-91f5-56b86544e96d tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:19.196177 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ff8d4948-f14b-4421-91f5-56b86544e96d tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:19.196900 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ff8d4948-f14b-4421-91f5-56b86544e96d tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:19.197654 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ff8d4948-f14b-4421-91f5-56b86544e96d tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:19.198090 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ff8d4948-f14b-4421-91f5-56b86544e96d tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:19.330389 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-ff8d4948-f14b-4421-91f5-56b86544e96d tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725d7beb4ec54b86a455af0d7bd0ce19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c197eded81494b818b1e56f4c01432c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:30:19.338725 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-ff8d4948-f14b-4421-91f5-56b86544e96d tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/b93d32ea-ad59-46a2-ae7e-e23d66132271" status: 200 len: 1687 microversion: 2.1 time: 0.155637 Sep 14 09:30:19.339341 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3098/6220] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:30:19 2022] GET /compute/v2.1/servers/b93d32ea-ad59-46a2-ae7e-e23d66132271 => generated 1687 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:30:19.362648 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a75522e2-4999-45e5-b7f9-ecafee626df5 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:30:19.363244 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-a75522e2-4999-45e5-b7f9-ecafee626df5 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: b93d32ea-ad59-46a2-ae7e-e23d66132271] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:30:19.370040 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a75522e2-4999-45e5-b7f9-ecafee626df5 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:19.370549 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a75522e2-4999-45e5-b7f9-ecafee626df5 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:19.371007 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a75522e2-4999-45e5-b7f9-ecafee626df5 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:19.371712 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a75522e2-4999-45e5-b7f9-ecafee626df5 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:19.372173 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a75522e2-4999-45e5-b7f9-ecafee626df5 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:19.372604 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a75522e2-4999-45e5-b7f9-ecafee626df5 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:19.431348 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-a75522e2-4999-45e5-b7f9-ecafee626df5 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "POST /compute/v2.1/servers/b93d32ea-ad59-46a2-ae7e-e23d66132271/action" status: 204 len: 0 microversion: 2.1 time: 0.073009 Sep 14 09:30:19.432412 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3123/6221] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:30:19 2022] POST /compute/v2.1/servers/b93d32ea-ad59-46a2-ae7e-e23d66132271/action => generated 0 bytes in 75 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:30:19.445783 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-5bee3b0f-d762-48ac-902b-85cf7b37ad56 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:19.449066 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-5bee3b0f-d762-48ac-902b-85cf7b37ad56 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: b93d32ea-ad59-46a2-ae7e-e23d66132271] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:30:19.456694 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5bee3b0f-d762-48ac-902b-85cf7b37ad56 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:19.457258 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5bee3b0f-d762-48ac-902b-85cf7b37ad56 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:19.457776 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5bee3b0f-d762-48ac-902b-85cf7b37ad56 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:19.458536 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5bee3b0f-d762-48ac-902b-85cf7b37ad56 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:19.459055 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5bee3b0f-d762-48ac-902b-85cf7b37ad56 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:19.459727 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5bee3b0f-d762-48ac-902b-85cf7b37ad56 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:19.478324 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-f9cfa45e-c53a-4fa3-91c0-da415f2fc239 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:19.479180 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-f9cfa45e-c53a-4fa3-91c0-da415f2fc239 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: a391dacb-3645-4277-9175-8fe6cf90b09a] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:30:19.486246 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f9cfa45e-c53a-4fa3-91c0-da415f2fc239 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:19.486994 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f9cfa45e-c53a-4fa3-91c0-da415f2fc239 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:19.487197 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f9cfa45e-c53a-4fa3-91c0-da415f2fc239 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:19.488102 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f9cfa45e-c53a-4fa3-91c0-da415f2fc239 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:19.488566 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f9cfa45e-c53a-4fa3-91c0-da415f2fc239 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:19.488985 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f9cfa45e-c53a-4fa3-91c0-da415f2fc239 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:19.716105 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-5bee3b0f-d762-48ac-902b-85cf7b37ad56 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725d7beb4ec54b86a455af0d7bd0ce19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c197eded81494b818b1e56f4c01432c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:30:19.742072 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-5bee3b0f-d762-48ac-902b-85cf7b37ad56 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/b93d32ea-ad59-46a2-ae7e-e23d66132271" status: 200 len: 1687 microversion: 2.1 time: 0.305467 Sep 14 09:30:19.746405 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3099/6222] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:30:19 2022] GET /compute/v2.1/servers/b93d32ea-ad59-46a2-ae7e-e23d66132271 => generated 1687 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:30:19.754050 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-f9cfa45e-c53a-4fa3-91c0-da415f2fc239 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:30:19.772788 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-f9cfa45e-c53a-4fa3-91c0-da415f2fc239 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/a391dacb-3645-4277-9175-8fe6cf90b09a" status: 200 len: 1203 microversion: 2.1 time: 0.306396 Sep 14 09:30:19.773779 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3124/6223] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:30:19 2022] GET /compute/v2.1/servers/a391dacb-3645-4277-9175-8fe6cf90b09a => generated 1203 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:30:20.770426 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-6a2aa42c-7941-4868-be89-20aa3141ded2 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:20.771204 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-6a2aa42c-7941-4868-be89-20aa3141ded2 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: b93d32ea-ad59-46a2-ae7e-e23d66132271] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:30:20.778347 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6a2aa42c-7941-4868-be89-20aa3141ded2 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:20.778835 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6a2aa42c-7941-4868-be89-20aa3141ded2 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:20.779303 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6a2aa42c-7941-4868-be89-20aa3141ded2 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:20.780001 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6a2aa42c-7941-4868-be89-20aa3141ded2 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:20.780453 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6a2aa42c-7941-4868-be89-20aa3141ded2 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:20.780998 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6a2aa42c-7941-4868-be89-20aa3141ded2 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:20.798166 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-dad99fbb-f28b-424f-b993-00b7958ae28d tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:20.800201 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-dad99fbb-f28b-424f-b993-00b7958ae28d tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: a391dacb-3645-4277-9175-8fe6cf90b09a] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:30:20.807553 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dad99fbb-f28b-424f-b993-00b7958ae28d tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:20.808122 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dad99fbb-f28b-424f-b993-00b7958ae28d tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:20.808652 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dad99fbb-f28b-424f-b993-00b7958ae28d tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:20.809425 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dad99fbb-f28b-424f-b993-00b7958ae28d tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:20.809954 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dad99fbb-f28b-424f-b993-00b7958ae28d tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:20.810450 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dad99fbb-f28b-424f-b993-00b7958ae28d tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:21.010542 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-dad99fbb-f28b-424f-b993-00b7958ae28d tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:30:21.010801 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-6a2aa42c-7941-4868-be89-20aa3141ded2 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725d7beb4ec54b86a455af0d7bd0ce19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c197eded81494b818b1e56f4c01432c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:30:21.022086 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-dad99fbb-f28b-424f-b993-00b7958ae28d tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/a391dacb-3645-4277-9175-8fe6cf90b09a" status: 200 len: 1203 microversion: 2.1 time: 0.228221 Sep 14 09:30:21.022666 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3125/6224] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:30:20 2022] GET /compute/v2.1/servers/a391dacb-3645-4277-9175-8fe6cf90b09a => generated 1203 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:30:21.027489 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-6a2aa42c-7941-4868-be89-20aa3141ded2 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/b93d32ea-ad59-46a2-ae7e-e23d66132271" status: 200 len: 1687 microversion: 2.1 time: 0.261733 Sep 14 09:30:21.028197 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3100/6225] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:30:20 2022] GET /compute/v2.1/servers/b93d32ea-ad59-46a2-ae7e-e23d66132271 => generated 1687 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:30:21.670846 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-f84a2558-2e1c-43a6-91ea-157882c054d4 req-ecb2e641-5152-4e37-a255-661921088596 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b93d32ea-ad59-46a2-ae7e-e23d66132271", "name": "network-vif-plugged", "status": "completed", "tag": "ffd5e266-d94c-4d18-b106-97154479401e"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:30:21.681493 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-f84a2558-2e1c-43a6-91ea-157882c054d4 req-ecb2e641-5152-4e37-a255-661921088596 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:21.682254 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-f84a2558-2e1c-43a6-91ea-157882c054d4 req-ecb2e641-5152-4e37-a255-661921088596 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:21.682781 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-f84a2558-2e1c-43a6-91ea-157882c054d4 req-ecb2e641-5152-4e37-a255-661921088596 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:21.695568 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-f84a2558-2e1c-43a6-91ea-157882c054d4 req-ecb2e641-5152-4e37-a255-661921088596 service nova] Creating event network-vif-plugged:ffd5e266-d94c-4d18-b106-97154479401e for instance b93d32ea-ad59-46a2-ae7e-e23d66132271 on n-h1-836830-18 Sep 14 09:30:21.710626 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [req-f84a2558-2e1c-43a6-91ea-157882c054d4 req-ecb2e641-5152-4e37-a255-661921088596 service nova] Instance b93d32ea-ad59-46a2-ae7e-e23d66132271 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-836830-18', 'n-h2-836830-18'} {{(pid=128759) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 14 09:30:21.732681 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-f84a2558-2e1c-43a6-91ea-157882c054d4 req-ecb2e641-5152-4e37-a255-661921088596 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065486 Sep 14 09:30:21.733323 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3101/6226] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:30:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:30:22.044529 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-efcaa5eb-a37d-453a-8519-bf89451034e6 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:22.045178 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-efcaa5eb-a37d-453a-8519-bf89451034e6 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: a391dacb-3645-4277-9175-8fe6cf90b09a] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:30:22.053063 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-efcaa5eb-a37d-453a-8519-bf89451034e6 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:22.053804 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-efcaa5eb-a37d-453a-8519-bf89451034e6 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:22.054455 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-47ce08f4-d563-48c6-bc5c-43ca4caa0a39 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:22.054961 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-efcaa5eb-a37d-453a-8519-bf89451034e6 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:22.055216 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-47ce08f4-d563-48c6-bc5c-43ca4caa0a39 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: b93d32ea-ad59-46a2-ae7e-e23d66132271] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:30:22.055366 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-efcaa5eb-a37d-453a-8519-bf89451034e6 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:22.055846 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-efcaa5eb-a37d-453a-8519-bf89451034e6 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:22.056286 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-efcaa5eb-a37d-453a-8519-bf89451034e6 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:22.070668 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-47ce08f4-d563-48c6-bc5c-43ca4caa0a39 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:22.071195 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-47ce08f4-d563-48c6-bc5c-43ca4caa0a39 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:22.071646 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-47ce08f4-d563-48c6-bc5c-43ca4caa0a39 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:22.072638 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-47ce08f4-d563-48c6-bc5c-43ca4caa0a39 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:22.073086 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-47ce08f4-d563-48c6-bc5c-43ca4caa0a39 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:22.073519 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-47ce08f4-d563-48c6-bc5c-43ca4caa0a39 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:22.296216 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-47ce08f4-d563-48c6-bc5c-43ca4caa0a39 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725d7beb4ec54b86a455af0d7bd0ce19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c197eded81494b818b1e56f4c01432c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:30:22.301430 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-efcaa5eb-a37d-453a-8519-bf89451034e6 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:30:22.306187 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-47ce08f4-d563-48c6-bc5c-43ca4caa0a39 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/b93d32ea-ad59-46a2-ae7e-e23d66132271" status: 200 len: 1679 microversion: 2.1 time: 0.256685 Sep 14 09:30:22.307037 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3102/6227] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:30:22 2022] GET /compute/v2.1/servers/b93d32ea-ad59-46a2-ae7e-e23d66132271 => generated 1679 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:30:22.310431 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-efcaa5eb-a37d-453a-8519-bf89451034e6 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/a391dacb-3645-4277-9175-8fe6cf90b09a" status: 200 len: 1203 microversion: 2.1 time: 0.269928 Sep 14 09:30:22.319660 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3126/6228] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:30:22 2022] GET /compute/v2.1/servers/a391dacb-3645-4277-9175-8fe6cf90b09a => generated 1203 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:30:23.335207 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8a47bbc1-d8b5-4aea-84ea-71ea328a5581 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:23.335966 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-8a47bbc1-d8b5-4aea-84ea-71ea328a5581 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: a391dacb-3645-4277-9175-8fe6cf90b09a] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:30:23.342752 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8a47bbc1-d8b5-4aea-84ea-71ea328a5581 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:23.343270 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8a47bbc1-d8b5-4aea-84ea-71ea328a5581 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:23.343710 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8a47bbc1-d8b5-4aea-84ea-71ea328a5581 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:23.344401 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8a47bbc1-d8b5-4aea-84ea-71ea328a5581 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:23.344885 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8a47bbc1-d8b5-4aea-84ea-71ea328a5581 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:23.345946 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8a47bbc1-d8b5-4aea-84ea-71ea328a5581 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:23.474312 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-8a47bbc1-d8b5-4aea-84ea-71ea328a5581 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:30:23.482079 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-8a47bbc1-d8b5-4aea-84ea-71ea328a5581 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/a391dacb-3645-4277-9175-8fe6cf90b09a" status: 200 len: 1203 microversion: 2.1 time: 0.152250 Sep 14 09:30:23.482653 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3103/6229] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:30:23 2022] GET /compute/v2.1/servers/a391dacb-3645-4277-9175-8fe6cf90b09a => generated 1203 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:30:23.771470 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-ff15843e-3998-4ba9-a48c-94036744d5b4 req-08be68c8-ce74-472c-81ff-d3111f865f7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a391dacb-3645-4277-9175-8fe6cf90b09a", "name": "network-vif-plugged", "status": "completed", "tag": "5e55a2aa-7985-420f-be32-06484124fbe7"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:30:23.785342 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-ff15843e-3998-4ba9-a48c-94036744d5b4 req-08be68c8-ce74-472c-81ff-d3111f865f7a service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:23.786090 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-ff15843e-3998-4ba9-a48c-94036744d5b4 req-08be68c8-ce74-472c-81ff-d3111f865f7a service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:23.786533 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-ff15843e-3998-4ba9-a48c-94036744d5b4 req-08be68c8-ce74-472c-81ff-d3111f865f7a service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:23.791036 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:30:23.800869 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-ff15843e-3998-4ba9-a48c-94036744d5b4 req-08be68c8-ce74-472c-81ff-d3111f865f7a service nova] Creating event network-vif-plugged:5e55a2aa-7985-420f-be32-06484124fbe7 for instance a391dacb-3645-4277-9175-8fe6cf90b09a on n-h2-836830-18 Sep 14 09:30:23.806226 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-ff15843e-3998-4ba9-a48c-94036744d5b4 req-08be68c8-ce74-472c-81ff-d3111f865f7a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038447 Sep 14 09:30:23.806843 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3127/6230] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:30:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:30:24.505766 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-85e1ed3a-b1f9-4f46-bcb8-5fb048a22866 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:24.506390 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-85e1ed3a-b1f9-4f46-bcb8-5fb048a22866 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: a391dacb-3645-4277-9175-8fe6cf90b09a] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:30:24.512660 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-85e1ed3a-b1f9-4f46-bcb8-5fb048a22866 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:24.513145 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-85e1ed3a-b1f9-4f46-bcb8-5fb048a22866 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:24.513585 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-85e1ed3a-b1f9-4f46-bcb8-5fb048a22866 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:24.514269 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-85e1ed3a-b1f9-4f46-bcb8-5fb048a22866 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:24.514723 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-85e1ed3a-b1f9-4f46-bcb8-5fb048a22866 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:24.515175 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-85e1ed3a-b1f9-4f46-bcb8-5fb048a22866 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:24.656843 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-85e1ed3a-b1f9-4f46-bcb8-5fb048a22866 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:30:24.665124 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-85e1ed3a-b1f9-4f46-bcb8-5fb048a22866 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/a391dacb-3645-4277-9175-8fe6cf90b09a" status: 200 len: 1203 microversion: 2.1 time: 0.163750 Sep 14 09:30:24.665713 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3104/6231] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:30:24 2022] GET /compute/v2.1/servers/a391dacb-3645-4277-9175-8fe6cf90b09a => generated 1203 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:30:25.690754 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-989b0f9c-f35e-4367-872e-5de676aba898 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:25.692223 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-989b0f9c-f35e-4367-872e-5de676aba898 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: a391dacb-3645-4277-9175-8fe6cf90b09a] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:30:25.694131 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:30:25.701717 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-989b0f9c-f35e-4367-872e-5de676aba898 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:25.702215 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-989b0f9c-f35e-4367-872e-5de676aba898 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:25.702657 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-989b0f9c-f35e-4367-872e-5de676aba898 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:25.703382 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-989b0f9c-f35e-4367-872e-5de676aba898 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:25.703844 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-989b0f9c-f35e-4367-872e-5de676aba898 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:25.704270 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-989b0f9c-f35e-4367-872e-5de676aba898 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:25.837636 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-989b0f9c-f35e-4367-872e-5de676aba898 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:30:25.846681 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-989b0f9c-f35e-4367-872e-5de676aba898 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/a391dacb-3645-4277-9175-8fe6cf90b09a" status: 200 len: 1388 microversion: 2.1 time: 0.161973 Sep 14 09:30:25.847536 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3128/6232] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:30:25 2022] GET /compute/v2.1/servers/a391dacb-3645-4277-9175-8fe6cf90b09a => generated 1388 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:30:25.869785 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-4ded90c9-8da6-43a7-a141-c9d014ee8d4f tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:25.870399 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-4ded90c9-8da6-43a7-a141-c9d014ee8d4f tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: a391dacb-3645-4277-9175-8fe6cf90b09a] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:30:25.877506 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4ded90c9-8da6-43a7-a141-c9d014ee8d4f tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:25.877987 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4ded90c9-8da6-43a7-a141-c9d014ee8d4f tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:25.878419 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4ded90c9-8da6-43a7-a141-c9d014ee8d4f tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:25.879143 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4ded90c9-8da6-43a7-a141-c9d014ee8d4f tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:25.879594 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4ded90c9-8da6-43a7-a141-c9d014ee8d4f tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:25.880034 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4ded90c9-8da6-43a7-a141-c9d014ee8d4f tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:26.021839 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-4ded90c9-8da6-43a7-a141-c9d014ee8d4f tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:30:26.030012 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-4ded90c9-8da6-43a7-a141-c9d014ee8d4f tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/a391dacb-3645-4277-9175-8fe6cf90b09a" status: 200 len: 1388 microversion: 2.1 time: 0.164191 Sep 14 09:30:26.030594 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3105/6233] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:30:25 2022] GET /compute/v2.1/servers/a391dacb-3645-4277-9175-8fe6cf90b09a => generated 1388 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:30:26.052976 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-031f68c2-938b-4a5b-a155-ce388ef6706d tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:26.053599 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-031f68c2-938b-4a5b-a155-ce388ef6706d tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: a391dacb-3645-4277-9175-8fe6cf90b09a] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:30:26.059855 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-031f68c2-938b-4a5b-a155-ce388ef6706d tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:26.060345 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-031f68c2-938b-4a5b-a155-ce388ef6706d tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:26.060784 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-031f68c2-938b-4a5b-a155-ce388ef6706d tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:26.061480 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-031f68c2-938b-4a5b-a155-ce388ef6706d tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:26.061940 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-031f68c2-938b-4a5b-a155-ce388ef6706d tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:26.062388 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-031f68c2-938b-4a5b-a155-ce388ef6706d tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:26.204064 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-031f68c2-938b-4a5b-a155-ce388ef6706d tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:30:26.212565 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-031f68c2-938b-4a5b-a155-ce388ef6706d tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/a391dacb-3645-4277-9175-8fe6cf90b09a" status: 200 len: 1388 microversion: 2.1 time: 0.164056 Sep 14 09:30:26.213148 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3129/6234] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:30:26 2022] GET /compute/v2.1/servers/a391dacb-3645-4277-9175-8fe6cf90b09a => generated 1388 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:30:26.235167 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d1200092-c6d2-46a3-b2fc-8818b7ba96d4 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:26.235692 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-d1200092-c6d2-46a3-b2fc-8818b7ba96d4 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: a391dacb-3645-4277-9175-8fe6cf90b09a] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:30:26.241775 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d1200092-c6d2-46a3-b2fc-8818b7ba96d4 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:26.242271 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d1200092-c6d2-46a3-b2fc-8818b7ba96d4 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:26.242717 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d1200092-c6d2-46a3-b2fc-8818b7ba96d4 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:26.243442 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d1200092-c6d2-46a3-b2fc-8818b7ba96d4 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:26.243906 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d1200092-c6d2-46a3-b2fc-8818b7ba96d4 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:26.244338 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d1200092-c6d2-46a3-b2fc-8818b7ba96d4 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:26.268947 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-d1200092-c6d2-46a3-b2fc-8818b7ba96d4 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: a391dacb-3645-4277-9175-8fe6cf90b09a] Going to try to terminate instance {{(pid=128759) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:30:26.345216 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d1200092-c6d2-46a3-b2fc-8818b7ba96d4 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "DELETE /compute/v2.1/servers/a391dacb-3645-4277-9175-8fe6cf90b09a" status: 204 len: 0 microversion: 2.1 time: 0.113662 Sep 14 09:30:26.346434 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3106/6235] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:30:26 2022] DELETE /compute/v2.1/servers/a391dacb-3645-4277-9175-8fe6cf90b09a => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:30:26.355155 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-f48b94a3-c198-4591-8895-2937d5d8a8c0 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:26.355908 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-f48b94a3-c198-4591-8895-2937d5d8a8c0 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: a391dacb-3645-4277-9175-8fe6cf90b09a] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:30:26.362850 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f48b94a3-c198-4591-8895-2937d5d8a8c0 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:26.363494 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f48b94a3-c198-4591-8895-2937d5d8a8c0 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:26.363890 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f48b94a3-c198-4591-8895-2937d5d8a8c0 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:26.364598 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f48b94a3-c198-4591-8895-2937d5d8a8c0 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:26.365060 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f48b94a3-c198-4591-8895-2937d5d8a8c0 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:26.365490 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f48b94a3-c198-4591-8895-2937d5d8a8c0 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:26.497860 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-f48b94a3-c198-4591-8895-2937d5d8a8c0 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:30:26.506454 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-f48b94a3-c198-4591-8895-2937d5d8a8c0 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/a391dacb-3645-4277-9175-8fe6cf90b09a" status: 200 len: 1394 microversion: 2.1 time: 0.155535 Sep 14 09:30:26.507250 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3130/6236] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:30:26 2022] GET /compute/v2.1/servers/a391dacb-3645-4277-9175-8fe6cf90b09a => generated 1394 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:30:27.530669 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8b464dcb-6adb-43fa-909b-7d2904ecbdca tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:27.531421 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-8b464dcb-6adb-43fa-909b-7d2904ecbdca tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: a391dacb-3645-4277-9175-8fe6cf90b09a] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:30:27.539239 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8b464dcb-6adb-43fa-909b-7d2904ecbdca tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:27.540432 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8b464dcb-6adb-43fa-909b-7d2904ecbdca tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:27.540432 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8b464dcb-6adb-43fa-909b-7d2904ecbdca tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:27.540851 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8b464dcb-6adb-43fa-909b-7d2904ecbdca tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:27.541299 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8b464dcb-6adb-43fa-909b-7d2904ecbdca tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:27.541724 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8b464dcb-6adb-43fa-909b-7d2904ecbdca tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:27.686085 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-8b464dcb-6adb-43fa-909b-7d2904ecbdca tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:30:27.696154 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-8b464dcb-6adb-43fa-909b-7d2904ecbdca tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/a391dacb-3645-4277-9175-8fe6cf90b09a" status: 200 len: 1394 microversion: 2.1 time: 0.169933 Sep 14 09:30:27.696828 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3107/6237] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:30:27 2022] GET /compute/v2.1/servers/a391dacb-3645-4277-9175-8fe6cf90b09a => generated 1394 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:30:28.288063 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-0bb1f129-3bd5-4003-908f-6f70a795fe5c req-5fc48c1d-afc7-4cfb-b037-5b30c2352c5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a391dacb-3645-4277-9175-8fe6cf90b09a", "name": "network-vif-deleted", "tag": "5e55a2aa-7985-420f-be32-06484124fbe7"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:30:28.308709 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-0bb1f129-3bd5-4003-908f-6f70a795fe5c req-5fc48c1d-afc7-4cfb-b037-5b30c2352c5f service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:28.309291 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-0bb1f129-3bd5-4003-908f-6f70a795fe5c req-5fc48c1d-afc7-4cfb-b037-5b30c2352c5f service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:28.309724 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-0bb1f129-3bd5-4003-908f-6f70a795fe5c req-5fc48c1d-afc7-4cfb-b037-5b30c2352c5f service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:28.323955 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-0bb1f129-3bd5-4003-908f-6f70a795fe5c req-5fc48c1d-afc7-4cfb-b037-5b30c2352c5f service nova] Creating event network-vif-deleted:5e55a2aa-7985-420f-be32-06484124fbe7 for instance a391dacb-3645-4277-9175-8fe6cf90b09a on n-h2-836830-18 Sep 14 09:30:28.329517 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-0bb1f129-3bd5-4003-908f-6f70a795fe5c req-5fc48c1d-afc7-4cfb-b037-5b30c2352c5f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045091 Sep 14 09:30:28.330768 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3131/6238] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:30:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:30:28.720830 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-45779c7d-40ee-4653-8f2b-8f1f847ac0d9 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:28.721435 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-45779c7d-40ee-4653-8f2b-8f1f847ac0d9 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: a391dacb-3645-4277-9175-8fe6cf90b09a] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:30:28.728735 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-45779c7d-40ee-4653-8f2b-8f1f847ac0d9 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:28.729234 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-45779c7d-40ee-4653-8f2b-8f1f847ac0d9 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:28.729890 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-45779c7d-40ee-4653-8f2b-8f1f847ac0d9 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:28.730587 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-45779c7d-40ee-4653-8f2b-8f1f847ac0d9 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:28.731096 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-45779c7d-40ee-4653-8f2b-8f1f847ac0d9 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:28.731511 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-45779c7d-40ee-4653-8f2b-8f1f847ac0d9 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:28.802494 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-45779c7d-40ee-4653-8f2b-8f1f847ac0d9 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:30:28.810720 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-45779c7d-40ee-4653-8f2b-8f1f847ac0d9 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/a391dacb-3645-4277-9175-8fe6cf90b09a" status: 200 len: 1188 microversion: 2.1 time: 0.094214 Sep 14 09:30:28.811637 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3108/6239] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:30:28 2022] GET /compute/v2.1/servers/a391dacb-3645-4277-9175-8fe6cf90b09a => generated 1188 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:30:29.835741 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1c71447a-fecb-4161-b2d7-a7dae1e9751d tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:29.837100 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-1c71447a-fecb-4161-b2d7-a7dae1e9751d tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: a391dacb-3645-4277-9175-8fe6cf90b09a] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:30:29.843654 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1c71447a-fecb-4161-b2d7-a7dae1e9751d tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:29.844138 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1c71447a-fecb-4161-b2d7-a7dae1e9751d tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:29.844570 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1c71447a-fecb-4161-b2d7-a7dae1e9751d tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:29.845818 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1c71447a-fecb-4161-b2d7-a7dae1e9751d tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:29.846275 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1c71447a-fecb-4161-b2d7-a7dae1e9751d tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:29.846696 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1c71447a-fecb-4161-b2d7-a7dae1e9751d tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:29.917360 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-1c71447a-fecb-4161-b2d7-a7dae1e9751d tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:30:29.925259 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-1c71447a-fecb-4161-b2d7-a7dae1e9751d tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/a391dacb-3645-4277-9175-8fe6cf90b09a" status: 200 len: 1188 microversion: 2.1 time: 0.094868 Sep 14 09:30:29.925838 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3132/6240] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:30:29 2022] GET /compute/v2.1/servers/a391dacb-3645-4277-9175-8fe6cf90b09a => generated 1188 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:30:30.948352 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-5123d0bb-a5f3-4dd5-aef3-9993cd4f81db tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:30.949711 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-5123d0bb-a5f3-4dd5-aef3-9993cd4f81db tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: a391dacb-3645-4277-9175-8fe6cf90b09a] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:30:30.965701 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5123d0bb-a5f3-4dd5-aef3-9993cd4f81db tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:30.966300 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5123d0bb-a5f3-4dd5-aef3-9993cd4f81db tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:30.966845 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5123d0bb-a5f3-4dd5-aef3-9993cd4f81db tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:30.967655 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5123d0bb-a5f3-4dd5-aef3-9993cd4f81db tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:30.968185 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5123d0bb-a5f3-4dd5-aef3-9993cd4f81db tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:30.968677 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5123d0bb-a5f3-4dd5-aef3-9993cd4f81db tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:31.042057 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-5123d0bb-a5f3-4dd5-aef3-9993cd4f81db tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:30:31.053911 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-5123d0bb-a5f3-4dd5-aef3-9993cd4f81db tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/a391dacb-3645-4277-9175-8fe6cf90b09a" status: 200 len: 1188 microversion: 2.1 time: 0.109742 Sep 14 09:30:31.068176 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3109/6241] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:30:30 2022] GET /compute/v2.1/servers/a391dacb-3645-4277-9175-8fe6cf90b09a => generated 1188 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:30:32.078080 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-6190c97d-c757-466f-abf3-b88519acdfde tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:32.078617 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-6190c97d-c757-466f-abf3-b88519acdfde tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: a391dacb-3645-4277-9175-8fe6cf90b09a] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:30:32.087087 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6190c97d-c757-466f-abf3-b88519acdfde tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:32.087809 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6190c97d-c757-466f-abf3-b88519acdfde tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:32.088292 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6190c97d-c757-466f-abf3-b88519acdfde tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:32.089014 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6190c97d-c757-466f-abf3-b88519acdfde tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:32.089467 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6190c97d-c757-466f-abf3-b88519acdfde tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:32.089894 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6190c97d-c757-466f-abf3-b88519acdfde tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:32.166681 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-6190c97d-c757-466f-abf3-b88519acdfde tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:30:32.175314 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-6190c97d-c757-466f-abf3-b88519acdfde tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/a391dacb-3645-4277-9175-8fe6cf90b09a" status: 200 len: 1188 microversion: 2.1 time: 0.101277 Sep 14 09:30:32.176113 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3133/6242] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:30:32 2022] GET /compute/v2.1/servers/a391dacb-3645-4277-9175-8fe6cf90b09a => generated 1188 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:30:33.198081 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a1657715-dcf0-4425-aa2a-20225fbfa7b4 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:33.198741 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-a1657715-dcf0-4425-aa2a-20225fbfa7b4 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: a391dacb-3645-4277-9175-8fe6cf90b09a] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:30:33.206268 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a1657715-dcf0-4425-aa2a-20225fbfa7b4 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:33.206765 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a1657715-dcf0-4425-aa2a-20225fbfa7b4 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:33.207267 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a1657715-dcf0-4425-aa2a-20225fbfa7b4 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:33.207973 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a1657715-dcf0-4425-aa2a-20225fbfa7b4 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:33.208434 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a1657715-dcf0-4425-aa2a-20225fbfa7b4 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:33.208864 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a1657715-dcf0-4425-aa2a-20225fbfa7b4 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:33.222602 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-a1657715-dcf0-4425-aa2a-20225fbfa7b4 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] HTTP exception thrown: Instance a391dacb-3645-4277-9175-8fe6cf90b09a could not be found. Sep 14 09:30:33.224283 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a1657715-dcf0-4425-aa2a-20225fbfa7b4 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Request method failure captured: Sep 14 09:30:33.224283 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/a391dacb-3645-4277-9175-8fe6cf90b09a HTTP/1.1 Sep 14 09:30:33.224283 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:30:33.224283 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:30:33.224283 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:30:33.224283 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:30:33.224283 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:30:33.224283 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:30:33.224283 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:30:33.224283 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:30:33.224283 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZ7vSEasHnu7hRXol9c-LZuMaC9uK137X6F5rG7UmloUJeCaIX1XI8DyW-6MYPzXIn8tJlRUDBfS9Xo7ko5WvlkRtwNLi8r30OmEJBkLllR4uOPeHedowZTMuQPwQppwmIxlx0K05UlAJOyH1eD16mNE7GFFk01jmhPM_9wCZyZUFi8 Sep 14 09:30:33.224283 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:30:33.224283 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:30:33.224283 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:30:33.224283 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:30:33.224283 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:30:33.224283 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:30:33.224283 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 0fca803d9ffa4b4ab0371c0d6a96a5a2 Sep 14 09:30:33.224283 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-TestVolumeBootPattern-1945148622 Sep 14 09:30:33.224283 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:30:33.224283 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:30:33.224283 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0fca803d9ffa4b4ab0371c0d6a96a5a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0fca803d9ffa4b4ab0371c0d6a96a5a2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0fca803d9ffa4b4ab0371c0d6a96a5a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0fca803d9ffa4b4ab0371c0d6a96a5a2"}]}] Sep 14 09:30:33.224283 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-TestVolumeBootPattern-1945148622 Sep 14 09:30:33.224283 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 0fca803d9ffa4b4ab0371c0d6a96a5a2 Sep 14 09:30:33.224283 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-TestVolumeBootPattern-1945148622 Sep 14 09:30:33.224283 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-TestVolumeBootPattern-1945148622-project Sep 14 09:30:33.224283 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:30:33.224283 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:30:33.224283 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 80257054a25540c294e1787780b601b4 Sep 14 09:30:33.224283 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-TestVolumeBootPattern-1945148622-project Sep 14 09:30:33.224283 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:30:33.224283 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance a391dacb-3645-4277-9175-8fe6cf90b09a could not be found. Sep 14 09:30:33.224283 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': 'a391dacb-3645-4277-9175-8fe6cf90b09a'} Sep 14 09:30:33.224283 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:30:33.224283 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:30:33.224283 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:30:33.224283 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:30:33.224283 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:30:33.224283 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:30:33.224283 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:30:33.224283 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:30:33.224283 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:30:33.224283 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:30:33.224283 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a391dacb-3645-4277-9175-8fe6cf90b09a could not be found. Sep 14 09:30:33.224283 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:30:33.224283 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:30:33.224283 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:30:33.224283 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:30:33.224283 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:30:33.224283 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:30:33.224283 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:30:33.224283 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:30:33.224283 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:30:33.224283 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:30:33.224283 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:30:33.224283 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:30:33.224283 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:30:33.224283 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:30:33.224283 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:30:33.224283 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:30:33.224283 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a391dacb-3645-4277-9175-8fe6cf90b09a could not be found. Sep 14 09:30:33.224283 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:30:33.224283 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:30:33.224283 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:30:33.228572 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:30:33.228572 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:30:33.228572 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:30:33.228572 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:30:33.228572 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:30:33.228572 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a391dacb-3645-4277-9175-8fe6cf90b09a could not be found. Sep 14 09:30:33.228572 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:30:33.228572 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a1657715-dcf0-4425-aa2a-20225fbfa7b4 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Returning 404 to user: Instance a391dacb-3645-4277-9175-8fe6cf90b09a could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:30:33.228572 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a1657715-dcf0-4425-aa2a-20225fbfa7b4 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/a391dacb-3645-4277-9175-8fe6cf90b09a" status: 404 len: 111 microversion: 2.1 time: 0.031914 Sep 14 09:30:33.228572 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3110/6243] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:30:33 2022] GET /compute/v2.1/servers/a391dacb-3645-4277-9175-8fe6cf90b09a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:30:52.536669 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-5949a191-e1c2-4ef8-ac97-dd33ccffa881 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:30:52.539152 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-5949a191-e1c2-4ef8-ac97-dd33ccffa881 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: b93d32ea-ad59-46a2-ae7e-e23d66132271] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:30:52.541942 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=11 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:30:52.543177 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=32 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:30:52.551159 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5949a191-e1c2-4ef8-ac97-dd33ccffa881 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:52.551807 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5949a191-e1c2-4ef8-ac97-dd33ccffa881 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:52.552361 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5949a191-e1c2-4ef8-ac97-dd33ccffa881 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:52.553760 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5949a191-e1c2-4ef8-ac97-dd33ccffa881 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:52.554504 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5949a191-e1c2-4ef8-ac97-dd33ccffa881 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:52.555206 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5949a191-e1c2-4ef8-ac97-dd33ccffa881 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:52.635535 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-5949a191-e1c2-4ef8-ac97-dd33ccffa881 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "POST /compute/v2.1/servers/b93d32ea-ad59-46a2-ae7e-e23d66132271/action" status: 200 len: 24578 microversion: 2.1 time: 0.103872 Sep 14 09:30:52.643058 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3134/6244] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:30:52 2022] POST /compute/v2.1/servers/b93d32ea-ad59-46a2-ae7e-e23d66132271/action => generated 24578 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 09:30:55.666899 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-382915c6-cd81-44a0-9d93-6f9efa4c5039 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-599870297", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "d229d02f-15ff-4eeb-a037-4141523fbf4b", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "70503795-7dfb-4d39-a57e-91e8e5270ce0"}]}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:30:55.677768 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:30:55.678430 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:30:55.762510 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.network.neutron [None req-382915c6-cd81-44a0-9d93-6f9efa4c5039 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] validate_networks() for [('70503795-7dfb-4d39-a57e-91e8e5270ce0', None, None, None, None, None)] {{(pid=128759) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:30:56.206878 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-382915c6-cd81-44a0-9d93-6f9efa4c5039 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Flavor limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:30:56.207428 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-382915c6-cd81-44a0-9d93-6f9efa4c5039 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Image limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:30:56.208001 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-382915c6-cd81-44a0-9d93-6f9efa4c5039 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Flavor pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:30:56.208481 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-382915c6-cd81-44a0-9d93-6f9efa4c5039 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Image pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:30:56.208968 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-382915c6-cd81-44a0-9d93-6f9efa4c5039 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:30:56.217985 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-382915c6-cd81-44a0-9d93-6f9efa4c5039 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:56.218555 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-382915c6-cd81-44a0-9d93-6f9efa4c5039 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:56.219100 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-382915c6-cd81-44a0-9d93-6f9efa4c5039 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:56.219904 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-382915c6-cd81-44a0-9d93-6f9efa4c5039 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:56.220996 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-382915c6-cd81-44a0-9d93-6f9efa4c5039 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:56.221509 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-382915c6-cd81-44a0-9d93-6f9efa4c5039 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:56.240431 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-382915c6-cd81-44a0-9d93-6f9efa4c5039 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Getting quotas for project 0fca803d9ffa4b4ab0371c0d6a96a5a2. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:30:56.246044 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-382915c6-cd81-44a0-9d93-6f9efa4c5039 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Getting quotas for user 80257054a25540c294e1787780b601b4 and project 0fca803d9ffa4b4ab0371c0d6a96a5a2. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:30:56.260187 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-382915c6-cd81-44a0-9d93-6f9efa4c5039 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Going to run 1 instances... {{(pid=128759) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:30:56.262414 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-382915c6-cd81-44a0-9d93-6f9efa4c5039 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: 0523217d-941f-4e9e-8b7e-4c43a628fa26] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='d229d02f-15ff-4eeb-a037-4141523fbf4b',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128759) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:30:56.341299 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-382915c6-cd81-44a0-9d93-6f9efa4c5039 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.678515 Sep 14 09:30:56.342188 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3111/6245] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 09:30:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 680 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:30:56.355940 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-3c5c3b09-0379-4cf9-a319-ecefee648ce0 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:56.358272 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-3c5c3b09-0379-4cf9-a319-ecefee648ce0 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: 0523217d-941f-4e9e-8b7e-4c43a628fa26] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:30:56.437289 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-3c5c3b09-0379-4cf9-a319-ecefee648ce0 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:30:56.451112 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-3c5c3b09-0379-4cf9-a319-ecefee648ce0 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/0523217d-941f-4e9e-8b7e-4c43a628fa26" status: 200 len: 1056 microversion: 2.1 time: 0.100338 Sep 14 09:30:56.451807 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3135/6246] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:30:56 2022] GET /compute/v2.1/servers/0523217d-941f-4e9e-8b7e-4c43a628fa26 => generated 1056 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:30:57.476423 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-684b823c-1272-47ee-ab9a-f6558b57e46b tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:57.477266 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-684b823c-1272-47ee-ab9a-f6558b57e46b tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: 0523217d-941f-4e9e-8b7e-4c43a628fa26] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:30:57.483751 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-684b823c-1272-47ee-ab9a-f6558b57e46b tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:57.484408 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-684b823c-1272-47ee-ab9a-f6558b57e46b tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:57.484872 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-684b823c-1272-47ee-ab9a-f6558b57e46b tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:57.485670 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-684b823c-1272-47ee-ab9a-f6558b57e46b tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:57.486784 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-684b823c-1272-47ee-ab9a-f6558b57e46b tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:57.487457 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-684b823c-1272-47ee-ab9a-f6558b57e46b tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:57.600298 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-684b823c-1272-47ee-ab9a-f6558b57e46b tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:30:57.608017 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-684b823c-1272-47ee-ab9a-f6558b57e46b tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/0523217d-941f-4e9e-8b7e-4c43a628fa26" status: 200 len: 1126 microversion: 2.1 time: 0.136879 Sep 14 09:30:57.609136 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3112/6247] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:30:57 2022] GET /compute/v2.1/servers/0523217d-941f-4e9e-8b7e-4c43a628fa26 => generated 1126 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:30:58.633111 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-8659d86a-475f-4402-9917-2ed45da7b0b3 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:58.633657 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-8659d86a-475f-4402-9917-2ed45da7b0b3 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: 0523217d-941f-4e9e-8b7e-4c43a628fa26] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:30:58.657447 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8659d86a-475f-4402-9917-2ed45da7b0b3 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:58.658036 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8659d86a-475f-4402-9917-2ed45da7b0b3 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:58.658490 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8659d86a-475f-4402-9917-2ed45da7b0b3 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:58.662823 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8659d86a-475f-4402-9917-2ed45da7b0b3 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:58.662823 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8659d86a-475f-4402-9917-2ed45da7b0b3 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:58.662823 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8659d86a-475f-4402-9917-2ed45da7b0b3 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:58.841231 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-8659d86a-475f-4402-9917-2ed45da7b0b3 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:30:58.850147 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-8659d86a-475f-4402-9917-2ed45da7b0b3 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/0523217d-941f-4e9e-8b7e-4c43a628fa26" status: 200 len: 1168 microversion: 2.1 time: 0.221418 Sep 14 09:30:58.852088 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3136/6248] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:30:58 2022] GET /compute/v2.1/servers/0523217d-941f-4e9e-8b7e-4c43a628fa26 => generated 1168 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:30:59.010777 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-c4d9b627-a10f-4be8-9690-714aa39355e9 req-82c55485-409e-4da3-bd32-14798a3d83d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0523217d-941f-4e9e-8b7e-4c43a628fa26", "tag": "14fe4ccb-9014-4a86-93e9-99086b002dd9"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:30:59.036230 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-c4d9b627-a10f-4be8-9690-714aa39355e9 req-82c55485-409e-4da3-bd32-14798a3d83d2 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:59.037032 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-c4d9b627-a10f-4be8-9690-714aa39355e9 req-82c55485-409e-4da3-bd32-14798a3d83d2 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:59.037979 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-c4d9b627-a10f-4be8-9690-714aa39355e9 req-82c55485-409e-4da3-bd32-14798a3d83d2 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:59.081693 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-c4d9b627-a10f-4be8-9690-714aa39355e9 req-82c55485-409e-4da3-bd32-14798a3d83d2 service nova] Creating event network-changed:14fe4ccb-9014-4a86-93e9-99086b002dd9 for instance 0523217d-941f-4e9e-8b7e-4c43a628fa26 on n-h2-836830-18 Sep 14 09:30:59.092496 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-c4d9b627-a10f-4be8-9690-714aa39355e9 req-82c55485-409e-4da3-bd32-14798a3d83d2 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087635 Sep 14 09:30:59.093761 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3113/6249] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:30:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:30:59.877714 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1095e168-d4e6-42c7-ab8f-1fd5b789bc9a tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:59.878922 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-1095e168-d4e6-42c7-ab8f-1fd5b789bc9a tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: 0523217d-941f-4e9e-8b7e-4c43a628fa26] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:30:59.885281 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1095e168-d4e6-42c7-ab8f-1fd5b789bc9a tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:59.885968 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1095e168-d4e6-42c7-ab8f-1fd5b789bc9a tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:59.886579 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1095e168-d4e6-42c7-ab8f-1fd5b789bc9a tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:59.887507 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1095e168-d4e6-42c7-ab8f-1fd5b789bc9a tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:59.888136 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1095e168-d4e6-42c7-ab8f-1fd5b789bc9a tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:59.888754 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1095e168-d4e6-42c7-ab8f-1fd5b789bc9a tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:00.087466 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-1095e168-d4e6-42c7-ab8f-1fd5b789bc9a tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:00.097412 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-1095e168-d4e6-42c7-ab8f-1fd5b789bc9a tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/0523217d-941f-4e9e-8b7e-4c43a628fa26" status: 200 len: 1168 microversion: 2.1 time: 0.224551 Sep 14 09:31:00.098182 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3137/6250] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:30:59 2022] GET /compute/v2.1/servers/0523217d-941f-4e9e-8b7e-4c43a628fa26 => generated 1168 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:31:01.121807 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b84beefd-e73e-45e8-9fda-655aa51cdbfc tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:01.123445 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b84beefd-e73e-45e8-9fda-655aa51cdbfc tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: 0523217d-941f-4e9e-8b7e-4c43a628fa26] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:01.139673 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b84beefd-e73e-45e8-9fda-655aa51cdbfc tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:01.141396 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b84beefd-e73e-45e8-9fda-655aa51cdbfc tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:01.143013 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b84beefd-e73e-45e8-9fda-655aa51cdbfc tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:01.144826 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b84beefd-e73e-45e8-9fda-655aa51cdbfc tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:01.146444 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b84beefd-e73e-45e8-9fda-655aa51cdbfc tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:01.147047 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b84beefd-e73e-45e8-9fda-655aa51cdbfc tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:01.313381 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b84beefd-e73e-45e8-9fda-655aa51cdbfc tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:01.324167 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b84beefd-e73e-45e8-9fda-655aa51cdbfc tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/0523217d-941f-4e9e-8b7e-4c43a628fa26" status: 200 len: 1168 microversion: 2.1 time: 0.207536 Sep 14 09:31:01.324825 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3114/6251] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:31:01 2022] GET /compute/v2.1/servers/0523217d-941f-4e9e-8b7e-4c43a628fa26 => generated 1168 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:31:02.354178 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-dbe338db-7b9f-493f-a32e-bb2b179d8bd5 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:02.355304 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-dbe338db-7b9f-493f-a32e-bb2b179d8bd5 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: 0523217d-941f-4e9e-8b7e-4c43a628fa26] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:02.364927 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dbe338db-7b9f-493f-a32e-bb2b179d8bd5 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:02.365528 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dbe338db-7b9f-493f-a32e-bb2b179d8bd5 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:02.366185 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dbe338db-7b9f-493f-a32e-bb2b179d8bd5 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:02.367706 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dbe338db-7b9f-493f-a32e-bb2b179d8bd5 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:02.368384 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dbe338db-7b9f-493f-a32e-bb2b179d8bd5 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:02.369131 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dbe338db-7b9f-493f-a32e-bb2b179d8bd5 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:02.529864 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-dbe338db-7b9f-493f-a32e-bb2b179d8bd5 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:02.544891 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-dbe338db-7b9f-493f-a32e-bb2b179d8bd5 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/0523217d-941f-4e9e-8b7e-4c43a628fa26" status: 200 len: 1168 microversion: 2.1 time: 0.195041 Sep 14 09:31:02.545994 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3138/6252] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:31:02 2022] GET /compute/v2.1/servers/0523217d-941f-4e9e-8b7e-4c43a628fa26 => generated 1168 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:31:03.575217 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e2fbec56-4ed2-45d3-b4e9-6889e1303962 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:03.576568 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e2fbec56-4ed2-45d3-b4e9-6889e1303962 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: 0523217d-941f-4e9e-8b7e-4c43a628fa26] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:03.585355 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e2fbec56-4ed2-45d3-b4e9-6889e1303962 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:03.586783 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e2fbec56-4ed2-45d3-b4e9-6889e1303962 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:03.586783 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e2fbec56-4ed2-45d3-b4e9-6889e1303962 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:03.589778 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e2fbec56-4ed2-45d3-b4e9-6889e1303962 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:03.589778 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e2fbec56-4ed2-45d3-b4e9-6889e1303962 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:03.589778 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e2fbec56-4ed2-45d3-b4e9-6889e1303962 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:03.768169 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-e2fbec56-4ed2-45d3-b4e9-6889e1303962 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:03.776552 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e2fbec56-4ed2-45d3-b4e9-6889e1303962 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/0523217d-941f-4e9e-8b7e-4c43a628fa26" status: 200 len: 1168 microversion: 2.1 time: 0.206300 Sep 14 09:31:03.777136 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3115/6253] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:31:03 2022] GET /compute/v2.1/servers/0523217d-941f-4e9e-8b7e-4c43a628fa26 => generated 1168 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:31:04.800609 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-28ae9e8d-895e-4391-bf2c-761ddc18633c tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:04.801258 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-28ae9e8d-895e-4391-bf2c-761ddc18633c tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: 0523217d-941f-4e9e-8b7e-4c43a628fa26] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:04.809425 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-28ae9e8d-895e-4391-bf2c-761ddc18633c tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:04.809912 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-28ae9e8d-895e-4391-bf2c-761ddc18633c tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:04.810359 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-28ae9e8d-895e-4391-bf2c-761ddc18633c tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:04.811084 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-28ae9e8d-895e-4391-bf2c-761ddc18633c tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:04.811541 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-28ae9e8d-895e-4391-bf2c-761ddc18633c tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:04.813126 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-28ae9e8d-895e-4391-bf2c-761ddc18633c tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:04.973848 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-28ae9e8d-895e-4391-bf2c-761ddc18633c tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:04.984570 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-28ae9e8d-895e-4391-bf2c-761ddc18633c tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/0523217d-941f-4e9e-8b7e-4c43a628fa26" status: 200 len: 1168 microversion: 2.1 time: 0.189345 Sep 14 09:31:04.996282 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3139/6254] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:31:04 2022] GET /compute/v2.1/servers/0523217d-941f-4e9e-8b7e-4c43a628fa26 => generated 1168 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:31:06.013011 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f54270ff-5ae9-43cd-94aa-ea9912043296 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:06.013774 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f54270ff-5ae9-43cd-94aa-ea9912043296 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: 0523217d-941f-4e9e-8b7e-4c43a628fa26] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:06.021759 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f54270ff-5ae9-43cd-94aa-ea9912043296 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:06.022191 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f54270ff-5ae9-43cd-94aa-ea9912043296 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:06.022630 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f54270ff-5ae9-43cd-94aa-ea9912043296 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:06.023582 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f54270ff-5ae9-43cd-94aa-ea9912043296 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:06.024041 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f54270ff-5ae9-43cd-94aa-ea9912043296 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:06.024470 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f54270ff-5ae9-43cd-94aa-ea9912043296 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:06.171961 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f54270ff-5ae9-43cd-94aa-ea9912043296 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:06.180259 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f54270ff-5ae9-43cd-94aa-ea9912043296 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/0523217d-941f-4e9e-8b7e-4c43a628fa26" status: 200 len: 1168 microversion: 2.1 time: 0.171321 Sep 14 09:31:06.194992 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3116/6255] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:31:06 2022] GET /compute/v2.1/servers/0523217d-941f-4e9e-8b7e-4c43a628fa26 => generated 1168 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:31:07.201984 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=2 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:31:07.207368 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-7f82e49f-5713-428b-b030-73bf157361e4 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:07.208223 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-7f82e49f-5713-428b-b030-73bf157361e4 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: 0523217d-941f-4e9e-8b7e-4c43a628fa26] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:07.215745 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7f82e49f-5713-428b-b030-73bf157361e4 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:07.216068 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7f82e49f-5713-428b-b030-73bf157361e4 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:07.216831 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7f82e49f-5713-428b-b030-73bf157361e4 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:07.217187 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7f82e49f-5713-428b-b030-73bf157361e4 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:07.217648 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7f82e49f-5713-428b-b030-73bf157361e4 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:07.218275 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7f82e49f-5713-428b-b030-73bf157361e4 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:07.394975 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-7f82e49f-5713-428b-b030-73bf157361e4 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:07.404541 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-7f82e49f-5713-428b-b030-73bf157361e4 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/0523217d-941f-4e9e-8b7e-4c43a628fa26" status: 200 len: 1168 microversion: 2.1 time: 0.204332 Sep 14 09:31:07.405584 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3140/6256] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:31:07 2022] GET /compute/v2.1/servers/0523217d-941f-4e9e-8b7e-4c43a628fa26 => generated 1168 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:31:08.428416 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c7d74fc7-ee89-4109-8da2-6eadf105e8c1 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:08.428969 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-c7d74fc7-ee89-4109-8da2-6eadf105e8c1 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: 0523217d-941f-4e9e-8b7e-4c43a628fa26] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:08.431024 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=2 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:31:08.431866 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=6 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:31:08.441212 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c7d74fc7-ee89-4109-8da2-6eadf105e8c1 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:08.441716 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c7d74fc7-ee89-4109-8da2-6eadf105e8c1 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:08.442219 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c7d74fc7-ee89-4109-8da2-6eadf105e8c1 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:08.442966 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c7d74fc7-ee89-4109-8da2-6eadf105e8c1 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:08.443420 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c7d74fc7-ee89-4109-8da2-6eadf105e8c1 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:08.443856 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c7d74fc7-ee89-4109-8da2-6eadf105e8c1 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:08.587346 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-c7d74fc7-ee89-4109-8da2-6eadf105e8c1 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:08.596108 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-c7d74fc7-ee89-4109-8da2-6eadf105e8c1 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/0523217d-941f-4e9e-8b7e-4c43a628fa26" status: 200 len: 1168 microversion: 2.1 time: 0.171768 Sep 14 09:31:08.596694 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3117/6257] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:31:08 2022] GET /compute/v2.1/servers/0523217d-941f-4e9e-8b7e-4c43a628fa26 => generated 1168 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:31:09.618078 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-9fed10e5-d142-4842-9de9-da9ad9afbbc0 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:09.618704 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-9fed10e5-d142-4842-9de9-da9ad9afbbc0 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: 0523217d-941f-4e9e-8b7e-4c43a628fa26] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:09.625921 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9fed10e5-d142-4842-9de9-da9ad9afbbc0 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:09.627086 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9fed10e5-d142-4842-9de9-da9ad9afbbc0 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:09.627536 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9fed10e5-d142-4842-9de9-da9ad9afbbc0 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:09.628289 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9fed10e5-d142-4842-9de9-da9ad9afbbc0 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:09.628806 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9fed10e5-d142-4842-9de9-da9ad9afbbc0 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:09.629231 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9fed10e5-d142-4842-9de9-da9ad9afbbc0 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:09.768980 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-9fed10e5-d142-4842-9de9-da9ad9afbbc0 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:09.777229 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-9fed10e5-d142-4842-9de9-da9ad9afbbc0 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/0523217d-941f-4e9e-8b7e-4c43a628fa26" status: 200 len: 1168 microversion: 2.1 time: 0.163049 Sep 14 09:31:09.777829 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3141/6258] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:31:09 2022] GET /compute/v2.1/servers/0523217d-941f-4e9e-8b7e-4c43a628fa26 => generated 1168 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:31:10.800361 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-4884f1ce-8651-4627-8996-1b5d89b43fa4 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:10.800925 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-4884f1ce-8651-4627-8996-1b5d89b43fa4 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: 0523217d-941f-4e9e-8b7e-4c43a628fa26] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:10.808079 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4884f1ce-8651-4627-8996-1b5d89b43fa4 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:10.808570 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4884f1ce-8651-4627-8996-1b5d89b43fa4 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:10.809009 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4884f1ce-8651-4627-8996-1b5d89b43fa4 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:10.809701 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4884f1ce-8651-4627-8996-1b5d89b43fa4 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:10.810162 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4884f1ce-8651-4627-8996-1b5d89b43fa4 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:10.810589 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4884f1ce-8651-4627-8996-1b5d89b43fa4 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:10.943088 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-4884f1ce-8651-4627-8996-1b5d89b43fa4 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:10.951412 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-4884f1ce-8651-4627-8996-1b5d89b43fa4 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/0523217d-941f-4e9e-8b7e-4c43a628fa26" status: 200 len: 1168 microversion: 2.1 time: 0.155084 Sep 14 09:31:10.952072 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3118/6259] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:31:10 2022] GET /compute/v2.1/servers/0523217d-941f-4e9e-8b7e-4c43a628fa26 => generated 1168 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:31:11.973881 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-28173c42-bc63-49af-bce2-c0f734947c6d tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:11.974507 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-28173c42-bc63-49af-bce2-c0f734947c6d tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: 0523217d-941f-4e9e-8b7e-4c43a628fa26] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:11.981566 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-28173c42-bc63-49af-bce2-c0f734947c6d tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:11.982048 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-28173c42-bc63-49af-bce2-c0f734947c6d tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:11.982478 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-28173c42-bc63-49af-bce2-c0f734947c6d tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:11.983220 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-28173c42-bc63-49af-bce2-c0f734947c6d tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:11.983676 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-28173c42-bc63-49af-bce2-c0f734947c6d tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:11.984100 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-28173c42-bc63-49af-bce2-c0f734947c6d tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:12.117837 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-28173c42-bc63-49af-bce2-c0f734947c6d tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:12.125820 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-28173c42-bc63-49af-bce2-c0f734947c6d tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/0523217d-941f-4e9e-8b7e-4c43a628fa26" status: 200 len: 1168 microversion: 2.1 time: 0.155848 Sep 14 09:31:12.141214 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3142/6260] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:31:11 2022] GET /compute/v2.1/servers/0523217d-941f-4e9e-8b7e-4c43a628fa26 => generated 1168 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:31:13.149584 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-83501410-534c-4bdc-ac63-ff78b59f45f0 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:13.150210 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-83501410-534c-4bdc-ac63-ff78b59f45f0 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: 0523217d-941f-4e9e-8b7e-4c43a628fa26] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:13.157180 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-83501410-534c-4bdc-ac63-ff78b59f45f0 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:13.157671 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-83501410-534c-4bdc-ac63-ff78b59f45f0 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:13.158108 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-83501410-534c-4bdc-ac63-ff78b59f45f0 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:13.158803 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-83501410-534c-4bdc-ac63-ff78b59f45f0 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:13.159286 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-83501410-534c-4bdc-ac63-ff78b59f45f0 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:13.159715 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-83501410-534c-4bdc-ac63-ff78b59f45f0 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:13.289723 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-83501410-534c-4bdc-ac63-ff78b59f45f0 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:13.297458 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-83501410-534c-4bdc-ac63-ff78b59f45f0 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/0523217d-941f-4e9e-8b7e-4c43a628fa26" status: 200 len: 1168 microversion: 2.1 time: 0.151846 Sep 14 09:31:13.298030 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3119/6261] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:31:13 2022] GET /compute/v2.1/servers/0523217d-941f-4e9e-8b7e-4c43a628fa26 => generated 1168 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:31:14.320421 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-324da060-080d-4762-9736-eaad08b8a55c tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:14.321062 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-324da060-080d-4762-9736-eaad08b8a55c tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: 0523217d-941f-4e9e-8b7e-4c43a628fa26] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:14.328369 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-324da060-080d-4762-9736-eaad08b8a55c tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:14.328869 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-324da060-080d-4762-9736-eaad08b8a55c tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:14.329316 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-324da060-080d-4762-9736-eaad08b8a55c tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:14.330024 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-324da060-080d-4762-9736-eaad08b8a55c tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:14.330489 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-324da060-080d-4762-9736-eaad08b8a55c tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:14.330928 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-324da060-080d-4762-9736-eaad08b8a55c tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:14.484195 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-324da060-080d-4762-9736-eaad08b8a55c tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:14.493285 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-324da060-080d-4762-9736-eaad08b8a55c tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/0523217d-941f-4e9e-8b7e-4c43a628fa26" status: 200 len: 1214 microversion: 2.1 time: 0.177070 Sep 14 09:31:14.505128 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3143/6262] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:31:14 2022] GET /compute/v2.1/servers/0523217d-941f-4e9e-8b7e-4c43a628fa26 => generated 1214 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:31:15.519230 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d442974b-dd21-4bb3-90f8-a4622b502bbf tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:15.519855 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-d442974b-dd21-4bb3-90f8-a4622b502bbf tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: 0523217d-941f-4e9e-8b7e-4c43a628fa26] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:15.527186 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d442974b-dd21-4bb3-90f8-a4622b502bbf tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:15.527692 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d442974b-dd21-4bb3-90f8-a4622b502bbf tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:15.528299 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d442974b-dd21-4bb3-90f8-a4622b502bbf tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:15.529056 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d442974b-dd21-4bb3-90f8-a4622b502bbf tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:15.529521 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d442974b-dd21-4bb3-90f8-a4622b502bbf tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:15.529958 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d442974b-dd21-4bb3-90f8-a4622b502bbf tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:15.665078 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-d442974b-dd21-4bb3-90f8-a4622b502bbf tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:15.673216 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d442974b-dd21-4bb3-90f8-a4622b502bbf tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/0523217d-941f-4e9e-8b7e-4c43a628fa26" status: 200 len: 1202 microversion: 2.1 time: 0.158576 Sep 14 09:31:15.674313 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3120/6263] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:31:15 2022] GET /compute/v2.1/servers/0523217d-941f-4e9e-8b7e-4c43a628fa26 => generated 1202 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:31:15.759500 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a10dfc52-8ecf-46d2-a94b-821988a9d591 tempest-TestNetworkAdvancedServerOps-649526860 tempest-TestNetworkAdvancedServerOps-649526860-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:15.760140 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-a10dfc52-8ecf-46d2-a94b-821988a9d591 tempest-TestNetworkAdvancedServerOps-649526860 tempest-TestNetworkAdvancedServerOps-649526860-project-admin] [instance: b93d32ea-ad59-46a2-ae7e-e23d66132271] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:15.767356 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a10dfc52-8ecf-46d2-a94b-821988a9d591 tempest-TestNetworkAdvancedServerOps-649526860 tempest-TestNetworkAdvancedServerOps-649526860-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:15.767873 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a10dfc52-8ecf-46d2-a94b-821988a9d591 tempest-TestNetworkAdvancedServerOps-649526860 tempest-TestNetworkAdvancedServerOps-649526860-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:15.768286 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a10dfc52-8ecf-46d2-a94b-821988a9d591 tempest-TestNetworkAdvancedServerOps-649526860 tempest-TestNetworkAdvancedServerOps-649526860-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:15.768977 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a10dfc52-8ecf-46d2-a94b-821988a9d591 tempest-TestNetworkAdvancedServerOps-649526860 tempest-TestNetworkAdvancedServerOps-649526860-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:15.769483 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a10dfc52-8ecf-46d2-a94b-821988a9d591 tempest-TestNetworkAdvancedServerOps-649526860 tempest-TestNetworkAdvancedServerOps-649526860-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:15.769864 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a10dfc52-8ecf-46d2-a94b-821988a9d591 tempest-TestNetworkAdvancedServerOps-649526860 tempest-TestNetworkAdvancedServerOps-649526860-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:15.903811 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-a10dfc52-8ecf-46d2-a94b-821988a9d591 tempest-TestNetworkAdvancedServerOps-649526860 tempest-TestNetworkAdvancedServerOps-649526860-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/b93d32ea-ad59-46a2-ae7e-e23d66132271" status: 200 len: 1832 microversion: 2.1 time: 0.147976 Sep 14 09:31:15.904547 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3144/6264] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:31:15 2022] GET /compute/v2.1/servers/b93d32ea-ad59-46a2-ae7e-e23d66132271 => generated 1832 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:31:16.703110 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c86f3d63-2ba5-4e09-8e0c-ab129fa81d75 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:16.703760 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-c86f3d63-2ba5-4e09-8e0c-ab129fa81d75 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: 0523217d-941f-4e9e-8b7e-4c43a628fa26] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:16.710912 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c86f3d63-2ba5-4e09-8e0c-ab129fa81d75 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:16.711462 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c86f3d63-2ba5-4e09-8e0c-ab129fa81d75 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:16.711910 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c86f3d63-2ba5-4e09-8e0c-ab129fa81d75 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:16.712622 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c86f3d63-2ba5-4e09-8e0c-ab129fa81d75 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:16.713077 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c86f3d63-2ba5-4e09-8e0c-ab129fa81d75 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:16.713501 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c86f3d63-2ba5-4e09-8e0c-ab129fa81d75 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:17.174606 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-c86f3d63-2ba5-4e09-8e0c-ab129fa81d75 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:17.184745 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-c86f3d63-2ba5-4e09-8e0c-ab129fa81d75 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/0523217d-941f-4e9e-8b7e-4c43a628fa26" status: 200 len: 1202 microversion: 2.1 time: 0.486187 Sep 14 09:31:17.185409 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-8eba21d7-a559-409d-99d2-1f3ddd1de407 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:17.185947 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-8eba21d7-a559-409d-99d2-1f3ddd1de407 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: b93d32ea-ad59-46a2-ae7e-e23d66132271] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:17.186579 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3121/6265] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:31:16 2022] GET /compute/v2.1/servers/0523217d-941f-4e9e-8b7e-4c43a628fa26 => generated 1202 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:31:17.191900 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-67dc4976-16da-4513-976b-1bba34af1f3c req-6831081a-16e9-4e66-9548-223a18fd0bbb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b93d32ea-ad59-46a2-ae7e-e23d66132271", "tag": "ffd5e266-d94c-4d18-b106-97154479401e"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:31:17.195838 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8eba21d7-a559-409d-99d2-1f3ddd1de407 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:17.196353 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8eba21d7-a559-409d-99d2-1f3ddd1de407 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:17.196788 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8eba21d7-a559-409d-99d2-1f3ddd1de407 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:17.197510 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8eba21d7-a559-409d-99d2-1f3ddd1de407 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:17.197976 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8eba21d7-a559-409d-99d2-1f3ddd1de407 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:17.198412 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8eba21d7-a559-409d-99d2-1f3ddd1de407 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:17.205441 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-67dc4976-16da-4513-976b-1bba34af1f3c req-6831081a-16e9-4e66-9548-223a18fd0bbb service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:17.206235 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-67dc4976-16da-4513-976b-1bba34af1f3c req-6831081a-16e9-4e66-9548-223a18fd0bbb service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:17.206816 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-67dc4976-16da-4513-976b-1bba34af1f3c req-6831081a-16e9-4e66-9548-223a18fd0bbb service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:17.221008 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-67dc4976-16da-4513-976b-1bba34af1f3c req-6831081a-16e9-4e66-9548-223a18fd0bbb service nova] Creating event network-changed:ffd5e266-d94c-4d18-b106-97154479401e for instance b93d32ea-ad59-46a2-ae7e-e23d66132271 on n-h1-836830-18 Sep 14 09:31:17.227022 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-67dc4976-16da-4513-976b-1bba34af1f3c req-6831081a-16e9-4e66-9548-223a18fd0bbb service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038980 Sep 14 09:31:17.228031 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3122/6266] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:31:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:31:17.241018 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-8eba21d7-a559-409d-99d2-1f3ddd1de407 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: b93d32ea-ad59-46a2-ae7e-e23d66132271] Going to try to terminate instance {{(pid=128758) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:31:17.352865 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-8eba21d7-a559-409d-99d2-1f3ddd1de407 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "DELETE /compute/v2.1/servers/b93d32ea-ad59-46a2-ae7e-e23d66132271" status: 204 len: 0 microversion: 2.1 time: 0.171394 Sep 14 09:31:17.357060 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3145/6267] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:31:17 2022] DELETE /compute/v2.1/servers/b93d32ea-ad59-46a2-ae7e-e23d66132271 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:31:17.363521 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3e15520c-396e-4a09-b969-827cff31193d tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:17.364763 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-3e15520c-396e-4a09-b969-827cff31193d tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: b93d32ea-ad59-46a2-ae7e-e23d66132271] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:17.371688 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3e15520c-396e-4a09-b969-827cff31193d tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:17.372615 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3e15520c-396e-4a09-b969-827cff31193d tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:17.373412 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3e15520c-396e-4a09-b969-827cff31193d tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:17.375986 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3e15520c-396e-4a09-b969-827cff31193d tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:17.376771 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3e15520c-396e-4a09-b969-827cff31193d tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:17.377298 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3e15520c-396e-4a09-b969-827cff31193d tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:17.589827 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-3e15520c-396e-4a09-b969-827cff31193d tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725d7beb4ec54b86a455af0d7bd0ce19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c197eded81494b818b1e56f4c01432c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:17.600021 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-3e15520c-396e-4a09-b969-827cff31193d tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/b93d32ea-ad59-46a2-ae7e-e23d66132271" status: 200 len: 1685 microversion: 2.1 time: 0.241530 Sep 14 09:31:17.600623 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3123/6268] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:31:17 2022] GET /compute/v2.1/servers/b93d32ea-ad59-46a2-ae7e-e23d66132271 => generated 1685 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:31:18.210275 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-2680e267-75dd-4b0e-8b03-c7a9dcdc95a9 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:18.211181 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-2680e267-75dd-4b0e-8b03-c7a9dcdc95a9 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: 0523217d-941f-4e9e-8b7e-4c43a628fa26] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:18.218257 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2680e267-75dd-4b0e-8b03-c7a9dcdc95a9 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:18.218831 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2680e267-75dd-4b0e-8b03-c7a9dcdc95a9 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:18.219371 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2680e267-75dd-4b0e-8b03-c7a9dcdc95a9 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:18.220176 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2680e267-75dd-4b0e-8b03-c7a9dcdc95a9 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:18.220707 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2680e267-75dd-4b0e-8b03-c7a9dcdc95a9 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:18.221208 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2680e267-75dd-4b0e-8b03-c7a9dcdc95a9 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:18.361957 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-2680e267-75dd-4b0e-8b03-c7a9dcdc95a9 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:18.370106 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-2680e267-75dd-4b0e-8b03-c7a9dcdc95a9 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/0523217d-941f-4e9e-8b7e-4c43a628fa26" status: 200 len: 1202 microversion: 2.1 time: 0.164088 Sep 14 09:31:18.370699 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3146/6269] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:31:18 2022] GET /compute/v2.1/servers/0523217d-941f-4e9e-8b7e-4c43a628fa26 => generated 1202 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:31:18.624267 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-34a13d35-ef47-4b68-92fa-ef1f5537ca96 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:18.624999 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-34a13d35-ef47-4b68-92fa-ef1f5537ca96 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: b93d32ea-ad59-46a2-ae7e-e23d66132271] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:18.632032 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-34a13d35-ef47-4b68-92fa-ef1f5537ca96 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:18.632529 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-34a13d35-ef47-4b68-92fa-ef1f5537ca96 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:18.633212 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-34a13d35-ef47-4b68-92fa-ef1f5537ca96 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:18.633671 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-34a13d35-ef47-4b68-92fa-ef1f5537ca96 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:18.634311 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-34a13d35-ef47-4b68-92fa-ef1f5537ca96 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:18.634921 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-34a13d35-ef47-4b68-92fa-ef1f5537ca96 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:18.848043 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-34a13d35-ef47-4b68-92fa-ef1f5537ca96 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725d7beb4ec54b86a455af0d7bd0ce19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c197eded81494b818b1e56f4c01432c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:18.855812 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-34a13d35-ef47-4b68-92fa-ef1f5537ca96 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/b93d32ea-ad59-46a2-ae7e-e23d66132271" status: 200 len: 1685 microversion: 2.1 time: 0.235535 Sep 14 09:31:18.856487 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3124/6270] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:31:18 2022] GET /compute/v2.1/servers/b93d32ea-ad59-46a2-ae7e-e23d66132271 => generated 1685 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:31:19.394637 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d57e3a9f-a40f-4b9a-9714-48f36690207d tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:19.395472 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-d57e3a9f-a40f-4b9a-9714-48f36690207d tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: 0523217d-941f-4e9e-8b7e-4c43a628fa26] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:19.402150 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d57e3a9f-a40f-4b9a-9714-48f36690207d tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:19.402769 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d57e3a9f-a40f-4b9a-9714-48f36690207d tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:19.403335 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d57e3a9f-a40f-4b9a-9714-48f36690207d tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:19.404144 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d57e3a9f-a40f-4b9a-9714-48f36690207d tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:19.404726 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d57e3a9f-a40f-4b9a-9714-48f36690207d tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:19.405283 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d57e3a9f-a40f-4b9a-9714-48f36690207d tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:19.613567 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-d57e3a9f-a40f-4b9a-9714-48f36690207d tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:19.623315 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-d57e3a9f-a40f-4b9a-9714-48f36690207d tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/0523217d-941f-4e9e-8b7e-4c43a628fa26" status: 200 len: 1202 microversion: 2.1 time: 0.232413 Sep 14 09:31:19.625534 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3147/6271] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:31:19 2022] GET /compute/v2.1/servers/0523217d-941f-4e9e-8b7e-4c43a628fa26 => generated 1202 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:31:19.808805 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-13f7c471-82fa-41ca-bb59-a4e64be5a79b req-7e064e3f-c446-45ba-a79f-1d806d27d8bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b93d32ea-ad59-46a2-ae7e-e23d66132271", "name": "network-vif-deleted", "tag": "ffd5e266-d94c-4d18-b106-97154479401e"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:31:19.819706 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-13f7c471-82fa-41ca-bb59-a4e64be5a79b req-7e064e3f-c446-45ba-a79f-1d806d27d8bb service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:19.820275 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-13f7c471-82fa-41ca-bb59-a4e64be5a79b req-7e064e3f-c446-45ba-a79f-1d806d27d8bb service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:19.820662 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-13f7c471-82fa-41ca-bb59-a4e64be5a79b req-7e064e3f-c446-45ba-a79f-1d806d27d8bb service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:19.833541 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-13f7c471-82fa-41ca-bb59-a4e64be5a79b req-7e064e3f-c446-45ba-a79f-1d806d27d8bb service nova] Creating event network-vif-deleted:ffd5e266-d94c-4d18-b106-97154479401e for instance b93d32ea-ad59-46a2-ae7e-e23d66132271 on n-h1-836830-18 Sep 14 09:31:19.838743 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-13f7c471-82fa-41ca-bb59-a4e64be5a79b req-7e064e3f-c446-45ba-a79f-1d806d27d8bb service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033719 Sep 14 09:31:19.842324 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3125/6272] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:31:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:31:19.879623 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-83bdac9e-c17a-4028-b392-cef22501ddbe tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:19.880409 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-83bdac9e-c17a-4028-b392-cef22501ddbe tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: b93d32ea-ad59-46a2-ae7e-e23d66132271] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:19.886745 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-83bdac9e-c17a-4028-b392-cef22501ddbe tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:19.887380 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-83bdac9e-c17a-4028-b392-cef22501ddbe tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:19.888123 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-83bdac9e-c17a-4028-b392-cef22501ddbe tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:19.888924 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-83bdac9e-c17a-4028-b392-cef22501ddbe tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:19.889487 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-83bdac9e-c17a-4028-b392-cef22501ddbe tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:19.890012 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-83bdac9e-c17a-4028-b392-cef22501ddbe tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:19.962197 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-83bdac9e-c17a-4028-b392-cef22501ddbe tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725d7beb4ec54b86a455af0d7bd0ce19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c197eded81494b818b1e56f4c01432c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:19.972620 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-83bdac9e-c17a-4028-b392-cef22501ddbe tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/b93d32ea-ad59-46a2-ae7e-e23d66132271" status: 200 len: 1348 microversion: 2.1 time: 0.096921 Sep 14 09:31:19.973796 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3148/6273] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:31:19 2022] GET /compute/v2.1/servers/b93d32ea-ad59-46a2-ae7e-e23d66132271 => generated 1348 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:31:20.650545 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f81f7711-031c-4d13-8df9-e1a663af60ac tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:20.651315 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f81f7711-031c-4d13-8df9-e1a663af60ac tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: 0523217d-941f-4e9e-8b7e-4c43a628fa26] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:20.659576 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f81f7711-031c-4d13-8df9-e1a663af60ac tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:20.660067 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f81f7711-031c-4d13-8df9-e1a663af60ac tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:20.660508 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f81f7711-031c-4d13-8df9-e1a663af60ac tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:20.661250 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f81f7711-031c-4d13-8df9-e1a663af60ac tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:20.661702 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f81f7711-031c-4d13-8df9-e1a663af60ac tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:20.662140 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f81f7711-031c-4d13-8df9-e1a663af60ac tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:20.796069 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f81f7711-031c-4d13-8df9-e1a663af60ac tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:20.804830 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f81f7711-031c-4d13-8df9-e1a663af60ac tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/0523217d-941f-4e9e-8b7e-4c43a628fa26" status: 200 len: 1202 microversion: 2.1 time: 0.160514 Sep 14 09:31:20.805653 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3126/6274] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:31:20 2022] GET /compute/v2.1/servers/0523217d-941f-4e9e-8b7e-4c43a628fa26 => generated 1202 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:31:20.996519 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-4a551956-a196-4c6f-9e0a-36707b0fcd6f tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:20.997145 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-4a551956-a196-4c6f-9e0a-36707b0fcd6f tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: b93d32ea-ad59-46a2-ae7e-e23d66132271] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:21.004099 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4a551956-a196-4c6f-9e0a-36707b0fcd6f tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:21.004588 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4a551956-a196-4c6f-9e0a-36707b0fcd6f tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:21.005030 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4a551956-a196-4c6f-9e0a-36707b0fcd6f tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:21.005725 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4a551956-a196-4c6f-9e0a-36707b0fcd6f tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:21.006184 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4a551956-a196-4c6f-9e0a-36707b0fcd6f tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:21.006615 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4a551956-a196-4c6f-9e0a-36707b0fcd6f tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:21.020966 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-4a551956-a196-4c6f-9e0a-36707b0fcd6f tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] HTTP exception thrown: Instance b93d32ea-ad59-46a2-ae7e-e23d66132271 could not be found. Sep 14 09:31:21.022547 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-4a551956-a196-4c6f-9e0a-36707b0fcd6f tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Request method failure captured: Sep 14 09:31:21.022547 n-d-836830-18 devstack@n-api.service[128758]: request: GET /compute/v2.1/servers/b93d32ea-ad59-46a2-ae7e-e23d66132271 HTTP/1.1 Sep 14 09:31:21.022547 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 09:31:21.022547 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 09:31:21.022547 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 09:31:21.022547 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 09:31:21.022547 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 09:31:21.022547 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 09:31:21.022547 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 09:31:21.022547 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 09:31:21.022547 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZ7Wj_81f9I2NRmfEwmuZpjrdWAEw7ARyOuI73wjvWEI66LzqUtysPT6IcAh0WZe2oebLj28uG94-uPGEC9cMUUKdhbePLDzfTDtmqqpgsB5YUrdD9jeNjtdjFX4L0eMBEKdd412dq4yc0_P9JNCFrwq1ozBqOy_b7PF0eHqh0jyqOo Sep 14 09:31:21.022547 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 09:31:21.022547 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 09:31:21.022547 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 09:31:21.022547 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 09:31:21.022547 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 09:31:21.022547 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 09:31:21.022547 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: c197eded81494b818b1e56f4c01432c5 Sep 14 09:31:21.022547 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1922438431 Sep 14 09:31:21.022547 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 09:31:21.022547 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 09:31:21.022547 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c197eded81494b818b1e56f4c01432c5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c197eded81494b818b1e56f4c01432c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c197eded81494b818b1e56f4c01432c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c197eded81494b818b1e56f4c01432c5"}]}] Sep 14 09:31:21.022547 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1922438431 Sep 14 09:31:21.022547 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: c197eded81494b818b1e56f4c01432c5 Sep 14 09:31:21.022547 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1922438431 Sep 14 09:31:21.022547 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-TestNetworkAdvancedServerOps-1922438431-project Sep 14 09:31:21.022547 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 09:31:21.022547 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 09:31:21.022547 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 725d7beb4ec54b86a455af0d7bd0ce19 Sep 14 09:31:21.022547 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1922438431-project Sep 14 09:31:21.022547 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 09:31:21.022547 n-d-836830-18 devstack@n-api.service[128758]: exception: Instance b93d32ea-ad59-46a2-ae7e-e23d66132271 could not be found. Sep 14 09:31:21.022547 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': 'b93d32ea-ad59-46a2-ae7e-e23d66132271'} Sep 14 09:31:21.022547 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:31:21.022547 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:31:21.022547 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:31:21.022547 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:31:21.022547 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:31:21.022547 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:31:21.022547 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:31:21.022547 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:31:21.022547 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:31:21.022547 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:31:21.022547 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b93d32ea-ad59-46a2-ae7e-e23d66132271 could not be found. Sep 14 09:31:21.022547 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:31:21.022547 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:31:21.022547 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:31:21.022547 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:31:21.022547 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:31:21.022547 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:31:21.022547 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:31:21.022547 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:31:21.022547 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:31:21.022547 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:31:21.022547 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:31:21.022547 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:31:21.022547 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:31:21.022547 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:31:21.022547 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:31:21.022547 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:31:21.022547 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b93d32ea-ad59-46a2-ae7e-e23d66132271 could not be found. Sep 14 09:31:21.022547 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:31:21.022547 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:31:21.027590 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:31:21.027590 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:31:21.027590 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:31:21.027590 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:31:21.027590 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:31:21.027590 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:31:21.027590 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b93d32ea-ad59-46a2-ae7e-e23d66132271 could not be found. Sep 14 09:31:21.027590 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:31:21.027590 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-4a551956-a196-4c6f-9e0a-36707b0fcd6f tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Returning 404 to user: Instance b93d32ea-ad59-46a2-ae7e-e23d66132271 could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:31:21.027590 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-4a551956-a196-4c6f-9e0a-36707b0fcd6f tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/b93d32ea-ad59-46a2-ae7e-e23d66132271" status: 404 len: 111 microversion: 2.1 time: 0.031498 Sep 14 09:31:21.036934 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3149/6275] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:31:20 2022] GET /compute/v2.1/servers/b93d32ea-ad59-46a2-ae7e-e23d66132271 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:31:21.830652 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e75b1acf-5af9-4849-b131-bc2fb205f90f tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:21.831315 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e75b1acf-5af9-4849-b131-bc2fb205f90f tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: 0523217d-941f-4e9e-8b7e-4c43a628fa26] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:21.840266 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e75b1acf-5af9-4849-b131-bc2fb205f90f tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:21.841051 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e75b1acf-5af9-4849-b131-bc2fb205f90f tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:21.844401 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e75b1acf-5af9-4849-b131-bc2fb205f90f tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:21.845267 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e75b1acf-5af9-4849-b131-bc2fb205f90f tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:21.846289 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e75b1acf-5af9-4849-b131-bc2fb205f90f tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:21.847838 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e75b1acf-5af9-4849-b131-bc2fb205f90f tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:22.052689 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-e75b1acf-5af9-4849-b131-bc2fb205f90f tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:22.066793 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e75b1acf-5af9-4849-b131-bc2fb205f90f tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/0523217d-941f-4e9e-8b7e-4c43a628fa26" status: 200 len: 1202 microversion: 2.1 time: 0.240475 Sep 14 09:31:22.071798 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3127/6276] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:31:21 2022] GET /compute/v2.1/servers/0523217d-941f-4e9e-8b7e-4c43a628fa26 => generated 1202 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:31:23.092191 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-250684cb-ddad-4a3e-81d4-a644a85c4531 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:23.093494 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-250684cb-ddad-4a3e-81d4-a644a85c4531 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: 0523217d-941f-4e9e-8b7e-4c43a628fa26] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:23.100179 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:31:23.101838 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-250684cb-ddad-4a3e-81d4-a644a85c4531 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:23.102554 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-250684cb-ddad-4a3e-81d4-a644a85c4531 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:23.106643 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-250684cb-ddad-4a3e-81d4-a644a85c4531 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:23.107862 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-250684cb-ddad-4a3e-81d4-a644a85c4531 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:23.108538 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-250684cb-ddad-4a3e-81d4-a644a85c4531 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:23.109168 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-250684cb-ddad-4a3e-81d4-a644a85c4531 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:23.115694 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:31:23.362837 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-250684cb-ddad-4a3e-81d4-a644a85c4531 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:23.379114 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-250684cb-ddad-4a3e-81d4-a644a85c4531 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/0523217d-941f-4e9e-8b7e-4c43a628fa26" status: 200 len: 1202 microversion: 2.1 time: 0.290728 Sep 14 09:31:23.381775 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3150/6277] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:31:23 2022] GET /compute/v2.1/servers/0523217d-941f-4e9e-8b7e-4c43a628fa26 => generated 1202 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:31:24.155163 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-33c415d7-4f3f-4c7c-ba2c-7d0e945a8fee req-11a067a6-5e1b-4785-a263-4bf568f099b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0523217d-941f-4e9e-8b7e-4c43a628fa26", "name": "network-vif-plugged", "status": "completed", "tag": "14fe4ccb-9014-4a86-93e9-99086b002dd9"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:31:24.176184 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-33c415d7-4f3f-4c7c-ba2c-7d0e945a8fee req-11a067a6-5e1b-4785-a263-4bf568f099b4 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:24.176977 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-33c415d7-4f3f-4c7c-ba2c-7d0e945a8fee req-11a067a6-5e1b-4785-a263-4bf568f099b4 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:24.177579 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-33c415d7-4f3f-4c7c-ba2c-7d0e945a8fee req-11a067a6-5e1b-4785-a263-4bf568f099b4 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:24.197508 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-33c415d7-4f3f-4c7c-ba2c-7d0e945a8fee req-11a067a6-5e1b-4785-a263-4bf568f099b4 service nova] Creating event network-vif-plugged:14fe4ccb-9014-4a86-93e9-99086b002dd9 for instance 0523217d-941f-4e9e-8b7e-4c43a628fa26 on n-h2-836830-18 Sep 14 09:31:24.203672 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-33c415d7-4f3f-4c7c-ba2c-7d0e945a8fee req-11a067a6-5e1b-4785-a263-4bf568f099b4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053591 Sep 14 09:31:24.205905 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3128/6278] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:31:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:31:24.404425 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-79a77a6a-1fb2-4d8f-813d-367e67fbb20b tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:24.404911 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-79a77a6a-1fb2-4d8f-813d-367e67fbb20b tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: 0523217d-941f-4e9e-8b7e-4c43a628fa26] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:24.412066 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-79a77a6a-1fb2-4d8f-813d-367e67fbb20b tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:24.412348 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-79a77a6a-1fb2-4d8f-813d-367e67fbb20b tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:24.412783 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-79a77a6a-1fb2-4d8f-813d-367e67fbb20b tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:24.413488 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-79a77a6a-1fb2-4d8f-813d-367e67fbb20b tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:24.413952 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-79a77a6a-1fb2-4d8f-813d-367e67fbb20b tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:24.414354 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-79a77a6a-1fb2-4d8f-813d-367e67fbb20b tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:24.544729 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-28527298-4163-4805-bb77-5d9caff46a90 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '.version_select at 0x7f7d487dd940>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:24.593097 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-28527298-4163-4805-bb77-5d9caff46a90 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-424161104" status: 202 len: 0 microversion: 2.1 time: 0.052529 Sep 14 09:31:24.593710 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3129/6279] 10.222.0.60 () {58 vars in 1281 bytes} [Wed Sep 14 09:31:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-424161104 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 14 09:31:24.615297 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-79a77a6a-1fb2-4d8f-813d-367e67fbb20b tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:24.626178 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-79a77a6a-1fb2-4d8f-813d-367e67fbb20b tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/0523217d-941f-4e9e-8b7e-4c43a628fa26" status: 200 len: 1202 microversion: 2.1 time: 0.226376 Sep 14 09:31:24.627237 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f8d241ed-2900-4501-8208-6d5231576647 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Action: 'create', calling method: .version_select at 0x7f7d44582b80>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1032342371", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOh35gJi5qe5cAZoN374JxDttm752sjH4XUYz6SI9Ew6SMSJCxdRcp9nHHrsgy1O+mFXqv9N/wVwYFhaZaL7ZtEN1Ks7OvBjd43lGGf7nrMTZ/lByuP3WVGi1z2p1lAdlw=="}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:31:24.639145 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3151/6280] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:31:24 2022] GET /compute/v2.1/servers/0523217d-941f-4e9e-8b7e-4c43a628fa26 => generated 1202 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:31:24.650663 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-f8d241ed-2900-4501-8208-6d5231576647 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Getting quotas for project c197eded81494b818b1e56f4c01432c5. Resources: {'key_pairs'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:31:24.656605 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-f8d241ed-2900-4501-8208-6d5231576647 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Getting quotas for user 725d7beb4ec54b86a455af0d7bd0ce19 and project c197eded81494b818b1e56f4c01432c5. Resources: {'key_pairs'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:31:24.680879 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f8d241ed-2900-4501-8208-6d5231576647 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.059271 Sep 14 09:31:24.681594 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3130/6281] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Sep 14 09:31:24 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:31:25.652165 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b3b5d457-13ba-4dd9-b51e-379815d04892 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:25.652853 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-b3b5d457-13ba-4dd9-b51e-379815d04892 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: 0523217d-941f-4e9e-8b7e-4c43a628fa26] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:25.660759 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b3b5d457-13ba-4dd9-b51e-379815d04892 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:25.661343 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b3b5d457-13ba-4dd9-b51e-379815d04892 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:25.661852 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b3b5d457-13ba-4dd9-b51e-379815d04892 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:25.662630 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b3b5d457-13ba-4dd9-b51e-379815d04892 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:25.663189 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b3b5d457-13ba-4dd9-b51e-379815d04892 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:25.663840 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b3b5d457-13ba-4dd9-b51e-379815d04892 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:25.833548 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-b3b5d457-13ba-4dd9-b51e-379815d04892 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:25.843469 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-b3b5d457-13ba-4dd9-b51e-379815d04892 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/0523217d-941f-4e9e-8b7e-4c43a628fa26" status: 200 len: 1386 microversion: 2.1 time: 0.195653 Sep 14 09:31:25.844133 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3152/6282] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:31:25 2022] GET /compute/v2.1/servers/0523217d-941f-4e9e-8b7e-4c43a628fa26 => generated 1386 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:31:25.868731 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-842fac8d-73d3-4be7-a571-666f6645a29f tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:25.869572 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-842fac8d-73d3-4be7-a571-666f6645a29f tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: 0523217d-941f-4e9e-8b7e-4c43a628fa26] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:25.871574 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:31:25.877365 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-842fac8d-73d3-4be7-a571-666f6645a29f tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:25.877905 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-842fac8d-73d3-4be7-a571-666f6645a29f tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:25.878530 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-842fac8d-73d3-4be7-a571-666f6645a29f tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:25.879309 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-842fac8d-73d3-4be7-a571-666f6645a29f tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:25.879846 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-842fac8d-73d3-4be7-a571-666f6645a29f tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:25.880302 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-842fac8d-73d3-4be7-a571-666f6645a29f tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:25.897612 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=89 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:31:26.040930 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-842fac8d-73d3-4be7-a571-666f6645a29f tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:26.049226 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-842fac8d-73d3-4be7-a571-666f6645a29f tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/0523217d-941f-4e9e-8b7e-4c43a628fa26" status: 200 len: 1386 microversion: 2.1 time: 0.185566 Sep 14 09:31:26.049824 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3131/6283] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:31:25 2022] GET /compute/v2.1/servers/0523217d-941f-4e9e-8b7e-4c43a628fa26 => generated 1386 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:31:26.072176 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-5d5606f6-cd8b-4dc5-91d1-839dbfc7e282 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:26.072796 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-5d5606f6-cd8b-4dc5-91d1-839dbfc7e282 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: 0523217d-941f-4e9e-8b7e-4c43a628fa26] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:26.079605 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5d5606f6-cd8b-4dc5-91d1-839dbfc7e282 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:26.080824 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5d5606f6-cd8b-4dc5-91d1-839dbfc7e282 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:26.081556 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5d5606f6-cd8b-4dc5-91d1-839dbfc7e282 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:26.082573 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5d5606f6-cd8b-4dc5-91d1-839dbfc7e282 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:26.083295 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5d5606f6-cd8b-4dc5-91d1-839dbfc7e282 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:26.084474 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5d5606f6-cd8b-4dc5-91d1-839dbfc7e282 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:26.233804 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-5d5606f6-cd8b-4dc5-91d1-839dbfc7e282 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:26.247850 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-5d5606f6-cd8b-4dc5-91d1-839dbfc7e282 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/0523217d-941f-4e9e-8b7e-4c43a628fa26" status: 200 len: 1386 microversion: 2.1 time: 0.179389 Sep 14 09:31:26.249105 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3153/6284] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:31:26 2022] GET /compute/v2.1/servers/0523217d-941f-4e9e-8b7e-4c43a628fa26 => generated 1386 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:31:26.355696 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-6c6d3c3d-33d0-4b56-9b8c-ef3fd73e381b tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:26.356536 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-6c6d3c3d-33d0-4b56-9b8c-ef3fd73e381b tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: 0523217d-941f-4e9e-8b7e-4c43a628fa26] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:26.364241 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6c6d3c3d-33d0-4b56-9b8c-ef3fd73e381b tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:26.364957 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6c6d3c3d-33d0-4b56-9b8c-ef3fd73e381b tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:26.365564 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6c6d3c3d-33d0-4b56-9b8c-ef3fd73e381b tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:26.366433 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6c6d3c3d-33d0-4b56-9b8c-ef3fd73e381b tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:26.367083 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6c6d3c3d-33d0-4b56-9b8c-ef3fd73e381b tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:26.367771 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6c6d3c3d-33d0-4b56-9b8c-ef3fd73e381b tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:26.395720 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-6c6d3c3d-33d0-4b56-9b8c-ef3fd73e381b tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: 0523217d-941f-4e9e-8b7e-4c43a628fa26] Going to try to terminate instance {{(pid=128759) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:31:26.519239 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-6c6d3c3d-33d0-4b56-9b8c-ef3fd73e381b tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "DELETE /compute/v2.1/servers/0523217d-941f-4e9e-8b7e-4c43a628fa26" status: 204 len: 0 microversion: 2.1 time: 0.167761 Sep 14 09:31:26.523967 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3132/6285] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:31:26 2022] DELETE /compute/v2.1/servers/0523217d-941f-4e9e-8b7e-4c43a628fa26 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:31:26.532233 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-301db92b-b7a8-4412-85d4-f92bd83a53bc tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:26.533442 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-301db92b-b7a8-4412-85d4-f92bd83a53bc tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: 0523217d-941f-4e9e-8b7e-4c43a628fa26] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:26.539951 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-301db92b-b7a8-4412-85d4-f92bd83a53bc tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:26.540763 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-301db92b-b7a8-4412-85d4-f92bd83a53bc tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:26.541390 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-301db92b-b7a8-4412-85d4-f92bd83a53bc tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:26.542303 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-301db92b-b7a8-4412-85d4-f92bd83a53bc tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:26.542986 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-301db92b-b7a8-4412-85d4-f92bd83a53bc tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:26.543401 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-301db92b-b7a8-4412-85d4-f92bd83a53bc tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:26.792317 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-301db92b-b7a8-4412-85d4-f92bd83a53bc tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:26.801393 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-301db92b-b7a8-4412-85d4-f92bd83a53bc tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/0523217d-941f-4e9e-8b7e-4c43a628fa26" status: 200 len: 1392 microversion: 2.1 time: 0.273340 Sep 14 09:31:26.802303 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3154/6286] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:31:26 2022] GET /compute/v2.1/servers/0523217d-941f-4e9e-8b7e-4c43a628fa26 => generated 1392 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:31:27.828435 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-0fe92955-bdd0-4c43-868f-2c8ba7c9d218 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:27.829280 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-0fe92955-bdd0-4c43-868f-2c8ba7c9d218 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: 0523217d-941f-4e9e-8b7e-4c43a628fa26] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:27.838862 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0fe92955-bdd0-4c43-868f-2c8ba7c9d218 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:27.840629 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0fe92955-bdd0-4c43-868f-2c8ba7c9d218 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:27.841151 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0fe92955-bdd0-4c43-868f-2c8ba7c9d218 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:27.841936 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0fe92955-bdd0-4c43-868f-2c8ba7c9d218 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:27.842470 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0fe92955-bdd0-4c43-868f-2c8ba7c9d218 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:27.847889 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0fe92955-bdd0-4c43-868f-2c8ba7c9d218 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:28.076677 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-0fe92955-bdd0-4c43-868f-2c8ba7c9d218 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:28.087551 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-0fe92955-bdd0-4c43-868f-2c8ba7c9d218 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/0523217d-941f-4e9e-8b7e-4c43a628fa26" status: 200 len: 1392 microversion: 2.1 time: 0.265869 Sep 14 09:31:28.103535 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3133/6287] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:31:27 2022] GET /compute/v2.1/servers/0523217d-941f-4e9e-8b7e-4c43a628fa26 => generated 1392 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:31:28.584617 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-da035f47-6993-4a4a-8c01-8d60fccb1a4a req-c7447bbe-24ff-4b19-be6e-8332b1e429f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0523217d-941f-4e9e-8b7e-4c43a628fa26", "name": "network-vif-deleted", "tag": "14fe4ccb-9014-4a86-93e9-99086b002dd9"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:31:28.623231 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-da035f47-6993-4a4a-8c01-8d60fccb1a4a req-c7447bbe-24ff-4b19-be6e-8332b1e429f3 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:28.625559 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-da035f47-6993-4a4a-8c01-8d60fccb1a4a req-c7447bbe-24ff-4b19-be6e-8332b1e429f3 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:28.629147 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-da035f47-6993-4a4a-8c01-8d60fccb1a4a req-c7447bbe-24ff-4b19-be6e-8332b1e429f3 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:28.688210 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-da035f47-6993-4a4a-8c01-8d60fccb1a4a req-c7447bbe-24ff-4b19-be6e-8332b1e429f3 service nova] Creating event network-vif-deleted:14fe4ccb-9014-4a86-93e9-99086b002dd9 for instance 0523217d-941f-4e9e-8b7e-4c43a628fa26 on n-h2-836830-18 Sep 14 09:31:28.705667 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-da035f47-6993-4a4a-8c01-8d60fccb1a4a req-c7447bbe-24ff-4b19-be6e-8332b1e429f3 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124478 Sep 14 09:31:28.708504 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3155/6288] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:31:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:31:29.117749 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-becf313e-1990-4d91-a8f0-489148c24403 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:29.121957 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-becf313e-1990-4d91-a8f0-489148c24403 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: 0523217d-941f-4e9e-8b7e-4c43a628fa26] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:29.155641 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-becf313e-1990-4d91-a8f0-489148c24403 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:29.156521 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-becf313e-1990-4d91-a8f0-489148c24403 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:29.160265 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-becf313e-1990-4d91-a8f0-489148c24403 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:29.161258 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-becf313e-1990-4d91-a8f0-489148c24403 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:29.161911 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-becf313e-1990-4d91-a8f0-489148c24403 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:29.162519 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-becf313e-1990-4d91-a8f0-489148c24403 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:29.309732 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-becf313e-1990-4d91-a8f0-489148c24403 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:29.320659 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-becf313e-1990-4d91-a8f0-489148c24403 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/0523217d-941f-4e9e-8b7e-4c43a628fa26" status: 200 len: 1187 microversion: 2.1 time: 0.211115 Sep 14 09:31:29.323450 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3134/6289] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:31:29 2022] GET /compute/v2.1/servers/0523217d-941f-4e9e-8b7e-4c43a628fa26 => generated 1187 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:31:30.348601 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-79c6adce-c891-4260-aac2-56de9e86677e tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:30.349324 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-79c6adce-c891-4260-aac2-56de9e86677e tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: 0523217d-941f-4e9e-8b7e-4c43a628fa26] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:30.372146 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-79c6adce-c891-4260-aac2-56de9e86677e tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:30.372653 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-79c6adce-c891-4260-aac2-56de9e86677e tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:30.373098 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-79c6adce-c891-4260-aac2-56de9e86677e tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:30.373822 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-79c6adce-c891-4260-aac2-56de9e86677e tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:30.374281 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-79c6adce-c891-4260-aac2-56de9e86677e tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:30.374711 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-79c6adce-c891-4260-aac2-56de9e86677e tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:30.633975 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-79c6adce-c891-4260-aac2-56de9e86677e tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:30.644745 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-79c6adce-c891-4260-aac2-56de9e86677e tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/0523217d-941f-4e9e-8b7e-4c43a628fa26" status: 200 len: 1187 microversion: 2.1 time: 0.300367 Sep 14 09:31:30.657766 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3156/6290] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:31:30 2022] GET /compute/v2.1/servers/0523217d-941f-4e9e-8b7e-4c43a628fa26 => generated 1187 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:31:31.693836 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-47823b82-c8de-44a7-b133-ae8fe3adbd58 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:31.694466 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-47823b82-c8de-44a7-b133-ae8fe3adbd58 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: 0523217d-941f-4e9e-8b7e-4c43a628fa26] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:31.727291 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-47823b82-c8de-44a7-b133-ae8fe3adbd58 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:31.727949 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-47823b82-c8de-44a7-b133-ae8fe3adbd58 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:31.728623 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-47823b82-c8de-44a7-b133-ae8fe3adbd58 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:31.735427 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-47823b82-c8de-44a7-b133-ae8fe3adbd58 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:31.736486 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-47823b82-c8de-44a7-b133-ae8fe3adbd58 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:31.736942 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-47823b82-c8de-44a7-b133-ae8fe3adbd58 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:31.901160 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-47823b82-c8de-44a7-b133-ae8fe3adbd58 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:31.918185 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-47823b82-c8de-44a7-b133-ae8fe3adbd58 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/0523217d-941f-4e9e-8b7e-4c43a628fa26" status: 200 len: 1187 microversion: 2.1 time: 0.228442 Sep 14 09:31:31.920685 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3135/6291] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:31:31 2022] GET /compute/v2.1/servers/0523217d-941f-4e9e-8b7e-4c43a628fa26 => generated 1187 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:31:32.944647 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-45577cf2-1d86-4031-a6c2-86c31e1b21ca tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:32.945111 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-45577cf2-1d86-4031-a6c2-86c31e1b21ca tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: 0523217d-941f-4e9e-8b7e-4c43a628fa26] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:32.956131 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-45577cf2-1d86-4031-a6c2-86c31e1b21ca tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:32.956642 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-45577cf2-1d86-4031-a6c2-86c31e1b21ca tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:32.957064 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-45577cf2-1d86-4031-a6c2-86c31e1b21ca tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:32.967647 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-45577cf2-1d86-4031-a6c2-86c31e1b21ca tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:32.968378 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-45577cf2-1d86-4031-a6c2-86c31e1b21ca tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:32.969237 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-45577cf2-1d86-4031-a6c2-86c31e1b21ca tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:32.985859 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-56ecf72f-0858-45e3-9a3b-3baad0dd5d07 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1630689896", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "networks": [{"uuid": "3d011b0b-2acb-4e06-85fc-ef9d10d7f278"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1032342371", "security_groups": [{"name": "tempest-secgroup-smoke-1737134526"}]}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:31:33.093960 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-45577cf2-1d86-4031-a6c2-86c31e1b21ca tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:33.107561 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-45577cf2-1d86-4031-a6c2-86c31e1b21ca tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/0523217d-941f-4e9e-8b7e-4c43a628fa26" status: 200 len: 1187 microversion: 2.1 time: 0.166703 Sep 14 09:31:33.125888 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3157/6292] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:31:32 2022] GET /compute/v2.1/servers/0523217d-941f-4e9e-8b7e-4c43a628fa26 => generated 1187 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:31:33.232363 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.network.neutron [None req-56ecf72f-0858-45e3-9a3b-3baad0dd5d07 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] validate_networks() for [('3d011b0b-2acb-4e06-85fc-ef9d10d7f278', None, None, None, None, None)] {{(pid=128759) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:31:34.133175 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b29dac5a-331e-4406-ac3e-70fa66d1bef3 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:34.133824 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-b29dac5a-331e-4406-ac3e-70fa66d1bef3 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: 0523217d-941f-4e9e-8b7e-4c43a628fa26] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:34.153493 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b29dac5a-331e-4406-ac3e-70fa66d1bef3 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:34.154008 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b29dac5a-331e-4406-ac3e-70fa66d1bef3 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:34.154451 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b29dac5a-331e-4406-ac3e-70fa66d1bef3 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:34.155206 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b29dac5a-331e-4406-ac3e-70fa66d1bef3 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:34.155670 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b29dac5a-331e-4406-ac3e-70fa66d1bef3 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:34.156099 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b29dac5a-331e-4406-ac3e-70fa66d1bef3 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:34.312940 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-b29dac5a-331e-4406-ac3e-70fa66d1bef3 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:34.322480 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-b29dac5a-331e-4406-ac3e-70fa66d1bef3 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/0523217d-941f-4e9e-8b7e-4c43a628fa26" status: 200 len: 1187 microversion: 2.1 time: 0.193681 Sep 14 09:31:34.331109 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3158/6293] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:31:34 2022] GET /compute/v2.1/servers/0523217d-941f-4e9e-8b7e-4c43a628fa26 => generated 1187 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:31:34.399173 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-56ecf72f-0858-45e3-9a3b-3baad0dd5d07 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Flavor limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:31:34.399601 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-56ecf72f-0858-45e3-9a3b-3baad0dd5d07 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Image limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:31:34.402662 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-56ecf72f-0858-45e3-9a3b-3baad0dd5d07 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Flavor pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:31:34.403127 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-56ecf72f-0858-45e3-9a3b-3baad0dd5d07 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Image pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:31:34.403558 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-56ecf72f-0858-45e3-9a3b-3baad0dd5d07 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:31:34.415612 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-56ecf72f-0858-45e3-9a3b-3baad0dd5d07 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:34.416500 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-56ecf72f-0858-45e3-9a3b-3baad0dd5d07 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:34.417196 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-56ecf72f-0858-45e3-9a3b-3baad0dd5d07 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:34.418175 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-56ecf72f-0858-45e3-9a3b-3baad0dd5d07 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:34.419073 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-56ecf72f-0858-45e3-9a3b-3baad0dd5d07 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:34.419900 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-56ecf72f-0858-45e3-9a3b-3baad0dd5d07 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:34.444978 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-56ecf72f-0858-45e3-9a3b-3baad0dd5d07 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Getting quotas for project c197eded81494b818b1e56f4c01432c5. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:31:34.452030 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-56ecf72f-0858-45e3-9a3b-3baad0dd5d07 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Getting quotas for user 725d7beb4ec54b86a455af0d7bd0ce19 and project c197eded81494b818b1e56f4c01432c5. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:31:34.468640 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-56ecf72f-0858-45e3-9a3b-3baad0dd5d07 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Going to run 1 instances... {{(pid=128759) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:31:34.471620 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-56ecf72f-0858-45e3-9a3b-3baad0dd5d07 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: c1297f74-578d-4a0d-8fd3-4197917a1dda] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128759) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:31:34.549934 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-56ecf72f-0858-45e3-9a3b-3baad0dd5d07 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.582123 Sep 14 09:31:34.551279 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3136/6294] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 09:31:32 2022] POST /compute/v2.1/servers => generated 406 bytes in 1584 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:31:34.563257 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-f5bf9be5-8458-40a4-8a7d-dbf29ce1d42d tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:34.565552 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-f5bf9be5-8458-40a4-8a7d-dbf29ce1d42d tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: c1297f74-578d-4a0d-8fd3-4197917a1dda] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:34.644481 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-f5bf9be5-8458-40a4-8a7d-dbf29ce1d42d tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725d7beb4ec54b86a455af0d7bd0ce19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c197eded81494b818b1e56f4c01432c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:34.653993 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-f5bf9be5-8458-40a4-8a7d-dbf29ce1d42d tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/c1297f74-578d-4a0d-8fd3-4197917a1dda" status: 200 len: 1267 microversion: 2.1 time: 0.094851 Sep 14 09:31:34.656659 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3159/6295] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:31:34 2022] GET /compute/v2.1/servers/c1297f74-578d-4a0d-8fd3-4197917a1dda => generated 1267 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:31:35.362216 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-4a52afcd-209f-42fe-aebd-cbed74c15b86 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:35.364724 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-4a52afcd-209f-42fe-aebd-cbed74c15b86 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: 0523217d-941f-4e9e-8b7e-4c43a628fa26] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:35.380345 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4a52afcd-209f-42fe-aebd-cbed74c15b86 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:35.382443 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4a52afcd-209f-42fe-aebd-cbed74c15b86 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:35.383116 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4a52afcd-209f-42fe-aebd-cbed74c15b86 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:35.386059 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4a52afcd-209f-42fe-aebd-cbed74c15b86 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:35.387523 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4a52afcd-209f-42fe-aebd-cbed74c15b86 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:35.389269 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4a52afcd-209f-42fe-aebd-cbed74c15b86 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:35.454966 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4a52afcd-209f-42fe-aebd-cbed74c15b86 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:35.455536 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4a52afcd-209f-42fe-aebd-cbed74c15b86 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:35.455905 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4a52afcd-209f-42fe-aebd-cbed74c15b86 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:35.456365 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.objects.instance [None req-4a52afcd-209f-42fe-aebd-cbed74c15b86 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lazy-loading 'fault' on Instance uuid 0523217d-941f-4e9e-8b7e-4c43a628fa26 {{(pid=128759) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:31:35.517256 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-4a52afcd-209f-42fe-aebd-cbed74c15b86 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:35.527028 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-4a52afcd-209f-42fe-aebd-cbed74c15b86 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/0523217d-941f-4e9e-8b7e-4c43a628fa26" status: 200 len: 1192 microversion: 2.1 time: 0.169588 Sep 14 09:31:35.528672 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3137/6296] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:31:35 2022] GET /compute/v2.1/servers/0523217d-941f-4e9e-8b7e-4c43a628fa26 => generated 1192 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:31:35.679752 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-cfad13b9-bf50-4c72-9eb4-a52d5db3e5a4 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:35.680449 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-cfad13b9-bf50-4c72-9eb4-a52d5db3e5a4 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: c1297f74-578d-4a0d-8fd3-4197917a1dda] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:35.706606 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cfad13b9-bf50-4c72-9eb4-a52d5db3e5a4 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:35.709847 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cfad13b9-bf50-4c72-9eb4-a52d5db3e5a4 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:35.710659 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cfad13b9-bf50-4c72-9eb4-a52d5db3e5a4 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:35.712154 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cfad13b9-bf50-4c72-9eb4-a52d5db3e5a4 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:35.714389 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cfad13b9-bf50-4c72-9eb4-a52d5db3e5a4 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:35.717710 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cfad13b9-bf50-4c72-9eb4-a52d5db3e5a4 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:35.851456 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-cfad13b9-bf50-4c72-9eb4-a52d5db3e5a4 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725d7beb4ec54b86a455af0d7bd0ce19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c197eded81494b818b1e56f4c01432c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:35.863816 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-cfad13b9-bf50-4c72-9eb4-a52d5db3e5a4 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/c1297f74-578d-4a0d-8fd3-4197917a1dda" status: 200 len: 1319 microversion: 2.1 time: 0.189614 Sep 14 09:31:35.869756 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3160/6297] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:31:35 2022] GET /compute/v2.1/servers/c1297f74-578d-4a0d-8fd3-4197917a1dda => generated 1319 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:31:36.557141 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-951ad5a1-a032-4712-abc6-25d9602f1b48 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:36.558349 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-951ad5a1-a032-4712-abc6-25d9602f1b48 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: 0523217d-941f-4e9e-8b7e-4c43a628fa26] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:36.570251 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-951ad5a1-a032-4712-abc6-25d9602f1b48 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:36.571178 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-951ad5a1-a032-4712-abc6-25d9602f1b48 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:36.571794 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-951ad5a1-a032-4712-abc6-25d9602f1b48 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:36.572741 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-951ad5a1-a032-4712-abc6-25d9602f1b48 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:36.573358 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-951ad5a1-a032-4712-abc6-25d9602f1b48 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:36.573943 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-951ad5a1-a032-4712-abc6-25d9602f1b48 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:36.597515 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-951ad5a1-a032-4712-abc6-25d9602f1b48 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] HTTP exception thrown: Instance 0523217d-941f-4e9e-8b7e-4c43a628fa26 could not be found. Sep 14 09:31:36.599810 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-951ad5a1-a032-4712-abc6-25d9602f1b48 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Request method failure captured: Sep 14 09:31:36.599810 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/0523217d-941f-4e9e-8b7e-4c43a628fa26 HTTP/1.1 Sep 14 09:31:36.599810 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:31:36.599810 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:31:36.599810 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:31:36.599810 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:31:36.599810 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:31:36.599810 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:31:36.599810 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:31:36.599810 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:31:36.599810 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZ7vSEasHnu7hRXol9c-LZuMaC9uK137X6F5rG7UmloUJeCaIX1XI8DyW-6MYPzXIn8tJlRUDBfS9Xo7ko5WvlkRtwNLi8r30OmEJBkLllR4uOPeHedowZTMuQPwQppwmIxlx0K05UlAJOyH1eD16mNE7GFFk01jmhPM_9wCZyZUFi8 Sep 14 09:31:36.599810 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:31:36.599810 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:31:36.599810 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:31:36.599810 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:31:36.599810 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:31:36.599810 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:31:36.599810 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 0fca803d9ffa4b4ab0371c0d6a96a5a2 Sep 14 09:31:36.599810 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-TestVolumeBootPattern-1945148622 Sep 14 09:31:36.599810 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:31:36.599810 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:31:36.599810 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0fca803d9ffa4b4ab0371c0d6a96a5a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0fca803d9ffa4b4ab0371c0d6a96a5a2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0fca803d9ffa4b4ab0371c0d6a96a5a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0fca803d9ffa4b4ab0371c0d6a96a5a2"}]}] Sep 14 09:31:36.599810 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-TestVolumeBootPattern-1945148622 Sep 14 09:31:36.599810 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 0fca803d9ffa4b4ab0371c0d6a96a5a2 Sep 14 09:31:36.599810 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-TestVolumeBootPattern-1945148622 Sep 14 09:31:36.599810 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-TestVolumeBootPattern-1945148622-project Sep 14 09:31:36.599810 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:31:36.599810 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:31:36.599810 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 80257054a25540c294e1787780b601b4 Sep 14 09:31:36.599810 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-TestVolumeBootPattern-1945148622-project Sep 14 09:31:36.599810 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:31:36.599810 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance 0523217d-941f-4e9e-8b7e-4c43a628fa26 could not be found. Sep 14 09:31:36.599810 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '0523217d-941f-4e9e-8b7e-4c43a628fa26'} Sep 14 09:31:36.599810 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:31:36.599810 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:31:36.599810 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:31:36.599810 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:31:36.599810 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:31:36.599810 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:31:36.599810 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:31:36.599810 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:31:36.599810 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:31:36.599810 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:31:36.599810 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0523217d-941f-4e9e-8b7e-4c43a628fa26 could not be found. Sep 14 09:31:36.599810 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:31:36.599810 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:31:36.599810 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:31:36.599810 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:31:36.599810 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:31:36.599810 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:31:36.599810 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:31:36.599810 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:31:36.599810 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:31:36.599810 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:31:36.599810 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:31:36.599810 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:31:36.599810 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:31:36.599810 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:31:36.599810 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:31:36.599810 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:31:36.599810 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0523217d-941f-4e9e-8b7e-4c43a628fa26 could not be found. Sep 14 09:31:36.599810 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:31:36.599810 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:31:36.599810 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:31:36.605045 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:31:36.605045 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:31:36.605045 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:31:36.605045 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:31:36.605045 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:31:36.605045 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0523217d-941f-4e9e-8b7e-4c43a628fa26 could not be found. Sep 14 09:31:36.605045 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:31:36.605045 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-951ad5a1-a032-4712-abc6-25d9602f1b48 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Returning 404 to user: Instance 0523217d-941f-4e9e-8b7e-4c43a628fa26 could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:31:36.605045 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-951ad5a1-a032-4712-abc6-25d9602f1b48 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/0523217d-941f-4e9e-8b7e-4c43a628fa26" status: 404 len: 111 microversion: 2.1 time: 0.049524 Sep 14 09:31:36.605045 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3138/6298] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:31:36 2022] GET /compute/v2.1/servers/0523217d-941f-4e9e-8b7e-4c43a628fa26 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:31:36.900458 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1851c0b5-6ef6-42ed-a863-d958bba6ac64 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:36.901278 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-1851c0b5-6ef6-42ed-a863-d958bba6ac64 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: c1297f74-578d-4a0d-8fd3-4197917a1dda] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:36.917298 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1851c0b5-6ef6-42ed-a863-d958bba6ac64 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:36.917812 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1851c0b5-6ef6-42ed-a863-d958bba6ac64 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:36.918268 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1851c0b5-6ef6-42ed-a863-d958bba6ac64 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:36.922918 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1851c0b5-6ef6-42ed-a863-d958bba6ac64 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:36.923499 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1851c0b5-6ef6-42ed-a863-d958bba6ac64 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:36.923962 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1851c0b5-6ef6-42ed-a863-d958bba6ac64 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:37.037384 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-1851c0b5-6ef6-42ed-a863-d958bba6ac64 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725d7beb4ec54b86a455af0d7bd0ce19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c197eded81494b818b1e56f4c01432c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:37.053978 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-1851c0b5-6ef6-42ed-a863-d958bba6ac64 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/c1297f74-578d-4a0d-8fd3-4197917a1dda" status: 200 len: 1325 microversion: 2.1 time: 0.159766 Sep 14 09:31:37.055162 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3161/6299] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:31:36 2022] GET /compute/v2.1/servers/c1297f74-578d-4a0d-8fd3-4197917a1dda => generated 1325 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:31:38.089898 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9e3d7856-3ec4-4c94-a236-5b0836e44410 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:38.090527 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-9e3d7856-3ec4-4c94-a236-5b0836e44410 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: c1297f74-578d-4a0d-8fd3-4197917a1dda] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:38.104203 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9e3d7856-3ec4-4c94-a236-5b0836e44410 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:38.104895 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9e3d7856-3ec4-4c94-a236-5b0836e44410 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:38.105555 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9e3d7856-3ec4-4c94-a236-5b0836e44410 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:38.106494 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9e3d7856-3ec4-4c94-a236-5b0836e44410 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:38.107157 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9e3d7856-3ec4-4c94-a236-5b0836e44410 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:38.107757 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9e3d7856-3ec4-4c94-a236-5b0836e44410 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:38.345227 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-9e3d7856-3ec4-4c94-a236-5b0836e44410 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725d7beb4ec54b86a455af0d7bd0ce19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c197eded81494b818b1e56f4c01432c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:38.353966 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-9e3d7856-3ec4-4c94-a236-5b0836e44410 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/c1297f74-578d-4a0d-8fd3-4197917a1dda" status: 200 len: 1393 microversion: 2.1 time: 0.268408 Sep 14 09:31:38.355079 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3139/6300] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:31:38 2022] GET /compute/v2.1/servers/c1297f74-578d-4a0d-8fd3-4197917a1dda => generated 1393 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:31:38.456978 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-7cecd82d-605f-4e91-b45e-ce7adfad889d req-2568cb9e-5222-4b85-b2dc-758ad65368b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1297f74-578d-4a0d-8fd3-4197917a1dda", "tag": "ca01d346-79c1-4969-9a4a-9124c8c992c0"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:31:38.469122 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-7cecd82d-605f-4e91-b45e-ce7adfad889d req-2568cb9e-5222-4b85-b2dc-758ad65368b2 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:38.469608 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-7cecd82d-605f-4e91-b45e-ce7adfad889d req-2568cb9e-5222-4b85-b2dc-758ad65368b2 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:38.470046 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-7cecd82d-605f-4e91-b45e-ce7adfad889d req-2568cb9e-5222-4b85-b2dc-758ad65368b2 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:38.483809 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-7cecd82d-605f-4e91-b45e-ce7adfad889d req-2568cb9e-5222-4b85-b2dc-758ad65368b2 service nova] Creating event network-changed:ca01d346-79c1-4969-9a4a-9124c8c992c0 for instance c1297f74-578d-4a0d-8fd3-4197917a1dda on n-h1-836830-18 Sep 14 09:31:38.490873 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-7cecd82d-605f-4e91-b45e-ce7adfad889d req-2568cb9e-5222-4b85-b2dc-758ad65368b2 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041290 Sep 14 09:31:38.494066 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3162/6301] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:31:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:31:38.888171 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-31a3e26b-ff91-40e4-9016-0eb2d5c12d9b tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:38.888777 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-31a3e26b-ff91-40e4-9016-0eb2d5c12d9b tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: 0523217d-941f-4e9e-8b7e-4c43a628fa26] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:38.895784 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-31a3e26b-ff91-40e4-9016-0eb2d5c12d9b tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:38.896402 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-31a3e26b-ff91-40e4-9016-0eb2d5c12d9b tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:38.897134 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-31a3e26b-ff91-40e4-9016-0eb2d5c12d9b tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:38.897842 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-31a3e26b-ff91-40e4-9016-0eb2d5c12d9b tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:38.898377 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-31a3e26b-ff91-40e4-9016-0eb2d5c12d9b tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:38.898885 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-31a3e26b-ff91-40e4-9016-0eb2d5c12d9b tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:38.937074 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-31a3e26b-ff91-40e4-9016-0eb2d5c12d9b tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] HTTP exception thrown: Instance 0523217d-941f-4e9e-8b7e-4c43a628fa26 could not be found. Sep 14 09:31:38.946513 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-31a3e26b-ff91-40e4-9016-0eb2d5c12d9b tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Request method failure captured: Sep 14 09:31:38.946513 n-d-836830-18 devstack@n-api.service[128759]: request: DELETE /compute/v2.1/servers/0523217d-941f-4e9e-8b7e-4c43a628fa26 HTTP/1.1 Sep 14 09:31:38.946513 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:31:38.946513 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:31:38.946513 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:31:38.946513 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:31:38.946513 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:31:38.946513 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:31:38.946513 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:31:38.946513 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:31:38.946513 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZ7vSEasHnu7hRXol9c-LZuMaC9uK137X6F5rG7UmloUJeCaIX1XI8DyW-6MYPzXIn8tJlRUDBfS9Xo7ko5WvlkRtwNLi8r30OmEJBkLllR4uOPeHedowZTMuQPwQppwmIxlx0K05UlAJOyH1eD16mNE7GFFk01jmhPM_9wCZyZUFi8 Sep 14 09:31:38.946513 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:31:38.946513 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:31:38.946513 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:31:38.946513 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:31:38.946513 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:31:38.946513 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:31:38.946513 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 0fca803d9ffa4b4ab0371c0d6a96a5a2 Sep 14 09:31:38.946513 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-TestVolumeBootPattern-1945148622 Sep 14 09:31:38.946513 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:31:38.946513 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:31:38.946513 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0fca803d9ffa4b4ab0371c0d6a96a5a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0fca803d9ffa4b4ab0371c0d6a96a5a2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0fca803d9ffa4b4ab0371c0d6a96a5a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0fca803d9ffa4b4ab0371c0d6a96a5a2"}]}] Sep 14 09:31:38.946513 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-TestVolumeBootPattern-1945148622 Sep 14 09:31:38.946513 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 0fca803d9ffa4b4ab0371c0d6a96a5a2 Sep 14 09:31:38.946513 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-TestVolumeBootPattern-1945148622 Sep 14 09:31:38.946513 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-TestVolumeBootPattern-1945148622-project Sep 14 09:31:38.946513 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:31:38.946513 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:31:38.946513 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 80257054a25540c294e1787780b601b4 Sep 14 09:31:38.946513 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-TestVolumeBootPattern-1945148622-project Sep 14 09:31:38.946513 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:31:38.946513 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance 0523217d-941f-4e9e-8b7e-4c43a628fa26 could not be found. Sep 14 09:31:38.946513 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '0523217d-941f-4e9e-8b7e-4c43a628fa26'} Sep 14 09:31:38.946513 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:31:38.946513 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:31:38.946513 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:31:38.946513 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:31:38.946513 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:31:38.946513 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:31:38.946513 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:31:38.946513 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:31:38.946513 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:31:38.946513 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:31:38.946513 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0523217d-941f-4e9e-8b7e-4c43a628fa26 could not be found. Sep 14 09:31:38.946513 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:31:38.946513 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:31:38.946513 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:31:38.946513 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:31:38.946513 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:31:38.946513 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:31:38.946513 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:31:38.946513 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:31:38.946513 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:31:38.946513 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:31:38.946513 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 09:31:38.946513 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 09:31:38.946513 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 09:31:38.946513 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 09:31:38.946513 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:31:38.946513 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:31:38.946513 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:31:38.946513 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:31:38.952598 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0523217d-941f-4e9e-8b7e-4c43a628fa26 could not be found. Sep 14 09:31:38.952598 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:31:38.952598 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:31:38.952598 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:31:38.952598 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:31:38.952598 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:31:38.952598 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:31:38.952598 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:31:38.952598 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:31:38.952598 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0523217d-941f-4e9e-8b7e-4c43a628fa26 could not be found. Sep 14 09:31:38.952598 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:31:38.952598 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-31a3e26b-ff91-40e4-9016-0eb2d5c12d9b tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Returning 404 to user: Instance 0523217d-941f-4e9e-8b7e-4c43a628fa26 could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:31:38.952598 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-31a3e26b-ff91-40e4-9016-0eb2d5c12d9b tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "DELETE /compute/v2.1/servers/0523217d-941f-4e9e-8b7e-4c43a628fa26" status: 404 len: 111 microversion: 2.1 time: 0.065380 Sep 14 09:31:38.954402 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3140/6302] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:31:38 2022] DELETE /compute/v2.1/servers/0523217d-941f-4e9e-8b7e-4c43a628fa26 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:31:38.960305 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-74b425e1-d421-4331-bdbe-37008ced7c1a tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:38.961027 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-74b425e1-d421-4331-bdbe-37008ced7c1a tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: 0523217d-941f-4e9e-8b7e-4c43a628fa26] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:38.971622 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-74b425e1-d421-4331-bdbe-37008ced7c1a tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:38.972137 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-74b425e1-d421-4331-bdbe-37008ced7c1a tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:38.972578 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-74b425e1-d421-4331-bdbe-37008ced7c1a tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:38.973293 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-74b425e1-d421-4331-bdbe-37008ced7c1a tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:38.973750 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-74b425e1-d421-4331-bdbe-37008ced7c1a tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:38.974175 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-74b425e1-d421-4331-bdbe-37008ced7c1a tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:38.998191 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-74b425e1-d421-4331-bdbe-37008ced7c1a tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] HTTP exception thrown: Instance 0523217d-941f-4e9e-8b7e-4c43a628fa26 could not be found. Sep 14 09:31:39.000002 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-74b425e1-d421-4331-bdbe-37008ced7c1a tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Request method failure captured: Sep 14 09:31:39.000002 n-d-836830-18 devstack@n-api.service[128758]: request: GET /compute/v2.1/servers/0523217d-941f-4e9e-8b7e-4c43a628fa26 HTTP/1.1 Sep 14 09:31:39.000002 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 09:31:39.000002 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 09:31:39.000002 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 09:31:39.000002 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 09:31:39.000002 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 09:31:39.000002 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 09:31:39.000002 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 09:31:39.000002 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 09:31:39.000002 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZ7vSEasHnu7hRXol9c-LZuMaC9uK137X6F5rG7UmloUJeCaIX1XI8DyW-6MYPzXIn8tJlRUDBfS9Xo7ko5WvlkRtwNLi8r30OmEJBkLllR4uOPeHedowZTMuQPwQppwmIxlx0K05UlAJOyH1eD16mNE7GFFk01jmhPM_9wCZyZUFi8 Sep 14 09:31:39.000002 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 09:31:39.000002 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 09:31:39.000002 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 09:31:39.000002 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 09:31:39.000002 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 09:31:39.000002 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 09:31:39.000002 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 0fca803d9ffa4b4ab0371c0d6a96a5a2 Sep 14 09:31:39.000002 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-TestVolumeBootPattern-1945148622 Sep 14 09:31:39.000002 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 09:31:39.000002 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 09:31:39.000002 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0fca803d9ffa4b4ab0371c0d6a96a5a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0fca803d9ffa4b4ab0371c0d6a96a5a2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0fca803d9ffa4b4ab0371c0d6a96a5a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0fca803d9ffa4b4ab0371c0d6a96a5a2"}]}] Sep 14 09:31:39.000002 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-TestVolumeBootPattern-1945148622 Sep 14 09:31:39.000002 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 0fca803d9ffa4b4ab0371c0d6a96a5a2 Sep 14 09:31:39.000002 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-TestVolumeBootPattern-1945148622 Sep 14 09:31:39.000002 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-TestVolumeBootPattern-1945148622-project Sep 14 09:31:39.000002 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 09:31:39.000002 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 09:31:39.000002 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 80257054a25540c294e1787780b601b4 Sep 14 09:31:39.000002 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-TestVolumeBootPattern-1945148622-project Sep 14 09:31:39.000002 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 09:31:39.000002 n-d-836830-18 devstack@n-api.service[128758]: exception: Instance 0523217d-941f-4e9e-8b7e-4c43a628fa26 could not be found. Sep 14 09:31:39.000002 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': '0523217d-941f-4e9e-8b7e-4c43a628fa26'} Sep 14 09:31:39.000002 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:31:39.000002 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:31:39.000002 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:31:39.000002 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:31:39.000002 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:31:39.000002 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:31:39.000002 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:31:39.000002 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:31:39.000002 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:31:39.000002 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:31:39.000002 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0523217d-941f-4e9e-8b7e-4c43a628fa26 could not be found. Sep 14 09:31:39.000002 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:31:39.000002 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:31:39.000002 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:31:39.000002 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:31:39.000002 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:31:39.000002 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:31:39.000002 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:31:39.000002 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:31:39.000002 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:31:39.000002 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:31:39.000002 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:31:39.000002 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:31:39.000002 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:31:39.000002 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:31:39.000002 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:31:39.000002 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:31:39.000002 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0523217d-941f-4e9e-8b7e-4c43a628fa26 could not be found. Sep 14 09:31:39.000002 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:31:39.000002 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:31:39.000002 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:31:39.005226 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:31:39.005226 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:31:39.005226 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:31:39.005226 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:31:39.005226 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:31:39.005226 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0523217d-941f-4e9e-8b7e-4c43a628fa26 could not be found. Sep 14 09:31:39.005226 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:31:39.005226 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-74b425e1-d421-4331-bdbe-37008ced7c1a tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Returning 404 to user: Instance 0523217d-941f-4e9e-8b7e-4c43a628fa26 could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:31:39.005226 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-74b425e1-d421-4331-bdbe-37008ced7c1a tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/0523217d-941f-4e9e-8b7e-4c43a628fa26" status: 404 len: 111 microversion: 2.1 time: 0.045702 Sep 14 09:31:39.005226 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3163/6303] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:31:38 2022] GET /compute/v2.1/servers/0523217d-941f-4e9e-8b7e-4c43a628fa26 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 14 09:31:39.377858 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-35982627-8215-4753-bf9b-3530e47820be tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:39.379630 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-35982627-8215-4753-bf9b-3530e47820be tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: c1297f74-578d-4a0d-8fd3-4197917a1dda] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:39.387441 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-35982627-8215-4753-bf9b-3530e47820be tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:39.388169 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-35982627-8215-4753-bf9b-3530e47820be tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:39.388823 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-35982627-8215-4753-bf9b-3530e47820be tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:39.390724 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-35982627-8215-4753-bf9b-3530e47820be tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:39.391901 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-35982627-8215-4753-bf9b-3530e47820be tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:39.392910 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-35982627-8215-4753-bf9b-3530e47820be tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:39.609296 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-35982627-8215-4753-bf9b-3530e47820be tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725d7beb4ec54b86a455af0d7bd0ce19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c197eded81494b818b1e56f4c01432c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:39.617907 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-35982627-8215-4753-bf9b-3530e47820be tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/c1297f74-578d-4a0d-8fd3-4197917a1dda" status: 200 len: 1393 microversion: 2.1 time: 0.243887 Sep 14 09:31:39.619105 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3141/6304] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:31:39 2022] GET /compute/v2.1/servers/c1297f74-578d-4a0d-8fd3-4197917a1dda => generated 1393 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:31:40.642661 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c3667037-a962-425f-985f-362015b22e25 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:40.644110 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-c3667037-a962-425f-985f-362015b22e25 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: c1297f74-578d-4a0d-8fd3-4197917a1dda] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:40.653354 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c3667037-a962-425f-985f-362015b22e25 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:40.653897 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c3667037-a962-425f-985f-362015b22e25 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:40.654334 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c3667037-a962-425f-985f-362015b22e25 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:40.655092 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c3667037-a962-425f-985f-362015b22e25 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:40.655545 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c3667037-a962-425f-985f-362015b22e25 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:40.656579 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c3667037-a962-425f-985f-362015b22e25 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:40.804438 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-c3667037-a962-425f-985f-362015b22e25 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725d7beb4ec54b86a455af0d7bd0ce19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c197eded81494b818b1e56f4c01432c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:40.812334 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-c3667037-a962-425f-985f-362015b22e25 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/c1297f74-578d-4a0d-8fd3-4197917a1dda" status: 200 len: 1393 microversion: 2.1 time: 0.175144 Sep 14 09:31:40.812917 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3164/6305] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:31:40 2022] GET /compute/v2.1/servers/c1297f74-578d-4a0d-8fd3-4197917a1dda => generated 1393 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:31:41.836290 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-05024794-8c77-40a4-969e-7f8f80fa81a1 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:41.836914 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-05024794-8c77-40a4-969e-7f8f80fa81a1 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: c1297f74-578d-4a0d-8fd3-4197917a1dda] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:41.846426 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-05024794-8c77-40a4-969e-7f8f80fa81a1 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:41.846927 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-05024794-8c77-40a4-969e-7f8f80fa81a1 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:41.847397 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-05024794-8c77-40a4-969e-7f8f80fa81a1 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:41.848122 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-05024794-8c77-40a4-969e-7f8f80fa81a1 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:41.848589 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-05024794-8c77-40a4-969e-7f8f80fa81a1 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:41.849166 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-05024794-8c77-40a4-969e-7f8f80fa81a1 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:42.008246 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-05024794-8c77-40a4-969e-7f8f80fa81a1 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725d7beb4ec54b86a455af0d7bd0ce19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c197eded81494b818b1e56f4c01432c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:42.016840 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-05024794-8c77-40a4-969e-7f8f80fa81a1 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/c1297f74-578d-4a0d-8fd3-4197917a1dda" status: 200 len: 1393 microversion: 2.1 time: 0.184560 Sep 14 09:31:42.017964 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3142/6306] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:31:41 2022] GET /compute/v2.1/servers/c1297f74-578d-4a0d-8fd3-4197917a1dda => generated 1393 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:31:43.042175 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a00e9ff9-ba9c-4969-bde7-e359ad12e14b tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:43.042825 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-a00e9ff9-ba9c-4969-bde7-e359ad12e14b tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: c1297f74-578d-4a0d-8fd3-4197917a1dda] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:43.063051 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a00e9ff9-ba9c-4969-bde7-e359ad12e14b tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:43.063575 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a00e9ff9-ba9c-4969-bde7-e359ad12e14b tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:43.064855 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a00e9ff9-ba9c-4969-bde7-e359ad12e14b tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:43.065795 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a00e9ff9-ba9c-4969-bde7-e359ad12e14b tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:43.066266 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a00e9ff9-ba9c-4969-bde7-e359ad12e14b tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:43.066706 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a00e9ff9-ba9c-4969-bde7-e359ad12e14b tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:43.236810 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-a00e9ff9-ba9c-4969-bde7-e359ad12e14b tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725d7beb4ec54b86a455af0d7bd0ce19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c197eded81494b818b1e56f4c01432c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:43.245494 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-a00e9ff9-ba9c-4969-bde7-e359ad12e14b tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/c1297f74-578d-4a0d-8fd3-4197917a1dda" status: 200 len: 1393 microversion: 2.1 time: 0.208972 Sep 14 09:31:43.246268 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3165/6307] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:31:43 2022] GET /compute/v2.1/servers/c1297f74-578d-4a0d-8fd3-4197917a1dda => generated 1393 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:31:44.271669 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-7d216620-1245-4e3b-80ab-775b0bda041f tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:44.274367 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-7d216620-1245-4e3b-80ab-775b0bda041f tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: c1297f74-578d-4a0d-8fd3-4197917a1dda] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:44.298520 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7d216620-1245-4e3b-80ab-775b0bda041f tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:44.299341 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7d216620-1245-4e3b-80ab-775b0bda041f tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:44.300002 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7d216620-1245-4e3b-80ab-775b0bda041f tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:44.301145 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7d216620-1245-4e3b-80ab-775b0bda041f tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:44.301615 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7d216620-1245-4e3b-80ab-775b0bda041f tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:44.302051 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7d216620-1245-4e3b-80ab-775b0bda041f tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:44.430659 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=2 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:31:44.463029 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=10 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:31:44.478641 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-7d216620-1245-4e3b-80ab-775b0bda041f tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725d7beb4ec54b86a455af0d7bd0ce19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c197eded81494b818b1e56f4c01432c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:44.487309 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-7d216620-1245-4e3b-80ab-775b0bda041f tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/c1297f74-578d-4a0d-8fd3-4197917a1dda" status: 200 len: 1393 microversion: 2.1 time: 0.222116 Sep 14 09:31:44.487901 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3143/6308] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:31:44 2022] GET /compute/v2.1/servers/c1297f74-578d-4a0d-8fd3-4197917a1dda => generated 1393 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:31:45.512351 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-62ccbee6-5127-4889-8906-137e9f4f834d tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:45.513294 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-62ccbee6-5127-4889-8906-137e9f4f834d tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: c1297f74-578d-4a0d-8fd3-4197917a1dda] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:45.516392 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=2 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:31:45.523492 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-62ccbee6-5127-4889-8906-137e9f4f834d tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:45.523995 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-62ccbee6-5127-4889-8906-137e9f4f834d tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:45.524443 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-62ccbee6-5127-4889-8906-137e9f4f834d tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:45.525164 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-62ccbee6-5127-4889-8906-137e9f4f834d tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:45.525622 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-62ccbee6-5127-4889-8906-137e9f4f834d tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:45.526049 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-62ccbee6-5127-4889-8906-137e9f4f834d tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:45.667912 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-62ccbee6-5127-4889-8906-137e9f4f834d tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725d7beb4ec54b86a455af0d7bd0ce19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c197eded81494b818b1e56f4c01432c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:45.676862 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-62ccbee6-5127-4889-8906-137e9f4f834d tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/c1297f74-578d-4a0d-8fd3-4197917a1dda" status: 200 len: 1393 microversion: 2.1 time: 0.168334 Sep 14 09:31:45.691504 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3166/6309] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:31:45 2022] GET /compute/v2.1/servers/c1297f74-578d-4a0d-8fd3-4197917a1dda => generated 1393 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:31:46.115327 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-7aed39ce-b18d-4493-bfcc-9c32ebd9f2ab req-f4531246-b908-42d3-8c7a-dfa9d9b4da7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1297f74-578d-4a0d-8fd3-4197917a1dda", "name": "network-vif-plugged", "status": "completed", "tag": "ca01d346-79c1-4969-9a4a-9124c8c992c0"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:31:46.132136 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-7aed39ce-b18d-4493-bfcc-9c32ebd9f2ab req-f4531246-b908-42d3-8c7a-dfa9d9b4da7c service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:46.133172 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-7aed39ce-b18d-4493-bfcc-9c32ebd9f2ab req-f4531246-b908-42d3-8c7a-dfa9d9b4da7c service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:46.134901 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-7aed39ce-b18d-4493-bfcc-9c32ebd9f2ab req-f4531246-b908-42d3-8c7a-dfa9d9b4da7c service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:46.152450 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-7aed39ce-b18d-4493-bfcc-9c32ebd9f2ab req-f4531246-b908-42d3-8c7a-dfa9d9b4da7c service nova] Creating event network-vif-plugged:ca01d346-79c1-4969-9a4a-9124c8c992c0 for instance c1297f74-578d-4a0d-8fd3-4197917a1dda on n-h1-836830-18 Sep 14 09:31:46.162229 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-7aed39ce-b18d-4493-bfcc-9c32ebd9f2ab req-f4531246-b908-42d3-8c7a-dfa9d9b4da7c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052005 Sep 14 09:31:46.164608 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3144/6310] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:31:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:31:46.701231 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-9e654fc9-c284-4925-bc95-e38dc5e9804a tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:46.701879 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-9e654fc9-c284-4925-bc95-e38dc5e9804a tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: c1297f74-578d-4a0d-8fd3-4197917a1dda] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:46.715317 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9e654fc9-c284-4925-bc95-e38dc5e9804a tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:46.716140 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9e654fc9-c284-4925-bc95-e38dc5e9804a tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:46.716588 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9e654fc9-c284-4925-bc95-e38dc5e9804a tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:46.717322 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9e654fc9-c284-4925-bc95-e38dc5e9804a tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:46.717790 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9e654fc9-c284-4925-bc95-e38dc5e9804a tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:46.718223 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9e654fc9-c284-4925-bc95-e38dc5e9804a tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:46.861272 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-9e654fc9-c284-4925-bc95-e38dc5e9804a tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725d7beb4ec54b86a455af0d7bd0ce19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c197eded81494b818b1e56f4c01432c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:46.870365 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-9e654fc9-c284-4925-bc95-e38dc5e9804a tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/c1297f74-578d-4a0d-8fd3-4197917a1dda" status: 200 len: 1393 microversion: 2.1 time: 0.173578 Sep 14 09:31:46.871304 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3167/6311] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:31:46 2022] GET /compute/v2.1/servers/c1297f74-578d-4a0d-8fd3-4197917a1dda => generated 1393 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:31:47.895318 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-1db4521c-1b01-4043-992d-291f7ded0abd tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:47.896036 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-1db4521c-1b01-4043-992d-291f7ded0abd tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: c1297f74-578d-4a0d-8fd3-4197917a1dda] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:47.903326 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1db4521c-1b01-4043-992d-291f7ded0abd tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:47.904093 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1db4521c-1b01-4043-992d-291f7ded0abd tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:47.904876 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1db4521c-1b01-4043-992d-291f7ded0abd tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:47.905647 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1db4521c-1b01-4043-992d-291f7ded0abd tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:47.906110 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1db4521c-1b01-4043-992d-291f7ded0abd tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:47.906869 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1db4521c-1b01-4043-992d-291f7ded0abd tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:48.149688 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-1db4521c-1b01-4043-992d-291f7ded0abd tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725d7beb4ec54b86a455af0d7bd0ce19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c197eded81494b818b1e56f4c01432c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:48.158899 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-1db4521c-1b01-4043-992d-291f7ded0abd tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/c1297f74-578d-4a0d-8fd3-4197917a1dda" status: 200 len: 1564 microversion: 2.1 time: 0.268715 Sep 14 09:31:48.159783 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3145/6312] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:31:47 2022] GET /compute/v2.1/servers/c1297f74-578d-4a0d-8fd3-4197917a1dda => generated 1564 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:31:48.189002 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ccddf765-a7e1-46cb-abe0-de594779398c tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:48.189611 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-ccddf765-a7e1-46cb-abe0-de594779398c tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: c1297f74-578d-4a0d-8fd3-4197917a1dda] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:48.197129 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ccddf765-a7e1-46cb-abe0-de594779398c tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:48.197656 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ccddf765-a7e1-46cb-abe0-de594779398c tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:48.198340 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ccddf765-a7e1-46cb-abe0-de594779398c tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:48.199326 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ccddf765-a7e1-46cb-abe0-de594779398c tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:48.200056 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ccddf765-a7e1-46cb-abe0-de594779398c tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:48.200488 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ccddf765-a7e1-46cb-abe0-de594779398c tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:48.381563 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-ccddf765-a7e1-46cb-abe0-de594779398c tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725d7beb4ec54b86a455af0d7bd0ce19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c197eded81494b818b1e56f4c01432c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:48.394234 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-ccddf765-a7e1-46cb-abe0-de594779398c tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/c1297f74-578d-4a0d-8fd3-4197917a1dda" status: 200 len: 1564 microversion: 2.1 time: 0.209211 Sep 14 09:31:48.395310 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3168/6313] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:31:48 2022] GET /compute/v2.1/servers/c1297f74-578d-4a0d-8fd3-4197917a1dda => generated 1564 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:31:50.249965 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-448b2304-e6f4-4216-8f8a-3c6e112832a3 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:50.251341 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-448b2304-e6f4-4216-8f8a-3c6e112832a3 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: c1297f74-578d-4a0d-8fd3-4197917a1dda] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:50.262266 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-448b2304-e6f4-4216-8f8a-3c6e112832a3 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:50.262772 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-448b2304-e6f4-4216-8f8a-3c6e112832a3 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:50.276181 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-448b2304-e6f4-4216-8f8a-3c6e112832a3 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:50.277794 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-5ecd51ce-dfda-4504-b600-afd06ef798f8 req-5ccf7859-5ef8-40e7-82f4-2eb36cb1a71a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1297f74-578d-4a0d-8fd3-4197917a1dda", "tag": "ca01d346-79c1-4969-9a4a-9124c8c992c0"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:31:50.279541 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-448b2304-e6f4-4216-8f8a-3c6e112832a3 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:50.280990 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-448b2304-e6f4-4216-8f8a-3c6e112832a3 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:50.282349 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-448b2304-e6f4-4216-8f8a-3c6e112832a3 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:50.292949 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-5ecd51ce-dfda-4504-b600-afd06ef798f8 req-5ccf7859-5ef8-40e7-82f4-2eb36cb1a71a service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:50.293739 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-5ecd51ce-dfda-4504-b600-afd06ef798f8 req-5ccf7859-5ef8-40e7-82f4-2eb36cb1a71a service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:50.294358 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-5ecd51ce-dfda-4504-b600-afd06ef798f8 req-5ccf7859-5ef8-40e7-82f4-2eb36cb1a71a service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:50.306638 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-5ecd51ce-dfda-4504-b600-afd06ef798f8 req-5ccf7859-5ef8-40e7-82f4-2eb36cb1a71a service nova] Creating event network-changed:ca01d346-79c1-4969-9a4a-9124c8c992c0 for instance c1297f74-578d-4a0d-8fd3-4197917a1dda on n-h1-836830-18 Sep 14 09:31:50.312180 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-5ecd51ce-dfda-4504-b600-afd06ef798f8 req-5ccf7859-5ef8-40e7-82f4-2eb36cb1a71a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038007 Sep 14 09:31:50.316365 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3169/6314] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:31:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:31:50.678620 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-448b2304-e6f4-4216-8f8a-3c6e112832a3 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725d7beb4ec54b86a455af0d7bd0ce19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c197eded81494b818b1e56f4c01432c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:50.690225 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-448b2304-e6f4-4216-8f8a-3c6e112832a3 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/c1297f74-578d-4a0d-8fd3-4197917a1dda" status: 200 len: 1564 microversion: 2.1 time: 0.445088 Sep 14 09:31:50.706969 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3146/6315] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:31:50 2022] GET /compute/v2.1/servers/c1297f74-578d-4a0d-8fd3-4197917a1dda => generated 1564 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:31:58.917237 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-f1a59b08-3ca3-435e-b727-fbaff2a52d5e tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1019144915", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "networks": [{"uuid": "0ed5254d-daa1-4f6c-8c7f-947df600f3ed"}]}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:31:58.929796 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=42 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:31:58.979710 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.network.neutron [None req-f1a59b08-3ca3-435e-b727-fbaff2a52d5e tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] validate_networks() for [('0ed5254d-daa1-4f6c-8c7f-947df600f3ed', None, None, None, None, None)] {{(pid=128758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:31:59.739247 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-f1a59b08-3ca3-435e-b727-fbaff2a52d5e tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Flavor limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:31:59.739935 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-f1a59b08-3ca3-435e-b727-fbaff2a52d5e tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Image limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:31:59.740461 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-f1a59b08-3ca3-435e-b727-fbaff2a52d5e tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Flavor pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:31:59.741089 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-f1a59b08-3ca3-435e-b727-fbaff2a52d5e tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Image pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:31:59.741506 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-f1a59b08-3ca3-435e-b727-fbaff2a52d5e tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:31:59.752917 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f1a59b08-3ca3-435e-b727-fbaff2a52d5e tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:59.753418 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f1a59b08-3ca3-435e-b727-fbaff2a52d5e tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:59.753851 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f1a59b08-3ca3-435e-b727-fbaff2a52d5e tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:59.754615 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f1a59b08-3ca3-435e-b727-fbaff2a52d5e tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:59.755128 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f1a59b08-3ca3-435e-b727-fbaff2a52d5e tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:59.755561 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f1a59b08-3ca3-435e-b727-fbaff2a52d5e tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:59.764840 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=98 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:31:59.777146 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-f1a59b08-3ca3-435e-b727-fbaff2a52d5e tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Getting quotas for project a11896b0244a4f1e859986b87a17affd. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:31:59.785143 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-f1a59b08-3ca3-435e-b727-fbaff2a52d5e tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Getting quotas for user ddfe63b5ac0d421392a768f97ce4bfbf and project a11896b0244a4f1e859986b87a17affd. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:31:59.804680 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-f1a59b08-3ca3-435e-b727-fbaff2a52d5e tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Going to run 1 instances... {{(pid=128758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:31:59.808149 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-f1a59b08-3ca3-435e-b727-fbaff2a52d5e tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] [instance: ea0bc23d-fa3a-45d4-8311-b9529203a6df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:31:59.867100 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-f1a59b08-3ca3-435e-b727-fbaff2a52d5e tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.958207 Sep 14 09:31:59.868184 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3170/6316] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 09:31:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 960 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 14 09:31:59.880456 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-617aa5b9-6801-47a0-a14c-629ce1e4ba9c tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:59.881138 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-617aa5b9-6801-47a0-a14c-629ce1e4ba9c tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] [instance: ea0bc23d-fa3a-45d4-8311-b9529203a6df] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:59.884302 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:31:59.980531 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-617aa5b9-6801-47a0-a14c-629ce1e4ba9c tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddfe63b5ac0d421392a768f97ce4bfbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a11896b0244a4f1e859986b87a17affd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:59.989624 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-617aa5b9-6801-47a0-a14c-629ce1e4ba9c tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] 10.222.0.60 "GET /compute/v2.1/servers/ea0bc23d-fa3a-45d4-8311-b9529203a6df" status: 200 len: 1219 microversion: 2.1 time: 0.114165 Sep 14 09:31:59.990286 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3147/6317] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:31:59 2022] GET /compute/v2.1/servers/ea0bc23d-fa3a-45d4-8311-b9529203a6df => generated 1219 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:32:01.022305 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b84eb66e-a4ca-48a0-9496-f2f998360d48 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:01.023099 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-b84eb66e-a4ca-48a0-9496-f2f998360d48 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] [instance: ea0bc23d-fa3a-45d4-8311-b9529203a6df] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:32:01.031855 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b84eb66e-a4ca-48a0-9496-f2f998360d48 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:01.032449 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b84eb66e-a4ca-48a0-9496-f2f998360d48 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:01.033527 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b84eb66e-a4ca-48a0-9496-f2f998360d48 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:01.034321 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b84eb66e-a4ca-48a0-9496-f2f998360d48 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:01.034875 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b84eb66e-a4ca-48a0-9496-f2f998360d48 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:01.035437 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b84eb66e-a4ca-48a0-9496-f2f998360d48 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:01.130766 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-b84eb66e-a4ca-48a0-9496-f2f998360d48 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddfe63b5ac0d421392a768f97ce4bfbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a11896b0244a4f1e859986b87a17affd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:01.139703 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-b84eb66e-a4ca-48a0-9496-f2f998360d48 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] 10.222.0.60 "GET /compute/v2.1/servers/ea0bc23d-fa3a-45d4-8311-b9529203a6df" status: 200 len: 1289 microversion: 2.1 time: 0.122248 Sep 14 09:32:01.149842 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3171/6318] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:32:01 2022] GET /compute/v2.1/servers/ea0bc23d-fa3a-45d4-8311-b9529203a6df => generated 1289 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:32:01.178037 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-14e6e369-be7f-4499-a8db-a3c559c4783d tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-1885780893", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "963d3183-5061-4d45-b5ef-297515da7156", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "70503795-7dfb-4d39-a57e-91e8e5270ce0"}]}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:32:01.188284 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:32:01.245188 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.network.neutron [None req-14e6e369-be7f-4499-a8db-a3c559c4783d tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] validate_networks() for [('70503795-7dfb-4d39-a57e-91e8e5270ce0', None, None, None, None, None)] {{(pid=128759) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:32:01.625561 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-14e6e369-be7f-4499-a8db-a3c559c4783d tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Flavor limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:32:01.625986 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-14e6e369-be7f-4499-a8db-a3c559c4783d tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Image limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:32:01.626463 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-14e6e369-be7f-4499-a8db-a3c559c4783d tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Flavor pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:32:01.627476 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-14e6e369-be7f-4499-a8db-a3c559c4783d tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Image pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:32:01.627891 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-14e6e369-be7f-4499-a8db-a3c559c4783d tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:32:01.636808 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-14e6e369-be7f-4499-a8db-a3c559c4783d tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:01.637289 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-14e6e369-be7f-4499-a8db-a3c559c4783d tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:01.637723 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-14e6e369-be7f-4499-a8db-a3c559c4783d tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:01.638472 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-14e6e369-be7f-4499-a8db-a3c559c4783d tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:01.638921 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-14e6e369-be7f-4499-a8db-a3c559c4783d tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:01.639367 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-14e6e369-be7f-4499-a8db-a3c559c4783d tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:01.656074 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-14e6e369-be7f-4499-a8db-a3c559c4783d tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Getting quotas for project 0fca803d9ffa4b4ab0371c0d6a96a5a2. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:32:01.661614 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-14e6e369-be7f-4499-a8db-a3c559c4783d tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Getting quotas for user 80257054a25540c294e1787780b601b4 and project 0fca803d9ffa4b4ab0371c0d6a96a5a2. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:32:01.722858 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-14e6e369-be7f-4499-a8db-a3c559c4783d tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Going to run 1 instances... {{(pid=128759) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:32:01.725170 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-14e6e369-be7f-4499-a8db-a3c559c4783d tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: cc2a0b70-662f-4c7e-a08a-76faaa3ec166] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='963d3183-5061-4d45-b5ef-297515da7156',volume_size=None,volume_type=None)] {{(pid=128759) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:32:01.855381 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-14e6e369-be7f-4499-a8db-a3c559c4783d tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.681097 Sep 14 09:32:01.856119 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3148/6319] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 09:32:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 683 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:32:01.867860 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-9b5185cf-ff78-493d-862f-5a141b64d64a tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:01.868504 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-9b5185cf-ff78-493d-862f-5a141b64d64a tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: cc2a0b70-662f-4c7e-a08a-76faaa3ec166] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:32:01.928673 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-9b5185cf-ff78-493d-862f-5a141b64d64a tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:01.937214 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-9b5185cf-ff78-493d-862f-5a141b64d64a tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/cc2a0b70-662f-4c7e-a08a-76faaa3ec166" status: 200 len: 1071 microversion: 2.1 time: 0.073832 Sep 14 09:32:01.937924 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3172/6320] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:32:01 2022] GET /compute/v2.1/servers/cc2a0b70-662f-4c7e-a08a-76faaa3ec166 => generated 1071 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:32:02.165918 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-084e20aa-8397-4106-bb06-c28b04c1a1aa tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:02.166858 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-084e20aa-8397-4106-bb06-c28b04c1a1aa tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] [instance: ea0bc23d-fa3a-45d4-8311-b9529203a6df] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:32:02.174047 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-084e20aa-8397-4106-bb06-c28b04c1a1aa tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:02.174821 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-084e20aa-8397-4106-bb06-c28b04c1a1aa tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:02.175498 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-084e20aa-8397-4106-bb06-c28b04c1a1aa tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:02.176445 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-084e20aa-8397-4106-bb06-c28b04c1a1aa tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:02.177105 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-084e20aa-8397-4106-bb06-c28b04c1a1aa tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:02.177750 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-084e20aa-8397-4106-bb06-c28b04c1a1aa tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:02.338038 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-084e20aa-8397-4106-bb06-c28b04c1a1aa tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddfe63b5ac0d421392a768f97ce4bfbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a11896b0244a4f1e859986b87a17affd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:02.348285 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-084e20aa-8397-4106-bb06-c28b04c1a1aa tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] 10.222.0.60 "GET /compute/v2.1/servers/ea0bc23d-fa3a-45d4-8311-b9529203a6df" status: 200 len: 1319 microversion: 2.1 time: 0.187105 Sep 14 09:32:02.348975 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3149/6321] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:32:02 2022] GET /compute/v2.1/servers/ea0bc23d-fa3a-45d4-8311-b9529203a6df => generated 1319 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:32:02.380519 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-2682c887-8967-43cd-a5ec-33a69d3a3b1b req-e04f83c8-41d0-47e6-a0bb-02ac6af3920e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea0bc23d-fa3a-45d4-8311-b9529203a6df", "tag": "02859de8-43b1-4e47-9551-e3bf79623515"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:32:02.393089 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-2682c887-8967-43cd-a5ec-33a69d3a3b1b req-e04f83c8-41d0-47e6-a0bb-02ac6af3920e service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:02.393909 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-2682c887-8967-43cd-a5ec-33a69d3a3b1b req-e04f83c8-41d0-47e6-a0bb-02ac6af3920e service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:02.394707 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-2682c887-8967-43cd-a5ec-33a69d3a3b1b req-e04f83c8-41d0-47e6-a0bb-02ac6af3920e service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:02.406165 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-2682c887-8967-43cd-a5ec-33a69d3a3b1b req-e04f83c8-41d0-47e6-a0bb-02ac6af3920e service nova] Creating event network-changed:02859de8-43b1-4e47-9551-e3bf79623515 for instance ea0bc23d-fa3a-45d4-8311-b9529203a6df on n-h2-836830-18 Sep 14 09:32:02.411703 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-2682c887-8967-43cd-a5ec-33a69d3a3b1b req-e04f83c8-41d0-47e6-a0bb-02ac6af3920e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035156 Sep 14 09:32:02.412420 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3173/6322] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:32:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:32:02.961529 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b3b233c0-12ac-4341-a8c3-b1a4428363f0 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:02.962086 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b3b233c0-12ac-4341-a8c3-b1a4428363f0 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: cc2a0b70-662f-4c7e-a08a-76faaa3ec166] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:32:02.968880 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b3b233c0-12ac-4341-a8c3-b1a4428363f0 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:02.969378 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b3b233c0-12ac-4341-a8c3-b1a4428363f0 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:02.969820 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b3b233c0-12ac-4341-a8c3-b1a4428363f0 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:02.970523 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b3b233c0-12ac-4341-a8c3-b1a4428363f0 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:02.971013 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b3b233c0-12ac-4341-a8c3-b1a4428363f0 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:02.971445 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b3b233c0-12ac-4341-a8c3-b1a4428363f0 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:03.036551 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b3b233c0-12ac-4341-a8c3-b1a4428363f0 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:03.044628 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b3b233c0-12ac-4341-a8c3-b1a4428363f0 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/cc2a0b70-662f-4c7e-a08a-76faaa3ec166" status: 200 len: 1169 microversion: 2.1 time: 0.087079 Sep 14 09:32:03.045789 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3150/6323] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:32:02 2022] GET /compute/v2.1/servers/cc2a0b70-662f-4c7e-a08a-76faaa3ec166 => generated 1169 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:32:03.373847 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-dd0f4cb5-d84e-48f2-ac90-f05ec42c7697 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:03.374730 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-dd0f4cb5-d84e-48f2-ac90-f05ec42c7697 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] [instance: ea0bc23d-fa3a-45d4-8311-b9529203a6df] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:32:03.381145 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dd0f4cb5-d84e-48f2-ac90-f05ec42c7697 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:03.382337 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dd0f4cb5-d84e-48f2-ac90-f05ec42c7697 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:03.382776 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dd0f4cb5-d84e-48f2-ac90-f05ec42c7697 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:03.383527 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dd0f4cb5-d84e-48f2-ac90-f05ec42c7697 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:03.383985 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dd0f4cb5-d84e-48f2-ac90-f05ec42c7697 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:03.384427 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dd0f4cb5-d84e-48f2-ac90-f05ec42c7697 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:03.604199 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-dd0f4cb5-d84e-48f2-ac90-f05ec42c7697 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddfe63b5ac0d421392a768f97ce4bfbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a11896b0244a4f1e859986b87a17affd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:03.614278 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-dd0f4cb5-d84e-48f2-ac90-f05ec42c7697 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] 10.222.0.60 "GET /compute/v2.1/servers/ea0bc23d-fa3a-45d4-8311-b9529203a6df" status: 200 len: 1319 microversion: 2.1 time: 0.244664 Sep 14 09:32:03.626025 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3174/6324] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:32:03 2022] GET /compute/v2.1/servers/ea0bc23d-fa3a-45d4-8311-b9529203a6df => generated 1319 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:32:04.069373 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-0c29fdc2-a139-4d4a-a0d1-5a61e304a333 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:04.070535 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-0c29fdc2-a139-4d4a-a0d1-5a61e304a333 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: cc2a0b70-662f-4c7e-a08a-76faaa3ec166] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:32:04.077415 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0c29fdc2-a139-4d4a-a0d1-5a61e304a333 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:04.077918 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0c29fdc2-a139-4d4a-a0d1-5a61e304a333 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:04.078362 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0c29fdc2-a139-4d4a-a0d1-5a61e304a333 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:04.079095 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0c29fdc2-a139-4d4a-a0d1-5a61e304a333 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:04.080291 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0c29fdc2-a139-4d4a-a0d1-5a61e304a333 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:04.080895 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0c29fdc2-a139-4d4a-a0d1-5a61e304a333 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:04.331438 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-0c29fdc2-a139-4d4a-a0d1-5a61e304a333 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:04.341220 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-0c29fdc2-a139-4d4a-a0d1-5a61e304a333 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/cc2a0b70-662f-4c7e-a08a-76faaa3ec166" status: 200 len: 1229 microversion: 2.1 time: 0.275789 Sep 14 09:32:04.357649 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3151/6325] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:32:04 2022] GET /compute/v2.1/servers/cc2a0b70-662f-4c7e-a08a-76faaa3ec166 => generated 1229 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:32:04.640103 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-8eb1f7a1-8967-42c5-9719-828f74c75d6f tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:04.642647 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-8eb1f7a1-8967-42c5-9719-828f74c75d6f tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] [instance: ea0bc23d-fa3a-45d4-8311-b9529203a6df] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:32:04.651505 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8eb1f7a1-8967-42c5-9719-828f74c75d6f tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:04.652227 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8eb1f7a1-8967-42c5-9719-828f74c75d6f tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:04.652852 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8eb1f7a1-8967-42c5-9719-828f74c75d6f tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:04.653744 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8eb1f7a1-8967-42c5-9719-828f74c75d6f tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:04.654358 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8eb1f7a1-8967-42c5-9719-828f74c75d6f tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:04.654967 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8eb1f7a1-8967-42c5-9719-828f74c75d6f tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:04.809509 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-f8451ba5-abbf-42f3-a718-d23aa84be6f5 req-85571e4d-6e41-44b6-972e-0b0aef9aeefa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc2a0b70-662f-4c7e-a08a-76faaa3ec166", "tag": "da23266e-81f2-445c-8002-9ee4e3d358d7"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:32:04.820121 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-f8451ba5-abbf-42f3-a718-d23aa84be6f5 req-85571e4d-6e41-44b6-972e-0b0aef9aeefa service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:04.820615 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-f8451ba5-abbf-42f3-a718-d23aa84be6f5 req-85571e4d-6e41-44b6-972e-0b0aef9aeefa service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:04.821055 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-f8451ba5-abbf-42f3-a718-d23aa84be6f5 req-85571e4d-6e41-44b6-972e-0b0aef9aeefa service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:04.833907 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-f8451ba5-abbf-42f3-a718-d23aa84be6f5 req-85571e4d-6e41-44b6-972e-0b0aef9aeefa service nova] Creating event network-changed:da23266e-81f2-445c-8002-9ee4e3d358d7 for instance cc2a0b70-662f-4c7e-a08a-76faaa3ec166 on n-h1-836830-18 Sep 14 09:32:04.839288 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-f8451ba5-abbf-42f3-a718-d23aa84be6f5 req-85571e4d-6e41-44b6-972e-0b0aef9aeefa service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033494 Sep 14 09:32:04.839906 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3152/6326] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:32:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:32:04.887319 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-8eb1f7a1-8967-42c5-9719-828f74c75d6f tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddfe63b5ac0d421392a768f97ce4bfbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a11896b0244a4f1e859986b87a17affd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:04.896235 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-8eb1f7a1-8967-42c5-9719-828f74c75d6f tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] 10.222.0.60 "GET /compute/v2.1/servers/ea0bc23d-fa3a-45d4-8311-b9529203a6df" status: 200 len: 1319 microversion: 2.1 time: 0.262645 Sep 14 09:32:04.897552 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3175/6327] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:32:04 2022] GET /compute/v2.1/servers/ea0bc23d-fa3a-45d4-8311-b9529203a6df => generated 1319 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:32:05.371262 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-92638b00-b1e5-42b0-a695-bd89118b8720 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:05.371989 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-92638b00-b1e5-42b0-a695-bd89118b8720 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: cc2a0b70-662f-4c7e-a08a-76faaa3ec166] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:32:05.378346 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-92638b00-b1e5-42b0-a695-bd89118b8720 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:05.378838 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-92638b00-b1e5-42b0-a695-bd89118b8720 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:05.379309 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-92638b00-b1e5-42b0-a695-bd89118b8720 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:05.380020 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-92638b00-b1e5-42b0-a695-bd89118b8720 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:05.380496 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-92638b00-b1e5-42b0-a695-bd89118b8720 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:05.380944 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-92638b00-b1e5-42b0-a695-bd89118b8720 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:05.590873 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-92638b00-b1e5-42b0-a695-bd89118b8720 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:05.600239 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-92638b00-b1e5-42b0-a695-bd89118b8720 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/cc2a0b70-662f-4c7e-a08a-76faaa3ec166" status: 200 len: 1229 microversion: 2.1 time: 0.234113 Sep 14 09:32:05.600959 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3153/6328] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:32:05 2022] GET /compute/v2.1/servers/cc2a0b70-662f-4c7e-a08a-76faaa3ec166 => generated 1229 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:32:05.919955 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-783f3d56-4a06-47a6-83f3-c9df7e65d57a tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:05.920582 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-783f3d56-4a06-47a6-83f3-c9df7e65d57a tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] [instance: ea0bc23d-fa3a-45d4-8311-b9529203a6df] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:32:05.931579 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-783f3d56-4a06-47a6-83f3-c9df7e65d57a tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:05.932077 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-783f3d56-4a06-47a6-83f3-c9df7e65d57a tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:05.932518 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-783f3d56-4a06-47a6-83f3-c9df7e65d57a tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:05.933283 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-783f3d56-4a06-47a6-83f3-c9df7e65d57a tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:05.933744 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-783f3d56-4a06-47a6-83f3-c9df7e65d57a tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:05.934173 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-783f3d56-4a06-47a6-83f3-c9df7e65d57a tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:06.070339 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-783f3d56-4a06-47a6-83f3-c9df7e65d57a tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddfe63b5ac0d421392a768f97ce4bfbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a11896b0244a4f1e859986b87a17affd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:06.078701 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-783f3d56-4a06-47a6-83f3-c9df7e65d57a tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] 10.222.0.60 "GET /compute/v2.1/servers/ea0bc23d-fa3a-45d4-8311-b9529203a6df" status: 200 len: 1319 microversion: 2.1 time: 0.162779 Sep 14 09:32:06.079423 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3176/6329] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:32:05 2022] GET /compute/v2.1/servers/ea0bc23d-fa3a-45d4-8311-b9529203a6df => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:32:06.305479 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-1e2e9b6a-eea5-4df9-8951-0e7aaeb1a155 req-4cc63a0f-a208-4038-a618-2741a92280e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea0bc23d-fa3a-45d4-8311-b9529203a6df", "name": "network-vif-plugged", "status": "completed", "tag": "02859de8-43b1-4e47-9551-e3bf79623515"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:32:06.316337 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-1e2e9b6a-eea5-4df9-8951-0e7aaeb1a155 req-4cc63a0f-a208-4038-a618-2741a92280e3 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:06.316900 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-1e2e9b6a-eea5-4df9-8951-0e7aaeb1a155 req-4cc63a0f-a208-4038-a618-2741a92280e3 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:06.317718 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-1e2e9b6a-eea5-4df9-8951-0e7aaeb1a155 req-4cc63a0f-a208-4038-a618-2741a92280e3 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:06.330540 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-1e2e9b6a-eea5-4df9-8951-0e7aaeb1a155 req-4cc63a0f-a208-4038-a618-2741a92280e3 service nova] Creating event network-vif-plugged:02859de8-43b1-4e47-9551-e3bf79623515 for instance ea0bc23d-fa3a-45d4-8311-b9529203a6df on n-h2-836830-18 Sep 14 09:32:06.336009 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-1e2e9b6a-eea5-4df9-8951-0e7aaeb1a155 req-4cc63a0f-a208-4038-a618-2741a92280e3 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034259 Sep 14 09:32:06.337150 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3154/6330] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:32:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:32:06.623391 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-33b26f55-cb1d-444d-a1b5-93647523bd3f tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:06.624142 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-33b26f55-cb1d-444d-a1b5-93647523bd3f tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: cc2a0b70-662f-4c7e-a08a-76faaa3ec166] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:32:06.631020 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-33b26f55-cb1d-444d-a1b5-93647523bd3f tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:06.631608 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-33b26f55-cb1d-444d-a1b5-93647523bd3f tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:06.632123 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-33b26f55-cb1d-444d-a1b5-93647523bd3f tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:06.632892 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-33b26f55-cb1d-444d-a1b5-93647523bd3f tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:06.633421 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-33b26f55-cb1d-444d-a1b5-93647523bd3f tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:06.633917 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-33b26f55-cb1d-444d-a1b5-93647523bd3f tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:06.764991 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-33b26f55-cb1d-444d-a1b5-93647523bd3f tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:06.773128 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-33b26f55-cb1d-444d-a1b5-93647523bd3f tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/cc2a0b70-662f-4c7e-a08a-76faaa3ec166" status: 200 len: 1229 microversion: 2.1 time: 0.153338 Sep 14 09:32:06.773594 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3177/6331] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:32:06 2022] GET /compute/v2.1/servers/cc2a0b70-662f-4c7e-a08a-76faaa3ec166 => generated 1229 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:32:07.103844 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-7c828314-17ef-4b2c-8976-f4b48328fb49 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:07.104559 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-7c828314-17ef-4b2c-8976-f4b48328fb49 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] [instance: ea0bc23d-fa3a-45d4-8311-b9529203a6df] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:32:07.110784 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7c828314-17ef-4b2c-8976-f4b48328fb49 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:07.111895 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7c828314-17ef-4b2c-8976-f4b48328fb49 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:07.112339 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7c828314-17ef-4b2c-8976-f4b48328fb49 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:07.113032 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7c828314-17ef-4b2c-8976-f4b48328fb49 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:07.113490 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7c828314-17ef-4b2c-8976-f4b48328fb49 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:07.113923 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7c828314-17ef-4b2c-8976-f4b48328fb49 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:07.248748 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-7c828314-17ef-4b2c-8976-f4b48328fb49 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddfe63b5ac0d421392a768f97ce4bfbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a11896b0244a4f1e859986b87a17affd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:07.256887 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-7c828314-17ef-4b2c-8976-f4b48328fb49 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] 10.222.0.60 "GET /compute/v2.1/servers/ea0bc23d-fa3a-45d4-8311-b9529203a6df" status: 200 len: 1319 microversion: 2.1 time: 0.158253 Sep 14 09:32:07.257477 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3155/6332] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:32:07 2022] GET /compute/v2.1/servers/ea0bc23d-fa3a-45d4-8311-b9529203a6df => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:32:07.796207 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-043c073e-2dbc-40f6-89c1-322e68d691a7 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:07.796859 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-043c073e-2dbc-40f6-89c1-322e68d691a7 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: cc2a0b70-662f-4c7e-a08a-76faaa3ec166] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:32:07.805073 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-043c073e-2dbc-40f6-89c1-322e68d691a7 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:07.805773 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-043c073e-2dbc-40f6-89c1-322e68d691a7 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:07.806233 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-043c073e-2dbc-40f6-89c1-322e68d691a7 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:07.806963 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-043c073e-2dbc-40f6-89c1-322e68d691a7 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:07.807440 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-043c073e-2dbc-40f6-89c1-322e68d691a7 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:07.807878 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-043c073e-2dbc-40f6-89c1-322e68d691a7 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:07.942603 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-043c073e-2dbc-40f6-89c1-322e68d691a7 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:07.951453 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-043c073e-2dbc-40f6-89c1-322e68d691a7 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/cc2a0b70-662f-4c7e-a08a-76faaa3ec166" status: 200 len: 1229 microversion: 2.1 time: 0.159137 Sep 14 09:32:07.952067 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3178/6333] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:32:07 2022] GET /compute/v2.1/servers/cc2a0b70-662f-4c7e-a08a-76faaa3ec166 => generated 1229 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:32:08.280082 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-7cfb5dd5-a290-4316-9745-d1d8b814161f tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:08.280732 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-7cfb5dd5-a290-4316-9745-d1d8b814161f tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] [instance: ea0bc23d-fa3a-45d4-8311-b9529203a6df] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:32:08.287585 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7cfb5dd5-a290-4316-9745-d1d8b814161f tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:08.288102 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7cfb5dd5-a290-4316-9745-d1d8b814161f tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:08.288822 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7cfb5dd5-a290-4316-9745-d1d8b814161f tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:08.289533 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7cfb5dd5-a290-4316-9745-d1d8b814161f tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:08.289992 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7cfb5dd5-a290-4316-9745-d1d8b814161f tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:08.290422 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7cfb5dd5-a290-4316-9745-d1d8b814161f tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:08.418813 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-7cfb5dd5-a290-4316-9745-d1d8b814161f tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddfe63b5ac0d421392a768f97ce4bfbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a11896b0244a4f1e859986b87a17affd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:08.426596 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-7cfb5dd5-a290-4316-9745-d1d8b814161f tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] 10.222.0.60 "GET /compute/v2.1/servers/ea0bc23d-fa3a-45d4-8311-b9529203a6df" status: 200 len: 1508 microversion: 2.1 time: 0.150616 Sep 14 09:32:08.427214 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3156/6334] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:32:08 2022] GET /compute/v2.1/servers/ea0bc23d-fa3a-45d4-8311-b9529203a6df => generated 1508 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:32:08.975088 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-90b2ef79-6503-4b8c-a235-58cab7a9d5f5 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:08.975926 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-90b2ef79-6503-4b8c-a235-58cab7a9d5f5 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: cc2a0b70-662f-4c7e-a08a-76faaa3ec166] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:32:08.982796 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-90b2ef79-6503-4b8c-a235-58cab7a9d5f5 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:08.983397 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-90b2ef79-6503-4b8c-a235-58cab7a9d5f5 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:08.983970 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-90b2ef79-6503-4b8c-a235-58cab7a9d5f5 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:08.984722 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-90b2ef79-6503-4b8c-a235-58cab7a9d5f5 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:08.985130 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-90b2ef79-6503-4b8c-a235-58cab7a9d5f5 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:08.985624 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-90b2ef79-6503-4b8c-a235-58cab7a9d5f5 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:09.127888 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-90b2ef79-6503-4b8c-a235-58cab7a9d5f5 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:09.136993 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-90b2ef79-6503-4b8c-a235-58cab7a9d5f5 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/cc2a0b70-662f-4c7e-a08a-76faaa3ec166" status: 200 len: 1217 microversion: 2.1 time: 0.166358 Sep 14 09:32:09.137577 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3179/6335] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:32:08 2022] GET /compute/v2.1/servers/cc2a0b70-662f-4c7e-a08a-76faaa3ec166 => generated 1217 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:32:10.161557 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d00e0b40-23fd-499b-b0ff-9bf02ae5ffe3 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:10.162510 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-d00e0b40-23fd-499b-b0ff-9bf02ae5ffe3 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: cc2a0b70-662f-4c7e-a08a-76faaa3ec166] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:32:10.169484 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d00e0b40-23fd-499b-b0ff-9bf02ae5ffe3 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:10.169983 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d00e0b40-23fd-499b-b0ff-9bf02ae5ffe3 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:10.170432 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d00e0b40-23fd-499b-b0ff-9bf02ae5ffe3 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:10.171162 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d00e0b40-23fd-499b-b0ff-9bf02ae5ffe3 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:10.171630 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d00e0b40-23fd-499b-b0ff-9bf02ae5ffe3 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:10.172064 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d00e0b40-23fd-499b-b0ff-9bf02ae5ffe3 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:10.314105 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-d00e0b40-23fd-499b-b0ff-9bf02ae5ffe3 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:10.322066 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d00e0b40-23fd-499b-b0ff-9bf02ae5ffe3 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/cc2a0b70-662f-4c7e-a08a-76faaa3ec166" status: 200 len: 1217 microversion: 2.1 time: 0.165004 Sep 14 09:32:10.322649 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3157/6336] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:32:10 2022] GET /compute/v2.1/servers/cc2a0b70-662f-4c7e-a08a-76faaa3ec166 => generated 1217 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:32:11.345084 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-109a12c5-81d1-4806-8511-4dde3dd8e027 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:11.345716 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-109a12c5-81d1-4806-8511-4dde3dd8e027 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: cc2a0b70-662f-4c7e-a08a-76faaa3ec166] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:32:11.347763 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=2 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:32:11.353992 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-109a12c5-81d1-4806-8511-4dde3dd8e027 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:11.354487 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-109a12c5-81d1-4806-8511-4dde3dd8e027 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:11.354926 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-109a12c5-81d1-4806-8511-4dde3dd8e027 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:11.355650 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-109a12c5-81d1-4806-8511-4dde3dd8e027 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:11.356107 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-109a12c5-81d1-4806-8511-4dde3dd8e027 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:11.356536 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-109a12c5-81d1-4806-8511-4dde3dd8e027 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:11.489157 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-109a12c5-81d1-4806-8511-4dde3dd8e027 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:11.497277 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-109a12c5-81d1-4806-8511-4dde3dd8e027 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/cc2a0b70-662f-4c7e-a08a-76faaa3ec166" status: 200 len: 1217 microversion: 2.1 time: 0.156103 Sep 14 09:32:11.497861 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3180/6337] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:32:11 2022] GET /compute/v2.1/servers/cc2a0b70-662f-4c7e-a08a-76faaa3ec166 => generated 1217 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:32:12.521551 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-28418444-7adf-4178-a46d-bd4242a1ad84 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:12.522099 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-28418444-7adf-4178-a46d-bd4242a1ad84 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: cc2a0b70-662f-4c7e-a08a-76faaa3ec166] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:32:12.525404 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=2 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:32:12.526236 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=8 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:32:12.533886 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-28418444-7adf-4178-a46d-bd4242a1ad84 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:12.534385 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-28418444-7adf-4178-a46d-bd4242a1ad84 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:12.534821 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-28418444-7adf-4178-a46d-bd4242a1ad84 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:12.535547 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-28418444-7adf-4178-a46d-bd4242a1ad84 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:12.536008 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-28418444-7adf-4178-a46d-bd4242a1ad84 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:12.536444 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-28418444-7adf-4178-a46d-bd4242a1ad84 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:12.682720 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-28418444-7adf-4178-a46d-bd4242a1ad84 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:12.694188 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-28418444-7adf-4178-a46d-bd4242a1ad84 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/cc2a0b70-662f-4c7e-a08a-76faaa3ec166" status: 200 len: 1217 microversion: 2.1 time: 0.177040 Sep 14 09:32:12.695138 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3158/6338] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:32:12 2022] GET /compute/v2.1/servers/cc2a0b70-662f-4c7e-a08a-76faaa3ec166 => generated 1217 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:32:13.717801 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d835c9bf-6b89-41f5-9cf1-d6dbe02998e2 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:13.718544 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-d835c9bf-6b89-41f5-9cf1-d6dbe02998e2 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: cc2a0b70-662f-4c7e-a08a-76faaa3ec166] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:32:13.720512 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=8 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:32:13.721639 n-d-836830-18 devstack@n-api.service[128758]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 09:32:13.721970 n-d-836830-18 devstack@n-api.service[128758]: Wed Sep 14 09:32:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cc2a0b70-662f-4c7e-a08a-76faaa3ec166 (ip 10.222.0.60) !!! Sep 14 09:32:13.733424 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d835c9bf-6b89-41f5-9cf1-d6dbe02998e2 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:13.733917 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d835c9bf-6b89-41f5-9cf1-d6dbe02998e2 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:13.734354 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d835c9bf-6b89-41f5-9cf1-d6dbe02998e2 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:13.735375 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d835c9bf-6b89-41f5-9cf1-d6dbe02998e2 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:13.736342 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d835c9bf-6b89-41f5-9cf1-d6dbe02998e2 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:13.736775 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d835c9bf-6b89-41f5-9cf1-d6dbe02998e2 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:13.874648 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-d835c9bf-6b89-41f5-9cf1-d6dbe02998e2 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:13.883265 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-d835c9bf-6b89-41f5-9cf1-d6dbe02998e2 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/cc2a0b70-662f-4c7e-a08a-76faaa3ec166" status: 200 len: 1217 microversion: 2.1 time: 0.169333 Sep 14 09:32:13.883859 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3181/6339] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:32:13 2022] GET /compute/v2.1/servers/cc2a0b70-662f-4c7e-a08a-76faaa3ec166 => generated 1217 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:32:14.905778 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-7622dfdb-d34f-4612-8f40-671f1b43ff2f tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:14.906405 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-7622dfdb-d34f-4612-8f40-671f1b43ff2f tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: cc2a0b70-662f-4c7e-a08a-76faaa3ec166] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:32:14.913413 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7622dfdb-d34f-4612-8f40-671f1b43ff2f tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:14.913903 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7622dfdb-d34f-4612-8f40-671f1b43ff2f tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:14.914353 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7622dfdb-d34f-4612-8f40-671f1b43ff2f tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:14.915076 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7622dfdb-d34f-4612-8f40-671f1b43ff2f tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:14.915543 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7622dfdb-d34f-4612-8f40-671f1b43ff2f tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:14.915976 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7622dfdb-d34f-4612-8f40-671f1b43ff2f tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:15.063239 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-7622dfdb-d34f-4612-8f40-671f1b43ff2f tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:15.072041 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-7622dfdb-d34f-4612-8f40-671f1b43ff2f tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/cc2a0b70-662f-4c7e-a08a-76faaa3ec166" status: 200 len: 1217 microversion: 2.1 time: 0.170246 Sep 14 09:32:15.072617 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3159/6340] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:32:14 2022] GET /compute/v2.1/servers/cc2a0b70-662f-4c7e-a08a-76faaa3ec166 => generated 1217 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:32:16.095485 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-bf2dcebc-d0c9-4ae1-9a81-008ef342bc27 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:16.096155 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-bf2dcebc-d0c9-4ae1-9a81-008ef342bc27 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: cc2a0b70-662f-4c7e-a08a-76faaa3ec166] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:32:16.103172 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bf2dcebc-d0c9-4ae1-9a81-008ef342bc27 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:16.103660 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bf2dcebc-d0c9-4ae1-9a81-008ef342bc27 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:16.104100 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bf2dcebc-d0c9-4ae1-9a81-008ef342bc27 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:16.104799 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bf2dcebc-d0c9-4ae1-9a81-008ef342bc27 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:16.105253 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bf2dcebc-d0c9-4ae1-9a81-008ef342bc27 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:16.105687 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bf2dcebc-d0c9-4ae1-9a81-008ef342bc27 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:16.246227 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-bf2dcebc-d0c9-4ae1-9a81-008ef342bc27 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:16.254712 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-bf2dcebc-d0c9-4ae1-9a81-008ef342bc27 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/cc2a0b70-662f-4c7e-a08a-76faaa3ec166" status: 200 len: 1217 microversion: 2.1 time: 0.163469 Sep 14 09:32:16.255329 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3182/6341] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:32:16 2022] GET /compute/v2.1/servers/cc2a0b70-662f-4c7e-a08a-76faaa3ec166 => generated 1217 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:32:17.277598 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-92180d3b-7476-4a3b-8d35-58e62dca8364 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:17.278475 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-92180d3b-7476-4a3b-8d35-58e62dca8364 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: cc2a0b70-662f-4c7e-a08a-76faaa3ec166] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:32:17.285744 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-92180d3b-7476-4a3b-8d35-58e62dca8364 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:17.289653 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-92180d3b-7476-4a3b-8d35-58e62dca8364 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:17.289653 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-92180d3b-7476-4a3b-8d35-58e62dca8364 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:17.290444 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-92180d3b-7476-4a3b-8d35-58e62dca8364 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:17.290917 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-92180d3b-7476-4a3b-8d35-58e62dca8364 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:17.291451 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-92180d3b-7476-4a3b-8d35-58e62dca8364 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:17.430237 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-92180d3b-7476-4a3b-8d35-58e62dca8364 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:17.438182 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-92180d3b-7476-4a3b-8d35-58e62dca8364 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/cc2a0b70-662f-4c7e-a08a-76faaa3ec166" status: 200 len: 1217 microversion: 2.1 time: 0.164378 Sep 14 09:32:17.438768 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3160/6342] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:32:17 2022] GET /compute/v2.1/servers/cc2a0b70-662f-4c7e-a08a-76faaa3ec166 => generated 1217 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:32:18.461493 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-7fde8d24-652e-475e-a002-f2dbd98a741e tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:18.462159 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-7fde8d24-652e-475e-a002-f2dbd98a741e tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: cc2a0b70-662f-4c7e-a08a-76faaa3ec166] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:32:18.468944 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7fde8d24-652e-475e-a002-f2dbd98a741e tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:18.469477 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7fde8d24-652e-475e-a002-f2dbd98a741e tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:18.469920 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7fde8d24-652e-475e-a002-f2dbd98a741e tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:18.471303 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7fde8d24-652e-475e-a002-f2dbd98a741e tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:18.471780 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7fde8d24-652e-475e-a002-f2dbd98a741e tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:18.472211 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7fde8d24-652e-475e-a002-f2dbd98a741e tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:18.607155 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-7fde8d24-652e-475e-a002-f2dbd98a741e tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:18.616866 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-7fde8d24-652e-475e-a002-f2dbd98a741e tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/cc2a0b70-662f-4c7e-a08a-76faaa3ec166" status: 200 len: 1217 microversion: 2.1 time: 0.159166 Sep 14 09:32:18.617771 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3183/6343] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:32:18 2022] GET /compute/v2.1/servers/cc2a0b70-662f-4c7e-a08a-76faaa3ec166 => generated 1217 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:32:19.640426 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-1274c6f1-4bcf-44b3-abfd-1f46cf57d51f tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:19.641054 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-1274c6f1-4bcf-44b3-abfd-1f46cf57d51f tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: cc2a0b70-662f-4c7e-a08a-76faaa3ec166] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:32:19.648200 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1274c6f1-4bcf-44b3-abfd-1f46cf57d51f tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:19.648696 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1274c6f1-4bcf-44b3-abfd-1f46cf57d51f tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:19.649149 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1274c6f1-4bcf-44b3-abfd-1f46cf57d51f tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:19.649847 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1274c6f1-4bcf-44b3-abfd-1f46cf57d51f tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:19.650313 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1274c6f1-4bcf-44b3-abfd-1f46cf57d51f tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:19.650750 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1274c6f1-4bcf-44b3-abfd-1f46cf57d51f tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:19.782176 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-1274c6f1-4bcf-44b3-abfd-1f46cf57d51f tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:19.790610 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-1274c6f1-4bcf-44b3-abfd-1f46cf57d51f tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/cc2a0b70-662f-4c7e-a08a-76faaa3ec166" status: 200 len: 1217 microversion: 2.1 time: 0.154289 Sep 14 09:32:19.791226 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3161/6344] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:32:19 2022] GET /compute/v2.1/servers/cc2a0b70-662f-4c7e-a08a-76faaa3ec166 => generated 1217 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:32:20.214643 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-ee91c240-a383-456e-a4fa-22e7f40b4f0c req-02364aca-75f4-45b0-bc58-91591d864d2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc2a0b70-662f-4c7e-a08a-76faaa3ec166", "name": "network-vif-plugged", "status": "completed", "tag": "da23266e-81f2-445c-8002-9ee4e3d358d7"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:32:20.226601 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-ee91c240-a383-456e-a4fa-22e7f40b4f0c req-02364aca-75f4-45b0-bc58-91591d864d2c service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:20.227203 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-ee91c240-a383-456e-a4fa-22e7f40b4f0c req-02364aca-75f4-45b0-bc58-91591d864d2c service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:20.227705 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-ee91c240-a383-456e-a4fa-22e7f40b4f0c req-02364aca-75f4-45b0-bc58-91591d864d2c service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:20.239715 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-ee91c240-a383-456e-a4fa-22e7f40b4f0c req-02364aca-75f4-45b0-bc58-91591d864d2c service nova] Creating event network-vif-plugged:da23266e-81f2-445c-8002-9ee4e3d358d7 for instance cc2a0b70-662f-4c7e-a08a-76faaa3ec166 on n-h1-836830-18 Sep 14 09:32:20.244860 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-ee91c240-a383-456e-a4fa-22e7f40b4f0c req-02364aca-75f4-45b0-bc58-91591d864d2c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034406 Sep 14 09:32:20.245732 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3184/6345] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:32:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:32:20.813702 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b5a6d693-3c88-4300-847b-26e97f40974f tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:20.814886 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b5a6d693-3c88-4300-847b-26e97f40974f tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: cc2a0b70-662f-4c7e-a08a-76faaa3ec166] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:32:20.821800 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b5a6d693-3c88-4300-847b-26e97f40974f tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:20.822289 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b5a6d693-3c88-4300-847b-26e97f40974f tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:20.822729 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b5a6d693-3c88-4300-847b-26e97f40974f tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:20.823464 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b5a6d693-3c88-4300-847b-26e97f40974f tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:20.823943 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b5a6d693-3c88-4300-847b-26e97f40974f tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:20.824370 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b5a6d693-3c88-4300-847b-26e97f40974f tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:20.953958 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b5a6d693-3c88-4300-847b-26e97f40974f tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:20.961818 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b5a6d693-3c88-4300-847b-26e97f40974f tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/cc2a0b70-662f-4c7e-a08a-76faaa3ec166" status: 200 len: 1217 microversion: 2.1 time: 0.152052 Sep 14 09:32:20.962588 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3162/6346] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:32:20 2022] GET /compute/v2.1/servers/cc2a0b70-662f-4c7e-a08a-76faaa3ec166 => generated 1217 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:32:21.990326 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a30ac348-92d0-47e3-93d4-de5a08393bce tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:21.991089 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-a30ac348-92d0-47e3-93d4-de5a08393bce tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: cc2a0b70-662f-4c7e-a08a-76faaa3ec166] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:32:21.999288 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a30ac348-92d0-47e3-93d4-de5a08393bce tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:21.999904 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a30ac348-92d0-47e3-93d4-de5a08393bce tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:22.000350 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a30ac348-92d0-47e3-93d4-de5a08393bce tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:22.001063 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a30ac348-92d0-47e3-93d4-de5a08393bce tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:22.002303 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a30ac348-92d0-47e3-93d4-de5a08393bce tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:22.002752 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a30ac348-92d0-47e3-93d4-de5a08393bce tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:22.179431 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-a30ac348-92d0-47e3-93d4-de5a08393bce tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:22.190547 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-a30ac348-92d0-47e3-93d4-de5a08393bce tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/cc2a0b70-662f-4c7e-a08a-76faaa3ec166" status: 200 len: 1401 microversion: 2.1 time: 0.209599 Sep 14 09:32:22.191486 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3185/6347] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:32:21 2022] GET /compute/v2.1/servers/cc2a0b70-662f-4c7e-a08a-76faaa3ec166 => generated 1401 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:32:22.216309 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-367ca939-26b0-4414-aebd-14778b804a37 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:22.216951 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-367ca939-26b0-4414-aebd-14778b804a37 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: cc2a0b70-662f-4c7e-a08a-76faaa3ec166] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:32:22.224335 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-367ca939-26b0-4414-aebd-14778b804a37 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:22.227031 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-367ca939-26b0-4414-aebd-14778b804a37 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:22.227505 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-367ca939-26b0-4414-aebd-14778b804a37 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:22.228252 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-367ca939-26b0-4414-aebd-14778b804a37 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:22.228731 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-367ca939-26b0-4414-aebd-14778b804a37 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:22.229163 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-367ca939-26b0-4414-aebd-14778b804a37 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:22.367280 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-367ca939-26b0-4414-aebd-14778b804a37 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:22.375166 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-367ca939-26b0-4414-aebd-14778b804a37 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/cc2a0b70-662f-4c7e-a08a-76faaa3ec166" status: 200 len: 1401 microversion: 2.1 time: 0.164174 Sep 14 09:32:22.375758 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3163/6348] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:32:22 2022] GET /compute/v2.1/servers/cc2a0b70-662f-4c7e-a08a-76faaa3ec166 => generated 1401 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:32:22.399259 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d59cfc4c-3e68-400b-8b60-49593987d1db tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-707674572"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:32:22.401582 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-d59cfc4c-3e68-400b-8b60-49593987d1db tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: cc2a0b70-662f-4c7e-a08a-76faaa3ec166] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:32:22.407716 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d59cfc4c-3e68-400b-8b60-49593987d1db tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:22.408705 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d59cfc4c-3e68-400b-8b60-49593987d1db tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:22.409142 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d59cfc4c-3e68-400b-8b60-49593987d1db tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:22.409836 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d59cfc4c-3e68-400b-8b60-49593987d1db tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:22.410292 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d59cfc4c-3e68-400b-8b60-49593987d1db tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:22.410718 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d59cfc4c-3e68-400b-8b60-49593987d1db tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:22.502663 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.compute.api [None req-d59cfc4c-3e68-400b-8b60-49593987d1db tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: cc2a0b70-662f-4c7e-a08a-76faaa3ec166] Attempting to quiesce instance before volume snapshot. Sep 14 09:32:22.554992 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.compute.api [None req-d59cfc4c-3e68-400b-8b60-49593987d1db tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: cc2a0b70-662f-4c7e-a08a-76faaa3ec166] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Sep 14 09:32:22.638837 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-d59cfc4c-3e68-400b-8b60-49593987d1db tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: cc2a0b70-662f-4c7e-a08a-76faaa3ec166] Creating snapshot from volume 963d3183-5061-4d45-b5ef-297515da7156. {{(pid=128758) snapshot_instance /opt/stack/nova/nova/compute/api.py:3509}} Sep 14 09:32:23.437816 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-d59cfc4c-3e68-400b-8b60-49593987d1db tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "POST /compute/v2.1/servers/cc2a0b70-662f-4c7e-a08a-76faaa3ec166/action" status: 202 len: 0 microversion: 2.1 time: 1.042691 Sep 14 09:32:23.438986 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3186/6349] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:32:22 2022] POST /compute/v2.1/servers/cc2a0b70-662f-4c7e-a08a-76faaa3ec166/action => generated 0 bytes in 1044 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 14 09:32:23.642177 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-cc9ba18e-e11f-4863-9075-dbf605937d43 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "75a14cbe-c296-45d1-9563-33e8488ed635", "device": "/dev/sdb"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:32:23.645112 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-cc9ba18e-e11f-4863-9075-dbf605937d43 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] [instance: ea0bc23d-fa3a-45d4-8311-b9529203a6df] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:32:23.652359 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cc9ba18e-e11f-4863-9075-dbf605937d43 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:23.652850 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cc9ba18e-e11f-4863-9075-dbf605937d43 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:23.653294 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cc9ba18e-e11f-4863-9075-dbf605937d43 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:23.653991 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cc9ba18e-e11f-4863-9075-dbf605937d43 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:23.654453 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cc9ba18e-e11f-4863-9075-dbf605937d43 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:23.654880 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cc9ba18e-e11f-4863-9075-dbf605937d43 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:23.900438 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-cc9ba18e-e11f-4863-9075-dbf605937d43 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] 10.222.0.60 "POST /compute/v2.1/servers/ea0bc23d-fa3a-45d4-8311-b9529203a6df/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.262320 Sep 14 09:32:23.906853 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3164/6350] 10.222.0.60 () {60 vars in 1323 bytes} [Wed Sep 14 09:32:23 2022] POST /compute/v2.1/servers/ea0bc23d-fa3a-45d4-8311-b9529203a6df/os-volume_attachments => generated 194 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:32:24.595756 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a938f4d7-14d5-428e-beaa-15a6cd0754cd tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-985036374", "imageRef": "7da805c8-3ead-48b2-a86c-34c63ebc9273", "flavorRef": "452", "networks": [{"uuid": "70503795-7dfb-4d39-a57e-91e8e5270ce0"}]}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:32:24.653407 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.network.neutron [None req-a938f4d7-14d5-428e-beaa-15a6cd0754cd tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] validate_networks() for [('70503795-7dfb-4d39-a57e-91e8e5270ce0', None, None, None, None, None)] {{(pid=128758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:32:25.042887 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-a938f4d7-14d5-428e-beaa-15a6cd0754cd tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Flavor limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:32:25.043558 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-a938f4d7-14d5-428e-beaa-15a6cd0754cd tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Image limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:32:25.044124 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-a938f4d7-14d5-428e-beaa-15a6cd0754cd tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Flavor pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:32:25.044559 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-a938f4d7-14d5-428e-beaa-15a6cd0754cd tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Image pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:32:25.044987 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-a938f4d7-14d5-428e-beaa-15a6cd0754cd tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:32:25.055491 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a938f4d7-14d5-428e-beaa-15a6cd0754cd tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:25.055989 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a938f4d7-14d5-428e-beaa-15a6cd0754cd tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:25.056438 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a938f4d7-14d5-428e-beaa-15a6cd0754cd tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:25.057186 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a938f4d7-14d5-428e-beaa-15a6cd0754cd tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:25.057653 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a938f4d7-14d5-428e-beaa-15a6cd0754cd tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:25.058089 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a938f4d7-14d5-428e-beaa-15a6cd0754cd tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:25.077240 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-a938f4d7-14d5-428e-beaa-15a6cd0754cd tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Getting quotas for project 0fca803d9ffa4b4ab0371c0d6a96a5a2. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:32:25.082510 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-a938f4d7-14d5-428e-beaa-15a6cd0754cd tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Getting quotas for user 80257054a25540c294e1787780b601b4 and project 0fca803d9ffa4b4ab0371c0d6a96a5a2. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:32:25.095838 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-a938f4d7-14d5-428e-beaa-15a6cd0754cd tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Going to run 1 instances... {{(pid=128758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:32:25.098526 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-a938f4d7-14d5-428e-beaa-15a6cd0754cd tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: c7f40b74-e569-4fe2-8227-c4c93e70d37d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='091cbc6a-02ce-4b4c-934e-e89df56ae712',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=128758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:32:25.179393 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-a938f4d7-14d5-428e-beaa-15a6cd0754cd tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.589521 Sep 14 09:32:25.186043 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3187/6351] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 09:32:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 591 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:32:25.192253 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-5b688ed5-ceff-4450-aaa7-0c8f302fd00d tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:25.193265 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-5b688ed5-ceff-4450-aaa7-0c8f302fd00d tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: c7f40b74-e569-4fe2-8227-c4c93e70d37d] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:32:25.255540 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-5b688ed5-ceff-4450-aaa7-0c8f302fd00d tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:25.264042 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-5b688ed5-ceff-4450-aaa7-0c8f302fd00d tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/c7f40b74-e569-4fe2-8227-c4c93e70d37d" status: 200 len: 1229 microversion: 2.1 time: 0.076099 Sep 14 09:32:25.264714 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3165/6352] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:32:25 2022] GET /compute/v2.1/servers/c7f40b74-e569-4fe2-8227-c4c93e70d37d => generated 1229 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:32:26.024909 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ba3400f9-f493-4032-9024-ba53512e4d7c tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:32:26.027302 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-ba3400f9-f493-4032-9024-ba53512e4d7c tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: c1297f74-578d-4a0d-8fd3-4197917a1dda] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:32:26.034352 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ba3400f9-f493-4032-9024-ba53512e4d7c tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:26.034853 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ba3400f9-f493-4032-9024-ba53512e4d7c tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:26.035405 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ba3400f9-f493-4032-9024-ba53512e4d7c tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:26.036118 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ba3400f9-f493-4032-9024-ba53512e4d7c tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:26.036590 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ba3400f9-f493-4032-9024-ba53512e4d7c tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:26.037035 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ba3400f9-f493-4032-9024-ba53512e4d7c tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:26.040929 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:32:26.111251 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-ba3400f9-f493-4032-9024-ba53512e4d7c tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "POST /compute/v2.1/servers/c1297f74-578d-4a0d-8fd3-4197917a1dda/action" status: 200 len: 24571 microversion: 2.1 time: 0.090479 Sep 14 09:32:26.118483 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3188/6353] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:32:26 2022] POST /compute/v2.1/servers/c1297f74-578d-4a0d-8fd3-4197917a1dda/action => generated 24571 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 09:32:26.290122 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-516d02c3-db93-491d-bb6d-8b812c52c8d1 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:26.290752 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-516d02c3-db93-491d-bb6d-8b812c52c8d1 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: c7f40b74-e569-4fe2-8227-c4c93e70d37d] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:32:26.299204 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-516d02c3-db93-491d-bb6d-8b812c52c8d1 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:26.299698 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-516d02c3-db93-491d-bb6d-8b812c52c8d1 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:26.300187 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-516d02c3-db93-491d-bb6d-8b812c52c8d1 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:26.300824 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-516d02c3-db93-491d-bb6d-8b812c52c8d1 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:26.301470 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-516d02c3-db93-491d-bb6d-8b812c52c8d1 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:26.302210 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-516d02c3-db93-491d-bb6d-8b812c52c8d1 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:26.309179 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:32:26.375772 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-516d02c3-db93-491d-bb6d-8b812c52c8d1 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:26.384976 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-516d02c3-db93-491d-bb6d-8b812c52c8d1 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/c7f40b74-e569-4fe2-8227-c4c93e70d37d" status: 200 len: 1299 microversion: 2.1 time: 0.101353 Sep 14 09:32:26.385898 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3166/6354] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:32:26 2022] GET /compute/v2.1/servers/c7f40b74-e569-4fe2-8227-c4c93e70d37d => generated 1299 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:32:27.408882 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-00563620-d009-424b-baa6-e2ef58e0d173 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:27.409665 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-00563620-d009-424b-baa6-e2ef58e0d173 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: c7f40b74-e569-4fe2-8227-c4c93e70d37d] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:32:27.417054 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-00563620-d009-424b-baa6-e2ef58e0d173 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:27.417828 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-00563620-d009-424b-baa6-e2ef58e0d173 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:27.418451 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-00563620-d009-424b-baa6-e2ef58e0d173 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:27.419467 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-00563620-d009-424b-baa6-e2ef58e0d173 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:27.420095 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-00563620-d009-424b-baa6-e2ef58e0d173 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:27.420759 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-00563620-d009-424b-baa6-e2ef58e0d173 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:27.636777 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-00563620-d009-424b-baa6-e2ef58e0d173 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:27.646254 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-00563620-d009-424b-baa6-e2ef58e0d173 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/c7f40b74-e569-4fe2-8227-c4c93e70d37d" status: 200 len: 1341 microversion: 2.1 time: 0.241924 Sep 14 09:32:27.647393 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3189/6355] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:32:27 2022] GET /compute/v2.1/servers/c7f40b74-e569-4fe2-8227-c4c93e70d37d => generated 1341 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:32:27.893994 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-32d2911f-994b-49f4-8956-1a1af853d488 req-4f41c63e-601a-44a9-b973-b7dbe5cbdaec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7f40b74-e569-4fe2-8227-c4c93e70d37d", "tag": "9788ede9-23f9-4eb4-88d1-b4fd26e88c11"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:32:27.905720 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-32d2911f-994b-49f4-8956-1a1af853d488 req-4f41c63e-601a-44a9-b973-b7dbe5cbdaec service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:27.906202 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-32d2911f-994b-49f4-8956-1a1af853d488 req-4f41c63e-601a-44a9-b973-b7dbe5cbdaec service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:27.906637 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-32d2911f-994b-49f4-8956-1a1af853d488 req-4f41c63e-601a-44a9-b973-b7dbe5cbdaec service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:27.936571 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-32d2911f-994b-49f4-8956-1a1af853d488 req-4f41c63e-601a-44a9-b973-b7dbe5cbdaec service nova] Creating event network-changed:9788ede9-23f9-4eb4-88d1-b4fd26e88c11 for instance c7f40b74-e569-4fe2-8227-c4c93e70d37d on n-h2-836830-18 Sep 14 09:32:27.955915 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-32d2911f-994b-49f4-8956-1a1af853d488 req-4f41c63e-601a-44a9-b973-b7dbe5cbdaec service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066671 Sep 14 09:32:27.956793 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3167/6356] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:32:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:32:28.676084 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-bac30358-5f74-40d6-a9bb-3e0ab662ebfb tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:28.677633 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-bac30358-5f74-40d6-a9bb-3e0ab662ebfb tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: c7f40b74-e569-4fe2-8227-c4c93e70d37d] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:32:28.696726 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bac30358-5f74-40d6-a9bb-3e0ab662ebfb tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:28.697247 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bac30358-5f74-40d6-a9bb-3e0ab662ebfb tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:28.697963 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bac30358-5f74-40d6-a9bb-3e0ab662ebfb tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:28.698965 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bac30358-5f74-40d6-a9bb-3e0ab662ebfb tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:28.699734 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bac30358-5f74-40d6-a9bb-3e0ab662ebfb tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:28.700352 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bac30358-5f74-40d6-a9bb-3e0ab662ebfb tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:28.852896 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-bac30358-5f74-40d6-a9bb-3e0ab662ebfb tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:28.863015 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-bac30358-5f74-40d6-a9bb-3e0ab662ebfb tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/c7f40b74-e569-4fe2-8227-c4c93e70d37d" status: 200 len: 1341 microversion: 2.1 time: 0.196733 Sep 14 09:32:28.865072 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3190/6357] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:32:28 2022] GET /compute/v2.1/servers/c7f40b74-e569-4fe2-8227-c4c93e70d37d => generated 1341 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:32:29.886202 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b186d9c3-7dc6-4d61-af12-3b34c3087a39 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:29.886873 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b186d9c3-7dc6-4d61-af12-3b34c3087a39 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: c7f40b74-e569-4fe2-8227-c4c93e70d37d] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:32:29.894533 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b186d9c3-7dc6-4d61-af12-3b34c3087a39 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:29.895052 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b186d9c3-7dc6-4d61-af12-3b34c3087a39 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:29.895496 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b186d9c3-7dc6-4d61-af12-3b34c3087a39 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:29.896198 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b186d9c3-7dc6-4d61-af12-3b34c3087a39 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:29.896655 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b186d9c3-7dc6-4d61-af12-3b34c3087a39 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:29.897090 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b186d9c3-7dc6-4d61-af12-3b34c3087a39 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:30.038694 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b186d9c3-7dc6-4d61-af12-3b34c3087a39 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:30.055281 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b186d9c3-7dc6-4d61-af12-3b34c3087a39 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/c7f40b74-e569-4fe2-8227-c4c93e70d37d" status: 200 len: 1341 microversion: 2.1 time: 0.173278 Sep 14 09:32:30.055962 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3168/6358] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:32:29 2022] GET /compute/v2.1/servers/c7f40b74-e569-4fe2-8227-c4c93e70d37d => generated 1341 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:32:31.083812 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-75f45d3e-87dd-44e2-94da-e538359ec2c5 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:31.087555 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-75f45d3e-87dd-44e2-94da-e538359ec2c5 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: c7f40b74-e569-4fe2-8227-c4c93e70d37d] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:32:31.091630 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=6 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:32:31.106014 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-75f45d3e-87dd-44e2-94da-e538359ec2c5 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:31.107376 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-75f45d3e-87dd-44e2-94da-e538359ec2c5 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:31.108297 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-75f45d3e-87dd-44e2-94da-e538359ec2c5 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:31.109422 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-75f45d3e-87dd-44e2-94da-e538359ec2c5 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:31.110011 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-75f45d3e-87dd-44e2-94da-e538359ec2c5 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:31.110454 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-75f45d3e-87dd-44e2-94da-e538359ec2c5 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:31.284894 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-75f45d3e-87dd-44e2-94da-e538359ec2c5 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:31.293602 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-75f45d3e-87dd-44e2-94da-e538359ec2c5 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/c7f40b74-e569-4fe2-8227-c4c93e70d37d" status: 200 len: 1341 microversion: 2.1 time: 0.217446 Sep 14 09:32:31.294185 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3191/6359] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:32:31 2022] GET /compute/v2.1/servers/c7f40b74-e569-4fe2-8227-c4c93e70d37d => generated 1341 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:32:32.327188 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-fa3d871f-94cc-4dcf-a597-51b9844233f4 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:32.329771 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-fa3d871f-94cc-4dcf-a597-51b9844233f4 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: c7f40b74-e569-4fe2-8227-c4c93e70d37d] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:32:32.335095 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:32:32.347758 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fa3d871f-94cc-4dcf-a597-51b9844233f4 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:32.351519 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fa3d871f-94cc-4dcf-a597-51b9844233f4 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:32.352100 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fa3d871f-94cc-4dcf-a597-51b9844233f4 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:32.353244 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fa3d871f-94cc-4dcf-a597-51b9844233f4 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:32.353965 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fa3d871f-94cc-4dcf-a597-51b9844233f4 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:32.354820 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fa3d871f-94cc-4dcf-a597-51b9844233f4 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:32.524228 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-fa3d871f-94cc-4dcf-a597-51b9844233f4 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:32.533448 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-fa3d871f-94cc-4dcf-a597-51b9844233f4 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/c7f40b74-e569-4fe2-8227-c4c93e70d37d" status: 200 len: 1341 microversion: 2.1 time: 0.217009 Sep 14 09:32:32.534045 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3169/6360] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:32:32 2022] GET /compute/v2.1/servers/c7f40b74-e569-4fe2-8227-c4c93e70d37d => generated 1341 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:32:33.577285 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-bf13acf0-97d5-428f-a621-c9bfc4f8f50c tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:33.578051 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-bf13acf0-97d5-428f-a621-c9bfc4f8f50c tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: c7f40b74-e569-4fe2-8227-c4c93e70d37d] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:32:33.585934 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bf13acf0-97d5-428f-a621-c9bfc4f8f50c tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:33.586447 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bf13acf0-97d5-428f-a621-c9bfc4f8f50c tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:33.586908 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bf13acf0-97d5-428f-a621-c9bfc4f8f50c tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:33.587949 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bf13acf0-97d5-428f-a621-c9bfc4f8f50c tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:33.588431 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bf13acf0-97d5-428f-a621-c9bfc4f8f50c tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:33.588862 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bf13acf0-97d5-428f-a621-c9bfc4f8f50c tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:33.754058 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-bf13acf0-97d5-428f-a621-c9bfc4f8f50c tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:33.762013 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-bf13acf0-97d5-428f-a621-c9bfc4f8f50c tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/c7f40b74-e569-4fe2-8227-c4c93e70d37d" status: 200 len: 1341 microversion: 2.1 time: 0.198943 Sep 14 09:32:33.762601 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3192/6361] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:32:33 2022] GET /compute/v2.1/servers/c7f40b74-e569-4fe2-8227-c4c93e70d37d => generated 1341 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:32:34.786518 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b4712350-82c1-4e8e-845d-d7fb33707358 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:34.787194 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b4712350-82c1-4e8e-845d-d7fb33707358 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: c7f40b74-e569-4fe2-8227-c4c93e70d37d] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:32:34.799372 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b4712350-82c1-4e8e-845d-d7fb33707358 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:34.799876 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b4712350-82c1-4e8e-845d-d7fb33707358 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:34.800432 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b4712350-82c1-4e8e-845d-d7fb33707358 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:34.801168 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b4712350-82c1-4e8e-845d-d7fb33707358 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:34.805791 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b4712350-82c1-4e8e-845d-d7fb33707358 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:34.806234 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b4712350-82c1-4e8e-845d-d7fb33707358 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:34.973226 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b4712350-82c1-4e8e-845d-d7fb33707358 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:34.983824 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b4712350-82c1-4e8e-845d-d7fb33707358 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/c7f40b74-e569-4fe2-8227-c4c93e70d37d" status: 200 len: 1341 microversion: 2.1 time: 0.200509 Sep 14 09:32:34.983824 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3170/6362] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:32:34 2022] GET /compute/v2.1/servers/c7f40b74-e569-4fe2-8227-c4c93e70d37d => generated 1341 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:32:36.007764 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-f99273c8-e638-4539-8204-96af0d184d29 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:36.008471 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-f99273c8-e638-4539-8204-96af0d184d29 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: c7f40b74-e569-4fe2-8227-c4c93e70d37d] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:32:36.012705 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=2 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:32:36.013447 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=6 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:32:36.021855 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f99273c8-e638-4539-8204-96af0d184d29 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:36.022365 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f99273c8-e638-4539-8204-96af0d184d29 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:36.022823 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f99273c8-e638-4539-8204-96af0d184d29 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:36.023586 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f99273c8-e638-4539-8204-96af0d184d29 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:36.024063 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f99273c8-e638-4539-8204-96af0d184d29 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:36.024508 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f99273c8-e638-4539-8204-96af0d184d29 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:36.180799 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-f99273c8-e638-4539-8204-96af0d184d29 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:36.189077 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-f99273c8-e638-4539-8204-96af0d184d29 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/c7f40b74-e569-4fe2-8227-c4c93e70d37d" status: 200 len: 1341 microversion: 2.1 time: 0.185821 Sep 14 09:32:36.189908 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3193/6363] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:32:36 2022] GET /compute/v2.1/servers/c7f40b74-e569-4fe2-8227-c4c93e70d37d => generated 1341 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:32:37.212537 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d1879215-1909-4a1c-89e6-82fff91fd9a7 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:37.213261 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-d1879215-1909-4a1c-89e6-82fff91fd9a7 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: c7f40b74-e569-4fe2-8227-c4c93e70d37d] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:32:37.218971 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=2 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:32:37.222325 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d1879215-1909-4a1c-89e6-82fff91fd9a7 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:37.223217 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d1879215-1909-4a1c-89e6-82fff91fd9a7 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:37.223859 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d1879215-1909-4a1c-89e6-82fff91fd9a7 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:37.224744 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d1879215-1909-4a1c-89e6-82fff91fd9a7 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:37.225279 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d1879215-1909-4a1c-89e6-82fff91fd9a7 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:37.225892 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d1879215-1909-4a1c-89e6-82fff91fd9a7 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:37.381774 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-d1879215-1909-4a1c-89e6-82fff91fd9a7 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:37.390093 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d1879215-1909-4a1c-89e6-82fff91fd9a7 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/c7f40b74-e569-4fe2-8227-c4c93e70d37d" status: 200 len: 1341 microversion: 2.1 time: 0.181764 Sep 14 09:32:37.391341 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3171/6364] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:32:37 2022] GET /compute/v2.1/servers/c7f40b74-e569-4fe2-8227-c4c93e70d37d => generated 1341 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:32:38.414012 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-9cca4320-8597-41b9-8aad-116d6b0f563d tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:38.414977 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-9cca4320-8597-41b9-8aad-116d6b0f563d tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: c7f40b74-e569-4fe2-8227-c4c93e70d37d] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:32:38.422541 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9cca4320-8597-41b9-8aad-116d6b0f563d tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:38.423782 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9cca4320-8597-41b9-8aad-116d6b0f563d tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:38.424366 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9cca4320-8597-41b9-8aad-116d6b0f563d tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:38.425391 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9cca4320-8597-41b9-8aad-116d6b0f563d tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:38.425998 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9cca4320-8597-41b9-8aad-116d6b0f563d tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:38.426552 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9cca4320-8597-41b9-8aad-116d6b0f563d tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:38.577945 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-9cca4320-8597-41b9-8aad-116d6b0f563d tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:38.591613 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-9cca4320-8597-41b9-8aad-116d6b0f563d tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/c7f40b74-e569-4fe2-8227-c4c93e70d37d" status: 200 len: 1341 microversion: 2.1 time: 0.179172 Sep 14 09:32:38.593071 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3194/6365] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:32:38 2022] GET /compute/v2.1/servers/c7f40b74-e569-4fe2-8227-c4c93e70d37d => generated 1341 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:32:39.617961 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-7167848c-3e74-46de-b010-2767f39785be tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:39.619773 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-7167848c-3e74-46de-b010-2767f39785be tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: c7f40b74-e569-4fe2-8227-c4c93e70d37d] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:32:39.642510 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7167848c-3e74-46de-b010-2767f39785be tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:39.643508 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7167848c-3e74-46de-b010-2767f39785be tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:39.643980 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7167848c-3e74-46de-b010-2767f39785be tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:39.644754 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7167848c-3e74-46de-b010-2767f39785be tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:39.645211 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7167848c-3e74-46de-b010-2767f39785be tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:39.645643 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7167848c-3e74-46de-b010-2767f39785be tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:39.800795 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-7167848c-3e74-46de-b010-2767f39785be tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:39.810246 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-7167848c-3e74-46de-b010-2767f39785be tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/c7f40b74-e569-4fe2-8227-c4c93e70d37d" status: 200 len: 1341 microversion: 2.1 time: 0.197764 Sep 14 09:32:39.811455 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3172/6366] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:32:39 2022] GET /compute/v2.1/servers/c7f40b74-e569-4fe2-8227-c4c93e70d37d => generated 1341 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:32:40.834448 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-e35980d4-67e6-4814-b460-9da563097da9 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:40.835017 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-e35980d4-67e6-4814-b460-9da563097da9 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: c7f40b74-e569-4fe2-8227-c4c93e70d37d] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:32:40.842439 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e35980d4-67e6-4814-b460-9da563097da9 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:40.843216 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e35980d4-67e6-4814-b460-9da563097da9 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:40.843903 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e35980d4-67e6-4814-b460-9da563097da9 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:40.844641 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e35980d4-67e6-4814-b460-9da563097da9 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:40.845654 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e35980d4-67e6-4814-b460-9da563097da9 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:40.846101 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e35980d4-67e6-4814-b460-9da563097da9 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:41.031881 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-e35980d4-67e6-4814-b460-9da563097da9 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:41.042966 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-e35980d4-67e6-4814-b460-9da563097da9 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/c7f40b74-e569-4fe2-8227-c4c93e70d37d" status: 200 len: 1341 microversion: 2.1 time: 0.212585 Sep 14 09:32:41.044153 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3195/6367] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:32:40 2022] GET /compute/v2.1/servers/c7f40b74-e569-4fe2-8227-c4c93e70d37d => generated 1341 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:32:42.069551 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e5e85add-f97a-4f38-8c24-5169e404829c tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:42.070121 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e5e85add-f97a-4f38-8c24-5169e404829c tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: c7f40b74-e569-4fe2-8227-c4c93e70d37d] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:32:42.077580 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e5e85add-f97a-4f38-8c24-5169e404829c tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:42.078076 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e5e85add-f97a-4f38-8c24-5169e404829c tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:42.078518 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e5e85add-f97a-4f38-8c24-5169e404829c tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:42.079253 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e5e85add-f97a-4f38-8c24-5169e404829c tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:42.079715 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e5e85add-f97a-4f38-8c24-5169e404829c tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:42.080149 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e5e85add-f97a-4f38-8c24-5169e404829c tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:42.219490 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-e5e85add-f97a-4f38-8c24-5169e404829c tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:42.228362 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e5e85add-f97a-4f38-8c24-5169e404829c tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/c7f40b74-e569-4fe2-8227-c4c93e70d37d" status: 200 len: 1375 microversion: 2.1 time: 0.164488 Sep 14 09:32:42.228968 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3173/6368] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:32:42 2022] GET /compute/v2.1/servers/c7f40b74-e569-4fe2-8227-c4c93e70d37d => generated 1375 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:32:43.253517 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-45d30964-57f3-4613-bd06-9c3a06d37223 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:43.254328 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-45d30964-57f3-4613-bd06-9c3a06d37223 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: c7f40b74-e569-4fe2-8227-c4c93e70d37d] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:32:43.261480 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-45d30964-57f3-4613-bd06-9c3a06d37223 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:43.262032 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-45d30964-57f3-4613-bd06-9c3a06d37223 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:43.262649 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-45d30964-57f3-4613-bd06-9c3a06d37223 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:43.263435 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-45d30964-57f3-4613-bd06-9c3a06d37223 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:43.263992 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-45d30964-57f3-4613-bd06-9c3a06d37223 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:43.264534 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-45d30964-57f3-4613-bd06-9c3a06d37223 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:43.412198 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-45d30964-57f3-4613-bd06-9c3a06d37223 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:43.423967 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-45d30964-57f3-4613-bd06-9c3a06d37223 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/c7f40b74-e569-4fe2-8227-c4c93e70d37d" status: 200 len: 1375 microversion: 2.1 time: 0.173810 Sep 14 09:32:43.424584 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3196/6369] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:32:43 2022] GET /compute/v2.1/servers/c7f40b74-e569-4fe2-8227-c4c93e70d37d => generated 1375 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:32:44.447433 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-2fb2ba4b-b4a8-4106-b734-888a3f98bf7d tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:44.448084 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-2fb2ba4b-b4a8-4106-b734-888a3f98bf7d tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: c7f40b74-e569-4fe2-8227-c4c93e70d37d] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:32:44.456521 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2fb2ba4b-b4a8-4106-b734-888a3f98bf7d tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:44.457013 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2fb2ba4b-b4a8-4106-b734-888a3f98bf7d tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:44.457453 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2fb2ba4b-b4a8-4106-b734-888a3f98bf7d tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:44.458165 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2fb2ba4b-b4a8-4106-b734-888a3f98bf7d tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:44.458604 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2fb2ba4b-b4a8-4106-b734-888a3f98bf7d tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:44.459057 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2fb2ba4b-b4a8-4106-b734-888a3f98bf7d tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:44.620065 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-2fb2ba4b-b4a8-4106-b734-888a3f98bf7d tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:44.628944 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-2fb2ba4b-b4a8-4106-b734-888a3f98bf7d tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/c7f40b74-e569-4fe2-8227-c4c93e70d37d" status: 200 len: 1375 microversion: 2.1 time: 0.185939 Sep 14 09:32:44.629595 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3174/6370] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:32:44 2022] GET /compute/v2.1/servers/c7f40b74-e569-4fe2-8227-c4c93e70d37d => generated 1375 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:32:45.653747 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-737b271d-0559-48e6-880e-aedd387329a3 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:45.654349 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-737b271d-0559-48e6-880e-aedd387329a3 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: c7f40b74-e569-4fe2-8227-c4c93e70d37d] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:32:45.662096 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-737b271d-0559-48e6-880e-aedd387329a3 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:45.662646 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-737b271d-0559-48e6-880e-aedd387329a3 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:45.663183 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-737b271d-0559-48e6-880e-aedd387329a3 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:45.664037 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-737b271d-0559-48e6-880e-aedd387329a3 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:45.664534 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-737b271d-0559-48e6-880e-aedd387329a3 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:45.665046 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-737b271d-0559-48e6-880e-aedd387329a3 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:45.801743 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-737b271d-0559-48e6-880e-aedd387329a3 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:45.809533 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-737b271d-0559-48e6-880e-aedd387329a3 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/c7f40b74-e569-4fe2-8227-c4c93e70d37d" status: 200 len: 1375 microversion: 2.1 time: 0.160222 Sep 14 09:32:45.810110 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3197/6371] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:32:45 2022] GET /compute/v2.1/servers/c7f40b74-e569-4fe2-8227-c4c93e70d37d => generated 1375 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:32:46.835532 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b9189efb-a79b-498e-b5e0-4139f63168f9 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:46.836077 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b9189efb-a79b-498e-b5e0-4139f63168f9 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: c7f40b74-e569-4fe2-8227-c4c93e70d37d] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:32:46.845274 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b9189efb-a79b-498e-b5e0-4139f63168f9 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:46.845841 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b9189efb-a79b-498e-b5e0-4139f63168f9 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:46.846521 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b9189efb-a79b-498e-b5e0-4139f63168f9 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:46.847459 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b9189efb-a79b-498e-b5e0-4139f63168f9 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:46.848014 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b9189efb-a79b-498e-b5e0-4139f63168f9 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:46.848574 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b9189efb-a79b-498e-b5e0-4139f63168f9 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:47.005529 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b9189efb-a79b-498e-b5e0-4139f63168f9 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:47.015445 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b9189efb-a79b-498e-b5e0-4139f63168f9 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/c7f40b74-e569-4fe2-8227-c4c93e70d37d" status: 200 len: 1375 microversion: 2.1 time: 0.185733 Sep 14 09:32:47.016416 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3175/6372] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:32:46 2022] GET /compute/v2.1/servers/c7f40b74-e569-4fe2-8227-c4c93e70d37d => generated 1375 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:32:48.041518 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c5e27c95-27d7-4aad-914a-65690b816953 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:48.042144 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-c5e27c95-27d7-4aad-914a-65690b816953 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: c7f40b74-e569-4fe2-8227-c4c93e70d37d] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:32:48.048883 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c5e27c95-27d7-4aad-914a-65690b816953 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:48.049377 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c5e27c95-27d7-4aad-914a-65690b816953 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:48.049824 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c5e27c95-27d7-4aad-914a-65690b816953 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:48.050526 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c5e27c95-27d7-4aad-914a-65690b816953 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:48.051015 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c5e27c95-27d7-4aad-914a-65690b816953 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:48.051454 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c5e27c95-27d7-4aad-914a-65690b816953 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:48.058698 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c4c9a792-74dc-40fc-8fb4-3f1cd9fa13c0 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:48.059427 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-c4c9a792-74dc-40fc-8fb4-3f1cd9fa13c0 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] [instance: ea0bc23d-fa3a-45d4-8311-b9529203a6df] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:32:48.066612 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c4c9a792-74dc-40fc-8fb4-3f1cd9fa13c0 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:48.067148 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c4c9a792-74dc-40fc-8fb4-3f1cd9fa13c0 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:48.067595 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c4c9a792-74dc-40fc-8fb4-3f1cd9fa13c0 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:48.068295 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c4c9a792-74dc-40fc-8fb4-3f1cd9fa13c0 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:48.068753 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c4c9a792-74dc-40fc-8fb4-3f1cd9fa13c0 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:48.069183 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c4c9a792-74dc-40fc-8fb4-3f1cd9fa13c0 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:48.160109 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.objects.instance [None req-c4c9a792-74dc-40fc-8fb4-3f1cd9fa13c0 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Lazy-loading 'services' on Instance uuid ea0bc23d-fa3a-45d4-8311-b9529203a6df {{(pid=128759) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:32:48.191714 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-c5e27c95-27d7-4aad-914a-65690b816953 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:48.199950 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-c5e27c95-27d7-4aad-914a-65690b816953 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/c7f40b74-e569-4fe2-8227-c4c93e70d37d" status: 200 len: 1375 microversion: 2.1 time: 0.162267 Sep 14 09:32:48.200647 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3198/6373] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:32:48 2022] GET /compute/v2.1/servers/c7f40b74-e569-4fe2-8227-c4c93e70d37d => generated 1375 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:32:48.230745 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-c4c9a792-74dc-40fc-8fb4-3f1cd9fa13c0 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] 10.222.0.60 "DELETE /compute/v2.1/servers/ea0bc23d-fa3a-45d4-8311-b9529203a6df/os-volume_attachments/75a14cbe-c296-45d1-9563-33e8488ed635" status: 202 len: 0 microversion: 2.1 time: 0.175983 Sep 14 09:32:48.231389 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3176/6374] 10.222.0.60 () {58 vars in 1416 bytes} [Wed Sep 14 09:32:48 2022] DELETE /compute/v2.1/servers/ea0bc23d-fa3a-45d4-8311-b9529203a6df/os-volume_attachments/75a14cbe-c296-45d1-9563-33e8488ed635 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 14 09:32:49.224346 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1d70a4ae-dc99-4f25-9609-ed6f2be8c13b tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:49.224959 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-1d70a4ae-dc99-4f25-9609-ed6f2be8c13b tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: c7f40b74-e569-4fe2-8227-c4c93e70d37d] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:32:49.232361 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1d70a4ae-dc99-4f25-9609-ed6f2be8c13b tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:49.232904 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1d70a4ae-dc99-4f25-9609-ed6f2be8c13b tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:49.233363 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1d70a4ae-dc99-4f25-9609-ed6f2be8c13b tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:49.234122 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1d70a4ae-dc99-4f25-9609-ed6f2be8c13b tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:49.234600 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1d70a4ae-dc99-4f25-9609-ed6f2be8c13b tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:49.235074 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1d70a4ae-dc99-4f25-9609-ed6f2be8c13b tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:49.460278 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-1d70a4ae-dc99-4f25-9609-ed6f2be8c13b tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:49.476789 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-1d70a4ae-dc99-4f25-9609-ed6f2be8c13b tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/c7f40b74-e569-4fe2-8227-c4c93e70d37d" status: 200 len: 1375 microversion: 2.1 time: 0.257108 Sep 14 09:32:49.477400 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3199/6375] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:32:49 2022] GET /compute/v2.1/servers/c7f40b74-e569-4fe2-8227-c4c93e70d37d => generated 1375 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:32:50.503510 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8bb252b2-eba9-4026-ad9d-4ced0bd117b7 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:50.504399 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-8bb252b2-eba9-4026-ad9d-4ced0bd117b7 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: c7f40b74-e569-4fe2-8227-c4c93e70d37d] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:32:50.511885 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8bb252b2-eba9-4026-ad9d-4ced0bd117b7 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:50.512669 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8bb252b2-eba9-4026-ad9d-4ced0bd117b7 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:50.513297 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8bb252b2-eba9-4026-ad9d-4ced0bd117b7 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:50.514122 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8bb252b2-eba9-4026-ad9d-4ced0bd117b7 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:50.514794 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8bb252b2-eba9-4026-ad9d-4ced0bd117b7 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:50.515365 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8bb252b2-eba9-4026-ad9d-4ced0bd117b7 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:50.629068 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-7f3a5b2a-d267-4efa-8b68-f9fe081e1a56 req-600b4362-07b1-433e-8a8a-ae75c97c6971 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7f40b74-e569-4fe2-8227-c4c93e70d37d", "name": "network-vif-plugged", "status": "completed", "tag": "9788ede9-23f9-4eb4-88d1-b4fd26e88c11"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:32:50.645025 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-7f3a5b2a-d267-4efa-8b68-f9fe081e1a56 req-600b4362-07b1-433e-8a8a-ae75c97c6971 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:50.645025 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-7f3a5b2a-d267-4efa-8b68-f9fe081e1a56 req-600b4362-07b1-433e-8a8a-ae75c97c6971 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:50.645025 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-7f3a5b2a-d267-4efa-8b68-f9fe081e1a56 req-600b4362-07b1-433e-8a8a-ae75c97c6971 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:50.659514 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-7f3a5b2a-d267-4efa-8b68-f9fe081e1a56 req-600b4362-07b1-433e-8a8a-ae75c97c6971 service nova] Creating event network-vif-plugged:9788ede9-23f9-4eb4-88d1-b4fd26e88c11 for instance c7f40b74-e569-4fe2-8227-c4c93e70d37d on n-h2-836830-18 Sep 14 09:32:50.665352 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-7f3a5b2a-d267-4efa-8b68-f9fe081e1a56 req-600b4362-07b1-433e-8a8a-ae75c97c6971 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041266 Sep 14 09:32:50.666546 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3200/6376] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:32:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:32:50.712735 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-8bb252b2-eba9-4026-ad9d-4ced0bd117b7 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:50.732037 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-8bb252b2-eba9-4026-ad9d-4ced0bd117b7 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/c7f40b74-e569-4fe2-8227-c4c93e70d37d" status: 200 len: 1375 microversion: 2.1 time: 0.234168 Sep 14 09:32:50.733047 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3177/6377] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:32:50 2022] GET /compute/v2.1/servers/c7f40b74-e569-4fe2-8227-c4c93e70d37d => generated 1375 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:32:51.758624 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-76fab3a8-2311-4fce-a397-6050b98823f9 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:51.759297 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-76fab3a8-2311-4fce-a397-6050b98823f9 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: c7f40b74-e569-4fe2-8227-c4c93e70d37d] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:32:51.766441 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-76fab3a8-2311-4fce-a397-6050b98823f9 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:51.767127 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-76fab3a8-2311-4fce-a397-6050b98823f9 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:51.767550 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-76fab3a8-2311-4fce-a397-6050b98823f9 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:51.768423 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-76fab3a8-2311-4fce-a397-6050b98823f9 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:51.768912 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-76fab3a8-2311-4fce-a397-6050b98823f9 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:51.769492 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-76fab3a8-2311-4fce-a397-6050b98823f9 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:51.951190 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-76fab3a8-2311-4fce-a397-6050b98823f9 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:51.960426 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-76fab3a8-2311-4fce-a397-6050b98823f9 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/c7f40b74-e569-4fe2-8227-c4c93e70d37d" status: 200 len: 1375 microversion: 2.1 time: 0.207096 Sep 14 09:32:51.961040 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3201/6378] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:32:51 2022] GET /compute/v2.1/servers/c7f40b74-e569-4fe2-8227-c4c93e70d37d => generated 1375 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:32:52.982721 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-86281abd-78bf-4fed-bcfc-9f53feda8461 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:52.983419 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-86281abd-78bf-4fed-bcfc-9f53feda8461 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: c7f40b74-e569-4fe2-8227-c4c93e70d37d] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:32:52.990207 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-86281abd-78bf-4fed-bcfc-9f53feda8461 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:52.990722 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-86281abd-78bf-4fed-bcfc-9f53feda8461 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:52.991214 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-86281abd-78bf-4fed-bcfc-9f53feda8461 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:52.992137 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-86281abd-78bf-4fed-bcfc-9f53feda8461 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:52.992606 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-86281abd-78bf-4fed-bcfc-9f53feda8461 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:52.993133 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-86281abd-78bf-4fed-bcfc-9f53feda8461 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:53.144581 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-86281abd-78bf-4fed-bcfc-9f53feda8461 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:53.152377 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-86281abd-78bf-4fed-bcfc-9f53feda8461 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/c7f40b74-e569-4fe2-8227-c4c93e70d37d" status: 200 len: 1560 microversion: 2.1 time: 0.173587 Sep 14 09:32:53.153044 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3178/6379] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:32:52 2022] GET /compute/v2.1/servers/c7f40b74-e569-4fe2-8227-c4c93e70d37d => generated 1560 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:32:53.179168 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-f9691707-19c5-4c77-9a69-573526bf438c tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:53.179834 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-f9691707-19c5-4c77-9a69-573526bf438c tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: c7f40b74-e569-4fe2-8227-c4c93e70d37d] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:32:53.186677 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f9691707-19c5-4c77-9a69-573526bf438c tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:53.187386 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f9691707-19c5-4c77-9a69-573526bf438c tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:53.187898 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f9691707-19c5-4c77-9a69-573526bf438c tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:53.188759 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f9691707-19c5-4c77-9a69-573526bf438c tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:53.189911 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f9691707-19c5-4c77-9a69-573526bf438c tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:53.190497 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f9691707-19c5-4c77-9a69-573526bf438c tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:53.339860 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-f9691707-19c5-4c77-9a69-573526bf438c tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:53.348765 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-f9691707-19c5-4c77-9a69-573526bf438c tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/c7f40b74-e569-4fe2-8227-c4c93e70d37d" status: 200 len: 1560 microversion: 2.1 time: 0.173890 Sep 14 09:32:53.349559 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3202/6380] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:32:53 2022] GET /compute/v2.1/servers/c7f40b74-e569-4fe2-8227-c4c93e70d37d => generated 1560 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:32:53.436868 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-4dacaa20-67c3-4877-a8d1-67cd37d1dc58 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:53.437377 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-4dacaa20-67c3-4877-a8d1-67cd37d1dc58 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: c7f40b74-e569-4fe2-8227-c4c93e70d37d] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:32:53.444805 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4dacaa20-67c3-4877-a8d1-67cd37d1dc58 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:53.445440 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4dacaa20-67c3-4877-a8d1-67cd37d1dc58 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:53.445891 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4dacaa20-67c3-4877-a8d1-67cd37d1dc58 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:53.446638 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4dacaa20-67c3-4877-a8d1-67cd37d1dc58 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:53.447194 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4dacaa20-67c3-4877-a8d1-67cd37d1dc58 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:53.447640 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4dacaa20-67c3-4877-a8d1-67cd37d1dc58 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:53.477532 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-4dacaa20-67c3-4877-a8d1-67cd37d1dc58 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: c7f40b74-e569-4fe2-8227-c4c93e70d37d] Going to try to terminate instance {{(pid=128759) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:32:53.575013 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-4dacaa20-67c3-4877-a8d1-67cd37d1dc58 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "DELETE /compute/v2.1/servers/c7f40b74-e569-4fe2-8227-c4c93e70d37d" status: 204 len: 0 microversion: 2.1 time: 0.139926 Sep 14 09:32:53.577948 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3179/6381] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:32:53 2022] DELETE /compute/v2.1/servers/c7f40b74-e569-4fe2-8227-c4c93e70d37d => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 14 09:32:53.583511 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-844e4560-51da-461c-9920-06537555cd04 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:53.584312 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-844e4560-51da-461c-9920-06537555cd04 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: c7f40b74-e569-4fe2-8227-c4c93e70d37d] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:32:53.591148 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-844e4560-51da-461c-9920-06537555cd04 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:53.591727 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-844e4560-51da-461c-9920-06537555cd04 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:53.592446 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-844e4560-51da-461c-9920-06537555cd04 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:53.593505 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-844e4560-51da-461c-9920-06537555cd04 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:53.594243 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-844e4560-51da-461c-9920-06537555cd04 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:53.594902 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-844e4560-51da-461c-9920-06537555cd04 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:53.650974 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8b9551d0-7231-4ab8-90b3-ff1c47dbac04 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:53.650974 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-8b9551d0-7231-4ab8-90b3-ff1c47dbac04 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] [instance: ea0bc23d-fa3a-45d4-8311-b9529203a6df] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:32:53.654631 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8b9551d0-7231-4ab8-90b3-ff1c47dbac04 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:53.655128 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8b9551d0-7231-4ab8-90b3-ff1c47dbac04 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:53.655575 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8b9551d0-7231-4ab8-90b3-ff1c47dbac04 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:53.656302 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8b9551d0-7231-4ab8-90b3-ff1c47dbac04 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:53.656764 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8b9551d0-7231-4ab8-90b3-ff1c47dbac04 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:53.657224 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8b9551d0-7231-4ab8-90b3-ff1c47dbac04 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:53.687533 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-8b9551d0-7231-4ab8-90b3-ff1c47dbac04 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] [instance: ea0bc23d-fa3a-45d4-8311-b9529203a6df] Going to try to terminate instance {{(pid=128759) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:32:53.728279 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:32:53.795834 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-844e4560-51da-461c-9920-06537555cd04 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:53.796868 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-8b9551d0-7231-4ab8-90b3-ff1c47dbac04 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] 10.222.0.60 "DELETE /compute/v2.1/servers/ea0bc23d-fa3a-45d4-8311-b9529203a6df" status: 204 len: 0 microversion: 2.1 time: 0.153717 Sep 14 09:32:53.797736 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3180/6382] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:32:53 2022] DELETE /compute/v2.1/servers/ea0bc23d-fa3a-45d4-8311-b9529203a6df => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:32:53.807022 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-844e4560-51da-461c-9920-06537555cd04 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/c7f40b74-e569-4fe2-8227-c4c93e70d37d" status: 200 len: 1566 microversion: 2.1 time: 0.227844 Sep 14 09:32:53.807734 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3203/6383] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:32:53 2022] GET /compute/v2.1/servers/c7f40b74-e569-4fe2-8227-c4c93e70d37d => generated 1566 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:32:53.808800 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-4d032c02-4c71-4d16-999e-267ba87a769f tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:53.809692 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-4d032c02-4c71-4d16-999e-267ba87a769f tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] [instance: ea0bc23d-fa3a-45d4-8311-b9529203a6df] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:32:53.817675 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4d032c02-4c71-4d16-999e-267ba87a769f tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:53.818179 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4d032c02-4c71-4d16-999e-267ba87a769f tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:53.818729 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4d032c02-4c71-4d16-999e-267ba87a769f tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:53.820244 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4d032c02-4c71-4d16-999e-267ba87a769f tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:53.820840 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4d032c02-4c71-4d16-999e-267ba87a769f tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:53.821275 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4d032c02-4c71-4d16-999e-267ba87a769f tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:53.977502 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-4d032c02-4c71-4d16-999e-267ba87a769f tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddfe63b5ac0d421392a768f97ce4bfbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a11896b0244a4f1e859986b87a17affd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:53.986619 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-4d032c02-4c71-4d16-999e-267ba87a769f tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] 10.222.0.60 "GET /compute/v2.1/servers/ea0bc23d-fa3a-45d4-8311-b9529203a6df" status: 200 len: 1514 microversion: 2.1 time: 0.183170 Sep 14 09:32:53.987381 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3181/6384] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:32:53 2022] GET /compute/v2.1/servers/ea0bc23d-fa3a-45d4-8311-b9529203a6df => generated 1514 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:32:54.832476 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-4eff2c3f-7b0b-47c4-afa7-66ecb5a295e5 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:54.833115 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-4eff2c3f-7b0b-47c4-afa7-66ecb5a295e5 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: c7f40b74-e569-4fe2-8227-c4c93e70d37d] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:32:54.841745 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4eff2c3f-7b0b-47c4-afa7-66ecb5a295e5 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:54.842254 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4eff2c3f-7b0b-47c4-afa7-66ecb5a295e5 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:54.842799 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4eff2c3f-7b0b-47c4-afa7-66ecb5a295e5 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:54.843789 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4eff2c3f-7b0b-47c4-afa7-66ecb5a295e5 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:54.844276 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4eff2c3f-7b0b-47c4-afa7-66ecb5a295e5 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:54.844747 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4eff2c3f-7b0b-47c4-afa7-66ecb5a295e5 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:54.982724 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-4eff2c3f-7b0b-47c4-afa7-66ecb5a295e5 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:54.991986 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-4eff2c3f-7b0b-47c4-afa7-66ecb5a295e5 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/c7f40b74-e569-4fe2-8227-c4c93e70d37d" status: 200 len: 1566 microversion: 2.1 time: 0.164061 Sep 14 09:32:54.992585 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3204/6385] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:32:54 2022] GET /compute/v2.1/servers/c7f40b74-e569-4fe2-8227-c4c93e70d37d => generated 1566 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:32:55.009593 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-2899b035-9634-4f1c-aedd-5be6ce4fe0c5 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:55.010211 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-2899b035-9634-4f1c-aedd-5be6ce4fe0c5 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] [instance: ea0bc23d-fa3a-45d4-8311-b9529203a6df] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:32:55.017047 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2899b035-9634-4f1c-aedd-5be6ce4fe0c5 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:55.017527 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2899b035-9634-4f1c-aedd-5be6ce4fe0c5 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:55.017962 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2899b035-9634-4f1c-aedd-5be6ce4fe0c5 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:55.018641 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2899b035-9634-4f1c-aedd-5be6ce4fe0c5 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:55.019129 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2899b035-9634-4f1c-aedd-5be6ce4fe0c5 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:55.019552 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2899b035-9634-4f1c-aedd-5be6ce4fe0c5 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:55.147402 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-2899b035-9634-4f1c-aedd-5be6ce4fe0c5 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddfe63b5ac0d421392a768f97ce4bfbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a11896b0244a4f1e859986b87a17affd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:55.155263 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-2899b035-9634-4f1c-aedd-5be6ce4fe0c5 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] 10.222.0.60 "GET /compute/v2.1/servers/ea0bc23d-fa3a-45d4-8311-b9529203a6df" status: 200 len: 1514 microversion: 2.1 time: 0.149394 Sep 14 09:32:55.155835 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3182/6386] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:32:55 2022] GET /compute/v2.1/servers/ea0bc23d-fa3a-45d4-8311-b9529203a6df => generated 1514 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:32:56.016442 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-3885c938-1ecb-4e59-a486-be58bf8e8d60 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:56.017076 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-3885c938-1ecb-4e59-a486-be58bf8e8d60 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: c7f40b74-e569-4fe2-8227-c4c93e70d37d] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:32:56.024245 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3885c938-1ecb-4e59-a486-be58bf8e8d60 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:56.024900 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3885c938-1ecb-4e59-a486-be58bf8e8d60 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:56.025410 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3885c938-1ecb-4e59-a486-be58bf8e8d60 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:56.026265 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3885c938-1ecb-4e59-a486-be58bf8e8d60 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:56.026725 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3885c938-1ecb-4e59-a486-be58bf8e8d60 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:56.027210 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3885c938-1ecb-4e59-a486-be58bf8e8d60 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:56.168652 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-3885c938-1ecb-4e59-a486-be58bf8e8d60 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:56.171044 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=99 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:32:56.179875 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-3885c938-1ecb-4e59-a486-be58bf8e8d60 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/c7f40b74-e569-4fe2-8227-c4c93e70d37d" status: 200 len: 1566 microversion: 2.1 time: 0.165917 Sep 14 09:32:56.180118 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-642b3933-df48-404e-91f0-1b3a6f684023 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:56.180557 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3205/6387] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:32:56 2022] GET /compute/v2.1/servers/c7f40b74-e569-4fe2-8227-c4c93e70d37d => generated 1566 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:32:56.180659 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-642b3933-df48-404e-91f0-1b3a6f684023 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] [instance: ea0bc23d-fa3a-45d4-8311-b9529203a6df] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:32:56.187584 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-642b3933-df48-404e-91f0-1b3a6f684023 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:56.188079 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-642b3933-df48-404e-91f0-1b3a6f684023 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:56.188524 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-642b3933-df48-404e-91f0-1b3a6f684023 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:56.189356 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-642b3933-df48-404e-91f0-1b3a6f684023 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:56.189819 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-642b3933-df48-404e-91f0-1b3a6f684023 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:56.190252 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-642b3933-df48-404e-91f0-1b3a6f684023 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:56.323617 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-642b3933-df48-404e-91f0-1b3a6f684023 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddfe63b5ac0d421392a768f97ce4bfbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a11896b0244a4f1e859986b87a17affd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:56.333066 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-642b3933-df48-404e-91f0-1b3a6f684023 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] 10.222.0.60 "GET /compute/v2.1/servers/ea0bc23d-fa3a-45d4-8311-b9529203a6df" status: 200 len: 1514 microversion: 2.1 time: 0.158451 Sep 14 09:32:56.333897 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3183/6388] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:32:56 2022] GET /compute/v2.1/servers/ea0bc23d-fa3a-45d4-8311-b9529203a6df => generated 1514 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:32:56.944014 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-4377ebeb-6fa1-4559-91c2-39aea5271ea3 req-acfe4c21-1e6f-4491-8c0e-c3aae72da93e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea0bc23d-fa3a-45d4-8311-b9529203a6df", "name": "network-vif-deleted", "tag": "02859de8-43b1-4e47-9551-e3bf79623515"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:32:56.957728 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-4377ebeb-6fa1-4559-91c2-39aea5271ea3 req-acfe4c21-1e6f-4491-8c0e-c3aae72da93e service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:56.962515 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-4377ebeb-6fa1-4559-91c2-39aea5271ea3 req-acfe4c21-1e6f-4491-8c0e-c3aae72da93e service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:56.963200 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-4377ebeb-6fa1-4559-91c2-39aea5271ea3 req-acfe4c21-1e6f-4491-8c0e-c3aae72da93e service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:56.979604 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-4377ebeb-6fa1-4559-91c2-39aea5271ea3 req-acfe4c21-1e6f-4491-8c0e-c3aae72da93e service nova] Creating event network-vif-deleted:02859de8-43b1-4e47-9551-e3bf79623515 for instance ea0bc23d-fa3a-45d4-8311-b9529203a6df on n-h2-836830-18 Sep 14 09:32:56.985653 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-4377ebeb-6fa1-4559-91c2-39aea5271ea3 req-acfe4c21-1e6f-4491-8c0e-c3aae72da93e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051333 Sep 14 09:32:56.987212 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3206/6389] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:32:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:32:57.203638 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-1ed76440-7adb-4871-a664-82ec1e8949bc tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:57.204284 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-1ed76440-7adb-4871-a664-82ec1e8949bc tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: c7f40b74-e569-4fe2-8227-c4c93e70d37d] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:32:57.211488 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1ed76440-7adb-4871-a664-82ec1e8949bc tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:57.211984 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1ed76440-7adb-4871-a664-82ec1e8949bc tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:57.212433 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1ed76440-7adb-4871-a664-82ec1e8949bc tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:57.213190 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1ed76440-7adb-4871-a664-82ec1e8949bc tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:57.213658 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1ed76440-7adb-4871-a664-82ec1e8949bc tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:57.214091 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1ed76440-7adb-4871-a664-82ec1e8949bc tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:57.286300 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-1ed76440-7adb-4871-a664-82ec1e8949bc tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:57.295289 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-1ed76440-7adb-4871-a664-82ec1e8949bc tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/c7f40b74-e569-4fe2-8227-c4c93e70d37d" status: 200 len: 1360 microversion: 2.1 time: 0.095968 Sep 14 09:32:57.295895 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3184/6390] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:32:57 2022] GET /compute/v2.1/servers/c7f40b74-e569-4fe2-8227-c4c93e70d37d => generated 1360 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:32:57.358372 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1585de73-3072-4021-a2e6-5b7f32cb7465 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:57.359346 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-1585de73-3072-4021-a2e6-5b7f32cb7465 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] [instance: ea0bc23d-fa3a-45d4-8311-b9529203a6df] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:32:57.368147 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1585de73-3072-4021-a2e6-5b7f32cb7465 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:57.369208 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1585de73-3072-4021-a2e6-5b7f32cb7465 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:57.369977 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1585de73-3072-4021-a2e6-5b7f32cb7465 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:57.370898 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1585de73-3072-4021-a2e6-5b7f32cb7465 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:57.371717 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1585de73-3072-4021-a2e6-5b7f32cb7465 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:57.372311 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1585de73-3072-4021-a2e6-5b7f32cb7465 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:57.413799 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1585de73-3072-4021-a2e6-5b7f32cb7465 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:57.414319 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1585de73-3072-4021-a2e6-5b7f32cb7465 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:57.414771 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1585de73-3072-4021-a2e6-5b7f32cb7465 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:57.415291 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.objects.instance [None req-1585de73-3072-4021-a2e6-5b7f32cb7465 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Lazy-loading 'fault' on Instance uuid ea0bc23d-fa3a-45d4-8311-b9529203a6df {{(pid=128758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:32:57.488063 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-1585de73-3072-4021-a2e6-5b7f32cb7465 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddfe63b5ac0d421392a768f97ce4bfbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a11896b0244a4f1e859986b87a17affd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:57.499989 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-1585de73-3072-4021-a2e6-5b7f32cb7465 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] 10.222.0.60 "GET /compute/v2.1/servers/ea0bc23d-fa3a-45d4-8311-b9529203a6df" status: 200 len: 1309 microversion: 2.1 time: 0.147414 Sep 14 09:32:57.501020 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3207/6391] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:32:57 2022] GET /compute/v2.1/servers/ea0bc23d-fa3a-45d4-8311-b9529203a6df => generated 1309 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:32:58.320132 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8bc8f9e7-73f3-495d-be9b-cb9f092cf075 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:58.320763 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-8bc8f9e7-73f3-495d-be9b-cb9f092cf075 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: c7f40b74-e569-4fe2-8227-c4c93e70d37d] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:32:58.328070 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8bc8f9e7-73f3-495d-be9b-cb9f092cf075 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:58.328568 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8bc8f9e7-73f3-495d-be9b-cb9f092cf075 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:58.329013 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8bc8f9e7-73f3-495d-be9b-cb9f092cf075 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:58.329718 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8bc8f9e7-73f3-495d-be9b-cb9f092cf075 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:58.330824 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8bc8f9e7-73f3-495d-be9b-cb9f092cf075 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:58.331287 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8bc8f9e7-73f3-495d-be9b-cb9f092cf075 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:58.396142 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-8bc8f9e7-73f3-495d-be9b-cb9f092cf075 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:58.404314 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-8bc8f9e7-73f3-495d-be9b-cb9f092cf075 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/c7f40b74-e569-4fe2-8227-c4c93e70d37d" status: 200 len: 1360 microversion: 2.1 time: 0.088163 Sep 14 09:32:58.404895 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3185/6392] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:32:58 2022] GET /compute/v2.1/servers/c7f40b74-e569-4fe2-8227-c4c93e70d37d => generated 1360 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:32:58.523540 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1b2b27b5-587a-4cdb-adf8-0a92dc2d3f4b tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:58.524190 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-1b2b27b5-587a-4cdb-adf8-0a92dc2d3f4b tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] [instance: ea0bc23d-fa3a-45d4-8311-b9529203a6df] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:32:58.531654 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1b2b27b5-587a-4cdb-adf8-0a92dc2d3f4b tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:58.532160 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1b2b27b5-587a-4cdb-adf8-0a92dc2d3f4b tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:58.532615 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1b2b27b5-587a-4cdb-adf8-0a92dc2d3f4b tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:58.533370 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1b2b27b5-587a-4cdb-adf8-0a92dc2d3f4b tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:58.533845 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1b2b27b5-587a-4cdb-adf8-0a92dc2d3f4b tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:58.534288 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1b2b27b5-587a-4cdb-adf8-0a92dc2d3f4b tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:58.548249 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-1b2b27b5-587a-4cdb-adf8-0a92dc2d3f4b tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] HTTP exception thrown: Instance ea0bc23d-fa3a-45d4-8311-b9529203a6df could not be found. Sep 14 09:32:58.550469 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1b2b27b5-587a-4cdb-adf8-0a92dc2d3f4b tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Request method failure captured: Sep 14 09:32:58.550469 n-d-836830-18 devstack@n-api.service[128758]: request: GET /compute/v2.1/servers/ea0bc23d-fa3a-45d4-8311-b9529203a6df HTTP/1.1 Sep 14 09:32:58.550469 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 09:32:58.550469 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 09:32:58.550469 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 09:32:58.550469 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 09:32:58.550469 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 09:32:58.550469 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 09:32:58.550469 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 09:32:58.550469 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 09:32:58.550469 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZ9Qs9RO3z6RoL6f22zMFfobaQGy-ZO7rGrDKCOjC5xD2hQCgfmSNFNePFRnwRIsmdK4CExfGHfhu88QRXfEGy0QmGI7tflM298tC3RO7RfwjPlZv4FYJWLrZ-KYKtZqGNZ4tL8F2RDrOI32do-BsrCGFmj9cV8ebEHhFLHVNNd2hTQ Sep 14 09:32:58.550469 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 09:32:58.550469 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 09:32:58.550469 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 09:32:58.550469 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 09:32:58.550469 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 09:32:58.550469 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 09:32:58.550469 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: a11896b0244a4f1e859986b87a17affd Sep 14 09:32:58.550469 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1639477699 Sep 14 09:32:58.550469 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 09:32:58.550469 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 09:32:58.550469 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a11896b0244a4f1e859986b87a17affd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a11896b0244a4f1e859986b87a17affd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a11896b0244a4f1e859986b87a17affd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a11896b0244a4f1e859986b87a17affd"}]}] Sep 14 09:32:58.550469 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-VolumesSnapshotTestJSON-1639477699 Sep 14 09:32:58.550469 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: a11896b0244a4f1e859986b87a17affd Sep 14 09:32:58.550469 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1639477699 Sep 14 09:32:58.550469 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-VolumesSnapshotTestJSON-1639477699-project Sep 14 09:32:58.550469 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 09:32:58.550469 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 09:32:58.550469 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: ddfe63b5ac0d421392a768f97ce4bfbf Sep 14 09:32:58.550469 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-VolumesSnapshotTestJSON-1639477699-project Sep 14 09:32:58.550469 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 09:32:58.550469 n-d-836830-18 devstack@n-api.service[128758]: exception: Instance ea0bc23d-fa3a-45d4-8311-b9529203a6df could not be found. Sep 14 09:32:58.550469 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': 'ea0bc23d-fa3a-45d4-8311-b9529203a6df'} Sep 14 09:32:58.550469 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:32:58.550469 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:32:58.550469 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:32:58.550469 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:32:58.550469 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:32:58.550469 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:32:58.550469 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:32:58.550469 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:32:58.550469 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:32:58.550469 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:32:58.550469 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea0bc23d-fa3a-45d4-8311-b9529203a6df could not be found. Sep 14 09:32:58.550469 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:32:58.550469 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:32:58.550469 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:32:58.550469 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:32:58.550469 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:32:58.550469 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:32:58.550469 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:32:58.550469 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:32:58.550469 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:32:58.550469 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:32:58.550469 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:32:58.550469 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:32:58.550469 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:32:58.550469 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:32:58.550469 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:32:58.550469 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:32:58.550469 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea0bc23d-fa3a-45d4-8311-b9529203a6df could not be found. Sep 14 09:32:58.550469 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:32:58.550469 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:32:58.550469 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:32:58.565470 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:32:58.565470 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:32:58.565470 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:32:58.565470 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:32:58.565470 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:32:58.565470 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea0bc23d-fa3a-45d4-8311-b9529203a6df could not be found. Sep 14 09:32:58.565470 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:32:58.565470 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1b2b27b5-587a-4cdb-adf8-0a92dc2d3f4b tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Returning 404 to user: Instance ea0bc23d-fa3a-45d4-8311-b9529203a6df could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:32:58.565470 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-1b2b27b5-587a-4cdb-adf8-0a92dc2d3f4b tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] 10.222.0.60 "GET /compute/v2.1/servers/ea0bc23d-fa3a-45d4-8311-b9529203a6df" status: 404 len: 111 microversion: 2.1 time: 0.032690 Sep 14 09:32:58.565470 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3208/6393] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:32:58 2022] GET /compute/v2.1/servers/ea0bc23d-fa3a-45d4-8311-b9529203a6df => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:32:59.003877 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-cb72268d-0ad3-4555-b941-0d2297fd7948 req-a2c0cbe2-5367-4610-8441-ac1aafc682bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7f40b74-e569-4fe2-8227-c4c93e70d37d", "name": "network-vif-deleted", "tag": "9788ede9-23f9-4eb4-88d1-b4fd26e88c11"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:32:59.014928 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-cb72268d-0ad3-4555-b941-0d2297fd7948 req-a2c0cbe2-5367-4610-8441-ac1aafc682bd service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:59.015527 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-cb72268d-0ad3-4555-b941-0d2297fd7948 req-a2c0cbe2-5367-4610-8441-ac1aafc682bd service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:59.016043 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-cb72268d-0ad3-4555-b941-0d2297fd7948 req-a2c0cbe2-5367-4610-8441-ac1aafc682bd service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:59.028289 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-cb72268d-0ad3-4555-b941-0d2297fd7948 req-a2c0cbe2-5367-4610-8441-ac1aafc682bd service nova] Creating event network-vif-deleted:9788ede9-23f9-4eb4-88d1-b4fd26e88c11 for instance c7f40b74-e569-4fe2-8227-c4c93e70d37d on n-h2-836830-18 Sep 14 09:32:59.034072 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-cb72268d-0ad3-4555-b941-0d2297fd7948 req-a2c0cbe2-5367-4610-8441-ac1aafc682bd service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034317 Sep 14 09:32:59.035372 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3186/6394] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:32:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:32:59.430181 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-475db9e2-8809-42fa-9914-2baa0515eb1e tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:59.431618 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-475db9e2-8809-42fa-9914-2baa0515eb1e tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: c7f40b74-e569-4fe2-8227-c4c93e70d37d] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:32:59.438253 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-475db9e2-8809-42fa-9914-2baa0515eb1e tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:59.438766 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-475db9e2-8809-42fa-9914-2baa0515eb1e tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:59.440188 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-475db9e2-8809-42fa-9914-2baa0515eb1e tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:59.440920 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-475db9e2-8809-42fa-9914-2baa0515eb1e tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:59.441702 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-475db9e2-8809-42fa-9914-2baa0515eb1e tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:59.442318 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-475db9e2-8809-42fa-9914-2baa0515eb1e tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:59.513252 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-475db9e2-8809-42fa-9914-2baa0515eb1e tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:59.522049 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-475db9e2-8809-42fa-9914-2baa0515eb1e tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/c7f40b74-e569-4fe2-8227-c4c93e70d37d" status: 200 len: 1360 microversion: 2.1 time: 0.098252 Sep 14 09:32:59.522659 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3209/6395] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:32:59 2022] GET /compute/v2.1/servers/c7f40b74-e569-4fe2-8227-c4c93e70d37d => generated 1360 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:33:00.549490 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-05b07c3f-ca1b-43fc-8378-990fceb0b867 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:00.550134 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-05b07c3f-ca1b-43fc-8378-990fceb0b867 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: c7f40b74-e569-4fe2-8227-c4c93e70d37d] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:00.561567 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-05b07c3f-ca1b-43fc-8378-990fceb0b867 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:00.562169 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-05b07c3f-ca1b-43fc-8378-990fceb0b867 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:00.562721 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-05b07c3f-ca1b-43fc-8378-990fceb0b867 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:00.563555 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-05b07c3f-ca1b-43fc-8378-990fceb0b867 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:00.564582 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-05b07c3f-ca1b-43fc-8378-990fceb0b867 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:00.565619 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-05b07c3f-ca1b-43fc-8378-990fceb0b867 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:00.634150 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-05b07c3f-ca1b-43fc-8378-990fceb0b867 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:00.642506 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-05b07c3f-ca1b-43fc-8378-990fceb0b867 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/c7f40b74-e569-4fe2-8227-c4c93e70d37d" status: 200 len: 1360 microversion: 2.1 time: 0.097418 Sep 14 09:33:00.643175 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3187/6396] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:33:00 2022] GET /compute/v2.1/servers/c7f40b74-e569-4fe2-8227-c4c93e70d37d => generated 1360 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:33:01.667055 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-f1d1000e-f7f9-4a2b-adb1-e6225b13c394 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:01.667772 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-f1d1000e-f7f9-4a2b-adb1-e6225b13c394 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: c7f40b74-e569-4fe2-8227-c4c93e70d37d] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:01.671721 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=40 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:33:01.677883 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f1d1000e-f7f9-4a2b-adb1-e6225b13c394 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:01.678507 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f1d1000e-f7f9-4a2b-adb1-e6225b13c394 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:01.678928 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f1d1000e-f7f9-4a2b-adb1-e6225b13c394 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:01.679781 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f1d1000e-f7f9-4a2b-adb1-e6225b13c394 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:01.680260 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f1d1000e-f7f9-4a2b-adb1-e6225b13c394 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:01.680701 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f1d1000e-f7f9-4a2b-adb1-e6225b13c394 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:01.715729 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f1d1000e-f7f9-4a2b-adb1-e6225b13c394 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:01.716228 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f1d1000e-f7f9-4a2b-adb1-e6225b13c394 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:01.716679 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f1d1000e-f7f9-4a2b-adb1-e6225b13c394 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:01.717263 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.objects.instance [None req-f1d1000e-f7f9-4a2b-adb1-e6225b13c394 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lazy-loading 'fault' on Instance uuid c7f40b74-e569-4fe2-8227-c4c93e70d37d {{(pid=128758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:33:01.765393 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-f1d1000e-f7f9-4a2b-adb1-e6225b13c394 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:01.775472 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-f1d1000e-f7f9-4a2b-adb1-e6225b13c394 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/c7f40b74-e569-4fe2-8227-c4c93e70d37d" status: 200 len: 1365 microversion: 2.1 time: 0.112865 Sep 14 09:33:01.781060 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3210/6397] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:33:01 2022] GET /compute/v2.1/servers/c7f40b74-e569-4fe2-8227-c4c93e70d37d => generated 1365 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:33:02.802188 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c1415d9f-3c44-4ba7-b348-0a4da9bff25b tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:02.802776 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-c1415d9f-3c44-4ba7-b348-0a4da9bff25b tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: c7f40b74-e569-4fe2-8227-c4c93e70d37d] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:02.806386 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=2 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:33:02.813100 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c1415d9f-3c44-4ba7-b348-0a4da9bff25b tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:02.813680 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c1415d9f-3c44-4ba7-b348-0a4da9bff25b tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:02.814747 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c1415d9f-3c44-4ba7-b348-0a4da9bff25b tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:02.815658 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c1415d9f-3c44-4ba7-b348-0a4da9bff25b tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:02.816329 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c1415d9f-3c44-4ba7-b348-0a4da9bff25b tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:02.816757 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c1415d9f-3c44-4ba7-b348-0a4da9bff25b tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:02.837690 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-c1415d9f-3c44-4ba7-b348-0a4da9bff25b tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] HTTP exception thrown: Instance c7f40b74-e569-4fe2-8227-c4c93e70d37d could not be found. Sep 14 09:33:02.839757 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c1415d9f-3c44-4ba7-b348-0a4da9bff25b tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Request method failure captured: Sep 14 09:33:02.839757 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/c7f40b74-e569-4fe2-8227-c4c93e70d37d HTTP/1.1 Sep 14 09:33:02.839757 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:33:02.839757 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:33:02.839757 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:33:02.839757 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:33:02.839757 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:33:02.839757 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:33:02.839757 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:33:02.839757 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:33:02.839757 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZ7vSEasHnu7hRXol9c-LZuMaC9uK137X6F5rG7UmloUJeCaIX1XI8DyW-6MYPzXIn8tJlRUDBfS9Xo7ko5WvlkRtwNLi8r30OmEJBkLllR4uOPeHedowZTMuQPwQppwmIxlx0K05UlAJOyH1eD16mNE7GFFk01jmhPM_9wCZyZUFi8 Sep 14 09:33:02.839757 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:33:02.839757 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:33:02.839757 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:33:02.839757 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:33:02.839757 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:33:02.839757 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:33:02.839757 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 0fca803d9ffa4b4ab0371c0d6a96a5a2 Sep 14 09:33:02.839757 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-TestVolumeBootPattern-1945148622 Sep 14 09:33:02.839757 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:33:02.839757 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:33:02.839757 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0fca803d9ffa4b4ab0371c0d6a96a5a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0fca803d9ffa4b4ab0371c0d6a96a5a2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0fca803d9ffa4b4ab0371c0d6a96a5a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0fca803d9ffa4b4ab0371c0d6a96a5a2"}]}] Sep 14 09:33:02.839757 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-TestVolumeBootPattern-1945148622 Sep 14 09:33:02.839757 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 0fca803d9ffa4b4ab0371c0d6a96a5a2 Sep 14 09:33:02.839757 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-TestVolumeBootPattern-1945148622 Sep 14 09:33:02.839757 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-TestVolumeBootPattern-1945148622-project Sep 14 09:33:02.839757 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:33:02.839757 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:33:02.839757 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 80257054a25540c294e1787780b601b4 Sep 14 09:33:02.839757 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-TestVolumeBootPattern-1945148622-project Sep 14 09:33:02.839757 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:33:02.839757 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance c7f40b74-e569-4fe2-8227-c4c93e70d37d could not be found. Sep 14 09:33:02.839757 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': 'c7f40b74-e569-4fe2-8227-c4c93e70d37d'} Sep 14 09:33:02.839757 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:33:02.839757 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:33:02.839757 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:33:02.839757 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:33:02.839757 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:33:02.839757 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:33:02.839757 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:33:02.839757 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:33:02.839757 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:33:02.839757 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:33:02.839757 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7f40b74-e569-4fe2-8227-c4c93e70d37d could not be found. Sep 14 09:33:02.839757 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:33:02.839757 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:33:02.839757 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:33:02.839757 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:33:02.839757 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:33:02.839757 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:33:02.839757 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:33:02.839757 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:33:02.839757 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:33:02.839757 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:33:02.839757 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:33:02.839757 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:33:02.839757 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:33:02.839757 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:33:02.839757 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:33:02.839757 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:33:02.839757 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7f40b74-e569-4fe2-8227-c4c93e70d37d could not be found. Sep 14 09:33:02.839757 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:33:02.839757 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:33:02.839757 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:33:02.849925 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:33:02.849925 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:33:02.849925 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:33:02.849925 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:33:02.849925 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:33:02.849925 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7f40b74-e569-4fe2-8227-c4c93e70d37d could not be found. Sep 14 09:33:02.849925 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:33:02.849925 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c1415d9f-3c44-4ba7-b348-0a4da9bff25b tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Returning 404 to user: Instance c7f40b74-e569-4fe2-8227-c4c93e70d37d could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:33:02.849925 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-c1415d9f-3c44-4ba7-b348-0a4da9bff25b tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/c7f40b74-e569-4fe2-8227-c4c93e70d37d" status: 404 len: 111 microversion: 2.1 time: 0.043710 Sep 14 09:33:02.849925 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3188/6398] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:33:02 2022] GET /compute/v2.1/servers/c7f40b74-e569-4fe2-8227-c4c93e70d37d => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:33:05.045902 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-660a1fc4-59dd-42da-ad97-1f6d3d062490 tempest-TestNetworkAdvancedServerOps-649526860 tempest-TestNetworkAdvancedServerOps-649526860-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:05.047079 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-660a1fc4-59dd-42da-ad97-1f6d3d062490 tempest-TestNetworkAdvancedServerOps-649526860 tempest-TestNetworkAdvancedServerOps-649526860-project-admin] [instance: c1297f74-578d-4a0d-8fd3-4197917a1dda] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:05.056441 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-660a1fc4-59dd-42da-ad97-1f6d3d062490 tempest-TestNetworkAdvancedServerOps-649526860 tempest-TestNetworkAdvancedServerOps-649526860-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:05.057173 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-660a1fc4-59dd-42da-ad97-1f6d3d062490 tempest-TestNetworkAdvancedServerOps-649526860 tempest-TestNetworkAdvancedServerOps-649526860-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:05.057819 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-660a1fc4-59dd-42da-ad97-1f6d3d062490 tempest-TestNetworkAdvancedServerOps-649526860 tempest-TestNetworkAdvancedServerOps-649526860-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:05.058720 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-660a1fc4-59dd-42da-ad97-1f6d3d062490 tempest-TestNetworkAdvancedServerOps-649526860 tempest-TestNetworkAdvancedServerOps-649526860-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:05.059701 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-660a1fc4-59dd-42da-ad97-1f6d3d062490 tempest-TestNetworkAdvancedServerOps-649526860 tempest-TestNetworkAdvancedServerOps-649526860-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:05.060228 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-660a1fc4-59dd-42da-ad97-1f6d3d062490 tempest-TestNetworkAdvancedServerOps-649526860 tempest-TestNetworkAdvancedServerOps-649526860-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:05.200712 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-660a1fc4-59dd-42da-ad97-1f6d3d062490 tempest-TestNetworkAdvancedServerOps-649526860 tempest-TestNetworkAdvancedServerOps-649526860-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/c1297f74-578d-4a0d-8fd3-4197917a1dda" status: 200 len: 1836 microversion: 2.1 time: 0.159801 Sep 14 09:33:05.201310 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3211/6399] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:33:05 2022] GET /compute/v2.1/servers/c1297f74-578d-4a0d-8fd3-4197917a1dda => generated 1836 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:33:05.226028 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e8a1cbcd-a9ac-453a-be41-df7efee796e0 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:05.226749 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e8a1cbcd-a9ac-453a-be41-df7efee796e0 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: c1297f74-578d-4a0d-8fd3-4197917a1dda] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:05.234754 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e8a1cbcd-a9ac-453a-be41-df7efee796e0 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:05.235942 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e8a1cbcd-a9ac-453a-be41-df7efee796e0 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:05.236623 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e8a1cbcd-a9ac-453a-be41-df7efee796e0 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:05.237388 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e8a1cbcd-a9ac-453a-be41-df7efee796e0 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:05.238074 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e8a1cbcd-a9ac-453a-be41-df7efee796e0 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:05.238711 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e8a1cbcd-a9ac-453a-be41-df7efee796e0 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:05.371838 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1d7f015c-2760-450b-af7c-eddd08ba49da tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1662337945", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "networks": [{"uuid": "0ed5254d-daa1-4f6c-8c7f-947df600f3ed"}]}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:33:05.388338 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-e8a1cbcd-a9ac-453a-be41-df7efee796e0 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725d7beb4ec54b86a455af0d7bd0ce19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c197eded81494b818b1e56f4c01432c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:05.398914 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e8a1cbcd-a9ac-453a-be41-df7efee796e0 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/c1297f74-578d-4a0d-8fd3-4197917a1dda" status: 200 len: 1683 microversion: 2.1 time: 0.178311 Sep 14 09:33:05.412178 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3189/6400] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:33:05 2022] GET /compute/v2.1/servers/c1297f74-578d-4a0d-8fd3-4197917a1dda => generated 1683 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:33:05.440050 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.network.neutron [None req-1d7f015c-2760-450b-af7c-eddd08ba49da tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] validate_networks() for [('0ed5254d-daa1-4f6c-8c7f-947df600f3ed', None, None, None, None, None)] {{(pid=128758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:33:05.511008 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d3cd9951-0880-4f9a-a193-257548bc65c7 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:33:05.513265 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-d3cd9951-0880-4f9a-a193-257548bc65c7 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: c1297f74-578d-4a0d-8fd3-4197917a1dda] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:05.520723 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d3cd9951-0880-4f9a-a193-257548bc65c7 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:05.521456 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d3cd9951-0880-4f9a-a193-257548bc65c7 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:05.521909 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d3cd9951-0880-4f9a-a193-257548bc65c7 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:05.522625 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d3cd9951-0880-4f9a-a193-257548bc65c7 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:05.523238 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d3cd9951-0880-4f9a-a193-257548bc65c7 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:05.523679 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d3cd9951-0880-4f9a-a193-257548bc65c7 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:05.602611 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d3cd9951-0880-4f9a-a193-257548bc65c7 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "POST /compute/v2.1/servers/c1297f74-578d-4a0d-8fd3-4197917a1dda/action" status: 200 len: 32642 microversion: 2.1 time: 0.095265 Sep 14 09:33:05.604357 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3190/6401] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:33:05 2022] POST /compute/v2.1/servers/c1297f74-578d-4a0d-8fd3-4197917a1dda/action => generated 32642 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 14 09:33:05.758619 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d9a51ea1-4115-4ac0-9482-bc5543d0faf3 tempest-TestNetworkAdvancedServerOps-649526860 tempest-TestNetworkAdvancedServerOps-649526860-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:33:05.759757 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-d9a51ea1-4115-4ac0-9482-bc5543d0faf3 tempest-TestNetworkAdvancedServerOps-649526860 tempest-TestNetworkAdvancedServerOps-649526860-project-admin] [instance: c1297f74-578d-4a0d-8fd3-4197917a1dda] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:05.767255 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d9a51ea1-4115-4ac0-9482-bc5543d0faf3 tempest-TestNetworkAdvancedServerOps-649526860 tempest-TestNetworkAdvancedServerOps-649526860-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:05.768406 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d9a51ea1-4115-4ac0-9482-bc5543d0faf3 tempest-TestNetworkAdvancedServerOps-649526860 tempest-TestNetworkAdvancedServerOps-649526860-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:05.768972 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d9a51ea1-4115-4ac0-9482-bc5543d0faf3 tempest-TestNetworkAdvancedServerOps-649526860 tempest-TestNetworkAdvancedServerOps-649526860-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:05.769927 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d9a51ea1-4115-4ac0-9482-bc5543d0faf3 tempest-TestNetworkAdvancedServerOps-649526860 tempest-TestNetworkAdvancedServerOps-649526860-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:05.770507 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d9a51ea1-4115-4ac0-9482-bc5543d0faf3 tempest-TestNetworkAdvancedServerOps-649526860 tempest-TestNetworkAdvancedServerOps-649526860-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:05.771270 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d9a51ea1-4115-4ac0-9482-bc5543d0faf3 tempest-TestNetworkAdvancedServerOps-649526860 tempest-TestNetworkAdvancedServerOps-649526860-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:05.802826 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-d9a51ea1-4115-4ac0-9482-bc5543d0faf3 tempest-TestNetworkAdvancedServerOps-649526860 tempest-TestNetworkAdvancedServerOps-649526860-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '2cc32fcc100b4dd596a125f43d53478e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71758c2c779457c9f5bab55d0918ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:05.803551 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-d9a51ea1-4115-4ac0-9482-bc5543d0faf3 tempest-TestNetworkAdvancedServerOps-649526860 tempest-TestNetworkAdvancedServerOps-649526860-project-admin] [instance: c1297f74-578d-4a0d-8fd3-4197917a1dda] flavor_id is None. Assuming migration. {{(pid=128759) resize /opt/stack/nova/nova/compute/api.py:4196}} Sep 14 09:33:05.804067 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-d9a51ea1-4115-4ac0-9482-bc5543d0faf3 tempest-TestNetworkAdvancedServerOps-649526860 tempest-TestNetworkAdvancedServerOps-649526860-project-admin] [instance: c1297f74-578d-4a0d-8fd3-4197917a1dda] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=128759) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 14 09:33:05.828313 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-1d7f015c-2760-450b-af7c-eddd08ba49da tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Flavor limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:33:05.828756 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-1d7f015c-2760-450b-af7c-eddd08ba49da tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Image limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:33:05.829436 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-1d7f015c-2760-450b-af7c-eddd08ba49da tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Flavor pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:33:05.830704 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-1d7f015c-2760-450b-af7c-eddd08ba49da tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Image pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:33:05.831197 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-1d7f015c-2760-450b-af7c-eddd08ba49da tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:33:05.840967 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1d7f015c-2760-450b-af7c-eddd08ba49da tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:05.841665 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1d7f015c-2760-450b-af7c-eddd08ba49da tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:05.842310 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1d7f015c-2760-450b-af7c-eddd08ba49da tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:05.843088 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1d7f015c-2760-450b-af7c-eddd08ba49da tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:05.843562 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1d7f015c-2760-450b-af7c-eddd08ba49da tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:05.844037 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1d7f015c-2760-450b-af7c-eddd08ba49da tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:05.862583 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-1d7f015c-2760-450b-af7c-eddd08ba49da tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Getting quotas for project a11896b0244a4f1e859986b87a17affd. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:33:05.868085 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-1d7f015c-2760-450b-af7c-eddd08ba49da tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Getting quotas for user ddfe63b5ac0d421392a768f97ce4bfbf and project a11896b0244a4f1e859986b87a17affd. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:33:05.881357 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-1d7f015c-2760-450b-af7c-eddd08ba49da tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Going to run 1 instances... {{(pid=128758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:33:05.883732 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-1d7f015c-2760-450b-af7c-eddd08ba49da tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] [instance: 9579aa98-cb7a-46a9-89eb-be0f1f823acf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:33:05.930251 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d9a51ea1-4115-4ac0-9482-bc5543d0faf3 tempest-TestNetworkAdvancedServerOps-649526860 tempest-TestNetworkAdvancedServerOps-649526860-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/c1297f74-578d-4a0d-8fd3-4197917a1dda/action" status: 202 len: 0 microversion: 2.1 time: 0.175760 Sep 14 09:33:05.931083 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3191/6402] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:33:05 2022] POST /compute/v2.1/servers/c1297f74-578d-4a0d-8fd3-4197917a1dda/action => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 14 09:33:05.931250 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-1d7f015c-2760-450b-af7c-eddd08ba49da tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.563903 Sep 14 09:33:05.932281 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3212/6403] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 09:33:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 566 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 14 09:33:05.946097 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-38751484-b71f-4587-b2a5-3282c800954c tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:05.946741 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-38751484-b71f-4587-b2a5-3282c800954c tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] [instance: 9579aa98-cb7a-46a9-89eb-be0f1f823acf] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:05.947460 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e185de5f-16ce-4d03-9c88-c6a790f00ff2 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:05.948692 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e185de5f-16ce-4d03-9c88-c6a790f00ff2 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: c1297f74-578d-4a0d-8fd3-4197917a1dda] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:05.956542 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e185de5f-16ce-4d03-9c88-c6a790f00ff2 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:05.957652 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e185de5f-16ce-4d03-9c88-c6a790f00ff2 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:05.958708 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e185de5f-16ce-4d03-9c88-c6a790f00ff2 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:05.959742 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e185de5f-16ce-4d03-9c88-c6a790f00ff2 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:05.971472 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e185de5f-16ce-4d03-9c88-c6a790f00ff2 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:05.972027 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e185de5f-16ce-4d03-9c88-c6a790f00ff2 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:06.038049 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-38751484-b71f-4587-b2a5-3282c800954c tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddfe63b5ac0d421392a768f97ce4bfbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a11896b0244a4f1e859986b87a17affd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:06.047148 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-38751484-b71f-4587-b2a5-3282c800954c tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] 10.222.0.60 "GET /compute/v2.1/servers/9579aa98-cb7a-46a9-89eb-be0f1f823acf" status: 200 len: 1219 microversion: 2.1 time: 0.106549 Sep 14 09:33:06.067271 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3213/6404] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:33:05 2022] GET /compute/v2.1/servers/9579aa98-cb7a-46a9-89eb-be0f1f823acf => generated 1219 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:33:06.181046 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-e185de5f-16ce-4d03-9c88-c6a790f00ff2 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725d7beb4ec54b86a455af0d7bd0ce19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c197eded81494b818b1e56f4c01432c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:06.189816 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e185de5f-16ce-4d03-9c88-c6a790f00ff2 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/c1297f74-578d-4a0d-8fd3-4197917a1dda" status: 200 len: 1692 microversion: 2.1 time: 0.252931 Sep 14 09:33:06.190981 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3192/6405] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:33:05 2022] GET /compute/v2.1/servers/c1297f74-578d-4a0d-8fd3-4197917a1dda => generated 1692 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:33:07.077987 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-9dd025ed-e18e-444b-9bb2-97cf2b20bc95 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:07.079748 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-9dd025ed-e18e-444b-9bb2-97cf2b20bc95 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] [instance: 9579aa98-cb7a-46a9-89eb-be0f1f823acf] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:07.093461 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9dd025ed-e18e-444b-9bb2-97cf2b20bc95 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:07.094298 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9dd025ed-e18e-444b-9bb2-97cf2b20bc95 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:07.095998 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9dd025ed-e18e-444b-9bb2-97cf2b20bc95 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:07.097529 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9dd025ed-e18e-444b-9bb2-97cf2b20bc95 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:07.098086 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9dd025ed-e18e-444b-9bb2-97cf2b20bc95 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:07.100608 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9dd025ed-e18e-444b-9bb2-97cf2b20bc95 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:07.177411 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b94f0204-7a8e-425d-b2f8-cc8586b541e9 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:07.177945 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b94f0204-7a8e-425d-b2f8-cc8586b541e9 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: cc2a0b70-662f-4c7e-a08a-76faaa3ec166] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:07.191400 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b94f0204-7a8e-425d-b2f8-cc8586b541e9 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:07.192285 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b94f0204-7a8e-425d-b2f8-cc8586b541e9 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:07.192897 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-9dd025ed-e18e-444b-9bb2-97cf2b20bc95 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddfe63b5ac0d421392a768f97ce4bfbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a11896b0244a4f1e859986b87a17affd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:07.193081 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b94f0204-7a8e-425d-b2f8-cc8586b541e9 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:07.193935 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b94f0204-7a8e-425d-b2f8-cc8586b541e9 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:07.194738 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b94f0204-7a8e-425d-b2f8-cc8586b541e9 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:07.195346 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b94f0204-7a8e-425d-b2f8-cc8586b541e9 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:07.203078 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-9dd025ed-e18e-444b-9bb2-97cf2b20bc95 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] 10.222.0.60 "GET /compute/v2.1/servers/9579aa98-cb7a-46a9-89eb-be0f1f823acf" status: 200 len: 1279 microversion: 2.1 time: 0.131146 Sep 14 09:33:07.207064 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3214/6406] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:33:07 2022] GET /compute/v2.1/servers/9579aa98-cb7a-46a9-89eb-be0f1f823acf => generated 1279 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:33:07.219823 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-df7f2e6c-ec70-47a4-a918-a0db7860429a tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:07.220807 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-df7f2e6c-ec70-47a4-a918-a0db7860429a tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: c1297f74-578d-4a0d-8fd3-4197917a1dda] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:07.230411 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-df7f2e6c-ec70-47a4-a918-a0db7860429a tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:07.230925 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-df7f2e6c-ec70-47a4-a918-a0db7860429a tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:07.231568 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-df7f2e6c-ec70-47a4-a918-a0db7860429a tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:07.232300 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-df7f2e6c-ec70-47a4-a918-a0db7860429a tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:07.232788 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-df7f2e6c-ec70-47a4-a918-a0db7860429a tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:07.233207 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-df7f2e6c-ec70-47a4-a918-a0db7860429a tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:07.240472 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b94f0204-7a8e-425d-b2f8-cc8586b541e9 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: cc2a0b70-662f-4c7e-a08a-76faaa3ec166] Going to try to terminate instance {{(pid=128759) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:33:07.355331 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b94f0204-7a8e-425d-b2f8-cc8586b541e9 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "DELETE /compute/v2.1/servers/cc2a0b70-662f-4c7e-a08a-76faaa3ec166" status: 204 len: 0 microversion: 2.1 time: 0.181511 Sep 14 09:33:07.359506 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3193/6407] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:33:07 2022] DELETE /compute/v2.1/servers/cc2a0b70-662f-4c7e-a08a-76faaa3ec166 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:33:07.369746 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-761b8d25-d375-4266-85b5-028c4d70e6b3 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:07.370468 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-761b8d25-d375-4266-85b5-028c4d70e6b3 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: cc2a0b70-662f-4c7e-a08a-76faaa3ec166] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:07.378210 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-761b8d25-d375-4266-85b5-028c4d70e6b3 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:07.379125 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-761b8d25-d375-4266-85b5-028c4d70e6b3 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:07.379747 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-761b8d25-d375-4266-85b5-028c4d70e6b3 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:07.380697 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-761b8d25-d375-4266-85b5-028c4d70e6b3 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:07.381524 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-761b8d25-d375-4266-85b5-028c4d70e6b3 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:07.382242 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-761b8d25-d375-4266-85b5-028c4d70e6b3 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:07.406591 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:33:07.421204 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-df7f2e6c-ec70-47a4-a918-a0db7860429a tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725d7beb4ec54b86a455af0d7bd0ce19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c197eded81494b818b1e56f4c01432c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:07.429973 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-df7f2e6c-ec70-47a4-a918-a0db7860429a tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/c1297f74-578d-4a0d-8fd3-4197917a1dda" status: 200 len: 1692 microversion: 2.1 time: 0.217247 Sep 14 09:33:07.431549 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3215/6408] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:33:07 2022] GET /compute/v2.1/servers/c1297f74-578d-4a0d-8fd3-4197917a1dda => generated 1692 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:33:07.536677 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-761b8d25-d375-4266-85b5-028c4d70e6b3 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:07.545906 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-761b8d25-d375-4266-85b5-028c4d70e6b3 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/cc2a0b70-662f-4c7e-a08a-76faaa3ec166" status: 200 len: 1407 microversion: 2.1 time: 0.181143 Sep 14 09:33:07.546598 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3194/6409] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:33:07 2022] GET /compute/v2.1/servers/cc2a0b70-662f-4c7e-a08a-76faaa3ec166 => generated 1407 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:33:08.227908 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-245d3f9b-ecd1-40b4-a174-e737d9056910 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:08.228642 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-245d3f9b-ecd1-40b4-a174-e737d9056910 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] [instance: 9579aa98-cb7a-46a9-89eb-be0f1f823acf] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:08.235635 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-245d3f9b-ecd1-40b4-a174-e737d9056910 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:08.236153 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-245d3f9b-ecd1-40b4-a174-e737d9056910 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:08.236607 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-245d3f9b-ecd1-40b4-a174-e737d9056910 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:08.237892 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-245d3f9b-ecd1-40b4-a174-e737d9056910 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:08.238368 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-245d3f9b-ecd1-40b4-a174-e737d9056910 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:08.238815 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-245d3f9b-ecd1-40b4-a174-e737d9056910 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:08.374461 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-245d3f9b-ecd1-40b4-a174-e737d9056910 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddfe63b5ac0d421392a768f97ce4bfbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a11896b0244a4f1e859986b87a17affd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:08.383153 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-245d3f9b-ecd1-40b4-a174-e737d9056910 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] 10.222.0.60 "GET /compute/v2.1/servers/9579aa98-cb7a-46a9-89eb-be0f1f823acf" status: 200 len: 1319 microversion: 2.1 time: 0.159292 Sep 14 09:33:08.383831 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3216/6410] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:33:08 2022] GET /compute/v2.1/servers/9579aa98-cb7a-46a9-89eb-be0f1f823acf => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:33:08.455553 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a3b5574a-79f0-4035-a4a2-1b3b5859c606 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:08.456299 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-a3b5574a-79f0-4035-a4a2-1b3b5859c606 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: c1297f74-578d-4a0d-8fd3-4197917a1dda] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:08.463563 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a3b5574a-79f0-4035-a4a2-1b3b5859c606 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:08.464068 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a3b5574a-79f0-4035-a4a2-1b3b5859c606 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:08.464516 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a3b5574a-79f0-4035-a4a2-1b3b5859c606 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:08.465231 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a3b5574a-79f0-4035-a4a2-1b3b5859c606 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:08.465694 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a3b5574a-79f0-4035-a4a2-1b3b5859c606 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:08.466146 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a3b5574a-79f0-4035-a4a2-1b3b5859c606 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:08.503656 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-ac870cbd-7f3c-4fce-a2b1-391fe5c78021 req-20d382d4-08eb-4e38-9595-18912b138fbc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9579aa98-cb7a-46a9-89eb-be0f1f823acf", "tag": "cfcdadc8-6f47-4775-8ac4-2702e6bf0018"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:33:08.515023 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-ac870cbd-7f3c-4fce-a2b1-391fe5c78021 req-20d382d4-08eb-4e38-9595-18912b138fbc service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:08.515659 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-ac870cbd-7f3c-4fce-a2b1-391fe5c78021 req-20d382d4-08eb-4e38-9595-18912b138fbc service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:08.516182 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-ac870cbd-7f3c-4fce-a2b1-391fe5c78021 req-20d382d4-08eb-4e38-9595-18912b138fbc service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:08.530381 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-ac870cbd-7f3c-4fce-a2b1-391fe5c78021 req-20d382d4-08eb-4e38-9595-18912b138fbc service nova] Creating event network-changed:cfcdadc8-6f47-4775-8ac4-2702e6bf0018 for instance 9579aa98-cb7a-46a9-89eb-be0f1f823acf on n-h2-836830-18 Sep 14 09:33:08.536922 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-ac870cbd-7f3c-4fce-a2b1-391fe5c78021 req-20d382d4-08eb-4e38-9595-18912b138fbc service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036487 Sep 14 09:33:08.537651 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3217/6411] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:33:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:33:08.570220 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-f2d9756c-5de1-43ba-8b65-7f53c80f5cdf tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:08.571289 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-f2d9756c-5de1-43ba-8b65-7f53c80f5cdf tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: cc2a0b70-662f-4c7e-a08a-76faaa3ec166] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:08.579516 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f2d9756c-5de1-43ba-8b65-7f53c80f5cdf tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:08.580096 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f2d9756c-5de1-43ba-8b65-7f53c80f5cdf tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:08.580738 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f2d9756c-5de1-43ba-8b65-7f53c80f5cdf tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:08.581768 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f2d9756c-5de1-43ba-8b65-7f53c80f5cdf tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:08.582320 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f2d9756c-5de1-43ba-8b65-7f53c80f5cdf tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:08.582987 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f2d9756c-5de1-43ba-8b65-7f53c80f5cdf tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:08.708045 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-a3b5574a-79f0-4035-a4a2-1b3b5859c606 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725d7beb4ec54b86a455af0d7bd0ce19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c197eded81494b818b1e56f4c01432c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:08.718224 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a3b5574a-79f0-4035-a4a2-1b3b5859c606 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/c1297f74-578d-4a0d-8fd3-4197917a1dda" status: 200 len: 1692 microversion: 2.1 time: 0.266966 Sep 14 09:33:08.730960 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3195/6412] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:33:08 2022] GET /compute/v2.1/servers/c1297f74-578d-4a0d-8fd3-4197917a1dda => generated 1692 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:33:08.842771 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-f2d9756c-5de1-43ba-8b65-7f53c80f5cdf tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:08.851876 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-f2d9756c-5de1-43ba-8b65-7f53c80f5cdf tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/cc2a0b70-662f-4c7e-a08a-76faaa3ec166" status: 200 len: 1407 microversion: 2.1 time: 0.285847 Sep 14 09:33:08.852698 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3218/6413] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:33:08 2022] GET /compute/v2.1/servers/cc2a0b70-662f-4c7e-a08a-76faaa3ec166 => generated 1407 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:33:09.406551 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d9fa8fe0-7fd0-4b7d-986c-fd370b238069 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:09.407272 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-d9fa8fe0-7fd0-4b7d-986c-fd370b238069 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] [instance: 9579aa98-cb7a-46a9-89eb-be0f1f823acf] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:09.413502 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d9fa8fe0-7fd0-4b7d-986c-fd370b238069 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:09.414004 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d9fa8fe0-7fd0-4b7d-986c-fd370b238069 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:09.414451 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d9fa8fe0-7fd0-4b7d-986c-fd370b238069 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:09.415190 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d9fa8fe0-7fd0-4b7d-986c-fd370b238069 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:09.415857 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d9fa8fe0-7fd0-4b7d-986c-fd370b238069 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:09.416296 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d9fa8fe0-7fd0-4b7d-986c-fd370b238069 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:09.548604 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-d9fa8fe0-7fd0-4b7d-986c-fd370b238069 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddfe63b5ac0d421392a768f97ce4bfbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a11896b0244a4f1e859986b87a17affd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:09.560680 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d9fa8fe0-7fd0-4b7d-986c-fd370b238069 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] 10.222.0.60 "GET /compute/v2.1/servers/9579aa98-cb7a-46a9-89eb-be0f1f823acf" status: 200 len: 1319 microversion: 2.1 time: 0.158060 Sep 14 09:33:09.561385 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3196/6414] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:33:09 2022] GET /compute/v2.1/servers/9579aa98-cb7a-46a9-89eb-be0f1f823acf => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:33:09.744469 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1e29faa2-2029-43ec-a546-6af611877b40 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:09.745098 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-1e29faa2-2029-43ec-a546-6af611877b40 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: c1297f74-578d-4a0d-8fd3-4197917a1dda] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:09.752291 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1e29faa2-2029-43ec-a546-6af611877b40 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:09.752799 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1e29faa2-2029-43ec-a546-6af611877b40 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:09.753252 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1e29faa2-2029-43ec-a546-6af611877b40 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:09.753970 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1e29faa2-2029-43ec-a546-6af611877b40 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:09.754449 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1e29faa2-2029-43ec-a546-6af611877b40 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:09.754889 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1e29faa2-2029-43ec-a546-6af611877b40 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:09.876080 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-6ff5af9e-c04d-4568-8169-f6f084f2c4a0 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:09.876964 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-6ff5af9e-c04d-4568-8169-f6f084f2c4a0 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: cc2a0b70-662f-4c7e-a08a-76faaa3ec166] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:09.883895 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6ff5af9e-c04d-4568-8169-f6f084f2c4a0 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:09.884392 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6ff5af9e-c04d-4568-8169-f6f084f2c4a0 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:09.884838 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6ff5af9e-c04d-4568-8169-f6f084f2c4a0 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:09.885551 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6ff5af9e-c04d-4568-8169-f6f084f2c4a0 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:09.886015 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6ff5af9e-c04d-4568-8169-f6f084f2c4a0 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:09.886452 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6ff5af9e-c04d-4568-8169-f6f084f2c4a0 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:09.918429 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-1e29faa2-2029-43ec-a546-6af611877b40 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725d7beb4ec54b86a455af0d7bd0ce19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c197eded81494b818b1e56f4c01432c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:09.927726 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-1e29faa2-2029-43ec-a546-6af611877b40 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/c1297f74-578d-4a0d-8fd3-4197917a1dda" status: 200 len: 1697 microversion: 2.1 time: 0.187159 Sep 14 09:33:09.943882 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3219/6415] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:33:09 2022] GET /compute/v2.1/servers/c1297f74-578d-4a0d-8fd3-4197917a1dda => generated 1697 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:33:09.958013 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-6ff5af9e-c04d-4568-8169-f6f084f2c4a0 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:09.970630 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-6ff5af9e-c04d-4568-8169-f6f084f2c4a0 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/cc2a0b70-662f-4c7e-a08a-76faaa3ec166" status: 200 len: 1202 microversion: 2.1 time: 0.098506 Sep 14 09:33:09.980463 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3197/6416] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:33:09 2022] GET /compute/v2.1/servers/cc2a0b70-662f-4c7e-a08a-76faaa3ec166 => generated 1202 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:33:10.551906 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-8939ec23-d893-48f1-af9c-9bcec5549576 req-5bcb92f5-7e9f-470b-b6cb-f75e6067da71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc2a0b70-662f-4c7e-a08a-76faaa3ec166", "name": "network-vif-deleted", "tag": "da23266e-81f2-445c-8002-9ee4e3d358d7"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:33:10.572435 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-8939ec23-d893-48f1-af9c-9bcec5549576 req-5bcb92f5-7e9f-470b-b6cb-f75e6067da71 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:10.575120 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-8939ec23-d893-48f1-af9c-9bcec5549576 req-5bcb92f5-7e9f-470b-b6cb-f75e6067da71 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:10.575596 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-8939ec23-d893-48f1-af9c-9bcec5549576 req-5bcb92f5-7e9f-470b-b6cb-f75e6067da71 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:10.587407 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e8529a90-3e1e-4b09-b96a-8b23403e6951 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:10.588876 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e8529a90-3e1e-4b09-b96a-8b23403e6951 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] [instance: 9579aa98-cb7a-46a9-89eb-be0f1f823acf] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:10.592033 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-8939ec23-d893-48f1-af9c-9bcec5549576 req-5bcb92f5-7e9f-470b-b6cb-f75e6067da71 service nova] Creating event network-vif-deleted:da23266e-81f2-445c-8002-9ee4e3d358d7 for instance cc2a0b70-662f-4c7e-a08a-76faaa3ec166 on n-h1-836830-18 Sep 14 09:33:10.598820 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-8939ec23-d893-48f1-af9c-9bcec5549576 req-5bcb92f5-7e9f-470b-b6cb-f75e6067da71 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050365 Sep 14 09:33:10.599499 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3220/6417] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:33:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:33:10.606376 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e8529a90-3e1e-4b09-b96a-8b23403e6951 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:10.607161 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e8529a90-3e1e-4b09-b96a-8b23403e6951 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:10.607777 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e8529a90-3e1e-4b09-b96a-8b23403e6951 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:10.608874 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e8529a90-3e1e-4b09-b96a-8b23403e6951 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:10.609113 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e8529a90-3e1e-4b09-b96a-8b23403e6951 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:10.609550 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e8529a90-3e1e-4b09-b96a-8b23403e6951 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:10.749830 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-e8529a90-3e1e-4b09-b96a-8b23403e6951 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddfe63b5ac0d421392a768f97ce4bfbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a11896b0244a4f1e859986b87a17affd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:10.760015 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e8529a90-3e1e-4b09-b96a-8b23403e6951 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] 10.222.0.60 "GET /compute/v2.1/servers/9579aa98-cb7a-46a9-89eb-be0f1f823acf" status: 200 len: 1319 microversion: 2.1 time: 0.177999 Sep 14 09:33:10.761692 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3198/6418] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:33:10 2022] GET /compute/v2.1/servers/9579aa98-cb7a-46a9-89eb-be0f1f823acf => generated 1319 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:33:10.955882 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-9dfccbac-8f42-48fb-a887-2fdc1f91425e tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:10.957135 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-9dfccbac-8f42-48fb-a887-2fdc1f91425e tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: c1297f74-578d-4a0d-8fd3-4197917a1dda] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:10.963562 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9dfccbac-8f42-48fb-a887-2fdc1f91425e tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:10.964072 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9dfccbac-8f42-48fb-a887-2fdc1f91425e tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:10.964520 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9dfccbac-8f42-48fb-a887-2fdc1f91425e tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:10.965435 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9dfccbac-8f42-48fb-a887-2fdc1f91425e tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:10.966084 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9dfccbac-8f42-48fb-a887-2fdc1f91425e tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:10.966528 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9dfccbac-8f42-48fb-a887-2fdc1f91425e tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:10.993661 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9c8d1745-d7f5-4757-a476-993f7d48059c tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:10.994287 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-9c8d1745-d7f5-4757-a476-993f7d48059c tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: cc2a0b70-662f-4c7e-a08a-76faaa3ec166] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:11.001360 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9c8d1745-d7f5-4757-a476-993f7d48059c tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:11.001860 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9c8d1745-d7f5-4757-a476-993f7d48059c tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:11.002307 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9c8d1745-d7f5-4757-a476-993f7d48059c tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:11.003632 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9c8d1745-d7f5-4757-a476-993f7d48059c tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:11.004099 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9c8d1745-d7f5-4757-a476-993f7d48059c tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:11.004529 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9c8d1745-d7f5-4757-a476-993f7d48059c tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:11.089520 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-9c8d1745-d7f5-4757-a476-993f7d48059c tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:11.098160 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-9c8d1745-d7f5-4757-a476-993f7d48059c tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/cc2a0b70-662f-4c7e-a08a-76faaa3ec166" status: 200 len: 1202 microversion: 2.1 time: 0.108295 Sep 14 09:33:11.098748 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3199/6419] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:33:10 2022] GET /compute/v2.1/servers/cc2a0b70-662f-4c7e-a08a-76faaa3ec166 => generated 1202 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:33:11.140191 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-9dfccbac-8f42-48fb-a887-2fdc1f91425e tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725d7beb4ec54b86a455af0d7bd0ce19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c197eded81494b818b1e56f4c01432c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:11.148698 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-9dfccbac-8f42-48fb-a887-2fdc1f91425e tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/c1297f74-578d-4a0d-8fd3-4197917a1dda" status: 200 len: 1697 microversion: 2.1 time: 0.198323 Sep 14 09:33:11.149282 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3221/6420] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:33:10 2022] GET /compute/v2.1/servers/c1297f74-578d-4a0d-8fd3-4197917a1dda => generated 1697 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:33:11.785498 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-1546d9cd-76e6-4cf7-9bf0-a66713eeda6b tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:11.786132 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-1546d9cd-76e6-4cf7-9bf0-a66713eeda6b tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] [instance: 9579aa98-cb7a-46a9-89eb-be0f1f823acf] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:11.793261 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1546d9cd-76e6-4cf7-9bf0-a66713eeda6b tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:11.793811 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1546d9cd-76e6-4cf7-9bf0-a66713eeda6b tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:11.794258 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1546d9cd-76e6-4cf7-9bf0-a66713eeda6b tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:11.794977 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1546d9cd-76e6-4cf7-9bf0-a66713eeda6b tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:11.795444 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1546d9cd-76e6-4cf7-9bf0-a66713eeda6b tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:11.795873 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1546d9cd-76e6-4cf7-9bf0-a66713eeda6b tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:11.928654 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-1546d9cd-76e6-4cf7-9bf0-a66713eeda6b tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddfe63b5ac0d421392a768f97ce4bfbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a11896b0244a4f1e859986b87a17affd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:11.936635 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-1546d9cd-76e6-4cf7-9bf0-a66713eeda6b tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] 10.222.0.60 "GET /compute/v2.1/servers/9579aa98-cb7a-46a9-89eb-be0f1f823acf" status: 200 len: 1319 microversion: 2.1 time: 0.156165 Sep 14 09:33:11.937221 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3200/6421] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:33:11 2022] GET /compute/v2.1/servers/9579aa98-cb7a-46a9-89eb-be0f1f823acf => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:33:12.120927 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-fe69d805-ed62-44ea-9383-2816e649885d tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:12.121707 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-fe69d805-ed62-44ea-9383-2816e649885d tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: cc2a0b70-662f-4c7e-a08a-76faaa3ec166] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:12.130088 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fe69d805-ed62-44ea-9383-2816e649885d tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:12.130610 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fe69d805-ed62-44ea-9383-2816e649885d tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:12.131122 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fe69d805-ed62-44ea-9383-2816e649885d tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:12.131873 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fe69d805-ed62-44ea-9383-2816e649885d tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:12.132352 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fe69d805-ed62-44ea-9383-2816e649885d tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:12.132802 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fe69d805-ed62-44ea-9383-2816e649885d tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:12.172499 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-4b83b72a-add5-47e5-b234-b9ae6fa5ab1d tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:12.173130 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-4b83b72a-add5-47e5-b234-b9ae6fa5ab1d tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: c1297f74-578d-4a0d-8fd3-4197917a1dda] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:12.180312 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4b83b72a-add5-47e5-b234-b9ae6fa5ab1d tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:12.180807 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4b83b72a-add5-47e5-b234-b9ae6fa5ab1d tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:12.181255 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4b83b72a-add5-47e5-b234-b9ae6fa5ab1d tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:12.181985 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4b83b72a-add5-47e5-b234-b9ae6fa5ab1d tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:12.182504 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4b83b72a-add5-47e5-b234-b9ae6fa5ab1d tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:12.182868 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4b83b72a-add5-47e5-b234-b9ae6fa5ab1d tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:12.209981 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-fe69d805-ed62-44ea-9383-2816e649885d tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:12.218323 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-fe69d805-ed62-44ea-9383-2816e649885d tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/cc2a0b70-662f-4c7e-a08a-76faaa3ec166" status: 200 len: 1202 microversion: 2.1 time: 0.101292 Sep 14 09:33:12.218922 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3222/6422] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:33:12 2022] GET /compute/v2.1/servers/cc2a0b70-662f-4c7e-a08a-76faaa3ec166 => generated 1202 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:33:12.321906 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-4b83b72a-add5-47e5-b234-b9ae6fa5ab1d tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725d7beb4ec54b86a455af0d7bd0ce19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c197eded81494b818b1e56f4c01432c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:12.330140 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-4b83b72a-add5-47e5-b234-b9ae6fa5ab1d tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/c1297f74-578d-4a0d-8fd3-4197917a1dda" status: 200 len: 1697 microversion: 2.1 time: 0.161640 Sep 14 09:33:12.330723 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3201/6423] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:33:12 2022] GET /compute/v2.1/servers/c1297f74-578d-4a0d-8fd3-4197917a1dda => generated 1697 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:33:12.698998 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-d4887a4b-7880-4440-903d-57e16e106aec req-14999d3d-6d66-4de1-b5dd-c6c925456046 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9579aa98-cb7a-46a9-89eb-be0f1f823acf", "name": "network-vif-plugged", "status": "completed", "tag": "cfcdadc8-6f47-4775-8ac4-2702e6bf0018"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:33:12.712734 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-d4887a4b-7880-4440-903d-57e16e106aec req-14999d3d-6d66-4de1-b5dd-c6c925456046 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:12.713550 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-d4887a4b-7880-4440-903d-57e16e106aec req-14999d3d-6d66-4de1-b5dd-c6c925456046 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:12.714203 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-d4887a4b-7880-4440-903d-57e16e106aec req-14999d3d-6d66-4de1-b5dd-c6c925456046 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:12.726606 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-d4887a4b-7880-4440-903d-57e16e106aec req-14999d3d-6d66-4de1-b5dd-c6c925456046 service nova] Creating event network-vif-plugged:cfcdadc8-6f47-4775-8ac4-2702e6bf0018 for instance 9579aa98-cb7a-46a9-89eb-be0f1f823acf on n-h2-836830-18 Sep 14 09:33:12.731940 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-d4887a4b-7880-4440-903d-57e16e106aec req-14999d3d-6d66-4de1-b5dd-c6c925456046 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038158 Sep 14 09:33:12.732538 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3223/6424] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:33:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:33:12.960107 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-6c33b7a8-f6af-4e4e-bf4a-22116ada4da1 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:12.960684 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-6c33b7a8-f6af-4e4e-bf4a-22116ada4da1 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] [instance: 9579aa98-cb7a-46a9-89eb-be0f1f823acf] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:12.967923 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6c33b7a8-f6af-4e4e-bf4a-22116ada4da1 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:12.968418 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6c33b7a8-f6af-4e4e-bf4a-22116ada4da1 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:12.968895 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6c33b7a8-f6af-4e4e-bf4a-22116ada4da1 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:12.969605 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6c33b7a8-f6af-4e4e-bf4a-22116ada4da1 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:12.970056 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6c33b7a8-f6af-4e4e-bf4a-22116ada4da1 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:12.970480 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6c33b7a8-f6af-4e4e-bf4a-22116ada4da1 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:13.103955 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-6c33b7a8-f6af-4e4e-bf4a-22116ada4da1 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddfe63b5ac0d421392a768f97ce4bfbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a11896b0244a4f1e859986b87a17affd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:13.112030 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-6c33b7a8-f6af-4e4e-bf4a-22116ada4da1 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] 10.222.0.60 "GET /compute/v2.1/servers/9579aa98-cb7a-46a9-89eb-be0f1f823acf" status: 200 len: 1319 microversion: 2.1 time: 0.156412 Sep 14 09:33:13.112610 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3202/6425] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:33:12 2022] GET /compute/v2.1/servers/9579aa98-cb7a-46a9-89eb-be0f1f823acf => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:33:13.243265 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-9a9a51bc-d713-4f96-b28a-161556fd7470 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:13.243936 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-9a9a51bc-d713-4f96-b28a-161556fd7470 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: cc2a0b70-662f-4c7e-a08a-76faaa3ec166] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:13.250226 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9a9a51bc-d713-4f96-b28a-161556fd7470 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:13.250725 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9a9a51bc-d713-4f96-b28a-161556fd7470 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:13.251198 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9a9a51bc-d713-4f96-b28a-161556fd7470 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:13.251907 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9a9a51bc-d713-4f96-b28a-161556fd7470 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:13.252375 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9a9a51bc-d713-4f96-b28a-161556fd7470 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:13.253362 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9a9a51bc-d713-4f96-b28a-161556fd7470 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:13.319954 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-9a9a51bc-d713-4f96-b28a-161556fd7470 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:13.328510 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-9a9a51bc-d713-4f96-b28a-161556fd7470 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/cc2a0b70-662f-4c7e-a08a-76faaa3ec166" status: 200 len: 1202 microversion: 2.1 time: 0.090404 Sep 14 09:33:13.332548 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3224/6426] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:33:13 2022] GET /compute/v2.1/servers/cc2a0b70-662f-4c7e-a08a-76faaa3ec166 => generated 1202 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:33:13.354085 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d19bba0e-1342-43a1-84ec-bea183a53368 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:13.354716 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-d19bba0e-1342-43a1-84ec-bea183a53368 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: c1297f74-578d-4a0d-8fd3-4197917a1dda] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:13.360802 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d19bba0e-1342-43a1-84ec-bea183a53368 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:13.361301 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d19bba0e-1342-43a1-84ec-bea183a53368 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:13.361751 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d19bba0e-1342-43a1-84ec-bea183a53368 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:13.363017 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d19bba0e-1342-43a1-84ec-bea183a53368 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:13.363486 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d19bba0e-1342-43a1-84ec-bea183a53368 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:13.363920 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d19bba0e-1342-43a1-84ec-bea183a53368 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:13.497453 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-d19bba0e-1342-43a1-84ec-bea183a53368 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725d7beb4ec54b86a455af0d7bd0ce19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c197eded81494b818b1e56f4c01432c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:13.505886 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d19bba0e-1342-43a1-84ec-bea183a53368 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/c1297f74-578d-4a0d-8fd3-4197917a1dda" status: 200 len: 1697 microversion: 2.1 time: 0.156031 Sep 14 09:33:13.506478 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3203/6427] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:33:13 2022] GET /compute/v2.1/servers/c1297f74-578d-4a0d-8fd3-4197917a1dda => generated 1697 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:33:14.134489 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-7aef636a-9c3e-4d07-afdd-df0a6f240a36 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:14.135155 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-7aef636a-9c3e-4d07-afdd-df0a6f240a36 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] [instance: 9579aa98-cb7a-46a9-89eb-be0f1f823acf] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:14.141478 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7aef636a-9c3e-4d07-afdd-df0a6f240a36 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:14.141997 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7aef636a-9c3e-4d07-afdd-df0a6f240a36 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:14.142460 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7aef636a-9c3e-4d07-afdd-df0a6f240a36 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:14.143727 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7aef636a-9c3e-4d07-afdd-df0a6f240a36 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:14.144203 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7aef636a-9c3e-4d07-afdd-df0a6f240a36 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:14.144648 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7aef636a-9c3e-4d07-afdd-df0a6f240a36 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:14.280682 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-7aef636a-9c3e-4d07-afdd-df0a6f240a36 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddfe63b5ac0d421392a768f97ce4bfbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a11896b0244a4f1e859986b87a17affd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:14.289678 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-7aef636a-9c3e-4d07-afdd-df0a6f240a36 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] 10.222.0.60 "GET /compute/v2.1/servers/9579aa98-cb7a-46a9-89eb-be0f1f823acf" status: 200 len: 1508 microversion: 2.1 time: 0.159048 Sep 14 09:33:14.290355 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3225/6428] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:33:14 2022] GET /compute/v2.1/servers/9579aa98-cb7a-46a9-89eb-be0f1f823acf => generated 1508 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:33:14.312849 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-361754f4-5644-400c-95bb-828524d19172 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "75cb850a-4357-49eb-a0a1-862b47a2b22d", "device": "/dev/sdb"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:33:14.315465 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-361754f4-5644-400c-95bb-828524d19172 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] [instance: 9579aa98-cb7a-46a9-89eb-be0f1f823acf] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:14.322684 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-361754f4-5644-400c-95bb-828524d19172 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:14.323219 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-361754f4-5644-400c-95bb-828524d19172 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:14.323920 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-361754f4-5644-400c-95bb-828524d19172 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:14.325788 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-361754f4-5644-400c-95bb-828524d19172 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:14.326203 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-361754f4-5644-400c-95bb-828524d19172 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:14.326639 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-361754f4-5644-400c-95bb-828524d19172 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:14.354765 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-80d39c84-1791-4298-9be2-e208511c60ff tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:14.355420 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-80d39c84-1791-4298-9be2-e208511c60ff tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: cc2a0b70-662f-4c7e-a08a-76faaa3ec166] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:14.373009 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-80d39c84-1791-4298-9be2-e208511c60ff tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:14.375229 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-80d39c84-1791-4298-9be2-e208511c60ff tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:14.376113 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-80d39c84-1791-4298-9be2-e208511c60ff tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:14.377215 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-80d39c84-1791-4298-9be2-e208511c60ff tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:14.379633 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-80d39c84-1791-4298-9be2-e208511c60ff tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:14.380715 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-80d39c84-1791-4298-9be2-e208511c60ff tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:14.424545 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-80d39c84-1791-4298-9be2-e208511c60ff tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:14.425370 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-80d39c84-1791-4298-9be2-e208511c60ff tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:14.426236 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-80d39c84-1791-4298-9be2-e208511c60ff tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:14.426917 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.objects.instance [None req-80d39c84-1791-4298-9be2-e208511c60ff tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lazy-loading 'fault' on Instance uuid cc2a0b70-662f-4c7e-a08a-76faaa3ec166 {{(pid=128758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:33:14.430800 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=100 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:33:14.477298 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-80d39c84-1791-4298-9be2-e208511c60ff tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:14.487804 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-80d39c84-1791-4298-9be2-e208511c60ff tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/cc2a0b70-662f-4c7e-a08a-76faaa3ec166" status: 200 len: 1207 microversion: 2.1 time: 0.136811 Sep 14 09:33:14.504374 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3226/6429] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:33:14 2022] GET /compute/v2.1/servers/cc2a0b70-662f-4c7e-a08a-76faaa3ec166 => generated 1207 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:33:14.532376 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b716f522-b811-4ae4-a9e1-7c69dd2a157b tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:14.533090 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-b716f522-b811-4ae4-a9e1-7c69dd2a157b tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: c1297f74-578d-4a0d-8fd3-4197917a1dda] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:14.542869 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b716f522-b811-4ae4-a9e1-7c69dd2a157b tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:14.543733 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b716f522-b811-4ae4-a9e1-7c69dd2a157b tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:14.544409 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b716f522-b811-4ae4-a9e1-7c69dd2a157b tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:14.545512 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b716f522-b811-4ae4-a9e1-7c69dd2a157b tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:14.546211 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b716f522-b811-4ae4-a9e1-7c69dd2a157b tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:14.546747 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b716f522-b811-4ae4-a9e1-7c69dd2a157b tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:14.656478 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-361754f4-5644-400c-95bb-828524d19172 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] 10.222.0.60 "POST /compute/v2.1/servers/9579aa98-cb7a-46a9-89eb-be0f1f823acf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.347917 Sep 14 09:33:14.657378 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3204/6430] 10.222.0.60 () {60 vars in 1323 bytes} [Wed Sep 14 09:33:14 2022] POST /compute/v2.1/servers/9579aa98-cb7a-46a9-89eb-be0f1f823acf/os-volume_attachments => generated 194 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:33:14.718706 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-b716f522-b811-4ae4-a9e1-7c69dd2a157b tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725d7beb4ec54b86a455af0d7bd0ce19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c197eded81494b818b1e56f4c01432c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:14.727524 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-b716f522-b811-4ae4-a9e1-7c69dd2a157b tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/c1297f74-578d-4a0d-8fd3-4197917a1dda" status: 200 len: 1697 microversion: 2.1 time: 0.199311 Sep 14 09:33:14.734920 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3227/6431] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:33:14 2022] GET /compute/v2.1/servers/c1297f74-578d-4a0d-8fd3-4197917a1dda => generated 1697 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:33:15.512094 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-94276ba4-8122-4197-bb77-95eaff2b96b9 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:15.513137 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-94276ba4-8122-4197-bb77-95eaff2b96b9 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: cc2a0b70-662f-4c7e-a08a-76faaa3ec166] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:15.520682 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-94276ba4-8122-4197-bb77-95eaff2b96b9 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:15.521278 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-94276ba4-8122-4197-bb77-95eaff2b96b9 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:15.521785 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-94276ba4-8122-4197-bb77-95eaff2b96b9 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:15.522589 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-94276ba4-8122-4197-bb77-95eaff2b96b9 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:15.523297 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-94276ba4-8122-4197-bb77-95eaff2b96b9 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:15.523805 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-94276ba4-8122-4197-bb77-95eaff2b96b9 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:15.538759 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-94276ba4-8122-4197-bb77-95eaff2b96b9 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] HTTP exception thrown: Instance cc2a0b70-662f-4c7e-a08a-76faaa3ec166 could not be found. Sep 14 09:33:15.540554 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-94276ba4-8122-4197-bb77-95eaff2b96b9 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Request method failure captured: Sep 14 09:33:15.540554 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/cc2a0b70-662f-4c7e-a08a-76faaa3ec166 HTTP/1.1 Sep 14 09:33:15.540554 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:33:15.540554 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:33:15.540554 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:33:15.540554 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:33:15.540554 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:33:15.540554 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:33:15.540554 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:33:15.540554 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:33:15.540554 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZ7vSEasHnu7hRXol9c-LZuMaC9uK137X6F5rG7UmloUJeCaIX1XI8DyW-6MYPzXIn8tJlRUDBfS9Xo7ko5WvlkRtwNLi8r30OmEJBkLllR4uOPeHedowZTMuQPwQppwmIxlx0K05UlAJOyH1eD16mNE7GFFk01jmhPM_9wCZyZUFi8 Sep 14 09:33:15.540554 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:33:15.540554 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:33:15.540554 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:33:15.540554 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:33:15.540554 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:33:15.540554 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:33:15.540554 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 0fca803d9ffa4b4ab0371c0d6a96a5a2 Sep 14 09:33:15.540554 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-TestVolumeBootPattern-1945148622 Sep 14 09:33:15.540554 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:33:15.540554 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:33:15.540554 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0fca803d9ffa4b4ab0371c0d6a96a5a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0fca803d9ffa4b4ab0371c0d6a96a5a2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0fca803d9ffa4b4ab0371c0d6a96a5a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0fca803d9ffa4b4ab0371c0d6a96a5a2"}]}] Sep 14 09:33:15.540554 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-TestVolumeBootPattern-1945148622 Sep 14 09:33:15.540554 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 0fca803d9ffa4b4ab0371c0d6a96a5a2 Sep 14 09:33:15.540554 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-TestVolumeBootPattern-1945148622 Sep 14 09:33:15.540554 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-TestVolumeBootPattern-1945148622-project Sep 14 09:33:15.540554 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:33:15.540554 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:33:15.540554 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 80257054a25540c294e1787780b601b4 Sep 14 09:33:15.540554 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-TestVolumeBootPattern-1945148622-project Sep 14 09:33:15.540554 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:33:15.540554 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance cc2a0b70-662f-4c7e-a08a-76faaa3ec166 could not be found. Sep 14 09:33:15.540554 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': 'cc2a0b70-662f-4c7e-a08a-76faaa3ec166'} Sep 14 09:33:15.540554 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:33:15.540554 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:33:15.540554 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:33:15.540554 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:33:15.540554 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:33:15.540554 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:33:15.540554 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:33:15.540554 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:33:15.540554 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:33:15.540554 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:33:15.540554 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc2a0b70-662f-4c7e-a08a-76faaa3ec166 could not be found. Sep 14 09:33:15.540554 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:33:15.540554 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:33:15.540554 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:33:15.540554 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:33:15.540554 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:33:15.540554 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:33:15.540554 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:33:15.540554 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:33:15.540554 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:33:15.540554 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:33:15.540554 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:33:15.540554 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:33:15.540554 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:33:15.540554 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:33:15.540554 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:33:15.540554 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:33:15.540554 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc2a0b70-662f-4c7e-a08a-76faaa3ec166 could not be found. Sep 14 09:33:15.540554 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:33:15.540554 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:33:15.540554 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:33:15.546128 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:33:15.546128 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:33:15.546128 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:33:15.546128 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:33:15.546128 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:33:15.546128 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc2a0b70-662f-4c7e-a08a-76faaa3ec166 could not be found. Sep 14 09:33:15.546128 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:33:15.546128 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-94276ba4-8122-4197-bb77-95eaff2b96b9 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Returning 404 to user: Instance cc2a0b70-662f-4c7e-a08a-76faaa3ec166 could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:33:15.546128 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-94276ba4-8122-4197-bb77-95eaff2b96b9 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/cc2a0b70-662f-4c7e-a08a-76faaa3ec166" status: 404 len: 111 microversion: 2.1 time: 0.036072 Sep 14 09:33:15.547802 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3205/6432] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:33:15 2022] GET /compute/v2.1/servers/cc2a0b70-662f-4c7e-a08a-76faaa3ec166 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:33:15.751706 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-fdc33369-c18a-4827-b3dc-8f1ecc896630 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:15.752356 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-fdc33369-c18a-4827-b3dc-8f1ecc896630 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: c1297f74-578d-4a0d-8fd3-4197917a1dda] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:15.767572 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fdc33369-c18a-4827-b3dc-8f1ecc896630 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:15.768096 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fdc33369-c18a-4827-b3dc-8f1ecc896630 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:15.769074 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fdc33369-c18a-4827-b3dc-8f1ecc896630 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:15.769813 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fdc33369-c18a-4827-b3dc-8f1ecc896630 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:15.770294 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fdc33369-c18a-4827-b3dc-8f1ecc896630 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:15.770744 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fdc33369-c18a-4827-b3dc-8f1ecc896630 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:15.852394 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=2 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:33:15.934079 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-fdc33369-c18a-4827-b3dc-8f1ecc896630 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725d7beb4ec54b86a455af0d7bd0ce19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c197eded81494b818b1e56f4c01432c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:15.942604 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-fdc33369-c18a-4827-b3dc-8f1ecc896630 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/c1297f74-578d-4a0d-8fd3-4197917a1dda" status: 200 len: 1697 microversion: 2.1 time: 0.195119 Sep 14 09:33:15.943244 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3228/6433] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:33:15 2022] GET /compute/v2.1/servers/c1297f74-578d-4a0d-8fd3-4197917a1dda => generated 1697 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:33:16.967450 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-99a875c8-4bbc-42b4-be90-5776edb62201 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:16.968073 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-99a875c8-4bbc-42b4-be90-5776edb62201 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: c1297f74-578d-4a0d-8fd3-4197917a1dda] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:16.975923 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-99a875c8-4bbc-42b4-be90-5776edb62201 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:16.976853 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-99a875c8-4bbc-42b4-be90-5776edb62201 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:16.977525 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-99a875c8-4bbc-42b4-be90-5776edb62201 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:16.978290 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-99a875c8-4bbc-42b4-be90-5776edb62201 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:16.978969 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-99a875c8-4bbc-42b4-be90-5776edb62201 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:16.979398 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-99a875c8-4bbc-42b4-be90-5776edb62201 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:17.141882 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-99a875c8-4bbc-42b4-be90-5776edb62201 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725d7beb4ec54b86a455af0d7bd0ce19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c197eded81494b818b1e56f4c01432c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:17.150859 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-99a875c8-4bbc-42b4-be90-5776edb62201 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/c1297f74-578d-4a0d-8fd3-4197917a1dda" status: 200 len: 1697 microversion: 2.1 time: 0.187591 Sep 14 09:33:17.151723 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3206/6434] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:33:16 2022] GET /compute/v2.1/servers/c1297f74-578d-4a0d-8fd3-4197917a1dda => generated 1697 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:33:17.712286 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ae31fea8-7338-45e3-9f71-51c72d1ed0d9 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:17.713761 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-ae31fea8-7338-45e3-9f71-51c72d1ed0d9 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: c7f40b74-e569-4fe2-8227-c4c93e70d37d] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:17.722307 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=8 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:33:17.727528 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ae31fea8-7338-45e3-9f71-51c72d1ed0d9 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:17.728288 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ae31fea8-7338-45e3-9f71-51c72d1ed0d9 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:17.728749 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ae31fea8-7338-45e3-9f71-51c72d1ed0d9 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:17.729534 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ae31fea8-7338-45e3-9f71-51c72d1ed0d9 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:17.730056 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ae31fea8-7338-45e3-9f71-51c72d1ed0d9 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:17.730498 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ae31fea8-7338-45e3-9f71-51c72d1ed0d9 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:17.747133 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-ae31fea8-7338-45e3-9f71-51c72d1ed0d9 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] HTTP exception thrown: Instance c7f40b74-e569-4fe2-8227-c4c93e70d37d could not be found. Sep 14 09:33:17.749464 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ae31fea8-7338-45e3-9f71-51c72d1ed0d9 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Request method failure captured: Sep 14 09:33:17.749464 n-d-836830-18 devstack@n-api.service[128758]: request: DELETE /compute/v2.1/servers/c7f40b74-e569-4fe2-8227-c4c93e70d37d HTTP/1.1 Sep 14 09:33:17.749464 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 09:33:17.749464 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 09:33:17.749464 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 09:33:17.749464 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 09:33:17.749464 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 09:33:17.749464 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 09:33:17.749464 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 09:33:17.749464 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 09:33:17.749464 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZ7vSEasHnu7hRXol9c-LZuMaC9uK137X6F5rG7UmloUJeCaIX1XI8DyW-6MYPzXIn8tJlRUDBfS9Xo7ko5WvlkRtwNLi8r30OmEJBkLllR4uOPeHedowZTMuQPwQppwmIxlx0K05UlAJOyH1eD16mNE7GFFk01jmhPM_9wCZyZUFi8 Sep 14 09:33:17.749464 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 09:33:17.749464 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 09:33:17.749464 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 09:33:17.749464 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 09:33:17.749464 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 09:33:17.749464 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 09:33:17.749464 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 0fca803d9ffa4b4ab0371c0d6a96a5a2 Sep 14 09:33:17.749464 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-TestVolumeBootPattern-1945148622 Sep 14 09:33:17.749464 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 09:33:17.749464 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 09:33:17.749464 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0fca803d9ffa4b4ab0371c0d6a96a5a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0fca803d9ffa4b4ab0371c0d6a96a5a2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0fca803d9ffa4b4ab0371c0d6a96a5a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0fca803d9ffa4b4ab0371c0d6a96a5a2"}]}] Sep 14 09:33:17.749464 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-TestVolumeBootPattern-1945148622 Sep 14 09:33:17.749464 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 0fca803d9ffa4b4ab0371c0d6a96a5a2 Sep 14 09:33:17.749464 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-TestVolumeBootPattern-1945148622 Sep 14 09:33:17.749464 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-TestVolumeBootPattern-1945148622-project Sep 14 09:33:17.749464 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 09:33:17.749464 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 09:33:17.749464 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 80257054a25540c294e1787780b601b4 Sep 14 09:33:17.749464 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-TestVolumeBootPattern-1945148622-project Sep 14 09:33:17.749464 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 09:33:17.749464 n-d-836830-18 devstack@n-api.service[128758]: exception: Instance c7f40b74-e569-4fe2-8227-c4c93e70d37d could not be found. Sep 14 09:33:17.749464 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': 'c7f40b74-e569-4fe2-8227-c4c93e70d37d'} Sep 14 09:33:17.749464 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:33:17.749464 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:33:17.749464 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:33:17.749464 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:33:17.749464 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:33:17.749464 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:33:17.749464 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:33:17.749464 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:33:17.749464 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:33:17.749464 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:33:17.749464 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7f40b74-e569-4fe2-8227-c4c93e70d37d could not be found. Sep 14 09:33:17.749464 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:33:17.749464 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:33:17.749464 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:33:17.749464 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:33:17.749464 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:33:17.749464 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:33:17.749464 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:33:17.749464 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:33:17.749464 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:33:17.749464 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:33:17.749464 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 09:33:17.749464 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 09:33:17.749464 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 09:33:17.749464 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 09:33:17.749464 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:33:17.749464 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:33:17.749464 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:33:17.749464 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:33:17.755127 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7f40b74-e569-4fe2-8227-c4c93e70d37d could not be found. Sep 14 09:33:17.755127 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:33:17.755127 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:33:17.755127 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:33:17.755127 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:33:17.755127 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:33:17.755127 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:33:17.755127 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:33:17.755127 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:33:17.755127 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7f40b74-e569-4fe2-8227-c4c93e70d37d could not be found. Sep 14 09:33:17.755127 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:33:17.756885 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ae31fea8-7338-45e3-9f71-51c72d1ed0d9 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Returning 404 to user: Instance c7f40b74-e569-4fe2-8227-c4c93e70d37d could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:33:17.758251 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-ae31fea8-7338-45e3-9f71-51c72d1ed0d9 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "DELETE /compute/v2.1/servers/c7f40b74-e569-4fe2-8227-c4c93e70d37d" status: 404 len: 111 microversion: 2.1 time: 0.052152 Sep 14 09:33:17.759003 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3229/6435] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:33:17 2022] DELETE /compute/v2.1/servers/c7f40b74-e569-4fe2-8227-c4c93e70d37d => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:33:17.767830 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-bd834590-6455-4190-a540-9ee3bec24a34 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:17.769735 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-bd834590-6455-4190-a540-9ee3bec24a34 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: c7f40b74-e569-4fe2-8227-c4c93e70d37d] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:17.776787 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bd834590-6455-4190-a540-9ee3bec24a34 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:17.777518 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bd834590-6455-4190-a540-9ee3bec24a34 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:17.778063 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bd834590-6455-4190-a540-9ee3bec24a34 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:17.779415 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bd834590-6455-4190-a540-9ee3bec24a34 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:17.780371 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bd834590-6455-4190-a540-9ee3bec24a34 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:17.780714 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bd834590-6455-4190-a540-9ee3bec24a34 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:17.798620 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-bd834590-6455-4190-a540-9ee3bec24a34 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] HTTP exception thrown: Instance c7f40b74-e569-4fe2-8227-c4c93e70d37d could not be found. Sep 14 09:33:17.800673 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-bd834590-6455-4190-a540-9ee3bec24a34 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Request method failure captured: Sep 14 09:33:17.800673 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/c7f40b74-e569-4fe2-8227-c4c93e70d37d HTTP/1.1 Sep 14 09:33:17.800673 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:33:17.800673 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:33:17.800673 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:33:17.800673 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:33:17.800673 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:33:17.800673 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:33:17.800673 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:33:17.800673 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:33:17.800673 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZ7vSEasHnu7hRXol9c-LZuMaC9uK137X6F5rG7UmloUJeCaIX1XI8DyW-6MYPzXIn8tJlRUDBfS9Xo7ko5WvlkRtwNLi8r30OmEJBkLllR4uOPeHedowZTMuQPwQppwmIxlx0K05UlAJOyH1eD16mNE7GFFk01jmhPM_9wCZyZUFi8 Sep 14 09:33:17.800673 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:33:17.800673 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:33:17.800673 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:33:17.800673 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:33:17.800673 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:33:17.800673 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:33:17.800673 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 0fca803d9ffa4b4ab0371c0d6a96a5a2 Sep 14 09:33:17.800673 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-TestVolumeBootPattern-1945148622 Sep 14 09:33:17.800673 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:33:17.800673 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:33:17.800673 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0fca803d9ffa4b4ab0371c0d6a96a5a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0fca803d9ffa4b4ab0371c0d6a96a5a2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0fca803d9ffa4b4ab0371c0d6a96a5a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0fca803d9ffa4b4ab0371c0d6a96a5a2"}]}] Sep 14 09:33:17.800673 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-TestVolumeBootPattern-1945148622 Sep 14 09:33:17.800673 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 0fca803d9ffa4b4ab0371c0d6a96a5a2 Sep 14 09:33:17.800673 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-TestVolumeBootPattern-1945148622 Sep 14 09:33:17.800673 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-TestVolumeBootPattern-1945148622-project Sep 14 09:33:17.800673 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:33:17.800673 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:33:17.800673 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 80257054a25540c294e1787780b601b4 Sep 14 09:33:17.800673 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-TestVolumeBootPattern-1945148622-project Sep 14 09:33:17.800673 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:33:17.800673 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance c7f40b74-e569-4fe2-8227-c4c93e70d37d could not be found. Sep 14 09:33:17.800673 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': 'c7f40b74-e569-4fe2-8227-c4c93e70d37d'} Sep 14 09:33:17.800673 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:33:17.800673 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:33:17.800673 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:33:17.800673 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:33:17.800673 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:33:17.800673 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:33:17.800673 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:33:17.800673 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:33:17.800673 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:33:17.800673 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:33:17.800673 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7f40b74-e569-4fe2-8227-c4c93e70d37d could not be found. Sep 14 09:33:17.800673 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:33:17.800673 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:33:17.800673 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:33:17.800673 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:33:17.800673 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:33:17.800673 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:33:17.800673 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:33:17.800673 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:33:17.800673 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:33:17.800673 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:33:17.800673 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:33:17.800673 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:33:17.800673 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:33:17.800673 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:33:17.800673 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:33:17.800673 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:33:17.800673 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7f40b74-e569-4fe2-8227-c4c93e70d37d could not be found. Sep 14 09:33:17.800673 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:33:17.800673 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:33:17.800673 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:33:17.806516 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:33:17.806516 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:33:17.806516 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:33:17.806516 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:33:17.806516 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:33:17.806516 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7f40b74-e569-4fe2-8227-c4c93e70d37d could not be found. Sep 14 09:33:17.806516 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:33:17.806516 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-bd834590-6455-4190-a540-9ee3bec24a34 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Returning 404 to user: Instance c7f40b74-e569-4fe2-8227-c4c93e70d37d could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:33:17.807662 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-bd834590-6455-4190-a540-9ee3bec24a34 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/c7f40b74-e569-4fe2-8227-c4c93e70d37d" status: 404 len: 111 microversion: 2.1 time: 0.042783 Sep 14 09:33:17.810999 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3207/6436] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:33:17 2022] GET /compute/v2.1/servers/c7f40b74-e569-4fe2-8227-c4c93e70d37d => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:33:18.176034 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-20eb4ed2-d39a-4a89-836c-d503dd68d1cb tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:18.176804 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-20eb4ed2-d39a-4a89-836c-d503dd68d1cb tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: c1297f74-578d-4a0d-8fd3-4197917a1dda] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:18.184974 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-20eb4ed2-d39a-4a89-836c-d503dd68d1cb tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:18.186218 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-20eb4ed2-d39a-4a89-836c-d503dd68d1cb tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:18.186702 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-20eb4ed2-d39a-4a89-836c-d503dd68d1cb tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:18.188330 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-20eb4ed2-d39a-4a89-836c-d503dd68d1cb tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:18.188940 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-20eb4ed2-d39a-4a89-836c-d503dd68d1cb tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:18.190017 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-20eb4ed2-d39a-4a89-836c-d503dd68d1cb tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:18.308872 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-20a828ed-e6ef-4a48-bdde-dea2f9ca9524 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:18.309766 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-20a828ed-e6ef-4a48-bdde-dea2f9ca9524 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: cc2a0b70-662f-4c7e-a08a-76faaa3ec166] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:18.320234 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-20a828ed-e6ef-4a48-bdde-dea2f9ca9524 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:18.321095 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-20a828ed-e6ef-4a48-bdde-dea2f9ca9524 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:18.321626 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-20a828ed-e6ef-4a48-bdde-dea2f9ca9524 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:18.322429 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-20a828ed-e6ef-4a48-bdde-dea2f9ca9524 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:18.323232 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-20a828ed-e6ef-4a48-bdde-dea2f9ca9524 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:18.323762 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-20a828ed-e6ef-4a48-bdde-dea2f9ca9524 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:18.341082 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-20a828ed-e6ef-4a48-bdde-dea2f9ca9524 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] HTTP exception thrown: Instance cc2a0b70-662f-4c7e-a08a-76faaa3ec166 could not be found. Sep 14 09:33:18.343032 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-20a828ed-e6ef-4a48-bdde-dea2f9ca9524 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Request method failure captured: Sep 14 09:33:18.343032 n-d-836830-18 devstack@n-api.service[128759]: request: DELETE /compute/v2.1/servers/cc2a0b70-662f-4c7e-a08a-76faaa3ec166 HTTP/1.1 Sep 14 09:33:18.343032 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:33:18.343032 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:33:18.343032 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:33:18.343032 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:33:18.343032 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:33:18.343032 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:33:18.343032 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:33:18.343032 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:33:18.343032 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZ7vSEasHnu7hRXol9c-LZuMaC9uK137X6F5rG7UmloUJeCaIX1XI8DyW-6MYPzXIn8tJlRUDBfS9Xo7ko5WvlkRtwNLi8r30OmEJBkLllR4uOPeHedowZTMuQPwQppwmIxlx0K05UlAJOyH1eD16mNE7GFFk01jmhPM_9wCZyZUFi8 Sep 14 09:33:18.343032 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:33:18.343032 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:33:18.343032 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:33:18.343032 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:33:18.343032 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:33:18.343032 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:33:18.343032 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 0fca803d9ffa4b4ab0371c0d6a96a5a2 Sep 14 09:33:18.343032 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-TestVolumeBootPattern-1945148622 Sep 14 09:33:18.343032 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:33:18.343032 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:33:18.343032 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0fca803d9ffa4b4ab0371c0d6a96a5a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0fca803d9ffa4b4ab0371c0d6a96a5a2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0fca803d9ffa4b4ab0371c0d6a96a5a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0fca803d9ffa4b4ab0371c0d6a96a5a2"}]}] Sep 14 09:33:18.343032 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-TestVolumeBootPattern-1945148622 Sep 14 09:33:18.343032 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 0fca803d9ffa4b4ab0371c0d6a96a5a2 Sep 14 09:33:18.343032 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-TestVolumeBootPattern-1945148622 Sep 14 09:33:18.343032 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-TestVolumeBootPattern-1945148622-project Sep 14 09:33:18.343032 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:33:18.343032 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:33:18.343032 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 80257054a25540c294e1787780b601b4 Sep 14 09:33:18.343032 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-TestVolumeBootPattern-1945148622-project Sep 14 09:33:18.343032 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:33:18.343032 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance cc2a0b70-662f-4c7e-a08a-76faaa3ec166 could not be found. Sep 14 09:33:18.343032 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': 'cc2a0b70-662f-4c7e-a08a-76faaa3ec166'} Sep 14 09:33:18.343032 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:33:18.343032 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:33:18.343032 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:33:18.343032 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:33:18.343032 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:33:18.343032 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:33:18.343032 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:33:18.343032 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:33:18.343032 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:33:18.343032 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:33:18.343032 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc2a0b70-662f-4c7e-a08a-76faaa3ec166 could not be found. Sep 14 09:33:18.343032 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:33:18.343032 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:33:18.343032 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:33:18.343032 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:33:18.343032 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:33:18.343032 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:33:18.343032 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:33:18.343032 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:33:18.343032 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:33:18.343032 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:33:18.343032 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 09:33:18.343032 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 09:33:18.343032 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 09:33:18.343032 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 09:33:18.343032 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:33:18.343032 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:33:18.343032 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:33:18.343032 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:33:18.348317 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc2a0b70-662f-4c7e-a08a-76faaa3ec166 could not be found. Sep 14 09:33:18.348317 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:33:18.348317 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:33:18.348317 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:33:18.348317 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:33:18.348317 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:33:18.348317 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:33:18.348317 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:33:18.348317 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:33:18.348317 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc2a0b70-662f-4c7e-a08a-76faaa3ec166 could not be found. Sep 14 09:33:18.348317 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:33:18.350335 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-20a828ed-e6ef-4a48-bdde-dea2f9ca9524 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Returning 404 to user: Instance cc2a0b70-662f-4c7e-a08a-76faaa3ec166 could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:33:18.351465 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-20a828ed-e6ef-4a48-bdde-dea2f9ca9524 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "DELETE /compute/v2.1/servers/cc2a0b70-662f-4c7e-a08a-76faaa3ec166" status: 404 len: 111 microversion: 2.1 time: 0.047744 Sep 14 09:33:18.352053 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3208/6437] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:33:18 2022] DELETE /compute/v2.1/servers/cc2a0b70-662f-4c7e-a08a-76faaa3ec166 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:33:18.364207 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f8a4421a-b797-4295-91fa-d3e749462ff8 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:18.364925 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f8a4421a-b797-4295-91fa-d3e749462ff8 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: cc2a0b70-662f-4c7e-a08a-76faaa3ec166] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:18.370239 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-20eb4ed2-d39a-4a89-836c-d503dd68d1cb tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725d7beb4ec54b86a455af0d7bd0ce19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c197eded81494b818b1e56f4c01432c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:18.373694 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f8a4421a-b797-4295-91fa-d3e749462ff8 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:18.374211 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f8a4421a-b797-4295-91fa-d3e749462ff8 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:18.375080 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f8a4421a-b797-4295-91fa-d3e749462ff8 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:18.375620 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f8a4421a-b797-4295-91fa-d3e749462ff8 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:18.376306 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f8a4421a-b797-4295-91fa-d3e749462ff8 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:18.377052 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f8a4421a-b797-4295-91fa-d3e749462ff8 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:18.380152 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-20eb4ed2-d39a-4a89-836c-d503dd68d1cb tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/c1297f74-578d-4a0d-8fd3-4197917a1dda" status: 200 len: 1697 microversion: 2.1 time: 0.209454 Sep 14 09:33:18.380844 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3230/6438] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:33:18 2022] GET /compute/v2.1/servers/c1297f74-578d-4a0d-8fd3-4197917a1dda => generated 1697 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:33:18.394770 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-f8a4421a-b797-4295-91fa-d3e749462ff8 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] HTTP exception thrown: Instance cc2a0b70-662f-4c7e-a08a-76faaa3ec166 could not be found. Sep 14 09:33:18.396378 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f8a4421a-b797-4295-91fa-d3e749462ff8 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Request method failure captured: Sep 14 09:33:18.396378 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/cc2a0b70-662f-4c7e-a08a-76faaa3ec166 HTTP/1.1 Sep 14 09:33:18.396378 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:33:18.396378 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:33:18.396378 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:33:18.396378 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:33:18.396378 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:33:18.396378 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:33:18.396378 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:33:18.396378 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:33:18.396378 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZ7vSEasHnu7hRXol9c-LZuMaC9uK137X6F5rG7UmloUJeCaIX1XI8DyW-6MYPzXIn8tJlRUDBfS9Xo7ko5WvlkRtwNLi8r30OmEJBkLllR4uOPeHedowZTMuQPwQppwmIxlx0K05UlAJOyH1eD16mNE7GFFk01jmhPM_9wCZyZUFi8 Sep 14 09:33:18.396378 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:33:18.396378 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:33:18.396378 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:33:18.396378 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:33:18.396378 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:33:18.396378 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:33:18.396378 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 0fca803d9ffa4b4ab0371c0d6a96a5a2 Sep 14 09:33:18.396378 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-TestVolumeBootPattern-1945148622 Sep 14 09:33:18.396378 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:33:18.396378 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:33:18.396378 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0fca803d9ffa4b4ab0371c0d6a96a5a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0fca803d9ffa4b4ab0371c0d6a96a5a2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0fca803d9ffa4b4ab0371c0d6a96a5a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0fca803d9ffa4b4ab0371c0d6a96a5a2"}]}] Sep 14 09:33:18.396378 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-TestVolumeBootPattern-1945148622 Sep 14 09:33:18.396378 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 0fca803d9ffa4b4ab0371c0d6a96a5a2 Sep 14 09:33:18.396378 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-TestVolumeBootPattern-1945148622 Sep 14 09:33:18.396378 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-TestVolumeBootPattern-1945148622-project Sep 14 09:33:18.396378 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:33:18.396378 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:33:18.396378 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 80257054a25540c294e1787780b601b4 Sep 14 09:33:18.396378 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-TestVolumeBootPattern-1945148622-project Sep 14 09:33:18.396378 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:33:18.396378 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance cc2a0b70-662f-4c7e-a08a-76faaa3ec166 could not be found. Sep 14 09:33:18.396378 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': 'cc2a0b70-662f-4c7e-a08a-76faaa3ec166'} Sep 14 09:33:18.396378 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:33:18.396378 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:33:18.396378 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:33:18.396378 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:33:18.396378 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:33:18.396378 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:33:18.396378 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:33:18.396378 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:33:18.396378 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:33:18.396378 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:33:18.396378 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc2a0b70-662f-4c7e-a08a-76faaa3ec166 could not be found. Sep 14 09:33:18.396378 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:33:18.396378 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:33:18.396378 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:33:18.396378 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:33:18.396378 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:33:18.396378 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:33:18.396378 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:33:18.396378 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:33:18.396378 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:33:18.396378 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:33:18.396378 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:33:18.396378 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:33:18.396378 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:33:18.396378 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:33:18.396378 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:33:18.396378 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:33:18.396378 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc2a0b70-662f-4c7e-a08a-76faaa3ec166 could not be found. Sep 14 09:33:18.396378 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:33:18.396378 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:33:18.396378 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:33:18.401801 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:33:18.401801 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:33:18.401801 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:33:18.401801 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:33:18.401801 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:33:18.401801 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc2a0b70-662f-4c7e-a08a-76faaa3ec166 could not be found. Sep 14 09:33:18.401801 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:33:18.401801 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f8a4421a-b797-4295-91fa-d3e749462ff8 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Returning 404 to user: Instance cc2a0b70-662f-4c7e-a08a-76faaa3ec166 could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:33:18.401801 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f8a4421a-b797-4295-91fa-d3e749462ff8 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/cc2a0b70-662f-4c7e-a08a-76faaa3ec166" status: 404 len: 111 microversion: 2.1 time: 0.041232 Sep 14 09:33:18.401801 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3209/6439] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:33:18 2022] GET /compute/v2.1/servers/cc2a0b70-662f-4c7e-a08a-76faaa3ec166 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:33:18.478103 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-3fdd573b-e838-496f-9596-f923be2a1496 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Action: 'create', calling method: .version_select at 0x7f7d3f2cd0d0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1345910784", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHgjcHb3nCwpnVkMnLJ3XU+OL4p/ts+x7BOoyXczp+jcF8DBwfbw/mIS1GCDs4E1WhGSeWUGsfSZoBLg8q4PHlxHgM8lhFd2AxWoz9/bpEruVUIGW/GW2I5rgjcajQJ1Zg=="}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:33:18.494829 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-3fdd573b-e838-496f-9596-f923be2a1496 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Getting quotas for project 0fca803d9ffa4b4ab0371c0d6a96a5a2. Resources: {'key_pairs'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:33:18.500559 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-3fdd573b-e838-496f-9596-f923be2a1496 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Getting quotas for user 80257054a25540c294e1787780b601b4 and project 0fca803d9ffa4b4ab0371c0d6a96a5a2. Resources: {'key_pairs'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:33:18.530682 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-3fdd573b-e838-496f-9596-f923be2a1496 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.056982 Sep 14 09:33:18.531578 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3231/6440] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Sep 14 09:33:18 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:33:19.410320 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ddce71e4-15f4-419d-a5ed-427be56fff4c tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:19.411039 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-ddce71e4-15f4-419d-a5ed-427be56fff4c tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: c1297f74-578d-4a0d-8fd3-4197917a1dda] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:19.417758 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ddce71e4-15f4-419d-a5ed-427be56fff4c tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:19.418531 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ddce71e4-15f4-419d-a5ed-427be56fff4c tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:19.419099 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ddce71e4-15f4-419d-a5ed-427be56fff4c tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:19.420072 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ddce71e4-15f4-419d-a5ed-427be56fff4c tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:19.420544 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ddce71e4-15f4-419d-a5ed-427be56fff4c tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:19.420972 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ddce71e4-15f4-419d-a5ed-427be56fff4c tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:19.632643 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-ddce71e4-15f4-419d-a5ed-427be56fff4c tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725d7beb4ec54b86a455af0d7bd0ce19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c197eded81494b818b1e56f4c01432c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:19.640852 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-ddce71e4-15f4-419d-a5ed-427be56fff4c tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/c1297f74-578d-4a0d-8fd3-4197917a1dda" status: 200 len: 1697 microversion: 2.1 time: 0.238271 Sep 14 09:33:19.641434 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3210/6441] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:33:19 2022] GET /compute/v2.1/servers/c1297f74-578d-4a0d-8fd3-4197917a1dda => generated 1697 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:33:20.665991 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-5675e8db-a9a5-46a5-aefc-c803e75f7233 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:20.666736 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-5675e8db-a9a5-46a5-aefc-c803e75f7233 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: c1297f74-578d-4a0d-8fd3-4197917a1dda] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:20.673808 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5675e8db-a9a5-46a5-aefc-c803e75f7233 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:20.674388 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5675e8db-a9a5-46a5-aefc-c803e75f7233 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:20.674964 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5675e8db-a9a5-46a5-aefc-c803e75f7233 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:20.675761 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5675e8db-a9a5-46a5-aefc-c803e75f7233 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:20.676303 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5675e8db-a9a5-46a5-aefc-c803e75f7233 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:20.676812 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5675e8db-a9a5-46a5-aefc-c803e75f7233 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:20.836585 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-5675e8db-a9a5-46a5-aefc-c803e75f7233 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725d7beb4ec54b86a455af0d7bd0ce19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c197eded81494b818b1e56f4c01432c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:20.846152 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-5675e8db-a9a5-46a5-aefc-c803e75f7233 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/c1297f74-578d-4a0d-8fd3-4197917a1dda" status: 200 len: 1697 microversion: 2.1 time: 0.184900 Sep 14 09:33:20.847040 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3232/6442] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:33:20 2022] GET /compute/v2.1/servers/c1297f74-578d-4a0d-8fd3-4197917a1dda => generated 1697 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:33:21.869740 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-79a1b3b1-93b6-41d1-a588-1862c344dca4 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:21.870363 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-79a1b3b1-93b6-41d1-a588-1862c344dca4 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: c1297f74-578d-4a0d-8fd3-4197917a1dda] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:21.877600 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-79a1b3b1-93b6-41d1-a588-1862c344dca4 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:21.878623 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-79a1b3b1-93b6-41d1-a588-1862c344dca4 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:21.879085 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-79a1b3b1-93b6-41d1-a588-1862c344dca4 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:21.879776 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-79a1b3b1-93b6-41d1-a588-1862c344dca4 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:21.880226 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-79a1b3b1-93b6-41d1-a588-1862c344dca4 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:21.880643 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-79a1b3b1-93b6-41d1-a588-1862c344dca4 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:22.024957 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-79a1b3b1-93b6-41d1-a588-1862c344dca4 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725d7beb4ec54b86a455af0d7bd0ce19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c197eded81494b818b1e56f4c01432c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:22.035175 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-79a1b3b1-93b6-41d1-a588-1862c344dca4 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/c1297f74-578d-4a0d-8fd3-4197917a1dda" status: 200 len: 1696 microversion: 2.1 time: 0.169462 Sep 14 09:33:22.035771 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3211/6443] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:33:21 2022] GET /compute/v2.1/servers/c1297f74-578d-4a0d-8fd3-4197917a1dda => generated 1696 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:33:22.111699 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-9e0723c2-bc49-404a-b5e8-fa8c4ece8178 req-e245ce8b-d3e4-4465-9fb2-299e49f8da9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1297f74-578d-4a0d-8fd3-4197917a1dda", "name": "network-vif-unplugged", "status": "completed", "tag": "ca01d346-79c1-4969-9a4a-9124c8c992c0"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:33:22.125471 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-9e0723c2-bc49-404a-b5e8-fa8c4ece8178 req-e245ce8b-d3e4-4465-9fb2-299e49f8da9f service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:22.126214 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-9e0723c2-bc49-404a-b5e8-fa8c4ece8178 req-e245ce8b-d3e4-4465-9fb2-299e49f8da9f service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:22.127094 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-9e0723c2-bc49-404a-b5e8-fa8c4ece8178 req-e245ce8b-d3e4-4465-9fb2-299e49f8da9f service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:22.144304 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-9e0723c2-bc49-404a-b5e8-fa8c4ece8178 req-e245ce8b-d3e4-4465-9fb2-299e49f8da9f service nova] Creating event network-vif-unplugged:ca01d346-79c1-4969-9a4a-9124c8c992c0 for instance c1297f74-578d-4a0d-8fd3-4197917a1dda on n-h2-836830-18 Sep 14 09:33:22.152609 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [req-9e0723c2-bc49-404a-b5e8-fa8c4ece8178 req-e245ce8b-d3e4-4465-9fb2-299e49f8da9f service nova] Instance c1297f74-578d-4a0d-8fd3-4197917a1dda is migrating within the same cell, copying events to all relevant hosts: {'n-h1-836830-18', 'n-h2-836830-18'} {{(pid=128758) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 14 09:33:22.166625 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-9e0723c2-bc49-404a-b5e8-fa8c4ece8178 req-e245ce8b-d3e4-4465-9fb2-299e49f8da9f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060528 Sep 14 09:33:22.167574 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3233/6444] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:33:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:33:23.060251 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c19dd835-e0ea-4848-ab1a-74175f0d78fa tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:23.061309 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-c19dd835-e0ea-4848-ab1a-74175f0d78fa tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: c1297f74-578d-4a0d-8fd3-4197917a1dda] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:23.068729 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c19dd835-e0ea-4848-ab1a-74175f0d78fa tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:23.069581 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c19dd835-e0ea-4848-ab1a-74175f0d78fa tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:23.072379 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c19dd835-e0ea-4848-ab1a-74175f0d78fa tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:23.073152 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c19dd835-e0ea-4848-ab1a-74175f0d78fa tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:23.073630 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c19dd835-e0ea-4848-ab1a-74175f0d78fa tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:23.074068 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c19dd835-e0ea-4848-ab1a-74175f0d78fa tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:23.096808 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:33:23.237794 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-c19dd835-e0ea-4848-ab1a-74175f0d78fa tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725d7beb4ec54b86a455af0d7bd0ce19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c197eded81494b818b1e56f4c01432c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:23.256547 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-c19dd835-e0ea-4848-ab1a-74175f0d78fa tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/c1297f74-578d-4a0d-8fd3-4197917a1dda" status: 200 len: 1696 microversion: 2.1 time: 0.201052 Sep 14 09:33:23.257141 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3212/6445] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:33:23 2022] GET /compute/v2.1/servers/c1297f74-578d-4a0d-8fd3-4197917a1dda => generated 1696 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:33:24.188731 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-b8fd8b78-5707-4a58-b090-958b99f5dd07 req-34045656-73f3-4738-ad5e-32a646a1d686 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1297f74-578d-4a0d-8fd3-4197917a1dda", "tag": "ca01d346-79c1-4969-9a4a-9124c8c992c0"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:33:24.199189 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-b8fd8b78-5707-4a58-b090-958b99f5dd07 req-34045656-73f3-4738-ad5e-32a646a1d686 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:24.199952 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-b8fd8b78-5707-4a58-b090-958b99f5dd07 req-34045656-73f3-4738-ad5e-32a646a1d686 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:24.200596 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-b8fd8b78-5707-4a58-b090-958b99f5dd07 req-34045656-73f3-4738-ad5e-32a646a1d686 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:24.213328 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-b8fd8b78-5707-4a58-b090-958b99f5dd07 req-34045656-73f3-4738-ad5e-32a646a1d686 service nova] Creating event network-changed:ca01d346-79c1-4969-9a4a-9124c8c992c0 for instance c1297f74-578d-4a0d-8fd3-4197917a1dda on n-h2-836830-18 Sep 14 09:33:24.219207 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [req-b8fd8b78-5707-4a58-b090-958b99f5dd07 req-34045656-73f3-4738-ad5e-32a646a1d686 service nova] Instance c1297f74-578d-4a0d-8fd3-4197917a1dda is migrating within the same cell, copying events to all relevant hosts: {'n-h1-836830-18', 'n-h2-836830-18'} {{(pid=128758) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 14 09:33:24.234044 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-b8fd8b78-5707-4a58-b090-958b99f5dd07 req-34045656-73f3-4738-ad5e-32a646a1d686 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050184 Sep 14 09:33:24.237873 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3234/6446] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:33:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:33:24.280852 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3852e0bc-562d-4fa3-90bc-ba41e784da6c tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:24.282039 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-3852e0bc-562d-4fa3-90bc-ba41e784da6c tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: c1297f74-578d-4a0d-8fd3-4197917a1dda] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:24.297012 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3852e0bc-562d-4fa3-90bc-ba41e784da6c tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:24.297520 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3852e0bc-562d-4fa3-90bc-ba41e784da6c tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:24.297964 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3852e0bc-562d-4fa3-90bc-ba41e784da6c tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:24.298692 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3852e0bc-562d-4fa3-90bc-ba41e784da6c tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:24.299185 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3852e0bc-562d-4fa3-90bc-ba41e784da6c tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:24.303372 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3852e0bc-562d-4fa3-90bc-ba41e784da6c tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:24.459702 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-3852e0bc-562d-4fa3-90bc-ba41e784da6c tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725d7beb4ec54b86a455af0d7bd0ce19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c197eded81494b818b1e56f4c01432c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:24.468452 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-3852e0bc-562d-4fa3-90bc-ba41e784da6c tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/c1297f74-578d-4a0d-8fd3-4197917a1dda" status: 200 len: 1694 microversion: 2.1 time: 0.192290 Sep 14 09:33:24.481738 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3213/6447] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:33:24 2022] GET /compute/v2.1/servers/c1297f74-578d-4a0d-8fd3-4197917a1dda => generated 1694 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:33:25.494734 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b81b70be-13a0-436b-8b8e-e8754b3ac8c6 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:25.495531 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-b81b70be-13a0-436b-8b8e-e8754b3ac8c6 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: c1297f74-578d-4a0d-8fd3-4197917a1dda] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:25.507558 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b81b70be-13a0-436b-8b8e-e8754b3ac8c6 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:25.508364 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b81b70be-13a0-436b-8b8e-e8754b3ac8c6 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:25.508992 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b81b70be-13a0-436b-8b8e-e8754b3ac8c6 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:25.509962 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b81b70be-13a0-436b-8b8e-e8754b3ac8c6 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:25.510607 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b81b70be-13a0-436b-8b8e-e8754b3ac8c6 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:25.511960 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b81b70be-13a0-436b-8b8e-e8754b3ac8c6 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:25.708903 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-b81b70be-13a0-436b-8b8e-e8754b3ac8c6 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725d7beb4ec54b86a455af0d7bd0ce19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c197eded81494b818b1e56f4c01432c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:25.719261 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-b81b70be-13a0-436b-8b8e-e8754b3ac8c6 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/c1297f74-578d-4a0d-8fd3-4197917a1dda" status: 200 len: 1691 microversion: 2.1 time: 0.229197 Sep 14 09:33:25.737201 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3235/6448] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:33:25 2022] GET /compute/v2.1/servers/c1297f74-578d-4a0d-8fd3-4197917a1dda => generated 1691 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:33:25.747123 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-7bdc9e3d-9c54-469e-bd04-c02d347da509 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:33:25.748383 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-7bdc9e3d-9c54-469e-bd04-c02d347da509 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: c1297f74-578d-4a0d-8fd3-4197917a1dda] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:25.756479 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7bdc9e3d-9c54-469e-bd04-c02d347da509 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:25.758101 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7bdc9e3d-9c54-469e-bd04-c02d347da509 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:25.758552 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7bdc9e3d-9c54-469e-bd04-c02d347da509 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:25.759303 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7bdc9e3d-9c54-469e-bd04-c02d347da509 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:25.759772 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7bdc9e3d-9c54-469e-bd04-c02d347da509 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:25.760202 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7bdc9e3d-9c54-469e-bd04-c02d347da509 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:25.889733 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-7bdc9e3d-9c54-469e-bd04-c02d347da509 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "POST /compute/v2.1/servers/c1297f74-578d-4a0d-8fd3-4197917a1dda/action" status: 202 len: 0 microversion: 2.1 time: 0.147290 Sep 14 09:33:25.890365 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3214/6449] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:33:25 2022] POST /compute/v2.1/servers/c1297f74-578d-4a0d-8fd3-4197917a1dda/action => generated 0 bytes in 149 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:33:25.899721 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-025297c3-b172-4f30-91f1-2fe069683ac4 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:25.900740 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-025297c3-b172-4f30-91f1-2fe069683ac4 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: c1297f74-578d-4a0d-8fd3-4197917a1dda] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:25.908284 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-025297c3-b172-4f30-91f1-2fe069683ac4 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:25.908943 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-025297c3-b172-4f30-91f1-2fe069683ac4 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:25.909467 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-025297c3-b172-4f30-91f1-2fe069683ac4 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:25.910436 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-025297c3-b172-4f30-91f1-2fe069683ac4 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:25.911159 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-025297c3-b172-4f30-91f1-2fe069683ac4 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:25.911816 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-025297c3-b172-4f30-91f1-2fe069683ac4 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:26.069855 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-025297c3-b172-4f30-91f1-2fe069683ac4 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725d7beb4ec54b86a455af0d7bd0ce19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c197eded81494b818b1e56f4c01432c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:26.079569 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-025297c3-b172-4f30-91f1-2fe069683ac4 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/c1297f74-578d-4a0d-8fd3-4197917a1dda" status: 200 len: 1690 microversion: 2.1 time: 0.184300 Sep 14 09:33:26.091795 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3236/6450] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:33:25 2022] GET /compute/v2.1/servers/c1297f74-578d-4a0d-8fd3-4197917a1dda => generated 1690 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:33:27.141928 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-1d4f57e0-4b9b-4aa2-9c9b-3173c28519b9 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:27.142765 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-1d4f57e0-4b9b-4aa2-9c9b-3173c28519b9 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: c1297f74-578d-4a0d-8fd3-4197917a1dda] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:27.165174 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1d4f57e0-4b9b-4aa2-9c9b-3173c28519b9 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:27.167674 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1d4f57e0-4b9b-4aa2-9c9b-3173c28519b9 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:27.168390 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1d4f57e0-4b9b-4aa2-9c9b-3173c28519b9 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:27.184645 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1d4f57e0-4b9b-4aa2-9c9b-3173c28519b9 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:27.189675 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1d4f57e0-4b9b-4aa2-9c9b-3173c28519b9 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:27.190415 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1d4f57e0-4b9b-4aa2-9c9b-3173c28519b9 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:27.414100 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-1d4f57e0-4b9b-4aa2-9c9b-3173c28519b9 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725d7beb4ec54b86a455af0d7bd0ce19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c197eded81494b818b1e56f4c01432c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:27.422519 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-1d4f57e0-4b9b-4aa2-9c9b-3173c28519b9 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/c1297f74-578d-4a0d-8fd3-4197917a1dda" status: 200 len: 1690 microversion: 2.1 time: 0.322126 Sep 14 09:33:27.423373 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3215/6451] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:33:27 2022] GET /compute/v2.1/servers/c1297f74-578d-4a0d-8fd3-4197917a1dda => generated 1690 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:33:28.447708 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-77f01a68-9e79-46a2-b0c3-e93a5dfed6af tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:28.448579 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-77f01a68-9e79-46a2-b0c3-e93a5dfed6af tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: c1297f74-578d-4a0d-8fd3-4197917a1dda] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:28.456151 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-77f01a68-9e79-46a2-b0c3-e93a5dfed6af tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:28.457020 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-77f01a68-9e79-46a2-b0c3-e93a5dfed6af tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:28.457764 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-77f01a68-9e79-46a2-b0c3-e93a5dfed6af tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:28.459018 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-77f01a68-9e79-46a2-b0c3-e93a5dfed6af tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:28.459708 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-77f01a68-9e79-46a2-b0c3-e93a5dfed6af tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:28.460594 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-77f01a68-9e79-46a2-b0c3-e93a5dfed6af tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:28.516249 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=4 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:33:28.655868 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-77f01a68-9e79-46a2-b0c3-e93a5dfed6af tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725d7beb4ec54b86a455af0d7bd0ce19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c197eded81494b818b1e56f4c01432c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:28.671236 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-77f01a68-9e79-46a2-b0c3-e93a5dfed6af tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/c1297f74-578d-4a0d-8fd3-4197917a1dda" status: 200 len: 1690 microversion: 2.1 time: 0.228466 Sep 14 09:33:28.691800 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3237/6452] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:33:28 2022] GET /compute/v2.1/servers/c1297f74-578d-4a0d-8fd3-4197917a1dda => generated 1690 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:33:28.807096 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-0aec22d0-0d4e-427f-9cf5-6b318d7b4b8d req-b15e698e-4287-42c6-b2d2-24b8a9da1272 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1297f74-578d-4a0d-8fd3-4197917a1dda", "name": "network-vif-plugged", "status": "completed", "tag": "ca01d346-79c1-4969-9a4a-9124c8c992c0"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:33:28.821157 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-0aec22d0-0d4e-427f-9cf5-6b318d7b4b8d req-b15e698e-4287-42c6-b2d2-24b8a9da1272 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:28.821921 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-0aec22d0-0d4e-427f-9cf5-6b318d7b4b8d req-b15e698e-4287-42c6-b2d2-24b8a9da1272 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:28.822679 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-0aec22d0-0d4e-427f-9cf5-6b318d7b4b8d req-b15e698e-4287-42c6-b2d2-24b8a9da1272 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:28.840274 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-0aec22d0-0d4e-427f-9cf5-6b318d7b4b8d req-b15e698e-4287-42c6-b2d2-24b8a9da1272 service nova] Creating event network-vif-plugged:ca01d346-79c1-4969-9a4a-9124c8c992c0 for instance c1297f74-578d-4a0d-8fd3-4197917a1dda on n-h1-836830-18 Sep 14 09:33:28.848529 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [req-0aec22d0-0d4e-427f-9cf5-6b318d7b4b8d req-b15e698e-4287-42c6-b2d2-24b8a9da1272 service nova] Instance c1297f74-578d-4a0d-8fd3-4197917a1dda is migrating within the same cell, copying events to all relevant hosts: {'n-h1-836830-18', 'n-h2-836830-18'} {{(pid=128759) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 14 09:33:28.861656 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-0aec22d0-0d4e-427f-9cf5-6b318d7b4b8d req-b15e698e-4287-42c6-b2d2-24b8a9da1272 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064419 Sep 14 09:33:28.863041 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3216/6453] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:33:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:33:29.551496 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-daa5327b-5765-455a-a926-2100a23ba81a req-78d213da-d080-4288-ac31-ecf0f5bc3a19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1297f74-578d-4a0d-8fd3-4197917a1dda", "name": "network-vif-unplugged", "status": "completed", "tag": "ca01d346-79c1-4969-9a4a-9124c8c992c0"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:33:29.568597 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-daa5327b-5765-455a-a926-2100a23ba81a req-78d213da-d080-4288-ac31-ecf0f5bc3a19 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:29.569409 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-daa5327b-5765-455a-a926-2100a23ba81a req-78d213da-d080-4288-ac31-ecf0f5bc3a19 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:29.570111 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-daa5327b-5765-455a-a926-2100a23ba81a req-78d213da-d080-4288-ac31-ecf0f5bc3a19 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:29.606785 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-daa5327b-5765-455a-a926-2100a23ba81a req-78d213da-d080-4288-ac31-ecf0f5bc3a19 service nova] Creating event network-vif-unplugged:ca01d346-79c1-4969-9a4a-9124c8c992c0 for instance c1297f74-578d-4a0d-8fd3-4197917a1dda on n-h1-836830-18 Sep 14 09:33:29.631350 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [req-daa5327b-5765-455a-a926-2100a23ba81a req-78d213da-d080-4288-ac31-ecf0f5bc3a19 service nova] Instance c1297f74-578d-4a0d-8fd3-4197917a1dda is migrating within the same cell, copying events to all relevant hosts: {'n-h1-836830-18', 'n-h2-836830-18'} {{(pid=128758) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 14 09:33:29.657694 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-daa5327b-5765-455a-a926-2100a23ba81a req-78d213da-d080-4288-ac31-ecf0f5bc3a19 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.122006 Sep 14 09:33:29.662453 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3238/6454] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:33:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:33:29.697486 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-0922d1da-3421-44cd-b10c-fc232317a974 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:29.698282 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-0922d1da-3421-44cd-b10c-fc232317a974 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: c1297f74-578d-4a0d-8fd3-4197917a1dda] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:29.705569 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0922d1da-3421-44cd-b10c-fc232317a974 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:29.707189 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0922d1da-3421-44cd-b10c-fc232317a974 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:29.707906 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0922d1da-3421-44cd-b10c-fc232317a974 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:29.708906 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0922d1da-3421-44cd-b10c-fc232317a974 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:29.709602 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0922d1da-3421-44cd-b10c-fc232317a974 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:29.710249 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0922d1da-3421-44cd-b10c-fc232317a974 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:29.867165 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-0922d1da-3421-44cd-b10c-fc232317a974 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725d7beb4ec54b86a455af0d7bd0ce19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c197eded81494b818b1e56f4c01432c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:29.876393 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-0922d1da-3421-44cd-b10c-fc232317a974 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/c1297f74-578d-4a0d-8fd3-4197917a1dda" status: 200 len: 1690 microversion: 2.1 time: 0.182758 Sep 14 09:33:29.887266 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3217/6455] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:33:29 2022] GET /compute/v2.1/servers/c1297f74-578d-4a0d-8fd3-4197917a1dda => generated 1690 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:33:30.899912 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-3a5fe3c9-2959-457e-921f-90333d3fbee6 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:30.901303 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-3a5fe3c9-2959-457e-921f-90333d3fbee6 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: c1297f74-578d-4a0d-8fd3-4197917a1dda] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:30.911429 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3a5fe3c9-2959-457e-921f-90333d3fbee6 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:30.912214 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3a5fe3c9-2959-457e-921f-90333d3fbee6 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:30.913644 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3a5fe3c9-2959-457e-921f-90333d3fbee6 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:30.916250 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3a5fe3c9-2959-457e-921f-90333d3fbee6 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:30.916759 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3a5fe3c9-2959-457e-921f-90333d3fbee6 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:30.917214 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3a5fe3c9-2959-457e-921f-90333d3fbee6 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:31.092433 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-3a5fe3c9-2959-457e-921f-90333d3fbee6 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725d7beb4ec54b86a455af0d7bd0ce19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c197eded81494b818b1e56f4c01432c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:31.107385 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-3a5fe3c9-2959-457e-921f-90333d3fbee6 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/c1297f74-578d-4a0d-8fd3-4197917a1dda" status: 200 len: 1690 microversion: 2.1 time: 0.211591 Sep 14 09:33:31.123876 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3239/6456] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:33:30 2022] GET /compute/v2.1/servers/c1297f74-578d-4a0d-8fd3-4197917a1dda => generated 1690 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:33:31.693829 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-f3100e65-c91c-479e-a44d-d6055de055c5 req-901abf5a-b399-4d08-9540-b1f2cac4e6f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1297f74-578d-4a0d-8fd3-4197917a1dda", "tag": "ca01d346-79c1-4969-9a4a-9124c8c992c0"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:33:31.707114 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-f3100e65-c91c-479e-a44d-d6055de055c5 req-901abf5a-b399-4d08-9540-b1f2cac4e6f3 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:31.707610 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-f3100e65-c91c-479e-a44d-d6055de055c5 req-901abf5a-b399-4d08-9540-b1f2cac4e6f3 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:31.708055 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-f3100e65-c91c-479e-a44d-d6055de055c5 req-901abf5a-b399-4d08-9540-b1f2cac4e6f3 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:31.721376 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-f3100e65-c91c-479e-a44d-d6055de055c5 req-901abf5a-b399-4d08-9540-b1f2cac4e6f3 service nova] Creating event network-changed:ca01d346-79c1-4969-9a4a-9124c8c992c0 for instance c1297f74-578d-4a0d-8fd3-4197917a1dda on n-h1-836830-18 Sep 14 09:33:31.728485 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [req-f3100e65-c91c-479e-a44d-d6055de055c5 req-901abf5a-b399-4d08-9540-b1f2cac4e6f3 service nova] Instance c1297f74-578d-4a0d-8fd3-4197917a1dda is migrating within the same cell, copying events to all relevant hosts: {'n-h1-836830-18', 'n-h2-836830-18'} {{(pid=128759) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 14 09:33:31.741086 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-f3100e65-c91c-479e-a44d-d6055de055c5 req-901abf5a-b399-4d08-9540-b1f2cac4e6f3 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051572 Sep 14 09:33:31.742076 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3218/6457] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:33:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:33:32.135759 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-997449ed-e5b2-4280-8a5d-e23fe5bf6faf tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:32.136398 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-997449ed-e5b2-4280-8a5d-e23fe5bf6faf tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: c1297f74-578d-4a0d-8fd3-4197917a1dda] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:32.139470 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=4 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:33:32.144776 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-997449ed-e5b2-4280-8a5d-e23fe5bf6faf tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:32.145839 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-997449ed-e5b2-4280-8a5d-e23fe5bf6faf tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:32.146312 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-997449ed-e5b2-4280-8a5d-e23fe5bf6faf tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:32.147352 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-997449ed-e5b2-4280-8a5d-e23fe5bf6faf tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:32.147834 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-997449ed-e5b2-4280-8a5d-e23fe5bf6faf tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:32.148283 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-997449ed-e5b2-4280-8a5d-e23fe5bf6faf tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:32.299029 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-997449ed-e5b2-4280-8a5d-e23fe5bf6faf tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725d7beb4ec54b86a455af0d7bd0ce19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c197eded81494b818b1e56f4c01432c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:32.311545 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-997449ed-e5b2-4280-8a5d-e23fe5bf6faf tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/c1297f74-578d-4a0d-8fd3-4197917a1dda" status: 200 len: 1690 microversion: 2.1 time: 0.179512 Sep 14 09:33:32.312200 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3240/6458] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:33:32 2022] GET /compute/v2.1/servers/c1297f74-578d-4a0d-8fd3-4197917a1dda => generated 1690 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:33:33.341268 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a1298cec-be33-4235-89f0-8fd51890b30e tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:33.342211 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-a1298cec-be33-4235-89f0-8fd51890b30e tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: c1297f74-578d-4a0d-8fd3-4197917a1dda] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:33.346914 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:33:33.355828 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a1298cec-be33-4235-89f0-8fd51890b30e tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:33.355828 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a1298cec-be33-4235-89f0-8fd51890b30e tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:33.356360 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a1298cec-be33-4235-89f0-8fd51890b30e tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:33.356988 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a1298cec-be33-4235-89f0-8fd51890b30e tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:33.358271 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a1298cec-be33-4235-89f0-8fd51890b30e tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:33.358271 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a1298cec-be33-4235-89f0-8fd51890b30e tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:33.527397 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-a1298cec-be33-4235-89f0-8fd51890b30e tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725d7beb4ec54b86a455af0d7bd0ce19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c197eded81494b818b1e56f4c01432c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:33.541806 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a1298cec-be33-4235-89f0-8fd51890b30e tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/c1297f74-578d-4a0d-8fd3-4197917a1dda" status: 200 len: 1690 microversion: 2.1 time: 0.205639 Sep 14 09:33:33.552722 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3219/6459] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:33:33 2022] GET /compute/v2.1/servers/c1297f74-578d-4a0d-8fd3-4197917a1dda => generated 1690 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:33:34.570204 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-4c02e882-6bb7-4b3b-b253-12409f34a40f tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:34.571095 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-4c02e882-6bb7-4b3b-b253-12409f34a40f tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: c1297f74-578d-4a0d-8fd3-4197917a1dda] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:34.578596 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4c02e882-6bb7-4b3b-b253-12409f34a40f tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:34.579405 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4c02e882-6bb7-4b3b-b253-12409f34a40f tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:34.579864 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4c02e882-6bb7-4b3b-b253-12409f34a40f tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:34.580608 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4c02e882-6bb7-4b3b-b253-12409f34a40f tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:34.581278 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4c02e882-6bb7-4b3b-b253-12409f34a40f tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:34.581721 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4c02e882-6bb7-4b3b-b253-12409f34a40f tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:34.729709 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-4c02e882-6bb7-4b3b-b253-12409f34a40f tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725d7beb4ec54b86a455af0d7bd0ce19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c197eded81494b818b1e56f4c01432c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:34.740265 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-4c02e882-6bb7-4b3b-b253-12409f34a40f tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/c1297f74-578d-4a0d-8fd3-4197917a1dda" status: 200 len: 1683 microversion: 2.1 time: 0.177956 Sep 14 09:33:34.741437 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3241/6460] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:33:34 2022] GET /compute/v2.1/servers/c1297f74-578d-4a0d-8fd3-4197917a1dda => generated 1683 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:33:36.582829 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-adbba312-eaa3-4f8f-9141-f0c52a58f17b tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:36.583444 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-adbba312-eaa3-4f8f-9141-f0c52a58f17b tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] [instance: 9579aa98-cb7a-46a9-89eb-be0f1f823acf] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:36.592810 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-adbba312-eaa3-4f8f-9141-f0c52a58f17b tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:36.593306 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-adbba312-eaa3-4f8f-9141-f0c52a58f17b tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:36.593957 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-adbba312-eaa3-4f8f-9141-f0c52a58f17b tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:36.595086 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-adbba312-eaa3-4f8f-9141-f0c52a58f17b tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:36.595543 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-adbba312-eaa3-4f8f-9141-f0c52a58f17b tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:36.596170 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-adbba312-eaa3-4f8f-9141-f0c52a58f17b tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:36.691516 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.objects.instance [None req-adbba312-eaa3-4f8f-9141-f0c52a58f17b tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Lazy-loading 'services' on Instance uuid 9579aa98-cb7a-46a9-89eb-be0f1f823acf {{(pid=128759) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:33:36.777076 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-adbba312-eaa3-4f8f-9141-f0c52a58f17b tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] 10.222.0.60 "DELETE /compute/v2.1/servers/9579aa98-cb7a-46a9-89eb-be0f1f823acf/os-volume_attachments/75cb850a-4357-49eb-a0a1-862b47a2b22d" status: 202 len: 0 microversion: 2.1 time: 0.201212 Sep 14 09:33:36.778326 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3220/6461] 10.222.0.60 () {58 vars in 1416 bytes} [Wed Sep 14 09:33:36 2022] DELETE /compute/v2.1/servers/9579aa98-cb7a-46a9-89eb-be0f1f823acf/os-volume_attachments/75cb850a-4357-49eb-a0a1-862b47a2b22d => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:33:36.903334 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-d9bb0a21-6851-4acd-ac7c-2444988185e2 req-d8be8d2b-3a4a-43a8-9329-ba8ab0b4db6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1297f74-578d-4a0d-8fd3-4197917a1dda", "name": "network-vif-plugged", "status": "completed", "tag": "ca01d346-79c1-4969-9a4a-9124c8c992c0"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:33:36.917023 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-d9bb0a21-6851-4acd-ac7c-2444988185e2 req-d8be8d2b-3a4a-43a8-9329-ba8ab0b4db6c service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:36.917535 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-d9bb0a21-6851-4acd-ac7c-2444988185e2 req-d8be8d2b-3a4a-43a8-9329-ba8ab0b4db6c service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:36.917986 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-d9bb0a21-6851-4acd-ac7c-2444988185e2 req-d8be8d2b-3a4a-43a8-9329-ba8ab0b4db6c service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:36.930030 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-d9bb0a21-6851-4acd-ac7c-2444988185e2 req-d8be8d2b-3a4a-43a8-9329-ba8ab0b4db6c service nova] Creating event network-vif-plugged:ca01d346-79c1-4969-9a4a-9124c8c992c0 for instance c1297f74-578d-4a0d-8fd3-4197917a1dda on n-h1-836830-18 Sep 14 09:33:36.935609 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-d9bb0a21-6851-4acd-ac7c-2444988185e2 req-d8be8d2b-3a4a-43a8-9329-ba8ab0b4db6c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042316 Sep 14 09:33:36.936517 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3242/6462] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:33:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:33:38.308999 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-0676cda5-f645-4d55-a61a-df3fef656971 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-207131192", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1345910784", "security_groups": [{"name": "tempest-secgroup-smoke-1175246649"}], "block_device_mapping_v2": [{"uuid": "de7f74df-f67a-4e6d-8971-b0ab51370b24", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "70503795-7dfb-4d39-a57e-91e8e5270ce0"}]}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:33:38.423746 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.network.neutron [None req-0676cda5-f645-4d55-a61a-df3fef656971 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] validate_networks() for [('70503795-7dfb-4d39-a57e-91e8e5270ce0', None, None, None, None, None)] {{(pid=128759) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:33:38.813936 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-0676cda5-f645-4d55-a61a-df3fef656971 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Flavor limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:33:38.814363 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-0676cda5-f645-4d55-a61a-df3fef656971 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Image limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:33:38.814876 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-0676cda5-f645-4d55-a61a-df3fef656971 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Flavor pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:33:38.815852 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-0676cda5-f645-4d55-a61a-df3fef656971 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Image pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:33:38.816273 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-0676cda5-f645-4d55-a61a-df3fef656971 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:33:38.826147 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0676cda5-f645-4d55-a61a-df3fef656971 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:38.826669 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0676cda5-f645-4d55-a61a-df3fef656971 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:38.827164 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0676cda5-f645-4d55-a61a-df3fef656971 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:38.828153 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0676cda5-f645-4d55-a61a-df3fef656971 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:38.828623 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0676cda5-f645-4d55-a61a-df3fef656971 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:38.829057 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0676cda5-f645-4d55-a61a-df3fef656971 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:38.847081 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-0676cda5-f645-4d55-a61a-df3fef656971 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Getting quotas for project 0fca803d9ffa4b4ab0371c0d6a96a5a2. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:33:38.852480 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-0676cda5-f645-4d55-a61a-df3fef656971 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Getting quotas for user 80257054a25540c294e1787780b601b4 and project 0fca803d9ffa4b4ab0371c0d6a96a5a2. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:33:38.913267 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-0676cda5-f645-4d55-a61a-df3fef656971 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Going to run 1 instances... {{(pid=128759) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:33:38.915704 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-0676cda5-f645-4d55-a61a-df3fef656971 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: 356742b9-7cbf-42d3-93bf-9ee0f93e872e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='de7f74df-f67a-4e6d-8971-b0ab51370b24',volume_size=None,volume_type=None)] {{(pid=128759) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:33:39.095764 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-0676cda5-f645-4d55-a61a-df3fef656971 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.791138 Sep 14 09:33:39.096788 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3221/6463] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 09:33:38 2022] POST /compute/v2.1/servers => generated 406 bytes in 793 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:33:39.109835 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-bb7f05ba-c87a-485e-ab5b-7804d9eaa1da tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:39.110709 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-bb7f05ba-c87a-485e-ab5b-7804d9eaa1da tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: 356742b9-7cbf-42d3-93bf-9ee0f93e872e] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:39.167880 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-bb7f05ba-c87a-485e-ab5b-7804d9eaa1da tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:39.175314 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-bb7f05ba-c87a-485e-ab5b-7804d9eaa1da tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/356742b9-7cbf-42d3-93bf-9ee0f93e872e" status: 200 len: 1094 microversion: 2.1 time: 0.071019 Sep 14 09:33:39.175905 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3243/6464] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:33:39 2022] GET /compute/v2.1/servers/356742b9-7cbf-42d3-93bf-9ee0f93e872e => generated 1094 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:33:40.198257 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c90398dd-acd7-4191-84ac-408919e72e0a tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:40.198880 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-c90398dd-acd7-4191-84ac-408919e72e0a tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: 356742b9-7cbf-42d3-93bf-9ee0f93e872e] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:40.207880 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c90398dd-acd7-4191-84ac-408919e72e0a tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:40.208378 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c90398dd-acd7-4191-84ac-408919e72e0a tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:40.208822 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c90398dd-acd7-4191-84ac-408919e72e0a tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:40.209544 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c90398dd-acd7-4191-84ac-408919e72e0a tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:40.210007 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c90398dd-acd7-4191-84ac-408919e72e0a tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:40.210444 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c90398dd-acd7-4191-84ac-408919e72e0a tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:40.333158 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-c90398dd-acd7-4191-84ac-408919e72e0a tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:40.346549 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-c90398dd-acd7-4191-84ac-408919e72e0a tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/356742b9-7cbf-42d3-93bf-9ee0f93e872e" status: 200 len: 1200 microversion: 2.1 time: 0.152517 Sep 14 09:33:40.348436 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3222/6465] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:33:40 2022] GET /compute/v2.1/servers/356742b9-7cbf-42d3-93bf-9ee0f93e872e => generated 1200 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:33:41.372854 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-5d7eb515-2d15-455a-9804-b89e4ba4955f tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:41.374201 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-5d7eb515-2d15-455a-9804-b89e4ba4955f tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: 356742b9-7cbf-42d3-93bf-9ee0f93e872e] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:41.385045 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5d7eb515-2d15-455a-9804-b89e4ba4955f tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:41.394969 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5d7eb515-2d15-455a-9804-b89e4ba4955f tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:41.395543 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5d7eb515-2d15-455a-9804-b89e4ba4955f tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:41.396582 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5d7eb515-2d15-455a-9804-b89e4ba4955f tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:41.397138 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5d7eb515-2d15-455a-9804-b89e4ba4955f tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:41.397686 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5d7eb515-2d15-455a-9804-b89e4ba4955f tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:41.519311 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-2c681de3-4368-4ffb-b7e2-d9c2c229a8ff tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:41.519939 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-2c681de3-4368-4ffb-b7e2-d9c2c229a8ff tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] [instance: 9579aa98-cb7a-46a9-89eb-be0f1f823acf] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:41.531254 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2c681de3-4368-4ffb-b7e2-d9c2c229a8ff tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:41.531932 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2c681de3-4368-4ffb-b7e2-d9c2c229a8ff tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:41.532532 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2c681de3-4368-4ffb-b7e2-d9c2c229a8ff tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:41.534475 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2c681de3-4368-4ffb-b7e2-d9c2c229a8ff tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:41.535266 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2c681de3-4368-4ffb-b7e2-d9c2c229a8ff tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:41.539371 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2c681de3-4368-4ffb-b7e2-d9c2c229a8ff tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:41.581875 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-2c681de3-4368-4ffb-b7e2-d9c2c229a8ff tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] [instance: 9579aa98-cb7a-46a9-89eb-be0f1f823acf] Going to try to terminate instance {{(pid=128759) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:33:41.603238 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-5d7eb515-2d15-455a-9804-b89e4ba4955f tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:41.613485 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-5d7eb515-2d15-455a-9804-b89e4ba4955f tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/356742b9-7cbf-42d3-93bf-9ee0f93e872e" status: 200 len: 1278 microversion: 2.1 time: 0.244137 Sep 14 09:33:41.638186 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3244/6466] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:33:41 2022] GET /compute/v2.1/servers/356742b9-7cbf-42d3-93bf-9ee0f93e872e => generated 1278 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:33:41.695169 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-2c681de3-4368-4ffb-b7e2-d9c2c229a8ff tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] 10.222.0.60 "DELETE /compute/v2.1/servers/9579aa98-cb7a-46a9-89eb-be0f1f823acf" status: 204 len: 0 microversion: 2.1 time: 0.180007 Sep 14 09:33:41.696905 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3223/6467] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:33:41 2022] DELETE /compute/v2.1/servers/9579aa98-cb7a-46a9-89eb-be0f1f823acf => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 14 09:33:41.706147 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-6676e37c-28eb-49fc-9845-c28786ed3008 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:41.706930 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-6676e37c-28eb-49fc-9845-c28786ed3008 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] [instance: 9579aa98-cb7a-46a9-89eb-be0f1f823acf] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:41.716904 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6676e37c-28eb-49fc-9845-c28786ed3008 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:41.717414 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6676e37c-28eb-49fc-9845-c28786ed3008 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:41.717857 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6676e37c-28eb-49fc-9845-c28786ed3008 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:41.718864 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6676e37c-28eb-49fc-9845-c28786ed3008 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:41.719622 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6676e37c-28eb-49fc-9845-c28786ed3008 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:41.720420 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6676e37c-28eb-49fc-9845-c28786ed3008 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:41.870262 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-6676e37c-28eb-49fc-9845-c28786ed3008 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddfe63b5ac0d421392a768f97ce4bfbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a11896b0244a4f1e859986b87a17affd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:41.880077 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-6676e37c-28eb-49fc-9845-c28786ed3008 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] 10.222.0.60 "GET /compute/v2.1/servers/9579aa98-cb7a-46a9-89eb-be0f1f823acf" status: 200 len: 1514 microversion: 2.1 time: 0.179038 Sep 14 09:33:41.881275 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3245/6468] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:33:41 2022] GET /compute/v2.1/servers/9579aa98-cb7a-46a9-89eb-be0f1f823acf => generated 1514 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:33:41.994398 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-3eff82fe-026a-44c2-bdb7-e2ee12b70583 req-77742d87-8556-4868-b5bf-3b94db10b1ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "356742b9-7cbf-42d3-93bf-9ee0f93e872e", "tag": "cef9c9f3-4c7b-4323-b68e-e465bbc007a9"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:33:42.005366 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-3eff82fe-026a-44c2-bdb7-e2ee12b70583 req-77742d87-8556-4868-b5bf-3b94db10b1ea service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:42.005849 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-3eff82fe-026a-44c2-bdb7-e2ee12b70583 req-77742d87-8556-4868-b5bf-3b94db10b1ea service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:42.006280 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-3eff82fe-026a-44c2-bdb7-e2ee12b70583 req-77742d87-8556-4868-b5bf-3b94db10b1ea service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:42.028587 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-3eff82fe-026a-44c2-bdb7-e2ee12b70583 req-77742d87-8556-4868-b5bf-3b94db10b1ea service nova] Creating event network-changed:cef9c9f3-4c7b-4323-b68e-e465bbc007a9 for instance 356742b9-7cbf-42d3-93bf-9ee0f93e872e on n-h1-836830-18 Sep 14 09:33:42.033638 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-3eff82fe-026a-44c2-bdb7-e2ee12b70583 req-77742d87-8556-4868-b5bf-3b94db10b1ea service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043417 Sep 14 09:33:42.034607 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3224/6469] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:33:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:33:42.637037 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a79750fe-0f5d-4418-9560-e673d892f0b3 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:42.637717 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-a79750fe-0f5d-4418-9560-e673d892f0b3 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: 356742b9-7cbf-42d3-93bf-9ee0f93e872e] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:42.645003 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a79750fe-0f5d-4418-9560-e673d892f0b3 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:42.645521 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a79750fe-0f5d-4418-9560-e673d892f0b3 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:42.645972 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a79750fe-0f5d-4418-9560-e673d892f0b3 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:42.646695 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a79750fe-0f5d-4418-9560-e673d892f0b3 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:42.647198 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a79750fe-0f5d-4418-9560-e673d892f0b3 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:42.647644 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a79750fe-0f5d-4418-9560-e673d892f0b3 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:42.790982 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-a79750fe-0f5d-4418-9560-e673d892f0b3 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:42.800203 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-a79750fe-0f5d-4418-9560-e673d892f0b3 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/356742b9-7cbf-42d3-93bf-9ee0f93e872e" status: 200 len: 1278 microversion: 2.1 time: 0.166492 Sep 14 09:33:42.800798 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3246/6470] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:33:42 2022] GET /compute/v2.1/servers/356742b9-7cbf-42d3-93bf-9ee0f93e872e => generated 1278 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:33:42.904216 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-6e1324db-b887-4717-a0c8-b46b99ed298a tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:42.904946 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-6e1324db-b887-4717-a0c8-b46b99ed298a tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] [instance: 9579aa98-cb7a-46a9-89eb-be0f1f823acf] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:42.913215 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6e1324db-b887-4717-a0c8-b46b99ed298a tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:42.913722 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6e1324db-b887-4717-a0c8-b46b99ed298a tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:42.914427 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6e1324db-b887-4717-a0c8-b46b99ed298a tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:42.915161 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6e1324db-b887-4717-a0c8-b46b99ed298a tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:42.915635 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6e1324db-b887-4717-a0c8-b46b99ed298a tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:42.916069 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6e1324db-b887-4717-a0c8-b46b99ed298a tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:43.068430 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-6e1324db-b887-4717-a0c8-b46b99ed298a tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddfe63b5ac0d421392a768f97ce4bfbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a11896b0244a4f1e859986b87a17affd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:43.076876 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-6e1324db-b887-4717-a0c8-b46b99ed298a tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] 10.222.0.60 "GET /compute/v2.1/servers/9579aa98-cb7a-46a9-89eb-be0f1f823acf" status: 200 len: 1514 microversion: 2.1 time: 0.176988 Sep 14 09:33:43.090970 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3225/6471] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:33:42 2022] GET /compute/v2.1/servers/9579aa98-cb7a-46a9-89eb-be0f1f823acf => generated 1514 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:33:43.823224 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-3984c911-d743-4f0d-aa50-49f916c41367 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:43.823861 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-3984c911-d743-4f0d-aa50-49f916c41367 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: 356742b9-7cbf-42d3-93bf-9ee0f93e872e] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:43.831427 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3984c911-d743-4f0d-aa50-49f916c41367 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:43.831930 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3984c911-d743-4f0d-aa50-49f916c41367 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:43.832375 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3984c911-d743-4f0d-aa50-49f916c41367 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:43.833097 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3984c911-d743-4f0d-aa50-49f916c41367 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:43.833562 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3984c911-d743-4f0d-aa50-49f916c41367 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:43.834043 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3984c911-d743-4f0d-aa50-49f916c41367 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:43.850357 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=100 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:33:43.978920 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-3984c911-d743-4f0d-aa50-49f916c41367 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:43.988253 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-3984c911-d743-4f0d-aa50-49f916c41367 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/356742b9-7cbf-42d3-93bf-9ee0f93e872e" status: 200 len: 1278 microversion: 2.1 time: 0.168781 Sep 14 09:33:43.989035 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3247/6472] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:33:43 2022] GET /compute/v2.1/servers/356742b9-7cbf-42d3-93bf-9ee0f93e872e => generated 1278 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:33:44.101415 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-23366b08-f334-459a-b8ea-ff622b8f2238 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:44.102032 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-23366b08-f334-459a-b8ea-ff622b8f2238 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] [instance: 9579aa98-cb7a-46a9-89eb-be0f1f823acf] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:44.109113 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-23366b08-f334-459a-b8ea-ff622b8f2238 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:44.109868 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-23366b08-f334-459a-b8ea-ff622b8f2238 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:44.110469 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-23366b08-f334-459a-b8ea-ff622b8f2238 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:44.111376 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-23366b08-f334-459a-b8ea-ff622b8f2238 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:44.112512 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-23366b08-f334-459a-b8ea-ff622b8f2238 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:44.113101 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-23366b08-f334-459a-b8ea-ff622b8f2238 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:44.159942 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-2c3c48c9-498b-4c39-b96b-9be08ad20daf req-71ed3cad-c9e2-4640-a949-651671973df7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9579aa98-cb7a-46a9-89eb-be0f1f823acf", "name": "network-vif-deleted", "tag": "cfcdadc8-6f47-4775-8ac4-2702e6bf0018"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:33:44.169667 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-2c3c48c9-498b-4c39-b96b-9be08ad20daf req-71ed3cad-c9e2-4640-a949-651671973df7 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:44.170396 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-2c3c48c9-498b-4c39-b96b-9be08ad20daf req-71ed3cad-c9e2-4640-a949-651671973df7 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:44.171040 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-2c3c48c9-498b-4c39-b96b-9be08ad20daf req-71ed3cad-c9e2-4640-a949-651671973df7 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:44.188991 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-2c3c48c9-498b-4c39-b96b-9be08ad20daf req-71ed3cad-c9e2-4640-a949-651671973df7 service nova] Creating event network-vif-deleted:cfcdadc8-6f47-4775-8ac4-2702e6bf0018 for instance 9579aa98-cb7a-46a9-89eb-be0f1f823acf on n-h2-836830-18 Sep 14 09:33:44.195729 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-2c3c48c9-498b-4c39-b96b-9be08ad20daf req-71ed3cad-c9e2-4640-a949-651671973df7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039891 Sep 14 09:33:44.198105 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3248/6473] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:33:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:33:44.200853 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-23366b08-f334-459a-b8ea-ff622b8f2238 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddfe63b5ac0d421392a768f97ce4bfbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a11896b0244a4f1e859986b87a17affd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:44.210970 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-23366b08-f334-459a-b8ea-ff622b8f2238 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] 10.222.0.60 "GET /compute/v2.1/servers/9579aa98-cb7a-46a9-89eb-be0f1f823acf" status: 200 len: 1472 microversion: 2.1 time: 0.113268 Sep 14 09:33:44.212218 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3226/6474] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:33:44 2022] GET /compute/v2.1/servers/9579aa98-cb7a-46a9-89eb-be0f1f823acf => generated 1472 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:33:45.015303 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-386c5a19-d134-467a-a626-e08d11c1b591 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:45.015942 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-386c5a19-d134-467a-a626-e08d11c1b591 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: 356742b9-7cbf-42d3-93bf-9ee0f93e872e] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:45.023055 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-386c5a19-d134-467a-a626-e08d11c1b591 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:45.023939 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-386c5a19-d134-467a-a626-e08d11c1b591 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:45.024399 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-386c5a19-d134-467a-a626-e08d11c1b591 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:45.025105 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-386c5a19-d134-467a-a626-e08d11c1b591 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:45.025568 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-386c5a19-d134-467a-a626-e08d11c1b591 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:45.026002 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-386c5a19-d134-467a-a626-e08d11c1b591 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:45.162992 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-386c5a19-d134-467a-a626-e08d11c1b591 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:45.170867 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-386c5a19-d134-467a-a626-e08d11c1b591 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/356742b9-7cbf-42d3-93bf-9ee0f93e872e" status: 200 len: 1278 microversion: 2.1 time: 0.160884 Sep 14 09:33:45.171473 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3249/6475] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:33:45 2022] GET /compute/v2.1/servers/356742b9-7cbf-42d3-93bf-9ee0f93e872e => generated 1278 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:33:45.235193 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b914d066-7740-4f05-abe1-c9e1061ce161 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:45.235921 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b914d066-7740-4f05-abe1-c9e1061ce161 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] [instance: 9579aa98-cb7a-46a9-89eb-be0f1f823acf] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:45.243470 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b914d066-7740-4f05-abe1-c9e1061ce161 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:45.244070 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b914d066-7740-4f05-abe1-c9e1061ce161 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:45.244573 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b914d066-7740-4f05-abe1-c9e1061ce161 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:45.245328 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b914d066-7740-4f05-abe1-c9e1061ce161 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:45.245852 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b914d066-7740-4f05-abe1-c9e1061ce161 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:45.246340 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b914d066-7740-4f05-abe1-c9e1061ce161 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:45.249196 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:33:45.264513 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-b914d066-7740-4f05-abe1-c9e1061ce161 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] HTTP exception thrown: Instance 9579aa98-cb7a-46a9-89eb-be0f1f823acf could not be found. Sep 14 09:33:45.266711 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b914d066-7740-4f05-abe1-c9e1061ce161 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Request method failure captured: Sep 14 09:33:45.266711 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/9579aa98-cb7a-46a9-89eb-be0f1f823acf HTTP/1.1 Sep 14 09:33:45.266711 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:33:45.266711 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:33:45.266711 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:33:45.266711 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:33:45.266711 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:33:45.266711 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:33:45.266711 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:33:45.266711 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:33:45.266711 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZ9Qs9RO3z6RoL6f22zMFfobaQGy-ZO7rGrDKCOjC5xD2hQCgfmSNFNePFRnwRIsmdK4CExfGHfhu88QRXfEGy0QmGI7tflM298tC3RO7RfwjPlZv4FYJWLrZ-KYKtZqGNZ4tL8F2RDrOI32do-BsrCGFmj9cV8ebEHhFLHVNNd2hTQ Sep 14 09:33:45.266711 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:33:45.266711 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:33:45.266711 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:33:45.266711 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:33:45.266711 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:33:45.266711 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:33:45.266711 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: a11896b0244a4f1e859986b87a17affd Sep 14 09:33:45.266711 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1639477699 Sep 14 09:33:45.266711 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:33:45.266711 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:33:45.266711 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a11896b0244a4f1e859986b87a17affd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a11896b0244a4f1e859986b87a17affd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a11896b0244a4f1e859986b87a17affd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a11896b0244a4f1e859986b87a17affd"}]}] Sep 14 09:33:45.266711 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-VolumesSnapshotTestJSON-1639477699 Sep 14 09:33:45.266711 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: a11896b0244a4f1e859986b87a17affd Sep 14 09:33:45.266711 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1639477699 Sep 14 09:33:45.266711 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-VolumesSnapshotTestJSON-1639477699-project Sep 14 09:33:45.266711 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:33:45.266711 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:33:45.266711 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: ddfe63b5ac0d421392a768f97ce4bfbf Sep 14 09:33:45.266711 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-VolumesSnapshotTestJSON-1639477699-project Sep 14 09:33:45.266711 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:33:45.266711 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance 9579aa98-cb7a-46a9-89eb-be0f1f823acf could not be found. Sep 14 09:33:45.266711 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '9579aa98-cb7a-46a9-89eb-be0f1f823acf'} Sep 14 09:33:45.266711 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:33:45.266711 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:33:45.266711 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:33:45.266711 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:33:45.266711 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:33:45.266711 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:33:45.266711 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:33:45.266711 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:33:45.266711 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:33:45.266711 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:33:45.266711 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9579aa98-cb7a-46a9-89eb-be0f1f823acf could not be found. Sep 14 09:33:45.266711 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:33:45.266711 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:33:45.266711 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:33:45.266711 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:33:45.266711 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:33:45.266711 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:33:45.266711 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:33:45.266711 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:33:45.266711 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:33:45.266711 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:33:45.266711 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:33:45.266711 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:33:45.266711 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:33:45.266711 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:33:45.266711 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:33:45.266711 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:33:45.266711 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9579aa98-cb7a-46a9-89eb-be0f1f823acf could not be found. Sep 14 09:33:45.266711 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:33:45.266711 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:33:45.266711 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:33:45.271909 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:33:45.271909 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:33:45.271909 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:33:45.271909 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:33:45.271909 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:33:45.271909 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9579aa98-cb7a-46a9-89eb-be0f1f823acf could not be found. Sep 14 09:33:45.271909 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:33:45.271909 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b914d066-7740-4f05-abe1-c9e1061ce161 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] Returning 404 to user: Instance 9579aa98-cb7a-46a9-89eb-be0f1f823acf could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:33:45.271909 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b914d066-7740-4f05-abe1-c9e1061ce161 tempest-VolumesSnapshotTestJSON-1639477699 tempest-VolumesSnapshotTestJSON-1639477699-project] 10.222.0.60 "GET /compute/v2.1/servers/9579aa98-cb7a-46a9-89eb-be0f1f823acf" status: 404 len: 111 microversion: 2.1 time: 0.037000 Sep 14 09:33:45.271909 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3227/6476] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:33:45 2022] GET /compute/v2.1/servers/9579aa98-cb7a-46a9-89eb-be0f1f823acf => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:33:46.194525 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-9ad8f46e-9a56-44b2-a235-da4f646135b5 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:46.195288 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-9ad8f46e-9a56-44b2-a235-da4f646135b5 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: 356742b9-7cbf-42d3-93bf-9ee0f93e872e] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:46.202475 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9ad8f46e-9a56-44b2-a235-da4f646135b5 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:46.203014 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9ad8f46e-9a56-44b2-a235-da4f646135b5 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:46.203734 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9ad8f46e-9a56-44b2-a235-da4f646135b5 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:46.204457 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9ad8f46e-9a56-44b2-a235-da4f646135b5 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:46.204932 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9ad8f46e-9a56-44b2-a235-da4f646135b5 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:46.205437 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9ad8f46e-9a56-44b2-a235-da4f646135b5 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:46.346957 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-9ad8f46e-9a56-44b2-a235-da4f646135b5 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:46.355589 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-9ad8f46e-9a56-44b2-a235-da4f646135b5 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/356742b9-7cbf-42d3-93bf-9ee0f93e872e" status: 200 len: 1266 microversion: 2.1 time: 0.165589 Sep 14 09:33:46.356374 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3250/6477] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:33:46 2022] GET /compute/v2.1/servers/356742b9-7cbf-42d3-93bf-9ee0f93e872e => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:33:47.379778 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-0f45c440-7b16-49a7-ba1f-d0faea9ab656 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:47.380406 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-0f45c440-7b16-49a7-ba1f-d0faea9ab656 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: 356742b9-7cbf-42d3-93bf-9ee0f93e872e] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:47.387908 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0f45c440-7b16-49a7-ba1f-d0faea9ab656 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:47.388406 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0f45c440-7b16-49a7-ba1f-d0faea9ab656 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:47.388850 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0f45c440-7b16-49a7-ba1f-d0faea9ab656 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:47.389561 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0f45c440-7b16-49a7-ba1f-d0faea9ab656 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:47.390026 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0f45c440-7b16-49a7-ba1f-d0faea9ab656 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:47.390452 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0f45c440-7b16-49a7-ba1f-d0faea9ab656 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:47.526830 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-0f45c440-7b16-49a7-ba1f-d0faea9ab656 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:47.535335 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-0f45c440-7b16-49a7-ba1f-d0faea9ab656 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/356742b9-7cbf-42d3-93bf-9ee0f93e872e" status: 200 len: 1266 microversion: 2.1 time: 0.159835 Sep 14 09:33:47.535993 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3228/6478] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:33:47 2022] GET /compute/v2.1/servers/356742b9-7cbf-42d3-93bf-9ee0f93e872e => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:33:48.558049 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-f939e878-91b4-456b-8b93-998ab1cfcdd9 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:48.558763 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-f939e878-91b4-456b-8b93-998ab1cfcdd9 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: 356742b9-7cbf-42d3-93bf-9ee0f93e872e] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:48.565811 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f939e878-91b4-456b-8b93-998ab1cfcdd9 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:48.566319 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f939e878-91b4-456b-8b93-998ab1cfcdd9 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:48.566774 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f939e878-91b4-456b-8b93-998ab1cfcdd9 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:48.567543 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f939e878-91b4-456b-8b93-998ab1cfcdd9 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:48.568025 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f939e878-91b4-456b-8b93-998ab1cfcdd9 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:48.568477 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f939e878-91b4-456b-8b93-998ab1cfcdd9 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:48.703109 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-f939e878-91b4-456b-8b93-998ab1cfcdd9 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:48.711884 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-f939e878-91b4-456b-8b93-998ab1cfcdd9 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/356742b9-7cbf-42d3-93bf-9ee0f93e872e" status: 200 len: 1266 microversion: 2.1 time: 0.157924 Sep 14 09:33:48.712468 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3251/6479] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:33:48 2022] GET /compute/v2.1/servers/356742b9-7cbf-42d3-93bf-9ee0f93e872e => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:33:49.735269 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ad3ee326-654f-466a-a87e-eeb48d850fef tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:49.735856 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-ad3ee326-654f-466a-a87e-eeb48d850fef tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: 356742b9-7cbf-42d3-93bf-9ee0f93e872e] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:49.739164 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=2 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:33:49.739845 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=6 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:33:49.745541 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ad3ee326-654f-466a-a87e-eeb48d850fef tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:49.746035 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ad3ee326-654f-466a-a87e-eeb48d850fef tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:49.746476 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ad3ee326-654f-466a-a87e-eeb48d850fef tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:49.747203 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ad3ee326-654f-466a-a87e-eeb48d850fef tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:49.747661 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ad3ee326-654f-466a-a87e-eeb48d850fef tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:49.748089 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ad3ee326-654f-466a-a87e-eeb48d850fef tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:49.887180 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-ad3ee326-654f-466a-a87e-eeb48d850fef tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:49.895953 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-ad3ee326-654f-466a-a87e-eeb48d850fef tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/356742b9-7cbf-42d3-93bf-9ee0f93e872e" status: 200 len: 1266 microversion: 2.1 time: 0.164731 Sep 14 09:33:49.896629 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3229/6480] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:33:49 2022] GET /compute/v2.1/servers/356742b9-7cbf-42d3-93bf-9ee0f93e872e => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:33:50.921815 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b057af95-01d7-423e-a8f6-7cde2723e4a6 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:50.922536 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-b057af95-01d7-423e-a8f6-7cde2723e4a6 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: 356742b9-7cbf-42d3-93bf-9ee0f93e872e] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:50.925197 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=2 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:33:50.931642 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b057af95-01d7-423e-a8f6-7cde2723e4a6 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:50.932148 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b057af95-01d7-423e-a8f6-7cde2723e4a6 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:50.932603 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b057af95-01d7-423e-a8f6-7cde2723e4a6 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:50.933316 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b057af95-01d7-423e-a8f6-7cde2723e4a6 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:50.933784 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b057af95-01d7-423e-a8f6-7cde2723e4a6 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:50.934229 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b057af95-01d7-423e-a8f6-7cde2723e4a6 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:51.074248 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-b057af95-01d7-423e-a8f6-7cde2723e4a6 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:51.083382 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-b057af95-01d7-423e-a8f6-7cde2723e4a6 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/356742b9-7cbf-42d3-93bf-9ee0f93e872e" status: 200 len: 1266 microversion: 2.1 time: 0.165774 Sep 14 09:33:51.084652 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3252/6481] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:33:50 2022] GET /compute/v2.1/servers/356742b9-7cbf-42d3-93bf-9ee0f93e872e => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:33:52.107343 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-2e867fb4-9f81-427c-b4d0-bc124ec483e4 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:52.108736 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-2e867fb4-9f81-427c-b4d0-bc124ec483e4 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: 356742b9-7cbf-42d3-93bf-9ee0f93e872e] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:52.117059 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2e867fb4-9f81-427c-b4d0-bc124ec483e4 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:52.117753 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2e867fb4-9f81-427c-b4d0-bc124ec483e4 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:52.118433 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2e867fb4-9f81-427c-b4d0-bc124ec483e4 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:52.119245 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2e867fb4-9f81-427c-b4d0-bc124ec483e4 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:52.119929 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2e867fb4-9f81-427c-b4d0-bc124ec483e4 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:52.120686 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2e867fb4-9f81-427c-b4d0-bc124ec483e4 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:52.404625 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-2e867fb4-9f81-427c-b4d0-bc124ec483e4 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:52.412900 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-2e867fb4-9f81-427c-b4d0-bc124ec483e4 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/356742b9-7cbf-42d3-93bf-9ee0f93e872e" status: 200 len: 1266 microversion: 2.1 time: 0.309879 Sep 14 09:33:52.413665 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3230/6482] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:33:52 2022] GET /compute/v2.1/servers/356742b9-7cbf-42d3-93bf-9ee0f93e872e => generated 1266 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:33:53.436445 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-65aad44a-6b7b-4b59-b818-790b8c1d8e33 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:53.437082 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-65aad44a-6b7b-4b59-b818-790b8c1d8e33 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: 356742b9-7cbf-42d3-93bf-9ee0f93e872e] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:53.443885 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-65aad44a-6b7b-4b59-b818-790b8c1d8e33 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:53.444404 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-65aad44a-6b7b-4b59-b818-790b8c1d8e33 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:53.445108 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-65aad44a-6b7b-4b59-b818-790b8c1d8e33 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:53.446197 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-65aad44a-6b7b-4b59-b818-790b8c1d8e33 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:53.446475 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-65aad44a-6b7b-4b59-b818-790b8c1d8e33 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:53.447132 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-65aad44a-6b7b-4b59-b818-790b8c1d8e33 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:53.664255 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-65aad44a-6b7b-4b59-b818-790b8c1d8e33 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:53.672292 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-65aad44a-6b7b-4b59-b818-790b8c1d8e33 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/356742b9-7cbf-42d3-93bf-9ee0f93e872e" status: 200 len: 1266 microversion: 2.1 time: 0.240323 Sep 14 09:33:53.672869 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3253/6483] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:33:53 2022] GET /compute/v2.1/servers/356742b9-7cbf-42d3-93bf-9ee0f93e872e => generated 1266 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:33:54.696010 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-dc448364-8183-4412-a7a8-cd40d3249841 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:54.696551 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-dc448364-8183-4412-a7a8-cd40d3249841 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: 356742b9-7cbf-42d3-93bf-9ee0f93e872e] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:54.699974 n-d-836830-18 devstack@n-api.service[128759]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 09:33:54.700431 n-d-836830-18 devstack@n-api.service[128759]: Wed Sep 14 09:33:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/356742b9-7cbf-42d3-93bf-9ee0f93e872e (ip 10.222.0.60) !!! Sep 14 09:33:54.724934 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dc448364-8183-4412-a7a8-cd40d3249841 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:54.728488 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dc448364-8183-4412-a7a8-cd40d3249841 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:54.729198 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dc448364-8183-4412-a7a8-cd40d3249841 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:54.730563 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dc448364-8183-4412-a7a8-cd40d3249841 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:54.731264 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dc448364-8183-4412-a7a8-cd40d3249841 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:54.731793 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dc448364-8183-4412-a7a8-cd40d3249841 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:54.919849 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-dc448364-8183-4412-a7a8-cd40d3249841 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:54.932957 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-dc448364-8183-4412-a7a8-cd40d3249841 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/356742b9-7cbf-42d3-93bf-9ee0f93e872e" status: 200 len: 1266 microversion: 2.1 time: 0.241022 Sep 14 09:33:54.934253 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3231/6484] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:33:54 2022] GET /compute/v2.1/servers/356742b9-7cbf-42d3-93bf-9ee0f93e872e => generated 1266 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:33:55.957336 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-5b262418-bbf9-4907-ae81-82c7dd659cbf tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:55.957974 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-5b262418-bbf9-4907-ae81-82c7dd659cbf tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: 356742b9-7cbf-42d3-93bf-9ee0f93e872e] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:55.965482 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5b262418-bbf9-4907-ae81-82c7dd659cbf tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:55.966250 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5b262418-bbf9-4907-ae81-82c7dd659cbf tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:55.966692 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5b262418-bbf9-4907-ae81-82c7dd659cbf tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:55.967423 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5b262418-bbf9-4907-ae81-82c7dd659cbf tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:55.967901 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5b262418-bbf9-4907-ae81-82c7dd659cbf tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:55.968327 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5b262418-bbf9-4907-ae81-82c7dd659cbf tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:56.102563 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-5b262418-bbf9-4907-ae81-82c7dd659cbf tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:56.111316 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-5b262418-bbf9-4907-ae81-82c7dd659cbf tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/356742b9-7cbf-42d3-93bf-9ee0f93e872e" status: 200 len: 1266 microversion: 2.1 time: 0.158255 Sep 14 09:33:56.123109 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3254/6485] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:33:55 2022] GET /compute/v2.1/servers/356742b9-7cbf-42d3-93bf-9ee0f93e872e => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:33:56.804794 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-f0dc2b1d-f33a-49b4-a36a-ede5636347f7 req-562c3ac9-bea7-4972-857f-eea82264363d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "356742b9-7cbf-42d3-93bf-9ee0f93e872e", "name": "network-vif-plugged", "status": "completed", "tag": "cef9c9f3-4c7b-4323-b68e-e465bbc007a9"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:33:56.814776 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-f0dc2b1d-f33a-49b4-a36a-ede5636347f7 req-562c3ac9-bea7-4972-857f-eea82264363d service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:56.815538 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-f0dc2b1d-f33a-49b4-a36a-ede5636347f7 req-562c3ac9-bea7-4972-857f-eea82264363d service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:56.815928 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-f0dc2b1d-f33a-49b4-a36a-ede5636347f7 req-562c3ac9-bea7-4972-857f-eea82264363d service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:56.827560 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-f0dc2b1d-f33a-49b4-a36a-ede5636347f7 req-562c3ac9-bea7-4972-857f-eea82264363d service nova] Creating event network-vif-plugged:cef9c9f3-4c7b-4323-b68e-e465bbc007a9 for instance 356742b9-7cbf-42d3-93bf-9ee0f93e872e on n-h1-836830-18 Sep 14 09:33:56.833608 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-f0dc2b1d-f33a-49b4-a36a-ede5636347f7 req-562c3ac9-bea7-4972-857f-eea82264363d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032318 Sep 14 09:33:56.834806 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3232/6486] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:33:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:33:57.135338 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-80293a84-6abc-4cbc-b417-be7b5e727739 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:57.135980 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-80293a84-6abc-4cbc-b417-be7b5e727739 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: 356742b9-7cbf-42d3-93bf-9ee0f93e872e] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:57.142971 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-80293a84-6abc-4cbc-b417-be7b5e727739 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:57.144003 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-80293a84-6abc-4cbc-b417-be7b5e727739 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:57.144456 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-80293a84-6abc-4cbc-b417-be7b5e727739 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:57.145172 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-80293a84-6abc-4cbc-b417-be7b5e727739 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:57.145644 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-80293a84-6abc-4cbc-b417-be7b5e727739 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:57.146086 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-80293a84-6abc-4cbc-b417-be7b5e727739 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:57.288497 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-80293a84-6abc-4cbc-b417-be7b5e727739 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:57.296943 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-80293a84-6abc-4cbc-b417-be7b5e727739 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/356742b9-7cbf-42d3-93bf-9ee0f93e872e" status: 200 len: 1266 microversion: 2.1 time: 0.165485 Sep 14 09:33:57.297850 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3255/6487] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:33:57 2022] GET /compute/v2.1/servers/356742b9-7cbf-42d3-93bf-9ee0f93e872e => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:33:58.321699 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-59a90921-89f5-456b-adc3-d4b80577e018 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:58.322305 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-59a90921-89f5-456b-adc3-d4b80577e018 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: 356742b9-7cbf-42d3-93bf-9ee0f93e872e] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:58.328813 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-59a90921-89f5-456b-adc3-d4b80577e018 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:58.329301 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-59a90921-89f5-456b-adc3-d4b80577e018 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:58.329740 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-59a90921-89f5-456b-adc3-d4b80577e018 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:58.330424 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-59a90921-89f5-456b-adc3-d4b80577e018 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:58.331407 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-59a90921-89f5-456b-adc3-d4b80577e018 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:58.331830 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-59a90921-89f5-456b-adc3-d4b80577e018 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:58.476475 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-59a90921-89f5-456b-adc3-d4b80577e018 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:58.486831 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-59a90921-89f5-456b-adc3-d4b80577e018 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/356742b9-7cbf-42d3-93bf-9ee0f93e872e" status: 200 len: 1266 microversion: 2.1 time: 0.170176 Sep 14 09:33:58.494174 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3233/6488] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:33:58 2022] GET /compute/v2.1/servers/356742b9-7cbf-42d3-93bf-9ee0f93e872e => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:33:59.509880 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-59aa3fce-f95d-4117-aa10-1ba329b846f1 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:59.510649 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-59aa3fce-f95d-4117-aa10-1ba329b846f1 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: 356742b9-7cbf-42d3-93bf-9ee0f93e872e] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:59.518457 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-59aa3fce-f95d-4117-aa10-1ba329b846f1 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:59.519088 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-59aa3fce-f95d-4117-aa10-1ba329b846f1 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:59.519611 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-59aa3fce-f95d-4117-aa10-1ba329b846f1 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:59.520397 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-59aa3fce-f95d-4117-aa10-1ba329b846f1 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:59.520943 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-59aa3fce-f95d-4117-aa10-1ba329b846f1 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:59.521462 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-59aa3fce-f95d-4117-aa10-1ba329b846f1 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:59.667566 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-59aa3fce-f95d-4117-aa10-1ba329b846f1 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:59.676396 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-59aa3fce-f95d-4117-aa10-1ba329b846f1 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/356742b9-7cbf-42d3-93bf-9ee0f93e872e" status: 200 len: 1450 microversion: 2.1 time: 0.170568 Sep 14 09:33:59.682702 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3256/6489] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:33:59 2022] GET /compute/v2.1/servers/356742b9-7cbf-42d3-93bf-9ee0f93e872e => generated 1450 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:33:59.699152 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-11a984d2-73e6-4a65-ba8a-d8773209f093 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:59.699761 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-11a984d2-73e6-4a65-ba8a-d8773209f093 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: 356742b9-7cbf-42d3-93bf-9ee0f93e872e] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:59.707315 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-11a984d2-73e6-4a65-ba8a-d8773209f093 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:59.707817 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-11a984d2-73e6-4a65-ba8a-d8773209f093 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:59.708262 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-11a984d2-73e6-4a65-ba8a-d8773209f093 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:59.708976 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-11a984d2-73e6-4a65-ba8a-d8773209f093 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:59.709435 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-11a984d2-73e6-4a65-ba8a-d8773209f093 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:59.709869 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-11a984d2-73e6-4a65-ba8a-d8773209f093 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:59.881850 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-11a984d2-73e6-4a65-ba8a-d8773209f093 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:59.890580 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-11a984d2-73e6-4a65-ba8a-d8773209f093 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/356742b9-7cbf-42d3-93bf-9ee0f93e872e" status: 200 len: 1450 microversion: 2.1 time: 0.195292 Sep 14 09:33:59.891671 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3234/6490] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:33:59 2022] GET /compute/v2.1/servers/356742b9-7cbf-42d3-93bf-9ee0f93e872e => generated 1450 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:34:01.676564 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-553c9c35-b10e-43d4-9f8e-38f4f0d32314 req-d1016080-1cb6-4105-8d56-10f5aafda205 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "356742b9-7cbf-42d3-93bf-9ee0f93e872e", "tag": "cef9c9f3-4c7b-4323-b68e-e465bbc007a9"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:34:01.694296 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-553c9c35-b10e-43d4-9f8e-38f4f0d32314 req-d1016080-1cb6-4105-8d56-10f5aafda205 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:01.694810 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-553c9c35-b10e-43d4-9f8e-38f4f0d32314 req-d1016080-1cb6-4105-8d56-10f5aafda205 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:01.695397 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-553c9c35-b10e-43d4-9f8e-38f4f0d32314 req-d1016080-1cb6-4105-8d56-10f5aafda205 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:01.711439 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-553c9c35-b10e-43d4-9f8e-38f4f0d32314 req-d1016080-1cb6-4105-8d56-10f5aafda205 service nova] Creating event network-changed:cef9c9f3-4c7b-4323-b68e-e465bbc007a9 for instance 356742b9-7cbf-42d3-93bf-9ee0f93e872e on n-h1-836830-18 Sep 14 09:34:01.717443 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-553c9c35-b10e-43d4-9f8e-38f4f0d32314 req-d1016080-1cb6-4105-8d56-10f5aafda205 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.156246 Sep 14 09:34:01.722668 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3257/6491] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:34:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:34:09.075211 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-681ef67f-edb6-452a-bf44-c717e76dc3d6 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:34:09.077794 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-681ef67f-edb6-452a-bf44-c717e76dc3d6 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: c1297f74-578d-4a0d-8fd3-4197917a1dda] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:34:09.080269 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:34:09.086150 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-681ef67f-edb6-452a-bf44-c717e76dc3d6 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:09.086730 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-681ef67f-edb6-452a-bf44-c717e76dc3d6 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:09.087483 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-681ef67f-edb6-452a-bf44-c717e76dc3d6 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:09.088556 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-681ef67f-edb6-452a-bf44-c717e76dc3d6 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:09.089251 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-681ef67f-edb6-452a-bf44-c717e76dc3d6 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:09.089931 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-681ef67f-edb6-452a-bf44-c717e76dc3d6 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:09.176572 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-681ef67f-edb6-452a-bf44-c717e76dc3d6 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "POST /compute/v2.1/servers/c1297f74-578d-4a0d-8fd3-4197917a1dda/action" status: 200 len: 62909 microversion: 2.1 time: 0.174610 Sep 14 09:34:09.177249 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3235/6492] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:34:09 2022] POST /compute/v2.1/servers/c1297f74-578d-4a0d-8fd3-4197917a1dda/action => generated 62909 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 09:34:31.923024 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=37 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:34:31.923787 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=55 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:34:32.150642 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-53e44e2e-c06b-4a89-a296-af0c3d468261 tempest-TestNetworkAdvancedServerOps-649526860 tempest-TestNetworkAdvancedServerOps-649526860-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:34:32.151459 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-53e44e2e-c06b-4a89-a296-af0c3d468261 tempest-TestNetworkAdvancedServerOps-649526860 tempest-TestNetworkAdvancedServerOps-649526860-project-admin] [instance: c1297f74-578d-4a0d-8fd3-4197917a1dda] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:34:32.157605 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-53e44e2e-c06b-4a89-a296-af0c3d468261 tempest-TestNetworkAdvancedServerOps-649526860 tempest-TestNetworkAdvancedServerOps-649526860-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:32.158097 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-53e44e2e-c06b-4a89-a296-af0c3d468261 tempest-TestNetworkAdvancedServerOps-649526860 tempest-TestNetworkAdvancedServerOps-649526860-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:32.158587 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-53e44e2e-c06b-4a89-a296-af0c3d468261 tempest-TestNetworkAdvancedServerOps-649526860 tempest-TestNetworkAdvancedServerOps-649526860-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:32.159310 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-53e44e2e-c06b-4a89-a296-af0c3d468261 tempest-TestNetworkAdvancedServerOps-649526860 tempest-TestNetworkAdvancedServerOps-649526860-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:32.159780 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-53e44e2e-c06b-4a89-a296-af0c3d468261 tempest-TestNetworkAdvancedServerOps-649526860 tempest-TestNetworkAdvancedServerOps-649526860-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:32.160212 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-53e44e2e-c06b-4a89-a296-af0c3d468261 tempest-TestNetworkAdvancedServerOps-649526860 tempest-TestNetworkAdvancedServerOps-649526860-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:32.288690 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-53e44e2e-c06b-4a89-a296-af0c3d468261 tempest-TestNetworkAdvancedServerOps-649526860 tempest-TestNetworkAdvancedServerOps-649526860-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/c1297f74-578d-4a0d-8fd3-4197917a1dda" status: 200 len: 1836 microversion: 2.1 time: 0.370834 Sep 14 09:34:32.289344 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3258/6493] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:34:31 2022] GET /compute/v2.1/servers/c1297f74-578d-4a0d-8fd3-4197917a1dda => generated 1836 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:34:33.519837 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-84b7161a-0d96-47b1-844b-fe0330fb2bdf tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:34:33.520501 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-84b7161a-0d96-47b1-844b-fe0330fb2bdf tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: c1297f74-578d-4a0d-8fd3-4197917a1dda] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:34:33.523469 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:34:33.524718 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=43 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:34:33.534025 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-84b7161a-0d96-47b1-844b-fe0330fb2bdf tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:33.534782 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-84b7161a-0d96-47b1-844b-fe0330fb2bdf tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:33.535323 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-84b7161a-0d96-47b1-844b-fe0330fb2bdf tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:33.536193 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-84b7161a-0d96-47b1-844b-fe0330fb2bdf tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:33.536741 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-84b7161a-0d96-47b1-844b-fe0330fb2bdf tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:33.537246 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-84b7161a-0d96-47b1-844b-fe0330fb2bdf tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:33.574779 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-84b7161a-0d96-47b1-844b-fe0330fb2bdf tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: c1297f74-578d-4a0d-8fd3-4197917a1dda] Going to try to terminate instance {{(pid=128759) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:34:33.603573 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-7efc3d1d-a21c-4cea-86a2-7c675627cf74 req-d6679b30-6128-4158-a804-a2c3cf8f86d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1297f74-578d-4a0d-8fd3-4197917a1dda", "tag": "ca01d346-79c1-4969-9a4a-9124c8c992c0"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:34:33.615637 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-7efc3d1d-a21c-4cea-86a2-7c675627cf74 req-d6679b30-6128-4158-a804-a2c3cf8f86d7 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:33.616246 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-7efc3d1d-a21c-4cea-86a2-7c675627cf74 req-d6679b30-6128-4158-a804-a2c3cf8f86d7 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:33.616660 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-7efc3d1d-a21c-4cea-86a2-7c675627cf74 req-d6679b30-6128-4158-a804-a2c3cf8f86d7 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:33.627804 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-7efc3d1d-a21c-4cea-86a2-7c675627cf74 req-d6679b30-6128-4158-a804-a2c3cf8f86d7 service nova] Creating event network-changed:ca01d346-79c1-4969-9a4a-9124c8c992c0 for instance c1297f74-578d-4a0d-8fd3-4197917a1dda on n-h1-836830-18 Sep 14 09:34:33.632994 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-7efc3d1d-a21c-4cea-86a2-7c675627cf74 req-d6679b30-6128-4158-a804-a2c3cf8f86d7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115673 Sep 14 09:34:33.633792 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3259/6494] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:34:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:34:33.667679 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-84b7161a-0d96-47b1-844b-fe0330fb2bdf tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "DELETE /compute/v2.1/servers/c1297f74-578d-4a0d-8fd3-4197917a1dda" status: 204 len: 0 microversion: 2.1 time: 0.152252 Sep 14 09:34:33.668675 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3236/6495] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:34:33 2022] DELETE /compute/v2.1/servers/c1297f74-578d-4a0d-8fd3-4197917a1dda => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:34:33.679684 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b770cc2f-68d8-493c-920e-22004620999d tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:34:33.691217 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-b770cc2f-68d8-493c-920e-22004620999d tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: c1297f74-578d-4a0d-8fd3-4197917a1dda] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:34:33.699659 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b770cc2f-68d8-493c-920e-22004620999d tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:33.700500 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b770cc2f-68d8-493c-920e-22004620999d tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:33.700958 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b770cc2f-68d8-493c-920e-22004620999d tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:33.701692 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b770cc2f-68d8-493c-920e-22004620999d tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:33.702353 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b770cc2f-68d8-493c-920e-22004620999d tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:33.702991 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b770cc2f-68d8-493c-920e-22004620999d tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:33.868996 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-b770cc2f-68d8-493c-920e-22004620999d tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725d7beb4ec54b86a455af0d7bd0ce19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c197eded81494b818b1e56f4c01432c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:33.878072 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-b770cc2f-68d8-493c-920e-22004620999d tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/c1297f74-578d-4a0d-8fd3-4197917a1dda" status: 200 len: 1689 microversion: 2.1 time: 0.203976 Sep 14 09:34:33.879412 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3260/6496] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:34:33 2022] GET /compute/v2.1/servers/c1297f74-578d-4a0d-8fd3-4197917a1dda => generated 1689 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:34:34.903077 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-4c532747-df34-4a96-8af2-7c088fe38c78 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:34:34.903801 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-4c532747-df34-4a96-8af2-7c088fe38c78 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: c1297f74-578d-4a0d-8fd3-4197917a1dda] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:34:34.911711 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4c532747-df34-4a96-8af2-7c088fe38c78 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:34.912213 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4c532747-df34-4a96-8af2-7c088fe38c78 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:34.912659 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4c532747-df34-4a96-8af2-7c088fe38c78 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:34.913428 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4c532747-df34-4a96-8af2-7c088fe38c78 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:34.913899 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4c532747-df34-4a96-8af2-7c088fe38c78 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:34.914331 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4c532747-df34-4a96-8af2-7c088fe38c78 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:35.051810 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-4c532747-df34-4a96-8af2-7c088fe38c78 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725d7beb4ec54b86a455af0d7bd0ce19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c197eded81494b818b1e56f4c01432c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:35.059976 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-4c532747-df34-4a96-8af2-7c088fe38c78 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/c1297f74-578d-4a0d-8fd3-4197917a1dda" status: 200 len: 1689 microversion: 2.1 time: 0.161395 Sep 14 09:34:35.060564 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3237/6497] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:34:34 2022] GET /compute/v2.1/servers/c1297f74-578d-4a0d-8fd3-4197917a1dda => generated 1689 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:34:36.084461 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-09e36f9c-06a3-4d6c-910d-0cfa8f3b3632 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:34:36.085203 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-09e36f9c-06a3-4d6c-910d-0cfa8f3b3632 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: c1297f74-578d-4a0d-8fd3-4197917a1dda] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:34:36.093897 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-09e36f9c-06a3-4d6c-910d-0cfa8f3b3632 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:36.094615 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-09e36f9c-06a3-4d6c-910d-0cfa8f3b3632 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:36.094858 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-09e36f9c-06a3-4d6c-910d-0cfa8f3b3632 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:36.095598 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-09e36f9c-06a3-4d6c-910d-0cfa8f3b3632 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:36.096794 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-09e36f9c-06a3-4d6c-910d-0cfa8f3b3632 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:36.097232 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-09e36f9c-06a3-4d6c-910d-0cfa8f3b3632 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:36.110446 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-ee0bb98a-76f0-4d24-8d9a-7685c0eed274 req-76ae4fce-6839-46c8-bece-b25820b3c9a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1297f74-578d-4a0d-8fd3-4197917a1dda", "name": "network-vif-deleted", "tag": "ca01d346-79c1-4969-9a4a-9124c8c992c0"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:34:36.124153 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-ee0bb98a-76f0-4d24-8d9a-7685c0eed274 req-76ae4fce-6839-46c8-bece-b25820b3c9a1 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:36.124693 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-ee0bb98a-76f0-4d24-8d9a-7685c0eed274 req-76ae4fce-6839-46c8-bece-b25820b3c9a1 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:36.125133 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-ee0bb98a-76f0-4d24-8d9a-7685c0eed274 req-76ae4fce-6839-46c8-bece-b25820b3c9a1 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:36.144435 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-ee0bb98a-76f0-4d24-8d9a-7685c0eed274 req-76ae4fce-6839-46c8-bece-b25820b3c9a1 service nova] Creating event network-vif-deleted:ca01d346-79c1-4969-9a4a-9124c8c992c0 for instance c1297f74-578d-4a0d-8fd3-4197917a1dda on n-h1-836830-18 Sep 14 09:34:36.149818 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-ee0bb98a-76f0-4d24-8d9a-7685c0eed274 req-76ae4fce-6839-46c8-bece-b25820b3c9a1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044759 Sep 14 09:34:36.150751 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3238/6498] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:34:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:34:36.169089 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-09e36f9c-06a3-4d6c-910d-0cfa8f3b3632 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725d7beb4ec54b86a455af0d7bd0ce19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c197eded81494b818b1e56f4c01432c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:36.177998 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-09e36f9c-06a3-4d6c-910d-0cfa8f3b3632 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/c1297f74-578d-4a0d-8fd3-4197917a1dda" status: 200 len: 1502 microversion: 2.1 time: 0.098075 Sep 14 09:34:36.178559 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3261/6499] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:34:36 2022] GET /compute/v2.1/servers/c1297f74-578d-4a0d-8fd3-4197917a1dda => generated 1502 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:34:37.206297 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8160ff4b-6d63-4d86-8df4-507d0b73cb62 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:34:37.207047 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-8160ff4b-6d63-4d86-8df4-507d0b73cb62 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: c1297f74-578d-4a0d-8fd3-4197917a1dda] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:34:37.214001 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8160ff4b-6d63-4d86-8df4-507d0b73cb62 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:37.214489 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8160ff4b-6d63-4d86-8df4-507d0b73cb62 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:37.214932 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8160ff4b-6d63-4d86-8df4-507d0b73cb62 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:37.215661 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8160ff4b-6d63-4d86-8df4-507d0b73cb62 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:37.216123 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8160ff4b-6d63-4d86-8df4-507d0b73cb62 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:37.216561 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8160ff4b-6d63-4d86-8df4-507d0b73cb62 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:37.230092 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-8160ff4b-6d63-4d86-8df4-507d0b73cb62 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] HTTP exception thrown: Instance c1297f74-578d-4a0d-8fd3-4197917a1dda could not be found. Sep 14 09:34:37.231750 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8160ff4b-6d63-4d86-8df4-507d0b73cb62 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Request method failure captured: Sep 14 09:34:37.231750 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/c1297f74-578d-4a0d-8fd3-4197917a1dda HTTP/1.1 Sep 14 09:34:37.231750 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:34:37.231750 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:34:37.231750 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:34:37.231750 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:34:37.231750 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:34:37.231750 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:34:37.231750 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:34:37.231750 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:34:37.231750 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZ7Wj_81f9I2NRmfEwmuZpjrdWAEw7ARyOuI73wjvWEI66LzqUtysPT6IcAh0WZe2oebLj28uG94-uPGEC9cMUUKdhbePLDzfTDtmqqpgsB5YUrdD9jeNjtdjFX4L0eMBEKdd412dq4yc0_P9JNCFrwq1ozBqOy_b7PF0eHqh0jyqOo Sep 14 09:34:37.231750 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:34:37.231750 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:34:37.231750 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:34:37.231750 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:34:37.231750 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:34:37.231750 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:34:37.231750 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: c197eded81494b818b1e56f4c01432c5 Sep 14 09:34:37.231750 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1922438431 Sep 14 09:34:37.231750 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:34:37.231750 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:34:37.231750 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c197eded81494b818b1e56f4c01432c5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c197eded81494b818b1e56f4c01432c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c197eded81494b818b1e56f4c01432c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c197eded81494b818b1e56f4c01432c5"}]}] Sep 14 09:34:37.231750 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1922438431 Sep 14 09:34:37.231750 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: c197eded81494b818b1e56f4c01432c5 Sep 14 09:34:37.231750 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1922438431 Sep 14 09:34:37.231750 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-TestNetworkAdvancedServerOps-1922438431-project Sep 14 09:34:37.231750 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:34:37.231750 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:34:37.231750 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 725d7beb4ec54b86a455af0d7bd0ce19 Sep 14 09:34:37.231750 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1922438431-project Sep 14 09:34:37.231750 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:34:37.231750 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance c1297f74-578d-4a0d-8fd3-4197917a1dda could not be found. Sep 14 09:34:37.231750 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': 'c1297f74-578d-4a0d-8fd3-4197917a1dda'} Sep 14 09:34:37.231750 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:34:37.231750 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:34:37.231750 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:34:37.231750 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:34:37.231750 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:34:37.231750 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:34:37.231750 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:34:37.231750 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:34:37.231750 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:34:37.231750 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:34:37.231750 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1297f74-578d-4a0d-8fd3-4197917a1dda could not be found. Sep 14 09:34:37.231750 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:34:37.231750 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:34:37.231750 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:34:37.231750 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:34:37.231750 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:34:37.231750 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:34:37.231750 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:34:37.231750 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:34:37.231750 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:34:37.231750 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:34:37.231750 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:34:37.231750 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:34:37.231750 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:34:37.231750 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:34:37.231750 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:34:37.231750 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:34:37.231750 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1297f74-578d-4a0d-8fd3-4197917a1dda could not be found. Sep 14 09:34:37.231750 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:34:37.231750 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:34:37.237159 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:34:37.237159 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:34:37.237159 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:34:37.237159 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:34:37.237159 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:34:37.237159 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:34:37.237159 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1297f74-578d-4a0d-8fd3-4197917a1dda could not be found. Sep 14 09:34:37.237159 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:34:37.237159 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8160ff4b-6d63-4d86-8df4-507d0b73cb62 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Returning 404 to user: Instance c1297f74-578d-4a0d-8fd3-4197917a1dda could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:34:37.237159 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-8160ff4b-6d63-4d86-8df4-507d0b73cb62 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/c1297f74-578d-4a0d-8fd3-4197917a1dda" status: 404 len: 111 microversion: 2.1 time: 0.031942 Sep 14 09:34:37.237159 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3239/6500] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:34:37 2022] GET /compute/v2.1/servers/c1297f74-578d-4a0d-8fd3-4197917a1dda => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:34:40.557391 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-30e7fff4-faed-46cc-a726-2b68b74f5366 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '.version_select at 0x7f7d3f2cd0d0>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:34:40.586646 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-30e7fff4-faed-46cc-a726-2b68b74f5366 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1032342371" status: 202 len: 0 microversion: 2.1 time: 0.033264 Sep 14 09:34:40.587227 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3262/6501] 10.222.0.60 () {58 vars in 1284 bytes} [Wed Sep 14 09:34:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1032342371 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:34:40.622108 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f308bf34-cf5b-4bb3-af87-46b4792bedae tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Action: 'create', calling method: .version_select at 0x7f7d3ede4ee0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1408939257", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD1v6+vS2qShv19AAix/UlhOuW+ewplC5ZGn2go6TMlnJRrCJuiu/SHy2FTatVP4/u9kgzgGavIU5WmxZvVjE2Pmf42ZA6nptX4EsgVJpno5xKOKiJSczvzXaEwpS9w7HQ=="}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:34:40.642274 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-f308bf34-cf5b-4bb3-af87-46b4792bedae tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Getting quotas for project c197eded81494b818b1e56f4c01432c5. Resources: {'key_pairs'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:34:40.647537 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-f308bf34-cf5b-4bb3-af87-46b4792bedae tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Getting quotas for user 725d7beb4ec54b86a455af0d7bd0ce19 and project c197eded81494b818b1e56f4c01432c5. Resources: {'key_pairs'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:34:40.674806 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f308bf34-cf5b-4bb3-af87-46b4792bedae tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.056012 Sep 14 09:34:40.675892 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3240/6502] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Sep 14 09:34:40 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:34:46.130150 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-f0053c1c-e553-4e93-b4f1-cc6d0176f486 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1972732067", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "networks": [{"uuid": "3af29760-5166-4c88-a005-556ab4bc55d8"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1408939257", "security_groups": [{"name": "tempest-secgroup-smoke-1064208018"}]}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:34:46.177128 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=20 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:34:46.249399 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.network.neutron [None req-f0053c1c-e553-4e93-b4f1-cc6d0176f486 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] validate_networks() for [('3af29760-5166-4c88-a005-556ab4bc55d8', None, None, None, None, None)] {{(pid=128758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:34:46.737147 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-f0053c1c-e553-4e93-b4f1-cc6d0176f486 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Flavor limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:34:46.737592 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-f0053c1c-e553-4e93-b4f1-cc6d0176f486 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Image limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:34:46.738127 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-f0053c1c-e553-4e93-b4f1-cc6d0176f486 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Flavor pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:34:46.738885 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-f0053c1c-e553-4e93-b4f1-cc6d0176f486 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Image pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:34:46.739227 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-f0053c1c-e553-4e93-b4f1-cc6d0176f486 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:34:46.756420 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f0053c1c-e553-4e93-b4f1-cc6d0176f486 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:46.756929 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f0053c1c-e553-4e93-b4f1-cc6d0176f486 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:46.757440 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f0053c1c-e553-4e93-b4f1-cc6d0176f486 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:46.758128 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f0053c1c-e553-4e93-b4f1-cc6d0176f486 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:46.758600 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f0053c1c-e553-4e93-b4f1-cc6d0176f486 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:46.759090 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f0053c1c-e553-4e93-b4f1-cc6d0176f486 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:46.785670 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-f0053c1c-e553-4e93-b4f1-cc6d0176f486 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Getting quotas for project c197eded81494b818b1e56f4c01432c5. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:34:46.796478 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-f0053c1c-e553-4e93-b4f1-cc6d0176f486 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Getting quotas for user 725d7beb4ec54b86a455af0d7bd0ce19 and project c197eded81494b818b1e56f4c01432c5. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:34:46.819338 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-f0053c1c-e553-4e93-b4f1-cc6d0176f486 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Going to run 1 instances... {{(pid=128758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:34:46.821619 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-f0053c1c-e553-4e93-b4f1-cc6d0176f486 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: e156b236-ffea-4914-a349-7820a9976c98] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:34:46.905731 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-f0053c1c-e553-4e93-b4f1-cc6d0176f486 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.779396 Sep 14 09:34:46.910517 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3263/6503] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 09:34:46 2022] POST /compute/v2.1/servers => generated 406 bytes in 781 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:34:46.919267 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8b54117b-3c78-4509-9882-2be9db45e8ae tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:34:46.919904 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-8b54117b-3c78-4509-9882-2be9db45e8ae tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: e156b236-ffea-4914-a349-7820a9976c98] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:34:47.001773 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-8b54117b-3c78-4509-9882-2be9db45e8ae tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725d7beb4ec54b86a455af0d7bd0ce19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c197eded81494b818b1e56f4c01432c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:47.010093 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-8b54117b-3c78-4509-9882-2be9db45e8ae tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/e156b236-ffea-4914-a349-7820a9976c98" status: 200 len: 1267 microversion: 2.1 time: 0.095975 Sep 14 09:34:47.033764 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3241/6504] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:34:46 2022] GET /compute/v2.1/servers/e156b236-ffea-4914-a349-7820a9976c98 => generated 1267 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:34:48.041660 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-17aad9c7-074c-4bac-b5c7-35b8e7c90fd1 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:34:48.042391 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-17aad9c7-074c-4bac-b5c7-35b8e7c90fd1 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: e156b236-ffea-4914-a349-7820a9976c98] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:34:48.049802 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-17aad9c7-074c-4bac-b5c7-35b8e7c90fd1 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:48.050486 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-17aad9c7-074c-4bac-b5c7-35b8e7c90fd1 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:48.051078 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-17aad9c7-074c-4bac-b5c7-35b8e7c90fd1 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:48.051947 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-17aad9c7-074c-4bac-b5c7-35b8e7c90fd1 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:48.052525 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-17aad9c7-074c-4bac-b5c7-35b8e7c90fd1 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:48.053092 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-17aad9c7-074c-4bac-b5c7-35b8e7c90fd1 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:48.127831 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-17aad9c7-074c-4bac-b5c7-35b8e7c90fd1 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725d7beb4ec54b86a455af0d7bd0ce19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c197eded81494b818b1e56f4c01432c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:48.137480 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-17aad9c7-074c-4bac-b5c7-35b8e7c90fd1 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/e156b236-ffea-4914-a349-7820a9976c98" status: 200 len: 1327 microversion: 2.1 time: 0.100637 Sep 14 09:34:48.143772 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3264/6505] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:34:48 2022] GET /compute/v2.1/servers/e156b236-ffea-4914-a349-7820a9976c98 => generated 1327 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:34:49.167802 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e211b196-2625-47b2-b5a0-64c740a03d48 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:34:49.169831 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e211b196-2625-47b2-b5a0-64c740a03d48 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: e156b236-ffea-4914-a349-7820a9976c98] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:34:49.172619 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:34:49.187549 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e211b196-2625-47b2-b5a0-64c740a03d48 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:49.189418 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e211b196-2625-47b2-b5a0-64c740a03d48 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:49.190485 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e211b196-2625-47b2-b5a0-64c740a03d48 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:49.191443 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e211b196-2625-47b2-b5a0-64c740a03d48 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:49.192244 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e211b196-2625-47b2-b5a0-64c740a03d48 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:49.192856 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e211b196-2625-47b2-b5a0-64c740a03d48 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:49.360259 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-e211b196-2625-47b2-b5a0-64c740a03d48 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725d7beb4ec54b86a455af0d7bd0ce19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c197eded81494b818b1e56f4c01432c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:49.368713 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e211b196-2625-47b2-b5a0-64c740a03d48 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/e156b236-ffea-4914-a349-7820a9976c98" status: 200 len: 1393 microversion: 2.1 time: 0.205541 Sep 14 09:34:49.370473 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3242/6506] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:34:49 2022] GET /compute/v2.1/servers/e156b236-ffea-4914-a349-7820a9976c98 => generated 1393 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:34:49.808972 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-fa0c780a-b4e1-467d-a71a-3a2ab27c4ce1 req-749cc370-0cee-4482-a974-1ba6a06ec544 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e156b236-ffea-4914-a349-7820a9976c98", "tag": "35b894fe-add4-4e6f-a2c6-2d73d289bb07"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:34:49.826492 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-fa0c780a-b4e1-467d-a71a-3a2ab27c4ce1 req-749cc370-0cee-4482-a974-1ba6a06ec544 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:49.827008 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-fa0c780a-b4e1-467d-a71a-3a2ab27c4ce1 req-749cc370-0cee-4482-a974-1ba6a06ec544 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:49.827739 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-fa0c780a-b4e1-467d-a71a-3a2ab27c4ce1 req-749cc370-0cee-4482-a974-1ba6a06ec544 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:49.842190 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-fa0c780a-b4e1-467d-a71a-3a2ab27c4ce1 req-749cc370-0cee-4482-a974-1ba6a06ec544 service nova] Creating event network-changed:35b894fe-add4-4e6f-a2c6-2d73d289bb07 for instance e156b236-ffea-4914-a349-7820a9976c98 on n-h2-836830-18 Sep 14 09:34:49.847764 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-fa0c780a-b4e1-467d-a71a-3a2ab27c4ce1 req-749cc370-0cee-4482-a974-1ba6a06ec544 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042449 Sep 14 09:34:49.848386 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3265/6507] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:34:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:34:50.392516 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f666eb6a-77af-411a-8b2e-41278e9a65c7 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:34:50.393144 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f666eb6a-77af-411a-8b2e-41278e9a65c7 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: e156b236-ffea-4914-a349-7820a9976c98] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:34:50.403526 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f666eb6a-77af-411a-8b2e-41278e9a65c7 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:50.404025 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f666eb6a-77af-411a-8b2e-41278e9a65c7 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:50.404478 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f666eb6a-77af-411a-8b2e-41278e9a65c7 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:50.405183 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f666eb6a-77af-411a-8b2e-41278e9a65c7 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:50.405645 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f666eb6a-77af-411a-8b2e-41278e9a65c7 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:50.406077 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f666eb6a-77af-411a-8b2e-41278e9a65c7 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:50.544749 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f666eb6a-77af-411a-8b2e-41278e9a65c7 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725d7beb4ec54b86a455af0d7bd0ce19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c197eded81494b818b1e56f4c01432c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:50.552422 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f666eb6a-77af-411a-8b2e-41278e9a65c7 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/e156b236-ffea-4914-a349-7820a9976c98" status: 200 len: 1393 microversion: 2.1 time: 0.163858 Sep 14 09:34:50.552999 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3243/6508] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:34:50 2022] GET /compute/v2.1/servers/e156b236-ffea-4914-a349-7820a9976c98 => generated 1393 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:34:51.576587 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ee1101f1-6510-4f38-a958-9caf98cd79c6 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:34:51.577408 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-ee1101f1-6510-4f38-a958-9caf98cd79c6 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: e156b236-ffea-4914-a349-7820a9976c98] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:34:51.584585 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ee1101f1-6510-4f38-a958-9caf98cd79c6 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:51.585161 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ee1101f1-6510-4f38-a958-9caf98cd79c6 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:51.585677 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ee1101f1-6510-4f38-a958-9caf98cd79c6 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:51.586474 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ee1101f1-6510-4f38-a958-9caf98cd79c6 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:51.587045 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ee1101f1-6510-4f38-a958-9caf98cd79c6 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:51.587553 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ee1101f1-6510-4f38-a958-9caf98cd79c6 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:51.726316 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-ee1101f1-6510-4f38-a958-9caf98cd79c6 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725d7beb4ec54b86a455af0d7bd0ce19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c197eded81494b818b1e56f4c01432c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:51.734306 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-ee1101f1-6510-4f38-a958-9caf98cd79c6 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/e156b236-ffea-4914-a349-7820a9976c98" status: 200 len: 1393 microversion: 2.1 time: 0.162954 Sep 14 09:34:51.734909 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3266/6509] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:34:51 2022] GET /compute/v2.1/servers/e156b236-ffea-4914-a349-7820a9976c98 => generated 1393 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:34:52.757598 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-57379039-bc9a-4f41-b69e-a92feec09b37 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:34:52.758288 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-57379039-bc9a-4f41-b69e-a92feec09b37 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: e156b236-ffea-4914-a349-7820a9976c98] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:34:52.765129 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-57379039-bc9a-4f41-b69e-a92feec09b37 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:52.765621 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-57379039-bc9a-4f41-b69e-a92feec09b37 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:52.766060 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-57379039-bc9a-4f41-b69e-a92feec09b37 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:52.766752 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-57379039-bc9a-4f41-b69e-a92feec09b37 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:52.767264 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-57379039-bc9a-4f41-b69e-a92feec09b37 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:52.767695 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-57379039-bc9a-4f41-b69e-a92feec09b37 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:52.904628 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-57379039-bc9a-4f41-b69e-a92feec09b37 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725d7beb4ec54b86a455af0d7bd0ce19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c197eded81494b818b1e56f4c01432c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:52.912437 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-57379039-bc9a-4f41-b69e-a92feec09b37 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/e156b236-ffea-4914-a349-7820a9976c98" status: 200 len: 1393 microversion: 2.1 time: 0.158825 Sep 14 09:34:52.913012 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3244/6510] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:34:52 2022] GET /compute/v2.1/servers/e156b236-ffea-4914-a349-7820a9976c98 => generated 1393 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:34:53.935650 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-51772279-7b54-4ef2-91a8-edac5f33e6a5 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:34:53.936277 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-51772279-7b54-4ef2-91a8-edac5f33e6a5 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: e156b236-ffea-4914-a349-7820a9976c98] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:34:53.943204 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-51772279-7b54-4ef2-91a8-edac5f33e6a5 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:53.943714 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-51772279-7b54-4ef2-91a8-edac5f33e6a5 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:53.944161 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-51772279-7b54-4ef2-91a8-edac5f33e6a5 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:53.944888 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-51772279-7b54-4ef2-91a8-edac5f33e6a5 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:53.945348 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-51772279-7b54-4ef2-91a8-edac5f33e6a5 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:53.945780 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-51772279-7b54-4ef2-91a8-edac5f33e6a5 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:54.074822 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-51772279-7b54-4ef2-91a8-edac5f33e6a5 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725d7beb4ec54b86a455af0d7bd0ce19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c197eded81494b818b1e56f4c01432c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:54.082898 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-51772279-7b54-4ef2-91a8-edac5f33e6a5 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/e156b236-ffea-4914-a349-7820a9976c98" status: 200 len: 1393 microversion: 2.1 time: 0.151177 Sep 14 09:34:54.084002 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3267/6511] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:34:53 2022] GET /compute/v2.1/servers/e156b236-ffea-4914-a349-7820a9976c98 => generated 1393 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:34:55.105715 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8e2af4d3-618d-41b6-8b6b-7a1c873db8c6 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:34:55.106324 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-8e2af4d3-618d-41b6-8b6b-7a1c873db8c6 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: e156b236-ffea-4914-a349-7820a9976c98] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:34:55.112875 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8e2af4d3-618d-41b6-8b6b-7a1c873db8c6 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:55.113324 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8e2af4d3-618d-41b6-8b6b-7a1c873db8c6 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:55.113750 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8e2af4d3-618d-41b6-8b6b-7a1c873db8c6 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:55.114526 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8e2af4d3-618d-41b6-8b6b-7a1c873db8c6 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:55.115022 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8e2af4d3-618d-41b6-8b6b-7a1c873db8c6 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:55.115444 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8e2af4d3-618d-41b6-8b6b-7a1c873db8c6 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:55.236728 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-cff75f5a-c468-48e7-883b-b8c8cf18cb5d req-fbd40e78-a584-45ad-9fd6-1b48a2ca72a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e156b236-ffea-4914-a349-7820a9976c98", "name": "network-vif-plugged", "status": "completed", "tag": "35b894fe-add4-4e6f-a2c6-2d73d289bb07"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:34:55.247088 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-cff75f5a-c468-48e7-883b-b8c8cf18cb5d req-fbd40e78-a584-45ad-9fd6-1b48a2ca72a4 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:55.247829 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-cff75f5a-c468-48e7-883b-b8c8cf18cb5d req-fbd40e78-a584-45ad-9fd6-1b48a2ca72a4 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:55.248335 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-cff75f5a-c468-48e7-883b-b8c8cf18cb5d req-fbd40e78-a584-45ad-9fd6-1b48a2ca72a4 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:55.260746 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-cff75f5a-c468-48e7-883b-b8c8cf18cb5d req-fbd40e78-a584-45ad-9fd6-1b48a2ca72a4 service nova] Creating event network-vif-plugged:35b894fe-add4-4e6f-a2c6-2d73d289bb07 for instance e156b236-ffea-4914-a349-7820a9976c98 on n-h2-836830-18 Sep 14 09:34:55.265832 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-cff75f5a-c468-48e7-883b-b8c8cf18cb5d req-fbd40e78-a584-45ad-9fd6-1b48a2ca72a4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105294 Sep 14 09:34:55.266445 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3268/6512] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:34:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:34:55.267743 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-8e2af4d3-618d-41b6-8b6b-7a1c873db8c6 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725d7beb4ec54b86a455af0d7bd0ce19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c197eded81494b818b1e56f4c01432c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:55.277632 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-8e2af4d3-618d-41b6-8b6b-7a1c873db8c6 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/e156b236-ffea-4914-a349-7820a9976c98" status: 200 len: 1393 microversion: 2.1 time: 0.175823 Sep 14 09:34:55.278216 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3245/6513] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:34:55 2022] GET /compute/v2.1/servers/e156b236-ffea-4914-a349-7820a9976c98 => generated 1393 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:34:56.301565 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c68f002a-1606-43cb-a4be-180d77416155 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:34:56.302805 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-c68f002a-1606-43cb-a4be-180d77416155 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: e156b236-ffea-4914-a349-7820a9976c98] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:34:56.309094 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c68f002a-1606-43cb-a4be-180d77416155 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:56.309591 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c68f002a-1606-43cb-a4be-180d77416155 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:56.310039 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c68f002a-1606-43cb-a4be-180d77416155 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:56.310740 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c68f002a-1606-43cb-a4be-180d77416155 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:56.311252 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c68f002a-1606-43cb-a4be-180d77416155 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:56.311688 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c68f002a-1606-43cb-a4be-180d77416155 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:56.452074 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-c68f002a-1606-43cb-a4be-180d77416155 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725d7beb4ec54b86a455af0d7bd0ce19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c197eded81494b818b1e56f4c01432c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:56.460433 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-c68f002a-1606-43cb-a4be-180d77416155 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/e156b236-ffea-4914-a349-7820a9976c98" status: 200 len: 1393 microversion: 2.1 time: 0.164034 Sep 14 09:34:56.461016 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3269/6514] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:34:56 2022] GET /compute/v2.1/servers/e156b236-ffea-4914-a349-7820a9976c98 => generated 1393 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:34:57.486437 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f7014ca2-d0c3-49e3-99c4-7b66e7ff7c05 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:34:57.487088 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f7014ca2-d0c3-49e3-99c4-7b66e7ff7c05 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: e156b236-ffea-4914-a349-7820a9976c98] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:34:57.490724 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=6 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:34:57.496896 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f7014ca2-d0c3-49e3-99c4-7b66e7ff7c05 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:57.497394 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f7014ca2-d0c3-49e3-99c4-7b66e7ff7c05 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:57.497843 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f7014ca2-d0c3-49e3-99c4-7b66e7ff7c05 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:57.498550 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f7014ca2-d0c3-49e3-99c4-7b66e7ff7c05 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:57.499040 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f7014ca2-d0c3-49e3-99c4-7b66e7ff7c05 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:57.499476 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f7014ca2-d0c3-49e3-99c4-7b66e7ff7c05 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:57.633903 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f7014ca2-d0c3-49e3-99c4-7b66e7ff7c05 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725d7beb4ec54b86a455af0d7bd0ce19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c197eded81494b818b1e56f4c01432c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:57.641693 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f7014ca2-d0c3-49e3-99c4-7b66e7ff7c05 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/e156b236-ffea-4914-a349-7820a9976c98" status: 200 len: 1566 microversion: 2.1 time: 0.159178 Sep 14 09:34:57.642264 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3246/6515] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:34:57 2022] GET /compute/v2.1/servers/e156b236-ffea-4914-a349-7820a9976c98 => generated 1566 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:34:57.664845 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-2240c01e-cd4b-4e6f-9f1a-fb05b443e16a tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:34:57.665483 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-2240c01e-cd4b-4e6f-9f1a-fb05b443e16a tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: e156b236-ffea-4914-a349-7820a9976c98] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:34:57.667488 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=2 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:34:57.668180 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=6 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:34:57.675010 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2240c01e-cd4b-4e6f-9f1a-fb05b443e16a tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:57.675516 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2240c01e-cd4b-4e6f-9f1a-fb05b443e16a tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:57.675974 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2240c01e-cd4b-4e6f-9f1a-fb05b443e16a tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:57.676683 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2240c01e-cd4b-4e6f-9f1a-fb05b443e16a tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:57.677156 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2240c01e-cd4b-4e6f-9f1a-fb05b443e16a tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:57.677597 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2240c01e-cd4b-4e6f-9f1a-fb05b443e16a tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:57.811562 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-2240c01e-cd4b-4e6f-9f1a-fb05b443e16a tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725d7beb4ec54b86a455af0d7bd0ce19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c197eded81494b818b1e56f4c01432c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:57.819694 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-2240c01e-cd4b-4e6f-9f1a-fb05b443e16a tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/e156b236-ffea-4914-a349-7820a9976c98" status: 200 len: 1566 microversion: 2.1 time: 0.159245 Sep 14 09:34:57.820278 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3270/6516] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:34:57 2022] GET /compute/v2.1/servers/e156b236-ffea-4914-a349-7820a9976c98 => generated 1566 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:34:59.721944 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-cba6e307-a256-44e6-a8b8-4e59d3f78c49 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:34:59.722656 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-cba6e307-a256-44e6-a8b8-4e59d3f78c49 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: e156b236-ffea-4914-a349-7820a9976c98] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:34:59.724594 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-d48bfec1-0ded-4159-8791-824f9ec918c4 req-ef55e6dd-e068-4d32-9633-9f9d60da4917 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e156b236-ffea-4914-a349-7820a9976c98", "tag": "35b894fe-add4-4e6f-a2c6-2d73d289bb07"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:34:59.730228 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cba6e307-a256-44e6-a8b8-4e59d3f78c49 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:59.730718 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cba6e307-a256-44e6-a8b8-4e59d3f78c49 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:59.731183 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cba6e307-a256-44e6-a8b8-4e59d3f78c49 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:59.732149 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cba6e307-a256-44e6-a8b8-4e59d3f78c49 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:59.732911 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cba6e307-a256-44e6-a8b8-4e59d3f78c49 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:59.733471 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cba6e307-a256-44e6-a8b8-4e59d3f78c49 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:59.736379 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-d48bfec1-0ded-4159-8791-824f9ec918c4 req-ef55e6dd-e068-4d32-9633-9f9d60da4917 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:59.737287 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-d48bfec1-0ded-4159-8791-824f9ec918c4 req-ef55e6dd-e068-4d32-9633-9f9d60da4917 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:59.737922 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-d48bfec1-0ded-4159-8791-824f9ec918c4 req-ef55e6dd-e068-4d32-9633-9f9d60da4917 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:59.750276 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-d48bfec1-0ded-4159-8791-824f9ec918c4 req-ef55e6dd-e068-4d32-9633-9f9d60da4917 service nova] Creating event network-changed:35b894fe-add4-4e6f-a2c6-2d73d289bb07 for instance e156b236-ffea-4914-a349-7820a9976c98 on n-h2-836830-18 Sep 14 09:34:59.757061 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-d48bfec1-0ded-4159-8791-824f9ec918c4 req-ef55e6dd-e068-4d32-9633-9f9d60da4917 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036865 Sep 14 09:34:59.761510 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3271/6517] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:34:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:34:59.879523 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-cba6e307-a256-44e6-a8b8-4e59d3f78c49 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725d7beb4ec54b86a455af0d7bd0ce19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c197eded81494b818b1e56f4c01432c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:59.890489 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-cba6e307-a256-44e6-a8b8-4e59d3f78c49 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/e156b236-ffea-4914-a349-7820a9976c98" status: 200 len: 1566 microversion: 2.1 time: 0.172992 Sep 14 09:34:59.905871 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3247/6518] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:34:59 2022] GET /compute/v2.1/servers/e156b236-ffea-4914-a349-7820a9976c98 => generated 1566 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:35:21.147666 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=42,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:35:21.148464 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=38 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:35:21.152656 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1dc30e81-9479-4e44-8121-62b1569d7f2f tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:35:21.154922 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-1dc30e81-9479-4e44-8121-62b1569d7f2f tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: e156b236-ffea-4914-a349-7820a9976c98] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:35:21.162125 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1dc30e81-9479-4e44-8121-62b1569d7f2f tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:21.162617 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1dc30e81-9479-4e44-8121-62b1569d7f2f tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:21.163124 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1dc30e81-9479-4e44-8121-62b1569d7f2f tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:21.163829 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1dc30e81-9479-4e44-8121-62b1569d7f2f tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:21.164299 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1dc30e81-9479-4e44-8121-62b1569d7f2f tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:21.164739 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1dc30e81-9479-4e44-8121-62b1569d7f2f tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:21.233012 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-1dc30e81-9479-4e44-8121-62b1569d7f2f tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "POST /compute/v2.1/servers/e156b236-ffea-4914-a349-7820a9976c98/action" status: 200 len: 24565 microversion: 2.1 time: 0.087076 Sep 14 09:35:21.233669 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3272/6519] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:35:21 2022] POST /compute/v2.1/servers/e156b236-ffea-4914-a349-7820a9976c98/action => generated 24565 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 09:35:32.276371 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-2d0ad8b9-25dc-49ce-b512-d32f4950d469 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:35:32.277061 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-2d0ad8b9-25dc-49ce-b512-d32f4950d469 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: e156b236-ffea-4914-a349-7820a9976c98] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:35:32.279344 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:35:32.280013 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=36 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:35:32.286286 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2d0ad8b9-25dc-49ce-b512-d32f4950d469 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:32.286779 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2d0ad8b9-25dc-49ce-b512-d32f4950d469 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:32.287832 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2d0ad8b9-25dc-49ce-b512-d32f4950d469 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:32.288544 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2d0ad8b9-25dc-49ce-b512-d32f4950d469 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:32.289009 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2d0ad8b9-25dc-49ce-b512-d32f4950d469 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:32.289443 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2d0ad8b9-25dc-49ce-b512-d32f4950d469 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:32.422995 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-2d0ad8b9-25dc-49ce-b512-d32f4950d469 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725d7beb4ec54b86a455af0d7bd0ce19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c197eded81494b818b1e56f4c01432c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:35:32.430870 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-2d0ad8b9-25dc-49ce-b512-d32f4950d469 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/e156b236-ffea-4914-a349-7820a9976c98" status: 200 len: 1685 microversion: 2.1 time: 0.158441 Sep 14 09:35:32.431473 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3248/6520] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:35:32 2022] GET /compute/v2.1/servers/e156b236-ffea-4914-a349-7820a9976c98 => generated 1685 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:35:32.531328 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-013b5146-67b7-4886-a5ee-6a3de2075ab0 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:35:32.533561 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-013b5146-67b7-4886-a5ee-6a3de2075ab0 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: e156b236-ffea-4914-a349-7820a9976c98] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:35:32.536295 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=2 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:35:32.536967 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=4 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:35:32.543089 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-013b5146-67b7-4886-a5ee-6a3de2075ab0 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:32.543593 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-013b5146-67b7-4886-a5ee-6a3de2075ab0 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:32.544048 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-013b5146-67b7-4886-a5ee-6a3de2075ab0 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:32.544757 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-013b5146-67b7-4886-a5ee-6a3de2075ab0 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:32.545231 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-013b5146-67b7-4886-a5ee-6a3de2075ab0 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:32.545672 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-013b5146-67b7-4886-a5ee-6a3de2075ab0 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:32.600905 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-013b5146-67b7-4886-a5ee-6a3de2075ab0 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "POST /compute/v2.1/servers/e156b236-ffea-4914-a349-7820a9976c98/action" status: 200 len: 32629 microversion: 2.1 time: 0.073833 Sep 14 09:35:32.601564 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3273/6521] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:35:32 2022] POST /compute/v2.1/servers/e156b236-ffea-4914-a349-7820a9976c98/action => generated 32629 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 09:35:32.764732 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ea6e9c52-c6df-4010-9f78-16b413a96ba5 tempest-TestNetworkAdvancedServerOps-649526860 tempest-TestNetworkAdvancedServerOps-649526860-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:35:32.765360 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-ea6e9c52-c6df-4010-9f78-16b413a96ba5 tempest-TestNetworkAdvancedServerOps-649526860 tempest-TestNetworkAdvancedServerOps-649526860-project-admin] [instance: e156b236-ffea-4914-a349-7820a9976c98] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:35:32.771459 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ea6e9c52-c6df-4010-9f78-16b413a96ba5 tempest-TestNetworkAdvancedServerOps-649526860 tempest-TestNetworkAdvancedServerOps-649526860-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:32.772571 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ea6e9c52-c6df-4010-9f78-16b413a96ba5 tempest-TestNetworkAdvancedServerOps-649526860 tempest-TestNetworkAdvancedServerOps-649526860-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:32.773018 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ea6e9c52-c6df-4010-9f78-16b413a96ba5 tempest-TestNetworkAdvancedServerOps-649526860 tempest-TestNetworkAdvancedServerOps-649526860-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:32.774297 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ea6e9c52-c6df-4010-9f78-16b413a96ba5 tempest-TestNetworkAdvancedServerOps-649526860 tempest-TestNetworkAdvancedServerOps-649526860-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:32.774297 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ea6e9c52-c6df-4010-9f78-16b413a96ba5 tempest-TestNetworkAdvancedServerOps-649526860 tempest-TestNetworkAdvancedServerOps-649526860-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:32.774611 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ea6e9c52-c6df-4010-9f78-16b413a96ba5 tempest-TestNetworkAdvancedServerOps-649526860 tempest-TestNetworkAdvancedServerOps-649526860-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:32.901628 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-ea6e9c52-c6df-4010-9f78-16b413a96ba5 tempest-TestNetworkAdvancedServerOps-649526860 tempest-TestNetworkAdvancedServerOps-649526860-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/e156b236-ffea-4914-a349-7820a9976c98" status: 200 len: 1838 microversion: 2.1 time: 0.140688 Sep 14 09:35:32.902202 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3249/6522] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:35:32 2022] GET /compute/v2.1/servers/e156b236-ffea-4914-a349-7820a9976c98 => generated 1838 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:35:32.931973 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ace4bae7-9465-473a-a58b-4384045a148f tempest-TestNetworkAdvancedServerOps-649526860 tempest-TestNetworkAdvancedServerOps-649526860-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:35:32.934537 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-ace4bae7-9465-473a-a58b-4384045a148f tempest-TestNetworkAdvancedServerOps-649526860 tempest-TestNetworkAdvancedServerOps-649526860-project-admin] [instance: e156b236-ffea-4914-a349-7820a9976c98] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:35:32.941713 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ace4bae7-9465-473a-a58b-4384045a148f tempest-TestNetworkAdvancedServerOps-649526860 tempest-TestNetworkAdvancedServerOps-649526860-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:32.942212 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ace4bae7-9465-473a-a58b-4384045a148f tempest-TestNetworkAdvancedServerOps-649526860 tempest-TestNetworkAdvancedServerOps-649526860-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:32.942665 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ace4bae7-9465-473a-a58b-4384045a148f tempest-TestNetworkAdvancedServerOps-649526860 tempest-TestNetworkAdvancedServerOps-649526860-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:32.943495 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ace4bae7-9465-473a-a58b-4384045a148f tempest-TestNetworkAdvancedServerOps-649526860 tempest-TestNetworkAdvancedServerOps-649526860-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:32.944475 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ace4bae7-9465-473a-a58b-4384045a148f tempest-TestNetworkAdvancedServerOps-649526860 tempest-TestNetworkAdvancedServerOps-649526860-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:32.944920 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ace4bae7-9465-473a-a58b-4384045a148f tempest-TestNetworkAdvancedServerOps-649526860 tempest-TestNetworkAdvancedServerOps-649526860-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:32.982171 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.objects.instance [None req-ace4bae7-9465-473a-a58b-4384045a148f tempest-TestNetworkAdvancedServerOps-649526860 tempest-TestNetworkAdvancedServerOps-649526860-project-admin] Lazy-loading 'flavor' on Instance uuid e156b236-ffea-4914-a349-7820a9976c98 {{(pid=128758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:35:32.995081 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-ace4bae7-9465-473a-a58b-4384045a148f tempest-TestNetworkAdvancedServerOps-649526860 tempest-TestNetworkAdvancedServerOps-649526860-project-admin] [instance: e156b236-ffea-4914-a349-7820a9976c98] Going to try to live migrate instance to another host {{(pid=128758) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 14 09:35:34.362290 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-ace4bae7-9465-473a-a58b-4384045a148f tempest-TestNetworkAdvancedServerOps-649526860 tempest-TestNetworkAdvancedServerOps-649526860-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/e156b236-ffea-4914-a349-7820a9976c98/action" status: 202 len: 0 microversion: 2.1 time: 1.435103 Sep 14 09:35:34.363109 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3274/6523] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:35:32 2022] POST /compute/v2.1/servers/e156b236-ffea-4914-a349-7820a9976c98/action => generated 0 bytes in 1437 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:35:34.372414 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-107e7858-79a2-48ae-8b3e-a5781f32bffd tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:35:34.373034 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-107e7858-79a2-48ae-8b3e-a5781f32bffd tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: e156b236-ffea-4914-a349-7820a9976c98] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:35:34.380373 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-107e7858-79a2-48ae-8b3e-a5781f32bffd tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:34.380890 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-107e7858-79a2-48ae-8b3e-a5781f32bffd tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:34.381873 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-107e7858-79a2-48ae-8b3e-a5781f32bffd tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:34.382578 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-107e7858-79a2-48ae-8b3e-a5781f32bffd tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:34.383063 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-107e7858-79a2-48ae-8b3e-a5781f32bffd tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:34.383527 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-107e7858-79a2-48ae-8b3e-a5781f32bffd tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:34.527825 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-107e7858-79a2-48ae-8b3e-a5781f32bffd tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725d7beb4ec54b86a455af0d7bd0ce19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c197eded81494b818b1e56f4c01432c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:35:34.535955 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-107e7858-79a2-48ae-8b3e-a5781f32bffd tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/e156b236-ffea-4914-a349-7820a9976c98" status: 200 len: 1695 microversion: 2.1 time: 0.167402 Sep 14 09:35:34.536541 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3250/6524] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:35:34 2022] GET /compute/v2.1/servers/e156b236-ffea-4914-a349-7820a9976c98 => generated 1695 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:35:35.560877 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ee2eaaca-2024-4347-b673-411a1d2b6b50 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:35:35.561728 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-ee2eaaca-2024-4347-b673-411a1d2b6b50 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: e156b236-ffea-4914-a349-7820a9976c98] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:35:35.570045 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ee2eaaca-2024-4347-b673-411a1d2b6b50 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:35.570562 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ee2eaaca-2024-4347-b673-411a1d2b6b50 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:35.571046 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ee2eaaca-2024-4347-b673-411a1d2b6b50 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:35.571787 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ee2eaaca-2024-4347-b673-411a1d2b6b50 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:35.572266 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ee2eaaca-2024-4347-b673-411a1d2b6b50 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:35.572709 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ee2eaaca-2024-4347-b673-411a1d2b6b50 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:35.715660 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-ee2eaaca-2024-4347-b673-411a1d2b6b50 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725d7beb4ec54b86a455af0d7bd0ce19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c197eded81494b818b1e56f4c01432c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:35:35.723579 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-ee2eaaca-2024-4347-b673-411a1d2b6b50 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/e156b236-ffea-4914-a349-7820a9976c98" status: 200 len: 1695 microversion: 2.1 time: 0.166848 Sep 14 09:35:35.724158 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3275/6525] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:35:35 2022] GET /compute/v2.1/servers/e156b236-ffea-4914-a349-7820a9976c98 => generated 1695 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:35:35.846007 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-18e49a92-e36e-43d4-b975-f6529f18a544 req-4b8bab23-31b6-43b4-bc51-e648077a03a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e156b236-ffea-4914-a349-7820a9976c98", "name": "network-vif-unplugged", "status": "completed", "tag": "35b894fe-add4-4e6f-a2c6-2d73d289bb07"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:35:35.857252 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-18e49a92-e36e-43d4-b975-f6529f18a544 req-4b8bab23-31b6-43b4-bc51-e648077a03a2 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:35.857733 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-18e49a92-e36e-43d4-b975-f6529f18a544 req-4b8bab23-31b6-43b4-bc51-e648077a03a2 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:35.858162 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-18e49a92-e36e-43d4-b975-f6529f18a544 req-4b8bab23-31b6-43b4-bc51-e648077a03a2 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:35.869834 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-18e49a92-e36e-43d4-b975-f6529f18a544 req-4b8bab23-31b6-43b4-bc51-e648077a03a2 service nova] Creating event network-vif-unplugged:35b894fe-add4-4e6f-a2c6-2d73d289bb07 for instance e156b236-ffea-4914-a349-7820a9976c98 on n-h2-836830-18 Sep 14 09:35:35.876336 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-18e49a92-e36e-43d4-b975-f6529f18a544 req-4b8bab23-31b6-43b4-bc51-e648077a03a2 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034028 Sep 14 09:35:35.877311 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3251/6526] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:35:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:35:36.747033 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-aff06167-4aa6-41a8-83a3-0045881aedbc tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:35:36.747666 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-aff06167-4aa6-41a8-83a3-0045881aedbc tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: e156b236-ffea-4914-a349-7820a9976c98] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:35:36.755095 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-aff06167-4aa6-41a8-83a3-0045881aedbc tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:36.755601 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-aff06167-4aa6-41a8-83a3-0045881aedbc tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:36.756064 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-aff06167-4aa6-41a8-83a3-0045881aedbc tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:36.756772 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-aff06167-4aa6-41a8-83a3-0045881aedbc tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:36.757245 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-aff06167-4aa6-41a8-83a3-0045881aedbc tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:36.757689 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-aff06167-4aa6-41a8-83a3-0045881aedbc tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:36.894598 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-aff06167-4aa6-41a8-83a3-0045881aedbc tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725d7beb4ec54b86a455af0d7bd0ce19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c197eded81494b818b1e56f4c01432c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:35:36.902960 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-aff06167-4aa6-41a8-83a3-0045881aedbc tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/e156b236-ffea-4914-a349-7820a9976c98" status: 200 len: 1695 microversion: 2.1 time: 0.159932 Sep 14 09:35:36.903566 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3276/6527] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:35:36 2022] GET /compute/v2.1/servers/e156b236-ffea-4914-a349-7820a9976c98 => generated 1695 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:35:37.915249 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-0abf0f78-3efe-440b-8606-c821fe3c02a0 req-68f0f235-b05b-4cd8-a4a1-969b2ed448d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e156b236-ffea-4914-a349-7820a9976c98", "tag": "35b894fe-add4-4e6f-a2c6-2d73d289bb07"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:35:37.926106 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-0abf0f78-3efe-440b-8606-c821fe3c02a0 req-68f0f235-b05b-4cd8-a4a1-969b2ed448d1 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:37.926626 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-0abf0f78-3efe-440b-8606-c821fe3c02a0 req-68f0f235-b05b-4cd8-a4a1-969b2ed448d1 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:37.926914 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-238e9e31-1907-48d2-9771-45aaa6331837 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:35:37.927476 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-0abf0f78-3efe-440b-8606-c821fe3c02a0 req-68f0f235-b05b-4cd8-a4a1-969b2ed448d1 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:37.927618 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-238e9e31-1907-48d2-9771-45aaa6331837 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: e156b236-ffea-4914-a349-7820a9976c98] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:35:37.935047 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-238e9e31-1907-48d2-9771-45aaa6331837 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:37.935594 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-238e9e31-1907-48d2-9771-45aaa6331837 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:37.936044 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-238e9e31-1907-48d2-9771-45aaa6331837 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:37.936749 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-238e9e31-1907-48d2-9771-45aaa6331837 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:37.937255 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-238e9e31-1907-48d2-9771-45aaa6331837 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:37.937667 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-238e9e31-1907-48d2-9771-45aaa6331837 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:37.940710 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-0abf0f78-3efe-440b-8606-c821fe3c02a0 req-68f0f235-b05b-4cd8-a4a1-969b2ed448d1 service nova] Creating event network-changed:35b894fe-add4-4e6f-a2c6-2d73d289bb07 for instance e156b236-ffea-4914-a349-7820a9976c98 on n-h2-836830-18 Sep 14 09:35:37.946286 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-0abf0f78-3efe-440b-8606-c821fe3c02a0 req-68f0f235-b05b-4cd8-a4a1-969b2ed448d1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036770 Sep 14 09:35:37.946996 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3252/6528] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:35:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:35:38.072324 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-238e9e31-1907-48d2-9771-45aaa6331837 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725d7beb4ec54b86a455af0d7bd0ce19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c197eded81494b818b1e56f4c01432c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:35:38.081326 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-238e9e31-1907-48d2-9771-45aaa6331837 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/e156b236-ffea-4914-a349-7820a9976c98" status: 200 len: 1695 microversion: 2.1 time: 0.158046 Sep 14 09:35:38.081981 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3277/6529] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:35:37 2022] GET /compute/v2.1/servers/e156b236-ffea-4914-a349-7820a9976c98 => generated 1695 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:35:39.109682 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-2d70ff02-4352-41a9-9f69-0117a889e4a8 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:35:39.110425 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-2d70ff02-4352-41a9-9f69-0117a889e4a8 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: e156b236-ffea-4914-a349-7820a9976c98] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:35:39.117107 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2d70ff02-4352-41a9-9f69-0117a889e4a8 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:39.117591 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2d70ff02-4352-41a9-9f69-0117a889e4a8 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:39.118029 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2d70ff02-4352-41a9-9f69-0117a889e4a8 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:39.118722 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2d70ff02-4352-41a9-9f69-0117a889e4a8 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:39.119296 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2d70ff02-4352-41a9-9f69-0117a889e4a8 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:39.119722 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2d70ff02-4352-41a9-9f69-0117a889e4a8 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:39.250537 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-2d70ff02-4352-41a9-9f69-0117a889e4a8 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725d7beb4ec54b86a455af0d7bd0ce19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c197eded81494b818b1e56f4c01432c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:35:39.258243 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-2d70ff02-4352-41a9-9f69-0117a889e4a8 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/e156b236-ffea-4914-a349-7820a9976c98" status: 200 len: 1695 microversion: 2.1 time: 0.153743 Sep 14 09:35:39.258810 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3253/6530] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:35:39 2022] GET /compute/v2.1/servers/e156b236-ffea-4914-a349-7820a9976c98 => generated 1695 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:35:40.281499 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-0e14846c-25dd-4d07-a31c-987d9e49dafd tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:35:40.282140 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-0e14846c-25dd-4d07-a31c-987d9e49dafd tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: e156b236-ffea-4914-a349-7820a9976c98] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:35:40.289213 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0e14846c-25dd-4d07-a31c-987d9e49dafd tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:40.289720 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0e14846c-25dd-4d07-a31c-987d9e49dafd tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:40.290180 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0e14846c-25dd-4d07-a31c-987d9e49dafd tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:40.290898 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0e14846c-25dd-4d07-a31c-987d9e49dafd tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:40.291402 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0e14846c-25dd-4d07-a31c-987d9e49dafd tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:40.291850 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0e14846c-25dd-4d07-a31c-987d9e49dafd tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:40.432747 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-0e14846c-25dd-4d07-a31c-987d9e49dafd tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725d7beb4ec54b86a455af0d7bd0ce19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c197eded81494b818b1e56f4c01432c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:35:40.440533 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-0e14846c-25dd-4d07-a31c-987d9e49dafd tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/e156b236-ffea-4914-a349-7820a9976c98" status: 200 len: 1695 microversion: 2.1 time: 0.162976 Sep 14 09:35:40.441112 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3278/6531] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:35:40 2022] GET /compute/v2.1/servers/e156b236-ffea-4914-a349-7820a9976c98 => generated 1695 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:35:41.465837 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-5afd1cf3-316a-475d-8089-8391975088b3 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:35:41.466705 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-5afd1cf3-316a-475d-8089-8391975088b3 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: e156b236-ffea-4914-a349-7820a9976c98] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:35:41.473647 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5afd1cf3-316a-475d-8089-8391975088b3 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:41.474130 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5afd1cf3-316a-475d-8089-8391975088b3 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:41.475099 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5afd1cf3-316a-475d-8089-8391975088b3 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:41.475788 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5afd1cf3-316a-475d-8089-8391975088b3 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:41.476241 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5afd1cf3-316a-475d-8089-8391975088b3 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:41.476665 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5afd1cf3-316a-475d-8089-8391975088b3 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:41.608487 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-5afd1cf3-316a-475d-8089-8391975088b3 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725d7beb4ec54b86a455af0d7bd0ce19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c197eded81494b818b1e56f4c01432c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:35:41.616884 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-5afd1cf3-316a-475d-8089-8391975088b3 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/e156b236-ffea-4914-a349-7820a9976c98" status: 200 len: 1695 microversion: 2.1 time: 0.156278 Sep 14 09:35:41.617460 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3254/6532] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:35:41 2022] GET /compute/v2.1/servers/e156b236-ffea-4914-a349-7820a9976c98 => generated 1695 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:35:42.640412 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-e061640c-e403-437c-a7e0-0f5309b26c59 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:35:42.641055 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-e061640c-e403-437c-a7e0-0f5309b26c59 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: e156b236-ffea-4914-a349-7820a9976c98] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:35:42.648151 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e061640c-e403-437c-a7e0-0f5309b26c59 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:42.648658 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e061640c-e403-437c-a7e0-0f5309b26c59 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:42.649114 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e061640c-e403-437c-a7e0-0f5309b26c59 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:42.649828 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e061640c-e403-437c-a7e0-0f5309b26c59 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:42.650302 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e061640c-e403-437c-a7e0-0f5309b26c59 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:42.650747 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e061640c-e403-437c-a7e0-0f5309b26c59 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:42.786369 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-e061640c-e403-437c-a7e0-0f5309b26c59 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725d7beb4ec54b86a455af0d7bd0ce19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c197eded81494b818b1e56f4c01432c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:35:42.794567 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-e061640c-e403-437c-a7e0-0f5309b26c59 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/e156b236-ffea-4914-a349-7820a9976c98" status: 200 len: 1695 microversion: 2.1 time: 0.157836 Sep 14 09:35:42.795183 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3279/6533] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:35:42 2022] GET /compute/v2.1/servers/e156b236-ffea-4914-a349-7820a9976c98 => generated 1695 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:35:43.817953 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-746bbf00-53e0-4cfa-94de-20165093eb7f tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:35:43.819276 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-746bbf00-53e0-4cfa-94de-20165093eb7f tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: e156b236-ffea-4914-a349-7820a9976c98] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:35:43.826277 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-746bbf00-53e0-4cfa-94de-20165093eb7f tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:43.826777 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-746bbf00-53e0-4cfa-94de-20165093eb7f tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:43.827391 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-746bbf00-53e0-4cfa-94de-20165093eb7f tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:43.827982 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-746bbf00-53e0-4cfa-94de-20165093eb7f tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:43.828578 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-746bbf00-53e0-4cfa-94de-20165093eb7f tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:43.829016 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-746bbf00-53e0-4cfa-94de-20165093eb7f tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:43.964009 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-746bbf00-53e0-4cfa-94de-20165093eb7f tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725d7beb4ec54b86a455af0d7bd0ce19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c197eded81494b818b1e56f4c01432c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:35:43.971747 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-746bbf00-53e0-4cfa-94de-20165093eb7f tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/e156b236-ffea-4914-a349-7820a9976c98" status: 200 len: 1695 microversion: 2.1 time: 0.157736 Sep 14 09:35:43.972319 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3255/6534] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:35:43 2022] GET /compute/v2.1/servers/e156b236-ffea-4914-a349-7820a9976c98 => generated 1695 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:35:44.995298 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-5f012343-3139-48e5-a123-351c6e6098e7 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:35:44.995958 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-5f012343-3139-48e5-a123-351c6e6098e7 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: e156b236-ffea-4914-a349-7820a9976c98] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:35:45.002866 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5f012343-3139-48e5-a123-351c6e6098e7 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:45.003400 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5f012343-3139-48e5-a123-351c6e6098e7 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:45.003863 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5f012343-3139-48e5-a123-351c6e6098e7 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:45.004594 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5f012343-3139-48e5-a123-351c6e6098e7 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:45.005085 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5f012343-3139-48e5-a123-351c6e6098e7 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:45.005534 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5f012343-3139-48e5-a123-351c6e6098e7 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:45.142460 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-5f012343-3139-48e5-a123-351c6e6098e7 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725d7beb4ec54b86a455af0d7bd0ce19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c197eded81494b818b1e56f4c01432c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:35:45.151238 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-5f012343-3139-48e5-a123-351c6e6098e7 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/e156b236-ffea-4914-a349-7820a9976c98" status: 200 len: 1695 microversion: 2.1 time: 0.159880 Sep 14 09:35:45.151865 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3280/6535] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:35:44 2022] GET /compute/v2.1/servers/e156b236-ffea-4914-a349-7820a9976c98 => generated 1695 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:35:46.174118 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a21e24c9-67e0-4f3e-adc7-76da81625d03 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:35:46.174660 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-a21e24c9-67e0-4f3e-adc7-76da81625d03 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: e156b236-ffea-4914-a349-7820a9976c98] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:35:46.181741 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a21e24c9-67e0-4f3e-adc7-76da81625d03 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:46.182236 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a21e24c9-67e0-4f3e-adc7-76da81625d03 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:46.182683 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a21e24c9-67e0-4f3e-adc7-76da81625d03 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:46.183413 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a21e24c9-67e0-4f3e-adc7-76da81625d03 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:46.183875 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a21e24c9-67e0-4f3e-adc7-76da81625d03 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:46.184308 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a21e24c9-67e0-4f3e-adc7-76da81625d03 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:46.338899 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-a21e24c9-67e0-4f3e-adc7-76da81625d03 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725d7beb4ec54b86a455af0d7bd0ce19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c197eded81494b818b1e56f4c01432c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:35:46.346691 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a21e24c9-67e0-4f3e-adc7-76da81625d03 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/e156b236-ffea-4914-a349-7820a9976c98" status: 200 len: 1685 microversion: 2.1 time: 0.176637 Sep 14 09:35:46.347314 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3256/6536] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:35:46 2022] GET /compute/v2.1/servers/e156b236-ffea-4914-a349-7820a9976c98 => generated 1685 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:35:46.369700 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d36bf994-ca88-4b26-8f02-b6baae6f96e1 tempest-TestNetworkAdvancedServerOps-649526860 tempest-TestNetworkAdvancedServerOps-649526860-project-admin] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:35:46.370339 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-d36bf994-ca88-4b26-8f02-b6baae6f96e1 tempest-TestNetworkAdvancedServerOps-649526860 tempest-TestNetworkAdvancedServerOps-649526860-project-admin] [instance: e156b236-ffea-4914-a349-7820a9976c98] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:35:46.377256 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d36bf994-ca88-4b26-8f02-b6baae6f96e1 tempest-TestNetworkAdvancedServerOps-649526860 tempest-TestNetworkAdvancedServerOps-649526860-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:46.377879 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d36bf994-ca88-4b26-8f02-b6baae6f96e1 tempest-TestNetworkAdvancedServerOps-649526860 tempest-TestNetworkAdvancedServerOps-649526860-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:46.378399 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d36bf994-ca88-4b26-8f02-b6baae6f96e1 tempest-TestNetworkAdvancedServerOps-649526860 tempest-TestNetworkAdvancedServerOps-649526860-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:46.379159 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d36bf994-ca88-4b26-8f02-b6baae6f96e1 tempest-TestNetworkAdvancedServerOps-649526860 tempest-TestNetworkAdvancedServerOps-649526860-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:46.379636 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d36bf994-ca88-4b26-8f02-b6baae6f96e1 tempest-TestNetworkAdvancedServerOps-649526860 tempest-TestNetworkAdvancedServerOps-649526860-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:46.380085 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d36bf994-ca88-4b26-8f02-b6baae6f96e1 tempest-TestNetworkAdvancedServerOps-649526860 tempest-TestNetworkAdvancedServerOps-649526860-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:46.518013 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-d36bf994-ca88-4b26-8f02-b6baae6f96e1 tempest-TestNetworkAdvancedServerOps-649526860 tempest-TestNetworkAdvancedServerOps-649526860-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/e156b236-ffea-4914-a349-7820a9976c98" status: 200 len: 1838 microversion: 2.1 time: 0.152537 Sep 14 09:35:46.518600 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3281/6537] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:35:46 2022] GET /compute/v2.1/servers/e156b236-ffea-4914-a349-7820a9976c98 => generated 1838 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:35:46.541644 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-6e5e630b-3986-4d63-b671-b9387dcaf205 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:35:46.542247 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-6e5e630b-3986-4d63-b671-b9387dcaf205 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: e156b236-ffea-4914-a349-7820a9976c98] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:35:46.548234 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6e5e630b-3986-4d63-b671-b9387dcaf205 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:46.548723 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6e5e630b-3986-4d63-b671-b9387dcaf205 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:46.549165 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6e5e630b-3986-4d63-b671-b9387dcaf205 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:46.549851 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6e5e630b-3986-4d63-b671-b9387dcaf205 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:46.550308 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6e5e630b-3986-4d63-b671-b9387dcaf205 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:46.550755 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6e5e630b-3986-4d63-b671-b9387dcaf205 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:46.690122 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-6e5e630b-3986-4d63-b671-b9387dcaf205 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725d7beb4ec54b86a455af0d7bd0ce19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c197eded81494b818b1e56f4c01432c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:35:46.699010 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-6e5e630b-3986-4d63-b671-b9387dcaf205 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/e156b236-ffea-4914-a349-7820a9976c98" status: 200 len: 1685 microversion: 2.1 time: 0.161234 Sep 14 09:35:46.699586 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3257/6538] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:35:46 2022] GET /compute/v2.1/servers/e156b236-ffea-4914-a349-7820a9976c98 => generated 1685 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:35:46.797770 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c471c833-9e66-4f56-81ee-f778c8eb1b2f tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:35:46.800043 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-c471c833-9e66-4f56-81ee-f778c8eb1b2f tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: e156b236-ffea-4914-a349-7820a9976c98] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:35:46.806291 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c471c833-9e66-4f56-81ee-f778c8eb1b2f tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:46.806794 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c471c833-9e66-4f56-81ee-f778c8eb1b2f tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:46.807308 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c471c833-9e66-4f56-81ee-f778c8eb1b2f tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:46.808020 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c471c833-9e66-4f56-81ee-f778c8eb1b2f tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:46.808495 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c471c833-9e66-4f56-81ee-f778c8eb1b2f tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:46.809742 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c471c833-9e66-4f56-81ee-f778c8eb1b2f tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:46.875450 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-c471c833-9e66-4f56-81ee-f778c8eb1b2f tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "POST /compute/v2.1/servers/e156b236-ffea-4914-a349-7820a9976c98/action" status: 200 len: 38639 microversion: 2.1 time: 0.082484 Sep 14 09:35:46.876106 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3282/6539] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:35:46 2022] POST /compute/v2.1/servers/e156b236-ffea-4914-a349-7820a9976c98/action => generated 38639 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 14 09:35:47.872265 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-caa3caa3-168c-4bb7-b8bc-358692c4f090 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:35:47.872833 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-caa3caa3-168c-4bb7-b8bc-358692c4f090 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: e156b236-ffea-4914-a349-7820a9976c98] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:35:47.875472 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-9f7b3501-346a-4642-8bb6-8142e6be54d0 req-20d4a523-898d-4a1f-8464-4819c6f00366 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e156b236-ffea-4914-a349-7820a9976c98", "tag": "35b894fe-add4-4e6f-a2c6-2d73d289bb07"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:35:47.880213 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-caa3caa3-168c-4bb7-b8bc-358692c4f090 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:47.880707 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-caa3caa3-168c-4bb7-b8bc-358692c4f090 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:47.881887 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-caa3caa3-168c-4bb7-b8bc-358692c4f090 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:47.882596 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-caa3caa3-168c-4bb7-b8bc-358692c4f090 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:47.883085 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-caa3caa3-168c-4bb7-b8bc-358692c4f090 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:47.883523 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-caa3caa3-168c-4bb7-b8bc-358692c4f090 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:47.888029 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-9f7b3501-346a-4642-8bb6-8142e6be54d0 req-20d4a523-898d-4a1f-8464-4819c6f00366 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:47.888524 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-9f7b3501-346a-4642-8bb6-8142e6be54d0 req-20d4a523-898d-4a1f-8464-4819c6f00366 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:47.889068 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-9f7b3501-346a-4642-8bb6-8142e6be54d0 req-20d4a523-898d-4a1f-8464-4819c6f00366 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:47.902577 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-9f7b3501-346a-4642-8bb6-8142e6be54d0 req-20d4a523-898d-4a1f-8464-4819c6f00366 service nova] Creating event network-changed:35b894fe-add4-4e6f-a2c6-2d73d289bb07 for instance e156b236-ffea-4914-a349-7820a9976c98 on n-h1-836830-18 Sep 14 09:35:47.907996 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-9f7b3501-346a-4642-8bb6-8142e6be54d0 req-20d4a523-898d-4a1f-8464-4819c6f00366 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036847 Sep 14 09:35:47.908928 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3283/6540] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:35:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:35:47.912450 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-caa3caa3-168c-4bb7-b8bc-358692c4f090 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: e156b236-ffea-4914-a349-7820a9976c98] Going to try to terminate instance {{(pid=128759) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:35:47.992279 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-caa3caa3-168c-4bb7-b8bc-358692c4f090 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "DELETE /compute/v2.1/servers/e156b236-ffea-4914-a349-7820a9976c98" status: 204 len: 0 microversion: 2.1 time: 0.123717 Sep 14 09:35:47.993019 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3258/6541] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:35:47 2022] DELETE /compute/v2.1/servers/e156b236-ffea-4914-a349-7820a9976c98 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:35:48.004228 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-0c39405c-33c5-48ed-98cc-fb07337f0196 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:35:48.005282 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-0c39405c-33c5-48ed-98cc-fb07337f0196 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: e156b236-ffea-4914-a349-7820a9976c98] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:35:48.013710 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0c39405c-33c5-48ed-98cc-fb07337f0196 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:48.015058 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0c39405c-33c5-48ed-98cc-fb07337f0196 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:48.015610 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0c39405c-33c5-48ed-98cc-fb07337f0196 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:48.016481 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0c39405c-33c5-48ed-98cc-fb07337f0196 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:48.017061 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0c39405c-33c5-48ed-98cc-fb07337f0196 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:48.017511 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0c39405c-33c5-48ed-98cc-fb07337f0196 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:48.160393 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-0c39405c-33c5-48ed-98cc-fb07337f0196 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725d7beb4ec54b86a455af0d7bd0ce19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c197eded81494b818b1e56f4c01432c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:35:48.168386 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-0c39405c-33c5-48ed-98cc-fb07337f0196 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/e156b236-ffea-4914-a349-7820a9976c98" status: 200 len: 1691 microversion: 2.1 time: 0.170654 Sep 14 09:35:48.168975 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3284/6542] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:35:47 2022] GET /compute/v2.1/servers/e156b236-ffea-4914-a349-7820a9976c98 => generated 1691 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:35:49.193819 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-710f34d6-89df-4902-b990-ba4a16fd6ab9 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:35:49.194495 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-710f34d6-89df-4902-b990-ba4a16fd6ab9 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: e156b236-ffea-4914-a349-7820a9976c98] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:35:49.201864 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-710f34d6-89df-4902-b990-ba4a16fd6ab9 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:49.202020 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-710f34d6-89df-4902-b990-ba4a16fd6ab9 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:49.202467 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-710f34d6-89df-4902-b990-ba4a16fd6ab9 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:49.203209 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-710f34d6-89df-4902-b990-ba4a16fd6ab9 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:49.203655 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-710f34d6-89df-4902-b990-ba4a16fd6ab9 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:49.204083 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-710f34d6-89df-4902-b990-ba4a16fd6ab9 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:49.419477 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-710f34d6-89df-4902-b990-ba4a16fd6ab9 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725d7beb4ec54b86a455af0d7bd0ce19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c197eded81494b818b1e56f4c01432c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:35:49.429933 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-710f34d6-89df-4902-b990-ba4a16fd6ab9 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/e156b236-ffea-4914-a349-7820a9976c98" status: 200 len: 1572 microversion: 2.1 time: 0.240636 Sep 14 09:35:49.430957 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3259/6543] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:35:49 2022] GET /compute/v2.1/servers/e156b236-ffea-4914-a349-7820a9976c98 => generated 1572 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:35:49.923623 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-80842f59-1f5e-4122-af9a-d864b2fc4ac5 req-39f36075-a210-4167-af16-d1adf19c2620 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e156b236-ffea-4914-a349-7820a9976c98", "name": "network-vif-deleted", "tag": "35b894fe-add4-4e6f-a2c6-2d73d289bb07"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:35:49.934640 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-80842f59-1f5e-4122-af9a-d864b2fc4ac5 req-39f36075-a210-4167-af16-d1adf19c2620 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:49.935170 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-80842f59-1f5e-4122-af9a-d864b2fc4ac5 req-39f36075-a210-4167-af16-d1adf19c2620 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:49.935624 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-80842f59-1f5e-4122-af9a-d864b2fc4ac5 req-39f36075-a210-4167-af16-d1adf19c2620 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:49.946834 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-80842f59-1f5e-4122-af9a-d864b2fc4ac5 req-39f36075-a210-4167-af16-d1adf19c2620 service nova] Creating event network-vif-deleted:35b894fe-add4-4e6f-a2c6-2d73d289bb07 for instance e156b236-ffea-4914-a349-7820a9976c98 on n-h1-836830-18 Sep 14 09:35:49.951627 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-80842f59-1f5e-4122-af9a-d864b2fc4ac5 req-39f36075-a210-4167-af16-d1adf19c2620 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031783 Sep 14 09:35:49.952216 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3285/6544] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:35:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:35:50.455423 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-60387d25-e1b4-48d3-a3a8-9130e6ec9c08 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:35:50.456302 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-60387d25-e1b4-48d3-a3a8-9130e6ec9c08 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: e156b236-ffea-4914-a349-7820a9976c98] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:35:50.463737 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-60387d25-e1b4-48d3-a3a8-9130e6ec9c08 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:50.464224 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-60387d25-e1b4-48d3-a3a8-9130e6ec9c08 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:50.464663 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-60387d25-e1b4-48d3-a3a8-9130e6ec9c08 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:50.465354 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-60387d25-e1b4-48d3-a3a8-9130e6ec9c08 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:50.465842 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-60387d25-e1b4-48d3-a3a8-9130e6ec9c08 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:50.466271 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-60387d25-e1b4-48d3-a3a8-9130e6ec9c08 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:50.479675 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-60387d25-e1b4-48d3-a3a8-9130e6ec9c08 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] HTTP exception thrown: Instance e156b236-ffea-4914-a349-7820a9976c98 could not be found. Sep 14 09:35:50.481309 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-60387d25-e1b4-48d3-a3a8-9130e6ec9c08 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Request method failure captured: Sep 14 09:35:50.481309 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/e156b236-ffea-4914-a349-7820a9976c98 HTTP/1.1 Sep 14 09:35:50.481309 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:35:50.481309 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:35:50.481309 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:35:50.481309 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:35:50.481309 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:35:50.481309 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:35:50.481309 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:35:50.481309 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:35:50.481309 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZ7Wj_81f9I2NRmfEwmuZpjrdWAEw7ARyOuI73wjvWEI66LzqUtysPT6IcAh0WZe2oebLj28uG94-uPGEC9cMUUKdhbePLDzfTDtmqqpgsB5YUrdD9jeNjtdjFX4L0eMBEKdd412dq4yc0_P9JNCFrwq1ozBqOy_b7PF0eHqh0jyqOo Sep 14 09:35:50.481309 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:35:50.481309 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:35:50.481309 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:35:50.481309 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:35:50.481309 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:35:50.481309 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:35:50.481309 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: c197eded81494b818b1e56f4c01432c5 Sep 14 09:35:50.481309 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1922438431 Sep 14 09:35:50.481309 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:35:50.481309 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:35:50.481309 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c197eded81494b818b1e56f4c01432c5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c197eded81494b818b1e56f4c01432c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c197eded81494b818b1e56f4c01432c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c197eded81494b818b1e56f4c01432c5"}]}] Sep 14 09:35:50.481309 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1922438431 Sep 14 09:35:50.481309 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: c197eded81494b818b1e56f4c01432c5 Sep 14 09:35:50.481309 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1922438431 Sep 14 09:35:50.481309 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-TestNetworkAdvancedServerOps-1922438431-project Sep 14 09:35:50.481309 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:35:50.481309 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:35:50.481309 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 725d7beb4ec54b86a455af0d7bd0ce19 Sep 14 09:35:50.481309 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1922438431-project Sep 14 09:35:50.481309 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:35:50.481309 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance e156b236-ffea-4914-a349-7820a9976c98 could not be found. Sep 14 09:35:50.481309 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': 'e156b236-ffea-4914-a349-7820a9976c98'} Sep 14 09:35:50.481309 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:35:50.481309 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:35:50.481309 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:35:50.481309 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:35:50.481309 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:35:50.481309 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:35:50.481309 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:35:50.481309 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:35:50.481309 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:35:50.481309 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:35:50.481309 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e156b236-ffea-4914-a349-7820a9976c98 could not be found. Sep 14 09:35:50.481309 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:35:50.481309 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:35:50.481309 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:35:50.481309 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:35:50.481309 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:35:50.481309 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:35:50.481309 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:35:50.481309 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:35:50.481309 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:35:50.481309 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:35:50.481309 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:35:50.481309 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:35:50.481309 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:35:50.481309 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:35:50.481309 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:35:50.481309 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:35:50.481309 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e156b236-ffea-4914-a349-7820a9976c98 could not be found. Sep 14 09:35:50.481309 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:35:50.481309 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:35:50.487217 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:35:50.487217 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:35:50.487217 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:35:50.487217 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:35:50.487217 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:35:50.487217 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:35:50.487217 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e156b236-ffea-4914-a349-7820a9976c98 could not be found. Sep 14 09:35:50.487217 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:35:50.487217 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-60387d25-e1b4-48d3-a3a8-9130e6ec9c08 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Returning 404 to user: Instance e156b236-ffea-4914-a349-7820a9976c98 could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:35:50.487217 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-60387d25-e1b4-48d3-a3a8-9130e6ec9c08 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/e156b236-ffea-4914-a349-7820a9976c98" status: 404 len: 111 microversion: 2.1 time: 0.031246 Sep 14 09:35:50.487217 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3260/6545] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:35:50 2022] GET /compute/v2.1/servers/e156b236-ffea-4914-a349-7820a9976c98 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:35:54.170805 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-23d211b6-24d3-447e-bd3d-2a209bb02f12 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '.version_select at 0x7f7d3f41bca0>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:35:54.192385 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-23d211b6-24d3-447e-bd3d-2a209bb02f12 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1408939257" status: 202 len: 0 microversion: 2.1 time: 0.026890 Sep 14 09:35:54.192862 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3286/6546] 10.222.0.60 () {58 vars in 1284 bytes} [Wed Sep 14 09:35:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1408939257 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:35:54.224347 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-bfbf180f-5e09-4907-833e-d73624654245 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Action: 'create', calling method: .version_select at 0x7f7d3eddbee0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-744396015", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFi0G6ZMZdXDmCdRqE1zuKCDIOB5Bvq3prqC+2dOS2eIKlvaVa2dtOaKY0YG1TdNUp3uZO6k18BpAew3OPF3y+XDIhmZw6lyMwAV6WuNowhUPkIYjHuWmZkZTUOMZ0mAuw=="}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:35:54.241766 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-bfbf180f-5e09-4907-833e-d73624654245 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Getting quotas for project c197eded81494b818b1e56f4c01432c5. Resources: {'key_pairs'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:35:54.247104 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-bfbf180f-5e09-4907-833e-d73624654245 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Getting quotas for user 725d7beb4ec54b86a455af0d7bd0ce19 and project c197eded81494b818b1e56f4c01432c5. Resources: {'key_pairs'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:35:54.270402 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-bfbf180f-5e09-4907-833e-d73624654245 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.050323 Sep 14 09:35:54.271034 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3261/6547] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Sep 14 09:35:54 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:35:59.298646 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ca1bf89d-329d-47ac-b3ad-0c037e2e87b3 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:35:59.299423 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-ca1bf89d-329d-47ac-b3ad-0c037e2e87b3 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: 356742b9-7cbf-42d3-93bf-9ee0f93e872e] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:35:59.308262 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ca1bf89d-329d-47ac-b3ad-0c037e2e87b3 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:59.308773 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ca1bf89d-329d-47ac-b3ad-0c037e2e87b3 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:59.309285 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ca1bf89d-329d-47ac-b3ad-0c037e2e87b3 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:59.310011 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ca1bf89d-329d-47ac-b3ad-0c037e2e87b3 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:59.310679 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ca1bf89d-329d-47ac-b3ad-0c037e2e87b3 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:59.311321 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ca1bf89d-329d-47ac-b3ad-0c037e2e87b3 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:59.347127 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-ca1bf89d-329d-47ac-b3ad-0c037e2e87b3 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: 356742b9-7cbf-42d3-93bf-9ee0f93e872e] Going to try to terminate instance {{(pid=128758) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:35:59.449477 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-ca1bf89d-329d-47ac-b3ad-0c037e2e87b3 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "DELETE /compute/v2.1/servers/356742b9-7cbf-42d3-93bf-9ee0f93e872e" status: 204 len: 0 microversion: 2.1 time: 0.312980 Sep 14 09:35:59.454809 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3287/6548] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:35:59 2022] DELETE /compute/v2.1/servers/356742b9-7cbf-42d3-93bf-9ee0f93e872e => generated 0 bytes in 317 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:35:59.459453 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-bc8d379a-2d4c-447f-ae79-cc7762a8553b tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:35:59.460703 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-bc8d379a-2d4c-447f-ae79-cc7762a8553b tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: 356742b9-7cbf-42d3-93bf-9ee0f93e872e] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:35:59.468256 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bc8d379a-2d4c-447f-ae79-cc7762a8553b tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:59.469017 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bc8d379a-2d4c-447f-ae79-cc7762a8553b tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:59.469712 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bc8d379a-2d4c-447f-ae79-cc7762a8553b tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:59.470973 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bc8d379a-2d4c-447f-ae79-cc7762a8553b tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:59.471676 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bc8d379a-2d4c-447f-ae79-cc7762a8553b tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:59.472121 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bc8d379a-2d4c-447f-ae79-cc7762a8553b tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:59.739165 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-bc8d379a-2d4c-447f-ae79-cc7762a8553b tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:35:59.747957 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-bc8d379a-2d4c-447f-ae79-cc7762a8553b tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/356742b9-7cbf-42d3-93bf-9ee0f93e872e" status: 200 len: 1575 microversion: 2.1 time: 0.292852 Sep 14 09:35:59.749138 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3262/6549] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:35:59 2022] GET /compute/v2.1/servers/356742b9-7cbf-42d3-93bf-9ee0f93e872e => generated 1575 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:35:59.988712 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-4c7e688e-8ac7-40e3-a50a-473ea1d3d7c4 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1269778889", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "networks": [{"uuid": "03aac04d-49ec-42b8-8c9d-9967bdd63d50"}], "key_name": "tempest-TestNetworkAdvancedServerOps-744396015", "security_groups": [{"name": "tempest-secgroup-smoke-2051562203"}]}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:36:00.122959 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.network.neutron [None req-4c7e688e-8ac7-40e3-a50a-473ea1d3d7c4 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] validate_networks() for [('03aac04d-49ec-42b8-8c9d-9967bdd63d50', None, None, None, None, None)] {{(pid=128758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:36:00.552462 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-4c7e688e-8ac7-40e3-a50a-473ea1d3d7c4 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Flavor limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:36:00.554361 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-4c7e688e-8ac7-40e3-a50a-473ea1d3d7c4 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Image limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:36:00.555766 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-4c7e688e-8ac7-40e3-a50a-473ea1d3d7c4 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Flavor pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:36:00.556383 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-4c7e688e-8ac7-40e3-a50a-473ea1d3d7c4 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Image pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:36:00.557006 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-4c7e688e-8ac7-40e3-a50a-473ea1d3d7c4 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:36:00.567162 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4c7e688e-8ac7-40e3-a50a-473ea1d3d7c4 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:00.567933 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4c7e688e-8ac7-40e3-a50a-473ea1d3d7c4 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:00.568422 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4c7e688e-8ac7-40e3-a50a-473ea1d3d7c4 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:00.569181 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4c7e688e-8ac7-40e3-a50a-473ea1d3d7c4 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:00.569654 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4c7e688e-8ac7-40e3-a50a-473ea1d3d7c4 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:00.570100 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4c7e688e-8ac7-40e3-a50a-473ea1d3d7c4 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:00.590047 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-4c7e688e-8ac7-40e3-a50a-473ea1d3d7c4 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Getting quotas for project c197eded81494b818b1e56f4c01432c5. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:36:00.595541 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-4c7e688e-8ac7-40e3-a50a-473ea1d3d7c4 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Getting quotas for user 725d7beb4ec54b86a455af0d7bd0ce19 and project c197eded81494b818b1e56f4c01432c5. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:36:00.608914 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-4c7e688e-8ac7-40e3-a50a-473ea1d3d7c4 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Going to run 1 instances... {{(pid=128758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:36:00.611373 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-4c7e688e-8ac7-40e3-a50a-473ea1d3d7c4 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: 72812065-1001-48aa-be8c-2a5e99351a68] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:36:00.658927 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-4c7e688e-8ac7-40e3-a50a-473ea1d3d7c4 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.674756 Sep 14 09:36:00.666678 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3288/6550] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 09:35:59 2022] POST /compute/v2.1/servers => generated 406 bytes in 677 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:36:00.671863 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-04faedab-1e10-448e-9e86-6a97703a5775 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:00.672499 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-04faedab-1e10-448e-9e86-6a97703a5775 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: 72812065-1001-48aa-be8c-2a5e99351a68] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:00.747057 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-04faedab-1e10-448e-9e86-6a97703a5775 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725d7beb4ec54b86a455af0d7bd0ce19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c197eded81494b818b1e56f4c01432c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:00.754614 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-04faedab-1e10-448e-9e86-6a97703a5775 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/72812065-1001-48aa-be8c-2a5e99351a68" status: 200 len: 1266 microversion: 2.1 time: 0.086810 Sep 14 09:36:00.755651 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3263/6551] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:36:00 2022] GET /compute/v2.1/servers/72812065-1001-48aa-be8c-2a5e99351a68 => generated 1266 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:36:00.782844 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-750ecf83-438c-44fa-8a31-52a7740f72fa tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:00.783457 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-750ecf83-438c-44fa-8a31-52a7740f72fa tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: 356742b9-7cbf-42d3-93bf-9ee0f93e872e] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:00.790425 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-750ecf83-438c-44fa-8a31-52a7740f72fa tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:00.790959 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-750ecf83-438c-44fa-8a31-52a7740f72fa tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:00.791436 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-750ecf83-438c-44fa-8a31-52a7740f72fa tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:00.792439 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-750ecf83-438c-44fa-8a31-52a7740f72fa tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:00.792637 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-750ecf83-438c-44fa-8a31-52a7740f72fa tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:00.793082 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-750ecf83-438c-44fa-8a31-52a7740f72fa tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:00.951358 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-750ecf83-438c-44fa-8a31-52a7740f72fa tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:00.961359 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:36:00.970148 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-750ecf83-438c-44fa-8a31-52a7740f72fa tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/356742b9-7cbf-42d3-93bf-9ee0f93e872e" status: 200 len: 1575 microversion: 2.1 time: 0.197595 Sep 14 09:36:00.971331 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3289/6552] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:36:00 2022] GET /compute/v2.1/servers/356742b9-7cbf-42d3-93bf-9ee0f93e872e => generated 1575 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:36:01.778962 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-35beabf5-8a6d-4955-8a41-b9fc3c2cd5a0 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:01.779604 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-35beabf5-8a6d-4955-8a41-b9fc3c2cd5a0 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: 72812065-1001-48aa-be8c-2a5e99351a68] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:01.790739 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-35beabf5-8a6d-4955-8a41-b9fc3c2cd5a0 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:01.791279 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-35beabf5-8a6d-4955-8a41-b9fc3c2cd5a0 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:01.791725 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-35beabf5-8a6d-4955-8a41-b9fc3c2cd5a0 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:01.792478 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-35beabf5-8a6d-4955-8a41-b9fc3c2cd5a0 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:01.792932 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-35beabf5-8a6d-4955-8a41-b9fc3c2cd5a0 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:01.793344 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-35beabf5-8a6d-4955-8a41-b9fc3c2cd5a0 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:01.978222 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-35beabf5-8a6d-4955-8a41-b9fc3c2cd5a0 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725d7beb4ec54b86a455af0d7bd0ce19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c197eded81494b818b1e56f4c01432c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:01.987641 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-35beabf5-8a6d-4955-8a41-b9fc3c2cd5a0 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/72812065-1001-48aa-be8c-2a5e99351a68" status: 200 len: 1326 microversion: 2.1 time: 0.213225 Sep 14 09:36:01.992883 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3264/6553] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:36:01 2022] GET /compute/v2.1/servers/72812065-1001-48aa-be8c-2a5e99351a68 => generated 1326 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:36:01.997745 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-0732f564-2630-4c37-babf-8995f3b3453c tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:01.999064 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-0732f564-2630-4c37-babf-8995f3b3453c tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: 356742b9-7cbf-42d3-93bf-9ee0f93e872e] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:02.024975 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0732f564-2630-4c37-babf-8995f3b3453c tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:02.025647 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0732f564-2630-4c37-babf-8995f3b3453c tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:02.026209 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0732f564-2630-4c37-babf-8995f3b3453c tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:02.027106 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0732f564-2630-4c37-babf-8995f3b3453c tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:02.027838 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0732f564-2630-4c37-babf-8995f3b3453c tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:02.028515 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0732f564-2630-4c37-babf-8995f3b3453c tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:02.132004 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-0732f564-2630-4c37-babf-8995f3b3453c tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:02.144741 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-0732f564-2630-4c37-babf-8995f3b3453c tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/356742b9-7cbf-42d3-93bf-9ee0f93e872e" status: 200 len: 1507 microversion: 2.1 time: 0.154100 Sep 14 09:36:02.145838 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3290/6554] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:36:01 2022] GET /compute/v2.1/servers/356742b9-7cbf-42d3-93bf-9ee0f93e872e => generated 1507 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:36:02.430739 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-b6e33790-f055-40d8-b546-e299fa229c54 req-ff30af2b-69be-454f-aa2f-c1a7b6969a69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "356742b9-7cbf-42d3-93bf-9ee0f93e872e", "name": "network-vif-deleted", "tag": "cef9c9f3-4c7b-4323-b68e-e465bbc007a9"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:36:02.477215 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:36:02.483274 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-b6e33790-f055-40d8-b546-e299fa229c54 req-ff30af2b-69be-454f-aa2f-c1a7b6969a69 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:02.483835 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-b6e33790-f055-40d8-b546-e299fa229c54 req-ff30af2b-69be-454f-aa2f-c1a7b6969a69 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:02.489460 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-b6e33790-f055-40d8-b546-e299fa229c54 req-ff30af2b-69be-454f-aa2f-c1a7b6969a69 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:02.504622 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:36:02.521313 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-b6e33790-f055-40d8-b546-e299fa229c54 req-ff30af2b-69be-454f-aa2f-c1a7b6969a69 service nova] Creating event network-vif-deleted:cef9c9f3-4c7b-4323-b68e-e465bbc007a9 for instance 356742b9-7cbf-42d3-93bf-9ee0f93e872e on n-h1-836830-18 Sep 14 09:36:02.530029 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-b6e33790-f055-40d8-b546-e299fa229c54 req-ff30af2b-69be-454f-aa2f-c1a7b6969a69 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115301 Sep 14 09:36:02.531872 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3265/6555] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:36:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:36:03.017101 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-8c8486ec-37b9-4dcc-9aec-18ce7970fb70 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:03.018423 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-8c8486ec-37b9-4dcc-9aec-18ce7970fb70 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: 72812065-1001-48aa-be8c-2a5e99351a68] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:03.021923 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=58,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:36:03.032788 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8c8486ec-37b9-4dcc-9aec-18ce7970fb70 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:03.037351 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8c8486ec-37b9-4dcc-9aec-18ce7970fb70 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:03.038121 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8c8486ec-37b9-4dcc-9aec-18ce7970fb70 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:03.039705 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8c8486ec-37b9-4dcc-9aec-18ce7970fb70 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:03.042153 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8c8486ec-37b9-4dcc-9aec-18ce7970fb70 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:03.047156 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8c8486ec-37b9-4dcc-9aec-18ce7970fb70 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:03.169835 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f6fb21e1-5acb-43b4-9a38-35d6ac4fc4e7 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:03.170565 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f6fb21e1-5acb-43b4-9a38-35d6ac4fc4e7 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: 356742b9-7cbf-42d3-93bf-9ee0f93e872e] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:03.205726 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f6fb21e1-5acb-43b4-9a38-35d6ac4fc4e7 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:03.206897 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f6fb21e1-5acb-43b4-9a38-35d6ac4fc4e7 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:03.207389 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f6fb21e1-5acb-43b4-9a38-35d6ac4fc4e7 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:03.208151 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f6fb21e1-5acb-43b4-9a38-35d6ac4fc4e7 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:03.208619 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f6fb21e1-5acb-43b4-9a38-35d6ac4fc4e7 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:03.217121 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f6fb21e1-5acb-43b4-9a38-35d6ac4fc4e7 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:03.370013 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-8c8486ec-37b9-4dcc-9aec-18ce7970fb70 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725d7beb4ec54b86a455af0d7bd0ce19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c197eded81494b818b1e56f4c01432c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:03.383769 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-8c8486ec-37b9-4dcc-9aec-18ce7970fb70 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/72812065-1001-48aa-be8c-2a5e99351a68" status: 200 len: 1392 microversion: 2.1 time: 0.370922 Sep 14 09:36:03.386448 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3291/6556] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:36:03 2022] GET /compute/v2.1/servers/72812065-1001-48aa-be8c-2a5e99351a68 => generated 1392 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:36:03.413156 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f6fb21e1-5acb-43b4-9a38-35d6ac4fc4e7 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:03.432557 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f6fb21e1-5acb-43b4-9a38-35d6ac4fc4e7 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/356742b9-7cbf-42d3-93bf-9ee0f93e872e" status: 200 len: 1225 microversion: 2.1 time: 0.267244 Sep 14 09:36:03.447417 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3266/6557] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:36:03 2022] GET /compute/v2.1/servers/356742b9-7cbf-42d3-93bf-9ee0f93e872e => generated 1225 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:36:04.178132 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-b02078f2-ea0a-4ea9-9e83-d7c0212f8eba req-863e7020-1886-4a7a-b942-d87568b78874 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72812065-1001-48aa-be8c-2a5e99351a68", "tag": "8a1b5d6e-4a16-406b-9f87-7c6fe87b147f"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:36:04.201352 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-b02078f2-ea0a-4ea9-9e83-d7c0212f8eba req-863e7020-1886-4a7a-b942-d87568b78874 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:04.201860 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-b02078f2-ea0a-4ea9-9e83-d7c0212f8eba req-863e7020-1886-4a7a-b942-d87568b78874 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:04.202311 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-b02078f2-ea0a-4ea9-9e83-d7c0212f8eba req-863e7020-1886-4a7a-b942-d87568b78874 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:04.216088 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-b02078f2-ea0a-4ea9-9e83-d7c0212f8eba req-863e7020-1886-4a7a-b942-d87568b78874 service nova] Creating event network-changed:8a1b5d6e-4a16-406b-9f87-7c6fe87b147f for instance 72812065-1001-48aa-be8c-2a5e99351a68 on n-h2-836830-18 Sep 14 09:36:04.221490 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-b02078f2-ea0a-4ea9-9e83-d7c0212f8eba req-863e7020-1886-4a7a-b942-d87568b78874 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047567 Sep 14 09:36:04.222268 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3292/6558] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:36:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:36:04.408730 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-300b55d5-721e-469d-97e1-84db4cbb7b49 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:04.409361 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-300b55d5-721e-469d-97e1-84db4cbb7b49 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: 72812065-1001-48aa-be8c-2a5e99351a68] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:04.416981 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-300b55d5-721e-469d-97e1-84db4cbb7b49 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:04.417567 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-300b55d5-721e-469d-97e1-84db4cbb7b49 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:04.418021 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-300b55d5-721e-469d-97e1-84db4cbb7b49 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:04.418733 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-300b55d5-721e-469d-97e1-84db4cbb7b49 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:04.419219 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-300b55d5-721e-469d-97e1-84db4cbb7b49 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:04.419653 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-300b55d5-721e-469d-97e1-84db4cbb7b49 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:04.461528 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-4fad00d6-455e-46bd-a99b-44692678cc23 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:04.463340 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-4fad00d6-455e-46bd-a99b-44692678cc23 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: 356742b9-7cbf-42d3-93bf-9ee0f93e872e] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:04.471820 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4fad00d6-455e-46bd-a99b-44692678cc23 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:04.473215 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4fad00d6-455e-46bd-a99b-44692678cc23 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:04.473858 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4fad00d6-455e-46bd-a99b-44692678cc23 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:04.475884 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4fad00d6-455e-46bd-a99b-44692678cc23 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:04.476542 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4fad00d6-455e-46bd-a99b-44692678cc23 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:04.477744 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4fad00d6-455e-46bd-a99b-44692678cc23 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:04.564827 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-4fad00d6-455e-46bd-a99b-44692678cc23 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:04.580814 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-4fad00d6-455e-46bd-a99b-44692678cc23 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/356742b9-7cbf-42d3-93bf-9ee0f93e872e" status: 200 len: 1225 microversion: 2.1 time: 0.124286 Sep 14 09:36:04.582343 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3293/6559] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:36:04 2022] GET /compute/v2.1/servers/356742b9-7cbf-42d3-93bf-9ee0f93e872e => generated 1225 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:36:04.598636 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-300b55d5-721e-469d-97e1-84db4cbb7b49 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725d7beb4ec54b86a455af0d7bd0ce19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c197eded81494b818b1e56f4c01432c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:04.606659 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-300b55d5-721e-469d-97e1-84db4cbb7b49 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/72812065-1001-48aa-be8c-2a5e99351a68" status: 200 len: 1392 microversion: 2.1 time: 0.202238 Sep 14 09:36:04.607269 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3267/6560] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:36:04 2022] GET /compute/v2.1/servers/72812065-1001-48aa-be8c-2a5e99351a68 => generated 1392 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:36:05.605522 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-3dbb15b4-d009-40a5-abff-9a528ece9c89 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:05.606174 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-3dbb15b4-d009-40a5-abff-9a528ece9c89 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: 356742b9-7cbf-42d3-93bf-9ee0f93e872e] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:05.613623 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3dbb15b4-d009-40a5-abff-9a528ece9c89 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:05.614147 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3dbb15b4-d009-40a5-abff-9a528ece9c89 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:05.614604 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3dbb15b4-d009-40a5-abff-9a528ece9c89 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:05.616068 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3dbb15b4-d009-40a5-abff-9a528ece9c89 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:05.616558 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3dbb15b4-d009-40a5-abff-9a528ece9c89 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:05.617005 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3dbb15b4-d009-40a5-abff-9a528ece9c89 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:05.631240 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d32fe4c6-85d8-4a4d-8135-50bcd7196c02 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:05.631865 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-d32fe4c6-85d8-4a4d-8135-50bcd7196c02 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: 72812065-1001-48aa-be8c-2a5e99351a68] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:05.639904 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d32fe4c6-85d8-4a4d-8135-50bcd7196c02 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:05.640673 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d32fe4c6-85d8-4a4d-8135-50bcd7196c02 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:05.641299 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d32fe4c6-85d8-4a4d-8135-50bcd7196c02 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:05.642486 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d32fe4c6-85d8-4a4d-8135-50bcd7196c02 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:05.643863 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d32fe4c6-85d8-4a4d-8135-50bcd7196c02 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:05.644353 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d32fe4c6-85d8-4a4d-8135-50bcd7196c02 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:05.700844 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-3dbb15b4-d009-40a5-abff-9a528ece9c89 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:05.709401 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-3dbb15b4-d009-40a5-abff-9a528ece9c89 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/356742b9-7cbf-42d3-93bf-9ee0f93e872e" status: 200 len: 1225 microversion: 2.1 time: 0.107835 Sep 14 09:36:05.725400 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3294/6561] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:36:05 2022] GET /compute/v2.1/servers/356742b9-7cbf-42d3-93bf-9ee0f93e872e => generated 1225 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:36:05.797519 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-d32fe4c6-85d8-4a4d-8135-50bcd7196c02 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725d7beb4ec54b86a455af0d7bd0ce19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c197eded81494b818b1e56f4c01432c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:05.806439 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d32fe4c6-85d8-4a4d-8135-50bcd7196c02 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/72812065-1001-48aa-be8c-2a5e99351a68" status: 200 len: 1392 microversion: 2.1 time: 0.180445 Sep 14 09:36:05.807330 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3268/6562] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:36:05 2022] GET /compute/v2.1/servers/72812065-1001-48aa-be8c-2a5e99351a68 => generated 1392 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:36:06.732670 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-bd841d25-7877-4ac5-b8c3-d0d9f0a1b7eb tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:06.733250 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-bd841d25-7877-4ac5-b8c3-d0d9f0a1b7eb tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: 356742b9-7cbf-42d3-93bf-9ee0f93e872e] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:06.740394 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bd841d25-7877-4ac5-b8c3-d0d9f0a1b7eb tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:06.740904 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bd841d25-7877-4ac5-b8c3-d0d9f0a1b7eb tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:06.741362 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bd841d25-7877-4ac5-b8c3-d0d9f0a1b7eb tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:06.742190 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bd841d25-7877-4ac5-b8c3-d0d9f0a1b7eb tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:06.742673 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bd841d25-7877-4ac5-b8c3-d0d9f0a1b7eb tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:06.743151 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bd841d25-7877-4ac5-b8c3-d0d9f0a1b7eb tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:06.809194 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-bd841d25-7877-4ac5-b8c3-d0d9f0a1b7eb tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:06.817133 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-bd841d25-7877-4ac5-b8c3-d0d9f0a1b7eb tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/356742b9-7cbf-42d3-93bf-9ee0f93e872e" status: 200 len: 1225 microversion: 2.1 time: 0.088614 Sep 14 09:36:06.817719 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3295/6563] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:36:06 2022] GET /compute/v2.1/servers/356742b9-7cbf-42d3-93bf-9ee0f93e872e => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:36:06.828639 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c12497d6-2f3f-42c3-ad70-19f02a1739fb tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:06.829348 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-c12497d6-2f3f-42c3-ad70-19f02a1739fb tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: 72812065-1001-48aa-be8c-2a5e99351a68] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:06.837225 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c12497d6-2f3f-42c3-ad70-19f02a1739fb tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:06.837722 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c12497d6-2f3f-42c3-ad70-19f02a1739fb tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:06.838169 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c12497d6-2f3f-42c3-ad70-19f02a1739fb tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:06.838871 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c12497d6-2f3f-42c3-ad70-19f02a1739fb tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:06.839364 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c12497d6-2f3f-42c3-ad70-19f02a1739fb tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:06.839800 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c12497d6-2f3f-42c3-ad70-19f02a1739fb tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:06.975252 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-c12497d6-2f3f-42c3-ad70-19f02a1739fb tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725d7beb4ec54b86a455af0d7bd0ce19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c197eded81494b818b1e56f4c01432c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:06.983121 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-c12497d6-2f3f-42c3-ad70-19f02a1739fb tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/72812065-1001-48aa-be8c-2a5e99351a68" status: 200 len: 1392 microversion: 2.1 time: 0.158249 Sep 14 09:36:06.983642 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3269/6564] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:36:06 2022] GET /compute/v2.1/servers/72812065-1001-48aa-be8c-2a5e99351a68 => generated 1392 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:36:07.840498 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-7073ef36-5794-4fee-8678-dfe454d3dac4 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:07.841329 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-7073ef36-5794-4fee-8678-dfe454d3dac4 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: 356742b9-7cbf-42d3-93bf-9ee0f93e872e] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:07.848452 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7073ef36-5794-4fee-8678-dfe454d3dac4 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:07.848960 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7073ef36-5794-4fee-8678-dfe454d3dac4 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:07.849933 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7073ef36-5794-4fee-8678-dfe454d3dac4 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:07.850655 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7073ef36-5794-4fee-8678-dfe454d3dac4 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:07.851162 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7073ef36-5794-4fee-8678-dfe454d3dac4 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:07.851610 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7073ef36-5794-4fee-8678-dfe454d3dac4 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:07.866466 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-7073ef36-5794-4fee-8678-dfe454d3dac4 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] HTTP exception thrown: Instance 356742b9-7cbf-42d3-93bf-9ee0f93e872e could not be found. Sep 14 09:36:07.868602 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-7073ef36-5794-4fee-8678-dfe454d3dac4 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Request method failure captured: Sep 14 09:36:07.868602 n-d-836830-18 devstack@n-api.service[128758]: request: GET /compute/v2.1/servers/356742b9-7cbf-42d3-93bf-9ee0f93e872e HTTP/1.1 Sep 14 09:36:07.868602 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 09:36:07.868602 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 09:36:07.868602 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 09:36:07.868602 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 09:36:07.868602 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 09:36:07.868602 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 09:36:07.868602 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 09:36:07.868602 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 09:36:07.868602 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZ7vSEasHnu7hRXol9c-LZuMaC9uK137X6F5rG7UmloUJeCaIX1XI8DyW-6MYPzXIn8tJlRUDBfS9Xo7ko5WvlkRtwNLi8r30OmEJBkLllR4uOPeHedowZTMuQPwQppwmIxlx0K05UlAJOyH1eD16mNE7GFFk01jmhPM_9wCZyZUFi8 Sep 14 09:36:07.868602 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 09:36:07.868602 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 09:36:07.868602 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 09:36:07.868602 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 09:36:07.868602 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 09:36:07.868602 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 09:36:07.868602 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 0fca803d9ffa4b4ab0371c0d6a96a5a2 Sep 14 09:36:07.868602 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-TestVolumeBootPattern-1945148622 Sep 14 09:36:07.868602 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 09:36:07.868602 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 09:36:07.868602 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0fca803d9ffa4b4ab0371c0d6a96a5a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0fca803d9ffa4b4ab0371c0d6a96a5a2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0fca803d9ffa4b4ab0371c0d6a96a5a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0fca803d9ffa4b4ab0371c0d6a96a5a2"}]}] Sep 14 09:36:07.868602 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-TestVolumeBootPattern-1945148622 Sep 14 09:36:07.868602 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 0fca803d9ffa4b4ab0371c0d6a96a5a2 Sep 14 09:36:07.868602 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-TestVolumeBootPattern-1945148622 Sep 14 09:36:07.868602 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-TestVolumeBootPattern-1945148622-project Sep 14 09:36:07.868602 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 09:36:07.868602 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 09:36:07.868602 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 80257054a25540c294e1787780b601b4 Sep 14 09:36:07.868602 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-TestVolumeBootPattern-1945148622-project Sep 14 09:36:07.868602 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 09:36:07.868602 n-d-836830-18 devstack@n-api.service[128758]: exception: Instance 356742b9-7cbf-42d3-93bf-9ee0f93e872e could not be found. Sep 14 09:36:07.868602 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': '356742b9-7cbf-42d3-93bf-9ee0f93e872e'} Sep 14 09:36:07.868602 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:36:07.868602 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:36:07.868602 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:36:07.868602 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:36:07.868602 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:36:07.868602 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:36:07.868602 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:36:07.868602 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:36:07.868602 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:36:07.868602 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:36:07.868602 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 356742b9-7cbf-42d3-93bf-9ee0f93e872e could not be found. Sep 14 09:36:07.868602 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:36:07.868602 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:36:07.868602 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:36:07.868602 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:36:07.868602 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:36:07.868602 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:36:07.868602 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:36:07.868602 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:36:07.868602 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:36:07.868602 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:36:07.868602 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:36:07.868602 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:36:07.868602 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:36:07.868602 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:36:07.868602 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:36:07.868602 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:36:07.868602 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 356742b9-7cbf-42d3-93bf-9ee0f93e872e could not be found. Sep 14 09:36:07.868602 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:36:07.868602 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:36:07.868602 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:36:07.874437 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:36:07.874437 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:36:07.874437 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:36:07.874437 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:36:07.874437 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:36:07.874437 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 356742b9-7cbf-42d3-93bf-9ee0f93e872e could not be found. Sep 14 09:36:07.874437 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:36:07.875903 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-7073ef36-5794-4fee-8678-dfe454d3dac4 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Returning 404 to user: Instance 356742b9-7cbf-42d3-93bf-9ee0f93e872e could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:36:07.876806 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-7073ef36-5794-4fee-8678-dfe454d3dac4 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/356742b9-7cbf-42d3-93bf-9ee0f93e872e" status: 404 len: 111 microversion: 2.1 time: 0.040381 Sep 14 09:36:07.877402 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3296/6565] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:36:07 2022] GET /compute/v2.1/servers/356742b9-7cbf-42d3-93bf-9ee0f93e872e => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:36:07.956762 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ee0c2bf2-b312-4acf-8949-c4b2dc1f718c tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1013013787", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1345910784", "security_groups": [{"name": "tempest-secgroup-smoke-1175246649"}], "block_device_mapping_v2": [{"uuid": "de7f74df-f67a-4e6d-8971-b0ab51370b24", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "70503795-7dfb-4d39-a57e-91e8e5270ce0"}]}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:36:08.007863 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-3185b8f1-fcfa-4d9d-aff8-3d2ad48707b2 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:08.008496 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-3185b8f1-fcfa-4d9d-aff8-3d2ad48707b2 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: 72812065-1001-48aa-be8c-2a5e99351a68] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:08.015329 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3185b8f1-fcfa-4d9d-aff8-3d2ad48707b2 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:08.016065 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3185b8f1-fcfa-4d9d-aff8-3d2ad48707b2 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:08.016725 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3185b8f1-fcfa-4d9d-aff8-3d2ad48707b2 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:08.017445 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3185b8f1-fcfa-4d9d-aff8-3d2ad48707b2 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:08.017916 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3185b8f1-fcfa-4d9d-aff8-3d2ad48707b2 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:08.018354 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3185b8f1-fcfa-4d9d-aff8-3d2ad48707b2 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:08.102178 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.network.neutron [None req-ee0c2bf2-b312-4acf-8949-c4b2dc1f718c tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] validate_networks() for [('70503795-7dfb-4d39-a57e-91e8e5270ce0', None, None, None, None, None)] {{(pid=128759) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:36:08.233227 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-3185b8f1-fcfa-4d9d-aff8-3d2ad48707b2 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725d7beb4ec54b86a455af0d7bd0ce19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c197eded81494b818b1e56f4c01432c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:08.241196 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-3185b8f1-fcfa-4d9d-aff8-3d2ad48707b2 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/72812065-1001-48aa-be8c-2a5e99351a68" status: 200 len: 1392 microversion: 2.1 time: 0.238246 Sep 14 09:36:08.241786 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3297/6566] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:36:08 2022] GET /compute/v2.1/servers/72812065-1001-48aa-be8c-2a5e99351a68 => generated 1392 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:36:08.614303 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-ee0c2bf2-b312-4acf-8949-c4b2dc1f718c tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Flavor limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:36:08.614743 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-ee0c2bf2-b312-4acf-8949-c4b2dc1f718c tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Image limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:36:08.615360 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-ee0c2bf2-b312-4acf-8949-c4b2dc1f718c tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Flavor pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:36:08.615797 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-ee0c2bf2-b312-4acf-8949-c4b2dc1f718c tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Image pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:36:08.616213 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-ee0c2bf2-b312-4acf-8949-c4b2dc1f718c tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:36:08.625111 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ee0c2bf2-b312-4acf-8949-c4b2dc1f718c tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:08.625592 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ee0c2bf2-b312-4acf-8949-c4b2dc1f718c tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:08.626027 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ee0c2bf2-b312-4acf-8949-c4b2dc1f718c tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:08.626801 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ee0c2bf2-b312-4acf-8949-c4b2dc1f718c tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:08.627237 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ee0c2bf2-b312-4acf-8949-c4b2dc1f718c tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:08.627659 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ee0c2bf2-b312-4acf-8949-c4b2dc1f718c tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:08.645175 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-ee0c2bf2-b312-4acf-8949-c4b2dc1f718c tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Getting quotas for project 0fca803d9ffa4b4ab0371c0d6a96a5a2. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:36:08.650990 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-ee0c2bf2-b312-4acf-8949-c4b2dc1f718c tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Getting quotas for user 80257054a25540c294e1787780b601b4 and project 0fca803d9ffa4b4ab0371c0d6a96a5a2. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:36:08.707543 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-ee0c2bf2-b312-4acf-8949-c4b2dc1f718c tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Going to run 1 instances... {{(pid=128759) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:36:08.710293 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-ee0c2bf2-b312-4acf-8949-c4b2dc1f718c tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: ae2c2dd3-d4f0-42a9-b4fa-fc48c4878fda] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='de7f74df-f67a-4e6d-8971-b0ab51370b24',volume_size=None,volume_type=None)] {{(pid=128759) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:36:08.837764 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-ee0c2bf2-b312-4acf-8949-c4b2dc1f718c tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.885120 Sep 14 09:36:08.838439 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3270/6567] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 09:36:07 2022] POST /compute/v2.1/servers => generated 406 bytes in 887 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:36:08.849539 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-e14490c6-21d5-4bad-95b6-b33397c8eb09 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:08.850194 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-e14490c6-21d5-4bad-95b6-b33397c8eb09 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: ae2c2dd3-d4f0-42a9-b4fa-fc48c4878fda] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:08.907836 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-e14490c6-21d5-4bad-95b6-b33397c8eb09 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:08.915072 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-e14490c6-21d5-4bad-95b6-b33397c8eb09 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/ae2c2dd3-d4f0-42a9-b4fa-fc48c4878fda" status: 200 len: 1095 microversion: 2.1 time: 0.069483 Sep 14 09:36:08.915667 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3298/6568] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:36:08 2022] GET /compute/v2.1/servers/ae2c2dd3-d4f0-42a9-b4fa-fc48c4878fda => generated 1095 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:36:09.264286 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-81fdf146-d2e3-4dab-b2e7-240a1d3fc4d6 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:09.264904 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-81fdf146-d2e3-4dab-b2e7-240a1d3fc4d6 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: 72812065-1001-48aa-be8c-2a5e99351a68] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:09.275656 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-81fdf146-d2e3-4dab-b2e7-240a1d3fc4d6 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:09.276149 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-81fdf146-d2e3-4dab-b2e7-240a1d3fc4d6 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:09.276593 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-81fdf146-d2e3-4dab-b2e7-240a1d3fc4d6 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:09.277292 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-81fdf146-d2e3-4dab-b2e7-240a1d3fc4d6 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:09.277753 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-81fdf146-d2e3-4dab-b2e7-240a1d3fc4d6 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:09.278186 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-81fdf146-d2e3-4dab-b2e7-240a1d3fc4d6 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:09.417326 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-81fdf146-d2e3-4dab-b2e7-240a1d3fc4d6 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725d7beb4ec54b86a455af0d7bd0ce19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c197eded81494b818b1e56f4c01432c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:09.425375 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-81fdf146-d2e3-4dab-b2e7-240a1d3fc4d6 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/72812065-1001-48aa-be8c-2a5e99351a68" status: 200 len: 1392 microversion: 2.1 time: 0.165806 Sep 14 09:36:09.437568 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3271/6569] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:36:09 2022] GET /compute/v2.1/servers/72812065-1001-48aa-be8c-2a5e99351a68 => generated 1392 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:36:09.545855 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-ae4817ce-96ea-4a4b-8534-13b5ee372a23 req-a48643d4-de1f-4e3d-b59b-bd15bce56ac2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72812065-1001-48aa-be8c-2a5e99351a68", "name": "network-vif-plugged", "status": "completed", "tag": "8a1b5d6e-4a16-406b-9f87-7c6fe87b147f"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:36:09.557567 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-ae4817ce-96ea-4a4b-8534-13b5ee372a23 req-a48643d4-de1f-4e3d-b59b-bd15bce56ac2 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:09.558491 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-ae4817ce-96ea-4a4b-8534-13b5ee372a23 req-a48643d4-de1f-4e3d-b59b-bd15bce56ac2 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:09.558955 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-ae4817ce-96ea-4a4b-8534-13b5ee372a23 req-a48643d4-de1f-4e3d-b59b-bd15bce56ac2 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:09.570398 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-ae4817ce-96ea-4a4b-8534-13b5ee372a23 req-a48643d4-de1f-4e3d-b59b-bd15bce56ac2 service nova] Creating event network-vif-plugged:8a1b5d6e-4a16-406b-9f87-7c6fe87b147f for instance 72812065-1001-48aa-be8c-2a5e99351a68 on n-h2-836830-18 Sep 14 09:36:09.575574 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-ae4817ce-96ea-4a4b-8534-13b5ee372a23 req-a48643d4-de1f-4e3d-b59b-bd15bce56ac2 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033206 Sep 14 09:36:09.576277 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3299/6570] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:36:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:36:09.938003 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b0895f09-a084-4469-ae2e-7309409aeac8 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:09.939087 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b0895f09-a084-4469-ae2e-7309409aeac8 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: ae2c2dd3-d4f0-42a9-b4fa-fc48c4878fda] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:09.946465 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b0895f09-a084-4469-ae2e-7309409aeac8 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:09.946984 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b0895f09-a084-4469-ae2e-7309409aeac8 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:09.947636 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b0895f09-a084-4469-ae2e-7309409aeac8 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:09.948355 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b0895f09-a084-4469-ae2e-7309409aeac8 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:09.948822 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b0895f09-a084-4469-ae2e-7309409aeac8 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:09.949314 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b0895f09-a084-4469-ae2e-7309409aeac8 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:10.031192 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b0895f09-a084-4469-ae2e-7309409aeac8 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:10.040098 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b0895f09-a084-4469-ae2e-7309409aeac8 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/ae2c2dd3-d4f0-42a9-b4fa-fc48c4878fda" status: 200 len: 1211 microversion: 2.1 time: 0.106209 Sep 14 09:36:10.040679 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3272/6571] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:36:09 2022] GET /compute/v2.1/servers/ae2c2dd3-d4f0-42a9-b4fa-fc48c4878fda => generated 1211 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:36:10.452030 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-70231189-6d4e-4bb1-8afe-14b4a4ed120b tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:10.453191 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-70231189-6d4e-4bb1-8afe-14b4a4ed120b tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: 72812065-1001-48aa-be8c-2a5e99351a68] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:10.460481 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-70231189-6d4e-4bb1-8afe-14b4a4ed120b tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:10.461180 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-70231189-6d4e-4bb1-8afe-14b4a4ed120b tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:10.461893 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-70231189-6d4e-4bb1-8afe-14b4a4ed120b tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:10.462763 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-70231189-6d4e-4bb1-8afe-14b4a4ed120b tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:10.463474 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-70231189-6d4e-4bb1-8afe-14b4a4ed120b tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:10.463985 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-70231189-6d4e-4bb1-8afe-14b4a4ed120b tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:10.580420 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=2 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:36:10.720146 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-70231189-6d4e-4bb1-8afe-14b4a4ed120b tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725d7beb4ec54b86a455af0d7bd0ce19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c197eded81494b818b1e56f4c01432c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:10.732556 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-70231189-6d4e-4bb1-8afe-14b4a4ed120b tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/72812065-1001-48aa-be8c-2a5e99351a68" status: 200 len: 1392 microversion: 2.1 time: 0.285721 Sep 14 09:36:10.743508 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3300/6572] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:36:10 2022] GET /compute/v2.1/servers/72812065-1001-48aa-be8c-2a5e99351a68 => generated 1392 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:36:11.063925 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-352c0d30-636d-492a-bdec-fbf3d4f21adc tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:11.065200 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-352c0d30-636d-492a-bdec-fbf3d4f21adc tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: ae2c2dd3-d4f0-42a9-b4fa-fc48c4878fda] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:11.073735 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-352c0d30-636d-492a-bdec-fbf3d4f21adc tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:11.074399 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-352c0d30-636d-492a-bdec-fbf3d4f21adc tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:11.074850 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-352c0d30-636d-492a-bdec-fbf3d4f21adc tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:11.075592 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-352c0d30-636d-492a-bdec-fbf3d4f21adc tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:11.076054 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-352c0d30-636d-492a-bdec-fbf3d4f21adc tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:11.076484 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-352c0d30-636d-492a-bdec-fbf3d4f21adc tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:11.467472 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-352c0d30-636d-492a-bdec-fbf3d4f21adc tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:11.478515 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-352c0d30-636d-492a-bdec-fbf3d4f21adc tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/ae2c2dd3-d4f0-42a9-b4fa-fc48c4878fda" status: 200 len: 1279 microversion: 2.1 time: 0.418511 Sep 14 09:36:11.479212 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3273/6573] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:36:11 2022] GET /compute/v2.1/servers/ae2c2dd3-d4f0-42a9-b4fa-fc48c4878fda => generated 1279 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:36:11.758374 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c51dd51e-6f22-4e2e-b172-d3df8eb28d9d tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:11.759100 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-c51dd51e-6f22-4e2e-b172-d3df8eb28d9d tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: 72812065-1001-48aa-be8c-2a5e99351a68] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:11.766204 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c51dd51e-6f22-4e2e-b172-d3df8eb28d9d tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:11.766711 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c51dd51e-6f22-4e2e-b172-d3df8eb28d9d tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:11.767186 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c51dd51e-6f22-4e2e-b172-d3df8eb28d9d tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:11.767927 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c51dd51e-6f22-4e2e-b172-d3df8eb28d9d tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:11.768394 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c51dd51e-6f22-4e2e-b172-d3df8eb28d9d tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:11.768823 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c51dd51e-6f22-4e2e-b172-d3df8eb28d9d tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:11.893232 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-60991ee6-ebbe-4ec0-9f29-43a7ce8b8969 req-c1bf3755-8a1b-4394-b717-b57d6c50f8a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae2c2dd3-d4f0-42a9-b4fa-fc48c4878fda", "tag": "a35c1f88-7ee3-4186-9b41-b4b5e4d6e8a0"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:36:11.905667 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-60991ee6-ebbe-4ec0-9f29-43a7ce8b8969 req-c1bf3755-8a1b-4394-b717-b57d6c50f8a1 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:11.906210 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-60991ee6-ebbe-4ec0-9f29-43a7ce8b8969 req-c1bf3755-8a1b-4394-b717-b57d6c50f8a1 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:11.906774 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-60991ee6-ebbe-4ec0-9f29-43a7ce8b8969 req-c1bf3755-8a1b-4394-b717-b57d6c50f8a1 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:11.918709 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-60991ee6-ebbe-4ec0-9f29-43a7ce8b8969 req-c1bf3755-8a1b-4394-b717-b57d6c50f8a1 service nova] Creating event network-changed:a35c1f88-7ee3-4186-9b41-b4b5e4d6e8a0 for instance ae2c2dd3-d4f0-42a9-b4fa-fc48c4878fda on n-h1-836830-18 Sep 14 09:36:11.924196 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-60991ee6-ebbe-4ec0-9f29-43a7ce8b8969 req-c1bf3755-8a1b-4394-b717-b57d6c50f8a1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035163 Sep 14 09:36:11.925237 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3274/6574] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:36:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:36:12.016850 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-c51dd51e-6f22-4e2e-b172-d3df8eb28d9d tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725d7beb4ec54b86a455af0d7bd0ce19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c197eded81494b818b1e56f4c01432c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:12.025685 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-c51dd51e-6f22-4e2e-b172-d3df8eb28d9d tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/72812065-1001-48aa-be8c-2a5e99351a68" status: 200 len: 1564 microversion: 2.1 time: 0.271895 Sep 14 09:36:12.026258 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3301/6575] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:36:11 2022] GET /compute/v2.1/servers/72812065-1001-48aa-be8c-2a5e99351a68 => generated 1564 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:36:12.048527 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c4bcf039-1e04-43b9-be06-497682f7a4a0 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:12.049618 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-c4bcf039-1e04-43b9-be06-497682f7a4a0 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: 72812065-1001-48aa-be8c-2a5e99351a68] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:12.056753 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c4bcf039-1e04-43b9-be06-497682f7a4a0 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:12.057833 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c4bcf039-1e04-43b9-be06-497682f7a4a0 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:12.058565 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c4bcf039-1e04-43b9-be06-497682f7a4a0 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:12.059570 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c4bcf039-1e04-43b9-be06-497682f7a4a0 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:12.060268 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c4bcf039-1e04-43b9-be06-497682f7a4a0 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:12.060934 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c4bcf039-1e04-43b9-be06-497682f7a4a0 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:12.278679 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-c4bcf039-1e04-43b9-be06-497682f7a4a0 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725d7beb4ec54b86a455af0d7bd0ce19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c197eded81494b818b1e56f4c01432c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:12.287960 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-c4bcf039-1e04-43b9-be06-497682f7a4a0 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/72812065-1001-48aa-be8c-2a5e99351a68" status: 200 len: 1564 microversion: 2.1 time: 0.242797 Sep 14 09:36:12.289085 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3275/6576] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:36:12 2022] GET /compute/v2.1/servers/72812065-1001-48aa-be8c-2a5e99351a68 => generated 1564 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:36:12.509088 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-5e9738ed-f05b-4633-9963-891be8f0427f tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:12.510146 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-5e9738ed-f05b-4633-9963-891be8f0427f tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: ae2c2dd3-d4f0-42a9-b4fa-fc48c4878fda] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:12.517403 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5e9738ed-f05b-4633-9963-891be8f0427f tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:12.518376 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5e9738ed-f05b-4633-9963-891be8f0427f tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:12.519240 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5e9738ed-f05b-4633-9963-891be8f0427f tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:12.520406 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5e9738ed-f05b-4633-9963-891be8f0427f tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:12.522148 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5e9738ed-f05b-4633-9963-891be8f0427f tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:12.523580 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5e9738ed-f05b-4633-9963-891be8f0427f tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:12.760276 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-5e9738ed-f05b-4633-9963-891be8f0427f tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:12.778931 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-5e9738ed-f05b-4633-9963-891be8f0427f tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/ae2c2dd3-d4f0-42a9-b4fa-fc48c4878fda" status: 200 len: 1279 microversion: 2.1 time: 0.277628 Sep 14 09:36:12.781307 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3302/6577] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:36:12 2022] GET /compute/v2.1/servers/ae2c2dd3-d4f0-42a9-b4fa-fc48c4878fda => generated 1279 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:36:13.804054 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c0e02f51-2e98-4f09-9ada-74e5d278d95d tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:13.804620 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-c0e02f51-2e98-4f09-9ada-74e5d278d95d tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: ae2c2dd3-d4f0-42a9-b4fa-fc48c4878fda] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:13.811841 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c0e02f51-2e98-4f09-9ada-74e5d278d95d tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:13.812343 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c0e02f51-2e98-4f09-9ada-74e5d278d95d tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:13.812790 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c0e02f51-2e98-4f09-9ada-74e5d278d95d tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:13.813509 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c0e02f51-2e98-4f09-9ada-74e5d278d95d tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:13.813963 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c0e02f51-2e98-4f09-9ada-74e5d278d95d tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:13.814396 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c0e02f51-2e98-4f09-9ada-74e5d278d95d tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:13.964025 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-c0e02f51-2e98-4f09-9ada-74e5d278d95d tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:13.973284 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-c0e02f51-2e98-4f09-9ada-74e5d278d95d tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/ae2c2dd3-d4f0-42a9-b4fa-fc48c4878fda" status: 200 len: 1279 microversion: 2.1 time: 0.173362 Sep 14 09:36:13.973896 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3276/6578] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:36:13 2022] GET /compute/v2.1/servers/ae2c2dd3-d4f0-42a9-b4fa-fc48c4878fda => generated 1279 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:36:14.035378 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-fd9a5de8-0108-443e-b5d9-ac90de70af28 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:14.036169 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-fd9a5de8-0108-443e-b5d9-ac90de70af28 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: 72812065-1001-48aa-be8c-2a5e99351a68] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:14.038673 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-7fb79b39-6327-4476-8446-953be027e34b req-28fa7cbf-908c-41e4-9f45-5bbf78f46413 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72812065-1001-48aa-be8c-2a5e99351a68", "tag": "8a1b5d6e-4a16-406b-9f87-7c6fe87b147f"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:36:14.048887 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-7fb79b39-6327-4476-8446-953be027e34b req-28fa7cbf-908c-41e4-9f45-5bbf78f46413 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:14.049381 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-7fb79b39-6327-4476-8446-953be027e34b req-28fa7cbf-908c-41e4-9f45-5bbf78f46413 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:14.049826 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-7fb79b39-6327-4476-8446-953be027e34b req-28fa7cbf-908c-41e4-9f45-5bbf78f46413 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:14.050243 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fd9a5de8-0108-443e-b5d9-ac90de70af28 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:14.053757 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fd9a5de8-0108-443e-b5d9-ac90de70af28 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:14.055479 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fd9a5de8-0108-443e-b5d9-ac90de70af28 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:14.061176 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fd9a5de8-0108-443e-b5d9-ac90de70af28 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:14.061627 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fd9a5de8-0108-443e-b5d9-ac90de70af28 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:14.062564 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fd9a5de8-0108-443e-b5d9-ac90de70af28 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:14.063259 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-7fb79b39-6327-4476-8446-953be027e34b req-28fa7cbf-908c-41e4-9f45-5bbf78f46413 service nova] Creating event network-changed:8a1b5d6e-4a16-406b-9f87-7c6fe87b147f for instance 72812065-1001-48aa-be8c-2a5e99351a68 on n-h2-836830-18 Sep 14 09:36:14.068969 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-7fb79b39-6327-4476-8446-953be027e34b req-28fa7cbf-908c-41e4-9f45-5bbf78f46413 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033352 Sep 14 09:36:14.069920 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3277/6579] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:36:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:36:14.225035 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-fd9a5de8-0108-443e-b5d9-ac90de70af28 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725d7beb4ec54b86a455af0d7bd0ce19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c197eded81494b818b1e56f4c01432c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:14.235611 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-fd9a5de8-0108-443e-b5d9-ac90de70af28 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/72812065-1001-48aa-be8c-2a5e99351a68" status: 200 len: 1564 microversion: 2.1 time: 0.203613 Sep 14 09:36:14.251944 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3303/6580] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:36:14 2022] GET /compute/v2.1/servers/72812065-1001-48aa-be8c-2a5e99351a68 => generated 1564 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:36:15.001467 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-32871e67-7802-4912-ba63-f0d159ddc768 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:15.002311 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-32871e67-7802-4912-ba63-f0d159ddc768 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: ae2c2dd3-d4f0-42a9-b4fa-fc48c4878fda] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:15.010808 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-32871e67-7802-4912-ba63-f0d159ddc768 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:15.011354 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-32871e67-7802-4912-ba63-f0d159ddc768 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:15.011810 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-32871e67-7802-4912-ba63-f0d159ddc768 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:15.012562 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-32871e67-7802-4912-ba63-f0d159ddc768 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:15.013027 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-32871e67-7802-4912-ba63-f0d159ddc768 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:15.014130 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-32871e67-7802-4912-ba63-f0d159ddc768 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:15.168158 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-32871e67-7802-4912-ba63-f0d159ddc768 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:15.176725 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-32871e67-7802-4912-ba63-f0d159ddc768 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/ae2c2dd3-d4f0-42a9-b4fa-fc48c4878fda" status: 200 len: 1279 microversion: 2.1 time: 0.183080 Sep 14 09:36:15.178513 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3278/6581] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:36:14 2022] GET /compute/v2.1/servers/ae2c2dd3-d4f0-42a9-b4fa-fc48c4878fda => generated 1279 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:36:16.200729 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ece23d9a-b8b8-41bb-9868-44ccc46e4787 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:16.201362 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-ece23d9a-b8b8-41bb-9868-44ccc46e4787 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: ae2c2dd3-d4f0-42a9-b4fa-fc48c4878fda] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:16.208529 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ece23d9a-b8b8-41bb-9868-44ccc46e4787 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:16.209632 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ece23d9a-b8b8-41bb-9868-44ccc46e4787 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:16.210102 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ece23d9a-b8b8-41bb-9868-44ccc46e4787 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:16.210787 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ece23d9a-b8b8-41bb-9868-44ccc46e4787 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:16.211285 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ece23d9a-b8b8-41bb-9868-44ccc46e4787 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:16.211723 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ece23d9a-b8b8-41bb-9868-44ccc46e4787 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:16.345495 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-ece23d9a-b8b8-41bb-9868-44ccc46e4787 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:16.353469 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-ece23d9a-b8b8-41bb-9868-44ccc46e4787 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/ae2c2dd3-d4f0-42a9-b4fa-fc48c4878fda" status: 200 len: 1267 microversion: 2.1 time: 0.156678 Sep 14 09:36:16.354062 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3304/6582] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:36:16 2022] GET /compute/v2.1/servers/ae2c2dd3-d4f0-42a9-b4fa-fc48c4878fda => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:36:17.376837 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ac1b518a-04af-4da4-9228-40aa9d911550 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:17.377464 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-ac1b518a-04af-4da4-9228-40aa9d911550 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: ae2c2dd3-d4f0-42a9-b4fa-fc48c4878fda] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:17.384913 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ac1b518a-04af-4da4-9228-40aa9d911550 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:17.385400 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ac1b518a-04af-4da4-9228-40aa9d911550 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:17.385867 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ac1b518a-04af-4da4-9228-40aa9d911550 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:17.386592 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ac1b518a-04af-4da4-9228-40aa9d911550 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:17.387082 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ac1b518a-04af-4da4-9228-40aa9d911550 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:17.387514 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ac1b518a-04af-4da4-9228-40aa9d911550 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:17.519639 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-ac1b518a-04af-4da4-9228-40aa9d911550 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:17.528214 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-ac1b518a-04af-4da4-9228-40aa9d911550 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/ae2c2dd3-d4f0-42a9-b4fa-fc48c4878fda" status: 200 len: 1267 microversion: 2.1 time: 0.155601 Sep 14 09:36:17.528788 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3279/6583] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:36:17 2022] GET /compute/v2.1/servers/ae2c2dd3-d4f0-42a9-b4fa-fc48c4878fda => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:36:18.550733 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-95a33221-123b-4008-9c8f-6a5f1c02a7a1 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:18.551424 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-95a33221-123b-4008-9c8f-6a5f1c02a7a1 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: ae2c2dd3-d4f0-42a9-b4fa-fc48c4878fda] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:18.559329 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-95a33221-123b-4008-9c8f-6a5f1c02a7a1 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:18.559834 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-95a33221-123b-4008-9c8f-6a5f1c02a7a1 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:18.560301 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-95a33221-123b-4008-9c8f-6a5f1c02a7a1 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:18.561089 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-95a33221-123b-4008-9c8f-6a5f1c02a7a1 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:18.561574 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-95a33221-123b-4008-9c8f-6a5f1c02a7a1 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:18.562014 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-95a33221-123b-4008-9c8f-6a5f1c02a7a1 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:18.696745 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-95a33221-123b-4008-9c8f-6a5f1c02a7a1 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:18.704560 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-95a33221-123b-4008-9c8f-6a5f1c02a7a1 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/ae2c2dd3-d4f0-42a9-b4fa-fc48c4878fda" status: 200 len: 1267 microversion: 2.1 time: 0.157789 Sep 14 09:36:18.705182 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3305/6584] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:36:18 2022] GET /compute/v2.1/servers/ae2c2dd3-d4f0-42a9-b4fa-fc48c4878fda => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:36:19.728989 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-2b3c23f4-ee76-4169-9524-d153b32728ca tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:19.729645 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-2b3c23f4-ee76-4169-9524-d153b32728ca tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: ae2c2dd3-d4f0-42a9-b4fa-fc48c4878fda] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:19.732437 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=2 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:36:19.733105 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=12 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:36:19.738744 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2b3c23f4-ee76-4169-9524-d153b32728ca tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:19.739261 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2b3c23f4-ee76-4169-9524-d153b32728ca tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:19.739707 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2b3c23f4-ee76-4169-9524-d153b32728ca tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:19.740981 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2b3c23f4-ee76-4169-9524-d153b32728ca tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:19.741438 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2b3c23f4-ee76-4169-9524-d153b32728ca tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:19.741867 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2b3c23f4-ee76-4169-9524-d153b32728ca tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:19.874480 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-2b3c23f4-ee76-4169-9524-d153b32728ca tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:19.882194 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-2b3c23f4-ee76-4169-9524-d153b32728ca tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/ae2c2dd3-d4f0-42a9-b4fa-fc48c4878fda" status: 200 len: 1267 microversion: 2.1 time: 0.157660 Sep 14 09:36:19.882756 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3280/6585] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:36:19 2022] GET /compute/v2.1/servers/ae2c2dd3-d4f0-42a9-b4fa-fc48c4878fda => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:36:20.904173 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-469c67e6-7b71-4640-87c7-4dda05da0ef1 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:20.904797 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-469c67e6-7b71-4640-87c7-4dda05da0ef1 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: ae2c2dd3-d4f0-42a9-b4fa-fc48c4878fda] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:20.906729 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=8 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:36:20.913073 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-469c67e6-7b71-4640-87c7-4dda05da0ef1 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:20.913566 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-469c67e6-7b71-4640-87c7-4dda05da0ef1 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:20.914012 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-469c67e6-7b71-4640-87c7-4dda05da0ef1 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:20.914707 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-469c67e6-7b71-4640-87c7-4dda05da0ef1 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:20.915197 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-469c67e6-7b71-4640-87c7-4dda05da0ef1 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:20.915633 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-469c67e6-7b71-4640-87c7-4dda05da0ef1 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:21.047769 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-469c67e6-7b71-4640-87c7-4dda05da0ef1 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:21.056035 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-469c67e6-7b71-4640-87c7-4dda05da0ef1 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/ae2c2dd3-d4f0-42a9-b4fa-fc48c4878fda" status: 200 len: 1267 microversion: 2.1 time: 0.155770 Sep 14 09:36:21.056606 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3306/6586] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:36:20 2022] GET /compute/v2.1/servers/ae2c2dd3-d4f0-42a9-b4fa-fc48c4878fda => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:36:22.078924 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a94d04c1-5d31-4462-81cb-2abbbd461059 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:22.079592 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-a94d04c1-5d31-4462-81cb-2abbbd461059 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: ae2c2dd3-d4f0-42a9-b4fa-fc48c4878fda] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:22.087416 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a94d04c1-5d31-4462-81cb-2abbbd461059 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:22.087909 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a94d04c1-5d31-4462-81cb-2abbbd461059 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:22.088352 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a94d04c1-5d31-4462-81cb-2abbbd461059 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:22.089051 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a94d04c1-5d31-4462-81cb-2abbbd461059 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:22.089512 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a94d04c1-5d31-4462-81cb-2abbbd461059 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:22.089944 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a94d04c1-5d31-4462-81cb-2abbbd461059 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:22.220017 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-a94d04c1-5d31-4462-81cb-2abbbd461059 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:22.227859 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a94d04c1-5d31-4462-81cb-2abbbd461059 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/ae2c2dd3-d4f0-42a9-b4fa-fc48c4878fda" status: 200 len: 1267 microversion: 2.1 time: 0.152870 Sep 14 09:36:22.228439 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3281/6587] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:36:22 2022] GET /compute/v2.1/servers/ae2c2dd3-d4f0-42a9-b4fa-fc48c4878fda => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:36:23.250715 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-2545df06-ba00-4303-b2ee-c75404966c18 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:23.251367 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-2545df06-ba00-4303-b2ee-c75404966c18 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: ae2c2dd3-d4f0-42a9-b4fa-fc48c4878fda] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:23.257597 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2545df06-ba00-4303-b2ee-c75404966c18 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:23.258089 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2545df06-ba00-4303-b2ee-c75404966c18 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:23.258535 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2545df06-ba00-4303-b2ee-c75404966c18 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:23.259258 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2545df06-ba00-4303-b2ee-c75404966c18 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:23.259723 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2545df06-ba00-4303-b2ee-c75404966c18 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:23.260156 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2545df06-ba00-4303-b2ee-c75404966c18 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:23.396773 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-2545df06-ba00-4303-b2ee-c75404966c18 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:23.405039 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-2545df06-ba00-4303-b2ee-c75404966c18 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/ae2c2dd3-d4f0-42a9-b4fa-fc48c4878fda" status: 200 len: 1267 microversion: 2.1 time: 0.158420 Sep 14 09:36:23.405697 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3307/6588] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:36:23 2022] GET /compute/v2.1/servers/ae2c2dd3-d4f0-42a9-b4fa-fc48c4878fda => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:36:24.429827 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a07dabe2-79c4-4462-b359-cb0d05da88e8 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:24.430369 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-a07dabe2-79c4-4462-b359-cb0d05da88e8 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: ae2c2dd3-d4f0-42a9-b4fa-fc48c4878fda] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:24.436601 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a07dabe2-79c4-4462-b359-cb0d05da88e8 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:24.437093 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a07dabe2-79c4-4462-b359-cb0d05da88e8 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:24.437539 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a07dabe2-79c4-4462-b359-cb0d05da88e8 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:24.438245 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a07dabe2-79c4-4462-b359-cb0d05da88e8 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:24.438706 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a07dabe2-79c4-4462-b359-cb0d05da88e8 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:24.439180 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a07dabe2-79c4-4462-b359-cb0d05da88e8 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:24.572754 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-a07dabe2-79c4-4462-b359-cb0d05da88e8 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:24.580633 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a07dabe2-79c4-4462-b359-cb0d05da88e8 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/ae2c2dd3-d4f0-42a9-b4fa-fc48c4878fda" status: 200 len: 1267 microversion: 2.1 time: 0.155626 Sep 14 09:36:24.581213 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3282/6589] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:36:24 2022] GET /compute/v2.1/servers/ae2c2dd3-d4f0-42a9-b4fa-fc48c4878fda => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:36:25.430584 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-8fe95265-e434-4ed9-ab4b-4eda32d0f6ed req-a5ccd512-3d37-4923-a9cf-b93e5a3888c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae2c2dd3-d4f0-42a9-b4fa-fc48c4878fda", "name": "network-vif-plugged", "status": "completed", "tag": "a35c1f88-7ee3-4186-9b41-b4b5e4d6e8a0"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:36:25.442507 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-8fe95265-e434-4ed9-ab4b-4eda32d0f6ed req-a5ccd512-3d37-4923-a9cf-b93e5a3888c7 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:25.444049 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-8fe95265-e434-4ed9-ab4b-4eda32d0f6ed req-a5ccd512-3d37-4923-a9cf-b93e5a3888c7 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:25.444503 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-8fe95265-e434-4ed9-ab4b-4eda32d0f6ed req-a5ccd512-3d37-4923-a9cf-b93e5a3888c7 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:25.456703 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-8fe95265-e434-4ed9-ab4b-4eda32d0f6ed req-a5ccd512-3d37-4923-a9cf-b93e5a3888c7 service nova] Creating event network-vif-plugged:a35c1f88-7ee3-4186-9b41-b4b5e4d6e8a0 for instance ae2c2dd3-d4f0-42a9-b4fa-fc48c4878fda on n-h1-836830-18 Sep 14 09:36:25.462389 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-8fe95265-e434-4ed9-ab4b-4eda32d0f6ed req-a5ccd512-3d37-4923-a9cf-b93e5a3888c7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036003 Sep 14 09:36:25.463056 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3308/6590] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:36:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:36:25.604313 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-553e29ba-caa8-4809-9bd7-562b69fa188c tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:25.604720 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-553e29ba-caa8-4809-9bd7-562b69fa188c tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: ae2c2dd3-d4f0-42a9-b4fa-fc48c4878fda] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:25.611628 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-553e29ba-caa8-4809-9bd7-562b69fa188c tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:25.612120 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-553e29ba-caa8-4809-9bd7-562b69fa188c tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:25.612568 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-553e29ba-caa8-4809-9bd7-562b69fa188c tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:25.613277 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-553e29ba-caa8-4809-9bd7-562b69fa188c tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:25.613744 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-553e29ba-caa8-4809-9bd7-562b69fa188c tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:25.614173 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-553e29ba-caa8-4809-9bd7-562b69fa188c tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:25.751949 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-553e29ba-caa8-4809-9bd7-562b69fa188c tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:25.761242 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-553e29ba-caa8-4809-9bd7-562b69fa188c tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/ae2c2dd3-d4f0-42a9-b4fa-fc48c4878fda" status: 200 len: 1267 microversion: 2.1 time: 0.161054 Sep 14 09:36:25.761813 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3283/6591] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:36:25 2022] GET /compute/v2.1/servers/ae2c2dd3-d4f0-42a9-b4fa-fc48c4878fda => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:36:26.785431 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-48f170fb-4653-45ac-8ace-40d028ca0a85 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:26.786161 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-48f170fb-4653-45ac-8ace-40d028ca0a85 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: ae2c2dd3-d4f0-42a9-b4fa-fc48c4878fda] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:26.792479 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-48f170fb-4653-45ac-8ace-40d028ca0a85 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:26.793002 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-48f170fb-4653-45ac-8ace-40d028ca0a85 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:26.793486 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-48f170fb-4653-45ac-8ace-40d028ca0a85 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:26.794183 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-48f170fb-4653-45ac-8ace-40d028ca0a85 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:26.794662 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-48f170fb-4653-45ac-8ace-40d028ca0a85 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:26.795200 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-48f170fb-4653-45ac-8ace-40d028ca0a85 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:26.929736 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-48f170fb-4653-45ac-8ace-40d028ca0a85 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:26.937638 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-48f170fb-4653-45ac-8ace-40d028ca0a85 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/ae2c2dd3-d4f0-42a9-b4fa-fc48c4878fda" status: 200 len: 1267 microversion: 2.1 time: 0.157373 Sep 14 09:36:26.938213 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3309/6592] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:36:26 2022] GET /compute/v2.1/servers/ae2c2dd3-d4f0-42a9-b4fa-fc48c4878fda => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:36:27.961042 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-4d1e64d6-4228-4935-966d-ada39888f734 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:27.961657 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-4d1e64d6-4228-4935-966d-ada39888f734 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: ae2c2dd3-d4f0-42a9-b4fa-fc48c4878fda] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:27.968461 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4d1e64d6-4228-4935-966d-ada39888f734 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:27.968944 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4d1e64d6-4228-4935-966d-ada39888f734 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:27.969378 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4d1e64d6-4228-4935-966d-ada39888f734 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:27.970062 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4d1e64d6-4228-4935-966d-ada39888f734 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:27.970514 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4d1e64d6-4228-4935-966d-ada39888f734 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:27.970961 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4d1e64d6-4228-4935-966d-ada39888f734 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:27.985479 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=100 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:36:28.111136 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-4d1e64d6-4228-4935-966d-ada39888f734 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:28.118947 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-4d1e64d6-4228-4935-966d-ada39888f734 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/ae2c2dd3-d4f0-42a9-b4fa-fc48c4878fda" status: 200 len: 1451 microversion: 2.1 time: 0.162605 Sep 14 09:36:28.119544 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3284/6593] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:36:27 2022] GET /compute/v2.1/servers/ae2c2dd3-d4f0-42a9-b4fa-fc48c4878fda => generated 1451 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:36:28.141268 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-bda47b30-565d-4f10-b174-ab4498150eaf tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:28.141911 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-bda47b30-565d-4f10-b174-ab4498150eaf tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: ae2c2dd3-d4f0-42a9-b4fa-fc48c4878fda] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:28.149482 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bda47b30-565d-4f10-b174-ab4498150eaf tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:28.149986 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bda47b30-565d-4f10-b174-ab4498150eaf tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:28.150440 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bda47b30-565d-4f10-b174-ab4498150eaf tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:28.151181 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bda47b30-565d-4f10-b174-ab4498150eaf tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:28.151660 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bda47b30-565d-4f10-b174-ab4498150eaf tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:28.152105 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bda47b30-565d-4f10-b174-ab4498150eaf tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:28.156220 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=100 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:36:28.282498 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-bda47b30-565d-4f10-b174-ab4498150eaf tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:28.290536 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-bda47b30-565d-4f10-b174-ab4498150eaf tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/ae2c2dd3-d4f0-42a9-b4fa-fc48c4878fda" status: 200 len: 1451 microversion: 2.1 time: 0.153153 Sep 14 09:36:28.291145 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3310/6594] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:36:28 2022] GET /compute/v2.1/servers/ae2c2dd3-d4f0-42a9-b4fa-fc48c4878fda => generated 1451 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:36:30.200512 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-19430df5-4200-414b-b533-ef8078869b09 req-6a3e7da4-1d79-4474-a395-368d228f5173 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae2c2dd3-d4f0-42a9-b4fa-fc48c4878fda", "tag": "a35c1f88-7ee3-4186-9b41-b4b5e4d6e8a0"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:36:30.212131 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-19430df5-4200-414b-b533-ef8078869b09 req-6a3e7da4-1d79-4474-a395-368d228f5173 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:30.212690 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-19430df5-4200-414b-b533-ef8078869b09 req-6a3e7da4-1d79-4474-a395-368d228f5173 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:30.213190 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-19430df5-4200-414b-b533-ef8078869b09 req-6a3e7da4-1d79-4474-a395-368d228f5173 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:30.228733 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-19430df5-4200-414b-b533-ef8078869b09 req-6a3e7da4-1d79-4474-a395-368d228f5173 service nova] Creating event network-changed:a35c1f88-7ee3-4186-9b41-b4b5e4d6e8a0 for instance ae2c2dd3-d4f0-42a9-b4fa-fc48c4878fda on n-h1-836830-18 Sep 14 09:36:30.234149 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-19430df5-4200-414b-b533-ef8078869b09 req-6a3e7da4-1d79-4474-a395-368d228f5173 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037440 Sep 14 09:36:30.234932 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3285/6595] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:36:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:36:35.504044 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-6900a57c-88a2-40c6-90c8-ec86f8192a06 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:36:35.506919 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-6900a57c-88a2-40c6-90c8-ec86f8192a06 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: 72812065-1001-48aa-be8c-2a5e99351a68] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:35.510099 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=42 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:36:35.515545 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6900a57c-88a2-40c6-90c8-ec86f8192a06 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:35.516049 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6900a57c-88a2-40c6-90c8-ec86f8192a06 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:35.516504 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6900a57c-88a2-40c6-90c8-ec86f8192a06 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:35.517227 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6900a57c-88a2-40c6-90c8-ec86f8192a06 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:35.517701 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6900a57c-88a2-40c6-90c8-ec86f8192a06 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:35.518146 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6900a57c-88a2-40c6-90c8-ec86f8192a06 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:35.573559 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-6900a57c-88a2-40c6-90c8-ec86f8192a06 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "POST /compute/v2.1/servers/72812065-1001-48aa-be8c-2a5e99351a68/action" status: 200 len: 24547 microversion: 2.1 time: 0.073239 Sep 14 09:36:35.574391 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3311/6596] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:36:35 2022] POST /compute/v2.1/servers/72812065-1001-48aa-be8c-2a5e99351a68/action => generated 24547 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 09:36:46.636501 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=3 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:36:46.637246 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=5 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:36:46.641475 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-1cfc3fcd-2b2c-4b04-bd5c-083a4a364ab8 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:36:46.644391 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-1cfc3fcd-2b2c-4b04-bd5c-083a4a364ab8 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: 72812065-1001-48aa-be8c-2a5e99351a68] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:46.652272 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1cfc3fcd-2b2c-4b04-bd5c-083a4a364ab8 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:46.652763 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1cfc3fcd-2b2c-4b04-bd5c-083a4a364ab8 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:46.653204 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1cfc3fcd-2b2c-4b04-bd5c-083a4a364ab8 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:46.653913 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1cfc3fcd-2b2c-4b04-bd5c-083a4a364ab8 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:46.654369 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1cfc3fcd-2b2c-4b04-bd5c-083a4a364ab8 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:46.654807 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1cfc3fcd-2b2c-4b04-bd5c-083a4a364ab8 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:46.733093 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-1cfc3fcd-2b2c-4b04-bd5c-083a4a364ab8 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Flavor limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:36:46.733582 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-1cfc3fcd-2b2c-4b04-bd5c-083a4a364ab8 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Image limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:36:46.734181 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-1cfc3fcd-2b2c-4b04-bd5c-083a4a364ab8 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Flavor pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:36:46.734609 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-1cfc3fcd-2b2c-4b04-bd5c-083a4a364ab8 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Image pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:36:46.735063 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-1cfc3fcd-2b2c-4b04-bd5c-083a4a364ab8 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:36:46.793895 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-1cfc3fcd-2b2c-4b04-bd5c-083a4a364ab8 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: 72812065-1001-48aa-be8c-2a5e99351a68] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:46.800173 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1cfc3fcd-2b2c-4b04-bd5c-083a4a364ab8 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:46.800677 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1cfc3fcd-2b2c-4b04-bd5c-083a4a364ab8 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:46.801157 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1cfc3fcd-2b2c-4b04-bd5c-083a4a364ab8 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:46.801869 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1cfc3fcd-2b2c-4b04-bd5c-083a4a364ab8 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:46.802925 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1cfc3fcd-2b2c-4b04-bd5c-083a4a364ab8 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:46.803432 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1cfc3fcd-2b2c-4b04-bd5c-083a4a364ab8 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:46.830141 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-1cfc3fcd-2b2c-4b04-bd5c-083a4a364ab8 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "POST /compute/v2.1/servers/72812065-1001-48aa-be8c-2a5e99351a68/action" status: 202 len: 1138 microversion: 2.1 time: 0.195876 Sep 14 09:36:46.830737 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3286/6597] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:36:46 2022] POST /compute/v2.1/servers/72812065-1001-48aa-be8c-2a5e99351a68/action => generated 1138 bytes in 197 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Sep 14 09:36:46.851906 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ee2cd4cf-e0df-4b0d-8570-dc33afda1cb9 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:46.852622 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-ee2cd4cf-e0df-4b0d-8570-dc33afda1cb9 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: 72812065-1001-48aa-be8c-2a5e99351a68] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:46.855639 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:36:46.856500 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=8 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:36:46.863094 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ee2cd4cf-e0df-4b0d-8570-dc33afda1cb9 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:46.863597 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ee2cd4cf-e0df-4b0d-8570-dc33afda1cb9 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:46.864042 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ee2cd4cf-e0df-4b0d-8570-dc33afda1cb9 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:46.865359 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ee2cd4cf-e0df-4b0d-8570-dc33afda1cb9 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:46.865841 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ee2cd4cf-e0df-4b0d-8570-dc33afda1cb9 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:46.866420 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ee2cd4cf-e0df-4b0d-8570-dc33afda1cb9 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:47.011910 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-ee2cd4cf-e0df-4b0d-8570-dc33afda1cb9 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725d7beb4ec54b86a455af0d7bd0ce19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c197eded81494b818b1e56f4c01432c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:47.020197 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-ee2cd4cf-e0df-4b0d-8570-dc33afda1cb9 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/72812065-1001-48aa-be8c-2a5e99351a68" status: 200 len: 1692 microversion: 2.1 time: 0.172997 Sep 14 09:36:47.021697 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3312/6598] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:36:46 2022] GET /compute/v2.1/servers/72812065-1001-48aa-be8c-2a5e99351a68 => generated 1692 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:36:48.045336 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-0e48991f-7bad-4ca3-bcda-e3c4e0c3b61f tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:48.045948 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-0e48991f-7bad-4ca3-bcda-e3c4e0c3b61f tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: 72812065-1001-48aa-be8c-2a5e99351a68] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:48.053147 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0e48991f-7bad-4ca3-bcda-e3c4e0c3b61f tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:48.053643 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0e48991f-7bad-4ca3-bcda-e3c4e0c3b61f tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:48.054092 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0e48991f-7bad-4ca3-bcda-e3c4e0c3b61f tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:48.054797 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0e48991f-7bad-4ca3-bcda-e3c4e0c3b61f tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:48.055290 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0e48991f-7bad-4ca3-bcda-e3c4e0c3b61f tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:48.055725 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0e48991f-7bad-4ca3-bcda-e3c4e0c3b61f tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:48.187833 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-0e48991f-7bad-4ca3-bcda-e3c4e0c3b61f tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725d7beb4ec54b86a455af0d7bd0ce19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c197eded81494b818b1e56f4c01432c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:48.196124 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-0e48991f-7bad-4ca3-bcda-e3c4e0c3b61f tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/72812065-1001-48aa-be8c-2a5e99351a68" status: 200 len: 1692 microversion: 2.1 time: 0.155125 Sep 14 09:36:48.196696 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3287/6599] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:36:48 2022] GET /compute/v2.1/servers/72812065-1001-48aa-be8c-2a5e99351a68 => generated 1692 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:36:49.220114 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-e305c0d0-39ec-4077-b683-2edc61a5273b tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:49.220667 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-e305c0d0-39ec-4077-b683-2edc61a5273b tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: 72812065-1001-48aa-be8c-2a5e99351a68] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:49.228954 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e305c0d0-39ec-4077-b683-2edc61a5273b tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:49.229457 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e305c0d0-39ec-4077-b683-2edc61a5273b tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:49.229913 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e305c0d0-39ec-4077-b683-2edc61a5273b tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:49.230623 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e305c0d0-39ec-4077-b683-2edc61a5273b tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:49.231124 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e305c0d0-39ec-4077-b683-2edc61a5273b tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:49.231991 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e305c0d0-39ec-4077-b683-2edc61a5273b tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:49.366038 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-e305c0d0-39ec-4077-b683-2edc61a5273b tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725d7beb4ec54b86a455af0d7bd0ce19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c197eded81494b818b1e56f4c01432c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:49.374249 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-e305c0d0-39ec-4077-b683-2edc61a5273b tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/72812065-1001-48aa-be8c-2a5e99351a68" status: 200 len: 1692 microversion: 2.1 time: 0.158157 Sep 14 09:36:49.374877 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3313/6600] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:36:49 2022] GET /compute/v2.1/servers/72812065-1001-48aa-be8c-2a5e99351a68 => generated 1692 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:36:50.397667 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f75de938-a8bb-47df-9290-e29bb8bcdcf2 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:50.398302 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f75de938-a8bb-47df-9290-e29bb8bcdcf2 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: 72812065-1001-48aa-be8c-2a5e99351a68] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:50.405310 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f75de938-a8bb-47df-9290-e29bb8bcdcf2 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:50.405808 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f75de938-a8bb-47df-9290-e29bb8bcdcf2 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:50.406254 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f75de938-a8bb-47df-9290-e29bb8bcdcf2 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:50.406969 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f75de938-a8bb-47df-9290-e29bb8bcdcf2 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:50.407437 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f75de938-a8bb-47df-9290-e29bb8bcdcf2 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:50.407872 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f75de938-a8bb-47df-9290-e29bb8bcdcf2 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:50.548485 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f75de938-a8bb-47df-9290-e29bb8bcdcf2 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725d7beb4ec54b86a455af0d7bd0ce19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c197eded81494b818b1e56f4c01432c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:50.558093 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f75de938-a8bb-47df-9290-e29bb8bcdcf2 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/72812065-1001-48aa-be8c-2a5e99351a68" status: 200 len: 1692 microversion: 2.1 time: 0.164323 Sep 14 09:36:50.558683 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3288/6601] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:36:50 2022] GET /compute/v2.1/servers/72812065-1001-48aa-be8c-2a5e99351a68 => generated 1692 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:36:51.580684 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-2353dc1d-ab84-48e4-8dc7-7042717fda0d tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:51.581319 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-2353dc1d-ab84-48e4-8dc7-7042717fda0d tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: 72812065-1001-48aa-be8c-2a5e99351a68] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:51.589105 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2353dc1d-ab84-48e4-8dc7-7042717fda0d tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:51.589607 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2353dc1d-ab84-48e4-8dc7-7042717fda0d tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:51.590060 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2353dc1d-ab84-48e4-8dc7-7042717fda0d tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:51.590770 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2353dc1d-ab84-48e4-8dc7-7042717fda0d tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:51.591305 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2353dc1d-ab84-48e4-8dc7-7042717fda0d tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:51.591749 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2353dc1d-ab84-48e4-8dc7-7042717fda0d tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:51.729777 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-2353dc1d-ab84-48e4-8dc7-7042717fda0d tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725d7beb4ec54b86a455af0d7bd0ce19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c197eded81494b818b1e56f4c01432c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:51.737805 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-2353dc1d-ab84-48e4-8dc7-7042717fda0d tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/72812065-1001-48aa-be8c-2a5e99351a68" status: 200 len: 1692 microversion: 2.1 time: 0.161153 Sep 14 09:36:51.738387 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3314/6602] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:36:51 2022] GET /compute/v2.1/servers/72812065-1001-48aa-be8c-2a5e99351a68 => generated 1692 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:36:52.761181 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8da06b78-5a25-4492-8cf6-71dead763083 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:52.761807 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-8da06b78-5a25-4492-8cf6-71dead763083 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: 72812065-1001-48aa-be8c-2a5e99351a68] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:52.768656 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8da06b78-5a25-4492-8cf6-71dead763083 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:52.769146 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8da06b78-5a25-4492-8cf6-71dead763083 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:52.769592 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8da06b78-5a25-4492-8cf6-71dead763083 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:52.770286 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8da06b78-5a25-4492-8cf6-71dead763083 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:52.770749 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8da06b78-5a25-4492-8cf6-71dead763083 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:52.771209 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8da06b78-5a25-4492-8cf6-71dead763083 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:52.906054 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-8da06b78-5a25-4492-8cf6-71dead763083 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725d7beb4ec54b86a455af0d7bd0ce19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c197eded81494b818b1e56f4c01432c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:52.914325 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-8da06b78-5a25-4492-8cf6-71dead763083 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/72812065-1001-48aa-be8c-2a5e99351a68" status: 200 len: 1692 microversion: 2.1 time: 0.157070 Sep 14 09:36:52.914907 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3289/6603] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:36:52 2022] GET /compute/v2.1/servers/72812065-1001-48aa-be8c-2a5e99351a68 => generated 1692 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:36:53.938012 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-411a5f3a-6209-4984-a931-e4085e75efd5 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:53.938586 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-411a5f3a-6209-4984-a931-e4085e75efd5 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: 72812065-1001-48aa-be8c-2a5e99351a68] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:53.945265 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-411a5f3a-6209-4984-a931-e4085e75efd5 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:53.945767 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-411a5f3a-6209-4984-a931-e4085e75efd5 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:53.946218 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-411a5f3a-6209-4984-a931-e4085e75efd5 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:53.946927 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-411a5f3a-6209-4984-a931-e4085e75efd5 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:53.947428 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-411a5f3a-6209-4984-a931-e4085e75efd5 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:53.947858 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-411a5f3a-6209-4984-a931-e4085e75efd5 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:54.084391 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-411a5f3a-6209-4984-a931-e4085e75efd5 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725d7beb4ec54b86a455af0d7bd0ce19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c197eded81494b818b1e56f4c01432c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:54.092218 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-411a5f3a-6209-4984-a931-e4085e75efd5 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/72812065-1001-48aa-be8c-2a5e99351a68" status: 200 len: 1692 microversion: 2.1 time: 0.158220 Sep 14 09:36:54.092836 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3315/6604] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:36:53 2022] GET /compute/v2.1/servers/72812065-1001-48aa-be8c-2a5e99351a68 => generated 1692 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:36:55.116808 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-24e72fcd-678b-48a0-aafd-8aed22bbb158 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:55.117382 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-24e72fcd-678b-48a0-aafd-8aed22bbb158 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: 72812065-1001-48aa-be8c-2a5e99351a68] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:55.123432 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-24e72fcd-678b-48a0-aafd-8aed22bbb158 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:55.123920 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-24e72fcd-678b-48a0-aafd-8aed22bbb158 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:55.124361 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-24e72fcd-678b-48a0-aafd-8aed22bbb158 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:55.125059 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-24e72fcd-678b-48a0-aafd-8aed22bbb158 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:55.125516 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-24e72fcd-678b-48a0-aafd-8aed22bbb158 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:55.125949 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-24e72fcd-678b-48a0-aafd-8aed22bbb158 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:55.264540 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-24e72fcd-678b-48a0-aafd-8aed22bbb158 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725d7beb4ec54b86a455af0d7bd0ce19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c197eded81494b818b1e56f4c01432c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:55.272288 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-24e72fcd-678b-48a0-aafd-8aed22bbb158 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/72812065-1001-48aa-be8c-2a5e99351a68" status: 200 len: 1692 microversion: 2.1 time: 0.160276 Sep 14 09:36:55.272863 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3290/6605] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:36:55 2022] GET /compute/v2.1/servers/72812065-1001-48aa-be8c-2a5e99351a68 => generated 1692 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:36:56.296546 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ed790aa1-e44e-488f-80a0-33ef03e776aa tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:56.297183 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-ed790aa1-e44e-488f-80a0-33ef03e776aa tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: 72812065-1001-48aa-be8c-2a5e99351a68] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:56.304649 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ed790aa1-e44e-488f-80a0-33ef03e776aa tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:56.305149 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ed790aa1-e44e-488f-80a0-33ef03e776aa tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:56.305603 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ed790aa1-e44e-488f-80a0-33ef03e776aa tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:56.306313 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ed790aa1-e44e-488f-80a0-33ef03e776aa tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:56.306786 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ed790aa1-e44e-488f-80a0-33ef03e776aa tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:56.307270 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ed790aa1-e44e-488f-80a0-33ef03e776aa tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:56.444007 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-ed790aa1-e44e-488f-80a0-33ef03e776aa tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725d7beb4ec54b86a455af0d7bd0ce19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c197eded81494b818b1e56f4c01432c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:56.451769 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-ed790aa1-e44e-488f-80a0-33ef03e776aa tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/72812065-1001-48aa-be8c-2a5e99351a68" status: 200 len: 1692 microversion: 2.1 time: 0.159384 Sep 14 09:36:56.452345 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3316/6606] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:36:56 2022] GET /compute/v2.1/servers/72812065-1001-48aa-be8c-2a5e99351a68 => generated 1692 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:36:57.475524 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-62b5a0db-b32c-4513-b924-2d3f457a025a tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:57.476136 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-62b5a0db-b32c-4513-b924-2d3f457a025a tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: 72812065-1001-48aa-be8c-2a5e99351a68] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:57.483037 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-62b5a0db-b32c-4513-b924-2d3f457a025a tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:57.483520 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-62b5a0db-b32c-4513-b924-2d3f457a025a tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:57.483955 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-62b5a0db-b32c-4513-b924-2d3f457a025a tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:57.484636 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-62b5a0db-b32c-4513-b924-2d3f457a025a tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:57.485088 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-62b5a0db-b32c-4513-b924-2d3f457a025a tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:57.485510 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-62b5a0db-b32c-4513-b924-2d3f457a025a tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:57.620437 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-62b5a0db-b32c-4513-b924-2d3f457a025a tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725d7beb4ec54b86a455af0d7bd0ce19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c197eded81494b818b1e56f4c01432c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:57.628278 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-62b5a0db-b32c-4513-b924-2d3f457a025a tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/72812065-1001-48aa-be8c-2a5e99351a68" status: 200 len: 1692 microversion: 2.1 time: 0.157263 Sep 14 09:36:57.628861 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3291/6607] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:36:57 2022] GET /compute/v2.1/servers/72812065-1001-48aa-be8c-2a5e99351a68 => generated 1692 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:36:58.652141 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-2acd5134-a279-4a60-bead-d11be2ee8a35 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:58.652780 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-2acd5134-a279-4a60-bead-d11be2ee8a35 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: 72812065-1001-48aa-be8c-2a5e99351a68] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:58.659891 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2acd5134-a279-4a60-bead-d11be2ee8a35 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:58.660403 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2acd5134-a279-4a60-bead-d11be2ee8a35 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:58.660858 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2acd5134-a279-4a60-bead-d11be2ee8a35 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:58.661573 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2acd5134-a279-4a60-bead-d11be2ee8a35 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:58.662612 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2acd5134-a279-4a60-bead-d11be2ee8a35 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:58.663086 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2acd5134-a279-4a60-bead-d11be2ee8a35 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:58.796055 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-2acd5134-a279-4a60-bead-d11be2ee8a35 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725d7beb4ec54b86a455af0d7bd0ce19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c197eded81494b818b1e56f4c01432c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:58.804728 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-2acd5134-a279-4a60-bead-d11be2ee8a35 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/72812065-1001-48aa-be8c-2a5e99351a68" status: 200 len: 1692 microversion: 2.1 time: 0.156470 Sep 14 09:36:58.805329 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3317/6608] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:36:58 2022] GET /compute/v2.1/servers/72812065-1001-48aa-be8c-2a5e99351a68 => generated 1692 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:36:59.828160 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8bd319da-8c83-449d-a538-cc48834d35d5 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:59.828714 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-8bd319da-8c83-449d-a538-cc48834d35d5 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: 72812065-1001-48aa-be8c-2a5e99351a68] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:59.836313 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8bd319da-8c83-449d-a538-cc48834d35d5 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:59.836803 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8bd319da-8c83-449d-a538-cc48834d35d5 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:59.837250 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8bd319da-8c83-449d-a538-cc48834d35d5 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:59.837946 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8bd319da-8c83-449d-a538-cc48834d35d5 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:59.838416 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8bd319da-8c83-449d-a538-cc48834d35d5 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:59.838848 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8bd319da-8c83-449d-a538-cc48834d35d5 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:59.967296 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-8bd319da-8c83-449d-a538-cc48834d35d5 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725d7beb4ec54b86a455af0d7bd0ce19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c197eded81494b818b1e56f4c01432c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:59.975601 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-8bd319da-8c83-449d-a538-cc48834d35d5 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/72812065-1001-48aa-be8c-2a5e99351a68" status: 200 len: 1692 microversion: 2.1 time: 0.151471 Sep 14 09:36:59.976176 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3292/6609] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:36:59 2022] GET /compute/v2.1/servers/72812065-1001-48aa-be8c-2a5e99351a68 => generated 1692 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:37:00.999355 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-6ffb7df6-baca-47a1-8ecc-f3d551f8b431 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:00.999990 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-6ffb7df6-baca-47a1-8ecc-f3d551f8b431 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: 72812065-1001-48aa-be8c-2a5e99351a68] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:37:01.006965 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6ffb7df6-baca-47a1-8ecc-f3d551f8b431 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:01.007477 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6ffb7df6-baca-47a1-8ecc-f3d551f8b431 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:01.007925 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6ffb7df6-baca-47a1-8ecc-f3d551f8b431 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:01.008627 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6ffb7df6-baca-47a1-8ecc-f3d551f8b431 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:01.009095 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6ffb7df6-baca-47a1-8ecc-f3d551f8b431 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:01.009534 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6ffb7df6-baca-47a1-8ecc-f3d551f8b431 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:01.145093 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-6ffb7df6-baca-47a1-8ecc-f3d551f8b431 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725d7beb4ec54b86a455af0d7bd0ce19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c197eded81494b818b1e56f4c01432c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:37:01.152925 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-6ffb7df6-baca-47a1-8ecc-f3d551f8b431 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/72812065-1001-48aa-be8c-2a5e99351a68" status: 200 len: 1692 microversion: 2.1 time: 0.157913 Sep 14 09:37:01.153509 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3318/6610] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:37:00 2022] GET /compute/v2.1/servers/72812065-1001-48aa-be8c-2a5e99351a68 => generated 1692 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:37:02.176644 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-74aacc13-047b-495c-8bf1-458d73482e1d tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:02.177760 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-74aacc13-047b-495c-8bf1-458d73482e1d tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: 72812065-1001-48aa-be8c-2a5e99351a68] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:37:02.184691 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-74aacc13-047b-495c-8bf1-458d73482e1d tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:02.185186 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-74aacc13-047b-495c-8bf1-458d73482e1d tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:02.185630 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-74aacc13-047b-495c-8bf1-458d73482e1d tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:02.186326 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-74aacc13-047b-495c-8bf1-458d73482e1d tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:02.186787 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-74aacc13-047b-495c-8bf1-458d73482e1d tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:02.187244 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-74aacc13-047b-495c-8bf1-458d73482e1d tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:02.315610 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-74aacc13-047b-495c-8bf1-458d73482e1d tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725d7beb4ec54b86a455af0d7bd0ce19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c197eded81494b818b1e56f4c01432c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:37:02.323954 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-74aacc13-047b-495c-8bf1-458d73482e1d tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/72812065-1001-48aa-be8c-2a5e99351a68" status: 200 len: 1692 microversion: 2.1 time: 0.151225 Sep 14 09:37:02.324537 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3293/6611] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:37:02 2022] GET /compute/v2.1/servers/72812065-1001-48aa-be8c-2a5e99351a68 => generated 1692 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:37:03.347494 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ff82c024-8c65-464f-8795-d346860d3c0f tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:03.348158 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-ff82c024-8c65-464f-8795-d346860d3c0f tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: 72812065-1001-48aa-be8c-2a5e99351a68] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:37:03.355145 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ff82c024-8c65-464f-8795-d346860d3c0f tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:03.355678 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ff82c024-8c65-464f-8795-d346860d3c0f tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:03.356206 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ff82c024-8c65-464f-8795-d346860d3c0f tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:03.356921 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ff82c024-8c65-464f-8795-d346860d3c0f tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:03.357395 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ff82c024-8c65-464f-8795-d346860d3c0f tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:03.357840 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ff82c024-8c65-464f-8795-d346860d3c0f tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:03.491482 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-ff82c024-8c65-464f-8795-d346860d3c0f tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725d7beb4ec54b86a455af0d7bd0ce19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c197eded81494b818b1e56f4c01432c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:37:03.500014 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-ff82c024-8c65-464f-8795-d346860d3c0f tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/72812065-1001-48aa-be8c-2a5e99351a68" status: 200 len: 1692 microversion: 2.1 time: 0.156464 Sep 14 09:37:03.500616 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3319/6612] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:37:03 2022] GET /compute/v2.1/servers/72812065-1001-48aa-be8c-2a5e99351a68 => generated 1692 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:37:04.526203 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-12c38bcd-8b30-4962-ac16-d7ee2c2ee84e tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:04.527120 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-12c38bcd-8b30-4962-ac16-d7ee2c2ee84e tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: 72812065-1001-48aa-be8c-2a5e99351a68] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:37:04.534660 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-12c38bcd-8b30-4962-ac16-d7ee2c2ee84e tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:04.535184 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-12c38bcd-8b30-4962-ac16-d7ee2c2ee84e tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:04.535632 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-12c38bcd-8b30-4962-ac16-d7ee2c2ee84e tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:04.536334 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-12c38bcd-8b30-4962-ac16-d7ee2c2ee84e tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:04.537401 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-12c38bcd-8b30-4962-ac16-d7ee2c2ee84e tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:04.537985 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-12c38bcd-8b30-4962-ac16-d7ee2c2ee84e tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:04.673242 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-12c38bcd-8b30-4962-ac16-d7ee2c2ee84e tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725d7beb4ec54b86a455af0d7bd0ce19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c197eded81494b818b1e56f4c01432c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:37:04.681404 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-12c38bcd-8b30-4962-ac16-d7ee2c2ee84e tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/72812065-1001-48aa-be8c-2a5e99351a68" status: 200 len: 1698 microversion: 2.1 time: 0.161419 Sep 14 09:37:04.681998 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3294/6613] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:37:04 2022] GET /compute/v2.1/servers/72812065-1001-48aa-be8c-2a5e99351a68 => generated 1698 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:37:05.707842 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-0c432a9d-69f8-4f3d-9c63-b9eb4fd68eed tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:05.708631 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-0c432a9d-69f8-4f3d-9c63-b9eb4fd68eed tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: 72812065-1001-48aa-be8c-2a5e99351a68] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:37:05.715616 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0c432a9d-69f8-4f3d-9c63-b9eb4fd68eed tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:05.716238 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0c432a9d-69f8-4f3d-9c63-b9eb4fd68eed tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:05.716580 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0c432a9d-69f8-4f3d-9c63-b9eb4fd68eed tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:05.717288 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0c432a9d-69f8-4f3d-9c63-b9eb4fd68eed tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:05.717761 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0c432a9d-69f8-4f3d-9c63-b9eb4fd68eed tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:05.718209 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0c432a9d-69f8-4f3d-9c63-b9eb4fd68eed tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:05.864058 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-0c432a9d-69f8-4f3d-9c63-b9eb4fd68eed tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725d7beb4ec54b86a455af0d7bd0ce19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c197eded81494b818b1e56f4c01432c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:37:05.872821 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-0c432a9d-69f8-4f3d-9c63-b9eb4fd68eed tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/72812065-1001-48aa-be8c-2a5e99351a68" status: 200 len: 1683 microversion: 2.1 time: 0.169496 Sep 14 09:37:05.873486 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3320/6614] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:37:05 2022] GET /compute/v2.1/servers/72812065-1001-48aa-be8c-2a5e99351a68 => generated 1683 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:37:07.803576 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-8086ffae-3a0e-44ca-9235-f67e02ec5791 req-a56984ba-7e54-4a52-bce6-5bde58ac1c72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72812065-1001-48aa-be8c-2a5e99351a68", "name": "network-vif-unplugged", "status": "completed", "tag": "8a1b5d6e-4a16-406b-9f87-7c6fe87b147f"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:37:07.817945 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-8086ffae-3a0e-44ca-9235-f67e02ec5791 req-a56984ba-7e54-4a52-bce6-5bde58ac1c72 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:07.818522 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-8086ffae-3a0e-44ca-9235-f67e02ec5791 req-a56984ba-7e54-4a52-bce6-5bde58ac1c72 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:07.819304 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-8086ffae-3a0e-44ca-9235-f67e02ec5791 req-a56984ba-7e54-4a52-bce6-5bde58ac1c72 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:07.831636 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-8086ffae-3a0e-44ca-9235-f67e02ec5791 req-a56984ba-7e54-4a52-bce6-5bde58ac1c72 service nova] Creating event network-vif-unplugged:8a1b5d6e-4a16-406b-9f87-7c6fe87b147f for instance 72812065-1001-48aa-be8c-2a5e99351a68 on n-h2-836830-18 Sep 14 09:37:07.837529 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-8086ffae-3a0e-44ca-9235-f67e02ec5791 req-a56984ba-7e54-4a52-bce6-5bde58ac1c72 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039502 Sep 14 09:37:07.838140 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3295/6615] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:37:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:37:09.872354 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-c88f85de-c8b3-4482-90a4-f8633cc7fa67 req-c55d9f64-fa42-4ea3-b19e-9bf359a2b6f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72812065-1001-48aa-be8c-2a5e99351a68", "name": "network-vif-plugged", "status": "completed", "tag": "8a1b5d6e-4a16-406b-9f87-7c6fe87b147f"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:37:09.883552 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-c88f85de-c8b3-4482-90a4-f8633cc7fa67 req-c55d9f64-fa42-4ea3-b19e-9bf359a2b6f9 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:09.884050 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-c88f85de-c8b3-4482-90a4-f8633cc7fa67 req-c55d9f64-fa42-4ea3-b19e-9bf359a2b6f9 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:09.884501 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-c88f85de-c8b3-4482-90a4-f8633cc7fa67 req-c55d9f64-fa42-4ea3-b19e-9bf359a2b6f9 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:09.895504 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-c88f85de-c8b3-4482-90a4-f8633cc7fa67 req-c55d9f64-fa42-4ea3-b19e-9bf359a2b6f9 service nova] Creating event network-vif-plugged:8a1b5d6e-4a16-406b-9f87-7c6fe87b147f for instance 72812065-1001-48aa-be8c-2a5e99351a68 on n-h2-836830-18 Sep 14 09:37:09.900667 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-c88f85de-c8b3-4482-90a4-f8633cc7fa67 req-c55d9f64-fa42-4ea3-b19e-9bf359a2b6f9 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032118 Sep 14 09:37:09.901300 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3321/6616] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:37:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:37:30.088933 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-aba7d9af-683c-4246-8525-96ed45739bd3 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:37:30.091300 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-aba7d9af-683c-4246-8525-96ed45739bd3 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: 72812065-1001-48aa-be8c-2a5e99351a68] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:37:30.094267 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=24 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:37:30.094959 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:37:30.100828 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-aba7d9af-683c-4246-8525-96ed45739bd3 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:30.101322 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-aba7d9af-683c-4246-8525-96ed45739bd3 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:30.101768 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-aba7d9af-683c-4246-8525-96ed45739bd3 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:30.102474 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-aba7d9af-683c-4246-8525-96ed45739bd3 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:30.103017 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-aba7d9af-683c-4246-8525-96ed45739bd3 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:30.103393 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-aba7d9af-683c-4246-8525-96ed45739bd3 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:30.156278 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-aba7d9af-683c-4246-8525-96ed45739bd3 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "POST /compute/v2.1/servers/72812065-1001-48aa-be8c-2a5e99351a68/action" status: 200 len: 24574 microversion: 2.1 time: 0.072115 Sep 14 09:37:30.156961 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3296/6617] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:37:30 2022] POST /compute/v2.1/servers/72812065-1001-48aa-be8c-2a5e99351a68/action => generated 24574 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 09:37:42.268162 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=20 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:37:42.268920 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=56 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:37:42.272385 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-ecf0293b-880b-4746-b54e-54f5f68799de req-b01df1d2-a218-462d-9b86-98601041b01c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72812065-1001-48aa-be8c-2a5e99351a68", "tag": "8a1b5d6e-4a16-406b-9f87-7c6fe87b147f"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:37:42.273320 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-e21a2b00-1d8d-4aeb-a643-6ab1093b7eea tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:42.273934 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-e21a2b00-1d8d-4aeb-a643-6ab1093b7eea tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: 72812065-1001-48aa-be8c-2a5e99351a68] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:37:42.282319 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e21a2b00-1d8d-4aeb-a643-6ab1093b7eea tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:42.282580 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=2 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:37:42.282819 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e21a2b00-1d8d-4aeb-a643-6ab1093b7eea tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:42.283511 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e21a2b00-1d8d-4aeb-a643-6ab1093b7eea tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:42.283676 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=4 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:37:42.284262 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e21a2b00-1d8d-4aeb-a643-6ab1093b7eea tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:42.284705 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e21a2b00-1d8d-4aeb-a643-6ab1093b7eea tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:42.285145 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e21a2b00-1d8d-4aeb-a643-6ab1093b7eea tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:42.287073 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-ecf0293b-880b-4746-b54e-54f5f68799de req-b01df1d2-a218-462d-9b86-98601041b01c service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:42.287559 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-ecf0293b-880b-4746-b54e-54f5f68799de req-b01df1d2-a218-462d-9b86-98601041b01c service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:42.288369 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-ecf0293b-880b-4746-b54e-54f5f68799de req-b01df1d2-a218-462d-9b86-98601041b01c service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:42.305181 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-ecf0293b-880b-4746-b54e-54f5f68799de req-b01df1d2-a218-462d-9b86-98601041b01c service nova] Creating event network-changed:8a1b5d6e-4a16-406b-9f87-7c6fe87b147f for instance 72812065-1001-48aa-be8c-2a5e99351a68 on n-h2-836830-18 Sep 14 09:37:42.310700 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-ecf0293b-880b-4746-b54e-54f5f68799de req-b01df1d2-a218-462d-9b86-98601041b01c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042795 Sep 14 09:37:42.311350 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3297/6618] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:37:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:37:42.312498 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-e21a2b00-1d8d-4aeb-a643-6ab1093b7eea tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: 72812065-1001-48aa-be8c-2a5e99351a68] Going to try to terminate instance {{(pid=128758) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:37:42.400961 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-e21a2b00-1d8d-4aeb-a643-6ab1093b7eea tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "DELETE /compute/v2.1/servers/72812065-1001-48aa-be8c-2a5e99351a68" status: 204 len: 0 microversion: 2.1 time: 0.135235 Sep 14 09:37:42.401635 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3322/6619] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:37:42 2022] DELETE /compute/v2.1/servers/72812065-1001-48aa-be8c-2a5e99351a68 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:37:42.412236 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e089b7d8-83f4-4ffe-9903-c34671b96153 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:42.412957 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e089b7d8-83f4-4ffe-9903-c34671b96153 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: 72812065-1001-48aa-be8c-2a5e99351a68] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:37:42.426155 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e089b7d8-83f4-4ffe-9903-c34671b96153 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:42.426656 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e089b7d8-83f4-4ffe-9903-c34671b96153 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:42.427703 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e089b7d8-83f4-4ffe-9903-c34671b96153 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:42.428474 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e089b7d8-83f4-4ffe-9903-c34671b96153 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:42.428889 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e089b7d8-83f4-4ffe-9903-c34671b96153 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:42.429327 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e089b7d8-83f4-4ffe-9903-c34671b96153 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:42.571036 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-e089b7d8-83f4-4ffe-9903-c34671b96153 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725d7beb4ec54b86a455af0d7bd0ce19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c197eded81494b818b1e56f4c01432c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:37:42.579297 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e089b7d8-83f4-4ffe-9903-c34671b96153 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/72812065-1001-48aa-be8c-2a5e99351a68" status: 200 len: 1689 microversion: 2.1 time: 0.172540 Sep 14 09:37:42.579886 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3298/6620] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:37:42 2022] GET /compute/v2.1/servers/72812065-1001-48aa-be8c-2a5e99351a68 => generated 1689 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:37:43.604419 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-27194196-0730-4d5a-90c1-5483262dc96f tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:43.605143 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-27194196-0730-4d5a-90c1-5483262dc96f tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: 72812065-1001-48aa-be8c-2a5e99351a68] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:37:43.611991 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-27194196-0730-4d5a-90c1-5483262dc96f tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:43.612491 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-27194196-0730-4d5a-90c1-5483262dc96f tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:43.612941 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-27194196-0730-4d5a-90c1-5483262dc96f tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:43.613646 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-27194196-0730-4d5a-90c1-5483262dc96f tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:43.614117 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-27194196-0730-4d5a-90c1-5483262dc96f tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:43.615074 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-27194196-0730-4d5a-90c1-5483262dc96f tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:43.752953 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-27194196-0730-4d5a-90c1-5483262dc96f tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725d7beb4ec54b86a455af0d7bd0ce19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c197eded81494b818b1e56f4c01432c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:37:43.760964 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-27194196-0730-4d5a-90c1-5483262dc96f tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/72812065-1001-48aa-be8c-2a5e99351a68" status: 200 len: 1689 microversion: 2.1 time: 0.160787 Sep 14 09:37:43.761663 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3323/6621] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:37:43 2022] GET /compute/v2.1/servers/72812065-1001-48aa-be8c-2a5e99351a68 => generated 1689 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:37:44.325948 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-5012f959-9f18-4080-888d-862a0d196f05 req-60b4d9cd-b3f7-4216-bb1d-8517f5dd1f91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72812065-1001-48aa-be8c-2a5e99351a68", "name": "network-vif-deleted", "tag": "8a1b5d6e-4a16-406b-9f87-7c6fe87b147f"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:37:44.337205 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-5012f959-9f18-4080-888d-862a0d196f05 req-60b4d9cd-b3f7-4216-bb1d-8517f5dd1f91 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:44.337699 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-5012f959-9f18-4080-888d-862a0d196f05 req-60b4d9cd-b3f7-4216-bb1d-8517f5dd1f91 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:44.338137 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-5012f959-9f18-4080-888d-862a0d196f05 req-60b4d9cd-b3f7-4216-bb1d-8517f5dd1f91 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:44.350926 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-5012f959-9f18-4080-888d-862a0d196f05 req-60b4d9cd-b3f7-4216-bb1d-8517f5dd1f91 service nova] Creating event network-vif-deleted:8a1b5d6e-4a16-406b-9f87-7c6fe87b147f for instance 72812065-1001-48aa-be8c-2a5e99351a68 on n-h2-836830-18 Sep 14 09:37:44.356308 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-5012f959-9f18-4080-888d-862a0d196f05 req-60b4d9cd-b3f7-4216-bb1d-8517f5dd1f91 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034074 Sep 14 09:37:44.356976 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3299/6622] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:37:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:37:44.786380 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-0e992577-c488-416e-bc90-3b61798274b7 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:44.786963 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-0e992577-c488-416e-bc90-3b61798274b7 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] [instance: 72812065-1001-48aa-be8c-2a5e99351a68] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:37:44.794729 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0e992577-c488-416e-bc90-3b61798274b7 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:44.795208 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0e992577-c488-416e-bc90-3b61798274b7 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:44.795659 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0e992577-c488-416e-bc90-3b61798274b7 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:44.796369 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0e992577-c488-416e-bc90-3b61798274b7 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:44.796838 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0e992577-c488-416e-bc90-3b61798274b7 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:44.797274 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0e992577-c488-416e-bc90-3b61798274b7 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:44.812333 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-0e992577-c488-416e-bc90-3b61798274b7 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] HTTP exception thrown: Instance 72812065-1001-48aa-be8c-2a5e99351a68 could not be found. Sep 14 09:37:44.814014 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-0e992577-c488-416e-bc90-3b61798274b7 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Request method failure captured: Sep 14 09:37:44.814014 n-d-836830-18 devstack@n-api.service[128758]: request: GET /compute/v2.1/servers/72812065-1001-48aa-be8c-2a5e99351a68 HTTP/1.1 Sep 14 09:37:44.814014 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 09:37:44.814014 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 09:37:44.814014 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 09:37:44.814014 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 09:37:44.814014 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 09:37:44.814014 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 09:37:44.814014 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 09:37:44.814014 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 09:37:44.814014 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIZ7Wj_81f9I2NRmfEwmuZpjrdWAEw7ARyOuI73wjvWEI66LzqUtysPT6IcAh0WZe2oebLj28uG94-uPGEC9cMUUKdhbePLDzfTDtmqqpgsB5YUrdD9jeNjtdjFX4L0eMBEKdd412dq4yc0_P9JNCFrwq1ozBqOy_b7PF0eHqh0jyqOo Sep 14 09:37:44.814014 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 09:37:44.814014 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 09:37:44.814014 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 09:37:44.814014 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 09:37:44.814014 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 09:37:44.814014 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 09:37:44.814014 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: c197eded81494b818b1e56f4c01432c5 Sep 14 09:37:44.814014 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1922438431 Sep 14 09:37:44.814014 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 09:37:44.814014 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 09:37:44.814014 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c197eded81494b818b1e56f4c01432c5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c197eded81494b818b1e56f4c01432c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c197eded81494b818b1e56f4c01432c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c197eded81494b818b1e56f4c01432c5"}]}] Sep 14 09:37:44.814014 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1922438431 Sep 14 09:37:44.814014 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: c197eded81494b818b1e56f4c01432c5 Sep 14 09:37:44.814014 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1922438431 Sep 14 09:37:44.814014 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-TestNetworkAdvancedServerOps-1922438431-project Sep 14 09:37:44.814014 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 09:37:44.814014 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 09:37:44.814014 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 725d7beb4ec54b86a455af0d7bd0ce19 Sep 14 09:37:44.814014 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1922438431-project Sep 14 09:37:44.814014 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 09:37:44.814014 n-d-836830-18 devstack@n-api.service[128758]: exception: Instance 72812065-1001-48aa-be8c-2a5e99351a68 could not be found. Sep 14 09:37:44.814014 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': '72812065-1001-48aa-be8c-2a5e99351a68'} Sep 14 09:37:44.814014 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:37:44.814014 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:37:44.814014 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:37:44.814014 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:37:44.814014 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:37:44.814014 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:37:44.814014 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:37:44.814014 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:37:44.814014 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:37:44.814014 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:37:44.814014 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72812065-1001-48aa-be8c-2a5e99351a68 could not be found. Sep 14 09:37:44.814014 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:37:44.814014 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:37:44.814014 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:37:44.814014 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:37:44.814014 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:37:44.814014 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:37:44.814014 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:37:44.814014 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:37:44.814014 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:37:44.814014 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:37:44.814014 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:37:44.814014 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:37:44.814014 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:37:44.814014 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:37:44.814014 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:37:44.814014 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:37:44.814014 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72812065-1001-48aa-be8c-2a5e99351a68 could not be found. Sep 14 09:37:44.814014 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:37:44.814014 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:37:44.820149 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:37:44.820149 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:37:44.820149 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:37:44.820149 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:37:44.820149 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:37:44.820149 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:37:44.820149 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72812065-1001-48aa-be8c-2a5e99351a68 could not be found. Sep 14 09:37:44.820149 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:37:44.820149 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-0e992577-c488-416e-bc90-3b61798274b7 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Returning 404 to user: Instance 72812065-1001-48aa-be8c-2a5e99351a68 could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:37:44.820149 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-0e992577-c488-416e-bc90-3b61798274b7 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "GET /compute/v2.1/servers/72812065-1001-48aa-be8c-2a5e99351a68" status: 404 len: 111 microversion: 2.1 time: 0.033681 Sep 14 09:37:44.820149 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3324/6623] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:37:44 2022] GET /compute/v2.1/servers/72812065-1001-48aa-be8c-2a5e99351a68 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:37:48.168540 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b59dbdfa-ad42-4960-853d-f55e08a14392 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] Calling method '.version_select at 0x7f7d3ef83af0>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:48.189783 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b59dbdfa-ad42-4960-853d-f55e08a14392 tempest-TestNetworkAdvancedServerOps-1922438431 tempest-TestNetworkAdvancedServerOps-1922438431-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-744396015" status: 202 len: 0 microversion: 2.1 time: 0.026315 Sep 14 09:37:48.190421 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3300/6624] 10.222.0.60 () {58 vars in 1281 bytes} [Wed Sep 14 09:37:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-744396015 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:38:10.519244 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c4ae7f40-d6b4-4290-92bf-456a72463013 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1063316623", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1345910784", "security_groups": [{"name": "tempest-secgroup-smoke-1175246649"}], "block_device_mapping_v2": [{"uuid": "d6611b84-0328-4968-ac30-72a872ec8589", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "70503795-7dfb-4d39-a57e-91e8e5270ce0"}]}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:38:10.530374 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:38:10.531065 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:38:20.544824 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=2 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:39:16.323539 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=10 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:39:16.324714 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:39:16.325722 n-d-836830-18 devstack@n-api.service[128759]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 09:39:16.326133 n-d-836830-18 devstack@n-api.service[128759]: Wed Sep 14 09:39:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ae2c2dd3-d4f0-42a9-b4fa-fc48c4878fda (ip 10.222.0.60) !!! Sep 14 09:39:16.334324 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a255632d-73f1-402f-8178-4e5bf4142d71 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:16.335225 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-a255632d-73f1-402f-8178-4e5bf4142d71 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: ae2c2dd3-d4f0-42a9-b4fa-fc48c4878fda] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:16.346649 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a255632d-73f1-402f-8178-4e5bf4142d71 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:16.347174 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a255632d-73f1-402f-8178-4e5bf4142d71 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:16.348113 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a255632d-73f1-402f-8178-4e5bf4142d71 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:16.348812 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a255632d-73f1-402f-8178-4e5bf4142d71 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:16.349336 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a255632d-73f1-402f-8178-4e5bf4142d71 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:16.349767 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a255632d-73f1-402f-8178-4e5bf4142d71 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:16.377966 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-a255632d-73f1-402f-8178-4e5bf4142d71 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: ae2c2dd3-d4f0-42a9-b4fa-fc48c4878fda] Going to try to terminate instance {{(pid=128759) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:39:16.465765 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a255632d-73f1-402f-8178-4e5bf4142d71 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "DELETE /compute/v2.1/servers/ae2c2dd3-d4f0-42a9-b4fa-fc48c4878fda" status: 204 len: 0 microversion: 2.1 time: 0.144419 Sep 14 09:39:16.470770 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3301/6625] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:39:16 2022] DELETE /compute/v2.1/servers/ae2c2dd3-d4f0-42a9-b4fa-fc48c4878fda => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:39:16.673149 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-cef49434-d226-4d7d-b3b0-2c81afa6dfa4 req-df5c7bdf-17ee-4afd-bb17-c70206101e83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae2c2dd3-d4f0-42a9-b4fa-fc48c4878fda", "tag": "a35c1f88-7ee3-4186-9b41-b4b5e4d6e8a0"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:39:16.682655 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-cef49434-d226-4d7d-b3b0-2c81afa6dfa4 req-df5c7bdf-17ee-4afd-bb17-c70206101e83 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:16.683163 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-cef49434-d226-4d7d-b3b0-2c81afa6dfa4 req-df5c7bdf-17ee-4afd-bb17-c70206101e83 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:16.683607 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-cef49434-d226-4d7d-b3b0-2c81afa6dfa4 req-df5c7bdf-17ee-4afd-bb17-c70206101e83 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:16.695131 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-cef49434-d226-4d7d-b3b0-2c81afa6dfa4 req-df5c7bdf-17ee-4afd-bb17-c70206101e83 service nova] Creating event network-changed:a35c1f88-7ee3-4186-9b41-b4b5e4d6e8a0 for instance ae2c2dd3-d4f0-42a9-b4fa-fc48c4878fda on n-h1-836830-18 Sep 14 09:39:16.700033 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-cef49434-d226-4d7d-b3b0-2c81afa6dfa4 req-df5c7bdf-17ee-4afd-bb17-c70206101e83 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.227790 Sep 14 09:39:16.700635 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3302/6626] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:39:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:39:16.708036 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e7f2192c-62cb-4d0c-9d77-bdea900ea355 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:16.708916 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e7f2192c-62cb-4d0c-9d77-bdea900ea355 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: ae2c2dd3-d4f0-42a9-b4fa-fc48c4878fda] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:16.724857 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e7f2192c-62cb-4d0c-9d77-bdea900ea355 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:16.725503 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e7f2192c-62cb-4d0c-9d77-bdea900ea355 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:16.726053 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e7f2192c-62cb-4d0c-9d77-bdea900ea355 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:16.726889 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e7f2192c-62cb-4d0c-9d77-bdea900ea355 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:16.727489 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e7f2192c-62cb-4d0c-9d77-bdea900ea355 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:16.728152 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e7f2192c-62cb-4d0c-9d77-bdea900ea355 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:17.053699 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-e7f2192c-62cb-4d0c-9d77-bdea900ea355 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:17.062890 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e7f2192c-62cb-4d0c-9d77-bdea900ea355 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/ae2c2dd3-d4f0-42a9-b4fa-fc48c4878fda" status: 200 len: 1575 microversion: 2.1 time: 0.360568 Sep 14 09:39:17.063406 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3303/6627] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:16 2022] GET /compute/v2.1/servers/ae2c2dd3-d4f0-42a9-b4fa-fc48c4878fda => generated 1575 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:39:18.086446 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e44a2086-d6d3-41c7-818c-d338343810bb tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:18.087079 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e44a2086-d6d3-41c7-818c-d338343810bb tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: ae2c2dd3-d4f0-42a9-b4fa-fc48c4878fda] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:18.094133 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e44a2086-d6d3-41c7-818c-d338343810bb tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:18.094823 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e44a2086-d6d3-41c7-818c-d338343810bb tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:18.095304 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e44a2086-d6d3-41c7-818c-d338343810bb tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:18.096000 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e44a2086-d6d3-41c7-818c-d338343810bb tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:18.096466 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e44a2086-d6d3-41c7-818c-d338343810bb tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:18.097632 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e44a2086-d6d3-41c7-818c-d338343810bb tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:18.276853 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-e44a2086-d6d3-41c7-818c-d338343810bb tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:18.285328 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e44a2086-d6d3-41c7-818c-d338343810bb tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/ae2c2dd3-d4f0-42a9-b4fa-fc48c4878fda" status: 200 len: 1575 microversion: 2.1 time: 0.202504 Sep 14 09:39:18.285906 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3304/6628] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:18 2022] GET /compute/v2.1/servers/ae2c2dd3-d4f0-42a9-b4fa-fc48c4878fda => generated 1575 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:39:18.830273 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-4589f965-137d-4d74-a56b-d1e02300a6d7 req-898c1a8b-ddc6-4942-b82e-06dfa1f9759f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae2c2dd3-d4f0-42a9-b4fa-fc48c4878fda", "name": "network-vif-deleted", "tag": "a35c1f88-7ee3-4186-9b41-b4b5e4d6e8a0"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:39:18.842299 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-4589f965-137d-4d74-a56b-d1e02300a6d7 req-898c1a8b-ddc6-4942-b82e-06dfa1f9759f service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:18.842816 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-4589f965-137d-4d74-a56b-d1e02300a6d7 req-898c1a8b-ddc6-4942-b82e-06dfa1f9759f service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:18.843278 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-4589f965-137d-4d74-a56b-d1e02300a6d7 req-898c1a8b-ddc6-4942-b82e-06dfa1f9759f service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:18.860763 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-4589f965-137d-4d74-a56b-d1e02300a6d7 req-898c1a8b-ddc6-4942-b82e-06dfa1f9759f service nova] Creating event network-vif-deleted:a35c1f88-7ee3-4186-9b41-b4b5e4d6e8a0 for instance ae2c2dd3-d4f0-42a9-b4fa-fc48c4878fda on n-h1-836830-18 Sep 14 09:39:18.867390 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-4589f965-137d-4d74-a56b-d1e02300a6d7 req-898c1a8b-ddc6-4942-b82e-06dfa1f9759f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041375 Sep 14 09:39:18.868370 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3305/6629] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:39:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:39:19.310778 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-7c579f63-6781-43a9-8073-7eccb952d16a tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:19.311669 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-7c579f63-6781-43a9-8073-7eccb952d16a tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: ae2c2dd3-d4f0-42a9-b4fa-fc48c4878fda] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:19.318703 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7c579f63-6781-43a9-8073-7eccb952d16a tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:19.319214 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7c579f63-6781-43a9-8073-7eccb952d16a tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:19.319647 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7c579f63-6781-43a9-8073-7eccb952d16a tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:19.320373 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7c579f63-6781-43a9-8073-7eccb952d16a tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:19.320827 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7c579f63-6781-43a9-8073-7eccb952d16a tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:19.321246 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7c579f63-6781-43a9-8073-7eccb952d16a tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:19.398421 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-7c579f63-6781-43a9-8073-7eccb952d16a tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:19.406733 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-7c579f63-6781-43a9-8073-7eccb952d16a tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/ae2c2dd3-d4f0-42a9-b4fa-fc48c4878fda" status: 200 len: 1226 microversion: 2.1 time: 0.100952 Sep 14 09:39:19.407342 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3306/6630] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:19 2022] GET /compute/v2.1/servers/ae2c2dd3-d4f0-42a9-b4fa-fc48c4878fda => generated 1226 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:39:20.430051 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-7a18627c-a090-4f8a-a709-022bf6a86442 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:20.430807 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-7a18627c-a090-4f8a-a709-022bf6a86442 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: ae2c2dd3-d4f0-42a9-b4fa-fc48c4878fda] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:20.437855 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7a18627c-a090-4f8a-a709-022bf6a86442 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:20.438340 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7a18627c-a090-4f8a-a709-022bf6a86442 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:20.438824 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7a18627c-a090-4f8a-a709-022bf6a86442 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:20.439544 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7a18627c-a090-4f8a-a709-022bf6a86442 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:20.439993 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7a18627c-a090-4f8a-a709-022bf6a86442 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:20.440411 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7a18627c-a090-4f8a-a709-022bf6a86442 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:20.522770 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-7a18627c-a090-4f8a-a709-022bf6a86442 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:20.531389 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-7a18627c-a090-4f8a-a709-022bf6a86442 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/ae2c2dd3-d4f0-42a9-b4fa-fc48c4878fda" status: 200 len: 1226 microversion: 2.1 time: 0.105303 Sep 14 09:39:20.532154 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3307/6631] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:20 2022] GET /compute/v2.1/servers/ae2c2dd3-d4f0-42a9-b4fa-fc48c4878fda => generated 1226 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:39:21.561313 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-6c632bde-365a-45be-958d-24494f401ce8 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:21.562651 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-6c632bde-365a-45be-958d-24494f401ce8 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: ae2c2dd3-d4f0-42a9-b4fa-fc48c4878fda] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:21.570415 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6c632bde-365a-45be-958d-24494f401ce8 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:21.571342 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6c632bde-365a-45be-958d-24494f401ce8 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:21.572580 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6c632bde-365a-45be-958d-24494f401ce8 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:21.573454 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6c632bde-365a-45be-958d-24494f401ce8 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:21.574067 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6c632bde-365a-45be-958d-24494f401ce8 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:21.574646 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6c632bde-365a-45be-958d-24494f401ce8 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:21.640955 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-6c632bde-365a-45be-958d-24494f401ce8 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:21.650007 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-6c632bde-365a-45be-958d-24494f401ce8 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/ae2c2dd3-d4f0-42a9-b4fa-fc48c4878fda" status: 200 len: 1226 microversion: 2.1 time: 0.098620 Sep 14 09:39:21.650586 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3308/6632] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:21 2022] GET /compute/v2.1/servers/ae2c2dd3-d4f0-42a9-b4fa-fc48c4878fda => generated 1226 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:39:22.278237 n-d-836830-18 devstack@n-api.service[128758]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 09:39:22.278872 n-d-836830-18 devstack@n-api.service[128758]: Wed Sep 14 09:39:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.60) !!! Sep 14 09:39:22.280368 n-d-836830-18 devstack@n-api.service[128758]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 09:39:22.280645 n-d-836830-18 devstack@n-api.service[128758]: Wed Sep 14 09:39:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.60) !!! Sep 14 09:39:22.673024 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-7b0f3dda-595c-4d67-a3da-8de167570c59 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:22.673595 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-7b0f3dda-595c-4d67-a3da-8de167570c59 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: ae2c2dd3-d4f0-42a9-b4fa-fc48c4878fda] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:22.680432 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7b0f3dda-595c-4d67-a3da-8de167570c59 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:22.680923 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7b0f3dda-595c-4d67-a3da-8de167570c59 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:22.681374 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7b0f3dda-595c-4d67-a3da-8de167570c59 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:22.682069 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7b0f3dda-595c-4d67-a3da-8de167570c59 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:22.682533 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7b0f3dda-595c-4d67-a3da-8de167570c59 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:22.682988 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7b0f3dda-595c-4d67-a3da-8de167570c59 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:22.745414 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-7b0f3dda-595c-4d67-a3da-8de167570c59 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80257054a25540c294e1787780b601b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fca803d9ffa4b4ab0371c0d6a96a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:22.753275 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-7b0f3dda-595c-4d67-a3da-8de167570c59 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/ae2c2dd3-d4f0-42a9-b4fa-fc48c4878fda" status: 200 len: 1226 microversion: 2.1 time: 0.084277 Sep 14 09:39:22.754400 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3309/6633] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:22 2022] GET /compute/v2.1/servers/ae2c2dd3-d4f0-42a9-b4fa-fc48c4878fda => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:39:23.777369 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-5166c1c2-46c8-43a3-b52c-bfb57dbc8215 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:23.777999 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-5166c1c2-46c8-43a3-b52c-bfb57dbc8215 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: ae2c2dd3-d4f0-42a9-b4fa-fc48c4878fda] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:23.786040 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5166c1c2-46c8-43a3-b52c-bfb57dbc8215 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:23.786541 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5166c1c2-46c8-43a3-b52c-bfb57dbc8215 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:23.787013 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5166c1c2-46c8-43a3-b52c-bfb57dbc8215 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:23.787725 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5166c1c2-46c8-43a3-b52c-bfb57dbc8215 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:23.788183 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5166c1c2-46c8-43a3-b52c-bfb57dbc8215 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:23.788612 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5166c1c2-46c8-43a3-b52c-bfb57dbc8215 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:23.802781 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-5166c1c2-46c8-43a3-b52c-bfb57dbc8215 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] HTTP exception thrown: Instance ae2c2dd3-d4f0-42a9-b4fa-fc48c4878fda could not be found. Sep 14 09:39:23.804766 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-5166c1c2-46c8-43a3-b52c-bfb57dbc8215 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Request method failure captured: Sep 14 09:39:23.804766 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/ae2c2dd3-d4f0-42a9-b4fa-fc48c4878fda HTTP/1.1 Sep 14 09:39:23.804766 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:39:23.804766 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:39:23.804766 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:39:23.804766 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:39:23.804766 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:39:23.804766 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:39:23.804766 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:39:23.804766 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:39:23.804766 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZ7vSEasHnu7hRXol9c-LZuMaC9uK137X6F5rG7UmloUJeCaIX1XI8DyW-6MYPzXIn8tJlRUDBfS9Xo7ko5WvlkRtwNLi8r30OmEJBkLllR4uOPeHedowZTMuQPwQppwmIxlx0K05UlAJOyH1eD16mNE7GFFk01jmhPM_9wCZyZUFi8 Sep 14 09:39:23.804766 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:39:23.804766 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:39:23.804766 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:39:23.804766 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:39:23.804766 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:39:23.804766 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:39:23.804766 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 0fca803d9ffa4b4ab0371c0d6a96a5a2 Sep 14 09:39:23.804766 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-TestVolumeBootPattern-1945148622 Sep 14 09:39:23.804766 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:39:23.804766 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:39:23.804766 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0fca803d9ffa4b4ab0371c0d6a96a5a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0fca803d9ffa4b4ab0371c0d6a96a5a2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0fca803d9ffa4b4ab0371c0d6a96a5a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0fca803d9ffa4b4ab0371c0d6a96a5a2"}]}] Sep 14 09:39:23.804766 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-TestVolumeBootPattern-1945148622 Sep 14 09:39:23.804766 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 0fca803d9ffa4b4ab0371c0d6a96a5a2 Sep 14 09:39:23.804766 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-TestVolumeBootPattern-1945148622 Sep 14 09:39:23.804766 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-TestVolumeBootPattern-1945148622-project Sep 14 09:39:23.804766 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:39:23.804766 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:39:23.804766 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 80257054a25540c294e1787780b601b4 Sep 14 09:39:23.804766 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-TestVolumeBootPattern-1945148622-project Sep 14 09:39:23.804766 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:39:23.804766 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance ae2c2dd3-d4f0-42a9-b4fa-fc48c4878fda could not be found. Sep 14 09:39:23.804766 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': 'ae2c2dd3-d4f0-42a9-b4fa-fc48c4878fda'} Sep 14 09:39:23.804766 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:39:23.804766 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:23.804766 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:39:23.804766 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:39:23.804766 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:39:23.804766 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:39:23.804766 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:39:23.804766 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:39:23.804766 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:39:23.804766 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:39:23.804766 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae2c2dd3-d4f0-42a9-b4fa-fc48c4878fda could not be found. Sep 14 09:39:23.804766 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:39:23.804766 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:39:23.804766 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:39:23.804766 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:23.804766 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:39:23.804766 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:39:23.804766 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:39:23.804766 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:39:23.804766 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:39:23.804766 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:39:23.804766 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:39:23.804766 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:39:23.804766 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:39:23.804766 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:39:23.804766 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:39:23.804766 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:39:23.804766 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae2c2dd3-d4f0-42a9-b4fa-fc48c4878fda could not be found. Sep 14 09:39:23.804766 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:39:23.804766 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:39:23.804766 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:39:23.809372 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:23.809372 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:39:23.809372 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:39:23.809372 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:39:23.809372 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:39:23.809372 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae2c2dd3-d4f0-42a9-b4fa-fc48c4878fda could not be found. Sep 14 09:39:23.809372 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:39:23.809372 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-5166c1c2-46c8-43a3-b52c-bfb57dbc8215 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Returning 404 to user: Instance ae2c2dd3-d4f0-42a9-b4fa-fc48c4878fda could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:39:23.809372 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-5166c1c2-46c8-43a3-b52c-bfb57dbc8215 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/ae2c2dd3-d4f0-42a9-b4fa-fc48c4878fda" status: 404 len: 111 microversion: 2.1 time: 0.033455 Sep 14 09:39:23.809996 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3310/6634] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:23 2022] GET /compute/v2.1/servers/ae2c2dd3-d4f0-42a9-b4fa-fc48c4878fda => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 14 09:39:24.273344 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-805504a6-ad3d-4b60-9c72-69770da3a1c6 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:24.273852 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-805504a6-ad3d-4b60-9c72-69770da3a1c6 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: 356742b9-7cbf-42d3-93bf-9ee0f93e872e] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:24.280267 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-805504a6-ad3d-4b60-9c72-69770da3a1c6 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:24.280750 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-805504a6-ad3d-4b60-9c72-69770da3a1c6 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:24.281188 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-805504a6-ad3d-4b60-9c72-69770da3a1c6 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:24.281878 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-805504a6-ad3d-4b60-9c72-69770da3a1c6 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:24.282331 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-805504a6-ad3d-4b60-9c72-69770da3a1c6 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:24.282759 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-805504a6-ad3d-4b60-9c72-69770da3a1c6 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:24.297027 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-805504a6-ad3d-4b60-9c72-69770da3a1c6 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] HTTP exception thrown: Instance 356742b9-7cbf-42d3-93bf-9ee0f93e872e could not be found. Sep 14 09:39:24.298614 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-805504a6-ad3d-4b60-9c72-69770da3a1c6 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Request method failure captured: Sep 14 09:39:24.298614 n-d-836830-18 devstack@n-api.service[128759]: request: DELETE /compute/v2.1/servers/356742b9-7cbf-42d3-93bf-9ee0f93e872e HTTP/1.1 Sep 14 09:39:24.298614 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:39:24.298614 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:39:24.298614 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:39:24.298614 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:39:24.298614 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:39:24.298614 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:39:24.298614 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:39:24.298614 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:39:24.298614 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZ7vSEasHnu7hRXol9c-LZuMaC9uK137X6F5rG7UmloUJeCaIX1XI8DyW-6MYPzXIn8tJlRUDBfS9Xo7ko5WvlkRtwNLi8r30OmEJBkLllR4uOPeHedowZTMuQPwQppwmIxlx0K05UlAJOyH1eD16mNE7GFFk01jmhPM_9wCZyZUFi8 Sep 14 09:39:24.298614 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:39:24.298614 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:39:24.298614 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:39:24.298614 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:39:24.298614 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:39:24.298614 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:39:24.298614 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 0fca803d9ffa4b4ab0371c0d6a96a5a2 Sep 14 09:39:24.298614 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-TestVolumeBootPattern-1945148622 Sep 14 09:39:24.298614 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:39:24.298614 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:39:24.298614 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0fca803d9ffa4b4ab0371c0d6a96a5a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0fca803d9ffa4b4ab0371c0d6a96a5a2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0fca803d9ffa4b4ab0371c0d6a96a5a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0fca803d9ffa4b4ab0371c0d6a96a5a2"}]}] Sep 14 09:39:24.298614 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-TestVolumeBootPattern-1945148622 Sep 14 09:39:24.298614 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 0fca803d9ffa4b4ab0371c0d6a96a5a2 Sep 14 09:39:24.298614 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-TestVolumeBootPattern-1945148622 Sep 14 09:39:24.298614 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-TestVolumeBootPattern-1945148622-project Sep 14 09:39:24.298614 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:39:24.298614 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:39:24.298614 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 80257054a25540c294e1787780b601b4 Sep 14 09:39:24.298614 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-TestVolumeBootPattern-1945148622-project Sep 14 09:39:24.298614 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:39:24.298614 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance 356742b9-7cbf-42d3-93bf-9ee0f93e872e could not be found. Sep 14 09:39:24.298614 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '356742b9-7cbf-42d3-93bf-9ee0f93e872e'} Sep 14 09:39:24.298614 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:39:24.298614 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:24.298614 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:39:24.298614 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:39:24.298614 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:39:24.298614 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:39:24.298614 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:39:24.298614 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:39:24.298614 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:39:24.298614 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:39:24.298614 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 356742b9-7cbf-42d3-93bf-9ee0f93e872e could not be found. Sep 14 09:39:24.298614 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:39:24.298614 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:39:24.298614 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:39:24.298614 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:24.298614 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:39:24.298614 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:39:24.298614 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:39:24.298614 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:39:24.298614 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:39:24.298614 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:39:24.298614 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 09:39:24.298614 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 09:39:24.298614 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 09:39:24.298614 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 09:39:24.298614 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:39:24.298614 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:39:24.298614 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:39:24.298614 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:39:24.303238 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 356742b9-7cbf-42d3-93bf-9ee0f93e872e could not be found. Sep 14 09:39:24.303238 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:39:24.303238 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:39:24.303238 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:39:24.303238 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:24.303238 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:39:24.303238 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:39:24.303238 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:39:24.303238 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:39:24.303238 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 356742b9-7cbf-42d3-93bf-9ee0f93e872e could not be found. Sep 14 09:39:24.303238 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:39:24.303238 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-805504a6-ad3d-4b60-9c72-69770da3a1c6 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Returning 404 to user: Instance 356742b9-7cbf-42d3-93bf-9ee0f93e872e could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:39:24.303238 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-805504a6-ad3d-4b60-9c72-69770da3a1c6 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "DELETE /compute/v2.1/servers/356742b9-7cbf-42d3-93bf-9ee0f93e872e" status: 404 len: 111 microversion: 2.1 time: 0.030648 Sep 14 09:39:24.304360 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3311/6635] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:39:24 2022] DELETE /compute/v2.1/servers/356742b9-7cbf-42d3-93bf-9ee0f93e872e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 14 09:39:24.309035 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f1a5509f-4d13-44a0-944a-b0283b7c16a8 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:24.309653 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f1a5509f-4d13-44a0-944a-b0283b7c16a8 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] [instance: 356742b9-7cbf-42d3-93bf-9ee0f93e872e] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:24.315473 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f1a5509f-4d13-44a0-944a-b0283b7c16a8 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:24.315978 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f1a5509f-4d13-44a0-944a-b0283b7c16a8 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:24.316418 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f1a5509f-4d13-44a0-944a-b0283b7c16a8 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:24.317109 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f1a5509f-4d13-44a0-944a-b0283b7c16a8 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:24.317568 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f1a5509f-4d13-44a0-944a-b0283b7c16a8 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:24.318001 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f1a5509f-4d13-44a0-944a-b0283b7c16a8 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:24.333183 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-f1a5509f-4d13-44a0-944a-b0283b7c16a8 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] HTTP exception thrown: Instance 356742b9-7cbf-42d3-93bf-9ee0f93e872e could not be found. Sep 14 09:39:24.334709 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f1a5509f-4d13-44a0-944a-b0283b7c16a8 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Request method failure captured: Sep 14 09:39:24.334709 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/356742b9-7cbf-42d3-93bf-9ee0f93e872e HTTP/1.1 Sep 14 09:39:24.334709 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:39:24.334709 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:39:24.334709 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:39:24.334709 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:39:24.334709 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:39:24.334709 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:39:24.334709 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:39:24.334709 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:39:24.334709 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIZ7vSEasHnu7hRXol9c-LZuMaC9uK137X6F5rG7UmloUJeCaIX1XI8DyW-6MYPzXIn8tJlRUDBfS9Xo7ko5WvlkRtwNLi8r30OmEJBkLllR4uOPeHedowZTMuQPwQppwmIxlx0K05UlAJOyH1eD16mNE7GFFk01jmhPM_9wCZyZUFi8 Sep 14 09:39:24.334709 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:39:24.334709 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:39:24.334709 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:39:24.334709 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:39:24.334709 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:39:24.334709 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:39:24.334709 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 0fca803d9ffa4b4ab0371c0d6a96a5a2 Sep 14 09:39:24.334709 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-TestVolumeBootPattern-1945148622 Sep 14 09:39:24.334709 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:39:24.334709 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:39:24.334709 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0fca803d9ffa4b4ab0371c0d6a96a5a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0fca803d9ffa4b4ab0371c0d6a96a5a2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0fca803d9ffa4b4ab0371c0d6a96a5a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0fca803d9ffa4b4ab0371c0d6a96a5a2"}]}] Sep 14 09:39:24.334709 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-TestVolumeBootPattern-1945148622 Sep 14 09:39:24.334709 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 0fca803d9ffa4b4ab0371c0d6a96a5a2 Sep 14 09:39:24.334709 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-TestVolumeBootPattern-1945148622 Sep 14 09:39:24.334709 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-TestVolumeBootPattern-1945148622-project Sep 14 09:39:24.334709 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:39:24.334709 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:39:24.334709 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 80257054a25540c294e1787780b601b4 Sep 14 09:39:24.334709 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-TestVolumeBootPattern-1945148622-project Sep 14 09:39:24.334709 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:39:24.334709 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance 356742b9-7cbf-42d3-93bf-9ee0f93e872e could not be found. Sep 14 09:39:24.334709 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '356742b9-7cbf-42d3-93bf-9ee0f93e872e'} Sep 14 09:39:24.334709 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:39:24.334709 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:24.334709 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:39:24.334709 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:39:24.334709 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:39:24.334709 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:39:24.334709 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:39:24.334709 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:39:24.334709 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:39:24.334709 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:39:24.334709 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 356742b9-7cbf-42d3-93bf-9ee0f93e872e could not be found. Sep 14 09:39:24.334709 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:39:24.334709 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:39:24.334709 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:39:24.334709 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:24.334709 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:39:24.334709 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:39:24.334709 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:39:24.334709 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:39:24.334709 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:39:24.334709 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:39:24.334709 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:39:24.334709 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:39:24.334709 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:39:24.334709 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:39:24.334709 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:39:24.334709 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:39:24.334709 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 356742b9-7cbf-42d3-93bf-9ee0f93e872e could not be found. Sep 14 09:39:24.334709 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:39:24.334709 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:39:24.334709 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:39:24.338239 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:24.338239 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:39:24.338239 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:39:24.338239 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:39:24.338239 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:39:24.338239 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 356742b9-7cbf-42d3-93bf-9ee0f93e872e could not be found. Sep 14 09:39:24.338239 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:39:24.338239 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f1a5509f-4d13-44a0-944a-b0283b7c16a8 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Returning 404 to user: Instance 356742b9-7cbf-42d3-93bf-9ee0f93e872e could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:39:24.338239 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f1a5509f-4d13-44a0-944a-b0283b7c16a8 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "GET /compute/v2.1/servers/356742b9-7cbf-42d3-93bf-9ee0f93e872e" status: 404 len: 111 microversion: 2.1 time: 0.031106 Sep 14 09:39:24.338239 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3312/6636] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:24 2022] GET /compute/v2.1/servers/356742b9-7cbf-42d3-93bf-9ee0f93e872e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:39:27.790284 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ba55eed8-84f7-41d7-8265-efbf6afe3111 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Calling method '.version_select at 0x7f7d3eef40d0>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:27.837686 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-ba55eed8-84f7-41d7-8265-efbf6afe3111 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1345910784" status: 202 len: 0 microversion: 2.1 time: 0.051562 Sep 14 09:39:27.838495 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3313/6637] 10.222.0.60 () {58 vars in 1263 bytes} [Wed Sep 14 09:39:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1345910784 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:39:54.757342 n-d-836830-18 devstack@n-api.service[128759]: ERROR oslo.messaging._drivers.impl_rabbit [-] [22ef38d2-af78-43f4-be77-ac372bc70aea] AMQP server on 10.222.0.60:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 14 09:39:54.761342 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-6ab6fa23-7d9c-45fb-8b6f-b287723b8f93 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Action: 'create', calling method: .version_select at 0x7f7d3ecf5d30>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-2040804972", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKPqERY64GSyOGAYkjCePY55rOJHH0GQrJCu7SacdA2wrSNrVxSPKLMmzxPGLeLn/rYMIpZkXutmt21Mqtmi3HNM5HiW/6vfy/djJpEIWVA2P8oRtuvzjYNyRKH7yWLc3A=="}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:39:54.769741 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:39:54.771165 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:39:54.787791 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-6ab6fa23-7d9c-45fb-8b6f-b287723b8f93 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Getting quotas for project a843f5c7c3fc4878adef49ae33ed03d2. Resources: {'key_pairs'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:39:54.792907 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-6ab6fa23-7d9c-45fb-8b6f-b287723b8f93 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Getting quotas for user 4bbfb8c66df642efa94ec5c04dcb0a82 and project a843f5c7c3fc4878adef49ae33ed03d2. Resources: {'key_pairs'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:39:54.817824 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-6ab6fa23-7d9c-45fb-8b6f-b287723b8f93 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.061920 Sep 14 09:39:54.818446 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3314/6638] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Sep 14 09:39:54 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:39:55.810028 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-be9fc966-b1fb-48ef-9dc0-ec11294a01be tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-776007013", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "108ee556-e336-4b29-abc9-8eeb34e7dda3", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-2040804972", "security_groups": [{"name": "tempest-secgroup-smoke-1004985602"}], "networks": [{"uuid": "f2fc2c46-270f-4b56-a3c8-a836a7e5937c"}]}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:39:55.839815 n-d-836830-18 devstack@n-api.service[128759]: INFO oslo.messaging._drivers.impl_rabbit [-] [22ef38d2-af78-43f4-be77-ac372bc70aea] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 47600. Sep 14 09:39:55.925166 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.network.neutron [None req-be9fc966-b1fb-48ef-9dc0-ec11294a01be tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] validate_networks() for [('f2fc2c46-270f-4b56-a3c8-a836a7e5937c', None, None, None, None, None)] {{(pid=128759) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:39:56.292038 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-be9fc966-b1fb-48ef-9dc0-ec11294a01be tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Flavor limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:39:56.292527 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-be9fc966-b1fb-48ef-9dc0-ec11294a01be tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Image limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:39:56.293000 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-be9fc966-b1fb-48ef-9dc0-ec11294a01be tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Flavor pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:39:56.293418 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-be9fc966-b1fb-48ef-9dc0-ec11294a01be tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Image pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:39:56.293839 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-be9fc966-b1fb-48ef-9dc0-ec11294a01be tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:39:56.303343 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-be9fc966-b1fb-48ef-9dc0-ec11294a01be tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:56.303828 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-be9fc966-b1fb-48ef-9dc0-ec11294a01be tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:56.304269 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-be9fc966-b1fb-48ef-9dc0-ec11294a01be tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:56.305001 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-be9fc966-b1fb-48ef-9dc0-ec11294a01be tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:56.305460 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-be9fc966-b1fb-48ef-9dc0-ec11294a01be tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:56.305897 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-be9fc966-b1fb-48ef-9dc0-ec11294a01be tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:56.323088 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-be9fc966-b1fb-48ef-9dc0-ec11294a01be tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Getting quotas for project a843f5c7c3fc4878adef49ae33ed03d2. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:39:56.328467 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-be9fc966-b1fb-48ef-9dc0-ec11294a01be tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Getting quotas for user 4bbfb8c66df642efa94ec5c04dcb0a82 and project a843f5c7c3fc4878adef49ae33ed03d2. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:39:56.386459 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-be9fc966-b1fb-48ef-9dc0-ec11294a01be tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Going to run 1 instances... {{(pid=128759) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:39:56.388618 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-be9fc966-b1fb-48ef-9dc0-ec11294a01be tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] [instance: 4fab3d89-88a9-4405-80c2-0744c2ac4fab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='108ee556-e336-4b29-abc9-8eeb34e7dda3',volume_size=None,volume_type=None)] {{(pid=128759) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:39:56.517879 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-be9fc966-b1fb-48ef-9dc0-ec11294a01be tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.713147 Sep 14 09:39:56.518742 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3315/6639] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 09:39:55 2022] POST /compute/v2.1/servers => generated 406 bytes in 715 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 14 09:39:56.530075 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a3578f23-1e44-46bd-a313-da8d210993ab tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:56.530692 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-a3578f23-1e44-46bd-a313-da8d210993ab tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] [instance: 4fab3d89-88a9-4405-80c2-0744c2ac4fab] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:56.589776 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-a3578f23-1e44-46bd-a313-da8d210993ab tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbfb8c66df642efa94ec5c04dcb0a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a843f5c7c3fc4878adef49ae33ed03d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:56.597560 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a3578f23-1e44-46bd-a313-da8d210993ab tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] 10.222.0.60 "GET /compute/v2.1/servers/4fab3d89-88a9-4405-80c2-0744c2ac4fab" status: 200 len: 1098 microversion: 2.1 time: 0.071676 Sep 14 09:39:56.598633 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3316/6640] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:56 2022] GET /compute/v2.1/servers/4fab3d89-88a9-4405-80c2-0744c2ac4fab => generated 1098 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:39:57.621228 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-7edd72bb-bcd2-4731-907f-0d9ca3e1e924 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:57.621963 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-7edd72bb-bcd2-4731-907f-0d9ca3e1e924 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] [instance: 4fab3d89-88a9-4405-80c2-0744c2ac4fab] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:57.629229 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7edd72bb-bcd2-4731-907f-0d9ca3e1e924 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:57.630360 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7edd72bb-bcd2-4731-907f-0d9ca3e1e924 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:57.630802 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7edd72bb-bcd2-4731-907f-0d9ca3e1e924 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:57.631539 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7edd72bb-bcd2-4731-907f-0d9ca3e1e924 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:57.632002 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7edd72bb-bcd2-4731-907f-0d9ca3e1e924 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:57.632431 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7edd72bb-bcd2-4731-907f-0d9ca3e1e924 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:57.699210 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-7edd72bb-bcd2-4731-907f-0d9ca3e1e924 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbfb8c66df642efa94ec5c04dcb0a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a843f5c7c3fc4878adef49ae33ed03d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:57.707791 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-7edd72bb-bcd2-4731-907f-0d9ca3e1e924 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] 10.222.0.60 "GET /compute/v2.1/servers/4fab3d89-88a9-4405-80c2-0744c2ac4fab" status: 200 len: 1196 microversion: 2.1 time: 0.090718 Sep 14 09:39:57.719019 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3317/6641] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:57 2022] GET /compute/v2.1/servers/4fab3d89-88a9-4405-80c2-0744c2ac4fab => generated 1196 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:39:58.731657 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-6e13989e-62c6-442d-a17a-cee9a7a94fd0 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:58.732323 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-6e13989e-62c6-442d-a17a-cee9a7a94fd0 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] [instance: 4fab3d89-88a9-4405-80c2-0744c2ac4fab] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:58.739629 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6e13989e-62c6-442d-a17a-cee9a7a94fd0 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:58.740133 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6e13989e-62c6-442d-a17a-cee9a7a94fd0 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:58.740576 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6e13989e-62c6-442d-a17a-cee9a7a94fd0 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:58.741427 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6e13989e-62c6-442d-a17a-cee9a7a94fd0 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:58.742351 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6e13989e-62c6-442d-a17a-cee9a7a94fd0 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:58.742791 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6e13989e-62c6-442d-a17a-cee9a7a94fd0 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:58.881892 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-6e13989e-62c6-442d-a17a-cee9a7a94fd0 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbfb8c66df642efa94ec5c04dcb0a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a843f5c7c3fc4878adef49ae33ed03d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:58.890102 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-6e13989e-62c6-442d-a17a-cee9a7a94fd0 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] 10.222.0.60 "GET /compute/v2.1/servers/4fab3d89-88a9-4405-80c2-0744c2ac4fab" status: 200 len: 1282 microversion: 2.1 time: 0.162589 Sep 14 09:39:58.890908 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3318/6642] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:58 2022] GET /compute/v2.1/servers/4fab3d89-88a9-4405-80c2-0744c2ac4fab => generated 1282 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:39:59.228982 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-af96124d-b709-428d-b423-8e0100cd2f5c req-c2e888d8-c23a-4cfe-9449-6dcd1f9c198b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fab3d89-88a9-4405-80c2-0744c2ac4fab", "tag": "7778b51e-1b26-458e-8701-1bf67a501b8d"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:39:59.239646 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-af96124d-b709-428d-b423-8e0100cd2f5c req-c2e888d8-c23a-4cfe-9449-6dcd1f9c198b service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:59.240358 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-af96124d-b709-428d-b423-8e0100cd2f5c req-c2e888d8-c23a-4cfe-9449-6dcd1f9c198b service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:59.240960 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-af96124d-b709-428d-b423-8e0100cd2f5c req-c2e888d8-c23a-4cfe-9449-6dcd1f9c198b service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:59.252563 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-af96124d-b709-428d-b423-8e0100cd2f5c req-c2e888d8-c23a-4cfe-9449-6dcd1f9c198b service nova] Creating event network-changed:7778b51e-1b26-458e-8701-1bf67a501b8d for instance 4fab3d89-88a9-4405-80c2-0744c2ac4fab on n-h2-836830-18 Sep 14 09:39:59.258792 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-af96124d-b709-428d-b423-8e0100cd2f5c req-c2e888d8-c23a-4cfe-9449-6dcd1f9c198b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036011 Sep 14 09:39:59.259625 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3319/6643] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:39:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:39:59.915391 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f360bb3a-2c71-4e5c-aa90-fe02c2f258f9 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:59.916423 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f360bb3a-2c71-4e5c-aa90-fe02c2f258f9 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] [instance: 4fab3d89-88a9-4405-80c2-0744c2ac4fab] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:59.926973 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f360bb3a-2c71-4e5c-aa90-fe02c2f258f9 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:59.927206 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f360bb3a-2c71-4e5c-aa90-fe02c2f258f9 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:59.927652 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f360bb3a-2c71-4e5c-aa90-fe02c2f258f9 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:59.928709 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f360bb3a-2c71-4e5c-aa90-fe02c2f258f9 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:59.928892 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f360bb3a-2c71-4e5c-aa90-fe02c2f258f9 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:59.929322 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f360bb3a-2c71-4e5c-aa90-fe02c2f258f9 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:00.088594 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f360bb3a-2c71-4e5c-aa90-fe02c2f258f9 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbfb8c66df642efa94ec5c04dcb0a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a843f5c7c3fc4878adef49ae33ed03d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:40:00.098715 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f360bb3a-2c71-4e5c-aa90-fe02c2f258f9 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] 10.222.0.60 "GET /compute/v2.1/servers/4fab3d89-88a9-4405-80c2-0744c2ac4fab" status: 200 len: 1282 microversion: 2.1 time: 0.188062 Sep 14 09:40:00.104318 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3320/6644] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:59 2022] GET /compute/v2.1/servers/4fab3d89-88a9-4405-80c2-0744c2ac4fab => generated 1282 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:40:01.126774 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-30779ae9-7371-44e9-9799-92dc5591480d tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:40:01.127468 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-30779ae9-7371-44e9-9799-92dc5591480d tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] [instance: 4fab3d89-88a9-4405-80c2-0744c2ac4fab] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:40:01.134610 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-30779ae9-7371-44e9-9799-92dc5591480d tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:01.135145 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-30779ae9-7371-44e9-9799-92dc5591480d tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:01.135590 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-30779ae9-7371-44e9-9799-92dc5591480d tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:01.136309 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-30779ae9-7371-44e9-9799-92dc5591480d tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:01.136995 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-30779ae9-7371-44e9-9799-92dc5591480d tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:01.137425 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-30779ae9-7371-44e9-9799-92dc5591480d tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:01.272420 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-30779ae9-7371-44e9-9799-92dc5591480d tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbfb8c66df642efa94ec5c04dcb0a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a843f5c7c3fc4878adef49ae33ed03d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:40:01.280416 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-30779ae9-7371-44e9-9799-92dc5591480d tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] 10.222.0.60 "GET /compute/v2.1/servers/4fab3d89-88a9-4405-80c2-0744c2ac4fab" status: 200 len: 1282 microversion: 2.1 time: 0.157679 Sep 14 09:40:01.281169 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3321/6645] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:40:01 2022] GET /compute/v2.1/servers/4fab3d89-88a9-4405-80c2-0744c2ac4fab => generated 1282 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:40:02.304665 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-7b94ecd4-5ef6-498c-991c-c237635db5c2 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:40:02.305388 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-7b94ecd4-5ef6-498c-991c-c237635db5c2 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] [instance: 4fab3d89-88a9-4405-80c2-0744c2ac4fab] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:40:02.312581 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7b94ecd4-5ef6-498c-991c-c237635db5c2 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:02.313109 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7b94ecd4-5ef6-498c-991c-c237635db5c2 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:02.313580 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7b94ecd4-5ef6-498c-991c-c237635db5c2 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:02.314295 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7b94ecd4-5ef6-498c-991c-c237635db5c2 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:02.314759 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7b94ecd4-5ef6-498c-991c-c237635db5c2 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:02.315221 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7b94ecd4-5ef6-498c-991c-c237635db5c2 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:02.462663 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-7b94ecd4-5ef6-498c-991c-c237635db5c2 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbfb8c66df642efa94ec5c04dcb0a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a843f5c7c3fc4878adef49ae33ed03d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:40:02.470840 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-7b94ecd4-5ef6-498c-991c-c237635db5c2 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] 10.222.0.60 "GET /compute/v2.1/servers/4fab3d89-88a9-4405-80c2-0744c2ac4fab" status: 200 len: 1282 microversion: 2.1 time: 0.170542 Sep 14 09:40:02.471515 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3322/6646] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:40:02 2022] GET /compute/v2.1/servers/4fab3d89-88a9-4405-80c2-0744c2ac4fab => generated 1282 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:40:03.494302 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b710e37c-fb43-4b47-9f6b-954ca3242a0a tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:40:03.495712 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b710e37c-fb43-4b47-9f6b-954ca3242a0a tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] [instance: 4fab3d89-88a9-4405-80c2-0744c2ac4fab] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:40:03.502534 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b710e37c-fb43-4b47-9f6b-954ca3242a0a tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:03.503068 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b710e37c-fb43-4b47-9f6b-954ca3242a0a tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:03.503540 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b710e37c-fb43-4b47-9f6b-954ca3242a0a tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:03.504726 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b710e37c-fb43-4b47-9f6b-954ca3242a0a tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:03.505186 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b710e37c-fb43-4b47-9f6b-954ca3242a0a tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:03.505616 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b710e37c-fb43-4b47-9f6b-954ca3242a0a tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:03.639283 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b710e37c-fb43-4b47-9f6b-954ca3242a0a tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbfb8c66df642efa94ec5c04dcb0a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a843f5c7c3fc4878adef49ae33ed03d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:40:03.647370 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b710e37c-fb43-4b47-9f6b-954ca3242a0a tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] 10.222.0.60 "GET /compute/v2.1/servers/4fab3d89-88a9-4405-80c2-0744c2ac4fab" status: 200 len: 1270 microversion: 2.1 time: 0.156955 Sep 14 09:40:03.647950 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3323/6647] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:40:03 2022] GET /compute/v2.1/servers/4fab3d89-88a9-4405-80c2-0744c2ac4fab => generated 1270 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:40:04.669703 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-1707bd35-b302-4dc1-9e50-7d3a8dbd1037 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:40:04.670335 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-1707bd35-b302-4dc1-9e50-7d3a8dbd1037 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] [instance: 4fab3d89-88a9-4405-80c2-0744c2ac4fab] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:40:04.677188 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1707bd35-b302-4dc1-9e50-7d3a8dbd1037 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:04.677672 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1707bd35-b302-4dc1-9e50-7d3a8dbd1037 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:04.678113 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1707bd35-b302-4dc1-9e50-7d3a8dbd1037 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:04.678830 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1707bd35-b302-4dc1-9e50-7d3a8dbd1037 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:04.679329 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1707bd35-b302-4dc1-9e50-7d3a8dbd1037 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:04.679759 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1707bd35-b302-4dc1-9e50-7d3a8dbd1037 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:04.811102 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-1707bd35-b302-4dc1-9e50-7d3a8dbd1037 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbfb8c66df642efa94ec5c04dcb0a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a843f5c7c3fc4878adef49ae33ed03d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:40:04.820837 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-1707bd35-b302-4dc1-9e50-7d3a8dbd1037 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] 10.222.0.60 "GET /compute/v2.1/servers/4fab3d89-88a9-4405-80c2-0744c2ac4fab" status: 200 len: 1270 microversion: 2.1 time: 0.155045 Sep 14 09:40:04.821417 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3324/6648] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:40:04 2022] GET /compute/v2.1/servers/4fab3d89-88a9-4405-80c2-0744c2ac4fab => generated 1270 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:40:05.844468 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-2d27fc0d-6008-4bfd-adde-bdc918022c46 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:40:05.845137 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-2d27fc0d-6008-4bfd-adde-bdc918022c46 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] [instance: 4fab3d89-88a9-4405-80c2-0744c2ac4fab] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:40:05.852545 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2d27fc0d-6008-4bfd-adde-bdc918022c46 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:05.853026 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2d27fc0d-6008-4bfd-adde-bdc918022c46 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:05.853461 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2d27fc0d-6008-4bfd-adde-bdc918022c46 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:05.854138 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2d27fc0d-6008-4bfd-adde-bdc918022c46 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:05.854590 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2d27fc0d-6008-4bfd-adde-bdc918022c46 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:05.855039 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2d27fc0d-6008-4bfd-adde-bdc918022c46 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:05.988879 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-2d27fc0d-6008-4bfd-adde-bdc918022c46 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbfb8c66df642efa94ec5c04dcb0a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a843f5c7c3fc4878adef49ae33ed03d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:40:05.996616 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-2d27fc0d-6008-4bfd-adde-bdc918022c46 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] 10.222.0.60 "GET /compute/v2.1/servers/4fab3d89-88a9-4405-80c2-0744c2ac4fab" status: 200 len: 1270 microversion: 2.1 time: 0.156045 Sep 14 09:40:05.997186 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3325/6649] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:40:05 2022] GET /compute/v2.1/servers/4fab3d89-88a9-4405-80c2-0744c2ac4fab => generated 1270 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:40:07.018717 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-bee4f0fe-fd15-41b1-b1f6-95a6128213e0 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:40:07.019380 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-bee4f0fe-fd15-41b1-b1f6-95a6128213e0 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] [instance: 4fab3d89-88a9-4405-80c2-0744c2ac4fab] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:40:07.021638 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=2 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:40:07.022332 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=12 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:40:07.029255 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bee4f0fe-fd15-41b1-b1f6-95a6128213e0 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:07.029745 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bee4f0fe-fd15-41b1-b1f6-95a6128213e0 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:07.030180 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bee4f0fe-fd15-41b1-b1f6-95a6128213e0 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:07.030867 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bee4f0fe-fd15-41b1-b1f6-95a6128213e0 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:07.031345 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bee4f0fe-fd15-41b1-b1f6-95a6128213e0 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:07.031773 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bee4f0fe-fd15-41b1-b1f6-95a6128213e0 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:07.164696 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-bee4f0fe-fd15-41b1-b1f6-95a6128213e0 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbfb8c66df642efa94ec5c04dcb0a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a843f5c7c3fc4878adef49ae33ed03d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:40:07.172496 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-bee4f0fe-fd15-41b1-b1f6-95a6128213e0 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] 10.222.0.60 "GET /compute/v2.1/servers/4fab3d89-88a9-4405-80c2-0744c2ac4fab" status: 200 len: 1270 microversion: 2.1 time: 0.157583 Sep 14 09:40:07.173011 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3326/6650] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:40:07 2022] GET /compute/v2.1/servers/4fab3d89-88a9-4405-80c2-0744c2ac4fab => generated 1270 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:40:08.196003 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3f835c8f-38af-4df0-8a7b-6fe0944c1709 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:40:08.196729 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-3f835c8f-38af-4df0-8a7b-6fe0944c1709 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] [instance: 4fab3d89-88a9-4405-80c2-0744c2ac4fab] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:40:08.203734 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3f835c8f-38af-4df0-8a7b-6fe0944c1709 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:08.204250 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3f835c8f-38af-4df0-8a7b-6fe0944c1709 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:08.204739 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3f835c8f-38af-4df0-8a7b-6fe0944c1709 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:08.205421 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3f835c8f-38af-4df0-8a7b-6fe0944c1709 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:08.205866 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3f835c8f-38af-4df0-8a7b-6fe0944c1709 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:08.206285 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3f835c8f-38af-4df0-8a7b-6fe0944c1709 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:08.340267 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-3f835c8f-38af-4df0-8a7b-6fe0944c1709 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbfb8c66df642efa94ec5c04dcb0a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a843f5c7c3fc4878adef49ae33ed03d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:40:08.348609 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-3f835c8f-38af-4df0-8a7b-6fe0944c1709 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] 10.222.0.60 "GET /compute/v2.1/servers/4fab3d89-88a9-4405-80c2-0744c2ac4fab" status: 200 len: 1270 microversion: 2.1 time: 0.156043 Sep 14 09:40:08.349180 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3327/6651] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:40:08 2022] GET /compute/v2.1/servers/4fab3d89-88a9-4405-80c2-0744c2ac4fab => generated 1270 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:40:09.371319 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f693d9ff-b1da-407b-844a-1df87d2f71a3 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:40:09.372012 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f693d9ff-b1da-407b-844a-1df87d2f71a3 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] [instance: 4fab3d89-88a9-4405-80c2-0744c2ac4fab] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:40:09.378981 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f693d9ff-b1da-407b-844a-1df87d2f71a3 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:09.379472 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f693d9ff-b1da-407b-844a-1df87d2f71a3 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:09.379933 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f693d9ff-b1da-407b-844a-1df87d2f71a3 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:09.380645 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f693d9ff-b1da-407b-844a-1df87d2f71a3 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:09.381097 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f693d9ff-b1da-407b-844a-1df87d2f71a3 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:09.381522 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f693d9ff-b1da-407b-844a-1df87d2f71a3 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:09.513950 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f693d9ff-b1da-407b-844a-1df87d2f71a3 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbfb8c66df642efa94ec5c04dcb0a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a843f5c7c3fc4878adef49ae33ed03d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:40:09.521630 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f693d9ff-b1da-407b-844a-1df87d2f71a3 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] 10.222.0.60 "GET /compute/v2.1/servers/4fab3d89-88a9-4405-80c2-0744c2ac4fab" status: 200 len: 1270 microversion: 2.1 time: 0.154273 Sep 14 09:40:09.522214 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3328/6652] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:40:09 2022] GET /compute/v2.1/servers/4fab3d89-88a9-4405-80c2-0744c2ac4fab => generated 1270 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:40:10.544580 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ff23ea96-3a52-4410-aef2-388a2ffca6a3 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:40:10.545345 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-ff23ea96-3a52-4410-aef2-388a2ffca6a3 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] [instance: 4fab3d89-88a9-4405-80c2-0744c2ac4fab] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:40:10.552700 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ff23ea96-3a52-4410-aef2-388a2ffca6a3 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:10.553204 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ff23ea96-3a52-4410-aef2-388a2ffca6a3 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:10.553646 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ff23ea96-3a52-4410-aef2-388a2ffca6a3 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:10.554361 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ff23ea96-3a52-4410-aef2-388a2ffca6a3 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:10.554977 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ff23ea96-3a52-4410-aef2-388a2ffca6a3 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:10.555432 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ff23ea96-3a52-4410-aef2-388a2ffca6a3 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:10.691417 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-ff23ea96-3a52-4410-aef2-388a2ffca6a3 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbfb8c66df642efa94ec5c04dcb0a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a843f5c7c3fc4878adef49ae33ed03d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:40:10.699528 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-ff23ea96-3a52-4410-aef2-388a2ffca6a3 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] 10.222.0.60 "GET /compute/v2.1/servers/4fab3d89-88a9-4405-80c2-0744c2ac4fab" status: 200 len: 1270 microversion: 2.1 time: 0.158873 Sep 14 09:40:10.700111 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3329/6653] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:40:10 2022] GET /compute/v2.1/servers/4fab3d89-88a9-4405-80c2-0744c2ac4fab => generated 1270 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:40:11.722880 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b563162f-1b65-4d44-b120-df644e4dbb91 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:40:11.724020 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b563162f-1b65-4d44-b120-df644e4dbb91 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] [instance: 4fab3d89-88a9-4405-80c2-0744c2ac4fab] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:40:11.730834 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b563162f-1b65-4d44-b120-df644e4dbb91 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:11.731342 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b563162f-1b65-4d44-b120-df644e4dbb91 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:11.731774 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b563162f-1b65-4d44-b120-df644e4dbb91 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:11.732458 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b563162f-1b65-4d44-b120-df644e4dbb91 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:11.732910 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b563162f-1b65-4d44-b120-df644e4dbb91 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:11.733338 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b563162f-1b65-4d44-b120-df644e4dbb91 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:11.866998 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b563162f-1b65-4d44-b120-df644e4dbb91 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbfb8c66df642efa94ec5c04dcb0a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a843f5c7c3fc4878adef49ae33ed03d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:40:11.874742 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b563162f-1b65-4d44-b120-df644e4dbb91 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] 10.222.0.60 "GET /compute/v2.1/servers/4fab3d89-88a9-4405-80c2-0744c2ac4fab" status: 200 len: 1270 microversion: 2.1 time: 0.155717 Sep 14 09:40:11.875349 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3330/6654] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:40:11 2022] GET /compute/v2.1/servers/4fab3d89-88a9-4405-80c2-0744c2ac4fab => generated 1270 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:40:12.769029 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-f6f5fcbf-3782-4f25-8ec2-bbcb5278ffbd req-cd8c700a-cd90-4107-ad01-aa532d5f86f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fab3d89-88a9-4405-80c2-0744c2ac4fab", "name": "network-vif-plugged", "status": "completed", "tag": "7778b51e-1b26-458e-8701-1bf67a501b8d"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:40:12.779273 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-f6f5fcbf-3782-4f25-8ec2-bbcb5278ffbd req-cd8c700a-cd90-4107-ad01-aa532d5f86f1 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:12.779755 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-f6f5fcbf-3782-4f25-8ec2-bbcb5278ffbd req-cd8c700a-cd90-4107-ad01-aa532d5f86f1 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:12.780187 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-f6f5fcbf-3782-4f25-8ec2-bbcb5278ffbd req-cd8c700a-cd90-4107-ad01-aa532d5f86f1 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:12.791847 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-f6f5fcbf-3782-4f25-8ec2-bbcb5278ffbd req-cd8c700a-cd90-4107-ad01-aa532d5f86f1 service nova] Creating event network-vif-plugged:7778b51e-1b26-458e-8701-1bf67a501b8d for instance 4fab3d89-88a9-4405-80c2-0744c2ac4fab on n-h2-836830-18 Sep 14 09:40:12.797023 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-f6f5fcbf-3782-4f25-8ec2-bbcb5278ffbd req-cd8c700a-cd90-4107-ad01-aa532d5f86f1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.163543 Sep 14 09:40:12.797619 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3331/6655] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:40:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:40:12.898554 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ac90be5a-d63a-46f1-bc95-44400b538adc tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:40:12.899300 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-ac90be5a-d63a-46f1-bc95-44400b538adc tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] [instance: 4fab3d89-88a9-4405-80c2-0744c2ac4fab] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:40:12.905507 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ac90be5a-d63a-46f1-bc95-44400b538adc tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:12.905995 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ac90be5a-d63a-46f1-bc95-44400b538adc tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:12.906454 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ac90be5a-d63a-46f1-bc95-44400b538adc tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:12.907233 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ac90be5a-d63a-46f1-bc95-44400b538adc tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:12.907691 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ac90be5a-d63a-46f1-bc95-44400b538adc tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:12.908119 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ac90be5a-d63a-46f1-bc95-44400b538adc tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:13.039986 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-ac90be5a-d63a-46f1-bc95-44400b538adc tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbfb8c66df642efa94ec5c04dcb0a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a843f5c7c3fc4878adef49ae33ed03d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:40:13.047717 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-ac90be5a-d63a-46f1-bc95-44400b538adc tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] 10.222.0.60 "GET /compute/v2.1/servers/4fab3d89-88a9-4405-80c2-0744c2ac4fab" status: 200 len: 1270 microversion: 2.1 time: 0.153939 Sep 14 09:40:13.048298 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3332/6656] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:40:12 2022] GET /compute/v2.1/servers/4fab3d89-88a9-4405-80c2-0744c2ac4fab => generated 1270 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:40:14.069834 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d3ae9510-578e-42fa-8305-91cd22a65676 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:40:14.070464 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-d3ae9510-578e-42fa-8305-91cd22a65676 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] [instance: 4fab3d89-88a9-4405-80c2-0744c2ac4fab] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:40:14.077360 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d3ae9510-578e-42fa-8305-91cd22a65676 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:14.077854 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d3ae9510-578e-42fa-8305-91cd22a65676 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:14.078301 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d3ae9510-578e-42fa-8305-91cd22a65676 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:14.079122 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d3ae9510-578e-42fa-8305-91cd22a65676 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:14.079587 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d3ae9510-578e-42fa-8305-91cd22a65676 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:14.080023 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d3ae9510-578e-42fa-8305-91cd22a65676 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:14.214301 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-d3ae9510-578e-42fa-8305-91cd22a65676 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbfb8c66df642efa94ec5c04dcb0a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a843f5c7c3fc4878adef49ae33ed03d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:40:14.222087 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d3ae9510-578e-42fa-8305-91cd22a65676 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] 10.222.0.60 "GET /compute/v2.1/servers/4fab3d89-88a9-4405-80c2-0744c2ac4fab" status: 200 len: 1459 microversion: 2.1 time: 0.156181 Sep 14 09:40:14.222674 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3333/6657] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:40:14 2022] GET /compute/v2.1/servers/4fab3d89-88a9-4405-80c2-0744c2ac4fab => generated 1459 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:40:14.244312 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3a3727f6-18dd-412f-bd4d-d4e0df4fbebc tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:40:14.244927 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-3a3727f6-18dd-412f-bd4d-d4e0df4fbebc tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] [instance: 4fab3d89-88a9-4405-80c2-0744c2ac4fab] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:40:14.250564 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3a3727f6-18dd-412f-bd4d-d4e0df4fbebc tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:14.251088 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3a3727f6-18dd-412f-bd4d-d4e0df4fbebc tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:14.251555 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3a3727f6-18dd-412f-bd4d-d4e0df4fbebc tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:14.252225 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3a3727f6-18dd-412f-bd4d-d4e0df4fbebc tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:14.252684 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3a3727f6-18dd-412f-bd4d-d4e0df4fbebc tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:14.253113 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3a3727f6-18dd-412f-bd4d-d4e0df4fbebc tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:14.271387 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=100 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:40:14.385312 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-3a3727f6-18dd-412f-bd4d-d4e0df4fbebc tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbfb8c66df642efa94ec5c04dcb0a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a843f5c7c3fc4878adef49ae33ed03d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:40:14.393237 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-3a3727f6-18dd-412f-bd4d-d4e0df4fbebc tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] 10.222.0.60 "GET /compute/v2.1/servers/4fab3d89-88a9-4405-80c2-0744c2ac4fab" status: 200 len: 1459 microversion: 2.1 time: 0.152408 Sep 14 09:40:14.393814 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3334/6658] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:40:14 2022] GET /compute/v2.1/servers/4fab3d89-88a9-4405-80c2-0744c2ac4fab => generated 1459 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:40:16.137608 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-cbaed179-7320-4c79-b865-a0b986cfed45 req-d5b98f06-8721-4b90-a547-9797b981e286 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fab3d89-88a9-4405-80c2-0744c2ac4fab", "tag": "7778b51e-1b26-458e-8701-1bf67a501b8d"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:40:16.148380 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-cbaed179-7320-4c79-b865-a0b986cfed45 req-d5b98f06-8721-4b90-a547-9797b981e286 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:16.148991 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-cbaed179-7320-4c79-b865-a0b986cfed45 req-d5b98f06-8721-4b90-a547-9797b981e286 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:16.149601 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-cbaed179-7320-4c79-b865-a0b986cfed45 req-d5b98f06-8721-4b90-a547-9797b981e286 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:16.161145 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-cbaed179-7320-4c79-b865-a0b986cfed45 req-d5b98f06-8721-4b90-a547-9797b981e286 service nova] Creating event network-changed:7778b51e-1b26-458e-8701-1bf67a501b8d for instance 4fab3d89-88a9-4405-80c2-0744c2ac4fab on n-h2-836830-18 Sep 14 09:40:16.166369 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-cbaed179-7320-4c79-b865-a0b986cfed45 req-d5b98f06-8721-4b90-a547-9797b981e286 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106318 Sep 14 09:40:16.167005 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3335/6659] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:40:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:40:17.653493 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-10cf2cc2-6909-4dfd-8c24-978831a7fe61 req-6bc44343-84d5-4487-b1ee-379b6a38bccf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fab3d89-88a9-4405-80c2-0744c2ac4fab", "tag": "7778b51e-1b26-458e-8701-1bf67a501b8d"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:40:17.663394 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-10cf2cc2-6909-4dfd-8c24-978831a7fe61 req-6bc44343-84d5-4487-b1ee-379b6a38bccf service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:17.663877 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-10cf2cc2-6909-4dfd-8c24-978831a7fe61 req-6bc44343-84d5-4487-b1ee-379b6a38bccf service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:17.664309 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-10cf2cc2-6909-4dfd-8c24-978831a7fe61 req-6bc44343-84d5-4487-b1ee-379b6a38bccf service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:17.675896 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-10cf2cc2-6909-4dfd-8c24-978831a7fe61 req-6bc44343-84d5-4487-b1ee-379b6a38bccf service nova] Creating event network-changed:7778b51e-1b26-458e-8701-1bf67a501b8d for instance 4fab3d89-88a9-4405-80c2-0744c2ac4fab on n-h2-836830-18 Sep 14 09:40:17.681216 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-10cf2cc2-6909-4dfd-8c24-978831a7fe61 req-6bc44343-84d5-4487-b1ee-379b6a38bccf service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032963 Sep 14 09:40:17.681799 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3336/6660] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:40:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:40:19.698677 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-c1a947cd-b32f-4147-b29e-1a984f7e5430 req-28fadff9-9439-4237-bb54-169ef2129ba7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fab3d89-88a9-4405-80c2-0744c2ac4fab", "tag": "7778b51e-1b26-458e-8701-1bf67a501b8d"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:40:19.708289 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-c1a947cd-b32f-4147-b29e-1a984f7e5430 req-28fadff9-9439-4237-bb54-169ef2129ba7 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:19.708770 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-c1a947cd-b32f-4147-b29e-1a984f7e5430 req-28fadff9-9439-4237-bb54-169ef2129ba7 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:19.709201 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-c1a947cd-b32f-4147-b29e-1a984f7e5430 req-28fadff9-9439-4237-bb54-169ef2129ba7 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:19.720474 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-c1a947cd-b32f-4147-b29e-1a984f7e5430 req-28fadff9-9439-4237-bb54-169ef2129ba7 service nova] Creating event network-changed:7778b51e-1b26-458e-8701-1bf67a501b8d for instance 4fab3d89-88a9-4405-80c2-0744c2ac4fab on n-h2-836830-18 Sep 14 09:40:19.725980 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-c1a947cd-b32f-4147-b29e-1a984f7e5430 req-28fadff9-9439-4237-bb54-169ef2129ba7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032620 Sep 14 09:40:19.726834 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3337/6661] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:40:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:40:46.968114 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-1890782e-9c24-4df0-8076-fe441cfcc92d tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:40:46.968807 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-1890782e-9c24-4df0-8076-fe441cfcc92d tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] [instance: 4fab3d89-88a9-4405-80c2-0744c2ac4fab] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:40:46.971920 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=4 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:40:46.972740 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=8 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:40:46.979675 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1890782e-9c24-4df0-8076-fe441cfcc92d tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:46.980168 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1890782e-9c24-4df0-8076-fe441cfcc92d tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:46.980612 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1890782e-9c24-4df0-8076-fe441cfcc92d tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:46.981314 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1890782e-9c24-4df0-8076-fe441cfcc92d tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:46.982090 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1890782e-9c24-4df0-8076-fe441cfcc92d tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:46.982528 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1890782e-9c24-4df0-8076-fe441cfcc92d tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:47.009758 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-1890782e-9c24-4df0-8076-fe441cfcc92d tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] [instance: 4fab3d89-88a9-4405-80c2-0744c2ac4fab] Going to try to terminate instance {{(pid=128759) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:40:47.090777 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-1890782e-9c24-4df0-8076-fe441cfcc92d tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] 10.222.0.60 "DELETE /compute/v2.1/servers/4fab3d89-88a9-4405-80c2-0744c2ac4fab" status: 204 len: 0 microversion: 2.1 time: 0.126791 Sep 14 09:40:47.091437 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3338/6662] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:40:46 2022] DELETE /compute/v2.1/servers/4fab3d89-88a9-4405-80c2-0744c2ac4fab => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 14 09:40:47.097511 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-49cc9fd6-e6ac-4cca-9529-f3b2a13a51a3 req-b05104fc-085d-472d-9c77-9305a785c2a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fab3d89-88a9-4405-80c2-0744c2ac4fab", "tag": "7778b51e-1b26-458e-8701-1bf67a501b8d"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:40:47.108187 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-49cc9fd6-e6ac-4cca-9529-f3b2a13a51a3 req-b05104fc-085d-472d-9c77-9305a785c2a2 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:47.108674 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-49cc9fd6-e6ac-4cca-9529-f3b2a13a51a3 req-b05104fc-085d-472d-9c77-9305a785c2a2 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:47.109109 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-49cc9fd6-e6ac-4cca-9529-f3b2a13a51a3 req-b05104fc-085d-472d-9c77-9305a785c2a2 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:47.120250 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-49cc9fd6-e6ac-4cca-9529-f3b2a13a51a3 req-b05104fc-085d-472d-9c77-9305a785c2a2 service nova] Creating event network-changed:7778b51e-1b26-458e-8701-1bf67a501b8d for instance 4fab3d89-88a9-4405-80c2-0744c2ac4fab on n-h2-836830-18 Sep 14 09:40:47.125183 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-49cc9fd6-e6ac-4cca-9529-f3b2a13a51a3 req-b05104fc-085d-472d-9c77-9305a785c2a2 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032433 Sep 14 09:40:47.125801 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3339/6663] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:40:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:40:47.131567 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b0721d81-cda0-499a-a001-c67cf90c1372 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:40:47.132311 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b0721d81-cda0-499a-a001-c67cf90c1372 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] [instance: 4fab3d89-88a9-4405-80c2-0744c2ac4fab] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:40:47.138835 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b0721d81-cda0-499a-a001-c67cf90c1372 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:47.139366 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b0721d81-cda0-499a-a001-c67cf90c1372 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:47.139811 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b0721d81-cda0-499a-a001-c67cf90c1372 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:47.140680 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b0721d81-cda0-499a-a001-c67cf90c1372 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:47.141145 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b0721d81-cda0-499a-a001-c67cf90c1372 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:47.141606 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b0721d81-cda0-499a-a001-c67cf90c1372 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:47.279445 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b0721d81-cda0-499a-a001-c67cf90c1372 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbfb8c66df642efa94ec5c04dcb0a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a843f5c7c3fc4878adef49ae33ed03d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:40:47.288394 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b0721d81-cda0-499a-a001-c67cf90c1372 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] 10.222.0.60 "GET /compute/v2.1/servers/4fab3d89-88a9-4405-80c2-0744c2ac4fab" status: 200 len: 1582 microversion: 2.1 time: 0.161407 Sep 14 09:40:47.288986 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3340/6664] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:40:47 2022] GET /compute/v2.1/servers/4fab3d89-88a9-4405-80c2-0744c2ac4fab => generated 1582 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:40:48.312701 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e1effc04-5e9e-4a6d-8a2a-93090817543d tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:40:48.313498 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e1effc04-5e9e-4a6d-8a2a-93090817543d tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] [instance: 4fab3d89-88a9-4405-80c2-0744c2ac4fab] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:40:48.320726 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e1effc04-5e9e-4a6d-8a2a-93090817543d tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:48.321215 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e1effc04-5e9e-4a6d-8a2a-93090817543d tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:48.321653 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e1effc04-5e9e-4a6d-8a2a-93090817543d tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:48.322409 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e1effc04-5e9e-4a6d-8a2a-93090817543d tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:48.322863 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e1effc04-5e9e-4a6d-8a2a-93090817543d tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:48.323313 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e1effc04-5e9e-4a6d-8a2a-93090817543d tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:48.457571 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-e1effc04-5e9e-4a6d-8a2a-93090817543d tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbfb8c66df642efa94ec5c04dcb0a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a843f5c7c3fc4878adef49ae33ed03d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:40:48.466307 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e1effc04-5e9e-4a6d-8a2a-93090817543d tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] 10.222.0.60 "GET /compute/v2.1/servers/4fab3d89-88a9-4405-80c2-0744c2ac4fab" status: 200 len: 1582 microversion: 2.1 time: 0.157888 Sep 14 09:40:48.466976 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3341/6665] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:40:48 2022] GET /compute/v2.1/servers/4fab3d89-88a9-4405-80c2-0744c2ac4fab => generated 1582 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:40:49.273093 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-22b09843-ce6d-4131-91c6-3ac9937f053a req-52445cb4-ab47-4e5a-8839-b68bae144bc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fab3d89-88a9-4405-80c2-0744c2ac4fab", "name": "network-vif-deleted", "tag": "7778b51e-1b26-458e-8701-1bf67a501b8d"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:40:49.283729 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-22b09843-ce6d-4131-91c6-3ac9937f053a req-52445cb4-ab47-4e5a-8839-b68bae144bc1 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:49.283946 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-22b09843-ce6d-4131-91c6-3ac9937f053a req-52445cb4-ab47-4e5a-8839-b68bae144bc1 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:49.284322 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-22b09843-ce6d-4131-91c6-3ac9937f053a req-52445cb4-ab47-4e5a-8839-b68bae144bc1 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:49.296647 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-22b09843-ce6d-4131-91c6-3ac9937f053a req-52445cb4-ab47-4e5a-8839-b68bae144bc1 service nova] Creating event network-vif-deleted:7778b51e-1b26-458e-8701-1bf67a501b8d for instance 4fab3d89-88a9-4405-80c2-0744c2ac4fab on n-h2-836830-18 Sep 14 09:40:49.302078 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-22b09843-ce6d-4131-91c6-3ac9937f053a req-52445cb4-ab47-4e5a-8839-b68bae144bc1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032121 Sep 14 09:40:49.302673 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3342/6666] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:40:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:40:49.492202 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-750daa65-7e47-4b6e-9643-ab0ccb400d01 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:40:49.492815 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-750daa65-7e47-4b6e-9643-ab0ccb400d01 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] [instance: 4fab3d89-88a9-4405-80c2-0744c2ac4fab] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:40:49.499248 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-750daa65-7e47-4b6e-9643-ab0ccb400d01 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:49.499738 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-750daa65-7e47-4b6e-9643-ab0ccb400d01 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:49.500177 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-750daa65-7e47-4b6e-9643-ab0ccb400d01 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:49.500869 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-750daa65-7e47-4b6e-9643-ab0ccb400d01 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:49.501323 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-750daa65-7e47-4b6e-9643-ab0ccb400d01 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:49.501755 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-750daa65-7e47-4b6e-9643-ab0ccb400d01 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:49.573001 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-750daa65-7e47-4b6e-9643-ab0ccb400d01 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbfb8c66df642efa94ec5c04dcb0a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a843f5c7c3fc4878adef49ae33ed03d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:40:49.581531 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-750daa65-7e47-4b6e-9643-ab0ccb400d01 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] 10.222.0.60 "GET /compute/v2.1/servers/4fab3d89-88a9-4405-80c2-0744c2ac4fab" status: 200 len: 1229 microversion: 2.1 time: 0.094459 Sep 14 09:40:49.582235 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3343/6667] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:40:49 2022] GET /compute/v2.1/servers/4fab3d89-88a9-4405-80c2-0744c2ac4fab => generated 1229 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:40:50.604657 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9d0ff48c-6912-40ac-9376-e908831ba781 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:40:50.605324 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-9d0ff48c-6912-40ac-9376-e908831ba781 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] [instance: 4fab3d89-88a9-4405-80c2-0744c2ac4fab] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:40:50.612339 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9d0ff48c-6912-40ac-9376-e908831ba781 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:50.612899 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9d0ff48c-6912-40ac-9376-e908831ba781 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:50.613405 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9d0ff48c-6912-40ac-9376-e908831ba781 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:50.614653 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9d0ff48c-6912-40ac-9376-e908831ba781 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:50.615200 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9d0ff48c-6912-40ac-9376-e908831ba781 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:50.615698 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9d0ff48c-6912-40ac-9376-e908831ba781 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:50.676302 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-9d0ff48c-6912-40ac-9376-e908831ba781 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbfb8c66df642efa94ec5c04dcb0a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a843f5c7c3fc4878adef49ae33ed03d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:40:50.684563 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-9d0ff48c-6912-40ac-9376-e908831ba781 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] 10.222.0.60 "GET /compute/v2.1/servers/4fab3d89-88a9-4405-80c2-0744c2ac4fab" status: 200 len: 1229 microversion: 2.1 time: 0.083820 Sep 14 09:40:50.685131 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3344/6668] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:40:50 2022] GET /compute/v2.1/servers/4fab3d89-88a9-4405-80c2-0744c2ac4fab => generated 1229 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:40:51.708337 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-aef506b6-f3c5-4d58-9b62-94cda5748b56 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:40:51.708968 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-aef506b6-f3c5-4d58-9b62-94cda5748b56 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] [instance: 4fab3d89-88a9-4405-80c2-0744c2ac4fab] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:40:51.716419 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-aef506b6-f3c5-4d58-9b62-94cda5748b56 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:51.716917 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-aef506b6-f3c5-4d58-9b62-94cda5748b56 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:51.717361 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-aef506b6-f3c5-4d58-9b62-94cda5748b56 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:51.718068 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-aef506b6-f3c5-4d58-9b62-94cda5748b56 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:51.718529 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-aef506b6-f3c5-4d58-9b62-94cda5748b56 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:51.718983 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-aef506b6-f3c5-4d58-9b62-94cda5748b56 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:51.784939 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-aef506b6-f3c5-4d58-9b62-94cda5748b56 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbfb8c66df642efa94ec5c04dcb0a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a843f5c7c3fc4878adef49ae33ed03d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:40:51.793424 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-aef506b6-f3c5-4d58-9b62-94cda5748b56 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] 10.222.0.60 "GET /compute/v2.1/servers/4fab3d89-88a9-4405-80c2-0744c2ac4fab" status: 200 len: 1229 microversion: 2.1 time: 0.089147 Sep 14 09:40:51.794001 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3345/6669] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:40:51 2022] GET /compute/v2.1/servers/4fab3d89-88a9-4405-80c2-0744c2ac4fab => generated 1229 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:40:52.817843 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-90183c5a-d57c-4195-ab36-8714fd4177aa tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:40:52.818473 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-90183c5a-d57c-4195-ab36-8714fd4177aa tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] [instance: 4fab3d89-88a9-4405-80c2-0744c2ac4fab] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:40:52.825909 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-90183c5a-d57c-4195-ab36-8714fd4177aa tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:52.826409 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-90183c5a-d57c-4195-ab36-8714fd4177aa tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:52.826895 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-90183c5a-d57c-4195-ab36-8714fd4177aa tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:52.827605 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-90183c5a-d57c-4195-ab36-8714fd4177aa tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:52.828068 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-90183c5a-d57c-4195-ab36-8714fd4177aa tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:52.828505 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-90183c5a-d57c-4195-ab36-8714fd4177aa tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:52.893815 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-90183c5a-d57c-4195-ab36-8714fd4177aa tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbfb8c66df642efa94ec5c04dcb0a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a843f5c7c3fc4878adef49ae33ed03d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:40:52.901654 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-90183c5a-d57c-4195-ab36-8714fd4177aa tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] 10.222.0.60 "GET /compute/v2.1/servers/4fab3d89-88a9-4405-80c2-0744c2ac4fab" status: 200 len: 1229 microversion: 2.1 time: 0.088477 Sep 14 09:40:52.902437 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3346/6670] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:40:52 2022] GET /compute/v2.1/servers/4fab3d89-88a9-4405-80c2-0744c2ac4fab => generated 1229 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:40:53.924203 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-db4d121a-143d-46ca-af9c-b21dde6aad12 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:40:53.925032 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-db4d121a-143d-46ca-af9c-b21dde6aad12 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] [instance: 4fab3d89-88a9-4405-80c2-0744c2ac4fab] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:40:53.933106 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-db4d121a-143d-46ca-af9c-b21dde6aad12 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:53.933605 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-db4d121a-143d-46ca-af9c-b21dde6aad12 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:53.934055 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-db4d121a-143d-46ca-af9c-b21dde6aad12 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:53.934870 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-db4d121a-143d-46ca-af9c-b21dde6aad12 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:53.935367 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-db4d121a-143d-46ca-af9c-b21dde6aad12 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:53.935917 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-db4d121a-143d-46ca-af9c-b21dde6aad12 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:53.968824 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-db4d121a-143d-46ca-af9c-b21dde6aad12 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:53.969412 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-db4d121a-143d-46ca-af9c-b21dde6aad12 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:53.969932 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-db4d121a-143d-46ca-af9c-b21dde6aad12 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:53.970459 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.objects.instance [None req-db4d121a-143d-46ca-af9c-b21dde6aad12 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Lazy-loading 'fault' on Instance uuid 4fab3d89-88a9-4405-80c2-0744c2ac4fab {{(pid=128759) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:40:54.014674 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-db4d121a-143d-46ca-af9c-b21dde6aad12 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbfb8c66df642efa94ec5c04dcb0a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a843f5c7c3fc4878adef49ae33ed03d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:40:54.022072 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-db4d121a-143d-46ca-af9c-b21dde6aad12 tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] 10.222.0.60 "GET /compute/v2.1/servers/4fab3d89-88a9-4405-80c2-0744c2ac4fab" status: 200 len: 1188 microversion: 2.1 time: 0.101745 Sep 14 09:40:54.022679 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3347/6671] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:40:53 2022] GET /compute/v2.1/servers/4fab3d89-88a9-4405-80c2-0744c2ac4fab => generated 1188 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:40:55.045167 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-1e16345a-cab7-47fb-bfcf-4336bf4b48fe tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:40:55.045815 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-1e16345a-cab7-47fb-bfcf-4336bf4b48fe tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] [instance: 4fab3d89-88a9-4405-80c2-0744c2ac4fab] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:40:55.053061 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1e16345a-cab7-47fb-bfcf-4336bf4b48fe tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:55.053540 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1e16345a-cab7-47fb-bfcf-4336bf4b48fe tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:55.053975 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1e16345a-cab7-47fb-bfcf-4336bf4b48fe tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:55.054658 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1e16345a-cab7-47fb-bfcf-4336bf4b48fe tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:55.055157 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1e16345a-cab7-47fb-bfcf-4336bf4b48fe tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:55.055565 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1e16345a-cab7-47fb-bfcf-4336bf4b48fe tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:55.069471 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-1e16345a-cab7-47fb-bfcf-4336bf4b48fe tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] HTTP exception thrown: Instance 4fab3d89-88a9-4405-80c2-0744c2ac4fab could not be found. Sep 14 09:40:55.071149 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-1e16345a-cab7-47fb-bfcf-4336bf4b48fe tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Request method failure captured: Sep 14 09:40:55.071149 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/4fab3d89-88a9-4405-80c2-0744c2ac4fab HTTP/1.1 Sep 14 09:40:55.071149 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:40:55.071149 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:40:55.071149 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:40:55.071149 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:40:55.071149 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:40:55.071149 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:40:55.071149 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:40:55.071149 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:40:55.071149 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIaDxvDD3LOf-O-0RLU50w2Hvi5mRTHW6onF_Z453h9zercIAcMT7E3xUql36-l5JWVaIdUWmSw1xafkF_PkEN-e1ec8sHtzGxPofeWayta0AC9FcSMWI5wBQqbqRFQ2fD-G398ro8USzuy-_G_foxZySxANfwRkpOUhaNJDre0O9faY Sep 14 09:40:55.071149 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:40:55.071149 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:40:55.071149 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:40:55.071149 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:40:55.071149 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:40:55.071149 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:40:55.071149 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: a843f5c7c3fc4878adef49ae33ed03d2 Sep 14 09:40:55.071149 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-TestVolumeBackupRestore-704981404 Sep 14 09:40:55.071149 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:40:55.071149 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:40:55.071149 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a843f5c7c3fc4878adef49ae33ed03d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a843f5c7c3fc4878adef49ae33ed03d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a843f5c7c3fc4878adef49ae33ed03d2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a843f5c7c3fc4878adef49ae33ed03d2"}]}] Sep 14 09:40:55.071149 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-TestVolumeBackupRestore-704981404 Sep 14 09:40:55.071149 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: a843f5c7c3fc4878adef49ae33ed03d2 Sep 14 09:40:55.071149 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-TestVolumeBackupRestore-704981404 Sep 14 09:40:55.071149 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-TestVolumeBackupRestore-704981404-project Sep 14 09:40:55.071149 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:40:55.071149 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:40:55.071149 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 4bbfb8c66df642efa94ec5c04dcb0a82 Sep 14 09:40:55.071149 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-TestVolumeBackupRestore-704981404-project Sep 14 09:40:55.071149 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:40:55.071149 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance 4fab3d89-88a9-4405-80c2-0744c2ac4fab could not be found. Sep 14 09:40:55.071149 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '4fab3d89-88a9-4405-80c2-0744c2ac4fab'} Sep 14 09:40:55.071149 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:40:55.071149 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:40:55.071149 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:40:55.071149 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:40:55.071149 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:40:55.071149 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:40:55.071149 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:40:55.071149 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:40:55.071149 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:40:55.071149 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:40:55.071149 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4fab3d89-88a9-4405-80c2-0744c2ac4fab could not be found. Sep 14 09:40:55.071149 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:40:55.071149 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:40:55.071149 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:40:55.071149 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:40:55.071149 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:40:55.071149 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:40:55.071149 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:40:55.071149 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:40:55.071149 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:40:55.071149 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:40:55.071149 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:40:55.071149 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:40:55.071149 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:40:55.071149 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:40:55.071149 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:40:55.071149 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:40:55.071149 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4fab3d89-88a9-4405-80c2-0744c2ac4fab could not be found. Sep 14 09:40:55.071149 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:40:55.071149 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:40:55.071149 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:40:55.075521 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:40:55.075521 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:40:55.075521 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:40:55.075521 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:40:55.075521 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:40:55.075521 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4fab3d89-88a9-4405-80c2-0744c2ac4fab could not be found. Sep 14 09:40:55.075521 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:40:55.075521 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-1e16345a-cab7-47fb-bfcf-4336bf4b48fe tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Returning 404 to user: Instance 4fab3d89-88a9-4405-80c2-0744c2ac4fab could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:40:55.075521 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-1e16345a-cab7-47fb-bfcf-4336bf4b48fe tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] 10.222.0.60 "GET /compute/v2.1/servers/4fab3d89-88a9-4405-80c2-0744c2ac4fab" status: 404 len: 111 microversion: 2.1 time: 0.031263 Sep 14 09:40:55.075521 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3348/6672] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:40:55 2022] GET /compute/v2.1/servers/4fab3d89-88a9-4405-80c2-0744c2ac4fab => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 14 09:40:55.235266 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c087f083-a324-4c5f-9bc5-87c43aa2029a tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] Calling method '.version_select at 0x7f7d3fb835e0>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:40:55.256758 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-c087f083-a324-4c5f-9bc5-87c43aa2029a tempest-TestVolumeBackupRestore-704981404 tempest-TestVolumeBackupRestore-704981404-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-2040804972" status: 202 len: 0 microversion: 2.1 time: 0.025299 Sep 14 09:40:55.257657 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3349/6673] 10.222.0.60 () {58 vars in 1269 bytes} [Wed Sep 14 09:40:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-2040804972 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 14 09:41:02.287257 n-d-836830-18 devstack@n-api.service[128758]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 09:41:02.287718 n-d-836830-18 devstack@n-api.service[128758]: Wed Sep 14 09:41:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.60) !!! Sep 14 09:41:18.037507 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:41:18.038350 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:41:18.154039 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d5f63f3d-03eb-41d4-9c0b-d572f3423383 tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-2100583563", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:41:18.207098 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.network.neutron [None req-d5f63f3d-03eb-41d4-9c0b-d572f3423383 tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] validate_networks() for None {{(pid=128759) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:41:18.493059 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-d5f63f3d-03eb-41d4-9c0b-d572f3423383 tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] Flavor limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:41:18.493484 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-d5f63f3d-03eb-41d4-9c0b-d572f3423383 tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] Image limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:41:18.493960 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-d5f63f3d-03eb-41d4-9c0b-d572f3423383 tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] Flavor pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:41:18.494387 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-d5f63f3d-03eb-41d4-9c0b-d572f3423383 tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] Image pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:41:18.494786 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-d5f63f3d-03eb-41d4-9c0b-d572f3423383 tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:41:18.503559 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d5f63f3d-03eb-41d4-9c0b-d572f3423383 tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:18.504040 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d5f63f3d-03eb-41d4-9c0b-d572f3423383 tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:18.505119 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d5f63f3d-03eb-41d4-9c0b-d572f3423383 tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:18.505847 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d5f63f3d-03eb-41d4-9c0b-d572f3423383 tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:18.506301 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d5f63f3d-03eb-41d4-9c0b-d572f3423383 tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:18.506725 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d5f63f3d-03eb-41d4-9c0b-d572f3423383 tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:18.526876 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-d5f63f3d-03eb-41d4-9c0b-d572f3423383 tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] Getting quotas for project d2672183e6844154b54239a75b6f134d. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:41:18.532126 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-d5f63f3d-03eb-41d4-9c0b-d572f3423383 tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] Getting quotas for user aca2cbf4a7b544aaa399c6026827c660 and project d2672183e6844154b54239a75b6f134d. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:41:18.544246 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-d5f63f3d-03eb-41d4-9c0b-d572f3423383 tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] Going to run 1 instances... {{(pid=128759) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:41:18.546501 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-d5f63f3d-03eb-41d4-9c0b-d572f3423383 tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] [instance: b08d0eb4-4d9c-43f5-9262-4a82e12953dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128759) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:41:18.592049 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d5f63f3d-03eb-41d4-9c0b-d572f3423383 tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.557093 Sep 14 09:41:18.592715 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3350/6674] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 09:41:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 558 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 14 09:41:18.605639 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-926c43b3-a9fa-404c-a631-7866b89c4e12 tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:18.606266 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-926c43b3-a9fa-404c-a631-7866b89c4e12 tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] [instance: b08d0eb4-4d9c-43f5-9262-4a82e12953dc] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:18.977248 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-926c43b3-a9fa-404c-a631-7866b89c4e12 tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca2cbf4a7b544aaa399c6026827c660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2672183e6844154b54239a75b6f134d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:41:18.984345 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-926c43b3-a9fa-404c-a631-7866b89c4e12 tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] 10.222.0.60 "GET /compute/v2.1/servers/b08d0eb4-4d9c-43f5-9262-4a82e12953dc" status: 200 len: 1222 microversion: 2.1 time: 0.382461 Sep 14 09:41:18.984926 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3351/6675] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:41:18 2022] GET /compute/v2.1/servers/b08d0eb4-4d9c-43f5-9262-4a82e12953dc => generated 1222 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:41:20.008128 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c968f4a0-b4b2-4463-9d25-5f4346bc985b tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:20.008758 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-c968f4a0-b4b2-4463-9d25-5f4346bc985b tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] [instance: b08d0eb4-4d9c-43f5-9262-4a82e12953dc] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:20.060881 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-c968f4a0-b4b2-4463-9d25-5f4346bc985b tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca2cbf4a7b544aaa399c6026827c660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2672183e6844154b54239a75b6f134d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:41:20.068389 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-c968f4a0-b4b2-4463-9d25-5f4346bc985b tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] 10.222.0.60 "GET /compute/v2.1/servers/b08d0eb4-4d9c-43f5-9262-4a82e12953dc" status: 200 len: 1222 microversion: 2.1 time: 0.064852 Sep 14 09:41:20.068974 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3352/6676] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:41:20 2022] GET /compute/v2.1/servers/b08d0eb4-4d9c-43f5-9262-4a82e12953dc => generated 1222 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:41:21.092099 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-18972110-9177-49e2-8b90-0e92a0fd43ad tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:21.092750 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-18972110-9177-49e2-8b90-0e92a0fd43ad tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] [instance: b08d0eb4-4d9c-43f5-9262-4a82e12953dc] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:21.146661 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-18972110-9177-49e2-8b90-0e92a0fd43ad tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca2cbf4a7b544aaa399c6026827c660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2672183e6844154b54239a75b6f134d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:41:21.155025 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-18972110-9177-49e2-8b90-0e92a0fd43ad tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] 10.222.0.60 "GET /compute/v2.1/servers/b08d0eb4-4d9c-43f5-9262-4a82e12953dc" status: 200 len: 1222 microversion: 2.1 time: 0.066690 Sep 14 09:41:21.155616 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3353/6677] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:41:21 2022] GET /compute/v2.1/servers/b08d0eb4-4d9c-43f5-9262-4a82e12953dc => generated 1222 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:41:22.178596 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-65e26ba2-d851-453a-91ad-38a9daf1d560 tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:22.179281 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-65e26ba2-d851-453a-91ad-38a9daf1d560 tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] [instance: b08d0eb4-4d9c-43f5-9262-4a82e12953dc] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:22.187520 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-65e26ba2-d851-453a-91ad-38a9daf1d560 tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:22.188043 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-65e26ba2-d851-453a-91ad-38a9daf1d560 tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:22.188495 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-65e26ba2-d851-453a-91ad-38a9daf1d560 tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:22.189198 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-65e26ba2-d851-453a-91ad-38a9daf1d560 tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:22.189660 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-65e26ba2-d851-453a-91ad-38a9daf1d560 tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:22.190092 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-65e26ba2-d851-453a-91ad-38a9daf1d560 tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:22.255445 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-65e26ba2-d851-453a-91ad-38a9daf1d560 tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca2cbf4a7b544aaa399c6026827c660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2672183e6844154b54239a75b6f134d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:41:22.264272 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-65e26ba2-d851-453a-91ad-38a9daf1d560 tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] 10.222.0.60 "GET /compute/v2.1/servers/b08d0eb4-4d9c-43f5-9262-4a82e12953dc" status: 200 len: 1226 microversion: 2.1 time: 0.089863 Sep 14 09:41:22.264878 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3354/6678] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:41:22 2022] GET /compute/v2.1/servers/b08d0eb4-4d9c-43f5-9262-4a82e12953dc => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:41:23.287425 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-21d83afa-bcc9-4f35-8b2a-fceaac547ce3 tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:23.288063 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-21d83afa-bcc9-4f35-8b2a-fceaac547ce3 tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] [instance: b08d0eb4-4d9c-43f5-9262-4a82e12953dc] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:23.294871 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-21d83afa-bcc9-4f35-8b2a-fceaac547ce3 tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:23.295405 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-21d83afa-bcc9-4f35-8b2a-fceaac547ce3 tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:23.295851 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-21d83afa-bcc9-4f35-8b2a-fceaac547ce3 tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:23.296551 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-21d83afa-bcc9-4f35-8b2a-fceaac547ce3 tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:23.297017 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-21d83afa-bcc9-4f35-8b2a-fceaac547ce3 tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:23.297451 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-21d83afa-bcc9-4f35-8b2a-fceaac547ce3 tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:23.362555 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-21d83afa-bcc9-4f35-8b2a-fceaac547ce3 tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca2cbf4a7b544aaa399c6026827c660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2672183e6844154b54239a75b6f134d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:41:23.370308 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-21d83afa-bcc9-4f35-8b2a-fceaac547ce3 tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] 10.222.0.60 "GET /compute/v2.1/servers/b08d0eb4-4d9c-43f5-9262-4a82e12953dc" status: 200 len: 1280 microversion: 2.1 time: 0.086800 Sep 14 09:41:23.370884 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3355/6679] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:41:23 2022] GET /compute/v2.1/servers/b08d0eb4-4d9c-43f5-9262-4a82e12953dc => generated 1280 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:41:24.270900 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-6237351a-ca20-477c-93eb-010efa5917ba req-93a4bfe9-4d89-4c86-b768-82e24168a89c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b08d0eb4-4d9c-43f5-9262-4a82e12953dc", "tag": "5add2d39-b945-4c25-9535-e653b72ef72c"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:41:24.281177 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-6237351a-ca20-477c-93eb-010efa5917ba req-93a4bfe9-4d89-4c86-b768-82e24168a89c service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:24.281786 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-6237351a-ca20-477c-93eb-010efa5917ba req-93a4bfe9-4d89-4c86-b768-82e24168a89c service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:24.282295 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-6237351a-ca20-477c-93eb-010efa5917ba req-93a4bfe9-4d89-4c86-b768-82e24168a89c service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:24.294479 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-6237351a-ca20-477c-93eb-010efa5917ba req-93a4bfe9-4d89-4c86-b768-82e24168a89c service nova] Creating event network-changed:5add2d39-b945-4c25-9535-e653b72ef72c for instance b08d0eb4-4d9c-43f5-9262-4a82e12953dc on n-h2-836830-18 Sep 14 09:41:24.299556 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-6237351a-ca20-477c-93eb-010efa5917ba req-93a4bfe9-4d89-4c86-b768-82e24168a89c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032744 Sep 14 09:41:24.300494 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3356/6680] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:41:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:41:24.394455 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-2157b224-e990-4a10-a942-e2fa73693325 tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:24.395205 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-2157b224-e990-4a10-a942-e2fa73693325 tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] [instance: b08d0eb4-4d9c-43f5-9262-4a82e12953dc] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:24.401415 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2157b224-e990-4a10-a942-e2fa73693325 tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:24.401912 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2157b224-e990-4a10-a942-e2fa73693325 tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:24.402358 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2157b224-e990-4a10-a942-e2fa73693325 tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:24.403088 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2157b224-e990-4a10-a942-e2fa73693325 tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:24.403551 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2157b224-e990-4a10-a942-e2fa73693325 tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:24.403984 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2157b224-e990-4a10-a942-e2fa73693325 tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:24.534092 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-2157b224-e990-4a10-a942-e2fa73693325 tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca2cbf4a7b544aaa399c6026827c660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2672183e6844154b54239a75b6f134d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:41:24.542640 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-2157b224-e990-4a10-a942-e2fa73693325 tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] 10.222.0.60 "GET /compute/v2.1/servers/b08d0eb4-4d9c-43f5-9262-4a82e12953dc" status: 200 len: 1322 microversion: 2.1 time: 0.152613 Sep 14 09:41:24.543264 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3357/6681] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:41:24 2022] GET /compute/v2.1/servers/b08d0eb4-4d9c-43f5-9262-4a82e12953dc => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:41:25.566155 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-cc35a9b5-e616-4a82-a78a-5a2cdb3bd856 tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:25.566777 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-cc35a9b5-e616-4a82-a78a-5a2cdb3bd856 tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] [instance: b08d0eb4-4d9c-43f5-9262-4a82e12953dc] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:25.573924 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cc35a9b5-e616-4a82-a78a-5a2cdb3bd856 tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:25.574423 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cc35a9b5-e616-4a82-a78a-5a2cdb3bd856 tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:25.575091 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cc35a9b5-e616-4a82-a78a-5a2cdb3bd856 tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:25.575604 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cc35a9b5-e616-4a82-a78a-5a2cdb3bd856 tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:25.576062 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cc35a9b5-e616-4a82-a78a-5a2cdb3bd856 tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:25.576492 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cc35a9b5-e616-4a82-a78a-5a2cdb3bd856 tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:25.708382 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-cc35a9b5-e616-4a82-a78a-5a2cdb3bd856 tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca2cbf4a7b544aaa399c6026827c660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2672183e6844154b54239a75b6f134d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:41:25.716349 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-cc35a9b5-e616-4a82-a78a-5a2cdb3bd856 tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] 10.222.0.60 "GET /compute/v2.1/servers/b08d0eb4-4d9c-43f5-9262-4a82e12953dc" status: 200 len: 1322 microversion: 2.1 time: 0.154564 Sep 14 09:41:25.716935 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3358/6682] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:41:25 2022] GET /compute/v2.1/servers/b08d0eb4-4d9c-43f5-9262-4a82e12953dc => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:41:26.740318 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3bdea30c-07d1-4ebd-92b1-c6e22ab0edcc tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:26.740964 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-3bdea30c-07d1-4ebd-92b1-c6e22ab0edcc tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] [instance: b08d0eb4-4d9c-43f5-9262-4a82e12953dc] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:26.747355 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3bdea30c-07d1-4ebd-92b1-c6e22ab0edcc tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:26.747837 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3bdea30c-07d1-4ebd-92b1-c6e22ab0edcc tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:26.748308 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3bdea30c-07d1-4ebd-92b1-c6e22ab0edcc tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:26.749053 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3bdea30c-07d1-4ebd-92b1-c6e22ab0edcc tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:26.749516 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3bdea30c-07d1-4ebd-92b1-c6e22ab0edcc tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:26.749935 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3bdea30c-07d1-4ebd-92b1-c6e22ab0edcc tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:26.883861 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-3bdea30c-07d1-4ebd-92b1-c6e22ab0edcc tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca2cbf4a7b544aaa399c6026827c660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2672183e6844154b54239a75b6f134d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:41:26.891533 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-3bdea30c-07d1-4ebd-92b1-c6e22ab0edcc tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] 10.222.0.60 "GET /compute/v2.1/servers/b08d0eb4-4d9c-43f5-9262-4a82e12953dc" status: 200 len: 1322 microversion: 2.1 time: 0.155963 Sep 14 09:41:26.892106 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3359/6683] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:41:26 2022] GET /compute/v2.1/servers/b08d0eb4-4d9c-43f5-9262-4a82e12953dc => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:41:27.914855 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-248b61f6-709d-4baa-8641-898ab3a33e30 tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:27.915502 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-248b61f6-709d-4baa-8641-898ab3a33e30 tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] [instance: b08d0eb4-4d9c-43f5-9262-4a82e12953dc] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:27.922678 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-248b61f6-709d-4baa-8641-898ab3a33e30 tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:27.923197 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-248b61f6-709d-4baa-8641-898ab3a33e30 tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:27.923639 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-248b61f6-709d-4baa-8641-898ab3a33e30 tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:27.924325 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-248b61f6-709d-4baa-8641-898ab3a33e30 tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:27.924780 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-248b61f6-709d-4baa-8641-898ab3a33e30 tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:27.925206 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-248b61f6-709d-4baa-8641-898ab3a33e30 tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:28.050631 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-248b61f6-709d-4baa-8641-898ab3a33e30 tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca2cbf4a7b544aaa399c6026827c660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2672183e6844154b54239a75b6f134d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:41:28.058291 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-248b61f6-709d-4baa-8641-898ab3a33e30 tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] 10.222.0.60 "GET /compute/v2.1/servers/b08d0eb4-4d9c-43f5-9262-4a82e12953dc" status: 200 len: 1322 microversion: 2.1 time: 0.147896 Sep 14 09:41:28.058871 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3360/6684] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:41:27 2022] GET /compute/v2.1/servers/b08d0eb4-4d9c-43f5-9262-4a82e12953dc => generated 1322 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:41:29.081000 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-63c51529-48ac-4d8b-8a4c-8e62fd0f9dac tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:29.081665 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-63c51529-48ac-4d8b-8a4c-8e62fd0f9dac tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] [instance: b08d0eb4-4d9c-43f5-9262-4a82e12953dc] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:29.083844 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=2 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:41:29.090832 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-63c51529-48ac-4d8b-8a4c-8e62fd0f9dac tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:29.091342 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-63c51529-48ac-4d8b-8a4c-8e62fd0f9dac tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:29.091781 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-63c51529-48ac-4d8b-8a4c-8e62fd0f9dac tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:29.092478 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-63c51529-48ac-4d8b-8a4c-8e62fd0f9dac tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:29.092930 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-63c51529-48ac-4d8b-8a4c-8e62fd0f9dac tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:29.093350 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-63c51529-48ac-4d8b-8a4c-8e62fd0f9dac tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:29.235261 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-63c51529-48ac-4d8b-8a4c-8e62fd0f9dac tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca2cbf4a7b544aaa399c6026827c660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2672183e6844154b54239a75b6f134d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:41:29.243622 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-63c51529-48ac-4d8b-8a4c-8e62fd0f9dac tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] 10.222.0.60 "GET /compute/v2.1/servers/b08d0eb4-4d9c-43f5-9262-4a82e12953dc" status: 200 len: 1322 microversion: 2.1 time: 0.166977 Sep 14 09:41:29.244202 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3361/6685] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:41:29 2022] GET /compute/v2.1/servers/b08d0eb4-4d9c-43f5-9262-4a82e12953dc => generated 1322 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:41:30.265833 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-23f19ce5-6095-4696-a8a6-61eafa5df998 tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:30.266467 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-23f19ce5-6095-4696-a8a6-61eafa5df998 tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] [instance: b08d0eb4-4d9c-43f5-9262-4a82e12953dc] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:30.273387 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-23f19ce5-6095-4696-a8a6-61eafa5df998 tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:30.273872 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-23f19ce5-6095-4696-a8a6-61eafa5df998 tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:30.274313 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-23f19ce5-6095-4696-a8a6-61eafa5df998 tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:30.275017 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-23f19ce5-6095-4696-a8a6-61eafa5df998 tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:30.275470 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-23f19ce5-6095-4696-a8a6-61eafa5df998 tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:30.275917 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-23f19ce5-6095-4696-a8a6-61eafa5df998 tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:30.405680 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-23f19ce5-6095-4696-a8a6-61eafa5df998 tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca2cbf4a7b544aaa399c6026827c660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2672183e6844154b54239a75b6f134d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:41:30.413432 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-23f19ce5-6095-4696-a8a6-61eafa5df998 tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] 10.222.0.60 "GET /compute/v2.1/servers/b08d0eb4-4d9c-43f5-9262-4a82e12953dc" status: 200 len: 1322 microversion: 2.1 time: 0.151515 Sep 14 09:41:30.413997 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3362/6686] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:41:30 2022] GET /compute/v2.1/servers/b08d0eb4-4d9c-43f5-9262-4a82e12953dc => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:41:31.064271 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-eee82695-0626-4e4d-b38a-beaa40e95c96 req-6df5f46f-c94a-4e82-ad41-d3486b6a3c3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b08d0eb4-4d9c-43f5-9262-4a82e12953dc", "name": "network-vif-plugged", "status": "completed", "tag": "5add2d39-b945-4c25-9535-e653b72ef72c"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:41:31.075172 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-eee82695-0626-4e4d-b38a-beaa40e95c96 req-6df5f46f-c94a-4e82-ad41-d3486b6a3c3a service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:31.076072 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-eee82695-0626-4e4d-b38a-beaa40e95c96 req-6df5f46f-c94a-4e82-ad41-d3486b6a3c3a service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:31.076794 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-eee82695-0626-4e4d-b38a-beaa40e95c96 req-6df5f46f-c94a-4e82-ad41-d3486b6a3c3a service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:31.089944 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-eee82695-0626-4e4d-b38a-beaa40e95c96 req-6df5f46f-c94a-4e82-ad41-d3486b6a3c3a service nova] Creating event network-vif-plugged:5add2d39-b945-4c25-9535-e653b72ef72c for instance b08d0eb4-4d9c-43f5-9262-4a82e12953dc on n-h2-836830-18 Sep 14 09:41:31.095184 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-eee82695-0626-4e4d-b38a-beaa40e95c96 req-6df5f46f-c94a-4e82-ad41-d3486b6a3c3a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034884 Sep 14 09:41:31.096329 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3363/6687] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:41:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:41:31.434556 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=12 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:41:31.439697 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f652a782-12b3-4cc9-9f19-4defb5ef900a tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:31.440409 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f652a782-12b3-4cc9-9f19-4defb5ef900a tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] [instance: b08d0eb4-4d9c-43f5-9262-4a82e12953dc] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:31.447354 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f652a782-12b3-4cc9-9f19-4defb5ef900a tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:31.447844 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f652a782-12b3-4cc9-9f19-4defb5ef900a tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:31.448292 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f652a782-12b3-4cc9-9f19-4defb5ef900a tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:31.449165 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f652a782-12b3-4cc9-9f19-4defb5ef900a tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:31.449436 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f652a782-12b3-4cc9-9f19-4defb5ef900a tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:31.449861 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f652a782-12b3-4cc9-9f19-4defb5ef900a tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:31.592667 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f652a782-12b3-4cc9-9f19-4defb5ef900a tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca2cbf4a7b544aaa399c6026827c660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2672183e6844154b54239a75b6f134d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:41:31.600737 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f652a782-12b3-4cc9-9f19-4defb5ef900a tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] 10.222.0.60 "GET /compute/v2.1/servers/b08d0eb4-4d9c-43f5-9262-4a82e12953dc" status: 200 len: 1322 microversion: 2.1 time: 0.167161 Sep 14 09:41:31.601315 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3364/6688] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:41:31 2022] GET /compute/v2.1/servers/b08d0eb4-4d9c-43f5-9262-4a82e12953dc => generated 1322 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:41:32.623294 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e8ea2ee9-e209-41a7-a6bf-8ec200ee8ee5 tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:32.623918 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e8ea2ee9-e209-41a7-a6bf-8ec200ee8ee5 tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] [instance: b08d0eb4-4d9c-43f5-9262-4a82e12953dc] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:32.631534 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e8ea2ee9-e209-41a7-a6bf-8ec200ee8ee5 tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:32.632022 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e8ea2ee9-e209-41a7-a6bf-8ec200ee8ee5 tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:32.632463 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e8ea2ee9-e209-41a7-a6bf-8ec200ee8ee5 tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:32.633157 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e8ea2ee9-e209-41a7-a6bf-8ec200ee8ee5 tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:32.633613 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e8ea2ee9-e209-41a7-a6bf-8ec200ee8ee5 tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:32.634043 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e8ea2ee9-e209-41a7-a6bf-8ec200ee8ee5 tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:32.759651 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-e8ea2ee9-e209-41a7-a6bf-8ec200ee8ee5 tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca2cbf4a7b544aaa399c6026827c660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2672183e6844154b54239a75b6f134d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:41:32.767417 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e8ea2ee9-e209-41a7-a6bf-8ec200ee8ee5 tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] 10.222.0.60 "GET /compute/v2.1/servers/b08d0eb4-4d9c-43f5-9262-4a82e12953dc" status: 200 len: 1472 microversion: 2.1 time: 0.147918 Sep 14 09:41:32.768000 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3365/6689] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:41:32 2022] GET /compute/v2.1/servers/b08d0eb4-4d9c-43f5-9262-4a82e12953dc => generated 1472 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:41:32.840374 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-1d5c3f71-2984-4ba0-8f0c-5654c083f24b tempest-ServersAdminNegativeTestJSON-951075478 tempest-ServersAdminNegativeTestJSON-951075478-project-admin] Calling method '.version_select at 0x7f7d3ed384c0>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:32.905342 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-1d5c3f71-2984-4ba0-8f0c-5654c083f24b tempest-ServersAdminNegativeTestJSON-951075478 tempest-ServersAdminNegativeTestJSON-951075478-project-admin] 10.222.0.60 "GET /compute/v2.1/os-quota-sets/081973a28d1a41bd8d32a83daa414885" status: 200 len: 371 microversion: 2.1 time: 0.117376 Sep 14 09:41:32.905918 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3366/6690] 10.222.0.60 () {58 vars in 1242 bytes} [Wed Sep 14 09:41:32 2022] GET /compute/v2.1/os-quota-sets/081973a28d1a41bd8d32a83daa414885 => generated 371 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:41:32.917732 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d521e227-6fbc-4789-a5dc-c0df49558e9e tempest-ServersAdminNegativeTestJSON-951075478 tempest-ServersAdminNegativeTestJSON-951075478-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-414097445", "id": 221163952, "os-flavor-access:is_public": "True"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:41:32.938394 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d521e227-6fbc-4789-a5dc-c0df49558e9e tempest-ServersAdminNegativeTestJSON-951075478 tempest-ServersAdminNegativeTestJSON-951075478-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 434 microversion: 2.1 time: 0.024044 Sep 14 09:41:32.938987 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3367/6691] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 09:41:32 2022] POST /compute/v2.1/flavors => generated 434 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:41:32.950629 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-4959a724-12ee-49fc-b8da-89a67e91a1ca tempest-ServersAdminNegativeTestJSON-951075478 tempest-ServersAdminNegativeTestJSON-951075478-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "221163952"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:41:32.953050 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-4959a724-12ee-49fc-b8da-89a67e91a1ca tempest-ServersAdminNegativeTestJSON-951075478 tempest-ServersAdminNegativeTestJSON-951075478-project-admin] [instance: b08d0eb4-4d9c-43f5-9262-4a82e12953dc] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:32.958764 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4959a724-12ee-49fc-b8da-89a67e91a1ca tempest-ServersAdminNegativeTestJSON-951075478 tempest-ServersAdminNegativeTestJSON-951075478-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:32.959337 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4959a724-12ee-49fc-b8da-89a67e91a1ca tempest-ServersAdminNegativeTestJSON-951075478 tempest-ServersAdminNegativeTestJSON-951075478-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:32.959719 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4959a724-12ee-49fc-b8da-89a67e91a1ca tempest-ServersAdminNegativeTestJSON-951075478 tempest-ServersAdminNegativeTestJSON-951075478-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:32.960401 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4959a724-12ee-49fc-b8da-89a67e91a1ca tempest-ServersAdminNegativeTestJSON-951075478 tempest-ServersAdminNegativeTestJSON-951075478-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:32.960852 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4959a724-12ee-49fc-b8da-89a67e91a1ca tempest-ServersAdminNegativeTestJSON-951075478 tempest-ServersAdminNegativeTestJSON-951075478-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:32.961274 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4959a724-12ee-49fc-b8da-89a67e91a1ca tempest-ServersAdminNegativeTestJSON-951075478 tempest-ServersAdminNegativeTestJSON-951075478-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:33.405657 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-4959a724-12ee-49fc-b8da-89a67e91a1ca tempest-ServersAdminNegativeTestJSON-951075478 tempest-ServersAdminNegativeTestJSON-951075478-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'a028cdd499234e038dc20d761296c56e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081973a28d1a41bd8d32a83daa414885', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:41:33.412363 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-4959a724-12ee-49fc-b8da-89a67e91a1ca tempest-ServersAdminNegativeTestJSON-951075478 tempest-ServersAdminNegativeTestJSON-951075478-project-admin] [instance: b08d0eb4-4d9c-43f5-9262-4a82e12953dc] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-414097445 {{(pid=128759) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 14 09:41:33.419651 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4959a724-12ee-49fc-b8da-89a67e91a1ca tempest-ServersAdminNegativeTestJSON-951075478 tempest-ServersAdminNegativeTestJSON-951075478-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:33.420048 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4959a724-12ee-49fc-b8da-89a67e91a1ca tempest-ServersAdminNegativeTestJSON-951075478 tempest-ServersAdminNegativeTestJSON-951075478-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:33.420592 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4959a724-12ee-49fc-b8da-89a67e91a1ca tempest-ServersAdminNegativeTestJSON-951075478 tempest-ServersAdminNegativeTestJSON-951075478-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:33.421614 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4959a724-12ee-49fc-b8da-89a67e91a1ca tempest-ServersAdminNegativeTestJSON-951075478 tempest-ServersAdminNegativeTestJSON-951075478-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:33.422110 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4959a724-12ee-49fc-b8da-89a67e91a1ca tempest-ServersAdminNegativeTestJSON-951075478 tempest-ServersAdminNegativeTestJSON-951075478-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:33.422584 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4959a724-12ee-49fc-b8da-89a67e91a1ca tempest-ServersAdminNegativeTestJSON-951075478 tempest-ServersAdminNegativeTestJSON-951075478-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:33.444130 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-4959a724-12ee-49fc-b8da-89a67e91a1ca tempest-ServersAdminNegativeTestJSON-951075478 tempest-ServersAdminNegativeTestJSON-951075478-project-admin] Getting quotas for project d2672183e6844154b54239a75b6f134d. Resources: {'cores', 'ram'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:41:33.449108 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-4959a724-12ee-49fc-b8da-89a67e91a1ca tempest-ServersAdminNegativeTestJSON-951075478 tempest-ServersAdminNegativeTestJSON-951075478-project-admin] Getting quotas for user aca2cbf4a7b544aaa399c6026827c660 and project d2672183e6844154b54239a75b6f134d. Resources: {'cores', 'ram'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:41:33.461520 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.compute.api [None req-4959a724-12ee-49fc-b8da-89a67e91a1ca tempest-ServersAdminNegativeTestJSON-951075478 tempest-ServersAdminNegativeTestJSON-951075478-project-admin] ram quota exceeded for 081973a28d1a41bd8d32a83daa414885, tried to resize instance. Sep 14 09:41:33.462313 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-4959a724-12ee-49fc-b8da-89a67e91a1ca tempest-ServersAdminNegativeTestJSON-951075478 tempest-ServersAdminNegativeTestJSON-951075478-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Sep 14 09:41:33.464400 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-4959a724-12ee-49fc-b8da-89a67e91a1ca tempest-ServersAdminNegativeTestJSON-951075478 tempest-ServersAdminNegativeTestJSON-951075478-project-admin] Request method failure captured: Sep 14 09:41:33.464400 n-d-836830-18 devstack@n-api.service[128759]: request: POST /compute/v2.1/servers/b08d0eb4-4d9c-43f5-9262-4a82e12953dc/action HTTP/1.1 Sep 14 09:41:33.464400 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:41:33.464400 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:41:33.464400 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:41:33.464400 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 38 Sep 14 09:41:33.464400 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:41:33.464400 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:41:33.464400 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:41:33.464400 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:41:33.464400 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIaG9RXoLYM6Y63wRWZ1wbEJxUl9bocututyeWKJJsI9S_kHaAn_H3NkfCCrJho3JS1agnEMSWeTwcbhU6QOvOKevmwgy87Rx0xOeGPeaoioRFVQqJ8oN_qv5NnMyiLO1qfwKLsOi1rafHigzBIi0IxAqm7ocT9FWP5APhQFmQK43u4I Sep 14 09:41:33.464400 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:41:33.464400 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:41:33.464400 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:41:33.464400 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:41:33.464400 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:41:33.464400 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:41:33.464400 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 081973a28d1a41bd8d32a83daa414885 Sep 14 09:41:33.464400 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-951075478 Sep 14 09:41:33.464400 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member,admin Sep 14 09:41:33.464400 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member,admin Sep 14 09:41:33.464400 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/081973a28d1a41bd8d32a83daa414885"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_081973a28d1a41bd8d32a83daa414885"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/081973a28d1a41bd8d32a83daa414885"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/081973a28d1a41bd8d32a83daa414885"}]}] Sep 14 09:41:33.464400 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ServersAdminNegativeTestJSON-951075478 Sep 14 09:41:33.464400 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 081973a28d1a41bd8d32a83daa414885 Sep 14 09:41:33.464400 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-951075478 Sep 14 09:41:33.464400 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ServersAdminNegativeTestJSON-951075478-project-admin Sep 14 09:41:33.464400 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:41:33.464400 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:41:33.464400 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: a028cdd499234e038dc20d761296c56e Sep 14 09:41:33.464400 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ServersAdminNegativeTestJSON-951075478-project-admin Sep 14 09:41:33.464400 n-d-836830-18 devstack@n-api.service[128759]: Sep 14 09:41:33.464400 n-d-836830-18 devstack@n-api.service[128759]: {"resize": {"flavorRef": "221163952"}} Sep 14 09:41:33.464400 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:41:33.464400 n-d-836830-18 devstack@n-api.service[128759]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Sep 14 09:41:33.464400 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': 'b08d0eb4-4d9c-43f5-9262-4a82e12953dc', 'body': {'resize': {'flavorRef': '221163952'}}} Sep 14 09:41:33.464400 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:41:33.464400 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:41:33.464400 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Sep 14 09:41:33.464400 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Sep 14 09:41:33.464400 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 14 09:41:33.464400 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 14 09:41:33.464400 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Sep 14 09:41:33.464400 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc Sep 14 09:41:33.464400 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Sep 14 09:41:33.464400 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Sep 14 09:41:33.464400 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 14 09:41:33.464400 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 14 09:41:33.464400 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Sep 14 09:41:33.464400 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Sep 14 09:41:33.464400 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Sep 14 09:41:33.464400 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Sep 14 09:41:33.464400 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Sep 14 09:41:33.464400 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Sep 14 09:41:33.464400 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Sep 14 09:41:33.464400 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:41:33.464400 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:41:33.464400 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:41:33.464400 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:41:33.464400 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Sep 14 09:41:33.464400 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Sep 14 09:41:33.464400 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 14 09:41:33.464400 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 14 09:41:33.464400 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 14 09:41:33.468823 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 14 09:41:33.468823 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 14 09:41:33.468823 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 14 09:41:33.468823 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 14 09:41:33.468823 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 14 09:41:33.468823 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 14 09:41:33.468823 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 14 09:41:33.468823 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 14 09:41:33.468823 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 14 09:41:33.468823 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Sep 14 09:41:33.468823 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Sep 14 09:41:33.468823 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Sep 14 09:41:33.468823 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Sep 14 09:41:33.468823 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Sep 14 09:41:33.468823 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:41:33.468823 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:41:33.468823 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:41:33.468823 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:41:33.468823 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:41:33.468823 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:41:33.468823 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:41:33.468823 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:41:33.468823 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:41:33.468823 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:41:33.468823 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:41:33.468823 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:41:33.468823 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Sep 14 09:41:33.468823 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Sep 14 09:41:33.468823 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Sep 14 09:41:33.468823 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 14 09:41:33.468823 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Sep 14 09:41:33.468823 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:41:33.468823 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:41:33.468823 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:41:33.468823 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:41:33.468823 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:41:33.468823 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:41:33.468823 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:41:33.468823 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:41:33.468823 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Sep 14 09:41:33.468823 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:41:33.468823 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-4959a724-12ee-49fc-b8da-89a67e91a1ca tempest-ServersAdminNegativeTestJSON-951075478 tempest-ServersAdminNegativeTestJSON-951075478-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:41:33.468823 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-4959a724-12ee-49fc-b8da-89a67e91a1ca tempest-ServersAdminNegativeTestJSON-951075478 tempest-ServersAdminNegativeTestJSON-951075478-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/b08d0eb4-4d9c-43f5-9262-4a82e12953dc/action" status: 403 len: 118 microversion: 2.1 time: 0.518729 Sep 14 09:41:33.468823 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3368/6692] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:41:32 2022] POST /compute/v2.1/servers/b08d0eb4-4d9c-43f5-9262-4a82e12953dc/action => generated 118 bytes in 520 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Sep 14 09:41:33.474949 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-6b18277e-784d-4658-afc5-bc3aabcb063c tempest-ServersAdminNegativeTestJSON-951075478 tempest-ServersAdminNegativeTestJSON-951075478-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:33.491771 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-6b18277e-784d-4658-afc5-bc3aabcb063c tempest-ServersAdminNegativeTestJSON-951075478 tempest-ServersAdminNegativeTestJSON-951075478-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/221163952" status: 202 len: 0 microversion: 2.1 time: 0.020909 Sep 14 09:41:33.492330 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3369/6693] 10.222.0.60 () {58 vars in 1158 bytes} [Wed Sep 14 09:41:33 2022] DELETE /compute/v2.1/flavors/221163952 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 14 09:41:33.499735 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-868eea8d-0192-4e42-918d-bba738b4800b tempest-ServersAdminNegativeTestJSON-951075478 tempest-ServersAdminNegativeTestJSON-951075478-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:33.518719 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-868eea8d-0192-4e42-918d-bba738b4800b tempest-ServersAdminNegativeTestJSON-951075478 tempest-ServersAdminNegativeTestJSON-951075478-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.022350 Sep 14 09:41:33.519283 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3370/6694] 10.222.0.60 () {58 vars in 1146 bytes} [Wed Sep 14 09:41:33 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:41:33.540319 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-1765edf2-01cb-4609-910e-66b8d3bec588 tempest-ServersAdminNegativeTestJSON-951075478 tempest-ServersAdminNegativeTestJSON-951075478-project-admin] Calling method '.version_select at 0x7f7d3eccbca0>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:33.614125 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-1765edf2-01cb-4609-910e-66b8d3bec588 tempest-ServersAdminNegativeTestJSON-951075478 tempest-ServersAdminNegativeTestJSON-951075478-project-admin] 10.222.0.60 "GET /compute/v2.1/os-quota-sets/081973a28d1a41bd8d32a83daa414885" status: 200 len: 371 microversion: 2.1 time: 0.077097 Sep 14 09:41:33.614699 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3371/6695] 10.222.0.60 () {58 vars in 1242 bytes} [Wed Sep 14 09:41:33 2022] GET /compute/v2.1/os-quota-sets/081973a28d1a41bd8d32a83daa414885 => generated 371 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:41:33.625975 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3538ad7e-4c61-477f-88a9-48d0d52d8688 tempest-ServersAdminNegativeTestJSON-951075478 tempest-ServersAdminNegativeTestJSON-951075478-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1204164118", "id": 210640072, "os-flavor-access:is_public": "True"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:41:33.644390 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-3538ad7e-4c61-477f-88a9-48d0d52d8688 tempest-ServersAdminNegativeTestJSON-951075478 tempest-ServersAdminNegativeTestJSON-951075478-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 434 microversion: 2.1 time: 0.021803 Sep 14 09:41:33.649930 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3372/6696] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 09:41:33 2022] POST /compute/v2.1/flavors => generated 434 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:41:33.657733 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c37a1a35-45be-49ba-a5f6-e3fca858d738 tempest-ServersAdminNegativeTestJSON-951075478 tempest-ServersAdminNegativeTestJSON-951075478-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "210640072"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:41:33.659980 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-c37a1a35-45be-49ba-a5f6-e3fca858d738 tempest-ServersAdminNegativeTestJSON-951075478 tempest-ServersAdminNegativeTestJSON-951075478-project-admin] [instance: b08d0eb4-4d9c-43f5-9262-4a82e12953dc] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:33.666643 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c37a1a35-45be-49ba-a5f6-e3fca858d738 tempest-ServersAdminNegativeTestJSON-951075478 tempest-ServersAdminNegativeTestJSON-951075478-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:33.667174 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c37a1a35-45be-49ba-a5f6-e3fca858d738 tempest-ServersAdminNegativeTestJSON-951075478 tempest-ServersAdminNegativeTestJSON-951075478-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:33.667606 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c37a1a35-45be-49ba-a5f6-e3fca858d738 tempest-ServersAdminNegativeTestJSON-951075478 tempest-ServersAdminNegativeTestJSON-951075478-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:33.668292 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c37a1a35-45be-49ba-a5f6-e3fca858d738 tempest-ServersAdminNegativeTestJSON-951075478 tempest-ServersAdminNegativeTestJSON-951075478-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:33.668746 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c37a1a35-45be-49ba-a5f6-e3fca858d738 tempest-ServersAdminNegativeTestJSON-951075478 tempest-ServersAdminNegativeTestJSON-951075478-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:33.669167 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c37a1a35-45be-49ba-a5f6-e3fca858d738 tempest-ServersAdminNegativeTestJSON-951075478 tempest-ServersAdminNegativeTestJSON-951075478-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:33.695756 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-c37a1a35-45be-49ba-a5f6-e3fca858d738 tempest-ServersAdminNegativeTestJSON-951075478 tempest-ServersAdminNegativeTestJSON-951075478-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'a028cdd499234e038dc20d761296c56e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081973a28d1a41bd8d32a83daa414885', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:41:33.700929 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-c37a1a35-45be-49ba-a5f6-e3fca858d738 tempest-ServersAdminNegativeTestJSON-951075478 tempest-ServersAdminNegativeTestJSON-951075478-project-admin] [instance: b08d0eb4-4d9c-43f5-9262-4a82e12953dc] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1204164118 {{(pid=128759) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 14 09:41:33.707734 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c37a1a35-45be-49ba-a5f6-e3fca858d738 tempest-ServersAdminNegativeTestJSON-951075478 tempest-ServersAdminNegativeTestJSON-951075478-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:33.708199 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c37a1a35-45be-49ba-a5f6-e3fca858d738 tempest-ServersAdminNegativeTestJSON-951075478 tempest-ServersAdminNegativeTestJSON-951075478-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:33.708625 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c37a1a35-45be-49ba-a5f6-e3fca858d738 tempest-ServersAdminNegativeTestJSON-951075478 tempest-ServersAdminNegativeTestJSON-951075478-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:33.709328 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c37a1a35-45be-49ba-a5f6-e3fca858d738 tempest-ServersAdminNegativeTestJSON-951075478 tempest-ServersAdminNegativeTestJSON-951075478-project-admin] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:33.709776 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c37a1a35-45be-49ba-a5f6-e3fca858d738 tempest-ServersAdminNegativeTestJSON-951075478 tempest-ServersAdminNegativeTestJSON-951075478-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:33.710188 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c37a1a35-45be-49ba-a5f6-e3fca858d738 tempest-ServersAdminNegativeTestJSON-951075478 tempest-ServersAdminNegativeTestJSON-951075478-project-admin] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:33.731212 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-c37a1a35-45be-49ba-a5f6-e3fca858d738 tempest-ServersAdminNegativeTestJSON-951075478 tempest-ServersAdminNegativeTestJSON-951075478-project-admin] Getting quotas for project d2672183e6844154b54239a75b6f134d. Resources: {'cores', 'ram'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:41:33.736180 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-c37a1a35-45be-49ba-a5f6-e3fca858d738 tempest-ServersAdminNegativeTestJSON-951075478 tempest-ServersAdminNegativeTestJSON-951075478-project-admin] Getting quotas for user aca2cbf4a7b544aaa399c6026827c660 and project d2672183e6844154b54239a75b6f134d. Resources: {'cores', 'ram'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:41:33.745674 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=5,nova_api:DELETE=3 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:41:33.749660 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.compute.api [None req-c37a1a35-45be-49ba-a5f6-e3fca858d738 tempest-ServersAdminNegativeTestJSON-951075478 tempest-ServersAdminNegativeTestJSON-951075478-project-admin] cores quota exceeded for 081973a28d1a41bd8d32a83daa414885, tried to resize instance. Sep 14 09:41:33.750204 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-c37a1a35-45be-49ba-a5f6-e3fca858d738 tempest-ServersAdminNegativeTestJSON-951075478 tempest-ServersAdminNegativeTestJSON-951075478-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Sep 14 09:41:33.752208 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c37a1a35-45be-49ba-a5f6-e3fca858d738 tempest-ServersAdminNegativeTestJSON-951075478 tempest-ServersAdminNegativeTestJSON-951075478-project-admin] Request method failure captured: Sep 14 09:41:33.752208 n-d-836830-18 devstack@n-api.service[128759]: request: POST /compute/v2.1/servers/b08d0eb4-4d9c-43f5-9262-4a82e12953dc/action HTTP/1.1 Sep 14 09:41:33.752208 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:41:33.752208 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:41:33.752208 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:41:33.752208 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 38 Sep 14 09:41:33.752208 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:41:33.752208 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:41:33.752208 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:41:33.752208 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:41:33.752208 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIaG9RXoLYM6Y63wRWZ1wbEJxUl9bocututyeWKJJsI9S_kHaAn_H3NkfCCrJho3JS1agnEMSWeTwcbhU6QOvOKevmwgy87Rx0xOeGPeaoioRFVQqJ8oN_qv5NnMyiLO1qfwKLsOi1rafHigzBIi0IxAqm7ocT9FWP5APhQFmQK43u4I Sep 14 09:41:33.752208 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:41:33.752208 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:41:33.752208 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:41:33.752208 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:41:33.752208 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:41:33.752208 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:41:33.752208 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 081973a28d1a41bd8d32a83daa414885 Sep 14 09:41:33.752208 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-951075478 Sep 14 09:41:33.752208 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member,admin Sep 14 09:41:33.752208 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member,admin Sep 14 09:41:33.752208 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/081973a28d1a41bd8d32a83daa414885"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_081973a28d1a41bd8d32a83daa414885"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/081973a28d1a41bd8d32a83daa414885"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/081973a28d1a41bd8d32a83daa414885"}]}] Sep 14 09:41:33.752208 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ServersAdminNegativeTestJSON-951075478 Sep 14 09:41:33.752208 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 081973a28d1a41bd8d32a83daa414885 Sep 14 09:41:33.752208 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-951075478 Sep 14 09:41:33.752208 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ServersAdminNegativeTestJSON-951075478-project-admin Sep 14 09:41:33.752208 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:41:33.752208 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:41:33.752208 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: a028cdd499234e038dc20d761296c56e Sep 14 09:41:33.752208 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ServersAdminNegativeTestJSON-951075478-project-admin Sep 14 09:41:33.752208 n-d-836830-18 devstack@n-api.service[128759]: Sep 14 09:41:33.752208 n-d-836830-18 devstack@n-api.service[128759]: {"resize": {"flavorRef": "210640072"}} Sep 14 09:41:33.752208 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:41:33.752208 n-d-836830-18 devstack@n-api.service[128759]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Sep 14 09:41:33.752208 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': 'b08d0eb4-4d9c-43f5-9262-4a82e12953dc', 'body': {'resize': {'flavorRef': '210640072'}}} Sep 14 09:41:33.752208 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:41:33.752208 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:41:33.752208 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Sep 14 09:41:33.752208 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Sep 14 09:41:33.752208 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 14 09:41:33.752208 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 14 09:41:33.752208 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Sep 14 09:41:33.752208 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc Sep 14 09:41:33.752208 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Sep 14 09:41:33.752208 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Sep 14 09:41:33.752208 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 14 09:41:33.752208 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 14 09:41:33.752208 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Sep 14 09:41:33.752208 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Sep 14 09:41:33.752208 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Sep 14 09:41:33.752208 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Sep 14 09:41:33.752208 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Sep 14 09:41:33.752208 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Sep 14 09:41:33.752208 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Sep 14 09:41:33.752208 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:41:33.752208 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:41:33.752208 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:41:33.752208 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:41:33.752208 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Sep 14 09:41:33.752208 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Sep 14 09:41:33.752208 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 14 09:41:33.752208 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 14 09:41:33.752208 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 14 09:41:33.756494 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 14 09:41:33.756494 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 14 09:41:33.756494 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 14 09:41:33.756494 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 14 09:41:33.756494 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 14 09:41:33.756494 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 14 09:41:33.756494 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 14 09:41:33.756494 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 14 09:41:33.756494 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 14 09:41:33.756494 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Sep 14 09:41:33.756494 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Sep 14 09:41:33.756494 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Sep 14 09:41:33.756494 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Sep 14 09:41:33.756494 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Sep 14 09:41:33.756494 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:41:33.756494 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:41:33.756494 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:41:33.756494 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:41:33.756494 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:41:33.756494 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:41:33.756494 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:41:33.756494 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:41:33.756494 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:41:33.756494 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:41:33.756494 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:41:33.756494 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:41:33.756494 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Sep 14 09:41:33.756494 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Sep 14 09:41:33.756494 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Sep 14 09:41:33.756494 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 14 09:41:33.756494 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Sep 14 09:41:33.756494 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:41:33.756494 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:41:33.756494 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:41:33.756494 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:41:33.756494 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:41:33.756494 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:41:33.756494 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:41:33.756494 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:41:33.756494 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Sep 14 09:41:33.756494 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:41:33.756494 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c37a1a35-45be-49ba-a5f6-e3fca858d738 tempest-ServersAdminNegativeTestJSON-951075478 tempest-ServersAdminNegativeTestJSON-951075478-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:41:33.756494 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-c37a1a35-45be-49ba-a5f6-e3fca858d738 tempest-ServersAdminNegativeTestJSON-951075478 tempest-ServersAdminNegativeTestJSON-951075478-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/b08d0eb4-4d9c-43f5-9262-4a82e12953dc/action" status: 403 len: 113 microversion: 2.1 time: 0.099566 Sep 14 09:41:33.756494 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3373/6697] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:41:33 2022] POST /compute/v2.1/servers/b08d0eb4-4d9c-43f5-9262-4a82e12953dc/action => generated 113 bytes in 101 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Sep 14 09:41:33.762273 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-6319edd3-22e9-4484-abf3-4086912045d7 tempest-ServersAdminNegativeTestJSON-951075478 tempest-ServersAdminNegativeTestJSON-951075478-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:33.787292 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-6319edd3-22e9-4484-abf3-4086912045d7 tempest-ServersAdminNegativeTestJSON-951075478 tempest-ServersAdminNegativeTestJSON-951075478-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/210640072" status: 202 len: 0 microversion: 2.1 time: 0.028827 Sep 14 09:41:33.787874 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3374/6698] 10.222.0.60 () {58 vars in 1158 bytes} [Wed Sep 14 09:41:33 2022] DELETE /compute/v2.1/flavors/210640072 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 14 09:41:33.795388 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-4ea7067c-d0b3-4a4a-8067-b72529ba298c tempest-ServersAdminNegativeTestJSON-951075478 tempest-ServersAdminNegativeTestJSON-951075478-project-admin] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:33.814204 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-4ea7067c-d0b3-4a4a-8067-b72529ba298c tempest-ServersAdminNegativeTestJSON-951075478 tempest-ServersAdminNegativeTestJSON-951075478-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.022195 Sep 14 09:41:33.814752 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3375/6699] 10.222.0.60 () {58 vars in 1146 bytes} [Wed Sep 14 09:41:33 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:41:33.836584 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-30b09d1c-b027-4f17-83d8-aa4eb785c33f tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:33.837014 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-30b09d1c-b027-4f17-83d8-aa4eb785c33f tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] [instance: b08d0eb4-4d9c-43f5-9262-4a82e12953dc] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:33.843028 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-30b09d1c-b027-4f17-83d8-aa4eb785c33f tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:33.843509 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-30b09d1c-b027-4f17-83d8-aa4eb785c33f tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:33.843940 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-30b09d1c-b027-4f17-83d8-aa4eb785c33f tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:33.844622 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-30b09d1c-b027-4f17-83d8-aa4eb785c33f tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:33.845076 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-30b09d1c-b027-4f17-83d8-aa4eb785c33f tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:33.845504 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-30b09d1c-b027-4f17-83d8-aa4eb785c33f tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:33.870289 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-30b09d1c-b027-4f17-83d8-aa4eb785c33f tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] [instance: b08d0eb4-4d9c-43f5-9262-4a82e12953dc] Going to try to terminate instance {{(pid=128759) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:41:33.884093 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=100 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:41:33.945063 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-30b09d1c-b027-4f17-83d8-aa4eb785c33f tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] 10.222.0.60 "DELETE /compute/v2.1/servers/b08d0eb4-4d9c-43f5-9262-4a82e12953dc" status: 204 len: 0 microversion: 2.1 time: 0.112412 Sep 14 09:41:33.945753 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3376/6700] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:41:33 2022] DELETE /compute/v2.1/servers/b08d0eb4-4d9c-43f5-9262-4a82e12953dc => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 14 09:41:33.953965 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d8e0a483-7729-4252-aa6e-7f964cce5f69 tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:33.954675 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-d8e0a483-7729-4252-aa6e-7f964cce5f69 tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] [instance: b08d0eb4-4d9c-43f5-9262-4a82e12953dc] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:33.961110 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d8e0a483-7729-4252-aa6e-7f964cce5f69 tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:33.961604 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d8e0a483-7729-4252-aa6e-7f964cce5f69 tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:33.962295 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d8e0a483-7729-4252-aa6e-7f964cce5f69 tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:33.963021 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d8e0a483-7729-4252-aa6e-7f964cce5f69 tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:33.963484 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d8e0a483-7729-4252-aa6e-7f964cce5f69 tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:33.963911 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d8e0a483-7729-4252-aa6e-7f964cce5f69 tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:34.093151 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-d8e0a483-7729-4252-aa6e-7f964cce5f69 tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca2cbf4a7b544aaa399c6026827c660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2672183e6844154b54239a75b6f134d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:41:34.100941 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d8e0a483-7729-4252-aa6e-7f964cce5f69 tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] 10.222.0.60 "GET /compute/v2.1/servers/b08d0eb4-4d9c-43f5-9262-4a82e12953dc" status: 200 len: 1478 microversion: 2.1 time: 0.150983 Sep 14 09:41:34.101507 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3377/6701] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:41:33 2022] GET /compute/v2.1/servers/b08d0eb4-4d9c-43f5-9262-4a82e12953dc => generated 1478 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:41:35.123588 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-05142d08-adde-48ad-98f7-ca8efbcdefba tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:35.124323 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-05142d08-adde-48ad-98f7-ca8efbcdefba tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] [instance: b08d0eb4-4d9c-43f5-9262-4a82e12953dc] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:35.131878 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-05142d08-adde-48ad-98f7-ca8efbcdefba tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:35.132374 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-05142d08-adde-48ad-98f7-ca8efbcdefba tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:35.132820 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-05142d08-adde-48ad-98f7-ca8efbcdefba tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:35.133515 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-05142d08-adde-48ad-98f7-ca8efbcdefba tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:35.133977 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-05142d08-adde-48ad-98f7-ca8efbcdefba tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:35.134481 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-05142d08-adde-48ad-98f7-ca8efbcdefba tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:35.271225 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-05142d08-adde-48ad-98f7-ca8efbcdefba tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca2cbf4a7b544aaa399c6026827c660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2672183e6844154b54239a75b6f134d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:41:35.279135 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-05142d08-adde-48ad-98f7-ca8efbcdefba tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] 10.222.0.60 "GET /compute/v2.1/servers/b08d0eb4-4d9c-43f5-9262-4a82e12953dc" status: 200 len: 1478 microversion: 2.1 time: 0.159445 Sep 14 09:41:35.279722 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3378/6702] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:41:35 2022] GET /compute/v2.1/servers/b08d0eb4-4d9c-43f5-9262-4a82e12953dc => generated 1478 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:41:35.725766 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-30148518-46e1-4c60-b19f-c0152c008023 req-2b32ab1a-4ad7-48e9-9bd0-33cec5727fef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b08d0eb4-4d9c-43f5-9262-4a82e12953dc", "name": "network-vif-deleted", "tag": "5add2d39-b945-4c25-9535-e653b72ef72c"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:41:35.736239 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-30148518-46e1-4c60-b19f-c0152c008023 req-2b32ab1a-4ad7-48e9-9bd0-33cec5727fef service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:35.736637 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-30148518-46e1-4c60-b19f-c0152c008023 req-2b32ab1a-4ad7-48e9-9bd0-33cec5727fef service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:35.737069 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-30148518-46e1-4c60-b19f-c0152c008023 req-2b32ab1a-4ad7-48e9-9bd0-33cec5727fef service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:35.749416 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-30148518-46e1-4c60-b19f-c0152c008023 req-2b32ab1a-4ad7-48e9-9bd0-33cec5727fef service nova] Creating event network-vif-deleted:5add2d39-b945-4c25-9535-e653b72ef72c for instance b08d0eb4-4d9c-43f5-9262-4a82e12953dc on n-h2-836830-18 Sep 14 09:41:35.755276 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-30148518-46e1-4c60-b19f-c0152c008023 req-2b32ab1a-4ad7-48e9-9bd0-33cec5727fef service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033321 Sep 14 09:41:35.756353 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3379/6703] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:41:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:41:36.304971 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-328c955e-1bde-4db0-b92e-1731e59a0866 tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:36.305681 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-328c955e-1bde-4db0-b92e-1731e59a0866 tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] [instance: b08d0eb4-4d9c-43f5-9262-4a82e12953dc] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:36.313756 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-328c955e-1bde-4db0-b92e-1731e59a0866 tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:36.314249 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-328c955e-1bde-4db0-b92e-1731e59a0866 tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:36.314695 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-328c955e-1bde-4db0-b92e-1731e59a0866 tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:36.315420 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-328c955e-1bde-4db0-b92e-1731e59a0866 tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:36.315879 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-328c955e-1bde-4db0-b92e-1731e59a0866 tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:36.316308 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-328c955e-1bde-4db0-b92e-1731e59a0866 tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:36.330073 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-328c955e-1bde-4db0-b92e-1731e59a0866 tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] HTTP exception thrown: Instance b08d0eb4-4d9c-43f5-9262-4a82e12953dc could not be found. Sep 14 09:41:36.331737 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-328c955e-1bde-4db0-b92e-1731e59a0866 tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] Request method failure captured: Sep 14 09:41:36.331737 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/b08d0eb4-4d9c-43f5-9262-4a82e12953dc HTTP/1.1 Sep 14 09:41:36.331737 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:41:36.331737 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:41:36.331737 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:41:36.331737 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:41:36.331737 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:41:36.331737 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:41:36.331737 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:41:36.331737 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:41:36.331737 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIaG9Yv3lhiB2eVP60400zOVEhxzONM11A-LmdsXFXoMOOlEtL-Sdnq9T3Bie0_83RAdKFrdmhAKtu2wQK5KJ7MkCxjfcEzmxIUXgioCI8LBRGEGvV3-2l8ima8tI--v1USKMyTKdU6_xUTUe9sy4EWplhBISxOtfu3xDBScGVwtv2zI Sep 14 09:41:36.331737 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:41:36.331737 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:41:36.331737 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:41:36.331737 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:41:36.331737 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:41:36.331737 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:41:36.331737 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: d2672183e6844154b54239a75b6f134d Sep 14 09:41:36.331737 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-29490299 Sep 14 09:41:36.331737 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:41:36.331737 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:41:36.331737 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/d2672183e6844154b54239a75b6f134d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_d2672183e6844154b54239a75b6f134d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d2672183e6844154b54239a75b6f134d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d2672183e6844154b54239a75b6f134d"}]}] Sep 14 09:41:36.331737 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ServersAdminNegativeTestJSON-29490299 Sep 14 09:41:36.331737 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: d2672183e6844154b54239a75b6f134d Sep 14 09:41:36.331737 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-29490299 Sep 14 09:41:36.331737 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ServersAdminNegativeTestJSON-29490299-project Sep 14 09:41:36.331737 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:41:36.331737 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:41:36.331737 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: aca2cbf4a7b544aaa399c6026827c660 Sep 14 09:41:36.331737 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ServersAdminNegativeTestJSON-29490299-project Sep 14 09:41:36.331737 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:41:36.331737 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance b08d0eb4-4d9c-43f5-9262-4a82e12953dc could not be found. Sep 14 09:41:36.331737 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': 'b08d0eb4-4d9c-43f5-9262-4a82e12953dc'} Sep 14 09:41:36.331737 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:41:36.331737 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:41:36.331737 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:41:36.331737 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:41:36.331737 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:41:36.331737 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:41:36.331737 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:41:36.331737 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:41:36.331737 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:41:36.331737 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:41:36.331737 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b08d0eb4-4d9c-43f5-9262-4a82e12953dc could not be found. Sep 14 09:41:36.331737 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:41:36.331737 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:41:36.331737 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:41:36.331737 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:41:36.331737 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:41:36.331737 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:41:36.331737 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:41:36.331737 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:41:36.331737 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:41:36.331737 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:41:36.331737 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:41:36.331737 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:41:36.331737 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:41:36.331737 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:41:36.331737 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:41:36.331737 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:41:36.331737 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b08d0eb4-4d9c-43f5-9262-4a82e12953dc could not be found. Sep 14 09:41:36.331737 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:41:36.331737 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:41:36.336497 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:41:36.336497 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:41:36.336497 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:41:36.336497 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:41:36.336497 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:41:36.336497 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:41:36.336497 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b08d0eb4-4d9c-43f5-9262-4a82e12953dc could not be found. Sep 14 09:41:36.336497 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:41:36.336497 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-328c955e-1bde-4db0-b92e-1731e59a0866 tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] Returning 404 to user: Instance b08d0eb4-4d9c-43f5-9262-4a82e12953dc could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:41:36.336497 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-328c955e-1bde-4db0-b92e-1731e59a0866 tempest-ServersAdminNegativeTestJSON-29490299 tempest-ServersAdminNegativeTestJSON-29490299-project] 10.222.0.60 "GET /compute/v2.1/servers/b08d0eb4-4d9c-43f5-9262-4a82e12953dc" status: 404 len: 111 microversion: 2.1 time: 0.034722 Sep 14 09:41:36.336497 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3380/6704] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:41:36 2022] GET /compute/v2.1/servers/b08d0eb4-4d9c-43f5-9262-4a82e12953dc => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 14 09:41:42.469745 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-6e9e1711-7737-483d-95da-056387133efc tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-887579516", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "networks": [{"uuid": "eb7ca1a3-f872-4207-ad86-6ec4bb106b26"}]}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:41:42.526830 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.network.neutron [None req-6e9e1711-7737-483d-95da-056387133efc tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] validate_networks() for [('eb7ca1a3-f872-4207-ad86-6ec4bb106b26', None, None, None, None, None)] {{(pid=128759) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:41:42.929034 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-6e9e1711-7737-483d-95da-056387133efc tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Flavor limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:41:42.929772 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-6e9e1711-7737-483d-95da-056387133efc tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Image limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:41:42.930251 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-6e9e1711-7737-483d-95da-056387133efc tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Flavor pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:41:42.930664 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-6e9e1711-7737-483d-95da-056387133efc tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Image pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:41:42.931117 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-6e9e1711-7737-483d-95da-056387133efc tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:41:42.940096 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6e9e1711-7737-483d-95da-056387133efc tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:42.940579 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6e9e1711-7737-483d-95da-056387133efc tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:42.941015 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6e9e1711-7737-483d-95da-056387133efc tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:42.941741 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6e9e1711-7737-483d-95da-056387133efc tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:42.942198 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6e9e1711-7737-483d-95da-056387133efc tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:42.942622 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6e9e1711-7737-483d-95da-056387133efc tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:42.962812 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-6e9e1711-7737-483d-95da-056387133efc tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Getting quotas for project 2055a333ba6542f4b23376eb443193a5. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:41:42.968365 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-6e9e1711-7737-483d-95da-056387133efc tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Getting quotas for user 991caa00be4b4a349e6a288dfd05becb and project 2055a333ba6542f4b23376eb443193a5. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:41:42.982089 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-6e9e1711-7737-483d-95da-056387133efc tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Going to run 1 instances... {{(pid=128759) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:41:42.984818 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-6e9e1711-7737-483d-95da-056387133efc tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] [instance: bd5e0e32-abf3-489b-9a1d-320689017006] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128759) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:41:43.037246 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-6e9e1711-7737-483d-95da-056387133efc tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.696188 Sep 14 09:41:43.038177 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3381/6705] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 09:41:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 698 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 14 09:41:43.053969 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-64b6c2e5-2a35-4428-bee7-28106f21a205 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:43.054693 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-64b6c2e5-2a35-4428-bee7-28106f21a205 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] [instance: bd5e0e32-abf3-489b-9a1d-320689017006] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:43.113021 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-64b6c2e5-2a35-4428-bee7-28106f21a205 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991caa00be4b4a349e6a288dfd05becb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2055a333ba6542f4b23376eb443193a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:41:43.122001 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-64b6c2e5-2a35-4428-bee7-28106f21a205 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] 10.222.0.60 "GET /compute/v2.1/servers/bd5e0e32-abf3-489b-9a1d-320689017006" status: 200 len: 1214 microversion: 2.1 time: 0.075688 Sep 14 09:41:43.122773 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3382/6706] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:41:43 2022] GET /compute/v2.1/servers/bd5e0e32-abf3-489b-9a1d-320689017006 => generated 1214 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:41:44.146358 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ab59aa63-8caf-438e-be50-693996767433 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:44.147050 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-ab59aa63-8caf-438e-be50-693996767433 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] [instance: bd5e0e32-abf3-489b-9a1d-320689017006] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:44.155294 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ab59aa63-8caf-438e-be50-693996767433 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:44.156011 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ab59aa63-8caf-438e-be50-693996767433 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:44.156600 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ab59aa63-8caf-438e-be50-693996767433 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:44.157478 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ab59aa63-8caf-438e-be50-693996767433 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:44.158085 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ab59aa63-8caf-438e-be50-693996767433 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:44.158659 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ab59aa63-8caf-438e-be50-693996767433 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:44.233743 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-ab59aa63-8caf-438e-be50-693996767433 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991caa00be4b4a349e6a288dfd05becb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2055a333ba6542f4b23376eb443193a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:41:44.242489 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-ab59aa63-8caf-438e-be50-693996767433 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] 10.222.0.60 "GET /compute/v2.1/servers/bd5e0e32-abf3-489b-9a1d-320689017006" status: 200 len: 1274 microversion: 2.1 time: 0.100449 Sep 14 09:41:44.243957 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3383/6707] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:41:44 2022] GET /compute/v2.1/servers/bd5e0e32-abf3-489b-9a1d-320689017006 => generated 1274 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:41:45.267443 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-cb3b83aa-439b-438e-8ae9-4e80213e8901 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:45.268153 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-cb3b83aa-439b-438e-8ae9-4e80213e8901 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] [instance: bd5e0e32-abf3-489b-9a1d-320689017006] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:45.281410 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cb3b83aa-439b-438e-8ae9-4e80213e8901 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:45.281976 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cb3b83aa-439b-438e-8ae9-4e80213e8901 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:45.282360 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cb3b83aa-439b-438e-8ae9-4e80213e8901 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:45.283106 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cb3b83aa-439b-438e-8ae9-4e80213e8901 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:45.283742 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cb3b83aa-439b-438e-8ae9-4e80213e8901 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:45.284325 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cb3b83aa-439b-438e-8ae9-4e80213e8901 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:45.462775 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-cb3b83aa-439b-438e-8ae9-4e80213e8901 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991caa00be4b4a349e6a288dfd05becb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2055a333ba6542f4b23376eb443193a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:41:45.474338 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-cb3b83aa-439b-438e-8ae9-4e80213e8901 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] 10.222.0.60 "GET /compute/v2.1/servers/bd5e0e32-abf3-489b-9a1d-320689017006" status: 200 len: 1314 microversion: 2.1 time: 0.210730 Sep 14 09:41:45.475945 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3384/6708] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:41:45 2022] GET /compute/v2.1/servers/bd5e0e32-abf3-489b-9a1d-320689017006 => generated 1314 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:41:45.698596 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-4efae40e-9eaf-4451-9d22-c94e6f251a13 req-3dd89a52-4127-4e73-8bb4-e758017df609 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd5e0e32-abf3-489b-9a1d-320689017006", "tag": "6f6489aa-538a-4e09-a882-eaf3895af2ad"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:41:45.714559 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-4efae40e-9eaf-4451-9d22-c94e6f251a13 req-3dd89a52-4127-4e73-8bb4-e758017df609 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:45.715444 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-4efae40e-9eaf-4451-9d22-c94e6f251a13 req-3dd89a52-4127-4e73-8bb4-e758017df609 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:45.716107 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-4efae40e-9eaf-4451-9d22-c94e6f251a13 req-3dd89a52-4127-4e73-8bb4-e758017df609 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:45.730969 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-4efae40e-9eaf-4451-9d22-c94e6f251a13 req-3dd89a52-4127-4e73-8bb4-e758017df609 service nova] Creating event network-changed:6f6489aa-538a-4e09-a882-eaf3895af2ad for instance bd5e0e32-abf3-489b-9a1d-320689017006 on n-h2-836830-18 Sep 14 09:41:45.740299 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-4efae40e-9eaf-4451-9d22-c94e6f251a13 req-3dd89a52-4127-4e73-8bb4-e758017df609 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044891 Sep 14 09:41:45.741966 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3385/6709] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:41:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:41:46.504551 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ee8ef4a5-0c7e-4d22-9ba9-00df40c117df tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:46.505267 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-ee8ef4a5-0c7e-4d22-9ba9-00df40c117df tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] [instance: bd5e0e32-abf3-489b-9a1d-320689017006] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:46.511630 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ee8ef4a5-0c7e-4d22-9ba9-00df40c117df tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:46.512128 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ee8ef4a5-0c7e-4d22-9ba9-00df40c117df tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:46.512576 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ee8ef4a5-0c7e-4d22-9ba9-00df40c117df tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:46.513269 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ee8ef4a5-0c7e-4d22-9ba9-00df40c117df tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:46.513740 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ee8ef4a5-0c7e-4d22-9ba9-00df40c117df tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:46.514179 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ee8ef4a5-0c7e-4d22-9ba9-00df40c117df tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:46.647567 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-ee8ef4a5-0c7e-4d22-9ba9-00df40c117df tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991caa00be4b4a349e6a288dfd05becb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2055a333ba6542f4b23376eb443193a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:41:46.655342 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-ee8ef4a5-0c7e-4d22-9ba9-00df40c117df tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] 10.222.0.60 "GET /compute/v2.1/servers/bd5e0e32-abf3-489b-9a1d-320689017006" status: 200 len: 1314 microversion: 2.1 time: 0.156012 Sep 14 09:41:46.655915 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3386/6710] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:41:46 2022] GET /compute/v2.1/servers/bd5e0e32-abf3-489b-9a1d-320689017006 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:41:47.677895 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-48e1cc05-a1b0-4b26-b723-2a4d4f30eba0 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:47.678546 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-48e1cc05-a1b0-4b26-b723-2a4d4f30eba0 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] [instance: bd5e0e32-abf3-489b-9a1d-320689017006] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:47.685927 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-48e1cc05-a1b0-4b26-b723-2a4d4f30eba0 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:47.686418 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-48e1cc05-a1b0-4b26-b723-2a4d4f30eba0 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:47.686860 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-48e1cc05-a1b0-4b26-b723-2a4d4f30eba0 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:47.687583 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-48e1cc05-a1b0-4b26-b723-2a4d4f30eba0 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:47.688047 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-48e1cc05-a1b0-4b26-b723-2a4d4f30eba0 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:47.688477 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-48e1cc05-a1b0-4b26-b723-2a4d4f30eba0 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:47.824690 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-48e1cc05-a1b0-4b26-b723-2a4d4f30eba0 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991caa00be4b4a349e6a288dfd05becb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2055a333ba6542f4b23376eb443193a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:41:47.832571 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-48e1cc05-a1b0-4b26-b723-2a4d4f30eba0 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] 10.222.0.60 "GET /compute/v2.1/servers/bd5e0e32-abf3-489b-9a1d-320689017006" status: 200 len: 1314 microversion: 2.1 time: 0.158785 Sep 14 09:41:47.833143 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3387/6711] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:41:47 2022] GET /compute/v2.1/servers/bd5e0e32-abf3-489b-9a1d-320689017006 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:41:48.856041 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3bd791f8-4cd4-4e90-9737-d67a80da8eb4 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:48.856683 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-3bd791f8-4cd4-4e90-9737-d67a80da8eb4 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] [instance: bd5e0e32-abf3-489b-9a1d-320689017006] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:48.864500 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3bd791f8-4cd4-4e90-9737-d67a80da8eb4 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:48.864992 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3bd791f8-4cd4-4e90-9737-d67a80da8eb4 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:48.865435 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3bd791f8-4cd4-4e90-9737-d67a80da8eb4 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:48.866158 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3bd791f8-4cd4-4e90-9737-d67a80da8eb4 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:48.866620 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3bd791f8-4cd4-4e90-9737-d67a80da8eb4 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:48.867122 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3bd791f8-4cd4-4e90-9737-d67a80da8eb4 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:49.001639 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-3bd791f8-4cd4-4e90-9737-d67a80da8eb4 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991caa00be4b4a349e6a288dfd05becb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2055a333ba6542f4b23376eb443193a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:41:49.009506 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-3bd791f8-4cd4-4e90-9737-d67a80da8eb4 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] 10.222.0.60 "GET /compute/v2.1/servers/bd5e0e32-abf3-489b-9a1d-320689017006" status: 200 len: 1314 microversion: 2.1 time: 0.157347 Sep 14 09:41:49.010083 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3388/6712] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:41:48 2022] GET /compute/v2.1/servers/bd5e0e32-abf3-489b-9a1d-320689017006 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:41:50.032999 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-1d487728-5634-4095-b07e-add974766899 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:50.033680 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-1d487728-5634-4095-b07e-add974766899 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] [instance: bd5e0e32-abf3-489b-9a1d-320689017006] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:50.040561 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1d487728-5634-4095-b07e-add974766899 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:50.041052 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1d487728-5634-4095-b07e-add974766899 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:50.041516 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1d487728-5634-4095-b07e-add974766899 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:50.042213 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1d487728-5634-4095-b07e-add974766899 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:50.042681 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1d487728-5634-4095-b07e-add974766899 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:50.043134 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1d487728-5634-4095-b07e-add974766899 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:50.170694 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-1d487728-5634-4095-b07e-add974766899 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991caa00be4b4a349e6a288dfd05becb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2055a333ba6542f4b23376eb443193a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:41:50.179161 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-1d487728-5634-4095-b07e-add974766899 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] 10.222.0.60 "GET /compute/v2.1/servers/bd5e0e32-abf3-489b-9a1d-320689017006" status: 200 len: 1314 microversion: 2.1 time: 0.150109 Sep 14 09:41:50.179750 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3389/6713] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:41:50 2022] GET /compute/v2.1/servers/bd5e0e32-abf3-489b-9a1d-320689017006 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:41:51.170964 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-2cf8f372-82aa-4625-b0fe-4265e205fe6a req-ce15622f-38e9-4e5a-bd94-9c19bbbd6286 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd5e0e32-abf3-489b-9a1d-320689017006", "name": "network-vif-plugged", "status": "completed", "tag": "6f6489aa-538a-4e09-a882-eaf3895af2ad"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:41:51.182444 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-2cf8f372-82aa-4625-b0fe-4265e205fe6a req-ce15622f-38e9-4e5a-bd94-9c19bbbd6286 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:51.182950 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-2cf8f372-82aa-4625-b0fe-4265e205fe6a req-ce15622f-38e9-4e5a-bd94-9c19bbbd6286 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:51.183387 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-2cf8f372-82aa-4625-b0fe-4265e205fe6a req-ce15622f-38e9-4e5a-bd94-9c19bbbd6286 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:51.197897 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-2cf8f372-82aa-4625-b0fe-4265e205fe6a req-ce15622f-38e9-4e5a-bd94-9c19bbbd6286 service nova] Creating event network-vif-plugged:6f6489aa-538a-4e09-a882-eaf3895af2ad for instance bd5e0e32-abf3-489b-9a1d-320689017006 on n-h2-836830-18 Sep 14 09:41:51.202739 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-2cf8f372-82aa-4625-b0fe-4265e205fe6a req-ce15622f-38e9-4e5a-bd94-9c19bbbd6286 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035519 Sep 14 09:41:51.203395 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3390/6714] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:41:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:41:51.208416 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-fc432b70-9b43-4e0e-8b50-42d91786c3d9 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:51.209122 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-fc432b70-9b43-4e0e-8b50-42d91786c3d9 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] [instance: bd5e0e32-abf3-489b-9a1d-320689017006] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:51.215515 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fc432b70-9b43-4e0e-8b50-42d91786c3d9 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:51.216004 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fc432b70-9b43-4e0e-8b50-42d91786c3d9 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:51.216444 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fc432b70-9b43-4e0e-8b50-42d91786c3d9 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:51.217137 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fc432b70-9b43-4e0e-8b50-42d91786c3d9 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:51.217591 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fc432b70-9b43-4e0e-8b50-42d91786c3d9 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:51.218018 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fc432b70-9b43-4e0e-8b50-42d91786c3d9 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:51.359743 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-fc432b70-9b43-4e0e-8b50-42d91786c3d9 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991caa00be4b4a349e6a288dfd05becb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2055a333ba6542f4b23376eb443193a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:41:51.367560 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-fc432b70-9b43-4e0e-8b50-42d91786c3d9 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] 10.222.0.60 "GET /compute/v2.1/servers/bd5e0e32-abf3-489b-9a1d-320689017006" status: 200 len: 1314 microversion: 2.1 time: 0.163083 Sep 14 09:41:51.368136 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3391/6715] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:41:51 2022] GET /compute/v2.1/servers/bd5e0e32-abf3-489b-9a1d-320689017006 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:41:52.391315 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a90ed1f5-03fb-43d6-9cd7-8b29de35877a tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:52.391990 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-a90ed1f5-03fb-43d6-9cd7-8b29de35877a tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] [instance: bd5e0e32-abf3-489b-9a1d-320689017006] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:52.399533 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a90ed1f5-03fb-43d6-9cd7-8b29de35877a tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:52.399997 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a90ed1f5-03fb-43d6-9cd7-8b29de35877a tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:52.400439 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a90ed1f5-03fb-43d6-9cd7-8b29de35877a tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:52.401148 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a90ed1f5-03fb-43d6-9cd7-8b29de35877a tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:52.401609 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a90ed1f5-03fb-43d6-9cd7-8b29de35877a tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:52.402038 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a90ed1f5-03fb-43d6-9cd7-8b29de35877a tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:52.537284 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-a90ed1f5-03fb-43d6-9cd7-8b29de35877a tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991caa00be4b4a349e6a288dfd05becb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2055a333ba6542f4b23376eb443193a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:41:52.545173 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a90ed1f5-03fb-43d6-9cd7-8b29de35877a tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] 10.222.0.60 "GET /compute/v2.1/servers/bd5e0e32-abf3-489b-9a1d-320689017006" status: 200 len: 1314 microversion: 2.1 time: 0.157921 Sep 14 09:41:52.545749 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3392/6716] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:41:52 2022] GET /compute/v2.1/servers/bd5e0e32-abf3-489b-9a1d-320689017006 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:41:53.568301 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a4f67e3c-0e55-4fed-b983-fe0f8123e45c tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:53.568934 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-a4f67e3c-0e55-4fed-b983-fe0f8123e45c tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] [instance: bd5e0e32-abf3-489b-9a1d-320689017006] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:53.570903 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=8 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:41:53.571848 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=12 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:41:53.578615 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a4f67e3c-0e55-4fed-b983-fe0f8123e45c tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:53.579154 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a4f67e3c-0e55-4fed-b983-fe0f8123e45c tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:53.579605 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a4f67e3c-0e55-4fed-b983-fe0f8123e45c tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:53.580312 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a4f67e3c-0e55-4fed-b983-fe0f8123e45c tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:53.580775 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a4f67e3c-0e55-4fed-b983-fe0f8123e45c tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:53.581209 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a4f67e3c-0e55-4fed-b983-fe0f8123e45c tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:53.710780 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-a4f67e3c-0e55-4fed-b983-fe0f8123e45c tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991caa00be4b4a349e6a288dfd05becb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2055a333ba6542f4b23376eb443193a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:41:53.719004 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a4f67e3c-0e55-4fed-b983-fe0f8123e45c tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] 10.222.0.60 "GET /compute/v2.1/servers/bd5e0e32-abf3-489b-9a1d-320689017006" status: 200 len: 1501 microversion: 2.1 time: 0.154783 Sep 14 09:41:53.719586 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3393/6717] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:41:53 2022] GET /compute/v2.1/servers/bd5e0e32-abf3-489b-9a1d-320689017006 => generated 1501 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:41:53.741983 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9318ce82-9500-4fee-9c01-e88d519d74ae tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:41:53.744267 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-9318ce82-9500-4fee-9c01-e88d519d74ae tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] [instance: bd5e0e32-abf3-489b-9a1d-320689017006] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:53.750029 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9318ce82-9500-4fee-9c01-e88d519d74ae tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:53.750524 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9318ce82-9500-4fee-9c01-e88d519d74ae tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:53.750995 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9318ce82-9500-4fee-9c01-e88d519d74ae tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:53.751801 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9318ce82-9500-4fee-9c01-e88d519d74ae tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:53.752259 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9318ce82-9500-4fee-9c01-e88d519d74ae tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:53.752689 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9318ce82-9500-4fee-9c01-e88d519d74ae tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:53.780754 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-9318ce82-9500-4fee-9c01-e88d519d74ae tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '991caa00be4b4a349e6a288dfd05becb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2055a333ba6542f4b23376eb443193a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:41:53.787079 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-9318ce82-9500-4fee-9c01-e88d519d74ae tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] [instance: bd5e0e32-abf3-489b-9a1d-320689017006] Old instance type m1.heat2, new instance type m1.heat {{(pid=128759) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 14 09:41:53.793776 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-9318ce82-9500-4fee-9c01-e88d519d74ae tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Flavor limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:41:53.794202 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-9318ce82-9500-4fee-9c01-e88d519d74ae tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Image limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:41:53.794680 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-9318ce82-9500-4fee-9c01-e88d519d74ae tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Flavor pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:41:53.795124 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-9318ce82-9500-4fee-9c01-e88d519d74ae tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Image pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:41:53.795540 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-9318ce82-9500-4fee-9c01-e88d519d74ae tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:41:53.859939 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-9318ce82-9500-4fee-9c01-e88d519d74ae tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] 10.222.0.60 "POST /compute/v2.1/servers/bd5e0e32-abf3-489b-9a1d-320689017006/action" status: 202 len: 0 microversion: 2.1 time: 0.122170 Sep 14 09:41:53.860783 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3394/6718] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:41:53 2022] POST /compute/v2.1/servers/bd5e0e32-abf3-489b-9a1d-320689017006/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 14 09:41:53.869240 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-939ade8c-34db-4982-ab07-821b2574a2c3 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:53.869865 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-939ade8c-34db-4982-ab07-821b2574a2c3 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] [instance: bd5e0e32-abf3-489b-9a1d-320689017006] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:53.875814 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-939ade8c-34db-4982-ab07-821b2574a2c3 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:53.876311 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-939ade8c-34db-4982-ab07-821b2574a2c3 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:53.876758 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-939ade8c-34db-4982-ab07-821b2574a2c3 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:53.877457 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-939ade8c-34db-4982-ab07-821b2574a2c3 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:53.877916 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-939ade8c-34db-4982-ab07-821b2574a2c3 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:53.878350 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-939ade8c-34db-4982-ab07-821b2574a2c3 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:53.882541 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:41:54.017722 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-939ade8c-34db-4982-ab07-821b2574a2c3 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991caa00be4b4a349e6a288dfd05becb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2055a333ba6542f4b23376eb443193a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:41:54.026314 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-939ade8c-34db-4982-ab07-821b2574a2c3 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] 10.222.0.60 "GET /compute/v2.1/servers/bd5e0e32-abf3-489b-9a1d-320689017006" status: 200 len: 1510 microversion: 2.1 time: 0.160810 Sep 14 09:41:54.026894 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3395/6719] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:41:53 2022] GET /compute/v2.1/servers/bd5e0e32-abf3-489b-9a1d-320689017006 => generated 1510 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:41:55.051301 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3fa354bb-0158-43b5-9232-26bff191f51b tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:55.052895 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-3fa354bb-0158-43b5-9232-26bff191f51b tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] [instance: bd5e0e32-abf3-489b-9a1d-320689017006] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:55.060245 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3fa354bb-0158-43b5-9232-26bff191f51b tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:55.060735 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3fa354bb-0158-43b5-9232-26bff191f51b tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:55.061176 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3fa354bb-0158-43b5-9232-26bff191f51b tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:55.061878 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3fa354bb-0158-43b5-9232-26bff191f51b tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:55.062332 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3fa354bb-0158-43b5-9232-26bff191f51b tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:55.062758 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3fa354bb-0158-43b5-9232-26bff191f51b tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:55.196898 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-3fa354bb-0158-43b5-9232-26bff191f51b tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991caa00be4b4a349e6a288dfd05becb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2055a333ba6542f4b23376eb443193a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:41:55.204751 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-3fa354bb-0158-43b5-9232-26bff191f51b tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] 10.222.0.60 "GET /compute/v2.1/servers/bd5e0e32-abf3-489b-9a1d-320689017006" status: 200 len: 1510 microversion: 2.1 time: 0.158328 Sep 14 09:41:55.205320 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3396/6720] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:41:55 2022] GET /compute/v2.1/servers/bd5e0e32-abf3-489b-9a1d-320689017006 => generated 1510 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:41:56.229390 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c701a821-00bb-4434-afb6-4692e2b324d0 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:56.230325 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-c701a821-00bb-4434-afb6-4692e2b324d0 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] [instance: bd5e0e32-abf3-489b-9a1d-320689017006] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:56.238745 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c701a821-00bb-4434-afb6-4692e2b324d0 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:56.239276 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c701a821-00bb-4434-afb6-4692e2b324d0 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:56.239793 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c701a821-00bb-4434-afb6-4692e2b324d0 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:56.240628 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c701a821-00bb-4434-afb6-4692e2b324d0 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:56.241166 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c701a821-00bb-4434-afb6-4692e2b324d0 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:56.241689 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c701a821-00bb-4434-afb6-4692e2b324d0 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:56.612053 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-c701a821-00bb-4434-afb6-4692e2b324d0 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991caa00be4b4a349e6a288dfd05becb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2055a333ba6542f4b23376eb443193a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:41:56.619904 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-c701a821-00bb-4434-afb6-4692e2b324d0 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] 10.222.0.60 "GET /compute/v2.1/servers/bd5e0e32-abf3-489b-9a1d-320689017006" status: 200 len: 1510 microversion: 2.1 time: 0.394707 Sep 14 09:41:56.620483 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3397/6721] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:41:56 2022] GET /compute/v2.1/servers/bd5e0e32-abf3-489b-9a1d-320689017006 => generated 1510 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:41:57.643916 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-bf780b12-edab-4958-9d66-1afd04554932 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:57.645073 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-bf780b12-edab-4958-9d66-1afd04554932 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] [instance: bd5e0e32-abf3-489b-9a1d-320689017006] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:57.652259 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bf780b12-edab-4958-9d66-1afd04554932 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:57.652760 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bf780b12-edab-4958-9d66-1afd04554932 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:57.653209 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bf780b12-edab-4958-9d66-1afd04554932 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:57.653909 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bf780b12-edab-4958-9d66-1afd04554932 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:57.654376 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bf780b12-edab-4958-9d66-1afd04554932 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:57.654812 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bf780b12-edab-4958-9d66-1afd04554932 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:57.785958 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-bf780b12-edab-4958-9d66-1afd04554932 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991caa00be4b4a349e6a288dfd05becb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2055a333ba6542f4b23376eb443193a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:41:57.794527 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-bf780b12-edab-4958-9d66-1afd04554932 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] 10.222.0.60 "GET /compute/v2.1/servers/bd5e0e32-abf3-489b-9a1d-320689017006" status: 200 len: 1515 microversion: 2.1 time: 0.154747 Sep 14 09:41:57.795130 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3398/6722] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:41:57 2022] GET /compute/v2.1/servers/bd5e0e32-abf3-489b-9a1d-320689017006 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:41:58.816983 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3ee16652-d7e7-4f5b-8f64-8568c6cd46c1 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:58.817671 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-3ee16652-d7e7-4f5b-8f64-8568c6cd46c1 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] [instance: bd5e0e32-abf3-489b-9a1d-320689017006] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:58.824792 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3ee16652-d7e7-4f5b-8f64-8568c6cd46c1 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:58.825247 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3ee16652-d7e7-4f5b-8f64-8568c6cd46c1 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:58.825744 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3ee16652-d7e7-4f5b-8f64-8568c6cd46c1 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:58.826456 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3ee16652-d7e7-4f5b-8f64-8568c6cd46c1 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:58.826909 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3ee16652-d7e7-4f5b-8f64-8568c6cd46c1 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:58.827364 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3ee16652-d7e7-4f5b-8f64-8568c6cd46c1 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:58.969490 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-3ee16652-d7e7-4f5b-8f64-8568c6cd46c1 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991caa00be4b4a349e6a288dfd05becb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2055a333ba6542f4b23376eb443193a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:41:58.977828 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-3ee16652-d7e7-4f5b-8f64-8568c6cd46c1 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] 10.222.0.60 "GET /compute/v2.1/servers/bd5e0e32-abf3-489b-9a1d-320689017006" status: 200 len: 1515 microversion: 2.1 time: 0.164913 Sep 14 09:41:58.978408 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3399/6723] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:41:58 2022] GET /compute/v2.1/servers/bd5e0e32-abf3-489b-9a1d-320689017006 => generated 1515 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:42:00.000684 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-db449e45-82de-4954-9635-f14549a4e429 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:42:00.001308 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-db449e45-82de-4954-9635-f14549a4e429 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] [instance: bd5e0e32-abf3-489b-9a1d-320689017006] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:42:00.008210 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-db449e45-82de-4954-9635-f14549a4e429 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:00.008708 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-db449e45-82de-4954-9635-f14549a4e429 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:00.009150 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-db449e45-82de-4954-9635-f14549a4e429 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:00.009841 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-db449e45-82de-4954-9635-f14549a4e429 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:00.010301 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-db449e45-82de-4954-9635-f14549a4e429 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:00.010732 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-db449e45-82de-4954-9635-f14549a4e429 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:00.143154 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-db449e45-82de-4954-9635-f14549a4e429 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991caa00be4b4a349e6a288dfd05becb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2055a333ba6542f4b23376eb443193a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:42:00.151494 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-db449e45-82de-4954-9635-f14549a4e429 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] 10.222.0.60 "GET /compute/v2.1/servers/bd5e0e32-abf3-489b-9a1d-320689017006" status: 200 len: 1515 microversion: 2.1 time: 0.154799 Sep 14 09:42:00.152062 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3400/6724] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:41:59 2022] GET /compute/v2.1/servers/bd5e0e32-abf3-489b-9a1d-320689017006 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:42:01.174746 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-6787c267-103f-4121-8264-be4df47ffa67 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:42:01.176186 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-6787c267-103f-4121-8264-be4df47ffa67 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] [instance: bd5e0e32-abf3-489b-9a1d-320689017006] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:42:01.183133 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6787c267-103f-4121-8264-be4df47ffa67 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:01.183628 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6787c267-103f-4121-8264-be4df47ffa67 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:01.184069 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6787c267-103f-4121-8264-be4df47ffa67 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:01.184762 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6787c267-103f-4121-8264-be4df47ffa67 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:01.185252 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6787c267-103f-4121-8264-be4df47ffa67 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:01.185684 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6787c267-103f-4121-8264-be4df47ffa67 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:01.316464 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-6787c267-103f-4121-8264-be4df47ffa67 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991caa00be4b4a349e6a288dfd05becb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2055a333ba6542f4b23376eb443193a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:42:01.324650 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-6787c267-103f-4121-8264-be4df47ffa67 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] 10.222.0.60 "GET /compute/v2.1/servers/bd5e0e32-abf3-489b-9a1d-320689017006" status: 200 len: 1515 microversion: 2.1 time: 0.153872 Sep 14 09:42:01.325225 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3401/6725] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:42:01 2022] GET /compute/v2.1/servers/bd5e0e32-abf3-489b-9a1d-320689017006 => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:42:02.349611 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ad9d7f1b-7a5e-43f6-aef9-888862c7e0ee tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:42:02.350345 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-ad9d7f1b-7a5e-43f6-aef9-888862c7e0ee tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] [instance: bd5e0e32-abf3-489b-9a1d-320689017006] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:42:02.357173 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ad9d7f1b-7a5e-43f6-aef9-888862c7e0ee tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:02.357664 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ad9d7f1b-7a5e-43f6-aef9-888862c7e0ee tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:02.358101 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ad9d7f1b-7a5e-43f6-aef9-888862c7e0ee tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:02.358803 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ad9d7f1b-7a5e-43f6-aef9-888862c7e0ee tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:02.359305 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ad9d7f1b-7a5e-43f6-aef9-888862c7e0ee tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:02.359732 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ad9d7f1b-7a5e-43f6-aef9-888862c7e0ee tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:02.490849 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-ad9d7f1b-7a5e-43f6-aef9-888862c7e0ee tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991caa00be4b4a349e6a288dfd05becb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2055a333ba6542f4b23376eb443193a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:42:02.498661 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-ad9d7f1b-7a5e-43f6-aef9-888862c7e0ee tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] 10.222.0.60 "GET /compute/v2.1/servers/bd5e0e32-abf3-489b-9a1d-320689017006" status: 200 len: 1515 microversion: 2.1 time: 0.153658 Sep 14 09:42:02.499281 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3402/6726] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:42:02 2022] GET /compute/v2.1/servers/bd5e0e32-abf3-489b-9a1d-320689017006 => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:42:03.521794 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8ab0f12d-14e0-4d3b-a96f-c73f7e6f3e93 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:42:03.522455 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-8ab0f12d-14e0-4d3b-a96f-c73f7e6f3e93 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] [instance: bd5e0e32-abf3-489b-9a1d-320689017006] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:42:03.529392 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8ab0f12d-14e0-4d3b-a96f-c73f7e6f3e93 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:03.529887 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8ab0f12d-14e0-4d3b-a96f-c73f7e6f3e93 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:03.530334 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8ab0f12d-14e0-4d3b-a96f-c73f7e6f3e93 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:03.531052 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8ab0f12d-14e0-4d3b-a96f-c73f7e6f3e93 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:03.531519 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8ab0f12d-14e0-4d3b-a96f-c73f7e6f3e93 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:03.531955 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8ab0f12d-14e0-4d3b-a96f-c73f7e6f3e93 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:03.662039 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-8ab0f12d-14e0-4d3b-a96f-c73f7e6f3e93 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991caa00be4b4a349e6a288dfd05becb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2055a333ba6542f4b23376eb443193a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:42:03.669988 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-8ab0f12d-14e0-4d3b-a96f-c73f7e6f3e93 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] 10.222.0.60 "GET /compute/v2.1/servers/bd5e0e32-abf3-489b-9a1d-320689017006" status: 200 len: 1515 microversion: 2.1 time: 0.152195 Sep 14 09:42:03.670563 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3403/6727] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:42:03 2022] GET /compute/v2.1/servers/bd5e0e32-abf3-489b-9a1d-320689017006 => generated 1515 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:42:04.693775 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a627ca1e-92b0-4b0a-a373-3b06483c8836 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:42:04.694425 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-a627ca1e-92b0-4b0a-a373-3b06483c8836 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] [instance: bd5e0e32-abf3-489b-9a1d-320689017006] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:42:04.697118 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=86,nova_api:DELETE=3,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:42:04.702509 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a627ca1e-92b0-4b0a-a373-3b06483c8836 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:04.703022 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a627ca1e-92b0-4b0a-a373-3b06483c8836 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:04.703463 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a627ca1e-92b0-4b0a-a373-3b06483c8836 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:04.704152 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a627ca1e-92b0-4b0a-a373-3b06483c8836 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:04.704606 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a627ca1e-92b0-4b0a-a373-3b06483c8836 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:04.705032 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a627ca1e-92b0-4b0a-a373-3b06483c8836 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:04.840827 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-a627ca1e-92b0-4b0a-a373-3b06483c8836 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991caa00be4b4a349e6a288dfd05becb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2055a333ba6542f4b23376eb443193a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:42:04.848579 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a627ca1e-92b0-4b0a-a373-3b06483c8836 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] 10.222.0.60 "GET /compute/v2.1/servers/bd5e0e32-abf3-489b-9a1d-320689017006" status: 200 len: 1515 microversion: 2.1 time: 0.158948 Sep 14 09:42:04.849157 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3404/6728] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:42:04 2022] GET /compute/v2.1/servers/bd5e0e32-abf3-489b-9a1d-320689017006 => generated 1515 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:42:05.871962 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d50f0602-2560-4027-a9da-d1f040e7630a tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:42:05.872646 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-d50f0602-2560-4027-a9da-d1f040e7630a tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] [instance: bd5e0e32-abf3-489b-9a1d-320689017006] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:42:05.879595 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d50f0602-2560-4027-a9da-d1f040e7630a tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:05.880150 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d50f0602-2560-4027-a9da-d1f040e7630a tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:05.880602 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d50f0602-2560-4027-a9da-d1f040e7630a tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:05.881301 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d50f0602-2560-4027-a9da-d1f040e7630a tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:05.881765 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d50f0602-2560-4027-a9da-d1f040e7630a tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:05.882195 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d50f0602-2560-4027-a9da-d1f040e7630a tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:06.011253 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-d50f0602-2560-4027-a9da-d1f040e7630a tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991caa00be4b4a349e6a288dfd05becb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2055a333ba6542f4b23376eb443193a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:42:06.019549 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d50f0602-2560-4027-a9da-d1f040e7630a tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] 10.222.0.60 "GET /compute/v2.1/servers/bd5e0e32-abf3-489b-9a1d-320689017006" status: 200 len: 1515 microversion: 2.1 time: 0.151138 Sep 14 09:42:06.020125 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3405/6729] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:42:05 2022] GET /compute/v2.1/servers/bd5e0e32-abf3-489b-9a1d-320689017006 => generated 1515 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:42:07.042449 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-2cbb45f2-885b-4c9f-8420-e327f838e067 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:42:07.043106 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-2cbb45f2-885b-4c9f-8420-e327f838e067 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] [instance: bd5e0e32-abf3-489b-9a1d-320689017006] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:42:07.049994 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2cbb45f2-885b-4c9f-8420-e327f838e067 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:07.050525 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2cbb45f2-885b-4c9f-8420-e327f838e067 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:07.051520 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2cbb45f2-885b-4c9f-8420-e327f838e067 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:07.052226 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2cbb45f2-885b-4c9f-8420-e327f838e067 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:07.052685 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2cbb45f2-885b-4c9f-8420-e327f838e067 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:07.053114 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2cbb45f2-885b-4c9f-8420-e327f838e067 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:07.185537 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-2cbb45f2-885b-4c9f-8420-e327f838e067 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991caa00be4b4a349e6a288dfd05becb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2055a333ba6542f4b23376eb443193a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:42:07.193444 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-2cbb45f2-885b-4c9f-8420-e327f838e067 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] 10.222.0.60 "GET /compute/v2.1/servers/bd5e0e32-abf3-489b-9a1d-320689017006" status: 200 len: 1515 microversion: 2.1 time: 0.155026 Sep 14 09:42:07.194024 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3406/6730] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:42:07 2022] GET /compute/v2.1/servers/bd5e0e32-abf3-489b-9a1d-320689017006 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:42:08.216510 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-7075fcc5-5b00-4d25-8c0b-c290c50fa035 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:42:08.217137 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-7075fcc5-5b00-4d25-8c0b-c290c50fa035 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] [instance: bd5e0e32-abf3-489b-9a1d-320689017006] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:42:08.223896 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7075fcc5-5b00-4d25-8c0b-c290c50fa035 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:08.224384 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7075fcc5-5b00-4d25-8c0b-c290c50fa035 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:08.224824 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7075fcc5-5b00-4d25-8c0b-c290c50fa035 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:08.225512 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7075fcc5-5b00-4d25-8c0b-c290c50fa035 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:08.225969 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7075fcc5-5b00-4d25-8c0b-c290c50fa035 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:08.226396 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7075fcc5-5b00-4d25-8c0b-c290c50fa035 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:08.355735 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-7075fcc5-5b00-4d25-8c0b-c290c50fa035 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991caa00be4b4a349e6a288dfd05becb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2055a333ba6542f4b23376eb443193a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:42:08.363530 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-7075fcc5-5b00-4d25-8c0b-c290c50fa035 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] 10.222.0.60 "GET /compute/v2.1/servers/bd5e0e32-abf3-489b-9a1d-320689017006" status: 200 len: 1515 microversion: 2.1 time: 0.151348 Sep 14 09:42:08.364103 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3407/6731] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:42:08 2022] GET /compute/v2.1/servers/bd5e0e32-abf3-489b-9a1d-320689017006 => generated 1515 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:42:09.387216 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-5ca1bd2d-9d4a-42f5-8416-573395f173c6 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:42:09.387864 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-5ca1bd2d-9d4a-42f5-8416-573395f173c6 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] [instance: bd5e0e32-abf3-489b-9a1d-320689017006] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:42:09.394754 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5ca1bd2d-9d4a-42f5-8416-573395f173c6 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:09.395354 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5ca1bd2d-9d4a-42f5-8416-573395f173c6 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:09.395843 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5ca1bd2d-9d4a-42f5-8416-573395f173c6 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:09.396532 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5ca1bd2d-9d4a-42f5-8416-573395f173c6 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:09.396996 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5ca1bd2d-9d4a-42f5-8416-573395f173c6 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:09.397431 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5ca1bd2d-9d4a-42f5-8416-573395f173c6 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:09.528416 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-5ca1bd2d-9d4a-42f5-8416-573395f173c6 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991caa00be4b4a349e6a288dfd05becb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2055a333ba6542f4b23376eb443193a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:42:09.536174 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-5ca1bd2d-9d4a-42f5-8416-573395f173c6 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] 10.222.0.60 "GET /compute/v2.1/servers/bd5e0e32-abf3-489b-9a1d-320689017006" status: 200 len: 1515 microversion: 2.1 time: 0.153090 Sep 14 09:42:09.538436 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3408/6732] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:42:09 2022] GET /compute/v2.1/servers/bd5e0e32-abf3-489b-9a1d-320689017006 => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:42:10.560571 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d2c6bab3-683a-4739-8796-6a343770202c tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:42:10.561226 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-d2c6bab3-683a-4739-8796-6a343770202c tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] [instance: bd5e0e32-abf3-489b-9a1d-320689017006] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:42:10.568281 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d2c6bab3-683a-4739-8796-6a343770202c tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:10.568779 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d2c6bab3-683a-4739-8796-6a343770202c tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:10.569225 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d2c6bab3-683a-4739-8796-6a343770202c tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:10.569951 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d2c6bab3-683a-4739-8796-6a343770202c tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:10.570413 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d2c6bab3-683a-4739-8796-6a343770202c tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:10.570848 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d2c6bab3-683a-4739-8796-6a343770202c tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:10.703422 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-d2c6bab3-683a-4739-8796-6a343770202c tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991caa00be4b4a349e6a288dfd05becb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2055a333ba6542f4b23376eb443193a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:42:10.711781 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d2c6bab3-683a-4739-8796-6a343770202c tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] 10.222.0.60 "GET /compute/v2.1/servers/bd5e0e32-abf3-489b-9a1d-320689017006" status: 200 len: 1515 microversion: 2.1 time: 0.155175 Sep 14 09:42:10.712365 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3409/6733] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:42:10 2022] GET /compute/v2.1/servers/bd5e0e32-abf3-489b-9a1d-320689017006 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:42:11.735291 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-fb28c42d-9b22-4d84-9544-1b0921111401 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:42:11.735951 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-fb28c42d-9b22-4d84-9544-1b0921111401 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] [instance: bd5e0e32-abf3-489b-9a1d-320689017006] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:42:11.742930 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fb28c42d-9b22-4d84-9544-1b0921111401 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:11.743453 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fb28c42d-9b22-4d84-9544-1b0921111401 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:11.743902 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fb28c42d-9b22-4d84-9544-1b0921111401 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:11.744712 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fb28c42d-9b22-4d84-9544-1b0921111401 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:11.745185 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fb28c42d-9b22-4d84-9544-1b0921111401 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:11.745649 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fb28c42d-9b22-4d84-9544-1b0921111401 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:11.875235 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-fb28c42d-9b22-4d84-9544-1b0921111401 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991caa00be4b4a349e6a288dfd05becb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2055a333ba6542f4b23376eb443193a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:42:11.883675 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-fb28c42d-9b22-4d84-9544-1b0921111401 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] 10.222.0.60 "GET /compute/v2.1/servers/bd5e0e32-abf3-489b-9a1d-320689017006" status: 200 len: 1515 microversion: 2.1 time: 0.152478 Sep 14 09:42:11.884256 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3410/6734] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:42:11 2022] GET /compute/v2.1/servers/bd5e0e32-abf3-489b-9a1d-320689017006 => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:42:12.906146 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3bd5705e-a2cf-4ef4-82bc-854273282822 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:42:12.906773 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-3bd5705e-a2cf-4ef4-82bc-854273282822 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] [instance: bd5e0e32-abf3-489b-9a1d-320689017006] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:42:12.914390 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3bd5705e-a2cf-4ef4-82bc-854273282822 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:12.914883 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3bd5705e-a2cf-4ef4-82bc-854273282822 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:12.915358 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3bd5705e-a2cf-4ef4-82bc-854273282822 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:12.916058 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3bd5705e-a2cf-4ef4-82bc-854273282822 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:12.916520 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3bd5705e-a2cf-4ef4-82bc-854273282822 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:12.916954 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3bd5705e-a2cf-4ef4-82bc-854273282822 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:13.047796 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-3bd5705e-a2cf-4ef4-82bc-854273282822 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991caa00be4b4a349e6a288dfd05becb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2055a333ba6542f4b23376eb443193a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:42:13.051282 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=100 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:42:13.057400 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-3bd5705e-a2cf-4ef4-82bc-854273282822 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] 10.222.0.60 "GET /compute/v2.1/servers/bd5e0e32-abf3-489b-9a1d-320689017006" status: 200 len: 1515 microversion: 2.1 time: 0.155179 Sep 14 09:42:13.057983 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3411/6735] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:42:12 2022] GET /compute/v2.1/servers/bd5e0e32-abf3-489b-9a1d-320689017006 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:42:14.081147 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-1bfbe176-e135-492a-90d1-c556351d83cd tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:42:14.081786 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-1bfbe176-e135-492a-90d1-c556351d83cd tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] [instance: bd5e0e32-abf3-489b-9a1d-320689017006] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:42:14.090301 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1bfbe176-e135-492a-90d1-c556351d83cd tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:14.090797 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1bfbe176-e135-492a-90d1-c556351d83cd tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:14.091285 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1bfbe176-e135-492a-90d1-c556351d83cd tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:14.091983 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1bfbe176-e135-492a-90d1-c556351d83cd tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:14.092449 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1bfbe176-e135-492a-90d1-c556351d83cd tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:14.092882 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1bfbe176-e135-492a-90d1-c556351d83cd tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:14.229046 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-1bfbe176-e135-492a-90d1-c556351d83cd tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991caa00be4b4a349e6a288dfd05becb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2055a333ba6542f4b23376eb443193a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:42:14.236978 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-1bfbe176-e135-492a-90d1-c556351d83cd tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] 10.222.0.60 "GET /compute/v2.1/servers/bd5e0e32-abf3-489b-9a1d-320689017006" status: 200 len: 1515 microversion: 2.1 time: 0.159863 Sep 14 09:42:14.237562 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3412/6736] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:42:14 2022] GET /compute/v2.1/servers/bd5e0e32-abf3-489b-9a1d-320689017006 => generated 1515 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:42:15.260185 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-14cbfe33-58bb-4b75-bcda-34946ff420e1 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:42:15.260809 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-14cbfe33-58bb-4b75-bcda-34946ff420e1 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] [instance: bd5e0e32-abf3-489b-9a1d-320689017006] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:42:15.267772 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-14cbfe33-58bb-4b75-bcda-34946ff420e1 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:15.268304 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-14cbfe33-58bb-4b75-bcda-34946ff420e1 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:15.268751 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-14cbfe33-58bb-4b75-bcda-34946ff420e1 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:15.269448 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-14cbfe33-58bb-4b75-bcda-34946ff420e1 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:15.269926 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-14cbfe33-58bb-4b75-bcda-34946ff420e1 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:15.270359 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-14cbfe33-58bb-4b75-bcda-34946ff420e1 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:15.400644 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-14cbfe33-58bb-4b75-bcda-34946ff420e1 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991caa00be4b4a349e6a288dfd05becb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2055a333ba6542f4b23376eb443193a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:42:15.408800 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-14cbfe33-58bb-4b75-bcda-34946ff420e1 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] 10.222.0.60 "GET /compute/v2.1/servers/bd5e0e32-abf3-489b-9a1d-320689017006" status: 200 len: 1515 microversion: 2.1 time: 0.152690 Sep 14 09:42:15.409387 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3413/6737] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:42:15 2022] GET /compute/v2.1/servers/bd5e0e32-abf3-489b-9a1d-320689017006 => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:42:16.432542 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8c45c1d1-3724-40cf-a73d-41269496f060 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:42:16.433179 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-8c45c1d1-3724-40cf-a73d-41269496f060 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] [instance: bd5e0e32-abf3-489b-9a1d-320689017006] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:42:16.440355 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8c45c1d1-3724-40cf-a73d-41269496f060 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:16.440838 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8c45c1d1-3724-40cf-a73d-41269496f060 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:16.441291 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8c45c1d1-3724-40cf-a73d-41269496f060 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:16.441974 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8c45c1d1-3724-40cf-a73d-41269496f060 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:16.442426 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8c45c1d1-3724-40cf-a73d-41269496f060 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:16.442856 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8c45c1d1-3724-40cf-a73d-41269496f060 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:16.575930 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-8c45c1d1-3724-40cf-a73d-41269496f060 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991caa00be4b4a349e6a288dfd05becb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2055a333ba6542f4b23376eb443193a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:42:16.584434 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-8c45c1d1-3724-40cf-a73d-41269496f060 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] 10.222.0.60 "GET /compute/v2.1/servers/bd5e0e32-abf3-489b-9a1d-320689017006" status: 200 len: 1515 microversion: 2.1 time: 0.155327 Sep 14 09:42:16.585023 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3414/6738] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:42:16 2022] GET /compute/v2.1/servers/bd5e0e32-abf3-489b-9a1d-320689017006 => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:42:17.608786 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-71a084a5-ab9b-498c-ae08-c17eb89e08b6 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:42:17.609459 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-71a084a5-ab9b-498c-ae08-c17eb89e08b6 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] [instance: bd5e0e32-abf3-489b-9a1d-320689017006] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:42:17.616430 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-71a084a5-ab9b-498c-ae08-c17eb89e08b6 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:17.617260 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-71a084a5-ab9b-498c-ae08-c17eb89e08b6 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:17.617375 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-71a084a5-ab9b-498c-ae08-c17eb89e08b6 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:17.618077 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-71a084a5-ab9b-498c-ae08-c17eb89e08b6 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:17.618527 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-71a084a5-ab9b-498c-ae08-c17eb89e08b6 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:17.619135 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-71a084a5-ab9b-498c-ae08-c17eb89e08b6 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:17.750080 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-71a084a5-ab9b-498c-ae08-c17eb89e08b6 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991caa00be4b4a349e6a288dfd05becb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2055a333ba6542f4b23376eb443193a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:42:17.758422 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-71a084a5-ab9b-498c-ae08-c17eb89e08b6 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] 10.222.0.60 "GET /compute/v2.1/servers/bd5e0e32-abf3-489b-9a1d-320689017006" status: 200 len: 1515 microversion: 2.1 time: 0.153726 Sep 14 09:42:17.759014 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3415/6739] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:42:17 2022] GET /compute/v2.1/servers/bd5e0e32-abf3-489b-9a1d-320689017006 => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:42:18.782082 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3ef19bd5-89f9-4d51-a0d6-120f024a3645 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:42:18.782713 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-3ef19bd5-89f9-4d51-a0d6-120f024a3645 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] [instance: bd5e0e32-abf3-489b-9a1d-320689017006] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:42:18.789688 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3ef19bd5-89f9-4d51-a0d6-120f024a3645 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:18.790179 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3ef19bd5-89f9-4d51-a0d6-120f024a3645 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:18.790623 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3ef19bd5-89f9-4d51-a0d6-120f024a3645 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:18.791341 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3ef19bd5-89f9-4d51-a0d6-120f024a3645 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:18.791804 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3ef19bd5-89f9-4d51-a0d6-120f024a3645 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:18.792236 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3ef19bd5-89f9-4d51-a0d6-120f024a3645 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:18.931425 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-3ef19bd5-89f9-4d51-a0d6-120f024a3645 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991caa00be4b4a349e6a288dfd05becb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2055a333ba6542f4b23376eb443193a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:42:18.943647 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-3ef19bd5-89f9-4d51-a0d6-120f024a3645 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] 10.222.0.60 "GET /compute/v2.1/servers/bd5e0e32-abf3-489b-9a1d-320689017006" status: 200 len: 1515 microversion: 2.1 time: 0.164436 Sep 14 09:42:18.944251 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3416/6740] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:42:18 2022] GET /compute/v2.1/servers/bd5e0e32-abf3-489b-9a1d-320689017006 => generated 1515 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:42:19.968044 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-adeb7db5-9170-4a05-ab92-7634eda72e93 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:42:19.968713 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-adeb7db5-9170-4a05-ab92-7634eda72e93 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] [instance: bd5e0e32-abf3-489b-9a1d-320689017006] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:42:19.976112 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-adeb7db5-9170-4a05-ab92-7634eda72e93 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:19.976593 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-adeb7db5-9170-4a05-ab92-7634eda72e93 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:19.977030 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-adeb7db5-9170-4a05-ab92-7634eda72e93 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:19.977720 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-adeb7db5-9170-4a05-ab92-7634eda72e93 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:19.978174 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-adeb7db5-9170-4a05-ab92-7634eda72e93 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:19.978596 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-adeb7db5-9170-4a05-ab92-7634eda72e93 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:20.107621 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-adeb7db5-9170-4a05-ab92-7634eda72e93 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991caa00be4b4a349e6a288dfd05becb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2055a333ba6542f4b23376eb443193a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:42:20.115566 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-adeb7db5-9170-4a05-ab92-7634eda72e93 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] 10.222.0.60 "GET /compute/v2.1/servers/bd5e0e32-abf3-489b-9a1d-320689017006" status: 200 len: 1515 microversion: 2.1 time: 0.151476 Sep 14 09:42:20.116147 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3417/6741] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:42:19 2022] GET /compute/v2.1/servers/bd5e0e32-abf3-489b-9a1d-320689017006 => generated 1515 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:42:21.137837 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f3dc10e9-de59-4bae-815f-2c542da47991 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:42:21.138467 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f3dc10e9-de59-4bae-815f-2c542da47991 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] [instance: bd5e0e32-abf3-489b-9a1d-320689017006] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:42:21.145662 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f3dc10e9-de59-4bae-815f-2c542da47991 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:21.146149 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f3dc10e9-de59-4bae-815f-2c542da47991 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:21.146597 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f3dc10e9-de59-4bae-815f-2c542da47991 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:21.147333 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f3dc10e9-de59-4bae-815f-2c542da47991 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:21.148081 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f3dc10e9-de59-4bae-815f-2c542da47991 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:21.148210 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f3dc10e9-de59-4bae-815f-2c542da47991 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:21.282337 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f3dc10e9-de59-4bae-815f-2c542da47991 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991caa00be4b4a349e6a288dfd05becb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2055a333ba6542f4b23376eb443193a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:42:21.290848 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f3dc10e9-de59-4bae-815f-2c542da47991 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] 10.222.0.60 "GET /compute/v2.1/servers/bd5e0e32-abf3-489b-9a1d-320689017006" status: 200 len: 1515 microversion: 2.1 time: 0.156944 Sep 14 09:42:21.291461 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3418/6742] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:42:21 2022] GET /compute/v2.1/servers/bd5e0e32-abf3-489b-9a1d-320689017006 => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:42:22.315028 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-47675235-2298-4185-bf4f-67f6484c44f2 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:42:22.315696 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-47675235-2298-4185-bf4f-67f6484c44f2 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] [instance: bd5e0e32-abf3-489b-9a1d-320689017006] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:42:22.322651 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-47675235-2298-4185-bf4f-67f6484c44f2 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:22.323184 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-47675235-2298-4185-bf4f-67f6484c44f2 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:22.323635 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-47675235-2298-4185-bf4f-67f6484c44f2 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:22.324337 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-47675235-2298-4185-bf4f-67f6484c44f2 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:22.324802 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-47675235-2298-4185-bf4f-67f6484c44f2 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:22.325235 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-47675235-2298-4185-bf4f-67f6484c44f2 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:22.457304 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-47675235-2298-4185-bf4f-67f6484c44f2 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991caa00be4b4a349e6a288dfd05becb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2055a333ba6542f4b23376eb443193a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:42:22.465869 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-47675235-2298-4185-bf4f-67f6484c44f2 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] 10.222.0.60 "GET /compute/v2.1/servers/bd5e0e32-abf3-489b-9a1d-320689017006" status: 200 len: 1515 microversion: 2.1 time: 0.154835 Sep 14 09:42:22.466444 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3419/6743] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:42:22 2022] GET /compute/v2.1/servers/bd5e0e32-abf3-489b-9a1d-320689017006 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:42:23.491829 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ee631004-b0e4-4048-b63d-8325e8235367 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:42:23.492883 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-ee631004-b0e4-4048-b63d-8325e8235367 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] [instance: bd5e0e32-abf3-489b-9a1d-320689017006] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:42:23.500095 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ee631004-b0e4-4048-b63d-8325e8235367 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:23.500585 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ee631004-b0e4-4048-b63d-8325e8235367 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:23.501028 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ee631004-b0e4-4048-b63d-8325e8235367 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:23.501783 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ee631004-b0e4-4048-b63d-8325e8235367 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:23.502272 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ee631004-b0e4-4048-b63d-8325e8235367 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:23.502707 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ee631004-b0e4-4048-b63d-8325e8235367 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:23.637413 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-ee631004-b0e4-4048-b63d-8325e8235367 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991caa00be4b4a349e6a288dfd05becb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2055a333ba6542f4b23376eb443193a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:42:23.645483 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-ee631004-b0e4-4048-b63d-8325e8235367 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] 10.222.0.60 "GET /compute/v2.1/servers/bd5e0e32-abf3-489b-9a1d-320689017006" status: 200 len: 1515 microversion: 2.1 time: 0.158305 Sep 14 09:42:23.646072 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3420/6744] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:42:23 2022] GET /compute/v2.1/servers/bd5e0e32-abf3-489b-9a1d-320689017006 => generated 1515 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:42:24.668747 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-4966ea68-a75b-4d1c-a5b3-e4bcf0c2d742 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:42:24.669346 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-4966ea68-a75b-4d1c-a5b3-e4bcf0c2d742 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] [instance: bd5e0e32-abf3-489b-9a1d-320689017006] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:42:24.676080 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4966ea68-a75b-4d1c-a5b3-e4bcf0c2d742 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:24.676569 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4966ea68-a75b-4d1c-a5b3-e4bcf0c2d742 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:24.677011 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4966ea68-a75b-4d1c-a5b3-e4bcf0c2d742 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:24.678218 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4966ea68-a75b-4d1c-a5b3-e4bcf0c2d742 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:24.678677 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4966ea68-a75b-4d1c-a5b3-e4bcf0c2d742 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:24.679133 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4966ea68-a75b-4d1c-a5b3-e4bcf0c2d742 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:24.813050 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-4966ea68-a75b-4d1c-a5b3-e4bcf0c2d742 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991caa00be4b4a349e6a288dfd05becb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2055a333ba6542f4b23376eb443193a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:42:24.821330 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-4966ea68-a75b-4d1c-a5b3-e4bcf0c2d742 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] 10.222.0.60 "GET /compute/v2.1/servers/bd5e0e32-abf3-489b-9a1d-320689017006" status: 200 len: 1515 microversion: 2.1 time: 0.156765 Sep 14 09:42:24.821899 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3421/6745] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:42:24 2022] GET /compute/v2.1/servers/bd5e0e32-abf3-489b-9a1d-320689017006 => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:42:25.845648 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-87f23e8a-a4ff-422a-9799-f5f7e65cc196 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:42:25.846283 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-87f23e8a-a4ff-422a-9799-f5f7e65cc196 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] [instance: bd5e0e32-abf3-489b-9a1d-320689017006] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:42:25.853327 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-87f23e8a-a4ff-422a-9799-f5f7e65cc196 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:25.853812 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-87f23e8a-a4ff-422a-9799-f5f7e65cc196 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:25.854250 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-87f23e8a-a4ff-422a-9799-f5f7e65cc196 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:25.854968 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-87f23e8a-a4ff-422a-9799-f5f7e65cc196 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:25.855422 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-87f23e8a-a4ff-422a-9799-f5f7e65cc196 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:25.855847 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-87f23e8a-a4ff-422a-9799-f5f7e65cc196 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:25.984431 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-87f23e8a-a4ff-422a-9799-f5f7e65cc196 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991caa00be4b4a349e6a288dfd05becb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2055a333ba6542f4b23376eb443193a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:42:25.992828 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-87f23e8a-a4ff-422a-9799-f5f7e65cc196 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] 10.222.0.60 "GET /compute/v2.1/servers/bd5e0e32-abf3-489b-9a1d-320689017006" status: 200 len: 1515 microversion: 2.1 time: 0.151373 Sep 14 09:42:25.993401 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3422/6746] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:42:25 2022] GET /compute/v2.1/servers/bd5e0e32-abf3-489b-9a1d-320689017006 => generated 1515 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:42:27.016182 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-63610c98-2605-4dcc-b1fb-00fe7d607362 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:42:27.016811 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-63610c98-2605-4dcc-b1fb-00fe7d607362 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] [instance: bd5e0e32-abf3-489b-9a1d-320689017006] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:42:27.024259 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-63610c98-2605-4dcc-b1fb-00fe7d607362 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:27.024730 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-63610c98-2605-4dcc-b1fb-00fe7d607362 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:27.025165 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-63610c98-2605-4dcc-b1fb-00fe7d607362 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:27.025848 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-63610c98-2605-4dcc-b1fb-00fe7d607362 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:27.026300 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-63610c98-2605-4dcc-b1fb-00fe7d607362 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:27.026724 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-63610c98-2605-4dcc-b1fb-00fe7d607362 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:27.159047 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-63610c98-2605-4dcc-b1fb-00fe7d607362 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991caa00be4b4a349e6a288dfd05becb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2055a333ba6542f4b23376eb443193a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:42:27.166833 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-63610c98-2605-4dcc-b1fb-00fe7d607362 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] 10.222.0.60 "GET /compute/v2.1/servers/bd5e0e32-abf3-489b-9a1d-320689017006" status: 200 len: 1515 microversion: 2.1 time: 0.154615 Sep 14 09:42:27.167431 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3423/6747] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:42:27 2022] GET /compute/v2.1/servers/bd5e0e32-abf3-489b-9a1d-320689017006 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:42:28.190348 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-5612db20-c792-4bcb-8af0-ad0a512987c1 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:42:28.191026 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-5612db20-c792-4bcb-8af0-ad0a512987c1 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] [instance: bd5e0e32-abf3-489b-9a1d-320689017006] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:42:28.198493 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5612db20-c792-4bcb-8af0-ad0a512987c1 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:28.199018 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5612db20-c792-4bcb-8af0-ad0a512987c1 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:28.199455 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5612db20-c792-4bcb-8af0-ad0a512987c1 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:28.200151 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5612db20-c792-4bcb-8af0-ad0a512987c1 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:28.200604 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5612db20-c792-4bcb-8af0-ad0a512987c1 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:28.201029 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5612db20-c792-4bcb-8af0-ad0a512987c1 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:28.332851 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-5612db20-c792-4bcb-8af0-ad0a512987c1 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991caa00be4b4a349e6a288dfd05becb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2055a333ba6542f4b23376eb443193a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:42:28.341045 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-5612db20-c792-4bcb-8af0-ad0a512987c1 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] 10.222.0.60 "GET /compute/v2.1/servers/bd5e0e32-abf3-489b-9a1d-320689017006" status: 200 len: 1514 microversion: 2.1 time: 0.155071 Sep 14 09:42:28.341774 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3424/6748] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:42:28 2022] GET /compute/v2.1/servers/bd5e0e32-abf3-489b-9a1d-320689017006 => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:42:28.631453 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-e8aee96b-19bd-4cce-93ad-2b7f64fc161e req-22ac27df-aae3-4ca7-aaeb-bcfa184b9ebb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd5e0e32-abf3-489b-9a1d-320689017006", "name": "network-vif-unplugged", "status": "completed", "tag": "6f6489aa-538a-4e09-a882-eaf3895af2ad"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:42:28.641329 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-e8aee96b-19bd-4cce-93ad-2b7f64fc161e req-22ac27df-aae3-4ca7-aaeb-bcfa184b9ebb service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:28.641828 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-e8aee96b-19bd-4cce-93ad-2b7f64fc161e req-22ac27df-aae3-4ca7-aaeb-bcfa184b9ebb service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:28.642266 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-e8aee96b-19bd-4cce-93ad-2b7f64fc161e req-22ac27df-aae3-4ca7-aaeb-bcfa184b9ebb service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:28.654424 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-e8aee96b-19bd-4cce-93ad-2b7f64fc161e req-22ac27df-aae3-4ca7-aaeb-bcfa184b9ebb service nova] Creating event network-vif-unplugged:6f6489aa-538a-4e09-a882-eaf3895af2ad for instance bd5e0e32-abf3-489b-9a1d-320689017006 on n-h1-836830-18 Sep 14 09:42:28.660044 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [req-e8aee96b-19bd-4cce-93ad-2b7f64fc161e req-22ac27df-aae3-4ca7-aaeb-bcfa184b9ebb service nova] Instance bd5e0e32-abf3-489b-9a1d-320689017006 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-836830-18', 'n-h2-836830-18'} {{(pid=128759) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 14 09:42:28.671673 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-e8aee96b-19bd-4cce-93ad-2b7f64fc161e req-22ac27df-aae3-4ca7-aaeb-bcfa184b9ebb service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044521 Sep 14 09:42:28.672607 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3425/6749] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:42:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:42:29.367005 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-fb8d83de-f6b9-4e7f-ac00-258396154d6e tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:42:29.368854 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-fb8d83de-f6b9-4e7f-ac00-258396154d6e tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] [instance: bd5e0e32-abf3-489b-9a1d-320689017006] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:42:29.376306 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fb8d83de-f6b9-4e7f-ac00-258396154d6e tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:29.376814 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fb8d83de-f6b9-4e7f-ac00-258396154d6e tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:29.377595 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fb8d83de-f6b9-4e7f-ac00-258396154d6e tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:29.378011 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fb8d83de-f6b9-4e7f-ac00-258396154d6e tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:29.378476 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fb8d83de-f6b9-4e7f-ac00-258396154d6e tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:29.378906 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fb8d83de-f6b9-4e7f-ac00-258396154d6e tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:29.525053 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-fb8d83de-f6b9-4e7f-ac00-258396154d6e tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991caa00be4b4a349e6a288dfd05becb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2055a333ba6542f4b23376eb443193a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:42:29.535410 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-fb8d83de-f6b9-4e7f-ac00-258396154d6e tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] 10.222.0.60 "GET /compute/v2.1/servers/bd5e0e32-abf3-489b-9a1d-320689017006" status: 200 len: 1514 microversion: 2.1 time: 0.174100 Sep 14 09:42:29.536052 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3426/6750] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:42:29 2022] GET /compute/v2.1/servers/bd5e0e32-abf3-489b-9a1d-320689017006 => generated 1514 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:42:30.560683 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-6dff617b-fc93-4610-9ad9-2a9adc2728fd tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:42:30.561295 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-6dff617b-fc93-4610-9ad9-2a9adc2728fd tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] [instance: bd5e0e32-abf3-489b-9a1d-320689017006] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:42:30.568353 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6dff617b-fc93-4610-9ad9-2a9adc2728fd tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:30.568859 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6dff617b-fc93-4610-9ad9-2a9adc2728fd tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:30.569301 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6dff617b-fc93-4610-9ad9-2a9adc2728fd tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:30.570018 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6dff617b-fc93-4610-9ad9-2a9adc2728fd tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:30.570477 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6dff617b-fc93-4610-9ad9-2a9adc2728fd tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:30.570904 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6dff617b-fc93-4610-9ad9-2a9adc2728fd tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:30.704298 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-6dff617b-fc93-4610-9ad9-2a9adc2728fd tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991caa00be4b4a349e6a288dfd05becb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2055a333ba6542f4b23376eb443193a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:42:30.713521 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-6dff617b-fc93-4610-9ad9-2a9adc2728fd tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] 10.222.0.60 "GET /compute/v2.1/servers/bd5e0e32-abf3-489b-9a1d-320689017006" status: 200 len: 1512 microversion: 2.1 time: 0.156552 Sep 14 09:42:30.714146 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3427/6751] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:42:30 2022] GET /compute/v2.1/servers/bd5e0e32-abf3-489b-9a1d-320689017006 => generated 1512 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:42:30.719101 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-bcb98ae3-a07c-4612-9243-5d943ceaacb4 req-9d6881f2-ae6c-4358-8be6-5c181d71e21b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd5e0e32-abf3-489b-9a1d-320689017006", "tag": "6f6489aa-538a-4e09-a882-eaf3895af2ad"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:42:30.728876 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-bcb98ae3-a07c-4612-9243-5d943ceaacb4 req-9d6881f2-ae6c-4358-8be6-5c181d71e21b service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:30.729402 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-bcb98ae3-a07c-4612-9243-5d943ceaacb4 req-9d6881f2-ae6c-4358-8be6-5c181d71e21b service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:30.729896 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-bcb98ae3-a07c-4612-9243-5d943ceaacb4 req-9d6881f2-ae6c-4358-8be6-5c181d71e21b service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:30.742081 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-bcb98ae3-a07c-4612-9243-5d943ceaacb4 req-9d6881f2-ae6c-4358-8be6-5c181d71e21b service nova] Creating event network-changed:6f6489aa-538a-4e09-a882-eaf3895af2ad for instance bd5e0e32-abf3-489b-9a1d-320689017006 on n-h1-836830-18 Sep 14 09:42:30.747601 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [req-bcb98ae3-a07c-4612-9243-5d943ceaacb4 req-9d6881f2-ae6c-4358-8be6-5c181d71e21b service nova] Instance bd5e0e32-abf3-489b-9a1d-320689017006 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-836830-18', 'n-h2-836830-18'} {{(pid=128759) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 14 09:42:30.758463 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-bcb98ae3-a07c-4612-9243-5d943ceaacb4 req-9d6881f2-ae6c-4358-8be6-5c181d71e21b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043072 Sep 14 09:42:30.759139 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3428/6752] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:42:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:42:31.739252 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-90f3d9b4-0271-4263-a2ec-32c541d95421 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:42:31.739968 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-90f3d9b4-0271-4263-a2ec-32c541d95421 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] [instance: bd5e0e32-abf3-489b-9a1d-320689017006] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:42:31.746215 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-90f3d9b4-0271-4263-a2ec-32c541d95421 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:31.746707 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-90f3d9b4-0271-4263-a2ec-32c541d95421 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:31.747178 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-90f3d9b4-0271-4263-a2ec-32c541d95421 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:31.747866 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-90f3d9b4-0271-4263-a2ec-32c541d95421 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:31.748326 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-90f3d9b4-0271-4263-a2ec-32c541d95421 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:31.748754 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-90f3d9b4-0271-4263-a2ec-32c541d95421 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:31.752887 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=100 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:42:31.881889 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-90f3d9b4-0271-4263-a2ec-32c541d95421 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991caa00be4b4a349e6a288dfd05becb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2055a333ba6542f4b23376eb443193a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:42:31.889669 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-90f3d9b4-0271-4263-a2ec-32c541d95421 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] 10.222.0.60 "GET /compute/v2.1/servers/bd5e0e32-abf3-489b-9a1d-320689017006" status: 200 len: 1512 microversion: 2.1 time: 0.155656 Sep 14 09:42:31.890241 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3429/6753] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:42:31 2022] GET /compute/v2.1/servers/bd5e0e32-abf3-489b-9a1d-320689017006 => generated 1512 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:42:32.913951 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-21ea8ca1-6233-4fc8-bf94-7da6f736c250 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:42:32.914720 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-21ea8ca1-6233-4fc8-bf94-7da6f736c250 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] [instance: bd5e0e32-abf3-489b-9a1d-320689017006] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:42:32.921675 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-21ea8ca1-6233-4fc8-bf94-7da6f736c250 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:32.922173 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-21ea8ca1-6233-4fc8-bf94-7da6f736c250 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:32.922624 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-21ea8ca1-6233-4fc8-bf94-7da6f736c250 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:32.923351 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-21ea8ca1-6233-4fc8-bf94-7da6f736c250 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:32.923815 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-21ea8ca1-6233-4fc8-bf94-7da6f736c250 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:32.924250 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-21ea8ca1-6233-4fc8-bf94-7da6f736c250 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:33.063383 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-21ea8ca1-6233-4fc8-bf94-7da6f736c250 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991caa00be4b4a349e6a288dfd05becb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2055a333ba6542f4b23376eb443193a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:42:33.072986 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-21ea8ca1-6233-4fc8-bf94-7da6f736c250 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] 10.222.0.60 "GET /compute/v2.1/servers/bd5e0e32-abf3-489b-9a1d-320689017006" status: 200 len: 1509 microversion: 2.1 time: 0.163525 Sep 14 09:42:33.073577 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3430/6754] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:42:32 2022] GET /compute/v2.1/servers/bd5e0e32-abf3-489b-9a1d-320689017006 => generated 1509 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:42:33.096023 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-790ef26a-9a50-40b7-bffa-0c6176a80602 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:42:33.096668 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-790ef26a-9a50-40b7-bffa-0c6176a80602 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] [instance: bd5e0e32-abf3-489b-9a1d-320689017006] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:42:33.103305 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-790ef26a-9a50-40b7-bffa-0c6176a80602 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:33.103800 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-790ef26a-9a50-40b7-bffa-0c6176a80602 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:33.104239 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-790ef26a-9a50-40b7-bffa-0c6176a80602 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:33.104937 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-790ef26a-9a50-40b7-bffa-0c6176a80602 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:33.105398 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-790ef26a-9a50-40b7-bffa-0c6176a80602 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:33.105828 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-790ef26a-9a50-40b7-bffa-0c6176a80602 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:33.132795 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-790ef26a-9a50-40b7-bffa-0c6176a80602 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] [instance: bd5e0e32-abf3-489b-9a1d-320689017006] Going to try to terminate instance {{(pid=128759) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:42:33.184050 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.compute.api [None req-790ef26a-9a50-40b7-bffa-0c6176a80602 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] [instance: bd5e0e32-abf3-489b-9a1d-320689017006] Found an unconfirmed migration during delete, id: 16, status: finished Sep 14 09:42:34.519925 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-790ef26a-9a50-40b7-bffa-0c6176a80602 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] 10.222.0.60 "DELETE /compute/v2.1/servers/bd5e0e32-abf3-489b-9a1d-320689017006" status: 204 len: 0 microversion: 2.1 time: 1.427583 Sep 14 09:42:34.520734 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3431/6755] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:42:33 2022] DELETE /compute/v2.1/servers/bd5e0e32-abf3-489b-9a1d-320689017006 => generated 0 bytes in 1429 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 14 09:42:34.529664 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-4f51f636-9f60-4c25-8d4e-61b747181810 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:42:34.530380 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-4f51f636-9f60-4c25-8d4e-61b747181810 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] [instance: bd5e0e32-abf3-489b-9a1d-320689017006] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:42:34.537386 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4f51f636-9f60-4c25-8d4e-61b747181810 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:34.537878 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4f51f636-9f60-4c25-8d4e-61b747181810 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:34.538323 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4f51f636-9f60-4c25-8d4e-61b747181810 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:34.539059 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4f51f636-9f60-4c25-8d4e-61b747181810 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:34.539525 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4f51f636-9f60-4c25-8d4e-61b747181810 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:34.539959 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4f51f636-9f60-4c25-8d4e-61b747181810 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:34.672303 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-4f51f636-9f60-4c25-8d4e-61b747181810 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991caa00be4b4a349e6a288dfd05becb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2055a333ba6542f4b23376eb443193a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:42:34.680758 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-4f51f636-9f60-4c25-8d4e-61b747181810 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] 10.222.0.60 "GET /compute/v2.1/servers/bd5e0e32-abf3-489b-9a1d-320689017006" status: 200 len: 1501 microversion: 2.1 time: 0.155242 Sep 14 09:42:34.681337 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3432/6756] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:42:34 2022] GET /compute/v2.1/servers/bd5e0e32-abf3-489b-9a1d-320689017006 => generated 1501 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:42:35.047629 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-a12f9ef2-bbdc-48fc-83fc-ed76ac9a9864 req-8ab8aab4-ce81-4479-91ba-f8a013b3b430 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd5e0e32-abf3-489b-9a1d-320689017006", "name": "network-vif-plugged", "status": "completed", "tag": "6f6489aa-538a-4e09-a882-eaf3895af2ad"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:42:35.053975 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:42:35.060522 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-a12f9ef2-bbdc-48fc-83fc-ed76ac9a9864 req-8ab8aab4-ce81-4479-91ba-f8a013b3b430 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:35.060973 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-a12f9ef2-bbdc-48fc-83fc-ed76ac9a9864 req-8ab8aab4-ce81-4479-91ba-f8a013b3b430 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:35.061420 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-a12f9ef2-bbdc-48fc-83fc-ed76ac9a9864 req-8ab8aab4-ce81-4479-91ba-f8a013b3b430 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:35.074448 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-a12f9ef2-bbdc-48fc-83fc-ed76ac9a9864 req-8ab8aab4-ce81-4479-91ba-f8a013b3b430 service nova] Creating event network-vif-plugged:6f6489aa-538a-4e09-a882-eaf3895af2ad for instance bd5e0e32-abf3-489b-9a1d-320689017006 on n-h1-836830-18 Sep 14 09:42:35.079324 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-a12f9ef2-bbdc-48fc-83fc-ed76ac9a9864 req-8ab8aab4-ce81-4479-91ba-f8a013b3b430 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035494 Sep 14 09:42:35.079933 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3433/6757] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:42:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:42:35.704680 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-7fd10c71-e69e-4ccb-ba16-9c051f54c6a4 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:42:35.705392 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-7fd10c71-e69e-4ccb-ba16-9c051f54c6a4 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] [instance: bd5e0e32-abf3-489b-9a1d-320689017006] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:42:35.712255 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7fd10c71-e69e-4ccb-ba16-9c051f54c6a4 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:35.712740 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7fd10c71-e69e-4ccb-ba16-9c051f54c6a4 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:35.713450 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7fd10c71-e69e-4ccb-ba16-9c051f54c6a4 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:35.714129 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7fd10c71-e69e-4ccb-ba16-9c051f54c6a4 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:35.714674 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7fd10c71-e69e-4ccb-ba16-9c051f54c6a4 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:35.715132 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7fd10c71-e69e-4ccb-ba16-9c051f54c6a4 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:35.846966 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-7fd10c71-e69e-4ccb-ba16-9c051f54c6a4 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991caa00be4b4a349e6a288dfd05becb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2055a333ba6542f4b23376eb443193a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:42:35.854748 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-7fd10c71-e69e-4ccb-ba16-9c051f54c6a4 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] 10.222.0.60 "GET /compute/v2.1/servers/bd5e0e32-abf3-489b-9a1d-320689017006" status: 200 len: 1501 microversion: 2.1 time: 0.154853 Sep 14 09:42:35.855348 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3434/6758] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:42:35 2022] GET /compute/v2.1/servers/bd5e0e32-abf3-489b-9a1d-320689017006 => generated 1501 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:42:36.442832 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-57f48063-3993-48c6-b429-5b2e7400b002 req-57121303-3ca7-4bd1-81d8-1f8a51e49f05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd5e0e32-abf3-489b-9a1d-320689017006", "name": "network-vif-deleted", "tag": "6f6489aa-538a-4e09-a882-eaf3895af2ad"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:42:36.454184 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-57f48063-3993-48c6-b429-5b2e7400b002 req-57121303-3ca7-4bd1-81d8-1f8a51e49f05 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:36.454678 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-57f48063-3993-48c6-b429-5b2e7400b002 req-57121303-3ca7-4bd1-81d8-1f8a51e49f05 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:36.455144 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-57f48063-3993-48c6-b429-5b2e7400b002 req-57121303-3ca7-4bd1-81d8-1f8a51e49f05 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:36.467562 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-57f48063-3993-48c6-b429-5b2e7400b002 req-57121303-3ca7-4bd1-81d8-1f8a51e49f05 service nova] Creating event network-vif-deleted:6f6489aa-538a-4e09-a882-eaf3895af2ad for instance bd5e0e32-abf3-489b-9a1d-320689017006 on n-h1-836830-18 Sep 14 09:42:36.474516 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-57f48063-3993-48c6-b429-5b2e7400b002 req-57121303-3ca7-4bd1-81d8-1f8a51e49f05 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035029 Sep 14 09:42:36.475388 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3435/6759] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:42:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:42:36.878706 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-05431d83-3c22-4605-bae3-6cb710eaea44 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:42:36.879456 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-05431d83-3c22-4605-bae3-6cb710eaea44 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] [instance: bd5e0e32-abf3-489b-9a1d-320689017006] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:42:36.886339 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-05431d83-3c22-4605-bae3-6cb710eaea44 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:36.886834 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-05431d83-3c22-4605-bae3-6cb710eaea44 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:36.887314 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-05431d83-3c22-4605-bae3-6cb710eaea44 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:36.888011 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-05431d83-3c22-4605-bae3-6cb710eaea44 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:36.888473 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-05431d83-3c22-4605-bae3-6cb710eaea44 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:36.888907 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-05431d83-3c22-4605-bae3-6cb710eaea44 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:36.902194 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-05431d83-3c22-4605-bae3-6cb710eaea44 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] HTTP exception thrown: Instance bd5e0e32-abf3-489b-9a1d-320689017006 could not be found. Sep 14 09:42:36.903877 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-05431d83-3c22-4605-bae3-6cb710eaea44 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Request method failure captured: Sep 14 09:42:36.903877 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/bd5e0e32-abf3-489b-9a1d-320689017006 HTTP/1.1 Sep 14 09:42:36.903877 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:42:36.903877 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:42:36.903877 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:42:36.903877 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:42:36.903877 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:42:36.903877 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:42:36.903877 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:42:36.903877 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:42:36.903877 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIaHWXcd7OXCtQeVIGSH0xtnVCXcF6fHBYvu8RpEiJJDVHUBiD1GU_OSuuR6C-Rcd0sEtNXdqxWUieYJXVscQPZtf2AJjxj1MHvnFr5ONwZgOHuOJR0JXJsIOSj01la41iYn76W1jHv3T5UgA8gRDmAiaghGLphDK4Jd_e-aPwfctfCs Sep 14 09:42:36.903877 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:42:36.903877 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:42:36.903877 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:42:36.903877 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:42:36.903877 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:42:36.903877 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:42:36.903877 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 2055a333ba6542f4b23376eb443193a5 Sep 14 09:42:36.903877 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-DeleteServersTestJSON-1223334824 Sep 14 09:42:36.903877 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:42:36.903877 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:42:36.903877 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/2055a333ba6542f4b23376eb443193a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_2055a333ba6542f4b23376eb443193a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2055a333ba6542f4b23376eb443193a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2055a333ba6542f4b23376eb443193a5"}]}] Sep 14 09:42:36.903877 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-DeleteServersTestJSON-1223334824 Sep 14 09:42:36.903877 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 2055a333ba6542f4b23376eb443193a5 Sep 14 09:42:36.903877 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-DeleteServersTestJSON-1223334824 Sep 14 09:42:36.903877 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-DeleteServersTestJSON-1223334824-project Sep 14 09:42:36.903877 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:42:36.903877 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:42:36.903877 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 991caa00be4b4a349e6a288dfd05becb Sep 14 09:42:36.903877 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-DeleteServersTestJSON-1223334824-project Sep 14 09:42:36.903877 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:42:36.903877 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance bd5e0e32-abf3-489b-9a1d-320689017006 could not be found. Sep 14 09:42:36.903877 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': 'bd5e0e32-abf3-489b-9a1d-320689017006'} Sep 14 09:42:36.903877 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:42:36.903877 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:42:36.903877 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:42:36.903877 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:42:36.903877 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:42:36.903877 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:42:36.903877 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:42:36.903877 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:42:36.903877 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:42:36.903877 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:42:36.903877 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd5e0e32-abf3-489b-9a1d-320689017006 could not be found. Sep 14 09:42:36.903877 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:42:36.903877 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:42:36.903877 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:42:36.903877 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:42:36.903877 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:42:36.903877 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:42:36.903877 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:42:36.903877 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:42:36.903877 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:42:36.903877 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:42:36.903877 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:42:36.903877 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:42:36.903877 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:42:36.903877 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:42:36.903877 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:42:36.903877 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:42:36.903877 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd5e0e32-abf3-489b-9a1d-320689017006 could not be found. Sep 14 09:42:36.903877 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:42:36.903877 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:42:36.903877 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:42:36.908319 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:42:36.908319 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:42:36.908319 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:42:36.908319 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:42:36.908319 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:42:36.908319 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd5e0e32-abf3-489b-9a1d-320689017006 could not be found. Sep 14 09:42:36.908319 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:42:36.908319 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-05431d83-3c22-4605-bae3-6cb710eaea44 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Returning 404 to user: Instance bd5e0e32-abf3-489b-9a1d-320689017006 could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:42:36.908319 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-05431d83-3c22-4605-bae3-6cb710eaea44 tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] 10.222.0.60 "GET /compute/v2.1/servers/bd5e0e32-abf3-489b-9a1d-320689017006" status: 404 len: 111 microversion: 2.1 time: 0.030888 Sep 14 09:42:36.908319 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3436/6760] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:42:36 2022] GET /compute/v2.1/servers/bd5e0e32-abf3-489b-9a1d-320689017006 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 14 09:42:36.921560 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-eed06491-4675-4ad4-808f-c0bf18f4a23e tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:42:36.922071 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-eed06491-4675-4ad4-808f-c0bf18f4a23e tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] [instance: bd5e0e32-abf3-489b-9a1d-320689017006] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:42:36.928523 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-eed06491-4675-4ad4-808f-c0bf18f4a23e tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:36.929015 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-eed06491-4675-4ad4-808f-c0bf18f4a23e tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:36.929462 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-eed06491-4675-4ad4-808f-c0bf18f4a23e tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:36.930154 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-eed06491-4675-4ad4-808f-c0bf18f4a23e tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:36.930619 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-eed06491-4675-4ad4-808f-c0bf18f4a23e tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:36.931076 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-eed06491-4675-4ad4-808f-c0bf18f4a23e tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:36.945122 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-eed06491-4675-4ad4-808f-c0bf18f4a23e tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] HTTP exception thrown: Instance bd5e0e32-abf3-489b-9a1d-320689017006 could not be found. Sep 14 09:42:36.946602 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-eed06491-4675-4ad4-808f-c0bf18f4a23e tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Request method failure captured: Sep 14 09:42:36.946602 n-d-836830-18 devstack@n-api.service[128759]: request: DELETE /compute/v2.1/servers/bd5e0e32-abf3-489b-9a1d-320689017006 HTTP/1.1 Sep 14 09:42:36.946602 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:42:36.946602 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:42:36.946602 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:42:36.946602 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:42:36.946602 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:42:36.946602 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:42:36.946602 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:42:36.946602 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:42:36.946602 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIaHWXcd7OXCtQeVIGSH0xtnVCXcF6fHBYvu8RpEiJJDVHUBiD1GU_OSuuR6C-Rcd0sEtNXdqxWUieYJXVscQPZtf2AJjxj1MHvnFr5ONwZgOHuOJR0JXJsIOSj01la41iYn76W1jHv3T5UgA8gRDmAiaghGLphDK4Jd_e-aPwfctfCs Sep 14 09:42:36.946602 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:42:36.946602 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:42:36.946602 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:42:36.946602 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:42:36.946602 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:42:36.946602 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:42:36.946602 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 2055a333ba6542f4b23376eb443193a5 Sep 14 09:42:36.946602 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-DeleteServersTestJSON-1223334824 Sep 14 09:42:36.946602 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:42:36.946602 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:42:36.946602 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/2055a333ba6542f4b23376eb443193a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_2055a333ba6542f4b23376eb443193a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2055a333ba6542f4b23376eb443193a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2055a333ba6542f4b23376eb443193a5"}]}] Sep 14 09:42:36.946602 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-DeleteServersTestJSON-1223334824 Sep 14 09:42:36.946602 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 2055a333ba6542f4b23376eb443193a5 Sep 14 09:42:36.946602 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-DeleteServersTestJSON-1223334824 Sep 14 09:42:36.946602 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-DeleteServersTestJSON-1223334824-project Sep 14 09:42:36.946602 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:42:36.946602 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:42:36.946602 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 991caa00be4b4a349e6a288dfd05becb Sep 14 09:42:36.946602 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-DeleteServersTestJSON-1223334824-project Sep 14 09:42:36.946602 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:42:36.946602 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance bd5e0e32-abf3-489b-9a1d-320689017006 could not be found. Sep 14 09:42:36.946602 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': 'bd5e0e32-abf3-489b-9a1d-320689017006'} Sep 14 09:42:36.946602 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:42:36.946602 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:42:36.946602 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:42:36.946602 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:42:36.946602 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:42:36.946602 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:42:36.946602 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:42:36.946602 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:42:36.946602 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:42:36.946602 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:42:36.946602 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd5e0e32-abf3-489b-9a1d-320689017006 could not be found. Sep 14 09:42:36.946602 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:42:36.946602 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:42:36.946602 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:42:36.946602 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:42:36.946602 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:42:36.946602 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:42:36.946602 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:42:36.946602 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:42:36.946602 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:42:36.946602 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:42:36.946602 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 09:42:36.946602 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 09:42:36.946602 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 09:42:36.946602 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 09:42:36.946602 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:42:36.946602 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:42:36.946602 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:42:36.946602 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:42:36.950607 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd5e0e32-abf3-489b-9a1d-320689017006 could not be found. Sep 14 09:42:36.950607 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:42:36.950607 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:42:36.950607 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:42:36.950607 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:42:36.950607 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:42:36.950607 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:42:36.950607 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:42:36.950607 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:42:36.950607 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd5e0e32-abf3-489b-9a1d-320689017006 could not be found. Sep 14 09:42:36.950607 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:42:36.950607 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-eed06491-4675-4ad4-808f-c0bf18f4a23e tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Returning 404 to user: Instance bd5e0e32-abf3-489b-9a1d-320689017006 could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:42:36.950607 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-eed06491-4675-4ad4-808f-c0bf18f4a23e tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] 10.222.0.60 "DELETE /compute/v2.1/servers/bd5e0e32-abf3-489b-9a1d-320689017006" status: 404 len: 111 microversion: 2.1 time: 0.030199 Sep 14 09:42:36.950607 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3437/6761] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:42:36 2022] DELETE /compute/v2.1/servers/bd5e0e32-abf3-489b-9a1d-320689017006 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 14 09:42:36.955916 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-2094c6b6-63ed-44b4-ba7a-750e9b0d248d tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:42:36.956534 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-2094c6b6-63ed-44b4-ba7a-750e9b0d248d tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] [instance: bd5e0e32-abf3-489b-9a1d-320689017006] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:42:36.962714 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2094c6b6-63ed-44b4-ba7a-750e9b0d248d tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:36.963499 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2094c6b6-63ed-44b4-ba7a-750e9b0d248d tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:36.963946 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2094c6b6-63ed-44b4-ba7a-750e9b0d248d tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:36.964640 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2094c6b6-63ed-44b4-ba7a-750e9b0d248d tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:36.965105 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2094c6b6-63ed-44b4-ba7a-750e9b0d248d tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:36.965539 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2094c6b6-63ed-44b4-ba7a-750e9b0d248d tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:36.978816 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-2094c6b6-63ed-44b4-ba7a-750e9b0d248d tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] HTTP exception thrown: Instance bd5e0e32-abf3-489b-9a1d-320689017006 could not be found. Sep 14 09:42:36.980401 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-2094c6b6-63ed-44b4-ba7a-750e9b0d248d tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Request method failure captured: Sep 14 09:42:36.980401 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/bd5e0e32-abf3-489b-9a1d-320689017006 HTTP/1.1 Sep 14 09:42:36.980401 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:42:36.980401 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:42:36.980401 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:42:36.980401 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:42:36.980401 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:42:36.980401 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:42:36.980401 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:42:36.980401 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:42:36.980401 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIaHWXcd7OXCtQeVIGSH0xtnVCXcF6fHBYvu8RpEiJJDVHUBiD1GU_OSuuR6C-Rcd0sEtNXdqxWUieYJXVscQPZtf2AJjxj1MHvnFr5ONwZgOHuOJR0JXJsIOSj01la41iYn76W1jHv3T5UgA8gRDmAiaghGLphDK4Jd_e-aPwfctfCs Sep 14 09:42:36.980401 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:42:36.980401 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:42:36.980401 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:42:36.980401 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:42:36.980401 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:42:36.980401 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:42:36.980401 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 2055a333ba6542f4b23376eb443193a5 Sep 14 09:42:36.980401 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-DeleteServersTestJSON-1223334824 Sep 14 09:42:36.980401 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:42:36.980401 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:42:36.980401 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/2055a333ba6542f4b23376eb443193a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_2055a333ba6542f4b23376eb443193a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2055a333ba6542f4b23376eb443193a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2055a333ba6542f4b23376eb443193a5"}]}] Sep 14 09:42:36.980401 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-DeleteServersTestJSON-1223334824 Sep 14 09:42:36.980401 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 2055a333ba6542f4b23376eb443193a5 Sep 14 09:42:36.980401 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-DeleteServersTestJSON-1223334824 Sep 14 09:42:36.980401 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-DeleteServersTestJSON-1223334824-project Sep 14 09:42:36.980401 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:42:36.980401 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:42:36.980401 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 991caa00be4b4a349e6a288dfd05becb Sep 14 09:42:36.980401 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-DeleteServersTestJSON-1223334824-project Sep 14 09:42:36.980401 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:42:36.980401 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance bd5e0e32-abf3-489b-9a1d-320689017006 could not be found. Sep 14 09:42:36.980401 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': 'bd5e0e32-abf3-489b-9a1d-320689017006'} Sep 14 09:42:36.980401 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:42:36.980401 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:42:36.980401 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:42:36.980401 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:42:36.980401 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:42:36.980401 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:42:36.980401 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:42:36.980401 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:42:36.980401 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:42:36.980401 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:42:36.980401 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd5e0e32-abf3-489b-9a1d-320689017006 could not be found. Sep 14 09:42:36.980401 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:42:36.980401 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:42:36.980401 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:42:36.980401 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:42:36.980401 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:42:36.980401 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:42:36.980401 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:42:36.980401 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:42:36.980401 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:42:36.980401 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:42:36.980401 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:42:36.980401 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:42:36.980401 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:42:36.980401 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:42:36.980401 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:42:36.980401 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:42:36.980401 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd5e0e32-abf3-489b-9a1d-320689017006 could not be found. Sep 14 09:42:36.980401 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:42:36.980401 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:42:36.980401 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:42:36.984717 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:42:36.984717 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:42:36.984717 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:42:36.984717 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:42:36.984717 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:42:36.984717 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd5e0e32-abf3-489b-9a1d-320689017006 could not be found. Sep 14 09:42:36.984717 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:42:36.984717 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-2094c6b6-63ed-44b4-ba7a-750e9b0d248d tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] Returning 404 to user: Instance bd5e0e32-abf3-489b-9a1d-320689017006 could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:42:36.984717 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-2094c6b6-63ed-44b4-ba7a-750e9b0d248d tempest-DeleteServersTestJSON-1223334824 tempest-DeleteServersTestJSON-1223334824-project] 10.222.0.60 "GET /compute/v2.1/servers/bd5e0e32-abf3-489b-9a1d-320689017006" status: 404 len: 111 microversion: 2.1 time: 0.029336 Sep 14 09:42:36.984717 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3438/6762] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:42:36 2022] GET /compute/v2.1/servers/bd5e0e32-abf3-489b-9a1d-320689017006 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 14 09:42:42.295679 n-d-836830-18 devstack@n-api.service[128758]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 09:42:42.296266 n-d-836830-18 devstack@n-api.service[128758]: Wed Sep 14 09:42:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.60) !!! Sep 14 09:42:42.298168 n-d-836830-18 devstack@n-api.service[128758]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 09:42:42.298535 n-d-836830-18 devstack@n-api.service[128758]: Wed Sep 14 09:42:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.60) !!! Sep 14 09:42:45.582567 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-42d5b6a4-1607-4e23-9992-b2e3cf7dce47 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1646176744", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "networks": [{"uuid": "bd848ee4-19bd-4063-8712-106fd8999059"}]}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:42:45.644416 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.network.neutron [None req-42d5b6a4-1607-4e23-9992-b2e3cf7dce47 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] validate_networks() for [('bd848ee4-19bd-4063-8712-106fd8999059', None, None, None, None, None)] {{(pid=128759) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:42:46.056570 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-42d5b6a4-1607-4e23-9992-b2e3cf7dce47 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Flavor limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:42:46.057009 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-42d5b6a4-1607-4e23-9992-b2e3cf7dce47 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Image limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:42:46.057532 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-42d5b6a4-1607-4e23-9992-b2e3cf7dce47 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Flavor pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:42:46.057947 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-42d5b6a4-1607-4e23-9992-b2e3cf7dce47 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Image pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:42:46.058364 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-42d5b6a4-1607-4e23-9992-b2e3cf7dce47 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:42:46.068337 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-42d5b6a4-1607-4e23-9992-b2e3cf7dce47 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:46.069184 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-42d5b6a4-1607-4e23-9992-b2e3cf7dce47 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:46.069798 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-42d5b6a4-1607-4e23-9992-b2e3cf7dce47 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:46.070538 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-42d5b6a4-1607-4e23-9992-b2e3cf7dce47 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:46.071022 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-42d5b6a4-1607-4e23-9992-b2e3cf7dce47 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:46.071482 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-42d5b6a4-1607-4e23-9992-b2e3cf7dce47 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:46.089904 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-42d5b6a4-1607-4e23-9992-b2e3cf7dce47 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Getting quotas for project bf91d97eec8b46e2b1f07b6f39185030. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:42:46.095489 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-42d5b6a4-1607-4e23-9992-b2e3cf7dce47 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Getting quotas for user 9068c0af1a7c48dab91c3ebf4ebd9148 and project bf91d97eec8b46e2b1f07b6f39185030. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:42:46.109184 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-42d5b6a4-1607-4e23-9992-b2e3cf7dce47 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Going to run 1 instances... {{(pid=128759) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:42:46.113030 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-42d5b6a4-1607-4e23-9992-b2e3cf7dce47 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] [instance: 65452924-da4a-4684-98ae-e88507c85e34] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128759) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:42:46.169893 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-42d5b6a4-1607-4e23-9992-b2e3cf7dce47 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.725479 Sep 14 09:42:46.170823 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3439/6763] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 09:42:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 728 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:42:46.182431 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9b636e4f-a766-41d2-9a3a-25b132b9beb0 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:42:46.183090 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-9b636e4f-a766-41d2-9a3a-25b132b9beb0 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] [instance: 65452924-da4a-4684-98ae-e88507c85e34] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:42:46.241885 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-9b636e4f-a766-41d2-9a3a-25b132b9beb0 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9068c0af1a7c48dab91c3ebf4ebd9148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf91d97eec8b46e2b1f07b6f39185030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:42:46.250650 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-9b636e4f-a766-41d2-9a3a-25b132b9beb0 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] 10.222.0.60 "GET /compute/v2.1/servers/65452924-da4a-4684-98ae-e88507c85e34" status: 200 len: 1218 microversion: 2.1 time: 0.071933 Sep 14 09:42:46.258449 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3440/6764] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:42:46 2022] GET /compute/v2.1/servers/65452924-da4a-4684-98ae-e88507c85e34 => generated 1218 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:42:47.277502 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3117b80d-ec0c-484b-aade-393910b63af4 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:42:47.279153 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-3117b80d-ec0c-484b-aade-393910b63af4 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] [instance: 65452924-da4a-4684-98ae-e88507c85e34] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:42:47.295082 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3117b80d-ec0c-484b-aade-393910b63af4 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:47.295689 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3117b80d-ec0c-484b-aade-393910b63af4 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:47.296145 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3117b80d-ec0c-484b-aade-393910b63af4 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:47.299943 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3117b80d-ec0c-484b-aade-393910b63af4 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:47.300560 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3117b80d-ec0c-484b-aade-393910b63af4 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:47.301088 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3117b80d-ec0c-484b-aade-393910b63af4 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:47.392844 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-3117b80d-ec0c-484b-aade-393910b63af4 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9068c0af1a7c48dab91c3ebf4ebd9148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf91d97eec8b46e2b1f07b6f39185030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:42:47.406994 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-3117b80d-ec0c-484b-aade-393910b63af4 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] 10.222.0.60 "GET /compute/v2.1/servers/65452924-da4a-4684-98ae-e88507c85e34" status: 200 len: 1278 microversion: 2.1 time: 0.136759 Sep 14 09:42:47.407822 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3441/6765] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:42:47 2022] GET /compute/v2.1/servers/65452924-da4a-4684-98ae-e88507c85e34 => generated 1278 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:42:48.433021 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ac261e76-f1ea-4bb3-8ab0-6ac86ba3f9f6 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:42:48.433678 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-ac261e76-f1ea-4bb3-8ab0-6ac86ba3f9f6 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] [instance: 65452924-da4a-4684-98ae-e88507c85e34] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:42:48.455543 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ac261e76-f1ea-4bb3-8ab0-6ac86ba3f9f6 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:48.456324 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ac261e76-f1ea-4bb3-8ab0-6ac86ba3f9f6 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:48.456971 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ac261e76-f1ea-4bb3-8ab0-6ac86ba3f9f6 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:48.458022 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ac261e76-f1ea-4bb3-8ab0-6ac86ba3f9f6 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:48.459369 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ac261e76-f1ea-4bb3-8ab0-6ac86ba3f9f6 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:48.459801 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ac261e76-f1ea-4bb3-8ab0-6ac86ba3f9f6 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:48.637450 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-ac261e76-f1ea-4bb3-8ab0-6ac86ba3f9f6 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9068c0af1a7c48dab91c3ebf4ebd9148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf91d97eec8b46e2b1f07b6f39185030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:42:48.649649 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-ac261e76-f1ea-4bb3-8ab0-6ac86ba3f9f6 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] 10.222.0.60 "GET /compute/v2.1/servers/65452924-da4a-4684-98ae-e88507c85e34" status: 200 len: 1318 microversion: 2.1 time: 0.222365 Sep 14 09:42:48.663257 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3442/6766] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:42:48 2022] GET /compute/v2.1/servers/65452924-da4a-4684-98ae-e88507c85e34 => generated 1318 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:42:48.809142 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-18f0cdb5-8751-43f8-b3b4-9d500a8e6a95 req-bfc1c03c-3639-42d7-9c0a-a5a1436bcf38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65452924-da4a-4684-98ae-e88507c85e34", "tag": "e81325e8-d3ef-49f2-9216-9e0d36f2a957"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:42:48.823483 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-18f0cdb5-8751-43f8-b3b4-9d500a8e6a95 req-bfc1c03c-3639-42d7-9c0a-a5a1436bcf38 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:48.823972 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-18f0cdb5-8751-43f8-b3b4-9d500a8e6a95 req-bfc1c03c-3639-42d7-9c0a-a5a1436bcf38 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:48.827835 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-18f0cdb5-8751-43f8-b3b4-9d500a8e6a95 req-bfc1c03c-3639-42d7-9c0a-a5a1436bcf38 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:48.844011 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-18f0cdb5-8751-43f8-b3b4-9d500a8e6a95 req-bfc1c03c-3639-42d7-9c0a-a5a1436bcf38 service nova] Creating event network-changed:e81325e8-d3ef-49f2-9216-9e0d36f2a957 for instance 65452924-da4a-4684-98ae-e88507c85e34 on n-h1-836830-18 Sep 14 09:42:48.849128 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-18f0cdb5-8751-43f8-b3b4-9d500a8e6a95 req-bfc1c03c-3639-42d7-9c0a-a5a1436bcf38 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043941 Sep 14 09:42:48.850225 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3443/6767] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:42:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:42:49.675893 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c82e6054-b9da-4291-b28a-a868471f79ee tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:42:49.676621 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-c82e6054-b9da-4291-b28a-a868471f79ee tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] [instance: 65452924-da4a-4684-98ae-e88507c85e34] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:42:49.682872 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c82e6054-b9da-4291-b28a-a868471f79ee tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:49.683397 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c82e6054-b9da-4291-b28a-a868471f79ee tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:49.683846 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c82e6054-b9da-4291-b28a-a868471f79ee tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:49.684573 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c82e6054-b9da-4291-b28a-a868471f79ee tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:49.685037 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c82e6054-b9da-4291-b28a-a868471f79ee tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:49.685502 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c82e6054-b9da-4291-b28a-a868471f79ee tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:49.819153 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-c82e6054-b9da-4291-b28a-a868471f79ee tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9068c0af1a7c48dab91c3ebf4ebd9148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf91d97eec8b46e2b1f07b6f39185030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:42:49.827002 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-c82e6054-b9da-4291-b28a-a868471f79ee tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] 10.222.0.60 "GET /compute/v2.1/servers/65452924-da4a-4684-98ae-e88507c85e34" status: 200 len: 1318 microversion: 2.1 time: 0.156256 Sep 14 09:42:49.827701 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3444/6768] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:42:49 2022] GET /compute/v2.1/servers/65452924-da4a-4684-98ae-e88507c85e34 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:42:50.851153 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-1041e389-5126-4af6-aa8d-05f50fafe8d2 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:42:50.851819 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-1041e389-5126-4af6-aa8d-05f50fafe8d2 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] [instance: 65452924-da4a-4684-98ae-e88507c85e34] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:42:50.858657 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1041e389-5126-4af6-aa8d-05f50fafe8d2 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:50.859207 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1041e389-5126-4af6-aa8d-05f50fafe8d2 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:50.859655 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1041e389-5126-4af6-aa8d-05f50fafe8d2 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:50.860352 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1041e389-5126-4af6-aa8d-05f50fafe8d2 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:50.860840 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1041e389-5126-4af6-aa8d-05f50fafe8d2 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:50.861273 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1041e389-5126-4af6-aa8d-05f50fafe8d2 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:50.990475 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-1041e389-5126-4af6-aa8d-05f50fafe8d2 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9068c0af1a7c48dab91c3ebf4ebd9148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf91d97eec8b46e2b1f07b6f39185030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:42:50.998276 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-1041e389-5126-4af6-aa8d-05f50fafe8d2 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] 10.222.0.60 "GET /compute/v2.1/servers/65452924-da4a-4684-98ae-e88507c85e34" status: 200 len: 1318 microversion: 2.1 time: 0.151140 Sep 14 09:42:50.998857 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3445/6769] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:42:50 2022] GET /compute/v2.1/servers/65452924-da4a-4684-98ae-e88507c85e34 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:42:52.020939 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a403b962-a8de-4dd7-a3ac-60f8d1b278ad tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:42:52.021750 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-a403b962-a8de-4dd7-a3ac-60f8d1b278ad tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] [instance: 65452924-da4a-4684-98ae-e88507c85e34] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:42:52.029700 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a403b962-a8de-4dd7-a3ac-60f8d1b278ad tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:52.030199 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a403b962-a8de-4dd7-a3ac-60f8d1b278ad tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:52.030652 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a403b962-a8de-4dd7-a3ac-60f8d1b278ad tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:52.031388 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a403b962-a8de-4dd7-a3ac-60f8d1b278ad tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:52.031856 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a403b962-a8de-4dd7-a3ac-60f8d1b278ad tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:52.032289 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a403b962-a8de-4dd7-a3ac-60f8d1b278ad tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:52.165538 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-a403b962-a8de-4dd7-a3ac-60f8d1b278ad tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9068c0af1a7c48dab91c3ebf4ebd9148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf91d97eec8b46e2b1f07b6f39185030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:42:52.173372 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a403b962-a8de-4dd7-a3ac-60f8d1b278ad tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] 10.222.0.60 "GET /compute/v2.1/servers/65452924-da4a-4684-98ae-e88507c85e34" status: 200 len: 1318 microversion: 2.1 time: 0.156525 Sep 14 09:42:52.173897 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3446/6770] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:42:52 2022] GET /compute/v2.1/servers/65452924-da4a-4684-98ae-e88507c85e34 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:42:53.197506 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-644dddbe-4c9f-45cc-816d-5e2471f41268 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:42:53.198132 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-644dddbe-4c9f-45cc-816d-5e2471f41268 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] [instance: 65452924-da4a-4684-98ae-e88507c85e34] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:42:53.205023 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-644dddbe-4c9f-45cc-816d-5e2471f41268 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:53.205513 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-644dddbe-4c9f-45cc-816d-5e2471f41268 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:53.205956 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-644dddbe-4c9f-45cc-816d-5e2471f41268 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:53.206777 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-644dddbe-4c9f-45cc-816d-5e2471f41268 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:53.207288 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-644dddbe-4c9f-45cc-816d-5e2471f41268 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:53.207703 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-644dddbe-4c9f-45cc-816d-5e2471f41268 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:53.342073 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-644dddbe-4c9f-45cc-816d-5e2471f41268 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9068c0af1a7c48dab91c3ebf4ebd9148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf91d97eec8b46e2b1f07b6f39185030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:42:53.350109 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-644dddbe-4c9f-45cc-816d-5e2471f41268 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] 10.222.0.60 "GET /compute/v2.1/servers/65452924-da4a-4684-98ae-e88507c85e34" status: 200 len: 1318 microversion: 2.1 time: 0.156524 Sep 14 09:42:53.350699 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3447/6771] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:42:53 2022] GET /compute/v2.1/servers/65452924-da4a-4684-98ae-e88507c85e34 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:42:54.373952 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-453694c4-9b66-4e19-b8b4-883c5146ca52 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:42:54.374657 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-453694c4-9b66-4e19-b8b4-883c5146ca52 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] [instance: 65452924-da4a-4684-98ae-e88507c85e34] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:42:54.381635 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-453694c4-9b66-4e19-b8b4-883c5146ca52 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:54.382137 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-453694c4-9b66-4e19-b8b4-883c5146ca52 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:54.382582 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-453694c4-9b66-4e19-b8b4-883c5146ca52 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:54.383353 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-453694c4-9b66-4e19-b8b4-883c5146ca52 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:54.384153 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-453694c4-9b66-4e19-b8b4-883c5146ca52 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:54.384246 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-453694c4-9b66-4e19-b8b4-883c5146ca52 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:54.516637 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-453694c4-9b66-4e19-b8b4-883c5146ca52 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9068c0af1a7c48dab91c3ebf4ebd9148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf91d97eec8b46e2b1f07b6f39185030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:42:54.524573 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-453694c4-9b66-4e19-b8b4-883c5146ca52 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] 10.222.0.60 "GET /compute/v2.1/servers/65452924-da4a-4684-98ae-e88507c85e34" status: 200 len: 1318 microversion: 2.1 time: 0.154674 Sep 14 09:42:54.525156 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3448/6772] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:42:54 2022] GET /compute/v2.1/servers/65452924-da4a-4684-98ae-e88507c85e34 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:42:55.162754 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-9a3fb355-02b8-4184-ac92-a4272c7fe6d2 req-ff7dfaf2-6013-4865-858c-38252efa8f8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65452924-da4a-4684-98ae-e88507c85e34", "name": "network-vif-plugged", "status": "completed", "tag": "e81325e8-d3ef-49f2-9216-9e0d36f2a957"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:42:55.173028 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-9a3fb355-02b8-4184-ac92-a4272c7fe6d2 req-ff7dfaf2-6013-4865-858c-38252efa8f8b service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:55.173516 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-9a3fb355-02b8-4184-ac92-a4272c7fe6d2 req-ff7dfaf2-6013-4865-858c-38252efa8f8b service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:55.173942 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-9a3fb355-02b8-4184-ac92-a4272c7fe6d2 req-ff7dfaf2-6013-4865-858c-38252efa8f8b service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:55.178507 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:42:55.189807 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-9a3fb355-02b8-4184-ac92-a4272c7fe6d2 req-ff7dfaf2-6013-4865-858c-38252efa8f8b service nova] Creating event network-vif-plugged:e81325e8-d3ef-49f2-9216-9e0d36f2a957 for instance 65452924-da4a-4684-98ae-e88507c85e34 on n-h1-836830-18 Sep 14 09:42:55.194867 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-9a3fb355-02b8-4184-ac92-a4272c7fe6d2 req-ff7dfaf2-6013-4865-858c-38252efa8f8b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036427 Sep 14 09:42:55.195515 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3449/6773] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:42:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:42:55.549812 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a66fc50a-ab31-4b82-9468-f8fe7bcaa44a tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:42:55.550516 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-a66fc50a-ab31-4b82-9468-f8fe7bcaa44a tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] [instance: 65452924-da4a-4684-98ae-e88507c85e34] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:42:55.557824 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a66fc50a-ab31-4b82-9468-f8fe7bcaa44a tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:55.558311 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a66fc50a-ab31-4b82-9468-f8fe7bcaa44a tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:55.558752 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a66fc50a-ab31-4b82-9468-f8fe7bcaa44a tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:55.559488 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a66fc50a-ab31-4b82-9468-f8fe7bcaa44a tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:55.559929 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a66fc50a-ab31-4b82-9468-f8fe7bcaa44a tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:55.560351 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a66fc50a-ab31-4b82-9468-f8fe7bcaa44a tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:55.694855 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-a66fc50a-ab31-4b82-9468-f8fe7bcaa44a tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9068c0af1a7c48dab91c3ebf4ebd9148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf91d97eec8b46e2b1f07b6f39185030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:42:55.702548 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a66fc50a-ab31-4b82-9468-f8fe7bcaa44a tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] 10.222.0.60 "GET /compute/v2.1/servers/65452924-da4a-4684-98ae-e88507c85e34" status: 200 len: 1318 microversion: 2.1 time: 0.158240 Sep 14 09:42:55.703151 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3450/6774] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:42:55 2022] GET /compute/v2.1/servers/65452924-da4a-4684-98ae-e88507c85e34 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:42:56.726227 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-bbfdf8fa-1206-4708-9e80-6cc865536b0e tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:42:56.726876 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-bbfdf8fa-1206-4708-9e80-6cc865536b0e tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] [instance: 65452924-da4a-4684-98ae-e88507c85e34] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:42:56.729189 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=2 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:42:56.729905 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=8 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:42:56.736475 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bbfdf8fa-1206-4708-9e80-6cc865536b0e tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:56.736968 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bbfdf8fa-1206-4708-9e80-6cc865536b0e tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:56.737407 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bbfdf8fa-1206-4708-9e80-6cc865536b0e tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:56.738103 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bbfdf8fa-1206-4708-9e80-6cc865536b0e tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:56.738557 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bbfdf8fa-1206-4708-9e80-6cc865536b0e tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:56.739185 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bbfdf8fa-1206-4708-9e80-6cc865536b0e tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:56.877000 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-bbfdf8fa-1206-4708-9e80-6cc865536b0e tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9068c0af1a7c48dab91c3ebf4ebd9148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf91d97eec8b46e2b1f07b6f39185030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:42:56.885475 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-bbfdf8fa-1206-4708-9e80-6cc865536b0e tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] 10.222.0.60 "GET /compute/v2.1/servers/65452924-da4a-4684-98ae-e88507c85e34" status: 200 len: 1507 microversion: 2.1 time: 0.163504 Sep 14 09:42:56.886054 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3451/6775] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:42:56 2022] GET /compute/v2.1/servers/65452924-da4a-4684-98ae-e88507c85e34 => generated 1507 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:42:56.907312 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-fd67906f-2c3e-4376-a526-ac214611cc77 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:42:56.907927 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-fd67906f-2c3e-4376-a526-ac214611cc77 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] [instance: 65452924-da4a-4684-98ae-e88507c85e34] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:42:56.913649 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fd67906f-2c3e-4376-a526-ac214611cc77 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:56.914133 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fd67906f-2c3e-4376-a526-ac214611cc77 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:56.914575 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fd67906f-2c3e-4376-a526-ac214611cc77 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:56.915365 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fd67906f-2c3e-4376-a526-ac214611cc77 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:56.915823 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fd67906f-2c3e-4376-a526-ac214611cc77 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:56.916253 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fd67906f-2c3e-4376-a526-ac214611cc77 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:57.055858 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-fd67906f-2c3e-4376-a526-ac214611cc77 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9068c0af1a7c48dab91c3ebf4ebd9148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf91d97eec8b46e2b1f07b6f39185030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:42:57.063741 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-fd67906f-2c3e-4376-a526-ac214611cc77 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] 10.222.0.60 "GET /compute/v2.1/servers/65452924-da4a-4684-98ae-e88507c85e34" status: 200 len: 1507 microversion: 2.1 time: 0.160005 Sep 14 09:42:57.064325 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3452/6776] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:42:56 2022] GET /compute/v2.1/servers/65452924-da4a-4684-98ae-e88507c85e34 => generated 1507 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:42:57.085935 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-66d9997b-8080-4166-90ec-e690c5a1f038 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:42:57.088640 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-66d9997b-8080-4166-90ec-e690c5a1f038 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] [instance: 65452924-da4a-4684-98ae-e88507c85e34] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:42:57.094829 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-66d9997b-8080-4166-90ec-e690c5a1f038 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:57.095364 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-66d9997b-8080-4166-90ec-e690c5a1f038 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:57.095811 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-66d9997b-8080-4166-90ec-e690c5a1f038 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:57.096513 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-66d9997b-8080-4166-90ec-e690c5a1f038 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:57.096975 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-66d9997b-8080-4166-90ec-e690c5a1f038 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:57.097408 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-66d9997b-8080-4166-90ec-e690c5a1f038 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:57.160672 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-66d9997b-8080-4166-90ec-e690c5a1f038 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] 10.222.0.60 "PUT /compute/v2.1/servers/65452924-da4a-4684-98ae-e88507c85e34" status: 200 len: 1079 microversion: 2.1 time: 0.078271 Sep 14 09:42:57.161749 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3453/6777] 10.222.0.60 () {60 vars in 1256 bytes} [Wed Sep 14 09:42:57 2022] PUT /compute/v2.1/servers/65452924-da4a-4684-98ae-e88507c85e34 => generated 1079 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:42:57.180590 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-43274043-0f90-4bba-a0db-53564e61ba32 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:42:57.181205 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-43274043-0f90-4bba-a0db-53564e61ba32 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] [instance: 65452924-da4a-4684-98ae-e88507c85e34] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:42:57.187168 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-43274043-0f90-4bba-a0db-53564e61ba32 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:57.187661 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-43274043-0f90-4bba-a0db-53564e61ba32 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:57.188107 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-43274043-0f90-4bba-a0db-53564e61ba32 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:57.188801 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-43274043-0f90-4bba-a0db-53564e61ba32 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:57.189260 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-43274043-0f90-4bba-a0db-53564e61ba32 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:57.189691 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-43274043-0f90-4bba-a0db-53564e61ba32 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:57.318662 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-43274043-0f90-4bba-a0db-53564e61ba32 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9068c0af1a7c48dab91c3ebf4ebd9148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf91d97eec8b46e2b1f07b6f39185030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:42:57.326587 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-43274043-0f90-4bba-a0db-53564e61ba32 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] 10.222.0.60 "GET /compute/v2.1/servers/65452924-da4a-4684-98ae-e88507c85e34" status: 200 len: 1505 microversion: 2.1 time: 0.150228 Sep 14 09:42:57.327199 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3454/6778] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:42:57 2022] GET /compute/v2.1/servers/65452924-da4a-4684-98ae-e88507c85e34 => generated 1505 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:42:57.348337 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-977ba191-da0d-495c-af23-b19cb53acd77 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:42:57.349454 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-977ba191-da0d-495c-af23-b19cb53acd77 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] [instance: 65452924-da4a-4684-98ae-e88507c85e34] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:42:57.355257 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-977ba191-da0d-495c-af23-b19cb53acd77 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:57.355752 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-977ba191-da0d-495c-af23-b19cb53acd77 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:57.356258 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-977ba191-da0d-495c-af23-b19cb53acd77 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:57.356989 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-977ba191-da0d-495c-af23-b19cb53acd77 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:57.357454 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-977ba191-da0d-495c-af23-b19cb53acd77 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:57.357891 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-977ba191-da0d-495c-af23-b19cb53acd77 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:57.493370 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-977ba191-da0d-495c-af23-b19cb53acd77 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9068c0af1a7c48dab91c3ebf4ebd9148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf91d97eec8b46e2b1f07b6f39185030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:42:57.501191 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-977ba191-da0d-495c-af23-b19cb53acd77 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] 10.222.0.60 "GET /compute/v2.1/servers/65452924-da4a-4684-98ae-e88507c85e34" status: 200 len: 1505 microversion: 2.1 time: 0.156470 Sep 14 09:42:57.502053 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3455/6779] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:42:57 2022] GET /compute/v2.1/servers/65452924-da4a-4684-98ae-e88507c85e34 => generated 1505 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:42:57.523070 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-2c0648c4-457f-42a3-a8fc-75a1607318d9 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:42:57.525365 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-2c0648c4-457f-42a3-a8fc-75a1607318d9 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] [instance: 65452924-da4a-4684-98ae-e88507c85e34] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:42:57.531334 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2c0648c4-457f-42a3-a8fc-75a1607318d9 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:57.531821 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2c0648c4-457f-42a3-a8fc-75a1607318d9 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:57.532257 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2c0648c4-457f-42a3-a8fc-75a1607318d9 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:57.532943 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2c0648c4-457f-42a3-a8fc-75a1607318d9 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:57.533395 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2c0648c4-457f-42a3-a8fc-75a1607318d9 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:57.533857 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2c0648c4-457f-42a3-a8fc-75a1607318d9 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:57.562718 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-2c0648c4-457f-42a3-a8fc-75a1607318d9 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '9068c0af1a7c48dab91c3ebf4ebd9148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf91d97eec8b46e2b1f07b6f39185030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:42:57.568332 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-2c0648c4-457f-42a3-a8fc-75a1607318d9 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] [instance: 65452924-da4a-4684-98ae-e88507c85e34] Old instance type m1.heat2, new instance type m1.heat {{(pid=128759) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 14 09:42:57.575180 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-2c0648c4-457f-42a3-a8fc-75a1607318d9 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Flavor limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:42:57.575326 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-2c0648c4-457f-42a3-a8fc-75a1607318d9 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Image limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:42:57.575801 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-2c0648c4-457f-42a3-a8fc-75a1607318d9 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Flavor pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:42:57.576235 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-2c0648c4-457f-42a3-a8fc-75a1607318d9 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Image pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:42:57.576646 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-2c0648c4-457f-42a3-a8fc-75a1607318d9 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:42:57.640111 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-2c0648c4-457f-42a3-a8fc-75a1607318d9 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] 10.222.0.60 "POST /compute/v2.1/servers/65452924-da4a-4684-98ae-e88507c85e34/action" status: 202 len: 0 microversion: 2.1 time: 0.120800 Sep 14 09:42:57.640728 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3456/6780] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:42:57 2022] POST /compute/v2.1/servers/65452924-da4a-4684-98ae-e88507c85e34/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 14 09:42:57.649184 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-24cc5b75-6375-4f9f-bf26-bdecc71d41ef tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:42:57.649810 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-24cc5b75-6375-4f9f-bf26-bdecc71d41ef tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] [instance: 65452924-da4a-4684-98ae-e88507c85e34] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:42:57.656835 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-24cc5b75-6375-4f9f-bf26-bdecc71d41ef tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:57.657425 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-24cc5b75-6375-4f9f-bf26-bdecc71d41ef tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:57.657882 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-24cc5b75-6375-4f9f-bf26-bdecc71d41ef tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:57.658740 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-24cc5b75-6375-4f9f-bf26-bdecc71d41ef tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:57.659247 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-24cc5b75-6375-4f9f-bf26-bdecc71d41ef tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:57.659690 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-24cc5b75-6375-4f9f-bf26-bdecc71d41ef tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:57.809358 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-24cc5b75-6375-4f9f-bf26-bdecc71d41ef tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9068c0af1a7c48dab91c3ebf4ebd9148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf91d97eec8b46e2b1f07b6f39185030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:42:57.820794 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-24cc5b75-6375-4f9f-bf26-bdecc71d41ef tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] 10.222.0.60 "GET /compute/v2.1/servers/65452924-da4a-4684-98ae-e88507c85e34" status: 200 len: 1516 microversion: 2.1 time: 0.175752 Sep 14 09:42:57.821382 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3457/6781] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:42:57 2022] GET /compute/v2.1/servers/65452924-da4a-4684-98ae-e88507c85e34 => generated 1516 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:42:58.845201 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-fbd3d0b3-7353-4265-9799-c9a1fd7e75ba tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:42:58.845897 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-fbd3d0b3-7353-4265-9799-c9a1fd7e75ba tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] [instance: 65452924-da4a-4684-98ae-e88507c85e34] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:42:58.853840 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fbd3d0b3-7353-4265-9799-c9a1fd7e75ba tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:58.854337 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fbd3d0b3-7353-4265-9799-c9a1fd7e75ba tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:58.854785 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fbd3d0b3-7353-4265-9799-c9a1fd7e75ba tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:58.855721 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fbd3d0b3-7353-4265-9799-c9a1fd7e75ba tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:58.856189 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fbd3d0b3-7353-4265-9799-c9a1fd7e75ba tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:58.856625 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fbd3d0b3-7353-4265-9799-c9a1fd7e75ba tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:58.989794 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-fbd3d0b3-7353-4265-9799-c9a1fd7e75ba tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9068c0af1a7c48dab91c3ebf4ebd9148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf91d97eec8b46e2b1f07b6f39185030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:42:58.997693 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-fbd3d0b3-7353-4265-9799-c9a1fd7e75ba tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] 10.222.0.60 "GET /compute/v2.1/servers/65452924-da4a-4684-98ae-e88507c85e34" status: 200 len: 1516 microversion: 2.1 time: 0.156687 Sep 14 09:42:58.998270 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3458/6782] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:42:58 2022] GET /compute/v2.1/servers/65452924-da4a-4684-98ae-e88507c85e34 => generated 1516 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:43:00.021297 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-391d64aa-d92f-4316-995a-8f157910dfe2 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:43:00.021917 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-391d64aa-d92f-4316-995a-8f157910dfe2 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] [instance: 65452924-da4a-4684-98ae-e88507c85e34] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:43:00.028885 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-391d64aa-d92f-4316-995a-8f157910dfe2 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:00.029370 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-391d64aa-d92f-4316-995a-8f157910dfe2 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:00.029811 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-391d64aa-d92f-4316-995a-8f157910dfe2 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:00.030504 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-391d64aa-d92f-4316-995a-8f157910dfe2 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:00.031097 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-391d64aa-d92f-4316-995a-8f157910dfe2 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:00.031415 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-391d64aa-d92f-4316-995a-8f157910dfe2 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:00.166008 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-391d64aa-d92f-4316-995a-8f157910dfe2 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9068c0af1a7c48dab91c3ebf4ebd9148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf91d97eec8b46e2b1f07b6f39185030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:43:00.174153 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-391d64aa-d92f-4316-995a-8f157910dfe2 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] 10.222.0.60 "GET /compute/v2.1/servers/65452924-da4a-4684-98ae-e88507c85e34" status: 200 len: 1521 microversion: 2.1 time: 0.156644 Sep 14 09:43:00.174735 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3459/6783] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:43:00 2022] GET /compute/v2.1/servers/65452924-da4a-4684-98ae-e88507c85e34 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:43:01.198252 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-58469e80-f351-4d02-834e-611ce27fc528 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:43:01.198891 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-58469e80-f351-4d02-834e-611ce27fc528 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] [instance: 65452924-da4a-4684-98ae-e88507c85e34] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:43:01.205828 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-58469e80-f351-4d02-834e-611ce27fc528 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:01.206316 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-58469e80-f351-4d02-834e-611ce27fc528 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:01.206759 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-58469e80-f351-4d02-834e-611ce27fc528 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:01.207497 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-58469e80-f351-4d02-834e-611ce27fc528 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:01.208593 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-58469e80-f351-4d02-834e-611ce27fc528 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:01.209033 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-58469e80-f351-4d02-834e-611ce27fc528 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:01.336930 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-58469e80-f351-4d02-834e-611ce27fc528 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9068c0af1a7c48dab91c3ebf4ebd9148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf91d97eec8b46e2b1f07b6f39185030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:43:01.345783 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-58469e80-f351-4d02-834e-611ce27fc528 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] 10.222.0.60 "GET /compute/v2.1/servers/65452924-da4a-4684-98ae-e88507c85e34" status: 200 len: 1521 microversion: 2.1 time: 0.151452 Sep 14 09:43:01.346376 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3460/6784] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:43:01 2022] GET /compute/v2.1/servers/65452924-da4a-4684-98ae-e88507c85e34 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:43:02.369443 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-dff051e4-462d-4d94-b96d-7100e1f4de91 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:43:02.370133 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-dff051e4-462d-4d94-b96d-7100e1f4de91 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] [instance: 65452924-da4a-4684-98ae-e88507c85e34] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:43:02.377072 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dff051e4-462d-4d94-b96d-7100e1f4de91 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:02.377563 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dff051e4-462d-4d94-b96d-7100e1f4de91 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:02.378008 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dff051e4-462d-4d94-b96d-7100e1f4de91 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:02.378708 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dff051e4-462d-4d94-b96d-7100e1f4de91 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:02.379201 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dff051e4-462d-4d94-b96d-7100e1f4de91 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:02.379642 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dff051e4-462d-4d94-b96d-7100e1f4de91 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:02.524609 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-dff051e4-462d-4d94-b96d-7100e1f4de91 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9068c0af1a7c48dab91c3ebf4ebd9148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf91d97eec8b46e2b1f07b6f39185030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:43:02.536711 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-dff051e4-462d-4d94-b96d-7100e1f4de91 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] 10.222.0.60 "GET /compute/v2.1/servers/65452924-da4a-4684-98ae-e88507c85e34" status: 200 len: 1521 microversion: 2.1 time: 0.171170 Sep 14 09:43:02.537315 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3461/6785] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:43:02 2022] GET /compute/v2.1/servers/65452924-da4a-4684-98ae-e88507c85e34 => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:43:03.561728 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c9f279a0-e5b1-4663-b79f-04e6c233c707 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:43:03.562404 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-c9f279a0-e5b1-4663-b79f-04e6c233c707 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] [instance: 65452924-da4a-4684-98ae-e88507c85e34] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:43:03.569492 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c9f279a0-e5b1-4663-b79f-04e6c233c707 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:03.569986 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c9f279a0-e5b1-4663-b79f-04e6c233c707 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:03.570429 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c9f279a0-e5b1-4663-b79f-04e6c233c707 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:03.571190 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c9f279a0-e5b1-4663-b79f-04e6c233c707 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:03.571653 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c9f279a0-e5b1-4663-b79f-04e6c233c707 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:03.572084 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c9f279a0-e5b1-4663-b79f-04e6c233c707 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:03.704104 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-c9f279a0-e5b1-4663-b79f-04e6c233c707 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9068c0af1a7c48dab91c3ebf4ebd9148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf91d97eec8b46e2b1f07b6f39185030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:43:03.712494 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-c9f279a0-e5b1-4663-b79f-04e6c233c707 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] 10.222.0.60 "GET /compute/v2.1/servers/65452924-da4a-4684-98ae-e88507c85e34" status: 200 len: 1521 microversion: 2.1 time: 0.154700 Sep 14 09:43:03.713076 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3462/6786] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:43:03 2022] GET /compute/v2.1/servers/65452924-da4a-4684-98ae-e88507c85e34 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:43:04.736196 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c4f8fc3e-28e8-4084-a596-fbebb33ae4e1 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:43:04.736829 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-c4f8fc3e-28e8-4084-a596-fbebb33ae4e1 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] [instance: 65452924-da4a-4684-98ae-e88507c85e34] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:43:04.743965 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c4f8fc3e-28e8-4084-a596-fbebb33ae4e1 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:04.744462 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c4f8fc3e-28e8-4084-a596-fbebb33ae4e1 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:04.744931 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c4f8fc3e-28e8-4084-a596-fbebb33ae4e1 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:04.745672 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c4f8fc3e-28e8-4084-a596-fbebb33ae4e1 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:04.746163 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c4f8fc3e-28e8-4084-a596-fbebb33ae4e1 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:04.746597 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c4f8fc3e-28e8-4084-a596-fbebb33ae4e1 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:04.879098 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-c4f8fc3e-28e8-4084-a596-fbebb33ae4e1 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9068c0af1a7c48dab91c3ebf4ebd9148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf91d97eec8b46e2b1f07b6f39185030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:43:04.887408 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-c4f8fc3e-28e8-4084-a596-fbebb33ae4e1 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] 10.222.0.60 "GET /compute/v2.1/servers/65452924-da4a-4684-98ae-e88507c85e34" status: 200 len: 1521 microversion: 2.1 time: 0.155162 Sep 14 09:43:04.887983 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3463/6787] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:43:04 2022] GET /compute/v2.1/servers/65452924-da4a-4684-98ae-e88507c85e34 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:43:05.913366 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-bb47fb6c-7e57-4add-93e7-628f19b0b723 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:43:05.914015 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-bb47fb6c-7e57-4add-93e7-628f19b0b723 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] [instance: 65452924-da4a-4684-98ae-e88507c85e34] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:43:05.916731 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=3 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:43:05.922153 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bb47fb6c-7e57-4add-93e7-628f19b0b723 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:05.922644 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bb47fb6c-7e57-4add-93e7-628f19b0b723 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:05.923111 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bb47fb6c-7e57-4add-93e7-628f19b0b723 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:05.923807 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bb47fb6c-7e57-4add-93e7-628f19b0b723 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:05.924264 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bb47fb6c-7e57-4add-93e7-628f19b0b723 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:05.924694 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bb47fb6c-7e57-4add-93e7-628f19b0b723 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:05.943751 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:43:06.059871 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-bb47fb6c-7e57-4add-93e7-628f19b0b723 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9068c0af1a7c48dab91c3ebf4ebd9148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf91d97eec8b46e2b1f07b6f39185030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:43:06.068267 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-bb47fb6c-7e57-4add-93e7-628f19b0b723 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] 10.222.0.60 "GET /compute/v2.1/servers/65452924-da4a-4684-98ae-e88507c85e34" status: 200 len: 1521 microversion: 2.1 time: 0.159405 Sep 14 09:43:06.068839 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3464/6788] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:43:05 2022] GET /compute/v2.1/servers/65452924-da4a-4684-98ae-e88507c85e34 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:43:07.091900 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-7f70c92d-c6aa-4e19-b205-49f152d37766 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:43:07.092528 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-7f70c92d-c6aa-4e19-b205-49f152d37766 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] [instance: 65452924-da4a-4684-98ae-e88507c85e34] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:43:07.100607 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7f70c92d-c6aa-4e19-b205-49f152d37766 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:07.101108 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7f70c92d-c6aa-4e19-b205-49f152d37766 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:07.101553 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7f70c92d-c6aa-4e19-b205-49f152d37766 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:07.102254 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7f70c92d-c6aa-4e19-b205-49f152d37766 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:07.102717 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7f70c92d-c6aa-4e19-b205-49f152d37766 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:07.103181 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7f70c92d-c6aa-4e19-b205-49f152d37766 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:07.230843 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-7f70c92d-c6aa-4e19-b205-49f152d37766 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9068c0af1a7c48dab91c3ebf4ebd9148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf91d97eec8b46e2b1f07b6f39185030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:43:07.239144 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-7f70c92d-c6aa-4e19-b205-49f152d37766 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] 10.222.0.60 "GET /compute/v2.1/servers/65452924-da4a-4684-98ae-e88507c85e34" status: 200 len: 1521 microversion: 2.1 time: 0.151456 Sep 14 09:43:07.239729 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3465/6789] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:43:07 2022] GET /compute/v2.1/servers/65452924-da4a-4684-98ae-e88507c85e34 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:43:08.263505 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-2cfe0fc4-9b1c-41a1-8f96-a9b81bf4bd08 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:43:08.264144 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-2cfe0fc4-9b1c-41a1-8f96-a9b81bf4bd08 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] [instance: 65452924-da4a-4684-98ae-e88507c85e34] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:43:08.271362 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2cfe0fc4-9b1c-41a1-8f96-a9b81bf4bd08 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:08.271883 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2cfe0fc4-9b1c-41a1-8f96-a9b81bf4bd08 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:08.272330 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2cfe0fc4-9b1c-41a1-8f96-a9b81bf4bd08 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:08.273034 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2cfe0fc4-9b1c-41a1-8f96-a9b81bf4bd08 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:08.273497 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2cfe0fc4-9b1c-41a1-8f96-a9b81bf4bd08 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:08.273936 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2cfe0fc4-9b1c-41a1-8f96-a9b81bf4bd08 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:08.413943 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-2cfe0fc4-9b1c-41a1-8f96-a9b81bf4bd08 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9068c0af1a7c48dab91c3ebf4ebd9148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf91d97eec8b46e2b1f07b6f39185030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:43:08.421796 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-2cfe0fc4-9b1c-41a1-8f96-a9b81bf4bd08 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] 10.222.0.60 "GET /compute/v2.1/servers/65452924-da4a-4684-98ae-e88507c85e34" status: 200 len: 1521 microversion: 2.1 time: 0.162380 Sep 14 09:43:08.422379 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3466/6790] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:43:08 2022] GET /compute/v2.1/servers/65452924-da4a-4684-98ae-e88507c85e34 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:43:09.445420 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-cfe4c688-b4bf-470d-ab5c-0d39302d5b37 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:43:09.446107 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-cfe4c688-b4bf-470d-ab5c-0d39302d5b37 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] [instance: 65452924-da4a-4684-98ae-e88507c85e34] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:43:09.453065 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cfe4c688-b4bf-470d-ab5c-0d39302d5b37 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:09.453553 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cfe4c688-b4bf-470d-ab5c-0d39302d5b37 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:09.453994 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cfe4c688-b4bf-470d-ab5c-0d39302d5b37 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:09.454686 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cfe4c688-b4bf-470d-ab5c-0d39302d5b37 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:09.455182 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cfe4c688-b4bf-470d-ab5c-0d39302d5b37 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:09.455610 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cfe4c688-b4bf-470d-ab5c-0d39302d5b37 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:09.589738 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-cfe4c688-b4bf-470d-ab5c-0d39302d5b37 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9068c0af1a7c48dab91c3ebf4ebd9148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf91d97eec8b46e2b1f07b6f39185030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:43:09.597559 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-cfe4c688-b4bf-470d-ab5c-0d39302d5b37 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] 10.222.0.60 "GET /compute/v2.1/servers/65452924-da4a-4684-98ae-e88507c85e34" status: 200 len: 1521 microversion: 2.1 time: 0.156070 Sep 14 09:43:09.598156 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3467/6791] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:43:09 2022] GET /compute/v2.1/servers/65452924-da4a-4684-98ae-e88507c85e34 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:43:10.621036 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-fa451432-151e-4d31-8d17-a3402eb63eb6 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:43:10.621696 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-fa451432-151e-4d31-8d17-a3402eb63eb6 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] [instance: 65452924-da4a-4684-98ae-e88507c85e34] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:43:10.628708 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fa451432-151e-4d31-8d17-a3402eb63eb6 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:10.629200 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fa451432-151e-4d31-8d17-a3402eb63eb6 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:10.629644 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fa451432-151e-4d31-8d17-a3402eb63eb6 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:10.630344 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fa451432-151e-4d31-8d17-a3402eb63eb6 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:10.630814 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fa451432-151e-4d31-8d17-a3402eb63eb6 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:10.631284 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fa451432-151e-4d31-8d17-a3402eb63eb6 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:10.760124 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-fa451432-151e-4d31-8d17-a3402eb63eb6 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9068c0af1a7c48dab91c3ebf4ebd9148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf91d97eec8b46e2b1f07b6f39185030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:43:10.767935 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-fa451432-151e-4d31-8d17-a3402eb63eb6 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] 10.222.0.60 "GET /compute/v2.1/servers/65452924-da4a-4684-98ae-e88507c85e34" status: 200 len: 1521 microversion: 2.1 time: 0.150877 Sep 14 09:43:10.768511 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3468/6792] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:43:10 2022] GET /compute/v2.1/servers/65452924-da4a-4684-98ae-e88507c85e34 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:43:11.791922 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-2104378b-c3f3-4023-8156-85ce8189800e tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:43:11.792581 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-2104378b-c3f3-4023-8156-85ce8189800e tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] [instance: 65452924-da4a-4684-98ae-e88507c85e34] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:43:11.799533 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2104378b-c3f3-4023-8156-85ce8189800e tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:11.800021 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2104378b-c3f3-4023-8156-85ce8189800e tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:11.800460 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2104378b-c3f3-4023-8156-85ce8189800e tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:11.801152 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2104378b-c3f3-4023-8156-85ce8189800e tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:11.801609 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2104378b-c3f3-4023-8156-85ce8189800e tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:11.802038 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2104378b-c3f3-4023-8156-85ce8189800e tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:11.933841 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-2104378b-c3f3-4023-8156-85ce8189800e tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9068c0af1a7c48dab91c3ebf4ebd9148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf91d97eec8b46e2b1f07b6f39185030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:43:11.941584 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-2104378b-c3f3-4023-8156-85ce8189800e tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] 10.222.0.60 "GET /compute/v2.1/servers/65452924-da4a-4684-98ae-e88507c85e34" status: 200 len: 1521 microversion: 2.1 time: 0.153643 Sep 14 09:43:11.942159 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3469/6793] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:43:11 2022] GET /compute/v2.1/servers/65452924-da4a-4684-98ae-e88507c85e34 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:43:12.966219 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9bbe8473-3c55-4831-be9e-66b97bacdf1a tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:43:12.966864 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-9bbe8473-3c55-4831-be9e-66b97bacdf1a tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] [instance: 65452924-da4a-4684-98ae-e88507c85e34] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:43:12.973880 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9bbe8473-3c55-4831-be9e-66b97bacdf1a tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:12.974372 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9bbe8473-3c55-4831-be9e-66b97bacdf1a tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:12.974822 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9bbe8473-3c55-4831-be9e-66b97bacdf1a tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:12.975546 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9bbe8473-3c55-4831-be9e-66b97bacdf1a tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:12.976011 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9bbe8473-3c55-4831-be9e-66b97bacdf1a tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:12.976446 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9bbe8473-3c55-4831-be9e-66b97bacdf1a tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:13.106562 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-9bbe8473-3c55-4831-be9e-66b97bacdf1a tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9068c0af1a7c48dab91c3ebf4ebd9148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf91d97eec8b46e2b1f07b6f39185030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:43:13.114552 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-9bbe8473-3c55-4831-be9e-66b97bacdf1a tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] 10.222.0.60 "GET /compute/v2.1/servers/65452924-da4a-4684-98ae-e88507c85e34" status: 200 len: 1521 microversion: 2.1 time: 0.152567 Sep 14 09:43:13.115170 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3470/6794] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:43:12 2022] GET /compute/v2.1/servers/65452924-da4a-4684-98ae-e88507c85e34 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:43:14.138368 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-1ba0aaff-e0e7-4c7c-b805-516327c031c5 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:43:14.139074 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-1ba0aaff-e0e7-4c7c-b805-516327c031c5 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] [instance: 65452924-da4a-4684-98ae-e88507c85e34] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:43:14.145951 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1ba0aaff-e0e7-4c7c-b805-516327c031c5 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:14.146443 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1ba0aaff-e0e7-4c7c-b805-516327c031c5 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:14.146889 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1ba0aaff-e0e7-4c7c-b805-516327c031c5 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:14.147610 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1ba0aaff-e0e7-4c7c-b805-516327c031c5 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:14.148071 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1ba0aaff-e0e7-4c7c-b805-516327c031c5 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:14.148504 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1ba0aaff-e0e7-4c7c-b805-516327c031c5 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:14.279781 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-1ba0aaff-e0e7-4c7c-b805-516327c031c5 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9068c0af1a7c48dab91c3ebf4ebd9148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf91d97eec8b46e2b1f07b6f39185030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:43:14.287577 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-1ba0aaff-e0e7-4c7c-b805-516327c031c5 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] 10.222.0.60 "GET /compute/v2.1/servers/65452924-da4a-4684-98ae-e88507c85e34" status: 200 len: 1521 microversion: 2.1 time: 0.153138 Sep 14 09:43:14.288146 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3471/6795] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:43:14 2022] GET /compute/v2.1/servers/65452924-da4a-4684-98ae-e88507c85e34 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:43:15.311651 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-cdc919f6-5309-403f-8b8d-13cc461fd690 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:43:15.312273 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-cdc919f6-5309-403f-8b8d-13cc461fd690 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] [instance: 65452924-da4a-4684-98ae-e88507c85e34] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:43:15.319127 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cdc919f6-5309-403f-8b8d-13cc461fd690 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:15.319613 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cdc919f6-5309-403f-8b8d-13cc461fd690 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:15.320046 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cdc919f6-5309-403f-8b8d-13cc461fd690 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:15.320729 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cdc919f6-5309-403f-8b8d-13cc461fd690 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:15.321181 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cdc919f6-5309-403f-8b8d-13cc461fd690 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:15.321606 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cdc919f6-5309-403f-8b8d-13cc461fd690 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:15.452698 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-cdc919f6-5309-403f-8b8d-13cc461fd690 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9068c0af1a7c48dab91c3ebf4ebd9148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf91d97eec8b46e2b1f07b6f39185030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:43:15.460394 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-cdc919f6-5309-403f-8b8d-13cc461fd690 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] 10.222.0.60 "GET /compute/v2.1/servers/65452924-da4a-4684-98ae-e88507c85e34" status: 200 len: 1521 microversion: 2.1 time: 0.152698 Sep 14 09:43:15.460963 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3472/6796] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:43:15 2022] GET /compute/v2.1/servers/65452924-da4a-4684-98ae-e88507c85e34 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:43:16.484254 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-5eef1726-f0c5-45de-a880-033de7d3f0bf tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:43:16.484936 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-5eef1726-f0c5-45de-a880-033de7d3f0bf tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] [instance: 65452924-da4a-4684-98ae-e88507c85e34] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:43:16.492224 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5eef1726-f0c5-45de-a880-033de7d3f0bf tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:16.492711 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5eef1726-f0c5-45de-a880-033de7d3f0bf tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:16.493145 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5eef1726-f0c5-45de-a880-033de7d3f0bf tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:16.493836 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5eef1726-f0c5-45de-a880-033de7d3f0bf tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:16.494286 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5eef1726-f0c5-45de-a880-033de7d3f0bf tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:16.494712 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5eef1726-f0c5-45de-a880-033de7d3f0bf tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:16.628698 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-5eef1726-f0c5-45de-a880-033de7d3f0bf tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9068c0af1a7c48dab91c3ebf4ebd9148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf91d97eec8b46e2b1f07b6f39185030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:43:16.637830 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-5eef1726-f0c5-45de-a880-033de7d3f0bf tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] 10.222.0.60 "GET /compute/v2.1/servers/65452924-da4a-4684-98ae-e88507c85e34" status: 200 len: 1521 microversion: 2.1 time: 0.157376 Sep 14 09:43:16.638469 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3473/6797] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:43:16 2022] GET /compute/v2.1/servers/65452924-da4a-4684-98ae-e88507c85e34 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:43:17.661580 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-054b84c7-07cb-45e1-83e5-f0b43e280c49 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:43:17.662204 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-054b84c7-07cb-45e1-83e5-f0b43e280c49 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] [instance: 65452924-da4a-4684-98ae-e88507c85e34] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:43:17.669884 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-054b84c7-07cb-45e1-83e5-f0b43e280c49 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:17.670377 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-054b84c7-07cb-45e1-83e5-f0b43e280c49 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:17.670821 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-054b84c7-07cb-45e1-83e5-f0b43e280c49 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:17.671550 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-054b84c7-07cb-45e1-83e5-f0b43e280c49 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:17.672010 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-054b84c7-07cb-45e1-83e5-f0b43e280c49 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:17.672437 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-054b84c7-07cb-45e1-83e5-f0b43e280c49 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:17.805919 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-054b84c7-07cb-45e1-83e5-f0b43e280c49 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9068c0af1a7c48dab91c3ebf4ebd9148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf91d97eec8b46e2b1f07b6f39185030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:43:17.813723 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-054b84c7-07cb-45e1-83e5-f0b43e280c49 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] 10.222.0.60 "GET /compute/v2.1/servers/65452924-da4a-4684-98ae-e88507c85e34" status: 200 len: 1521 microversion: 2.1 time: 0.156145 Sep 14 09:43:17.814304 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3474/6798] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:43:17 2022] GET /compute/v2.1/servers/65452924-da4a-4684-98ae-e88507c85e34 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:43:18.838095 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9c0252ed-8ee3-449f-b7f0-24f7c8d8e0d7 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:43:18.839014 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-9c0252ed-8ee3-449f-b7f0-24f7c8d8e0d7 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] [instance: 65452924-da4a-4684-98ae-e88507c85e34] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:43:18.845979 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9c0252ed-8ee3-449f-b7f0-24f7c8d8e0d7 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:18.846512 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9c0252ed-8ee3-449f-b7f0-24f7c8d8e0d7 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:18.846977 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9c0252ed-8ee3-449f-b7f0-24f7c8d8e0d7 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:18.847685 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9c0252ed-8ee3-449f-b7f0-24f7c8d8e0d7 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:18.848151 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9c0252ed-8ee3-449f-b7f0-24f7c8d8e0d7 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:18.848586 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9c0252ed-8ee3-449f-b7f0-24f7c8d8e0d7 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:18.977864 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-9c0252ed-8ee3-449f-b7f0-24f7c8d8e0d7 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9068c0af1a7c48dab91c3ebf4ebd9148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf91d97eec8b46e2b1f07b6f39185030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:43:18.985651 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-9c0252ed-8ee3-449f-b7f0-24f7c8d8e0d7 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] 10.222.0.60 "GET /compute/v2.1/servers/65452924-da4a-4684-98ae-e88507c85e34" status: 200 len: 1521 microversion: 2.1 time: 0.151890 Sep 14 09:43:18.986225 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3475/6799] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:43:18 2022] GET /compute/v2.1/servers/65452924-da4a-4684-98ae-e88507c85e34 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:43:20.009811 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-14ea4e7c-23a2-4984-92dc-622a8f796298 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:43:20.010483 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-14ea4e7c-23a2-4984-92dc-622a8f796298 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] [instance: 65452924-da4a-4684-98ae-e88507c85e34] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:43:20.017346 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-14ea4e7c-23a2-4984-92dc-622a8f796298 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:20.017838 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-14ea4e7c-23a2-4984-92dc-622a8f796298 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:20.018284 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-14ea4e7c-23a2-4984-92dc-622a8f796298 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:20.019047 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-14ea4e7c-23a2-4984-92dc-622a8f796298 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:20.019512 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-14ea4e7c-23a2-4984-92dc-622a8f796298 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:20.019945 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-14ea4e7c-23a2-4984-92dc-622a8f796298 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:20.151643 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-14ea4e7c-23a2-4984-92dc-622a8f796298 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9068c0af1a7c48dab91c3ebf4ebd9148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf91d97eec8b46e2b1f07b6f39185030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:43:20.159387 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-14ea4e7c-23a2-4984-92dc-622a8f796298 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] 10.222.0.60 "GET /compute/v2.1/servers/65452924-da4a-4684-98ae-e88507c85e34" status: 200 len: 1521 microversion: 2.1 time: 0.154120 Sep 14 09:43:20.159968 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3476/6800] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:43:20 2022] GET /compute/v2.1/servers/65452924-da4a-4684-98ae-e88507c85e34 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:43:21.182230 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d7038237-c039-4746-aafc-051e80b13bd8 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:43:21.182881 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-d7038237-c039-4746-aafc-051e80b13bd8 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] [instance: 65452924-da4a-4684-98ae-e88507c85e34] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:43:21.189725 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d7038237-c039-4746-aafc-051e80b13bd8 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:21.190213 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d7038237-c039-4746-aafc-051e80b13bd8 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:21.190650 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d7038237-c039-4746-aafc-051e80b13bd8 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:21.191370 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d7038237-c039-4746-aafc-051e80b13bd8 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:21.191831 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d7038237-c039-4746-aafc-051e80b13bd8 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:21.192255 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d7038237-c039-4746-aafc-051e80b13bd8 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:21.319824 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-d7038237-c039-4746-aafc-051e80b13bd8 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9068c0af1a7c48dab91c3ebf4ebd9148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf91d97eec8b46e2b1f07b6f39185030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:43:21.327570 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d7038237-c039-4746-aafc-051e80b13bd8 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] 10.222.0.60 "GET /compute/v2.1/servers/65452924-da4a-4684-98ae-e88507c85e34" status: 200 len: 1521 microversion: 2.1 time: 0.149895 Sep 14 09:43:21.328151 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3477/6801] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:43:21 2022] GET /compute/v2.1/servers/65452924-da4a-4684-98ae-e88507c85e34 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:43:22.350980 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-456d3c29-1b8a-4f9a-950b-fa93cfc9ec7a tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:43:22.351671 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-456d3c29-1b8a-4f9a-950b-fa93cfc9ec7a tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] [instance: 65452924-da4a-4684-98ae-e88507c85e34] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:43:22.358684 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-456d3c29-1b8a-4f9a-950b-fa93cfc9ec7a tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:22.359208 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-456d3c29-1b8a-4f9a-950b-fa93cfc9ec7a tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:22.359654 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-456d3c29-1b8a-4f9a-950b-fa93cfc9ec7a tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:22.360348 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-456d3c29-1b8a-4f9a-950b-fa93cfc9ec7a tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:22.360810 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-456d3c29-1b8a-4f9a-950b-fa93cfc9ec7a tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:22.361240 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-456d3c29-1b8a-4f9a-950b-fa93cfc9ec7a tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:22.497040 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-456d3c29-1b8a-4f9a-950b-fa93cfc9ec7a tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9068c0af1a7c48dab91c3ebf4ebd9148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf91d97eec8b46e2b1f07b6f39185030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:43:22.504728 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-456d3c29-1b8a-4f9a-950b-fa93cfc9ec7a tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] 10.222.0.60 "GET /compute/v2.1/servers/65452924-da4a-4684-98ae-e88507c85e34" status: 200 len: 1521 microversion: 2.1 time: 0.157702 Sep 14 09:43:22.505304 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3478/6802] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:43:22 2022] GET /compute/v2.1/servers/65452924-da4a-4684-98ae-e88507c85e34 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:43:23.528730 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-0ed6b366-e46d-4589-829c-e72af04b30b2 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:43:23.529410 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-0ed6b366-e46d-4589-829c-e72af04b30b2 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] [instance: 65452924-da4a-4684-98ae-e88507c85e34] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:43:23.536287 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0ed6b366-e46d-4589-829c-e72af04b30b2 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:23.536810 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0ed6b366-e46d-4589-829c-e72af04b30b2 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:23.537276 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0ed6b366-e46d-4589-829c-e72af04b30b2 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:23.538648 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0ed6b366-e46d-4589-829c-e72af04b30b2 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:23.539161 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0ed6b366-e46d-4589-829c-e72af04b30b2 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:23.539601 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0ed6b366-e46d-4589-829c-e72af04b30b2 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:23.670532 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-0ed6b366-e46d-4589-829c-e72af04b30b2 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9068c0af1a7c48dab91c3ebf4ebd9148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf91d97eec8b46e2b1f07b6f39185030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:43:23.678439 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-0ed6b366-e46d-4589-829c-e72af04b30b2 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] 10.222.0.60 "GET /compute/v2.1/servers/65452924-da4a-4684-98ae-e88507c85e34" status: 200 len: 1521 microversion: 2.1 time: 0.153660 Sep 14 09:43:23.679055 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3479/6803] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:43:23 2022] GET /compute/v2.1/servers/65452924-da4a-4684-98ae-e88507c85e34 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:43:24.702193 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-85ae7732-25e7-4a2d-84f3-846dc35def8f tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:43:24.702816 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-85ae7732-25e7-4a2d-84f3-846dc35def8f tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] [instance: 65452924-da4a-4684-98ae-e88507c85e34] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:43:24.709722 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-85ae7732-25e7-4a2d-84f3-846dc35def8f tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:24.710212 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-85ae7732-25e7-4a2d-84f3-846dc35def8f tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:24.710657 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-85ae7732-25e7-4a2d-84f3-846dc35def8f tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:24.711385 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-85ae7732-25e7-4a2d-84f3-846dc35def8f tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:24.711849 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-85ae7732-25e7-4a2d-84f3-846dc35def8f tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:24.712282 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-85ae7732-25e7-4a2d-84f3-846dc35def8f tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:24.840219 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-85ae7732-25e7-4a2d-84f3-846dc35def8f tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9068c0af1a7c48dab91c3ebf4ebd9148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf91d97eec8b46e2b1f07b6f39185030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:43:24.848061 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-85ae7732-25e7-4a2d-84f3-846dc35def8f tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] 10.222.0.60 "GET /compute/v2.1/servers/65452924-da4a-4684-98ae-e88507c85e34" status: 200 len: 1521 microversion: 2.1 time: 0.150032 Sep 14 09:43:24.848650 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3480/6804] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:43:24 2022] GET /compute/v2.1/servers/65452924-da4a-4684-98ae-e88507c85e34 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:43:25.870644 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-be9e3704-0277-45c2-95c0-2eeda12bca65 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:43:25.871304 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-be9e3704-0277-45c2-95c0-2eeda12bca65 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] [instance: 65452924-da4a-4684-98ae-e88507c85e34] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:43:25.878122 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-be9e3704-0277-45c2-95c0-2eeda12bca65 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:25.878614 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-be9e3704-0277-45c2-95c0-2eeda12bca65 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:25.879136 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-be9e3704-0277-45c2-95c0-2eeda12bca65 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:25.879884 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-be9e3704-0277-45c2-95c0-2eeda12bca65 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:25.880323 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-be9e3704-0277-45c2-95c0-2eeda12bca65 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:25.880799 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-be9e3704-0277-45c2-95c0-2eeda12bca65 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:25.885320 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=100 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:43:26.014614 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-be9e3704-0277-45c2-95c0-2eeda12bca65 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9068c0af1a7c48dab91c3ebf4ebd9148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf91d97eec8b46e2b1f07b6f39185030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:43:26.022305 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-be9e3704-0277-45c2-95c0-2eeda12bca65 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] 10.222.0.60 "GET /compute/v2.1/servers/65452924-da4a-4684-98ae-e88507c85e34" status: 200 len: 1521 microversion: 2.1 time: 0.155610 Sep 14 09:43:26.022874 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3481/6805] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:43:25 2022] GET /compute/v2.1/servers/65452924-da4a-4684-98ae-e88507c85e34 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:43:26.756319 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-66b8153b-626e-4c76-9f5d-2093f0f3692a req-21988a01-5aee-4e10-b2e5-dac0c1fc96f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65452924-da4a-4684-98ae-e88507c85e34", "name": "network-vif-unplugged", "status": "completed", "tag": "e81325e8-d3ef-49f2-9216-9e0d36f2a957"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:43:26.766956 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-66b8153b-626e-4c76-9f5d-2093f0f3692a req-21988a01-5aee-4e10-b2e5-dac0c1fc96f6 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:26.767456 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-66b8153b-626e-4c76-9f5d-2093f0f3692a req-21988a01-5aee-4e10-b2e5-dac0c1fc96f6 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:26.767892 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-66b8153b-626e-4c76-9f5d-2093f0f3692a req-21988a01-5aee-4e10-b2e5-dac0c1fc96f6 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:26.780468 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-66b8153b-626e-4c76-9f5d-2093f0f3692a req-21988a01-5aee-4e10-b2e5-dac0c1fc96f6 service nova] Creating event network-vif-unplugged:e81325e8-d3ef-49f2-9216-9e0d36f2a957 for instance 65452924-da4a-4684-98ae-e88507c85e34 on n-h2-836830-18 Sep 14 09:43:26.785865 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [req-66b8153b-626e-4c76-9f5d-2093f0f3692a req-21988a01-5aee-4e10-b2e5-dac0c1fc96f6 service nova] Instance 65452924-da4a-4684-98ae-e88507c85e34 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-836830-18', 'n-h2-836830-18'} {{(pid=128759) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 14 09:43:26.800194 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-66b8153b-626e-4c76-9f5d-2093f0f3692a req-21988a01-5aee-4e10-b2e5-dac0c1fc96f6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047753 Sep 14 09:43:26.801156 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3482/6806] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:43:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:43:27.053318 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f16aa0d1-f4df-4ddc-9f01-e0e5f2c4d01b tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:43:27.054030 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f16aa0d1-f4df-4ddc-9f01-e0e5f2c4d01b tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] [instance: 65452924-da4a-4684-98ae-e88507c85e34] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:43:27.062093 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f16aa0d1-f4df-4ddc-9f01-e0e5f2c4d01b tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:27.062592 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f16aa0d1-f4df-4ddc-9f01-e0e5f2c4d01b tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:27.063094 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f16aa0d1-f4df-4ddc-9f01-e0e5f2c4d01b tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:27.063804 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f16aa0d1-f4df-4ddc-9f01-e0e5f2c4d01b tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:27.064262 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f16aa0d1-f4df-4ddc-9f01-e0e5f2c4d01b tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:27.064695 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f16aa0d1-f4df-4ddc-9f01-e0e5f2c4d01b tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:27.203226 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f16aa0d1-f4df-4ddc-9f01-e0e5f2c4d01b tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9068c0af1a7c48dab91c3ebf4ebd9148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf91d97eec8b46e2b1f07b6f39185030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:43:27.212145 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f16aa0d1-f4df-4ddc-9f01-e0e5f2c4d01b tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] 10.222.0.60 "GET /compute/v2.1/servers/65452924-da4a-4684-98ae-e88507c85e34" status: 200 len: 1520 microversion: 2.1 time: 0.167548 Sep 14 09:43:27.212832 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3483/6807] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:43:27 2022] GET /compute/v2.1/servers/65452924-da4a-4684-98ae-e88507c85e34 => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:43:28.236154 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d819a986-b90a-4e5c-bf9f-903c1ea62ada tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:43:28.236804 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-d819a986-b90a-4e5c-bf9f-903c1ea62ada tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] [instance: 65452924-da4a-4684-98ae-e88507c85e34] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:43:28.244478 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d819a986-b90a-4e5c-bf9f-903c1ea62ada tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:28.244972 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d819a986-b90a-4e5c-bf9f-903c1ea62ada tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:28.245418 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d819a986-b90a-4e5c-bf9f-903c1ea62ada tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:28.246115 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d819a986-b90a-4e5c-bf9f-903c1ea62ada tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:28.246577 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d819a986-b90a-4e5c-bf9f-903c1ea62ada tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:28.247041 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d819a986-b90a-4e5c-bf9f-903c1ea62ada tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:28.378319 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-d819a986-b90a-4e5c-bf9f-903c1ea62ada tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9068c0af1a7c48dab91c3ebf4ebd9148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf91d97eec8b46e2b1f07b6f39185030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:43:28.386202 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d819a986-b90a-4e5c-bf9f-903c1ea62ada tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] 10.222.0.60 "GET /compute/v2.1/servers/65452924-da4a-4684-98ae-e88507c85e34" status: 200 len: 1518 microversion: 2.1 time: 0.154252 Sep 14 09:43:28.386783 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3484/6808] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:43:28 2022] GET /compute/v2.1/servers/65452924-da4a-4684-98ae-e88507c85e34 => generated 1518 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:43:28.829612 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-28db7e15-f95f-41bb-9eb5-5f05498d9cc2 req-2c5b5020-50d5-45a6-8c6a-3416b139c114 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65452924-da4a-4684-98ae-e88507c85e34", "tag": "e81325e8-d3ef-49f2-9216-9e0d36f2a957"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:43:28.839906 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-28db7e15-f95f-41bb-9eb5-5f05498d9cc2 req-2c5b5020-50d5-45a6-8c6a-3416b139c114 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:28.840396 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-28db7e15-f95f-41bb-9eb5-5f05498d9cc2 req-2c5b5020-50d5-45a6-8c6a-3416b139c114 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:28.840834 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-28db7e15-f95f-41bb-9eb5-5f05498d9cc2 req-2c5b5020-50d5-45a6-8c6a-3416b139c114 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:28.852639 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-28db7e15-f95f-41bb-9eb5-5f05498d9cc2 req-2c5b5020-50d5-45a6-8c6a-3416b139c114 service nova] Creating event network-changed:e81325e8-d3ef-49f2-9216-9e0d36f2a957 for instance 65452924-da4a-4684-98ae-e88507c85e34 on n-h2-836830-18 Sep 14 09:43:28.857963 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [req-28db7e15-f95f-41bb-9eb5-5f05498d9cc2 req-2c5b5020-50d5-45a6-8c6a-3416b139c114 service nova] Instance 65452924-da4a-4684-98ae-e88507c85e34 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-836830-18', 'n-h2-836830-18'} {{(pid=128759) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 14 09:43:28.868660 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-28db7e15-f95f-41bb-9eb5-5f05498d9cc2 req-2c5b5020-50d5-45a6-8c6a-3416b139c114 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042825 Sep 14 09:43:28.869255 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3485/6809] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:43:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:43:29.411639 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b13130a3-73af-47c1-97d4-404d3ddee853 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:43:29.412815 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b13130a3-73af-47c1-97d4-404d3ddee853 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] [instance: 65452924-da4a-4684-98ae-e88507c85e34] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:43:29.419237 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b13130a3-73af-47c1-97d4-404d3ddee853 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:29.419739 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b13130a3-73af-47c1-97d4-404d3ddee853 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:29.420188 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b13130a3-73af-47c1-97d4-404d3ddee853 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:29.420906 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b13130a3-73af-47c1-97d4-404d3ddee853 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:29.421426 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b13130a3-73af-47c1-97d4-404d3ddee853 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:29.421864 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b13130a3-73af-47c1-97d4-404d3ddee853 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:29.559275 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b13130a3-73af-47c1-97d4-404d3ddee853 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9068c0af1a7c48dab91c3ebf4ebd9148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf91d97eec8b46e2b1f07b6f39185030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:43:29.567331 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b13130a3-73af-47c1-97d4-404d3ddee853 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] 10.222.0.60 "GET /compute/v2.1/servers/65452924-da4a-4684-98ae-e88507c85e34" status: 200 len: 1515 microversion: 2.1 time: 0.161179 Sep 14 09:43:29.577907 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3486/6810] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:43:29 2022] GET /compute/v2.1/servers/65452924-da4a-4684-98ae-e88507c85e34 => generated 1515 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:43:29.590773 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-74ce4b6f-86aa-43ee-86e5-b7899b4a77bc tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:43:29.591340 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-74ce4b6f-86aa-43ee-86e5-b7899b4a77bc tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] [instance: 65452924-da4a-4684-98ae-e88507c85e34] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:43:29.598183 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-74ce4b6f-86aa-43ee-86e5-b7899b4a77bc tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:29.598683 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-74ce4b6f-86aa-43ee-86e5-b7899b4a77bc tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:29.599334 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-74ce4b6f-86aa-43ee-86e5-b7899b4a77bc tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:29.600553 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-74ce4b6f-86aa-43ee-86e5-b7899b4a77bc tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:29.601016 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-74ce4b6f-86aa-43ee-86e5-b7899b4a77bc tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:29.601450 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-74ce4b6f-86aa-43ee-86e5-b7899b4a77bc tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:29.662655 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-74ce4b6f-86aa-43ee-86e5-b7899b4a77bc tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] 10.222.0.60 "POST /compute/v2.1/servers/65452924-da4a-4684-98ae-e88507c85e34/action" status: 204 len: 0 microversion: 2.1 time: 0.075525 Sep 14 09:43:29.663287 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3487/6811] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:43:29 2022] POST /compute/v2.1/servers/65452924-da4a-4684-98ae-e88507c85e34/action => generated 0 bytes in 78 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 14 09:43:29.673347 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-2a8563e4-9ca7-4875-bf44-8a2508bb5c37 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:43:29.674080 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-2a8563e4-9ca7-4875-bf44-8a2508bb5c37 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] [instance: 65452924-da4a-4684-98ae-e88507c85e34] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:43:29.684003 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2a8563e4-9ca7-4875-bf44-8a2508bb5c37 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:29.684508 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2a8563e4-9ca7-4875-bf44-8a2508bb5c37 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:29.684951 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2a8563e4-9ca7-4875-bf44-8a2508bb5c37 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:29.686210 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2a8563e4-9ca7-4875-bf44-8a2508bb5c37 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:29.686877 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2a8563e4-9ca7-4875-bf44-8a2508bb5c37 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:29.687350 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2a8563e4-9ca7-4875-bf44-8a2508bb5c37 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:29.829132 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-2a8563e4-9ca7-4875-bf44-8a2508bb5c37 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9068c0af1a7c48dab91c3ebf4ebd9148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf91d97eec8b46e2b1f07b6f39185030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:43:29.839911 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-2a8563e4-9ca7-4875-bf44-8a2508bb5c37 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] 10.222.0.60 "GET /compute/v2.1/servers/65452924-da4a-4684-98ae-e88507c85e34" status: 200 len: 1515 microversion: 2.1 time: 0.172087 Sep 14 09:43:29.840503 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3488/6812] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:43:29 2022] GET /compute/v2.1/servers/65452924-da4a-4684-98ae-e88507c85e34 => generated 1515 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:43:30.864202 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-205d8ef6-f9ef-48cf-873f-ef0602d167cc tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:43:30.864880 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-205d8ef6-f9ef-48cf-873f-ef0602d167cc tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] [instance: 65452924-da4a-4684-98ae-e88507c85e34] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:43:30.873375 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-205d8ef6-f9ef-48cf-873f-ef0602d167cc tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:30.873954 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-205d8ef6-f9ef-48cf-873f-ef0602d167cc tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:30.874404 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-205d8ef6-f9ef-48cf-873f-ef0602d167cc tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:30.875163 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-205d8ef6-f9ef-48cf-873f-ef0602d167cc tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:30.875623 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-205d8ef6-f9ef-48cf-873f-ef0602d167cc tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:30.876052 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-205d8ef6-f9ef-48cf-873f-ef0602d167cc tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:31.038389 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-205d8ef6-f9ef-48cf-873f-ef0602d167cc tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9068c0af1a7c48dab91c3ebf4ebd9148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf91d97eec8b46e2b1f07b6f39185030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:43:31.048476 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-205d8ef6-f9ef-48cf-873f-ef0602d167cc tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] 10.222.0.60 "GET /compute/v2.1/servers/65452924-da4a-4684-98ae-e88507c85e34" status: 200 len: 1515 microversion: 2.1 time: 0.188478 Sep 14 09:43:31.049351 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3489/6813] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:43:30 2022] GET /compute/v2.1/servers/65452924-da4a-4684-98ae-e88507c85e34 => generated 1515 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:43:32.072534 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-69459781-9758-4966-a0c5-0b9c45953e96 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:43:32.073144 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-69459781-9758-4966-a0c5-0b9c45953e96 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] [instance: 65452924-da4a-4684-98ae-e88507c85e34] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:43:32.079971 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-69459781-9758-4966-a0c5-0b9c45953e96 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:32.080465 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-69459781-9758-4966-a0c5-0b9c45953e96 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:32.080906 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-69459781-9758-4966-a0c5-0b9c45953e96 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:32.081597 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-69459781-9758-4966-a0c5-0b9c45953e96 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:32.082059 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-69459781-9758-4966-a0c5-0b9c45953e96 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:32.082491 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-69459781-9758-4966-a0c5-0b9c45953e96 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:32.210477 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-69459781-9758-4966-a0c5-0b9c45953e96 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9068c0af1a7c48dab91c3ebf4ebd9148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf91d97eec8b46e2b1f07b6f39185030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:43:32.218487 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-69459781-9758-4966-a0c5-0b9c45953e96 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] 10.222.0.60 "GET /compute/v2.1/servers/65452924-da4a-4684-98ae-e88507c85e34" status: 200 len: 1507 microversion: 2.1 time: 0.150038 Sep 14 09:43:32.219089 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3490/6814] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:43:32 2022] GET /compute/v2.1/servers/65452924-da4a-4684-98ae-e88507c85e34 => generated 1507 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:43:32.239923 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b6ddb5fe-20ac-498e-bf63-babef54b2e60 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:43:32.241062 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b6ddb5fe-20ac-498e-bf63-babef54b2e60 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] [instance: 65452924-da4a-4684-98ae-e88507c85e34] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:43:32.246843 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b6ddb5fe-20ac-498e-bf63-babef54b2e60 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:32.247429 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b6ddb5fe-20ac-498e-bf63-babef54b2e60 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:32.247867 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b6ddb5fe-20ac-498e-bf63-babef54b2e60 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:32.248556 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b6ddb5fe-20ac-498e-bf63-babef54b2e60 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:32.249010 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b6ddb5fe-20ac-498e-bf63-babef54b2e60 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:32.249434 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b6ddb5fe-20ac-498e-bf63-babef54b2e60 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:32.387315 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b6ddb5fe-20ac-498e-bf63-babef54b2e60 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9068c0af1a7c48dab91c3ebf4ebd9148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf91d97eec8b46e2b1f07b6f39185030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:43:32.395164 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b6ddb5fe-20ac-498e-bf63-babef54b2e60 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] 10.222.0.60 "GET /compute/v2.1/servers/65452924-da4a-4684-98ae-e88507c85e34" status: 200 len: 1507 microversion: 2.1 time: 0.158830 Sep 14 09:43:32.395728 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3491/6815] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:43:32 2022] GET /compute/v2.1/servers/65452924-da4a-4684-98ae-e88507c85e34 => generated 1507 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:43:32.420712 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-2baa54c6-7914-45bd-8f4b-24427eff14e1 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Action: 'create', calling method: .version_select at 0x7f7d3efc2700>, body: {"keypair": {"name": "tempest-keypair-394914941", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKAuFKwMXCIEnNV6GodzM0I/8OU9uKgjUaIu2sSwU8dhmT1696L7tz4YISrSBHRjfrYHZ0YtPJDH/J3YCUtRJYMalD1ehr6SKhmm8vwXAWKqujL6xYVhtC9JgZN5B40Eog=="}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:43:32.436347 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-2baa54c6-7914-45bd-8f4b-24427eff14e1 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Getting quotas for project bf91d97eec8b46e2b1f07b6f39185030. Resources: {'key_pairs'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:43:32.441533 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-2baa54c6-7914-45bd-8f4b-24427eff14e1 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Getting quotas for user 9068c0af1a7c48dab91c3ebf4ebd9148 and project bf91d97eec8b46e2b1f07b6f39185030. Resources: {'key_pairs'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:43:32.465990 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-2baa54c6-7914-45bd-8f4b-24427eff14e1 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.048939 Sep 14 09:43:32.466589 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3492/6816] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Sep 14 09:43:32 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:43:33.653352 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-3544e2b9-40c9-42f8-9154-ed086d281e3d req-a4d33de9-49d6-4c6a-b45c-06a21aa3153c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65452924-da4a-4684-98ae-e88507c85e34", "name": "network-vif-plugged", "status": "completed", "tag": "e81325e8-d3ef-49f2-9216-9e0d36f2a957"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:43:33.665374 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-3544e2b9-40c9-42f8-9154-ed086d281e3d req-a4d33de9-49d6-4c6a-b45c-06a21aa3153c service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:33.665945 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-3544e2b9-40c9-42f8-9154-ed086d281e3d req-a4d33de9-49d6-4c6a-b45c-06a21aa3153c service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:33.666658 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-3544e2b9-40c9-42f8-9154-ed086d281e3d req-a4d33de9-49d6-4c6a-b45c-06a21aa3153c service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:33.678788 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-3544e2b9-40c9-42f8-9154-ed086d281e3d req-a4d33de9-49d6-4c6a-b45c-06a21aa3153c service nova] Creating event network-vif-plugged:e81325e8-d3ef-49f2-9216-9e0d36f2a957 for instance 65452924-da4a-4684-98ae-e88507c85e34 on n-h2-836830-18 Sep 14 09:43:33.684082 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-3544e2b9-40c9-42f8-9154-ed086d281e3d req-a4d33de9-49d6-4c6a-b45c-06a21aa3153c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036435 Sep 14 09:43:33.684812 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3493/6817] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:43:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:43:33.962618 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f1a16403-cdd7-4b32-9e21-99d6f860e0e6 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:43:33.963462 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f1a16403-cdd7-4b32-9e21-99d6f860e0e6 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] [instance: 65452924-da4a-4684-98ae-e88507c85e34] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:43:33.969886 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f1a16403-cdd7-4b32-9e21-99d6f860e0e6 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:33.970375 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f1a16403-cdd7-4b32-9e21-99d6f860e0e6 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:33.970821 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f1a16403-cdd7-4b32-9e21-99d6f860e0e6 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:33.971545 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f1a16403-cdd7-4b32-9e21-99d6f860e0e6 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:33.972003 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f1a16403-cdd7-4b32-9e21-99d6f860e0e6 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:33.972436 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f1a16403-cdd7-4b32-9e21-99d6f860e0e6 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:34.104170 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f1a16403-cdd7-4b32-9e21-99d6f860e0e6 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9068c0af1a7c48dab91c3ebf4ebd9148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf91d97eec8b46e2b1f07b6f39185030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:43:34.111982 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f1a16403-cdd7-4b32-9e21-99d6f860e0e6 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] 10.222.0.60 "GET /compute/v2.1/servers/65452924-da4a-4684-98ae-e88507c85e34" status: 200 len: 1507 microversion: 2.1 time: 0.153688 Sep 14 09:43:34.112566 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3494/6818] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:43:33 2022] GET /compute/v2.1/servers/65452924-da4a-4684-98ae-e88507c85e34 => generated 1507 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:43:34.134634 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9863ac36-fe83-49c7-a8e8-960657eb9beb tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:43:34.135182 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-9863ac36-fe83-49c7-a8e8-960657eb9beb tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] [instance: 65452924-da4a-4684-98ae-e88507c85e34] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:43:34.141068 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9863ac36-fe83-49c7-a8e8-960657eb9beb tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:34.141553 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9863ac36-fe83-49c7-a8e8-960657eb9beb tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:34.141999 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9863ac36-fe83-49c7-a8e8-960657eb9beb tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:34.142694 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9863ac36-fe83-49c7-a8e8-960657eb9beb tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:34.143187 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9863ac36-fe83-49c7-a8e8-960657eb9beb tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:34.143625 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9863ac36-fe83-49c7-a8e8-960657eb9beb tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:34.168998 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-9863ac36-fe83-49c7-a8e8-960657eb9beb tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] [instance: 65452924-da4a-4684-98ae-e88507c85e34] Going to try to terminate instance {{(pid=128759) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:43:34.246354 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-9863ac36-fe83-49c7-a8e8-960657eb9beb tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] 10.222.0.60 "DELETE /compute/v2.1/servers/65452924-da4a-4684-98ae-e88507c85e34" status: 204 len: 0 microversion: 2.1 time: 0.114638 Sep 14 09:43:34.247414 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3495/6819] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:43:34 2022] DELETE /compute/v2.1/servers/65452924-da4a-4684-98ae-e88507c85e34 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 14 09:43:34.304614 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-68e3ea6e-0ced-4d75-a2fc-c2e3fa78e8de tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-836109845", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "networks": [{"uuid": "bd848ee4-19bd-4063-8712-106fd8999059"}]}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:43:34.358038 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.network.neutron [None req-68e3ea6e-0ced-4d75-a2fc-c2e3fa78e8de tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] validate_networks() for [('bd848ee4-19bd-4063-8712-106fd8999059', None, None, None, None, None)] {{(pid=128759) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:43:34.729573 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-68e3ea6e-0ced-4d75-a2fc-c2e3fa78e8de tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Flavor limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:43:34.730192 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-68e3ea6e-0ced-4d75-a2fc-c2e3fa78e8de tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Image limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:43:34.730516 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-68e3ea6e-0ced-4d75-a2fc-c2e3fa78e8de tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Flavor pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:43:34.730954 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-68e3ea6e-0ced-4d75-a2fc-c2e3fa78e8de tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Image pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:43:34.731393 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-68e3ea6e-0ced-4d75-a2fc-c2e3fa78e8de tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:43:34.740792 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-68e3ea6e-0ced-4d75-a2fc-c2e3fa78e8de tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:34.741288 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-68e3ea6e-0ced-4d75-a2fc-c2e3fa78e8de tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:34.741729 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-68e3ea6e-0ced-4d75-a2fc-c2e3fa78e8de tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:34.742465 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-68e3ea6e-0ced-4d75-a2fc-c2e3fa78e8de tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:34.742928 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-68e3ea6e-0ced-4d75-a2fc-c2e3fa78e8de tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:34.743381 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-68e3ea6e-0ced-4d75-a2fc-c2e3fa78e8de tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:34.760239 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-68e3ea6e-0ced-4d75-a2fc-c2e3fa78e8de tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Getting quotas for project bf91d97eec8b46e2b1f07b6f39185030. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:43:34.765544 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-68e3ea6e-0ced-4d75-a2fc-c2e3fa78e8de tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Getting quotas for user 9068c0af1a7c48dab91c3ebf4ebd9148 and project bf91d97eec8b46e2b1f07b6f39185030. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:43:34.778193 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-68e3ea6e-0ced-4d75-a2fc-c2e3fa78e8de tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Going to run 1 instances... {{(pid=128759) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:43:34.780628 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-68e3ea6e-0ced-4d75-a2fc-c2e3fa78e8de tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] [instance: caf55729-5b90-40c7-8cf8-e14820b20573] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128759) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:43:34.829569 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-68e3ea6e-0ced-4d75-a2fc-c2e3fa78e8de tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.529245 Sep 14 09:43:34.830186 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3496/6820] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 09:43:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 531 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 14 09:43:34.842830 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9b599716-f17b-469b-a334-4cf6add448b3 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:43:34.843494 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-9b599716-f17b-469b-a334-4cf6add448b3 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] [instance: caf55729-5b90-40c7-8cf8-e14820b20573] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:43:34.899580 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-9b599716-f17b-469b-a334-4cf6add448b3 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9068c0af1a7c48dab91c3ebf4ebd9148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf91d97eec8b46e2b1f07b6f39185030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:43:34.906892 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-9b599716-f17b-469b-a334-4cf6add448b3 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] 10.222.0.60 "GET /compute/v2.1/servers/caf55729-5b90-40c7-8cf8-e14820b20573" status: 200 len: 1217 microversion: 2.1 time: 0.068455 Sep 14 09:43:34.907500 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3497/6821] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:43:34 2022] GET /compute/v2.1/servers/caf55729-5b90-40c7-8cf8-e14820b20573 => generated 1217 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:43:35.930467 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a4f7721d-e555-49f6-81ab-db46cdbd2bbb tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:43:35.931122 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-a4f7721d-e555-49f6-81ab-db46cdbd2bbb tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] [instance: caf55729-5b90-40c7-8cf8-e14820b20573] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:43:35.933960 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:43:35.939654 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a4f7721d-e555-49f6-81ab-db46cdbd2bbb tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:35.940088 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a4f7721d-e555-49f6-81ab-db46cdbd2bbb tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:35.940547 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a4f7721d-e555-49f6-81ab-db46cdbd2bbb tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:35.941256 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a4f7721d-e555-49f6-81ab-db46cdbd2bbb tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:35.941725 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a4f7721d-e555-49f6-81ab-db46cdbd2bbb tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:35.942162 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a4f7721d-e555-49f6-81ab-db46cdbd2bbb tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:36.013085 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-a4f7721d-e555-49f6-81ab-db46cdbd2bbb tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9068c0af1a7c48dab91c3ebf4ebd9148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf91d97eec8b46e2b1f07b6f39185030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:43:36.021209 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a4f7721d-e555-49f6-81ab-db46cdbd2bbb tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] 10.222.0.60 "GET /compute/v2.1/servers/caf55729-5b90-40c7-8cf8-e14820b20573" status: 200 len: 1269 microversion: 2.1 time: 0.095266 Sep 14 09:43:36.022585 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3498/6822] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:43:35 2022] GET /compute/v2.1/servers/caf55729-5b90-40c7-8cf8-e14820b20573 => generated 1269 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:43:36.250295 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-d94da886-f109-4d23-951b-50932f7db845 req-c52e6c76-0cc9-42b0-b908-fe4415957548 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65452924-da4a-4684-98ae-e88507c85e34", "name": "network-vif-deleted", "tag": "e81325e8-d3ef-49f2-9216-9e0d36f2a957"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:43:36.267247 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-d94da886-f109-4d23-951b-50932f7db845 req-c52e6c76-0cc9-42b0-b908-fe4415957548 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:36.267746 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-d94da886-f109-4d23-951b-50932f7db845 req-c52e6c76-0cc9-42b0-b908-fe4415957548 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:36.268182 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-d94da886-f109-4d23-951b-50932f7db845 req-c52e6c76-0cc9-42b0-b908-fe4415957548 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:36.281312 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:43:36.290129 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-d94da886-f109-4d23-951b-50932f7db845 req-c52e6c76-0cc9-42b0-b908-fe4415957548 service nova] Creating event network-vif-deleted:e81325e8-d3ef-49f2-9216-9e0d36f2a957 for instance 65452924-da4a-4684-98ae-e88507c85e34 on n-h2-836830-18 Sep 14 09:43:36.302299 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-d94da886-f109-4d23-951b-50932f7db845 req-c52e6c76-0cc9-42b0-b908-fe4415957548 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056170 Sep 14 09:43:36.304199 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3499/6823] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:43:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:43:37.046449 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-cb3cb4d1-d25f-4ee9-b95c-2829df80ea9c tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:43:37.047200 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-cb3cb4d1-d25f-4ee9-b95c-2829df80ea9c tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] [instance: caf55729-5b90-40c7-8cf8-e14820b20573] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:43:37.060403 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cb3cb4d1-d25f-4ee9-b95c-2829df80ea9c tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:37.061088 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cb3cb4d1-d25f-4ee9-b95c-2829df80ea9c tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:37.061637 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cb3cb4d1-d25f-4ee9-b95c-2829df80ea9c tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:37.062523 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cb3cb4d1-d25f-4ee9-b95c-2829df80ea9c tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:37.063257 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cb3cb4d1-d25f-4ee9-b95c-2829df80ea9c tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:37.063937 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cb3cb4d1-d25f-4ee9-b95c-2829df80ea9c tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:37.196873 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-cb3cb4d1-d25f-4ee9-b95c-2829df80ea9c tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9068c0af1a7c48dab91c3ebf4ebd9148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf91d97eec8b46e2b1f07b6f39185030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:43:37.205258 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-cb3cb4d1-d25f-4ee9-b95c-2829df80ea9c tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] 10.222.0.60 "GET /compute/v2.1/servers/caf55729-5b90-40c7-8cf8-e14820b20573" status: 200 len: 1317 microversion: 2.1 time: 0.163834 Sep 14 09:43:37.205923 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3500/6824] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:43:37 2022] GET /compute/v2.1/servers/caf55729-5b90-40c7-8cf8-e14820b20573 => generated 1317 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:43:38.229999 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-1bebd614-962e-4db3-929e-ec7f39eeca47 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:43:38.230624 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-1bebd614-962e-4db3-929e-ec7f39eeca47 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] [instance: caf55729-5b90-40c7-8cf8-e14820b20573] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:43:38.237501 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1bebd614-962e-4db3-929e-ec7f39eeca47 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:38.237994 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1bebd614-962e-4db3-929e-ec7f39eeca47 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:38.238438 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1bebd614-962e-4db3-929e-ec7f39eeca47 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:38.239168 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1bebd614-962e-4db3-929e-ec7f39eeca47 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:38.239633 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1bebd614-962e-4db3-929e-ec7f39eeca47 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:38.240091 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1bebd614-962e-4db3-929e-ec7f39eeca47 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:38.372333 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-1bebd614-962e-4db3-929e-ec7f39eeca47 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9068c0af1a7c48dab91c3ebf4ebd9148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf91d97eec8b46e2b1f07b6f39185030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:43:38.380242 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-1bebd614-962e-4db3-929e-ec7f39eeca47 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] 10.222.0.60 "GET /compute/v2.1/servers/caf55729-5b90-40c7-8cf8-e14820b20573" status: 200 len: 1317 microversion: 2.1 time: 0.154376 Sep 14 09:43:38.380816 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3501/6825] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:43:38 2022] GET /compute/v2.1/servers/caf55729-5b90-40c7-8cf8-e14820b20573 => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:43:38.385909 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-8f9a185c-a3dd-477c-bde0-dfe59d09a6b8 req-6d5e21a9-7991-43b7-a9a5-5c39154a454b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "caf55729-5b90-40c7-8cf8-e14820b20573", "tag": "18ed8d86-6464-43d6-b7f1-eae0025337a5"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:43:38.395169 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-8f9a185c-a3dd-477c-bde0-dfe59d09a6b8 req-6d5e21a9-7991-43b7-a9a5-5c39154a454b service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:38.395661 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-8f9a185c-a3dd-477c-bde0-dfe59d09a6b8 req-6d5e21a9-7991-43b7-a9a5-5c39154a454b service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:38.396100 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-8f9a185c-a3dd-477c-bde0-dfe59d09a6b8 req-6d5e21a9-7991-43b7-a9a5-5c39154a454b service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:38.410081 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-8f9a185c-a3dd-477c-bde0-dfe59d09a6b8 req-6d5e21a9-7991-43b7-a9a5-5c39154a454b service nova] Creating event network-changed:18ed8d86-6464-43d6-b7f1-eae0025337a5 for instance caf55729-5b90-40c7-8cf8-e14820b20573 on n-h2-836830-18 Sep 14 09:43:38.415725 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-8f9a185c-a3dd-477c-bde0-dfe59d09a6b8 req-6d5e21a9-7991-43b7-a9a5-5c39154a454b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033189 Sep 14 09:43:38.416308 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3502/6826] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:43:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:43:39.404406 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-720c0a0d-32c2-4a60-84c1-1843faa170bc tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:43:39.405138 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-720c0a0d-32c2-4a60-84c1-1843faa170bc tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] [instance: caf55729-5b90-40c7-8cf8-e14820b20573] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:43:39.411362 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-720c0a0d-32c2-4a60-84c1-1843faa170bc tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:39.411842 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-720c0a0d-32c2-4a60-84c1-1843faa170bc tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:39.412278 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-720c0a0d-32c2-4a60-84c1-1843faa170bc tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:39.412958 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-720c0a0d-32c2-4a60-84c1-1843faa170bc tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:39.413412 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-720c0a0d-32c2-4a60-84c1-1843faa170bc tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:39.413830 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-720c0a0d-32c2-4a60-84c1-1843faa170bc tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:39.543199 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-720c0a0d-32c2-4a60-84c1-1843faa170bc tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9068c0af1a7c48dab91c3ebf4ebd9148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf91d97eec8b46e2b1f07b6f39185030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:43:39.550841 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-720c0a0d-32c2-4a60-84c1-1843faa170bc tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] 10.222.0.60 "GET /compute/v2.1/servers/caf55729-5b90-40c7-8cf8-e14820b20573" status: 200 len: 1317 microversion: 2.1 time: 0.151663 Sep 14 09:43:39.551495 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3503/6827] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:43:39 2022] GET /compute/v2.1/servers/caf55729-5b90-40c7-8cf8-e14820b20573 => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:43:40.574025 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c64ea769-9be1-4cd0-a40a-38d67083ee75 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:43:40.574490 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-c64ea769-9be1-4cd0-a40a-38d67083ee75 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] [instance: caf55729-5b90-40c7-8cf8-e14820b20573] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:43:40.581401 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c64ea769-9be1-4cd0-a40a-38d67083ee75 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:40.581898 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c64ea769-9be1-4cd0-a40a-38d67083ee75 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:40.582350 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c64ea769-9be1-4cd0-a40a-38d67083ee75 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:40.583081 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c64ea769-9be1-4cd0-a40a-38d67083ee75 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:40.583546 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c64ea769-9be1-4cd0-a40a-38d67083ee75 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:40.583982 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c64ea769-9be1-4cd0-a40a-38d67083ee75 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:40.721841 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-c64ea769-9be1-4cd0-a40a-38d67083ee75 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9068c0af1a7c48dab91c3ebf4ebd9148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf91d97eec8b46e2b1f07b6f39185030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:43:40.730286 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-c64ea769-9be1-4cd0-a40a-38d67083ee75 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] 10.222.0.60 "GET /compute/v2.1/servers/caf55729-5b90-40c7-8cf8-e14820b20573" status: 200 len: 1317 microversion: 2.1 time: 0.160578 Sep 14 09:43:40.730869 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3504/6828] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:43:40 2022] GET /compute/v2.1/servers/caf55729-5b90-40c7-8cf8-e14820b20573 => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:43:41.753103 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ee425c8c-324e-4aa4-bd01-7393d026b36d tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:43:41.753815 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-ee425c8c-324e-4aa4-bd01-7393d026b36d tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] [instance: caf55729-5b90-40c7-8cf8-e14820b20573] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:43:41.761328 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ee425c8c-324e-4aa4-bd01-7393d026b36d tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:41.761824 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ee425c8c-324e-4aa4-bd01-7393d026b36d tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:41.762272 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ee425c8c-324e-4aa4-bd01-7393d026b36d tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:41.763005 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ee425c8c-324e-4aa4-bd01-7393d026b36d tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:41.763478 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ee425c8c-324e-4aa4-bd01-7393d026b36d tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:41.763916 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ee425c8c-324e-4aa4-bd01-7393d026b36d tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:41.900033 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-ee425c8c-324e-4aa4-bd01-7393d026b36d tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9068c0af1a7c48dab91c3ebf4ebd9148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf91d97eec8b46e2b1f07b6f39185030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:43:41.908121 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-ee425c8c-324e-4aa4-bd01-7393d026b36d tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] 10.222.0.60 "GET /compute/v2.1/servers/caf55729-5b90-40c7-8cf8-e14820b20573" status: 200 len: 1317 microversion: 2.1 time: 0.158948 Sep 14 09:43:41.908707 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3505/6829] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:43:41 2022] GET /compute/v2.1/servers/caf55729-5b90-40c7-8cf8-e14820b20573 => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:43:42.931132 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-89fe234d-7818-457e-bef7-24ae094b161f tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:43:42.931805 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-89fe234d-7818-457e-bef7-24ae094b161f tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] [instance: caf55729-5b90-40c7-8cf8-e14820b20573] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:43:42.938735 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-89fe234d-7818-457e-bef7-24ae094b161f tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:42.939269 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-89fe234d-7818-457e-bef7-24ae094b161f tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:42.939751 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-89fe234d-7818-457e-bef7-24ae094b161f tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:42.940490 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-89fe234d-7818-457e-bef7-24ae094b161f tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:42.940953 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-89fe234d-7818-457e-bef7-24ae094b161f tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:42.941387 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-89fe234d-7818-457e-bef7-24ae094b161f tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:43.073131 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-89fe234d-7818-457e-bef7-24ae094b161f tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9068c0af1a7c48dab91c3ebf4ebd9148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf91d97eec8b46e2b1f07b6f39185030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:43:43.081035 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-89fe234d-7818-457e-bef7-24ae094b161f tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] 10.222.0.60 "GET /compute/v2.1/servers/caf55729-5b90-40c7-8cf8-e14820b20573" status: 200 len: 1317 microversion: 2.1 time: 0.153954 Sep 14 09:43:43.081619 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3506/6830] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:43:42 2022] GET /compute/v2.1/servers/caf55729-5b90-40c7-8cf8-e14820b20573 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:43:43.682400 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-871443e8-9043-4bec-b36f-b39443b55bd5 req-b41944fb-ede4-42f0-95f0-f0d8fed1ae86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "caf55729-5b90-40c7-8cf8-e14820b20573", "name": "network-vif-plugged", "status": "completed", "tag": "18ed8d86-6464-43d6-b7f1-eae0025337a5"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:43:43.692857 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-871443e8-9043-4bec-b36f-b39443b55bd5 req-b41944fb-ede4-42f0-95f0-f0d8fed1ae86 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:43.693435 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-871443e8-9043-4bec-b36f-b39443b55bd5 req-b41944fb-ede4-42f0-95f0-f0d8fed1ae86 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:43.693875 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-871443e8-9043-4bec-b36f-b39443b55bd5 req-b41944fb-ede4-42f0-95f0-f0d8fed1ae86 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:43.705863 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-871443e8-9043-4bec-b36f-b39443b55bd5 req-b41944fb-ede4-42f0-95f0-f0d8fed1ae86 service nova] Creating event network-vif-plugged:18ed8d86-6464-43d6-b7f1-eae0025337a5 for instance caf55729-5b90-40c7-8cf8-e14820b20573 on n-h2-836830-18 Sep 14 09:43:43.711651 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-871443e8-9043-4bec-b36f-b39443b55bd5 req-b41944fb-ede4-42f0-95f0-f0d8fed1ae86 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033477 Sep 14 09:43:43.712830 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3507/6831] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:43:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:43:44.106530 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-4cf7af20-9bd4-4249-881e-818e1d5d71fb tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:43:44.107271 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-4cf7af20-9bd4-4249-881e-818e1d5d71fb tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] [instance: caf55729-5b90-40c7-8cf8-e14820b20573] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:43:44.113551 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4cf7af20-9bd4-4249-881e-818e1d5d71fb tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:44.114039 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4cf7af20-9bd4-4249-881e-818e1d5d71fb tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:44.114473 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4cf7af20-9bd4-4249-881e-818e1d5d71fb tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:44.115193 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4cf7af20-9bd4-4249-881e-818e1d5d71fb tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:44.115647 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4cf7af20-9bd4-4249-881e-818e1d5d71fb tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:44.116074 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4cf7af20-9bd4-4249-881e-818e1d5d71fb tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:44.245682 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-4cf7af20-9bd4-4249-881e-818e1d5d71fb tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9068c0af1a7c48dab91c3ebf4ebd9148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf91d97eec8b46e2b1f07b6f39185030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:43:44.253472 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-4cf7af20-9bd4-4249-881e-818e1d5d71fb tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] 10.222.0.60 "GET /compute/v2.1/servers/caf55729-5b90-40c7-8cf8-e14820b20573" status: 200 len: 1317 microversion: 2.1 time: 0.152550 Sep 14 09:43:44.254058 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3508/6832] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:43:44 2022] GET /compute/v2.1/servers/caf55729-5b90-40c7-8cf8-e14820b20573 => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:43:45.276536 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b8a503ee-281a-4edb-afb4-f03a2e78c968 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:43:45.277158 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b8a503ee-281a-4edb-afb4-f03a2e78c968 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] [instance: caf55729-5b90-40c7-8cf8-e14820b20573] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:43:45.279156 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=2 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:43:45.279865 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=12 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:43:45.286966 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b8a503ee-281a-4edb-afb4-f03a2e78c968 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:45.287465 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b8a503ee-281a-4edb-afb4-f03a2e78c968 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:45.287910 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b8a503ee-281a-4edb-afb4-f03a2e78c968 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:45.288617 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b8a503ee-281a-4edb-afb4-f03a2e78c968 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:45.289073 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b8a503ee-281a-4edb-afb4-f03a2e78c968 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:45.289502 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b8a503ee-281a-4edb-afb4-f03a2e78c968 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:45.426754 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b8a503ee-281a-4edb-afb4-f03a2e78c968 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9068c0af1a7c48dab91c3ebf4ebd9148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf91d97eec8b46e2b1f07b6f39185030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:43:45.435193 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b8a503ee-281a-4edb-afb4-f03a2e78c968 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] 10.222.0.60 "GET /compute/v2.1/servers/caf55729-5b90-40c7-8cf8-e14820b20573" status: 200 len: 1507 microversion: 2.1 time: 0.162541 Sep 14 09:43:45.435792 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3509/6833] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:43:45 2022] GET /compute/v2.1/servers/caf55729-5b90-40c7-8cf8-e14820b20573 => generated 1507 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:43:45.458273 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-2d2e873f-be14-4587-adfd-d067f5d90095 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:43:45.458960 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-2d2e873f-be14-4587-adfd-d067f5d90095 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] [instance: caf55729-5b90-40c7-8cf8-e14820b20573] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:43:45.465032 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2d2e873f-be14-4587-adfd-d067f5d90095 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:45.465529 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2d2e873f-be14-4587-adfd-d067f5d90095 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:45.465978 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2d2e873f-be14-4587-adfd-d067f5d90095 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:45.466680 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2d2e873f-be14-4587-adfd-d067f5d90095 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:45.467178 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2d2e873f-be14-4587-adfd-d067f5d90095 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:45.467620 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2d2e873f-be14-4587-adfd-d067f5d90095 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:45.607194 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-2d2e873f-be14-4587-adfd-d067f5d90095 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9068c0af1a7c48dab91c3ebf4ebd9148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf91d97eec8b46e2b1f07b6f39185030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:43:45.615400 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-2d2e873f-be14-4587-adfd-d067f5d90095 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] 10.222.0.60 "GET /compute/v2.1/servers/caf55729-5b90-40c7-8cf8-e14820b20573" status: 200 len: 1507 microversion: 2.1 time: 0.160653 Sep 14 09:43:45.615878 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3510/6834] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:43:45 2022] GET /compute/v2.1/servers/caf55729-5b90-40c7-8cf8-e14820b20573 => generated 1507 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:43:45.637869 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-fe10e217-b8ed-4915-8931-130ffad6570b tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:43:45.640231 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-fe10e217-b8ed-4915-8931-130ffad6570b tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] [instance: caf55729-5b90-40c7-8cf8-e14820b20573] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:43:45.646190 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fe10e217-b8ed-4915-8931-130ffad6570b tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:45.646675 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fe10e217-b8ed-4915-8931-130ffad6570b tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:45.647151 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fe10e217-b8ed-4915-8931-130ffad6570b tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:45.647856 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fe10e217-b8ed-4915-8931-130ffad6570b tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:45.648314 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fe10e217-b8ed-4915-8931-130ffad6570b tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:45.648744 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fe10e217-b8ed-4915-8931-130ffad6570b tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:45.678043 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-fe10e217-b8ed-4915-8931-130ffad6570b tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '9068c0af1a7c48dab91c3ebf4ebd9148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf91d97eec8b46e2b1f07b6f39185030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:43:45.684070 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-fe10e217-b8ed-4915-8931-130ffad6570b tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] [instance: caf55729-5b90-40c7-8cf8-e14820b20573] Old instance type m1.heat2, new instance type m1.heat {{(pid=128759) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 14 09:43:45.691112 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-fe10e217-b8ed-4915-8931-130ffad6570b tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Flavor limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:43:45.691544 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-fe10e217-b8ed-4915-8931-130ffad6570b tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Image limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:43:45.692028 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-fe10e217-b8ed-4915-8931-130ffad6570b tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Flavor pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:43:45.692442 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-fe10e217-b8ed-4915-8931-130ffad6570b tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Image pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:43:45.692862 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-fe10e217-b8ed-4915-8931-130ffad6570b tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:43:45.765587 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-fe10e217-b8ed-4915-8931-130ffad6570b tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] 10.222.0.60 "POST /compute/v2.1/servers/caf55729-5b90-40c7-8cf8-e14820b20573/action" status: 202 len: 0 microversion: 2.1 time: 0.131499 Sep 14 09:43:45.766252 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3511/6835] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:43:45 2022] POST /compute/v2.1/servers/caf55729-5b90-40c7-8cf8-e14820b20573/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 14 09:43:45.775653 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-84a68f98-2830-4f47-b43a-5db1cda9ff27 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:43:45.776284 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-84a68f98-2830-4f47-b43a-5db1cda9ff27 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] [instance: caf55729-5b90-40c7-8cf8-e14820b20573] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:43:45.783019 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-84a68f98-2830-4f47-b43a-5db1cda9ff27 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:45.783624 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-84a68f98-2830-4f47-b43a-5db1cda9ff27 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:45.783971 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-84a68f98-2830-4f47-b43a-5db1cda9ff27 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:45.784727 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-84a68f98-2830-4f47-b43a-5db1cda9ff27 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:45.785155 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-84a68f98-2830-4f47-b43a-5db1cda9ff27 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:45.785591 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-84a68f98-2830-4f47-b43a-5db1cda9ff27 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:45.925956 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-84a68f98-2830-4f47-b43a-5db1cda9ff27 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9068c0af1a7c48dab91c3ebf4ebd9148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf91d97eec8b46e2b1f07b6f39185030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:43:45.934070 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-84a68f98-2830-4f47-b43a-5db1cda9ff27 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] 10.222.0.60 "GET /compute/v2.1/servers/caf55729-5b90-40c7-8cf8-e14820b20573" status: 200 len: 1514 microversion: 2.1 time: 0.163327 Sep 14 09:43:45.939048 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3512/6836] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:43:45 2022] GET /compute/v2.1/servers/caf55729-5b90-40c7-8cf8-e14820b20573 => generated 1514 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:43:46.958363 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-18393ad0-1b9b-4731-ba4b-c005280d06b0 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:43:46.959093 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-18393ad0-1b9b-4731-ba4b-c005280d06b0 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] [instance: caf55729-5b90-40c7-8cf8-e14820b20573] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:43:46.966555 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-18393ad0-1b9b-4731-ba4b-c005280d06b0 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:46.967151 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-18393ad0-1b9b-4731-ba4b-c005280d06b0 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:46.967601 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-18393ad0-1b9b-4731-ba4b-c005280d06b0 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:46.968302 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-18393ad0-1b9b-4731-ba4b-c005280d06b0 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:46.968762 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-18393ad0-1b9b-4731-ba4b-c005280d06b0 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:46.969194 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-18393ad0-1b9b-4731-ba4b-c005280d06b0 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:47.118622 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-18393ad0-1b9b-4731-ba4b-c005280d06b0 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9068c0af1a7c48dab91c3ebf4ebd9148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf91d97eec8b46e2b1f07b6f39185030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:43:47.126671 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-18393ad0-1b9b-4731-ba4b-c005280d06b0 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] 10.222.0.60 "GET /compute/v2.1/servers/caf55729-5b90-40c7-8cf8-e14820b20573" status: 200 len: 1514 microversion: 2.1 time: 0.172503 Sep 14 09:43:47.127294 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3513/6837] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:43:46 2022] GET /compute/v2.1/servers/caf55729-5b90-40c7-8cf8-e14820b20573 => generated 1514 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:43:48.150035 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-04013210-1dff-42b5-a8e1-7c125049b7e0 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:43:48.150665 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-04013210-1dff-42b5-a8e1-7c125049b7e0 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] [instance: caf55729-5b90-40c7-8cf8-e14820b20573] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:43:48.157725 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-04013210-1dff-42b5-a8e1-7c125049b7e0 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:48.158258 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-04013210-1dff-42b5-a8e1-7c125049b7e0 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:48.158701 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-04013210-1dff-42b5-a8e1-7c125049b7e0 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:48.159462 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-04013210-1dff-42b5-a8e1-7c125049b7e0 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:48.159933 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-04013210-1dff-42b5-a8e1-7c125049b7e0 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:48.160362 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-04013210-1dff-42b5-a8e1-7c125049b7e0 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:48.297957 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-04013210-1dff-42b5-a8e1-7c125049b7e0 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9068c0af1a7c48dab91c3ebf4ebd9148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf91d97eec8b46e2b1f07b6f39185030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:43:48.305765 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-04013210-1dff-42b5-a8e1-7c125049b7e0 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] 10.222.0.60 "GET /compute/v2.1/servers/caf55729-5b90-40c7-8cf8-e14820b20573" status: 200 len: 1519 microversion: 2.1 time: 0.159884 Sep 14 09:43:48.306346 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3514/6838] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:43:48 2022] GET /compute/v2.1/servers/caf55729-5b90-40c7-8cf8-e14820b20573 => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:43:49.329495 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-1ff62c04-f1f1-414f-bcb8-f5ace3528b4b tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:43:49.330131 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-1ff62c04-f1f1-414f-bcb8-f5ace3528b4b tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] [instance: caf55729-5b90-40c7-8cf8-e14820b20573] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:43:49.337649 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1ff62c04-f1f1-414f-bcb8-f5ace3528b4b tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:49.338142 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1ff62c04-f1f1-414f-bcb8-f5ace3528b4b tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:49.338588 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1ff62c04-f1f1-414f-bcb8-f5ace3528b4b tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:49.339601 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1ff62c04-f1f1-414f-bcb8-f5ace3528b4b tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:49.340067 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1ff62c04-f1f1-414f-bcb8-f5ace3528b4b tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:49.340501 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1ff62c04-f1f1-414f-bcb8-f5ace3528b4b tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:49.472471 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-1ff62c04-f1f1-414f-bcb8-f5ace3528b4b tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9068c0af1a7c48dab91c3ebf4ebd9148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf91d97eec8b46e2b1f07b6f39185030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:43:49.480757 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-1ff62c04-f1f1-414f-bcb8-f5ace3528b4b tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] 10.222.0.60 "GET /compute/v2.1/servers/caf55729-5b90-40c7-8cf8-e14820b20573" status: 200 len: 1519 microversion: 2.1 time: 0.155370 Sep 14 09:43:49.481338 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3515/6839] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:43:49 2022] GET /compute/v2.1/servers/caf55729-5b90-40c7-8cf8-e14820b20573 => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:43:50.505154 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-7ae773ba-766a-45d6-8693-d7f963df5be7 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:43:50.505796 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-7ae773ba-766a-45d6-8693-d7f963df5be7 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] [instance: caf55729-5b90-40c7-8cf8-e14820b20573] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:43:50.513266 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7ae773ba-766a-45d6-8693-d7f963df5be7 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:50.513752 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7ae773ba-766a-45d6-8693-d7f963df5be7 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:50.514190 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7ae773ba-766a-45d6-8693-d7f963df5be7 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:50.514887 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7ae773ba-766a-45d6-8693-d7f963df5be7 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:50.515363 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7ae773ba-766a-45d6-8693-d7f963df5be7 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:50.515783 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7ae773ba-766a-45d6-8693-d7f963df5be7 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:50.530403 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:43:50.651601 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-7ae773ba-766a-45d6-8693-d7f963df5be7 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9068c0af1a7c48dab91c3ebf4ebd9148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf91d97eec8b46e2b1f07b6f39185030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:43:50.660232 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-7ae773ba-766a-45d6-8693-d7f963df5be7 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] 10.222.0.60 "GET /compute/v2.1/servers/caf55729-5b90-40c7-8cf8-e14820b20573" status: 200 len: 1519 microversion: 2.1 time: 0.159067 Sep 14 09:43:50.660808 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3516/6840] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:43:50 2022] GET /compute/v2.1/servers/caf55729-5b90-40c7-8cf8-e14820b20573 => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:43:51.683624 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-2317193d-e691-429f-a72f-0681657d3311 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:43:51.684240 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-2317193d-e691-429f-a72f-0681657d3311 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] [instance: caf55729-5b90-40c7-8cf8-e14820b20573] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:43:51.691191 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2317193d-e691-429f-a72f-0681657d3311 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:51.691686 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2317193d-e691-429f-a72f-0681657d3311 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:51.692136 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2317193d-e691-429f-a72f-0681657d3311 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:51.692839 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2317193d-e691-429f-a72f-0681657d3311 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:51.693305 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2317193d-e691-429f-a72f-0681657d3311 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:51.693741 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2317193d-e691-429f-a72f-0681657d3311 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:51.822078 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-2317193d-e691-429f-a72f-0681657d3311 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9068c0af1a7c48dab91c3ebf4ebd9148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf91d97eec8b46e2b1f07b6f39185030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:43:51.829907 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-2317193d-e691-429f-a72f-0681657d3311 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] 10.222.0.60 "GET /compute/v2.1/servers/caf55729-5b90-40c7-8cf8-e14820b20573" status: 200 len: 1519 microversion: 2.1 time: 0.150250 Sep 14 09:43:51.830431 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3517/6841] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:43:51 2022] GET /compute/v2.1/servers/caf55729-5b90-40c7-8cf8-e14820b20573 => generated 1519 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:43:52.853847 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-76924095-e0ee-41fd-8c7e-2a992ea80520 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:43:52.854467 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-76924095-e0ee-41fd-8c7e-2a992ea80520 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] [instance: caf55729-5b90-40c7-8cf8-e14820b20573] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:43:52.861521 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-76924095-e0ee-41fd-8c7e-2a992ea80520 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:52.862019 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-76924095-e0ee-41fd-8c7e-2a992ea80520 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:52.862463 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-76924095-e0ee-41fd-8c7e-2a992ea80520 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:52.863198 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-76924095-e0ee-41fd-8c7e-2a992ea80520 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:52.863663 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-76924095-e0ee-41fd-8c7e-2a992ea80520 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:52.864097 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-76924095-e0ee-41fd-8c7e-2a992ea80520 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:53.213104 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-76924095-e0ee-41fd-8c7e-2a992ea80520 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9068c0af1a7c48dab91c3ebf4ebd9148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf91d97eec8b46e2b1f07b6f39185030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:43:53.221141 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-76924095-e0ee-41fd-8c7e-2a992ea80520 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] 10.222.0.60 "GET /compute/v2.1/servers/caf55729-5b90-40c7-8cf8-e14820b20573" status: 200 len: 1519 microversion: 2.1 time: 0.371348 Sep 14 09:43:53.221727 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3518/6842] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:43:52 2022] GET /compute/v2.1/servers/caf55729-5b90-40c7-8cf8-e14820b20573 => generated 1519 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:43:54.244847 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-133b61a4-1763-4d98-b32e-ec60e5a2e833 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:43:54.245471 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-133b61a4-1763-4d98-b32e-ec60e5a2e833 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] [instance: caf55729-5b90-40c7-8cf8-e14820b20573] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:43:54.252050 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-133b61a4-1763-4d98-b32e-ec60e5a2e833 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:54.252538 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-133b61a4-1763-4d98-b32e-ec60e5a2e833 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:54.252981 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-133b61a4-1763-4d98-b32e-ec60e5a2e833 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:54.253684 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-133b61a4-1763-4d98-b32e-ec60e5a2e833 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:54.254153 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-133b61a4-1763-4d98-b32e-ec60e5a2e833 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:54.254586 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-133b61a4-1763-4d98-b32e-ec60e5a2e833 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:54.381989 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-133b61a4-1763-4d98-b32e-ec60e5a2e833 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9068c0af1a7c48dab91c3ebf4ebd9148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf91d97eec8b46e2b1f07b6f39185030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:43:54.391334 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-133b61a4-1763-4d98-b32e-ec60e5a2e833 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] 10.222.0.60 "GET /compute/v2.1/servers/caf55729-5b90-40c7-8cf8-e14820b20573" status: 200 len: 1519 microversion: 2.1 time: 0.150947 Sep 14 09:43:54.391917 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3519/6843] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:43:54 2022] GET /compute/v2.1/servers/caf55729-5b90-40c7-8cf8-e14820b20573 => generated 1519 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:43:55.417095 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8f8081be-c9c3-4acc-95e3-5edadda66aa2 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:43:55.417794 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-8f8081be-c9c3-4acc-95e3-5edadda66aa2 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] [instance: caf55729-5b90-40c7-8cf8-e14820b20573] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:43:55.424787 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8f8081be-c9c3-4acc-95e3-5edadda66aa2 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:55.425283 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8f8081be-c9c3-4acc-95e3-5edadda66aa2 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:55.425731 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8f8081be-c9c3-4acc-95e3-5edadda66aa2 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:55.426433 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8f8081be-c9c3-4acc-95e3-5edadda66aa2 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:55.426906 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8f8081be-c9c3-4acc-95e3-5edadda66aa2 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:55.427485 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8f8081be-c9c3-4acc-95e3-5edadda66aa2 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:55.557801 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-8f8081be-c9c3-4acc-95e3-5edadda66aa2 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9068c0af1a7c48dab91c3ebf4ebd9148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf91d97eec8b46e2b1f07b6f39185030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:43:55.565752 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-8f8081be-c9c3-4acc-95e3-5edadda66aa2 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] 10.222.0.60 "GET /compute/v2.1/servers/caf55729-5b90-40c7-8cf8-e14820b20573" status: 200 len: 1519 microversion: 2.1 time: 0.154307 Sep 14 09:43:55.566327 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3520/6844] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:43:55 2022] GET /compute/v2.1/servers/caf55729-5b90-40c7-8cf8-e14820b20573 => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:43:56.589936 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-67ca19f2-a61a-4542-95a6-9381d93d3723 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:43:56.590566 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-67ca19f2-a61a-4542-95a6-9381d93d3723 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] [instance: caf55729-5b90-40c7-8cf8-e14820b20573] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:43:56.597556 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-67ca19f2-a61a-4542-95a6-9381d93d3723 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:56.598060 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-67ca19f2-a61a-4542-95a6-9381d93d3723 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:56.598508 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-67ca19f2-a61a-4542-95a6-9381d93d3723 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:56.599260 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-67ca19f2-a61a-4542-95a6-9381d93d3723 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:56.599731 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-67ca19f2-a61a-4542-95a6-9381d93d3723 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:56.600169 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-67ca19f2-a61a-4542-95a6-9381d93d3723 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:56.732915 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-67ca19f2-a61a-4542-95a6-9381d93d3723 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9068c0af1a7c48dab91c3ebf4ebd9148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf91d97eec8b46e2b1f07b6f39185030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:43:56.741051 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-67ca19f2-a61a-4542-95a6-9381d93d3723 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] 10.222.0.60 "GET /compute/v2.1/servers/caf55729-5b90-40c7-8cf8-e14820b20573" status: 200 len: 1519 microversion: 2.1 time: 0.155334 Sep 14 09:43:56.742224 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3521/6845] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:43:56 2022] GET /compute/v2.1/servers/caf55729-5b90-40c7-8cf8-e14820b20573 => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:43:57.766156 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-6cbf7742-063f-44de-9b3d-4ca645f110c3 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:43:57.766780 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-6cbf7742-063f-44de-9b3d-4ca645f110c3 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] [instance: caf55729-5b90-40c7-8cf8-e14820b20573] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:43:57.773704 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6cbf7742-063f-44de-9b3d-4ca645f110c3 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:57.774196 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6cbf7742-063f-44de-9b3d-4ca645f110c3 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:57.774642 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6cbf7742-063f-44de-9b3d-4ca645f110c3 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:57.775354 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6cbf7742-063f-44de-9b3d-4ca645f110c3 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:57.775817 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6cbf7742-063f-44de-9b3d-4ca645f110c3 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:57.776242 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6cbf7742-063f-44de-9b3d-4ca645f110c3 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:57.905635 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-6cbf7742-063f-44de-9b3d-4ca645f110c3 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9068c0af1a7c48dab91c3ebf4ebd9148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf91d97eec8b46e2b1f07b6f39185030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:43:57.913733 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-6cbf7742-063f-44de-9b3d-4ca645f110c3 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] 10.222.0.60 "GET /compute/v2.1/servers/caf55729-5b90-40c7-8cf8-e14820b20573" status: 200 len: 1519 microversion: 2.1 time: 0.151562 Sep 14 09:43:57.914308 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3522/6846] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:43:57 2022] GET /compute/v2.1/servers/caf55729-5b90-40c7-8cf8-e14820b20573 => generated 1519 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:43:58.937189 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-1b795a73-6207-4a00-b048-8c20d5337e93 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:43:58.937848 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-1b795a73-6207-4a00-b048-8c20d5337e93 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] [instance: caf55729-5b90-40c7-8cf8-e14820b20573] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:43:58.944819 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1b795a73-6207-4a00-b048-8c20d5337e93 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:58.945307 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1b795a73-6207-4a00-b048-8c20d5337e93 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:58.945747 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1b795a73-6207-4a00-b048-8c20d5337e93 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:58.946964 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1b795a73-6207-4a00-b048-8c20d5337e93 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:58.947430 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1b795a73-6207-4a00-b048-8c20d5337e93 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:58.947873 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1b795a73-6207-4a00-b048-8c20d5337e93 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:59.083337 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-1b795a73-6207-4a00-b048-8c20d5337e93 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9068c0af1a7c48dab91c3ebf4ebd9148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf91d97eec8b46e2b1f07b6f39185030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:43:59.091452 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-1b795a73-6207-4a00-b048-8c20d5337e93 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] 10.222.0.60 "GET /compute/v2.1/servers/caf55729-5b90-40c7-8cf8-e14820b20573" status: 200 len: 1519 microversion: 2.1 time: 0.158133 Sep 14 09:43:59.092029 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3523/6847] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:43:58 2022] GET /compute/v2.1/servers/caf55729-5b90-40c7-8cf8-e14820b20573 => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:44:00.113715 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e1be25c6-ebea-4828-9f2a-cc38020f9a37 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:44:00.114360 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e1be25c6-ebea-4828-9f2a-cc38020f9a37 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] [instance: caf55729-5b90-40c7-8cf8-e14820b20573] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:44:00.121196 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e1be25c6-ebea-4828-9f2a-cc38020f9a37 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:44:00.121686 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e1be25c6-ebea-4828-9f2a-cc38020f9a37 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:44:00.122128 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e1be25c6-ebea-4828-9f2a-cc38020f9a37 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:44:00.122826 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e1be25c6-ebea-4828-9f2a-cc38020f9a37 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:44:00.123314 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e1be25c6-ebea-4828-9f2a-cc38020f9a37 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:44:00.123862 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e1be25c6-ebea-4828-9f2a-cc38020f9a37 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:44:00.251912 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-e1be25c6-ebea-4828-9f2a-cc38020f9a37 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9068c0af1a7c48dab91c3ebf4ebd9148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf91d97eec8b46e2b1f07b6f39185030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:44:00.260279 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e1be25c6-ebea-4828-9f2a-cc38020f9a37 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] 10.222.0.60 "GET /compute/v2.1/servers/caf55729-5b90-40c7-8cf8-e14820b20573" status: 200 len: 1519 microversion: 2.1 time: 0.150534 Sep 14 09:44:00.260868 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3524/6848] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:44:00 2022] GET /compute/v2.1/servers/caf55729-5b90-40c7-8cf8-e14820b20573 => generated 1519 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:44:01.284298 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a0daebf9-6ab4-4498-a2ca-2cfa064f89ca tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:44:01.284959 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-a0daebf9-6ab4-4498-a2ca-2cfa064f89ca tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] [instance: caf55729-5b90-40c7-8cf8-e14820b20573] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:44:01.292583 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a0daebf9-6ab4-4498-a2ca-2cfa064f89ca tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:44:01.293080 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a0daebf9-6ab4-4498-a2ca-2cfa064f89ca tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:44:01.293530 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a0daebf9-6ab4-4498-a2ca-2cfa064f89ca tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:44:01.294226 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a0daebf9-6ab4-4498-a2ca-2cfa064f89ca tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:44:01.294693 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a0daebf9-6ab4-4498-a2ca-2cfa064f89ca tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:44:01.295161 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a0daebf9-6ab4-4498-a2ca-2cfa064f89ca tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:44:01.425845 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-a0daebf9-6ab4-4498-a2ca-2cfa064f89ca tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9068c0af1a7c48dab91c3ebf4ebd9148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf91d97eec8b46e2b1f07b6f39185030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:44:01.433788 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a0daebf9-6ab4-4498-a2ca-2cfa064f89ca tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] 10.222.0.60 "GET /compute/v2.1/servers/caf55729-5b90-40c7-8cf8-e14820b20573" status: 200 len: 1519 microversion: 2.1 time: 0.153435 Sep 14 09:44:01.434407 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3525/6849] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:44:01 2022] GET /compute/v2.1/servers/caf55729-5b90-40c7-8cf8-e14820b20573 => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:44:02.457179 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9a9ee1cb-9c8e-4608-ade6-f5e2619793a9 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:44:02.457844 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-9a9ee1cb-9c8e-4608-ade6-f5e2619793a9 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] [instance: caf55729-5b90-40c7-8cf8-e14820b20573] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:44:02.465109 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9a9ee1cb-9c8e-4608-ade6-f5e2619793a9 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:44:02.465607 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9a9ee1cb-9c8e-4608-ade6-f5e2619793a9 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:44:02.466053 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9a9ee1cb-9c8e-4608-ade6-f5e2619793a9 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:44:02.466751 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9a9ee1cb-9c8e-4608-ade6-f5e2619793a9 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:44:02.467241 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9a9ee1cb-9c8e-4608-ade6-f5e2619793a9 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:44:02.467677 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9a9ee1cb-9c8e-4608-ade6-f5e2619793a9 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:44:02.598961 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-9a9ee1cb-9c8e-4608-ade6-f5e2619793a9 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9068c0af1a7c48dab91c3ebf4ebd9148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf91d97eec8b46e2b1f07b6f39185030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:44:02.607254 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-9a9ee1cb-9c8e-4608-ade6-f5e2619793a9 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] 10.222.0.60 "GET /compute/v2.1/servers/caf55729-5b90-40c7-8cf8-e14820b20573" status: 200 len: 1519 microversion: 2.1 time: 0.154110 Sep 14 09:44:02.607832 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3526/6850] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:44:02 2022] GET /compute/v2.1/servers/caf55729-5b90-40c7-8cf8-e14820b20573 => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:44:03.630844 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c23b6f9d-9556-4bce-bbb7-7a2c02ddf5ff tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:44:03.631485 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-c23b6f9d-9556-4bce-bbb7-7a2c02ddf5ff tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] [instance: caf55729-5b90-40c7-8cf8-e14820b20573] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:44:03.639045 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c23b6f9d-9556-4bce-bbb7-7a2c02ddf5ff tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:44:03.639560 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c23b6f9d-9556-4bce-bbb7-7a2c02ddf5ff tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:44:03.639999 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c23b6f9d-9556-4bce-bbb7-7a2c02ddf5ff tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:44:03.640679 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c23b6f9d-9556-4bce-bbb7-7a2c02ddf5ff tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:44:03.641131 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c23b6f9d-9556-4bce-bbb7-7a2c02ddf5ff tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:44:03.641552 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c23b6f9d-9556-4bce-bbb7-7a2c02ddf5ff tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:44:03.776807 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-c23b6f9d-9556-4bce-bbb7-7a2c02ddf5ff tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9068c0af1a7c48dab91c3ebf4ebd9148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf91d97eec8b46e2b1f07b6f39185030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:44:03.784671 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-c23b6f9d-9556-4bce-bbb7-7a2c02ddf5ff tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] 10.222.0.60 "GET /compute/v2.1/servers/caf55729-5b90-40c7-8cf8-e14820b20573" status: 200 len: 1519 microversion: 2.1 time: 0.157751 Sep 14 09:44:03.785263 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3527/6851] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:44:03 2022] GET /compute/v2.1/servers/caf55729-5b90-40c7-8cf8-e14820b20573 => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:44:04.807364 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9086b08c-cd6d-4441-9c4d-4fc941661846 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:44:04.808018 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-9086b08c-cd6d-4441-9c4d-4fc941661846 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] [instance: caf55729-5b90-40c7-8cf8-e14820b20573] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:44:04.814953 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9086b08c-cd6d-4441-9c4d-4fc941661846 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:44:04.815465 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9086b08c-cd6d-4441-9c4d-4fc941661846 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:44:04.815914 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9086b08c-cd6d-4441-9c4d-4fc941661846 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:44:04.816609 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9086b08c-cd6d-4441-9c4d-4fc941661846 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:44:04.817072 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9086b08c-cd6d-4441-9c4d-4fc941661846 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:44:04.817506 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9086b08c-cd6d-4441-9c4d-4fc941661846 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:44:04.951471 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-9086b08c-cd6d-4441-9c4d-4fc941661846 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9068c0af1a7c48dab91c3ebf4ebd9148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf91d97eec8b46e2b1f07b6f39185030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:44:04.959176 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-9086b08c-cd6d-4441-9c4d-4fc941661846 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] 10.222.0.60 "GET /compute/v2.1/servers/caf55729-5b90-40c7-8cf8-e14820b20573" status: 200 len: 1519 microversion: 2.1 time: 0.155836 Sep 14 09:44:04.959753 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3528/6852] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:44:04 2022] GET /compute/v2.1/servers/caf55729-5b90-40c7-8cf8-e14820b20573 => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:44:05.982564 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-7099ca89-cadd-4271-a0b0-81d2bcb26056 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:44:05.983275 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-7099ca89-cadd-4271-a0b0-81d2bcb26056 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] [instance: caf55729-5b90-40c7-8cf8-e14820b20573] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:44:05.986022 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=66 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:44:05.991553 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7099ca89-cadd-4271-a0b0-81d2bcb26056 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:44:05.991978 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7099ca89-cadd-4271-a0b0-81d2bcb26056 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:44:05.992419 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7099ca89-cadd-4271-a0b0-81d2bcb26056 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:44:05.993110 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7099ca89-cadd-4271-a0b0-81d2bcb26056 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:44:05.993568 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7099ca89-cadd-4271-a0b0-81d2bcb26056 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:44:05.993995 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7099ca89-cadd-4271-a0b0-81d2bcb26056 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:44:06.121245 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-7099ca89-cadd-4271-a0b0-81d2bcb26056 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9068c0af1a7c48dab91c3ebf4ebd9148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf91d97eec8b46e2b1f07b6f39185030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:44:06.129129 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-7099ca89-cadd-4271-a0b0-81d2bcb26056 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] 10.222.0.60 "GET /compute/v2.1/servers/caf55729-5b90-40c7-8cf8-e14820b20573" status: 200 len: 1519 microversion: 2.1 time: 0.150984 Sep 14 09:44:06.129710 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3529/6853] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:44:05 2022] GET /compute/v2.1/servers/caf55729-5b90-40c7-8cf8-e14820b20573 => generated 1519 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:44:07.152468 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c6b5e75b-9096-4d00-99ad-a2f337a47f42 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:44:07.153099 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-c6b5e75b-9096-4d00-99ad-a2f337a47f42 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] [instance: caf55729-5b90-40c7-8cf8-e14820b20573] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:44:07.160039 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c6b5e75b-9096-4d00-99ad-a2f337a47f42 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:44:07.160569 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c6b5e75b-9096-4d00-99ad-a2f337a47f42 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:44:07.161014 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c6b5e75b-9096-4d00-99ad-a2f337a47f42 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:44:07.161717 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c6b5e75b-9096-4d00-99ad-a2f337a47f42 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:44:07.162203 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c6b5e75b-9096-4d00-99ad-a2f337a47f42 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:44:07.163022 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c6b5e75b-9096-4d00-99ad-a2f337a47f42 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:44:07.296162 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-c6b5e75b-9096-4d00-99ad-a2f337a47f42 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9068c0af1a7c48dab91c3ebf4ebd9148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf91d97eec8b46e2b1f07b6f39185030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:44:07.303941 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-c6b5e75b-9096-4d00-99ad-a2f337a47f42 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] 10.222.0.60 "GET /compute/v2.1/servers/caf55729-5b90-40c7-8cf8-e14820b20573" status: 200 len: 1519 microversion: 2.1 time: 0.155380 Sep 14 09:44:07.304519 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3530/6854] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:44:07 2022] GET /compute/v2.1/servers/caf55729-5b90-40c7-8cf8-e14820b20573 => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:44:08.328360 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-2d2995e7-efdc-4a09-85e5-f778669f4f45 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:44:08.328979 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-2d2995e7-efdc-4a09-85e5-f778669f4f45 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] [instance: caf55729-5b90-40c7-8cf8-e14820b20573] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:44:08.335916 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2d2995e7-efdc-4a09-85e5-f778669f4f45 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:44:08.336409 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2d2995e7-efdc-4a09-85e5-f778669f4f45 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:44:08.336855 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2d2995e7-efdc-4a09-85e5-f778669f4f45 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:44:08.337555 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2d2995e7-efdc-4a09-85e5-f778669f4f45 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:44:08.338016 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2d2995e7-efdc-4a09-85e5-f778669f4f45 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:44:08.338455 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2d2995e7-efdc-4a09-85e5-f778669f4f45 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:44:08.465571 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-2d2995e7-efdc-4a09-85e5-f778669f4f45 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9068c0af1a7c48dab91c3ebf4ebd9148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf91d97eec8b46e2b1f07b6f39185030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:44:08.473406 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-2d2995e7-efdc-4a09-85e5-f778669f4f45 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] 10.222.0.60 "GET /compute/v2.1/servers/caf55729-5b90-40c7-8cf8-e14820b20573" status: 200 len: 1519 microversion: 2.1 time: 0.149627 Sep 14 09:44:08.473991 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3531/6855] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:44:08 2022] GET /compute/v2.1/servers/caf55729-5b90-40c7-8cf8-e14820b20573 => generated 1519 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:44:09.497722 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-242a317a-5ded-41e0-b410-3517b0e9280f tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:44:09.498388 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-242a317a-5ded-41e0-b410-3517b0e9280f tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] [instance: caf55729-5b90-40c7-8cf8-e14820b20573] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:44:09.505359 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-242a317a-5ded-41e0-b410-3517b0e9280f tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:44:09.505852 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-242a317a-5ded-41e0-b410-3517b0e9280f tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:44:09.506296 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-242a317a-5ded-41e0-b410-3517b0e9280f tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:44:09.507021 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-242a317a-5ded-41e0-b410-3517b0e9280f tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:44:09.507491 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-242a317a-5ded-41e0-b410-3517b0e9280f tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:44:09.507926 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-242a317a-5ded-41e0-b410-3517b0e9280f tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:44:09.641592 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-242a317a-5ded-41e0-b410-3517b0e9280f tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9068c0af1a7c48dab91c3ebf4ebd9148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf91d97eec8b46e2b1f07b6f39185030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:44:09.649261 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-242a317a-5ded-41e0-b410-3517b0e9280f tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] 10.222.0.60 "GET /compute/v2.1/servers/caf55729-5b90-40c7-8cf8-e14820b20573" status: 200 len: 1519 microversion: 2.1 time: 0.156092 Sep 14 09:44:09.649836 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3532/6856] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:44:09 2022] GET /compute/v2.1/servers/caf55729-5b90-40c7-8cf8-e14820b20573 => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:44:10.672239 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c25f8db4-d556-41b0-b837-d718a5ccaa59 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:44:10.672890 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-c25f8db4-d556-41b0-b837-d718a5ccaa59 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] [instance: caf55729-5b90-40c7-8cf8-e14820b20573] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:44:10.679699 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c25f8db4-d556-41b0-b837-d718a5ccaa59 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:44:10.680183 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c25f8db4-d556-41b0-b837-d718a5ccaa59 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:44:10.680619 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c25f8db4-d556-41b0-b837-d718a5ccaa59 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:44:10.681300 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c25f8db4-d556-41b0-b837-d718a5ccaa59 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:44:10.681819 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c25f8db4-d556-41b0-b837-d718a5ccaa59 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:44:10.682243 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c25f8db4-d556-41b0-b837-d718a5ccaa59 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:44:10.684818 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=100 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:44:10.813642 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-c25f8db4-d556-41b0-b837-d718a5ccaa59 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9068c0af1a7c48dab91c3ebf4ebd9148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf91d97eec8b46e2b1f07b6f39185030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:44:10.821403 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-c25f8db4-d556-41b0-b837-d718a5ccaa59 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] 10.222.0.60 "GET /compute/v2.1/servers/caf55729-5b90-40c7-8cf8-e14820b20573" status: 200 len: 1519 microversion: 2.1 time: 0.153121 Sep 14 09:44:10.821985 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3533/6857] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:44:10 2022] GET /compute/v2.1/servers/caf55729-5b90-40c7-8cf8-e14820b20573 => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:44:11.846047 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d605c6d0-f6e6-45ef-ae1a-9908f868052e tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:44:11.846696 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-d605c6d0-f6e6-45ef-ae1a-9908f868052e tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] [instance: caf55729-5b90-40c7-8cf8-e14820b20573] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:44:11.854510 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d605c6d0-f6e6-45ef-ae1a-9908f868052e tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:44:11.855029 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d605c6d0-f6e6-45ef-ae1a-9908f868052e tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:44:11.855470 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d605c6d0-f6e6-45ef-ae1a-9908f868052e tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:44:11.856164 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d605c6d0-f6e6-45ef-ae1a-9908f868052e tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:44:11.856618 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d605c6d0-f6e6-45ef-ae1a-9908f868052e tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:44:11.857047 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d605c6d0-f6e6-45ef-ae1a-9908f868052e tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:44:11.984326 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-d605c6d0-f6e6-45ef-ae1a-9908f868052e tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9068c0af1a7c48dab91c3ebf4ebd9148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf91d97eec8b46e2b1f07b6f39185030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:44:11.992048 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d605c6d0-f6e6-45ef-ae1a-9908f868052e tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] 10.222.0.60 "GET /compute/v2.1/servers/caf55729-5b90-40c7-8cf8-e14820b20573" status: 200 len: 1519 microversion: 2.1 time: 0.149979 Sep 14 09:44:11.992650 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3534/6858] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:44:11 2022] GET /compute/v2.1/servers/caf55729-5b90-40c7-8cf8-e14820b20573 => generated 1519 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:44:13.015481 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-71c7d3bc-2b3b-4297-a848-d589f23150df tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:44:13.016170 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-71c7d3bc-2b3b-4297-a848-d589f23150df tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] [instance: caf55729-5b90-40c7-8cf8-e14820b20573] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:44:13.023024 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-71c7d3bc-2b3b-4297-a848-d589f23150df tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:44:13.023515 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-71c7d3bc-2b3b-4297-a848-d589f23150df tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:44:13.023957 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-71c7d3bc-2b3b-4297-a848-d589f23150df tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:44:13.024650 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-71c7d3bc-2b3b-4297-a848-d589f23150df tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:44:13.025110 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-71c7d3bc-2b3b-4297-a848-d589f23150df tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:44:13.025543 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-71c7d3bc-2b3b-4297-a848-d589f23150df tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:44:13.156948 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-71c7d3bc-2b3b-4297-a848-d589f23150df tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9068c0af1a7c48dab91c3ebf4ebd9148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf91d97eec8b46e2b1f07b6f39185030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:44:13.164637 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-71c7d3bc-2b3b-4297-a848-d589f23150df tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] 10.222.0.60 "GET /compute/v2.1/servers/caf55729-5b90-40c7-8cf8-e14820b20573" status: 200 len: 1519 microversion: 2.1 time: 0.153087 Sep 14 09:44:13.165205 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3535/6859] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:44:13 2022] GET /compute/v2.1/servers/caf55729-5b90-40c7-8cf8-e14820b20573 => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:44:14.188330 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c327167c-b92a-46b4-a153-67056e1df89c tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:44:14.189001 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-c327167c-b92a-46b4-a153-67056e1df89c tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] [instance: caf55729-5b90-40c7-8cf8-e14820b20573] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:44:14.195903 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c327167c-b92a-46b4-a153-67056e1df89c tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:44:14.196395 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c327167c-b92a-46b4-a153-67056e1df89c tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:44:14.196839 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c327167c-b92a-46b4-a153-67056e1df89c tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:44:14.198107 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c327167c-b92a-46b4-a153-67056e1df89c tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:44:14.198569 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c327167c-b92a-46b4-a153-67056e1df89c tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:44:14.199025 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c327167c-b92a-46b4-a153-67056e1df89c tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:44:14.327886 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-c327167c-b92a-46b4-a153-67056e1df89c tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9068c0af1a7c48dab91c3ebf4ebd9148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf91d97eec8b46e2b1f07b6f39185030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:44:14.335801 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-c327167c-b92a-46b4-a153-67056e1df89c tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] 10.222.0.60 "GET /compute/v2.1/servers/caf55729-5b90-40c7-8cf8-e14820b20573" status: 200 len: 1519 microversion: 2.1 time: 0.151406 Sep 14 09:44:14.336584 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3536/6860] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:44:14 2022] GET /compute/v2.1/servers/caf55729-5b90-40c7-8cf8-e14820b20573 => generated 1519 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:44:14.843816 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-bdb2550b-4ae4-42ab-9403-2ea4d0bb1755 req-58ef8d09-26aa-47db-98cb-f1fe1c865166 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "caf55729-5b90-40c7-8cf8-e14820b20573", "name": "network-vif-unplugged", "status": "completed", "tag": "18ed8d86-6464-43d6-b7f1-eae0025337a5"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:44:14.853319 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-bdb2550b-4ae4-42ab-9403-2ea4d0bb1755 req-58ef8d09-26aa-47db-98cb-f1fe1c865166 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:44:14.854388 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-bdb2550b-4ae4-42ab-9403-2ea4d0bb1755 req-58ef8d09-26aa-47db-98cb-f1fe1c865166 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:44:14.854879 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-bdb2550b-4ae4-42ab-9403-2ea4d0bb1755 req-58ef8d09-26aa-47db-98cb-f1fe1c865166 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:44:14.867254 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-bdb2550b-4ae4-42ab-9403-2ea4d0bb1755 req-58ef8d09-26aa-47db-98cb-f1fe1c865166 service nova] Creating event network-vif-unplugged:18ed8d86-6464-43d6-b7f1-eae0025337a5 for instance caf55729-5b90-40c7-8cf8-e14820b20573 on n-h1-836830-18 Sep 14 09:44:14.873960 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [req-bdb2550b-4ae4-42ab-9403-2ea4d0bb1755 req-58ef8d09-26aa-47db-98cb-f1fe1c865166 service nova] Instance caf55729-5b90-40c7-8cf8-e14820b20573 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-836830-18', 'n-h2-836830-18'} {{(pid=128759) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 14 09:44:14.884831 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-bdb2550b-4ae4-42ab-9403-2ea4d0bb1755 req-58ef8d09-26aa-47db-98cb-f1fe1c865166 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044804 Sep 14 09:44:14.885828 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3537/6861] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:44:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:44:15.360920 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-14beafeb-4b70-40b6-8674-9037dd983f56 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:44:15.361644 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-14beafeb-4b70-40b6-8674-9037dd983f56 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] [instance: caf55729-5b90-40c7-8cf8-e14820b20573] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:44:15.367823 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-14beafeb-4b70-40b6-8674-9037dd983f56 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:44:15.368310 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-14beafeb-4b70-40b6-8674-9037dd983f56 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:44:15.368744 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-14beafeb-4b70-40b6-8674-9037dd983f56 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:44:15.369466 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-14beafeb-4b70-40b6-8674-9037dd983f56 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:44:15.369920 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-14beafeb-4b70-40b6-8674-9037dd983f56 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:44:15.370344 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-14beafeb-4b70-40b6-8674-9037dd983f56 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:44:15.506965 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-14beafeb-4b70-40b6-8674-9037dd983f56 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9068c0af1a7c48dab91c3ebf4ebd9148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf91d97eec8b46e2b1f07b6f39185030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:44:15.515641 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-14beafeb-4b70-40b6-8674-9037dd983f56 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] 10.222.0.60 "GET /compute/v2.1/servers/caf55729-5b90-40c7-8cf8-e14820b20573" status: 200 len: 1518 microversion: 2.1 time: 0.159911 Sep 14 09:44:15.516244 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3538/6862] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:44:15 2022] GET /compute/v2.1/servers/caf55729-5b90-40c7-8cf8-e14820b20573 => generated 1518 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:44:16.540105 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-0cafb149-c2bf-496d-861c-ea9f84c94553 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:44:16.540786 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-0cafb149-c2bf-496d-861c-ea9f84c94553 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] [instance: caf55729-5b90-40c7-8cf8-e14820b20573] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:44:16.548248 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0cafb149-c2bf-496d-861c-ea9f84c94553 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:44:16.548737 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0cafb149-c2bf-496d-861c-ea9f84c94553 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:44:16.549179 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0cafb149-c2bf-496d-861c-ea9f84c94553 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:44:16.549868 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0cafb149-c2bf-496d-861c-ea9f84c94553 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:44:16.550329 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0cafb149-c2bf-496d-861c-ea9f84c94553 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:44:16.550758 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0cafb149-c2bf-496d-861c-ea9f84c94553 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:44:16.737383 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-0cafb149-c2bf-496d-861c-ea9f84c94553 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9068c0af1a7c48dab91c3ebf4ebd9148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf91d97eec8b46e2b1f07b6f39185030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:44:16.747855 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-0cafb149-c2bf-496d-861c-ea9f84c94553 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] 10.222.0.60 "GET /compute/v2.1/servers/caf55729-5b90-40c7-8cf8-e14820b20573" status: 200 len: 1516 microversion: 2.1 time: 0.211626 Sep 14 09:44:16.750704 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3539/6863] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:44:16 2022] GET /compute/v2.1/servers/caf55729-5b90-40c7-8cf8-e14820b20573 => generated 1516 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:44:16.975730 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-0cb5a4b5-0852-4ceb-81c2-6841a56c1bac req-9b236fc2-2cd0-4829-93c5-4a15c6d2bc79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "caf55729-5b90-40c7-8cf8-e14820b20573", "tag": "18ed8d86-6464-43d6-b7f1-eae0025337a5"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:44:16.985774 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-0cb5a4b5-0852-4ceb-81c2-6841a56c1bac req-9b236fc2-2cd0-4829-93c5-4a15c6d2bc79 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:44:16.986261 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-0cb5a4b5-0852-4ceb-81c2-6841a56c1bac req-9b236fc2-2cd0-4829-93c5-4a15c6d2bc79 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:44:16.986697 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-0cb5a4b5-0852-4ceb-81c2-6841a56c1bac req-9b236fc2-2cd0-4829-93c5-4a15c6d2bc79 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:44:17.001212 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-0cb5a4b5-0852-4ceb-81c2-6841a56c1bac req-9b236fc2-2cd0-4829-93c5-4a15c6d2bc79 service nova] Creating event network-changed:18ed8d86-6464-43d6-b7f1-eae0025337a5 for instance caf55729-5b90-40c7-8cf8-e14820b20573 on n-h1-836830-18 Sep 14 09:44:17.006528 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [req-0cb5a4b5-0852-4ceb-81c2-6841a56c1bac req-9b236fc2-2cd0-4829-93c5-4a15c6d2bc79 service nova] Instance caf55729-5b90-40c7-8cf8-e14820b20573 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-836830-18', 'n-h2-836830-18'} {{(pid=128759) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 14 09:44:17.017275 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-0cb5a4b5-0852-4ceb-81c2-6841a56c1bac req-9b236fc2-2cd0-4829-93c5-4a15c6d2bc79 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107356 Sep 14 09:44:17.017868 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3540/6864] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:44:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:44:17.774228 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-14227e79-0c99-4357-90ba-aa8f8fd1ab7e tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:44:17.774987 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-14227e79-0c99-4357-90ba-aa8f8fd1ab7e tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] [instance: caf55729-5b90-40c7-8cf8-e14820b20573] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:44:17.782133 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-14227e79-0c99-4357-90ba-aa8f8fd1ab7e tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:44:17.782627 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-14227e79-0c99-4357-90ba-aa8f8fd1ab7e tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:44:17.783105 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-14227e79-0c99-4357-90ba-aa8f8fd1ab7e tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:44:17.783785 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-14227e79-0c99-4357-90ba-aa8f8fd1ab7e tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:44:17.784235 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-14227e79-0c99-4357-90ba-aa8f8fd1ab7e tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:44:17.784655 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-14227e79-0c99-4357-90ba-aa8f8fd1ab7e tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:44:17.918346 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-14227e79-0c99-4357-90ba-aa8f8fd1ab7e tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9068c0af1a7c48dab91c3ebf4ebd9148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf91d97eec8b46e2b1f07b6f39185030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:44:17.926115 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-14227e79-0c99-4357-90ba-aa8f8fd1ab7e tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] 10.222.0.60 "GET /compute/v2.1/servers/caf55729-5b90-40c7-8cf8-e14820b20573" status: 200 len: 1516 microversion: 2.1 time: 0.156227 Sep 14 09:44:17.926703 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3541/6865] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:44:17 2022] GET /compute/v2.1/servers/caf55729-5b90-40c7-8cf8-e14820b20573 => generated 1516 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:44:18.949266 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-34c7f5f6-587c-4074-bae0-b093b91898cf tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:44:18.949939 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-34c7f5f6-587c-4074-bae0-b093b91898cf tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] [instance: caf55729-5b90-40c7-8cf8-e14820b20573] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:44:18.956858 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-34c7f5f6-587c-4074-bae0-b093b91898cf tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:44:18.957343 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-34c7f5f6-587c-4074-bae0-b093b91898cf tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:44:18.957787 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-34c7f5f6-587c-4074-bae0-b093b91898cf tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:44:18.958551 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-34c7f5f6-587c-4074-bae0-b093b91898cf tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:44:18.959480 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-34c7f5f6-587c-4074-bae0-b093b91898cf tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:44:18.959920 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-34c7f5f6-587c-4074-bae0-b093b91898cf tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:44:19.106997 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-34c7f5f6-587c-4074-bae0-b093b91898cf tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9068c0af1a7c48dab91c3ebf4ebd9148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf91d97eec8b46e2b1f07b6f39185030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:44:19.114820 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-34c7f5f6-587c-4074-bae0-b093b91898cf tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] 10.222.0.60 "GET /compute/v2.1/servers/caf55729-5b90-40c7-8cf8-e14820b20573" status: 200 len: 1516 microversion: 2.1 time: 0.169534 Sep 14 09:44:19.115434 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3542/6866] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:44:18 2022] GET /compute/v2.1/servers/caf55729-5b90-40c7-8cf8-e14820b20573 => generated 1516 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:44:20.142187 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b8cb506b-4550-4af9-8ad2-157b28809d32 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:44:20.143164 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b8cb506b-4550-4af9-8ad2-157b28809d32 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] [instance: caf55729-5b90-40c7-8cf8-e14820b20573] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:44:20.150804 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b8cb506b-4550-4af9-8ad2-157b28809d32 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:44:20.151332 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b8cb506b-4550-4af9-8ad2-157b28809d32 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:44:20.151771 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b8cb506b-4550-4af9-8ad2-157b28809d32 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:44:20.152476 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b8cb506b-4550-4af9-8ad2-157b28809d32 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:44:20.152934 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b8cb506b-4550-4af9-8ad2-157b28809d32 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:44:20.153365 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b8cb506b-4550-4af9-8ad2-157b28809d32 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:44:20.283377 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b8cb506b-4550-4af9-8ad2-157b28809d32 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9068c0af1a7c48dab91c3ebf4ebd9148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf91d97eec8b46e2b1f07b6f39185030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:44:20.291631 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b8cb506b-4550-4af9-8ad2-157b28809d32 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] 10.222.0.60 "GET /compute/v2.1/servers/caf55729-5b90-40c7-8cf8-e14820b20573" status: 200 len: 1513 microversion: 2.1 time: 0.152876 Sep 14 09:44:20.292222 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3543/6867] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:44:20 2022] GET /compute/v2.1/servers/caf55729-5b90-40c7-8cf8-e14820b20573 => generated 1513 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:44:20.313219 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d051faaa-3694-4898-a448-46cc1aa7e534 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:44:20.313756 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-d051faaa-3694-4898-a448-46cc1aa7e534 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] [instance: caf55729-5b90-40c7-8cf8-e14820b20573] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:44:20.319532 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d051faaa-3694-4898-a448-46cc1aa7e534 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:44:20.320072 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d051faaa-3694-4898-a448-46cc1aa7e534 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:44:20.320447 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d051faaa-3694-4898-a448-46cc1aa7e534 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:44:20.321159 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d051faaa-3694-4898-a448-46cc1aa7e534 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:44:20.321608 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d051faaa-3694-4898-a448-46cc1aa7e534 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:44:20.322031 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d051faaa-3694-4898-a448-46cc1aa7e534 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:44:20.378815 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d051faaa-3694-4898-a448-46cc1aa7e534 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] 10.222.0.60 "POST /compute/v2.1/servers/caf55729-5b90-40c7-8cf8-e14820b20573/action" status: 204 len: 0 microversion: 2.1 time: 0.069033 Sep 14 09:44:20.379517 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3544/6868] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:44:20 2022] POST /compute/v2.1/servers/caf55729-5b90-40c7-8cf8-e14820b20573/action => generated 0 bytes in 70 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 14 09:44:20.388132 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e6d6ada4-9043-4624-81ee-aa30c129a544 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:44:20.388836 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e6d6ada4-9043-4624-81ee-aa30c129a544 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] [instance: caf55729-5b90-40c7-8cf8-e14820b20573] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:44:20.395284 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e6d6ada4-9043-4624-81ee-aa30c129a544 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:44:20.395690 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e6d6ada4-9043-4624-81ee-aa30c129a544 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:44:20.396203 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e6d6ada4-9043-4624-81ee-aa30c129a544 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:44:20.397014 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e6d6ada4-9043-4624-81ee-aa30c129a544 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:44:20.397615 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e6d6ada4-9043-4624-81ee-aa30c129a544 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:44:20.398024 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e6d6ada4-9043-4624-81ee-aa30c129a544 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:44:20.535250 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-e6d6ada4-9043-4624-81ee-aa30c129a544 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9068c0af1a7c48dab91c3ebf4ebd9148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf91d97eec8b46e2b1f07b6f39185030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:44:20.543189 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e6d6ada4-9043-4624-81ee-aa30c129a544 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] 10.222.0.60 "GET /compute/v2.1/servers/caf55729-5b90-40c7-8cf8-e14820b20573" status: 200 len: 1513 microversion: 2.1 time: 0.159411 Sep 14 09:44:20.543777 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3545/6869] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:44:20 2022] GET /compute/v2.1/servers/caf55729-5b90-40c7-8cf8-e14820b20573 => generated 1513 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:44:21.567208 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-7fcae71f-6a78-48f3-8bc5-a8ecdc393a2f tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:44:21.567876 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-7fcae71f-6a78-48f3-8bc5-a8ecdc393a2f tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] [instance: caf55729-5b90-40c7-8cf8-e14820b20573] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:44:21.575194 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7fcae71f-6a78-48f3-8bc5-a8ecdc393a2f tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:44:21.575926 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7fcae71f-6a78-48f3-8bc5-a8ecdc393a2f tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:44:21.576374 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7fcae71f-6a78-48f3-8bc5-a8ecdc393a2f tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:44:21.577136 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7fcae71f-6a78-48f3-8bc5-a8ecdc393a2f tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:44:21.577563 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7fcae71f-6a78-48f3-8bc5-a8ecdc393a2f tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:44:21.578018 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7fcae71f-6a78-48f3-8bc5-a8ecdc393a2f tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:44:21.713569 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-7fcae71f-6a78-48f3-8bc5-a8ecdc393a2f tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9068c0af1a7c48dab91c3ebf4ebd9148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf91d97eec8b46e2b1f07b6f39185030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:44:21.721629 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-7fcae71f-6a78-48f3-8bc5-a8ecdc393a2f tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] 10.222.0.60 "GET /compute/v2.1/servers/caf55729-5b90-40c7-8cf8-e14820b20573" status: 200 len: 1505 microversion: 2.1 time: 0.158720 Sep 14 09:44:21.722205 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3546/6870] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:44:21 2022] GET /compute/v2.1/servers/caf55729-5b90-40c7-8cf8-e14820b20573 => generated 1505 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:44:21.743742 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-151aaf81-36ab-41f0-95e9-fc9195156ac4 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:44:21.744356 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-151aaf81-36ab-41f0-95e9-fc9195156ac4 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] [instance: caf55729-5b90-40c7-8cf8-e14820b20573] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:44:21.749939 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-151aaf81-36ab-41f0-95e9-fc9195156ac4 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:44:21.750418 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-151aaf81-36ab-41f0-95e9-fc9195156ac4 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:44:21.750856 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-151aaf81-36ab-41f0-95e9-fc9195156ac4 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:44:21.751564 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-151aaf81-36ab-41f0-95e9-fc9195156ac4 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:44:21.752017 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-151aaf81-36ab-41f0-95e9-fc9195156ac4 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:44:21.752440 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-151aaf81-36ab-41f0-95e9-fc9195156ac4 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:44:21.885265 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-151aaf81-36ab-41f0-95e9-fc9195156ac4 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9068c0af1a7c48dab91c3ebf4ebd9148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf91d97eec8b46e2b1f07b6f39185030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:44:21.893071 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-151aaf81-36ab-41f0-95e9-fc9195156ac4 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] 10.222.0.60 "GET /compute/v2.1/servers/caf55729-5b90-40c7-8cf8-e14820b20573" status: 200 len: 1505 microversion: 2.1 time: 0.152836 Sep 14 09:44:21.893638 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3547/6871] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:44:21 2022] GET /compute/v2.1/servers/caf55729-5b90-40c7-8cf8-e14820b20573 => generated 1505 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:44:21.914456 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f8642fd3-9f52-4be7-96c0-6e53fd2ded94 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:44:21.915088 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f8642fd3-9f52-4be7-96c0-6e53fd2ded94 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] [instance: caf55729-5b90-40c7-8cf8-e14820b20573] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:44:21.921194 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f8642fd3-9f52-4be7-96c0-6e53fd2ded94 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:44:21.921681 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f8642fd3-9f52-4be7-96c0-6e53fd2ded94 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:44:21.922119 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f8642fd3-9f52-4be7-96c0-6e53fd2ded94 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:44:21.922800 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f8642fd3-9f52-4be7-96c0-6e53fd2ded94 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:44:21.923278 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f8642fd3-9f52-4be7-96c0-6e53fd2ded94 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:44:21.923720 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f8642fd3-9f52-4be7-96c0-6e53fd2ded94 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:44:22.052426 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f8642fd3-9f52-4be7-96c0-6e53fd2ded94 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9068c0af1a7c48dab91c3ebf4ebd9148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf91d97eec8b46e2b1f07b6f39185030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:44:22.060617 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f8642fd3-9f52-4be7-96c0-6e53fd2ded94 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] 10.222.0.60 "GET /compute/v2.1/servers/caf55729-5b90-40c7-8cf8-e14820b20573" status: 200 len: 1505 microversion: 2.1 time: 0.149686 Sep 14 09:44:22.061196 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3548/6872] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:44:21 2022] GET /compute/v2.1/servers/caf55729-5b90-40c7-8cf8-e14820b20573 => generated 1505 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:44:22.083080 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3e565502-7605-46fd-8d23-3dd421d461c5 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:44:22.083624 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-3e565502-7605-46fd-8d23-3dd421d461c5 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] [instance: caf55729-5b90-40c7-8cf8-e14820b20573] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:44:22.090392 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3e565502-7605-46fd-8d23-3dd421d461c5 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:44:22.090881 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3e565502-7605-46fd-8d23-3dd421d461c5 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:44:22.091347 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3e565502-7605-46fd-8d23-3dd421d461c5 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:44:22.092050 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3e565502-7605-46fd-8d23-3dd421d461c5 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:44:22.092511 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3e565502-7605-46fd-8d23-3dd421d461c5 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:44:22.092942 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3e565502-7605-46fd-8d23-3dd421d461c5 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:44:22.097078 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:44:22.119649 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-3e565502-7605-46fd-8d23-3dd421d461c5 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] [instance: caf55729-5b90-40c7-8cf8-e14820b20573] Going to try to terminate instance {{(pid=128759) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:44:22.199160 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-3e565502-7605-46fd-8d23-3dd421d461c5 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] 10.222.0.60 "DELETE /compute/v2.1/servers/caf55729-5b90-40c7-8cf8-e14820b20573" status: 204 len: 0 microversion: 2.1 time: 0.119585 Sep 14 09:44:22.199672 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3549/6873] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:44:22 2022] DELETE /compute/v2.1/servers/caf55729-5b90-40c7-8cf8-e14820b20573 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 14 09:44:22.215796 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-4cfdb060-c2d6-47cb-8f55-62b13f7e8e3e tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:44:22.216385 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-4cfdb060-c2d6-47cb-8f55-62b13f7e8e3e tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] [instance: caf55729-5b90-40c7-8cf8-e14820b20573] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:44:22.222229 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4cfdb060-c2d6-47cb-8f55-62b13f7e8e3e tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:44:22.222712 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4cfdb060-c2d6-47cb-8f55-62b13f7e8e3e tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:44:22.223183 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4cfdb060-c2d6-47cb-8f55-62b13f7e8e3e tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:44:22.223862 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4cfdb060-c2d6-47cb-8f55-62b13f7e8e3e tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:44:22.224315 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4cfdb060-c2d6-47cb-8f55-62b13f7e8e3e tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:44:22.224738 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4cfdb060-c2d6-47cb-8f55-62b13f7e8e3e tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:44:22.250035 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-4cfdb060-c2d6-47cb-8f55-62b13f7e8e3e tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] [instance: caf55729-5b90-40c7-8cf8-e14820b20573] Going to try to terminate instance {{(pid=128759) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:44:22.292950 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.compute.api [None req-4cfdb060-c2d6-47cb-8f55-62b13f7e8e3e tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] [instance: caf55729-5b90-40c7-8cf8-e14820b20573] Instance is already in deleting state, ignoring this request Sep 14 09:44:22.293770 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-4cfdb060-c2d6-47cb-8f55-62b13f7e8e3e tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] 10.222.0.60 "DELETE /compute/v2.1/servers/caf55729-5b90-40c7-8cf8-e14820b20573" status: 204 len: 0 microversion: 2.1 time: 0.082663 Sep 14 09:44:22.294506 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3550/6874] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:44:22 2022] DELETE /compute/v2.1/servers/caf55729-5b90-40c7-8cf8-e14820b20573 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 14 09:44:22.302140 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9ff9f969-cbc6-4f31-8941-0d622fa3f012 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:44:22.302749 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-9ff9f969-cbc6-4f31-8941-0d622fa3f012 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] [instance: caf55729-5b90-40c7-8cf8-e14820b20573] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:44:22.308886 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9ff9f969-cbc6-4f31-8941-0d622fa3f012 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:44:22.309371 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9ff9f969-cbc6-4f31-8941-0d622fa3f012 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:44:22.309804 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9ff9f969-cbc6-4f31-8941-0d622fa3f012 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:44:22.310483 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9ff9f969-cbc6-4f31-8941-0d622fa3f012 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:44:22.310954 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9ff9f969-cbc6-4f31-8941-0d622fa3f012 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:44:22.311376 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9ff9f969-cbc6-4f31-8941-0d622fa3f012 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:44:22.313751 n-d-836830-18 devstack@n-api.service[128758]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 09:44:22.314233 n-d-836830-18 devstack@n-api.service[128758]: Wed Sep 14 09:44:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.60) !!! Sep 14 09:44:22.438271 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-9ff9f969-cbc6-4f31-8941-0d622fa3f012 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9068c0af1a7c48dab91c3ebf4ebd9148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf91d97eec8b46e2b1f07b6f39185030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:44:22.446003 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-9ff9f969-cbc6-4f31-8941-0d622fa3f012 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] 10.222.0.60 "GET /compute/v2.1/servers/caf55729-5b90-40c7-8cf8-e14820b20573" status: 200 len: 1511 microversion: 2.1 time: 0.147522 Sep 14 09:44:22.446576 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3551/6875] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:44:22 2022] GET /compute/v2.1/servers/caf55729-5b90-40c7-8cf8-e14820b20573 => generated 1511 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:44:23.470612 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-789a283b-8877-4ba8-ae13-1581351e576c tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:44:23.471496 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-789a283b-8877-4ba8-ae13-1581351e576c tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] [instance: caf55729-5b90-40c7-8cf8-e14820b20573] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:44:23.479270 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-789a283b-8877-4ba8-ae13-1581351e576c tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:44:23.479847 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-789a283b-8877-4ba8-ae13-1581351e576c tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:44:23.480367 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-789a283b-8877-4ba8-ae13-1581351e576c tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:44:23.481171 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-789a283b-8877-4ba8-ae13-1581351e576c tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:44:23.481794 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-789a283b-8877-4ba8-ae13-1581351e576c tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:44:23.482170 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-789a283b-8877-4ba8-ae13-1581351e576c tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:44:23.633792 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-789a283b-8877-4ba8-ae13-1581351e576c tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9068c0af1a7c48dab91c3ebf4ebd9148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf91d97eec8b46e2b1f07b6f39185030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:44:23.643893 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-789a283b-8877-4ba8-ae13-1581351e576c tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] 10.222.0.60 "GET /compute/v2.1/servers/caf55729-5b90-40c7-8cf8-e14820b20573" status: 200 len: 1511 microversion: 2.1 time: 0.177686 Sep 14 09:44:23.644475 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3552/6876] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:44:23 2022] GET /compute/v2.1/servers/caf55729-5b90-40c7-8cf8-e14820b20573 => generated 1511 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:44:23.649072 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-3d9e1fd8-5685-4ac4-8c85-e1fe21413f16 req-7c5cb8c6-8bd2-43e6-a24f-289cea4080a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "caf55729-5b90-40c7-8cf8-e14820b20573", "name": "network-vif-plugged", "status": "completed", "tag": "18ed8d86-6464-43d6-b7f1-eae0025337a5"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:44:23.658865 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-3d9e1fd8-5685-4ac4-8c85-e1fe21413f16 req-7c5cb8c6-8bd2-43e6-a24f-289cea4080a6 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:44:23.659409 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-3d9e1fd8-5685-4ac4-8c85-e1fe21413f16 req-7c5cb8c6-8bd2-43e6-a24f-289cea4080a6 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:44:23.659845 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-3d9e1fd8-5685-4ac4-8c85-e1fe21413f16 req-7c5cb8c6-8bd2-43e6-a24f-289cea4080a6 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:44:23.671450 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-3d9e1fd8-5685-4ac4-8c85-e1fe21413f16 req-7c5cb8c6-8bd2-43e6-a24f-289cea4080a6 service nova] Creating event network-vif-plugged:18ed8d86-6464-43d6-b7f1-eae0025337a5 for instance caf55729-5b90-40c7-8cf8-e14820b20573 on n-h1-836830-18 Sep 14 09:44:23.676370 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-3d9e1fd8-5685-4ac4-8c85-e1fe21413f16 req-7c5cb8c6-8bd2-43e6-a24f-289cea4080a6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030650 Sep 14 09:44:23.676967 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3553/6877] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:44:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:44:24.267799 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-0b756bfb-acf8-4535-ae7e-a311d9616edc req-d8f80b4b-d88d-4976-8910-d89bc7fd7005 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "caf55729-5b90-40c7-8cf8-e14820b20573", "name": "network-vif-deleted", "tag": "18ed8d86-6464-43d6-b7f1-eae0025337a5"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:44:24.279092 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-0b756bfb-acf8-4535-ae7e-a311d9616edc req-d8f80b4b-d88d-4976-8910-d89bc7fd7005 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:44:24.279663 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-0b756bfb-acf8-4535-ae7e-a311d9616edc req-d8f80b4b-d88d-4976-8910-d89bc7fd7005 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:44:24.280175 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-0b756bfb-acf8-4535-ae7e-a311d9616edc req-d8f80b4b-d88d-4976-8910-d89bc7fd7005 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:44:24.293372 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-0b756bfb-acf8-4535-ae7e-a311d9616edc req-d8f80b4b-d88d-4976-8910-d89bc7fd7005 service nova] Creating event network-vif-deleted:18ed8d86-6464-43d6-b7f1-eae0025337a5 for instance caf55729-5b90-40c7-8cf8-e14820b20573 on n-h1-836830-18 Sep 14 09:44:24.299739 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-0b756bfb-acf8-4535-ae7e-a311d9616edc req-d8f80b4b-d88d-4976-8910-d89bc7fd7005 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036240 Sep 14 09:44:24.300452 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3554/6878] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:44:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:44:24.669647 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-91380bd3-fa37-42e9-afa5-861b3d9742bc tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:44:24.670350 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-91380bd3-fa37-42e9-afa5-861b3d9742bc tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] [instance: caf55729-5b90-40c7-8cf8-e14820b20573] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:44:24.676600 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-91380bd3-fa37-42e9-afa5-861b3d9742bc tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:44:24.677079 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-91380bd3-fa37-42e9-afa5-861b3d9742bc tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:44:24.677520 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-91380bd3-fa37-42e9-afa5-861b3d9742bc tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:44:24.678208 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-91380bd3-fa37-42e9-afa5-861b3d9742bc tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:44:24.678662 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-91380bd3-fa37-42e9-afa5-861b3d9742bc tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:44:24.679119 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-91380bd3-fa37-42e9-afa5-861b3d9742bc tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:44:24.692936 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-91380bd3-fa37-42e9-afa5-861b3d9742bc tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] HTTP exception thrown: Instance caf55729-5b90-40c7-8cf8-e14820b20573 could not be found. Sep 14 09:44:24.694573 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-91380bd3-fa37-42e9-afa5-861b3d9742bc tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Request method failure captured: Sep 14 09:44:24.694573 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/caf55729-5b90-40c7-8cf8-e14820b20573 HTTP/1.1 Sep 14 09:44:24.694573 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:44:24.694573 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:44:24.694573 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:44:24.694573 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:44:24.694573 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:44:24.694573 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:44:24.694573 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:44:24.694573 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:44:24.694573 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIaIVL0gmRLbc38g-B4NMTKDeOE7ZuRcC_2Wy1KWBMw2eJqcdLD7d_A3eAC7UEiusxt7gutMBhMi8ouiPKv8WLjo9T5jRZB5hAUAt029LOMQ3JTY-aRAja6he-0f3-ZPJGFCvQRWOgqkmbJP8OE2LLnRkNATpAB4dvoGdxreWBfg6fyI Sep 14 09:44:24.694573 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:44:24.694573 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:44:24.694573 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:44:24.694573 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:44:24.694573 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:44:24.694573 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:44:24.694573 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: bf91d97eec8b46e2b1f07b6f39185030 Sep 14 09:44:24.694573 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ServerDiskConfigTestJSON-601880931 Sep 14 09:44:24.694573 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:44:24.694573 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:44:24.694573 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/bf91d97eec8b46e2b1f07b6f39185030"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_bf91d97eec8b46e2b1f07b6f39185030"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/bf91d97eec8b46e2b1f07b6f39185030"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/bf91d97eec8b46e2b1f07b6f39185030"}]}] Sep 14 09:44:24.694573 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ServerDiskConfigTestJSON-601880931 Sep 14 09:44:24.694573 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: bf91d97eec8b46e2b1f07b6f39185030 Sep 14 09:44:24.694573 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-601880931 Sep 14 09:44:24.694573 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ServerDiskConfigTestJSON-601880931-project Sep 14 09:44:24.694573 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:44:24.694573 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:44:24.694573 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 9068c0af1a7c48dab91c3ebf4ebd9148 Sep 14 09:44:24.694573 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ServerDiskConfigTestJSON-601880931-project Sep 14 09:44:24.694573 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:44:24.694573 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance caf55729-5b90-40c7-8cf8-e14820b20573 could not be found. Sep 14 09:44:24.694573 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': 'caf55729-5b90-40c7-8cf8-e14820b20573'} Sep 14 09:44:24.694573 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:44:24.694573 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:44:24.694573 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:44:24.694573 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:44:24.694573 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:44:24.694573 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:44:24.694573 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:44:24.694573 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:44:24.694573 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:44:24.694573 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:44:24.694573 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance caf55729-5b90-40c7-8cf8-e14820b20573 could not be found. Sep 14 09:44:24.694573 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:44:24.694573 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:44:24.694573 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:44:24.694573 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:44:24.694573 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:44:24.694573 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:44:24.694573 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:44:24.694573 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:44:24.694573 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:44:24.694573 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:44:24.694573 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:44:24.694573 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:44:24.694573 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:44:24.694573 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:44:24.694573 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:44:24.694573 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:44:24.694573 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance caf55729-5b90-40c7-8cf8-e14820b20573 could not be found. Sep 14 09:44:24.694573 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:44:24.694573 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:44:24.694573 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:44:24.699867 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:44:24.699867 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:44:24.699867 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:44:24.699867 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:44:24.699867 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:44:24.699867 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance caf55729-5b90-40c7-8cf8-e14820b20573 could not be found. Sep 14 09:44:24.699867 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:44:24.699867 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-91380bd3-fa37-42e9-afa5-861b3d9742bc tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Returning 404 to user: Instance caf55729-5b90-40c7-8cf8-e14820b20573 could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:44:24.699867 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-91380bd3-fa37-42e9-afa5-861b3d9742bc tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] 10.222.0.60 "GET /compute/v2.1/servers/caf55729-5b90-40c7-8cf8-e14820b20573" status: 404 len: 111 microversion: 2.1 time: 0.031799 Sep 14 09:44:24.699867 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3555/6879] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:44:24 2022] GET /compute/v2.1/servers/caf55729-5b90-40c7-8cf8-e14820b20573 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 14 09:44:24.704716 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-57a5f323-d8b3-4f1f-9f2a-ac709db53cec tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Calling method '.version_select at 0x7f7d3ee03dc0>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:44:24.724824 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-57a5f323-d8b3-4f1f-9f2a-ac709db53cec tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-394914941" status: 202 len: 0 microversion: 2.1 time: 0.023428 Sep 14 09:44:24.725412 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3556/6880] 10.222.0.60 () {58 vars in 1218 bytes} [Wed Sep 14 09:44:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-394914941 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 14 09:44:25.339064 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-90aed0fe-2e8c-4267-bb39-5e2568eb81a3 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:44:25.339860 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-90aed0fe-2e8c-4267-bb39-5e2568eb81a3 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] [instance: 65452924-da4a-4684-98ae-e88507c85e34] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:44:25.346819 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-90aed0fe-2e8c-4267-bb39-5e2568eb81a3 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:44:25.347348 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-90aed0fe-2e8c-4267-bb39-5e2568eb81a3 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:44:25.347795 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-90aed0fe-2e8c-4267-bb39-5e2568eb81a3 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:44:25.348499 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-90aed0fe-2e8c-4267-bb39-5e2568eb81a3 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:44:25.348964 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-90aed0fe-2e8c-4267-bb39-5e2568eb81a3 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:44:25.349399 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-90aed0fe-2e8c-4267-bb39-5e2568eb81a3 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:44:25.363424 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-90aed0fe-2e8c-4267-bb39-5e2568eb81a3 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] HTTP exception thrown: Instance 65452924-da4a-4684-98ae-e88507c85e34 could not be found. Sep 14 09:44:25.365050 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-90aed0fe-2e8c-4267-bb39-5e2568eb81a3 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Request method failure captured: Sep 14 09:44:25.365050 n-d-836830-18 devstack@n-api.service[128759]: request: DELETE /compute/v2.1/servers/65452924-da4a-4684-98ae-e88507c85e34 HTTP/1.1 Sep 14 09:44:25.365050 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:44:25.365050 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:44:25.365050 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:44:25.365050 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:44:25.365050 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:44:25.365050 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:44:25.365050 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:44:25.365050 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:44:25.365050 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIaIVL0gmRLbc38g-B4NMTKDeOE7ZuRcC_2Wy1KWBMw2eJqcdLD7d_A3eAC7UEiusxt7gutMBhMi8ouiPKv8WLjo9T5jRZB5hAUAt029LOMQ3JTY-aRAja6he-0f3-ZPJGFCvQRWOgqkmbJP8OE2LLnRkNATpAB4dvoGdxreWBfg6fyI Sep 14 09:44:25.365050 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:44:25.365050 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:44:25.365050 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:44:25.365050 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:44:25.365050 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:44:25.365050 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:44:25.365050 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: bf91d97eec8b46e2b1f07b6f39185030 Sep 14 09:44:25.365050 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ServerDiskConfigTestJSON-601880931 Sep 14 09:44:25.365050 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:44:25.365050 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:44:25.365050 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/bf91d97eec8b46e2b1f07b6f39185030"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_bf91d97eec8b46e2b1f07b6f39185030"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/bf91d97eec8b46e2b1f07b6f39185030"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/bf91d97eec8b46e2b1f07b6f39185030"}]}] Sep 14 09:44:25.365050 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ServerDiskConfigTestJSON-601880931 Sep 14 09:44:25.365050 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: bf91d97eec8b46e2b1f07b6f39185030 Sep 14 09:44:25.365050 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-601880931 Sep 14 09:44:25.365050 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ServerDiskConfigTestJSON-601880931-project Sep 14 09:44:25.365050 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:44:25.365050 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:44:25.365050 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 9068c0af1a7c48dab91c3ebf4ebd9148 Sep 14 09:44:25.365050 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ServerDiskConfigTestJSON-601880931-project Sep 14 09:44:25.365050 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:44:25.365050 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance 65452924-da4a-4684-98ae-e88507c85e34 could not be found. Sep 14 09:44:25.365050 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '65452924-da4a-4684-98ae-e88507c85e34'} Sep 14 09:44:25.365050 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:44:25.365050 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:44:25.365050 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:44:25.365050 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:44:25.365050 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:44:25.365050 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:44:25.365050 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:44:25.365050 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:44:25.365050 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:44:25.365050 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:44:25.365050 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65452924-da4a-4684-98ae-e88507c85e34 could not be found. Sep 14 09:44:25.365050 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:44:25.365050 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:44:25.365050 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:44:25.365050 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:44:25.365050 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:44:25.365050 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:44:25.365050 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:44:25.365050 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:44:25.365050 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:44:25.365050 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:44:25.365050 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 09:44:25.365050 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 09:44:25.365050 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 09:44:25.365050 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 09:44:25.365050 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:44:25.365050 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:44:25.365050 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:44:25.365050 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:44:25.372532 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65452924-da4a-4684-98ae-e88507c85e34 could not be found. Sep 14 09:44:25.372532 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:44:25.372532 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:44:25.372532 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:44:25.372532 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:44:25.372532 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:44:25.372532 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:44:25.372532 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:44:25.372532 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:44:25.372532 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65452924-da4a-4684-98ae-e88507c85e34 could not be found. Sep 14 09:44:25.372532 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:44:25.372532 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-90aed0fe-2e8c-4267-bb39-5e2568eb81a3 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Returning 404 to user: Instance 65452924-da4a-4684-98ae-e88507c85e34 could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:44:25.372532 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-90aed0fe-2e8c-4267-bb39-5e2568eb81a3 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] 10.222.0.60 "DELETE /compute/v2.1/servers/65452924-da4a-4684-98ae-e88507c85e34" status: 404 len: 111 microversion: 2.1 time: 0.032310 Sep 14 09:44:25.372532 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3557/6881] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:44:25 2022] DELETE /compute/v2.1/servers/65452924-da4a-4684-98ae-e88507c85e34 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 14 09:44:25.374867 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c4a3aa45-2abc-443e-b4e9-64517ae96482 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:44:25.375571 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-c4a3aa45-2abc-443e-b4e9-64517ae96482 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] [instance: 65452924-da4a-4684-98ae-e88507c85e34] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:44:25.381876 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c4a3aa45-2abc-443e-b4e9-64517ae96482 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:44:25.382364 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c4a3aa45-2abc-443e-b4e9-64517ae96482 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:44:25.382809 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c4a3aa45-2abc-443e-b4e9-64517ae96482 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:44:25.383799 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c4a3aa45-2abc-443e-b4e9-64517ae96482 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:44:25.384276 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c4a3aa45-2abc-443e-b4e9-64517ae96482 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:44:25.384708 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c4a3aa45-2abc-443e-b4e9-64517ae96482 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:44:25.397977 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-c4a3aa45-2abc-443e-b4e9-64517ae96482 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] HTTP exception thrown: Instance 65452924-da4a-4684-98ae-e88507c85e34 could not be found. Sep 14 09:44:25.399478 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c4a3aa45-2abc-443e-b4e9-64517ae96482 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Request method failure captured: Sep 14 09:44:25.399478 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/65452924-da4a-4684-98ae-e88507c85e34 HTTP/1.1 Sep 14 09:44:25.399478 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:44:25.399478 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:44:25.399478 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:44:25.399478 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:44:25.399478 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:44:25.399478 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:44:25.399478 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:44:25.399478 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:44:25.399478 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIaIVL0gmRLbc38g-B4NMTKDeOE7ZuRcC_2Wy1KWBMw2eJqcdLD7d_A3eAC7UEiusxt7gutMBhMi8ouiPKv8WLjo9T5jRZB5hAUAt029LOMQ3JTY-aRAja6he-0f3-ZPJGFCvQRWOgqkmbJP8OE2LLnRkNATpAB4dvoGdxreWBfg6fyI Sep 14 09:44:25.399478 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:44:25.399478 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:44:25.399478 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:44:25.399478 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:44:25.399478 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:44:25.399478 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:44:25.399478 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: bf91d97eec8b46e2b1f07b6f39185030 Sep 14 09:44:25.399478 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ServerDiskConfigTestJSON-601880931 Sep 14 09:44:25.399478 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:44:25.399478 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:44:25.399478 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/bf91d97eec8b46e2b1f07b6f39185030"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_bf91d97eec8b46e2b1f07b6f39185030"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/bf91d97eec8b46e2b1f07b6f39185030"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/bf91d97eec8b46e2b1f07b6f39185030"}]}] Sep 14 09:44:25.399478 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ServerDiskConfigTestJSON-601880931 Sep 14 09:44:25.399478 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: bf91d97eec8b46e2b1f07b6f39185030 Sep 14 09:44:25.399478 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-601880931 Sep 14 09:44:25.399478 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ServerDiskConfigTestJSON-601880931-project Sep 14 09:44:25.399478 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:44:25.399478 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:44:25.399478 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 9068c0af1a7c48dab91c3ebf4ebd9148 Sep 14 09:44:25.399478 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ServerDiskConfigTestJSON-601880931-project Sep 14 09:44:25.399478 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:44:25.399478 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance 65452924-da4a-4684-98ae-e88507c85e34 could not be found. Sep 14 09:44:25.399478 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '65452924-da4a-4684-98ae-e88507c85e34'} Sep 14 09:44:25.399478 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:44:25.399478 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:44:25.399478 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:44:25.399478 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:44:25.399478 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:44:25.399478 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:44:25.399478 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:44:25.399478 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:44:25.399478 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:44:25.399478 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:44:25.399478 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65452924-da4a-4684-98ae-e88507c85e34 could not be found. Sep 14 09:44:25.399478 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:44:25.399478 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:44:25.399478 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:44:25.399478 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:44:25.399478 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:44:25.399478 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:44:25.399478 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:44:25.399478 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:44:25.399478 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:44:25.399478 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:44:25.399478 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:44:25.399478 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:44:25.399478 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:44:25.399478 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:44:25.399478 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:44:25.399478 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:44:25.399478 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65452924-da4a-4684-98ae-e88507c85e34 could not be found. Sep 14 09:44:25.399478 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:44:25.399478 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:44:25.399478 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:44:25.404532 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:44:25.404532 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:44:25.404532 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:44:25.404532 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:44:25.404532 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:44:25.404532 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65452924-da4a-4684-98ae-e88507c85e34 could not be found. Sep 14 09:44:25.404532 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:44:25.404532 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c4a3aa45-2abc-443e-b4e9-64517ae96482 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] Returning 404 to user: Instance 65452924-da4a-4684-98ae-e88507c85e34 could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:44:25.404532 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-c4a3aa45-2abc-443e-b4e9-64517ae96482 tempest-ServerDiskConfigTestJSON-601880931 tempest-ServerDiskConfigTestJSON-601880931-project] 10.222.0.60 "GET /compute/v2.1/servers/65452924-da4a-4684-98ae-e88507c85e34" status: 404 len: 111 microversion: 2.1 time: 0.029682 Sep 14 09:44:25.404532 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3558/6882] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:44:25 2022] GET /compute/v2.1/servers/65452924-da4a-4684-98ae-e88507c85e34 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 14 09:44:34.015386 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-4b713383-556b-46e5-90d8-71e0c5dffe29 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Action: 'create', calling method: .version_select at 0x7f7d445cf1f0>, body: {"keypair": {"name": "tempest-keypair-254910026", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNLRDlA5GjtNxJctv/MG+9SzTD7Z/eWoyA7DFM2weVhvNXcPA3ERt5izGw0omDVIIh1yH1LuL98FDB7XuCGrasN2fE2Y3YyT/GVz/7NcOwZL10PLVHO10qhcR2ICoDvIow=="}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:44:34.031864 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-4b713383-556b-46e5-90d8-71e0c5dffe29 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Getting quotas for project 270f637ba197498bb4f7fa1ba14a62ad. Resources: {'key_pairs'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:44:34.036962 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-4b713383-556b-46e5-90d8-71e0c5dffe29 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Getting quotas for user 5de83b9937f145dbbe1091039327e71a and project 270f637ba197498bb4f7fa1ba14a62ad. Resources: {'key_pairs'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:44:34.061699 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-4b713383-556b-46e5-90d8-71e0c5dffe29 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.180512 Sep 14 09:44:34.062296 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3559/6883] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Sep 14 09:44:33 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:44:35.351836 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f3c90953-6898-43c2-9fad-d2b49ebded07 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-794312660", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5634288b-23f2-493a-aa6e-c62111a88261"}], "security_groups": [{"name": "tempest-securitygroup--438503213"}], "key_name": "tempest-keypair-254910026", "user_data": "}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:44:35.389885 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:44:35.475952 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.network.neutron [None req-f3c90953-6898-43c2-9fad-d2b49ebded07 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] validate_networks() for [('5634288b-23f2-493a-aa6e-c62111a88261', None, None, None, None, None)] {{(pid=128759) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:44:35.878906 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-f3c90953-6898-43c2-9fad-d2b49ebded07 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Flavor limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:44:35.879515 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-f3c90953-6898-43c2-9fad-d2b49ebded07 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Image limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:44:35.879999 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-f3c90953-6898-43c2-9fad-d2b49ebded07 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Flavor pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:44:35.880418 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-f3c90953-6898-43c2-9fad-d2b49ebded07 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Image pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:44:35.880838 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-f3c90953-6898-43c2-9fad-d2b49ebded07 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:44:35.890711 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f3c90953-6898-43c2-9fad-d2b49ebded07 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:44:35.891228 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f3c90953-6898-43c2-9fad-d2b49ebded07 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:44:35.891688 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f3c90953-6898-43c2-9fad-d2b49ebded07 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:44:35.892416 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f3c90953-6898-43c2-9fad-d2b49ebded07 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:44:35.892868 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f3c90953-6898-43c2-9fad-d2b49ebded07 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:44:35.893290 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f3c90953-6898-43c2-9fad-d2b49ebded07 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:44:35.910587 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-f3c90953-6898-43c2-9fad-d2b49ebded07 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Getting quotas for project 270f637ba197498bb4f7fa1ba14a62ad. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:44:35.915817 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-f3c90953-6898-43c2-9fad-d2b49ebded07 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Getting quotas for user 5de83b9937f145dbbe1091039327e71a and project 270f637ba197498bb4f7fa1ba14a62ad. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:44:35.928441 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f3c90953-6898-43c2-9fad-d2b49ebded07 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Going to run 1 instances... {{(pid=128759) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:44:35.930750 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f3c90953-6898-43c2-9fad-d2b49ebded07 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 1bc1a004-49b2-4b89-ba42-cddb661c7d94] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128759) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:44:35.978776 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f3c90953-6898-43c2-9fad-d2b49ebded07 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.632441 Sep 14 09:44:35.985693 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3560/6884] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 09:44:35 2022] POST /compute/v2.1/servers => generated 408 bytes in 634 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 14 09:44:35.991349 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-6fea79b9-4fae-4dfc-98c3-f1ac12380138 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:44:35.992048 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-6fea79b9-4fae-4dfc-98c3-f1ac12380138 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 1bc1a004-49b2-4b89-ba42-cddb661c7d94] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:44:35.995952 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:44:36.059157 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-6fea79b9-4fae-4dfc-98c3-f1ac12380138 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:44:36.069467 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-6fea79b9-4fae-4dfc-98c3-f1ac12380138 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/1bc1a004-49b2-4b89-ba42-cddb661c7d94" status: 200 len: 1237 microversion: 2.1 time: 0.081927 Sep 14 09:44:36.070631 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3561/6885] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:44:35 2022] GET /compute/v2.1/servers/1bc1a004-49b2-4b89-ba42-cddb661c7d94 => generated 1237 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:44:37.094792 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9ff0ee13-8bbf-45e0-9e2b-0dca04ec6fbd tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:44:37.096308 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-9ff0ee13-8bbf-45e0-9e2b-0dca04ec6fbd tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 1bc1a004-49b2-4b89-ba42-cddb661c7d94] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:44:37.104820 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9ff0ee13-8bbf-45e0-9e2b-0dca04ec6fbd tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:44:37.105786 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9ff0ee13-8bbf-45e0-9e2b-0dca04ec6fbd tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:44:37.106462 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9ff0ee13-8bbf-45e0-9e2b-0dca04ec6fbd tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:44:37.107531 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9ff0ee13-8bbf-45e0-9e2b-0dca04ec6fbd tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:44:37.108334 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9ff0ee13-8bbf-45e0-9e2b-0dca04ec6fbd tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:44:37.108981 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9ff0ee13-8bbf-45e0-9e2b-0dca04ec6fbd tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:44:37.186601 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-9ff0ee13-8bbf-45e0-9e2b-0dca04ec6fbd tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:44:37.195837 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-9ff0ee13-8bbf-45e0-9e2b-0dca04ec6fbd tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/1bc1a004-49b2-4b89-ba42-cddb661c7d94" status: 200 len: 1289 microversion: 2.1 time: 0.106485 Sep 14 09:44:37.196790 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3562/6886] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:44:37 2022] GET /compute/v2.1/servers/1bc1a004-49b2-4b89-ba42-cddb661c7d94 => generated 1289 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:44:38.221294 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-548481b4-4cc5-4f6d-b20b-d4b28f7cd861 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:44:38.221979 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-548481b4-4cc5-4f6d-b20b-d4b28f7cd861 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 1bc1a004-49b2-4b89-ba42-cddb661c7d94] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:44:38.229028 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-548481b4-4cc5-4f6d-b20b-d4b28f7cd861 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:44:38.229526 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-548481b4-4cc5-4f6d-b20b-d4b28f7cd861 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:44:38.229978 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-548481b4-4cc5-4f6d-b20b-d4b28f7cd861 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:44:38.230670 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-548481b4-4cc5-4f6d-b20b-d4b28f7cd861 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:44:38.231158 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-548481b4-4cc5-4f6d-b20b-d4b28f7cd861 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:44:38.231590 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-548481b4-4cc5-4f6d-b20b-d4b28f7cd861 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:44:38.373200 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-548481b4-4cc5-4f6d-b20b-d4b28f7cd861 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:44:38.381009 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-548481b4-4cc5-4f6d-b20b-d4b28f7cd861 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/1bc1a004-49b2-4b89-ba42-cddb661c7d94" status: 200 len: 1362 microversion: 2.1 time: 0.163917 Sep 14 09:44:38.381600 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3563/6887] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:44:38 2022] GET /compute/v2.1/servers/1bc1a004-49b2-4b89-ba42-cddb661c7d94 => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:44:38.793216 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-06526e9f-8a06-42b9-82b7-7f46235b90c7 req-a23ee1ff-c1ae-45ea-b5b4-7d4d4ab028f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1bc1a004-49b2-4b89-ba42-cddb661c7d94", "tag": "aebc8474-ddb8-44f8-bc3e-54a9f3d854ae"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:44:38.805093 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-06526e9f-8a06-42b9-82b7-7f46235b90c7 req-a23ee1ff-c1ae-45ea-b5b4-7d4d4ab028f6 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:44:38.805579 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-06526e9f-8a06-42b9-82b7-7f46235b90c7 req-a23ee1ff-c1ae-45ea-b5b4-7d4d4ab028f6 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:44:38.806009 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-06526e9f-8a06-42b9-82b7-7f46235b90c7 req-a23ee1ff-c1ae-45ea-b5b4-7d4d4ab028f6 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:44:38.820768 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-06526e9f-8a06-42b9-82b7-7f46235b90c7 req-a23ee1ff-c1ae-45ea-b5b4-7d4d4ab028f6 service nova] Creating event network-changed:aebc8474-ddb8-44f8-bc3e-54a9f3d854ae for instance 1bc1a004-49b2-4b89-ba42-cddb661c7d94 on n-h1-836830-18 Sep 14 09:44:38.827199 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-06526e9f-8a06-42b9-82b7-7f46235b90c7 req-a23ee1ff-c1ae-45ea-b5b4-7d4d4ab028f6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038531 Sep 14 09:44:38.828124 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3564/6888] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:44:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:44:39.406295 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c3f7769e-2ad9-4369-b2a3-d9320ee93090 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:44:39.406970 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-c3f7769e-2ad9-4369-b2a3-d9320ee93090 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 1bc1a004-49b2-4b89-ba42-cddb661c7d94] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:44:39.414727 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c3f7769e-2ad9-4369-b2a3-d9320ee93090 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:44:39.415250 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c3f7769e-2ad9-4369-b2a3-d9320ee93090 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:44:39.415730 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c3f7769e-2ad9-4369-b2a3-d9320ee93090 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:44:39.417007 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c3f7769e-2ad9-4369-b2a3-d9320ee93090 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:44:39.417472 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c3f7769e-2ad9-4369-b2a3-d9320ee93090 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:44:39.417905 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c3f7769e-2ad9-4369-b2a3-d9320ee93090 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:44:39.545790 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-c3f7769e-2ad9-4369-b2a3-d9320ee93090 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:44:39.553568 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-c3f7769e-2ad9-4369-b2a3-d9320ee93090 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/1bc1a004-49b2-4b89-ba42-cddb661c7d94" status: 200 len: 1362 microversion: 2.1 time: 0.152017 Sep 14 09:44:39.554149 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3565/6889] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:44:39 2022] GET /compute/v2.1/servers/1bc1a004-49b2-4b89-ba42-cddb661c7d94 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:44:40.576923 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-33af0c36-84eb-48f4-b5fb-361074277e6e tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:44:40.577545 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-33af0c36-84eb-48f4-b5fb-361074277e6e tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 1bc1a004-49b2-4b89-ba42-cddb661c7d94] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:44:40.584534 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-33af0c36-84eb-48f4-b5fb-361074277e6e tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:44:40.585024 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-33af0c36-84eb-48f4-b5fb-361074277e6e tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:44:40.585464 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-33af0c36-84eb-48f4-b5fb-361074277e6e tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:44:40.586159 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-33af0c36-84eb-48f4-b5fb-361074277e6e tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:44:40.586618 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-33af0c36-84eb-48f4-b5fb-361074277e6e tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:44:40.587089 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-33af0c36-84eb-48f4-b5fb-361074277e6e tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:44:40.721714 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-33af0c36-84eb-48f4-b5fb-361074277e6e tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:44:40.729388 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-33af0c36-84eb-48f4-b5fb-361074277e6e tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/1bc1a004-49b2-4b89-ba42-cddb661c7d94" status: 200 len: 1362 microversion: 2.1 time: 0.156927 Sep 14 09:44:40.729957 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3566/6890] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:44:40 2022] GET /compute/v2.1/servers/1bc1a004-49b2-4b89-ba42-cddb661c7d94 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:44:41.752024 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d55261ac-da46-4de8-89c8-3267ad5367fa tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:44:41.752676 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-d55261ac-da46-4de8-89c8-3267ad5367fa tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 1bc1a004-49b2-4b89-ba42-cddb661c7d94] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:44:41.759434 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d55261ac-da46-4de8-89c8-3267ad5367fa tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:44:41.759917 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d55261ac-da46-4de8-89c8-3267ad5367fa tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:44:41.760349 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d55261ac-da46-4de8-89c8-3267ad5367fa tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:44:41.761041 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d55261ac-da46-4de8-89c8-3267ad5367fa tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:44:41.761498 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d55261ac-da46-4de8-89c8-3267ad5367fa tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:44:41.761923 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d55261ac-da46-4de8-89c8-3267ad5367fa tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:44:41.889156 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-d55261ac-da46-4de8-89c8-3267ad5367fa tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:44:41.896791 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d55261ac-da46-4de8-89c8-3267ad5367fa tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/1bc1a004-49b2-4b89-ba42-cddb661c7d94" status: 200 len: 1362 microversion: 2.1 time: 0.148661 Sep 14 09:44:41.897357 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3567/6891] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:44:41 2022] GET /compute/v2.1/servers/1bc1a004-49b2-4b89-ba42-cddb661c7d94 => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:44:42.919862 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3c693357-cf5a-491f-b58d-6016f4547473 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:44:42.920491 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-3c693357-cf5a-491f-b58d-6016f4547473 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 1bc1a004-49b2-4b89-ba42-cddb661c7d94] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:44:42.927458 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3c693357-cf5a-491f-b58d-6016f4547473 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:44:42.927951 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3c693357-cf5a-491f-b58d-6016f4547473 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:44:42.928387 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3c693357-cf5a-491f-b58d-6016f4547473 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:44:42.929078 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3c693357-cf5a-491f-b58d-6016f4547473 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:44:42.929539 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3c693357-cf5a-491f-b58d-6016f4547473 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:44:42.929968 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3c693357-cf5a-491f-b58d-6016f4547473 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:44:43.061044 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-3c693357-cf5a-491f-b58d-6016f4547473 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:44:43.069022 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-3c693357-cf5a-491f-b58d-6016f4547473 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/1bc1a004-49b2-4b89-ba42-cddb661c7d94" status: 200 len: 1362 microversion: 2.1 time: 0.153068 Sep 14 09:44:43.069607 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3568/6892] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:44:42 2022] GET /compute/v2.1/servers/1bc1a004-49b2-4b89-ba42-cddb661c7d94 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:44:44.093287 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-06a6848e-f0bc-42da-9d16-41f5cf097141 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:44:44.094046 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-06a6848e-f0bc-42da-9d16-41f5cf097141 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 1bc1a004-49b2-4b89-ba42-cddb661c7d94] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:44:44.101148 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-06a6848e-f0bc-42da-9d16-41f5cf097141 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:44:44.101639 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-06a6848e-f0bc-42da-9d16-41f5cf097141 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:44:44.102080 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-06a6848e-f0bc-42da-9d16-41f5cf097141 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:44:44.102789 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-06a6848e-f0bc-42da-9d16-41f5cf097141 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:44:44.103280 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-06a6848e-f0bc-42da-9d16-41f5cf097141 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:44:44.104274 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-06a6848e-f0bc-42da-9d16-41f5cf097141 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:44:44.233019 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-06a6848e-f0bc-42da-9d16-41f5cf097141 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:44:44.240795 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-06a6848e-f0bc-42da-9d16-41f5cf097141 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/1bc1a004-49b2-4b89-ba42-cddb661c7d94" status: 200 len: 1362 microversion: 2.1 time: 0.151743 Sep 14 09:44:44.241377 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3569/6893] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:44:44 2022] GET /compute/v2.1/servers/1bc1a004-49b2-4b89-ba42-cddb661c7d94 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:44:45.263276 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-edf41c3a-29b8-4581-9da5-acedbcf0fa28 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:44:45.263926 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-edf41c3a-29b8-4581-9da5-acedbcf0fa28 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 1bc1a004-49b2-4b89-ba42-cddb661c7d94] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:44:45.270931 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-edf41c3a-29b8-4581-9da5-acedbcf0fa28 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:44:45.271459 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-edf41c3a-29b8-4581-9da5-acedbcf0fa28 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:44:45.271905 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-edf41c3a-29b8-4581-9da5-acedbcf0fa28 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:44:45.272607 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-edf41c3a-29b8-4581-9da5-acedbcf0fa28 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:44:45.273070 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-edf41c3a-29b8-4581-9da5-acedbcf0fa28 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:44:45.273506 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-edf41c3a-29b8-4581-9da5-acedbcf0fa28 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:44:45.405902 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-edf41c3a-29b8-4581-9da5-acedbcf0fa28 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:44:45.413694 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-edf41c3a-29b8-4581-9da5-acedbcf0fa28 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/1bc1a004-49b2-4b89-ba42-cddb661c7d94" status: 200 len: 1362 microversion: 2.1 time: 0.154381 Sep 14 09:44:45.414276 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3570/6894] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:44:45 2022] GET /compute/v2.1/servers/1bc1a004-49b2-4b89-ba42-cddb661c7d94 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:44:45.646846 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-7dce20eb-de87-4729-a90f-53f46d9243a9 req-d11c7b06-9e16-4023-aafe-8cb559c1f25b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bc1a004-49b2-4b89-ba42-cddb661c7d94", "name": "network-vif-plugged", "status": "completed", "tag": "aebc8474-ddb8-44f8-bc3e-54a9f3d854ae"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:44:45.657535 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-7dce20eb-de87-4729-a90f-53f46d9243a9 req-d11c7b06-9e16-4023-aafe-8cb559c1f25b service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:44:45.658034 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-7dce20eb-de87-4729-a90f-53f46d9243a9 req-d11c7b06-9e16-4023-aafe-8cb559c1f25b service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:44:45.658471 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-7dce20eb-de87-4729-a90f-53f46d9243a9 req-d11c7b06-9e16-4023-aafe-8cb559c1f25b service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:44:45.670365 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-7dce20eb-de87-4729-a90f-53f46d9243a9 req-d11c7b06-9e16-4023-aafe-8cb559c1f25b service nova] Creating event network-vif-plugged:aebc8474-ddb8-44f8-bc3e-54a9f3d854ae for instance 1bc1a004-49b2-4b89-ba42-cddb661c7d94 on n-h1-836830-18 Sep 14 09:44:45.675283 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-7dce20eb-de87-4729-a90f-53f46d9243a9 req-d11c7b06-9e16-4023-aafe-8cb559c1f25b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032236 Sep 14 09:44:45.675883 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3571/6895] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:44:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:44:46.433945 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=2 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:44:46.434776 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=12 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:44:46.439707 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-27e3be3e-c1a3-4aa4-9b38-06222a45bba9 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:44:46.440424 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-27e3be3e-c1a3-4aa4-9b38-06222a45bba9 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 1bc1a004-49b2-4b89-ba42-cddb661c7d94] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:44:46.447795 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-27e3be3e-c1a3-4aa4-9b38-06222a45bba9 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:44:46.448288 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-27e3be3e-c1a3-4aa4-9b38-06222a45bba9 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:44:46.448741 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-27e3be3e-c1a3-4aa4-9b38-06222a45bba9 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:44:46.449436 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-27e3be3e-c1a3-4aa4-9b38-06222a45bba9 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:44:46.449897 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-27e3be3e-c1a3-4aa4-9b38-06222a45bba9 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:44:46.450330 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-27e3be3e-c1a3-4aa4-9b38-06222a45bba9 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:44:46.596941 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-27e3be3e-c1a3-4aa4-9b38-06222a45bba9 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:44:46.604971 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-27e3be3e-c1a3-4aa4-9b38-06222a45bba9 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/1bc1a004-49b2-4b89-ba42-cddb661c7d94" status: 200 len: 1362 microversion: 2.1 time: 0.171962 Sep 14 09:44:46.605555 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3572/6896] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:44:46 2022] GET /compute/v2.1/servers/1bc1a004-49b2-4b89-ba42-cddb661c7d94 => generated 1362 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:44:47.626907 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9c4b6ed1-25e8-4697-a09c-545e2ba8b931 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:44:47.627793 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-9c4b6ed1-25e8-4697-a09c-545e2ba8b931 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 1bc1a004-49b2-4b89-ba42-cddb661c7d94] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:44:47.635888 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9c4b6ed1-25e8-4697-a09c-545e2ba8b931 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:44:47.636513 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9c4b6ed1-25e8-4697-a09c-545e2ba8b931 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:44:47.637009 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9c4b6ed1-25e8-4697-a09c-545e2ba8b931 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:44:47.637838 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9c4b6ed1-25e8-4697-a09c-545e2ba8b931 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:44:47.638378 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9c4b6ed1-25e8-4697-a09c-545e2ba8b931 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:44:47.638898 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9c4b6ed1-25e8-4697-a09c-545e2ba8b931 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:44:47.767834 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-9c4b6ed1-25e8-4697-a09c-545e2ba8b931 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:44:47.776169 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-9c4b6ed1-25e8-4697-a09c-545e2ba8b931 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/1bc1a004-49b2-4b89-ba42-cddb661c7d94" status: 200 len: 1548 microversion: 2.1 time: 0.152687 Sep 14 09:44:47.776744 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3573/6897] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:44:47 2022] GET /compute/v2.1/servers/1bc1a004-49b2-4b89-ba42-cddb661c7d94 => generated 1548 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:44:47.798844 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-003fbf27-729b-4f94-9ac2-8820f89d1ebf tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:44:47.799382 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-003fbf27-729b-4f94-9ac2-8820f89d1ebf tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 1bc1a004-49b2-4b89-ba42-cddb661c7d94] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:44:47.805268 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-003fbf27-729b-4f94-9ac2-8820f89d1ebf tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:44:47.805761 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-003fbf27-729b-4f94-9ac2-8820f89d1ebf tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:44:47.806207 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-003fbf27-729b-4f94-9ac2-8820f89d1ebf tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:44:47.806906 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-003fbf27-729b-4f94-9ac2-8820f89d1ebf tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:44:47.807401 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-003fbf27-729b-4f94-9ac2-8820f89d1ebf tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:44:47.807832 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-003fbf27-729b-4f94-9ac2-8820f89d1ebf tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:44:47.891631 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-003fbf27-729b-4f94-9ac2-8820f89d1ebf tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/1bc1a004-49b2-4b89-ba42-cddb661c7d94/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096407 Sep 14 09:44:47.892231 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3574/6898] 10.222.0.60 () {58 vars in 1275 bytes} [Wed Sep 14 09:44:47 2022] GET /compute/v2.1/servers/1bc1a004-49b2-4b89-ba42-cddb661c7d94/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:44:49.065686 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-faabbed4-44af-45ea-89c0-947fed6d072d req-1b0d949f-887e-4298-a4d1-a418d13c9517 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1bc1a004-49b2-4b89-ba42-cddb661c7d94", "tag": "aebc8474-ddb8-44f8-bc3e-54a9f3d854ae"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:44:49.075628 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-faabbed4-44af-45ea-89c0-947fed6d072d req-1b0d949f-887e-4298-a4d1-a418d13c9517 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:44:49.076195 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-faabbed4-44af-45ea-89c0-947fed6d072d req-1b0d949f-887e-4298-a4d1-a418d13c9517 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:44:49.076839 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-faabbed4-44af-45ea-89c0-947fed6d072d req-1b0d949f-887e-4298-a4d1-a418d13c9517 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:44:49.089954 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-faabbed4-44af-45ea-89c0-947fed6d072d req-1b0d949f-887e-4298-a4d1-a418d13c9517 service nova] Creating event network-changed:aebc8474-ddb8-44f8-bc3e-54a9f3d854ae for instance 1bc1a004-49b2-4b89-ba42-cddb661c7d94 on n-h1-836830-18 Sep 14 09:44:49.095092 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-faabbed4-44af-45ea-89c0-947fed6d072d req-1b0d949f-887e-4298-a4d1-a418d13c9517 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034033 Sep 14 09:44:49.095802 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3575/6899] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:44:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:45:53.824073 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=30 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:45:53.824736 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=72 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:45:53.829864 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-5baaca70-5175-42b2-a989-c91e84db1da9 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:45:53.830612 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-5baaca70-5175-42b2-a989-c91e84db1da9 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 1bc1a004-49b2-4b89-ba42-cddb661c7d94] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:45:53.837885 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5baaca70-5175-42b2-a989-c91e84db1da9 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:45:53.838383 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5baaca70-5175-42b2-a989-c91e84db1da9 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:45:53.838829 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5baaca70-5175-42b2-a989-c91e84db1da9 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:45:53.839569 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5baaca70-5175-42b2-a989-c91e84db1da9 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:45:53.840031 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5baaca70-5175-42b2-a989-c91e84db1da9 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:45:53.840777 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5baaca70-5175-42b2-a989-c91e84db1da9 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:45:53.974302 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-5baaca70-5175-42b2-a989-c91e84db1da9 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:45:53.982702 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-5baaca70-5175-42b2-a989-c91e84db1da9 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/1bc1a004-49b2-4b89-ba42-cddb661c7d94" status: 200 len: 1666 microversion: 2.1 time: 0.161096 Sep 14 09:45:53.983317 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3576/6900] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:45:53 2022] GET /compute/v2.1/servers/1bc1a004-49b2-4b89-ba42-cddb661c7d94 => generated 1666 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:45:54.005043 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-abea6381-6b70-4a2b-9ebf-50a01ca71c77 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:45:54.005665 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-abea6381-6b70-4a2b-9ebf-50a01ca71c77 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 1bc1a004-49b2-4b89-ba42-cddb661c7d94] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:45:54.011481 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-abea6381-6b70-4a2b-9ebf-50a01ca71c77 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:45:54.011957 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-abea6381-6b70-4a2b-9ebf-50a01ca71c77 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:45:54.012401 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-abea6381-6b70-4a2b-9ebf-50a01ca71c77 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:45:54.013100 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-abea6381-6b70-4a2b-9ebf-50a01ca71c77 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:45:54.013566 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-abea6381-6b70-4a2b-9ebf-50a01ca71c77 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:45:54.013995 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-abea6381-6b70-4a2b-9ebf-50a01ca71c77 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:45:54.146173 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-abea6381-6b70-4a2b-9ebf-50a01ca71c77 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:45:54.154043 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-abea6381-6b70-4a2b-9ebf-50a01ca71c77 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/1bc1a004-49b2-4b89-ba42-cddb661c7d94" status: 200 len: 1666 microversion: 2.1 time: 0.152661 Sep 14 09:45:54.154624 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3577/6901] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:45:54 2022] GET /compute/v2.1/servers/1bc1a004-49b2-4b89-ba42-cddb661c7d94 => generated 1666 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:45:54.176168 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-804efb03-ae65-473f-90bb-3df7838ebef5 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:45:54.176787 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-804efb03-ae65-473f-90bb-3df7838ebef5 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 1bc1a004-49b2-4b89-ba42-cddb661c7d94] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:45:54.182499 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-804efb03-ae65-473f-90bb-3df7838ebef5 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:45:54.183026 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-804efb03-ae65-473f-90bb-3df7838ebef5 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:45:54.183474 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-804efb03-ae65-473f-90bb-3df7838ebef5 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:45:54.184168 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-804efb03-ae65-473f-90bb-3df7838ebef5 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:45:54.185237 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-804efb03-ae65-473f-90bb-3df7838ebef5 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:45:54.185669 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-804efb03-ae65-473f-90bb-3df7838ebef5 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:45:54.316358 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-804efb03-ae65-473f-90bb-3df7838ebef5 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:45:54.324100 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-804efb03-ae65-473f-90bb-3df7838ebef5 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/1bc1a004-49b2-4b89-ba42-cddb661c7d94" status: 200 len: 1666 microversion: 2.1 time: 0.151498 Sep 14 09:45:54.324693 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3578/6902] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:45:54 2022] GET /compute/v2.1/servers/1bc1a004-49b2-4b89-ba42-cddb661c7d94 => generated 1666 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:45:54.346678 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-cdcb0f67-fbcb-4467-adbd-ac195816ab0a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:45:54.348959 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-cdcb0f67-fbcb-4467-adbd-ac195816ab0a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 1bc1a004-49b2-4b89-ba42-cddb661c7d94] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:45:54.354779 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cdcb0f67-fbcb-4467-adbd-ac195816ab0a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:45:54.355310 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cdcb0f67-fbcb-4467-adbd-ac195816ab0a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:45:54.355760 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cdcb0f67-fbcb-4467-adbd-ac195816ab0a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:45:54.357299 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cdcb0f67-fbcb-4467-adbd-ac195816ab0a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:45:54.357927 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cdcb0f67-fbcb-4467-adbd-ac195816ab0a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:45:54.358367 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cdcb0f67-fbcb-4467-adbd-ac195816ab0a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:45:54.388871 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-cdcb0f67-fbcb-4467-adbd-ac195816ab0a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:45:54.394251 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-cdcb0f67-fbcb-4467-adbd-ac195816ab0a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 1bc1a004-49b2-4b89-ba42-cddb661c7d94] Old instance type m1.heat2, new instance type m1.heat {{(pid=128759) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 14 09:45:54.400770 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-cdcb0f67-fbcb-4467-adbd-ac195816ab0a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Flavor limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:45:54.401202 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-cdcb0f67-fbcb-4467-adbd-ac195816ab0a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Image limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:45:54.401686 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-cdcb0f67-fbcb-4467-adbd-ac195816ab0a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Flavor pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:45:54.402104 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-cdcb0f67-fbcb-4467-adbd-ac195816ab0a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Image pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:45:54.402529 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-cdcb0f67-fbcb-4467-adbd-ac195816ab0a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:45:54.469371 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-cdcb0f67-fbcb-4467-adbd-ac195816ab0a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "POST /compute/v2.1/servers/1bc1a004-49b2-4b89-ba42-cddb661c7d94/action" status: 202 len: 0 microversion: 2.1 time: 0.126161 Sep 14 09:45:54.470001 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3579/6903] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:45:54 2022] POST /compute/v2.1/servers/1bc1a004-49b2-4b89-ba42-cddb661c7d94/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 14 09:45:54.477735 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e1d5a83b-adfe-4812-a5b1-bc4fa1779e83 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:45:54.478374 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e1d5a83b-adfe-4812-a5b1-bc4fa1779e83 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 1bc1a004-49b2-4b89-ba42-cddb661c7d94] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:45:54.485094 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e1d5a83b-adfe-4812-a5b1-bc4fa1779e83 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:45:54.485668 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e1d5a83b-adfe-4812-a5b1-bc4fa1779e83 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:45:54.486105 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e1d5a83b-adfe-4812-a5b1-bc4fa1779e83 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:45:54.486847 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e1d5a83b-adfe-4812-a5b1-bc4fa1779e83 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:45:54.487332 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e1d5a83b-adfe-4812-a5b1-bc4fa1779e83 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:45:54.487764 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e1d5a83b-adfe-4812-a5b1-bc4fa1779e83 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:45:54.623386 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-e1d5a83b-adfe-4812-a5b1-bc4fa1779e83 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:45:54.631634 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e1d5a83b-adfe-4812-a5b1-bc4fa1779e83 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/1bc1a004-49b2-4b89-ba42-cddb661c7d94" status: 200 len: 1675 microversion: 2.1 time: 0.157578 Sep 14 09:45:54.632208 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3580/6904] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:45:54 2022] GET /compute/v2.1/servers/1bc1a004-49b2-4b89-ba42-cddb661c7d94 => generated 1675 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:45:55.656030 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-caad1647-c100-4603-9810-1c2946ed6349 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:45:55.656729 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-caad1647-c100-4603-9810-1c2946ed6349 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 1bc1a004-49b2-4b89-ba42-cddb661c7d94] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:45:55.663878 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-caad1647-c100-4603-9810-1c2946ed6349 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:45:55.664366 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-caad1647-c100-4603-9810-1c2946ed6349 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:45:55.664809 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-caad1647-c100-4603-9810-1c2946ed6349 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:45:55.665684 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-caad1647-c100-4603-9810-1c2946ed6349 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:45:55.666152 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-caad1647-c100-4603-9810-1c2946ed6349 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:45:55.666579 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-caad1647-c100-4603-9810-1c2946ed6349 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:45:55.802852 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-caad1647-c100-4603-9810-1c2946ed6349 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:45:55.811462 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-caad1647-c100-4603-9810-1c2946ed6349 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/1bc1a004-49b2-4b89-ba42-cddb661c7d94" status: 200 len: 1675 microversion: 2.1 time: 0.160142 Sep 14 09:45:55.812141 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3581/6905] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:45:55 2022] GET /compute/v2.1/servers/1bc1a004-49b2-4b89-ba42-cddb661c7d94 => generated 1675 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:45:56.835546 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-85a8d187-4f8b-4c98-b6a4-ee175f89e7a2 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:45:56.836271 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-85a8d187-4f8b-4c98-b6a4-ee175f89e7a2 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 1bc1a004-49b2-4b89-ba42-cddb661c7d94] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:45:56.844028 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-85a8d187-4f8b-4c98-b6a4-ee175f89e7a2 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:45:56.844529 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-85a8d187-4f8b-4c98-b6a4-ee175f89e7a2 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:45:56.844957 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-85a8d187-4f8b-4c98-b6a4-ee175f89e7a2 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:45:56.845678 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-85a8d187-4f8b-4c98-b6a4-ee175f89e7a2 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:45:56.846126 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-85a8d187-4f8b-4c98-b6a4-ee175f89e7a2 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:45:56.846564 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-85a8d187-4f8b-4c98-b6a4-ee175f89e7a2 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:45:56.975204 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-85a8d187-4f8b-4c98-b6a4-ee175f89e7a2 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:45:56.983093 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-85a8d187-4f8b-4c98-b6a4-ee175f89e7a2 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/1bc1a004-49b2-4b89-ba42-cddb661c7d94" status: 200 len: 1680 microversion: 2.1 time: 0.151479 Sep 14 09:45:56.983700 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3582/6906] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:45:56 2022] GET /compute/v2.1/servers/1bc1a004-49b2-4b89-ba42-cddb661c7d94 => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:45:58.007394 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3a3a52f9-d602-4745-89b1-011e86218b3a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:45:58.008030 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-3a3a52f9-d602-4745-89b1-011e86218b3a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 1bc1a004-49b2-4b89-ba42-cddb661c7d94] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:45:58.014908 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3a3a52f9-d602-4745-89b1-011e86218b3a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:45:58.015425 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3a3a52f9-d602-4745-89b1-011e86218b3a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:45:58.015869 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3a3a52f9-d602-4745-89b1-011e86218b3a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:45:58.016561 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3a3a52f9-d602-4745-89b1-011e86218b3a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:45:58.017022 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3a3a52f9-d602-4745-89b1-011e86218b3a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:45:58.017449 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3a3a52f9-d602-4745-89b1-011e86218b3a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:45:58.148724 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-3a3a52f9-d602-4745-89b1-011e86218b3a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:45:58.163058 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-3a3a52f9-d602-4745-89b1-011e86218b3a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/1bc1a004-49b2-4b89-ba42-cddb661c7d94" status: 200 len: 1680 microversion: 2.1 time: 0.159630 Sep 14 09:45:58.163704 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3583/6907] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:45:58 2022] GET /compute/v2.1/servers/1bc1a004-49b2-4b89-ba42-cddb661c7d94 => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:45:59.187559 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a3f5e5c0-7dfe-4ed5-bf22-e45277e6a571 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:45:59.188186 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-a3f5e5c0-7dfe-4ed5-bf22-e45277e6a571 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 1bc1a004-49b2-4b89-ba42-cddb661c7d94] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:45:59.195052 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a3f5e5c0-7dfe-4ed5-bf22-e45277e6a571 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:45:59.195544 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a3f5e5c0-7dfe-4ed5-bf22-e45277e6a571 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:45:59.195990 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a3f5e5c0-7dfe-4ed5-bf22-e45277e6a571 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:45:59.196690 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a3f5e5c0-7dfe-4ed5-bf22-e45277e6a571 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:45:59.197153 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a3f5e5c0-7dfe-4ed5-bf22-e45277e6a571 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:45:59.197586 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a3f5e5c0-7dfe-4ed5-bf22-e45277e6a571 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:45:59.329759 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-a3f5e5c0-7dfe-4ed5-bf22-e45277e6a571 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:45:59.337519 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a3f5e5c0-7dfe-4ed5-bf22-e45277e6a571 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/1bc1a004-49b2-4b89-ba42-cddb661c7d94" status: 200 len: 1680 microversion: 2.1 time: 0.154673 Sep 14 09:45:59.338096 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3584/6908] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:45:59 2022] GET /compute/v2.1/servers/1bc1a004-49b2-4b89-ba42-cddb661c7d94 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:46:00.361117 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-1912cd2a-908c-4eff-b4f2-205ccdf767d0 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:46:00.361784 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-1912cd2a-908c-4eff-b4f2-205ccdf767d0 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 1bc1a004-49b2-4b89-ba42-cddb661c7d94] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:46:00.368641 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1912cd2a-908c-4eff-b4f2-205ccdf767d0 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:00.369140 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1912cd2a-908c-4eff-b4f2-205ccdf767d0 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:00.369586 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1912cd2a-908c-4eff-b4f2-205ccdf767d0 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:00.370282 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1912cd2a-908c-4eff-b4f2-205ccdf767d0 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:00.370747 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1912cd2a-908c-4eff-b4f2-205ccdf767d0 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:00.371209 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1912cd2a-908c-4eff-b4f2-205ccdf767d0 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:00.501790 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-1912cd2a-908c-4eff-b4f2-205ccdf767d0 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:46:00.509666 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-1912cd2a-908c-4eff-b4f2-205ccdf767d0 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/1bc1a004-49b2-4b89-ba42-cddb661c7d94" status: 200 len: 1680 microversion: 2.1 time: 0.152509 Sep 14 09:46:00.510243 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3585/6909] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:46:00 2022] GET /compute/v2.1/servers/1bc1a004-49b2-4b89-ba42-cddb661c7d94 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:46:01.533998 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-db203ce4-6509-4102-a658-b69a37e019bc tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:46:01.534671 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-db203ce4-6509-4102-a658-b69a37e019bc tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 1bc1a004-49b2-4b89-ba42-cddb661c7d94] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:46:01.541420 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-db203ce4-6509-4102-a658-b69a37e019bc tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:01.541910 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-db203ce4-6509-4102-a658-b69a37e019bc tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:01.542353 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-db203ce4-6509-4102-a658-b69a37e019bc tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:01.543070 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-db203ce4-6509-4102-a658-b69a37e019bc tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:01.543533 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-db203ce4-6509-4102-a658-b69a37e019bc tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:01.543961 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-db203ce4-6509-4102-a658-b69a37e019bc tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:01.680128 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-db203ce4-6509-4102-a658-b69a37e019bc tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:46:01.687951 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-db203ce4-6509-4102-a658-b69a37e019bc tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/1bc1a004-49b2-4b89-ba42-cddb661c7d94" status: 200 len: 1680 microversion: 2.1 time: 0.158059 Sep 14 09:46:01.688532 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3586/6910] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:46:01 2022] GET /compute/v2.1/servers/1bc1a004-49b2-4b89-ba42-cddb661c7d94 => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:46:02.310577 n-d-836830-18 devstack@n-api.service[128758]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 09:46:02.311191 n-d-836830-18 devstack@n-api.service[128758]: Wed Sep 14 09:46:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.60) !!! Sep 14 09:46:02.316056 n-d-836830-18 devstack@n-api.service[128758]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 09:46:02.316173 n-d-836830-18 devstack@n-api.service[128758]: Wed Sep 14 09:46:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.60) !!! Sep 14 09:46:02.710853 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-77be9e37-9fa2-4f2c-a4e0-fbc490c0d676 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:46:02.711511 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-77be9e37-9fa2-4f2c-a4e0-fbc490c0d676 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 1bc1a004-49b2-4b89-ba42-cddb661c7d94] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:46:02.719248 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-77be9e37-9fa2-4f2c-a4e0-fbc490c0d676 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:02.719742 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-77be9e37-9fa2-4f2c-a4e0-fbc490c0d676 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:02.720187 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-77be9e37-9fa2-4f2c-a4e0-fbc490c0d676 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:02.720912 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-77be9e37-9fa2-4f2c-a4e0-fbc490c0d676 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:02.721373 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-77be9e37-9fa2-4f2c-a4e0-fbc490c0d676 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:02.721803 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-77be9e37-9fa2-4f2c-a4e0-fbc490c0d676 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:02.851383 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-77be9e37-9fa2-4f2c-a4e0-fbc490c0d676 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:46:02.859716 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-77be9e37-9fa2-4f2c-a4e0-fbc490c0d676 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/1bc1a004-49b2-4b89-ba42-cddb661c7d94" status: 200 len: 1680 microversion: 2.1 time: 0.152834 Sep 14 09:46:02.860289 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3587/6911] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:46:02 2022] GET /compute/v2.1/servers/1bc1a004-49b2-4b89-ba42-cddb661c7d94 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:46:03.883083 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-64c1f7c4-4895-4f58-9af3-b741e8259ddd tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:46:03.883703 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-64c1f7c4-4895-4f58-9af3-b741e8259ddd tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 1bc1a004-49b2-4b89-ba42-cddb661c7d94] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:46:03.890680 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-64c1f7c4-4895-4f58-9af3-b741e8259ddd tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:03.891210 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-64c1f7c4-4895-4f58-9af3-b741e8259ddd tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:03.891653 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-64c1f7c4-4895-4f58-9af3-b741e8259ddd tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:03.892345 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-64c1f7c4-4895-4f58-9af3-b741e8259ddd tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:03.892806 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-64c1f7c4-4895-4f58-9af3-b741e8259ddd tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:03.893235 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-64c1f7c4-4895-4f58-9af3-b741e8259ddd tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:04.026162 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-64c1f7c4-4895-4f58-9af3-b741e8259ddd tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:46:04.033908 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-64c1f7c4-4895-4f58-9af3-b741e8259ddd tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/1bc1a004-49b2-4b89-ba42-cddb661c7d94" status: 200 len: 1680 microversion: 2.1 time: 0.154952 Sep 14 09:46:04.034490 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3588/6912] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:46:03 2022] GET /compute/v2.1/servers/1bc1a004-49b2-4b89-ba42-cddb661c7d94 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:46:05.056895 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b7493ad1-b3b6-408f-a767-1ae2db41542a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:46:05.057549 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b7493ad1-b3b6-408f-a767-1ae2db41542a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 1bc1a004-49b2-4b89-ba42-cddb661c7d94] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:46:05.064497 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b7493ad1-b3b6-408f-a767-1ae2db41542a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:05.064990 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b7493ad1-b3b6-408f-a767-1ae2db41542a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:05.065434 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b7493ad1-b3b6-408f-a767-1ae2db41542a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:05.066126 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b7493ad1-b3b6-408f-a767-1ae2db41542a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:05.066585 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b7493ad1-b3b6-408f-a767-1ae2db41542a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:05.067040 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b7493ad1-b3b6-408f-a767-1ae2db41542a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:05.196825 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b7493ad1-b3b6-408f-a767-1ae2db41542a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:46:05.205099 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b7493ad1-b3b6-408f-a767-1ae2db41542a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/1bc1a004-49b2-4b89-ba42-cddb661c7d94" status: 200 len: 1680 microversion: 2.1 time: 0.152177 Sep 14 09:46:05.205676 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3589/6913] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:46:05 2022] GET /compute/v2.1/servers/1bc1a004-49b2-4b89-ba42-cddb661c7d94 => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:46:06.228958 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-93772ce9-c48e-47f1-a6c0-b25c460497a1 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:46:06.229588 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-93772ce9-c48e-47f1-a6c0-b25c460497a1 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 1bc1a004-49b2-4b89-ba42-cddb661c7d94] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:46:06.237060 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-93772ce9-c48e-47f1-a6c0-b25c460497a1 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:06.237551 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-93772ce9-c48e-47f1-a6c0-b25c460497a1 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:06.237994 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-93772ce9-c48e-47f1-a6c0-b25c460497a1 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:06.238740 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-93772ce9-c48e-47f1-a6c0-b25c460497a1 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:06.239216 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-93772ce9-c48e-47f1-a6c0-b25c460497a1 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:06.239650 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-93772ce9-c48e-47f1-a6c0-b25c460497a1 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:06.372873 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-93772ce9-c48e-47f1-a6c0-b25c460497a1 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:46:06.380678 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-93772ce9-c48e-47f1-a6c0-b25c460497a1 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/1bc1a004-49b2-4b89-ba42-cddb661c7d94" status: 200 len: 1680 microversion: 2.1 time: 0.155813 Sep 14 09:46:06.381270 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3590/6914] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:46:06 2022] GET /compute/v2.1/servers/1bc1a004-49b2-4b89-ba42-cddb661c7d94 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:46:07.403671 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d3a82806-be54-40e8-8b9b-ab091182733b tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:46:07.404301 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-d3a82806-be54-40e8-8b9b-ab091182733b tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 1bc1a004-49b2-4b89-ba42-cddb661c7d94] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:46:07.411409 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d3a82806-be54-40e8-8b9b-ab091182733b tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:07.411897 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d3a82806-be54-40e8-8b9b-ab091182733b tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:07.412334 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d3a82806-be54-40e8-8b9b-ab091182733b tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:07.413026 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d3a82806-be54-40e8-8b9b-ab091182733b tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:07.413485 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d3a82806-be54-40e8-8b9b-ab091182733b tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:07.413912 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d3a82806-be54-40e8-8b9b-ab091182733b tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:07.417937 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:46:07.549076 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-d3a82806-be54-40e8-8b9b-ab091182733b tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:46:07.556831 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d3a82806-be54-40e8-8b9b-ab091182733b tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/1bc1a004-49b2-4b89-ba42-cddb661c7d94" status: 200 len: 1680 microversion: 2.1 time: 0.157150 Sep 14 09:46:07.557623 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3591/6915] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:46:07 2022] GET /compute/v2.1/servers/1bc1a004-49b2-4b89-ba42-cddb661c7d94 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:46:08.581288 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e4c9a76e-ddfe-4884-932c-a72e80da3d00 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:46:08.581934 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e4c9a76e-ddfe-4884-932c-a72e80da3d00 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 1bc1a004-49b2-4b89-ba42-cddb661c7d94] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:46:08.588713 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e4c9a76e-ddfe-4884-932c-a72e80da3d00 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:08.589200 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e4c9a76e-ddfe-4884-932c-a72e80da3d00 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:08.589641 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e4c9a76e-ddfe-4884-932c-a72e80da3d00 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:08.590329 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e4c9a76e-ddfe-4884-932c-a72e80da3d00 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:08.591325 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e4c9a76e-ddfe-4884-932c-a72e80da3d00 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:08.591749 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e4c9a76e-ddfe-4884-932c-a72e80da3d00 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:08.728195 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-e4c9a76e-ddfe-4884-932c-a72e80da3d00 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:46:08.737016 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e4c9a76e-ddfe-4884-932c-a72e80da3d00 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/1bc1a004-49b2-4b89-ba42-cddb661c7d94" status: 200 len: 1680 microversion: 2.1 time: 0.159875 Sep 14 09:46:08.737607 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3592/6916] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:46:08 2022] GET /compute/v2.1/servers/1bc1a004-49b2-4b89-ba42-cddb661c7d94 => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:46:09.180251 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-580fd616-548c-47cb-bea6-4f467ac62f38 req-d830d389-2276-4a70-8fbe-daf6cae603c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bc1a004-49b2-4b89-ba42-cddb661c7d94", "name": "network-vif-unplugged", "status": "completed", "tag": "aebc8474-ddb8-44f8-bc3e-54a9f3d854ae"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:46:09.190377 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-580fd616-548c-47cb-bea6-4f467ac62f38 req-d830d389-2276-4a70-8fbe-daf6cae603c4 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:09.190874 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-580fd616-548c-47cb-bea6-4f467ac62f38 req-d830d389-2276-4a70-8fbe-daf6cae603c4 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:09.191338 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-580fd616-548c-47cb-bea6-4f467ac62f38 req-d830d389-2276-4a70-8fbe-daf6cae603c4 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:09.205340 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-580fd616-548c-47cb-bea6-4f467ac62f38 req-d830d389-2276-4a70-8fbe-daf6cae603c4 service nova] Creating event network-vif-unplugged:aebc8474-ddb8-44f8-bc3e-54a9f3d854ae for instance 1bc1a004-49b2-4b89-ba42-cddb661c7d94 on n-h2-836830-18 Sep 14 09:46:09.210687 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [req-580fd616-548c-47cb-bea6-4f467ac62f38 req-d830d389-2276-4a70-8fbe-daf6cae603c4 service nova] Instance 1bc1a004-49b2-4b89-ba42-cddb661c7d94 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-836830-18', 'n-h2-836830-18'} {{(pid=128759) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 14 09:46:09.223056 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-580fd616-548c-47cb-bea6-4f467ac62f38 req-d830d389-2276-4a70-8fbe-daf6cae603c4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047351 Sep 14 09:46:09.224041 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3593/6917] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:46:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:46:09.762009 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-491d11c5-1d5e-423c-8deb-5d7ca8463875 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:46:09.762715 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-491d11c5-1d5e-423c-8deb-5d7ca8463875 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 1bc1a004-49b2-4b89-ba42-cddb661c7d94] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:46:09.768924 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-491d11c5-1d5e-423c-8deb-5d7ca8463875 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:09.769419 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-491d11c5-1d5e-423c-8deb-5d7ca8463875 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:09.769864 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-491d11c5-1d5e-423c-8deb-5d7ca8463875 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:09.770559 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-491d11c5-1d5e-423c-8deb-5d7ca8463875 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:09.771049 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-491d11c5-1d5e-423c-8deb-5d7ca8463875 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:09.771485 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-491d11c5-1d5e-423c-8deb-5d7ca8463875 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:09.906386 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-491d11c5-1d5e-423c-8deb-5d7ca8463875 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:46:09.914405 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-491d11c5-1d5e-423c-8deb-5d7ca8463875 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/1bc1a004-49b2-4b89-ba42-cddb661c7d94" status: 200 len: 1679 microversion: 2.1 time: 0.157485 Sep 14 09:46:09.915287 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3594/6918] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:46:09 2022] GET /compute/v2.1/servers/1bc1a004-49b2-4b89-ba42-cddb661c7d94 => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:46:10.939294 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f93e0bdc-fac9-4bdb-b3c3-756a4cd9a01f tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:46:10.939982 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f93e0bdc-fac9-4bdb-b3c3-756a4cd9a01f tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 1bc1a004-49b2-4b89-ba42-cddb661c7d94] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:46:10.946892 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f93e0bdc-fac9-4bdb-b3c3-756a4cd9a01f tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:10.947411 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f93e0bdc-fac9-4bdb-b3c3-756a4cd9a01f tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:10.947855 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f93e0bdc-fac9-4bdb-b3c3-756a4cd9a01f tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:10.948553 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f93e0bdc-fac9-4bdb-b3c3-756a4cd9a01f tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:10.949054 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f93e0bdc-fac9-4bdb-b3c3-756a4cd9a01f tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:10.949487 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f93e0bdc-fac9-4bdb-b3c3-756a4cd9a01f tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:11.084533 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f93e0bdc-fac9-4bdb-b3c3-756a4cd9a01f tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:46:11.092684 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f93e0bdc-fac9-4bdb-b3c3-756a4cd9a01f tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/1bc1a004-49b2-4b89-ba42-cddb661c7d94" status: 200 len: 1677 microversion: 2.1 time: 0.157951 Sep 14 09:46:11.093272 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3595/6919] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:46:10 2022] GET /compute/v2.1/servers/1bc1a004-49b2-4b89-ba42-cddb661c7d94 => generated 1677 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:46:11.258055 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-b2ab8946-dc89-448d-87c1-0e34cb1a7bc3 req-86f8dd08-77cb-4886-9802-09d70e36cf95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1bc1a004-49b2-4b89-ba42-cddb661c7d94", "tag": "aebc8474-ddb8-44f8-bc3e-54a9f3d854ae"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:46:11.267870 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-b2ab8946-dc89-448d-87c1-0e34cb1a7bc3 req-86f8dd08-77cb-4886-9802-09d70e36cf95 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:11.268342 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-b2ab8946-dc89-448d-87c1-0e34cb1a7bc3 req-86f8dd08-77cb-4886-9802-09d70e36cf95 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:11.268769 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-b2ab8946-dc89-448d-87c1-0e34cb1a7bc3 req-86f8dd08-77cb-4886-9802-09d70e36cf95 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:11.281360 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-b2ab8946-dc89-448d-87c1-0e34cb1a7bc3 req-86f8dd08-77cb-4886-9802-09d70e36cf95 service nova] Creating event network-changed:aebc8474-ddb8-44f8-bc3e-54a9f3d854ae for instance 1bc1a004-49b2-4b89-ba42-cddb661c7d94 on n-h2-836830-18 Sep 14 09:46:11.286718 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [req-b2ab8946-dc89-448d-87c1-0e34cb1a7bc3 req-86f8dd08-77cb-4886-9802-09d70e36cf95 service nova] Instance 1bc1a004-49b2-4b89-ba42-cddb661c7d94 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-836830-18', 'n-h2-836830-18'} {{(pid=128759) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 14 09:46:11.297169 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-b2ab8946-dc89-448d-87c1-0e34cb1a7bc3 req-86f8dd08-77cb-4886-9802-09d70e36cf95 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042840 Sep 14 09:46:11.297760 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3596/6920] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:46:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:46:12.117776 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f60f9395-71d2-45bd-aa97-084ebb3dc7b8 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:46:12.118484 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f60f9395-71d2-45bd-aa97-084ebb3dc7b8 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 1bc1a004-49b2-4b89-ba42-cddb661c7d94] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:46:12.125525 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f60f9395-71d2-45bd-aa97-084ebb3dc7b8 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:12.126023 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f60f9395-71d2-45bd-aa97-084ebb3dc7b8 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:12.126501 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f60f9395-71d2-45bd-aa97-084ebb3dc7b8 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:12.127282 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f60f9395-71d2-45bd-aa97-084ebb3dc7b8 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:12.127827 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f60f9395-71d2-45bd-aa97-084ebb3dc7b8 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:12.128885 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f60f9395-71d2-45bd-aa97-084ebb3dc7b8 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:12.346377 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f60f9395-71d2-45bd-aa97-084ebb3dc7b8 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:46:12.354732 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f60f9395-71d2-45bd-aa97-084ebb3dc7b8 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/1bc1a004-49b2-4b89-ba42-cddb661c7d94" status: 200 len: 1674 microversion: 2.1 time: 0.241980 Sep 14 09:46:12.367051 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3597/6921] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:46:12 2022] GET /compute/v2.1/servers/1bc1a004-49b2-4b89-ba42-cddb661c7d94 => generated 1674 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:46:12.379004 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-cbbae6cf-17c6-49ed-a601-6339ad3663d9 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:46:12.380218 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-cbbae6cf-17c6-49ed-a601-6339ad3663d9 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 1bc1a004-49b2-4b89-ba42-cddb661c7d94] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:46:12.386551 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cbbae6cf-17c6-49ed-a601-6339ad3663d9 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:12.387086 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cbbae6cf-17c6-49ed-a601-6339ad3663d9 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:12.387527 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cbbae6cf-17c6-49ed-a601-6339ad3663d9 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:12.388263 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cbbae6cf-17c6-49ed-a601-6339ad3663d9 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:12.388717 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cbbae6cf-17c6-49ed-a601-6339ad3663d9 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:12.389142 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cbbae6cf-17c6-49ed-a601-6339ad3663d9 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:12.451568 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-cbbae6cf-17c6-49ed-a601-6339ad3663d9 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "POST /compute/v2.1/servers/1bc1a004-49b2-4b89-ba42-cddb661c7d94/action" status: 204 len: 0 microversion: 2.1 time: 0.076355 Sep 14 09:46:12.452428 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3598/6922] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:46:12 2022] POST /compute/v2.1/servers/1bc1a004-49b2-4b89-ba42-cddb661c7d94/action => generated 0 bytes in 78 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:46:12.461414 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8a9c753c-8560-4b65-ac08-33dbcf1c17f1 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:46:12.462122 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-8a9c753c-8560-4b65-ac08-33dbcf1c17f1 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 1bc1a004-49b2-4b89-ba42-cddb661c7d94] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:46:12.469985 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8a9c753c-8560-4b65-ac08-33dbcf1c17f1 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:12.470526 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8a9c753c-8560-4b65-ac08-33dbcf1c17f1 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:12.471038 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8a9c753c-8560-4b65-ac08-33dbcf1c17f1 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:12.471730 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8a9c753c-8560-4b65-ac08-33dbcf1c17f1 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:12.472342 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8a9c753c-8560-4b65-ac08-33dbcf1c17f1 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:12.472761 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8a9c753c-8560-4b65-ac08-33dbcf1c17f1 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:12.624050 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-8a9c753c-8560-4b65-ac08-33dbcf1c17f1 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:46:12.632082 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-8a9c753c-8560-4b65-ac08-33dbcf1c17f1 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/1bc1a004-49b2-4b89-ba42-cddb661c7d94" status: 200 len: 1674 microversion: 2.1 time: 0.175432 Sep 14 09:46:12.632665 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3599/6923] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:46:12 2022] GET /compute/v2.1/servers/1bc1a004-49b2-4b89-ba42-cddb661c7d94 => generated 1674 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:46:13.655727 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f89a0522-d1e4-46b3-834c-9da7c5c6ce5f tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:46:13.656354 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f89a0522-d1e4-46b3-834c-9da7c5c6ce5f tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 1bc1a004-49b2-4b89-ba42-cddb661c7d94] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:46:13.663173 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f89a0522-d1e4-46b3-834c-9da7c5c6ce5f tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:13.663664 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f89a0522-d1e4-46b3-834c-9da7c5c6ce5f tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:13.664107 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f89a0522-d1e4-46b3-834c-9da7c5c6ce5f tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:13.664801 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f89a0522-d1e4-46b3-834c-9da7c5c6ce5f tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:13.665257 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f89a0522-d1e4-46b3-834c-9da7c5c6ce5f tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:13.665690 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f89a0522-d1e4-46b3-834c-9da7c5c6ce5f tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:13.793668 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f89a0522-d1e4-46b3-834c-9da7c5c6ce5f tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:46:13.801995 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f89a0522-d1e4-46b3-834c-9da7c5c6ce5f tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/1bc1a004-49b2-4b89-ba42-cddb661c7d94" status: 200 len: 1674 microversion: 2.1 time: 0.150211 Sep 14 09:46:13.802572 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3600/6924] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:46:13 2022] GET /compute/v2.1/servers/1bc1a004-49b2-4b89-ba42-cddb661c7d94 => generated 1674 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:46:14.413799 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-be7d4c4b-81a9-4901-804f-dcfe836db5b3 req-9b7fca79-9288-4bef-8e80-b27b0a3f351d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bc1a004-49b2-4b89-ba42-cddb661c7d94", "name": "network-vif-plugged", "status": "completed", "tag": "aebc8474-ddb8-44f8-bc3e-54a9f3d854ae"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:46:14.423622 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-be7d4c4b-81a9-4901-804f-dcfe836db5b3 req-9b7fca79-9288-4bef-8e80-b27b0a3f351d service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:14.424109 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-be7d4c4b-81a9-4901-804f-dcfe836db5b3 req-9b7fca79-9288-4bef-8e80-b27b0a3f351d service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:14.424545 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-be7d4c4b-81a9-4901-804f-dcfe836db5b3 req-9b7fca79-9288-4bef-8e80-b27b0a3f351d service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:14.435641 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-be7d4c4b-81a9-4901-804f-dcfe836db5b3 req-9b7fca79-9288-4bef-8e80-b27b0a3f351d service nova] Creating event network-vif-plugged:aebc8474-ddb8-44f8-bc3e-54a9f3d854ae for instance 1bc1a004-49b2-4b89-ba42-cddb661c7d94 on n-h2-836830-18 Sep 14 09:46:14.440730 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-be7d4c4b-81a9-4901-804f-dcfe836db5b3 req-9b7fca79-9288-4bef-8e80-b27b0a3f351d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093638 Sep 14 09:46:14.441345 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3601/6925] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:46:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:46:14.827555 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-41856f17-7b2c-447f-aa44-b27664d994d3 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:46:14.828179 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-41856f17-7b2c-447f-aa44-b27664d994d3 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 1bc1a004-49b2-4b89-ba42-cddb661c7d94] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:46:14.834314 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-41856f17-7b2c-447f-aa44-b27664d994d3 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:14.834792 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-41856f17-7b2c-447f-aa44-b27664d994d3 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:14.835253 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-41856f17-7b2c-447f-aa44-b27664d994d3 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:14.835936 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-41856f17-7b2c-447f-aa44-b27664d994d3 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:14.836385 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-41856f17-7b2c-447f-aa44-b27664d994d3 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:14.836807 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-41856f17-7b2c-447f-aa44-b27664d994d3 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:14.970681 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-41856f17-7b2c-447f-aa44-b27664d994d3 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:46:14.978425 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-41856f17-7b2c-447f-aa44-b27664d994d3 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/1bc1a004-49b2-4b89-ba42-cddb661c7d94" status: 200 len: 1666 microversion: 2.1 time: 0.156683 Sep 14 09:46:14.979015 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3602/6926] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:46:14 2022] GET /compute/v2.1/servers/1bc1a004-49b2-4b89-ba42-cddb661c7d94 => generated 1666 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:46:15.002033 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8732cd3e-74cd-4011-a461-dc93bb705fac tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:46:15.002648 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-8732cd3e-74cd-4011-a461-dc93bb705fac tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 1bc1a004-49b2-4b89-ba42-cddb661c7d94] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:46:15.008390 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8732cd3e-74cd-4011-a461-dc93bb705fac tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:15.008882 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8732cd3e-74cd-4011-a461-dc93bb705fac tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:15.009323 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8732cd3e-74cd-4011-a461-dc93bb705fac tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:15.010019 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8732cd3e-74cd-4011-a461-dc93bb705fac tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:15.010476 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8732cd3e-74cd-4011-a461-dc93bb705fac tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:15.010904 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8732cd3e-74cd-4011-a461-dc93bb705fac tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:15.140426 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-8732cd3e-74cd-4011-a461-dc93bb705fac tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:46:15.148267 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-8732cd3e-74cd-4011-a461-dc93bb705fac tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/1bc1a004-49b2-4b89-ba42-cddb661c7d94" status: 200 len: 1666 microversion: 2.1 time: 0.149856 Sep 14 09:46:15.149043 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3603/6927] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:46:14 2022] GET /compute/v2.1/servers/1bc1a004-49b2-4b89-ba42-cddb661c7d94 => generated 1666 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:46:15.170188 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b583b285-2153-4b75-a97b-d2cca6d62c4c tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:46:15.170801 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b583b285-2153-4b75-a97b-d2cca6d62c4c tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 1bc1a004-49b2-4b89-ba42-cddb661c7d94] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:46:15.176448 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b583b285-2153-4b75-a97b-d2cca6d62c4c tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:15.176934 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b583b285-2153-4b75-a97b-d2cca6d62c4c tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:15.177374 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b583b285-2153-4b75-a97b-d2cca6d62c4c tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:15.178061 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b583b285-2153-4b75-a97b-d2cca6d62c4c tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:15.178513 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b583b285-2153-4b75-a97b-d2cca6d62c4c tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:15.178961 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b583b285-2153-4b75-a97b-d2cca6d62c4c tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:15.311623 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b583b285-2153-4b75-a97b-d2cca6d62c4c tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:46:15.319451 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b583b285-2153-4b75-a97b-d2cca6d62c4c tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/1bc1a004-49b2-4b89-ba42-cddb661c7d94" status: 200 len: 1666 microversion: 2.1 time: 0.153307 Sep 14 09:46:15.320043 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3604/6928] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:46:15 2022] GET /compute/v2.1/servers/1bc1a004-49b2-4b89-ba42-cddb661c7d94 => generated 1666 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:46:15.341976 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8fae69ff-1915-4a06-8441-98171a92eb85 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:46:15.342416 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-8fae69ff-1915-4a06-8441-98171a92eb85 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 1bc1a004-49b2-4b89-ba42-cddb661c7d94] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:46:15.348185 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8fae69ff-1915-4a06-8441-98171a92eb85 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:15.348676 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8fae69ff-1915-4a06-8441-98171a92eb85 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:15.349119 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8fae69ff-1915-4a06-8441-98171a92eb85 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:15.349820 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8fae69ff-1915-4a06-8441-98171a92eb85 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:15.350283 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8fae69ff-1915-4a06-8441-98171a92eb85 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:15.350719 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8fae69ff-1915-4a06-8441-98171a92eb85 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:15.375730 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-8fae69ff-1915-4a06-8441-98171a92eb85 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 1bc1a004-49b2-4b89-ba42-cddb661c7d94] Going to try to terminate instance {{(pid=128759) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:46:15.451380 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-8fae69ff-1915-4a06-8441-98171a92eb85 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "DELETE /compute/v2.1/servers/1bc1a004-49b2-4b89-ba42-cddb661c7d94" status: 204 len: 0 microversion: 2.1 time: 0.113248 Sep 14 09:46:15.452259 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3605/6929] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:46:15 2022] DELETE /compute/v2.1/servers/1bc1a004-49b2-4b89-ba42-cddb661c7d94 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 14 09:46:15.460964 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3074e996-261f-4c1c-a968-1e534132f45b tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:46:15.461675 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-3074e996-261f-4c1c-a968-1e534132f45b tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 1bc1a004-49b2-4b89-ba42-cddb661c7d94] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:46:15.468307 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3074e996-261f-4c1c-a968-1e534132f45b tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:15.468797 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3074e996-261f-4c1c-a968-1e534132f45b tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:15.469235 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3074e996-261f-4c1c-a968-1e534132f45b tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:15.469925 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3074e996-261f-4c1c-a968-1e534132f45b tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:15.470382 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3074e996-261f-4c1c-a968-1e534132f45b tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:15.470805 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3074e996-261f-4c1c-a968-1e534132f45b tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:15.486376 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:46:15.602032 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-3074e996-261f-4c1c-a968-1e534132f45b tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:46:15.610465 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-3074e996-261f-4c1c-a968-1e534132f45b tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/1bc1a004-49b2-4b89-ba42-cddb661c7d94" status: 200 len: 1672 microversion: 2.1 time: 0.153585 Sep 14 09:46:15.611064 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3606/6930] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:46:15 2022] GET /compute/v2.1/servers/1bc1a004-49b2-4b89-ba42-cddb661c7d94 => generated 1672 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:46:16.633776 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-2cac577d-b994-48a8-8206-c159c937ad3f tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:46:16.634416 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-2cac577d-b994-48a8-8206-c159c937ad3f tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 1bc1a004-49b2-4b89-ba42-cddb661c7d94] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:46:16.641851 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2cac577d-b994-48a8-8206-c159c937ad3f tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:16.642368 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2cac577d-b994-48a8-8206-c159c937ad3f tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:16.642812 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2cac577d-b994-48a8-8206-c159c937ad3f tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:16.643538 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2cac577d-b994-48a8-8206-c159c937ad3f tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:16.643999 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2cac577d-b994-48a8-8206-c159c937ad3f tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:16.644429 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2cac577d-b994-48a8-8206-c159c937ad3f tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:16.854753 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-2cac577d-b994-48a8-8206-c159c937ad3f tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:46:16.862657 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-2cac577d-b994-48a8-8206-c159c937ad3f tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/1bc1a004-49b2-4b89-ba42-cddb661c7d94" status: 200 len: 1672 microversion: 2.1 time: 0.232815 Sep 14 09:46:16.863277 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3607/6931] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:46:16 2022] GET /compute/v2.1/servers/1bc1a004-49b2-4b89-ba42-cddb661c7d94 => generated 1672 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:46:17.647082 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-ddaef166-77f4-496d-9a9e-fa039efadc5c req-a21658aa-100a-494c-bba8-25f9a62fbe56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bc1a004-49b2-4b89-ba42-cddb661c7d94", "name": "network-vif-deleted", "tag": "aebc8474-ddb8-44f8-bc3e-54a9f3d854ae"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:46:17.658215 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-ddaef166-77f4-496d-9a9e-fa039efadc5c req-a21658aa-100a-494c-bba8-25f9a62fbe56 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:17.658701 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-ddaef166-77f4-496d-9a9e-fa039efadc5c req-a21658aa-100a-494c-bba8-25f9a62fbe56 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:17.659168 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-ddaef166-77f4-496d-9a9e-fa039efadc5c req-a21658aa-100a-494c-bba8-25f9a62fbe56 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:17.671097 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-ddaef166-77f4-496d-9a9e-fa039efadc5c req-a21658aa-100a-494c-bba8-25f9a62fbe56 service nova] Creating event network-vif-deleted:aebc8474-ddb8-44f8-bc3e-54a9f3d854ae for instance 1bc1a004-49b2-4b89-ba42-cddb661c7d94 on n-h2-836830-18 Sep 14 09:46:17.676497 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-ddaef166-77f4-496d-9a9e-fa039efadc5c req-a21658aa-100a-494c-bba8-25f9a62fbe56 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033083 Sep 14 09:46:17.677120 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3608/6932] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:46:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:46:17.889025 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f453a0ae-f66b-46cf-907a-194f62ece100 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:46:17.889653 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f453a0ae-f66b-46cf-907a-194f62ece100 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 1bc1a004-49b2-4b89-ba42-cddb661c7d94] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:46:17.895998 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f453a0ae-f66b-46cf-907a-194f62ece100 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:17.896499 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f453a0ae-f66b-46cf-907a-194f62ece100 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:17.896940 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f453a0ae-f66b-46cf-907a-194f62ece100 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:17.897662 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f453a0ae-f66b-46cf-907a-194f62ece100 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:17.898103 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f453a0ae-f66b-46cf-907a-194f62ece100 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:17.898530 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f453a0ae-f66b-46cf-907a-194f62ece100 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:17.912940 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-f453a0ae-f66b-46cf-907a-194f62ece100 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] HTTP exception thrown: Instance 1bc1a004-49b2-4b89-ba42-cddb661c7d94 could not be found. Sep 14 09:46:17.914622 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f453a0ae-f66b-46cf-907a-194f62ece100 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Request method failure captured: Sep 14 09:46:17.914622 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/1bc1a004-49b2-4b89-ba42-cddb661c7d94 HTTP/1.1 Sep 14 09:46:17.914622 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:46:17.914622 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:46:17.914622 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:46:17.914622 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:46:17.914622 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:46:17.914622 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:46:17.914622 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:46:17.914622 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:46:17.914622 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIaKBrBAh_wj7DfZiRKdrZ6pB2BVsnaFIACH9I9tnPwlUsTvBKg4Km-70hzyiQAJmR8uMyCC--Kmi_m3mCvjQEmAIcuX7dXHviBWfEEzRkbjLifKvzwHyNal8H1sdEC_eoJmfTTtUV4zMyNBM3to2Z7TJSY3tl0h8kAHjt5BuvlhekYs Sep 14 09:46:17.914622 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:46:17.914622 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:46:17.914622 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:46:17.914622 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:46:17.914622 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:46:17.914622 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:46:17.914622 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 270f637ba197498bb4f7fa1ba14a62ad Sep 14 09:46:17.914622 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ServerActionsTestJSON-1037640335 Sep 14 09:46:17.914622 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:46:17.914622 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:46:17.914622 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/270f637ba197498bb4f7fa1ba14a62ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_270f637ba197498bb4f7fa1ba14a62ad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/270f637ba197498bb4f7fa1ba14a62ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/270f637ba197498bb4f7fa1ba14a62ad"}]}] Sep 14 09:46:17.914622 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ServerActionsTestJSON-1037640335 Sep 14 09:46:17.914622 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 270f637ba197498bb4f7fa1ba14a62ad Sep 14 09:46:17.914622 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ServerActionsTestJSON-1037640335 Sep 14 09:46:17.914622 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ServerActionsTestJSON-1037640335-project Sep 14 09:46:17.914622 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:46:17.914622 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:46:17.914622 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 5de83b9937f145dbbe1091039327e71a Sep 14 09:46:17.914622 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ServerActionsTestJSON-1037640335-project Sep 14 09:46:17.914622 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:46:17.914622 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance 1bc1a004-49b2-4b89-ba42-cddb661c7d94 could not be found. Sep 14 09:46:17.914622 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '1bc1a004-49b2-4b89-ba42-cddb661c7d94'} Sep 14 09:46:17.914622 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:46:17.914622 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:46:17.914622 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:46:17.914622 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:46:17.914622 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:46:17.914622 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:46:17.914622 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:46:17.914622 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:46:17.914622 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:46:17.914622 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:46:17.914622 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1bc1a004-49b2-4b89-ba42-cddb661c7d94 could not be found. Sep 14 09:46:17.914622 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:46:17.914622 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:46:17.914622 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:46:17.914622 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:46:17.914622 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:46:17.914622 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:46:17.914622 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:46:17.914622 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:46:17.914622 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:46:17.914622 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:46:17.914622 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:46:17.914622 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:46:17.914622 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:46:17.914622 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:46:17.914622 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:46:17.914622 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:46:17.914622 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1bc1a004-49b2-4b89-ba42-cddb661c7d94 could not be found. Sep 14 09:46:17.914622 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:46:17.914622 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:46:17.914622 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:46:17.918580 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:46:17.918580 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:46:17.918580 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:46:17.918580 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:46:17.918580 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:46:17.918580 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1bc1a004-49b2-4b89-ba42-cddb661c7d94 could not be found. Sep 14 09:46:17.918580 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:46:17.918580 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f453a0ae-f66b-46cf-907a-194f62ece100 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Returning 404 to user: Instance 1bc1a004-49b2-4b89-ba42-cddb661c7d94 could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:46:17.918580 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f453a0ae-f66b-46cf-907a-194f62ece100 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/1bc1a004-49b2-4b89-ba42-cddb661c7d94" status: 404 len: 111 microversion: 2.1 time: 0.033385 Sep 14 09:46:17.918580 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3609/6933] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:46:17 2022] GET /compute/v2.1/servers/1bc1a004-49b2-4b89-ba42-cddb661c7d94 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:46:17.930344 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-0f4101b6-ff4f-47aa-930a-982fbf319e31 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:46:17.931141 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-0f4101b6-ff4f-47aa-930a-982fbf319e31 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 1bc1a004-49b2-4b89-ba42-cddb661c7d94] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:46:17.937334 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0f4101b6-ff4f-47aa-930a-982fbf319e31 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:17.937902 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0f4101b6-ff4f-47aa-930a-982fbf319e31 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:17.938407 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0f4101b6-ff4f-47aa-930a-982fbf319e31 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:17.939489 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0f4101b6-ff4f-47aa-930a-982fbf319e31 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:17.940237 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0f4101b6-ff4f-47aa-930a-982fbf319e31 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:17.940237 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0f4101b6-ff4f-47aa-930a-982fbf319e31 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:17.954987 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-0f4101b6-ff4f-47aa-930a-982fbf319e31 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] HTTP exception thrown: Instance 1bc1a004-49b2-4b89-ba42-cddb661c7d94 could not be found. Sep 14 09:46:17.956557 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-0f4101b6-ff4f-47aa-930a-982fbf319e31 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Request method failure captured: Sep 14 09:46:17.956557 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/1bc1a004-49b2-4b89-ba42-cddb661c7d94 HTTP/1.1 Sep 14 09:46:17.956557 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:46:17.956557 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:46:17.956557 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:46:17.956557 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:46:17.956557 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:46:17.956557 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:46:17.956557 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:46:17.956557 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:46:17.956557 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIaKBrBAh_wj7DfZiRKdrZ6pB2BVsnaFIACH9I9tnPwlUsTvBKg4Km-70hzyiQAJmR8uMyCC--Kmi_m3mCvjQEmAIcuX7dXHviBWfEEzRkbjLifKvzwHyNal8H1sdEC_eoJmfTTtUV4zMyNBM3to2Z7TJSY3tl0h8kAHjt5BuvlhekYs Sep 14 09:46:17.956557 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:46:17.956557 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:46:17.956557 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:46:17.956557 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:46:17.956557 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:46:17.956557 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:46:17.956557 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 270f637ba197498bb4f7fa1ba14a62ad Sep 14 09:46:17.956557 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ServerActionsTestJSON-1037640335 Sep 14 09:46:17.956557 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:46:17.956557 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:46:17.956557 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/270f637ba197498bb4f7fa1ba14a62ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_270f637ba197498bb4f7fa1ba14a62ad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/270f637ba197498bb4f7fa1ba14a62ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/270f637ba197498bb4f7fa1ba14a62ad"}]}] Sep 14 09:46:17.956557 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ServerActionsTestJSON-1037640335 Sep 14 09:46:17.956557 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 270f637ba197498bb4f7fa1ba14a62ad Sep 14 09:46:17.956557 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ServerActionsTestJSON-1037640335 Sep 14 09:46:17.956557 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ServerActionsTestJSON-1037640335-project Sep 14 09:46:17.956557 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:46:17.956557 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:46:17.956557 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 5de83b9937f145dbbe1091039327e71a Sep 14 09:46:17.956557 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ServerActionsTestJSON-1037640335-project Sep 14 09:46:17.956557 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:46:17.956557 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance 1bc1a004-49b2-4b89-ba42-cddb661c7d94 could not be found. Sep 14 09:46:17.956557 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '1bc1a004-49b2-4b89-ba42-cddb661c7d94'} Sep 14 09:46:17.956557 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:46:17.956557 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:46:17.956557 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:46:17.956557 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:46:17.956557 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:46:17.956557 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:46:17.956557 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:46:17.956557 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:46:17.956557 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:46:17.956557 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:46:17.956557 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1bc1a004-49b2-4b89-ba42-cddb661c7d94 could not be found. Sep 14 09:46:17.956557 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:46:17.956557 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:46:17.956557 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:46:17.956557 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:46:17.956557 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:46:17.956557 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:46:17.956557 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:46:17.956557 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:46:17.956557 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:46:17.956557 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:46:17.956557 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:46:17.956557 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:46:17.956557 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:46:17.956557 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:46:17.956557 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:46:17.956557 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:46:17.956557 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1bc1a004-49b2-4b89-ba42-cddb661c7d94 could not be found. Sep 14 09:46:17.956557 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:46:17.956557 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:46:17.956557 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:46:17.960243 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:46:17.960243 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:46:17.960243 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:46:17.960243 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:46:17.960243 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:46:17.960243 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1bc1a004-49b2-4b89-ba42-cddb661c7d94 could not be found. Sep 14 09:46:17.960243 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:46:17.960243 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-0f4101b6-ff4f-47aa-930a-982fbf319e31 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Returning 404 to user: Instance 1bc1a004-49b2-4b89-ba42-cddb661c7d94 could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:46:17.960243 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-0f4101b6-ff4f-47aa-930a-982fbf319e31 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/1bc1a004-49b2-4b89-ba42-cddb661c7d94" status: 404 len: 111 microversion: 2.1 time: 0.031665 Sep 14 09:46:17.960243 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3610/6934] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:46:17 2022] GET /compute/v2.1/servers/1bc1a004-49b2-4b89-ba42-cddb661c7d94 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:46:18.006583 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c12b599f-a920-48e3-a9c3-93df1a6359d2 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1602792196", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "networks": [{"uuid": "5634288b-23f2-493a-aa6e-c62111a88261"}], "security_groups": [{"name": "tempest-securitygroup--438503213"}], "key_name": "tempest-keypair-254910026", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:46:18.118211 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.network.neutron [None req-c12b599f-a920-48e3-a9c3-93df1a6359d2 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] validate_networks() for [('5634288b-23f2-493a-aa6e-c62111a88261', None, None, None, None, None)] {{(pid=128759) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:46:18.508076 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-c12b599f-a920-48e3-a9c3-93df1a6359d2 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Flavor limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:46:18.508776 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-c12b599f-a920-48e3-a9c3-93df1a6359d2 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Image limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:46:18.509075 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-c12b599f-a920-48e3-a9c3-93df1a6359d2 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Flavor pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:46:18.509495 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-c12b599f-a920-48e3-a9c3-93df1a6359d2 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Image pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:46:18.509937 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-c12b599f-a920-48e3-a9c3-93df1a6359d2 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:46:18.519922 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c12b599f-a920-48e3-a9c3-93df1a6359d2 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:18.520416 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c12b599f-a920-48e3-a9c3-93df1a6359d2 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:18.520859 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c12b599f-a920-48e3-a9c3-93df1a6359d2 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:18.521599 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c12b599f-a920-48e3-a9c3-93df1a6359d2 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:18.522064 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c12b599f-a920-48e3-a9c3-93df1a6359d2 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:18.522498 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c12b599f-a920-48e3-a9c3-93df1a6359d2 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:18.539610 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-c12b599f-a920-48e3-a9c3-93df1a6359d2 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Getting quotas for project 270f637ba197498bb4f7fa1ba14a62ad. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:46:18.545235 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-c12b599f-a920-48e3-a9c3-93df1a6359d2 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Getting quotas for user 5de83b9937f145dbbe1091039327e71a and project 270f637ba197498bb4f7fa1ba14a62ad. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:46:18.560923 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-c12b599f-a920-48e3-a9c3-93df1a6359d2 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Going to run 1 instances... {{(pid=128759) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:46:18.563004 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-c12b599f-a920-48e3-a9c3-93df1a6359d2 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 7b1e3385-d546-471e-b140-c5ca25783bca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128759) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:46:18.614027 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-c12b599f-a920-48e3-a9c3-93df1a6359d2 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.611333 Sep 14 09:46:18.619223 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3611/6935] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 09:46:18 2022] POST /compute/v2.1/servers => generated 405 bytes in 613 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 14 09:46:18.631445 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-08e1e8b2-6714-4976-a722-f376a788d4de tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:46:18.632082 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-08e1e8b2-6714-4976-a722-f376a788d4de tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 7b1e3385-d546-471e-b140-c5ca25783bca] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:46:18.635636 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:46:18.691744 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-08e1e8b2-6714-4976-a722-f376a788d4de tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:46:18.698953 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-08e1e8b2-6714-4976-a722-f376a788d4de tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/7b1e3385-d546-471e-b140-c5ca25783bca" status: 200 len: 1238 microversion: 2.1 time: 0.076410 Sep 14 09:46:18.699552 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3612/6936] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:46:18 2022] GET /compute/v2.1/servers/7b1e3385-d546-471e-b140-c5ca25783bca => generated 1238 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:46:19.723531 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-813cddfa-aa87-470b-9206-ebe214ae5872 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:46:19.724218 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-813cddfa-aa87-470b-9206-ebe214ae5872 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 7b1e3385-d546-471e-b140-c5ca25783bca] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:46:19.732391 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-813cddfa-aa87-470b-9206-ebe214ae5872 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:19.732908 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-813cddfa-aa87-470b-9206-ebe214ae5872 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:19.733395 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-813cddfa-aa87-470b-9206-ebe214ae5872 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:19.734172 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-813cddfa-aa87-470b-9206-ebe214ae5872 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:19.734822 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-813cddfa-aa87-470b-9206-ebe214ae5872 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:19.735496 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-813cddfa-aa87-470b-9206-ebe214ae5872 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:19.806708 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-813cddfa-aa87-470b-9206-ebe214ae5872 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:46:19.815795 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-813cddfa-aa87-470b-9206-ebe214ae5872 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/7b1e3385-d546-471e-b140-c5ca25783bca" status: 200 len: 1298 microversion: 2.1 time: 0.096175 Sep 14 09:46:19.816375 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3613/6937] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:46:19 2022] GET /compute/v2.1/servers/7b1e3385-d546-471e-b140-c5ca25783bca => generated 1298 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:46:20.840848 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-5c52a876-dae7-46eb-92a6-7582a727d757 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:46:20.841992 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-5c52a876-dae7-46eb-92a6-7582a727d757 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 7b1e3385-d546-471e-b140-c5ca25783bca] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:46:20.851269 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5c52a876-dae7-46eb-92a6-7582a727d757 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:20.851757 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5c52a876-dae7-46eb-92a6-7582a727d757 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:20.852193 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5c52a876-dae7-46eb-92a6-7582a727d757 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:20.852888 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5c52a876-dae7-46eb-92a6-7582a727d757 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:20.853345 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5c52a876-dae7-46eb-92a6-7582a727d757 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:20.853770 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5c52a876-dae7-46eb-92a6-7582a727d757 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:20.994347 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-5c52a876-dae7-46eb-92a6-7582a727d757 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:46:21.002287 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-5c52a876-dae7-46eb-92a6-7582a727d757 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/7b1e3385-d546-471e-b140-c5ca25783bca" status: 200 len: 1363 microversion: 2.1 time: 0.165593 Sep 14 09:46:21.002873 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3614/6938] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:46:20 2022] GET /compute/v2.1/servers/7b1e3385-d546-471e-b140-c5ca25783bca => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:46:21.105578 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-1d073fd2-6a09-4e95-be68-6327b62705ca req-ccd3f624-a992-42d1-8d2f-e3b7317b0b43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b1e3385-d546-471e-b140-c5ca25783bca", "tag": "818f11dc-8678-4091-91d1-069a7c021da7"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:46:21.117854 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-1d073fd2-6a09-4e95-be68-6327b62705ca req-ccd3f624-a992-42d1-8d2f-e3b7317b0b43 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:21.118348 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-1d073fd2-6a09-4e95-be68-6327b62705ca req-ccd3f624-a992-42d1-8d2f-e3b7317b0b43 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:21.118781 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-1d073fd2-6a09-4e95-be68-6327b62705ca req-ccd3f624-a992-42d1-8d2f-e3b7317b0b43 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:21.131868 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-1d073fd2-6a09-4e95-be68-6327b62705ca req-ccd3f624-a992-42d1-8d2f-e3b7317b0b43 service nova] Creating event network-changed:818f11dc-8678-4091-91d1-069a7c021da7 for instance 7b1e3385-d546-471e-b140-c5ca25783bca on n-h2-836830-18 Sep 14 09:46:21.136730 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-1d073fd2-6a09-4e95-be68-6327b62705ca req-ccd3f624-a992-42d1-8d2f-e3b7317b0b43 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035450 Sep 14 09:46:21.137444 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3615/6939] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:46:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:46:22.026634 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-427a5f98-4d03-409e-a495-f583c809cf90 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:46:22.027390 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-427a5f98-4d03-409e-a495-f583c809cf90 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 7b1e3385-d546-471e-b140-c5ca25783bca] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:46:22.035011 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-427a5f98-4d03-409e-a495-f583c809cf90 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:22.035497 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-427a5f98-4d03-409e-a495-f583c809cf90 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:22.035930 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-427a5f98-4d03-409e-a495-f583c809cf90 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:22.036609 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-427a5f98-4d03-409e-a495-f583c809cf90 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:22.037065 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-427a5f98-4d03-409e-a495-f583c809cf90 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:22.037487 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-427a5f98-4d03-409e-a495-f583c809cf90 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:22.166797 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-427a5f98-4d03-409e-a495-f583c809cf90 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:46:22.174652 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-427a5f98-4d03-409e-a495-f583c809cf90 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/7b1e3385-d546-471e-b140-c5ca25783bca" status: 200 len: 1363 microversion: 2.1 time: 0.152297 Sep 14 09:46:22.175259 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3616/6940] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:46:22 2022] GET /compute/v2.1/servers/7b1e3385-d546-471e-b140-c5ca25783bca => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:46:23.199202 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-15e3fba8-2cb9-49f2-8631-b634e6269505 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:46:23.199859 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-15e3fba8-2cb9-49f2-8631-b634e6269505 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 7b1e3385-d546-471e-b140-c5ca25783bca] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:46:23.206762 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-15e3fba8-2cb9-49f2-8631-b634e6269505 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:23.207290 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-15e3fba8-2cb9-49f2-8631-b634e6269505 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:23.207731 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-15e3fba8-2cb9-49f2-8631-b634e6269505 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:23.208421 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-15e3fba8-2cb9-49f2-8631-b634e6269505 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:23.208870 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-15e3fba8-2cb9-49f2-8631-b634e6269505 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:23.209289 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-15e3fba8-2cb9-49f2-8631-b634e6269505 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:23.336903 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-15e3fba8-2cb9-49f2-8631-b634e6269505 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:46:23.344795 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-15e3fba8-2cb9-49f2-8631-b634e6269505 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/7b1e3385-d546-471e-b140-c5ca25783bca" status: 200 len: 1363 microversion: 2.1 time: 0.149995 Sep 14 09:46:23.345402 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3617/6941] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:46:23 2022] GET /compute/v2.1/servers/7b1e3385-d546-471e-b140-c5ca25783bca => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:46:24.369797 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3886426e-441b-486f-a896-662fdfe4faf4 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:46:24.370429 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-3886426e-441b-486f-a896-662fdfe4faf4 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 7b1e3385-d546-471e-b140-c5ca25783bca] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:46:24.377695 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3886426e-441b-486f-a896-662fdfe4faf4 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:24.378185 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3886426e-441b-486f-a896-662fdfe4faf4 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:24.378626 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3886426e-441b-486f-a896-662fdfe4faf4 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:24.379363 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3886426e-441b-486f-a896-662fdfe4faf4 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:24.379819 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3886426e-441b-486f-a896-662fdfe4faf4 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:24.380248 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3886426e-441b-486f-a896-662fdfe4faf4 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:24.514740 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-3886426e-441b-486f-a896-662fdfe4faf4 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:46:24.522507 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-3886426e-441b-486f-a896-662fdfe4faf4 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/7b1e3385-d546-471e-b140-c5ca25783bca" status: 200 len: 1363 microversion: 2.1 time: 0.157332 Sep 14 09:46:24.523110 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3618/6942] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:46:24 2022] GET /compute/v2.1/servers/7b1e3385-d546-471e-b140-c5ca25783bca => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:46:25.546159 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e2f060ee-1642-407a-885d-9ae40de80ff1 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:46:25.546818 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e2f060ee-1642-407a-885d-9ae40de80ff1 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 7b1e3385-d546-471e-b140-c5ca25783bca] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:46:25.553871 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e2f060ee-1642-407a-885d-9ae40de80ff1 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:25.554592 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e2f060ee-1642-407a-885d-9ae40de80ff1 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:25.554851 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e2f060ee-1642-407a-885d-9ae40de80ff1 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:25.555615 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e2f060ee-1642-407a-885d-9ae40de80ff1 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:25.556078 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e2f060ee-1642-407a-885d-9ae40de80ff1 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:25.556510 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e2f060ee-1642-407a-885d-9ae40de80ff1 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:25.687286 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-e2f060ee-1642-407a-885d-9ae40de80ff1 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:46:25.695143 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e2f060ee-1642-407a-885d-9ae40de80ff1 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/7b1e3385-d546-471e-b140-c5ca25783bca" status: 200 len: 1363 microversion: 2.1 time: 0.153576 Sep 14 09:46:25.695728 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3619/6943] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:46:25 2022] GET /compute/v2.1/servers/7b1e3385-d546-471e-b140-c5ca25783bca => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:46:26.416544 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-cd819957-17cf-423b-8b89-2786c6f23971 req-ab3b1e73-316a-4d2d-9b19-3159ffdd8ac1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b1e3385-d546-471e-b140-c5ca25783bca", "name": "network-vif-plugged", "status": "completed", "tag": "818f11dc-8678-4091-91d1-069a7c021da7"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:46:26.426780 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-cd819957-17cf-423b-8b89-2786c6f23971 req-ab3b1e73-316a-4d2d-9b19-3159ffdd8ac1 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:26.427299 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-cd819957-17cf-423b-8b89-2786c6f23971 req-ab3b1e73-316a-4d2d-9b19-3159ffdd8ac1 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:26.427726 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-cd819957-17cf-423b-8b89-2786c6f23971 req-ab3b1e73-316a-4d2d-9b19-3159ffdd8ac1 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:26.439096 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-cd819957-17cf-423b-8b89-2786c6f23971 req-ab3b1e73-316a-4d2d-9b19-3159ffdd8ac1 service nova] Creating event network-vif-plugged:818f11dc-8678-4091-91d1-069a7c021da7 for instance 7b1e3385-d546-471e-b140-c5ca25783bca on n-h2-836830-18 Sep 14 09:46:26.444009 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-cd819957-17cf-423b-8b89-2786c6f23971 req-ab3b1e73-316a-4d2d-9b19-3159ffdd8ac1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031442 Sep 14 09:46:26.444649 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3620/6944] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:46:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:46:26.719679 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-5d262875-0af8-4bec-83ed-cb7158065947 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:46:26.720383 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-5d262875-0af8-4bec-83ed-cb7158065947 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 7b1e3385-d546-471e-b140-c5ca25783bca] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:46:26.726736 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5d262875-0af8-4bec-83ed-cb7158065947 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:26.727264 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5d262875-0af8-4bec-83ed-cb7158065947 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:26.727704 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5d262875-0af8-4bec-83ed-cb7158065947 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:26.728395 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5d262875-0af8-4bec-83ed-cb7158065947 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:26.728851 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5d262875-0af8-4bec-83ed-cb7158065947 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:26.729274 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5d262875-0af8-4bec-83ed-cb7158065947 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:26.861300 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-5d262875-0af8-4bec-83ed-cb7158065947 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:46:26.869090 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-5d262875-0af8-4bec-83ed-cb7158065947 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/7b1e3385-d546-471e-b140-c5ca25783bca" status: 200 len: 1363 microversion: 2.1 time: 0.154500 Sep 14 09:46:26.869672 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3621/6945] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:46:26 2022] GET /compute/v2.1/servers/7b1e3385-d546-471e-b140-c5ca25783bca => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:46:27.892892 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e5d13284-7c76-4615-b48a-4a09bd7fa5c2 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:46:27.893544 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e5d13284-7c76-4615-b48a-4a09bd7fa5c2 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 7b1e3385-d546-471e-b140-c5ca25783bca] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:46:27.900411 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e5d13284-7c76-4615-b48a-4a09bd7fa5c2 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:27.900901 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e5d13284-7c76-4615-b48a-4a09bd7fa5c2 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:27.901351 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e5d13284-7c76-4615-b48a-4a09bd7fa5c2 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:27.902047 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e5d13284-7c76-4615-b48a-4a09bd7fa5c2 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:27.902511 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e5d13284-7c76-4615-b48a-4a09bd7fa5c2 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:27.902954 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e5d13284-7c76-4615-b48a-4a09bd7fa5c2 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:28.032127 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-e5d13284-7c76-4615-b48a-4a09bd7fa5c2 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:46:28.039858 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e5d13284-7c76-4615-b48a-4a09bd7fa5c2 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/7b1e3385-d546-471e-b140-c5ca25783bca" status: 200 len: 1549 microversion: 2.1 time: 0.150941 Sep 14 09:46:28.040432 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3622/6946] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:46:27 2022] GET /compute/v2.1/servers/7b1e3385-d546-471e-b140-c5ca25783bca => generated 1549 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:46:28.063771 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-11103695-521a-4937-a409-eacc58063b31 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:46:28.064274 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-11103695-521a-4937-a409-eacc58063b31 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 7b1e3385-d546-471e-b140-c5ca25783bca] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:46:28.070111 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-11103695-521a-4937-a409-eacc58063b31 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:28.070595 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-11103695-521a-4937-a409-eacc58063b31 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:28.071067 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-11103695-521a-4937-a409-eacc58063b31 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:28.071762 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-11103695-521a-4937-a409-eacc58063b31 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:28.072219 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-11103695-521a-4937-a409-eacc58063b31 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:28.072647 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-11103695-521a-4937-a409-eacc58063b31 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:28.148164 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-11103695-521a-4937-a409-eacc58063b31 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/7b1e3385-d546-471e-b140-c5ca25783bca/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088560 Sep 14 09:46:28.148767 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3623/6947] 10.222.0.60 () {58 vars in 1275 bytes} [Wed Sep 14 09:46:28 2022] GET /compute/v2.1/servers/7b1e3385-d546-471e-b140-c5ca25783bca/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:46:29.358235 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=2 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:46:29.359280 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=8 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:46:29.413607 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-c73b577a-dc9e-460e-8309-188b68818cd6 req-d387b085-c5c0-43ba-a2d7-7c19cb6ddf25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b1e3385-d546-471e-b140-c5ca25783bca", "tag": "818f11dc-8678-4091-91d1-069a7c021da7"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:46:29.423270 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-c73b577a-dc9e-460e-8309-188b68818cd6 req-d387b085-c5c0-43ba-a2d7-7c19cb6ddf25 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:29.423760 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-c73b577a-dc9e-460e-8309-188b68818cd6 req-d387b085-c5c0-43ba-a2d7-7c19cb6ddf25 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:29.424198 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-c73b577a-dc9e-460e-8309-188b68818cd6 req-d387b085-c5c0-43ba-a2d7-7c19cb6ddf25 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:29.436949 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-c73b577a-dc9e-460e-8309-188b68818cd6 req-d387b085-c5c0-43ba-a2d7-7c19cb6ddf25 service nova] Creating event network-changed:818f11dc-8678-4091-91d1-069a7c021da7 for instance 7b1e3385-d546-471e-b140-c5ca25783bca on n-h2-836830-18 Sep 14 09:46:29.442255 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-c73b577a-dc9e-460e-8309-188b68818cd6 req-d387b085-c5c0-43ba-a2d7-7c19cb6ddf25 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084701 Sep 14 09:46:29.442963 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3624/6948] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:46:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:47:02.210586 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=26 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:47:02.211367 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=75 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:47:02.215801 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-2b373ce8-8e97-4294-ad42-c73f78ee9fdc tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:47:02.223529 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2b373ce8-8e97-4294-ad42-c73f78ee9fdc tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:02.224017 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2b373ce8-8e97-4294-ad42-c73f78ee9fdc tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:02.224448 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2b373ce8-8e97-4294-ad42-c73f78ee9fdc tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:02.246555 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-2b373ce8-8e97-4294-ad42-c73f78ee9fdc tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 7b1e3385-d546-471e-b140-c5ca25783bca] Going to try to stop instance {{(pid=128759) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 14 09:47:02.286787 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-2b373ce8-8e97-4294-ad42-c73f78ee9fdc tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "POST /compute/v2.1/servers/7b1e3385-d546-471e-b140-c5ca25783bca/action" status: 202 len: 0 microversion: 2.1 time: 0.078283 Sep 14 09:47:02.287454 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3625/6949] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:47:02 2022] POST /compute/v2.1/servers/7b1e3385-d546-471e-b140-c5ca25783bca/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 14 09:47:02.295763 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-77b1a612-4c09-4763-bcad-8d671c947eae tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:47:02.296474 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-77b1a612-4c09-4763-bcad-8d671c947eae tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 7b1e3385-d546-471e-b140-c5ca25783bca] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:47:02.303320 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-77b1a612-4c09-4763-bcad-8d671c947eae tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:02.303896 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-77b1a612-4c09-4763-bcad-8d671c947eae tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:02.304344 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-77b1a612-4c09-4763-bcad-8d671c947eae tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:02.305105 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-77b1a612-4c09-4763-bcad-8d671c947eae tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:02.305565 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-77b1a612-4c09-4763-bcad-8d671c947eae tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:02.305993 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-77b1a612-4c09-4763-bcad-8d671c947eae tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:02.438492 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-77b1a612-4c09-4763-bcad-8d671c947eae tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:47:02.446340 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-77b1a612-4c09-4763-bcad-8d671c947eae tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/7b1e3385-d546-471e-b140-c5ca25783bca" status: 200 len: 1677 microversion: 2.1 time: 0.154582 Sep 14 09:47:02.446913 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3626/6950] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:47:02 2022] GET /compute/v2.1/servers/7b1e3385-d546-471e-b140-c5ca25783bca => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:47:03.469920 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-80096963-05a3-4b0b-a327-a5b254c5d496 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:47:03.470590 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-80096963-05a3-4b0b-a327-a5b254c5d496 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 7b1e3385-d546-471e-b140-c5ca25783bca] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:47:03.477504 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-80096963-05a3-4b0b-a327-a5b254c5d496 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:03.477995 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-80096963-05a3-4b0b-a327-a5b254c5d496 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:03.478443 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-80096963-05a3-4b0b-a327-a5b254c5d496 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:03.479168 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-80096963-05a3-4b0b-a327-a5b254c5d496 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:03.479632 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-80096963-05a3-4b0b-a327-a5b254c5d496 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:03.480064 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-80096963-05a3-4b0b-a327-a5b254c5d496 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:03.615734 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-80096963-05a3-4b0b-a327-a5b254c5d496 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:47:03.623555 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-80096963-05a3-4b0b-a327-a5b254c5d496 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/7b1e3385-d546-471e-b140-c5ca25783bca" status: 200 len: 1677 microversion: 2.1 time: 0.157863 Sep 14 09:47:03.624174 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3627/6951] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:47:03 2022] GET /compute/v2.1/servers/7b1e3385-d546-471e-b140-c5ca25783bca => generated 1677 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:47:04.647221 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-6c5f7dc6-7a91-426e-9e80-bed597cbbec6 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:47:04.647843 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-6c5f7dc6-7a91-426e-9e80-bed597cbbec6 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 7b1e3385-d546-471e-b140-c5ca25783bca] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:47:04.654725 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6c5f7dc6-7a91-426e-9e80-bed597cbbec6 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:04.655243 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6c5f7dc6-7a91-426e-9e80-bed597cbbec6 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:04.655688 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6c5f7dc6-7a91-426e-9e80-bed597cbbec6 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:04.656378 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6c5f7dc6-7a91-426e-9e80-bed597cbbec6 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:04.656838 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6c5f7dc6-7a91-426e-9e80-bed597cbbec6 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:04.657266 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6c5f7dc6-7a91-426e-9e80-bed597cbbec6 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:04.788967 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-6c5f7dc6-7a91-426e-9e80-bed597cbbec6 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:47:04.796815 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-6c5f7dc6-7a91-426e-9e80-bed597cbbec6 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/7b1e3385-d546-471e-b140-c5ca25783bca" status: 200 len: 1677 microversion: 2.1 time: 0.154125 Sep 14 09:47:04.797391 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3628/6952] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:47:04 2022] GET /compute/v2.1/servers/7b1e3385-d546-471e-b140-c5ca25783bca => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:47:05.820992 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-928aa2a7-b0c1-485a-8c9d-63bd24a50490 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:47:05.821620 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-928aa2a7-b0c1-485a-8c9d-63bd24a50490 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 7b1e3385-d546-471e-b140-c5ca25783bca] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:47:05.828566 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-928aa2a7-b0c1-485a-8c9d-63bd24a50490 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:05.828997 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-928aa2a7-b0c1-485a-8c9d-63bd24a50490 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:05.829440 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-928aa2a7-b0c1-485a-8c9d-63bd24a50490 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:05.830158 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-928aa2a7-b0c1-485a-8c9d-63bd24a50490 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:05.830619 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-928aa2a7-b0c1-485a-8c9d-63bd24a50490 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:05.831076 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-928aa2a7-b0c1-485a-8c9d-63bd24a50490 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:05.964016 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-928aa2a7-b0c1-485a-8c9d-63bd24a50490 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:47:05.972546 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-928aa2a7-b0c1-485a-8c9d-63bd24a50490 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/7b1e3385-d546-471e-b140-c5ca25783bca" status: 200 len: 1677 microversion: 2.1 time: 0.155438 Sep 14 09:47:05.973124 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3629/6953] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:47:05 2022] GET /compute/v2.1/servers/7b1e3385-d546-471e-b140-c5ca25783bca => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:47:06.997519 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f26e0881-5cb1-4228-b696-dfcdd5153b3c tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:47:06.998180 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f26e0881-5cb1-4228-b696-dfcdd5153b3c tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 7b1e3385-d546-471e-b140-c5ca25783bca] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:47:07.005024 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f26e0881-5cb1-4228-b696-dfcdd5153b3c tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:07.005512 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f26e0881-5cb1-4228-b696-dfcdd5153b3c tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:07.005955 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f26e0881-5cb1-4228-b696-dfcdd5153b3c tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:07.006645 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f26e0881-5cb1-4228-b696-dfcdd5153b3c tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:07.007140 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f26e0881-5cb1-4228-b696-dfcdd5153b3c tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:07.007570 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f26e0881-5cb1-4228-b696-dfcdd5153b3c tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:07.135924 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f26e0881-5cb1-4228-b696-dfcdd5153b3c tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:47:07.144145 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f26e0881-5cb1-4228-b696-dfcdd5153b3c tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/7b1e3385-d546-471e-b140-c5ca25783bca" status: 200 len: 1677 microversion: 2.1 time: 0.150718 Sep 14 09:47:07.144717 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3630/6954] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:47:06 2022] GET /compute/v2.1/servers/7b1e3385-d546-471e-b140-c5ca25783bca => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:47:08.168139 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-73e8e76a-ddd2-4fc1-af9e-37aa27e0aaa9 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:47:08.168820 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-73e8e76a-ddd2-4fc1-af9e-37aa27e0aaa9 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 7b1e3385-d546-471e-b140-c5ca25783bca] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:47:08.175622 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-73e8e76a-ddd2-4fc1-af9e-37aa27e0aaa9 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:08.176105 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-73e8e76a-ddd2-4fc1-af9e-37aa27e0aaa9 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:08.176541 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-73e8e76a-ddd2-4fc1-af9e-37aa27e0aaa9 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:08.177220 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-73e8e76a-ddd2-4fc1-af9e-37aa27e0aaa9 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:08.177669 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-73e8e76a-ddd2-4fc1-af9e-37aa27e0aaa9 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:08.178088 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-73e8e76a-ddd2-4fc1-af9e-37aa27e0aaa9 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:08.304509 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-73e8e76a-ddd2-4fc1-af9e-37aa27e0aaa9 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:47:08.312186 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-73e8e76a-ddd2-4fc1-af9e-37aa27e0aaa9 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/7b1e3385-d546-471e-b140-c5ca25783bca" status: 200 len: 1677 microversion: 2.1 time: 0.148010 Sep 14 09:47:08.312761 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3631/6955] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:47:08 2022] GET /compute/v2.1/servers/7b1e3385-d546-471e-b140-c5ca25783bca => generated 1677 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:47:09.337103 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-2134365e-8f6e-4d05-a8ba-95758ad2ed2a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:47:09.337742 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-2134365e-8f6e-4d05-a8ba-95758ad2ed2a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 7b1e3385-d546-471e-b140-c5ca25783bca] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:47:09.345206 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2134365e-8f6e-4d05-a8ba-95758ad2ed2a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:09.345681 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2134365e-8f6e-4d05-a8ba-95758ad2ed2a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:09.346709 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2134365e-8f6e-4d05-a8ba-95758ad2ed2a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:09.347467 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2134365e-8f6e-4d05-a8ba-95758ad2ed2a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:09.347931 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2134365e-8f6e-4d05-a8ba-95758ad2ed2a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:09.348364 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2134365e-8f6e-4d05-a8ba-95758ad2ed2a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:09.486359 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-2134365e-8f6e-4d05-a8ba-95758ad2ed2a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:47:09.494388 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-2134365e-8f6e-4d05-a8ba-95758ad2ed2a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/7b1e3385-d546-471e-b140-c5ca25783bca" status: 200 len: 1677 microversion: 2.1 time: 0.161705 Sep 14 09:47:09.494876 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3632/6956] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:47:09 2022] GET /compute/v2.1/servers/7b1e3385-d546-471e-b140-c5ca25783bca => generated 1677 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:47:10.517487 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-26dfcfbb-9248-4f5e-a098-066d8f1e4963 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:47:10.518195 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-26dfcfbb-9248-4f5e-a098-066d8f1e4963 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 7b1e3385-d546-471e-b140-c5ca25783bca] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:47:10.525623 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-26dfcfbb-9248-4f5e-a098-066d8f1e4963 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:10.526115 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-26dfcfbb-9248-4f5e-a098-066d8f1e4963 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:10.526557 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-26dfcfbb-9248-4f5e-a098-066d8f1e4963 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:10.527279 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-26dfcfbb-9248-4f5e-a098-066d8f1e4963 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:10.527744 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-26dfcfbb-9248-4f5e-a098-066d8f1e4963 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:10.528176 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-26dfcfbb-9248-4f5e-a098-066d8f1e4963 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:10.659716 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-26dfcfbb-9248-4f5e-a098-066d8f1e4963 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:47:10.667584 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-26dfcfbb-9248-4f5e-a098-066d8f1e4963 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/7b1e3385-d546-471e-b140-c5ca25783bca" status: 200 len: 1677 microversion: 2.1 time: 0.154094 Sep 14 09:47:10.668173 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3633/6957] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:47:10 2022] GET /compute/v2.1/servers/7b1e3385-d546-471e-b140-c5ca25783bca => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:47:11.691431 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9cbcf9e5-a300-44b1-aa9b-112e5ff6fda7 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:47:11.692048 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-9cbcf9e5-a300-44b1-aa9b-112e5ff6fda7 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 7b1e3385-d546-471e-b140-c5ca25783bca] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:47:11.698842 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9cbcf9e5-a300-44b1-aa9b-112e5ff6fda7 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:11.699354 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9cbcf9e5-a300-44b1-aa9b-112e5ff6fda7 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:11.699791 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9cbcf9e5-a300-44b1-aa9b-112e5ff6fda7 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:11.700478 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9cbcf9e5-a300-44b1-aa9b-112e5ff6fda7 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:11.700934 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9cbcf9e5-a300-44b1-aa9b-112e5ff6fda7 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:11.701356 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9cbcf9e5-a300-44b1-aa9b-112e5ff6fda7 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:11.833679 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-9cbcf9e5-a300-44b1-aa9b-112e5ff6fda7 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:47:11.841829 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-9cbcf9e5-a300-44b1-aa9b-112e5ff6fda7 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/7b1e3385-d546-471e-b140-c5ca25783bca" status: 200 len: 1677 microversion: 2.1 time: 0.154347 Sep 14 09:47:11.842409 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3634/6958] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:47:11 2022] GET /compute/v2.1/servers/7b1e3385-d546-471e-b140-c5ca25783bca => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:47:12.866212 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-522213f1-65e7-49eb-9474-228ce6e8ec46 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:47:12.866886 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-522213f1-65e7-49eb-9474-228ce6e8ec46 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 7b1e3385-d546-471e-b140-c5ca25783bca] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:47:12.873982 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-522213f1-65e7-49eb-9474-228ce6e8ec46 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:12.874515 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-522213f1-65e7-49eb-9474-228ce6e8ec46 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:12.874988 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-522213f1-65e7-49eb-9474-228ce6e8ec46 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:12.875691 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-522213f1-65e7-49eb-9474-228ce6e8ec46 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:12.876180 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-522213f1-65e7-49eb-9474-228ce6e8ec46 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:12.876614 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-522213f1-65e7-49eb-9474-228ce6e8ec46 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:13.005502 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-522213f1-65e7-49eb-9474-228ce6e8ec46 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:47:13.013206 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-522213f1-65e7-49eb-9474-228ce6e8ec46 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/7b1e3385-d546-471e-b140-c5ca25783bca" status: 200 len: 1654 microversion: 2.1 time: 0.151023 Sep 14 09:47:13.013789 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3635/6959] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:47:12 2022] GET /compute/v2.1/servers/7b1e3385-d546-471e-b140-c5ca25783bca => generated 1654 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:47:13.035016 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-4cdb59ef-84fe-4035-875a-dd76337cb0ae tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:47:13.037384 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-4cdb59ef-84fe-4035-875a-dd76337cb0ae tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 7b1e3385-d546-471e-b140-c5ca25783bca] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:47:13.043074 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4cdb59ef-84fe-4035-875a-dd76337cb0ae tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:13.043558 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4cdb59ef-84fe-4035-875a-dd76337cb0ae tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:13.043997 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4cdb59ef-84fe-4035-875a-dd76337cb0ae tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:13.044693 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4cdb59ef-84fe-4035-875a-dd76337cb0ae tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:13.045149 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4cdb59ef-84fe-4035-875a-dd76337cb0ae tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:13.045580 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4cdb59ef-84fe-4035-875a-dd76337cb0ae tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:13.074223 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-4cdb59ef-84fe-4035-875a-dd76337cb0ae tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:47:13.079651 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-4cdb59ef-84fe-4035-875a-dd76337cb0ae tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 7b1e3385-d546-471e-b140-c5ca25783bca] Old instance type m1.heat2, new instance type m1.heat {{(pid=128759) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 14 09:47:13.086207 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-4cdb59ef-84fe-4035-875a-dd76337cb0ae tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Flavor limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:47:13.086628 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-4cdb59ef-84fe-4035-875a-dd76337cb0ae tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Image limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:47:13.087146 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-4cdb59ef-84fe-4035-875a-dd76337cb0ae tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Flavor pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:47:13.087559 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-4cdb59ef-84fe-4035-875a-dd76337cb0ae tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Image pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:47:13.087971 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-4cdb59ef-84fe-4035-875a-dd76337cb0ae tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:47:13.151008 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-4cdb59ef-84fe-4035-875a-dd76337cb0ae tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "POST /compute/v2.1/servers/7b1e3385-d546-471e-b140-c5ca25783bca/action" status: 202 len: 0 microversion: 2.1 time: 0.119471 Sep 14 09:47:13.151623 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3636/6960] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:47:13 2022] POST /compute/v2.1/servers/7b1e3385-d546-471e-b140-c5ca25783bca/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 14 09:47:13.159421 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ecba1be6-a917-454e-ae61-c840000265aa tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:47:13.160041 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-ecba1be6-a917-454e-ae61-c840000265aa tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 7b1e3385-d546-471e-b140-c5ca25783bca] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:47:13.166117 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ecba1be6-a917-454e-ae61-c840000265aa tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:13.166609 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ecba1be6-a917-454e-ae61-c840000265aa tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:13.167109 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ecba1be6-a917-454e-ae61-c840000265aa tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:13.167810 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ecba1be6-a917-454e-ae61-c840000265aa tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:13.168268 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ecba1be6-a917-454e-ae61-c840000265aa tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:13.168696 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ecba1be6-a917-454e-ae61-c840000265aa tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:13.308740 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-ecba1be6-a917-454e-ae61-c840000265aa tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:47:13.317309 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-ecba1be6-a917-454e-ae61-c840000265aa tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/7b1e3385-d546-471e-b140-c5ca25783bca" status: 200 len: 1677 microversion: 2.1 time: 0.161598 Sep 14 09:47:13.317898 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3637/6961] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:47:13 2022] GET /compute/v2.1/servers/7b1e3385-d546-471e-b140-c5ca25783bca => generated 1677 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:47:14.342508 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-08528746-09af-4975-9b01-06e596ec8fb0 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:47:14.343163 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-08528746-09af-4975-9b01-06e596ec8fb0 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 7b1e3385-d546-471e-b140-c5ca25783bca] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:47:14.351032 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-08528746-09af-4975-9b01-06e596ec8fb0 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:14.351528 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-08528746-09af-4975-9b01-06e596ec8fb0 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:14.351972 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-08528746-09af-4975-9b01-06e596ec8fb0 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:14.352854 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-08528746-09af-4975-9b01-06e596ec8fb0 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:14.353337 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-08528746-09af-4975-9b01-06e596ec8fb0 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:14.353792 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-08528746-09af-4975-9b01-06e596ec8fb0 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:14.490651 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-08528746-09af-4975-9b01-06e596ec8fb0 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:47:14.498475 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-08528746-09af-4975-9b01-06e596ec8fb0 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/7b1e3385-d546-471e-b140-c5ca25783bca" status: 200 len: 1677 microversion: 2.1 time: 0.161858 Sep 14 09:47:14.499079 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3638/6962] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:47:14 2022] GET /compute/v2.1/servers/7b1e3385-d546-471e-b140-c5ca25783bca => generated 1677 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:47:15.523910 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ed151436-c3db-4cb5-b9d8-b1bb150c35e3 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:47:15.524544 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-ed151436-c3db-4cb5-b9d8-b1bb150c35e3 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 7b1e3385-d546-471e-b140-c5ca25783bca] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:47:15.531339 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ed151436-c3db-4cb5-b9d8-b1bb150c35e3 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:15.531835 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ed151436-c3db-4cb5-b9d8-b1bb150c35e3 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:15.532280 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ed151436-c3db-4cb5-b9d8-b1bb150c35e3 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:15.532979 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ed151436-c3db-4cb5-b9d8-b1bb150c35e3 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:15.533473 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ed151436-c3db-4cb5-b9d8-b1bb150c35e3 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:15.534514 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ed151436-c3db-4cb5-b9d8-b1bb150c35e3 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:15.538690 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:47:15.663296 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-ed151436-c3db-4cb5-b9d8-b1bb150c35e3 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:47:15.671137 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-ed151436-c3db-4cb5-b9d8-b1bb150c35e3 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/7b1e3385-d546-471e-b140-c5ca25783bca" status: 200 len: 1682 microversion: 2.1 time: 0.151252 Sep 14 09:47:15.671719 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3639/6963] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:47:15 2022] GET /compute/v2.1/servers/7b1e3385-d546-471e-b140-c5ca25783bca => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:47:16.694576 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a79d4b7a-75d6-476b-9efd-8e17bccad313 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:47:16.695248 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-a79d4b7a-75d6-476b-9efd-8e17bccad313 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 7b1e3385-d546-471e-b140-c5ca25783bca] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:47:16.702111 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a79d4b7a-75d6-476b-9efd-8e17bccad313 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:16.702605 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a79d4b7a-75d6-476b-9efd-8e17bccad313 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:16.703081 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a79d4b7a-75d6-476b-9efd-8e17bccad313 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:16.703782 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a79d4b7a-75d6-476b-9efd-8e17bccad313 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:16.704250 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a79d4b7a-75d6-476b-9efd-8e17bccad313 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:16.704681 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a79d4b7a-75d6-476b-9efd-8e17bccad313 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:16.838151 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-a79d4b7a-75d6-476b-9efd-8e17bccad313 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:47:16.846874 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a79d4b7a-75d6-476b-9efd-8e17bccad313 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/7b1e3385-d546-471e-b140-c5ca25783bca" status: 200 len: 1682 microversion: 2.1 time: 0.155737 Sep 14 09:47:16.847676 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3640/6964] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:47:16 2022] GET /compute/v2.1/servers/7b1e3385-d546-471e-b140-c5ca25783bca => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:47:17.740241 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-4d4ef036-e9f7-458d-9d76-00e329cc9cd1 req-a5ca8afb-e4ce-4283-96b3-c014c084496b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b1e3385-d546-471e-b140-c5ca25783bca", "name": "network-vif-unplugged", "status": "completed", "tag": "818f11dc-8678-4091-91d1-069a7c021da7"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:47:17.749899 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-4d4ef036-e9f7-458d-9d76-00e329cc9cd1 req-a5ca8afb-e4ce-4283-96b3-c014c084496b service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:17.750389 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-4d4ef036-e9f7-458d-9d76-00e329cc9cd1 req-a5ca8afb-e4ce-4283-96b3-c014c084496b service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:17.750823 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-4d4ef036-e9f7-458d-9d76-00e329cc9cd1 req-a5ca8afb-e4ce-4283-96b3-c014c084496b service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:17.763052 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-4d4ef036-e9f7-458d-9d76-00e329cc9cd1 req-a5ca8afb-e4ce-4283-96b3-c014c084496b service nova] Creating event network-vif-unplugged:818f11dc-8678-4091-91d1-069a7c021da7 for instance 7b1e3385-d546-471e-b140-c5ca25783bca on n-h1-836830-18 Sep 14 09:47:17.769082 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [req-4d4ef036-e9f7-458d-9d76-00e329cc9cd1 req-a5ca8afb-e4ce-4283-96b3-c014c084496b service nova] Instance 7b1e3385-d546-471e-b140-c5ca25783bca is migrating within the same cell, copying events to all relevant hosts: {'n-h1-836830-18', 'n-h2-836830-18'} {{(pid=128759) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 14 09:47:17.779837 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-4d4ef036-e9f7-458d-9d76-00e329cc9cd1 req-a5ca8afb-e4ce-4283-96b3-c014c084496b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.093823 Sep 14 09:47:17.780380 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3641/6965] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:47:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:47:17.870423 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ea54b60d-e3da-4758-b76b-e4d6073d0dfe tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:47:17.871190 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-ea54b60d-e3da-4758-b76b-e4d6073d0dfe tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 7b1e3385-d546-471e-b140-c5ca25783bca] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:47:17.878180 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ea54b60d-e3da-4758-b76b-e4d6073d0dfe tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:17.878678 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ea54b60d-e3da-4758-b76b-e4d6073d0dfe tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:17.879162 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ea54b60d-e3da-4758-b76b-e4d6073d0dfe tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:17.879897 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ea54b60d-e3da-4758-b76b-e4d6073d0dfe tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:17.880363 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ea54b60d-e3da-4758-b76b-e4d6073d0dfe tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:17.880796 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ea54b60d-e3da-4758-b76b-e4d6073d0dfe tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:18.013494 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-ea54b60d-e3da-4758-b76b-e4d6073d0dfe tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:47:18.022103 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-ea54b60d-e3da-4758-b76b-e4d6073d0dfe tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/7b1e3385-d546-471e-b140-c5ca25783bca" status: 200 len: 1681 microversion: 2.1 time: 0.156044 Sep 14 09:47:18.022688 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3642/6966] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:47:17 2022] GET /compute/v2.1/servers/7b1e3385-d546-471e-b140-c5ca25783bca => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:47:19.046011 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-67894932-5183-4c43-b55a-e6b1426c7537 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:47:19.046688 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-67894932-5183-4c43-b55a-e6b1426c7537 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 7b1e3385-d546-471e-b140-c5ca25783bca] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:47:19.054102 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-67894932-5183-4c43-b55a-e6b1426c7537 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:19.054592 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-67894932-5183-4c43-b55a-e6b1426c7537 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:19.055063 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-67894932-5183-4c43-b55a-e6b1426c7537 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:19.055760 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-67894932-5183-4c43-b55a-e6b1426c7537 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:19.056222 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-67894932-5183-4c43-b55a-e6b1426c7537 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:19.056651 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-67894932-5183-4c43-b55a-e6b1426c7537 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:19.188504 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-67894932-5183-4c43-b55a-e6b1426c7537 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:47:19.196798 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-67894932-5183-4c43-b55a-e6b1426c7537 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/7b1e3385-d546-471e-b140-c5ca25783bca" status: 200 len: 1679 microversion: 2.1 time: 0.154841 Sep 14 09:47:19.197379 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3643/6967] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:47:19 2022] GET /compute/v2.1/servers/7b1e3385-d546-471e-b140-c5ca25783bca => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:47:19.797435 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-7b553fcd-57eb-4cd2-b7cd-ed9e8c214c7b req-cab31ec0-acea-4e1e-a5ae-b865738857cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b1e3385-d546-471e-b140-c5ca25783bca", "tag": "818f11dc-8678-4091-91d1-069a7c021da7"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:47:19.806952 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-7b553fcd-57eb-4cd2-b7cd-ed9e8c214c7b req-cab31ec0-acea-4e1e-a5ae-b865738857cf service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:19.807449 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-7b553fcd-57eb-4cd2-b7cd-ed9e8c214c7b req-cab31ec0-acea-4e1e-a5ae-b865738857cf service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:19.807883 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-7b553fcd-57eb-4cd2-b7cd-ed9e8c214c7b req-cab31ec0-acea-4e1e-a5ae-b865738857cf service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:19.819473 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-7b553fcd-57eb-4cd2-b7cd-ed9e8c214c7b req-cab31ec0-acea-4e1e-a5ae-b865738857cf service nova] Creating event network-changed:818f11dc-8678-4091-91d1-069a7c021da7 for instance 7b1e3385-d546-471e-b140-c5ca25783bca on n-h1-836830-18 Sep 14 09:47:19.824815 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [req-7b553fcd-57eb-4cd2-b7cd-ed9e8c214c7b req-cab31ec0-acea-4e1e-a5ae-b865738857cf service nova] Instance 7b1e3385-d546-471e-b140-c5ca25783bca is migrating within the same cell, copying events to all relevant hosts: {'n-h1-836830-18', 'n-h2-836830-18'} {{(pid=128759) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 14 09:47:19.836184 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-7b553fcd-57eb-4cd2-b7cd-ed9e8c214c7b req-cab31ec0-acea-4e1e-a5ae-b865738857cf service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042393 Sep 14 09:47:19.836808 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3644/6968] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:47:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:47:20.222630 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-44299be5-52eb-4eb4-9fd3-c05c5b6e6553 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:47:20.223367 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-44299be5-52eb-4eb4-9fd3-c05c5b6e6553 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 7b1e3385-d546-471e-b140-c5ca25783bca] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:47:20.229647 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-44299be5-52eb-4eb4-9fd3-c05c5b6e6553 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:20.230146 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-44299be5-52eb-4eb4-9fd3-c05c5b6e6553 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:20.230591 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-44299be5-52eb-4eb4-9fd3-c05c5b6e6553 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:20.231322 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-44299be5-52eb-4eb4-9fd3-c05c5b6e6553 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:20.231785 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-44299be5-52eb-4eb4-9fd3-c05c5b6e6553 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:20.232224 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-44299be5-52eb-4eb4-9fd3-c05c5b6e6553 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:20.367343 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-44299be5-52eb-4eb4-9fd3-c05c5b6e6553 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:47:20.375315 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-44299be5-52eb-4eb4-9fd3-c05c5b6e6553 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/7b1e3385-d546-471e-b140-c5ca25783bca" status: 200 len: 1679 microversion: 2.1 time: 0.158322 Sep 14 09:47:20.376193 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3645/6969] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:47:20 2022] GET /compute/v2.1/servers/7b1e3385-d546-471e-b140-c5ca25783bca => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:47:21.398571 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e4f06859-875c-449e-a22e-408655c006b3 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:47:21.399320 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e4f06859-875c-449e-a22e-408655c006b3 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 7b1e3385-d546-471e-b140-c5ca25783bca] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:47:21.406066 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e4f06859-875c-449e-a22e-408655c006b3 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:21.406563 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e4f06859-875c-449e-a22e-408655c006b3 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:21.407024 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e4f06859-875c-449e-a22e-408655c006b3 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:21.407716 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e4f06859-875c-449e-a22e-408655c006b3 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:21.408167 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e4f06859-875c-449e-a22e-408655c006b3 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:21.408585 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e4f06859-875c-449e-a22e-408655c006b3 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:21.539004 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-e4f06859-875c-449e-a22e-408655c006b3 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:47:21.546818 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e4f06859-875c-449e-a22e-408655c006b3 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/7b1e3385-d546-471e-b140-c5ca25783bca" status: 200 len: 1675 microversion: 2.1 time: 0.152246 Sep 14 09:47:21.547455 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3646/6970] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:47:21 2022] GET /compute/v2.1/servers/7b1e3385-d546-471e-b140-c5ca25783bca => generated 1675 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:47:21.570362 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-32aff9df-eb5a-4b67-bf93-cd462e8713c1 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:47:21.571185 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-32aff9df-eb5a-4b67-bf93-cd462e8713c1 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 7b1e3385-d546-471e-b140-c5ca25783bca] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:47:21.577234 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-32aff9df-eb5a-4b67-bf93-cd462e8713c1 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:21.577727 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-32aff9df-eb5a-4b67-bf93-cd462e8713c1 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:21.578165 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-32aff9df-eb5a-4b67-bf93-cd462e8713c1 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:21.578862 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-32aff9df-eb5a-4b67-bf93-cd462e8713c1 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:21.579342 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-32aff9df-eb5a-4b67-bf93-cd462e8713c1 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:21.579767 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-32aff9df-eb5a-4b67-bf93-cd462e8713c1 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:21.639309 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-32aff9df-eb5a-4b67-bf93-cd462e8713c1 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "POST /compute/v2.1/servers/7b1e3385-d546-471e-b140-c5ca25783bca/action" status: 204 len: 0 microversion: 2.1 time: 0.072591 Sep 14 09:47:21.640011 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3647/6971] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:47:21 2022] POST /compute/v2.1/servers/7b1e3385-d546-471e-b140-c5ca25783bca/action => generated 0 bytes in 75 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 14 09:47:21.649101 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ad2c4b76-c434-4123-9ab7-d3895fe676db tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:47:21.650067 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-ad2c4b76-c434-4123-9ab7-d3895fe676db tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 7b1e3385-d546-471e-b140-c5ca25783bca] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:47:21.657270 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ad2c4b76-c434-4123-9ab7-d3895fe676db tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:21.658196 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ad2c4b76-c434-4123-9ab7-d3895fe676db tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:21.658830 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ad2c4b76-c434-4123-9ab7-d3895fe676db tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:21.659993 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ad2c4b76-c434-4123-9ab7-d3895fe676db tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:21.660627 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ad2c4b76-c434-4123-9ab7-d3895fe676db tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:21.661070 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ad2c4b76-c434-4123-9ab7-d3895fe676db tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:21.804148 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-ad2c4b76-c434-4123-9ab7-d3895fe676db tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:47:21.812351 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-ad2c4b76-c434-4123-9ab7-d3895fe676db tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/7b1e3385-d546-471e-b140-c5ca25783bca" status: 200 len: 1675 microversion: 2.1 time: 0.167487 Sep 14 09:47:21.812946 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3648/6972] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:47:21 2022] GET /compute/v2.1/servers/7b1e3385-d546-471e-b140-c5ca25783bca => generated 1675 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:47:22.836991 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f31efd9b-2c2f-41b8-8aad-eb825f0f2776 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:47:22.837664 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f31efd9b-2c2f-41b8-8aad-eb825f0f2776 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 7b1e3385-d546-471e-b140-c5ca25783bca] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:47:22.845083 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f31efd9b-2c2f-41b8-8aad-eb825f0f2776 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:22.845698 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f31efd9b-2c2f-41b8-8aad-eb825f0f2776 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:22.846132 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f31efd9b-2c2f-41b8-8aad-eb825f0f2776 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:22.847513 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f31efd9b-2c2f-41b8-8aad-eb825f0f2776 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:22.848011 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f31efd9b-2c2f-41b8-8aad-eb825f0f2776 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:22.848437 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f31efd9b-2c2f-41b8-8aad-eb825f0f2776 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:23.002621 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f31efd9b-2c2f-41b8-8aad-eb825f0f2776 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:47:23.010509 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f31efd9b-2c2f-41b8-8aad-eb825f0f2776 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/7b1e3385-d546-471e-b140-c5ca25783bca" status: 200 len: 1654 microversion: 2.1 time: 0.177407 Sep 14 09:47:23.011116 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3649/6973] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:47:22 2022] GET /compute/v2.1/servers/7b1e3385-d546-471e-b140-c5ca25783bca => generated 1654 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:47:23.033402 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-97e5e43f-a475-4609-9fa8-1bfffe729bd2 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:47:23.034503 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-97e5e43f-a475-4609-9fa8-1bfffe729bd2 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 7b1e3385-d546-471e-b140-c5ca25783bca] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:47:23.040279 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-97e5e43f-a475-4609-9fa8-1bfffe729bd2 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:23.040805 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-97e5e43f-a475-4609-9fa8-1bfffe729bd2 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:23.041248 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-97e5e43f-a475-4609-9fa8-1bfffe729bd2 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:23.041939 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-97e5e43f-a475-4609-9fa8-1bfffe729bd2 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:23.042398 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-97e5e43f-a475-4609-9fa8-1bfffe729bd2 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:23.042826 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-97e5e43f-a475-4609-9fa8-1bfffe729bd2 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:23.173557 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-97e5e43f-a475-4609-9fa8-1bfffe729bd2 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:47:23.181410 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-97e5e43f-a475-4609-9fa8-1bfffe729bd2 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/7b1e3385-d546-471e-b140-c5ca25783bca" status: 200 len: 1654 microversion: 2.1 time: 0.151609 Sep 14 09:47:23.181993 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3650/6974] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:47:23 2022] GET /compute/v2.1/servers/7b1e3385-d546-471e-b140-c5ca25783bca => generated 1654 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:47:23.203452 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-cb5197fb-4f28-45e5-b165-7e47ba89e0d0 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:47:23.209866 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cb5197fb-4f28-45e5-b165-7e47ba89e0d0 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:23.210355 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cb5197fb-4f28-45e5-b165-7e47ba89e0d0 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:23.210800 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cb5197fb-4f28-45e5-b165-7e47ba89e0d0 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:23.233382 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-cb5197fb-4f28-45e5-b165-7e47ba89e0d0 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 7b1e3385-d546-471e-b140-c5ca25783bca] Going to try to start instance {{(pid=128759) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 14 09:47:23.277794 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-cb5197fb-4f28-45e5-b165-7e47ba89e0d0 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "POST /compute/v2.1/servers/7b1e3385-d546-471e-b140-c5ca25783bca/action" status: 202 len: 0 microversion: 2.1 time: 0.077706 Sep 14 09:47:23.278396 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3651/6975] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:47:23 2022] POST /compute/v2.1/servers/7b1e3385-d546-471e-b140-c5ca25783bca/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 14 09:47:23.286795 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-2726fc04-1aa8-4e9d-b2ae-b4e8298adba5 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:47:23.287457 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-2726fc04-1aa8-4e9d-b2ae-b4e8298adba5 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 7b1e3385-d546-471e-b140-c5ca25783bca] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:47:23.294125 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2726fc04-1aa8-4e9d-b2ae-b4e8298adba5 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:23.294602 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2726fc04-1aa8-4e9d-b2ae-b4e8298adba5 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:23.295130 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2726fc04-1aa8-4e9d-b2ae-b4e8298adba5 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:23.295827 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2726fc04-1aa8-4e9d-b2ae-b4e8298adba5 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:23.296295 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2726fc04-1aa8-4e9d-b2ae-b4e8298adba5 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:23.296719 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2726fc04-1aa8-4e9d-b2ae-b4e8298adba5 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:23.435750 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-2726fc04-1aa8-4e9d-b2ae-b4e8298adba5 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:47:23.444430 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-2726fc04-1aa8-4e9d-b2ae-b4e8298adba5 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/7b1e3385-d546-471e-b140-c5ca25783bca" status: 200 len: 1663 microversion: 2.1 time: 0.161701 Sep 14 09:47:23.445386 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3652/6976] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:47:23 2022] GET /compute/v2.1/servers/7b1e3385-d546-471e-b140-c5ca25783bca => generated 1663 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:47:24.494509 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-9d9050c1-8c88-4684-b0d3-39f24a358e05 req-82b2502d-227f-4bb5-a999-3f66b476dbcd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b1e3385-d546-471e-b140-c5ca25783bca", "name": "network-vif-plugged", "status": "completed", "tag": "818f11dc-8678-4091-91d1-069a7c021da7"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:47:24.505488 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-9d9050c1-8c88-4684-b0d3-39f24a358e05 req-82b2502d-227f-4bb5-a999-3f66b476dbcd service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:24.505977 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-9d9050c1-8c88-4684-b0d3-39f24a358e05 req-82b2502d-227f-4bb5-a999-3f66b476dbcd service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:24.506601 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-9d9050c1-8c88-4684-b0d3-39f24a358e05 req-82b2502d-227f-4bb5-a999-3f66b476dbcd service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:24.519925 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-9d9050c1-8c88-4684-b0d3-39f24a358e05 req-82b2502d-227f-4bb5-a999-3f66b476dbcd service nova] Creating event network-vif-plugged:818f11dc-8678-4091-91d1-069a7c021da7 for instance 7b1e3385-d546-471e-b140-c5ca25783bca on n-h1-836830-18 Sep 14 09:47:24.524683 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-9d9050c1-8c88-4684-b0d3-39f24a358e05 req-82b2502d-227f-4bb5-a999-3f66b476dbcd service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089170 Sep 14 09:47:24.525291 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3653/6977] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:47:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:47:24.530467 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a01eb756-7f24-4c81-ac82-a2ea595779af tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:47:24.531359 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-a01eb756-7f24-4c81-ac82-a2ea595779af tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 7b1e3385-d546-471e-b140-c5ca25783bca] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:47:24.537592 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a01eb756-7f24-4c81-ac82-a2ea595779af tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:24.538088 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a01eb756-7f24-4c81-ac82-a2ea595779af tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:24.538540 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a01eb756-7f24-4c81-ac82-a2ea595779af tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:24.539275 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a01eb756-7f24-4c81-ac82-a2ea595779af tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:24.539742 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a01eb756-7f24-4c81-ac82-a2ea595779af tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:24.540180 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a01eb756-7f24-4c81-ac82-a2ea595779af tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:24.670253 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-a01eb756-7f24-4c81-ac82-a2ea595779af tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:47:24.678661 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a01eb756-7f24-4c81-ac82-a2ea595779af tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/7b1e3385-d546-471e-b140-c5ca25783bca" status: 200 len: 1667 microversion: 2.1 time: 0.152210 Sep 14 09:47:24.679268 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3654/6978] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:47:24 2022] GET /compute/v2.1/servers/7b1e3385-d546-471e-b140-c5ca25783bca => generated 1667 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:47:24.700593 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-bbcf3678-17cf-48b9-8bca-483476566f9e tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:47:24.701100 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-bbcf3678-17cf-48b9-8bca-483476566f9e tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 7b1e3385-d546-471e-b140-c5ca25783bca] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:47:24.707065 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bbcf3678-17cf-48b9-8bca-483476566f9e tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:24.707556 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bbcf3678-17cf-48b9-8bca-483476566f9e tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:24.708002 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bbcf3678-17cf-48b9-8bca-483476566f9e tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:24.708700 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bbcf3678-17cf-48b9-8bca-483476566f9e tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:24.709162 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bbcf3678-17cf-48b9-8bca-483476566f9e tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:24.709596 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bbcf3678-17cf-48b9-8bca-483476566f9e tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:24.713629 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:47:24.736779 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-bbcf3678-17cf-48b9-8bca-483476566f9e tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 7b1e3385-d546-471e-b140-c5ca25783bca] Going to try to terminate instance {{(pid=128759) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:47:24.812410 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-bbcf3678-17cf-48b9-8bca-483476566f9e tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "DELETE /compute/v2.1/servers/7b1e3385-d546-471e-b140-c5ca25783bca" status: 204 len: 0 microversion: 2.1 time: 0.115009 Sep 14 09:47:24.812934 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3655/6979] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:47:24 2022] DELETE /compute/v2.1/servers/7b1e3385-d546-471e-b140-c5ca25783bca => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 14 09:47:24.821598 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-465b31b1-fffd-499c-982d-aae0a505e045 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:47:24.822308 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-465b31b1-fffd-499c-982d-aae0a505e045 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 7b1e3385-d546-471e-b140-c5ca25783bca] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:47:24.828327 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-465b31b1-fffd-499c-982d-aae0a505e045 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:24.828811 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-465b31b1-fffd-499c-982d-aae0a505e045 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:24.829244 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-465b31b1-fffd-499c-982d-aae0a505e045 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:24.829961 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-465b31b1-fffd-499c-982d-aae0a505e045 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:24.830414 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-465b31b1-fffd-499c-982d-aae0a505e045 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:24.830853 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-465b31b1-fffd-499c-982d-aae0a505e045 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:24.971858 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-465b31b1-fffd-499c-982d-aae0a505e045 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:47:24.982044 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-465b31b1-fffd-499c-982d-aae0a505e045 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/7b1e3385-d546-471e-b140-c5ca25783bca" status: 200 len: 1673 microversion: 2.1 time: 0.164505 Sep 14 09:47:24.982621 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3656/6980] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:47:24 2022] GET /compute/v2.1/servers/7b1e3385-d546-471e-b140-c5ca25783bca => generated 1673 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:47:26.005857 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f39c46ec-b2f7-4e88-a127-1e8c0c00052c tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:47:26.006541 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f39c46ec-b2f7-4e88-a127-1e8c0c00052c tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 7b1e3385-d546-471e-b140-c5ca25783bca] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:47:26.013046 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f39c46ec-b2f7-4e88-a127-1e8c0c00052c tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:26.013542 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f39c46ec-b2f7-4e88-a127-1e8c0c00052c tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:26.013984 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f39c46ec-b2f7-4e88-a127-1e8c0c00052c tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:26.014684 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f39c46ec-b2f7-4e88-a127-1e8c0c00052c tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:26.015172 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f39c46ec-b2f7-4e88-a127-1e8c0c00052c tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:26.015608 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f39c46ec-b2f7-4e88-a127-1e8c0c00052c tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:26.145837 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f39c46ec-b2f7-4e88-a127-1e8c0c00052c tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:47:26.153662 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f39c46ec-b2f7-4e88-a127-1e8c0c00052c tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/7b1e3385-d546-471e-b140-c5ca25783bca" status: 200 len: 1673 microversion: 2.1 time: 0.152476 Sep 14 09:47:26.154236 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3657/6981] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:47:26 2022] GET /compute/v2.1/servers/7b1e3385-d546-471e-b140-c5ca25783bca => generated 1673 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:47:27.050654 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-54a15404-a4a4-45d0-a70d-10a26356d9c7 req-52c606aa-19e4-4d6f-9dd9-fd0ef56e51b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b1e3385-d546-471e-b140-c5ca25783bca", "name": "network-vif-deleted", "tag": "818f11dc-8678-4091-91d1-069a7c021da7"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:47:27.061236 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-54a15404-a4a4-45d0-a70d-10a26356d9c7 req-52c606aa-19e4-4d6f-9dd9-fd0ef56e51b9 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:27.061724 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-54a15404-a4a4-45d0-a70d-10a26356d9c7 req-52c606aa-19e4-4d6f-9dd9-fd0ef56e51b9 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:27.062163 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-54a15404-a4a4-45d0-a70d-10a26356d9c7 req-52c606aa-19e4-4d6f-9dd9-fd0ef56e51b9 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:27.074399 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-54a15404-a4a4-45d0-a70d-10a26356d9c7 req-52c606aa-19e4-4d6f-9dd9-fd0ef56e51b9 service nova] Creating event network-vif-deleted:818f11dc-8678-4091-91d1-069a7c021da7 for instance 7b1e3385-d546-471e-b140-c5ca25783bca on n-h1-836830-18 Sep 14 09:47:27.079394 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-54a15404-a4a4-45d0-a70d-10a26356d9c7 req-52c606aa-19e4-4d6f-9dd9-fd0ef56e51b9 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032468 Sep 14 09:47:27.083508 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3658/6982] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:47:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:47:27.178909 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c898f99b-ffb2-4a5e-a6e7-2e23879207ea tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:47:27.179711 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-c898f99b-ffb2-4a5e-a6e7-2e23879207ea tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 7b1e3385-d546-471e-b140-c5ca25783bca] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:47:27.185990 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c898f99b-ffb2-4a5e-a6e7-2e23879207ea tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:27.186482 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c898f99b-ffb2-4a5e-a6e7-2e23879207ea tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:27.186917 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c898f99b-ffb2-4a5e-a6e7-2e23879207ea tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:27.187708 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c898f99b-ffb2-4a5e-a6e7-2e23879207ea tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:27.188172 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c898f99b-ffb2-4a5e-a6e7-2e23879207ea tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:27.188604 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c898f99b-ffb2-4a5e-a6e7-2e23879207ea tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:27.222727 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c898f99b-ffb2-4a5e-a6e7-2e23879207ea tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:27.223263 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c898f99b-ffb2-4a5e-a6e7-2e23879207ea tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:27.223687 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c898f99b-ffb2-4a5e-a6e7-2e23879207ea tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:27.224134 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.objects.instance [None req-c898f99b-ffb2-4a5e-a6e7-2e23879207ea tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lazy-loading 'fault' on Instance uuid 7b1e3385-d546-471e-b140-c5ca25783bca {{(pid=128759) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:47:27.273687 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-c898f99b-ffb2-4a5e-a6e7-2e23879207ea tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:47:27.283473 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-c898f99b-ffb2-4a5e-a6e7-2e23879207ea tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/7b1e3385-d546-471e-b140-c5ca25783bca" status: 200 len: 1328 microversion: 2.1 time: 0.109204 Sep 14 09:47:27.286990 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3659/6983] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:47:27 2022] GET /compute/v2.1/servers/7b1e3385-d546-471e-b140-c5ca25783bca => generated 1328 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:47:28.307870 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-6384b9ff-f906-47b8-87da-f81f24065b6c tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:47:28.308522 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-6384b9ff-f906-47b8-87da-f81f24065b6c tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 7b1e3385-d546-471e-b140-c5ca25783bca] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:47:28.316021 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6384b9ff-f906-47b8-87da-f81f24065b6c tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:28.316443 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6384b9ff-f906-47b8-87da-f81f24065b6c tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:28.316877 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6384b9ff-f906-47b8-87da-f81f24065b6c tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:28.317556 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6384b9ff-f906-47b8-87da-f81f24065b6c tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:28.318009 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6384b9ff-f906-47b8-87da-f81f24065b6c tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:28.318431 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6384b9ff-f906-47b8-87da-f81f24065b6c tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:28.332310 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-6384b9ff-f906-47b8-87da-f81f24065b6c tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] HTTP exception thrown: Instance 7b1e3385-d546-471e-b140-c5ca25783bca could not be found. Sep 14 09:47:28.333942 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-6384b9ff-f906-47b8-87da-f81f24065b6c tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Request method failure captured: Sep 14 09:47:28.333942 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/7b1e3385-d546-471e-b140-c5ca25783bca HTTP/1.1 Sep 14 09:47:28.333942 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:47:28.333942 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:47:28.333942 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:47:28.333942 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:47:28.333942 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:47:28.333942 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:47:28.333942 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:47:28.333942 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:47:28.333942 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIaKBrBAh_wj7DfZiRKdrZ6pB2BVsnaFIACH9I9tnPwlUsTvBKg4Km-70hzyiQAJmR8uMyCC--Kmi_m3mCvjQEmAIcuX7dXHviBWfEEzRkbjLifKvzwHyNal8H1sdEC_eoJmfTTtUV4zMyNBM3to2Z7TJSY3tl0h8kAHjt5BuvlhekYs Sep 14 09:47:28.333942 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:47:28.333942 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:47:28.333942 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:47:28.333942 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:47:28.333942 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:47:28.333942 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:47:28.333942 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 270f637ba197498bb4f7fa1ba14a62ad Sep 14 09:47:28.333942 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ServerActionsTestJSON-1037640335 Sep 14 09:47:28.333942 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:47:28.333942 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:47:28.333942 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/270f637ba197498bb4f7fa1ba14a62ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_270f637ba197498bb4f7fa1ba14a62ad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/270f637ba197498bb4f7fa1ba14a62ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/270f637ba197498bb4f7fa1ba14a62ad"}]}] Sep 14 09:47:28.333942 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ServerActionsTestJSON-1037640335 Sep 14 09:47:28.333942 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 270f637ba197498bb4f7fa1ba14a62ad Sep 14 09:47:28.333942 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ServerActionsTestJSON-1037640335 Sep 14 09:47:28.333942 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ServerActionsTestJSON-1037640335-project Sep 14 09:47:28.333942 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:47:28.333942 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:47:28.333942 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 5de83b9937f145dbbe1091039327e71a Sep 14 09:47:28.333942 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ServerActionsTestJSON-1037640335-project Sep 14 09:47:28.333942 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:47:28.333942 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance 7b1e3385-d546-471e-b140-c5ca25783bca could not be found. Sep 14 09:47:28.333942 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '7b1e3385-d546-471e-b140-c5ca25783bca'} Sep 14 09:47:28.333942 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:47:28.333942 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:47:28.333942 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:47:28.333942 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:47:28.333942 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:47:28.333942 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:47:28.333942 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:47:28.333942 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:47:28.333942 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:47:28.333942 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:47:28.333942 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b1e3385-d546-471e-b140-c5ca25783bca could not be found. Sep 14 09:47:28.333942 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:47:28.333942 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:47:28.333942 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:47:28.333942 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:47:28.333942 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:47:28.333942 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:47:28.333942 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:47:28.333942 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:47:28.333942 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:47:28.333942 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:47:28.333942 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:47:28.333942 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:47:28.333942 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:47:28.333942 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:47:28.333942 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:47:28.333942 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:47:28.333942 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b1e3385-d546-471e-b140-c5ca25783bca could not be found. Sep 14 09:47:28.333942 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:47:28.333942 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:47:28.333942 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:47:28.338981 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:47:28.338981 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:47:28.338981 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:47:28.338981 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:47:28.338981 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:47:28.338981 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b1e3385-d546-471e-b140-c5ca25783bca could not be found. Sep 14 09:47:28.338981 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:47:28.338981 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-6384b9ff-f906-47b8-87da-f81f24065b6c tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Returning 404 to user: Instance 7b1e3385-d546-471e-b140-c5ca25783bca could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:47:28.338981 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-6384b9ff-f906-47b8-87da-f81f24065b6c tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/7b1e3385-d546-471e-b140-c5ca25783bca" status: 404 len: 111 microversion: 2.1 time: 0.031418 Sep 14 09:47:28.338981 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3660/6984] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:47:28 2022] GET /compute/v2.1/servers/7b1e3385-d546-471e-b140-c5ca25783bca => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 14 09:47:28.351429 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-36874438-f774-4460-aeea-0a334e3ad588 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:47:28.352035 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-36874438-f774-4460-aeea-0a334e3ad588 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 7b1e3385-d546-471e-b140-c5ca25783bca] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:47:28.357823 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-36874438-f774-4460-aeea-0a334e3ad588 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:28.358303 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-36874438-f774-4460-aeea-0a334e3ad588 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:28.358738 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-36874438-f774-4460-aeea-0a334e3ad588 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:28.359483 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-36874438-f774-4460-aeea-0a334e3ad588 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:28.359936 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-36874438-f774-4460-aeea-0a334e3ad588 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:28.360359 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-36874438-f774-4460-aeea-0a334e3ad588 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:28.374344 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-36874438-f774-4460-aeea-0a334e3ad588 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] HTTP exception thrown: Instance 7b1e3385-d546-471e-b140-c5ca25783bca could not be found. Sep 14 09:47:28.375887 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-36874438-f774-4460-aeea-0a334e3ad588 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Request method failure captured: Sep 14 09:47:28.375887 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/7b1e3385-d546-471e-b140-c5ca25783bca HTTP/1.1 Sep 14 09:47:28.375887 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:47:28.375887 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:47:28.375887 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:47:28.375887 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:47:28.375887 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:47:28.375887 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:47:28.375887 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:47:28.375887 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:47:28.375887 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIaKBrBAh_wj7DfZiRKdrZ6pB2BVsnaFIACH9I9tnPwlUsTvBKg4Km-70hzyiQAJmR8uMyCC--Kmi_m3mCvjQEmAIcuX7dXHviBWfEEzRkbjLifKvzwHyNal8H1sdEC_eoJmfTTtUV4zMyNBM3to2Z7TJSY3tl0h8kAHjt5BuvlhekYs Sep 14 09:47:28.375887 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:47:28.375887 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:47:28.375887 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:47:28.375887 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:47:28.375887 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:47:28.375887 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:47:28.375887 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 270f637ba197498bb4f7fa1ba14a62ad Sep 14 09:47:28.375887 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ServerActionsTestJSON-1037640335 Sep 14 09:47:28.375887 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:47:28.375887 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:47:28.375887 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/270f637ba197498bb4f7fa1ba14a62ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_270f637ba197498bb4f7fa1ba14a62ad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/270f637ba197498bb4f7fa1ba14a62ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/270f637ba197498bb4f7fa1ba14a62ad"}]}] Sep 14 09:47:28.375887 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ServerActionsTestJSON-1037640335 Sep 14 09:47:28.375887 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 270f637ba197498bb4f7fa1ba14a62ad Sep 14 09:47:28.375887 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ServerActionsTestJSON-1037640335 Sep 14 09:47:28.375887 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ServerActionsTestJSON-1037640335-project Sep 14 09:47:28.375887 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:47:28.375887 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:47:28.375887 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 5de83b9937f145dbbe1091039327e71a Sep 14 09:47:28.375887 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ServerActionsTestJSON-1037640335-project Sep 14 09:47:28.375887 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:47:28.375887 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance 7b1e3385-d546-471e-b140-c5ca25783bca could not be found. Sep 14 09:47:28.375887 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '7b1e3385-d546-471e-b140-c5ca25783bca'} Sep 14 09:47:28.375887 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:47:28.375887 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:47:28.375887 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:47:28.375887 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:47:28.375887 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:47:28.375887 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:47:28.375887 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:47:28.375887 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:47:28.375887 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:47:28.375887 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:47:28.375887 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b1e3385-d546-471e-b140-c5ca25783bca could not be found. Sep 14 09:47:28.375887 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:47:28.375887 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:47:28.375887 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:47:28.375887 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:47:28.375887 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:47:28.375887 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:47:28.375887 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:47:28.375887 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:47:28.375887 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:47:28.375887 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:47:28.375887 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:47:28.375887 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:47:28.375887 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:47:28.375887 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:47:28.375887 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:47:28.375887 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:47:28.375887 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b1e3385-d546-471e-b140-c5ca25783bca could not be found. Sep 14 09:47:28.375887 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:47:28.375887 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:47:28.375887 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:47:28.380143 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:47:28.380143 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:47:28.380143 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:47:28.380143 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:47:28.380143 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:47:28.380143 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b1e3385-d546-471e-b140-c5ca25783bca could not be found. Sep 14 09:47:28.380143 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:47:28.380143 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-36874438-f774-4460-aeea-0a334e3ad588 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Returning 404 to user: Instance 7b1e3385-d546-471e-b140-c5ca25783bca could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:47:28.380143 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-36874438-f774-4460-aeea-0a334e3ad588 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/7b1e3385-d546-471e-b140-c5ca25783bca" status: 404 len: 111 microversion: 2.1 time: 0.029407 Sep 14 09:47:28.380143 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3661/6985] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:47:28 2022] GET /compute/v2.1/servers/7b1e3385-d546-471e-b140-c5ca25783bca => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:47:28.428044 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-06f52c37-4985-4e9d-9c2e-0175990ff5bf tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2038628461", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "networks": [{"uuid": "5634288b-23f2-493a-aa6e-c62111a88261"}], "security_groups": [{"name": "tempest-securitygroup--438503213"}], "key_name": "tempest-keypair-254910026", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:47:28.531291 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.network.neutron [None req-06f52c37-4985-4e9d-9c2e-0175990ff5bf tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] validate_networks() for [('5634288b-23f2-493a-aa6e-c62111a88261', None, None, None, None, None)] {{(pid=128759) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:47:28.976681 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-06f52c37-4985-4e9d-9c2e-0175990ff5bf tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Flavor limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:47:28.977103 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-06f52c37-4985-4e9d-9c2e-0175990ff5bf tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Image limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:47:28.977576 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-06f52c37-4985-4e9d-9c2e-0175990ff5bf tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Flavor pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:47:28.977989 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-06f52c37-4985-4e9d-9c2e-0175990ff5bf tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Image pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:47:28.978401 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-06f52c37-4985-4e9d-9c2e-0175990ff5bf tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:47:28.988628 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-06f52c37-4985-4e9d-9c2e-0175990ff5bf tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:28.988628 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-06f52c37-4985-4e9d-9c2e-0175990ff5bf tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:28.988628 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-06f52c37-4985-4e9d-9c2e-0175990ff5bf tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:28.989556 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-06f52c37-4985-4e9d-9c2e-0175990ff5bf tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:28.989710 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-06f52c37-4985-4e9d-9c2e-0175990ff5bf tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:28.990131 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-06f52c37-4985-4e9d-9c2e-0175990ff5bf tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:29.007517 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-06f52c37-4985-4e9d-9c2e-0175990ff5bf tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Getting quotas for project 270f637ba197498bb4f7fa1ba14a62ad. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:47:29.012717 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-06f52c37-4985-4e9d-9c2e-0175990ff5bf tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Getting quotas for user 5de83b9937f145dbbe1091039327e71a and project 270f637ba197498bb4f7fa1ba14a62ad. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:47:29.021688 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:47:29.026099 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-06f52c37-4985-4e9d-9c2e-0175990ff5bf tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Going to run 1 instances... {{(pid=128759) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:47:29.028415 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-06f52c37-4985-4e9d-9c2e-0175990ff5bf tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 565c49d8-efe1-4dcb-b6b8-493de07df35d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128759) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:47:29.076116 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-06f52c37-4985-4e9d-9c2e-0175990ff5bf tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.651804 Sep 14 09:47:29.076792 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3662/6986] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 09:47:28 2022] POST /compute/v2.1/servers => generated 405 bytes in 653 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 14 09:47:29.087924 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8e3d860c-9cff-40db-9a57-a322ae8802b5 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:47:29.089174 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-8e3d860c-9cff-40db-9a57-a322ae8802b5 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 565c49d8-efe1-4dcb-b6b8-493de07df35d] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:47:29.143303 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-8e3d860c-9cff-40db-9a57-a322ae8802b5 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:47:29.151213 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-8e3d860c-9cff-40db-9a57-a322ae8802b5 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/565c49d8-efe1-4dcb-b6b8-493de07df35d" status: 200 len: 1238 microversion: 2.1 time: 0.067155 Sep 14 09:47:29.151787 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3663/6987] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:47:29 2022] GET /compute/v2.1/servers/565c49d8-efe1-4dcb-b6b8-493de07df35d => generated 1238 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:47:30.175465 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-71b2ef06-fecc-4939-9301-8aa829a247dd tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:47:30.176251 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-71b2ef06-fecc-4939-9301-8aa829a247dd tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 565c49d8-efe1-4dcb-b6b8-493de07df35d] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:47:30.183204 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-71b2ef06-fecc-4939-9301-8aa829a247dd tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:30.183701 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-71b2ef06-fecc-4939-9301-8aa829a247dd tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:30.184147 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-71b2ef06-fecc-4939-9301-8aa829a247dd tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:30.184849 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-71b2ef06-fecc-4939-9301-8aa829a247dd tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:30.185314 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-71b2ef06-fecc-4939-9301-8aa829a247dd tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:30.185770 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-71b2ef06-fecc-4939-9301-8aa829a247dd tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:30.254697 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-71b2ef06-fecc-4939-9301-8aa829a247dd tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:47:30.262795 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-71b2ef06-fecc-4939-9301-8aa829a247dd tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/565c49d8-efe1-4dcb-b6b8-493de07df35d" status: 200 len: 1296 microversion: 2.1 time: 0.091899 Sep 14 09:47:30.263408 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3664/6988] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:47:30 2022] GET /compute/v2.1/servers/565c49d8-efe1-4dcb-b6b8-493de07df35d => generated 1296 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:47:31.286672 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-6c3742c6-79b2-4f9b-a88b-adc5158daf44 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:47:31.287418 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-6c3742c6-79b2-4f9b-a88b-adc5158daf44 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 565c49d8-efe1-4dcb-b6b8-493de07df35d] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:47:31.295119 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6c3742c6-79b2-4f9b-a88b-adc5158daf44 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:31.295713 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6c3742c6-79b2-4f9b-a88b-adc5158daf44 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:31.296234 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6c3742c6-79b2-4f9b-a88b-adc5158daf44 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:31.297039 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6c3742c6-79b2-4f9b-a88b-adc5158daf44 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:31.297600 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6c3742c6-79b2-4f9b-a88b-adc5158daf44 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:31.298317 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6c3742c6-79b2-4f9b-a88b-adc5158daf44 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:31.440976 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-6c3742c6-79b2-4f9b-a88b-adc5158daf44 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:47:31.451020 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-6c3742c6-79b2-4f9b-a88b-adc5158daf44 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/565c49d8-efe1-4dcb-b6b8-493de07df35d" status: 200 len: 1363 microversion: 2.1 time: 0.168909 Sep 14 09:47:31.451930 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3665/6989] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:47:31 2022] GET /compute/v2.1/servers/565c49d8-efe1-4dcb-b6b8-493de07df35d => generated 1363 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:47:31.720982 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-fdbfe09b-a238-4e7b-b1fa-f6bde4632172 req-7623c83c-4396-4a83-9723-8bef91cfbfe8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "565c49d8-efe1-4dcb-b6b8-493de07df35d", "tag": "689af942-9fb7-45d0-903d-02cde067a6d0"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:47:31.733895 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-fdbfe09b-a238-4e7b-b1fa-f6bde4632172 req-7623c83c-4396-4a83-9723-8bef91cfbfe8 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:31.734367 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-fdbfe09b-a238-4e7b-b1fa-f6bde4632172 req-7623c83c-4396-4a83-9723-8bef91cfbfe8 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:31.734800 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-fdbfe09b-a238-4e7b-b1fa-f6bde4632172 req-7623c83c-4396-4a83-9723-8bef91cfbfe8 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:31.749567 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-fdbfe09b-a238-4e7b-b1fa-f6bde4632172 req-7623c83c-4396-4a83-9723-8bef91cfbfe8 service nova] Creating event network-changed:689af942-9fb7-45d0-903d-02cde067a6d0 for instance 565c49d8-efe1-4dcb-b6b8-493de07df35d on n-h2-836830-18 Sep 14 09:47:31.755082 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-fdbfe09b-a238-4e7b-b1fa-f6bde4632172 req-7623c83c-4396-4a83-9723-8bef91cfbfe8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038578 Sep 14 09:47:31.755700 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3666/6990] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:47:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:47:32.477309 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a07fe2e9-9694-4a19-addb-27099d3c3f58 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:47:32.478015 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-a07fe2e9-9694-4a19-addb-27099d3c3f58 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 565c49d8-efe1-4dcb-b6b8-493de07df35d] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:47:32.485061 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a07fe2e9-9694-4a19-addb-27099d3c3f58 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:32.485541 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a07fe2e9-9694-4a19-addb-27099d3c3f58 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:32.485984 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a07fe2e9-9694-4a19-addb-27099d3c3f58 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:32.486668 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a07fe2e9-9694-4a19-addb-27099d3c3f58 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:32.487151 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a07fe2e9-9694-4a19-addb-27099d3c3f58 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:32.487574 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a07fe2e9-9694-4a19-addb-27099d3c3f58 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:32.616307 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-a07fe2e9-9694-4a19-addb-27099d3c3f58 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:47:32.624235 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a07fe2e9-9694-4a19-addb-27099d3c3f58 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/565c49d8-efe1-4dcb-b6b8-493de07df35d" status: 200 len: 1363 microversion: 2.1 time: 0.151176 Sep 14 09:47:32.624799 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3667/6991] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:47:32 2022] GET /compute/v2.1/servers/565c49d8-efe1-4dcb-b6b8-493de07df35d => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:47:33.647452 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-181ab0d2-ef0b-44bb-a053-41f4268c4c83 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:47:33.648078 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-181ab0d2-ef0b-44bb-a053-41f4268c4c83 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 565c49d8-efe1-4dcb-b6b8-493de07df35d] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:47:33.655075 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-181ab0d2-ef0b-44bb-a053-41f4268c4c83 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:33.655570 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-181ab0d2-ef0b-44bb-a053-41f4268c4c83 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:33.656016 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-181ab0d2-ef0b-44bb-a053-41f4268c4c83 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:33.656714 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-181ab0d2-ef0b-44bb-a053-41f4268c4c83 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:33.657177 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-181ab0d2-ef0b-44bb-a053-41f4268c4c83 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:33.657609 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-181ab0d2-ef0b-44bb-a053-41f4268c4c83 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:33.784173 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-181ab0d2-ef0b-44bb-a053-41f4268c4c83 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:47:33.791895 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-181ab0d2-ef0b-44bb-a053-41f4268c4c83 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/565c49d8-efe1-4dcb-b6b8-493de07df35d" status: 200 len: 1363 microversion: 2.1 time: 0.148401 Sep 14 09:47:33.792477 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3668/6992] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:47:33 2022] GET /compute/v2.1/servers/565c49d8-efe1-4dcb-b6b8-493de07df35d => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:47:34.816616 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-522408c4-ba8a-4ccb-b2dd-48307a897156 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:47:34.817281 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-522408c4-ba8a-4ccb-b2dd-48307a897156 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 565c49d8-efe1-4dcb-b6b8-493de07df35d] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:47:34.824213 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-522408c4-ba8a-4ccb-b2dd-48307a897156 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:34.824634 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-522408c4-ba8a-4ccb-b2dd-48307a897156 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:34.825068 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-522408c4-ba8a-4ccb-b2dd-48307a897156 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:34.825761 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-522408c4-ba8a-4ccb-b2dd-48307a897156 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:34.826213 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-522408c4-ba8a-4ccb-b2dd-48307a897156 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:34.826636 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-522408c4-ba8a-4ccb-b2dd-48307a897156 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:34.963328 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-522408c4-ba8a-4ccb-b2dd-48307a897156 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:47:34.971905 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-522408c4-ba8a-4ccb-b2dd-48307a897156 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/565c49d8-efe1-4dcb-b6b8-493de07df35d" status: 200 len: 1363 microversion: 2.1 time: 0.159801 Sep 14 09:47:34.972477 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3669/6993] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:47:34 2022] GET /compute/v2.1/servers/565c49d8-efe1-4dcb-b6b8-493de07df35d => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:47:35.995552 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d5506e21-249e-4840-b1d9-7ca35220068b tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:47:35.996222 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-d5506e21-249e-4840-b1d9-7ca35220068b tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 565c49d8-efe1-4dcb-b6b8-493de07df35d] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:47:36.003185 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d5506e21-249e-4840-b1d9-7ca35220068b tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:36.003680 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d5506e21-249e-4840-b1d9-7ca35220068b tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:36.004126 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d5506e21-249e-4840-b1d9-7ca35220068b tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:36.004820 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d5506e21-249e-4840-b1d9-7ca35220068b tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:36.005315 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d5506e21-249e-4840-b1d9-7ca35220068b tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:36.005747 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d5506e21-249e-4840-b1d9-7ca35220068b tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:36.131685 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-d5506e21-249e-4840-b1d9-7ca35220068b tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:47:36.139377 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d5506e21-249e-4840-b1d9-7ca35220068b tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/565c49d8-efe1-4dcb-b6b8-493de07df35d" status: 200 len: 1363 microversion: 2.1 time: 0.147760 Sep 14 09:47:36.139955 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3670/6994] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:47:35 2022] GET /compute/v2.1/servers/565c49d8-efe1-4dcb-b6b8-493de07df35d => generated 1363 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:47:36.855201 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-a57c1681-0f20-4c92-8bf0-486622aeb3cf req-d6887a30-ecf1-4720-bf9a-c3efb21ff192 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "565c49d8-efe1-4dcb-b6b8-493de07df35d", "name": "network-vif-plugged", "status": "completed", "tag": "689af942-9fb7-45d0-903d-02cde067a6d0"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:47:36.865290 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-a57c1681-0f20-4c92-8bf0-486622aeb3cf req-d6887a30-ecf1-4720-bf9a-c3efb21ff192 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:36.865777 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-a57c1681-0f20-4c92-8bf0-486622aeb3cf req-d6887a30-ecf1-4720-bf9a-c3efb21ff192 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:36.866896 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-a57c1681-0f20-4c92-8bf0-486622aeb3cf req-d6887a30-ecf1-4720-bf9a-c3efb21ff192 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:36.878732 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-a57c1681-0f20-4c92-8bf0-486622aeb3cf req-d6887a30-ecf1-4720-bf9a-c3efb21ff192 service nova] Creating event network-vif-plugged:689af942-9fb7-45d0-903d-02cde067a6d0 for instance 565c49d8-efe1-4dcb-b6b8-493de07df35d on n-h2-836830-18 Sep 14 09:47:36.883764 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-a57c1681-0f20-4c92-8bf0-486622aeb3cf req-d6887a30-ecf1-4720-bf9a-c3efb21ff192 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032573 Sep 14 09:47:36.884599 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3671/6995] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:47:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:47:37.164783 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-22fd71b3-43bc-4135-b788-927432ab769c tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:47:37.165432 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-22fd71b3-43bc-4135-b788-927432ab769c tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 565c49d8-efe1-4dcb-b6b8-493de07df35d] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:47:37.171642 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-22fd71b3-43bc-4135-b788-927432ab769c tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:37.172951 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-22fd71b3-43bc-4135-b788-927432ab769c tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:37.172951 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-22fd71b3-43bc-4135-b788-927432ab769c tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:37.173251 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-22fd71b3-43bc-4135-b788-927432ab769c tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:37.173708 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-22fd71b3-43bc-4135-b788-927432ab769c tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:37.174139 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-22fd71b3-43bc-4135-b788-927432ab769c tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:37.305463 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-22fd71b3-43bc-4135-b788-927432ab769c tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:47:37.313188 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-22fd71b3-43bc-4135-b788-927432ab769c tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/565c49d8-efe1-4dcb-b6b8-493de07df35d" status: 200 len: 1363 microversion: 2.1 time: 0.153580 Sep 14 09:47:37.313768 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3672/6996] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:47:37 2022] GET /compute/v2.1/servers/565c49d8-efe1-4dcb-b6b8-493de07df35d => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:47:38.337503 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-dbb31055-21d9-48c0-bd76-7d3f6ffd6b81 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:47:38.338188 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-dbb31055-21d9-48c0-bd76-7d3f6ffd6b81 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 565c49d8-efe1-4dcb-b6b8-493de07df35d] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:47:38.345304 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dbb31055-21d9-48c0-bd76-7d3f6ffd6b81 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:38.345791 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dbb31055-21d9-48c0-bd76-7d3f6ffd6b81 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:38.346228 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dbb31055-21d9-48c0-bd76-7d3f6ffd6b81 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:38.346919 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dbb31055-21d9-48c0-bd76-7d3f6ffd6b81 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:38.347404 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dbb31055-21d9-48c0-bd76-7d3f6ffd6b81 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:38.347833 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dbb31055-21d9-48c0-bd76-7d3f6ffd6b81 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:38.476797 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-dbb31055-21d9-48c0-bd76-7d3f6ffd6b81 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:47:38.484795 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-dbb31055-21d9-48c0-bd76-7d3f6ffd6b81 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/565c49d8-efe1-4dcb-b6b8-493de07df35d" status: 200 len: 1550 microversion: 2.1 time: 0.151255 Sep 14 09:47:38.485517 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3673/6997] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:47:38 2022] GET /compute/v2.1/servers/565c49d8-efe1-4dcb-b6b8-493de07df35d => generated 1550 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:47:38.514885 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c84c7c3b-67a9-4efd-9c6a-993912550e30 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:47:38.515420 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-c84c7c3b-67a9-4efd-9c6a-993912550e30 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 565c49d8-efe1-4dcb-b6b8-493de07df35d] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:47:38.521448 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c84c7c3b-67a9-4efd-9c6a-993912550e30 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:38.521937 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c84c7c3b-67a9-4efd-9c6a-993912550e30 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:38.522383 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c84c7c3b-67a9-4efd-9c6a-993912550e30 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:38.523113 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c84c7c3b-67a9-4efd-9c6a-993912550e30 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:38.523579 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c84c7c3b-67a9-4efd-9c6a-993912550e30 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:38.524010 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c84c7c3b-67a9-4efd-9c6a-993912550e30 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:38.600156 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-c84c7c3b-67a9-4efd-9c6a-993912550e30 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/565c49d8-efe1-4dcb-b6b8-493de07df35d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089434 Sep 14 09:47:38.600792 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3674/6998] 10.222.0.60 () {58 vars in 1275 bytes} [Wed Sep 14 09:47:38 2022] GET /compute/v2.1/servers/565c49d8-efe1-4dcb-b6b8-493de07df35d/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:47:39.757579 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=2 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:47:39.758809 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=8 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:47:39.764168 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-7f34a3c3-a2a1-4673-a468-56f8434d957c req-4d4a0b3c-8885-4325-83a0-5142a946fb50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "565c49d8-efe1-4dcb-b6b8-493de07df35d", "tag": "689af942-9fb7-45d0-903d-02cde067a6d0"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:47:39.774823 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-7f34a3c3-a2a1-4673-a468-56f8434d957c req-4d4a0b3c-8885-4325-83a0-5142a946fb50 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:39.775333 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-7f34a3c3-a2a1-4673-a468-56f8434d957c req-4d4a0b3c-8885-4325-83a0-5142a946fb50 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:39.775765 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-7f34a3c3-a2a1-4673-a468-56f8434d957c req-4d4a0b3c-8885-4325-83a0-5142a946fb50 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:39.779471 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:47:39.787837 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-7f34a3c3-a2a1-4673-a468-56f8434d957c req-4d4a0b3c-8885-4325-83a0-5142a946fb50 service nova] Creating event network-changed:689af942-9fb7-45d0-903d-02cde067a6d0 for instance 565c49d8-efe1-4dcb-b6b8-493de07df35d on n-h2-836830-18 Sep 14 09:47:39.794073 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-7f34a3c3-a2a1-4673-a468-56f8434d957c req-4d4a0b3c-8885-4325-83a0-5142a946fb50 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037080 Sep 14 09:47:39.794691 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3675/6999] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:47:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:47:42.323054 n-d-836830-18 devstack@n-api.service[128758]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 09:47:42.323659 n-d-836830-18 devstack@n-api.service[128758]: Wed Sep 14 09:47:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.60) !!! Sep 14 09:48:12.787808 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:48:12.792873 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c92f5c81-dce4-46c4-9cd3-4f2803597db1 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:48:12.795227 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-c92f5c81-dce4-46c4-9cd3-4f2803597db1 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 565c49d8-efe1-4dcb-b6b8-493de07df35d] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:48:12.803842 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c92f5c81-dce4-46c4-9cd3-4f2803597db1 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:48:12.804329 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c92f5c81-dce4-46c4-9cd3-4f2803597db1 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:48:12.804777 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c92f5c81-dce4-46c4-9cd3-4f2803597db1 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:48:12.805473 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c92f5c81-dce4-46c4-9cd3-4f2803597db1 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:48:12.805934 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c92f5c81-dce4-46c4-9cd3-4f2803597db1 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:48:12.806399 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c92f5c81-dce4-46c4-9cd3-4f2803597db1 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:48:12.836855 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-c92f5c81-dce4-46c4-9cd3-4f2803597db1 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:48:12.844714 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-c92f5c81-dce4-46c4-9cd3-4f2803597db1 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 565c49d8-efe1-4dcb-b6b8-493de07df35d] Old instance type m1.heat2, new instance type m1.heat {{(pid=128759) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 14 09:48:12.851732 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-c92f5c81-dce4-46c4-9cd3-4f2803597db1 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Flavor limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:48:12.852163 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-c92f5c81-dce4-46c4-9cd3-4f2803597db1 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Image limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:48:12.852641 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-c92f5c81-dce4-46c4-9cd3-4f2803597db1 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Flavor pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:48:12.853059 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-c92f5c81-dce4-46c4-9cd3-4f2803597db1 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Image pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:48:12.853477 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-c92f5c81-dce4-46c4-9cd3-4f2803597db1 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:48:12.927211 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-c92f5c81-dce4-46c4-9cd3-4f2803597db1 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "POST /compute/v2.1/servers/565c49d8-efe1-4dcb-b6b8-493de07df35d/action" status: 202 len: 0 microversion: 2.1 time: 0.141590 Sep 14 09:48:12.927836 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3676/7000] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:48:12 2022] POST /compute/v2.1/servers/565c49d8-efe1-4dcb-b6b8-493de07df35d/action => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 14 09:48:12.935911 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-08790b95-95b3-4bc8-bb8d-5d65f46a24b2 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:48:12.936543 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-08790b95-95b3-4bc8-bb8d-5d65f46a24b2 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 565c49d8-efe1-4dcb-b6b8-493de07df35d] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:48:12.943197 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-08790b95-95b3-4bc8-bb8d-5d65f46a24b2 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:48:12.943690 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-08790b95-95b3-4bc8-bb8d-5d65f46a24b2 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:48:12.944135 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-08790b95-95b3-4bc8-bb8d-5d65f46a24b2 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:48:12.944833 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-08790b95-95b3-4bc8-bb8d-5d65f46a24b2 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:48:12.945294 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-08790b95-95b3-4bc8-bb8d-5d65f46a24b2 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:48:12.945726 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-08790b95-95b3-4bc8-bb8d-5d65f46a24b2 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:48:13.082096 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-08790b95-95b3-4bc8-bb8d-5d65f46a24b2 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:48:13.090172 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-08790b95-95b3-4bc8-bb8d-5d65f46a24b2 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/565c49d8-efe1-4dcb-b6b8-493de07df35d" status: 200 len: 1677 microversion: 2.1 time: 0.158136 Sep 14 09:48:13.090692 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3677/7001] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:48:12 2022] GET /compute/v2.1/servers/565c49d8-efe1-4dcb-b6b8-493de07df35d => generated 1677 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:48:14.114227 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-97239ab6-2a8b-45b9-951d-49559896095d tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:48:14.114887 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-97239ab6-2a8b-45b9-951d-49559896095d tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 565c49d8-efe1-4dcb-b6b8-493de07df35d] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:48:14.121754 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-97239ab6-2a8b-45b9-951d-49559896095d tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:48:14.122277 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-97239ab6-2a8b-45b9-951d-49559896095d tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:48:14.122720 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-97239ab6-2a8b-45b9-951d-49559896095d tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:48:14.123451 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-97239ab6-2a8b-45b9-951d-49559896095d tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:48:14.123916 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-97239ab6-2a8b-45b9-951d-49559896095d tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:48:14.124350 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-97239ab6-2a8b-45b9-951d-49559896095d tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:48:14.264575 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-97239ab6-2a8b-45b9-951d-49559896095d tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:48:14.272456 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-97239ab6-2a8b-45b9-951d-49559896095d tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/565c49d8-efe1-4dcb-b6b8-493de07df35d" status: 200 len: 1677 microversion: 2.1 time: 0.162768 Sep 14 09:48:14.273034 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3678/7002] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:48:14 2022] GET /compute/v2.1/servers/565c49d8-efe1-4dcb-b6b8-493de07df35d => generated 1677 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:48:15.296476 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ee5e0577-1b18-4af9-b09e-4bfc71b02e30 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:48:15.297092 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-ee5e0577-1b18-4af9-b09e-4bfc71b02e30 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 565c49d8-efe1-4dcb-b6b8-493de07df35d] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:48:15.304431 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ee5e0577-1b18-4af9-b09e-4bfc71b02e30 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:48:15.304910 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ee5e0577-1b18-4af9-b09e-4bfc71b02e30 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:48:15.305346 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ee5e0577-1b18-4af9-b09e-4bfc71b02e30 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:48:15.306030 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ee5e0577-1b18-4af9-b09e-4bfc71b02e30 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:48:15.306485 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ee5e0577-1b18-4af9-b09e-4bfc71b02e30 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:48:15.306909 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ee5e0577-1b18-4af9-b09e-4bfc71b02e30 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:48:15.437398 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-ee5e0577-1b18-4af9-b09e-4bfc71b02e30 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:48:15.445721 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-ee5e0577-1b18-4af9-b09e-4bfc71b02e30 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/565c49d8-efe1-4dcb-b6b8-493de07df35d" status: 200 len: 1682 microversion: 2.1 time: 0.153274 Sep 14 09:48:15.446294 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3679/7003] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:48:15 2022] GET /compute/v2.1/servers/565c49d8-efe1-4dcb-b6b8-493de07df35d => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:48:16.469502 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-66f9ed68-0b51-4a7e-b99f-31e879d3945c tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:48:16.470185 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-66f9ed68-0b51-4a7e-b99f-31e879d3945c tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 565c49d8-efe1-4dcb-b6b8-493de07df35d] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:48:16.477491 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-66f9ed68-0b51-4a7e-b99f-31e879d3945c tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:48:16.477978 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-66f9ed68-0b51-4a7e-b99f-31e879d3945c tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:48:16.478417 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-66f9ed68-0b51-4a7e-b99f-31e879d3945c tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:48:16.479142 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-66f9ed68-0b51-4a7e-b99f-31e879d3945c tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:48:16.479602 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-66f9ed68-0b51-4a7e-b99f-31e879d3945c tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:48:16.480031 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-66f9ed68-0b51-4a7e-b99f-31e879d3945c tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:48:16.611075 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-66f9ed68-0b51-4a7e-b99f-31e879d3945c tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:48:16.619430 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-66f9ed68-0b51-4a7e-b99f-31e879d3945c tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/565c49d8-efe1-4dcb-b6b8-493de07df35d" status: 200 len: 1682 microversion: 2.1 time: 0.154232 Sep 14 09:48:16.620006 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3680/7004] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:48:16 2022] GET /compute/v2.1/servers/565c49d8-efe1-4dcb-b6b8-493de07df35d => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:48:17.647264 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-52700d2b-045a-454f-a058-0bc0bb89acee tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:48:17.648059 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-52700d2b-045a-454f-a058-0bc0bb89acee tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 565c49d8-efe1-4dcb-b6b8-493de07df35d] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:48:17.658710 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-52700d2b-045a-454f-a058-0bc0bb89acee tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:48:17.659252 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-52700d2b-045a-454f-a058-0bc0bb89acee tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:48:17.659807 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-52700d2b-045a-454f-a058-0bc0bb89acee tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:48:17.660581 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-52700d2b-045a-454f-a058-0bc0bb89acee tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:48:17.661048 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-52700d2b-045a-454f-a058-0bc0bb89acee tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:48:17.661483 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-52700d2b-045a-454f-a058-0bc0bb89acee tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:48:17.792579 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-52700d2b-045a-454f-a058-0bc0bb89acee tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:48:17.801521 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-52700d2b-045a-454f-a058-0bc0bb89acee tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/565c49d8-efe1-4dcb-b6b8-493de07df35d" status: 200 len: 1682 microversion: 2.1 time: 0.161637 Sep 14 09:48:17.802100 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3681/7005] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:48:17 2022] GET /compute/v2.1/servers/565c49d8-efe1-4dcb-b6b8-493de07df35d => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:48:18.824979 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-321a51da-e9f6-4858-a6ef-2f5ce23160e6 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:48:18.825610 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-321a51da-e9f6-4858-a6ef-2f5ce23160e6 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 565c49d8-efe1-4dcb-b6b8-493de07df35d] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:48:18.837366 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-321a51da-e9f6-4858-a6ef-2f5ce23160e6 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:48:18.837998 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-321a51da-e9f6-4858-a6ef-2f5ce23160e6 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:48:18.838590 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-321a51da-e9f6-4858-a6ef-2f5ce23160e6 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:48:18.839328 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-321a51da-e9f6-4858-a6ef-2f5ce23160e6 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:48:18.839794 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-321a51da-e9f6-4858-a6ef-2f5ce23160e6 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:48:18.840226 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-321a51da-e9f6-4858-a6ef-2f5ce23160e6 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:48:18.976980 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-321a51da-e9f6-4858-a6ef-2f5ce23160e6 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:48:18.984972 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-321a51da-e9f6-4858-a6ef-2f5ce23160e6 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/565c49d8-efe1-4dcb-b6b8-493de07df35d" status: 200 len: 1682 microversion: 2.1 time: 0.164013 Sep 14 09:48:18.985548 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3682/7006] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:48:18 2022] GET /compute/v2.1/servers/565c49d8-efe1-4dcb-b6b8-493de07df35d => generated 1682 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:48:20.009265 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-cfacd603-7907-4d3e-a26c-6cb422afc52a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:48:20.009937 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-cfacd603-7907-4d3e-a26c-6cb422afc52a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 565c49d8-efe1-4dcb-b6b8-493de07df35d] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:48:20.016849 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cfacd603-7907-4d3e-a26c-6cb422afc52a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:48:20.017341 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cfacd603-7907-4d3e-a26c-6cb422afc52a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:48:20.017785 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cfacd603-7907-4d3e-a26c-6cb422afc52a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:48:20.018484 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cfacd603-7907-4d3e-a26c-6cb422afc52a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:48:20.019559 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cfacd603-7907-4d3e-a26c-6cb422afc52a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:48:20.019995 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cfacd603-7907-4d3e-a26c-6cb422afc52a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:48:20.149909 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-cfacd603-7907-4d3e-a26c-6cb422afc52a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:48:20.157660 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-cfacd603-7907-4d3e-a26c-6cb422afc52a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/565c49d8-efe1-4dcb-b6b8-493de07df35d" status: 200 len: 1682 microversion: 2.1 time: 0.152345 Sep 14 09:48:20.158227 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3683/7007] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:48:20 2022] GET /compute/v2.1/servers/565c49d8-efe1-4dcb-b6b8-493de07df35d => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:48:21.181478 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c354f516-41a3-436c-9d84-34438e748d8f tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:48:21.182140 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-c354f516-41a3-436c-9d84-34438e748d8f tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 565c49d8-efe1-4dcb-b6b8-493de07df35d] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:48:21.188819 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c354f516-41a3-436c-9d84-34438e748d8f tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:48:21.189318 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c354f516-41a3-436c-9d84-34438e748d8f tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:48:21.189767 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c354f516-41a3-436c-9d84-34438e748d8f tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:48:21.191105 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c354f516-41a3-436c-9d84-34438e748d8f tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:48:21.191576 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c354f516-41a3-436c-9d84-34438e748d8f tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:48:21.192013 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c354f516-41a3-436c-9d84-34438e748d8f tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:48:21.322616 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-c354f516-41a3-436c-9d84-34438e748d8f tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:48:21.330482 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-c354f516-41a3-436c-9d84-34438e748d8f tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/565c49d8-efe1-4dcb-b6b8-493de07df35d" status: 200 len: 1682 microversion: 2.1 time: 0.153156 Sep 14 09:48:21.331214 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3684/7008] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:48:21 2022] GET /compute/v2.1/servers/565c49d8-efe1-4dcb-b6b8-493de07df35d => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:48:22.353968 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-5f31d426-557b-4d19-a227-76bb94a8c60a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:48:22.354643 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-5f31d426-557b-4d19-a227-76bb94a8c60a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 565c49d8-efe1-4dcb-b6b8-493de07df35d] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:48:22.361609 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5f31d426-557b-4d19-a227-76bb94a8c60a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:48:22.362098 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5f31d426-557b-4d19-a227-76bb94a8c60a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:48:22.363166 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5f31d426-557b-4d19-a227-76bb94a8c60a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:48:22.363866 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5f31d426-557b-4d19-a227-76bb94a8c60a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:48:22.364331 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5f31d426-557b-4d19-a227-76bb94a8c60a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:48:22.364765 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5f31d426-557b-4d19-a227-76bb94a8c60a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:48:22.496700 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-5f31d426-557b-4d19-a227-76bb94a8c60a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:48:22.504581 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-5f31d426-557b-4d19-a227-76bb94a8c60a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/565c49d8-efe1-4dcb-b6b8-493de07df35d" status: 200 len: 1682 microversion: 2.1 time: 0.154563 Sep 14 09:48:22.505170 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3685/7009] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:48:22 2022] GET /compute/v2.1/servers/565c49d8-efe1-4dcb-b6b8-493de07df35d => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:48:23.528062 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-1b350560-35bc-4755-b557-9f7c72c4e41d tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:48:23.528788 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-1b350560-35bc-4755-b557-9f7c72c4e41d tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 565c49d8-efe1-4dcb-b6b8-493de07df35d] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:48:23.535971 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1b350560-35bc-4755-b557-9f7c72c4e41d tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:48:23.536390 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1b350560-35bc-4755-b557-9f7c72c4e41d tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:48:23.536825 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1b350560-35bc-4755-b557-9f7c72c4e41d tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:48:23.537532 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1b350560-35bc-4755-b557-9f7c72c4e41d tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:48:23.537973 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1b350560-35bc-4755-b557-9f7c72c4e41d tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:48:23.538404 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1b350560-35bc-4755-b557-9f7c72c4e41d tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:48:23.668202 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-1b350560-35bc-4755-b557-9f7c72c4e41d tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:48:23.677076 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-1b350560-35bc-4755-b557-9f7c72c4e41d tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/565c49d8-efe1-4dcb-b6b8-493de07df35d" status: 200 len: 1682 microversion: 2.1 time: 0.153235 Sep 14 09:48:23.677650 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3686/7010] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:48:23 2022] GET /compute/v2.1/servers/565c49d8-efe1-4dcb-b6b8-493de07df35d => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:48:24.700841 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d66a7d0d-2b5a-4245-b7ac-c889acf2b8b3 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:48:24.701401 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-d66a7d0d-2b5a-4245-b7ac-c889acf2b8b3 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 565c49d8-efe1-4dcb-b6b8-493de07df35d] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:48:24.708265 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d66a7d0d-2b5a-4245-b7ac-c889acf2b8b3 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:48:24.708748 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d66a7d0d-2b5a-4245-b7ac-c889acf2b8b3 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:48:24.709183 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d66a7d0d-2b5a-4245-b7ac-c889acf2b8b3 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:48:24.709866 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d66a7d0d-2b5a-4245-b7ac-c889acf2b8b3 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:48:24.710318 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d66a7d0d-2b5a-4245-b7ac-c889acf2b8b3 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:48:24.710743 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d66a7d0d-2b5a-4245-b7ac-c889acf2b8b3 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:48:24.842081 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-d66a7d0d-2b5a-4245-b7ac-c889acf2b8b3 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:48:24.850346 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d66a7d0d-2b5a-4245-b7ac-c889acf2b8b3 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/565c49d8-efe1-4dcb-b6b8-493de07df35d" status: 200 len: 1682 microversion: 2.1 time: 0.153485 Sep 14 09:48:24.850915 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3687/7011] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:48:24 2022] GET /compute/v2.1/servers/565c49d8-efe1-4dcb-b6b8-493de07df35d => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:48:25.874920 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-2e5ad5b7-9e57-4fc0-a353-d64d2d2974e6 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:48:25.875567 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-2e5ad5b7-9e57-4fc0-a353-d64d2d2974e6 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 565c49d8-efe1-4dcb-b6b8-493de07df35d] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:48:25.882771 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2e5ad5b7-9e57-4fc0-a353-d64d2d2974e6 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:48:25.883303 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2e5ad5b7-9e57-4fc0-a353-d64d2d2974e6 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:48:25.883750 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2e5ad5b7-9e57-4fc0-a353-d64d2d2974e6 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:48:25.884450 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2e5ad5b7-9e57-4fc0-a353-d64d2d2974e6 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:48:25.884909 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2e5ad5b7-9e57-4fc0-a353-d64d2d2974e6 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:48:25.885337 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2e5ad5b7-9e57-4fc0-a353-d64d2d2974e6 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:48:26.014200 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-2e5ad5b7-9e57-4fc0-a353-d64d2d2974e6 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:48:26.022008 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-2e5ad5b7-9e57-4fc0-a353-d64d2d2974e6 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/565c49d8-efe1-4dcb-b6b8-493de07df35d" status: 200 len: 1682 microversion: 2.1 time: 0.151174 Sep 14 09:48:26.022597 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3688/7012] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:48:25 2022] GET /compute/v2.1/servers/565c49d8-efe1-4dcb-b6b8-493de07df35d => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:48:27.045832 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-fda363f8-7310-47b6-a7e9-d7897efa792e tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:48:27.046475 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-fda363f8-7310-47b6-a7e9-d7897efa792e tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 565c49d8-efe1-4dcb-b6b8-493de07df35d] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:48:27.053897 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fda363f8-7310-47b6-a7e9-d7897efa792e tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:48:27.054379 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fda363f8-7310-47b6-a7e9-d7897efa792e tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:48:27.054818 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fda363f8-7310-47b6-a7e9-d7897efa792e tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:48:27.055547 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fda363f8-7310-47b6-a7e9-d7897efa792e tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:48:27.056009 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fda363f8-7310-47b6-a7e9-d7897efa792e tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:48:27.056436 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fda363f8-7310-47b6-a7e9-d7897efa792e tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:48:27.187473 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-fda363f8-7310-47b6-a7e9-d7897efa792e tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:48:27.195226 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-fda363f8-7310-47b6-a7e9-d7897efa792e tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/565c49d8-efe1-4dcb-b6b8-493de07df35d" status: 200 len: 1682 microversion: 2.1 time: 0.153396 Sep 14 09:48:27.195802 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3689/7013] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:48:27 2022] GET /compute/v2.1/servers/565c49d8-efe1-4dcb-b6b8-493de07df35d => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:48:28.219501 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-46a52d04-96e3-4e3e-8048-17e3b8b936fd tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:48:28.220129 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-46a52d04-96e3-4e3e-8048-17e3b8b936fd tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 565c49d8-efe1-4dcb-b6b8-493de07df35d] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:48:28.227496 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-46a52d04-96e3-4e3e-8048-17e3b8b936fd tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:48:28.227983 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-46a52d04-96e3-4e3e-8048-17e3b8b936fd tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:48:28.228423 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-46a52d04-96e3-4e3e-8048-17e3b8b936fd tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:48:28.229113 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-46a52d04-96e3-4e3e-8048-17e3b8b936fd tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:48:28.229574 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-46a52d04-96e3-4e3e-8048-17e3b8b936fd tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:48:28.230004 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-46a52d04-96e3-4e3e-8048-17e3b8b936fd tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:48:28.360087 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-46a52d04-96e3-4e3e-8048-17e3b8b936fd tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:48:28.367955 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-46a52d04-96e3-4e3e-8048-17e3b8b936fd tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/565c49d8-efe1-4dcb-b6b8-493de07df35d" status: 200 len: 1682 microversion: 2.1 time: 0.152747 Sep 14 09:48:28.368535 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3690/7014] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:48:28 2022] GET /compute/v2.1/servers/565c49d8-efe1-4dcb-b6b8-493de07df35d => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:48:29.396466 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ed314bbc-e2b0-4182-a748-eb5c624b0cfe tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:48:29.397081 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-ed314bbc-e2b0-4182-a748-eb5c624b0cfe tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 565c49d8-efe1-4dcb-b6b8-493de07df35d] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:48:29.404025 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ed314bbc-e2b0-4182-a748-eb5c624b0cfe tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:48:29.404514 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ed314bbc-e2b0-4182-a748-eb5c624b0cfe tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:48:29.404955 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ed314bbc-e2b0-4182-a748-eb5c624b0cfe tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:48:29.405646 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ed314bbc-e2b0-4182-a748-eb5c624b0cfe tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:48:29.406104 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ed314bbc-e2b0-4182-a748-eb5c624b0cfe tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:48:29.406541 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ed314bbc-e2b0-4182-a748-eb5c624b0cfe tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:48:29.409722 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:48:29.539905 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-ed314bbc-e2b0-4182-a748-eb5c624b0cfe tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:48:29.547612 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-ed314bbc-e2b0-4182-a748-eb5c624b0cfe tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/565c49d8-efe1-4dcb-b6b8-493de07df35d" status: 200 len: 1682 microversion: 2.1 time: 0.155634 Sep 14 09:48:29.548188 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3691/7015] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:48:29 2022] GET /compute/v2.1/servers/565c49d8-efe1-4dcb-b6b8-493de07df35d => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:48:30.571131 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-347b8912-a911-4084-a64e-f2d6bac6076d tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:48:30.571760 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-347b8912-a911-4084-a64e-f2d6bac6076d tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 565c49d8-efe1-4dcb-b6b8-493de07df35d] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:48:30.578572 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-347b8912-a911-4084-a64e-f2d6bac6076d tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:48:30.579118 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-347b8912-a911-4084-a64e-f2d6bac6076d tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:48:30.579563 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-347b8912-a911-4084-a64e-f2d6bac6076d tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:48:30.580263 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-347b8912-a911-4084-a64e-f2d6bac6076d tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:48:30.580721 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-347b8912-a911-4084-a64e-f2d6bac6076d tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:48:30.581148 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-347b8912-a911-4084-a64e-f2d6bac6076d tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:48:30.717675 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-347b8912-a911-4084-a64e-f2d6bac6076d tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:48:30.726445 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-347b8912-a911-4084-a64e-f2d6bac6076d tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/565c49d8-efe1-4dcb-b6b8-493de07df35d" status: 200 len: 1682 microversion: 2.1 time: 0.159456 Sep 14 09:48:30.727038 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3692/7016] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:48:30 2022] GET /compute/v2.1/servers/565c49d8-efe1-4dcb-b6b8-493de07df35d => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:48:31.750031 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-fc0bc363-360a-4a65-ac1e-97d75198192b tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:48:31.750756 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-fc0bc363-360a-4a65-ac1e-97d75198192b tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 565c49d8-efe1-4dcb-b6b8-493de07df35d] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:48:31.758521 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fc0bc363-360a-4a65-ac1e-97d75198192b tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:48:31.759047 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fc0bc363-360a-4a65-ac1e-97d75198192b tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:48:31.759499 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fc0bc363-360a-4a65-ac1e-97d75198192b tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:48:31.760201 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fc0bc363-360a-4a65-ac1e-97d75198192b tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:48:31.760667 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fc0bc363-360a-4a65-ac1e-97d75198192b tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:48:31.761100 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fc0bc363-360a-4a65-ac1e-97d75198192b tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:48:31.896412 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-fc0bc363-360a-4a65-ac1e-97d75198192b tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:48:31.904106 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-fc0bc363-360a-4a65-ac1e-97d75198192b tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/565c49d8-efe1-4dcb-b6b8-493de07df35d" status: 200 len: 1681 microversion: 2.1 time: 0.158152 Sep 14 09:48:31.904678 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3693/7017] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:48:31 2022] GET /compute/v2.1/servers/565c49d8-efe1-4dcb-b6b8-493de07df35d => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:48:32.208282 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-349fb3a6-1ab5-46ea-beac-ef1098e45716 req-fd2237c8-12b9-4b20-97eb-30073b5d7e37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "565c49d8-efe1-4dcb-b6b8-493de07df35d", "name": "network-vif-unplugged", "status": "completed", "tag": "689af942-9fb7-45d0-903d-02cde067a6d0"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:48:32.218105 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-349fb3a6-1ab5-46ea-beac-ef1098e45716 req-fd2237c8-12b9-4b20-97eb-30073b5d7e37 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:48:32.218618 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-349fb3a6-1ab5-46ea-beac-ef1098e45716 req-fd2237c8-12b9-4b20-97eb-30073b5d7e37 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:48:32.219209 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-349fb3a6-1ab5-46ea-beac-ef1098e45716 req-fd2237c8-12b9-4b20-97eb-30073b5d7e37 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:48:32.231954 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-349fb3a6-1ab5-46ea-beac-ef1098e45716 req-fd2237c8-12b9-4b20-97eb-30073b5d7e37 service nova] Creating event network-vif-unplugged:689af942-9fb7-45d0-903d-02cde067a6d0 for instance 565c49d8-efe1-4dcb-b6b8-493de07df35d on n-h1-836830-18 Sep 14 09:48:32.238074 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [req-349fb3a6-1ab5-46ea-beac-ef1098e45716 req-fd2237c8-12b9-4b20-97eb-30073b5d7e37 service nova] Instance 565c49d8-efe1-4dcb-b6b8-493de07df35d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-836830-18', 'n-h2-836830-18'} {{(pid=128759) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 14 09:48:32.249007 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-349fb3a6-1ab5-46ea-beac-ef1098e45716 req-fd2237c8-12b9-4b20-97eb-30073b5d7e37 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044498 Sep 14 09:48:32.249630 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3694/7018] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:48:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:48:32.929938 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-0bed6ff0-68ae-4e2b-86b6-b965605e560a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:48:32.930643 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-0bed6ff0-68ae-4e2b-86b6-b965605e560a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 565c49d8-efe1-4dcb-b6b8-493de07df35d] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:48:32.936841 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0bed6ff0-68ae-4e2b-86b6-b965605e560a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:48:32.937394 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0bed6ff0-68ae-4e2b-86b6-b965605e560a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:48:32.937837 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0bed6ff0-68ae-4e2b-86b6-b965605e560a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:48:32.938527 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0bed6ff0-68ae-4e2b-86b6-b965605e560a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:48:32.939021 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0bed6ff0-68ae-4e2b-86b6-b965605e560a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:48:32.939449 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0bed6ff0-68ae-4e2b-86b6-b965605e560a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:48:33.074477 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-0bed6ff0-68ae-4e2b-86b6-b965605e560a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:48:33.082428 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-0bed6ff0-68ae-4e2b-86b6-b965605e560a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/565c49d8-efe1-4dcb-b6b8-493de07df35d" status: 200 len: 1681 microversion: 2.1 time: 0.158298 Sep 14 09:48:33.083037 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3695/7019] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:48:32 2022] GET /compute/v2.1/servers/565c49d8-efe1-4dcb-b6b8-493de07df35d => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:48:34.106233 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-5eeced01-9a69-478a-900d-2d1adc5d0f7f tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:48:34.106900 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-5eeced01-9a69-478a-900d-2d1adc5d0f7f tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 565c49d8-efe1-4dcb-b6b8-493de07df35d] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:48:34.113818 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5eeced01-9a69-478a-900d-2d1adc5d0f7f tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:48:34.114303 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5eeced01-9a69-478a-900d-2d1adc5d0f7f tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:48:34.114739 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5eeced01-9a69-478a-900d-2d1adc5d0f7f tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:48:34.115577 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5eeced01-9a69-478a-900d-2d1adc5d0f7f tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:48:34.116045 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5eeced01-9a69-478a-900d-2d1adc5d0f7f tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:48:34.116471 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5eeced01-9a69-478a-900d-2d1adc5d0f7f tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:48:34.243318 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-5eeced01-9a69-478a-900d-2d1adc5d0f7f tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:48:34.251103 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-5eeced01-9a69-478a-900d-2d1adc5d0f7f tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/565c49d8-efe1-4dcb-b6b8-493de07df35d" status: 200 len: 1679 microversion: 2.1 time: 0.148760 Sep 14 09:48:34.251686 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3696/7020] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:48:34 2022] GET /compute/v2.1/servers/565c49d8-efe1-4dcb-b6b8-493de07df35d => generated 1679 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:48:34.272081 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-09a0c22c-b826-4368-a20d-9d28c19779ce req-6efcd34e-1cce-4b81-9271-87fafa16a3a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "565c49d8-efe1-4dcb-b6b8-493de07df35d", "tag": "689af942-9fb7-45d0-903d-02cde067a6d0"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:48:34.281240 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-09a0c22c-b826-4368-a20d-9d28c19779ce req-6efcd34e-1cce-4b81-9271-87fafa16a3a3 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:48:34.281720 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-09a0c22c-b826-4368-a20d-9d28c19779ce req-6efcd34e-1cce-4b81-9271-87fafa16a3a3 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:48:34.282153 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-09a0c22c-b826-4368-a20d-9d28c19779ce req-6efcd34e-1cce-4b81-9271-87fafa16a3a3 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:48:34.293555 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-09a0c22c-b826-4368-a20d-9d28c19779ce req-6efcd34e-1cce-4b81-9271-87fafa16a3a3 service nova] Creating event network-changed:689af942-9fb7-45d0-903d-02cde067a6d0 for instance 565c49d8-efe1-4dcb-b6b8-493de07df35d on n-h1-836830-18 Sep 14 09:48:34.303837 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [req-09a0c22c-b826-4368-a20d-9d28c19779ce req-6efcd34e-1cce-4b81-9271-87fafa16a3a3 service nova] Instance 565c49d8-efe1-4dcb-b6b8-493de07df35d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-836830-18', 'n-h2-836830-18'} {{(pid=128759) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 14 09:48:34.316646 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-09a0c22c-b826-4368-a20d-9d28c19779ce req-6efcd34e-1cce-4b81-9271-87fafa16a3a3 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048682 Sep 14 09:48:34.317233 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3697/7021] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:48:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:48:35.276971 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f663a864-b039-4077-8861-f95052ef81e5 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:48:35.277641 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f663a864-b039-4077-8861-f95052ef81e5 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 565c49d8-efe1-4dcb-b6b8-493de07df35d] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:48:35.283925 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f663a864-b039-4077-8861-f95052ef81e5 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:48:35.284421 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f663a864-b039-4077-8861-f95052ef81e5 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:48:35.284867 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f663a864-b039-4077-8861-f95052ef81e5 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:48:35.285586 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f663a864-b039-4077-8861-f95052ef81e5 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:48:35.286028 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f663a864-b039-4077-8861-f95052ef81e5 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:48:35.286630 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f663a864-b039-4077-8861-f95052ef81e5 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:48:35.418242 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f663a864-b039-4077-8861-f95052ef81e5 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:48:35.426454 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f663a864-b039-4077-8861-f95052ef81e5 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/565c49d8-efe1-4dcb-b6b8-493de07df35d" status: 200 len: 1679 microversion: 2.1 time: 0.154747 Sep 14 09:48:35.427048 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3698/7022] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:48:35 2022] GET /compute/v2.1/servers/565c49d8-efe1-4dcb-b6b8-493de07df35d => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:48:36.450418 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3fc42523-95b0-4906-bd45-a1b9e3b0494b tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:48:36.451117 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-3fc42523-95b0-4906-bd45-a1b9e3b0494b tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 565c49d8-efe1-4dcb-b6b8-493de07df35d] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:48:36.458342 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3fc42523-95b0-4906-bd45-a1b9e3b0494b tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:48:36.458874 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3fc42523-95b0-4906-bd45-a1b9e3b0494b tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:48:36.459344 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3fc42523-95b0-4906-bd45-a1b9e3b0494b tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:48:36.460244 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3fc42523-95b0-4906-bd45-a1b9e3b0494b tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:48:36.460711 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3fc42523-95b0-4906-bd45-a1b9e3b0494b tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:48:36.461138 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3fc42523-95b0-4906-bd45-a1b9e3b0494b tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:48:36.626700 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-3fc42523-95b0-4906-bd45-a1b9e3b0494b tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:48:36.635180 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-3fc42523-95b0-4906-bd45-a1b9e3b0494b tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/565c49d8-efe1-4dcb-b6b8-493de07df35d" status: 200 len: 1679 microversion: 2.1 time: 0.189085 Sep 14 09:48:36.635777 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3699/7023] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:48:36 2022] GET /compute/v2.1/servers/565c49d8-efe1-4dcb-b6b8-493de07df35d => generated 1679 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:48:37.658160 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-78276d1e-b2c0-4452-9df7-2e985a96b5cc tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:48:37.658842 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-78276d1e-b2c0-4452-9df7-2e985a96b5cc tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 565c49d8-efe1-4dcb-b6b8-493de07df35d] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:48:37.666289 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-78276d1e-b2c0-4452-9df7-2e985a96b5cc tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:48:37.666779 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-78276d1e-b2c0-4452-9df7-2e985a96b5cc tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:48:37.667268 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-78276d1e-b2c0-4452-9df7-2e985a96b5cc tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:48:37.667971 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-78276d1e-b2c0-4452-9df7-2e985a96b5cc tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:48:37.668416 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-78276d1e-b2c0-4452-9df7-2e985a96b5cc tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:48:37.668844 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-78276d1e-b2c0-4452-9df7-2e985a96b5cc tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:48:37.799411 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-78276d1e-b2c0-4452-9df7-2e985a96b5cc tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:48:37.807236 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-78276d1e-b2c0-4452-9df7-2e985a96b5cc tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/565c49d8-efe1-4dcb-b6b8-493de07df35d" status: 200 len: 1676 microversion: 2.1 time: 0.152953 Sep 14 09:48:37.807818 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3700/7024] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:48:37 2022] GET /compute/v2.1/servers/565c49d8-efe1-4dcb-b6b8-493de07df35d => generated 1676 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:48:37.829322 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a09d04bf-0ff0-41eb-a2c8-d3b79f860b13 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:48:37.829795 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-a09d04bf-0ff0-41eb-a2c8-d3b79f860b13 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 565c49d8-efe1-4dcb-b6b8-493de07df35d] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:48:37.838771 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a09d04bf-0ff0-41eb-a2c8-d3b79f860b13 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:48:37.839293 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a09d04bf-0ff0-41eb-a2c8-d3b79f860b13 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:48:37.839736 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a09d04bf-0ff0-41eb-a2c8-d3b79f860b13 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:48:37.840435 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a09d04bf-0ff0-41eb-a2c8-d3b79f860b13 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:48:37.840891 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a09d04bf-0ff0-41eb-a2c8-d3b79f860b13 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:48:37.841320 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a09d04bf-0ff0-41eb-a2c8-d3b79f860b13 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:48:37.878546 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a09d04bf-0ff0-41eb-a2c8-d3b79f860b13 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:48:37.879059 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a09d04bf-0ff0-41eb-a2c8-d3b79f860b13 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:48:37.879497 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a09d04bf-0ff0-41eb-a2c8-d3b79f860b13 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:48:37.880220 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a09d04bf-0ff0-41eb-a2c8-d3b79f860b13 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:48:37.880678 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a09d04bf-0ff0-41eb-a2c8-d3b79f860b13 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:48:37.881107 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a09d04bf-0ff0-41eb-a2c8-d3b79f860b13 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:48:37.906712 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-a09d04bf-0ff0-41eb-a2c8-d3b79f860b13 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Getting quotas for project 270f637ba197498bb4f7fa1ba14a62ad. Resources: {'cores', 'ram'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:48:37.912613 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-a09d04bf-0ff0-41eb-a2c8-d3b79f860b13 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Getting quotas for user 5de83b9937f145dbbe1091039327e71a and project 270f637ba197498bb4f7fa1ba14a62ad. Resources: {'cores', 'ram'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:48:38.011022 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a09d04bf-0ff0-41eb-a2c8-d3b79f860b13 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "POST /compute/v2.1/servers/565c49d8-efe1-4dcb-b6b8-493de07df35d/action" status: 202 len: 0 microversion: 2.1 time: 0.185125 Sep 14 09:48:38.011632 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3701/7025] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:48:37 2022] POST /compute/v2.1/servers/565c49d8-efe1-4dcb-b6b8-493de07df35d/action => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 14 09:48:38.020396 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f07dbdf8-02cd-4da1-90a4-1f4a024acc77 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:48:38.021102 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f07dbdf8-02cd-4da1-90a4-1f4a024acc77 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 565c49d8-efe1-4dcb-b6b8-493de07df35d] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:48:38.027510 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f07dbdf8-02cd-4da1-90a4-1f4a024acc77 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:48:38.028085 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f07dbdf8-02cd-4da1-90a4-1f4a024acc77 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:48:38.028531 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f07dbdf8-02cd-4da1-90a4-1f4a024acc77 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:48:38.029267 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f07dbdf8-02cd-4da1-90a4-1f4a024acc77 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:48:38.029728 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f07dbdf8-02cd-4da1-90a4-1f4a024acc77 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:48:38.030157 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f07dbdf8-02cd-4da1-90a4-1f4a024acc77 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:48:38.167092 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f07dbdf8-02cd-4da1-90a4-1f4a024acc77 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:48:38.174881 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f07dbdf8-02cd-4da1-90a4-1f4a024acc77 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/565c49d8-efe1-4dcb-b6b8-493de07df35d" status: 200 len: 1675 microversion: 2.1 time: 0.159019 Sep 14 09:48:38.175485 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3702/7026] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:48:38 2022] GET /compute/v2.1/servers/565c49d8-efe1-4dcb-b6b8-493de07df35d => generated 1675 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:48:39.198628 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e8b07bef-17b9-4b90-a7ec-ca34f9403fe6 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:48:39.199306 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e8b07bef-17b9-4b90-a7ec-ca34f9403fe6 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 565c49d8-efe1-4dcb-b6b8-493de07df35d] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:48:39.206224 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e8b07bef-17b9-4b90-a7ec-ca34f9403fe6 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:48:39.206712 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e8b07bef-17b9-4b90-a7ec-ca34f9403fe6 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:48:39.207193 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e8b07bef-17b9-4b90-a7ec-ca34f9403fe6 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:48:39.207915 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e8b07bef-17b9-4b90-a7ec-ca34f9403fe6 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:48:39.208374 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e8b07bef-17b9-4b90-a7ec-ca34f9403fe6 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:48:39.208805 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e8b07bef-17b9-4b90-a7ec-ca34f9403fe6 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:48:39.342778 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-e8b07bef-17b9-4b90-a7ec-ca34f9403fe6 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:48:39.350754 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e8b07bef-17b9-4b90-a7ec-ca34f9403fe6 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/565c49d8-efe1-4dcb-b6b8-493de07df35d" status: 200 len: 1675 microversion: 2.1 time: 0.155979 Sep 14 09:48:39.351552 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3703/7027] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:48:39 2022] GET /compute/v2.1/servers/565c49d8-efe1-4dcb-b6b8-493de07df35d => generated 1675 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:48:40.374779 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-2bb9d24d-a7a5-403a-bda2-dd4728b26ab8 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:48:40.375548 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-2bb9d24d-a7a5-403a-bda2-dd4728b26ab8 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 565c49d8-efe1-4dcb-b6b8-493de07df35d] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:48:40.383685 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2bb9d24d-a7a5-403a-bda2-dd4728b26ab8 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:48:40.384176 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2bb9d24d-a7a5-403a-bda2-dd4728b26ab8 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:48:40.384625 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2bb9d24d-a7a5-403a-bda2-dd4728b26ab8 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:48:40.385394 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2bb9d24d-a7a5-403a-bda2-dd4728b26ab8 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:48:40.385911 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2bb9d24d-a7a5-403a-bda2-dd4728b26ab8 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:48:40.386341 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2bb9d24d-a7a5-403a-bda2-dd4728b26ab8 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:48:40.522552 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-2bb9d24d-a7a5-403a-bda2-dd4728b26ab8 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:48:40.530370 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-2bb9d24d-a7a5-403a-bda2-dd4728b26ab8 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/565c49d8-efe1-4dcb-b6b8-493de07df35d" status: 200 len: 1675 microversion: 2.1 time: 0.159454 Sep 14 09:48:40.530976 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3704/7028] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:48:40 2022] GET /compute/v2.1/servers/565c49d8-efe1-4dcb-b6b8-493de07df35d => generated 1675 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:48:40.816547 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-f99d3e9a-9407-419f-aed1-b56822987744 req-34489dcc-13ea-4043-940b-c88c3f43867b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "565c49d8-efe1-4dcb-b6b8-493de07df35d", "name": "network-vif-plugged", "status": "completed", "tag": "689af942-9fb7-45d0-903d-02cde067a6d0"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:48:40.826867 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-f99d3e9a-9407-419f-aed1-b56822987744 req-34489dcc-13ea-4043-940b-c88c3f43867b service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:48:40.827955 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-f99d3e9a-9407-419f-aed1-b56822987744 req-34489dcc-13ea-4043-940b-c88c3f43867b service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:48:40.828412 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-f99d3e9a-9407-419f-aed1-b56822987744 req-34489dcc-13ea-4043-940b-c88c3f43867b service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:48:40.842393 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-f99d3e9a-9407-419f-aed1-b56822987744 req-34489dcc-13ea-4043-940b-c88c3f43867b service nova] Creating event network-vif-plugged:689af942-9fb7-45d0-903d-02cde067a6d0 for instance 565c49d8-efe1-4dcb-b6b8-493de07df35d on n-h2-836830-18 Sep 14 09:48:40.845629 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:48:40.850219 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [req-f99d3e9a-9407-419f-aed1-b56822987744 req-34489dcc-13ea-4043-940b-c88c3f43867b service nova] Instance 565c49d8-efe1-4dcb-b6b8-493de07df35d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-836830-18', 'n-h2-836830-18'} {{(pid=128759) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 14 09:48:40.863306 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-f99d3e9a-9407-419f-aed1-b56822987744 req-34489dcc-13ea-4043-940b-c88c3f43867b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051427 Sep 14 09:48:40.864069 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3705/7029] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:48:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:48:41.386206 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-87eba6b1-6b11-4738-836b-e500f0e46a57 req-08ce86ef-4448-4928-b8de-10d16306c89b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "565c49d8-efe1-4dcb-b6b8-493de07df35d", "name": "network-vif-unplugged", "status": "completed", "tag": "689af942-9fb7-45d0-903d-02cde067a6d0"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:48:41.398527 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-87eba6b1-6b11-4738-836b-e500f0e46a57 req-08ce86ef-4448-4928-b8de-10d16306c89b service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:48:41.399037 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-87eba6b1-6b11-4738-836b-e500f0e46a57 req-08ce86ef-4448-4928-b8de-10d16306c89b service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:48:41.399629 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-87eba6b1-6b11-4738-836b-e500f0e46a57 req-08ce86ef-4448-4928-b8de-10d16306c89b service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:48:41.412783 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-87eba6b1-6b11-4738-836b-e500f0e46a57 req-08ce86ef-4448-4928-b8de-10d16306c89b service nova] Creating event network-vif-unplugged:689af942-9fb7-45d0-903d-02cde067a6d0 for instance 565c49d8-efe1-4dcb-b6b8-493de07df35d on n-h2-836830-18 Sep 14 09:48:41.418772 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [req-87eba6b1-6b11-4738-836b-e500f0e46a57 req-08ce86ef-4448-4928-b8de-10d16306c89b service nova] Instance 565c49d8-efe1-4dcb-b6b8-493de07df35d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-836830-18', 'n-h2-836830-18'} {{(pid=128759) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 14 09:48:41.429881 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-87eba6b1-6b11-4738-836b-e500f0e46a57 req-08ce86ef-4448-4928-b8de-10d16306c89b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048982 Sep 14 09:48:41.430653 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3706/7030] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:48:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:48:41.555866 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f090c3c9-0501-42f1-bcfc-691cba3184a4 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:48:41.557851 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f090c3c9-0501-42f1-bcfc-691cba3184a4 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 565c49d8-efe1-4dcb-b6b8-493de07df35d] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:48:41.564649 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f090c3c9-0501-42f1-bcfc-691cba3184a4 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:48:41.565742 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f090c3c9-0501-42f1-bcfc-691cba3184a4 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:48:41.566190 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f090c3c9-0501-42f1-bcfc-691cba3184a4 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:48:41.566898 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f090c3c9-0501-42f1-bcfc-691cba3184a4 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:48:41.567381 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f090c3c9-0501-42f1-bcfc-691cba3184a4 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:48:41.568166 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f090c3c9-0501-42f1-bcfc-691cba3184a4 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:48:41.697392 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f090c3c9-0501-42f1-bcfc-691cba3184a4 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:48:41.705154 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f090c3c9-0501-42f1-bcfc-691cba3184a4 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/565c49d8-efe1-4dcb-b6b8-493de07df35d" status: 200 len: 1675 microversion: 2.1 time: 0.154477 Sep 14 09:48:41.705759 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3707/7031] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:48:41 2022] GET /compute/v2.1/servers/565c49d8-efe1-4dcb-b6b8-493de07df35d => generated 1675 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:48:42.728691 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-11512344-f738-44d6-82fc-7a8143a145c6 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:48:42.729300 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-11512344-f738-44d6-82fc-7a8143a145c6 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 565c49d8-efe1-4dcb-b6b8-493de07df35d] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:48:42.736077 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-11512344-f738-44d6-82fc-7a8143a145c6 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:48:42.736562 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-11512344-f738-44d6-82fc-7a8143a145c6 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:48:42.737619 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-11512344-f738-44d6-82fc-7a8143a145c6 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:48:42.738312 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-11512344-f738-44d6-82fc-7a8143a145c6 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:48:42.738767 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-11512344-f738-44d6-82fc-7a8143a145c6 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:48:42.739218 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-11512344-f738-44d6-82fc-7a8143a145c6 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:48:42.868267 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-11512344-f738-44d6-82fc-7a8143a145c6 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:48:42.876055 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-11512344-f738-44d6-82fc-7a8143a145c6 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/565c49d8-efe1-4dcb-b6b8-493de07df35d" status: 200 len: 1675 microversion: 2.1 time: 0.151399 Sep 14 09:48:42.876669 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3708/7032] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:48:42 2022] GET /compute/v2.1/servers/565c49d8-efe1-4dcb-b6b8-493de07df35d => generated 1675 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:48:43.448167 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-bfe40d45-6a47-4fea-90e5-fcf8b9d63d2e req-a63475e1-84c0-46e9-a8ba-89c48f003399 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "565c49d8-efe1-4dcb-b6b8-493de07df35d", "tag": "689af942-9fb7-45d0-903d-02cde067a6d0"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:48:43.457002 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:48:43.459222 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-bfe40d45-6a47-4fea-90e5-fcf8b9d63d2e req-a63475e1-84c0-46e9-a8ba-89c48f003399 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:48:43.459709 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-bfe40d45-6a47-4fea-90e5-fcf8b9d63d2e req-a63475e1-84c0-46e9-a8ba-89c48f003399 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:48:43.460183 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-bfe40d45-6a47-4fea-90e5-fcf8b9d63d2e req-a63475e1-84c0-46e9-a8ba-89c48f003399 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:48:43.473242 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-bfe40d45-6a47-4fea-90e5-fcf8b9d63d2e req-a63475e1-84c0-46e9-a8ba-89c48f003399 service nova] Creating event network-changed:689af942-9fb7-45d0-903d-02cde067a6d0 for instance 565c49d8-efe1-4dcb-b6b8-493de07df35d on n-h2-836830-18 Sep 14 09:48:43.478424 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [req-bfe40d45-6a47-4fea-90e5-fcf8b9d63d2e req-a63475e1-84c0-46e9-a8ba-89c48f003399 service nova] Instance 565c49d8-efe1-4dcb-b6b8-493de07df35d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-836830-18', 'n-h2-836830-18'} {{(pid=128759) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 14 09:48:43.489402 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-bfe40d45-6a47-4fea-90e5-fcf8b9d63d2e req-a63475e1-84c0-46e9-a8ba-89c48f003399 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045221 Sep 14 09:48:43.490003 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3709/7033] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:48:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:48:43.901615 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-80496afc-21ae-40b8-8702-01b9b71618cb tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:48:43.902345 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-80496afc-21ae-40b8-8702-01b9b71618cb tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 565c49d8-efe1-4dcb-b6b8-493de07df35d] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:48:43.909514 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-80496afc-21ae-40b8-8702-01b9b71618cb tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:48:43.910014 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-80496afc-21ae-40b8-8702-01b9b71618cb tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:48:43.910456 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-80496afc-21ae-40b8-8702-01b9b71618cb tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:48:43.911399 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-80496afc-21ae-40b8-8702-01b9b71618cb tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:48:43.912026 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-80496afc-21ae-40b8-8702-01b9b71618cb tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:48:43.912486 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-80496afc-21ae-40b8-8702-01b9b71618cb tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:48:44.060816 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-80496afc-21ae-40b8-8702-01b9b71618cb tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:48:44.068852 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-80496afc-21ae-40b8-8702-01b9b71618cb tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/565c49d8-efe1-4dcb-b6b8-493de07df35d" status: 200 len: 1668 microversion: 2.1 time: 0.172357 Sep 14 09:48:44.069437 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3710/7034] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:48:43 2022] GET /compute/v2.1/servers/565c49d8-efe1-4dcb-b6b8-493de07df35d => generated 1668 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:48:44.091775 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ec2a7756-44e4-4738-a916-4584cbdddcb9 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:48:44.092689 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-ec2a7756-44e4-4738-a916-4584cbdddcb9 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 565c49d8-efe1-4dcb-b6b8-493de07df35d] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:48:44.099313 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ec2a7756-44e4-4738-a916-4584cbdddcb9 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:48:44.099817 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ec2a7756-44e4-4738-a916-4584cbdddcb9 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:48:44.100264 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ec2a7756-44e4-4738-a916-4584cbdddcb9 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:48:44.100968 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ec2a7756-44e4-4738-a916-4584cbdddcb9 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:48:44.101432 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ec2a7756-44e4-4738-a916-4584cbdddcb9 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:48:44.101865 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ec2a7756-44e4-4738-a916-4584cbdddcb9 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:48:44.232571 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-ec2a7756-44e4-4738-a916-4584cbdddcb9 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:48:44.241361 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-ec2a7756-44e4-4738-a916-4584cbdddcb9 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/565c49d8-efe1-4dcb-b6b8-493de07df35d" status: 200 len: 1668 microversion: 2.1 time: 0.153539 Sep 14 09:48:44.241958 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3711/7035] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:48:44 2022] GET /compute/v2.1/servers/565c49d8-efe1-4dcb-b6b8-493de07df35d => generated 1668 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:48:44.263312 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-37ce1e64-1244-46dd-9123-a7dfcbc635b0 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:48:44.263936 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-37ce1e64-1244-46dd-9123-a7dfcbc635b0 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 565c49d8-efe1-4dcb-b6b8-493de07df35d] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:48:44.269970 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-37ce1e64-1244-46dd-9123-a7dfcbc635b0 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:48:44.270468 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-37ce1e64-1244-46dd-9123-a7dfcbc635b0 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:48:44.270916 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-37ce1e64-1244-46dd-9123-a7dfcbc635b0 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:48:44.271642 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-37ce1e64-1244-46dd-9123-a7dfcbc635b0 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:48:44.272105 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-37ce1e64-1244-46dd-9123-a7dfcbc635b0 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:48:44.272823 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-37ce1e64-1244-46dd-9123-a7dfcbc635b0 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:48:44.420364 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-37ce1e64-1244-46dd-9123-a7dfcbc635b0 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:48:44.428583 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-37ce1e64-1244-46dd-9123-a7dfcbc635b0 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/565c49d8-efe1-4dcb-b6b8-493de07df35d" status: 200 len: 1668 microversion: 2.1 time: 0.169073 Sep 14 09:48:44.429173 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3712/7036] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:48:44 2022] GET /compute/v2.1/servers/565c49d8-efe1-4dcb-b6b8-493de07df35d => generated 1668 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:48:44.451065 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-aa93bb94-7e9d-4c65-abfd-7a123451e839 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:48:44.451511 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-aa93bb94-7e9d-4c65-abfd-7a123451e839 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 565c49d8-efe1-4dcb-b6b8-493de07df35d] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:48:44.457864 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-aa93bb94-7e9d-4c65-abfd-7a123451e839 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:48:44.458355 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-aa93bb94-7e9d-4c65-abfd-7a123451e839 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:48:44.458798 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-aa93bb94-7e9d-4c65-abfd-7a123451e839 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:48:44.459520 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-aa93bb94-7e9d-4c65-abfd-7a123451e839 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:48:44.459979 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-aa93bb94-7e9d-4c65-abfd-7a123451e839 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:48:44.460406 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-aa93bb94-7e9d-4c65-abfd-7a123451e839 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:48:44.486362 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-aa93bb94-7e9d-4c65-abfd-7a123451e839 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 565c49d8-efe1-4dcb-b6b8-493de07df35d] Going to try to terminate instance {{(pid=128759) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:48:44.562261 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-aa93bb94-7e9d-4c65-abfd-7a123451e839 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "DELETE /compute/v2.1/servers/565c49d8-efe1-4dcb-b6b8-493de07df35d" status: 204 len: 0 microversion: 2.1 time: 0.114729 Sep 14 09:48:44.562861 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3713/7037] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:48:44 2022] DELETE /compute/v2.1/servers/565c49d8-efe1-4dcb-b6b8-493de07df35d => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 14 09:48:44.572045 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-48ebec79-6272-456c-bd18-5bab6621a64b tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:48:44.572759 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-48ebec79-6272-456c-bd18-5bab6621a64b tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 565c49d8-efe1-4dcb-b6b8-493de07df35d] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:48:44.578681 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-48ebec79-6272-456c-bd18-5bab6621a64b tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:48:44.579206 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-48ebec79-6272-456c-bd18-5bab6621a64b tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:48:44.579650 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-48ebec79-6272-456c-bd18-5bab6621a64b tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:48:44.580343 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-48ebec79-6272-456c-bd18-5bab6621a64b tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:48:44.581339 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-48ebec79-6272-456c-bd18-5bab6621a64b tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:48:44.581769 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-48ebec79-6272-456c-bd18-5bab6621a64b tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:48:44.712259 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-48ebec79-6272-456c-bd18-5bab6621a64b tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:48:44.720557 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-48ebec79-6272-456c-bd18-5bab6621a64b tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/565c49d8-efe1-4dcb-b6b8-493de07df35d" status: 200 len: 1674 microversion: 2.1 time: 0.152685 Sep 14 09:48:44.721162 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3714/7038] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:48:44 2022] GET /compute/v2.1/servers/565c49d8-efe1-4dcb-b6b8-493de07df35d => generated 1674 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:48:45.745353 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-5b1d1918-04b5-4c3a-96a8-edbb9e006bd8 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:48:45.745992 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-5b1d1918-04b5-4c3a-96a8-edbb9e006bd8 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 565c49d8-efe1-4dcb-b6b8-493de07df35d] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:48:45.752862 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5b1d1918-04b5-4c3a-96a8-edbb9e006bd8 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:48:45.753356 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5b1d1918-04b5-4c3a-96a8-edbb9e006bd8 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:48:45.753795 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5b1d1918-04b5-4c3a-96a8-edbb9e006bd8 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:48:45.754497 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5b1d1918-04b5-4c3a-96a8-edbb9e006bd8 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:48:45.754990 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5b1d1918-04b5-4c3a-96a8-edbb9e006bd8 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:48:45.755426 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5b1d1918-04b5-4c3a-96a8-edbb9e006bd8 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:48:45.889535 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-5b1d1918-04b5-4c3a-96a8-edbb9e006bd8 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:48:45.898147 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-5b1d1918-04b5-4c3a-96a8-edbb9e006bd8 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/565c49d8-efe1-4dcb-b6b8-493de07df35d" status: 200 len: 1674 microversion: 2.1 time: 0.156728 Sep 14 09:48:45.898734 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3715/7039] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:48:45 2022] GET /compute/v2.1/servers/565c49d8-efe1-4dcb-b6b8-493de07df35d => generated 1674 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:48:46.921876 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-1c4b4e3d-81f9-4628-beba-ae7a3a290420 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:48:46.922507 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-1c4b4e3d-81f9-4628-beba-ae7a3a290420 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 565c49d8-efe1-4dcb-b6b8-493de07df35d] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:48:46.930759 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1c4b4e3d-81f9-4628-beba-ae7a3a290420 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:48:46.931569 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1c4b4e3d-81f9-4628-beba-ae7a3a290420 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:48:46.932011 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1c4b4e3d-81f9-4628-beba-ae7a3a290420 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:48:46.932879 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1c4b4e3d-81f9-4628-beba-ae7a3a290420 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:48:46.933347 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1c4b4e3d-81f9-4628-beba-ae7a3a290420 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:48:46.933772 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1c4b4e3d-81f9-4628-beba-ae7a3a290420 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:48:47.017855 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-1c4b4e3d-81f9-4628-beba-ae7a3a290420 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:48:47.028649 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-1c4b4e3d-81f9-4628-beba-ae7a3a290420 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/565c49d8-efe1-4dcb-b6b8-493de07df35d" status: 200 len: 1607 microversion: 2.1 time: 0.110487 Sep 14 09:48:47.029697 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3716/7040] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:48:46 2022] GET /compute/v2.1/servers/565c49d8-efe1-4dcb-b6b8-493de07df35d => generated 1607 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:48:47.035867 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-8e07f46f-0595-4242-9a73-f21f1f52b180 req-f633fd63-1942-4a6f-b48b-de0a299dd321 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "565c49d8-efe1-4dcb-b6b8-493de07df35d", "name": "network-vif-deleted", "tag": "689af942-9fb7-45d0-903d-02cde067a6d0"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:48:47.054327 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-8e07f46f-0595-4242-9a73-f21f1f52b180 req-f633fd63-1942-4a6f-b48b-de0a299dd321 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:48:47.054801 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-8e07f46f-0595-4242-9a73-f21f1f52b180 req-f633fd63-1942-4a6f-b48b-de0a299dd321 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:48:47.055252 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-8e07f46f-0595-4242-9a73-f21f1f52b180 req-f633fd63-1942-4a6f-b48b-de0a299dd321 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:48:47.067849 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-8e07f46f-0595-4242-9a73-f21f1f52b180 req-f633fd63-1942-4a6f-b48b-de0a299dd321 service nova] Creating event network-vif-deleted:689af942-9fb7-45d0-903d-02cde067a6d0 for instance 565c49d8-efe1-4dcb-b6b8-493de07df35d on n-h2-836830-18 Sep 14 09:48:47.073911 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-8e07f46f-0595-4242-9a73-f21f1f52b180 req-f633fd63-1942-4a6f-b48b-de0a299dd321 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043287 Sep 14 09:48:47.074749 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3717/7041] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:48:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:48:48.051650 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=3 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:48:48.056753 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-763dca02-11c6-4166-b18f-14c9d22d4839 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:48:48.057476 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-763dca02-11c6-4166-b18f-14c9d22d4839 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 565c49d8-efe1-4dcb-b6b8-493de07df35d] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:48:48.063953 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-763dca02-11c6-4166-b18f-14c9d22d4839 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:48:48.064447 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-763dca02-11c6-4166-b18f-14c9d22d4839 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:48:48.065399 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-763dca02-11c6-4166-b18f-14c9d22d4839 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:48:48.066092 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-763dca02-11c6-4166-b18f-14c9d22d4839 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:48:48.066557 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-763dca02-11c6-4166-b18f-14c9d22d4839 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:48:48.067017 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-763dca02-11c6-4166-b18f-14c9d22d4839 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:48:48.080405 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-763dca02-11c6-4166-b18f-14c9d22d4839 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] HTTP exception thrown: Instance 565c49d8-efe1-4dcb-b6b8-493de07df35d could not be found. Sep 14 09:48:48.082580 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-763dca02-11c6-4166-b18f-14c9d22d4839 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Request method failure captured: Sep 14 09:48:48.082580 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/565c49d8-efe1-4dcb-b6b8-493de07df35d HTTP/1.1 Sep 14 09:48:48.082580 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:48:48.082580 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:48:48.082580 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:48:48.082580 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:48:48.082580 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:48:48.082580 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:48:48.082580 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:48:48.082580 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:48:48.082580 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIaKBrBAh_wj7DfZiRKdrZ6pB2BVsnaFIACH9I9tnPwlUsTvBKg4Km-70hzyiQAJmR8uMyCC--Kmi_m3mCvjQEmAIcuX7dXHviBWfEEzRkbjLifKvzwHyNal8H1sdEC_eoJmfTTtUV4zMyNBM3to2Z7TJSY3tl0h8kAHjt5BuvlhekYs Sep 14 09:48:48.082580 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:48:48.082580 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:48:48.082580 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:48:48.082580 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:48:48.082580 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:48:48.082580 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:48:48.082580 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 270f637ba197498bb4f7fa1ba14a62ad Sep 14 09:48:48.082580 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ServerActionsTestJSON-1037640335 Sep 14 09:48:48.082580 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:48:48.082580 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:48:48.082580 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/270f637ba197498bb4f7fa1ba14a62ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_270f637ba197498bb4f7fa1ba14a62ad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/270f637ba197498bb4f7fa1ba14a62ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/270f637ba197498bb4f7fa1ba14a62ad"}]}] Sep 14 09:48:48.082580 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ServerActionsTestJSON-1037640335 Sep 14 09:48:48.082580 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 270f637ba197498bb4f7fa1ba14a62ad Sep 14 09:48:48.082580 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ServerActionsTestJSON-1037640335 Sep 14 09:48:48.082580 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ServerActionsTestJSON-1037640335-project Sep 14 09:48:48.082580 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:48:48.082580 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:48:48.082580 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 5de83b9937f145dbbe1091039327e71a Sep 14 09:48:48.082580 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ServerActionsTestJSON-1037640335-project Sep 14 09:48:48.082580 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:48:48.082580 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance 565c49d8-efe1-4dcb-b6b8-493de07df35d could not be found. Sep 14 09:48:48.082580 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '565c49d8-efe1-4dcb-b6b8-493de07df35d'} Sep 14 09:48:48.082580 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:48:48.082580 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:48:48.082580 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:48:48.082580 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:48:48.082580 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:48:48.082580 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:48:48.082580 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:48:48.082580 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:48:48.082580 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:48:48.082580 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:48:48.082580 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 565c49d8-efe1-4dcb-b6b8-493de07df35d could not be found. Sep 14 09:48:48.082580 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:48:48.082580 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:48:48.082580 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:48:48.082580 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:48:48.082580 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:48:48.082580 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:48:48.082580 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:48:48.082580 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:48:48.082580 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:48:48.082580 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:48:48.082580 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:48:48.082580 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:48:48.082580 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:48:48.082580 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:48:48.082580 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:48:48.082580 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:48:48.082580 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 565c49d8-efe1-4dcb-b6b8-493de07df35d could not be found. Sep 14 09:48:48.082580 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:48:48.082580 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:48:48.082580 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:48:48.087596 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:48:48.087596 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:48:48.087596 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:48:48.087596 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:48:48.087596 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:48:48.087596 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 565c49d8-efe1-4dcb-b6b8-493de07df35d could not be found. Sep 14 09:48:48.087596 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:48:48.087596 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-763dca02-11c6-4166-b18f-14c9d22d4839 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Returning 404 to user: Instance 565c49d8-efe1-4dcb-b6b8-493de07df35d could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:48:48.087596 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-763dca02-11c6-4166-b18f-14c9d22d4839 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/565c49d8-efe1-4dcb-b6b8-493de07df35d" status: 404 len: 111 microversion: 2.1 time: 0.033450 Sep 14 09:48:48.087596 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3718/7042] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:48:48 2022] GET /compute/v2.1/servers/565c49d8-efe1-4dcb-b6b8-493de07df35d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 14 09:48:48.102893 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-fc647698-ad6c-43ee-b49c-623b8370e0ae tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:48:48.103575 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-fc647698-ad6c-43ee-b49c-623b8370e0ae tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 565c49d8-efe1-4dcb-b6b8-493de07df35d] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:48:48.109572 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fc647698-ad6c-43ee-b49c-623b8370e0ae tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:48:48.110066 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fc647698-ad6c-43ee-b49c-623b8370e0ae tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:48:48.110513 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fc647698-ad6c-43ee-b49c-623b8370e0ae tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:48:48.111240 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fc647698-ad6c-43ee-b49c-623b8370e0ae tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:48:48.111708 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fc647698-ad6c-43ee-b49c-623b8370e0ae tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:48:48.112141 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fc647698-ad6c-43ee-b49c-623b8370e0ae tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:48:48.125567 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-fc647698-ad6c-43ee-b49c-623b8370e0ae tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] HTTP exception thrown: Instance 565c49d8-efe1-4dcb-b6b8-493de07df35d could not be found. Sep 14 09:48:48.127111 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-fc647698-ad6c-43ee-b49c-623b8370e0ae tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Request method failure captured: Sep 14 09:48:48.127111 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/565c49d8-efe1-4dcb-b6b8-493de07df35d HTTP/1.1 Sep 14 09:48:48.127111 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:48:48.127111 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:48:48.127111 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:48:48.127111 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:48:48.127111 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:48:48.127111 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:48:48.127111 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:48:48.127111 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:48:48.127111 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIaKBrBAh_wj7DfZiRKdrZ6pB2BVsnaFIACH9I9tnPwlUsTvBKg4Km-70hzyiQAJmR8uMyCC--Kmi_m3mCvjQEmAIcuX7dXHviBWfEEzRkbjLifKvzwHyNal8H1sdEC_eoJmfTTtUV4zMyNBM3to2Z7TJSY3tl0h8kAHjt5BuvlhekYs Sep 14 09:48:48.127111 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:48:48.127111 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:48:48.127111 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:48:48.127111 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:48:48.127111 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:48:48.127111 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:48:48.127111 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 270f637ba197498bb4f7fa1ba14a62ad Sep 14 09:48:48.127111 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ServerActionsTestJSON-1037640335 Sep 14 09:48:48.127111 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:48:48.127111 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:48:48.127111 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/270f637ba197498bb4f7fa1ba14a62ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_270f637ba197498bb4f7fa1ba14a62ad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/270f637ba197498bb4f7fa1ba14a62ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/270f637ba197498bb4f7fa1ba14a62ad"}]}] Sep 14 09:48:48.127111 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ServerActionsTestJSON-1037640335 Sep 14 09:48:48.127111 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 270f637ba197498bb4f7fa1ba14a62ad Sep 14 09:48:48.127111 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ServerActionsTestJSON-1037640335 Sep 14 09:48:48.127111 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ServerActionsTestJSON-1037640335-project Sep 14 09:48:48.127111 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:48:48.127111 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:48:48.127111 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 5de83b9937f145dbbe1091039327e71a Sep 14 09:48:48.127111 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ServerActionsTestJSON-1037640335-project Sep 14 09:48:48.127111 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:48:48.127111 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance 565c49d8-efe1-4dcb-b6b8-493de07df35d could not be found. Sep 14 09:48:48.127111 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '565c49d8-efe1-4dcb-b6b8-493de07df35d'} Sep 14 09:48:48.127111 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:48:48.127111 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:48:48.127111 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:48:48.127111 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:48:48.127111 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:48:48.127111 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:48:48.127111 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:48:48.127111 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:48:48.127111 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:48:48.127111 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:48:48.127111 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 565c49d8-efe1-4dcb-b6b8-493de07df35d could not be found. Sep 14 09:48:48.127111 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:48:48.127111 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:48:48.127111 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:48:48.127111 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:48:48.127111 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:48:48.127111 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:48:48.127111 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:48:48.127111 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:48:48.127111 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:48:48.127111 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:48:48.127111 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:48:48.127111 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:48:48.127111 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:48:48.127111 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:48:48.127111 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:48:48.127111 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:48:48.127111 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 565c49d8-efe1-4dcb-b6b8-493de07df35d could not be found. Sep 14 09:48:48.127111 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:48:48.127111 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:48:48.127111 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:48:48.132418 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:48:48.132418 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:48:48.132418 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:48:48.132418 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:48:48.132418 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:48:48.132418 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 565c49d8-efe1-4dcb-b6b8-493de07df35d could not be found. Sep 14 09:48:48.132418 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:48:48.132418 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-fc647698-ad6c-43ee-b49c-623b8370e0ae tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Returning 404 to user: Instance 565c49d8-efe1-4dcb-b6b8-493de07df35d could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:48:48.132418 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-fc647698-ad6c-43ee-b49c-623b8370e0ae tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/565c49d8-efe1-4dcb-b6b8-493de07df35d" status: 404 len: 111 microversion: 2.1 time: 0.029981 Sep 14 09:48:48.132418 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3719/7043] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:48:48 2022] GET /compute/v2.1/servers/565c49d8-efe1-4dcb-b6b8-493de07df35d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 14 09:48:48.178048 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ccafab1f-6f08-4321-ba8b-804c18254c20 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-429732171", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "networks": [{"uuid": "5634288b-23f2-493a-aa6e-c62111a88261"}], "security_groups": [{"name": "tempest-securitygroup--438503213"}], "key_name": "tempest-keypair-254910026", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:48:48.285159 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.network.neutron [None req-ccafab1f-6f08-4321-ba8b-804c18254c20 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] validate_networks() for [('5634288b-23f2-493a-aa6e-c62111a88261', None, None, None, None, None)] {{(pid=128759) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:48:48.656634 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-ccafab1f-6f08-4321-ba8b-804c18254c20 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Flavor limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:48:48.657068 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-ccafab1f-6f08-4321-ba8b-804c18254c20 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Image limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:48:48.657550 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-ccafab1f-6f08-4321-ba8b-804c18254c20 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Flavor pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:48:48.657966 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-ccafab1f-6f08-4321-ba8b-804c18254c20 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Image pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:48:48.658386 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-ccafab1f-6f08-4321-ba8b-804c18254c20 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:48:48.670258 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ccafab1f-6f08-4321-ba8b-804c18254c20 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:48:48.670748 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ccafab1f-6f08-4321-ba8b-804c18254c20 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:48:48.671226 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ccafab1f-6f08-4321-ba8b-804c18254c20 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:48:48.671957 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ccafab1f-6f08-4321-ba8b-804c18254c20 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:48:48.672415 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ccafab1f-6f08-4321-ba8b-804c18254c20 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:48:48.672845 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ccafab1f-6f08-4321-ba8b-804c18254c20 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:48:48.690012 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-ccafab1f-6f08-4321-ba8b-804c18254c20 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Getting quotas for project 270f637ba197498bb4f7fa1ba14a62ad. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:48:48.695380 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-ccafab1f-6f08-4321-ba8b-804c18254c20 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Getting quotas for user 5de83b9937f145dbbe1091039327e71a and project 270f637ba197498bb4f7fa1ba14a62ad. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:48:48.707835 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-ccafab1f-6f08-4321-ba8b-804c18254c20 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Going to run 1 instances... {{(pid=128759) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:48:48.710141 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-ccafab1f-6f08-4321-ba8b-804c18254c20 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 81aae111-cb97-486f-b843-405808b7b096] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128759) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:48:48.758592 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-ccafab1f-6f08-4321-ba8b-804c18254c20 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.585069 Sep 14 09:48:48.759285 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3720/7044] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 09:48:48 2022] POST /compute/v2.1/servers => generated 405 bytes in 586 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 14 09:48:48.770964 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-215dd854-763b-4003-80fa-9aeca867a384 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:48:48.772012 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-215dd854-763b-4003-80fa-9aeca867a384 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 81aae111-cb97-486f-b843-405808b7b096] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:48:48.829163 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-215dd854-763b-4003-80fa-9aeca867a384 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:48:48.837306 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-215dd854-763b-4003-80fa-9aeca867a384 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096" status: 200 len: 1237 microversion: 2.1 time: 0.069627 Sep 14 09:48:48.837306 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3721/7045] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:48:48 2022] GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096 => generated 1237 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:48:49.863459 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e2035a5a-f70b-4af3-9c0b-3d7f51f6e6c4 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:48:49.864145 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e2035a5a-f70b-4af3-9c0b-3d7f51f6e6c4 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 81aae111-cb97-486f-b843-405808b7b096] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:48:49.873742 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e2035a5a-f70b-4af3-9c0b-3d7f51f6e6c4 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:48:49.874241 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e2035a5a-f70b-4af3-9c0b-3d7f51f6e6c4 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:48:49.874679 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e2035a5a-f70b-4af3-9c0b-3d7f51f6e6c4 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:48:49.875538 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e2035a5a-f70b-4af3-9c0b-3d7f51f6e6c4 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:48:49.875992 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e2035a5a-f70b-4af3-9c0b-3d7f51f6e6c4 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:48:49.876424 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e2035a5a-f70b-4af3-9c0b-3d7f51f6e6c4 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:48:49.941679 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-e2035a5a-f70b-4af3-9c0b-3d7f51f6e6c4 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:48:49.949576 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e2035a5a-f70b-4af3-9c0b-3d7f51f6e6c4 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096" status: 200 len: 1295 microversion: 2.1 time: 0.091761 Sep 14 09:48:49.950186 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3722/7046] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:48:49 2022] GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096 => generated 1295 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:48:50.973814 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-6acdec49-5cc0-46c7-958c-ff5bf56f13aa tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:48:50.974482 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-6acdec49-5cc0-46c7-958c-ff5bf56f13aa tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 81aae111-cb97-486f-b843-405808b7b096] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:48:50.981487 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6acdec49-5cc0-46c7-958c-ff5bf56f13aa tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:48:50.981937 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6acdec49-5cc0-46c7-958c-ff5bf56f13aa tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:48:50.982382 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6acdec49-5cc0-46c7-958c-ff5bf56f13aa tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:48:50.983158 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6acdec49-5cc0-46c7-958c-ff5bf56f13aa tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:48:50.983597 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6acdec49-5cc0-46c7-958c-ff5bf56f13aa tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:48:50.984014 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6acdec49-5cc0-46c7-958c-ff5bf56f13aa tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:48:51.119748 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-6acdec49-5cc0-46c7-958c-ff5bf56f13aa tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:48:51.128239 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-6acdec49-5cc0-46c7-958c-ff5bf56f13aa tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096" status: 200 len: 1362 microversion: 2.1 time: 0.157743 Sep 14 09:48:51.128841 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3723/7047] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:48:50 2022] GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:48:51.201883 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-82819d68-0ae8-498e-941f-dbe283e41eaf req-d40bae08-9998-4f42-bf15-9bd29c151780 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81aae111-cb97-486f-b843-405808b7b096", "tag": "5936b844-2b77-4ad5-934a-163f3310dce3"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:48:51.211812 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-82819d68-0ae8-498e-941f-dbe283e41eaf req-d40bae08-9998-4f42-bf15-9bd29c151780 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:48:51.212297 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-82819d68-0ae8-498e-941f-dbe283e41eaf req-d40bae08-9998-4f42-bf15-9bd29c151780 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:48:51.212732 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-82819d68-0ae8-498e-941f-dbe283e41eaf req-d40bae08-9998-4f42-bf15-9bd29c151780 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:48:51.224731 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-82819d68-0ae8-498e-941f-dbe283e41eaf req-d40bae08-9998-4f42-bf15-9bd29c151780 service nova] Creating event network-changed:5936b844-2b77-4ad5-934a-163f3310dce3 for instance 81aae111-cb97-486f-b843-405808b7b096 on n-h2-836830-18 Sep 14 09:48:51.229580 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-82819d68-0ae8-498e-941f-dbe283e41eaf req-d40bae08-9998-4f42-bf15-9bd29c151780 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031396 Sep 14 09:48:51.230190 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3724/7048] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:48:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:48:52.153665 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-dd0713ef-92fd-4ae2-a52b-368b11844015 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:48:52.154360 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-dd0713ef-92fd-4ae2-a52b-368b11844015 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 81aae111-cb97-486f-b843-405808b7b096] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:48:52.161274 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dd0713ef-92fd-4ae2-a52b-368b11844015 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:48:52.161767 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dd0713ef-92fd-4ae2-a52b-368b11844015 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:48:52.162213 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dd0713ef-92fd-4ae2-a52b-368b11844015 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:48:52.162900 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dd0713ef-92fd-4ae2-a52b-368b11844015 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:48:52.163389 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dd0713ef-92fd-4ae2-a52b-368b11844015 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:48:52.163818 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dd0713ef-92fd-4ae2-a52b-368b11844015 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:48:52.291308 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-dd0713ef-92fd-4ae2-a52b-368b11844015 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:48:52.293676 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:48:52.301070 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-dd0713ef-92fd-4ae2-a52b-368b11844015 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096" status: 200 len: 1362 microversion: 2.1 time: 0.152503 Sep 14 09:48:52.301660 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3725/7049] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:48:52 2022] GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:48:53.324657 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-5bbd23a0-bc26-4e9f-9523-519901037c42 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:48:53.325273 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-5bbd23a0-bc26-4e9f-9523-519901037c42 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 81aae111-cb97-486f-b843-405808b7b096] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:48:53.332682 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5bbd23a0-bc26-4e9f-9523-519901037c42 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:48:53.333161 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5bbd23a0-bc26-4e9f-9523-519901037c42 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:48:53.333594 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5bbd23a0-bc26-4e9f-9523-519901037c42 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:48:53.334279 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5bbd23a0-bc26-4e9f-9523-519901037c42 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:48:53.334739 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5bbd23a0-bc26-4e9f-9523-519901037c42 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:48:53.335187 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5bbd23a0-bc26-4e9f-9523-519901037c42 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:48:53.471772 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-5bbd23a0-bc26-4e9f-9523-519901037c42 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:48:53.479556 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-5bbd23a0-bc26-4e9f-9523-519901037c42 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096" status: 200 len: 1362 microversion: 2.1 time: 0.159152 Sep 14 09:48:53.480134 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3726/7050] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:48:53 2022] GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:48:54.503399 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-2bb4657a-64ab-4d5b-abf2-437e1c85da2a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:48:54.504050 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-2bb4657a-64ab-4d5b-abf2-437e1c85da2a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 81aae111-cb97-486f-b843-405808b7b096] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:48:54.510564 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2bb4657a-64ab-4d5b-abf2-437e1c85da2a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:48:54.511089 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2bb4657a-64ab-4d5b-abf2-437e1c85da2a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:48:54.511529 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2bb4657a-64ab-4d5b-abf2-437e1c85da2a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:48:54.512226 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2bb4657a-64ab-4d5b-abf2-437e1c85da2a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:48:54.512683 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2bb4657a-64ab-4d5b-abf2-437e1c85da2a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:48:54.513111 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2bb4657a-64ab-4d5b-abf2-437e1c85da2a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:48:54.642624 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-2bb4657a-64ab-4d5b-abf2-437e1c85da2a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:48:54.650984 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-2bb4657a-64ab-4d5b-abf2-437e1c85da2a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096" status: 200 len: 1362 microversion: 2.1 time: 0.152221 Sep 14 09:48:54.651570 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3727/7051] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:48:54 2022] GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:48:55.177678 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-0dfafba1-e562-447e-b15f-ad34a73fa575 req-fc380099-8078-444b-ab11-3747c9caf154 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81aae111-cb97-486f-b843-405808b7b096", "name": "network-vif-plugged", "status": "completed", "tag": "5936b844-2b77-4ad5-934a-163f3310dce3"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:48:55.187253 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-0dfafba1-e562-447e-b15f-ad34a73fa575 req-fc380099-8078-444b-ab11-3747c9caf154 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:48:55.187739 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-0dfafba1-e562-447e-b15f-ad34a73fa575 req-fc380099-8078-444b-ab11-3747c9caf154 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:48:55.188201 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-0dfafba1-e562-447e-b15f-ad34a73fa575 req-fc380099-8078-444b-ab11-3747c9caf154 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:48:55.203139 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-0dfafba1-e562-447e-b15f-ad34a73fa575 req-fc380099-8078-444b-ab11-3747c9caf154 service nova] Creating event network-vif-plugged:5936b844-2b77-4ad5-934a-163f3310dce3 for instance 81aae111-cb97-486f-b843-405808b7b096 on n-h2-836830-18 Sep 14 09:48:55.208389 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-0dfafba1-e562-447e-b15f-ad34a73fa575 req-fc380099-8078-444b-ab11-3747c9caf154 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034693 Sep 14 09:48:55.208999 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3728/7052] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:48:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:48:55.676205 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ccd25d00-f6a2-4ebf-bf3c-e2fab442c34c tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:48:55.676917 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-ccd25d00-f6a2-4ebf-bf3c-e2fab442c34c tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 81aae111-cb97-486f-b843-405808b7b096] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:48:55.683067 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ccd25d00-f6a2-4ebf-bf3c-e2fab442c34c tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:48:55.683552 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ccd25d00-f6a2-4ebf-bf3c-e2fab442c34c tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:48:55.683986 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ccd25d00-f6a2-4ebf-bf3c-e2fab442c34c tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:48:55.684667 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ccd25d00-f6a2-4ebf-bf3c-e2fab442c34c tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:48:55.685117 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ccd25d00-f6a2-4ebf-bf3c-e2fab442c34c tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:48:55.685536 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ccd25d00-f6a2-4ebf-bf3c-e2fab442c34c tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:48:55.814586 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-ccd25d00-f6a2-4ebf-bf3c-e2fab442c34c tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:48:55.822281 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-ccd25d00-f6a2-4ebf-bf3c-e2fab442c34c tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096" status: 200 len: 1362 microversion: 2.1 time: 0.151170 Sep 14 09:48:55.822858 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3729/7053] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:48:55 2022] GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:48:56.846011 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-04e612d2-4d94-4d7d-9f64-a6bab490de5d tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:48:56.846633 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-04e612d2-4d94-4d7d-9f64-a6bab490de5d tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 81aae111-cb97-486f-b843-405808b7b096] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:48:56.853553 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-04e612d2-4d94-4d7d-9f64-a6bab490de5d tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:48:56.854073 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-04e612d2-4d94-4d7d-9f64-a6bab490de5d tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:48:56.854496 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-04e612d2-4d94-4d7d-9f64-a6bab490de5d tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:48:56.855219 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-04e612d2-4d94-4d7d-9f64-a6bab490de5d tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:48:56.855682 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-04e612d2-4d94-4d7d-9f64-a6bab490de5d tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:48:56.856353 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-04e612d2-4d94-4d7d-9f64-a6bab490de5d tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:48:56.991989 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-04e612d2-4d94-4d7d-9f64-a6bab490de5d tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:48:56.999984 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-04e612d2-4d94-4d7d-9f64-a6bab490de5d tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096" status: 200 len: 1549 microversion: 2.1 time: 0.158188 Sep 14 09:48:57.000558 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3730/7054] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:48:56 2022] GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096 => generated 1549 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:48:57.027617 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c5cbb355-1c88-42fe-b983-ed8c7e776d4b tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:48:57.028615 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-c5cbb355-1c88-42fe-b983-ed8c7e776d4b tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 81aae111-cb97-486f-b843-405808b7b096] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:48:57.038881 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c5cbb355-1c88-42fe-b983-ed8c7e776d4b tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:48:57.039784 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c5cbb355-1c88-42fe-b983-ed8c7e776d4b tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:48:57.040580 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c5cbb355-1c88-42fe-b983-ed8c7e776d4b tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:48:57.041843 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c5cbb355-1c88-42fe-b983-ed8c7e776d4b tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:48:57.042600 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c5cbb355-1c88-42fe-b983-ed8c7e776d4b tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:48:57.043400 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c5cbb355-1c88-42fe-b983-ed8c7e776d4b tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:48:57.140377 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-c5cbb355-1c88-42fe-b983-ed8c7e776d4b tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.119828 Sep 14 09:48:57.141029 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3731/7055] 10.222.0.60 () {58 vars in 1275 bytes} [Wed Sep 14 09:48:57 2022] GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096/os-interface => generated 285 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:48:58.085647 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-bdd4f8c5-5942-4ef0-8b33-e3565e076550 req-d4e1d3ba-70b1-4ffd-a673-a00353718e29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81aae111-cb97-486f-b843-405808b7b096", "tag": "5936b844-2b77-4ad5-934a-163f3310dce3"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:48:58.095425 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-bdd4f8c5-5942-4ef0-8b33-e3565e076550 req-d4e1d3ba-70b1-4ffd-a673-a00353718e29 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:48:58.095949 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-bdd4f8c5-5942-4ef0-8b33-e3565e076550 req-d4e1d3ba-70b1-4ffd-a673-a00353718e29 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:48:58.096384 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-bdd4f8c5-5942-4ef0-8b33-e3565e076550 req-d4e1d3ba-70b1-4ffd-a673-a00353718e29 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:48:58.109396 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-bdd4f8c5-5942-4ef0-8b33-e3565e076550 req-d4e1d3ba-70b1-4ffd-a673-a00353718e29 service nova] Creating event network-changed:5936b844-2b77-4ad5-934a-163f3310dce3 for instance 81aae111-cb97-486f-b843-405808b7b096 on n-h2-836830-18 Sep 14 09:48:58.115321 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-bdd4f8c5-5942-4ef0-8b33-e3565e076550 req-d4e1d3ba-70b1-4ffd-a673-a00353718e29 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034128 Sep 14 09:48:58.115942 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3732/7056] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:48:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:49:22.320871 n-d-836830-18 devstack@n-api.service[128758]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 09:49:22.321474 n-d-836830-18 devstack@n-api.service[128758]: Wed Sep 14 09:49:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.60) !!! Sep 14 09:49:22.326634 n-d-836830-18 devstack@n-api.service[128758]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 09:49:22.326772 n-d-836830-18 devstack@n-api.service[128758]: Wed Sep 14 09:49:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.60) !!! Sep 14 09:49:32.347948 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=2 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:49:32.348753 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=8 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:49:32.350777 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:49:32.351523 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=33 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:49:32.356061 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-42cd62c9-a548-478b-b51d-ef4b60d60660 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:49:32.356772 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-42cd62c9-a548-478b-b51d-ef4b60d60660 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 81aae111-cb97-486f-b843-405808b7b096] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:49:32.365157 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-42cd62c9-a548-478b-b51d-ef4b60d60660 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:49:32.365568 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-42cd62c9-a548-478b-b51d-ef4b60d60660 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:49:32.366009 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-42cd62c9-a548-478b-b51d-ef4b60d60660 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:49:32.366694 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-42cd62c9-a548-478b-b51d-ef4b60d60660 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:49:32.367187 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-42cd62c9-a548-478b-b51d-ef4b60d60660 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:49:32.367614 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-42cd62c9-a548-478b-b51d-ef4b60d60660 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:49:32.504160 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-42cd62c9-a548-478b-b51d-ef4b60d60660 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:49:32.511868 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-42cd62c9-a548-478b-b51d-ef4b60d60660 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096" status: 200 len: 1667 microversion: 2.1 time: 0.164896 Sep 14 09:49:32.512453 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3733/7057] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:49:32 2022] GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096 => generated 1667 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:49:32.536608 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a9968d41-2659-4666-b841-88b6bfb78f67 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eaf905b3-7ee3-44fd-b0ca-8ae1cb8f52a6"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:49:32.538974 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-a9968d41-2659-4666-b841-88b6bfb78f67 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 81aae111-cb97-486f-b843-405808b7b096] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:49:32.544594 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a9968d41-2659-4666-b841-88b6bfb78f67 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:49:32.545071 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a9968d41-2659-4666-b841-88b6bfb78f67 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:49:32.545506 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a9968d41-2659-4666-b841-88b6bfb78f67 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:49:32.546190 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a9968d41-2659-4666-b841-88b6bfb78f67 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:49:32.546642 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a9968d41-2659-4666-b841-88b6bfb78f67 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:49:32.547090 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a9968d41-2659-4666-b841-88b6bfb78f67 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:49:32.793973 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a9968d41-2659-4666-b841-88b6bfb78f67 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "POST /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.261318 Sep 14 09:49:32.794881 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3734/7058] 10.222.0.60 () {60 vars in 1323 bytes} [Wed Sep 14 09:49:32 2022] POST /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096/os-volume_attachments => generated 194 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:49:43.679545 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-5503dba4-abac-4124-af7b-9111f938f25a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:49:43.681999 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-5503dba4-abac-4124-af7b-9111f938f25a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 81aae111-cb97-486f-b843-405808b7b096] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:49:43.684944 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=4 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:49:43.685783 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:49:43.692841 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5503dba4-abac-4124-af7b-9111f938f25a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:49:43.693334 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5503dba4-abac-4124-af7b-9111f938f25a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:49:43.693780 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5503dba4-abac-4124-af7b-9111f938f25a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:49:43.694508 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5503dba4-abac-4124-af7b-9111f938f25a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:49:43.694996 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5503dba4-abac-4124-af7b-9111f938f25a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:49:43.695434 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5503dba4-abac-4124-af7b-9111f938f25a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:49:43.727581 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-5503dba4-abac-4124-af7b-9111f938f25a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:49:43.732902 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-5503dba4-abac-4124-af7b-9111f938f25a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 81aae111-cb97-486f-b843-405808b7b096] Old instance type m1.heat2, new instance type m1.heat {{(pid=128759) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 14 09:49:43.740448 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-5503dba4-abac-4124-af7b-9111f938f25a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Flavor limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:49:43.740878 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-5503dba4-abac-4124-af7b-9111f938f25a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Image limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:49:43.741360 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-5503dba4-abac-4124-af7b-9111f938f25a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Flavor pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:49:43.741777 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-5503dba4-abac-4124-af7b-9111f938f25a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Image pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:49:43.742194 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-5503dba4-abac-4124-af7b-9111f938f25a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:49:43.805892 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-5503dba4-abac-4124-af7b-9111f938f25a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "POST /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096/action" status: 202 len: 0 microversion: 2.1 time: 0.131412 Sep 14 09:49:43.806506 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3735/7059] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:49:43 2022] POST /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 14 09:49:43.814418 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-1fa03314-eb01-4556-a55d-2c1b84b7f0c8 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:49:43.815142 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-1fa03314-eb01-4556-a55d-2c1b84b7f0c8 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 81aae111-cb97-486f-b843-405808b7b096] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:49:43.822282 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1fa03314-eb01-4556-a55d-2c1b84b7f0c8 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:49:43.822778 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1fa03314-eb01-4556-a55d-2c1b84b7f0c8 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:49:43.823658 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1fa03314-eb01-4556-a55d-2c1b84b7f0c8 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:49:43.823942 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1fa03314-eb01-4556-a55d-2c1b84b7f0c8 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:49:43.824406 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1fa03314-eb01-4556-a55d-2c1b84b7f0c8 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:49:43.824839 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1fa03314-eb01-4556-a55d-2c1b84b7f0c8 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:49:43.964806 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-1fa03314-eb01-4556-a55d-2c1b84b7f0c8 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:49:43.974228 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-1fa03314-eb01-4556-a55d-2c1b84b7f0c8 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096" status: 200 len: 1722 microversion: 2.1 time: 0.163483 Sep 14 09:49:43.974806 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3736/7060] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:49:43 2022] GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:49:45.001726 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b62382a8-6a2e-4864-a497-9c74cd63495d tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:49:45.002363 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b62382a8-6a2e-4864-a497-9c74cd63495d tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 81aae111-cb97-486f-b843-405808b7b096] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:49:45.009618 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b62382a8-6a2e-4864-a497-9c74cd63495d tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:49:45.010109 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b62382a8-6a2e-4864-a497-9c74cd63495d tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:49:45.010552 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b62382a8-6a2e-4864-a497-9c74cd63495d tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:49:45.011366 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b62382a8-6a2e-4864-a497-9c74cd63495d tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:49:45.011830 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b62382a8-6a2e-4864-a497-9c74cd63495d tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:49:45.012261 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b62382a8-6a2e-4864-a497-9c74cd63495d tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:49:45.150684 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b62382a8-6a2e-4864-a497-9c74cd63495d tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:49:45.159195 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b62382a8-6a2e-4864-a497-9c74cd63495d tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096" status: 200 len: 1722 microversion: 2.1 time: 0.161925 Sep 14 09:49:45.159786 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3737/7061] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:49:44 2022] GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:49:46.183423 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-0c80963a-c281-467d-92fb-277a3918c20e tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:49:46.184127 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-0c80963a-c281-467d-92fb-277a3918c20e tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 81aae111-cb97-486f-b843-405808b7b096] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:49:46.191595 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0c80963a-c281-467d-92fb-277a3918c20e tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:49:46.192081 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0c80963a-c281-467d-92fb-277a3918c20e tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:49:46.192520 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0c80963a-c281-467d-92fb-277a3918c20e tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:49:46.193212 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0c80963a-c281-467d-92fb-277a3918c20e tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:49:46.193683 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0c80963a-c281-467d-92fb-277a3918c20e tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:49:46.194098 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0c80963a-c281-467d-92fb-277a3918c20e tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:49:46.328871 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-0c80963a-c281-467d-92fb-277a3918c20e tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:49:46.337056 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-0c80963a-c281-467d-92fb-277a3918c20e tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096" status: 200 len: 1727 microversion: 2.1 time: 0.157527 Sep 14 09:49:46.337639 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3738/7062] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:49:46 2022] GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096 => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:49:47.361393 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-06a5a1ae-9725-4b65-b214-83aa017337cf tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:49:47.362067 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-06a5a1ae-9725-4b65-b214-83aa017337cf tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 81aae111-cb97-486f-b843-405808b7b096] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:49:47.368929 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-06a5a1ae-9725-4b65-b214-83aa017337cf tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:49:47.369415 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-06a5a1ae-9725-4b65-b214-83aa017337cf tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:49:47.369863 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-06a5a1ae-9725-4b65-b214-83aa017337cf tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:49:47.370554 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-06a5a1ae-9725-4b65-b214-83aa017337cf tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:49:47.371039 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-06a5a1ae-9725-4b65-b214-83aa017337cf tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:49:47.371473 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-06a5a1ae-9725-4b65-b214-83aa017337cf tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:49:47.502318 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-06a5a1ae-9725-4b65-b214-83aa017337cf tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:49:47.511299 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-06a5a1ae-9725-4b65-b214-83aa017337cf tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096" status: 200 len: 1727 microversion: 2.1 time: 0.153807 Sep 14 09:49:47.511881 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3739/7063] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:49:47 2022] GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096 => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:49:48.535082 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a901c44c-2807-4d40-90ed-fd416811137d tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:49:48.535765 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-a901c44c-2807-4d40-90ed-fd416811137d tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 81aae111-cb97-486f-b843-405808b7b096] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:49:48.542554 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a901c44c-2807-4d40-90ed-fd416811137d tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:49:48.543071 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a901c44c-2807-4d40-90ed-fd416811137d tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:49:48.543513 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a901c44c-2807-4d40-90ed-fd416811137d tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:49:48.544201 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a901c44c-2807-4d40-90ed-fd416811137d tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:49:48.544657 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a901c44c-2807-4d40-90ed-fd416811137d tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:49:48.545085 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a901c44c-2807-4d40-90ed-fd416811137d tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:49:48.673368 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-a901c44c-2807-4d40-90ed-fd416811137d tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:49:48.682219 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a901c44c-2807-4d40-90ed-fd416811137d tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096" status: 200 len: 1727 microversion: 2.1 time: 0.151557 Sep 14 09:49:48.682798 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3740/7064] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:49:48 2022] GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096 => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:49:49.705009 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-5518e9cf-fbe6-4179-b59f-6f2d16fe176b tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:49:49.705669 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-5518e9cf-fbe6-4179-b59f-6f2d16fe176b tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 81aae111-cb97-486f-b843-405808b7b096] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:49:49.712544 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5518e9cf-fbe6-4179-b59f-6f2d16fe176b tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:49:49.713036 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5518e9cf-fbe6-4179-b59f-6f2d16fe176b tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:49:49.713482 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5518e9cf-fbe6-4179-b59f-6f2d16fe176b tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:49:49.714179 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5518e9cf-fbe6-4179-b59f-6f2d16fe176b tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:49:49.714641 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5518e9cf-fbe6-4179-b59f-6f2d16fe176b tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:49:49.715107 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5518e9cf-fbe6-4179-b59f-6f2d16fe176b tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:49:49.849743 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-5518e9cf-fbe6-4179-b59f-6f2d16fe176b tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:49:49.858068 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-5518e9cf-fbe6-4179-b59f-6f2d16fe176b tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096" status: 200 len: 1727 microversion: 2.1 time: 0.156982 Sep 14 09:49:49.858656 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3741/7065] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:49:49 2022] GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096 => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:49:50.882698 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-7032e887-3501-4054-be60-15e6ec616f62 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:49:50.883951 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-7032e887-3501-4054-be60-15e6ec616f62 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 81aae111-cb97-486f-b843-405808b7b096] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:49:50.892506 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7032e887-3501-4054-be60-15e6ec616f62 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:49:50.892994 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7032e887-3501-4054-be60-15e6ec616f62 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:49:50.893428 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7032e887-3501-4054-be60-15e6ec616f62 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:49:50.894747 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7032e887-3501-4054-be60-15e6ec616f62 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:49:50.895231 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7032e887-3501-4054-be60-15e6ec616f62 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:49:50.895656 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7032e887-3501-4054-be60-15e6ec616f62 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:49:51.269414 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-7032e887-3501-4054-be60-15e6ec616f62 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:49:51.279567 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-7032e887-3501-4054-be60-15e6ec616f62 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096" status: 200 len: 1727 microversion: 2.1 time: 0.401741 Sep 14 09:49:51.280193 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3742/7066] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:49:50 2022] GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096 => generated 1727 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:49:52.303594 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-500d8fb1-0c84-4914-b1ba-8946f15d511d tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:49:52.304302 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-500d8fb1-0c84-4914-b1ba-8946f15d511d tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 81aae111-cb97-486f-b843-405808b7b096] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:49:52.311062 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-500d8fb1-0c84-4914-b1ba-8946f15d511d tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:49:52.311555 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-500d8fb1-0c84-4914-b1ba-8946f15d511d tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:49:52.312008 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-500d8fb1-0c84-4914-b1ba-8946f15d511d tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:49:52.312706 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-500d8fb1-0c84-4914-b1ba-8946f15d511d tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:49:52.313168 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-500d8fb1-0c84-4914-b1ba-8946f15d511d tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:49:52.313603 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-500d8fb1-0c84-4914-b1ba-8946f15d511d tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:49:52.441559 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-500d8fb1-0c84-4914-b1ba-8946f15d511d tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:49:52.449986 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-500d8fb1-0c84-4914-b1ba-8946f15d511d tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096" status: 200 len: 1727 microversion: 2.1 time: 0.150919 Sep 14 09:49:52.450563 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3743/7067] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:49:52 2022] GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096 => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:49:53.477003 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a22cd994-f825-4fcf-8641-92c48da9bf7a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:49:53.477658 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-a22cd994-f825-4fcf-8641-92c48da9bf7a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 81aae111-cb97-486f-b843-405808b7b096] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:49:53.479839 n-d-836830-18 devstack@n-api.service[128759]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 09:49:53.479989 n-d-836830-18 devstack@n-api.service[128759]: Wed Sep 14 09:49:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096 (ip 10.222.0.60) !!! Sep 14 09:49:53.489269 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a22cd994-f825-4fcf-8641-92c48da9bf7a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:49:53.489810 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a22cd994-f825-4fcf-8641-92c48da9bf7a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:49:53.490282 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a22cd994-f825-4fcf-8641-92c48da9bf7a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:49:53.491020 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a22cd994-f825-4fcf-8641-92c48da9bf7a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:49:53.491478 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a22cd994-f825-4fcf-8641-92c48da9bf7a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:49:53.491903 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a22cd994-f825-4fcf-8641-92c48da9bf7a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:49:53.625255 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-a22cd994-f825-4fcf-8641-92c48da9bf7a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:49:53.634238 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a22cd994-f825-4fcf-8641-92c48da9bf7a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096" status: 200 len: 1727 microversion: 2.1 time: 0.161201 Sep 14 09:49:53.634819 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3744/7068] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:49:53 2022] GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096 => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:49:54.657325 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f6a25b28-94f0-4ade-b398-afd2ff22bb2e tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:49:54.657935 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f6a25b28-94f0-4ade-b398-afd2ff22bb2e tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 81aae111-cb97-486f-b843-405808b7b096] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:49:54.664988 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f6a25b28-94f0-4ade-b398-afd2ff22bb2e tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:49:54.665474 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f6a25b28-94f0-4ade-b398-afd2ff22bb2e tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:49:54.665912 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f6a25b28-94f0-4ade-b398-afd2ff22bb2e tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:49:54.666593 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f6a25b28-94f0-4ade-b398-afd2ff22bb2e tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:49:54.667071 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f6a25b28-94f0-4ade-b398-afd2ff22bb2e tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:49:54.667494 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f6a25b28-94f0-4ade-b398-afd2ff22bb2e tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:49:54.795666 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f6a25b28-94f0-4ade-b398-afd2ff22bb2e tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:49:54.804056 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f6a25b28-94f0-4ade-b398-afd2ff22bb2e tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096" status: 200 len: 1727 microversion: 2.1 time: 0.150614 Sep 14 09:49:54.804628 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3745/7069] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:49:54 2022] GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096 => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:49:55.828639 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-7cce4420-959c-4576-9f3a-129d225432d3 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:49:55.829273 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-7cce4420-959c-4576-9f3a-129d225432d3 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 81aae111-cb97-486f-b843-405808b7b096] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:49:55.836769 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7cce4420-959c-4576-9f3a-129d225432d3 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:49:55.837258 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7cce4420-959c-4576-9f3a-129d225432d3 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:49:55.837701 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7cce4420-959c-4576-9f3a-129d225432d3 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:49:55.838397 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7cce4420-959c-4576-9f3a-129d225432d3 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:49:55.838859 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7cce4420-959c-4576-9f3a-129d225432d3 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:49:55.839321 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7cce4420-959c-4576-9f3a-129d225432d3 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:49:55.971888 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-7cce4420-959c-4576-9f3a-129d225432d3 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:49:55.980101 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-7cce4420-959c-4576-9f3a-129d225432d3 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096" status: 200 len: 1727 microversion: 2.1 time: 0.155400 Sep 14 09:49:55.980686 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3746/7070] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:49:55 2022] GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096 => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:49:57.003341 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-aa9edb48-f0ca-4e36-95d9-4ba3d009f588 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:49:57.004029 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-aa9edb48-f0ca-4e36-95d9-4ba3d009f588 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 81aae111-cb97-486f-b843-405808b7b096] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:49:57.011013 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-aa9edb48-f0ca-4e36-95d9-4ba3d009f588 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:49:57.011500 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-aa9edb48-f0ca-4e36-95d9-4ba3d009f588 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:49:57.011933 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-aa9edb48-f0ca-4e36-95d9-4ba3d009f588 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:49:57.012620 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-aa9edb48-f0ca-4e36-95d9-4ba3d009f588 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:49:57.013074 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-aa9edb48-f0ca-4e36-95d9-4ba3d009f588 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:49:57.013498 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-aa9edb48-f0ca-4e36-95d9-4ba3d009f588 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:49:57.146315 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-aa9edb48-f0ca-4e36-95d9-4ba3d009f588 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:49:57.154596 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-aa9edb48-f0ca-4e36-95d9-4ba3d009f588 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096" status: 200 len: 1727 microversion: 2.1 time: 0.155311 Sep 14 09:49:57.155208 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3747/7071] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:49:56 2022] GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096 => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:49:58.180863 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f2d2e6e7-bc1e-46ea-98c4-7ed85c8b0e6d tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:49:58.181496 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f2d2e6e7-bc1e-46ea-98c4-7ed85c8b0e6d tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 81aae111-cb97-486f-b843-405808b7b096] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:49:58.189177 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f2d2e6e7-bc1e-46ea-98c4-7ed85c8b0e6d tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:49:58.190299 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f2d2e6e7-bc1e-46ea-98c4-7ed85c8b0e6d tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:49:58.191352 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f2d2e6e7-bc1e-46ea-98c4-7ed85c8b0e6d tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:49:58.192310 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f2d2e6e7-bc1e-46ea-98c4-7ed85c8b0e6d tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:49:58.192975 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f2d2e6e7-bc1e-46ea-98c4-7ed85c8b0e6d tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:49:58.193455 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f2d2e6e7-bc1e-46ea-98c4-7ed85c8b0e6d tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:49:58.341594 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f2d2e6e7-bc1e-46ea-98c4-7ed85c8b0e6d tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:49:58.350594 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f2d2e6e7-bc1e-46ea-98c4-7ed85c8b0e6d tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096" status: 200 len: 1727 microversion: 2.1 time: 0.173769 Sep 14 09:49:58.351200 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3748/7072] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:49:58 2022] GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096 => generated 1727 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:49:59.373721 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c11ce20f-5675-4cda-b9e8-365ebc1636c3 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:49:59.374361 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-c11ce20f-5675-4cda-b9e8-365ebc1636c3 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 81aae111-cb97-486f-b843-405808b7b096] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:49:59.381301 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c11ce20f-5675-4cda-b9e8-365ebc1636c3 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:49:59.381787 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c11ce20f-5675-4cda-b9e8-365ebc1636c3 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:49:59.382225 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c11ce20f-5675-4cda-b9e8-365ebc1636c3 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:49:59.382911 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c11ce20f-5675-4cda-b9e8-365ebc1636c3 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:49:59.383496 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c11ce20f-5675-4cda-b9e8-365ebc1636c3 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:49:59.383923 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c11ce20f-5675-4cda-b9e8-365ebc1636c3 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:49:59.513188 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-c11ce20f-5675-4cda-b9e8-365ebc1636c3 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:49:59.521993 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-c11ce20f-5675-4cda-b9e8-365ebc1636c3 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096" status: 200 len: 1727 microversion: 2.1 time: 0.152247 Sep 14 09:49:59.522572 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3749/7073] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:49:59 2022] GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096 => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:50:00.546110 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3964657a-b546-4b26-b3d1-73be89bc2996 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:50:00.546793 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-3964657a-b546-4b26-b3d1-73be89bc2996 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 81aae111-cb97-486f-b843-405808b7b096] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:50:00.554291 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3964657a-b546-4b26-b3d1-73be89bc2996 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:50:00.554782 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3964657a-b546-4b26-b3d1-73be89bc2996 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:50:00.555260 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3964657a-b546-4b26-b3d1-73be89bc2996 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:50:00.556113 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3964657a-b546-4b26-b3d1-73be89bc2996 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:50:00.556576 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3964657a-b546-4b26-b3d1-73be89bc2996 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:50:00.557099 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3964657a-b546-4b26-b3d1-73be89bc2996 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:50:00.562011 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:50:00.688394 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-3964657a-b546-4b26-b3d1-73be89bc2996 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:50:00.697203 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-3964657a-b546-4b26-b3d1-73be89bc2996 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096" status: 200 len: 1727 microversion: 2.1 time: 0.154995 Sep 14 09:50:00.697789 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3750/7074] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:50:00 2022] GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:50:01.721152 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-be0da8f1-bcd9-49a4-ad6a-907ae88cff5d tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:50:01.721799 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-be0da8f1-bcd9-49a4-ad6a-907ae88cff5d tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 81aae111-cb97-486f-b843-405808b7b096] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:50:01.729167 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-be0da8f1-bcd9-49a4-ad6a-907ae88cff5d tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:50:01.729651 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-be0da8f1-bcd9-49a4-ad6a-907ae88cff5d tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:50:01.730090 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-be0da8f1-bcd9-49a4-ad6a-907ae88cff5d tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:50:01.730778 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-be0da8f1-bcd9-49a4-ad6a-907ae88cff5d tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:50:01.731262 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-be0da8f1-bcd9-49a4-ad6a-907ae88cff5d tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:50:01.731688 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-be0da8f1-bcd9-49a4-ad6a-907ae88cff5d tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:50:01.862898 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-be0da8f1-bcd9-49a4-ad6a-907ae88cff5d tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:50:01.871535 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-be0da8f1-bcd9-49a4-ad6a-907ae88cff5d tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096" status: 200 len: 1727 microversion: 2.1 time: 0.154605 Sep 14 09:50:01.872121 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3751/7075] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:50:01 2022] GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:50:02.894820 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-dd570765-3fc2-4a16-86c8-6b2d04312119 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:50:02.895566 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-dd570765-3fc2-4a16-86c8-6b2d04312119 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 81aae111-cb97-486f-b843-405808b7b096] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:50:02.902595 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dd570765-3fc2-4a16-86c8-6b2d04312119 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:50:02.903056 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dd570765-3fc2-4a16-86c8-6b2d04312119 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:50:02.903522 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dd570765-3fc2-4a16-86c8-6b2d04312119 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:50:02.904220 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dd570765-3fc2-4a16-86c8-6b2d04312119 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:50:02.904675 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dd570765-3fc2-4a16-86c8-6b2d04312119 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:50:02.905098 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dd570765-3fc2-4a16-86c8-6b2d04312119 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:50:03.037987 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-dd570765-3fc2-4a16-86c8-6b2d04312119 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:50:03.046297 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-dd570765-3fc2-4a16-86c8-6b2d04312119 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096" status: 200 len: 1727 microversion: 2.1 time: 0.155649 Sep 14 09:50:03.046880 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3752/7076] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:50:02 2022] GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096 => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:50:04.069827 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-0461091a-2bc4-43cf-af37-873dddbebb24 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:50:04.070487 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-0461091a-2bc4-43cf-af37-873dddbebb24 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 81aae111-cb97-486f-b843-405808b7b096] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:50:04.077294 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0461091a-2bc4-43cf-af37-873dddbebb24 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:50:04.077780 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0461091a-2bc4-43cf-af37-873dddbebb24 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:50:04.078223 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0461091a-2bc4-43cf-af37-873dddbebb24 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:50:04.078912 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0461091a-2bc4-43cf-af37-873dddbebb24 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:50:04.079394 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0461091a-2bc4-43cf-af37-873dddbebb24 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:50:04.079823 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0461091a-2bc4-43cf-af37-873dddbebb24 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:50:04.216303 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-0461091a-2bc4-43cf-af37-873dddbebb24 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:50:04.224988 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-0461091a-2bc4-43cf-af37-873dddbebb24 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096" status: 200 len: 1727 microversion: 2.1 time: 0.159231 Sep 14 09:50:04.225576 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3753/7077] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:50:04 2022] GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096 => generated 1727 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:50:05.249186 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-5b3e1c63-deca-4181-9dda-42909fd9e0ef tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:50:05.249841 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-5b3e1c63-deca-4181-9dda-42909fd9e0ef tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 81aae111-cb97-486f-b843-405808b7b096] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:50:05.256828 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5b3e1c63-deca-4181-9dda-42909fd9e0ef tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:50:05.257322 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5b3e1c63-deca-4181-9dda-42909fd9e0ef tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:50:05.257769 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5b3e1c63-deca-4181-9dda-42909fd9e0ef tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:50:05.258466 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5b3e1c63-deca-4181-9dda-42909fd9e0ef tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:50:05.258953 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5b3e1c63-deca-4181-9dda-42909fd9e0ef tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:50:05.259397 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5b3e1c63-deca-4181-9dda-42909fd9e0ef tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:50:05.390658 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-5b3e1c63-deca-4181-9dda-42909fd9e0ef tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:50:05.399678 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-5b3e1c63-deca-4181-9dda-42909fd9e0ef tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096" status: 200 len: 1726 microversion: 2.1 time: 0.154419 Sep 14 09:50:05.400264 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3754/7078] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:50:05 2022] GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096 => generated 1726 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:50:05.523629 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-786b3712-342f-4890-bf3f-4db462dd5663 req-3afc775a-f402-4be5-99f0-a5f5dc063906 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81aae111-cb97-486f-b843-405808b7b096", "name": "network-vif-unplugged", "status": "completed", "tag": "5936b844-2b77-4ad5-934a-163f3310dce3"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:50:05.533215 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-786b3712-342f-4890-bf3f-4db462dd5663 req-3afc775a-f402-4be5-99f0-a5f5dc063906 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:50:05.533702 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-786b3712-342f-4890-bf3f-4db462dd5663 req-3afc775a-f402-4be5-99f0-a5f5dc063906 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:50:05.534147 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-786b3712-342f-4890-bf3f-4db462dd5663 req-3afc775a-f402-4be5-99f0-a5f5dc063906 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:50:05.546716 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-786b3712-342f-4890-bf3f-4db462dd5663 req-3afc775a-f402-4be5-99f0-a5f5dc063906 service nova] Creating event network-vif-unplugged:5936b844-2b77-4ad5-934a-163f3310dce3 for instance 81aae111-cb97-486f-b843-405808b7b096 on n-h1-836830-18 Sep 14 09:50:05.552060 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [req-786b3712-342f-4890-bf3f-4db462dd5663 req-3afc775a-f402-4be5-99f0-a5f5dc063906 service nova] Instance 81aae111-cb97-486f-b843-405808b7b096 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-836830-18', 'n-h2-836830-18'} {{(pid=128759) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 14 09:50:05.565544 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-786b3712-342f-4890-bf3f-4db462dd5663 req-3afc775a-f402-4be5-99f0-a5f5dc063906 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046410 Sep 14 09:50:05.566356 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3755/7079] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:50:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:50:06.425893 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-7e13e061-e376-4da3-9265-4fc13bd1c422 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:50:06.426700 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-7e13e061-e376-4da3-9265-4fc13bd1c422 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 81aae111-cb97-486f-b843-405808b7b096] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:50:06.432954 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7e13e061-e376-4da3-9265-4fc13bd1c422 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:50:06.433491 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7e13e061-e376-4da3-9265-4fc13bd1c422 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:50:06.433941 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7e13e061-e376-4da3-9265-4fc13bd1c422 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:50:06.434649 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7e13e061-e376-4da3-9265-4fc13bd1c422 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:50:06.435145 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7e13e061-e376-4da3-9265-4fc13bd1c422 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:50:06.435582 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7e13e061-e376-4da3-9265-4fc13bd1c422 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:50:06.574050 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-7e13e061-e376-4da3-9265-4fc13bd1c422 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:50:06.582675 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-7e13e061-e376-4da3-9265-4fc13bd1c422 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096" status: 200 len: 1726 microversion: 2.1 time: 0.162380 Sep 14 09:50:06.583330 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3756/7080] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:50:06 2022] GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096 => generated 1726 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:50:07.582523 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-1170ea38-04c5-411b-95ae-b02b54a5f626 req-235898c5-1a01-46cb-938e-fb50b65fbaef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81aae111-cb97-486f-b843-405808b7b096", "tag": "5936b844-2b77-4ad5-934a-163f3310dce3"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:50:07.593070 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-1170ea38-04c5-411b-95ae-b02b54a5f626 req-235898c5-1a01-46cb-938e-fb50b65fbaef service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:50:07.593554 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-1170ea38-04c5-411b-95ae-b02b54a5f626 req-235898c5-1a01-46cb-938e-fb50b65fbaef service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:50:07.593990 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-1170ea38-04c5-411b-95ae-b02b54a5f626 req-235898c5-1a01-46cb-938e-fb50b65fbaef service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:50:07.606095 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-1170ea38-04c5-411b-95ae-b02b54a5f626 req-235898c5-1a01-46cb-938e-fb50b65fbaef service nova] Creating event network-changed:5936b844-2b77-4ad5-934a-163f3310dce3 for instance 81aae111-cb97-486f-b843-405808b7b096 on n-h1-836830-18 Sep 14 09:50:07.611546 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [req-1170ea38-04c5-411b-95ae-b02b54a5f626 req-235898c5-1a01-46cb-938e-fb50b65fbaef service nova] Instance 81aae111-cb97-486f-b843-405808b7b096 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-836830-18', 'n-h2-836830-18'} {{(pid=128759) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 14 09:50:07.622596 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-1170ea38-04c5-411b-95ae-b02b54a5f626 req-235898c5-1a01-46cb-938e-fb50b65fbaef service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044352 Sep 14 09:50:07.623415 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3757/7081] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:50:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:50:07.629026 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f3891522-e5ac-47d0-88e5-66d2c8353f4d tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:50:07.629719 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f3891522-e5ac-47d0-88e5-66d2c8353f4d tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 81aae111-cb97-486f-b843-405808b7b096] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:50:07.641790 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f3891522-e5ac-47d0-88e5-66d2c8353f4d tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:50:07.642457 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f3891522-e5ac-47d0-88e5-66d2c8353f4d tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:50:07.642927 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f3891522-e5ac-47d0-88e5-66d2c8353f4d tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:50:07.643739 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f3891522-e5ac-47d0-88e5-66d2c8353f4d tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:50:07.644208 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f3891522-e5ac-47d0-88e5-66d2c8353f4d tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:50:07.644644 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f3891522-e5ac-47d0-88e5-66d2c8353f4d tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:50:07.792348 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f3891522-e5ac-47d0-88e5-66d2c8353f4d tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:50:07.802240 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f3891522-e5ac-47d0-88e5-66d2c8353f4d tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096" status: 200 len: 1724 microversion: 2.1 time: 0.177757 Sep 14 09:50:07.802830 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3758/7082] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:50:07 2022] GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096 => generated 1724 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:50:08.826305 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-484de032-e3db-4b5f-8567-714cff354d7c tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:50:08.827045 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-484de032-e3db-4b5f-8567-714cff354d7c tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 81aae111-cb97-486f-b843-405808b7b096] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:50:08.834153 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-484de032-e3db-4b5f-8567-714cff354d7c tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:50:08.834648 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-484de032-e3db-4b5f-8567-714cff354d7c tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:50:08.835130 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-484de032-e3db-4b5f-8567-714cff354d7c tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:50:08.835844 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-484de032-e3db-4b5f-8567-714cff354d7c tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:50:08.836308 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-484de032-e3db-4b5f-8567-714cff354d7c tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:50:08.836742 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-484de032-e3db-4b5f-8567-714cff354d7c tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:50:08.979326 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-484de032-e3db-4b5f-8567-714cff354d7c tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:50:08.988301 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-484de032-e3db-4b5f-8567-714cff354d7c tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096" status: 200 len: 1724 microversion: 2.1 time: 0.165498 Sep 14 09:50:08.988976 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3759/7083] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:50:08 2022] GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:50:10.011918 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c36b8b8a-bab3-41b8-9b5a-95011c23b6e4 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:50:10.012722 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-c36b8b8a-bab3-41b8-9b5a-95011c23b6e4 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 81aae111-cb97-486f-b843-405808b7b096] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:50:10.019987 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c36b8b8a-bab3-41b8-9b5a-95011c23b6e4 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:50:10.020462 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c36b8b8a-bab3-41b8-9b5a-95011c23b6e4 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:50:10.020899 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c36b8b8a-bab3-41b8-9b5a-95011c23b6e4 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:50:10.021903 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c36b8b8a-bab3-41b8-9b5a-95011c23b6e4 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:50:10.022417 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c36b8b8a-bab3-41b8-9b5a-95011c23b6e4 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:50:10.022846 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c36b8b8a-bab3-41b8-9b5a-95011c23b6e4 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:50:10.160711 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-c36b8b8a-bab3-41b8-9b5a-95011c23b6e4 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:50:10.169228 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-c36b8b8a-bab3-41b8-9b5a-95011c23b6e4 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096" status: 200 len: 1724 microversion: 2.1 time: 0.161516 Sep 14 09:50:10.169815 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3760/7084] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:50:10 2022] GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:50:11.200230 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-40cdb1a6-64fe-4b2a-a650-3122cb545b70 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:50:11.201011 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-40cdb1a6-64fe-4b2a-a650-3122cb545b70 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 81aae111-cb97-486f-b843-405808b7b096] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:50:11.209153 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-40cdb1a6-64fe-4b2a-a650-3122cb545b70 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:50:11.209834 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-40cdb1a6-64fe-4b2a-a650-3122cb545b70 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:50:11.210354 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-40cdb1a6-64fe-4b2a-a650-3122cb545b70 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:50:11.211096 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-40cdb1a6-64fe-4b2a-a650-3122cb545b70 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:50:11.211569 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-40cdb1a6-64fe-4b2a-a650-3122cb545b70 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:50:11.212009 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-40cdb1a6-64fe-4b2a-a650-3122cb545b70 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:50:11.349358 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-40cdb1a6-64fe-4b2a-a650-3122cb545b70 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:50:11.357571 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-40cdb1a6-64fe-4b2a-a650-3122cb545b70 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096" status: 200 len: 1724 microversion: 2.1 time: 0.161369 Sep 14 09:50:11.358136 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3761/7085] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:50:11 2022] GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:50:12.381743 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-56e2b344-62f5-40f5-9954-b2b0787de1f0 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:50:12.382375 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-56e2b344-62f5-40f5-9954-b2b0787de1f0 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 81aae111-cb97-486f-b843-405808b7b096] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:50:12.389325 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-56e2b344-62f5-40f5-9954-b2b0787de1f0 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:50:12.389818 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-56e2b344-62f5-40f5-9954-b2b0787de1f0 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:50:12.390264 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-56e2b344-62f5-40f5-9954-b2b0787de1f0 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:50:12.390986 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-56e2b344-62f5-40f5-9954-b2b0787de1f0 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:50:12.391450 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-56e2b344-62f5-40f5-9954-b2b0787de1f0 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:50:12.391880 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-56e2b344-62f5-40f5-9954-b2b0787de1f0 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:50:12.524336 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-56e2b344-62f5-40f5-9954-b2b0787de1f0 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:50:12.532636 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-56e2b344-62f5-40f5-9954-b2b0787de1f0 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096" status: 200 len: 1724 microversion: 2.1 time: 0.155475 Sep 14 09:50:12.533213 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3762/7086] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:50:12 2022] GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:50:13.557218 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-66addc82-a6ed-4e77-be6d-f1650a63bd50 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:50:13.557886 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-66addc82-a6ed-4e77-be6d-f1650a63bd50 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 81aae111-cb97-486f-b843-405808b7b096] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:50:13.564710 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-66addc82-a6ed-4e77-be6d-f1650a63bd50 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:50:13.565193 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-66addc82-a6ed-4e77-be6d-f1650a63bd50 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:50:13.565648 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-66addc82-a6ed-4e77-be6d-f1650a63bd50 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:50:13.566368 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-66addc82-a6ed-4e77-be6d-f1650a63bd50 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:50:13.566817 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-66addc82-a6ed-4e77-be6d-f1650a63bd50 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:50:13.567279 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-66addc82-a6ed-4e77-be6d-f1650a63bd50 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:50:13.696975 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-66addc82-a6ed-4e77-be6d-f1650a63bd50 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:50:13.705210 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-66addc82-a6ed-4e77-be6d-f1650a63bd50 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096" status: 200 len: 1724 microversion: 2.1 time: 0.152256 Sep 14 09:50:13.705787 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3763/7087] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:50:13 2022] GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:50:14.730545 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b12e8342-795d-4b33-8018-c412740885f1 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:50:14.731204 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b12e8342-795d-4b33-8018-c412740885f1 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 81aae111-cb97-486f-b843-405808b7b096] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:50:14.734058 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=63 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:50:14.740389 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b12e8342-795d-4b33-8018-c412740885f1 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:50:14.740873 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b12e8342-795d-4b33-8018-c412740885f1 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:50:14.741308 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b12e8342-795d-4b33-8018-c412740885f1 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:50:14.741997 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b12e8342-795d-4b33-8018-c412740885f1 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:50:14.742447 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b12e8342-795d-4b33-8018-c412740885f1 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:50:14.742871 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b12e8342-795d-4b33-8018-c412740885f1 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:50:14.871257 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b12e8342-795d-4b33-8018-c412740885f1 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:50:14.879654 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b12e8342-795d-4b33-8018-c412740885f1 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096" status: 200 len: 1724 microversion: 2.1 time: 0.153212 Sep 14 09:50:14.880235 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3764/7088] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:50:14 2022] GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:50:15.903038 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-1b097003-7a43-4618-a36d-aa51d00968b1 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:50:15.903694 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-1b097003-7a43-4618-a36d-aa51d00968b1 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 81aae111-cb97-486f-b843-405808b7b096] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:50:15.910625 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1b097003-7a43-4618-a36d-aa51d00968b1 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:50:15.911151 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1b097003-7a43-4618-a36d-aa51d00968b1 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:50:15.911601 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1b097003-7a43-4618-a36d-aa51d00968b1 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:50:15.912301 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1b097003-7a43-4618-a36d-aa51d00968b1 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:50:15.912762 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1b097003-7a43-4618-a36d-aa51d00968b1 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:50:15.913201 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1b097003-7a43-4618-a36d-aa51d00968b1 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:50:16.042836 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-1b097003-7a43-4618-a36d-aa51d00968b1 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:50:16.051742 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-1b097003-7a43-4618-a36d-aa51d00968b1 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096" status: 200 len: 1724 microversion: 2.1 time: 0.152724 Sep 14 09:50:16.052328 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3765/7089] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:50:15 2022] GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:50:17.075502 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-7f095556-c4f6-4429-962d-67514d5e28a4 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:50:17.076144 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-7f095556-c4f6-4429-962d-67514d5e28a4 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 81aae111-cb97-486f-b843-405808b7b096] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:50:17.083056 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7f095556-c4f6-4429-962d-67514d5e28a4 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:50:17.083553 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7f095556-c4f6-4429-962d-67514d5e28a4 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:50:17.084000 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7f095556-c4f6-4429-962d-67514d5e28a4 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:50:17.084694 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7f095556-c4f6-4429-962d-67514d5e28a4 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:50:17.085157 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7f095556-c4f6-4429-962d-67514d5e28a4 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:50:17.085598 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7f095556-c4f6-4429-962d-67514d5e28a4 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:50:17.216155 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-7f095556-c4f6-4429-962d-67514d5e28a4 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:50:17.228527 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-7f095556-c4f6-4429-962d-67514d5e28a4 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096" status: 200 len: 1724 microversion: 2.1 time: 0.156611 Sep 14 09:50:17.229627 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3766/7090] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:50:17 2022] GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:50:18.257634 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-32da7699-233e-4e08-a464-fe2b02b7b3ef tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:50:18.258315 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-32da7699-233e-4e08-a464-fe2b02b7b3ef tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 81aae111-cb97-486f-b843-405808b7b096] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:50:18.265001 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-32da7699-233e-4e08-a464-fe2b02b7b3ef tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:50:18.265482 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-32da7699-233e-4e08-a464-fe2b02b7b3ef tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:50:18.265914 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-32da7699-233e-4e08-a464-fe2b02b7b3ef tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:50:18.266594 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-32da7699-233e-4e08-a464-fe2b02b7b3ef tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:50:18.267077 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-32da7699-233e-4e08-a464-fe2b02b7b3ef tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:50:18.267506 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-32da7699-233e-4e08-a464-fe2b02b7b3ef tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:50:18.286359 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=100 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:50:18.411695 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-32da7699-233e-4e08-a464-fe2b02b7b3ef tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:50:18.419904 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-32da7699-233e-4e08-a464-fe2b02b7b3ef tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096" status: 200 len: 1724 microversion: 2.1 time: 0.166207 Sep 14 09:50:18.420471 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3767/7091] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:50:18 2022] GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:50:19.442735 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-22aebb50-83a4-40c9-921d-e198bcf4c716 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:50:19.443373 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-22aebb50-83a4-40c9-921d-e198bcf4c716 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 81aae111-cb97-486f-b843-405808b7b096] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:50:19.450205 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-22aebb50-83a4-40c9-921d-e198bcf4c716 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:50:19.450696 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-22aebb50-83a4-40c9-921d-e198bcf4c716 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:50:19.451173 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-22aebb50-83a4-40c9-921d-e198bcf4c716 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:50:19.451900 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-22aebb50-83a4-40c9-921d-e198bcf4c716 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:50:19.452368 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-22aebb50-83a4-40c9-921d-e198bcf4c716 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:50:19.452799 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-22aebb50-83a4-40c9-921d-e198bcf4c716 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:50:19.579746 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-22aebb50-83a4-40c9-921d-e198bcf4c716 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:50:19.588824 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-22aebb50-83a4-40c9-921d-e198bcf4c716 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096" status: 200 len: 1724 microversion: 2.1 time: 0.150133 Sep 14 09:50:19.589405 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3768/7092] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:50:19 2022] GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:50:20.613221 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f06c6a91-b5cd-4567-9917-8d16c2c6f69b tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:50:20.613962 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f06c6a91-b5cd-4567-9917-8d16c2c6f69b tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 81aae111-cb97-486f-b843-405808b7b096] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:50:20.620670 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f06c6a91-b5cd-4567-9917-8d16c2c6f69b tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:50:20.621154 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f06c6a91-b5cd-4567-9917-8d16c2c6f69b tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:50:20.621593 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f06c6a91-b5cd-4567-9917-8d16c2c6f69b tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:50:20.622276 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f06c6a91-b5cd-4567-9917-8d16c2c6f69b tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:50:20.622729 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f06c6a91-b5cd-4567-9917-8d16c2c6f69b tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:50:20.623183 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f06c6a91-b5cd-4567-9917-8d16c2c6f69b tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:50:20.751431 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f06c6a91-b5cd-4567-9917-8d16c2c6f69b tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:50:20.762831 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f06c6a91-b5cd-4567-9917-8d16c2c6f69b tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096" status: 200 len: 1721 microversion: 2.1 time: 0.153460 Sep 14 09:50:20.763445 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3769/7093] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:50:20 2022] GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096 => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:50:20.785709 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-82298254-b79b-4ad8-9891-60f549ed087a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:50:20.786253 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-82298254-b79b-4ad8-9891-60f549ed087a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 81aae111-cb97-486f-b843-405808b7b096] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:50:20.792158 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-82298254-b79b-4ad8-9891-60f549ed087a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:50:20.792645 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-82298254-b79b-4ad8-9891-60f549ed087a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:50:20.793091 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-82298254-b79b-4ad8-9891-60f549ed087a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:50:20.793785 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-82298254-b79b-4ad8-9891-60f549ed087a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:50:20.794254 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-82298254-b79b-4ad8-9891-60f549ed087a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:50:20.794683 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-82298254-b79b-4ad8-9891-60f549ed087a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:50:20.831202 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-82298254-b79b-4ad8-9891-60f549ed087a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:50:20.831583 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-82298254-b79b-4ad8-9891-60f549ed087a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:50:20.832035 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-82298254-b79b-4ad8-9891-60f549ed087a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:50:20.833319 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-82298254-b79b-4ad8-9891-60f549ed087a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:50:20.833781 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-82298254-b79b-4ad8-9891-60f549ed087a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:50:20.834211 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-82298254-b79b-4ad8-9891-60f549ed087a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:50:20.854605 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-82298254-b79b-4ad8-9891-60f549ed087a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Getting quotas for project 270f637ba197498bb4f7fa1ba14a62ad. Resources: {'cores', 'ram'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:50:20.859745 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-82298254-b79b-4ad8-9891-60f549ed087a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Getting quotas for user 5de83b9937f145dbbe1091039327e71a and project 270f637ba197498bb4f7fa1ba14a62ad. Resources: {'cores', 'ram'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:50:20.959431 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-82298254-b79b-4ad8-9891-60f549ed087a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "POST /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096/action" status: 202 len: 0 microversion: 2.1 time: 0.177161 Sep 14 09:50:20.960044 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3770/7094] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:50:20 2022] POST /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096/action => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 14 09:50:20.968466 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-5a1f1aa5-7f9a-4200-b10c-4d88012bfd1d tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:50:20.969179 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-5a1f1aa5-7f9a-4200-b10c-4d88012bfd1d tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 81aae111-cb97-486f-b843-405808b7b096] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:50:20.975335 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5a1f1aa5-7f9a-4200-b10c-4d88012bfd1d tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:50:20.976109 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5a1f1aa5-7f9a-4200-b10c-4d88012bfd1d tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:50:20.976252 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5a1f1aa5-7f9a-4200-b10c-4d88012bfd1d tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:50:20.977119 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5a1f1aa5-7f9a-4200-b10c-4d88012bfd1d tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:50:20.977406 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5a1f1aa5-7f9a-4200-b10c-4d88012bfd1d tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:50:20.977838 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5a1f1aa5-7f9a-4200-b10c-4d88012bfd1d tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:50:21.120043 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-5a1f1aa5-7f9a-4200-b10c-4d88012bfd1d tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:50:21.128516 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-5a1f1aa5-7f9a-4200-b10c-4d88012bfd1d tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096" status: 200 len: 1720 microversion: 2.1 time: 0.164174 Sep 14 09:50:21.129146 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3771/7095] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:50:20 2022] GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096 => generated 1720 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:50:22.153073 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8b438172-b0b4-4d45-8bb0-a41ae48a04eb tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:50:22.153708 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-8b438172-b0b4-4d45-8bb0-a41ae48a04eb tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 81aae111-cb97-486f-b843-405808b7b096] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:50:22.161147 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8b438172-b0b4-4d45-8bb0-a41ae48a04eb tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:50:22.161664 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8b438172-b0b4-4d45-8bb0-a41ae48a04eb tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:50:22.162105 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8b438172-b0b4-4d45-8bb0-a41ae48a04eb tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:50:22.162796 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8b438172-b0b4-4d45-8bb0-a41ae48a04eb tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:50:22.163286 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8b438172-b0b4-4d45-8bb0-a41ae48a04eb tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:50:22.163715 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8b438172-b0b4-4d45-8bb0-a41ae48a04eb tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:50:22.293371 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-8b438172-b0b4-4d45-8bb0-a41ae48a04eb tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:50:22.302552 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-8b438172-b0b4-4d45-8bb0-a41ae48a04eb tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096" status: 200 len: 1720 microversion: 2.1 time: 0.153378 Sep 14 09:50:22.303154 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3772/7096] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:50:22 2022] GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096 => generated 1720 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:50:23.228020 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-5a232c3c-010f-45df-84e2-b8767a074c4b req-1edbb7b5-a639-4169-92f4-611c841403c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81aae111-cb97-486f-b843-405808b7b096", "name": "network-vif-plugged", "status": "completed", "tag": "5936b844-2b77-4ad5-934a-163f3310dce3"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:50:23.239632 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-5a232c3c-010f-45df-84e2-b8767a074c4b req-1edbb7b5-a639-4169-92f4-611c841403c8 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:50:23.240127 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-5a232c3c-010f-45df-84e2-b8767a074c4b req-1edbb7b5-a639-4169-92f4-611c841403c8 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:50:23.240652 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-5a232c3c-010f-45df-84e2-b8767a074c4b req-1edbb7b5-a639-4169-92f4-611c841403c8 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:50:23.252852 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-5a232c3c-010f-45df-84e2-b8767a074c4b req-1edbb7b5-a639-4169-92f4-611c841403c8 service nova] Creating event network-vif-plugged:5936b844-2b77-4ad5-934a-163f3310dce3 for instance 81aae111-cb97-486f-b843-405808b7b096 on n-h1-836830-18 Sep 14 09:50:23.258781 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [req-5a232c3c-010f-45df-84e2-b8767a074c4b req-1edbb7b5-a639-4169-92f4-611c841403c8 service nova] Instance 81aae111-cb97-486f-b843-405808b7b096 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-836830-18', 'n-h2-836830-18'} {{(pid=128759) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 14 09:50:23.269670 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-5a232c3c-010f-45df-84e2-b8767a074c4b req-1edbb7b5-a639-4169-92f4-611c841403c8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045356 Sep 14 09:50:23.271055 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3773/7097] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:50:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:50:23.326325 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-6330df8c-3598-4b7e-8556-6178e2118a96 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:50:23.326989 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-6330df8c-3598-4b7e-8556-6178e2118a96 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 81aae111-cb97-486f-b843-405808b7b096] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:50:23.333180 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6330df8c-3598-4b7e-8556-6178e2118a96 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:50:23.333662 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6330df8c-3598-4b7e-8556-6178e2118a96 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:50:23.334093 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6330df8c-3598-4b7e-8556-6178e2118a96 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:50:23.334774 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6330df8c-3598-4b7e-8556-6178e2118a96 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:50:23.335258 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6330df8c-3598-4b7e-8556-6178e2118a96 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:50:23.335681 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6330df8c-3598-4b7e-8556-6178e2118a96 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:50:23.471708 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-6330df8c-3598-4b7e-8556-6178e2118a96 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:50:23.479976 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-6330df8c-3598-4b7e-8556-6178e2118a96 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096" status: 200 len: 1720 microversion: 2.1 time: 0.157924 Sep 14 09:50:23.480565 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3774/7098] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:50:23 2022] GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096 => generated 1720 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:50:24.503294 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-7ddfedd3-3677-4906-9c44-a091a31abe38 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:50:24.503987 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-7ddfedd3-3677-4906-9c44-a091a31abe38 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 81aae111-cb97-486f-b843-405808b7b096] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:50:24.510571 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7ddfedd3-3677-4906-9c44-a091a31abe38 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:50:24.511103 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7ddfedd3-3677-4906-9c44-a091a31abe38 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:50:24.511585 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7ddfedd3-3677-4906-9c44-a091a31abe38 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:50:24.512307 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7ddfedd3-3677-4906-9c44-a091a31abe38 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:50:24.512748 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7ddfedd3-3677-4906-9c44-a091a31abe38 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:50:24.513178 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7ddfedd3-3677-4906-9c44-a091a31abe38 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:50:24.647286 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-7ddfedd3-3677-4906-9c44-a091a31abe38 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:50:24.655674 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-7ddfedd3-3677-4906-9c44-a091a31abe38 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096" status: 200 len: 1720 microversion: 2.1 time: 0.156654 Sep 14 09:50:24.656275 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3775/7099] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:50:24 2022] GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096 => generated 1720 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:50:25.680879 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8639d69d-b4a9-4958-900f-e7f3fe224c95 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:50:25.681595 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-8639d69d-b4a9-4958-900f-e7f3fe224c95 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 81aae111-cb97-486f-b843-405808b7b096] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:50:25.688528 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8639d69d-b4a9-4958-900f-e7f3fe224c95 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:50:25.689020 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8639d69d-b4a9-4958-900f-e7f3fe224c95 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:50:25.689466 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8639d69d-b4a9-4958-900f-e7f3fe224c95 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:50:25.690167 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8639d69d-b4a9-4958-900f-e7f3fe224c95 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:50:25.690631 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8639d69d-b4a9-4958-900f-e7f3fe224c95 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:50:25.691091 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8639d69d-b4a9-4958-900f-e7f3fe224c95 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:50:25.834150 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-8639d69d-b4a9-4958-900f-e7f3fe224c95 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:50:25.843467 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-8639d69d-b4a9-4958-900f-e7f3fe224c95 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096" status: 200 len: 1720 microversion: 2.1 time: 0.167339 Sep 14 09:50:25.844046 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3776/7100] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:50:25 2022] GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096 => generated 1720 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:50:26.386312 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-cf984db1-c530-4f67-a5af-d4b8cae7fd27 req-c4c85019-6d6f-4506-924e-7ed026b4117c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81aae111-cb97-486f-b843-405808b7b096", "name": "network-vif-unplugged", "status": "completed", "tag": "5936b844-2b77-4ad5-934a-163f3310dce3"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:50:26.396618 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-cf984db1-c530-4f67-a5af-d4b8cae7fd27 req-c4c85019-6d6f-4506-924e-7ed026b4117c service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:50:26.397173 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-cf984db1-c530-4f67-a5af-d4b8cae7fd27 req-c4c85019-6d6f-4506-924e-7ed026b4117c service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:50:26.397589 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-cf984db1-c530-4f67-a5af-d4b8cae7fd27 req-c4c85019-6d6f-4506-924e-7ed026b4117c service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:50:26.409654 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-cf984db1-c530-4f67-a5af-d4b8cae7fd27 req-c4c85019-6d6f-4506-924e-7ed026b4117c service nova] Creating event network-vif-unplugged:5936b844-2b77-4ad5-934a-163f3310dce3 for instance 81aae111-cb97-486f-b843-405808b7b096 on n-h2-836830-18 Sep 14 09:50:26.415786 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [req-cf984db1-c530-4f67-a5af-d4b8cae7fd27 req-c4c85019-6d6f-4506-924e-7ed026b4117c service nova] Instance 81aae111-cb97-486f-b843-405808b7b096 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-836830-18', 'n-h2-836830-18'} {{(pid=128759) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 14 09:50:26.427053 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-cf984db1-c530-4f67-a5af-d4b8cae7fd27 req-c4c85019-6d6f-4506-924e-7ed026b4117c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044515 Sep 14 09:50:26.428296 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3777/7101] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:50:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:50:26.868788 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-2772efe7-452a-4585-9d31-256cce762299 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:50:26.869609 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-2772efe7-452a-4585-9d31-256cce762299 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 81aae111-cb97-486f-b843-405808b7b096] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:50:26.875940 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2772efe7-452a-4585-9d31-256cce762299 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:50:26.876434 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2772efe7-452a-4585-9d31-256cce762299 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:50:26.876876 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2772efe7-452a-4585-9d31-256cce762299 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:50:26.877574 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2772efe7-452a-4585-9d31-256cce762299 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:50:26.878033 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2772efe7-452a-4585-9d31-256cce762299 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:50:26.878463 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2772efe7-452a-4585-9d31-256cce762299 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:50:27.013596 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-2772efe7-452a-4585-9d31-256cce762299 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:50:27.023263 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-2772efe7-452a-4585-9d31-256cce762299 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096" status: 200 len: 1720 microversion: 2.1 time: 0.159647 Sep 14 09:50:27.023912 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3778/7102] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:50:26 2022] GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096 => generated 1720 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:50:28.045813 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-afdce520-53f0-4af1-9b3f-933a3f32ee5d tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:50:28.046487 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-afdce520-53f0-4af1-9b3f-933a3f32ee5d tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 81aae111-cb97-486f-b843-405808b7b096] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:50:28.053405 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-afdce520-53f0-4af1-9b3f-933a3f32ee5d tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:50:28.053891 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-afdce520-53f0-4af1-9b3f-933a3f32ee5d tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:50:28.054332 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-afdce520-53f0-4af1-9b3f-933a3f32ee5d tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:50:28.055051 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-afdce520-53f0-4af1-9b3f-933a3f32ee5d tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:50:28.055513 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-afdce520-53f0-4af1-9b3f-933a3f32ee5d tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:50:28.055935 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-afdce520-53f0-4af1-9b3f-933a3f32ee5d tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:50:28.188256 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-afdce520-53f0-4af1-9b3f-933a3f32ee5d tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:50:28.197258 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-afdce520-53f0-4af1-9b3f-933a3f32ee5d tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096" status: 200 len: 1720 microversion: 2.1 time: 0.155374 Sep 14 09:50:28.197840 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3779/7103] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:50:28 2022] GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096 => generated 1720 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:50:28.442000 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-44faa37c-03b7-4c82-9c4b-b2966c7eefda req-d2994050-45a0-4eb8-b2e8-645e5aa45bae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81aae111-cb97-486f-b843-405808b7b096", "tag": "5936b844-2b77-4ad5-934a-163f3310dce3"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:50:28.451336 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-44faa37c-03b7-4c82-9c4b-b2966c7eefda req-d2994050-45a0-4eb8-b2e8-645e5aa45bae service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:50:28.451814 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-44faa37c-03b7-4c82-9c4b-b2966c7eefda req-d2994050-45a0-4eb8-b2e8-645e5aa45bae service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:50:28.452242 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-44faa37c-03b7-4c82-9c4b-b2966c7eefda req-d2994050-45a0-4eb8-b2e8-645e5aa45bae service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:50:28.464647 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-44faa37c-03b7-4c82-9c4b-b2966c7eefda req-d2994050-45a0-4eb8-b2e8-645e5aa45bae service nova] Creating event network-changed:5936b844-2b77-4ad5-934a-163f3310dce3 for instance 81aae111-cb97-486f-b843-405808b7b096 on n-h2-836830-18 Sep 14 09:50:28.470473 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [req-44faa37c-03b7-4c82-9c4b-b2966c7eefda req-d2994050-45a0-4eb8-b2e8-645e5aa45bae service nova] Instance 81aae111-cb97-486f-b843-405808b7b096 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-836830-18', 'n-h2-836830-18'} {{(pid=128759) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 14 09:50:28.480958 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-44faa37c-03b7-4c82-9c4b-b2966c7eefda req-d2994050-45a0-4eb8-b2e8-645e5aa45bae service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043125 Sep 14 09:50:28.481575 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3780/7104] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:50:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:50:29.222200 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f8a19991-4f5b-4f96-9cfc-9c84aef8bb86 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:50:29.224484 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f8a19991-4f5b-4f96-9cfc-9c84aef8bb86 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 81aae111-cb97-486f-b843-405808b7b096] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:50:29.231664 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f8a19991-4f5b-4f96-9cfc-9c84aef8bb86 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:50:29.232158 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f8a19991-4f5b-4f96-9cfc-9c84aef8bb86 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:50:29.232607 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f8a19991-4f5b-4f96-9cfc-9c84aef8bb86 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:50:29.233315 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f8a19991-4f5b-4f96-9cfc-9c84aef8bb86 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:50:29.233774 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f8a19991-4f5b-4f96-9cfc-9c84aef8bb86 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:50:29.234414 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f8a19991-4f5b-4f96-9cfc-9c84aef8bb86 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:50:29.388696 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f8a19991-4f5b-4f96-9cfc-9c84aef8bb86 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:50:29.398521 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f8a19991-4f5b-4f96-9cfc-9c84aef8bb86 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096" status: 200 len: 1720 microversion: 2.1 time: 0.180717 Sep 14 09:50:29.399134 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3781/7105] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:50:29 2022] GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096 => generated 1720 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:50:30.422367 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-7ba9983f-5f56-4f4e-8b63-e0b22b51e5d7 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:50:30.423871 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-7ba9983f-5f56-4f4e-8b63-e0b22b51e5d7 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 81aae111-cb97-486f-b843-405808b7b096] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:50:30.431667 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7ba9983f-5f56-4f4e-8b63-e0b22b51e5d7 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:50:30.432161 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7ba9983f-5f56-4f4e-8b63-e0b22b51e5d7 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:50:30.432617 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7ba9983f-5f56-4f4e-8b63-e0b22b51e5d7 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:50:30.433332 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7ba9983f-5f56-4f4e-8b63-e0b22b51e5d7 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:50:30.433796 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7ba9983f-5f56-4f4e-8b63-e0b22b51e5d7 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:50:30.434224 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7ba9983f-5f56-4f4e-8b63-e0b22b51e5d7 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:50:30.439483 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:50:30.583846 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-7ba9983f-5f56-4f4e-8b63-e0b22b51e5d7 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:50:30.593158 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-7ba9983f-5f56-4f4e-8b63-e0b22b51e5d7 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096" status: 200 len: 1720 microversion: 2.1 time: 0.174512 Sep 14 09:50:30.593750 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3782/7106] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:50:30 2022] GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096 => generated 1720 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:50:31.617276 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9a93ea79-9777-4338-9e91-a41d70113929 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:50:31.617895 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-9a93ea79-9777-4338-9e91-a41d70113929 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 81aae111-cb97-486f-b843-405808b7b096] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:50:31.619742 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=3 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:50:31.625875 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9a93ea79-9777-4338-9e91-a41d70113929 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:50:31.626367 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9a93ea79-9777-4338-9e91-a41d70113929 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:50:31.626808 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9a93ea79-9777-4338-9e91-a41d70113929 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:50:31.627573 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9a93ea79-9777-4338-9e91-a41d70113929 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:50:31.628027 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9a93ea79-9777-4338-9e91-a41d70113929 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:50:31.628456 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9a93ea79-9777-4338-9e91-a41d70113929 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:50:31.762744 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-9a93ea79-9777-4338-9e91-a41d70113929 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:50:31.771357 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-9a93ea79-9777-4338-9e91-a41d70113929 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096" status: 200 len: 1720 microversion: 2.1 time: 0.158497 Sep 14 09:50:31.772032 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3783/7107] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:50:31 2022] GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096 => generated 1720 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:50:32.795392 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-309adea3-202d-42de-b5e7-4bdfa57393c8 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:50:32.796026 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-309adea3-202d-42de-b5e7-4bdfa57393c8 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 81aae111-cb97-486f-b843-405808b7b096] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:50:32.802876 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-309adea3-202d-42de-b5e7-4bdfa57393c8 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:50:32.803395 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-309adea3-202d-42de-b5e7-4bdfa57393c8 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:50:32.803835 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-309adea3-202d-42de-b5e7-4bdfa57393c8 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:50:32.804519 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-309adea3-202d-42de-b5e7-4bdfa57393c8 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:50:32.804972 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-309adea3-202d-42de-b5e7-4bdfa57393c8 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:50:32.805396 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-309adea3-202d-42de-b5e7-4bdfa57393c8 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:50:32.938642 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-309adea3-202d-42de-b5e7-4bdfa57393c8 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:50:32.947586 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-309adea3-202d-42de-b5e7-4bdfa57393c8 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096" status: 200 len: 1720 microversion: 2.1 time: 0.156131 Sep 14 09:50:32.948170 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3784/7108] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:50:32 2022] GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096 => generated 1720 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:50:33.971800 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e6500c9c-dd55-474b-95b2-27a580fad434 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:50:33.972482 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e6500c9c-dd55-474b-95b2-27a580fad434 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 81aae111-cb97-486f-b843-405808b7b096] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:50:33.979249 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e6500c9c-dd55-474b-95b2-27a580fad434 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:50:33.979738 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e6500c9c-dd55-474b-95b2-27a580fad434 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:50:33.980177 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e6500c9c-dd55-474b-95b2-27a580fad434 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:50:33.980871 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e6500c9c-dd55-474b-95b2-27a580fad434 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:50:33.981326 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e6500c9c-dd55-474b-95b2-27a580fad434 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:50:33.981752 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e6500c9c-dd55-474b-95b2-27a580fad434 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:50:34.111905 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-e6500c9c-dd55-474b-95b2-27a580fad434 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:50:34.120716 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e6500c9c-dd55-474b-95b2-27a580fad434 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096" status: 200 len: 1720 microversion: 2.1 time: 0.153204 Sep 14 09:50:34.121309 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3785/7109] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:50:33 2022] GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096 => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:50:35.143846 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-36131550-18c5-4073-8b0e-d32bb13ee7f3 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:50:35.144559 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-36131550-18c5-4073-8b0e-d32bb13ee7f3 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 81aae111-cb97-486f-b843-405808b7b096] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:50:35.151987 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-36131550-18c5-4073-8b0e-d32bb13ee7f3 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:50:35.152479 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-36131550-18c5-4073-8b0e-d32bb13ee7f3 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:50:35.152922 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-36131550-18c5-4073-8b0e-d32bb13ee7f3 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:50:35.153619 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-36131550-18c5-4073-8b0e-d32bb13ee7f3 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:50:35.154081 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-36131550-18c5-4073-8b0e-d32bb13ee7f3 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:50:35.154510 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-36131550-18c5-4073-8b0e-d32bb13ee7f3 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:50:35.286721 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-36131550-18c5-4073-8b0e-d32bb13ee7f3 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:50:35.295083 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-36131550-18c5-4073-8b0e-d32bb13ee7f3 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096" status: 200 len: 1720 microversion: 2.1 time: 0.155221 Sep 14 09:50:35.295661 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3786/7110] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:50:35 2022] GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096 => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:50:36.319115 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a936cd41-0780-4856-ab79-7e6bcbd2ed2a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:50:36.319733 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-a936cd41-0780-4856-ab79-7e6bcbd2ed2a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 81aae111-cb97-486f-b843-405808b7b096] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:50:36.326534 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a936cd41-0780-4856-ab79-7e6bcbd2ed2a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:50:36.327054 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a936cd41-0780-4856-ab79-7e6bcbd2ed2a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:50:36.327500 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a936cd41-0780-4856-ab79-7e6bcbd2ed2a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:50:36.328188 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a936cd41-0780-4856-ab79-7e6bcbd2ed2a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:50:36.328644 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a936cd41-0780-4856-ab79-7e6bcbd2ed2a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:50:36.329069 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a936cd41-0780-4856-ab79-7e6bcbd2ed2a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:50:36.457207 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-a936cd41-0780-4856-ab79-7e6bcbd2ed2a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:50:36.466051 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a936cd41-0780-4856-ab79-7e6bcbd2ed2a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096" status: 200 len: 1720 microversion: 2.1 time: 0.150990 Sep 14 09:50:36.466627 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3787/7111] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:50:36 2022] GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096 => generated 1720 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:50:37.489465 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a58289ff-cf14-4244-a08c-6a32df46dc93 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:50:37.490096 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-a58289ff-cf14-4244-a08c-6a32df46dc93 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 81aae111-cb97-486f-b843-405808b7b096] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:50:37.497469 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a58289ff-cf14-4244-a08c-6a32df46dc93 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:50:37.497956 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a58289ff-cf14-4244-a08c-6a32df46dc93 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:50:37.498397 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a58289ff-cf14-4244-a08c-6a32df46dc93 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:50:37.499121 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a58289ff-cf14-4244-a08c-6a32df46dc93 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:50:37.499582 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a58289ff-cf14-4244-a08c-6a32df46dc93 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:50:37.500008 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a58289ff-cf14-4244-a08c-6a32df46dc93 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:50:37.633245 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-a58289ff-cf14-4244-a08c-6a32df46dc93 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:50:37.643208 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a58289ff-cf14-4244-a08c-6a32df46dc93 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096" status: 200 len: 1720 microversion: 2.1 time: 0.157468 Sep 14 09:50:37.643876 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3788/7112] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:50:37 2022] GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096 => generated 1720 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:50:38.666411 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-6e18e03a-2c8d-4a29-8ca4-260ececa5986 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:50:38.667063 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-6e18e03a-2c8d-4a29-8ca4-260ececa5986 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 81aae111-cb97-486f-b843-405808b7b096] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:50:38.673870 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6e18e03a-2c8d-4a29-8ca4-260ececa5986 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:50:38.674355 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6e18e03a-2c8d-4a29-8ca4-260ececa5986 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:50:38.674795 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6e18e03a-2c8d-4a29-8ca4-260ececa5986 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:50:38.675513 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6e18e03a-2c8d-4a29-8ca4-260ececa5986 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:50:38.675971 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6e18e03a-2c8d-4a29-8ca4-260ececa5986 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:50:38.676397 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6e18e03a-2c8d-4a29-8ca4-260ececa5986 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:50:38.802609 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-6e18e03a-2c8d-4a29-8ca4-260ececa5986 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:50:38.810861 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-6e18e03a-2c8d-4a29-8ca4-260ececa5986 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096" status: 200 len: 1720 microversion: 2.1 time: 0.148344 Sep 14 09:50:38.811464 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3789/7113] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:50:38 2022] GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096 => generated 1720 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:50:39.834783 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-2e6e3240-be98-4c7c-95ff-3daf41fee71b tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:50:39.835451 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-2e6e3240-be98-4c7c-95ff-3daf41fee71b tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 81aae111-cb97-486f-b843-405808b7b096] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:50:39.842331 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2e6e3240-be98-4c7c-95ff-3daf41fee71b tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:50:39.842820 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2e6e3240-be98-4c7c-95ff-3daf41fee71b tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:50:39.843555 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2e6e3240-be98-4c7c-95ff-3daf41fee71b tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:50:39.844252 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2e6e3240-be98-4c7c-95ff-3daf41fee71b tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:50:39.844714 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2e6e3240-be98-4c7c-95ff-3daf41fee71b tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:50:39.845138 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2e6e3240-be98-4c7c-95ff-3daf41fee71b tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:50:39.980208 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-2e6e3240-be98-4c7c-95ff-3daf41fee71b tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:50:39.988637 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-2e6e3240-be98-4c7c-95ff-3daf41fee71b tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096" status: 200 len: 1713 microversion: 2.1 time: 0.157799 Sep 14 09:50:39.989216 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3790/7114] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:50:39 2022] GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096 => generated 1713 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:50:40.011558 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-fbe59a48-ee25-4240-bdde-9adcac5f94cc tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:50:40.012168 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-fbe59a48-ee25-4240-bdde-9adcac5f94cc tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 81aae111-cb97-486f-b843-405808b7b096] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:50:40.017850 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fbe59a48-ee25-4240-bdde-9adcac5f94cc tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:50:40.018335 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fbe59a48-ee25-4240-bdde-9adcac5f94cc tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:50:40.018778 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fbe59a48-ee25-4240-bdde-9adcac5f94cc tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:50:40.019499 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fbe59a48-ee25-4240-bdde-9adcac5f94cc tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:50:40.019987 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fbe59a48-ee25-4240-bdde-9adcac5f94cc tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:50:40.020415 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fbe59a48-ee25-4240-bdde-9adcac5f94cc tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:50:40.149465 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-fbe59a48-ee25-4240-bdde-9adcac5f94cc tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:50:40.157695 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-fbe59a48-ee25-4240-bdde-9adcac5f94cc tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096" status: 200 len: 1713 microversion: 2.1 time: 0.149635 Sep 14 09:50:40.158275 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3791/7115] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:50:40 2022] GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096 => generated 1713 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:50:40.182299 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8270ce8b-79c8-4ec5-bea3-eacd1e1ce345 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:50:40.182923 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-8270ce8b-79c8-4ec5-bea3-eacd1e1ce345 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 81aae111-cb97-486f-b843-405808b7b096] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:50:40.188859 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8270ce8b-79c8-4ec5-bea3-eacd1e1ce345 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:50:40.189352 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8270ce8b-79c8-4ec5-bea3-eacd1e1ce345 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:50:40.189800 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8270ce8b-79c8-4ec5-bea3-eacd1e1ce345 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:50:40.190493 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8270ce8b-79c8-4ec5-bea3-eacd1e1ce345 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:50:40.190969 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8270ce8b-79c8-4ec5-bea3-eacd1e1ce345 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:50:40.191407 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8270ce8b-79c8-4ec5-bea3-eacd1e1ce345 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:50:40.320094 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-8270ce8b-79c8-4ec5-bea3-eacd1e1ce345 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:50:40.328469 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-8270ce8b-79c8-4ec5-bea3-eacd1e1ce345 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096" status: 200 len: 1713 microversion: 2.1 time: 0.150071 Sep 14 09:50:40.329053 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3792/7116] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:50:40 2022] GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096 => generated 1713 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:50:40.351094 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-aa33af4c-e0e2-4e72-bfea-5d2b3b41105a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:50:40.351537 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-aa33af4c-e0e2-4e72-bfea-5d2b3b41105a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 81aae111-cb97-486f-b843-405808b7b096] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:50:40.357204 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-aa33af4c-e0e2-4e72-bfea-5d2b3b41105a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:50:40.357694 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-aa33af4c-e0e2-4e72-bfea-5d2b3b41105a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:50:40.358144 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-aa33af4c-e0e2-4e72-bfea-5d2b3b41105a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:50:40.358869 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-aa33af4c-e0e2-4e72-bfea-5d2b3b41105a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:50:40.359353 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-aa33af4c-e0e2-4e72-bfea-5d2b3b41105a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:50:40.359783 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-aa33af4c-e0e2-4e72-bfea-5d2b3b41105a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:50:40.384777 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-aa33af4c-e0e2-4e72-bfea-5d2b3b41105a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 81aae111-cb97-486f-b843-405808b7b096] Going to try to terminate instance {{(pid=128759) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:50:40.460047 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-aa33af4c-e0e2-4e72-bfea-5d2b3b41105a tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "DELETE /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096" status: 204 len: 0 microversion: 2.1 time: 0.112890 Sep 14 09:50:40.460847 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3793/7117] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:50:40 2022] DELETE /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 14 09:50:40.470372 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-494d6672-50db-45ea-831a-f6d96f064503 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:50:40.471110 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-494d6672-50db-45ea-831a-f6d96f064503 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 81aae111-cb97-486f-b843-405808b7b096] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:50:40.477472 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-494d6672-50db-45ea-831a-f6d96f064503 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:50:40.477961 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-494d6672-50db-45ea-831a-f6d96f064503 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:50:40.478399 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-494d6672-50db-45ea-831a-f6d96f064503 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:50:40.479125 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-494d6672-50db-45ea-831a-f6d96f064503 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:50:40.479580 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-494d6672-50db-45ea-831a-f6d96f064503 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:50:40.480005 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-494d6672-50db-45ea-831a-f6d96f064503 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:50:40.612690 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-494d6672-50db-45ea-831a-f6d96f064503 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:50:40.621347 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-494d6672-50db-45ea-831a-f6d96f064503 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096" status: 200 len: 1719 microversion: 2.1 time: 0.155652 Sep 14 09:50:40.621921 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3794/7118] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:50:40 2022] GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096 => generated 1719 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:50:41.644467 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-933f63c5-2c1a-490c-92ab-f3126989b7af tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:50:41.645098 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-933f63c5-2c1a-490c-92ab-f3126989b7af tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 81aae111-cb97-486f-b843-405808b7b096] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:50:41.652223 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-933f63c5-2c1a-490c-92ab-f3126989b7af tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:50:41.652723 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-933f63c5-2c1a-490c-92ab-f3126989b7af tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:50:41.653174 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-933f63c5-2c1a-490c-92ab-f3126989b7af tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:50:41.653913 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-933f63c5-2c1a-490c-92ab-f3126989b7af tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:50:41.654390 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-933f63c5-2c1a-490c-92ab-f3126989b7af tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:50:41.654815 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-933f63c5-2c1a-490c-92ab-f3126989b7af tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:50:41.793577 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-933f63c5-2c1a-490c-92ab-f3126989b7af tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:50:41.802380 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-933f63c5-2c1a-490c-92ab-f3126989b7af tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096" status: 200 len: 1719 microversion: 2.1 time: 0.161899 Sep 14 09:50:41.803395 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3795/7119] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:50:41 2022] GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096 => generated 1719 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:50:41.808566 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-dac61bbe-8e03-4d85-8f61-f57883ecb06c req-710c65a4-20b6-430d-90ea-f1c669494281 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81aae111-cb97-486f-b843-405808b7b096", "name": "network-vif-plugged", "status": "completed", "tag": "5936b844-2b77-4ad5-934a-163f3310dce3"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:50:41.819850 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-dac61bbe-8e03-4d85-8f61-f57883ecb06c req-710c65a4-20b6-430d-90ea-f1c669494281 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:50:41.820413 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-dac61bbe-8e03-4d85-8f61-f57883ecb06c req-710c65a4-20b6-430d-90ea-f1c669494281 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:50:41.820982 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-dac61bbe-8e03-4d85-8f61-f57883ecb06c req-710c65a4-20b6-430d-90ea-f1c669494281 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:50:41.832130 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-dac61bbe-8e03-4d85-8f61-f57883ecb06c req-710c65a4-20b6-430d-90ea-f1c669494281 service nova] Creating event network-vif-plugged:5936b844-2b77-4ad5-934a-163f3310dce3 for instance 81aae111-cb97-486f-b843-405808b7b096 on n-h2-836830-18 Sep 14 09:50:41.837642 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-dac61bbe-8e03-4d85-8f61-f57883ecb06c req-710c65a4-20b6-430d-90ea-f1c669494281 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032568 Sep 14 09:50:41.838225 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3796/7120] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:50:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:50:42.826252 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c8508303-3977-4585-871c-2e48efed6291 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:50:42.827125 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-c8508303-3977-4585-871c-2e48efed6291 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 81aae111-cb97-486f-b843-405808b7b096] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:50:42.834369 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c8508303-3977-4585-871c-2e48efed6291 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:50:42.834959 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c8508303-3977-4585-871c-2e48efed6291 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:50:42.835494 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c8508303-3977-4585-871c-2e48efed6291 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:50:42.836267 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c8508303-3977-4585-871c-2e48efed6291 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:50:42.836801 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c8508303-3977-4585-871c-2e48efed6291 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:50:42.837305 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c8508303-3977-4585-871c-2e48efed6291 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:50:42.902202 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-c8508303-3977-4585-871c-2e48efed6291 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:50:42.905854 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:50:42.911731 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-c8508303-3977-4585-871c-2e48efed6291 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096" status: 200 len: 1652 microversion: 2.1 time: 0.089695 Sep 14 09:50:42.929736 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3797/7121] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:50:42 2022] GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096 => generated 1652 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:50:42.935341 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-fe4a9499-8c7a-4dca-9383-7b53504eb0d9 req-dfd9c5b7-4bad-4999-a4a5-8d962a20cca3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81aae111-cb97-486f-b843-405808b7b096", "name": "network-vif-deleted", "tag": "5936b844-2b77-4ad5-934a-163f3310dce3"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:50:42.948934 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-fe4a9499-8c7a-4dca-9383-7b53504eb0d9 req-dfd9c5b7-4bad-4999-a4a5-8d962a20cca3 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:50:42.949554 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-fe4a9499-8c7a-4dca-9383-7b53504eb0d9 req-dfd9c5b7-4bad-4999-a4a5-8d962a20cca3 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:50:42.950054 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-fe4a9499-8c7a-4dca-9383-7b53504eb0d9 req-dfd9c5b7-4bad-4999-a4a5-8d962a20cca3 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:50:42.962729 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-fe4a9499-8c7a-4dca-9383-7b53504eb0d9 req-dfd9c5b7-4bad-4999-a4a5-8d962a20cca3 service nova] Creating event network-vif-deleted:5936b844-2b77-4ad5-934a-163f3310dce3 for instance 81aae111-cb97-486f-b843-405808b7b096 on n-h2-836830-18 Sep 14 09:50:42.968909 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-fe4a9499-8c7a-4dca-9383-7b53504eb0d9 req-dfd9c5b7-4bad-4999-a4a5-8d962a20cca3 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036737 Sep 14 09:50:42.969857 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3798/7122] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:50:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:50:43.939637 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-833cf7f2-255c-4a25-adb2-8eef40333b63 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:50:43.940457 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-833cf7f2-255c-4a25-adb2-8eef40333b63 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 81aae111-cb97-486f-b843-405808b7b096] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:50:43.948244 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-833cf7f2-255c-4a25-adb2-8eef40333b63 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:50:43.949010 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-833cf7f2-255c-4a25-adb2-8eef40333b63 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:50:43.949461 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-833cf7f2-255c-4a25-adb2-8eef40333b63 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:50:43.950206 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-833cf7f2-255c-4a25-adb2-8eef40333b63 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:50:43.950669 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-833cf7f2-255c-4a25-adb2-8eef40333b63 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:50:43.951140 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-833cf7f2-255c-4a25-adb2-8eef40333b63 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:50:44.025582 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-833cf7f2-255c-4a25-adb2-8eef40333b63 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:50:44.034542 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-833cf7f2-255c-4a25-adb2-8eef40333b63 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096" status: 200 len: 1368 microversion: 2.1 time: 0.101413 Sep 14 09:50:44.035430 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3799/7123] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:50:43 2022] GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096 => generated 1368 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:50:45.058395 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-cba5d045-81c7-4d3a-b705-4a216d73d454 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:50:45.059062 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-cba5d045-81c7-4d3a-b705-4a216d73d454 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 81aae111-cb97-486f-b843-405808b7b096] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:50:45.061866 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=2 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:50:45.067258 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cba5d045-81c7-4d3a-b705-4a216d73d454 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:50:45.067747 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cba5d045-81c7-4d3a-b705-4a216d73d454 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:50:45.068187 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cba5d045-81c7-4d3a-b705-4a216d73d454 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:50:45.069495 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cba5d045-81c7-4d3a-b705-4a216d73d454 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:50:45.069948 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cba5d045-81c7-4d3a-b705-4a216d73d454 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:50:45.070371 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cba5d045-81c7-4d3a-b705-4a216d73d454 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:50:45.134174 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-cba5d045-81c7-4d3a-b705-4a216d73d454 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:50:45.142529 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-cba5d045-81c7-4d3a-b705-4a216d73d454 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096" status: 200 len: 1368 microversion: 2.1 time: 0.088361 Sep 14 09:50:45.143126 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3800/7124] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:50:45 2022] GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:50:46.166148 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-27f0d796-9c5f-4ebe-bfc4-02b69b19a991 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:50:46.166868 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-27f0d796-9c5f-4ebe-bfc4-02b69b19a991 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 81aae111-cb97-486f-b843-405808b7b096] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:50:46.174115 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-27f0d796-9c5f-4ebe-bfc4-02b69b19a991 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:50:46.174614 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-27f0d796-9c5f-4ebe-bfc4-02b69b19a991 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:50:46.175084 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-27f0d796-9c5f-4ebe-bfc4-02b69b19a991 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:50:46.175794 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-27f0d796-9c5f-4ebe-bfc4-02b69b19a991 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:50:46.176250 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-27f0d796-9c5f-4ebe-bfc4-02b69b19a991 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:50:46.176680 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-27f0d796-9c5f-4ebe-bfc4-02b69b19a991 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:50:46.245197 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-27f0d796-9c5f-4ebe-bfc4-02b69b19a991 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:50:46.254138 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-27f0d796-9c5f-4ebe-bfc4-02b69b19a991 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096" status: 200 len: 1368 microversion: 2.1 time: 0.092486 Sep 14 09:50:46.254723 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3801/7125] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:50:46 2022] GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096 => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:50:47.278004 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f160a02f-5461-46c5-8972-c3b7f47c1f90 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:50:47.278637 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f160a02f-5461-46c5-8972-c3b7f47c1f90 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 81aae111-cb97-486f-b843-405808b7b096] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:50:47.285533 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f160a02f-5461-46c5-8972-c3b7f47c1f90 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:50:47.286026 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f160a02f-5461-46c5-8972-c3b7f47c1f90 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:50:47.286474 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f160a02f-5461-46c5-8972-c3b7f47c1f90 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:50:47.287856 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f160a02f-5461-46c5-8972-c3b7f47c1f90 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:50:47.288323 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f160a02f-5461-46c5-8972-c3b7f47c1f90 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:50:47.288756 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f160a02f-5461-46c5-8972-c3b7f47c1f90 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:50:47.318668 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f160a02f-5461-46c5-8972-c3b7f47c1f90 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:50:47.319189 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f160a02f-5461-46c5-8972-c3b7f47c1f90 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:50:47.319638 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f160a02f-5461-46c5-8972-c3b7f47c1f90 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:50:47.320380 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.objects.instance [None req-f160a02f-5461-46c5-8972-c3b7f47c1f90 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lazy-loading 'fault' on Instance uuid 81aae111-cb97-486f-b843-405808b7b096 {{(pid=128759) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:50:47.361748 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f160a02f-5461-46c5-8972-c3b7f47c1f90 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de83b9937f145dbbe1091039327e71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270f637ba197498bb4f7fa1ba14a62ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:50:47.369918 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f160a02f-5461-46c5-8972-c3b7f47c1f90 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096" status: 200 len: 1373 microversion: 2.1 time: 0.095903 Sep 14 09:50:47.370486 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3802/7126] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:50:47 2022] GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096 => generated 1373 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:50:48.392936 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-51345efb-4afe-479c-a2ab-a4bf903806a2 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:50:48.393611 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-51345efb-4afe-479c-a2ab-a4bf903806a2 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 81aae111-cb97-486f-b843-405808b7b096] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:50:48.401058 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-51345efb-4afe-479c-a2ab-a4bf903806a2 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:50:48.401552 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-51345efb-4afe-479c-a2ab-a4bf903806a2 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:50:48.401994 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-51345efb-4afe-479c-a2ab-a4bf903806a2 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:50:48.402691 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-51345efb-4afe-479c-a2ab-a4bf903806a2 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:50:48.403254 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-51345efb-4afe-479c-a2ab-a4bf903806a2 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:50:48.403686 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-51345efb-4afe-479c-a2ab-a4bf903806a2 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:50:48.416993 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-51345efb-4afe-479c-a2ab-a4bf903806a2 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] HTTP exception thrown: Instance 81aae111-cb97-486f-b843-405808b7b096 could not be found. Sep 14 09:50:48.418650 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-51345efb-4afe-479c-a2ab-a4bf903806a2 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Request method failure captured: Sep 14 09:50:48.418650 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096 HTTP/1.1 Sep 14 09:50:48.418650 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:50:48.418650 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:50:48.418650 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:50:48.418650 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:50:48.418650 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:50:48.418650 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:50:48.418650 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:50:48.418650 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:50:48.418650 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIaKBrBAh_wj7DfZiRKdrZ6pB2BVsnaFIACH9I9tnPwlUsTvBKg4Km-70hzyiQAJmR8uMyCC--Kmi_m3mCvjQEmAIcuX7dXHviBWfEEzRkbjLifKvzwHyNal8H1sdEC_eoJmfTTtUV4zMyNBM3to2Z7TJSY3tl0h8kAHjt5BuvlhekYs Sep 14 09:50:48.418650 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:50:48.418650 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:50:48.418650 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:50:48.418650 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:50:48.418650 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:50:48.418650 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:50:48.418650 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 270f637ba197498bb4f7fa1ba14a62ad Sep 14 09:50:48.418650 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ServerActionsTestJSON-1037640335 Sep 14 09:50:48.418650 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:50:48.418650 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:50:48.418650 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/270f637ba197498bb4f7fa1ba14a62ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_270f637ba197498bb4f7fa1ba14a62ad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/270f637ba197498bb4f7fa1ba14a62ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/270f637ba197498bb4f7fa1ba14a62ad"}]}] Sep 14 09:50:48.418650 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ServerActionsTestJSON-1037640335 Sep 14 09:50:48.418650 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 270f637ba197498bb4f7fa1ba14a62ad Sep 14 09:50:48.418650 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ServerActionsTestJSON-1037640335 Sep 14 09:50:48.418650 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ServerActionsTestJSON-1037640335-project Sep 14 09:50:48.418650 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:50:48.418650 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:50:48.418650 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 5de83b9937f145dbbe1091039327e71a Sep 14 09:50:48.418650 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ServerActionsTestJSON-1037640335-project Sep 14 09:50:48.418650 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:50:48.418650 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance 81aae111-cb97-486f-b843-405808b7b096 could not be found. Sep 14 09:50:48.418650 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '81aae111-cb97-486f-b843-405808b7b096'} Sep 14 09:50:48.418650 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:50:48.418650 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:50:48.418650 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:50:48.418650 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:50:48.418650 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:50:48.418650 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:50:48.418650 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:50:48.418650 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:50:48.418650 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:50:48.418650 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:50:48.418650 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81aae111-cb97-486f-b843-405808b7b096 could not be found. Sep 14 09:50:48.418650 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:50:48.418650 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:50:48.418650 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:50:48.418650 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:50:48.418650 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:50:48.418650 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:50:48.418650 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:50:48.418650 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:50:48.418650 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:50:48.418650 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:50:48.418650 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:50:48.418650 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:50:48.418650 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:50:48.418650 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:50:48.418650 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:50:48.418650 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:50:48.418650 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81aae111-cb97-486f-b843-405808b7b096 could not be found. Sep 14 09:50:48.418650 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:50:48.418650 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:50:48.418650 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:50:48.423734 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:50:48.423734 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:50:48.423734 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:50:48.423734 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:50:48.423734 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:50:48.423734 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81aae111-cb97-486f-b843-405808b7b096 could not be found. Sep 14 09:50:48.423734 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:50:48.423734 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-51345efb-4afe-479c-a2ab-a4bf903806a2 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Returning 404 to user: Instance 81aae111-cb97-486f-b843-405808b7b096 could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:50:48.423734 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-51345efb-4afe-479c-a2ab-a4bf903806a2 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096" status: 404 len: 111 microversion: 2.1 time: 0.031119 Sep 14 09:50:48.423734 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3803/7127] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:50:48 2022] GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 14 09:50:48.536360 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-bffe7bf7-0b6d-4101-ab23-28559780d074 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:50:48.538566 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-bffe7bf7-0b6d-4101-ab23-28559780d074 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 81aae111-cb97-486f-b843-405808b7b096] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:50:48.544559 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bffe7bf7-0b6d-4101-ab23-28559780d074 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:50:48.545056 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bffe7bf7-0b6d-4101-ab23-28559780d074 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:50:48.545489 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bffe7bf7-0b6d-4101-ab23-28559780d074 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:50:48.546164 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bffe7bf7-0b6d-4101-ab23-28559780d074 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:50:48.546615 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bffe7bf7-0b6d-4101-ab23-28559780d074 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:50:48.547062 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bffe7bf7-0b6d-4101-ab23-28559780d074 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:50:48.559611 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-bffe7bf7-0b6d-4101-ab23-28559780d074 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] HTTP exception thrown: Instance 81aae111-cb97-486f-b843-405808b7b096 could not be found. Sep 14 09:50:48.561155 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-bffe7bf7-0b6d-4101-ab23-28559780d074 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Request method failure captured: Sep 14 09:50:48.561155 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096/os-volume_attachments HTTP/1.1 Sep 14 09:50:48.561155 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:50:48.561155 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:50:48.561155 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:50:48.561155 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:50:48.561155 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:50:48.561155 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:50:48.561155 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:50:48.561155 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:50:48.561155 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIaKBrBAh_wj7DfZiRKdrZ6pB2BVsnaFIACH9I9tnPwlUsTvBKg4Km-70hzyiQAJmR8uMyCC--Kmi_m3mCvjQEmAIcuX7dXHviBWfEEzRkbjLifKvzwHyNal8H1sdEC_eoJmfTTtUV4zMyNBM3to2Z7TJSY3tl0h8kAHjt5BuvlhekYs Sep 14 09:50:48.561155 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:50:48.561155 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:50:48.561155 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:50:48.561155 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:50:48.561155 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:50:48.561155 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:50:48.561155 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 270f637ba197498bb4f7fa1ba14a62ad Sep 14 09:50:48.561155 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ServerActionsTestJSON-1037640335 Sep 14 09:50:48.561155 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:50:48.561155 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:50:48.561155 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/270f637ba197498bb4f7fa1ba14a62ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_270f637ba197498bb4f7fa1ba14a62ad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/270f637ba197498bb4f7fa1ba14a62ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/270f637ba197498bb4f7fa1ba14a62ad"}]}] Sep 14 09:50:48.561155 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ServerActionsTestJSON-1037640335 Sep 14 09:50:48.561155 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 270f637ba197498bb4f7fa1ba14a62ad Sep 14 09:50:48.561155 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ServerActionsTestJSON-1037640335 Sep 14 09:50:48.561155 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ServerActionsTestJSON-1037640335-project Sep 14 09:50:48.561155 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:50:48.561155 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:50:48.561155 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 5de83b9937f145dbbe1091039327e71a Sep 14 09:50:48.561155 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ServerActionsTestJSON-1037640335-project Sep 14 09:50:48.561155 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:50:48.561155 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance 81aae111-cb97-486f-b843-405808b7b096 could not be found. Sep 14 09:50:48.561155 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'server_id': '81aae111-cb97-486f-b843-405808b7b096'} Sep 14 09:50:48.561155 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:50:48.561155 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:50:48.561155 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:50:48.561155 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:50:48.561155 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:50:48.561155 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:50:48.561155 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:50:48.561155 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:50:48.561155 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:50:48.561155 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:50:48.561155 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81aae111-cb97-486f-b843-405808b7b096 could not be found. Sep 14 09:50:48.561155 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:50:48.561155 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:50:48.561155 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:50:48.561155 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:50:48.561155 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:50:48.561155 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:50:48.561155 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:50:48.561155 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:50:48.561155 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:50:48.561155 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:50:48.561155 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 14 09:50:48.561155 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:50:48.561155 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 14 09:50:48.561155 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:50:48.561155 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 14 09:50:48.561155 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 14 09:50:48.561155 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:50:48.561155 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:50:48.565747 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81aae111-cb97-486f-b843-405808b7b096 could not be found. Sep 14 09:50:48.565747 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:50:48.565747 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:50:48.565747 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:50:48.565747 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:50:48.565747 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:50:48.565747 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:50:48.565747 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:50:48.565747 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:50:48.565747 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81aae111-cb97-486f-b843-405808b7b096 could not be found. Sep 14 09:50:48.565747 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:50:48.565747 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-bffe7bf7-0b6d-4101-ab23-28559780d074 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Returning 404 to user: Instance 81aae111-cb97-486f-b843-405808b7b096 could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:50:48.565747 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-bffe7bf7-0b6d-4101-ab23-28559780d074 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.030257 Sep 14 09:50:48.565747 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3804/7128] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 14 09:50:48 2022] GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096/os-volume_attachments => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 14 09:50:51.893849 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-485645b3-eebe-45e8-ae9f-4ac5511ab9b6 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:50:51.894687 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-485645b3-eebe-45e8-ae9f-4ac5511ab9b6 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 81aae111-cb97-486f-b843-405808b7b096] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:50:51.901601 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-485645b3-eebe-45e8-ae9f-4ac5511ab9b6 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:50:51.902094 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-485645b3-eebe-45e8-ae9f-4ac5511ab9b6 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:50:51.902539 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-485645b3-eebe-45e8-ae9f-4ac5511ab9b6 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:50:51.903282 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-485645b3-eebe-45e8-ae9f-4ac5511ab9b6 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:50:51.903745 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-485645b3-eebe-45e8-ae9f-4ac5511ab9b6 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:50:51.904176 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-485645b3-eebe-45e8-ae9f-4ac5511ab9b6 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:50:51.919081 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-485645b3-eebe-45e8-ae9f-4ac5511ab9b6 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] HTTP exception thrown: Instance 81aae111-cb97-486f-b843-405808b7b096 could not be found. Sep 14 09:50:51.920667 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-485645b3-eebe-45e8-ae9f-4ac5511ab9b6 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Request method failure captured: Sep 14 09:50:51.920667 n-d-836830-18 devstack@n-api.service[128759]: request: DELETE /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096 HTTP/1.1 Sep 14 09:50:51.920667 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:50:51.920667 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:50:51.920667 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:50:51.920667 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:50:51.920667 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:50:51.920667 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:50:51.920667 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:50:51.920667 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:50:51.920667 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIaKBrBAh_wj7DfZiRKdrZ6pB2BVsnaFIACH9I9tnPwlUsTvBKg4Km-70hzyiQAJmR8uMyCC--Kmi_m3mCvjQEmAIcuX7dXHviBWfEEzRkbjLifKvzwHyNal8H1sdEC_eoJmfTTtUV4zMyNBM3to2Z7TJSY3tl0h8kAHjt5BuvlhekYs Sep 14 09:50:51.920667 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:50:51.920667 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:50:51.920667 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:50:51.920667 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:50:51.920667 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:50:51.920667 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:50:51.920667 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 270f637ba197498bb4f7fa1ba14a62ad Sep 14 09:50:51.920667 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ServerActionsTestJSON-1037640335 Sep 14 09:50:51.920667 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:50:51.920667 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:50:51.920667 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/270f637ba197498bb4f7fa1ba14a62ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_270f637ba197498bb4f7fa1ba14a62ad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/270f637ba197498bb4f7fa1ba14a62ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/270f637ba197498bb4f7fa1ba14a62ad"}]}] Sep 14 09:50:51.920667 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ServerActionsTestJSON-1037640335 Sep 14 09:50:51.920667 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 270f637ba197498bb4f7fa1ba14a62ad Sep 14 09:50:51.920667 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ServerActionsTestJSON-1037640335 Sep 14 09:50:51.920667 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ServerActionsTestJSON-1037640335-project Sep 14 09:50:51.920667 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:50:51.920667 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:50:51.920667 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 5de83b9937f145dbbe1091039327e71a Sep 14 09:50:51.920667 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ServerActionsTestJSON-1037640335-project Sep 14 09:50:51.920667 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:50:51.920667 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance 81aae111-cb97-486f-b843-405808b7b096 could not be found. Sep 14 09:50:51.920667 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '81aae111-cb97-486f-b843-405808b7b096'} Sep 14 09:50:51.920667 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:50:51.920667 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:50:51.920667 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:50:51.920667 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:50:51.920667 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:50:51.920667 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:50:51.920667 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:50:51.920667 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:50:51.920667 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:50:51.920667 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:50:51.920667 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81aae111-cb97-486f-b843-405808b7b096 could not be found. Sep 14 09:50:51.920667 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:50:51.920667 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:50:51.920667 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:50:51.920667 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:50:51.920667 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:50:51.920667 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:50:51.920667 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:50:51.920667 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:50:51.920667 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:50:51.920667 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:50:51.920667 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 09:50:51.920667 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 09:50:51.920667 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 09:50:51.920667 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 09:50:51.920667 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:50:51.920667 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:50:51.920667 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:50:51.920667 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:50:51.924839 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81aae111-cb97-486f-b843-405808b7b096 could not be found. Sep 14 09:50:51.924839 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:50:51.924839 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:50:51.924839 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:50:51.924839 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:50:51.924839 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:50:51.924839 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:50:51.924839 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:50:51.924839 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:50:51.924839 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81aae111-cb97-486f-b843-405808b7b096 could not be found. Sep 14 09:50:51.924839 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:50:51.924839 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-485645b3-eebe-45e8-ae9f-4ac5511ab9b6 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Returning 404 to user: Instance 81aae111-cb97-486f-b843-405808b7b096 could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:50:51.924839 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-485645b3-eebe-45e8-ae9f-4ac5511ab9b6 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "DELETE /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096" status: 404 len: 111 microversion: 2.1 time: 0.032130 Sep 14 09:50:51.924839 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3805/7129] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:50:51 2022] DELETE /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 14 09:50:51.931878 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-7af22aa4-af55-4bb2-8eb9-3ba7c02f7942 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:50:51.932820 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-7af22aa4-af55-4bb2-8eb9-3ba7c02f7942 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 81aae111-cb97-486f-b843-405808b7b096] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:50:51.939213 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7af22aa4-af55-4bb2-8eb9-3ba7c02f7942 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:50:51.939711 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7af22aa4-af55-4bb2-8eb9-3ba7c02f7942 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:50:51.940177 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7af22aa4-af55-4bb2-8eb9-3ba7c02f7942 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:50:51.940870 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7af22aa4-af55-4bb2-8eb9-3ba7c02f7942 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:50:51.941332 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7af22aa4-af55-4bb2-8eb9-3ba7c02f7942 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:50:51.941762 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7af22aa4-af55-4bb2-8eb9-3ba7c02f7942 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:50:51.957017 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-7af22aa4-af55-4bb2-8eb9-3ba7c02f7942 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] HTTP exception thrown: Instance 81aae111-cb97-486f-b843-405808b7b096 could not be found. Sep 14 09:50:51.958680 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-7af22aa4-af55-4bb2-8eb9-3ba7c02f7942 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Request method failure captured: Sep 14 09:50:51.958680 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096 HTTP/1.1 Sep 14 09:50:51.958680 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:50:51.958680 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:50:51.958680 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:50:51.958680 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:50:51.958680 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:50:51.958680 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:50:51.958680 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:50:51.958680 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:50:51.958680 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIaKBrBAh_wj7DfZiRKdrZ6pB2BVsnaFIACH9I9tnPwlUsTvBKg4Km-70hzyiQAJmR8uMyCC--Kmi_m3mCvjQEmAIcuX7dXHviBWfEEzRkbjLifKvzwHyNal8H1sdEC_eoJmfTTtUV4zMyNBM3to2Z7TJSY3tl0h8kAHjt5BuvlhekYs Sep 14 09:50:51.958680 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:50:51.958680 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:50:51.958680 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:50:51.958680 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:50:51.958680 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:50:51.958680 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:50:51.958680 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 270f637ba197498bb4f7fa1ba14a62ad Sep 14 09:50:51.958680 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ServerActionsTestJSON-1037640335 Sep 14 09:50:51.958680 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:50:51.958680 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:50:51.958680 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/270f637ba197498bb4f7fa1ba14a62ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_270f637ba197498bb4f7fa1ba14a62ad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/270f637ba197498bb4f7fa1ba14a62ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/270f637ba197498bb4f7fa1ba14a62ad"}]}] Sep 14 09:50:51.958680 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ServerActionsTestJSON-1037640335 Sep 14 09:50:51.958680 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 270f637ba197498bb4f7fa1ba14a62ad Sep 14 09:50:51.958680 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ServerActionsTestJSON-1037640335 Sep 14 09:50:51.958680 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ServerActionsTestJSON-1037640335-project Sep 14 09:50:51.958680 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:50:51.958680 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:50:51.958680 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 5de83b9937f145dbbe1091039327e71a Sep 14 09:50:51.958680 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ServerActionsTestJSON-1037640335-project Sep 14 09:50:51.958680 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:50:51.958680 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance 81aae111-cb97-486f-b843-405808b7b096 could not be found. Sep 14 09:50:51.958680 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '81aae111-cb97-486f-b843-405808b7b096'} Sep 14 09:50:51.958680 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:50:51.958680 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:50:51.958680 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:50:51.958680 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:50:51.958680 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:50:51.958680 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:50:51.958680 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:50:51.958680 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:50:51.958680 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:50:51.958680 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:50:51.958680 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81aae111-cb97-486f-b843-405808b7b096 could not be found. Sep 14 09:50:51.958680 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:50:51.958680 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:50:51.958680 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:50:51.958680 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:50:51.958680 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:50:51.958680 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:50:51.958680 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:50:51.958680 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:50:51.958680 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:50:51.958680 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:50:51.958680 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:50:51.958680 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:50:51.958680 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:50:51.958680 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:50:51.958680 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:50:51.958680 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:50:51.958680 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81aae111-cb97-486f-b843-405808b7b096 could not be found. Sep 14 09:50:51.958680 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:50:51.958680 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:50:51.958680 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:50:51.962827 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:50:51.962827 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:50:51.962827 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:50:51.962827 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:50:51.962827 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:50:51.962827 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81aae111-cb97-486f-b843-405808b7b096 could not be found. Sep 14 09:50:51.962827 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:50:51.962827 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-7af22aa4-af55-4bb2-8eb9-3ba7c02f7942 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Returning 404 to user: Instance 81aae111-cb97-486f-b843-405808b7b096 could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:50:51.962827 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-7af22aa4-af55-4bb2-8eb9-3ba7c02f7942 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096" status: 404 len: 111 microversion: 2.1 time: 0.033222 Sep 14 09:50:51.962827 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3806/7130] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:50:51 2022] GET /compute/v2.1/servers/81aae111-cb97-486f-b843-405808b7b096 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 14 09:50:51.969156 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-40355d9f-ce65-4106-af70-4fdc73ee87c3 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:50:51.969660 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-40355d9f-ce65-4106-af70-4fdc73ee87c3 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 565c49d8-efe1-4dcb-b6b8-493de07df35d] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:50:51.975945 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-40355d9f-ce65-4106-af70-4fdc73ee87c3 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:50:51.976439 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-40355d9f-ce65-4106-af70-4fdc73ee87c3 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:50:51.977471 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-40355d9f-ce65-4106-af70-4fdc73ee87c3 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:50:51.978191 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-40355d9f-ce65-4106-af70-4fdc73ee87c3 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:50:51.978649 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-40355d9f-ce65-4106-af70-4fdc73ee87c3 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:50:51.979160 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-40355d9f-ce65-4106-af70-4fdc73ee87c3 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:50:51.996100 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-40355d9f-ce65-4106-af70-4fdc73ee87c3 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] HTTP exception thrown: Instance 565c49d8-efe1-4dcb-b6b8-493de07df35d could not be found. Sep 14 09:50:51.997663 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-40355d9f-ce65-4106-af70-4fdc73ee87c3 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Request method failure captured: Sep 14 09:50:51.997663 n-d-836830-18 devstack@n-api.service[128759]: request: DELETE /compute/v2.1/servers/565c49d8-efe1-4dcb-b6b8-493de07df35d HTTP/1.1 Sep 14 09:50:51.997663 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:50:51.997663 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:50:51.997663 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:50:51.997663 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:50:51.997663 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:50:51.997663 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:50:51.997663 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:50:51.997663 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:50:51.997663 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIaKBrBAh_wj7DfZiRKdrZ6pB2BVsnaFIACH9I9tnPwlUsTvBKg4Km-70hzyiQAJmR8uMyCC--Kmi_m3mCvjQEmAIcuX7dXHviBWfEEzRkbjLifKvzwHyNal8H1sdEC_eoJmfTTtUV4zMyNBM3to2Z7TJSY3tl0h8kAHjt5BuvlhekYs Sep 14 09:50:51.997663 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:50:51.997663 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:50:51.997663 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:50:51.997663 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:50:51.997663 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:50:51.997663 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:50:51.997663 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 270f637ba197498bb4f7fa1ba14a62ad Sep 14 09:50:51.997663 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ServerActionsTestJSON-1037640335 Sep 14 09:50:51.997663 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:50:51.997663 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:50:51.997663 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/270f637ba197498bb4f7fa1ba14a62ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_270f637ba197498bb4f7fa1ba14a62ad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/270f637ba197498bb4f7fa1ba14a62ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/270f637ba197498bb4f7fa1ba14a62ad"}]}] Sep 14 09:50:51.997663 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ServerActionsTestJSON-1037640335 Sep 14 09:50:51.997663 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 270f637ba197498bb4f7fa1ba14a62ad Sep 14 09:50:51.997663 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ServerActionsTestJSON-1037640335 Sep 14 09:50:51.997663 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ServerActionsTestJSON-1037640335-project Sep 14 09:50:51.997663 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:50:51.997663 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:50:51.997663 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 5de83b9937f145dbbe1091039327e71a Sep 14 09:50:51.997663 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ServerActionsTestJSON-1037640335-project Sep 14 09:50:51.997663 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:50:51.997663 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance 565c49d8-efe1-4dcb-b6b8-493de07df35d could not be found. Sep 14 09:50:51.997663 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '565c49d8-efe1-4dcb-b6b8-493de07df35d'} Sep 14 09:50:51.997663 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:50:51.997663 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:50:51.997663 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:50:51.997663 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:50:51.997663 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:50:51.997663 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:50:51.997663 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:50:51.997663 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:50:51.997663 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:50:51.997663 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:50:51.997663 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 565c49d8-efe1-4dcb-b6b8-493de07df35d could not be found. Sep 14 09:50:51.997663 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:50:51.997663 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:50:51.997663 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:50:51.997663 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:50:51.997663 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:50:51.997663 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:50:51.997663 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:50:51.997663 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:50:51.997663 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:50:51.997663 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:50:51.997663 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 09:50:51.997663 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 09:50:51.997663 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 09:50:51.997663 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 09:50:51.997663 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:50:51.997663 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:50:51.997663 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:50:51.997663 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:50:52.002149 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 565c49d8-efe1-4dcb-b6b8-493de07df35d could not be found. Sep 14 09:50:52.002149 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:50:52.002149 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:50:52.002149 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:50:52.002149 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:50:52.002149 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:50:52.002149 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:50:52.002149 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:50:52.002149 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:50:52.002149 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 565c49d8-efe1-4dcb-b6b8-493de07df35d could not be found. Sep 14 09:50:52.002149 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:50:52.002149 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-40355d9f-ce65-4106-af70-4fdc73ee87c3 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Returning 404 to user: Instance 565c49d8-efe1-4dcb-b6b8-493de07df35d could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:50:52.002149 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-40355d9f-ce65-4106-af70-4fdc73ee87c3 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "DELETE /compute/v2.1/servers/565c49d8-efe1-4dcb-b6b8-493de07df35d" status: 404 len: 111 microversion: 2.1 time: 0.034074 Sep 14 09:50:52.003100 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3807/7131] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:50:51 2022] DELETE /compute/v2.1/servers/565c49d8-efe1-4dcb-b6b8-493de07df35d => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 14 09:50:52.008056 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-adfe39e2-c7e7-42fe-851f-686eb11c9aac tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:50:52.008674 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-adfe39e2-c7e7-42fe-851f-686eb11c9aac tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 565c49d8-efe1-4dcb-b6b8-493de07df35d] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:50:52.014491 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-adfe39e2-c7e7-42fe-851f-686eb11c9aac tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:50:52.015016 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-adfe39e2-c7e7-42fe-851f-686eb11c9aac tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:50:52.015464 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-adfe39e2-c7e7-42fe-851f-686eb11c9aac tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:50:52.016159 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-adfe39e2-c7e7-42fe-851f-686eb11c9aac tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:50:52.016617 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-adfe39e2-c7e7-42fe-851f-686eb11c9aac tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:50:52.017045 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-adfe39e2-c7e7-42fe-851f-686eb11c9aac tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:50:52.030402 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-adfe39e2-c7e7-42fe-851f-686eb11c9aac tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] HTTP exception thrown: Instance 565c49d8-efe1-4dcb-b6b8-493de07df35d could not be found. Sep 14 09:50:52.031951 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-adfe39e2-c7e7-42fe-851f-686eb11c9aac tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Request method failure captured: Sep 14 09:50:52.031951 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/565c49d8-efe1-4dcb-b6b8-493de07df35d HTTP/1.1 Sep 14 09:50:52.031951 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:50:52.031951 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:50:52.031951 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:50:52.031951 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:50:52.031951 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:50:52.031951 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:50:52.031951 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:50:52.031951 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:50:52.031951 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIaKBrBAh_wj7DfZiRKdrZ6pB2BVsnaFIACH9I9tnPwlUsTvBKg4Km-70hzyiQAJmR8uMyCC--Kmi_m3mCvjQEmAIcuX7dXHviBWfEEzRkbjLifKvzwHyNal8H1sdEC_eoJmfTTtUV4zMyNBM3to2Z7TJSY3tl0h8kAHjt5BuvlhekYs Sep 14 09:50:52.031951 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:50:52.031951 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:50:52.031951 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:50:52.031951 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:50:52.031951 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:50:52.031951 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:50:52.031951 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 270f637ba197498bb4f7fa1ba14a62ad Sep 14 09:50:52.031951 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ServerActionsTestJSON-1037640335 Sep 14 09:50:52.031951 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:50:52.031951 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:50:52.031951 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/270f637ba197498bb4f7fa1ba14a62ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_270f637ba197498bb4f7fa1ba14a62ad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/270f637ba197498bb4f7fa1ba14a62ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/270f637ba197498bb4f7fa1ba14a62ad"}]}] Sep 14 09:50:52.031951 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ServerActionsTestJSON-1037640335 Sep 14 09:50:52.031951 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 270f637ba197498bb4f7fa1ba14a62ad Sep 14 09:50:52.031951 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ServerActionsTestJSON-1037640335 Sep 14 09:50:52.031951 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ServerActionsTestJSON-1037640335-project Sep 14 09:50:52.031951 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:50:52.031951 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:50:52.031951 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 5de83b9937f145dbbe1091039327e71a Sep 14 09:50:52.031951 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ServerActionsTestJSON-1037640335-project Sep 14 09:50:52.031951 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:50:52.031951 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance 565c49d8-efe1-4dcb-b6b8-493de07df35d could not be found. Sep 14 09:50:52.031951 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '565c49d8-efe1-4dcb-b6b8-493de07df35d'} Sep 14 09:50:52.031951 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:50:52.031951 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:50:52.031951 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:50:52.031951 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:50:52.031951 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:50:52.031951 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:50:52.031951 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:50:52.031951 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:50:52.031951 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:50:52.031951 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:50:52.031951 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 565c49d8-efe1-4dcb-b6b8-493de07df35d could not be found. Sep 14 09:50:52.031951 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:50:52.031951 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:50:52.031951 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:50:52.031951 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:50:52.031951 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:50:52.031951 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:50:52.031951 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:50:52.031951 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:50:52.031951 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:50:52.031951 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:50:52.031951 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:50:52.031951 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:50:52.031951 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:50:52.031951 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:50:52.031951 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:50:52.031951 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:50:52.031951 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 565c49d8-efe1-4dcb-b6b8-493de07df35d could not be found. Sep 14 09:50:52.031951 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:50:52.031951 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:50:52.031951 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:50:52.036230 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:50:52.036230 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:50:52.036230 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:50:52.036230 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:50:52.036230 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:50:52.036230 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 565c49d8-efe1-4dcb-b6b8-493de07df35d could not be found. Sep 14 09:50:52.036230 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:50:52.036230 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-adfe39e2-c7e7-42fe-851f-686eb11c9aac tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Returning 404 to user: Instance 565c49d8-efe1-4dcb-b6b8-493de07df35d could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:50:52.036230 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-adfe39e2-c7e7-42fe-851f-686eb11c9aac tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/565c49d8-efe1-4dcb-b6b8-493de07df35d" status: 404 len: 111 microversion: 2.1 time: 0.029410 Sep 14 09:50:52.036230 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3808/7132] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:50:52 2022] GET /compute/v2.1/servers/565c49d8-efe1-4dcb-b6b8-493de07df35d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:50:52.041448 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9102d44f-91f1-4d27-a547-70cdcbf84fba tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:50:52.041945 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-9102d44f-91f1-4d27-a547-70cdcbf84fba tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 7b1e3385-d546-471e-b140-c5ca25783bca] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:50:52.047799 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9102d44f-91f1-4d27-a547-70cdcbf84fba tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:50:52.048283 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9102d44f-91f1-4d27-a547-70cdcbf84fba tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:50:52.048721 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9102d44f-91f1-4d27-a547-70cdcbf84fba tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:50:52.049408 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9102d44f-91f1-4d27-a547-70cdcbf84fba tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:50:52.049860 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9102d44f-91f1-4d27-a547-70cdcbf84fba tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:50:52.050284 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9102d44f-91f1-4d27-a547-70cdcbf84fba tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:50:52.064354 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-9102d44f-91f1-4d27-a547-70cdcbf84fba tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] HTTP exception thrown: Instance 7b1e3385-d546-471e-b140-c5ca25783bca could not be found. Sep 14 09:50:52.065893 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9102d44f-91f1-4d27-a547-70cdcbf84fba tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Request method failure captured: Sep 14 09:50:52.065893 n-d-836830-18 devstack@n-api.service[128759]: request: DELETE /compute/v2.1/servers/7b1e3385-d546-471e-b140-c5ca25783bca HTTP/1.1 Sep 14 09:50:52.065893 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:50:52.065893 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:50:52.065893 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:50:52.065893 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:50:52.065893 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:50:52.065893 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:50:52.065893 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:50:52.065893 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:50:52.065893 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIaKBrBAh_wj7DfZiRKdrZ6pB2BVsnaFIACH9I9tnPwlUsTvBKg4Km-70hzyiQAJmR8uMyCC--Kmi_m3mCvjQEmAIcuX7dXHviBWfEEzRkbjLifKvzwHyNal8H1sdEC_eoJmfTTtUV4zMyNBM3to2Z7TJSY3tl0h8kAHjt5BuvlhekYs Sep 14 09:50:52.065893 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:50:52.065893 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:50:52.065893 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:50:52.065893 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:50:52.065893 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:50:52.065893 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:50:52.065893 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 270f637ba197498bb4f7fa1ba14a62ad Sep 14 09:50:52.065893 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ServerActionsTestJSON-1037640335 Sep 14 09:50:52.065893 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:50:52.065893 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:50:52.065893 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/270f637ba197498bb4f7fa1ba14a62ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_270f637ba197498bb4f7fa1ba14a62ad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/270f637ba197498bb4f7fa1ba14a62ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/270f637ba197498bb4f7fa1ba14a62ad"}]}] Sep 14 09:50:52.065893 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ServerActionsTestJSON-1037640335 Sep 14 09:50:52.065893 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 270f637ba197498bb4f7fa1ba14a62ad Sep 14 09:50:52.065893 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ServerActionsTestJSON-1037640335 Sep 14 09:50:52.065893 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ServerActionsTestJSON-1037640335-project Sep 14 09:50:52.065893 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:50:52.065893 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:50:52.065893 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 5de83b9937f145dbbe1091039327e71a Sep 14 09:50:52.065893 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ServerActionsTestJSON-1037640335-project Sep 14 09:50:52.065893 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:50:52.065893 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance 7b1e3385-d546-471e-b140-c5ca25783bca could not be found. Sep 14 09:50:52.065893 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '7b1e3385-d546-471e-b140-c5ca25783bca'} Sep 14 09:50:52.065893 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:50:52.065893 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:50:52.065893 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:50:52.065893 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:50:52.065893 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:50:52.065893 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:50:52.065893 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:50:52.065893 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:50:52.065893 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:50:52.065893 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:50:52.065893 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b1e3385-d546-471e-b140-c5ca25783bca could not be found. Sep 14 09:50:52.065893 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:50:52.065893 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:50:52.065893 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:50:52.065893 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:50:52.065893 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:50:52.065893 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:50:52.065893 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:50:52.065893 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:50:52.065893 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:50:52.065893 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:50:52.065893 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 09:50:52.065893 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 09:50:52.065893 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 09:50:52.065893 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 09:50:52.065893 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:50:52.065893 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:50:52.065893 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:50:52.065893 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:50:52.070914 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b1e3385-d546-471e-b140-c5ca25783bca could not be found. Sep 14 09:50:52.070914 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:50:52.070914 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:50:52.070914 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:50:52.070914 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:50:52.070914 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:50:52.070914 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:50:52.070914 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:50:52.070914 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:50:52.070914 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b1e3385-d546-471e-b140-c5ca25783bca could not be found. Sep 14 09:50:52.070914 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:50:52.070914 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9102d44f-91f1-4d27-a547-70cdcbf84fba tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Returning 404 to user: Instance 7b1e3385-d546-471e-b140-c5ca25783bca could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:50:52.070914 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-9102d44f-91f1-4d27-a547-70cdcbf84fba tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "DELETE /compute/v2.1/servers/7b1e3385-d546-471e-b140-c5ca25783bca" status: 404 len: 111 microversion: 2.1 time: 0.029422 Sep 14 09:50:52.070914 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3809/7133] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:50:52 2022] DELETE /compute/v2.1/servers/7b1e3385-d546-471e-b140-c5ca25783bca => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:50:52.075849 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e6b6c9f7-97b7-4606-9664-d2b3ecca2e98 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:50:52.076467 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e6b6c9f7-97b7-4606-9664-d2b3ecca2e98 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 7b1e3385-d546-471e-b140-c5ca25783bca] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:50:52.082168 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e6b6c9f7-97b7-4606-9664-d2b3ecca2e98 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:50:52.082659 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e6b6c9f7-97b7-4606-9664-d2b3ecca2e98 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:50:52.083142 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e6b6c9f7-97b7-4606-9664-d2b3ecca2e98 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:50:52.083863 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e6b6c9f7-97b7-4606-9664-d2b3ecca2e98 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:50:52.084318 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e6b6c9f7-97b7-4606-9664-d2b3ecca2e98 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:50:52.084744 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e6b6c9f7-97b7-4606-9664-d2b3ecca2e98 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:50:52.098455 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-e6b6c9f7-97b7-4606-9664-d2b3ecca2e98 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] HTTP exception thrown: Instance 7b1e3385-d546-471e-b140-c5ca25783bca could not be found. Sep 14 09:50:52.100323 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e6b6c9f7-97b7-4606-9664-d2b3ecca2e98 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Request method failure captured: Sep 14 09:50:52.100323 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/7b1e3385-d546-471e-b140-c5ca25783bca HTTP/1.1 Sep 14 09:50:52.100323 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:50:52.100323 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:50:52.100323 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:50:52.100323 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:50:52.100323 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:50:52.100323 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:50:52.100323 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:50:52.100323 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:50:52.100323 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIaKBrBAh_wj7DfZiRKdrZ6pB2BVsnaFIACH9I9tnPwlUsTvBKg4Km-70hzyiQAJmR8uMyCC--Kmi_m3mCvjQEmAIcuX7dXHviBWfEEzRkbjLifKvzwHyNal8H1sdEC_eoJmfTTtUV4zMyNBM3to2Z7TJSY3tl0h8kAHjt5BuvlhekYs Sep 14 09:50:52.100323 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:50:52.100323 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:50:52.100323 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:50:52.100323 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:50:52.100323 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:50:52.100323 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:50:52.100323 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 270f637ba197498bb4f7fa1ba14a62ad Sep 14 09:50:52.100323 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ServerActionsTestJSON-1037640335 Sep 14 09:50:52.100323 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:50:52.100323 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:50:52.100323 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/270f637ba197498bb4f7fa1ba14a62ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_270f637ba197498bb4f7fa1ba14a62ad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/270f637ba197498bb4f7fa1ba14a62ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/270f637ba197498bb4f7fa1ba14a62ad"}]}] Sep 14 09:50:52.100323 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ServerActionsTestJSON-1037640335 Sep 14 09:50:52.100323 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 270f637ba197498bb4f7fa1ba14a62ad Sep 14 09:50:52.100323 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ServerActionsTestJSON-1037640335 Sep 14 09:50:52.100323 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ServerActionsTestJSON-1037640335-project Sep 14 09:50:52.100323 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:50:52.100323 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:50:52.100323 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 5de83b9937f145dbbe1091039327e71a Sep 14 09:50:52.100323 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ServerActionsTestJSON-1037640335-project Sep 14 09:50:52.100323 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:50:52.100323 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance 7b1e3385-d546-471e-b140-c5ca25783bca could not be found. Sep 14 09:50:52.100323 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '7b1e3385-d546-471e-b140-c5ca25783bca'} Sep 14 09:50:52.100323 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:50:52.100323 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:50:52.100323 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:50:52.100323 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:50:52.100323 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:50:52.100323 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:50:52.100323 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:50:52.100323 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:50:52.100323 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:50:52.100323 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:50:52.100323 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b1e3385-d546-471e-b140-c5ca25783bca could not be found. Sep 14 09:50:52.100323 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:50:52.100323 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:50:52.100323 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:50:52.100323 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:50:52.100323 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:50:52.100323 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:50:52.100323 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:50:52.100323 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:50:52.100323 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:50:52.100323 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:50:52.100323 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:50:52.100323 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:50:52.100323 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:50:52.100323 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:50:52.100323 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:50:52.100323 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:50:52.100323 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b1e3385-d546-471e-b140-c5ca25783bca could not be found. Sep 14 09:50:52.100323 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:50:52.100323 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:50:52.100323 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:50:52.104538 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:50:52.104538 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:50:52.104538 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:50:52.104538 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:50:52.104538 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:50:52.104538 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b1e3385-d546-471e-b140-c5ca25783bca could not be found. Sep 14 09:50:52.104538 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:50:52.104538 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e6b6c9f7-97b7-4606-9664-d2b3ecca2e98 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Returning 404 to user: Instance 7b1e3385-d546-471e-b140-c5ca25783bca could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:50:52.104538 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e6b6c9f7-97b7-4606-9664-d2b3ecca2e98 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/7b1e3385-d546-471e-b140-c5ca25783bca" status: 404 len: 111 microversion: 2.1 time: 0.029395 Sep 14 09:50:52.104538 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3810/7134] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:50:52 2022] GET /compute/v2.1/servers/7b1e3385-d546-471e-b140-c5ca25783bca => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 14 09:50:52.109893 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-de802ac5-7878-4c42-82df-d525528bfadb tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:50:52.110403 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-de802ac5-7878-4c42-82df-d525528bfadb tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 1bc1a004-49b2-4b89-ba42-cddb661c7d94] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:50:52.116849 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-de802ac5-7878-4c42-82df-d525528bfadb tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:50:52.117332 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-de802ac5-7878-4c42-82df-d525528bfadb tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:50:52.117768 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-de802ac5-7878-4c42-82df-d525528bfadb tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:50:52.118462 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-de802ac5-7878-4c42-82df-d525528bfadb tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:50:52.118917 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-de802ac5-7878-4c42-82df-d525528bfadb tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:50:52.119411 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-de802ac5-7878-4c42-82df-d525528bfadb tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:50:52.132989 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-de802ac5-7878-4c42-82df-d525528bfadb tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] HTTP exception thrown: Instance 1bc1a004-49b2-4b89-ba42-cddb661c7d94 could not be found. Sep 14 09:50:52.134543 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-de802ac5-7878-4c42-82df-d525528bfadb tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Request method failure captured: Sep 14 09:50:52.134543 n-d-836830-18 devstack@n-api.service[128759]: request: DELETE /compute/v2.1/servers/1bc1a004-49b2-4b89-ba42-cddb661c7d94 HTTP/1.1 Sep 14 09:50:52.134543 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:50:52.134543 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:50:52.134543 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:50:52.134543 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:50:52.134543 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:50:52.134543 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:50:52.134543 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:50:52.134543 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:50:52.134543 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIaKBrBAh_wj7DfZiRKdrZ6pB2BVsnaFIACH9I9tnPwlUsTvBKg4Km-70hzyiQAJmR8uMyCC--Kmi_m3mCvjQEmAIcuX7dXHviBWfEEzRkbjLifKvzwHyNal8H1sdEC_eoJmfTTtUV4zMyNBM3to2Z7TJSY3tl0h8kAHjt5BuvlhekYs Sep 14 09:50:52.134543 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:50:52.134543 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:50:52.134543 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:50:52.134543 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:50:52.134543 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:50:52.134543 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:50:52.134543 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 270f637ba197498bb4f7fa1ba14a62ad Sep 14 09:50:52.134543 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ServerActionsTestJSON-1037640335 Sep 14 09:50:52.134543 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:50:52.134543 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:50:52.134543 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/270f637ba197498bb4f7fa1ba14a62ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_270f637ba197498bb4f7fa1ba14a62ad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/270f637ba197498bb4f7fa1ba14a62ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/270f637ba197498bb4f7fa1ba14a62ad"}]}] Sep 14 09:50:52.134543 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ServerActionsTestJSON-1037640335 Sep 14 09:50:52.134543 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 270f637ba197498bb4f7fa1ba14a62ad Sep 14 09:50:52.134543 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ServerActionsTestJSON-1037640335 Sep 14 09:50:52.134543 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ServerActionsTestJSON-1037640335-project Sep 14 09:50:52.134543 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:50:52.134543 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:50:52.134543 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 5de83b9937f145dbbe1091039327e71a Sep 14 09:50:52.134543 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ServerActionsTestJSON-1037640335-project Sep 14 09:50:52.134543 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:50:52.134543 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance 1bc1a004-49b2-4b89-ba42-cddb661c7d94 could not be found. Sep 14 09:50:52.134543 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '1bc1a004-49b2-4b89-ba42-cddb661c7d94'} Sep 14 09:50:52.134543 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:50:52.134543 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:50:52.134543 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:50:52.134543 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:50:52.134543 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:50:52.134543 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:50:52.134543 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:50:52.134543 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:50:52.134543 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:50:52.134543 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:50:52.134543 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1bc1a004-49b2-4b89-ba42-cddb661c7d94 could not be found. Sep 14 09:50:52.134543 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:50:52.134543 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:50:52.134543 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:50:52.134543 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:50:52.134543 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:50:52.134543 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:50:52.134543 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:50:52.134543 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:50:52.134543 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:50:52.134543 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:50:52.134543 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 09:50:52.134543 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 09:50:52.134543 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 09:50:52.134543 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 09:50:52.134543 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:50:52.134543 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:50:52.134543 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:50:52.134543 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:50:52.139012 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1bc1a004-49b2-4b89-ba42-cddb661c7d94 could not be found. Sep 14 09:50:52.139012 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:50:52.139012 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:50:52.139012 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:50:52.139012 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:50:52.139012 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:50:52.139012 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:50:52.139012 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:50:52.139012 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:50:52.139012 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1bc1a004-49b2-4b89-ba42-cddb661c7d94 could not be found. Sep 14 09:50:52.139012 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:50:52.139012 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-de802ac5-7878-4c42-82df-d525528bfadb tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Returning 404 to user: Instance 1bc1a004-49b2-4b89-ba42-cddb661c7d94 could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:50:52.139012 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-de802ac5-7878-4c42-82df-d525528bfadb tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "DELETE /compute/v2.1/servers/1bc1a004-49b2-4b89-ba42-cddb661c7d94" status: 404 len: 111 microversion: 2.1 time: 0.029657 Sep 14 09:50:52.139012 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3811/7135] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:50:52 2022] DELETE /compute/v2.1/servers/1bc1a004-49b2-4b89-ba42-cddb661c7d94 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 14 09:50:52.144255 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-85b6e7f8-b515-4cec-8efd-0d2d80f4b3aa tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:50:52.144867 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-85b6e7f8-b515-4cec-8efd-0d2d80f4b3aa tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] [instance: 1bc1a004-49b2-4b89-ba42-cddb661c7d94] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:50:52.150796 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-85b6e7f8-b515-4cec-8efd-0d2d80f4b3aa tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:50:52.151258 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-85b6e7f8-b515-4cec-8efd-0d2d80f4b3aa tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:50:52.151702 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-85b6e7f8-b515-4cec-8efd-0d2d80f4b3aa tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:50:52.152391 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-85b6e7f8-b515-4cec-8efd-0d2d80f4b3aa tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:50:52.152849 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-85b6e7f8-b515-4cec-8efd-0d2d80f4b3aa tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:50:52.153282 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-85b6e7f8-b515-4cec-8efd-0d2d80f4b3aa tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:50:52.167493 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-85b6e7f8-b515-4cec-8efd-0d2d80f4b3aa tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] HTTP exception thrown: Instance 1bc1a004-49b2-4b89-ba42-cddb661c7d94 could not be found. Sep 14 09:50:52.169020 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-85b6e7f8-b515-4cec-8efd-0d2d80f4b3aa tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Request method failure captured: Sep 14 09:50:52.169020 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/1bc1a004-49b2-4b89-ba42-cddb661c7d94 HTTP/1.1 Sep 14 09:50:52.169020 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:50:52.169020 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:50:52.169020 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:50:52.169020 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:50:52.169020 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:50:52.169020 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:50:52.169020 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:50:52.169020 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:50:52.169020 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIaKBrBAh_wj7DfZiRKdrZ6pB2BVsnaFIACH9I9tnPwlUsTvBKg4Km-70hzyiQAJmR8uMyCC--Kmi_m3mCvjQEmAIcuX7dXHviBWfEEzRkbjLifKvzwHyNal8H1sdEC_eoJmfTTtUV4zMyNBM3to2Z7TJSY3tl0h8kAHjt5BuvlhekYs Sep 14 09:50:52.169020 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:50:52.169020 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:50:52.169020 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:50:52.169020 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:50:52.169020 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:50:52.169020 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:50:52.169020 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 270f637ba197498bb4f7fa1ba14a62ad Sep 14 09:50:52.169020 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ServerActionsTestJSON-1037640335 Sep 14 09:50:52.169020 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:50:52.169020 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:50:52.169020 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/270f637ba197498bb4f7fa1ba14a62ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_270f637ba197498bb4f7fa1ba14a62ad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/270f637ba197498bb4f7fa1ba14a62ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/270f637ba197498bb4f7fa1ba14a62ad"}]}] Sep 14 09:50:52.169020 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ServerActionsTestJSON-1037640335 Sep 14 09:50:52.169020 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 270f637ba197498bb4f7fa1ba14a62ad Sep 14 09:50:52.169020 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ServerActionsTestJSON-1037640335 Sep 14 09:50:52.169020 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ServerActionsTestJSON-1037640335-project Sep 14 09:50:52.169020 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:50:52.169020 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:50:52.169020 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 5de83b9937f145dbbe1091039327e71a Sep 14 09:50:52.169020 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ServerActionsTestJSON-1037640335-project Sep 14 09:50:52.169020 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:50:52.169020 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance 1bc1a004-49b2-4b89-ba42-cddb661c7d94 could not be found. Sep 14 09:50:52.169020 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '1bc1a004-49b2-4b89-ba42-cddb661c7d94'} Sep 14 09:50:52.169020 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:50:52.169020 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:50:52.169020 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:50:52.169020 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:50:52.169020 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:50:52.169020 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:50:52.169020 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:50:52.169020 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:50:52.169020 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:50:52.169020 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:50:52.169020 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1bc1a004-49b2-4b89-ba42-cddb661c7d94 could not be found. Sep 14 09:50:52.169020 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:50:52.169020 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:50:52.169020 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:50:52.169020 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:50:52.169020 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:50:52.169020 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:50:52.169020 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:50:52.169020 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:50:52.169020 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:50:52.169020 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:50:52.169020 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:50:52.169020 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:50:52.169020 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:50:52.169020 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:50:52.169020 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:50:52.169020 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:50:52.169020 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1bc1a004-49b2-4b89-ba42-cddb661c7d94 could not be found. Sep 14 09:50:52.169020 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:50:52.169020 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:50:52.169020 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:50:52.173617 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:50:52.173617 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:50:52.173617 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:50:52.173617 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:50:52.173617 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:50:52.173617 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1bc1a004-49b2-4b89-ba42-cddb661c7d94 could not be found. Sep 14 09:50:52.173617 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:50:52.173617 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-85b6e7f8-b515-4cec-8efd-0d2d80f4b3aa tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Returning 404 to user: Instance 1bc1a004-49b2-4b89-ba42-cddb661c7d94 could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:50:52.173617 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-85b6e7f8-b515-4cec-8efd-0d2d80f4b3aa tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "GET /compute/v2.1/servers/1bc1a004-49b2-4b89-ba42-cddb661c7d94" status: 404 len: 111 microversion: 2.1 time: 0.030417 Sep 14 09:50:52.173617 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3812/7136] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:50:52 2022] GET /compute/v2.1/servers/1bc1a004-49b2-4b89-ba42-cddb661c7d94 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 14 09:50:52.179735 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a614ca3a-e7f3-41e9-bbc5-589fab1e1e45 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] Calling method '.version_select at 0x7f7d3fc9d8b0>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:50:52.203432 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a614ca3a-e7f3-41e9-bbc5-589fab1e1e45 tempest-ServerActionsTestJSON-1037640335 tempest-ServerActionsTestJSON-1037640335-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-254910026" status: 202 len: 0 microversion: 2.1 time: 0.027631 Sep 14 09:50:52.204018 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3813/7137] 10.222.0.60 () {58 vars in 1218 bytes} [Wed Sep 14 09:50:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-254910026 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:51:01.727279 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-38552aa2-85f1-4648-98ea-5330e0b0c1cb tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1437778439", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "networks": [{"uuid": "787f6139-3e36-4840-b138-23d5af602651"}]}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:51:01.785119 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.network.neutron [None req-38552aa2-85f1-4648-98ea-5330e0b0c1cb tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] validate_networks() for [('787f6139-3e36-4840-b138-23d5af602651', None, None, None, None, None)] {{(pid=128759) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:51:02.157820 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=48 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:51:02.184777 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-38552aa2-85f1-4648-98ea-5330e0b0c1cb tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Flavor limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:51:02.185211 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-38552aa2-85f1-4648-98ea-5330e0b0c1cb tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Image limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:51:02.185696 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-38552aa2-85f1-4648-98ea-5330e0b0c1cb tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Flavor pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:51:02.186118 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-38552aa2-85f1-4648-98ea-5330e0b0c1cb tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Image pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:51:02.186582 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-38552aa2-85f1-4648-98ea-5330e0b0c1cb tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:51:02.201068 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-38552aa2-85f1-4648-98ea-5330e0b0c1cb tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:02.201571 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-38552aa2-85f1-4648-98ea-5330e0b0c1cb tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:02.202020 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-38552aa2-85f1-4648-98ea-5330e0b0c1cb tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:02.202796 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-38552aa2-85f1-4648-98ea-5330e0b0c1cb tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:02.203327 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-38552aa2-85f1-4648-98ea-5330e0b0c1cb tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:02.203758 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-38552aa2-85f1-4648-98ea-5330e0b0c1cb tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:02.222117 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-38552aa2-85f1-4648-98ea-5330e0b0c1cb tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Getting quotas for project 20cd39db14bb442f828650bd4a7ffe94. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:51:02.227590 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-38552aa2-85f1-4648-98ea-5330e0b0c1cb tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Getting quotas for user 06b0591e5bf74eb58078fa987baa6163 and project 20cd39db14bb442f828650bd4a7ffe94. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:51:02.240987 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-38552aa2-85f1-4648-98ea-5330e0b0c1cb tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Going to run 1 instances... {{(pid=128759) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:51:02.243334 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-38552aa2-85f1-4648-98ea-5330e0b0c1cb tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] [instance: 4b8eb878-3321-4d5c-9bae-bab041b3fd5f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128759) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:51:02.290130 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-38552aa2-85f1-4648-98ea-5330e0b0c1cb tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.754330 Sep 14 09:51:02.290986 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3814/7138] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 09:51:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 756 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 14 09:51:02.302171 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-1ff7b375-8f7b-40af-b22c-081668ebee4e tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:51:02.303345 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-1ff7b375-8f7b-40af-b22c-081668ebee4e tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] [instance: 4b8eb878-3321-4d5c-9bae-bab041b3fd5f] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:51:02.331318 n-d-836830-18 devstack@n-api.service[128758]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 09:51:02.331804 n-d-836830-18 devstack@n-api.service[128758]: Wed Sep 14 09:51:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.60) !!! Sep 14 09:51:02.375251 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-1ff7b375-8f7b-40af-b22c-081668ebee4e tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b0591e5bf74eb58078fa987baa6163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cd39db14bb442f828650bd4a7ffe94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:51:02.385221 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-1ff7b375-8f7b-40af-b22c-081668ebee4e tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] 10.222.0.60 "GET /compute/v2.1/servers/4b8eb878-3321-4d5c-9bae-bab041b3fd5f" status: 200 len: 1217 microversion: 2.1 time: 0.086899 Sep 14 09:51:02.399435 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3815/7139] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:51:02 2022] GET /compute/v2.1/servers/4b8eb878-3321-4d5c-9bae-bab041b3fd5f => generated 1217 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:51:03.408051 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-68dc9973-5ed5-4d97-a0f8-0593861830e3 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:51:03.422231 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-68dc9973-5ed5-4d97-a0f8-0593861830e3 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] [instance: 4b8eb878-3321-4d5c-9bae-bab041b3fd5f] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:51:03.435782 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-68dc9973-5ed5-4d97-a0f8-0593861830e3 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:03.436294 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-68dc9973-5ed5-4d97-a0f8-0593861830e3 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:03.436742 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-68dc9973-5ed5-4d97-a0f8-0593861830e3 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:03.437466 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-68dc9973-5ed5-4d97-a0f8-0593861830e3 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:03.437929 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-68dc9973-5ed5-4d97-a0f8-0593861830e3 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:03.438362 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-68dc9973-5ed5-4d97-a0f8-0593861830e3 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:03.543855 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-68dc9973-5ed5-4d97-a0f8-0593861830e3 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b0591e5bf74eb58078fa987baa6163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cd39db14bb442f828650bd4a7ffe94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:51:03.553944 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-68dc9973-5ed5-4d97-a0f8-0593861830e3 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] 10.222.0.60 "GET /compute/v2.1/servers/4b8eb878-3321-4d5c-9bae-bab041b3fd5f" status: 200 len: 1275 microversion: 2.1 time: 0.149891 Sep 14 09:51:03.571842 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3816/7140] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:51:03 2022] GET /compute/v2.1/servers/4b8eb878-3321-4d5c-9bae-bab041b3fd5f => generated 1275 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:51:04.581022 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-4569d63c-e405-425e-9e66-2ef1305411dd tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:51:04.581503 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-4569d63c-e405-425e-9e66-2ef1305411dd tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] [instance: 4b8eb878-3321-4d5c-9bae-bab041b3fd5f] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:51:04.590756 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4569d63c-e405-425e-9e66-2ef1305411dd tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:04.591979 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4569d63c-e405-425e-9e66-2ef1305411dd tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:04.593404 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4569d63c-e405-425e-9e66-2ef1305411dd tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:04.594760 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4569d63c-e405-425e-9e66-2ef1305411dd tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:04.595675 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4569d63c-e405-425e-9e66-2ef1305411dd tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:04.597641 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4569d63c-e405-425e-9e66-2ef1305411dd tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:04.767895 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-4569d63c-e405-425e-9e66-2ef1305411dd tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b0591e5bf74eb58078fa987baa6163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cd39db14bb442f828650bd4a7ffe94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:51:04.777504 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-4569d63c-e405-425e-9e66-2ef1305411dd tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] 10.222.0.60 "GET /compute/v2.1/servers/4b8eb878-3321-4d5c-9bae-bab041b3fd5f" status: 200 len: 1317 microversion: 2.1 time: 0.201357 Sep 14 09:51:04.778485 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3817/7141] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:51:04 2022] GET /compute/v2.1/servers/4b8eb878-3321-4d5c-9bae-bab041b3fd5f => generated 1317 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:51:04.903651 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-7655d51f-863d-4c6f-bc6e-c9cd68750c8e req-ffec5e45-5a8b-4b21-9267-e69869855c0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b8eb878-3321-4d5c-9bae-bab041b3fd5f", "tag": "cb75f4e4-cb36-43c2-ba7c-700200392a1b"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:51:04.920781 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-7655d51f-863d-4c6f-bc6e-c9cd68750c8e req-ffec5e45-5a8b-4b21-9267-e69869855c0b service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:04.921805 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-7655d51f-863d-4c6f-bc6e-c9cd68750c8e req-ffec5e45-5a8b-4b21-9267-e69869855c0b service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:04.922310 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-7655d51f-863d-4c6f-bc6e-c9cd68750c8e req-ffec5e45-5a8b-4b21-9267-e69869855c0b service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:04.938401 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-7655d51f-863d-4c6f-bc6e-c9cd68750c8e req-ffec5e45-5a8b-4b21-9267-e69869855c0b service nova] Creating event network-changed:cb75f4e4-cb36-43c2-ba7c-700200392a1b for instance 4b8eb878-3321-4d5c-9bae-bab041b3fd5f on n-h2-836830-18 Sep 14 09:51:04.946859 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-7655d51f-863d-4c6f-bc6e-c9cd68750c8e req-ffec5e45-5a8b-4b21-9267-e69869855c0b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047830 Sep 14 09:51:04.947743 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3818/7142] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:51:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:51:05.802553 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-05668edc-ac4c-436b-96d9-825ce8337d94 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:51:05.803292 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-05668edc-ac4c-436b-96d9-825ce8337d94 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] [instance: 4b8eb878-3321-4d5c-9bae-bab041b3fd5f] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:51:05.810285 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-05668edc-ac4c-436b-96d9-825ce8337d94 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:05.810775 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-05668edc-ac4c-436b-96d9-825ce8337d94 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:05.811246 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-05668edc-ac4c-436b-96d9-825ce8337d94 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:05.811936 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-05668edc-ac4c-436b-96d9-825ce8337d94 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:05.812395 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-05668edc-ac4c-436b-96d9-825ce8337d94 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:05.812824 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-05668edc-ac4c-436b-96d9-825ce8337d94 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:05.944280 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-05668edc-ac4c-436b-96d9-825ce8337d94 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b0591e5bf74eb58078fa987baa6163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cd39db14bb442f828650bd4a7ffe94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:51:05.952283 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-05668edc-ac4c-436b-96d9-825ce8337d94 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] 10.222.0.60 "GET /compute/v2.1/servers/4b8eb878-3321-4d5c-9bae-bab041b3fd5f" status: 200 len: 1317 microversion: 2.1 time: 0.154110 Sep 14 09:51:05.952866 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3819/7143] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:51:05 2022] GET /compute/v2.1/servers/4b8eb878-3321-4d5c-9bae-bab041b3fd5f => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:51:06.975785 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-392527f1-b9eb-488c-a3a5-51081af23398 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:51:06.976444 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-392527f1-b9eb-488c-a3a5-51081af23398 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] [instance: 4b8eb878-3321-4d5c-9bae-bab041b3fd5f] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:51:06.983196 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-392527f1-b9eb-488c-a3a5-51081af23398 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:06.983690 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-392527f1-b9eb-488c-a3a5-51081af23398 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:06.984135 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-392527f1-b9eb-488c-a3a5-51081af23398 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:06.984831 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-392527f1-b9eb-488c-a3a5-51081af23398 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:06.985290 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-392527f1-b9eb-488c-a3a5-51081af23398 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:06.985725 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-392527f1-b9eb-488c-a3a5-51081af23398 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:07.119580 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-392527f1-b9eb-488c-a3a5-51081af23398 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b0591e5bf74eb58078fa987baa6163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cd39db14bb442f828650bd4a7ffe94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:51:07.127414 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-392527f1-b9eb-488c-a3a5-51081af23398 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] 10.222.0.60 "GET /compute/v2.1/servers/4b8eb878-3321-4d5c-9bae-bab041b3fd5f" status: 200 len: 1317 microversion: 2.1 time: 0.155562 Sep 14 09:51:07.127990 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3820/7144] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:51:06 2022] GET /compute/v2.1/servers/4b8eb878-3321-4d5c-9bae-bab041b3fd5f => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:51:08.149807 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-bc1a7abe-8699-402f-882a-cc1c40024660 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:51:08.150447 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-bc1a7abe-8699-402f-882a-cc1c40024660 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] [instance: 4b8eb878-3321-4d5c-9bae-bab041b3fd5f] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:51:08.157356 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bc1a7abe-8699-402f-882a-cc1c40024660 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:08.157851 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bc1a7abe-8699-402f-882a-cc1c40024660 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:08.158299 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bc1a7abe-8699-402f-882a-cc1c40024660 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:08.159029 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bc1a7abe-8699-402f-882a-cc1c40024660 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:08.159494 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bc1a7abe-8699-402f-882a-cc1c40024660 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:08.159951 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bc1a7abe-8699-402f-882a-cc1c40024660 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:08.288236 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-bc1a7abe-8699-402f-882a-cc1c40024660 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b0591e5bf74eb58078fa987baa6163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cd39db14bb442f828650bd4a7ffe94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:51:08.296043 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-bc1a7abe-8699-402f-882a-cc1c40024660 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] 10.222.0.60 "GET /compute/v2.1/servers/4b8eb878-3321-4d5c-9bae-bab041b3fd5f" status: 200 len: 1317 microversion: 2.1 time: 0.150282 Sep 14 09:51:08.296623 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3821/7145] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:51:08 2022] GET /compute/v2.1/servers/4b8eb878-3321-4d5c-9bae-bab041b3fd5f => generated 1317 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:51:09.318886 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8977b00a-c08e-464b-8c3a-3ee02e2e0cc6 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:51:09.319700 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-8977b00a-c08e-464b-8c3a-3ee02e2e0cc6 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] [instance: 4b8eb878-3321-4d5c-9bae-bab041b3fd5f] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:51:09.326277 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8977b00a-c08e-464b-8c3a-3ee02e2e0cc6 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:09.326761 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8977b00a-c08e-464b-8c3a-3ee02e2e0cc6 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:09.327225 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8977b00a-c08e-464b-8c3a-3ee02e2e0cc6 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:09.327911 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8977b00a-c08e-464b-8c3a-3ee02e2e0cc6 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:09.328359 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8977b00a-c08e-464b-8c3a-3ee02e2e0cc6 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:09.328781 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8977b00a-c08e-464b-8c3a-3ee02e2e0cc6 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:09.462262 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-8977b00a-c08e-464b-8c3a-3ee02e2e0cc6 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b0591e5bf74eb58078fa987baa6163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cd39db14bb442f828650bd4a7ffe94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:51:09.470163 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-8977b00a-c08e-464b-8c3a-3ee02e2e0cc6 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] 10.222.0.60 "GET /compute/v2.1/servers/4b8eb878-3321-4d5c-9bae-bab041b3fd5f" status: 200 len: 1317 microversion: 2.1 time: 0.155484 Sep 14 09:51:09.470733 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3822/7146] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:51:09 2022] GET /compute/v2.1/servers/4b8eb878-3321-4d5c-9bae-bab041b3fd5f => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:51:09.869127 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-fae0fde5-da20-431e-80c2-25f205f0e7db req-77ca7fd7-5d85-449c-b25f-f06781fea051 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b8eb878-3321-4d5c-9bae-bab041b3fd5f", "name": "network-vif-plugged", "status": "completed", "tag": "cb75f4e4-cb36-43c2-ba7c-700200392a1b"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:51:09.879102 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-fae0fde5-da20-431e-80c2-25f205f0e7db req-77ca7fd7-5d85-449c-b25f-f06781fea051 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:09.879589 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-fae0fde5-da20-431e-80c2-25f205f0e7db req-77ca7fd7-5d85-449c-b25f-f06781fea051 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:09.880020 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-fae0fde5-da20-431e-80c2-25f205f0e7db req-77ca7fd7-5d85-449c-b25f-f06781fea051 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:09.891688 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-fae0fde5-da20-431e-80c2-25f205f0e7db req-77ca7fd7-5d85-449c-b25f-f06781fea051 service nova] Creating event network-vif-plugged:cb75f4e4-cb36-43c2-ba7c-700200392a1b for instance 4b8eb878-3321-4d5c-9bae-bab041b3fd5f on n-h2-836830-18 Sep 14 09:51:09.896769 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-fae0fde5-da20-431e-80c2-25f205f0e7db req-77ca7fd7-5d85-449c-b25f-f06781fea051 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032185 Sep 14 09:51:09.897471 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3823/7147] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:51:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:51:10.495310 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-0d0517ff-d03d-4829-bfca-3f199c582037 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:51:10.496036 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-0d0517ff-d03d-4829-bfca-3f199c582037 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] [instance: 4b8eb878-3321-4d5c-9bae-bab041b3fd5f] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:51:10.502284 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0d0517ff-d03d-4829-bfca-3f199c582037 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:10.502772 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0d0517ff-d03d-4829-bfca-3f199c582037 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:10.503252 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0d0517ff-d03d-4829-bfca-3f199c582037 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:10.503945 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0d0517ff-d03d-4829-bfca-3f199c582037 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:10.504407 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0d0517ff-d03d-4829-bfca-3f199c582037 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:10.504838 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0d0517ff-d03d-4829-bfca-3f199c582037 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:10.636478 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-0d0517ff-d03d-4829-bfca-3f199c582037 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b0591e5bf74eb58078fa987baa6163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cd39db14bb442f828650bd4a7ffe94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:51:10.644200 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-0d0517ff-d03d-4829-bfca-3f199c582037 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] 10.222.0.60 "GET /compute/v2.1/servers/4b8eb878-3321-4d5c-9bae-bab041b3fd5f" status: 200 len: 1317 microversion: 2.1 time: 0.154540 Sep 14 09:51:10.644779 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3824/7148] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:51:10 2022] GET /compute/v2.1/servers/4b8eb878-3321-4d5c-9bae-bab041b3fd5f => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:51:11.667282 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-955ba7c1-472e-4f9f-b809-1025d6bd8d86 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:51:11.667911 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-955ba7c1-472e-4f9f-b809-1025d6bd8d86 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] [instance: 4b8eb878-3321-4d5c-9bae-bab041b3fd5f] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:51:11.674894 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-955ba7c1-472e-4f9f-b809-1025d6bd8d86 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:11.675420 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-955ba7c1-472e-4f9f-b809-1025d6bd8d86 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:11.675861 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-955ba7c1-472e-4f9f-b809-1025d6bd8d86 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:11.676556 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-955ba7c1-472e-4f9f-b809-1025d6bd8d86 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:11.677016 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-955ba7c1-472e-4f9f-b809-1025d6bd8d86 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:11.677449 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-955ba7c1-472e-4f9f-b809-1025d6bd8d86 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:11.809488 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-955ba7c1-472e-4f9f-b809-1025d6bd8d86 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b0591e5bf74eb58078fa987baa6163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cd39db14bb442f828650bd4a7ffe94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:51:11.817265 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-955ba7c1-472e-4f9f-b809-1025d6bd8d86 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] 10.222.0.60 "GET /compute/v2.1/servers/4b8eb878-3321-4d5c-9bae-bab041b3fd5f" status: 200 len: 1506 microversion: 2.1 time: 0.153999 Sep 14 09:51:11.818356 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3825/7149] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:51:11 2022] GET /compute/v2.1/servers/4b8eb878-3321-4d5c-9bae-bab041b3fd5f => generated 1506 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:51:11.878383 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-79641875-64aa-4c2f-b648-fe125b3c8c11 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1777322002", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "networks": [{"uuid": "787f6139-3e36-4840-b138-23d5af602651"}]}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:51:11.930840 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.network.neutron [None req-79641875-64aa-4c2f-b648-fe125b3c8c11 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] validate_networks() for [('787f6139-3e36-4840-b138-23d5af602651', None, None, None, None, None)] {{(pid=128759) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:51:12.211894 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=2 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:51:12.299683 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-79641875-64aa-4c2f-b648-fe125b3c8c11 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Flavor limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:51:12.300110 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-79641875-64aa-4c2f-b648-fe125b3c8c11 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Image limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:51:12.300588 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-79641875-64aa-4c2f-b648-fe125b3c8c11 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Flavor pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:51:12.301003 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-79641875-64aa-4c2f-b648-fe125b3c8c11 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Image pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:51:12.301417 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-79641875-64aa-4c2f-b648-fe125b3c8c11 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:51:12.310711 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-79641875-64aa-4c2f-b648-fe125b3c8c11 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:12.311223 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-79641875-64aa-4c2f-b648-fe125b3c8c11 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:12.311661 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-79641875-64aa-4c2f-b648-fe125b3c8c11 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:12.312390 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-79641875-64aa-4c2f-b648-fe125b3c8c11 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:12.312855 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-79641875-64aa-4c2f-b648-fe125b3c8c11 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:12.313279 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-79641875-64aa-4c2f-b648-fe125b3c8c11 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:12.330479 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-79641875-64aa-4c2f-b648-fe125b3c8c11 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Getting quotas for project 20cd39db14bb442f828650bd4a7ffe94. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:51:12.335703 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-79641875-64aa-4c2f-b648-fe125b3c8c11 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Getting quotas for user 06b0591e5bf74eb58078fa987baa6163 and project 20cd39db14bb442f828650bd4a7ffe94. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:51:12.348354 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-79641875-64aa-4c2f-b648-fe125b3c8c11 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Going to run 1 instances... {{(pid=128759) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:51:12.351147 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-79641875-64aa-4c2f-b648-fe125b3c8c11 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] [instance: d9e40505-7817-4f32-a74e-add41b39dd8b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128759) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:51:12.398246 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-79641875-64aa-4c2f-b648-fe125b3c8c11 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.523648 Sep 14 09:51:12.398810 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3826/7150] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 09:51:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 525 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 14 09:51:12.409854 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-abc294a6-68b7-4cf3-b048-4dc7425bb33a tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:51:12.410474 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-abc294a6-68b7-4cf3-b048-4dc7425bb33a tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] [instance: d9e40505-7817-4f32-a74e-add41b39dd8b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:51:12.463575 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-abc294a6-68b7-4cf3-b048-4dc7425bb33a tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b0591e5bf74eb58078fa987baa6163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cd39db14bb442f828650bd4a7ffe94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:51:12.471624 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-abc294a6-68b7-4cf3-b048-4dc7425bb33a tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] 10.222.0.60 "GET /compute/v2.1/servers/d9e40505-7817-4f32-a74e-add41b39dd8b" status: 200 len: 1217 microversion: 2.1 time: 0.065535 Sep 14 09:51:12.472202 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3827/7151] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:51:12 2022] GET /compute/v2.1/servers/d9e40505-7817-4f32-a74e-add41b39dd8b => generated 1217 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:51:13.495861 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-349d9d20-772b-420f-b179-294b79187f51 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:51:13.496499 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-349d9d20-772b-420f-b179-294b79187f51 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] [instance: d9e40505-7817-4f32-a74e-add41b39dd8b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:51:13.504177 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-349d9d20-772b-420f-b179-294b79187f51 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:13.504677 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-349d9d20-772b-420f-b179-294b79187f51 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:13.505126 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-349d9d20-772b-420f-b179-294b79187f51 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:13.506003 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-349d9d20-772b-420f-b179-294b79187f51 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:13.506468 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-349d9d20-772b-420f-b179-294b79187f51 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:13.507022 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-349d9d20-772b-420f-b179-294b79187f51 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:13.580944 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-349d9d20-772b-420f-b179-294b79187f51 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b0591e5bf74eb58078fa987baa6163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cd39db14bb442f828650bd4a7ffe94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:51:13.590514 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-349d9d20-772b-420f-b179-294b79187f51 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] 10.222.0.60 "GET /compute/v2.1/servers/d9e40505-7817-4f32-a74e-add41b39dd8b" status: 200 len: 1269 microversion: 2.1 time: 0.098670 Sep 14 09:51:13.594372 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3828/7152] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:51:13 2022] GET /compute/v2.1/servers/d9e40505-7817-4f32-a74e-add41b39dd8b => generated 1269 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:51:14.615166 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d0c59971-74fc-4c9d-872e-fc5daf9f1344 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:51:14.618727 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-d0c59971-74fc-4c9d-872e-fc5daf9f1344 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] [instance: d9e40505-7817-4f32-a74e-add41b39dd8b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:51:14.625387 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d0c59971-74fc-4c9d-872e-fc5daf9f1344 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:14.625883 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d0c59971-74fc-4c9d-872e-fc5daf9f1344 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:14.626327 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d0c59971-74fc-4c9d-872e-fc5daf9f1344 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:14.627056 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d0c59971-74fc-4c9d-872e-fc5daf9f1344 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:14.627519 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d0c59971-74fc-4c9d-872e-fc5daf9f1344 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:14.627948 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d0c59971-74fc-4c9d-872e-fc5daf9f1344 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:14.765565 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-d0c59971-74fc-4c9d-872e-fc5daf9f1344 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b0591e5bf74eb58078fa987baa6163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cd39db14bb442f828650bd4a7ffe94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:51:14.773574 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d0c59971-74fc-4c9d-872e-fc5daf9f1344 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] 10.222.0.60 "GET /compute/v2.1/servers/d9e40505-7817-4f32-a74e-add41b39dd8b" status: 200 len: 1317 microversion: 2.1 time: 0.162879 Sep 14 09:51:14.774238 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3829/7153] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:51:14 2022] GET /compute/v2.1/servers/d9e40505-7817-4f32-a74e-add41b39dd8b => generated 1317 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:51:14.910387 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-c02358ad-f2c5-4b52-b53f-3e009fad15e2 req-cc91ddc1-54b4-4cbb-8e02-ee86b1e834ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9e40505-7817-4f32-a74e-add41b39dd8b", "tag": "af25b942-06ec-4077-bbf0-c16d0e4305ef"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:51:14.922392 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-c02358ad-f2c5-4b52-b53f-3e009fad15e2 req-cc91ddc1-54b4-4cbb-8e02-ee86b1e834ea service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:14.922998 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-c02358ad-f2c5-4b52-b53f-3e009fad15e2 req-cc91ddc1-54b4-4cbb-8e02-ee86b1e834ea service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:14.923523 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-c02358ad-f2c5-4b52-b53f-3e009fad15e2 req-cc91ddc1-54b4-4cbb-8e02-ee86b1e834ea service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:14.942029 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-c02358ad-f2c5-4b52-b53f-3e009fad15e2 req-cc91ddc1-54b4-4cbb-8e02-ee86b1e834ea service nova] Creating event network-changed:af25b942-06ec-4077-bbf0-c16d0e4305ef for instance d9e40505-7817-4f32-a74e-add41b39dd8b on n-h1-836830-18 Sep 14 09:51:14.947498 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-c02358ad-f2c5-4b52-b53f-3e009fad15e2 req-cc91ddc1-54b4-4cbb-8e02-ee86b1e834ea service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040784 Sep 14 09:51:14.948329 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3830/7154] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:51:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:51:15.798981 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-6a16ed2e-6b80-4cc5-afec-6f8289701892 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:51:15.799730 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-6a16ed2e-6b80-4cc5-afec-6f8289701892 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] [instance: d9e40505-7817-4f32-a74e-add41b39dd8b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:51:15.801664 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:51:15.808137 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6a16ed2e-6b80-4cc5-afec-6f8289701892 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:15.808631 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6a16ed2e-6b80-4cc5-afec-6f8289701892 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:15.809077 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6a16ed2e-6b80-4cc5-afec-6f8289701892 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:15.809774 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6a16ed2e-6b80-4cc5-afec-6f8289701892 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:15.810236 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6a16ed2e-6b80-4cc5-afec-6f8289701892 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:15.810668 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6a16ed2e-6b80-4cc5-afec-6f8289701892 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:15.942168 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-6a16ed2e-6b80-4cc5-afec-6f8289701892 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b0591e5bf74eb58078fa987baa6163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cd39db14bb442f828650bd4a7ffe94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:51:15.950386 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-6a16ed2e-6b80-4cc5-afec-6f8289701892 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] 10.222.0.60 "GET /compute/v2.1/servers/d9e40505-7817-4f32-a74e-add41b39dd8b" status: 200 len: 1317 microversion: 2.1 time: 0.156616 Sep 14 09:51:15.950972 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3831/7155] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:51:15 2022] GET /compute/v2.1/servers/d9e40505-7817-4f32-a74e-add41b39dd8b => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:51:16.973351 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b94d8927-bda8-4dc2-b732-a09360cedb6c tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:51:16.973973 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b94d8927-bda8-4dc2-b732-a09360cedb6c tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] [instance: d9e40505-7817-4f32-a74e-add41b39dd8b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:51:16.980742 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b94d8927-bda8-4dc2-b732-a09360cedb6c tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:16.981231 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b94d8927-bda8-4dc2-b732-a09360cedb6c tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:16.981673 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b94d8927-bda8-4dc2-b732-a09360cedb6c tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:16.982370 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b94d8927-bda8-4dc2-b732-a09360cedb6c tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:16.982826 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b94d8927-bda8-4dc2-b732-a09360cedb6c tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:16.983291 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b94d8927-bda8-4dc2-b732-a09360cedb6c tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:17.159061 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b94d8927-bda8-4dc2-b732-a09360cedb6c tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b0591e5bf74eb58078fa987baa6163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cd39db14bb442f828650bd4a7ffe94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:51:17.167265 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b94d8927-bda8-4dc2-b732-a09360cedb6c tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] 10.222.0.60 "GET /compute/v2.1/servers/d9e40505-7817-4f32-a74e-add41b39dd8b" status: 200 len: 1317 microversion: 2.1 time: 0.197904 Sep 14 09:51:17.167846 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3832/7156] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:51:16 2022] GET /compute/v2.1/servers/d9e40505-7817-4f32-a74e-add41b39dd8b => generated 1317 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:51:18.189656 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-be95e814-d290-4645-8f73-e3085c768b8a tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:51:18.190283 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-be95e814-d290-4645-8f73-e3085c768b8a tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] [instance: d9e40505-7817-4f32-a74e-add41b39dd8b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:51:18.197791 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-be95e814-d290-4645-8f73-e3085c768b8a tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:18.198288 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-be95e814-d290-4645-8f73-e3085c768b8a tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:18.198730 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-be95e814-d290-4645-8f73-e3085c768b8a tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:18.199448 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-be95e814-d290-4645-8f73-e3085c768b8a tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:18.199907 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-be95e814-d290-4645-8f73-e3085c768b8a tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:18.200332 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-be95e814-d290-4645-8f73-e3085c768b8a tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:18.335192 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-be95e814-d290-4645-8f73-e3085c768b8a tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b0591e5bf74eb58078fa987baa6163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cd39db14bb442f828650bd4a7ffe94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:51:18.342866 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-be95e814-d290-4645-8f73-e3085c768b8a tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] 10.222.0.60 "GET /compute/v2.1/servers/d9e40505-7817-4f32-a74e-add41b39dd8b" status: 200 len: 1317 microversion: 2.1 time: 0.157115 Sep 14 09:51:18.343748 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3833/7157] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:51:18 2022] GET /compute/v2.1/servers/d9e40505-7817-4f32-a74e-add41b39dd8b => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:51:19.366357 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9ad637ee-9855-4ca6-ace4-42c3166ab88b tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:51:19.367047 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-9ad637ee-9855-4ca6-ace4-42c3166ab88b tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] [instance: d9e40505-7817-4f32-a74e-add41b39dd8b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:51:19.373865 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9ad637ee-9855-4ca6-ace4-42c3166ab88b tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:19.374512 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9ad637ee-9855-4ca6-ace4-42c3166ab88b tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:19.374790 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9ad637ee-9855-4ca6-ace4-42c3166ab88b tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:19.375823 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9ad637ee-9855-4ca6-ace4-42c3166ab88b tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:19.376051 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9ad637ee-9855-4ca6-ace4-42c3166ab88b tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:19.376539 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9ad637ee-9855-4ca6-ace4-42c3166ab88b tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:19.513108 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-9ad637ee-9855-4ca6-ace4-42c3166ab88b tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b0591e5bf74eb58078fa987baa6163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cd39db14bb442f828650bd4a7ffe94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:51:19.521350 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-9ad637ee-9855-4ca6-ace4-42c3166ab88b tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] 10.222.0.60 "GET /compute/v2.1/servers/d9e40505-7817-4f32-a74e-add41b39dd8b" status: 200 len: 1317 microversion: 2.1 time: 0.158970 Sep 14 09:51:19.521933 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3834/7158] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:51:19 2022] GET /compute/v2.1/servers/d9e40505-7817-4f32-a74e-add41b39dd8b => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:51:20.545056 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-60b102e3-82b1-4f4b-be0f-a8f18179dade tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:51:20.545710 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-60b102e3-82b1-4f4b-be0f-a8f18179dade tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] [instance: d9e40505-7817-4f32-a74e-add41b39dd8b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:51:20.552982 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-60b102e3-82b1-4f4b-be0f-a8f18179dade tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:20.553465 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-60b102e3-82b1-4f4b-be0f-a8f18179dade tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:20.553921 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-60b102e3-82b1-4f4b-be0f-a8f18179dade tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:20.554603 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-60b102e3-82b1-4f4b-be0f-a8f18179dade tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:20.555077 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-60b102e3-82b1-4f4b-be0f-a8f18179dade tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:20.555503 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-60b102e3-82b1-4f4b-be0f-a8f18179dade tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:20.688043 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-60b102e3-82b1-4f4b-be0f-a8f18179dade tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b0591e5bf74eb58078fa987baa6163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cd39db14bb442f828650bd4a7ffe94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:51:20.691507 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=100 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:51:20.696963 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-60b102e3-82b1-4f4b-be0f-a8f18179dade tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] 10.222.0.60 "GET /compute/v2.1/servers/d9e40505-7817-4f32-a74e-add41b39dd8b" status: 200 len: 1317 microversion: 2.1 time: 0.155755 Sep 14 09:51:20.697544 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3835/7159] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:51:20 2022] GET /compute/v2.1/servers/d9e40505-7817-4f32-a74e-add41b39dd8b => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:51:21.527608 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-c07e671b-ea7d-4d55-b6e6-cf3a89f36f13 req-23e20418-1f4a-4d61-a401-8a0043fe686c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9e40505-7817-4f32-a74e-add41b39dd8b", "name": "network-vif-plugged", "status": "completed", "tag": "af25b942-06ec-4077-bbf0-c16d0e4305ef"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:51:21.539720 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-c07e671b-ea7d-4d55-b6e6-cf3a89f36f13 req-23e20418-1f4a-4d61-a401-8a0043fe686c service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:21.540218 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-c07e671b-ea7d-4d55-b6e6-cf3a89f36f13 req-23e20418-1f4a-4d61-a401-8a0043fe686c service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:21.540656 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-c07e671b-ea7d-4d55-b6e6-cf3a89f36f13 req-23e20418-1f4a-4d61-a401-8a0043fe686c service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:21.552546 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-c07e671b-ea7d-4d55-b6e6-cf3a89f36f13 req-23e20418-1f4a-4d61-a401-8a0043fe686c service nova] Creating event network-vif-plugged:af25b942-06ec-4077-bbf0-c16d0e4305ef for instance d9e40505-7817-4f32-a74e-add41b39dd8b on n-h1-836830-18 Sep 14 09:51:21.558443 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-c07e671b-ea7d-4d55-b6e6-cf3a89f36f13 req-23e20418-1f4a-4d61-a401-8a0043fe686c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034301 Sep 14 09:51:21.558911 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3836/7160] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:51:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:51:21.720863 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-1451b4d2-6bc7-446e-a940-c8ac18da9c59 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:51:21.721634 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-1451b4d2-6bc7-446e-a940-c8ac18da9c59 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] [instance: d9e40505-7817-4f32-a74e-add41b39dd8b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:51:21.727810 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1451b4d2-6bc7-446e-a940-c8ac18da9c59 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:21.728301 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1451b4d2-6bc7-446e-a940-c8ac18da9c59 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:21.728746 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1451b4d2-6bc7-446e-a940-c8ac18da9c59 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:21.729446 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1451b4d2-6bc7-446e-a940-c8ac18da9c59 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:21.729907 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1451b4d2-6bc7-446e-a940-c8ac18da9c59 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:21.730339 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1451b4d2-6bc7-446e-a940-c8ac18da9c59 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:21.857819 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-1451b4d2-6bc7-446e-a940-c8ac18da9c59 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b0591e5bf74eb58078fa987baa6163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cd39db14bb442f828650bd4a7ffe94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:51:21.865976 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-1451b4d2-6bc7-446e-a940-c8ac18da9c59 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] 10.222.0.60 "GET /compute/v2.1/servers/d9e40505-7817-4f32-a74e-add41b39dd8b" status: 200 len: 1317 microversion: 2.1 time: 0.149674 Sep 14 09:51:21.866553 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3837/7161] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:51:21 2022] GET /compute/v2.1/servers/d9e40505-7817-4f32-a74e-add41b39dd8b => generated 1317 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:51:22.889690 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-7cdeebfd-1d66-489f-9a8c-9fd75894afc1 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:51:22.890313 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-7cdeebfd-1d66-489f-9a8c-9fd75894afc1 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] [instance: d9e40505-7817-4f32-a74e-add41b39dd8b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:51:22.892328 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=2 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:51:22.893021 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=16 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:51:22.899748 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7cdeebfd-1d66-489f-9a8c-9fd75894afc1 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:22.900230 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7cdeebfd-1d66-489f-9a8c-9fd75894afc1 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:22.900670 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7cdeebfd-1d66-489f-9a8c-9fd75894afc1 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:22.901357 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7cdeebfd-1d66-489f-9a8c-9fd75894afc1 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:22.901807 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7cdeebfd-1d66-489f-9a8c-9fd75894afc1 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:22.902226 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7cdeebfd-1d66-489f-9a8c-9fd75894afc1 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:23.031075 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-7cdeebfd-1d66-489f-9a8c-9fd75894afc1 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b0591e5bf74eb58078fa987baa6163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cd39db14bb442f828650bd4a7ffe94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:51:23.039462 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-7cdeebfd-1d66-489f-9a8c-9fd75894afc1 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] 10.222.0.60 "GET /compute/v2.1/servers/d9e40505-7817-4f32-a74e-add41b39dd8b" status: 200 len: 1317 microversion: 2.1 time: 0.153701 Sep 14 09:51:23.040040 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3838/7162] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:51:22 2022] GET /compute/v2.1/servers/d9e40505-7817-4f32-a74e-add41b39dd8b => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:51:24.061842 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8cec0810-b4f3-4e27-ad82-30ef65131f83 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:51:24.062512 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-8cec0810-b4f3-4e27-ad82-30ef65131f83 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] [instance: d9e40505-7817-4f32-a74e-add41b39dd8b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:51:24.069004 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8cec0810-b4f3-4e27-ad82-30ef65131f83 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:24.069511 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8cec0810-b4f3-4e27-ad82-30ef65131f83 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:24.069952 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8cec0810-b4f3-4e27-ad82-30ef65131f83 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:24.070645 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8cec0810-b4f3-4e27-ad82-30ef65131f83 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:24.071130 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8cec0810-b4f3-4e27-ad82-30ef65131f83 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:24.071562 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8cec0810-b4f3-4e27-ad82-30ef65131f83 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:24.204571 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-8cec0810-b4f3-4e27-ad82-30ef65131f83 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b0591e5bf74eb58078fa987baa6163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cd39db14bb442f828650bd4a7ffe94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:51:24.212903 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-8cec0810-b4f3-4e27-ad82-30ef65131f83 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] 10.222.0.60 "GET /compute/v2.1/servers/d9e40505-7817-4f32-a74e-add41b39dd8b" status: 200 len: 1506 microversion: 2.1 time: 0.155143 Sep 14 09:51:24.213484 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3839/7163] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:51:24 2022] GET /compute/v2.1/servers/d9e40505-7817-4f32-a74e-add41b39dd8b => generated 1506 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:51:24.235441 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-cf0baf02-245e-4188-ad35-27183a6d3274 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:51:24.235939 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-cf0baf02-245e-4188-ad35-27183a6d3274 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] [instance: d9e40505-7817-4f32-a74e-add41b39dd8b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:51:24.241520 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cf0baf02-245e-4188-ad35-27183a6d3274 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:24.242005 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cf0baf02-245e-4188-ad35-27183a6d3274 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:24.242442 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cf0baf02-245e-4188-ad35-27183a6d3274 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:24.243158 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cf0baf02-245e-4188-ad35-27183a6d3274 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:24.243616 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cf0baf02-245e-4188-ad35-27183a6d3274 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:24.244043 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cf0baf02-245e-4188-ad35-27183a6d3274 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:24.268130 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-cf0baf02-245e-4188-ad35-27183a6d3274 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] [instance: d9e40505-7817-4f32-a74e-add41b39dd8b] Going to try to terminate instance {{(pid=128759) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:51:24.349498 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-cf0baf02-245e-4188-ad35-27183a6d3274 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] 10.222.0.60 "DELETE /compute/v2.1/servers/d9e40505-7817-4f32-a74e-add41b39dd8b" status: 204 len: 0 microversion: 2.1 time: 0.116700 Sep 14 09:51:24.350137 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3840/7164] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:51:24 2022] DELETE /compute/v2.1/servers/d9e40505-7817-4f32-a74e-add41b39dd8b => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 14 09:51:24.359320 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-7a84c0c8-4cf2-4714-a31b-4f7471a34365 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:51:24.360020 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-7a84c0c8-4cf2-4714-a31b-4f7471a34365 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] [instance: d9e40505-7817-4f32-a74e-add41b39dd8b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:51:24.365862 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7a84c0c8-4cf2-4714-a31b-4f7471a34365 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:24.366343 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7a84c0c8-4cf2-4714-a31b-4f7471a34365 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:24.366781 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7a84c0c8-4cf2-4714-a31b-4f7471a34365 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:24.367515 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7a84c0c8-4cf2-4714-a31b-4f7471a34365 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:24.367966 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7a84c0c8-4cf2-4714-a31b-4f7471a34365 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:24.368406 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7a84c0c8-4cf2-4714-a31b-4f7471a34365 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:24.498750 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-7a84c0c8-4cf2-4714-a31b-4f7471a34365 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b0591e5bf74eb58078fa987baa6163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cd39db14bb442f828650bd4a7ffe94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:51:24.507966 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-7a84c0c8-4cf2-4714-a31b-4f7471a34365 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] 10.222.0.60 "GET /compute/v2.1/servers/d9e40505-7817-4f32-a74e-add41b39dd8b" status: 200 len: 1512 microversion: 2.1 time: 0.153158 Sep 14 09:51:24.508547 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3841/7165] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:51:24 2022] GET /compute/v2.1/servers/d9e40505-7817-4f32-a74e-add41b39dd8b => generated 1512 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:51:25.531282 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-81684903-3ada-4908-b1fd-462d7ee27d42 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:51:25.531936 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-81684903-3ada-4908-b1fd-462d7ee27d42 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] [instance: d9e40505-7817-4f32-a74e-add41b39dd8b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:51:25.539530 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-81684903-3ada-4908-b1fd-462d7ee27d42 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:25.540009 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-81684903-3ada-4908-b1fd-462d7ee27d42 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:25.540440 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-81684903-3ada-4908-b1fd-462d7ee27d42 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:25.541153 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-81684903-3ada-4908-b1fd-462d7ee27d42 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:25.541604 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-81684903-3ada-4908-b1fd-462d7ee27d42 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:25.542024 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-81684903-3ada-4908-b1fd-462d7ee27d42 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:25.674621 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-81684903-3ada-4908-b1fd-462d7ee27d42 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b0591e5bf74eb58078fa987baa6163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cd39db14bb442f828650bd4a7ffe94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:51:25.682685 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-81684903-3ada-4908-b1fd-462d7ee27d42 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] 10.222.0.60 "GET /compute/v2.1/servers/d9e40505-7817-4f32-a74e-add41b39dd8b" status: 200 len: 1512 microversion: 2.1 time: 0.155224 Sep 14 09:51:25.683697 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3842/7166] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:51:25 2022] GET /compute/v2.1/servers/d9e40505-7817-4f32-a74e-add41b39dd8b => generated 1512 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:51:26.397747 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-418ee04a-4ece-45a6-af13-0aa5273b9406 req-aba5bb85-158d-40b9-b16a-83c252c201c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9e40505-7817-4f32-a74e-add41b39dd8b", "name": "network-vif-deleted", "tag": "af25b942-06ec-4077-bbf0-c16d0e4305ef"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:51:26.410079 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-418ee04a-4ece-45a6-af13-0aa5273b9406 req-aba5bb85-158d-40b9-b16a-83c252c201c8 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:26.410720 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-418ee04a-4ece-45a6-af13-0aa5273b9406 req-aba5bb85-158d-40b9-b16a-83c252c201c8 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:26.422850 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-418ee04a-4ece-45a6-af13-0aa5273b9406 req-aba5bb85-158d-40b9-b16a-83c252c201c8 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:26.440139 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-418ee04a-4ece-45a6-af13-0aa5273b9406 req-aba5bb85-158d-40b9-b16a-83c252c201c8 service nova] Creating event network-vif-deleted:af25b942-06ec-4077-bbf0-c16d0e4305ef for instance d9e40505-7817-4f32-a74e-add41b39dd8b on n-h1-836830-18 Sep 14 09:51:26.446263 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-418ee04a-4ece-45a6-af13-0aa5273b9406 req-aba5bb85-158d-40b9-b16a-83c252c201c8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052766 Sep 14 09:51:26.447406 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3843/7167] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:51:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:51:26.706156 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-646ecfd8-ceeb-42e2-bd90-1d0b124f586b tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:51:26.706876 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-646ecfd8-ceeb-42e2-bd90-1d0b124f586b tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] [instance: d9e40505-7817-4f32-a74e-add41b39dd8b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:51:26.714372 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-646ecfd8-ceeb-42e2-bd90-1d0b124f586b tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:26.714863 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-646ecfd8-ceeb-42e2-bd90-1d0b124f586b tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:26.715339 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-646ecfd8-ceeb-42e2-bd90-1d0b124f586b tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:26.716033 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-646ecfd8-ceeb-42e2-bd90-1d0b124f586b tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:26.716494 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-646ecfd8-ceeb-42e2-bd90-1d0b124f586b tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:26.716921 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-646ecfd8-ceeb-42e2-bd90-1d0b124f586b tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:26.749729 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-646ecfd8-ceeb-42e2-bd90-1d0b124f586b tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:26.750213 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-646ecfd8-ceeb-42e2-bd90-1d0b124f586b tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:26.750652 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-646ecfd8-ceeb-42e2-bd90-1d0b124f586b tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:26.751131 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.objects.instance [None req-646ecfd8-ceeb-42e2-bd90-1d0b124f586b tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lazy-loading 'fault' on Instance uuid d9e40505-7817-4f32-a74e-add41b39dd8b {{(pid=128759) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:51:26.791812 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-646ecfd8-ceeb-42e2-bd90-1d0b124f586b tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b0591e5bf74eb58078fa987baa6163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cd39db14bb442f828650bd4a7ffe94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:51:26.799554 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-646ecfd8-ceeb-42e2-bd90-1d0b124f586b tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] 10.222.0.60 "GET /compute/v2.1/servers/d9e40505-7817-4f32-a74e-add41b39dd8b" status: 200 len: 1307 microversion: 2.1 time: 0.097630 Sep 14 09:51:26.800128 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3844/7168] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:51:26 2022] GET /compute/v2.1/servers/d9e40505-7817-4f32-a74e-add41b39dd8b => generated 1307 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:51:27.823894 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d428a275-399f-47e3-b02f-e0f518dff095 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:51:27.824593 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-d428a275-399f-47e3-b02f-e0f518dff095 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] [instance: d9e40505-7817-4f32-a74e-add41b39dd8b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:51:27.831401 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d428a275-399f-47e3-b02f-e0f518dff095 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:27.831888 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d428a275-399f-47e3-b02f-e0f518dff095 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:27.832321 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d428a275-399f-47e3-b02f-e0f518dff095 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:27.833020 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d428a275-399f-47e3-b02f-e0f518dff095 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:27.833472 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d428a275-399f-47e3-b02f-e0f518dff095 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:27.833891 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d428a275-399f-47e3-b02f-e0f518dff095 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:27.847259 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-d428a275-399f-47e3-b02f-e0f518dff095 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] HTTP exception thrown: Instance d9e40505-7817-4f32-a74e-add41b39dd8b could not be found. Sep 14 09:51:27.848902 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d428a275-399f-47e3-b02f-e0f518dff095 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Request method failure captured: Sep 14 09:51:27.848902 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/d9e40505-7817-4f32-a74e-add41b39dd8b HTTP/1.1 Sep 14 09:51:27.848902 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:51:27.848902 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:51:27.848902 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:51:27.848902 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:51:27.848902 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:51:27.848902 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:51:27.848902 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:51:27.848902 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:51:27.848902 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIaQFvvZZQmRk4n4nh8VBfGJMweBPZSiRCINSpBokavN_GhyiYmgtFblahoyDoiUKE4CZkYS77vceS4ZMePeWV-4n9-yH1WD0Ugobe9704fu5TFjSz090KaBq657i_8dXxf697MQ9GnT0oN5Pd6p6hfNXX3OKZ5duEu_UtiLqCzNG0E0 Sep 14 09:51:27.848902 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:51:27.848902 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:51:27.848902 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:51:27.848902 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:51:27.848902 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:51:27.848902 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:51:27.848902 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 20cd39db14bb442f828650bd4a7ffe94 Sep 14 09:51:27.848902 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ServersNegativeTestJSON-1193707111 Sep 14 09:51:27.848902 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:51:27.848902 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:51:27.848902 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/20cd39db14bb442f828650bd4a7ffe94"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_20cd39db14bb442f828650bd4a7ffe94"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/20cd39db14bb442f828650bd4a7ffe94"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/20cd39db14bb442f828650bd4a7ffe94"}]}] Sep 14 09:51:27.848902 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ServersNegativeTestJSON-1193707111 Sep 14 09:51:27.848902 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 20cd39db14bb442f828650bd4a7ffe94 Sep 14 09:51:27.848902 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1193707111 Sep 14 09:51:27.848902 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ServersNegativeTestJSON-1193707111-project Sep 14 09:51:27.848902 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:51:27.848902 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:51:27.848902 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 06b0591e5bf74eb58078fa987baa6163 Sep 14 09:51:27.848902 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ServersNegativeTestJSON-1193707111-project Sep 14 09:51:27.848902 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:51:27.848902 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance d9e40505-7817-4f32-a74e-add41b39dd8b could not be found. Sep 14 09:51:27.848902 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': 'd9e40505-7817-4f32-a74e-add41b39dd8b'} Sep 14 09:51:27.848902 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:51:27.848902 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:51:27.848902 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:51:27.848902 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:51:27.848902 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:51:27.848902 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:51:27.848902 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:51:27.848902 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:51:27.848902 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:51:27.848902 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:51:27.848902 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9e40505-7817-4f32-a74e-add41b39dd8b could not be found. Sep 14 09:51:27.848902 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:51:27.848902 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:51:27.848902 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:51:27.848902 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:51:27.848902 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:51:27.848902 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:51:27.848902 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:51:27.848902 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:51:27.848902 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:51:27.848902 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:51:27.848902 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:51:27.848902 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:51:27.848902 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:51:27.848902 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:51:27.848902 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:51:27.848902 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:51:27.848902 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9e40505-7817-4f32-a74e-add41b39dd8b could not be found. Sep 14 09:51:27.848902 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:51:27.848902 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:51:27.848902 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:51:27.853806 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:51:27.853806 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:51:27.853806 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:51:27.853806 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:51:27.853806 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:51:27.853806 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9e40505-7817-4f32-a74e-add41b39dd8b could not be found. Sep 14 09:51:27.853806 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:51:27.853806 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d428a275-399f-47e3-b02f-e0f518dff095 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Returning 404 to user: Instance d9e40505-7817-4f32-a74e-add41b39dd8b could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:51:27.853806 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d428a275-399f-47e3-b02f-e0f518dff095 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] 10.222.0.60 "GET /compute/v2.1/servers/d9e40505-7817-4f32-a74e-add41b39dd8b" status: 404 len: 111 microversion: 2.1 time: 0.030285 Sep 14 09:51:27.853806 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3845/7169] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:51:27 2022] GET /compute/v2.1/servers/d9e40505-7817-4f32-a74e-add41b39dd8b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 14 09:51:27.859291 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e072cca5-b884-4878-a2fa-25c1191d0d48 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:51:27.859916 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e072cca5-b884-4878-a2fa-25c1191d0d48 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] [instance: 4b8eb878-3321-4d5c-9bae-bab041b3fd5f] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:51:27.866605 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e072cca5-b884-4878-a2fa-25c1191d0d48 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:27.867120 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e072cca5-b884-4878-a2fa-25c1191d0d48 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:27.867566 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e072cca5-b884-4878-a2fa-25c1191d0d48 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:27.868369 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e072cca5-b884-4878-a2fa-25c1191d0d48 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:27.868831 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e072cca5-b884-4878-a2fa-25c1191d0d48 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:27.869280 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e072cca5-b884-4878-a2fa-25c1191d0d48 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:28.000262 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-e072cca5-b884-4878-a2fa-25c1191d0d48 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b0591e5bf74eb58078fa987baa6163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cd39db14bb442f828650bd4a7ffe94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:51:28.008725 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e072cca5-b884-4878-a2fa-25c1191d0d48 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] 10.222.0.60 "GET /compute/v2.1/servers/4b8eb878-3321-4d5c-9bae-bab041b3fd5f" status: 200 len: 1506 microversion: 2.1 time: 0.153226 Sep 14 09:51:28.009300 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3846/7170] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:51:27 2022] GET /compute/v2.1/servers/4b8eb878-3321-4d5c-9bae-bab041b3fd5f => generated 1506 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:51:28.030503 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a87a7458-0d92-481c-802c-8ede9aadb4df tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:51:28.032748 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-a87a7458-0d92-481c-802c-8ede9aadb4df tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] [instance: 91217282-e22a-43e8-9af6-5222aedf5e10] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:51:28.037925 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-a87a7458-0d92-481c-802c-8ede9aadb4df tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] HTTP exception thrown: Instance 91217282-e22a-43e8-9af6-5222aedf5e10 could not be found. Sep 14 09:51:28.039524 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a87a7458-0d92-481c-802c-8ede9aadb4df tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Request method failure captured: Sep 14 09:51:28.039524 n-d-836830-18 devstack@n-api.service[128759]: request: POST /compute/v2.1/servers/91217282-e22a-43e8-9af6-5222aedf5e10/action HTTP/1.1 Sep 14 09:51:28.039524 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:51:28.039524 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:51:28.039524 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:51:28.039524 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 32 Sep 14 09:51:28.039524 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:51:28.039524 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:51:28.039524 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:51:28.039524 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:51:28.039524 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIaQFvvZZQmRk4n4nh8VBfGJMweBPZSiRCINSpBokavN_GhyiYmgtFblahoyDoiUKE4CZkYS77vceS4ZMePeWV-4n9-yH1WD0Ugobe9704fu5TFjSz090KaBq657i_8dXxf697MQ9GnT0oN5Pd6p6hfNXX3OKZ5duEu_UtiLqCzNG0E0 Sep 14 09:51:28.039524 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:51:28.039524 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:51:28.039524 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:51:28.039524 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:51:28.039524 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:51:28.039524 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:51:28.039524 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 20cd39db14bb442f828650bd4a7ffe94 Sep 14 09:51:28.039524 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ServersNegativeTestJSON-1193707111 Sep 14 09:51:28.039524 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:51:28.039524 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:51:28.039524 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/20cd39db14bb442f828650bd4a7ffe94"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_20cd39db14bb442f828650bd4a7ffe94"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/20cd39db14bb442f828650bd4a7ffe94"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/20cd39db14bb442f828650bd4a7ffe94"}]}] Sep 14 09:51:28.039524 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ServersNegativeTestJSON-1193707111 Sep 14 09:51:28.039524 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 20cd39db14bb442f828650bd4a7ffe94 Sep 14 09:51:28.039524 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1193707111 Sep 14 09:51:28.039524 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ServersNegativeTestJSON-1193707111-project Sep 14 09:51:28.039524 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:51:28.039524 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:51:28.039524 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 06b0591e5bf74eb58078fa987baa6163 Sep 14 09:51:28.039524 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ServersNegativeTestJSON-1193707111-project Sep 14 09:51:28.039524 n-d-836830-18 devstack@n-api.service[128759]: Sep 14 09:51:28.039524 n-d-836830-18 devstack@n-api.service[128759]: {"resize": {"flavorRef": "452"}} Sep 14 09:51:28.039524 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:51:28.039524 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance 91217282-e22a-43e8-9af6-5222aedf5e10 could not be found. Sep 14 09:51:28.039524 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '91217282-e22a-43e8-9af6-5222aedf5e10', 'body': {'resize': {'flavorRef': '452'}}} Sep 14 09:51:28.039524 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:51:28.039524 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:51:28.039524 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:51:28.039524 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:51:28.039524 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:51:28.039524 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:51:28.039524 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 14 09:51:28.039524 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 14 09:51:28.039524 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91217282-e22a-43e8-9af6-5222aedf5e10 could not be found. Sep 14 09:51:28.039524 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:51:28.039524 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:51:28.039524 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:51:28.039524 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:51:28.039524 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:51:28.039524 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:51:28.039524 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:51:28.039524 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:51:28.039524 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:51:28.039524 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:51:28.039524 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:51:28.039524 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:51:28.039524 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Sep 14 09:51:28.039524 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Sep 14 09:51:28.039524 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Sep 14 09:51:28.039524 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Sep 14 09:51:28.039524 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:51:28.039524 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:51:28.039524 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:51:28.039524 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:51:28.044255 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91217282-e22a-43e8-9af6-5222aedf5e10 could not be found. Sep 14 09:51:28.044255 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:51:28.044255 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:51:28.044255 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:51:28.044255 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:51:28.044255 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:51:28.044255 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:51:28.044255 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:51:28.044255 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:51:28.044255 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91217282-e22a-43e8-9af6-5222aedf5e10 could not be found. Sep 14 09:51:28.044255 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:51:28.044255 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a87a7458-0d92-481c-802c-8ede9aadb4df tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Returning 404 to user: Instance 91217282-e22a-43e8-9af6-5222aedf5e10 could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:51:28.044255 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a87a7458-0d92-481c-802c-8ede9aadb4df tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] 10.222.0.60 "POST /compute/v2.1/servers/91217282-e22a-43e8-9af6-5222aedf5e10/action" status: 404 len: 111 microversion: 2.1 time: 0.014046 Sep 14 09:51:28.044255 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3847/7171] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:51:28 2022] POST /compute/v2.1/servers/91217282-e22a-43e8-9af6-5222aedf5e10/action => generated 111 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 14 09:51:28.048520 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-7ed1a4d1-663e-42d0-adf7-573c80e13db4 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:51:28.049127 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-7ed1a4d1-663e-42d0-adf7-573c80e13db4 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] [instance: 4b8eb878-3321-4d5c-9bae-bab041b3fd5f] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:51:28.055839 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7ed1a4d1-663e-42d0-adf7-573c80e13db4 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:28.056325 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7ed1a4d1-663e-42d0-adf7-573c80e13db4 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:28.056767 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7ed1a4d1-663e-42d0-adf7-573c80e13db4 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:28.057466 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7ed1a4d1-663e-42d0-adf7-573c80e13db4 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:28.057924 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7ed1a4d1-663e-42d0-adf7-573c80e13db4 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:28.058355 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7ed1a4d1-663e-42d0-adf7-573c80e13db4 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:28.188802 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-7ed1a4d1-663e-42d0-adf7-573c80e13db4 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b0591e5bf74eb58078fa987baa6163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cd39db14bb442f828650bd4a7ffe94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:51:28.196489 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-7ed1a4d1-663e-42d0-adf7-573c80e13db4 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] 10.222.0.60 "GET /compute/v2.1/servers/4b8eb878-3321-4d5c-9bae-bab041b3fd5f" status: 200 len: 1506 microversion: 2.1 time: 0.151309 Sep 14 09:51:28.197053 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3848/7172] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:51:28 2022] GET /compute/v2.1/servers/4b8eb878-3321-4d5c-9bae-bab041b3fd5f => generated 1506 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:51:28.219182 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d7132ac2-16e1-46a0-95ff-a55c47fe5b6e tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:51:28.219769 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-d7132ac2-16e1-46a0-95ff-a55c47fe5b6e tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] [instance: 4b8eb878-3321-4d5c-9bae-bab041b3fd5f] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:51:28.225853 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d7132ac2-16e1-46a0-95ff-a55c47fe5b6e tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:28.226331 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d7132ac2-16e1-46a0-95ff-a55c47fe5b6e tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:28.226762 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d7132ac2-16e1-46a0-95ff-a55c47fe5b6e tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:28.227465 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d7132ac2-16e1-46a0-95ff-a55c47fe5b6e tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:28.227918 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d7132ac2-16e1-46a0-95ff-a55c47fe5b6e tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:28.228341 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d7132ac2-16e1-46a0-95ff-a55c47fe5b6e tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:28.354698 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-d7132ac2-16e1-46a0-95ff-a55c47fe5b6e tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b0591e5bf74eb58078fa987baa6163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cd39db14bb442f828650bd4a7ffe94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:51:28.362487 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d7132ac2-16e1-46a0-95ff-a55c47fe5b6e tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] 10.222.0.60 "GET /compute/v2.1/servers/4b8eb878-3321-4d5c-9bae-bab041b3fd5f" status: 200 len: 1506 microversion: 2.1 time: 0.147128 Sep 14 09:51:28.363130 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3849/7173] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:51:28 2022] GET /compute/v2.1/servers/4b8eb878-3321-4d5c-9bae-bab041b3fd5f => generated 1506 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:51:28.385086 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-00b080b6-89fc-4c23-a060-e5d541e76b90 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "b1e49265-b5b1-47c3-959f-b55490f4556a"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:51:28.387357 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-00b080b6-89fc-4c23-a060-e5d541e76b90 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] [instance: 4b8eb878-3321-4d5c-9bae-bab041b3fd5f] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:51:28.393230 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-00b080b6-89fc-4c23-a060-e5d541e76b90 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:28.393659 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-00b080b6-89fc-4c23-a060-e5d541e76b90 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:28.394095 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-00b080b6-89fc-4c23-a060-e5d541e76b90 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:28.394818 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-00b080b6-89fc-4c23-a060-e5d541e76b90 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:28.395306 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-00b080b6-89fc-4c23-a060-e5d541e76b90 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:28.395736 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-00b080b6-89fc-4c23-a060-e5d541e76b90 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:28.423944 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-00b080b6-89fc-4c23-a060-e5d541e76b90 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '06b0591e5bf74eb58078fa987baa6163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cd39db14bb442f828650bd4a7ffe94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:51:28.429173 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-00b080b6-89fc-4c23-a060-e5d541e76b90 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] HTTP exception thrown: Flavor b1e49265-b5b1-47c3-959f-b55490f4556a could not be found. Sep 14 09:51:28.430959 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-00b080b6-89fc-4c23-a060-e5d541e76b90 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Request method failure captured: Sep 14 09:51:28.430959 n-d-836830-18 devstack@n-api.service[128759]: request: POST /compute/v2.1/servers/4b8eb878-3321-4d5c-9bae-bab041b3fd5f/action HTTP/1.1 Sep 14 09:51:28.430959 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:51:28.430959 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:51:28.430959 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:51:28.430959 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 65 Sep 14 09:51:28.430959 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:51:28.430959 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:51:28.430959 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:51:28.430959 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:51:28.430959 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIaQFvvZZQmRk4n4nh8VBfGJMweBPZSiRCINSpBokavN_GhyiYmgtFblahoyDoiUKE4CZkYS77vceS4ZMePeWV-4n9-yH1WD0Ugobe9704fu5TFjSz090KaBq657i_8dXxf697MQ9GnT0oN5Pd6p6hfNXX3OKZ5duEu_UtiLqCzNG0E0 Sep 14 09:51:28.430959 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:51:28.430959 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:51:28.430959 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:51:28.430959 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:51:28.430959 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:51:28.430959 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:51:28.430959 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 20cd39db14bb442f828650bd4a7ffe94 Sep 14 09:51:28.430959 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ServersNegativeTestJSON-1193707111 Sep 14 09:51:28.430959 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:51:28.430959 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:51:28.430959 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/20cd39db14bb442f828650bd4a7ffe94"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_20cd39db14bb442f828650bd4a7ffe94"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/20cd39db14bb442f828650bd4a7ffe94"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/20cd39db14bb442f828650bd4a7ffe94"}]}] Sep 14 09:51:28.430959 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ServersNegativeTestJSON-1193707111 Sep 14 09:51:28.430959 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 20cd39db14bb442f828650bd4a7ffe94 Sep 14 09:51:28.430959 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1193707111 Sep 14 09:51:28.430959 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ServersNegativeTestJSON-1193707111-project Sep 14 09:51:28.430959 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:51:28.430959 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:51:28.430959 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 06b0591e5bf74eb58078fa987baa6163 Sep 14 09:51:28.430959 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ServersNegativeTestJSON-1193707111-project Sep 14 09:51:28.430959 n-d-836830-18 devstack@n-api.service[128759]: Sep 14 09:51:28.430959 n-d-836830-18 devstack@n-api.service[128759]: {"resize": {"flavorRef": "b1e49265-b5b1-47c3-959f-b55490f4556a"}} Sep 14 09:51:28.430959 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:51:28.430959 n-d-836830-18 devstack@n-api.service[128759]: exception: Flavor b1e49265-b5b1-47c3-959f-b55490f4556a could not be found. Sep 14 09:51:28.430959 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '4b8eb878-3321-4d5c-9bae-bab041b3fd5f', 'body': {'resize': {'flavorRef': 'b1e49265-b5b1-47c3-959f-b55490f4556a'}}} Sep 14 09:51:28.430959 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:51:28.430959 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:51:28.430959 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Sep 14 09:51:28.430959 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Sep 14 09:51:28.430959 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 14 09:51:28.430959 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 14 09:51:28.430959 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 14 09:51:28.430959 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 14 09:51:28.430959 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 14 09:51:28.430959 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 14 09:51:28.430959 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 14 09:51:28.430959 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 14 09:51:28.430959 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 14 09:51:28.430959 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 14 09:51:28.430959 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 14 09:51:28.430959 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 14 09:51:28.430959 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4200, in resize Sep 14 09:51:28.430959 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Sep 14 09:51:28.430959 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 14 09:51:28.430959 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 14 09:51:28.430959 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 14 09:51:28.430959 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 14 09:51:28.430959 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 14 09:51:28.430959 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 14 09:51:28.430959 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 14 09:51:28.430959 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:51:28.430959 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 14 09:51:28.435599 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 14 09:51:28.435599 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor b1e49265-b5b1-47c3-959f-b55490f4556a could not be found. Sep 14 09:51:28.435599 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:51:28.435599 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:51:28.435599 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:51:28.435599 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:51:28.435599 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:51:28.435599 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:51:28.435599 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:51:28.435599 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:51:28.435599 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:51:28.435599 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:51:28.435599 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:51:28.435599 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:51:28.435599 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Sep 14 09:51:28.435599 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Sep 14 09:51:28.435599 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Sep 14 09:51:28.435599 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 14 09:51:28.435599 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor b1e49265-b5b1-47c3-959f-b55490f4556a could not be found. Sep 14 09:51:28.435599 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:51:28.435599 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:51:28.435599 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:51:28.435599 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:51:28.435599 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:51:28.435599 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:51:28.435599 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:51:28.435599 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:51:28.435599 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor b1e49265-b5b1-47c3-959f-b55490f4556a could not be found. Sep 14 09:51:28.435599 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:51:28.435599 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-00b080b6-89fc-4c23-a060-e5d541e76b90 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Returning 400 to user: Flavor b1e49265-b5b1-47c3-959f-b55490f4556a could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:51:28.435599 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-00b080b6-89fc-4c23-a060-e5d541e76b90 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] 10.222.0.60 "POST /compute/v2.1/servers/4b8eb878-3321-4d5c-9bae-bab041b3fd5f/action" status: 400 len: 107 microversion: 2.1 time: 0.051024 Sep 14 09:51:28.435599 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3850/7174] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:51:28 2022] POST /compute/v2.1/servers/4b8eb878-3321-4d5c-9bae-bab041b3fd5f/action => generated 107 bytes in 52 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 14 09:51:28.440670 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-dc6f68f9-699c-4d40-881f-229dffa23c65 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:51:28.441319 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-dc6f68f9-699c-4d40-881f-229dffa23c65 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] [instance: 4b8eb878-3321-4d5c-9bae-bab041b3fd5f] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:51:28.447421 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dc6f68f9-699c-4d40-881f-229dffa23c65 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:28.447912 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dc6f68f9-699c-4d40-881f-229dffa23c65 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:28.448410 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dc6f68f9-699c-4d40-881f-229dffa23c65 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:28.449104 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dc6f68f9-699c-4d40-881f-229dffa23c65 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:28.449602 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dc6f68f9-699c-4d40-881f-229dffa23c65 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:28.450031 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dc6f68f9-699c-4d40-881f-229dffa23c65 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:28.584553 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-dc6f68f9-699c-4d40-881f-229dffa23c65 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b0591e5bf74eb58078fa987baa6163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cd39db14bb442f828650bd4a7ffe94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:51:28.592403 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-dc6f68f9-699c-4d40-881f-229dffa23c65 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] 10.222.0.60 "GET /compute/v2.1/servers/4b8eb878-3321-4d5c-9bae-bab041b3fd5f" status: 200 len: 1506 microversion: 2.1 time: 0.155302 Sep 14 09:51:28.592978 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3851/7175] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:51:28 2022] GET /compute/v2.1/servers/4b8eb878-3321-4d5c-9bae-bab041b3fd5f => generated 1506 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:51:28.615617 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-26900095-be6d-4b29-96fe-a2f29aa86c2b tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:51:28.616238 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-26900095-be6d-4b29-96fe-a2f29aa86c2b tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] [instance: 4b8eb878-3321-4d5c-9bae-bab041b3fd5f] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:51:28.625947 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-26900095-be6d-4b29-96fe-a2f29aa86c2b tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:28.626441 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-26900095-be6d-4b29-96fe-a2f29aa86c2b tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:28.626891 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-26900095-be6d-4b29-96fe-a2f29aa86c2b tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:28.629483 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-26900095-be6d-4b29-96fe-a2f29aa86c2b tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:28.630000 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-26900095-be6d-4b29-96fe-a2f29aa86c2b tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:28.630415 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-26900095-be6d-4b29-96fe-a2f29aa86c2b tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:28.756663 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-26900095-be6d-4b29-96fe-a2f29aa86c2b tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b0591e5bf74eb58078fa987baa6163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cd39db14bb442f828650bd4a7ffe94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:51:28.764398 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-26900095-be6d-4b29-96fe-a2f29aa86c2b tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] 10.222.0.60 "GET /compute/v2.1/servers/4b8eb878-3321-4d5c-9bae-bab041b3fd5f" status: 200 len: 1506 microversion: 2.1 time: 0.152418 Sep 14 09:51:28.764979 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3852/7176] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:51:28 2022] GET /compute/v2.1/servers/4b8eb878-3321-4d5c-9bae-bab041b3fd5f => generated 1506 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:51:28.787963 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-18c50651-8f2d-4560-9536-b20ff783f02a tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:51:28.791624 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-18c50651-8f2d-4560-9536-b20ff783f02a tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Request method failure captured: Sep 14 09:51:28.791624 n-d-836830-18 devstack@n-api.service[128759]: request: POST /compute/v2.1/servers/4b8eb878-3321-4d5c-9bae-bab041b3fd5f/action HTTP/1.1 Sep 14 09:51:28.791624 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:51:28.791624 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:51:28.791624 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:51:28.791624 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 29 Sep 14 09:51:28.791624 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:51:28.791624 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:51:28.791624 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:51:28.791624 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:51:28.791624 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIaQFvvZZQmRk4n4nh8VBfGJMweBPZSiRCINSpBokavN_GhyiYmgtFblahoyDoiUKE4CZkYS77vceS4ZMePeWV-4n9-yH1WD0Ugobe9704fu5TFjSz090KaBq657i_8dXxf697MQ9GnT0oN5Pd6p6hfNXX3OKZ5duEu_UtiLqCzNG0E0 Sep 14 09:51:28.791624 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:51:28.791624 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:51:28.791624 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:51:28.791624 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:51:28.791624 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:51:28.791624 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:51:28.791624 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 20cd39db14bb442f828650bd4a7ffe94 Sep 14 09:51:28.791624 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ServersNegativeTestJSON-1193707111 Sep 14 09:51:28.791624 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:51:28.791624 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:51:28.791624 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/20cd39db14bb442f828650bd4a7ffe94"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_20cd39db14bb442f828650bd4a7ffe94"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/20cd39db14bb442f828650bd4a7ffe94"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/20cd39db14bb442f828650bd4a7ffe94"}]}] Sep 14 09:51:28.791624 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ServersNegativeTestJSON-1193707111 Sep 14 09:51:28.791624 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 20cd39db14bb442f828650bd4a7ffe94 Sep 14 09:51:28.791624 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1193707111 Sep 14 09:51:28.791624 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ServersNegativeTestJSON-1193707111-project Sep 14 09:51:28.791624 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:51:28.791624 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:51:28.791624 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 06b0591e5bf74eb58078fa987baa6163 Sep 14 09:51:28.791624 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ServersNegativeTestJSON-1193707111-project Sep 14 09:51:28.791624 n-d-836830-18 devstack@n-api.service[128759]: Sep 14 09:51:28.791624 n-d-836830-18 devstack@n-api.service[128759]: {"resize": {"flavorRef": ""}} Sep 14 09:51:28.791624 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:51:28.791624 n-d-836830-18 devstack@n-api.service[128759]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Sep 14 09:51:28.791624 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '4b8eb878-3321-4d5c-9bae-bab041b3fd5f', 'body': {'resize': {'flavorRef': ''}}} Sep 14 09:51:28.791624 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:51:28.791624 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:51:28.791624 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 14 09:51:28.791624 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 14 09:51:28.791624 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 14 09:51:28.791624 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise error Sep 14 09:51:28.791624 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Sep 14 09:51:28.791624 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:51:28.791624 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Sep 14 09:51:28.791624 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Sep 14 09:51:28.791624 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:51:28.791624 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi On instance['resize']: Sep 14 09:51:28.791624 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi '' Sep 14 09:51:28.791624 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:51:28.791624 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:51:28.791624 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:51:28.791624 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:51:28.791624 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:51:28.791624 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:51:28.791624 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:51:28.791624 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:51:28.791624 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:51:28.791624 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:51:28.791624 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 14 09:51:28.791624 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 14 09:51:28.791624 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 14 09:51:28.791624 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 14 09:51:28.791624 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 14 09:51:28.791624 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 14 09:51:28.791624 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Sep 14 09:51:28.791624 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:51:28.791624 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:51:28.796415 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:51:28.796415 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:51:28.796415 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:51:28.796415 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:51:28.796415 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 14 09:51:28.796415 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 14 09:51:28.796415 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Sep 14 09:51:28.796415 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:51:28.796415 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-18c50651-8f2d-4560-9536-b20ff783f02a tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:51:28.796415 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-18c50651-8f2d-4560-9536-b20ff783f02a tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] 10.222.0.60 "POST /compute/v2.1/servers/4b8eb878-3321-4d5c-9bae-bab041b3fd5f/action" status: 400 len: 113 microversion: 2.1 time: 0.009830 Sep 14 09:51:28.796415 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3853/7177] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:51:28 2022] POST /compute/v2.1/servers/4b8eb878-3321-4d5c-9bae-bab041b3fd5f/action => generated 113 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 14 09:51:28.801378 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ee62f8f3-ac60-4d39-acc7-05cae2e4dbeb tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:51:28.802017 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-ee62f8f3-ac60-4d39-acc7-05cae2e4dbeb tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] [instance: 4b8eb878-3321-4d5c-9bae-bab041b3fd5f] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:51:28.808753 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ee62f8f3-ac60-4d39-acc7-05cae2e4dbeb tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:28.809241 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ee62f8f3-ac60-4d39-acc7-05cae2e4dbeb tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:28.809683 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ee62f8f3-ac60-4d39-acc7-05cae2e4dbeb tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:28.810371 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ee62f8f3-ac60-4d39-acc7-05cae2e4dbeb tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:28.810831 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ee62f8f3-ac60-4d39-acc7-05cae2e4dbeb tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:28.811298 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ee62f8f3-ac60-4d39-acc7-05cae2e4dbeb tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:28.943934 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-ee62f8f3-ac60-4d39-acc7-05cae2e4dbeb tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b0591e5bf74eb58078fa987baa6163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cd39db14bb442f828650bd4a7ffe94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:51:28.947611 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:51:28.953024 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-ee62f8f3-ac60-4d39-acc7-05cae2e4dbeb tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] 10.222.0.60 "GET /compute/v2.1/servers/4b8eb878-3321-4d5c-9bae-bab041b3fd5f" status: 200 len: 1506 microversion: 2.1 time: 0.155233 Sep 14 09:51:28.953591 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3854/7178] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:51:28 2022] GET /compute/v2.1/servers/4b8eb878-3321-4d5c-9bae-bab041b3fd5f => generated 1506 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:51:28.981926 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b72647d7-d784-49ae-b09e-2539f5a4ff92 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:51:28.982465 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b72647d7-d784-49ae-b09e-2539f5a4ff92 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] [instance: d9e40505-7817-4f32-a74e-add41b39dd8b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:51:28.989017 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b72647d7-d784-49ae-b09e-2539f5a4ff92 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:28.989500 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b72647d7-d784-49ae-b09e-2539f5a4ff92 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:28.989932 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b72647d7-d784-49ae-b09e-2539f5a4ff92 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:28.990619 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b72647d7-d784-49ae-b09e-2539f5a4ff92 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:28.991104 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b72647d7-d784-49ae-b09e-2539f5a4ff92 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:28.991524 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b72647d7-d784-49ae-b09e-2539f5a4ff92 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:29.005731 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-b72647d7-d784-49ae-b09e-2539f5a4ff92 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] HTTP exception thrown: Instance d9e40505-7817-4f32-a74e-add41b39dd8b could not be found. Sep 14 09:51:29.007283 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b72647d7-d784-49ae-b09e-2539f5a4ff92 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Request method failure captured: Sep 14 09:51:29.007283 n-d-836830-18 devstack@n-api.service[128759]: request: DELETE /compute/v2.1/servers/d9e40505-7817-4f32-a74e-add41b39dd8b HTTP/1.1 Sep 14 09:51:29.007283 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:51:29.007283 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:51:29.007283 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:51:29.007283 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:51:29.007283 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:51:29.007283 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:51:29.007283 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:51:29.007283 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:51:29.007283 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIaQFvvZZQmRk4n4nh8VBfGJMweBPZSiRCINSpBokavN_GhyiYmgtFblahoyDoiUKE4CZkYS77vceS4ZMePeWV-4n9-yH1WD0Ugobe9704fu5TFjSz090KaBq657i_8dXxf697MQ9GnT0oN5Pd6p6hfNXX3OKZ5duEu_UtiLqCzNG0E0 Sep 14 09:51:29.007283 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:51:29.007283 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:51:29.007283 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:51:29.007283 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:51:29.007283 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:51:29.007283 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:51:29.007283 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 20cd39db14bb442f828650bd4a7ffe94 Sep 14 09:51:29.007283 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ServersNegativeTestJSON-1193707111 Sep 14 09:51:29.007283 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:51:29.007283 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:51:29.007283 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/20cd39db14bb442f828650bd4a7ffe94"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_20cd39db14bb442f828650bd4a7ffe94"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/20cd39db14bb442f828650bd4a7ffe94"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/20cd39db14bb442f828650bd4a7ffe94"}]}] Sep 14 09:51:29.007283 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ServersNegativeTestJSON-1193707111 Sep 14 09:51:29.007283 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 20cd39db14bb442f828650bd4a7ffe94 Sep 14 09:51:29.007283 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1193707111 Sep 14 09:51:29.007283 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ServersNegativeTestJSON-1193707111-project Sep 14 09:51:29.007283 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:51:29.007283 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:51:29.007283 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 06b0591e5bf74eb58078fa987baa6163 Sep 14 09:51:29.007283 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ServersNegativeTestJSON-1193707111-project Sep 14 09:51:29.007283 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:51:29.007283 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance d9e40505-7817-4f32-a74e-add41b39dd8b could not be found. Sep 14 09:51:29.007283 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': 'd9e40505-7817-4f32-a74e-add41b39dd8b'} Sep 14 09:51:29.007283 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:51:29.007283 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:51:29.007283 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:51:29.007283 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:51:29.007283 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:51:29.007283 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:51:29.007283 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:51:29.007283 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:51:29.007283 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:51:29.007283 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:51:29.007283 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9e40505-7817-4f32-a74e-add41b39dd8b could not be found. Sep 14 09:51:29.007283 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:51:29.007283 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:51:29.007283 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:51:29.007283 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:51:29.007283 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:51:29.007283 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:51:29.007283 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:51:29.007283 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:51:29.007283 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:51:29.007283 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:51:29.007283 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 09:51:29.007283 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 09:51:29.007283 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 09:51:29.007283 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 09:51:29.007283 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:51:29.007283 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:51:29.007283 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:51:29.007283 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:51:29.011614 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9e40505-7817-4f32-a74e-add41b39dd8b could not be found. Sep 14 09:51:29.011614 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:51:29.011614 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:51:29.011614 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:51:29.011614 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:51:29.011614 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:51:29.011614 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:51:29.011614 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:51:29.011614 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:51:29.011614 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9e40505-7817-4f32-a74e-add41b39dd8b could not be found. Sep 14 09:51:29.011614 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:51:29.011614 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b72647d7-d784-49ae-b09e-2539f5a4ff92 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Returning 404 to user: Instance d9e40505-7817-4f32-a74e-add41b39dd8b could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:51:29.011614 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b72647d7-d784-49ae-b09e-2539f5a4ff92 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] 10.222.0.60 "DELETE /compute/v2.1/servers/d9e40505-7817-4f32-a74e-add41b39dd8b" status: 404 len: 111 microversion: 2.1 time: 0.032295 Sep 14 09:51:29.011614 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3855/7179] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:51:28 2022] DELETE /compute/v2.1/servers/d9e40505-7817-4f32-a74e-add41b39dd8b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 14 09:51:29.016677 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f897b2b4-9f23-4f4d-b48b-abc97dd6e160 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:51:29.017282 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f897b2b4-9f23-4f4d-b48b-abc97dd6e160 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] [instance: d9e40505-7817-4f32-a74e-add41b39dd8b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:51:29.023426 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f897b2b4-9f23-4f4d-b48b-abc97dd6e160 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:29.023906 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f897b2b4-9f23-4f4d-b48b-abc97dd6e160 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:29.024340 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f897b2b4-9f23-4f4d-b48b-abc97dd6e160 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:29.025017 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f897b2b4-9f23-4f4d-b48b-abc97dd6e160 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:29.025470 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f897b2b4-9f23-4f4d-b48b-abc97dd6e160 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:29.025892 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f897b2b4-9f23-4f4d-b48b-abc97dd6e160 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:29.039095 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-f897b2b4-9f23-4f4d-b48b-abc97dd6e160 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] HTTP exception thrown: Instance d9e40505-7817-4f32-a74e-add41b39dd8b could not be found. Sep 14 09:51:29.040581 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f897b2b4-9f23-4f4d-b48b-abc97dd6e160 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Request method failure captured: Sep 14 09:51:29.040581 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/d9e40505-7817-4f32-a74e-add41b39dd8b HTTP/1.1 Sep 14 09:51:29.040581 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:51:29.040581 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:51:29.040581 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:51:29.040581 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:51:29.040581 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:51:29.040581 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:51:29.040581 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:51:29.040581 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:51:29.040581 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIaQFvvZZQmRk4n4nh8VBfGJMweBPZSiRCINSpBokavN_GhyiYmgtFblahoyDoiUKE4CZkYS77vceS4ZMePeWV-4n9-yH1WD0Ugobe9704fu5TFjSz090KaBq657i_8dXxf697MQ9GnT0oN5Pd6p6hfNXX3OKZ5duEu_UtiLqCzNG0E0 Sep 14 09:51:29.040581 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:51:29.040581 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:51:29.040581 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:51:29.040581 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:51:29.040581 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:51:29.040581 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:51:29.040581 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 20cd39db14bb442f828650bd4a7ffe94 Sep 14 09:51:29.040581 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ServersNegativeTestJSON-1193707111 Sep 14 09:51:29.040581 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:51:29.040581 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:51:29.040581 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/20cd39db14bb442f828650bd4a7ffe94"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_20cd39db14bb442f828650bd4a7ffe94"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/20cd39db14bb442f828650bd4a7ffe94"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/20cd39db14bb442f828650bd4a7ffe94"}]}] Sep 14 09:51:29.040581 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ServersNegativeTestJSON-1193707111 Sep 14 09:51:29.040581 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 20cd39db14bb442f828650bd4a7ffe94 Sep 14 09:51:29.040581 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1193707111 Sep 14 09:51:29.040581 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ServersNegativeTestJSON-1193707111-project Sep 14 09:51:29.040581 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:51:29.040581 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:51:29.040581 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 06b0591e5bf74eb58078fa987baa6163 Sep 14 09:51:29.040581 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ServersNegativeTestJSON-1193707111-project Sep 14 09:51:29.040581 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:51:29.040581 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance d9e40505-7817-4f32-a74e-add41b39dd8b could not be found. Sep 14 09:51:29.040581 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': 'd9e40505-7817-4f32-a74e-add41b39dd8b'} Sep 14 09:51:29.040581 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:51:29.040581 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:51:29.040581 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:51:29.040581 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:51:29.040581 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:51:29.040581 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:51:29.040581 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:51:29.040581 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:51:29.040581 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:51:29.040581 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:51:29.040581 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9e40505-7817-4f32-a74e-add41b39dd8b could not be found. Sep 14 09:51:29.040581 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:51:29.040581 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:51:29.040581 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:51:29.040581 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:51:29.040581 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:51:29.040581 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:51:29.040581 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:51:29.040581 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:51:29.040581 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:51:29.040581 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:51:29.040581 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:51:29.040581 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:51:29.040581 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:51:29.040581 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:51:29.040581 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:51:29.040581 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:51:29.040581 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9e40505-7817-4f32-a74e-add41b39dd8b could not be found. Sep 14 09:51:29.040581 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:51:29.040581 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:51:29.040581 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:51:29.045367 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:51:29.045367 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:51:29.045367 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:51:29.045367 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:51:29.045367 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:51:29.045367 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9e40505-7817-4f32-a74e-add41b39dd8b could not be found. Sep 14 09:51:29.045367 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:51:29.045367 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f897b2b4-9f23-4f4d-b48b-abc97dd6e160 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Returning 404 to user: Instance d9e40505-7817-4f32-a74e-add41b39dd8b could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:51:29.045367 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f897b2b4-9f23-4f4d-b48b-abc97dd6e160 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] 10.222.0.60 "GET /compute/v2.1/servers/d9e40505-7817-4f32-a74e-add41b39dd8b" status: 404 len: 111 microversion: 2.1 time: 0.028740 Sep 14 09:51:29.045367 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3856/7180] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:51:29 2022] GET /compute/v2.1/servers/d9e40505-7817-4f32-a74e-add41b39dd8b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:51:29.049657 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-27ac0109-006d-40ff-b42c-3168fa65e63f tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:51:29.050148 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-27ac0109-006d-40ff-b42c-3168fa65e63f tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] [instance: 4b8eb878-3321-4d5c-9bae-bab041b3fd5f] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:51:29.055796 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-27ac0109-006d-40ff-b42c-3168fa65e63f tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:29.056322 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-27ac0109-006d-40ff-b42c-3168fa65e63f tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:29.056714 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-27ac0109-006d-40ff-b42c-3168fa65e63f tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:29.057385 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-27ac0109-006d-40ff-b42c-3168fa65e63f tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:29.057836 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-27ac0109-006d-40ff-b42c-3168fa65e63f tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:29.058257 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-27ac0109-006d-40ff-b42c-3168fa65e63f tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:29.083652 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-27ac0109-006d-40ff-b42c-3168fa65e63f tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] [instance: 4b8eb878-3321-4d5c-9bae-bab041b3fd5f] Going to try to terminate instance {{(pid=128759) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:51:29.157761 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-27ac0109-006d-40ff-b42c-3168fa65e63f tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] 10.222.0.60 "DELETE /compute/v2.1/servers/4b8eb878-3321-4d5c-9bae-bab041b3fd5f" status: 204 len: 0 microversion: 2.1 time: 0.111063 Sep 14 09:51:29.158470 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3857/7181] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:51:29 2022] DELETE /compute/v2.1/servers/4b8eb878-3321-4d5c-9bae-bab041b3fd5f => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 14 09:51:29.166762 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-78f25b72-363d-46da-92e6-e81e9fc62cd3 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:51:29.167496 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-78f25b72-363d-46da-92e6-e81e9fc62cd3 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] [instance: 4b8eb878-3321-4d5c-9bae-bab041b3fd5f] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:51:29.173215 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-78f25b72-363d-46da-92e6-e81e9fc62cd3 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:29.173749 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-78f25b72-363d-46da-92e6-e81e9fc62cd3 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:29.174186 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-78f25b72-363d-46da-92e6-e81e9fc62cd3 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:29.174866 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-78f25b72-363d-46da-92e6-e81e9fc62cd3 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:29.175344 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-78f25b72-363d-46da-92e6-e81e9fc62cd3 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:29.175765 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-78f25b72-363d-46da-92e6-e81e9fc62cd3 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:29.308831 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-78f25b72-363d-46da-92e6-e81e9fc62cd3 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b0591e5bf74eb58078fa987baa6163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cd39db14bb442f828650bd4a7ffe94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:51:29.316602 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-78f25b72-363d-46da-92e6-e81e9fc62cd3 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] 10.222.0.60 "GET /compute/v2.1/servers/4b8eb878-3321-4d5c-9bae-bab041b3fd5f" status: 200 len: 1512 microversion: 2.1 time: 0.153847 Sep 14 09:51:29.317171 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3858/7182] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:51:29 2022] GET /compute/v2.1/servers/4b8eb878-3321-4d5c-9bae-bab041b3fd5f => generated 1512 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:51:30.340317 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-973b1ac6-b0f3-4049-9d9d-e51bbee2904e tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:51:30.340959 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-973b1ac6-b0f3-4049-9d9d-e51bbee2904e tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] [instance: 4b8eb878-3321-4d5c-9bae-bab041b3fd5f] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:51:30.348040 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-973b1ac6-b0f3-4049-9d9d-e51bbee2904e tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:30.349039 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-973b1ac6-b0f3-4049-9d9d-e51bbee2904e tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:30.349483 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-973b1ac6-b0f3-4049-9d9d-e51bbee2904e tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:30.350189 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-973b1ac6-b0f3-4049-9d9d-e51bbee2904e tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:30.350647 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-973b1ac6-b0f3-4049-9d9d-e51bbee2904e tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:30.351107 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-973b1ac6-b0f3-4049-9d9d-e51bbee2904e tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:30.485398 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-973b1ac6-b0f3-4049-9d9d-e51bbee2904e tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b0591e5bf74eb58078fa987baa6163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cd39db14bb442f828650bd4a7ffe94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:51:30.494857 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-973b1ac6-b0f3-4049-9d9d-e51bbee2904e tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] 10.222.0.60 "GET /compute/v2.1/servers/4b8eb878-3321-4d5c-9bae-bab041b3fd5f" status: 200 len: 1512 microversion: 2.1 time: 0.158531 Sep 14 09:51:30.495493 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3859/7183] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:51:30 2022] GET /compute/v2.1/servers/4b8eb878-3321-4d5c-9bae-bab041b3fd5f => generated 1512 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:51:30.991048 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-36309e3f-ac72-4ff0-9d18-9d478391a4d7 req-90e8c26a-281c-4d1b-9751-fa0fe8a859e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b8eb878-3321-4d5c-9bae-bab041b3fd5f", "name": "network-vif-deleted", "tag": "cb75f4e4-cb36-43c2-ba7c-700200392a1b"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:51:31.003241 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-36309e3f-ac72-4ff0-9d18-9d478391a4d7 req-90e8c26a-281c-4d1b-9751-fa0fe8a859e3 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:31.003861 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-36309e3f-ac72-4ff0-9d18-9d478391a4d7 req-90e8c26a-281c-4d1b-9751-fa0fe8a859e3 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:31.011394 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-36309e3f-ac72-4ff0-9d18-9d478391a4d7 req-90e8c26a-281c-4d1b-9751-fa0fe8a859e3 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:31.036404 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-36309e3f-ac72-4ff0-9d18-9d478391a4d7 req-90e8c26a-281c-4d1b-9751-fa0fe8a859e3 service nova] Creating event network-vif-deleted:cb75f4e4-cb36-43c2-ba7c-700200392a1b for instance 4b8eb878-3321-4d5c-9bae-bab041b3fd5f on n-h2-836830-18 Sep 14 09:51:31.041592 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-36309e3f-ac72-4ff0-9d18-9d478391a4d7 req-90e8c26a-281c-4d1b-9751-fa0fe8a859e3 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058325 Sep 14 09:51:31.045437 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3860/7184] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:51:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:51:31.519384 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-adfdd314-37b8-4e02-9c8b-a03f7b8b9091 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:51:31.520100 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-adfdd314-37b8-4e02-9c8b-a03f7b8b9091 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] [instance: 4b8eb878-3321-4d5c-9bae-bab041b3fd5f] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:51:31.527184 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-adfdd314-37b8-4e02-9c8b-a03f7b8b9091 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:31.527671 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-adfdd314-37b8-4e02-9c8b-a03f7b8b9091 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:31.528119 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-adfdd314-37b8-4e02-9c8b-a03f7b8b9091 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:31.528805 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-adfdd314-37b8-4e02-9c8b-a03f7b8b9091 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:31.529258 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-adfdd314-37b8-4e02-9c8b-a03f7b8b9091 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:31.529678 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-adfdd314-37b8-4e02-9c8b-a03f7b8b9091 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:31.544024 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-adfdd314-37b8-4e02-9c8b-a03f7b8b9091 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] HTTP exception thrown: Instance 4b8eb878-3321-4d5c-9bae-bab041b3fd5f could not be found. Sep 14 09:51:31.545625 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-adfdd314-37b8-4e02-9c8b-a03f7b8b9091 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Request method failure captured: Sep 14 09:51:31.545625 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/4b8eb878-3321-4d5c-9bae-bab041b3fd5f HTTP/1.1 Sep 14 09:51:31.545625 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:51:31.545625 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:51:31.545625 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:51:31.545625 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:51:31.545625 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:51:31.545625 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:51:31.545625 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:51:31.545625 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:51:31.545625 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIaQFvvZZQmRk4n4nh8VBfGJMweBPZSiRCINSpBokavN_GhyiYmgtFblahoyDoiUKE4CZkYS77vceS4ZMePeWV-4n9-yH1WD0Ugobe9704fu5TFjSz090KaBq657i_8dXxf697MQ9GnT0oN5Pd6p6hfNXX3OKZ5duEu_UtiLqCzNG0E0 Sep 14 09:51:31.545625 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:51:31.545625 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:51:31.545625 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:51:31.545625 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:51:31.545625 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:51:31.545625 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:51:31.545625 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 20cd39db14bb442f828650bd4a7ffe94 Sep 14 09:51:31.545625 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-ServersNegativeTestJSON-1193707111 Sep 14 09:51:31.545625 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:51:31.545625 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:51:31.545625 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/20cd39db14bb442f828650bd4a7ffe94"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_20cd39db14bb442f828650bd4a7ffe94"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/20cd39db14bb442f828650bd4a7ffe94"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/20cd39db14bb442f828650bd4a7ffe94"}]}] Sep 14 09:51:31.545625 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-ServersNegativeTestJSON-1193707111 Sep 14 09:51:31.545625 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 20cd39db14bb442f828650bd4a7ffe94 Sep 14 09:51:31.545625 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1193707111 Sep 14 09:51:31.545625 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-ServersNegativeTestJSON-1193707111-project Sep 14 09:51:31.545625 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:51:31.545625 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:51:31.545625 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 06b0591e5bf74eb58078fa987baa6163 Sep 14 09:51:31.545625 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-ServersNegativeTestJSON-1193707111-project Sep 14 09:51:31.545625 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:51:31.545625 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance 4b8eb878-3321-4d5c-9bae-bab041b3fd5f could not be found. Sep 14 09:51:31.545625 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '4b8eb878-3321-4d5c-9bae-bab041b3fd5f'} Sep 14 09:51:31.545625 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:51:31.545625 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:51:31.545625 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:51:31.545625 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:51:31.545625 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:51:31.545625 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:51:31.545625 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:51:31.545625 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:51:31.545625 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:51:31.545625 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:51:31.545625 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b8eb878-3321-4d5c-9bae-bab041b3fd5f could not be found. Sep 14 09:51:31.545625 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:51:31.545625 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:51:31.545625 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:51:31.545625 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:51:31.545625 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:51:31.545625 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:51:31.545625 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:51:31.545625 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:51:31.545625 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:51:31.545625 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:51:31.545625 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:51:31.545625 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:51:31.545625 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:51:31.545625 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:51:31.545625 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:51:31.545625 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:51:31.545625 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b8eb878-3321-4d5c-9bae-bab041b3fd5f could not be found. Sep 14 09:51:31.545625 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:51:31.545625 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:51:31.545625 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:51:31.550407 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:51:31.550407 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:51:31.550407 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:51:31.550407 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:51:31.550407 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:51:31.550407 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b8eb878-3321-4d5c-9bae-bab041b3fd5f could not be found. Sep 14 09:51:31.550407 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:51:31.550407 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-adfdd314-37b8-4e02-9c8b-a03f7b8b9091 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] Returning 404 to user: Instance 4b8eb878-3321-4d5c-9bae-bab041b3fd5f could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:51:31.550407 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-adfdd314-37b8-4e02-9c8b-a03f7b8b9091 tempest-ServersNegativeTestJSON-1193707111 tempest-ServersNegativeTestJSON-1193707111-project] 10.222.0.60 "GET /compute/v2.1/servers/4b8eb878-3321-4d5c-9bae-bab041b3fd5f" status: 404 len: 111 microversion: 2.1 time: 0.033023 Sep 14 09:51:31.550407 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3861/7185] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:51:31 2022] GET /compute/v2.1/servers/4b8eb878-3321-4d5c-9bae-bab041b3fd5f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 14 09:52:02.298186 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=2 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:52:02.299673 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:52:02.478257 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3ca90a8a-1fa1-40c0-b354-e14c2f49b76e tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Action: 'create', calling method: .version_select at 0x7f7d3ec700d0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-462263794", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCTUWjsxGebs9BrTnKACdxVzaCT+AzdzQSM9R4ywpViTzLrFMR83A1RYy1tjABoQxAq6zMPJIqm6A2646/1tNGmqXzbgPc6wRJ5PqsaQehz1wvRigUVzRu5JlFEw8WWDlQ=="}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:52:02.494005 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-3ca90a8a-1fa1-40c0-b354-e14c2f49b76e tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Getting quotas for project 3aa81dd5f183418a8bf268f7618d38dd. Resources: {'key_pairs'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:52:02.499385 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-3ca90a8a-1fa1-40c0-b354-e14c2f49b76e tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Getting quotas for user 2ffbbf813488435bb54edbbfedea84fc and project 3aa81dd5f183418a8bf268f7618d38dd. Resources: {'key_pairs'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:52:02.525744 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-3ca90a8a-1fa1-40c0-b354-e14c2f49b76e tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.233784 Sep 14 09:52:02.526507 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3862/7186] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Sep 14 09:52:02 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:52:02.587269 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-86e7b767-c480-4c6b-a0b6-9ad030a289fd tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-609946301", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-462263794", "networks": [{"uuid": "3ee3346d-8612-443a-945d-749e378f4b46"}]}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:52:02.647971 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.network.neutron [None req-86e7b767-c480-4c6b-a0b6-9ad030a289fd tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] validate_networks() for [('3ee3346d-8612-443a-945d-749e378f4b46', None, None, None, None, None)] {{(pid=128759) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:52:03.038814 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-86e7b767-c480-4c6b-a0b6-9ad030a289fd tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Flavor limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:52:03.039288 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-86e7b767-c480-4c6b-a0b6-9ad030a289fd tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Image limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:52:03.039771 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-86e7b767-c480-4c6b-a0b6-9ad030a289fd tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Flavor pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:52:03.040188 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-86e7b767-c480-4c6b-a0b6-9ad030a289fd tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Image pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:52:03.040607 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-86e7b767-c480-4c6b-a0b6-9ad030a289fd tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:52:03.049389 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-86e7b767-c480-4c6b-a0b6-9ad030a289fd tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:03.049877 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-86e7b767-c480-4c6b-a0b6-9ad030a289fd tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:03.050321 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-86e7b767-c480-4c6b-a0b6-9ad030a289fd tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:03.051596 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-86e7b767-c480-4c6b-a0b6-9ad030a289fd tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:03.052060 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-86e7b767-c480-4c6b-a0b6-9ad030a289fd tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:03.052510 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-86e7b767-c480-4c6b-a0b6-9ad030a289fd tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:03.069571 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-86e7b767-c480-4c6b-a0b6-9ad030a289fd tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Getting quotas for project 3aa81dd5f183418a8bf268f7618d38dd. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:52:03.074736 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-86e7b767-c480-4c6b-a0b6-9ad030a289fd tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Getting quotas for user 2ffbbf813488435bb54edbbfedea84fc and project 3aa81dd5f183418a8bf268f7618d38dd. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:52:03.087062 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-86e7b767-c480-4c6b-a0b6-9ad030a289fd tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Going to run 1 instances... {{(pid=128759) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:52:03.089343 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-86e7b767-c480-4c6b-a0b6-9ad030a289fd tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] [instance: 35944dfd-8739-49d5-a153-e6e8f0e49f55] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128759) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:52:03.136390 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-86e7b767-c480-4c6b-a0b6-9ad030a289fd tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.553219 Sep 14 09:52:03.137053 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3863/7187] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 09:52:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 555 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:52:03.147721 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-030a9c11-b0a4-466e-a861-32ef514ef574 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:52:03.148540 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-030a9c11-b0a4-466e-a861-32ef514ef574 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] [instance: 35944dfd-8739-49d5-a153-e6e8f0e49f55] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:52:03.205061 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-030a9c11-b0a4-466e-a861-32ef514ef574 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffbbf813488435bb54edbbfedea84fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa81dd5f183418a8bf268f7618d38dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:52:03.215489 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-030a9c11-b0a4-466e-a861-32ef514ef574 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] 10.222.0.60 "GET /compute/v2.1/servers/35944dfd-8739-49d5-a153-e6e8f0e49f55" status: 200 len: 1261 microversion: 2.1 time: 0.071425 Sep 14 09:52:03.216065 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3864/7188] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:52:03 2022] GET /compute/v2.1/servers/35944dfd-8739-49d5-a153-e6e8f0e49f55 => generated 1261 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:52:04.237862 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-16db48c8-f6fe-4f9c-b9b6-7f55163474d7 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:52:04.238518 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-16db48c8-f6fe-4f9c-b9b6-7f55163474d7 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] [instance: 35944dfd-8739-49d5-a153-e6e8f0e49f55] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:52:04.245572 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-16db48c8-f6fe-4f9c-b9b6-7f55163474d7 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:04.246038 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-16db48c8-f6fe-4f9c-b9b6-7f55163474d7 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:04.246479 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-16db48c8-f6fe-4f9c-b9b6-7f55163474d7 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:04.247201 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-16db48c8-f6fe-4f9c-b9b6-7f55163474d7 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:04.247656 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-16db48c8-f6fe-4f9c-b9b6-7f55163474d7 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:04.248083 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-16db48c8-f6fe-4f9c-b9b6-7f55163474d7 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:04.314041 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-16db48c8-f6fe-4f9c-b9b6-7f55163474d7 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffbbf813488435bb54edbbfedea84fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa81dd5f183418a8bf268f7618d38dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:52:04.324307 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-16db48c8-f6fe-4f9c-b9b6-7f55163474d7 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] 10.222.0.60 "GET /compute/v2.1/servers/35944dfd-8739-49d5-a153-e6e8f0e49f55" status: 200 len: 1313 microversion: 2.1 time: 0.090471 Sep 14 09:52:04.324922 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3865/7189] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:52:04 2022] GET /compute/v2.1/servers/35944dfd-8739-49d5-a153-e6e8f0e49f55 => generated 1313 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:52:05.349492 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-1f5ae212-5b91-4564-b965-084bf98022f0 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:52:05.350168 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-1f5ae212-5b91-4564-b965-084bf98022f0 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] [instance: 35944dfd-8739-49d5-a153-e6e8f0e49f55] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:52:05.357729 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1f5ae212-5b91-4564-b965-084bf98022f0 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:05.358306 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1f5ae212-5b91-4564-b965-084bf98022f0 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:05.358911 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1f5ae212-5b91-4564-b965-084bf98022f0 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:05.359968 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1f5ae212-5b91-4564-b965-084bf98022f0 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:05.360585 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1f5ae212-5b91-4564-b965-084bf98022f0 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:05.361409 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1f5ae212-5b91-4564-b965-084bf98022f0 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:05.508022 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-1f5ae212-5b91-4564-b965-084bf98022f0 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffbbf813488435bb54edbbfedea84fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa81dd5f183418a8bf268f7618d38dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:52:05.516618 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-1f5ae212-5b91-4564-b965-084bf98022f0 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] 10.222.0.60 "GET /compute/v2.1/servers/35944dfd-8739-49d5-a153-e6e8f0e49f55" status: 200 len: 1361 microversion: 2.1 time: 0.172113 Sep 14 09:52:05.517278 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3866/7190] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:52:05 2022] GET /compute/v2.1/servers/35944dfd-8739-49d5-a153-e6e8f0e49f55 => generated 1361 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:52:05.930882 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-eba6d4a5-ae35-4d30-a9fa-cb639598cb6a req-2af30f71-0eae-43f8-aa1a-1d79ca4f78ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35944dfd-8739-49d5-a153-e6e8f0e49f55", "tag": "e0cb1b97-19d5-475b-b768-42762af84b4e"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:52:05.940580 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-eba6d4a5-ae35-4d30-a9fa-cb639598cb6a req-2af30f71-0eae-43f8-aa1a-1d79ca4f78ee service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:05.941294 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-eba6d4a5-ae35-4d30-a9fa-cb639598cb6a req-2af30f71-0eae-43f8-aa1a-1d79ca4f78ee service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:05.942324 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-eba6d4a5-ae35-4d30-a9fa-cb639598cb6a req-2af30f71-0eae-43f8-aa1a-1d79ca4f78ee service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:05.955033 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-eba6d4a5-ae35-4d30-a9fa-cb639598cb6a req-2af30f71-0eae-43f8-aa1a-1d79ca4f78ee service nova] Creating event network-changed:e0cb1b97-19d5-475b-b768-42762af84b4e for instance 35944dfd-8739-49d5-a153-e6e8f0e49f55 on n-h2-836830-18 Sep 14 09:52:05.962827 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-eba6d4a5-ae35-4d30-a9fa-cb639598cb6a req-2af30f71-0eae-43f8-aa1a-1d79ca4f78ee service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035516 Sep 14 09:52:05.963496 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3867/7191] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:52:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:52:06.540367 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3fe9ac4a-d868-4d84-a64b-345cef5548f1 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:52:06.541919 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-3fe9ac4a-d868-4d84-a64b-345cef5548f1 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] [instance: 35944dfd-8739-49d5-a153-e6e8f0e49f55] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:52:06.549799 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3fe9ac4a-d868-4d84-a64b-345cef5548f1 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:06.550294 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3fe9ac4a-d868-4d84-a64b-345cef5548f1 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:06.550766 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3fe9ac4a-d868-4d84-a64b-345cef5548f1 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:06.551525 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3fe9ac4a-d868-4d84-a64b-345cef5548f1 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:06.551984 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3fe9ac4a-d868-4d84-a64b-345cef5548f1 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:06.552632 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3fe9ac4a-d868-4d84-a64b-345cef5548f1 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:06.711943 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-3fe9ac4a-d868-4d84-a64b-345cef5548f1 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffbbf813488435bb54edbbfedea84fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa81dd5f183418a8bf268f7618d38dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:52:06.722784 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-3fe9ac4a-d868-4d84-a64b-345cef5548f1 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] 10.222.0.60 "GET /compute/v2.1/servers/35944dfd-8739-49d5-a153-e6e8f0e49f55" status: 200 len: 1361 microversion: 2.1 time: 0.186487 Sep 14 09:52:06.723493 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3868/7192] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:52:06 2022] GET /compute/v2.1/servers/35944dfd-8739-49d5-a153-e6e8f0e49f55 => generated 1361 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:52:07.745932 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-4db41820-d7d4-4c7e-90a5-929f0defbe19 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:52:07.746567 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-4db41820-d7d4-4c7e-90a5-929f0defbe19 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] [instance: 35944dfd-8739-49d5-a153-e6e8f0e49f55] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:52:07.753330 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4db41820-d7d4-4c7e-90a5-929f0defbe19 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:07.753840 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4db41820-d7d4-4c7e-90a5-929f0defbe19 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:07.754893 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4db41820-d7d4-4c7e-90a5-929f0defbe19 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:07.755625 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4db41820-d7d4-4c7e-90a5-929f0defbe19 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:07.756088 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4db41820-d7d4-4c7e-90a5-929f0defbe19 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:07.756519 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4db41820-d7d4-4c7e-90a5-929f0defbe19 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:07.894165 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-4db41820-d7d4-4c7e-90a5-929f0defbe19 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffbbf813488435bb54edbbfedea84fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa81dd5f183418a8bf268f7618d38dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:52:07.902202 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-4db41820-d7d4-4c7e-90a5-929f0defbe19 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] 10.222.0.60 "GET /compute/v2.1/servers/35944dfd-8739-49d5-a153-e6e8f0e49f55" status: 200 len: 1361 microversion: 2.1 time: 0.160317 Sep 14 09:52:07.903027 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3869/7193] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:52:07 2022] GET /compute/v2.1/servers/35944dfd-8739-49d5-a153-e6e8f0e49f55 => generated 1361 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:52:08.925750 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-4360f588-c7f8-4972-8533-b22b6c712279 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:52:08.926486 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-4360f588-c7f8-4972-8533-b22b6c712279 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] [instance: 35944dfd-8739-49d5-a153-e6e8f0e49f55] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:52:08.933564 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4360f588-c7f8-4972-8533-b22b6c712279 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:08.934056 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4360f588-c7f8-4972-8533-b22b6c712279 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:08.934501 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4360f588-c7f8-4972-8533-b22b6c712279 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:08.935242 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4360f588-c7f8-4972-8533-b22b6c712279 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:08.935704 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4360f588-c7f8-4972-8533-b22b6c712279 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:08.936139 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4360f588-c7f8-4972-8533-b22b6c712279 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:09.075310 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-4360f588-c7f8-4972-8533-b22b6c712279 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffbbf813488435bb54edbbfedea84fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa81dd5f183418a8bf268f7618d38dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:52:09.083147 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-4360f588-c7f8-4972-8533-b22b6c712279 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] 10.222.0.60 "GET /compute/v2.1/servers/35944dfd-8739-49d5-a153-e6e8f0e49f55" status: 200 len: 1361 microversion: 2.1 time: 0.161308 Sep 14 09:52:09.083727 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3870/7194] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:52:08 2022] GET /compute/v2.1/servers/35944dfd-8739-49d5-a153-e6e8f0e49f55 => generated 1361 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:52:10.105672 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a627b828-d233-40f9-93ea-094b1248717d tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:52:10.106315 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-a627b828-d233-40f9-93ea-094b1248717d tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] [instance: 35944dfd-8739-49d5-a153-e6e8f0e49f55] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:52:10.112933 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a627b828-d233-40f9-93ea-094b1248717d tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:10.113457 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a627b828-d233-40f9-93ea-094b1248717d tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:10.113894 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a627b828-d233-40f9-93ea-094b1248717d tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:10.114593 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a627b828-d233-40f9-93ea-094b1248717d tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:10.115070 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a627b828-d233-40f9-93ea-094b1248717d tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:10.115494 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a627b828-d233-40f9-93ea-094b1248717d tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:10.248710 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-a627b828-d233-40f9-93ea-094b1248717d tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffbbf813488435bb54edbbfedea84fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa81dd5f183418a8bf268f7618d38dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:52:10.256979 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a627b828-d233-40f9-93ea-094b1248717d tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] 10.222.0.60 "GET /compute/v2.1/servers/35944dfd-8739-49d5-a153-e6e8f0e49f55" status: 200 len: 1361 microversion: 2.1 time: 0.155191 Sep 14 09:52:10.257544 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3871/7195] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:52:10 2022] GET /compute/v2.1/servers/35944dfd-8739-49d5-a153-e6e8f0e49f55 => generated 1361 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:52:10.261950 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-a5922e4f-d45b-4485-b926-c42ab1315e5e req-57a934ee-5f0a-45d4-bfed-3934f4478629 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35944dfd-8739-49d5-a153-e6e8f0e49f55", "name": "network-vif-plugged", "status": "completed", "tag": "e0cb1b97-19d5-475b-b768-42762af84b4e"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:52:10.271600 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-a5922e4f-d45b-4485-b926-c42ab1315e5e req-57a934ee-5f0a-45d4-bfed-3934f4478629 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:10.272074 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-a5922e4f-d45b-4485-b926-c42ab1315e5e req-57a934ee-5f0a-45d4-bfed-3934f4478629 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:10.272545 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-a5922e4f-d45b-4485-b926-c42ab1315e5e req-57a934ee-5f0a-45d4-bfed-3934f4478629 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:10.283773 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-a5922e4f-d45b-4485-b926-c42ab1315e5e req-57a934ee-5f0a-45d4-bfed-3934f4478629 service nova] Creating event network-vif-plugged:e0cb1b97-19d5-475b-b768-42762af84b4e for instance 35944dfd-8739-49d5-a153-e6e8f0e49f55 on n-h2-836830-18 Sep 14 09:52:10.289090 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-a5922e4f-d45b-4485-b926-c42ab1315e5e req-57a934ee-5f0a-45d4-bfed-3934f4478629 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030263 Sep 14 09:52:10.289677 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3872/7196] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:52:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:52:11.281472 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b66d2fd2-462a-4c4a-a254-f9ac0cfd3845 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:52:11.282107 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b66d2fd2-462a-4c4a-a254-f9ac0cfd3845 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] [instance: 35944dfd-8739-49d5-a153-e6e8f0e49f55] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:52:11.288313 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b66d2fd2-462a-4c4a-a254-f9ac0cfd3845 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:11.288801 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b66d2fd2-462a-4c4a-a254-f9ac0cfd3845 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:11.289241 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b66d2fd2-462a-4c4a-a254-f9ac0cfd3845 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:11.289928 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b66d2fd2-462a-4c4a-a254-f9ac0cfd3845 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:11.290384 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b66d2fd2-462a-4c4a-a254-f9ac0cfd3845 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:11.290808 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b66d2fd2-462a-4c4a-a254-f9ac0cfd3845 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:11.423143 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b66d2fd2-462a-4c4a-a254-f9ac0cfd3845 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffbbf813488435bb54edbbfedea84fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa81dd5f183418a8bf268f7618d38dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:52:11.431409 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b66d2fd2-462a-4c4a-a254-f9ac0cfd3845 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] 10.222.0.60 "GET /compute/v2.1/servers/35944dfd-8739-49d5-a153-e6e8f0e49f55" status: 200 len: 1361 microversion: 2.1 time: 0.155213 Sep 14 09:52:11.431998 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3873/7197] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:52:11 2022] GET /compute/v2.1/servers/35944dfd-8739-49d5-a153-e6e8f0e49f55 => generated 1361 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:52:12.455081 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-87a182f0-1c22-4a10-91a1-2016c1210b02 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:52:12.455744 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-87a182f0-1c22-4a10-91a1-2016c1210b02 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] [instance: 35944dfd-8739-49d5-a153-e6e8f0e49f55] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:52:12.462549 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-87a182f0-1c22-4a10-91a1-2016c1210b02 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:12.463075 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-87a182f0-1c22-4a10-91a1-2016c1210b02 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:12.463520 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-87a182f0-1c22-4a10-91a1-2016c1210b02 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:12.464212 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-87a182f0-1c22-4a10-91a1-2016c1210b02 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:12.464671 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-87a182f0-1c22-4a10-91a1-2016c1210b02 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:12.465108 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-87a182f0-1c22-4a10-91a1-2016c1210b02 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:12.598204 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-87a182f0-1c22-4a10-91a1-2016c1210b02 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffbbf813488435bb54edbbfedea84fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa81dd5f183418a8bf268f7618d38dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:52:12.606117 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-87a182f0-1c22-4a10-91a1-2016c1210b02 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] 10.222.0.60 "GET /compute/v2.1/servers/35944dfd-8739-49d5-a153-e6e8f0e49f55" status: 200 len: 1552 microversion: 2.1 time: 0.154970 Sep 14 09:52:12.606701 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3874/7198] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:52:12 2022] GET /compute/v2.1/servers/35944dfd-8739-49d5-a153-e6e8f0e49f55 => generated 1552 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:52:12.629216 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-76068c25-289a-4e41-b10a-46506c5ea760 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:52:12.629837 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-76068c25-289a-4e41-b10a-46506c5ea760 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] [instance: 35944dfd-8739-49d5-a153-e6e8f0e49f55] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:52:12.635594 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-76068c25-289a-4e41-b10a-46506c5ea760 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:12.636088 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-76068c25-289a-4e41-b10a-46506c5ea760 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:12.636531 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-76068c25-289a-4e41-b10a-46506c5ea760 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:12.637226 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-76068c25-289a-4e41-b10a-46506c5ea760 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:12.637685 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-76068c25-289a-4e41-b10a-46506c5ea760 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:12.638114 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-76068c25-289a-4e41-b10a-46506c5ea760 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:12.765556 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-76068c25-289a-4e41-b10a-46506c5ea760 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffbbf813488435bb54edbbfedea84fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa81dd5f183418a8bf268f7618d38dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:52:12.773904 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-76068c25-289a-4e41-b10a-46506c5ea760 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] 10.222.0.60 "GET /compute/v2.1/servers/35944dfd-8739-49d5-a153-e6e8f0e49f55" status: 200 len: 1552 microversion: 2.1 time: 0.148664 Sep 14 09:52:12.774491 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3875/7199] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:52:12 2022] GET /compute/v2.1/servers/35944dfd-8739-49d5-a153-e6e8f0e49f55 => generated 1552 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:52:14.383475 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-6613d97d-006f-4908-8ed0-cc5280c4e69d tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "daac0114-1f6b-4362-b85c-a47b3f6eaf84"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:52:14.385822 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-6613d97d-006f-4908-8ed0-cc5280c4e69d tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] [instance: 35944dfd-8739-49d5-a153-e6e8f0e49f55] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:52:14.387892 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=2 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:52:14.388596 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=12 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:52:14.395335 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6613d97d-006f-4908-8ed0-cc5280c4e69d tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:14.395830 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6613d97d-006f-4908-8ed0-cc5280c4e69d tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:14.396268 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6613d97d-006f-4908-8ed0-cc5280c4e69d tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:14.396957 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6613d97d-006f-4908-8ed0-cc5280c4e69d tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:14.397413 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6613d97d-006f-4908-8ed0-cc5280c4e69d tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:14.397874 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6613d97d-006f-4908-8ed0-cc5280c4e69d tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:14.638859 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-6613d97d-006f-4908-8ed0-cc5280c4e69d tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] 10.222.0.60 "POST /compute/v2.1/servers/35944dfd-8739-49d5-a153-e6e8f0e49f55/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.259842 Sep 14 09:52:14.639513 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3876/7200] 10.222.0.60 () {60 vars in 1323 bytes} [Wed Sep 14 09:52:14 2022] POST /compute/v2.1/servers/35944dfd-8739-49d5-a153-e6e8f0e49f55/os-volume_attachments => generated 194 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:52:25.344248 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=4 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:52:25.345148 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:52:25.349926 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f660a2d1-4dda-4b60-9009-f4ebfbcbeb64 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:52:25.350520 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f660a2d1-4dda-4b60-9009-f4ebfbcbeb64 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] [instance: 35944dfd-8739-49d5-a153-e6e8f0e49f55] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:52:25.358065 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f660a2d1-4dda-4b60-9009-f4ebfbcbeb64 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:25.358554 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f660a2d1-4dda-4b60-9009-f4ebfbcbeb64 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:25.359017 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f660a2d1-4dda-4b60-9009-f4ebfbcbeb64 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:25.359716 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f660a2d1-4dda-4b60-9009-f4ebfbcbeb64 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:25.360171 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f660a2d1-4dda-4b60-9009-f4ebfbcbeb64 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:25.360598 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f660a2d1-4dda-4b60-9009-f4ebfbcbeb64 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:25.709687 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.objects.instance [None req-f660a2d1-4dda-4b60-9009-f4ebfbcbeb64 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lazy-loading 'services' on Instance uuid 35944dfd-8739-49d5-a153-e6e8f0e49f55 {{(pid=128759) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:52:25.778620 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f660a2d1-4dda-4b60-9009-f4ebfbcbeb64 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] 10.222.0.60 "DELETE /compute/v2.1/servers/35944dfd-8739-49d5-a153-e6e8f0e49f55/os-volume_attachments/daac0114-1f6b-4362-b85c-a47b3f6eaf84" status: 202 len: 0 microversion: 2.1 time: 0.436413 Sep 14 09:52:25.779351 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3877/7201] 10.222.0.60 () {58 vars in 1416 bytes} [Wed Sep 14 09:52:25 2022] DELETE /compute/v2.1/servers/35944dfd-8739-49d5-a153-e6e8f0e49f55/os-volume_attachments/daac0114-1f6b-4362-b85c-a47b3f6eaf84 => generated 0 bytes in 438 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 14 09:52:25.787816 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-fabf0bdf-1deb-44ad-a350-03de804c468a tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:52:25.790143 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-fabf0bdf-1deb-44ad-a350-03de804c468a tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] [instance: 35944dfd-8739-49d5-a153-e6e8f0e49f55] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:52:25.796697 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fabf0bdf-1deb-44ad-a350-03de804c468a tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:25.797229 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fabf0bdf-1deb-44ad-a350-03de804c468a tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:25.797670 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fabf0bdf-1deb-44ad-a350-03de804c468a tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:25.798366 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fabf0bdf-1deb-44ad-a350-03de804c468a tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:25.798861 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fabf0bdf-1deb-44ad-a350-03de804c468a tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:25.799655 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fabf0bdf-1deb-44ad-a350-03de804c468a tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:25.830105 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-fabf0bdf-1deb-44ad-a350-03de804c468a tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] 10.222.0.60 "GET /compute/v2.1/servers/35944dfd-8739-49d5-a153-e6e8f0e49f55/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046232 Sep 14 09:52:25.830651 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3878/7202] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 14 09:52:25 2022] GET /compute/v2.1/servers/35944dfd-8739-49d5-a153-e6e8f0e49f55/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:52:26.842654 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b00d64ab-9e0f-4c4f-a42f-591ebafeff68 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:52:26.845124 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b00d64ab-9e0f-4c4f-a42f-591ebafeff68 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] [instance: 35944dfd-8739-49d5-a153-e6e8f0e49f55] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:52:26.852322 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b00d64ab-9e0f-4c4f-a42f-591ebafeff68 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:26.852817 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b00d64ab-9e0f-4c4f-a42f-591ebafeff68 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:26.853260 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b00d64ab-9e0f-4c4f-a42f-591ebafeff68 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:26.853959 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b00d64ab-9e0f-4c4f-a42f-591ebafeff68 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:26.854416 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b00d64ab-9e0f-4c4f-a42f-591ebafeff68 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:26.854843 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b00d64ab-9e0f-4c4f-a42f-591ebafeff68 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:26.885045 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b00d64ab-9e0f-4c4f-a42f-591ebafeff68 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] 10.222.0.60 "GET /compute/v2.1/servers/35944dfd-8739-49d5-a153-e6e8f0e49f55/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046347 Sep 14 09:52:26.885604 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3879/7203] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 14 09:52:26 2022] GET /compute/v2.1/servers/35944dfd-8739-49d5-a153-e6e8f0e49f55/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:52:27.897654 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-02978d69-b484-4f03-85c7-6b0fd4498704 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:52:27.899951 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-02978d69-b484-4f03-85c7-6b0fd4498704 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] [instance: 35944dfd-8739-49d5-a153-e6e8f0e49f55] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:52:27.906664 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-02978d69-b484-4f03-85c7-6b0fd4498704 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:27.907186 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-02978d69-b484-4f03-85c7-6b0fd4498704 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:27.907636 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-02978d69-b484-4f03-85c7-6b0fd4498704 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:27.908331 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-02978d69-b484-4f03-85c7-6b0fd4498704 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:27.908809 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-02978d69-b484-4f03-85c7-6b0fd4498704 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:27.909218 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-02978d69-b484-4f03-85c7-6b0fd4498704 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:27.939131 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-02978d69-b484-4f03-85c7-6b0fd4498704 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] 10.222.0.60 "GET /compute/v2.1/servers/35944dfd-8739-49d5-a153-e6e8f0e49f55/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045512 Sep 14 09:52:27.939696 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3880/7204] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 14 09:52:27 2022] GET /compute/v2.1/servers/35944dfd-8739-49d5-a153-e6e8f0e49f55/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:52:28.952188 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e18d8b6b-d10f-46a5-ac3a-e049a15f19ae tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:52:28.954420 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e18d8b6b-d10f-46a5-ac3a-e049a15f19ae tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] [instance: 35944dfd-8739-49d5-a153-e6e8f0e49f55] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:52:28.962273 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e18d8b6b-d10f-46a5-ac3a-e049a15f19ae tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:28.962772 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e18d8b6b-d10f-46a5-ac3a-e049a15f19ae tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:28.963263 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e18d8b6b-d10f-46a5-ac3a-e049a15f19ae tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:28.963974 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e18d8b6b-d10f-46a5-ac3a-e049a15f19ae tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:28.964437 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e18d8b6b-d10f-46a5-ac3a-e049a15f19ae tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:28.964871 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e18d8b6b-d10f-46a5-ac3a-e049a15f19ae tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:28.996171 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e18d8b6b-d10f-46a5-ac3a-e049a15f19ae tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] 10.222.0.60 "GET /compute/v2.1/servers/35944dfd-8739-49d5-a153-e6e8f0e49f55/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047270 Sep 14 09:52:28.996171 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3881/7205] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 14 09:52:28 2022] GET /compute/v2.1/servers/35944dfd-8739-49d5-a153-e6e8f0e49f55/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:52:30.008711 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-adbb4e5a-754f-489f-91e9-ce3b9f513547 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:52:30.013975 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-adbb4e5a-754f-489f-91e9-ce3b9f513547 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] [instance: 35944dfd-8739-49d5-a153-e6e8f0e49f55] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:52:30.020882 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-adbb4e5a-754f-489f-91e9-ce3b9f513547 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:30.021375 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-adbb4e5a-754f-489f-91e9-ce3b9f513547 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:30.021821 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-adbb4e5a-754f-489f-91e9-ce3b9f513547 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:30.022524 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-adbb4e5a-754f-489f-91e9-ce3b9f513547 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:30.023012 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-adbb4e5a-754f-489f-91e9-ce3b9f513547 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:30.023442 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-adbb4e5a-754f-489f-91e9-ce3b9f513547 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:30.059299 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-adbb4e5a-754f-489f-91e9-ce3b9f513547 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] 10.222.0.60 "GET /compute/v2.1/servers/35944dfd-8739-49d5-a153-e6e8f0e49f55/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054487 Sep 14 09:52:30.060344 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3882/7206] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 14 09:52:30 2022] GET /compute/v2.1/servers/35944dfd-8739-49d5-a153-e6e8f0e49f55/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:52:31.072052 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3b9bf7d6-5728-4b72-a78f-dc9fe7758aa5 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:52:31.074131 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-3b9bf7d6-5728-4b72-a78f-dc9fe7758aa5 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] [instance: 35944dfd-8739-49d5-a153-e6e8f0e49f55] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:52:31.081110 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3b9bf7d6-5728-4b72-a78f-dc9fe7758aa5 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:31.082103 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3b9bf7d6-5728-4b72-a78f-dc9fe7758aa5 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:31.082541 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3b9bf7d6-5728-4b72-a78f-dc9fe7758aa5 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:31.083267 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3b9bf7d6-5728-4b72-a78f-dc9fe7758aa5 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:31.083724 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3b9bf7d6-5728-4b72-a78f-dc9fe7758aa5 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:31.084150 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3b9bf7d6-5728-4b72-a78f-dc9fe7758aa5 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:31.114079 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-3b9bf7d6-5728-4b72-a78f-dc9fe7758aa5 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] 10.222.0.60 "GET /compute/v2.1/servers/35944dfd-8739-49d5-a153-e6e8f0e49f55/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046134 Sep 14 09:52:31.114648 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3883/7207] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 14 09:52:31 2022] GET /compute/v2.1/servers/35944dfd-8739-49d5-a153-e6e8f0e49f55/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 14 09:52:31.124819 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-fa5466be-468d-4ebf-af2f-c694579a6f00 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:52:31.125319 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-fa5466be-468d-4ebf-af2f-c694579a6f00 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] [instance: 35944dfd-8739-49d5-a153-e6e8f0e49f55] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:52:31.131676 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fa5466be-468d-4ebf-af2f-c694579a6f00 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:31.132167 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fa5466be-468d-4ebf-af2f-c694579a6f00 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:31.132640 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fa5466be-468d-4ebf-af2f-c694579a6f00 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:31.133364 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fa5466be-468d-4ebf-af2f-c694579a6f00 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:31.133825 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fa5466be-468d-4ebf-af2f-c694579a6f00 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:31.134252 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fa5466be-468d-4ebf-af2f-c694579a6f00 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:31.214341 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-fa5466be-468d-4ebf-af2f-c694579a6f00 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] HTTP exception thrown: Instance 35944dfd-8739-49d5-a153-e6e8f0e49f55 is not attached to volume daac0114-1f6b-4362-b85c-a47b3f6eaf84 Sep 14 09:52:31.228130 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-fa5466be-468d-4ebf-af2f-c694579a6f00 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Request method failure captured: Sep 14 09:52:31.228130 n-d-836830-18 devstack@n-api.service[128759]: request: DELETE /compute/v2.1/servers/35944dfd-8739-49d5-a153-e6e8f0e49f55/os-volume_attachments/daac0114-1f6b-4362-b85c-a47b3f6eaf84 HTTP/1.1 Sep 14 09:52:31.228130 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:52:31.228130 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:52:31.228130 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:52:31.228130 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:52:31.228130 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:52:31.228130 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:52:31.228130 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:52:31.228130 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:52:31.228130 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIaQ9jLg9OYKsTKIqRb0AS5YYNhe9kr_ANsACd1isdaYhW78CTX8cL8Q5Vws63wMqQgUtcZO_6u0GyZVv47VX5G9QiK0sNZWYNnxbw9fc-dt0RlmInzl7MtLdFsG3iXVkLxLLITALqIUXoC1qK41C97F_1345yVQwyuOW-yGqKnQelJY Sep 14 09:52:31.228130 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:52:31.228130 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:52:31.228130 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:52:31.228130 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:52:31.228130 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:52:31.228130 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:52:31.228130 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 3aa81dd5f183418a8bf268f7618d38dd Sep 14 09:52:31.228130 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-TestEncryptedCinderVolumes-994755716 Sep 14 09:52:31.228130 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:52:31.228130 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:52:31.228130 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/3aa81dd5f183418a8bf268f7618d38dd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_3aa81dd5f183418a8bf268f7618d38dd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3aa81dd5f183418a8bf268f7618d38dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3aa81dd5f183418a8bf268f7618d38dd"}]}] Sep 14 09:52:31.228130 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-TestEncryptedCinderVolumes-994755716 Sep 14 09:52:31.228130 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 3aa81dd5f183418a8bf268f7618d38dd Sep 14 09:52:31.228130 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-994755716 Sep 14 09:52:31.228130 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-TestEncryptedCinderVolumes-994755716-project Sep 14 09:52:31.228130 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:52:31.228130 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:52:31.228130 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 2ffbbf813488435bb54edbbfedea84fc Sep 14 09:52:31.228130 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-TestEncryptedCinderVolumes-994755716-project Sep 14 09:52:31.228130 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:52:31.228130 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance 35944dfd-8739-49d5-a153-e6e8f0e49f55 is not attached to volume daac0114-1f6b-4362-b85c-a47b3f6eaf84 Sep 14 09:52:31.228130 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'server_id': '35944dfd-8739-49d5-a153-e6e8f0e49f55', 'id': 'daac0114-1f6b-4362-b85c-a47b3f6eaf84'} Sep 14 09:52:31.228130 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:52:31.228130 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:52:31.228130 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 14 09:52:31.228130 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 14 09:52:31.228130 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 14 09:52:31.228130 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 14 09:52:31.228130 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 14 09:52:31.228130 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 14 09:52:31.228130 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id daac0114-1f6b-4362-b85c-a47b3f6eaf84. Sep 14 09:52:31.228130 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:52:31.228130 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:52:31.228130 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:52:31.228130 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:52:31.228130 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:52:31.228130 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:52:31.228130 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:52:31.228130 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:52:31.228130 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:52:31.228130 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:52:31.228130 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 14 09:52:31.228130 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 14 09:52:31.228130 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35944dfd-8739-49d5-a153-e6e8f0e49f55 is not attached to volume daac0114-1f6b-4362-b85c-a47b3f6eaf84 Sep 14 09:52:31.228130 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:52:31.228130 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:52:31.228130 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:52:31.228130 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:52:31.228130 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:52:31.228130 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:52:31.232748 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:52:31.232748 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:52:31.232748 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35944dfd-8739-49d5-a153-e6e8f0e49f55 is not attached to volume daac0114-1f6b-4362-b85c-a47b3f6eaf84 Sep 14 09:52:31.232748 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:52:31.232748 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-fa5466be-468d-4ebf-af2f-c694579a6f00 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Returning 404 to user: Instance 35944dfd-8739-49d5-a153-e6e8f0e49f55 is not attached to volume daac0114-1f6b-4362-b85c-a47b3f6eaf84 {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:52:31.232748 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-fa5466be-468d-4ebf-af2f-c694579a6f00 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] 10.222.0.60 "DELETE /compute/v2.1/servers/35944dfd-8739-49d5-a153-e6e8f0e49f55/os-volume_attachments/daac0114-1f6b-4362-b85c-a47b3f6eaf84" status: 404 len: 154 microversion: 2.1 time: 0.108480 Sep 14 09:52:31.232748 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3884/7208] 10.222.0.60 () {58 vars in 1416 bytes} [Wed Sep 14 09:52:31 2022] DELETE /compute/v2.1/servers/35944dfd-8739-49d5-a153-e6e8f0e49f55/os-volume_attachments/daac0114-1f6b-4362-b85c-a47b3f6eaf84 => generated 154 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 14 09:52:34.580665 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3ef1814f-71ba-4133-86c3-099fa39a0f63 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:52:34.581272 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-3ef1814f-71ba-4133-86c3-099fa39a0f63 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] [instance: 35944dfd-8739-49d5-a153-e6e8f0e49f55] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:52:34.589910 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3ef1814f-71ba-4133-86c3-099fa39a0f63 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:34.590397 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3ef1814f-71ba-4133-86c3-099fa39a0f63 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:34.590842 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3ef1814f-71ba-4133-86c3-099fa39a0f63 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:34.591591 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3ef1814f-71ba-4133-86c3-099fa39a0f63 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:34.592084 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3ef1814f-71ba-4133-86c3-099fa39a0f63 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:34.592514 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3ef1814f-71ba-4133-86c3-099fa39a0f63 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:34.620498 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-3ef1814f-71ba-4133-86c3-099fa39a0f63 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] [instance: 35944dfd-8739-49d5-a153-e6e8f0e49f55] Going to try to terminate instance {{(pid=128759) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:52:34.699218 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-3ef1814f-71ba-4133-86c3-099fa39a0f63 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] 10.222.0.60 "DELETE /compute/v2.1/servers/35944dfd-8739-49d5-a153-e6e8f0e49f55" status: 204 len: 0 microversion: 2.1 time: 0.122420 Sep 14 09:52:34.699838 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3885/7209] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:52:34 2022] DELETE /compute/v2.1/servers/35944dfd-8739-49d5-a153-e6e8f0e49f55 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:52:34.708615 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-5ba72eb0-da9f-4132-9cf0-dfd1bb8fbfcc tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:52:34.709316 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-5ba72eb0-da9f-4132-9cf0-dfd1bb8fbfcc tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] [instance: 35944dfd-8739-49d5-a153-e6e8f0e49f55] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:52:34.715282 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5ba72eb0-da9f-4132-9cf0-dfd1bb8fbfcc tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:34.715713 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5ba72eb0-da9f-4132-9cf0-dfd1bb8fbfcc tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:34.716151 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5ba72eb0-da9f-4132-9cf0-dfd1bb8fbfcc tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:34.716842 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5ba72eb0-da9f-4132-9cf0-dfd1bb8fbfcc tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:34.717296 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5ba72eb0-da9f-4132-9cf0-dfd1bb8fbfcc tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:34.717723 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5ba72eb0-da9f-4132-9cf0-dfd1bb8fbfcc tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:34.853280 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-5ba72eb0-da9f-4132-9cf0-dfd1bb8fbfcc tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffbbf813488435bb54edbbfedea84fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa81dd5f183418a8bf268f7618d38dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:52:34.861061 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-5ba72eb0-da9f-4132-9cf0-dfd1bb8fbfcc tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] 10.222.0.60 "GET /compute/v2.1/servers/35944dfd-8739-49d5-a153-e6e8f0e49f55" status: 200 len: 1558 microversion: 2.1 time: 0.156662 Sep 14 09:52:34.861632 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3886/7210] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:52:34 2022] GET /compute/v2.1/servers/35944dfd-8739-49d5-a153-e6e8f0e49f55 => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:52:35.885739 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-951ec924-4dd4-4bed-8a71-a8a555aa1eb3 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:52:35.886387 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-951ec924-4dd4-4bed-8a71-a8a555aa1eb3 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] [instance: 35944dfd-8739-49d5-a153-e6e8f0e49f55] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:52:35.893422 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-951ec924-4dd4-4bed-8a71-a8a555aa1eb3 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:35.893893 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-951ec924-4dd4-4bed-8a71-a8a555aa1eb3 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:35.895036 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-951ec924-4dd4-4bed-8a71-a8a555aa1eb3 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:35.895735 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-951ec924-4dd4-4bed-8a71-a8a555aa1eb3 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:35.896197 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-951ec924-4dd4-4bed-8a71-a8a555aa1eb3 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:35.896631 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-951ec924-4dd4-4bed-8a71-a8a555aa1eb3 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:36.024170 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-951ec924-4dd4-4bed-8a71-a8a555aa1eb3 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffbbf813488435bb54edbbfedea84fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa81dd5f183418a8bf268f7618d38dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:52:36.031961 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-951ec924-4dd4-4bed-8a71-a8a555aa1eb3 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] 10.222.0.60 "GET /compute/v2.1/servers/35944dfd-8739-49d5-a153-e6e8f0e49f55" status: 200 len: 1558 microversion: 2.1 time: 0.150145 Sep 14 09:52:36.032536 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3887/7211] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:52:35 2022] GET /compute/v2.1/servers/35944dfd-8739-49d5-a153-e6e8f0e49f55 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:52:37.057737 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-23ca6387-ca9a-49e2-b8f8-9f8881da401b tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:52:37.058371 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-23ca6387-ca9a-49e2-b8f8-9f8881da401b tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] [instance: 35944dfd-8739-49d5-a153-e6e8f0e49f55] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:52:37.065658 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-23ca6387-ca9a-49e2-b8f8-9f8881da401b tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:37.066915 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-23ca6387-ca9a-49e2-b8f8-9f8881da401b tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:37.067388 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-23ca6387-ca9a-49e2-b8f8-9f8881da401b tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:37.068191 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-23ca6387-ca9a-49e2-b8f8-9f8881da401b tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:37.068553 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-23ca6387-ca9a-49e2-b8f8-9f8881da401b tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:37.068987 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-23ca6387-ca9a-49e2-b8f8-9f8881da401b tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:37.138108 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-23ca6387-ca9a-49e2-b8f8-9f8881da401b tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffbbf813488435bb54edbbfedea84fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa81dd5f183418a8bf268f7618d38dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:52:37.147834 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-23ca6387-ca9a-49e2-b8f8-9f8881da401b tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] 10.222.0.60 "GET /compute/v2.1/servers/35944dfd-8739-49d5-a153-e6e8f0e49f55" status: 200 len: 1516 microversion: 2.1 time: 0.095001 Sep 14 09:52:37.148421 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3888/7212] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:52:37 2022] GET /compute/v2.1/servers/35944dfd-8739-49d5-a153-e6e8f0e49f55 => generated 1516 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:52:37.209605 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-53b549b4-b5d6-4d4c-9f77-d93284f36b25 req-e8125611-c063-4b15-9c9e-3163fa1ced8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35944dfd-8739-49d5-a153-e6e8f0e49f55", "name": "network-vif-deleted", "tag": "e0cb1b97-19d5-475b-b768-42762af84b4e"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:52:37.219708 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-53b549b4-b5d6-4d4c-9f77-d93284f36b25 req-e8125611-c063-4b15-9c9e-3163fa1ced8f service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:37.220201 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-53b549b4-b5d6-4d4c-9f77-d93284f36b25 req-e8125611-c063-4b15-9c9e-3163fa1ced8f service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:37.220641 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-53b549b4-b5d6-4d4c-9f77-d93284f36b25 req-e8125611-c063-4b15-9c9e-3163fa1ced8f service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:37.232460 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-53b549b4-b5d6-4d4c-9f77-d93284f36b25 req-e8125611-c063-4b15-9c9e-3163fa1ced8f service nova] Creating event network-vif-deleted:e0cb1b97-19d5-475b-b768-42762af84b4e for instance 35944dfd-8739-49d5-a153-e6e8f0e49f55 on n-h2-836830-18 Sep 14 09:52:37.237300 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-53b549b4-b5d6-4d4c-9f77-d93284f36b25 req-e8125611-c063-4b15-9c9e-3163fa1ced8f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087771 Sep 14 09:52:37.237917 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3889/7213] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:52:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:52:38.174033 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-2c5dca55-953d-4529-a1e8-0a5a9ffc6fe5 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:52:38.174762 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-2c5dca55-953d-4529-a1e8-0a5a9ffc6fe5 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] [instance: 35944dfd-8739-49d5-a153-e6e8f0e49f55] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:52:38.181771 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2c5dca55-953d-4529-a1e8-0a5a9ffc6fe5 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:38.182263 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2c5dca55-953d-4529-a1e8-0a5a9ffc6fe5 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:38.182708 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2c5dca55-953d-4529-a1e8-0a5a9ffc6fe5 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:38.183460 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2c5dca55-953d-4529-a1e8-0a5a9ffc6fe5 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:38.183912 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2c5dca55-953d-4529-a1e8-0a5a9ffc6fe5 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:38.184345 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2c5dca55-953d-4529-a1e8-0a5a9ffc6fe5 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:38.197593 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-2c5dca55-953d-4529-a1e8-0a5a9ffc6fe5 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] HTTP exception thrown: Instance 35944dfd-8739-49d5-a153-e6e8f0e49f55 could not be found. Sep 14 09:52:38.199261 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-2c5dca55-953d-4529-a1e8-0a5a9ffc6fe5 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Request method failure captured: Sep 14 09:52:38.199261 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/35944dfd-8739-49d5-a153-e6e8f0e49f55 HTTP/1.1 Sep 14 09:52:38.199261 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:52:38.199261 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:52:38.199261 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:52:38.199261 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:52:38.199261 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:52:38.199261 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:52:38.199261 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:52:38.199261 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:52:38.199261 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIaQ9jLg9OYKsTKIqRb0AS5YYNhe9kr_ANsACd1isdaYhW78CTX8cL8Q5Vws63wMqQgUtcZO_6u0GyZVv47VX5G9QiK0sNZWYNnxbw9fc-dt0RlmInzl7MtLdFsG3iXVkLxLLITALqIUXoC1qK41C97F_1345yVQwyuOW-yGqKnQelJY Sep 14 09:52:38.199261 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:52:38.199261 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:52:38.199261 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:52:38.199261 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:52:38.199261 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:52:38.199261 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:52:38.199261 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 3aa81dd5f183418a8bf268f7618d38dd Sep 14 09:52:38.199261 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-TestEncryptedCinderVolumes-994755716 Sep 14 09:52:38.199261 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:52:38.199261 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:52:38.199261 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/3aa81dd5f183418a8bf268f7618d38dd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_3aa81dd5f183418a8bf268f7618d38dd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3aa81dd5f183418a8bf268f7618d38dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3aa81dd5f183418a8bf268f7618d38dd"}]}] Sep 14 09:52:38.199261 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-TestEncryptedCinderVolumes-994755716 Sep 14 09:52:38.199261 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 3aa81dd5f183418a8bf268f7618d38dd Sep 14 09:52:38.199261 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-994755716 Sep 14 09:52:38.199261 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-TestEncryptedCinderVolumes-994755716-project Sep 14 09:52:38.199261 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:52:38.199261 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:52:38.199261 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 2ffbbf813488435bb54edbbfedea84fc Sep 14 09:52:38.199261 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-TestEncryptedCinderVolumes-994755716-project Sep 14 09:52:38.199261 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:52:38.199261 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance 35944dfd-8739-49d5-a153-e6e8f0e49f55 could not be found. Sep 14 09:52:38.199261 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '35944dfd-8739-49d5-a153-e6e8f0e49f55'} Sep 14 09:52:38.199261 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:52:38.199261 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:52:38.199261 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:52:38.199261 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:52:38.199261 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:52:38.199261 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:52:38.199261 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:52:38.199261 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:52:38.199261 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:52:38.199261 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:52:38.199261 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35944dfd-8739-49d5-a153-e6e8f0e49f55 could not be found. Sep 14 09:52:38.199261 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:52:38.199261 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:52:38.199261 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:52:38.199261 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:52:38.199261 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:52:38.199261 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:52:38.199261 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:52:38.199261 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:52:38.199261 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:52:38.199261 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:52:38.199261 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:52:38.199261 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:52:38.199261 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:52:38.199261 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:52:38.199261 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:52:38.199261 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:52:38.199261 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35944dfd-8739-49d5-a153-e6e8f0e49f55 could not be found. Sep 14 09:52:38.199261 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:52:38.199261 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:52:38.199261 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:52:38.204071 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:52:38.204071 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:52:38.204071 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:52:38.204071 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:52:38.204071 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:52:38.204071 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35944dfd-8739-49d5-a153-e6e8f0e49f55 could not be found. Sep 14 09:52:38.204071 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:52:38.204071 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-2c5dca55-953d-4529-a1e8-0a5a9ffc6fe5 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Returning 404 to user: Instance 35944dfd-8739-49d5-a153-e6e8f0e49f55 could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:52:38.204071 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-2c5dca55-953d-4529-a1e8-0a5a9ffc6fe5 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] 10.222.0.60 "GET /compute/v2.1/servers/35944dfd-8739-49d5-a153-e6e8f0e49f55" status: 404 len: 111 microversion: 2.1 time: 0.031934 Sep 14 09:52:38.204071 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3890/7214] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:52:38 2022] GET /compute/v2.1/servers/35944dfd-8739-49d5-a153-e6e8f0e49f55 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 14 09:52:38.208956 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e4b49bed-58d4-42ba-9997-83623e7780f9 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Calling method '.version_select at 0x7f7d3ec44430>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:52:38.229672 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e4b49bed-58d4-42ba-9997-83623e7780f9 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-462263794" status: 202 len: 0 microversion: 2.1 time: 0.024190 Sep 14 09:52:38.230445 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3891/7215] 10.222.0.60 () {58 vars in 1275 bytes} [Wed Sep 14 09:52:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-462263794 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 14 09:52:38.245333 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d46a0a7e-1e32-41cb-a303-6bba99ae747a tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Action: 'create', calling method: .version_select at 0x7f7d3ecb3040>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1108686810", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIYYSsVeWQOT9ybhc4jzvAv51avwcg+ItATvkY00rl0/q9siVWWvCJCy8r2oeMpkKxHyMJl3RvPSD7oQU5ysBtJj4QG9QFlWgJKT6Qcoy1zYijTgQ0aiEmdTsn2mkJTmlg=="}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:52:38.261207 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-d46a0a7e-1e32-41cb-a303-6bba99ae747a tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Getting quotas for project 3aa81dd5f183418a8bf268f7618d38dd. Resources: {'key_pairs'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:52:38.266283 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-d46a0a7e-1e32-41cb-a303-6bba99ae747a tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Getting quotas for user 2ffbbf813488435bb54edbbfedea84fc and project 3aa81dd5f183418a8bf268f7618d38dd. Resources: {'key_pairs'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:52:38.289560 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d46a0a7e-1e32-41cb-a303-6bba99ae747a tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.048135 Sep 14 09:52:38.290131 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3892/7216] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Sep 14 09:52:38 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:52:38.338667 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-1ed54c84-f9a9-4f58-96df-51cd6d48b602 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1062417017", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1108686810", "networks": [{"uuid": "3ee3346d-8612-443a-945d-749e378f4b46"}]}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:52:38.392498 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.network.neutron [None req-1ed54c84-f9a9-4f58-96df-51cd6d48b602 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] validate_networks() for [('3ee3346d-8612-443a-945d-749e378f4b46', None, None, None, None, None)] {{(pid=128759) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:52:38.811540 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-1ed54c84-f9a9-4f58-96df-51cd6d48b602 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Flavor limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:52:38.812399 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-1ed54c84-f9a9-4f58-96df-51cd6d48b602 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Image limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:52:38.813319 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-1ed54c84-f9a9-4f58-96df-51cd6d48b602 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Flavor pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:52:38.813735 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-1ed54c84-f9a9-4f58-96df-51cd6d48b602 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Image pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:52:38.814159 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-1ed54c84-f9a9-4f58-96df-51cd6d48b602 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:52:38.824294 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1ed54c84-f9a9-4f58-96df-51cd6d48b602 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:38.824778 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1ed54c84-f9a9-4f58-96df-51cd6d48b602 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:38.825241 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1ed54c84-f9a9-4f58-96df-51cd6d48b602 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:38.825949 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1ed54c84-f9a9-4f58-96df-51cd6d48b602 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:38.826408 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1ed54c84-f9a9-4f58-96df-51cd6d48b602 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:38.826851 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1ed54c84-f9a9-4f58-96df-51cd6d48b602 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:38.844382 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-1ed54c84-f9a9-4f58-96df-51cd6d48b602 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Getting quotas for project 3aa81dd5f183418a8bf268f7618d38dd. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:52:38.849731 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-1ed54c84-f9a9-4f58-96df-51cd6d48b602 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Getting quotas for user 2ffbbf813488435bb54edbbfedea84fc and project 3aa81dd5f183418a8bf268f7618d38dd. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:52:38.861891 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-1ed54c84-f9a9-4f58-96df-51cd6d48b602 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Going to run 1 instances... {{(pid=128759) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:52:38.864230 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-1ed54c84-f9a9-4f58-96df-51cd6d48b602 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] [instance: 701f1bdb-000a-4fa6-8e79-cd277daee20c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128759) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:52:38.911942 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-1ed54c84-f9a9-4f58-96df-51cd6d48b602 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.577156 Sep 14 09:52:38.912598 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3893/7217] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 09:52:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 578 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 14 09:52:38.923326 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a90f2056-0cc6-430b-b96d-feeb72aea4c2 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:52:38.923949 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-a90f2056-0cc6-430b-b96d-feeb72aea4c2 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] [instance: 701f1bdb-000a-4fa6-8e79-cd277daee20c] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:52:38.983464 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-a90f2056-0cc6-430b-b96d-feeb72aea4c2 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffbbf813488435bb54edbbfedea84fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa81dd5f183418a8bf268f7618d38dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:52:38.991880 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a90f2056-0cc6-430b-b96d-feeb72aea4c2 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] 10.222.0.60 "GET /compute/v2.1/servers/701f1bdb-000a-4fa6-8e79-cd277daee20c" status: 200 len: 1263 microversion: 2.1 time: 0.072162 Sep 14 09:52:38.992725 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3894/7218] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:52:38 2022] GET /compute/v2.1/servers/701f1bdb-000a-4fa6-8e79-cd277daee20c => generated 1263 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:52:40.016055 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-5b679332-b259-444e-a12b-8a29d5fff71b tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:52:40.016967 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-5b679332-b259-444e-a12b-8a29d5fff71b tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] [instance: 701f1bdb-000a-4fa6-8e79-cd277daee20c] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:52:40.025183 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5b679332-b259-444e-a12b-8a29d5fff71b tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:40.025758 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5b679332-b259-444e-a12b-8a29d5fff71b tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:40.026281 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5b679332-b259-444e-a12b-8a29d5fff71b tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:40.027260 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5b679332-b259-444e-a12b-8a29d5fff71b tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:40.027918 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5b679332-b259-444e-a12b-8a29d5fff71b tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:40.028361 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5b679332-b259-444e-a12b-8a29d5fff71b tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:40.094598 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-5b679332-b259-444e-a12b-8a29d5fff71b tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffbbf813488435bb54edbbfedea84fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa81dd5f183418a8bf268f7618d38dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:52:40.103212 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-5b679332-b259-444e-a12b-8a29d5fff71b tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] 10.222.0.60 "GET /compute/v2.1/servers/701f1bdb-000a-4fa6-8e79-cd277daee20c" status: 200 len: 1321 microversion: 2.1 time: 0.091308 Sep 14 09:52:40.103804 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3895/7219] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:52:40 2022] GET /compute/v2.1/servers/701f1bdb-000a-4fa6-8e79-cd277daee20c => generated 1321 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:52:41.126317 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b3c216e2-508e-4465-a4f4-267537bc7c24 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:52:41.126980 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b3c216e2-508e-4465-a4f4-267537bc7c24 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] [instance: 701f1bdb-000a-4fa6-8e79-cd277daee20c] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:52:41.133799 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b3c216e2-508e-4465-a4f4-267537bc7c24 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:41.134296 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b3c216e2-508e-4465-a4f4-267537bc7c24 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:41.134743 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b3c216e2-508e-4465-a4f4-267537bc7c24 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:41.135476 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b3c216e2-508e-4465-a4f4-267537bc7c24 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:41.135939 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b3c216e2-508e-4465-a4f4-267537bc7c24 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:41.136371 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b3c216e2-508e-4465-a4f4-267537bc7c24 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:41.140778 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:52:41.274217 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b3c216e2-508e-4465-a4f4-267537bc7c24 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffbbf813488435bb54edbbfedea84fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa81dd5f183418a8bf268f7618d38dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:52:41.282401 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b3c216e2-508e-4465-a4f4-267537bc7c24 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] 10.222.0.60 "GET /compute/v2.1/servers/701f1bdb-000a-4fa6-8e79-cd277daee20c" status: 200 len: 1363 microversion: 2.1 time: 0.160036 Sep 14 09:52:41.291003 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3896/7220] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:52:41 2022] GET /compute/v2.1/servers/701f1bdb-000a-4fa6-8e79-cd277daee20c => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:52:41.291003 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-856871fa-6e70-485b-bfa2-bc54504447b0 req-0557ae18-b858-4ef0-a2c3-d69f72889c07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "701f1bdb-000a-4fa6-8e79-cd277daee20c", "tag": "da77f79a-eb47-4d6a-a052-669c0169d3af"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:52:41.300160 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-856871fa-6e70-485b-bfa2-bc54504447b0 req-0557ae18-b858-4ef0-a2c3-d69f72889c07 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:41.300160 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-856871fa-6e70-485b-bfa2-bc54504447b0 req-0557ae18-b858-4ef0-a2c3-d69f72889c07 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:41.300160 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-856871fa-6e70-485b-bfa2-bc54504447b0 req-0557ae18-b858-4ef0-a2c3-d69f72889c07 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:41.311131 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-856871fa-6e70-485b-bfa2-bc54504447b0 req-0557ae18-b858-4ef0-a2c3-d69f72889c07 service nova] Creating event network-changed:da77f79a-eb47-4d6a-a052-669c0169d3af for instance 701f1bdb-000a-4fa6-8e79-cd277daee20c on n-h2-836830-18 Sep 14 09:52:41.316280 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-856871fa-6e70-485b-bfa2-bc54504447b0 req-0557ae18-b858-4ef0-a2c3-d69f72889c07 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032027 Sep 14 09:52:41.316870 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3897/7221] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:52:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:52:42.308340 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-1cd18791-7064-4838-8dc2-b48aff866482 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:52:42.309089 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-1cd18791-7064-4838-8dc2-b48aff866482 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] [instance: 701f1bdb-000a-4fa6-8e79-cd277daee20c] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:52:42.315295 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1cd18791-7064-4838-8dc2-b48aff866482 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:42.315786 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1cd18791-7064-4838-8dc2-b48aff866482 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:42.316815 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1cd18791-7064-4838-8dc2-b48aff866482 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:42.317508 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1cd18791-7064-4838-8dc2-b48aff866482 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:42.317968 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1cd18791-7064-4838-8dc2-b48aff866482 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:42.318398 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1cd18791-7064-4838-8dc2-b48aff866482 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:42.331828 n-d-836830-18 devstack@n-api.service[128758]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 09:52:42.332309 n-d-836830-18 devstack@n-api.service[128758]: Wed Sep 14 09:52:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.60) !!! Sep 14 09:52:42.341605 n-d-836830-18 devstack@n-api.service[128758]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 09:52:42.341752 n-d-836830-18 devstack@n-api.service[128758]: Wed Sep 14 09:52:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.60) !!! Sep 14 09:52:42.458951 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-1cd18791-7064-4838-8dc2-b48aff866482 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffbbf813488435bb54edbbfedea84fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa81dd5f183418a8bf268f7618d38dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:52:42.466862 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-1cd18791-7064-4838-8dc2-b48aff866482 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] 10.222.0.60 "GET /compute/v2.1/servers/701f1bdb-000a-4fa6-8e79-cd277daee20c" status: 200 len: 1363 microversion: 2.1 time: 0.163755 Sep 14 09:52:42.467467 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3898/7222] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:52:42 2022] GET /compute/v2.1/servers/701f1bdb-000a-4fa6-8e79-cd277daee20c => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:52:43.490298 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-6fa7f274-5009-461c-94b2-bbef091bfbdc tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:52:43.490975 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-6fa7f274-5009-461c-94b2-bbef091bfbdc tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] [instance: 701f1bdb-000a-4fa6-8e79-cd277daee20c] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:52:43.497843 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6fa7f274-5009-461c-94b2-bbef091bfbdc tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:43.498329 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6fa7f274-5009-461c-94b2-bbef091bfbdc tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:43.498769 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6fa7f274-5009-461c-94b2-bbef091bfbdc tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:43.499508 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6fa7f274-5009-461c-94b2-bbef091bfbdc tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:43.499967 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6fa7f274-5009-461c-94b2-bbef091bfbdc tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:43.500391 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6fa7f274-5009-461c-94b2-bbef091bfbdc tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:43.627747 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-6fa7f274-5009-461c-94b2-bbef091bfbdc tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffbbf813488435bb54edbbfedea84fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa81dd5f183418a8bf268f7618d38dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:52:43.636198 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-6fa7f274-5009-461c-94b2-bbef091bfbdc tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] 10.222.0.60 "GET /compute/v2.1/servers/701f1bdb-000a-4fa6-8e79-cd277daee20c" status: 200 len: 1363 microversion: 2.1 time: 0.150385 Sep 14 09:52:43.636778 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3899/7223] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:52:43 2022] GET /compute/v2.1/servers/701f1bdb-000a-4fa6-8e79-cd277daee20c => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:52:44.036307 n-d-836830-18 devstack@n-api.service[128758]: DEBUG neutronclient.v2_0.client [None req-c4ae7f40-d6b4-4290-92bf-456a72463013 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Error message: {"error": {"code": 401, "title": "Unauthorized", "message": "The request you have made requires authentication."}} {{(pid=128758) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 14 09:52:44.037136 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-c4ae7f40-d6b4-4290-92bf-456a72463013 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 500 len: 0 microversion: 2.1 time: 873.521884 Sep 14 09:52:44.099799 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack [None req-c4ae7f40-d6b4-4290-92bf-456a72463013 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Caught error: Not authorized.: nova.exception.Unauthorized: Not authorized. Sep 14 09:52:44.099799 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack Traceback (most recent call last): Sep 14 09:52:44.099799 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Sep 14 09:52:44.099799 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack return self.find_resource_by_id(resource, name_or_id, Sep 14 09:52:44.099799 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:52:44.099799 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack ret = obj(*args, **kwargs) Sep 14 09:52:44.099799 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Sep 14 09:52:44.099799 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack raise exceptions.NotFound(message=not_found_message) Sep 14 09:52:44.099799 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'tempest-secgroup-smoke-1175246649' Sep 14 09:52:44.099799 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack Sep 14 09:52:44.099799 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack During handling of the above exception, another exception occurred: Sep 14 09:52:44.099799 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack Sep 14 09:52:44.099799 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack Traceback (most recent call last): Sep 14 09:52:44.099799 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:52:44.099799 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack ret = obj(*args, **kwargs) Sep 14 09:52:44.099799 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 14 09:52:44.099799 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack exception_handler_v20(status_code, error_body) Sep 14 09:52:44.099799 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 14 09:52:44.099799 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack raise client_exc(message=error_message, Sep 14 09:52:44.099799 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack neutronclient.common.exceptions.Unauthorized: 401-{'error': {'code': 401, 'title': 'Unauthorized', 'message': 'The request you have made requires authentication.'}} Sep 14 09:52:44.099799 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack Neutron server returns request_ids: ['req-01f0bdc7-1c9a-4f68-bda9-6a3b4a87ef99'] Sep 14 09:52:44.099799 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack Sep 14 09:52:44.099799 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack During handling of the above exception, another exception occurred: Sep 14 09:52:44.099799 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack Sep 14 09:52:44.099799 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack Traceback (most recent call last): Sep 14 09:52:44.099799 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/openstack/__init__.py", line 95, in __call__ Sep 14 09:52:44.099799 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack return req.get_response(self.application) Sep 14 09:52:44.099799 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1313, in send Sep 14 09:52:44.099799 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack status, headers, app_iter = self.call_application( Sep 14 09:52:44.099799 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1278, in call_application Sep 14 09:52:44.099799 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack app_iter = application(self.environ, start_response) Sep 14 09:52:44.099799 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 129, in __call__ Sep 14 09:52:44.099799 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack resp = self.call_func(req, *args, **kw) Sep 14 09:52:44.099799 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 193, in call_func Sep 14 09:52:44.099799 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack return self.func(req, *args, **kwargs) Sep 14 09:52:44.099799 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/openstack/requestlog.py", line 104, in __call__ Sep 14 09:52:44.099799 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack self._log_req(req, res, start) Sep 14 09:52:44.099799 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 14 09:52:44.099799 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack self.force_reraise() Sep 14 09:52:44.099799 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 14 09:52:44.099799 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack raise self.value Sep 14 09:52:44.099799 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/openstack/requestlog.py", line 99, in __call__ Sep 14 09:52:44.099799 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack res = req.get_response(self.application) Sep 14 09:52:44.099799 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1313, in send Sep 14 09:52:44.099799 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack status, headers, app_iter = self.call_application( Sep 14 09:52:44.099799 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1278, in call_application Sep 14 09:52:44.099799 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack app_iter = application(self.environ, start_response) Sep 14 09:52:44.099799 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 143, in __call__ Sep 14 09:52:44.099799 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack return resp(environ, start_response) Sep 14 09:52:44.099799 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 129, in __call__ Sep 14 09:52:44.099799 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack resp = self.call_func(req, *args, **kw) Sep 14 09:52:44.099799 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 193, in call_func Sep 14 09:52:44.099799 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack return self.func(req, *args, **kwargs) Sep 14 09:52:44.099799 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/osprofiler/web.py", line 111, in __call__ Sep 14 09:52:44.099799 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack return request.get_response(self.application) Sep 14 09:52:44.099799 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1313, in send Sep 14 09:52:44.099799 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack status, headers, app_iter = self.call_application( Sep 14 09:52:44.099799 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1278, in call_application Sep 14 09:52:44.104213 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack app_iter = application(self.environ, start_response) Sep 14 09:52:44.104213 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 129, in __call__ Sep 14 09:52:44.104213 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack resp = self.call_func(req, *args, **kw) Sep 14 09:52:44.104213 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 193, in call_func Sep 14 09:52:44.104213 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack return self.func(req, *args, **kwargs) Sep 14 09:52:44.104213 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py", line 341, in __call__ Sep 14 09:52:44.104213 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack response = req.get_response(self._app) Sep 14 09:52:44.104213 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1313, in send Sep 14 09:52:44.104213 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack status, headers, app_iter = self.call_application( Sep 14 09:52:44.104213 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1278, in call_application Sep 14 09:52:44.104213 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack app_iter = application(self.environ, start_response) Sep 14 09:52:44.104213 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 143, in __call__ Sep 14 09:52:44.104213 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack return resp(environ, start_response) Sep 14 09:52:44.104213 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 143, in __call__ Sep 14 09:52:44.104213 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack return resp(environ, start_response) Sep 14 09:52:44.104213 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/routes/middleware.py", line 153, in __call__ Sep 14 09:52:44.104213 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack response = self.app(environ, start_response) Sep 14 09:52:44.104213 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 143, in __call__ Sep 14 09:52:44.104213 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack return resp(environ, start_response) Sep 14 09:52:44.104213 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 129, in __call__ Sep 14 09:52:44.104213 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack resp = self.call_func(req, *args, **kw) Sep 14 09:52:44.104213 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 193, in call_func Sep 14 09:52:44.104213 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack return self.func(req, *args, **kwargs) Sep 14 09:52:44.104213 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 486, in __call__ Sep 14 09:52:44.104213 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack return self._process_stack(request, action, action_args, Sep 14 09:52:44.104213 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:52:44.104213 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack action_result = self.dispatch(meth, request, action_args) Sep 14 09:52:44.104213 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:52:44.104213 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack return method(req=request, **action_args) Sep 14 09:52:44.104213 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:52:44.104213 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack return f(*args, **kwargs) Sep 14 09:52:44.104213 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:52:44.104213 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack return func(*args, **kwargs) Sep 14 09:52:44.104213 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:52:44.104213 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack return func(*args, **kwargs) Sep 14 09:52:44.104213 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:52:44.104213 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack return func(*args, **kwargs) Sep 14 09:52:44.104213 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack [Previous line repeated 10 more times] Sep 14 09:52:44.104213 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 14 09:52:44.104213 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack instances, resv_id = self.compute_api.create( Sep 14 09:52:44.104213 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 14 09:52:44.104213 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack return self._create_instance( Sep 14 09:52:44.104213 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Sep 14 09:52:44.104213 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack ) = self._validate_and_build_base_options( Sep 14 09:52:44.104213 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack File "/opt/stack/nova/nova/compute/api.py", line 1074, in _validate_and_build_base_options Sep 14 09:52:44.104213 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack security_groups = self._check_requested_secgroups( Sep 14 09:52:44.104213 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack File "/opt/stack/nova/nova/compute/api.py", line 521, in _check_requested_secgroups Sep 14 09:52:44.104213 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack secgroup_uuid = security_group_api.validate_name(context, secgroup) Sep 14 09:52:44.104213 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Sep 14 09:52:44.104213 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack return neutronv20.find_resourceid_by_name_or_id( Sep 14 09:52:44.104213 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Sep 14 09:52:44.104213 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack return find_resource_by_name_or_id(client, resource, name_or_id, Sep 14 09:52:44.104213 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Sep 14 09:52:44.104213 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack return client.find_resource(resource, name_or_id, project_id, Sep 14 09:52:44.104213 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:52:44.104213 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack ret = obj(*args, **kwargs) Sep 14 09:52:44.104213 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Sep 14 09:52:44.104213 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack return self._find_resource_by_name( Sep 14 09:52:44.108466 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:52:44.108466 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack ret = obj(*args, **kwargs) Sep 14 09:52:44.108466 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 457, in _find_resource_by_name Sep 14 09:52:44.108466 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack data = obj_lister(**params) Sep 14 09:52:44.108466 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:52:44.108466 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack ret = obj(*args, **kwargs) Sep 14 09:52:44.108466 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1063, in list_security_groups Sep 14 09:52:44.108466 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack return self.list('security_groups', self.security_groups_path, Sep 14 09:52:44.108466 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:52:44.108466 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack ret = obj(*args, **kwargs) Sep 14 09:52:44.108466 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 372, in list Sep 14 09:52:44.108466 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack for r in self._pagination(collection, path, **params): Sep 14 09:52:44.108466 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 387, in _pagination Sep 14 09:52:44.108466 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack res = self.get(path, params=params) Sep 14 09:52:44.108466 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:52:44.108466 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack ret = obj(*args, **kwargs) Sep 14 09:52:44.108466 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 14 09:52:44.108466 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack return self.retry_request("GET", action, body=body, Sep 14 09:52:44.108466 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:52:44.108466 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack ret = obj(*args, **kwargs) Sep 14 09:52:44.108466 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 14 09:52:44.108466 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack return self.do_request(method, action, body=body, Sep 14 09:52:44.108466 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:52:44.108466 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack ret = obj(*args, **kwargs) Sep 14 09:52:44.108466 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 14 09:52:44.108466 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack self._handle_fault_response(status_code, replybody, resp) Sep 14 09:52:44.108466 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 204, in wrapper Sep 14 09:52:44.108466 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack raise exception.Unauthorized() Sep 14 09:52:44.108466 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack nova.exception.Unauthorized: Not authorized. Sep 14 09:52:44.108466 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack Sep 14 09:52:44.108466 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack [None req-c4ae7f40-d6b4-4290-92bf-456a72463013 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] http://10.222.0.60/compute/v2.1/servers returned with HTTP 401 Sep 14 09:52:44.108466 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c4ae7f40-d6b4-4290-92bf-456a72463013 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Returning 401 to user: This server could not verify that you are authorized to access the document you requested. Either you supplied the wrong credentials (e.g., bad password), or your browser does not understand how to supply the credentials required. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:52:44.108466 n-d-836830-18 devstack@n-api.service[128758]: Wed Sep 14 09:52:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.60) !!! Sep 14 09:52:44.108466 n-d-836830-18 devstack@n-api.service[128758]: Wed Sep 14 09:52:44 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during POST /compute/v2.1/servers (10.222.0.60) Sep 14 09:52:44.108466 n-d-836830-18 devstack@n-api.service[128758]: CRITICAL nova [None req-c4ae7f40-d6b4-4290-92bf-456a72463013 tempest-TestVolumeBootPattern-1945148622 tempest-TestVolumeBootPattern-1945148622-project] Unhandled error: OSError: write error Sep 14 09:52:44.108466 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova OSError: write error Sep 14 09:52:44.108466 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova Sep 14 09:52:44.108466 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3325/7224] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 09:38:10 2022] POST /compute/v2.1/servers => generated 0 bytes in 873588 msecs (HTTP/1.1 401) 9 headers in 0 bytes (0 switches on core 0) Sep 14 09:52:44.659466 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-712f547b-5c43-48ec-9050-40d461694474 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:52:44.660896 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-712f547b-5c43-48ec-9050-40d461694474 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] [instance: 701f1bdb-000a-4fa6-8e79-cd277daee20c] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:52:44.667918 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-712f547b-5c43-48ec-9050-40d461694474 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:44.668414 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-712f547b-5c43-48ec-9050-40d461694474 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:44.668864 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-712f547b-5c43-48ec-9050-40d461694474 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:44.669572 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-712f547b-5c43-48ec-9050-40d461694474 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:44.670028 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-712f547b-5c43-48ec-9050-40d461694474 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:44.670469 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-712f547b-5c43-48ec-9050-40d461694474 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:44.813680 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-712f547b-5c43-48ec-9050-40d461694474 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffbbf813488435bb54edbbfedea84fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa81dd5f183418a8bf268f7618d38dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:52:44.821450 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-712f547b-5c43-48ec-9050-40d461694474 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] 10.222.0.60 "GET /compute/v2.1/servers/701f1bdb-000a-4fa6-8e79-cd277daee20c" status: 200 len: 1363 microversion: 2.1 time: 0.166096 Sep 14 09:52:44.822037 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3900/7225] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:52:44 2022] GET /compute/v2.1/servers/701f1bdb-000a-4fa6-8e79-cd277daee20c => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:52:45.846002 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-5cf316e2-5e78-4a00-8f38-669139c31238 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:52:45.846636 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-5cf316e2-5e78-4a00-8f38-669139c31238 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] [instance: 701f1bdb-000a-4fa6-8e79-cd277daee20c] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:52:45.855710 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5cf316e2-5e78-4a00-8f38-669139c31238 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:45.856217 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5cf316e2-5e78-4a00-8f38-669139c31238 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:45.856674 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5cf316e2-5e78-4a00-8f38-669139c31238 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:45.857387 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5cf316e2-5e78-4a00-8f38-669139c31238 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:45.857865 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5cf316e2-5e78-4a00-8f38-669139c31238 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:45.858310 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5cf316e2-5e78-4a00-8f38-669139c31238 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:45.989353 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-5cf316e2-5e78-4a00-8f38-669139c31238 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffbbf813488435bb54edbbfedea84fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa81dd5f183418a8bf268f7618d38dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:52:45.997087 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-5cf316e2-5e78-4a00-8f38-669139c31238 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] 10.222.0.60 "GET /compute/v2.1/servers/701f1bdb-000a-4fa6-8e79-cd277daee20c" status: 200 len: 1363 microversion: 2.1 time: 0.156791 Sep 14 09:52:45.997670 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3326/7226] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:52:45 2022] GET /compute/v2.1/servers/701f1bdb-000a-4fa6-8e79-cd277daee20c => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:52:46.496841 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-10ef1cf2-ea74-4a0f-a114-4e1fc913a611 req-c55b9755-32e5-4262-8491-fce2cffd8a0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "701f1bdb-000a-4fa6-8e79-cd277daee20c", "name": "network-vif-plugged", "status": "completed", "tag": "da77f79a-eb47-4d6a-a052-669c0169d3af"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:52:46.507697 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-10ef1cf2-ea74-4a0f-a114-4e1fc913a611 req-c55b9755-32e5-4262-8491-fce2cffd8a0b service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:46.508835 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-10ef1cf2-ea74-4a0f-a114-4e1fc913a611 req-c55b9755-32e5-4262-8491-fce2cffd8a0b service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:46.509570 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-10ef1cf2-ea74-4a0f-a114-4e1fc913a611 req-c55b9755-32e5-4262-8491-fce2cffd8a0b service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:46.525283 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-10ef1cf2-ea74-4a0f-a114-4e1fc913a611 req-c55b9755-32e5-4262-8491-fce2cffd8a0b service nova] Creating event network-vif-plugged:da77f79a-eb47-4d6a-a052-669c0169d3af for instance 701f1bdb-000a-4fa6-8e79-cd277daee20c on n-h2-836830-18 Sep 14 09:52:46.530447 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-10ef1cf2-ea74-4a0f-a114-4e1fc913a611 req-c55b9755-32e5-4262-8491-fce2cffd8a0b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091424 Sep 14 09:52:46.531160 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3901/7227] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:52:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:52:47.020696 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-16b14cab-a1ca-4690-a51e-7e66e014316c tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:52:47.021319 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-16b14cab-a1ca-4690-a51e-7e66e014316c tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] [instance: 701f1bdb-000a-4fa6-8e79-cd277daee20c] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:52:47.030365 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-16b14cab-a1ca-4690-a51e-7e66e014316c tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:47.030854 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-16b14cab-a1ca-4690-a51e-7e66e014316c tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:47.031329 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-16b14cab-a1ca-4690-a51e-7e66e014316c tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:47.032026 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-16b14cab-a1ca-4690-a51e-7e66e014316c tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:47.032490 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-16b14cab-a1ca-4690-a51e-7e66e014316c tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:47.032922 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-16b14cab-a1ca-4690-a51e-7e66e014316c tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:47.163036 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-16b14cab-a1ca-4690-a51e-7e66e014316c tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffbbf813488435bb54edbbfedea84fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa81dd5f183418a8bf268f7618d38dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:52:47.170658 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-16b14cab-a1ca-4690-a51e-7e66e014316c tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] 10.222.0.60 "GET /compute/v2.1/servers/701f1bdb-000a-4fa6-8e79-cd277daee20c" status: 200 len: 1363 microversion: 2.1 time: 0.153952 Sep 14 09:52:47.171275 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3327/7228] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:52:47 2022] GET /compute/v2.1/servers/701f1bdb-000a-4fa6-8e79-cd277daee20c => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:52:48.196155 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-504f4e95-10e7-4358-9a95-af82d067b786 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:52:48.196907 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-504f4e95-10e7-4358-9a95-af82d067b786 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] [instance: 701f1bdb-000a-4fa6-8e79-cd277daee20c] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:52:48.203150 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-504f4e95-10e7-4358-9a95-af82d067b786 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:48.203644 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-504f4e95-10e7-4358-9a95-af82d067b786 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:48.204091 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-504f4e95-10e7-4358-9a95-af82d067b786 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:48.204785 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-504f4e95-10e7-4358-9a95-af82d067b786 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:48.205243 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-504f4e95-10e7-4358-9a95-af82d067b786 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:48.205671 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-504f4e95-10e7-4358-9a95-af82d067b786 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:48.342072 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-504f4e95-10e7-4358-9a95-af82d067b786 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffbbf813488435bb54edbbfedea84fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa81dd5f183418a8bf268f7618d38dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:52:48.350856 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-504f4e95-10e7-4358-9a95-af82d067b786 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] 10.222.0.60 "GET /compute/v2.1/servers/701f1bdb-000a-4fa6-8e79-cd277daee20c" status: 200 len: 1553 microversion: 2.1 time: 0.160138 Sep 14 09:52:48.351469 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3902/7229] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:52:48 2022] GET /compute/v2.1/servers/701f1bdb-000a-4fa6-8e79-cd277daee20c => generated 1553 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:52:48.374386 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-4388a658-dbd3-4b58-9be6-c3b4fa2a5d5f tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:52:48.375125 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-4388a658-dbd3-4b58-9be6-c3b4fa2a5d5f tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] [instance: 701f1bdb-000a-4fa6-8e79-cd277daee20c] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:52:48.384454 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4388a658-dbd3-4b58-9be6-c3b4fa2a5d5f tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:48.384958 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4388a658-dbd3-4b58-9be6-c3b4fa2a5d5f tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:48.385414 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4388a658-dbd3-4b58-9be6-c3b4fa2a5d5f tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:48.386131 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4388a658-dbd3-4b58-9be6-c3b4fa2a5d5f tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:48.386604 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4388a658-dbd3-4b58-9be6-c3b4fa2a5d5f tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:48.387082 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4388a658-dbd3-4b58-9be6-c3b4fa2a5d5f tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:48.514815 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-4388a658-dbd3-4b58-9be6-c3b4fa2a5d5f tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffbbf813488435bb54edbbfedea84fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa81dd5f183418a8bf268f7618d38dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:52:48.523321 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-4388a658-dbd3-4b58-9be6-c3b4fa2a5d5f tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] 10.222.0.60 "GET /compute/v2.1/servers/701f1bdb-000a-4fa6-8e79-cd277daee20c" status: 200 len: 1553 microversion: 2.1 time: 0.153058 Sep 14 09:52:48.523908 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3328/7230] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:52:48 2022] GET /compute/v2.1/servers/701f1bdb-000a-4fa6-8e79-cd277daee20c => generated 1553 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:52:50.009753 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-64772e0e-965f-49c6-ac45-887e6794db29 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cd575360-4619-44d9-9633-ce51f87f6e2d"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:52:50.012082 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-64772e0e-965f-49c6-ac45-887e6794db29 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] [instance: 701f1bdb-000a-4fa6-8e79-cd277daee20c] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:52:50.014053 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=2 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:52:50.014806 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=12 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:52:50.022152 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-64772e0e-965f-49c6-ac45-887e6794db29 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:50.023137 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-64772e0e-965f-49c6-ac45-887e6794db29 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:50.023590 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-64772e0e-965f-49c6-ac45-887e6794db29 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:50.024297 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-64772e0e-965f-49c6-ac45-887e6794db29 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:50.024769 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-64772e0e-965f-49c6-ac45-887e6794db29 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:50.025203 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-64772e0e-965f-49c6-ac45-887e6794db29 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:50.256639 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-64772e0e-965f-49c6-ac45-887e6794db29 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] 10.222.0.60 "POST /compute/v2.1/servers/701f1bdb-000a-4fa6-8e79-cd277daee20c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.250668 Sep 14 09:52:50.257274 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3903/7231] 10.222.0.60 () {60 vars in 1323 bytes} [Wed Sep 14 09:52:50 2022] POST /compute/v2.1/servers/701f1bdb-000a-4fa6-8e79-cd277daee20c/os-volume_attachments => generated 194 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:53:01.148857 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-981f84ef-5015-4820-a09f-1a8e99a5ed9a tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:53:01.149418 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-981f84ef-5015-4820-a09f-1a8e99a5ed9a tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] [instance: 701f1bdb-000a-4fa6-8e79-cd277daee20c] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:53:01.151646 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=6 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:53:01.152478 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=18 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:53:01.158141 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-981f84ef-5015-4820-a09f-1a8e99a5ed9a tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:01.158634 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-981f84ef-5015-4820-a09f-1a8e99a5ed9a tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:01.159112 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-981f84ef-5015-4820-a09f-1a8e99a5ed9a tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:01.160342 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-981f84ef-5015-4820-a09f-1a8e99a5ed9a tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:01.160802 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-981f84ef-5015-4820-a09f-1a8e99a5ed9a tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:01.161232 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-981f84ef-5015-4820-a09f-1a8e99a5ed9a tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:01.240869 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.objects.instance [None req-981f84ef-5015-4820-a09f-1a8e99a5ed9a tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lazy-loading 'services' on Instance uuid 701f1bdb-000a-4fa6-8e79-cd277daee20c {{(pid=128758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:53:01.310673 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-981f84ef-5015-4820-a09f-1a8e99a5ed9a tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] 10.222.0.60 "DELETE /compute/v2.1/servers/701f1bdb-000a-4fa6-8e79-cd277daee20c/os-volume_attachments/cd575360-4619-44d9-9633-ce51f87f6e2d" status: 202 len: 0 microversion: 2.1 time: 0.165995 Sep 14 09:53:01.311313 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3329/7232] 10.222.0.60 () {58 vars in 1416 bytes} [Wed Sep 14 09:53:01 2022] DELETE /compute/v2.1/servers/701f1bdb-000a-4fa6-8e79-cd277daee20c/os-volume_attachments/cd575360-4619-44d9-9633-ce51f87f6e2d => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 14 09:53:01.320716 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-4b013660-d032-41f7-982b-d399323e1478 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:53:01.323126 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-4b013660-d032-41f7-982b-d399323e1478 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] [instance: 701f1bdb-000a-4fa6-8e79-cd277daee20c] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:53:01.325800 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:53:01.326637 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:53:01.333598 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4b013660-d032-41f7-982b-d399323e1478 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:01.334088 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4b013660-d032-41f7-982b-d399323e1478 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:01.334557 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4b013660-d032-41f7-982b-d399323e1478 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:01.335285 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4b013660-d032-41f7-982b-d399323e1478 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:01.335742 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4b013660-d032-41f7-982b-d399323e1478 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:01.336203 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4b013660-d032-41f7-982b-d399323e1478 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:01.378137 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-4b013660-d032-41f7-982b-d399323e1478 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] 10.222.0.60 "GET /compute/v2.1/servers/701f1bdb-000a-4fa6-8e79-cd277daee20c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061954 Sep 14 09:53:01.378886 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3904/7233] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 14 09:53:01 2022] GET /compute/v2.1/servers/701f1bdb-000a-4fa6-8e79-cd277daee20c/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:53:02.394542 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-478eacfb-5e33-47b9-b73e-06fb6ab63093 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:53:02.397647 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-478eacfb-5e33-47b9-b73e-06fb6ab63093 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] [instance: 701f1bdb-000a-4fa6-8e79-cd277daee20c] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:53:02.404069 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-478eacfb-5e33-47b9-b73e-06fb6ab63093 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:02.404580 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-478eacfb-5e33-47b9-b73e-06fb6ab63093 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:02.405071 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-478eacfb-5e33-47b9-b73e-06fb6ab63093 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:02.405726 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-478eacfb-5e33-47b9-b73e-06fb6ab63093 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:02.406194 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-478eacfb-5e33-47b9-b73e-06fb6ab63093 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:02.406633 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-478eacfb-5e33-47b9-b73e-06fb6ab63093 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:02.437360 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-478eacfb-5e33-47b9-b73e-06fb6ab63093 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] 10.222.0.60 "GET /compute/v2.1/servers/701f1bdb-000a-4fa6-8e79-cd277daee20c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048684 Sep 14 09:53:02.437939 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3330/7234] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 14 09:53:02 2022] GET /compute/v2.1/servers/701f1bdb-000a-4fa6-8e79-cd277daee20c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:53:03.449827 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-37643b50-bafe-4c30-a01f-6c1c29316c63 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:53:03.452058 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-37643b50-bafe-4c30-a01f-6c1c29316c63 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] [instance: 701f1bdb-000a-4fa6-8e79-cd277daee20c] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:53:03.460565 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-37643b50-bafe-4c30-a01f-6c1c29316c63 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:03.461055 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-37643b50-bafe-4c30-a01f-6c1c29316c63 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:03.461492 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-37643b50-bafe-4c30-a01f-6c1c29316c63 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:03.462186 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-37643b50-bafe-4c30-a01f-6c1c29316c63 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:03.462637 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-37643b50-bafe-4c30-a01f-6c1c29316c63 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:03.463084 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-37643b50-bafe-4c30-a01f-6c1c29316c63 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:03.500761 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-37643b50-bafe-4c30-a01f-6c1c29316c63 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] 10.222.0.60 "GET /compute/v2.1/servers/701f1bdb-000a-4fa6-8e79-cd277daee20c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054920 Sep 14 09:53:03.501335 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3905/7235] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 14 09:53:03 2022] GET /compute/v2.1/servers/701f1bdb-000a-4fa6-8e79-cd277daee20c/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:53:04.514005 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-388f6c5f-877d-4b1f-9750-1f84daa54a3d tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:53:04.516215 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-388f6c5f-877d-4b1f-9750-1f84daa54a3d tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] [instance: 701f1bdb-000a-4fa6-8e79-cd277daee20c] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:53:04.523671 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-388f6c5f-877d-4b1f-9750-1f84daa54a3d tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:04.524177 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-388f6c5f-877d-4b1f-9750-1f84daa54a3d tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:04.524631 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-388f6c5f-877d-4b1f-9750-1f84daa54a3d tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:04.525340 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-388f6c5f-877d-4b1f-9750-1f84daa54a3d tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:04.525813 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-388f6c5f-877d-4b1f-9750-1f84daa54a3d tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:04.526262 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-388f6c5f-877d-4b1f-9750-1f84daa54a3d tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:04.556914 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-388f6c5f-877d-4b1f-9750-1f84daa54a3d tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] 10.222.0.60 "GET /compute/v2.1/servers/701f1bdb-000a-4fa6-8e79-cd277daee20c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046928 Sep 14 09:53:04.557763 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3331/7236] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 14 09:53:04 2022] GET /compute/v2.1/servers/701f1bdb-000a-4fa6-8e79-cd277daee20c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:53:05.569974 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-7bab1fb6-8832-44f4-a5f5-bae3764ea1af tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:53:05.572935 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-7bab1fb6-8832-44f4-a5f5-bae3764ea1af tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] [instance: 701f1bdb-000a-4fa6-8e79-cd277daee20c] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:53:05.579966 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7bab1fb6-8832-44f4-a5f5-bae3764ea1af tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:05.580474 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7bab1fb6-8832-44f4-a5f5-bae3764ea1af tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:05.580896 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7bab1fb6-8832-44f4-a5f5-bae3764ea1af tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:05.581595 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7bab1fb6-8832-44f4-a5f5-bae3764ea1af tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:05.582055 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7bab1fb6-8832-44f4-a5f5-bae3764ea1af tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:05.582477 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7bab1fb6-8832-44f4-a5f5-bae3764ea1af tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:05.614454 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-7bab1fb6-8832-44f4-a5f5-bae3764ea1af tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] 10.222.0.60 "GET /compute/v2.1/servers/701f1bdb-000a-4fa6-8e79-cd277daee20c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049090 Sep 14 09:53:05.615357 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3906/7237] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 14 09:53:05 2022] GET /compute/v2.1/servers/701f1bdb-000a-4fa6-8e79-cd277daee20c/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:53:06.626697 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d62b5fa2-90fb-48fc-bd07-386c66487e13 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:53:06.629446 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-d62b5fa2-90fb-48fc-bd07-386c66487e13 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] [instance: 701f1bdb-000a-4fa6-8e79-cd277daee20c] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:53:06.636178 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d62b5fa2-90fb-48fc-bd07-386c66487e13 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:06.636675 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d62b5fa2-90fb-48fc-bd07-386c66487e13 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:06.637118 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d62b5fa2-90fb-48fc-bd07-386c66487e13 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:06.637813 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d62b5fa2-90fb-48fc-bd07-386c66487e13 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:06.638274 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d62b5fa2-90fb-48fc-bd07-386c66487e13 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:06.638704 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d62b5fa2-90fb-48fc-bd07-386c66487e13 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:06.667627 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-d62b5fa2-90fb-48fc-bd07-386c66487e13 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] 10.222.0.60 "GET /compute/v2.1/servers/701f1bdb-000a-4fa6-8e79-cd277daee20c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045025 Sep 14 09:53:06.668178 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3332/7238] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 14 09:53:06 2022] GET /compute/v2.1/servers/701f1bdb-000a-4fa6-8e79-cd277daee20c/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 09:53:06.678852 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-895d3fa3-1f1f-49c0-9594-b7d58481d835 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:53:06.679385 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-895d3fa3-1f1f-49c0-9594-b7d58481d835 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] [instance: 701f1bdb-000a-4fa6-8e79-cd277daee20c] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:53:06.686227 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-895d3fa3-1f1f-49c0-9594-b7d58481d835 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:06.686716 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-895d3fa3-1f1f-49c0-9594-b7d58481d835 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:06.687204 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-895d3fa3-1f1f-49c0-9594-b7d58481d835 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:06.687903 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-895d3fa3-1f1f-49c0-9594-b7d58481d835 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:06.688366 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-895d3fa3-1f1f-49c0-9594-b7d58481d835 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:06.688809 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-895d3fa3-1f1f-49c0-9594-b7d58481d835 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:06.767599 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-895d3fa3-1f1f-49c0-9594-b7d58481d835 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] HTTP exception thrown: Instance 701f1bdb-000a-4fa6-8e79-cd277daee20c is not attached to volume cd575360-4619-44d9-9633-ce51f87f6e2d Sep 14 09:53:06.769249 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-895d3fa3-1f1f-49c0-9594-b7d58481d835 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Request method failure captured: Sep 14 09:53:06.769249 n-d-836830-18 devstack@n-api.service[128759]: request: DELETE /compute/v2.1/servers/701f1bdb-000a-4fa6-8e79-cd277daee20c/os-volume_attachments/cd575360-4619-44d9-9633-ce51f87f6e2d HTTP/1.1 Sep 14 09:53:06.769249 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:53:06.769249 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:53:06.769249 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:53:06.769249 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:53:06.769249 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:53:06.769249 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:53:06.769249 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:53:06.769249 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:53:06.769249 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIaQ9jLg9OYKsTKIqRb0AS5YYNhe9kr_ANsACd1isdaYhW78CTX8cL8Q5Vws63wMqQgUtcZO_6u0GyZVv47VX5G9QiK0sNZWYNnxbw9fc-dt0RlmInzl7MtLdFsG3iXVkLxLLITALqIUXoC1qK41C97F_1345yVQwyuOW-yGqKnQelJY Sep 14 09:53:06.769249 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:53:06.769249 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:53:06.769249 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:53:06.769249 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:53:06.769249 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:53:06.769249 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:53:06.769249 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 3aa81dd5f183418a8bf268f7618d38dd Sep 14 09:53:06.769249 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-TestEncryptedCinderVolumes-994755716 Sep 14 09:53:06.769249 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:53:06.769249 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:53:06.769249 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/3aa81dd5f183418a8bf268f7618d38dd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_3aa81dd5f183418a8bf268f7618d38dd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3aa81dd5f183418a8bf268f7618d38dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3aa81dd5f183418a8bf268f7618d38dd"}]}] Sep 14 09:53:06.769249 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-TestEncryptedCinderVolumes-994755716 Sep 14 09:53:06.769249 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 3aa81dd5f183418a8bf268f7618d38dd Sep 14 09:53:06.769249 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-994755716 Sep 14 09:53:06.769249 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-TestEncryptedCinderVolumes-994755716-project Sep 14 09:53:06.769249 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:53:06.769249 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:53:06.769249 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 2ffbbf813488435bb54edbbfedea84fc Sep 14 09:53:06.769249 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-TestEncryptedCinderVolumes-994755716-project Sep 14 09:53:06.769249 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:53:06.769249 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance 701f1bdb-000a-4fa6-8e79-cd277daee20c is not attached to volume cd575360-4619-44d9-9633-ce51f87f6e2d Sep 14 09:53:06.769249 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'server_id': '701f1bdb-000a-4fa6-8e79-cd277daee20c', 'id': 'cd575360-4619-44d9-9633-ce51f87f6e2d'} Sep 14 09:53:06.769249 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:53:06.769249 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:53:06.769249 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 14 09:53:06.769249 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 14 09:53:06.769249 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 14 09:53:06.769249 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 14 09:53:06.769249 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 14 09:53:06.769249 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 14 09:53:06.769249 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id cd575360-4619-44d9-9633-ce51f87f6e2d. Sep 14 09:53:06.769249 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:53:06.769249 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:53:06.769249 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:53:06.769249 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:53:06.769249 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:53:06.769249 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:53:06.769249 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:53:06.769249 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:53:06.769249 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:53:06.769249 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:53:06.769249 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 14 09:53:06.769249 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 14 09:53:06.769249 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 701f1bdb-000a-4fa6-8e79-cd277daee20c is not attached to volume cd575360-4619-44d9-9633-ce51f87f6e2d Sep 14 09:53:06.769249 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:53:06.769249 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:53:06.769249 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:53:06.769249 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:53:06.769249 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:53:06.769249 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:53:06.773892 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:53:06.773892 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:53:06.773892 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 701f1bdb-000a-4fa6-8e79-cd277daee20c is not attached to volume cd575360-4619-44d9-9633-ce51f87f6e2d Sep 14 09:53:06.773892 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:53:06.773892 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-895d3fa3-1f1f-49c0-9594-b7d58481d835 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Returning 404 to user: Instance 701f1bdb-000a-4fa6-8e79-cd277daee20c is not attached to volume cd575360-4619-44d9-9633-ce51f87f6e2d {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:53:06.773892 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-895d3fa3-1f1f-49c0-9594-b7d58481d835 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] 10.222.0.60 "DELETE /compute/v2.1/servers/701f1bdb-000a-4fa6-8e79-cd277daee20c/os-volume_attachments/cd575360-4619-44d9-9633-ce51f87f6e2d" status: 404 len: 154 microversion: 2.1 time: 0.095941 Sep 14 09:53:06.773892 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3907/7239] 10.222.0.60 () {58 vars in 1416 bytes} [Wed Sep 14 09:53:06 2022] DELETE /compute/v2.1/servers/701f1bdb-000a-4fa6-8e79-cd277daee20c/os-volume_attachments/cd575360-4619-44d9-9633-ce51f87f6e2d => generated 154 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:53:10.125839 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-116121a1-cdad-4e3f-a324-f8b635d94dbf tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:53:10.126352 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-116121a1-cdad-4e3f-a324-f8b635d94dbf tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] [instance: 701f1bdb-000a-4fa6-8e79-cd277daee20c] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:53:10.133474 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-116121a1-cdad-4e3f-a324-f8b635d94dbf tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:10.133992 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-116121a1-cdad-4e3f-a324-f8b635d94dbf tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:10.134451 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-116121a1-cdad-4e3f-a324-f8b635d94dbf tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:10.135206 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-116121a1-cdad-4e3f-a324-f8b635d94dbf tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:10.135686 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-116121a1-cdad-4e3f-a324-f8b635d94dbf tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:10.136130 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-116121a1-cdad-4e3f-a324-f8b635d94dbf tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:10.165260 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-116121a1-cdad-4e3f-a324-f8b635d94dbf tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] [instance: 701f1bdb-000a-4fa6-8e79-cd277daee20c] Going to try to terminate instance {{(pid=128758) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:53:10.242366 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-116121a1-cdad-4e3f-a324-f8b635d94dbf tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] 10.222.0.60 "DELETE /compute/v2.1/servers/701f1bdb-000a-4fa6-8e79-cd277daee20c" status: 204 len: 0 microversion: 2.1 time: 0.120174 Sep 14 09:53:10.243046 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3333/7240] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:53:10 2022] DELETE /compute/v2.1/servers/701f1bdb-000a-4fa6-8e79-cd277daee20c => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:53:10.251897 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-29a07bf7-7156-45e1-8c37-8e014cb318ec tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:53:10.252431 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-29a07bf7-7156-45e1-8c37-8e014cb318ec tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] [instance: 701f1bdb-000a-4fa6-8e79-cd277daee20c] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:53:10.260341 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-29a07bf7-7156-45e1-8c37-8e014cb318ec tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:10.260835 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-29a07bf7-7156-45e1-8c37-8e014cb318ec tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:10.261297 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-29a07bf7-7156-45e1-8c37-8e014cb318ec tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:10.261971 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-29a07bf7-7156-45e1-8c37-8e014cb318ec tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:10.262426 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-29a07bf7-7156-45e1-8c37-8e014cb318ec tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:10.262854 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-29a07bf7-7156-45e1-8c37-8e014cb318ec tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:10.400756 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-29a07bf7-7156-45e1-8c37-8e014cb318ec tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffbbf813488435bb54edbbfedea84fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa81dd5f183418a8bf268f7618d38dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:53:10.408729 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-29a07bf7-7156-45e1-8c37-8e014cb318ec tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] 10.222.0.60 "GET /compute/v2.1/servers/701f1bdb-000a-4fa6-8e79-cd277daee20c" status: 200 len: 1559 microversion: 2.1 time: 0.160852 Sep 14 09:53:10.409318 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3908/7241] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:53:10 2022] GET /compute/v2.1/servers/701f1bdb-000a-4fa6-8e79-cd277daee20c => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:53:11.434145 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-eccaacff-5d3a-4297-b226-fa45f7c2c68f tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:53:11.434859 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-eccaacff-5d3a-4297-b226-fa45f7c2c68f tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] [instance: 701f1bdb-000a-4fa6-8e79-cd277daee20c] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:53:11.442533 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-eccaacff-5d3a-4297-b226-fa45f7c2c68f tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:11.442900 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-eccaacff-5d3a-4297-b226-fa45f7c2c68f tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:11.443368 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-eccaacff-5d3a-4297-b226-fa45f7c2c68f tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:11.444068 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-eccaacff-5d3a-4297-b226-fa45f7c2c68f tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:11.444532 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-eccaacff-5d3a-4297-b226-fa45f7c2c68f tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:11.444963 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-eccaacff-5d3a-4297-b226-fa45f7c2c68f tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:11.574745 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-eccaacff-5d3a-4297-b226-fa45f7c2c68f tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffbbf813488435bb54edbbfedea84fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa81dd5f183418a8bf268f7618d38dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:53:11.582647 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-eccaacff-5d3a-4297-b226-fa45f7c2c68f tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] 10.222.0.60 "GET /compute/v2.1/servers/701f1bdb-000a-4fa6-8e79-cd277daee20c" status: 200 len: 1559 microversion: 2.1 time: 0.152708 Sep 14 09:53:11.583260 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3334/7242] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:53:11 2022] GET /compute/v2.1/servers/701f1bdb-000a-4fa6-8e79-cd277daee20c => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:53:12.270197 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-285e60fd-e093-43d7-a18f-3cb43c5193e4 req-1fe4e273-668c-4288-9f94-6285b0464fb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "701f1bdb-000a-4fa6-8e79-cd277daee20c", "name": "network-vif-deleted", "tag": "da77f79a-eb47-4d6a-a052-669c0169d3af"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:53:12.282133 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-285e60fd-e093-43d7-a18f-3cb43c5193e4 req-1fe4e273-668c-4288-9f94-6285b0464fb8 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:12.282622 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-285e60fd-e093-43d7-a18f-3cb43c5193e4 req-1fe4e273-668c-4288-9f94-6285b0464fb8 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:12.283089 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-285e60fd-e093-43d7-a18f-3cb43c5193e4 req-1fe4e273-668c-4288-9f94-6285b0464fb8 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:12.295197 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-285e60fd-e093-43d7-a18f-3cb43c5193e4 req-1fe4e273-668c-4288-9f94-6285b0464fb8 service nova] Creating event network-vif-deleted:da77f79a-eb47-4d6a-a052-669c0169d3af for instance 701f1bdb-000a-4fa6-8e79-cd277daee20c on n-h2-836830-18 Sep 14 09:53:12.300950 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-285e60fd-e093-43d7-a18f-3cb43c5193e4 req-1fe4e273-668c-4288-9f94-6285b0464fb8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034392 Sep 14 09:53:12.301749 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3909/7243] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:53:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:53:12.607135 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-0c8869e4-e24a-4ce0-81fe-a44a26318ba6 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:53:12.607778 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-0c8869e4-e24a-4ce0-81fe-a44a26318ba6 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] [instance: 701f1bdb-000a-4fa6-8e79-cd277daee20c] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:53:12.615767 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0c8869e4-e24a-4ce0-81fe-a44a26318ba6 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:12.616283 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0c8869e4-e24a-4ce0-81fe-a44a26318ba6 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:12.616739 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0c8869e4-e24a-4ce0-81fe-a44a26318ba6 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:12.617464 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0c8869e4-e24a-4ce0-81fe-a44a26318ba6 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:12.617940 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0c8869e4-e24a-4ce0-81fe-a44a26318ba6 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:12.618382 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0c8869e4-e24a-4ce0-81fe-a44a26318ba6 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:12.652371 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0c8869e4-e24a-4ce0-81fe-a44a26318ba6 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:12.652878 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0c8869e4-e24a-4ce0-81fe-a44a26318ba6 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:12.653330 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0c8869e4-e24a-4ce0-81fe-a44a26318ba6 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:12.653799 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.objects.instance [None req-0c8869e4-e24a-4ce0-81fe-a44a26318ba6 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lazy-loading 'fault' on Instance uuid 701f1bdb-000a-4fa6-8e79-cd277daee20c {{(pid=128758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:53:12.705840 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-0c8869e4-e24a-4ce0-81fe-a44a26318ba6 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffbbf813488435bb54edbbfedea84fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa81dd5f183418a8bf268f7618d38dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:53:12.714142 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-0c8869e4-e24a-4ce0-81fe-a44a26318ba6 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] 10.222.0.60 "GET /compute/v2.1/servers/701f1bdb-000a-4fa6-8e79-cd277daee20c" status: 200 len: 1353 microversion: 2.1 time: 0.111073 Sep 14 09:53:12.714800 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3335/7244] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:53:12 2022] GET /compute/v2.1/servers/701f1bdb-000a-4fa6-8e79-cd277daee20c => generated 1353 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:53:13.739486 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3bb7130d-00b9-4aa8-9b6e-60ddcd2d5017 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:53:13.740137 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-3bb7130d-00b9-4aa8-9b6e-60ddcd2d5017 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] [instance: 701f1bdb-000a-4fa6-8e79-cd277daee20c] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:53:13.746316 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3bb7130d-00b9-4aa8-9b6e-60ddcd2d5017 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:13.746809 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3bb7130d-00b9-4aa8-9b6e-60ddcd2d5017 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:13.747281 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3bb7130d-00b9-4aa8-9b6e-60ddcd2d5017 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:13.747982 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3bb7130d-00b9-4aa8-9b6e-60ddcd2d5017 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:13.748445 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3bb7130d-00b9-4aa8-9b6e-60ddcd2d5017 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:13.748886 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3bb7130d-00b9-4aa8-9b6e-60ddcd2d5017 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:13.762063 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-3bb7130d-00b9-4aa8-9b6e-60ddcd2d5017 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] HTTP exception thrown: Instance 701f1bdb-000a-4fa6-8e79-cd277daee20c could not be found. Sep 14 09:53:13.763716 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3bb7130d-00b9-4aa8-9b6e-60ddcd2d5017 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Request method failure captured: Sep 14 09:53:13.763716 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/701f1bdb-000a-4fa6-8e79-cd277daee20c HTTP/1.1 Sep 14 09:53:13.763716 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:53:13.763716 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:53:13.763716 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:53:13.763716 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:53:13.763716 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:53:13.763716 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:53:13.763716 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:53:13.763716 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:53:13.763716 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIaQ9jLg9OYKsTKIqRb0AS5YYNhe9kr_ANsACd1isdaYhW78CTX8cL8Q5Vws63wMqQgUtcZO_6u0GyZVv47VX5G9QiK0sNZWYNnxbw9fc-dt0RlmInzl7MtLdFsG3iXVkLxLLITALqIUXoC1qK41C97F_1345yVQwyuOW-yGqKnQelJY Sep 14 09:53:13.763716 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:53:13.763716 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:53:13.763716 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:53:13.763716 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:53:13.763716 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:53:13.763716 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:53:13.763716 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 3aa81dd5f183418a8bf268f7618d38dd Sep 14 09:53:13.763716 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-TestEncryptedCinderVolumes-994755716 Sep 14 09:53:13.763716 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:53:13.763716 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:53:13.763716 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/3aa81dd5f183418a8bf268f7618d38dd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_3aa81dd5f183418a8bf268f7618d38dd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3aa81dd5f183418a8bf268f7618d38dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3aa81dd5f183418a8bf268f7618d38dd"}]}] Sep 14 09:53:13.763716 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-TestEncryptedCinderVolumes-994755716 Sep 14 09:53:13.763716 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 3aa81dd5f183418a8bf268f7618d38dd Sep 14 09:53:13.763716 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-994755716 Sep 14 09:53:13.763716 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-TestEncryptedCinderVolumes-994755716-project Sep 14 09:53:13.763716 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:53:13.763716 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:53:13.763716 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 2ffbbf813488435bb54edbbfedea84fc Sep 14 09:53:13.763716 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-TestEncryptedCinderVolumes-994755716-project Sep 14 09:53:13.763716 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:53:13.763716 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance 701f1bdb-000a-4fa6-8e79-cd277daee20c could not be found. Sep 14 09:53:13.763716 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '701f1bdb-000a-4fa6-8e79-cd277daee20c'} Sep 14 09:53:13.763716 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:53:13.763716 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:53:13.763716 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:53:13.763716 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:53:13.763716 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:53:13.763716 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:53:13.763716 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:53:13.763716 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:53:13.763716 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:53:13.763716 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:53:13.763716 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 701f1bdb-000a-4fa6-8e79-cd277daee20c could not be found. Sep 14 09:53:13.763716 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:53:13.763716 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:53:13.763716 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:53:13.763716 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:53:13.763716 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:53:13.763716 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:53:13.763716 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:53:13.763716 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:53:13.763716 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:53:13.763716 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:53:13.763716 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:53:13.763716 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:53:13.763716 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:53:13.763716 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:53:13.763716 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:53:13.763716 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:53:13.763716 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 701f1bdb-000a-4fa6-8e79-cd277daee20c could not be found. Sep 14 09:53:13.763716 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:53:13.763716 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:53:13.763716 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:53:13.769242 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:53:13.769242 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:53:13.769242 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:53:13.769242 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:53:13.769242 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:53:13.769242 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 701f1bdb-000a-4fa6-8e79-cd277daee20c could not be found. Sep 14 09:53:13.769242 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:53:13.769242 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3bb7130d-00b9-4aa8-9b6e-60ddcd2d5017 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Returning 404 to user: Instance 701f1bdb-000a-4fa6-8e79-cd277daee20c could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:53:13.769242 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-3bb7130d-00b9-4aa8-9b6e-60ddcd2d5017 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] 10.222.0.60 "GET /compute/v2.1/servers/701f1bdb-000a-4fa6-8e79-cd277daee20c" status: 404 len: 111 microversion: 2.1 time: 0.030979 Sep 14 09:53:13.769242 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3910/7245] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:53:13 2022] GET /compute/v2.1/servers/701f1bdb-000a-4fa6-8e79-cd277daee20c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:53:13.774266 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-07b7bb46-9ccd-4914-b38c-611c869adf13 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Calling method '.version_select at 0x7f7d3f2e41f0>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:53:13.798347 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-07b7bb46-9ccd-4914-b38c-611c869adf13 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1108686810" status: 202 len: 0 microversion: 2.1 time: 0.027820 Sep 14 09:53:13.798932 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3336/7246] 10.222.0.60 () {58 vars in 1278 bytes} [Wed Sep 14 09:53:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1108686810 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:53:13.815923 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-75503f84-5225-49f9-bf23-ed2d49775b74 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Action: 'create', calling method: .version_select at 0x7f7d3ec5f8b0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1092546797", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJcfzf3mEkqFA6o/Z7YG52WI0vrJ5ehskoTsn9s1yxaem+KyZoYAeqyqM/VlHmaz+E9ooZNuIQG4YyH1Yw6ODUXm5whkXIkmX3N2oQAS4m0CZtBg04CpDslq82uPzZJFxQ=="}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:53:13.831961 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-75503f84-5225-49f9-bf23-ed2d49775b74 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Getting quotas for project 3aa81dd5f183418a8bf268f7618d38dd. Resources: {'key_pairs'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:53:13.837804 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-75503f84-5225-49f9-bf23-ed2d49775b74 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Getting quotas for user 2ffbbf813488435bb54edbbfedea84fc and project 3aa81dd5f183418a8bf268f7618d38dd. Resources: {'key_pairs'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:53:13.863356 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-75503f84-5225-49f9-bf23-ed2d49775b74 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.051399 Sep 14 09:53:13.863951 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3911/7247] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Sep 14 09:53:13 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:53:13.913829 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-5f5b90a0-796a-480e-a5fb-236afa901cbe tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-139693818", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1092546797", "networks": [{"uuid": "3ee3346d-8612-443a-945d-749e378f4b46"}]}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:53:13.965951 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.network.neutron [None req-5f5b90a0-796a-480e-a5fb-236afa901cbe tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] validate_networks() for [('3ee3346d-8612-443a-945d-749e378f4b46', None, None, None, None, None)] {{(pid=128758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:53:14.413968 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-5f5b90a0-796a-480e-a5fb-236afa901cbe tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Flavor limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:53:14.414407 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-5f5b90a0-796a-480e-a5fb-236afa901cbe tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Image limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:53:14.414904 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-5f5b90a0-796a-480e-a5fb-236afa901cbe tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Flavor pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:53:14.415351 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-5f5b90a0-796a-480e-a5fb-236afa901cbe tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Image pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:53:14.415776 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-5f5b90a0-796a-480e-a5fb-236afa901cbe tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:53:14.427453 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5f5b90a0-796a-480e-a5fb-236afa901cbe tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:14.427942 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5f5b90a0-796a-480e-a5fb-236afa901cbe tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:14.428387 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5f5b90a0-796a-480e-a5fb-236afa901cbe tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:14.429117 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5f5b90a0-796a-480e-a5fb-236afa901cbe tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:14.429579 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5f5b90a0-796a-480e-a5fb-236afa901cbe tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:14.430014 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5f5b90a0-796a-480e-a5fb-236afa901cbe tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:14.449372 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-5f5b90a0-796a-480e-a5fb-236afa901cbe tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Getting quotas for project 3aa81dd5f183418a8bf268f7618d38dd. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:53:14.454527 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-5f5b90a0-796a-480e-a5fb-236afa901cbe tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Getting quotas for user 2ffbbf813488435bb54edbbfedea84fc and project 3aa81dd5f183418a8bf268f7618d38dd. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:53:14.466706 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-5f5b90a0-796a-480e-a5fb-236afa901cbe tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Going to run 1 instances... {{(pid=128758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:53:14.469045 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-5f5b90a0-796a-480e-a5fb-236afa901cbe tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] [instance: 5f7b5a2b-5225-49fa-828d-930f941bf287] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:53:14.517289 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-5f5b90a0-796a-480e-a5fb-236afa901cbe tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.607327 Sep 14 09:53:14.517950 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3337/7248] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 09:53:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 609 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:53:14.529429 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e4b5a405-7ccd-4e88-8c77-8f6aec9c33e7 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:53:14.530056 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e4b5a405-7ccd-4e88-8c77-8f6aec9c33e7 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] [instance: 5f7b5a2b-5225-49fa-828d-930f941bf287] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:53:14.588375 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-e4b5a405-7ccd-4e88-8c77-8f6aec9c33e7 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffbbf813488435bb54edbbfedea84fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa81dd5f183418a8bf268f7618d38dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:53:14.595897 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e4b5a405-7ccd-4e88-8c77-8f6aec9c33e7 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] 10.222.0.60 "GET /compute/v2.1/servers/5f7b5a2b-5225-49fa-828d-930f941bf287" status: 200 len: 1262 microversion: 2.1 time: 0.070417 Sep 14 09:53:14.596484 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3912/7249] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:53:14 2022] GET /compute/v2.1/servers/5f7b5a2b-5225-49fa-828d-930f941bf287 => generated 1262 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:53:15.620861 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-48fd23a8-b990-42c3-b566-d147d010a191 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:53:15.621552 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-48fd23a8-b990-42c3-b566-d147d010a191 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] [instance: 5f7b5a2b-5225-49fa-828d-930f941bf287] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:53:15.628059 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-48fd23a8-b990-42c3-b566-d147d010a191 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:15.628591 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-48fd23a8-b990-42c3-b566-d147d010a191 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:15.629043 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-48fd23a8-b990-42c3-b566-d147d010a191 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:15.629798 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-48fd23a8-b990-42c3-b566-d147d010a191 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:15.630269 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-48fd23a8-b990-42c3-b566-d147d010a191 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:15.630711 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-48fd23a8-b990-42c3-b566-d147d010a191 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:15.950672 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-48fd23a8-b990-42c3-b566-d147d010a191 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffbbf813488435bb54edbbfedea84fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa81dd5f183418a8bf268f7618d38dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:53:15.959202 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-48fd23a8-b990-42c3-b566-d147d010a191 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] 10.222.0.60 "GET /compute/v2.1/servers/5f7b5a2b-5225-49fa-828d-930f941bf287" status: 200 len: 1320 microversion: 2.1 time: 0.343338 Sep 14 09:53:15.959788 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3338/7250] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:53:15 2022] GET /compute/v2.1/servers/5f7b5a2b-5225-49fa-828d-930f941bf287 => generated 1320 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:53:16.905547 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-a26af45d-858b-48f4-bd4d-86bc18241afb req-57fbf91c-e472-4ff7-8e5d-3d8eeab02866 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f7b5a2b-5225-49fa-828d-930f941bf287", "tag": "e0c38f37-b32c-4979-82d6-2ee991547a6a"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:53:16.917208 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-a26af45d-858b-48f4-bd4d-86bc18241afb req-57fbf91c-e472-4ff7-8e5d-3d8eeab02866 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:16.917700 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-a26af45d-858b-48f4-bd4d-86bc18241afb req-57fbf91c-e472-4ff7-8e5d-3d8eeab02866 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:16.918143 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-a26af45d-858b-48f4-bd4d-86bc18241afb req-57fbf91c-e472-4ff7-8e5d-3d8eeab02866 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:16.929544 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-a26af45d-858b-48f4-bd4d-86bc18241afb req-57fbf91c-e472-4ff7-8e5d-3d8eeab02866 service nova] Creating event network-changed:e0c38f37-b32c-4979-82d6-2ee991547a6a for instance 5f7b5a2b-5225-49fa-828d-930f941bf287 on n-h2-836830-18 Sep 14 09:53:16.934418 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-a26af45d-858b-48f4-bd4d-86bc18241afb req-57fbf91c-e472-4ff7-8e5d-3d8eeab02866 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032736 Sep 14 09:53:16.935096 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3913/7251] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:53:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:53:16.984156 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-8b30aa44-2382-4f99-8ade-a6875e179481 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:53:16.984875 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-8b30aa44-2382-4f99-8ade-a6875e179481 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] [instance: 5f7b5a2b-5225-49fa-828d-930f941bf287] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:53:17.001437 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8b30aa44-2382-4f99-8ade-a6875e179481 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:17.001968 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8b30aa44-2382-4f99-8ade-a6875e179481 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:17.002431 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8b30aa44-2382-4f99-8ade-a6875e179481 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:17.003744 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8b30aa44-2382-4f99-8ade-a6875e179481 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:17.004222 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8b30aa44-2382-4f99-8ade-a6875e179481 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:17.004666 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8b30aa44-2382-4f99-8ade-a6875e179481 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:17.139591 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-8b30aa44-2382-4f99-8ade-a6875e179481 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffbbf813488435bb54edbbfedea84fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa81dd5f183418a8bf268f7618d38dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:53:17.148116 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-8b30aa44-2382-4f99-8ade-a6875e179481 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] 10.222.0.60 "GET /compute/v2.1/servers/5f7b5a2b-5225-49fa-828d-930f941bf287" status: 200 len: 1362 microversion: 2.1 time: 0.168090 Sep 14 09:53:17.148784 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3339/7252] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:53:16 2022] GET /compute/v2.1/servers/5f7b5a2b-5225-49fa-828d-930f941bf287 => generated 1362 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:53:18.172748 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3552be3b-eaa6-4001-8f70-088d44dda017 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:53:18.173467 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-3552be3b-eaa6-4001-8f70-088d44dda017 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] [instance: 5f7b5a2b-5225-49fa-828d-930f941bf287] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:53:18.180248 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3552be3b-eaa6-4001-8f70-088d44dda017 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:18.180741 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3552be3b-eaa6-4001-8f70-088d44dda017 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:18.181189 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3552be3b-eaa6-4001-8f70-088d44dda017 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:18.181888 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3552be3b-eaa6-4001-8f70-088d44dda017 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:18.182354 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3552be3b-eaa6-4001-8f70-088d44dda017 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:18.182788 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3552be3b-eaa6-4001-8f70-088d44dda017 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:18.314466 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-3552be3b-eaa6-4001-8f70-088d44dda017 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffbbf813488435bb54edbbfedea84fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa81dd5f183418a8bf268f7618d38dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:53:18.322955 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-3552be3b-eaa6-4001-8f70-088d44dda017 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] 10.222.0.60 "GET /compute/v2.1/servers/5f7b5a2b-5225-49fa-828d-930f941bf287" status: 200 len: 1362 microversion: 2.1 time: 0.155348 Sep 14 09:53:18.323551 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3914/7253] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:53:18 2022] GET /compute/v2.1/servers/5f7b5a2b-5225-49fa-828d-930f941bf287 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:53:19.345750 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ff1015be-362c-4517-9074-6191bacb4db9 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:53:19.346359 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-ff1015be-362c-4517-9074-6191bacb4db9 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] [instance: 5f7b5a2b-5225-49fa-828d-930f941bf287] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:53:19.353730 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ff1015be-362c-4517-9074-6191bacb4db9 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:19.354193 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ff1015be-362c-4517-9074-6191bacb4db9 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:19.354637 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ff1015be-362c-4517-9074-6191bacb4db9 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:19.355486 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ff1015be-362c-4517-9074-6191bacb4db9 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:19.356034 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ff1015be-362c-4517-9074-6191bacb4db9 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:19.356417 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ff1015be-362c-4517-9074-6191bacb4db9 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:19.488915 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-ff1015be-362c-4517-9074-6191bacb4db9 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffbbf813488435bb54edbbfedea84fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa81dd5f183418a8bf268f7618d38dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:53:19.499346 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-ff1015be-362c-4517-9074-6191bacb4db9 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] 10.222.0.60 "GET /compute/v2.1/servers/5f7b5a2b-5225-49fa-828d-930f941bf287" status: 200 len: 1362 microversion: 2.1 time: 0.157704 Sep 14 09:53:19.499950 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3340/7254] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:53:19 2022] GET /compute/v2.1/servers/5f7b5a2b-5225-49fa-828d-930f941bf287 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:53:20.522102 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c00b025f-02db-47f8-b78b-6ffb06c8d83f tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:53:20.522727 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-c00b025f-02db-47f8-b78b-6ffb06c8d83f tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] [instance: 5f7b5a2b-5225-49fa-828d-930f941bf287] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:53:20.529618 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c00b025f-02db-47f8-b78b-6ffb06c8d83f tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:20.530114 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c00b025f-02db-47f8-b78b-6ffb06c8d83f tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:20.530563 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c00b025f-02db-47f8-b78b-6ffb06c8d83f tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:20.531381 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c00b025f-02db-47f8-b78b-6ffb06c8d83f tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:20.531844 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c00b025f-02db-47f8-b78b-6ffb06c8d83f tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:20.532277 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c00b025f-02db-47f8-b78b-6ffb06c8d83f tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:20.670699 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-c00b025f-02db-47f8-b78b-6ffb06c8d83f tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffbbf813488435bb54edbbfedea84fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa81dd5f183418a8bf268f7618d38dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:53:20.678998 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-c00b025f-02db-47f8-b78b-6ffb06c8d83f tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] 10.222.0.60 "GET /compute/v2.1/servers/5f7b5a2b-5225-49fa-828d-930f941bf287" status: 200 len: 1362 microversion: 2.1 time: 0.160840 Sep 14 09:53:20.679569 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3915/7255] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:53:20 2022] GET /compute/v2.1/servers/5f7b5a2b-5225-49fa-828d-930f941bf287 => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:53:21.701478 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-96fa2261-764e-4027-ab1b-976a7fca2877 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:53:21.702085 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-96fa2261-764e-4027-ab1b-976a7fca2877 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] [instance: 5f7b5a2b-5225-49fa-828d-930f941bf287] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:53:21.709489 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-96fa2261-764e-4027-ab1b-976a7fca2877 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:21.709988 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-96fa2261-764e-4027-ab1b-976a7fca2877 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:21.710440 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-96fa2261-764e-4027-ab1b-976a7fca2877 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:21.711406 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-96fa2261-764e-4027-ab1b-976a7fca2877 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:21.711882 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-96fa2261-764e-4027-ab1b-976a7fca2877 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:21.712320 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-96fa2261-764e-4027-ab1b-976a7fca2877 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:21.839299 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-96fa2261-764e-4027-ab1b-976a7fca2877 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffbbf813488435bb54edbbfedea84fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa81dd5f183418a8bf268f7618d38dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:53:21.847842 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-96fa2261-764e-4027-ab1b-976a7fca2877 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] 10.222.0.60 "GET /compute/v2.1/servers/5f7b5a2b-5225-49fa-828d-930f941bf287" status: 200 len: 1362 microversion: 2.1 time: 0.150316 Sep 14 09:53:21.848416 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3341/7256] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:53:21 2022] GET /compute/v2.1/servers/5f7b5a2b-5225-49fa-828d-930f941bf287 => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:53:22.636367 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-58977a74-7bb6-4642-866c-a0831109f4a8 req-0b7c1829-05cf-4686-b4b2-fff3192cf220 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f7b5a2b-5225-49fa-828d-930f941bf287", "name": "network-vif-plugged", "status": "completed", "tag": "e0c38f37-b32c-4979-82d6-2ee991547a6a"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:53:22.648514 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-58977a74-7bb6-4642-866c-a0831109f4a8 req-0b7c1829-05cf-4686-b4b2-fff3192cf220 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:22.649009 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-58977a74-7bb6-4642-866c-a0831109f4a8 req-0b7c1829-05cf-4686-b4b2-fff3192cf220 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:22.649441 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-58977a74-7bb6-4642-866c-a0831109f4a8 req-0b7c1829-05cf-4686-b4b2-fff3192cf220 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:22.660813 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-58977a74-7bb6-4642-866c-a0831109f4a8 req-0b7c1829-05cf-4686-b4b2-fff3192cf220 service nova] Creating event network-vif-plugged:e0c38f37-b32c-4979-82d6-2ee991547a6a for instance 5f7b5a2b-5225-49fa-828d-930f941bf287 on n-h2-836830-18 Sep 14 09:53:22.665742 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-58977a74-7bb6-4642-866c-a0831109f4a8 req-0b7c1829-05cf-4686-b4b2-fff3192cf220 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033570 Sep 14 09:53:22.666767 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3916/7257] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:53:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:53:22.869981 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-7773f4f5-f96a-4d13-bd3b-50c0e69cdd64 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:53:22.870613 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-7773f4f5-f96a-4d13-bd3b-50c0e69cdd64 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] [instance: 5f7b5a2b-5225-49fa-828d-930f941bf287] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:53:22.876577 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7773f4f5-f96a-4d13-bd3b-50c0e69cdd64 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:22.877077 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7773f4f5-f96a-4d13-bd3b-50c0e69cdd64 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:22.877524 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7773f4f5-f96a-4d13-bd3b-50c0e69cdd64 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:22.878231 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7773f4f5-f96a-4d13-bd3b-50c0e69cdd64 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:22.878701 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7773f4f5-f96a-4d13-bd3b-50c0e69cdd64 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:22.879166 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7773f4f5-f96a-4d13-bd3b-50c0e69cdd64 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:23.007273 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-7773f4f5-f96a-4d13-bd3b-50c0e69cdd64 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffbbf813488435bb54edbbfedea84fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa81dd5f183418a8bf268f7618d38dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:53:23.015015 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-7773f4f5-f96a-4d13-bd3b-50c0e69cdd64 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] 10.222.0.60 "GET /compute/v2.1/servers/5f7b5a2b-5225-49fa-828d-930f941bf287" status: 200 len: 1362 microversion: 2.1 time: 0.149196 Sep 14 09:53:23.015598 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3342/7258] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:53:22 2022] GET /compute/v2.1/servers/5f7b5a2b-5225-49fa-828d-930f941bf287 => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:53:24.037772 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d2414956-9d3a-439b-894d-66d4a612280d tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:53:24.038489 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-d2414956-9d3a-439b-894d-66d4a612280d tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] [instance: 5f7b5a2b-5225-49fa-828d-930f941bf287] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:53:24.045464 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d2414956-9d3a-439b-894d-66d4a612280d tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:24.045960 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d2414956-9d3a-439b-894d-66d4a612280d tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:24.046412 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d2414956-9d3a-439b-894d-66d4a612280d tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:24.047156 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d2414956-9d3a-439b-894d-66d4a612280d tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:24.047630 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d2414956-9d3a-439b-894d-66d4a612280d tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:24.048066 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d2414956-9d3a-439b-894d-66d4a612280d tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:24.179914 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-d2414956-9d3a-439b-894d-66d4a612280d tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffbbf813488435bb54edbbfedea84fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa81dd5f183418a8bf268f7618d38dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:53:24.187716 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d2414956-9d3a-439b-894d-66d4a612280d tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] 10.222.0.60 "GET /compute/v2.1/servers/5f7b5a2b-5225-49fa-828d-930f941bf287" status: 200 len: 1552 microversion: 2.1 time: 0.154402 Sep 14 09:53:24.188297 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3917/7259] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:53:24 2022] GET /compute/v2.1/servers/5f7b5a2b-5225-49fa-828d-930f941bf287 => generated 1552 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:53:24.211006 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-778e638e-7a85-415f-a19d-2d8a333c514d tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:53:24.211572 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-778e638e-7a85-415f-a19d-2d8a333c514d tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] [instance: 5f7b5a2b-5225-49fa-828d-930f941bf287] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:53:24.218724 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-778e638e-7a85-415f-a19d-2d8a333c514d tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:24.218871 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-778e638e-7a85-415f-a19d-2d8a333c514d tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:24.219671 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-778e638e-7a85-415f-a19d-2d8a333c514d tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:24.220371 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-778e638e-7a85-415f-a19d-2d8a333c514d tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:24.220845 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-778e638e-7a85-415f-a19d-2d8a333c514d tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:24.221291 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-778e638e-7a85-415f-a19d-2d8a333c514d tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:24.348775 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-778e638e-7a85-415f-a19d-2d8a333c514d tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffbbf813488435bb54edbbfedea84fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa81dd5f183418a8bf268f7618d38dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:53:24.360652 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-778e638e-7a85-415f-a19d-2d8a333c514d tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] 10.222.0.60 "GET /compute/v2.1/servers/5f7b5a2b-5225-49fa-828d-930f941bf287" status: 200 len: 1552 microversion: 2.1 time: 0.153697 Sep 14 09:53:24.361240 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3343/7260] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:53:24 2022] GET /compute/v2.1/servers/5f7b5a2b-5225-49fa-828d-930f941bf287 => generated 1552 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:53:25.859504 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-4058b272-1d12-46e9-a16a-788c93b23553 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "93184a96-88a0-4bef-b0a0-fea120195b18"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:53:25.861811 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-4058b272-1d12-46e9-a16a-788c93b23553 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] [instance: 5f7b5a2b-5225-49fa-828d-930f941bf287] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:53:25.863853 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=6 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:53:25.870000 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4058b272-1d12-46e9-a16a-788c93b23553 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:25.870492 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4058b272-1d12-46e9-a16a-788c93b23553 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:25.870964 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4058b272-1d12-46e9-a16a-788c93b23553 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:25.871667 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4058b272-1d12-46e9-a16a-788c93b23553 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:25.872133 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4058b272-1d12-46e9-a16a-788c93b23553 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:25.872572 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4058b272-1d12-46e9-a16a-788c93b23553 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:26.112652 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-4058b272-1d12-46e9-a16a-788c93b23553 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] 10.222.0.60 "POST /compute/v2.1/servers/5f7b5a2b-5225-49fa-828d-930f941bf287/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.257025 Sep 14 09:53:26.113277 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3918/7261] 10.222.0.60 () {60 vars in 1323 bytes} [Wed Sep 14 09:53:25 2022] POST /compute/v2.1/servers/5f7b5a2b-5225-49fa-828d-930f941bf287/os-volume_attachments => generated 194 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:53:36.817268 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d2fccfca-4c8c-462e-9060-fa392d8d27e3 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:53:36.817908 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-d2fccfca-4c8c-462e-9060-fa392d8d27e3 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] [instance: 5f7b5a2b-5225-49fa-828d-930f941bf287] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:53:36.820024 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=2 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:53:36.820863 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=6 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:53:36.822634 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:53:36.823345 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:53:36.831014 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d2fccfca-4c8c-462e-9060-fa392d8d27e3 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:36.831463 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d2fccfca-4c8c-462e-9060-fa392d8d27e3 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:36.831927 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d2fccfca-4c8c-462e-9060-fa392d8d27e3 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:36.833188 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d2fccfca-4c8c-462e-9060-fa392d8d27e3 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:36.833646 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d2fccfca-4c8c-462e-9060-fa392d8d27e3 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:36.834089 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d2fccfca-4c8c-462e-9060-fa392d8d27e3 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:36.918304 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.objects.instance [None req-d2fccfca-4c8c-462e-9060-fa392d8d27e3 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lazy-loading 'services' on Instance uuid 5f7b5a2b-5225-49fa-828d-930f941bf287 {{(pid=128758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:53:36.987344 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-d2fccfca-4c8c-462e-9060-fa392d8d27e3 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] 10.222.0.60 "DELETE /compute/v2.1/servers/5f7b5a2b-5225-49fa-828d-930f941bf287/os-volume_attachments/93184a96-88a0-4bef-b0a0-fea120195b18" status: 202 len: 0 microversion: 2.1 time: 0.173884 Sep 14 09:53:36.987976 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3344/7262] 10.222.0.60 () {58 vars in 1416 bytes} [Wed Sep 14 09:53:36 2022] DELETE /compute/v2.1/servers/5f7b5a2b-5225-49fa-828d-930f941bf287/os-volume_attachments/93184a96-88a0-4bef-b0a0-fea120195b18 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:53:36.994925 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:53:36.995796 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:53:37.000012 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a603ff49-1330-4021-8f34-d83424eb8f51 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:53:37.002440 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-a603ff49-1330-4021-8f34-d83424eb8f51 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] [instance: 5f7b5a2b-5225-49fa-828d-930f941bf287] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:53:37.010723 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a603ff49-1330-4021-8f34-d83424eb8f51 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:37.011222 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a603ff49-1330-4021-8f34-d83424eb8f51 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:37.011673 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a603ff49-1330-4021-8f34-d83424eb8f51 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:37.012390 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a603ff49-1330-4021-8f34-d83424eb8f51 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:37.012880 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a603ff49-1330-4021-8f34-d83424eb8f51 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:37.013313 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a603ff49-1330-4021-8f34-d83424eb8f51 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:37.045266 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a603ff49-1330-4021-8f34-d83424eb8f51 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] 10.222.0.60 "GET /compute/v2.1/servers/5f7b5a2b-5225-49fa-828d-930f941bf287/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052179 Sep 14 09:53:37.045844 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3919/7263] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 14 09:53:36 2022] GET /compute/v2.1/servers/5f7b5a2b-5225-49fa-828d-930f941bf287/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:53:38.059881 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-98a067e5-da54-4508-a8ee-ce433ffed963 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:53:38.062409 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-98a067e5-da54-4508-a8ee-ce433ffed963 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] [instance: 5f7b5a2b-5225-49fa-828d-930f941bf287] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:53:38.069122 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-98a067e5-da54-4508-a8ee-ce433ffed963 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:38.069671 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-98a067e5-da54-4508-a8ee-ce433ffed963 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:38.070157 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-98a067e5-da54-4508-a8ee-ce433ffed963 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:38.070908 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-98a067e5-da54-4508-a8ee-ce433ffed963 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:38.071407 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-98a067e5-da54-4508-a8ee-ce433ffed963 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:38.071849 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-98a067e5-da54-4508-a8ee-ce433ffed963 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:38.102731 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-98a067e5-da54-4508-a8ee-ce433ffed963 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] 10.222.0.60 "GET /compute/v2.1/servers/5f7b5a2b-5225-49fa-828d-930f941bf287/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048065 Sep 14 09:53:38.103342 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3345/7264] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 14 09:53:38 2022] GET /compute/v2.1/servers/5f7b5a2b-5225-49fa-828d-930f941bf287/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:53:39.115533 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-edf3f1ca-48b9-45b1-bdab-a1343b33b6da tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:53:39.117842 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-edf3f1ca-48b9-45b1-bdab-a1343b33b6da tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] [instance: 5f7b5a2b-5225-49fa-828d-930f941bf287] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:53:39.124788 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-edf3f1ca-48b9-45b1-bdab-a1343b33b6da tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:39.125281 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-edf3f1ca-48b9-45b1-bdab-a1343b33b6da tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:39.125724 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-edf3f1ca-48b9-45b1-bdab-a1343b33b6da tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:39.126423 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-edf3f1ca-48b9-45b1-bdab-a1343b33b6da tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:39.126881 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-edf3f1ca-48b9-45b1-bdab-a1343b33b6da tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:39.127345 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-edf3f1ca-48b9-45b1-bdab-a1343b33b6da tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:39.160145 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-edf3f1ca-48b9-45b1-bdab-a1343b33b6da tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] 10.222.0.60 "GET /compute/v2.1/servers/5f7b5a2b-5225-49fa-828d-930f941bf287/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048674 Sep 14 09:53:39.160721 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3920/7265] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 14 09:53:39 2022] GET /compute/v2.1/servers/5f7b5a2b-5225-49fa-828d-930f941bf287/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:53:40.172865 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-99b940ae-3925-410f-a53f-816a68082d21 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:53:40.175148 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-99b940ae-3925-410f-a53f-816a68082d21 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] [instance: 5f7b5a2b-5225-49fa-828d-930f941bf287] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:53:40.182630 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-99b940ae-3925-410f-a53f-816a68082d21 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:40.183162 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-99b940ae-3925-410f-a53f-816a68082d21 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:40.183612 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-99b940ae-3925-410f-a53f-816a68082d21 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:40.184322 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-99b940ae-3925-410f-a53f-816a68082d21 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:40.184787 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-99b940ae-3925-410f-a53f-816a68082d21 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:40.185226 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-99b940ae-3925-410f-a53f-816a68082d21 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:40.217921 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-99b940ae-3925-410f-a53f-816a68082d21 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] 10.222.0.60 "GET /compute/v2.1/servers/5f7b5a2b-5225-49fa-828d-930f941bf287/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049027 Sep 14 09:53:40.218509 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3346/7266] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 14 09:53:40 2022] GET /compute/v2.1/servers/5f7b5a2b-5225-49fa-828d-930f941bf287/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:53:41.230528 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8c9578f3-4a62-48a6-9cd3-a4bfa4a56fde tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:53:41.232824 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-8c9578f3-4a62-48a6-9cd3-a4bfa4a56fde tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] [instance: 5f7b5a2b-5225-49fa-828d-930f941bf287] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:53:41.239907 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8c9578f3-4a62-48a6-9cd3-a4bfa4a56fde tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:41.240399 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8c9578f3-4a62-48a6-9cd3-a4bfa4a56fde tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:41.240842 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8c9578f3-4a62-48a6-9cd3-a4bfa4a56fde tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:41.241546 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8c9578f3-4a62-48a6-9cd3-a4bfa4a56fde tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:41.242031 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8c9578f3-4a62-48a6-9cd3-a4bfa4a56fde tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:41.242460 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8c9578f3-4a62-48a6-9cd3-a4bfa4a56fde tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:41.274318 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-8c9578f3-4a62-48a6-9cd3-a4bfa4a56fde tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] 10.222.0.60 "GET /compute/v2.1/servers/5f7b5a2b-5225-49fa-828d-930f941bf287/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048427 Sep 14 09:53:41.274900 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3921/7267] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 14 09:53:41 2022] GET /compute/v2.1/servers/5f7b5a2b-5225-49fa-828d-930f941bf287/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:53:42.287515 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-4cd252ef-fd41-4705-b058-309736aee077 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:53:42.289763 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-4cd252ef-fd41-4705-b058-309736aee077 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] [instance: 5f7b5a2b-5225-49fa-828d-930f941bf287] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:53:42.296597 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4cd252ef-fd41-4705-b058-309736aee077 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:42.297101 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4cd252ef-fd41-4705-b058-309736aee077 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:42.297554 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4cd252ef-fd41-4705-b058-309736aee077 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:42.298268 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4cd252ef-fd41-4705-b058-309736aee077 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:42.298739 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4cd252ef-fd41-4705-b058-309736aee077 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:42.299204 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4cd252ef-fd41-4705-b058-309736aee077 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:42.328179 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-4cd252ef-fd41-4705-b058-309736aee077 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] 10.222.0.60 "GET /compute/v2.1/servers/5f7b5a2b-5225-49fa-828d-930f941bf287/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045260 Sep 14 09:53:42.328747 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3347/7268] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 14 09:53:42 2022] GET /compute/v2.1/servers/5f7b5a2b-5225-49fa-828d-930f941bf287/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 09:53:42.340196 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-92d421e5-f2fc-4dbd-b52c-ff695c05142d tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:53:42.340715 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-92d421e5-f2fc-4dbd-b52c-ff695c05142d tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] [instance: 5f7b5a2b-5225-49fa-828d-930f941bf287] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:53:42.348813 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-92d421e5-f2fc-4dbd-b52c-ff695c05142d tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:42.349841 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-92d421e5-f2fc-4dbd-b52c-ff695c05142d tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:42.350422 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-92d421e5-f2fc-4dbd-b52c-ff695c05142d tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:42.351164 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-92d421e5-f2fc-4dbd-b52c-ff695c05142d tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:42.351622 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-92d421e5-f2fc-4dbd-b52c-ff695c05142d tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:42.352051 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-92d421e5-f2fc-4dbd-b52c-ff695c05142d tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:42.426847 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-92d421e5-f2fc-4dbd-b52c-ff695c05142d tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] HTTP exception thrown: Instance 5f7b5a2b-5225-49fa-828d-930f941bf287 is not attached to volume 93184a96-88a0-4bef-b0a0-fea120195b18 Sep 14 09:53:42.429156 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-92d421e5-f2fc-4dbd-b52c-ff695c05142d tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Request method failure captured: Sep 14 09:53:42.429156 n-d-836830-18 devstack@n-api.service[128759]: request: DELETE /compute/v2.1/servers/5f7b5a2b-5225-49fa-828d-930f941bf287/os-volume_attachments/93184a96-88a0-4bef-b0a0-fea120195b18 HTTP/1.1 Sep 14 09:53:42.429156 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:53:42.429156 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:53:42.429156 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:53:42.429156 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:53:42.429156 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:53:42.429156 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:53:42.429156 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:53:42.429156 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:53:42.429156 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIaQ9jLg9OYKsTKIqRb0AS5YYNhe9kr_ANsACd1isdaYhW78CTX8cL8Q5Vws63wMqQgUtcZO_6u0GyZVv47VX5G9QiK0sNZWYNnxbw9fc-dt0RlmInzl7MtLdFsG3iXVkLxLLITALqIUXoC1qK41C97F_1345yVQwyuOW-yGqKnQelJY Sep 14 09:53:42.429156 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:53:42.429156 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:53:42.429156 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:53:42.429156 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:53:42.429156 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:53:42.429156 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:53:42.429156 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 3aa81dd5f183418a8bf268f7618d38dd Sep 14 09:53:42.429156 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-TestEncryptedCinderVolumes-994755716 Sep 14 09:53:42.429156 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:53:42.429156 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:53:42.429156 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/3aa81dd5f183418a8bf268f7618d38dd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_3aa81dd5f183418a8bf268f7618d38dd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3aa81dd5f183418a8bf268f7618d38dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3aa81dd5f183418a8bf268f7618d38dd"}]}] Sep 14 09:53:42.429156 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-TestEncryptedCinderVolumes-994755716 Sep 14 09:53:42.429156 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 3aa81dd5f183418a8bf268f7618d38dd Sep 14 09:53:42.429156 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-994755716 Sep 14 09:53:42.429156 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-TestEncryptedCinderVolumes-994755716-project Sep 14 09:53:42.429156 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:53:42.429156 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:53:42.429156 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 2ffbbf813488435bb54edbbfedea84fc Sep 14 09:53:42.429156 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-TestEncryptedCinderVolumes-994755716-project Sep 14 09:53:42.429156 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:53:42.429156 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance 5f7b5a2b-5225-49fa-828d-930f941bf287 is not attached to volume 93184a96-88a0-4bef-b0a0-fea120195b18 Sep 14 09:53:42.429156 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'server_id': '5f7b5a2b-5225-49fa-828d-930f941bf287', 'id': '93184a96-88a0-4bef-b0a0-fea120195b18'} Sep 14 09:53:42.429156 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:53:42.429156 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:53:42.429156 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 14 09:53:42.429156 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 14 09:53:42.429156 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 14 09:53:42.429156 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 14 09:53:42.429156 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 14 09:53:42.429156 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 14 09:53:42.429156 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 93184a96-88a0-4bef-b0a0-fea120195b18. Sep 14 09:53:42.429156 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:53:42.429156 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:53:42.429156 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:53:42.429156 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:53:42.429156 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:53:42.429156 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:53:42.429156 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:53:42.429156 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:53:42.429156 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:53:42.429156 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:53:42.429156 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 14 09:53:42.429156 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 14 09:53:42.429156 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f7b5a2b-5225-49fa-828d-930f941bf287 is not attached to volume 93184a96-88a0-4bef-b0a0-fea120195b18 Sep 14 09:53:42.429156 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:53:42.429156 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:53:42.429156 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:53:42.429156 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:53:42.429156 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:53:42.429156 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:53:42.433541 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:53:42.433541 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:53:42.433541 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f7b5a2b-5225-49fa-828d-930f941bf287 is not attached to volume 93184a96-88a0-4bef-b0a0-fea120195b18 Sep 14 09:53:42.433541 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:53:42.433541 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-92d421e5-f2fc-4dbd-b52c-ff695c05142d tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Returning 404 to user: Instance 5f7b5a2b-5225-49fa-828d-930f941bf287 is not attached to volume 93184a96-88a0-4bef-b0a0-fea120195b18 {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:53:42.433541 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-92d421e5-f2fc-4dbd-b52c-ff695c05142d tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] 10.222.0.60 "DELETE /compute/v2.1/servers/5f7b5a2b-5225-49fa-828d-930f941bf287/os-volume_attachments/93184a96-88a0-4bef-b0a0-fea120195b18" status: 404 len: 154 microversion: 2.1 time: 0.095167 Sep 14 09:53:42.433541 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3922/7269] 10.222.0.60 () {58 vars in 1416 bytes} [Wed Sep 14 09:53:42 2022] DELETE /compute/v2.1/servers/5f7b5a2b-5225-49fa-828d-930f941bf287/os-volume_attachments/93184a96-88a0-4bef-b0a0-fea120195b18 => generated 154 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:53:45.786041 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-252a7d31-d439-4e60-9811-18ebd4d0c522 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:53:45.786582 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-252a7d31-d439-4e60-9811-18ebd4d0c522 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] [instance: 5f7b5a2b-5225-49fa-828d-930f941bf287] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:53:45.794786 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-252a7d31-d439-4e60-9811-18ebd4d0c522 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:45.795329 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-252a7d31-d439-4e60-9811-18ebd4d0c522 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:45.795789 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-252a7d31-d439-4e60-9811-18ebd4d0c522 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:45.796526 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-252a7d31-d439-4e60-9811-18ebd4d0c522 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:45.797002 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-252a7d31-d439-4e60-9811-18ebd4d0c522 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:45.797448 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-252a7d31-d439-4e60-9811-18ebd4d0c522 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:45.824743 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-252a7d31-d439-4e60-9811-18ebd4d0c522 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] [instance: 5f7b5a2b-5225-49fa-828d-930f941bf287] Going to try to terminate instance {{(pid=128758) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:53:45.910054 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-252a7d31-d439-4e60-9811-18ebd4d0c522 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] 10.222.0.60 "DELETE /compute/v2.1/servers/5f7b5a2b-5225-49fa-828d-930f941bf287" status: 204 len: 0 microversion: 2.1 time: 0.126982 Sep 14 09:53:45.910972 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3348/7270] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:53:45 2022] DELETE /compute/v2.1/servers/5f7b5a2b-5225-49fa-828d-930f941bf287 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 14 09:53:45.919808 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-0b86d2c9-e739-431b-ada7-1dc9173aa059 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:53:45.920565 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-0b86d2c9-e739-431b-ada7-1dc9173aa059 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] [instance: 5f7b5a2b-5225-49fa-828d-930f941bf287] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:53:45.928960 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0b86d2c9-e739-431b-ada7-1dc9173aa059 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:45.929451 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0b86d2c9-e739-431b-ada7-1dc9173aa059 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:45.929897 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0b86d2c9-e739-431b-ada7-1dc9173aa059 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:45.930602 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0b86d2c9-e739-431b-ada7-1dc9173aa059 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:45.931111 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0b86d2c9-e739-431b-ada7-1dc9173aa059 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:45.931547 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0b86d2c9-e739-431b-ada7-1dc9173aa059 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:46.066323 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-0b86d2c9-e739-431b-ada7-1dc9173aa059 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffbbf813488435bb54edbbfedea84fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa81dd5f183418a8bf268f7618d38dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:53:46.074320 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-0b86d2c9-e739-431b-ada7-1dc9173aa059 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] 10.222.0.60 "GET /compute/v2.1/servers/5f7b5a2b-5225-49fa-828d-930f941bf287" status: 200 len: 1558 microversion: 2.1 time: 0.158591 Sep 14 09:53:46.074895 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3923/7271] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:53:45 2022] GET /compute/v2.1/servers/5f7b5a2b-5225-49fa-828d-930f941bf287 => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:53:47.099606 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-7a10689c-e51d-4d14-8560-9ab997c5ab87 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:53:47.100351 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-7a10689c-e51d-4d14-8560-9ab997c5ab87 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] [instance: 5f7b5a2b-5225-49fa-828d-930f941bf287] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:53:47.107278 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7a10689c-e51d-4d14-8560-9ab997c5ab87 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:47.107785 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7a10689c-e51d-4d14-8560-9ab997c5ab87 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:47.108244 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7a10689c-e51d-4d14-8560-9ab997c5ab87 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:47.108951 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7a10689c-e51d-4d14-8560-9ab997c5ab87 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:47.109423 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7a10689c-e51d-4d14-8560-9ab997c5ab87 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:47.109867 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7a10689c-e51d-4d14-8560-9ab997c5ab87 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:47.241386 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-7a10689c-e51d-4d14-8560-9ab997c5ab87 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffbbf813488435bb54edbbfedea84fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa81dd5f183418a8bf268f7618d38dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:53:47.250409 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-7a10689c-e51d-4d14-8560-9ab997c5ab87 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] 10.222.0.60 "GET /compute/v2.1/servers/5f7b5a2b-5225-49fa-828d-930f941bf287" status: 200 len: 1558 microversion: 2.1 time: 0.155216 Sep 14 09:53:47.251014 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3349/7272] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:53:47 2022] GET /compute/v2.1/servers/5f7b5a2b-5225-49fa-828d-930f941bf287 => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:53:47.967717 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-7e88aa4f-327d-4553-bd0a-6588c555c246 req-1b999650-adce-4f80-b122-915ea76eb0e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f7b5a2b-5225-49fa-828d-930f941bf287", "name": "network-vif-deleted", "tag": "e0c38f37-b32c-4979-82d6-2ee991547a6a"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:53:47.978668 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-7e88aa4f-327d-4553-bd0a-6588c555c246 req-1b999650-adce-4f80-b122-915ea76eb0e9 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:47.979118 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-7e88aa4f-327d-4553-bd0a-6588c555c246 req-1b999650-adce-4f80-b122-915ea76eb0e9 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:47.979547 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-7e88aa4f-327d-4553-bd0a-6588c555c246 req-1b999650-adce-4f80-b122-915ea76eb0e9 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:47.991742 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-7e88aa4f-327d-4553-bd0a-6588c555c246 req-1b999650-adce-4f80-b122-915ea76eb0e9 service nova] Creating event network-vif-deleted:e0c38f37-b32c-4979-82d6-2ee991547a6a for instance 5f7b5a2b-5225-49fa-828d-930f941bf287 on n-h2-836830-18 Sep 14 09:53:47.997315 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-7e88aa4f-327d-4553-bd0a-6588c555c246 req-1b999650-adce-4f80-b122-915ea76eb0e9 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033171 Sep 14 09:53:47.997969 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3924/7273] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:53:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:53:48.276210 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-89ea2d74-ce19-40be-a7c9-bc725f84b025 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:53:48.276834 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-89ea2d74-ce19-40be-a7c9-bc725f84b025 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] [instance: 5f7b5a2b-5225-49fa-828d-930f941bf287] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:53:48.284590 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-89ea2d74-ce19-40be-a7c9-bc725f84b025 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:48.284813 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-89ea2d74-ce19-40be-a7c9-bc725f84b025 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:48.285296 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-89ea2d74-ce19-40be-a7c9-bc725f84b025 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:48.285963 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-89ea2d74-ce19-40be-a7c9-bc725f84b025 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:48.286426 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-89ea2d74-ce19-40be-a7c9-bc725f84b025 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:48.286864 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-89ea2d74-ce19-40be-a7c9-bc725f84b025 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:48.320471 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-89ea2d74-ce19-40be-a7c9-bc725f84b025 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:48.321603 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-89ea2d74-ce19-40be-a7c9-bc725f84b025 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:48.322057 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-89ea2d74-ce19-40be-a7c9-bc725f84b025 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:48.322523 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.objects.instance [None req-89ea2d74-ce19-40be-a7c9-bc725f84b025 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lazy-loading 'fault' on Instance uuid 5f7b5a2b-5225-49fa-828d-930f941bf287 {{(pid=128758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:53:48.367007 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-89ea2d74-ce19-40be-a7c9-bc725f84b025 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffbbf813488435bb54edbbfedea84fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa81dd5f183418a8bf268f7618d38dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:53:48.375410 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-89ea2d74-ce19-40be-a7c9-bc725f84b025 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] 10.222.0.60 "GET /compute/v2.1/servers/5f7b5a2b-5225-49fa-828d-930f941bf287" status: 200 len: 1352 microversion: 2.1 time: 0.103670 Sep 14 09:53:48.387463 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3350/7274] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:53:48 2022] GET /compute/v2.1/servers/5f7b5a2b-5225-49fa-828d-930f941bf287 => generated 1352 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:53:49.401371 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-afcfafa8-51a8-4b9c-a83e-94461d0d094f tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:53:49.402097 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-afcfafa8-51a8-4b9c-a83e-94461d0d094f tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] [instance: 5f7b5a2b-5225-49fa-828d-930f941bf287] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:53:49.409238 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-afcfafa8-51a8-4b9c-a83e-94461d0d094f tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:49.409735 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-afcfafa8-51a8-4b9c-a83e-94461d0d094f tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:49.410183 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-afcfafa8-51a8-4b9c-a83e-94461d0d094f tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:49.410895 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-afcfafa8-51a8-4b9c-a83e-94461d0d094f tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:49.411383 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-afcfafa8-51a8-4b9c-a83e-94461d0d094f tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:49.411819 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-afcfafa8-51a8-4b9c-a83e-94461d0d094f tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:49.425074 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-afcfafa8-51a8-4b9c-a83e-94461d0d094f tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] HTTP exception thrown: Instance 5f7b5a2b-5225-49fa-828d-930f941bf287 could not be found. Sep 14 09:53:49.426708 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-afcfafa8-51a8-4b9c-a83e-94461d0d094f tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Request method failure captured: Sep 14 09:53:49.426708 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/5f7b5a2b-5225-49fa-828d-930f941bf287 HTTP/1.1 Sep 14 09:53:49.426708 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:53:49.426708 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:53:49.426708 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:53:49.426708 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:53:49.426708 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:53:49.426708 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:53:49.426708 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:53:49.426708 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:53:49.426708 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIaQ9jLg9OYKsTKIqRb0AS5YYNhe9kr_ANsACd1isdaYhW78CTX8cL8Q5Vws63wMqQgUtcZO_6u0GyZVv47VX5G9QiK0sNZWYNnxbw9fc-dt0RlmInzl7MtLdFsG3iXVkLxLLITALqIUXoC1qK41C97F_1345yVQwyuOW-yGqKnQelJY Sep 14 09:53:49.426708 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:53:49.426708 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:53:49.426708 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:53:49.426708 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:53:49.426708 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:53:49.426708 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:53:49.426708 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 3aa81dd5f183418a8bf268f7618d38dd Sep 14 09:53:49.426708 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-TestEncryptedCinderVolumes-994755716 Sep 14 09:53:49.426708 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:53:49.426708 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:53:49.426708 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/3aa81dd5f183418a8bf268f7618d38dd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_3aa81dd5f183418a8bf268f7618d38dd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3aa81dd5f183418a8bf268f7618d38dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3aa81dd5f183418a8bf268f7618d38dd"}]}] Sep 14 09:53:49.426708 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-TestEncryptedCinderVolumes-994755716 Sep 14 09:53:49.426708 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 3aa81dd5f183418a8bf268f7618d38dd Sep 14 09:53:49.426708 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-994755716 Sep 14 09:53:49.426708 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-TestEncryptedCinderVolumes-994755716-project Sep 14 09:53:49.426708 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:53:49.426708 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:53:49.426708 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 2ffbbf813488435bb54edbbfedea84fc Sep 14 09:53:49.426708 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-TestEncryptedCinderVolumes-994755716-project Sep 14 09:53:49.426708 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:53:49.426708 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance 5f7b5a2b-5225-49fa-828d-930f941bf287 could not be found. Sep 14 09:53:49.426708 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '5f7b5a2b-5225-49fa-828d-930f941bf287'} Sep 14 09:53:49.426708 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:53:49.426708 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:53:49.426708 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:53:49.426708 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:53:49.426708 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:53:49.426708 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:53:49.426708 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:53:49.426708 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:53:49.426708 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:53:49.426708 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:53:49.426708 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f7b5a2b-5225-49fa-828d-930f941bf287 could not be found. Sep 14 09:53:49.426708 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:53:49.426708 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:53:49.426708 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:53:49.426708 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:53:49.426708 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:53:49.426708 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:53:49.426708 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:53:49.426708 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:53:49.426708 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:53:49.426708 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:53:49.426708 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:53:49.426708 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:53:49.426708 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:53:49.426708 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:53:49.426708 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:53:49.426708 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:53:49.426708 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f7b5a2b-5225-49fa-828d-930f941bf287 could not be found. Sep 14 09:53:49.426708 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:53:49.426708 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:53:49.426708 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:53:49.431377 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:53:49.431377 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:53:49.431377 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:53:49.431377 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:53:49.431377 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:53:49.431377 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f7b5a2b-5225-49fa-828d-930f941bf287 could not be found. Sep 14 09:53:49.431377 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:53:49.431377 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-afcfafa8-51a8-4b9c-a83e-94461d0d094f tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Returning 404 to user: Instance 5f7b5a2b-5225-49fa-828d-930f941bf287 could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:53:49.431377 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-afcfafa8-51a8-4b9c-a83e-94461d0d094f tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] 10.222.0.60 "GET /compute/v2.1/servers/5f7b5a2b-5225-49fa-828d-930f941bf287" status: 404 len: 111 microversion: 2.1 time: 0.031630 Sep 14 09:53:49.431377 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3925/7275] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:53:49 2022] GET /compute/v2.1/servers/5f7b5a2b-5225-49fa-828d-930f941bf287 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 14 09:53:49.437226 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-6b4efd1b-1a45-4ecf-846b-9578279ca173 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] Calling method '.version_select at 0x7f7d3f298f70>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:53:49.457593 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-6b4efd1b-1a45-4ecf-846b-9578279ca173 tempest-TestEncryptedCinderVolumes-994755716 tempest-TestEncryptedCinderVolumes-994755716-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1092546797" status: 202 len: 0 microversion: 2.1 time: 0.024220 Sep 14 09:53:49.458052 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3351/7276] 10.222.0.60 () {58 vars in 1278 bytes} [Wed Sep 14 09:53:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1092546797 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 14 09:54:16.370632 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ef4f5527-970d-44bc-b3eb-834a6e80b739 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Action: 'create', calling method: .version_select at 0x7f7d3fcee5e0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-727819476", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKpjizcTASBDDAp+nSfE8vIc16U5d1SI8ZlywND1iQ+M9FNUa4hl/ARmd/+AesacdYg7DOotWw0gxxubvabFD516+0n6C1DO/UfXf+xw/E/hmn/muo7fXP2Uq9T4tL38fA=="}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:54:16.376665 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=14 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:54:16.377330 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=34 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:54:16.389445 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-ef4f5527-970d-44bc-b3eb-834a6e80b739 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Getting quotas for project dd6bde0c922b436f8e144b8a6feefebe. Resources: {'key_pairs'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:54:16.395370 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-ef4f5527-970d-44bc-b3eb-834a6e80b739 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Getting quotas for user 02916df7dbfa4ba9b40ff2c0d162ce4f and project dd6bde0c922b436f8e144b8a6feefebe. Resources: {'key_pairs'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:54:16.417925 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-ef4f5527-970d-44bc-b3eb-834a6e80b739 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.051424 Sep 14 09:54:16.418520 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3926/7277] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Sep 14 09:54:16 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:54:16.467033 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:54:16.467843 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:54:16.472121 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-441d081d-dd39-4a85-866b-59e5a9408854 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-604301680", "imageRef": "8b31b2cd-4ed3-4410-adb6-5e07c191fa9a", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-727819476", "networks": [{"uuid": "c685e3a8-9682-4c73-8dbb-3fc082f807fb"}]}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:54:16.526643 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.network.neutron [None req-441d081d-dd39-4a85-866b-59e5a9408854 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] validate_networks() for [('c685e3a8-9682-4c73-8dbb-3fc082f807fb', None, None, None, None, None)] {{(pid=128758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:54:16.899500 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-441d081d-dd39-4a85-866b-59e5a9408854 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Flavor limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:54:16.900146 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-441d081d-dd39-4a85-866b-59e5a9408854 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Image limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:54:16.900637 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-441d081d-dd39-4a85-866b-59e5a9408854 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Flavor pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:54:16.901088 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-441d081d-dd39-4a85-866b-59e5a9408854 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Image pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:54:16.901530 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-441d081d-dd39-4a85-866b-59e5a9408854 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:54:16.912525 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-441d081d-dd39-4a85-866b-59e5a9408854 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:16.913187 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-441d081d-dd39-4a85-866b-59e5a9408854 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:16.913736 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-441d081d-dd39-4a85-866b-59e5a9408854 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:16.914732 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-441d081d-dd39-4a85-866b-59e5a9408854 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:16.915418 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-441d081d-dd39-4a85-866b-59e5a9408854 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:16.916103 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-441d081d-dd39-4a85-866b-59e5a9408854 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:16.941550 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-441d081d-dd39-4a85-866b-59e5a9408854 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Getting quotas for project dd6bde0c922b436f8e144b8a6feefebe. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:54:16.950261 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-441d081d-dd39-4a85-866b-59e5a9408854 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Getting quotas for user 02916df7dbfa4ba9b40ff2c0d162ce4f and project dd6bde0c922b436f8e144b8a6feefebe. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:54:16.967189 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-441d081d-dd39-4a85-866b-59e5a9408854 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Going to run 1 instances... {{(pid=128758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:54:16.969435 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-441d081d-dd39-4a85-866b-59e5a9408854 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] [instance: d526ca93-ef52-4c58-a408-9619dbc27a67] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8b31b2cd-4ed3-4410-adb6-5e07c191fa9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:54:17.017176 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-441d081d-dd39-4a85-866b-59e5a9408854 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.552150 Sep 14 09:54:17.017846 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3352/7278] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 09:54:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 553 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:54:17.029416 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-aaf260ea-1409-4089-997c-2aba9321781b tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:54:17.030047 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-aaf260ea-1409-4089-997c-2aba9321781b tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] [instance: d526ca93-ef52-4c58-a408-9619dbc27a67] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:54:17.091878 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-aaf260ea-1409-4089-997c-2aba9321781b tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02916df7dbfa4ba9b40ff2c0d162ce4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6bde0c922b436f8e144b8a6feefebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:54:17.099933 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-aaf260ea-1409-4089-997c-2aba9321781b tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] 10.222.0.60 "GET /compute/v2.1/servers/d526ca93-ef52-4c58-a408-9619dbc27a67" status: 200 len: 1257 microversion: 2.1 time: 0.073876 Sep 14 09:54:17.100519 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3927/7279] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:54:17 2022] GET /compute/v2.1/servers/d526ca93-ef52-4c58-a408-9619dbc27a67 => generated 1257 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:54:18.123660 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d10884cf-0ce7-4389-9551-b4c50ca60361 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:54:18.124346 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-d10884cf-0ce7-4389-9551-b4c50ca60361 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] [instance: d526ca93-ef52-4c58-a408-9619dbc27a67] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:54:18.131222 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d10884cf-0ce7-4389-9551-b4c50ca60361 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:18.131786 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d10884cf-0ce7-4389-9551-b4c50ca60361 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:18.132237 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d10884cf-0ce7-4389-9551-b4c50ca60361 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:18.132941 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d10884cf-0ce7-4389-9551-b4c50ca60361 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:18.133408 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d10884cf-0ce7-4389-9551-b4c50ca60361 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:18.133857 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d10884cf-0ce7-4389-9551-b4c50ca60361 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:18.199874 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-d10884cf-0ce7-4389-9551-b4c50ca60361 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02916df7dbfa4ba9b40ff2c0d162ce4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6bde0c922b436f8e144b8a6feefebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:54:18.207982 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-d10884cf-0ce7-4389-9551-b4c50ca60361 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] 10.222.0.60 "GET /compute/v2.1/servers/d526ca93-ef52-4c58-a408-9619dbc27a67" status: 200 len: 1315 microversion: 2.1 time: 0.089321 Sep 14 09:54:18.223248 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3353/7280] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:54:18 2022] GET /compute/v2.1/servers/d526ca93-ef52-4c58-a408-9619dbc27a67 => generated 1315 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:54:19.233056 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-35d60bb3-347e-4b21-b3f2-e74c590cc03a tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:54:19.233688 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-35d60bb3-347e-4b21-b3f2-e74c590cc03a tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] [instance: d526ca93-ef52-4c58-a408-9619dbc27a67] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:54:19.245424 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-35d60bb3-347e-4b21-b3f2-e74c590cc03a tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:19.245954 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-35d60bb3-347e-4b21-b3f2-e74c590cc03a tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:19.246375 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-35d60bb3-347e-4b21-b3f2-e74c590cc03a tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:19.247225 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-35d60bb3-347e-4b21-b3f2-e74c590cc03a tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:19.247744 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-35d60bb3-347e-4b21-b3f2-e74c590cc03a tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:19.248324 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-35d60bb3-347e-4b21-b3f2-e74c590cc03a tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:19.405725 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-35d60bb3-347e-4b21-b3f2-e74c590cc03a tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02916df7dbfa4ba9b40ff2c0d162ce4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6bde0c922b436f8e144b8a6feefebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:54:19.415058 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-35d60bb3-347e-4b21-b3f2-e74c590cc03a tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] 10.222.0.60 "GET /compute/v2.1/servers/d526ca93-ef52-4c58-a408-9619dbc27a67" status: 200 len: 1357 microversion: 2.1 time: 0.185952 Sep 14 09:54:19.432581 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3928/7281] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:54:19 2022] GET /compute/v2.1/servers/d526ca93-ef52-4c58-a408-9619dbc27a67 => generated 1357 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:54:20.439118 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-0a67751c-2ac7-478a-ae80-56f1ada70718 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:54:20.439743 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-0a67751c-2ac7-478a-ae80-56f1ada70718 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] [instance: d526ca93-ef52-4c58-a408-9619dbc27a67] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:54:20.446804 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0a67751c-2ac7-478a-ae80-56f1ada70718 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:20.447366 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0a67751c-2ac7-478a-ae80-56f1ada70718 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:20.447818 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0a67751c-2ac7-478a-ae80-56f1ada70718 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:20.448531 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0a67751c-2ac7-478a-ae80-56f1ada70718 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:20.449000 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0a67751c-2ac7-478a-ae80-56f1ada70718 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:20.449446 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0a67751c-2ac7-478a-ae80-56f1ada70718 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:20.927574 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-0a67751c-2ac7-478a-ae80-56f1ada70718 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02916df7dbfa4ba9b40ff2c0d162ce4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6bde0c922b436f8e144b8a6feefebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:54:20.935694 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-0a67751c-2ac7-478a-ae80-56f1ada70718 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] 10.222.0.60 "GET /compute/v2.1/servers/d526ca93-ef52-4c58-a408-9619dbc27a67" status: 200 len: 1357 microversion: 2.1 time: 0.500470 Sep 14 09:54:20.936277 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3354/7282] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:54:20 2022] GET /compute/v2.1/servers/d526ca93-ef52-4c58-a408-9619dbc27a67 => generated 1357 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:54:21.960661 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-af2c8e4a-5ff5-4d2f-9ebe-0f2fe498e649 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:54:21.961305 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-af2c8e4a-5ff5-4d2f-9ebe-0f2fe498e649 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] [instance: d526ca93-ef52-4c58-a408-9619dbc27a67] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:54:21.967615 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-af2c8e4a-5ff5-4d2f-9ebe-0f2fe498e649 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:21.968113 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-af2c8e4a-5ff5-4d2f-9ebe-0f2fe498e649 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:21.968567 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-af2c8e4a-5ff5-4d2f-9ebe-0f2fe498e649 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:21.969274 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-af2c8e4a-5ff5-4d2f-9ebe-0f2fe498e649 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:21.970003 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-af2c8e4a-5ff5-4d2f-9ebe-0f2fe498e649 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:21.970440 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-af2c8e4a-5ff5-4d2f-9ebe-0f2fe498e649 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:22.114502 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-af2c8e4a-5ff5-4d2f-9ebe-0f2fe498e649 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02916df7dbfa4ba9b40ff2c0d162ce4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6bde0c922b436f8e144b8a6feefebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:54:22.122319 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-af2c8e4a-5ff5-4d2f-9ebe-0f2fe498e649 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] 10.222.0.60 "GET /compute/v2.1/servers/d526ca93-ef52-4c58-a408-9619dbc27a67" status: 200 len: 1357 microversion: 2.1 time: 0.166837 Sep 14 09:54:22.122912 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3929/7283] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:54:21 2022] GET /compute/v2.1/servers/d526ca93-ef52-4c58-a408-9619dbc27a67 => generated 1357 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:54:23.145921 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-4698e0ca-1459-4305-aaf1-f3c8fa6b99d6 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:54:23.146575 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-4698e0ca-1459-4305-aaf1-f3c8fa6b99d6 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] [instance: d526ca93-ef52-4c58-a408-9619dbc27a67] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:54:23.153204 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4698e0ca-1459-4305-aaf1-f3c8fa6b99d6 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:23.153692 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4698e0ca-1459-4305-aaf1-f3c8fa6b99d6 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:23.154134 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4698e0ca-1459-4305-aaf1-f3c8fa6b99d6 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:23.154829 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4698e0ca-1459-4305-aaf1-f3c8fa6b99d6 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:23.155322 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4698e0ca-1459-4305-aaf1-f3c8fa6b99d6 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:23.155757 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4698e0ca-1459-4305-aaf1-f3c8fa6b99d6 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:23.294118 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-4698e0ca-1459-4305-aaf1-f3c8fa6b99d6 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02916df7dbfa4ba9b40ff2c0d162ce4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6bde0c922b436f8e144b8a6feefebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:54:23.303980 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-4698e0ca-1459-4305-aaf1-f3c8fa6b99d6 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] 10.222.0.60 "GET /compute/v2.1/servers/d526ca93-ef52-4c58-a408-9619dbc27a67" status: 200 len: 1357 microversion: 2.1 time: 0.162548 Sep 14 09:54:23.311027 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3355/7284] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:54:23 2022] GET /compute/v2.1/servers/d526ca93-ef52-4c58-a408-9619dbc27a67 => generated 1357 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:54:24.327285 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d5cf5160-e9b4-43c5-a047-75b890312409 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:54:24.327902 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-d5cf5160-e9b4-43c5-a047-75b890312409 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] [instance: d526ca93-ef52-4c58-a408-9619dbc27a67] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:54:24.334639 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d5cf5160-e9b4-43c5-a047-75b890312409 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:24.335106 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d5cf5160-e9b4-43c5-a047-75b890312409 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:24.335551 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d5cf5160-e9b4-43c5-a047-75b890312409 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:24.336249 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d5cf5160-e9b4-43c5-a047-75b890312409 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:24.336710 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d5cf5160-e9b4-43c5-a047-75b890312409 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:24.337138 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d5cf5160-e9b4-43c5-a047-75b890312409 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:24.483248 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-d5cf5160-e9b4-43c5-a047-75b890312409 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02916df7dbfa4ba9b40ff2c0d162ce4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6bde0c922b436f8e144b8a6feefebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:54:24.492169 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d5cf5160-e9b4-43c5-a047-75b890312409 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] 10.222.0.60 "GET /compute/v2.1/servers/d526ca93-ef52-4c58-a408-9619dbc27a67" status: 200 len: 1357 microversion: 2.1 time: 0.168783 Sep 14 09:54:24.492769 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3930/7285] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:54:24 2022] GET /compute/v2.1/servers/d526ca93-ef52-4c58-a408-9619dbc27a67 => generated 1357 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:54:25.516698 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-48b59d9a-60fd-42d7-9dd9-ad31968849a3 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:54:25.517323 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-48b59d9a-60fd-42d7-9dd9-ad31968849a3 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] [instance: d526ca93-ef52-4c58-a408-9619dbc27a67] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:54:25.525431 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-48b59d9a-60fd-42d7-9dd9-ad31968849a3 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:25.525936 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-48b59d9a-60fd-42d7-9dd9-ad31968849a3 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:25.526830 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-48b59d9a-60fd-42d7-9dd9-ad31968849a3 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:25.527750 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-48b59d9a-60fd-42d7-9dd9-ad31968849a3 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:25.528216 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-48b59d9a-60fd-42d7-9dd9-ad31968849a3 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:25.528652 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-48b59d9a-60fd-42d7-9dd9-ad31968849a3 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:25.663439 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-48b59d9a-60fd-42d7-9dd9-ad31968849a3 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02916df7dbfa4ba9b40ff2c0d162ce4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6bde0c922b436f8e144b8a6feefebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:54:25.672800 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-48b59d9a-60fd-42d7-9dd9-ad31968849a3 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] 10.222.0.60 "GET /compute/v2.1/servers/d526ca93-ef52-4c58-a408-9619dbc27a67" status: 200 len: 1357 microversion: 2.1 time: 0.160410 Sep 14 09:54:25.673597 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3356/7286] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:54:25 2022] GET /compute/v2.1/servers/d526ca93-ef52-4c58-a408-9619dbc27a67 => generated 1357 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:54:26.696236 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-bfda19d5-dd4e-4375-b848-3dd4810c0878 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:54:26.697169 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-bfda19d5-dd4e-4375-b848-3dd4810c0878 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] [instance: d526ca93-ef52-4c58-a408-9619dbc27a67] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:54:26.704710 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bfda19d5-dd4e-4375-b848-3dd4810c0878 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:26.705467 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bfda19d5-dd4e-4375-b848-3dd4810c0878 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:26.705890 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bfda19d5-dd4e-4375-b848-3dd4810c0878 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:26.706586 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bfda19d5-dd4e-4375-b848-3dd4810c0878 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:26.707069 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bfda19d5-dd4e-4375-b848-3dd4810c0878 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:26.707502 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bfda19d5-dd4e-4375-b848-3dd4810c0878 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:26.843811 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-bfda19d5-dd4e-4375-b848-3dd4810c0878 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02916df7dbfa4ba9b40ff2c0d162ce4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6bde0c922b436f8e144b8a6feefebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:54:26.852849 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-bfda19d5-dd4e-4375-b848-3dd4810c0878 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] 10.222.0.60 "GET /compute/v2.1/servers/d526ca93-ef52-4c58-a408-9619dbc27a67" status: 200 len: 1357 microversion: 2.1 time: 0.160610 Sep 14 09:54:26.853420 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3931/7287] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:54:26 2022] GET /compute/v2.1/servers/d526ca93-ef52-4c58-a408-9619dbc27a67 => generated 1357 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:54:26.946151 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-0c9fd7eb-6d60-4ca9-8282-54244ed1f09d req-dcf56f14-d9c2-4f5c-9c60-a402a79ed61c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d526ca93-ef52-4c58-a408-9619dbc27a67", "tag": "4904b5cc-5c5d-40ae-ae54-48ce200d83cb"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:54:26.952574 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=2 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:54:26.959142 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-0c9fd7eb-6d60-4ca9-8282-54244ed1f09d req-dcf56f14-d9c2-4f5c-9c60-a402a79ed61c service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:26.959644 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-0c9fd7eb-6d60-4ca9-8282-54244ed1f09d req-dcf56f14-d9c2-4f5c-9c60-a402a79ed61c service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:26.960089 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-0c9fd7eb-6d60-4ca9-8282-54244ed1f09d req-dcf56f14-d9c2-4f5c-9c60-a402a79ed61c service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:26.964488 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=6 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:54:26.973093 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-0c9fd7eb-6d60-4ca9-8282-54244ed1f09d req-dcf56f14-d9c2-4f5c-9c60-a402a79ed61c service nova] Creating event network-changed:4904b5cc-5c5d-40ae-ae54-48ce200d83cb for instance d526ca93-ef52-4c58-a408-9619dbc27a67 on n-h2-836830-18 Sep 14 09:54:26.978452 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-0c9fd7eb-6d60-4ca9-8282-54244ed1f09d req-dcf56f14-d9c2-4f5c-9c60-a402a79ed61c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036684 Sep 14 09:54:26.979549 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3357/7288] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:54:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:54:27.876657 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-0a21aa09-ee53-420f-9ece-eee8b56015da tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:54:27.877281 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-0a21aa09-ee53-420f-9ece-eee8b56015da tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] [instance: d526ca93-ef52-4c58-a408-9619dbc27a67] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:54:27.879160 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=6 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:54:27.885675 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0a21aa09-ee53-420f-9ece-eee8b56015da tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:27.886489 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0a21aa09-ee53-420f-9ece-eee8b56015da tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:27.887148 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0a21aa09-ee53-420f-9ece-eee8b56015da tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:27.888396 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0a21aa09-ee53-420f-9ece-eee8b56015da tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:27.889200 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0a21aa09-ee53-420f-9ece-eee8b56015da tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:27.890072 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0a21aa09-ee53-420f-9ece-eee8b56015da tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:28.021420 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-0a21aa09-ee53-420f-9ece-eee8b56015da tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02916df7dbfa4ba9b40ff2c0d162ce4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6bde0c922b436f8e144b8a6feefebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:54:28.029197 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-0a21aa09-ee53-420f-9ece-eee8b56015da tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] 10.222.0.60 "GET /compute/v2.1/servers/d526ca93-ef52-4c58-a408-9619dbc27a67" status: 200 len: 1357 microversion: 2.1 time: 0.156489 Sep 14 09:54:28.029775 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3932/7289] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:54:27 2022] GET /compute/v2.1/servers/d526ca93-ef52-4c58-a408-9619dbc27a67 => generated 1357 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:54:29.054469 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-8d7ffc10-0003-4413-a260-09ee6e171dd1 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:54:29.055233 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-8d7ffc10-0003-4413-a260-09ee6e171dd1 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] [instance: d526ca93-ef52-4c58-a408-9619dbc27a67] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:54:29.061469 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8d7ffc10-0003-4413-a260-09ee6e171dd1 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:29.062010 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8d7ffc10-0003-4413-a260-09ee6e171dd1 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:29.062473 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8d7ffc10-0003-4413-a260-09ee6e171dd1 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:29.063210 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8d7ffc10-0003-4413-a260-09ee6e171dd1 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:29.063688 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8d7ffc10-0003-4413-a260-09ee6e171dd1 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:29.064134 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8d7ffc10-0003-4413-a260-09ee6e171dd1 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:29.214167 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-8d7ffc10-0003-4413-a260-09ee6e171dd1 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02916df7dbfa4ba9b40ff2c0d162ce4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6bde0c922b436f8e144b8a6feefebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:54:29.226042 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-8d7ffc10-0003-4413-a260-09ee6e171dd1 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] 10.222.0.60 "GET /compute/v2.1/servers/d526ca93-ef52-4c58-a408-9619dbc27a67" status: 200 len: 1357 microversion: 2.1 time: 0.177095 Sep 14 09:54:29.226825 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3358/7290] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:54:29 2022] GET /compute/v2.1/servers/d526ca93-ef52-4c58-a408-9619dbc27a67 => generated 1357 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:54:30.250625 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-eb33ec75-e5f9-4d33-979e-65a254006304 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:54:30.251317 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-eb33ec75-e5f9-4d33-979e-65a254006304 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] [instance: d526ca93-ef52-4c58-a408-9619dbc27a67] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:54:30.258696 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-eb33ec75-e5f9-4d33-979e-65a254006304 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:30.259226 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-eb33ec75-e5f9-4d33-979e-65a254006304 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:30.259677 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-eb33ec75-e5f9-4d33-979e-65a254006304 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:30.260380 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-eb33ec75-e5f9-4d33-979e-65a254006304 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:30.260843 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-eb33ec75-e5f9-4d33-979e-65a254006304 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:30.261281 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-eb33ec75-e5f9-4d33-979e-65a254006304 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:30.389329 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-eb33ec75-e5f9-4d33-979e-65a254006304 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02916df7dbfa4ba9b40ff2c0d162ce4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6bde0c922b436f8e144b8a6feefebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:54:30.397117 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-eb33ec75-e5f9-4d33-979e-65a254006304 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] 10.222.0.60 "GET /compute/v2.1/servers/d526ca93-ef52-4c58-a408-9619dbc27a67" status: 200 len: 1357 microversion: 2.1 time: 0.150508 Sep 14 09:54:30.397699 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3933/7291] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:54:30 2022] GET /compute/v2.1/servers/d526ca93-ef52-4c58-a408-9619dbc27a67 => generated 1357 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:54:30.927307 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-98f96fea-7c8b-40cb-b204-4d0a5217765d req-8edcc1eb-77cf-495c-b05f-326359dadb1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d526ca93-ef52-4c58-a408-9619dbc27a67", "name": "network-vif-plugged", "status": "completed", "tag": "4904b5cc-5c5d-40ae-ae54-48ce200d83cb"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:54:30.938071 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-98f96fea-7c8b-40cb-b204-4d0a5217765d req-8edcc1eb-77cf-495c-b05f-326359dadb1e service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:30.938642 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-98f96fea-7c8b-40cb-b204-4d0a5217765d req-8edcc1eb-77cf-495c-b05f-326359dadb1e service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:30.939186 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-98f96fea-7c8b-40cb-b204-4d0a5217765d req-8edcc1eb-77cf-495c-b05f-326359dadb1e service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:30.952461 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-98f96fea-7c8b-40cb-b204-4d0a5217765d req-8edcc1eb-77cf-495c-b05f-326359dadb1e service nova] Creating event network-vif-plugged:4904b5cc-5c5d-40ae-ae54-48ce200d83cb for instance d526ca93-ef52-4c58-a408-9619dbc27a67 on n-h2-836830-18 Sep 14 09:54:30.957844 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-98f96fea-7c8b-40cb-b204-4d0a5217765d req-8edcc1eb-77cf-495c-b05f-326359dadb1e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034199 Sep 14 09:54:30.959132 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3359/7292] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:54:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:54:31.420144 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9ffb2a2d-08cc-445a-a77b-360ded14ff08 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:54:31.420760 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-9ffb2a2d-08cc-445a-a77b-360ded14ff08 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] [instance: d526ca93-ef52-4c58-a408-9619dbc27a67] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:54:31.428191 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9ffb2a2d-08cc-445a-a77b-360ded14ff08 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:31.428671 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9ffb2a2d-08cc-445a-a77b-360ded14ff08 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:31.429110 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9ffb2a2d-08cc-445a-a77b-360ded14ff08 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:31.429801 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9ffb2a2d-08cc-445a-a77b-360ded14ff08 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:31.430254 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9ffb2a2d-08cc-445a-a77b-360ded14ff08 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:31.430676 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9ffb2a2d-08cc-445a-a77b-360ded14ff08 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:31.559176 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-9ffb2a2d-08cc-445a-a77b-360ded14ff08 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02916df7dbfa4ba9b40ff2c0d162ce4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6bde0c922b436f8e144b8a6feefebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:54:31.567021 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-9ffb2a2d-08cc-445a-a77b-360ded14ff08 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] 10.222.0.60 "GET /compute/v2.1/servers/d526ca93-ef52-4c58-a408-9619dbc27a67" status: 200 len: 1357 microversion: 2.1 time: 0.150840 Sep 14 09:54:31.567604 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3934/7293] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:54:31 2022] GET /compute/v2.1/servers/d526ca93-ef52-4c58-a408-9619dbc27a67 => generated 1357 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:54:32.590601 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a752d602-e50f-4590-9031-b150c3399972 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:54:32.591362 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-a752d602-e50f-4590-9031-b150c3399972 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] [instance: d526ca93-ef52-4c58-a408-9619dbc27a67] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:54:32.598605 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a752d602-e50f-4590-9031-b150c3399972 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:32.599190 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a752d602-e50f-4590-9031-b150c3399972 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:32.599648 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a752d602-e50f-4590-9031-b150c3399972 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:32.600355 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a752d602-e50f-4590-9031-b150c3399972 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:32.600826 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a752d602-e50f-4590-9031-b150c3399972 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:32.601275 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a752d602-e50f-4590-9031-b150c3399972 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:32.734412 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-a752d602-e50f-4590-9031-b150c3399972 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02916df7dbfa4ba9b40ff2c0d162ce4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6bde0c922b436f8e144b8a6feefebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:54:32.742751 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-a752d602-e50f-4590-9031-b150c3399972 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] 10.222.0.60 "GET /compute/v2.1/servers/d526ca93-ef52-4c58-a408-9619dbc27a67" status: 200 len: 1547 microversion: 2.1 time: 0.156511 Sep 14 09:54:32.743365 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3360/7294] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:54:32 2022] GET /compute/v2.1/servers/d526ca93-ef52-4c58-a408-9619dbc27a67 => generated 1547 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:54:32.765384 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-eb053092-f9fd-470c-bf34-075065310782 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:54:32.766010 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-eb053092-f9fd-470c-bf34-075065310782 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] [instance: d526ca93-ef52-4c58-a408-9619dbc27a67] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:54:32.773012 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-eb053092-f9fd-470c-bf34-075065310782 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:32.773499 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-eb053092-f9fd-470c-bf34-075065310782 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:32.773938 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-eb053092-f9fd-470c-bf34-075065310782 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:32.774629 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-eb053092-f9fd-470c-bf34-075065310782 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:32.775147 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-eb053092-f9fd-470c-bf34-075065310782 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:32.775577 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-eb053092-f9fd-470c-bf34-075065310782 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:32.907022 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-eb053092-f9fd-470c-bf34-075065310782 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02916df7dbfa4ba9b40ff2c0d162ce4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6bde0c922b436f8e144b8a6feefebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:54:32.915296 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-eb053092-f9fd-470c-bf34-075065310782 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] 10.222.0.60 "GET /compute/v2.1/servers/d526ca93-ef52-4c58-a408-9619dbc27a67" status: 200 len: 1547 microversion: 2.1 time: 0.153801 Sep 14 09:54:32.915868 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3935/7295] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:54:32 2022] GET /compute/v2.1/servers/d526ca93-ef52-4c58-a408-9619dbc27a67 => generated 1547 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:54:32.937631 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-88a49b99-6277-4e8d-89fb-536516f07995 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:54:32.942284 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-88a49b99-6277-4e8d-89fb-536516f07995 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '02916df7dbfa4ba9b40ff2c0d162ce4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6bde0c922b436f8e144b8a6feefebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:54:32.943131 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-88a49b99-6277-4e8d-89fb-536516f07995 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Searching by: {'deleted': False, 'project_id': 'dd6bde0c922b436f8e144b8a6feefebe'} {{(pid=128758) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 14 09:54:32.948418 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-88a49b99-6277-4e8d-89fb-536516f07995 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:32.948906 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-88a49b99-6277-4e8d-89fb-536516f07995 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:32.949347 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-88a49b99-6277-4e8d-89fb-536516f07995 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:32.950074 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-88a49b99-6277-4e8d-89fb-536516f07995 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:32.950535 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-88a49b99-6277-4e8d-89fb-536516f07995 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:32.950991 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-88a49b99-6277-4e8d-89fb-536516f07995 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:32.975167 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.multi_cell_list [None req-88a49b99-6277-4e8d-89fb-536516f07995 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128758) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 14 09:54:33.001243 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-88a49b99-6277-4e8d-89fb-536516f07995 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] 10.222.0.60 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.067509 Sep 14 09:54:33.001817 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3361/7296] 10.222.0.60 () {58 vars in 1125 bytes} [Wed Sep 14 09:54:32 2022] GET /compute/v2.1/servers => generated 342 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:54:33.013632 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e5afd9b1-9717-4676-9396-b179d493df53 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:54:33.014259 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e5afd9b1-9717-4676-9396-b179d493df53 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] [instance: d526ca93-ef52-4c58-a408-9619dbc27a67] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:54:33.020155 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e5afd9b1-9717-4676-9396-b179d493df53 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:33.020645 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e5afd9b1-9717-4676-9396-b179d493df53 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:33.021096 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e5afd9b1-9717-4676-9396-b179d493df53 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:33.021812 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e5afd9b1-9717-4676-9396-b179d493df53 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:33.022277 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e5afd9b1-9717-4676-9396-b179d493df53 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:33.022735 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e5afd9b1-9717-4676-9396-b179d493df53 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:33.152834 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-e5afd9b1-9717-4676-9396-b179d493df53 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02916df7dbfa4ba9b40ff2c0d162ce4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6bde0c922b436f8e144b8a6feefebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:54:33.160581 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e5afd9b1-9717-4676-9396-b179d493df53 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] 10.222.0.60 "GET /compute/v2.1/servers/d526ca93-ef52-4c58-a408-9619dbc27a67" status: 200 len: 1547 microversion: 2.1 time: 0.150887 Sep 14 09:54:33.161164 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3936/7297] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:54:33 2022] GET /compute/v2.1/servers/d526ca93-ef52-4c58-a408-9619dbc27a67 => generated 1547 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:54:34.704324 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-e52f1ca5-f5a3-4cd5-be81-e1161c2191b8 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "57dffdbf-d8b0-40c7-ba06-43a191f2d635"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:54:34.706676 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-e52f1ca5-f5a3-4cd5-be81-e1161c2191b8 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] [instance: d526ca93-ef52-4c58-a408-9619dbc27a67] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:54:34.713418 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e52f1ca5-f5a3-4cd5-be81-e1161c2191b8 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:34.713909 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e52f1ca5-f5a3-4cd5-be81-e1161c2191b8 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:34.714355 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e52f1ca5-f5a3-4cd5-be81-e1161c2191b8 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:34.715073 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e52f1ca5-f5a3-4cd5-be81-e1161c2191b8 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:34.715537 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e52f1ca5-f5a3-4cd5-be81-e1161c2191b8 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:34.715976 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e52f1ca5-f5a3-4cd5-be81-e1161c2191b8 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:34.950614 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-e52f1ca5-f5a3-4cd5-be81-e1161c2191b8 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] 10.222.0.60 "POST /compute/v2.1/servers/d526ca93-ef52-4c58-a408-9619dbc27a67/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.250086 Sep 14 09:54:34.951346 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3362/7298] 10.222.0.60 () {60 vars in 1323 bytes} [Wed Sep 14 09:54:34 2022] POST /compute/v2.1/servers/d526ca93-ef52-4c58-a408-9619dbc27a67/os-volume_attachments => generated 194 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:54:47.986381 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-dc729519-7284-47ba-9d5b-40b33b1d28d1 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:54:47.987060 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-dc729519-7284-47ba-9d5b-40b33b1d28d1 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] [instance: d526ca93-ef52-4c58-a408-9619dbc27a67] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:54:47.990560 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:54:47.991596 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=54 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:54:47.997549 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dc729519-7284-47ba-9d5b-40b33b1d28d1 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:47.998043 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dc729519-7284-47ba-9d5b-40b33b1d28d1 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:47.998517 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dc729519-7284-47ba-9d5b-40b33b1d28d1 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:47.999252 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dc729519-7284-47ba-9d5b-40b33b1d28d1 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:47.999717 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dc729519-7284-47ba-9d5b-40b33b1d28d1 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:48.000153 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dc729519-7284-47ba-9d5b-40b33b1d28d1 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:48.130559 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-dc729519-7284-47ba-9d5b-40b33b1d28d1 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02916df7dbfa4ba9b40ff2c0d162ce4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6bde0c922b436f8e144b8a6feefebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:54:48.138918 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-dc729519-7284-47ba-9d5b-40b33b1d28d1 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] 10.222.0.60 "GET /compute/v2.1/servers/d526ca93-ef52-4c58-a408-9619dbc27a67" status: 200 len: 1593 microversion: 2.1 time: 0.156474 Sep 14 09:54:48.139516 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3937/7299] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:54:47 2022] GET /compute/v2.1/servers/d526ca93-ef52-4c58-a408-9619dbc27a67 => generated 1593 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:54:50.034836 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=2 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:54:50.035867 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:54:50.036835 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:54:50.182285 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-1ddff23e-dea2-4def-97ad-6055064a5573 req-b3aee3a6-588b-4004-9392-b1724b3a8614 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d526ca93-ef52-4c58-a408-9619dbc27a67", "tag": "4904b5cc-5c5d-40ae-ae54-48ce200d83cb"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:54:50.195312 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-1ddff23e-dea2-4def-97ad-6055064a5573 req-b3aee3a6-588b-4004-9392-b1724b3a8614 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:50.195949 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-1ddff23e-dea2-4def-97ad-6055064a5573 req-b3aee3a6-588b-4004-9392-b1724b3a8614 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:50.196402 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-1ddff23e-dea2-4def-97ad-6055064a5573 req-b3aee3a6-588b-4004-9392-b1724b3a8614 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:50.210614 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-1ddff23e-dea2-4def-97ad-6055064a5573 req-b3aee3a6-588b-4004-9392-b1724b3a8614 service nova] Creating event network-changed:4904b5cc-5c5d-40ae-ae54-48ce200d83cb for instance d526ca93-ef52-4c58-a408-9619dbc27a67 on n-h2-836830-18 Sep 14 09:54:50.217680 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-1ddff23e-dea2-4def-97ad-6055064a5573 req-b3aee3a6-588b-4004-9392-b1724b3a8614 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.184334 Sep 14 09:54:50.218472 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3363/7300] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:54:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:54:51.063460 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-db4cdb13-a382-4cfd-9b60-7902432bf058 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-186631762"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:54:51.064059 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-db4cdb13-a382-4cfd-9b60-7902432bf058 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] [instance: d526ca93-ef52-4c58-a408-9619dbc27a67] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:54:51.074680 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-db4cdb13-a382-4cfd-9b60-7902432bf058 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:51.075549 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-db4cdb13-a382-4cfd-9b60-7902432bf058 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:51.075981 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-db4cdb13-a382-4cfd-9b60-7902432bf058 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:51.076702 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-db4cdb13-a382-4cfd-9b60-7902432bf058 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:51.077168 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-db4cdb13-a382-4cfd-9b60-7902432bf058 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:51.077606 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-db4cdb13-a382-4cfd-9b60-7902432bf058 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:51.212620 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.network.security_group_api [None req-db4cdb13-a382-4cfd-9b60-7902432bf058 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Adding security group d498bf00-2354-40b2-b2f6-a7c212d2488f to port 4904b5cc-5c5d-40ae-ae54-48ce200d83cb Sep 14 09:54:51.547431 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-db4cdb13-a382-4cfd-9b60-7902432bf058 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] 10.222.0.60 "POST /compute/v2.1/servers/d526ca93-ef52-4c58-a408-9619dbc27a67/action" status: 202 len: 0 microversion: 2.1 time: 0.487922 Sep 14 09:54:51.551893 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3938/7301] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:54:51 2022] POST /compute/v2.1/servers/d526ca93-ef52-4c58-a408-9619dbc27a67/action => generated 0 bytes in 490 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:54:51.557577 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-4bdc3c1c-3f46-46f6-8d85-9e4b7c28abd5 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:54:51.558390 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-4bdc3c1c-3f46-46f6-8d85-9e4b7c28abd5 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] [instance: d526ca93-ef52-4c58-a408-9619dbc27a67] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:54:51.566082 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4bdc3c1c-3f46-46f6-8d85-9e4b7c28abd5 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:51.566593 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4bdc3c1c-3f46-46f6-8d85-9e4b7c28abd5 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:51.567118 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4bdc3c1c-3f46-46f6-8d85-9e4b7c28abd5 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:51.568989 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4bdc3c1c-3f46-46f6-8d85-9e4b7c28abd5 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:51.569480 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4bdc3c1c-3f46-46f6-8d85-9e4b7c28abd5 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:51.569937 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4bdc3c1c-3f46-46f6-8d85-9e4b7c28abd5 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:51.744144 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-4bdc3c1c-3f46-46f6-8d85-9e4b7c28abd5 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02916df7dbfa4ba9b40ff2c0d162ce4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6bde0c922b436f8e144b8a6feefebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:54:51.753022 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-4bdc3c1c-3f46-46f6-8d85-9e4b7c28abd5 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] 10.222.0.60 "GET /compute/v2.1/servers/d526ca93-ef52-4c58-a408-9619dbc27a67" status: 200 len: 1757 microversion: 2.1 time: 0.199573 Sep 14 09:54:51.753631 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3364/7302] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:54:51 2022] GET /compute/v2.1/servers/d526ca93-ef52-4c58-a408-9619dbc27a67 => generated 1757 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:54:52.233831 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-feddcdaf-fcea-4ad0-bf01-5bd815a67778 req-c30311e5-ccda-4ba8-add0-1e2317072ecc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d526ca93-ef52-4c58-a408-9619dbc27a67", "tag": "4904b5cc-5c5d-40ae-ae54-48ce200d83cb"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:54:52.244113 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-feddcdaf-fcea-4ad0-bf01-5bd815a67778 req-c30311e5-ccda-4ba8-add0-1e2317072ecc service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:52.244606 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-feddcdaf-fcea-4ad0-bf01-5bd815a67778 req-c30311e5-ccda-4ba8-add0-1e2317072ecc service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:52.245047 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-feddcdaf-fcea-4ad0-bf01-5bd815a67778 req-c30311e5-ccda-4ba8-add0-1e2317072ecc service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:52.256519 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-feddcdaf-fcea-4ad0-bf01-5bd815a67778 req-c30311e5-ccda-4ba8-add0-1e2317072ecc service nova] Creating event network-changed:4904b5cc-5c5d-40ae-ae54-48ce200d83cb for instance d526ca93-ef52-4c58-a408-9619dbc27a67 on n-h2-836830-18 Sep 14 09:54:52.262050 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-feddcdaf-fcea-4ad0-bf01-5bd815a67778 req-c30311e5-ccda-4ba8-add0-1e2317072ecc service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032721 Sep 14 09:54:52.262662 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3939/7303] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:54:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:56:29.818162 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=4 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:56:29.818921 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=8 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:56:29.820257 n-d-836830-18 devstack@n-api.service[128758]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Sep 14 09:56:29.822771 n-d-836830-18 devstack@n-api.service[128758]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Sep 14 09:56:29.829402 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ba0b6236-f127-433d-bd74-98c30391f369 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:56:29.831740 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-ba0b6236-f127-433d-bd74-98c30391f369 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] [instance: d526ca93-ef52-4c58-a408-9619dbc27a67] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:56:29.840459 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ba0b6236-f127-433d-bd74-98c30391f369 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:29.840969 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ba0b6236-f127-433d-bd74-98c30391f369 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:29.841394 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ba0b6236-f127-433d-bd74-98c30391f369 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:29.842086 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ba0b6236-f127-433d-bd74-98c30391f369 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:29.842545 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ba0b6236-f127-433d-bd74-98c30391f369 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:29.843067 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ba0b6236-f127-433d-bd74-98c30391f369 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:29.914686 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-ba0b6236-f127-433d-bd74-98c30391f369 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] 10.222.0.60 "POST /compute/v2.1/servers/d526ca93-ef52-4c58-a408-9619dbc27a67/action" status: 202 len: 0 microversion: 2.1 time: 0.098183 Sep 14 09:56:29.915394 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3365/7304] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:56:29 2022] POST /compute/v2.1/servers/d526ca93-ef52-4c58-a408-9619dbc27a67/action => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 14 09:56:29.922720 n-d-836830-18 devstack@n-api.service[128759]: ERROR oslo.messaging._drivers.impl_rabbit [-] [22ef38d2-af78-43f4-be77-ac372bc70aea] AMQP server on 10.222.0.60:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Sep 14 09:56:29.923833 n-d-836830-18 devstack@n-api.service[128759]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fe2cf8e3-40e5-4586-b96b-b3e5ef0901e5] AMQP server on 10.222.0.60:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Sep 14 09:56:29.924663 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=6 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:56:29.925460 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=12 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:56:29.926759 n-d-836830-18 devstack@n-api.service[128759]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 09:56:29.926915 n-d-836830-18 devstack@n-api.service[128759]: Wed Sep 14 09:56:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d526ca93-ef52-4c58-a408-9619dbc27a67 (ip 10.222.0.60) !!! Sep 14 09:56:29.933797 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b5b37592-db53-431b-9fe8-56eb8fddf9b9 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:56:29.934565 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b5b37592-db53-431b-9fe8-56eb8fddf9b9 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] [instance: d526ca93-ef52-4c58-a408-9619dbc27a67] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:56:29.944887 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b5b37592-db53-431b-9fe8-56eb8fddf9b9 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:29.945405 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b5b37592-db53-431b-9fe8-56eb8fddf9b9 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:29.945851 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b5b37592-db53-431b-9fe8-56eb8fddf9b9 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:29.946572 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b5b37592-db53-431b-9fe8-56eb8fddf9b9 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:29.947039 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b5b37592-db53-431b-9fe8-56eb8fddf9b9 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:29.947468 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b5b37592-db53-431b-9fe8-56eb8fddf9b9 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:30.200986 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b5b37592-db53-431b-9fe8-56eb8fddf9b9 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02916df7dbfa4ba9b40ff2c0d162ce4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6bde0c922b436f8e144b8a6feefebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:56:30.209800 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b5b37592-db53-431b-9fe8-56eb8fddf9b9 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] 10.222.0.60 "GET /compute/v2.1/servers/d526ca93-ef52-4c58-a408-9619dbc27a67" status: 200 len: 1759 microversion: 2.1 time: 0.289244 Sep 14 09:56:30.210367 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3940/7305] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:56:29 2022] GET /compute/v2.1/servers/d526ca93-ef52-4c58-a408-9619dbc27a67 => generated 1759 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:56:31.236148 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-6e6d0735-2c8c-46ff-b31f-15f8cf541353 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:56:31.236768 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-6e6d0735-2c8c-46ff-b31f-15f8cf541353 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] [instance: d526ca93-ef52-4c58-a408-9619dbc27a67] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:56:31.242897 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6e6d0735-2c8c-46ff-b31f-15f8cf541353 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:31.243420 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6e6d0735-2c8c-46ff-b31f-15f8cf541353 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:31.243869 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6e6d0735-2c8c-46ff-b31f-15f8cf541353 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:31.244575 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6e6d0735-2c8c-46ff-b31f-15f8cf541353 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:31.245035 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6e6d0735-2c8c-46ff-b31f-15f8cf541353 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:31.245474 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6e6d0735-2c8c-46ff-b31f-15f8cf541353 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:31.396209 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-6e6d0735-2c8c-46ff-b31f-15f8cf541353 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02916df7dbfa4ba9b40ff2c0d162ce4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6bde0c922b436f8e144b8a6feefebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:56:31.404992 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-6e6d0735-2c8c-46ff-b31f-15f8cf541353 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] 10.222.0.60 "GET /compute/v2.1/servers/d526ca93-ef52-4c58-a408-9619dbc27a67" status: 200 len: 1757 microversion: 2.1 time: 0.174254 Sep 14 09:56:31.405600 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3366/7306] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:56:31 2022] GET /compute/v2.1/servers/d526ca93-ef52-4c58-a408-9619dbc27a67 => generated 1757 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:57:45.104479 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=2 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:57:45.105251 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=6 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:57:45.109451 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-41422994-6d1a-4a26-8928-1a292218a483 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-186631762"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:57:45.110003 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-41422994-6d1a-4a26-8928-1a292218a483 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] [instance: d526ca93-ef52-4c58-a408-9619dbc27a67] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:57:45.125057 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-41422994-6d1a-4a26-8928-1a292218a483 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:45.125560 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-41422994-6d1a-4a26-8928-1a292218a483 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:45.126050 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-41422994-6d1a-4a26-8928-1a292218a483 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:45.126792 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-41422994-6d1a-4a26-8928-1a292218a483 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:45.127291 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-41422994-6d1a-4a26-8928-1a292218a483 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:45.127728 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-41422994-6d1a-4a26-8928-1a292218a483 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:45.131601 n-d-836830-18 devstack@n-api.service[128759]: INFO oslo.messaging._drivers.impl_rabbit [-] [fe2cf8e3-40e5-4586-b96b-b3e5ef0901e5] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 51282. Sep 14 09:57:45.132340 n-d-836830-18 devstack@n-api.service[128759]: INFO oslo.messaging._drivers.impl_rabbit [-] [22ef38d2-af78-43f4-be77-ac372bc70aea] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 51280. Sep 14 09:57:45.263018 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.network.security_group_api [None req-41422994-6d1a-4a26-8928-1a292218a483 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Removing security group d498bf00-2354-40b2-b2f6-a7c212d2488f from port 4904b5cc-5c5d-40ae-ae54-48ce200d83cb Sep 14 09:57:45.566212 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-41422994-6d1a-4a26-8928-1a292218a483 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] 10.222.0.60 "POST /compute/v2.1/servers/d526ca93-ef52-4c58-a408-9619dbc27a67/action" status: 202 len: 0 microversion: 2.1 time: 0.465256 Sep 14 09:57:45.572858 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3941/7307] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:57:45 2022] POST /compute/v2.1/servers/d526ca93-ef52-4c58-a408-9619dbc27a67/action => generated 0 bytes in 467 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:57:45.602471 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-b5df4045-7647-4fc5-9af5-bb6c633b2431 req-c97334ed-3bac-4a52-b71d-f84f622b0bd4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d526ca93-ef52-4c58-a408-9619dbc27a67", "tag": "4904b5cc-5c5d-40ae-ae54-48ce200d83cb"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:57:45.613615 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=4 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:57:45.615152 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:57:45.617428 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-b5df4045-7647-4fc5-9af5-bb6c633b2431 req-c97334ed-3bac-4a52-b71d-f84f622b0bd4 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:45.618237 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-b5df4045-7647-4fc5-9af5-bb6c633b2431 req-c97334ed-3bac-4a52-b71d-f84f622b0bd4 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:45.618921 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-b5df4045-7647-4fc5-9af5-bb6c633b2431 req-c97334ed-3bac-4a52-b71d-f84f622b0bd4 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:45.635638 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-b5df4045-7647-4fc5-9af5-bb6c633b2431 req-c97334ed-3bac-4a52-b71d-f84f622b0bd4 service nova] Creating event network-changed:4904b5cc-5c5d-40ae-ae54-48ce200d83cb for instance d526ca93-ef52-4c58-a408-9619dbc27a67 on n-h2-836830-18 Sep 14 09:57:45.647212 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-b5df4045-7647-4fc5-9af5-bb6c633b2431 req-c97334ed-3bac-4a52-b71d-f84f622b0bd4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047630 Sep 14 09:57:45.648386 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3367/7308] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:57:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:57:46.774605 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-935e0358-7d8b-4835-8589-2f1f0943827b tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:57:46.775181 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-935e0358-7d8b-4835-8589-2f1f0943827b tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] [instance: d526ca93-ef52-4c58-a408-9619dbc27a67] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:57:46.781214 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-935e0358-7d8b-4835-8589-2f1f0943827b tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:46.781700 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-935e0358-7d8b-4835-8589-2f1f0943827b tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:46.782139 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-935e0358-7d8b-4835-8589-2f1f0943827b tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:46.782838 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-935e0358-7d8b-4835-8589-2f1f0943827b tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:46.783321 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-935e0358-7d8b-4835-8589-2f1f0943827b tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:46.783743 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-935e0358-7d8b-4835-8589-2f1f0943827b tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:46.867326 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.objects.instance [None req-935e0358-7d8b-4835-8589-2f1f0943827b tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lazy-loading 'services' on Instance uuid d526ca93-ef52-4c58-a408-9619dbc27a67 {{(pid=128759) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:57:46.938972 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-935e0358-7d8b-4835-8589-2f1f0943827b tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] 10.222.0.60 "DELETE /compute/v2.1/servers/d526ca93-ef52-4c58-a408-9619dbc27a67/os-volume_attachments/57dffdbf-d8b0-40c7-ba06-43a191f2d635" status: 202 len: 0 microversion: 2.1 time: 0.168883 Sep 14 09:57:46.950374 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-e1afcbdc-9fe6-433f-b478-4208ca938f27 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:57:46.952775 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-e1afcbdc-9fe6-433f-b478-4208ca938f27 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] [instance: d526ca93-ef52-4c58-a408-9619dbc27a67] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:57:46.953047 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3942/7309] 10.222.0.60 () {58 vars in 1416 bytes} [Wed Sep 14 09:57:46 2022] DELETE /compute/v2.1/servers/d526ca93-ef52-4c58-a408-9619dbc27a67/os-volume_attachments/57dffdbf-d8b0-40c7-ba06-43a191f2d635 => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:57:46.960073 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e1afcbdc-9fe6-433f-b478-4208ca938f27 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:46.960920 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e1afcbdc-9fe6-433f-b478-4208ca938f27 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:46.961477 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e1afcbdc-9fe6-433f-b478-4208ca938f27 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:46.962341 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e1afcbdc-9fe6-433f-b478-4208ca938f27 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:46.962820 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e1afcbdc-9fe6-433f-b478-4208ca938f27 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:46.963291 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e1afcbdc-9fe6-433f-b478-4208ca938f27 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:46.995871 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-e1afcbdc-9fe6-433f-b478-4208ca938f27 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] 10.222.0.60 "GET /compute/v2.1/servers/d526ca93-ef52-4c58-a408-9619dbc27a67/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051046 Sep 14 09:57:46.996622 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3368/7310] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 14 09:57:46 2022] GET /compute/v2.1/servers/d526ca93-ef52-4c58-a408-9619dbc27a67/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:57:47.678301 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-410bbfd8-cbcb-4151-8179-1dea15c375c6 req-b11d50f0-358e-4134-948d-9255f49c67bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d526ca93-ef52-4c58-a408-9619dbc27a67", "tag": "4904b5cc-5c5d-40ae-ae54-48ce200d83cb"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:57:47.701033 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-410bbfd8-cbcb-4151-8179-1dea15c375c6 req-b11d50f0-358e-4134-948d-9255f49c67bd service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:47.701526 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-410bbfd8-cbcb-4151-8179-1dea15c375c6 req-b11d50f0-358e-4134-948d-9255f49c67bd service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:47.701964 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-410bbfd8-cbcb-4151-8179-1dea15c375c6 req-b11d50f0-358e-4134-948d-9255f49c67bd service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:47.713496 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-410bbfd8-cbcb-4151-8179-1dea15c375c6 req-b11d50f0-358e-4134-948d-9255f49c67bd service nova] Creating event network-changed:4904b5cc-5c5d-40ae-ae54-48ce200d83cb for instance d526ca93-ef52-4c58-a408-9619dbc27a67 on n-h2-836830-18 Sep 14 09:57:47.718379 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-410bbfd8-cbcb-4151-8179-1dea15c375c6 req-b11d50f0-358e-4134-948d-9255f49c67bd service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044164 Sep 14 09:57:47.719150 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3943/7311] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:57:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:57:48.008967 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-0adbc169-7c0d-4fec-9d61-ff719d1b4a21 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:57:48.012206 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-0adbc169-7c0d-4fec-9d61-ff719d1b4a21 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] [instance: d526ca93-ef52-4c58-a408-9619dbc27a67] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:57:48.018738 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0adbc169-7c0d-4fec-9d61-ff719d1b4a21 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:48.021138 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0adbc169-7c0d-4fec-9d61-ff719d1b4a21 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:48.021788 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0adbc169-7c0d-4fec-9d61-ff719d1b4a21 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:48.022531 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0adbc169-7c0d-4fec-9d61-ff719d1b4a21 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:48.023042 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0adbc169-7c0d-4fec-9d61-ff719d1b4a21 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:48.023745 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0adbc169-7c0d-4fec-9d61-ff719d1b4a21 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:48.055811 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-0adbc169-7c0d-4fec-9d61-ff719d1b4a21 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] 10.222.0.60 "GET /compute/v2.1/servers/d526ca93-ef52-4c58-a408-9619dbc27a67/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050868 Sep 14 09:57:48.057266 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3369/7312] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 14 09:57:48 2022] GET /compute/v2.1/servers/d526ca93-ef52-4c58-a408-9619dbc27a67/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:57:49.070218 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8c9298a2-2b92-49af-ba01-4b14e1f458e3 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:57:49.073040 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-8c9298a2-2b92-49af-ba01-4b14e1f458e3 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] [instance: d526ca93-ef52-4c58-a408-9619dbc27a67] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:57:49.079344 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8c9298a2-2b92-49af-ba01-4b14e1f458e3 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:49.079841 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8c9298a2-2b92-49af-ba01-4b14e1f458e3 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:49.080287 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8c9298a2-2b92-49af-ba01-4b14e1f458e3 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:49.080997 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8c9298a2-2b92-49af-ba01-4b14e1f458e3 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:49.081461 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8c9298a2-2b92-49af-ba01-4b14e1f458e3 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:49.081895 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8c9298a2-2b92-49af-ba01-4b14e1f458e3 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:49.114760 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-8c9298a2-2b92-49af-ba01-4b14e1f458e3 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] 10.222.0.60 "GET /compute/v2.1/servers/d526ca93-ef52-4c58-a408-9619dbc27a67/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049737 Sep 14 09:57:49.115376 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3944/7313] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 14 09:57:49 2022] GET /compute/v2.1/servers/d526ca93-ef52-4c58-a408-9619dbc27a67/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:57:50.127520 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-8d3c05af-e073-4b69-8230-15f4dd8dca7f tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:57:50.129731 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-8d3c05af-e073-4b69-8230-15f4dd8dca7f tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] [instance: d526ca93-ef52-4c58-a408-9619dbc27a67] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:57:50.137237 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8d3c05af-e073-4b69-8230-15f4dd8dca7f tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:50.137733 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8d3c05af-e073-4b69-8230-15f4dd8dca7f tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:50.138182 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8d3c05af-e073-4b69-8230-15f4dd8dca7f tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:50.138887 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8d3c05af-e073-4b69-8230-15f4dd8dca7f tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:50.139382 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8d3c05af-e073-4b69-8230-15f4dd8dca7f tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:50.139817 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8d3c05af-e073-4b69-8230-15f4dd8dca7f tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:50.169079 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-8d3c05af-e073-4b69-8230-15f4dd8dca7f tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] 10.222.0.60 "GET /compute/v2.1/servers/d526ca93-ef52-4c58-a408-9619dbc27a67/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045651 Sep 14 09:57:50.169644 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3370/7314] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 14 09:57:50 2022] GET /compute/v2.1/servers/d526ca93-ef52-4c58-a408-9619dbc27a67/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:57:51.181799 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-48a67337-cee4-4b63-bc2a-838dfb6bb47f tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:57:51.184163 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-48a67337-cee4-4b63-bc2a-838dfb6bb47f tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] [instance: d526ca93-ef52-4c58-a408-9619dbc27a67] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:57:51.191190 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-48a67337-cee4-4b63-bc2a-838dfb6bb47f tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:51.191680 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-48a67337-cee4-4b63-bc2a-838dfb6bb47f tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:51.192118 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-48a67337-cee4-4b63-bc2a-838dfb6bb47f tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:51.192815 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-48a67337-cee4-4b63-bc2a-838dfb6bb47f tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:51.193275 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-48a67337-cee4-4b63-bc2a-838dfb6bb47f tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:51.193721 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-48a67337-cee4-4b63-bc2a-838dfb6bb47f tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:51.224489 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-48a67337-cee4-4b63-bc2a-838dfb6bb47f tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] 10.222.0.60 "GET /compute/v2.1/servers/d526ca93-ef52-4c58-a408-9619dbc27a67/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046639 Sep 14 09:57:51.225394 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3945/7315] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 14 09:57:51 2022] GET /compute/v2.1/servers/d526ca93-ef52-4c58-a408-9619dbc27a67/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:57:52.237526 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b406196b-f332-4f13-9b26-b27d2b0fc758 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:57:52.239791 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-b406196b-f332-4f13-9b26-b27d2b0fc758 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] [instance: d526ca93-ef52-4c58-a408-9619dbc27a67] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:57:52.246278 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b406196b-f332-4f13-9b26-b27d2b0fc758 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:52.246781 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b406196b-f332-4f13-9b26-b27d2b0fc758 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:52.247260 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b406196b-f332-4f13-9b26-b27d2b0fc758 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:52.247968 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b406196b-f332-4f13-9b26-b27d2b0fc758 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:52.248439 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b406196b-f332-4f13-9b26-b27d2b0fc758 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:52.248882 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b406196b-f332-4f13-9b26-b27d2b0fc758 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:52.277365 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-b406196b-f332-4f13-9b26-b27d2b0fc758 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] 10.222.0.60 "GET /compute/v2.1/servers/d526ca93-ef52-4c58-a408-9619dbc27a67/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044271 Sep 14 09:57:52.277939 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3371/7316] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 14 09:57:52 2022] GET /compute/v2.1/servers/d526ca93-ef52-4c58-a408-9619dbc27a67/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 09:57:52.288614 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-7792ab0d-d7c4-4cb3-af4c-738932cbf276 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:57:52.289103 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-7792ab0d-d7c4-4cb3-af4c-738932cbf276 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] [instance: d526ca93-ef52-4c58-a408-9619dbc27a67] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:57:52.295684 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7792ab0d-d7c4-4cb3-af4c-738932cbf276 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:52.296165 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7792ab0d-d7c4-4cb3-af4c-738932cbf276 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:52.296600 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7792ab0d-d7c4-4cb3-af4c-738932cbf276 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:52.297282 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7792ab0d-d7c4-4cb3-af4c-738932cbf276 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:52.297734 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7792ab0d-d7c4-4cb3-af4c-738932cbf276 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:52.298152 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7792ab0d-d7c4-4cb3-af4c-738932cbf276 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:52.374395 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-7792ab0d-d7c4-4cb3-af4c-738932cbf276 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] HTTP exception thrown: Instance d526ca93-ef52-4c58-a408-9619dbc27a67 is not attached to volume 57dffdbf-d8b0-40c7-ba06-43a191f2d635 Sep 14 09:57:52.376296 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-7792ab0d-d7c4-4cb3-af4c-738932cbf276 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Request method failure captured: Sep 14 09:57:52.376296 n-d-836830-18 devstack@n-api.service[128759]: request: DELETE /compute/v2.1/servers/d526ca93-ef52-4c58-a408-9619dbc27a67/os-volume_attachments/57dffdbf-d8b0-40c7-ba06-43a191f2d635 HTTP/1.1 Sep 14 09:57:52.376296 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:57:52.376296 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:57:52.376296 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:57:52.376296 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:57:52.376296 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:57:52.376296 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:57:52.376296 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:57:52.376296 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:57:52.376296 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIaS5TyfTtg0yHewiyDcnS6v8_MAYI33o2Mi_UNVwZ9OWFRX3Ngx8QY_wcOpgD2X3MSnI2n0CJTtylxnWXwR24mmOLc4S1x4KV39Bu_q3EUVMIwhwISESH4t9iKGNZvNFAcTNA1h3aFh04-8aGYbeTj_aPqf2lC7ho8nuQhoA9WXTdPk Sep 14 09:57:52.376296 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:57:52.376296 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:57:52.376296 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:57:52.376296 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:57:52.376296 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:57:52.376296 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:57:52.376296 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: dd6bde0c922b436f8e144b8a6feefebe Sep 14 09:57:52.376296 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-TestMinimumBasicScenario-880850400 Sep 14 09:57:52.376296 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:57:52.376296 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:57:52.376296 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/dd6bde0c922b436f8e144b8a6feefebe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_dd6bde0c922b436f8e144b8a6feefebe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/dd6bde0c922b436f8e144b8a6feefebe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/dd6bde0c922b436f8e144b8a6feefebe"}]}] Sep 14 09:57:52.376296 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-TestMinimumBasicScenario-880850400 Sep 14 09:57:52.376296 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: dd6bde0c922b436f8e144b8a6feefebe Sep 14 09:57:52.376296 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-TestMinimumBasicScenario-880850400 Sep 14 09:57:52.376296 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-TestMinimumBasicScenario-880850400-project Sep 14 09:57:52.376296 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:57:52.376296 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:57:52.376296 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 02916df7dbfa4ba9b40ff2c0d162ce4f Sep 14 09:57:52.376296 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-TestMinimumBasicScenario-880850400-project Sep 14 09:57:52.376296 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:57:52.376296 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance d526ca93-ef52-4c58-a408-9619dbc27a67 is not attached to volume 57dffdbf-d8b0-40c7-ba06-43a191f2d635 Sep 14 09:57:52.376296 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'server_id': 'd526ca93-ef52-4c58-a408-9619dbc27a67', 'id': '57dffdbf-d8b0-40c7-ba06-43a191f2d635'} Sep 14 09:57:52.376296 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:57:52.376296 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:57:52.376296 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 14 09:57:52.376296 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 14 09:57:52.376296 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 14 09:57:52.376296 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 14 09:57:52.376296 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 14 09:57:52.376296 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 14 09:57:52.376296 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 57dffdbf-d8b0-40c7-ba06-43a191f2d635. Sep 14 09:57:52.376296 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:57:52.376296 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:57:52.376296 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:57:52.376296 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:57:52.376296 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:57:52.376296 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:57:52.376296 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:57:52.376296 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:57:52.376296 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:57:52.376296 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:57:52.376296 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 14 09:57:52.376296 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 14 09:57:52.376296 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d526ca93-ef52-4c58-a408-9619dbc27a67 is not attached to volume 57dffdbf-d8b0-40c7-ba06-43a191f2d635 Sep 14 09:57:52.376296 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:57:52.376296 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:57:52.376296 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:57:52.376296 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:57:52.376296 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:57:52.376296 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:57:52.380550 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:57:52.380550 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:57:52.380550 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d526ca93-ef52-4c58-a408-9619dbc27a67 is not attached to volume 57dffdbf-d8b0-40c7-ba06-43a191f2d635 Sep 14 09:57:52.380550 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:57:52.380550 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-7792ab0d-d7c4-4cb3-af4c-738932cbf276 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Returning 404 to user: Instance d526ca93-ef52-4c58-a408-9619dbc27a67 is not attached to volume 57dffdbf-d8b0-40c7-ba06-43a191f2d635 {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:57:52.380550 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-7792ab0d-d7c4-4cb3-af4c-738932cbf276 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] 10.222.0.60 "DELETE /compute/v2.1/servers/d526ca93-ef52-4c58-a408-9619dbc27a67/os-volume_attachments/57dffdbf-d8b0-40c7-ba06-43a191f2d635" status: 404 len: 154 microversion: 2.1 time: 0.093271 Sep 14 09:57:52.380550 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3946/7317] 10.222.0.60 () {58 vars in 1416 bytes} [Wed Sep 14 09:57:52 2022] DELETE /compute/v2.1/servers/d526ca93-ef52-4c58-a408-9619dbc27a67/os-volume_attachments/57dffdbf-d8b0-40c7-ba06-43a191f2d635 => generated 154 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:57:55.637242 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a069bdb8-fd17-4a2e-a4a4-21ad5cc252df tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:57:55.637811 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-a069bdb8-fd17-4a2e-a4a4-21ad5cc252df tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] [instance: d526ca93-ef52-4c58-a408-9619dbc27a67] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:57:55.645002 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a069bdb8-fd17-4a2e-a4a4-21ad5cc252df tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:55.645505 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a069bdb8-fd17-4a2e-a4a4-21ad5cc252df tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:55.645957 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a069bdb8-fd17-4a2e-a4a4-21ad5cc252df tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:55.646676 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a069bdb8-fd17-4a2e-a4a4-21ad5cc252df tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:55.647176 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a069bdb8-fd17-4a2e-a4a4-21ad5cc252df tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:55.647619 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a069bdb8-fd17-4a2e-a4a4-21ad5cc252df tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:55.675276 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-a069bdb8-fd17-4a2e-a4a4-21ad5cc252df tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] [instance: d526ca93-ef52-4c58-a408-9619dbc27a67] Going to try to terminate instance {{(pid=128758) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:57:55.753808 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-a069bdb8-fd17-4a2e-a4a4-21ad5cc252df tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] 10.222.0.60 "DELETE /compute/v2.1/servers/d526ca93-ef52-4c58-a408-9619dbc27a67" status: 204 len: 0 microversion: 2.1 time: 0.119690 Sep 14 09:57:55.754737 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3372/7318] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:57:55 2022] DELETE /compute/v2.1/servers/d526ca93-ef52-4c58-a408-9619dbc27a67 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:57:55.763368 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-0090395a-8d01-426b-87b0-eaf5180a4a18 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:57:55.763994 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-0090395a-8d01-426b-87b0-eaf5180a4a18 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] [instance: d526ca93-ef52-4c58-a408-9619dbc27a67] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:57:55.771123 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0090395a-8d01-426b-87b0-eaf5180a4a18 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:55.771823 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0090395a-8d01-426b-87b0-eaf5180a4a18 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:55.772269 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0090395a-8d01-426b-87b0-eaf5180a4a18 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:55.772969 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0090395a-8d01-426b-87b0-eaf5180a4a18 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:55.773431 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0090395a-8d01-426b-87b0-eaf5180a4a18 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:55.773860 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0090395a-8d01-426b-87b0-eaf5180a4a18 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:55.907113 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-0090395a-8d01-426b-87b0-eaf5180a4a18 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02916df7dbfa4ba9b40ff2c0d162ce4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6bde0c922b436f8e144b8a6feefebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:57:55.915096 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-0090395a-8d01-426b-87b0-eaf5180a4a18 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] 10.222.0.60 "GET /compute/v2.1/servers/d526ca93-ef52-4c58-a408-9619dbc27a67" status: 200 len: 1553 microversion: 2.1 time: 0.156037 Sep 14 09:57:55.916115 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3947/7319] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:57:55 2022] GET /compute/v2.1/servers/d526ca93-ef52-4c58-a408-9619dbc27a67 => generated 1553 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:57:56.940018 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-01827402-1526-4ec4-b7b6-820aa39fe23e tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:57:56.940752 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-01827402-1526-4ec4-b7b6-820aa39fe23e tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] [instance: d526ca93-ef52-4c58-a408-9619dbc27a67] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:57:56.951311 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-01827402-1526-4ec4-b7b6-820aa39fe23e tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:56.951820 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-01827402-1526-4ec4-b7b6-820aa39fe23e tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:56.952273 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-01827402-1526-4ec4-b7b6-820aa39fe23e tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:56.952986 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-01827402-1526-4ec4-b7b6-820aa39fe23e tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:56.953455 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-01827402-1526-4ec4-b7b6-820aa39fe23e tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:56.953898 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-01827402-1526-4ec4-b7b6-820aa39fe23e tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:57.152679 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-01827402-1526-4ec4-b7b6-820aa39fe23e tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02916df7dbfa4ba9b40ff2c0d162ce4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6bde0c922b436f8e144b8a6feefebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:57:57.160634 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-01827402-1526-4ec4-b7b6-820aa39fe23e tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] 10.222.0.60 "GET /compute/v2.1/servers/d526ca93-ef52-4c58-a408-9619dbc27a67" status: 200 len: 1553 microversion: 2.1 time: 0.224906 Sep 14 09:57:57.161217 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3373/7320] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:57:56 2022] GET /compute/v2.1/servers/d526ca93-ef52-4c58-a408-9619dbc27a67 => generated 1553 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:57:57.893797 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-eceb1a99-f770-4b1a-856e-3959437a0a01 req-63543346-fab3-44e6-adb7-949241c1f350 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d526ca93-ef52-4c58-a408-9619dbc27a67", "name": "network-vif-deleted", "tag": "4904b5cc-5c5d-40ae-ae54-48ce200d83cb"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:57:57.903486 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-eceb1a99-f770-4b1a-856e-3959437a0a01 req-63543346-fab3-44e6-adb7-949241c1f350 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:57.904004 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-eceb1a99-f770-4b1a-856e-3959437a0a01 req-63543346-fab3-44e6-adb7-949241c1f350 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:57.904426 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-eceb1a99-f770-4b1a-856e-3959437a0a01 req-63543346-fab3-44e6-adb7-949241c1f350 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:57.916320 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-eceb1a99-f770-4b1a-856e-3959437a0a01 req-63543346-fab3-44e6-adb7-949241c1f350 service nova] Creating event network-vif-deleted:4904b5cc-5c5d-40ae-ae54-48ce200d83cb for instance d526ca93-ef52-4c58-a408-9619dbc27a67 on n-h2-836830-18 Sep 14 09:57:57.921367 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-eceb1a99-f770-4b1a-856e-3959437a0a01 req-63543346-fab3-44e6-adb7-949241c1f350 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114668 Sep 14 09:57:57.921996 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3948/7321] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:57:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:57:58.184697 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-cd133fd4-b6ff-4baa-941f-8e8671b22f05 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:57:58.185340 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-cd133fd4-b6ff-4baa-941f-8e8671b22f05 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] [instance: d526ca93-ef52-4c58-a408-9619dbc27a67] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:57:58.192731 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cd133fd4-b6ff-4baa-941f-8e8671b22f05 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:58.193247 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cd133fd4-b6ff-4baa-941f-8e8671b22f05 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:58.193891 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cd133fd4-b6ff-4baa-941f-8e8671b22f05 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:58.194801 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cd133fd4-b6ff-4baa-941f-8e8671b22f05 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:58.195472 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cd133fd4-b6ff-4baa-941f-8e8671b22f05 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:58.196157 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cd133fd4-b6ff-4baa-941f-8e8671b22f05 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:58.230751 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cd133fd4-b6ff-4baa-941f-8e8671b22f05 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:58.231362 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cd133fd4-b6ff-4baa-941f-8e8671b22f05 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:58.231874 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-cd133fd4-b6ff-4baa-941f-8e8671b22f05 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:58.232319 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.objects.instance [None req-cd133fd4-b6ff-4baa-941f-8e8671b22f05 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lazy-loading 'fault' on Instance uuid d526ca93-ef52-4c58-a408-9619dbc27a67 {{(pid=128758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:57:58.278228 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-cd133fd4-b6ff-4baa-941f-8e8671b22f05 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02916df7dbfa4ba9b40ff2c0d162ce4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6bde0c922b436f8e144b8a6feefebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:57:58.286092 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-cd133fd4-b6ff-4baa-941f-8e8671b22f05 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] 10.222.0.60 "GET /compute/v2.1/servers/d526ca93-ef52-4c58-a408-9619dbc27a67" status: 200 len: 1347 microversion: 2.1 time: 0.105357 Sep 14 09:57:58.286665 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3374/7322] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:57:58 2022] GET /compute/v2.1/servers/d526ca93-ef52-4c58-a408-9619dbc27a67 => generated 1347 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:57:59.311046 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-47c5e6d2-f8bf-4b52-a989-5c5dfca0552e tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:57:59.311766 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-47c5e6d2-f8bf-4b52-a989-5c5dfca0552e tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] [instance: d526ca93-ef52-4c58-a408-9619dbc27a67] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:57:59.317950 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-47c5e6d2-f8bf-4b52-a989-5c5dfca0552e tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:59.318435 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-47c5e6d2-f8bf-4b52-a989-5c5dfca0552e tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:59.318873 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-47c5e6d2-f8bf-4b52-a989-5c5dfca0552e tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:59.319589 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-47c5e6d2-f8bf-4b52-a989-5c5dfca0552e tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:59.320048 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-47c5e6d2-f8bf-4b52-a989-5c5dfca0552e tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:59.320478 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-47c5e6d2-f8bf-4b52-a989-5c5dfca0552e tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:59.333813 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-47c5e6d2-f8bf-4b52-a989-5c5dfca0552e tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] HTTP exception thrown: Instance d526ca93-ef52-4c58-a408-9619dbc27a67 could not be found. Sep 14 09:57:59.335481 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-47c5e6d2-f8bf-4b52-a989-5c5dfca0552e tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Request method failure captured: Sep 14 09:57:59.335481 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/d526ca93-ef52-4c58-a408-9619dbc27a67 HTTP/1.1 Sep 14 09:57:59.335481 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 09:57:59.335481 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 09:57:59.335481 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 09:57:59.335481 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 09:57:59.335481 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 09:57:59.335481 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 09:57:59.335481 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 09:57:59.335481 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 09:57:59.335481 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIaS5TyfTtg0yHewiyDcnS6v8_MAYI33o2Mi_UNVwZ9OWFRX3Ngx8QY_wcOpgD2X3MSnI2n0CJTtylxnWXwR24mmOLc4S1x4KV39Bu_q3EUVMIwhwISESH4t9iKGNZvNFAcTNA1h3aFh04-8aGYbeTj_aPqf2lC7ho8nuQhoA9WXTdPk Sep 14 09:57:59.335481 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 09:57:59.335481 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 09:57:59.335481 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 09:57:59.335481 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 09:57:59.335481 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 09:57:59.335481 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 09:57:59.335481 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: dd6bde0c922b436f8e144b8a6feefebe Sep 14 09:57:59.335481 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-TestMinimumBasicScenario-880850400 Sep 14 09:57:59.335481 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 09:57:59.335481 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 09:57:59.335481 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/dd6bde0c922b436f8e144b8a6feefebe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_dd6bde0c922b436f8e144b8a6feefebe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/dd6bde0c922b436f8e144b8a6feefebe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/dd6bde0c922b436f8e144b8a6feefebe"}]}] Sep 14 09:57:59.335481 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-TestMinimumBasicScenario-880850400 Sep 14 09:57:59.335481 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: dd6bde0c922b436f8e144b8a6feefebe Sep 14 09:57:59.335481 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-TestMinimumBasicScenario-880850400 Sep 14 09:57:59.335481 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-TestMinimumBasicScenario-880850400-project Sep 14 09:57:59.335481 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 09:57:59.335481 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 09:57:59.335481 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 02916df7dbfa4ba9b40ff2c0d162ce4f Sep 14 09:57:59.335481 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-TestMinimumBasicScenario-880850400-project Sep 14 09:57:59.335481 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 09:57:59.335481 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance d526ca93-ef52-4c58-a408-9619dbc27a67 could not be found. Sep 14 09:57:59.335481 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': 'd526ca93-ef52-4c58-a408-9619dbc27a67'} Sep 14 09:57:59.335481 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:57:59.335481 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:57:59.335481 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:57:59.335481 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:57:59.335481 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:57:59.335481 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:57:59.335481 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:57:59.335481 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:57:59.335481 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:57:59.335481 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:57:59.335481 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d526ca93-ef52-4c58-a408-9619dbc27a67 could not be found. Sep 14 09:57:59.335481 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:57:59.335481 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:57:59.335481 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:57:59.335481 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:57:59.335481 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:57:59.335481 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:57:59.335481 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:57:59.335481 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:57:59.335481 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:57:59.335481 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:57:59.335481 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:57:59.335481 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:57:59.335481 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:57:59.335481 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:57:59.335481 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:57:59.335481 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:57:59.335481 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d526ca93-ef52-4c58-a408-9619dbc27a67 could not be found. Sep 14 09:57:59.335481 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:57:59.335481 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:57:59.335481 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:57:59.341118 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:57:59.341118 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:57:59.341118 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:57:59.341118 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:57:59.341118 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:57:59.341118 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d526ca93-ef52-4c58-a408-9619dbc27a67 could not be found. Sep 14 09:57:59.341118 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 09:57:59.341118 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-47c5e6d2-f8bf-4b52-a989-5c5dfca0552e tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Returning 404 to user: Instance d526ca93-ef52-4c58-a408-9619dbc27a67 could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:57:59.341118 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-47c5e6d2-f8bf-4b52-a989-5c5dfca0552e tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] 10.222.0.60 "GET /compute/v2.1/servers/d526ca93-ef52-4c58-a408-9619dbc27a67" status: 404 len: 111 microversion: 2.1 time: 0.031127 Sep 14 09:57:59.341118 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3949/7323] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:57:59 2022] GET /compute/v2.1/servers/d526ca93-ef52-4c58-a408-9619dbc27a67 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:57:59.346093 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b3d0af3f-3ef3-4ff3-9681-ec6e71c32467 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Calling method '.version_select at 0x7f7d3f3980d0>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:57:59.370890 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-b3d0af3f-3ef3-4ff3-9681-ec6e71c32467 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-727819476" status: 202 len: 0 microversion: 2.1 time: 0.028550 Sep 14 09:57:59.371556 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3375/7324] 10.222.0.60 () {58 vars in 1269 bytes} [Wed Sep 14 09:57:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-727819476 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:58:08.414791 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-58840422-f27a-4b71-bd8f-6944727e239b tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Action: 'create', calling method: .version_select at 0x7f7d3f6014c0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1523601232", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOefpujOVROlvmibxGv98bpqgFmXWpOVE45MX2iSAsvClPubZXhVxS93sVTLnWJ0mmoNbzv/wPJ07jaGYNpEXcpJzex3/D3uqpjgUFBOpV/BQAfA05PahdrazsD2O/C6vg=="}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:58:08.432545 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-58840422-f27a-4b71-bd8f-6944727e239b tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Getting quotas for project dd6bde0c922b436f8e144b8a6feefebe. Resources: {'key_pairs'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:58:08.437674 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-58840422-f27a-4b71-bd8f-6944727e239b tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Getting quotas for user 02916df7dbfa4ba9b40ff2c0d162ce4f and project dd6bde0c922b436f8e144b8a6feefebe. Resources: {'key_pairs'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:58:08.452021 n-d-836830-18 devstack@n-api.service[128759]: ERROR oslo.messaging._drivers.impl_rabbit [None req-58840422-f27a-4b71-bd8f-6944727e239b tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] [48ddcf4f-b5ef-443d-80c4-a7292cbf1807] AMQP server on 10.222.0.60:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 14 09:58:09.325460 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=43,nova_cell1:INSERT=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:58:09.459697 n-d-836830-18 devstack@n-api.service[128759]: INFO oslo.messaging._drivers.impl_rabbit [None req-58840422-f27a-4b71-bd8f-6944727e239b tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] [48ddcf4f-b5ef-443d-80c4-a7292cbf1807] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 51440. Sep 14 09:58:09.475940 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-58840422-f27a-4b71-bd8f-6944727e239b tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 1.065202 Sep 14 09:58:09.476556 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3950/7325] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Sep 14 09:58:08 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:58:09.527385 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:58:09.528180 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:58:09.533365 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-4a4694e5-c4da-49dc-bba6-1cb7ce1276c5 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-373656740", "imageRef": "dd2d26cf-558a-4600-9335-2a7941275bb1", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1523601232", "networks": [{"uuid": "c685e3a8-9682-4c73-8dbb-3fc082f807fb"}]}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:58:09.588877 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.network.neutron [None req-4a4694e5-c4da-49dc-bba6-1cb7ce1276c5 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] validate_networks() for [('c685e3a8-9682-4c73-8dbb-3fc082f807fb', None, None, None, None, None)] {{(pid=128758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:58:09.960342 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-4a4694e5-c4da-49dc-bba6-1cb7ce1276c5 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Flavor limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:58:09.960789 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-4a4694e5-c4da-49dc-bba6-1cb7ce1276c5 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Image limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:58:09.961353 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-4a4694e5-c4da-49dc-bba6-1cb7ce1276c5 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Flavor pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:58:09.961792 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-4a4694e5-c4da-49dc-bba6-1cb7ce1276c5 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Image pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:58:09.963057 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-4a4694e5-c4da-49dc-bba6-1cb7ce1276c5 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:58:09.972391 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4a4694e5-c4da-49dc-bba6-1cb7ce1276c5 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:09.972999 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4a4694e5-c4da-49dc-bba6-1cb7ce1276c5 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:09.973453 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4a4694e5-c4da-49dc-bba6-1cb7ce1276c5 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:09.974202 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4a4694e5-c4da-49dc-bba6-1cb7ce1276c5 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:09.974678 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4a4694e5-c4da-49dc-bba6-1cb7ce1276c5 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:09.975150 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4a4694e5-c4da-49dc-bba6-1cb7ce1276c5 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:09.992798 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-4a4694e5-c4da-49dc-bba6-1cb7ce1276c5 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Getting quotas for project dd6bde0c922b436f8e144b8a6feefebe. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:58:09.998083 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-4a4694e5-c4da-49dc-bba6-1cb7ce1276c5 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Getting quotas for user 02916df7dbfa4ba9b40ff2c0d162ce4f and project dd6bde0c922b436f8e144b8a6feefebe. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:58:10.010890 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-4a4694e5-c4da-49dc-bba6-1cb7ce1276c5 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Going to run 1 instances... {{(pid=128758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:58:10.013161 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-4a4694e5-c4da-49dc-bba6-1cb7ce1276c5 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] [instance: 5851ba25-8bf7-4e7e-8609-f164a529e8ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='dd2d26cf-558a-4600-9335-2a7941275bb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:58:10.058617 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-4a4694e5-c4da-49dc-bba6-1cb7ce1276c5 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.532960 Sep 14 09:58:10.059484 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3376/7326] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 09:58:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 535 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:58:10.070929 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ea7e42a8-3e18-4411-b3c8-bcd6551c07f9 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:58:10.072285 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-ea7e42a8-3e18-4411-b3c8-bcd6551c07f9 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] [instance: 5851ba25-8bf7-4e7e-8609-f164a529e8ca] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:58:10.126847 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-ea7e42a8-3e18-4411-b3c8-bcd6551c07f9 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02916df7dbfa4ba9b40ff2c0d162ce4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6bde0c922b436f8e144b8a6feefebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:58:10.134977 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-ea7e42a8-3e18-4411-b3c8-bcd6551c07f9 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] 10.222.0.60 "GET /compute/v2.1/servers/5851ba25-8bf7-4e7e-8609-f164a529e8ca" status: 200 len: 1258 microversion: 2.1 time: 0.068157 Sep 14 09:58:10.135574 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3951/7327] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:58:10 2022] GET /compute/v2.1/servers/5851ba25-8bf7-4e7e-8609-f164a529e8ca => generated 1258 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:58:11.158743 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-76e671f6-770a-46c4-b8ac-6fcfe92f3f7c tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:58:11.159545 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-76e671f6-770a-46c4-b8ac-6fcfe92f3f7c tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] [instance: 5851ba25-8bf7-4e7e-8609-f164a529e8ca] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:58:11.216676 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-76e671f6-770a-46c4-b8ac-6fcfe92f3f7c tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02916df7dbfa4ba9b40ff2c0d162ce4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6bde0c922b436f8e144b8a6feefebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:58:11.224175 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-76e671f6-770a-46c4-b8ac-6fcfe92f3f7c tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] 10.222.0.60 "GET /compute/v2.1/servers/5851ba25-8bf7-4e7e-8609-f164a529e8ca" status: 200 len: 1258 microversion: 2.1 time: 0.070194 Sep 14 09:58:11.224753 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3377/7328] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:58:11 2022] GET /compute/v2.1/servers/5851ba25-8bf7-4e7e-8609-f164a529e8ca => generated 1258 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:58:12.248900 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-2c16fdf3-cf75-40b4-bcf3-942ed11be667 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:58:12.249527 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-2c16fdf3-cf75-40b4-bcf3-942ed11be667 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] [instance: 5851ba25-8bf7-4e7e-8609-f164a529e8ca] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:58:12.307136 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-2c16fdf3-cf75-40b4-bcf3-942ed11be667 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02916df7dbfa4ba9b40ff2c0d162ce4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6bde0c922b436f8e144b8a6feefebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:58:12.314109 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-2c16fdf3-cf75-40b4-bcf3-942ed11be667 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] 10.222.0.60 "GET /compute/v2.1/servers/5851ba25-8bf7-4e7e-8609-f164a529e8ca" status: 200 len: 1258 microversion: 2.1 time: 0.069174 Sep 14 09:58:12.314688 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3952/7329] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:58:12 2022] GET /compute/v2.1/servers/5851ba25-8bf7-4e7e-8609-f164a529e8ca => generated 1258 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:58:13.337370 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-dd42bab3-9563-48ee-baa2-eab27d66b562 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:58:13.338016 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-dd42bab3-9563-48ee-baa2-eab27d66b562 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] [instance: 5851ba25-8bf7-4e7e-8609-f164a529e8ca] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:58:13.390890 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-dd42bab3-9563-48ee-baa2-eab27d66b562 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02916df7dbfa4ba9b40ff2c0d162ce4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6bde0c922b436f8e144b8a6feefebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:58:13.397793 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-dd42bab3-9563-48ee-baa2-eab27d66b562 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] 10.222.0.60 "GET /compute/v2.1/servers/5851ba25-8bf7-4e7e-8609-f164a529e8ca" status: 200 len: 1258 microversion: 2.1 time: 0.064422 Sep 14 09:58:13.398366 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3378/7330] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:58:13 2022] GET /compute/v2.1/servers/5851ba25-8bf7-4e7e-8609-f164a529e8ca => generated 1258 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:58:14.421123 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c2c7cc0e-1474-42eb-8fef-4af365c1a164 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:58:14.421750 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-c2c7cc0e-1474-42eb-8fef-4af365c1a164 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] [instance: 5851ba25-8bf7-4e7e-8609-f164a529e8ca] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:58:14.429307 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c2c7cc0e-1474-42eb-8fef-4af365c1a164 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:14.429785 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c2c7cc0e-1474-42eb-8fef-4af365c1a164 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:14.430236 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c2c7cc0e-1474-42eb-8fef-4af365c1a164 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:14.430990 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c2c7cc0e-1474-42eb-8fef-4af365c1a164 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:14.431458 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c2c7cc0e-1474-42eb-8fef-4af365c1a164 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:14.431893 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c2c7cc0e-1474-42eb-8fef-4af365c1a164 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:14.500747 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-c2c7cc0e-1474-42eb-8fef-4af365c1a164 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02916df7dbfa4ba9b40ff2c0d162ce4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6bde0c922b436f8e144b8a6feefebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:58:14.508550 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-c2c7cc0e-1474-42eb-8fef-4af365c1a164 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] 10.222.0.60 "GET /compute/v2.1/servers/5851ba25-8bf7-4e7e-8609-f164a529e8ca" status: 200 len: 1262 microversion: 2.1 time: 0.091698 Sep 14 09:58:14.509659 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3953/7331] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:58:14 2022] GET /compute/v2.1/servers/5851ba25-8bf7-4e7e-8609-f164a529e8ca => generated 1262 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:58:15.533785 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-9b8c158a-708f-412d-91c0-c6b70c544787 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:58:15.535484 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-9b8c158a-708f-412d-91c0-c6b70c544787 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] [instance: 5851ba25-8bf7-4e7e-8609-f164a529e8ca] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:58:15.553166 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9b8c158a-708f-412d-91c0-c6b70c544787 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:15.554115 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9b8c158a-708f-412d-91c0-c6b70c544787 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:15.554808 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9b8c158a-708f-412d-91c0-c6b70c544787 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:15.555690 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9b8c158a-708f-412d-91c0-c6b70c544787 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:15.557067 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9b8c158a-708f-412d-91c0-c6b70c544787 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:15.557899 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9b8c158a-708f-412d-91c0-c6b70c544787 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:15.637533 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-9b8c158a-708f-412d-91c0-c6b70c544787 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02916df7dbfa4ba9b40ff2c0d162ce4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6bde0c922b436f8e144b8a6feefebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:58:15.649783 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-9b8c158a-708f-412d-91c0-c6b70c544787 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] 10.222.0.60 "GET /compute/v2.1/servers/5851ba25-8bf7-4e7e-8609-f164a529e8ca" status: 200 len: 1316 microversion: 2.1 time: 0.120973 Sep 14 09:58:15.663447 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3379/7332] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:58:15 2022] GET /compute/v2.1/servers/5851ba25-8bf7-4e7e-8609-f164a529e8ca => generated 1316 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:58:16.678362 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-0e14f783-ca50-470e-8b2d-5a7338200676 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:58:16.679226 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-0e14f783-ca50-470e-8b2d-5a7338200676 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] [instance: 5851ba25-8bf7-4e7e-8609-f164a529e8ca] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:58:16.682144 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:58:16.688241 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0e14f783-ca50-470e-8b2d-5a7338200676 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:16.689092 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0e14f783-ca50-470e-8b2d-5a7338200676 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:16.689747 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0e14f783-ca50-470e-8b2d-5a7338200676 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:16.690568 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0e14f783-ca50-470e-8b2d-5a7338200676 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:16.691368 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0e14f783-ca50-470e-8b2d-5a7338200676 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:16.692045 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0e14f783-ca50-470e-8b2d-5a7338200676 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:16.837189 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-0e14f783-ca50-470e-8b2d-5a7338200676 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02916df7dbfa4ba9b40ff2c0d162ce4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6bde0c922b436f8e144b8a6feefebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:58:16.845195 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-0e14f783-ca50-470e-8b2d-5a7338200676 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] 10.222.0.60 "GET /compute/v2.1/servers/5851ba25-8bf7-4e7e-8609-f164a529e8ca" status: 200 len: 1358 microversion: 2.1 time: 0.170887 Sep 14 09:58:16.845777 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3954/7333] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:58:16 2022] GET /compute/v2.1/servers/5851ba25-8bf7-4e7e-8609-f164a529e8ca => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:58:17.870091 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b1022bac-2576-403c-b30a-fa9158a644df tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:58:17.870738 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-b1022bac-2576-403c-b30a-fa9158a644df tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] [instance: 5851ba25-8bf7-4e7e-8609-f164a529e8ca] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:58:17.877990 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b1022bac-2576-403c-b30a-fa9158a644df tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:17.878496 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b1022bac-2576-403c-b30a-fa9158a644df tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:17.881467 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b1022bac-2576-403c-b30a-fa9158a644df tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:17.882356 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b1022bac-2576-403c-b30a-fa9158a644df tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:17.882964 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b1022bac-2576-403c-b30a-fa9158a644df tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:17.883663 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b1022bac-2576-403c-b30a-fa9158a644df tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:18.030822 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-b1022bac-2576-403c-b30a-fa9158a644df tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02916df7dbfa4ba9b40ff2c0d162ce4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6bde0c922b436f8e144b8a6feefebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:58:18.040478 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-b1022bac-2576-403c-b30a-fa9158a644df tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] 10.222.0.60 "GET /compute/v2.1/servers/5851ba25-8bf7-4e7e-8609-f164a529e8ca" status: 200 len: 1358 microversion: 2.1 time: 0.174922 Sep 14 09:58:18.041083 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3380/7334] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:58:17 2022] GET /compute/v2.1/servers/5851ba25-8bf7-4e7e-8609-f164a529e8ca => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:58:19.064281 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d26805fd-541c-4c44-b733-b7ed39003222 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:58:19.065054 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-d26805fd-541c-4c44-b733-b7ed39003222 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] [instance: 5851ba25-8bf7-4e7e-8609-f164a529e8ca] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:58:19.074337 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d26805fd-541c-4c44-b733-b7ed39003222 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:19.074862 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d26805fd-541c-4c44-b733-b7ed39003222 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:19.077337 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d26805fd-541c-4c44-b733-b7ed39003222 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:19.077337 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d26805fd-541c-4c44-b733-b7ed39003222 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:19.077552 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d26805fd-541c-4c44-b733-b7ed39003222 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:19.077966 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d26805fd-541c-4c44-b733-b7ed39003222 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:19.222413 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-d26805fd-541c-4c44-b733-b7ed39003222 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02916df7dbfa4ba9b40ff2c0d162ce4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6bde0c922b436f8e144b8a6feefebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:58:19.232125 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d26805fd-541c-4c44-b733-b7ed39003222 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] 10.222.0.60 "GET /compute/v2.1/servers/5851ba25-8bf7-4e7e-8609-f164a529e8ca" status: 200 len: 1358 microversion: 2.1 time: 0.171673 Sep 14 09:58:19.232738 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3955/7335] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:58:19 2022] GET /compute/v2.1/servers/5851ba25-8bf7-4e7e-8609-f164a529e8ca => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:58:20.258037 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-3f8f5d4c-66ab-4d0f-aa89-360cdabb564c tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:58:20.259383 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-3f8f5d4c-66ab-4d0f-aa89-360cdabb564c tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] [instance: 5851ba25-8bf7-4e7e-8609-f164a529e8ca] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:58:20.262123 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=2 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:58:20.267961 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3f8f5d4c-66ab-4d0f-aa89-360cdabb564c tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:20.268469 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3f8f5d4c-66ab-4d0f-aa89-360cdabb564c tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:20.268918 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3f8f5d4c-66ab-4d0f-aa89-360cdabb564c tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:20.269630 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3f8f5d4c-66ab-4d0f-aa89-360cdabb564c tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:20.270098 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3f8f5d4c-66ab-4d0f-aa89-360cdabb564c tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:20.270532 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3f8f5d4c-66ab-4d0f-aa89-360cdabb564c tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:20.426981 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-3f8f5d4c-66ab-4d0f-aa89-360cdabb564c tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02916df7dbfa4ba9b40ff2c0d162ce4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6bde0c922b436f8e144b8a6feefebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:58:20.436077 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-3f8f5d4c-66ab-4d0f-aa89-360cdabb564c tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] 10.222.0.60 "GET /compute/v2.1/servers/5851ba25-8bf7-4e7e-8609-f164a529e8ca" status: 200 len: 1358 microversion: 2.1 time: 0.182083 Sep 14 09:58:20.436954 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3381/7336] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:58:20 2022] GET /compute/v2.1/servers/5851ba25-8bf7-4e7e-8609-f164a529e8ca => generated 1358 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:58:21.459681 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-5788344a-8666-42d3-b89a-1a4c88189cb5 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:58:21.461077 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-5788344a-8666-42d3-b89a-1a4c88189cb5 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] [instance: 5851ba25-8bf7-4e7e-8609-f164a529e8ca] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:58:21.469068 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5788344a-8666-42d3-b89a-1a4c88189cb5 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:21.469570 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5788344a-8666-42d3-b89a-1a4c88189cb5 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:21.470716 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5788344a-8666-42d3-b89a-1a4c88189cb5 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:21.471943 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5788344a-8666-42d3-b89a-1a4c88189cb5 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:21.472582 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5788344a-8666-42d3-b89a-1a4c88189cb5 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:21.473207 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5788344a-8666-42d3-b89a-1a4c88189cb5 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:21.617256 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-5788344a-8666-42d3-b89a-1a4c88189cb5 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02916df7dbfa4ba9b40ff2c0d162ce4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6bde0c922b436f8e144b8a6feefebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:58:21.627346 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-5788344a-8666-42d3-b89a-1a4c88189cb5 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] 10.222.0.60 "GET /compute/v2.1/servers/5851ba25-8bf7-4e7e-8609-f164a529e8ca" status: 200 len: 1358 microversion: 2.1 time: 0.171535 Sep 14 09:58:21.628162 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3956/7337] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:58:21 2022] GET /compute/v2.1/servers/5851ba25-8bf7-4e7e-8609-f164a529e8ca => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:58:22.651116 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-41b13473-1cee-432c-9285-7808d0d9ade4 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:58:22.651775 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-41b13473-1cee-432c-9285-7808d0d9ade4 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] [instance: 5851ba25-8bf7-4e7e-8609-f164a529e8ca] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:58:22.658065 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-41b13473-1cee-432c-9285-7808d0d9ade4 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:22.658607 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-41b13473-1cee-432c-9285-7808d0d9ade4 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:22.659090 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-41b13473-1cee-432c-9285-7808d0d9ade4 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:22.659818 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-41b13473-1cee-432c-9285-7808d0d9ade4 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:22.660287 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-41b13473-1cee-432c-9285-7808d0d9ade4 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:22.660719 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-41b13473-1cee-432c-9285-7808d0d9ade4 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:22.791930 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-41b13473-1cee-432c-9285-7808d0d9ade4 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02916df7dbfa4ba9b40ff2c0d162ce4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6bde0c922b436f8e144b8a6feefebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:58:22.799902 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-41b13473-1cee-432c-9285-7808d0d9ade4 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] 10.222.0.60 "GET /compute/v2.1/servers/5851ba25-8bf7-4e7e-8609-f164a529e8ca" status: 200 len: 1358 microversion: 2.1 time: 0.152879 Sep 14 09:58:22.800489 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3382/7338] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:58:22 2022] GET /compute/v2.1/servers/5851ba25-8bf7-4e7e-8609-f164a529e8ca => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:58:23.778660 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-af66f009-a380-417d-8a83-4cb2e6c4eaed req-ecc6d93b-afb3-4877-8c92-0ac10ebe326f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5851ba25-8bf7-4e7e-8609-f164a529e8ca", "tag": "bb324d8a-748f-49ca-a08f-7d0649ba352a"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:58:23.784254 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=8 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:58:23.792330 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-af66f009-a380-417d-8a83-4cb2e6c4eaed req-ecc6d93b-afb3-4877-8c92-0ac10ebe326f service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:23.792825 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-af66f009-a380-417d-8a83-4cb2e6c4eaed req-ecc6d93b-afb3-4877-8c92-0ac10ebe326f service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:23.793636 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-af66f009-a380-417d-8a83-4cb2e6c4eaed req-ecc6d93b-afb3-4877-8c92-0ac10ebe326f service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:23.805548 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-af66f009-a380-417d-8a83-4cb2e6c4eaed req-ecc6d93b-afb3-4877-8c92-0ac10ebe326f service nova] Creating event network-changed:bb324d8a-748f-49ca-a08f-7d0649ba352a for instance 5851ba25-8bf7-4e7e-8609-f164a529e8ca on n-h2-836830-18 Sep 14 09:58:23.810715 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-af66f009-a380-417d-8a83-4cb2e6c4eaed req-ecc6d93b-afb3-4877-8c92-0ac10ebe326f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036417 Sep 14 09:58:23.811437 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3957/7339] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:58:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:58:23.822402 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-e6dddd2f-235a-4bea-bf50-b3636440f381 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:58:23.823085 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-e6dddd2f-235a-4bea-bf50-b3636440f381 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] [instance: 5851ba25-8bf7-4e7e-8609-f164a529e8ca] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:58:23.824981 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=10 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:58:23.831553 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e6dddd2f-235a-4bea-bf50-b3636440f381 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:23.832064 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e6dddd2f-235a-4bea-bf50-b3636440f381 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:23.832524 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e6dddd2f-235a-4bea-bf50-b3636440f381 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:23.833248 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e6dddd2f-235a-4bea-bf50-b3636440f381 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:23.833725 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e6dddd2f-235a-4bea-bf50-b3636440f381 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:23.834172 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e6dddd2f-235a-4bea-bf50-b3636440f381 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:23.965825 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-e6dddd2f-235a-4bea-bf50-b3636440f381 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02916df7dbfa4ba9b40ff2c0d162ce4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6bde0c922b436f8e144b8a6feefebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:58:23.974043 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-e6dddd2f-235a-4bea-bf50-b3636440f381 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] 10.222.0.60 "GET /compute/v2.1/servers/5851ba25-8bf7-4e7e-8609-f164a529e8ca" status: 200 len: 1358 microversion: 2.1 time: 0.155595 Sep 14 09:58:23.974642 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3383/7340] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:58:23 2022] GET /compute/v2.1/servers/5851ba25-8bf7-4e7e-8609-f164a529e8ca => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:58:25.000165 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3520c6a7-aec1-428d-903e-0e9508a5d2b7 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:58:25.000885 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-3520c6a7-aec1-428d-903e-0e9508a5d2b7 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] [instance: 5851ba25-8bf7-4e7e-8609-f164a529e8ca] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:58:25.007187 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3520c6a7-aec1-428d-903e-0e9508a5d2b7 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:25.007724 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3520c6a7-aec1-428d-903e-0e9508a5d2b7 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:25.008231 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3520c6a7-aec1-428d-903e-0e9508a5d2b7 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:25.009025 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3520c6a7-aec1-428d-903e-0e9508a5d2b7 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:25.009478 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3520c6a7-aec1-428d-903e-0e9508a5d2b7 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:25.009903 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3520c6a7-aec1-428d-903e-0e9508a5d2b7 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:25.146043 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-3520c6a7-aec1-428d-903e-0e9508a5d2b7 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02916df7dbfa4ba9b40ff2c0d162ce4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6bde0c922b436f8e144b8a6feefebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:58:25.154314 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-3520c6a7-aec1-428d-903e-0e9508a5d2b7 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] 10.222.0.60 "GET /compute/v2.1/servers/5851ba25-8bf7-4e7e-8609-f164a529e8ca" status: 200 len: 1358 microversion: 2.1 time: 0.160380 Sep 14 09:58:25.155042 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3958/7341] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:58:24 2022] GET /compute/v2.1/servers/5851ba25-8bf7-4e7e-8609-f164a529e8ca => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:58:26.177990 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-5c8d2dec-4c10-4a94-89f6-692f6fb24dc8 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:58:26.178557 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-5c8d2dec-4c10-4a94-89f6-692f6fb24dc8 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] [instance: 5851ba25-8bf7-4e7e-8609-f164a529e8ca] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:58:26.186069 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5c8d2dec-4c10-4a94-89f6-692f6fb24dc8 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:26.186574 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5c8d2dec-4c10-4a94-89f6-692f6fb24dc8 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:26.187071 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5c8d2dec-4c10-4a94-89f6-692f6fb24dc8 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:26.187782 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5c8d2dec-4c10-4a94-89f6-692f6fb24dc8 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:26.188257 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5c8d2dec-4c10-4a94-89f6-692f6fb24dc8 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:26.188701 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5c8d2dec-4c10-4a94-89f6-692f6fb24dc8 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:26.314679 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-5c8d2dec-4c10-4a94-89f6-692f6fb24dc8 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02916df7dbfa4ba9b40ff2c0d162ce4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6bde0c922b436f8e144b8a6feefebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:58:26.323012 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-5c8d2dec-4c10-4a94-89f6-692f6fb24dc8 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] 10.222.0.60 "GET /compute/v2.1/servers/5851ba25-8bf7-4e7e-8609-f164a529e8ca" status: 200 len: 1358 microversion: 2.1 time: 0.149022 Sep 14 09:58:26.324056 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3384/7342] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:58:26 2022] GET /compute/v2.1/servers/5851ba25-8bf7-4e7e-8609-f164a529e8ca => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:58:27.347877 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-13c90333-55b7-45c7-ae5e-5b231606d1f9 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:58:27.348603 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-13c90333-55b7-45c7-ae5e-5b231606d1f9 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] [instance: 5851ba25-8bf7-4e7e-8609-f164a529e8ca] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:58:27.355431 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-13c90333-55b7-45c7-ae5e-5b231606d1f9 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:27.355932 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-13c90333-55b7-45c7-ae5e-5b231606d1f9 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:27.356376 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-13c90333-55b7-45c7-ae5e-5b231606d1f9 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:27.357105 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-13c90333-55b7-45c7-ae5e-5b231606d1f9 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:27.357568 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-13c90333-55b7-45c7-ae5e-5b231606d1f9 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:27.358006 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-13c90333-55b7-45c7-ae5e-5b231606d1f9 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:27.723071 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-13c90333-55b7-45c7-ae5e-5b231606d1f9 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02916df7dbfa4ba9b40ff2c0d162ce4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6bde0c922b436f8e144b8a6feefebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:58:27.730910 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-13c90333-55b7-45c7-ae5e-5b231606d1f9 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] 10.222.0.60 "GET /compute/v2.1/servers/5851ba25-8bf7-4e7e-8609-f164a529e8ca" status: 200 len: 1358 microversion: 2.1 time: 0.387319 Sep 14 09:58:27.731595 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3959/7343] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:58:27 2022] GET /compute/v2.1/servers/5851ba25-8bf7-4e7e-8609-f164a529e8ca => generated 1358 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:58:28.754527 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-8d6120e8-0add-4037-a49f-0fffda82f408 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:58:28.755180 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-8d6120e8-0add-4037-a49f-0fffda82f408 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] [instance: 5851ba25-8bf7-4e7e-8609-f164a529e8ca] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:58:28.762502 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8d6120e8-0add-4037-a49f-0fffda82f408 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:28.763023 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8d6120e8-0add-4037-a49f-0fffda82f408 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:28.763471 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8d6120e8-0add-4037-a49f-0fffda82f408 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:28.764168 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8d6120e8-0add-4037-a49f-0fffda82f408 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:28.764636 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8d6120e8-0add-4037-a49f-0fffda82f408 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:28.765072 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8d6120e8-0add-4037-a49f-0fffda82f408 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:28.895367 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-8d6120e8-0add-4037-a49f-0fffda82f408 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02916df7dbfa4ba9b40ff2c0d162ce4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6bde0c922b436f8e144b8a6feefebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:58:28.903673 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-8d6120e8-0add-4037-a49f-0fffda82f408 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] 10.222.0.60 "GET /compute/v2.1/servers/5851ba25-8bf7-4e7e-8609-f164a529e8ca" status: 200 len: 1358 microversion: 2.1 time: 0.153066 Sep 14 09:58:28.904250 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3385/7344] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:58:28 2022] GET /compute/v2.1/servers/5851ba25-8bf7-4e7e-8609-f164a529e8ca => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:58:29.932008 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a316cc0c-eb84-4233-b795-004d51bd89c0 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:58:29.934998 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-a316cc0c-eb84-4233-b795-004d51bd89c0 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] [instance: 5851ba25-8bf7-4e7e-8609-f164a529e8ca] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:58:29.942377 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a316cc0c-eb84-4233-b795-004d51bd89c0 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:29.942868 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a316cc0c-eb84-4233-b795-004d51bd89c0 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:29.943335 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a316cc0c-eb84-4233-b795-004d51bd89c0 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:29.944039 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a316cc0c-eb84-4233-b795-004d51bd89c0 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:29.944494 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a316cc0c-eb84-4233-b795-004d51bd89c0 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:29.944920 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a316cc0c-eb84-4233-b795-004d51bd89c0 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:30.085650 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-a316cc0c-eb84-4233-b795-004d51bd89c0 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02916df7dbfa4ba9b40ff2c0d162ce4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6bde0c922b436f8e144b8a6feefebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:58:30.088441 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-f88b723b-8bc8-4209-9533-2af85643d339 req-f5a7b568-4324-4ac6-8774-76f548440ee9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5851ba25-8bf7-4e7e-8609-f164a529e8ca", "name": "network-vif-plugged", "status": "completed", "tag": "bb324d8a-748f-49ca-a08f-7d0649ba352a"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:58:30.094198 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a316cc0c-eb84-4233-b795-004d51bd89c0 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] 10.222.0.60 "GET /compute/v2.1/servers/5851ba25-8bf7-4e7e-8609-f164a529e8ca" status: 200 len: 1358 microversion: 2.1 time: 0.170901 Sep 14 09:58:30.094807 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3960/7345] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:58:29 2022] GET /compute/v2.1/servers/5851ba25-8bf7-4e7e-8609-f164a529e8ca => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:58:30.108717 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-f88b723b-8bc8-4209-9533-2af85643d339 req-f5a7b568-4324-4ac6-8774-76f548440ee9 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:30.109320 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-f88b723b-8bc8-4209-9533-2af85643d339 req-f5a7b568-4324-4ac6-8774-76f548440ee9 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:30.109892 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-f88b723b-8bc8-4209-9533-2af85643d339 req-f5a7b568-4324-4ac6-8774-76f548440ee9 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:30.121582 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-f88b723b-8bc8-4209-9533-2af85643d339 req-f5a7b568-4324-4ac6-8774-76f548440ee9 service nova] Creating event network-vif-plugged:bb324d8a-748f-49ca-a08f-7d0649ba352a for instance 5851ba25-8bf7-4e7e-8609-f164a529e8ca on n-h2-836830-18 Sep 14 09:58:30.127123 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-f88b723b-8bc8-4209-9533-2af85643d339 req-f5a7b568-4324-4ac6-8774-76f548440ee9 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105259 Sep 14 09:58:30.127751 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3386/7346] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:58:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:58:31.117904 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8be8b0c7-c5a4-472f-b44b-f039266a7484 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:58:31.119137 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-8be8b0c7-c5a4-472f-b44b-f039266a7484 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] [instance: 5851ba25-8bf7-4e7e-8609-f164a529e8ca] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:58:31.126010 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8be8b0c7-c5a4-472f-b44b-f039266a7484 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:31.126422 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8be8b0c7-c5a4-472f-b44b-f039266a7484 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:31.126862 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8be8b0c7-c5a4-472f-b44b-f039266a7484 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:31.127585 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8be8b0c7-c5a4-472f-b44b-f039266a7484 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:31.128044 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8be8b0c7-c5a4-472f-b44b-f039266a7484 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:31.128472 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8be8b0c7-c5a4-472f-b44b-f039266a7484 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:31.265973 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-8be8b0c7-c5a4-472f-b44b-f039266a7484 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02916df7dbfa4ba9b40ff2c0d162ce4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6bde0c922b436f8e144b8a6feefebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:58:31.273934 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-8be8b0c7-c5a4-472f-b44b-f039266a7484 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] 10.222.0.60 "GET /compute/v2.1/servers/5851ba25-8bf7-4e7e-8609-f164a529e8ca" status: 200 len: 1358 microversion: 2.1 time: 0.159986 Sep 14 09:58:31.275420 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3961/7347] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:58:31 2022] GET /compute/v2.1/servers/5851ba25-8bf7-4e7e-8609-f164a529e8ca => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:58:32.300065 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-832cedcd-a540-4c8b-800d-6e4fa9931dba tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:58:32.300791 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-832cedcd-a540-4c8b-800d-6e4fa9931dba tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] [instance: 5851ba25-8bf7-4e7e-8609-f164a529e8ca] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:58:32.307558 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-832cedcd-a540-4c8b-800d-6e4fa9931dba tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:32.308058 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-832cedcd-a540-4c8b-800d-6e4fa9931dba tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:32.308512 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-832cedcd-a540-4c8b-800d-6e4fa9931dba tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:32.309217 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-832cedcd-a540-4c8b-800d-6e4fa9931dba tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:32.309689 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-832cedcd-a540-4c8b-800d-6e4fa9931dba tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:32.310131 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-832cedcd-a540-4c8b-800d-6e4fa9931dba tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:32.441265 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-832cedcd-a540-4c8b-800d-6e4fa9931dba tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02916df7dbfa4ba9b40ff2c0d162ce4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6bde0c922b436f8e144b8a6feefebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:58:32.449171 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-832cedcd-a540-4c8b-800d-6e4fa9931dba tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] 10.222.0.60 "GET /compute/v2.1/servers/5851ba25-8bf7-4e7e-8609-f164a529e8ca" status: 200 len: 1547 microversion: 2.1 time: 0.154384 Sep 14 09:58:32.449778 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3387/7348] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:58:32 2022] GET /compute/v2.1/servers/5851ba25-8bf7-4e7e-8609-f164a529e8ca => generated 1547 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:58:32.471325 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f51e254d-1d92-428b-983a-9f0213f1feba tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:58:32.472246 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f51e254d-1d92-428b-983a-9f0213f1feba tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] [instance: 5851ba25-8bf7-4e7e-8609-f164a529e8ca] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:58:32.479643 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f51e254d-1d92-428b-983a-9f0213f1feba tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:32.480133 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f51e254d-1d92-428b-983a-9f0213f1feba tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:32.480576 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f51e254d-1d92-428b-983a-9f0213f1feba tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:32.481273 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f51e254d-1d92-428b-983a-9f0213f1feba tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:32.481734 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f51e254d-1d92-428b-983a-9f0213f1feba tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:32.482166 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f51e254d-1d92-428b-983a-9f0213f1feba tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:32.609417 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f51e254d-1d92-428b-983a-9f0213f1feba tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02916df7dbfa4ba9b40ff2c0d162ce4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6bde0c922b436f8e144b8a6feefebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:58:32.617348 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f51e254d-1d92-428b-983a-9f0213f1feba tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] 10.222.0.60 "GET /compute/v2.1/servers/5851ba25-8bf7-4e7e-8609-f164a529e8ca" status: 200 len: 1547 microversion: 2.1 time: 0.149912 Sep 14 09:58:32.617924 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3962/7349] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:58:32 2022] GET /compute/v2.1/servers/5851ba25-8bf7-4e7e-8609-f164a529e8ca => generated 1547 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:58:32.639551 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b47b2120-6171-4452-a7c8-8c8ba7b8c7e2 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:58:32.644390 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-b47b2120-6171-4452-a7c8-8c8ba7b8c7e2 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '02916df7dbfa4ba9b40ff2c0d162ce4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6bde0c922b436f8e144b8a6feefebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:58:32.645186 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-b47b2120-6171-4452-a7c8-8c8ba7b8c7e2 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Searching by: {'deleted': False, 'project_id': 'dd6bde0c922b436f8e144b8a6feefebe'} {{(pid=128758) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 14 09:58:32.650547 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b47b2120-6171-4452-a7c8-8c8ba7b8c7e2 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:32.651092 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b47b2120-6171-4452-a7c8-8c8ba7b8c7e2 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:32.651551 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b47b2120-6171-4452-a7c8-8c8ba7b8c7e2 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:32.652299 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b47b2120-6171-4452-a7c8-8c8ba7b8c7e2 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:32.652773 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b47b2120-6171-4452-a7c8-8c8ba7b8c7e2 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:32.653218 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b47b2120-6171-4452-a7c8-8c8ba7b8c7e2 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:32.676791 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.multi_cell_list [None req-b47b2120-6171-4452-a7c8-8c8ba7b8c7e2 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128758) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 14 09:58:32.705953 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-b47b2120-6171-4452-a7c8-8c8ba7b8c7e2 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] 10.222.0.60 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.070264 Sep 14 09:58:32.706559 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3388/7350] 10.222.0.60 () {58 vars in 1125 bytes} [Wed Sep 14 09:58:32 2022] GET /compute/v2.1/servers => generated 342 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:58:32.718181 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3eafe05c-e313-4eb9-9cb1-94add1a1c77e tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:58:32.718807 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-3eafe05c-e313-4eb9-9cb1-94add1a1c77e tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] [instance: 5851ba25-8bf7-4e7e-8609-f164a529e8ca] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:58:32.725372 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3eafe05c-e313-4eb9-9cb1-94add1a1c77e tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:32.725865 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3eafe05c-e313-4eb9-9cb1-94add1a1c77e tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:32.726311 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3eafe05c-e313-4eb9-9cb1-94add1a1c77e tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:32.727039 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3eafe05c-e313-4eb9-9cb1-94add1a1c77e tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:32.727500 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3eafe05c-e313-4eb9-9cb1-94add1a1c77e tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:32.728422 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3eafe05c-e313-4eb9-9cb1-94add1a1c77e tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:32.854765 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-3eafe05c-e313-4eb9-9cb1-94add1a1c77e tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02916df7dbfa4ba9b40ff2c0d162ce4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6bde0c922b436f8e144b8a6feefebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:58:32.862537 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-3eafe05c-e313-4eb9-9cb1-94add1a1c77e tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] 10.222.0.60 "GET /compute/v2.1/servers/5851ba25-8bf7-4e7e-8609-f164a529e8ca" status: 200 len: 1547 microversion: 2.1 time: 0.148233 Sep 14 09:58:32.863141 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3963/7351] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:58:32 2022] GET /compute/v2.1/servers/5851ba25-8bf7-4e7e-8609-f164a529e8ca => generated 1547 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:58:34.377924 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-e0c51551-e72b-4c95-881a-d49e1b8612a3 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8e29e17b-83ff-4f63-a306-173853396f40"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:58:34.382152 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-e0c51551-e72b-4c95-881a-d49e1b8612a3 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] [instance: 5851ba25-8bf7-4e7e-8609-f164a529e8ca] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:58:34.392737 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e0c51551-e72b-4c95-881a-d49e1b8612a3 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:34.394186 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e0c51551-e72b-4c95-881a-d49e1b8612a3 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:34.394651 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e0c51551-e72b-4c95-881a-d49e1b8612a3 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:34.395845 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e0c51551-e72b-4c95-881a-d49e1b8612a3 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:34.396319 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e0c51551-e72b-4c95-881a-d49e1b8612a3 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:34.396760 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e0c51551-e72b-4c95-881a-d49e1b8612a3 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:34.645334 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-e0c51551-e72b-4c95-881a-d49e1b8612a3 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] 10.222.0.60 "POST /compute/v2.1/servers/5851ba25-8bf7-4e7e-8609-f164a529e8ca/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.273287 Sep 14 09:58:34.650290 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3389/7352] 10.222.0.60 () {60 vars in 1323 bytes} [Wed Sep 14 09:58:34 2022] POST /compute/v2.1/servers/5851ba25-8bf7-4e7e-8609-f164a529e8ca/os-volume_attachments => generated 194 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:58:45.416031 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-763b59c8-cee5-4a5c-a880-ef2afff10ab2 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:58:45.416662 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-763b59c8-cee5-4a5c-a880-ef2afff10ab2 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] [instance: 5851ba25-8bf7-4e7e-8609-f164a529e8ca] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:58:45.419076 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=19 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:58:45.419887 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=62 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:58:45.425710 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-763b59c8-cee5-4a5c-a880-ef2afff10ab2 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:45.426203 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-763b59c8-cee5-4a5c-a880-ef2afff10ab2 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:45.426654 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-763b59c8-cee5-4a5c-a880-ef2afff10ab2 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:45.427379 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-763b59c8-cee5-4a5c-a880-ef2afff10ab2 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:45.427846 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-763b59c8-cee5-4a5c-a880-ef2afff10ab2 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:45.428283 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-763b59c8-cee5-4a5c-a880-ef2afff10ab2 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:45.567087 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-763b59c8-cee5-4a5c-a880-ef2afff10ab2 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02916df7dbfa4ba9b40ff2c0d162ce4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6bde0c922b436f8e144b8a6feefebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:58:45.576180 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-763b59c8-cee5-4a5c-a880-ef2afff10ab2 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] 10.222.0.60 "GET /compute/v2.1/servers/5851ba25-8bf7-4e7e-8609-f164a529e8ca" status: 200 len: 1593 microversion: 2.1 time: 0.164184 Sep 14 09:58:45.576768 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3964/7353] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:58:45 2022] GET /compute/v2.1/servers/5851ba25-8bf7-4e7e-8609-f164a529e8ca => generated 1593 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:58:47.171153 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=2 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:58:47.172304 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:58:47.173601 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:58:47.179431 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-8498b861-d96c-4e92-8d34-3093c22d18f0 req-38475b84-481b-4b6a-86e2-ee105bba879f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5851ba25-8bf7-4e7e-8609-f164a529e8ca", "tag": "bb324d8a-748f-49ca-a08f-7d0649ba352a"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:58:47.192687 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-8498b861-d96c-4e92-8d34-3093c22d18f0 req-38475b84-481b-4b6a-86e2-ee105bba879f service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:47.193408 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-8498b861-d96c-4e92-8d34-3093c22d18f0 req-38475b84-481b-4b6a-86e2-ee105bba879f service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:47.194117 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-8498b861-d96c-4e92-8d34-3093c22d18f0 req-38475b84-481b-4b6a-86e2-ee105bba879f service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:47.207988 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-8498b861-d96c-4e92-8d34-3093c22d18f0 req-38475b84-481b-4b6a-86e2-ee105bba879f service nova] Creating event network-changed:bb324d8a-748f-49ca-a08f-7d0649ba352a for instance 5851ba25-8bf7-4e7e-8609-f164a529e8ca on n-h2-836830-18 Sep 14 09:58:47.213623 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-8498b861-d96c-4e92-8d34-3093c22d18f0 req-38475b84-481b-4b6a-86e2-ee105bba879f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045033 Sep 14 09:58:47.214388 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3390/7354] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:58:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:58:48.234441 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-5b2515d3-0b5a-4c8b-8f19-d955605ad957 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-546885718"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:58:48.235013 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-5b2515d3-0b5a-4c8b-8f19-d955605ad957 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] [instance: 5851ba25-8bf7-4e7e-8609-f164a529e8ca] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:58:48.242746 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5b2515d3-0b5a-4c8b-8f19-d955605ad957 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:48.243272 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5b2515d3-0b5a-4c8b-8f19-d955605ad957 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:48.243734 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5b2515d3-0b5a-4c8b-8f19-d955605ad957 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:48.244431 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5b2515d3-0b5a-4c8b-8f19-d955605ad957 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:48.244909 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5b2515d3-0b5a-4c8b-8f19-d955605ad957 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:48.245336 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5b2515d3-0b5a-4c8b-8f19-d955605ad957 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:48.378590 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.network.security_group_api [None req-5b2515d3-0b5a-4c8b-8f19-d955605ad957 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Adding security group 4ef852a9-8877-4d55-aec3-ea186e7c9811 to port bb324d8a-748f-49ca-a08f-7d0649ba352a Sep 14 09:58:48.692404 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-5b2515d3-0b5a-4c8b-8f19-d955605ad957 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] 10.222.0.60 "POST /compute/v2.1/servers/5851ba25-8bf7-4e7e-8609-f164a529e8ca/action" status: 202 len: 0 microversion: 2.1 time: 0.461872 Sep 14 09:58:48.693248 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3965/7355] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:58:48 2022] POST /compute/v2.1/servers/5851ba25-8bf7-4e7e-8609-f164a529e8ca/action => generated 0 bytes in 463 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:58:48.703250 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-454eb86f-9562-46c0-968f-b63fd6ed4fb9 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:58:48.704102 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-454eb86f-9562-46c0-968f-b63fd6ed4fb9 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] [instance: 5851ba25-8bf7-4e7e-8609-f164a529e8ca] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:58:48.710360 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-454eb86f-9562-46c0-968f-b63fd6ed4fb9 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:48.710857 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-454eb86f-9562-46c0-968f-b63fd6ed4fb9 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:48.711467 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-454eb86f-9562-46c0-968f-b63fd6ed4fb9 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:48.712181 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-454eb86f-9562-46c0-968f-b63fd6ed4fb9 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:48.712832 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-454eb86f-9562-46c0-968f-b63fd6ed4fb9 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:48.713268 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-454eb86f-9562-46c0-968f-b63fd6ed4fb9 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:48.868869 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-454eb86f-9562-46c0-968f-b63fd6ed4fb9 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02916df7dbfa4ba9b40ff2c0d162ce4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6bde0c922b436f8e144b8a6feefebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:58:48.877835 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-454eb86f-9562-46c0-968f-b63fd6ed4fb9 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] 10.222.0.60 "GET /compute/v2.1/servers/5851ba25-8bf7-4e7e-8609-f164a529e8ca" status: 200 len: 1758 microversion: 2.1 time: 0.179885 Sep 14 09:58:48.878448 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3391/7356] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:58:48 2022] GET /compute/v2.1/servers/5851ba25-8bf7-4e7e-8609-f164a529e8ca => generated 1758 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:58:49.228973 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-22538f0a-ff99-4c4b-b291-9590f4e55ff2 req-86b853d8-32d1-4714-a4cd-254204675b8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5851ba25-8bf7-4e7e-8609-f164a529e8ca", "tag": "bb324d8a-748f-49ca-a08f-7d0649ba352a"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:58:49.240065 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-22538f0a-ff99-4c4b-b291-9590f4e55ff2 req-86b853d8-32d1-4714-a4cd-254204675b8a service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:49.240712 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-22538f0a-ff99-4c4b-b291-9590f4e55ff2 req-86b853d8-32d1-4714-a4cd-254204675b8a service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:49.240972 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-22538f0a-ff99-4c4b-b291-9590f4e55ff2 req-86b853d8-32d1-4714-a4cd-254204675b8a service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:49.252446 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-22538f0a-ff99-4c4b-b291-9590f4e55ff2 req-86b853d8-32d1-4714-a4cd-254204675b8a service nova] Creating event network-changed:bb324d8a-748f-49ca-a08f-7d0649ba352a for instance 5851ba25-8bf7-4e7e-8609-f164a529e8ca on n-h2-836830-18 Sep 14 09:58:49.257631 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-22538f0a-ff99-4c4b-b291-9590f4e55ff2 req-86b853d8-32d1-4714-a4cd-254204675b8a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032317 Sep 14 09:58:49.258248 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3966/7357] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:58:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:59:03.885175 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-aad92db9-aa7a-497a-ab5c-9f461ea76fe3 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:59:03.890564 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-aad92db9-aa7a-497a-ab5c-9f461ea76fe3 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] [instance: 5851ba25-8bf7-4e7e-8609-f164a529e8ca] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:59:03.893383 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=4 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:59:03.894118 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=8 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:59:03.903306 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-aad92db9-aa7a-497a-ab5c-9f461ea76fe3 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:03.903917 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-aad92db9-aa7a-497a-ab5c-9f461ea76fe3 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:03.904749 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-aad92db9-aa7a-497a-ab5c-9f461ea76fe3 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:03.905964 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-aad92db9-aa7a-497a-ab5c-9f461ea76fe3 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:03.906830 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-aad92db9-aa7a-497a-ab5c-9f461ea76fe3 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:03.907353 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-aad92db9-aa7a-497a-ab5c-9f461ea76fe3 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:03.988002 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-aad92db9-aa7a-497a-ab5c-9f461ea76fe3 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] 10.222.0.60 "POST /compute/v2.1/servers/5851ba25-8bf7-4e7e-8609-f164a529e8ca/action" status: 202 len: 0 microversion: 2.1 time: 0.107255 Sep 14 09:59:03.989598 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3392/7358] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:59:03 2022] POST /compute/v2.1/servers/5851ba25-8bf7-4e7e-8609-f164a529e8ca/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:59:03.995351 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=6 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:59:03.996117 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=12 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:59:04.000926 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-4c120618-79fb-4697-8846-d0753aa76030 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:59:04.001651 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-4c120618-79fb-4697-8846-d0753aa76030 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] [instance: 5851ba25-8bf7-4e7e-8609-f164a529e8ca] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:59:04.010845 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4c120618-79fb-4697-8846-d0753aa76030 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:04.011380 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4c120618-79fb-4697-8846-d0753aa76030 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:04.011831 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4c120618-79fb-4697-8846-d0753aa76030 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:04.012967 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4c120618-79fb-4697-8846-d0753aa76030 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:04.013808 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4c120618-79fb-4697-8846-d0753aa76030 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:04.014376 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4c120618-79fb-4697-8846-d0753aa76030 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:04.184723 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-4c120618-79fb-4697-8846-d0753aa76030 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02916df7dbfa4ba9b40ff2c0d162ce4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6bde0c922b436f8e144b8a6feefebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:59:04.193310 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-4c120618-79fb-4697-8846-d0753aa76030 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] 10.222.0.60 "GET /compute/v2.1/servers/5851ba25-8bf7-4e7e-8609-f164a529e8ca" status: 200 len: 1750 microversion: 2.1 time: 0.199929 Sep 14 09:59:04.193912 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3967/7359] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:59:03 2022] GET /compute/v2.1/servers/5851ba25-8bf7-4e7e-8609-f164a529e8ca => generated 1750 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:59:05.218414 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-4ae6df94-0bb6-4623-a818-2ea0ee1fa278 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:59:05.219170 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-4ae6df94-0bb6-4623-a818-2ea0ee1fa278 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] [instance: 5851ba25-8bf7-4e7e-8609-f164a529e8ca] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:59:05.225663 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4ae6df94-0bb6-4623-a818-2ea0ee1fa278 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:05.226162 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4ae6df94-0bb6-4623-a818-2ea0ee1fa278 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:05.226614 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4ae6df94-0bb6-4623-a818-2ea0ee1fa278 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:05.227351 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4ae6df94-0bb6-4623-a818-2ea0ee1fa278 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:05.227819 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4ae6df94-0bb6-4623-a818-2ea0ee1fa278 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:05.228258 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4ae6df94-0bb6-4623-a818-2ea0ee1fa278 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:05.378824 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-4ae6df94-0bb6-4623-a818-2ea0ee1fa278 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02916df7dbfa4ba9b40ff2c0d162ce4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6bde0c922b436f8e144b8a6feefebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:59:05.387250 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-4ae6df94-0bb6-4623-a818-2ea0ee1fa278 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] 10.222.0.60 "GET /compute/v2.1/servers/5851ba25-8bf7-4e7e-8609-f164a529e8ca" status: 200 len: 1755 microversion: 2.1 time: 0.174047 Sep 14 09:59:05.387824 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3393/7360] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:59:05 2022] GET /compute/v2.1/servers/5851ba25-8bf7-4e7e-8609-f164a529e8ca => generated 1755 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:59:06.411291 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-40e280b7-b157-4a87-8dd6-7d2e79fd5b02 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:59:06.411920 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-40e280b7-b157-4a87-8dd6-7d2e79fd5b02 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] [instance: 5851ba25-8bf7-4e7e-8609-f164a529e8ca] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:59:06.418879 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-40e280b7-b157-4a87-8dd6-7d2e79fd5b02 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:06.419405 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-40e280b7-b157-4a87-8dd6-7d2e79fd5b02 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:06.419850 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-40e280b7-b157-4a87-8dd6-7d2e79fd5b02 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:06.420551 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-40e280b7-b157-4a87-8dd6-7d2e79fd5b02 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:06.421008 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-40e280b7-b157-4a87-8dd6-7d2e79fd5b02 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:06.421439 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-40e280b7-b157-4a87-8dd6-7d2e79fd5b02 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:06.571971 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-40e280b7-b157-4a87-8dd6-7d2e79fd5b02 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02916df7dbfa4ba9b40ff2c0d162ce4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6bde0c922b436f8e144b8a6feefebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:59:06.581306 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-40e280b7-b157-4a87-8dd6-7d2e79fd5b02 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] 10.222.0.60 "GET /compute/v2.1/servers/5851ba25-8bf7-4e7e-8609-f164a529e8ca" status: 200 len: 1755 microversion: 2.1 time: 0.174001 Sep 14 09:59:06.581910 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3968/7361] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:59:06 2022] GET /compute/v2.1/servers/5851ba25-8bf7-4e7e-8609-f164a529e8ca => generated 1755 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:59:07.651349 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-94c6ad36-6ebd-4872-85cb-cfdbe9ed8382 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:59:07.651996 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-94c6ad36-6ebd-4872-85cb-cfdbe9ed8382 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] [instance: 5851ba25-8bf7-4e7e-8609-f164a529e8ca] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:59:07.658984 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-94c6ad36-6ebd-4872-85cb-cfdbe9ed8382 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:07.659500 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-94c6ad36-6ebd-4872-85cb-cfdbe9ed8382 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:07.659960 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-94c6ad36-6ebd-4872-85cb-cfdbe9ed8382 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:07.660680 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-94c6ad36-6ebd-4872-85cb-cfdbe9ed8382 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:07.661187 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-94c6ad36-6ebd-4872-85cb-cfdbe9ed8382 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:07.661634 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-94c6ad36-6ebd-4872-85cb-cfdbe9ed8382 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:07.810168 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-94c6ad36-6ebd-4872-85cb-cfdbe9ed8382 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02916df7dbfa4ba9b40ff2c0d162ce4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6bde0c922b436f8e144b8a6feefebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:59:07.818584 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-94c6ad36-6ebd-4872-85cb-cfdbe9ed8382 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] 10.222.0.60 "GET /compute/v2.1/servers/5851ba25-8bf7-4e7e-8609-f164a529e8ca" status: 200 len: 1755 microversion: 2.1 time: 0.217004 Sep 14 09:59:07.819211 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3394/7362] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:59:07 2022] GET /compute/v2.1/servers/5851ba25-8bf7-4e7e-8609-f164a529e8ca => generated 1755 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:59:08.842491 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-03ab2509-2e05-4e88-af9b-2b17c72dd9e5 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:59:08.843109 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-03ab2509-2e05-4e88-af9b-2b17c72dd9e5 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] [instance: 5851ba25-8bf7-4e7e-8609-f164a529e8ca] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:59:08.852848 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-03ab2509-2e05-4e88-af9b-2b17c72dd9e5 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:08.853739 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-03ab2509-2e05-4e88-af9b-2b17c72dd9e5 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:08.854316 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-03ab2509-2e05-4e88-af9b-2b17c72dd9e5 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:08.855044 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-03ab2509-2e05-4e88-af9b-2b17c72dd9e5 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:08.855504 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-03ab2509-2e05-4e88-af9b-2b17c72dd9e5 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:08.855930 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-03ab2509-2e05-4e88-af9b-2b17c72dd9e5 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:08.998379 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-03ab2509-2e05-4e88-af9b-2b17c72dd9e5 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02916df7dbfa4ba9b40ff2c0d162ce4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6bde0c922b436f8e144b8a6feefebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:59:09.006657 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-03ab2509-2e05-4e88-af9b-2b17c72dd9e5 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] 10.222.0.60 "GET /compute/v2.1/servers/5851ba25-8bf7-4e7e-8609-f164a529e8ca" status: 200 len: 1755 microversion: 2.1 time: 0.168132 Sep 14 09:59:09.007267 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3969/7363] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:59:08 2022] GET /compute/v2.1/servers/5851ba25-8bf7-4e7e-8609-f164a529e8ca => generated 1755 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:59:10.029938 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-07453ec8-f54b-4288-a3be-a964bac44c47 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:59:10.030538 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-07453ec8-f54b-4288-a3be-a964bac44c47 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] [instance: 5851ba25-8bf7-4e7e-8609-f164a529e8ca] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:59:10.037348 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-07453ec8-f54b-4288-a3be-a964bac44c47 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:10.037845 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-07453ec8-f54b-4288-a3be-a964bac44c47 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:10.038294 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-07453ec8-f54b-4288-a3be-a964bac44c47 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:10.039051 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-07453ec8-f54b-4288-a3be-a964bac44c47 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:10.039536 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-07453ec8-f54b-4288-a3be-a964bac44c47 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:10.039970 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-07453ec8-f54b-4288-a3be-a964bac44c47 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:10.182998 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-07453ec8-f54b-4288-a3be-a964bac44c47 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02916df7dbfa4ba9b40ff2c0d162ce4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6bde0c922b436f8e144b8a6feefebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:59:10.192657 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-07453ec8-f54b-4288-a3be-a964bac44c47 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] 10.222.0.60 "GET /compute/v2.1/servers/5851ba25-8bf7-4e7e-8609-f164a529e8ca" status: 200 len: 1755 microversion: 2.1 time: 0.166719 Sep 14 09:59:10.193241 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3395/7364] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:59:10 2022] GET /compute/v2.1/servers/5851ba25-8bf7-4e7e-8609-f164a529e8ca => generated 1755 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:59:11.216034 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-096f4da6-c550-462c-b354-fefbb45194e6 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:59:11.216689 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-096f4da6-c550-462c-b354-fefbb45194e6 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] [instance: 5851ba25-8bf7-4e7e-8609-f164a529e8ca] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:59:11.224331 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-096f4da6-c550-462c-b354-fefbb45194e6 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:11.224573 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-096f4da6-c550-462c-b354-fefbb45194e6 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:11.224947 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-096f4da6-c550-462c-b354-fefbb45194e6 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:11.225641 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-096f4da6-c550-462c-b354-fefbb45194e6 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:11.226099 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-096f4da6-c550-462c-b354-fefbb45194e6 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:11.226531 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-096f4da6-c550-462c-b354-fefbb45194e6 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:11.372722 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-096f4da6-c550-462c-b354-fefbb45194e6 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02916df7dbfa4ba9b40ff2c0d162ce4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6bde0c922b436f8e144b8a6feefebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:59:11.381051 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-096f4da6-c550-462c-b354-fefbb45194e6 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] 10.222.0.60 "GET /compute/v2.1/servers/5851ba25-8bf7-4e7e-8609-f164a529e8ca" status: 200 len: 1755 microversion: 2.1 time: 0.168988 Sep 14 09:59:11.381632 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3970/7365] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:59:11 2022] GET /compute/v2.1/servers/5851ba25-8bf7-4e7e-8609-f164a529e8ca => generated 1755 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:59:12.403728 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a290e3f3-7d75-49b1-9620-03fb57af1183 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:59:12.404361 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-a290e3f3-7d75-49b1-9620-03fb57af1183 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] [instance: 5851ba25-8bf7-4e7e-8609-f164a529e8ca] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:59:12.411350 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a290e3f3-7d75-49b1-9620-03fb57af1183 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:12.411852 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a290e3f3-7d75-49b1-9620-03fb57af1183 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:12.412299 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a290e3f3-7d75-49b1-9620-03fb57af1183 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:12.413001 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a290e3f3-7d75-49b1-9620-03fb57af1183 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:12.413471 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a290e3f3-7d75-49b1-9620-03fb57af1183 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:12.413912 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a290e3f3-7d75-49b1-9620-03fb57af1183 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:12.555920 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-a290e3f3-7d75-49b1-9620-03fb57af1183 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02916df7dbfa4ba9b40ff2c0d162ce4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6bde0c922b436f8e144b8a6feefebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:59:12.564521 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-a290e3f3-7d75-49b1-9620-03fb57af1183 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] 10.222.0.60 "GET /compute/v2.1/servers/5851ba25-8bf7-4e7e-8609-f164a529e8ca" status: 200 len: 1755 microversion: 2.1 time: 0.164772 Sep 14 09:59:12.565095 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3396/7366] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:59:12 2022] GET /compute/v2.1/servers/5851ba25-8bf7-4e7e-8609-f164a529e8ca => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:59:13.587668 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-1edea3cb-b845-4391-81a5-92da649b9c7d tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:59:13.588297 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-1edea3cb-b845-4391-81a5-92da649b9c7d tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] [instance: 5851ba25-8bf7-4e7e-8609-f164a529e8ca] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:59:13.595296 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1edea3cb-b845-4391-81a5-92da649b9c7d tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:13.595786 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1edea3cb-b845-4391-81a5-92da649b9c7d tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:13.596230 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1edea3cb-b845-4391-81a5-92da649b9c7d tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:13.597192 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1edea3cb-b845-4391-81a5-92da649b9c7d tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:13.597656 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1edea3cb-b845-4391-81a5-92da649b9c7d tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:13.598085 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1edea3cb-b845-4391-81a5-92da649b9c7d tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:13.742414 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-1edea3cb-b845-4391-81a5-92da649b9c7d tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02916df7dbfa4ba9b40ff2c0d162ce4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6bde0c922b436f8e144b8a6feefebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:59:13.751395 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-1edea3cb-b845-4391-81a5-92da649b9c7d tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] 10.222.0.60 "GET /compute/v2.1/servers/5851ba25-8bf7-4e7e-8609-f164a529e8ca" status: 200 len: 1755 microversion: 2.1 time: 0.167640 Sep 14 09:59:13.751977 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3971/7367] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:59:13 2022] GET /compute/v2.1/servers/5851ba25-8bf7-4e7e-8609-f164a529e8ca => generated 1755 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:59:14.774737 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-9e039379-c490-40fe-a484-e8a2492267af tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:59:14.775414 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-9e039379-c490-40fe-a484-e8a2492267af tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] [instance: 5851ba25-8bf7-4e7e-8609-f164a529e8ca] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:59:14.782302 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9e039379-c490-40fe-a484-e8a2492267af tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:14.782789 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9e039379-c490-40fe-a484-e8a2492267af tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:14.783257 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9e039379-c490-40fe-a484-e8a2492267af tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:14.783956 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9e039379-c490-40fe-a484-e8a2492267af tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:14.784420 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9e039379-c490-40fe-a484-e8a2492267af tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:14.784880 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9e039379-c490-40fe-a484-e8a2492267af tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:14.928052 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-9e039379-c490-40fe-a484-e8a2492267af tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02916df7dbfa4ba9b40ff2c0d162ce4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6bde0c922b436f8e144b8a6feefebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:59:14.936906 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-9e039379-c490-40fe-a484-e8a2492267af tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] 10.222.0.60 "GET /compute/v2.1/servers/5851ba25-8bf7-4e7e-8609-f164a529e8ca" status: 200 len: 1755 microversion: 2.1 time: 0.166172 Sep 14 09:59:14.937490 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3397/7368] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:59:14 2022] GET /compute/v2.1/servers/5851ba25-8bf7-4e7e-8609-f164a529e8ca => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:59:15.960436 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ce564b57-9b12-4308-ae34-dc2b312ce6a8 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:59:15.961048 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-ce564b57-9b12-4308-ae34-dc2b312ce6a8 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] [instance: 5851ba25-8bf7-4e7e-8609-f164a529e8ca] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:59:15.967218 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ce564b57-9b12-4308-ae34-dc2b312ce6a8 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:15.967705 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ce564b57-9b12-4308-ae34-dc2b312ce6a8 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:15.968145 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ce564b57-9b12-4308-ae34-dc2b312ce6a8 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:15.968834 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ce564b57-9b12-4308-ae34-dc2b312ce6a8 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:15.969293 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ce564b57-9b12-4308-ae34-dc2b312ce6a8 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:15.969721 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ce564b57-9b12-4308-ae34-dc2b312ce6a8 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:16.112535 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-ce564b57-9b12-4308-ae34-dc2b312ce6a8 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02916df7dbfa4ba9b40ff2c0d162ce4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6bde0c922b436f8e144b8a6feefebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:59:16.121009 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-ce564b57-9b12-4308-ae34-dc2b312ce6a8 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] 10.222.0.60 "GET /compute/v2.1/servers/5851ba25-8bf7-4e7e-8609-f164a529e8ca" status: 200 len: 1758 microversion: 2.1 time: 0.164847 Sep 14 09:59:16.122139 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3972/7369] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:59:15 2022] GET /compute/v2.1/servers/5851ba25-8bf7-4e7e-8609-f164a529e8ca => generated 1758 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:59:48.438640 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-5dfceb5d-500b-40c5-b6e1-1eec79850119 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-546885718"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:59:48.439279 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-5dfceb5d-500b-40c5-b6e1-1eec79850119 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] [instance: 5851ba25-8bf7-4e7e-8609-f164a529e8ca] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:59:48.441691 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=12 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:59:48.442381 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:59:48.448413 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5dfceb5d-500b-40c5-b6e1-1eec79850119 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:48.448917 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5dfceb5d-500b-40c5-b6e1-1eec79850119 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:48.449373 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5dfceb5d-500b-40c5-b6e1-1eec79850119 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:48.450080 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5dfceb5d-500b-40c5-b6e1-1eec79850119 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:48.451163 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5dfceb5d-500b-40c5-b6e1-1eec79850119 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:48.451611 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5dfceb5d-500b-40c5-b6e1-1eec79850119 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:48.581083 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.network.security_group_api [None req-5dfceb5d-500b-40c5-b6e1-1eec79850119 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Removing security group 4ef852a9-8877-4d55-aec3-ea186e7c9811 from port bb324d8a-748f-49ca-a08f-7d0649ba352a Sep 14 09:59:48.895653 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-5dfceb5d-500b-40c5-b6e1-1eec79850119 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] 10.222.0.60 "POST /compute/v2.1/servers/5851ba25-8bf7-4e7e-8609-f164a529e8ca/action" status: 202 len: 0 microversion: 2.1 time: 0.461500 Sep 14 09:59:48.896489 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3398/7370] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 09:59:48 2022] POST /compute/v2.1/servers/5851ba25-8bf7-4e7e-8609-f164a529e8ca/action => generated 0 bytes in 463 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:59:48.905764 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-a1856c7e-d090-4dae-808e-b146832cfba6 req-b1c658c3-5c82-4e40-ae18-71935792b39b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5851ba25-8bf7-4e7e-8609-f164a529e8ca", "tag": "bb324d8a-748f-49ca-a08f-7d0649ba352a"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:59:48.917423 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=12 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:59:48.918137 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=36 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:59:48.932469 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-a1856c7e-d090-4dae-808e-b146832cfba6 req-b1c658c3-5c82-4e40-ae18-71935792b39b service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:48.932954 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-a1856c7e-d090-4dae-808e-b146832cfba6 req-b1c658c3-5c82-4e40-ae18-71935792b39b service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:48.933391 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-a1856c7e-d090-4dae-808e-b146832cfba6 req-b1c658c3-5c82-4e40-ae18-71935792b39b service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:48.957494 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-a1856c7e-d090-4dae-808e-b146832cfba6 req-b1c658c3-5c82-4e40-ae18-71935792b39b service nova] Creating event network-changed:bb324d8a-748f-49ca-a08f-7d0649ba352a for instance 5851ba25-8bf7-4e7e-8609-f164a529e8ca on n-h2-836830-18 Sep 14 09:59:48.973570 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-a1856c7e-d090-4dae-808e-b146832cfba6 req-b1c658c3-5c82-4e40-ae18-71935792b39b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071417 Sep 14 09:59:48.974165 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3973/7371] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:59:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:59:50.232947 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-982a2454-afc3-4426-a64f-8e5d3d9de1c1 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:59:50.233466 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-982a2454-afc3-4426-a64f-8e5d3d9de1c1 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] [instance: 5851ba25-8bf7-4e7e-8609-f164a529e8ca] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:59:50.240141 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-982a2454-afc3-4426-a64f-8e5d3d9de1c1 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:50.240650 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-982a2454-afc3-4426-a64f-8e5d3d9de1c1 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:50.241110 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-982a2454-afc3-4426-a64f-8e5d3d9de1c1 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:50.241833 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-982a2454-afc3-4426-a64f-8e5d3d9de1c1 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:50.242310 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-982a2454-afc3-4426-a64f-8e5d3d9de1c1 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:50.242758 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-982a2454-afc3-4426-a64f-8e5d3d9de1c1 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:50.324786 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.objects.instance [None req-982a2454-afc3-4426-a64f-8e5d3d9de1c1 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lazy-loading 'services' on Instance uuid 5851ba25-8bf7-4e7e-8609-f164a529e8ca {{(pid=128758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:59:50.397022 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-982a2454-afc3-4426-a64f-8e5d3d9de1c1 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] 10.222.0.60 "DELETE /compute/v2.1/servers/5851ba25-8bf7-4e7e-8609-f164a529e8ca/os-volume_attachments/8e29e17b-83ff-4f63-a306-173853396f40" status: 202 len: 0 microversion: 2.1 time: 0.169740 Sep 14 09:59:50.397648 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3399/7372] 10.222.0.60 () {58 vars in 1416 bytes} [Wed Sep 14 09:59:50 2022] DELETE /compute/v2.1/servers/5851ba25-8bf7-4e7e-8609-f164a529e8ca/os-volume_attachments/8e29e17b-83ff-4f63-a306-173853396f40 => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:59:50.404717 n-d-836830-18 devstack@n-api.service[128759]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 09:59:50.405231 n-d-836830-18 devstack@n-api.service[128759]: Wed Sep 14 09:59:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5851ba25-8bf7-4e7e-8609-f164a529e8ca/os-volume_attachments (ip 10.222.0.60) !!! Sep 14 09:59:50.409538 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d85e512e-5595-4138-ac2f-307b341365fa tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:59:50.411997 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-d85e512e-5595-4138-ac2f-307b341365fa tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] [instance: 5851ba25-8bf7-4e7e-8609-f164a529e8ca] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:59:50.420583 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d85e512e-5595-4138-ac2f-307b341365fa tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:50.421066 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d85e512e-5595-4138-ac2f-307b341365fa tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:50.421547 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d85e512e-5595-4138-ac2f-307b341365fa tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:50.422286 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d85e512e-5595-4138-ac2f-307b341365fa tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:50.422735 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d85e512e-5595-4138-ac2f-307b341365fa tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:50.423360 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d85e512e-5595-4138-ac2f-307b341365fa tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:50.465293 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d85e512e-5595-4138-ac2f-307b341365fa tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] 10.222.0.60 "GET /compute/v2.1/servers/5851ba25-8bf7-4e7e-8609-f164a529e8ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063029 Sep 14 09:59:50.466224 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3974/7373] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 14 09:59:50 2022] GET /compute/v2.1/servers/5851ba25-8bf7-4e7e-8609-f164a529e8ca/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:59:51.047894 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-1b883a4e-6073-4e6b-b8b3-d835c7697523 req-cde05aac-4964-41d5-b580-6916a8f79b29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5851ba25-8bf7-4e7e-8609-f164a529e8ca", "tag": "bb324d8a-748f-49ca-a08f-7d0649ba352a"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:59:51.057679 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-1b883a4e-6073-4e6b-b8b3-d835c7697523 req-cde05aac-4964-41d5-b580-6916a8f79b29 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:51.058177 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-1b883a4e-6073-4e6b-b8b3-d835c7697523 req-cde05aac-4964-41d5-b580-6916a8f79b29 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:51.058627 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-1b883a4e-6073-4e6b-b8b3-d835c7697523 req-cde05aac-4964-41d5-b580-6916a8f79b29 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:51.072905 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-1b883a4e-6073-4e6b-b8b3-d835c7697523 req-cde05aac-4964-41d5-b580-6916a8f79b29 service nova] Creating event network-changed:bb324d8a-748f-49ca-a08f-7d0649ba352a for instance 5851ba25-8bf7-4e7e-8609-f164a529e8ca on n-h2-836830-18 Sep 14 09:59:51.078570 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-1b883a4e-6073-4e6b-b8b3-d835c7697523 req-cde05aac-4964-41d5-b580-6916a8f79b29 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089111 Sep 14 09:59:51.079586 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3400/7374] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 09:59:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:59:51.478982 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-952bdb0e-6f9f-440b-9e27-1f7527fd4ff7 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:59:51.482013 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-952bdb0e-6f9f-440b-9e27-1f7527fd4ff7 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] [instance: 5851ba25-8bf7-4e7e-8609-f164a529e8ca] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:59:51.489051 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-952bdb0e-6f9f-440b-9e27-1f7527fd4ff7 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:51.489542 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-952bdb0e-6f9f-440b-9e27-1f7527fd4ff7 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:51.490507 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-952bdb0e-6f9f-440b-9e27-1f7527fd4ff7 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:51.491244 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-952bdb0e-6f9f-440b-9e27-1f7527fd4ff7 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:51.491701 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-952bdb0e-6f9f-440b-9e27-1f7527fd4ff7 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:51.492178 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-952bdb0e-6f9f-440b-9e27-1f7527fd4ff7 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:51.526424 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-952bdb0e-6f9f-440b-9e27-1f7527fd4ff7 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] 10.222.0.60 "GET /compute/v2.1/servers/5851ba25-8bf7-4e7e-8609-f164a529e8ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052241 Sep 14 09:59:51.527233 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3975/7375] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 14 09:59:51 2022] GET /compute/v2.1/servers/5851ba25-8bf7-4e7e-8609-f164a529e8ca/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:59:52.540610 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-928caf97-f285-47c5-9be7-d9ea9e6bbc2f tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:59:52.542907 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-928caf97-f285-47c5-9be7-d9ea9e6bbc2f tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] [instance: 5851ba25-8bf7-4e7e-8609-f164a529e8ca] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:59:52.549861 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-928caf97-f285-47c5-9be7-d9ea9e6bbc2f tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:52.550361 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-928caf97-f285-47c5-9be7-d9ea9e6bbc2f tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:52.550814 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-928caf97-f285-47c5-9be7-d9ea9e6bbc2f tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:52.551552 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-928caf97-f285-47c5-9be7-d9ea9e6bbc2f tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:52.552031 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-928caf97-f285-47c5-9be7-d9ea9e6bbc2f tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:52.552476 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-928caf97-f285-47c5-9be7-d9ea9e6bbc2f tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:52.583974 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-928caf97-f285-47c5-9be7-d9ea9e6bbc2f tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] 10.222.0.60 "GET /compute/v2.1/servers/5851ba25-8bf7-4e7e-8609-f164a529e8ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048645 Sep 14 09:59:52.584574 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3401/7376] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 14 09:59:52 2022] GET /compute/v2.1/servers/5851ba25-8bf7-4e7e-8609-f164a529e8ca/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:59:53.596808 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-6274eb7e-f929-4613-a37c-52928aaf00ea tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:59:53.599497 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-6274eb7e-f929-4613-a37c-52928aaf00ea tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] [instance: 5851ba25-8bf7-4e7e-8609-f164a529e8ca] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:59:53.607073 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6274eb7e-f929-4613-a37c-52928aaf00ea tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:53.607631 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6274eb7e-f929-4613-a37c-52928aaf00ea tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:53.608131 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6274eb7e-f929-4613-a37c-52928aaf00ea tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:53.608824 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6274eb7e-f929-4613-a37c-52928aaf00ea tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:53.609275 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6274eb7e-f929-4613-a37c-52928aaf00ea tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:53.609698 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6274eb7e-f929-4613-a37c-52928aaf00ea tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:53.639241 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-6274eb7e-f929-4613-a37c-52928aaf00ea tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] 10.222.0.60 "GET /compute/v2.1/servers/5851ba25-8bf7-4e7e-8609-f164a529e8ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046568 Sep 14 09:59:53.639814 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3976/7377] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 14 09:59:53 2022] GET /compute/v2.1/servers/5851ba25-8bf7-4e7e-8609-f164a529e8ca/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:59:54.652322 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d17072d6-0c2b-4531-b47e-fc2c24a24866 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:59:54.655284 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-d17072d6-0c2b-4531-b47e-fc2c24a24866 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] [instance: 5851ba25-8bf7-4e7e-8609-f164a529e8ca] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:59:54.662455 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d17072d6-0c2b-4531-b47e-fc2c24a24866 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:54.663097 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d17072d6-0c2b-4531-b47e-fc2c24a24866 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:54.663556 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d17072d6-0c2b-4531-b47e-fc2c24a24866 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:54.664268 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d17072d6-0c2b-4531-b47e-fc2c24a24866 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:54.664737 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d17072d6-0c2b-4531-b47e-fc2c24a24866 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:54.665177 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d17072d6-0c2b-4531-b47e-fc2c24a24866 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:54.695391 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-d17072d6-0c2b-4531-b47e-fc2c24a24866 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] 10.222.0.60 "GET /compute/v2.1/servers/5851ba25-8bf7-4e7e-8609-f164a529e8ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047255 Sep 14 09:59:54.695970 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3402/7378] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 14 09:59:54 2022] GET /compute/v2.1/servers/5851ba25-8bf7-4e7e-8609-f164a529e8ca/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:59:55.707948 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-96b1ac3c-9285-49a5-8804-31aa728fcee9 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:59:55.710172 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-96b1ac3c-9285-49a5-8804-31aa728fcee9 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] [instance: 5851ba25-8bf7-4e7e-8609-f164a529e8ca] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:59:55.717624 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-96b1ac3c-9285-49a5-8804-31aa728fcee9 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:55.718116 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-96b1ac3c-9285-49a5-8804-31aa728fcee9 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:55.718570 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-96b1ac3c-9285-49a5-8804-31aa728fcee9 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:55.719294 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-96b1ac3c-9285-49a5-8804-31aa728fcee9 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:55.719765 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-96b1ac3c-9285-49a5-8804-31aa728fcee9 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:55.720196 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-96b1ac3c-9285-49a5-8804-31aa728fcee9 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:55.748589 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-96b1ac3c-9285-49a5-8804-31aa728fcee9 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] 10.222.0.60 "GET /compute/v2.1/servers/5851ba25-8bf7-4e7e-8609-f164a529e8ca/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044696 Sep 14 09:59:55.749151 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3977/7379] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Sep 14 09:59:55 2022] GET /compute/v2.1/servers/5851ba25-8bf7-4e7e-8609-f164a529e8ca/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 09:59:55.759916 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-fecbf767-04c3-42ef-bb9b-e333a032318a tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:59:55.760459 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-fecbf767-04c3-42ef-bb9b-e333a032318a tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] [instance: 5851ba25-8bf7-4e7e-8609-f164a529e8ca] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:59:55.768166 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fecbf767-04c3-42ef-bb9b-e333a032318a tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:55.768668 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fecbf767-04c3-42ef-bb9b-e333a032318a tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:55.769121 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fecbf767-04c3-42ef-bb9b-e333a032318a tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:55.769824 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fecbf767-04c3-42ef-bb9b-e333a032318a tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:55.770291 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fecbf767-04c3-42ef-bb9b-e333a032318a tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:55.770729 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fecbf767-04c3-42ef-bb9b-e333a032318a tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:55.845899 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-fecbf767-04c3-42ef-bb9b-e333a032318a tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] HTTP exception thrown: Instance 5851ba25-8bf7-4e7e-8609-f164a529e8ca is not attached to volume 8e29e17b-83ff-4f63-a306-173853396f40 Sep 14 09:59:55.848162 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-fecbf767-04c3-42ef-bb9b-e333a032318a tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Request method failure captured: Sep 14 09:59:55.848162 n-d-836830-18 devstack@n-api.service[128758]: request: DELETE /compute/v2.1/servers/5851ba25-8bf7-4e7e-8609-f164a529e8ca/os-volume_attachments/8e29e17b-83ff-4f63-a306-173853396f40 HTTP/1.1 Sep 14 09:59:55.848162 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 09:59:55.848162 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 09:59:55.848162 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 09:59:55.848162 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 09:59:55.848162 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 09:59:55.848162 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 09:59:55.848162 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 09:59:55.848162 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 09:59:55.848162 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIaS5TyfTtg0yHewiyDcnS6v8_MAYI33o2Mi_UNVwZ9OWFRX3Ngx8QY_wcOpgD2X3MSnI2n0CJTtylxnWXwR24mmOLc4S1x4KV39Bu_q3EUVMIwhwISESH4t9iKGNZvNFAcTNA1h3aFh04-8aGYbeTj_aPqf2lC7ho8nuQhoA9WXTdPk Sep 14 09:59:55.848162 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 09:59:55.848162 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 09:59:55.848162 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 09:59:55.848162 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 09:59:55.848162 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 09:59:55.848162 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 09:59:55.848162 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: dd6bde0c922b436f8e144b8a6feefebe Sep 14 09:59:55.848162 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-TestMinimumBasicScenario-880850400 Sep 14 09:59:55.848162 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 09:59:55.848162 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 09:59:55.848162 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/dd6bde0c922b436f8e144b8a6feefebe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_dd6bde0c922b436f8e144b8a6feefebe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/dd6bde0c922b436f8e144b8a6feefebe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/dd6bde0c922b436f8e144b8a6feefebe"}]}] Sep 14 09:59:55.848162 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-TestMinimumBasicScenario-880850400 Sep 14 09:59:55.848162 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: dd6bde0c922b436f8e144b8a6feefebe Sep 14 09:59:55.848162 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-TestMinimumBasicScenario-880850400 Sep 14 09:59:55.848162 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-TestMinimumBasicScenario-880850400-project Sep 14 09:59:55.848162 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 09:59:55.848162 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 09:59:55.848162 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 02916df7dbfa4ba9b40ff2c0d162ce4f Sep 14 09:59:55.848162 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-TestMinimumBasicScenario-880850400-project Sep 14 09:59:55.848162 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 09:59:55.848162 n-d-836830-18 devstack@n-api.service[128758]: exception: Instance 5851ba25-8bf7-4e7e-8609-f164a529e8ca is not attached to volume 8e29e17b-83ff-4f63-a306-173853396f40 Sep 14 09:59:55.848162 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'server_id': '5851ba25-8bf7-4e7e-8609-f164a529e8ca', 'id': '8e29e17b-83ff-4f63-a306-173853396f40'} Sep 14 09:59:55.848162 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:59:55.848162 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:59:55.848162 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 14 09:59:55.848162 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 14 09:59:55.848162 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 14 09:59:55.848162 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 14 09:59:55.848162 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 14 09:59:55.848162 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 14 09:59:55.848162 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 8e29e17b-83ff-4f63-a306-173853396f40. Sep 14 09:59:55.848162 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:59:55.848162 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:59:55.848162 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:59:55.848162 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:59:55.848162 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:59:55.848162 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:59:55.848162 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:59:55.848162 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:59:55.848162 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:59:55.848162 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:59:55.848162 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 14 09:59:55.848162 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 14 09:59:55.848162 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5851ba25-8bf7-4e7e-8609-f164a529e8ca is not attached to volume 8e29e17b-83ff-4f63-a306-173853396f40 Sep 14 09:59:55.848162 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:59:55.848162 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:59:55.848162 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:59:55.848162 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:59:55.848162 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:59:55.848162 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:59:55.853359 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:59:55.853359 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:59:55.853359 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5851ba25-8bf7-4e7e-8609-f164a529e8ca is not attached to volume 8e29e17b-83ff-4f63-a306-173853396f40 Sep 14 09:59:55.853359 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 09:59:55.853359 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-fecbf767-04c3-42ef-bb9b-e333a032318a tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Returning 404 to user: Instance 5851ba25-8bf7-4e7e-8609-f164a529e8ca is not attached to volume 8e29e17b-83ff-4f63-a306-173853396f40 {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:59:55.853359 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-fecbf767-04c3-42ef-bb9b-e333a032318a tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] 10.222.0.60 "DELETE /compute/v2.1/servers/5851ba25-8bf7-4e7e-8609-f164a529e8ca/os-volume_attachments/8e29e17b-83ff-4f63-a306-173853396f40" status: 404 len: 154 microversion: 2.1 time: 0.093819 Sep 14 09:59:55.853359 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3403/7380] 10.222.0.60 () {58 vars in 1416 bytes} [Wed Sep 14 09:59:55 2022] DELETE /compute/v2.1/servers/5851ba25-8bf7-4e7e-8609-f164a529e8ca/os-volume_attachments/8e29e17b-83ff-4f63-a306-173853396f40 => generated 154 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:59:59.104506 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-4e0e04e6-0f36-4761-be91-015059f2c93f tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:59:59.105085 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-4e0e04e6-0f36-4761-be91-015059f2c93f tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] [instance: 5851ba25-8bf7-4e7e-8609-f164a529e8ca] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:59:59.112485 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4e0e04e6-0f36-4761-be91-015059f2c93f tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:59.112990 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4e0e04e6-0f36-4761-be91-015059f2c93f tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:59.113431 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4e0e04e6-0f36-4761-be91-015059f2c93f tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:59.114192 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4e0e04e6-0f36-4761-be91-015059f2c93f tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:59.114657 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4e0e04e6-0f36-4761-be91-015059f2c93f tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:59.115130 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4e0e04e6-0f36-4761-be91-015059f2c93f tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:59.143953 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-4e0e04e6-0f36-4761-be91-015059f2c93f tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] [instance: 5851ba25-8bf7-4e7e-8609-f164a529e8ca] Going to try to terminate instance {{(pid=128759) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:59:59.231907 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-4e0e04e6-0f36-4761-be91-015059f2c93f tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] 10.222.0.60 "DELETE /compute/v2.1/servers/5851ba25-8bf7-4e7e-8609-f164a529e8ca" status: 204 len: 0 microversion: 2.1 time: 0.130785 Sep 14 09:59:59.232734 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3978/7381] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 09:59:59 2022] DELETE /compute/v2.1/servers/5851ba25-8bf7-4e7e-8609-f164a529e8ca => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:59:59.241195 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-7c59e22e-8c3a-4e14-a1c2-7347d4d32095 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:59:59.241834 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-7c59e22e-8c3a-4e14-a1c2-7347d4d32095 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] [instance: 5851ba25-8bf7-4e7e-8609-f164a529e8ca] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:59:59.249943 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7c59e22e-8c3a-4e14-a1c2-7347d4d32095 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:59.250445 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7c59e22e-8c3a-4e14-a1c2-7347d4d32095 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:59.250903 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7c59e22e-8c3a-4e14-a1c2-7347d4d32095 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:59.251636 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7c59e22e-8c3a-4e14-a1c2-7347d4d32095 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:59.252107 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7c59e22e-8c3a-4e14-a1c2-7347d4d32095 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:59.252548 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7c59e22e-8c3a-4e14-a1c2-7347d4d32095 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:59.387854 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-7c59e22e-8c3a-4e14-a1c2-7347d4d32095 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02916df7dbfa4ba9b40ff2c0d162ce4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6bde0c922b436f8e144b8a6feefebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:59:59.396120 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-7c59e22e-8c3a-4e14-a1c2-7347d4d32095 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] 10.222.0.60 "GET /compute/v2.1/servers/5851ba25-8bf7-4e7e-8609-f164a529e8ca" status: 200 len: 1553 microversion: 2.1 time: 0.158808 Sep 14 09:59:59.396795 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3404/7382] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 09:59:59 2022] GET /compute/v2.1/servers/5851ba25-8bf7-4e7e-8609-f164a529e8ca => generated 1553 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:00:00.420762 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f5f0683d-73c3-456f-99c0-e2069d8fa8d0 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:00:00.421489 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f5f0683d-73c3-456f-99c0-e2069d8fa8d0 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] [instance: 5851ba25-8bf7-4e7e-8609-f164a529e8ca] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:00:00.429459 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f5f0683d-73c3-456f-99c0-e2069d8fa8d0 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:00:00.429953 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f5f0683d-73c3-456f-99c0-e2069d8fa8d0 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:00:00.430400 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f5f0683d-73c3-456f-99c0-e2069d8fa8d0 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:00:00.431136 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f5f0683d-73c3-456f-99c0-e2069d8fa8d0 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:00:00.431600 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f5f0683d-73c3-456f-99c0-e2069d8fa8d0 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:00:00.432040 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f5f0683d-73c3-456f-99c0-e2069d8fa8d0 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:00:00.559416 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f5f0683d-73c3-456f-99c0-e2069d8fa8d0 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02916df7dbfa4ba9b40ff2c0d162ce4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6bde0c922b436f8e144b8a6feefebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:00:00.568276 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f5f0683d-73c3-456f-99c0-e2069d8fa8d0 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] 10.222.0.60 "GET /compute/v2.1/servers/5851ba25-8bf7-4e7e-8609-f164a529e8ca" status: 200 len: 1553 microversion: 2.1 time: 0.151876 Sep 14 10:00:00.568862 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3979/7383] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:00:00 2022] GET /compute/v2.1/servers/5851ba25-8bf7-4e7e-8609-f164a529e8ca => generated 1553 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:00:01.348325 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-1bcf104c-a903-4349-98b2-5b3ff9de6a17 req-dd63b44c-a863-4c50-afb3-e5cf7080783f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5851ba25-8bf7-4e7e-8609-f164a529e8ca", "name": "network-vif-deleted", "tag": "bb324d8a-748f-49ca-a08f-7d0649ba352a"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:00:01.363841 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-1bcf104c-a903-4349-98b2-5b3ff9de6a17 req-dd63b44c-a863-4c50-afb3-e5cf7080783f service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:00:01.365114 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-1bcf104c-a903-4349-98b2-5b3ff9de6a17 req-dd63b44c-a863-4c50-afb3-e5cf7080783f service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:00:01.366008 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-1bcf104c-a903-4349-98b2-5b3ff9de6a17 req-dd63b44c-a863-4c50-afb3-e5cf7080783f service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:00:01.379374 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-1bcf104c-a903-4349-98b2-5b3ff9de6a17 req-dd63b44c-a863-4c50-afb3-e5cf7080783f service nova] Creating event network-vif-deleted:bb324d8a-748f-49ca-a08f-7d0649ba352a for instance 5851ba25-8bf7-4e7e-8609-f164a529e8ca on n-h2-836830-18 Sep 14 10:00:01.385117 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-1bcf104c-a903-4349-98b2-5b3ff9de6a17 req-dd63b44c-a863-4c50-afb3-e5cf7080783f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042458 Sep 14 10:00:01.385737 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3405/7384] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 10:00:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:00:01.593233 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-16f4248a-a534-4a42-9a39-d0fb83c83c8a tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:00:01.593866 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-16f4248a-a534-4a42-9a39-d0fb83c83c8a tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] [instance: 5851ba25-8bf7-4e7e-8609-f164a529e8ca] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:00:01.601216 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-16f4248a-a534-4a42-9a39-d0fb83c83c8a tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:00:01.601709 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-16f4248a-a534-4a42-9a39-d0fb83c83c8a tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:00:01.602155 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-16f4248a-a534-4a42-9a39-d0fb83c83c8a tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:00:01.602884 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-16f4248a-a534-4a42-9a39-d0fb83c83c8a tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:00:01.603380 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-16f4248a-a534-4a42-9a39-d0fb83c83c8a tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:00:01.603794 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-16f4248a-a534-4a42-9a39-d0fb83c83c8a tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:00:01.638332 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-16f4248a-a534-4a42-9a39-d0fb83c83c8a tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:00:01.638836 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-16f4248a-a534-4a42-9a39-d0fb83c83c8a tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:00:01.639315 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-16f4248a-a534-4a42-9a39-d0fb83c83c8a tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:00:01.639789 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.objects.instance [None req-16f4248a-a534-4a42-9a39-d0fb83c83c8a tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lazy-loading 'fault' on Instance uuid 5851ba25-8bf7-4e7e-8609-f164a529e8ca {{(pid=128759) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 10:00:01.684708 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-16f4248a-a534-4a42-9a39-d0fb83c83c8a tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02916df7dbfa4ba9b40ff2c0d162ce4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6bde0c922b436f8e144b8a6feefebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:00:01.692932 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-16f4248a-a534-4a42-9a39-d0fb83c83c8a tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] 10.222.0.60 "GET /compute/v2.1/servers/5851ba25-8bf7-4e7e-8609-f164a529e8ca" status: 200 len: 1348 microversion: 2.1 time: 0.104300 Sep 14 10:00:01.693526 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3980/7385] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:00:01 2022] GET /compute/v2.1/servers/5851ba25-8bf7-4e7e-8609-f164a529e8ca => generated 1348 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:00:02.717902 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b11a17e5-128f-4596-b18d-bc2874034d12 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:00:02.718557 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-b11a17e5-128f-4596-b18d-bc2874034d12 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] [instance: 5851ba25-8bf7-4e7e-8609-f164a529e8ca] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:00:02.726017 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b11a17e5-128f-4596-b18d-bc2874034d12 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:00:02.726524 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b11a17e5-128f-4596-b18d-bc2874034d12 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:00:02.726994 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b11a17e5-128f-4596-b18d-bc2874034d12 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:00:02.727708 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b11a17e5-128f-4596-b18d-bc2874034d12 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:00:02.728180 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b11a17e5-128f-4596-b18d-bc2874034d12 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:00:02.728626 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b11a17e5-128f-4596-b18d-bc2874034d12 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:00:02.741936 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-b11a17e5-128f-4596-b18d-bc2874034d12 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] HTTP exception thrown: Instance 5851ba25-8bf7-4e7e-8609-f164a529e8ca could not be found. Sep 14 10:00:02.743599 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b11a17e5-128f-4596-b18d-bc2874034d12 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Request method failure captured: Sep 14 10:00:02.743599 n-d-836830-18 devstack@n-api.service[128758]: request: GET /compute/v2.1/servers/5851ba25-8bf7-4e7e-8609-f164a529e8ca HTTP/1.1 Sep 14 10:00:02.743599 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 10:00:02.743599 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 10:00:02.743599 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 10:00:02.743599 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 10:00:02.743599 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 10:00:02.743599 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 10:00:02.743599 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 10:00:02.743599 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 10:00:02.743599 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIaS5TyfTtg0yHewiyDcnS6v8_MAYI33o2Mi_UNVwZ9OWFRX3Ngx8QY_wcOpgD2X3MSnI2n0CJTtylxnWXwR24mmOLc4S1x4KV39Bu_q3EUVMIwhwISESH4t9iKGNZvNFAcTNA1h3aFh04-8aGYbeTj_aPqf2lC7ho8nuQhoA9WXTdPk Sep 14 10:00:02.743599 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 10:00:02.743599 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 10:00:02.743599 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 10:00:02.743599 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 10:00:02.743599 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 10:00:02.743599 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 10:00:02.743599 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: dd6bde0c922b436f8e144b8a6feefebe Sep 14 10:00:02.743599 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-TestMinimumBasicScenario-880850400 Sep 14 10:00:02.743599 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 10:00:02.743599 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 10:00:02.743599 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/dd6bde0c922b436f8e144b8a6feefebe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_dd6bde0c922b436f8e144b8a6feefebe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/dd6bde0c922b436f8e144b8a6feefebe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/dd6bde0c922b436f8e144b8a6feefebe"}]}] Sep 14 10:00:02.743599 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-TestMinimumBasicScenario-880850400 Sep 14 10:00:02.743599 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: dd6bde0c922b436f8e144b8a6feefebe Sep 14 10:00:02.743599 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-TestMinimumBasicScenario-880850400 Sep 14 10:00:02.743599 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-TestMinimumBasicScenario-880850400-project Sep 14 10:00:02.743599 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 10:00:02.743599 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 10:00:02.743599 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 02916df7dbfa4ba9b40ff2c0d162ce4f Sep 14 10:00:02.743599 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-TestMinimumBasicScenario-880850400-project Sep 14 10:00:02.743599 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 10:00:02.743599 n-d-836830-18 devstack@n-api.service[128758]: exception: Instance 5851ba25-8bf7-4e7e-8609-f164a529e8ca could not be found. Sep 14 10:00:02.743599 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': '5851ba25-8bf7-4e7e-8609-f164a529e8ca'} Sep 14 10:00:02.743599 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 10:00:02.743599 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:00:02.743599 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 10:00:02.743599 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 10:00:02.743599 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 10:00:02.743599 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 10:00:02.743599 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 10:00:02.743599 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 10:00:02.743599 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 10:00:02.743599 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 10:00:02.743599 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5851ba25-8bf7-4e7e-8609-f164a529e8ca could not be found. Sep 14 10:00:02.743599 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 10:00:02.743599 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:00:02.743599 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 10:00:02.743599 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:00:02.743599 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:00:02.743599 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:00:02.743599 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 10:00:02.743599 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 10:00:02.743599 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 10:00:02.743599 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 10:00:02.743599 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 10:00:02.743599 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 10:00:02.743599 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 10:00:02.743599 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 10:00:02.743599 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 10:00:02.743599 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 10:00:02.743599 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5851ba25-8bf7-4e7e-8609-f164a529e8ca could not be found. Sep 14 10:00:02.743599 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 10:00:02.743599 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:00:02.743599 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 10:00:02.748547 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:00:02.748547 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:00:02.748547 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:00:02.748547 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 10:00:02.748547 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 10:00:02.748547 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5851ba25-8bf7-4e7e-8609-f164a529e8ca could not be found. Sep 14 10:00:02.748547 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 10:00:02.748547 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b11a17e5-128f-4596-b18d-bc2874034d12 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Returning 404 to user: Instance 5851ba25-8bf7-4e7e-8609-f164a529e8ca could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 10:00:02.748547 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-b11a17e5-128f-4596-b18d-bc2874034d12 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] 10.222.0.60 "GET /compute/v2.1/servers/5851ba25-8bf7-4e7e-8609-f164a529e8ca" status: 404 len: 111 microversion: 2.1 time: 0.031541 Sep 14 10:00:02.748547 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3406/7386] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:00:02 2022] GET /compute/v2.1/servers/5851ba25-8bf7-4e7e-8609-f164a529e8ca => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 10:00:02.754468 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8fd3ab10-a2ff-4040-be29-4237d7bbe0c8 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] Calling method '.version_select at 0x7f7d3fdff3a0>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:00:02.775218 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-8fd3ab10-a2ff-4040-be29-4237d7bbe0c8 tempest-TestMinimumBasicScenario-880850400 tempest-TestMinimumBasicScenario-880850400-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1523601232" status: 202 len: 0 microversion: 2.1 time: 0.024545 Sep 14 10:00:02.775800 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3981/7387] 10.222.0.60 () {58 vars in 1272 bytes} [Wed Sep 14 10:00:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1523601232 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 10:00:11.931001 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-3b2ff58c-b608-4580-b3f6-b4bcf1dd6917 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Action: 'create', calling method: .version_select at 0x7f7d3f311820>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-512055857", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCB+ZWv1z9ccdabl8pz/Feju2prqfEsgSYN4HUZPEeqkWuhdGlfdUG9E7T4W+bGZBOkDBMaYCIkfsCnCoNr4fLfM568v7UbgY44nnAQ9a6xka+V9xjdJf0bX6oI7Q89hQw=="}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:00:11.947384 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-3b2ff58c-b608-4580-b3f6-b4bcf1dd6917 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Getting quotas for project 1e6b6775bdd84b24bf7a5ce051e30998. Resources: {'key_pairs'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 10:00:11.952513 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-3b2ff58c-b608-4580-b3f6-b4bcf1dd6917 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Getting quotas for user caa0c29696e24390a5492804e0948010 and project 1e6b6775bdd84b24bf7a5ce051e30998. Resources: {'key_pairs'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 10:00:11.978375 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-3b2ff58c-b608-4580-b3f6-b4bcf1dd6917 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.212062 Sep 14 10:00:11.979283 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3407/7388] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Sep 14 10:00:11 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:00:17.858159 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:00:17.858923 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:00:17.862969 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-105a6936-f741-44bc-88cf-9bc425e3cbca tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1475931037", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "networks": [{"uuid": "d9fdb0c7-7f04-4c46-851e-ffe364f0479e"}], "key_name": "tempest-TestNetworkAdvancedServerOps-512055857", "security_groups": [{"name": "tempest-secgroup-smoke-1713984163"}]}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:00:17.979600 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.network.neutron [None req-105a6936-f741-44bc-88cf-9bc425e3cbca tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] validate_networks() for [('d9fdb0c7-7f04-4c46-851e-ffe364f0479e', None, None, None, None, None)] {{(pid=128759) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 10:00:18.460030 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-105a6936-f741-44bc-88cf-9bc425e3cbca tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Flavor limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 10:00:18.460461 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-105a6936-f741-44bc-88cf-9bc425e3cbca tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Image limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 10:00:18.460937 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-105a6936-f741-44bc-88cf-9bc425e3cbca tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Flavor pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 10:00:18.461348 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-105a6936-f741-44bc-88cf-9bc425e3cbca tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Image pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 10:00:18.461781 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-105a6936-f741-44bc-88cf-9bc425e3cbca tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 10:00:18.473645 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-105a6936-f741-44bc-88cf-9bc425e3cbca tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:00:18.474275 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-105a6936-f741-44bc-88cf-9bc425e3cbca tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:00:18.474841 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-105a6936-f741-44bc-88cf-9bc425e3cbca tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:00:18.475895 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-105a6936-f741-44bc-88cf-9bc425e3cbca tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:00:18.476379 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-105a6936-f741-44bc-88cf-9bc425e3cbca tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:00:18.476911 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-105a6936-f741-44bc-88cf-9bc425e3cbca tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:00:18.497836 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-105a6936-f741-44bc-88cf-9bc425e3cbca tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Getting quotas for project 1e6b6775bdd84b24bf7a5ce051e30998. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 10:00:18.503822 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-105a6936-f741-44bc-88cf-9bc425e3cbca tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Getting quotas for user caa0c29696e24390a5492804e0948010 and project 1e6b6775bdd84b24bf7a5ce051e30998. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 10:00:18.518564 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-105a6936-f741-44bc-88cf-9bc425e3cbca tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Going to run 1 instances... {{(pid=128759) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 10:00:18.520232 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-105a6936-f741-44bc-88cf-9bc425e3cbca tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 6a673ce1-ea0b-4552-b0ea-c00aa6fbaaa9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128759) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 10:00:18.581419 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-105a6936-f741-44bc-88cf-9bc425e3cbca tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.725204 Sep 14 10:00:18.583391 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3982/7389] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 10:00:17 2022] POST /compute/v2.1/servers => generated 406 bytes in 728 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 10:00:18.591279 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=43,nova_cell1:INSERT=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:00:18.598044 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-2bafcd49-dccc-4e1a-9bbe-9fdfa6dae25d tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:00:18.599252 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-2bafcd49-dccc-4e1a-9bbe-9fdfa6dae25d tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 6a673ce1-ea0b-4552-b0ea-c00aa6fbaaa9] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:00:18.607141 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:00:18.687690 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-2bafcd49-dccc-4e1a-9bbe-9fdfa6dae25d tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0c29696e24390a5492804e0948010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6b6775bdd84b24bf7a5ce051e30998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:00:18.701035 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-2bafcd49-dccc-4e1a-9bbe-9fdfa6dae25d tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "GET /compute/v2.1/servers/6a673ce1-ea0b-4552-b0ea-c00aa6fbaaa9" status: 200 len: 1266 microversion: 2.1 time: 0.111113 Sep 14 10:00:18.702076 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3408/7390] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:00:18 2022] GET /compute/v2.1/servers/6a673ce1-ea0b-4552-b0ea-c00aa6fbaaa9 => generated 1266 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:00:19.725442 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-71b921eb-4a6f-43a2-9b43-11b3cc7d4e66 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:00:19.726733 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-71b921eb-4a6f-43a2-9b43-11b3cc7d4e66 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 6a673ce1-ea0b-4552-b0ea-c00aa6fbaaa9] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:00:19.738647 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-71b921eb-4a6f-43a2-9b43-11b3cc7d4e66 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:00:19.739405 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-71b921eb-4a6f-43a2-9b43-11b3cc7d4e66 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:00:19.740026 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-71b921eb-4a6f-43a2-9b43-11b3cc7d4e66 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:00:19.740960 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-71b921eb-4a6f-43a2-9b43-11b3cc7d4e66 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:00:19.741641 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-71b921eb-4a6f-43a2-9b43-11b3cc7d4e66 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:00:19.742244 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-71b921eb-4a6f-43a2-9b43-11b3cc7d4e66 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:00:19.813883 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-71b921eb-4a6f-43a2-9b43-11b3cc7d4e66 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0c29696e24390a5492804e0948010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6b6775bdd84b24bf7a5ce051e30998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:00:19.823489 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-71b921eb-4a6f-43a2-9b43-11b3cc7d4e66 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "GET /compute/v2.1/servers/6a673ce1-ea0b-4552-b0ea-c00aa6fbaaa9" status: 200 len: 1326 microversion: 2.1 time: 0.102786 Sep 14 10:00:19.839473 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3983/7391] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:00:19 2022] GET /compute/v2.1/servers/6a673ce1-ea0b-4552-b0ea-c00aa6fbaaa9 => generated 1326 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:00:20.850597 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ef32bd4f-9973-4b39-b47a-604ec89f3aa2 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:00:20.852099 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-ef32bd4f-9973-4b39-b47a-604ec89f3aa2 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 6a673ce1-ea0b-4552-b0ea-c00aa6fbaaa9] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:00:20.860771 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ef32bd4f-9973-4b39-b47a-604ec89f3aa2 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:00:20.861517 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ef32bd4f-9973-4b39-b47a-604ec89f3aa2 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:00:20.862167 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ef32bd4f-9973-4b39-b47a-604ec89f3aa2 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:00:20.863134 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ef32bd4f-9973-4b39-b47a-604ec89f3aa2 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:00:20.863617 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ef32bd4f-9973-4b39-b47a-604ec89f3aa2 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:00:20.864063 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ef32bd4f-9973-4b39-b47a-604ec89f3aa2 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:00:21.031268 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-ef32bd4f-9973-4b39-b47a-604ec89f3aa2 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0c29696e24390a5492804e0948010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6b6775bdd84b24bf7a5ce051e30998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:00:21.039969 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-ef32bd4f-9973-4b39-b47a-604ec89f3aa2 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "GET /compute/v2.1/servers/6a673ce1-ea0b-4552-b0ea-c00aa6fbaaa9" status: 200 len: 1392 microversion: 2.1 time: 0.193849 Sep 14 10:00:21.040646 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3409/7392] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:00:20 2022] GET /compute/v2.1/servers/6a673ce1-ea0b-4552-b0ea-c00aa6fbaaa9 => generated 1392 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:00:21.636960 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-bf97c98b-6889-407f-ad9c-d69092b1f5fd req-a3d50ad5-acad-4dec-b981-2b906346351d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a673ce1-ea0b-4552-b0ea-c00aa6fbaaa9", "tag": "10811c94-78e6-4965-b66c-a432c6c782ac"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:00:21.648385 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-bf97c98b-6889-407f-ad9c-d69092b1f5fd req-a3d50ad5-acad-4dec-b981-2b906346351d service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:00:21.649128 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-bf97c98b-6889-407f-ad9c-d69092b1f5fd req-a3d50ad5-acad-4dec-b981-2b906346351d service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:00:21.649759 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-bf97c98b-6889-407f-ad9c-d69092b1f5fd req-a3d50ad5-acad-4dec-b981-2b906346351d service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:00:21.663097 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-bf97c98b-6889-407f-ad9c-d69092b1f5fd req-a3d50ad5-acad-4dec-b981-2b906346351d service nova] Creating event network-changed:10811c94-78e6-4965-b66c-a432c6c782ac for instance 6a673ce1-ea0b-4552-b0ea-c00aa6fbaaa9 on n-h1-836830-18 Sep 14 10:00:21.667974 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-bf97c98b-6889-407f-ad9c-d69092b1f5fd req-a3d50ad5-acad-4dec-b981-2b906346351d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034663 Sep 14 10:00:21.668564 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3984/7393] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 10:00:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 10:00:22.066005 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-5a2fdc91-7d07-492e-8d7f-b78c8461748c tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:00:22.067275 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-5a2fdc91-7d07-492e-8d7f-b78c8461748c tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 6a673ce1-ea0b-4552-b0ea-c00aa6fbaaa9] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:00:22.074345 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5a2fdc91-7d07-492e-8d7f-b78c8461748c tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:00:22.075381 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5a2fdc91-7d07-492e-8d7f-b78c8461748c tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:00:22.076096 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5a2fdc91-7d07-492e-8d7f-b78c8461748c tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:00:22.077115 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5a2fdc91-7d07-492e-8d7f-b78c8461748c tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:00:22.077602 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5a2fdc91-7d07-492e-8d7f-b78c8461748c tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:00:22.078110 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5a2fdc91-7d07-492e-8d7f-b78c8461748c tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:00:22.220742 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-5a2fdc91-7d07-492e-8d7f-b78c8461748c tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0c29696e24390a5492804e0948010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6b6775bdd84b24bf7a5ce051e30998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:00:22.228884 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-5a2fdc91-7d07-492e-8d7f-b78c8461748c tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "GET /compute/v2.1/servers/6a673ce1-ea0b-4552-b0ea-c00aa6fbaaa9" status: 200 len: 1392 microversion: 2.1 time: 0.168214 Sep 14 10:00:22.229482 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3410/7394] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:00:22 2022] GET /compute/v2.1/servers/6a673ce1-ea0b-4552-b0ea-c00aa6fbaaa9 => generated 1392 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:00:23.253498 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-590c9337-c233-47d7-891a-93b4f7006eb9 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:00:23.254141 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-590c9337-c233-47d7-891a-93b4f7006eb9 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 6a673ce1-ea0b-4552-b0ea-c00aa6fbaaa9] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:00:23.260452 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-590c9337-c233-47d7-891a-93b4f7006eb9 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:00:23.260941 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-590c9337-c233-47d7-891a-93b4f7006eb9 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:00:23.261386 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-590c9337-c233-47d7-891a-93b4f7006eb9 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:00:23.262083 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-590c9337-c233-47d7-891a-93b4f7006eb9 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:00:23.263082 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-590c9337-c233-47d7-891a-93b4f7006eb9 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:00:23.263521 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-590c9337-c233-47d7-891a-93b4f7006eb9 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:00:23.405847 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-590c9337-c233-47d7-891a-93b4f7006eb9 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0c29696e24390a5492804e0948010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6b6775bdd84b24bf7a5ce051e30998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:00:23.413606 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-590c9337-c233-47d7-891a-93b4f7006eb9 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "GET /compute/v2.1/servers/6a673ce1-ea0b-4552-b0ea-c00aa6fbaaa9" status: 200 len: 1392 microversion: 2.1 time: 0.165343 Sep 14 10:00:23.414191 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3985/7395] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:00:23 2022] GET /compute/v2.1/servers/6a673ce1-ea0b-4552-b0ea-c00aa6fbaaa9 => generated 1392 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:00:24.437773 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-db3fadf6-02f9-4343-a0a1-05894960bda8 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:00:24.438404 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-db3fadf6-02f9-4343-a0a1-05894960bda8 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 6a673ce1-ea0b-4552-b0ea-c00aa6fbaaa9] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:00:24.445191 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-db3fadf6-02f9-4343-a0a1-05894960bda8 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:00:24.445725 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-db3fadf6-02f9-4343-a0a1-05894960bda8 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:00:24.446182 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-db3fadf6-02f9-4343-a0a1-05894960bda8 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:00:24.447290 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-db3fadf6-02f9-4343-a0a1-05894960bda8 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:00:24.447765 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-db3fadf6-02f9-4343-a0a1-05894960bda8 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:00:24.448207 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-db3fadf6-02f9-4343-a0a1-05894960bda8 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:00:24.579316 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-db3fadf6-02f9-4343-a0a1-05894960bda8 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0c29696e24390a5492804e0948010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6b6775bdd84b24bf7a5ce051e30998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:00:24.587249 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-db3fadf6-02f9-4343-a0a1-05894960bda8 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "GET /compute/v2.1/servers/6a673ce1-ea0b-4552-b0ea-c00aa6fbaaa9" status: 200 len: 1392 microversion: 2.1 time: 0.154137 Sep 14 10:00:24.587846 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3411/7396] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:00:24 2022] GET /compute/v2.1/servers/6a673ce1-ea0b-4552-b0ea-c00aa6fbaaa9 => generated 1392 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:00:25.610416 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-60e606b5-4f3f-4fde-b990-07fe10eb360d tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:00:25.611064 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-60e606b5-4f3f-4fde-b990-07fe10eb360d tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 6a673ce1-ea0b-4552-b0ea-c00aa6fbaaa9] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:00:25.618016 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-60e606b5-4f3f-4fde-b990-07fe10eb360d tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:00:25.618509 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-60e606b5-4f3f-4fde-b990-07fe10eb360d tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:00:25.618987 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-60e606b5-4f3f-4fde-b990-07fe10eb360d tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:00:25.619683 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-60e606b5-4f3f-4fde-b990-07fe10eb360d tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:00:25.620141 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-60e606b5-4f3f-4fde-b990-07fe10eb360d tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:00:25.620571 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-60e606b5-4f3f-4fde-b990-07fe10eb360d tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:00:25.756222 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-60e606b5-4f3f-4fde-b990-07fe10eb360d tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0c29696e24390a5492804e0948010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6b6775bdd84b24bf7a5ce051e30998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:00:25.764747 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-60e606b5-4f3f-4fde-b990-07fe10eb360d tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "GET /compute/v2.1/servers/6a673ce1-ea0b-4552-b0ea-c00aa6fbaaa9" status: 200 len: 1392 microversion: 2.1 time: 0.158273 Sep 14 10:00:25.765328 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3986/7397] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:00:25 2022] GET /compute/v2.1/servers/6a673ce1-ea0b-4552-b0ea-c00aa6fbaaa9 => generated 1392 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:00:26.788339 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-2bd74282-909c-4021-8e4f-7b04b74c559f tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:00:26.788965 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-2bd74282-909c-4021-8e4f-7b04b74c559f tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 6a673ce1-ea0b-4552-b0ea-c00aa6fbaaa9] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:00:26.796370 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2bd74282-909c-4021-8e4f-7b04b74c559f tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:00:26.796868 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2bd74282-909c-4021-8e4f-7b04b74c559f tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:00:26.797319 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2bd74282-909c-4021-8e4f-7b04b74c559f tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:00:26.798023 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2bd74282-909c-4021-8e4f-7b04b74c559f tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:00:26.798487 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2bd74282-909c-4021-8e4f-7b04b74c559f tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:00:26.798926 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2bd74282-909c-4021-8e4f-7b04b74c559f tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:00:26.932485 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-2bd74282-909c-4021-8e4f-7b04b74c559f tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0c29696e24390a5492804e0948010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6b6775bdd84b24bf7a5ce051e30998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:00:26.940276 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-2bd74282-909c-4021-8e4f-7b04b74c559f tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "GET /compute/v2.1/servers/6a673ce1-ea0b-4552-b0ea-c00aa6fbaaa9" status: 200 len: 1392 microversion: 2.1 time: 0.155870 Sep 14 10:00:26.940852 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3412/7398] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:00:26 2022] GET /compute/v2.1/servers/6a673ce1-ea0b-4552-b0ea-c00aa6fbaaa9 => generated 1392 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:00:27.965394 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-96489be7-28f4-41ed-8629-9be8e92941c7 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:00:27.966022 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-96489be7-28f4-41ed-8629-9be8e92941c7 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 6a673ce1-ea0b-4552-b0ea-c00aa6fbaaa9] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:00:27.973168 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-96489be7-28f4-41ed-8629-9be8e92941c7 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:00:27.973658 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-96489be7-28f4-41ed-8629-9be8e92941c7 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:00:27.974103 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-96489be7-28f4-41ed-8629-9be8e92941c7 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:00:27.974795 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-96489be7-28f4-41ed-8629-9be8e92941c7 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:00:27.975293 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-96489be7-28f4-41ed-8629-9be8e92941c7 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:00:27.975725 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-96489be7-28f4-41ed-8629-9be8e92941c7 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:00:28.114676 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-96489be7-28f4-41ed-8629-9be8e92941c7 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0c29696e24390a5492804e0948010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6b6775bdd84b24bf7a5ce051e30998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:00:28.123318 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-96489be7-28f4-41ed-8629-9be8e92941c7 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "GET /compute/v2.1/servers/6a673ce1-ea0b-4552-b0ea-c00aa6fbaaa9" status: 200 len: 1392 microversion: 2.1 time: 0.161927 Sep 14 10:00:28.123906 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3987/7399] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:00:27 2022] GET /compute/v2.1/servers/6a673ce1-ea0b-4552-b0ea-c00aa6fbaaa9 => generated 1392 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:00:28.188809 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-9cbef56a-ab6c-4a66-81bd-aefbe95d584d req-97dfe13f-3cca-4571-9563-9ac3c62ca6c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a673ce1-ea0b-4552-b0ea-c00aa6fbaaa9", "name": "network-vif-plugged", "status": "completed", "tag": "10811c94-78e6-4965-b66c-a432c6c782ac"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:00:28.199235 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-9cbef56a-ab6c-4a66-81bd-aefbe95d584d req-97dfe13f-3cca-4571-9563-9ac3c62ca6c3 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:00:28.199741 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-9cbef56a-ab6c-4a66-81bd-aefbe95d584d req-97dfe13f-3cca-4571-9563-9ac3c62ca6c3 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:00:28.200190 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-9cbef56a-ab6c-4a66-81bd-aefbe95d584d req-97dfe13f-3cca-4571-9563-9ac3c62ca6c3 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:00:28.212119 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-9cbef56a-ab6c-4a66-81bd-aefbe95d584d req-97dfe13f-3cca-4571-9563-9ac3c62ca6c3 service nova] Creating event network-vif-plugged:10811c94-78e6-4965-b66c-a432c6c782ac for instance 6a673ce1-ea0b-4552-b0ea-c00aa6fbaaa9 on n-h1-836830-18 Sep 14 10:00:28.217630 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-9cbef56a-ab6c-4a66-81bd-aefbe95d584d req-97dfe13f-3cca-4571-9563-9ac3c62ca6c3 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032578 Sep 14 10:00:28.218422 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3413/7400] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 10:00:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:00:29.145829 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d0c4a176-b2e5-4ad9-8d21-e67f697308f5 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:00:29.146484 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-d0c4a176-b2e5-4ad9-8d21-e67f697308f5 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 6a673ce1-ea0b-4552-b0ea-c00aa6fbaaa9] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:00:29.148483 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=2 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:00:29.149155 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=6 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:00:29.156470 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d0c4a176-b2e5-4ad9-8d21-e67f697308f5 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:00:29.156963 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d0c4a176-b2e5-4ad9-8d21-e67f697308f5 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:00:29.157410 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d0c4a176-b2e5-4ad9-8d21-e67f697308f5 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:00:29.158106 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d0c4a176-b2e5-4ad9-8d21-e67f697308f5 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:00:29.158566 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d0c4a176-b2e5-4ad9-8d21-e67f697308f5 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:00:29.159027 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d0c4a176-b2e5-4ad9-8d21-e67f697308f5 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:00:29.289574 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-d0c4a176-b2e5-4ad9-8d21-e67f697308f5 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0c29696e24390a5492804e0948010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6b6775bdd84b24bf7a5ce051e30998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:00:29.297363 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d0c4a176-b2e5-4ad9-8d21-e67f697308f5 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "GET /compute/v2.1/servers/6a673ce1-ea0b-4552-b0ea-c00aa6fbaaa9" status: 200 len: 1392 microversion: 2.1 time: 0.155482 Sep 14 10:00:29.297945 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3988/7401] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:00:29 2022] GET /compute/v2.1/servers/6a673ce1-ea0b-4552-b0ea-c00aa6fbaaa9 => generated 1392 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:00:30.318364 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=6 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:00:30.323459 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a52a0d2c-ce75-4ca4-b1b5-e8b57f7f2e59 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:00:30.324198 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-a52a0d2c-ce75-4ca4-b1b5-e8b57f7f2e59 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 6a673ce1-ea0b-4552-b0ea-c00aa6fbaaa9] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:00:30.330725 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a52a0d2c-ce75-4ca4-b1b5-e8b57f7f2e59 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:00:30.332401 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a52a0d2c-ce75-4ca4-b1b5-e8b57f7f2e59 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:00:30.332401 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a52a0d2c-ce75-4ca4-b1b5-e8b57f7f2e59 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:00:30.332636 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a52a0d2c-ce75-4ca4-b1b5-e8b57f7f2e59 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:00:30.333094 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a52a0d2c-ce75-4ca4-b1b5-e8b57f7f2e59 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:00:30.333360 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a52a0d2c-ce75-4ca4-b1b5-e8b57f7f2e59 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:00:30.467616 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-a52a0d2c-ce75-4ca4-b1b5-e8b57f7f2e59 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0c29696e24390a5492804e0948010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6b6775bdd84b24bf7a5ce051e30998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:00:30.475896 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-a52a0d2c-ce75-4ca4-b1b5-e8b57f7f2e59 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "GET /compute/v2.1/servers/6a673ce1-ea0b-4552-b0ea-c00aa6fbaaa9" status: 200 len: 1565 microversion: 2.1 time: 0.158567 Sep 14 10:00:30.476475 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3414/7402] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:00:30 2022] GET /compute/v2.1/servers/6a673ce1-ea0b-4552-b0ea-c00aa6fbaaa9 => generated 1565 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:00:30.498347 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8191bdb7-bc28-4bda-a297-849a0518c373 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:00:30.498992 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-8191bdb7-bc28-4bda-a297-849a0518c373 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 6a673ce1-ea0b-4552-b0ea-c00aa6fbaaa9] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:00:30.505551 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8191bdb7-bc28-4bda-a297-849a0518c373 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:00:30.506042 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8191bdb7-bc28-4bda-a297-849a0518c373 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:00:30.506485 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8191bdb7-bc28-4bda-a297-849a0518c373 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:00:30.507249 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8191bdb7-bc28-4bda-a297-849a0518c373 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:00:30.507715 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8191bdb7-bc28-4bda-a297-849a0518c373 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:00:30.508178 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8191bdb7-bc28-4bda-a297-849a0518c373 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:00:30.649300 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-8191bdb7-bc28-4bda-a297-849a0518c373 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0c29696e24390a5492804e0948010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6b6775bdd84b24bf7a5ce051e30998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:00:30.657085 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-8191bdb7-bc28-4bda-a297-849a0518c373 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "GET /compute/v2.1/servers/6a673ce1-ea0b-4552-b0ea-c00aa6fbaaa9" status: 200 len: 1565 microversion: 2.1 time: 0.162651 Sep 14 10:00:30.657678 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3989/7403] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:00:30 2022] GET /compute/v2.1/servers/6a673ce1-ea0b-4552-b0ea-c00aa6fbaaa9 => generated 1565 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:00:32.493646 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-2dd526ef-6cfd-4000-94da-2618b22eb15d tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:00:32.494649 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-2dd526ef-6cfd-4000-94da-2618b22eb15d tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 6a673ce1-ea0b-4552-b0ea-c00aa6fbaaa9] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:00:32.495615 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-420ff349-d4bf-4728-9473-d105788597a0 req-8d42d86e-1d8d-40bf-b058-609c0695cc4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a673ce1-ea0b-4552-b0ea-c00aa6fbaaa9", "tag": "10811c94-78e6-4965-b66c-a432c6c782ac"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:00:32.502552 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2dd526ef-6cfd-4000-94da-2618b22eb15d tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:00:32.503383 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2dd526ef-6cfd-4000-94da-2618b22eb15d tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:00:32.504066 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2dd526ef-6cfd-4000-94da-2618b22eb15d tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:00:32.504855 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2dd526ef-6cfd-4000-94da-2618b22eb15d tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:00:32.505326 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2dd526ef-6cfd-4000-94da-2618b22eb15d tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:00:32.505767 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2dd526ef-6cfd-4000-94da-2618b22eb15d tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:00:32.506809 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-420ff349-d4bf-4728-9473-d105788597a0 req-8d42d86e-1d8d-40bf-b058-609c0695cc4e service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:00:32.507395 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-420ff349-d4bf-4728-9473-d105788597a0 req-8d42d86e-1d8d-40bf-b058-609c0695cc4e service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:00:32.507913 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-420ff349-d4bf-4728-9473-d105788597a0 req-8d42d86e-1d8d-40bf-b058-609c0695cc4e service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:00:32.520473 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-420ff349-d4bf-4728-9473-d105788597a0 req-8d42d86e-1d8d-40bf-b058-609c0695cc4e service nova] Creating event network-changed:10811c94-78e6-4965-b66c-a432c6c782ac for instance 6a673ce1-ea0b-4552-b0ea-c00aa6fbaaa9 on n-h1-836830-18 Sep 14 10:00:32.525998 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-420ff349-d4bf-4728-9473-d105788597a0 req-8d42d86e-1d8d-40bf-b058-609c0695cc4e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034256 Sep 14 10:00:32.526839 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3990/7404] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 10:00:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:00:32.646022 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-2dd526ef-6cfd-4000-94da-2618b22eb15d tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0c29696e24390a5492804e0948010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6b6775bdd84b24bf7a5ce051e30998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:00:32.655200 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-2dd526ef-6cfd-4000-94da-2618b22eb15d tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "GET /compute/v2.1/servers/6a673ce1-ea0b-4552-b0ea-c00aa6fbaaa9" status: 200 len: 1565 microversion: 2.1 time: 0.165896 Sep 14 10:00:32.656129 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3415/7405] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:00:32 2022] GET /compute/v2.1/servers/6a673ce1-ea0b-4552-b0ea-c00aa6fbaaa9 => generated 1565 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:01:05.015419 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-57f8d9c0-d776-450a-b28e-419ad09160d3 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:01:05.017786 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-57f8d9c0-d776-450a-b28e-419ad09160d3 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 6a673ce1-ea0b-4552-b0ea-c00aa6fbaaa9] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:01:05.020157 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:01:05.020844 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=42 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:01:05.026980 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-57f8d9c0-d776-450a-b28e-419ad09160d3 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:05.027468 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-57f8d9c0-d776-450a-b28e-419ad09160d3 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:05.027915 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-57f8d9c0-d776-450a-b28e-419ad09160d3 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:05.028622 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-57f8d9c0-d776-450a-b28e-419ad09160d3 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:05.029094 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-57f8d9c0-d776-450a-b28e-419ad09160d3 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:05.030031 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-57f8d9c0-d776-450a-b28e-419ad09160d3 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:05.102080 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-57f8d9c0-d776-450a-b28e-419ad09160d3 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "POST /compute/v2.1/servers/6a673ce1-ea0b-4552-b0ea-c00aa6fbaaa9/action" status: 200 len: 24568 microversion: 2.1 time: 0.091165 Sep 14 10:01:05.102765 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3991/7406] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 10:01:05 2022] POST /compute/v2.1/servers/6a673ce1-ea0b-4552-b0ea-c00aa6fbaaa9/action => generated 24568 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 10:01:35.344972 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=17 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:01:35.345771 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=38 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:01:35.346866 n-d-836830-18 devstack@n-api.service[128758]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 10:01:35.347214 n-d-836830-18 devstack@n-api.service[128758]: Wed Sep 14 10:01:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6a673ce1-ea0b-4552-b0ea-c00aa6fbaaa9/action (ip 10.222.0.60) !!! Sep 14 10:01:35.353676 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-2749783b-0ef0-4c5e-a12e-abd446a9f3fc tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:01:35.354234 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-2749783b-0ef0-4c5e-a12e-abd446a9f3fc tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 6a673ce1-ea0b-4552-b0ea-c00aa6fbaaa9] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:01:35.366768 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2749783b-0ef0-4c5e-a12e-abd446a9f3fc tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:35.367299 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2749783b-0ef0-4c5e-a12e-abd446a9f3fc tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:35.367754 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2749783b-0ef0-4c5e-a12e-abd446a9f3fc tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:35.368462 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2749783b-0ef0-4c5e-a12e-abd446a9f3fc tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:35.368936 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2749783b-0ef0-4c5e-a12e-abd446a9f3fc tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:35.369412 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2749783b-0ef0-4c5e-a12e-abd446a9f3fc tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:35.438329 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-2749783b-0ef0-4c5e-a12e-abd446a9f3fc tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "POST /compute/v2.1/servers/6a673ce1-ea0b-4552-b0ea-c00aa6fbaaa9/action" status: 202 len: 0 microversion: 2.1 time: 0.094959 Sep 14 10:01:35.439073 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3416/7407] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 10:01:35 2022] POST /compute/v2.1/servers/6a673ce1-ea0b-4552-b0ea-c00aa6fbaaa9/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 10:01:35.448298 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-80034223-d62a-4b4b-a418-36408528b310 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:01:35.449011 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-80034223-d62a-4b4b-a418-36408528b310 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 6a673ce1-ea0b-4552-b0ea-c00aa6fbaaa9] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:01:35.451575 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=2 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:01:35.452568 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=4 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:01:35.460341 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-80034223-d62a-4b4b-a418-36408528b310 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:35.460822 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-80034223-d62a-4b4b-a418-36408528b310 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:35.461274 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-80034223-d62a-4b4b-a418-36408528b310 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:35.461966 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-80034223-d62a-4b4b-a418-36408528b310 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:35.462418 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-80034223-d62a-4b4b-a418-36408528b310 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:35.462840 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-80034223-d62a-4b4b-a418-36408528b310 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:35.681647 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-80034223-d62a-4b4b-a418-36408528b310 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0c29696e24390a5492804e0948010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6b6775bdd84b24bf7a5ce051e30998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:01:35.689625 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-80034223-d62a-4b4b-a418-36408528b310 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "GET /compute/v2.1/servers/6a673ce1-ea0b-4552-b0ea-c00aa6fbaaa9" status: 200 len: 1688 microversion: 2.1 time: 0.245884 Sep 14 10:01:35.692712 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3992/7408] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:01:35 2022] GET /compute/v2.1/servers/6a673ce1-ea0b-4552-b0ea-c00aa6fbaaa9 => generated 1688 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:01:36.719571 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1050dfd4-3182-4f04-93ef-f254f615b075 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:01:36.720332 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-1050dfd4-3182-4f04-93ef-f254f615b075 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 6a673ce1-ea0b-4552-b0ea-c00aa6fbaaa9] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:01:36.726893 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1050dfd4-3182-4f04-93ef-f254f615b075 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:36.727442 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1050dfd4-3182-4f04-93ef-f254f615b075 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:36.727903 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1050dfd4-3182-4f04-93ef-f254f615b075 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:36.728622 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1050dfd4-3182-4f04-93ef-f254f615b075 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:36.729100 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1050dfd4-3182-4f04-93ef-f254f615b075 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:36.729550 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1050dfd4-3182-4f04-93ef-f254f615b075 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:36.862232 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-1050dfd4-3182-4f04-93ef-f254f615b075 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0c29696e24390a5492804e0948010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6b6775bdd84b24bf7a5ce051e30998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:01:36.870055 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-1050dfd4-3182-4f04-93ef-f254f615b075 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "GET /compute/v2.1/servers/6a673ce1-ea0b-4552-b0ea-c00aa6fbaaa9" status: 200 len: 1668 microversion: 2.1 time: 0.156252 Sep 14 10:01:36.870634 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3417/7409] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:01:36 2022] GET /compute/v2.1/servers/6a673ce1-ea0b-4552-b0ea-c00aa6fbaaa9 => generated 1668 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:01:37.963926 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3f1cb1b1-89ef-4092-b0f7-a65bc33d64b5 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:01:37.966202 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-3f1cb1b1-89ef-4092-b0f7-a65bc33d64b5 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 6a673ce1-ea0b-4552-b0ea-c00aa6fbaaa9] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:01:37.974771 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3f1cb1b1-89ef-4092-b0f7-a65bc33d64b5 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:37.975301 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3f1cb1b1-89ef-4092-b0f7-a65bc33d64b5 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:37.975740 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3f1cb1b1-89ef-4092-b0f7-a65bc33d64b5 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:37.976429 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3f1cb1b1-89ef-4092-b0f7-a65bc33d64b5 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:37.976886 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3f1cb1b1-89ef-4092-b0f7-a65bc33d64b5 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:37.977319 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3f1cb1b1-89ef-4092-b0f7-a65bc33d64b5 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:38.045477 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-3f1cb1b1-89ef-4092-b0f7-a65bc33d64b5 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "POST /compute/v2.1/servers/6a673ce1-ea0b-4552-b0ea-c00aa6fbaaa9/action" status: 200 len: 32642 microversion: 2.1 time: 0.084805 Sep 14 10:01:38.046151 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3993/7410] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 10:01:37 2022] POST /compute/v2.1/servers/6a673ce1-ea0b-4552-b0ea-c00aa6fbaaa9/action => generated 32642 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 10:01:38.057901 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-f82b47ed-215d-4e2b-9b65-828de162223d tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:01:38.058465 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-f82b47ed-215d-4e2b-9b65-828de162223d tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 6a673ce1-ea0b-4552-b0ea-c00aa6fbaaa9] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:01:38.065592 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f82b47ed-215d-4e2b-9b65-828de162223d tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:38.066086 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f82b47ed-215d-4e2b-9b65-828de162223d tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:38.066544 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f82b47ed-215d-4e2b-9b65-828de162223d tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:38.067298 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f82b47ed-215d-4e2b-9b65-828de162223d tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:38.067804 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f82b47ed-215d-4e2b-9b65-828de162223d tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:38.068249 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f82b47ed-215d-4e2b-9b65-828de162223d tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:38.145169 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-f82b47ed-215d-4e2b-9b65-828de162223d tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "POST /compute/v2.1/servers/6a673ce1-ea0b-4552-b0ea-c00aa6fbaaa9/action" status: 202 len: 0 microversion: 2.1 time: 0.091072 Sep 14 10:01:38.145924 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3418/7411] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 10:01:38 2022] POST /compute/v2.1/servers/6a673ce1-ea0b-4552-b0ea-c00aa6fbaaa9/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 10:01:38.155290 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e25e9716-187a-4262-b2e9-0c8c8b913197 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:01:38.156172 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e25e9716-187a-4262-b2e9-0c8c8b913197 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 6a673ce1-ea0b-4552-b0ea-c00aa6fbaaa9] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:01:38.164203 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e25e9716-187a-4262-b2e9-0c8c8b913197 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:38.164791 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e25e9716-187a-4262-b2e9-0c8c8b913197 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:38.165148 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e25e9716-187a-4262-b2e9-0c8c8b913197 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:38.165895 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e25e9716-187a-4262-b2e9-0c8c8b913197 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:38.166357 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e25e9716-187a-4262-b2e9-0c8c8b913197 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:38.166787 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e25e9716-187a-4262-b2e9-0c8c8b913197 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:38.305833 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-e25e9716-187a-4262-b2e9-0c8c8b913197 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0c29696e24390a5492804e0948010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6b6775bdd84b24bf7a5ce051e30998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:01:38.313673 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e25e9716-187a-4262-b2e9-0c8c8b913197 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "GET /compute/v2.1/servers/6a673ce1-ea0b-4552-b0ea-c00aa6fbaaa9" status: 200 len: 1675 microversion: 2.1 time: 0.163278 Sep 14 10:01:38.314261 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3994/7412] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:01:38 2022] GET /compute/v2.1/servers/6a673ce1-ea0b-4552-b0ea-c00aa6fbaaa9 => generated 1675 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:01:39.340239 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-9b5a4e7f-97da-4382-944f-587b3f202bfd tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:01:39.340960 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-9b5a4e7f-97da-4382-944f-587b3f202bfd tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 6a673ce1-ea0b-4552-b0ea-c00aa6fbaaa9] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:01:39.347190 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9b5a4e7f-97da-4382-944f-587b3f202bfd tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:39.347686 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9b5a4e7f-97da-4382-944f-587b3f202bfd tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:39.348388 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9b5a4e7f-97da-4382-944f-587b3f202bfd tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:39.349090 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9b5a4e7f-97da-4382-944f-587b3f202bfd tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:39.349553 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9b5a4e7f-97da-4382-944f-587b3f202bfd tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:39.349990 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9b5a4e7f-97da-4382-944f-587b3f202bfd tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:39.485000 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-9b5a4e7f-97da-4382-944f-587b3f202bfd tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0c29696e24390a5492804e0948010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6b6775bdd84b24bf7a5ce051e30998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:01:39.492926 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-9b5a4e7f-97da-4382-944f-587b3f202bfd tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "GET /compute/v2.1/servers/6a673ce1-ea0b-4552-b0ea-c00aa6fbaaa9" status: 200 len: 1683 microversion: 2.1 time: 0.157838 Sep 14 10:01:39.493513 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3419/7413] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:01:39 2022] GET /compute/v2.1/servers/6a673ce1-ea0b-4552-b0ea-c00aa6fbaaa9 => generated 1683 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:01:39.593208 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ecc9017f-1db6-4b2f-934c-55484ce2ea72 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:01:39.595581 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-ecc9017f-1db6-4b2f-934c-55484ce2ea72 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 6a673ce1-ea0b-4552-b0ea-c00aa6fbaaa9] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:01:39.603571 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ecc9017f-1db6-4b2f-934c-55484ce2ea72 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:39.604063 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ecc9017f-1db6-4b2f-934c-55484ce2ea72 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:39.604509 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ecc9017f-1db6-4b2f-934c-55484ce2ea72 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:39.605200 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ecc9017f-1db6-4b2f-934c-55484ce2ea72 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:39.605657 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ecc9017f-1db6-4b2f-934c-55484ce2ea72 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:39.606088 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ecc9017f-1db6-4b2f-934c-55484ce2ea72 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:39.667003 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-ecc9017f-1db6-4b2f-934c-55484ce2ea72 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "POST /compute/v2.1/servers/6a673ce1-ea0b-4552-b0ea-c00aa6fbaaa9/action" status: 200 len: 38517 microversion: 2.1 time: 0.078102 Sep 14 10:01:39.667647 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3995/7414] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 10:01:39 2022] POST /compute/v2.1/servers/6a673ce1-ea0b-4552-b0ea-c00aa6fbaaa9/action => generated 38517 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 10:01:40.639354 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-7976a7f2-3b8c-4670-a419-b6c8dddf96fc tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:01:40.645216 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-7cb72764-2254-4934-8367-c9f16858b687 req-2edeb9e7-bc5f-45b2-a37c-da9969b9a2d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a673ce1-ea0b-4552-b0ea-c00aa6fbaaa9", "tag": "10811c94-78e6-4965-b66c-a432c6c782ac"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:01:40.645733 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-7976a7f2-3b8c-4670-a419-b6c8dddf96fc tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 6a673ce1-ea0b-4552-b0ea-c00aa6fbaaa9] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:01:40.653099 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7976a7f2-3b8c-4670-a419-b6c8dddf96fc tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:40.653614 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7976a7f2-3b8c-4670-a419-b6c8dddf96fc tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:40.655147 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7976a7f2-3b8c-4670-a419-b6c8dddf96fc tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:40.655420 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7976a7f2-3b8c-4670-a419-b6c8dddf96fc tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:40.655901 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7976a7f2-3b8c-4670-a419-b6c8dddf96fc tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:40.656354 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7976a7f2-3b8c-4670-a419-b6c8dddf96fc tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:40.657428 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-7cb72764-2254-4934-8367-c9f16858b687 req-2edeb9e7-bc5f-45b2-a37c-da9969b9a2d6 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:40.657920 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-7cb72764-2254-4934-8367-c9f16858b687 req-2edeb9e7-bc5f-45b2-a37c-da9969b9a2d6 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:40.658358 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-7cb72764-2254-4934-8367-c9f16858b687 req-2edeb9e7-bc5f-45b2-a37c-da9969b9a2d6 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:40.669977 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-7cb72764-2254-4934-8367-c9f16858b687 req-2edeb9e7-bc5f-45b2-a37c-da9969b9a2d6 service nova] Creating event network-changed:10811c94-78e6-4965-b66c-a432c6c782ac for instance 6a673ce1-ea0b-4552-b0ea-c00aa6fbaaa9 on n-h1-836830-18 Sep 14 10:01:40.675616 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-7cb72764-2254-4934-8367-c9f16858b687 req-2edeb9e7-bc5f-45b2-a37c-da9969b9a2d6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034321 Sep 14 10:01:40.676617 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3996/7415] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 10:01:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:01:40.684512 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-7976a7f2-3b8c-4670-a419-b6c8dddf96fc tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 6a673ce1-ea0b-4552-b0ea-c00aa6fbaaa9] Going to try to terminate instance {{(pid=128758) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 10:01:40.767377 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-7976a7f2-3b8c-4670-a419-b6c8dddf96fc tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "DELETE /compute/v2.1/servers/6a673ce1-ea0b-4552-b0ea-c00aa6fbaaa9" status: 204 len: 0 microversion: 2.1 time: 0.132144 Sep 14 10:01:40.768316 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3420/7416] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 10:01:40 2022] DELETE /compute/v2.1/servers/6a673ce1-ea0b-4552-b0ea-c00aa6fbaaa9 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 10:01:40.777626 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-1330ac7f-c5ba-49cc-8ffb-4a59dd092f6d tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:01:40.778346 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-1330ac7f-c5ba-49cc-8ffb-4a59dd092f6d tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 6a673ce1-ea0b-4552-b0ea-c00aa6fbaaa9] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:01:40.786058 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1330ac7f-c5ba-49cc-8ffb-4a59dd092f6d tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:40.786556 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1330ac7f-c5ba-49cc-8ffb-4a59dd092f6d tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:40.787027 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1330ac7f-c5ba-49cc-8ffb-4a59dd092f6d tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:40.787737 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1330ac7f-c5ba-49cc-8ffb-4a59dd092f6d tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:40.788207 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1330ac7f-c5ba-49cc-8ffb-4a59dd092f6d tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:40.788633 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-1330ac7f-c5ba-49cc-8ffb-4a59dd092f6d tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:40.931389 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-1330ac7f-c5ba-49cc-8ffb-4a59dd092f6d tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0c29696e24390a5492804e0948010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6b6775bdd84b24bf7a5ce051e30998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:01:40.939702 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-1330ac7f-c5ba-49cc-8ffb-4a59dd092f6d tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "GET /compute/v2.1/servers/6a673ce1-ea0b-4552-b0ea-c00aa6fbaaa9" status: 200 len: 1689 microversion: 2.1 time: 0.166822 Sep 14 10:01:40.940275 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3997/7417] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:01:40 2022] GET /compute/v2.1/servers/6a673ce1-ea0b-4552-b0ea-c00aa6fbaaa9 => generated 1689 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:01:41.964865 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-219404be-1c3a-45df-9cdc-ee501a17ff13 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:01:41.965528 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-219404be-1c3a-45df-9cdc-ee501a17ff13 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 6a673ce1-ea0b-4552-b0ea-c00aa6fbaaa9] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:01:41.973228 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-219404be-1c3a-45df-9cdc-ee501a17ff13 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:41.973731 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-219404be-1c3a-45df-9cdc-ee501a17ff13 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:41.974190 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-219404be-1c3a-45df-9cdc-ee501a17ff13 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:41.974908 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-219404be-1c3a-45df-9cdc-ee501a17ff13 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:41.975414 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-219404be-1c3a-45df-9cdc-ee501a17ff13 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:41.975861 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-219404be-1c3a-45df-9cdc-ee501a17ff13 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:42.110215 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-219404be-1c3a-45df-9cdc-ee501a17ff13 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0c29696e24390a5492804e0948010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6b6775bdd84b24bf7a5ce051e30998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:01:42.118143 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-219404be-1c3a-45df-9cdc-ee501a17ff13 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "GET /compute/v2.1/servers/6a673ce1-ea0b-4552-b0ea-c00aa6fbaaa9" status: 200 len: 1689 microversion: 2.1 time: 0.157728 Sep 14 10:01:42.118721 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3421/7418] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:01:41 2022] GET /compute/v2.1/servers/6a673ce1-ea0b-4552-b0ea-c00aa6fbaaa9 => generated 1689 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:01:43.108032 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-774787d9-7062-4fe9-a0e5-ff2600918e7c req-da40ad1b-56d4-440a-8e74-e5aa112008bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a673ce1-ea0b-4552-b0ea-c00aa6fbaaa9", "name": "network-vif-deleted", "tag": "10811c94-78e6-4965-b66c-a432c6c782ac"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:01:43.120011 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-774787d9-7062-4fe9-a0e5-ff2600918e7c req-da40ad1b-56d4-440a-8e74-e5aa112008bc service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:43.120490 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-774787d9-7062-4fe9-a0e5-ff2600918e7c req-da40ad1b-56d4-440a-8e74-e5aa112008bc service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:43.120926 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-774787d9-7062-4fe9-a0e5-ff2600918e7c req-da40ad1b-56d4-440a-8e74-e5aa112008bc service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:43.134651 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-774787d9-7062-4fe9-a0e5-ff2600918e7c req-da40ad1b-56d4-440a-8e74-e5aa112008bc service nova] Creating event network-vif-deleted:10811c94-78e6-4965-b66c-a432c6c782ac for instance 6a673ce1-ea0b-4552-b0ea-c00aa6fbaaa9 on n-h1-836830-18 Sep 14 10:01:43.142872 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-e8f1125d-0a51-4d97-86fd-34007dda9395 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:01:43.143563 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-e8f1125d-0a51-4d97-86fd-34007dda9395 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 6a673ce1-ea0b-4552-b0ea-c00aa6fbaaa9] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:01:43.143749 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-774787d9-7062-4fe9-a0e5-ff2600918e7c req-da40ad1b-56d4-440a-8e74-e5aa112008bc service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039383 Sep 14 10:01:43.144548 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3998/7419] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 10:01:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:01:43.150568 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e8f1125d-0a51-4d97-86fd-34007dda9395 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:43.151129 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e8f1125d-0a51-4d97-86fd-34007dda9395 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:43.151590 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e8f1125d-0a51-4d97-86fd-34007dda9395 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:43.152310 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e8f1125d-0a51-4d97-86fd-34007dda9395 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:43.152787 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e8f1125d-0a51-4d97-86fd-34007dda9395 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:43.153234 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e8f1125d-0a51-4d97-86fd-34007dda9395 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:43.220938 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-e8f1125d-0a51-4d97-86fd-34007dda9395 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0c29696e24390a5492804e0948010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6b6775bdd84b24bf7a5ce051e30998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:01:43.229175 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-e8f1125d-0a51-4d97-86fd-34007dda9395 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "GET /compute/v2.1/servers/6a673ce1-ea0b-4552-b0ea-c00aa6fbaaa9" status: 200 len: 1351 microversion: 2.1 time: 0.091081 Sep 14 10:01:43.229768 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3422/7420] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:01:43 2022] GET /compute/v2.1/servers/6a673ce1-ea0b-4552-b0ea-c00aa6fbaaa9 => generated 1351 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:01:44.254534 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-5b0d843a-7a36-4894-8ac6-1eea7ebeebc2 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:01:44.255317 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-5b0d843a-7a36-4894-8ac6-1eea7ebeebc2 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 6a673ce1-ea0b-4552-b0ea-c00aa6fbaaa9] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:01:44.261600 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5b0d843a-7a36-4894-8ac6-1eea7ebeebc2 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:44.262095 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5b0d843a-7a36-4894-8ac6-1eea7ebeebc2 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:44.262542 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5b0d843a-7a36-4894-8ac6-1eea7ebeebc2 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:44.263851 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5b0d843a-7a36-4894-8ac6-1eea7ebeebc2 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:44.264322 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5b0d843a-7a36-4894-8ac6-1eea7ebeebc2 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:44.264759 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5b0d843a-7a36-4894-8ac6-1eea7ebeebc2 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:44.278076 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-5b0d843a-7a36-4894-8ac6-1eea7ebeebc2 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] HTTP exception thrown: Instance 6a673ce1-ea0b-4552-b0ea-c00aa6fbaaa9 could not be found. Sep 14 10:01:44.279748 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-5b0d843a-7a36-4894-8ac6-1eea7ebeebc2 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Request method failure captured: Sep 14 10:01:44.279748 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/6a673ce1-ea0b-4552-b0ea-c00aa6fbaaa9 HTTP/1.1 Sep 14 10:01:44.279748 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 10:01:44.279748 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 10:01:44.279748 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 10:01:44.279748 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 10:01:44.279748 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 10:01:44.279748 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 10:01:44.279748 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 10:01:44.279748 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 10:01:44.279748 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIaYrejhj2TGf9R9N95darLKnnjP7yvAOzzRGk88fUneEcfLJ79TotlbWmaifDlagIOgchpK-W9GG7KW3sgKBKNTQaihdlpQR7nbYvQmmAemQtSyT8HYEWV36tTrgBgWqk_HpFAN-DV62Paaf0wzD9le8cOOWXqmVMqtvFpWKeFSur8Y Sep 14 10:01:44.279748 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 10:01:44.279748 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 10:01:44.279748 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 10:01:44.279748 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 10:01:44.279748 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 10:01:44.279748 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 10:01:44.279748 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 1e6b6775bdd84b24bf7a5ce051e30998 Sep 14 10:01:44.279748 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-722006907 Sep 14 10:01:44.279748 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 10:01:44.279748 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 10:01:44.279748 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/1e6b6775bdd84b24bf7a5ce051e30998"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_1e6b6775bdd84b24bf7a5ce051e30998"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1e6b6775bdd84b24bf7a5ce051e30998"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1e6b6775bdd84b24bf7a5ce051e30998"}]}] Sep 14 10:01:44.279748 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-TestNetworkAdvancedServerOps-722006907 Sep 14 10:01:44.279748 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 1e6b6775bdd84b24bf7a5ce051e30998 Sep 14 10:01:44.279748 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-722006907 Sep 14 10:01:44.279748 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-TestNetworkAdvancedServerOps-722006907-project Sep 14 10:01:44.279748 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 10:01:44.279748 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 10:01:44.279748 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: caa0c29696e24390a5492804e0948010 Sep 14 10:01:44.279748 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-TestNetworkAdvancedServerOps-722006907-project Sep 14 10:01:44.279748 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 10:01:44.279748 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance 6a673ce1-ea0b-4552-b0ea-c00aa6fbaaa9 could not be found. Sep 14 10:01:44.279748 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '6a673ce1-ea0b-4552-b0ea-c00aa6fbaaa9'} Sep 14 10:01:44.279748 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 10:01:44.279748 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:01:44.279748 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 10:01:44.279748 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 10:01:44.279748 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 10:01:44.279748 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 10:01:44.279748 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 10:01:44.279748 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 10:01:44.279748 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 10:01:44.279748 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 10:01:44.279748 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a673ce1-ea0b-4552-b0ea-c00aa6fbaaa9 could not be found. Sep 14 10:01:44.279748 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 10:01:44.279748 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:01:44.279748 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 10:01:44.279748 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:01:44.279748 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:01:44.279748 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:01:44.279748 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 10:01:44.279748 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 10:01:44.279748 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 10:01:44.279748 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 10:01:44.279748 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 10:01:44.279748 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 10:01:44.279748 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 10:01:44.279748 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 10:01:44.279748 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 10:01:44.279748 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 10:01:44.279748 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a673ce1-ea0b-4552-b0ea-c00aa6fbaaa9 could not be found. Sep 14 10:01:44.279748 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 10:01:44.279748 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:01:44.284697 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 10:01:44.284697 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:01:44.284697 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:01:44.284697 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:01:44.284697 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 10:01:44.284697 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 10:01:44.284697 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a673ce1-ea0b-4552-b0ea-c00aa6fbaaa9 could not be found. Sep 14 10:01:44.284697 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 10:01:44.284697 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-5b0d843a-7a36-4894-8ac6-1eea7ebeebc2 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Returning 404 to user: Instance 6a673ce1-ea0b-4552-b0ea-c00aa6fbaaa9 could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 10:01:44.284697 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-5b0d843a-7a36-4894-8ac6-1eea7ebeebc2 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "GET /compute/v2.1/servers/6a673ce1-ea0b-4552-b0ea-c00aa6fbaaa9" status: 404 len: 111 microversion: 2.1 time: 0.031789 Sep 14 10:01:44.284697 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 3999/7421] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:01:44 2022] GET /compute/v2.1/servers/6a673ce1-ea0b-4552-b0ea-c00aa6fbaaa9 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 10:01:47.770662 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-865cf41b-9361-4141-925c-ba7d5c247a5a tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '.version_select at 0x7f7d3f3849d0>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:01:47.798683 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-865cf41b-9361-4141-925c-ba7d5c247a5a tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-512055857" status: 202 len: 0 microversion: 2.1 time: 0.031646 Sep 14 10:01:47.805268 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3423/7422] 10.222.0.60 () {58 vars in 1281 bytes} [Wed Sep 14 10:01:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-512055857 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 10:01:47.825438 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-14f9cb48-bd45-497d-a3ee-b11e8c21d329 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Action: 'create', calling method: .version_select at 0x7f7d3fbe45e0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1464853606", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBArRCaOO1H4BlQOw55DaPpeqYqD+Nb4jFksBHUKsSYFP2a3XcUNxtgHIICo0Icz96oYM7qZbXbxSLCjiSqxzFzR8KNPf9F6TBvS8nI084MyPPFel4MJhIl+aEaHKTx/dJA=="}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:01:47.843956 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-14f9cb48-bd45-497d-a3ee-b11e8c21d329 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Getting quotas for project 1e6b6775bdd84b24bf7a5ce051e30998. Resources: {'key_pairs'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 10:01:47.850578 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-14f9cb48-bd45-497d-a3ee-b11e8c21d329 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Getting quotas for user caa0c29696e24390a5492804e0948010 and project 1e6b6775bdd84b24bf7a5ce051e30998. Resources: {'key_pairs'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 10:01:47.876039 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-14f9cb48-bd45-497d-a3ee-b11e8c21d329 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.055189 Sep 14 10:01:47.883374 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4000/7423] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Sep 14 10:01:47 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:01:53.264521 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-bb303ccb-efe6-4fe2-85b2-90e973bbe324 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1654936382", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "networks": [{"uuid": "0ca81319-030d-4948-99de-c4c650eb7229"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1464853606", "security_groups": [{"name": "tempest-secgroup-smoke-453004220"}]}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:01:53.274453 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:01:53.389084 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.network.neutron [None req-bb303ccb-efe6-4fe2-85b2-90e973bbe324 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] validate_networks() for [('0ca81319-030d-4948-99de-c4c650eb7229', None, None, None, None, None)] {{(pid=128758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 10:01:53.919335 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-bb303ccb-efe6-4fe2-85b2-90e973bbe324 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Flavor limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 10:01:53.919335 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-bb303ccb-efe6-4fe2-85b2-90e973bbe324 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Image limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 10:01:53.919888 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-bb303ccb-efe6-4fe2-85b2-90e973bbe324 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Flavor pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 10:01:53.920322 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-bb303ccb-efe6-4fe2-85b2-90e973bbe324 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Image pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 10:01:53.920760 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-bb303ccb-efe6-4fe2-85b2-90e973bbe324 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 10:01:53.933908 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bb303ccb-efe6-4fe2-85b2-90e973bbe324 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:53.934496 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bb303ccb-efe6-4fe2-85b2-90e973bbe324 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:53.935898 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bb303ccb-efe6-4fe2-85b2-90e973bbe324 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:53.936905 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bb303ccb-efe6-4fe2-85b2-90e973bbe324 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:53.939106 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bb303ccb-efe6-4fe2-85b2-90e973bbe324 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:53.939857 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bb303ccb-efe6-4fe2-85b2-90e973bbe324 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:53.974152 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-bb303ccb-efe6-4fe2-85b2-90e973bbe324 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Getting quotas for project 1e6b6775bdd84b24bf7a5ce051e30998. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 10:01:53.981129 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-bb303ccb-efe6-4fe2-85b2-90e973bbe324 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Getting quotas for user caa0c29696e24390a5492804e0948010 and project 1e6b6775bdd84b24bf7a5ce051e30998. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 10:01:53.996664 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-bb303ccb-efe6-4fe2-85b2-90e973bbe324 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Going to run 1 instances... {{(pid=128758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 10:01:54.000255 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-bb303ccb-efe6-4fe2-85b2-90e973bbe324 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 7f6de8c0-6b9c-4669-8edd-13f26c931386] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 10:01:54.061519 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-bb303ccb-efe6-4fe2-85b2-90e973bbe324 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.801477 Sep 14 10:01:54.062542 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3424/7424] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 10:01:53 2022] POST /compute/v2.1/servers => generated 405 bytes in 803 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 10:01:54.074500 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-980c62fc-26ef-4d32-8a79-b60dafdd199f tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:01:54.083284 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-980c62fc-26ef-4d32-8a79-b60dafdd199f tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 7f6de8c0-6b9c-4669-8edd-13f26c931386] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:01:54.161461 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-980c62fc-26ef-4d32-8a79-b60dafdd199f tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0c29696e24390a5492804e0948010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6b6775bdd84b24bf7a5ce051e30998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:01:54.174963 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-980c62fc-26ef-4d32-8a79-b60dafdd199f tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "GET /compute/v2.1/servers/7f6de8c0-6b9c-4669-8edd-13f26c931386" status: 200 len: 1267 microversion: 2.1 time: 0.105202 Sep 14 10:01:54.175570 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4001/7425] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:01:54 2022] GET /compute/v2.1/servers/7f6de8c0-6b9c-4669-8edd-13f26c931386 => generated 1267 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:01:55.198750 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-7d431f3d-a8d6-43f4-a5f9-ea1a04b81c83 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:01:55.200095 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-7d431f3d-a8d6-43f4-a5f9-ea1a04b81c83 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 7f6de8c0-6b9c-4669-8edd-13f26c931386] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:01:55.217997 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7d431f3d-a8d6-43f4-a5f9-ea1a04b81c83 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:55.218582 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7d431f3d-a8d6-43f4-a5f9-ea1a04b81c83 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:55.220027 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7d431f3d-a8d6-43f4-a5f9-ea1a04b81c83 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:55.222314 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7d431f3d-a8d6-43f4-a5f9-ea1a04b81c83 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:55.224062 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7d431f3d-a8d6-43f4-a5f9-ea1a04b81c83 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:55.224797 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7d431f3d-a8d6-43f4-a5f9-ea1a04b81c83 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:55.332627 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-7d431f3d-a8d6-43f4-a5f9-ea1a04b81c83 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0c29696e24390a5492804e0948010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6b6775bdd84b24bf7a5ce051e30998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:01:55.342182 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-7d431f3d-a8d6-43f4-a5f9-ea1a04b81c83 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "GET /compute/v2.1/servers/7f6de8c0-6b9c-4669-8edd-13f26c931386" status: 200 len: 1327 microversion: 2.1 time: 0.147398 Sep 14 10:01:55.342858 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3425/7426] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:01:55 2022] GET /compute/v2.1/servers/7f6de8c0-6b9c-4669-8edd-13f26c931386 => generated 1327 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:01:56.366778 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-641b355f-79fb-4f89-9e1c-6e89ea21cd95 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:01:56.367613 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-641b355f-79fb-4f89-9e1c-6e89ea21cd95 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 7f6de8c0-6b9c-4669-8edd-13f26c931386] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:01:56.369709 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=32 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:01:56.385122 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-641b355f-79fb-4f89-9e1c-6e89ea21cd95 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:56.387610 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-641b355f-79fb-4f89-9e1c-6e89ea21cd95 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:56.388785 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-641b355f-79fb-4f89-9e1c-6e89ea21cd95 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:56.389604 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-641b355f-79fb-4f89-9e1c-6e89ea21cd95 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:56.390131 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-641b355f-79fb-4f89-9e1c-6e89ea21cd95 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:56.390672 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-641b355f-79fb-4f89-9e1c-6e89ea21cd95 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:56.537727 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-641b355f-79fb-4f89-9e1c-6e89ea21cd95 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0c29696e24390a5492804e0948010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6b6775bdd84b24bf7a5ce051e30998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:01:56.546436 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-641b355f-79fb-4f89-9e1c-6e89ea21cd95 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "GET /compute/v2.1/servers/7f6de8c0-6b9c-4669-8edd-13f26c931386" status: 200 len: 1392 microversion: 2.1 time: 0.184377 Sep 14 10:01:56.547038 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4002/7427] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:01:56 2022] GET /compute/v2.1/servers/7f6de8c0-6b9c-4669-8edd-13f26c931386 => generated 1392 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:01:56.786126 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-f567e60a-bc9d-4fc5-8a23-a1ed4ebfc446 req-d73b83af-82c1-4a07-9224-ebcb03906a98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f6de8c0-6b9c-4669-8edd-13f26c931386", "tag": "883a0bd4-f58d-4f35-902c-e4596d94facd"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:01:56.798155 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-f567e60a-bc9d-4fc5-8a23-a1ed4ebfc446 req-d73b83af-82c1-4a07-9224-ebcb03906a98 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:56.799000 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-f567e60a-bc9d-4fc5-8a23-a1ed4ebfc446 req-d73b83af-82c1-4a07-9224-ebcb03906a98 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:56.799520 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-f567e60a-bc9d-4fc5-8a23-a1ed4ebfc446 req-d73b83af-82c1-4a07-9224-ebcb03906a98 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:56.812094 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-f567e60a-bc9d-4fc5-8a23-a1ed4ebfc446 req-d73b83af-82c1-4a07-9224-ebcb03906a98 service nova] Creating event network-changed:883a0bd4-f58d-4f35-902c-e4596d94facd for instance 7f6de8c0-6b9c-4669-8edd-13f26c931386 on n-h2-836830-18 Sep 14 10:01:56.817269 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-f567e60a-bc9d-4fc5-8a23-a1ed4ebfc446 req-d73b83af-82c1-4a07-9224-ebcb03906a98 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035071 Sep 14 10:01:56.817885 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3426/7428] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 10:01:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:01:57.569793 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-237e7ab8-5aa2-4626-a925-92b086c8d6e7 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:01:57.570378 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-237e7ab8-5aa2-4626-a925-92b086c8d6e7 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 7f6de8c0-6b9c-4669-8edd-13f26c931386] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:01:57.578026 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-237e7ab8-5aa2-4626-a925-92b086c8d6e7 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:57.578522 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-237e7ab8-5aa2-4626-a925-92b086c8d6e7 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:57.579013 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-237e7ab8-5aa2-4626-a925-92b086c8d6e7 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:57.579723 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-237e7ab8-5aa2-4626-a925-92b086c8d6e7 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:57.580220 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-237e7ab8-5aa2-4626-a925-92b086c8d6e7 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:57.580663 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-237e7ab8-5aa2-4626-a925-92b086c8d6e7 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:57.710591 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-237e7ab8-5aa2-4626-a925-92b086c8d6e7 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0c29696e24390a5492804e0948010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6b6775bdd84b24bf7a5ce051e30998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:01:57.718355 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-237e7ab8-5aa2-4626-a925-92b086c8d6e7 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "GET /compute/v2.1/servers/7f6de8c0-6b9c-4669-8edd-13f26c931386" status: 200 len: 1392 microversion: 2.1 time: 0.152627 Sep 14 10:01:57.718931 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4003/7429] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:01:57 2022] GET /compute/v2.1/servers/7f6de8c0-6b9c-4669-8edd-13f26c931386 => generated 1392 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:01:58.742523 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-34d52589-df76-4115-b3f8-d83aa26b7c20 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:01:58.743277 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-34d52589-df76-4115-b3f8-d83aa26b7c20 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 7f6de8c0-6b9c-4669-8edd-13f26c931386] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:01:58.749659 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-34d52589-df76-4115-b3f8-d83aa26b7c20 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:58.750156 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-34d52589-df76-4115-b3f8-d83aa26b7c20 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:58.750611 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-34d52589-df76-4115-b3f8-d83aa26b7c20 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:58.751371 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-34d52589-df76-4115-b3f8-d83aa26b7c20 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:58.751826 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-34d52589-df76-4115-b3f8-d83aa26b7c20 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:58.752270 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-34d52589-df76-4115-b3f8-d83aa26b7c20 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:58.887009 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-34d52589-df76-4115-b3f8-d83aa26b7c20 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0c29696e24390a5492804e0948010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6b6775bdd84b24bf7a5ce051e30998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:01:58.895514 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-34d52589-df76-4115-b3f8-d83aa26b7c20 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "GET /compute/v2.1/servers/7f6de8c0-6b9c-4669-8edd-13f26c931386" status: 200 len: 1392 microversion: 2.1 time: 0.158191 Sep 14 10:01:58.896079 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3427/7430] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:01:58 2022] GET /compute/v2.1/servers/7f6de8c0-6b9c-4669-8edd-13f26c931386 => generated 1392 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:01:59.918074 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-5bed200e-76a3-4b12-bc24-517c850361af tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:01:59.918690 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-5bed200e-76a3-4b12-bc24-517c850361af tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 7f6de8c0-6b9c-4669-8edd-13f26c931386] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:01:59.927275 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5bed200e-76a3-4b12-bc24-517c850361af tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:59.927766 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5bed200e-76a3-4b12-bc24-517c850361af tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:59.928205 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5bed200e-76a3-4b12-bc24-517c850361af tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:59.928896 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5bed200e-76a3-4b12-bc24-517c850361af tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:59.929354 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5bed200e-76a3-4b12-bc24-517c850361af tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:59.929784 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5bed200e-76a3-4b12-bc24-517c850361af tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:00.065784 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-5bed200e-76a3-4b12-bc24-517c850361af tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0c29696e24390a5492804e0948010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6b6775bdd84b24bf7a5ce051e30998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:02:00.073571 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-5bed200e-76a3-4b12-bc24-517c850361af tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "GET /compute/v2.1/servers/7f6de8c0-6b9c-4669-8edd-13f26c931386" status: 200 len: 1392 microversion: 2.1 time: 0.159436 Sep 14 10:02:00.074144 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4004/7431] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:01:59 2022] GET /compute/v2.1/servers/7f6de8c0-6b9c-4669-8edd-13f26c931386 => generated 1392 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:02:01.098447 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-bf289c0d-3aa2-432d-98cc-27bec22e5ed8 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:02:01.099123 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-bf289c0d-3aa2-432d-98cc-27bec22e5ed8 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 7f6de8c0-6b9c-4669-8edd-13f26c931386] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:02:01.107487 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bf289c0d-3aa2-432d-98cc-27bec22e5ed8 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:01.108003 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bf289c0d-3aa2-432d-98cc-27bec22e5ed8 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:01.108466 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bf289c0d-3aa2-432d-98cc-27bec22e5ed8 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:01.109199 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bf289c0d-3aa2-432d-98cc-27bec22e5ed8 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:01.109681 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bf289c0d-3aa2-432d-98cc-27bec22e5ed8 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:01.110128 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-bf289c0d-3aa2-432d-98cc-27bec22e5ed8 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:01.243254 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-bf289c0d-3aa2-432d-98cc-27bec22e5ed8 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0c29696e24390a5492804e0948010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6b6775bdd84b24bf7a5ce051e30998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:02:01.251582 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-bf289c0d-3aa2-432d-98cc-27bec22e5ed8 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "GET /compute/v2.1/servers/7f6de8c0-6b9c-4669-8edd-13f26c931386" status: 200 len: 1392 microversion: 2.1 time: 0.157432 Sep 14 10:02:01.252172 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3428/7432] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:02:01 2022] GET /compute/v2.1/servers/7f6de8c0-6b9c-4669-8edd-13f26c931386 => generated 1392 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:02:02.276147 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f225b27a-92c3-464c-86ff-1d984d73a1f2 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:02:02.276763 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f225b27a-92c3-464c-86ff-1d984d73a1f2 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 7f6de8c0-6b9c-4669-8edd-13f26c931386] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:02:02.283639 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f225b27a-92c3-464c-86ff-1d984d73a1f2 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:02.284128 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f225b27a-92c3-464c-86ff-1d984d73a1f2 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:02.284566 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f225b27a-92c3-464c-86ff-1d984d73a1f2 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:02.285257 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f225b27a-92c3-464c-86ff-1d984d73a1f2 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:02.285712 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f225b27a-92c3-464c-86ff-1d984d73a1f2 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:02.286137 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f225b27a-92c3-464c-86ff-1d984d73a1f2 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:02.421676 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f225b27a-92c3-464c-86ff-1d984d73a1f2 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0c29696e24390a5492804e0948010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6b6775bdd84b24bf7a5ce051e30998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:02:02.429374 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f225b27a-92c3-464c-86ff-1d984d73a1f2 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "GET /compute/v2.1/servers/7f6de8c0-6b9c-4669-8edd-13f26c931386" status: 200 len: 1392 microversion: 2.1 time: 0.157193 Sep 14 10:02:02.429955 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4005/7433] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:02:02 2022] GET /compute/v2.1/servers/7f6de8c0-6b9c-4669-8edd-13f26c931386 => generated 1392 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:02:02.850041 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-c438fd9a-cebd-4eb8-b25a-d0ab69139254 req-0072b600-e6ac-4e52-b5a7-617ae2d566d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f6de8c0-6b9c-4669-8edd-13f26c931386", "name": "network-vif-plugged", "status": "completed", "tag": "883a0bd4-f58d-4f35-902c-e4596d94facd"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:02:02.862504 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-c438fd9a-cebd-4eb8-b25a-d0ab69139254 req-0072b600-e6ac-4e52-b5a7-617ae2d566d1 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:02.863102 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-c438fd9a-cebd-4eb8-b25a-d0ab69139254 req-0072b600-e6ac-4e52-b5a7-617ae2d566d1 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:02.863529 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-c438fd9a-cebd-4eb8-b25a-d0ab69139254 req-0072b600-e6ac-4e52-b5a7-617ae2d566d1 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:02.874777 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-c438fd9a-cebd-4eb8-b25a-d0ab69139254 req-0072b600-e6ac-4e52-b5a7-617ae2d566d1 service nova] Creating event network-vif-plugged:883a0bd4-f58d-4f35-902c-e4596d94facd for instance 7f6de8c0-6b9c-4669-8edd-13f26c931386 on n-h2-836830-18 Sep 14 10:02:02.879783 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-c438fd9a-cebd-4eb8-b25a-d0ab69139254 req-0072b600-e6ac-4e52-b5a7-617ae2d566d1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033799 Sep 14 10:02:02.880399 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3429/7434] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 10:02:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:02:03.453479 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e767b613-c8e8-4995-9a60-f2f4635e4404 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:02:03.454108 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e767b613-c8e8-4995-9a60-f2f4635e4404 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 7f6de8c0-6b9c-4669-8edd-13f26c931386] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:02:03.461037 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e767b613-c8e8-4995-9a60-f2f4635e4404 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:03.461535 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e767b613-c8e8-4995-9a60-f2f4635e4404 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:03.461989 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e767b613-c8e8-4995-9a60-f2f4635e4404 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:03.462680 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e767b613-c8e8-4995-9a60-f2f4635e4404 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:03.463182 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e767b613-c8e8-4995-9a60-f2f4635e4404 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:03.463620 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e767b613-c8e8-4995-9a60-f2f4635e4404 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:03.596410 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-e767b613-c8e8-4995-9a60-f2f4635e4404 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0c29696e24390a5492804e0948010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6b6775bdd84b24bf7a5ce051e30998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:02:03.604502 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e767b613-c8e8-4995-9a60-f2f4635e4404 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "GET /compute/v2.1/servers/7f6de8c0-6b9c-4669-8edd-13f26c931386" status: 200 len: 1392 microversion: 2.1 time: 0.155649 Sep 14 10:02:03.605086 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4006/7435] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:02:03 2022] GET /compute/v2.1/servers/7f6de8c0-6b9c-4669-8edd-13f26c931386 => generated 1392 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:02:04.626406 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=2 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:02:04.627216 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=6 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:02:04.631923 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-578752a8-9714-46ac-a69a-28f41bc76f4a tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:02:04.632643 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-578752a8-9714-46ac-a69a-28f41bc76f4a tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 7f6de8c0-6b9c-4669-8edd-13f26c931386] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:02:04.639745 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-578752a8-9714-46ac-a69a-28f41bc76f4a tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:04.640245 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-578752a8-9714-46ac-a69a-28f41bc76f4a tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:04.640704 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-578752a8-9714-46ac-a69a-28f41bc76f4a tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:04.641407 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-578752a8-9714-46ac-a69a-28f41bc76f4a tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:04.641874 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-578752a8-9714-46ac-a69a-28f41bc76f4a tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:04.642316 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-578752a8-9714-46ac-a69a-28f41bc76f4a tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:04.780478 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-578752a8-9714-46ac-a69a-28f41bc76f4a tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0c29696e24390a5492804e0948010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6b6775bdd84b24bf7a5ce051e30998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:02:04.788390 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-578752a8-9714-46ac-a69a-28f41bc76f4a tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "GET /compute/v2.1/servers/7f6de8c0-6b9c-4669-8edd-13f26c931386" status: 200 len: 1564 microversion: 2.1 time: 0.163756 Sep 14 10:02:04.788976 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3430/7436] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:02:04 2022] GET /compute/v2.1/servers/7f6de8c0-6b9c-4669-8edd-13f26c931386 => generated 1564 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 10:02:04.811897 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-7cd3ab2d-cdef-4e01-9b50-58083e8b5c28 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:02:04.812435 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-7cd3ab2d-cdef-4e01-9b50-58083e8b5c28 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 7f6de8c0-6b9c-4669-8edd-13f26c931386] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:02:04.814281 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=6 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:02:04.821053 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7cd3ab2d-cdef-4e01-9b50-58083e8b5c28 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:04.821559 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7cd3ab2d-cdef-4e01-9b50-58083e8b5c28 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:04.821989 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7cd3ab2d-cdef-4e01-9b50-58083e8b5c28 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:04.822758 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7cd3ab2d-cdef-4e01-9b50-58083e8b5c28 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:04.823260 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7cd3ab2d-cdef-4e01-9b50-58083e8b5c28 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:04.823694 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7cd3ab2d-cdef-4e01-9b50-58083e8b5c28 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:04.955667 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-7cd3ab2d-cdef-4e01-9b50-58083e8b5c28 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0c29696e24390a5492804e0948010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6b6775bdd84b24bf7a5ce051e30998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:02:04.963424 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-7cd3ab2d-cdef-4e01-9b50-58083e8b5c28 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "GET /compute/v2.1/servers/7f6de8c0-6b9c-4669-8edd-13f26c931386" status: 200 len: 1564 microversion: 2.1 time: 0.156118 Sep 14 10:02:04.963996 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4007/7437] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:02:04 2022] GET /compute/v2.1/servers/7f6de8c0-6b9c-4669-8edd-13f26c931386 => generated 1564 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:02:06.786810 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-6208975e-09a1-4db8-bac4-6686d3316b65 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:02:06.787487 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-6208975e-09a1-4db8-bac4-6686d3316b65 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 7f6de8c0-6b9c-4669-8edd-13f26c931386] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:02:06.789210 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-90013277-0ebe-41f5-aba3-a93a2b8ae76c req-684c7bb0-5c06-43c1-9b40-ff5339982f98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f6de8c0-6b9c-4669-8edd-13f26c931386", "tag": "883a0bd4-f58d-4f35-902c-e4596d94facd"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:02:06.791925 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:02:06.795067 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:02:06.795980 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6208975e-09a1-4db8-bac4-6686d3316b65 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:06.796507 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6208975e-09a1-4db8-bac4-6686d3316b65 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:06.796923 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6208975e-09a1-4db8-bac4-6686d3316b65 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:06.797813 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6208975e-09a1-4db8-bac4-6686d3316b65 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:06.798293 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6208975e-09a1-4db8-bac4-6686d3316b65 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:06.798738 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6208975e-09a1-4db8-bac4-6686d3316b65 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:06.802700 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-90013277-0ebe-41f5-aba3-a93a2b8ae76c req-684c7bb0-5c06-43c1-9b40-ff5339982f98 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:06.803207 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-90013277-0ebe-41f5-aba3-a93a2b8ae76c req-684c7bb0-5c06-43c1-9b40-ff5339982f98 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:06.803863 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-90013277-0ebe-41f5-aba3-a93a2b8ae76c req-684c7bb0-5c06-43c1-9b40-ff5339982f98 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:06.815853 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-90013277-0ebe-41f5-aba3-a93a2b8ae76c req-684c7bb0-5c06-43c1-9b40-ff5339982f98 service nova] Creating event network-changed:883a0bd4-f58d-4f35-902c-e4596d94facd for instance 7f6de8c0-6b9c-4669-8edd-13f26c931386 on n-h2-836830-18 Sep 14 10:02:06.821935 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-90013277-0ebe-41f5-aba3-a93a2b8ae76c req-684c7bb0-5c06-43c1-9b40-ff5339982f98 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036129 Sep 14 10:02:06.823229 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4008/7438] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 10:02:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 10:02:06.952897 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-6208975e-09a1-4db8-bac4-6686d3316b65 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0c29696e24390a5492804e0948010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6b6775bdd84b24bf7a5ce051e30998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:02:06.961205 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-6208975e-09a1-4db8-bac4-6686d3316b65 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "GET /compute/v2.1/servers/7f6de8c0-6b9c-4669-8edd-13f26c931386" status: 200 len: 1564 microversion: 2.1 time: 0.178712 Sep 14 10:02:06.962345 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3431/7439] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:02:06 2022] GET /compute/v2.1/servers/7f6de8c0-6b9c-4669-8edd-13f26c931386 => generated 1564 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:02:29.325792 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:02:29.326556 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=38 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:02:29.331333 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a64ff83b-589b-415f-a03a-b17eb8abc3fd tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:02:29.333635 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-a64ff83b-589b-415f-a03a-b17eb8abc3fd tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 7f6de8c0-6b9c-4669-8edd-13f26c931386] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:02:29.340611 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a64ff83b-589b-415f-a03a-b17eb8abc3fd tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:29.341107 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a64ff83b-589b-415f-a03a-b17eb8abc3fd tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:29.341553 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a64ff83b-589b-415f-a03a-b17eb8abc3fd tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:29.342254 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a64ff83b-589b-415f-a03a-b17eb8abc3fd tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:29.342718 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a64ff83b-589b-415f-a03a-b17eb8abc3fd tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:29.343207 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a64ff83b-589b-415f-a03a-b17eb8abc3fd tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:29.395630 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a64ff83b-589b-415f-a03a-b17eb8abc3fd tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "POST /compute/v2.1/servers/7f6de8c0-6b9c-4669-8edd-13f26c931386/action" status: 200 len: 24570 microversion: 2.1 time: 0.071656 Sep 14 10:02:29.396738 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4009/7440] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 10:02:29 2022] POST /compute/v2.1/servers/7f6de8c0-6b9c-4669-8edd-13f26c931386/action => generated 24570 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 10:02:35.733921 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a2fc567e-a1bf-4c7d-8c18-c831f9c06842 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:02:35.736297 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-a2fc567e-a1bf-4c7d-8c18-c831f9c06842 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 7f6de8c0-6b9c-4669-8edd-13f26c931386] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:02:35.738520 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:02:35.739373 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=36 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:02:35.744803 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a2fc567e-a1bf-4c7d-8c18-c831f9c06842 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:35.745314 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a2fc567e-a1bf-4c7d-8c18-c831f9c06842 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:35.745771 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a2fc567e-a1bf-4c7d-8c18-c831f9c06842 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:35.746481 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a2fc567e-a1bf-4c7d-8c18-c831f9c06842 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:35.746970 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a2fc567e-a1bf-4c7d-8c18-c831f9c06842 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:35.747420 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a2fc567e-a1bf-4c7d-8c18-c831f9c06842 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:35.819830 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-a2fc567e-a1bf-4c7d-8c18-c831f9c06842 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "POST /compute/v2.1/servers/7f6de8c0-6b9c-4669-8edd-13f26c931386/action" status: 202 len: 0 microversion: 2.1 time: 0.089886 Sep 14 10:02:35.820511 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3432/7441] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 10:02:35 2022] POST /compute/v2.1/servers/7f6de8c0-6b9c-4669-8edd-13f26c931386/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 10:02:35.830276 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ac2bb05f-a53d-407c-bc6c-9462d4d34263 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:02:35.831036 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-ac2bb05f-a53d-407c-bc6c-9462d4d34263 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 7f6de8c0-6b9c-4669-8edd-13f26c931386] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:02:35.838783 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ac2bb05f-a53d-407c-bc6c-9462d4d34263 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:35.839338 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ac2bb05f-a53d-407c-bc6c-9462d4d34263 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:35.839746 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ac2bb05f-a53d-407c-bc6c-9462d4d34263 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:35.840452 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ac2bb05f-a53d-407c-bc6c-9462d4d34263 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:35.840942 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ac2bb05f-a53d-407c-bc6c-9462d4d34263 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:35.841374 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ac2bb05f-a53d-407c-bc6c-9462d4d34263 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:35.981140 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-ac2bb05f-a53d-407c-bc6c-9462d4d34263 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0c29696e24390a5492804e0948010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6b6775bdd84b24bf7a5ce051e30998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:02:35.989743 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-ac2bb05f-a53d-407c-bc6c-9462d4d34263 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "GET /compute/v2.1/servers/7f6de8c0-6b9c-4669-8edd-13f26c931386" status: 200 len: 1675 microversion: 2.1 time: 0.164595 Sep 14 10:02:35.990319 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4010/7442] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:02:35 2022] GET /compute/v2.1/servers/7f6de8c0-6b9c-4669-8edd-13f26c931386 => generated 1675 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:02:37.014696 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-0408d551-27df-4245-8da3-4a223ae6c010 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:02:37.015476 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-0408d551-27df-4245-8da3-4a223ae6c010 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 7f6de8c0-6b9c-4669-8edd-13f26c931386] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:02:37.022210 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0408d551-27df-4245-8da3-4a223ae6c010 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:37.022732 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0408d551-27df-4245-8da3-4a223ae6c010 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:37.023211 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0408d551-27df-4245-8da3-4a223ae6c010 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:37.023940 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0408d551-27df-4245-8da3-4a223ae6c010 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:37.024411 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0408d551-27df-4245-8da3-4a223ae6c010 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:37.024854 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0408d551-27df-4245-8da3-4a223ae6c010 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:37.164443 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-0408d551-27df-4245-8da3-4a223ae6c010 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0c29696e24390a5492804e0948010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6b6775bdd84b24bf7a5ce051e30998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:02:37.172400 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-0408d551-27df-4245-8da3-4a223ae6c010 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "GET /compute/v2.1/servers/7f6de8c0-6b9c-4669-8edd-13f26c931386" status: 200 len: 1680 microversion: 2.1 time: 0.162839 Sep 14 10:02:37.172983 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3433/7443] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:02:37 2022] GET /compute/v2.1/servers/7f6de8c0-6b9c-4669-8edd-13f26c931386 => generated 1680 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:02:38.198864 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3d1ec281-875f-416a-9212-2cf6a3b4e9d5 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:02:38.199528 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-3d1ec281-875f-416a-9212-2cf6a3b4e9d5 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 7f6de8c0-6b9c-4669-8edd-13f26c931386] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:02:38.207863 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3d1ec281-875f-416a-9212-2cf6a3b4e9d5 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:38.208357 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3d1ec281-875f-416a-9212-2cf6a3b4e9d5 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:38.208807 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3d1ec281-875f-416a-9212-2cf6a3b4e9d5 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:38.209512 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3d1ec281-875f-416a-9212-2cf6a3b4e9d5 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:38.209979 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3d1ec281-875f-416a-9212-2cf6a3b4e9d5 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:38.210413 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3d1ec281-875f-416a-9212-2cf6a3b4e9d5 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:38.343723 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-3d1ec281-875f-416a-9212-2cf6a3b4e9d5 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0c29696e24390a5492804e0948010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6b6775bdd84b24bf7a5ce051e30998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:02:38.352606 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-3d1ec281-875f-416a-9212-2cf6a3b4e9d5 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "GET /compute/v2.1/servers/7f6de8c0-6b9c-4669-8edd-13f26c931386" status: 200 len: 1680 microversion: 2.1 time: 0.157649 Sep 14 10:02:38.353117 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4011/7444] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:02:38 2022] GET /compute/v2.1/servers/7f6de8c0-6b9c-4669-8edd-13f26c931386 => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:02:39.376065 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d2a2e5e8-722c-4706-8c8b-d088fc3dcfde tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:02:39.376971 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-d2a2e5e8-722c-4706-8c8b-d088fc3dcfde tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 7f6de8c0-6b9c-4669-8edd-13f26c931386] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:02:39.384600 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d2a2e5e8-722c-4706-8c8b-d088fc3dcfde tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:39.385101 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d2a2e5e8-722c-4706-8c8b-d088fc3dcfde tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:39.385557 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d2a2e5e8-722c-4706-8c8b-d088fc3dcfde tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:39.386262 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d2a2e5e8-722c-4706-8c8b-d088fc3dcfde tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:39.386733 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d2a2e5e8-722c-4706-8c8b-d088fc3dcfde tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:39.387203 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d2a2e5e8-722c-4706-8c8b-d088fc3dcfde tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:39.526229 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-d2a2e5e8-722c-4706-8c8b-d088fc3dcfde tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0c29696e24390a5492804e0948010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6b6775bdd84b24bf7a5ce051e30998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:02:39.534826 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-d2a2e5e8-722c-4706-8c8b-d088fc3dcfde tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "GET /compute/v2.1/servers/7f6de8c0-6b9c-4669-8edd-13f26c931386" status: 200 len: 1680 microversion: 2.1 time: 0.162719 Sep 14 10:02:39.535455 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3434/7445] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:02:39 2022] GET /compute/v2.1/servers/7f6de8c0-6b9c-4669-8edd-13f26c931386 => generated 1680 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:02:40.558074 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-cf221da1-d9f5-42a1-a705-8f1b1352acc3 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:02:40.558715 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-cf221da1-d9f5-42a1-a705-8f1b1352acc3 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 7f6de8c0-6b9c-4669-8edd-13f26c931386] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:02:40.566003 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cf221da1-d9f5-42a1-a705-8f1b1352acc3 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:40.566499 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cf221da1-d9f5-42a1-a705-8f1b1352acc3 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:40.566960 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cf221da1-d9f5-42a1-a705-8f1b1352acc3 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:40.567691 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cf221da1-d9f5-42a1-a705-8f1b1352acc3 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:40.568153 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cf221da1-d9f5-42a1-a705-8f1b1352acc3 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:40.568584 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cf221da1-d9f5-42a1-a705-8f1b1352acc3 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:40.703267 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-cf221da1-d9f5-42a1-a705-8f1b1352acc3 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0c29696e24390a5492804e0948010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6b6775bdd84b24bf7a5ce051e30998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:02:40.711839 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-cf221da1-d9f5-42a1-a705-8f1b1352acc3 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "GET /compute/v2.1/servers/7f6de8c0-6b9c-4669-8edd-13f26c931386" status: 200 len: 1680 microversion: 2.1 time: 0.157692 Sep 14 10:02:40.712442 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4012/7446] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:02:40 2022] GET /compute/v2.1/servers/7f6de8c0-6b9c-4669-8edd-13f26c931386 => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:02:41.735993 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-06b4dc3e-5c5c-4ea9-ba08-d55739702abc tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:02:41.736655 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-06b4dc3e-5c5c-4ea9-ba08-d55739702abc tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 7f6de8c0-6b9c-4669-8edd-13f26c931386] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:02:41.743500 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-06b4dc3e-5c5c-4ea9-ba08-d55739702abc tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:41.744000 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-06b4dc3e-5c5c-4ea9-ba08-d55739702abc tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:41.744447 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-06b4dc3e-5c5c-4ea9-ba08-d55739702abc tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:41.745147 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-06b4dc3e-5c5c-4ea9-ba08-d55739702abc tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:41.745614 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-06b4dc3e-5c5c-4ea9-ba08-d55739702abc tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:41.746082 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-06b4dc3e-5c5c-4ea9-ba08-d55739702abc tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:41.880959 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-06b4dc3e-5c5c-4ea9-ba08-d55739702abc tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0c29696e24390a5492804e0948010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6b6775bdd84b24bf7a5ce051e30998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:02:41.888691 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-06b4dc3e-5c5c-4ea9-ba08-d55739702abc tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "GET /compute/v2.1/servers/7f6de8c0-6b9c-4669-8edd-13f26c931386" status: 200 len: 1680 microversion: 2.1 time: 0.157221 Sep 14 10:02:41.889271 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3435/7447] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:02:41 2022] GET /compute/v2.1/servers/7f6de8c0-6b9c-4669-8edd-13f26c931386 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:02:42.911998 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-af5649df-4e7b-47cd-b5ba-32a2358ed9fd tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:02:42.912628 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-af5649df-4e7b-47cd-b5ba-32a2358ed9fd tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 7f6de8c0-6b9c-4669-8edd-13f26c931386] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:02:42.919695 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-af5649df-4e7b-47cd-b5ba-32a2358ed9fd tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:42.920192 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-af5649df-4e7b-47cd-b5ba-32a2358ed9fd tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:42.920640 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-af5649df-4e7b-47cd-b5ba-32a2358ed9fd tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:42.921340 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-af5649df-4e7b-47cd-b5ba-32a2358ed9fd tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:42.921806 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-af5649df-4e7b-47cd-b5ba-32a2358ed9fd tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:42.922835 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-af5649df-4e7b-47cd-b5ba-32a2358ed9fd tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:43.053368 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-af5649df-4e7b-47cd-b5ba-32a2358ed9fd tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0c29696e24390a5492804e0948010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6b6775bdd84b24bf7a5ce051e30998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:02:43.061138 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-af5649df-4e7b-47cd-b5ba-32a2358ed9fd tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "GET /compute/v2.1/servers/7f6de8c0-6b9c-4669-8edd-13f26c931386" status: 200 len: 1680 microversion: 2.1 time: 0.153098 Sep 14 10:02:43.061733 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4013/7448] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:02:42 2022] GET /compute/v2.1/servers/7f6de8c0-6b9c-4669-8edd-13f26c931386 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:02:44.085440 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-15d67b72-2424-4f5d-87d1-cbce61410713 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:02:44.086084 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-15d67b72-2424-4f5d-87d1-cbce61410713 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 7f6de8c0-6b9c-4669-8edd-13f26c931386] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:02:44.093043 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-15d67b72-2424-4f5d-87d1-cbce61410713 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:44.093554 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-15d67b72-2424-4f5d-87d1-cbce61410713 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:44.094025 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-15d67b72-2424-4f5d-87d1-cbce61410713 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:44.094782 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-15d67b72-2424-4f5d-87d1-cbce61410713 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:44.095294 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-15d67b72-2424-4f5d-87d1-cbce61410713 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:44.095779 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-15d67b72-2424-4f5d-87d1-cbce61410713 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:44.228210 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-15d67b72-2424-4f5d-87d1-cbce61410713 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0c29696e24390a5492804e0948010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6b6775bdd84b24bf7a5ce051e30998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:02:44.236776 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-15d67b72-2424-4f5d-87d1-cbce61410713 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "GET /compute/v2.1/servers/7f6de8c0-6b9c-4669-8edd-13f26c931386" status: 200 len: 1680 microversion: 2.1 time: 0.155493 Sep 14 10:02:44.237366 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3436/7449] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:02:44 2022] GET /compute/v2.1/servers/7f6de8c0-6b9c-4669-8edd-13f26c931386 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:02:45.261095 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-620aea13-07b1-4806-b787-949ec479ef83 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:02:45.261720 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-620aea13-07b1-4806-b787-949ec479ef83 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 7f6de8c0-6b9c-4669-8edd-13f26c931386] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:02:45.268773 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-620aea13-07b1-4806-b787-949ec479ef83 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:45.269271 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-620aea13-07b1-4806-b787-949ec479ef83 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:45.269714 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-620aea13-07b1-4806-b787-949ec479ef83 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:45.270411 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-620aea13-07b1-4806-b787-949ec479ef83 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:45.270874 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-620aea13-07b1-4806-b787-949ec479ef83 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:45.271334 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-620aea13-07b1-4806-b787-949ec479ef83 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:45.403681 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-620aea13-07b1-4806-b787-949ec479ef83 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0c29696e24390a5492804e0948010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6b6775bdd84b24bf7a5ce051e30998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:02:45.411370 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-620aea13-07b1-4806-b787-949ec479ef83 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "GET /compute/v2.1/servers/7f6de8c0-6b9c-4669-8edd-13f26c931386" status: 200 len: 1680 microversion: 2.1 time: 0.154412 Sep 14 10:02:45.411953 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4014/7450] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:02:45 2022] GET /compute/v2.1/servers/7f6de8c0-6b9c-4669-8edd-13f26c931386 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:02:46.435345 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b277d140-50be-4e61-93e2-c1b9a3cc1c81 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:02:46.435990 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-b277d140-50be-4e61-93e2-c1b9a3cc1c81 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 7f6de8c0-6b9c-4669-8edd-13f26c931386] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:02:46.443056 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b277d140-50be-4e61-93e2-c1b9a3cc1c81 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:46.443563 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b277d140-50be-4e61-93e2-c1b9a3cc1c81 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:46.444022 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b277d140-50be-4e61-93e2-c1b9a3cc1c81 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:46.444736 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b277d140-50be-4e61-93e2-c1b9a3cc1c81 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:46.445217 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b277d140-50be-4e61-93e2-c1b9a3cc1c81 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:46.445664 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b277d140-50be-4e61-93e2-c1b9a3cc1c81 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:46.575886 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-b277d140-50be-4e61-93e2-c1b9a3cc1c81 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0c29696e24390a5492804e0948010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6b6775bdd84b24bf7a5ce051e30998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:02:46.584412 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-b277d140-50be-4e61-93e2-c1b9a3cc1c81 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "GET /compute/v2.1/servers/7f6de8c0-6b9c-4669-8edd-13f26c931386" status: 200 len: 1680 microversion: 2.1 time: 0.153108 Sep 14 10:02:46.584997 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3437/7451] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:02:46 2022] GET /compute/v2.1/servers/7f6de8c0-6b9c-4669-8edd-13f26c931386 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:02:47.608987 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a78e5d28-334d-47c7-ba03-5cae04aec948 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:02:47.610284 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-a78e5d28-334d-47c7-ba03-5cae04aec948 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 7f6de8c0-6b9c-4669-8edd-13f26c931386] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:02:47.617289 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a78e5d28-334d-47c7-ba03-5cae04aec948 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:47.617794 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a78e5d28-334d-47c7-ba03-5cae04aec948 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:47.618243 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a78e5d28-334d-47c7-ba03-5cae04aec948 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:47.618959 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a78e5d28-334d-47c7-ba03-5cae04aec948 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:47.619430 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a78e5d28-334d-47c7-ba03-5cae04aec948 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:47.619864 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a78e5d28-334d-47c7-ba03-5cae04aec948 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:47.755028 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-a78e5d28-334d-47c7-ba03-5cae04aec948 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0c29696e24390a5492804e0948010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6b6775bdd84b24bf7a5ce051e30998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:02:47.762848 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a78e5d28-334d-47c7-ba03-5cae04aec948 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "GET /compute/v2.1/servers/7f6de8c0-6b9c-4669-8edd-13f26c931386" status: 200 len: 1683 microversion: 2.1 time: 0.157829 Sep 14 10:02:47.763484 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4015/7452] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:02:47 2022] GET /compute/v2.1/servers/7f6de8c0-6b9c-4669-8edd-13f26c931386 => generated 1683 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:03:11.950917 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-e4b926c4-86b3-47c5-84e8-328b176b8c18 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:03:11.953169 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-e4b926c4-86b3-47c5-84e8-328b176b8c18 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 7f6de8c0-6b9c-4669-8edd-13f26c931386] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:03:11.955517 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=12 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:03:11.956195 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:03:11.962295 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e4b926c4-86b3-47c5-84e8-328b176b8c18 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:11.962798 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e4b926c4-86b3-47c5-84e8-328b176b8c18 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:11.963278 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e4b926c4-86b3-47c5-84e8-328b176b8c18 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:11.963990 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e4b926c4-86b3-47c5-84e8-328b176b8c18 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:11.964460 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e4b926c4-86b3-47c5-84e8-328b176b8c18 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:11.964921 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e4b926c4-86b3-47c5-84e8-328b176b8c18 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:12.030957 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-e4b926c4-86b3-47c5-84e8-328b176b8c18 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "POST /compute/v2.1/servers/7f6de8c0-6b9c-4669-8edd-13f26c931386/action" status: 200 len: 68941 microversion: 2.1 time: 0.084090 Sep 14 10:03:12.031647 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3438/7453] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 10:03:11 2022] POST /compute/v2.1/servers/7f6de8c0-6b9c-4669-8edd-13f26c931386/action => generated 68941 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 10:03:19.070680 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-260be2b1-85ab-45be-87ad-c77a96ef341f tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:03:19.071247 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-260be2b1-85ab-45be-87ad-c77a96ef341f tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 7f6de8c0-6b9c-4669-8edd-13f26c931386] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:03:19.073490 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=14 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:03:19.074316 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=40 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:03:19.076275 n-d-836830-18 devstack@n-api.service[128759]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 10:03:19.076275 n-d-836830-18 devstack@n-api.service[128759]: Wed Sep 14 10:03:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7f6de8c0-6b9c-4669-8edd-13f26c931386 (ip 10.222.0.60) !!! Sep 14 10:03:19.085710 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-260be2b1-85ab-45be-87ad-c77a96ef341f tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:19.086199 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-260be2b1-85ab-45be-87ad-c77a96ef341f tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:19.086642 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-260be2b1-85ab-45be-87ad-c77a96ef341f tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:19.087874 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-260be2b1-85ab-45be-87ad-c77a96ef341f tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:19.087874 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-260be2b1-85ab-45be-87ad-c77a96ef341f tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:19.088244 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-260be2b1-85ab-45be-87ad-c77a96ef341f tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:19.118069 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-260be2b1-85ab-45be-87ad-c77a96ef341f tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 7f6de8c0-6b9c-4669-8edd-13f26c931386] Going to try to terminate instance {{(pid=128759) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 10:03:19.135945 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-1354e419-25e8-4f06-a858-35c9775b25db req-c16c3309-919a-4cc6-a324-9afedaba2568 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f6de8c0-6b9c-4669-8edd-13f26c931386", "tag": "883a0bd4-f58d-4f35-902c-e4596d94facd"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:03:19.151083 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-1354e419-25e8-4f06-a858-35c9775b25db req-c16c3309-919a-4cc6-a324-9afedaba2568 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:19.151593 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-1354e419-25e8-4f06-a858-35c9775b25db req-c16c3309-919a-4cc6-a324-9afedaba2568 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:19.152110 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-1354e419-25e8-4f06-a858-35c9775b25db req-c16c3309-919a-4cc6-a324-9afedaba2568 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:19.171167 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-1354e419-25e8-4f06-a858-35c9775b25db req-c16c3309-919a-4cc6-a324-9afedaba2568 service nova] Creating event network-changed:883a0bd4-f58d-4f35-902c-e4596d94facd for instance 7f6de8c0-6b9c-4669-8edd-13f26c931386 on n-h2-836830-18 Sep 14 10:03:19.177020 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-1354e419-25e8-4f06-a858-35c9775b25db req-c16c3309-919a-4cc6-a324-9afedaba2568 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108191 Sep 14 10:03:19.177828 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3439/7454] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 10:03:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 10:03:19.208837 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-260be2b1-85ab-45be-87ad-c77a96ef341f tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "DELETE /compute/v2.1/servers/7f6de8c0-6b9c-4669-8edd-13f26c931386" status: 204 len: 0 microversion: 2.1 time: 0.143023 Sep 14 10:03:19.210755 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4016/7455] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 10:03:19 2022] DELETE /compute/v2.1/servers/7f6de8c0-6b9c-4669-8edd-13f26c931386 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 10:03:19.221513 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a26372a3-0836-4744-9019-76673e82e22c tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:03:19.222244 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-a26372a3-0836-4744-9019-76673e82e22c tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 7f6de8c0-6b9c-4669-8edd-13f26c931386] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:03:19.229180 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a26372a3-0836-4744-9019-76673e82e22c tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:19.229965 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a26372a3-0836-4744-9019-76673e82e22c tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:19.230636 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a26372a3-0836-4744-9019-76673e82e22c tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:19.231593 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a26372a3-0836-4744-9019-76673e82e22c tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:19.232266 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a26372a3-0836-4744-9019-76673e82e22c tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:19.232905 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a26372a3-0836-4744-9019-76673e82e22c tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:19.422527 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-a26372a3-0836-4744-9019-76673e82e22c tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0c29696e24390a5492804e0948010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6b6775bdd84b24bf7a5ce051e30998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:03:19.431176 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-a26372a3-0836-4744-9019-76673e82e22c tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "GET /compute/v2.1/servers/7f6de8c0-6b9c-4669-8edd-13f26c931386" status: 200 len: 1689 microversion: 2.1 time: 0.215837 Sep 14 10:03:19.431764 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3440/7456] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:03:19 2022] GET /compute/v2.1/servers/7f6de8c0-6b9c-4669-8edd-13f26c931386 => generated 1689 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:03:20.455371 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9b80bc2b-a1cf-4e4e-9949-a3ad0893c492 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:03:20.456084 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-9b80bc2b-a1cf-4e4e-9949-a3ad0893c492 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 7f6de8c0-6b9c-4669-8edd-13f26c931386] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:03:20.463471 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9b80bc2b-a1cf-4e4e-9949-a3ad0893c492 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:20.463962 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9b80bc2b-a1cf-4e4e-9949-a3ad0893c492 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:20.464409 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9b80bc2b-a1cf-4e4e-9949-a3ad0893c492 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:20.465108 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9b80bc2b-a1cf-4e4e-9949-a3ad0893c492 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:20.465570 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9b80bc2b-a1cf-4e4e-9949-a3ad0893c492 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:20.465995 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9b80bc2b-a1cf-4e4e-9949-a3ad0893c492 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:20.609293 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-9b80bc2b-a1cf-4e4e-9949-a3ad0893c492 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0c29696e24390a5492804e0948010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6b6775bdd84b24bf7a5ce051e30998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:03:20.617910 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-9b80bc2b-a1cf-4e4e-9949-a3ad0893c492 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "GET /compute/v2.1/servers/7f6de8c0-6b9c-4669-8edd-13f26c931386" status: 200 len: 1689 microversion: 2.1 time: 0.166822 Sep 14 10:03:20.618497 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4017/7457] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:03:20 2022] GET /compute/v2.1/servers/7f6de8c0-6b9c-4669-8edd-13f26c931386 => generated 1689 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:03:21.147213 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-db67ac99-11d7-4a9d-b4fc-be4a89cc1d43 req-59e54911-22be-47aa-9260-d1f505eb2bd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f6de8c0-6b9c-4669-8edd-13f26c931386", "name": "network-vif-deleted", "tag": "883a0bd4-f58d-4f35-902c-e4596d94facd"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:03:21.157716 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-db67ac99-11d7-4a9d-b4fc-be4a89cc1d43 req-59e54911-22be-47aa-9260-d1f505eb2bd3 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:21.158220 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-db67ac99-11d7-4a9d-b4fc-be4a89cc1d43 req-59e54911-22be-47aa-9260-d1f505eb2bd3 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:21.158675 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-db67ac99-11d7-4a9d-b4fc-be4a89cc1d43 req-59e54911-22be-47aa-9260-d1f505eb2bd3 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:21.170851 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-db67ac99-11d7-4a9d-b4fc-be4a89cc1d43 req-59e54911-22be-47aa-9260-d1f505eb2bd3 service nova] Creating event network-vif-deleted:883a0bd4-f58d-4f35-902c-e4596d94facd for instance 7f6de8c0-6b9c-4669-8edd-13f26c931386 on n-h2-836830-18 Sep 14 10:03:21.176449 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-db67ac99-11d7-4a9d-b4fc-be4a89cc1d43 req-59e54911-22be-47aa-9260-d1f505eb2bd3 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032542 Sep 14 10:03:21.177065 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3441/7458] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 10:03:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:03:21.643473 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e0f69a73-3531-4a9b-8f8e-ebb037a0491e tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:03:21.644472 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e0f69a73-3531-4a9b-8f8e-ebb037a0491e tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 7f6de8c0-6b9c-4669-8edd-13f26c931386] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:03:21.651995 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e0f69a73-3531-4a9b-8f8e-ebb037a0491e tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:21.652481 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e0f69a73-3531-4a9b-8f8e-ebb037a0491e tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:21.652917 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e0f69a73-3531-4a9b-8f8e-ebb037a0491e tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:21.653804 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e0f69a73-3531-4a9b-8f8e-ebb037a0491e tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:21.654432 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e0f69a73-3531-4a9b-8f8e-ebb037a0491e tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:21.654861 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e0f69a73-3531-4a9b-8f8e-ebb037a0491e tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:21.668931 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-e0f69a73-3531-4a9b-8f8e-ebb037a0491e tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] HTTP exception thrown: Instance 7f6de8c0-6b9c-4669-8edd-13f26c931386 could not be found. Sep 14 10:03:21.670528 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e0f69a73-3531-4a9b-8f8e-ebb037a0491e tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Request method failure captured: Sep 14 10:03:21.670528 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/7f6de8c0-6b9c-4669-8edd-13f26c931386 HTTP/1.1 Sep 14 10:03:21.670528 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 10:03:21.670528 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 10:03:21.670528 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 10:03:21.670528 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 10:03:21.670528 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 10:03:21.670528 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 10:03:21.670528 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 10:03:21.670528 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 10:03:21.670528 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIaYrejhj2TGf9R9N95darLKnnjP7yvAOzzRGk88fUneEcfLJ79TotlbWmaifDlagIOgchpK-W9GG7KW3sgKBKNTQaihdlpQR7nbYvQmmAemQtSyT8HYEWV36tTrgBgWqk_HpFAN-DV62Paaf0wzD9le8cOOWXqmVMqtvFpWKeFSur8Y Sep 14 10:03:21.670528 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 10:03:21.670528 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 10:03:21.670528 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 10:03:21.670528 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 10:03:21.670528 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 10:03:21.670528 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 10:03:21.670528 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 1e6b6775bdd84b24bf7a5ce051e30998 Sep 14 10:03:21.670528 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-722006907 Sep 14 10:03:21.670528 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 10:03:21.670528 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 10:03:21.670528 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/1e6b6775bdd84b24bf7a5ce051e30998"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_1e6b6775bdd84b24bf7a5ce051e30998"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1e6b6775bdd84b24bf7a5ce051e30998"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1e6b6775bdd84b24bf7a5ce051e30998"}]}] Sep 14 10:03:21.670528 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-TestNetworkAdvancedServerOps-722006907 Sep 14 10:03:21.670528 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 1e6b6775bdd84b24bf7a5ce051e30998 Sep 14 10:03:21.670528 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-722006907 Sep 14 10:03:21.670528 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-TestNetworkAdvancedServerOps-722006907-project Sep 14 10:03:21.670528 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 10:03:21.670528 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 10:03:21.670528 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: caa0c29696e24390a5492804e0948010 Sep 14 10:03:21.670528 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-TestNetworkAdvancedServerOps-722006907-project Sep 14 10:03:21.670528 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 10:03:21.670528 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance 7f6de8c0-6b9c-4669-8edd-13f26c931386 could not be found. Sep 14 10:03:21.670528 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '7f6de8c0-6b9c-4669-8edd-13f26c931386'} Sep 14 10:03:21.670528 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 10:03:21.670528 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:03:21.670528 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 10:03:21.670528 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 10:03:21.670528 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 10:03:21.670528 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 10:03:21.670528 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 10:03:21.670528 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 10:03:21.670528 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 10:03:21.670528 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 10:03:21.670528 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f6de8c0-6b9c-4669-8edd-13f26c931386 could not be found. Sep 14 10:03:21.670528 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 10:03:21.670528 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:03:21.670528 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 10:03:21.670528 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:03:21.670528 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:03:21.670528 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:03:21.670528 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 10:03:21.670528 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 10:03:21.670528 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 10:03:21.670528 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 10:03:21.670528 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 10:03:21.670528 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 10:03:21.670528 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 10:03:21.670528 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 10:03:21.670528 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 10:03:21.670528 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 10:03:21.670528 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f6de8c0-6b9c-4669-8edd-13f26c931386 could not be found. Sep 14 10:03:21.670528 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 10:03:21.670528 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:03:21.675201 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 10:03:21.675201 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:03:21.675201 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:03:21.675201 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:03:21.675201 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 10:03:21.675201 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 10:03:21.675201 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f6de8c0-6b9c-4669-8edd-13f26c931386 could not be found. Sep 14 10:03:21.675201 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 10:03:21.675201 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e0f69a73-3531-4a9b-8f8e-ebb037a0491e tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Returning 404 to user: Instance 7f6de8c0-6b9c-4669-8edd-13f26c931386 could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 10:03:21.675201 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e0f69a73-3531-4a9b-8f8e-ebb037a0491e tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "GET /compute/v2.1/servers/7f6de8c0-6b9c-4669-8edd-13f26c931386" status: 404 len: 111 microversion: 2.1 time: 0.032854 Sep 14 10:03:21.675201 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4018/7459] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:03:21 2022] GET /compute/v2.1/servers/7f6de8c0-6b9c-4669-8edd-13f26c931386 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 10:03:24.875343 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-dd28c9e0-3301-444f-85f6-aed597cdc253 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '.version_select at 0x7f7d44027af0>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:03:24.895977 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-dd28c9e0-3301-444f-85f6-aed597cdc253 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1464853606" status: 202 len: 0 microversion: 2.1 time: 0.025818 Sep 14 10:03:24.896601 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3442/7460] 10.222.0.60 () {58 vars in 1284 bytes} [Wed Sep 14 10:03:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1464853606 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 10:03:24.922862 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-929d7c6c-692c-49d6-9779-817c0c459a89 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Action: 'create', calling method: .version_select at 0x7f7d3ff5a940>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-590553377", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKRoL3tz2Ph3OQ4GCMF0ByIyCX1JRHZyaqenbUPxuJ85qZtGOqrC7ZVuAlMpR33FLDIEgdMOjU1irXKtaQ0RfuBEVFN73Fs1dN3sAFjHimMyyd4i9H771hN+y1R8OGYZLQ=="}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:03:24.940073 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-929d7c6c-692c-49d6-9779-817c0c459a89 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Getting quotas for project 1e6b6775bdd84b24bf7a5ce051e30998. Resources: {'key_pairs'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 10:03:24.946008 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-929d7c6c-692c-49d6-9779-817c0c459a89 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Getting quotas for user caa0c29696e24390a5492804e0948010 and project 1e6b6775bdd84b24bf7a5ce051e30998. Resources: {'key_pairs'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 10:03:24.970672 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-929d7c6c-692c-49d6-9779-817c0c459a89 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.051694 Sep 14 10:03:24.971351 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4019/7461] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Sep 14 10:03:24 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:03:30.638153 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-8f4811ec-834c-4996-a95f-8fe516aeea39 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-513849897", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "networks": [{"uuid": "632ebeec-0860-46b3-8938-cdd698751490"}], "key_name": "tempest-TestNetworkAdvancedServerOps-590553377", "security_groups": [{"name": "tempest-secgroup-smoke-1661994093"}]}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:03:30.782420 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.network.neutron [None req-8f4811ec-834c-4996-a95f-8fe516aeea39 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] validate_networks() for [('632ebeec-0860-46b3-8938-cdd698751490', None, None, None, None, None)] {{(pid=128758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 10:03:31.164652 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=14 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:03:31.250721 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-8f4811ec-834c-4996-a95f-8fe516aeea39 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Flavor limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 10:03:31.251417 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-8f4811ec-834c-4996-a95f-8fe516aeea39 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Image limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 10:03:31.251929 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-8f4811ec-834c-4996-a95f-8fe516aeea39 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Flavor pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 10:03:31.252364 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-8f4811ec-834c-4996-a95f-8fe516aeea39 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Image pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 10:03:31.252801 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-8f4811ec-834c-4996-a95f-8fe516aeea39 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 10:03:31.275724 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8f4811ec-834c-4996-a95f-8fe516aeea39 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:31.276585 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8f4811ec-834c-4996-a95f-8fe516aeea39 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:31.277254 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8f4811ec-834c-4996-a95f-8fe516aeea39 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:31.278241 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8f4811ec-834c-4996-a95f-8fe516aeea39 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:31.278891 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8f4811ec-834c-4996-a95f-8fe516aeea39 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:31.279680 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8f4811ec-834c-4996-a95f-8fe516aeea39 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:31.304169 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-8f4811ec-834c-4996-a95f-8fe516aeea39 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Getting quotas for project 1e6b6775bdd84b24bf7a5ce051e30998. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 10:03:31.312535 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-8f4811ec-834c-4996-a95f-8fe516aeea39 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Getting quotas for user caa0c29696e24390a5492804e0948010 and project 1e6b6775bdd84b24bf7a5ce051e30998. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 10:03:31.330532 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-8f4811ec-834c-4996-a95f-8fe516aeea39 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Going to run 1 instances... {{(pid=128758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 10:03:31.334056 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-8f4811ec-834c-4996-a95f-8fe516aeea39 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 760c06a0-528e-496f-b494-d70f10a1b95a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 10:03:31.398141 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-8f4811ec-834c-4996-a95f-8fe516aeea39 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.764712 Sep 14 10:03:31.399223 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3443/7462] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 10:03:30 2022] POST /compute/v2.1/servers => generated 406 bytes in 767 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 10:03:31.412203 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3c003cd5-a4ce-4b2c-b1b9-5587b10bccb9 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:03:31.413576 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-3c003cd5-a4ce-4b2c-b1b9-5587b10bccb9 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 760c06a0-528e-496f-b494-d70f10a1b95a] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:03:31.512004 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-3c003cd5-a4ce-4b2c-b1b9-5587b10bccb9 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0c29696e24390a5492804e0948010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6b6775bdd84b24bf7a5ce051e30998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:03:31.519892 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-3c003cd5-a4ce-4b2c-b1b9-5587b10bccb9 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "GET /compute/v2.1/servers/760c06a0-528e-496f-b494-d70f10a1b95a" status: 200 len: 1265 microversion: 2.1 time: 0.113388 Sep 14 10:03:31.521018 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4020/7463] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:03:31 2022] GET /compute/v2.1/servers/760c06a0-528e-496f-b494-d70f10a1b95a => generated 1265 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:03:32.544801 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-dc660059-574c-4e52-9b37-fbed41a52206 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:03:32.545463 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-dc660059-574c-4e52-9b37-fbed41a52206 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 760c06a0-528e-496f-b494-d70f10a1b95a] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:03:32.555115 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dc660059-574c-4e52-9b37-fbed41a52206 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:32.555639 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dc660059-574c-4e52-9b37-fbed41a52206 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:32.556102 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dc660059-574c-4e52-9b37-fbed41a52206 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:32.556846 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dc660059-574c-4e52-9b37-fbed41a52206 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:32.557324 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dc660059-574c-4e52-9b37-fbed41a52206 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:32.558363 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dc660059-574c-4e52-9b37-fbed41a52206 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:32.642794 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-dc660059-574c-4e52-9b37-fbed41a52206 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0c29696e24390a5492804e0948010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6b6775bdd84b24bf7a5ce051e30998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:03:32.651731 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-dc660059-574c-4e52-9b37-fbed41a52206 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "GET /compute/v2.1/servers/760c06a0-528e-496f-b494-d70f10a1b95a" status: 200 len: 1317 microversion: 2.1 time: 0.111468 Sep 14 10:03:32.652656 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3444/7464] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:03:32 2022] GET /compute/v2.1/servers/760c06a0-528e-496f-b494-d70f10a1b95a => generated 1317 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:03:33.675913 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-6bd65106-2da6-47b1-a9f5-06db4db200e1 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:03:33.677245 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-6bd65106-2da6-47b1-a9f5-06db4db200e1 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 760c06a0-528e-496f-b494-d70f10a1b95a] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:03:33.679396 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:03:33.687341 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6bd65106-2da6-47b1-a9f5-06db4db200e1 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:33.688937 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6bd65106-2da6-47b1-a9f5-06db4db200e1 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:33.689400 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6bd65106-2da6-47b1-a9f5-06db4db200e1 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:33.690361 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6bd65106-2da6-47b1-a9f5-06db4db200e1 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:33.690837 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6bd65106-2da6-47b1-a9f5-06db4db200e1 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:33.691836 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-6bd65106-2da6-47b1-a9f5-06db4db200e1 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:33.929003 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-6bd65106-2da6-47b1-a9f5-06db4db200e1 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0c29696e24390a5492804e0948010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6b6775bdd84b24bf7a5ce051e30998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:03:33.944214 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-6bd65106-2da6-47b1-a9f5-06db4db200e1 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "GET /compute/v2.1/servers/760c06a0-528e-496f-b494-d70f10a1b95a" status: 200 len: 1391 microversion: 2.1 time: 0.272772 Sep 14 10:03:33.949063 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4021/7465] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:03:33 2022] GET /compute/v2.1/servers/760c06a0-528e-496f-b494-d70f10a1b95a => generated 1391 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 10:03:34.354342 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-363449c7-4b3f-4ac7-8dbb-f004efbd7c66 req-007f1714-d2e4-4aec-b8b7-51d2f4b1f686 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "760c06a0-528e-496f-b494-d70f10a1b95a", "tag": "f8382bf5-af57-4ebf-893f-c1df6fc729a9"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:03:34.366330 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-363449c7-4b3f-4ac7-8dbb-f004efbd7c66 req-007f1714-d2e4-4aec-b8b7-51d2f4b1f686 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:34.366830 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-363449c7-4b3f-4ac7-8dbb-f004efbd7c66 req-007f1714-d2e4-4aec-b8b7-51d2f4b1f686 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:34.367340 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-363449c7-4b3f-4ac7-8dbb-f004efbd7c66 req-007f1714-d2e4-4aec-b8b7-51d2f4b1f686 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:34.379869 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-363449c7-4b3f-4ac7-8dbb-f004efbd7c66 req-007f1714-d2e4-4aec-b8b7-51d2f4b1f686 service nova] Creating event network-changed:f8382bf5-af57-4ebf-893f-c1df6fc729a9 for instance 760c06a0-528e-496f-b494-d70f10a1b95a on n-h1-836830-18 Sep 14 10:03:34.385058 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-363449c7-4b3f-4ac7-8dbb-f004efbd7c66 req-007f1714-d2e4-4aec-b8b7-51d2f4b1f686 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034480 Sep 14 10:03:34.385858 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3445/7466] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 10:03:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:03:34.974037 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-4b6f4217-7768-4fdb-9549-01de59e73b54 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:03:34.974660 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-4b6f4217-7768-4fdb-9549-01de59e73b54 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 760c06a0-528e-496f-b494-d70f10a1b95a] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:03:34.983518 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4b6f4217-7768-4fdb-9549-01de59e73b54 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:34.984024 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4b6f4217-7768-4fdb-9549-01de59e73b54 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:34.984463 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4b6f4217-7768-4fdb-9549-01de59e73b54 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:34.985169 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4b6f4217-7768-4fdb-9549-01de59e73b54 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:34.985633 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4b6f4217-7768-4fdb-9549-01de59e73b54 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:34.986065 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4b6f4217-7768-4fdb-9549-01de59e73b54 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:35.124176 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-4b6f4217-7768-4fdb-9549-01de59e73b54 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0c29696e24390a5492804e0948010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6b6775bdd84b24bf7a5ce051e30998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:03:35.132496 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-4b6f4217-7768-4fdb-9549-01de59e73b54 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "GET /compute/v2.1/servers/760c06a0-528e-496f-b494-d70f10a1b95a" status: 200 len: 1391 microversion: 2.1 time: 0.163316 Sep 14 10:03:35.133084 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4022/7467] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:03:34 2022] GET /compute/v2.1/servers/760c06a0-528e-496f-b494-d70f10a1b95a => generated 1391 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:03:36.157452 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b66fe221-f2e6-4e95-ab7e-433753f1b3bb tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:03:36.158111 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-b66fe221-f2e6-4e95-ab7e-433753f1b3bb tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 760c06a0-528e-496f-b494-d70f10a1b95a] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:03:36.165144 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b66fe221-f2e6-4e95-ab7e-433753f1b3bb tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:36.165916 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b66fe221-f2e6-4e95-ab7e-433753f1b3bb tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:36.166375 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b66fe221-f2e6-4e95-ab7e-433753f1b3bb tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:36.167112 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b66fe221-f2e6-4e95-ab7e-433753f1b3bb tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:36.167587 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b66fe221-f2e6-4e95-ab7e-433753f1b3bb tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:36.168030 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b66fe221-f2e6-4e95-ab7e-433753f1b3bb tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:36.305657 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-b66fe221-f2e6-4e95-ab7e-433753f1b3bb tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0c29696e24390a5492804e0948010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6b6775bdd84b24bf7a5ce051e30998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:03:36.313453 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-b66fe221-f2e6-4e95-ab7e-433753f1b3bb tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "GET /compute/v2.1/servers/760c06a0-528e-496f-b494-d70f10a1b95a" status: 200 len: 1391 microversion: 2.1 time: 0.161267 Sep 14 10:03:36.314062 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3446/7468] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:03:36 2022] GET /compute/v2.1/servers/760c06a0-528e-496f-b494-d70f10a1b95a => generated 1391 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:03:37.336257 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-30ce38cd-1e2e-4a24-bdb2-bf1b368785c1 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:03:37.336877 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-30ce38cd-1e2e-4a24-bdb2-bf1b368785c1 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 760c06a0-528e-496f-b494-d70f10a1b95a] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:03:37.343763 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-30ce38cd-1e2e-4a24-bdb2-bf1b368785c1 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:37.344257 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-30ce38cd-1e2e-4a24-bdb2-bf1b368785c1 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:37.344698 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-30ce38cd-1e2e-4a24-bdb2-bf1b368785c1 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:37.345391 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-30ce38cd-1e2e-4a24-bdb2-bf1b368785c1 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:37.345855 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-30ce38cd-1e2e-4a24-bdb2-bf1b368785c1 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:37.346288 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-30ce38cd-1e2e-4a24-bdb2-bf1b368785c1 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:37.480262 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-30ce38cd-1e2e-4a24-bdb2-bf1b368785c1 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0c29696e24390a5492804e0948010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6b6775bdd84b24bf7a5ce051e30998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:03:37.488603 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-30ce38cd-1e2e-4a24-bdb2-bf1b368785c1 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "GET /compute/v2.1/servers/760c06a0-528e-496f-b494-d70f10a1b95a" status: 200 len: 1391 microversion: 2.1 time: 0.155602 Sep 14 10:03:37.489187 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4023/7469] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:03:37 2022] GET /compute/v2.1/servers/760c06a0-528e-496f-b494-d70f10a1b95a => generated 1391 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:03:38.511368 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-f77142a4-ba7d-4c9e-a86e-0722e9d83f5a tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:03:38.511998 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-f77142a4-ba7d-4c9e-a86e-0722e9d83f5a tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 760c06a0-528e-496f-b494-d70f10a1b95a] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:03:38.518820 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f77142a4-ba7d-4c9e-a86e-0722e9d83f5a tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:38.519352 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f77142a4-ba7d-4c9e-a86e-0722e9d83f5a tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:38.520312 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f77142a4-ba7d-4c9e-a86e-0722e9d83f5a tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:38.521016 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f77142a4-ba7d-4c9e-a86e-0722e9d83f5a tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:38.521483 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f77142a4-ba7d-4c9e-a86e-0722e9d83f5a tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:38.521920 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f77142a4-ba7d-4c9e-a86e-0722e9d83f5a tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:38.650838 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-f77142a4-ba7d-4c9e-a86e-0722e9d83f5a tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0c29696e24390a5492804e0948010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6b6775bdd84b24bf7a5ce051e30998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:03:38.658898 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-f77142a4-ba7d-4c9e-a86e-0722e9d83f5a tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "GET /compute/v2.1/servers/760c06a0-528e-496f-b494-d70f10a1b95a" status: 200 len: 1391 microversion: 2.1 time: 0.151499 Sep 14 10:03:38.659518 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3447/7470] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:03:38 2022] GET /compute/v2.1/servers/760c06a0-528e-496f-b494-d70f10a1b95a => generated 1391 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:03:39.682975 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-bd8afc0e-038c-47fc-85b4-ab5e1382fd8c tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:03:39.683525 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-bd8afc0e-038c-47fc-85b4-ab5e1382fd8c tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 760c06a0-528e-496f-b494-d70f10a1b95a] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:03:39.690427 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bd8afc0e-038c-47fc-85b4-ab5e1382fd8c tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:39.690913 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bd8afc0e-038c-47fc-85b4-ab5e1382fd8c tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:39.691388 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bd8afc0e-038c-47fc-85b4-ab5e1382fd8c tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:39.692089 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bd8afc0e-038c-47fc-85b4-ab5e1382fd8c tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:39.692546 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bd8afc0e-038c-47fc-85b4-ab5e1382fd8c tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:39.692966 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bd8afc0e-038c-47fc-85b4-ab5e1382fd8c tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:39.827308 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-bd8afc0e-038c-47fc-85b4-ab5e1382fd8c tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0c29696e24390a5492804e0948010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6b6775bdd84b24bf7a5ce051e30998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:03:39.835409 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-bd8afc0e-038c-47fc-85b4-ab5e1382fd8c tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "GET /compute/v2.1/servers/760c06a0-528e-496f-b494-d70f10a1b95a" status: 200 len: 1391 microversion: 2.1 time: 0.156455 Sep 14 10:03:39.836000 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4024/7471] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:03:39 2022] GET /compute/v2.1/servers/760c06a0-528e-496f-b494-d70f10a1b95a => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 10:03:40.858528 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-8e61cb21-9e41-47d3-8334-115152d27290 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:03:40.859188 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-8e61cb21-9e41-47d3-8334-115152d27290 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 760c06a0-528e-496f-b494-d70f10a1b95a] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:03:40.866111 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8e61cb21-9e41-47d3-8334-115152d27290 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:40.866603 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8e61cb21-9e41-47d3-8334-115152d27290 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:40.867087 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8e61cb21-9e41-47d3-8334-115152d27290 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:40.867795 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8e61cb21-9e41-47d3-8334-115152d27290 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:40.868261 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8e61cb21-9e41-47d3-8334-115152d27290 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:40.868696 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8e61cb21-9e41-47d3-8334-115152d27290 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:41.003992 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-8e61cb21-9e41-47d3-8334-115152d27290 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0c29696e24390a5492804e0948010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6b6775bdd84b24bf7a5ce051e30998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:03:41.012175 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-8e61cb21-9e41-47d3-8334-115152d27290 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "GET /compute/v2.1/servers/760c06a0-528e-496f-b494-d70f10a1b95a" status: 200 len: 1391 microversion: 2.1 time: 0.157616 Sep 14 10:03:41.012749 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3448/7472] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:03:40 2022] GET /compute/v2.1/servers/760c06a0-528e-496f-b494-d70f10a1b95a => generated 1391 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:03:41.260421 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-fc908c98-50ef-4d41-8430-e066764295b7 req-cb264828-d694-47da-b3b2-ecc098e438e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "760c06a0-528e-496f-b494-d70f10a1b95a", "name": "network-vif-plugged", "status": "completed", "tag": "f8382bf5-af57-4ebf-893f-c1df6fc729a9"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:03:41.270842 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-fc908c98-50ef-4d41-8430-e066764295b7 req-cb264828-d694-47da-b3b2-ecc098e438e2 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:41.271363 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-fc908c98-50ef-4d41-8430-e066764295b7 req-cb264828-d694-47da-b3b2-ecc098e438e2 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:41.271803 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-fc908c98-50ef-4d41-8430-e066764295b7 req-cb264828-d694-47da-b3b2-ecc098e438e2 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:41.282913 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-fc908c98-50ef-4d41-8430-e066764295b7 req-cb264828-d694-47da-b3b2-ecc098e438e2 service nova] Creating event network-vif-plugged:f8382bf5-af57-4ebf-893f-c1df6fc729a9 for instance 760c06a0-528e-496f-b494-d70f10a1b95a on n-h1-836830-18 Sep 14 10:03:41.288466 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-fc908c98-50ef-4d41-8430-e066764295b7 req-cb264828-d694-47da-b3b2-ecc098e438e2 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094528 Sep 14 10:03:41.289067 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4025/7473] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 10:03:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:03:42.036051 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ac20bdd0-ccbd-4422-8d1f-bc309168e64c tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:03:42.036638 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-ac20bdd0-ccbd-4422-8d1f-bc309168e64c tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 760c06a0-528e-496f-b494-d70f10a1b95a] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:03:42.038644 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=2 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:03:42.039350 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=6 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:03:42.040953 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=37,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:03:42.047694 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ac20bdd0-ccbd-4422-8d1f-bc309168e64c tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:42.048200 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ac20bdd0-ccbd-4422-8d1f-bc309168e64c tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:42.048657 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ac20bdd0-ccbd-4422-8d1f-bc309168e64c tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:42.049369 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ac20bdd0-ccbd-4422-8d1f-bc309168e64c tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:42.049844 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ac20bdd0-ccbd-4422-8d1f-bc309168e64c tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:42.050292 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ac20bdd0-ccbd-4422-8d1f-bc309168e64c tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:42.181642 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-ac20bdd0-ccbd-4422-8d1f-bc309168e64c tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0c29696e24390a5492804e0948010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6b6775bdd84b24bf7a5ce051e30998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:03:42.189872 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-ac20bdd0-ccbd-4422-8d1f-bc309168e64c tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "GET /compute/v2.1/servers/760c06a0-528e-496f-b494-d70f10a1b95a" status: 200 len: 1391 microversion: 2.1 time: 0.158208 Sep 14 10:03:42.190537 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3449/7474] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:03:42 2022] GET /compute/v2.1/servers/760c06a0-528e-496f-b494-d70f10a1b95a => generated 1391 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:03:43.210604 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=6 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:03:43.215824 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-fe14b257-43a5-4be0-8aa7-2e2a1d47350d tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:03:43.216541 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-fe14b257-43a5-4be0-8aa7-2e2a1d47350d tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 760c06a0-528e-496f-b494-d70f10a1b95a] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:03:43.223117 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fe14b257-43a5-4be0-8aa7-2e2a1d47350d tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:43.223865 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fe14b257-43a5-4be0-8aa7-2e2a1d47350d tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:43.224320 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fe14b257-43a5-4be0-8aa7-2e2a1d47350d tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:43.225016 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fe14b257-43a5-4be0-8aa7-2e2a1d47350d tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:43.225481 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fe14b257-43a5-4be0-8aa7-2e2a1d47350d tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:43.225914 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fe14b257-43a5-4be0-8aa7-2e2a1d47350d tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:43.362099 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-fe14b257-43a5-4be0-8aa7-2e2a1d47350d tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0c29696e24390a5492804e0948010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6b6775bdd84b24bf7a5ce051e30998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:03:43.370575 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-fe14b257-43a5-4be0-8aa7-2e2a1d47350d tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "GET /compute/v2.1/servers/760c06a0-528e-496f-b494-d70f10a1b95a" status: 200 len: 1563 microversion: 2.1 time: 0.161013 Sep 14 10:03:43.371211 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4026/7475] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:03:43 2022] GET /compute/v2.1/servers/760c06a0-528e-496f-b494-d70f10a1b95a => generated 1563 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:03:43.393221 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d3482486-78ba-4bbb-9995-c608f4bdebd1 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:03:43.393867 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-d3482486-78ba-4bbb-9995-c608f4bdebd1 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 760c06a0-528e-496f-b494-d70f10a1b95a] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:03:43.400821 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d3482486-78ba-4bbb-9995-c608f4bdebd1 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:43.401331 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d3482486-78ba-4bbb-9995-c608f4bdebd1 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:43.401793 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d3482486-78ba-4bbb-9995-c608f4bdebd1 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:43.402508 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d3482486-78ba-4bbb-9995-c608f4bdebd1 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:43.403014 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d3482486-78ba-4bbb-9995-c608f4bdebd1 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:43.403467 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d3482486-78ba-4bbb-9995-c608f4bdebd1 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:43.533728 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-d3482486-78ba-4bbb-9995-c608f4bdebd1 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0c29696e24390a5492804e0948010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6b6775bdd84b24bf7a5ce051e30998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:03:43.542395 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-d3482486-78ba-4bbb-9995-c608f4bdebd1 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "GET /compute/v2.1/servers/760c06a0-528e-496f-b494-d70f10a1b95a" status: 200 len: 1563 microversion: 2.1 time: 0.153260 Sep 14 10:03:43.542998 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3450/7476] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:03:43 2022] GET /compute/v2.1/servers/760c06a0-528e-496f-b494-d70f10a1b95a => generated 1563 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:03:45.434471 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-62e359b3-467d-4086-bb6b-360225da6790 req-1040e801-bb83-4cc4-9f87-e3f3ad4ea0bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "760c06a0-528e-496f-b494-d70f10a1b95a", "tag": "f8382bf5-af57-4ebf-893f-c1df6fc729a9"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:03:45.436905 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8c812850-2b6f-4d5f-ad1b-53d321953f7d tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:03:45.437532 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-8c812850-2b6f-4d5f-ad1b-53d321953f7d tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 760c06a0-528e-496f-b494-d70f10a1b95a] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:03:45.444824 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8c812850-2b6f-4d5f-ad1b-53d321953f7d tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:45.445601 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8c812850-2b6f-4d5f-ad1b-53d321953f7d tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:45.446472 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8c812850-2b6f-4d5f-ad1b-53d321953f7d tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:45.447368 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8c812850-2b6f-4d5f-ad1b-53d321953f7d tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:45.448413 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8c812850-2b6f-4d5f-ad1b-53d321953f7d tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:45.450276 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8c812850-2b6f-4d5f-ad1b-53d321953f7d tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:45.451632 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-62e359b3-467d-4086-bb6b-360225da6790 req-1040e801-bb83-4cc4-9f87-e3f3ad4ea0bb service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:45.452128 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-62e359b3-467d-4086-bb6b-360225da6790 req-1040e801-bb83-4cc4-9f87-e3f3ad4ea0bb service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:45.452578 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-62e359b3-467d-4086-bb6b-360225da6790 req-1040e801-bb83-4cc4-9f87-e3f3ad4ea0bb service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:45.468424 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-62e359b3-467d-4086-bb6b-360225da6790 req-1040e801-bb83-4cc4-9f87-e3f3ad4ea0bb service nova] Creating event network-changed:f8382bf5-af57-4ebf-893f-c1df6fc729a9 for instance 760c06a0-528e-496f-b494-d70f10a1b95a on n-h1-836830-18 Sep 14 10:03:45.474192 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-62e359b3-467d-4086-bb6b-360225da6790 req-1040e801-bb83-4cc4-9f87-e3f3ad4ea0bb service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042966 Sep 14 10:03:45.474976 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3451/7477] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 10:03:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:03:45.670652 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-8c812850-2b6f-4d5f-ad1b-53d321953f7d tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0c29696e24390a5492804e0948010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6b6775bdd84b24bf7a5ce051e30998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:03:45.679459 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-8c812850-2b6f-4d5f-ad1b-53d321953f7d tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "GET /compute/v2.1/servers/760c06a0-528e-496f-b494-d70f10a1b95a" status: 200 len: 1563 microversion: 2.1 time: 0.252344 Sep 14 10:03:45.680246 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4027/7478] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:03:45 2022] GET /compute/v2.1/servers/760c06a0-528e-496f-b494-d70f10a1b95a => generated 1563 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:04:16.967249 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c800fb02-13cf-451d-bffc-5c0874f0f8e1 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:04:16.969648 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-c800fb02-13cf-451d-bffc-5c0874f0f8e1 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 760c06a0-528e-496f-b494-d70f10a1b95a] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:04:16.972179 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=5 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:04:16.973164 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=42 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:04:16.980478 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c800fb02-13cf-451d-bffc-5c0874f0f8e1 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:04:16.980978 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c800fb02-13cf-451d-bffc-5c0874f0f8e1 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:04:16.981432 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c800fb02-13cf-451d-bffc-5c0874f0f8e1 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:04:16.982139 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c800fb02-13cf-451d-bffc-5c0874f0f8e1 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:04:16.982610 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c800fb02-13cf-451d-bffc-5c0874f0f8e1 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:04:16.983082 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c800fb02-13cf-451d-bffc-5c0874f0f8e1 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:04:17.050966 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-c800fb02-13cf-451d-bffc-5c0874f0f8e1 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "POST /compute/v2.1/servers/760c06a0-528e-496f-b494-d70f10a1b95a/action" status: 200 len: 24566 microversion: 2.1 time: 0.087853 Sep 14 10:04:17.051619 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3452/7479] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 10:04:16 2022] POST /compute/v2.1/servers/760c06a0-528e-496f-b494-d70f10a1b95a/action => generated 24566 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 10:04:47.269041 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:04:47.269805 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=38 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:04:47.274518 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-29150239-b187-4bfe-b253-abbf815c3c93 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:04:47.276927 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-29150239-b187-4bfe-b253-abbf815c3c93 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 760c06a0-528e-496f-b494-d70f10a1b95a] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:04:47.284411 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-29150239-b187-4bfe-b253-abbf815c3c93 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:04:47.284909 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-29150239-b187-4bfe-b253-abbf815c3c93 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:04:47.285354 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-29150239-b187-4bfe-b253-abbf815c3c93 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:04:47.286055 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-29150239-b187-4bfe-b253-abbf815c3c93 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:04:47.286517 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-29150239-b187-4bfe-b253-abbf815c3c93 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:04:47.286973 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-29150239-b187-4bfe-b253-abbf815c3c93 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:04:47.328691 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-29150239-b187-4bfe-b253-abbf815c3c93 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'caa0c29696e24390a5492804e0948010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6b6775bdd84b24bf7a5ce051e30998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:04:47.334645 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-29150239-b187-4bfe-b253-abbf815c3c93 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 760c06a0-528e-496f-b494-d70f10a1b95a] Old instance type m1.heat2, new instance type m1.heat {{(pid=128759) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 14 10:04:47.341313 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-29150239-b187-4bfe-b253-abbf815c3c93 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Flavor limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 10:04:47.341748 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-29150239-b187-4bfe-b253-abbf815c3c93 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Image limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 10:04:47.342230 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-29150239-b187-4bfe-b253-abbf815c3c93 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Flavor pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 10:04:47.342649 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-29150239-b187-4bfe-b253-abbf815c3c93 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Image pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 10:04:47.343119 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-29150239-b187-4bfe-b253-abbf815c3c93 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 10:04:47.408036 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-29150239-b187-4bfe-b253-abbf815c3c93 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "POST /compute/v2.1/servers/760c06a0-528e-496f-b494-d70f10a1b95a/action" status: 202 len: 0 microversion: 2.1 time: 0.140969 Sep 14 10:04:47.408961 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4028/7480] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 10:04:47 2022] POST /compute/v2.1/servers/760c06a0-528e-496f-b494-d70f10a1b95a/action => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 10:04:47.417794 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-79f678bd-5d02-410b-9af1-7cb18e3adf85 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:04:47.418530 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-79f678bd-5d02-410b-9af1-7cb18e3adf85 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 760c06a0-528e-496f-b494-d70f10a1b95a] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:04:47.421253 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=2 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:04:47.422037 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=4 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:04:47.428365 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-79f678bd-5d02-410b-9af1-7cb18e3adf85 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:04:47.428869 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-79f678bd-5d02-410b-9af1-7cb18e3adf85 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:04:47.429362 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-79f678bd-5d02-410b-9af1-7cb18e3adf85 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:04:47.430586 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-79f678bd-5d02-410b-9af1-7cb18e3adf85 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:04:47.431096 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-79f678bd-5d02-410b-9af1-7cb18e3adf85 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:04:47.431551 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-79f678bd-5d02-410b-9af1-7cb18e3adf85 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:04:47.591260 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-79f678bd-5d02-410b-9af1-7cb18e3adf85 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0c29696e24390a5492804e0948010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6b6775bdd84b24bf7a5ce051e30998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:04:47.599479 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-79f678bd-5d02-410b-9af1-7cb18e3adf85 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "GET /compute/v2.1/servers/760c06a0-528e-496f-b494-d70f10a1b95a" status: 200 len: 1691 microversion: 2.1 time: 0.185746 Sep 14 10:04:47.600062 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3453/7481] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:04:47 2022] GET /compute/v2.1/servers/760c06a0-528e-496f-b494-d70f10a1b95a => generated 1691 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:04:48.626054 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-eeb14a60-cb2d-4754-abbf-52518bf7617d tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:04:48.626689 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-eeb14a60-cb2d-4754-abbf-52518bf7617d tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 760c06a0-528e-496f-b494-d70f10a1b95a] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:04:48.633877 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-eeb14a60-cb2d-4754-abbf-52518bf7617d tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:04:48.634374 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-eeb14a60-cb2d-4754-abbf-52518bf7617d tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:04:48.634825 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-eeb14a60-cb2d-4754-abbf-52518bf7617d tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:04:48.635553 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-eeb14a60-cb2d-4754-abbf-52518bf7617d tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:04:48.636017 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-eeb14a60-cb2d-4754-abbf-52518bf7617d tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:04:48.636456 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-eeb14a60-cb2d-4754-abbf-52518bf7617d tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:04:48.769952 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-eeb14a60-cb2d-4754-abbf-52518bf7617d tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0c29696e24390a5492804e0948010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6b6775bdd84b24bf7a5ce051e30998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:04:48.777684 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-eeb14a60-cb2d-4754-abbf-52518bf7617d tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "GET /compute/v2.1/servers/760c06a0-528e-496f-b494-d70f10a1b95a" status: 200 len: 1691 microversion: 2.1 time: 0.156590 Sep 14 10:04:48.778265 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4029/7482] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:04:48 2022] GET /compute/v2.1/servers/760c06a0-528e-496f-b494-d70f10a1b95a => generated 1691 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:04:49.801296 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-f8317005-b475-4eb5-8164-3ddf501dfe9b tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:04:49.801967 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-f8317005-b475-4eb5-8164-3ddf501dfe9b tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 760c06a0-528e-496f-b494-d70f10a1b95a] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:04:49.809349 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f8317005-b475-4eb5-8164-3ddf501dfe9b tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:04:49.809792 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f8317005-b475-4eb5-8164-3ddf501dfe9b tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:04:49.810244 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f8317005-b475-4eb5-8164-3ddf501dfe9b tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:04:49.810959 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f8317005-b475-4eb5-8164-3ddf501dfe9b tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:04:49.811447 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f8317005-b475-4eb5-8164-3ddf501dfe9b tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:04:49.811893 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f8317005-b475-4eb5-8164-3ddf501dfe9b tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:04:49.945439 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-f8317005-b475-4eb5-8164-3ddf501dfe9b tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0c29696e24390a5492804e0948010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6b6775bdd84b24bf7a5ce051e30998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:04:49.953811 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-f8317005-b475-4eb5-8164-3ddf501dfe9b tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "GET /compute/v2.1/servers/760c06a0-528e-496f-b494-d70f10a1b95a" status: 200 len: 1691 microversion: 2.1 time: 0.156764 Sep 14 10:04:49.954388 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3454/7483] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:04:49 2022] GET /compute/v2.1/servers/760c06a0-528e-496f-b494-d70f10a1b95a => generated 1691 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:04:50.978570 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c860174e-bccb-4904-bf51-fe4728de9f9f tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:04:50.979233 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-c860174e-bccb-4904-bf51-fe4728de9f9f tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 760c06a0-528e-496f-b494-d70f10a1b95a] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:04:50.986130 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c860174e-bccb-4904-bf51-fe4728de9f9f tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:04:50.986628 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c860174e-bccb-4904-bf51-fe4728de9f9f tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:04:50.987114 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c860174e-bccb-4904-bf51-fe4728de9f9f tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:04:50.987818 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c860174e-bccb-4904-bf51-fe4728de9f9f tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:04:50.988279 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c860174e-bccb-4904-bf51-fe4728de9f9f tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:04:50.988714 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c860174e-bccb-4904-bf51-fe4728de9f9f tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:04:51.123082 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-c860174e-bccb-4904-bf51-fe4728de9f9f tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0c29696e24390a5492804e0948010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6b6775bdd84b24bf7a5ce051e30998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:04:51.130924 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-c860174e-bccb-4904-bf51-fe4728de9f9f tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "GET /compute/v2.1/servers/760c06a0-528e-496f-b494-d70f10a1b95a" status: 200 len: 1691 microversion: 2.1 time: 0.157163 Sep 14 10:04:51.131518 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4030/7484] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:04:50 2022] GET /compute/v2.1/servers/760c06a0-528e-496f-b494-d70f10a1b95a => generated 1691 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:04:52.157746 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-126daa7b-a216-4da8-b555-6685b90c0603 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:04:52.158310 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-126daa7b-a216-4da8-b555-6685b90c0603 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 760c06a0-528e-496f-b494-d70f10a1b95a] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:04:52.165427 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-126daa7b-a216-4da8-b555-6685b90c0603 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:04:52.165932 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-126daa7b-a216-4da8-b555-6685b90c0603 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:04:52.166478 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-126daa7b-a216-4da8-b555-6685b90c0603 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:04:52.167339 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-126daa7b-a216-4da8-b555-6685b90c0603 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:04:52.167824 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-126daa7b-a216-4da8-b555-6685b90c0603 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:04:52.168271 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-126daa7b-a216-4da8-b555-6685b90c0603 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:04:52.298619 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-126daa7b-a216-4da8-b555-6685b90c0603 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0c29696e24390a5492804e0948010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6b6775bdd84b24bf7a5ce051e30998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:04:52.307031 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-126daa7b-a216-4da8-b555-6685b90c0603 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "GET /compute/v2.1/servers/760c06a0-528e-496f-b494-d70f10a1b95a" status: 200 len: 1691 microversion: 2.1 time: 0.153477 Sep 14 10:04:52.307613 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3455/7485] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:04:52 2022] GET /compute/v2.1/servers/760c06a0-528e-496f-b494-d70f10a1b95a => generated 1691 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:04:53.329867 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b19acdb4-8bb8-4d08-9292-75c21e35ee1a tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:04:53.330622 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b19acdb4-8bb8-4d08-9292-75c21e35ee1a tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 760c06a0-528e-496f-b494-d70f10a1b95a] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:04:53.337628 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b19acdb4-8bb8-4d08-9292-75c21e35ee1a tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:04:53.338148 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b19acdb4-8bb8-4d08-9292-75c21e35ee1a tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:04:53.338575 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b19acdb4-8bb8-4d08-9292-75c21e35ee1a tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:04:53.339313 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b19acdb4-8bb8-4d08-9292-75c21e35ee1a tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:04:53.339807 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b19acdb4-8bb8-4d08-9292-75c21e35ee1a tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:04:53.340226 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b19acdb4-8bb8-4d08-9292-75c21e35ee1a tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:04:53.554243 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b19acdb4-8bb8-4d08-9292-75c21e35ee1a tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0c29696e24390a5492804e0948010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6b6775bdd84b24bf7a5ce051e30998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:04:53.565440 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b19acdb4-8bb8-4d08-9292-75c21e35ee1a tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "GET /compute/v2.1/servers/760c06a0-528e-496f-b494-d70f10a1b95a" status: 200 len: 1691 microversion: 2.1 time: 0.239540 Sep 14 10:04:53.568374 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4031/7486] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:04:53 2022] GET /compute/v2.1/servers/760c06a0-528e-496f-b494-d70f10a1b95a => generated 1691 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:04:54.590580 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-3e8718b5-8010-45cd-bdd2-1128138e161c tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:04:54.591265 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-3e8718b5-8010-45cd-bdd2-1128138e161c tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 760c06a0-528e-496f-b494-d70f10a1b95a] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:04:54.598160 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3e8718b5-8010-45cd-bdd2-1128138e161c tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:04:54.598664 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3e8718b5-8010-45cd-bdd2-1128138e161c tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:04:54.599153 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3e8718b5-8010-45cd-bdd2-1128138e161c tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:04:54.600130 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3e8718b5-8010-45cd-bdd2-1128138e161c tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:04:54.600603 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3e8718b5-8010-45cd-bdd2-1128138e161c tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:04:54.601050 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3e8718b5-8010-45cd-bdd2-1128138e161c tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:04:54.732837 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-3e8718b5-8010-45cd-bdd2-1128138e161c tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0c29696e24390a5492804e0948010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6b6775bdd84b24bf7a5ce051e30998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:04:54.740851 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-3e8718b5-8010-45cd-bdd2-1128138e161c tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "GET /compute/v2.1/servers/760c06a0-528e-496f-b494-d70f10a1b95a" status: 200 len: 1696 microversion: 2.1 time: 0.154960 Sep 14 10:04:54.741440 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3456/7487] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:04:54 2022] GET /compute/v2.1/servers/760c06a0-528e-496f-b494-d70f10a1b95a => generated 1696 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:04:55.764783 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-881e4ff1-6668-4209-a6ec-7e77d6e9527e tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:04:55.765419 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-881e4ff1-6668-4209-a6ec-7e77d6e9527e tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 760c06a0-528e-496f-b494-d70f10a1b95a] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:04:55.772289 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-881e4ff1-6668-4209-a6ec-7e77d6e9527e tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:04:55.772784 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-881e4ff1-6668-4209-a6ec-7e77d6e9527e tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:04:55.773232 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-881e4ff1-6668-4209-a6ec-7e77d6e9527e tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:04:55.774438 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-881e4ff1-6668-4209-a6ec-7e77d6e9527e tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:04:55.774963 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-881e4ff1-6668-4209-a6ec-7e77d6e9527e tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:04:55.775407 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-881e4ff1-6668-4209-a6ec-7e77d6e9527e tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:04:55.908924 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-881e4ff1-6668-4209-a6ec-7e77d6e9527e tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0c29696e24390a5492804e0948010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6b6775bdd84b24bf7a5ce051e30998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:04:55.917513 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-881e4ff1-6668-4209-a6ec-7e77d6e9527e tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "GET /compute/v2.1/servers/760c06a0-528e-496f-b494-d70f10a1b95a" status: 200 len: 1696 microversion: 2.1 time: 0.156688 Sep 14 10:04:55.918091 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4032/7488] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:04:55 2022] GET /compute/v2.1/servers/760c06a0-528e-496f-b494-d70f10a1b95a => generated 1696 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:04:56.941331 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-e26e6bd4-738f-405a-97d7-a54f591a7e42 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:04:56.941981 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-e26e6bd4-738f-405a-97d7-a54f591a7e42 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 760c06a0-528e-496f-b494-d70f10a1b95a] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:04:56.949430 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e26e6bd4-738f-405a-97d7-a54f591a7e42 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:04:56.949939 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e26e6bd4-738f-405a-97d7-a54f591a7e42 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:04:56.950401 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e26e6bd4-738f-405a-97d7-a54f591a7e42 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:04:56.951147 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e26e6bd4-738f-405a-97d7-a54f591a7e42 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:04:56.951624 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e26e6bd4-738f-405a-97d7-a54f591a7e42 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:04:56.952072 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e26e6bd4-738f-405a-97d7-a54f591a7e42 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:04:57.086414 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-e26e6bd4-738f-405a-97d7-a54f591a7e42 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0c29696e24390a5492804e0948010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6b6775bdd84b24bf7a5ce051e30998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:04:57.094315 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-e26e6bd4-738f-405a-97d7-a54f591a7e42 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "GET /compute/v2.1/servers/760c06a0-528e-496f-b494-d70f10a1b95a" status: 200 len: 1696 microversion: 2.1 time: 0.156968 Sep 14 10:04:57.094899 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3457/7489] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:04:56 2022] GET /compute/v2.1/servers/760c06a0-528e-496f-b494-d70f10a1b95a => generated 1696 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:04:58.117916 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-70cf3462-aa87-4255-8b7b-10a99dd386ac tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:04:58.118531 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-70cf3462-aa87-4255-8b7b-10a99dd386ac tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 760c06a0-528e-496f-b494-d70f10a1b95a] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:04:58.125919 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-70cf3462-aa87-4255-8b7b-10a99dd386ac tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:04:58.126492 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-70cf3462-aa87-4255-8b7b-10a99dd386ac tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:04:58.126993 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-70cf3462-aa87-4255-8b7b-10a99dd386ac tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:04:58.127807 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-70cf3462-aa87-4255-8b7b-10a99dd386ac tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:04:58.128333 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-70cf3462-aa87-4255-8b7b-10a99dd386ac tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:04:58.128775 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-70cf3462-aa87-4255-8b7b-10a99dd386ac tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:04:58.261381 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-70cf3462-aa87-4255-8b7b-10a99dd386ac tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0c29696e24390a5492804e0948010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6b6775bdd84b24bf7a5ce051e30998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:04:58.269227 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-70cf3462-aa87-4255-8b7b-10a99dd386ac tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "GET /compute/v2.1/servers/760c06a0-528e-496f-b494-d70f10a1b95a" status: 200 len: 1696 microversion: 2.1 time: 0.155316 Sep 14 10:04:58.269806 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4033/7490] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:04:58 2022] GET /compute/v2.1/servers/760c06a0-528e-496f-b494-d70f10a1b95a => generated 1696 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:04:59.292963 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-6be939b7-a5c2-48ce-89ea-8f70ad6d10ba tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:04:59.293516 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-6be939b7-a5c2-48ce-89ea-8f70ad6d10ba tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 760c06a0-528e-496f-b494-d70f10a1b95a] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:04:59.301455 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6be939b7-a5c2-48ce-89ea-8f70ad6d10ba tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:04:59.301957 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6be939b7-a5c2-48ce-89ea-8f70ad6d10ba tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:04:59.302411 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6be939b7-a5c2-48ce-89ea-8f70ad6d10ba tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:04:59.303158 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6be939b7-a5c2-48ce-89ea-8f70ad6d10ba tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:04:59.303634 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6be939b7-a5c2-48ce-89ea-8f70ad6d10ba tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:04:59.304077 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6be939b7-a5c2-48ce-89ea-8f70ad6d10ba tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:04:59.442246 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-6be939b7-a5c2-48ce-89ea-8f70ad6d10ba tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0c29696e24390a5492804e0948010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6b6775bdd84b24bf7a5ce051e30998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:04:59.451915 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-6be939b7-a5c2-48ce-89ea-8f70ad6d10ba tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "GET /compute/v2.1/servers/760c06a0-528e-496f-b494-d70f10a1b95a" status: 200 len: 1696 microversion: 2.1 time: 0.163027 Sep 14 10:04:59.452508 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3458/7491] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:04:59 2022] GET /compute/v2.1/servers/760c06a0-528e-496f-b494-d70f10a1b95a => generated 1696 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:05:00.476543 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-0d85d464-5d3f-4957-9b7e-15f2e0eef970 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:05:00.477092 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-0d85d464-5d3f-4957-9b7e-15f2e0eef970 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 760c06a0-528e-496f-b494-d70f10a1b95a] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:05:00.484692 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0d85d464-5d3f-4957-9b7e-15f2e0eef970 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:00.485189 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0d85d464-5d3f-4957-9b7e-15f2e0eef970 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:00.485635 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0d85d464-5d3f-4957-9b7e-15f2e0eef970 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:00.486337 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0d85d464-5d3f-4957-9b7e-15f2e0eef970 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:00.486798 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0d85d464-5d3f-4957-9b7e-15f2e0eef970 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:00.487260 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0d85d464-5d3f-4957-9b7e-15f2e0eef970 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:00.619524 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-0d85d464-5d3f-4957-9b7e-15f2e0eef970 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0c29696e24390a5492804e0948010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6b6775bdd84b24bf7a5ce051e30998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:00.627418 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-0d85d464-5d3f-4957-9b7e-15f2e0eef970 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "GET /compute/v2.1/servers/760c06a0-528e-496f-b494-d70f10a1b95a" status: 200 len: 1696 microversion: 2.1 time: 0.155153 Sep 14 10:05:00.628008 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4034/7492] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:05:00 2022] GET /compute/v2.1/servers/760c06a0-528e-496f-b494-d70f10a1b95a => generated 1696 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:05:01.651479 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d10959e6-179e-4aeb-8802-f43f66e3f001 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:05:01.652179 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-d10959e6-179e-4aeb-8802-f43f66e3f001 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 760c06a0-528e-496f-b494-d70f10a1b95a] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:05:01.659071 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d10959e6-179e-4aeb-8802-f43f66e3f001 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:01.659588 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d10959e6-179e-4aeb-8802-f43f66e3f001 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:01.660050 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d10959e6-179e-4aeb-8802-f43f66e3f001 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:01.660769 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d10959e6-179e-4aeb-8802-f43f66e3f001 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:01.661246 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d10959e6-179e-4aeb-8802-f43f66e3f001 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:01.661695 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d10959e6-179e-4aeb-8802-f43f66e3f001 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:01.798396 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-d10959e6-179e-4aeb-8802-f43f66e3f001 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0c29696e24390a5492804e0948010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6b6775bdd84b24bf7a5ce051e30998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:01.806780 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-d10959e6-179e-4aeb-8802-f43f66e3f001 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "GET /compute/v2.1/servers/760c06a0-528e-496f-b494-d70f10a1b95a" status: 200 len: 1696 microversion: 2.1 time: 0.159341 Sep 14 10:05:01.807403 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3459/7493] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:05:01 2022] GET /compute/v2.1/servers/760c06a0-528e-496f-b494-d70f10a1b95a => generated 1696 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:05:02.830776 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-729a12f3-43a8-4679-9a78-e9c1ec532f58 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:05:02.831435 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-729a12f3-43a8-4679-9a78-e9c1ec532f58 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 760c06a0-528e-496f-b494-d70f10a1b95a] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:05:02.838895 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-729a12f3-43a8-4679-9a78-e9c1ec532f58 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:02.839420 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-729a12f3-43a8-4679-9a78-e9c1ec532f58 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:02.839866 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-729a12f3-43a8-4679-9a78-e9c1ec532f58 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:02.840560 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-729a12f3-43a8-4679-9a78-e9c1ec532f58 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:02.841019 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-729a12f3-43a8-4679-9a78-e9c1ec532f58 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:02.841448 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-729a12f3-43a8-4679-9a78-e9c1ec532f58 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:02.978372 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-729a12f3-43a8-4679-9a78-e9c1ec532f58 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0c29696e24390a5492804e0948010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6b6775bdd84b24bf7a5ce051e30998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:02.986276 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-729a12f3-43a8-4679-9a78-e9c1ec532f58 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "GET /compute/v2.1/servers/760c06a0-528e-496f-b494-d70f10a1b95a" status: 200 len: 1696 microversion: 2.1 time: 0.159458 Sep 14 10:05:02.986861 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4035/7494] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:05:02 2022] GET /compute/v2.1/servers/760c06a0-528e-496f-b494-d70f10a1b95a => generated 1696 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:05:04.010054 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c52d43ee-0f2d-4a31-891d-3c465f591efe tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:05:04.010680 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-c52d43ee-0f2d-4a31-891d-3c465f591efe tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 760c06a0-528e-496f-b494-d70f10a1b95a] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:05:04.017544 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c52d43ee-0f2d-4a31-891d-3c465f591efe tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:04.018043 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c52d43ee-0f2d-4a31-891d-3c465f591efe tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:04.018493 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c52d43ee-0f2d-4a31-891d-3c465f591efe tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:04.019295 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c52d43ee-0f2d-4a31-891d-3c465f591efe tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:04.019795 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c52d43ee-0f2d-4a31-891d-3c465f591efe tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:04.020239 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c52d43ee-0f2d-4a31-891d-3c465f591efe tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:04.151340 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-c52d43ee-0f2d-4a31-891d-3c465f591efe tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0c29696e24390a5492804e0948010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6b6775bdd84b24bf7a5ce051e30998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:04.159095 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-c52d43ee-0f2d-4a31-891d-3c465f591efe tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "GET /compute/v2.1/servers/760c06a0-528e-496f-b494-d70f10a1b95a" status: 200 len: 1696 microversion: 2.1 time: 0.153167 Sep 14 10:05:04.159676 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3460/7495] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:05:04 2022] GET /compute/v2.1/servers/760c06a0-528e-496f-b494-d70f10a1b95a => generated 1696 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:05:05.182303 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c9899dfe-65ec-4baf-a863-38e71eea8d81 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:05:05.182916 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-c9899dfe-65ec-4baf-a863-38e71eea8d81 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 760c06a0-528e-496f-b494-d70f10a1b95a] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:05:05.189753 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c9899dfe-65ec-4baf-a863-38e71eea8d81 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:05.190235 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c9899dfe-65ec-4baf-a863-38e71eea8d81 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:05.190673 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c9899dfe-65ec-4baf-a863-38e71eea8d81 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:05.191387 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c9899dfe-65ec-4baf-a863-38e71eea8d81 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:05.191842 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c9899dfe-65ec-4baf-a863-38e71eea8d81 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:05.192269 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c9899dfe-65ec-4baf-a863-38e71eea8d81 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:05.326417 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-c9899dfe-65ec-4baf-a863-38e71eea8d81 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0c29696e24390a5492804e0948010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6b6775bdd84b24bf7a5ce051e30998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:05.334372 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-c9899dfe-65ec-4baf-a863-38e71eea8d81 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "GET /compute/v2.1/servers/760c06a0-528e-496f-b494-d70f10a1b95a" status: 200 len: 1696 microversion: 2.1 time: 0.156624 Sep 14 10:05:05.334980 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4036/7496] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:05:05 2022] GET /compute/v2.1/servers/760c06a0-528e-496f-b494-d70f10a1b95a => generated 1696 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:05:06.294813 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-34e5bb15-785a-489a-94ad-6400e2186939 req-a08e22e5-780a-4443-8ee9-fbb614ee471d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "760c06a0-528e-496f-b494-d70f10a1b95a", "name": "network-vif-unplugged", "status": "completed", "tag": "f8382bf5-af57-4ebf-893f-c1df6fc729a9"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:05:06.305114 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-34e5bb15-785a-489a-94ad-6400e2186939 req-a08e22e5-780a-4443-8ee9-fbb614ee471d service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:06.305615 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-34e5bb15-785a-489a-94ad-6400e2186939 req-a08e22e5-780a-4443-8ee9-fbb614ee471d service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:06.306578 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-34e5bb15-785a-489a-94ad-6400e2186939 req-a08e22e5-780a-4443-8ee9-fbb614ee471d service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:06.319538 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-34e5bb15-785a-489a-94ad-6400e2186939 req-a08e22e5-780a-4443-8ee9-fbb614ee471d service nova] Creating event network-vif-unplugged:f8382bf5-af57-4ebf-893f-c1df6fc729a9 for instance 760c06a0-528e-496f-b494-d70f10a1b95a on n-h2-836830-18 Sep 14 10:05:06.325878 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [req-34e5bb15-785a-489a-94ad-6400e2186939 req-a08e22e5-780a-4443-8ee9-fbb614ee471d service nova] Instance 760c06a0-528e-496f-b494-d70f10a1b95a is migrating within the same cell, copying events to all relevant hosts: {'n-h1-836830-18', 'n-h2-836830-18'} {{(pid=128758) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 14 10:05:06.337085 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-34e5bb15-785a-489a-94ad-6400e2186939 req-a08e22e5-780a-4443-8ee9-fbb614ee471d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.100441 Sep 14 10:05:06.337741 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3461/7497] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 10:05:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 10:05:06.357648 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-2f612270-c1ad-4e64-b93c-de7e2874f652 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:05:06.358411 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-2f612270-c1ad-4e64-b93c-de7e2874f652 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 760c06a0-528e-496f-b494-d70f10a1b95a] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:05:06.365275 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2f612270-c1ad-4e64-b93c-de7e2874f652 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:06.365769 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2f612270-c1ad-4e64-b93c-de7e2874f652 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:06.366218 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2f612270-c1ad-4e64-b93c-de7e2874f652 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:06.366929 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2f612270-c1ad-4e64-b93c-de7e2874f652 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:06.367415 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2f612270-c1ad-4e64-b93c-de7e2874f652 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:06.367854 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2f612270-c1ad-4e64-b93c-de7e2874f652 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:06.595521 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-2f612270-c1ad-4e64-b93c-de7e2874f652 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0c29696e24390a5492804e0948010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6b6775bdd84b24bf7a5ce051e30998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:06.604158 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-2f612270-c1ad-4e64-b93c-de7e2874f652 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "GET /compute/v2.1/servers/760c06a0-528e-496f-b494-d70f10a1b95a" status: 200 len: 1695 microversion: 2.1 time: 0.250414 Sep 14 10:05:06.621244 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4037/7498] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:05:06 2022] GET /compute/v2.1/servers/760c06a0-528e-496f-b494-d70f10a1b95a => generated 1695 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:05:07.630959 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-567d901f-c774-427c-878a-97105c1ecb26 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:05:07.631721 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-567d901f-c774-427c-878a-97105c1ecb26 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 760c06a0-528e-496f-b494-d70f10a1b95a] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:05:07.638738 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-567d901f-c774-427c-878a-97105c1ecb26 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:07.639281 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-567d901f-c774-427c-878a-97105c1ecb26 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:07.639744 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-567d901f-c774-427c-878a-97105c1ecb26 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:07.640492 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-567d901f-c774-427c-878a-97105c1ecb26 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:07.640969 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-567d901f-c774-427c-878a-97105c1ecb26 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:07.641447 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-567d901f-c774-427c-878a-97105c1ecb26 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:07.784546 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-567d901f-c774-427c-878a-97105c1ecb26 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0c29696e24390a5492804e0948010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6b6775bdd84b24bf7a5ce051e30998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:07.792477 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-567d901f-c774-427c-878a-97105c1ecb26 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "GET /compute/v2.1/servers/760c06a0-528e-496f-b494-d70f10a1b95a" status: 200 len: 1693 microversion: 2.1 time: 0.166765 Sep 14 10:05:07.793060 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3462/7499] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:05:07 2022] GET /compute/v2.1/servers/760c06a0-528e-496f-b494-d70f10a1b95a => generated 1693 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:05:08.354469 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-5a01451d-0ed3-4f93-9669-f231aade5113 req-63229681-4f09-4fc3-ad41-9074d10d860d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "760c06a0-528e-496f-b494-d70f10a1b95a", "tag": "f8382bf5-af57-4ebf-893f-c1df6fc729a9"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:05:08.364542 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-5a01451d-0ed3-4f93-9669-f231aade5113 req-63229681-4f09-4fc3-ad41-9074d10d860d service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:08.365024 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-5a01451d-0ed3-4f93-9669-f231aade5113 req-63229681-4f09-4fc3-ad41-9074d10d860d service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:08.365462 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-5a01451d-0ed3-4f93-9669-f231aade5113 req-63229681-4f09-4fc3-ad41-9074d10d860d service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:08.380619 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-5a01451d-0ed3-4f93-9669-f231aade5113 req-63229681-4f09-4fc3-ad41-9074d10d860d service nova] Creating event network-changed:f8382bf5-af57-4ebf-893f-c1df6fc729a9 for instance 760c06a0-528e-496f-b494-d70f10a1b95a on n-h2-836830-18 Sep 14 10:05:08.386586 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [req-5a01451d-0ed3-4f93-9669-f231aade5113 req-63229681-4f09-4fc3-ad41-9074d10d860d service nova] Instance 760c06a0-528e-496f-b494-d70f10a1b95a is migrating within the same cell, copying events to all relevant hosts: {'n-h1-836830-18', 'n-h2-836830-18'} {{(pid=128759) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 14 10:05:08.397182 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-5a01451d-0ed3-4f93-9669-f231aade5113 req-63229681-4f09-4fc3-ad41-9074d10d860d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046527 Sep 14 10:05:08.397786 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4038/7500] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 10:05:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:05:08.817051 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-69685bf6-321a-4e38-8097-8b77ca339d4a tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:05:08.817694 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-69685bf6-321a-4e38-8097-8b77ca339d4a tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 760c06a0-528e-496f-b494-d70f10a1b95a] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:05:08.825049 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-69685bf6-321a-4e38-8097-8b77ca339d4a tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:08.825572 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-69685bf6-321a-4e38-8097-8b77ca339d4a tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:08.826033 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-69685bf6-321a-4e38-8097-8b77ca339d4a tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:08.826777 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-69685bf6-321a-4e38-8097-8b77ca339d4a tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:08.827304 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-69685bf6-321a-4e38-8097-8b77ca339d4a tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:08.827755 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-69685bf6-321a-4e38-8097-8b77ca339d4a tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:09.339171 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-69685bf6-321a-4e38-8097-8b77ca339d4a tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0c29696e24390a5492804e0948010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6b6775bdd84b24bf7a5ce051e30998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:09.347001 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-69685bf6-321a-4e38-8097-8b77ca339d4a tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "GET /compute/v2.1/servers/760c06a0-528e-496f-b494-d70f10a1b95a" status: 200 len: 1693 microversion: 2.1 time: 0.533849 Sep 14 10:05:09.347785 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3463/7501] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:05:08 2022] GET /compute/v2.1/servers/760c06a0-528e-496f-b494-d70f10a1b95a => generated 1693 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:05:10.373655 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-07891a69-55fe-43a1-a6fd-657857c1bec8 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:05:10.375044 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-07891a69-55fe-43a1-a6fd-657857c1bec8 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 760c06a0-528e-496f-b494-d70f10a1b95a] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:05:10.381204 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-07891a69-55fe-43a1-a6fd-657857c1bec8 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:10.381693 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-07891a69-55fe-43a1-a6fd-657857c1bec8 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:10.382138 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-07891a69-55fe-43a1-a6fd-657857c1bec8 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:10.382839 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-07891a69-55fe-43a1-a6fd-657857c1bec8 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:10.383327 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-07891a69-55fe-43a1-a6fd-657857c1bec8 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:10.383783 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-07891a69-55fe-43a1-a6fd-657857c1bec8 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:10.515852 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-07891a69-55fe-43a1-a6fd-657857c1bec8 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0c29696e24390a5492804e0948010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6b6775bdd84b24bf7a5ce051e30998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:10.523564 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-07891a69-55fe-43a1-a6fd-657857c1bec8 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "GET /compute/v2.1/servers/760c06a0-528e-496f-b494-d70f10a1b95a" status: 200 len: 1690 microversion: 2.1 time: 0.155820 Sep 14 10:05:10.524142 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4039/7502] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:05:10 2022] GET /compute/v2.1/servers/760c06a0-528e-496f-b494-d70f10a1b95a => generated 1690 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 10:05:10.546742 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a3ebaea8-3615-45dc-8686-ba1b391e44bf tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:05:10.547329 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-a3ebaea8-3615-45dc-8686-ba1b391e44bf tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 760c06a0-528e-496f-b494-d70f10a1b95a] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:05:10.554200 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a3ebaea8-3615-45dc-8686-ba1b391e44bf tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:10.554712 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a3ebaea8-3615-45dc-8686-ba1b391e44bf tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:10.555197 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a3ebaea8-3615-45dc-8686-ba1b391e44bf tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:10.556409 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a3ebaea8-3615-45dc-8686-ba1b391e44bf tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:10.557083 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a3ebaea8-3615-45dc-8686-ba1b391e44bf tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:10.557536 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a3ebaea8-3615-45dc-8686-ba1b391e44bf tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:10.620021 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-a3ebaea8-3615-45dc-8686-ba1b391e44bf tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "POST /compute/v2.1/servers/760c06a0-528e-496f-b494-d70f10a1b95a/action" status: 204 len: 0 microversion: 2.1 time: 0.076990 Sep 14 10:05:10.620672 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3464/7503] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 10:05:10 2022] POST /compute/v2.1/servers/760c06a0-528e-496f-b494-d70f10a1b95a/action => generated 0 bytes in 78 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 10:05:10.682841 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-5bb81966-8ea6-4681-8ba4-f2521bf8f130 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:05:10.683620 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-5bb81966-8ea6-4681-8ba4-f2521bf8f130 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 760c06a0-528e-496f-b494-d70f10a1b95a] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:05:10.690332 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5bb81966-8ea6-4681-8ba4-f2521bf8f130 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:10.691318 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5bb81966-8ea6-4681-8ba4-f2521bf8f130 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:10.691770 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5bb81966-8ea6-4681-8ba4-f2521bf8f130 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:10.692470 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5bb81966-8ea6-4681-8ba4-f2521bf8f130 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:10.692935 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5bb81966-8ea6-4681-8ba4-f2521bf8f130 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:10.693364 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5bb81966-8ea6-4681-8ba4-f2521bf8f130 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:10.919475 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-5bb81966-8ea6-4681-8ba4-f2521bf8f130 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0c29696e24390a5492804e0948010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6b6775bdd84b24bf7a5ce051e30998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:10.927326 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-5bb81966-8ea6-4681-8ba4-f2521bf8f130 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "GET /compute/v2.1/servers/760c06a0-528e-496f-b494-d70f10a1b95a" status: 200 len: 1690 microversion: 2.1 time: 0.302388 Sep 14 10:05:10.927908 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4040/7504] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:05:10 2022] GET /compute/v2.1/servers/760c06a0-528e-496f-b494-d70f10a1b95a => generated 1690 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:05:10.952121 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-fdd2136c-3b93-40a0-aaa6-09b712cb1a74 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:05:10.952845 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-fdd2136c-3b93-40a0-aaa6-09b712cb1a74 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 760c06a0-528e-496f-b494-d70f10a1b95a] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:05:10.959254 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fdd2136c-3b93-40a0-aaa6-09b712cb1a74 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:10.959762 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fdd2136c-3b93-40a0-aaa6-09b712cb1a74 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:10.960211 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fdd2136c-3b93-40a0-aaa6-09b712cb1a74 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:10.960931 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fdd2136c-3b93-40a0-aaa6-09b712cb1a74 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:10.961402 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fdd2136c-3b93-40a0-aaa6-09b712cb1a74 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:10.961844 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fdd2136c-3b93-40a0-aaa6-09b712cb1a74 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:11.178801 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-fdd2136c-3b93-40a0-aaa6-09b712cb1a74 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0c29696e24390a5492804e0948010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6b6775bdd84b24bf7a5ce051e30998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:11.187415 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-fdd2136c-3b93-40a0-aaa6-09b712cb1a74 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "GET /compute/v2.1/servers/760c06a0-528e-496f-b494-d70f10a1b95a" status: 200 len: 1690 microversion: 2.1 time: 0.240407 Sep 14 10:05:11.188098 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3465/7505] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:05:10 2022] GET /compute/v2.1/servers/760c06a0-528e-496f-b494-d70f10a1b95a => generated 1690 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:05:11.805753 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-5b450106-f234-4ed4-b4b8-c517115f1444 req-4e879912-67e1-4275-9462-dfb1ce9dae3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "760c06a0-528e-496f-b494-d70f10a1b95a", "name": "network-vif-plugged", "status": "completed", "tag": "f8382bf5-af57-4ebf-893f-c1df6fc729a9"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:05:11.816417 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-5b450106-f234-4ed4-b4b8-c517115f1444 req-4e879912-67e1-4275-9462-dfb1ce9dae3c service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:11.816910 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-5b450106-f234-4ed4-b4b8-c517115f1444 req-4e879912-67e1-4275-9462-dfb1ce9dae3c service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:11.817356 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-5b450106-f234-4ed4-b4b8-c517115f1444 req-4e879912-67e1-4275-9462-dfb1ce9dae3c service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:11.829849 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-5b450106-f234-4ed4-b4b8-c517115f1444 req-4e879912-67e1-4275-9462-dfb1ce9dae3c service nova] Creating event network-vif-plugged:f8382bf5-af57-4ebf-893f-c1df6fc729a9 for instance 760c06a0-528e-496f-b494-d70f10a1b95a on n-h2-836830-18 Sep 14 10:05:11.835259 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [req-5b450106-f234-4ed4-b4b8-c517115f1444 req-4e879912-67e1-4275-9462-dfb1ce9dae3c service nova] Instance 760c06a0-528e-496f-b494-d70f10a1b95a is migrating within the same cell, copying events to all relevant hosts: {'n-h1-836830-18', 'n-h2-836830-18'} {{(pid=128759) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 14 10:05:11.846643 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-5b450106-f234-4ed4-b4b8-c517115f1444 req-4e879912-67e1-4275-9462-dfb1ce9dae3c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044666 Sep 14 10:05:11.847460 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4041/7506] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 10:05:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:05:12.211834 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-453c6908-4676-49c3-a81b-39571aeb22bb tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:05:12.212504 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-453c6908-4676-49c3-a81b-39571aeb22bb tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 760c06a0-528e-496f-b494-d70f10a1b95a] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:05:12.220967 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-453c6908-4676-49c3-a81b-39571aeb22bb tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:12.221469 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-453c6908-4676-49c3-a81b-39571aeb22bb tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:12.221919 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-453c6908-4676-49c3-a81b-39571aeb22bb tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:12.222725 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-453c6908-4676-49c3-a81b-39571aeb22bb tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:12.223232 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-453c6908-4676-49c3-a81b-39571aeb22bb tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:12.223708 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-453c6908-4676-49c3-a81b-39571aeb22bb tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:12.363900 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-453c6908-4676-49c3-a81b-39571aeb22bb tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0c29696e24390a5492804e0948010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6b6775bdd84b24bf7a5ce051e30998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:12.372256 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-453c6908-4676-49c3-a81b-39571aeb22bb tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "GET /compute/v2.1/servers/760c06a0-528e-496f-b494-d70f10a1b95a" status: 200 len: 1682 microversion: 2.1 time: 0.165007 Sep 14 10:05:12.372843 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3466/7507] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:05:12 2022] GET /compute/v2.1/servers/760c06a0-528e-496f-b494-d70f10a1b95a => generated 1682 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:05:34.551628 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=32 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:05:34.552605 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:05:34.558222 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-14e2d475-747d-4c7b-b855-da0c29711a48 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:05:34.560658 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-14e2d475-747d-4c7b-b855-da0c29711a48 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 760c06a0-528e-496f-b494-d70f10a1b95a] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:05:34.568166 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-14e2d475-747d-4c7b-b855-da0c29711a48 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:34.568662 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-14e2d475-747d-4c7b-b855-da0c29711a48 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:34.569110 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-14e2d475-747d-4c7b-b855-da0c29711a48 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:34.569815 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-14e2d475-747d-4c7b-b855-da0c29711a48 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:34.570277 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-14e2d475-747d-4c7b-b855-da0c29711a48 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:34.570707 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-14e2d475-747d-4c7b-b855-da0c29711a48 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:34.623079 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-14e2d475-747d-4c7b-b855-da0c29711a48 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "POST /compute/v2.1/servers/760c06a0-528e-496f-b494-d70f10a1b95a/action" status: 200 len: 24582 microversion: 2.1 time: 0.073297 Sep 14 10:05:34.624037 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4042/7508] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 10:05:34 2022] POST /compute/v2.1/servers/760c06a0-528e-496f-b494-d70f10a1b95a/action => generated 24582 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 10:05:41.657776 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-0447e33f-3a23-4abf-9ffa-eda013d09cd1 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:05:41.658317 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-0447e33f-3a23-4abf-9ffa-eda013d09cd1 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 760c06a0-528e-496f-b494-d70f10a1b95a] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:05:41.660678 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=28 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:05:41.661497 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:05:41.662774 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-7cb2b512-6674-4cef-bdbd-b6b901b2cddd req-592daf1a-00fa-4773-adc8-62332474f129 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "760c06a0-528e-496f-b494-d70f10a1b95a", "tag": "f8382bf5-af57-4ebf-893f-c1df6fc729a9"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:05:41.668269 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0447e33f-3a23-4abf-9ffa-eda013d09cd1 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:41.668674 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0447e33f-3a23-4abf-9ffa-eda013d09cd1 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:41.669604 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0447e33f-3a23-4abf-9ffa-eda013d09cd1 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:41.670333 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0447e33f-3a23-4abf-9ffa-eda013d09cd1 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:41.670814 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0447e33f-3a23-4abf-9ffa-eda013d09cd1 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:41.671284 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0447e33f-3a23-4abf-9ffa-eda013d09cd1 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:41.674601 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-7cb2b512-6674-4cef-bdbd-b6b901b2cddd req-592daf1a-00fa-4773-adc8-62332474f129 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:41.675126 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-7cb2b512-6674-4cef-bdbd-b6b901b2cddd req-592daf1a-00fa-4773-adc8-62332474f129 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:41.675932 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-7cb2b512-6674-4cef-bdbd-b6b901b2cddd req-592daf1a-00fa-4773-adc8-62332474f129 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:41.692706 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-7cb2b512-6674-4cef-bdbd-b6b901b2cddd req-592daf1a-00fa-4773-adc8-62332474f129 service nova] Creating event network-changed:f8382bf5-af57-4ebf-893f-c1df6fc729a9 for instance 760c06a0-528e-496f-b494-d70f10a1b95a on n-h2-836830-18 Sep 14 10:05:41.696345 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-7cb2b512-6674-4cef-bdbd-b6b901b2cddd req-592daf1a-00fa-4773-adc8-62332474f129 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037820 Sep 14 10:05:41.697137 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4043/7509] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 10:05:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:05:41.702496 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-0447e33f-3a23-4abf-9ffa-eda013d09cd1 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 760c06a0-528e-496f-b494-d70f10a1b95a] Going to try to terminate instance {{(pid=128758) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 10:05:41.796898 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-0447e33f-3a23-4abf-9ffa-eda013d09cd1 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "DELETE /compute/v2.1/servers/760c06a0-528e-496f-b494-d70f10a1b95a" status: 204 len: 0 microversion: 2.1 time: 0.142926 Sep 14 10:05:41.797510 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3467/7510] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 10:05:41 2022] DELETE /compute/v2.1/servers/760c06a0-528e-496f-b494-d70f10a1b95a => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 10:05:41.808048 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-2eca7b96-493c-44e8-b2c8-90025b04901a tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:05:41.808807 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-2eca7b96-493c-44e8-b2c8-90025b04901a tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 760c06a0-528e-496f-b494-d70f10a1b95a] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:05:41.817469 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2eca7b96-493c-44e8-b2c8-90025b04901a tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:41.817962 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2eca7b96-493c-44e8-b2c8-90025b04901a tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:41.818451 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2eca7b96-493c-44e8-b2c8-90025b04901a tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:41.819508 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2eca7b96-493c-44e8-b2c8-90025b04901a tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:41.819966 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2eca7b96-493c-44e8-b2c8-90025b04901a tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:41.820444 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2eca7b96-493c-44e8-b2c8-90025b04901a tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:41.970751 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-2eca7b96-493c-44e8-b2c8-90025b04901a tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0c29696e24390a5492804e0948010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6b6775bdd84b24bf7a5ce051e30998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:41.979196 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-2eca7b96-493c-44e8-b2c8-90025b04901a tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "GET /compute/v2.1/servers/760c06a0-528e-496f-b494-d70f10a1b95a" status: 200 len: 1688 microversion: 2.1 time: 0.176811 Sep 14 10:05:41.979993 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4044/7511] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:05:41 2022] GET /compute/v2.1/servers/760c06a0-528e-496f-b494-d70f10a1b95a => generated 1688 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:05:43.007833 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-4ef25355-44cc-4071-a1d9-94ee4e925ec9 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:05:43.008552 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-4ef25355-44cc-4071-a1d9-94ee4e925ec9 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 760c06a0-528e-496f-b494-d70f10a1b95a] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:05:43.015400 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4ef25355-44cc-4071-a1d9-94ee4e925ec9 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:43.015896 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4ef25355-44cc-4071-a1d9-94ee4e925ec9 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:43.016344 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4ef25355-44cc-4071-a1d9-94ee4e925ec9 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:43.017045 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4ef25355-44cc-4071-a1d9-94ee4e925ec9 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:43.017510 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4ef25355-44cc-4071-a1d9-94ee4e925ec9 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:43.017947 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4ef25355-44cc-4071-a1d9-94ee4e925ec9 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:43.238638 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-4ef25355-44cc-4071-a1d9-94ee4e925ec9 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0c29696e24390a5492804e0948010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6b6775bdd84b24bf7a5ce051e30998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:43.247348 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-4ef25355-44cc-4071-a1d9-94ee4e925ec9 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "GET /compute/v2.1/servers/760c06a0-528e-496f-b494-d70f10a1b95a" status: 200 len: 1688 microversion: 2.1 time: 0.243644 Sep 14 10:05:43.251308 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3468/7512] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:05:43 2022] GET /compute/v2.1/servers/760c06a0-528e-496f-b494-d70f10a1b95a => generated 1688 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:05:43.712683 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-9663d413-8bec-4798-b050-6070e903e078 req-d76b302c-f3a3-4c37-86d3-7e5ee2acd6ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "760c06a0-528e-496f-b494-d70f10a1b95a", "name": "network-vif-deleted", "tag": "f8382bf5-af57-4ebf-893f-c1df6fc729a9"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:05:43.725662 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-9663d413-8bec-4798-b050-6070e903e078 req-d76b302c-f3a3-4c37-86d3-7e5ee2acd6ac service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:43.726153 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-9663d413-8bec-4798-b050-6070e903e078 req-d76b302c-f3a3-4c37-86d3-7e5ee2acd6ac service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:43.726595 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-9663d413-8bec-4798-b050-6070e903e078 req-d76b302c-f3a3-4c37-86d3-7e5ee2acd6ac service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:43.738876 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-9663d413-8bec-4798-b050-6070e903e078 req-d76b302c-f3a3-4c37-86d3-7e5ee2acd6ac service nova] Creating event network-vif-deleted:f8382bf5-af57-4ebf-893f-c1df6fc729a9 for instance 760c06a0-528e-496f-b494-d70f10a1b95a on n-h2-836830-18 Sep 14 10:05:43.744201 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-9663d413-8bec-4798-b050-6070e903e078 req-d76b302c-f3a3-4c37-86d3-7e5ee2acd6ac service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035893 Sep 14 10:05:43.744903 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4045/7513] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 10:05:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:05:44.271519 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-499776ef-7cae-4b0e-83f8-e8914ebb69a1 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:05:44.272067 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-499776ef-7cae-4b0e-83f8-e8914ebb69a1 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 760c06a0-528e-496f-b494-d70f10a1b95a] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:05:44.278868 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-499776ef-7cae-4b0e-83f8-e8914ebb69a1 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:44.279420 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-499776ef-7cae-4b0e-83f8-e8914ebb69a1 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:44.279881 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-499776ef-7cae-4b0e-83f8-e8914ebb69a1 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:44.280612 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-499776ef-7cae-4b0e-83f8-e8914ebb69a1 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:44.281106 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-499776ef-7cae-4b0e-83f8-e8914ebb69a1 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:44.281555 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-499776ef-7cae-4b0e-83f8-e8914ebb69a1 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:44.296055 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-499776ef-7cae-4b0e-83f8-e8914ebb69a1 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] HTTP exception thrown: Instance 760c06a0-528e-496f-b494-d70f10a1b95a could not be found. Sep 14 10:05:44.297731 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-499776ef-7cae-4b0e-83f8-e8914ebb69a1 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Request method failure captured: Sep 14 10:05:44.297731 n-d-836830-18 devstack@n-api.service[128758]: request: GET /compute/v2.1/servers/760c06a0-528e-496f-b494-d70f10a1b95a HTTP/1.1 Sep 14 10:05:44.297731 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 10:05:44.297731 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 10:05:44.297731 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 10:05:44.297731 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 10:05:44.297731 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 10:05:44.297731 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 10:05:44.297731 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 10:05:44.297731 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 10:05:44.297731 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIaYrejhj2TGf9R9N95darLKnnjP7yvAOzzRGk88fUneEcfLJ79TotlbWmaifDlagIOgchpK-W9GG7KW3sgKBKNTQaihdlpQR7nbYvQmmAemQtSyT8HYEWV36tTrgBgWqk_HpFAN-DV62Paaf0wzD9le8cOOWXqmVMqtvFpWKeFSur8Y Sep 14 10:05:44.297731 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 10:05:44.297731 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 10:05:44.297731 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 10:05:44.297731 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 10:05:44.297731 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 10:05:44.297731 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 10:05:44.297731 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 1e6b6775bdd84b24bf7a5ce051e30998 Sep 14 10:05:44.297731 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-722006907 Sep 14 10:05:44.297731 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 10:05:44.297731 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 10:05:44.297731 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/1e6b6775bdd84b24bf7a5ce051e30998"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_1e6b6775bdd84b24bf7a5ce051e30998"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1e6b6775bdd84b24bf7a5ce051e30998"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1e6b6775bdd84b24bf7a5ce051e30998"}]}] Sep 14 10:05:44.297731 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-TestNetworkAdvancedServerOps-722006907 Sep 14 10:05:44.297731 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 1e6b6775bdd84b24bf7a5ce051e30998 Sep 14 10:05:44.297731 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-722006907 Sep 14 10:05:44.297731 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-TestNetworkAdvancedServerOps-722006907-project Sep 14 10:05:44.297731 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 10:05:44.297731 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 10:05:44.297731 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: caa0c29696e24390a5492804e0948010 Sep 14 10:05:44.297731 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-TestNetworkAdvancedServerOps-722006907-project Sep 14 10:05:44.297731 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 10:05:44.297731 n-d-836830-18 devstack@n-api.service[128758]: exception: Instance 760c06a0-528e-496f-b494-d70f10a1b95a could not be found. Sep 14 10:05:44.297731 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': '760c06a0-528e-496f-b494-d70f10a1b95a'} Sep 14 10:05:44.297731 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 10:05:44.297731 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:05:44.297731 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 10:05:44.297731 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 10:05:44.297731 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 10:05:44.297731 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 10:05:44.297731 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 10:05:44.297731 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 10:05:44.297731 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 10:05:44.297731 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 10:05:44.297731 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 760c06a0-528e-496f-b494-d70f10a1b95a could not be found. Sep 14 10:05:44.297731 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 10:05:44.297731 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:05:44.297731 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 10:05:44.297731 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:05:44.297731 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:05:44.297731 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:05:44.297731 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 10:05:44.297731 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 10:05:44.297731 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 10:05:44.297731 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 10:05:44.297731 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 10:05:44.297731 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 10:05:44.297731 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 10:05:44.297731 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 10:05:44.297731 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 10:05:44.297731 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 10:05:44.297731 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 760c06a0-528e-496f-b494-d70f10a1b95a could not be found. Sep 14 10:05:44.297731 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 10:05:44.297731 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:05:44.302568 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 10:05:44.302568 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:05:44.302568 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:05:44.302568 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:05:44.302568 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 10:05:44.302568 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 10:05:44.302568 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 760c06a0-528e-496f-b494-d70f10a1b95a could not be found. Sep 14 10:05:44.302568 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 10:05:44.302568 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-499776ef-7cae-4b0e-83f8-e8914ebb69a1 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Returning 404 to user: Instance 760c06a0-528e-496f-b494-d70f10a1b95a could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 10:05:44.302568 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-499776ef-7cae-4b0e-83f8-e8914ebb69a1 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "GET /compute/v2.1/servers/760c06a0-528e-496f-b494-d70f10a1b95a" status: 404 len: 111 microversion: 2.1 time: 0.031868 Sep 14 10:05:44.302568 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3469/7514] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:05:44 2022] GET /compute/v2.1/servers/760c06a0-528e-496f-b494-d70f10a1b95a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 10:05:47.525619 n-d-836830-18 devstack@n-api.service[128759]: ERROR oslo.messaging._drivers.impl_rabbit [-] [22ef38d2-af78-43f4-be77-ac372bc70aea] AMQP server on 10.222.0.60:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 14 10:05:47.529910 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3b88c379-c195-4bb7-9936-5b85bc8eef52 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '.version_select at 0x7f7d4424bee0>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:05:47.563656 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-3b88c379-c195-4bb7-9936-5b85bc8eef52 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-590553377" status: 202 len: 0 microversion: 2.1 time: 0.039410 Sep 14 10:05:47.564263 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4046/7515] 10.222.0.60 () {58 vars in 1281 bytes} [Wed Sep 14 10:05:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-590553377 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 10:05:47.590710 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ac7e6a48-e42d-4407-b213-d21bcc420814 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Action: 'create', calling method: .version_select at 0x7f7d3f355d30>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-453629073", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ0nabGQf0WyD6FW0zu5gjKZonsgzO3z/3yU+zNpkb17PgV3jYqj8L3OnZRWkxy0VpQV7qJmbQy5gT4FhD7xkU8AEtM+Cl43BtSi35by0n6+/bvd12VxP7LTJ6U6bYYsnQ=="}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:05:47.609302 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-ac7e6a48-e42d-4407-b213-d21bcc420814 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Getting quotas for project 1e6b6775bdd84b24bf7a5ce051e30998. Resources: {'key_pairs'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 10:05:47.615819 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-ac7e6a48-e42d-4407-b213-d21bcc420814 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Getting quotas for user caa0c29696e24390a5492804e0948010 and project 1e6b6775bdd84b24bf7a5ce051e30998. Resources: {'key_pairs'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 10:05:47.629751 n-d-836830-18 devstack@n-api.service[128758]: ERROR oslo.messaging._drivers.impl_rabbit [None req-ac7e6a48-e42d-4407-b213-d21bcc420814 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [9c307738-a09e-46fc-a558-c2b092a37ed4] AMQP server on 10.222.0.60:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 14 10:05:48.636019 n-d-836830-18 devstack@n-api.service[128758]: INFO oslo.messaging._drivers.impl_rabbit [None req-ac7e6a48-e42d-4407-b213-d21bcc420814 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [9c307738-a09e-46fc-a558-c2b092a37ed4] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 52522. Sep 14 10:05:48.651243 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-ac7e6a48-e42d-4407-b213-d21bcc420814 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 1.064517 Sep 14 10:05:48.651872 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3470/7516] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Sep 14 10:05:47 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:05:54.419628 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b6a2e5f6-fb56-410c-a9f4-3702cb872c6b tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-278705342", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "networks": [{"uuid": "6b1bf58d-f423-4925-ad25-9b434bb432d1"}], "key_name": "tempest-TestNetworkAdvancedServerOps-453629073", "security_groups": [{"name": "tempest-secgroup-smoke-29445155"}]}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:05:54.430179 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=14 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:05:54.448201 n-d-836830-18 devstack@n-api.service[128759]: INFO oslo.messaging._drivers.impl_rabbit [-] [22ef38d2-af78-43f4-be77-ac372bc70aea] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 52558. Sep 14 10:05:54.531944 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.network.neutron [None req-b6a2e5f6-fb56-410c-a9f4-3702cb872c6b tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] validate_networks() for [('6b1bf58d-f423-4925-ad25-9b434bb432d1', None, None, None, None, None)] {{(pid=128759) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 10:05:55.035374 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-b6a2e5f6-fb56-410c-a9f4-3702cb872c6b tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Flavor limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 10:05:55.035993 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-b6a2e5f6-fb56-410c-a9f4-3702cb872c6b tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Image limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 10:05:55.036500 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-b6a2e5f6-fb56-410c-a9f4-3702cb872c6b tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Flavor pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 10:05:55.036906 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-b6a2e5f6-fb56-410c-a9f4-3702cb872c6b tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Image pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 10:05:55.037318 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-b6a2e5f6-fb56-410c-a9f4-3702cb872c6b tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 10:05:55.047566 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b6a2e5f6-fb56-410c-a9f4-3702cb872c6b tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:55.048248 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b6a2e5f6-fb56-410c-a9f4-3702cb872c6b tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:55.048684 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b6a2e5f6-fb56-410c-a9f4-3702cb872c6b tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:55.049415 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b6a2e5f6-fb56-410c-a9f4-3702cb872c6b tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:55.049875 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b6a2e5f6-fb56-410c-a9f4-3702cb872c6b tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:55.050298 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b6a2e5f6-fb56-410c-a9f4-3702cb872c6b tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:55.074563 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-b6a2e5f6-fb56-410c-a9f4-3702cb872c6b tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Getting quotas for project 1e6b6775bdd84b24bf7a5ce051e30998. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 10:05:55.081116 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-b6a2e5f6-fb56-410c-a9f4-3702cb872c6b tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Getting quotas for user caa0c29696e24390a5492804e0948010 and project 1e6b6775bdd84b24bf7a5ce051e30998. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 10:05:55.095188 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b6a2e5f6-fb56-410c-a9f4-3702cb872c6b tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Going to run 1 instances... {{(pid=128759) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 10:05:55.098223 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b6a2e5f6-fb56-410c-a9f4-3702cb872c6b tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 42687c77-4c27-4921-9148-f95843474cf6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128759) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 10:05:55.155526 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b6a2e5f6-fb56-410c-a9f4-3702cb872c6b tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.741531 Sep 14 10:05:55.156512 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4047/7517] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 10:05:54 2022] POST /compute/v2.1/servers => generated 404 bytes in 743 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 10:05:55.165864 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:05:55.170616 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-f4156df3-3c2a-4eb9-bcc3-82fc980942cc tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:05:55.171299 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-f4156df3-3c2a-4eb9-bcc3-82fc980942cc tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 42687c77-4c27-4921-9148-f95843474cf6] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:05:55.236850 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-f4156df3-3c2a-4eb9-bcc3-82fc980942cc tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0c29696e24390a5492804e0948010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6b6775bdd84b24bf7a5ce051e30998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:55.245460 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-f4156df3-3c2a-4eb9-bcc3-82fc980942cc tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "GET /compute/v2.1/servers/42687c77-4c27-4921-9148-f95843474cf6" status: 200 len: 1265 microversion: 2.1 time: 0.081549 Sep 14 10:05:55.247455 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3471/7518] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:05:55 2022] GET /compute/v2.1/servers/42687c77-4c27-4921-9148-f95843474cf6 => generated 1265 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 10:05:56.270531 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-01e58580-fe14-4453-a54b-1fa3f1e1993c tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:05:56.271939 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-01e58580-fe14-4453-a54b-1fa3f1e1993c tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 42687c77-4c27-4921-9148-f95843474cf6] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:05:56.279192 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-01e58580-fe14-4453-a54b-1fa3f1e1993c tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:56.280030 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-01e58580-fe14-4453-a54b-1fa3f1e1993c tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:56.280694 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-01e58580-fe14-4453-a54b-1fa3f1e1993c tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:56.281770 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-01e58580-fe14-4453-a54b-1fa3f1e1993c tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:56.282633 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-01e58580-fe14-4453-a54b-1fa3f1e1993c tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:56.283335 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-01e58580-fe14-4453-a54b-1fa3f1e1993c tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:56.384087 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-01e58580-fe14-4453-a54b-1fa3f1e1993c tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0c29696e24390a5492804e0948010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6b6775bdd84b24bf7a5ce051e30998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:56.392653 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-01e58580-fe14-4453-a54b-1fa3f1e1993c tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "GET /compute/v2.1/servers/42687c77-4c27-4921-9148-f95843474cf6" status: 200 len: 1325 microversion: 2.1 time: 0.126857 Sep 14 10:05:56.393238 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4048/7519] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:05:56 2022] GET /compute/v2.1/servers/42687c77-4c27-4921-9148-f95843474cf6 => generated 1325 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:05:57.418999 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1d46412c-69c8-48d9-956e-61ab68028d76 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:05:57.419851 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-1d46412c-69c8-48d9-956e-61ab68028d76 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 42687c77-4c27-4921-9148-f95843474cf6] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:05:57.427667 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1d46412c-69c8-48d9-956e-61ab68028d76 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:57.428118 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1d46412c-69c8-48d9-956e-61ab68028d76 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:57.428587 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1d46412c-69c8-48d9-956e-61ab68028d76 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:57.429320 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1d46412c-69c8-48d9-956e-61ab68028d76 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:57.429829 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1d46412c-69c8-48d9-956e-61ab68028d76 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:57.430312 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1d46412c-69c8-48d9-956e-61ab68028d76 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:57.657661 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-1d46412c-69c8-48d9-956e-61ab68028d76 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0c29696e24390a5492804e0948010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6b6775bdd84b24bf7a5ce051e30998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:57.665482 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-1d46412c-69c8-48d9-956e-61ab68028d76 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "GET /compute/v2.1/servers/42687c77-4c27-4921-9148-f95843474cf6" status: 200 len: 1389 microversion: 2.1 time: 0.250550 Sep 14 10:05:57.666091 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3472/7520] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:05:57 2022] GET /compute/v2.1/servers/42687c77-4c27-4921-9148-f95843474cf6 => generated 1389 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:05:58.056261 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-75ee20a7-31f4-4b86-9c47-05feb48e8ce9 req-e54e6470-4654-4777-952d-0b8a808fbd31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42687c77-4c27-4921-9148-f95843474cf6", "tag": "35840791-621e-49a0-9e5f-96fe845a8ee3"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:05:58.068764 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-75ee20a7-31f4-4b86-9c47-05feb48e8ce9 req-e54e6470-4654-4777-952d-0b8a808fbd31 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:58.069603 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-75ee20a7-31f4-4b86-9c47-05feb48e8ce9 req-e54e6470-4654-4777-952d-0b8a808fbd31 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:58.070114 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-75ee20a7-31f4-4b86-9c47-05feb48e8ce9 req-e54e6470-4654-4777-952d-0b8a808fbd31 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:58.083902 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-75ee20a7-31f4-4b86-9c47-05feb48e8ce9 req-e54e6470-4654-4777-952d-0b8a808fbd31 service nova] Creating event network-changed:35840791-621e-49a0-9e5f-96fe845a8ee3 for instance 42687c77-4c27-4921-9148-f95843474cf6 on n-h1-836830-18 Sep 14 10:05:58.089225 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-75ee20a7-31f4-4b86-9c47-05feb48e8ce9 req-e54e6470-4654-4777-952d-0b8a808fbd31 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045009 Sep 14 10:05:58.090392 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4049/7521] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 10:05:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 10:05:58.688889 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-4eeb9905-b870-46b4-bcb0-9abf71d6d72c tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:05:58.689529 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-4eeb9905-b870-46b4-bcb0-9abf71d6d72c tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 42687c77-4c27-4921-9148-f95843474cf6] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:05:58.696507 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4eeb9905-b870-46b4-bcb0-9abf71d6d72c tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:58.697016 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4eeb9905-b870-46b4-bcb0-9abf71d6d72c tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:58.697477 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4eeb9905-b870-46b4-bcb0-9abf71d6d72c tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:58.698194 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4eeb9905-b870-46b4-bcb0-9abf71d6d72c tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:58.698674 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4eeb9905-b870-46b4-bcb0-9abf71d6d72c tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:58.699158 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4eeb9905-b870-46b4-bcb0-9abf71d6d72c tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:58.863054 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-4eeb9905-b870-46b4-bcb0-9abf71d6d72c tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0c29696e24390a5492804e0948010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6b6775bdd84b24bf7a5ce051e30998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:58.871451 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-4eeb9905-b870-46b4-bcb0-9abf71d6d72c tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "GET /compute/v2.1/servers/42687c77-4c27-4921-9148-f95843474cf6" status: 200 len: 1389 microversion: 2.1 time: 0.186455 Sep 14 10:05:58.872043 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3473/7522] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:05:58 2022] GET /compute/v2.1/servers/42687c77-4c27-4921-9148-f95843474cf6 => generated 1389 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:05:59.897622 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-54433ee9-c114-4a84-885d-e9e7b6170575 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:05:59.898337 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-54433ee9-c114-4a84-885d-e9e7b6170575 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 42687c77-4c27-4921-9148-f95843474cf6] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:05:59.905297 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-54433ee9-c114-4a84-885d-e9e7b6170575 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:59.905783 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-54433ee9-c114-4a84-885d-e9e7b6170575 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:59.906234 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-54433ee9-c114-4a84-885d-e9e7b6170575 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:59.906925 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-54433ee9-c114-4a84-885d-e9e7b6170575 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:59.907409 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-54433ee9-c114-4a84-885d-e9e7b6170575 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:59.907837 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-54433ee9-c114-4a84-885d-e9e7b6170575 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:06:00.042837 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-54433ee9-c114-4a84-885d-e9e7b6170575 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0c29696e24390a5492804e0948010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6b6775bdd84b24bf7a5ce051e30998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:06:00.051365 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-54433ee9-c114-4a84-885d-e9e7b6170575 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "GET /compute/v2.1/servers/42687c77-4c27-4921-9148-f95843474cf6" status: 200 len: 1389 microversion: 2.1 time: 0.158879 Sep 14 10:06:00.051942 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4050/7523] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:05:59 2022] GET /compute/v2.1/servers/42687c77-4c27-4921-9148-f95843474cf6 => generated 1389 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:06:01.073859 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-de6bfe92-b171-4fdc-9e91-fd9e1fbe0cd5 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:06:01.074641 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-de6bfe92-b171-4fdc-9e91-fd9e1fbe0cd5 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 42687c77-4c27-4921-9148-f95843474cf6] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:06:01.081902 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-de6bfe92-b171-4fdc-9e91-fd9e1fbe0cd5 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:06:01.082346 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-de6bfe92-b171-4fdc-9e91-fd9e1fbe0cd5 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:06:01.082809 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-de6bfe92-b171-4fdc-9e91-fd9e1fbe0cd5 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:06:01.083559 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-de6bfe92-b171-4fdc-9e91-fd9e1fbe0cd5 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:06:01.084099 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-de6bfe92-b171-4fdc-9e91-fd9e1fbe0cd5 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:06:01.084558 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-de6bfe92-b171-4fdc-9e91-fd9e1fbe0cd5 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:06:01.230173 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-de6bfe92-b171-4fdc-9e91-fd9e1fbe0cd5 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0c29696e24390a5492804e0948010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6b6775bdd84b24bf7a5ce051e30998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:06:01.238509 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-de6bfe92-b171-4fdc-9e91-fd9e1fbe0cd5 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "GET /compute/v2.1/servers/42687c77-4c27-4921-9148-f95843474cf6" status: 200 len: 1389 microversion: 2.1 time: 0.168664 Sep 14 10:06:01.239119 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3474/7524] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:06:01 2022] GET /compute/v2.1/servers/42687c77-4c27-4921-9148-f95843474cf6 => generated 1389 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:06:02.261159 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a0670800-2c5e-4c94-b038-24b5cb6f2e1e tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:06:02.261789 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-a0670800-2c5e-4c94-b038-24b5cb6f2e1e tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 42687c77-4c27-4921-9148-f95843474cf6] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:06:02.269083 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a0670800-2c5e-4c94-b038-24b5cb6f2e1e tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:06:02.269584 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a0670800-2c5e-4c94-b038-24b5cb6f2e1e tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:06:02.270035 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a0670800-2c5e-4c94-b038-24b5cb6f2e1e tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:06:02.270753 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a0670800-2c5e-4c94-b038-24b5cb6f2e1e tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:06:02.271243 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a0670800-2c5e-4c94-b038-24b5cb6f2e1e tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:06:02.271677 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a0670800-2c5e-4c94-b038-24b5cb6f2e1e tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:06:02.408868 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-a0670800-2c5e-4c94-b038-24b5cb6f2e1e tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0c29696e24390a5492804e0948010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6b6775bdd84b24bf7a5ce051e30998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:06:02.416612 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a0670800-2c5e-4c94-b038-24b5cb6f2e1e tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "GET /compute/v2.1/servers/42687c77-4c27-4921-9148-f95843474cf6" status: 200 len: 1389 microversion: 2.1 time: 0.159421 Sep 14 10:06:02.417198 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4051/7525] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:06:02 2022] GET /compute/v2.1/servers/42687c77-4c27-4921-9148-f95843474cf6 => generated 1389 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:06:03.440222 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1b7226aa-be88-47e2-9606-bf6843d13407 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:06:03.440851 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-1b7226aa-be88-47e2-9606-bf6843d13407 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 42687c77-4c27-4921-9148-f95843474cf6] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:06:03.447814 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1b7226aa-be88-47e2-9606-bf6843d13407 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:06:03.448348 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1b7226aa-be88-47e2-9606-bf6843d13407 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:06:03.448809 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1b7226aa-be88-47e2-9606-bf6843d13407 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:06:03.449525 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1b7226aa-be88-47e2-9606-bf6843d13407 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:06:03.450004 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1b7226aa-be88-47e2-9606-bf6843d13407 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:06:03.450453 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1b7226aa-be88-47e2-9606-bf6843d13407 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:06:03.587080 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-1b7226aa-be88-47e2-9606-bf6843d13407 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0c29696e24390a5492804e0948010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6b6775bdd84b24bf7a5ce051e30998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:06:03.594882 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-1b7226aa-be88-47e2-9606-bf6843d13407 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "GET /compute/v2.1/servers/42687c77-4c27-4921-9148-f95843474cf6" status: 200 len: 1389 microversion: 2.1 time: 0.159272 Sep 14 10:06:03.595554 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3475/7526] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:06:03 2022] GET /compute/v2.1/servers/42687c77-4c27-4921-9148-f95843474cf6 => generated 1389 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:06:03.860353 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-0931da5d-bda7-4fdb-9622-5630068b52a6 req-0794a249-c1af-4f38-8201-3d116c5f621e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42687c77-4c27-4921-9148-f95843474cf6", "name": "network-vif-plugged", "status": "completed", "tag": "35840791-621e-49a0-9e5f-96fe845a8ee3"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:06:03.872668 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-0931da5d-bda7-4fdb-9622-5630068b52a6 req-0794a249-c1af-4f38-8201-3d116c5f621e service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:06:03.873147 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-0931da5d-bda7-4fdb-9622-5630068b52a6 req-0794a249-c1af-4f38-8201-3d116c5f621e service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:06:03.873632 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-0931da5d-bda7-4fdb-9622-5630068b52a6 req-0794a249-c1af-4f38-8201-3d116c5f621e service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:06:03.885231 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-0931da5d-bda7-4fdb-9622-5630068b52a6 req-0794a249-c1af-4f38-8201-3d116c5f621e service nova] Creating event network-vif-plugged:35840791-621e-49a0-9e5f-96fe845a8ee3 for instance 42687c77-4c27-4921-9148-f95843474cf6 on n-h1-836830-18 Sep 14 10:06:03.890663 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-0931da5d-bda7-4fdb-9622-5630068b52a6 req-0794a249-c1af-4f38-8201-3d116c5f621e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034937 Sep 14 10:06:03.891439 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4052/7527] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 10:06:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:06:04.618259 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a9b5b56b-f41f-4853-bde2-179ac513c9d9 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:06:04.618903 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-a9b5b56b-f41f-4853-bde2-179ac513c9d9 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 42687c77-4c27-4921-9148-f95843474cf6] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:06:04.626928 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a9b5b56b-f41f-4853-bde2-179ac513c9d9 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:06:04.627533 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a9b5b56b-f41f-4853-bde2-179ac513c9d9 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:06:04.627994 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a9b5b56b-f41f-4853-bde2-179ac513c9d9 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:06:04.628778 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a9b5b56b-f41f-4853-bde2-179ac513c9d9 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:06:04.629259 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a9b5b56b-f41f-4853-bde2-179ac513c9d9 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:06:04.629714 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a9b5b56b-f41f-4853-bde2-179ac513c9d9 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:06:04.767398 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-a9b5b56b-f41f-4853-bde2-179ac513c9d9 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0c29696e24390a5492804e0948010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6b6775bdd84b24bf7a5ce051e30998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:06:04.775298 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-a9b5b56b-f41f-4853-bde2-179ac513c9d9 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "GET /compute/v2.1/servers/42687c77-4c27-4921-9148-f95843474cf6" status: 200 len: 1389 microversion: 2.1 time: 0.161011 Sep 14 10:06:04.775875 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3476/7528] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:06:04 2022] GET /compute/v2.1/servers/42687c77-4c27-4921-9148-f95843474cf6 => generated 1389 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:06:05.798230 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-75a467e6-1d32-4510-a15a-5eca823cef3c tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:06:05.798988 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-75a467e6-1d32-4510-a15a-5eca823cef3c tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 42687c77-4c27-4921-9148-f95843474cf6] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:06:05.801755 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=2 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:06:05.802435 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=6 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:06:05.803198 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=37,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:06:05.810158 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-75a467e6-1d32-4510-a15a-5eca823cef3c tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:06:05.810650 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-75a467e6-1d32-4510-a15a-5eca823cef3c tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:06:05.811133 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-75a467e6-1d32-4510-a15a-5eca823cef3c tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:06:05.811876 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-75a467e6-1d32-4510-a15a-5eca823cef3c tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:06:05.812336 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-75a467e6-1d32-4510-a15a-5eca823cef3c tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:06:05.812768 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-75a467e6-1d32-4510-a15a-5eca823cef3c tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:06:05.947777 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-75a467e6-1d32-4510-a15a-5eca823cef3c tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0c29696e24390a5492804e0948010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6b6775bdd84b24bf7a5ce051e30998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:06:05.956340 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-75a467e6-1d32-4510-a15a-5eca823cef3c tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "GET /compute/v2.1/servers/42687c77-4c27-4921-9148-f95843474cf6" status: 200 len: 1561 microversion: 2.1 time: 0.162402 Sep 14 10:06:05.956915 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4053/7529] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:06:05 2022] GET /compute/v2.1/servers/42687c77-4c27-4921-9148-f95843474cf6 => generated 1561 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:06:05.979684 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-10f55e47-b809-4c7f-947c-985b38efdcf9 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:06:05.980327 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-10f55e47-b809-4c7f-947c-985b38efdcf9 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 42687c77-4c27-4921-9148-f95843474cf6] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:06:05.982253 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=6 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:06:05.988707 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-10f55e47-b809-4c7f-947c-985b38efdcf9 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:06:05.989217 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-10f55e47-b809-4c7f-947c-985b38efdcf9 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:06:05.989686 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-10f55e47-b809-4c7f-947c-985b38efdcf9 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:06:05.990408 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-10f55e47-b809-4c7f-947c-985b38efdcf9 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:06:05.990887 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-10f55e47-b809-4c7f-947c-985b38efdcf9 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:06:05.991368 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-10f55e47-b809-4c7f-947c-985b38efdcf9 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:06:06.121492 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-10f55e47-b809-4c7f-947c-985b38efdcf9 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0c29696e24390a5492804e0948010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6b6775bdd84b24bf7a5ce051e30998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:06:06.129811 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-10f55e47-b809-4c7f-947c-985b38efdcf9 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "GET /compute/v2.1/servers/42687c77-4c27-4921-9148-f95843474cf6" status: 200 len: 1561 microversion: 2.1 time: 0.154277 Sep 14 10:06:06.130405 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3477/7530] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:06:05 2022] GET /compute/v2.1/servers/42687c77-4c27-4921-9148-f95843474cf6 => generated 1561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:06:07.740436 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-2cdeedbb-bc65-4be8-a0b4-52aa30a9e132 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:06:07.741057 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-2cdeedbb-bc65-4be8-a0b4-52aa30a9e132 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 42687c77-4c27-4921-9148-f95843474cf6] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:06:07.743161 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-0c40c881-9ff6-48a4-b1ba-70d0d83f30f5 req-85b02c6d-e85b-4c19-8bba-ac64084d97c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42687c77-4c27-4921-9148-f95843474cf6", "tag": "35840791-621e-49a0-9e5f-96fe845a8ee3"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:06:07.748469 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2cdeedbb-bc65-4be8-a0b4-52aa30a9e132 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:06:07.748987 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2cdeedbb-bc65-4be8-a0b4-52aa30a9e132 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:06:07.749985 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2cdeedbb-bc65-4be8-a0b4-52aa30a9e132 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:06:07.750688 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2cdeedbb-bc65-4be8-a0b4-52aa30a9e132 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:06:07.751407 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2cdeedbb-bc65-4be8-a0b4-52aa30a9e132 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:06:07.751832 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2cdeedbb-bc65-4be8-a0b4-52aa30a9e132 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:06:07.754801 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-0c40c881-9ff6-48a4-b1ba-70d0d83f30f5 req-85b02c6d-e85b-4c19-8bba-ac64084d97c3 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:06:07.755568 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-0c40c881-9ff6-48a4-b1ba-70d0d83f30f5 req-85b02c6d-e85b-4c19-8bba-ac64084d97c3 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:06:07.756102 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-0c40c881-9ff6-48a4-b1ba-70d0d83f30f5 req-85b02c6d-e85b-4c19-8bba-ac64084d97c3 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:06:07.771303 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-0c40c881-9ff6-48a4-b1ba-70d0d83f30f5 req-85b02c6d-e85b-4c19-8bba-ac64084d97c3 service nova] Creating event network-changed:35840791-621e-49a0-9e5f-96fe845a8ee3 for instance 42687c77-4c27-4921-9148-f95843474cf6 on n-h1-836830-18 Sep 14 10:06:07.777317 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-0c40c881-9ff6-48a4-b1ba-70d0d83f30f5 req-85b02c6d-e85b-4c19-8bba-ac64084d97c3 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037535 Sep 14 10:06:07.777951 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3478/7531] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 10:06:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 10:06:07.971781 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-2cdeedbb-bc65-4be8-a0b4-52aa30a9e132 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0c29696e24390a5492804e0948010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6b6775bdd84b24bf7a5ce051e30998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:06:07.980731 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-2cdeedbb-bc65-4be8-a0b4-52aa30a9e132 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "GET /compute/v2.1/servers/42687c77-4c27-4921-9148-f95843474cf6" status: 200 len: 1561 microversion: 2.1 time: 0.244128 Sep 14 10:06:07.981463 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4054/7532] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:06:07 2022] GET /compute/v2.1/servers/42687c77-4c27-4921-9148-f95843474cf6 => generated 1561 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:06:39.261454 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:06:39.262231 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=38 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:06:39.266540 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-7659357f-3b51-463e-bc39-a079fbaf48cc tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:06:39.268885 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-7659357f-3b51-463e-bc39-a079fbaf48cc tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 42687c77-4c27-4921-9148-f95843474cf6] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:06:39.276664 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7659357f-3b51-463e-bc39-a079fbaf48cc tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:06:39.277172 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7659357f-3b51-463e-bc39-a079fbaf48cc tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:06:39.277630 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7659357f-3b51-463e-bc39-a079fbaf48cc tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:06:39.278374 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7659357f-3b51-463e-bc39-a079fbaf48cc tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:06:39.278875 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7659357f-3b51-463e-bc39-a079fbaf48cc tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:06:39.279351 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7659357f-3b51-463e-bc39-a079fbaf48cc tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:06:39.300769 n-d-836830-18 devstack@n-api.service[128758]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 10:06:39.300955 n-d-836830-18 devstack@n-api.service[128758]: Wed Sep 14 10:06:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/42687c77-4c27-4921-9148-f95843474cf6/action (ip 10.222.0.60) !!! Sep 14 10:06:39.353004 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-7659357f-3b51-463e-bc39-a079fbaf48cc tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "POST /compute/v2.1/servers/42687c77-4c27-4921-9148-f95843474cf6/action" status: 200 len: 24565 microversion: 2.1 time: 0.093406 Sep 14 10:06:39.353667 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3479/7533] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 10:06:39 2022] POST /compute/v2.1/servers/42687c77-4c27-4921-9148-f95843474cf6/action => generated 24565 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 10:07:09.558633 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=3 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:07:09.559425 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=36 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:07:09.564608 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8c61aad3-d026-4009-93c8-d62e987baabe tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:07:09.572320 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8c61aad3-d026-4009-93c8-d62e987baabe tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:07:09.572814 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8c61aad3-d026-4009-93c8-d62e987baabe tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:07:09.573256 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8c61aad3-d026-4009-93c8-d62e987baabe tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:07:09.596220 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-8c61aad3-d026-4009-93c8-d62e987baabe tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 42687c77-4c27-4921-9148-f95843474cf6] Going to try to stop instance {{(pid=128759) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 14 10:07:09.637186 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-8c61aad3-d026-4009-93c8-d62e987baabe tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "POST /compute/v2.1/servers/42687c77-4c27-4921-9148-f95843474cf6/action" status: 202 len: 0 microversion: 2.1 time: 0.080206 Sep 14 10:07:09.637852 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4055/7534] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 10:07:09 2022] POST /compute/v2.1/servers/42687c77-4c27-4921-9148-f95843474cf6/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 10:07:09.646746 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-4beaacf8-dca8-4ce9-a8f7-7b96be4ce1ec tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:07:09.647494 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-4beaacf8-dca8-4ce9-a8f7-7b96be4ce1ec tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 42687c77-4c27-4921-9148-f95843474cf6] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:07:09.651854 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=4 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:07:09.652761 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=2 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:07:09.657761 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4beaacf8-dca8-4ce9-a8f7-7b96be4ce1ec tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:07:09.658266 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4beaacf8-dca8-4ce9-a8f7-7b96be4ce1ec tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:07:09.658722 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4beaacf8-dca8-4ce9-a8f7-7b96be4ce1ec tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:07:09.659466 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4beaacf8-dca8-4ce9-a8f7-7b96be4ce1ec tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:07:09.659962 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4beaacf8-dca8-4ce9-a8f7-7b96be4ce1ec tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:07:09.660401 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4beaacf8-dca8-4ce9-a8f7-7b96be4ce1ec tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:07:09.798135 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-4beaacf8-dca8-4ce9-a8f7-7b96be4ce1ec tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0c29696e24390a5492804e0948010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6b6775bdd84b24bf7a5ce051e30998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:07:09.806676 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-4beaacf8-dca8-4ce9-a8f7-7b96be4ce1ec tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "GET /compute/v2.1/servers/42687c77-4c27-4921-9148-f95843474cf6" status: 200 len: 1690 microversion: 2.1 time: 0.164302 Sep 14 10:07:09.807312 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3480/7535] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:07:09 2022] GET /compute/v2.1/servers/42687c77-4c27-4921-9148-f95843474cf6 => generated 1690 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:07:10.832945 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-30df8c0b-19ad-4c06-931f-67c3237f1232 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:07:10.833578 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-30df8c0b-19ad-4c06-931f-67c3237f1232 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 42687c77-4c27-4921-9148-f95843474cf6] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:07:10.839749 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-30df8c0b-19ad-4c06-931f-67c3237f1232 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:07:10.840230 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-30df8c0b-19ad-4c06-931f-67c3237f1232 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:07:10.840692 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-30df8c0b-19ad-4c06-931f-67c3237f1232 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:07:10.841377 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-30df8c0b-19ad-4c06-931f-67c3237f1232 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:07:10.841841 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-30df8c0b-19ad-4c06-931f-67c3237f1232 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:07:10.842246 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-30df8c0b-19ad-4c06-931f-67c3237f1232 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:07:11.056833 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-30df8c0b-19ad-4c06-931f-67c3237f1232 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0c29696e24390a5492804e0948010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6b6775bdd84b24bf7a5ce051e30998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:07:11.064651 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-30df8c0b-19ad-4c06-931f-67c3237f1232 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "GET /compute/v2.1/servers/42687c77-4c27-4921-9148-f95843474cf6" status: 200 len: 1690 microversion: 2.1 time: 0.237342 Sep 14 10:07:11.065231 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4056/7536] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:07:10 2022] GET /compute/v2.1/servers/42687c77-4c27-4921-9148-f95843474cf6 => generated 1690 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:07:12.089357 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-89c17d5e-a306-416f-8f68-9b8342ba7b70 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:07:12.090021 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-89c17d5e-a306-416f-8f68-9b8342ba7b70 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 42687c77-4c27-4921-9148-f95843474cf6] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:07:12.097350 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-89c17d5e-a306-416f-8f68-9b8342ba7b70 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:07:12.097851 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-89c17d5e-a306-416f-8f68-9b8342ba7b70 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:07:12.098307 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-89c17d5e-a306-416f-8f68-9b8342ba7b70 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:07:12.099048 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-89c17d5e-a306-416f-8f68-9b8342ba7b70 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:07:12.099525 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-89c17d5e-a306-416f-8f68-9b8342ba7b70 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:07:12.099969 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-89c17d5e-a306-416f-8f68-9b8342ba7b70 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:07:12.230091 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-89c17d5e-a306-416f-8f68-9b8342ba7b70 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0c29696e24390a5492804e0948010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6b6775bdd84b24bf7a5ce051e30998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:07:12.238279 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-89c17d5e-a306-416f-8f68-9b8342ba7b70 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "GET /compute/v2.1/servers/42687c77-4c27-4921-9148-f95843474cf6" status: 200 len: 1690 microversion: 2.1 time: 0.152936 Sep 14 10:07:12.238849 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3481/7537] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:07:12 2022] GET /compute/v2.1/servers/42687c77-4c27-4921-9148-f95843474cf6 => generated 1690 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:07:13.262254 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-55535a2e-21c0-4a6c-91e4-92c24f2283fc tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:07:13.262895 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-55535a2e-21c0-4a6c-91e4-92c24f2283fc tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 42687c77-4c27-4921-9148-f95843474cf6] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:07:13.269703 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-55535a2e-21c0-4a6c-91e4-92c24f2283fc tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:07:13.270184 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-55535a2e-21c0-4a6c-91e4-92c24f2283fc tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:07:13.270619 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-55535a2e-21c0-4a6c-91e4-92c24f2283fc tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:07:13.271349 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-55535a2e-21c0-4a6c-91e4-92c24f2283fc tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:07:13.271809 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-55535a2e-21c0-4a6c-91e4-92c24f2283fc tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:07:13.272232 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-55535a2e-21c0-4a6c-91e4-92c24f2283fc tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:07:13.405275 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-55535a2e-21c0-4a6c-91e4-92c24f2283fc tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0c29696e24390a5492804e0948010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6b6775bdd84b24bf7a5ce051e30998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:07:13.413165 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-55535a2e-21c0-4a6c-91e4-92c24f2283fc tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "GET /compute/v2.1/servers/42687c77-4c27-4921-9148-f95843474cf6" status: 200 len: 1690 microversion: 2.1 time: 0.155412 Sep 14 10:07:13.413748 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4057/7538] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:07:13 2022] GET /compute/v2.1/servers/42687c77-4c27-4921-9148-f95843474cf6 => generated 1690 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:07:14.436620 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ba8b5dba-45b2-4a50-8c87-34f2179a3bf6 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:07:14.437257 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-ba8b5dba-45b2-4a50-8c87-34f2179a3bf6 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 42687c77-4c27-4921-9148-f95843474cf6] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:07:14.444168 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ba8b5dba-45b2-4a50-8c87-34f2179a3bf6 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:07:14.444676 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ba8b5dba-45b2-4a50-8c87-34f2179a3bf6 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:07:14.445133 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ba8b5dba-45b2-4a50-8c87-34f2179a3bf6 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:07:14.445913 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ba8b5dba-45b2-4a50-8c87-34f2179a3bf6 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:07:14.446962 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ba8b5dba-45b2-4a50-8c87-34f2179a3bf6 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:07:14.447417 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ba8b5dba-45b2-4a50-8c87-34f2179a3bf6 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:07:14.592600 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-ba8b5dba-45b2-4a50-8c87-34f2179a3bf6 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0c29696e24390a5492804e0948010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6b6775bdd84b24bf7a5ce051e30998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:07:14.603339 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-ba8b5dba-45b2-4a50-8c87-34f2179a3bf6 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "GET /compute/v2.1/servers/42687c77-4c27-4921-9148-f95843474cf6" status: 200 len: 1690 microversion: 2.1 time: 0.170630 Sep 14 10:07:14.603941 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3482/7539] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:07:14 2022] GET /compute/v2.1/servers/42687c77-4c27-4921-9148-f95843474cf6 => generated 1690 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:07:15.629687 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-112e2c5a-96ee-4e59-a414-4dc0a6a2bf0a tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:07:15.630389 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-112e2c5a-96ee-4e59-a414-4dc0a6a2bf0a tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 42687c77-4c27-4921-9148-f95843474cf6] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:07:15.637616 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-112e2c5a-96ee-4e59-a414-4dc0a6a2bf0a tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:07:15.638100 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-112e2c5a-96ee-4e59-a414-4dc0a6a2bf0a tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:07:15.638538 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-112e2c5a-96ee-4e59-a414-4dc0a6a2bf0a tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:07:15.639259 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-112e2c5a-96ee-4e59-a414-4dc0a6a2bf0a tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:07:15.639713 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-112e2c5a-96ee-4e59-a414-4dc0a6a2bf0a tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:07:15.640138 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-112e2c5a-96ee-4e59-a414-4dc0a6a2bf0a tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:07:15.776992 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-112e2c5a-96ee-4e59-a414-4dc0a6a2bf0a tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0c29696e24390a5492804e0948010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6b6775bdd84b24bf7a5ce051e30998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:07:15.785191 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-112e2c5a-96ee-4e59-a414-4dc0a6a2bf0a tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "GET /compute/v2.1/servers/42687c77-4c27-4921-9148-f95843474cf6" status: 200 len: 1690 microversion: 2.1 time: 0.159441 Sep 14 10:07:15.785760 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4058/7540] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:07:15 2022] GET /compute/v2.1/servers/42687c77-4c27-4921-9148-f95843474cf6 => generated 1690 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:07:16.808987 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-e651ac9b-bf67-482d-880b-d82a1e381940 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:07:16.809641 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-e651ac9b-bf67-482d-880b-d82a1e381940 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 42687c77-4c27-4921-9148-f95843474cf6] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:07:16.816565 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e651ac9b-bf67-482d-880b-d82a1e381940 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:07:16.817061 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e651ac9b-bf67-482d-880b-d82a1e381940 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:07:16.817507 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e651ac9b-bf67-482d-880b-d82a1e381940 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:07:16.818209 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e651ac9b-bf67-482d-880b-d82a1e381940 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:07:16.818678 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e651ac9b-bf67-482d-880b-d82a1e381940 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:07:16.819149 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e651ac9b-bf67-482d-880b-d82a1e381940 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:07:16.953291 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-e651ac9b-bf67-482d-880b-d82a1e381940 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0c29696e24390a5492804e0948010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6b6775bdd84b24bf7a5ce051e30998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:07:16.961943 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-e651ac9b-bf67-482d-880b-d82a1e381940 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "GET /compute/v2.1/servers/42687c77-4c27-4921-9148-f95843474cf6" status: 200 len: 1690 microversion: 2.1 time: 0.156182 Sep 14 10:07:16.961943 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3483/7541] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:07:16 2022] GET /compute/v2.1/servers/42687c77-4c27-4921-9148-f95843474cf6 => generated 1690 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:07:17.985786 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-05e259b2-9fa6-4f48-ae92-63f43e2b9e30 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:07:17.986414 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-05e259b2-9fa6-4f48-ae92-63f43e2b9e30 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 42687c77-4c27-4921-9148-f95843474cf6] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:07:17.993973 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-05e259b2-9fa6-4f48-ae92-63f43e2b9e30 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:07:17.994463 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-05e259b2-9fa6-4f48-ae92-63f43e2b9e30 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:07:17.994906 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-05e259b2-9fa6-4f48-ae92-63f43e2b9e30 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:07:17.995629 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-05e259b2-9fa6-4f48-ae92-63f43e2b9e30 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:07:17.996093 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-05e259b2-9fa6-4f48-ae92-63f43e2b9e30 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:07:17.996522 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-05e259b2-9fa6-4f48-ae92-63f43e2b9e30 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:07:18.128158 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-05e259b2-9fa6-4f48-ae92-63f43e2b9e30 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0c29696e24390a5492804e0948010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6b6775bdd84b24bf7a5ce051e30998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:07:18.136356 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-05e259b2-9fa6-4f48-ae92-63f43e2b9e30 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "GET /compute/v2.1/servers/42687c77-4c27-4921-9148-f95843474cf6" status: 200 len: 1690 microversion: 2.1 time: 0.154499 Sep 14 10:07:18.136934 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4059/7542] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:07:17 2022] GET /compute/v2.1/servers/42687c77-4c27-4921-9148-f95843474cf6 => generated 1690 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 10:07:19.160250 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-165159dd-abd3-4aec-b9c9-2808e528d02f tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:07:19.160899 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-165159dd-abd3-4aec-b9c9-2808e528d02f tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 42687c77-4c27-4921-9148-f95843474cf6] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:07:19.167899 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-165159dd-abd3-4aec-b9c9-2808e528d02f tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:07:19.168432 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-165159dd-abd3-4aec-b9c9-2808e528d02f tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:07:19.168931 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-165159dd-abd3-4aec-b9c9-2808e528d02f tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:07:19.169717 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-165159dd-abd3-4aec-b9c9-2808e528d02f tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:07:19.170200 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-165159dd-abd3-4aec-b9c9-2808e528d02f tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:07:19.170647 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-165159dd-abd3-4aec-b9c9-2808e528d02f tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:07:19.303775 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-165159dd-abd3-4aec-b9c9-2808e528d02f tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0c29696e24390a5492804e0948010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6b6775bdd84b24bf7a5ce051e30998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:07:19.311738 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-165159dd-abd3-4aec-b9c9-2808e528d02f tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "GET /compute/v2.1/servers/42687c77-4c27-4921-9148-f95843474cf6" status: 200 len: 1690 microversion: 2.1 time: 0.155474 Sep 14 10:07:19.312316 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3484/7543] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:07:19 2022] GET /compute/v2.1/servers/42687c77-4c27-4921-9148-f95843474cf6 => generated 1690 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:07:20.334919 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c73af246-ba28-4614-9742-9dfca6c752a2 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:07:20.335498 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-c73af246-ba28-4614-9742-9dfca6c752a2 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 42687c77-4c27-4921-9148-f95843474cf6] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:07:20.343142 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c73af246-ba28-4614-9742-9dfca6c752a2 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:07:20.343633 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c73af246-ba28-4614-9742-9dfca6c752a2 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:07:20.344080 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c73af246-ba28-4614-9742-9dfca6c752a2 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:07:20.344774 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c73af246-ba28-4614-9742-9dfca6c752a2 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:07:20.345235 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c73af246-ba28-4614-9742-9dfca6c752a2 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:07:20.345669 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c73af246-ba28-4614-9742-9dfca6c752a2 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:07:20.479603 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-c73af246-ba28-4614-9742-9dfca6c752a2 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0c29696e24390a5492804e0948010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6b6775bdd84b24bf7a5ce051e30998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:07:20.487665 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-c73af246-ba28-4614-9742-9dfca6c752a2 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "GET /compute/v2.1/servers/42687c77-4c27-4921-9148-f95843474cf6" status: 200 len: 1667 microversion: 2.1 time: 0.156799 Sep 14 10:07:20.488252 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4060/7544] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:07:20 2022] GET /compute/v2.1/servers/42687c77-4c27-4921-9148-f95843474cf6 => generated 1667 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:07:21.584312 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a00be736-d2b7-4cec-9493-449a4fda2321 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:07:21.586562 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-a00be736-d2b7-4cec-9493-449a4fda2321 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 42687c77-4c27-4921-9148-f95843474cf6] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:07:21.593765 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a00be736-d2b7-4cec-9493-449a4fda2321 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:07:21.594265 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a00be736-d2b7-4cec-9493-449a4fda2321 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:07:21.594721 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a00be736-d2b7-4cec-9493-449a4fda2321 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:07:21.595473 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a00be736-d2b7-4cec-9493-449a4fda2321 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:07:21.595949 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a00be736-d2b7-4cec-9493-449a4fda2321 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:07:21.596389 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a00be736-d2b7-4cec-9493-449a4fda2321 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:07:21.660526 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-a00be736-d2b7-4cec-9493-449a4fda2321 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "POST /compute/v2.1/servers/42687c77-4c27-4921-9148-f95843474cf6/action" status: 200 len: 38449 microversion: 2.1 time: 0.080073 Sep 14 10:07:21.661230 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3485/7545] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 10:07:21 2022] POST /compute/v2.1/servers/42687c77-4c27-4921-9148-f95843474cf6/action => generated 38449 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 10:07:21.673557 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3054abbe-7965-4140-b041-3c8fb26b2323 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:07:21.680513 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3054abbe-7965-4140-b041-3c8fb26b2323 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:07:21.681604 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3054abbe-7965-4140-b041-3c8fb26b2323 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:07:21.682060 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3054abbe-7965-4140-b041-3c8fb26b2323 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:07:21.703896 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-3054abbe-7965-4140-b041-3c8fb26b2323 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 42687c77-4c27-4921-9148-f95843474cf6] Going to try to start instance {{(pid=128759) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 14 10:07:21.744872 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-3054abbe-7965-4140-b041-3c8fb26b2323 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "POST /compute/v2.1/servers/42687c77-4c27-4921-9148-f95843474cf6/action" status: 202 len: 0 microversion: 2.1 time: 0.075047 Sep 14 10:07:21.745465 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4061/7546] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 10:07:21 2022] POST /compute/v2.1/servers/42687c77-4c27-4921-9148-f95843474cf6/action => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 10:07:21.754219 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1abc2909-971f-40d6-882e-d51e7d497c58 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:07:21.754958 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-1abc2909-971f-40d6-882e-d51e7d497c58 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 42687c77-4c27-4921-9148-f95843474cf6] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:07:21.762060 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1abc2909-971f-40d6-882e-d51e7d497c58 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:07:21.762564 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1abc2909-971f-40d6-882e-d51e7d497c58 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:07:21.763056 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1abc2909-971f-40d6-882e-d51e7d497c58 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:07:21.763773 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1abc2909-971f-40d6-882e-d51e7d497c58 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:07:21.764253 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1abc2909-971f-40d6-882e-d51e7d497c58 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:07:21.764713 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1abc2909-971f-40d6-882e-d51e7d497c58 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:07:21.950084 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-1abc2909-971f-40d6-882e-d51e7d497c58 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0c29696e24390a5492804e0948010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6b6775bdd84b24bf7a5ce051e30998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:07:21.958371 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-1abc2909-971f-40d6-882e-d51e7d497c58 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "GET /compute/v2.1/servers/42687c77-4c27-4921-9148-f95843474cf6" status: 200 len: 1676 microversion: 2.1 time: 0.208384 Sep 14 10:07:21.959192 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3486/7547] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:07:21 2022] GET /compute/v2.1/servers/42687c77-4c27-4921-9148-f95843474cf6 => generated 1676 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:07:22.984753 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8b859174-c59c-47a3-9bd4-767e17d3351d tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:07:22.985459 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-8b859174-c59c-47a3-9bd4-767e17d3351d tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 42687c77-4c27-4921-9148-f95843474cf6] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:07:22.991708 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8b859174-c59c-47a3-9bd4-767e17d3351d tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:07:22.992193 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8b859174-c59c-47a3-9bd4-767e17d3351d tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:07:22.992631 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8b859174-c59c-47a3-9bd4-767e17d3351d tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:07:22.993971 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8b859174-c59c-47a3-9bd4-767e17d3351d tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:07:22.994426 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8b859174-c59c-47a3-9bd4-767e17d3351d tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:07:22.994853 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8b859174-c59c-47a3-9bd4-767e17d3351d tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:07:23.127873 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-8b859174-c59c-47a3-9bd4-767e17d3351d tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0c29696e24390a5492804e0948010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6b6775bdd84b24bf7a5ce051e30998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:07:23.136598 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-8b859174-c59c-47a3-9bd4-767e17d3351d tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "GET /compute/v2.1/servers/42687c77-4c27-4921-9148-f95843474cf6" status: 200 len: 1676 microversion: 2.1 time: 0.156744 Sep 14 10:07:23.137180 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4062/7548] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:07:22 2022] GET /compute/v2.1/servers/42687c77-4c27-4921-9148-f95843474cf6 => generated 1676 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:07:24.159758 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-161be307-7682-4329-8663-66e3d9f8082f tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:07:24.160402 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-161be307-7682-4329-8663-66e3d9f8082f tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 42687c77-4c27-4921-9148-f95843474cf6] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:07:24.167219 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-161be307-7682-4329-8663-66e3d9f8082f tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:07:24.167728 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-161be307-7682-4329-8663-66e3d9f8082f tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:07:24.168187 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-161be307-7682-4329-8663-66e3d9f8082f tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:07:24.168910 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-161be307-7682-4329-8663-66e3d9f8082f tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:07:24.169389 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-161be307-7682-4329-8663-66e3d9f8082f tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:07:24.169839 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-161be307-7682-4329-8663-66e3d9f8082f tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:07:24.299288 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-161be307-7682-4329-8663-66e3d9f8082f tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0c29696e24390a5492804e0948010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6b6775bdd84b24bf7a5ce051e30998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:07:24.307708 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-161be307-7682-4329-8663-66e3d9f8082f tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "GET /compute/v2.1/servers/42687c77-4c27-4921-9148-f95843474cf6" status: 200 len: 1680 microversion: 2.1 time: 0.151950 Sep 14 10:07:24.308287 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3487/7549] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:07:24 2022] GET /compute/v2.1/servers/42687c77-4c27-4921-9148-f95843474cf6 => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:07:56.530679 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f1b7c141-a114-4cdc-88fd-41f5dbbac311 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:07:56.532964 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f1b7c141-a114-4cdc-88fd-41f5dbbac311 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 42687c77-4c27-4921-9148-f95843474cf6] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:07:56.535470 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=16 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:07:56.536130 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:07:56.541998 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f1b7c141-a114-4cdc-88fd-41f5dbbac311 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:07:56.542482 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f1b7c141-a114-4cdc-88fd-41f5dbbac311 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:07:56.542916 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f1b7c141-a114-4cdc-88fd-41f5dbbac311 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:07:56.543628 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f1b7c141-a114-4cdc-88fd-41f5dbbac311 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:07:56.544081 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f1b7c141-a114-4cdc-88fd-41f5dbbac311 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:07:56.544513 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f1b7c141-a114-4cdc-88fd-41f5dbbac311 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:07:56.616227 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f1b7c141-a114-4cdc-88fd-41f5dbbac311 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "POST /compute/v2.1/servers/42687c77-4c27-4921-9148-f95843474cf6/action" status: 200 len: 62981 microversion: 2.1 time: 0.089319 Sep 14 10:07:56.616909 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4063/7550] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 10:07:56 2022] POST /compute/v2.1/servers/42687c77-4c27-4921-9148-f95843474cf6/action => generated 62981 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 10:08:13.665581 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-1c610751-b898-4b74-9074-6050524ffcb0 req-d6192fa4-97f4-4287-9cf6-b9fb765a74c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42687c77-4c27-4921-9148-f95843474cf6", "tag": "35840791-621e-49a0-9e5f-96fe845a8ee3"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:08:13.670067 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-acad3b7a-ba84-417f-a5e9-ba4a1c31fb22 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:08:13.670583 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-acad3b7a-ba84-417f-a5e9-ba4a1c31fb22 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 42687c77-4c27-4921-9148-f95843474cf6] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:08:13.681299 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=2 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:08:13.681519 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=16 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:08:13.682026 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=46 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:08:13.682797 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=4 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:08:13.683691 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-acad3b7a-ba84-417f-a5e9-ba4a1c31fb22 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:08:13.684243 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-acad3b7a-ba84-417f-a5e9-ba4a1c31fb22 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:08:13.685095 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-acad3b7a-ba84-417f-a5e9-ba4a1c31fb22 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:08:13.685235 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-1c610751-b898-4b74-9074-6050524ffcb0 req-d6192fa4-97f4-4287-9cf6-b9fb765a74c4 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:08:13.685477 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-acad3b7a-ba84-417f-a5e9-ba4a1c31fb22 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:08:13.685596 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-1c610751-b898-4b74-9074-6050524ffcb0 req-d6192fa4-97f4-4287-9cf6-b9fb765a74c4 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:08:13.686132 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-1c610751-b898-4b74-9074-6050524ffcb0 req-d6192fa4-97f4-4287-9cf6-b9fb765a74c4 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:08:13.686262 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-acad3b7a-ba84-417f-a5e9-ba4a1c31fb22 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:08:13.686460 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-acad3b7a-ba84-417f-a5e9-ba4a1c31fb22 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:08:13.700336 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-1c610751-b898-4b74-9074-6050524ffcb0 req-d6192fa4-97f4-4287-9cf6-b9fb765a74c4 service nova] Creating event network-changed:35840791-621e-49a0-9e5f-96fe845a8ee3 for instance 42687c77-4c27-4921-9148-f95843474cf6 on n-h1-836830-18 Sep 14 10:08:13.705592 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-1c610751-b898-4b74-9074-6050524ffcb0 req-d6192fa4-97f4-4287-9cf6-b9fb765a74c4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044112 Sep 14 10:08:13.706542 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4064/7551] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 10:08:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:08:13.717971 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-acad3b7a-ba84-417f-a5e9-ba4a1c31fb22 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 42687c77-4c27-4921-9148-f95843474cf6] Going to try to terminate instance {{(pid=128758) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 10:08:13.801534 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-acad3b7a-ba84-417f-a5e9-ba4a1c31fb22 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "DELETE /compute/v2.1/servers/42687c77-4c27-4921-9148-f95843474cf6" status: 204 len: 0 microversion: 2.1 time: 0.141952 Sep 14 10:08:13.803207 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3488/7552] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 10:08:13 2022] DELETE /compute/v2.1/servers/42687c77-4c27-4921-9148-f95843474cf6 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 10:08:13.812985 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-80604bb0-2292-4299-b277-e5837b3fccf7 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:08:13.813904 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-80604bb0-2292-4299-b277-e5837b3fccf7 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 42687c77-4c27-4921-9148-f95843474cf6] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:08:13.820717 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-80604bb0-2292-4299-b277-e5837b3fccf7 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:08:13.821284 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-80604bb0-2292-4299-b277-e5837b3fccf7 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:08:13.821826 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-80604bb0-2292-4299-b277-e5837b3fccf7 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:08:13.822593 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-80604bb0-2292-4299-b277-e5837b3fccf7 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:08:13.823166 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-80604bb0-2292-4299-b277-e5837b3fccf7 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:08:13.823666 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-80604bb0-2292-4299-b277-e5837b3fccf7 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:08:13.966465 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-80604bb0-2292-4299-b277-e5837b3fccf7 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0c29696e24390a5492804e0948010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6b6775bdd84b24bf7a5ce051e30998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:08:13.974479 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-80604bb0-2292-4299-b277-e5837b3fccf7 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "GET /compute/v2.1/servers/42687c77-4c27-4921-9148-f95843474cf6" status: 200 len: 1686 microversion: 2.1 time: 0.167044 Sep 14 10:08:13.975179 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4065/7553] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:08:13 2022] GET /compute/v2.1/servers/42687c77-4c27-4921-9148-f95843474cf6 => generated 1686 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 10:08:15.001292 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-3f77b148-cc90-4deb-a59f-ba51eca9b5d1 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:08:15.002008 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-3f77b148-cc90-4deb-a59f-ba51eca9b5d1 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 42687c77-4c27-4921-9148-f95843474cf6] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:08:15.009193 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3f77b148-cc90-4deb-a59f-ba51eca9b5d1 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:08:15.009694 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3f77b148-cc90-4deb-a59f-ba51eca9b5d1 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:08:15.010145 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3f77b148-cc90-4deb-a59f-ba51eca9b5d1 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:08:15.010854 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3f77b148-cc90-4deb-a59f-ba51eca9b5d1 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:08:15.011351 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3f77b148-cc90-4deb-a59f-ba51eca9b5d1 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:08:15.011794 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3f77b148-cc90-4deb-a59f-ba51eca9b5d1 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:08:15.228363 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-3f77b148-cc90-4deb-a59f-ba51eca9b5d1 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0c29696e24390a5492804e0948010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6b6775bdd84b24bf7a5ce051e30998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:08:15.237804 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-3f77b148-cc90-4deb-a59f-ba51eca9b5d1 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "GET /compute/v2.1/servers/42687c77-4c27-4921-9148-f95843474cf6" status: 200 len: 1686 microversion: 2.1 time: 0.240797 Sep 14 10:08:15.238415 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3489/7554] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:08:14 2022] GET /compute/v2.1/servers/42687c77-4c27-4921-9148-f95843474cf6 => generated 1686 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:08:16.047409 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-871fb4d4-ddb2-43ac-ada2-fe1c95c92f18 req-f276a4d7-c038-4649-b7b4-1f8a90d81610 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42687c77-4c27-4921-9148-f95843474cf6", "name": "network-vif-deleted", "tag": "35840791-621e-49a0-9e5f-96fe845a8ee3"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:08:16.057923 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-871fb4d4-ddb2-43ac-ada2-fe1c95c92f18 req-f276a4d7-c038-4649-b7b4-1f8a90d81610 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:08:16.058416 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-871fb4d4-ddb2-43ac-ada2-fe1c95c92f18 req-f276a4d7-c038-4649-b7b4-1f8a90d81610 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:08:16.058884 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-871fb4d4-ddb2-43ac-ada2-fe1c95c92f18 req-f276a4d7-c038-4649-b7b4-1f8a90d81610 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:08:16.070381 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-871fb4d4-ddb2-43ac-ada2-fe1c95c92f18 req-f276a4d7-c038-4649-b7b4-1f8a90d81610 service nova] Creating event network-vif-deleted:35840791-621e-49a0-9e5f-96fe845a8ee3 for instance 42687c77-4c27-4921-9148-f95843474cf6 on n-h1-836830-18 Sep 14 10:08:16.076026 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-871fb4d4-ddb2-43ac-ada2-fe1c95c92f18 req-f276a4d7-c038-4649-b7b4-1f8a90d81610 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032894 Sep 14 10:08:16.076776 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4066/7555] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 10:08:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 10:08:16.262199 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-84be1da5-d80d-4720-8bdd-a83314872e01 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:08:16.262881 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-84be1da5-d80d-4720-8bdd-a83314872e01 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 42687c77-4c27-4921-9148-f95843474cf6] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:08:16.270015 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-84be1da5-d80d-4720-8bdd-a83314872e01 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:08:16.270530 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-84be1da5-d80d-4720-8bdd-a83314872e01 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:08:16.271013 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-84be1da5-d80d-4720-8bdd-a83314872e01 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:08:16.271735 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-84be1da5-d80d-4720-8bdd-a83314872e01 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:08:16.272218 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-84be1da5-d80d-4720-8bdd-a83314872e01 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:08:16.272665 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-84be1da5-d80d-4720-8bdd-a83314872e01 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:08:16.304686 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-84be1da5-d80d-4720-8bdd-a83314872e01 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:08:16.305003 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-84be1da5-d80d-4720-8bdd-a83314872e01 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:08:16.305462 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-84be1da5-d80d-4720-8bdd-a83314872e01 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:08:16.305930 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.objects.instance [None req-84be1da5-d80d-4720-8bdd-a83314872e01 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lazy-loading 'fault' on Instance uuid 42687c77-4c27-4921-9148-f95843474cf6 {{(pid=128758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 10:08:16.348009 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-84be1da5-d80d-4720-8bdd-a83314872e01 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0c29696e24390a5492804e0948010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6b6775bdd84b24bf7a5ce051e30998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:08:16.356418 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-84be1da5-d80d-4720-8bdd-a83314872e01 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "GET /compute/v2.1/servers/42687c77-4c27-4921-9148-f95843474cf6" status: 200 len: 1355 microversion: 2.1 time: 0.098654 Sep 14 10:08:16.357013 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3490/7556] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:08:16 2022] GET /compute/v2.1/servers/42687c77-4c27-4921-9148-f95843474cf6 => generated 1355 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:08:17.381656 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3977a5ff-5d03-4296-b3c9-9c3746230b66 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:08:17.382374 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-3977a5ff-5d03-4296-b3c9-9c3746230b66 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 42687c77-4c27-4921-9148-f95843474cf6] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:08:17.388557 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3977a5ff-5d03-4296-b3c9-9c3746230b66 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:08:17.389046 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3977a5ff-5d03-4296-b3c9-9c3746230b66 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:08:17.389489 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3977a5ff-5d03-4296-b3c9-9c3746230b66 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:08:17.390181 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3977a5ff-5d03-4296-b3c9-9c3746230b66 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:08:17.390641 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3977a5ff-5d03-4296-b3c9-9c3746230b66 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:08:17.391105 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3977a5ff-5d03-4296-b3c9-9c3746230b66 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:08:17.405890 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-3977a5ff-5d03-4296-b3c9-9c3746230b66 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] HTTP exception thrown: Instance 42687c77-4c27-4921-9148-f95843474cf6 could not be found. Sep 14 10:08:17.407586 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3977a5ff-5d03-4296-b3c9-9c3746230b66 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Request method failure captured: Sep 14 10:08:17.407586 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/42687c77-4c27-4921-9148-f95843474cf6 HTTP/1.1 Sep 14 10:08:17.407586 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 10:08:17.407586 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 10:08:17.407586 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 10:08:17.407586 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 10:08:17.407586 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 10:08:17.407586 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 10:08:17.407586 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 10:08:17.407586 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 10:08:17.407586 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIaYrejhj2TGf9R9N95darLKnnjP7yvAOzzRGk88fUneEcfLJ79TotlbWmaifDlagIOgchpK-W9GG7KW3sgKBKNTQaihdlpQR7nbYvQmmAemQtSyT8HYEWV36tTrgBgWqk_HpFAN-DV62Paaf0wzD9le8cOOWXqmVMqtvFpWKeFSur8Y Sep 14 10:08:17.407586 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 10:08:17.407586 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 10:08:17.407586 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 10:08:17.407586 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 10:08:17.407586 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 10:08:17.407586 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 10:08:17.407586 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 1e6b6775bdd84b24bf7a5ce051e30998 Sep 14 10:08:17.407586 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-722006907 Sep 14 10:08:17.407586 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 10:08:17.407586 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 10:08:17.407586 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/1e6b6775bdd84b24bf7a5ce051e30998"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_1e6b6775bdd84b24bf7a5ce051e30998"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1e6b6775bdd84b24bf7a5ce051e30998"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1e6b6775bdd84b24bf7a5ce051e30998"}]}] Sep 14 10:08:17.407586 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-TestNetworkAdvancedServerOps-722006907 Sep 14 10:08:17.407586 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 1e6b6775bdd84b24bf7a5ce051e30998 Sep 14 10:08:17.407586 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-722006907 Sep 14 10:08:17.407586 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-TestNetworkAdvancedServerOps-722006907-project Sep 14 10:08:17.407586 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 10:08:17.407586 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 10:08:17.407586 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: caa0c29696e24390a5492804e0948010 Sep 14 10:08:17.407586 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-TestNetworkAdvancedServerOps-722006907-project Sep 14 10:08:17.407586 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 10:08:17.407586 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance 42687c77-4c27-4921-9148-f95843474cf6 could not be found. Sep 14 10:08:17.407586 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '42687c77-4c27-4921-9148-f95843474cf6'} Sep 14 10:08:17.407586 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 10:08:17.407586 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:08:17.407586 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 10:08:17.407586 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 10:08:17.407586 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 10:08:17.407586 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 10:08:17.407586 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 10:08:17.407586 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 10:08:17.407586 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 10:08:17.407586 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 10:08:17.407586 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42687c77-4c27-4921-9148-f95843474cf6 could not be found. Sep 14 10:08:17.407586 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 10:08:17.407586 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:08:17.407586 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 10:08:17.407586 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:08:17.407586 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:08:17.407586 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:08:17.407586 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 10:08:17.407586 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 10:08:17.407586 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 10:08:17.407586 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 10:08:17.407586 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 10:08:17.407586 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 10:08:17.407586 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 10:08:17.407586 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 10:08:17.407586 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 10:08:17.407586 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 10:08:17.407586 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42687c77-4c27-4921-9148-f95843474cf6 could not be found. Sep 14 10:08:17.407586 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 10:08:17.407586 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:08:17.414470 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 10:08:17.414470 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:08:17.414470 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:08:17.414470 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:08:17.414470 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 10:08:17.414470 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 10:08:17.414470 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42687c77-4c27-4921-9148-f95843474cf6 could not be found. Sep 14 10:08:17.414470 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 10:08:17.414470 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3977a5ff-5d03-4296-b3c9-9c3746230b66 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Returning 404 to user: Instance 42687c77-4c27-4921-9148-f95843474cf6 could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 10:08:17.414470 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-3977a5ff-5d03-4296-b3c9-9c3746230b66 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "GET /compute/v2.1/servers/42687c77-4c27-4921-9148-f95843474cf6" status: 404 len: 111 microversion: 2.1 time: 0.032511 Sep 14 10:08:17.414470 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4067/7557] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:08:17 2022] GET /compute/v2.1/servers/42687c77-4c27-4921-9148-f95843474cf6 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 10:08:20.690210 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-331434bd-1647-46d0-8412-8af6d204c2b4 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '.version_select at 0x7f7d3f41bc10>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:08:20.710688 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-331434bd-1647-46d0-8412-8af6d204c2b4 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-453629073" status: 202 len: 0 microversion: 2.1 time: 0.024483 Sep 14 10:08:20.711748 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3491/7558] 10.222.0.60 () {58 vars in 1281 bytes} [Wed Sep 14 10:08:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-453629073 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 10:08:20.743432 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c2a700d9-5b38-4063-b14e-7ba1c9d292e4 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Action: 'create', calling method: .version_select at 0x7f7d48808c10>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-699298217", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEDeEKvmAvwP55ju54HT5yx87+RfZ4nFd++ETqYukfMAVy3eWLJr72QLhp+R/3RRlFbu0DwWNOUCzhyJXLcZkZU+80ae2qmLdu95G3k+NEmBHOGu0g2Hc3b7rjGNHOyubw=="}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:08:20.760977 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-c2a700d9-5b38-4063-b14e-7ba1c9d292e4 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Getting quotas for project 1e6b6775bdd84b24bf7a5ce051e30998. Resources: {'key_pairs'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 10:08:20.766161 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-c2a700d9-5b38-4063-b14e-7ba1c9d292e4 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Getting quotas for user caa0c29696e24390a5492804e0948010 and project 1e6b6775bdd84b24bf7a5ce051e30998. Resources: {'key_pairs'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 10:08:20.779193 n-d-836830-18 devstack@n-api.service[128759]: ERROR oslo.messaging._drivers.impl_rabbit [None req-c2a700d9-5b38-4063-b14e-7ba1c9d292e4 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [48ddcf4f-b5ef-443d-80c4-a7292cbf1807] AMQP server on 10.222.0.60:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 14 10:08:21.785497 n-d-836830-18 devstack@n-api.service[128759]: INFO oslo.messaging._drivers.impl_rabbit [None req-c2a700d9-5b38-4063-b14e-7ba1c9d292e4 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [48ddcf4f-b5ef-443d-80c4-a7292cbf1807] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 52742. Sep 14 10:08:21.799447 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-c2a700d9-5b38-4063-b14e-7ba1c9d292e4 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 1.059875 Sep 14 10:08:21.800071 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4068/7559] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Sep 14 10:08:20 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:08:27.292416 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:08:27.298490 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-8c18223b-9849-4433-b4cb-d6cb469e50fc tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-2059824075", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "networks": [{"uuid": "b8f8d711-f92e-42d4-9a53-086291c26ea3"}], "key_name": "tempest-TestNetworkAdvancedServerOps-699298217", "security_groups": [{"name": "tempest-secgroup-smoke-858857158"}]}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:08:27.550478 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.network.neutron [None req-8c18223b-9849-4433-b4cb-d6cb469e50fc tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] validate_networks() for [('b8f8d711-f92e-42d4-9a53-086291c26ea3', None, None, None, None, None)] {{(pid=128758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 10:08:27.981936 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-8c18223b-9849-4433-b4cb-d6cb469e50fc tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Flavor limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 10:08:27.982469 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-8c18223b-9849-4433-b4cb-d6cb469e50fc tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Image limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 10:08:27.983095 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-8c18223b-9849-4433-b4cb-d6cb469e50fc tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Flavor pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 10:08:27.983537 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-8c18223b-9849-4433-b4cb-d6cb469e50fc tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Image pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 10:08:27.984328 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-8c18223b-9849-4433-b4cb-d6cb469e50fc tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 10:08:27.995243 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8c18223b-9849-4433-b4cb-d6cb469e50fc tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:08:27.995754 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8c18223b-9849-4433-b4cb-d6cb469e50fc tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:08:27.996415 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8c18223b-9849-4433-b4cb-d6cb469e50fc tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:08:27.997178 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8c18223b-9849-4433-b4cb-d6cb469e50fc tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:08:27.997658 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8c18223b-9849-4433-b4cb-d6cb469e50fc tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:08:27.998106 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-8c18223b-9849-4433-b4cb-d6cb469e50fc tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:08:28.021497 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-8c18223b-9849-4433-b4cb-d6cb469e50fc tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Getting quotas for project 1e6b6775bdd84b24bf7a5ce051e30998. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 10:08:28.027646 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-8c18223b-9849-4433-b4cb-d6cb469e50fc tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Getting quotas for user caa0c29696e24390a5492804e0948010 and project 1e6b6775bdd84b24bf7a5ce051e30998. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 10:08:28.041929 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-8c18223b-9849-4433-b4cb-d6cb469e50fc tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Going to run 1 instances... {{(pid=128758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 10:08:28.045012 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-8c18223b-9849-4433-b4cb-d6cb469e50fc tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 99ed9f43-64f0-49bb-866c-26e3b86562cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 10:08:28.107349 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-8c18223b-9849-4433-b4cb-d6cb469e50fc tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.816892 Sep 14 10:08:28.108416 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3492/7560] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 10:08:27 2022] POST /compute/v2.1/servers => generated 405 bytes in 819 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 10:08:28.117943 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=12 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:08:28.123597 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8f4426d6-b7ed-4485-b36f-21562a5de0a1 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:08:28.125012 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-8f4426d6-b7ed-4485-b36f-21562a5de0a1 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 99ed9f43-64f0-49bb-866c-26e3b86562cb] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:08:28.188834 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-8f4426d6-b7ed-4485-b36f-21562a5de0a1 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0c29696e24390a5492804e0948010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6b6775bdd84b24bf7a5ce051e30998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:08:28.201969 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-8f4426d6-b7ed-4485-b36f-21562a5de0a1 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "GET /compute/v2.1/servers/99ed9f43-64f0-49bb-866c-26e3b86562cb" status: 200 len: 1266 microversion: 2.1 time: 0.085552 Sep 14 10:08:28.202567 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4069/7561] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:08:28 2022] GET /compute/v2.1/servers/99ed9f43-64f0-49bb-866c-26e3b86562cb => generated 1266 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:08:29.225787 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b706beb6-38d7-4c5a-a12c-980ce188b0bb tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:08:29.226986 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-b706beb6-38d7-4c5a-a12c-980ce188b0bb tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 99ed9f43-64f0-49bb-866c-26e3b86562cb] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:08:29.240507 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b706beb6-38d7-4c5a-a12c-980ce188b0bb tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:08:29.242486 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b706beb6-38d7-4c5a-a12c-980ce188b0bb tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:08:29.244629 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b706beb6-38d7-4c5a-a12c-980ce188b0bb tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:08:29.245576 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b706beb6-38d7-4c5a-a12c-980ce188b0bb tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:08:29.249642 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b706beb6-38d7-4c5a-a12c-980ce188b0bb tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:08:29.250318 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b706beb6-38d7-4c5a-a12c-980ce188b0bb tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:08:29.394880 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-b706beb6-38d7-4c5a-a12c-980ce188b0bb tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0c29696e24390a5492804e0948010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6b6775bdd84b24bf7a5ce051e30998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:08:29.411292 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-b706beb6-38d7-4c5a-a12c-980ce188b0bb tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "GET /compute/v2.1/servers/99ed9f43-64f0-49bb-866c-26e3b86562cb" status: 200 len: 1326 microversion: 2.1 time: 0.189225 Sep 14 10:08:29.412670 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3493/7562] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:08:29 2022] GET /compute/v2.1/servers/99ed9f43-64f0-49bb-866c-26e3b86562cb => generated 1326 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:08:30.436290 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f5115a99-0a74-45a7-8ffb-86399c58d10d tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:08:30.436902 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f5115a99-0a74-45a7-8ffb-86399c58d10d tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 99ed9f43-64f0-49bb-866c-26e3b86562cb] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:08:30.446851 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f5115a99-0a74-45a7-8ffb-86399c58d10d tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:08:30.450773 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f5115a99-0a74-45a7-8ffb-86399c58d10d tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:08:30.451323 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f5115a99-0a74-45a7-8ffb-86399c58d10d tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:08:30.452089 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f5115a99-0a74-45a7-8ffb-86399c58d10d tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:08:30.452568 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f5115a99-0a74-45a7-8ffb-86399c58d10d tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:08:30.453011 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f5115a99-0a74-45a7-8ffb-86399c58d10d tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:08:30.621569 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f5115a99-0a74-45a7-8ffb-86399c58d10d tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0c29696e24390a5492804e0948010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6b6775bdd84b24bf7a5ce051e30998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:08:30.630759 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f5115a99-0a74-45a7-8ffb-86399c58d10d tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "GET /compute/v2.1/servers/99ed9f43-64f0-49bb-866c-26e3b86562cb" status: 200 len: 1391 microversion: 2.1 time: 0.197852 Sep 14 10:08:30.631912 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4070/7563] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:08:30 2022] GET /compute/v2.1/servers/99ed9f43-64f0-49bb-866c-26e3b86562cb => generated 1391 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:08:31.244874 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-7997debd-fd8d-4bc4-b24b-501458c2546f req-2c311199-5bba-4593-a548-3691c4882dfe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99ed9f43-64f0-49bb-866c-26e3b86562cb", "tag": "4e71aff5-56a0-41c7-96ea-28dbf8c22ee5"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:08:31.273295 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-7997debd-fd8d-4bc4-b24b-501458c2546f req-2c311199-5bba-4593-a548-3691c4882dfe service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:08:31.274082 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-7997debd-fd8d-4bc4-b24b-501458c2546f req-2c311199-5bba-4593-a548-3691c4882dfe service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:08:31.281467 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-7997debd-fd8d-4bc4-b24b-501458c2546f req-2c311199-5bba-4593-a548-3691c4882dfe service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:08:31.296722 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-7997debd-fd8d-4bc4-b24b-501458c2546f req-2c311199-5bba-4593-a548-3691c4882dfe service nova] Creating event network-changed:4e71aff5-56a0-41c7-96ea-28dbf8c22ee5 for instance 99ed9f43-64f0-49bb-866c-26e3b86562cb on n-h1-836830-18 Sep 14 10:08:31.302017 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-7997debd-fd8d-4bc4-b24b-501458c2546f req-2c311199-5bba-4593-a548-3691c4882dfe service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130839 Sep 14 10:08:31.302867 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3494/7564] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 10:08:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 10:08:31.653860 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-cfe9109f-5007-4add-ab67-ed78ddb75ca9 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:08:31.654483 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-cfe9109f-5007-4add-ab67-ed78ddb75ca9 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 99ed9f43-64f0-49bb-866c-26e3b86562cb] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:08:31.662072 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cfe9109f-5007-4add-ab67-ed78ddb75ca9 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:08:31.662842 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cfe9109f-5007-4add-ab67-ed78ddb75ca9 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:08:31.664176 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cfe9109f-5007-4add-ab67-ed78ddb75ca9 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:08:31.665351 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cfe9109f-5007-4add-ab67-ed78ddb75ca9 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:08:31.665870 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cfe9109f-5007-4add-ab67-ed78ddb75ca9 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:08:31.666339 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cfe9109f-5007-4add-ab67-ed78ddb75ca9 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:08:31.801672 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-cfe9109f-5007-4add-ab67-ed78ddb75ca9 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0c29696e24390a5492804e0948010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6b6775bdd84b24bf7a5ce051e30998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:08:31.810068 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-cfe9109f-5007-4add-ab67-ed78ddb75ca9 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "GET /compute/v2.1/servers/99ed9f43-64f0-49bb-866c-26e3b86562cb" status: 200 len: 1391 microversion: 2.1 time: 0.160368 Sep 14 10:08:31.810636 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4071/7565] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:08:31 2022] GET /compute/v2.1/servers/99ed9f43-64f0-49bb-866c-26e3b86562cb => generated 1391 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:08:32.834665 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-2cae653c-a271-4d2c-af36-f9248a5b9a0b tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:08:32.835355 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-2cae653c-a271-4d2c-af36-f9248a5b9a0b tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 99ed9f43-64f0-49bb-866c-26e3b86562cb] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:08:32.842290 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2cae653c-a271-4d2c-af36-f9248a5b9a0b tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:08:32.842792 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2cae653c-a271-4d2c-af36-f9248a5b9a0b tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:08:32.843266 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2cae653c-a271-4d2c-af36-f9248a5b9a0b tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:08:32.843974 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2cae653c-a271-4d2c-af36-f9248a5b9a0b tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:08:32.844445 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2cae653c-a271-4d2c-af36-f9248a5b9a0b tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:08:32.844887 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2cae653c-a271-4d2c-af36-f9248a5b9a0b tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:08:32.975654 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-2cae653c-a271-4d2c-af36-f9248a5b9a0b tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0c29696e24390a5492804e0948010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6b6775bdd84b24bf7a5ce051e30998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:08:32.983620 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-2cae653c-a271-4d2c-af36-f9248a5b9a0b tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "GET /compute/v2.1/servers/99ed9f43-64f0-49bb-866c-26e3b86562cb" status: 200 len: 1391 microversion: 2.1 time: 0.154195 Sep 14 10:08:32.984199 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3495/7566] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:08:32 2022] GET /compute/v2.1/servers/99ed9f43-64f0-49bb-866c-26e3b86562cb => generated 1391 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:08:34.007295 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-652f5364-b68f-452a-b1b3-3f44cff84ebb tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:08:34.007952 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-652f5364-b68f-452a-b1b3-3f44cff84ebb tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 99ed9f43-64f0-49bb-866c-26e3b86562cb] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:08:34.014784 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-652f5364-b68f-452a-b1b3-3f44cff84ebb tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:08:34.015320 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-652f5364-b68f-452a-b1b3-3f44cff84ebb tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:08:34.015762 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-652f5364-b68f-452a-b1b3-3f44cff84ebb tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:08:34.016458 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-652f5364-b68f-452a-b1b3-3f44cff84ebb tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:08:34.016910 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-652f5364-b68f-452a-b1b3-3f44cff84ebb tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:08:34.017337 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-652f5364-b68f-452a-b1b3-3f44cff84ebb tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:08:34.147464 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-652f5364-b68f-452a-b1b3-3f44cff84ebb tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0c29696e24390a5492804e0948010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6b6775bdd84b24bf7a5ce051e30998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:08:34.155749 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-652f5364-b68f-452a-b1b3-3f44cff84ebb tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "GET /compute/v2.1/servers/99ed9f43-64f0-49bb-866c-26e3b86562cb" status: 200 len: 1391 microversion: 2.1 time: 0.152442 Sep 14 10:08:34.156325 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4072/7567] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:08:34 2022] GET /compute/v2.1/servers/99ed9f43-64f0-49bb-866c-26e3b86562cb => generated 1391 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:08:35.179124 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a7d6b566-c108-49a1-b15f-1f8b832a0caf tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:08:35.179771 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-a7d6b566-c108-49a1-b15f-1f8b832a0caf tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 99ed9f43-64f0-49bb-866c-26e3b86562cb] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:08:35.187338 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a7d6b566-c108-49a1-b15f-1f8b832a0caf tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:08:35.187849 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a7d6b566-c108-49a1-b15f-1f8b832a0caf tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:08:35.188307 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a7d6b566-c108-49a1-b15f-1f8b832a0caf tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:08:35.189028 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a7d6b566-c108-49a1-b15f-1f8b832a0caf tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:08:35.189503 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a7d6b566-c108-49a1-b15f-1f8b832a0caf tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:08:35.189950 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a7d6b566-c108-49a1-b15f-1f8b832a0caf tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:08:35.325431 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-a7d6b566-c108-49a1-b15f-1f8b832a0caf tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0c29696e24390a5492804e0948010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6b6775bdd84b24bf7a5ce051e30998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:08:35.333467 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-a7d6b566-c108-49a1-b15f-1f8b832a0caf tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "GET /compute/v2.1/servers/99ed9f43-64f0-49bb-866c-26e3b86562cb" status: 200 len: 1391 microversion: 2.1 time: 0.158285 Sep 14 10:08:35.334059 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3496/7568] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:08:35 2022] GET /compute/v2.1/servers/99ed9f43-64f0-49bb-866c-26e3b86562cb => generated 1391 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 10:08:36.357316 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-5a824998-1050-4bab-8603-b3908cb7aae1 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:08:36.357930 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-5a824998-1050-4bab-8603-b3908cb7aae1 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 99ed9f43-64f0-49bb-866c-26e3b86562cb] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:08:36.364791 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5a824998-1050-4bab-8603-b3908cb7aae1 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:08:36.365287 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5a824998-1050-4bab-8603-b3908cb7aae1 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:08:36.365733 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5a824998-1050-4bab-8603-b3908cb7aae1 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:08:36.366437 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5a824998-1050-4bab-8603-b3908cb7aae1 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:08:36.366903 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5a824998-1050-4bab-8603-b3908cb7aae1 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:08:36.367365 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5a824998-1050-4bab-8603-b3908cb7aae1 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:08:36.512859 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-5a824998-1050-4bab-8603-b3908cb7aae1 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0c29696e24390a5492804e0948010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6b6775bdd84b24bf7a5ce051e30998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:08:36.520842 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-5a824998-1050-4bab-8603-b3908cb7aae1 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "GET /compute/v2.1/servers/99ed9f43-64f0-49bb-866c-26e3b86562cb" status: 200 len: 1391 microversion: 2.1 time: 0.168432 Sep 14 10:08:36.521453 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4073/7569] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:08:36 2022] GET /compute/v2.1/servers/99ed9f43-64f0-49bb-866c-26e3b86562cb => generated 1391 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:08:36.623931 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-761d34db-bda1-41a0-8dfa-9fad4adcc75f req-003a42e8-76fe-4848-9073-e63f517613b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99ed9f43-64f0-49bb-866c-26e3b86562cb", "name": "network-vif-plugged", "status": "completed", "tag": "4e71aff5-56a0-41c7-96ea-28dbf8c22ee5"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:08:36.634344 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-761d34db-bda1-41a0-8dfa-9fad4adcc75f req-003a42e8-76fe-4848-9073-e63f517613b6 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:08:36.634925 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-761d34db-bda1-41a0-8dfa-9fad4adcc75f req-003a42e8-76fe-4848-9073-e63f517613b6 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:08:36.635392 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-761d34db-bda1-41a0-8dfa-9fad4adcc75f req-003a42e8-76fe-4848-9073-e63f517613b6 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:08:36.646739 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-761d34db-bda1-41a0-8dfa-9fad4adcc75f req-003a42e8-76fe-4848-9073-e63f517613b6 service nova] Creating event network-vif-plugged:4e71aff5-56a0-41c7-96ea-28dbf8c22ee5 for instance 99ed9f43-64f0-49bb-866c-26e3b86562cb on n-h1-836830-18 Sep 14 10:08:36.651894 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-761d34db-bda1-41a0-8dfa-9fad4adcc75f req-003a42e8-76fe-4848-9073-e63f517613b6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032474 Sep 14 10:08:36.652536 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3497/7570] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 10:08:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:08:37.544904 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d8cfd379-aa15-40e0-b9a2-db696bf29408 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:08:37.545529 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-d8cfd379-aa15-40e0-b9a2-db696bf29408 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 99ed9f43-64f0-49bb-866c-26e3b86562cb] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:08:37.552388 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d8cfd379-aa15-40e0-b9a2-db696bf29408 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:08:37.552916 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d8cfd379-aa15-40e0-b9a2-db696bf29408 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:08:37.553360 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d8cfd379-aa15-40e0-b9a2-db696bf29408 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:08:37.554063 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d8cfd379-aa15-40e0-b9a2-db696bf29408 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:08:37.554526 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d8cfd379-aa15-40e0-b9a2-db696bf29408 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:08:37.554974 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d8cfd379-aa15-40e0-b9a2-db696bf29408 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:08:37.690204 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-d8cfd379-aa15-40e0-b9a2-db696bf29408 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0c29696e24390a5492804e0948010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6b6775bdd84b24bf7a5ce051e30998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:08:37.697938 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d8cfd379-aa15-40e0-b9a2-db696bf29408 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "GET /compute/v2.1/servers/99ed9f43-64f0-49bb-866c-26e3b86562cb" status: 200 len: 1391 microversion: 2.1 time: 0.156950 Sep 14 10:08:37.698509 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4074/7571] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:08:37 2022] GET /compute/v2.1/servers/99ed9f43-64f0-49bb-866c-26e3b86562cb => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:08:38.719775 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=2 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:08:38.720570 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=6 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:08:38.724670 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-66658f6f-fcd6-482c-b7d0-c49712a814fc tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:08:38.725404 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-66658f6f-fcd6-482c-b7d0-c49712a814fc tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 99ed9f43-64f0-49bb-866c-26e3b86562cb] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:08:38.732813 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-66658f6f-fcd6-482c-b7d0-c49712a814fc tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:08:38.733314 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-66658f6f-fcd6-482c-b7d0-c49712a814fc tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:08:38.733770 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-66658f6f-fcd6-482c-b7d0-c49712a814fc tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:08:38.734529 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-66658f6f-fcd6-482c-b7d0-c49712a814fc tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:08:38.734975 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-66658f6f-fcd6-482c-b7d0-c49712a814fc tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:08:38.735429 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-66658f6f-fcd6-482c-b7d0-c49712a814fc tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:08:38.872798 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-66658f6f-fcd6-482c-b7d0-c49712a814fc tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0c29696e24390a5492804e0948010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6b6775bdd84b24bf7a5ce051e30998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:08:38.881109 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-66658f6f-fcd6-482c-b7d0-c49712a814fc tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "GET /compute/v2.1/servers/99ed9f43-64f0-49bb-866c-26e3b86562cb" status: 200 len: 1563 microversion: 2.1 time: 0.163154 Sep 14 10:08:38.881693 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3498/7572] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:08:38 2022] GET /compute/v2.1/servers/99ed9f43-64f0-49bb-866c-26e3b86562cb => generated 1563 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:08:38.906791 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a6c10488-2a7d-4c8c-979e-93ab48b996b8 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:08:38.907461 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-a6c10488-2a7d-4c8c-979e-93ab48b996b8 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 99ed9f43-64f0-49bb-866c-26e3b86562cb] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:08:38.909758 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=6 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:08:38.916163 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a6c10488-2a7d-4c8c-979e-93ab48b996b8 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:08:38.916668 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a6c10488-2a7d-4c8c-979e-93ab48b996b8 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:08:38.917118 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a6c10488-2a7d-4c8c-979e-93ab48b996b8 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:08:38.917833 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a6c10488-2a7d-4c8c-979e-93ab48b996b8 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:08:38.918292 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a6c10488-2a7d-4c8c-979e-93ab48b996b8 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:08:38.918758 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a6c10488-2a7d-4c8c-979e-93ab48b996b8 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:08:39.055947 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-a6c10488-2a7d-4c8c-979e-93ab48b996b8 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0c29696e24390a5492804e0948010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6b6775bdd84b24bf7a5ce051e30998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:08:39.064445 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a6c10488-2a7d-4c8c-979e-93ab48b996b8 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "GET /compute/v2.1/servers/99ed9f43-64f0-49bb-866c-26e3b86562cb" status: 200 len: 1563 microversion: 2.1 time: 0.162201 Sep 14 10:08:39.065041 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4075/7573] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:08:38 2022] GET /compute/v2.1/servers/99ed9f43-64f0-49bb-866c-26e3b86562cb => generated 1563 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:08:40.650794 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-18049f36-8ca8-4047-881c-247b9a47b309 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:08:40.651621 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-18049f36-8ca8-4047-881c-247b9a47b309 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 99ed9f43-64f0-49bb-866c-26e3b86562cb] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:08:40.654187 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-a180b00c-a44b-4ae9-895f-3c7921742722 req-7a99595c-4640-4a86-99e6-8fd8a007ade9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99ed9f43-64f0-49bb-866c-26e3b86562cb", "tag": "4e71aff5-56a0-41c7-96ea-28dbf8c22ee5"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:08:40.659145 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-18049f36-8ca8-4047-881c-247b9a47b309 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:08:40.659900 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-18049f36-8ca8-4047-881c-247b9a47b309 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:08:40.660360 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-18049f36-8ca8-4047-881c-247b9a47b309 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:08:40.661091 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-18049f36-8ca8-4047-881c-247b9a47b309 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:08:40.661701 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-18049f36-8ca8-4047-881c-247b9a47b309 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:08:40.662151 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-18049f36-8ca8-4047-881c-247b9a47b309 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:08:40.665311 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-a180b00c-a44b-4ae9-895f-3c7921742722 req-7a99595c-4640-4a86-99e6-8fd8a007ade9 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:08:40.666055 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-a180b00c-a44b-4ae9-895f-3c7921742722 req-7a99595c-4640-4a86-99e6-8fd8a007ade9 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:08:40.666556 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-a180b00c-a44b-4ae9-895f-3c7921742722 req-7a99595c-4640-4a86-99e6-8fd8a007ade9 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:08:40.678824 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-a180b00c-a44b-4ae9-895f-3c7921742722 req-7a99595c-4640-4a86-99e6-8fd8a007ade9 service nova] Creating event network-changed:4e71aff5-56a0-41c7-96ea-28dbf8c22ee5 for instance 99ed9f43-64f0-49bb-866c-26e3b86562cb on n-h1-836830-18 Sep 14 10:08:40.684228 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-a180b00c-a44b-4ae9-895f-3c7921742722 req-7a99595c-4640-4a86-99e6-8fd8a007ade9 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034643 Sep 14 10:08:40.685104 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4076/7574] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 10:08:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:08:40.809674 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-18049f36-8ca8-4047-881c-247b9a47b309 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0c29696e24390a5492804e0948010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6b6775bdd84b24bf7a5ce051e30998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:08:40.818728 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-18049f36-8ca8-4047-881c-247b9a47b309 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "GET /compute/v2.1/servers/99ed9f43-64f0-49bb-866c-26e3b86562cb" status: 200 len: 1563 microversion: 2.1 time: 0.171922 Sep 14 10:08:40.819527 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3499/7575] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:08:40 2022] GET /compute/v2.1/servers/99ed9f43-64f0-49bb-866c-26e3b86562cb => generated 1563 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:09:12.100927 n-d-836830-18 devstack@n-api.service[128759]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 10:09:12.101513 n-d-836830-18 devstack@n-api.service[128759]: Wed Sep 14 10:09:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/99ed9f43-64f0-49bb-866c-26e3b86562cb/action (ip 10.222.0.60) !!! Sep 14 10:09:12.102070 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:09:12.102812 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=38 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:09:12.107550 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c53ccbd7-d119-4cb7-b47e-cd4258c02551 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:09:12.109863 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-c53ccbd7-d119-4cb7-b47e-cd4258c02551 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 99ed9f43-64f0-49bb-866c-26e3b86562cb] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:09:12.119748 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c53ccbd7-d119-4cb7-b47e-cd4258c02551 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:09:12.120232 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c53ccbd7-d119-4cb7-b47e-cd4258c02551 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:09:12.120670 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c53ccbd7-d119-4cb7-b47e-cd4258c02551 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:09:12.121361 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c53ccbd7-d119-4cb7-b47e-cd4258c02551 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:09:12.121820 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c53ccbd7-d119-4cb7-b47e-cd4258c02551 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:09:12.122247 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c53ccbd7-d119-4cb7-b47e-cd4258c02551 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:09:12.194406 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-c53ccbd7-d119-4cb7-b47e-cd4258c02551 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "POST /compute/v2.1/servers/99ed9f43-64f0-49bb-866c-26e3b86562cb/action" status: 200 len: 24549 microversion: 2.1 time: 0.095807 Sep 14 10:09:12.195071 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4077/7576] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 10:09:12 2022] POST /compute/v2.1/servers/99ed9f43-64f0-49bb-866c-26e3b86562cb/action => generated 24549 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 10:09:42.400067 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:09:42.400838 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=36 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:09:42.405476 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1a734587-5f5f-4fc8-b86e-c98d7672be2f tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:09:42.406024 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-1a734587-5f5f-4fc8-b86e-c98d7672be2f tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 99ed9f43-64f0-49bb-866c-26e3b86562cb] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:09:42.413209 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1a734587-5f5f-4fc8-b86e-c98d7672be2f tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:09:42.413707 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1a734587-5f5f-4fc8-b86e-c98d7672be2f tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:09:42.414154 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1a734587-5f5f-4fc8-b86e-c98d7672be2f tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:09:42.414852 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1a734587-5f5f-4fc8-b86e-c98d7672be2f tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:09:42.415365 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1a734587-5f5f-4fc8-b86e-c98d7672be2f tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:09:42.415796 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1a734587-5f5f-4fc8-b86e-c98d7672be2f tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:09:42.441320 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.objects.instance [None req-1a734587-5f5f-4fc8-b86e-c98d7672be2f tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lazy-loading 'flavor' on Instance uuid 99ed9f43-64f0-49bb-866c-26e3b86562cb {{(pid=128758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 10:09:42.509105 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-1a734587-5f5f-4fc8-b86e-c98d7672be2f tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "POST /compute/v2.1/servers/99ed9f43-64f0-49bb-866c-26e3b86562cb/action" status: 202 len: 0 microversion: 2.1 time: 0.110715 Sep 14 10:09:42.509782 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3500/7577] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 10:09:42 2022] POST /compute/v2.1/servers/99ed9f43-64f0-49bb-866c-26e3b86562cb/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 10:09:42.518441 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ca17fb0b-4b23-4c62-a215-752d5bcb919f tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:09:42.519593 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-ca17fb0b-4b23-4c62-a215-752d5bcb919f tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 99ed9f43-64f0-49bb-866c-26e3b86562cb] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:09:42.523699 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=2 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:09:42.524422 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=4 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:09:42.529266 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ca17fb0b-4b23-4c62-a215-752d5bcb919f tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:09:42.529834 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ca17fb0b-4b23-4c62-a215-752d5bcb919f tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:09:42.530361 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ca17fb0b-4b23-4c62-a215-752d5bcb919f tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:09:42.531131 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ca17fb0b-4b23-4c62-a215-752d5bcb919f tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:09:42.531631 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ca17fb0b-4b23-4c62-a215-752d5bcb919f tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:09:42.532064 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ca17fb0b-4b23-4c62-a215-752d5bcb919f tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:09:42.666914 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-ca17fb0b-4b23-4c62-a215-752d5bcb919f tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0c29696e24390a5492804e0948010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6b6775bdd84b24bf7a5ce051e30998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:09:42.674675 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-ca17fb0b-4b23-4c62-a215-752d5bcb919f tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "GET /compute/v2.1/servers/99ed9f43-64f0-49bb-866c-26e3b86562cb" status: 200 len: 1689 microversion: 2.1 time: 0.160472 Sep 14 10:09:42.675282 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4078/7578] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:09:42 2022] GET /compute/v2.1/servers/99ed9f43-64f0-49bb-866c-26e3b86562cb => generated 1689 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:09:43.698526 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-fa336d6f-04e9-47d0-8992-8c532ff01cf8 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:09:43.699272 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-fa336d6f-04e9-47d0-8992-8c532ff01cf8 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 99ed9f43-64f0-49bb-866c-26e3b86562cb] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:09:43.707031 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fa336d6f-04e9-47d0-8992-8c532ff01cf8 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:09:43.707529 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fa336d6f-04e9-47d0-8992-8c532ff01cf8 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:09:43.708486 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fa336d6f-04e9-47d0-8992-8c532ff01cf8 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:09:43.709183 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fa336d6f-04e9-47d0-8992-8c532ff01cf8 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:09:43.709650 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fa336d6f-04e9-47d0-8992-8c532ff01cf8 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:09:43.710085 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-fa336d6f-04e9-47d0-8992-8c532ff01cf8 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:09:43.839644 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-fa336d6f-04e9-47d0-8992-8c532ff01cf8 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0c29696e24390a5492804e0948010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6b6775bdd84b24bf7a5ce051e30998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:09:43.847570 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-fa336d6f-04e9-47d0-8992-8c532ff01cf8 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "GET /compute/v2.1/servers/99ed9f43-64f0-49bb-866c-26e3b86562cb" status: 200 len: 1689 microversion: 2.1 time: 0.153315 Sep 14 10:09:43.848155 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3501/7579] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:09:43 2022] GET /compute/v2.1/servers/99ed9f43-64f0-49bb-866c-26e3b86562cb => generated 1689 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:09:44.873118 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d2676e8a-9533-47f1-89a2-3539fbdc0469 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:09:44.873734 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-d2676e8a-9533-47f1-89a2-3539fbdc0469 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 99ed9f43-64f0-49bb-866c-26e3b86562cb] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:09:44.881156 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d2676e8a-9533-47f1-89a2-3539fbdc0469 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:09:44.881620 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d2676e8a-9533-47f1-89a2-3539fbdc0469 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:09:44.882062 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d2676e8a-9533-47f1-89a2-3539fbdc0469 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:09:44.882749 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d2676e8a-9533-47f1-89a2-3539fbdc0469 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:09:44.883223 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d2676e8a-9533-47f1-89a2-3539fbdc0469 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:09:44.883646 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d2676e8a-9533-47f1-89a2-3539fbdc0469 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:09:45.017495 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-d2676e8a-9533-47f1-89a2-3539fbdc0469 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0c29696e24390a5492804e0948010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6b6775bdd84b24bf7a5ce051e30998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:09:45.025897 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d2676e8a-9533-47f1-89a2-3539fbdc0469 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "GET /compute/v2.1/servers/99ed9f43-64f0-49bb-866c-26e3b86562cb" status: 200 len: 1672 microversion: 2.1 time: 0.156756 Sep 14 10:09:45.026469 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4079/7580] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:09:44 2022] GET /compute/v2.1/servers/99ed9f43-64f0-49bb-866c-26e3b86562cb => generated 1672 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:09:46.119285 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-becde8fc-1cdc-44d6-b58c-e9b66c2562d9 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:09:46.121563 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-becde8fc-1cdc-44d6-b58c-e9b66c2562d9 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 99ed9f43-64f0-49bb-866c-26e3b86562cb] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:09:46.128403 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-becde8fc-1cdc-44d6-b58c-e9b66c2562d9 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:09:46.128912 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-becde8fc-1cdc-44d6-b58c-e9b66c2562d9 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:09:46.129358 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-becde8fc-1cdc-44d6-b58c-e9b66c2562d9 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:09:46.130064 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-becde8fc-1cdc-44d6-b58c-e9b66c2562d9 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:09:46.130534 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-becde8fc-1cdc-44d6-b58c-e9b66c2562d9 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:09:46.131014 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-becde8fc-1cdc-44d6-b58c-e9b66c2562d9 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:09:46.191506 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-becde8fc-1cdc-44d6-b58c-e9b66c2562d9 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "POST /compute/v2.1/servers/99ed9f43-64f0-49bb-866c-26e3b86562cb/action" status: 200 len: 38423 microversion: 2.1 time: 0.076126 Sep 14 10:09:46.192153 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3502/7581] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 10:09:46 2022] POST /compute/v2.1/servers/99ed9f43-64f0-49bb-866c-26e3b86562cb/action => generated 38423 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 10:09:46.204802 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-573369c5-f362-47b5-a1b3-08a92f856024 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:09:46.205334 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-573369c5-f362-47b5-a1b3-08a92f856024 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 99ed9f43-64f0-49bb-866c-26e3b86562cb] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:09:46.212363 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-573369c5-f362-47b5-a1b3-08a92f856024 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:09:46.212852 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-573369c5-f362-47b5-a1b3-08a92f856024 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:09:46.213290 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-573369c5-f362-47b5-a1b3-08a92f856024 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:09:46.213983 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-573369c5-f362-47b5-a1b3-08a92f856024 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:09:46.214437 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-573369c5-f362-47b5-a1b3-08a92f856024 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:09:46.214862 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-573369c5-f362-47b5-a1b3-08a92f856024 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:09:46.285715 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-573369c5-f362-47b5-a1b3-08a92f856024 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "POST /compute/v2.1/servers/99ed9f43-64f0-49bb-866c-26e3b86562cb/action" status: 202 len: 0 microversion: 2.1 time: 0.084789 Sep 14 10:09:46.286503 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4080/7582] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 10:09:46 2022] POST /compute/v2.1/servers/99ed9f43-64f0-49bb-866c-26e3b86562cb/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 10:09:46.295588 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-35ab0640-dcb3-4e48-aa7d-ce74a8e5a85e tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:09:46.296448 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-35ab0640-dcb3-4e48-aa7d-ce74a8e5a85e tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 99ed9f43-64f0-49bb-866c-26e3b86562cb] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:09:46.303514 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-35ab0640-dcb3-4e48-aa7d-ce74a8e5a85e tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:09:46.304025 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-35ab0640-dcb3-4e48-aa7d-ce74a8e5a85e tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:09:46.304510 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-35ab0640-dcb3-4e48-aa7d-ce74a8e5a85e tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:09:46.305333 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-35ab0640-dcb3-4e48-aa7d-ce74a8e5a85e tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:09:46.305859 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-35ab0640-dcb3-4e48-aa7d-ce74a8e5a85e tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:09:46.306258 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-35ab0640-dcb3-4e48-aa7d-ce74a8e5a85e tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:09:46.452231 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-35ab0640-dcb3-4e48-aa7d-ce74a8e5a85e tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0c29696e24390a5492804e0948010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6b6775bdd84b24bf7a5ce051e30998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:09:46.460826 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-35ab0640-dcb3-4e48-aa7d-ce74a8e5a85e tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "GET /compute/v2.1/servers/99ed9f43-64f0-49bb-866c-26e3b86562cb" status: 200 len: 1678 microversion: 2.1 time: 0.169767 Sep 14 10:09:46.461412 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3503/7583] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:09:46 2022] GET /compute/v2.1/servers/99ed9f43-64f0-49bb-866c-26e3b86562cb => generated 1678 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:09:47.485542 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-584d8156-12fc-45e6-9111-7c178638a096 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:09:47.486246 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-584d8156-12fc-45e6-9111-7c178638a096 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 99ed9f43-64f0-49bb-866c-26e3b86562cb] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:09:47.492446 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-584d8156-12fc-45e6-9111-7c178638a096 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:09:47.492930 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-584d8156-12fc-45e6-9111-7c178638a096 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:09:47.493358 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-584d8156-12fc-45e6-9111-7c178638a096 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:09:47.494044 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-584d8156-12fc-45e6-9111-7c178638a096 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:09:47.494494 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-584d8156-12fc-45e6-9111-7c178638a096 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:09:47.494920 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-584d8156-12fc-45e6-9111-7c178638a096 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:09:47.626257 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-584d8156-12fc-45e6-9111-7c178638a096 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0c29696e24390a5492804e0948010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6b6775bdd84b24bf7a5ce051e30998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:09:47.634024 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-584d8156-12fc-45e6-9111-7c178638a096 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "GET /compute/v2.1/servers/99ed9f43-64f0-49bb-866c-26e3b86562cb" status: 200 len: 1678 microversion: 2.1 time: 0.153628 Sep 14 10:09:47.634603 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4081/7584] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:09:47 2022] GET /compute/v2.1/servers/99ed9f43-64f0-49bb-866c-26e3b86562cb => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:09:48.658680 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-aea65f68-4ea4-4e69-a16b-dbd5936ba2a6 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:09:48.659439 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-aea65f68-4ea4-4e69-a16b-dbd5936ba2a6 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 99ed9f43-64f0-49bb-866c-26e3b86562cb] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:09:48.667213 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-aea65f68-4ea4-4e69-a16b-dbd5936ba2a6 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:09:48.667724 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-aea65f68-4ea4-4e69-a16b-dbd5936ba2a6 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:09:48.668188 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-aea65f68-4ea4-4e69-a16b-dbd5936ba2a6 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:09:48.668904 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-aea65f68-4ea4-4e69-a16b-dbd5936ba2a6 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:09:48.669381 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-aea65f68-4ea4-4e69-a16b-dbd5936ba2a6 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:09:48.669826 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-aea65f68-4ea4-4e69-a16b-dbd5936ba2a6 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:09:48.803314 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-aea65f68-4ea4-4e69-a16b-dbd5936ba2a6 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0c29696e24390a5492804e0948010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6b6775bdd84b24bf7a5ce051e30998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:09:48.811238 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-aea65f68-4ea4-4e69-a16b-dbd5936ba2a6 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "GET /compute/v2.1/servers/99ed9f43-64f0-49bb-866c-26e3b86562cb" status: 200 len: 1681 microversion: 2.1 time: 0.156583 Sep 14 10:09:48.811823 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3504/7585] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:09:48 2022] GET /compute/v2.1/servers/99ed9f43-64f0-49bb-866c-26e3b86562cb => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:09:48.909559 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-34c32e1e-65e9-494d-878b-674f38b7d0e2 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:09:48.911794 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-34c32e1e-65e9-494d-878b-674f38b7d0e2 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 99ed9f43-64f0-49bb-866c-26e3b86562cb] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:09:48.919193 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-34c32e1e-65e9-494d-878b-674f38b7d0e2 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:09:48.919676 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-34c32e1e-65e9-494d-878b-674f38b7d0e2 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:09:48.920110 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-34c32e1e-65e9-494d-878b-674f38b7d0e2 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:09:48.920796 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-34c32e1e-65e9-494d-878b-674f38b7d0e2 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:09:48.921249 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-34c32e1e-65e9-494d-878b-674f38b7d0e2 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:09:48.921673 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-34c32e1e-65e9-494d-878b-674f38b7d0e2 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:09:48.989321 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-34c32e1e-65e9-494d-878b-674f38b7d0e2 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "POST /compute/v2.1/servers/99ed9f43-64f0-49bb-866c-26e3b86562cb/action" status: 200 len: 38423 microversion: 2.1 time: 0.083637 Sep 14 10:09:48.989993 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4082/7586] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 10:09:48 2022] POST /compute/v2.1/servers/99ed9f43-64f0-49bb-866c-26e3b86562cb/action => generated 38423 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 10:09:50.226461 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ba8c722b-bd2a-4bdf-adbc-b889e6d63332 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:09:50.232681 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-6fab9b84-5184-42fe-a29a-e1126d99c4a8 req-609d6aab-9390-4b02-883e-04f5dee2e2ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99ed9f43-64f0-49bb-866c-26e3b86562cb", "tag": "4e71aff5-56a0-41c7-96ea-28dbf8c22ee5"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:09:50.233230 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-ba8c722b-bd2a-4bdf-adbc-b889e6d63332 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 99ed9f43-64f0-49bb-866c-26e3b86562cb] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:09:50.246319 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ba8c722b-bd2a-4bdf-adbc-b889e6d63332 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:09:50.246912 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ba8c722b-bd2a-4bdf-adbc-b889e6d63332 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:09:50.247487 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ba8c722b-bd2a-4bdf-adbc-b889e6d63332 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:09:50.248121 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-6fab9b84-5184-42fe-a29a-e1126d99c4a8 req-609d6aab-9390-4b02-883e-04f5dee2e2ca service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:09:50.248258 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-6fab9b84-5184-42fe-a29a-e1126d99c4a8 req-609d6aab-9390-4b02-883e-04f5dee2e2ca service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:09:50.248354 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ba8c722b-bd2a-4bdf-adbc-b889e6d63332 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:09:50.248589 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-6fab9b84-5184-42fe-a29a-e1126d99c4a8 req-609d6aab-9390-4b02-883e-04f5dee2e2ca service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:09:50.248719 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ba8c722b-bd2a-4bdf-adbc-b889e6d63332 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:09:50.249092 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ba8c722b-bd2a-4bdf-adbc-b889e6d63332 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:09:50.262373 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-6fab9b84-5184-42fe-a29a-e1126d99c4a8 req-609d6aab-9390-4b02-883e-04f5dee2e2ca service nova] Creating event network-changed:4e71aff5-56a0-41c7-96ea-28dbf8c22ee5 for instance 99ed9f43-64f0-49bb-866c-26e3b86562cb on n-h1-836830-18 Sep 14 10:09:50.267324 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-6fab9b84-5184-42fe-a29a-e1126d99c4a8 req-609d6aab-9390-4b02-883e-04f5dee2e2ca service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038909 Sep 14 10:09:50.268116 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4083/7587] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 10:09:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:09:50.282369 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-ba8c722b-bd2a-4bdf-adbc-b889e6d63332 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 99ed9f43-64f0-49bb-866c-26e3b86562cb] Going to try to terminate instance {{(pid=128758) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 10:09:50.367605 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-ba8c722b-bd2a-4bdf-adbc-b889e6d63332 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "DELETE /compute/v2.1/servers/99ed9f43-64f0-49bb-866c-26e3b86562cb" status: 204 len: 0 microversion: 2.1 time: 0.144650 Sep 14 10:09:50.368635 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3505/7588] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 10:09:50 2022] DELETE /compute/v2.1/servers/99ed9f43-64f0-49bb-866c-26e3b86562cb => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 10:09:50.377875 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9c474639-0799-43f8-a806-a6e199c8a9ba tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:09:50.379053 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-9c474639-0799-43f8-a806-a6e199c8a9ba tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 99ed9f43-64f0-49bb-866c-26e3b86562cb] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:09:50.387031 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9c474639-0799-43f8-a806-a6e199c8a9ba tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:09:50.387796 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9c474639-0799-43f8-a806-a6e199c8a9ba tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:09:50.388472 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9c474639-0799-43f8-a806-a6e199c8a9ba tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:09:50.389377 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9c474639-0799-43f8-a806-a6e199c8a9ba tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:09:50.390028 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9c474639-0799-43f8-a806-a6e199c8a9ba tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:09:50.390673 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9c474639-0799-43f8-a806-a6e199c8a9ba tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:09:50.532892 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-9c474639-0799-43f8-a806-a6e199c8a9ba tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0c29696e24390a5492804e0948010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6b6775bdd84b24bf7a5ce051e30998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:09:50.540755 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-9c474639-0799-43f8-a806-a6e199c8a9ba tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "GET /compute/v2.1/servers/99ed9f43-64f0-49bb-866c-26e3b86562cb" status: 200 len: 1687 microversion: 2.1 time: 0.167234 Sep 14 10:09:50.541330 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4084/7589] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:09:50 2022] GET /compute/v2.1/servers/99ed9f43-64f0-49bb-866c-26e3b86562cb => generated 1687 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:09:51.566920 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-4b231983-3a45-44c0-8d19-d118bd13667e tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:09:51.567605 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-4b231983-3a45-44c0-8d19-d118bd13667e tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 99ed9f43-64f0-49bb-866c-26e3b86562cb] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:09:51.575067 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4b231983-3a45-44c0-8d19-d118bd13667e tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:09:51.575576 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4b231983-3a45-44c0-8d19-d118bd13667e tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:09:51.576028 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4b231983-3a45-44c0-8d19-d118bd13667e tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:09:51.576743 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4b231983-3a45-44c0-8d19-d118bd13667e tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:09:51.577214 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4b231983-3a45-44c0-8d19-d118bd13667e tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:09:51.577655 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4b231983-3a45-44c0-8d19-d118bd13667e tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:09:51.711605 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-4b231983-3a45-44c0-8d19-d118bd13667e tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0c29696e24390a5492804e0948010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6b6775bdd84b24bf7a5ce051e30998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:09:51.719700 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-4b231983-3a45-44c0-8d19-d118bd13667e tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "GET /compute/v2.1/servers/99ed9f43-64f0-49bb-866c-26e3b86562cb" status: 200 len: 1687 microversion: 2.1 time: 0.157178 Sep 14 10:09:51.720295 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3506/7590] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:09:51 2022] GET /compute/v2.1/servers/99ed9f43-64f0-49bb-866c-26e3b86562cb => generated 1687 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:09:52.735840 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-723db273-77b1-4211-b7b8-35442dfc0e4f req-d6d6135d-0552-45f2-b6a3-b987f9d5f279 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99ed9f43-64f0-49bb-866c-26e3b86562cb", "name": "network-vif-deleted", "tag": "4e71aff5-56a0-41c7-96ea-28dbf8c22ee5"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:09:52.744578 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-7f28febb-f5f9-49b2-b908-d533d9dc4122 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:09:52.745163 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-7f28febb-f5f9-49b2-b908-d533d9dc4122 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 99ed9f43-64f0-49bb-866c-26e3b86562cb] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:09:52.746698 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-723db273-77b1-4211-b7b8-35442dfc0e4f req-d6d6135d-0552-45f2-b6a3-b987f9d5f279 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:09:52.747230 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-723db273-77b1-4211-b7b8-35442dfc0e4f req-d6d6135d-0552-45f2-b6a3-b987f9d5f279 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:09:52.747675 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-723db273-77b1-4211-b7b8-35442dfc0e4f req-d6d6135d-0552-45f2-b6a3-b987f9d5f279 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:09:52.753242 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7f28febb-f5f9-49b2-b908-d533d9dc4122 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:09:52.753760 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7f28febb-f5f9-49b2-b908-d533d9dc4122 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:09:52.754216 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7f28febb-f5f9-49b2-b908-d533d9dc4122 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:09:52.754963 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7f28febb-f5f9-49b2-b908-d533d9dc4122 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:09:52.755443 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7f28febb-f5f9-49b2-b908-d533d9dc4122 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:09:52.755893 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7f28febb-f5f9-49b2-b908-d533d9dc4122 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:09:52.759575 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-723db273-77b1-4211-b7b8-35442dfc0e4f req-d6d6135d-0552-45f2-b6a3-b987f9d5f279 service nova] Creating event network-vif-deleted:4e71aff5-56a0-41c7-96ea-28dbf8c22ee5 for instance 99ed9f43-64f0-49bb-866c-26e3b86562cb on n-h1-836830-18 Sep 14 10:09:52.764518 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-723db273-77b1-4211-b7b8-35442dfc0e4f req-d6d6135d-0552-45f2-b6a3-b987f9d5f279 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032499 Sep 14 10:09:52.765321 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4085/7591] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 10:09:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:09:52.820730 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-7f28febb-f5f9-49b2-b908-d533d9dc4122 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0c29696e24390a5492804e0948010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6b6775bdd84b24bf7a5ce051e30998', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:09:52.828838 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-7f28febb-f5f9-49b2-b908-d533d9dc4122 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "GET /compute/v2.1/servers/99ed9f43-64f0-49bb-866c-26e3b86562cb" status: 200 len: 1502 microversion: 2.1 time: 0.088545 Sep 14 10:09:52.829660 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3507/7592] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:09:52 2022] GET /compute/v2.1/servers/99ed9f43-64f0-49bb-866c-26e3b86562cb => generated 1502 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 10:09:53.853705 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-35f21362-c5e2-4bae-8e19-42ed89da118e tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:09:53.854699 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-35f21362-c5e2-4bae-8e19-42ed89da118e tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] [instance: 99ed9f43-64f0-49bb-866c-26e3b86562cb] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:09:53.861822 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-35f21362-c5e2-4bae-8e19-42ed89da118e tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:09:53.862317 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-35f21362-c5e2-4bae-8e19-42ed89da118e tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:09:53.862765 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-35f21362-c5e2-4bae-8e19-42ed89da118e tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:09:53.863493 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-35f21362-c5e2-4bae-8e19-42ed89da118e tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:09:53.863969 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-35f21362-c5e2-4bae-8e19-42ed89da118e tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:09:53.864404 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-35f21362-c5e2-4bae-8e19-42ed89da118e tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:09:53.877693 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-35f21362-c5e2-4bae-8e19-42ed89da118e tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] HTTP exception thrown: Instance 99ed9f43-64f0-49bb-866c-26e3b86562cb could not be found. Sep 14 10:09:53.879391 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-35f21362-c5e2-4bae-8e19-42ed89da118e tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Request method failure captured: Sep 14 10:09:53.879391 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/99ed9f43-64f0-49bb-866c-26e3b86562cb HTTP/1.1 Sep 14 10:09:53.879391 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 10:09:53.879391 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 10:09:53.879391 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 10:09:53.879391 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 10:09:53.879391 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 10:09:53.879391 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 10:09:53.879391 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 10:09:53.879391 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 10:09:53.879391 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIaYrejhj2TGf9R9N95darLKnnjP7yvAOzzRGk88fUneEcfLJ79TotlbWmaifDlagIOgchpK-W9GG7KW3sgKBKNTQaihdlpQR7nbYvQmmAemQtSyT8HYEWV36tTrgBgWqk_HpFAN-DV62Paaf0wzD9le8cOOWXqmVMqtvFpWKeFSur8Y Sep 14 10:09:53.879391 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 10:09:53.879391 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 10:09:53.879391 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 10:09:53.879391 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 10:09:53.879391 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 10:09:53.879391 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 10:09:53.879391 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 1e6b6775bdd84b24bf7a5ce051e30998 Sep 14 10:09:53.879391 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-722006907 Sep 14 10:09:53.879391 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 10:09:53.879391 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 10:09:53.879391 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/1e6b6775bdd84b24bf7a5ce051e30998"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_1e6b6775bdd84b24bf7a5ce051e30998"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1e6b6775bdd84b24bf7a5ce051e30998"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1e6b6775bdd84b24bf7a5ce051e30998"}]}] Sep 14 10:09:53.879391 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-TestNetworkAdvancedServerOps-722006907 Sep 14 10:09:53.879391 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 1e6b6775bdd84b24bf7a5ce051e30998 Sep 14 10:09:53.879391 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-722006907 Sep 14 10:09:53.879391 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-TestNetworkAdvancedServerOps-722006907-project Sep 14 10:09:53.879391 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 10:09:53.879391 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 10:09:53.879391 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: caa0c29696e24390a5492804e0948010 Sep 14 10:09:53.879391 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-TestNetworkAdvancedServerOps-722006907-project Sep 14 10:09:53.879391 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 10:09:53.879391 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance 99ed9f43-64f0-49bb-866c-26e3b86562cb could not be found. Sep 14 10:09:53.879391 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': '99ed9f43-64f0-49bb-866c-26e3b86562cb'} Sep 14 10:09:53.879391 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 10:09:53.879391 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:09:53.879391 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 10:09:53.879391 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 10:09:53.879391 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 10:09:53.879391 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 10:09:53.879391 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 10:09:53.879391 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 10:09:53.879391 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 10:09:53.879391 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 10:09:53.879391 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99ed9f43-64f0-49bb-866c-26e3b86562cb could not be found. Sep 14 10:09:53.879391 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 10:09:53.879391 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:09:53.879391 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 10:09:53.879391 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:09:53.879391 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:09:53.879391 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:09:53.879391 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 10:09:53.879391 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 10:09:53.879391 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 10:09:53.879391 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 10:09:53.879391 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 10:09:53.879391 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 10:09:53.879391 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 10:09:53.879391 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 10:09:53.879391 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 10:09:53.879391 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 10:09:53.879391 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99ed9f43-64f0-49bb-866c-26e3b86562cb could not be found. Sep 14 10:09:53.879391 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 10:09:53.879391 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:09:53.885011 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 10:09:53.885011 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:09:53.885011 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:09:53.885011 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:09:53.885011 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 10:09:53.885011 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 10:09:53.885011 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99ed9f43-64f0-49bb-866c-26e3b86562cb could not be found. Sep 14 10:09:53.885011 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 10:09:53.885011 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-35f21362-c5e2-4bae-8e19-42ed89da118e tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Returning 404 to user: Instance 99ed9f43-64f0-49bb-866c-26e3b86562cb could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 10:09:53.885011 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-35f21362-c5e2-4bae-8e19-42ed89da118e tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "GET /compute/v2.1/servers/99ed9f43-64f0-49bb-866c-26e3b86562cb" status: 404 len: 111 microversion: 2.1 time: 0.031483 Sep 14 10:09:53.885011 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4086/7593] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:09:53 2022] GET /compute/v2.1/servers/99ed9f43-64f0-49bb-866c-26e3b86562cb => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 10:09:57.198635 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-59a309bd-4b17-4efb-8193-2f81d94a4bd6 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] Calling method '.version_select at 0x7f7d3f332b80>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:09:57.221946 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-59a309bd-4b17-4efb-8193-2f81d94a4bd6 tempest-TestNetworkAdvancedServerOps-722006907 tempest-TestNetworkAdvancedServerOps-722006907-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-699298217" status: 202 len: 0 microversion: 2.1 time: 0.027205 Sep 14 10:09:57.222966 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3508/7594] 10.222.0.60 () {58 vars in 1281 bytes} [Wed Sep 14 10:09:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-699298217 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 10:10:08.244513 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=18 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:10:08.245351 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:10:08.476127 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-313447d4-7f98-41d6-9736-dc44951da672 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Action: 'create', calling method: .version_select at 0x7f7d445cf670>, body: {"keypair": {"name": "tempest-TestShelveInstance-1419449833", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNADY1jSnyPAIHd+grdH7TV44EAv5VGSJa1Pv+I5FWdkUy+Suu1xXOEnKnxdGdgJafouYKAP+7TMEnGa0XxdYDZx0hI01hRXoMFlCS12IMluNr4R01YlPAMo8edx/YLtPA=="}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:10:08.493760 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-313447d4-7f98-41d6-9736-dc44951da672 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Getting quotas for project afca8f753d4a47249a0636dcde826313. Resources: {'key_pairs'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 10:10:08.500098 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-313447d4-7f98-41d6-9736-dc44951da672 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Getting quotas for user bb4a5cf8e45d46ca96e7d9378d1d59c8 and project afca8f753d4a47249a0636dcde826313. Resources: {'key_pairs'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 10:10:08.529990 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-313447d4-7f98-41d6-9736-dc44951da672 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.291389 Sep 14 10:10:08.530608 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4087/7595] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Sep 14 10:10:08 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:10:09.517296 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:10:09.518486 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:10:09.523091 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c46bbd3c-3696-4ba9-98f1-03bbc9b66ff2 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1955991098", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1419449833", "security_groups": [{"name": "tempest-secgroup-smoke-1759826633"}], "networks": [{"uuid": "0b7b0e66-0341-4536-ba5a-fff7b089c9f8"}]}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:10:09.631575 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.network.neutron [None req-c46bbd3c-3696-4ba9-98f1-03bbc9b66ff2 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] validate_networks() for [('0b7b0e66-0341-4536-ba5a-fff7b089c9f8', None, None, None, None, None)] {{(pid=128758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 10:10:10.043458 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-c46bbd3c-3696-4ba9-98f1-03bbc9b66ff2 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Flavor limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 10:10:10.044083 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-c46bbd3c-3696-4ba9-98f1-03bbc9b66ff2 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Image limits 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 10:10:10.044796 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-c46bbd3c-3696-4ba9-98f1-03bbc9b66ff2 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Flavor pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 10:10:10.045230 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-c46bbd3c-3696-4ba9-98f1-03bbc9b66ff2 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Image pref 0:0:0 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 10:10:10.045668 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.virt.hardware [None req-c46bbd3c-3696-4ba9-98f1-03bbc9b66ff2 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 10:10:10.055419 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c46bbd3c-3696-4ba9-98f1-03bbc9b66ff2 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:10:10.055920 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c46bbd3c-3696-4ba9-98f1-03bbc9b66ff2 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:10:10.056367 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c46bbd3c-3696-4ba9-98f1-03bbc9b66ff2 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:10:10.057102 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c46bbd3c-3696-4ba9-98f1-03bbc9b66ff2 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:10:10.057565 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c46bbd3c-3696-4ba9-98f1-03bbc9b66ff2 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:10:10.058002 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c46bbd3c-3696-4ba9-98f1-03bbc9b66ff2 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:10:10.078289 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-c46bbd3c-3696-4ba9-98f1-03bbc9b66ff2 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Getting quotas for project afca8f753d4a47249a0636dcde826313. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 10:10:10.084789 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-c46bbd3c-3696-4ba9-98f1-03bbc9b66ff2 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Getting quotas for user bb4a5cf8e45d46ca96e7d9378d1d59c8 and project afca8f753d4a47249a0636dcde826313. Resources: {'cores', 'ram', 'instances'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 10:10:10.101266 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-c46bbd3c-3696-4ba9-98f1-03bbc9b66ff2 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Going to run 1 instances... {{(pid=128758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 10:10:10.103751 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-c46bbd3c-3696-4ba9-98f1-03bbc9b66ff2 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] [instance: ffc3f779-4b7b-4d6b-be27-f89cb18ab01b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 10:10:10.154740 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-c46bbd3c-3696-4ba9-98f1-03bbc9b66ff2 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.639704 Sep 14 10:10:10.155799 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3509/7596] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 10:10:09 2022] POST /compute/v2.1/servers => generated 406 bytes in 641 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 10:10:10.168353 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-6c8dba36-b8a9-4a7f-8d16-4ac443ac5995 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:10:10.168982 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-6c8dba36-b8a9-4a7f-8d16-4ac443ac5995 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] [instance: ffc3f779-4b7b-4d6b-be27-f89cb18ab01b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:10:10.233005 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-6c8dba36-b8a9-4a7f-8d16-4ac443ac5995 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a5cf8e45d46ca96e7d9378d1d59c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afca8f753d4a47249a0636dcde826313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:10:10.241763 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-6c8dba36-b8a9-4a7f-8d16-4ac443ac5995 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] 10.222.0.60 "GET /compute/v2.1/servers/ffc3f779-4b7b-4d6b-be27-f89cb18ab01b" status: 200 len: 1247 microversion: 2.1 time: 0.078044 Sep 14 10:10:10.246706 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4088/7597] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:10:10 2022] GET /compute/v2.1/servers/ffc3f779-4b7b-4d6b-be27-f89cb18ab01b => generated 1247 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:10:11.268144 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-66d11202-e2ed-464a-9947-5993a2356d4b tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:10:11.268712 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-66d11202-e2ed-464a-9947-5993a2356d4b tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] [instance: ffc3f779-4b7b-4d6b-be27-f89cb18ab01b] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:10:11.280754 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-66d11202-e2ed-464a-9947-5993a2356d4b tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:10:11.281169 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-66d11202-e2ed-464a-9947-5993a2356d4b tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:10:11.282444 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-66d11202-e2ed-464a-9947-5993a2356d4b tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:10:11.283764 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-66d11202-e2ed-464a-9947-5993a2356d4b tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:10:11.285402 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-66d11202-e2ed-464a-9947-5993a2356d4b tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:10:11.285844 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-66d11202-e2ed-464a-9947-5993a2356d4b tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:10:11.372011 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-66d11202-e2ed-464a-9947-5993a2356d4b tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a5cf8e45d46ca96e7d9378d1d59c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afca8f753d4a47249a0636dcde826313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:10:11.380532 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-66d11202-e2ed-464a-9947-5993a2356d4b tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] 10.222.0.60 "GET /compute/v2.1/servers/ffc3f779-4b7b-4d6b-be27-f89cb18ab01b" status: 200 len: 1317 microversion: 2.1 time: 0.119000 Sep 14 10:10:11.381211 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3510/7598] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:10:11 2022] GET /compute/v2.1/servers/ffc3f779-4b7b-4d6b-be27-f89cb18ab01b => generated 1317 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:10:12.406530 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b9743329-d7d9-40c6-9fb0-be5552f04e64 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:10:12.407911 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b9743329-d7d9-40c6-9fb0-be5552f04e64 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] [instance: ffc3f779-4b7b-4d6b-be27-f89cb18ab01b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:10:12.417601 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b9743329-d7d9-40c6-9fb0-be5552f04e64 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:10:12.418404 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b9743329-d7d9-40c6-9fb0-be5552f04e64 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:10:12.419568 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b9743329-d7d9-40c6-9fb0-be5552f04e64 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:10:12.420448 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b9743329-d7d9-40c6-9fb0-be5552f04e64 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:10:12.421070 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b9743329-d7d9-40c6-9fb0-be5552f04e64 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:10:12.422116 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b9743329-d7d9-40c6-9fb0-be5552f04e64 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:10:12.604580 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b9743329-d7d9-40c6-9fb0-be5552f04e64 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a5cf8e45d46ca96e7d9378d1d59c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afca8f753d4a47249a0636dcde826313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:10:12.614604 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b9743329-d7d9-40c6-9fb0-be5552f04e64 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] 10.222.0.60 "GET /compute/v2.1/servers/ffc3f779-4b7b-4d6b-be27-f89cb18ab01b" status: 200 len: 1373 microversion: 2.1 time: 0.213509 Sep 14 10:10:12.615968 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4089/7599] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:10:12 2022] GET /compute/v2.1/servers/ffc3f779-4b7b-4d6b-be27-f89cb18ab01b => generated 1373 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:10:12.882555 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-b83c1bec-6d30-4f34-9487-ffd93327e63f req-53c76581-3d5e-4f54-b5aa-4ab3b42c97b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffc3f779-4b7b-4d6b-be27-f89cb18ab01b", "tag": "95c67862-e5ef-436b-838e-2139a1eb284c"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:10:12.898133 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-b83c1bec-6d30-4f34-9487-ffd93327e63f req-53c76581-3d5e-4f54-b5aa-4ab3b42c97b7 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:10:12.898608 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-b83c1bec-6d30-4f34-9487-ffd93327e63f req-53c76581-3d5e-4f54-b5aa-4ab3b42c97b7 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:10:12.899783 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-b83c1bec-6d30-4f34-9487-ffd93327e63f req-53c76581-3d5e-4f54-b5aa-4ab3b42c97b7 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:10:12.914092 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-b83c1bec-6d30-4f34-9487-ffd93327e63f req-53c76581-3d5e-4f54-b5aa-4ab3b42c97b7 service nova] Creating event network-changed:95c67862-e5ef-436b-838e-2139a1eb284c for instance ffc3f779-4b7b-4d6b-be27-f89cb18ab01b on n-h2-836830-18 Sep 14 10:10:12.920200 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-b83c1bec-6d30-4f34-9487-ffd93327e63f req-53c76581-3d5e-4f54-b5aa-4ab3b42c97b7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042401 Sep 14 10:10:12.920829 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3511/7600] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 10:10:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 10:10:13.639854 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b4bbed3f-bf16-4113-81cb-cca8dca039c0 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:10:13.640471 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b4bbed3f-bf16-4113-81cb-cca8dca039c0 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] [instance: ffc3f779-4b7b-4d6b-be27-f89cb18ab01b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:10:13.648000 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b4bbed3f-bf16-4113-81cb-cca8dca039c0 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:10:13.648482 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b4bbed3f-bf16-4113-81cb-cca8dca039c0 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:10:13.648916 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b4bbed3f-bf16-4113-81cb-cca8dca039c0 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:10:13.649598 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b4bbed3f-bf16-4113-81cb-cca8dca039c0 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:10:13.650050 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b4bbed3f-bf16-4113-81cb-cca8dca039c0 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:10:13.650474 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b4bbed3f-bf16-4113-81cb-cca8dca039c0 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:10:13.780145 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b4bbed3f-bf16-4113-81cb-cca8dca039c0 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a5cf8e45d46ca96e7d9378d1d59c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afca8f753d4a47249a0636dcde826313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:10:13.788627 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b4bbed3f-bf16-4113-81cb-cca8dca039c0 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] 10.222.0.60 "GET /compute/v2.1/servers/ffc3f779-4b7b-4d6b-be27-f89cb18ab01b" status: 200 len: 1373 microversion: 2.1 time: 0.152726 Sep 14 10:10:13.789236 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4090/7601] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:10:13 2022] GET /compute/v2.1/servers/ffc3f779-4b7b-4d6b-be27-f89cb18ab01b => generated 1373 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:10:14.813396 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-44a244df-f401-4e83-8bd0-c37c9bf8ff0d tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:10:14.814047 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-44a244df-f401-4e83-8bd0-c37c9bf8ff0d tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] [instance: ffc3f779-4b7b-4d6b-be27-f89cb18ab01b] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:10:14.820406 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-44a244df-f401-4e83-8bd0-c37c9bf8ff0d tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:10:14.820911 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-44a244df-f401-4e83-8bd0-c37c9bf8ff0d tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:10:14.821371 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-44a244df-f401-4e83-8bd0-c37c9bf8ff0d tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:10:14.822085 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-44a244df-f401-4e83-8bd0-c37c9bf8ff0d tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:10:14.822561 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-44a244df-f401-4e83-8bd0-c37c9bf8ff0d tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:10:14.823031 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-44a244df-f401-4e83-8bd0-c37c9bf8ff0d tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:10:14.958550 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-44a244df-f401-4e83-8bd0-c37c9bf8ff0d tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a5cf8e45d46ca96e7d9378d1d59c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afca8f753d4a47249a0636dcde826313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:10:14.966578 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-44a244df-f401-4e83-8bd0-c37c9bf8ff0d tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] 10.222.0.60 "GET /compute/v2.1/servers/ffc3f779-4b7b-4d6b-be27-f89cb18ab01b" status: 200 len: 1373 microversion: 2.1 time: 0.158459 Sep 14 10:10:14.967198 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3512/7602] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:10:14 2022] GET /compute/v2.1/servers/ffc3f779-4b7b-4d6b-be27-f89cb18ab01b => generated 1373 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:10:15.990422 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-daa4d6ab-de5e-4215-8b08-4617e59ed5d8 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:10:15.991081 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-daa4d6ab-de5e-4215-8b08-4617e59ed5d8 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] [instance: ffc3f779-4b7b-4d6b-be27-f89cb18ab01b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:10:15.998227 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-daa4d6ab-de5e-4215-8b08-4617e59ed5d8 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:10:15.998718 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-daa4d6ab-de5e-4215-8b08-4617e59ed5d8 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:10:15.999201 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-daa4d6ab-de5e-4215-8b08-4617e59ed5d8 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:10:15.999901 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-daa4d6ab-de5e-4215-8b08-4617e59ed5d8 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:10:16.000364 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-daa4d6ab-de5e-4215-8b08-4617e59ed5d8 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:10:16.000796 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-daa4d6ab-de5e-4215-8b08-4617e59ed5d8 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:10:16.133322 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-daa4d6ab-de5e-4215-8b08-4617e59ed5d8 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a5cf8e45d46ca96e7d9378d1d59c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afca8f753d4a47249a0636dcde826313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:10:16.141110 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-daa4d6ab-de5e-4215-8b08-4617e59ed5d8 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] 10.222.0.60 "GET /compute/v2.1/servers/ffc3f779-4b7b-4d6b-be27-f89cb18ab01b" status: 200 len: 1373 microversion: 2.1 time: 0.155342 Sep 14 10:10:16.141706 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4091/7603] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:10:15 2022] GET /compute/v2.1/servers/ffc3f779-4b7b-4d6b-be27-f89cb18ab01b => generated 1373 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:10:17.166583 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-67c99a0d-eebc-4a60-9ff3-8602b1be4b98 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:10:17.167246 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-67c99a0d-eebc-4a60-9ff3-8602b1be4b98 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] [instance: ffc3f779-4b7b-4d6b-be27-f89cb18ab01b] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:10:17.173939 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-67c99a0d-eebc-4a60-9ff3-8602b1be4b98 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:10:17.174448 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-67c99a0d-eebc-4a60-9ff3-8602b1be4b98 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:10:17.174890 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-67c99a0d-eebc-4a60-9ff3-8602b1be4b98 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:10:17.175629 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-67c99a0d-eebc-4a60-9ff3-8602b1be4b98 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:10:17.176098 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-67c99a0d-eebc-4a60-9ff3-8602b1be4b98 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:10:17.176541 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-67c99a0d-eebc-4a60-9ff3-8602b1be4b98 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:10:17.325701 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-67c99a0d-eebc-4a60-9ff3-8602b1be4b98 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a5cf8e45d46ca96e7d9378d1d59c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afca8f753d4a47249a0636dcde826313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:10:17.330168 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-111eb567-18c1-4d5e-ad16-f0037cc2e550 req-9ef316c5-b03b-4c54-baab-16a014bb3ce8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffc3f779-4b7b-4d6b-be27-f89cb18ab01b", "name": "network-vif-plugged", "status": "completed", "tag": "95c67862-e5ef-436b-838e-2139a1eb284c"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:10:17.335092 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-67c99a0d-eebc-4a60-9ff3-8602b1be4b98 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] 10.222.0.60 "GET /compute/v2.1/servers/ffc3f779-4b7b-4d6b-be27-f89cb18ab01b" status: 200 len: 1373 microversion: 2.1 time: 0.174142 Sep 14 10:10:17.335835 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3513/7604] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:10:17 2022] GET /compute/v2.1/servers/ffc3f779-4b7b-4d6b-be27-f89cb18ab01b => generated 1373 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:10:17.339669 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-111eb567-18c1-4d5e-ad16-f0037cc2e550 req-9ef316c5-b03b-4c54-baab-16a014bb3ce8 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:10:17.340157 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-111eb567-18c1-4d5e-ad16-f0037cc2e550 req-9ef316c5-b03b-4c54-baab-16a014bb3ce8 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:10:17.340589 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-111eb567-18c1-4d5e-ad16-f0037cc2e550 req-9ef316c5-b03b-4c54-baab-16a014bb3ce8 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:10:17.351693 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-111eb567-18c1-4d5e-ad16-f0037cc2e550 req-9ef316c5-b03b-4c54-baab-16a014bb3ce8 service nova] Creating event network-vif-plugged:95c67862-e5ef-436b-838e-2139a1eb284c for instance ffc3f779-4b7b-4d6b-be27-f89cb18ab01b on n-h2-836830-18 Sep 14 10:10:17.356969 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-111eb567-18c1-4d5e-ad16-f0037cc2e550 req-9ef316c5-b03b-4c54-baab-16a014bb3ce8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104584 Sep 14 10:10:17.357547 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4092/7605] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 10:10:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:10:18.358484 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-30e89999-8404-4fe3-84e1-673f1e94520a tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:10:18.359161 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-30e89999-8404-4fe3-84e1-673f1e94520a tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] [instance: ffc3f779-4b7b-4d6b-be27-f89cb18ab01b] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:10:18.366186 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-30e89999-8404-4fe3-84e1-673f1e94520a tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:10:18.366694 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-30e89999-8404-4fe3-84e1-673f1e94520a tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:10:18.367180 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-30e89999-8404-4fe3-84e1-673f1e94520a tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:10:18.367899 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-30e89999-8404-4fe3-84e1-673f1e94520a tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:10:18.368374 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-30e89999-8404-4fe3-84e1-673f1e94520a tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:10:18.368819 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-30e89999-8404-4fe3-84e1-673f1e94520a tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:10:18.498363 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-30e89999-8404-4fe3-84e1-673f1e94520a tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a5cf8e45d46ca96e7d9378d1d59c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afca8f753d4a47249a0636dcde826313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:10:18.506609 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-30e89999-8404-4fe3-84e1-673f1e94520a tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] 10.222.0.60 "GET /compute/v2.1/servers/ffc3f779-4b7b-4d6b-be27-f89cb18ab01b" status: 200 len: 1373 microversion: 2.1 time: 0.151919 Sep 14 10:10:18.507222 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3514/7606] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:10:18 2022] GET /compute/v2.1/servers/ffc3f779-4b7b-4d6b-be27-f89cb18ab01b => generated 1373 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:10:19.531202 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e002f30e-19c5-40f8-afab-29d4dff7d785 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:10:19.531908 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e002f30e-19c5-40f8-afab-29d4dff7d785 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] [instance: ffc3f779-4b7b-4d6b-be27-f89cb18ab01b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:10:19.538166 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e002f30e-19c5-40f8-afab-29d4dff7d785 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:10:19.539332 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e002f30e-19c5-40f8-afab-29d4dff7d785 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:10:19.539808 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e002f30e-19c5-40f8-afab-29d4dff7d785 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:10:19.540525 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e002f30e-19c5-40f8-afab-29d4dff7d785 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:10:19.540995 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e002f30e-19c5-40f8-afab-29d4dff7d785 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:10:19.541430 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e002f30e-19c5-40f8-afab-29d4dff7d785 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:10:19.692083 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-e002f30e-19c5-40f8-afab-29d4dff7d785 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a5cf8e45d46ca96e7d9378d1d59c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afca8f753d4a47249a0636dcde826313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:10:19.700427 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e002f30e-19c5-40f8-afab-29d4dff7d785 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] 10.222.0.60 "GET /compute/v2.1/servers/ffc3f779-4b7b-4d6b-be27-f89cb18ab01b" status: 200 len: 1556 microversion: 2.1 time: 0.174471 Sep 14 10:10:19.701025 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4093/7607] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:10:19 2022] GET /compute/v2.1/servers/ffc3f779-4b7b-4d6b-be27-f89cb18ab01b => generated 1556 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:10:19.723650 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-eac6ac8b-8b31-4c5d-aa65-b0aeb67cd6ec tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:10:19.724296 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-eac6ac8b-8b31-4c5d-aa65-b0aeb67cd6ec tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] [instance: ffc3f779-4b7b-4d6b-be27-f89cb18ab01b] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:10:19.732061 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-eac6ac8b-8b31-4c5d-aa65-b0aeb67cd6ec tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:10:19.732566 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-eac6ac8b-8b31-4c5d-aa65-b0aeb67cd6ec tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:10:19.733024 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-eac6ac8b-8b31-4c5d-aa65-b0aeb67cd6ec tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:10:19.733739 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-eac6ac8b-8b31-4c5d-aa65-b0aeb67cd6ec tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:10:19.734215 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-eac6ac8b-8b31-4c5d-aa65-b0aeb67cd6ec tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:10:19.734889 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-eac6ac8b-8b31-4c5d-aa65-b0aeb67cd6ec tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:10:19.870968 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-eac6ac8b-8b31-4c5d-aa65-b0aeb67cd6ec tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a5cf8e45d46ca96e7d9378d1d59c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afca8f753d4a47249a0636dcde826313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:10:19.878867 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-eac6ac8b-8b31-4c5d-aa65-b0aeb67cd6ec tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] 10.222.0.60 "GET /compute/v2.1/servers/ffc3f779-4b7b-4d6b-be27-f89cb18ab01b" status: 200 len: 1556 microversion: 2.1 time: 0.159216 Sep 14 10:10:19.879470 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3515/7608] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:10:19 2022] GET /compute/v2.1/servers/ffc3f779-4b7b-4d6b-be27-f89cb18ab01b => generated 1556 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:10:21.511351 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=6 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:10:21.570378 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-fffc1808-d5a2-48b6-b6f2-ce352c95b864 req-3eb2dfcf-1149-4d08-bf5c-4dd538187b6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffc3f779-4b7b-4d6b-be27-f89cb18ab01b", "tag": "95c67862-e5ef-436b-838e-2139a1eb284c"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:10:21.580342 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-fffc1808-d5a2-48b6-b6f2-ce352c95b864 req-3eb2dfcf-1149-4d08-bf5c-4dd538187b6b service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:10:21.581121 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-fffc1808-d5a2-48b6-b6f2-ce352c95b864 req-3eb2dfcf-1149-4d08-bf5c-4dd538187b6b service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:10:21.581739 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-fffc1808-d5a2-48b6-b6f2-ce352c95b864 req-3eb2dfcf-1149-4d08-bf5c-4dd538187b6b service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:10:21.593738 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-fffc1808-d5a2-48b6-b6f2-ce352c95b864 req-3eb2dfcf-1149-4d08-bf5c-4dd538187b6b service nova] Creating event network-changed:95c67862-e5ef-436b-838e-2139a1eb284c for instance ffc3f779-4b7b-4d6b-be27-f89cb18ab01b on n-h2-836830-18 Sep 14 10:10:21.599490 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-fffc1808-d5a2-48b6-b6f2-ce352c95b864 req-3eb2dfcf-1149-4d08-bf5c-4dd538187b6b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092330 Sep 14 10:10:21.600644 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4094/7609] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 10:10:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:12:16.604230 n-d-836830-18 devstack@n-api.service[128758]: ERROR oslo.messaging._drivers.impl_rabbit [-] [57e2b41d-7c54-48cb-b191-b7f77db67cfb] AMQP server on 10.222.0.60:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 14 10:12:16.605441 n-d-836830-18 devstack@n-api.service[128758]: ERROR oslo.messaging._drivers.impl_rabbit [-] [33d7e4a6-539b-476c-bc18-5478ca3a22f4] AMQP server on 10.222.0.60:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 14 10:12:16.605815 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=2 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:12:16.607289 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=6 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:12:16.607658 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:12:16.608351 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=34 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:12:16.609761 n-d-836830-18 devstack@n-api.service[128758]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Sep 14 10:12:16.615662 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-6f22af0e-031a-42bb-8e97-7100fb4caab0 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:12:16.616231 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-6f22af0e-031a-42bb-8e97-7100fb4caab0 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] [instance: ffc3f779-4b7b-4d6b-be27-f89cb18ab01b] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:12:16.628007 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6f22af0e-031a-42bb-8e97-7100fb4caab0 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:12:16.628462 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6f22af0e-031a-42bb-8e97-7100fb4caab0 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:12:16.628927 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6f22af0e-031a-42bb-8e97-7100fb4caab0 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:12:16.629658 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6f22af0e-031a-42bb-8e97-7100fb4caab0 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:12:16.630136 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6f22af0e-031a-42bb-8e97-7100fb4caab0 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:12:16.630583 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6f22af0e-031a-42bb-8e97-7100fb4caab0 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:12:16.655122 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.objects.instance [None req-6f22af0e-031a-42bb-8e97-7100fb4caab0 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lazy-loading 'flavor' on Instance uuid ffc3f779-4b7b-4d6b-be27-f89cb18ab01b {{(pid=128758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 10:12:16.841550 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-6f22af0e-031a-42bb-8e97-7100fb4caab0 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] 10.222.0.60 "POST /compute/v2.1/servers/ffc3f779-4b7b-4d6b-be27-f89cb18ab01b/action" status: 202 len: 0 microversion: 2.1 time: 0.239091 Sep 14 10:12:16.842165 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3516/7610] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 10:12:16 2022] POST /compute/v2.1/servers/ffc3f779-4b7b-4d6b-be27-f89cb18ab01b/action => generated 0 bytes in 241 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 10:12:16.849227 n-d-836830-18 devstack@n-api.service[128759]: ERROR oslo.messaging._drivers.impl_rabbit [-] [22ef38d2-af78-43f4-be77-ac372bc70aea] AMQP server on 10.222.0.60:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 14 10:12:16.849889 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:12:16.850856 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=28 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:12:16.852423 n-d-836830-18 devstack@n-api.service[128759]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 14 10:12:16.852589 n-d-836830-18 devstack@n-api.service[128759]: Wed Sep 14 10:12:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ffc3f779-4b7b-4d6b-be27-f89cb18ab01b (ip 10.222.0.60) !!! Sep 14 10:12:16.857904 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8e35934d-6cea-432c-812d-e25b5feaf7ed tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:12:16.858778 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-8e35934d-6cea-432c-812d-e25b5feaf7ed tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] [instance: ffc3f779-4b7b-4d6b-be27-f89cb18ab01b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:12:16.868430 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8e35934d-6cea-432c-812d-e25b5feaf7ed tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:12:16.868918 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8e35934d-6cea-432c-812d-e25b5feaf7ed tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:12:16.869359 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8e35934d-6cea-432c-812d-e25b5feaf7ed tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:12:16.870053 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8e35934d-6cea-432c-812d-e25b5feaf7ed tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:12:16.871216 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8e35934d-6cea-432c-812d-e25b5feaf7ed tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:12:16.871641 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8e35934d-6cea-432c-812d-e25b5feaf7ed tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:12:17.091866 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-8e35934d-6cea-432c-812d-e25b5feaf7ed tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a5cf8e45d46ca96e7d9378d1d59c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afca8f753d4a47249a0636dcde826313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:12:17.099750 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-8e35934d-6cea-432c-812d-e25b5feaf7ed tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] 10.222.0.60 "GET /compute/v2.1/servers/ffc3f779-4b7b-4d6b-be27-f89cb18ab01b" status: 200 len: 1680 microversion: 2.1 time: 0.252950 Sep 14 10:12:17.100325 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4095/7611] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:12:16 2022] GET /compute/v2.1/servers/ffc3f779-4b7b-4d6b-be27-f89cb18ab01b => generated 1680 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 10:12:18.125684 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-0f0cc314-dac1-4780-8211-74be77692bf3 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:12:18.126417 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-0f0cc314-dac1-4780-8211-74be77692bf3 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] [instance: ffc3f779-4b7b-4d6b-be27-f89cb18ab01b] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:12:18.136170 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0f0cc314-dac1-4780-8211-74be77692bf3 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:12:18.136705 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0f0cc314-dac1-4780-8211-74be77692bf3 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:12:18.137159 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0f0cc314-dac1-4780-8211-74be77692bf3 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:12:18.137880 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0f0cc314-dac1-4780-8211-74be77692bf3 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:12:18.138354 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0f0cc314-dac1-4780-8211-74be77692bf3 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:12:18.138799 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0f0cc314-dac1-4780-8211-74be77692bf3 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:12:18.142953 n-d-836830-18 devstack@n-api.service[128758]: INFO oslo.messaging._drivers.impl_rabbit [-] [33d7e4a6-539b-476c-bc18-5478ca3a22f4] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 53136. Sep 14 10:12:18.143684 n-d-836830-18 devstack@n-api.service[128758]: INFO oslo.messaging._drivers.impl_rabbit [-] [57e2b41d-7c54-48cb-b191-b7f77db67cfb] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 53134. Sep 14 10:12:18.280638 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-0f0cc314-dac1-4780-8211-74be77692bf3 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a5cf8e45d46ca96e7d9378d1d59c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afca8f753d4a47249a0636dcde826313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:12:18.288458 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-0f0cc314-dac1-4780-8211-74be77692bf3 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] 10.222.0.60 "GET /compute/v2.1/servers/ffc3f779-4b7b-4d6b-be27-f89cb18ab01b" status: 200 len: 1680 microversion: 2.1 time: 0.169007 Sep 14 10:12:18.289030 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3517/7612] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:12:18 2022] GET /compute/v2.1/servers/ffc3f779-4b7b-4d6b-be27-f89cb18ab01b => generated 1680 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:12:19.312913 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e60ea439-5f95-47b2-a30a-0a389ce9a2d8 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:12:19.313527 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e60ea439-5f95-47b2-a30a-0a389ce9a2d8 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] [instance: ffc3f779-4b7b-4d6b-be27-f89cb18ab01b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:12:19.321988 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e60ea439-5f95-47b2-a30a-0a389ce9a2d8 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:12:19.322474 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e60ea439-5f95-47b2-a30a-0a389ce9a2d8 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:12:19.322908 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e60ea439-5f95-47b2-a30a-0a389ce9a2d8 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:12:19.323654 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e60ea439-5f95-47b2-a30a-0a389ce9a2d8 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:12:19.324107 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e60ea439-5f95-47b2-a30a-0a389ce9a2d8 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:12:19.324529 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e60ea439-5f95-47b2-a30a-0a389ce9a2d8 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:12:19.330628 n-d-836830-18 devstack@n-api.service[128759]: INFO oslo.messaging._drivers.impl_rabbit [-] [22ef38d2-af78-43f4-be77-ac372bc70aea] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 53142. Sep 14 10:12:19.456782 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-e60ea439-5f95-47b2-a30a-0a389ce9a2d8 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a5cf8e45d46ca96e7d9378d1d59c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afca8f753d4a47249a0636dcde826313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:12:19.464449 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e60ea439-5f95-47b2-a30a-0a389ce9a2d8 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] 10.222.0.60 "GET /compute/v2.1/servers/ffc3f779-4b7b-4d6b-be27-f89cb18ab01b" status: 200 len: 1680 microversion: 2.1 time: 0.156045 Sep 14 10:12:19.465014 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4096/7613] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:12:19 2022] GET /compute/v2.1/servers/ffc3f779-4b7b-4d6b-be27-f89cb18ab01b => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:12:20.488053 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ab0004d1-1d08-4609-b29b-b7a192f55a9f tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:12:20.488604 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-ab0004d1-1d08-4609-b29b-b7a192f55a9f tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] [instance: ffc3f779-4b7b-4d6b-be27-f89cb18ab01b] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:12:20.495453 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ab0004d1-1d08-4609-b29b-b7a192f55a9f tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:12:20.495950 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ab0004d1-1d08-4609-b29b-b7a192f55a9f tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:12:20.496395 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ab0004d1-1d08-4609-b29b-b7a192f55a9f tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:12:20.497090 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ab0004d1-1d08-4609-b29b-b7a192f55a9f tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:12:20.497559 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ab0004d1-1d08-4609-b29b-b7a192f55a9f tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:12:20.497993 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ab0004d1-1d08-4609-b29b-b7a192f55a9f tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:12:20.631050 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-ab0004d1-1d08-4609-b29b-b7a192f55a9f tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a5cf8e45d46ca96e7d9378d1d59c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afca8f753d4a47249a0636dcde826313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:12:20.638807 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-ab0004d1-1d08-4609-b29b-b7a192f55a9f tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] 10.222.0.60 "GET /compute/v2.1/servers/ffc3f779-4b7b-4d6b-be27-f89cb18ab01b" status: 200 len: 1680 microversion: 2.1 time: 0.154830 Sep 14 10:12:20.639914 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3518/7614] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:12:20 2022] GET /compute/v2.1/servers/ffc3f779-4b7b-4d6b-be27-f89cb18ab01b => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:12:21.663301 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d0113e0d-f271-4e76-a726-f37810d9d5d1 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:12:21.663923 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-d0113e0d-f271-4e76-a726-f37810d9d5d1 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] [instance: ffc3f779-4b7b-4d6b-be27-f89cb18ab01b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:12:21.671519 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d0113e0d-f271-4e76-a726-f37810d9d5d1 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:12:21.672005 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d0113e0d-f271-4e76-a726-f37810d9d5d1 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:12:21.672440 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d0113e0d-f271-4e76-a726-f37810d9d5d1 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:12:21.673129 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d0113e0d-f271-4e76-a726-f37810d9d5d1 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:12:21.673584 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d0113e0d-f271-4e76-a726-f37810d9d5d1 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:12:21.674005 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d0113e0d-f271-4e76-a726-f37810d9d5d1 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:12:21.809738 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-d0113e0d-f271-4e76-a726-f37810d9d5d1 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a5cf8e45d46ca96e7d9378d1d59c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afca8f753d4a47249a0636dcde826313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:12:21.817834 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d0113e0d-f271-4e76-a726-f37810d9d5d1 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] 10.222.0.60 "GET /compute/v2.1/servers/ffc3f779-4b7b-4d6b-be27-f89cb18ab01b" status: 200 len: 1680 microversion: 2.1 time: 0.158627 Sep 14 10:12:21.818420 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4097/7615] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:12:21 2022] GET /compute/v2.1/servers/ffc3f779-4b7b-4d6b-be27-f89cb18ab01b => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:12:22.847127 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b8e512cf-db6b-418b-aa73-d57eeeb02948 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:12:22.847770 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-b8e512cf-db6b-418b-aa73-d57eeeb02948 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] [instance: ffc3f779-4b7b-4d6b-be27-f89cb18ab01b] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:12:22.854599 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b8e512cf-db6b-418b-aa73-d57eeeb02948 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:12:22.855151 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b8e512cf-db6b-418b-aa73-d57eeeb02948 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:12:22.855610 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b8e512cf-db6b-418b-aa73-d57eeeb02948 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:12:22.856320 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b8e512cf-db6b-418b-aa73-d57eeeb02948 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:12:22.857054 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b8e512cf-db6b-418b-aa73-d57eeeb02948 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:12:22.857501 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b8e512cf-db6b-418b-aa73-d57eeeb02948 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:12:22.986527 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-b8e512cf-db6b-418b-aa73-d57eeeb02948 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a5cf8e45d46ca96e7d9378d1d59c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afca8f753d4a47249a0636dcde826313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:12:22.994420 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-b8e512cf-db6b-418b-aa73-d57eeeb02948 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] 10.222.0.60 "GET /compute/v2.1/servers/ffc3f779-4b7b-4d6b-be27-f89cb18ab01b" status: 200 len: 1680 microversion: 2.1 time: 0.151912 Sep 14 10:12:22.995002 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3519/7616] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:12:22 2022] GET /compute/v2.1/servers/ffc3f779-4b7b-4d6b-be27-f89cb18ab01b => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:12:24.018330 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-03658fed-18eb-45e0-8731-2a1acbaec837 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:12:24.019011 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-03658fed-18eb-45e0-8731-2a1acbaec837 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] [instance: ffc3f779-4b7b-4d6b-be27-f89cb18ab01b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:12:24.025853 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-03658fed-18eb-45e0-8731-2a1acbaec837 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:12:24.026347 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-03658fed-18eb-45e0-8731-2a1acbaec837 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:12:24.026790 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-03658fed-18eb-45e0-8731-2a1acbaec837 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:12:24.027511 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-03658fed-18eb-45e0-8731-2a1acbaec837 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:12:24.027974 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-03658fed-18eb-45e0-8731-2a1acbaec837 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:12:24.028408 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-03658fed-18eb-45e0-8731-2a1acbaec837 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:12:24.166572 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-03658fed-18eb-45e0-8731-2a1acbaec837 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a5cf8e45d46ca96e7d9378d1d59c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afca8f753d4a47249a0636dcde826313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:12:24.175429 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-03658fed-18eb-45e0-8731-2a1acbaec837 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] 10.222.0.60 "GET /compute/v2.1/servers/ffc3f779-4b7b-4d6b-be27-f89cb18ab01b" status: 200 len: 1680 microversion: 2.1 time: 0.161581 Sep 14 10:12:24.176031 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4098/7617] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:12:24 2022] GET /compute/v2.1/servers/ffc3f779-4b7b-4d6b-be27-f89cb18ab01b => generated 1680 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:12:25.199546 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-038ebca3-3721-456d-ba44-adb78dc50f6a tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:12:25.200840 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-038ebca3-3721-456d-ba44-adb78dc50f6a tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] [instance: ffc3f779-4b7b-4d6b-be27-f89cb18ab01b] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:12:25.208583 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-038ebca3-3721-456d-ba44-adb78dc50f6a tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:12:25.209092 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-038ebca3-3721-456d-ba44-adb78dc50f6a tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:12:25.209547 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-038ebca3-3721-456d-ba44-adb78dc50f6a tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:12:25.210278 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-038ebca3-3721-456d-ba44-adb78dc50f6a tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:12:25.210791 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-038ebca3-3721-456d-ba44-adb78dc50f6a tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:12:25.211275 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-038ebca3-3721-456d-ba44-adb78dc50f6a tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:12:25.343832 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-038ebca3-3721-456d-ba44-adb78dc50f6a tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a5cf8e45d46ca96e7d9378d1d59c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afca8f753d4a47249a0636dcde826313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:12:25.354200 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-038ebca3-3721-456d-ba44-adb78dc50f6a tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] 10.222.0.60 "GET /compute/v2.1/servers/ffc3f779-4b7b-4d6b-be27-f89cb18ab01b" status: 200 len: 1680 microversion: 2.1 time: 0.158727 Sep 14 10:12:25.354789 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3520/7618] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:12:25 2022] GET /compute/v2.1/servers/ffc3f779-4b7b-4d6b-be27-f89cb18ab01b => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:12:26.379683 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-373f4809-fafc-469b-b619-66ec836ca693 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:12:26.380311 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-373f4809-fafc-469b-b619-66ec836ca693 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] [instance: ffc3f779-4b7b-4d6b-be27-f89cb18ab01b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:12:26.387266 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-373f4809-fafc-469b-b619-66ec836ca693 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:12:26.387698 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-373f4809-fafc-469b-b619-66ec836ca693 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:12:26.388144 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-373f4809-fafc-469b-b619-66ec836ca693 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:12:26.388839 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-373f4809-fafc-469b-b619-66ec836ca693 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:12:26.389303 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-373f4809-fafc-469b-b619-66ec836ca693 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:12:26.389737 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-373f4809-fafc-469b-b619-66ec836ca693 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:12:26.523350 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-373f4809-fafc-469b-b619-66ec836ca693 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a5cf8e45d46ca96e7d9378d1d59c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afca8f753d4a47249a0636dcde826313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:12:26.531178 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-373f4809-fafc-469b-b619-66ec836ca693 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] 10.222.0.60 "GET /compute/v2.1/servers/ffc3f779-4b7b-4d6b-be27-f89cb18ab01b" status: 200 len: 1680 microversion: 2.1 time: 0.155574 Sep 14 10:12:26.532364 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4099/7619] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:12:26 2022] GET /compute/v2.1/servers/ffc3f779-4b7b-4d6b-be27-f89cb18ab01b => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:12:27.554907 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-086cc155-2c61-4bc6-910b-4dae42718557 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:12:27.555601 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-086cc155-2c61-4bc6-910b-4dae42718557 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] [instance: ffc3f779-4b7b-4d6b-be27-f89cb18ab01b] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:12:27.562832 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-086cc155-2c61-4bc6-910b-4dae42718557 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:12:27.563386 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-086cc155-2c61-4bc6-910b-4dae42718557 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:12:27.563820 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-086cc155-2c61-4bc6-910b-4dae42718557 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:12:27.565035 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-086cc155-2c61-4bc6-910b-4dae42718557 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:12:27.565504 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-086cc155-2c61-4bc6-910b-4dae42718557 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:12:27.565943 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-086cc155-2c61-4bc6-910b-4dae42718557 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:12:27.973042 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-086cc155-2c61-4bc6-910b-4dae42718557 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a5cf8e45d46ca96e7d9378d1d59c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afca8f753d4a47249a0636dcde826313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:12:27.981063 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-086cc155-2c61-4bc6-910b-4dae42718557 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] 10.222.0.60 "GET /compute/v2.1/servers/ffc3f779-4b7b-4d6b-be27-f89cb18ab01b" status: 200 len: 1701 microversion: 2.1 time: 0.430075 Sep 14 10:12:27.981900 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3521/7620] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:12:27 2022] GET /compute/v2.1/servers/ffc3f779-4b7b-4d6b-be27-f89cb18ab01b => generated 1701 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:12:29.005582 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-5bd7321c-69d4-497e-8cbc-a5e2bd65d1d0 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:12:29.006242 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-5bd7321c-69d4-497e-8cbc-a5e2bd65d1d0 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] [instance: ffc3f779-4b7b-4d6b-be27-f89cb18ab01b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:12:29.013264 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5bd7321c-69d4-497e-8cbc-a5e2bd65d1d0 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:12:29.013758 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5bd7321c-69d4-497e-8cbc-a5e2bd65d1d0 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:12:29.014206 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5bd7321c-69d4-497e-8cbc-a5e2bd65d1d0 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:12:29.014900 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5bd7321c-69d4-497e-8cbc-a5e2bd65d1d0 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:12:29.015388 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5bd7321c-69d4-497e-8cbc-a5e2bd65d1d0 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:12:29.015821 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5bd7321c-69d4-497e-8cbc-a5e2bd65d1d0 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:12:29.149104 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-5bd7321c-69d4-497e-8cbc-a5e2bd65d1d0 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a5cf8e45d46ca96e7d9378d1d59c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afca8f753d4a47249a0636dcde826313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:12:29.157026 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-5bd7321c-69d4-497e-8cbc-a5e2bd65d1d0 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] 10.222.0.60 "GET /compute/v2.1/servers/ffc3f779-4b7b-4d6b-be27-f89cb18ab01b" status: 200 len: 1701 microversion: 2.1 time: 0.155880 Sep 14 10:12:29.157919 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4100/7621] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:12:29 2022] GET /compute/v2.1/servers/ffc3f779-4b7b-4d6b-be27-f89cb18ab01b => generated 1701 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:12:30.180397 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-7b8799a2-55bf-45ad-b38c-8096180d2f43 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:12:30.181106 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-7b8799a2-55bf-45ad-b38c-8096180d2f43 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] [instance: ffc3f779-4b7b-4d6b-be27-f89cb18ab01b] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:12:30.191740 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7b8799a2-55bf-45ad-b38c-8096180d2f43 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:12:30.192248 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7b8799a2-55bf-45ad-b38c-8096180d2f43 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:12:30.192699 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7b8799a2-55bf-45ad-b38c-8096180d2f43 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:12:30.197081 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7b8799a2-55bf-45ad-b38c-8096180d2f43 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:12:30.198830 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7b8799a2-55bf-45ad-b38c-8096180d2f43 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:12:30.199555 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7b8799a2-55bf-45ad-b38c-8096180d2f43 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:12:30.395083 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-7b8799a2-55bf-45ad-b38c-8096180d2f43 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a5cf8e45d46ca96e7d9378d1d59c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afca8f753d4a47249a0636dcde826313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:12:30.405098 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-7b8799a2-55bf-45ad-b38c-8096180d2f43 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] 10.222.0.60 "GET /compute/v2.1/servers/ffc3f779-4b7b-4d6b-be27-f89cb18ab01b" status: 200 len: 1696 microversion: 2.1 time: 0.228455 Sep 14 10:12:30.421608 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3522/7622] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:12:30 2022] GET /compute/v2.1/servers/ffc3f779-4b7b-4d6b-be27-f89cb18ab01b => generated 1696 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:12:31.430268 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-96a8c48d-b60b-4100-a1d5-0e12eb29bcbb tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:12:31.430891 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-96a8c48d-b60b-4100-a1d5-0e12eb29bcbb tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] [instance: ffc3f779-4b7b-4d6b-be27-f89cb18ab01b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:12:31.438401 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-96a8c48d-b60b-4100-a1d5-0e12eb29bcbb tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:12:31.439387 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-96a8c48d-b60b-4100-a1d5-0e12eb29bcbb tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:12:31.440003 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-96a8c48d-b60b-4100-a1d5-0e12eb29bcbb tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:12:31.440888 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-96a8c48d-b60b-4100-a1d5-0e12eb29bcbb tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:12:31.441504 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-96a8c48d-b60b-4100-a1d5-0e12eb29bcbb tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:12:31.442086 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-96a8c48d-b60b-4100-a1d5-0e12eb29bcbb tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:12:31.616120 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-96a8c48d-b60b-4100-a1d5-0e12eb29bcbb tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a5cf8e45d46ca96e7d9378d1d59c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afca8f753d4a47249a0636dcde826313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:12:31.626754 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-96a8c48d-b60b-4100-a1d5-0e12eb29bcbb tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] 10.222.0.60 "GET /compute/v2.1/servers/ffc3f779-4b7b-4d6b-be27-f89cb18ab01b" status: 200 len: 1696 microversion: 2.1 time: 0.200590 Sep 14 10:12:31.627578 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4101/7623] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:12:31 2022] GET /compute/v2.1/servers/ffc3f779-4b7b-4d6b-be27-f89cb18ab01b => generated 1696 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:12:31.999986 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-30fe461c-af55-4e8b-832e-0def331e0366 req-d8274799-3a0e-48d1-a4dc-d226619819a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffc3f779-4b7b-4d6b-be27-f89cb18ab01b", "name": "network-vif-plugged", "status": "completed", "tag": "95c67862-e5ef-436b-838e-2139a1eb284c"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:12:32.011298 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-30fe461c-af55-4e8b-832e-0def331e0366 req-d8274799-3a0e-48d1-a4dc-d226619819a9 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:12:32.012055 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-30fe461c-af55-4e8b-832e-0def331e0366 req-d8274799-3a0e-48d1-a4dc-d226619819a9 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:12:32.012657 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-30fe461c-af55-4e8b-832e-0def331e0366 req-d8274799-3a0e-48d1-a4dc-d226619819a9 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:12:32.026803 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-30fe461c-af55-4e8b-832e-0def331e0366 req-d8274799-3a0e-48d1-a4dc-d226619819a9 service nova] Creating event network-vif-plugged:95c67862-e5ef-436b-838e-2139a1eb284c for instance ffc3f779-4b7b-4d6b-be27-f89cb18ab01b on n-h2-836830-18 Sep 14 10:12:32.033719 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-30fe461c-af55-4e8b-832e-0def331e0366 req-d8274799-3a0e-48d1-a4dc-d226619819a9 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043139 Sep 14 10:12:32.034549 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3523/7624] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 10:12:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:12:32.651676 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d51d8f57-2950-47e1-a993-a19bf5734bb9 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:12:32.653222 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-d51d8f57-2950-47e1-a993-a19bf5734bb9 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] [instance: ffc3f779-4b7b-4d6b-be27-f89cb18ab01b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:12:32.661204 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d51d8f57-2950-47e1-a993-a19bf5734bb9 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:12:32.661872 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d51d8f57-2950-47e1-a993-a19bf5734bb9 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:12:32.662713 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d51d8f57-2950-47e1-a993-a19bf5734bb9 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:12:32.663666 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d51d8f57-2950-47e1-a993-a19bf5734bb9 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:12:32.664319 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d51d8f57-2950-47e1-a993-a19bf5734bb9 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:12:32.664904 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d51d8f57-2950-47e1-a993-a19bf5734bb9 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:12:32.815725 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-d51d8f57-2950-47e1-a993-a19bf5734bb9 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a5cf8e45d46ca96e7d9378d1d59c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afca8f753d4a47249a0636dcde826313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:12:32.824564 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d51d8f57-2950-47e1-a993-a19bf5734bb9 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] 10.222.0.60 "GET /compute/v2.1/servers/ffc3f779-4b7b-4d6b-be27-f89cb18ab01b" status: 200 len: 1696 microversion: 2.1 time: 0.177053 Sep 14 10:12:32.825876 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4102/7625] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:12:32 2022] GET /compute/v2.1/servers/ffc3f779-4b7b-4d6b-be27-f89cb18ab01b => generated 1696 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:12:33.851210 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-4f3f6ac3-6a44-4df8-b548-1a0d80bda35f tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:12:33.852065 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-4f3f6ac3-6a44-4df8-b548-1a0d80bda35f tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] [instance: ffc3f779-4b7b-4d6b-be27-f89cb18ab01b] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:12:33.860391 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4f3f6ac3-6a44-4df8-b548-1a0d80bda35f tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:12:33.861564 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4f3f6ac3-6a44-4df8-b548-1a0d80bda35f tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:12:33.862278 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4f3f6ac3-6a44-4df8-b548-1a0d80bda35f tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:12:33.863151 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4f3f6ac3-6a44-4df8-b548-1a0d80bda35f tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:12:33.863702 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4f3f6ac3-6a44-4df8-b548-1a0d80bda35f tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:12:33.864217 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4f3f6ac3-6a44-4df8-b548-1a0d80bda35f tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:12:34.011254 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-4f3f6ac3-6a44-4df8-b548-1a0d80bda35f tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a5cf8e45d46ca96e7d9378d1d59c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afca8f753d4a47249a0636dcde826313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:12:34.020759 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-4f3f6ac3-6a44-4df8-b548-1a0d80bda35f tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] 10.222.0.60 "GET /compute/v2.1/servers/ffc3f779-4b7b-4d6b-be27-f89cb18ab01b" status: 200 len: 1696 microversion: 2.1 time: 0.174161 Sep 14 10:12:34.021666 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3524/7626] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:12:33 2022] GET /compute/v2.1/servers/ffc3f779-4b7b-4d6b-be27-f89cb18ab01b => generated 1696 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:12:35.045457 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a2a95d6e-abdc-4dcd-a157-1b49191b6d0d tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:12:35.046088 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-a2a95d6e-abdc-4dcd-a157-1b49191b6d0d tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] [instance: ffc3f779-4b7b-4d6b-be27-f89cb18ab01b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:12:35.053999 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a2a95d6e-abdc-4dcd-a157-1b49191b6d0d tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:12:35.054512 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a2a95d6e-abdc-4dcd-a157-1b49191b6d0d tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:12:35.054977 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a2a95d6e-abdc-4dcd-a157-1b49191b6d0d tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:12:35.055706 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a2a95d6e-abdc-4dcd-a157-1b49191b6d0d tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:12:35.056179 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a2a95d6e-abdc-4dcd-a157-1b49191b6d0d tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:12:35.056617 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a2a95d6e-abdc-4dcd-a157-1b49191b6d0d tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:12:35.206806 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-a2a95d6e-abdc-4dcd-a157-1b49191b6d0d tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a5cf8e45d46ca96e7d9378d1d59c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afca8f753d4a47249a0636dcde826313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:12:35.222020 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a2a95d6e-abdc-4dcd-a157-1b49191b6d0d tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] 10.222.0.60 "GET /compute/v2.1/servers/ffc3f779-4b7b-4d6b-be27-f89cb18ab01b" status: 200 len: 1696 microversion: 2.1 time: 0.180610 Sep 14 10:12:35.222800 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4103/7627] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:12:35 2022] GET /compute/v2.1/servers/ffc3f779-4b7b-4d6b-be27-f89cb18ab01b => generated 1696 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:12:36.249165 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-c7b6f48e-78eb-40fd-933a-73caa6160c35 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:12:36.249906 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-c7b6f48e-78eb-40fd-933a-73caa6160c35 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] [instance: ffc3f779-4b7b-4d6b-be27-f89cb18ab01b] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:12:36.257489 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c7b6f48e-78eb-40fd-933a-73caa6160c35 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:12:36.258067 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c7b6f48e-78eb-40fd-933a-73caa6160c35 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:12:36.258585 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c7b6f48e-78eb-40fd-933a-73caa6160c35 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:12:36.259367 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c7b6f48e-78eb-40fd-933a-73caa6160c35 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:12:36.259905 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c7b6f48e-78eb-40fd-933a-73caa6160c35 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:12:36.260352 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-c7b6f48e-78eb-40fd-933a-73caa6160c35 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:12:36.405709 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-c7b6f48e-78eb-40fd-933a-73caa6160c35 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a5cf8e45d46ca96e7d9378d1d59c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afca8f753d4a47249a0636dcde826313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:12:36.414442 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-c7b6f48e-78eb-40fd-933a-73caa6160c35 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] 10.222.0.60 "GET /compute/v2.1/servers/ffc3f779-4b7b-4d6b-be27-f89cb18ab01b" status: 200 len: 1696 microversion: 2.1 time: 0.172493 Sep 14 10:12:36.415202 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3525/7628] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:12:36 2022] GET /compute/v2.1/servers/ffc3f779-4b7b-4d6b-be27-f89cb18ab01b => generated 1696 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:12:37.437569 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-22967372-568b-47b8-a3c1-2f82c45f6c08 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:12:37.438310 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-22967372-568b-47b8-a3c1-2f82c45f6c08 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] [instance: ffc3f779-4b7b-4d6b-be27-f89cb18ab01b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:12:37.445471 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-22967372-568b-47b8-a3c1-2f82c45f6c08 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:12:37.445965 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-22967372-568b-47b8-a3c1-2f82c45f6c08 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:12:37.446411 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-22967372-568b-47b8-a3c1-2f82c45f6c08 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:12:37.447173 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-22967372-568b-47b8-a3c1-2f82c45f6c08 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:12:37.447856 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-22967372-568b-47b8-a3c1-2f82c45f6c08 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:12:37.448318 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-22967372-568b-47b8-a3c1-2f82c45f6c08 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:12:37.600611 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-22967372-568b-47b8-a3c1-2f82c45f6c08 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a5cf8e45d46ca96e7d9378d1d59c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afca8f753d4a47249a0636dcde826313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:12:37.609236 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-22967372-568b-47b8-a3c1-2f82c45f6c08 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] 10.222.0.60 "GET /compute/v2.1/servers/ffc3f779-4b7b-4d6b-be27-f89cb18ab01b" status: 200 len: 1696 microversion: 2.1 time: 0.175710 Sep 14 10:12:37.610312 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4104/7629] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:12:37 2022] GET /compute/v2.1/servers/ffc3f779-4b7b-4d6b-be27-f89cb18ab01b => generated 1696 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:12:38.634087 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-7bd58b8f-9593-4f36-8c7c-5c1c7ca22475 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:12:38.634707 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-7bd58b8f-9593-4f36-8c7c-5c1c7ca22475 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] [instance: ffc3f779-4b7b-4d6b-be27-f89cb18ab01b] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:12:38.641636 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7bd58b8f-9593-4f36-8c7c-5c1c7ca22475 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:12:38.642180 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7bd58b8f-9593-4f36-8c7c-5c1c7ca22475 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:12:38.642640 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7bd58b8f-9593-4f36-8c7c-5c1c7ca22475 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:12:38.643512 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7bd58b8f-9593-4f36-8c7c-5c1c7ca22475 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:12:38.644064 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7bd58b8f-9593-4f36-8c7c-5c1c7ca22475 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:12:38.644622 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7bd58b8f-9593-4f36-8c7c-5c1c7ca22475 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:12:38.784931 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-7bd58b8f-9593-4f36-8c7c-5c1c7ca22475 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a5cf8e45d46ca96e7d9378d1d59c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afca8f753d4a47249a0636dcde826313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:12:38.793071 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-7bd58b8f-9593-4f36-8c7c-5c1c7ca22475 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] 10.222.0.60 "GET /compute/v2.1/servers/ffc3f779-4b7b-4d6b-be27-f89cb18ab01b" status: 200 len: 1696 microversion: 2.1 time: 0.163174 Sep 14 10:12:38.793648 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3526/7630] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:12:38 2022] GET /compute/v2.1/servers/ffc3f779-4b7b-4d6b-be27-f89cb18ab01b => generated 1696 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:12:39.817721 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-2c17ac18-c6d8-45ac-be20-b59032a1eac8 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:12:39.818351 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-2c17ac18-c6d8-45ac-be20-b59032a1eac8 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] [instance: ffc3f779-4b7b-4d6b-be27-f89cb18ab01b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:12:39.825440 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2c17ac18-c6d8-45ac-be20-b59032a1eac8 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:12:39.825934 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2c17ac18-c6d8-45ac-be20-b59032a1eac8 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:12:39.826386 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2c17ac18-c6d8-45ac-be20-b59032a1eac8 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:12:39.827108 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2c17ac18-c6d8-45ac-be20-b59032a1eac8 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:12:39.827572 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2c17ac18-c6d8-45ac-be20-b59032a1eac8 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:12:39.828060 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2c17ac18-c6d8-45ac-be20-b59032a1eac8 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:12:39.959242 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-2c17ac18-c6d8-45ac-be20-b59032a1eac8 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a5cf8e45d46ca96e7d9378d1d59c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afca8f753d4a47249a0636dcde826313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:12:39.967012 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-2c17ac18-c6d8-45ac-be20-b59032a1eac8 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] 10.222.0.60 "GET /compute/v2.1/servers/ffc3f779-4b7b-4d6b-be27-f89cb18ab01b" status: 200 len: 1678 microversion: 2.1 time: 0.153743 Sep 14 10:12:39.967583 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4105/7631] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:12:39 2022] GET /compute/v2.1/servers/ffc3f779-4b7b-4d6b-be27-f89cb18ab01b => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:12:40.991430 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ea8804fd-d234-4dc4-8946-5f73c164a694 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:12:40.992150 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-ea8804fd-d234-4dc4-8946-5f73c164a694 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] [instance: ffc3f779-4b7b-4d6b-be27-f89cb18ab01b] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:12:41.000365 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ea8804fd-d234-4dc4-8946-5f73c164a694 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:12:41.000878 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ea8804fd-d234-4dc4-8946-5f73c164a694 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:12:41.001335 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ea8804fd-d234-4dc4-8946-5f73c164a694 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:12:41.002563 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ea8804fd-d234-4dc4-8946-5f73c164a694 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:12:41.003070 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ea8804fd-d234-4dc4-8946-5f73c164a694 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:12:41.003517 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ea8804fd-d234-4dc4-8946-5f73c164a694 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:12:41.141200 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-ea8804fd-d234-4dc4-8946-5f73c164a694 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a5cf8e45d46ca96e7d9378d1d59c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afca8f753d4a47249a0636dcde826313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:12:41.149672 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-ea8804fd-d234-4dc4-8946-5f73c164a694 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] 10.222.0.60 "GET /compute/v2.1/servers/ffc3f779-4b7b-4d6b-be27-f89cb18ab01b" status: 200 len: 1678 microversion: 2.1 time: 0.162191 Sep 14 10:12:41.150264 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3527/7632] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:12:40 2022] GET /compute/v2.1/servers/ffc3f779-4b7b-4d6b-be27-f89cb18ab01b => generated 1678 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:12:42.172974 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d1838dbe-83c3-426e-8554-c96ac3284357 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:12:42.174109 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-d1838dbe-83c3-426e-8554-c96ac3284357 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] [instance: ffc3f779-4b7b-4d6b-be27-f89cb18ab01b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:12:42.181142 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d1838dbe-83c3-426e-8554-c96ac3284357 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:12:42.181634 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d1838dbe-83c3-426e-8554-c96ac3284357 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:12:42.182079 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d1838dbe-83c3-426e-8554-c96ac3284357 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:12:42.182775 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d1838dbe-83c3-426e-8554-c96ac3284357 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:12:42.183272 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d1838dbe-83c3-426e-8554-c96ac3284357 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:12:42.183708 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d1838dbe-83c3-426e-8554-c96ac3284357 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:12:42.317331 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-d1838dbe-83c3-426e-8554-c96ac3284357 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a5cf8e45d46ca96e7d9378d1d59c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afca8f753d4a47249a0636dcde826313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:12:42.325375 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d1838dbe-83c3-426e-8554-c96ac3284357 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] 10.222.0.60 "GET /compute/v2.1/servers/ffc3f779-4b7b-4d6b-be27-f89cb18ab01b" status: 200 len: 1621 microversion: 2.1 time: 0.156372 Sep 14 10:12:42.325953 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4106/7633] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:12:42 2022] GET /compute/v2.1/servers/ffc3f779-4b7b-4d6b-be27-f89cb18ab01b => generated 1621 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:12:42.348161 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-0aecb945-4dc0-4847-9d8d-1256d588a2cf tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:12:42.348774 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-0aecb945-4dc0-4847-9d8d-1256d588a2cf tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] [instance: ffc3f779-4b7b-4d6b-be27-f89cb18ab01b] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:12:42.355748 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0aecb945-4dc0-4847-9d8d-1256d588a2cf tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:12:42.356242 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0aecb945-4dc0-4847-9d8d-1256d588a2cf tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:12:42.356685 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0aecb945-4dc0-4847-9d8d-1256d588a2cf tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:12:42.357646 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0aecb945-4dc0-4847-9d8d-1256d588a2cf tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:12:42.358117 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0aecb945-4dc0-4847-9d8d-1256d588a2cf tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:12:42.358551 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0aecb945-4dc0-4847-9d8d-1256d588a2cf tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:12:42.399978 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-0aecb945-4dc0-4847-9d8d-1256d588a2cf tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] [instance: ffc3f779-4b7b-4d6b-be27-f89cb18ab01b] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128758) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 14 10:12:42.466007 n-d-836830-18 devstack@n-api.service[128758]: ERROR oslo.messaging._drivers.impl_rabbit [None req-0aecb945-4dc0-4847-9d8d-1256d588a2cf tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] [70ca246a-8c7e-4cbe-9ecb-1ffd476aea93] AMQP server on 10.222.0.60:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 14 10:12:43.472713 n-d-836830-18 devstack@n-api.service[128758]: INFO oslo.messaging._drivers.impl_rabbit [None req-0aecb945-4dc0-4847-9d8d-1256d588a2cf tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] [70ca246a-8c7e-4cbe-9ecb-1ffd476aea93] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 53238. Sep 14 10:12:43.475966 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-0aecb945-4dc0-4847-9d8d-1256d588a2cf tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] 10.222.0.60 "POST /compute/v2.1/servers/ffc3f779-4b7b-4d6b-be27-f89cb18ab01b/action" status: 202 len: 0 microversion: 2.1 time: 1.131849 Sep 14 10:12:43.476600 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3528/7634] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 10:12:42 2022] POST /compute/v2.1/servers/ffc3f779-4b7b-4d6b-be27-f89cb18ab01b/action => generated 0 bytes in 1133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 14 10:12:43.485007 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-68cae703-ab6a-4093-87b2-4f0735f9672a tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:12:43.485634 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-68cae703-ab6a-4093-87b2-4f0735f9672a tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] [instance: ffc3f779-4b7b-4d6b-be27-f89cb18ab01b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:12:43.492624 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-68cae703-ab6a-4093-87b2-4f0735f9672a tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:12:43.493120 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-68cae703-ab6a-4093-87b2-4f0735f9672a tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:12:43.493562 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-68cae703-ab6a-4093-87b2-4f0735f9672a tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:12:43.494298 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-68cae703-ab6a-4093-87b2-4f0735f9672a tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:12:43.494759 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-68cae703-ab6a-4093-87b2-4f0735f9672a tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:12:43.495221 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-68cae703-ab6a-4093-87b2-4f0735f9672a tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:12:43.632381 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-68cae703-ab6a-4093-87b2-4f0735f9672a tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a5cf8e45d46ca96e7d9378d1d59c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afca8f753d4a47249a0636dcde826313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:12:43.640435 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-68cae703-ab6a-4093-87b2-4f0735f9672a tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] 10.222.0.60 "GET /compute/v2.1/servers/ffc3f779-4b7b-4d6b-be27-f89cb18ab01b" status: 200 len: 1629 microversion: 2.1 time: 0.159666 Sep 14 10:12:43.641017 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4107/7635] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:12:43 2022] GET /compute/v2.1/servers/ffc3f779-4b7b-4d6b-be27-f89cb18ab01b => generated 1629 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 10:12:43.974259 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-d129b640-d5a4-4faa-916e-6d901c1571e2 req-4ca97bcc-4f4d-40b1-a3f6-0e559acb94bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffc3f779-4b7b-4d6b-be27-f89cb18ab01b", "name": "network-vif-unplugged", "status": "completed", "tag": "95c67862-e5ef-436b-838e-2139a1eb284c"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:12:43.987514 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-d129b640-d5a4-4faa-916e-6d901c1571e2 req-4ca97bcc-4f4d-40b1-a3f6-0e559acb94bb service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:12:43.988040 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-d129b640-d5a4-4faa-916e-6d901c1571e2 req-4ca97bcc-4f4d-40b1-a3f6-0e559acb94bb service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:12:43.988487 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-d129b640-d5a4-4faa-916e-6d901c1571e2 req-4ca97bcc-4f4d-40b1-a3f6-0e559acb94bb service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:12:43.999615 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.compute.server_external_events [req-d129b640-d5a4-4faa-916e-6d901c1571e2 req-4ca97bcc-4f4d-40b1-a3f6-0e559acb94bb service nova] Unable to find a host for instance ffc3f779-4b7b-4d6b-be27-f89cb18ab01b. Dropping event network-vif-unplugged {{(pid=128758) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 14 10:12:44.000688 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-d129b640-d5a4-4faa-916e-6d901c1571e2 req-4ca97bcc-4f4d-40b1-a3f6-0e559acb94bb service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.032496 Sep 14 10:12:44.001302 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3529/7636] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 10:12:43 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 34 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 14 10:12:44.664194 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-2643e248-5aa6-44f6-9b92-34c7787001c3 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:12:44.664811 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-2643e248-5aa6-44f6-9b92-34c7787001c3 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] [instance: ffc3f779-4b7b-4d6b-be27-f89cb18ab01b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:12:44.671596 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2643e248-5aa6-44f6-9b92-34c7787001c3 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:12:44.672079 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2643e248-5aa6-44f6-9b92-34c7787001c3 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:12:44.672516 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2643e248-5aa6-44f6-9b92-34c7787001c3 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:12:44.673201 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2643e248-5aa6-44f6-9b92-34c7787001c3 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:12:44.673654 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2643e248-5aa6-44f6-9b92-34c7787001c3 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:12:44.674079 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2643e248-5aa6-44f6-9b92-34c7787001c3 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:12:44.806261 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-2643e248-5aa6-44f6-9b92-34c7787001c3 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a5cf8e45d46ca96e7d9378d1d59c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afca8f753d4a47249a0636dcde826313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:12:44.814063 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-2643e248-5aa6-44f6-9b92-34c7787001c3 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] 10.222.0.60 "GET /compute/v2.1/servers/ffc3f779-4b7b-4d6b-be27-f89cb18ab01b" status: 200 len: 1687 microversion: 2.1 time: 0.153744 Sep 14 10:12:44.815181 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4108/7637] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:12:44 2022] GET /compute/v2.1/servers/ffc3f779-4b7b-4d6b-be27-f89cb18ab01b => generated 1687 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:12:45.768863 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-c066a963-ba47-4f41-a6fa-ba3041cf9e73 req-8f20ed84-613d-47e1-add0-df4519a391c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffc3f779-4b7b-4d6b-be27-f89cb18ab01b", "tag": "95c67862-e5ef-436b-838e-2139a1eb284c"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:12:45.779279 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-c066a963-ba47-4f41-a6fa-ba3041cf9e73 req-8f20ed84-613d-47e1-add0-df4519a391c6 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:12:45.779776 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-c066a963-ba47-4f41-a6fa-ba3041cf9e73 req-8f20ed84-613d-47e1-add0-df4519a391c6 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:12:45.780868 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-c066a963-ba47-4f41-a6fa-ba3041cf9e73 req-8f20ed84-613d-47e1-add0-df4519a391c6 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:12:45.792680 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-c066a963-ba47-4f41-a6fa-ba3041cf9e73 req-8f20ed84-613d-47e1-add0-df4519a391c6 service nova] Creating event network-changed:95c67862-e5ef-436b-838e-2139a1eb284c for instance ffc3f779-4b7b-4d6b-be27-f89cb18ab01b on n-h1-836830-18 Sep 14 10:12:45.797667 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-c066a963-ba47-4f41-a6fa-ba3041cf9e73 req-8f20ed84-613d-47e1-add0-df4519a391c6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032624 Sep 14 10:12:45.798348 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3530/7638] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 10:12:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:12:45.839374 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-bb360be5-fda7-438c-9d59-352628692cb7 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:12:45.839925 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-bb360be5-fda7-438c-9d59-352628692cb7 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] [instance: ffc3f779-4b7b-4d6b-be27-f89cb18ab01b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:12:45.847088 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bb360be5-fda7-438c-9d59-352628692cb7 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:12:45.847893 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bb360be5-fda7-438c-9d59-352628692cb7 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:12:45.848420 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bb360be5-fda7-438c-9d59-352628692cb7 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:12:45.849063 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bb360be5-fda7-438c-9d59-352628692cb7 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:12:45.849534 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bb360be5-fda7-438c-9d59-352628692cb7 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:12:45.850033 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bb360be5-fda7-438c-9d59-352628692cb7 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:12:45.993435 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-bb360be5-fda7-438c-9d59-352628692cb7 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a5cf8e45d46ca96e7d9378d1d59c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afca8f753d4a47249a0636dcde826313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:12:46.001306 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-bb360be5-fda7-438c-9d59-352628692cb7 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] 10.222.0.60 "GET /compute/v2.1/servers/ffc3f779-4b7b-4d6b-be27-f89cb18ab01b" status: 200 len: 1687 microversion: 2.1 time: 0.166252 Sep 14 10:12:46.002548 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4109/7639] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:12:45 2022] GET /compute/v2.1/servers/ffc3f779-4b7b-4d6b-be27-f89cb18ab01b => generated 1687 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:12:47.028507 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-469ba8f8-e216-41b6-99d8-e53fbb840979 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:12:47.029171 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-469ba8f8-e216-41b6-99d8-e53fbb840979 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] [instance: ffc3f779-4b7b-4d6b-be27-f89cb18ab01b] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:12:47.031836 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:12:47.039470 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-469ba8f8-e216-41b6-99d8-e53fbb840979 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:12:47.040440 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-469ba8f8-e216-41b6-99d8-e53fbb840979 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:12:47.041130 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-469ba8f8-e216-41b6-99d8-e53fbb840979 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:12:47.041934 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-469ba8f8-e216-41b6-99d8-e53fbb840979 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:12:47.042481 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-469ba8f8-e216-41b6-99d8-e53fbb840979 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:12:47.043016 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-469ba8f8-e216-41b6-99d8-e53fbb840979 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:12:47.046675 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:12:47.206559 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-469ba8f8-e216-41b6-99d8-e53fbb840979 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a5cf8e45d46ca96e7d9378d1d59c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afca8f753d4a47249a0636dcde826313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:12:47.214403 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-469ba8f8-e216-41b6-99d8-e53fbb840979 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] 10.222.0.60 "GET /compute/v2.1/servers/ffc3f779-4b7b-4d6b-be27-f89cb18ab01b" status: 200 len: 1687 microversion: 2.1 time: 0.192533 Sep 14 10:12:47.214997 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3531/7640] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:12:47 2022] GET /compute/v2.1/servers/ffc3f779-4b7b-4d6b-be27-f89cb18ab01b => generated 1687 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:12:48.238458 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c402894f-fa9b-4e77-9263-10d22298e63a tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:12:48.239146 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-c402894f-fa9b-4e77-9263-10d22298e63a tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] [instance: ffc3f779-4b7b-4d6b-be27-f89cb18ab01b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:12:48.241949 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=31 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:12:48.247509 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c402894f-fa9b-4e77-9263-10d22298e63a tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:12:48.248008 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c402894f-fa9b-4e77-9263-10d22298e63a tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:12:48.248461 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c402894f-fa9b-4e77-9263-10d22298e63a tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:12:48.249203 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c402894f-fa9b-4e77-9263-10d22298e63a tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:12:48.249666 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c402894f-fa9b-4e77-9263-10d22298e63a tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:12:48.250102 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c402894f-fa9b-4e77-9263-10d22298e63a tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:12:48.253639 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=91 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:12:48.400654 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-c402894f-fa9b-4e77-9263-10d22298e63a tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a5cf8e45d46ca96e7d9378d1d59c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afca8f753d4a47249a0636dcde826313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:12:48.408573 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-c402894f-fa9b-4e77-9263-10d22298e63a tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] 10.222.0.60 "GET /compute/v2.1/servers/ffc3f779-4b7b-4d6b-be27-f89cb18ab01b" status: 200 len: 1687 microversion: 2.1 time: 0.174521 Sep 14 10:12:48.409163 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4110/7641] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:12:48 2022] GET /compute/v2.1/servers/ffc3f779-4b7b-4d6b-be27-f89cb18ab01b => generated 1687 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:12:49.433032 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-085ee26f-b906-43fa-9a66-f225d62a5c91 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:12:49.433680 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-085ee26f-b906-43fa-9a66-f225d62a5c91 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] [instance: ffc3f779-4b7b-4d6b-be27-f89cb18ab01b] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:12:49.441244 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-085ee26f-b906-43fa-9a66-f225d62a5c91 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:12:49.442128 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-085ee26f-b906-43fa-9a66-f225d62a5c91 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:12:49.442587 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-085ee26f-b906-43fa-9a66-f225d62a5c91 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:12:49.443405 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-085ee26f-b906-43fa-9a66-f225d62a5c91 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:12:49.444529 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-085ee26f-b906-43fa-9a66-f225d62a5c91 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:12:49.444529 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-085ee26f-b906-43fa-9a66-f225d62a5c91 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:12:49.592401 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-085ee26f-b906-43fa-9a66-f225d62a5c91 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a5cf8e45d46ca96e7d9378d1d59c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afca8f753d4a47249a0636dcde826313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:12:49.608675 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-085ee26f-b906-43fa-9a66-f225d62a5c91 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] 10.222.0.60 "GET /compute/v2.1/servers/ffc3f779-4b7b-4d6b-be27-f89cb18ab01b" status: 200 len: 1687 microversion: 2.1 time: 0.179883 Sep 14 10:12:49.623446 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3532/7642] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:12:49 2022] GET /compute/v2.1/servers/ffc3f779-4b7b-4d6b-be27-f89cb18ab01b => generated 1687 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:12:50.632768 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-149b65d2-bdb3-4910-94d3-66f2f29a4ed1 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:12:50.633423 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-149b65d2-bdb3-4910-94d3-66f2f29a4ed1 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] [instance: ffc3f779-4b7b-4d6b-be27-f89cb18ab01b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:12:50.640709 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-149b65d2-bdb3-4910-94d3-66f2f29a4ed1 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:12:50.641209 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-149b65d2-bdb3-4910-94d3-66f2f29a4ed1 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:12:50.641656 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-149b65d2-bdb3-4910-94d3-66f2f29a4ed1 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:12:50.642370 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-149b65d2-bdb3-4910-94d3-66f2f29a4ed1 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:12:50.642835 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-149b65d2-bdb3-4910-94d3-66f2f29a4ed1 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:12:50.643294 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-149b65d2-bdb3-4910-94d3-66f2f29a4ed1 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:12:50.800694 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-149b65d2-bdb3-4910-94d3-66f2f29a4ed1 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a5cf8e45d46ca96e7d9378d1d59c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afca8f753d4a47249a0636dcde826313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:12:50.808736 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-149b65d2-bdb3-4910-94d3-66f2f29a4ed1 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] 10.222.0.60 "GET /compute/v2.1/servers/ffc3f779-4b7b-4d6b-be27-f89cb18ab01b" status: 200 len: 1687 microversion: 2.1 time: 0.179943 Sep 14 10:12:50.809326 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4111/7643] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:12:50 2022] GET /compute/v2.1/servers/ffc3f779-4b7b-4d6b-be27-f89cb18ab01b => generated 1687 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:12:51.843679 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-e6296f73-f6b9-45fd-a521-faad42000a49 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:12:51.846152 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-e6296f73-f6b9-45fd-a521-faad42000a49 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] [instance: ffc3f779-4b7b-4d6b-be27-f89cb18ab01b] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:12:51.869748 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e6296f73-f6b9-45fd-a521-faad42000a49 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:12:51.870480 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e6296f73-f6b9-45fd-a521-faad42000a49 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:12:51.870975 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e6296f73-f6b9-45fd-a521-faad42000a49 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:12:51.872033 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e6296f73-f6b9-45fd-a521-faad42000a49 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:12:51.872602 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e6296f73-f6b9-45fd-a521-faad42000a49 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:12:51.873176 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e6296f73-f6b9-45fd-a521-faad42000a49 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:12:52.037446 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-e6296f73-f6b9-45fd-a521-faad42000a49 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a5cf8e45d46ca96e7d9378d1d59c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afca8f753d4a47249a0636dcde826313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:12:52.046144 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-e6296f73-f6b9-45fd-a521-faad42000a49 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] 10.222.0.60 "GET /compute/v2.1/servers/ffc3f779-4b7b-4d6b-be27-f89cb18ab01b" status: 200 len: 1687 microversion: 2.1 time: 0.215036 Sep 14 10:12:52.047137 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3533/7644] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:12:51 2022] GET /compute/v2.1/servers/ffc3f779-4b7b-4d6b-be27-f89cb18ab01b => generated 1687 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:12:53.070855 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-94445d5e-efea-4e73-873b-b70f514232c4 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:12:53.072158 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-94445d5e-efea-4e73-873b-b70f514232c4 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] [instance: ffc3f779-4b7b-4d6b-be27-f89cb18ab01b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:12:53.082103 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-94445d5e-efea-4e73-873b-b70f514232c4 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:12:53.082779 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-94445d5e-efea-4e73-873b-b70f514232c4 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:12:53.083351 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-94445d5e-efea-4e73-873b-b70f514232c4 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:12:53.084258 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-94445d5e-efea-4e73-873b-b70f514232c4 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:12:53.085103 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-94445d5e-efea-4e73-873b-b70f514232c4 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:12:53.085580 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-94445d5e-efea-4e73-873b-b70f514232c4 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:12:53.227252 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-94445d5e-efea-4e73-873b-b70f514232c4 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a5cf8e45d46ca96e7d9378d1d59c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afca8f753d4a47249a0636dcde826313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:12:53.235190 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-94445d5e-efea-4e73-873b-b70f514232c4 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] 10.222.0.60 "GET /compute/v2.1/servers/ffc3f779-4b7b-4d6b-be27-f89cb18ab01b" status: 200 len: 1687 microversion: 2.1 time: 0.168726 Sep 14 10:12:53.236136 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4112/7645] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:12:53 2022] GET /compute/v2.1/servers/ffc3f779-4b7b-4d6b-be27-f89cb18ab01b => generated 1687 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:12:54.259411 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-47b4e84f-94be-437d-be2d-8b5313406468 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:12:54.260079 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-47b4e84f-94be-437d-be2d-8b5313406468 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] [instance: ffc3f779-4b7b-4d6b-be27-f89cb18ab01b] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:12:54.267946 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-47b4e84f-94be-437d-be2d-8b5313406468 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:12:54.268450 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-47b4e84f-94be-437d-be2d-8b5313406468 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:12:54.268907 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-47b4e84f-94be-437d-be2d-8b5313406468 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:12:54.269615 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-47b4e84f-94be-437d-be2d-8b5313406468 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:12:54.270087 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-47b4e84f-94be-437d-be2d-8b5313406468 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:12:54.270535 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-47b4e84f-94be-437d-be2d-8b5313406468 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:12:54.412360 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-47b4e84f-94be-437d-be2d-8b5313406468 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a5cf8e45d46ca96e7d9378d1d59c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afca8f753d4a47249a0636dcde826313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:12:54.420612 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-47b4e84f-94be-437d-be2d-8b5313406468 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] 10.222.0.60 "GET /compute/v2.1/servers/ffc3f779-4b7b-4d6b-be27-f89cb18ab01b" status: 200 len: 1687 microversion: 2.1 time: 0.165276 Sep 14 10:12:54.421203 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3534/7646] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:12:54 2022] GET /compute/v2.1/servers/ffc3f779-4b7b-4d6b-be27-f89cb18ab01b => generated 1687 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:12:55.445342 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-2f53d1f2-0430-443e-849f-15351fcc40d5 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:12:55.445915 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-2f53d1f2-0430-443e-849f-15351fcc40d5 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] [instance: ffc3f779-4b7b-4d6b-be27-f89cb18ab01b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:12:55.453081 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2f53d1f2-0430-443e-849f-15351fcc40d5 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:12:55.453571 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2f53d1f2-0430-443e-849f-15351fcc40d5 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:12:55.454021 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2f53d1f2-0430-443e-849f-15351fcc40d5 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:12:55.454716 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2f53d1f2-0430-443e-849f-15351fcc40d5 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:12:55.455214 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2f53d1f2-0430-443e-849f-15351fcc40d5 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:12:55.455646 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-2f53d1f2-0430-443e-849f-15351fcc40d5 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:12:55.592922 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-2f53d1f2-0430-443e-849f-15351fcc40d5 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a5cf8e45d46ca96e7d9378d1d59c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afca8f753d4a47249a0636dcde826313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:12:55.601254 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-2f53d1f2-0430-443e-849f-15351fcc40d5 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] 10.222.0.60 "GET /compute/v2.1/servers/ffc3f779-4b7b-4d6b-be27-f89cb18ab01b" status: 200 len: 1687 microversion: 2.1 time: 0.160053 Sep 14 10:12:55.601827 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4113/7647] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:12:55 2022] GET /compute/v2.1/servers/ffc3f779-4b7b-4d6b-be27-f89cb18ab01b => generated 1687 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:12:56.624086 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-6d75c5ec-0867-4307-90ba-e651916da911 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:12:56.624730 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-6d75c5ec-0867-4307-90ba-e651916da911 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] [instance: ffc3f779-4b7b-4d6b-be27-f89cb18ab01b] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:12:56.632078 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6d75c5ec-0867-4307-90ba-e651916da911 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:12:56.632596 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6d75c5ec-0867-4307-90ba-e651916da911 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:12:56.633101 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6d75c5ec-0867-4307-90ba-e651916da911 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:12:56.633825 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6d75c5ec-0867-4307-90ba-e651916da911 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:12:56.634337 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6d75c5ec-0867-4307-90ba-e651916da911 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:12:56.634789 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6d75c5ec-0867-4307-90ba-e651916da911 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:12:56.768690 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-6d75c5ec-0867-4307-90ba-e651916da911 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a5cf8e45d46ca96e7d9378d1d59c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afca8f753d4a47249a0636dcde826313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:12:56.776754 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-6d75c5ec-0867-4307-90ba-e651916da911 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] 10.222.0.60 "GET /compute/v2.1/servers/ffc3f779-4b7b-4d6b-be27-f89cb18ab01b" status: 200 len: 1687 microversion: 2.1 time: 0.156583 Sep 14 10:12:56.777342 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3535/7648] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:12:56 2022] GET /compute/v2.1/servers/ffc3f779-4b7b-4d6b-be27-f89cb18ab01b => generated 1687 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:12:57.800597 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-cbfe87db-64ca-4873-849f-2b92232638ef tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:12:57.801142 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-cbfe87db-64ca-4873-849f-2b92232638ef tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] [instance: ffc3f779-4b7b-4d6b-be27-f89cb18ab01b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:12:57.807994 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cbfe87db-64ca-4873-849f-2b92232638ef tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:12:57.808480 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cbfe87db-64ca-4873-849f-2b92232638ef tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:12:57.808921 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cbfe87db-64ca-4873-849f-2b92232638ef tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:12:57.809610 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cbfe87db-64ca-4873-849f-2b92232638ef tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:12:57.810068 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cbfe87db-64ca-4873-849f-2b92232638ef tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:12:57.810495 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cbfe87db-64ca-4873-849f-2b92232638ef tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:12:57.944405 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-cbfe87db-64ca-4873-849f-2b92232638ef tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a5cf8e45d46ca96e7d9378d1d59c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afca8f753d4a47249a0636dcde826313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:12:57.952778 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-cbfe87db-64ca-4873-849f-2b92232638ef tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] 10.222.0.60 "GET /compute/v2.1/servers/ffc3f779-4b7b-4d6b-be27-f89cb18ab01b" status: 200 len: 1687 microversion: 2.1 time: 0.156769 Sep 14 10:12:57.953356 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4114/7649] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:12:57 2022] GET /compute/v2.1/servers/ffc3f779-4b7b-4d6b-be27-f89cb18ab01b => generated 1687 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:12:58.976625 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-f080ff2a-9252-4918-b360-a0bc919d8d67 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:12:58.977184 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-f080ff2a-9252-4918-b360-a0bc919d8d67 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] [instance: ffc3f779-4b7b-4d6b-be27-f89cb18ab01b] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:12:58.984532 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f080ff2a-9252-4918-b360-a0bc919d8d67 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:12:58.985033 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f080ff2a-9252-4918-b360-a0bc919d8d67 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:12:58.985487 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f080ff2a-9252-4918-b360-a0bc919d8d67 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:12:58.986195 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f080ff2a-9252-4918-b360-a0bc919d8d67 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:12:58.987247 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f080ff2a-9252-4918-b360-a0bc919d8d67 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:12:58.987698 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f080ff2a-9252-4918-b360-a0bc919d8d67 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:12:59.117995 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-f080ff2a-9252-4918-b360-a0bc919d8d67 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a5cf8e45d46ca96e7d9378d1d59c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afca8f753d4a47249a0636dcde826313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:12:59.125984 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-f080ff2a-9252-4918-b360-a0bc919d8d67 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] 10.222.0.60 "GET /compute/v2.1/servers/ffc3f779-4b7b-4d6b-be27-f89cb18ab01b" status: 200 len: 1687 microversion: 2.1 time: 0.153428 Sep 14 10:12:59.126563 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3536/7650] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:12:58 2022] GET /compute/v2.1/servers/ffc3f779-4b7b-4d6b-be27-f89cb18ab01b => generated 1687 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:13:00.149801 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e75ba612-1e33-4d76-b3ea-7a3172a35d40 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:13:00.150427 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e75ba612-1e33-4d76-b3ea-7a3172a35d40 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] [instance: ffc3f779-4b7b-4d6b-be27-f89cb18ab01b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:13:00.157744 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e75ba612-1e33-4d76-b3ea-7a3172a35d40 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:13:00.158961 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e75ba612-1e33-4d76-b3ea-7a3172a35d40 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:13:00.159394 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e75ba612-1e33-4d76-b3ea-7a3172a35d40 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:13:00.160096 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e75ba612-1e33-4d76-b3ea-7a3172a35d40 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:13:00.160556 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e75ba612-1e33-4d76-b3ea-7a3172a35d40 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:13:00.160995 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e75ba612-1e33-4d76-b3ea-7a3172a35d40 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:13:00.303469 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-e75ba612-1e33-4d76-b3ea-7a3172a35d40 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a5cf8e45d46ca96e7d9378d1d59c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afca8f753d4a47249a0636dcde826313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:13:00.311566 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e75ba612-1e33-4d76-b3ea-7a3172a35d40 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] 10.222.0.60 "GET /compute/v2.1/servers/ffc3f779-4b7b-4d6b-be27-f89cb18ab01b" status: 200 len: 1687 microversion: 2.1 time: 0.165730 Sep 14 10:13:00.312151 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4115/7651] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:13:00 2022] GET /compute/v2.1/servers/ffc3f779-4b7b-4d6b-be27-f89cb18ab01b => generated 1687 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:13:01.335014 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d37b43bb-a3a1-4f76-b7c6-676495392e52 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:13:01.335661 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-d37b43bb-a3a1-4f76-b7c6-676495392e52 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] [instance: ffc3f779-4b7b-4d6b-be27-f89cb18ab01b] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:13:01.342647 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d37b43bb-a3a1-4f76-b7c6-676495392e52 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:13:01.343192 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d37b43bb-a3a1-4f76-b7c6-676495392e52 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:13:01.343661 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d37b43bb-a3a1-4f76-b7c6-676495392e52 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:13:01.344376 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d37b43bb-a3a1-4f76-b7c6-676495392e52 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:13:01.344860 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d37b43bb-a3a1-4f76-b7c6-676495392e52 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:13:01.345307 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d37b43bb-a3a1-4f76-b7c6-676495392e52 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:13:01.480736 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-d37b43bb-a3a1-4f76-b7c6-676495392e52 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a5cf8e45d46ca96e7d9378d1d59c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afca8f753d4a47249a0636dcde826313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:13:01.489591 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-d37b43bb-a3a1-4f76-b7c6-676495392e52 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] 10.222.0.60 "GET /compute/v2.1/servers/ffc3f779-4b7b-4d6b-be27-f89cb18ab01b" status: 200 len: 1687 microversion: 2.1 time: 0.158561 Sep 14 10:13:01.490195 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3537/7652] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:13:01 2022] GET /compute/v2.1/servers/ffc3f779-4b7b-4d6b-be27-f89cb18ab01b => generated 1687 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:13:02.512902 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-257869d8-fab5-43e1-8fc6-e20ae4e9a0a3 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:13:02.513462 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-257869d8-fab5-43e1-8fc6-e20ae4e9a0a3 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] [instance: ffc3f779-4b7b-4d6b-be27-f89cb18ab01b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:13:02.520280 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-257869d8-fab5-43e1-8fc6-e20ae4e9a0a3 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:13:02.520761 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-257869d8-fab5-43e1-8fc6-e20ae4e9a0a3 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:13:02.521198 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-257869d8-fab5-43e1-8fc6-e20ae4e9a0a3 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:13:02.521892 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-257869d8-fab5-43e1-8fc6-e20ae4e9a0a3 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:13:02.522344 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-257869d8-fab5-43e1-8fc6-e20ae4e9a0a3 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:13:02.522765 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-257869d8-fab5-43e1-8fc6-e20ae4e9a0a3 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:13:02.657543 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-257869d8-fab5-43e1-8fc6-e20ae4e9a0a3 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a5cf8e45d46ca96e7d9378d1d59c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afca8f753d4a47249a0636dcde826313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:13:02.665879 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-257869d8-fab5-43e1-8fc6-e20ae4e9a0a3 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] 10.222.0.60 "GET /compute/v2.1/servers/ffc3f779-4b7b-4d6b-be27-f89cb18ab01b" status: 200 len: 1687 microversion: 2.1 time: 0.157058 Sep 14 10:13:02.666473 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4116/7653] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:13:02 2022] GET /compute/v2.1/servers/ffc3f779-4b7b-4d6b-be27-f89cb18ab01b => generated 1687 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:13:03.688215 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-e0338a0b-15dc-4fa7-abfa-5d1e9460495e tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:13:03.688864 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-e0338a0b-15dc-4fa7-abfa-5d1e9460495e tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] [instance: ffc3f779-4b7b-4d6b-be27-f89cb18ab01b] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:13:03.697360 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e0338a0b-15dc-4fa7-abfa-5d1e9460495e tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:13:03.697867 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e0338a0b-15dc-4fa7-abfa-5d1e9460495e tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:13:03.698327 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e0338a0b-15dc-4fa7-abfa-5d1e9460495e tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:13:03.699146 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e0338a0b-15dc-4fa7-abfa-5d1e9460495e tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:13:03.699630 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e0338a0b-15dc-4fa7-abfa-5d1e9460495e tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:13:03.700081 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e0338a0b-15dc-4fa7-abfa-5d1e9460495e tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:13:03.843488 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-e0338a0b-15dc-4fa7-abfa-5d1e9460495e tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a5cf8e45d46ca96e7d9378d1d59c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afca8f753d4a47249a0636dcde826313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:13:03.851700 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-e0338a0b-15dc-4fa7-abfa-5d1e9460495e tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] 10.222.0.60 "GET /compute/v2.1/servers/ffc3f779-4b7b-4d6b-be27-f89cb18ab01b" status: 200 len: 1687 microversion: 2.1 time: 0.167662 Sep 14 10:13:03.852314 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3538/7654] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:13:03 2022] GET /compute/v2.1/servers/ffc3f779-4b7b-4d6b-be27-f89cb18ab01b => generated 1687 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:13:03.860710 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-7947b225-da98-4dce-9086-1f19f9083da6 req-eb6c9a67-350e-47e4-a065-d283821dcc5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffc3f779-4b7b-4d6b-be27-f89cb18ab01b", "name": "network-vif-plugged", "status": "completed", "tag": "95c67862-e5ef-436b-838e-2139a1eb284c"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:13:03.872334 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-7947b225-da98-4dce-9086-1f19f9083da6 req-eb6c9a67-350e-47e4-a065-d283821dcc5b service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:13:03.872904 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-7947b225-da98-4dce-9086-1f19f9083da6 req-eb6c9a67-350e-47e4-a065-d283821dcc5b service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:13:03.873336 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-7947b225-da98-4dce-9086-1f19f9083da6 req-eb6c9a67-350e-47e4-a065-d283821dcc5b service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:13:03.885983 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-7947b225-da98-4dce-9086-1f19f9083da6 req-eb6c9a67-350e-47e4-a065-d283821dcc5b service nova] Creating event network-vif-plugged:95c67862-e5ef-436b-838e-2139a1eb284c for instance ffc3f779-4b7b-4d6b-be27-f89cb18ab01b on n-h1-836830-18 Sep 14 10:13:03.889506 n-d-836830-18 devstack@n-api.service[128759]: ERROR oslo.messaging._drivers.impl_rabbit [req-7947b225-da98-4dce-9086-1f19f9083da6 req-eb6c9a67-350e-47e4-a065-d283821dcc5b service nova] [f9f751b3-1896-4e16-80f7-753b062738e6] AMQP server on 10.222.0.60:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 14 10:13:04.875817 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b3d46327-c185-4488-af1f-436534371736 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:13:04.876467 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-b3d46327-c185-4488-af1f-436534371736 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] [instance: ffc3f779-4b7b-4d6b-be27-f89cb18ab01b] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:13:04.883504 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b3d46327-c185-4488-af1f-436534371736 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:13:04.884013 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b3d46327-c185-4488-af1f-436534371736 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:13:04.884491 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b3d46327-c185-4488-af1f-436534371736 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:13:04.885182 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b3d46327-c185-4488-af1f-436534371736 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:13:04.885658 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b3d46327-c185-4488-af1f-436534371736 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:13:04.886106 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b3d46327-c185-4488-af1f-436534371736 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:13:04.896792 n-d-836830-18 devstack@n-api.service[128759]: INFO oslo.messaging._drivers.impl_rabbit [req-7947b225-da98-4dce-9086-1f19f9083da6 req-eb6c9a67-350e-47e4-a065-d283821dcc5b service nova] [f9f751b3-1896-4e16-80f7-753b062738e6] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 53334. Sep 14 10:13:04.900877 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-7947b225-da98-4dce-9086-1f19f9083da6 req-eb6c9a67-350e-47e4-a065-d283821dcc5b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.044914 Sep 14 10:13:04.901498 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4117/7655] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 10:13:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 10:13:05.019440 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-b3d46327-c185-4488-af1f-436534371736 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a5cf8e45d46ca96e7d9378d1d59c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afca8f753d4a47249a0636dcde826313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:13:05.027378 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-b3d46327-c185-4488-af1f-436534371736 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] 10.222.0.60 "GET /compute/v2.1/servers/ffc3f779-4b7b-4d6b-be27-f89cb18ab01b" status: 200 len: 1687 microversion: 2.1 time: 0.155545 Sep 14 10:13:05.028267 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3539/7656] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:13:04 2022] GET /compute/v2.1/servers/ffc3f779-4b7b-4d6b-be27-f89cb18ab01b => generated 1687 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 10:13:06.052560 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-0c6670ce-4b97-4c35-b206-2cdd5c69d554 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:13:06.053277 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-0c6670ce-4b97-4c35-b206-2cdd5c69d554 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] [instance: ffc3f779-4b7b-4d6b-be27-f89cb18ab01b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:13:06.059560 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0c6670ce-4b97-4c35-b206-2cdd5c69d554 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:13:06.060053 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0c6670ce-4b97-4c35-b206-2cdd5c69d554 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:13:06.060495 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0c6670ce-4b97-4c35-b206-2cdd5c69d554 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:13:06.061183 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0c6670ce-4b97-4c35-b206-2cdd5c69d554 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:13:06.061641 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0c6670ce-4b97-4c35-b206-2cdd5c69d554 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:13:06.062067 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0c6670ce-4b97-4c35-b206-2cdd5c69d554 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:13:06.200869 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-0c6670ce-4b97-4c35-b206-2cdd5c69d554 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a5cf8e45d46ca96e7d9378d1d59c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afca8f753d4a47249a0636dcde826313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:13:06.209120 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-0c6670ce-4b97-4c35-b206-2cdd5c69d554 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] 10.222.0.60 "GET /compute/v2.1/servers/ffc3f779-4b7b-4d6b-be27-f89cb18ab01b" status: 200 len: 1687 microversion: 2.1 time: 0.162378 Sep 14 10:13:06.209697 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4118/7657] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:13:06 2022] GET /compute/v2.1/servers/ffc3f779-4b7b-4d6b-be27-f89cb18ab01b => generated 1687 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:13:07.233591 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1d11b6b7-b0f3-4701-a931-9b86ecc06f0f tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:13:07.234246 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-1d11b6b7-b0f3-4701-a931-9b86ecc06f0f tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] [instance: ffc3f779-4b7b-4d6b-be27-f89cb18ab01b] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:13:07.241681 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1d11b6b7-b0f3-4701-a931-9b86ecc06f0f tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:13:07.242178 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1d11b6b7-b0f3-4701-a931-9b86ecc06f0f tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:13:07.242621 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1d11b6b7-b0f3-4701-a931-9b86ecc06f0f tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:13:07.243349 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1d11b6b7-b0f3-4701-a931-9b86ecc06f0f tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:13:07.243815 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1d11b6b7-b0f3-4701-a931-9b86ecc06f0f tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:13:07.244255 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1d11b6b7-b0f3-4701-a931-9b86ecc06f0f tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:13:07.378625 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-1d11b6b7-b0f3-4701-a931-9b86ecc06f0f tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a5cf8e45d46ca96e7d9378d1d59c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afca8f753d4a47249a0636dcde826313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:13:07.386401 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-1d11b6b7-b0f3-4701-a931-9b86ecc06f0f tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] 10.222.0.60 "GET /compute/v2.1/servers/ffc3f779-4b7b-4d6b-be27-f89cb18ab01b" status: 200 len: 1674 microversion: 2.1 time: 0.157034 Sep 14 10:13:07.386998 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3540/7658] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:13:07 2022] GET /compute/v2.1/servers/ffc3f779-4b7b-4d6b-be27-f89cb18ab01b => generated 1674 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:14:43.883458 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=19 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:14:43.884262 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=59 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:14:43.887056 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e072a30f-f22e-4813-b804-70fe541734a9 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:14:43.887574 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e072a30f-f22e-4813-b804-70fe541734a9 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] [instance: ffc3f779-4b7b-4d6b-be27-f89cb18ab01b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:14:43.889991 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=17 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:14:43.890662 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=49 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:14:43.896694 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-c98cf8f9-0ab8-4d5b-b1d2-7e8bb62a5c62 req-27fe35fc-0888-4e29-94ea-f1a5d1b65322 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffc3f779-4b7b-4d6b-be27-f89cb18ab01b", "tag": "95c67862-e5ef-436b-838e-2139a1eb284c"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:14:43.901086 n-d-836830-18 devstack@n-api.service[128759]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 10:14:43.901436 n-d-836830-18 devstack@n-api.service[128759]: Wed Sep 14 10:14:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ffc3f779-4b7b-4d6b-be27-f89cb18ab01b (ip 10.222.0.60) !!! Sep 14 10:14:43.909129 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-c98cf8f9-0ab8-4d5b-b1d2-7e8bb62a5c62 req-27fe35fc-0888-4e29-94ea-f1a5d1b65322 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:14:43.909985 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-c98cf8f9-0ab8-4d5b-b1d2-7e8bb62a5c62 req-27fe35fc-0888-4e29-94ea-f1a5d1b65322 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:14:43.910509 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-c98cf8f9-0ab8-4d5b-b1d2-7e8bb62a5c62 req-27fe35fc-0888-4e29-94ea-f1a5d1b65322 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:14:43.912347 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e072a30f-f22e-4813-b804-70fe541734a9 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:14:43.912832 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e072a30f-f22e-4813-b804-70fe541734a9 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:14:43.913297 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e072a30f-f22e-4813-b804-70fe541734a9 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:14:43.914224 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e072a30f-f22e-4813-b804-70fe541734a9 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:14:43.914885 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e072a30f-f22e-4813-b804-70fe541734a9 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:14:43.915337 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e072a30f-f22e-4813-b804-70fe541734a9 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:14:43.923555 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-c98cf8f9-0ab8-4d5b-b1d2-7e8bb62a5c62 req-27fe35fc-0888-4e29-94ea-f1a5d1b65322 service nova] Creating event network-changed:95c67862-e5ef-436b-838e-2139a1eb284c for instance ffc3f779-4b7b-4d6b-be27-f89cb18ab01b on n-h1-836830-18 Sep 14 10:14:43.928708 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-c98cf8f9-0ab8-4d5b-b1d2-7e8bb62a5c62 req-27fe35fc-0888-4e29-94ea-f1a5d1b65322 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047181 Sep 14 10:14:43.929404 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3541/7659] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 10:14:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 10:14:43.947552 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e072a30f-f22e-4813-b804-70fe541734a9 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] [instance: ffc3f779-4b7b-4d6b-be27-f89cb18ab01b] Going to try to terminate instance {{(pid=128759) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 10:14:44.037573 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e072a30f-f22e-4813-b804-70fe541734a9 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] 10.222.0.60 "DELETE /compute/v2.1/servers/ffc3f779-4b7b-4d6b-be27-f89cb18ab01b" status: 204 len: 0 microversion: 2.1 time: 0.159651 Sep 14 10:14:44.038483 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4119/7660] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 10:14:43 2022] DELETE /compute/v2.1/servers/ffc3f779-4b7b-4d6b-be27-f89cb18ab01b => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 10:14:44.048853 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ab04a09c-febc-4232-8357-20f21b800eda tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:14:44.049621 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-ab04a09c-febc-4232-8357-20f21b800eda tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] [instance: ffc3f779-4b7b-4d6b-be27-f89cb18ab01b] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:14:44.055926 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ab04a09c-febc-4232-8357-20f21b800eda tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:14:44.056433 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ab04a09c-febc-4232-8357-20f21b800eda tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:14:44.056887 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ab04a09c-febc-4232-8357-20f21b800eda tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:14:44.057649 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ab04a09c-febc-4232-8357-20f21b800eda tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:14:44.058127 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ab04a09c-febc-4232-8357-20f21b800eda tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:14:44.058578 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ab04a09c-febc-4232-8357-20f21b800eda tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:14:44.250151 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-ab04a09c-febc-4232-8357-20f21b800eda tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a5cf8e45d46ca96e7d9378d1d59c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afca8f753d4a47249a0636dcde826313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:14:44.258049 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-ab04a09c-febc-4232-8357-20f21b800eda tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] 10.222.0.60 "GET /compute/v2.1/servers/ffc3f779-4b7b-4d6b-be27-f89cb18ab01b" status: 200 len: 1680 microversion: 2.1 time: 0.214190 Sep 14 10:14:44.258632 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3542/7661] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:14:44 2022] GET /compute/v2.1/servers/ffc3f779-4b7b-4d6b-be27-f89cb18ab01b => generated 1680 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:14:45.282370 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-5fe9d285-654a-43cd-a319-ca2f5b985518 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:14:45.283211 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-5fe9d285-654a-43cd-a319-ca2f5b985518 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] [instance: ffc3f779-4b7b-4d6b-be27-f89cb18ab01b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:14:45.285768 n-d-836830-18 devstack@n-api.service[128759]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fe2cf8e3-40e5-4586-b96b-b3e5ef0901e5] AMQP server on 10.222.0.60:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 14 10:14:45.291160 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5fe9d285-654a-43cd-a319-ca2f5b985518 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:14:45.291654 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5fe9d285-654a-43cd-a319-ca2f5b985518 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:14:45.292093 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5fe9d285-654a-43cd-a319-ca2f5b985518 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:14:45.292840 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5fe9d285-654a-43cd-a319-ca2f5b985518 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:14:45.293250 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5fe9d285-654a-43cd-a319-ca2f5b985518 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:14:45.293676 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5fe9d285-654a-43cd-a319-ca2f5b985518 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:14:45.427244 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-5fe9d285-654a-43cd-a319-ca2f5b985518 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a5cf8e45d46ca96e7d9378d1d59c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afca8f753d4a47249a0636dcde826313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:14:45.436696 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-5fe9d285-654a-43cd-a319-ca2f5b985518 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] 10.222.0.60 "GET /compute/v2.1/servers/ffc3f779-4b7b-4d6b-be27-f89cb18ab01b" status: 200 len: 1680 microversion: 2.1 time: 0.158616 Sep 14 10:14:45.437432 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4120/7662] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:14:45 2022] GET /compute/v2.1/servers/ffc3f779-4b7b-4d6b-be27-f89cb18ab01b => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:14:46.034508 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-dbc69035-fcbf-4289-ad45-b34d02fe2165 req-a3271cfc-91df-40b5-abe5-69c33950e58e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffc3f779-4b7b-4d6b-be27-f89cb18ab01b", "name": "network-vif-deleted", "tag": "95c67862-e5ef-436b-838e-2139a1eb284c"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:14:46.045794 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-dbc69035-fcbf-4289-ad45-b34d02fe2165 req-a3271cfc-91df-40b5-abe5-69c33950e58e service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:14:46.046302 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-dbc69035-fcbf-4289-ad45-b34d02fe2165 req-a3271cfc-91df-40b5-abe5-69c33950e58e service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:14:46.046756 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-dbc69035-fcbf-4289-ad45-b34d02fe2165 req-a3271cfc-91df-40b5-abe5-69c33950e58e service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:14:46.058205 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-dbc69035-fcbf-4289-ad45-b34d02fe2165 req-a3271cfc-91df-40b5-abe5-69c33950e58e service nova] Creating event network-vif-deleted:95c67862-e5ef-436b-838e-2139a1eb284c for instance ffc3f779-4b7b-4d6b-be27-f89cb18ab01b on n-h1-836830-18 Sep 14 10:14:46.063659 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-dbc69035-fcbf-4289-ad45-b34d02fe2165 req-a3271cfc-91df-40b5-abe5-69c33950e58e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032961 Sep 14 10:14:46.064465 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3543/7663] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 10:14:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:14:46.462824 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-88dc27ce-5a1f-4202-96a0-f3401d7c6812 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:14:46.463479 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-88dc27ce-5a1f-4202-96a0-f3401d7c6812 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] [instance: ffc3f779-4b7b-4d6b-be27-f89cb18ab01b] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:14:46.473492 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-88dc27ce-5a1f-4202-96a0-f3401d7c6812 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:14:46.474394 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-88dc27ce-5a1f-4202-96a0-f3401d7c6812 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:14:46.474838 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-88dc27ce-5a1f-4202-96a0-f3401d7c6812 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:14:46.475564 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-88dc27ce-5a1f-4202-96a0-f3401d7c6812 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:14:46.476465 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-88dc27ce-5a1f-4202-96a0-f3401d7c6812 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:14:46.476896 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-88dc27ce-5a1f-4202-96a0-f3401d7c6812 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:14:46.484199 n-d-836830-18 devstack@n-api.service[128759]: INFO oslo.messaging._drivers.impl_rabbit [-] [fe2cf8e3-40e5-4586-b96b-b3e5ef0901e5] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 53426. Sep 14 10:14:46.512767 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-88dc27ce-5a1f-4202-96a0-f3401d7c6812 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:14:46.513302 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-88dc27ce-5a1f-4202-96a0-f3401d7c6812 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:14:46.513812 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-88dc27ce-5a1f-4202-96a0-f3401d7c6812 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:14:46.514343 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.objects.instance [None req-88dc27ce-5a1f-4202-96a0-f3401d7c6812 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lazy-loading 'fault' on Instance uuid ffc3f779-4b7b-4d6b-be27-f89cb18ab01b {{(pid=128759) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 10:14:46.558566 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-88dc27ce-5a1f-4202-96a0-f3401d7c6812 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a5cf8e45d46ca96e7d9378d1d59c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afca8f753d4a47249a0636dcde826313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:14:46.567456 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-88dc27ce-5a1f-4202-96a0-f3401d7c6812 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] 10.222.0.60 "GET /compute/v2.1/servers/ffc3f779-4b7b-4d6b-be27-f89cb18ab01b" status: 200 len: 1337 microversion: 2.1 time: 0.109945 Sep 14 10:14:46.576881 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4121/7664] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:14:46 2022] GET /compute/v2.1/servers/ffc3f779-4b7b-4d6b-be27-f89cb18ab01b => generated 1337 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:14:47.592993 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-68530a4d-6915-4c70-b816-a97aeaae6908 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:14:47.593728 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-68530a4d-6915-4c70-b816-a97aeaae6908 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] [instance: ffc3f779-4b7b-4d6b-be27-f89cb18ab01b] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:14:47.600026 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-68530a4d-6915-4c70-b816-a97aeaae6908 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:14:47.600527 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-68530a4d-6915-4c70-b816-a97aeaae6908 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:14:47.600984 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-68530a4d-6915-4c70-b816-a97aeaae6908 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:14:47.601694 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-68530a4d-6915-4c70-b816-a97aeaae6908 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:14:47.602167 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-68530a4d-6915-4c70-b816-a97aeaae6908 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:14:47.602613 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-68530a4d-6915-4c70-b816-a97aeaae6908 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:14:47.616992 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-68530a4d-6915-4c70-b816-a97aeaae6908 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] HTTP exception thrown: Instance ffc3f779-4b7b-4d6b-be27-f89cb18ab01b could not be found. Sep 14 10:14:47.618683 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-68530a4d-6915-4c70-b816-a97aeaae6908 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Request method failure captured: Sep 14 10:14:47.618683 n-d-836830-18 devstack@n-api.service[128758]: request: GET /compute/v2.1/servers/ffc3f779-4b7b-4d6b-be27-f89cb18ab01b HTTP/1.1 Sep 14 10:14:47.618683 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 10:14:47.618683 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 10:14:47.618683 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 10:14:47.618683 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 10:14:47.618683 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 10:14:47.618683 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 10:14:47.618683 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 10:14:47.618683 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 10:14:47.618683 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIah7jcv0TTIHE-AzcPX7Zc4g8F-B3bV2nfZXLaFxHHmiRwwWuhXn6ZhAc0pkwAvBSRy4CxeqQpTc341_VRbKNLvesPfGHkY5KZl_T2uhIodgdT0CQaCKfikxq1iJeg7ZWzW3URabxDza0tpqMajeiJQTrKHj5HqU27creKvHR_65jzA Sep 14 10:14:47.618683 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 10:14:47.618683 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 10:14:47.618683 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 10:14:47.618683 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 10:14:47.618683 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 10:14:47.618683 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 10:14:47.618683 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: afca8f753d4a47249a0636dcde826313 Sep 14 10:14:47.618683 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-TestShelveInstance-143535994 Sep 14 10:14:47.618683 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 10:14:47.618683 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 10:14:47.618683 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/afca8f753d4a47249a0636dcde826313"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_afca8f753d4a47249a0636dcde826313"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/afca8f753d4a47249a0636dcde826313"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/afca8f753d4a47249a0636dcde826313"}]}] Sep 14 10:14:47.618683 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-TestShelveInstance-143535994 Sep 14 10:14:47.618683 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: afca8f753d4a47249a0636dcde826313 Sep 14 10:14:47.618683 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-TestShelveInstance-143535994 Sep 14 10:14:47.618683 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-TestShelveInstance-143535994-project Sep 14 10:14:47.618683 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 10:14:47.618683 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 10:14:47.618683 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: bb4a5cf8e45d46ca96e7d9378d1d59c8 Sep 14 10:14:47.618683 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-TestShelveInstance-143535994-project Sep 14 10:14:47.618683 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 10:14:47.618683 n-d-836830-18 devstack@n-api.service[128758]: exception: Instance ffc3f779-4b7b-4d6b-be27-f89cb18ab01b could not be found. Sep 14 10:14:47.618683 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': 'ffc3f779-4b7b-4d6b-be27-f89cb18ab01b'} Sep 14 10:14:47.618683 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 10:14:47.618683 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:14:47.618683 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 10:14:47.618683 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 10:14:47.618683 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 10:14:47.618683 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 10:14:47.618683 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 10:14:47.618683 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 10:14:47.618683 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 10:14:47.618683 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 10:14:47.618683 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffc3f779-4b7b-4d6b-be27-f89cb18ab01b could not be found. Sep 14 10:14:47.618683 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 10:14:47.618683 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:14:47.618683 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 10:14:47.618683 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:14:47.618683 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:14:47.618683 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:14:47.618683 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 10:14:47.618683 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 10:14:47.618683 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 10:14:47.618683 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 10:14:47.618683 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 10:14:47.618683 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 10:14:47.618683 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 10:14:47.618683 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 10:14:47.618683 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 10:14:47.618683 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 10:14:47.618683 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffc3f779-4b7b-4d6b-be27-f89cb18ab01b could not be found. Sep 14 10:14:47.618683 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 10:14:47.618683 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:14:47.618683 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 10:14:47.624201 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:14:47.624201 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:14:47.624201 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:14:47.624201 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 10:14:47.624201 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 10:14:47.624201 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffc3f779-4b7b-4d6b-be27-f89cb18ab01b could not be found. Sep 14 10:14:47.624201 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 10:14:47.624201 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-68530a4d-6915-4c70-b816-a97aeaae6908 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Returning 404 to user: Instance ffc3f779-4b7b-4d6b-be27-f89cb18ab01b could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 10:14:47.624201 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-68530a4d-6915-4c70-b816-a97aeaae6908 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] 10.222.0.60 "GET /compute/v2.1/servers/ffc3f779-4b7b-4d6b-be27-f89cb18ab01b" status: 404 len: 111 microversion: 2.1 time: 0.032961 Sep 14 10:14:47.624201 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3544/7665] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:14:47 2022] GET /compute/v2.1/servers/ffc3f779-4b7b-4d6b-be27-f89cb18ab01b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 10:14:47.791212 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b5d4c9c1-e5fc-4d1b-a49f-e9173fe46644 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Calling method '.version_select at 0x7f7d487743a0>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:14:47.819565 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b5d4c9c1-e5fc-4d1b-a49f-e9173fe46644 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1419449833" status: 202 len: 0 microversion: 2.1 time: 0.032473 Sep 14 10:14:47.820441 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4122/7666] 10.222.0.60 () {58 vars in 1254 bytes} [Wed Sep 14 10:14:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1419449833 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 10:14:47.842496 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ea5d9242-9725-434c-a5ff-520f8a3ff408 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Action: 'create', calling method: .version_select at 0x7f7d4865c550>, body: {"keypair": {"name": "tempest-TestShelveInstance-1948508301", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAevGrC5f00REHNBIle8o/aGYoVRX+UzWzJVqS7MUrqv35F/aV4RLiSiKkIzCMgfgmSP79Kbj7QAWSh0N+RkQWOYKhxECIRthR7EC1XyYnzeSOMXHZOVfvoftEFChT6uVw=="}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:14:47.859242 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-ea5d9242-9725-434c-a5ff-520f8a3ff408 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Getting quotas for project afca8f753d4a47249a0636dcde826313. Resources: {'key_pairs'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 10:14:47.864453 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-ea5d9242-9725-434c-a5ff-520f8a3ff408 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Getting quotas for user bb4a5cf8e45d46ca96e7d9378d1d59c8 and project afca8f753d4a47249a0636dcde826313. Resources: {'key_pairs'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 10:14:47.890972 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-ea5d9242-9725-434c-a5ff-520f8a3ff408 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.053173 Sep 14 10:14:47.891695 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3545/7667] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Sep 14 10:14:47 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:15:04.061381 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:15:04.062164 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:15:04.066728 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9f609bb5-ce58-4408-8054-4353be414c3d tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-301703694", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1948508301", "security_groups": [{"name": "tempest-secgroup-smoke-397528005"}], "networks": [{"uuid": "0b7b0e66-0341-4536-ba5a-fff7b089c9f8"}], "block_device_mapping_v2": [{"uuid": "4baac54e-f803-4d37-a5f2-78359134055b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:15:04.187034 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.network.neutron [None req-9f609bb5-ce58-4408-8054-4353be414c3d tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] validate_networks() for [('0b7b0e66-0341-4536-ba5a-fff7b089c9f8', None, None, None, None, None)] {{(pid=128759) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 10:15:04.610189 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-9f609bb5-ce58-4408-8054-4353be414c3d tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Flavor limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 10:15:04.610655 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-9f609bb5-ce58-4408-8054-4353be414c3d tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Image limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 10:15:04.611182 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-9f609bb5-ce58-4408-8054-4353be414c3d tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Flavor pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 10:15:04.611596 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-9f609bb5-ce58-4408-8054-4353be414c3d tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Image pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 10:15:04.612032 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-9f609bb5-ce58-4408-8054-4353be414c3d tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 10:15:04.620880 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9f609bb5-ce58-4408-8054-4353be414c3d tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:15:04.621365 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9f609bb5-ce58-4408-8054-4353be414c3d tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:15:04.621803 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9f609bb5-ce58-4408-8054-4353be414c3d tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:15:04.622528 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9f609bb5-ce58-4408-8054-4353be414c3d tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:15:04.623021 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9f609bb5-ce58-4408-8054-4353be414c3d tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:15:04.623452 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9f609bb5-ce58-4408-8054-4353be414c3d tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:15:04.640950 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-9f609bb5-ce58-4408-8054-4353be414c3d tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Getting quotas for project afca8f753d4a47249a0636dcde826313. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 10:15:04.646158 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-9f609bb5-ce58-4408-8054-4353be414c3d tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Getting quotas for user bb4a5cf8e45d46ca96e7d9378d1d59c8 and project afca8f753d4a47249a0636dcde826313. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 10:15:04.704916 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-9f609bb5-ce58-4408-8054-4353be414c3d tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Going to run 1 instances... {{(pid=128759) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 10:15:04.707158 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-9f609bb5-ce58-4408-8054-4353be414c3d tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] [instance: 2b284d4d-d0ed-4d48-901c-d16a9e4505b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4baac54e-f803-4d37-a5f2-78359134055b',volume_size=None,volume_type=None)] {{(pid=128759) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 10:15:04.833836 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-9f609bb5-ce58-4408-8054-4353be414c3d tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.774701 Sep 14 10:15:04.834645 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4123/7668] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 10:15:04 2022] POST /compute/v2.1/servers => generated 405 bytes in 776 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 10:15:04.844815 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=12 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:15:04.845706 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=4 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:15:04.846556 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:15:04.852832 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-87ef4199-f700-4cd5-b86c-0e3e933416f7 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:15:04.853487 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-87ef4199-f700-4cd5-b86c-0e3e933416f7 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] [instance: 2b284d4d-d0ed-4d48-901c-d16a9e4505b1] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:15:04.917598 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-87ef4199-f700-4cd5-b86c-0e3e933416f7 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a5cf8e45d46ca96e7d9378d1d59c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afca8f753d4a47249a0636dcde826313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:15:04.925042 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-87ef4199-f700-4cd5-b86c-0e3e933416f7 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] 10.222.0.60 "GET /compute/v2.1/servers/2b284d4d-d0ed-4d48-901c-d16a9e4505b1" status: 200 len: 1088 microversion: 2.1 time: 0.082194 Sep 14 10:15:04.925626 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3546/7669] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:15:04 2022] GET /compute/v2.1/servers/2b284d4d-d0ed-4d48-901c-d16a9e4505b1 => generated 1088 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:15:05.950015 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-079d3d0e-93e4-4227-8569-1ebecb7e3469 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:15:05.951456 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-079d3d0e-93e4-4227-8569-1ebecb7e3469 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] [instance: 2b284d4d-d0ed-4d48-901c-d16a9e4505b1] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:15:05.968289 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-079d3d0e-93e4-4227-8569-1ebecb7e3469 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:15:05.968812 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-079d3d0e-93e4-4227-8569-1ebecb7e3469 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:15:05.969427 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-079d3d0e-93e4-4227-8569-1ebecb7e3469 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:15:05.970157 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-079d3d0e-93e4-4227-8569-1ebecb7e3469 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:15:05.970624 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-079d3d0e-93e4-4227-8569-1ebecb7e3469 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:15:05.971098 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-079d3d0e-93e4-4227-8569-1ebecb7e3469 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:15:06.037440 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-079d3d0e-93e4-4227-8569-1ebecb7e3469 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a5cf8e45d46ca96e7d9378d1d59c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afca8f753d4a47249a0636dcde826313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:15:06.047704 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-079d3d0e-93e4-4227-8569-1ebecb7e3469 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] 10.222.0.60 "GET /compute/v2.1/servers/2b284d4d-d0ed-4d48-901c-d16a9e4505b1" status: 200 len: 1204 microversion: 2.1 time: 0.102313 Sep 14 10:15:06.048133 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4124/7670] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:15:05 2022] GET /compute/v2.1/servers/2b284d4d-d0ed-4d48-901c-d16a9e4505b1 => generated 1204 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:15:07.071095 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-2f1f2c01-ce65-4626-a5c8-a81912c2e1ad tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:15:07.071942 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-2f1f2c01-ce65-4626-a5c8-a81912c2e1ad tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] [instance: 2b284d4d-d0ed-4d48-901c-d16a9e4505b1] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:15:07.081026 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2f1f2c01-ce65-4626-a5c8-a81912c2e1ad tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:15:07.081693 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2f1f2c01-ce65-4626-a5c8-a81912c2e1ad tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:15:07.082252 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2f1f2c01-ce65-4626-a5c8-a81912c2e1ad tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:15:07.083137 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2f1f2c01-ce65-4626-a5c8-a81912c2e1ad tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:15:07.083721 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2f1f2c01-ce65-4626-a5c8-a81912c2e1ad tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:15:07.084289 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-2f1f2c01-ce65-4626-a5c8-a81912c2e1ad tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:15:07.241165 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-2f1f2c01-ce65-4626-a5c8-a81912c2e1ad tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a5cf8e45d46ca96e7d9378d1d59c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afca8f753d4a47249a0636dcde826313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:15:07.249812 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-2f1f2c01-ce65-4626-a5c8-a81912c2e1ad tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] 10.222.0.60 "GET /compute/v2.1/servers/2b284d4d-d0ed-4d48-901c-d16a9e4505b1" status: 200 len: 1271 microversion: 2.1 time: 0.182958 Sep 14 10:15:07.250735 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3547/7671] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:15:07 2022] GET /compute/v2.1/servers/2b284d4d-d0ed-4d48-901c-d16a9e4505b1 => generated 1271 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:15:07.699249 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-4049c217-e524-4a4b-abb5-28692406e0c4 req-4ecc3619-39a5-4bc2-b230-e18cfc36cdc9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b284d4d-d0ed-4d48-901c-d16a9e4505b1", "tag": "4ffcbda4-b14b-4282-b836-779e39a881e2"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:15:07.724157 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-4049c217-e524-4a4b-abb5-28692406e0c4 req-4ecc3619-39a5-4bc2-b230-e18cfc36cdc9 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:15:07.725368 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-4049c217-e524-4a4b-abb5-28692406e0c4 req-4ecc3619-39a5-4bc2-b230-e18cfc36cdc9 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:15:07.726108 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-4049c217-e524-4a4b-abb5-28692406e0c4 req-4ecc3619-39a5-4bc2-b230-e18cfc36cdc9 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:15:07.741511 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-4049c217-e524-4a4b-abb5-28692406e0c4 req-4ecc3619-39a5-4bc2-b230-e18cfc36cdc9 service nova] Creating event network-changed:4ffcbda4-b14b-4282-b836-779e39a881e2 for instance 2b284d4d-d0ed-4d48-901c-d16a9e4505b1 on n-h2-836830-18 Sep 14 10:15:07.747027 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-4049c217-e524-4a4b-abb5-28692406e0c4 req-4ecc3619-39a5-4bc2-b230-e18cfc36cdc9 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121328 Sep 14 10:15:07.748972 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4125/7672] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 10:15:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:15:08.333767 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-69275e14-ac72-40d7-b290-22fdf3faa069 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:15:08.334709 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-69275e14-ac72-40d7-b290-22fdf3faa069 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] [instance: 2b284d4d-d0ed-4d48-901c-d16a9e4505b1] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:15:08.341343 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-69275e14-ac72-40d7-b290-22fdf3faa069 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:15:08.341853 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-69275e14-ac72-40d7-b290-22fdf3faa069 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:15:08.342311 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-69275e14-ac72-40d7-b290-22fdf3faa069 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:15:08.343176 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-69275e14-ac72-40d7-b290-22fdf3faa069 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:15:08.343660 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-69275e14-ac72-40d7-b290-22fdf3faa069 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:15:08.344260 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-69275e14-ac72-40d7-b290-22fdf3faa069 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:15:08.487531 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-69275e14-ac72-40d7-b290-22fdf3faa069 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a5cf8e45d46ca96e7d9378d1d59c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afca8f753d4a47249a0636dcde826313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:15:08.495702 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-69275e14-ac72-40d7-b290-22fdf3faa069 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] 10.222.0.60 "GET /compute/v2.1/servers/2b284d4d-d0ed-4d48-901c-d16a9e4505b1" status: 200 len: 1271 microversion: 2.1 time: 0.226897 Sep 14 10:15:08.496441 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3548/7673] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:15:08 2022] GET /compute/v2.1/servers/2b284d4d-d0ed-4d48-901c-d16a9e4505b1 => generated 1271 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:15:09.520517 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d3071653-2f81-4d6b-8a3b-8a45498129ba tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:15:09.521124 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-d3071653-2f81-4d6b-8a3b-8a45498129ba tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] [instance: 2b284d4d-d0ed-4d48-901c-d16a9e4505b1] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:15:09.528346 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d3071653-2f81-4d6b-8a3b-8a45498129ba tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:15:09.528830 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d3071653-2f81-4d6b-8a3b-8a45498129ba tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:15:09.529274 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d3071653-2f81-4d6b-8a3b-8a45498129ba tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:15:09.529969 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d3071653-2f81-4d6b-8a3b-8a45498129ba tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:15:09.530426 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d3071653-2f81-4d6b-8a3b-8a45498129ba tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:15:09.530852 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d3071653-2f81-4d6b-8a3b-8a45498129ba tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:15:09.665704 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-d3071653-2f81-4d6b-8a3b-8a45498129ba tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a5cf8e45d46ca96e7d9378d1d59c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afca8f753d4a47249a0636dcde826313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:15:09.673689 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d3071653-2f81-4d6b-8a3b-8a45498129ba tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] 10.222.0.60 "GET /compute/v2.1/servers/2b284d4d-d0ed-4d48-901c-d16a9e4505b1" status: 200 len: 1271 microversion: 2.1 time: 0.157643 Sep 14 10:15:09.674272 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4126/7674] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:15:09 2022] GET /compute/v2.1/servers/2b284d4d-d0ed-4d48-901c-d16a9e4505b1 => generated 1271 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 10:15:10.697301 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-66ba8bbb-c396-4883-be7f-0c1bb7c8ad77 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:15:10.697786 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-66ba8bbb-c396-4883-be7f-0c1bb7c8ad77 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] [instance: 2b284d4d-d0ed-4d48-901c-d16a9e4505b1] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:15:10.705041 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-66ba8bbb-c396-4883-be7f-0c1bb7c8ad77 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:15:10.705541 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-66ba8bbb-c396-4883-be7f-0c1bb7c8ad77 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:15:10.705988 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-66ba8bbb-c396-4883-be7f-0c1bb7c8ad77 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:15:10.706693 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-66ba8bbb-c396-4883-be7f-0c1bb7c8ad77 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:15:10.707265 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-66ba8bbb-c396-4883-be7f-0c1bb7c8ad77 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:15:10.707710 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-66ba8bbb-c396-4883-be7f-0c1bb7c8ad77 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:15:10.844996 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-66ba8bbb-c396-4883-be7f-0c1bb7c8ad77 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a5cf8e45d46ca96e7d9378d1d59c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afca8f753d4a47249a0636dcde826313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:15:10.852818 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-66ba8bbb-c396-4883-be7f-0c1bb7c8ad77 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] 10.222.0.60 "GET /compute/v2.1/servers/2b284d4d-d0ed-4d48-901c-d16a9e4505b1" status: 200 len: 1271 microversion: 2.1 time: 0.159724 Sep 14 10:15:10.853403 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3549/7675] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:15:10 2022] GET /compute/v2.1/servers/2b284d4d-d0ed-4d48-901c-d16a9e4505b1 => generated 1271 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:15:11.877402 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-de811c45-51ad-4bca-9966-06df724570d8 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:15:11.878019 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-de811c45-51ad-4bca-9966-06df724570d8 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] [instance: 2b284d4d-d0ed-4d48-901c-d16a9e4505b1] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:15:11.884886 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-de811c45-51ad-4bca-9966-06df724570d8 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:15:11.885373 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-de811c45-51ad-4bca-9966-06df724570d8 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:15:11.885809 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-de811c45-51ad-4bca-9966-06df724570d8 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:15:11.886493 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-de811c45-51ad-4bca-9966-06df724570d8 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:15:11.886969 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-de811c45-51ad-4bca-9966-06df724570d8 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:15:11.887391 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-de811c45-51ad-4bca-9966-06df724570d8 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:15:12.016543 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-de811c45-51ad-4bca-9966-06df724570d8 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a5cf8e45d46ca96e7d9378d1d59c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afca8f753d4a47249a0636dcde826313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:15:12.024324 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-de811c45-51ad-4bca-9966-06df724570d8 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] 10.222.0.60 "GET /compute/v2.1/servers/2b284d4d-d0ed-4d48-901c-d16a9e4505b1" status: 200 len: 1259 microversion: 2.1 time: 0.150865 Sep 14 10:15:12.024905 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4127/7676] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:15:11 2022] GET /compute/v2.1/servers/2b284d4d-d0ed-4d48-901c-d16a9e4505b1 => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:15:13.047965 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-4ef0031e-c994-4406-9778-267e351125dc tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:15:13.048600 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-4ef0031e-c994-4406-9778-267e351125dc tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] [instance: 2b284d4d-d0ed-4d48-901c-d16a9e4505b1] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:15:13.056049 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4ef0031e-c994-4406-9778-267e351125dc tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:15:13.056551 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4ef0031e-c994-4406-9778-267e351125dc tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:15:13.057008 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4ef0031e-c994-4406-9778-267e351125dc tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:15:13.057714 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4ef0031e-c994-4406-9778-267e351125dc tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:15:13.058185 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4ef0031e-c994-4406-9778-267e351125dc tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:15:13.058627 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4ef0031e-c994-4406-9778-267e351125dc tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:15:13.191964 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-4ef0031e-c994-4406-9778-267e351125dc tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a5cf8e45d46ca96e7d9378d1d59c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afca8f753d4a47249a0636dcde826313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:15:13.199924 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-4ef0031e-c994-4406-9778-267e351125dc tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] 10.222.0.60 "GET /compute/v2.1/servers/2b284d4d-d0ed-4d48-901c-d16a9e4505b1" status: 200 len: 1259 microversion: 2.1 time: 0.155966 Sep 14 10:15:13.200502 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3550/7677] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:15:13 2022] GET /compute/v2.1/servers/2b284d4d-d0ed-4d48-901c-d16a9e4505b1 => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:15:14.222567 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-4bd71637-9fb0-4508-801a-594cbf2002e4 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:15:14.223256 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-4bd71637-9fb0-4508-801a-594cbf2002e4 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] [instance: 2b284d4d-d0ed-4d48-901c-d16a9e4505b1] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:15:14.230163 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4bd71637-9fb0-4508-801a-594cbf2002e4 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:15:14.230659 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4bd71637-9fb0-4508-801a-594cbf2002e4 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:15:14.231139 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4bd71637-9fb0-4508-801a-594cbf2002e4 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:15:14.232350 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4bd71637-9fb0-4508-801a-594cbf2002e4 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:15:14.232818 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4bd71637-9fb0-4508-801a-594cbf2002e4 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:15:14.233251 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4bd71637-9fb0-4508-801a-594cbf2002e4 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:15:14.366663 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-4bd71637-9fb0-4508-801a-594cbf2002e4 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a5cf8e45d46ca96e7d9378d1d59c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afca8f753d4a47249a0636dcde826313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:15:14.375083 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-4bd71637-9fb0-4508-801a-594cbf2002e4 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] 10.222.0.60 "GET /compute/v2.1/servers/2b284d4d-d0ed-4d48-901c-d16a9e4505b1" status: 200 len: 1259 microversion: 2.1 time: 0.156433 Sep 14 10:15:14.375659 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4128/7678] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:15:14 2022] GET /compute/v2.1/servers/2b284d4d-d0ed-4d48-901c-d16a9e4505b1 => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:15:15.397650 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-3dc02a00-6148-488c-9212-5baad8d08381 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:15:15.398278 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-3dc02a00-6148-488c-9212-5baad8d08381 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] [instance: 2b284d4d-d0ed-4d48-901c-d16a9e4505b1] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:15:15.401062 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=2 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:15:15.406621 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3dc02a00-6148-488c-9212-5baad8d08381 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:15:15.407150 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3dc02a00-6148-488c-9212-5baad8d08381 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:15:15.407601 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3dc02a00-6148-488c-9212-5baad8d08381 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:15:15.408296 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3dc02a00-6148-488c-9212-5baad8d08381 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:15:15.408761 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3dc02a00-6148-488c-9212-5baad8d08381 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:15:15.409197 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3dc02a00-6148-488c-9212-5baad8d08381 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:15:15.540195 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-3dc02a00-6148-488c-9212-5baad8d08381 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a5cf8e45d46ca96e7d9378d1d59c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afca8f753d4a47249a0636dcde826313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:15:15.547915 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-3dc02a00-6148-488c-9212-5baad8d08381 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] 10.222.0.60 "GET /compute/v2.1/servers/2b284d4d-d0ed-4d48-901c-d16a9e4505b1" status: 200 len: 1259 microversion: 2.1 time: 0.154190 Sep 14 10:15:15.548495 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3551/7679] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:15:15 2022] GET /compute/v2.1/servers/2b284d4d-d0ed-4d48-901c-d16a9e4505b1 => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:15:16.571345 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-13a4c4ea-1fac-4c5e-bff7-6042f805e25b tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:15:16.571894 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-13a4c4ea-1fac-4c5e-bff7-6042f805e25b tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] [instance: 2b284d4d-d0ed-4d48-901c-d16a9e4505b1] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:15:16.574014 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=2 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:15:16.574679 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=6 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:15:16.581331 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-13a4c4ea-1fac-4c5e-bff7-6042f805e25b tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:15:16.581814 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-13a4c4ea-1fac-4c5e-bff7-6042f805e25b tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:15:16.582248 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-13a4c4ea-1fac-4c5e-bff7-6042f805e25b tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:15:16.582966 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-13a4c4ea-1fac-4c5e-bff7-6042f805e25b tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:15:16.583421 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-13a4c4ea-1fac-4c5e-bff7-6042f805e25b tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:15:16.583845 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-13a4c4ea-1fac-4c5e-bff7-6042f805e25b tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:15:16.714484 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-13a4c4ea-1fac-4c5e-bff7-6042f805e25b tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a5cf8e45d46ca96e7d9378d1d59c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afca8f753d4a47249a0636dcde826313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:15:16.722623 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-13a4c4ea-1fac-4c5e-bff7-6042f805e25b tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] 10.222.0.60 "GET /compute/v2.1/servers/2b284d4d-d0ed-4d48-901c-d16a9e4505b1" status: 200 len: 1259 microversion: 2.1 time: 0.155308 Sep 14 10:15:16.723235 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4129/7680] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:15:16 2022] GET /compute/v2.1/servers/2b284d4d-d0ed-4d48-901c-d16a9e4505b1 => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:15:17.745662 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-f0548103-64e7-4d31-9f5a-381157c442cd tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:15:17.746306 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-f0548103-64e7-4d31-9f5a-381157c442cd tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] [instance: 2b284d4d-d0ed-4d48-901c-d16a9e4505b1] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:15:17.753829 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f0548103-64e7-4d31-9f5a-381157c442cd tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:15:17.754394 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f0548103-64e7-4d31-9f5a-381157c442cd tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:15:17.754837 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f0548103-64e7-4d31-9f5a-381157c442cd tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:15:17.755643 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f0548103-64e7-4d31-9f5a-381157c442cd tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:15:17.756056 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f0548103-64e7-4d31-9f5a-381157c442cd tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:15:17.756509 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-f0548103-64e7-4d31-9f5a-381157c442cd tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:15:17.888854 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-f0548103-64e7-4d31-9f5a-381157c442cd tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a5cf8e45d46ca96e7d9378d1d59c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afca8f753d4a47249a0636dcde826313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:15:17.896844 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-f0548103-64e7-4d31-9f5a-381157c442cd tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] 10.222.0.60 "GET /compute/v2.1/servers/2b284d4d-d0ed-4d48-901c-d16a9e4505b1" status: 200 len: 1259 microversion: 2.1 time: 0.155099 Sep 14 10:15:17.897425 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3552/7681] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:15:17 2022] GET /compute/v2.1/servers/2b284d4d-d0ed-4d48-901c-d16a9e4505b1 => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:15:18.919267 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8620862c-285b-47a1-abe5-5daa97d82459 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:15:18.919893 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-8620862c-285b-47a1-abe5-5daa97d82459 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] [instance: 2b284d4d-d0ed-4d48-901c-d16a9e4505b1] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:15:18.926816 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8620862c-285b-47a1-abe5-5daa97d82459 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:15:18.927344 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8620862c-285b-47a1-abe5-5daa97d82459 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:15:18.927837 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8620862c-285b-47a1-abe5-5daa97d82459 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:15:18.928536 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8620862c-285b-47a1-abe5-5daa97d82459 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:15:18.929000 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8620862c-285b-47a1-abe5-5daa97d82459 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:15:18.929434 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8620862c-285b-47a1-abe5-5daa97d82459 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:15:19.062914 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-8620862c-285b-47a1-abe5-5daa97d82459 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a5cf8e45d46ca96e7d9378d1d59c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afca8f753d4a47249a0636dcde826313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:15:19.075130 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-8620862c-285b-47a1-abe5-5daa97d82459 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] 10.222.0.60 "GET /compute/v2.1/servers/2b284d4d-d0ed-4d48-901c-d16a9e4505b1" status: 200 len: 1259 microversion: 2.1 time: 0.159693 Sep 14 10:15:19.075943 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4130/7682] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:15:18 2022] GET /compute/v2.1/servers/2b284d4d-d0ed-4d48-901c-d16a9e4505b1 => generated 1259 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:15:20.097729 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-72d0b83f-5ccf-4b25-a8c2-6347b48c31ba tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:15:20.098356 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-72d0b83f-5ccf-4b25-a8c2-6347b48c31ba tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] [instance: 2b284d4d-d0ed-4d48-901c-d16a9e4505b1] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:15:20.104760 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-72d0b83f-5ccf-4b25-a8c2-6347b48c31ba tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:15:20.105254 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-72d0b83f-5ccf-4b25-a8c2-6347b48c31ba tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:15:20.105700 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-72d0b83f-5ccf-4b25-a8c2-6347b48c31ba tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:15:20.106399 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-72d0b83f-5ccf-4b25-a8c2-6347b48c31ba tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:15:20.106860 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-72d0b83f-5ccf-4b25-a8c2-6347b48c31ba tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:15:20.107323 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-72d0b83f-5ccf-4b25-a8c2-6347b48c31ba tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:15:20.240172 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-72d0b83f-5ccf-4b25-a8c2-6347b48c31ba tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a5cf8e45d46ca96e7d9378d1d59c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afca8f753d4a47249a0636dcde826313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:15:20.247981 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-72d0b83f-5ccf-4b25-a8c2-6347b48c31ba tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] 10.222.0.60 "GET /compute/v2.1/servers/2b284d4d-d0ed-4d48-901c-d16a9e4505b1" status: 200 len: 1259 microversion: 2.1 time: 0.154228 Sep 14 10:15:20.249209 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3553/7683] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:15:20 2022] GET /compute/v2.1/servers/2b284d4d-d0ed-4d48-901c-d16a9e4505b1 => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:15:20.798393 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-8a27966d-8ef5-469c-9da2-917b25496e83 req-7ec80983-62a1-4c64-b450-93179a457cc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b284d4d-d0ed-4d48-901c-d16a9e4505b1", "name": "network-vif-plugged", "status": "completed", "tag": "4ffcbda4-b14b-4282-b836-779e39a881e2"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:15:20.815015 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-8a27966d-8ef5-469c-9da2-917b25496e83 req-7ec80983-62a1-4c64-b450-93179a457cc5 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:15:20.815542 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-8a27966d-8ef5-469c-9da2-917b25496e83 req-7ec80983-62a1-4c64-b450-93179a457cc5 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:15:20.815983 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-8a27966d-8ef5-469c-9da2-917b25496e83 req-7ec80983-62a1-4c64-b450-93179a457cc5 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:15:20.828282 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-8a27966d-8ef5-469c-9da2-917b25496e83 req-7ec80983-62a1-4c64-b450-93179a457cc5 service nova] Creating event network-vif-plugged:4ffcbda4-b14b-4282-b836-779e39a881e2 for instance 2b284d4d-d0ed-4d48-901c-d16a9e4505b1 on n-h2-836830-18 Sep 14 10:15:20.837650 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-8a27966d-8ef5-469c-9da2-917b25496e83 req-7ec80983-62a1-4c64-b450-93179a457cc5 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119115 Sep 14 10:15:20.838265 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4131/7684] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 10:15:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 10:15:21.271326 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-07238ffa-5811-4085-8c19-3489c80f4cdf tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:15:21.271964 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-07238ffa-5811-4085-8c19-3489c80f4cdf tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] [instance: 2b284d4d-d0ed-4d48-901c-d16a9e4505b1] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:15:21.278859 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-07238ffa-5811-4085-8c19-3489c80f4cdf tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:15:21.279909 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-07238ffa-5811-4085-8c19-3489c80f4cdf tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:15:21.280378 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-07238ffa-5811-4085-8c19-3489c80f4cdf tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:15:21.281079 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-07238ffa-5811-4085-8c19-3489c80f4cdf tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:15:21.281551 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-07238ffa-5811-4085-8c19-3489c80f4cdf tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:15:21.281994 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-07238ffa-5811-4085-8c19-3489c80f4cdf tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:15:21.416655 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-07238ffa-5811-4085-8c19-3489c80f4cdf tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a5cf8e45d46ca96e7d9378d1d59c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afca8f753d4a47249a0636dcde826313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:15:21.425114 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-07238ffa-5811-4085-8c19-3489c80f4cdf tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] 10.222.0.60 "GET /compute/v2.1/servers/2b284d4d-d0ed-4d48-901c-d16a9e4505b1" status: 200 len: 1259 microversion: 2.1 time: 0.157688 Sep 14 10:15:21.425718 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3554/7685] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:15:21 2022] GET /compute/v2.1/servers/2b284d4d-d0ed-4d48-901c-d16a9e4505b1 => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:15:22.448522 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-51c2bddc-4447-4adc-89fd-cb0cf6350612 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:15:22.449242 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-51c2bddc-4447-4adc-89fd-cb0cf6350612 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] [instance: 2b284d4d-d0ed-4d48-901c-d16a9e4505b1] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:15:22.456898 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-51c2bddc-4447-4adc-89fd-cb0cf6350612 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:15:22.457392 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-51c2bddc-4447-4adc-89fd-cb0cf6350612 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:15:22.457838 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-51c2bddc-4447-4adc-89fd-cb0cf6350612 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:15:22.458778 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-51c2bddc-4447-4adc-89fd-cb0cf6350612 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:15:22.459044 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-51c2bddc-4447-4adc-89fd-cb0cf6350612 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:15:22.459479 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-51c2bddc-4447-4adc-89fd-cb0cf6350612 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:15:22.594277 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-51c2bddc-4447-4adc-89fd-cb0cf6350612 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a5cf8e45d46ca96e7d9378d1d59c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afca8f753d4a47249a0636dcde826313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:15:22.602063 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-51c2bddc-4447-4adc-89fd-cb0cf6350612 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] 10.222.0.60 "GET /compute/v2.1/servers/2b284d4d-d0ed-4d48-901c-d16a9e4505b1" status: 200 len: 1442 microversion: 2.1 time: 0.157968 Sep 14 10:15:22.602642 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4132/7686] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:15:22 2022] GET /compute/v2.1/servers/2b284d4d-d0ed-4d48-901c-d16a9e4505b1 => generated 1442 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:15:22.624207 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-4044a76d-e48e-4566-bf24-971bba2d1e2c tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:15:22.624846 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-4044a76d-e48e-4566-bf24-971bba2d1e2c tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] [instance: 2b284d4d-d0ed-4d48-901c-d16a9e4505b1] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:15:22.631723 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4044a76d-e48e-4566-bf24-971bba2d1e2c tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:15:22.632220 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4044a76d-e48e-4566-bf24-971bba2d1e2c tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:15:22.632667 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4044a76d-e48e-4566-bf24-971bba2d1e2c tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:15:22.633369 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4044a76d-e48e-4566-bf24-971bba2d1e2c tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:15:22.633848 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4044a76d-e48e-4566-bf24-971bba2d1e2c tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:15:22.634301 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4044a76d-e48e-4566-bf24-971bba2d1e2c tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:15:22.766029 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-4044a76d-e48e-4566-bf24-971bba2d1e2c tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a5cf8e45d46ca96e7d9378d1d59c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afca8f753d4a47249a0636dcde826313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:15:22.773974 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-4044a76d-e48e-4566-bf24-971bba2d1e2c tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] 10.222.0.60 "GET /compute/v2.1/servers/2b284d4d-d0ed-4d48-901c-d16a9e4505b1" status: 200 len: 1442 microversion: 2.1 time: 0.153666 Sep 14 10:15:22.774553 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3555/7687] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:15:22 2022] GET /compute/v2.1/servers/2b284d4d-d0ed-4d48-901c-d16a9e4505b1 => generated 1442 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:15:24.740078 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-309d519e-4eea-4f61-9eee-88ff6ad9ea39 req-455238ff-09fb-43be-826a-8b44a8ddf623 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b284d4d-d0ed-4d48-901c-d16a9e4505b1", "tag": "4ffcbda4-b14b-4282-b836-779e39a881e2"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:15:24.750610 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-309d519e-4eea-4f61-9eee-88ff6ad9ea39 req-455238ff-09fb-43be-826a-8b44a8ddf623 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:15:24.751079 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-309d519e-4eea-4f61-9eee-88ff6ad9ea39 req-455238ff-09fb-43be-826a-8b44a8ddf623 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:15:24.751522 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-309d519e-4eea-4f61-9eee-88ff6ad9ea39 req-455238ff-09fb-43be-826a-8b44a8ddf623 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:15:24.763504 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-309d519e-4eea-4f61-9eee-88ff6ad9ea39 req-455238ff-09fb-43be-826a-8b44a8ddf623 service nova] Creating event network-changed:4ffcbda4-b14b-4282-b836-779e39a881e2 for instance 2b284d4d-d0ed-4d48-901c-d16a9e4505b1 on n-h2-836830-18 Sep 14 10:15:24.769202 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-309d519e-4eea-4f61-9eee-88ff6ad9ea39 req-455238ff-09fb-43be-826a-8b44a8ddf623 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089904 Sep 14 10:15:24.770009 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4133/7688] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 10:15:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:17:19.766828 n-d-836830-18 devstack@n-api.service[128758]: ERROR oslo.messaging._drivers.impl_rabbit [-] [57e2b41d-7c54-48cb-b191-b7f77db67cfb] AMQP server on 10.222.0.60:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 14 10:17:19.767790 n-d-836830-18 devstack@n-api.service[128758]: ERROR oslo.messaging._drivers.impl_rabbit [-] [33d7e4a6-539b-476c-bc18-5478ca3a22f4] AMQP server on 10.222.0.60:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 14 10:17:19.768696 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=22 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:17:19.769460 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=54 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:17:19.770421 n-d-836830-18 devstack@n-api.service[128758]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 14 10:17:19.770619 n-d-836830-18 devstack@n-api.service[128758]: Wed Sep 14 10:17:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2b284d4d-d0ed-4d48-901c-d16a9e4505b1/action (ip 10.222.0.60) !!! Sep 14 10:17:19.771594 n-d-836830-18 devstack@n-api.service[128758]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 10:17:19.771820 n-d-836830-18 devstack@n-api.service[128758]: Wed Sep 14 10:17:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2b284d4d-d0ed-4d48-901c-d16a9e4505b1/action (ip 10.222.0.60) !!! Sep 14 10:17:19.772737 n-d-836830-18 devstack@n-api.service[128758]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 14 10:17:19.772860 n-d-836830-18 devstack@n-api.service[128758]: Wed Sep 14 10:17:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2b284d4d-d0ed-4d48-901c-d16a9e4505b1/action (ip 10.222.0.60) !!! Sep 14 10:17:19.780121 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-0d8551ed-2b38-4b07-bdce-18b7609f15bf tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:17:19.782565 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-0d8551ed-2b38-4b07-bdce-18b7609f15bf tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] [instance: 2b284d4d-d0ed-4d48-901c-d16a9e4505b1] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:17:19.792115 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0d8551ed-2b38-4b07-bdce-18b7609f15bf tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:19.792618 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0d8551ed-2b38-4b07-bdce-18b7609f15bf tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:19.793070 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0d8551ed-2b38-4b07-bdce-18b7609f15bf tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:19.793782 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0d8551ed-2b38-4b07-bdce-18b7609f15bf tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:19.794252 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0d8551ed-2b38-4b07-bdce-18b7609f15bf tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:19.794695 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0d8551ed-2b38-4b07-bdce-18b7609f15bf tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:19.820973 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.objects.instance [None req-0d8551ed-2b38-4b07-bdce-18b7609f15bf tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lazy-loading 'flavor' on Instance uuid 2b284d4d-d0ed-4d48-901c-d16a9e4505b1 {{(pid=128758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 10:17:19.894043 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-0d8551ed-2b38-4b07-bdce-18b7609f15bf tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] 10.222.0.60 "POST /compute/v2.1/servers/2b284d4d-d0ed-4d48-901c-d16a9e4505b1/action" status: 202 len: 0 microversion: 2.1 time: 0.128719 Sep 14 10:17:19.898190 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3556/7689] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 10:17:19 2022] POST /compute/v2.1/servers/2b284d4d-d0ed-4d48-901c-d16a9e4505b1/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 10:17:19.901383 n-d-836830-18 devstack@n-api.service[128759]: ERROR oslo.messaging._drivers.impl_rabbit [-] [22ef38d2-af78-43f4-be77-ac372bc70aea] AMQP server on 10.222.0.60:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 14 10:17:19.902706 n-d-836830-18 devstack@n-api.service[128759]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fe2cf8e3-40e5-4586-b96b-b3e5ef0901e5] AMQP server on 10.222.0.60:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Sep 14 10:17:19.903346 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:17:19.904278 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=50 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:17:19.905381 n-d-836830-18 devstack@n-api.service[128759]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 14 10:17:19.905548 n-d-836830-18 devstack@n-api.service[128759]: Wed Sep 14 10:17:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2b284d4d-d0ed-4d48-901c-d16a9e4505b1 (ip 10.222.0.60) !!! Sep 14 10:17:19.911224 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f9250f1a-cf31-4fab-8bc0-68854c79445c tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:17:19.911949 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f9250f1a-cf31-4fab-8bc0-68854c79445c tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] [instance: 2b284d4d-d0ed-4d48-901c-d16a9e4505b1] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:17:19.927775 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f9250f1a-cf31-4fab-8bc0-68854c79445c tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:19.928285 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f9250f1a-cf31-4fab-8bc0-68854c79445c tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:19.928742 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f9250f1a-cf31-4fab-8bc0-68854c79445c tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:19.929464 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f9250f1a-cf31-4fab-8bc0-68854c79445c tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:19.930057 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f9250f1a-cf31-4fab-8bc0-68854c79445c tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:19.930621 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f9250f1a-cf31-4fab-8bc0-68854c79445c tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:20.143275 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f9250f1a-cf31-4fab-8bc0-68854c79445c tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a5cf8e45d46ca96e7d9378d1d59c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afca8f753d4a47249a0636dcde826313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:17:20.151263 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f9250f1a-cf31-4fab-8bc0-68854c79445c tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] 10.222.0.60 "GET /compute/v2.1/servers/2b284d4d-d0ed-4d48-901c-d16a9e4505b1" status: 200 len: 1567 microversion: 2.1 time: 0.251908 Sep 14 10:17:20.151779 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4134/7690] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:17:19 2022] GET /compute/v2.1/servers/2b284d4d-d0ed-4d48-901c-d16a9e4505b1 => generated 1567 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 10:17:21.177864 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-be711f9c-5825-4cd1-8dbe-6757199c9738 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:17:21.178605 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-be711f9c-5825-4cd1-8dbe-6757199c9738 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] [instance: 2b284d4d-d0ed-4d48-901c-d16a9e4505b1] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:17:21.192582 n-d-836830-18 devstack@n-api.service[128758]: INFO oslo.messaging._drivers.impl_rabbit [-] [57e2b41d-7c54-48cb-b191-b7f77db67cfb] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 53702. Sep 14 10:17:21.194234 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-be711f9c-5825-4cd1-8dbe-6757199c9738 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:21.194734 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-be711f9c-5825-4cd1-8dbe-6757199c9738 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:21.195231 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-be711f9c-5825-4cd1-8dbe-6757199c9738 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:21.195945 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-be711f9c-5825-4cd1-8dbe-6757199c9738 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:21.196445 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-be711f9c-5825-4cd1-8dbe-6757199c9738 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:21.196899 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-be711f9c-5825-4cd1-8dbe-6757199c9738 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:21.203374 n-d-836830-18 devstack@n-api.service[128758]: INFO oslo.messaging._drivers.impl_rabbit [-] [33d7e4a6-539b-476c-bc18-5478ca3a22f4] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 53704. Sep 14 10:17:21.329839 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-be711f9c-5825-4cd1-8dbe-6757199c9738 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a5cf8e45d46ca96e7d9378d1d59c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afca8f753d4a47249a0636dcde826313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:17:21.338354 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-be711f9c-5825-4cd1-8dbe-6757199c9738 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] 10.222.0.60 "GET /compute/v2.1/servers/2b284d4d-d0ed-4d48-901c-d16a9e4505b1" status: 200 len: 1567 microversion: 2.1 time: 0.166471 Sep 14 10:17:21.338960 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3557/7691] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:17:21 2022] GET /compute/v2.1/servers/2b284d4d-d0ed-4d48-901c-d16a9e4505b1 => generated 1567 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:17:22.362661 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9634da9e-e84c-436c-9ef3-cc551d3c22e5 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:17:22.363323 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-9634da9e-e84c-436c-9ef3-cc551d3c22e5 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] [instance: 2b284d4d-d0ed-4d48-901c-d16a9e4505b1] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:17:22.375184 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9634da9e-e84c-436c-9ef3-cc551d3c22e5 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:22.375671 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9634da9e-e84c-436c-9ef3-cc551d3c22e5 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:22.376108 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9634da9e-e84c-436c-9ef3-cc551d3c22e5 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:22.376805 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9634da9e-e84c-436c-9ef3-cc551d3c22e5 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:22.377261 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9634da9e-e84c-436c-9ef3-cc551d3c22e5 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:22.377681 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9634da9e-e84c-436c-9ef3-cc551d3c22e5 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:22.378296 n-d-836830-18 devstack@n-api.service[128759]: INFO oslo.messaging._drivers.impl_rabbit [-] [22ef38d2-af78-43f4-be77-ac372bc70aea] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 53708. Sep 14 10:17:22.379062 n-d-836830-18 devstack@n-api.service[128759]: INFO oslo.messaging._drivers.impl_rabbit [-] [fe2cf8e3-40e5-4586-b96b-b3e5ef0901e5] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 53710. Sep 14 10:17:22.514269 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-9634da9e-e84c-436c-9ef3-cc551d3c22e5 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a5cf8e45d46ca96e7d9378d1d59c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afca8f753d4a47249a0636dcde826313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:17:22.522714 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-9634da9e-e84c-436c-9ef3-cc551d3c22e5 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] 10.222.0.60 "GET /compute/v2.1/servers/2b284d4d-d0ed-4d48-901c-d16a9e4505b1" status: 200 len: 1567 microversion: 2.1 time: 0.164988 Sep 14 10:17:22.523324 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4135/7692] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:17:22 2022] GET /compute/v2.1/servers/2b284d4d-d0ed-4d48-901c-d16a9e4505b1 => generated 1567 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:17:23.545712 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-367a2360-06c5-47d3-bd58-ed9404c83ac0 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:17:23.546352 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-367a2360-06c5-47d3-bd58-ed9404c83ac0 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] [instance: 2b284d4d-d0ed-4d48-901c-d16a9e4505b1] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:17:23.554066 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-367a2360-06c5-47d3-bd58-ed9404c83ac0 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:23.554575 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-367a2360-06c5-47d3-bd58-ed9404c83ac0 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:23.555057 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-367a2360-06c5-47d3-bd58-ed9404c83ac0 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:23.555782 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-367a2360-06c5-47d3-bd58-ed9404c83ac0 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:23.556259 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-367a2360-06c5-47d3-bd58-ed9404c83ac0 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:23.556709 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-367a2360-06c5-47d3-bd58-ed9404c83ac0 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:23.688053 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-367a2360-06c5-47d3-bd58-ed9404c83ac0 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a5cf8e45d46ca96e7d9378d1d59c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afca8f753d4a47249a0636dcde826313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:17:23.696136 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-367a2360-06c5-47d3-bd58-ed9404c83ac0 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] 10.222.0.60 "GET /compute/v2.1/servers/2b284d4d-d0ed-4d48-901c-d16a9e4505b1" status: 200 len: 1567 microversion: 2.1 time: 0.154341 Sep 14 10:17:23.696719 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3558/7693] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:17:23 2022] GET /compute/v2.1/servers/2b284d4d-d0ed-4d48-901c-d16a9e4505b1 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:17:24.719633 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9ce1f2d9-8f1b-46f8-b457-34fb9251b14f tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:17:24.720261 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-9ce1f2d9-8f1b-46f8-b457-34fb9251b14f tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] [instance: 2b284d4d-d0ed-4d48-901c-d16a9e4505b1] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:17:24.727208 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9ce1f2d9-8f1b-46f8-b457-34fb9251b14f tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:24.727706 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9ce1f2d9-8f1b-46f8-b457-34fb9251b14f tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:24.728154 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9ce1f2d9-8f1b-46f8-b457-34fb9251b14f tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:24.728840 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9ce1f2d9-8f1b-46f8-b457-34fb9251b14f tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:24.729296 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9ce1f2d9-8f1b-46f8-b457-34fb9251b14f tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:24.729725 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9ce1f2d9-8f1b-46f8-b457-34fb9251b14f tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:24.874498 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-9ce1f2d9-8f1b-46f8-b457-34fb9251b14f tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a5cf8e45d46ca96e7d9378d1d59c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afca8f753d4a47249a0636dcde826313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:17:24.883624 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-9ce1f2d9-8f1b-46f8-b457-34fb9251b14f tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] 10.222.0.60 "GET /compute/v2.1/servers/2b284d4d-d0ed-4d48-901c-d16a9e4505b1" status: 200 len: 1567 microversion: 2.1 time: 0.167929 Sep 14 10:17:24.884169 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4136/7694] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:17:24 2022] GET /compute/v2.1/servers/2b284d4d-d0ed-4d48-901c-d16a9e4505b1 => generated 1567 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:17:25.907346 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1a654ba7-e0da-4f3f-80cf-1b9f6062a9f5 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:17:25.908009 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-1a654ba7-e0da-4f3f-80cf-1b9f6062a9f5 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] [instance: 2b284d4d-d0ed-4d48-901c-d16a9e4505b1] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:17:25.915450 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1a654ba7-e0da-4f3f-80cf-1b9f6062a9f5 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:25.915950 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1a654ba7-e0da-4f3f-80cf-1b9f6062a9f5 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:25.916399 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1a654ba7-e0da-4f3f-80cf-1b9f6062a9f5 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:25.917101 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1a654ba7-e0da-4f3f-80cf-1b9f6062a9f5 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:25.917572 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1a654ba7-e0da-4f3f-80cf-1b9f6062a9f5 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:25.918015 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1a654ba7-e0da-4f3f-80cf-1b9f6062a9f5 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:26.050789 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-1a654ba7-e0da-4f3f-80cf-1b9f6062a9f5 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a5cf8e45d46ca96e7d9378d1d59c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afca8f753d4a47249a0636dcde826313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:17:26.058810 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-1a654ba7-e0da-4f3f-80cf-1b9f6062a9f5 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] 10.222.0.60 "GET /compute/v2.1/servers/2b284d4d-d0ed-4d48-901c-d16a9e4505b1" status: 200 len: 1567 microversion: 2.1 time: 0.155357 Sep 14 10:17:26.059416 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3559/7695] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:17:25 2022] GET /compute/v2.1/servers/2b284d4d-d0ed-4d48-901c-d16a9e4505b1 => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:17:27.082045 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ac17ac5e-4ed7-4948-ae29-96f1db5a28c3 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:17:27.082679 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-ac17ac5e-4ed7-4948-ae29-96f1db5a28c3 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] [instance: 2b284d4d-d0ed-4d48-901c-d16a9e4505b1] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:17:27.089719 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ac17ac5e-4ed7-4948-ae29-96f1db5a28c3 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:27.090206 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ac17ac5e-4ed7-4948-ae29-96f1db5a28c3 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:27.090645 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ac17ac5e-4ed7-4948-ae29-96f1db5a28c3 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:27.091364 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ac17ac5e-4ed7-4948-ae29-96f1db5a28c3 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:27.091818 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ac17ac5e-4ed7-4948-ae29-96f1db5a28c3 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:27.092243 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ac17ac5e-4ed7-4948-ae29-96f1db5a28c3 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:27.230985 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-ac17ac5e-4ed7-4948-ae29-96f1db5a28c3 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a5cf8e45d46ca96e7d9378d1d59c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afca8f753d4a47249a0636dcde826313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:17:27.240488 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-ac17ac5e-4ed7-4948-ae29-96f1db5a28c3 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] 10.222.0.60 "GET /compute/v2.1/servers/2b284d4d-d0ed-4d48-901c-d16a9e4505b1" status: 200 len: 1567 microversion: 2.1 time: 0.162345 Sep 14 10:17:27.241070 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4137/7696] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:17:27 2022] GET /compute/v2.1/servers/2b284d4d-d0ed-4d48-901c-d16a9e4505b1 => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:17:28.264304 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1f3f65b1-36a4-4e1c-90dd-d4381bd5d0b9 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:17:28.264934 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-1f3f65b1-36a4-4e1c-90dd-d4381bd5d0b9 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] [instance: 2b284d4d-d0ed-4d48-901c-d16a9e4505b1] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:17:28.272384 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1f3f65b1-36a4-4e1c-90dd-d4381bd5d0b9 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:28.272879 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1f3f65b1-36a4-4e1c-90dd-d4381bd5d0b9 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:28.273327 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1f3f65b1-36a4-4e1c-90dd-d4381bd5d0b9 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:28.274123 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1f3f65b1-36a4-4e1c-90dd-d4381bd5d0b9 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:28.274592 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1f3f65b1-36a4-4e1c-90dd-d4381bd5d0b9 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:28.275117 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1f3f65b1-36a4-4e1c-90dd-d4381bd5d0b9 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:28.409404 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-1f3f65b1-36a4-4e1c-90dd-d4381bd5d0b9 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a5cf8e45d46ca96e7d9378d1d59c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afca8f753d4a47249a0636dcde826313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:17:28.417877 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-1f3f65b1-36a4-4e1c-90dd-d4381bd5d0b9 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] 10.222.0.60 "GET /compute/v2.1/servers/2b284d4d-d0ed-4d48-901c-d16a9e4505b1" status: 200 len: 1567 microversion: 2.1 time: 0.157464 Sep 14 10:17:28.418465 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3560/7697] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:17:28 2022] GET /compute/v2.1/servers/2b284d4d-d0ed-4d48-901c-d16a9e4505b1 => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:17:29.442726 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-916660f2-5ce7-4b79-8958-b75b0efff164 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:17:29.443387 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-916660f2-5ce7-4b79-8958-b75b0efff164 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] [instance: 2b284d4d-d0ed-4d48-901c-d16a9e4505b1] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:17:29.450252 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-916660f2-5ce7-4b79-8958-b75b0efff164 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:29.450745 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-916660f2-5ce7-4b79-8958-b75b0efff164 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:29.451218 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-916660f2-5ce7-4b79-8958-b75b0efff164 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:29.451919 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-916660f2-5ce7-4b79-8958-b75b0efff164 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:29.452377 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-916660f2-5ce7-4b79-8958-b75b0efff164 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:29.452807 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-916660f2-5ce7-4b79-8958-b75b0efff164 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:29.583381 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-916660f2-5ce7-4b79-8958-b75b0efff164 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a5cf8e45d46ca96e7d9378d1d59c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afca8f753d4a47249a0636dcde826313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:17:29.591167 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-916660f2-5ce7-4b79-8958-b75b0efff164 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] 10.222.0.60 "GET /compute/v2.1/servers/2b284d4d-d0ed-4d48-901c-d16a9e4505b1" status: 200 len: 1567 microversion: 2.1 time: 0.152475 Sep 14 10:17:29.591743 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4138/7698] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:17:29 2022] GET /compute/v2.1/servers/2b284d4d-d0ed-4d48-901c-d16a9e4505b1 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:17:30.617771 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b9dfceec-0364-4f11-9c58-99b123f5d920 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:17:30.619752 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-b9dfceec-0364-4f11-9c58-99b123f5d920 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] [instance: 2b284d4d-d0ed-4d48-901c-d16a9e4505b1] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:17:30.627474 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b9dfceec-0364-4f11-9c58-99b123f5d920 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:30.628407 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b9dfceec-0364-4f11-9c58-99b123f5d920 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:30.628967 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b9dfceec-0364-4f11-9c58-99b123f5d920 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:30.630209 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b9dfceec-0364-4f11-9c58-99b123f5d920 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:30.631036 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b9dfceec-0364-4f11-9c58-99b123f5d920 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:30.631149 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b9dfceec-0364-4f11-9c58-99b123f5d920 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:30.775119 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-b9dfceec-0364-4f11-9c58-99b123f5d920 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a5cf8e45d46ca96e7d9378d1d59c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afca8f753d4a47249a0636dcde826313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:17:30.782986 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-b9dfceec-0364-4f11-9c58-99b123f5d920 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] 10.222.0.60 "GET /compute/v2.1/servers/2b284d4d-d0ed-4d48-901c-d16a9e4505b1" status: 200 len: 1567 microversion: 2.1 time: 0.170236 Sep 14 10:17:30.783565 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3561/7699] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:17:30 2022] GET /compute/v2.1/servers/2b284d4d-d0ed-4d48-901c-d16a9e4505b1 => generated 1567 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:17:31.806642 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c45bda83-fef7-4aec-a0d1-e0cac319a292 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:17:31.807219 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-c45bda83-fef7-4aec-a0d1-e0cac319a292 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] [instance: 2b284d4d-d0ed-4d48-901c-d16a9e4505b1] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:17:31.814174 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c45bda83-fef7-4aec-a0d1-e0cac319a292 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:31.814697 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c45bda83-fef7-4aec-a0d1-e0cac319a292 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:31.815184 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c45bda83-fef7-4aec-a0d1-e0cac319a292 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:31.815915 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c45bda83-fef7-4aec-a0d1-e0cac319a292 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:31.816342 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c45bda83-fef7-4aec-a0d1-e0cac319a292 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:31.817289 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c45bda83-fef7-4aec-a0d1-e0cac319a292 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:31.948387 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-c45bda83-fef7-4aec-a0d1-e0cac319a292 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a5cf8e45d46ca96e7d9378d1d59c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afca8f753d4a47249a0636dcde826313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:17:31.956206 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-c45bda83-fef7-4aec-a0d1-e0cac319a292 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] 10.222.0.60 "GET /compute/v2.1/servers/2b284d4d-d0ed-4d48-901c-d16a9e4505b1" status: 200 len: 1567 microversion: 2.1 time: 0.153578 Sep 14 10:17:31.956784 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4139/7700] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:17:31 2022] GET /compute/v2.1/servers/2b284d4d-d0ed-4d48-901c-d16a9e4505b1 => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:17:32.979314 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-89efa4bf-65fa-4ccf-a1f3-9f54beb84fe2 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:17:32.979957 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-89efa4bf-65fa-4ccf-a1f3-9f54beb84fe2 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] [instance: 2b284d4d-d0ed-4d48-901c-d16a9e4505b1] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:17:32.987402 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-89efa4bf-65fa-4ccf-a1f3-9f54beb84fe2 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:32.987914 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-89efa4bf-65fa-4ccf-a1f3-9f54beb84fe2 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:32.988885 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-89efa4bf-65fa-4ccf-a1f3-9f54beb84fe2 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:32.989621 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-89efa4bf-65fa-4ccf-a1f3-9f54beb84fe2 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:32.990098 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-89efa4bf-65fa-4ccf-a1f3-9f54beb84fe2 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:32.990543 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-89efa4bf-65fa-4ccf-a1f3-9f54beb84fe2 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:33.123396 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-89efa4bf-65fa-4ccf-a1f3-9f54beb84fe2 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a5cf8e45d46ca96e7d9378d1d59c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afca8f753d4a47249a0636dcde826313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:17:33.131397 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-89efa4bf-65fa-4ccf-a1f3-9f54beb84fe2 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] 10.222.0.60 "GET /compute/v2.1/servers/2b284d4d-d0ed-4d48-901c-d16a9e4505b1" status: 200 len: 1567 microversion: 2.1 time: 0.156024 Sep 14 10:17:33.132042 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3562/7701] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:17:32 2022] GET /compute/v2.1/servers/2b284d4d-d0ed-4d48-901c-d16a9e4505b1 => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:17:34.153656 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f9cd73a8-f2fd-4375-af92-8a4f8c89fd58 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:17:34.154287 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f9cd73a8-f2fd-4375-af92-8a4f8c89fd58 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] [instance: 2b284d4d-d0ed-4d48-901c-d16a9e4505b1] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:17:34.161241 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f9cd73a8-f2fd-4375-af92-8a4f8c89fd58 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:34.161734 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f9cd73a8-f2fd-4375-af92-8a4f8c89fd58 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:34.162182 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f9cd73a8-f2fd-4375-af92-8a4f8c89fd58 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:34.162881 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f9cd73a8-f2fd-4375-af92-8a4f8c89fd58 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:34.163372 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f9cd73a8-f2fd-4375-af92-8a4f8c89fd58 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:34.163807 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f9cd73a8-f2fd-4375-af92-8a4f8c89fd58 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:34.303879 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-f9cd73a8-f2fd-4375-af92-8a4f8c89fd58 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a5cf8e45d46ca96e7d9378d1d59c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afca8f753d4a47249a0636dcde826313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:17:34.311786 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f9cd73a8-f2fd-4375-af92-8a4f8c89fd58 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] 10.222.0.60 "GET /compute/v2.1/servers/2b284d4d-d0ed-4d48-901c-d16a9e4505b1" status: 200 len: 1568 microversion: 2.1 time: 0.162110 Sep 14 10:17:34.312366 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4140/7702] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:17:34 2022] GET /compute/v2.1/servers/2b284d4d-d0ed-4d48-901c-d16a9e4505b1 => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:17:34.335206 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d80e3cdc-a9bf-4e89-a744-735b4c36926d tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:17:34.335821 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-d80e3cdc-a9bf-4e89-a744-735b4c36926d tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] [instance: 2b284d4d-d0ed-4d48-901c-d16a9e4505b1] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:17:34.342530 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d80e3cdc-a9bf-4e89-a744-735b4c36926d tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:34.343055 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d80e3cdc-a9bf-4e89-a744-735b4c36926d tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:34.343506 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d80e3cdc-a9bf-4e89-a744-735b4c36926d tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:34.344203 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d80e3cdc-a9bf-4e89-a744-735b4c36926d tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:34.344676 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d80e3cdc-a9bf-4e89-a744-735b4c36926d tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:34.345110 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d80e3cdc-a9bf-4e89-a744-735b4c36926d tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:34.373569 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-d80e3cdc-a9bf-4e89-a744-735b4c36926d tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] [instance: 2b284d4d-d0ed-4d48-901c-d16a9e4505b1] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128758) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 14 10:17:34.438856 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-d80e3cdc-a9bf-4e89-a744-735b4c36926d tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] 10.222.0.60 "POST /compute/v2.1/servers/2b284d4d-d0ed-4d48-901c-d16a9e4505b1/action" status: 202 len: 0 microversion: 2.1 time: 0.107460 Sep 14 10:17:34.439424 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3563/7703] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 10:17:34 2022] POST /compute/v2.1/servers/2b284d4d-d0ed-4d48-901c-d16a9e4505b1/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 10:17:34.448057 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-41a9584b-5840-4687-aa39-8d1da6406f19 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:17:34.448684 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-41a9584b-5840-4687-aa39-8d1da6406f19 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] [instance: 2b284d4d-d0ed-4d48-901c-d16a9e4505b1] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:17:34.454585 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-41a9584b-5840-4687-aa39-8d1da6406f19 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:34.455113 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-41a9584b-5840-4687-aa39-8d1da6406f19 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:34.455555 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-41a9584b-5840-4687-aa39-8d1da6406f19 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:34.456260 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-41a9584b-5840-4687-aa39-8d1da6406f19 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:34.456720 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-41a9584b-5840-4687-aa39-8d1da6406f19 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:34.457177 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-41a9584b-5840-4687-aa39-8d1da6406f19 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:34.612030 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-41a9584b-5840-4687-aa39-8d1da6406f19 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a5cf8e45d46ca96e7d9378d1d59c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afca8f753d4a47249a0636dcde826313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:17:34.619933 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-41a9584b-5840-4687-aa39-8d1da6406f19 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] 10.222.0.60 "GET /compute/v2.1/servers/2b284d4d-d0ed-4d48-901c-d16a9e4505b1" status: 200 len: 1516 microversion: 2.1 time: 0.175758 Sep 14 10:17:34.620491 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4141/7704] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:17:34 2022] GET /compute/v2.1/servers/2b284d4d-d0ed-4d48-901c-d16a9e4505b1 => generated 1516 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 10:17:35.166162 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-47c17e86-bc71-4c9e-80d2-e0e1a075e64f req-df540103-dbb3-414a-b37d-aa9fe6d58ef7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b284d4d-d0ed-4d48-901c-d16a9e4505b1", "name": "network-vif-unplugged", "status": "completed", "tag": "4ffcbda4-b14b-4282-b836-779e39a881e2"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:17:35.178611 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-47c17e86-bc71-4c9e-80d2-e0e1a075e64f req-df540103-dbb3-414a-b37d-aa9fe6d58ef7 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:35.178756 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-47c17e86-bc71-4c9e-80d2-e0e1a075e64f req-df540103-dbb3-414a-b37d-aa9fe6d58ef7 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:35.179510 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-47c17e86-bc71-4c9e-80d2-e0e1a075e64f req-df540103-dbb3-414a-b37d-aa9fe6d58ef7 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:35.191445 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.compute.server_external_events [req-47c17e86-bc71-4c9e-80d2-e0e1a075e64f req-df540103-dbb3-414a-b37d-aa9fe6d58ef7 service nova] Unable to find a host for instance 2b284d4d-d0ed-4d48-901c-d16a9e4505b1. Dropping event network-vif-unplugged {{(pid=128758) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 14 10:17:35.192360 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-47c17e86-bc71-4c9e-80d2-e0e1a075e64f req-df540103-dbb3-414a-b37d-aa9fe6d58ef7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.030535 Sep 14 10:17:35.192960 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3564/7705] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 10:17:35 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 32 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 14 10:17:35.643292 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9e175da8-758f-41ac-bc15-fcf81d410abd tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:17:35.643929 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-9e175da8-758f-41ac-bc15-fcf81d410abd tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] [instance: 2b284d4d-d0ed-4d48-901c-d16a9e4505b1] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:17:35.651466 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9e175da8-758f-41ac-bc15-fcf81d410abd tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:35.651964 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9e175da8-758f-41ac-bc15-fcf81d410abd tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:35.652412 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9e175da8-758f-41ac-bc15-fcf81d410abd tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:35.653119 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9e175da8-758f-41ac-bc15-fcf81d410abd tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:35.653583 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9e175da8-758f-41ac-bc15-fcf81d410abd tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:35.654023 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9e175da8-758f-41ac-bc15-fcf81d410abd tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:35.792452 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-9e175da8-758f-41ac-bc15-fcf81d410abd tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a5cf8e45d46ca96e7d9378d1d59c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afca8f753d4a47249a0636dcde826313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:17:35.801426 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-9e175da8-758f-41ac-bc15-fcf81d410abd tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] 10.222.0.60 "GET /compute/v2.1/servers/2b284d4d-d0ed-4d48-901c-d16a9e4505b1" status: 200 len: 1518 microversion: 2.1 time: 0.161507 Sep 14 10:17:35.802023 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4142/7706] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:17:35 2022] GET /compute/v2.1/servers/2b284d4d-d0ed-4d48-901c-d16a9e4505b1 => generated 1518 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:17:36.827332 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-3e2dfb90-d1fe-40f4-a851-f2e6f91f1cb7 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:17:36.827885 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-3e2dfb90-d1fe-40f4-a851-f2e6f91f1cb7 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] [instance: 2b284d4d-d0ed-4d48-901c-d16a9e4505b1] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:17:36.835237 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3e2dfb90-d1fe-40f4-a851-f2e6f91f1cb7 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:36.835756 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3e2dfb90-d1fe-40f4-a851-f2e6f91f1cb7 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:36.836211 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3e2dfb90-d1fe-40f4-a851-f2e6f91f1cb7 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:36.836930 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3e2dfb90-d1fe-40f4-a851-f2e6f91f1cb7 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:36.837406 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3e2dfb90-d1fe-40f4-a851-f2e6f91f1cb7 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:36.837850 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-3e2dfb90-d1fe-40f4-a851-f2e6f91f1cb7 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:36.974419 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-3e2dfb90-d1fe-40f4-a851-f2e6f91f1cb7 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a5cf8e45d46ca96e7d9378d1d59c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afca8f753d4a47249a0636dcde826313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:17:36.983107 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-3e2dfb90-d1fe-40f4-a851-f2e6f91f1cb7 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] 10.222.0.60 "GET /compute/v2.1/servers/2b284d4d-d0ed-4d48-901c-d16a9e4505b1" status: 200 len: 1518 microversion: 2.1 time: 0.160773 Sep 14 10:17:36.983701 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3565/7707] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:17:36 2022] GET /compute/v2.1/servers/2b284d4d-d0ed-4d48-901c-d16a9e4505b1 => generated 1518 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:17:38.007980 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-5ef5085f-f27b-4604-a9c7-721c3033ba11 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:17:38.008620 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-5ef5085f-f27b-4604-a9c7-721c3033ba11 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] [instance: 2b284d4d-d0ed-4d48-901c-d16a9e4505b1] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:17:38.015816 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5ef5085f-f27b-4604-a9c7-721c3033ba11 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:38.016313 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5ef5085f-f27b-4604-a9c7-721c3033ba11 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:38.016759 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5ef5085f-f27b-4604-a9c7-721c3033ba11 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:38.017473 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5ef5085f-f27b-4604-a9c7-721c3033ba11 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:38.017930 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5ef5085f-f27b-4604-a9c7-721c3033ba11 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:38.018359 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5ef5085f-f27b-4604-a9c7-721c3033ba11 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:38.160814 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-5ef5085f-f27b-4604-a9c7-721c3033ba11 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a5cf8e45d46ca96e7d9378d1d59c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afca8f753d4a47249a0636dcde826313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:17:38.168883 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-5ef5085f-f27b-4604-a9c7-721c3033ba11 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] 10.222.0.60 "GET /compute/v2.1/servers/2b284d4d-d0ed-4d48-901c-d16a9e4505b1" status: 200 len: 1518 microversion: 2.1 time: 0.164878 Sep 14 10:17:38.169471 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4143/7708] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:17:38 2022] GET /compute/v2.1/servers/2b284d4d-d0ed-4d48-901c-d16a9e4505b1 => generated 1518 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:17:39.193342 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-9349c743-d257-4e37-a578-1ecacde3ded8 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:17:39.193887 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-9349c743-d257-4e37-a578-1ecacde3ded8 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] [instance: 2b284d4d-d0ed-4d48-901c-d16a9e4505b1] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:17:39.201017 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9349c743-d257-4e37-a578-1ecacde3ded8 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:39.201521 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9349c743-d257-4e37-a578-1ecacde3ded8 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:39.201972 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9349c743-d257-4e37-a578-1ecacde3ded8 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:39.202684 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9349c743-d257-4e37-a578-1ecacde3ded8 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:39.203193 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9349c743-d257-4e37-a578-1ecacde3ded8 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:39.203633 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9349c743-d257-4e37-a578-1ecacde3ded8 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:39.334273 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-9349c743-d257-4e37-a578-1ecacde3ded8 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a5cf8e45d46ca96e7d9378d1d59c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afca8f753d4a47249a0636dcde826313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:17:39.342500 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-9349c743-d257-4e37-a578-1ecacde3ded8 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] 10.222.0.60 "GET /compute/v2.1/servers/2b284d4d-d0ed-4d48-901c-d16a9e4505b1" status: 200 len: 1518 microversion: 2.1 time: 0.153328 Sep 14 10:17:39.343127 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3566/7709] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:17:39 2022] GET /compute/v2.1/servers/2b284d4d-d0ed-4d48-901c-d16a9e4505b1 => generated 1518 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:17:40.366057 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-0aada75a-d738-4ff7-9832-ef547d51c780 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:17:40.366689 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-0aada75a-d738-4ff7-9832-ef547d51c780 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] [instance: 2b284d4d-d0ed-4d48-901c-d16a9e4505b1] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:17:40.377280 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0aada75a-d738-4ff7-9832-ef547d51c780 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:40.377794 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0aada75a-d738-4ff7-9832-ef547d51c780 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:40.378243 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0aada75a-d738-4ff7-9832-ef547d51c780 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:40.379113 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0aada75a-d738-4ff7-9832-ef547d51c780 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:40.379990 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0aada75a-d738-4ff7-9832-ef547d51c780 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:40.380783 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0aada75a-d738-4ff7-9832-ef547d51c780 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:40.578515 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-0aada75a-d738-4ff7-9832-ef547d51c780 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a5cf8e45d46ca96e7d9378d1d59c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afca8f753d4a47249a0636dcde826313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:17:40.587099 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-0aada75a-d738-4ff7-9832-ef547d51c780 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] 10.222.0.60 "GET /compute/v2.1/servers/2b284d4d-d0ed-4d48-901c-d16a9e4505b1" status: 200 len: 1574 microversion: 2.1 time: 0.224975 Sep 14 10:17:40.587680 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4144/7710] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:17:40 2022] GET /compute/v2.1/servers/2b284d4d-d0ed-4d48-901c-d16a9e4505b1 => generated 1574 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:17:41.263892 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-eb86e4ee-8e3e-4e2f-8efe-130256ab1e72 req-76377566-9d73-4322-a340-38acbf251eae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b284d4d-d0ed-4d48-901c-d16a9e4505b1", "tag": "4ffcbda4-b14b-4282-b836-779e39a881e2"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:17:41.275504 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-eb86e4ee-8e3e-4e2f-8efe-130256ab1e72 req-76377566-9d73-4322-a340-38acbf251eae service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:41.276009 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-eb86e4ee-8e3e-4e2f-8efe-130256ab1e72 req-76377566-9d73-4322-a340-38acbf251eae service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:41.276465 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-eb86e4ee-8e3e-4e2f-8efe-130256ab1e72 req-76377566-9d73-4322-a340-38acbf251eae service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:41.288206 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-eb86e4ee-8e3e-4e2f-8efe-130256ab1e72 req-76377566-9d73-4322-a340-38acbf251eae service nova] Creating event network-changed:4ffcbda4-b14b-4282-b836-779e39a881e2 for instance 2b284d4d-d0ed-4d48-901c-d16a9e4505b1 on n-h1-836830-18 Sep 14 10:17:41.293707 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-eb86e4ee-8e3e-4e2f-8efe-130256ab1e72 req-76377566-9d73-4322-a340-38acbf251eae service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033746 Sep 14 10:17:41.294336 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3567/7711] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 10:17:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:17:41.610070 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-5dffcdf2-041f-4031-a139-aa2ef45aa2af tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:17:41.611081 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-5dffcdf2-041f-4031-a139-aa2ef45aa2af tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] [instance: 2b284d4d-d0ed-4d48-901c-d16a9e4505b1] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:17:41.618489 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5dffcdf2-041f-4031-a139-aa2ef45aa2af tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:41.619012 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5dffcdf2-041f-4031-a139-aa2ef45aa2af tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:41.619455 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5dffcdf2-041f-4031-a139-aa2ef45aa2af tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:41.620142 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5dffcdf2-041f-4031-a139-aa2ef45aa2af tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:41.620598 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5dffcdf2-041f-4031-a139-aa2ef45aa2af tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:41.621020 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-5dffcdf2-041f-4031-a139-aa2ef45aa2af tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:41.830791 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-5dffcdf2-041f-4031-a139-aa2ef45aa2af tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a5cf8e45d46ca96e7d9378d1d59c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afca8f753d4a47249a0636dcde826313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:17:41.839027 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-5dffcdf2-041f-4031-a139-aa2ef45aa2af tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] 10.222.0.60 "GET /compute/v2.1/servers/2b284d4d-d0ed-4d48-901c-d16a9e4505b1" status: 200 len: 1574 microversion: 2.1 time: 0.233213 Sep 14 10:17:41.839608 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4145/7712] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:17:41 2022] GET /compute/v2.1/servers/2b284d4d-d0ed-4d48-901c-d16a9e4505b1 => generated 1574 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:17:42.864697 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d1ce8ea3-fec9-493f-84e2-ef97415c7326 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:17:42.865433 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-d1ce8ea3-fec9-493f-84e2-ef97415c7326 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] [instance: 2b284d4d-d0ed-4d48-901c-d16a9e4505b1] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:17:42.871795 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d1ce8ea3-fec9-493f-84e2-ef97415c7326 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:42.872302 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d1ce8ea3-fec9-493f-84e2-ef97415c7326 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:42.872755 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d1ce8ea3-fec9-493f-84e2-ef97415c7326 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:42.873462 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d1ce8ea3-fec9-493f-84e2-ef97415c7326 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:42.873937 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d1ce8ea3-fec9-493f-84e2-ef97415c7326 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:42.874380 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d1ce8ea3-fec9-493f-84e2-ef97415c7326 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:43.065672 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-d1ce8ea3-fec9-493f-84e2-ef97415c7326 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a5cf8e45d46ca96e7d9378d1d59c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afca8f753d4a47249a0636dcde826313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:17:43.074205 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-d1ce8ea3-fec9-493f-84e2-ef97415c7326 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] 10.222.0.60 "GET /compute/v2.1/servers/2b284d4d-d0ed-4d48-901c-d16a9e4505b1" status: 200 len: 1574 microversion: 2.1 time: 0.214941 Sep 14 10:17:43.074884 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3568/7713] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:17:42 2022] GET /compute/v2.1/servers/2b284d4d-d0ed-4d48-901c-d16a9e4505b1 => generated 1574 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:17:44.098541 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-c9b09fa2-d716-4616-b2ec-3fc3168854ee tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:17:44.099201 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-c9b09fa2-d716-4616-b2ec-3fc3168854ee tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] [instance: 2b284d4d-d0ed-4d48-901c-d16a9e4505b1] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:17:44.106084 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c9b09fa2-d716-4616-b2ec-3fc3168854ee tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:44.106576 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c9b09fa2-d716-4616-b2ec-3fc3168854ee tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:44.107056 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c9b09fa2-d716-4616-b2ec-3fc3168854ee tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:44.107755 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c9b09fa2-d716-4616-b2ec-3fc3168854ee tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:44.108219 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c9b09fa2-d716-4616-b2ec-3fc3168854ee tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:44.108650 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-c9b09fa2-d716-4616-b2ec-3fc3168854ee tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:44.241587 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-c9b09fa2-d716-4616-b2ec-3fc3168854ee tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a5cf8e45d46ca96e7d9378d1d59c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afca8f753d4a47249a0636dcde826313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:17:44.249424 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-c9b09fa2-d716-4616-b2ec-3fc3168854ee tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] 10.222.0.60 "GET /compute/v2.1/servers/2b284d4d-d0ed-4d48-901c-d16a9e4505b1" status: 200 len: 1574 microversion: 2.1 time: 0.154885 Sep 14 10:17:44.250004 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4146/7714] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:17:44 2022] GET /compute/v2.1/servers/2b284d4d-d0ed-4d48-901c-d16a9e4505b1 => generated 1574 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:17:45.274416 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-5e3a2cf3-1dc7-4261-8884-96a6d23d3ab9 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:17:45.275412 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-5e3a2cf3-1dc7-4261-8884-96a6d23d3ab9 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] [instance: 2b284d4d-d0ed-4d48-901c-d16a9e4505b1] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:17:45.284430 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5e3a2cf3-1dc7-4261-8884-96a6d23d3ab9 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:45.284923 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5e3a2cf3-1dc7-4261-8884-96a6d23d3ab9 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:45.285369 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5e3a2cf3-1dc7-4261-8884-96a6d23d3ab9 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:45.286070 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5e3a2cf3-1dc7-4261-8884-96a6d23d3ab9 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:45.286563 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5e3a2cf3-1dc7-4261-8884-96a6d23d3ab9 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:45.288268 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-5e3a2cf3-1dc7-4261-8884-96a6d23d3ab9 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:45.417352 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-5e3a2cf3-1dc7-4261-8884-96a6d23d3ab9 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a5cf8e45d46ca96e7d9378d1d59c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afca8f753d4a47249a0636dcde826313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:17:45.425108 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-5e3a2cf3-1dc7-4261-8884-96a6d23d3ab9 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] 10.222.0.60 "GET /compute/v2.1/servers/2b284d4d-d0ed-4d48-901c-d16a9e4505b1" status: 200 len: 1574 microversion: 2.1 time: 0.155590 Sep 14 10:17:45.425681 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3569/7715] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:17:45 2022] GET /compute/v2.1/servers/2b284d4d-d0ed-4d48-901c-d16a9e4505b1 => generated 1574 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:17:46.449398 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-be92ec18-61cf-46c4-b647-6e3b3a36579d tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:17:46.450079 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-be92ec18-61cf-46c4-b647-6e3b3a36579d tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] [instance: 2b284d4d-d0ed-4d48-901c-d16a9e4505b1] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:17:46.456944 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-be92ec18-61cf-46c4-b647-6e3b3a36579d tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:46.457915 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-be92ec18-61cf-46c4-b647-6e3b3a36579d tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:46.458346 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-be92ec18-61cf-46c4-b647-6e3b3a36579d tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:46.459067 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-be92ec18-61cf-46c4-b647-6e3b3a36579d tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:46.459520 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-be92ec18-61cf-46c4-b647-6e3b3a36579d tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:46.459942 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-be92ec18-61cf-46c4-b647-6e3b3a36579d tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:46.593788 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-be92ec18-61cf-46c4-b647-6e3b3a36579d tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a5cf8e45d46ca96e7d9378d1d59c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afca8f753d4a47249a0636dcde826313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:17:46.601663 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-be92ec18-61cf-46c4-b647-6e3b3a36579d tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] 10.222.0.60 "GET /compute/v2.1/servers/2b284d4d-d0ed-4d48-901c-d16a9e4505b1" status: 200 len: 1574 microversion: 2.1 time: 0.156467 Sep 14 10:17:46.602243 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4147/7716] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:17:46 2022] GET /compute/v2.1/servers/2b284d4d-d0ed-4d48-901c-d16a9e4505b1 => generated 1574 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:17:47.625011 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-20964f3a-4a1d-42b7-be88-3fa11807b690 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:17:47.625640 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-20964f3a-4a1d-42b7-be88-3fa11807b690 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] [instance: 2b284d4d-d0ed-4d48-901c-d16a9e4505b1] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:17:47.633055 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-20964f3a-4a1d-42b7-be88-3fa11807b690 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:47.633553 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-20964f3a-4a1d-42b7-be88-3fa11807b690 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:47.634008 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-20964f3a-4a1d-42b7-be88-3fa11807b690 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:47.634712 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-20964f3a-4a1d-42b7-be88-3fa11807b690 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:47.635210 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-20964f3a-4a1d-42b7-be88-3fa11807b690 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:47.635653 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-20964f3a-4a1d-42b7-be88-3fa11807b690 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:47.764700 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-20964f3a-4a1d-42b7-be88-3fa11807b690 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a5cf8e45d46ca96e7d9378d1d59c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afca8f753d4a47249a0636dcde826313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:17:47.768439 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:17:47.774055 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-20964f3a-4a1d-42b7-be88-3fa11807b690 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] 10.222.0.60 "GET /compute/v2.1/servers/2b284d4d-d0ed-4d48-901c-d16a9e4505b1" status: 200 len: 1574 microversion: 2.1 time: 0.152983 Sep 14 10:17:47.774676 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3570/7717] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:17:47 2022] GET /compute/v2.1/servers/2b284d4d-d0ed-4d48-901c-d16a9e4505b1 => generated 1574 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 10:17:48.797207 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-bb110891-3502-4035-b7ce-1f4be103b21c tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:17:48.797831 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-bb110891-3502-4035-b7ce-1f4be103b21c tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] [instance: 2b284d4d-d0ed-4d48-901c-d16a9e4505b1] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:17:48.804973 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bb110891-3502-4035-b7ce-1f4be103b21c tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:48.805466 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bb110891-3502-4035-b7ce-1f4be103b21c tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:48.805912 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bb110891-3502-4035-b7ce-1f4be103b21c tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:48.806609 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bb110891-3502-4035-b7ce-1f4be103b21c tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:48.807117 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bb110891-3502-4035-b7ce-1f4be103b21c tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:48.807551 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-bb110891-3502-4035-b7ce-1f4be103b21c tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:48.942498 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-bb110891-3502-4035-b7ce-1f4be103b21c tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a5cf8e45d46ca96e7d9378d1d59c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afca8f753d4a47249a0636dcde826313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:17:48.950375 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-bb110891-3502-4035-b7ce-1f4be103b21c tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] 10.222.0.60 "GET /compute/v2.1/servers/2b284d4d-d0ed-4d48-901c-d16a9e4505b1" status: 200 len: 1574 microversion: 2.1 time: 0.157221 Sep 14 10:17:48.951183 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4148/7718] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:17:48 2022] GET /compute/v2.1/servers/2b284d4d-d0ed-4d48-901c-d16a9e4505b1 => generated 1574 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:17:49.973760 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-99d8b950-f4ed-4e25-9862-d1d986a41ebe tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:17:49.974399 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-99d8b950-f4ed-4e25-9862-d1d986a41ebe tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] [instance: 2b284d4d-d0ed-4d48-901c-d16a9e4505b1] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:17:49.977773 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:17:49.984106 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-99d8b950-f4ed-4e25-9862-d1d986a41ebe tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:49.984615 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-99d8b950-f4ed-4e25-9862-d1d986a41ebe tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:49.985073 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-99d8b950-f4ed-4e25-9862-d1d986a41ebe tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:49.986044 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-99d8b950-f4ed-4e25-9862-d1d986a41ebe tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:49.986517 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-99d8b950-f4ed-4e25-9862-d1d986a41ebe tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:49.987017 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-99d8b950-f4ed-4e25-9862-d1d986a41ebe tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:50.121432 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-99d8b950-f4ed-4e25-9862-d1d986a41ebe tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a5cf8e45d46ca96e7d9378d1d59c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afca8f753d4a47249a0636dcde826313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:17:50.129330 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-99d8b950-f4ed-4e25-9862-d1d986a41ebe tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] 10.222.0.60 "GET /compute/v2.1/servers/2b284d4d-d0ed-4d48-901c-d16a9e4505b1" status: 200 len: 1574 microversion: 2.1 time: 0.159530 Sep 14 10:17:50.129883 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3571/7719] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:17:49 2022] GET /compute/v2.1/servers/2b284d4d-d0ed-4d48-901c-d16a9e4505b1 => generated 1574 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:17:51.153276 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-021e0134-c6fa-42d6-b99d-80eae2357631 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:17:51.154012 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-021e0134-c6fa-42d6-b99d-80eae2357631 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] [instance: 2b284d4d-d0ed-4d48-901c-d16a9e4505b1] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:17:51.156859 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=31 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:17:51.162852 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-021e0134-c6fa-42d6-b99d-80eae2357631 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:51.163219 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-021e0134-c6fa-42d6-b99d-80eae2357631 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:51.163715 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-021e0134-c6fa-42d6-b99d-80eae2357631 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:51.164424 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-021e0134-c6fa-42d6-b99d-80eae2357631 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:51.164880 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-021e0134-c6fa-42d6-b99d-80eae2357631 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:51.165362 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-021e0134-c6fa-42d6-b99d-80eae2357631 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:51.168378 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=91 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:17:51.301400 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-021e0134-c6fa-42d6-b99d-80eae2357631 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a5cf8e45d46ca96e7d9378d1d59c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afca8f753d4a47249a0636dcde826313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:17:51.310435 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-021e0134-c6fa-42d6-b99d-80eae2357631 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] 10.222.0.60 "GET /compute/v2.1/servers/2b284d4d-d0ed-4d48-901c-d16a9e4505b1" status: 200 len: 1574 microversion: 2.1 time: 0.161197 Sep 14 10:17:51.311589 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4149/7720] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:17:51 2022] GET /compute/v2.1/servers/2b284d4d-d0ed-4d48-901c-d16a9e4505b1 => generated 1574 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:17:52.334376 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d5824ad0-52c4-4b0b-980b-c94fb0062dc9 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:17:52.335052 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-d5824ad0-52c4-4b0b-980b-c94fb0062dc9 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] [instance: 2b284d4d-d0ed-4d48-901c-d16a9e4505b1] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:17:52.341506 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d5824ad0-52c4-4b0b-980b-c94fb0062dc9 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:52.342014 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d5824ad0-52c4-4b0b-980b-c94fb0062dc9 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:52.342468 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d5824ad0-52c4-4b0b-980b-c94fb0062dc9 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:52.343213 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d5824ad0-52c4-4b0b-980b-c94fb0062dc9 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:52.343688 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d5824ad0-52c4-4b0b-980b-c94fb0062dc9 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:52.344131 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d5824ad0-52c4-4b0b-980b-c94fb0062dc9 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:52.480695 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-d5824ad0-52c4-4b0b-980b-c94fb0062dc9 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a5cf8e45d46ca96e7d9378d1d59c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afca8f753d4a47249a0636dcde826313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:17:52.489533 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-d5824ad0-52c4-4b0b-980b-c94fb0062dc9 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] 10.222.0.60 "GET /compute/v2.1/servers/2b284d4d-d0ed-4d48-901c-d16a9e4505b1" status: 200 len: 1574 microversion: 2.1 time: 0.159163 Sep 14 10:17:52.490163 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3572/7721] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:17:52 2022] GET /compute/v2.1/servers/2b284d4d-d0ed-4d48-901c-d16a9e4505b1 => generated 1574 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:17:53.224026 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-f091bb4a-2088-4f33-a750-837e6e142b7c req-b4c966bf-e82d-476b-8a17-37ff3784ee3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b284d4d-d0ed-4d48-901c-d16a9e4505b1", "name": "network-vif-plugged", "status": "completed", "tag": "4ffcbda4-b14b-4282-b836-779e39a881e2"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:17:53.234766 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-f091bb4a-2088-4f33-a750-837e6e142b7c req-b4c966bf-e82d-476b-8a17-37ff3784ee3c service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:53.236123 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-f091bb4a-2088-4f33-a750-837e6e142b7c req-b4c966bf-e82d-476b-8a17-37ff3784ee3c service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:53.236582 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-f091bb4a-2088-4f33-a750-837e6e142b7c req-b4c966bf-e82d-476b-8a17-37ff3784ee3c service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:53.248558 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-f091bb4a-2088-4f33-a750-837e6e142b7c req-b4c966bf-e82d-476b-8a17-37ff3784ee3c service nova] Creating event network-vif-plugged:4ffcbda4-b14b-4282-b836-779e39a881e2 for instance 2b284d4d-d0ed-4d48-901c-d16a9e4505b1 on n-h1-836830-18 Sep 14 10:17:53.253710 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-f091bb4a-2088-4f33-a750-837e6e142b7c req-b4c966bf-e82d-476b-8a17-37ff3784ee3c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033761 Sep 14 10:17:53.255176 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4150/7722] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 10:17:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:17:53.513244 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-9e7635c6-dead-4b15-a678-df2c6dba76aa tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:17:53.514085 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-9e7635c6-dead-4b15-a678-df2c6dba76aa tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] [instance: 2b284d4d-d0ed-4d48-901c-d16a9e4505b1] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:17:53.520900 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9e7635c6-dead-4b15-a678-df2c6dba76aa tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:53.521403 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9e7635c6-dead-4b15-a678-df2c6dba76aa tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:53.521851 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9e7635c6-dead-4b15-a678-df2c6dba76aa tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:53.522562 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9e7635c6-dead-4b15-a678-df2c6dba76aa tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:53.523091 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9e7635c6-dead-4b15-a678-df2c6dba76aa tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:53.523530 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-9e7635c6-dead-4b15-a678-df2c6dba76aa tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:53.659877 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-9e7635c6-dead-4b15-a678-df2c6dba76aa tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a5cf8e45d46ca96e7d9378d1d59c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afca8f753d4a47249a0636dcde826313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:17:53.668274 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-9e7635c6-dead-4b15-a678-df2c6dba76aa tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] 10.222.0.60 "GET /compute/v2.1/servers/2b284d4d-d0ed-4d48-901c-d16a9e4505b1" status: 200 len: 1574 microversion: 2.1 time: 0.159027 Sep 14 10:17:53.668793 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3573/7723] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:17:53 2022] GET /compute/v2.1/servers/2b284d4d-d0ed-4d48-901c-d16a9e4505b1 => generated 1574 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:17:54.692350 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-03436b4f-0cfc-448a-9ee3-f252506229fa tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:17:54.693071 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-03436b4f-0cfc-448a-9ee3-f252506229fa tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] [instance: 2b284d4d-d0ed-4d48-901c-d16a9e4505b1] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:17:54.700264 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-03436b4f-0cfc-448a-9ee3-f252506229fa tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:54.700757 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-03436b4f-0cfc-448a-9ee3-f252506229fa tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:54.701203 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-03436b4f-0cfc-448a-9ee3-f252506229fa tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:54.701894 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-03436b4f-0cfc-448a-9ee3-f252506229fa tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:54.702358 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-03436b4f-0cfc-448a-9ee3-f252506229fa tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:54.702786 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-03436b4f-0cfc-448a-9ee3-f252506229fa tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:54.843514 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-03436b4f-0cfc-448a-9ee3-f252506229fa tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a5cf8e45d46ca96e7d9378d1d59c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afca8f753d4a47249a0636dcde826313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:17:54.852851 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-03436b4f-0cfc-448a-9ee3-f252506229fa tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] 10.222.0.60 "GET /compute/v2.1/servers/2b284d4d-d0ed-4d48-901c-d16a9e4505b1" status: 200 len: 1574 microversion: 2.1 time: 0.165329 Sep 14 10:17:54.853600 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4151/7724] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:17:54 2022] GET /compute/v2.1/servers/2b284d4d-d0ed-4d48-901c-d16a9e4505b1 => generated 1574 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:17:55.877128 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-dcecd4c1-b600-446f-b1fb-2357d2400a63 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:17:55.877768 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-dcecd4c1-b600-446f-b1fb-2357d2400a63 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] [instance: 2b284d4d-d0ed-4d48-901c-d16a9e4505b1] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:17:55.884739 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dcecd4c1-b600-446f-b1fb-2357d2400a63 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:55.885251 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dcecd4c1-b600-446f-b1fb-2357d2400a63 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:55.885707 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dcecd4c1-b600-446f-b1fb-2357d2400a63 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:55.886418 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dcecd4c1-b600-446f-b1fb-2357d2400a63 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:55.886896 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dcecd4c1-b600-446f-b1fb-2357d2400a63 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:55.887367 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-dcecd4c1-b600-446f-b1fb-2357d2400a63 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:56.026128 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-dcecd4c1-b600-446f-b1fb-2357d2400a63 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a5cf8e45d46ca96e7d9378d1d59c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afca8f753d4a47249a0636dcde826313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:17:56.034168 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-dcecd4c1-b600-446f-b1fb-2357d2400a63 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] 10.222.0.60 "GET /compute/v2.1/servers/2b284d4d-d0ed-4d48-901c-d16a9e4505b1" status: 200 len: 1561 microversion: 2.1 time: 0.161066 Sep 14 10:17:56.034746 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3574/7725] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:17:55 2022] GET /compute/v2.1/servers/2b284d4d-d0ed-4d48-901c-d16a9e4505b1 => generated 1561 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:19:12.437496 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=5 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:19:12.440087 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=7 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:19:12.440851 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=24 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:19:12.442225 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=13 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:19:12.443567 n-d-836830-18 devstack@n-api.service[128759]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 10:19:12.445875 n-d-836830-18 devstack@n-api.service[128759]: Wed Sep 14 10:19:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2b284d4d-d0ed-4d48-901c-d16a9e4505b1 (ip 10.222.0.60) !!! Sep 14 10:19:12.450659 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-20c333ca-0170-45d9-9b6b-169072eaeea4 req-b0b0d674-85ba-403e-835d-9a667dbe99b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b284d4d-d0ed-4d48-901c-d16a9e4505b1", "tag": "4ffcbda4-b14b-4282-b836-779e39a881e2"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:19:12.458691 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-f2767241-9f27-4f16-a336-223baa8369e9 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:19:12.459237 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f2767241-9f27-4f16-a336-223baa8369e9 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] [instance: 2b284d4d-d0ed-4d48-901c-d16a9e4505b1] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:19:12.462838 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-20c333ca-0170-45d9-9b6b-169072eaeea4 req-b0b0d674-85ba-403e-835d-9a667dbe99b7 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:19:12.463732 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-20c333ca-0170-45d9-9b6b-169072eaeea4 req-b0b0d674-85ba-403e-835d-9a667dbe99b7 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:19:12.463896 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-20c333ca-0170-45d9-9b6b-169072eaeea4 req-b0b0d674-85ba-403e-835d-9a667dbe99b7 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:19:12.467840 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f2767241-9f27-4f16-a336-223baa8369e9 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:19:12.468339 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f2767241-9f27-4f16-a336-223baa8369e9 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:19:12.468786 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f2767241-9f27-4f16-a336-223baa8369e9 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:19:12.469497 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f2767241-9f27-4f16-a336-223baa8369e9 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:19:12.469965 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f2767241-9f27-4f16-a336-223baa8369e9 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:19:12.470392 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-f2767241-9f27-4f16-a336-223baa8369e9 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:19:12.478247 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-20c333ca-0170-45d9-9b6b-169072eaeea4 req-b0b0d674-85ba-403e-835d-9a667dbe99b7 service nova] Creating event network-changed:4ffcbda4-b14b-4282-b836-779e39a881e2 for instance 2b284d4d-d0ed-4d48-901c-d16a9e4505b1 on n-h1-836830-18 Sep 14 10:19:12.483752 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-20c333ca-0170-45d9-9b6b-169072eaeea4 req-b0b0d674-85ba-403e-835d-9a667dbe99b7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050503 Sep 14 10:19:12.484715 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3575/7726] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 10:19:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:19:12.499512 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-f2767241-9f27-4f16-a336-223baa8369e9 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] [instance: 2b284d4d-d0ed-4d48-901c-d16a9e4505b1] Going to try to terminate instance {{(pid=128759) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 10:19:12.587865 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-f2767241-9f27-4f16-a336-223baa8369e9 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] 10.222.0.60 "DELETE /compute/v2.1/servers/2b284d4d-d0ed-4d48-901c-d16a9e4505b1" status: 204 len: 0 microversion: 2.1 time: 0.151836 Sep 14 10:19:12.588534 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4152/7727] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 10:19:12 2022] DELETE /compute/v2.1/servers/2b284d4d-d0ed-4d48-901c-d16a9e4505b1 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 10:19:12.598041 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-289601bd-dd7e-4caf-8c6a-4f2b3d68a159 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:19:12.598782 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-289601bd-dd7e-4caf-8c6a-4f2b3d68a159 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] [instance: 2b284d4d-d0ed-4d48-901c-d16a9e4505b1] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:19:12.605216 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-289601bd-dd7e-4caf-8c6a-4f2b3d68a159 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:19:12.606118 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-289601bd-dd7e-4caf-8c6a-4f2b3d68a159 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:19:12.606588 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-289601bd-dd7e-4caf-8c6a-4f2b3d68a159 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:19:12.607370 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-289601bd-dd7e-4caf-8c6a-4f2b3d68a159 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:19:12.607849 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-289601bd-dd7e-4caf-8c6a-4f2b3d68a159 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:19:12.608297 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-289601bd-dd7e-4caf-8c6a-4f2b3d68a159 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:19:12.772799 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-289601bd-dd7e-4caf-8c6a-4f2b3d68a159 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a5cf8e45d46ca96e7d9378d1d59c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afca8f753d4a47249a0636dcde826313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:19:12.780817 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-289601bd-dd7e-4caf-8c6a-4f2b3d68a159 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] 10.222.0.60 "GET /compute/v2.1/servers/2b284d4d-d0ed-4d48-901c-d16a9e4505b1" status: 200 len: 1567 microversion: 2.1 time: 0.187402 Sep 14 10:19:12.781325 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3576/7728] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:19:12 2022] GET /compute/v2.1/servers/2b284d4d-d0ed-4d48-901c-d16a9e4505b1 => generated 1567 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 10:19:13.805060 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-207e3e52-1db6-4073-afc8-219231889b04 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:19:13.805769 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-207e3e52-1db6-4073-afc8-219231889b04 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] [instance: 2b284d4d-d0ed-4d48-901c-d16a9e4505b1] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:19:13.813333 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-207e3e52-1db6-4073-afc8-219231889b04 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:19:13.813812 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-207e3e52-1db6-4073-afc8-219231889b04 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:19:13.814343 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-207e3e52-1db6-4073-afc8-219231889b04 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:19:13.815066 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-207e3e52-1db6-4073-afc8-219231889b04 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:19:13.815513 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-207e3e52-1db6-4073-afc8-219231889b04 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:19:13.815937 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-207e3e52-1db6-4073-afc8-219231889b04 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:19:14.018305 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-207e3e52-1db6-4073-afc8-219231889b04 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a5cf8e45d46ca96e7d9378d1d59c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afca8f753d4a47249a0636dcde826313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:19:14.026154 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-207e3e52-1db6-4073-afc8-219231889b04 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] 10.222.0.60 "GET /compute/v2.1/servers/2b284d4d-d0ed-4d48-901c-d16a9e4505b1" status: 200 len: 1567 microversion: 2.1 time: 0.225345 Sep 14 10:19:14.026729 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4153/7729] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:19:13 2022] GET /compute/v2.1/servers/2b284d4d-d0ed-4d48-901c-d16a9e4505b1 => generated 1567 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:19:14.899277 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-ea49b4f3-665e-4a27-8cd8-9169048b7ff4 req-ad38cd17-9f26-4b38-9e94-fd6a6dde7daa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b284d4d-d0ed-4d48-901c-d16a9e4505b1", "name": "network-vif-deleted", "tag": "4ffcbda4-b14b-4282-b836-779e39a881e2"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:19:14.911920 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-ea49b4f3-665e-4a27-8cd8-9169048b7ff4 req-ad38cd17-9f26-4b38-9e94-fd6a6dde7daa service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:19:14.912346 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-ea49b4f3-665e-4a27-8cd8-9169048b7ff4 req-ad38cd17-9f26-4b38-9e94-fd6a6dde7daa service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:19:14.912786 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-ea49b4f3-665e-4a27-8cd8-9169048b7ff4 req-ad38cd17-9f26-4b38-9e94-fd6a6dde7daa service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:19:14.924933 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-ea49b4f3-665e-4a27-8cd8-9169048b7ff4 req-ad38cd17-9f26-4b38-9e94-fd6a6dde7daa service nova] Creating event network-vif-deleted:4ffcbda4-b14b-4282-b836-779e39a881e2 for instance 2b284d4d-d0ed-4d48-901c-d16a9e4505b1 on n-h1-836830-18 Sep 14 10:19:14.930298 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-ea49b4f3-665e-4a27-8cd8-9169048b7ff4 req-ad38cd17-9f26-4b38-9e94-fd6a6dde7daa service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034794 Sep 14 10:19:14.931030 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3577/7730] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 10:19:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:19:15.050908 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-0f10e4bc-1f61-447f-b9c0-ce34ea4ec70b tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:19:15.051567 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-0f10e4bc-1f61-447f-b9c0-ce34ea4ec70b tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] [instance: 2b284d4d-d0ed-4d48-901c-d16a9e4505b1] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:19:15.058731 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0f10e4bc-1f61-447f-b9c0-ce34ea4ec70b tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:19:15.059269 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0f10e4bc-1f61-447f-b9c0-ce34ea4ec70b tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:19:15.059719 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0f10e4bc-1f61-447f-b9c0-ce34ea4ec70b tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:19:15.060442 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0f10e4bc-1f61-447f-b9c0-ce34ea4ec70b tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:19:15.060905 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0f10e4bc-1f61-447f-b9c0-ce34ea4ec70b tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:19:15.061337 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-0f10e4bc-1f61-447f-b9c0-ce34ea4ec70b tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:19:15.131450 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-0f10e4bc-1f61-447f-b9c0-ce34ea4ec70b tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a5cf8e45d46ca96e7d9378d1d59c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afca8f753d4a47249a0636dcde826313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:19:15.139976 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-0f10e4bc-1f61-447f-b9c0-ce34ea4ec70b tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] 10.222.0.60 "GET /compute/v2.1/servers/2b284d4d-d0ed-4d48-901c-d16a9e4505b1" status: 200 len: 1219 microversion: 2.1 time: 0.094043 Sep 14 10:19:15.140562 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4154/7731] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:19:15 2022] GET /compute/v2.1/servers/2b284d4d-d0ed-4d48-901c-d16a9e4505b1 => generated 1219 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:19:16.164021 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-987e9b6a-ae01-48df-bf96-276c054cb11b tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:19:16.164747 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-987e9b6a-ae01-48df-bf96-276c054cb11b tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] [instance: 2b284d4d-d0ed-4d48-901c-d16a9e4505b1] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:19:16.171884 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-987e9b6a-ae01-48df-bf96-276c054cb11b tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:19:16.172385 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-987e9b6a-ae01-48df-bf96-276c054cb11b tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:19:16.172834 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-987e9b6a-ae01-48df-bf96-276c054cb11b tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:19:16.173548 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-987e9b6a-ae01-48df-bf96-276c054cb11b tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:19:16.174030 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-987e9b6a-ae01-48df-bf96-276c054cb11b tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:19:16.174466 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-987e9b6a-ae01-48df-bf96-276c054cb11b tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:19:16.238606 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-987e9b6a-ae01-48df-bf96-276c054cb11b tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a5cf8e45d46ca96e7d9378d1d59c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afca8f753d4a47249a0636dcde826313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:19:16.246504 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-987e9b6a-ae01-48df-bf96-276c054cb11b tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] 10.222.0.60 "GET /compute/v2.1/servers/2b284d4d-d0ed-4d48-901c-d16a9e4505b1" status: 200 len: 1219 microversion: 2.1 time: 0.086823 Sep 14 10:19:16.247608 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3578/7732] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:19:16 2022] GET /compute/v2.1/servers/2b284d4d-d0ed-4d48-901c-d16a9e4505b1 => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:19:17.269842 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-cf6fe85f-901f-46ad-a9e3-5de60c897f48 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:19:17.270465 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-cf6fe85f-901f-46ad-a9e3-5de60c897f48 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] [instance: 2b284d4d-d0ed-4d48-901c-d16a9e4505b1] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:19:17.277688 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cf6fe85f-901f-46ad-a9e3-5de60c897f48 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:19:17.278764 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cf6fe85f-901f-46ad-a9e3-5de60c897f48 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:19:17.279234 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cf6fe85f-901f-46ad-a9e3-5de60c897f48 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:19:17.279949 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cf6fe85f-901f-46ad-a9e3-5de60c897f48 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:19:17.280413 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cf6fe85f-901f-46ad-a9e3-5de60c897f48 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:19:17.280843 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-cf6fe85f-901f-46ad-a9e3-5de60c897f48 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:19:17.345609 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-cf6fe85f-901f-46ad-a9e3-5de60c897f48 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a5cf8e45d46ca96e7d9378d1d59c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afca8f753d4a47249a0636dcde826313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:19:17.353896 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-cf6fe85f-901f-46ad-a9e3-5de60c897f48 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] 10.222.0.60 "GET /compute/v2.1/servers/2b284d4d-d0ed-4d48-901c-d16a9e4505b1" status: 200 len: 1219 microversion: 2.1 time: 0.087973 Sep 14 10:19:17.354501 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4155/7733] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:19:17 2022] GET /compute/v2.1/servers/2b284d4d-d0ed-4d48-901c-d16a9e4505b1 => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:19:18.377585 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b526979a-60e2-48ad-a0ca-60100a99f0ea tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:19:18.378221 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-b526979a-60e2-48ad-a0ca-60100a99f0ea tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] [instance: 2b284d4d-d0ed-4d48-901c-d16a9e4505b1] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:19:18.385279 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b526979a-60e2-48ad-a0ca-60100a99f0ea tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:19:18.385778 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b526979a-60e2-48ad-a0ca-60100a99f0ea tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:19:18.386230 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b526979a-60e2-48ad-a0ca-60100a99f0ea tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:19:18.386968 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b526979a-60e2-48ad-a0ca-60100a99f0ea tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:19:18.387984 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b526979a-60e2-48ad-a0ca-60100a99f0ea tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:19:18.388429 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b526979a-60e2-48ad-a0ca-60100a99f0ea tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:19:18.453588 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-b526979a-60e2-48ad-a0ca-60100a99f0ea tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a5cf8e45d46ca96e7d9378d1d59c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afca8f753d4a47249a0636dcde826313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:19:18.461510 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-b526979a-60e2-48ad-a0ca-60100a99f0ea tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] 10.222.0.60 "GET /compute/v2.1/servers/2b284d4d-d0ed-4d48-901c-d16a9e4505b1" status: 200 len: 1219 microversion: 2.1 time: 0.087863 Sep 14 10:19:18.462095 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3579/7734] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:19:18 2022] GET /compute/v2.1/servers/2b284d4d-d0ed-4d48-901c-d16a9e4505b1 => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:19:19.485453 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b4d68a42-2f55-449a-8269-8d816ec1da62 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:19:19.486081 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b4d68a42-2f55-449a-8269-8d816ec1da62 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] [instance: 2b284d4d-d0ed-4d48-901c-d16a9e4505b1] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:19:19.494856 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b4d68a42-2f55-449a-8269-8d816ec1da62 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:19:19.495505 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b4d68a42-2f55-449a-8269-8d816ec1da62 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:19:19.496033 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b4d68a42-2f55-449a-8269-8d816ec1da62 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:19:19.497511 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b4d68a42-2f55-449a-8269-8d816ec1da62 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:19:19.498083 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b4d68a42-2f55-449a-8269-8d816ec1da62 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:19:19.500117 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b4d68a42-2f55-449a-8269-8d816ec1da62 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:19:19.532212 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b4d68a42-2f55-449a-8269-8d816ec1da62 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:19:19.532713 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b4d68a42-2f55-449a-8269-8d816ec1da62 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:19:19.533153 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b4d68a42-2f55-449a-8269-8d816ec1da62 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:19:19.533615 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.objects.instance [None req-b4d68a42-2f55-449a-8269-8d816ec1da62 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lazy-loading 'fault' on Instance uuid 2b284d4d-d0ed-4d48-901c-d16a9e4505b1 {{(pid=128759) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 10:19:19.582419 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b4d68a42-2f55-449a-8269-8d816ec1da62 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a5cf8e45d46ca96e7d9378d1d59c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afca8f753d4a47249a0636dcde826313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:19:19.589770 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b4d68a42-2f55-449a-8269-8d816ec1da62 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] 10.222.0.60 "GET /compute/v2.1/servers/2b284d4d-d0ed-4d48-901c-d16a9e4505b1" status: 200 len: 1178 microversion: 2.1 time: 0.108878 Sep 14 10:19:19.590409 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4156/7735] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:19:19 2022] GET /compute/v2.1/servers/2b284d4d-d0ed-4d48-901c-d16a9e4505b1 => generated 1178 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:19:20.613562 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1f041fc2-651e-4163-8d30-e41794fcaaf0 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:19:20.614222 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-1f041fc2-651e-4163-8d30-e41794fcaaf0 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] [instance: 2b284d4d-d0ed-4d48-901c-d16a9e4505b1] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:19:20.621347 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1f041fc2-651e-4163-8d30-e41794fcaaf0 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:19:20.622377 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1f041fc2-651e-4163-8d30-e41794fcaaf0 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:19:20.622835 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1f041fc2-651e-4163-8d30-e41794fcaaf0 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:19:20.623581 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1f041fc2-651e-4163-8d30-e41794fcaaf0 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:19:20.624058 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1f041fc2-651e-4163-8d30-e41794fcaaf0 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:19:20.624502 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1f041fc2-651e-4163-8d30-e41794fcaaf0 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:19:20.638852 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-1f041fc2-651e-4163-8d30-e41794fcaaf0 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] HTTP exception thrown: Instance 2b284d4d-d0ed-4d48-901c-d16a9e4505b1 could not be found. Sep 14 10:19:20.640581 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1f041fc2-651e-4163-8d30-e41794fcaaf0 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Request method failure captured: Sep 14 10:19:20.640581 n-d-836830-18 devstack@n-api.service[128758]: request: GET /compute/v2.1/servers/2b284d4d-d0ed-4d48-901c-d16a9e4505b1 HTTP/1.1 Sep 14 10:19:20.640581 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 10:19:20.640581 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 10:19:20.640581 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 10:19:20.640581 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 10:19:20.640581 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 10:19:20.640581 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 10:19:20.640581 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 10:19:20.640581 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 10:19:20.640581 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIah7jcv0TTIHE-AzcPX7Zc4g8F-B3bV2nfZXLaFxHHmiRwwWuhXn6ZhAc0pkwAvBSRy4CxeqQpTc341_VRbKNLvesPfGHkY5KZl_T2uhIodgdT0CQaCKfikxq1iJeg7ZWzW3URabxDza0tpqMajeiJQTrKHj5HqU27creKvHR_65jzA Sep 14 10:19:20.640581 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 10:19:20.640581 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 10:19:20.640581 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 10:19:20.640581 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 10:19:20.640581 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 10:19:20.640581 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 10:19:20.640581 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: afca8f753d4a47249a0636dcde826313 Sep 14 10:19:20.640581 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-TestShelveInstance-143535994 Sep 14 10:19:20.640581 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 10:19:20.640581 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 10:19:20.640581 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/afca8f753d4a47249a0636dcde826313"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_afca8f753d4a47249a0636dcde826313"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/afca8f753d4a47249a0636dcde826313"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/afca8f753d4a47249a0636dcde826313"}]}] Sep 14 10:19:20.640581 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-TestShelveInstance-143535994 Sep 14 10:19:20.640581 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: afca8f753d4a47249a0636dcde826313 Sep 14 10:19:20.640581 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-TestShelveInstance-143535994 Sep 14 10:19:20.640581 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-TestShelveInstance-143535994-project Sep 14 10:19:20.640581 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 10:19:20.640581 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 10:19:20.640581 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: bb4a5cf8e45d46ca96e7d9378d1d59c8 Sep 14 10:19:20.640581 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-TestShelveInstance-143535994-project Sep 14 10:19:20.640581 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 10:19:20.640581 n-d-836830-18 devstack@n-api.service[128758]: exception: Instance 2b284d4d-d0ed-4d48-901c-d16a9e4505b1 could not be found. Sep 14 10:19:20.640581 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': '2b284d4d-d0ed-4d48-901c-d16a9e4505b1'} Sep 14 10:19:20.640581 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 10:19:20.640581 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:19:20.640581 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 10:19:20.640581 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 10:19:20.640581 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 10:19:20.640581 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 10:19:20.640581 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 10:19:20.640581 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 10:19:20.640581 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 10:19:20.640581 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 10:19:20.640581 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b284d4d-d0ed-4d48-901c-d16a9e4505b1 could not be found. Sep 14 10:19:20.640581 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 10:19:20.640581 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:19:20.640581 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 10:19:20.640581 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:19:20.640581 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:19:20.640581 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:19:20.640581 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 10:19:20.640581 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 10:19:20.640581 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 10:19:20.640581 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 10:19:20.640581 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 10:19:20.640581 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 10:19:20.640581 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 10:19:20.640581 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 10:19:20.640581 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 10:19:20.640581 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 10:19:20.640581 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b284d4d-d0ed-4d48-901c-d16a9e4505b1 could not be found. Sep 14 10:19:20.640581 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 10:19:20.640581 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:19:20.640581 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 10:19:20.645185 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:19:20.645185 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:19:20.645185 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:19:20.645185 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 10:19:20.645185 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 10:19:20.645185 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b284d4d-d0ed-4d48-901c-d16a9e4505b1 could not be found. Sep 14 10:19:20.645185 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 10:19:20.645185 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1f041fc2-651e-4163-8d30-e41794fcaaf0 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Returning 404 to user: Instance 2b284d4d-d0ed-4d48-901c-d16a9e4505b1 could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 10:19:20.645185 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-1f041fc2-651e-4163-8d30-e41794fcaaf0 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] 10.222.0.60 "GET /compute/v2.1/servers/2b284d4d-d0ed-4d48-901c-d16a9e4505b1" status: 404 len: 111 microversion: 2.1 time: 0.032775 Sep 14 10:19:20.645185 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3580/7736] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:19:20 2022] GET /compute/v2.1/servers/2b284d4d-d0ed-4d48-901c-d16a9e4505b1 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 10:19:20.805050 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-df4e9198-aa71-4f17-8c81-ca19f905a248 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] Calling method '.version_select at 0x7f7d48692b80>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:19:20.844612 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-df4e9198-aa71-4f17-8c81-ca19f905a248 tempest-TestShelveInstance-143535994 tempest-TestShelveInstance-143535994-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1948508301" status: 202 len: 0 microversion: 2.1 time: 0.043407 Sep 14 10:19:20.845259 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4157/7737] 10.222.0.60 () {58 vars in 1254 bytes} [Wed Sep 14 10:19:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1948508301 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 10:19:38.389681 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=12 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:19:38.390870 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=24 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:19:38.592995 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b52244ef-8159-48ce-bc87-a7e4ae0d6e44 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Action: 'create', calling method: .version_select at 0x7f7d445e9430>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-783805181", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIZiWBK2wOQJEp6RyYlYwQLKl3MB6uTxB7QhSuxnsHeyPK80kUqA97x0E9vRJegyjMJ0jkEtyNEnGgTEteA4SnJVI/q2jEYMGC++XtujcHwWE0/etQaiO0fCKX16FtuhwA=="}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:19:38.610096 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-b52244ef-8159-48ce-bc87-a7e4ae0d6e44 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Getting quotas for project 3a3a1781e1dd43299dc8aa5013f947ba. Resources: {'key_pairs'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 10:19:38.616426 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.quota [None req-b52244ef-8159-48ce-bc87-a7e4ae0d6e44 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Getting quotas for user 4d3f5ca85bbc47239ba0756cf56dab95 and project 3a3a1781e1dd43299dc8aa5013f947ba. Resources: {'key_pairs'} {{(pid=128758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 10:19:38.646238 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-b52244ef-8159-48ce-bc87-a7e4ae0d6e44 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.262023 Sep 14 10:19:38.647598 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3581/7738] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Sep 14 10:19:38 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:19:39.743029 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:19:39.744421 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:19:39.749198 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8f0de752-6834-48af-8e3b-390f955747ea tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-926126633", "imageRef": "bff4ab7f-4846-441f-8940-d96fec4c28e9", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-783805181", "security_groups": [{"name": "tempest-secgroup-smoke-408924359"}], "networks": [{"uuid": "63846a45-fdcc-4af7-82e1-af470ee97873"}]}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:19:39.863858 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.network.neutron [None req-8f0de752-6834-48af-8e3b-390f955747ea tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] validate_networks() for [('63846a45-fdcc-4af7-82e1-af470ee97873', None, None, None, None, None)] {{(pid=128759) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 10:19:40.267591 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-8f0de752-6834-48af-8e3b-390f955747ea tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Flavor limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 10:19:40.268016 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-8f0de752-6834-48af-8e3b-390f955747ea tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Image limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 10:19:40.268490 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-8f0de752-6834-48af-8e3b-390f955747ea tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Flavor pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 10:19:40.268925 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-8f0de752-6834-48af-8e3b-390f955747ea tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Image pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 10:19:40.269339 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-8f0de752-6834-48af-8e3b-390f955747ea tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 10:19:40.278077 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8f0de752-6834-48af-8e3b-390f955747ea tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:19:40.278557 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8f0de752-6834-48af-8e3b-390f955747ea tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:19:40.279023 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8f0de752-6834-48af-8e3b-390f955747ea tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:19:40.279745 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8f0de752-6834-48af-8e3b-390f955747ea tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:19:40.280195 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8f0de752-6834-48af-8e3b-390f955747ea tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:19:40.280618 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8f0de752-6834-48af-8e3b-390f955747ea tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:19:40.298151 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-8f0de752-6834-48af-8e3b-390f955747ea tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Getting quotas for project 3a3a1781e1dd43299dc8aa5013f947ba. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 10:19:40.303301 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-8f0de752-6834-48af-8e3b-390f955747ea tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Getting quotas for user 4d3f5ca85bbc47239ba0756cf56dab95 and project 3a3a1781e1dd43299dc8aa5013f947ba. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 10:19:40.315913 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-8f0de752-6834-48af-8e3b-390f955747ea tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Going to run 1 instances... {{(pid=128759) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 10:19:40.318171 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-8f0de752-6834-48af-8e3b-390f955747ea tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] [instance: 28df742c-2df9-4895-98dd-1bd582452de9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bff4ab7f-4846-441f-8940-d96fec4c28e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128759) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 10:19:40.366116 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-8f0de752-6834-48af-8e3b-390f955747ea tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.624880 Sep 14 10:19:40.366633 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4158/7739] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 10:19:39 2022] POST /compute/v2.1/servers => generated 405 bytes in 626 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 10:19:40.384103 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-e3af21a4-ef02-47d4-bbc9-16275a63464b tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:19:40.388891 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-e3af21a4-ef02-47d4-bbc9-16275a63464b tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] [instance: 28df742c-2df9-4895-98dd-1bd582452de9] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:19:40.447804 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-e3af21a4-ef02-47d4-bbc9-16275a63464b tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3f5ca85bbc47239ba0756cf56dab95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a3a1781e1dd43299dc8aa5013f947ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:19:40.455013 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-e3af21a4-ef02-47d4-bbc9-16275a63464b tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] 10.222.0.60 "GET /compute/v2.1/servers/28df742c-2df9-4895-98dd-1bd582452de9" status: 200 len: 1247 microversion: 2.1 time: 0.078022 Sep 14 10:19:40.455908 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3582/7740] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:19:40 2022] GET /compute/v2.1/servers/28df742c-2df9-4895-98dd-1bd582452de9 => generated 1247 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:19:41.479243 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-aadb85a8-7cf3-4dad-babf-e1c1ec7bebc7 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:19:41.480821 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-aadb85a8-7cf3-4dad-babf-e1c1ec7bebc7 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] [instance: 28df742c-2df9-4895-98dd-1bd582452de9] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:19:41.489047 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-aadb85a8-7cf3-4dad-babf-e1c1ec7bebc7 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:19:41.489769 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-aadb85a8-7cf3-4dad-babf-e1c1ec7bebc7 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:19:41.490781 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-aadb85a8-7cf3-4dad-babf-e1c1ec7bebc7 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:19:41.492042 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-aadb85a8-7cf3-4dad-babf-e1c1ec7bebc7 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:19:41.492678 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-aadb85a8-7cf3-4dad-babf-e1c1ec7bebc7 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:19:41.493282 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-aadb85a8-7cf3-4dad-babf-e1c1ec7bebc7 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:19:41.583456 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-aadb85a8-7cf3-4dad-babf-e1c1ec7bebc7 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3f5ca85bbc47239ba0756cf56dab95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a3a1781e1dd43299dc8aa5013f947ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:19:41.593757 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-aadb85a8-7cf3-4dad-babf-e1c1ec7bebc7 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] 10.222.0.60 "GET /compute/v2.1/servers/28df742c-2df9-4895-98dd-1bd582452de9" status: 200 len: 1317 microversion: 2.1 time: 0.119812 Sep 14 10:19:41.594605 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4159/7741] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:19:41 2022] GET /compute/v2.1/servers/28df742c-2df9-4895-98dd-1bd582452de9 => generated 1317 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:19:42.618031 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-d1bb1d99-0bb3-47d1-bbfd-1b83b5631e2b tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:19:42.618830 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-d1bb1d99-0bb3-47d1-bbfd-1b83b5631e2b tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] [instance: 28df742c-2df9-4895-98dd-1bd582452de9] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:19:42.628238 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d1bb1d99-0bb3-47d1-bbfd-1b83b5631e2b tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:19:42.632006 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d1bb1d99-0bb3-47d1-bbfd-1b83b5631e2b tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:19:42.632690 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d1bb1d99-0bb3-47d1-bbfd-1b83b5631e2b tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:19:42.633731 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d1bb1d99-0bb3-47d1-bbfd-1b83b5631e2b tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:19:42.634419 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d1bb1d99-0bb3-47d1-bbfd-1b83b5631e2b tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:19:42.635069 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-d1bb1d99-0bb3-47d1-bbfd-1b83b5631e2b tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:19:42.801421 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-d1bb1d99-0bb3-47d1-bbfd-1b83b5631e2b tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3f5ca85bbc47239ba0756cf56dab95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a3a1781e1dd43299dc8aa5013f947ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:19:42.810855 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-d1bb1d99-0bb3-47d1-bbfd-1b83b5631e2b tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] 10.222.0.60 "GET /compute/v2.1/servers/28df742c-2df9-4895-98dd-1bd582452de9" status: 200 len: 1372 microversion: 2.1 time: 0.196819 Sep 14 10:19:42.811813 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3583/7742] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:19:42 2022] GET /compute/v2.1/servers/28df742c-2df9-4895-98dd-1bd582452de9 => generated 1372 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:19:43.049282 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-8c12b3a3-ed87-4398-a080-e069f7ac6b2c req-2fd7c5bd-f113-438a-b18f-d38c293ccf90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28df742c-2df9-4895-98dd-1bd582452de9", "tag": "0c607d8b-3525-4d57-a19f-adb56cb951a3"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:19:43.064138 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-8c12b3a3-ed87-4398-a080-e069f7ac6b2c req-2fd7c5bd-f113-438a-b18f-d38c293ccf90 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:19:43.064980 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-8c12b3a3-ed87-4398-a080-e069f7ac6b2c req-2fd7c5bd-f113-438a-b18f-d38c293ccf90 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:19:43.065637 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-8c12b3a3-ed87-4398-a080-e069f7ac6b2c req-2fd7c5bd-f113-438a-b18f-d38c293ccf90 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:19:43.078067 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-8c12b3a3-ed87-4398-a080-e069f7ac6b2c req-2fd7c5bd-f113-438a-b18f-d38c293ccf90 service nova] Creating event network-changed:0c607d8b-3525-4d57-a19f-adb56cb951a3 for instance 28df742c-2df9-4895-98dd-1bd582452de9 on n-h2-836830-18 Sep 14 10:19:43.083555 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-8c12b3a3-ed87-4398-a080-e069f7ac6b2c req-2fd7c5bd-f113-438a-b18f-d38c293ccf90 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038404 Sep 14 10:19:43.084215 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4160/7743] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 10:19:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:19:43.834292 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-37b373df-41a8-4204-9af8-0a867eb73909 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:19:43.834851 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-37b373df-41a8-4204-9af8-0a867eb73909 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] [instance: 28df742c-2df9-4895-98dd-1bd582452de9] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:19:43.842278 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-37b373df-41a8-4204-9af8-0a867eb73909 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:19:43.842786 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-37b373df-41a8-4204-9af8-0a867eb73909 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:19:43.843266 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-37b373df-41a8-4204-9af8-0a867eb73909 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:19:43.843975 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-37b373df-41a8-4204-9af8-0a867eb73909 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:19:43.844451 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-37b373df-41a8-4204-9af8-0a867eb73909 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:19:43.844895 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-37b373df-41a8-4204-9af8-0a867eb73909 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:19:43.978476 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-37b373df-41a8-4204-9af8-0a867eb73909 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3f5ca85bbc47239ba0756cf56dab95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a3a1781e1dd43299dc8aa5013f947ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:19:43.987339 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-37b373df-41a8-4204-9af8-0a867eb73909 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] 10.222.0.60 "GET /compute/v2.1/servers/28df742c-2df9-4895-98dd-1bd582452de9" status: 200 len: 1372 microversion: 2.1 time: 0.157049 Sep 14 10:19:43.987940 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3584/7744] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:19:43 2022] GET /compute/v2.1/servers/28df742c-2df9-4895-98dd-1bd582452de9 => generated 1372 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:19:45.011397 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-69cbf1ad-d6df-413b-9dae-a8a91b5bf1ef tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:19:45.013030 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-69cbf1ad-d6df-413b-9dae-a8a91b5bf1ef tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] [instance: 28df742c-2df9-4895-98dd-1bd582452de9] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:19:45.018907 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-69cbf1ad-d6df-413b-9dae-a8a91b5bf1ef tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:19:45.019423 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-69cbf1ad-d6df-413b-9dae-a8a91b5bf1ef tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:19:45.019870 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-69cbf1ad-d6df-413b-9dae-a8a91b5bf1ef tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:19:45.020561 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-69cbf1ad-d6df-413b-9dae-a8a91b5bf1ef tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:19:45.021018 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-69cbf1ad-d6df-413b-9dae-a8a91b5bf1ef tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:19:45.021451 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-69cbf1ad-d6df-413b-9dae-a8a91b5bf1ef tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:19:45.155993 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-69cbf1ad-d6df-413b-9dae-a8a91b5bf1ef tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3f5ca85bbc47239ba0756cf56dab95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a3a1781e1dd43299dc8aa5013f947ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:19:45.163702 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-69cbf1ad-d6df-413b-9dae-a8a91b5bf1ef tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] 10.222.0.60 "GET /compute/v2.1/servers/28df742c-2df9-4895-98dd-1bd582452de9" status: 200 len: 1372 microversion: 2.1 time: 0.157595 Sep 14 10:19:45.164280 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4161/7745] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:19:45 2022] GET /compute/v2.1/servers/28df742c-2df9-4895-98dd-1bd582452de9 => generated 1372 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 10:19:46.187104 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-61662716-8569-43bd-9a7b-0297ee037836 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:19:46.187677 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-61662716-8569-43bd-9a7b-0297ee037836 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] [instance: 28df742c-2df9-4895-98dd-1bd582452de9] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:19:46.194578 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-61662716-8569-43bd-9a7b-0297ee037836 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:19:46.195189 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-61662716-8569-43bd-9a7b-0297ee037836 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:19:46.195652 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-61662716-8569-43bd-9a7b-0297ee037836 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:19:46.196361 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-61662716-8569-43bd-9a7b-0297ee037836 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:19:46.196836 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-61662716-8569-43bd-9a7b-0297ee037836 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:19:46.197288 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-61662716-8569-43bd-9a7b-0297ee037836 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:19:46.435218 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-61662716-8569-43bd-9a7b-0297ee037836 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3f5ca85bbc47239ba0756cf56dab95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a3a1781e1dd43299dc8aa5013f947ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:19:46.446268 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-61662716-8569-43bd-9a7b-0297ee037836 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] 10.222.0.60 "GET /compute/v2.1/servers/28df742c-2df9-4895-98dd-1bd582452de9" status: 200 len: 1372 microversion: 2.1 time: 0.263620 Sep 14 10:19:46.447416 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3585/7746] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:19:46 2022] GET /compute/v2.1/servers/28df742c-2df9-4895-98dd-1bd582452de9 => generated 1372 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:19:47.470217 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8a3b11b9-9d1f-46ed-9ed7-d2d70b2f4663 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:19:47.470845 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-8a3b11b9-9d1f-46ed-9ed7-d2d70b2f4663 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] [instance: 28df742c-2df9-4895-98dd-1bd582452de9] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:19:47.478307 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8a3b11b9-9d1f-46ed-9ed7-d2d70b2f4663 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:19:47.478800 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8a3b11b9-9d1f-46ed-9ed7-d2d70b2f4663 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:19:47.479278 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8a3b11b9-9d1f-46ed-9ed7-d2d70b2f4663 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:19:47.479966 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8a3b11b9-9d1f-46ed-9ed7-d2d70b2f4663 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:19:47.480944 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8a3b11b9-9d1f-46ed-9ed7-d2d70b2f4663 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:19:47.481357 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8a3b11b9-9d1f-46ed-9ed7-d2d70b2f4663 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:19:47.618852 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-8a3b11b9-9d1f-46ed-9ed7-d2d70b2f4663 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3f5ca85bbc47239ba0756cf56dab95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a3a1781e1dd43299dc8aa5013f947ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:19:47.626636 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-8a3b11b9-9d1f-46ed-9ed7-d2d70b2f4663 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] 10.222.0.60 "GET /compute/v2.1/servers/28df742c-2df9-4895-98dd-1bd582452de9" status: 200 len: 1372 microversion: 2.1 time: 0.160642 Sep 14 10:19:47.627262 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4162/7747] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:19:47 2022] GET /compute/v2.1/servers/28df742c-2df9-4895-98dd-1bd582452de9 => generated 1372 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:19:48.022600 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-9e9d18e2-0ebc-4888-8f85-719bc8c62a01 req-4f1264cc-facb-4a42-9c70-af4f4ab80eeb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28df742c-2df9-4895-98dd-1bd582452de9", "name": "network-vif-plugged", "status": "completed", "tag": "0c607d8b-3525-4d57-a19f-adb56cb951a3"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:19:48.034073 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-9e9d18e2-0ebc-4888-8f85-719bc8c62a01 req-4f1264cc-facb-4a42-9c70-af4f4ab80eeb service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:19:48.034682 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-9e9d18e2-0ebc-4888-8f85-719bc8c62a01 req-4f1264cc-facb-4a42-9c70-af4f4ab80eeb service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:19:48.035187 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-9e9d18e2-0ebc-4888-8f85-719bc8c62a01 req-4f1264cc-facb-4a42-9c70-af4f4ab80eeb service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:19:48.047343 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-9e9d18e2-0ebc-4888-8f85-719bc8c62a01 req-4f1264cc-facb-4a42-9c70-af4f4ab80eeb service nova] Creating event network-vif-plugged:0c607d8b-3525-4d57-a19f-adb56cb951a3 for instance 28df742c-2df9-4895-98dd-1bd582452de9 on n-h2-836830-18 Sep 14 10:19:48.052482 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-9e9d18e2-0ebc-4888-8f85-719bc8c62a01 req-4f1264cc-facb-4a42-9c70-af4f4ab80eeb service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033668 Sep 14 10:19:48.053092 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3586/7748] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 10:19:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:19:48.651853 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-e7639b8c-244b-4297-aca0-061a7324ee78 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:19:48.653030 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-e7639b8c-244b-4297-aca0-061a7324ee78 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] [instance: 28df742c-2df9-4895-98dd-1bd582452de9] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:19:48.660040 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e7639b8c-244b-4297-aca0-061a7324ee78 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:19:48.660533 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e7639b8c-244b-4297-aca0-061a7324ee78 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:19:48.660980 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e7639b8c-244b-4297-aca0-061a7324ee78 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:19:48.661677 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e7639b8c-244b-4297-aca0-061a7324ee78 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:19:48.662140 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e7639b8c-244b-4297-aca0-061a7324ee78 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:19:48.662574 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-e7639b8c-244b-4297-aca0-061a7324ee78 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:19:48.796742 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-e7639b8c-244b-4297-aca0-061a7324ee78 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3f5ca85bbc47239ba0756cf56dab95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a3a1781e1dd43299dc8aa5013f947ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:19:48.804495 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-e7639b8c-244b-4297-aca0-061a7324ee78 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] 10.222.0.60 "GET /compute/v2.1/servers/28df742c-2df9-4895-98dd-1bd582452de9" status: 200 len: 1372 microversion: 2.1 time: 0.156617 Sep 14 10:19:48.805078 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4163/7749] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:19:48 2022] GET /compute/v2.1/servers/28df742c-2df9-4895-98dd-1bd582452de9 => generated 1372 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:19:49.830869 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-e9c18e59-b64d-4db6-9f03-6b8d2e634be7 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:19:49.831546 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-e9c18e59-b64d-4db6-9f03-6b8d2e634be7 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] [instance: 28df742c-2df9-4895-98dd-1bd582452de9] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:19:49.837768 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e9c18e59-b64d-4db6-9f03-6b8d2e634be7 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:19:49.838270 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e9c18e59-b64d-4db6-9f03-6b8d2e634be7 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:19:49.838728 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e9c18e59-b64d-4db6-9f03-6b8d2e634be7 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:19:49.839462 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e9c18e59-b64d-4db6-9f03-6b8d2e634be7 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:19:49.839940 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e9c18e59-b64d-4db6-9f03-6b8d2e634be7 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:19:49.840389 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e9c18e59-b64d-4db6-9f03-6b8d2e634be7 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:19:49.972917 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-e9c18e59-b64d-4db6-9f03-6b8d2e634be7 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3f5ca85bbc47239ba0756cf56dab95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a3a1781e1dd43299dc8aa5013f947ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:19:49.981146 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-e9c18e59-b64d-4db6-9f03-6b8d2e634be7 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] 10.222.0.60 "GET /compute/v2.1/servers/28df742c-2df9-4895-98dd-1bd582452de9" status: 200 len: 1557 microversion: 2.1 time: 0.155639 Sep 14 10:19:49.981716 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3587/7750] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:19:49 2022] GET /compute/v2.1/servers/28df742c-2df9-4895-98dd-1bd582452de9 => generated 1557 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:19:50.003778 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-24d5305e-b817-4e75-9628-181d3395582d tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:19:50.004455 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-24d5305e-b817-4e75-9628-181d3395582d tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] [instance: 28df742c-2df9-4895-98dd-1bd582452de9] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:19:50.012445 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-24d5305e-b817-4e75-9628-181d3395582d tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:19:50.013301 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-24d5305e-b817-4e75-9628-181d3395582d tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:19:50.013759 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-24d5305e-b817-4e75-9628-181d3395582d tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:19:50.014470 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-24d5305e-b817-4e75-9628-181d3395582d tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:19:50.014960 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-24d5305e-b817-4e75-9628-181d3395582d tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:19:50.015410 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-24d5305e-b817-4e75-9628-181d3395582d tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:19:50.149107 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-24d5305e-b817-4e75-9628-181d3395582d tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3f5ca85bbc47239ba0756cf56dab95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a3a1781e1dd43299dc8aa5013f947ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:19:50.156983 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-24d5305e-b817-4e75-9628-181d3395582d tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] 10.222.0.60 "GET /compute/v2.1/servers/28df742c-2df9-4895-98dd-1bd582452de9" status: 200 len: 1557 microversion: 2.1 time: 0.157122 Sep 14 10:19:50.157568 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4164/7751] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:19:49 2022] GET /compute/v2.1/servers/28df742c-2df9-4895-98dd-1bd582452de9 => generated 1557 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:19:52.054415 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-a09ae7f2-8b6e-45e6-8d55-1c27ee7c2417 req-a1d6511a-6dd5-4a7c-81ee-5b73d584fcb7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28df742c-2df9-4895-98dd-1bd582452de9", "tag": "0c607d8b-3525-4d57-a19f-adb56cb951a3"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:19:52.061210 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=6 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:19:52.066398 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-a09ae7f2-8b6e-45e6-8d55-1c27ee7c2417 req-a1d6511a-6dd5-4a7c-81ee-5b73d584fcb7 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:19:52.066896 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-a09ae7f2-8b6e-45e6-8d55-1c27ee7c2417 req-a1d6511a-6dd5-4a7c-81ee-5b73d584fcb7 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:19:52.067375 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-a09ae7f2-8b6e-45e6-8d55-1c27ee7c2417 req-a1d6511a-6dd5-4a7c-81ee-5b73d584fcb7 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:19:52.082392 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-a09ae7f2-8b6e-45e6-8d55-1c27ee7c2417 req-a1d6511a-6dd5-4a7c-81ee-5b73d584fcb7 service nova] Creating event network-changed:0c607d8b-3525-4d57-a19f-adb56cb951a3 for instance 28df742c-2df9-4895-98dd-1bd582452de9 on n-h2-836830-18 Sep 14 10:19:52.087717 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-a09ae7f2-8b6e-45e6-8d55-1c27ee7c2417 req-a1d6511a-6dd5-4a7c-81ee-5b73d584fcb7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037216 Sep 14 10:19:52.088480 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3588/7752] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 10:19:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:21:47.264119 n-d-836830-18 devstack@n-api.service[128759]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fe2cf8e3-40e5-4586-b96b-b3e5ef0901e5] AMQP server on 10.222.0.60:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 14 10:21:47.265302 n-d-836830-18 devstack@n-api.service[128759]: ERROR oslo.messaging._drivers.impl_rabbit [-] [22ef38d2-af78-43f4-be77-ac372bc70aea] AMQP server on 10.222.0.60:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 14 10:21:47.265672 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=2 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:21:47.266441 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=6 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:21:47.267244 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:21:47.267878 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=34 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:21:47.273081 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-d6d7d0bd-8faa-406b-920c-605e34853dfa tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1789058327"}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:21:47.275475 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-d6d7d0bd-8faa-406b-920c-605e34853dfa tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] [instance: 28df742c-2df9-4895-98dd-1bd582452de9] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:21:47.283769 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d6d7d0bd-8faa-406b-920c-605e34853dfa tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:21:47.284255 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d6d7d0bd-8faa-406b-920c-605e34853dfa tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:21:47.284695 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d6d7d0bd-8faa-406b-920c-605e34853dfa tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:21:47.285391 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d6d7d0bd-8faa-406b-920c-605e34853dfa tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:21:47.285849 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d6d7d0bd-8faa-406b-920c-605e34853dfa tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:21:47.286279 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-d6d7d0bd-8faa-406b-920c-605e34853dfa tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:21:47.492617 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-d6d7d0bd-8faa-406b-920c-605e34853dfa tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] 10.222.0.60 "POST /compute/v2.1/servers/28df742c-2df9-4895-98dd-1bd582452de9/action" status: 202 len: 0 microversion: 2.1 time: 0.230297 Sep 14 10:21:47.494734 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4165/7753] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 10:21:47 2022] POST /compute/v2.1/servers/28df742c-2df9-4895-98dd-1bd582452de9/action => generated 0 bytes in 233 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 14 10:21:54.678163 n-d-836830-18 devstack@n-api.service[128758]: ERROR oslo.messaging._drivers.impl_rabbit [-] [33d7e4a6-539b-476c-bc18-5478ca3a22f4] AMQP server on 10.222.0.60:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 14 10:21:54.680037 n-d-836830-18 devstack@n-api.service[128758]: ERROR oslo.messaging._drivers.impl_rabbit [-] [57e2b41d-7c54-48cb-b191-b7f77db67cfb] AMQP server on 10.222.0.60:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 14 10:21:54.680685 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:21:54.681607 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=28 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:21:54.682390 n-d-836830-18 devstack@n-api.service[128758]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 10:21:54.682526 n-d-836830-18 devstack@n-api.service[128758]: Wed Sep 14 10:21:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.60) !!! Sep 14 10:21:54.791064 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-2cfd4582-715a-4d8e-b365-c4148471226e req-a2baa563-8b29-4146-9700-04cf37d551cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28df742c-2df9-4895-98dd-1bd582452de9", "name": "network-vif-plugged", "status": "completed", "tag": "0c607d8b-3525-4d57-a19f-adb56cb951a3"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:21:54.804292 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-2cfd4582-715a-4d8e-b365-c4148471226e req-a2baa563-8b29-4146-9700-04cf37d551cd service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:21:54.805082 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-2cfd4582-715a-4d8e-b365-c4148471226e req-a2baa563-8b29-4146-9700-04cf37d551cd service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:21:54.805830 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-2cfd4582-715a-4d8e-b365-c4148471226e req-a2baa563-8b29-4146-9700-04cf37d551cd service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:21:54.818097 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-2cfd4582-715a-4d8e-b365-c4148471226e req-a2baa563-8b29-4146-9700-04cf37d551cd service nova] Creating event network-vif-plugged:0c607d8b-3525-4d57-a19f-adb56cb951a3 for instance 28df742c-2df9-4895-98dd-1bd582452de9 on n-h2-836830-18 Sep 14 10:21:54.825200 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-2cfd4582-715a-4d8e-b365-c4148471226e req-a2baa563-8b29-4146-9700-04cf37d551cd service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148793 Sep 14 10:21:54.826036 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3589/7754] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 10:21:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:22:01.054773 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-db8e7fec-a50d-40fb-86cc-cbbfd8e407a8 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-335015173", "imageRef": "d3703165-cd70-469b-b8a9-2aa5ba54bbfc", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-783805181", "security_groups": [{"name": "tempest-secgroup-smoke-408924359"}], "networks": [{"uuid": "63846a45-fdcc-4af7-82e1-af470ee97873"}]}} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:22:01.065398 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=2 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:22:01.066277 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:22:01.084832 n-d-836830-18 devstack@n-api.service[128759]: INFO oslo.messaging._drivers.impl_rabbit [-] [fe2cf8e3-40e5-4586-b96b-b3e5ef0901e5] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 54214. Sep 14 10:22:01.086541 n-d-836830-18 devstack@n-api.service[128759]: INFO oslo.messaging._drivers.impl_rabbit [-] [22ef38d2-af78-43f4-be77-ac372bc70aea] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 54216. Sep 14 10:22:01.177156 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.network.neutron [None req-db8e7fec-a50d-40fb-86cc-cbbfd8e407a8 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] validate_networks() for [('63846a45-fdcc-4af7-82e1-af470ee97873', None, None, None, None, None)] {{(pid=128759) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 10:22:01.596114 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-db8e7fec-a50d-40fb-86cc-cbbfd8e407a8 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Flavor limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 10:22:01.596553 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-db8e7fec-a50d-40fb-86cc-cbbfd8e407a8 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Image limits 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 10:22:01.597048 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-db8e7fec-a50d-40fb-86cc-cbbfd8e407a8 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Flavor pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 10:22:01.597469 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-db8e7fec-a50d-40fb-86cc-cbbfd8e407a8 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Image pref 0:0:0 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 10:22:01.597890 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.virt.hardware [None req-db8e7fec-a50d-40fb-86cc-cbbfd8e407a8 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128759) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 10:22:01.607690 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-db8e7fec-a50d-40fb-86cc-cbbfd8e407a8 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:01.608172 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-db8e7fec-a50d-40fb-86cc-cbbfd8e407a8 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:01.608614 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-db8e7fec-a50d-40fb-86cc-cbbfd8e407a8 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:01.609343 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-db8e7fec-a50d-40fb-86cc-cbbfd8e407a8 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:01.609803 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-db8e7fec-a50d-40fb-86cc-cbbfd8e407a8 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:01.610232 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-db8e7fec-a50d-40fb-86cc-cbbfd8e407a8 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:01.627266 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-db8e7fec-a50d-40fb-86cc-cbbfd8e407a8 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Getting quotas for project 3a3a1781e1dd43299dc8aa5013f947ba. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 10:22:01.632467 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.quota [None req-db8e7fec-a50d-40fb-86cc-cbbfd8e407a8 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Getting quotas for user 4d3f5ca85bbc47239ba0756cf56dab95 and project 3a3a1781e1dd43299dc8aa5013f947ba. Resources: {'cores', 'ram', 'instances'} {{(pid=128759) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 10:22:01.644803 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-db8e7fec-a50d-40fb-86cc-cbbfd8e407a8 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Going to run 1 instances... {{(pid=128759) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 10:22:01.647299 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-db8e7fec-a50d-40fb-86cc-cbbfd8e407a8 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] [instance: e8fea9be-0267-4cec-881e-efec990a9651] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d3703165-cd70-469b-b8a9-2aa5ba54bbfc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128759) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 10:22:01.694426 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-db8e7fec-a50d-40fb-86cc-cbbfd8e407a8 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.644003 Sep 14 10:22:01.695125 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4166/7755] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Sep 14 10:22:01 2022] POST /compute/v2.1/servers => generated 405 bytes in 646 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 10:22:01.708083 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-4938ff41-ce8d-41c7-9733-9f414b201f0d tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:22:01.708836 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-4938ff41-ce8d-41c7-9733-9f414b201f0d tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] [instance: e8fea9be-0267-4cec-881e-efec990a9651] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:22:01.722822 n-d-836830-18 devstack@n-api.service[128758]: INFO oslo.messaging._drivers.impl_rabbit [-] [57e2b41d-7c54-48cb-b191-b7f77db67cfb] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 54234. Sep 14 10:22:01.723666 n-d-836830-18 devstack@n-api.service[128758]: INFO oslo.messaging._drivers.impl_rabbit [-] [33d7e4a6-539b-476c-bc18-5478ca3a22f4] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 54232. Sep 14 10:22:01.770063 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-4938ff41-ce8d-41c7-9733-9f414b201f0d tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3f5ca85bbc47239ba0756cf56dab95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a3a1781e1dd43299dc8aa5013f947ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:22:01.778475 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-4938ff41-ce8d-41c7-9733-9f414b201f0d tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] 10.222.0.60 "GET /compute/v2.1/servers/e8fea9be-0267-4cec-881e-efec990a9651" status: 200 len: 1247 microversion: 2.1 time: 0.075785 Sep 14 10:22:01.779375 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3590/7756] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:22:01 2022] GET /compute/v2.1/servers/e8fea9be-0267-4cec-881e-efec990a9651 => generated 1247 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:22:02.803555 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-8e206394-3ca3-4fff-a23d-b6f45a018300 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:22:02.804215 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-8e206394-3ca3-4fff-a23d-b6f45a018300 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] [instance: e8fea9be-0267-4cec-881e-efec990a9651] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:22:02.812644 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8e206394-3ca3-4fff-a23d-b6f45a018300 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:02.813197 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8e206394-3ca3-4fff-a23d-b6f45a018300 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:02.813698 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8e206394-3ca3-4fff-a23d-b6f45a018300 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:02.814612 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8e206394-3ca3-4fff-a23d-b6f45a018300 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:02.815136 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8e206394-3ca3-4fff-a23d-b6f45a018300 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:02.815755 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-8e206394-3ca3-4fff-a23d-b6f45a018300 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:02.912508 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-8e206394-3ca3-4fff-a23d-b6f45a018300 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3f5ca85bbc47239ba0756cf56dab95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a3a1781e1dd43299dc8aa5013f947ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:22:02.924204 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-8e206394-3ca3-4fff-a23d-b6f45a018300 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] 10.222.0.60 "GET /compute/v2.1/servers/e8fea9be-0267-4cec-881e-efec990a9651" status: 200 len: 1307 microversion: 2.1 time: 0.124738 Sep 14 10:22:02.924985 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4167/7757] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:22:02 2022] GET /compute/v2.1/servers/e8fea9be-0267-4cec-881e-efec990a9651 => generated 1307 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:22:03.949118 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-66d38c60-bc4b-400e-8ae2-6af6b02e02e4 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:22:03.950572 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-66d38c60-bc4b-400e-8ae2-6af6b02e02e4 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] [instance: e8fea9be-0267-4cec-881e-efec990a9651] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:22:03.958385 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-66d38c60-bc4b-400e-8ae2-6af6b02e02e4 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:03.958900 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-66d38c60-bc4b-400e-8ae2-6af6b02e02e4 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:03.959397 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-66d38c60-bc4b-400e-8ae2-6af6b02e02e4 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:03.960381 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-66d38c60-bc4b-400e-8ae2-6af6b02e02e4 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:03.961672 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-66d38c60-bc4b-400e-8ae2-6af6b02e02e4 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:03.962363 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-66d38c60-bc4b-400e-8ae2-6af6b02e02e4 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:04.123755 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-66d38c60-bc4b-400e-8ae2-6af6b02e02e4 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3f5ca85bbc47239ba0756cf56dab95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a3a1781e1dd43299dc8aa5013f947ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:22:04.132631 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-66d38c60-bc4b-400e-8ae2-6af6b02e02e4 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] 10.222.0.60 "GET /compute/v2.1/servers/e8fea9be-0267-4cec-881e-efec990a9651" status: 200 len: 1372 microversion: 2.1 time: 0.188134 Sep 14 10:22:04.133288 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3591/7758] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:22:03 2022] GET /compute/v2.1/servers/e8fea9be-0267-4cec-881e-efec990a9651 => generated 1372 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:22:04.708600 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-897e551c-1901-48cd-b591-4e7a4aaaa04e req-4a267200-8af0-4c09-a457-cfaa976f0267 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28df742c-2df9-4895-98dd-1bd582452de9", "name": "network-vif-unplugged", "status": "completed", "tag": "0c607d8b-3525-4d57-a19f-adb56cb951a3"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:22:04.719958 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-897e551c-1901-48cd-b591-4e7a4aaaa04e req-4a267200-8af0-4c09-a457-cfaa976f0267 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:04.720734 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-897e551c-1901-48cd-b591-4e7a4aaaa04e req-4a267200-8af0-4c09-a457-cfaa976f0267 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:04.721345 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-897e551c-1901-48cd-b591-4e7a4aaaa04e req-4a267200-8af0-4c09-a457-cfaa976f0267 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:04.734118 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-897e551c-1901-48cd-b591-4e7a4aaaa04e req-4a267200-8af0-4c09-a457-cfaa976f0267 service nova] Creating event network-vif-unplugged:0c607d8b-3525-4d57-a19f-adb56cb951a3 for instance 28df742c-2df9-4895-98dd-1bd582452de9 on n-h2-836830-18 Sep 14 10:22:04.752543 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-897e551c-1901-48cd-b591-4e7a4aaaa04e req-4a267200-8af0-4c09-a457-cfaa976f0267 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047647 Sep 14 10:22:04.755313 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4168/7759] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 10:22:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:22:05.156372 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-ad7614cd-bb24-4ae7-bddd-68991523c980 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:22:05.157003 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-ad7614cd-bb24-4ae7-bddd-68991523c980 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] [instance: e8fea9be-0267-4cec-881e-efec990a9651] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:22:05.164091 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ad7614cd-bb24-4ae7-bddd-68991523c980 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:05.164593 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ad7614cd-bb24-4ae7-bddd-68991523c980 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:05.165549 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ad7614cd-bb24-4ae7-bddd-68991523c980 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:05.166253 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ad7614cd-bb24-4ae7-bddd-68991523c980 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:05.166722 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ad7614cd-bb24-4ae7-bddd-68991523c980 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:05.167202 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-ad7614cd-bb24-4ae7-bddd-68991523c980 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:05.308635 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-ad7614cd-bb24-4ae7-bddd-68991523c980 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3f5ca85bbc47239ba0756cf56dab95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a3a1781e1dd43299dc8aa5013f947ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:22:05.316813 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-ad7614cd-bb24-4ae7-bddd-68991523c980 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] 10.222.0.60 "GET /compute/v2.1/servers/e8fea9be-0267-4cec-881e-efec990a9651" status: 200 len: 1372 microversion: 2.1 time: 0.164356 Sep 14 10:22:05.324119 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3592/7760] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:22:05 2022] GET /compute/v2.1/servers/e8fea9be-0267-4cec-881e-efec990a9651 => generated 1372 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:22:06.343246 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-7ba53d4c-281a-4104-b112-f24e273509ae tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:22:06.343910 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-7ba53d4c-281a-4104-b112-f24e273509ae tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] [instance: e8fea9be-0267-4cec-881e-efec990a9651] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:22:06.351626 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7ba53d4c-281a-4104-b112-f24e273509ae tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:06.353243 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7ba53d4c-281a-4104-b112-f24e273509ae tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:06.353858 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7ba53d4c-281a-4104-b112-f24e273509ae tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:06.354745 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7ba53d4c-281a-4104-b112-f24e273509ae tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:06.356065 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7ba53d4c-281a-4104-b112-f24e273509ae tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:06.356065 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-7ba53d4c-281a-4104-b112-f24e273509ae tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:06.511116 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-7ba53d4c-281a-4104-b112-f24e273509ae tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3f5ca85bbc47239ba0756cf56dab95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a3a1781e1dd43299dc8aa5013f947ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:22:06.520034 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-7ba53d4c-281a-4104-b112-f24e273509ae tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] 10.222.0.60 "GET /compute/v2.1/servers/e8fea9be-0267-4cec-881e-efec990a9651" status: 200 len: 1372 microversion: 2.1 time: 0.183080 Sep 14 10:22:06.522180 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4169/7761] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:22:06 2022] GET /compute/v2.1/servers/e8fea9be-0267-4cec-881e-efec990a9651 => generated 1372 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:22:07.544130 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-0da672fb-7f6d-4baf-925f-589b7fefa967 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:22:07.544764 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-0da672fb-7f6d-4baf-925f-589b7fefa967 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] [instance: e8fea9be-0267-4cec-881e-efec990a9651] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:22:07.551973 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0da672fb-7f6d-4baf-925f-589b7fefa967 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:07.552630 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0da672fb-7f6d-4baf-925f-589b7fefa967 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:07.553342 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0da672fb-7f6d-4baf-925f-589b7fefa967 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:07.554446 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0da672fb-7f6d-4baf-925f-589b7fefa967 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:07.555832 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0da672fb-7f6d-4baf-925f-589b7fefa967 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:07.556647 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-0da672fb-7f6d-4baf-925f-589b7fefa967 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:07.699082 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-0da672fb-7f6d-4baf-925f-589b7fefa967 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3f5ca85bbc47239ba0756cf56dab95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a3a1781e1dd43299dc8aa5013f947ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:22:07.707448 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-0da672fb-7f6d-4baf-925f-589b7fefa967 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] 10.222.0.60 "GET /compute/v2.1/servers/e8fea9be-0267-4cec-881e-efec990a9651" status: 200 len: 1372 microversion: 2.1 time: 0.167226 Sep 14 10:22:07.708372 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3593/7762] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:22:07 2022] GET /compute/v2.1/servers/e8fea9be-0267-4cec-881e-efec990a9651 => generated 1372 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:22:08.733772 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-dccf373b-1cd2-4854-b0b0-52ecd2002d39 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:22:08.734384 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-dccf373b-1cd2-4854-b0b0-52ecd2002d39 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] [instance: e8fea9be-0267-4cec-881e-efec990a9651] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:22:08.741928 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dccf373b-1cd2-4854-b0b0-52ecd2002d39 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:08.742429 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dccf373b-1cd2-4854-b0b0-52ecd2002d39 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:08.743188 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dccf373b-1cd2-4854-b0b0-52ecd2002d39 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:08.743907 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dccf373b-1cd2-4854-b0b0-52ecd2002d39 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:08.744369 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dccf373b-1cd2-4854-b0b0-52ecd2002d39 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:08.744797 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-dccf373b-1cd2-4854-b0b0-52ecd2002d39 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:08.890869 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-dccf373b-1cd2-4854-b0b0-52ecd2002d39 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3f5ca85bbc47239ba0756cf56dab95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a3a1781e1dd43299dc8aa5013f947ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:22:08.903733 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-dccf373b-1cd2-4854-b0b0-52ecd2002d39 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] 10.222.0.60 "GET /compute/v2.1/servers/e8fea9be-0267-4cec-881e-efec990a9651" status: 200 len: 1372 microversion: 2.1 time: 0.173755 Sep 14 10:22:08.904552 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4170/7763] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:22:08 2022] GET /compute/v2.1/servers/e8fea9be-0267-4cec-881e-efec990a9651 => generated 1372 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:22:09.927334 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-6d2a3924-dd65-43e6-9bb1-a644e807efcf tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:22:09.928027 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-6d2a3924-dd65-43e6-9bb1-a644e807efcf tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] [instance: e8fea9be-0267-4cec-881e-efec990a9651] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:22:09.935926 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6d2a3924-dd65-43e6-9bb1-a644e807efcf tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:09.936577 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6d2a3924-dd65-43e6-9bb1-a644e807efcf tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:09.937161 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6d2a3924-dd65-43e6-9bb1-a644e807efcf tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:09.938129 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6d2a3924-dd65-43e6-9bb1-a644e807efcf tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:09.938718 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6d2a3924-dd65-43e6-9bb1-a644e807efcf tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:09.939282 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-6d2a3924-dd65-43e6-9bb1-a644e807efcf tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:10.089219 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-6d2a3924-dd65-43e6-9bb1-a644e807efcf tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3f5ca85bbc47239ba0756cf56dab95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a3a1781e1dd43299dc8aa5013f947ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:22:10.098515 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-6d2a3924-dd65-43e6-9bb1-a644e807efcf tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] 10.222.0.60 "GET /compute/v2.1/servers/e8fea9be-0267-4cec-881e-efec990a9651" status: 200 len: 1372 microversion: 2.1 time: 0.175067 Sep 14 10:22:10.099614 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3594/7764] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:22:09 2022] GET /compute/v2.1/servers/e8fea9be-0267-4cec-881e-efec990a9651 => generated 1372 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:22:11.122034 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b3e0fd4f-024b-470d-a424-10d47406a306 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:22:11.122658 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b3e0fd4f-024b-470d-a424-10d47406a306 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] [instance: e8fea9be-0267-4cec-881e-efec990a9651] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:22:11.129480 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b3e0fd4f-024b-470d-a424-10d47406a306 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:11.129982 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b3e0fd4f-024b-470d-a424-10d47406a306 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:11.130408 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b3e0fd4f-024b-470d-a424-10d47406a306 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:11.131132 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b3e0fd4f-024b-470d-a424-10d47406a306 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:11.131594 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b3e0fd4f-024b-470d-a424-10d47406a306 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:11.132020 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b3e0fd4f-024b-470d-a424-10d47406a306 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:11.264462 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b3e0fd4f-024b-470d-a424-10d47406a306 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3f5ca85bbc47239ba0756cf56dab95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a3a1781e1dd43299dc8aa5013f947ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:22:11.272127 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b3e0fd4f-024b-470d-a424-10d47406a306 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] 10.222.0.60 "GET /compute/v2.1/servers/e8fea9be-0267-4cec-881e-efec990a9651" status: 200 len: 1372 microversion: 2.1 time: 0.154000 Sep 14 10:22:11.272707 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4171/7765] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:22:11 2022] GET /compute/v2.1/servers/e8fea9be-0267-4cec-881e-efec990a9651 => generated 1372 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:22:12.296637 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-e590210c-d508-4c2d-9272-d0d7a810fa1d tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:22:12.297275 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-e590210c-d508-4c2d-9272-d0d7a810fa1d tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] [instance: e8fea9be-0267-4cec-881e-efec990a9651] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:22:12.299998 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell0:SELECT=2 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:22:12.305548 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e590210c-d508-4c2d-9272-d0d7a810fa1d tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:12.306055 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e590210c-d508-4c2d-9272-d0d7a810fa1d tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:12.306507 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e590210c-d508-4c2d-9272-d0d7a810fa1d tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:12.307242 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e590210c-d508-4c2d-9272-d0d7a810fa1d tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:12.307719 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e590210c-d508-4c2d-9272-d0d7a810fa1d tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:12.308164 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e590210c-d508-4c2d-9272-d0d7a810fa1d tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:12.445475 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-e590210c-d508-4c2d-9272-d0d7a810fa1d tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3f5ca85bbc47239ba0756cf56dab95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a3a1781e1dd43299dc8aa5013f947ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:22:12.453732 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-e590210c-d508-4c2d-9272-d0d7a810fa1d tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] 10.222.0.60 "GET /compute/v2.1/servers/e8fea9be-0267-4cec-881e-efec990a9651" status: 200 len: 1372 microversion: 2.1 time: 0.161163 Sep 14 10:22:12.454341 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3595/7766] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:22:12 2022] GET /compute/v2.1/servers/e8fea9be-0267-4cec-881e-efec990a9651 => generated 1372 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:22:13.477851 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-58ea3219-9c28-47b1-90be-269f5e9723e3 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:22:13.478640 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-58ea3219-9c28-47b1-90be-269f5e9723e3 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] [instance: e8fea9be-0267-4cec-881e-efec990a9651] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:22:13.480668 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=2 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:22:13.481379 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell0:SELECT=6 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:22:13.488704 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-58ea3219-9c28-47b1-90be-269f5e9723e3 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:13.489183 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-58ea3219-9c28-47b1-90be-269f5e9723e3 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:13.489625 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-58ea3219-9c28-47b1-90be-269f5e9723e3 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:13.490368 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-58ea3219-9c28-47b1-90be-269f5e9723e3 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:13.491041 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-58ea3219-9c28-47b1-90be-269f5e9723e3 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:13.491678 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-58ea3219-9c28-47b1-90be-269f5e9723e3 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:13.692707 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-58ea3219-9c28-47b1-90be-269f5e9723e3 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3f5ca85bbc47239ba0756cf56dab95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a3a1781e1dd43299dc8aa5013f947ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:22:13.701327 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-58ea3219-9c28-47b1-90be-269f5e9723e3 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] 10.222.0.60 "GET /compute/v2.1/servers/e8fea9be-0267-4cec-881e-efec990a9651" status: 200 len: 1372 microversion: 2.1 time: 0.228090 Sep 14 10:22:13.701911 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4172/7767] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:22:13 2022] GET /compute/v2.1/servers/e8fea9be-0267-4cec-881e-efec990a9651 => generated 1372 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:22:13.802012 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-54c8bda6-da39-4351-a192-2f07b68ab0e5 req-0cd9e64e-f26e-4c1a-a500-3d11dbd93933 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8fea9be-0267-4cec-881e-efec990a9651", "tag": "a766c385-b4b2-4667-b3d8-24523465aaaa"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:22:13.812951 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-54c8bda6-da39-4351-a192-2f07b68ab0e5 req-0cd9e64e-f26e-4c1a-a500-3d11dbd93933 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:13.813452 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-54c8bda6-da39-4351-a192-2f07b68ab0e5 req-0cd9e64e-f26e-4c1a-a500-3d11dbd93933 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:13.813902 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-54c8bda6-da39-4351-a192-2f07b68ab0e5 req-0cd9e64e-f26e-4c1a-a500-3d11dbd93933 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:13.825855 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-54c8bda6-da39-4351-a192-2f07b68ab0e5 req-0cd9e64e-f26e-4c1a-a500-3d11dbd93933 service nova] Creating event network-changed:a766c385-b4b2-4667-b3d8-24523465aaaa for instance e8fea9be-0267-4cec-881e-efec990a9651 on n-h1-836830-18 Sep 14 10:22:13.831298 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-54c8bda6-da39-4351-a192-2f07b68ab0e5 req-0cd9e64e-f26e-4c1a-a500-3d11dbd93933 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102541 Sep 14 10:22:13.831924 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3596/7768] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 10:22:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:22:14.724419 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-a05e7314-d047-49af-9f36-3377c8833a81 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:22:14.724969 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-a05e7314-d047-49af-9f36-3377c8833a81 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] [instance: e8fea9be-0267-4cec-881e-efec990a9651] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:22:14.731917 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a05e7314-d047-49af-9f36-3377c8833a81 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:14.732409 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a05e7314-d047-49af-9f36-3377c8833a81 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:14.732852 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a05e7314-d047-49af-9f36-3377c8833a81 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:14.733558 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a05e7314-d047-49af-9f36-3377c8833a81 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:14.734019 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a05e7314-d047-49af-9f36-3377c8833a81 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:14.734453 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-a05e7314-d047-49af-9f36-3377c8833a81 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:14.868710 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-a05e7314-d047-49af-9f36-3377c8833a81 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3f5ca85bbc47239ba0756cf56dab95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a3a1781e1dd43299dc8aa5013f947ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:22:14.876467 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-a05e7314-d047-49af-9f36-3377c8833a81 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] 10.222.0.60 "GET /compute/v2.1/servers/e8fea9be-0267-4cec-881e-efec990a9651" status: 200 len: 1372 microversion: 2.1 time: 0.156081 Sep 14 10:22:14.877053 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4173/7769] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:22:14 2022] GET /compute/v2.1/servers/e8fea9be-0267-4cec-881e-efec990a9651 => generated 1372 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 10:22:15.900699 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-1468f004-052c-42fe-96a0-623137c79ec2 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:22:15.901430 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-1468f004-052c-42fe-96a0-623137c79ec2 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] [instance: e8fea9be-0267-4cec-881e-efec990a9651] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:22:15.907840 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1468f004-052c-42fe-96a0-623137c79ec2 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:15.908340 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1468f004-052c-42fe-96a0-623137c79ec2 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:15.908797 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1468f004-052c-42fe-96a0-623137c79ec2 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:15.909505 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1468f004-052c-42fe-96a0-623137c79ec2 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:15.909978 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1468f004-052c-42fe-96a0-623137c79ec2 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:15.910419 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-1468f004-052c-42fe-96a0-623137c79ec2 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:16.045410 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-1468f004-052c-42fe-96a0-623137c79ec2 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3f5ca85bbc47239ba0756cf56dab95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a3a1781e1dd43299dc8aa5013f947ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:22:16.053175 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-1468f004-052c-42fe-96a0-623137c79ec2 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] 10.222.0.60 "GET /compute/v2.1/servers/e8fea9be-0267-4cec-881e-efec990a9651" status: 200 len: 1372 microversion: 2.1 time: 0.157798 Sep 14 10:22:16.053748 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3597/7770] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:22:15 2022] GET /compute/v2.1/servers/e8fea9be-0267-4cec-881e-efec990a9651 => generated 1372 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:22:17.076919 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-ea9a20d5-3422-46c0-a2ab-8872436187f3 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:22:17.077548 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-ea9a20d5-3422-46c0-a2ab-8872436187f3 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] [instance: e8fea9be-0267-4cec-881e-efec990a9651] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:22:17.084536 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ea9a20d5-3422-46c0-a2ab-8872436187f3 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:17.085029 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ea9a20d5-3422-46c0-a2ab-8872436187f3 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:17.085474 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ea9a20d5-3422-46c0-a2ab-8872436187f3 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:17.086170 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ea9a20d5-3422-46c0-a2ab-8872436187f3 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:17.087234 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ea9a20d5-3422-46c0-a2ab-8872436187f3 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:17.087670 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-ea9a20d5-3422-46c0-a2ab-8872436187f3 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:17.226712 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-ea9a20d5-3422-46c0-a2ab-8872436187f3 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3f5ca85bbc47239ba0756cf56dab95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a3a1781e1dd43299dc8aa5013f947ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:22:17.234496 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-ea9a20d5-3422-46c0-a2ab-8872436187f3 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] 10.222.0.60 "GET /compute/v2.1/servers/e8fea9be-0267-4cec-881e-efec990a9651" status: 200 len: 1372 microversion: 2.1 time: 0.161566 Sep 14 10:22:17.235133 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4174/7771] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:22:17 2022] GET /compute/v2.1/servers/e8fea9be-0267-4cec-881e-efec990a9651 => generated 1372 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:22:18.259170 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-4e939433-d088-4f92-8f06-77becb230841 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:22:18.259818 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-4e939433-d088-4f92-8f06-77becb230841 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] [instance: e8fea9be-0267-4cec-881e-efec990a9651] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:22:18.266650 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4e939433-d088-4f92-8f06-77becb230841 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:18.267192 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4e939433-d088-4f92-8f06-77becb230841 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:18.267650 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4e939433-d088-4f92-8f06-77becb230841 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:18.268359 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4e939433-d088-4f92-8f06-77becb230841 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:18.268827 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4e939433-d088-4f92-8f06-77becb230841 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:18.269267 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-4e939433-d088-4f92-8f06-77becb230841 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:18.404589 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-4e939433-d088-4f92-8f06-77becb230841 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3f5ca85bbc47239ba0756cf56dab95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a3a1781e1dd43299dc8aa5013f947ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:22:18.412419 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-4e939433-d088-4f92-8f06-77becb230841 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] 10.222.0.60 "GET /compute/v2.1/servers/e8fea9be-0267-4cec-881e-efec990a9651" status: 200 len: 1372 microversion: 2.1 time: 0.158115 Sep 14 10:22:18.413013 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3598/7772] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:22:18 2022] GET /compute/v2.1/servers/e8fea9be-0267-4cec-881e-efec990a9651 => generated 1372 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:22:19.436917 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-3d27db5e-8811-4f4e-afc6-c181523d1ea1 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:22:19.437512 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-3d27db5e-8811-4f4e-afc6-c181523d1ea1 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] [instance: e8fea9be-0267-4cec-881e-efec990a9651] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:22:19.444381 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3d27db5e-8811-4f4e-afc6-c181523d1ea1 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:19.444862 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3d27db5e-8811-4f4e-afc6-c181523d1ea1 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:19.445295 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3d27db5e-8811-4f4e-afc6-c181523d1ea1 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:19.446025 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3d27db5e-8811-4f4e-afc6-c181523d1ea1 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:19.446477 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3d27db5e-8811-4f4e-afc6-c181523d1ea1 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:19.446900 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-3d27db5e-8811-4f4e-afc6-c181523d1ea1 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:19.653583 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-3d27db5e-8811-4f4e-afc6-c181523d1ea1 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3f5ca85bbc47239ba0756cf56dab95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a3a1781e1dd43299dc8aa5013f947ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:22:19.661271 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-3d27db5e-8811-4f4e-afc6-c181523d1ea1 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] 10.222.0.60 "GET /compute/v2.1/servers/e8fea9be-0267-4cec-881e-efec990a9651" status: 200 len: 1372 microversion: 2.1 time: 0.228350 Sep 14 10:22:19.661852 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4175/7773] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:22:19 2022] GET /compute/v2.1/servers/e8fea9be-0267-4cec-881e-efec990a9651 => generated 1372 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 10:22:20.343658 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [req-7c02f31a-264b-4413-a13a-d70c929aa7de req-027276d3-a686-4ac7-88b0-1e367a9e91df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8fea9be-0267-4cec-881e-efec990a9651", "name": "network-vif-plugged", "status": "completed", "tag": "a766c385-b4b2-4667-b3d8-24523465aaaa"}]} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:22:20.354182 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-7c02f31a-264b-4413-a13a-d70c929aa7de req-027276d3-a686-4ac7-88b0-1e367a9e91df service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:20.354687 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-7c02f31a-264b-4413-a13a-d70c929aa7de req-027276d3-a686-4ac7-88b0-1e367a9e91df service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:20.355197 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [req-7c02f31a-264b-4413-a13a-d70c929aa7de req-027276d3-a686-4ac7-88b0-1e367a9e91df service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:20.366858 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.compute.server_external_events [req-7c02f31a-264b-4413-a13a-d70c929aa7de req-027276d3-a686-4ac7-88b0-1e367a9e91df service nova] Creating event network-vif-plugged:a766c385-b4b2-4667-b3d8-24523465aaaa for instance e8fea9be-0267-4cec-881e-efec990a9651 on n-h1-836830-18 Sep 14 10:22:20.372607 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [req-7c02f31a-264b-4413-a13a-d70c929aa7de req-027276d3-a686-4ac7-88b0-1e367a9e91df service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032774 Sep 14 10:22:20.373221 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3599/7774] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 10:22:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:22:20.684423 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-835d96b3-d34e-4a6e-a326-ec1d7b9601c5 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:22:20.685030 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-835d96b3-d34e-4a6e-a326-ec1d7b9601c5 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] [instance: e8fea9be-0267-4cec-881e-efec990a9651] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:22:20.692051 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-835d96b3-d34e-4a6e-a326-ec1d7b9601c5 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:20.692485 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-835d96b3-d34e-4a6e-a326-ec1d7b9601c5 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:20.692930 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-835d96b3-d34e-4a6e-a326-ec1d7b9601c5 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:20.693623 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-835d96b3-d34e-4a6e-a326-ec1d7b9601c5 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:20.694087 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-835d96b3-d34e-4a6e-a326-ec1d7b9601c5 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:20.694528 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-835d96b3-d34e-4a6e-a326-ec1d7b9601c5 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:20.825932 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-835d96b3-d34e-4a6e-a326-ec1d7b9601c5 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3f5ca85bbc47239ba0756cf56dab95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a3a1781e1dd43299dc8aa5013f947ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:22:20.833572 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-835d96b3-d34e-4a6e-a326-ec1d7b9601c5 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] 10.222.0.60 "GET /compute/v2.1/servers/e8fea9be-0267-4cec-881e-efec990a9651" status: 200 len: 1372 microversion: 2.1 time: 0.153219 Sep 14 10:22:20.834149 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4176/7775] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:22:20 2022] GET /compute/v2.1/servers/e8fea9be-0267-4cec-881e-efec990a9651 => generated 1372 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:22:21.858384 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a0ef4cf7-ce4e-4884-8011-4a0347bdca80 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:22:21.859132 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-a0ef4cf7-ce4e-4884-8011-4a0347bdca80 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] [instance: e8fea9be-0267-4cec-881e-efec990a9651] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:22:21.866632 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a0ef4cf7-ce4e-4884-8011-4a0347bdca80 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:21.867445 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a0ef4cf7-ce4e-4884-8011-4a0347bdca80 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:21.867783 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a0ef4cf7-ce4e-4884-8011-4a0347bdca80 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:21.868622 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a0ef4cf7-ce4e-4884-8011-4a0347bdca80 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:21.869180 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a0ef4cf7-ce4e-4884-8011-4a0347bdca80 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:21.870859 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a0ef4cf7-ce4e-4884-8011-4a0347bdca80 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:22.006875 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-a0ef4cf7-ce4e-4884-8011-4a0347bdca80 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3f5ca85bbc47239ba0756cf56dab95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a3a1781e1dd43299dc8aa5013f947ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:22:22.015313 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-a0ef4cf7-ce4e-4884-8011-4a0347bdca80 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] 10.222.0.60 "GET /compute/v2.1/servers/e8fea9be-0267-4cec-881e-efec990a9651" status: 200 len: 1372 microversion: 2.1 time: 0.161042 Sep 14 10:22:22.016196 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3600/7776] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:22:21 2022] GET /compute/v2.1/servers/e8fea9be-0267-4cec-881e-efec990a9651 => generated 1372 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:22:23.043844 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-b299006d-9066-42b2-89b3-bb5b612987fe tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:22:23.044472 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-b299006d-9066-42b2-89b3-bb5b612987fe tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] [instance: e8fea9be-0267-4cec-881e-efec990a9651] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:22:23.051691 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b299006d-9066-42b2-89b3-bb5b612987fe tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:23.052183 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b299006d-9066-42b2-89b3-bb5b612987fe tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:23.052628 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b299006d-9066-42b2-89b3-bb5b612987fe tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:23.053324 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b299006d-9066-42b2-89b3-bb5b612987fe tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:23.053787 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b299006d-9066-42b2-89b3-bb5b612987fe tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:23.054221 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-b299006d-9066-42b2-89b3-bb5b612987fe tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:23.185333 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-b299006d-9066-42b2-89b3-bb5b612987fe tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3f5ca85bbc47239ba0756cf56dab95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a3a1781e1dd43299dc8aa5013f947ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:22:23.193053 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-b299006d-9066-42b2-89b3-bb5b612987fe tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] 10.222.0.60 "GET /compute/v2.1/servers/e8fea9be-0267-4cec-881e-efec990a9651" status: 200 len: 1556 microversion: 2.1 time: 0.153762 Sep 14 10:22:23.193636 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4177/7777] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:22:23 2022] GET /compute/v2.1/servers/e8fea9be-0267-4cec-881e-efec990a9651 => generated 1556 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:22:23.215782 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-7b2c80b4-7fc3-4be8-b0ef-f77f5b860d24 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:22:23.216422 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-7b2c80b4-7fc3-4be8-b0ef-f77f5b860d24 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] [instance: e8fea9be-0267-4cec-881e-efec990a9651] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:22:23.223420 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7b2c80b4-7fc3-4be8-b0ef-f77f5b860d24 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:23.223915 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7b2c80b4-7fc3-4be8-b0ef-f77f5b860d24 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:23.224359 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7b2c80b4-7fc3-4be8-b0ef-f77f5b860d24 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:23.225059 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7b2c80b4-7fc3-4be8-b0ef-f77f5b860d24 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:23.225524 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7b2c80b4-7fc3-4be8-b0ef-f77f5b860d24 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:23.226021 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-7b2c80b4-7fc3-4be8-b0ef-f77f5b860d24 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:23.357108 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-7b2c80b4-7fc3-4be8-b0ef-f77f5b860d24 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3f5ca85bbc47239ba0756cf56dab95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a3a1781e1dd43299dc8aa5013f947ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:22:23.364947 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-7b2c80b4-7fc3-4be8-b0ef-f77f5b860d24 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] 10.222.0.60 "GET /compute/v2.1/servers/e8fea9be-0267-4cec-881e-efec990a9651" status: 200 len: 1556 microversion: 2.1 time: 0.153619 Sep 14 10:22:23.365527 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3601/7778] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:22:23 2022] GET /compute/v2.1/servers/e8fea9be-0267-4cec-881e-efec990a9651 => generated 1556 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:22:25.210781 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-1372e674-bb60-4f6d-812c-cf55bbf9c198 req-a231303e-fda0-4b3b-9e06-e5c125297b6e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8fea9be-0267-4cec-881e-efec990a9651", "tag": "a766c385-b4b2-4667-b3d8-24523465aaaa"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:22:25.221522 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-1372e674-bb60-4f6d-812c-cf55bbf9c198 req-a231303e-fda0-4b3b-9e06-e5c125297b6e service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:25.222095 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-1372e674-bb60-4f6d-812c-cf55bbf9c198 req-a231303e-fda0-4b3b-9e06-e5c125297b6e service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:25.222612 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-1372e674-bb60-4f6d-812c-cf55bbf9c198 req-a231303e-fda0-4b3b-9e06-e5c125297b6e service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:25.235589 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-1372e674-bb60-4f6d-812c-cf55bbf9c198 req-a231303e-fda0-4b3b-9e06-e5c125297b6e service nova] Creating event network-changed:a766c385-b4b2-4667-b3d8-24523465aaaa for instance e8fea9be-0267-4cec-881e-efec990a9651 on n-h1-836830-18 Sep 14 10:22:25.241284 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-1372e674-bb60-4f6d-812c-cf55bbf9c198 req-a231303e-fda0-4b3b-9e06-e5c125297b6e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034485 Sep 14 10:22:25.242195 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4178/7779] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 10:22:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:24:24.276208 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=28 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:24:24.277001 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=60 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:24:24.278334 n-d-836830-18 devstack@n-api.service[128758]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 10:24:24.278478 n-d-836830-18 devstack@n-api.service[128758]: Wed Sep 14 10:24:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e8fea9be-0267-4cec-881e-efec990a9651/action (ip 10.222.0.60) !!! Sep 14 10:24:24.283204 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-deb07ea8-c922-4327-a21c-4cc6e6df5a45 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-748346224"}} {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:24:24.285513 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-deb07ea8-c922-4327-a21c-4cc6e6df5a45 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] [instance: e8fea9be-0267-4cec-881e-efec990a9651] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:24:24.293774 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-deb07ea8-c922-4327-a21c-4cc6e6df5a45 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:24:24.294260 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-deb07ea8-c922-4327-a21c-4cc6e6df5a45 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:24:24.294706 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-deb07ea8-c922-4327-a21c-4cc6e6df5a45 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:24:24.295429 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-deb07ea8-c922-4327-a21c-4cc6e6df5a45 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:24:24.295894 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-deb07ea8-c922-4327-a21c-4cc6e6df5a45 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:24:24.296323 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-deb07ea8-c922-4327-a21c-4cc6e6df5a45 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:24:24.501195 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-deb07ea8-c922-4327-a21c-4cc6e6df5a45 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] 10.222.0.60 "POST /compute/v2.1/servers/e8fea9be-0267-4cec-881e-efec990a9651/action" status: 202 len: 0 microversion: 2.1 time: 0.227071 Sep 14 10:24:24.501839 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3602/7780] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Sep 14 10:24:24 2022] POST /compute/v2.1/servers/e8fea9be-0267-4cec-881e-efec990a9651/action => generated 0 bytes in 229 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 14 10:24:31.014920 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:24:31.015824 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=66 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:24:31.017080 n-d-836830-18 devstack@n-api.service[128759]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 14 10:24:31.017312 n-d-836830-18 devstack@n-api.service[128759]: Wed Sep 14 10:24:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.60) !!! Sep 14 10:24:31.018510 n-d-836830-18 devstack@n-api.service[128759]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 10:24:31.018825 n-d-836830-18 devstack@n-api.service[128759]: Wed Sep 14 10:24:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.60) !!! Sep 14 10:24:31.025109 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-c727a692-f2c4-4222-92ca-6e5a45157f23 req-8022bd1e-1a90-4dd4-8c7f-2d720d752360 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8fea9be-0267-4cec-881e-efec990a9651", "name": "network-vif-plugged", "status": "completed", "tag": "a766c385-b4b2-4667-b3d8-24523465aaaa"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:24:31.039162 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-c727a692-f2c4-4222-92ca-6e5a45157f23 req-8022bd1e-1a90-4dd4-8c7f-2d720d752360 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:24:31.040004 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-c727a692-f2c4-4222-92ca-6e5a45157f23 req-8022bd1e-1a90-4dd4-8c7f-2d720d752360 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:24:31.040639 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-c727a692-f2c4-4222-92ca-6e5a45157f23 req-8022bd1e-1a90-4dd4-8c7f-2d720d752360 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:24:31.059321 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-c727a692-f2c4-4222-92ca-6e5a45157f23 req-8022bd1e-1a90-4dd4-8c7f-2d720d752360 service nova] Creating event network-vif-plugged:a766c385-b4b2-4667-b3d8-24523465aaaa for instance e8fea9be-0267-4cec-881e-efec990a9651 on n-h1-836830-18 Sep 14 10:24:31.065078 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-c727a692-f2c4-4222-92ca-6e5a45157f23 req-8022bd1e-1a90-4dd4-8c7f-2d720d752360 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052198 Sep 14 10:24:31.065968 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4179/7781] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 10:24:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:24:43.344119 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-e63697f6-6960-487e-9ba9-227b8a3b17e0 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:24:43.344740 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-e63697f6-6960-487e-9ba9-227b8a3b17e0 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] [instance: e8fea9be-0267-4cec-881e-efec990a9651] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:24:43.344922 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_cell1:SELECT=2 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:24:43.345758 n-d-836830-18 devstack@n-api.service[128759]: DEBUG dbcounter [-] [128759] Writing DB stats nova_api:SELECT=2 {{(pid=128759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:24:43.349661 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_api:SELECT=2 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:24:43.350339 n-d-836830-18 devstack@n-api.service[128758]: DEBUG dbcounter [-] [128758] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:24:43.355985 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e63697f6-6960-487e-9ba9-227b8a3b17e0 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:24:43.356747 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e63697f6-6960-487e-9ba9-227b8a3b17e0 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:24:43.357372 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e63697f6-6960-487e-9ba9-227b8a3b17e0 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:24:43.358229 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e63697f6-6960-487e-9ba9-227b8a3b17e0 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:24:43.358695 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e63697f6-6960-487e-9ba9-227b8a3b17e0 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:24:43.359363 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-e63697f6-6960-487e-9ba9-227b8a3b17e0 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:24:43.390303 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-e63697f6-6960-487e-9ba9-227b8a3b17e0 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] [instance: e8fea9be-0267-4cec-881e-efec990a9651] Going to try to terminate instance {{(pid=128758) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 10:24:43.415484 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-1ac0ec41-d2e9-4a6d-831e-4621cdf6d42f req-8371eb7d-cf91-4a2f-a0c0-8f63c55336e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8fea9be-0267-4cec-881e-efec990a9651", "tag": "a766c385-b4b2-4667-b3d8-24523465aaaa"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:24:43.425498 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-1ac0ec41-d2e9-4a6d-831e-4621cdf6d42f req-8371eb7d-cf91-4a2f-a0c0-8f63c55336e3 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:24:43.425984 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-1ac0ec41-d2e9-4a6d-831e-4621cdf6d42f req-8371eb7d-cf91-4a2f-a0c0-8f63c55336e3 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:24:43.426653 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-1ac0ec41-d2e9-4a6d-831e-4621cdf6d42f req-8371eb7d-cf91-4a2f-a0c0-8f63c55336e3 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:24:43.451400 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-1ac0ec41-d2e9-4a6d-831e-4621cdf6d42f req-8371eb7d-cf91-4a2f-a0c0-8f63c55336e3 service nova] Creating event network-changed:a766c385-b4b2-4667-b3d8-24523465aaaa for instance e8fea9be-0267-4cec-881e-efec990a9651 on n-h1-836830-18 Sep 14 10:24:43.456659 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-1ac0ec41-d2e9-4a6d-831e-4621cdf6d42f req-8371eb7d-cf91-4a2f-a0c0-8f63c55336e3 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114153 Sep 14 10:24:43.460359 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4180/7782] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 10:24:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:24:43.477941 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-e63697f6-6960-487e-9ba9-227b8a3b17e0 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] 10.222.0.60 "DELETE /compute/v2.1/servers/e8fea9be-0267-4cec-881e-efec990a9651" status: 204 len: 0 microversion: 2.1 time: 0.138049 Sep 14 10:24:43.478549 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3603/7783] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 10:24:43 2022] DELETE /compute/v2.1/servers/e8fea9be-0267-4cec-881e-efec990a9651 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 10:24:43.487391 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9dbe9cf0-2ddc-45a0-a345-e93f7e6816da tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:24:43.488192 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-9dbe9cf0-2ddc-45a0-a345-e93f7e6816da tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] [instance: e8fea9be-0267-4cec-881e-efec990a9651] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:24:43.499388 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9dbe9cf0-2ddc-45a0-a345-e93f7e6816da tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:24:43.503478 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9dbe9cf0-2ddc-45a0-a345-e93f7e6816da tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:24:43.504203 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9dbe9cf0-2ddc-45a0-a345-e93f7e6816da tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:24:43.506157 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9dbe9cf0-2ddc-45a0-a345-e93f7e6816da tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:24:43.506901 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9dbe9cf0-2ddc-45a0-a345-e93f7e6816da tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:24:43.507341 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-9dbe9cf0-2ddc-45a0-a345-e93f7e6816da tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:24:43.665989 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-9dbe9cf0-2ddc-45a0-a345-e93f7e6816da tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3f5ca85bbc47239ba0756cf56dab95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a3a1781e1dd43299dc8aa5013f947ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:24:43.673948 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-9dbe9cf0-2ddc-45a0-a345-e93f7e6816da tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] 10.222.0.60 "GET /compute/v2.1/servers/e8fea9be-0267-4cec-881e-efec990a9651" status: 200 len: 1681 microversion: 2.1 time: 0.190863 Sep 14 10:24:43.674536 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4181/7784] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:24:43 2022] GET /compute/v2.1/servers/e8fea9be-0267-4cec-881e-efec990a9651 => generated 1681 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:24:44.698916 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-22f69f03-ed6e-4182-bd52-41e5425d7a1d tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:24:44.699656 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-22f69f03-ed6e-4182-bd52-41e5425d7a1d tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] [instance: e8fea9be-0267-4cec-881e-efec990a9651] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:24:44.706680 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-22f69f03-ed6e-4182-bd52-41e5425d7a1d tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:24:44.707208 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-22f69f03-ed6e-4182-bd52-41e5425d7a1d tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:24:44.707656 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-22f69f03-ed6e-4182-bd52-41e5425d7a1d tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:24:44.708349 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-22f69f03-ed6e-4182-bd52-41e5425d7a1d tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:24:44.708812 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-22f69f03-ed6e-4182-bd52-41e5425d7a1d tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:24:44.709245 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-22f69f03-ed6e-4182-bd52-41e5425d7a1d tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:24:44.898241 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-22f69f03-ed6e-4182-bd52-41e5425d7a1d tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3f5ca85bbc47239ba0756cf56dab95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a3a1781e1dd43299dc8aa5013f947ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:24:44.906205 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-22f69f03-ed6e-4182-bd52-41e5425d7a1d tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] 10.222.0.60 "GET /compute/v2.1/servers/e8fea9be-0267-4cec-881e-efec990a9651" status: 200 len: 1681 microversion: 2.1 time: 0.211611 Sep 14 10:24:44.907048 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3604/7785] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:24:44 2022] GET /compute/v2.1/servers/e8fea9be-0267-4cec-881e-efec990a9651 => generated 1681 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:24:45.741328 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-2fb5a9e1-4ca8-43f6-95d8-ebe5c7fe20d8 req-d0e5458b-2aa1-4e39-94de-6be4db24cb78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8fea9be-0267-4cec-881e-efec990a9651", "name": "network-vif-deleted", "tag": "a766c385-b4b2-4667-b3d8-24523465aaaa"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:24:45.753770 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-2fb5a9e1-4ca8-43f6-95d8-ebe5c7fe20d8 req-d0e5458b-2aa1-4e39-94de-6be4db24cb78 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:24:45.754248 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-2fb5a9e1-4ca8-43f6-95d8-ebe5c7fe20d8 req-d0e5458b-2aa1-4e39-94de-6be4db24cb78 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:24:45.754676 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-2fb5a9e1-4ca8-43f6-95d8-ebe5c7fe20d8 req-d0e5458b-2aa1-4e39-94de-6be4db24cb78 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:24:45.766972 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-2fb5a9e1-4ca8-43f6-95d8-ebe5c7fe20d8 req-d0e5458b-2aa1-4e39-94de-6be4db24cb78 service nova] Creating event network-vif-deleted:a766c385-b4b2-4667-b3d8-24523465aaaa for instance e8fea9be-0267-4cec-881e-efec990a9651 on n-h1-836830-18 Sep 14 10:24:45.773438 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-2fb5a9e1-4ca8-43f6-95d8-ebe5c7fe20d8 req-d0e5458b-2aa1-4e39-94de-6be4db24cb78 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036149 Sep 14 10:24:45.774021 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4182/7786] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 10:24:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:24:45.930777 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-a2b03a29-6152-4115-9793-15873cd94b33 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:24:45.931447 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-a2b03a29-6152-4115-9793-15873cd94b33 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] [instance: e8fea9be-0267-4cec-881e-efec990a9651] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:24:45.938556 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a2b03a29-6152-4115-9793-15873cd94b33 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:24:45.939102 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a2b03a29-6152-4115-9793-15873cd94b33 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:24:45.939562 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a2b03a29-6152-4115-9793-15873cd94b33 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:24:45.940281 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a2b03a29-6152-4115-9793-15873cd94b33 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:24:45.940815 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a2b03a29-6152-4115-9793-15873cd94b33 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:24:45.941262 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a2b03a29-6152-4115-9793-15873cd94b33 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:24:45.974271 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a2b03a29-6152-4115-9793-15873cd94b33 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:24:45.974770 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a2b03a29-6152-4115-9793-15873cd94b33 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:24:45.975253 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-a2b03a29-6152-4115-9793-15873cd94b33 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:24:45.975720 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.objects.instance [None req-a2b03a29-6152-4115-9793-15873cd94b33 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lazy-loading 'fault' on Instance uuid e8fea9be-0267-4cec-881e-efec990a9651 {{(pid=128758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 10:24:46.017797 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-a2b03a29-6152-4115-9793-15873cd94b33 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3f5ca85bbc47239ba0756cf56dab95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a3a1781e1dd43299dc8aa5013f947ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:24:46.026497 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-a2b03a29-6152-4115-9793-15873cd94b33 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] 10.222.0.60 "GET /compute/v2.1/servers/e8fea9be-0267-4cec-881e-efec990a9651" status: 200 len: 1337 microversion: 2.1 time: 0.100506 Sep 14 10:24:46.027137 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3605/7787] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:24:45 2022] GET /compute/v2.1/servers/e8fea9be-0267-4cec-881e-efec990a9651 => generated 1337 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:24:47.050181 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-fd7dddc4-f2cb-4604-b2b5-80d8e184807e tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:24:47.050897 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-fd7dddc4-f2cb-4604-b2b5-80d8e184807e tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] [instance: e8fea9be-0267-4cec-881e-efec990a9651] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:24:47.058777 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fd7dddc4-f2cb-4604-b2b5-80d8e184807e tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:24:47.059306 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fd7dddc4-f2cb-4604-b2b5-80d8e184807e tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:24:47.060028 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fd7dddc4-f2cb-4604-b2b5-80d8e184807e tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:24:47.060728 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fd7dddc4-f2cb-4604-b2b5-80d8e184807e tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:24:47.061186 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fd7dddc4-f2cb-4604-b2b5-80d8e184807e tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:24:47.061614 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-fd7dddc4-f2cb-4604-b2b5-80d8e184807e tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:24:47.075497 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.wsgi [None req-fd7dddc4-f2cb-4604-b2b5-80d8e184807e tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] HTTP exception thrown: Instance e8fea9be-0267-4cec-881e-efec990a9651 could not be found. Sep 14 10:24:47.077159 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-fd7dddc4-f2cb-4604-b2b5-80d8e184807e tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Request method failure captured: Sep 14 10:24:47.077159 n-d-836830-18 devstack@n-api.service[128759]: request: GET /compute/v2.1/servers/e8fea9be-0267-4cec-881e-efec990a9651 HTTP/1.1 Sep 14 10:24:47.077159 n-d-836830-18 devstack@n-api.service[128759]: Accept: application/json Sep 14 10:24:47.077159 n-d-836830-18 devstack@n-api.service[128759]: Accept-Encoding: identity Sep 14 10:24:47.077159 n-d-836830-18 devstack@n-api.service[128759]: Connection: close Sep 14 10:24:47.077159 n-d-836830-18 devstack@n-api.service[128759]: Content-Length: 0 Sep 14 10:24:47.077159 n-d-836830-18 devstack@n-api.service[128759]: Content-Type: application/json Sep 14 10:24:47.077159 n-d-836830-18 devstack@n-api.service[128759]: Host: 10.222.0.60 Sep 14 10:24:47.077159 n-d-836830-18 devstack@n-api.service[128759]: Openstack-System-Scope: None Sep 14 10:24:47.077159 n-d-836830-18 devstack@n-api.service[128759]: User-Agent: python-urllib3/1.26.12 Sep 14 10:24:47.077159 n-d-836830-18 devstack@n-api.service[128759]: X-Auth-Token: gAAAAABjIaq1_DoghUQUaaJ9elvDgTb__YvFzm8iCgpgkWae6JRaJF6SUnh630CJxkGOod_MU6JbilYRNpofnyJHHMOGrUvroM6GKVgKruribO2R7Ltj1J8y1mjx2epT3u-aIwhMKyEGdE_RUcfzJ-3Uo26gxQ5sD27DpvabUdFMZ5AGuCcfzGY Sep 14 10:24:47.077159 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Id: None Sep 14 10:24:47.077159 n-d-836830-18 devstack@n-api.service[128759]: X-Domain-Name: None Sep 14 10:24:47.077159 n-d-836830-18 devstack@n-api.service[128759]: X-Identity-Status: Confirmed Sep 14 10:24:47.077159 n-d-836830-18 devstack@n-api.service[128759]: X-Is-Admin-Project: True Sep 14 10:24:47.077159 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Id: default Sep 14 10:24:47.077159 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Domain-Name: Default Sep 14 10:24:47.077159 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Id: 3a3a1781e1dd43299dc8aa5013f947ba Sep 14 10:24:47.077159 n-d-836830-18 devstack@n-api.service[128759]: X-Project-Name: tempest-TestSnapshotPattern-735267727 Sep 14 10:24:47.077159 n-d-836830-18 devstack@n-api.service[128759]: X-Role: reader,member Sep 14 10:24:47.077159 n-d-836830-18 devstack@n-api.service[128759]: X-Roles: reader,member Sep 14 10:24:47.077159 n-d-836830-18 devstack@n-api.service[128759]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/3a3a1781e1dd43299dc8aa5013f947ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_3a3a1781e1dd43299dc8aa5013f947ba"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3a3a1781e1dd43299dc8aa5013f947ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3a3a1781e1dd43299dc8aa5013f947ba"}]}] Sep 14 10:24:47.077159 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant: tempest-TestSnapshotPattern-735267727 Sep 14 10:24:47.077159 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Id: 3a3a1781e1dd43299dc8aa5013f947ba Sep 14 10:24:47.077159 n-d-836830-18 devstack@n-api.service[128759]: X-Tenant-Name: tempest-TestSnapshotPattern-735267727 Sep 14 10:24:47.077159 n-d-836830-18 devstack@n-api.service[128759]: X-User: tempest-TestSnapshotPattern-735267727-project Sep 14 10:24:47.077159 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Id: default Sep 14 10:24:47.077159 n-d-836830-18 devstack@n-api.service[128759]: X-User-Domain-Name: Default Sep 14 10:24:47.077159 n-d-836830-18 devstack@n-api.service[128759]: X-User-Id: 4d3f5ca85bbc47239ba0756cf56dab95 Sep 14 10:24:47.077159 n-d-836830-18 devstack@n-api.service[128759]: X-User-Name: tempest-TestSnapshotPattern-735267727-project Sep 14 10:24:47.077159 n-d-836830-18 devstack@n-api.service[128759]: method: > Sep 14 10:24:47.077159 n-d-836830-18 devstack@n-api.service[128759]: exception: Instance e8fea9be-0267-4cec-881e-efec990a9651 could not be found. Sep 14 10:24:47.077159 n-d-836830-18 devstack@n-api.service[128759]: action_args: {'id': 'e8fea9be-0267-4cec-881e-efec990a9651'} Sep 14 10:24:47.077159 n-d-836830-18 devstack@n-api.service[128759]: {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 10:24:47.077159 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:24:47.077159 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 10:24:47.077159 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 10:24:47.077159 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 10:24:47.077159 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 10:24:47.077159 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 10:24:47.077159 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 10:24:47.077159 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 10:24:47.077159 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 10:24:47.077159 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8fea9be-0267-4cec-881e-efec990a9651 could not be found. Sep 14 10:24:47.077159 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 10:24:47.077159 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:24:47.077159 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 10:24:47.077159 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:24:47.077159 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:24:47.077159 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:24:47.077159 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 10:24:47.077159 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 10:24:47.077159 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 10:24:47.077159 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 10:24:47.077159 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 10:24:47.077159 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 10:24:47.077159 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 10:24:47.077159 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 10:24:47.077159 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 10:24:47.077159 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 10:24:47.077159 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8fea9be-0267-4cec-881e-efec990a9651 could not be found. Sep 14 10:24:47.077159 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 10:24:47.077159 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:24:47.077159 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 10:24:47.082776 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:24:47.082776 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:24:47.082776 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:24:47.082776 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 10:24:47.082776 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 10:24:47.082776 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8fea9be-0267-4cec-881e-efec990a9651 could not be found. Sep 14 10:24:47.082776 n-d-836830-18 devstack@n-api.service[128759]: ERROR nova.api.openstack.wsgi Sep 14 10:24:47.082776 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-fd7dddc4-f2cb-4604-b2b5-80d8e184807e tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Returning 404 to user: Instance e8fea9be-0267-4cec-881e-efec990a9651 could not be found. {{(pid=128759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 10:24:47.082776 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-fd7dddc4-f2cb-4604-b2b5-80d8e184807e tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] 10.222.0.60 "GET /compute/v2.1/servers/e8fea9be-0267-4cec-881e-efec990a9651" status: 404 len: 111 microversion: 2.1 time: 0.032659 Sep 14 10:24:47.082776 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4183/7788] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:24:47 2022] GET /compute/v2.1/servers/e8fea9be-0267-4cec-881e-efec990a9651 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 10:24:48.422450 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-45b3fd18-8b0e-48e2-bc9b-c394f24d7b1f tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:24:48.423025 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-45b3fd18-8b0e-48e2-bc9b-c394f24d7b1f tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] [instance: 28df742c-2df9-4895-98dd-1bd582452de9] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:24:48.424974 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-a39baa9e-cb76-4850-8b5c-3819010aafd1 req-407b90ab-9211-4743-b574-5aafc56439ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28df742c-2df9-4895-98dd-1bd582452de9", "tag": "0c607d8b-3525-4d57-a19f-adb56cb951a3"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:24:48.431293 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-45b3fd18-8b0e-48e2-bc9b-c394f24d7b1f tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:24:48.431794 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-45b3fd18-8b0e-48e2-bc9b-c394f24d7b1f tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:24:48.432244 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-45b3fd18-8b0e-48e2-bc9b-c394f24d7b1f tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:24:48.432951 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-45b3fd18-8b0e-48e2-bc9b-c394f24d7b1f tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:24:48.433618 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-45b3fd18-8b0e-48e2-bc9b-c394f24d7b1f tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:24:48.434061 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-45b3fd18-8b0e-48e2-bc9b-c394f24d7b1f tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:24:48.437492 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-a39baa9e-cb76-4850-8b5c-3819010aafd1 req-407b90ab-9211-4743-b574-5aafc56439ef service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:24:48.438054 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-a39baa9e-cb76-4850-8b5c-3819010aafd1 req-407b90ab-9211-4743-b574-5aafc56439ef service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:24:48.438490 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-a39baa9e-cb76-4850-8b5c-3819010aafd1 req-407b90ab-9211-4743-b574-5aafc56439ef service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:24:48.450827 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-a39baa9e-cb76-4850-8b5c-3819010aafd1 req-407b90ab-9211-4743-b574-5aafc56439ef service nova] Creating event network-changed:0c607d8b-3525-4d57-a19f-adb56cb951a3 for instance 28df742c-2df9-4895-98dd-1bd582452de9 on n-h2-836830-18 Sep 14 10:24:48.456336 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-a39baa9e-cb76-4850-8b5c-3819010aafd1 req-407b90ab-9211-4743-b574-5aafc56439ef service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035406 Sep 14 10:24:48.457434 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4184/7789] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 10:24:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:24:48.465141 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-45b3fd18-8b0e-48e2-bc9b-c394f24d7b1f tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] [instance: 28df742c-2df9-4895-98dd-1bd582452de9] Going to try to terminate instance {{(pid=128758) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 10:24:48.561586 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-45b3fd18-8b0e-48e2-bc9b-c394f24d7b1f tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] 10.222.0.60 "DELETE /compute/v2.1/servers/28df742c-2df9-4895-98dd-1bd582452de9" status: 204 len: 0 microversion: 2.1 time: 0.142930 Sep 14 10:24:48.563097 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3606/7790] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Sep 14 10:24:48 2022] DELETE /compute/v2.1/servers/28df742c-2df9-4895-98dd-1bd582452de9 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 10:24:48.573194 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-4b7fc437-aced-4d8e-8030-883564fa6345 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Calling method '>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:24:48.574196 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.compute.api [None req-4b7fc437-aced-4d8e-8030-883564fa6345 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] [instance: 28df742c-2df9-4895-98dd-1bd582452de9] Fetching instance by UUID {{(pid=128759) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:24:48.581731 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4b7fc437-aced-4d8e-8030-883564fa6345 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:24:48.582371 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4b7fc437-aced-4d8e-8030-883564fa6345 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:24:48.582823 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4b7fc437-aced-4d8e-8030-883564fa6345 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:24:48.583631 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4b7fc437-aced-4d8e-8030-883564fa6345 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:24:48.584100 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4b7fc437-aced-4d8e-8030-883564fa6345 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:24:48.584531 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [None req-4b7fc437-aced-4d8e-8030-883564fa6345 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:24:48.730298 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.policy [None req-4b7fc437-aced-4d8e-8030-883564fa6345 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3f5ca85bbc47239ba0756cf56dab95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a3a1781e1dd43299dc8aa5013f947ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128759) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:24:48.738254 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-4b7fc437-aced-4d8e-8030-883564fa6345 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] 10.222.0.60 "GET /compute/v2.1/servers/28df742c-2df9-4895-98dd-1bd582452de9" status: 200 len: 1682 microversion: 2.1 time: 0.170015 Sep 14 10:24:48.738836 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4185/7791] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:24:48 2022] GET /compute/v2.1/servers/28df742c-2df9-4895-98dd-1bd582452de9 => generated 1682 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:24:49.763353 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-b634acc9-390f-40b3-97d6-232362b5953a tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:24:49.764095 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-b634acc9-390f-40b3-97d6-232362b5953a tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] [instance: 28df742c-2df9-4895-98dd-1bd582452de9] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:24:49.770852 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b634acc9-390f-40b3-97d6-232362b5953a tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:24:49.771411 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b634acc9-390f-40b3-97d6-232362b5953a tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:24:49.771867 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b634acc9-390f-40b3-97d6-232362b5953a tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:24:49.772583 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b634acc9-390f-40b3-97d6-232362b5953a tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:24:49.773063 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b634acc9-390f-40b3-97d6-232362b5953a tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:24:49.773500 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-b634acc9-390f-40b3-97d6-232362b5953a tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:24:49.913142 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.policy [None req-b634acc9-390f-40b3-97d6-232362b5953a tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3f5ca85bbc47239ba0756cf56dab95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a3a1781e1dd43299dc8aa5013f947ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128758) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:24:49.921393 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-b634acc9-390f-40b3-97d6-232362b5953a tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] 10.222.0.60 "GET /compute/v2.1/servers/28df742c-2df9-4895-98dd-1bd582452de9" status: 200 len: 1496 microversion: 2.1 time: 0.162351 Sep 14 10:24:49.922007 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3607/7792] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:24:49 2022] GET /compute/v2.1/servers/28df742c-2df9-4895-98dd-1bd582452de9 => generated 1496 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:24:49.951080 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [req-793d9e51-d05d-461a-b4ee-2e33b366e9af req-2d910423-61bd-47a6-ae68-9beebdfc5077 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28df742c-2df9-4895-98dd-1bd582452de9", "name": "network-vif-deleted", "tag": "0c607d8b-3525-4d57-a19f-adb56cb951a3"}]} {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:24:49.961219 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-793d9e51-d05d-461a-b4ee-2e33b366e9af req-2d910423-61bd-47a6-ae68-9beebdfc5077 service nova] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:24:49.961773 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-793d9e51-d05d-461a-b4ee-2e33b366e9af req-2d910423-61bd-47a6-ae68-9beebdfc5077 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:24:49.962193 n-d-836830-18 devstack@n-api.service[128759]: DEBUG oslo_concurrency.lockutils [req-793d9e51-d05d-461a-b4ee-2e33b366e9af req-2d910423-61bd-47a6-ae68-9beebdfc5077 service nova] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:24:49.974227 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.compute.server_external_events [req-793d9e51-d05d-461a-b4ee-2e33b366e9af req-2d910423-61bd-47a6-ae68-9beebdfc5077 service nova] Creating event network-vif-deleted:0c607d8b-3525-4d57-a19f-adb56cb951a3 for instance 28df742c-2df9-4895-98dd-1bd582452de9 on n-h2-836830-18 Sep 14 10:24:49.979056 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [req-793d9e51-d05d-461a-b4ee-2e33b366e9af req-2d910423-61bd-47a6-ae68-9beebdfc5077 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031712 Sep 14 10:24:49.979659 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4186/7793] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Sep 14 10:24:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:24:50.946253 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-77e0f832-4789-4aa1-a439-8e5730789b40 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Calling method '>' {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:24:50.946870 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.compute.api [None req-77e0f832-4789-4aa1-a439-8e5730789b40 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] [instance: 28df742c-2df9-4895-98dd-1bd582452de9] Fetching instance by UUID {{(pid=128758) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:24:50.953800 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-77e0f832-4789-4aa1-a439-8e5730789b40 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:24:50.954299 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-77e0f832-4789-4aa1-a439-8e5730789b40 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:24:50.954754 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-77e0f832-4789-4aa1-a439-8e5730789b40 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:24:50.955502 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-77e0f832-4789-4aa1-a439-8e5730789b40 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Acquiring lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:24:50.955978 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-77e0f832-4789-4aa1-a439-8e5730789b40 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:24:50.956426 n-d-836830-18 devstack@n-api.service[128758]: DEBUG oslo_concurrency.lockutils [None req-77e0f832-4789-4aa1-a439-8e5730789b40 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Lock "0a35f87f-19b7-4b11-98e6-8bcd07b0466f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:24:50.970494 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.wsgi [None req-77e0f832-4789-4aa1-a439-8e5730789b40 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] HTTP exception thrown: Instance 28df742c-2df9-4895-98dd-1bd582452de9 could not be found. Sep 14 10:24:50.972199 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-77e0f832-4789-4aa1-a439-8e5730789b40 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Request method failure captured: Sep 14 10:24:50.972199 n-d-836830-18 devstack@n-api.service[128758]: request: GET /compute/v2.1/servers/28df742c-2df9-4895-98dd-1bd582452de9 HTTP/1.1 Sep 14 10:24:50.972199 n-d-836830-18 devstack@n-api.service[128758]: Accept: application/json Sep 14 10:24:50.972199 n-d-836830-18 devstack@n-api.service[128758]: Accept-Encoding: identity Sep 14 10:24:50.972199 n-d-836830-18 devstack@n-api.service[128758]: Connection: close Sep 14 10:24:50.972199 n-d-836830-18 devstack@n-api.service[128758]: Content-Length: 0 Sep 14 10:24:50.972199 n-d-836830-18 devstack@n-api.service[128758]: Content-Type: application/json Sep 14 10:24:50.972199 n-d-836830-18 devstack@n-api.service[128758]: Host: 10.222.0.60 Sep 14 10:24:50.972199 n-d-836830-18 devstack@n-api.service[128758]: Openstack-System-Scope: None Sep 14 10:24:50.972199 n-d-836830-18 devstack@n-api.service[128758]: User-Agent: python-urllib3/1.26.12 Sep 14 10:24:50.972199 n-d-836830-18 devstack@n-api.service[128758]: X-Auth-Token: gAAAAABjIaq1_DoghUQUaaJ9elvDgTb__YvFzm8iCgpgkWae6JRaJF6SUnh630CJxkGOod_MU6JbilYRNpofnyJHHMOGrUvroM6GKVgKruribO2R7Ltj1J8y1mjx2epT3u-aIwhMKyEGdE_RUcfzJ-3Uo26gxQ5sD27DpvabUdFMZ5AGuCcfzGY Sep 14 10:24:50.972199 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Id: None Sep 14 10:24:50.972199 n-d-836830-18 devstack@n-api.service[128758]: X-Domain-Name: None Sep 14 10:24:50.972199 n-d-836830-18 devstack@n-api.service[128758]: X-Identity-Status: Confirmed Sep 14 10:24:50.972199 n-d-836830-18 devstack@n-api.service[128758]: X-Is-Admin-Project: True Sep 14 10:24:50.972199 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Id: default Sep 14 10:24:50.972199 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Domain-Name: Default Sep 14 10:24:50.972199 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Id: 3a3a1781e1dd43299dc8aa5013f947ba Sep 14 10:24:50.972199 n-d-836830-18 devstack@n-api.service[128758]: X-Project-Name: tempest-TestSnapshotPattern-735267727 Sep 14 10:24:50.972199 n-d-836830-18 devstack@n-api.service[128758]: X-Role: reader,member Sep 14 10:24:50.972199 n-d-836830-18 devstack@n-api.service[128758]: X-Roles: reader,member Sep 14 10:24:50.972199 n-d-836830-18 devstack@n-api.service[128758]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/3a3a1781e1dd43299dc8aa5013f947ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_3a3a1781e1dd43299dc8aa5013f947ba"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3a3a1781e1dd43299dc8aa5013f947ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3a3a1781e1dd43299dc8aa5013f947ba"}]}] Sep 14 10:24:50.972199 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant: tempest-TestSnapshotPattern-735267727 Sep 14 10:24:50.972199 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Id: 3a3a1781e1dd43299dc8aa5013f947ba Sep 14 10:24:50.972199 n-d-836830-18 devstack@n-api.service[128758]: X-Tenant-Name: tempest-TestSnapshotPattern-735267727 Sep 14 10:24:50.972199 n-d-836830-18 devstack@n-api.service[128758]: X-User: tempest-TestSnapshotPattern-735267727-project Sep 14 10:24:50.972199 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Id: default Sep 14 10:24:50.972199 n-d-836830-18 devstack@n-api.service[128758]: X-User-Domain-Name: Default Sep 14 10:24:50.972199 n-d-836830-18 devstack@n-api.service[128758]: X-User-Id: 4d3f5ca85bbc47239ba0756cf56dab95 Sep 14 10:24:50.972199 n-d-836830-18 devstack@n-api.service[128758]: X-User-Name: tempest-TestSnapshotPattern-735267727-project Sep 14 10:24:50.972199 n-d-836830-18 devstack@n-api.service[128758]: method: > Sep 14 10:24:50.972199 n-d-836830-18 devstack@n-api.service[128758]: exception: Instance 28df742c-2df9-4895-98dd-1bd582452de9 could not be found. Sep 14 10:24:50.972199 n-d-836830-18 devstack@n-api.service[128758]: action_args: {'id': '28df742c-2df9-4895-98dd-1bd582452de9'} Sep 14 10:24:50.972199 n-d-836830-18 devstack@n-api.service[128758]: {{(pid=128758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 10:24:50.972199 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:24:50.972199 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 10:24:50.972199 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 10:24:50.972199 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 10:24:50.972199 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 10:24:50.972199 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 10:24:50.972199 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 10:24:50.972199 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 10:24:50.972199 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 10:24:50.972199 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28df742c-2df9-4895-98dd-1bd582452de9 could not be found. Sep 14 10:24:50.972199 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 10:24:50.972199 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:24:50.972199 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 10:24:50.972199 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:24:50.972199 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:24:50.972199 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:24:50.972199 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 10:24:50.972199 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 10:24:50.972199 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 10:24:50.972199 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 10:24:50.972199 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 10:24:50.972199 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 10:24:50.972199 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 10:24:50.972199 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 10:24:50.972199 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 10:24:50.972199 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 10:24:50.972199 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28df742c-2df9-4895-98dd-1bd582452de9 could not be found. Sep 14 10:24:50.972199 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 10:24:50.972199 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:24:50.972199 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 10:24:50.977519 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:24:50.977519 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:24:50.977519 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:24:50.977519 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 10:24:50.977519 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 10:24:50.977519 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28df742c-2df9-4895-98dd-1bd582452de9 could not be found. Sep 14 10:24:50.977519 n-d-836830-18 devstack@n-api.service[128758]: ERROR nova.api.openstack.wsgi Sep 14 10:24:50.977519 n-d-836830-18 devstack@n-api.service[128758]: DEBUG nova.api.openstack.wsgi [None req-77e0f832-4789-4aa1-a439-8e5730789b40 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Returning 404 to user: Instance 28df742c-2df9-4895-98dd-1bd582452de9 could not be found. {{(pid=128758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 10:24:50.977519 n-d-836830-18 devstack@n-api.service[128758]: INFO nova.api.openstack.requestlog [None req-77e0f832-4789-4aa1-a439-8e5730789b40 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] 10.222.0.60 "GET /compute/v2.1/servers/28df742c-2df9-4895-98dd-1bd582452de9" status: 404 len: 111 microversion: 2.1 time: 0.031843 Sep 14 10:24:50.977519 n-d-836830-18 devstack@n-api.service[128758]: [pid: 128758|app: 0|req: 3608/7794] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Sep 14 10:24:50 2022] GET /compute/v2.1/servers/28df742c-2df9-4895-98dd-1bd582452de9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 10:24:51.134650 n-d-836830-18 devstack@n-api.service[128759]: DEBUG nova.api.openstack.wsgi [None req-9d088376-b71b-49c2-9cfa-aca5241d04f3 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] Calling method '.version_select at 0x7f7d48671ca0>' {{(pid=128759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:24:51.160346 n-d-836830-18 devstack@n-api.service[128759]: INFO nova.api.openstack.requestlog [None req-9d088376-b71b-49c2-9cfa-aca5241d04f3 tempest-TestSnapshotPattern-735267727 tempest-TestSnapshotPattern-735267727-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-783805181" status: 202 len: 0 microversion: 2.1 time: 0.031314 Sep 14 10:24:51.164170 n-d-836830-18 devstack@n-api.service[128759]: [pid: 128759|app: 0|req: 4187/7795] 10.222.0.60 () {58 vars in 1254 bytes} [Wed Sep 14 10:24:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-783805181 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)